2024-09-12T01:25:40.720 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T01:25:40.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:25:40.851 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/client-limits} email: ceph-qa@ceph.com first_in_suite: false job_id: '7901559' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - responding to mclientcaps\(revoke\) - not advance its oldest_client_tid - failing to advance its oldest client/flush tid - Too many inodes in cache - failing to respond to cache pressure - slow requests are blocked - failing to respond to capability release - MDS cache is too large - \(MDS_CLIENT_OLDEST_TID\) - \(MDS_CACHE_OVERSIZED\) sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 481 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 57/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 086c737fa75c22d521a3932c59b31c5e1d1c9ef4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBkinxHlcM/qfrumYYNrIAykDH371TpIl0sjZEw5oxIla421lMpybULXTxn8fD0WzbiYG1Lim/QCHuRMOwMFzh4= smithi105.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCdDg+pX1BhO8Z3BAvErdQMYi3oJIdJhaNP0zbsYOAyNzgqvvctwbc/3Vz/q3XnrM3zfQTeEqfRt1gsO+Gg0u/4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_client_limits teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T01:25:40.851 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa; will attempt to use it 2024-09-12T01:25:40.852 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa/tasks 2024-09-12T01:25:40.852 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T01:25:40.853 INFO:teuthology.task.internal:Checking packages... 2024-09-12T01:25:40.874 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-12T01:25:40.874 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T01:25:40.874 INFO:teuthology.packaging:ref: None 2024-09-12T01:25:40.874 INFO:teuthology.packaging:tag: None 2024-09-12T01:25:40.874 INFO:teuthology.packaging:branch: squid 2024-09-12T01:25:40.874 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:25:40.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-12T01:25:41.127 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-314.g086c737f 2024-09-12T01:25:41.128 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T01:25:41.329 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T01:25:41.329 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T01:25:41.377 INFO:teuthology.task.internal:Saving configuration 2024-09-12T01:25:41.395 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T01:25:41.400 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T01:25:41.431 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:20:51.420850', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBkinxHlcM/qfrumYYNrIAykDH371TpIl0sjZEw5oxIla421lMpybULXTxn8fD0WzbiYG1Lim/QCHuRMOwMFzh4='} 2024-09-12T01:25:41.462 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 01:20:51.419167', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCdDg+pX1BhO8Z3BAvErdQMYi3oJIdJhaNP0zbsYOAyNzgqvvctwbc/3Vz/q3XnrM3zfQTeEqfRt1gsO+Gg0u/4='} 2024-09-12T01:25:41.462 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T01:25:41.468 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-12T01:25:41.468 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-12T01:25:41.468 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T01:25:41.541 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feccd4e7be0>, signals=[15]) 2024-09-12T01:25:41.541 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T01:25:41.547 INFO:teuthology.task.internal:Opening connections... 2024-09-12T01:25:41.547 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:25:41.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:25:41.636 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:25:41.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:25:41.725 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T01:25:41.731 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-09-12T01:25:41.750 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-09-12T01:25:41.750 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-09-12T01:25:41.808 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-09-12T01:25:41.808 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-09-12T01:25:41.808 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-09-12T01:25:41.808 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:25:41.809 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-09-12T01:25:41.809 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:25:41.809 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:25:41.809 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-09-12T01:25:41.809 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:25:41.809 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:25:41.809 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:25:41.809 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:25:41.809 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:25:41.809 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:25:41.810 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-09-12T01:25:41.838 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2024-09-12T01:25:41.857 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2024-09-12T01:25:41.857 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2024-09-12T01:25:41.914 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2024-09-12T01:25:41.915 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="9" 2024-09-12T01:25:41.915 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2024-09-12T01:25:41.915 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2024-09-12T01:25:41.915 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="9" 2024-09-12T01:25:41.915 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el9" 2024-09-12T01:25:41.915 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T01:25:41.915 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2024-09-12T01:25:41.915 INFO:teuthology.orchestra.run.smithi105.stdout:LOGO="fedora-logo-icon" 2024-09-12T01:25:41.915 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T01:25:41.915 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2024-09-12T01:25:41.915 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T01:25:41.915 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T01:25:41.916 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T01:25:41.916 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2024-09-12T01:25:41.946 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T01:25:41.955 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T01:25:41.963 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T01:25:41.963 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:25:41.965 DEBUG:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2024-09-12T01:25:41.981 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T01:25:41.990 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T01:25:41.991 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:25:42.023 DEBUG:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2024-09-12T01:25:42.058 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T01:25:42.121 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T01:25:42.137 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-12T01:25:42.138 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-12T01:25:42.138 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-12T01:25:42.138 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:25:42.138 DEBUG:teuthology.orchestra.run.smithi105:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T01:25:42.155 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:25:42.156 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-12T01:25:42.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:25:42.157 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2024-09-12T01:25:42.214 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-503.el9.x86_64 2024-09-12T01:25:42.214 INFO:teuthology.task.kernel:Running kernel on smithi060: 5.14.0-503.el9.x86_64 2024-09-12T01:25:42.214 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum install -y kernel 2024-09-12T01:25:42.215 INFO:teuthology.orchestra.run.smithi105.stdout:5.14.0-503.el9.x86_64 2024-09-12T01:25:42.215 INFO:teuthology.task.kernel:Running kernel on smithi105: 5.14.0-503.el9.x86_64 2024-09-12T01:25:42.215 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum install -y kernel 2024-09-12T01:25:44.831 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.2 MB 00:00 2024-09-12T01:25:46.389 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - BaseOS 3.3 MB/s | 8.2 MB 00:02 2024-09-12T01:25:46.666 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-12T01:25:49.489 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-12T01:25:52.125 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-12T01:25:53.653 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 19 kB 00:00 2024-09-12T01:25:53.898 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T01:25:54.446 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T01:25:55.549 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-12T01:25:56.670 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-12T01:26:00.052 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T01:26:02.134 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-12T01:26:02.142 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T01:26:02.142 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T01:26:02.237 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-12T01:26:02.244 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-12T01:26:02.244 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-09-12T01:26:02.245 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-12T01:26:02.245 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-12T01:26:02.245 INFO:teuthology.orchestra.run.smithi060.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T01:26:02.245 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-12T01:26:02.245 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T01:26:02.245 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T01:26:02.245 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T01:26:02.245 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:26:02.245 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-12T01:26:02.245 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-12T01:26:02.245 INFO:teuthology.orchestra.run.smithi060.stdout:Install 4 Packages 2024-09-12T01:26:02.245 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:26:02.246 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 79 M 2024-09-12T01:26:02.246 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 126 M 2024-09-12T01:26:02.246 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-12T01:26:02.596 INFO:teuthology.orchestra.run.smithi060.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 234 kB/s | 23 kB 00:00 2024-09-12T01:26:02.996 INFO:teuthology.orchestra.run.smithi060.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-12T01:26:03.379 INFO:teuthology.orchestra.run.smithi060.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-12T01:26:03.696 INFO:teuthology.orchestra.run.smithi060.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-12T01:26:03.697 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:26:03.697 INFO:teuthology.orchestra.run.smithi060.stdout:Total 54 MB/s | 79 MB 00:01 2024-09-12T01:26:04.207 INFO:teuthology.orchestra.run.smithi105.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T01:26:04.207 INFO:teuthology.orchestra.run.smithi105.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T01:26:04.310 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2024-09-12T01:26:04.317 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2024-09-12T01:26:04.317 INFO:teuthology.orchestra.run.smithi105.stdout: Package Architecture Version Repository Size 2024-09-12T01:26:04.317 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2024-09-12T01:26:04.317 INFO:teuthology.orchestra.run.smithi105.stdout:Installing: 2024-09-12T01:26:04.318 INFO:teuthology.orchestra.run.smithi105.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T01:26:04.318 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2024-09-12T01:26:04.318 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T01:26:04.318 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T01:26:04.318 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T01:26:04.318 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:26:04.318 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2024-09-12T01:26:04.318 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2024-09-12T01:26:04.318 INFO:teuthology.orchestra.run.smithi105.stdout:Install 4 Packages 2024-09-12T01:26:04.318 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:26:04.319 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 79 M 2024-09-12T01:26:04.319 INFO:teuthology.orchestra.run.smithi105.stdout:Installed size: 126 M 2024-09-12T01:26:04.319 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2024-09-12T01:26:04.408 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-12T01:26:04.652 INFO:teuthology.orchestra.run.smithi105.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 290 kB/s | 23 kB 00:00 2024-09-12T01:26:04.782 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-12T01:26:04.782 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-12T01:26:05.002 INFO:teuthology.orchestra.run.smithi105.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-09-12T01:26:05.403 INFO:teuthology.orchestra.run.smithi105.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 42 MB/s | 35 MB 00:00 2024-09-12T01:26:05.779 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-12T01:26:05.779 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-12T01:26:05.794 INFO:teuthology.orchestra.run.smithi105.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-12T01:26:05.794 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:26:05.795 INFO:teuthology.orchestra.run.smithi105.stdout:Total 53 MB/s | 79 MB 00:01 2024-09-12T01:26:06.488 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2024-09-12T01:26:06.853 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2024-09-12T01:26:06.853 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2024-09-12T01:26:07.826 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2024-09-12T01:26:07.827 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2024-09-12T01:26:08.343 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-12T01:26:09.000 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:26:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:26:10.285 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2024-09-12T01:26:11.073 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:26:11.170 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:26:11.876 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:26:12.002 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:26:13.977 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:26:14.115 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:26:17.129 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:26:17.169 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:26:18.959 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:26:18.999 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:26:22.320 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:26:23.824 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:27:01.592 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:27:01.633 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:27:01.981 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:27:01.981 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:27:01.981 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:27:01.981 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:27:02.098 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:27:02.138 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:27:02.486 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:27:02.486 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T01:27:02.486 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T01:27:02.486 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T01:27:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:27:02.796 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:27:02.796 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-12T01:27:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T01:27:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T01:27:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T01:27:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T01:27:02.797 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:27:02.797 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-12T01:27:03.158 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:27:03.245 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:27:03.246 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:27:03.246 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T01:27:03.246 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T01:27:03.247 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T01:27:03.247 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-12T01:27:03.247 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T01:27:03.247 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:27:03.307 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:27:03.307 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:27:03.307 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2024-09-12T01:27:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T01:27:03.308 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:27:03.309 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2024-09-12T01:27:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T01:27:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T01:27:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T01:27:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T01:27:03.309 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:27:03.309 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2024-09-12T01:27:03.346 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2024-09-12T01:27:03.346 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2024-09-12T01:27:03.346 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.06 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 82.el9 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:Group : Unspecified 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 8274670 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : builder@centos.org 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : CentOS 2024-09-12T01:27:03.347 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T01:27:03.348 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2024-09-12T01:27:03.348 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2024-09-12T01:27:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:27:03.348 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T01:27:03.348 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T01:27:03.348 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T01:27:03.348 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2024-09-12T01:27:03.348 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:27:03.348 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T01:27:03.349 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T01:27:03.349 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 5.14.0-505.el9.x86_64 2024-09-12T01:27:03.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T01:27:03.657 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:27:03.739 INFO:teuthology.orchestra.run.smithi105.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:27:03.739 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:27:03.739 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T01:27:03.739 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T01:27:03.739 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T01:27:03.739 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-12T01:27:03.740 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi105.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T01:27:03.740 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T01:27:03.798 INFO:teuthology.orchestra.run.smithi105.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T01:27:03.798 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T01:27:03.798 DEBUG:teuthology.orchestra.run.smithi105:> sudo rpm -qi grub2-tools 2024-09-12T01:27:03.830 INFO:teuthology.orchestra.run.smithi105.stdout:Name : grub2-tools 2024-09-12T01:27:03.830 INFO:teuthology.orchestra.run.smithi105.stdout:Epoch : 1 2024-09-12T01:27:03.830 INFO:teuthology.orchestra.run.smithi105.stdout:Version : 2.06 2024-09-12T01:27:03.831 INFO:teuthology.orchestra.run.smithi105.stdout:Release : 82.el9 2024-09-12T01:27:03.831 INFO:teuthology.orchestra.run.smithi105.stdout:Architecture: x86_64 2024-09-12T01:27:03.831 INFO:teuthology.orchestra.run.smithi105.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T01:27:03.831 INFO:teuthology.orchestra.run.smithi105.stdout:Group : Unspecified 2024-09-12T01:27:03.831 INFO:teuthology.orchestra.run.smithi105.stdout:Size : 8274670 2024-09-12T01:27:03.831 INFO:teuthology.orchestra.run.smithi105.stdout:License : GPLv3+ 2024-09-12T01:27:03.831 INFO:teuthology.orchestra.run.smithi105.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T01:27:03.831 INFO:teuthology.orchestra.run.smithi105.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T01:27:03.831 INFO:teuthology.orchestra.run.smithi105.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T01:27:03.831 INFO:teuthology.orchestra.run.smithi105.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T01:27:03.831 INFO:teuthology.orchestra.run.smithi105.stdout:Packager : builder@centos.org 2024-09-12T01:27:03.831 INFO:teuthology.orchestra.run.smithi105.stdout:Vendor : CentOS 2024-09-12T01:27:03.832 INFO:teuthology.orchestra.run.smithi105.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T01:27:03.832 INFO:teuthology.orchestra.run.smithi105.stdout:Summary : Support tools for GRUB. 2024-09-12T01:27:03.832 INFO:teuthology.orchestra.run.smithi105.stdout:Description : 2024-09-12T01:27:03.832 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:27:03.832 INFO:teuthology.orchestra.run.smithi105.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T01:27:03.832 INFO:teuthology.orchestra.run.smithi105.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T01:27:03.832 INFO:teuthology.orchestra.run.smithi105.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T01:27:03.832 INFO:teuthology.orchestra.run.smithi105.stdout:hardware devices. 2024-09-12T01:27:03.832 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:27:03.832 INFO:teuthology.orchestra.run.smithi105.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T01:27:03.833 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T01:27:03.833 INFO:teuthology.task.kernel:Updating grub on smithi105 to boot 5.14.0-505.el9.x86_64 2024-09-12T01:27:03.833 DEBUG:teuthology.orchestra.run.smithi105:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T01:27:03.979 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2024-09-12T01:27:04.517 INFO:teuthology.orchestra.run.smithi105.stderr:Generating grub configuration file ... 2024-09-12T01:27:05.284 INFO:teuthology.orchestra.run.smithi060.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T01:27:05.319 INFO:teuthology.orchestra.run.smithi060.stderr:done 2024-09-12T01:27:05.322 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-09-12T01:27:05.337 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.vKVouMnolQ 2024-09-12T01:27:05.337 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vKVouMnolQ 2024-09-12T01:27:05.403 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.vKVouMnolQ 2024-09-12T01:27:05.536 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.vKVouMnolQ is 6KB 2024-09-12T01:27:05.585 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.vKVouMnolQ 2024-09-12T01:27:05.599 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T01:27:05.664 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T01:27:05.664 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T01:27:05.665 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T01:27:05.665 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T01:27:05.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T01:27:05.807 INFO:teuthology.orchestra.run.smithi105.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T01:27:05.813 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2024-09-12T01:27:05.840 INFO:teuthology.orchestra.run.smithi105.stderr:done 2024-09-12T01:27:05.842 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-09-12T01:27:05.858 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.NZW7lnDBSK 2024-09-12T01:27:05.858 DEBUG:teuthology.orchestra.run.smithi105:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NZW7lnDBSK 2024-09-12T01:27:05.924 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.NZW7lnDBSK 2024-09-12T01:27:06.061 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.NZW7lnDBSK is 6KB 2024-09-12T01:27:06.081 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.NZW7lnDBSK 2024-09-12T01:27:06.096 DEBUG:teuthology.orchestra.run.smithi105:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T01:27:06.164 INFO:teuthology.orchestra.run.smithi105.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T01:27:06.165 INFO:teuthology.orchestra.run.smithi105.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T01:27:06.165 INFO:teuthology.orchestra.run.smithi105.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T01:27:06.165 INFO:teuthology.orchestra.run.smithi105.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T01:27:06.166 DEBUG:teuthology.orchestra.run.smithi105:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T01:27:06.309 DEBUG:teuthology.orchestra.run.smithi105:> sudo shutdown -r now 2024-09-12T01:27:35.841 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-12T01:27:35.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-12T01:27:35.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:27:36.318 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-12T01:27:36.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-12T01:27:36.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:27:54.173 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.60 2024-09-12T01:27:54.685 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-09-12T01:28:03.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-12T01:28:03.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:28:03.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-12T01:28:03.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:28:06.781 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.105 2024-09-12T01:28:18.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-12T01:28:18.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:28:50.584 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-09-12T01:28:51.253 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-12T01:28:51.253 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-505.el9.x86_64"... 2024-09-12T01:28:51.253 DEBUG:teuthology.orchestra.run.smithi105:> uname -r 2024-09-12T01:28:51.295 INFO:teuthology.orchestra.run.smithi105.stdout:5.14.0-505.el9.x86_64 2024-09-12T01:28:51.295 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T01:28:51.295 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T01:28:51.296 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T01:28:52.296 DEBUG:teuthology.parallel:result is None 2024-09-12T01:29:03.192 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T01:29:15.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-12T01:29:15.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:29:15.505 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-12T01:29:15.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-12T01:29:15.850 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-12T01:29:15.851 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-12T01:29:15.867 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-505.el9.x86_64 2024-09-12T01:29:15.868 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T01:29:15.868 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T01:29:15.868 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T01:29:16.869 DEBUG:teuthology.parallel:result is None 2024-09-12T01:29:16.869 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T01:29:16.876 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T01:29:16.876 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:29:16.878 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T01:29:16.898 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T01:29:16.935 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T01:29:16.945 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T01:29:16.946 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:29:16.948 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T01:29:16.984 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T01:29:16.990 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T01:29:16.990 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:29:17.020 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T01:29:17.113 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:29:17.134 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:29:17.137 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:29:17.150 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T01:29:17.152 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T01:29:17.159 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T01:29:17.159 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:29:17.161 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T01:29:17.190 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T01:29:17.199 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T01:29:17.199 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:29:17.231 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T01:29:17.249 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:29:17.343 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:29:17.385 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:29:17.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:29:17.513 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:29:17.513 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:29:17.580 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:29:17.634 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T01:29:17.682 DEBUG:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:29:17.774 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T01:29:17.808 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:29:17.808 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T01:29:17.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-09-12T01:29:17.878 DEBUG:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2024-09-12T01:29:17.927 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:29:17.980 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:29:18.367 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T01:29:18.375 INFO:teuthology.task.internal:Starting timer... 2024-09-12T01:29:18.375 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T01:29:18.386 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T01:29:18.395 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-12T01:29:18.395 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-09-12T01:29:18.460 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-09-12T01:29:18.463 DEBUG:teuthology.orchestra.run.smithi105:> sudo service auditd rotate 2024-09-12T01:29:18.504 INFO:teuthology.orchestra.run.smithi105.stdout:Rotating logs: 2024-09-12T01:29:18.506 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T01:29:18.506 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-09-12T01:29:18.536 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-09-12T01:29:18.536 DEBUG:teuthology.orchestra.run.smithi105:> /usr/sbin/getenforce 2024-09-12T01:29:18.568 INFO:teuthology.orchestra.run.smithi105.stdout:Permissive 2024-09-12T01:29:18.568 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi105.front.sepia.ceph.com': 'permissive'} 2024-09-12T01:29:18.569 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:29:18.604 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:29:18.605 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:29:18.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:29:18.635 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T01:29:18.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:29:18.692 DEBUG:teuthology.orchestra.run.smithi105:> sudo /usr/sbin/setenforce permissive 2024-09-12T01:29:18.726 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T01:29:18.735 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T01:29:18.748 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T01:29:18.749 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi105.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T01:33:06.289 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi105.front.sepia.ceph.com')] 2024-09-12T01:33:06.291 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-12T01:33:06.292 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:33:06.377 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-12T01:33:06.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-12T01:33:06.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-12T01:33:06.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T01:33:06.545 DEBUG:teuthology.orchestra.run.smithi105:> true 2024-09-12T01:33:06.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2024-09-12T01:33:06.632 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T01:33:06.646 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T01:33:06.646 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:33:06.646 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:33:06.649 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T01:33:06.649 DEBUG:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:33:06.678 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:33:06.694 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:33:06.699 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T01:33:06.713 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T01:33:06.719 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-09-12T01:33:06.731 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-09-12T01:33:06.738 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: ntpd: command not found 2024-09-12T01:33:06.746 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:33:06.748 INFO:teuthology.orchestra.run.smithi105.stdout:506 Cannot talk to daemon 2024-09-12T01:33:06.761 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:33:06.761 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T01:33:06.775 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T01:33:06.828 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:33:06.829 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:33:06.831 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:33:06.831 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2024-09-12T01:33:06.832 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:33:06.832 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:33:06.832 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:33:06.832 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:33:06.836 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:33:06.836 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-12T01:33:06.836 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:33:06.837 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:33:06.837 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:33:06.837 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:33:06.837 INFO:teuthology.run_tasks:Running task install... 2024-09-12T01:33:06.846 DEBUG:teuthology.task.install:project ceph 2024-09-12T01:33:06.846 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-12T01:33:06.846 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-12T01:33:06.846 INFO:teuthology.task.install:Using flavor: default 2024-09-12T01:33:06.852 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T01:33:06.852 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-12T01:33:06.852 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:33:06.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:33:06.855 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'tag': None, 'wait_for_package': False} 2024-09-12T01:33:06.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:33:07.001 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:33:07.001 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:33:07.024 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/ 2024-09-12T01:33:07.024 INFO:teuthology.task.install.rpm:Package version is 19.1.1-298.gb53b6d3e 2024-09-12T01:33:07.168 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:33:07.168 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:33:07.168 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:33:07.173 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T01:33:07.173 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:33:07.173 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T01:33:07.195 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:33:07.196 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:33:07.199 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-12T01:33:07.199 DEBUG:teuthology.orchestra.run.smithi105:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T01:33:07.263 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:33:07.264 DEBUG:teuthology.orchestra.run.smithi105:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T01:33:07.339 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:33:07.340 DEBUG:teuthology.orchestra.run.smithi105:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T01:33:07.404 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-09-12T01:33:07.404 INFO:teuthology.orchestra.run.smithi105.stdout:check_obsoletes = 1 2024-09-12T01:33:07.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-09-12T01:33:07.406 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum clean all 2024-09-12T01:33:07.637 INFO:teuthology.orchestra.run.smithi105.stdout:45 files removed 2024-09-12T01:33:07.638 INFO:teuthology.orchestra.run.smithi060.stdout:45 files removed 2024-09-12T01:33:07.663 DEBUG:teuthology.orchestra.run.smithi105:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:33:07.666 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-12T01:33:08.572 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 138 kB/s | 84 kB 00:00 2024-09-12T01:33:08.586 INFO:teuthology.orchestra.run.smithi105.stdout:ceph packages for x86_64 131 kB/s | 84 kB 00:00 2024-09-12T01:33:09.078 INFO:teuthology.orchestra.run.smithi105.stdout:ceph noarch packages 26 kB/s | 12 kB 00:00 2024-09-12T01:33:09.081 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-09-12T01:33:09.690 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 3.3 kB/s | 1.9 kB 00:00 2024-09-12T01:33:09.695 INFO:teuthology.orchestra.run.smithi105.stdout:ceph source packages 3.3 kB/s | 1.9 kB 00:00 2024-09-12T01:33:10.362 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.2 MB 00:00 2024-09-12T01:33:10.873 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 7.2 MB/s | 8.2 MB 00:01 2024-09-12T01:33:13.230 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-09-12T01:33:14.100 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 20 MB 00:02 2024-09-12T01:33:17.723 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.5 MB 00:00 2024-09-12T01:33:18.928 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.5 MB 00:00 2024-09-12T01:33:19.424 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 19 kB 00:00 2024-09-12T01:33:20.361 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T01:33:20.393 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 102 kB/s | 19 kB 00:00 2024-09-12T01:33:21.255 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-12T01:33:25.759 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-12T01:33:26.961 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-12T01:33:28.103 INFO:teuthology.orchestra.run.smithi105.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:33:28.103 INFO:teuthology.orchestra.run.smithi105.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:33:28.114 INFO:teuthology.orchestra.run.smithi105.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:33:28.115 INFO:teuthology.orchestra.run.smithi105.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:33:28.116 INFO:teuthology.orchestra.run.smithi105.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:33:28.117 INFO:teuthology.orchestra.run.smithi105.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:33:28.119 INFO:teuthology.orchestra.run.smithi105.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:33:28.121 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:33:28.122 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:33:28.183 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2024-09-12T01:33:28.211 INFO:teuthology.orchestra.run.smithi105.stdout:====================================================================================== 2024-09-12T01:33:28.212 INFO:teuthology.orchestra.run.smithi105.stdout: Package Arch Version Repository Size 2024-09-12T01:33:28.212 INFO:teuthology.orchestra.run.smithi105.stdout:====================================================================================== 2024-09-12T01:33:28.212 INFO:teuthology.orchestra.run.smithi105.stdout:Installing: 2024-09-12T01:33:28.212 INFO:teuthology.orchestra.run.smithi105.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:33:28.212 INFO:teuthology.orchestra.run.smithi105.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:33:28.212 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:33:28.212 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:33:28.212 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:33:28.212 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:33:28.212 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:33:28.212 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:33:28.213 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:33:28.214 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:33:28.214 INFO:teuthology.orchestra.run.smithi105.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:33:28.214 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:33:28.214 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:33:28.214 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:33:28.214 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:33:28.214 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:33:28.214 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:33:28.214 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:33:28.214 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:33:28.214 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:33:28.214 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrading: 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:33:28.215 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2024-09-12T01:33:28.216 INFO:teuthology.orchestra.run.smithi105.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:33:28.216 INFO:teuthology.orchestra.run.smithi105.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:33:28.216 INFO:teuthology.orchestra.run.smithi105.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:33:28.216 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:33:28.216 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:33:28.216 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:33:28.216 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:33:28.216 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:33:28.216 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:33:28.216 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:33:28.216 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:33:28.216 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:33:28.217 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:33:28.218 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:33:28.219 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:33:28.219 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:33:28.219 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:33:28.219 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:33:28.219 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:33:28.219 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:33:28.219 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:33:28.219 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:33:28.219 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:33:28.219 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:33:28.220 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:33:28.221 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:33:28.222 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:33:28.223 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:33:28.223 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:33:28.223 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:33:28.223 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:33:28.223 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:33:28.223 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:33:28.223 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:33:28.223 INFO:teuthology.orchestra.run.smithi105.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:33:28.223 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:33:28.223 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:33:28.223 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:33:28.223 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout:Installing weak dependencies: 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:33:28.224 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:33:28.225 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2024-09-12T01:33:28.225 INFO:teuthology.orchestra.run.smithi105.stdout:====================================================================================== 2024-09-12T01:33:28.225 INFO:teuthology.orchestra.run.smithi105.stdout:Install 148 Packages 2024-09-12T01:33:28.225 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrade 8 Packages 2024-09-12T01:33:28.225 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:33:28.225 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 226 M 2024-09-12T01:33:28.225 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2024-09-12T01:33:29.002 INFO:teuthology.orchestra.run.smithi105.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 54 kB/s | 6.5 kB 00:00 2024-09-12T01:33:29.203 INFO:teuthology.orchestra.run.smithi105.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 4.4 MB/s | 897 kB 00:00 2024-09-12T01:33:29.295 INFO:teuthology.orchestra.run.smithi105.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 1.5 MB/s | 145 kB 00:00 2024-09-12T01:33:29.371 INFO:teuthology.orchestra.run.smithi105.stdout:(4/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-12T01:33:29.387 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:33:29.387 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T01:33:29.397 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-12T01:33:29.398 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-12T01:33:29.400 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-12T01:33:29.401 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-12T01:33:29.403 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-12T01:33:29.405 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-12T01:33:29.406 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-12T01:33:29.462 INFO:teuthology.orchestra.run.smithi105.stdout:(5/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 17 MB/s | 1.5 MB 00:00 2024-09-12T01:33:29.472 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-12T01:33:29.482 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-12T01:33:29.482 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-12T01:33:29.483 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-12T01:33:29.483 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-12T01:33:29.483 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-12T01:33:29.483 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 6.5 k 2024-09-12T01:33:29.483 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.4 M 2024-09-12T01:33:29.483 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 897 k 2024-09-12T01:33:29.483 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 145 k 2024-09-12T01:33:29.483 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 1.5 M 2024-09-12T01:33:29.483 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 146 k 2024-09-12T01:33:29.483 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 3.6 M 2024-09-12T01:33:29.483 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 7.4 M 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 49 k 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 11 M 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 49 M 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 285 k 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 765 k 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 228 k 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 27 k 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 18 k 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 32 k 2024-09-12T01:33:29.484 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 752 k 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 127 k 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 162 k 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 321 k 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 301 k 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 100 k 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 85 k 2024-09-12T01:33:29.485 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.1 M 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 171 k 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.4 M 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 3.2 M 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-12T01:33:29.486 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 21 M 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 32 k 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 2.4 M 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 249 k 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 4.7 M 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 17 M 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:19.1.1-298.gb53b6d3e.el9 ceph-noarch 16 k 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 25 k 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T01:33:29.487 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 163 k 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 506 k 2024-09-12T01:33:29.488 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 5.3 M 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T01:33:29.489 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T01:33:29.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T01:33:29.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-12T01:33:29.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T01:33:29.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T01:33:29.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T01:33:29.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 45 k 2024-09-12T01:33:29.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:19.1.1-298.gb53b6d3e.el9 ceph 136 k 2024-09-12T01:33:29.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T01:33:29.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T01:33:29.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T01:33:29.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T01:33:29.490 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-12T01:33:29.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-12T01:33:29.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T01:33:29.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T01:33:29.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T01:33:29.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T01:33:29.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T01:33:29.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T01:33:29.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T01:33:29.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T01:33:29.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T01:33:29.491 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T01:33:29.492 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T01:33:29.492 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T01:33:29.492 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T01:33:29.492 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T01:33:29.492 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T01:33:29.492 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T01:33:29.492 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T01:33:29.492 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T01:33:29.492 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T01:33:29.492 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T01:33:29.492 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T01:33:29.492 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T01:33:29.493 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T01:33:29.493 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T01:33:29.493 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T01:33:29.493 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T01:33:29.493 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T01:33:29.493 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T01:33:29.493 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T01:33:29.493 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T01:33:29.493 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T01:33:29.494 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T01:33:29.494 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-12T01:33:29.494 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T01:33:29.494 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T01:33:29.494 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T01:33:29.494 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T01:33:29.494 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T01:33:29.494 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T01:33:29.494 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T01:33:29.494 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T01:33:29.494 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T01:33:29.494 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T01:33:29.495 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-12T01:33:29.496 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2024-09-12T01:33:29.496 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T01:33:29.496 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:33:29.496 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-12T01:33:29.496 INFO:teuthology.orchestra.run.smithi060.stdout:====================================================================================== 2024-09-12T01:33:29.496 INFO:teuthology.orchestra.run.smithi060.stdout:Install 148 Packages 2024-09-12T01:33:29.496 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 8 Packages 2024-09-12T01:33:29.496 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:33:29.497 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 226 M 2024-09-12T01:33:29.497 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-12T01:33:29.572 INFO:teuthology.orchestra.run.smithi105.stdout:(6/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 8.9 MB/s | 2.4 MB 00:00 2024-09-12T01:33:29.812 INFO:teuthology.orchestra.run.smithi105.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-12T01:33:30.013 INFO:teuthology.orchestra.run.smithi105.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 19 MB/s | 21 MB 00:01 2024-09-12T01:33:30.029 INFO:teuthology.orchestra.run.smithi060.stdout:(1/156): ceph-19.1.1-298.gb53b6d3e.el9.x86_64.r 41 kB/s | 6.5 kB 00:00 2024-09-12T01:33:30.063 INFO:teuthology.orchestra.run.smithi105.stdout:(9/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9. 505 kB/s | 25 kB 00:00 2024-09-12T01:33:30.646 INFO:teuthology.orchestra.run.smithi060.stdout:(2/156): ceph-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.4 MB/s | 897 kB 00:00 2024-09-12T01:33:30.696 INFO:teuthology.orchestra.run.smithi060.stdout:(3/156): ceph-immutable-object-cache-19.1.1-298 2.8 MB/s | 145 kB 00:00 2024-09-12T01:33:30.863 INFO:teuthology.orchestra.run.smithi105.stdout:(10/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 13 MB/s | 17 MB 00:01 2024-09-12T01:33:30.922 INFO:teuthology.orchestra.run.smithi105.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-12T01:33:30.989 INFO:teuthology.orchestra.run.smithi105.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 406 kB/s | 27 kB 00:00 2024-09-12T01:33:31.055 INFO:teuthology.orchestra.run.smithi105.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 477 kB/s | 32 kB 00:00 2024-09-12T01:33:31.080 INFO:teuthology.orchestra.run.smithi060.stdout:(4/156): ceph-mds-19.1.1-298.gb53b6d3e.el9.x86_ 6.2 MB/s | 2.4 MB 00:00 2024-09-12T01:33:31.192 INFO:teuthology.orchestra.run.smithi105.stdout:(14/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9 7.7 MB/s | 11 MB 00:01 2024-09-12T01:33:31.231 INFO:teuthology.orchestra.run.smithi105.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 4.2 MB/s | 752 kB 00:00 2024-09-12T01:33:31.247 INFO:teuthology.orchestra.run.smithi060.stdout:(5/156): ceph-base-19.1.1-298.gb53b6d3e.el9.x86 3.9 MB/s | 5.4 MB 00:01 2024-09-12T01:33:31.256 INFO:teuthology.orchestra.run.smithi105.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.4 MB/s | 163 kB 00:00 2024-09-12T01:33:31.282 INFO:teuthology.orchestra.run.smithi105.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T01:33:31.315 INFO:teuthology.orchestra.run.smithi105.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 8.5 MB/s | 506 kB 00:00 2024-09-12T01:33:31.331 INFO:teuthology.orchestra.run.smithi060.stdout:(6/156): ceph-mgr-19.1.1-298.gb53b6d3e.el9.x86_ 6.1 MB/s | 1.5 MB 00:00 2024-09-12T01:33:31.382 INFO:teuthology.orchestra.run.smithi105.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 674 kB/s | 45 kB 00:00 2024-09-12T01:33:31.474 INFO:teuthology.orchestra.run.smithi105.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.4 MB/s | 136 kB 00:00 2024-09-12T01:33:31.566 INFO:teuthology.orchestra.run.smithi105.stdout:(21/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.7 MB/s | 162 kB 00:00 2024-09-12T01:33:31.650 INFO:teuthology.orchestra.run.smithi105.stdout:(22/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 15 MB/s | 5.3 MB 00:00 2024-09-12T01:33:31.683 INFO:teuthology.orchestra.run.smithi105.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 321 kB 00:00 2024-09-12T01:33:31.742 INFO:teuthology.orchestra.run.smithi105.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 3.2 MB/s | 301 kB 00:00 2024-09-12T01:33:31.767 INFO:teuthology.orchestra.run.smithi105.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.2 MB/s | 100 kB 00:00 2024-09-12T01:33:31.818 INFO:teuthology.orchestra.run.smithi105.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.1 MB/s | 85 kB 00:00 2024-09-12T01:33:31.856 INFO:teuthology.orchestra.run.smithi060.stdout:(7/156): ceph-mon-19.1.1-298.gb53b6d3e.el9.x86_ 7.7 MB/s | 4.7 MB 00:00 2024-09-12T01:33:31.893 INFO:teuthology.orchestra.run.smithi105.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-12T01:33:31.976 INFO:teuthology.orchestra.run.smithi105.stdout:(28/156): ceph-grafana-dashboards-19.1.1-298.gb 382 kB/s | 32 kB 00:00 2024-09-12T01:33:32.077 INFO:teuthology.orchestra.run.smithi105.stdout:(29/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 1.4 MB/s | 146 kB 00:00 2024-09-12T01:33:32.203 INFO:teuthology.orchestra.run.smithi105.stdout:(30/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 7.1 MB/s | 3.1 MB 00:00 2024-09-12T01:33:32.661 INFO:teuthology.orchestra.run.smithi105.stdout:(31/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 19 MB/s | 49 MB 00:02 2024-09-12T01:33:32.745 INFO:teuthology.orchestra.run.smithi105.stdout:(32/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 5.3 MB/s | 3.6 MB 00:00 2024-09-12T01:33:32.770 INFO:teuthology.orchestra.run.smithi105.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.2 MB/s | 249 kB 00:00 2024-09-12T01:33:32.789 INFO:teuthology.orchestra.run.smithi060.stdout:(8/156): ceph-common-19.1.1-298.gb53b6d3e.el9.x 7.3 MB/s | 21 MB 00:02 2024-09-12T01:33:32.795 INFO:teuthology.orchestra.run.smithi105.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 988 kB/s | 49 kB 00:00 2024-09-12T01:33:32.821 INFO:teuthology.orchestra.run.smithi105.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 328 kB/s | 16 kB 00:00 2024-09-12T01:33:32.846 INFO:teuthology.orchestra.run.smithi105.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.5 MB/s | 285 kB 00:00 2024-09-12T01:33:32.906 INFO:teuthology.orchestra.run.smithi060.stdout:(9/156): ceph-radosgw-19.1.1-298.gb53b6d3e.el9. 10 MB/s | 11 MB 00:01 2024-09-12T01:33:32.931 INFO:teuthology.orchestra.run.smithi060.stdout:(10/156): ceph-selinux-19.1.1-298.gb53b6d3e.el9 178 kB/s | 25 kB 00:00 2024-09-12T01:33:32.955 INFO:teuthology.orchestra.run.smithi105.stdout:(37/156): ceph-mgr-diskprediction-local-19.1.1- 9.9 MB/s | 7.4 MB 00:00 2024-09-12T01:33:32.980 INFO:teuthology.orchestra.run.smithi105.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 137 kB/s | 18 kB 00:00 2024-09-12T01:33:32.990 INFO:teuthology.orchestra.run.smithi060.stdout:(11/156): cephfs-mirror-19.1.1-298.gb53b6d3e.el 3.8 MB/s | 228 kB 00:00 2024-09-12T01:33:33.005 INFO:teuthology.orchestra.run.smithi105.stdout:(39/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 4.1 MB/s | 765 kB 00:00 2024-09-12T01:33:33.049 INFO:teuthology.orchestra.run.smithi060.stdout:(12/156): cephfs-shell-19.1.1-298.gb53b6d3e.el9 464 kB/s | 27 kB 00:00 2024-09-12T01:33:33.107 INFO:teuthology.orchestra.run.smithi060.stdout:(13/156): libcephfs-devel-19.1.1-298.gb53b6d3e. 543 kB/s | 32 kB 00:00 2024-09-12T01:33:33.114 INFO:teuthology.orchestra.run.smithi105.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 503 kB/s | 80 kB 00:00 2024-09-12T01:33:33.172 INFO:teuthology.orchestra.run.smithi105.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-12T01:33:33.222 INFO:teuthology.orchestra.run.smithi105.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-12T01:33:33.265 INFO:teuthology.orchestra.run.smithi105.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-12T01:33:33.290 INFO:teuthology.orchestra.run.smithi105.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-12T01:33:33.291 INFO:teuthology.orchestra.run.smithi060.stdout:(14/156): ceph-osd-19.1.1-298.gb53b6d3e.el9.x86 8.6 MB/s | 17 MB 00:01 2024-09-12T01:33:33.315 INFO:teuthology.orchestra.run.smithi105.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-12T01:33:33.324 INFO:teuthology.orchestra.run.smithi060.stdout:(15/156): libcephfs2-19.1.1-298.gb53b6d3e.el9.x 3.4 MB/s | 752 kB 00:00 2024-09-12T01:33:33.341 INFO:teuthology.orchestra.run.smithi105.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-12T01:33:33.350 INFO:teuthology.orchestra.run.smithi060.stdout:(16/156): libcephsqlite-19.1.1-298.gb53b6d3e.el 2.7 MB/s | 163 kB 00:00 2024-09-12T01:33:33.375 INFO:teuthology.orchestra.run.smithi060.stdout:(17/156): librados-devel-19.1.1-298.gb53b6d3e.e 2.5 MB/s | 127 kB 00:00 2024-09-12T01:33:33.409 INFO:teuthology.orchestra.run.smithi060.stdout:(18/156): libradosstriper1-19.1.1-298.gb53b6d3e 8.4 MB/s | 506 kB 00:00 2024-09-12T01:33:33.459 INFO:teuthology.orchestra.run.smithi060.stdout:(19/156): python3-ceph-argparse-19.1.1-298.gb53 907 kB/s | 45 kB 00:00 2024-09-12T01:33:33.532 INFO:teuthology.orchestra.run.smithi105.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 989 kB/s | 215 kB 00:00 2024-09-12T01:33:33.534 INFO:teuthology.orchestra.run.smithi060.stdout:(20/156): python3-ceph-common-19.1.1-298.gb53b6 1.8 MB/s | 136 kB 00:00 2024-09-12T01:33:33.558 INFO:teuthology.orchestra.run.smithi105.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 3.1 MB/s | 689 kB 00:00 2024-09-12T01:33:33.635 INFO:teuthology.orchestra.run.smithi060.stdout:(21/156): librgw2-19.1.1-298.gb53b6d3e.el9.x86_ 21 MB/s | 5.3 MB 00:00 2024-09-12T01:33:33.638 INFO:teuthology.orchestra.run.smithi105.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-09-12T01:33:33.660 INFO:teuthology.orchestra.run.smithi060.stdout:(22/156): python3-cephfs-19.1.1-298.gb53b6d3e.e 1.3 MB/s | 162 kB 00:00 2024-09-12T01:33:33.675 INFO:teuthology.orchestra.run.smithi105.stdout:(50/156): python3-cryptography-36.0.1-4.el9.x86 2.4 MB/s | 1.2 MB 00:00 2024-09-12T01:33:33.685 INFO:teuthology.orchestra.run.smithi060.stdout:(23/156): python3-rados-19.1.1-298.gb53b6d3e.el 6.3 MB/s | 321 kB 00:00 2024-09-12T01:33:33.700 INFO:teuthology.orchestra.run.smithi105.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 350 kB/s | 22 kB 00:00 2024-09-12T01:33:33.710 INFO:teuthology.orchestra.run.smithi060.stdout:(24/156): python3-rbd-19.1.1-298.gb53b6d3e.el9. 5.9 MB/s | 301 kB 00:00 2024-09-12T01:33:33.736 INFO:teuthology.orchestra.run.smithi060.stdout:(25/156): python3-rgw-19.1.1-298.gb53b6d3e.el9. 1.9 MB/s | 100 kB 00:00 2024-09-12T01:33:33.742 INFO:teuthology.orchestra.run.smithi105.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 785 kB/s | 33 kB 00:00 2024-09-12T01:33:33.761 INFO:teuthology.orchestra.run.smithi060.stdout:(26/156): rbd-fuse-19.1.1-298.gb53b6d3e.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-12T01:33:33.809 INFO:teuthology.orchestra.run.smithi105.stdout:(53/156): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-12T01:33:33.811 INFO:teuthology.orchestra.run.smithi060.stdout:(27/156): rbd-nbd-19.1.1-298.gb53b6d3e.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-12T01:33:33.851 INFO:teuthology.orchestra.run.smithi105.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-12T01:33:33.885 INFO:teuthology.orchestra.run.smithi105.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 1.5 MB/s | 313 kB 00:00 2024-09-12T01:33:33.903 INFO:teuthology.orchestra.run.smithi060.stdout:(28/156): rbd-mirror-19.1.1-298.gb53b6d3e.el9.x 19 MB/s | 3.1 MB 00:00 2024-09-12T01:33:33.910 INFO:teuthology.orchestra.run.smithi105.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-12T01:33:33.920 INFO:teuthology.orchestra.run.smithi060.stdout:(29/156): ceph-grafana-dashboards-19.1.1-298.gb 294 kB/s | 32 kB 00:00 2024-09-12T01:33:33.943 INFO:teuthology.orchestra.run.smithi105.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T01:33:33.954 INFO:teuthology.orchestra.run.smithi060.stdout:(30/156): ceph-mgr-cephadm-19.1.1-298.gb53b6d3e 2.8 MB/s | 146 kB 00:00 2024-09-12T01:33:33.961 INFO:teuthology.orchestra.run.smithi105.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-12T01:33:34.011 INFO:teuthology.orchestra.run.smithi105.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-09-12T01:33:34.053 INFO:teuthology.orchestra.run.smithi105.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-12T01:33:34.070 INFO:teuthology.orchestra.run.smithi105.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-12T01:33:34.103 INFO:teuthology.orchestra.run.smithi105.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-12T01:33:34.129 INFO:teuthology.orchestra.run.smithi105.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-12T01:33:34.162 INFO:teuthology.orchestra.run.smithi105.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-12T01:33:34.188 INFO:teuthology.orchestra.run.smithi105.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 659 kB/s | 38 kB 00:00 2024-09-12T01:33:34.213 INFO:teuthology.orchestra.run.smithi105.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-09-12T01:33:34.313 INFO:teuthology.orchestra.run.smithi105.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-12T01:33:34.355 INFO:teuthology.orchestra.run.smithi105.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-12T01:33:34.362 INFO:teuthology.orchestra.run.smithi060.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-12T01:33:34.397 INFO:teuthology.orchestra.run.smithi105.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 11 MB/s | 910 kB 00:00 2024-09-12T01:33:34.422 INFO:teuthology.orchestra.run.smithi105.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-12T01:33:34.429 INFO:teuthology.orchestra.run.smithi060.stdout:(32/156): ceph-mgr-dashboard-19.1.1-298.gb53b6d 7.0 MB/s | 3.6 MB 00:00 2024-09-12T01:33:34.455 INFO:teuthology.orchestra.run.smithi060.stdout:(33/156): ceph-mgr-modules-core-19.1.1-298.gb53 2.6 MB/s | 249 kB 00:00 2024-09-12T01:33:34.480 INFO:teuthology.orchestra.run.smithi060.stdout:(34/156): ceph-mgr-rook-19.1.1-298.gb53b6d3e.el 981 kB/s | 49 kB 00:00 2024-09-12T01:33:34.498 INFO:teuthology.orchestra.run.smithi105.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 15 MB/s | 4.9 MB 00:00 2024-09-12T01:33:34.505 INFO:teuthology.orchestra.run.smithi060.stdout:(35/156): ceph-prometheus-alerts-19.1.1-298.gb5 328 kB/s | 16 kB 00:00 2024-09-12T01:33:34.530 INFO:teuthology.orchestra.run.smithi060.stdout:(36/156): ceph-volume-19.1.1-298.gb53b6d3e.el9. 5.5 MB/s | 285 kB 00:00 2024-09-12T01:33:34.540 INFO:teuthology.orchestra.run.smithi105.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.6 MB/s | 1.0 MB 00:00 2024-09-12T01:33:34.564 INFO:teuthology.orchestra.run.smithi060.stdout:(37/156): cephadm-19.1.1-298.gb53b6d3e.el9.noar 13 MB/s | 765 kB 00:00 2024-09-12T01:33:34.565 INFO:teuthology.orchestra.run.smithi105.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-12T01:33:34.589 INFO:teuthology.orchestra.run.smithi060.stdout:(38/156): cephfs-top-19.1.1-298.gb53b6d3e.el9.n 312 kB/s | 18 kB 00:00 2024-09-12T01:33:34.607 INFO:teuthology.orchestra.run.smithi105.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-12T01:33:34.682 INFO:teuthology.orchestra.run.smithi105.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-09-12T01:33:34.708 INFO:teuthology.orchestra.run.smithi105.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-12T01:33:34.731 INFO:teuthology.orchestra.run.smithi060.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-12T01:33:34.741 INFO:teuthology.orchestra.run.smithi105.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-12T01:33:34.766 INFO:teuthology.orchestra.run.smithi105.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 436 kB/s | 26 kB 00:00 2024-09-12T01:33:34.792 INFO:teuthology.orchestra.run.smithi105.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-12T01:33:34.817 INFO:teuthology.orchestra.run.smithi105.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-12T01:33:34.842 INFO:teuthology.orchestra.run.smithi105.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-12T01:33:34.934 INFO:teuthology.orchestra.run.smithi105.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-12T01:33:34.960 INFO:teuthology.orchestra.run.smithi105.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-12T01:33:34.985 INFO:teuthology.orchestra.run.smithi105.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-12T01:33:35.010 INFO:teuthology.orchestra.run.smithi105.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-12T01:33:35.036 INFO:teuthology.orchestra.run.smithi105.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-12T01:33:35.061 INFO:teuthology.orchestra.run.smithi105.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-12T01:33:35.086 INFO:teuthology.orchestra.run.smithi105.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-12T01:33:35.111 INFO:teuthology.orchestra.run.smithi105.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-12T01:33:35.137 INFO:teuthology.orchestra.run.smithi105.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T01:33:35.162 INFO:teuthology.orchestra.run.smithi105.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T01:33:35.173 INFO:teuthology.orchestra.run.smithi060.stdout:(40/156): ceph-test-19.1.1-298.gb53b6d3e.el9.x8 21 MB/s | 49 MB 00:02 2024-09-12T01:33:35.198 INFO:teuthology.orchestra.run.smithi060.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 409 kB/s | 191 kB 00:00 2024-09-12T01:33:35.237 INFO:teuthology.orchestra.run.smithi105.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-12T01:33:35.263 INFO:teuthology.orchestra.run.smithi105.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 415 kB/s | 42 kB 00:00 2024-09-12T01:33:35.288 INFO:teuthology.orchestra.run.smithi105.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 880 kB/s | 44 kB 00:00 2024-09-12T01:33:35.299 INFO:teuthology.orchestra.run.smithi060.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 801 kB 00:00 2024-09-12T01:33:35.313 INFO:teuthology.orchestra.run.smithi105.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-12T01:33:35.339 INFO:teuthology.orchestra.run.smithi105.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-12T01:33:35.341 INFO:teuthology.orchestra.run.smithi060.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 8.6 MB/s | 1.2 MB 00:00 2024-09-12T01:33:35.364 INFO:teuthology.orchestra.run.smithi105.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-12T01:33:35.374 INFO:teuthology.orchestra.run.smithi060.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T01:33:35.389 INFO:teuthology.orchestra.run.smithi105.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T01:33:35.400 INFO:teuthology.orchestra.run.smithi060.stdout:(45/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-12T01:33:35.414 INFO:teuthology.orchestra.run.smithi105.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T01:33:35.425 INFO:teuthology.orchestra.run.smithi060.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-12T01:33:35.440 INFO:teuthology.orchestra.run.smithi105.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T01:33:35.450 INFO:teuthology.orchestra.run.smithi060.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-12T01:33:35.465 INFO:teuthology.orchestra.run.smithi105.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T01:33:35.490 INFO:teuthology.orchestra.run.smithi105.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-12T01:33:35.492 INFO:teuthology.orchestra.run.smithi060.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-12T01:33:35.626 INFO:teuthology.orchestra.run.smithi060.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 803 kB/s | 107 kB 00:00 2024-09-12T01:33:35.718 INFO:teuthology.orchestra.run.smithi060.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 236 kB/s | 22 kB 00:00 2024-09-12T01:33:35.760 INFO:teuthology.orchestra.run.smithi060.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.0 MB/s | 689 kB 00:00 2024-09-12T01:33:35.766 INFO:teuthology.orchestra.run.smithi105.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-12T01:33:35.802 INFO:teuthology.orchestra.run.smithi060.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-12T01:33:35.816 INFO:teuthology.orchestra.run.smithi105.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T01:33:35.827 INFO:teuthology.orchestra.run.smithi060.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-09-12T01:33:35.849 INFO:teuthology.orchestra.run.smithi105.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-12T01:33:35.852 INFO:teuthology.orchestra.run.smithi060.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-12T01:33:35.883 INFO:teuthology.orchestra.run.smithi105.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 754 kB/s | 19 kB 00:00 2024-09-12T01:33:35.885 INFO:teuthology.orchestra.run.smithi060.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-12T01:33:35.911 INFO:teuthology.orchestra.run.smithi060.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 190 kB/s | 11 kB 00:00 2024-09-12T01:33:35.945 INFO:teuthology.orchestra.run.smithi060.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T01:33:35.970 INFO:teuthology.orchestra.run.smithi060.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-09-12T01:33:36.025 INFO:teuthology.orchestra.run.smithi105.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-12T01:33:36.050 INFO:teuthology.orchestra.run.smithi105.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T01:33:36.076 INFO:teuthology.orchestra.run.smithi105.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T01:33:36.087 INFO:teuthology.orchestra.run.smithi060.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-12T01:33:36.101 INFO:teuthology.orchestra.run.smithi105.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T01:33:36.120 INFO:teuthology.orchestra.run.smithi060.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-09-12T01:33:36.126 INFO:teuthology.orchestra.run.smithi105.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T01:33:36.146 INFO:teuthology.orchestra.run.smithi060.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-12T01:33:36.168 INFO:teuthology.orchestra.run.smithi105.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-12T01:33:36.193 INFO:teuthology.orchestra.run.smithi105.stdout:(113/156): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-09-12T01:33:36.229 INFO:teuthology.orchestra.run.smithi060.stdout:(62/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-12T01:33:36.235 INFO:teuthology.orchestra.run.smithi105.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 8.0 MB/s | 548 kB 00:00 2024-09-12T01:33:36.246 INFO:teuthology.orchestra.run.smithi060.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-09-12T01:33:36.261 INFO:teuthology.orchestra.run.smithi105.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T01:33:36.286 INFO:teuthology.orchestra.run.smithi105.stdout:(116/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 471 kB/s | 43 kB 00:00 2024-09-12T01:33:36.305 INFO:teuthology.orchestra.run.smithi060.stdout:(64/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2024-09-12T01:33:36.322 INFO:teuthology.orchestra.run.smithi060.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 512 kB/s | 38 kB 00:00 2024-09-12T01:33:36.347 INFO:teuthology.orchestra.run.smithi060.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-12T01:33:36.370 INFO:teuthology.orchestra.run.smithi105.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 130 kB/s | 14 kB 00:00 2024-09-12T01:33:36.395 INFO:teuthology.orchestra.run.smithi105.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.6 MB/s | 172 kB 00:00 2024-09-12T01:33:36.429 INFO:teuthology.orchestra.run.smithi105.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-12T01:33:36.454 INFO:teuthology.orchestra.run.smithi105.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-12T01:33:36.479 INFO:teuthology.orchestra.run.smithi105.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T01:33:36.513 INFO:teuthology.orchestra.run.smithi105.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-12T01:33:36.538 INFO:teuthology.orchestra.run.smithi105.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-12T01:33:36.563 INFO:teuthology.orchestra.run.smithi105.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-12T01:33:36.580 INFO:teuthology.orchestra.run.smithi060.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-09-12T01:33:36.589 INFO:teuthology.orchestra.run.smithi105.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-09-12T01:33:36.614 INFO:teuthology.orchestra.run.smithi105.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 785 kB/s | 19 kB 00:00 2024-09-12T01:33:36.639 INFO:teuthology.orchestra.run.smithi105.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-12T01:33:36.690 INFO:teuthology.orchestra.run.smithi105.stdout:(128/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-09-12T01:33:36.723 INFO:teuthology.orchestra.run.smithi105.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-12T01:33:36.739 INFO:teuthology.orchestra.run.smithi060.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 5.6 MB/s | 910 kB 00:00 2024-09-12T01:33:36.749 INFO:teuthology.orchestra.run.smithi105.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T01:33:36.774 INFO:teuthology.orchestra.run.smithi105.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T01:33:36.789 INFO:teuthology.orchestra.run.smithi060.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.7 MB/s | 137 kB 00:00 2024-09-12T01:33:36.832 INFO:teuthology.orchestra.run.smithi105.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-12T01:33:36.858 INFO:teuthology.orchestra.run.smithi105.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-12T01:33:36.900 INFO:teuthology.orchestra.run.smithi105.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-09-12T01:33:36.925 INFO:teuthology.orchestra.run.smithi105.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-12T01:33:36.950 INFO:teuthology.orchestra.run.smithi105.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-12T01:33:36.976 INFO:teuthology.orchestra.run.smithi105.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-12T01:33:37.001 INFO:teuthology.orchestra.run.smithi105.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.7 MB/s | 188 kB 00:00 2024-09-12T01:33:37.026 INFO:teuthology.orchestra.run.smithi105.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-12T01:33:37.051 INFO:teuthology.orchestra.run.smithi105.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T01:33:37.077 INFO:teuthology.orchestra.run.smithi105.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T01:33:37.102 INFO:teuthology.orchestra.run.smithi105.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T01:33:37.115 INFO:teuthology.orchestra.run.smithi060.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 6.1 MB/s | 4.9 MB 00:00 2024-09-12T01:33:37.136 INFO:teuthology.orchestra.run.smithi105.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-12T01:33:37.161 INFO:teuthology.orchestra.run.smithi105.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 807 kB/s | 20 kB 00:00 2024-09-12T01:33:37.196 INFO:teuthology.orchestra.run.smithi105.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.4 MB/s | 427 kB 00:00 2024-09-12T01:33:37.221 INFO:teuthology.orchestra.run.smithi105.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.1 MB/s | 191 kB 00:00 2024-09-12T01:33:37.280 INFO:teuthology.orchestra.run.smithi105.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-12T01:33:37.315 INFO:teuthology.orchestra.run.smithi060.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.1 MB/s | 1.0 MB 00:00 2024-09-12T01:33:37.407 INFO:teuthology.orchestra.run.smithi060.stdout:(72/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2024-09-12T01:33:37.432 INFO:teuthology.orchestra.run.smithi060.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 749 kB/s | 87 kB 00:00 2024-09-12T01:33:37.482 INFO:teuthology.orchestra.run.smithi060.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-12T01:33:37.539 INFO:teuthology.orchestra.run.smithi105.stdout:(148/156): librados2-19.1.1-298.gb53b6d3e.el9.x 11 MB/s | 3.4 MB 00:00 2024-09-12T01:33:37.597 INFO:teuthology.orchestra.run.smithi105.stdout:(149/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-12T01:33:37.599 INFO:teuthology.orchestra.run.smithi060.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 7.1 MB/s | 5.8 MB 00:00 2024-09-12T01:33:37.625 INFO:teuthology.orchestra.run.smithi060.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-12T01:33:37.675 INFO:teuthology.orchestra.run.smithi060.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-12T01:33:37.700 INFO:teuthology.orchestra.run.smithi060.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-12T01:33:37.726 INFO:teuthology.orchestra.run.smithi060.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-12T01:33:37.751 INFO:teuthology.orchestra.run.smithi060.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-12T01:33:37.776 INFO:teuthology.orchestra.run.smithi060.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-12T01:33:37.860 INFO:teuthology.orchestra.run.smithi060.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-12T01:33:37.939 INFO:teuthology.orchestra.run.smithi105.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 5.3 MB/s | 1.8 MB 00:00 2024-09-12T01:33:37.943 INFO:teuthology.orchestra.run.smithi060.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-12T01:33:37.990 INFO:teuthology.orchestra.run.smithi105.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 829 kB/s | 41 kB 00:00 2024-09-12T01:33:38.002 INFO:teuthology.orchestra.run.smithi060.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-12T01:33:38.061 INFO:teuthology.orchestra.run.smithi060.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 723 kB/s | 42 kB 00:00 2024-09-12T01:33:38.082 INFO:teuthology.orchestra.run.smithi105.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 2.7 MB/s | 249 kB 00:00 2024-09-12T01:33:38.144 INFO:teuthology.orchestra.run.smithi060.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-09-12T01:33:38.190 INFO:teuthology.orchestra.run.smithi105.stdout:(153/156): NetworkManager-1.49.90-1.el9.x86_64. 3.6 MB/s | 2.3 MB 00:00 2024-09-12T01:33:38.203 INFO:teuthology.orchestra.run.smithi060.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-12T01:33:38.346 INFO:teuthology.orchestra.run.smithi060.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.9 MB/s | 279 kB 00:00 2024-09-12T01:33:38.391 INFO:teuthology.orchestra.run.smithi105.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 4.4 MB/s | 1.4 MB 00:00 2024-09-12T01:33:38.395 INFO:teuthology.orchestra.run.smithi060.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T01:33:38.445 INFO:teuthology.orchestra.run.smithi060.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-12T01:33:38.549 INFO:teuthology.orchestra.run.smithi105.stdout:(155/156): protobuf-compiler-3.14.0-13.el9.x86_ 282 kB/s | 863 kB 00:03 2024-09-12T01:33:38.571 INFO:teuthology.orchestra.run.smithi060.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.2 MB/s | 5.1 MB 00:00 2024-09-12T01:33:38.612 INFO:teuthology.orchestra.run.smithi060.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-12T01:33:38.654 INFO:teuthology.orchestra.run.smithi060.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-12T01:33:38.674 INFO:teuthology.orchestra.run.smithi105.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.9 MB/s | 2.4 MB 00:00 2024-09-12T01:33:38.680 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:33:38.680 INFO:teuthology.orchestra.run.smithi105.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-12T01:33:38.713 INFO:teuthology.orchestra.run.smithi060.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T01:33:38.755 INFO:teuthology.orchestra.run.smithi060.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 864 kB/s | 36 kB 00:00 2024-09-12T01:33:38.797 INFO:teuthology.orchestra.run.smithi060.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-12T01:33:38.898 INFO:teuthology.orchestra.run.smithi060.stdout:(97/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.0 MB/s | 6.0 MB 00:01 2024-09-12T01:33:38.923 INFO:teuthology.orchestra.run.smithi060.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.4 MB/s | 304 kB 00:00 2024-09-12T01:33:38.948 INFO:teuthology.orchestra.run.smithi060.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-12T01:33:38.973 INFO:teuthology.orchestra.run.smithi060.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-12T01:33:38.998 INFO:teuthology.orchestra.run.smithi060.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-12T01:33:39.024 INFO:teuthology.orchestra.run.smithi060.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-12T01:33:39.146 INFO:teuthology.orchestra.run.smithi060.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 151 kB/s | 22 kB 00:00 2024-09-12T01:33:39.208 INFO:teuthology.orchestra.run.smithi060.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.7 MB/s | 548 kB 00:00 2024-09-12T01:33:39.241 INFO:teuthology.orchestra.run.smithi060.stdout:(105/156): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-12T01:33:39.267 INFO:teuthology.orchestra.run.smithi060.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-09-12T01:33:39.325 INFO:teuthology.orchestra.run.smithi060.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-09-12T01:33:39.409 INFO:teuthology.orchestra.run.smithi060.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-12T01:33:39.434 INFO:teuthology.orchestra.run.smithi060.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 239 kB/s | 26 kB 00:00 2024-09-12T01:33:39.459 INFO:teuthology.orchestra.run.smithi060.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 974 kB/s | 49 kB 00:00 2024-09-12T01:33:39.485 INFO:teuthology.orchestra.run.smithi060.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-12T01:33:39.510 INFO:teuthology.orchestra.run.smithi060.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-12T01:33:39.544 INFO:teuthology.orchestra.run.smithi060.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T01:33:39.569 INFO:teuthology.orchestra.run.smithi060.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T01:33:39.594 INFO:teuthology.orchestra.run.smithi060.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T01:33:39.619 INFO:teuthology.orchestra.run.smithi060.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-12T01:33:39.645 INFO:teuthology.orchestra.run.smithi060.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.1 MB/s | 839 kB 00:00 2024-09-12T01:33:39.670 INFO:teuthology.orchestra.run.smithi060.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T01:33:39.703 INFO:teuthology.orchestra.run.smithi060.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-12T01:33:39.737 INFO:teuthology.orchestra.run.smithi060.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-12T01:33:39.763 INFO:teuthology.orchestra.run.smithi060.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-12T01:33:39.789 INFO:teuthology.orchestra.run.smithi060.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-12T01:33:39.813 INFO:teuthology.orchestra.run.smithi060.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-12T01:33:39.838 INFO:teuthology.orchestra.run.smithi060.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-09-12T01:33:39.864 INFO:teuthology.orchestra.run.smithi060.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-12T01:33:39.889 INFO:teuthology.orchestra.run.smithi060.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 781 kB/s | 19 kB 00:00 2024-09-12T01:33:39.909 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2024-09-12T01:33:39.914 INFO:teuthology.orchestra.run.smithi060.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 794 kB/s | 20 kB 00:00 2024-09-12T01:33:39.956 INFO:teuthology.orchestra.run.smithi060.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 24 MB/s | 1.0 MB 00:00 2024-09-12T01:33:39.982 INFO:teuthology.orchestra.run.smithi060.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T01:33:40.007 INFO:teuthology.orchestra.run.smithi060.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T01:33:40.032 INFO:teuthology.orchestra.run.smithi060.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T01:33:40.060 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2024-09-12T01:33:40.060 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2024-09-12T01:33:40.091 INFO:teuthology.orchestra.run.smithi060.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.8 MB/s | 2.0 MB 00:00 2024-09-12T01:33:40.108 INFO:teuthology.orchestra.run.smithi060.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 970 kB/s | 16 kB 00:00 2024-09-12T01:33:40.133 INFO:teuthology.orchestra.run.smithi060.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-12T01:33:40.158 INFO:teuthology.orchestra.run.smithi060.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-12T01:33:40.175 INFO:teuthology.orchestra.run.smithi060.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 677 kB/s | 28 kB 00:00 2024-09-12T01:33:40.201 INFO:teuthology.orchestra.run.smithi060.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 735 kB/s | 31 kB 00:00 2024-09-12T01:33:40.226 INFO:teuthology.orchestra.run.smithi060.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T01:33:40.251 INFO:teuthology.orchestra.run.smithi060.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T01:33:40.276 INFO:teuthology.orchestra.run.smithi060.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-12T01:33:40.302 INFO:teuthology.orchestra.run.smithi060.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T01:33:40.327 INFO:teuthology.orchestra.run.smithi060.stdout:(142/156): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-12T01:33:40.352 INFO:teuthology.orchestra.run.smithi060.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T01:33:40.378 INFO:teuthology.orchestra.run.smithi060.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-09-12T01:33:40.403 INFO:teuthology.orchestra.run.smithi060.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-12T01:33:40.428 INFO:teuthology.orchestra.run.smithi060.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T01:33:40.487 INFO:teuthology.orchestra.run.smithi060.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-12T01:33:40.729 INFO:teuthology.orchestra.run.smithi060.stdout:(148/156): librbd1-19.1.1-298.gb53b6d3e.el9.x86 13 MB/s | 3.2 MB 00:00 2024-09-12T01:33:40.788 INFO:teuthology.orchestra.run.smithi060.stdout:(149/156): librados2-19.1.1-298.gb53b6d3e.el9.x 9.5 MB/s | 3.4 MB 00:00 2024-09-12T01:33:41.021 INFO:teuthology.orchestra.run.smithi060.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 8.0 MB/s | 2.3 MB 00:00 2024-09-12T01:33:41.063 INFO:teuthology.orchestra.run.smithi060.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 6.6 MB/s | 1.8 MB 00:00 2024-09-12T01:33:41.088 INFO:teuthology.orchestra.run.smithi060.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 610 kB/s | 41 kB 00:00 2024-09-12T01:33:41.113 INFO:teuthology.orchestra.run.smithi060.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 4.8 MB/s | 249 kB 00:00 2024-09-12T01:33:41.272 INFO:teuthology.orchestra.run.smithi060.stdout:(154/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.7 MB/s | 16 MB 00:02 2024-09-12T01:33:41.314 INFO:teuthology.orchestra.run.smithi060.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 6.0 MB/s | 1.4 MB 00:00 2024-09-12T01:33:41.364 INFO:teuthology.orchestra.run.smithi060.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 9.6 MB/s | 2.4 MB 00:00 2024-09-12T01:33:41.369 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-12T01:33:41.370 INFO:teuthology.orchestra.run.smithi060.stdout:Total 19 MB/s | 226 MB 00:11 2024-09-12T01:33:42.300 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2024-09-12T01:33:42.300 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2024-09-12T01:33:42.636 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-12T01:33:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-12T01:33:42.804 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-12T01:33:45.144 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-12T01:33:45.144 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-12T01:33:48.518 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2024-09-12T01:33:48.654 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:33:48.713 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:33:48.965 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:33:49.004 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:33:49.030 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:33:49.083 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:33:49.428 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:33:49.530 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:33:49.653 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:33:49.681 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:33:49.765 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:33:49.794 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:33:49.972 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:33:50.032 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:33:50.061 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:33:50.173 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:33:50.204 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:33:50.273 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:33:50.305 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:33:50.331 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:33:50.527 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:33:50.718 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:33:50.861 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:33:50.979 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:33:51.054 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:33:51.300 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:33:51.410 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:33:51.504 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:33:51.535 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:33:51.569 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:33:51.633 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:33:51.678 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:33:51.694 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-12T01:33:51.710 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:33:51.754 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:33:51.794 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-12T01:33:51.795 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:33:51.832 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:33:51.880 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-12T01:33:51.901 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:33:51.954 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:33:51.985 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:33:52.029 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:33:52.065 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-12T01:33:52.106 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:33:52.139 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:33:52.183 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:33:52.211 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:33:52.282 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:33:52.306 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-12T01:33:52.335 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:33:52.338 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-12T01:33:52.392 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-12T01:33:52.409 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:33:52.545 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:33:52.603 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:33:52.756 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-12T01:33:52.879 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:33:53.005 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:33:53.143 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:33:53.164 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:33:53.224 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:33:53.241 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:33:53.261 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:33:53.269 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:33:53.304 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:33:53.342 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:33:53.384 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:33:53.444 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-12T01:33:53.516 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-12T01:33:53.543 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:33:53.544 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:33:53.612 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:33:53.649 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:33:53.674 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:33:53.677 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:33:53.743 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 14/164 2024-09-12T01:33:53.756 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:33:53.770 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:33:53.788 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:33:53.791 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-12T01:33:53.824 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:33:53.872 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:33:53.908 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:33:53.950 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:33:53.997 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:33:54.000 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:33:54.143 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:33:54.165 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-12T01:33:54.186 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:33:54.227 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:33:54.319 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-12T01:33:54.436 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:33:54.492 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:33:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:33:54.528 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:33:54.568 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:33:54.605 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:33:54.629 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:33:54.727 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:33:54.745 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-12T01:33:54.855 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-12T01:33:54.856 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:33:54.895 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:33:54.932 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:33:54.950 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-12T01:33:54.971 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:33:54.992 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-12T01:33:55.013 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:33:55.035 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-12T01:33:55.045 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:33:55.083 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:33:55.110 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-12T01:33:55.126 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:33:55.159 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:33:55.161 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-12T01:33:55.201 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:33:55.201 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-12T01:33:55.235 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:33:55.254 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-12T01:33:55.294 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-12T01:33:55.322 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-12T01:33:55.322 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:33:55.366 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:33:55.394 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-12T01:33:55.397 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:33:55.500 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:33:55.556 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:33:55.571 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-12T01:33:55.600 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-12T01:33:55.644 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-12T01:33:55.722 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-12T01:33:55.754 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 34/164 2024-09-12T01:33:55.798 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 35/164 2024-09-12T01:33:55.834 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 36/164 2024-09-12T01:33:55.908 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-12T01:33:55.950 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-12T01:33:56.026 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-12T01:33:56.172 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-12T01:33:56.228 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-12T01:33:56.276 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:33:56.322 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:33:56.356 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:33:56.453 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:33:56.510 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:33:56.564 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:33:56.658 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:33:56.699 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:33:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-12T01:33:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-12T01:33:56.883 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:33:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-12T01:33:56.914 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:33:56.953 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-12T01:33:56.991 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:33:56.999 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 46/164 2024-09-12T01:33:57.044 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-12T01:33:57.465 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-12T01:33:57.537 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-12T01:33:57.595 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-12T01:33:57.656 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:33:57.669 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-12T01:33:57.712 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-12T01:33:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-12T01:33:57.779 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:33:57.805 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-12T01:33:57.839 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-12T01:33:57.883 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-12T01:33:57.925 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-12T01:33:58.068 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-12T01:33:58.109 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-12T01:33:58.151 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-12T01:33:58.259 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-12T01:33:58.301 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-12T01:33:58.341 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-12T01:33:58.374 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-09-12T01:33:58.399 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-12T01:33:58.494 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-12T01:33:58.622 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-12T01:33:58.656 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-12T01:33:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-12T01:33:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-12T01:33:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-12T01:33:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-12T01:33:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-12T01:33:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-12T01:33:58.932 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-12T01:33:58.975 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-12T01:33:59.008 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-12T01:33:59.038 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:33:59.099 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-12T01:33:59.128 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:33:59.148 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-12T01:33:59.156 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:33:59.178 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-12T01:33:59.189 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:33:59.286 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-12T01:33:59.347 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-12T01:33:59.504 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:33:59.552 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:33:59.642 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:33:59.682 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:33:59.719 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:34:00.112 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-12T01:34:00.159 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-12T01:34:00.194 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-12T01:34:00.215 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:34:00.262 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:34:00.297 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-12T01:34:00.318 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:34:00.353 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-12T01:34:00.395 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-12T01:34:00.486 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-12T01:34:00.521 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-12T01:34:00.563 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:34:00.714 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-12T01:34:00.743 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-12T01:34:00.825 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-12T01:34:01.528 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-12T01:34:01.655 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-12T01:34:02.976 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:34:02.985 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-12T01:34:03.020 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:34:03.064 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-12T01:34:03.095 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-12T01:34:03.127 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-12T01:34:03.459 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-12T01:34:03.498 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:34:03.584 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:34:03.598 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 101/164 2024-09-12T01:34:03.624 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:34:03.628 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 102/164 2024-09-12T01:34:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-12T01:34:03.716 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:34:03.716 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:34:03.716 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:34:03.716 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:03.759 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:34:04.177 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-12T01:34:04.225 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:34:04.298 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 105/164 2024-09-12T01:34:04.328 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 106/164 2024-09-12T01:34:07.223 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:34:07.266 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:34:07.855 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 107/164 2024-09-12T01:34:07.894 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:34:07.981 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 108/164 2024-09-12T01:34:07.981 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T01:34:07.981 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T01:34:07.981 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:08.020 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:34:15.574 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:34:15.575 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /sys 2024-09-12T01:34:15.575 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /proc 2024-09-12T01:34:15.575 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /mnt 2024-09-12T01:34:15.575 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /var/tmp 2024-09-12T01:34:15.575 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /home 2024-09-12T01:34:15.575 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /root 2024-09-12T01:34:15.575 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /tmp 2024-09-12T01:34:15.575 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:15.746 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:34:15.763 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:34:15.763 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:15.763 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:34:15.763 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:17.248 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:34:17.275 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:34:17.275 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:17.275 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:34:17.275 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:34:17.275 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:34:17.276 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:17.499 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:34:17.522 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:34:17.523 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:17.523 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:34:17.523 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:34:17.523 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:34:17.523 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:17.958 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:34:17.981 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:34:17.982 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:17.982 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:34:17.982 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:34:17.982 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:34:17.982 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:18.088 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:34:18.136 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:34:18.192 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:34:18.380 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:34:18.434 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:34:18.511 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:34:18.600 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:34:18.739 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:34:18.784 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:34:18.824 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:34:18.861 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:34:19.244 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:34:19.276 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:34:19.337 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:34:19.403 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:34:19.432 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:34:20.451 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 109/164 2024-09-12T01:34:20.452 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-09-12T01:34:20.452 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-09-12T01:34:20.452 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-09-12T01:34:20.452 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-09-12T01:34:20.452 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-09-12T01:34:20.452 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-09-12T01:34:20.452 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-09-12T01:34:20.452 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:20.469 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:34:20.534 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:34:20.631 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:34:20.648 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 110/164 2024-09-12T01:34:20.648 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:20.648 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T01:34:20.648 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:21.501 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:34:21.534 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:34:21.639 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:34:21.797 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:34:21.828 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:34:21.852 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:34:21.853 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:21.853 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:34:21.853 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:34:21.853 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:34:21.853 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:21.904 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:34:21.915 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:34:22.021 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:34:22.074 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:34:22.192 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:34:22.221 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 111/164 2024-09-12T01:34:22.221 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:22.221 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T01:34:22.222 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:34:22.222 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T01:34:22.222 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:22.469 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:34:22.494 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 112/164 2024-09-12T01:34:22.495 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:22.495 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T01:34:22.495 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:34:22.495 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T01:34:22.495 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:22.961 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:34:22.986 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 113/164 2024-09-12T01:34:22.986 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:22.986 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T01:34:22.986 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:34:22.987 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T01:34:22.987 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:22.990 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:34:23.023 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:34:23.047 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:34:23.048 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:23.048 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:34:23.048 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:34:23.048 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:34:23.048 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:23.091 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:34:23.101 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-12T01:34:23.113 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:34:23.113 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:23.113 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:34:23.113 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:23.158 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:34:23.159 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-12T01:34:23.181 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:34:23.181 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:23.181 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:34:23.181 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:34:23.181 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:34:23.182 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:23.223 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-12T01:34:23.427 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-12T01:34:23.479 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-12T01:34:23.492 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:34:23.515 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:34:23.516 INFO:teuthology.orchestra.run.smithi105.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:23.516 INFO:teuthology.orchestra.run.smithi105.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:34:23.516 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:34:23.516 INFO:teuthology.orchestra.run.smithi105.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:34:23.516 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:23.561 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-12T01:34:23.659 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-12T01:34:23.817 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-12T01:34:23.867 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-12T01:34:23.903 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-12T01:34:23.930 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-12T01:34:24.390 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:34:24.421 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 125/164 2024-09-12T01:34:24.453 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 126/164 2024-09-12T01:34:24.509 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 127/164 2024-09-12T01:34:24.544 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:34:25.650 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 128/164 2024-09-12T01:34:25.687 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:34:26.705 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 129/164 2024-09-12T01:34:26.729 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:34:26.838 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 130/164 2024-09-12T01:34:27.007 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 131/164 2024-09-12T01:34:27.040 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:34:27.065 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 132/164 2024-09-12T01:34:27.066 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:27.066 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T01:34:27.066 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:34:27.066 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T01:34:27.066 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:27.115 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:34:27.128 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 133/164 2024-09-12T01:34:27.229 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 134/164 2024-09-12T01:34:27.289 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 135/164 2024-09-12T01:34:28.071 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:34:28.112 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:34:28.152 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:34:28.185 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:34:28.212 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:34:28.267 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-12T01:34:28.293 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:34:28.318 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 137/164 2024-09-12T01:34:28.318 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:28.319 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T01:34:28.319 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:34:28.319 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T01:34:28.319 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:28.360 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:34:28.385 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 138/164 2024-09-12T01:34:28.385 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:28.385 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T01:34:28.385 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:28.399 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:34:28.436 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:34:28.442 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:34:28.460 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 139/164 2024-09-12T01:34:28.461 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:28.461 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-12T01:34:28.461 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:34:28.461 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-12T01:34:28.461 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:28.472 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:34:28.502 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:34:28.548 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:34:28.778 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:34:28.803 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 140/164 2024-09-12T01:34:28.803 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T01:34:28.803 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T01:34:28.803 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:34:28.803 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T01:34:28.804 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:29.206 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:34:29.246 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:34:29.268 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:34:30.096 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:34:30.177 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:34:30.228 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:34:30.325 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:34:30.354 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:34:30.380 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:34:30.414 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:34:30.415 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:34:30.506 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:34:30.507 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:34:30.599 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:34:30.624 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:34:30.630 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:34:30.630 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:34:30.809 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:34:30.809 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:34:30.893 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:34:30.959 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:34:33.641 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 141/164 2024-09-12T01:34:33.691 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 142/164 2024-09-12T01:34:33.731 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 143/164 2024-09-12T01:34:33.763 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-12T01:34:33.798 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-12T01:34:34.003 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 146/164 2024-09-12T01:34:34.045 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-12T01:34:34.075 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 148/164 2024-09-12T01:34:34.105 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-12T01:34:34.145 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-12T01:34:34.807 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:34:34.840 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:34:34.863 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-12T01:34:35.767 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 152/164 2024-09-12T01:34:35.854 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-12T01:34:35.901 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-12T01:34:35.998 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-12T01:34:36.032 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-12T01:34:36.057 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-12T01:34:36.083 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-12T01:34:36.083 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:34:36.167 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-12T01:34:36.167 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:34:36.251 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-12T01:34:36.276 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-12T01:34:36.282 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:34:36.282 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:34:36.486 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-12T01:34:36.486 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:34:36.570 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-12T01:34:36.639 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:34:36.673 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:34:36.673 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:34:36.673 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:34:36.673 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:34:36.673 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:34:36.673 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:34:36.673 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:34:36.673 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:34:36.673 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:34:36.673 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:34:36.673 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:34:36.674 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:34:36.675 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:34:36.675 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:34:36.675 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:34:36.689 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:34:36.689 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:34:36.689 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:34:36.689 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:34:36.689 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:34:36.689 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:34:36.689 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:34:36.689 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:34:36.689 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:34:36.689 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:34:36.689 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:34:36.689 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:34:36.690 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:34:36.691 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:34:36.691 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:34:36.691 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:34:36.691 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:34:36.691 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:34:36.691 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:34:36.691 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:34:36.691 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:34:36.691 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:34:36.691 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:34:36.692 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:34:36.692 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:34:36.692 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:34:36.692 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:34:36.692 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:34:36.692 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:34:36.692 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:34:36.692 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:34:36.693 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:34:36.693 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:34:36.693 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:34:36.693 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:34:36.693 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:34:36.693 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:34:36.693 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:34:36.694 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:34:36.694 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:34:36.694 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:34:36.694 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:34:36.694 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:34:36.694 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:34:36.694 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:34:36.694 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:34:36.694 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:34:36.694 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:34:36.694 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:34:36.695 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:34:36.695 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:34:36.695 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:34:36.695 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:34:36.695 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:34:36.695 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:34:36.695 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:34:36.695 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:34:36.695 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:34:36.696 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:34:36.697 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:34:36.698 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:34:36.698 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:34:36.698 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:34:36.698 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:34:36.698 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:34:36.698 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:34:36.698 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:34:36.698 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:34:36.698 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:34:36.698 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:34:36.698 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:34:36.699 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:34:36.700 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:34:36.701 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:34:39.307 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:34:39.307 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:39.307 INFO:teuthology.orchestra.run.smithi105.stdout:Upgraded: 2024-09-12T01:34:39.307 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:34:39.307 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:34:39.307 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:34:39.307 INFO:teuthology.orchestra.run.smithi105.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.308 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:39.309 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:34:39.310 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:34:39.311 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:34:39.312 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:34:39.313 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:34:39.314 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.314 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.314 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.314 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:34:39.314 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:34:39.314 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:34:39.314 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:34:39.314 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:34:39.314 INFO:teuthology.orchestra.run.smithi105.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:34:39.314 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:34:39.314 INFO:teuthology.orchestra.run.smithi105.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:34:39.314 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:34:39.315 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:34:39.315 INFO:teuthology.orchestra.run.smithi105.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:34:39.315 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:34:39.315 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:34:39.315 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:34:39.315 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:34:39.315 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:34:39.315 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:34:39.315 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:34:39.315 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:34:39.315 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:34:39.315 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:34:39.316 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:34:39.316 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:34:39.316 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:34:39.316 INFO:teuthology.orchestra.run.smithi105.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:34:39.316 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:34:39.316 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:34:39.316 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:34:39.316 INFO:teuthology.orchestra.run.smithi105.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:34:39.316 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:34:39.316 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:34:39.316 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:34:39.316 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.317 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:34:39.318 INFO:teuthology.orchestra.run.smithi105.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:34:39.319 INFO:teuthology.orchestra.run.smithi105.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:34:39.319 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.319 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.319 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:39.319 INFO:teuthology.orchestra.run.smithi105.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:34:39.319 INFO:teuthology.orchestra.run.smithi105.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:34:39.319 INFO:teuthology.orchestra.run.smithi105.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:34:39.319 INFO:teuthology.orchestra.run.smithi105.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:34:39.319 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:34:39.319 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:34:39.319 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:34:39.320 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:39.320 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2024-09-12T01:34:39.744 DEBUG:teuthology.parallel:result is None 2024-09-12T01:34:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:34:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 1/164 2024-09-12T01:34:42.245 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 3/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 4/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-298.gb53b6d 5/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 6/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 7/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 8/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 9/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 10/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 11/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 12/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 13/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 14/164 2024-09-12T01:34:42.246 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_6 15/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 16/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 17/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 18/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_ 19/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 20/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9 21/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x 22/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 23/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 24/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 25/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 26/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 27/164 2024-09-12T01:34:42.247 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 28/164 2024-09-12T01:34:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 29/164 2024-09-12T01:34:42.248 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.e 30/164 2024-09-12T01:34:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noar 31/164 2024-09-12T01:34:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.no 32/164 2024-09-12T01:34:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b 33/164 2024-09-12T01:34:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9 34/164 2024-09-12T01:34:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 35/164 2024-09-12T01:34:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el 36/164 2024-09-12T01:34:42.259 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 37/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 38/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 39/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-12T01:34:42.260 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-12T01:34:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-12T01:34:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-12T01:34:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-12T01:34:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-12T01:34:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-12T01:34:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-12T01:34:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-12T01:34:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-12T01:34:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-12T01:34:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-12T01:34:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-12T01:34:42.261 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-12T01:34:42.262 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-12T01:34:42.263 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-12T01:34:42.264 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-12T01:34:42.265 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-12T01:34:42.266 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-12T01:34:42.267 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 149/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 151/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-12T01:34:42.268 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-12T01:34:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-12T01:34:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-12T01:34:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-12T01:34:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-12T01:34:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-12T01:34:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-12T01:34:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-12T01:34:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-12T01:34:42.269 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-12T01:34:45.194 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T01:34:45.195 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.2-8.el9.noarch 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.7.4-5.el9.x86_64 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:45.196 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.197 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:19.1.1-298.gb53b6d3e.el9.noarch 2024-09-12T01:34:45.198 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-12T01:34:45.198 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.4-9.el9.x86_64 2024-09-12T01:34:45.198 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T01:34:45.198 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T01:34:45.198 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T01:34:45.198 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T01:34:45.198 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T01:34:45.198 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T01:34:45.198 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-12T01:34:45.198 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T01:34:45.198 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-12T01:34:45.199 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-13.16-1.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-12T01:34:45.200 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T01:34:45.201 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T01:34:45.202 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T01:34:45.203 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T01:34:45.203 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T01:34:45.203 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T01:34:45.203 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T01:34:45.203 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T01:34:45.203 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T01:34:45.203 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T01:34:45.203 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T01:34:45.203 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T01:34:45.203 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T01:34:45.203 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T01:34:45.203 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.204 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.205 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T01:34:45.205 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T01:34:45.205 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T01:34:45.205 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.205 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T01:34:45.209 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T01:34:45.209 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T01:34:45.209 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T01:34:45.209 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T01:34:45.209 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:19.1.1-298.gb53b6d3e.el9.x86_64 2024-09-12T01:34:45.210 INFO:teuthology.orchestra.run.smithi060.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T01:34:45.211 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T01:34:45.211 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T01:34:45.211 INFO:teuthology.orchestra.run.smithi060.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-12T01:34:45.211 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-12T01:34:45.211 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T01:34:45.211 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-12T01:34:45.211 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:45.211 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-12T01:34:45.599 DEBUG:teuthology.parallel:result is None 2024-09-12T01:34:45.600 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:34:45.747 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:34:45.770 INFO:teuthology.orchestra.run.smithi060.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:34:45.771 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:34:45.771 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:34:45.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-12T01:34:45.914 DEBUG:teuthology.orchestra.run.smithi105:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T01:34:45.940 INFO:teuthology.orchestra.run.smithi105.stdout:19.1.1-298.gb53b6d3e.el9 2024-09-12T01:34:45.940 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298.gb53b6d3e.el9 2024-09-12T01:34:45.941 INFO:teuthology.task.install:The correct ceph version 19.1.1-298.gb53b6d3e is installed. 2024-09-12T01:34:45.942 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T01:34:45.943 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:34:45.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:34:45.971 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:34:45.971 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T01:34:46.010 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T01:34:46.011 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:34:46.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:34:46.036 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:34:46.103 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:34:46.104 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T01:34:46.131 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T01:34:46.198 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T01:34:46.198 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:34:46.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:34:46.225 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:34:46.291 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:34:46.292 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T01:34:46.317 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T01:34:46.382 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T01:34:46.383 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:34:46.383 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:34:46.409 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:34:46.475 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:34:46.475 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T01:34:46.500 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T01:34:46.563 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T01:34:46.645 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T01:34:46.645 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /var/log/ceph 2024-09-12T01:34:46.647 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 777 /var/log/ceph 2024-09-12T01:34:46.672 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T01:34:46.672 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T01:34:46.715 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T01:34:46.739 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T01:34:46.740 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T01:34:46.782 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T01:34:46.813 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-12T01:34:46.813 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-12T01:34:46.813 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-12T01:34:46.814 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:34:46.814 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T01:34:46.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T01:34:46.984 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-12T01:34:47.010 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:34:47.010 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-12T01:34:47.025 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-12T01:34:47.142 DEBUG:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-12T01:34:47.180 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T01:34:47.180 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T01:34:47.180 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/client-limits}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7901559', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 481, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '57/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_086c737fa75c22d521a3932c59b31c5e1d1c9ef4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '086c737fa75c22d521a3932c59b31c5e1d1c9ef4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi060.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBkinxHlcM/qfrumYYNrIAykDH371TpIl0sjZEw5oxIla421lMpybULXTxn8fD0WzbiYG1Lim/QCHuRMOwMFzh4=', 'smithi105.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCdDg+pX1BhO8Z3BAvErdQMYi3oJIdJhaNP0zbsYOAyNzgqvvctwbc/3Vz/q3XnrM3zfQTeEqfRt1gsO+Gg0u/4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'responding to mclientcaps\\(revoke\\)', 'not advance its oldest_client_tid', 'failing to advance its oldest client/flush tid', 'Too many inodes in cache', 'failing to respond to cache pressure', 'slow requests are blocked', 'failing to respond to capability release', 'MDS cache is too large', '\\(MDS_CLIENT_OLDEST_TID\\)', '\\(MDS_CACHE_OVERSIZED\\)'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_client_limits']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T01:34:47.181 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T01:34:47.184 DEBUG:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T01:34:47.230 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T01:34:47.240 DEBUG:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T01:34:47.295 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:34:47.295 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:34:47.320 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:34:47.320 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-09-12T01:34:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:34:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:34:47.377 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T01:34:47.377 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:34:47.377 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:34:47.377 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-12 01:34:37.015427163 +0000 2024-09-12T01:34:47.377 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-12 01:32:47.617074133 +0000 2024-09-12T01:34:47.377 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-12 01:32:47.617074133 +0000 2024-09-12T01:34:47.377 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-12 01:32:47.617074133 +0000 2024-09-12T01:34:47.377 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:34:47.440 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-12T01:34:47.441 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-12T01:34:47.441 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000101999 s, 5.0 MB/s 2024-09-12T01:34:47.442 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:34:47.499 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-09-12T01:34:47.555 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:34:47.555 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:34:47.555 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T01:34:47.555 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:34:47.555 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:34:47.555 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-12 01:34:37.016427152 +0000 2024-09-12T01:34:47.555 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-12 01:32:47.935070668 +0000 2024-09-12T01:34:47.555 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-12 01:32:47.935070668 +0000 2024-09-12T01:34:47.555 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-12 01:32:47.935070668 +0000 2024-09-12T01:34:47.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:34:47.619 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-12T01:34:47.619 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-12T01:34:47.619 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 8.3418e-05 s, 6.1 MB/s 2024-09-12T01:34:47.620 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:34:47.677 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-09-12T01:34:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:34:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:34:47.733 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T01:34:47.733 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:34:47.733 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:34:47.733 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-12 01:34:37.016427152 +0000 2024-09-12T01:34:47.733 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-12 01:32:48.253067202 +0000 2024-09-12T01:34:47.733 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-12 01:32:48.253067202 +0000 2024-09-12T01:34:47.733 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-12 01:32:48.253067202 +0000 2024-09-12T01:34:47.734 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:34:47.797 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-12T01:34:47.797 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-12T01:34:47.797 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000128621 s, 4.0 MB/s 2024-09-12T01:34:47.799 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:34:47.856 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-09-12T01:34:47.912 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:34:47.912 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:34:47.912 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T01:34:47.912 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:34:47.912 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:34:47.912 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-12 01:34:37.017427141 +0000 2024-09-12T01:34:47.912 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-12 01:32:48.577063672 +0000 2024-09-12T01:34:47.912 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-12 01:32:48.577063672 +0000 2024-09-12T01:34:47.912 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-12 01:32:48.577063672 +0000 2024-09-12T01:34:47.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:34:47.976 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-12T01:34:47.976 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-12T01:34:47.976 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000102899 s, 5.0 MB/s 2024-09-12T01:34:47.977 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:34:48.036 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T01:34:48.036 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:34:48.036 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T01:34:48.053 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T01:34:48.053 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 2024-09-12T01:34:48.109 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T01:34:48.110 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:34:48.110 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T01:34:48.110 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:34:48.110 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:34:48.110 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-12 01:34:31.331843516 +0000 2024-09-12T01:34:48.110 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-12 01:32:45.457571996 +0000 2024-09-12T01:34:48.110 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-12 01:32:45.457571996 +0000 2024-09-12T01:34:48.110 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-12 01:32:45.457571996 +0000 2024-09-12T01:34:48.110 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T01:34:48.173 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-12T01:34:48.174 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-12T01:34:48.174 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000210599 s, 2.4 MB/s 2024-09-12T01:34:48.175 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T01:34:48.232 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 2024-09-12T01:34:48.287 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T01:34:48.288 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:34:48.288 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-12T01:34:48.288 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:34:48.288 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:34:48.288 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-12 01:34:31.331843516 +0000 2024-09-12T01:34:48.288 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-12 01:32:45.782565430 +0000 2024-09-12T01:34:48.288 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-12 01:32:45.782565430 +0000 2024-09-12T01:34:48.288 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-12 01:32:45.782565430 +0000 2024-09-12T01:34:48.289 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T01:34:48.351 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-12T01:34:48.351 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-12T01:34:48.352 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000231968 s, 2.2 MB/s 2024-09-12T01:34:48.353 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T01:34:48.410 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 2024-09-12T01:34:48.466 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T01:34:48.466 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:34:48.466 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T01:34:48.466 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:34:48.467 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:34:48.467 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-12 01:34:31.331843516 +0000 2024-09-12T01:34:48.467 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-12 01:32:46.096559086 +0000 2024-09-12T01:34:48.467 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-12 01:32:46.096559086 +0000 2024-09-12T01:34:48.467 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-12 01:32:46.096559086 +0000 2024-09-12T01:34:48.468 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T01:34:48.529 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-12T01:34:48.529 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-12T01:34:48.529 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000161941 s, 3.2 MB/s 2024-09-12T01:34:48.531 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T01:34:48.587 DEBUG:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 2024-09-12T01:34:48.643 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T01:34:48.643 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T01:34:48.643 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-12T01:34:48.643 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T01:34:48.643 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T01:34:48.643 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2024-09-12 01:34:31.331843516 +0000 2024-09-12T01:34:48.643 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2024-09-12 01:32:46.489551145 +0000 2024-09-12T01:34:48.643 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2024-09-12 01:32:46.489551145 +0000 2024-09-12T01:34:48.643 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: 2024-09-12 01:32:46.489551145 +0000 2024-09-12T01:34:48.643 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T01:34:48.709 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2024-09-12T01:34:48.710 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2024-09-12T01:34:48.710 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000212133 s, 2.4 MB/s 2024-09-12T01:34:48.710 DEBUG:teuthology.orchestra.run.smithi105:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T01:34:48.765 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T01:34:48.765 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T01:34:48.765 INFO:tasks.ceph:Generating config... 2024-09-12T01:34:48.767 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-12T01:34:48.767 INFO:tasks.ceph:[client] debug client = 20 2024-09-12T01:34:48.767 INFO:tasks.ceph:[client] debug ms = 1 2024-09-12T01:34:48.767 INFO:tasks.ceph:[client] pid file = 2024-09-12T01:34:48.767 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-12T01:34:48.767 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-12T01:34:48.767 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-12T01:34:48.767 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-12T01:34:48.767 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-12T01:34:48.767 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T01:34:48.768 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T01:34:48.769 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-12T01:34:48.769 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-12T01:34:48.769 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-12T01:34:48.769 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T01:34:48.769 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T01:34:48.769 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T01:34:48.769 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T01:34:48.769 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T01:34:48.769 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T01:34:48.769 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T01:34:48.769 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T01:34:48.769 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T01:34:48.770 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T01:34:48.770 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T01:34:48.770 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T01:34:48.770 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T01:34:48.770 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T01:34:48.770 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T01:34:48.770 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-12T01:34:48.770 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T01:34:48.770 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T01:34:48.826 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T01:34:48.829 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T01:34:48.877 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T01:34:48.904 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.60'), ('mon.b', '172.21.15.105'), ('mon.c', '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]')] 2024-09-12T01:34:48.904 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.60,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-12T01:34:48.905 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:34:48.905 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T01:34:48.961 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.60 --add b 172.21.15.105 --addv c '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:34:49.050 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:34:49.050 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: generated fsid 5401bd8a-3492-4b21-b6c0-d6616ff39793 2024-09-12T01:34:49.050 INFO:teuthology.orchestra.run.smithi060.stdout:setting min_mon_release = quincy 2024-09-12T01:34:49.050 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 0 2024-09-12T01:34:49.051 INFO:teuthology.orchestra.run.smithi060.stdout:fsid 5401bd8a-3492-4b21-b6c0-d6616ff39793 2024-09-12T01:34:49.051 INFO:teuthology.orchestra.run.smithi060.stdout:last_changed 2024-09-12T01:34:49.051103+0000 2024-09-12T01:34:49.051 INFO:teuthology.orchestra.run.smithi060.stdout:created 2024-09-12T01:34:49.051103+0000 2024-09-12T01:34:49.051 INFO:teuthology.orchestra.run.smithi060.stdout:min_mon_release 17 (quincy) 2024-09-12T01:34:49.051 INFO:teuthology.orchestra.run.smithi060.stdout:election_strategy: 1 2024-09-12T01:34:49.052 INFO:teuthology.orchestra.run.smithi060.stdout:0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2024-09-12T01:34:49.052 INFO:teuthology.orchestra.run.smithi060.stdout:1: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2024-09-12T01:34:49.052 INFO:teuthology.orchestra.run.smithi060.stdout:2: [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] mon.c 2024-09-12T01:34:49.052 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T01:34:49.054 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T01:34:49.070 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5401bd8a-3492-4b21-b6c0-d6616ff39793... 2024-09-12T01:34:49.071 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T01:34:49.113 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T01:34:49.156 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2024-09-12T01:34:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: chdir = "" 2024-09-12T01:34:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T01:34:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: auth supported = cephx 2024-09-12T01:34:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.156 INFO:teuthology.orchestra.run.smithi060.stdout: filestore xattr use omap = true 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: mon clock drift allowed = 1.000 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: osd crush chooseleaf type = 0 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: auth debug = true 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on old message = true 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on bug = true 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn max object skew = 0 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.157 INFO:teuthology.orchestra.run.smithi060.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default size = 2 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow primary affinity = true 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow pg remap = true 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on legacy crush tunables = false 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on crush straw calc version zero = false 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on no sortbitwise = false 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on osd down out interval zero = false 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on too few osds = false 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: mon_allow_pool_size_one = true 2024-09-12T01:34:49.158 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: osd default data pool replay window = 5 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: mon allow pool delete = true 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: mon cluster log file level = debug 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: debug asserts on shutdown = true 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: mon health detail to clog = false 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: mon host = "172.21.15.60,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on skipped message = False 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = 5401bd8a-3492-4b21-b6c0-d6616ff39793 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.159 INFO:teuthology.orchestra.run.smithi060.stdout:[osd] 2024-09-12T01:34:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: osd journal size = 100 2024-09-12T01:34:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub load threshold = 5.0 2024-09-12T01:34:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub max interval = 600 2024-09-12T01:34:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: osd mclock profile = high_recovery_ops 2024-09-12T01:34:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: osd recover clone overlap = true 2024-09-12T01:34:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: osd recovery max chunk = 1048576 2024-09-12T01:34:49.160 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug shutdown = true 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug op order = true 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify stray on activate = true 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug trim objects = true 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: osd open classes on start = true 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug pg log writeout = true 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: osd deep scrub update digest min age = 30 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: osd map max advance = 10 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: journal zero on create = true 2024-09-12T01:34:49.161 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: filestore ondisk finisher threads = 3 2024-09-12T01:34:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: filestore apply finisher threads = 3 2024-09-12T01:34:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: bdev debug aio = true 2024-09-12T01:34:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug misdirected ops = true 2024-09-12T01:34:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: bdev async discard = True 2024-09-12T01:34:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: bdev enable discard = True 2024-09-12T01:34:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore allocator = bitmap 2024-09-12T01:34:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore block size = 96636764160 2024-09-12T01:34:49.162 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore fsck on mount = True 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluefs = 1/20 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluestore = 1/20 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: debug osd = 20 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: debug rocksdb = 4/10 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.9 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.8 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: osd failsafe full ratio = 0.95 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: osd objectstore = bluestore 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.163 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr] 2024-09-12T01:34:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-12T01:34:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: debug mgr = 20 2024-09-12T01:34:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2024-09-12T01:34:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2024-09-12T01:34:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2024-09-12T01:34:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2024-09-12T01:34:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: mgr/telemetry/nag = false 2024-09-12T01:34:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2024-09-12T01:34:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.164 INFO:teuthology.orchestra.run.smithi060.stdout:[mon] 2024-09-12T01:34:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-12T01:34:49.164 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2024-09-12T01:34:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: debug paxos = 20 2024-09-12T01:34:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2024-09-12T01:34:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: mon data avail warn = 5 2024-09-12T01:34:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: mon mgr mkfs grace = 240 2024-09-12T01:34:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2024-09-12T01:34:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd reporter subtree level = osd 2024-09-12T01:34:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd prime pg temp = true 2024-09-12T01:34:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2024-09-12T01:34:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.165 INFO:teuthology.orchestra.run.smithi060.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: # 1m isn't quite enough 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: mon_down_mkfs_grace = 2m 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_filestore_osds = false 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: mon down mkfs grace = 300 2024-09-12T01:34:49.166 INFO:teuthology.orchestra.run.smithi060.stdout: mon op complaint time = 120 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on pool no app = False 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout:[client] 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: rgw cache enabled = true 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable ops log = true 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable usage log = true 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: client mount timeout = 600 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = "" 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: rados mon op timeout = 900 2024-09-12T01:34:49.167 INFO:teuthology.orchestra.run.smithi060.stdout: rados osd op timeout = 900 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.a] 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.b] 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.c] 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d] 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout:[mds] 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds = 20 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds balancer = 20 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug frag = True 2024-09-12T01:34:49.168 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug scatterstat = True 2024-09-12T01:34:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: mds op complaint time = 180 2024-09-12T01:34:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: mds verify scatter = True 2024-09-12T01:34:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2024-09-12T01:34:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: rados mon op timeout = 900 2024-09-12T01:34:49.169 INFO:teuthology.orchestra.run.smithi060.stdout: rados osd op timeout = 900 2024-09-12T01:34:49.170 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2024-09-12T01:34:49.170 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2024-09-12T01:34:49.170 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.171 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2024-09-12T01:34:49.172 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2024-09-12T01:34:49.173 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2024-09-12T01:34:49.173 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T01:34:49.173 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T01:34:49.173 INFO:teuthology.orchestra.run.smithi105.stdout: mon_allow_pool_size_one = true 2024-09-12T01:34:49.173 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.173 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T01:34:49.173 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.173 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2024-09-12T01:34:49.173 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.173 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: mon health detail to clog = false 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.60,172.21.15.105,[v2:172.21.15.105:3301,v1:172.21.15.105:6790]" 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on skipped message = False 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = 5401bd8a-3492-4b21-b6c0-d6616ff39793 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: osd mclock profile = high_recovery_ops 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.174 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug trim objects = true 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.175 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: bdev async discard = True 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: bdev enable discard = True 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore allocator = bitmap 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 1/20 2024-09-12T01:34:49.176 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 1/20 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 20 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 4/10 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2024-09-12T01:34:49.177 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2024-09-12T01:34:49.178 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: # 1m isn't quite enough 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: mon_down_mkfs_grace = 2m 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.179 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_filestore_osds = false 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: mon down mkfs grace = 300 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on pool no app = False 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-12T01:34:49.180 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = "" 2024-09-12T01:34:49.181 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2024-09-12T01:34:49.181 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2024-09-12T01:34:49.181 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2024-09-12T01:34:49.181 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2024-09-12T01:34:49.181 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2024-09-12T01:34:49.181 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2024-09-12T01:34:49.181 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2024-09-12T01:34:49.181 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2024-09-12T01:34:49.181 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2024-09-12T01:34:49.181 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2024-09-12T01:34:49.181 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2024-09-12T01:34:49.181 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds balancer = 20 2024-09-12T01:34:49.182 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2024-09-12T01:34:49.182 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2024-09-12T01:34:49.182 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2024-09-12T01:34:49.182 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2024-09-12T01:34:49.182 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2024-09-12T01:34:49.182 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2024-09-12T01:34:49.182 INFO:teuthology.orchestra.run.smithi105.stdout: rados mon op timeout = 900 2024-09-12T01:34:49.182 INFO:teuthology.orchestra.run.smithi105.stdout: rados osd op timeout = 900 2024-09-12T01:34:49.182 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T01:34:49.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T01:34:49.267 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T01:34:49.267 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:34:49.267 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T01:34:49.283 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:34:49.283 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T01:34:49.339 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:34:49.339 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:34:49.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T01:34:49.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T01:34:49.414 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:34:49.414 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:34:49.471 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:34:49.471 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:34:49.471 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T01:34:49.471 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T01:34:49.506 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:34:49.506 DEBUG:teuthology.orchestra.run.smithi105:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:34:49.562 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T01:34:49.562 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T01:34:49.562 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T01:34:49.615 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T01:34:49.617 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T01:34:49.678 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T01:34:49.681 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T01:34:49.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T01:34:49.734 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-12T01:34:49.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-12T01:34:49.762 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T01:34:49.855 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-12T01:34:49.858 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-12T01:34:49.884 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T01:34:49.935 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-12T01:34:49.938 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-12T01:34:49.962 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T01:34:50.053 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-12T01:34:50.055 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-12T01:34:50.079 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T01:34:50.079 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T01:34:50.122 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T01:34:50.135 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-12T01:34:50.217 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-12T01:34:50.230 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T01:34:50.271 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T01:34:50.284 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-12T01:34:50.365 INFO:teuthology.orchestra.run.smithi105.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-12T01:34:50.378 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T01:34:50.378 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T01:34:50.379 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T01:34:50.406 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T01:34:50.406 INFO:tasks.ceph:role: osd.0 2024-09-12T01:34:50.406 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:34:50.406 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T01:34:50.471 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:34:50.471 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:34:50.471 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:34:50.471 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:34:50.471 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:34:50.471 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:34:50.472 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:34:50.472 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:34:50.472 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:34:50.472 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:34:50.504 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-09-12T01:34:50.506 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-09-12T01:34:50.506 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T01:34:50.576 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T01:34:50.647 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T01:34:50.712 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T01:34:50.713 INFO:tasks.ceph:role: osd.1 2024-09-12T01:34:50.713 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:34:50.713 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T01:34:50.780 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:34:50.780 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:34:50.780 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:34:50.780 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:34:50.780 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:34:50.780 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:34:50.780 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:34:50.780 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:34:50.780 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:34:50.780 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:34:50.813 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-09-12T01:34:50.815 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-09-12T01:34:50.815 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T01:34:50.885 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T01:34:50.956 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T01:34:51.024 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T01:34:51.024 INFO:tasks.ceph:role: osd.2 2024-09-12T01:34:51.024 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:34:51.025 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T01:34:51.091 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:34:51.091 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:34:51.091 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:34:51.091 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:34:51.091 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:34:51.091 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:34:51.091 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:34:51.091 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:34:51.091 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:34:51.092 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:34:51.123 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-09-12T01:34:51.125 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-09-12T01:34:51.126 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T01:34:51.196 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T01:34:51.266 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T01:34:51.333 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T01:34:51.333 INFO:tasks.ceph:role: osd.3 2024-09-12T01:34:51.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:34:51.333 DEBUG:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T01:34:51.398 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:34:51.398 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:34:51.398 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:34:51.398 INFO:teuthology.orchestra.run.smithi060.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:34:51.399 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:34:51.399 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:34:51.399 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:34:51.399 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:34:51.399 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:34:51.399 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:34:51.432 INFO:teuthology.orchestra.run.smithi060.stdout:Discarding blocks...Done. 2024-09-12T01:34:51.434 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2024-09-12T01:34:51.434 DEBUG:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T01:34:51.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T01:34:51.573 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:34:51.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:34:51.670+0000 7f5cd3e0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T01:34:51.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:34:51.670+0000 7f5cd3e0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T01:34:51.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:34:51.670+0000 7f5cd3e0c640 -1 bdev(0x55d9df8f7800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T01:34:51.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:34:51.670+0000 7f5cd3e0c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T01:34:55.072 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T01:34:55.104 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:34:55.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:34:55.196+0000 7f63b0927640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T01:34:55.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:34:55.196+0000 7f63b0927640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T01:34:55.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:34:55.196+0000 7f63b0927640 -1 bdev(0x555cc504f800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T01:34:55.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:34:55.196+0000 7f63b0927640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T01:34:58.124 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T01:34:58.154 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:34:58.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:34:58.249+0000 7f920b618640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T01:34:58.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:34:58.250+0000 7f920b618640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T01:34:58.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:34:58.250+0000 7f920b618640 -1 bdev(0x558faf247800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T01:34:58.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:34:58.250+0000 7f920b618640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T01:35:01.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T01:35:01.460 DEBUG:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:35:01.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:01.551+0000 7ff028e64640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T01:35:01.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:01.552+0000 7ff028e64640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T01:35:01.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:01.552+0000 7ff028e64640 -1 bdev(0x55e7a36bb800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T01:35:01.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:01.552+0000 7ff028e64640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T01:35:05.466 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T01:35:05.497 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T01:35:05.527 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T01:35:05.527 INFO:tasks.ceph:role: osd.4 2024-09-12T01:35:05.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:35:05.528 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T01:35:05.603 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:35:05.603 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:35:05.603 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:35:05.603 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:35:05.603 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:35:05.604 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:35:05.604 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:35:05.604 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:35:05.604 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:35:05.604 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:35:06.122 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-09-12T01:35:06.124 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-09-12T01:35:06.124 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T01:35:06.258 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T01:35:06.290 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T01:35:06.357 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T01:35:06.357 INFO:tasks.ceph:role: osd.5 2024-09-12T01:35:06.357 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:35:06.357 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T01:35:06.429 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:35:06.430 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:35:06.430 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:35:06.430 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:35:06.430 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:35:06.430 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:35:06.430 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:35:06.430 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:35:06.430 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:35:06.430 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:35:06.882 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-09-12T01:35:06.884 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-09-12T01:35:06.884 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T01:35:06.975 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T01:35:07.004 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T01:35:07.069 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T01:35:07.069 INFO:tasks.ceph:role: osd.6 2024-09-12T01:35:07.069 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:35:07.070 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T01:35:07.142 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:35:07.142 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:35:07.142 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:35:07.143 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:35:07.143 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:35:07.143 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:35:07.143 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:35:07.143 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:35:07.143 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:35:07.143 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:35:07.631 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-09-12T01:35:07.633 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-09-12T01:35:07.633 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T01:35:07.746 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T01:35:07.777 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T01:35:07.842 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T01:35:07.842 INFO:tasks.ceph:role: osd.7 2024-09-12T01:35:07.842 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:35:07.843 DEBUG:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T01:35:07.914 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T01:35:07.915 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T01:35:07.915 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T01:35:07.915 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T01:35:07.915 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T01:35:07.915 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2024-09-12T01:35:07.915 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T01:35:07.915 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T01:35:07.915 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T01:35:07.915 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T01:35:08.431 INFO:teuthology.orchestra.run.smithi105.stdout:Discarding blocks...Done. 2024-09-12T01:35:08.432 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2024-09-12T01:35:08.433 DEBUG:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T01:35:08.563 DEBUG:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T01:35:08.593 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:35:08.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:08.709+0000 7fb395a1c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T01:35:08.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:08.709+0000 7fb395a1c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T01:35:08.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:08.709+0000 7fb395a1c640 -1 bdev(0x564f067df800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T01:35:08.709 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:08.709+0000 7fb395a1c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T01:35:12.363 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T01:35:12.393 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:35:12.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:12.486+0000 7f620be33640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T01:35:12.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:12.486+0000 7f620be33640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T01:35:12.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:12.486+0000 7f620be33640 -1 bdev(0x559fe0455800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T01:35:12.486 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:12.486+0000 7f620be33640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T01:35:16.389 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T01:35:16.418 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:35:16.510 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:16.509+0000 7fdbe7dc5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T01:35:16.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:16.510+0000 7fdbe7dc5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T01:35:16.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:16.510+0000 7fdbe7dc5640 -1 bdev(0x56042f8df800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T01:35:16.511 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:16.510+0000 7fdbe7dc5640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T01:35:17.183 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:35:17.186 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:35:19.921 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T01:35:19.950 DEBUG:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:35:20.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:20.040+0000 7f517e5dd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T01:35:20.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:20.041+0000 7f517e5dd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T01:35:20.041 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:20.041+0000 7f517e5dd640 -1 bdev(0x5581b1c4f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T01:35:20.042 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:20.041+0000 7f517e5dd640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T01:35:23.958 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T01:35:23.988 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T01:35:23.988 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:23.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T01:35:24.020 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:24.020 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-12T01:35:24.090 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:24.090 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-12T01:35:24.159 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:24.159 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T01:35:24.227 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:24.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T01:35:24.295 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:24.295 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T01:35:24.364 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:24.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T01:35:24.433 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:24.433 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T01:35:24.463 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:24.464 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-12T01:35:24.532 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:24.532 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-12T01:35:24.600 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:24.600 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T01:35:24.668 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:24.668 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T01:35:24.735 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:24.735 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T01:35:24.802 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:24.802 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T01:35:24.868 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:24.868 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T01:35:24.887 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:24.888 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-12T01:35:24.947 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:24.947 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T01:35:24.963 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:24.963 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-12T01:35:25.019 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T01:35:25.019 DEBUG:teuthology.orchestra.run.smithi060:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T01:35:25.021 DEBUG:teuthology.orchestra.run.smithi105:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T01:35:25.063 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.y] 2024-09-12T01:35:25.063 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA5ReJm3Ei+JBAAhwgXWq0baTlDtaLedcaHmg== 2024-09-12T01:35:25.063 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2024-09-12T01:35:25.063 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA5ReJmIK3fKxAAM9RkghDZwJZWuKouIbObDw== 2024-09-12T01:35:25.063 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2024-09-12T01:35:25.063 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA5ReJmksMWMxAAp3xMDD09rfphgPZwQcEABA== 2024-09-12T01:35:25.063 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.0] 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA7ReJmc3D/JxAAXiw6n1Q3n9sCXln6YSiCBA== 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.1] 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA/ReJmEOu3CxAA4uu1neLh0mpeG9nia+/VqQ== 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.2] 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBCReJm3HHtDhAAoAdKVsjuXmpcf5R5zTtFKg== 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.3] 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBFReJmtRLuIBAA/BBibpGfpXsFXqVjVrmXWA== 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.x] 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA5ReJmjpyMKBAAMSGgYJddHs7TtCV0NszZAQ== 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA5ReJmzqHZNxAAnhCo4gGwLgYDVzzYnoiDFA== 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.d] 2024-09-12T01:35:25.064 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmvLw/AxAApd4hl5LRD1QddnPPjRw2Kg== 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.4] 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBMReJmdDNXKhAAeh5aCvMw+70z3tnwjb9Hjg== 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.5] 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBQReJm/tsIHRAAmgx+5WifY/VITGHAbUV2CQ== 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.6] 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBUReJmQFaBHhAA1vH01tePCoJQFXlHB5gcVg== 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.7] 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQBYReJmTHqLAhAAtUB94Pa3eihlVdaupZ8Ggg== 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ== 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout:[client.2] 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmqUgQDRAAAp5SAwNM9aSxZ1VVRwroNA== 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout:[client.1] 2024-09-12T01:35:25.065 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmTopGEBAAY0K3iZm2PotQc8a489uO/Q== 2024-09-12T01:35:25.066 INFO:teuthology.orchestra.run.smithi060.stdout:[client.3] 2024-09-12T01:35:25.066 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmGfzeFRAAE2xCnzeyX/KBo3NBrkixYQ== 2024-09-12T01:35:25.082 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.y] 2024-09-12T01:35:25.083 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA5ReJm3Ei+JBAAhwgXWq0baTlDtaLedcaHmg== 2024-09-12T01:35:25.083 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2024-09-12T01:35:25.083 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA5ReJmIK3fKxAAM9RkghDZwJZWuKouIbObDw== 2024-09-12T01:35:25.083 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.c] 2024-09-12T01:35:25.083 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA5ReJmksMWMxAAp3xMDD09rfphgPZwQcEABA== 2024-09-12T01:35:25.083 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.0] 2024-09-12T01:35:25.083 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA7ReJmc3D/JxAAXiw6n1Q3n9sCXln6YSiCBA== 2024-09-12T01:35:25.083 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.1] 2024-09-12T01:35:25.083 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA/ReJmEOu3CxAA4uu1neLh0mpeG9nia+/VqQ== 2024-09-12T01:35:25.083 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.2] 2024-09-12T01:35:25.083 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBCReJm3HHtDhAAoAdKVsjuXmpcf5R5zTtFKg== 2024-09-12T01:35:25.084 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.3] 2024-09-12T01:35:25.084 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBFReJmtRLuIBAA/BBibpGfpXsFXqVjVrmXWA== 2024-09-12T01:35:25.084 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.x] 2024-09-12T01:35:25.084 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA5ReJmjpyMKBAAMSGgYJddHs7TtCV0NszZAQ== 2024-09-12T01:35:25.084 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2024-09-12T01:35:25.084 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA5ReJmzqHZNxAAnhCo4gGwLgYDVzzYnoiDFA== 2024-09-12T01:35:25.084 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.d] 2024-09-12T01:35:25.084 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA6ReJmvLw/AxAApd4hl5LRD1QddnPPjRw2Kg== 2024-09-12T01:35:25.084 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.4] 2024-09-12T01:35:25.084 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBMReJmdDNXKhAAeh5aCvMw+70z3tnwjb9Hjg== 2024-09-12T01:35:25.084 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.5] 2024-09-12T01:35:25.084 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBQReJm/tsIHRAAmgx+5WifY/VITGHAbUV2CQ== 2024-09-12T01:35:25.085 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.6] 2024-09-12T01:35:25.085 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBUReJmQFaBHhAA1vH01tePCoJQFXlHB5gcVg== 2024-09-12T01:35:25.085 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.7] 2024-09-12T01:35:25.085 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQBYReJmTHqLAhAAtUB94Pa3eihlVdaupZ8Ggg== 2024-09-12T01:35:25.085 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2024-09-12T01:35:25.085 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ== 2024-09-12T01:35:25.085 INFO:teuthology.orchestra.run.smithi105.stdout:[client.2] 2024-09-12T01:35:25.085 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA6ReJmqUgQDRAAAp5SAwNM9aSxZ1VVRwroNA== 2024-09-12T01:35:25.085 INFO:teuthology.orchestra.run.smithi105.stdout:[client.1] 2024-09-12T01:35:25.085 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA6ReJmTopGEBAAY0K3iZm2PotQc8a489uO/Q== 2024-09-12T01:35:25.085 INFO:teuthology.orchestra.run.smithi105.stdout:[client.3] 2024-09-12T01:35:25.085 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQA6ReJmGfzeFRAAE2xCnzeyX/KBo3NBrkixYQ== 2024-09-12T01:35:25.086 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T01:35:25.110 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T01:35:25.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:35:25.179 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:35:25.236 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:35:25.238 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:35:25.293 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.295 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.346 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.348 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.398 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.400 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.452 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.455 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.506 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T01:35:25.508 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T01:35:25.559 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:35:25.561 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:35:25.615 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:35:25.618 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-12T01:35:25.671 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.674 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.724 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.727 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.777 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.780 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.832 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T01:35:25.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:35:25.885 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:35:25.939 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:35:25.941 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:35:25.995 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:35:25.997 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:35:26.051 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:35:26.054 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T01:35:26.107 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T01:35:26.107 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T01:35:26.133 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T01:35:26.230 DEBUG:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T01:35:26.255 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T01:35:26.281 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T01:35:26.377 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T01:35:26.401 DEBUG:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T01:35:26.466 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T01:35:26.561 DEBUG:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T01:35:26.586 DEBUG:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:35:26.593 DEBUG:teuthology.orchestra.run.smithi105:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T01:35:26.641 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T01:35:26.642 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T01:35:26.642 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T01:35:26.646 INFO:tasks.ceph.mon.a:Started 2024-09-12T01:35:26.646 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T01:35:26.646 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T01:35:26.683 INFO:tasks.ceph.mon.b:Started 2024-09-12T01:35:26.683 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T01:35:26.684 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T01:35:26.685 INFO:tasks.ceph.mon.c:Started 2024-09-12T01:35:26.686 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T01:35:26.686 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T01:35:26.686 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T01:35:26.688 INFO:tasks.ceph.mgr.y:Started 2024-09-12T01:35:26.689 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T01:35:26.689 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T01:35:26.691 INFO:tasks.ceph.mgr.x:Started 2024-09-12T01:35:26.691 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T01:35:26.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T01:35:26.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.794+0000 7f2789ef1640 1 Processor -- start 2024-09-12T01:35:26.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.794+0000 7f2789ef1640 1 -- start start 2024-09-12T01:35:26.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.795+0000 7f2789ef1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:26.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.795+0000 7f2789ef1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27840cf2a0 con 0x7f2784162150 2024-09-12T01:35:26.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.795+0000 7f2789ef1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27840cf9b0 con 0x7f2784161d70 2024-09-12T01:35:26.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.795+0000 7f2789ef1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f27840cf760 con 0x7f27840b6890 2024-09-12T01:35:26.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.795+0000 7f2783fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2784162150 0x7f27840d22d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:43078/0 (socket says 172.21.15.60:43078) 2024-09-12T01:35:26.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.795+0000 7f2783fff640 1 -- 172.21.15.60:0/3035003087 learned_addr learned my addr 172.21.15.60:0/3035003087 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:35:26.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.795+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:26.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.795+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f27840b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T01:35:26.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.795+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f27840b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:26.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.795+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:26.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.795+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.996+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.996+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f27840b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T01:35:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.996+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f27840b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.996+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:26.996+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:35:27.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:27.397+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:27.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:27.397+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f27840b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T01:35:27.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:27.397+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f27840b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:27.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:27.397+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:27.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:27.397+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:35:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:28.199+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:28.199+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f27840b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T01:35:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:28.199+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f27840b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:28.199+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:28.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:28.199+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:35:29.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27817fa640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f27840b3390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:35:29.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27817fa640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f27840b3390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:29.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27817fa640 1 -- 172.21.15.60:0/3035003087 >> v1:172.21.15.105:6789/0 conn(0x7f2784161d70 legacy=0x7f27840b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:29.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27817fa640 1 -- 172.21.15.60:0/3035003087 >> v1:172.21.15.60:6789/0 conn(0x7f2784162150 legacy=0x7f27840d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:29.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27817fa640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:29.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27817fa640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:29.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27817fa640 1 -- 172.21.15.60:0/3035003087 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f27840cf760 con 0x7f27700061c0 2024-09-12T01:35:29.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27817fa640 1 -- 172.21.15.60:0/3035003087 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2770008cf0 con 0x7f27700036f0 2024-09-12T01:35:29.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:29.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 msgr2=0x7f2770008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T01:35:29.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 msgr2=0x7f2770008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:29.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:29.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:29.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:29.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27837fe640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 msgr2=0x7f2770005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T01:35:29.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27837fe640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 msgr2=0x7f2770005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:29.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:29.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.796+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:29.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.997+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:29.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.997+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 msgr2=0x7f2770008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T01:35:29.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.997+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 msgr2=0x7f2770008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:29.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.997+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:29.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.997+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:29.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.997+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:35:29.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.997+0000 7f27837fe640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 msgr2=0x7f2770005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T01:35:29.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.997+0000 7f27837fe640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 msgr2=0x7f2770005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:29.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.997+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:29.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:29.997+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-12T01:35:30.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:30.398+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:30.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:30.398+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 msgr2=0x7f2770008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T01:35:30.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:30.398+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 msgr2=0x7f2770008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:30.398+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:30.398+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:35:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:30.398+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:30.398+0000 7f27837fe640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 msgr2=0x7f2770005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T01:35:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:30.398+0000 7f27837fe640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 msgr2=0x7f2770005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:30.398+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:30.398+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-12T01:35:31.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:31.199+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:31.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:31.199+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 msgr2=0x7f2770008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T01:35:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:31.199+0000 7f2782ffd640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 msgr2=0x7f2770008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:31.199+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:31.199+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:35:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:31.199+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:31.199+0000 7f27837fe640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 msgr2=0x7f2770005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T01:35:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:31.199+0000 7f27837fe640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 msgr2=0x7f2770005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:31.199+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:31.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:31.199+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-12T01:35:32.091 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:32.091+0000 7f3e9bdf9040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:35:32.136 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:32.136+0000 7f3e9bdf9040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:35:32.282 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:32.282+0000 7f3e9bdf9040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:35:32.335 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:32.335+0000 7f3e9bdf9040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:35:32.510 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:32.510+0000 7f3e9bdf9040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:35:32.626 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:32.626+0000 7f3e9bdf9040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:35:32.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27817fa640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 msgr2=0x7f2770005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:35:32.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27817fa640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.105:3300/0 conn(0x7f27700036f0 0x7f2770005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:32.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27817fa640 1 -- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 msgr2=0x7f2770008640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:35:32.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27817fa640 1 --2- 172.21.15.60:0/3035003087 >> v2:172.21.15.60:3300/0 conn(0x7f27700061c0 0x7f2770008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:32.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f2783fff640 1 -- 172.21.15.60:0/3035003087 reap_dead start 2024-09-12T01:35:32.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27817fa640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f277000b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:32.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27817fa640 1 -- 172.21.15.60:0/3035003087 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27840cfc90 con 0x7f2770003b40 2024-09-12T01:35:32.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27817fa640 1 -- 172.21.15.60:0/3035003087 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f277000f6c0 con 0x7f2770007cc0 2024-09-12T01:35:32.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27817fa640 1 -- 172.21.15.60:0/3035003087 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f27840cf760 con 0x7f27840b6890 2024-09-12T01:35:32.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f277000b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:32.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286490900 0 0) 0x7f27840cfc90 con 0x7f2770003b40 2024-09-12T01:35:32.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f276c003520 con 0x7f2770003b40 2024-09-12T01:35:32.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27837fe640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f277000b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T01:35:32.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27837fe640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f277000b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:32.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f277000b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:32.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f277000b150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2588789545 0 0) 0x7f276c003520 con 0x7f2770003b40 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f277000b150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27827fc640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f277000b150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 >> v1:172.21.15.105:6789/0 conn(0x7f2770007cc0 legacy=0x7f2770008170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27700108a0 con 0x7f2770003b40 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f2778015580 con 0x7f2770003b40 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.796+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 >> v1:172.21.15.60:6789/0 conn(0x7f2770003b40 legacy=0x7f27700065a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f27827fc640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f276c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f27827fc640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f276c003fd0 0x7f276c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f27827fc640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f276c004d40 0x7f276c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27840cf760 con 0x7f276c004d40 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f276c00bbb0 con 0x7f276c003fd0 2024-09-12T01:35:32.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f276c00bdb0 con 0x7f27840b6890 2024-09-12T01:35:32.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f2783fff640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f276c004d40 0x7f276c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:32.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f276c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:32.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f276c003fd0 0x7f276c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:32.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f27837fe640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f276c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-12T01:35:32.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f27837fe640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f276c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:32.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f276c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:32.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f27837fe640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f276c0039e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:32.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f2783fff640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 msgr2=0x7f276c0039e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:35:32.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f2783fff640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27840b6890 0x7f276c0039e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:32.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f2783fff640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f276c003fd0 msgr2=0x7f276c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:32.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f2783fff640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f276c003fd0 0x7f276c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:32.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.797+0000 7f2783fff640 1 -- 172.21.15.60:0/3035003087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f276c003520 con 0x7f276c004d40 2024-09-12T01:35:32.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.798+0000 7f2783fff640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f276c004d40 0x7f276c0051c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f27840c81d0 tx=0x7f276c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1bfe4d9d3c8dc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:32.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.798+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c001e00 con 0x7f276c004d40 2024-09-12T01:35:32.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.798+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277c032630 con 0x7f276c004d40 2024-09-12T01:35:32.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.798+0000 7f27827fc640 1 -- 172.21.15.60:0/3035003087 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277c032a20 con 0x7f276c004d40 2024-09-12T01:35:32.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.799+0000 7f2789ef1640 1 -- 172.21.15.60:0/3035003087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f276c004d40 msgr2=0x7f276c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:32.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.799+0000 7f2789ef1640 1 --2- 172.21.15.60:0/3035003087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f276c004d40 0x7f276c0051c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f27840c81d0 tx=0x7f276c005830 comp rx=0 tx=0).stop 2024-09-12T01:35:32.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.799+0000 7f2783fff640 1 -- 172.21.15.60:0/3035003087 reap_dead start 2024-09-12T01:35:32.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.799+0000 7f2789ef1640 1 -- 172.21.15.60:0/3035003087 shutdown_connections 2024-09-12T01:35:32.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.799+0000 7f2789ef1640 1 -- 172.21.15.60:0/3035003087 >> 172.21.15.60:0/3035003087 conn(0x7f278406c500 msgr2=0x7f278406c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:32.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.799+0000 7f2789ef1640 1 -- 172.21.15.60:0/3035003087 shutdown_connections 2024-09-12T01:35:32.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.799+0000 7f2789ef1640 1 -- 172.21.15.60:0/3035003087 wait complete. 2024-09-12T01:35:32.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.800+0000 7f2789ef1640 1 Processor -- start 2024-09-12T01:35:32.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.800+0000 7f2789ef1640 1 -- start start 2024-09-12T01:35:32.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f2789ef1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f278415f4c0 0x7f278415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:32.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f2789ef1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f278415f8a0 0x7f278415c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:32.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f2789ef1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f278415aac0 0x7f278415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:32.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f2789ef1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27840d43e0 con 0x7f278415f4c0 2024-09-12T01:35:32.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f2789ef1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27840d4260 con 0x7f278415aac0 2024-09-12T01:35:32.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f2789ef1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f27840d4560 con 0x7f278415f8a0 2024-09-12T01:35:32.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f27837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f278415f4c0 0x7f278415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:32.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f27837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f278415f4c0 0x7f278415d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56938/0 (socket says 172.21.15.60:56938) 2024-09-12T01:35:32.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f27837fe640 1 -- 172.21.15.60:0/3735878855 learned_addr learned my addr 172.21.15.60:0/3735878855 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3735878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f278415f8a0 0x7f278415c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f2783fff640 1 --2- 172.21.15.60:0/3735878855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f278415aac0 0x7f278415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f2782ffd640 1 -- 172.21.15.60:0/3735878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f278415f8a0 msgr2=0x7f278415c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f2782ffd640 1 -- 172.21.15.60:0/3735878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f278415f8a0 msgr2=0x7f278415c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3735878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f278415f8a0 0x7f278415c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f2782ffd640 1 --2- 172.21.15.60:0/3735878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f278415f8a0 0x7f278415c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f27837fe640 1 -- 172.21.15.60:0/3735878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f278415f8a0 msgr2=0x7f278415c2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f27837fe640 1 --2- 172.21.15.60:0/3735878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f278415f8a0 0x7f278415c2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f27837fe640 1 -- 172.21.15.60:0/3735878855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f278415aac0 msgr2=0x7f278415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f27837fe640 1 --2- 172.21.15.60:0/3735878855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f278415aac0 0x7f278415af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f27837fe640 1 -- 172.21.15.60:0/3735878855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278415de80 con 0x7f278415f4c0 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.801+0000 7f27837fe640 1 --2- 172.21.15.60:0/3735878855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f278415f4c0 0x7f278415d8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2774003fb0 tx=0x7f2774016850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:32.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.802+0000 7f276bfff640 1 -- 172.21.15.60:0/3735878855 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774017700 con 0x7f278415f4c0 2024-09-12T01:35:32.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.802+0000 7f276bfff640 1 -- 172.21.15.60:0/3735878855 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277401b030 con 0x7f278415f4c0 2024-09-12T01:35:32.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.802+0000 7f2789ef1640 1 -- 172.21.15.60:0/3735878855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f278415e160 con 0x7f278415f4c0 2024-09-12T01:35:32.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.802+0000 7f276bfff640 1 -- 172.21.15.60:0/3735878855 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774017ae0 con 0x7f278415f4c0 2024-09-12T01:35:32.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.802+0000 7f2789ef1640 1 -- 172.21.15.60:0/3735878855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f278415e720 con 0x7f278415f4c0 2024-09-12T01:35:32.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.802+0000 7f276bfff640 1 -- 172.21.15.60:0/3735878855 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2774013040 con 0x7f278415f4c0 2024-09-12T01:35:32.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.802+0000 7f276bfff640 1 -- 172.21.15.60:0/3735878855 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f277401f9b0 con 0x7f278415f4c0 2024-09-12T01:35:32.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.803+0000 7f2789ef1640 1 -- 172.21.15.60:0/3735878855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27840ced50 con 0x7f278415f4c0 2024-09-12T01:35:32.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.805+0000 7f276bfff640 1 -- 172.21.15.60:0/3735878855 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2774017c80 con 0x7f278415f4c0 2024-09-12T01:35:32.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.869+0000 7f2789ef1640 1 -- 172.21.15.60:0/3735878855 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f27840b6fa0 con 0x7f278415f4c0 2024-09-12T01:35:32.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.870+0000 7f276bfff640 1 -- 172.21.15.60:0/3735878855 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f277401fc00 con 0x7f278415f4c0 2024-09-12T01:35:32.870 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2024-09-12T01:35:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.871+0000 7f2789ef1640 1 -- 172.21.15.60:0/3735878855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f278415f4c0 msgr2=0x7f278415d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.871+0000 7f2789ef1640 1 --2- 172.21.15.60:0/3735878855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f278415f4c0 0x7f278415d8a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2774003fb0 tx=0x7f2774016850 comp rx=0 tx=0).stop 2024-09-12T01:35:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.871+0000 7f2789ef1640 1 -- 172.21.15.60:0/3735878855 shutdown_connections 2024-09-12T01:35:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.871+0000 7f2789ef1640 1 --2- 172.21.15.60:0/3735878855 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f278415aac0 0x7f278415af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.871+0000 7f2789ef1640 1 --2- 172.21.15.60:0/3735878855 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f278415f8a0 0x7f278415c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.871+0000 7f2789ef1640 1 --2- 172.21.15.60:0/3735878855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f278415f4c0 0x7f278415d8a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.871+0000 7f2789ef1640 1 -- 172.21.15.60:0/3735878855 >> 172.21.15.60:0/3735878855 conn(0x7f278406c500 msgr2=0x7f27840b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.871+0000 7f2789ef1640 1 -- 172.21.15.60:0/3735878855 shutdown_connections 2024-09-12T01:35:32.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:32.871+0000 7f2789ef1640 1 -- 172.21.15.60:0/3735878855 wait complete. 2024-09-12T01:35:32.874 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:32.874+0000 7f953ea0d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-12T01:35:32.883 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T01:35:32.883 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T01:35:32.883 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:32.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T01:35:32.909 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:32.909 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T01:35:32.916 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:32.916+0000 7f953ea0d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-12T01:35:32.973 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:32.972+0000 7f3e9bdf9040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:35:32.977 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:32.977 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T01:35:33.028 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:33.028+0000 7f3e9bdf9040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:35:33.047 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:35:33.047 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T01:35:33.065 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:33.065+0000 7f953ea0d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-12T01:35:33.114 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:33.114 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T01:35:33.115 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:33.114+0000 7f953ea0d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-12T01:35:33.141 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:33.141 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T01:35:33.190 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:33.189+0000 7f3e9bdf9040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:35:33.206 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:33.206 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T01:35:33.271 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:35:33.271 DEBUG:teuthology.orchestra.run.smithi105:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T01:35:33.289 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:33.289+0000 7f953ea0d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:35:33.313 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 2f2c26f8-c31e-432b-87ff-54875d7a99c7 0 2024-09-12T01:35:33.404 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:33.404+0000 7f953ea0d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-12T01:35:33.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.452+0000 7fb507b78640 1 Processor -- start 2024-09-12T01:35:33.452 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.452+0000 7fb507b78640 1 -- start start 2024-09-12T01:35:33.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb507b78640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb5000d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb507b78640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb500072c70 con 0x7fb5000b3570 2024-09-12T01:35:33.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb507b78640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5000d1190 con 0x7fb500072690 2024-09-12T01:35:33.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb507b78640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb5000d21b0 con 0x7fb50015c260 2024-09-12T01:35:33.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb505914640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb5000d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb506115640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fb500072690 0x7fb50006ca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:52812/0 (socket says 172.21.15.105:52812) 2024-09-12T01:35:33.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb506115640 1 -- 172.21.15.105:0/1542250155 learned_addr learned my addr 172.21.15.105:0/1542250155 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-09-12T01:35:33.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb505914640 1 -- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 msgr2=0x7fb5000d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T01:35:33.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb505914640 1 -- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 msgr2=0x7fb5000d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:33.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb505914640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb5000d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:33.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb505914640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb5000d1c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:33.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487663861 0 0) 0x7fb5000d1190 con 0x7fb500072690 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.453+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4ec003520 con 0x7fb500072690 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2477879404 0 0) 0x7fb4ec003520 con 0x7fb500072690 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 msgr2=0x7fb5000d1c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb5000d1c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 >> v1:172.21.15.60:6789/0 conn(0x7fb5000b3570 legacy=0x7fb500071f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5000d1470 con 0x7fb500072690 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fb4f80019f0 con 0x7fb500072690 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 >> v1:172.21.15.105:6789/0 conn(0x7fb500072690 legacy=0x7fb50006ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4ec0039b0 0x7fb4ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4ec004800 0x7fb4ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb4ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb5000d21b0 con 0x7fb4ec004800 2024-09-12T01:35:33.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4ec005540 con 0x7fb4ec0039b0 2024-09-12T01:35:33.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb4ec00bf00 con 0x7fb50015c260 2024-09-12T01:35:33.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb505914640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4ec0039b0 0x7fb4ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb506115640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb4ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb505113640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4ec004800 0x7fb4ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb506115640 1 -- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4ec0039b0 msgr2=0x7fb4ec003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:33.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb506115640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4ec0039b0 0x7fb4ec003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb506115640 1 -- 172.21.15.105:0/1542250155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4ec004800 msgr2=0x7fb4ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:33.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb506115640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4ec004800 0x7fb4ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb506115640 1 -- 172.21.15.105:0/1542250155 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4ec003520 con 0x7fb50015c260 2024-09-12T01:35:33.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.454+0000 7fb505914640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4ec0039b0 0x7fb4ec003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:33.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.455+0000 7fb506115640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb4ec00b9c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800a840 tx=0x7fb4ec005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a4bf11cf656ec9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:33.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.455+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800a460 con 0x7fb50015c260 2024-09-12T01:35:33.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.455+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f802f070 con 0x7fb50015c260 2024-09-12T01:35:33.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.455+0000 7fb504912640 1 -- 172.21.15.105:0/1542250155 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f802bcb0 con 0x7fb50015c260 2024-09-12T01:35:33.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.456+0000 7fb507b78640 1 -- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 msgr2=0x7fb4ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.456+0000 7fb507b78640 1 --2- 172.21.15.105:0/1542250155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb4ec00b9c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800a840 tx=0x7fb4ec005830 comp rx=0 tx=0).stop 2024-09-12T01:35:33.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.456+0000 7fb506115640 1 -- 172.21.15.105:0/1542250155 reap_dead start 2024-09-12T01:35:33.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.456+0000 7fb507b78640 1 -- 172.21.15.105:0/1542250155 shutdown_connections 2024-09-12T01:35:33.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.456+0000 7fb507b78640 1 -- 172.21.15.105:0/1542250155 >> 172.21.15.105:0/1542250155 conn(0x7fb5000b6b50 msgr2=0x7fb5000b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:33.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.456+0000 7fb507b78640 1 -- 172.21.15.105:0/1542250155 shutdown_connections 2024-09-12T01:35:33.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.456+0000 7fb507b78640 1 -- 172.21.15.105:0/1542250155 wait complete. 2024-09-12T01:35:33.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.457+0000 7fb507b78640 1 Processor -- start 2024-09-12T01:35:33.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.457+0000 7fb507b78640 1 -- start start 2024-09-12T01:35:33.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb507b78640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb50015c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb507b78640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb50015e450 0x7fb50013f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb507b78640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5001583d0 0x7fb500158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb507b78640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb5000d17e0 con 0x7fb50015e450 2024-09-12T01:35:33.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb507b78640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb500072f50 con 0x7fb5001583d0 2024-09-12T01:35:33.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb507b78640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb5000d1c70 con 0x7fb50015c260 2024-09-12T01:35:33.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb505914640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb50015c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb506115640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5001583d0 0x7fb500158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb505914640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb50015c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60608/0 (socket says 172.21.15.105:60608) 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb505914640 1 -- 172.21.15.105:0/3641360098 learned_addr learned my addr 172.21.15.105:0/3641360098 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb505113640 1 --2- 172.21.15.105:0/3641360098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb50015e450 0x7fb50013f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb505914640 1 -- 172.21.15.105:0/3641360098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 msgr2=0x7fb50015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb505914640 1 -- 172.21.15.105:0/3641360098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 msgr2=0x7fb50015c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb505914640 1 --2- 172.21.15.105:0/3641360098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb50015c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb505914640 1 --2- 172.21.15.105:0/3641360098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb50015c850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb506115640 1 -- 172.21.15.105:0/3641360098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 msgr2=0x7fb50015c850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb506115640 1 --2- 172.21.15.105:0/3641360098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb50015c850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb506115640 1 -- 172.21.15.105:0/3641360098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb50015e450 msgr2=0x7fb50013f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb506115640 1 --2- 172.21.15.105:0/3641360098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb50015e450 0x7fb50013f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb506115640 1 -- 172.21.15.105:0/3641360098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb500140210 con 0x7fb5001583d0 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb505113640 1 --2- 172.21.15.105:0/3641360098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb50015e450 0x7fb50013f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb506115640 1 --2- 172.21.15.105:0/3641360098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5001583d0 0x7fb500158860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8030000 tx=0x7fb5000d1640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:33.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb4f67fc640 1 -- 172.21.15.105:0/3641360098 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f000b5e0 con 0x7fb5001583d0 2024-09-12T01:35:33.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb4f67fc640 1 -- 172.21.15.105:0/3641360098 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f802bc60 con 0x7fb5001583d0 2024-09-12T01:35:33.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb4f67fc640 1 -- 172.21.15.105:0/3641360098 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800a460 con 0x7fb5001583d0 2024-09-12T01:35:33.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.458+0000 7fb507b78640 1 -- 172.21.15.105:0/3641360098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5001404f0 con 0x7fb5001583d0 2024-09-12T01:35:33.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.459+0000 7fb507b78640 1 -- 172.21.15.105:0/3641360098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb500140ab0 con 0x7fb5001583d0 2024-09-12T01:35:33.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.459+0000 7fb4f67fc640 1 -- 172.21.15.105:0/3641360098 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb4f8046060 con 0x7fb5001583d0 2024-09-12T01:35:33.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.459+0000 7fb4f67fc640 1 -- 172.21.15.105:0/3641360098 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fb4f8048940 con 0x7fb5001583d0 2024-09-12T01:35:33.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.460+0000 7fb507b78640 1 -- 172.21.15.105:0/3641360098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5000b39b0 con 0x7fb5001583d0 2024-09-12T01:35:33.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.462+0000 7fb4f67fc640 1 -- 172.21.15.105:0/3641360098 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb4f805f2d0 con 0x7fb5001583d0 2024-09-12T01:35:33.529 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.529+0000 7fb507b78640 1 -- 172.21.15.105:0/3641360098 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2f2c26f8-c31e-432b-87ff-54875d7a99c7", "id": 0} v 0) -- 0x7fb500073160 con 0x7fb5001583d0 2024-09-12T01:35:33.532 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.533+0000 7fb4f67fc640 1 -- 172.21.15.105:0/3641360098 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f2c26f8-c31e-432b-87ff-54875d7a99c7", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fb4f804d030 con 0x7fb5001583d0 2024-09-12T01:35:33.533 INFO:teuthology.orchestra.run.smithi105.stdout:0 2024-09-12T01:35:33.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.534+0000 7fb507b78640 1 -- 172.21.15.105:0/3641360098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5001583d0 msgr2=0x7fb500158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.534+0000 7fb507b78640 1 --2- 172.21.15.105:0/3641360098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5001583d0 0x7fb500158860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8030000 tx=0x7fb5000d1640 comp rx=0 tx=0).stop 2024-09-12T01:35:33.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.534+0000 7fb507b78640 1 -- 172.21.15.105:0/3641360098 shutdown_connections 2024-09-12T01:35:33.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.534+0000 7fb507b78640 1 --2- 172.21.15.105:0/3641360098 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5001583d0 0x7fb500158860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.534+0000 7fb507b78640 1 --2- 172.21.15.105:0/3641360098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb50015e450 0x7fb50013f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.534+0000 7fb507b78640 1 --2- 172.21.15.105:0/3641360098 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb50015c260 0x7fb50015c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.534+0000 7fb507b78640 1 -- 172.21.15.105:0/3641360098 >> 172.21.15.105:0/3641360098 conn(0x7fb5000b6b50 msgr2=0x7fb5000cf5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:33.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.534+0000 7fb507b78640 1 -- 172.21.15.105:0/3641360098 shutdown_connections 2024-09-12T01:35:33.537 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.534+0000 7fb507b78640 1 -- 172.21.15.105:0/3641360098 wait complete. 2024-09-12T01:35:33.544 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new c92bf594-1af8-4a25-beed-7ca9cc3d9eff 1 2024-09-12T01:35:33.645 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.645+0000 7f9418152640 1 Processor -- start 2024-09-12T01:35:33.645 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.645+0000 7f9418152640 1 -- start start 2024-09-12T01:35:33.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9418152640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9410159000 0x7f941015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9418152640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9410072f40 con 0x7f9410072190 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9418152640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9410072980 con 0x7f94100b36a0 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9418152640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f94100b5130 con 0x7f9410159000 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f94166ef640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f94100b36a0 0x7f941015ca40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:52816/0 (socket says 172.21.15.105:52816) 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f94166ef640 1 -- 172.21.15.105:0/1369967494 learned_addr learned my addr 172.21.15.105:0/1369967494 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9415eee640 1 --2- 172.21.15.105:0/1369967494 >> v2:172.21.15.60:3300/0 conn(0x7f9410159000 0x7f941015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 527755140 0 0) 0x7f9410072980 con 0x7f94100b36a0 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93fc003520 con 0x7f94100b36a0 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2983632697 0 0) 0x7f93fc003520 con 0x7f94100b36a0 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 >> v2:172.21.15.60:3300/0 conn(0x7f9410159000 msgr2=0x7f941015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9414eec640 1 --2- 172.21.15.105:0/1369967494 >> v2:172.21.15.60:3300/0 conn(0x7f9410159000 0x7f941015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 >> v1:172.21.15.60:6789/0 conn(0x7f9410072190 legacy=0x7f94100b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9410072c60 con 0x7f94100b36a0 2024-09-12T01:35:33.649 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f94080019f0 con 0x7f94100b36a0 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.646+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 >> v1:172.21.15.105:6789/0 conn(0x7f94100b36a0 legacy=0x7f941015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f9414eec640 1 --2- 172.21.15.105:0/1369967494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93fc0039b0 0x7f93fc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f9414eec640 1 --2- 172.21.15.105:0/1369967494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93fc004800 0x7f93fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f9414eec640 1 --2- 172.21.15.105:0/1369967494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93fc0051c0 0x7f93fc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f94100b5130 con 0x7f93fc0051c0 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f93fc00c160 con 0x7f93fc0039b0 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f93fc010770 con 0x7f93fc004800 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f94156ed640 1 --2- 172.21.15.105:0/1369967494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93fc004800 0x7f93fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f9415eee640 1 --2- 172.21.15.105:0/1369967494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93fc0039b0 0x7f93fc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f94166ef640 1 --2- 172.21.15.105:0/1369967494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93fc0051c0 0x7f93fc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f94156ed640 1 -- 172.21.15.105:0/1369967494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93fc0039b0 msgr2=0x7f93fc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f94156ed640 1 --2- 172.21.15.105:0/1369967494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93fc0039b0 0x7f93fc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f94156ed640 1 -- 172.21.15.105:0/1369967494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93fc0051c0 msgr2=0x7f93fc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:33.650 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f94156ed640 1 --2- 172.21.15.105:0/1369967494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93fc0051c0 0x7f93fc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f94156ed640 1 -- 172.21.15.105:0/1369967494 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93fc003520 con 0x7f93fc004800 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f94166ef640 1 -- 172.21.15.105:0/1369967494 reap_dead start 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.647+0000 7f9415eee640 1 --2- 172.21.15.105:0/1369967494 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93fc0039b0 0x7f93fc003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.648+0000 7f94156ed640 1 --2- 172.21.15.105:0/1369967494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93fc004800 0x7f93fc004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f940c001720 tx=0x7f93fc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d875d7bedf7a88bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.648+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c001370 con 0x7f93fc004800 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.648+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f940c0052d0 con 0x7f93fc004800 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.648+0000 7f9414eec640 1 -- 172.21.15.105:0/1369967494 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f940c02ab90 con 0x7f93fc004800 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.648+0000 7f9418152640 1 -- 172.21.15.105:0/1369967494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93fc004800 msgr2=0x7f93fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.648+0000 7f9418152640 1 --2- 172.21.15.105:0/1369967494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93fc004800 0x7f93fc004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f940c001720 tx=0x7f93fc005830 comp rx=0 tx=0).stop 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.648+0000 7f9418152640 1 -- 172.21.15.105:0/1369967494 shutdown_connections 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.648+0000 7f9418152640 1 --2- 172.21.15.105:0/1369967494 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93fc004800 0x7f93fc004c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.648+0000 7f9418152640 1 -- 172.21.15.105:0/1369967494 >> 172.21.15.105:0/1369967494 conn(0x7f94100b6b50 msgr2=0x7f94100b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:33.651 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.649+0000 7f9418152640 1 -- 172.21.15.105:0/1369967494 shutdown_connections 2024-09-12T01:35:33.652 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.649+0000 7f9418152640 1 -- 172.21.15.105:0/1369967494 wait complete. 2024-09-12T01:35:33.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.650+0000 7f9418152640 1 Processor -- start 2024-09-12T01:35:33.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.650+0000 7f9418152640 1 -- start start 2024-09-12T01:35:33.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.650+0000 7f9418152640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93fc004800 0x7f94100ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.650+0000 7f9418152640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94101571b0 0x7f941014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.654 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.650+0000 7f9418152640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94101efdd0 0x7f94101f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.650+0000 7f9418152640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9410072730 con 0x7f94101efdd0 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.650+0000 7f9418152640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94100725b0 con 0x7f93fc004800 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.650+0000 7f9418152640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f941015c4c0 con 0x7f94101571b0 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f9415eee640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93fc004800 0x7f94100ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f9415eee640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93fc004800 0x7f94100ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40512/0 (socket says 172.21.15.105:40512) 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f9415eee640 1 -- 172.21.15.105:0/2029343983 learned_addr learned my addr 172.21.15.105:0/2029343983 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f94156ed640 1 --2- 172.21.15.105:0/2029343983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94101571b0 0x7f941014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f94156ed640 1 -- 172.21.15.105:0/2029343983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94101571b0 msgr2=0x7f941014c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f94156ed640 1 -- 172.21.15.105:0/2029343983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94101571b0 msgr2=0x7f941014c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f94156ed640 1 --2- 172.21.15.105:0/2029343983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94101571b0 0x7f941014c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f94166ef640 1 --2- 172.21.15.105:0/2029343983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94101efdd0 0x7f94101f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f94156ed640 1 --2- 172.21.15.105:0/2029343983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94101571b0 0x7f941014c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:33.655 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f9415eee640 1 -- 172.21.15.105:0/2029343983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94101571b0 msgr2=0x7f941014c0d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:35:33.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f9415eee640 1 --2- 172.21.15.105:0/2029343983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94101571b0 0x7f941014c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f9415eee640 1 -- 172.21.15.105:0/2029343983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94101efdd0 msgr2=0x7f94101f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f9415eee640 1 --2- 172.21.15.105:0/2029343983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94101efdd0 0x7f94101f0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f9415eee640 1 -- 172.21.15.105:0/2029343983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94101579c0 con 0x7f93fc004800 2024-09-12T01:35:33.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f94166ef640 1 --2- 172.21.15.105:0/2029343983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94101efdd0 0x7f94101f0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:33.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f9415eee640 1 --2- 172.21.15.105:0/2029343983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93fc004800 0x7f94100ad970 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9400011bd0 tx=0x7f940000f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:33.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f94067fc640 1 -- 172.21.15.105:0/2029343983 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400009690 con 0x7f93fc004800 2024-09-12T01:35:33.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f94067fc640 1 -- 172.21.15.105:0/2029343983 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9400011cc0 con 0x7f93fc004800 2024-09-12T01:35:33.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f94067fc640 1 -- 172.21.15.105:0/2029343983 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400014660 con 0x7f93fc004800 2024-09-12T01:35:33.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f9418152640 1 -- 172.21.15.105:0/2029343983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f941014c610 con 0x7f93fc004800 2024-09-12T01:35:33.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f9418152640 1 -- 172.21.15.105:0/2029343983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94100ae2e0 con 0x7f93fc004800 2024-09-12T01:35:33.656 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f94067fc640 1 -- 172.21.15.105:0/2029343983 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9400012040 con 0x7f93fc004800 2024-09-12T01:35:33.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.651+0000 7f94067fc640 1 -- 172.21.15.105:0/2029343983 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f940001db10 con 0x7f93fc004800 2024-09-12T01:35:33.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.652+0000 7f9418152640 1 -- 172.21.15.105:0/2029343983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94100b3ae0 con 0x7f93fc004800 2024-09-12T01:35:33.657 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.654+0000 7f94067fc640 1 -- 172.21.15.105:0/2029343983 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9400019030 con 0x7f93fc004800 2024-09-12T01:35:33.720 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.721+0000 7f9418152640 1 -- 172.21.15.105:0/2029343983 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c92bf594-1af8-4a25-beed-7ca9cc3d9eff", "id": 1} v 0) -- 0x7f94100b70d0 con 0x7f93fc004800 2024-09-12T01:35:33.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.724+0000 7f94067fc640 1 -- 172.21.15.105:0/2029343983 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c92bf594-1af8-4a25-beed-7ca9cc3d9eff", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f940001dd60 con 0x7f93fc004800 2024-09-12T01:35:33.724 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:35:33.724 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.725+0000 7f9418152640 1 -- 172.21.15.105:0/2029343983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93fc004800 msgr2=0x7f94100ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.725+0000 7f9418152640 1 --2- 172.21.15.105:0/2029343983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93fc004800 0x7f94100ad970 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9400011bd0 tx=0x7f940000f610 comp rx=0 tx=0).stop 2024-09-12T01:35:33.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.725+0000 7f9418152640 1 -- 172.21.15.105:0/2029343983 shutdown_connections 2024-09-12T01:35:33.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.725+0000 7f9418152640 1 --2- 172.21.15.105:0/2029343983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94101efdd0 0x7f94101f0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.725+0000 7f9418152640 1 --2- 172.21.15.105:0/2029343983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94101571b0 0x7f941014c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.725+0000 7f9418152640 1 --2- 172.21.15.105:0/2029343983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93fc004800 0x7f94100ad970 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.725+0000 7f9418152640 1 -- 172.21.15.105:0/2029343983 >> 172.21.15.105:0/2029343983 conn(0x7f94100b6b50 msgr2=0x7f94100b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:33.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.725+0000 7f9418152640 1 -- 172.21.15.105:0/2029343983 shutdown_connections 2024-09-12T01:35:33.725 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.725+0000 7f9418152640 1 -- 172.21.15.105:0/2029343983 wait complete. 2024-09-12T01:35:33.735 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new f1eee73a-bfd9-43d4-9b46-eaba90621d59 2 2024-09-12T01:35:33.740 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:33.738+0000 7f953ea0d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-12T01:35:33.796 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:33.797+0000 7f953ea0d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-12T01:35:33.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.833+0000 7fb17d1f6640 1 Processor -- start 2024-09-12T01:35:33.832 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.833+0000 7fb17d1f6640 1 -- start start 2024-09-12T01:35:33.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.833+0000 7fb17d1f6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb178147fe0 0x7fb1780d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.833+0000 7fb17d1f6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb1780b5690 0x7fb1780b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.833+0000 7fb17d1f6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1781483c0 con 0x7fb1780b36a0 2024-09-12T01:35:33.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.833+0000 7fb17d1f6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb1780b45f0 con 0x7fb1780b5690 2024-09-12T01:35:33.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.833+0000 7fb17d1f6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb1780b48d0 con 0x7fb178147fe0 2024-09-12T01:35:33.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.833+0000 7fb176d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb178147fe0 0x7fb1780d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb176d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb178147fe0 0x7fb1780d1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60624/0 (socket says 172.21.15.105:60624) 2024-09-12T01:35:33.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb17659c640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fb1780b36a0 0x7fb1780b3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:52826/0 (socket says 172.21.15.105:52826) 2024-09-12T01:35:33.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb176d9d640 1 -- 172.21.15.105:0/497781805 learned_addr learned my addr 172.21.15.105:0/497781805 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T01:35:33.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb176d9d640 1 -- 172.21.15.105:0/497781805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb178147fe0 msgr2=0x7fb1780d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T01:35:33.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb176d9d640 1 -- 172.21.15.105:0/497781805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb178147fe0 msgr2=0x7fb1780d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:33.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb176d9d640 1 --2- 172.21.15.105:0/497781805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb178147fe0 0x7fb1780d1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb176d9d640 1 --2- 172.21.15.105:0/497781805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb178147fe0 0x7fb1780d1ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb17759e640 1 --2- 172.21.15.105:0/497781805 >> v2:172.21.15.60:3300/0 conn(0x7fb1780b5690 0x7fb1780b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb175d9b640 1 -- 172.21.15.105:0/497781805 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 693087014 0 0) 0x7fb1781483c0 con 0x7fb1780b36a0 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb175d9b640 1 -- 172.21.15.105:0/497781805 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb160003520 con 0x7fb1780b36a0 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb17759e640 1 -- 172.21.15.105:0/497781805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb178147fe0 msgr2=0x7fb1780d1ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb17759e640 1 --2- 172.21.15.105:0/497781805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb178147fe0 0x7fb1780d1ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb17759e640 1 -- 172.21.15.105:0/497781805 >> v1:172.21.15.105:6789/0 conn(0x7fb1780b36a0 legacy=0x7fb1780b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb175d9b640 1 -- 172.21.15.105:0/497781805 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3429568345 0 0) 0x7fb160003520 con 0x7fb1780b36a0 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.834+0000 7fb17759e640 1 -- 172.21.15.105:0/497781805 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1780b4bb0 con 0x7fb1780b5690 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.835+0000 7fb17759e640 1 --2- 172.21.15.105:0/497781805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1780b5690 0x7fb1780b5b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb170009d90 tx=0x7fb17002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1388d8d5ac8443e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.835+0000 7fb175d9b640 1 -- 172.21.15.105:0/497781805 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb16c001670 con 0x7fb1780b5690 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.835+0000 7fb175d9b640 1 -- 172.21.15.105:0/497781805 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb170007540 con 0x7fb1780b5690 2024-09-12T01:35:33.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.835+0000 7fb175d9b640 1 -- 172.21.15.105:0/497781805 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170007910 con 0x7fb1780b5690 2024-09-12T01:35:33.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.836+0000 7fb17d1f6640 1 -- 172.21.15.105:0/497781805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1780b5690 msgr2=0x7fb1780b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.836+0000 7fb17d1f6640 1 --2- 172.21.15.105:0/497781805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1780b5690 0x7fb1780b5b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb170009d90 tx=0x7fb17002a5f0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.836+0000 7fb17d1f6640 1 -- 172.21.15.105:0/497781805 shutdown_connections 2024-09-12T01:35:33.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.836+0000 7fb17d1f6640 1 --2- 172.21.15.105:0/497781805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1780b5690 0x7fb1780b5b00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.836+0000 7fb17d1f6640 1 --2- 172.21.15.105:0/497781805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb178147fe0 0x7fb1780d1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.836+0000 7fb17d1f6640 1 -- 172.21.15.105:0/497781805 >> 172.21.15.105:0/497781805 conn(0x7fb1780b6b50 msgr2=0x7fb1780b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:33.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.836+0000 7fb17d1f6640 1 -- 172.21.15.105:0/497781805 shutdown_connections 2024-09-12T01:35:33.838 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.836+0000 7fb17d1f6640 1 -- 172.21.15.105:0/497781805 wait complete. 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.837+0000 7fb17d1f6640 1 Processor -- start 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.837+0000 7fb17d1f6640 1 -- start start 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17d1f6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1780b36a0 0x7fb178142780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17d1f6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1780b5690 0x7fb17815d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17d1f6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb178147fe0 0x7fb178160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17d1f6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb1780ae890 con 0x7fb1780b36a0 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17d1f6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb1780b5170 con 0x7fb178147fe0 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17d1f6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb17806cdf0 con 0x7fb1780b5690 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17659c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1780b5690 0x7fb17815d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17759e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb178147fe0 0x7fb178160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17659c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1780b5690 0x7fb17815d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60628/0 (socket says 172.21.15.105:60628) 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17659c640 1 -- 172.21.15.105:0/1323318661 learned_addr learned my addr 172.21.15.105:0/1323318661 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T01:35:33.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb176d9d640 1 --2- 172.21.15.105:0/1323318661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1780b36a0 0x7fb178142780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17659c640 1 -- 172.21.15.105:0/1323318661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1780b5690 msgr2=0x7fb17815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17659c640 1 -- 172.21.15.105:0/1323318661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1780b5690 msgr2=0x7fb17815d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17659c640 1 --2- 172.21.15.105:0/1323318661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1780b5690 0x7fb17815d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17659c640 1 --2- 172.21.15.105:0/1323318661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1780b5690 0x7fb17815d190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17759e640 1 -- 172.21.15.105:0/1323318661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1780b5690 msgr2=0x7fb17815d190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17759e640 1 --2- 172.21.15.105:0/1323318661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1780b5690 0x7fb17815d190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17759e640 1 -- 172.21.15.105:0/1323318661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1780b36a0 msgr2=0x7fb178142780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17759e640 1 --2- 172.21.15.105:0/1323318661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1780b36a0 0x7fb178142780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb17759e640 1 -- 172.21.15.105:0/1323318661 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb178142d60 con 0x7fb178147fe0 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.838+0000 7fb176d9d640 1 --2- 172.21.15.105:0/1323318661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1780b36a0 0x7fb178142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.839+0000 7fb17759e640 1 --2- 172.21.15.105:0/1323318661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb178147fe0 0x7fb178160e10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb178074440 tx=0x7fb170004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.839+0000 7fb15f7fe640 1 -- 172.21.15.105:0/1323318661 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170040070 con 0x7fb178147fe0 2024-09-12T01:35:33.842 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.839+0000 7fb15f7fe640 1 -- 172.21.15.105:0/1323318661 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb170031bc0 con 0x7fb178147fe0 2024-09-12T01:35:33.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.839+0000 7fb17d1f6640 1 -- 172.21.15.105:0/1323318661 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb178144720 con 0x7fb178147fe0 2024-09-12T01:35:33.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.839+0000 7fb15f7fe640 1 -- 172.21.15.105:0/1323318661 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb170009450 con 0x7fb178147fe0 2024-09-12T01:35:33.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.839+0000 7fb17d1f6640 1 -- 172.21.15.105:0/1323318661 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb178144ce0 con 0x7fb178147fe0 2024-09-12T01:35:33.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.839+0000 7fb15f7fe640 1 -- 172.21.15.105:0/1323318661 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb170039040 con 0x7fb178147fe0 2024-09-12T01:35:33.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.839+0000 7fb15f7fe640 1 -- 172.21.15.105:0/1323318661 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fb170044830 con 0x7fb178147fe0 2024-09-12T01:35:33.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.840+0000 7fb17d1f6640 1 -- 172.21.15.105:0/1323318661 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1780b3a80 con 0x7fb178147fe0 2024-09-12T01:35:33.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.842+0000 7fb15f7fe640 1 -- 172.21.15.105:0/1323318661 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb170052080 con 0x7fb178147fe0 2024-09-12T01:35:33.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.909+0000 7fb17d1f6640 1 -- 172.21.15.105:0/1323318661 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f1eee73a-bfd9-43d4-9b46-eaba90621d59", "id": 2} v 0) -- 0x7fb1780b1e90 con 0x7fb178147fe0 2024-09-12T01:35:33.911 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.912+0000 7fb15f7fe640 1 -- 172.21.15.105:0/1323318661 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f1eee73a-bfd9-43d4-9b46-eaba90621d59", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fb170044410 con 0x7fb178147fe0 2024-09-12T01:35:33.912 INFO:teuthology.orchestra.run.smithi105.stdout:2 2024-09-12T01:35:33.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.913+0000 7fb17d1f6640 1 -- 172.21.15.105:0/1323318661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb178147fe0 msgr2=0x7fb178160e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:33.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.913+0000 7fb17d1f6640 1 --2- 172.21.15.105:0/1323318661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb178147fe0 0x7fb178160e10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb178074440 tx=0x7fb170004a40 comp rx=0 tx=0).stop 2024-09-12T01:35:33.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.913+0000 7fb17d1f6640 1 -- 172.21.15.105:0/1323318661 shutdown_connections 2024-09-12T01:35:33.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.913+0000 7fb17d1f6640 1 --2- 172.21.15.105:0/1323318661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb178147fe0 0x7fb178160e10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.913+0000 7fb17d1f6640 1 --2- 172.21.15.105:0/1323318661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1780b5690 0x7fb17815d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.913 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.913+0000 7fb17d1f6640 1 --2- 172.21.15.105:0/1323318661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1780b36a0 0x7fb178142780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:33.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.913+0000 7fb17d1f6640 1 -- 172.21.15.105:0/1323318661 >> 172.21.15.105:0/1323318661 conn(0x7fb1780b6b50 msgr2=0x7fb1780b2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:33.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.913+0000 7fb17d1f6640 1 -- 172.21.15.105:0/1323318661 shutdown_connections 2024-09-12T01:35:33.914 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:33.913+0000 7fb17d1f6640 1 -- 172.21.15.105:0/1323318661 wait complete. 2024-09-12T01:35:33.923 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 49c31c39-8c0b-49cc-99c3-d4c5b400e7ca 3 2024-09-12T01:35:33.952 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:33.953+0000 7f953ea0d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-12T01:35:34.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.023+0000 7f2edcc80640 1 Processor -- start 2024-09-12T01:35:34.023 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.023+0000 7f2edcc80640 1 -- start start 2024-09-12T01:35:34.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2edcc80640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2ed80b3570 0x7f2ed80b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2edcc80640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2ed8160490 0x7f2ed81608b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.024 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2edcc80640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ed80d17f0 con 0x7f2ed8158b30 2024-09-12T01:35:34.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2edcc80640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2ed80d1ac0 con 0x7f2ed8160490 2024-09-12T01:35:34.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2edcc80640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2ed80d1da0 con 0x7f2ed80b3570 2024-09-12T01:35:34.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2ed5d9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2ed80b3570 0x7f2ed80b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2ed5d9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2ed80b3570 0x7f2ed80b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40536/0 (socket says 172.21.15.105:40536) 2024-09-12T01:35:34.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2ed5d9b640 1 -- 172.21.15.105:0/1279762808 learned_addr learned my addr 172.21.15.105:0/1279762808 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T01:35:34.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2ed6d9d640 1 --2- 172.21.15.105:0/1279762808 >> v2:172.21.15.60:3300/0 conn(0x7f2ed8160490 0x7f2ed81608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2ed5d9b640 1 -- 172.21.15.105:0/1279762808 >> v2:172.21.15.60:3300/0 conn(0x7f2ed8160490 msgr2=0x7f2ed81608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:34.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2ed5d9b640 1 --2- 172.21.15.105:0/1279762808 >> v2:172.21.15.60:3300/0 conn(0x7f2ed8160490 0x7f2ed81608b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2ed5d9b640 1 -- 172.21.15.105:0/1279762808 >> v1:172.21.15.60:6789/0 conn(0x7f2ed8158b30 legacy=0x7f2ed80d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2ed5d9b640 1 -- 172.21.15.105:0/1279762808 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed80d2080 con 0x7f2ed80b3570 2024-09-12T01:35:34.025 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.024+0000 7f2ed6d9d640 1 --2- 172.21.15.105:0/1279762808 >> v2:172.21.15.60:3300/0 conn(0x7f2ed8160490 0x7f2ed81608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:34.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.025+0000 7f2ed5d9b640 1 --2- 172.21.15.105:0/1279762808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed80b3570 0x7f2ed80b3a00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80d2380 tx=0x7f2ecc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58bfc736ca621c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:34.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.025+0000 7f2ed559a640 1 -- 172.21.15.105:0/1279762808 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc037070 con 0x7f2ed80b3570 2024-09-12T01:35:34.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.025+0000 7f2ed559a640 1 -- 172.21.15.105:0/1279762808 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ecc032440 con 0x7f2ed80b3570 2024-09-12T01:35:34.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.025+0000 7f2ed559a640 1 -- 172.21.15.105:0/1279762808 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc032810 con 0x7f2ed80b3570 2024-09-12T01:35:34.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.026+0000 7f2edcc80640 1 -- 172.21.15.105:0/1279762808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed80b3570 msgr2=0x7f2ed80b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.026+0000 7f2edcc80640 1 --2- 172.21.15.105:0/1279762808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed80b3570 0x7f2ed80b3a00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80d2380 tx=0x7f2ecc02a270 comp rx=0 tx=0).stop 2024-09-12T01:35:34.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.026+0000 7f2edcc80640 1 -- 172.21.15.105:0/1279762808 shutdown_connections 2024-09-12T01:35:34.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.026+0000 7f2edcc80640 1 --2- 172.21.15.105:0/1279762808 >> v2:172.21.15.60:3300/0 conn(0x7f2ed8160490 0x7f2ed81608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.026+0000 7f2edcc80640 1 --2- 172.21.15.105:0/1279762808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed80b3570 0x7f2ed80b3a00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.027 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.026+0000 7f2edcc80640 1 -- 172.21.15.105:0/1279762808 >> 172.21.15.105:0/1279762808 conn(0x7f2ed80b6b50 msgr2=0x7f2ed80b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:34.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.026+0000 7f2edcc80640 1 -- 172.21.15.105:0/1279762808 shutdown_connections 2024-09-12T01:35:34.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.026+0000 7f2edcc80640 1 -- 172.21.15.105:0/1279762808 wait complete. 2024-09-12T01:35:34.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.027+0000 7f2edcc80640 1 Processor -- start 2024-09-12T01:35:34.028 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.027+0000 7f2edcc80640 1 -- start start 2024-09-12T01:35:34.030 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2edcc80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ed80b3570 0x7f2ed81612a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2edcc80640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ed8158b30 0x7f2ed8145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2edcc80640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8160490 0x7f2ed8152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2edcc80640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed8158f10 con 0x7f2ed80b3570 2024-09-12T01:35:34.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2edcc80640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2ed815ff70 con 0x7f2ed8160490 2024-09-12T01:35:34.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2edcc80640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2ed80b54d0 con 0x7f2ed8158b30 2024-09-12T01:35:34.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2ed5d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ed8158b30 0x7f2ed8145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2ed6d9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8160490 0x7f2ed8152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2ed5d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ed8158b30 0x7f2ed8145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60632/0 (socket says 172.21.15.105:60632) 2024-09-12T01:35:34.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2ed5d9b640 1 -- 172.21.15.105:0/3302788232 learned_addr learned my addr 172.21.15.105:0/3302788232 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T01:35:34.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2ed659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ed80b3570 0x7f2ed81612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2ed5d9b640 1 -- 172.21.15.105:0/3302788232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ed8158b30 msgr2=0x7f2ed8145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-12T01:35:34.031 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2ed5d9b640 1 -- 172.21.15.105:0/3302788232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ed8158b30 msgr2=0x7f2ed8145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2ed5d9b640 1 --2- 172.21.15.105:0/3302788232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ed8158b30 0x7f2ed8145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.028+0000 7f2ed5d9b640 1 --2- 172.21.15.105:0/3302788232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ed8158b30 0x7f2ed8145ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2ed6d9d640 1 -- 172.21.15.105:0/3302788232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ed8158b30 msgr2=0x7f2ed8145ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2ed6d9d640 1 --2- 172.21.15.105:0/3302788232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ed8158b30 0x7f2ed8145ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2ed6d9d640 1 -- 172.21.15.105:0/3302788232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ed80b3570 msgr2=0x7f2ed81612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2ed6d9d640 1 --2- 172.21.15.105:0/3302788232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ed80b3570 0x7f2ed81612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2ed6d9d640 1 -- 172.21.15.105:0/3302788232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ed8159440 con 0x7f2ed8160490 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2ed6d9d640 1 --2- 172.21.15.105:0/3302788232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8160490 0x7f2ed8152ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8007db0 tx=0x7f2ec800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2ec6ffd640 1 -- 172.21.15.105:0/3302788232 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec801a070 con 0x7f2ed8160490 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2ec6ffd640 1 -- 172.21.15.105:0/3302788232 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec8003990 con 0x7f2ed8160490 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2edcc80640 1 -- 172.21.15.105:0/3302788232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ed80d0790 con 0x7f2ed8160490 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2ec6ffd640 1 -- 172.21.15.105:0/3302788232 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8003d80 con 0x7f2ed8160490 2024-09-12T01:35:34.032 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2edcc80640 1 -- 172.21.15.105:0/3302788232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ed8146410 con 0x7f2ed8160490 2024-09-12T01:35:34.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2ec6ffd640 1 -- 172.21.15.105:0/3302788232 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2ec801d070 con 0x7f2ed8160490 2024-09-12T01:35:34.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.029+0000 7f2ec6ffd640 1 -- 172.21.15.105:0/3302788232 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f2ec80158d0 con 0x7f2ed8160490 2024-09-12T01:35:34.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.030+0000 7f2edcc80640 1 -- 172.21.15.105:0/3302788232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ed80b3a00 con 0x7f2ed8160490 2024-09-12T01:35:34.033 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.032+0000 7f2ec6ffd640 1 -- 172.21.15.105:0/3302788232 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2ec8024020 con 0x7f2ed8160490 2024-09-12T01:35:34.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.100+0000 7f2edcc80640 1 -- 172.21.15.105:0/3302788232 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49c31c39-8c0b-49cc-99c3-d4c5b400e7ca", "id": 3} v 0) -- 0x7f2ed80d1440 con 0x7f2ed8160490 2024-09-12T01:35:34.102 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.102+0000 7f2ec6ffd640 1 -- 172.21.15.105:0/3302788232 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49c31c39-8c0b-49cc-99c3-d4c5b400e7ca", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f2ec8010070 con 0x7f2ed8160490 2024-09-12T01:35:34.102 INFO:teuthology.orchestra.run.smithi105.stdout:3 2024-09-12T01:35:34.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.103+0000 7f2edcc80640 1 -- 172.21.15.105:0/3302788232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8160490 msgr2=0x7f2ed8152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.103+0000 7f2edcc80640 1 --2- 172.21.15.105:0/3302788232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8160490 0x7f2ed8152ba0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8007db0 tx=0x7f2ec800d4a0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.103+0000 7f2edcc80640 1 -- 172.21.15.105:0/3302788232 shutdown_connections 2024-09-12T01:35:34.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.103+0000 7f2edcc80640 1 --2- 172.21.15.105:0/3302788232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2ed8160490 0x7f2ed8152ba0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.103 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.103+0000 7f2edcc80640 1 --2- 172.21.15.105:0/3302788232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2ed8158b30 0x7f2ed8145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.103+0000 7f2edcc80640 1 --2- 172.21.15.105:0/3302788232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ed80b3570 0x7f2ed81612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.103+0000 7f2edcc80640 1 -- 172.21.15.105:0/3302788232 >> 172.21.15.105:0/3302788232 conn(0x7f2ed80b6b50 msgr2=0x7f2ed80b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:34.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.103+0000 7f2edcc80640 1 -- 172.21.15.105:0/3302788232 shutdown_connections 2024-09-12T01:35:34.104 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.103+0000 7f2edcc80640 1 -- 172.21.15.105:0/3302788232 wait complete. 2024-09-12T01:35:34.113 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 031273d9-1c1f-4374-8b9a-47f6c60aa5a9 4 2024-09-12T01:35:34.190 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:34.190+0000 7f3e9bdf9040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:35:34.245 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:34.245+0000 7f3e9bdf9040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:35:34.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.252+0000 7f33f3559640 1 Processor -- start 2024-09-12T01:35:34.252 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.252+0000 7f33f3559640 1 -- start start 2024-09-12T01:35:34.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.253+0000 7f33f3559640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f33ec15b3a0 0x7f33ec062630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.253+0000 7f33f3559640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec062b70 con 0x7f33ec0cfd20 2024-09-12T01:35:34.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.253+0000 7f33f3559640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33ec0cef60 con 0x7f33ec072f40 2024-09-12T01:35:34.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.253+0000 7f33f3559640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f33ec0cf240 con 0x7f33ec15b3a0 2024-09-12T01:35:34.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.253+0000 7f33f12f5640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f33ec15b3a0 0x7f33ec062630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.253+0000 7f33f1af6640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f33ec072f40 0x7f33ec0b3e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:52836/0 (socket says 172.21.15.105:52836) 2024-09-12T01:35:34.255 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.253+0000 7f33f12f5640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f33ec15b3a0 0x7f33ec062630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40558/0 (socket says 172.21.15.105:40558) 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.253+0000 7f33f1af6640 1 -- 172.21.15.105:0/3699839238 learned_addr learned my addr 172.21.15.105:0/3699839238 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.254+0000 7f33f12f5640 1 -- 172.21.15.105:0/3699839238 >> v1:172.21.15.105:6789/0 conn(0x7f33ec072f40 legacy=0x7f33ec0b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.254+0000 7f33f12f5640 1 -- 172.21.15.105:0/3699839238 >> v1:172.21.15.60:6789/0 conn(0x7f33ec0cfd20 legacy=0x7f33ec072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.254+0000 7f33dffff640 1 -- 172.21.15.105:0/3699839238 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2377135629 0 0) 0x7f33ec0cef60 con 0x7f33ec072f40 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.254+0000 7f33f12f5640 1 -- 172.21.15.105:0/3699839238 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ec0cf520 con 0x7f33ec15b3a0 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.254+0000 7f33f12f5640 1 --2- 172.21.15.105:0/3699839238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33ec15b3a0 0x7f33ec062630 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f33e00097a0 tx=0x7f33e002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5f7fcf3e02376e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.254+0000 7f33dffff640 1 -- 172.21.15.105:0/3699839238 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0037070 con 0x7f33ec15b3a0 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.254+0000 7f33dffff640 1 -- 172.21.15.105:0/3699839238 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e0032440 con 0x7f33ec15b3a0 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.255+0000 7f33dffff640 1 -- 172.21.15.105:0/3699839238 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0032810 con 0x7f33ec15b3a0 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.255+0000 7f33f3559640 1 -- 172.21.15.105:0/3699839238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33ec15b3a0 msgr2=0x7f33ec062630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.255+0000 7f33f3559640 1 --2- 172.21.15.105:0/3699839238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33ec15b3a0 0x7f33ec062630 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f33e00097a0 tx=0x7f33e002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.255+0000 7f33f3559640 1 -- 172.21.15.105:0/3699839238 shutdown_connections 2024-09-12T01:35:34.256 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.255+0000 7f33f3559640 1 --2- 172.21.15.105:0/3699839238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33ec15b3a0 0x7f33ec062630 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.255+0000 7f33f3559640 1 -- 172.21.15.105:0/3699839238 >> 172.21.15.105:0/3699839238 conn(0x7f33ec0b0aa0 msgr2=0x7f33ec0b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:34.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.255+0000 7f33f3559640 1 -- 172.21.15.105:0/3699839238 shutdown_connections 2024-09-12T01:35:34.257 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.255+0000 7f33f3559640 1 -- 172.21.15.105:0/3699839238 wait complete. 2024-09-12T01:35:34.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.256+0000 7f33f3559640 1 Processor -- start 2024-09-12T01:35:34.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.256+0000 7f33f3559640 1 -- start start 2024-09-12T01:35:34.259 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f3559640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33ec072f40 0x7f33ec1f0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f3559640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33ec0cfd20 0x7f33ec0af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f3559640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33ec15b3a0 0x7f33ec0af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f3559640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec0cec10 con 0x7f33ec0cfd20 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f3559640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec15b780 con 0x7f33ec072f40 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f3559640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f33ec0d03f0 con 0x7f33ec15b3a0 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f12f5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33ec072f40 0x7f33ec1f0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f12f5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33ec072f40 0x7f33ec1f0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40568/0 (socket says 172.21.15.105:40568) 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f12f5640 1 -- 172.21.15.105:0/2501252364 learned_addr learned my addr 172.21.15.105:0/2501252364 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f1af6640 1 --2- 172.21.15.105:0/2501252364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33ec15b3a0 0x7f33ec0af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f0af4640 1 --2- 172.21.15.105:0/2501252364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33ec0cfd20 0x7f33ec0af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f1af6640 1 -- 172.21.15.105:0/2501252364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33ec15b3a0 msgr2=0x7f33ec0af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f1af6640 1 -- 172.21.15.105:0/2501252364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33ec15b3a0 msgr2=0x7f33ec0af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:35:34.260 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f1af6640 1 --2- 172.21.15.105:0/2501252364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33ec15b3a0 0x7f33ec0af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f1af6640 1 --2- 172.21.15.105:0/2501252364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33ec15b3a0 0x7f33ec0af600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f12f5640 1 -- 172.21.15.105:0/2501252364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33ec15b3a0 msgr2=0x7f33ec0af600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f12f5640 1 --2- 172.21.15.105:0/2501252364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33ec15b3a0 0x7f33ec0af600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f12f5640 1 -- 172.21.15.105:0/2501252364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33ec0cfd20 msgr2=0x7f33ec0af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f12f5640 1 --2- 172.21.15.105:0/2501252364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33ec0cfd20 0x7f33ec0af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.257+0000 7f33f12f5640 1 -- 172.21.15.105:0/2501252364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ec0afbf0 con 0x7f33ec072f40 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.258+0000 7f33f12f5640 1 --2- 172.21.15.105:0/2501252364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33ec072f40 0x7f33ec1f0680 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f33e0000c00 tx=0x7f33e00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.258+0000 7f33ddffb640 1 -- 172.21.15.105:0/2501252364 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0037040 con 0x7f33ec072f40 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.258+0000 7f33ddffb640 1 -- 172.21.15.105:0/2501252364 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e0042070 con 0x7f33ec072f40 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.258+0000 7f33ddffb640 1 -- 172.21.15.105:0/2501252364 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0030a70 con 0x7f33ec072f40 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.258+0000 7f33f3559640 1 -- 172.21.15.105:0/2501252364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33ec0afed0 con 0x7f33ec072f40 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.258+0000 7f33f3559640 1 -- 172.21.15.105:0/2501252364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33ec158840 con 0x7f33ec072f40 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.258+0000 7f33ddffb640 1 -- 172.21.15.105:0/2501252364 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f33e0030c10 con 0x7f33ec072f40 2024-09-12T01:35:34.261 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.258+0000 7f33ddffb640 1 -- 172.21.15.105:0/2501252364 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f33e0047cd0 con 0x7f33ec072f40 2024-09-12T01:35:34.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.259+0000 7f33f3559640 1 -- 172.21.15.105:0/2501252364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33ec062630 con 0x7f33ec072f40 2024-09-12T01:35:34.262 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.261+0000 7f33ddffb640 1 -- 172.21.15.105:0/2501252364 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f33e0047460 con 0x7f33ec072f40 2024-09-12T01:35:34.330 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.330+0000 7f33f3559640 1 -- 172.21.15.105:0/2501252364 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "031273d9-1c1f-4374-8b9a-47f6c60aa5a9", "id": 4} v 0) -- 0x7f33ec06f120 con 0x7f33ec072f40 2024-09-12T01:35:34.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.333+0000 7f33ddffb640 1 -- 172.21.15.105:0/2501252364 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "031273d9-1c1f-4374-8b9a-47f6c60aa5a9", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f33e0047640 con 0x7f33ec072f40 2024-09-12T01:35:34.333 INFO:teuthology.orchestra.run.smithi105.stdout:4 2024-09-12T01:35:34.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.334+0000 7f33f3559640 1 -- 172.21.15.105:0/2501252364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33ec072f40 msgr2=0x7f33ec1f0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.334+0000 7f33f3559640 1 --2- 172.21.15.105:0/2501252364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33ec072f40 0x7f33ec1f0680 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f33e0000c00 tx=0x7f33e00046c0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.334+0000 7f33f3559640 1 -- 172.21.15.105:0/2501252364 shutdown_connections 2024-09-12T01:35:34.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.334+0000 7f33f3559640 1 --2- 172.21.15.105:0/2501252364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33ec15b3a0 0x7f33ec0af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.334+0000 7f33f3559640 1 --2- 172.21.15.105:0/2501252364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33ec0cfd20 0x7f33ec0af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.334+0000 7f33f3559640 1 --2- 172.21.15.105:0/2501252364 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33ec072f40 0x7f33ec1f0680 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.334+0000 7f33f3559640 1 -- 172.21.15.105:0/2501252364 >> 172.21.15.105:0/2501252364 conn(0x7f33ec0b0aa0 msgr2=0x7f33ec156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:34.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.334+0000 7f33f3559640 1 -- 172.21.15.105:0/2501252364 shutdown_connections 2024-09-12T01:35:34.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.334+0000 7f33f3559640 1 -- 172.21.15.105:0/2501252364 wait complete. 2024-09-12T01:35:34.344 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 304a5a51-6887-4771-bfa0-136120f8a3cb 5 2024-09-12T01:35:34.442 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.442+0000 7fdbc2dd6640 1 Processor -- start 2024-09-12T01:35:34.443 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.443+0000 7fdbc2dd6640 1 -- start start 2024-09-12T01:35:34.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.443+0000 7fdbc2dd6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdbbc0730d0 0x7fdbbc06fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.453 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.443+0000 7fdbc2dd6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdbbc15f780 0x7fdbbc0734b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.443+0000 7fdbc2dd6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbbc0739f0 con 0x7fdbbc1622f0 2024-09-12T01:35:34.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.443+0000 7fdbc2dd6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdbbc0af8a0 con 0x7fdbbc0730d0 2024-09-12T01:35:34.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.443+0000 7fdbc2dd6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdbbc0717c0 con 0x7fdbbc15f780 2024-09-12T01:35:34.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.443+0000 7fdbbbfff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdbbc15f780 0x7fdbbc0734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.454 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.444+0000 7fdbc1373640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fdbbc1622f0 0x7fdbbc162700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:52838/0 (socket says 172.21.15.105:52838) 2024-09-12T01:35:34.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.444+0000 7fdbc1373640 1 -- 172.21.15.105:0/933302641 learned_addr learned my addr 172.21.15.105:0/933302641 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-09-12T01:35:34.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.444+0000 7fdbc0b72640 1 --2- 172.21.15.105:0/933302641 >> v2:172.21.15.60:3300/0 conn(0x7fdbbc0730d0 0x7fdbbc06fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.444+0000 7fdbbbfff640 1 -- 172.21.15.105:0/933302641 >> v2:172.21.15.60:3300/0 conn(0x7fdbbc0730d0 msgr2=0x7fdbbc06fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:34.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.444+0000 7fdbbbfff640 1 --2- 172.21.15.105:0/933302641 >> v2:172.21.15.60:3300/0 conn(0x7fdbbc0730d0 0x7fdbbc06fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.444+0000 7fdbbbfff640 1 -- 172.21.15.105:0/933302641 >> v1:172.21.15.105:6789/0 conn(0x7fdbbc1622f0 legacy=0x7fdbbc162700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.455 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.444+0000 7fdbbbfff640 1 -- 172.21.15.105:0/933302641 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc071aa0 con 0x7fdbbc15f780 2024-09-12T01:35:34.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.444+0000 7fdbbb7fe640 1 -- 172.21.15.105:0/933302641 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347235873 0 0) 0x7fdbbc0739f0 con 0x7fdbbc1622f0 2024-09-12T01:35:34.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.444+0000 7fdbc0b72640 1 --2- 172.21.15.105:0/933302641 >> v2:172.21.15.60:3300/0 conn(0x7fdbbc0730d0 0x7fdbbc06fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:34.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.445+0000 7fdbbbfff640 1 --2- 172.21.15.105:0/933302641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbbc15f780 0x7fdbbc0734b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0b0430 tx=0x7fdba802a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a73b7bfbc7c756a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:34.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.445+0000 7fdbbb7fe640 1 -- 172.21.15.105:0/933302641 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba8037070 con 0x7fdbbc15f780 2024-09-12T01:35:34.456 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.445+0000 7fdbbb7fe640 1 -- 172.21.15.105:0/933302641 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba8032440 con 0x7fdbbc15f780 2024-09-12T01:35:34.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.445+0000 7fdbbb7fe640 1 -- 172.21.15.105:0/933302641 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba8032810 con 0x7fdbbc15f780 2024-09-12T01:35:34.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.445+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/933302641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbbc15f780 msgr2=0x7fdbbc0734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.445+0000 7fdbc2dd6640 1 --2- 172.21.15.105:0/933302641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbbc15f780 0x7fdbbc0734b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0b0430 tx=0x7fdba802a1a0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.445+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/933302641 shutdown_connections 2024-09-12T01:35:34.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.445+0000 7fdbc2dd6640 1 --2- 172.21.15.105:0/933302641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbbc15f780 0x7fdbbc0734b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.457 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.445+0000 7fdbc2dd6640 1 --2- 172.21.15.105:0/933302641 >> v2:172.21.15.60:3300/0 conn(0x7fdbbc0730d0 0x7fdbbc06fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.445+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/933302641 >> 172.21.15.105:0/933302641 conn(0x7fdbbc0b0aa0 msgr2=0x7fdbbc0b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:34.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.445+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/933302641 shutdown_connections 2024-09-12T01:35:34.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.445+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/933302641 wait complete. 2024-09-12T01:35:34.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.446+0000 7fdbc2dd6640 1 Processor -- start 2024-09-12T01:35:34.458 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.447+0000 7fdbc2dd6640 1 -- start start 2024-09-12T01:35:34.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.447+0000 7fdbc2dd6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbbc0730d0 0x7fdbbc153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.447+0000 7fdbc2dd6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbbc15f780 0x7fdbbc154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.447+0000 7fdbc2dd6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbbc1622f0 0x7fdbbc15dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.447+0000 7fdbc2dd6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc072340 con 0x7fdbbc15f780 2024-09-12T01:35:34.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.447+0000 7fdbc2dd6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc072060 con 0x7fdbbc0730d0 2024-09-12T01:35:34.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.447+0000 7fdbc2dd6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdbbc159170 con 0x7fdbbc1622f0 2024-09-12T01:35:34.459 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc0b72640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbbc0730d0 0x7fdbbc153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc1373640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbbc1622f0 0x7fdbbc15dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc1373640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbbc1622f0 0x7fdbbc15dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60644/0 (socket says 172.21.15.105:60644) 2024-09-12T01:35:34.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc0b72640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbbc0730d0 0x7fdbbc153ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40586/0 (socket says 172.21.15.105:40586) 2024-09-12T01:35:34.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc1373640 1 -- 172.21.15.105:0/250718350 learned_addr learned my addr 172.21.15.105:0/250718350 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T01:35:34.460 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbbbfff640 1 --2- 172.21.15.105:0/250718350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbbc15f780 0x7fdbbc154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc1373640 1 -- 172.21.15.105:0/250718350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbbc1622f0 msgr2=0x7fdbbc15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T01:35:34.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc1373640 1 -- 172.21.15.105:0/250718350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbbc1622f0 msgr2=0x7fdbbc15dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:35:34.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc1373640 1 --2- 172.21.15.105:0/250718350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbbc1622f0 0x7fdbbc15dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:34.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc1373640 1 --2- 172.21.15.105:0/250718350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbbc1622f0 0x7fdbbc15dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:34.461 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc0b72640 1 -- 172.21.15.105:0/250718350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbbc1622f0 msgr2=0x7fdbbc15dd50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:35:34.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc0b72640 1 --2- 172.21.15.105:0/250718350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbbc1622f0 0x7fdbbc15dd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc0b72640 1 -- 172.21.15.105:0/250718350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbbc15f780 msgr2=0x7fdbbc154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc0b72640 1 --2- 172.21.15.105:0/250718350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbbc15f780 0x7fdbbc154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc0b72640 1 -- 172.21.15.105:0/250718350 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc15c570 con 0x7fdbbc0730d0 2024-09-12T01:35:34.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc0b72640 1 --2- 172.21.15.105:0/250718350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbbc0730d0 0x7fdbbc153ab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000d5c0 tx=0x7fdbb000da80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:34.462 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbb97fa640 1 -- 172.21.15.105:0/250718350 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0004030 con 0x7fdbbc0730d0 2024-09-12T01:35:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbb97fa640 1 -- 172.21.15.105:0/250718350 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbb00041d0 con 0x7fdbbc0730d0 2024-09-12T01:35:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/250718350 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbbc155160 con 0x7fdbbc0730d0 2024-09-12T01:35:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbb97fa640 1 -- 172.21.15.105:0/250718350 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0014620 con 0x7fdbbc0730d0 2024-09-12T01:35:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/250718350 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbbc155720 con 0x7fdbbc0730d0 2024-09-12T01:35:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbb97fa640 1 -- 172.21.15.105:0/250718350 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdbb0014b50 con 0x7fdbbc0730d0 2024-09-12T01:35:34.463 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.448+0000 7fdbb97fa640 1 -- 172.21.15.105:0/250718350 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fdbb001db10 con 0x7fdbbc0730d0 2024-09-12T01:35:34.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.449+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/250718350 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbbc15fc10 con 0x7fdbbc0730d0 2024-09-12T01:35:34.464 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.451+0000 7fdbb97fa640 1 -- 172.21.15.105:0/250718350 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdbb001ddf0 con 0x7fdbbc0730d0 2024-09-12T01:35:34.520 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.520+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/250718350 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "304a5a51-6887-4771-bfa0-136120f8a3cb", "id": 5} v 0) -- 0x7fdbbc0d0af0 con 0x7fdbbc0730d0 2024-09-12T01:35:34.525 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.526+0000 7fdbb97fa640 1 -- 172.21.15.105:0/250718350 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "304a5a51-6887-4771-bfa0-136120f8a3cb", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fdbb001d660 con 0x7fdbbc0730d0 2024-09-12T01:35:34.526 INFO:teuthology.orchestra.run.smithi105.stdout:5 2024-09-12T01:35:34.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.527+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/250718350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbbc0730d0 msgr2=0x7fdbbc153ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.527+0000 7fdbc2dd6640 1 --2- 172.21.15.105:0/250718350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbbc0730d0 0x7fdbbc153ab0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000d5c0 tx=0x7fdbb000da80 comp rx=0 tx=0).stop 2024-09-12T01:35:34.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.527+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/250718350 shutdown_connections 2024-09-12T01:35:34.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.527+0000 7fdbc2dd6640 1 --2- 172.21.15.105:0/250718350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbbc1622f0 0x7fdbbc15dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.527+0000 7fdbc2dd6640 1 --2- 172.21.15.105:0/250718350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbbc15f780 0x7fdbbc154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.527+0000 7fdbc2dd6640 1 --2- 172.21.15.105:0/250718350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbbc0730d0 0x7fdbbc153ab0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.527+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/250718350 >> 172.21.15.105:0/250718350 conn(0x7fdbbc0b0aa0 msgr2=0x7fdbbc15fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:34.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.527+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/250718350 shutdown_connections 2024-09-12T01:35:34.527 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.527+0000 7fdbc2dd6640 1 -- 172.21.15.105:0/250718350 wait complete. 2024-09-12T01:35:34.536 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7 6 2024-09-12T01:35:34.634 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:34.634+0000 7f3e9bdf9040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:35:34.635 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.636+0000 7fe1914f1640 1 Processor -- start 2024-09-12T01:35:34.636 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.636+0000 7fe1914f1640 1 -- start start 2024-09-12T01:35:34.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe1914f1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe18c0cfd20 0x7fe18c072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe1914f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe18c072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe1914f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe18c0cef60 con 0x7fe18c15b3a0 2024-09-12T01:35:34.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe1914f1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe18c0cf240 con 0x7fe18c0cfd20 2024-09-12T01:35:34.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe1914f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe18c0cf520 con 0x7fe18c0d03f0 2024-09-12T01:35:34.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe18affd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fe18c15b3a0 0x7fe18c062630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:52852/0 (socket says 172.21.15.105:52852) 2024-09-12T01:35:34.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe18affd640 1 -- 172.21.15.105:0/3252860928 learned_addr learned my addr 172.21.15.105:0/3252860928 (peer_addr_for_me v1:172.21.15.105:0/0) 2024-09-12T01:35:34.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe18b7fe640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe18c072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe18a7fc640 1 --2- 172.21.15.105:0/3252860928 >> v2:172.21.15.60:3300/0 conn(0x7fe18c0cfd20 0x7fe18c072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.639 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe18b7fe640 1 -- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 msgr2=0x7fe18c072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe18b7fe640 1 -- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 msgr2=0x7fe18c072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe18b7fe640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe18c072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe18b7fe640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe18c072d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3320783485 0 0) 0x7fe18c0cef60 con 0x7fe18c15b3a0 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe178003520 con 0x7fe18c15b3a0 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1194340886 0 0) 0x7fe178003520 con 0x7fe18c15b3a0 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 msgr2=0x7fe18c072d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.637+0000 7fe189ffb640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe18c072d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 >> v2:172.21.15.60:3300/0 conn(0x7fe18c0cfd20 msgr2=0x7fe18c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe189ffb640 1 --2- 172.21.15.105:0/3252860928 >> v2:172.21.15.60:3300/0 conn(0x7fe18c0cfd20 0x7fe18c072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c0cf800 con 0x7fe18c15b3a0 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fe1840019f0 con 0x7fe18c15b3a0 2024-09-12T01:35:34.640 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 >> v1:172.21.15.105:6789/0 conn(0x7fe18c15b3a0 legacy=0x7fe18c062630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe189ffb640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780039b0 0x7fe178003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe189ffb640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe178004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe189ffb640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe178004d40 0x7fe1780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c0cf240 con 0x7fe1780039b0 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c0cf520 con 0x7fe178004d40 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe17800ba70 con 0x7fe18c0d03f0 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe18a7fc640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe178004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe18b7fe640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe178004d40 0x7fe1780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe18affd640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780039b0 0x7fe178003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe18a7fc640 1 -- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe178004d40 msgr2=0x7fe1780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe18a7fc640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe178004d40 0x7fe1780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe18a7fc640 1 -- 172.21.15.105:0/3252860928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780039b0 msgr2=0x7fe178003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:34.641 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe18a7fc640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780039b0 0x7fe178003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.638+0000 7fe18a7fc640 1 -- 172.21.15.105:0/3252860928 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe178003520 con 0x7fe18c0d03f0 2024-09-12T01:35:34.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.639+0000 7fe18a7fc640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe178004800 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe174009ac0 tx=0x7fe178005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeb444c23f4de678 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:34.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.639+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17403a070 con 0x7fe18c0d03f0 2024-09-12T01:35:34.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.639+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17402d720 con 0x7fe18c0d03f0 2024-09-12T01:35:34.642 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.639+0000 7fe189ffb640 1 -- 172.21.15.105:0/3252860928 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174009690 con 0x7fe18c0d03f0 2024-09-12T01:35:34.645 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.640+0000 7fe1914f1640 1 -- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 msgr2=0x7fe178004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.645 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.640+0000 7fe1914f1640 1 --2- 172.21.15.105:0/3252860928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe178004800 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe174009ac0 tx=0x7fe178005830 comp rx=0 tx=0).stop 2024-09-12T01:35:34.645 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.640+0000 7fe18b7fe640 1 -- 172.21.15.105:0/3252860928 reap_dead start 2024-09-12T01:35:34.645 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.640+0000 7fe1914f1640 1 -- 172.21.15.105:0/3252860928 shutdown_connections 2024-09-12T01:35:34.645 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.640+0000 7fe1914f1640 1 -- 172.21.15.105:0/3252860928 >> 172.21.15.105:0/3252860928 conn(0x7fe18c0b0aa0 msgr2=0x7fe18c0b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:34.645 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.640+0000 7fe1914f1640 1 -- 172.21.15.105:0/3252860928 shutdown_connections 2024-09-12T01:35:34.645 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.640+0000 7fe1914f1640 1 -- 172.21.15.105:0/3252860928 wait complete. 2024-09-12T01:35:34.645 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.642+0000 7fe1914f1640 1 Processor -- start 2024-09-12T01:35:34.645 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.642+0000 7fe1914f1640 1 -- start start 2024-09-12T01:35:34.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe1914f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe18c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe1914f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe18c154510 0x7fe18c0b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe1914f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe18c143320 0x7fe18c143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe1914f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c072d70 con 0x7fe18c154510 2024-09-12T01:35:34.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe1914f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c0cec10 con 0x7fe18c143320 2024-09-12T01:35:34.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe1914f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe18c072ef0 con 0x7fe18c0d03f0 2024-09-12T01:35:34.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe18c143320 0x7fe18c143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18affd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe18c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18b7fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe18c143320 0x7fe18c143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40604/0 (socket says 172.21.15.105:40604) 2024-09-12T01:35:34.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18affd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe18c14f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60674/0 (socket says 172.21.15.105:60674) 2024-09-12T01:35:34.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18b7fe640 1 -- 172.21.15.105:0/1003711580 learned_addr learned my addr 172.21.15.105:0/1003711580 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T01:35:34.646 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18a7fc640 1 --2- 172.21.15.105:0/1003711580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe18c154510 0x7fe18c0b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18affd640 1 -- 172.21.15.105:0/1003711580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 msgr2=0x7fe18c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18affd640 1 -- 172.21.15.105:0/1003711580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 msgr2=0x7fe18c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18affd640 1 --2- 172.21.15.105:0/1003711580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe18c14f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18affd640 1 --2- 172.21.15.105:0/1003711580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe18c14f3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18b7fe640 1 -- 172.21.15.105:0/1003711580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 msgr2=0x7fe18c14f3b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18b7fe640 1 --2- 172.21.15.105:0/1003711580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe18c14f3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18b7fe640 1 -- 172.21.15.105:0/1003711580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe18c154510 msgr2=0x7fe18c0b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18b7fe640 1 --2- 172.21.15.105:0/1003711580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe18c154510 0x7fe18c0b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.643+0000 7fe18b7fe640 1 -- 172.21.15.105:0/1003711580 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c143cb0 con 0x7fe18c143320 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.644+0000 7fe18b7fe640 1 --2- 172.21.15.105:0/1003711580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe18c143320 0x7fe18c143770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe17c006fd0 tx=0x7fe17c010c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.644+0000 7fe1837fe640 1 -- 172.21.15.105:0/1003711580 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c010e70 con 0x7fe18c143320 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.644+0000 7fe1837fe640 1 -- 172.21.15.105:0/1003711580 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe17c01c070 con 0x7fe18c143320 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.644+0000 7fe1914f1640 1 -- 172.21.15.105:0/1003711580 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe18c150d30 con 0x7fe18c143320 2024-09-12T01:35:34.647 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.644+0000 7fe1837fe640 1 -- 172.21.15.105:0/1003711580 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17c00eb80 con 0x7fe18c143320 2024-09-12T01:35:34.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.644+0000 7fe1914f1640 1 -- 172.21.15.105:0/1003711580 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe18c14ff70 con 0x7fe18c143320 2024-09-12T01:35:34.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.644+0000 7fe1837fe640 1 -- 172.21.15.105:0/1003711580 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe17c012040 con 0x7fe18c143320 2024-09-12T01:35:34.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.644+0000 7fe1837fe640 1 -- 172.21.15.105:0/1003711580 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fe17c014b10 con 0x7fe18c143320 2024-09-12T01:35:34.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.645+0000 7fe1914f1640 1 -- 172.21.15.105:0/1003711580 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18c0cef60 con 0x7fe18c143320 2024-09-12T01:35:34.648 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.647+0000 7fe1837fe640 1 -- 172.21.15.105:0/1003711580 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe17c00ed20 con 0x7fe18c143320 2024-09-12T01:35:34.715 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.716+0000 7fe1914f1640 1 -- 172.21.15.105:0/1003711580 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7", "id": 6} v 0) -- 0x7fe18c157620 con 0x7fe18c143320 2024-09-12T01:35:34.721 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.722+0000 7fe1837fe640 1 -- 172.21.15.105:0/1003711580 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fe17c014df0 con 0x7fe18c143320 2024-09-12T01:35:34.721 INFO:teuthology.orchestra.run.smithi105.stdout:6 2024-09-12T01:35:34.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.722+0000 7fe1914f1640 1 -- 172.21.15.105:0/1003711580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe18c143320 msgr2=0x7fe18c143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.722+0000 7fe1914f1640 1 --2- 172.21.15.105:0/1003711580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe18c143320 0x7fe18c143770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe17c006fd0 tx=0x7fe17c010c80 comp rx=0 tx=0).stop 2024-09-12T01:35:34.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.722+0000 7fe1914f1640 1 -- 172.21.15.105:0/1003711580 shutdown_connections 2024-09-12T01:35:34.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.723+0000 7fe1914f1640 1 --2- 172.21.15.105:0/1003711580 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe18c143320 0x7fe18c143770 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.722 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.723+0000 7fe1914f1640 1 --2- 172.21.15.105:0/1003711580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe18c154510 0x7fe18c0b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.723+0000 7fe1914f1640 1 --2- 172.21.15.105:0/1003711580 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe18c0d03f0 0x7fe18c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.723+0000 7fe1914f1640 1 -- 172.21.15.105:0/1003711580 >> 172.21.15.105:0/1003711580 conn(0x7fe18c0b0aa0 msgr2=0x7fe18c06eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:34.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.723+0000 7fe1914f1640 1 -- 172.21.15.105:0/1003711580 shutdown_connections 2024-09-12T01:35:34.723 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.723+0000 7fe1914f1640 1 -- 172.21.15.105:0/1003711580 wait complete. 2024-09-12T01:35:34.725 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:34.725+0000 7f3e9bdf9040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:35:34.732 DEBUG:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 52f0c7f6-1764-4e6b-a135-40a6d07df0b0 7 2024-09-12T01:35:34.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.831+0000 7f011a1a6640 1 Processor -- start 2024-09-12T01:35:34.831 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.831+0000 7f011a1a6640 1 -- start start 2024-09-12T01:35:34.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.832+0000 7f011a1a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f011415c260 0x7f01140d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.832+0000 7f011a1a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f01140b3570 0x7f01140b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.832+0000 7f011a1a6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0114071f80 0x7f0114072430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f011a1a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f01140d21b0 con 0x7f01140b3570 2024-09-12T01:35:34.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f011a1a6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0114072f50 con 0x7f0114071f80 2024-09-12T01:35:34.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f011a1a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f01140d17e0 con 0x7f011415c260 2024-09-12T01:35:34.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f01137fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f011415c260 0x7f01140d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f0113fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0114071f80 0x7f0114072430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.833 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f0113fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0114071f80 0x7f0114072430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:40606/0 (socket says 172.21.15.105:40606) 2024-09-12T01:35:34.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f01137fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f011415c260 0x7f01140d1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60680/0 (socket says 172.21.15.105:60680) 2024-09-12T01:35:34.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f0113fff640 1 -- 172.21.15.105:0/1616203902 learned_addr learned my addr 172.21.15.105:0/1616203902 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T01:35:34.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f010bfff640 1 --2- 172.21.15.105:0/1616203902 >> v2:172.21.15.60:3300/0 conn(0x7f01140b3570 0x7f01140b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f01137fe640 1 -- 172.21.15.105:0/1616203902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f011415c260 msgr2=0x7f01140d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-12T01:35:34.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f01137fe640 1 -- 172.21.15.105:0/1616203902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f011415c260 msgr2=0x7f01140d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-12T01:35:34.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f01137fe640 1 --2- 172.21.15.105:0/1616203902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f011415c260 0x7f01140d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:34.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f01137fe640 1 --2- 172.21.15.105:0/1616203902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f011415c260 0x7f01140d1c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:34.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f0113fff640 1 -- 172.21.15.105:0/1616203902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f011415c260 msgr2=0x7f01140d1c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-12T01:35:34.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f0113fff640 1 --2- 172.21.15.105:0/1616203902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f011415c260 0x7f01140d1c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f0113fff640 1 -- 172.21.15.105:0/1616203902 >> v2:172.21.15.60:3300/0 conn(0x7f01140b3570 msgr2=0x7f01140b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:34.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f0113fff640 1 --2- 172.21.15.105:0/1616203902 >> v2:172.21.15.60:3300/0 conn(0x7f01140b3570 0x7f01140b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.834 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.833+0000 7f0113fff640 1 -- 172.21.15.105:0/1616203902 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0114072c70 con 0x7f0114071f80 2024-09-12T01:35:34.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.834+0000 7f0113fff640 1 --2- 172.21.15.105:0/1616203902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0114071f80 0x7f0114072430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f01140d1750 tx=0x7f010c02a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6643fe65dad72afb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:34.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.834+0000 7f0112ffd640 1 -- 172.21.15.105:0/1616203902 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c036070 con 0x7f0114071f80 2024-09-12T01:35:34.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.834+0000 7f0112ffd640 1 -- 172.21.15.105:0/1616203902 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010c031600 con 0x7f0114071f80 2024-09-12T01:35:34.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.834+0000 7f0112ffd640 1 -- 172.21.15.105:0/1616203902 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c0319d0 con 0x7f0114071f80 2024-09-12T01:35:34.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.835+0000 7f011a1a6640 1 -- 172.21.15.105:0/1616203902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0114071f80 msgr2=0x7f0114072430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.835+0000 7f011a1a6640 1 --2- 172.21.15.105:0/1616203902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0114071f80 0x7f0114072430 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f01140d1750 tx=0x7f010c02a610 comp rx=0 tx=0).stop 2024-09-12T01:35:34.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.835+0000 7f011a1a6640 1 -- 172.21.15.105:0/1616203902 shutdown_connections 2024-09-12T01:35:34.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.835+0000 7f011a1a6640 1 --2- 172.21.15.105:0/1616203902 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0114071f80 0x7f0114072430 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.835+0000 7f011a1a6640 1 --2- 172.21.15.105:0/1616203902 >> v2:172.21.15.60:3300/0 conn(0x7f01140b3570 0x7f01140b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.835+0000 7f011a1a6640 1 --2- 172.21.15.105:0/1616203902 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f011415c260 0x7f01140d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.835+0000 7f011a1a6640 1 -- 172.21.15.105:0/1616203902 >> 172.21.15.105:0/1616203902 conn(0x7f01140b6b50 msgr2=0x7f01140b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:34.836 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.835+0000 7f011a1a6640 1 -- 172.21.15.105:0/1616203902 shutdown_connections 2024-09-12T01:35:34.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.835+0000 7f011a1a6640 1 -- 172.21.15.105:0/1616203902 wait complete. 2024-09-12T01:35:34.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.836+0000 7f011a1a6640 1 Processor -- start 2024-09-12T01:35:34.837 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.836+0000 7f011a1a6640 1 -- start start 2024-09-12T01:35:34.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f011a1a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0114071f80 0x7f01141f7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f011a1a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01140b3570 0x7f0114144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f011a1a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011415c260 0x7f01141f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:34.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f011a1a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f01140d1470 con 0x7f011415c260 2024-09-12T01:35:34.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f011a1a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f01140b3ef0 con 0x7f01140b3570 2024-09-12T01:35:34.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f011a1a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0114072970 con 0x7f0114071f80 2024-09-12T01:35:34.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f01137fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0114071f80 0x7f01141f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f010bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01140b3570 0x7f0114144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f01137fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0114071f80 0x7f01141f7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:60688/0 (socket says 172.21.15.105:60688) 2024-09-12T01:35:34.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f01137fe640 1 -- 172.21.15.105:0/3323288252 learned_addr learned my addr 172.21.15.105:0/3323288252 (peer_addr_for_me v2:172.21.15.105:0/0) 2024-09-12T01:35:34.839 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f0113fff640 1 --2- 172.21.15.105:0/3323288252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011415c260 0x7f01141f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f01137fe640 1 -- 172.21.15.105:0/3323288252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0114071f80 msgr2=0x7f01141f7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f01137fe640 1 -- 172.21.15.105:0/3323288252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0114071f80 msgr2=0x7f01141f7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f01137fe640 1 --2- 172.21.15.105:0/3323288252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0114071f80 0x7f01141f7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f01137fe640 1 --2- 172.21.15.105:0/3323288252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0114071f80 0x7f01141f7890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f010bfff640 1 -- 172.21.15.105:0/3323288252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0114071f80 msgr2=0x7f01141f7890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f010bfff640 1 --2- 172.21.15.105:0/3323288252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0114071f80 0x7f01141f7890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f010bfff640 1 -- 172.21.15.105:0/3323288252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011415c260 msgr2=0x7f01141f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f010bfff640 1 --2- 172.21.15.105:0/3323288252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011415c260 0x7f01141f4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.837+0000 7f010bfff640 1 -- 172.21.15.105:0/3323288252 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01141f7e70 con 0x7f01140b3570 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.838+0000 7f010bfff640 1 --2- 172.21.15.105:0/3323288252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01140b3570 0x7f0114144ba0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00e840 tx=0x7f00fc00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.838+0000 7f0110ff9640 1 -- 172.21.15.105:0/3323288252 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc017070 con 0x7f01140b3570 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.838+0000 7f0110ff9640 1 -- 172.21.15.105:0/3323288252 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00fc00c940 con 0x7f01140b3570 2024-09-12T01:35:34.840 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.838+0000 7f011a1a6640 1 -- 172.21.15.105:0/3323288252 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01141f8150 con 0x7f01140b3570 2024-09-12T01:35:34.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.838+0000 7f0110ff9640 1 -- 172.21.15.105:0/3323288252 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00fc00cd30 con 0x7f01140b3570 2024-09-12T01:35:34.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.838+0000 7f011a1a6640 1 -- 172.21.15.105:0/3323288252 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01141f8710 con 0x7f01140b3570 2024-09-12T01:35:34.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.838+0000 7f0110ff9640 1 -- 172.21.15.105:0/3323288252 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f00fc01a070 con 0x7f01140b3570 2024-09-12T01:35:34.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.838+0000 7f0110ff9640 1 -- 172.21.15.105:0/3323288252 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f00fc013ad0 con 0x7f01140b3570 2024-09-12T01:35:34.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.839+0000 7f011a1a6640 1 -- 172.21.15.105:0/3323288252 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f011415d7c0 con 0x7f01140b3570 2024-09-12T01:35:34.841 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:34.837+0000 7f3e9bdf9040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:35:34.841 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.841+0000 7f0110ff9640 1 -- 172.21.15.105:0/3323288252 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f00fc013db0 con 0x7f01140b3570 2024-09-12T01:35:34.886 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:34.886+0000 7f3e9bdf9040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:35:34.909 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.910+0000 7f011a1a6640 1 -- 172.21.15.105:0/3323288252 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "52f0c7f6-1764-4e6b-a135-40a6d07df0b0", "id": 7} v 0) -- 0x7f0114073160 con 0x7f01140b3570 2024-09-12T01:35:34.917 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.917+0000 7f0110ff9640 1 -- 172.21.15.105:0/3323288252 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52f0c7f6-1764-4e6b-a135-40a6d07df0b0", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f00fc006640 con 0x7f01140b3570 2024-09-12T01:35:34.917 INFO:teuthology.orchestra.run.smithi105.stdout:7 2024-09-12T01:35:34.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.918+0000 7f011a1a6640 1 -- 172.21.15.105:0/3323288252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01140b3570 msgr2=0x7f0114144ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:34.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.918+0000 7f011a1a6640 1 --2- 172.21.15.105:0/3323288252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01140b3570 0x7f0114144ba0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00e840 tx=0x7f00fc00ed00 comp rx=0 tx=0).stop 2024-09-12T01:35:34.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.918+0000 7f011a1a6640 1 -- 172.21.15.105:0/3323288252 shutdown_connections 2024-09-12T01:35:34.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.918+0000 7f011a1a6640 1 --2- 172.21.15.105:0/3323288252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f011415c260 0x7f01141f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.918+0000 7f011a1a6640 1 --2- 172.21.15.105:0/3323288252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01140b3570 0x7f0114144ba0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.918+0000 7f011a1a6640 1 --2- 172.21.15.105:0/3323288252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0114071f80 0x7f01141f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:34.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.918+0000 7f011a1a6640 1 -- 172.21.15.105:0/3323288252 >> 172.21.15.105:0/3323288252 conn(0x7f01140b6b50 msgr2=0x7f01140cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:34.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.918+0000 7f011a1a6640 1 -- 172.21.15.105:0/3323288252 shutdown_connections 2024-09-12T01:35:34.919 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:35:34.918+0000 7f011a1a6640 1 -- 172.21.15.105:0/3323288252 wait complete. 2024-09-12T01:35:34.928 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T01:35:34.928 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T01:35:34.930 INFO:tasks.ceph.osd.0:Started 2024-09-12T01:35:34.931 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T01:35:34.931 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T01:35:34.933 INFO:tasks.ceph.osd.1:Started 2024-09-12T01:35:34.933 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T01:35:34.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T01:35:34.935 INFO:tasks.ceph.osd.2:Started 2024-09-12T01:35:34.935 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T01:35:34.935 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T01:35:34.937 INFO:tasks.ceph.osd.3:Started 2024-09-12T01:35:34.937 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T01:35:34.937 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T01:35:34.939 INFO:tasks.ceph.osd.4:Started 2024-09-12T01:35:34.939 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T01:35:34.940 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T01:35:34.941 INFO:tasks.ceph.osd.5:Started 2024-09-12T01:35:34.942 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T01:35:34.942 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T01:35:34.943 INFO:tasks.ceph.osd.6:Started 2024-09-12T01:35:34.944 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T01:35:34.944 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T01:35:34.946 INFO:tasks.ceph.osd.7:Started 2024-09-12T01:35:34.947 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:35:34.990 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:34.990+0000 7f953ea0d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-12T01:35:35.049 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:35.049+0000 7f3e9bdf9040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:35:35.059 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:35.059+0000 7f953ea0d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-12T01:35:35.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.098+0000 7fbc8c23c640 1 Processor -- start 2024-09-12T01:35:35.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.098+0000 7fbc8c23c640 1 -- start start 2024-09-12T01:35:35.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.099+0000 7fbc8c23c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc840cfb90 0x7fbc840d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:35.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.099+0000 7fbc8c23c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbc8406fa50 0x7fbc84073350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:35.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.099+0000 7fbc8c23c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc840d1870 con 0x7fbc840d2090 2024-09-12T01:35:35.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.099+0000 7fbc8c23c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbc8415d810 con 0x7fbc840cfb90 2024-09-12T01:35:35.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.099+0000 7fbc8c23c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbc8415cc00 con 0x7fbc8406fa50 2024-09-12T01:35:35.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.099+0000 7fbc89fd8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc840cfb90 0x7fbc840d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:35.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.099+0000 7fbc89fd8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc840cfb90 0x7fbc840d1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56962/0 (socket says 172.21.15.60:56962) 2024-09-12T01:35:35.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.099+0000 7fbc897d7640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbc840d2090 0x7fbc8406f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47452/0 (socket says 172.21.15.60:47452) 2024-09-12T01:35:35.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.099+0000 7fbc89fd8640 1 -- 172.21.15.60:0/3186246193 learned_addr learned my addr 172.21.15.60:0/3186246193 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:35.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.099+0000 7fbc8a7d9640 1 --2- 172.21.15.60:0/3186246193 >> v2:172.21.15.105:3300/0 conn(0x7fbc8406fa50 0x7fbc84073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:35.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.100+0000 7fbc89fd8640 1 -- 172.21.15.60:0/3186246193 >> v2:172.21.15.105:3300/0 conn(0x7fbc8406fa50 msgr2=0x7fbc84073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:35.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.100+0000 7fbc89fd8640 1 --2- 172.21.15.60:0/3186246193 >> v2:172.21.15.105:3300/0 conn(0x7fbc8406fa50 0x7fbc84073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.100+0000 7fbc89fd8640 1 -- 172.21.15.60:0/3186246193 >> v1:172.21.15.60:6789/0 conn(0x7fbc840d2090 legacy=0x7fbc8406f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:35.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.100+0000 7fbc89fd8640 1 -- 172.21.15.60:0/3186246193 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc8415cee0 con 0x7fbc840cfb90 2024-09-12T01:35:35.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.100+0000 7fbc88fd6640 1 -- 172.21.15.60:0/3186246193 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3348499633 0 0) 0x7fbc840d1870 con 0x7fbc840d2090 2024-09-12T01:35:35.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.100+0000 7fbc89fd8640 1 --2- 172.21.15.60:0/3186246193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc840cfb90 0x7fbc840d1b50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbc78009870 tx=0x7fbc7802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5fe71164fa97a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:35.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.100+0000 7fbc88fd6640 1 -- 172.21.15.60:0/3186246193 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78037070 con 0x7fbc840cfb90 2024-09-12T01:35:35.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.100+0000 7fbc88fd6640 1 -- 172.21.15.60:0/3186246193 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc78032440 con 0x7fbc840cfb90 2024-09-12T01:35:35.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.100+0000 7fbc88fd6640 1 -- 172.21.15.60:0/3186246193 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78032810 con 0x7fbc840cfb90 2024-09-12T01:35:35.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.101+0000 7fbc8c23c640 1 -- 172.21.15.60:0/3186246193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc840cfb90 msgr2=0x7fbc840d1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:35.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.101+0000 7fbc8c23c640 1 --2- 172.21.15.60:0/3186246193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc840cfb90 0x7fbc840d1b50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbc78009870 tx=0x7fbc7802a2a0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.101+0000 7fbc8c23c640 1 -- 172.21.15.60:0/3186246193 shutdown_connections 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.101+0000 7fbc8c23c640 1 --2- 172.21.15.60:0/3186246193 >> v2:172.21.15.105:3300/0 conn(0x7fbc8406fa50 0x7fbc84073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.101+0000 7fbc8c23c640 1 --2- 172.21.15.60:0/3186246193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc840cfb90 0x7fbc840d1b50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.101+0000 7fbc8c23c640 1 -- 172.21.15.60:0/3186246193 >> 172.21.15.60:0/3186246193 conn(0x7fbc84062630 msgr2=0x7fbc84062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.101+0000 7fbc8c23c640 1 -- 172.21.15.60:0/3186246193 shutdown_connections 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.101+0000 7fbc8c23c640 1 -- 172.21.15.60:0/3186246193 wait complete. 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.102+0000 7fbc8c23c640 1 Processor -- start 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.103+0000 7fbc8c23c640 1 -- start start 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.103+0000 7fbc8c23c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8406fa50 0x7fbc840b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.103+0000 7fbc8c23c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc840cfb90 0x7fbc840aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.103+0000 7fbc8c23c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc840d2090 0x7fbc8414de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc8c23c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbc840cff70 con 0x7fbc840cfb90 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc8c23c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8415d4a0 con 0x7fbc8406fa50 2024-09-12T01:35:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc8c23c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbc840b55b0 con 0x7fbc840d2090 2024-09-12T01:35:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc897d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc840cfb90 0x7fbc840aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc89fd8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8406fa50 0x7fbc840b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc897d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc840cfb90 0x7fbc840aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56970/0 (socket says 172.21.15.60:56970) 2024-09-12T01:35:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc897d7640 1 -- 172.21.15.60:0/2024657212 learned_addr learned my addr 172.21.15.60:0/2024657212 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc89fd8640 1 --2- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8406fa50 0x7fbc840b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39346/0 (socket says 172.21.15.60:39346) 2024-09-12T01:35:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc8a7d9640 1 --2- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc840d2090 0x7fbc8414de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc8a7d9640 1 -- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc840d2090 msgr2=0x7fbc8414de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T01:35:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc8a7d9640 1 -- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc840d2090 msgr2=0x7fbc8414de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:35:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc8a7d9640 1 --2- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc840d2090 0x7fbc8414de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc8a7d9640 1 --2- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc840d2090 0x7fbc8414de10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc89fd8640 1 -- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc840d2090 msgr2=0x7fbc8414de10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc89fd8640 1 --2- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc840d2090 0x7fbc8414de10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc89fd8640 1 -- 172.21.15.60:0/2024657212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc840cfb90 msgr2=0x7fbc840aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc89fd8640 1 --2- 172.21.15.60:0/2024657212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc840cfb90 0x7fbc840aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc89fd8640 1 -- 172.21.15.60:0/2024657212 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc841587d0 con 0x7fbc8406fa50 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc897d7640 1 --2- 172.21.15.60:0/2024657212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc840cfb90 0x7fbc840aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc89fd8640 1 --2- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8406fa50 0x7fbc840b1030 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbc78031000 tx=0x7fbc780046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc767fc640 1 -- 172.21.15.60:0/2024657212 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78041070 con 0x7fbc8406fa50 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc767fc640 1 -- 172.21.15.60:0/2024657212 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7803c870 con 0x7fbc8406fa50 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc767fc640 1 -- 172.21.15.60:0/2024657212 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78037040 con 0x7fbc8406fa50 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc8c23c640 1 -- 172.21.15.60:0/2024657212 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc840ab590 con 0x7fbc8406fa50 2024-09-12T01:35:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.104+0000 7fbc8c23c640 1 -- 172.21.15.60:0/2024657212 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc840abb50 con 0x7fbc8406fa50 2024-09-12T01:35:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.105+0000 7fbc767fc640 1 -- 172.21.15.60:0/2024657212 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbc78044070 con 0x7fbc8406fa50 2024-09-12T01:35:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.105+0000 7fbc767fc640 1 -- 172.21.15.60:0/2024657212 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fbc7803cc40 con 0x7fbc8406fa50 2024-09-12T01:35:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.105+0000 7fbc8c23c640 1 -- 172.21.15.60:0/2024657212 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc840abd90 con 0x7fbc8406fa50 2024-09-12T01:35:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.108+0000 7fbc767fc640 1 -- 172.21.15.60:0/2024657212 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fbc840abd90 con 0x7fbc8406fa50 2024-09-12T01:35:35.117 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:35.117+0000 7f3e9bdf9040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:35:35.165 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:35.165+0000 7f3e9bdf9040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:35:35.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.167+0000 7fbc8c23c640 1 -- 172.21.15.60:0/2024657212 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc840d1b50 con 0x7fbc8406fa50 2024-09-12T01:35:35.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.168+0000 7fbc767fc640 1 -- 172.21.15.60:0/2024657212 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fbc78046450 con 0x7fbc8406fa50 2024-09-12T01:35:35.173 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:35:35.173 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":10,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:34.911685+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:35:35.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.169+0000 7fbc8c23c640 1 -- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8406fa50 msgr2=0x7fbc840b1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:35.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.169+0000 7fbc8c23c640 1 --2- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8406fa50 0x7fbc840b1030 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbc78031000 tx=0x7fbc780046c0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.169+0000 7fbc8c23c640 1 -- 172.21.15.60:0/2024657212 shutdown_connections 2024-09-12T01:35:35.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.169+0000 7fbc8c23c640 1 --2- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc840d2090 0x7fbc8414de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.169+0000 7fbc8c23c640 1 --2- 172.21.15.60:0/2024657212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc840cfb90 0x7fbc840aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.169+0000 7fbc8c23c640 1 --2- 172.21.15.60:0/2024657212 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc8406fa50 0x7fbc840b1030 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:35.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.169+0000 7fbc8c23c640 1 -- 172.21.15.60:0/2024657212 >> 172.21.15.60:0/2024657212 conn(0x7fbc84062630 msgr2=0x7fbc8415df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:35.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.169+0000 7fbc8c23c640 1 -- 172.21.15.60:0/2024657212 shutdown_connections 2024-09-12T01:35:35.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:35.169+0000 7fbc8c23c640 1 -- 172.21.15.60:0/2024657212 wait complete. 2024-09-12T01:35:35.180 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T01:35:35.180 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T01:35:35.284 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:35.284+0000 7f3e9bdf9040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:35:35.337 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:35.337+0000 7f3e9bdf9040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:35:35.391 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:35.391+0000 7f3e9bdf9040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:35:35.425 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:35.425+0000 7f953ea0d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-12T01:35:35.462 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:35.462+0000 7f3e9bdf9040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:35:35.507 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:35.508+0000 7f953ea0d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-12T01:35:35.508 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:35.508+0000 7f3e9bdf9040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:35:35.555 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:35.555+0000 7f3e9bdf9040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:35:35.615 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:35.616+0000 7f953ea0d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-12T01:35:35.662 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:35.662+0000 7f953ea0d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-12T01:35:35.772 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:35.772+0000 7f953ea0d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-12T01:35:35.824 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:35.824+0000 7f953ea0d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-12T01:35:35.870 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:35.870+0000 7f953ea0d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-12T01:35:35.985 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:35.985+0000 7f953ea0d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-12T01:35:35.987 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T01:35:36.033 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:36.034+0000 7f953ea0d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-12T01:35:36.081 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.081+0000 7efed7578640 1 Processor -- start 2024-09-12T01:35:36.082 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.081+0000 7efed7578640 1 -- start start 2024-09-12T01:35:36.083 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.082+0000 7efed7578640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efed00cf4e0 0x7efed006fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:36.083 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.082+0000 7efed7578640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed00705c0 con 0x7efed00cf100 2024-09-12T01:35:36.083 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.082+0000 7efed7578640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efed00cd0c0 con 0x7efed0071120 2024-09-12T01:35:36.083 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.082+0000 7efed7578640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7efed00af4b0 con 0x7efed00cf4e0 2024-09-12T01:35:36.083 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.082+0000 7efed5b15640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efed00cf4e0 0x7efed006fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:36.083 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.082+0000 7efed5314640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efed00cf100 0x7efed01607f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47468/0 (socket says 172.21.15.60:47468) 2024-09-12T01:35:36.083 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.082+0000 7efed5314640 1 -- 172.21.15.60:0/3216459080 learned_addr learned my addr 172.21.15.60:0/3216459080 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:35:36.083 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.083+0000 7efed5b15640 1 -- 172.21.15.60:0/3216459080 >> v1:172.21.15.105:6789/0 conn(0x7efed0071120 legacy=0x7efed00cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:36.083 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.083+0000 7efed5b15640 1 -- 172.21.15.60:0/3216459080 >> v1:172.21.15.60:6789/0 conn(0x7efed00cf100 legacy=0x7efed01607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:36.083 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.083+0000 7efed5b15640 1 -- 172.21.15.60:0/3216459080 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed00cd3a0 con 0x7efed00cf4e0 2024-09-12T01:35:36.083 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.083+0000 7efec3fff640 1 -- 172.21.15.60:0/3216459080 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223123720 0 0) 0x7efed00705c0 con 0x7efed00cf100 2024-09-12T01:35:36.084 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:36.084+0000 7f953ea0d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-12T01:35:36.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.083+0000 7efed5b15640 1 --2- 172.21.15.60:0/3216459080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed00cf4e0 0x7efed006fe50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efec8009d90 tx=0x7efec802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e45f700ada06100 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:36.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.084+0000 7efec3fff640 1 -- 172.21.15.60:0/3216459080 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8007740 con 0x7efed00cf4e0 2024-09-12T01:35:36.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.084+0000 7efec3fff640 1 -- 172.21.15.60:0/3216459080 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec80078e0 con 0x7efed00cf4e0 2024-09-12T01:35:36.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.084+0000 7efec3fff640 1 -- 172.21.15.60:0/3216459080 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec8007cb0 con 0x7efed00cf4e0 2024-09-12T01:35:36.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.084+0000 7efed7578640 1 -- 172.21.15.60:0/3216459080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed00cf4e0 msgr2=0x7efed006fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:36.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.084+0000 7efed7578640 1 --2- 172.21.15.60:0/3216459080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed00cf4e0 0x7efed006fe50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efec8009d90 tx=0x7efec802a6f0 comp rx=0 tx=0).stop 2024-09-12T01:35:36.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.084+0000 7efed7578640 1 -- 172.21.15.60:0/3216459080 shutdown_connections 2024-09-12T01:35:36.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.084+0000 7efed7578640 1 --2- 172.21.15.60:0/3216459080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed00cf4e0 0x7efed006fe50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:36.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.084+0000 7efed7578640 1 -- 172.21.15.60:0/3216459080 >> 172.21.15.60:0/3216459080 conn(0x7efed009b9f0 msgr2=0x7efed00b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:36.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.084+0000 7efed7578640 1 -- 172.21.15.60:0/3216459080 shutdown_connections 2024-09-12T01:35:36.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.084+0000 7efed7578640 1 -- 172.21.15.60:0/3216459080 wait complete. 2024-09-12T01:35:36.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.086+0000 7efed7578640 1 Processor -- start 2024-09-12T01:35:36.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.086+0000 7efed7578640 1 -- start start 2024-09-12T01:35:36.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.086+0000 7efed7578640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed0071120 0x7efed0158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:36.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.086+0000 7efed7578640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed00cf100 0x7efed00cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:36.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.086+0000 7efed7578640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed00cf4e0 0x7efed00b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:36.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.086+0000 7efed7578640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efed00708a0 con 0x7efed00cf100 2024-09-12T01:35:36.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.086+0000 7efed7578640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efed0070a20 con 0x7efed0071120 2024-09-12T01:35:36.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.086+0000 7efed7578640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efed0160f00 con 0x7efed00cf4e0 2024-09-12T01:35:36.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed4b13640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed00cf100 0x7efed00cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:36.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed4b13640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed00cf100 0x7efed00cb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56982/0 (socket says 172.21.15.60:56982) 2024-09-12T01:35:36.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed4b13640 1 -- 172.21.15.60:0/2536828668 learned_addr learned my addr 172.21.15.60:0/2536828668 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:36.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed5314640 1 --2- 172.21.15.60:0/2536828668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed0071120 0x7efed0158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:36.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed5b15640 1 --2- 172.21.15.60:0/2536828668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed00cf4e0 0x7efed00b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:36.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed5b15640 1 -- 172.21.15.60:0/2536828668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed00cf4e0 msgr2=0x7efed00b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-12T01:35:36.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed5b15640 1 -- 172.21.15.60:0/2536828668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed00cf4e0 msgr2=0x7efed00b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-12T01:35:36.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed5b15640 1 --2- 172.21.15.60:0/2536828668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed00cf4e0 0x7efed00b67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-12T01:35:36.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed5b15640 1 --2- 172.21.15.60:0/2536828668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed00cf4e0 0x7efed00b67f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-12T01:35:36.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed4b13640 1 -- 172.21.15.60:0/2536828668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed00cf4e0 msgr2=0x7efed00b67f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:35:36.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed4b13640 1 --2- 172.21.15.60:0/2536828668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed00cf4e0 0x7efed00b67f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:36.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed4b13640 1 -- 172.21.15.60:0/2536828668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed0071120 msgr2=0x7efed0158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:36.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed4b13640 1 --2- 172.21.15.60:0/2536828668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed0071120 0x7efed0158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:36.091 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed4b13640 1 -- 172.21.15.60:0/2536828668 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed00cb9c0 con 0x7efed00cf100 2024-09-12T01:35:36.091 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed4b13640 1 --2- 172.21.15.60:0/2536828668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed00cf100 0x7efed00cb050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efec400c480 tx=0x7efec400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:36.091 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efec1ffb640 1 -- 172.21.15.60:0/2536828668 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec40052d0 con 0x7efed00cf100 2024-09-12T01:35:36.091 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efec1ffb640 1 -- 172.21.15.60:0/2536828668 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec4005470 con 0x7efed00cf100 2024-09-12T01:35:36.091 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed7578640 1 -- 172.21.15.60:0/2536828668 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed00b2370 con 0x7efed00cf100 2024-09-12T01:35:36.091 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efec1ffb640 1 -- 172.21.15.60:0/2536828668 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec4012870 con 0x7efed00cf100 2024-09-12T01:35:36.091 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efed7578640 1 -- 172.21.15.60:0/2536828668 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed00b2930 con 0x7efed00cf100 2024-09-12T01:35:36.091 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.087+0000 7efec1ffb640 1 -- 172.21.15.60:0/2536828668 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efec4012a10 con 0x7efed00cf100 2024-09-12T01:35:36.091 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.088+0000 7efec1ffb640 1 -- 172.21.15.60:0/2536828668 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7efec4012d00 con 0x7efed00cf100 2024-09-12T01:35:36.091 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.088+0000 7efed7578640 1 -- 172.21.15.60:0/2536828668 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efed006fe50 con 0x7efed00cf100 2024-09-12T01:35:36.092 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.091+0000 7efec1ffb640 1 -- 172.21.15.60:0/2536828668 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efec4007020 con 0x7efed00cf100 2024-09-12T01:35:36.151 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.151+0000 7efed7578640 1 -- 172.21.15.60:0/2536828668 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efed00b8600 con 0x7efed00cf100 2024-09-12T01:35:36.152 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.152+0000 7efec1ffb640 1 -- 172.21.15.60:0/2536828668 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7efec4007200 con 0x7efed00cf100 2024-09-12T01:35:36.152 INFO:teuthology.misc.health.smithi060.stdout: 2024-09-12T01:35:36.152 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":10,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:34.911685+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:35:36.153 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:36.153+0000 7f953ea0d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-12T01:35:36.153 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.153+0000 7efed7578640 1 -- 172.21.15.60:0/2536828668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed00cf100 msgr2=0x7efed00cb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:36.153 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.153+0000 7efed7578640 1 --2- 172.21.15.60:0/2536828668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed00cf100 0x7efed00cb050 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7efec400c480 tx=0x7efec400c940 comp rx=0 tx=0).stop 2024-09-12T01:35:36.154 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.153+0000 7efed7578640 1 -- 172.21.15.60:0/2536828668 shutdown_connections 2024-09-12T01:35:36.154 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.153+0000 7efed7578640 1 --2- 172.21.15.60:0/2536828668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efed00cf4e0 0x7efed00b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:36.154 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.153+0000 7efed7578640 1 --2- 172.21.15.60:0/2536828668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efed00cf100 0x7efed00cb050 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:36.154 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.153+0000 7efed7578640 1 --2- 172.21.15.60:0/2536828668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efed0071120 0x7efed0158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:36.154 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.153+0000 7efed7578640 1 -- 172.21.15.60:0/2536828668 >> 172.21.15.60:0/2536828668 conn(0x7efed009b9f0 msgr2=0x7efed00b0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:36.154 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.153+0000 7efed7578640 1 -- 172.21.15.60:0/2536828668 shutdown_connections 2024-09-12T01:35:36.154 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:36.153+0000 7efed7578640 1 -- 172.21.15.60:0/2536828668 wait complete. 2024-09-12T01:35:36.162 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T01:35:36.198 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:36.198+0000 7f953ea0d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-12T01:35:36.243 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:36.244+0000 7f953ea0d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-12T01:35:36.250 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:36.250+0000 7f3e9bdf9040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:35:36.645 INFO:tasks.ceph.osd.2.smithi060.stderr:2024-09-12T01:35:36.644+0000 7fb93cdfd640 -1 Falling back to public interface 2024-09-12T01:35:36.656 INFO:tasks.ceph.osd.1.smithi060.stderr:2024-09-12T01:35:36.656+0000 7f5adbbc5640 -1 Falling back to public interface 2024-09-12T01:35:36.732 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-09-12T01:35:36.732+0000 7f7102817640 -1 Falling back to public interface 2024-09-12T01:35:36.735 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-09-12T01:35:36.736+0000 7f31f6589640 -1 Falling back to public interface 2024-09-12T01:35:36.893 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-12T01:35:36.892+0000 7f25a63a8640 -1 Falling back to public interface 2024-09-12T01:35:36.898 INFO:tasks.ceph.osd.3.smithi060.stderr:2024-09-12T01:35:36.898+0000 7fe3eb031640 -1 Falling back to public interface 2024-09-12T01:35:36.899 INFO:tasks.ceph.mgr.x.smithi105.stderr:2024-09-12T01:35:36.900+0000 7f953ea0d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-12T01:35:36.965 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-09-12T01:35:36.965+0000 7f440bd41640 -1 Falling back to public interface 2024-09-12T01:35:36.970 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-09-12T01:35:36.971+0000 7fb92920b640 -1 Falling back to public interface 2024-09-12T01:35:37.264 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:37.264+0000 7f3e3c6c7640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T01:35:37.265 INFO:tasks.ceph.mgr.y.smithi060.stderr:2024-09-12T01:35:37.264+0000 7f3e3c6c7640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T01:35:40.551 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-09-12T01:35:40.552+0000 7f31f6589640 -1 osd.4 0 log_to_monitors true 2024-09-12T01:35:40.721 INFO:tasks.ceph.osd.2.smithi060.stderr:2024-09-12T01:35:40.721+0000 7fb93cdfd640 -1 osd.2 0 log_to_monitors true 2024-09-12T01:35:40.970 INFO:tasks.ceph.osd.1.smithi060.stderr:2024-09-12T01:35:40.970+0000 7f5adbbc5640 -1 osd.1 0 log_to_monitors true 2024-09-12T01:35:41.018 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-09-12T01:35:41.019+0000 7f7102817640 -1 osd.6 0 log_to_monitors true 2024-09-12T01:35:41.153 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-12T01:35:41.153+0000 7f25a63a8640 -1 osd.0 0 log_to_monitors true 2024-09-12T01:35:41.196 INFO:tasks.ceph.osd.3.smithi060.stderr:2024-09-12T01:35:41.196+0000 7fe3eb031640 -1 osd.3 0 log_to_monitors true 2024-09-12T01:35:41.261 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-09-12T01:35:41.262+0000 7fb92920b640 -1 osd.7 0 log_to_monitors true 2024-09-12T01:35:41.495 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-09-12T01:35:41.495+0000 7f440bd41640 -1 osd.5 0 log_to_monitors true 2024-09-12T01:35:42.455 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-09-12T01:35:42.456+0000 7f31f2d2c640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T01:35:42.469 INFO:tasks.ceph.osd.4.smithi105.stderr:2024-09-12T01:35:42.470+0000 7f31ea327640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:35:42.969 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T01:35:43.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.084+0000 7f3209b26640 1 Processor -- start 2024-09-12T01:35:43.085 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.084+0000 7f3209b26640 1 -- start start 2024-09-12T01:35:43.086 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f3209b26640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f320415b3c0 0x7f320415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:43.086 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f3209b26640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f320415cd80 0x7f320415e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:43.086 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f3209b26640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f320415d300 con 0x7f320415e8e0 2024-09-12T01:35:43.086 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f3209b26640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f320415b7a0 con 0x7f320415b3c0 2024-09-12T01:35:43.086 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f3209b26640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f320415d5e0 con 0x7f320415cd80 2024-09-12T01:35:43.086 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f32037fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f320415b3c0 0x7f320415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:43.087 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f32037fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f320415b3c0 0x7f320415c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57604/0 (socket says 172.21.15.60:57604) 2024-09-12T01:35:43.087 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f3202ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f320415cd80 0x7f320415e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:43.087 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f32037fe640 1 -- 172.21.15.60:0/2221667060 learned_addr learned my addr 172.21.15.60:0/2221667060 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:43.088 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f32037fe640 1 -- 172.21.15.60:0/2221667060 >> v2:172.21.15.105:3300/0 conn(0x7f320415cd80 msgr2=0x7f320415e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:43.088 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f32037fe640 1 --2- 172.21.15.60:0/2221667060 >> v2:172.21.15.105:3300/0 conn(0x7f320415cd80 0x7f320415e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:43.088 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f32027fc640 1 -- 172.21.15.60:0/2221667060 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285873475 0 0) 0x7f320415d300 con 0x7f320415e8e0 2024-09-12T01:35:43.088 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.086+0000 7f32037fe640 1 -- 172.21.15.60:0/2221667060 >> v1:172.21.15.60:6789/0 conn(0x7f320415e8e0 legacy=0x7f32040c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:43.088 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.087+0000 7f32037fe640 1 -- 172.21.15.60:0/2221667060 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320415d8c0 con 0x7f320415b3c0 2024-09-12T01:35:43.088 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.087+0000 7f3202ffd640 1 --2- 172.21.15.60:0/2221667060 >> v2:172.21.15.105:3300/0 conn(0x7f320415cd80 0x7f320415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:43.088 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.087+0000 7f32037fe640 1 --2- 172.21.15.60:0/2221667060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f320415b3c0 0x7f320415c840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32040b7480 tx=0x7f31f402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbadbfa6294e6755 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:43.088 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.087+0000 7f32027fc640 1 -- 172.21.15.60:0/2221667060 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f4036020 con 0x7f320415b3c0 2024-09-12T01:35:43.088 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.088+0000 7f32027fc640 1 -- 172.21.15.60:0/2221667060 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f4032640 con 0x7f320415b3c0 2024-09-12T01:35:43.088 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.088+0000 7f32027fc640 1 -- 172.21.15.60:0/2221667060 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f4032a10 con 0x7f320415b3c0 2024-09-12T01:35:43.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.088+0000 7f3209b26640 1 -- 172.21.15.60:0/2221667060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f320415b3c0 msgr2=0x7f320415c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:43.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.088+0000 7f3209b26640 1 --2- 172.21.15.60:0/2221667060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f320415b3c0 0x7f320415c840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32040b7480 tx=0x7f31f402c940 comp rx=0 tx=0).stop 2024-09-12T01:35:43.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.088+0000 7f3209b26640 1 -- 172.21.15.60:0/2221667060 shutdown_connections 2024-09-12T01:35:43.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.088+0000 7f3209b26640 1 --2- 172.21.15.60:0/2221667060 >> v2:172.21.15.105:3300/0 conn(0x7f320415cd80 0x7f320415e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:43.089 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.088+0000 7f3209b26640 1 --2- 172.21.15.60:0/2221667060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f320415b3c0 0x7f320415c840 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:43.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.088+0000 7f3209b26640 1 -- 172.21.15.60:0/2221667060 >> 172.21.15.60:0/2221667060 conn(0x7f320406cc30 msgr2=0x7f320406d010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:43.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.088+0000 7f3209b26640 1 -- 172.21.15.60:0/2221667060 shutdown_connections 2024-09-12T01:35:43.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.088+0000 7f3209b26640 1 -- 172.21.15.60:0/2221667060 wait complete. 2024-09-12T01:35:43.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.090+0000 7f3209b26640 1 Processor -- start 2024-09-12T01:35:43.090 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.090+0000 7f3209b26640 1 -- start start 2024-09-12T01:35:43.092 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.091+0000 7f3209b26640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f320415b3c0 0x7f3204154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:43.092 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.091+0000 7f3209b26640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f320415cd80 0x7f3204165590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:43.092 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.091+0000 7f3209b26640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f320415e8e0 0x7f320414cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:43.092 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.091+0000 7f3209b26640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f320415bb20 con 0x7f320415e8e0 2024-09-12T01:35:43.092 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.091+0000 7f3209b26640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f320415de80 con 0x7f320415cd80 2024-09-12T01:35:43.092 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.091+0000 7f3209b26640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f32040c6af0 con 0x7f320415b3c0 2024-09-12T01:35:43.092 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.091+0000 7f3203fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f320415e8e0 0x7f320414cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:43.093 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.091+0000 7f3203fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f320415e8e0 0x7f320414cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57614/0 (socket says 172.21.15.60:57614) 2024-09-12T01:35:43.093 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.091+0000 7f32037fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f320415b3c0 0x7f3204154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:43.093 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.091+0000 7f3203fff640 1 -- 172.21.15.60:0/2893331313 learned_addr learned my addr 172.21.15.60:0/2893331313 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:43.093 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.091+0000 7f3202ffd640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f320415cd80 0x7f3204165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:43.093 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.091+0000 7f32037fe640 1 -- 172.21.15.60:0/2893331313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f320415cd80 msgr2=0x7f3204165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:43.093 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.092+0000 7f32037fe640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f320415cd80 0x7f3204165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:43.093 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.092+0000 7f32037fe640 1 -- 172.21.15.60:0/2893331313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f320415e8e0 msgr2=0x7f320414cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:43.093 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.092+0000 7f32037fe640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f320415e8e0 0x7f320414cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:43.093 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.092+0000 7f32037fe640 1 -- 172.21.15.60:0/2893331313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3204154ad0 con 0x7f320415b3c0 2024-09-12T01:35:43.093 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.092+0000 7f3202ffd640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f320415cd80 0x7f3204165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:43.093 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.092+0000 7f3203fff640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f320415e8e0 0x7f320414cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:43.093 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.092+0000 7f32037fe640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f320415b3c0 0x7f3204154590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f31f4034000 tx=0x7f31f4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:43.094 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.092+0000 7f31ebfff640 1 -- 172.21.15.60:0/2893331313 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f4031bb0 con 0x7f320415b3c0 2024-09-12T01:35:43.094 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.092+0000 7f31ebfff640 1 -- 172.21.15.60:0/2893331313 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31f4031d70 con 0x7f320415b3c0 2024-09-12T01:35:43.094 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.092+0000 7f31ebfff640 1 -- 172.21.15.60:0/2893331313 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f403b660 con 0x7f320415b3c0 2024-09-12T01:35:43.094 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.092+0000 7f3209b26640 1 -- 172.21.15.60:0/2893331313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3204154d70 con 0x7f320415b3c0 2024-09-12T01:35:43.094 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.092+0000 7f3209b26640 1 -- 172.21.15.60:0/2893331313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3204155330 con 0x7f320415b3c0 2024-09-12T01:35:43.095 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.094+0000 7f3209b26640 1 -- 172.21.15.60:0/2893331313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f320415c840 con 0x7f320415b3c0 2024-09-12T01:35:43.095 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.094+0000 7f31ebfff640 1 -- 172.21.15.60:0/2893331313 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 4) ==== 90442+0+0 (secure 0 0 0) 0x7f31f4039020 con 0x7f320415b3c0 2024-09-12T01:35:43.095 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.095+0000 7f31ebfff640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31f006bda0 0x7f31f006e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:43.095 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.095+0000 7f31ebfff640 1 -- 172.21.15.60:0/2893331313 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f31f40aadb0 con 0x7f320415b3c0 2024-09-12T01:35:43.096 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.095+0000 7f3202ffd640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31f006bda0 0x7f31f006e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:43.096 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.096+0000 7f3202ffd640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31f006bda0 0x7f31f006e260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3204155e90 tx=0x7f31f8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:43.100 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.100+0000 7f31ebfff640 1 -- 172.21.15.60:0/2893331313 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31f4079f00 con 0x7f320415b3c0 2024-09-12T01:35:43.377 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.376+0000 7f3209b26640 1 -- 172.21.15.60:0/2893331313 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f320415e510 con 0x7f320415b3c0 2024-09-12T01:35:43.378 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.377+0000 7f31ebfff640 1 -- 172.21.15.60:0/2893331313 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7567 (secure 0 0 0) 0x7f31f407e200 con 0x7f320415b3c0 2024-09-12T01:35:43.379 INFO:teuthology.misc.health.smithi060.stdout: 2024-09-12T01:35:43.379 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":13,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:42.611551+0000","last_up_change":"2024-09-12T01:35:42.611551+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:35:43.382 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.380+0000 7f3209b26640 1 -- 172.21.15.60:0/2893331313 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31f006bda0 msgr2=0x7f31f006e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:43.382 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.380+0000 7f3209b26640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31f006bda0 0x7f31f006e260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3204155e90 tx=0x7f31f8009190 comp rx=0 tx=0).stop 2024-09-12T01:35:43.382 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.380+0000 7f3209b26640 1 -- 172.21.15.60:0/2893331313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f320415b3c0 msgr2=0x7f3204154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:43.382 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.380+0000 7f3209b26640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f320415b3c0 0x7f3204154590 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f31f4034000 tx=0x7f31f4004730 comp rx=0 tx=0).stop 2024-09-12T01:35:43.383 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.381+0000 7f3209b26640 1 -- 172.21.15.60:0/2893331313 shutdown_connections 2024-09-12T01:35:43.383 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.381+0000 7f3209b26640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f320415e8e0 0x7f320414cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:43.383 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.381+0000 7f3209b26640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f320415cd80 0x7f3204165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:43.383 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.381+0000 7f3209b26640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31f006bda0 0x7f31f006e260 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:43.383 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.381+0000 7f3209b26640 1 --2- 172.21.15.60:0/2893331313 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f320415b3c0 0x7f3204154590 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:43.383 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.381+0000 7f3209b26640 1 -- 172.21.15.60:0/2893331313 >> 172.21.15.60:0/2893331313 conn(0x7f320406cc30 msgr2=0x7f3204159b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:43.383 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.382+0000 7f3209b26640 1 -- 172.21.15.60:0/2893331313 shutdown_connections 2024-09-12T01:35:43.383 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:43.382+0000 7f3209b26640 1 -- 172.21.15.60:0/2893331313 wait complete. 2024-09-12T01:35:43.397 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T01:35:43.993 INFO:tasks.ceph.osd.1.smithi060.stderr:2024-09-12T01:35:43.992+0000 7f5ad7331640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T01:35:44.005 INFO:tasks.ceph.osd.1.smithi060.stderr:2024-09-12T01:35:44.005+0000 7f5acf963640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:35:44.048 INFO:tasks.ceph.osd.2.smithi060.stderr:2024-09-12T01:35:44.047+0000 7fb938569640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T01:35:44.055 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-12T01:35:44.055+0000 7f25a1b14640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T01:35:44.062 INFO:tasks.ceph.osd.2.smithi060.stderr:2024-09-12T01:35:44.062+0000 7fb930b9b640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:35:44.071 INFO:tasks.ceph.osd.0.smithi060.stderr:2024-09-12T01:35:44.071+0000 7f259a146640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:35:44.248 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-09-12T01:35:44.248+0000 7f70fd8e3640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T01:35:44.264 INFO:tasks.ceph.osd.6.smithi105.stderr:2024-09-12T01:35:44.264+0000 7f70f5f15640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:35:44.305 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-09-12T01:35:44.306+0000 7f44074ad640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T01:35:44.306 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-09-12T01:35:44.307+0000 7fb9243f9640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T01:35:44.314 INFO:tasks.ceph.osd.5.smithi105.stderr:2024-09-12T01:35:44.315+0000 7f43ffadf640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:35:44.319 INFO:tasks.ceph.osd.7.smithi105.stderr:2024-09-12T01:35:44.320+0000 7fb91ca2b640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:35:44.391 INFO:tasks.ceph.osd.3.smithi060.stderr:2024-09-12T01:35:44.391+0000 7fe3e6d99640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T01:35:44.401 INFO:tasks.ceph.osd.3.smithi060.stderr:2024-09-12T01:35:44.401+0000 7fe3de394640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T01:35:47.269 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:35:47.272 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:35:50.205 DEBUG:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T01:35:50.310 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.309+0000 7f0e9872c640 1 Processor -- start 2024-09-12T01:35:50.310 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.309+0000 7f0e9872c640 1 -- start start 2024-09-12T01:35:50.310 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.310+0000 7f0e9872c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e900b8cd0 0x7f0e901691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.310 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.310+0000 7f0e9872c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e900b77e0 con 0x7f0e900d2b60 2024-09-12T01:35:50.311 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.310+0000 7f0e9872c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e900d3890 con 0x7f0e900b60c0 2024-09-12T01:35:50.311 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.310+0000 7f0e9872c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e900d3b70 con 0x7f0e900b8cd0 2024-09-12T01:35:50.311 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.310+0000 7f0e95cc7640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0e900d2b60 0x7f0e900d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33242/0 (socket says 172.21.15.60:33242) 2024-09-12T01:35:50.311 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.310+0000 7f0e95cc7640 1 -- 172.21.15.60:0/1064026577 learned_addr learned my addr 172.21.15.60:0/1064026577 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:35:50.313 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e96cc9640 1 --2- 172.21.15.60:0/1064026577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e900b8cd0 0x7f0e901691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852096933 0 0) 0x7f0e900b77e0 con 0x7f0e900d2b60 2024-09-12T01:35:50.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e78003520 con 0x7f0e900d2b60 2024-09-12T01:35:50.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1808674564 0 0) 0x7f0e78003520 con 0x7f0e900d2b60 2024-09-12T01:35:50.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e900b8cd0 msgr2=0x7f0e901691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:50.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 --2- 172.21.15.60:0/1064026577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e900b8cd0 0x7f0e901691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 >> v1:172.21.15.105:6789/0 conn(0x7f0e900b60c0 legacy=0x7f0e900b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e900d3e50 con 0x7f0e900d2b60 2024-09-12T01:35:50.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f0e84001670 con 0x7f0e900d2b60 2024-09-12T01:35:50.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 >> v1:172.21.15.60:6789/0 conn(0x7f0e900d2b60 legacy=0x7f0e900d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 --2- 172.21.15.60:0/1064026577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e78003a50 0x7f0e78003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 --2- 172.21.15.60:0/1064026577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e900b8cd0 0x7f0e78004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.314 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 --2- 172.21.15.60:0/1064026577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e78004d40 0x7f0e780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0e900d3b70 con 0x7f0e78004d40 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e7800ba70 con 0x7f0e78003a50 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e7800bc70 con 0x7f0e900b8cd0 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e96cc9640 1 --2- 172.21.15.60:0/1064026577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e78004d40 0x7f0e780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e964c8640 1 --2- 172.21.15.60:0/1064026577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e78003a50 0x7f0e78003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.311+0000 7f0e95cc7640 1 --2- 172.21.15.60:0/1064026577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e900b8cd0 0x7f0e78004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.312+0000 7f0e96cc9640 1 -- 172.21.15.60:0/1064026577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e900b8cd0 msgr2=0x7f0e78004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.312+0000 7f0e96cc9640 1 --2- 172.21.15.60:0/1064026577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e900b8cd0 0x7f0e78004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.312+0000 7f0e96cc9640 1 -- 172.21.15.60:0/1064026577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e78003a50 msgr2=0x7f0e78003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.312+0000 7f0e96cc9640 1 --2- 172.21.15.60:0/1064026577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e78003a50 0x7f0e78003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.312+0000 7f0e96cc9640 1 -- 172.21.15.60:0/1064026577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e78003520 con 0x7f0e78004d40 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.312+0000 7f0e96cc9640 1 --2- 172.21.15.60:0/1064026577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e78004d40 0x7f0e780051c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009a90 tx=0x7f0e78005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5aa30707a3192e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.312+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88036070 con 0x7f0e78004d40 2024-09-12T01:35:50.315 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.312+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88031400 con 0x7f0e78004d40 2024-09-12T01:35:50.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.312+0000 7f0e954c6640 1 -- 172.21.15.60:0/1064026577 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88009690 con 0x7f0e78004d40 2024-09-12T01:35:50.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.313+0000 7f0e9872c640 1 -- 172.21.15.60:0/1064026577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e78004d40 msgr2=0x7f0e780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.313+0000 7f0e9872c640 1 --2- 172.21.15.60:0/1064026577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e78004d40 0x7f0e780051c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0e88009a90 tx=0x7f0e78005830 comp rx=0 tx=0).stop 2024-09-12T01:35:50.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.313+0000 7f0e96cc9640 1 -- 172.21.15.60:0/1064026577 reap_dead start 2024-09-12T01:35:50.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.313+0000 7f0e9872c640 1 -- 172.21.15.60:0/1064026577 shutdown_connections 2024-09-12T01:35:50.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.313+0000 7f0e9872c640 1 -- 172.21.15.60:0/1064026577 >> 172.21.15.60:0/1064026577 conn(0x7f0e900d10c0 msgr2=0x7f0e900d14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:50.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.313+0000 7f0e9872c640 1 -- 172.21.15.60:0/1064026577 shutdown_connections 2024-09-12T01:35:50.316 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.313+0000 7f0e9872c640 1 -- 172.21.15.60:0/1064026577 wait complete. 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.314+0000 7f0e9872c640 1 Processor -- start 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.314+0000 7f0e9872c640 1 -- start start 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.315+0000 7f0e9872c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e78004d40 0x7f0e90155460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.315+0000 7f0e9872c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e9015acb0 0x7f0e900cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.315+0000 7f0e9872c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e9015baa0 0x7f0e90157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.315+0000 7f0e9872c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9015ea60 con 0x7f0e78004d40 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.315+0000 7f0e9872c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9015e8e0 con 0x7f0e9015acb0 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.315+0000 7f0e9872c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e901671d0 con 0x7f0e9015baa0 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.315+0000 7f0e964c8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e78004d40 0x7f0e90155460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.315+0000 7f0e964c8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e78004d40 0x7f0e90155460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57658/0 (socket says 172.21.15.60:57658) 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.315+0000 7f0e964c8640 1 -- 172.21.15.60:0/1853040324 learned_addr learned my addr 172.21.15.60:0/1853040324 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.315+0000 7f0e96cc9640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e9015baa0 0x7f0e90157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.319 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.316+0000 7f0e95cc7640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e9015acb0 0x7f0e900cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.316+0000 7f0e964c8640 1 -- 172.21.15.60:0/1853040324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e9015baa0 msgr2=0x7f0e90157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.316+0000 7f0e964c8640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e9015baa0 0x7f0e90157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.316+0000 7f0e964c8640 1 -- 172.21.15.60:0/1853040324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e9015acb0 msgr2=0x7f0e900cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.316+0000 7f0e964c8640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e9015acb0 0x7f0e900cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.316+0000 7f0e964c8640 1 -- 172.21.15.60:0/1853040324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e900ca150 con 0x7f0e78004d40 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.316+0000 7f0e964c8640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e78004d40 0x7f0e90155460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000fb90 tx=0x7f0e8000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.316+0000 7f0e8effd640 1 -- 172.21.15.60:0/1853040324 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000dc30 con 0x7f0e78004d40 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.316+0000 7f0e8effd640 1 -- 172.21.15.60:0/1853040324 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e80018070 con 0x7f0e78004d40 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.316+0000 7f0e9872c640 1 -- 172.21.15.60:0/1853040324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9015a4f0 con 0x7f0e78004d40 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.316+0000 7f0e8effd640 1 -- 172.21.15.60:0/1853040324 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e80003970 con 0x7f0e78004d40 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.316+0000 7f0e9872c640 1 -- 172.21.15.60:0/1853040324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e900ca3f0 con 0x7f0e78004d40 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.317+0000 7f0e9872c640 1 -- 172.21.15.60:0/1853040324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e900ba310 con 0x7f0e78004d40 2024-09-12T01:35:50.320 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.317+0000 7f0e8effd640 1 -- 172.21.15.60:0/1853040324 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e80003b30 con 0x7f0e78004d40 2024-09-12T01:35:50.321 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.318+0000 7f0e8effd640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e7c06be30 0x7f0e7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.321 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.318+0000 7f0e95cc7640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e7c06be30 0x7f0e7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.321 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.318+0000 7f0e8effd640 1 -- 172.21.15.60:0/1853040324 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f0e8008ae70 con 0x7f0e78004d40 2024-09-12T01:35:50.321 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.319+0000 7f0e95cc7640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e7c06be30 0x7f0e7c06e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e901f7af0 tx=0x7f0e84009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:50.323 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.323+0000 7f0e8effd640 1 -- 172.21.15.60:0/1853040324 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e900ba310 con 0x7f0e78004d40 2024-09-12T01:35:50.499 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.499+0000 7f0e9872c640 1 -- 172.21.15.60:0/1853040324 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e900b64a0 con 0x7f0e78004d40 2024-09-12T01:35:50.500 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.499+0000 7f0e8effd640 1 -- 172.21.15.60:0/1853040324 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12860 (secure 0 0 0) 0x7f0e80003e20 con 0x7f0e78004d40 2024-09-12T01:35:50.500 INFO:teuthology.misc.health.smithi060.stdout: 2024-09-12T01:35:50.500 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":19,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:49.009321+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:35:50.502 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.502+0000 7f0e9872c640 1 -- 172.21.15.60:0/1853040324 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e7c06be30 msgr2=0x7f0e7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.502 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.502+0000 7f0e9872c640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e7c06be30 0x7f0e7c06e2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0e901f7af0 tx=0x7f0e84009040 comp rx=0 tx=0).stop 2024-09-12T01:35:50.502 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.502+0000 7f0e9872c640 1 -- 172.21.15.60:0/1853040324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e78004d40 msgr2=0x7f0e90155460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.502 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.502+0000 7f0e9872c640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e78004d40 0x7f0e90155460 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0e8000fb90 tx=0x7f0e8000d520 comp rx=0 tx=0).stop 2024-09-12T01:35:50.502 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.502+0000 7f0e9872c640 1 -- 172.21.15.60:0/1853040324 shutdown_connections 2024-09-12T01:35:50.503 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.502+0000 7f0e9872c640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e7c06be30 0x7f0e7c06e2f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.503 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.502+0000 7f0e9872c640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e9015baa0 0x7f0e90157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.503 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.502+0000 7f0e9872c640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e9015acb0 0x7f0e900cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.503 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.502+0000 7f0e9872c640 1 --2- 172.21.15.60:0/1853040324 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e78004d40 0x7f0e90155460 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.503 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.502+0000 7f0e9872c640 1 -- 172.21.15.60:0/1853040324 >> 172.21.15.60:0/1853040324 conn(0x7f0e900d10c0 msgr2=0x7f0e900b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:50.503 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.502+0000 7f0e9872c640 1 -- 172.21.15.60:0/1853040324 shutdown_connections 2024-09-12T01:35:50.503 INFO:teuthology.misc.health.smithi060.stderr:2024-09-12T01:35:50.502+0000 7f0e9872c640 1 -- 172.21.15.60:0/1853040324 wait complete. 2024-09-12T01:35:50.511 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T01:35:50.512 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T01:35:50.512 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:35:50.512 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:35:50.514 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:35:50.515 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:35:50.515 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:35:50.516 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:35:50.517 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:35:50.517 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:35:50.519 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:35:50.520 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:35:50.520 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:35:50.522 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:35:50.522 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-12T01:35:50.522 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:35:50.591 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2024-09-12T01:35:50.592 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2024-09-12T01:35:50.592 INFO:tasks.ceph.mds.a.smithi060.stderr:2024-09-12T01:35:50.592+0000 7f0de85a6640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-12T01:35:50.608 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:35:50.611 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:35:50.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.629+0000 7f27c84f1640 1 Processor -- start 2024-09-12T01:35:50.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.629+0000 7f27c84f1640 1 -- start start 2024-09-12T01:35:50.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.630+0000 7f27c84f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27c015e660 0x7f27c00cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.630+0000 7f27c84f1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f27c00d1820 0x7f27c00b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.630+0000 7f27c84f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27c015ea40 con 0x7f27c00d3310 2024-09-12T01:35:50.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.630+0000 7f27c84f1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f27c00d3870 con 0x7f27c00d1820 2024-09-12T01:35:50.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.630+0000 7f27c84f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f27c00d3b50 con 0x7f27c015e660 2024-09-12T01:35:50.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.630+0000 7f27c5a8c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f27c00d3310 0x7f27c00d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33260/0 (socket says 172.21.15.60:33260) 2024-09-12T01:35:50.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.630+0000 7f27c5a8c640 1 -- 172.21.15.60:0/2673149551 learned_addr learned my addr 172.21.15.60:0/2673149551 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:35:50.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.630+0000 7f27c6a8e640 1 --2- 172.21.15.60:0/2673149551 >> v2:172.21.15.105:3300/0 conn(0x7f27c00d1820 0x7f27c00b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.630+0000 7f27c628d640 1 --2- 172.21.15.60:0/2673149551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27c015e660 0x7f27c00cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.630+0000 7f27c528b640 1 -- 172.21.15.60:0/2673149551 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 860784193 0 0) 0x7f27c015ea40 con 0x7f27c00d3310 2024-09-12T01:35:50.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.630+0000 7f27c528b640 1 -- 172.21.15.60:0/2673149551 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27ac003520 con 0x7f27c00d3310 2024-09-12T01:35:50.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.631+0000 7f27c528b640 1 -- 172.21.15.60:0/2673149551 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2116135968 0 0) 0x7f27ac003520 con 0x7f27c00d3310 2024-09-12T01:35:50.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.631+0000 7f27c6a8e640 1 -- 172.21.15.60:0/2673149551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27c015e660 msgr2=0x7f27c00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:50.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.631+0000 7f27c6a8e640 1 --2- 172.21.15.60:0/2673149551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27c015e660 0x7f27c00cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.631+0000 7f27c6a8e640 1 -- 172.21.15.60:0/2673149551 >> v1:172.21.15.60:6789/0 conn(0x7f27c00d3310 legacy=0x7f27c00d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.631+0000 7f27c6a8e640 1 -- 172.21.15.60:0/2673149551 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c00d3e30 con 0x7f27c00d1820 2024-09-12T01:35:50.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.631+0000 7f27c628d640 1 --2- 172.21.15.60:0/2673149551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27c015e660 0x7f27c00cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:50.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.631+0000 7f27c6a8e640 1 --2- 172.21.15.60:0/2673149551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c00d1820 0x7f27c00b7b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009d90 tx=0x7f27b802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=283f8a8a26435679 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:50.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.632+0000 7f27c528b640 1 -- 172.21.15.60:0/2673149551 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b0001670 con 0x7f27c00d1820 2024-09-12T01:35:50.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.632+0000 7f27c528b640 1 -- 172.21.15.60:0/2673149551 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b8007540 con 0x7f27c00d1820 2024-09-12T01:35:50.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.632+0000 7f27c528b640 1 -- 172.21.15.60:0/2673149551 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8007910 con 0x7f27c00d1820 2024-09-12T01:35:50.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.632+0000 7f27c84f1640 1 -- 172.21.15.60:0/2673149551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c00d1820 msgr2=0x7f27c00b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.632+0000 7f27c84f1640 1 --2- 172.21.15.60:0/2673149551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c00d1820 0x7f27c00b7b70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009d90 tx=0x7f27b802a5f0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.632+0000 7f27c84f1640 1 -- 172.21.15.60:0/2673149551 shutdown_connections 2024-09-12T01:35:50.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.632+0000 7f27c84f1640 1 --2- 172.21.15.60:0/2673149551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c00d1820 0x7f27c00b7b70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.632+0000 7f27c84f1640 1 --2- 172.21.15.60:0/2673149551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27c015e660 0x7f27c00cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.632+0000 7f27c84f1640 1 -- 172.21.15.60:0/2673149551 >> 172.21.15.60:0/2673149551 conn(0x7f27c00b6410 msgr2=0x7f27c00b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:50.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.632+0000 7f27c84f1640 1 -- 172.21.15.60:0/2673149551 shutdown_connections 2024-09-12T01:35:50.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.632+0000 7f27c84f1640 1 -- 172.21.15.60:0/2673149551 wait complete. 2024-09-12T01:35:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.633+0000 7f27c84f1640 1 Processor -- start 2024-09-12T01:35:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.634+0000 7f27c84f1640 1 -- start start 2024-09-12T01:35:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.634+0000 7f27c84f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c00d1820 0x7f27c0149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.634+0000 7f27c84f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27c00d3310 0x7f27c00cae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.634+0000 7f27c84f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c015e660 0x7f27c00b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.634+0000 7f27c84f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27c00cfc70 con 0x7f27c015e660 2024-09-12T01:35:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.634+0000 7f27c84f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27c00d43f0 con 0x7f27c00d1820 2024-09-12T01:35:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.634+0000 7f27c84f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f27c00b80b0 con 0x7f27c00d3310 2024-09-12T01:35:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.634+0000 7f27c6a8e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c015e660 0x7f27c00b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.634+0000 7f27c6a8e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c015e660 0x7f27c00b84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57690/0 (socket says 172.21.15.60:57690) 2024-09-12T01:35:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.634+0000 7f27c6a8e640 1 -- 172.21.15.60:0/4032005441 learned_addr learned my addr 172.21.15.60:0/4032005441 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27c628d640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c00d1820 0x7f27c0149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27c5a8c640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27c00d3310 0x7f27c00cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27c6a8e640 1 -- 172.21.15.60:0/4032005441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27c00d3310 msgr2=0x7f27c00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27c6a8e640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27c00d3310 0x7f27c00cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27c6a8e640 1 -- 172.21.15.60:0/4032005441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c00d1820 msgr2=0x7f27c0149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27c6a8e640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c00d1820 0x7f27c0149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27c6a8e640 1 -- 172.21.15.60:0/4032005441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c0149790 con 0x7f27c015e660 2024-09-12T01:35:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27c6a8e640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c015e660 0x7f27c00b84b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009d90 tx=0x7f27b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27b6ffd640 1 -- 172.21.15.60:0/4032005441 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8040070 con 0x7f27c015e660 2024-09-12T01:35:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27b6ffd640 1 -- 172.21.15.60:0/4032005441 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27b8031b40 con 0x7f27c015e660 2024-09-12T01:35:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27c84f1640 1 -- 172.21.15.60:0/4032005441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27c01467b0 con 0x7f27c015e660 2024-09-12T01:35:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27b6ffd640 1 -- 172.21.15.60:0/4032005441 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27b8007e90 con 0x7f27c015e660 2024-09-12T01:35:50.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.635+0000 7f27c84f1640 1 -- 172.21.15.60:0/4032005441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27c01e7090 con 0x7f27c015e660 2024-09-12T01:35:50.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.636+0000 7f27c84f1640 1 -- 172.21.15.60:0/4032005441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27c00b7b70 con 0x7f27c015e660 2024-09-12T01:35:50.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.637+0000 7f27b6ffd640 1 -- 172.21.15.60:0/4032005441 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27b8039040 con 0x7f27c015e660 2024-09-12T01:35:50.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.637+0000 7f27b6ffd640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f27a406be30 0x7f27a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:50.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.637+0000 7f27b6ffd640 1 -- 172.21.15.60:0/4032005441 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f27b80aba80 con 0x7f27c015e660 2024-09-12T01:35:50.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.637+0000 7f27c628d640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f27a406be30 0x7f27a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:50.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.638+0000 7f27c628d640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f27a406be30 0x7f27a406e2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009560 tx=0x7f27bc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:50.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.642+0000 7f27b6ffd640 1 -- 172.21.15.60:0/4032005441 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27c0149790 con 0x7f27c015e660 2024-09-12T01:35:50.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.850+0000 7f27c84f1640 1 -- 172.21.15.60:0/4032005441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27c00b4a40 con 0x7f27c015e660 2024-09-12T01:35:50.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.850+0000 7f27b6ffd640 1 -- 172.21.15.60:0/4032005441 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f27b807a0b0 con 0x7f27c015e660 2024-09-12T01:35:50.851 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:35:50.851 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":2,"btime":"2024-09-12T01:35:50:597900+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3216581844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3216581844},{"type":"v1","addr":"172.21.15.60:6836","nonce":3216581844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-12T01:35:50.851 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 2 2024-09-12T01:35:50.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.852+0000 7f27c84f1640 1 -- 172.21.15.60:0/4032005441 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f27a406be30 msgr2=0x7f27a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.852+0000 7f27c84f1640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f27a406be30 0x7f27a406e2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f27bc009560 tx=0x7f27bc009190 comp rx=0 tx=0).stop 2024-09-12T01:35:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.852+0000 7f27c84f1640 1 -- 172.21.15.60:0/4032005441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c015e660 msgr2=0x7f27c00b84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.852+0000 7f27c84f1640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c015e660 0x7f27c00b84b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f27b8009d90 tx=0x7f27b8004a40 comp rx=0 tx=0).stop 2024-09-12T01:35:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.852+0000 7f27c84f1640 1 -- 172.21.15.60:0/4032005441 shutdown_connections 2024-09-12T01:35:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.852+0000 7f27c84f1640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27c015e660 0x7f27c00b84b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.852+0000 7f27c84f1640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f27a406be30 0x7f27a406e2f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.852+0000 7f27c84f1640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27c00d3310 0x7f27c00cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.852+0000 7f27c84f1640 1 --2- 172.21.15.60:0/4032005441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27c00d1820 0x7f27c0149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.852+0000 7f27c84f1640 1 -- 172.21.15.60:0/4032005441 >> 172.21.15.60:0/4032005441 conn(0x7f27c00b6410 msgr2=0x7f27c0159890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.852+0000 7f27c84f1640 1 -- 172.21.15.60:0/4032005441 shutdown_connections 2024-09-12T01:35:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:50.852+0000 7f27c84f1640 1 -- 172.21.15.60:0/4032005441 wait complete. 2024-09-12T01:35:52.864 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:35:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.979+0000 7f726b3b0640 1 Processor -- start 2024-09-12T01:35:52.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.980+0000 7f726b3b0640 1 -- start start 2024-09-12T01:35:52.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.980+0000 7f726b3b0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f726415e660 0x7f72640cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.980+0000 7f726b3b0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72640d3310 0x7f72640d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.980+0000 7f726b3b0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f726415ea40 con 0x7f72640d1650 2024-09-12T01:35:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f726b3b0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f72640d1ac0 con 0x7f726415e660 2024-09-12T01:35:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f726b3b0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f72640d3870 con 0x7f72640d3310 2024-09-12T01:35:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f726894b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72640d3310 0x7f72640d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f726914c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f726415e660 0x7f72640cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f726894b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72640d3310 0x7f72640d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:57904/0 (socket says 172.21.15.60:57904) 2024-09-12T01:35:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f726914c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f726415e660 0x7f72640cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:52322/0 (socket says 172.21.15.60:52322) 2024-09-12T01:35:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f726894b640 1 -- 172.21.15.60:0/3657507986 learned_addr learned my addr 172.21.15.60:0/3657507986 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f726914c640 1 -- 172.21.15.60:0/3657507986 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72640d3310 msgr2=0x7f72640d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f726914c640 1 --2- 172.21.15.60:0/3657507986 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72640d3310 0x7f72640d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f726914c640 1 -- 172.21.15.60:0/3657507986 >> v1:172.21.15.105:6789/0 conn(0x7f72640d1650 legacy=0x7f726406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f725bfff640 1 -- 172.21.15.60:0/3657507986 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841117221 0 0) 0x7f726415ea40 con 0x7f72640d1650 2024-09-12T01:35:52.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f726914c640 1 -- 172.21.15.60:0/3657507986 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72640d3b50 con 0x7f726415e660 2024-09-12T01:35:52.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.981+0000 7f726894b640 1 --2- 172.21.15.60:0/3657507986 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72640d3310 0x7f72640d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:52.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.982+0000 7f726914c640 1 --2- 172.21.15.60:0/3657507986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f726415e660 0x7f72640cf730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72600097a0 tx=0x7f726002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc6997f6bf4cc4fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:52.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.982+0000 7f725bfff640 1 -- 172.21.15.60:0/3657507986 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260037070 con 0x7f726415e660 2024-09-12T01:35:52.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.982+0000 7f725bfff640 1 -- 172.21.15.60:0/3657507986 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7260032440 con 0x7f726415e660 2024-09-12T01:35:52.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.982+0000 7f725bfff640 1 -- 172.21.15.60:0/3657507986 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260032810 con 0x7f726415e660 2024-09-12T01:35:52.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.983+0000 7f726b3b0640 1 -- 172.21.15.60:0/3657507986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f726415e660 msgr2=0x7f72640cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.983+0000 7f726b3b0640 1 --2- 172.21.15.60:0/3657507986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f726415e660 0x7f72640cf730 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f72600097a0 tx=0x7f726002a180 comp rx=0 tx=0).stop 2024-09-12T01:35:52.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.983+0000 7f726b3b0640 1 -- 172.21.15.60:0/3657507986 shutdown_connections 2024-09-12T01:35:52.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.983+0000 7f726b3b0640 1 --2- 172.21.15.60:0/3657507986 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72640d3310 0x7f72640d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.983+0000 7f726b3b0640 1 --2- 172.21.15.60:0/3657507986 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f726415e660 0x7f72640cf730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.983+0000 7f726b3b0640 1 -- 172.21.15.60:0/3657507986 >> 172.21.15.60:0/3657507986 conn(0x7f72640b6410 msgr2=0x7f72640b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:52.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.983+0000 7f726b3b0640 1 -- 172.21.15.60:0/3657507986 shutdown_connections 2024-09-12T01:35:52.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.983+0000 7f726b3b0640 1 -- 172.21.15.60:0/3657507986 wait complete. 2024-09-12T01:35:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.984+0000 7f726b3b0640 1 Processor -- start 2024-09-12T01:35:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.984+0000 7f726b3b0640 1 -- start start 2024-09-12T01:35:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.985+0000 7f726b3b0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72640d1650 0x7f7264161640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.985+0000 7f726b3b0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72640d3310 0x7f7264151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.985+0000 7f726b3b0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f726415e660 0x7f726415ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.985+0000 7f726b3b0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f72640d43f0 con 0x7f72640d1650 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.985+0000 7f726b3b0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f72640d4110 con 0x7f72640d3310 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.985+0000 7f726b3b0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f72640cfc70 con 0x7f726415e660 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.985+0000 7f726914c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72640d1650 0x7f7264161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.985+0000 7f726914c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72640d1650 0x7f7264161640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33640/0 (socket says 172.21.15.60:33640) 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.985+0000 7f726914c640 1 -- 172.21.15.60:0/681962369 learned_addr learned my addr 172.21.15.60:0/681962369 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.985+0000 7f726994d640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f726415e660 0x7f726415ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.985+0000 7f726894b640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72640d3310 0x7f7264151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f726914c640 1 -- 172.21.15.60:0/681962369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f726415e660 msgr2=0x7f726415ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f726914c640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f726415e660 0x7f726415ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f726914c640 1 -- 172.21.15.60:0/681962369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72640d3310 msgr2=0x7f7264151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f726914c640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72640d3310 0x7f7264151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f726914c640 1 -- 172.21.15.60:0/681962369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72640cabe0 con 0x7f72640d1650 2024-09-12T01:35:52.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f726994d640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f726415e660 0x7f726415ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:52.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f726894b640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72640d3310 0x7f7264151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:52.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f726914c640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72640d1650 0x7f7264161640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72600097a0 tx=0x7f72600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:52.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f7259ffb640 1 -- 172.21.15.60:0/681962369 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260037050 con 0x7f72640d1650 2024-09-12T01:35:52.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f7259ffb640 1 -- 172.21.15.60:0/681962369 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7260038040 con 0x7f72640d1650 2024-09-12T01:35:52.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f726b3b0640 1 -- 172.21.15.60:0/681962369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f726415fab0 con 0x7f72640d1650 2024-09-12T01:35:52.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f7259ffb640 1 -- 172.21.15.60:0/681962369 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7260004490 con 0x7f72640d1650 2024-09-12T01:35:52.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.986+0000 7f726b3b0640 1 -- 172.21.15.60:0/681962369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72640c84d0 con 0x7f72640d1650 2024-09-12T01:35:52.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.987+0000 7f726b3b0640 1 -- 172.21.15.60:0/681962369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72640d1110 con 0x7f72640d1650 2024-09-12T01:35:52.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.988+0000 7f7259ffb640 1 -- 172.21.15.60:0/681962369 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f726003c6d0 con 0x7f72640d1650 2024-09-12T01:35:52.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.989+0000 7f7259ffb640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f724806be30 0x7f724806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:52.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.989+0000 7f726894b640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f724806be30 0x7f724806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:52.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.989+0000 7f7259ffb640 1 -- 172.21.15.60:0/681962369 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f72600ab540 con 0x7f72640d1650 2024-09-12T01:35:52.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.989+0000 7f726894b640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f724806be30 0x7f724806e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7254009630 tx=0x7f7254008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:52.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:52.993+0000 7f7259ffb640 1 -- 172.21.15.60:0/681962369 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f726007a230 con 0x7f72640d1650 2024-09-12T01:35:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.205+0000 7f726b3b0640 1 -- 172.21.15.60:0/681962369 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72640cb0c0 con 0x7f72640d1650 2024-09-12T01:35:53.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.205+0000 7f7259ffb640 1 -- 172.21.15.60:0/681962369 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3912 (secure 0 0 0) 0x7f7260079b30 con 0x7f72640d1650 2024-09-12T01:35:53.206 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:35:53.206 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":3,"btime":"2024-09-12T01:35:51:598828+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3216581844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3216581844},{"type":"v1","addr":"172.21.15.60:6836","nonce":3216581844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1706637770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1706637770},{"type":"v1","addr":"172.21.15.105:6833","nonce":1706637770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3645806076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3645806076},{"type":"v1","addr":"172.21.15.60:6837","nonce":3645806076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3695785914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3695785914},{"type":"v1","addr":"172.21.15.105:6835","nonce":3695785914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-12T01:35:53.206 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 3 2024-09-12T01:35:53.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.207+0000 7f726b3b0640 1 -- 172.21.15.60:0/681962369 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f724806be30 msgr2=0x7f724806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.207+0000 7f726b3b0640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f724806be30 0x7f724806e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7254009630 tx=0x7f7254008040 comp rx=0 tx=0).stop 2024-09-12T01:35:53.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.207+0000 7f726b3b0640 1 -- 172.21.15.60:0/681962369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72640d1650 msgr2=0x7f7264161640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.207+0000 7f726b3b0640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72640d1650 0x7f7264161640 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72600097a0 tx=0x7f72600046c0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.207+0000 7f726b3b0640 1 -- 172.21.15.60:0/681962369 shutdown_connections 2024-09-12T01:35:53.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.207+0000 7f726b3b0640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f724806be30 0x7f724806e2f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.207+0000 7f726b3b0640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f726415e660 0x7f726415ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.207+0000 7f726b3b0640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f72640d3310 0x7f7264151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.207+0000 7f726b3b0640 1 --2- 172.21.15.60:0/681962369 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72640d1650 0x7f7264161640 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.207+0000 7f726b3b0640 1 -- 172.21.15.60:0/681962369 >> 172.21.15.60:0/681962369 conn(0x7f72640b6410 msgr2=0x7f726415d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:53.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.208+0000 7f726b3b0640 1 -- 172.21.15.60:0/681962369 shutdown_connections 2024-09-12T01:35:53.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.208+0000 7f726b3b0640 1 -- 172.21.15.60:0/681962369 wait complete. 2024-09-12T01:35:53.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:35:53.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.320+0000 7fcccec5c640 1 Processor -- start 2024-09-12T01:35:53.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.320+0000 7fcccec5c640 1 -- start start 2024-09-12T01:35:53.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccec5c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fccc815c550 0x7fccc80715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccec5c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fccc8073160 0x7fccc8073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccec5c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccc80d0270 con 0x7fccc80b6e10 2024-09-12T01:35:53.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccec5c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fccc815c930 con 0x7fccc815c550 2024-09-12T01:35:53.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccec5c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fccc8073ad0 con 0x7fccc8073160 2024-09-12T01:35:53.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccc9f8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fccc815c550 0x7fccc80715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccc9f8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fccc815c550 0x7fccc80715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33652/0 (socket says 172.21.15.60:33652) 2024-09-12T01:35:53.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccc9f8640 1 -- 172.21.15.60:0/2300673213 learned_addr learned my addr 172.21.15.60:0/2300673213 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:53.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fccc7fff640 1 --1- 172.21.15.60:0/2300673213 >> v1:172.21.15.60:6789/0 conn(0x7fccc80b6e10 0x7fccc80b5540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57770/0 (socket says 172.21.15.60:57770) 2024-09-12T01:35:53.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccd1f9640 1 --2- 172.21.15.60:0/2300673213 >> v2:172.21.15.105:3300/0 conn(0x7fccc8073160 0x7fccc8073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccc9f8640 1 -- 172.21.15.60:0/2300673213 >> v2:172.21.15.105:3300/0 conn(0x7fccc8073160 msgr2=0x7fccc8073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:53.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccc9f8640 1 --2- 172.21.15.60:0/2300673213 >> v2:172.21.15.105:3300/0 conn(0x7fccc8073160 0x7fccc8073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccc9f8640 1 -- 172.21.15.60:0/2300673213 >> v1:172.21.15.60:6789/0 conn(0x7fccc80b6e10 legacy=0x7fccc80b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fcccc9f8640 1 -- 172.21.15.60:0/2300673213 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc80d04f0 con 0x7fccc815c550 2024-09-12T01:35:53.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.321+0000 7fccc77fe640 1 -- 172.21.15.60:0/2300673213 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2448520503 0 0) 0x7fccbc001110 con 0x7fccc80b6e10 2024-09-12T01:35:53.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.322+0000 7fcccc9f8640 1 --2- 172.21.15.60:0/2300673213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccc815c550 0x7fccc80715e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fccc8072d90 tx=0x7fccc002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e2851e9f9ad467 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:53.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.322+0000 7fccc77fe640 1 -- 172.21.15.60:0/2300673213 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0036070 con 0x7fccc815c550 2024-09-12T01:35:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.322+0000 7fccc77fe640 1 -- 172.21.15.60:0/2300673213 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc0031600 con 0x7fccc815c550 2024-09-12T01:35:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.322+0000 7fccc77fe640 1 -- 172.21.15.60:0/2300673213 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc00319d0 con 0x7fccc815c550 2024-09-12T01:35:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.323+0000 7fcccec5c640 1 -- 172.21.15.60:0/2300673213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccc815c550 msgr2=0x7fccc80715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.323+0000 7fcccec5c640 1 --2- 172.21.15.60:0/2300673213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccc815c550 0x7fccc80715e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fccc8072d90 tx=0x7fccc002a730 comp rx=0 tx=0).stop 2024-09-12T01:35:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.323+0000 7fcccec5c640 1 -- 172.21.15.60:0/2300673213 shutdown_connections 2024-09-12T01:35:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.323+0000 7fcccec5c640 1 --2- 172.21.15.60:0/2300673213 >> v2:172.21.15.105:3300/0 conn(0x7fccc8073160 0x7fccc8073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.323+0000 7fcccec5c640 1 --2- 172.21.15.60:0/2300673213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccc815c550 0x7fccc80715e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.323+0000 7fcccec5c640 1 -- 172.21.15.60:0/2300673213 >> 172.21.15.60:0/2300673213 conn(0x7fccc80b4240 msgr2=0x7fccc80b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.323+0000 7fcccec5c640 1 -- 172.21.15.60:0/2300673213 shutdown_connections 2024-09-12T01:35:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.323+0000 7fcccec5c640 1 -- 172.21.15.60:0/2300673213 wait complete. 2024-09-12T01:35:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.324+0000 7fcccec5c640 1 Processor -- start 2024-09-12T01:35:53.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.324+0000 7fcccec5c640 1 -- start start 2024-09-12T01:35:53.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccec5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccc8073160 0x7fccc814d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccec5c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccc80b6e10 0x7fccc806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccec5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccc815c550 0x7fccc806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccec5c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fccc80d07b0 con 0x7fccc8073160 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccec5c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fccc80b7860 con 0x7fccc80b6e10 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccec5c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fccc80b7280 con 0x7fccc815c550 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccc9f8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccc8073160 0x7fccc814d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccc9f8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccc8073160 0x7fccc814d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33658/0 (socket says 172.21.15.60:33658) 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccc9f8640 1 -- 172.21.15.60:0/1853571884 learned_addr learned my addr 172.21.15.60:0/1853571884 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fccc7fff640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccc80b6e10 0x7fccc806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccd1f9640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccc815c550 0x7fccc806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccc9f8640 1 -- 172.21.15.60:0/1853571884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccc815c550 msgr2=0x7fccc806d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccc9f8640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccc815c550 0x7fccc806d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccc9f8640 1 -- 172.21.15.60:0/1853571884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccc80b6e10 msgr2=0x7fccc806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccc9f8640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccc80b6e10 0x7fccc806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.325+0000 7fcccc9f8640 1 -- 172.21.15.60:0/1853571884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc80b0930 con 0x7fccc8073160 2024-09-12T01:35:53.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.326+0000 7fcccc9f8640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccc8073160 0x7fccc814d370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fccc0000f80 tx=0x7fccc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:53.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.326+0000 7fccc57fa640 1 -- 172.21.15.60:0/1853571884 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0036050 con 0x7fccc8073160 2024-09-12T01:35:53.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.326+0000 7fccc57fa640 1 -- 172.21.15.60:0/1853571884 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc0042070 con 0x7fccc8073160 2024-09-12T01:35:53.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.326+0000 7fccc57fa640 1 -- 172.21.15.60:0/1853571884 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc0009510 con 0x7fccc8073160 2024-09-12T01:35:53.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.326+0000 7fcccec5c640 1 -- 172.21.15.60:0/1853571884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc80b1010 con 0x7fccc8073160 2024-09-12T01:35:53.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.326+0000 7fcccec5c640 1 -- 172.21.15.60:0/1853571884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc814d8b0 con 0x7fccc8073160 2024-09-12T01:35:53.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.327+0000 7fcccec5c640 1 -- 172.21.15.60:0/1853571884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc8073590 con 0x7fccc8073160 2024-09-12T01:35:53.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.327+0000 7fccc57fa640 1 -- 172.21.15.60:0/1853571884 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fccc0007c70 con 0x7fccc8073160 2024-09-12T01:35:53.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.328+0000 7fccc57fa640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fccb406be60 0x7fccb406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.328+0000 7fccc57fa640 1 -- 172.21.15.60:0/1853571884 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fccc00ab8a0 con 0x7fccc8073160 2024-09-12T01:35:53.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.328+0000 7fccc7fff640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fccb406be60 0x7fccb406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.328+0000 7fccc7fff640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fccb406be60 0x7fccb406e320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fccc815b7e0 tx=0x7fccbc007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:53.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.332+0000 7fccc57fa640 1 -- 172.21.15.60:0/1853571884 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fccc007a100 con 0x7fccc8073160 2024-09-12T01:35:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.508+0000 7fcccec5c640 1 -- 172.21.15.60:0/1853571884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fccc8070fd0 con 0x7fccc8073160 2024-09-12T01:35:53.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.509+0000 7fccc57fa640 1 -- 172.21.15.60:0/1853571884 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7fccc007e400 con 0x7fccc8073160 2024-09-12T01:35:53.509 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:35:53.509 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T01:35:53.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:35:53.509 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T01:35:53.510 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T01:35:53.510 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:35:53.510 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T01:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.510+0000 7fcccec5c640 1 -- 172.21.15.60:0/1853571884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fccb406be60 msgr2=0x7fccb406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.510+0000 7fcccec5c640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fccb406be60 0x7fccb406e320 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fccc815b7e0 tx=0x7fccbc007b50 comp rx=0 tx=0).stop 2024-09-12T01:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.510+0000 7fcccec5c640 1 -- 172.21.15.60:0/1853571884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccc8073160 msgr2=0x7fccc814d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.511+0000 7fcccec5c640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccc8073160 0x7fccc814d370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fccc0000f80 tx=0x7fccc0004a40 comp rx=0 tx=0).stop 2024-09-12T01:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.511+0000 7fcccec5c640 1 -- 172.21.15.60:0/1853571884 shutdown_connections 2024-09-12T01:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.511+0000 7fcccec5c640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fccb406be60 0x7fccb406e320 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.511+0000 7fcccec5c640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccc815c550 0x7fccc806d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.511+0000 7fcccec5c640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccc80b6e10 0x7fccc806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.511+0000 7fcccec5c640 1 --2- 172.21.15.60:0/1853571884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccc8073160 0x7fccc814d370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.511+0000 7fcccec5c640 1 -- 172.21.15.60:0/1853571884 >> 172.21.15.60:0/1853571884 conn(0x7fccc80b4240 msgr2=0x7fccc80b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:53.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.511+0000 7fcccec5c640 1 -- 172.21.15.60:0/1853571884 shutdown_connections 2024-09-12T01:35:53.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.511+0000 7fcccec5c640 1 -- 172.21.15.60:0/1853571884 wait complete. 2024-09-12T01:35:53.521 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:35:53.522 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:35:53.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.628+0000 7f9821ae6640 1 Processor -- start 2024-09-12T01:35:53.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.628+0000 7f9821ae6640 1 -- start start 2024-09-12T01:35:53.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f9821ae6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f981c15e990 0x7f981c0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f9821ae6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f981c162450 0x7f981c162890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f9821ae6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f981c162dd0 0x7f981c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f9821ae6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f981c0cff20 con 0x7f981c162dd0 2024-09-12T01:35:53.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f9821ae6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f981c15ed70 con 0x7f981c15e990 2024-09-12T01:35:53.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f9821ae6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f981c163280 con 0x7f981c162450 2024-09-12T01:35:53.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f981bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f981c162dd0 0x7f981c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f981bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f981c162dd0 0x7f981c0b6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33668/0 (socket says 172.21.15.60:33668) 2024-09-12T01:35:53.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f981bfff640 1 -- 172.21.15.60:0/1858217675 learned_addr learned my addr 172.21.15.60:0/1858217675 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:53.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f981affd640 1 --2- 172.21.15.60:0/1858217675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f981c162450 0x7f981c162890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f981b7fe640 1 --2- 172.21.15.60:0/1858217675 >> v2:172.21.15.105:3300/0 conn(0x7f981c15e990 0x7f981c0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f981bfff640 1 -- 172.21.15.60:0/1858217675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f981c162450 msgr2=0x7f981c162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f981bfff640 1 --2- 172.21.15.60:0/1858217675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f981c162450 0x7f981c162890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f981bfff640 1 -- 172.21.15.60:0/1858217675 >> v2:172.21.15.105:3300/0 conn(0x7f981c15e990 msgr2=0x7f981c0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f981bfff640 1 --2- 172.21.15.60:0/1858217675 >> v2:172.21.15.105:3300/0 conn(0x7f981c15e990 0x7f981c0b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.629+0000 7f981bfff640 1 -- 172.21.15.60:0/1858217675 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c0d1fa0 con 0x7f981c162dd0 2024-09-12T01:35:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.630+0000 7f981bfff640 1 --2- 172.21.15.60:0/1858217675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f981c162dd0 0x7f981c0b6200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f981c074330 tx=0x7f981402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3fa0a6639d06a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.630+0000 7f981a7fc640 1 -- 172.21.15.60:0/1858217675 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814036070 con 0x7f981c162dd0 2024-09-12T01:35:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.630+0000 7f981a7fc640 1 -- 172.21.15.60:0/1858217675 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9814031600 con 0x7f981c162dd0 2024-09-12T01:35:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.630+0000 7f981a7fc640 1 -- 172.21.15.60:0/1858217675 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98140319d0 con 0x7f981c162dd0 2024-09-12T01:35:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.631+0000 7f9821ae6640 1 -- 172.21.15.60:0/1858217675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f981c162dd0 msgr2=0x7f981c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.631+0000 7f9821ae6640 1 --2- 172.21.15.60:0/1858217675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f981c162dd0 0x7f981c0b6200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f981c074330 tx=0x7f981402a610 comp rx=0 tx=0).stop 2024-09-12T01:35:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.631+0000 7f9821ae6640 1 -- 172.21.15.60:0/1858217675 shutdown_connections 2024-09-12T01:35:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.631+0000 7f9821ae6640 1 --2- 172.21.15.60:0/1858217675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f981c162dd0 0x7f981c0b6200 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.631+0000 7f9821ae6640 1 --2- 172.21.15.60:0/1858217675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f981c162450 0x7f981c162890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.631+0000 7f9821ae6640 1 --2- 172.21.15.60:0/1858217675 >> v2:172.21.15.105:3300/0 conn(0x7f981c15e990 0x7f981c0b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.631+0000 7f9821ae6640 1 -- 172.21.15.60:0/1858217675 >> 172.21.15.60:0/1858217675 conn(0x7f981c0d1200 msgr2=0x7f981c0d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.631+0000 7f9821ae6640 1 -- 172.21.15.60:0/1858217675 shutdown_connections 2024-09-12T01:35:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.631+0000 7f9821ae6640 1 -- 172.21.15.60:0/1858217675 wait complete. 2024-09-12T01:35:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.632+0000 7f9821ae6640 1 Processor -- start 2024-09-12T01:35:53.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.632+0000 7f9821ae6640 1 -- start start 2024-09-12T01:35:53.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f9821ae6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f981c15e990 0x7f981c14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f9821ae6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f981c162450 0x7f981c1f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f9821ae6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f981c162dd0 0x7f981c14fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f9821ae6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f981c0b6740 con 0x7f981c162450 2024-09-12T01:35:53.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f9821ae6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f981c0cfc40 con 0x7f981c15e990 2024-09-12T01:35:53.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f9821ae6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f981c0b68c0 con 0x7f981c162dd0 2024-09-12T01:35:53.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f981affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f981c162450 0x7f981c1f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f981affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f981c162450 0x7f981c1f7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33678/0 (socket says 172.21.15.60:33678) 2024-09-12T01:35:53.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f981affd640 1 -- 172.21.15.60:0/332171979 learned_addr learned my addr 172.21.15.60:0/332171979 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:53.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f981b7fe640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f981c15e990 0x7f981c14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f981bfff640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f981c162dd0 0x7f981c14fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f981affd640 1 -- 172.21.15.60:0/332171979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f981c162dd0 msgr2=0x7f981c14fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f981affd640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f981c162dd0 0x7f981c14fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f981affd640 1 -- 172.21.15.60:0/332171979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f981c15e990 msgr2=0x7f981c14d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f981affd640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f981c15e990 0x7f981c14d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.633+0000 7f981affd640 1 -- 172.21.15.60:0/332171979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c1507d0 con 0x7f981c162450 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.634+0000 7f981affd640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f981c162450 0x7f981c1f7cb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f981000d7d0 tx=0x7f981000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.634+0000 7f9803fff640 1 -- 172.21.15.60:0/332171979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810004020 con 0x7f981c162450 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.634+0000 7f9803fff640 1 -- 172.21.15.60:0/332171979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98100041e0 con 0x7f981c162450 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.634+0000 7f9821ae6640 1 -- 172.21.15.60:0/332171979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981c0cc9a0 con 0x7f981c162450 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.634+0000 7f9803fff640 1 -- 172.21.15.60:0/332171979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98100043d0 con 0x7f981c162450 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.634+0000 7f9821ae6640 1 -- 172.21.15.60:0/332171979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981c0cd1e0 con 0x7f981c162450 2024-09-12T01:35:53.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.635+0000 7f9821ae6640 1 -- 172.21.15.60:0/332171979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981c162890 con 0x7f981c162450 2024-09-12T01:35:53.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.635+0000 7f9803fff640 1 -- 172.21.15.60:0/332171979 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f981001b020 con 0x7f981c162450 2024-09-12T01:35:53.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.636+0000 7f9803fff640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f980806be30 0x7f980806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:53.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.636+0000 7f9803fff640 1 -- 172.21.15.60:0/332171979 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f981008a7f0 con 0x7f981c162450 2024-09-12T01:35:53.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.636+0000 7f981b7fe640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f980806be30 0x7f980806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:53.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.636+0000 7f981b7fe640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f980806be30 0x7f980806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f980c006fd0 tx=0x7f980c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:53.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.640+0000 7f9803fff640 1 -- 172.21.15.60:0/332171979 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f981c0cc9a0 con 0x7f981c162450 2024-09-12T01:35:53.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:53.815+0000 7f9821ae6640 1 -- 172.21.15.60:0/332171979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f981c0ba700 con 0x7f981c162450 2024-09-12T01:35:54.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.609+0000 7f9803fff640 1 -- 172.21.15.60:0/332171979 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f9810058ea0 con 0x7f981c162450 2024-09-12T01:35:54.610 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-12T01:35:54.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.612+0000 7f9821ae6640 1 -- 172.21.15.60:0/332171979 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f980806be30 msgr2=0x7f980806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:54.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.612+0000 7f9821ae6640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f980806be30 0x7f980806e2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f980c006fd0 tx=0x7f980c008040 comp rx=0 tx=0).stop 2024-09-12T01:35:54.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.612+0000 7f9821ae6640 1 -- 172.21.15.60:0/332171979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f981c162450 msgr2=0x7f981c1f7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:54.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.612+0000 7f9821ae6640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f981c162450 0x7f981c1f7cb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f981000d7d0 tx=0x7f981000dc90 comp rx=0 tx=0).stop 2024-09-12T01:35:54.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.612+0000 7f9821ae6640 1 -- 172.21.15.60:0/332171979 shutdown_connections 2024-09-12T01:35:54.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.612+0000 7f9821ae6640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f980806be30 0x7f980806e2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:54.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.612+0000 7f9821ae6640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f981c162dd0 0x7f981c14fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:54.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.612+0000 7f9821ae6640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f981c162450 0x7f981c1f7cb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:54.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.612+0000 7f9821ae6640 1 --2- 172.21.15.60:0/332171979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f981c15e990 0x7f981c14d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:54.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.612+0000 7f9821ae6640 1 -- 172.21.15.60:0/332171979 >> 172.21.15.60:0/332171979 conn(0x7f981c0d1200 msgr2=0x7f981c160f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:54.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.613+0000 7f9821ae6640 1 -- 172.21.15.60:0/332171979 shutdown_connections 2024-09-12T01:35:54.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.613+0000 7f9821ae6640 1 -- 172.21.15.60:0/332171979 wait complete. 2024-09-12T01:35:54.630 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:35:54.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.744+0000 7fb5f6c82640 1 Processor -- start 2024-09-12T01:35:54.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.744+0000 7fb5f6c82640 1 -- start start 2024-09-12T01:35:54.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.745+0000 7fb5f6c82640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb5f015e940 0x7fb5f00b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:54.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.745+0000 7fb5f6c82640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5f00ba440 0x7fb5f00b6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:54.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.745+0000 7fb5f6c82640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5f015ed20 con 0x7fb5f00d2290 2024-09-12T01:35:54.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.745+0000 7fb5f6c82640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb5f00d3ef0 con 0x7fb5f015e940 2024-09-12T01:35:54.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.745+0000 7fb5f6c82640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f00d32e0 con 0x7fb5f00ba440 2024-09-12T01:35:54.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.746+0000 7fb5effff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5f00ba440 0x7fb5f00b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:54.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.746+0000 7fb5f4a1e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb5f015e940 0x7fb5f00b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:54.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.746+0000 7fb5f4a1e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb5f015e940 0x7fb5f00b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:52372/0 (socket says 172.21.15.60:52372) 2024-09-12T01:35:54.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.746+0000 7fb5effff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5f00ba440 0x7fb5f00b6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:57950/0 (socket says 172.21.15.60:57950) 2024-09-12T01:35:54.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.746+0000 7fb5f4a1e640 1 -- 172.21.15.60:0/686518674 learned_addr learned my addr 172.21.15.60:0/686518674 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:54.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.746+0000 7fb5f521f640 1 --1- 172.21.15.60:0/686518674 >> v1:172.21.15.105:6789/0 conn(0x7fb5f00d2290 0x7fb5f00cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:52976/0 (socket says 172.21.15.60:52976) 2024-09-12T01:35:54.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.746+0000 7fb5f4a1e640 1 -- 172.21.15.60:0/686518674 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5f00ba440 msgr2=0x7fb5f00b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:54.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.746+0000 7fb5f4a1e640 1 --2- 172.21.15.60:0/686518674 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5f00ba440 0x7fb5f00b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:54.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.746+0000 7fb5f4a1e640 1 -- 172.21.15.60:0/686518674 >> v1:172.21.15.105:6789/0 conn(0x7fb5f00d2290 legacy=0x7fb5f00cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:54.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.746+0000 7fb5f4a1e640 1 -- 172.21.15.60:0/686518674 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f00d35c0 con 0x7fb5f015e940 2024-09-12T01:35:54.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.746+0000 7fb5effff640 1 --2- 172.21.15.60:0/686518674 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5f00ba440 0x7fb5f00b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:54.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.747+0000 7fb5f4a1e640 1 --2- 172.21.15.60:0/686518674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5f015e940 0x7fb5f00b6140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009870 tx=0x7fb5e002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccde1cbb60eba355 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:54.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.747+0000 7fb5ef7fe640 1 -- 172.21.15.60:0/686518674 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0037070 con 0x7fb5f015e940 2024-09-12T01:35:54.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.747+0000 7fb5ef7fe640 1 -- 172.21.15.60:0/686518674 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e0032440 con 0x7fb5f015e940 2024-09-12T01:35:54.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.747+0000 7fb5ef7fe640 1 -- 172.21.15.60:0/686518674 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0032810 con 0x7fb5f015e940 2024-09-12T01:35:54.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.747+0000 7fb5f6c82640 1 -- 172.21.15.60:0/686518674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5f015e940 msgr2=0x7fb5f00b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:54.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.747+0000 7fb5f6c82640 1 --2- 172.21.15.60:0/686518674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5f015e940 0x7fb5f00b6140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009870 tx=0x7fb5e002a1c0 comp rx=0 tx=0).stop 2024-09-12T01:35:54.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.748+0000 7fb5f6c82640 1 -- 172.21.15.60:0/686518674 shutdown_connections 2024-09-12T01:35:54.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.748+0000 7fb5f6c82640 1 --2- 172.21.15.60:0/686518674 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5f00ba440 0x7fb5f00b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:54.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.748+0000 7fb5f6c82640 1 --2- 172.21.15.60:0/686518674 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5f015e940 0x7fb5f00b6140 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:54.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.748+0000 7fb5f6c82640 1 -- 172.21.15.60:0/686518674 >> 172.21.15.60:0/686518674 conn(0x7fb5f00d1140 msgr2=0x7fb5f00d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:54.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.748+0000 7fb5f6c82640 1 -- 172.21.15.60:0/686518674 shutdown_connections 2024-09-12T01:35:54.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.748+0000 7fb5f6c82640 1 -- 172.21.15.60:0/686518674 wait complete. 2024-09-12T01:35:54.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.749+0000 7fb5f6c82640 1 Processor -- start 2024-09-12T01:35:54.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.749+0000 7fb5f6c82640 1 -- start start 2024-09-12T01:35:54.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f6c82640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f00ba440 0x7fb5f00cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:54.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f6c82640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5f00d2290 0x7fb5f00c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:54.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f6c82640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5f015e940 0x7fb5f00c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:54.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f6c82640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f00b7510 con 0x7fb5f00ba440 2024-09-12T01:35:54.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f6c82640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f00d3b80 con 0x7fb5f015e940 2024-09-12T01:35:54.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f6c82640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f00b8bb0 con 0x7fb5f00d2290 2024-09-12T01:35:54.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f4a1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f00ba440 0x7fb5f00cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f4a1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f00ba440 0x7fb5f00cf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33692/0 (socket says 172.21.15.60:33692) 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f4a1e640 1 -- 172.21.15.60:0/2753508851 learned_addr learned my addr 172.21.15.60:0/2753508851 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5effff640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5f00d2290 0x7fb5f00c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f521f640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5f015e940 0x7fb5f00c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f4a1e640 1 -- 172.21.15.60:0/2753508851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5f00d2290 msgr2=0x7fb5f00c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f4a1e640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5f00d2290 0x7fb5f00c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f4a1e640 1 -- 172.21.15.60:0/2753508851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5f015e940 msgr2=0x7fb5f00c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f4a1e640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5f015e940 0x7fb5f00c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f4a1e640 1 -- 172.21.15.60:0/2753508851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f00c8370 con 0x7fb5f00ba440 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f521f640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5f015e940 0x7fb5f00c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.750+0000 7fb5f4a1e640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f00ba440 0x7fb5f00cf270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009870 tx=0x7fb5e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.751+0000 7fb5ed7fa640 1 -- 172.21.15.60:0/2753508851 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0041020 con 0x7fb5f00ba440 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.751+0000 7fb5ed7fa640 1 -- 172.21.15.60:0/2753508851 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5e0030640 con 0x7fb5f00ba440 2024-09-12T01:35:54.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.751+0000 7fb5ed7fa640 1 -- 172.21.15.60:0/2753508851 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0037040 con 0x7fb5f00ba440 2024-09-12T01:35:54.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.751+0000 7fb5f6c82640 1 -- 172.21.15.60:0/2753508851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f00c8650 con 0x7fb5f00ba440 2024-09-12T01:35:54.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.751+0000 7fb5f6c82640 1 -- 172.21.15.60:0/2753508851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f00c8c10 con 0x7fb5f00ba440 2024-09-12T01:35:54.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.752+0000 7fb5f6c82640 1 -- 172.21.15.60:0/2753508851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5f00b6140 con 0x7fb5f00ba440 2024-09-12T01:35:54.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.752+0000 7fb5ed7fa640 1 -- 172.21.15.60:0/2753508851 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5e0044020 con 0x7fb5f00ba440 2024-09-12T01:35:54.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.753+0000 7fb5ed7fa640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb5dc06be30 0x7fb5dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:54.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.753+0000 7fb5ed7fa640 1 -- 172.21.15.60:0/2753508851 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7fb5e00ab2d0 con 0x7fb5f00ba440 2024-09-12T01:35:54.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.753+0000 7fb5effff640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb5dc06be30 0x7fb5dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:54.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.753+0000 7fb5effff640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb5dc06be30 0x7fb5dc06e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009560 tx=0x7fb5e4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:54.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.757+0000 7fb5ed7fa640 1 -- 172.21.15.60:0/2753508851 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5e004b030 con 0x7fb5f00ba440 2024-09-12T01:35:54.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:54.934+0000 7fb5f6c82640 1 -- 172.21.15.60:0/2753508851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb5f00693c0 con 0x7fb5f00ba440 2024-09-12T01:35:55.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.612+0000 7fb5ed7fa640 1 -- 172.21.15.60:0/2753508851 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7fb5e007a010 con 0x7fb5f00ba440 2024-09-12T01:35:55.612 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-12T01:35:55.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.616+0000 7fb5f6c82640 1 -- 172.21.15.60:0/2753508851 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb5dc06be30 msgr2=0x7fb5dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.616+0000 7fb5f6c82640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb5dc06be30 0x7fb5dc06e2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009560 tx=0x7fb5e4009190 comp rx=0 tx=0).stop 2024-09-12T01:35:55.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.616+0000 7fb5f6c82640 1 -- 172.21.15.60:0/2753508851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f00ba440 msgr2=0x7fb5f00cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.616+0000 7fb5f6c82640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f00ba440 0x7fb5f00cf270 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009870 tx=0x7fb5e00046c0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.617+0000 7fb5f6c82640 1 -- 172.21.15.60:0/2753508851 shutdown_connections 2024-09-12T01:35:55.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.617+0000 7fb5f6c82640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5f015e940 0x7fb5f00c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.617+0000 7fb5f6c82640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb5dc06be30 0x7fb5dc06e2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.617+0000 7fb5f6c82640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5f00d2290 0x7fb5f00c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.617+0000 7fb5f6c82640 1 --2- 172.21.15.60:0/2753508851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5f00ba440 0x7fb5f00cf270 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.618+0000 7fb5f6c82640 1 -- 172.21.15.60:0/2753508851 >> 172.21.15.60:0/2753508851 conn(0x7fb5f00d1140 msgr2=0x7fb5f00b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:55.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.625+0000 7fb5f6c82640 1 -- 172.21.15.60:0/2753508851 shutdown_connections 2024-09-12T01:35:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.630+0000 7fb5f6c82640 1 -- 172.21.15.60:0/2753508851 wait complete. 2024-09-12T01:35:55.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:35:55.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.759+0000 7fd9bae17640 1 Processor -- start 2024-09-12T01:35:55.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.759+0000 7fd9bae17640 1 -- start start 2024-09-12T01:35:55.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.760+0000 7fd9bae17640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd9b415c0f0 0x7fd9b40739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.760+0000 7fd9bae17640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd9b406c320 0x7fd9b406f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.760+0000 7fd9bae17640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9b415c4d0 con 0x7fd9b4073f10 2024-09-12T01:35:55.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.760+0000 7fd9bae17640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b415ee60 con 0x7fd9b415c0f0 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.760+0000 7fd9bae17640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd9b415f140 con 0x7fd9b406c320 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.760+0000 7fd9b8bb3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd9b415c0f0 0x7fd9b40739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.760+0000 7fd9b8bb3640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd9b415c0f0 0x7fd9b40739d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33704/0 (socket says 172.21.15.60:33704) 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.760+0000 7fd9b8bb3640 1 -- 172.21.15.60:0/460392468 learned_addr learned my addr 172.21.15.60:0/460392468 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.760+0000 7fd9b93b4640 1 --2- 172.21.15.60:0/460392468 >> v2:172.21.15.105:3300/0 conn(0x7fd9b406c320 0x7fd9b406f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.761+0000 7fd9b8bb3640 1 -- 172.21.15.60:0/460392468 >> v2:172.21.15.105:3300/0 conn(0x7fd9b406c320 msgr2=0x7fd9b406f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.761+0000 7fd9b8bb3640 1 --2- 172.21.15.60:0/460392468 >> v2:172.21.15.105:3300/0 conn(0x7fd9b406c320 0x7fd9b406f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.761+0000 7fd9b8bb3640 1 -- 172.21.15.60:0/460392468 >> v1:172.21.15.105:6789/0 conn(0x7fd9b4073f10 legacy=0x7fd9b406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.761+0000 7fd9b8bb3640 1 -- 172.21.15.60:0/460392468 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b415f420 con 0x7fd9b415c0f0 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.761+0000 7fd9b8bb3640 1 --2- 172.21.15.60:0/460392468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b415c0f0 0x7fd9b40739d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd9b415fc20 tx=0x7fd9ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a939ef7f9059b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.761+0000 7fd9b37fe640 1 -- 172.21.15.60:0/460392468 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac037070 con 0x7fd9b415c0f0 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.762+0000 7fd9b37fe640 1 -- 172.21.15.60:0/460392468 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9ac032440 con 0x7fd9b415c0f0 2024-09-12T01:35:55.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.762+0000 7fd9b37fe640 1 -- 172.21.15.60:0/460392468 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac032810 con 0x7fd9b415c0f0 2024-09-12T01:35:55.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.762+0000 7fd9bae17640 1 -- 172.21.15.60:0/460392468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b415c0f0 msgr2=0x7fd9b40739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.762+0000 7fd9bae17640 1 --2- 172.21.15.60:0/460392468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b415c0f0 0x7fd9b40739d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd9b415fc20 tx=0x7fd9ac02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.762+0000 7fd9bae17640 1 -- 172.21.15.60:0/460392468 shutdown_connections 2024-09-12T01:35:55.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.762+0000 7fd9bae17640 1 --2- 172.21.15.60:0/460392468 >> v2:172.21.15.105:3300/0 conn(0x7fd9b406c320 0x7fd9b406f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.762+0000 7fd9bae17640 1 --2- 172.21.15.60:0/460392468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b415c0f0 0x7fd9b40739d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.762+0000 7fd9bae17640 1 -- 172.21.15.60:0/460392468 >> 172.21.15.60:0/460392468 conn(0x7fd9b40d1390 msgr2=0x7fd9b40d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:55.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.762+0000 7fd9bae17640 1 -- 172.21.15.60:0/460392468 shutdown_connections 2024-09-12T01:35:55.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.762+0000 7fd9bae17640 1 -- 172.21.15.60:0/460392468 wait complete. 2024-09-12T01:35:55.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.763+0000 7fd9bae17640 1 Processor -- start 2024-09-12T01:35:55.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.763+0000 7fd9bae17640 1 -- start start 2024-09-12T01:35:55.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.764+0000 7fd9bae17640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b406c320 0x7fd9b41f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.764+0000 7fd9bae17640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9b4073f10 0x7fd9b40c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.764+0000 7fd9bae17640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9b415c0f0 0x7fd9b40c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.764+0000 7fd9bae17640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b4072070 con 0x7fd9b406c320 2024-09-12T01:35:55.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.764+0000 7fd9bae17640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9b4071ef0 con 0x7fd9b415c0f0 2024-09-12T01:35:55.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.764+0000 7fd9bae17640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9b40b0ba0 con 0x7fd9b4073f10 2024-09-12T01:35:55.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.764+0000 7fd9b8bb3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b406c320 0x7fd9b41f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.764+0000 7fd9b8bb3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b406c320 0x7fd9b41f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33718/0 (socket says 172.21.15.60:33718) 2024-09-12T01:35:55.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.764+0000 7fd9b8bb3640 1 -- 172.21.15.60:0/1651336086 learned_addr learned my addr 172.21.15.60:0/1651336086 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:55.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.764+0000 7fd9b93b4640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9b415c0f0 0x7fd9b40c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.764+0000 7fd9b3fff640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9b4073f10 0x7fd9b40c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.765+0000 7fd9b8bb3640 1 -- 172.21.15.60:0/1651336086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9b4073f10 msgr2=0x7fd9b40c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.765+0000 7fd9b8bb3640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9b4073f10 0x7fd9b40c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.765+0000 7fd9b8bb3640 1 -- 172.21.15.60:0/1651336086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9b415c0f0 msgr2=0x7fd9b40c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:55.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.765+0000 7fd9b8bb3640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9b415c0f0 0x7fd9b40c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:55.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.765+0000 7fd9b8bb3640 1 -- 172.21.15.60:0/1651336086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9b40cf5d0 con 0x7fd9b406c320 2024-09-12T01:35:55.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.765+0000 7fd9b8bb3640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b406c320 0x7fd9b41f4b00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac000c00 tx=0x7fd9ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:55.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.765+0000 7fd9b17fa640 1 -- 172.21.15.60:0/1651336086 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac041020 con 0x7fd9b406c320 2024-09-12T01:35:55.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.765+0000 7fd9b17fa640 1 -- 172.21.15.60:0/1651336086 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9ac0306c0 con 0x7fd9b406c320 2024-09-12T01:35:55.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.765+0000 7fd9bae17640 1 -- 172.21.15.60:0/1651336086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9b40cf870 con 0x7fd9b406c320 2024-09-12T01:35:55.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.765+0000 7fd9b17fa640 1 -- 172.21.15.60:0/1651336086 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac037040 con 0x7fd9b406c320 2024-09-12T01:35:55.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.765+0000 7fd9bae17640 1 -- 172.21.15.60:0/1651336086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9b40c7720 con 0x7fd9b406c320 2024-09-12T01:35:55.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.766+0000 7fd9bae17640 1 -- 172.21.15.60:0/1651336086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b40739d0 con 0x7fd9b406c320 2024-09-12T01:35:55.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.767+0000 7fd9b17fa640 1 -- 172.21.15.60:0/1651336086 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9ac044020 con 0x7fd9b406c320 2024-09-12T01:35:55.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.767+0000 7fd9b17fa640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd99406be30 0x7fd99406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:55.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.767+0000 7fd9b17fa640 1 -- 172.21.15.60:0/1651336086 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7fd9ac0ab500 con 0x7fd9b406c320 2024-09-12T01:35:55.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.767+0000 7fd9b3fff640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd99406be30 0x7fd99406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:55.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.768+0000 7fd9b3fff640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd99406be30 0x7fd99406e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40cf270 tx=0x7fd9a4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:55.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.772+0000 7fd9b17fa640 1 -- 172.21.15.60:0/1651336086 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9ac04b030 con 0x7fd9b406c320 2024-09-12T01:35:55.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:55.982+0000 7fd9bae17640 1 -- 172.21.15.60:0/1651336086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd9b4072470 con 0x7fd9b406c320 2024-09-12T01:35:56.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.637+0000 7fd9b17fa640 1 -- 172.21.15.60:0/1651336086 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fd9ac0798c0 con 0x7fd9b406c320 2024-09-12T01:35:56.645 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 2 and data pool 3 2024-09-12T01:35:56.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.651+0000 7fd9bae17640 1 -- 172.21.15.60:0/1651336086 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd99406be30 msgr2=0x7fd99406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.652+0000 7fd9bae17640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd99406be30 0x7fd99406e2f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd9b40cf270 tx=0x7fd9a4009040 comp rx=0 tx=0).stop 2024-09-12T01:35:56.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.652+0000 7fd9bae17640 1 -- 172.21.15.60:0/1651336086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b406c320 msgr2=0x7fd9b41f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.652+0000 7fd9bae17640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b406c320 0x7fd9b41f4b00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac000c00 tx=0x7fd9ac0046c0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.652+0000 7fd9bae17640 1 -- 172.21.15.60:0/1651336086 shutdown_connections 2024-09-12T01:35:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.652+0000 7fd9bae17640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9b415c0f0 0x7fd9b40c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.652+0000 7fd9bae17640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd99406be30 0x7fd99406e2f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.652+0000 7fd9bae17640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9b4073f10 0x7fd9b40c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.652+0000 7fd9bae17640 1 --2- 172.21.15.60:0/1651336086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9b406c320 0x7fd9b41f4b00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.652+0000 7fd9bae17640 1 -- 172.21.15.60:0/1651336086 >> 172.21.15.60:0/1651336086 conn(0x7fd9b40d1390 msgr2=0x7fd9b40b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.652+0000 7fd9bae17640 1 -- 172.21.15.60:0/1651336086 shutdown_connections 2024-09-12T01:35:56.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.652+0000 7fd9bae17640 1 -- 172.21.15.60:0/1651336086 wait complete. 2024-09-12T01:35:56.670 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:35:56.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.779+0000 7fb9a5e47640 1 Processor -- start 2024-09-12T01:35:56.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.779+0000 7fb9a5e47640 1 -- start start 2024-09-12T01:35:56.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.780+0000 7fb9a5e47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a00cfb90 0x7fb9a00d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.780+0000 7fb9a5e47640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb9a006fa50 0x7fb9a0073350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.780+0000 7fb9a5e47640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9a00d1870 con 0x7fb9a00d2090 2024-09-12T01:35:56.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.780+0000 7fb9a5e47640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb9a015d810 con 0x7fb9a006fa50 2024-09-12T01:35:56.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.780+0000 7fb9a5e47640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a015cc00 con 0x7fb9a00cfb90 2024-09-12T01:35:56.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.780+0000 7fb99effd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb9a00d2090 0x7fb9a006f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57782/0 (socket says 172.21.15.60:57782) 2024-09-12T01:35:56.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.780+0000 7fb99effd640 1 -- 172.21.15.60:0/310897973 learned_addr learned my addr 172.21.15.60:0/310897973 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:35:56.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.781+0000 7fb99ffff640 1 --2- 172.21.15.60:0/310897973 >> v2:172.21.15.105:3300/0 conn(0x7fb9a006fa50 0x7fb9a0073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.781+0000 7fb99f7fe640 1 --2- 172.21.15.60:0/310897973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a00cfb90 0x7fb9a00d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.781+0000 7fb99e7fc640 1 -- 172.21.15.60:0/310897973 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307292547 0 0) 0x7fb9a00d1870 con 0x7fb9a00d2090 2024-09-12T01:35:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.781+0000 7fb99e7fc640 1 -- 172.21.15.60:0/310897973 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb988003520 con 0x7fb9a00d2090 2024-09-12T01:35:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.781+0000 7fb99e7fc640 1 -- 172.21.15.60:0/310897973 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 852048701 0 0) 0x7fb988003520 con 0x7fb9a00d2090 2024-09-12T01:35:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.781+0000 7fb99ffff640 1 -- 172.21.15.60:0/310897973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a00cfb90 msgr2=0x7fb9a00d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.781+0000 7fb99ffff640 1 --2- 172.21.15.60:0/310897973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a00cfb90 0x7fb9a00d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.781+0000 7fb99ffff640 1 -- 172.21.15.60:0/310897973 >> v1:172.21.15.60:6789/0 conn(0x7fb9a00d2090 legacy=0x7fb9a006f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.781+0000 7fb99ffff640 1 -- 172.21.15.60:0/310897973 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a015cee0 con 0x7fb9a006fa50 2024-09-12T01:35:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.781+0000 7fb99f7fe640 1 --2- 172.21.15.60:0/310897973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a00cfb90 0x7fb9a00d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:35:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.782+0000 7fb99ffff640 1 --2- 172.21.15.60:0/310897973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a006fa50 0x7fb9a0073350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb998009d90 tx=0x7fb99802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cdd422430cf4251 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:56.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.782+0000 7fb99e7fc640 1 -- 172.21.15.60:0/310897973 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994001670 con 0x7fb9a006fa50 2024-09-12T01:35:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.782+0000 7fb99e7fc640 1 -- 172.21.15.60:0/310897973 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb998007540 con 0x7fb9a006fa50 2024-09-12T01:35:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.782+0000 7fb99e7fc640 1 -- 172.21.15.60:0/310897973 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9980078f0 con 0x7fb9a006fa50 2024-09-12T01:35:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.783+0000 7fb9a5e47640 1 -- 172.21.15.60:0/310897973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a006fa50 msgr2=0x7fb9a0073350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.783+0000 7fb9a5e47640 1 --2- 172.21.15.60:0/310897973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a006fa50 0x7fb9a0073350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb998009d90 tx=0x7fb99802a5f0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.783+0000 7fb9a5e47640 1 -- 172.21.15.60:0/310897973 shutdown_connections 2024-09-12T01:35:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.783+0000 7fb9a5e47640 1 --2- 172.21.15.60:0/310897973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a006fa50 0x7fb9a0073350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.783+0000 7fb9a5e47640 1 --2- 172.21.15.60:0/310897973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a00cfb90 0x7fb9a00d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.783+0000 7fb9a5e47640 1 -- 172.21.15.60:0/310897973 >> 172.21.15.60:0/310897973 conn(0x7fb9a0062630 msgr2=0x7fb9a0062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.783+0000 7fb9a5e47640 1 -- 172.21.15.60:0/310897973 shutdown_connections 2024-09-12T01:35:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.783+0000 7fb9a5e47640 1 -- 172.21.15.60:0/310897973 wait complete. 2024-09-12T01:35:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.784+0000 7fb9a5e47640 1 Processor -- start 2024-09-12T01:35:56.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.784+0000 7fb9a5e47640 1 -- start start 2024-09-12T01:35:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb9a5e47640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a006fa50 0x7fb9a00b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb9a5e47640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9a00cfb90 0x7fb9a00b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb9a5e47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a00d2090 0x7fb9a014e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb9a5e47640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a00cff70 con 0x7fb9a00cfb90 2024-09-12T01:35:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb9a5e47640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a015d4a0 con 0x7fb9a006fa50 2024-09-12T01:35:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb9a5e47640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a00b55b0 con 0x7fb9a00d2090 2024-09-12T01:35:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb99effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9a00cfb90 0x7fb9a00b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb99effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9a00cfb90 0x7fb9a00b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33720/0 (socket says 172.21.15.60:33720) 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb99effd640 1 -- 172.21.15.60:0/855224905 learned_addr learned my addr 172.21.15.60:0/855224905 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb99f7fe640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a006fa50 0x7fb9a00b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb99ffff640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a00d2090 0x7fb9a014e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb99effd640 1 -- 172.21.15.60:0/855224905 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a00d2090 msgr2=0x7fb9a014e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb99effd640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a00d2090 0x7fb9a014e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb99effd640 1 -- 172.21.15.60:0/855224905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a006fa50 msgr2=0x7fb9a00b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb99effd640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a006fa50 0x7fb9a00b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.785+0000 7fb99effd640 1 -- 172.21.15.60:0/855224905 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a0153bf0 con 0x7fb9a00cfb90 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.786+0000 7fb99effd640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9a00cfb90 0x7fb9a00b3310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb99400c750 tx=0x7fb99400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.786+0000 7fb987fff640 1 -- 172.21.15.60:0/855224905 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994017070 con 0x7fb9a00cfb90 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.786+0000 7fb987fff640 1 -- 172.21.15.60:0/855224905 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb994005ad0 con 0x7fb9a00cfb90 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.786+0000 7fb9a5e47640 1 -- 172.21.15.60:0/855224905 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a0159560 con 0x7fb9a00cfb90 2024-09-12T01:35:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.786+0000 7fb987fff640 1 -- 172.21.15.60:0/855224905 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb994007070 con 0x7fb9a00cfb90 2024-09-12T01:35:56.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.786+0000 7fb9a5e47640 1 -- 172.21.15.60:0/855224905 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a0159b20 con 0x7fb9a00cfb90 2024-09-12T01:35:56.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.787+0000 7fb9a5e47640 1 -- 172.21.15.60:0/855224905 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a00d1b50 con 0x7fb9a00cfb90 2024-09-12T01:35:56.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.787+0000 7fb987fff640 1 -- 172.21.15.60:0/855224905 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb99401a070 con 0x7fb9a00cfb90 2024-09-12T01:35:56.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.788+0000 7fb987fff640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb98c06be60 0x7fb98c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:56.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.788+0000 7fb987fff640 1 -- 172.21.15.60:0/855224905 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb99408a2c0 con 0x7fb9a00cfb90 2024-09-12T01:35:56.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.788+0000 7fb99f7fe640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb98c06be60 0x7fb98c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:56.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.788+0000 7fb99f7fe640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb98c06be60 0x7fb98c06e320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00b16c0 tx=0x7fb990009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:56.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.792+0000 7fb987fff640 1 -- 172.21.15.60:0/855224905 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb9940585a0 con 0x7fb9a00cfb90 2024-09-12T01:35:56.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.968+0000 7fb9a5e47640 1 -- 172.21.15.60:0/855224905 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9a00b7420 con 0x7fb9a00cfb90 2024-09-12T01:35:56.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.969+0000 7fb987fff640 1 -- 172.21.15.60:0/855224905 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16646 (secure 0 0 0) 0x7fb99408a0e0 con 0x7fb9a00cfb90 2024-09-12T01:35:56.970 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:35:56.970 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:55.984329+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:35:53.846331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:35:54.965757+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:35:56.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.971+0000 7fb9a5e47640 1 -- 172.21.15.60:0/855224905 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb98c06be60 msgr2=0x7fb98c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.971+0000 7fb9a5e47640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb98c06be60 0x7fb98c06e320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00b16c0 tx=0x7fb990009190 comp rx=0 tx=0).stop 2024-09-12T01:35:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.971+0000 7fb9a5e47640 1 -- 172.21.15.60:0/855224905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9a00cfb90 msgr2=0x7fb9a00b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.971+0000 7fb9a5e47640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9a00cfb90 0x7fb9a00b3310 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb99400c750 tx=0x7fb99400cc10 comp rx=0 tx=0).stop 2024-09-12T01:35:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.971+0000 7fb9a5e47640 1 -- 172.21.15.60:0/855224905 shutdown_connections 2024-09-12T01:35:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.972+0000 7fb9a5e47640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb98c06be60 0x7fb98c06e320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.972+0000 7fb9a5e47640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9a00d2090 0x7fb9a014e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.972+0000 7fb9a5e47640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9a00cfb90 0x7fb9a00b3310 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.972+0000 7fb9a5e47640 1 --2- 172.21.15.60:0/855224905 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb9a006fa50 0x7fb9a00b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.972+0000 7fb9a5e47640 1 -- 172.21.15.60:0/855224905 >> 172.21.15.60:0/855224905 conn(0x7fb9a0062630 msgr2=0x7fb9a015eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.972+0000 7fb9a5e47640 1 -- 172.21.15.60:0/855224905 shutdown_connections 2024-09-12T01:35:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:56.972+0000 7fb9a5e47640 1 -- 172.21.15.60:0/855224905 wait complete. 2024-09-12T01:35:56.983 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:35:57.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.085+0000 7f5314842640 1 Processor -- start 2024-09-12T01:35:57.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.085+0000 7f5314842640 1 -- start start 2024-09-12T01:35:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f5314842640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f531015c2b0 0x7f53100b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f5314842640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f53100b72f0 0x7f531015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f5314842640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f531015fb10 con 0x7f531015f030 2024-09-12T01:35:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f5314842640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f53100b5900 con 0x7f53100b72f0 2024-09-12T01:35:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f5314842640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f531015f830 con 0x7f531015c2b0 2024-09-12T01:35:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f530dd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f53100b72f0 0x7f531015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f530dd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f53100b72f0 0x7f531015eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33730/0 (socket says 172.21.15.60:33730) 2024-09-12T01:35:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f530dd9b640 1 -- 172.21.15.60:0/3408650922 learned_addr learned my addr 172.21.15.60:0/3408650922 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f530ed9d640 1 --1- 172.21.15.60:0/3408650922 >> v1:172.21.15.60:6789/0 conn(0x7f531015f030 0x7f531006f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57794/0 (socket says 172.21.15.60:57794) 2024-09-12T01:35:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f530e59c640 1 --2- 172.21.15.60:0/3408650922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f531015c2b0 0x7f53100b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f530dd9b640 1 -- 172.21.15.60:0/3408650922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f531015c2b0 msgr2=0x7f53100b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f530dd9b640 1 --2- 172.21.15.60:0/3408650922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f531015c2b0 0x7f53100b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f530dd9b640 1 -- 172.21.15.60:0/3408650922 >> v1:172.21.15.60:6789/0 conn(0x7f531015f030 legacy=0x7f531006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f530d59a640 1 -- 172.21.15.60:0/3408650922 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302814940 0 0) 0x7f531015fb10 con 0x7f531015f030 2024-09-12T01:35:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.086+0000 7f530dd9b640 1 -- 172.21.15.60:0/3408650922 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531006ce30 con 0x7f53100b72f0 2024-09-12T01:35:57.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.087+0000 7f530dd9b640 1 --2- 172.21.15.60:0/3408650922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100b72f0 0x7f531015eaf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009870 tx=0x7f52f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f728551f177a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:57.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.087+0000 7f530d59a640 1 -- 172.21.15.60:0/3408650922 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f8037070 con 0x7f53100b72f0 2024-09-12T01:35:57.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.087+0000 7f530d59a640 1 -- 172.21.15.60:0/3408650922 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f8032440 con 0x7f53100b72f0 2024-09-12T01:35:57.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.087+0000 7f530d59a640 1 -- 172.21.15.60:0/3408650922 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f8032810 con 0x7f53100b72f0 2024-09-12T01:35:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.088+0000 7f5314842640 1 -- 172.21.15.60:0/3408650922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100b72f0 msgr2=0x7f531015eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.088+0000 7f5314842640 1 --2- 172.21.15.60:0/3408650922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100b72f0 0x7f531015eaf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009870 tx=0x7f52f802a270 comp rx=0 tx=0).stop 2024-09-12T01:35:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.088+0000 7f5314842640 1 -- 172.21.15.60:0/3408650922 shutdown_connections 2024-09-12T01:35:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.088+0000 7f5314842640 1 --2- 172.21.15.60:0/3408650922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100b72f0 0x7f531015eaf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.088+0000 7f5314842640 1 --2- 172.21.15.60:0/3408650922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f531015c2b0 0x7f53100b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.088+0000 7f5314842640 1 -- 172.21.15.60:0/3408650922 >> 172.21.15.60:0/3408650922 conn(0x7f53100b4240 msgr2=0x7f53100b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.088+0000 7f5314842640 1 -- 172.21.15.60:0/3408650922 shutdown_connections 2024-09-12T01:35:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.088+0000 7f5314842640 1 -- 172.21.15.60:0/3408650922 wait complete. 2024-09-12T01:35:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.089+0000 7f5314842640 1 Processor -- start 2024-09-12T01:35:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.089+0000 7f5314842640 1 -- start start 2024-09-12T01:35:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f5314842640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100b72f0 0x7f531014bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f5314842640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f531015c2b0 0x7f5310149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f5314842640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f531015f030 0x7f531014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f5314842640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f53100b7730 con 0x7f53100b72f0 2024-09-12T01:35:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f5314842640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f531006d3f0 con 0x7f531015c2b0 2024-09-12T01:35:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f5314842640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f531015f4e0 con 0x7f531015f030 2024-09-12T01:35:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f530e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100b72f0 0x7f531014bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f530e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100b72f0 0x7f531014bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33734/0 (socket says 172.21.15.60:33734) 2024-09-12T01:35:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f530e59c640 1 -- 172.21.15.60:0/1314590389 learned_addr learned my addr 172.21.15.60:0/1314590389 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f530dd9b640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f531015c2b0 0x7f5310149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f530ed9d640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f531015f030 0x7f531014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f530e59c640 1 -- 172.21.15.60:0/1314590389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f531015f030 msgr2=0x7f531014a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f530e59c640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f531015f030 0x7f531014a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f530e59c640 1 -- 172.21.15.60:0/1314590389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f531015c2b0 msgr2=0x7f5310149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f530e59c640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f531015c2b0 0x7f5310149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f530e59c640 1 -- 172.21.15.60:0/1314590389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531014a060 con 0x7f53100b72f0 2024-09-12T01:35:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.090+0000 7f530e59c640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100b72f0 0x7f531014bd00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5308007ef0 tx=0x7f530800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.091+0000 7f5306ffd640 1 -- 172.21.15.60:0/1314590389 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308014620 con 0x7f53100b72f0 2024-09-12T01:35:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.091+0000 7f5306ffd640 1 -- 172.21.15.60:0/1314590389 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5308019070 con 0x7f53100b72f0 2024-09-12T01:35:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.091+0000 7f5306ffd640 1 -- 172.21.15.60:0/1314590389 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308014a00 con 0x7f53100b72f0 2024-09-12T01:35:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.091+0000 7f5314842640 1 -- 172.21.15.60:0/1314590389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531014ac60 con 0x7f53100b72f0 2024-09-12T01:35:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.091+0000 7f5314842640 1 -- 172.21.15.60:0/1314590389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f531014b220 con 0x7f53100b72f0 2024-09-12T01:35:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.092+0000 7f5314842640 1 -- 172.21.15.60:0/1314590389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531015eaf0 con 0x7f53100b72f0 2024-09-12T01:35:57.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.092+0000 7f5306ffd640 1 -- 172.21.15.60:0/1314590389 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5308014ba0 con 0x7f53100b72f0 2024-09-12T01:35:57.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.093+0000 7f5306ffd640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f52f006be60 0x7f52f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.093+0000 7f5306ffd640 1 -- 172.21.15.60:0/1314590389 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f530808b630 con 0x7f53100b72f0 2024-09-12T01:35:57.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.093+0000 7f530dd9b640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f52f006be60 0x7f52f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.093+0000 7f530dd9b640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f52f006be60 0x7f52f006e320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52f8034000 tx=0x7f52f802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:57.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.097+0000 7f5306ffd640 1 -- 172.21.15.60:0/1314590389 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5308059970 con 0x7f53100b72f0 2024-09-12T01:35:57.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.272+0000 7f5314842640 1 -- 172.21.15.60:0/1314590389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5310071230 con 0x7f53100b72f0 2024-09-12T01:35:57.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.273+0000 7f5306ffd640 1 -- 172.21.15.60:0/1314590389 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16646 (secure 0 0 0) 0x7f530805dc70 con 0x7f53100b72f0 2024-09-12T01:35:57.274 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:35:57.274 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:55.984329+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:35:53.846331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:35:54.965757+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:35:57.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.275+0000 7f5314842640 1 -- 172.21.15.60:0/1314590389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f52f006be60 msgr2=0x7f52f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.275+0000 7f5314842640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f52f006be60 0x7f52f006e320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f52f8034000 tx=0x7f52f802e000 comp rx=0 tx=0).stop 2024-09-12T01:35:57.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.275+0000 7f5314842640 1 -- 172.21.15.60:0/1314590389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100b72f0 msgr2=0x7f531014bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.275+0000 7f5314842640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100b72f0 0x7f531014bd00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5308007ef0 tx=0x7f530800e4b0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.276+0000 7f5314842640 1 -- 172.21.15.60:0/1314590389 shutdown_connections 2024-09-12T01:35:57.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.276+0000 7f5314842640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f52f006be60 0x7f52f006e320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.276+0000 7f5314842640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f531015f030 0x7f531014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.276+0000 7f5314842640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f531015c2b0 0x7f5310149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.276+0000 7f5314842640 1 --2- 172.21.15.60:0/1314590389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53100b72f0 0x7f531014bd00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.276+0000 7f5314842640 1 -- 172.21.15.60:0/1314590389 >> 172.21.15.60:0/1314590389 conn(0x7f53100b4240 msgr2=0x7f531015a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:57.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.276+0000 7f5314842640 1 -- 172.21.15.60:0/1314590389 shutdown_connections 2024-09-12T01:35:57.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.276+0000 7f5314842640 1 -- 172.21.15.60:0/1314590389 wait complete. 2024-09-12T01:35:57.287 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:35:57.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.393+0000 7fee52991640 1 Processor -- start 2024-09-12T01:35:57.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.393+0000 7fee52991640 1 -- start start 2024-09-12T01:35:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.393+0000 7fee52991640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fee4c159000 0x7fee4c15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.393+0000 7fee52991640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c0b36a0 0x7fee4c0b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.393+0000 7fee52991640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee4c072f40 con 0x7fee4c072190 2024-09-12T01:35:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.393+0000 7fee52991640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fee4c0b5130 con 0x7fee4c159000 2024-09-12T01:35:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.393+0000 7fee52991640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fee4c072980 con 0x7fee4c0b36a0 2024-09-12T01:35:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee43fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fee4c072190 0x7fee4c0b55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57806/0 (socket says 172.21.15.60:57806) 2024-09-12T01:35:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee43fff640 1 -- 172.21.15.60:0/2836674513 learned_addr learned my addr 172.21.15.60:0/2836674513 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:35:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4bfff640 1 --2- 172.21.15.60:0/2836674513 >> v2:172.21.15.105:3300/0 conn(0x7fee4c159000 0x7fee4c15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee50f2e640 1 --2- 172.21.15.60:0/2836674513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c0b36a0 0x7fee4c0b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884471672 0 0) 0x7fee4c072f40 con 0x7fee4c072190 2024-09-12T01:35:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee38003520 con 0x7fee4c072190 2024-09-12T01:35:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 365078227 0 0) 0x7fee38003520 con 0x7fee4c072190 2024-09-12T01:35:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c0b36a0 msgr2=0x7fee4c0b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 --2- 172.21.15.60:0/2836674513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c0b36a0 0x7fee4c0b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 >> v2:172.21.15.105:3300/0 conn(0x7fee4c159000 msgr2=0x7fee4c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 --2- 172.21.15.60:0/2836674513 >> v2:172.21.15.105:3300/0 conn(0x7fee4c159000 0x7fee4c15c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4c072c60 con 0x7fee4c072190 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fee34001690 con 0x7fee4c072190 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 >> v1:172.21.15.60:6789/0 conn(0x7fee4c072190 legacy=0x7fee4c0b55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 --2- 172.21.15.60:0/2836674513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c0b36a0 0x7fee380039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 --2- 172.21.15.60:0/2836674513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee38003f30 0x7fee38004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 --2- 172.21.15.60:0/2836674513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee38004d40 0x7fee380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c0b5130 con 0x7fee38003f30 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c072980 con 0x7fee38004d40 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fee3800dc20 con 0x7fee4c0b36a0 2024-09-12T01:35:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee43fff640 1 --2- 172.21.15.60:0/2836674513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee38003f30 0x7fee38004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.394+0000 7fee4bfff640 1 --2- 172.21.15.60:0/2836674513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c0b36a0 0x7fee380039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.395+0000 7fee50f2e640 1 --2- 172.21.15.60:0/2836674513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee38004d40 0x7fee380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.395+0000 7fee43fff640 1 -- 172.21.15.60:0/2836674513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c0b36a0 msgr2=0x7fee380039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.395+0000 7fee43fff640 1 --2- 172.21.15.60:0/2836674513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c0b36a0 0x7fee380039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.395+0000 7fee43fff640 1 -- 172.21.15.60:0/2836674513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee38004d40 msgr2=0x7fee380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.395+0000 7fee43fff640 1 --2- 172.21.15.60:0/2836674513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee38004d40 0x7fee380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.395+0000 7fee43fff640 1 -- 172.21.15.60:0/2836674513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee38003520 con 0x7fee38003f30 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.395+0000 7fee43fff640 1 --2- 172.21.15.60:0/2836674513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee38003f30 0x7fee38004800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee3400c240 tx=0x7fee38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951fa8f84ea065d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.396+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34007d70 con 0x7fee38003f30 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.396+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee34005ad0 con 0x7fee38003f30 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.396+0000 7fee4b7fe640 1 -- 172.21.15.60:0/2836674513 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee34007070 con 0x7fee38003f30 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.396+0000 7fee52991640 1 -- 172.21.15.60:0/2836674513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee38003f30 msgr2=0x7fee38004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.396+0000 7fee52991640 1 --2- 172.21.15.60:0/2836674513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee38003f30 0x7fee38004800 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee3400c240 tx=0x7fee38005830 comp rx=0 tx=0).stop 2024-09-12T01:35:57.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.396+0000 7fee50f2e640 1 -- 172.21.15.60:0/2836674513 reap_dead start 2024-09-12T01:35:57.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.396+0000 7fee52991640 1 -- 172.21.15.60:0/2836674513 shutdown_connections 2024-09-12T01:35:57.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.396+0000 7fee52991640 1 -- 172.21.15.60:0/2836674513 >> 172.21.15.60:0/2836674513 conn(0x7fee4c0b6b50 msgr2=0x7fee4c0b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:57.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.396+0000 7fee52991640 1 -- 172.21.15.60:0/2836674513 shutdown_connections 2024-09-12T01:35:57.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.396+0000 7fee52991640 1 -- 172.21.15.60:0/2836674513 wait complete. 2024-09-12T01:35:57.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.397+0000 7fee52991640 1 Processor -- start 2024-09-12T01:35:57.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.398+0000 7fee52991640 1 -- start start 2024-09-12T01:35:57.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.398+0000 7fee52991640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee38003f30 0x7fee4c1e1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.398+0000 7fee52991640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c1e2f40 0x7fee4c1e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.398+0000 7fee52991640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee4c143f70 0x7fee4c1562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.398+0000 7fee52991640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c072730 con 0x7fee4c143f70 2024-09-12T01:35:57.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.398+0000 7fee52991640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c0725b0 con 0x7fee38003f30 2024-09-12T01:35:57.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.398+0000 7fee52991640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fee4c0b3b30 con 0x7fee4c1e2f40 2024-09-12T01:35:57.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.398+0000 7fee50f2e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee4c143f70 0x7fee4c1562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.398+0000 7fee50f2e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee4c143f70 0x7fee4c1562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33756/0 (socket says 172.21.15.60:33756) 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.398+0000 7fee50f2e640 1 -- 172.21.15.60:0/3821080933 learned_addr learned my addr 172.21.15.60:0/3821080933 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.398+0000 7fee4bfff640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee38003f30 0x7fee4c1e1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.398+0000 7fee43fff640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c1e2f40 0x7fee4c1e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.399+0000 7fee50f2e640 1 -- 172.21.15.60:0/3821080933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c1e2f40 msgr2=0x7fee4c1e4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.399+0000 7fee50f2e640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c1e2f40 0x7fee4c1e4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.399+0000 7fee50f2e640 1 -- 172.21.15.60:0/3821080933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee38003f30 msgr2=0x7fee4c1e1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.399+0000 7fee50f2e640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee38003f30 0x7fee4c1e1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.399+0000 7fee50f2e640 1 -- 172.21.15.60:0/3821080933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4c1e33a0 con 0x7fee4c143f70 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.399+0000 7fee50f2e640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee4c143f70 0x7fee4c1562a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0d2410 tx=0x7fee4400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.399+0000 7fee497fa640 1 -- 172.21.15.60:0/3821080933 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4400fce0 con 0x7fee4c143f70 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.399+0000 7fee497fa640 1 -- 172.21.15.60:0/3821080933 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee4401d070 con 0x7fee4c143f70 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.399+0000 7fee52991640 1 -- 172.21.15.60:0/3821080933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4c1e1ea0 con 0x7fee4c143f70 2024-09-12T01:35:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.399+0000 7fee497fa640 1 -- 172.21.15.60:0/3821080933 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee44015670 con 0x7fee4c143f70 2024-09-12T01:35:57.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.399+0000 7fee52991640 1 -- 172.21.15.60:0/3821080933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee4c1e2460 con 0x7fee4c143f70 2024-09-12T01:35:57.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.400+0000 7fee52991640 1 -- 172.21.15.60:0/3821080933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee4c0b3ec0 con 0x7fee4c143f70 2024-09-12T01:35:57.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.400+0000 7fee497fa640 1 -- 172.21.15.60:0/3821080933 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee44015810 con 0x7fee4c143f70 2024-09-12T01:35:57.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.401+0000 7fee497fa640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fee2c06be60 0x7fee2c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.401+0000 7fee497fa640 1 -- 172.21.15.60:0/3821080933 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fee4408b6c0 con 0x7fee4c143f70 2024-09-12T01:35:57.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.401+0000 7fee4bfff640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fee2c06be60 0x7fee2c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.401+0000 7fee4bfff640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fee2c06be60 0x7fee2c06e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009bc0 tx=0x7fee3c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:57.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.405+0000 7fee497fa640 1 -- 172.21.15.60:0/3821080933 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee44010040 con 0x7fee4c143f70 2024-09-12T01:35:57.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.614+0000 7fee52991640 1 -- 172.21.15.60:0/3821080933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fee4c158540 con 0x7fee4c143f70 2024-09-12T01:35:57.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.739+0000 7fee497fa640 1 -- 172.21.15.60:0/3821080933 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7fee44059fd0 con 0x7fee4c143f70 2024-09-12T01:35:57.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.741+0000 7fee52991640 1 -- 172.21.15.60:0/3821080933 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fee2c06be60 msgr2=0x7fee2c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.741+0000 7fee52991640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fee2c06be60 0x7fee2c06e320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fee3c009bc0 tx=0x7fee3c009190 comp rx=0 tx=0).stop 2024-09-12T01:35:57.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.741+0000 7fee52991640 1 -- 172.21.15.60:0/3821080933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee4c143f70 msgr2=0x7fee4c1562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.741+0000 7fee52991640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee4c143f70 0x7fee4c1562a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0d2410 tx=0x7fee4400f1b0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.741+0000 7fee52991640 1 -- 172.21.15.60:0/3821080933 shutdown_connections 2024-09-12T01:35:57.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.741+0000 7fee52991640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee4c143f70 0x7fee4c1562a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.741+0000 7fee52991640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fee2c06be60 0x7fee2c06e320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.741+0000 7fee52991640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee4c1e2f40 0x7fee4c1e4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.741+0000 7fee52991640 1 --2- 172.21.15.60:0/3821080933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee38003f30 0x7fee4c1e1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.741+0000 7fee52991640 1 -- 172.21.15.60:0/3821080933 >> 172.21.15.60:0/3821080933 conn(0x7fee4c0b6b50 msgr2=0x7fee4c0aa540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:57.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.741+0000 7fee52991640 1 -- 172.21.15.60:0/3821080933 shutdown_connections 2024-09-12T01:35:57.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.741+0000 7fee52991640 1 -- 172.21.15.60:0/3821080933 wait complete. 2024-09-12T01:35:57.752 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:35:57.752 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:35:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.859+0000 7f8ab45c0640 1 Processor -- start 2024-09-12T01:35:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.859+0000 7f8ab45c0640 1 -- start start 2024-09-12T01:35:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab45c0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac15e7a0 0x7f8aac06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab45c0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8aac0cf1f0 0x7f8aac0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab45c0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aac0cf860 con 0x7f8aac0b6720 2024-09-12T01:35:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab45c0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f8aac0d2ca0 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab45c0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac0cfb40 con 0x7f8aac15e7a0 2024-09-12T01:35:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab1b5b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8aac0cf1f0 0x7f8aac0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab1b5b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8aac0cf1f0 0x7f8aac0b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33758/0 (socket says 172.21.15.60:33758) 2024-09-12T01:35:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab1b5b640 1 -- 172.21.15.60:0/1325339632 learned_addr learned my addr 172.21.15.60:0/1325339632 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab235c640 1 --2- 172.21.15.60:0/1325339632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac15e7a0 0x7f8aac06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab1b5b640 1 -- 172.21.15.60:0/1325339632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac15e7a0 msgr2=0x7f8aac06caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab1b5b640 1 --2- 172.21.15.60:0/1325339632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac15e7a0 0x7f8aac06caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab1b5b640 1 -- 172.21.15.60:0/1325339632 >> v1:172.21.15.105:6789/0 conn(0x7f8aac0b6720 legacy=0x7f8aac1623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.860+0000 7f8ab1b5b640 1 -- 172.21.15.60:0/1325339632 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac0cfe20 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.861+0000 7f8ab1b5b640 1 --2- 172.21.15.60:0/1325339632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0cf1f0 0x7f8aac0b61e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009870 tx=0x7f8aa802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cccd0b7a202dc62 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.861+0000 7f8ab135a640 1 -- 172.21.15.60:0/1325339632 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8037070 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.861+0000 7f8ab135a640 1 -- 172.21.15.60:0/1325339632 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa8032440 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.861+0000 7f8ab135a640 1 -- 172.21.15.60:0/1325339632 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8032810 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.862+0000 7f8ab45c0640 1 -- 172.21.15.60:0/1325339632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0cf1f0 msgr2=0x7f8aac0b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.862+0000 7f8ab45c0640 1 --2- 172.21.15.60:0/1325339632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0cf1f0 0x7f8aac0b61e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009870 tx=0x7f8aa802a1c0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.862+0000 7f8ab45c0640 1 -- 172.21.15.60:0/1325339632 shutdown_connections 2024-09-12T01:35:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.862+0000 7f8ab45c0640 1 --2- 172.21.15.60:0/1325339632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0cf1f0 0x7f8aac0b61e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.862+0000 7f8ab45c0640 1 --2- 172.21.15.60:0/1325339632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac15e7a0 0x7f8aac06caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.862+0000 7f8ab45c0640 1 -- 172.21.15.60:0/1325339632 >> 172.21.15.60:0/1325339632 conn(0x7f8aac0d11e0 msgr2=0x7f8aac0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.862+0000 7f8ab45c0640 1 -- 172.21.15.60:0/1325339632 shutdown_connections 2024-09-12T01:35:57.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.862+0000 7f8ab45c0640 1 -- 172.21.15.60:0/1325339632 wait complete. 2024-09-12T01:35:57.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.863+0000 7f8ab45c0640 1 Processor -- start 2024-09-12T01:35:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.863+0000 7f8ab45c0640 1 -- start start 2024-09-12T01:35:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab45c0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aac0b6720 0x7f8aac0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab45c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0cf1f0 0x7f8aac1594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab45c0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac15e7a0 0x7f8aac0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab45c0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac06cfe0 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab45c0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8aac0b7a00 con 0x7f8aac0b6720 2024-09-12T01:35:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab45c0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8aac0d4420 con 0x7f8aac15e7a0 2024-09-12T01:35:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab1b5b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0cf1f0 0x7f8aac1594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab1b5b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0cf1f0 0x7f8aac1594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33766/0 (socket says 172.21.15.60:33766) 2024-09-12T01:35:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab1b5b640 1 -- 172.21.15.60:0/2408563627 learned_addr learned my addr 172.21.15.60:0/2408563627 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab235c640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aac0b6720 0x7f8aac0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab2b5d640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac15e7a0 0x7f8aac0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab1b5b640 1 -- 172.21.15.60:0/2408563627 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac15e7a0 msgr2=0x7f8aac0c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab1b5b640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac15e7a0 0x7f8aac0c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab1b5b640 1 -- 172.21.15.60:0/2408563627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aac0b6720 msgr2=0x7f8aac0ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab1b5b640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aac0b6720 0x7f8aac0ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab1b5b640 1 -- 172.21.15.60:0/2408563627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aac1465f0 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab2b5d640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac15e7a0 0x7f8aac0c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8ab1b5b640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0cf1f0 0x7f8aac1594a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009870 tx=0x7f8aa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8aa2ffd640 1 -- 172.21.15.60:0/2408563627 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8041070 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.864+0000 7f8aa2ffd640 1 -- 172.21.15.60:0/2408563627 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa803c890 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.865+0000 7f8ab45c0640 1 -- 172.21.15.60:0/2408563627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aac0cae20 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.865+0000 7f8aa2ffd640 1 -- 172.21.15.60:0/2408563627 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8037040 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.865+0000 7f8ab45c0640 1 -- 172.21.15.60:0/2408563627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aac1468b0 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.866+0000 7f8ab45c0640 1 -- 172.21.15.60:0/2408563627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8aac15eb80 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.866+0000 7f8aa2ffd640 1 -- 172.21.15.60:0/2408563627 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8aa8044070 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.866+0000 7f8aa2ffd640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8a9006be30 0x7f8a9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:57.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.867+0000 7f8ab235c640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8a9006be30 0x7f8a9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:57.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.867+0000 7f8aa2ffd640 1 -- 172.21.15.60:0/2408563627 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f8aa80aba50 con 0x7f8aac0cf1f0 2024-09-12T01:35:57.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.867+0000 7f8ab235c640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8a9006be30 0x7f8a9006e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009aa0 tx=0x7f8a9c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:57.871+0000 7f8aa2ffd640 1 -- 172.21.15.60:0/2408563627 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8aa8079f60 con 0x7f8aac0cf1f0 2024-09-12T01:35:58.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.081+0000 7f8ab45c0640 1 -- 172.21.15.60:0/2408563627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f8aac0d2a80 con 0x7f8aac0cf1f0 2024-09-12T01:35:58.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.743+0000 7f8aa2ffd640 1 -- 172.21.15.60:0/2408563627 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f8aa807e260 con 0x7f8aac0cf1f0 2024-09-12T01:35:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.746+0000 7f8ab45c0640 1 -- 172.21.15.60:0/2408563627 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8a9006be30 msgr2=0x7f8a9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.746+0000 7f8ab45c0640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8a9006be30 0x7f8a9006e2f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009aa0 tx=0x7f8a9c009190 comp rx=0 tx=0).stop 2024-09-12T01:35:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.746+0000 7f8ab45c0640 1 -- 172.21.15.60:0/2408563627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0cf1f0 msgr2=0x7f8aac1594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.746+0000 7f8ab45c0640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0cf1f0 0x7f8aac1594a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8009870 tx=0x7f8aa80046c0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.746+0000 7f8ab45c0640 1 -- 172.21.15.60:0/2408563627 shutdown_connections 2024-09-12T01:35:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.746+0000 7f8ab45c0640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8a9006be30 0x7f8a9006e2f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.746+0000 7f8ab45c0640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8aac15e7a0 0x7f8aac0c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.746+0000 7f8ab45c0640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8aac0cf1f0 0x7f8aac1594a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.746+0000 7f8ab45c0640 1 --2- 172.21.15.60:0/2408563627 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8aac0b6720 0x7f8aac0ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.746+0000 7f8ab45c0640 1 -- 172.21.15.60:0/2408563627 >> 172.21.15.60:0/2408563627 conn(0x7f8aac0d11e0 msgr2=0x7f8aac15b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.746+0000 7f8ab45c0640 1 -- 172.21.15.60:0/2408563627 shutdown_connections 2024-09-12T01:35:58.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.746+0000 7f8ab45c0640 1 -- 172.21.15.60:0/2408563627 wait complete. 2024-09-12T01:35:58.760 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:35:58.760 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:35:58.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.868+0000 7fc6b2237640 1 Processor -- start 2024-09-12T01:35:58.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.868+0000 7fc6b2237640 1 -- start start 2024-09-12T01:35:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.869+0000 7fc6b2237640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc6ac162b20 0x7fc6ac167060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.869+0000 7fc6b2237640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6ac0b62f0 0x7fc6ac06f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.869+0000 7fc6b2237640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6ac06f880 0x7fc6ac0731a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.869+0000 7fc6b2237640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ac06ed70 con 0x7fc6ac0b62f0 2024-09-12T01:35:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.869+0000 7fc6b2237640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc6ac1675a0 con 0x7fc6ac162b20 2024-09-12T01:35:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.869+0000 7fc6b2237640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac0cef30 con 0x7fc6ac06f880 2024-09-12T01:35:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.869+0000 7fc6aaffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6ac0b62f0 0x7fc6ac06f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.869+0000 7fc6aaffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc6ac0b62f0 0x7fc6ac06f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33776/0 (socket says 172.21.15.60:33776) 2024-09-12T01:35:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.869+0000 7fc6aaffd640 1 -- 172.21.15.60:0/1807908782 learned_addr learned my addr 172.21.15.60:0/1807908782 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.870+0000 7fc6ab7fe640 1 --2- 172.21.15.60:0/1807908782 >> v2:172.21.15.105:3300/0 conn(0x7fc6ac162b20 0x7fc6ac167060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.870+0000 7fc6abfff640 1 --2- 172.21.15.60:0/1807908782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6ac06f880 0x7fc6ac0731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.870+0000 7fc6aaffd640 1 -- 172.21.15.60:0/1807908782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6ac06f880 msgr2=0x7fc6ac0731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.870+0000 7fc6aaffd640 1 --2- 172.21.15.60:0/1807908782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6ac06f880 0x7fc6ac0731a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.870+0000 7fc6aaffd640 1 -- 172.21.15.60:0/1807908782 >> v2:172.21.15.105:3300/0 conn(0x7fc6ac162b20 msgr2=0x7fc6ac167060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.870+0000 7fc6aaffd640 1 --2- 172.21.15.60:0/1807908782 >> v2:172.21.15.105:3300/0 conn(0x7fc6ac162b20 0x7fc6ac167060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.870+0000 7fc6aaffd640 1 -- 172.21.15.60:0/1807908782 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac0d2260 con 0x7fc6ac0b62f0 2024-09-12T01:35:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.870+0000 7fc6abfff640 1 --2- 172.21.15.60:0/1807908782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6ac06f880 0x7fc6ac0731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:58.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.870+0000 7fc6aaffd640 1 --2- 172.21.15.60:0/1807908782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6ac0b62f0 0x7fc6ac06f340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0b7a60 tx=0x7fc6a002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843b5bd61929610a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:58.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.871+0000 7fc6aa7fc640 1 -- 172.21.15.60:0/1807908782 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0037070 con 0x7fc6ac0b62f0 2024-09-12T01:35:58.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.871+0000 7fc6aa7fc640 1 -- 172.21.15.60:0/1807908782 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a0032440 con 0x7fc6ac0b62f0 2024-09-12T01:35:58.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.871+0000 7fc6aa7fc640 1 -- 172.21.15.60:0/1807908782 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0032810 con 0x7fc6ac0b62f0 2024-09-12T01:35:58.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.871+0000 7fc6b2237640 1 -- 172.21.15.60:0/1807908782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6ac0b62f0 msgr2=0x7fc6ac06f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.871+0000 7fc6b2237640 1 --2- 172.21.15.60:0/1807908782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6ac0b62f0 0x7fc6ac06f340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac0b7a60 tx=0x7fc6a002a210 comp rx=0 tx=0).stop 2024-09-12T01:35:58.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.871+0000 7fc6b2237640 1 -- 172.21.15.60:0/1807908782 shutdown_connections 2024-09-12T01:35:58.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.871+0000 7fc6b2237640 1 --2- 172.21.15.60:0/1807908782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6ac06f880 0x7fc6ac0731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.871+0000 7fc6b2237640 1 --2- 172.21.15.60:0/1807908782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6ac0b62f0 0x7fc6ac06f340 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.871+0000 7fc6b2237640 1 --2- 172.21.15.60:0/1807908782 >> v2:172.21.15.105:3300/0 conn(0x7fc6ac162b20 0x7fc6ac167060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.871+0000 7fc6b2237640 1 -- 172.21.15.60:0/1807908782 >> 172.21.15.60:0/1807908782 conn(0x7fc6ac062630 msgr2=0x7fc6ac062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:58.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.871+0000 7fc6b2237640 1 -- 172.21.15.60:0/1807908782 shutdown_connections 2024-09-12T01:35:58.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.871+0000 7fc6b2237640 1 -- 172.21.15.60:0/1807908782 wait complete. 2024-09-12T01:35:58.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.872+0000 7fc6b2237640 1 Processor -- start 2024-09-12T01:35:58.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.873+0000 7fc6b2237640 1 -- start start 2024-09-12T01:35:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.873+0000 7fc6b2237640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6ac06f880 0x7fc6ac150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.873+0000 7fc6b2237640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6ac0b62f0 0x7fc6ac0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.873+0000 7fc6b2237640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6ac162b20 0x7fc6ac1642d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.873+0000 7fc6b2237640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac0cebc0 con 0x7fc6ac162b20 2024-09-12T01:35:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.873+0000 7fc6b2237640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc6ac0ce8e0 con 0x7fc6ac0b62f0 2024-09-12T01:35:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.873+0000 7fc6b2237640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc6ac162f00 con 0x7fc6ac06f880 2024-09-12T01:35:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.873+0000 7fc6abfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6ac162b20 0x7fc6ac1642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.873+0000 7fc6abfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6ac162b20 0x7fc6ac1642d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33784/0 (socket says 172.21.15.60:33784) 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc6abfff640 1 -- 172.21.15.60:0/1111798171 learned_addr learned my addr 172.21.15.60:0/1111798171 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc6aaffd640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6ac0b62f0 0x7fc6ac0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc6ab7fe640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6ac06f880 0x7fc6ac150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc6abfff640 1 -- 172.21.15.60:0/1111798171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6ac06f880 msgr2=0x7fc6ac150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc6abfff640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6ac06f880 0x7fc6ac150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc6abfff640 1 -- 172.21.15.60:0/1111798171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6ac0b62f0 msgr2=0x7fc6ac0c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc6abfff640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6ac0b62f0 0x7fc6ac0c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc6abfff640 1 -- 172.21.15.60:0/1111798171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6ac1621a0 con 0x7fc6ac162b20 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc6abfff640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6ac162b20 0x7fc6ac1642d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400cef0 tx=0x7fc6a400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc693fff640 1 -- 172.21.15.60:0/1111798171 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a401a070 con 0x7fc6ac162b20 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc693fff640 1 -- 172.21.15.60:0/1111798171 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6a400d860 con 0x7fc6ac162b20 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc6b2237640 1 -- 172.21.15.60:0/1111798171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6ac161100 con 0x7fc6ac162b20 2024-09-12T01:35:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc693fff640 1 -- 172.21.15.60:0/1111798171 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a400dc50 con 0x7fc6ac162b20 2024-09-12T01:35:58.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.874+0000 7fc6b2237640 1 -- 172.21.15.60:0/1111798171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6ac1616c0 con 0x7fc6ac162b20 2024-09-12T01:35:58.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.875+0000 7fc6b2237640 1 -- 172.21.15.60:0/1111798171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6ac0b6760 con 0x7fc6ac162b20 2024-09-12T01:35:58.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.876+0000 7fc693fff640 1 -- 172.21.15.60:0/1111798171 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc6a401d070 con 0x7fc6ac162b20 2024-09-12T01:35:58.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.876+0000 7fc693fff640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc69806be30 0x7fc69806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:58.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.876+0000 7fc6ab7fe640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc69806be30 0x7fc69806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:58.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.876+0000 7fc693fff640 1 -- 172.21.15.60:0/1111798171 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc6a408b600 con 0x7fc6ac162b20 2024-09-12T01:35:58.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.877+0000 7fc6ab7fe640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc69806be30 0x7fc69806e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac15aee0 tx=0x7fc69c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:58.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:58.881+0000 7fc693fff640 1 -- 172.21.15.60:0/1111798171 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc6a4059ab0 con 0x7fc6ac162b20 2024-09-12T01:35:59.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.090+0000 7fc6b2237640 1 -- 172.21.15.60:0/1111798171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6ac0d1ba0 con 0x7fc6ac162b20 2024-09-12T01:35:59.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.091+0000 7fc693fff640 1 -- 172.21.15.60:0/1111798171 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5223 (secure 0 0 0) 0x7fc6a405ddb0 con 0x7fc6ac162b20 2024-09-12T01:35:59.091 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:35:59.091 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"btime":"2024-09-12T01:35:58:740642+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3216581844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3216581844},{"type":"v1","addr":"172.21.15.60:6836","nonce":3216581844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1706637770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1706637770},{"type":"v1","addr":"172.21.15.105:6833","nonce":1706637770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3645806076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3645806076},{"type":"v1","addr":"172.21.15.60:6837","nonce":3645806076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:35:55.984648+0000","modified":"2024-09-12T01:35:58.083477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3695785914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3695785914},{"type":"v1","addr":"172.21.15.105:6835","nonce":3695785914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-12T01:35:59.092 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2024-09-12T01:35:59.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.093+0000 7fc6b2237640 1 -- 172.21.15.60:0/1111798171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc69806be30 msgr2=0x7fc69806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.093+0000 7fc6b2237640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc69806be30 0x7fc69806e2f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc6ac15aee0 tx=0x7fc69c008040 comp rx=0 tx=0).stop 2024-09-12T01:35:59.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.093+0000 7fc6b2237640 1 -- 172.21.15.60:0/1111798171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6ac162b20 msgr2=0x7fc6ac1642d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.093+0000 7fc6b2237640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6ac162b20 0x7fc6ac1642d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc6a400cef0 tx=0x7fc6a400a710 comp rx=0 tx=0).stop 2024-09-12T01:35:59.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.093+0000 7fc6b2237640 1 -- 172.21.15.60:0/1111798171 shutdown_connections 2024-09-12T01:35:59.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.093+0000 7fc6b2237640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6ac162b20 0x7fc6ac1642d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.093+0000 7fc6b2237640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6ac0b62f0 0x7fc6ac0c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.093+0000 7fc6b2237640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc69806be30 0x7fc69806e2f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.093+0000 7fc6b2237640 1 --2- 172.21.15.60:0/1111798171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6ac06f880 0x7fc6ac150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.093+0000 7fc6b2237640 1 -- 172.21.15.60:0/1111798171 >> 172.21.15.60:0/1111798171 conn(0x7fc6ac062630 msgr2=0x7fc6ac0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:59.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.093+0000 7fc6b2237640 1 -- 172.21.15.60:0/1111798171 shutdown_connections 2024-09-12T01:35:59.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.093+0000 7fc6b2237640 1 -- 172.21.15.60:0/1111798171 wait complete. 2024-09-12T01:35:59.104 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:35:59.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.206+0000 7f3412178640 1 Processor -- start 2024-09-12T01:35:59.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.206+0000 7f3412178640 1 -- start start 2024-09-12T01:35:59.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.207+0000 7f3412178640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f340c15e7a0 0x7f340c0ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.207+0000 7f3412178640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f340c0cf2f0 0x7f340c0cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.207+0000 7f3412178640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f340c0d4430 con 0x7f340c0d3fe0 2024-09-12T01:35:59.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.207+0000 7f3412178640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f340c0cfca0 con 0x7f340c0cf2f0 2024-09-12T01:35:59.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.207+0000 7f3412178640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f340c0d2f40 con 0x7f340c15e7a0 2024-09-12T01:35:59.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.207+0000 7f340bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f340c0cf2f0 0x7f340c0cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.207+0000 7f340bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f340c0cf2f0 0x7f340c0cf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33790/0 (socket says 172.21.15.60:33790) 2024-09-12T01:35:59.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.207+0000 7f340bfff640 1 -- 172.21.15.60:0/1229017408 learned_addr learned my addr 172.21.15.60:0/1229017408 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:59.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.207+0000 7f340b7fe640 1 --2- 172.21.15.60:0/1229017408 >> v2:172.21.15.105:3300/0 conn(0x7f340c15e7a0 0x7f340c0ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.207+0000 7f340bfff640 1 -- 172.21.15.60:0/1229017408 >> v2:172.21.15.105:3300/0 conn(0x7f340c15e7a0 msgr2=0x7f340c0ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:59.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.208+0000 7f340bfff640 1 --2- 172.21.15.60:0/1229017408 >> v2:172.21.15.105:3300/0 conn(0x7f340c15e7a0 0x7f340c0ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.208+0000 7f340bfff640 1 -- 172.21.15.60:0/1229017408 >> v1:172.21.15.105:6789/0 conn(0x7f340c0d3fe0 legacy=0x7f340c0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.208+0000 7f340bfff640 1 -- 172.21.15.60:0/1229017408 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c0d3220 con 0x7f340c0cf2f0 2024-09-12T01:35:59.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.208+0000 7f340bfff640 1 --2- 172.21.15.60:0/1229017408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c0cf2f0 0x7f340c0cf760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f340c0b71e0 tx=0x7f340402a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287c2c703ea2d533 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:59.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.208+0000 7f340a7fc640 1 -- 172.21.15.60:0/1229017408 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404036070 con 0x7f340c0cf2f0 2024-09-12T01:35:59.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.208+0000 7f340a7fc640 1 -- 172.21.15.60:0/1229017408 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3404031600 con 0x7f340c0cf2f0 2024-09-12T01:35:59.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.208+0000 7f340a7fc640 1 -- 172.21.15.60:0/1229017408 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34040319f0 con 0x7f340c0cf2f0 2024-09-12T01:35:59.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.209+0000 7f3412178640 1 -- 172.21.15.60:0/1229017408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c0cf2f0 msgr2=0x7f340c0cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.209+0000 7f3412178640 1 --2- 172.21.15.60:0/1229017408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c0cf2f0 0x7f340c0cf760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f340c0b71e0 tx=0x7f340402a7c0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.209+0000 7f3412178640 1 -- 172.21.15.60:0/1229017408 shutdown_connections 2024-09-12T01:35:59.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.209+0000 7f3412178640 1 --2- 172.21.15.60:0/1229017408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c0cf2f0 0x7f340c0cf760 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.209+0000 7f3412178640 1 --2- 172.21.15.60:0/1229017408 >> v2:172.21.15.105:3300/0 conn(0x7f340c15e7a0 0x7f340c0ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.209+0000 7f3412178640 1 -- 172.21.15.60:0/1229017408 >> 172.21.15.60:0/1229017408 conn(0x7f340c0d1550 msgr2=0x7f340c0d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:59.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.209+0000 7f3412178640 1 -- 172.21.15.60:0/1229017408 shutdown_connections 2024-09-12T01:35:59.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.209+0000 7f3412178640 1 -- 172.21.15.60:0/1229017408 wait complete. 2024-09-12T01:35:59.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.210+0000 7f3412178640 1 Processor -- start 2024-09-12T01:35:59.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.210+0000 7f3412178640 1 -- start start 2024-09-12T01:35:59.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.211+0000 7f3412178640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f340c0cf2f0 0x7f340c15d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.211+0000 7f3412178640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f340c0d3fe0 0x7f340c1e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.211+0000 7f3412178640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c15e7a0 0x7f340c1e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.211+0000 7f3412178640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f340c0d3ac0 con 0x7f340c15e7a0 2024-09-12T01:35:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.211+0000 7f3412178640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f340c0d37e0 con 0x7f340c0d3fe0 2024-09-12T01:35:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.211+0000 7f3412178640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f340c15eb80 con 0x7f340c0cf2f0 2024-09-12T01:35:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.211+0000 7f340bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c15e7a0 0x7f340c1e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.211+0000 7f340bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c15e7a0 0x7f340c1e81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33792/0 (socket says 172.21.15.60:33792) 2024-09-12T01:35:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.211+0000 7f340bfff640 1 -- 172.21.15.60:0/2193681778 learned_addr learned my addr 172.21.15.60:0/2193681778 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:59.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.211+0000 7f340b7fe640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f340c0cf2f0 0x7f340c15d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.211+0000 7f340affd640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f340c0d3fe0 0x7f340c1e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.212+0000 7f340bfff640 1 -- 172.21.15.60:0/2193681778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f340c0cf2f0 msgr2=0x7f340c15d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.212+0000 7f340bfff640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f340c0cf2f0 0x7f340c15d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.212+0000 7f340bfff640 1 -- 172.21.15.60:0/2193681778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f340c0d3fe0 msgr2=0x7f340c1e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.212+0000 7f340bfff640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f340c0d3fe0 0x7f340c1e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.212+0000 7f340bfff640 1 -- 172.21.15.60:0/2193681778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c0cc650 con 0x7f340c15e7a0 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.212+0000 7f340bfff640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c15e7a0 0x7f340c1e81a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f340402adb0 tx=0x7f3404004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.212+0000 7f33f3fff640 1 -- 172.21.15.60:0/2193681778 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404036050 con 0x7f340c15e7a0 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.212+0000 7f33f3fff640 1 -- 172.21.15.60:0/2193681778 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3404037040 con 0x7f340c15e7a0 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.212+0000 7f33f3fff640 1 -- 172.21.15.60:0/2193681778 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3404009510 con 0x7f340c15e7a0 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.212+0000 7f3412178640 1 -- 172.21.15.60:0/2193681778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340c1e8800 con 0x7f340c15e7a0 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.212+0000 7f3412178640 1 -- 172.21.15.60:0/2193681778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f340c0cbb70 con 0x7f340c15e7a0 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.213+0000 7f3412178640 1 -- 172.21.15.60:0/2193681778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f340c0cf760 con 0x7f340c15e7a0 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.214+0000 7f33f3fff640 1 -- 172.21.15.60:0/2193681778 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3404044020 con 0x7f340c15e7a0 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.214+0000 7f33f3fff640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f33f806be30 0x7f33f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.214+0000 7f33f3fff640 1 -- 172.21.15.60:0/2193681778 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f34040aafc0 con 0x7f340c15e7a0 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.214+0000 7f340b7fe640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f33f806be30 0x7f33f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.214+0000 7f340b7fe640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f33f806be30 0x7f33f806e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f340c0cee20 tx=0x7f33fc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:59.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.218+0000 7f33f3fff640 1 -- 172.21.15.60:0/2193681778 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f340404b020 con 0x7f340c15e7a0 2024-09-12T01:35:59.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.393+0000 7f3412178640 1 -- 172.21.15.60:0/2193681778 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f340c0d1ad0 con 0x7f340c15e7a0 2024-09-12T01:35:59.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.394+0000 7f33f3fff640 1 -- 172.21.15.60:0/2193681778 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7f34040793b0 con 0x7f340c15e7a0 2024-09-12T01:35:59.394 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:35:59.395 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:57.624089+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:35:53.846331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:35:54.965757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:35:59.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.396+0000 7f3412178640 1 -- 172.21.15.60:0/2193681778 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f33f806be30 msgr2=0x7f33f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.396+0000 7f3412178640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f33f806be30 0x7f33f806e2f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f340c0cee20 tx=0x7f33fc009190 comp rx=0 tx=0).stop 2024-09-12T01:35:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.396+0000 7f3412178640 1 -- 172.21.15.60:0/2193681778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c15e7a0 msgr2=0x7f340c1e81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.396+0000 7f3412178640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c15e7a0 0x7f340c1e81a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f340402adb0 tx=0x7f3404004a40 comp rx=0 tx=0).stop 2024-09-12T01:35:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.396+0000 7f3412178640 1 -- 172.21.15.60:0/2193681778 shutdown_connections 2024-09-12T01:35:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.396+0000 7f3412178640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f340c15e7a0 0x7f340c1e81a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.396+0000 7f3412178640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f340c0d3fe0 0x7f340c1e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.396+0000 7f3412178640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f33f806be30 0x7f33f806e2f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.396+0000 7f3412178640 1 --2- 172.21.15.60:0/2193681778 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f340c0cf2f0 0x7f340c15d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.396+0000 7f3412178640 1 -- 172.21.15.60:0/2193681778 >> 172.21.15.60:0/2193681778 conn(0x7f340c0d1550 msgr2=0x7f340c160e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.396+0000 7f3412178640 1 -- 172.21.15.60:0/2193681778 shutdown_connections 2024-09-12T01:35:59.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.396+0000 7f3412178640 1 -- 172.21.15.60:0/2193681778 wait complete. 2024-09-12T01:35:59.408 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:35:59.408 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:35:59.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.509+0000 7f5590386640 1 Processor -- start 2024-09-12T01:35:59.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.509+0000 7f5590386640 1 -- start start 2024-09-12T01:35:59.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.510+0000 7f5590386640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f558815e860 0x7f55880d2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.510+0000 7f5590386640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55880b6870 0x7f55880b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.510+0000 7f5590386640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55880d34c0 con 0x7f55880d2ff0 2024-09-12T01:35:59.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.510+0000 7f5590386640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f55880d40d0 con 0x7f55880b6870 2024-09-12T01:35:59.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.510+0000 7f5590386640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f55880d37a0 con 0x7f558815e860 2024-09-12T01:35:59.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.510+0000 7f558e923640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55880b6870 0x7f55880b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.510+0000 7f558d921640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f55880d2ff0 0x7f55880b6160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57816/0 (socket says 172.21.15.60:57816) 2024-09-12T01:35:59.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.510+0000 7f558d921640 1 -- 172.21.15.60:0/849065984 learned_addr learned my addr 172.21.15.60:0/849065984 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:35:59.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.510+0000 7f558e122640 1 --2- 172.21.15.60:0/849065984 >> v2:172.21.15.105:3300/0 conn(0x7f558815e860 0x7f55880d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.510+0000 7f558e923640 1 -- 172.21.15.60:0/849065984 >> v2:172.21.15.105:3300/0 conn(0x7f558815e860 msgr2=0x7f55880d2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:59.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.511+0000 7f558e923640 1 --2- 172.21.15.60:0/849065984 >> v2:172.21.15.105:3300/0 conn(0x7f558815e860 0x7f55880d2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.511+0000 7f558e923640 1 -- 172.21.15.60:0/849065984 >> v1:172.21.15.60:6789/0 conn(0x7f55880d2ff0 legacy=0x7f55880b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.511+0000 7f558e923640 1 -- 172.21.15.60:0/849065984 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55880d3a80 con 0x7f55880b6870 2024-09-12T01:35:59.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.511+0000 7f558d120640 1 -- 172.21.15.60:0/849065984 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 851735083 0 0) 0x7f55880d34c0 con 0x7f55880d2ff0 2024-09-12T01:35:59.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.511+0000 7f558e923640 1 --2- 172.21.15.60:0/849065984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55880b6870 0x7f55880b7880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f558806cfc0 tx=0x7f558002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a27a85c5ad164d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:59.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.511+0000 7f558d120640 1 -- 172.21.15.60:0/849065984 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580007740 con 0x7f55880b6870 2024-09-12T01:35:59.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.511+0000 7f558d120640 1 -- 172.21.15.60:0/849065984 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55800078e0 con 0x7f55880b6870 2024-09-12T01:35:59.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.511+0000 7f558d120640 1 -- 172.21.15.60:0/849065984 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580007cb0 con 0x7f55880b6870 2024-09-12T01:35:59.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.512+0000 7f5590386640 1 -- 172.21.15.60:0/849065984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55880b6870 msgr2=0x7f55880b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.512+0000 7f5590386640 1 --2- 172.21.15.60:0/849065984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55880b6870 0x7f55880b7880 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f558806cfc0 tx=0x7f558002a680 comp rx=0 tx=0).stop 2024-09-12T01:35:59.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.512+0000 7f5590386640 1 -- 172.21.15.60:0/849065984 shutdown_connections 2024-09-12T01:35:59.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.512+0000 7f5590386640 1 --2- 172.21.15.60:0/849065984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55880b6870 0x7f55880b7880 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.512+0000 7f5590386640 1 --2- 172.21.15.60:0/849065984 >> v2:172.21.15.105:3300/0 conn(0x7f558815e860 0x7f55880d2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.512+0000 7f5590386640 1 -- 172.21.15.60:0/849065984 >> 172.21.15.60:0/849065984 conn(0x7f5588062c60 msgr2=0x7f55880d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:59.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.512+0000 7f5590386640 1 -- 172.21.15.60:0/849065984 shutdown_connections 2024-09-12T01:35:59.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.512+0000 7f5590386640 1 -- 172.21.15.60:0/849065984 wait complete. 2024-09-12T01:35:59.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.513+0000 7f5590386640 1 Processor -- start 2024-09-12T01:35:59.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.513+0000 7f5590386640 1 -- start start 2024-09-12T01:35:59.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f5590386640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55880b6870 0x7f55881612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f5590386640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55880d2ff0 0x7f55881582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f5590386640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f558815e860 0x7f55881587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f5590386640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f55880b3a10 con 0x7f558815e860 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f5590386640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f55880b3890 con 0x7f55880b6870 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f5590386640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f55880b7dc0 con 0x7f55880d2ff0 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f558e923640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f558815e860 0x7f55881587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f558e923640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f558815e860 0x7f55881587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33804/0 (socket says 172.21.15.60:33804) 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f558e923640 1 -- 172.21.15.60:0/1311662826 learned_addr learned my addr 172.21.15.60:0/1311662826 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f558e122640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55880b6870 0x7f55881612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f558d921640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55880d2ff0 0x7f55881582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f558e923640 1 -- 172.21.15.60:0/1311662826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55880d2ff0 msgr2=0x7f55881582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f558e923640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55880d2ff0 0x7f55881582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f558e923640 1 -- 172.21.15.60:0/1311662826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55880b6870 msgr2=0x7f55881612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f558e923640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55880b6870 0x7f55881612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.514+0000 7f558e923640 1 -- 172.21.15.60:0/1311662826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558815b050 con 0x7f558815e860 2024-09-12T01:35:59.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.515+0000 7f558e923640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f558815e860 0x7f55881587f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5580009e80 tx=0x7f5580004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:59.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.515+0000 7f557effd640 1 -- 172.21.15.60:0/1311662826 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580040070 con 0x7f558815e860 2024-09-12T01:35:59.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.515+0000 7f557effd640 1 -- 172.21.15.60:0/1311662826 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5580031bc0 con 0x7f558815e860 2024-09-12T01:35:59.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.515+0000 7f557effd640 1 -- 172.21.15.60:0/1311662826 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5580009450 con 0x7f558815e860 2024-09-12T01:35:59.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.515+0000 7f5590386640 1 -- 172.21.15.60:0/1311662826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558815b330 con 0x7f558815e860 2024-09-12T01:35:59.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.515+0000 7f5590386640 1 -- 172.21.15.60:0/1311662826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5588159160 con 0x7f558815e860 2024-09-12T01:35:59.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.516+0000 7f5590386640 1 -- 172.21.15.60:0/1311662826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55880b7880 con 0x7f558815e860 2024-09-12T01:35:59.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.516+0000 7f557effd640 1 -- 172.21.15.60:0/1311662826 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5580039040 con 0x7f558815e860 2024-09-12T01:35:59.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.517+0000 7f557effd640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f556c06be30 0x7f556c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.517+0000 7f557effd640 1 -- 172.21.15.60:0/1311662826 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f55800abdc0 con 0x7f558815e860 2024-09-12T01:35:59.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.517+0000 7f558e122640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f556c06be30 0x7f556c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.517+0000 7f558e122640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f556c06be30 0x7f556c06e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f55840079a0 tx=0x7f5584008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:59.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.521+0000 7f557effd640 1 -- 172.21.15.60:0/1311662826 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f558007a080 con 0x7f558815e860 2024-09-12T01:35:59.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.693+0000 7f5590386640 1 -- 172.21.15.60:0/1311662826 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5588161810 con 0x7f556c06be30 2024-09-12T01:35:59.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.699+0000 7f557effd640 1 -- 172.21.15.60:0/1311662826 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242976 (secure 0 0 0) 0x7f55840108d0 con 0x7f556c06be30 2024-09-12T01:35:59.702 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:35:59.704 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:35:59.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.702+0000 7f5590386640 1 -- 172.21.15.60:0/1311662826 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f556c06be30 msgr2=0x7f556c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.702+0000 7f5590386640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f556c06be30 0x7f556c06e2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f55840079a0 tx=0x7f5584008040 comp rx=0 tx=0).stop 2024-09-12T01:35:59.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.702+0000 7f5590386640 1 -- 172.21.15.60:0/1311662826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f558815e860 msgr2=0x7f55881587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.702+0000 7f5590386640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f558815e860 0x7f55881587f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5580009e80 tx=0x7f5580004a40 comp rx=0 tx=0).stop 2024-09-12T01:35:59.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.702+0000 7f5590386640 1 -- 172.21.15.60:0/1311662826 shutdown_connections 2024-09-12T01:35:59.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.702+0000 7f5590386640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f558815e860 0x7f55881587f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.702+0000 7f5590386640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f556c06be30 0x7f556c06e2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.702+0000 7f5590386640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55880d2ff0 0x7f55881582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.702+0000 7f5590386640 1 --2- 172.21.15.60:0/1311662826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55880b6870 0x7f55881612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.702+0000 7f5590386640 1 -- 172.21.15.60:0/1311662826 >> 172.21.15.60:0/1311662826 conn(0x7f5588062c60 msgr2=0x7f55880cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:59.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.702+0000 7f5590386640 1 -- 172.21.15.60:0/1311662826 shutdown_connections 2024-09-12T01:35:59.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.702+0000 7f5590386640 1 -- 172.21.15.60:0/1311662826 wait complete. 2024-09-12T01:35:59.713 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T01:35:58.260431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235552,"kb_used_data":2684,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739168,"statfs":{"total":773094113280,"available":772852908032,"internally_reserved":0,"allocated":2748416,"data_stored":1669999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000884"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.628171+0000","last_change":"2024-09-12T01:35:55.628171+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.628171+0000","last_undegraded":"2024-09-12T01:35:55.628171+0000","last_fullsized":"2024-09-12T01:35:55.628171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619679+0000","last_change":"2024-09-12T01:35:55.619679+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619679+0000","last_undegraded":"2024-09-12T01:35:55.619679+0000","last_fullsized":"2024-09-12T01:35:55.619679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617675+0000","last_change":"2024-09-12T01:35:55.617675+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617675+0000","last_undegraded":"2024-09-12T01:35:55.617675+0000","last_fullsized":"2024-09-12T01:35:55.617675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620008+0000","last_change":"2024-09-12T01:35:55.620008+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620008+0000","last_undegraded":"2024-09-12T01:35:55.620008+0000","last_fullsized":"2024-09-12T01:35:55.620008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623789+0000","last_change":"2024-09-12T01:35:55.623789+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623789+0000","last_undegraded":"2024-09-12T01:35:55.623789+0000","last_fullsized":"2024-09-12T01:35:55.623789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619901+0000","last_change":"2024-09-12T01:35:55.619901+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619901+0000","last_undegraded":"2024-09-12T01:35:55.619901+0000","last_fullsized":"2024-09-12T01:35:55.619901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622730+0000","last_change":"2024-09-12T01:35:55.622730+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622730+0000","last_undegraded":"2024-09-12T01:35:55.622730+0000","last_fullsized":"2024-09-12T01:35:55.622730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619838+0000","last_change":"2024-09-12T01:35:55.619838+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619838+0000","last_undegraded":"2024-09-12T01:35:55.619838+0000","last_fullsized":"2024-09-12T01:35:55.619838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617420+0000","last_change":"2024-09-12T01:35:55.617420+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617420+0000","last_undegraded":"2024-09-12T01:35:55.617420+0000","last_fullsized":"2024-09-12T01:35:55.617420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624063+0000","last_change":"2024-09-12T01:35:55.624063+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624063+0000","last_undegraded":"2024-09-12T01:35:55.624063+0000","last_fullsized":"2024-09-12T01:35:55.624063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625169+0000","last_change":"2024-09-12T01:35:55.625169+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625169+0000","last_undegraded":"2024-09-12T01:35:55.625169+0000","last_fullsized":"2024-09-12T01:35:55.625169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625373+0000","last_change":"2024-09-12T01:35:55.625373+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625373+0000","last_undegraded":"2024-09-12T01:35:55.625373+0000","last_fullsized":"2024-09-12T01:35:55.625373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.618586+0000","last_change":"2024-09-12T01:35:55.618586+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618586+0000","last_undegraded":"2024-09-12T01:35:55.618586+0000","last_fullsized":"2024-09-12T01:35:55.618586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625198+0000","last_change":"2024-09-12T01:35:55.625198+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625198+0000","last_undegraded":"2024-09-12T01:35:55.625198+0000","last_fullsized":"2024-09-12T01:35:55.625198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622142+0000","last_change":"2024-09-12T01:35:55.622142+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622142+0000","last_undegraded":"2024-09-12T01:35:55.622142+0000","last_fullsized":"2024-09-12T01:35:55.622142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620296+0000","last_change":"2024-09-12T01:35:55.620296+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620296+0000","last_undegraded":"2024-09-12T01:35:55.620296+0000","last_fullsized":"2024-09-12T01:35:55.620296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623080+0000","last_change":"2024-09-12T01:35:55.623080+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623080+0000","last_undegraded":"2024-09-12T01:35:55.623080+0000","last_fullsized":"2024-09-12T01:35:55.623080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624919+0000","last_change":"2024-09-12T01:35:55.624919+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624919+0000","last_undegraded":"2024-09-12T01:35:55.624919+0000","last_fullsized":"2024-09-12T01:35:55.624919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.618101+0000","last_change":"2024-09-12T01:35:55.618101+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618101+0000","last_undegraded":"2024-09-12T01:35:55.618101+0000","last_fullsized":"2024-09-12T01:35:55.618101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617490+0000","last_change":"2024-09-12T01:35:55.617490+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617490+0000","last_undegraded":"2024-09-12T01:35:55.617490+0000","last_fullsized":"2024-09-12T01:35:55.617490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622303+0000","last_change":"2024-09-12T01:35:55.622303+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622303+0000","last_undegraded":"2024-09-12T01:35:55.622303+0000","last_fullsized":"2024-09-12T01:35:55.622303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619766+0000","last_change":"2024-09-12T01:35:55.619766+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619766+0000","last_undegraded":"2024-09-12T01:35:55.619766+0000","last_fullsized":"2024-09-12T01:35:55.619766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621156+0000","last_change":"2024-09-12T01:35:55.621156+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621156+0000","last_undegraded":"2024-09-12T01:35:55.621156+0000","last_fullsized":"2024-09-12T01:35:55.621156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617690+0000","last_change":"2024-09-12T01:35:55.617690+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617690+0000","last_undegraded":"2024-09-12T01:35:55.617690+0000","last_fullsized":"2024-09-12T01:35:55.617690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621917+0000","last_change":"2024-09-12T01:35:55.621917+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621917+0000","last_undegraded":"2024-09-12T01:35:55.621917+0000","last_fullsized":"2024-09-12T01:35:55.621917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620388+0000","last_change":"2024-09-12T01:35:55.620388+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620388+0000","last_undegraded":"2024-09-12T01:35:55.620388+0000","last_fullsized":"2024-09-12T01:35:55.620388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619468+0000","last_change":"2024-09-12T01:35:55.619468+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619468+0000","last_undegraded":"2024-09-12T01:35:55.619468+0000","last_fullsized":"2024-09-12T01:35:55.619468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617380+0000","last_change":"2024-09-12T01:35:55.617380+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617380+0000","last_undegraded":"2024-09-12T01:35:55.617380+0000","last_fullsized":"2024-09-12T01:35:55.617380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.619533+0000","last_change":"2024-09-12T01:35:55.619533+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619533+0000","last_undegraded":"2024-09-12T01:35:55.619533+0000","last_fullsized":"2024-09-12T01:35:55.619533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620979+0000","last_change":"2024-09-12T01:35:55.620979+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620979+0000","last_undegraded":"2024-09-12T01:35:55.620979+0000","last_fullsized":"2024-09-12T01:35:55.620979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.616863+0000","last_change":"2024-09-12T01:35:54.616863+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.616863+0000","last_undegraded":"2024-09-12T01:35:54.616863+0000","last_fullsized":"2024-09-12T01:35:54.616863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617529+0000","last_change":"2024-09-12T01:35:55.617529+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617529+0000","last_undegraded":"2024-09-12T01:35:55.617529+0000","last_fullsized":"2024-09-12T01:35:55.617529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621628+0000","last_change":"2024-09-12T01:35:55.621628+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621628+0000","last_undegraded":"2024-09-12T01:35:55.621628+0000","last_fullsized":"2024-09-12T01:35:55.621628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.617259+0000","last_change":"2024-09-12T01:35:55.617259+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617259+0000","last_undegraded":"2024-09-12T01:35:55.617259+0000","last_fullsized":"2024-09-12T01:35:55.617259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620673+0000","last_change":"2024-09-12T01:35:55.620673+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620673+0000","last_undegraded":"2024-09-12T01:35:55.620673+0000","last_fullsized":"2024-09-12T01:35:55.620673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621631+0000","last_change":"2024-09-12T01:35:55.621631+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621631+0000","last_undegraded":"2024-09-12T01:35:55.621631+0000","last_fullsized":"2024-09-12T01:35:55.621631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617596+0000","last_change":"2024-09-12T01:35:55.617596+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617596+0000","last_undegraded":"2024-09-12T01:35:55.617596+0000","last_fullsized":"2024-09-12T01:35:55.617596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.616803+0000","last_change":"2024-09-12T01:35:54.616803+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.616803+0000","last_undegraded":"2024-09-12T01:35:54.616803+0000","last_fullsized":"2024-09-12T01:35:54.616803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622699+0000","last_change":"2024-09-12T01:35:55.622699+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622699+0000","last_undegraded":"2024-09-12T01:35:55.622699+0000","last_fullsized":"2024-09-12T01:35:55.622699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.615864+0000","last_change":"2024-09-12T01:35:55.615864+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.615864+0000","last_undegraded":"2024-09-12T01:35:55.615864+0000","last_fullsized":"2024-09-12T01:35:55.615864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624634+0000","last_change":"2024-09-12T01:35:55.624634+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624634+0000","last_undegraded":"2024-09-12T01:35:55.624634+0000","last_fullsized":"2024-09-12T01:35:55.624634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.616840+0000","last_change":"2024-09-12T01:35:54.616840+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.616840+0000","last_undegraded":"2024-09-12T01:35:54.616840+0000","last_fullsized":"2024-09-12T01:35:54.616840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620906+0000","last_change":"2024-09-12T01:35:55.620906+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620906+0000","last_undegraded":"2024-09-12T01:35:55.620906+0000","last_fullsized":"2024-09-12T01:35:55.620906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623965+0000","last_change":"2024-09-12T01:35:55.623965+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623965+0000","last_undegraded":"2024-09-12T01:35:55.623965+0000","last_fullsized":"2024-09-12T01:35:55.623965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.622266+0000","last_change":"2024-09-12T01:35:55.622266+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622266+0000","last_undegraded":"2024-09-12T01:35:55.622266+0000","last_fullsized":"2024-09-12T01:35:55.622266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617336+0000","last_change":"2024-09-12T01:35:55.617336+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617336+0000","last_undegraded":"2024-09-12T01:35:55.617336+0000","last_fullsized":"2024-09-12T01:35:55.617336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:54.606018+0000","last_change":"2024-09-12T01:35:54.606018+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.606018+0000","last_undegraded":"2024-09-12T01:35:54.606018+0000","last_fullsized":"2024-09-12T01:35:54.606018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621216+0000","last_change":"2024-09-12T01:35:55.621216+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621216+0000","last_undegraded":"2024-09-12T01:35:55.621216+0000","last_fullsized":"2024-09-12T01:35:55.621216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.625866+0000","last_change":"2024-09-12T01:35:55.625866+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625866+0000","last_undegraded":"2024-09-12T01:35:55.625866+0000","last_fullsized":"2024-09-12T01:35:55.625866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619560+0000","last_change":"2024-09-12T01:35:55.619560+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619560+0000","last_undegraded":"2024-09-12T01:35:55.619560+0000","last_fullsized":"2024-09-12T01:35:55.619560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:54.606018+0000","last_change":"2024-09-12T01:35:54.606018+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.606018+0000","last_undegraded":"2024-09-12T01:35:54.606018+0000","last_fullsized":"2024-09-12T01:35:54.606018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625776+0000","last_change":"2024-09-12T01:35:55.625776+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625776+0000","last_undegraded":"2024-09-12T01:35:55.625776+0000","last_fullsized":"2024-09-12T01:35:55.625776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620076+0000","last_change":"2024-09-12T01:35:55.620076+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620076+0000","last_undegraded":"2024-09-12T01:35:55.620076+0000","last_fullsized":"2024-09-12T01:35:55.620076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623700+0000","last_change":"2024-09-12T01:35:55.623700+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623700+0000","last_undegraded":"2024-09-12T01:35:55.623700+0000","last_fullsized":"2024-09-12T01:35:55.623700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.617520+0000","last_change":"2024-09-12T01:35:54.617520+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.617520+0000","last_undegraded":"2024-09-12T01:35:54.617520+0000","last_fullsized":"2024-09-12T01:35:54.617520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624235+0000","last_change":"2024-09-12T01:35:55.624235+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624235+0000","last_undegraded":"2024-09-12T01:35:55.624235+0000","last_fullsized":"2024-09-12T01:35:55.624235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T01:35:55.618559+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:35:55.618559+0000","last_peered":"2024-09-12T01:35:55.618559+0000","last_clean":"2024-09-12T01:35:55.618559+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:35:55.618559+0000","last_undegraded":"2024-09-12T01:35:55.618559+0000","last_fullsized":"2024-09-12T01:35:55.618559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.622144+0000","last_change":"2024-09-12T01:35:55.622144+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622144+0000","last_undegraded":"2024-09-12T01:35:55.622144+0000","last_fullsized":"2024-09-12T01:35:55.622144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621589+0000","last_change":"2024-09-12T01:35:55.621589+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621589+0000","last_undegraded":"2024-09-12T01:35:55.621589+0000","last_fullsized":"2024-09-12T01:35:55.621589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621251+0000","last_change":"2024-09-12T01:35:55.621251+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621251+0000","last_undegraded":"2024-09-12T01:35:55.621251+0000","last_fullsized":"2024-09-12T01:35:55.621251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619326+0000","last_change":"2024-09-12T01:35:55.619326+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619326+0000","last_undegraded":"2024-09-12T01:35:55.619326+0000","last_fullsized":"2024-09-12T01:35:55.619326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620581+0000","last_change":"2024-09-12T01:35:55.620581+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620581+0000","last_undegraded":"2024-09-12T01:35:55.620581+0000","last_fullsized":"2024-09-12T01:35:55.620581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.626444+0000","last_change":"2024-09-12T01:35:55.626444+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.626444+0000","last_undegraded":"2024-09-12T01:35:55.626444+0000","last_fullsized":"2024-09-12T01:35:55.626444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.618319+0000","last_change":"2024-09-12T01:35:55.618319+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618319+0000","last_undegraded":"2024-09-12T01:35:55.618319+0000","last_fullsized":"2024-09-12T01:35:55.618319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619440+0000","last_change":"2024-09-12T01:35:55.619440+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619440+0000","last_undegraded":"2024-09-12T01:35:55.619440+0000","last_fullsized":"2024-09-12T01:35:55.619440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621690+0000","last_change":"2024-09-12T01:35:55.621690+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621690+0000","last_undegraded":"2024-09-12T01:35:55.621690+0000","last_fullsized":"2024-09-12T01:35:55.621690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:54.606018+0000","last_change":"2024-09-12T01:35:54.606018+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.606018+0000","last_undegraded":"2024-09-12T01:35:54.606018+0000","last_fullsized":"2024-09-12T01:35:54.606018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620792+0000","last_change":"2024-09-12T01:35:55.620792+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620792+0000","last_undegraded":"2024-09-12T01:35:55.620792+0000","last_fullsized":"2024-09-12T01:35:55.620792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":4,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.629279+0000","last_change":"2024-09-12T01:35:55.621704+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.629279+0000","last_undegraded":"2024-09-12T01:35:55.629279+0000","last_fullsized":"2024-09-12T01:35:55.629279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620599+0000","last_change":"2024-09-12T01:35:55.620599+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620599+0000","last_undegraded":"2024-09-12T01:35:55.620599+0000","last_fullsized":"2024-09-12T01:35:55.620599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:54.606018+0000","last_change":"2024-09-12T01:35:54.606018+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.606018+0000","last_undegraded":"2024-09-12T01:35:54.606018+0000","last_fullsized":"2024-09-12T01:35:54.606018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.617559+0000","last_change":"2024-09-12T01:35:54.617559+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.617559+0000","last_undegraded":"2024-09-12T01:35:54.617559+0000","last_fullsized":"2024-09-12T01:35:54.617559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620277+0000","last_change":"2024-09-12T01:35:55.620277+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620277+0000","last_undegraded":"2024-09-12T01:35:55.620277+0000","last_fullsized":"2024-09-12T01:35:55.620277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.622581+0000","last_change":"2024-09-12T01:35:55.622581+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622581+0000","last_undegraded":"2024-09-12T01:35:55.622581+0000","last_fullsized":"2024-09-12T01:35:55.622581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621419+0000","last_change":"2024-09-12T01:35:55.621419+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621419+0000","last_undegraded":"2024-09-12T01:35:55.621419+0000","last_fullsized":"2024-09-12T01:35:55.621419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624687+0000","last_change":"2024-09-12T01:35:55.624687+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624687+0000","last_undegraded":"2024-09-12T01:35:55.624687+0000","last_fullsized":"2024-09-12T01:35:55.624687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.625951+0000","last_change":"2024-09-12T01:35:55.625951+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625951+0000","last_undegraded":"2024-09-12T01:35:55.625951+0000","last_fullsized":"2024-09-12T01:35:55.625951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617407+0000","last_change":"2024-09-12T01:35:55.617407+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617407+0000","last_undegraded":"2024-09-12T01:35:55.617407+0000","last_fullsized":"2024-09-12T01:35:55.617407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.624201+0000","last_change":"2024-09-12T01:35:55.624201+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624201+0000","last_undegraded":"2024-09-12T01:35:55.624201+0000","last_fullsized":"2024-09-12T01:35:55.624201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.618323+0000","last_change":"2024-09-12T01:35:55.618323+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618323+0000","last_undegraded":"2024-09-12T01:35:55.618323+0000","last_fullsized":"2024-09-12T01:35:55.618323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.617912+0000","last_change":"2024-09-12T01:35:55.617912+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617912+0000","last_undegraded":"2024-09-12T01:35:55.617912+0000","last_fullsized":"2024-09-12T01:35:55.617912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617790+0000","last_change":"2024-09-12T01:35:55.617790+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617790+0000","last_undegraded":"2024-09-12T01:35:55.617790+0000","last_fullsized":"2024-09-12T01:35:55.617790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:54.606018+0000","last_change":"2024-09-12T01:35:54.606018+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.606018+0000","last_undegraded":"2024-09-12T01:35:54.606018+0000","last_fullsized":"2024-09-12T01:35:54.606018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":6},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:35:59.718 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:35:59.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.855+0000 7efd06549640 1 Processor -- start 2024-09-12T01:35:59.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.855+0000 7efd06549640 1 -- start start 2024-09-12T01:35:59.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.855+0000 7efd06549640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd000d1820 0x7efd001691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.855+0000 7efd06549640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd0015ea40 con 0x7efd000d3310 2024-09-12T01:35:59.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.855+0000 7efd06549640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd000d3870 con 0x7efd0015e660 2024-09-12T01:35:59.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.855+0000 7efd06549640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7efd000d3b50 con 0x7efd000d1820 2024-09-12T01:35:59.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.856+0000 7efd04ae6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd000d1820 0x7efd001691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.856+0000 7efcff7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efd000d3310 0x7efd000d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57832/0 (socket says 172.21.15.60:57832) 2024-09-12T01:35:59.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.856+0000 7efd04ae6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd000d1820 0x7efd001691c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33818/0 (socket says 172.21.15.60:33818) 2024-09-12T01:35:59.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.856+0000 7efcff7fe640 1 -- 172.21.15.60:0/790190491 learned_addr learned my addr 172.21.15.60:0/790190491 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:35:59.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.856+0000 7efd04ae6640 1 -- 172.21.15.60:0/790190491 >> v1:172.21.15.105:6789/0 conn(0x7efd0015e660 legacy=0x7efd000cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:35:59.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.856+0000 7efd04ae6640 1 -- 172.21.15.60:0/790190491 >> v1:172.21.15.60:6789/0 conn(0x7efd000d3310 legacy=0x7efd000d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.856+0000 7efd04ae6640 1 -- 172.21.15.60:0/790190491 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd000d3e30 con 0x7efd000d1820 2024-09-12T01:35:59.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.857+0000 7efd04ae6640 1 --2- 172.21.15.60:0/790190491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd000d1820 0x7efd001691c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009d90 tx=0x7efcf802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be17302e505e891e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:59.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.857+0000 7efcfeffd640 1 -- 172.21.15.60:0/790190491 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8007740 con 0x7efd000d1820 2024-09-12T01:35:59.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.857+0000 7efcfeffd640 1 -- 172.21.15.60:0/790190491 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf80078e0 con 0x7efd000d1820 2024-09-12T01:35:59.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.857+0000 7efcfeffd640 1 -- 172.21.15.60:0/790190491 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf8007cb0 con 0x7efd000d1820 2024-09-12T01:35:59.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.857+0000 7efd06549640 1 -- 172.21.15.60:0/790190491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd000d1820 msgr2=0x7efd001691c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.857+0000 7efd06549640 1 --2- 172.21.15.60:0/790190491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd000d1820 0x7efd001691c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009d90 tx=0x7efcf802a6a0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.857+0000 7efd06549640 1 -- 172.21.15.60:0/790190491 shutdown_connections 2024-09-12T01:35:59.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.857+0000 7efd06549640 1 --2- 172.21.15.60:0/790190491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd000d1820 0x7efd001691c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.857+0000 7efd06549640 1 -- 172.21.15.60:0/790190491 >> 172.21.15.60:0/790190491 conn(0x7efd000b6410 msgr2=0x7efd000b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:35:59.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.857+0000 7efd06549640 1 -- 172.21.15.60:0/790190491 shutdown_connections 2024-09-12T01:35:59.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.857+0000 7efd06549640 1 -- 172.21.15.60:0/790190491 wait complete. 2024-09-12T01:35:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.859+0000 7efd06549640 1 Processor -- start 2024-09-12T01:35:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.859+0000 7efd06549640 1 -- start start 2024-09-12T01:35:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.859+0000 7efd06549640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd000d1820 0x7efd00161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.859+0000 7efd06549640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd000d3310 0x7efd000c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.859+0000 7efd06549640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd0015e660 0x7efd000ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.859+0000 7efd06549640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efd000b8b80 con 0x7efd000d3310 2024-09-12T01:35:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.859+0000 7efd06549640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efd000d43f0 con 0x7efd000d1820 2024-09-12T01:35:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.859+0000 7efd06549640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efd000b8d00 con 0x7efd0015e660 2024-09-12T01:35:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcff7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd000d3310 0x7efd000c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcff7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd000d3310 0x7efd000c9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33826/0 (socket says 172.21.15.60:33826) 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcff7fe640 1 -- 172.21.15.60:0/1700594847 learned_addr learned my addr 172.21.15.60:0/1700594847 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcfffff640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd000d1820 0x7efd00161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efd04ae6640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd0015e660 0x7efd000ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcff7fe640 1 -- 172.21.15.60:0/1700594847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd0015e660 msgr2=0x7efd000ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcff7fe640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd0015e660 0x7efd000ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcff7fe640 1 -- 172.21.15.60:0/1700594847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd000d1820 msgr2=0x7efd00161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcff7fe640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd000d1820 0x7efd00161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcff7fe640 1 -- 172.21.15.60:0/1700594847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd000c8230 con 0x7efd000d3310 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcfffff640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd000d1820 0x7efd00161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efd04ae6640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd0015e660 0x7efd000ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcff7fe640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd000d3310 0x7efd000c9d30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efcf400c430 tx=0x7efcf400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcfcff9640 1 -- 172.21.15.60:0/1700594847 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4017070 con 0x7efd000d3310 2024-09-12T01:35:59.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcfcff9640 1 -- 172.21.15.60:0/1700594847 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf4005ce0 con 0x7efd000d3310 2024-09-12T01:35:59.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efcfcff9640 1 -- 172.21.15.60:0/1700594847 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf40072f0 con 0x7efd000d3310 2024-09-12T01:35:59.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efd06549640 1 -- 172.21.15.60:0/1700594847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd001f3fe0 con 0x7efd000d3310 2024-09-12T01:35:59.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.860+0000 7efd06549640 1 -- 172.21.15.60:0/1700594847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd000c87d0 con 0x7efd000d3310 2024-09-12T01:35:59.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.861+0000 7efd06549640 1 -- 172.21.15.60:0/1700594847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd000d1110 con 0x7efd000d3310 2024-09-12T01:35:59.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.862+0000 7efcfcff9640 1 -- 172.21.15.60:0/1700594847 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efcf401a070 con 0x7efd000d3310 2024-09-12T01:35:59.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.862+0000 7efcfcff9640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efcec06be30 0x7efcec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:35:59.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.862+0000 7efcfcff9640 1 -- 172.21.15.60:0/1700594847 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efcf408a390 con 0x7efd000d3310 2024-09-12T01:35:59.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.862+0000 7efcfffff640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efcec06be30 0x7efcec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:35:59.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.863+0000 7efcfffff640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efcec06be30 0x7efcec06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efcf0003eb0 tx=0x7efcf0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:35:59.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:35:59.867+0000 7efcfcff9640 1 -- 172.21.15.60:0/1700594847 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efcf4058c10 con 0x7efd000d3310 2024-09-12T01:36:00.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.037+0000 7efd06549640 1 -- 172.21.15.60:0/1700594847 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efd0015c770 con 0x7efcec06be30 2024-09-12T01:36:00.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.043+0000 7efcfcff9640 1 -- 172.21.15.60:0/1700594847 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242976 (secure 0 0 0) 0x7efcf0053530 con 0x7efcec06be30 2024-09-12T01:36:00.045 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:00.047 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:36:00.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.046+0000 7efd06549640 1 -- 172.21.15.60:0/1700594847 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efcec06be30 msgr2=0x7efcec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.046+0000 7efd06549640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efcec06be30 0x7efcec06e2f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efcf0003eb0 tx=0x7efcf0009040 comp rx=0 tx=0).stop 2024-09-12T01:36:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.046+0000 7efd06549640 1 -- 172.21.15.60:0/1700594847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd000d3310 msgr2=0x7efd000c9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.046+0000 7efd06549640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd000d3310 0x7efd000c9d30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efcf400c430 tx=0x7efcf400c8f0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.046+0000 7efd06549640 1 -- 172.21.15.60:0/1700594847 shutdown_connections 2024-09-12T01:36:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.046+0000 7efd06549640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efcec06be30 0x7efcec06e2f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.046+0000 7efd06549640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd0015e660 0x7efd000ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.046+0000 7efd06549640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd000d3310 0x7efd000c9d30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.046+0000 7efd06549640 1 --2- 172.21.15.60:0/1700594847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd000d1820 0x7efd00161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.046+0000 7efd06549640 1 -- 172.21.15.60:0/1700594847 >> 172.21.15.60:0/1700594847 conn(0x7efd000b6410 msgr2=0x7efd000b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.046+0000 7efd06549640 1 -- 172.21.15.60:0/1700594847 shutdown_connections 2024-09-12T01:36:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.046+0000 7efd06549640 1 -- 172.21.15.60:0/1700594847 wait complete. 2024-09-12T01:36:00.057 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T01:35:58.260431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235552,"kb_used_data":2684,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739168,"statfs":{"total":773094113280,"available":772852908032,"internally_reserved":0,"allocated":2748416,"data_stored":1669999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000884"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.628171+0000","last_change":"2024-09-12T01:35:55.628171+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.628171+0000","last_undegraded":"2024-09-12T01:35:55.628171+0000","last_fullsized":"2024-09-12T01:35:55.628171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619679+0000","last_change":"2024-09-12T01:35:55.619679+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619679+0000","last_undegraded":"2024-09-12T01:35:55.619679+0000","last_fullsized":"2024-09-12T01:35:55.619679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617675+0000","last_change":"2024-09-12T01:35:55.617675+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617675+0000","last_undegraded":"2024-09-12T01:35:55.617675+0000","last_fullsized":"2024-09-12T01:35:55.617675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620008+0000","last_change":"2024-09-12T01:35:55.620008+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620008+0000","last_undegraded":"2024-09-12T01:35:55.620008+0000","last_fullsized":"2024-09-12T01:35:55.620008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623789+0000","last_change":"2024-09-12T01:35:55.623789+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623789+0000","last_undegraded":"2024-09-12T01:35:55.623789+0000","last_fullsized":"2024-09-12T01:35:55.623789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619901+0000","last_change":"2024-09-12T01:35:55.619901+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619901+0000","last_undegraded":"2024-09-12T01:35:55.619901+0000","last_fullsized":"2024-09-12T01:35:55.619901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622730+0000","last_change":"2024-09-12T01:35:55.622730+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622730+0000","last_undegraded":"2024-09-12T01:35:55.622730+0000","last_fullsized":"2024-09-12T01:35:55.622730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619838+0000","last_change":"2024-09-12T01:35:55.619838+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619838+0000","last_undegraded":"2024-09-12T01:35:55.619838+0000","last_fullsized":"2024-09-12T01:35:55.619838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617420+0000","last_change":"2024-09-12T01:35:55.617420+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617420+0000","last_undegraded":"2024-09-12T01:35:55.617420+0000","last_fullsized":"2024-09-12T01:35:55.617420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624063+0000","last_change":"2024-09-12T01:35:55.624063+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624063+0000","last_undegraded":"2024-09-12T01:35:55.624063+0000","last_fullsized":"2024-09-12T01:35:55.624063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625169+0000","last_change":"2024-09-12T01:35:55.625169+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625169+0000","last_undegraded":"2024-09-12T01:35:55.625169+0000","last_fullsized":"2024-09-12T01:35:55.625169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625373+0000","last_change":"2024-09-12T01:35:55.625373+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625373+0000","last_undegraded":"2024-09-12T01:35:55.625373+0000","last_fullsized":"2024-09-12T01:35:55.625373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.618586+0000","last_change":"2024-09-12T01:35:55.618586+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618586+0000","last_undegraded":"2024-09-12T01:35:55.618586+0000","last_fullsized":"2024-09-12T01:35:55.618586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625198+0000","last_change":"2024-09-12T01:35:55.625198+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625198+0000","last_undegraded":"2024-09-12T01:35:55.625198+0000","last_fullsized":"2024-09-12T01:35:55.625198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622142+0000","last_change":"2024-09-12T01:35:55.622142+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622142+0000","last_undegraded":"2024-09-12T01:35:55.622142+0000","last_fullsized":"2024-09-12T01:35:55.622142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620296+0000","last_change":"2024-09-12T01:35:55.620296+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620296+0000","last_undegraded":"2024-09-12T01:35:55.620296+0000","last_fullsized":"2024-09-12T01:35:55.620296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623080+0000","last_change":"2024-09-12T01:35:55.623080+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623080+0000","last_undegraded":"2024-09-12T01:35:55.623080+0000","last_fullsized":"2024-09-12T01:35:55.623080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624919+0000","last_change":"2024-09-12T01:35:55.624919+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624919+0000","last_undegraded":"2024-09-12T01:35:55.624919+0000","last_fullsized":"2024-09-12T01:35:55.624919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.618101+0000","last_change":"2024-09-12T01:35:55.618101+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618101+0000","last_undegraded":"2024-09-12T01:35:55.618101+0000","last_fullsized":"2024-09-12T01:35:55.618101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617490+0000","last_change":"2024-09-12T01:35:55.617490+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617490+0000","last_undegraded":"2024-09-12T01:35:55.617490+0000","last_fullsized":"2024-09-12T01:35:55.617490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622303+0000","last_change":"2024-09-12T01:35:55.622303+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622303+0000","last_undegraded":"2024-09-12T01:35:55.622303+0000","last_fullsized":"2024-09-12T01:35:55.622303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619766+0000","last_change":"2024-09-12T01:35:55.619766+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619766+0000","last_undegraded":"2024-09-12T01:35:55.619766+0000","last_fullsized":"2024-09-12T01:35:55.619766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621156+0000","last_change":"2024-09-12T01:35:55.621156+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621156+0000","last_undegraded":"2024-09-12T01:35:55.621156+0000","last_fullsized":"2024-09-12T01:35:55.621156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617690+0000","last_change":"2024-09-12T01:35:55.617690+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617690+0000","last_undegraded":"2024-09-12T01:35:55.617690+0000","last_fullsized":"2024-09-12T01:35:55.617690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621917+0000","last_change":"2024-09-12T01:35:55.621917+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621917+0000","last_undegraded":"2024-09-12T01:35:55.621917+0000","last_fullsized":"2024-09-12T01:35:55.621917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620388+0000","last_change":"2024-09-12T01:35:55.620388+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620388+0000","last_undegraded":"2024-09-12T01:35:55.620388+0000","last_fullsized":"2024-09-12T01:35:55.620388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619468+0000","last_change":"2024-09-12T01:35:55.619468+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619468+0000","last_undegraded":"2024-09-12T01:35:55.619468+0000","last_fullsized":"2024-09-12T01:35:55.619468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617380+0000","last_change":"2024-09-12T01:35:55.617380+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617380+0000","last_undegraded":"2024-09-12T01:35:55.617380+0000","last_fullsized":"2024-09-12T01:35:55.617380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.619533+0000","last_change":"2024-09-12T01:35:55.619533+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619533+0000","last_undegraded":"2024-09-12T01:35:55.619533+0000","last_fullsized":"2024-09-12T01:35:55.619533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620979+0000","last_change":"2024-09-12T01:35:55.620979+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620979+0000","last_undegraded":"2024-09-12T01:35:55.620979+0000","last_fullsized":"2024-09-12T01:35:55.620979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.616863+0000","last_change":"2024-09-12T01:35:54.616863+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.616863+0000","last_undegraded":"2024-09-12T01:35:54.616863+0000","last_fullsized":"2024-09-12T01:35:54.616863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617529+0000","last_change":"2024-09-12T01:35:55.617529+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617529+0000","last_undegraded":"2024-09-12T01:35:55.617529+0000","last_fullsized":"2024-09-12T01:35:55.617529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621628+0000","last_change":"2024-09-12T01:35:55.621628+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621628+0000","last_undegraded":"2024-09-12T01:35:55.621628+0000","last_fullsized":"2024-09-12T01:35:55.621628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.617259+0000","last_change":"2024-09-12T01:35:55.617259+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617259+0000","last_undegraded":"2024-09-12T01:35:55.617259+0000","last_fullsized":"2024-09-12T01:35:55.617259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620673+0000","last_change":"2024-09-12T01:35:55.620673+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620673+0000","last_undegraded":"2024-09-12T01:35:55.620673+0000","last_fullsized":"2024-09-12T01:35:55.620673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621631+0000","last_change":"2024-09-12T01:35:55.621631+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621631+0000","last_undegraded":"2024-09-12T01:35:55.621631+0000","last_fullsized":"2024-09-12T01:35:55.621631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617596+0000","last_change":"2024-09-12T01:35:55.617596+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617596+0000","last_undegraded":"2024-09-12T01:35:55.617596+0000","last_fullsized":"2024-09-12T01:35:55.617596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.616803+0000","last_change":"2024-09-12T01:35:54.616803+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.616803+0000","last_undegraded":"2024-09-12T01:35:54.616803+0000","last_fullsized":"2024-09-12T01:35:54.616803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622699+0000","last_change":"2024-09-12T01:35:55.622699+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622699+0000","last_undegraded":"2024-09-12T01:35:55.622699+0000","last_fullsized":"2024-09-12T01:35:55.622699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.615864+0000","last_change":"2024-09-12T01:35:55.615864+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.615864+0000","last_undegraded":"2024-09-12T01:35:55.615864+0000","last_fullsized":"2024-09-12T01:35:55.615864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624634+0000","last_change":"2024-09-12T01:35:55.624634+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624634+0000","last_undegraded":"2024-09-12T01:35:55.624634+0000","last_fullsized":"2024-09-12T01:35:55.624634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.616840+0000","last_change":"2024-09-12T01:35:54.616840+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.616840+0000","last_undegraded":"2024-09-12T01:35:54.616840+0000","last_fullsized":"2024-09-12T01:35:54.616840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620906+0000","last_change":"2024-09-12T01:35:55.620906+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620906+0000","last_undegraded":"2024-09-12T01:35:55.620906+0000","last_fullsized":"2024-09-12T01:35:55.620906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623965+0000","last_change":"2024-09-12T01:35:55.623965+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623965+0000","last_undegraded":"2024-09-12T01:35:55.623965+0000","last_fullsized":"2024-09-12T01:35:55.623965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.622266+0000","last_change":"2024-09-12T01:35:55.622266+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622266+0000","last_undegraded":"2024-09-12T01:35:55.622266+0000","last_fullsized":"2024-09-12T01:35:55.622266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617336+0000","last_change":"2024-09-12T01:35:55.617336+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617336+0000","last_undegraded":"2024-09-12T01:35:55.617336+0000","last_fullsized":"2024-09-12T01:35:55.617336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:54.606018+0000","last_change":"2024-09-12T01:35:54.606018+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.606018+0000","last_undegraded":"2024-09-12T01:35:54.606018+0000","last_fullsized":"2024-09-12T01:35:54.606018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621216+0000","last_change":"2024-09-12T01:35:55.621216+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621216+0000","last_undegraded":"2024-09-12T01:35:55.621216+0000","last_fullsized":"2024-09-12T01:35:55.621216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.625866+0000","last_change":"2024-09-12T01:35:55.625866+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625866+0000","last_undegraded":"2024-09-12T01:35:55.625866+0000","last_fullsized":"2024-09-12T01:35:55.625866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619560+0000","last_change":"2024-09-12T01:35:55.619560+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619560+0000","last_undegraded":"2024-09-12T01:35:55.619560+0000","last_fullsized":"2024-09-12T01:35:55.619560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:54.606018+0000","last_change":"2024-09-12T01:35:54.606018+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.606018+0000","last_undegraded":"2024-09-12T01:35:54.606018+0000","last_fullsized":"2024-09-12T01:35:54.606018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625776+0000","last_change":"2024-09-12T01:35:55.625776+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625776+0000","last_undegraded":"2024-09-12T01:35:55.625776+0000","last_fullsized":"2024-09-12T01:35:55.625776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620076+0000","last_change":"2024-09-12T01:35:55.620076+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620076+0000","last_undegraded":"2024-09-12T01:35:55.620076+0000","last_fullsized":"2024-09-12T01:35:55.620076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623700+0000","last_change":"2024-09-12T01:35:55.623700+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623700+0000","last_undegraded":"2024-09-12T01:35:55.623700+0000","last_fullsized":"2024-09-12T01:35:55.623700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.617520+0000","last_change":"2024-09-12T01:35:54.617520+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.617520+0000","last_undegraded":"2024-09-12T01:35:54.617520+0000","last_fullsized":"2024-09-12T01:35:54.617520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624235+0000","last_change":"2024-09-12T01:35:55.624235+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624235+0000","last_undegraded":"2024-09-12T01:35:55.624235+0000","last_fullsized":"2024-09-12T01:35:55.624235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T01:35:55.618559+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:35:55.618559+0000","last_peered":"2024-09-12T01:35:55.618559+0000","last_clean":"2024-09-12T01:35:55.618559+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:35:55.618559+0000","last_undegraded":"2024-09-12T01:35:55.618559+0000","last_fullsized":"2024-09-12T01:35:55.618559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.622144+0000","last_change":"2024-09-12T01:35:55.622144+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622144+0000","last_undegraded":"2024-09-12T01:35:55.622144+0000","last_fullsized":"2024-09-12T01:35:55.622144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621589+0000","last_change":"2024-09-12T01:35:55.621589+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621589+0000","last_undegraded":"2024-09-12T01:35:55.621589+0000","last_fullsized":"2024-09-12T01:35:55.621589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621251+0000","last_change":"2024-09-12T01:35:55.621251+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621251+0000","last_undegraded":"2024-09-12T01:35:55.621251+0000","last_fullsized":"2024-09-12T01:35:55.621251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619326+0000","last_change":"2024-09-12T01:35:55.619326+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619326+0000","last_undegraded":"2024-09-12T01:35:55.619326+0000","last_fullsized":"2024-09-12T01:35:55.619326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620581+0000","last_change":"2024-09-12T01:35:55.620581+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620581+0000","last_undegraded":"2024-09-12T01:35:55.620581+0000","last_fullsized":"2024-09-12T01:35:55.620581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.626444+0000","last_change":"2024-09-12T01:35:55.626444+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.626444+0000","last_undegraded":"2024-09-12T01:35:55.626444+0000","last_fullsized":"2024-09-12T01:35:55.626444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.618319+0000","last_change":"2024-09-12T01:35:55.618319+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618319+0000","last_undegraded":"2024-09-12T01:35:55.618319+0000","last_fullsized":"2024-09-12T01:35:55.618319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619440+0000","last_change":"2024-09-12T01:35:55.619440+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619440+0000","last_undegraded":"2024-09-12T01:35:55.619440+0000","last_fullsized":"2024-09-12T01:35:55.619440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621690+0000","last_change":"2024-09-12T01:35:55.621690+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621690+0000","last_undegraded":"2024-09-12T01:35:55.621690+0000","last_fullsized":"2024-09-12T01:35:55.621690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:54.606018+0000","last_change":"2024-09-12T01:35:54.606018+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.606018+0000","last_undegraded":"2024-09-12T01:35:54.606018+0000","last_fullsized":"2024-09-12T01:35:54.606018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620792+0000","last_change":"2024-09-12T01:35:55.620792+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620792+0000","last_undegraded":"2024-09-12T01:35:55.620792+0000","last_fullsized":"2024-09-12T01:35:55.620792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":4,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.629279+0000","last_change":"2024-09-12T01:35:55.621704+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.629279+0000","last_undegraded":"2024-09-12T01:35:55.629279+0000","last_fullsized":"2024-09-12T01:35:55.629279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620599+0000","last_change":"2024-09-12T01:35:55.620599+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620599+0000","last_undegraded":"2024-09-12T01:35:55.620599+0000","last_fullsized":"2024-09-12T01:35:55.620599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:54.606018+0000","last_change":"2024-09-12T01:35:54.606018+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.606018+0000","last_undegraded":"2024-09-12T01:35:54.606018+0000","last_fullsized":"2024-09-12T01:35:54.606018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.617559+0000","last_change":"2024-09-12T01:35:54.617559+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.617559+0000","last_undegraded":"2024-09-12T01:35:54.617559+0000","last_fullsized":"2024-09-12T01:35:54.617559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620277+0000","last_change":"2024-09-12T01:35:55.620277+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620277+0000","last_undegraded":"2024-09-12T01:35:55.620277+0000","last_fullsized":"2024-09-12T01:35:55.620277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.622581+0000","last_change":"2024-09-12T01:35:55.622581+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622581+0000","last_undegraded":"2024-09-12T01:35:55.622581+0000","last_fullsized":"2024-09-12T01:35:55.622581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621419+0000","last_change":"2024-09-12T01:35:55.621419+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621419+0000","last_undegraded":"2024-09-12T01:35:55.621419+0000","last_fullsized":"2024-09-12T01:35:55.621419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624687+0000","last_change":"2024-09-12T01:35:55.624687+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624687+0000","last_undegraded":"2024-09-12T01:35:55.624687+0000","last_fullsized":"2024-09-12T01:35:55.624687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.625951+0000","last_change":"2024-09-12T01:35:55.625951+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625951+0000","last_undegraded":"2024-09-12T01:35:55.625951+0000","last_fullsized":"2024-09-12T01:35:55.625951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617407+0000","last_change":"2024-09-12T01:35:55.617407+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617407+0000","last_undegraded":"2024-09-12T01:35:55.617407+0000","last_fullsized":"2024-09-12T01:35:55.617407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.624201+0000","last_change":"2024-09-12T01:35:55.624201+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624201+0000","last_undegraded":"2024-09-12T01:35:55.624201+0000","last_fullsized":"2024-09-12T01:35:55.624201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.618323+0000","last_change":"2024-09-12T01:35:55.618323+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618323+0000","last_undegraded":"2024-09-12T01:35:55.618323+0000","last_fullsized":"2024-09-12T01:35:55.618323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.617912+0000","last_change":"2024-09-12T01:35:55.617912+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617912+0000","last_undegraded":"2024-09-12T01:35:55.617912+0000","last_fullsized":"2024-09-12T01:35:55.617912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617790+0000","last_change":"2024-09-12T01:35:55.617790+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617790+0000","last_undegraded":"2024-09-12T01:35:55.617790+0000","last_fullsized":"2024-09-12T01:35:55.617790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:54.606018+0000","last_change":"2024-09-12T01:35:54.606018+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.606018+0000","last_undegraded":"2024-09-12T01:35:54.606018+0000","last_fullsized":"2024-09-12T01:35:54.606018+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":6},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":56068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:36:00.062 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:36:00.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.200+0000 7f84e7fff640 1 Processor -- start 2024-09-12T01:36:00.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.200+0000 7f84e7fff640 1 -- start start 2024-09-12T01:36:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.201+0000 7f84e7fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f84e806f580 0x7f84e806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.201+0000 7f84e7fff640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e80b5880 con 0x7f84e815b220 2024-09-12T01:36:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.201+0000 7f84e7fff640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e80b5b60 con 0x7f84e80cf1c0 2024-09-12T01:36:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.201+0000 7f84e7fff640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f84e806ff20 con 0x7f84e806f580 2024-09-12T01:36:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.201+0000 7f84e6ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f84e815b220 0x7f84e80b6640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57842/0 (socket says 172.21.15.60:57842) 2024-09-12T01:36:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.201+0000 7f84e6ffd640 1 -- 172.21.15.60:0/2088906261 learned_addr learned my addr 172.21.15.60:0/2088906261 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.202+0000 7f84e67fc640 1 --2- 172.21.15.60:0/2088906261 >> v2:172.21.15.105:3300/0 conn(0x7f84e806f580 0x7f84e806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.202+0000 7f84e5ffb640 1 -- 172.21.15.60:0/2088906261 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2512377241 0 0) 0x7f84e80b5880 con 0x7f84e815b220 2024-09-12T01:36:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.202+0000 7f84e5ffb640 1 -- 172.21.15.60:0/2088906261 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84d0003520 con 0x7f84e815b220 2024-09-12T01:36:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.202+0000 7f84e67fc640 1 -- 172.21.15.60:0/2088906261 >> v1:172.21.15.105:6789/0 conn(0x7f84e80cf1c0 legacy=0x7f84e80cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.202+0000 7f84e67fc640 1 -- 172.21.15.60:0/2088906261 >> v1:172.21.15.60:6789/0 conn(0x7f84e815b220 legacy=0x7f84e80b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.202+0000 7f84e67fc640 1 -- 172.21.15.60:0/2088906261 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e80b5e40 con 0x7f84e806f580 2024-09-12T01:36:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.203+0000 7f84e67fc640 1 --2- 172.21.15.60:0/2088906261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e806f580 0x7f84e806f9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0097a0 tx=0x7f84dc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41aa579626105d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.203+0000 7f84e5ffb640 1 -- 172.21.15.60:0/2088906261 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc037070 con 0x7f84e806f580 2024-09-12T01:36:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.203+0000 7f84e5ffb640 1 -- 172.21.15.60:0/2088906261 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84dc032440 con 0x7f84e806f580 2024-09-12T01:36:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.203+0000 7f84e5ffb640 1 -- 172.21.15.60:0/2088906261 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc0327f0 con 0x7f84e806f580 2024-09-12T01:36:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.203+0000 7f84e7fff640 1 -- 172.21.15.60:0/2088906261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e806f580 msgr2=0x7f84e806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.203+0000 7f84e7fff640 1 --2- 172.21.15.60:0/2088906261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e806f580 0x7f84e806f9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0097a0 tx=0x7f84dc02a230 comp rx=0 tx=0).stop 2024-09-12T01:36:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.203+0000 7f84e7fff640 1 -- 172.21.15.60:0/2088906261 shutdown_connections 2024-09-12T01:36:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.203+0000 7f84e7fff640 1 --2- 172.21.15.60:0/2088906261 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e806f580 0x7f84e806f9e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.203+0000 7f84e7fff640 1 -- 172.21.15.60:0/2088906261 >> 172.21.15.60:0/2088906261 conn(0x7f84e806e200 msgr2=0x7f84e806e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.203+0000 7f84e7fff640 1 -- 172.21.15.60:0/2088906261 shutdown_connections 2024-09-12T01:36:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.203+0000 7f84e7fff640 1 -- 172.21.15.60:0/2088906261 wait complete. 2024-09-12T01:36:00.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.205+0000 7f84e7fff640 1 Processor -- start 2024-09-12T01:36:00.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.205+0000 7f84e7fff640 1 -- start start 2024-09-12T01:36:00.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.205+0000 7f84e7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e806f580 0x7f84e8151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.205+0000 7f84e7fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e80cf1c0 0x7f84e81f4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.205+0000 7f84e7fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e815b220 0x7f84e81f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e7fff640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f84e80b5570 con 0x7f84e806f580 2024-09-12T01:36:00.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e7fff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f84e815c610 con 0x7f84e80cf1c0 2024-09-12T01:36:00.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e7fff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f84e8072140 con 0x7f84e815b220 2024-09-12T01:36:00.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e806f580 0x7f84e8151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e806f580 0x7f84e8151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33840/0 (socket says 172.21.15.60:33840) 2024-09-12T01:36:00.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e6ffd640 1 -- 172.21.15.60:0/239038994 learned_addr learned my addr 172.21.15.60:0/239038994 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:00.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e67fc640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e80cf1c0 0x7f84e81f4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e77fe640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e815b220 0x7f84e81f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e6ffd640 1 -- 172.21.15.60:0/239038994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e815b220 msgr2=0x7f84e81f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e6ffd640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e815b220 0x7f84e81f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e6ffd640 1 -- 172.21.15.60:0/239038994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e80cf1c0 msgr2=0x7f84e81f4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e6ffd640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e80cf1c0 0x7f84e81f4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e6ffd640 1 -- 172.21.15.60:0/239038994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e81e6020 con 0x7f84e806f580 2024-09-12T01:36:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e6ffd640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e806f580 0x7f84e8151860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c440 tx=0x7f84d800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84cf7fe640 1 -- 172.21.15.60:0/239038994 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d8017070 con 0x7f84e806f580 2024-09-12T01:36:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84cf7fe640 1 -- 172.21.15.60:0/239038994 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d8005ce0 con 0x7f84e806f580 2024-09-12T01:36:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e7fff640 1 -- 172.21.15.60:0/239038994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e8151da0 con 0x7f84e806f580 2024-09-12T01:36:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84cf7fe640 1 -- 172.21.15.60:0/239038994 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d80072b0 con 0x7f84e806f580 2024-09-12T01:36:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.206+0000 7f84e7fff640 1 -- 172.21.15.60:0/239038994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e81e65c0 con 0x7f84e806f580 2024-09-12T01:36:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.207+0000 7f84e7fff640 1 -- 172.21.15.60:0/239038994 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e8158880 con 0x7f84e806f580 2024-09-12T01:36:00.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.208+0000 7f84cf7fe640 1 -- 172.21.15.60:0/239038994 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f84d801a070 con 0x7f84e806f580 2024-09-12T01:36:00.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.208+0000 7f84cf7fe640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f84d406be30 0x7f84d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.209+0000 7f84e67fc640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f84d406be30 0x7f84d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.209+0000 7f84cf7fe640 1 -- 172.21.15.60:0/239038994 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f84d808a070 con 0x7f84e806f580 2024-09-12T01:36:00.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.209+0000 7f84e67fc640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f84d406be30 0x7f84d406e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84dc034000 tx=0x7f84dc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.213+0000 7f84cf7fe640 1 -- 172.21.15.60:0/239038994 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84d8058520 con 0x7f84e806f580 2024-09-12T01:36:00.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.385+0000 7f84e7fff640 1 -- 172.21.15.60:0/239038994 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84e80cd510 con 0x7f84d406be30 2024-09-12T01:36:00.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.391+0000 7f84cf7fe640 1 -- 172.21.15.60:0/239038994 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244858 (secure 0 0 0) 0x7f84dc038040 con 0x7f84d406be30 2024-09-12T01:36:00.393 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:00.394 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:36:00.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.394+0000 7f84e7fff640 1 -- 172.21.15.60:0/239038994 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f84d406be30 msgr2=0x7f84d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.394+0000 7f84e7fff640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f84d406be30 0x7f84d406e2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f84dc034000 tx=0x7f84dc02e000 comp rx=0 tx=0).stop 2024-09-12T01:36:00.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.394+0000 7f84e7fff640 1 -- 172.21.15.60:0/239038994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e806f580 msgr2=0x7f84e8151860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.394+0000 7f84e7fff640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e806f580 0x7f84e8151860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f84d800c440 tx=0x7f84d800c900 comp rx=0 tx=0).stop 2024-09-12T01:36:00.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.394+0000 7f84e7fff640 1 -- 172.21.15.60:0/239038994 shutdown_connections 2024-09-12T01:36:00.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.394+0000 7f84e7fff640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f84d406be30 0x7f84d406e2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.394+0000 7f84e7fff640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e815b220 0x7f84e81f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.394+0000 7f84e7fff640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e80cf1c0 0x7f84e81f4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.394+0000 7f84e7fff640 1 --2- 172.21.15.60:0/239038994 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e806f580 0x7f84e8151860 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.394+0000 7f84e7fff640 1 -- 172.21.15.60:0/239038994 >> 172.21.15.60:0/239038994 conn(0x7f84e806e200 msgr2=0x7f84e80cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.394+0000 7f84e7fff640 1 -- 172.21.15.60:0/239038994 shutdown_connections 2024-09-12T01:36:00.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.394+0000 7f84e7fff640 1 -- 172.21.15.60:0/239038994 wait complete. 2024-09-12T01:36:00.405 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T01:36:00.260706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":179,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235616,"kb_used_data":2752,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739104,"statfs":{"total":773094113280,"available":772852842496,"internally_reserved":0,"allocated":2818048,"data_stored":1697450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.649358"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.628171+0000","last_change":"2024-09-12T01:35:55.628171+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.628171+0000","last_undegraded":"2024-09-12T01:35:55.628171+0000","last_fullsized":"2024-09-12T01:35:55.628171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619679+0000","last_change":"2024-09-12T01:35:55.619679+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619679+0000","last_undegraded":"2024-09-12T01:35:55.619679+0000","last_fullsized":"2024-09-12T01:35:55.619679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617675+0000","last_change":"2024-09-12T01:35:55.617675+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617675+0000","last_undegraded":"2024-09-12T01:35:55.617675+0000","last_fullsized":"2024-09-12T01:35:55.617675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620008+0000","last_change":"2024-09-12T01:35:55.620008+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620008+0000","last_undegraded":"2024-09-12T01:35:55.620008+0000","last_fullsized":"2024-09-12T01:35:55.620008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623789+0000","last_change":"2024-09-12T01:35:55.623789+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623789+0000","last_undegraded":"2024-09-12T01:35:55.623789+0000","last_fullsized":"2024-09-12T01:35:55.623789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619901+0000","last_change":"2024-09-12T01:35:55.619901+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619901+0000","last_undegraded":"2024-09-12T01:35:55.619901+0000","last_fullsized":"2024-09-12T01:35:55.619901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622730+0000","last_change":"2024-09-12T01:35:55.622730+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622730+0000","last_undegraded":"2024-09-12T01:35:55.622730+0000","last_fullsized":"2024-09-12T01:35:55.622730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619838+0000","last_change":"2024-09-12T01:35:55.619838+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619838+0000","last_undegraded":"2024-09-12T01:35:55.619838+0000","last_fullsized":"2024-09-12T01:35:55.619838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617420+0000","last_change":"2024-09-12T01:35:55.617420+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617420+0000","last_undegraded":"2024-09-12T01:35:55.617420+0000","last_fullsized":"2024-09-12T01:35:55.617420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624063+0000","last_change":"2024-09-12T01:35:55.624063+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624063+0000","last_undegraded":"2024-09-12T01:35:55.624063+0000","last_fullsized":"2024-09-12T01:35:55.624063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625169+0000","last_change":"2024-09-12T01:35:55.625169+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625169+0000","last_undegraded":"2024-09-12T01:35:55.625169+0000","last_fullsized":"2024-09-12T01:35:55.625169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625373+0000","last_change":"2024-09-12T01:35:55.625373+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625373+0000","last_undegraded":"2024-09-12T01:35:55.625373+0000","last_fullsized":"2024-09-12T01:35:55.625373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.618586+0000","last_change":"2024-09-12T01:35:55.618586+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618586+0000","last_undegraded":"2024-09-12T01:35:55.618586+0000","last_fullsized":"2024-09-12T01:35:55.618586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625198+0000","last_change":"2024-09-12T01:35:55.625198+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625198+0000","last_undegraded":"2024-09-12T01:35:55.625198+0000","last_fullsized":"2024-09-12T01:35:55.625198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622142+0000","last_change":"2024-09-12T01:35:55.622142+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622142+0000","last_undegraded":"2024-09-12T01:35:55.622142+0000","last_fullsized":"2024-09-12T01:35:55.622142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620296+0000","last_change":"2024-09-12T01:35:55.620296+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620296+0000","last_undegraded":"2024-09-12T01:35:55.620296+0000","last_fullsized":"2024-09-12T01:35:55.620296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623080+0000","last_change":"2024-09-12T01:35:55.623080+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623080+0000","last_undegraded":"2024-09-12T01:35:55.623080+0000","last_fullsized":"2024-09-12T01:35:55.623080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624919+0000","last_change":"2024-09-12T01:35:55.624919+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624919+0000","last_undegraded":"2024-09-12T01:35:55.624919+0000","last_fullsized":"2024-09-12T01:35:55.624919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630212+0000","last_change":"2024-09-12T01:35:56.630997+0000","last_active":"2024-09-12T01:35:57.630212+0000","last_peered":"2024-09-12T01:35:57.630212+0000","last_clean":"2024-09-12T01:35:57.630212+0000","last_became_active":"2024-09-12T01:35:56.630704+0000","last_became_peered":"2024-09-12T01:35:56.630704+0000","last_unstale":"2024-09-12T01:35:57.630212+0000","last_undegraded":"2024-09-12T01:35:57.630212+0000","last_fullsized":"2024-09-12T01:35:57.630212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:33.242417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.618101+0000","last_change":"2024-09-12T01:35:55.618101+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618101+0000","last_undegraded":"2024-09-12T01:35:55.618101+0000","last_fullsized":"2024-09-12T01:35:55.618101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617490+0000","last_change":"2024-09-12T01:35:55.617490+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617490+0000","last_undegraded":"2024-09-12T01:35:55.617490+0000","last_fullsized":"2024-09-12T01:35:55.617490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622303+0000","last_change":"2024-09-12T01:35:55.622303+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622303+0000","last_undegraded":"2024-09-12T01:35:55.622303+0000","last_fullsized":"2024-09-12T01:35:55.622303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619766+0000","last_change":"2024-09-12T01:35:55.619766+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619766+0000","last_undegraded":"2024-09-12T01:35:55.619766+0000","last_fullsized":"2024-09-12T01:35:55.619766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621156+0000","last_change":"2024-09-12T01:35:55.621156+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621156+0000","last_undegraded":"2024-09-12T01:35:55.621156+0000","last_fullsized":"2024-09-12T01:35:55.621156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617690+0000","last_change":"2024-09-12T01:35:55.617690+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617690+0000","last_undegraded":"2024-09-12T01:35:55.617690+0000","last_fullsized":"2024-09-12T01:35:55.617690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621917+0000","last_change":"2024-09-12T01:35:55.621917+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621917+0000","last_undegraded":"2024-09-12T01:35:55.621917+0000","last_fullsized":"2024-09-12T01:35:55.621917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620388+0000","last_change":"2024-09-12T01:35:55.620388+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620388+0000","last_undegraded":"2024-09-12T01:35:55.620388+0000","last_fullsized":"2024-09-12T01:35:55.620388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619468+0000","last_change":"2024-09-12T01:35:55.619468+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619468+0000","last_undegraded":"2024-09-12T01:35:55.619468+0000","last_fullsized":"2024-09-12T01:35:55.619468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617380+0000","last_change":"2024-09-12T01:35:55.617380+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617380+0000","last_undegraded":"2024-09-12T01:35:55.617380+0000","last_fullsized":"2024-09-12T01:35:55.617380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.619533+0000","last_change":"2024-09-12T01:35:55.619533+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619533+0000","last_undegraded":"2024-09-12T01:35:55.619533+0000","last_fullsized":"2024-09-12T01:35:55.619533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630355+0000","last_change":"2024-09-12T01:35:56.650933+0000","last_active":"2024-09-12T01:35:57.630355+0000","last_peered":"2024-09-12T01:35:57.630355+0000","last_clean":"2024-09-12T01:35:57.630355+0000","last_became_active":"2024-09-12T01:35:56.649511+0000","last_became_peered":"2024-09-12T01:35:56.649511+0000","last_unstale":"2024-09-12T01:35:57.630355+0000","last_undegraded":"2024-09-12T01:35:57.630355+0000","last_fullsized":"2024-09-12T01:35:57.630355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:37.930582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620979+0000","last_change":"2024-09-12T01:35:55.620979+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620979+0000","last_undegraded":"2024-09-12T01:35:55.620979+0000","last_fullsized":"2024-09-12T01:35:55.620979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.616863+0000","last_change":"2024-09-12T01:35:54.616863+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.616863+0000","last_undegraded":"2024-09-12T01:35:54.616863+0000","last_fullsized":"2024-09-12T01:35:54.616863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617529+0000","last_change":"2024-09-12T01:35:55.617529+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617529+0000","last_undegraded":"2024-09-12T01:35:55.617529+0000","last_fullsized":"2024-09-12T01:35:55.617529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621628+0000","last_change":"2024-09-12T01:35:55.621628+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621628+0000","last_undegraded":"2024-09-12T01:35:55.621628+0000","last_fullsized":"2024-09-12T01:35:55.621628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630785+0000","last_change":"2024-09-12T01:35:56.639249+0000","last_active":"2024-09-12T01:35:57.630785+0000","last_peered":"2024-09-12T01:35:57.630785+0000","last_clean":"2024-09-12T01:35:57.630785+0000","last_became_active":"2024-09-12T01:35:56.638993+0000","last_became_peered":"2024-09-12T01:35:56.638993+0000","last_unstale":"2024-09-12T01:35:57.630785+0000","last_undegraded":"2024-09-12T01:35:57.630785+0000","last_fullsized":"2024-09-12T01:35:57.630785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:52.928010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.617259+0000","last_change":"2024-09-12T01:35:55.617259+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617259+0000","last_undegraded":"2024-09-12T01:35:55.617259+0000","last_fullsized":"2024-09-12T01:35:55.617259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620673+0000","last_change":"2024-09-12T01:35:55.620673+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620673+0000","last_undegraded":"2024-09-12T01:35:55.620673+0000","last_fullsized":"2024-09-12T01:35:55.620673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621631+0000","last_change":"2024-09-12T01:35:55.621631+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621631+0000","last_undegraded":"2024-09-12T01:35:55.621631+0000","last_fullsized":"2024-09-12T01:35:55.621631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617596+0000","last_change":"2024-09-12T01:35:55.617596+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617596+0000","last_undegraded":"2024-09-12T01:35:55.617596+0000","last_fullsized":"2024-09-12T01:35:55.617596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.616803+0000","last_change":"2024-09-12T01:35:54.616803+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.616803+0000","last_undegraded":"2024-09-12T01:35:54.616803+0000","last_fullsized":"2024-09-12T01:35:54.616803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622699+0000","last_change":"2024-09-12T01:35:55.622699+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622699+0000","last_undegraded":"2024-09-12T01:35:55.622699+0000","last_fullsized":"2024-09-12T01:35:55.622699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.615864+0000","last_change":"2024-09-12T01:35:55.615864+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.615864+0000","last_undegraded":"2024-09-12T01:35:55.615864+0000","last_fullsized":"2024-09-12T01:35:55.615864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624634+0000","last_change":"2024-09-12T01:35:55.624634+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624634+0000","last_undegraded":"2024-09-12T01:35:55.624634+0000","last_fullsized":"2024-09-12T01:35:55.624634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.616840+0000","last_change":"2024-09-12T01:35:54.616840+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.616840+0000","last_undegraded":"2024-09-12T01:35:54.616840+0000","last_fullsized":"2024-09-12T01:35:54.616840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620906+0000","last_change":"2024-09-12T01:35:55.620906+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620906+0000","last_undegraded":"2024-09-12T01:35:55.620906+0000","last_fullsized":"2024-09-12T01:35:55.620906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623965+0000","last_change":"2024-09-12T01:35:55.623965+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623965+0000","last_undegraded":"2024-09-12T01:35:55.623965+0000","last_fullsized":"2024-09-12T01:35:55.623965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.622266+0000","last_change":"2024-09-12T01:35:55.622266+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622266+0000","last_undegraded":"2024-09-12T01:35:55.622266+0000","last_fullsized":"2024-09-12T01:35:55.622266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617336+0000","last_change":"2024-09-12T01:35:55.617336+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617336+0000","last_undegraded":"2024-09-12T01:35:55.617336+0000","last_fullsized":"2024-09-12T01:35:55.617336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630113+0000","last_change":"2024-09-12T01:35:55.633512+0000","last_active":"2024-09-12T01:35:57.630113+0000","last_peered":"2024-09-12T01:35:57.630113+0000","last_clean":"2024-09-12T01:35:57.630113+0000","last_became_active":"2024-09-12T01:35:55.630924+0000","last_became_peered":"2024-09-12T01:35:55.630924+0000","last_unstale":"2024-09-12T01:35:57.630113+0000","last_undegraded":"2024-09-12T01:35:57.630113+0000","last_fullsized":"2024-09-12T01:35:57.630113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:22.281284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621216+0000","last_change":"2024-09-12T01:35:55.621216+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621216+0000","last_undegraded":"2024-09-12T01:35:55.621216+0000","last_fullsized":"2024-09-12T01:35:55.621216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.625866+0000","last_change":"2024-09-12T01:35:55.625866+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625866+0000","last_undegraded":"2024-09-12T01:35:55.625866+0000","last_fullsized":"2024-09-12T01:35:55.625866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619560+0000","last_change":"2024-09-12T01:35:55.619560+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619560+0000","last_undegraded":"2024-09-12T01:35:55.619560+0000","last_fullsized":"2024-09-12T01:35:55.619560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630591+0000","last_change":"2024-09-12T01:35:55.632582+0000","last_active":"2024-09-12T01:35:57.630591+0000","last_peered":"2024-09-12T01:35:57.630591+0000","last_clean":"2024-09-12T01:35:57.630591+0000","last_became_active":"2024-09-12T01:35:55.631969+0000","last_became_peered":"2024-09-12T01:35:55.631969+0000","last_unstale":"2024-09-12T01:35:57.630591+0000","last_undegraded":"2024-09-12T01:35:57.630591+0000","last_fullsized":"2024-09-12T01:35:57.630591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:04.556922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625776+0000","last_change":"2024-09-12T01:35:55.625776+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625776+0000","last_undegraded":"2024-09-12T01:35:55.625776+0000","last_fullsized":"2024-09-12T01:35:55.625776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620076+0000","last_change":"2024-09-12T01:35:55.620076+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620076+0000","last_undegraded":"2024-09-12T01:35:55.620076+0000","last_fullsized":"2024-09-12T01:35:55.620076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623700+0000","last_change":"2024-09-12T01:35:55.623700+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623700+0000","last_undegraded":"2024-09-12T01:35:55.623700+0000","last_fullsized":"2024-09-12T01:35:55.623700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.617520+0000","last_change":"2024-09-12T01:35:54.617520+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.617520+0000","last_undegraded":"2024-09-12T01:35:54.617520+0000","last_fullsized":"2024-09-12T01:35:54.617520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624235+0000","last_change":"2024-09-12T01:35:55.624235+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624235+0000","last_undegraded":"2024-09-12T01:35:55.624235+0000","last_fullsized":"2024-09-12T01:35:55.624235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T01:35:55.618559+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:35:55.618559+0000","last_peered":"2024-09-12T01:35:55.618559+0000","last_clean":"2024-09-12T01:35:55.618559+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:35:55.618559+0000","last_undegraded":"2024-09-12T01:35:55.618559+0000","last_fullsized":"2024-09-12T01:35:55.618559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.622144+0000","last_change":"2024-09-12T01:35:55.622144+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622144+0000","last_undegraded":"2024-09-12T01:35:55.622144+0000","last_fullsized":"2024-09-12T01:35:55.622144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630356+0000","last_change":"2024-09-12T01:35:56.631140+0000","last_active":"2024-09-12T01:35:57.630356+0000","last_peered":"2024-09-12T01:35:57.630356+0000","last_clean":"2024-09-12T01:35:57.630356+0000","last_became_active":"2024-09-12T01:35:56.630798+0000","last_became_peered":"2024-09-12T01:35:56.630798+0000","last_unstale":"2024-09-12T01:35:57.630356+0000","last_undegraded":"2024-09-12T01:35:57.630356+0000","last_fullsized":"2024-09-12T01:35:57.630356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:16.316634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621589+0000","last_change":"2024-09-12T01:35:55.621589+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621589+0000","last_undegraded":"2024-09-12T01:35:55.621589+0000","last_fullsized":"2024-09-12T01:35:55.621589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621251+0000","last_change":"2024-09-12T01:35:55.621251+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621251+0000","last_undegraded":"2024-09-12T01:35:55.621251+0000","last_fullsized":"2024-09-12T01:35:55.621251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619326+0000","last_change":"2024-09-12T01:35:55.619326+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619326+0000","last_undegraded":"2024-09-12T01:35:55.619326+0000","last_fullsized":"2024-09-12T01:35:55.619326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620581+0000","last_change":"2024-09-12T01:35:55.620581+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620581+0000","last_undegraded":"2024-09-12T01:35:55.620581+0000","last_fullsized":"2024-09-12T01:35:55.620581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.626444+0000","last_change":"2024-09-12T01:35:55.626444+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.626444+0000","last_undegraded":"2024-09-12T01:35:55.626444+0000","last_fullsized":"2024-09-12T01:35:55.626444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.618319+0000","last_change":"2024-09-12T01:35:55.618319+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618319+0000","last_undegraded":"2024-09-12T01:35:55.618319+0000","last_fullsized":"2024-09-12T01:35:55.618319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619440+0000","last_change":"2024-09-12T01:35:55.619440+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619440+0000","last_undegraded":"2024-09-12T01:35:55.619440+0000","last_fullsized":"2024-09-12T01:35:55.619440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621690+0000","last_change":"2024-09-12T01:35:55.621690+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621690+0000","last_undegraded":"2024-09-12T01:35:55.621690+0000","last_fullsized":"2024-09-12T01:35:55.621690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641362+0000","last_change":"2024-09-12T01:35:55.636276+0000","last_active":"2024-09-12T01:35:57.641362+0000","last_peered":"2024-09-12T01:35:57.641362+0000","last_clean":"2024-09-12T01:35:57.641362+0000","last_became_active":"2024-09-12T01:35:55.635996+0000","last_became_peered":"2024-09-12T01:35:55.635996+0000","last_unstale":"2024-09-12T01:35:57.641362+0000","last_undegraded":"2024-09-12T01:35:57.641362+0000","last_fullsized":"2024-09-12T01:35:57.641362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:44.922761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631351+0000","last_change":"2024-09-12T01:35:56.641708+0000","last_active":"2024-09-12T01:35:57.631351+0000","last_peered":"2024-09-12T01:35:57.631351+0000","last_clean":"2024-09-12T01:35:57.631351+0000","last_became_active":"2024-09-12T01:35:56.641436+0000","last_became_peered":"2024-09-12T01:35:56.641436+0000","last_unstale":"2024-09-12T01:35:57.631351+0000","last_undegraded":"2024-09-12T01:35:57.631351+0000","last_fullsized":"2024-09-12T01:35:57.631351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:30.517423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620792+0000","last_change":"2024-09-12T01:35:55.620792+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620792+0000","last_undegraded":"2024-09-12T01:35:55.620792+0000","last_fullsized":"2024-09-12T01:35:55.620792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630498+0000","last_change":"2024-09-12T01:35:56.638352+0000","last_active":"2024-09-12T01:35:57.630498+0000","last_peered":"2024-09-12T01:35:57.630498+0000","last_clean":"2024-09-12T01:35:57.630498+0000","last_became_active":"2024-09-12T01:35:56.637106+0000","last_became_peered":"2024-09-12T01:35:56.637106+0000","last_unstale":"2024-09-12T01:35:57.630498+0000","last_undegraded":"2024-09-12T01:35:57.630498+0000","last_fullsized":"2024-09-12T01:35:57.630498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:04.733539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":4,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.629279+0000","last_change":"2024-09-12T01:35:55.621704+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.629279+0000","last_undegraded":"2024-09-12T01:35:55.629279+0000","last_fullsized":"2024-09-12T01:35:55.629279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620599+0000","last_change":"2024-09-12T01:35:55.620599+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620599+0000","last_undegraded":"2024-09-12T01:35:55.620599+0000","last_fullsized":"2024-09-12T01:35:55.620599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631240+0000","last_change":"2024-09-12T01:35:55.635445+0000","last_active":"2024-09-12T01:35:57.631240+0000","last_peered":"2024-09-12T01:35:57.631240+0000","last_clean":"2024-09-12T01:35:57.631240+0000","last_became_active":"2024-09-12T01:35:55.635147+0000","last_became_peered":"2024-09-12T01:35:55.635147+0000","last_unstale":"2024-09-12T01:35:57.631240+0000","last_undegraded":"2024-09-12T01:35:57.631240+0000","last_fullsized":"2024-09-12T01:35:57.631240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:26.672278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630175+0000","last_change":"2024-09-12T01:35:56.638375+0000","last_active":"2024-09-12T01:35:57.630175+0000","last_peered":"2024-09-12T01:35:57.630175+0000","last_clean":"2024-09-12T01:35:57.630175+0000","last_became_active":"2024-09-12T01:35:56.637081+0000","last_became_peered":"2024-09-12T01:35:56.637081+0000","last_unstale":"2024-09-12T01:35:57.630175+0000","last_undegraded":"2024-09-12T01:35:57.630175+0000","last_fullsized":"2024-09-12T01:35:57.630175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:53.842225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.617559+0000","last_change":"2024-09-12T01:35:54.617559+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.617559+0000","last_undegraded":"2024-09-12T01:35:54.617559+0000","last_fullsized":"2024-09-12T01:35:54.617559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620277+0000","last_change":"2024-09-12T01:35:55.620277+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620277+0000","last_undegraded":"2024-09-12T01:35:55.620277+0000","last_fullsized":"2024-09-12T01:35:55.620277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.622581+0000","last_change":"2024-09-12T01:35:55.622581+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622581+0000","last_undegraded":"2024-09-12T01:35:55.622581+0000","last_fullsized":"2024-09-12T01:35:55.622581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621419+0000","last_change":"2024-09-12T01:35:55.621419+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621419+0000","last_undegraded":"2024-09-12T01:35:55.621419+0000","last_fullsized":"2024-09-12T01:35:55.621419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624687+0000","last_change":"2024-09-12T01:35:55.624687+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624687+0000","last_undegraded":"2024-09-12T01:35:55.624687+0000","last_fullsized":"2024-09-12T01:35:55.624687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.625951+0000","last_change":"2024-09-12T01:35:55.625951+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625951+0000","last_undegraded":"2024-09-12T01:35:55.625951+0000","last_fullsized":"2024-09-12T01:35:55.625951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617407+0000","last_change":"2024-09-12T01:35:55.617407+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617407+0000","last_undegraded":"2024-09-12T01:35:55.617407+0000","last_fullsized":"2024-09-12T01:35:55.617407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.624201+0000","last_change":"2024-09-12T01:35:55.624201+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624201+0000","last_undegraded":"2024-09-12T01:35:55.624201+0000","last_fullsized":"2024-09-12T01:35:55.624201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.618323+0000","last_change":"2024-09-12T01:35:55.618323+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618323+0000","last_undegraded":"2024-09-12T01:35:55.618323+0000","last_fullsized":"2024-09-12T01:35:55.618323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.617912+0000","last_change":"2024-09-12T01:35:55.617912+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617912+0000","last_undegraded":"2024-09-12T01:35:55.617912+0000","last_fullsized":"2024-09-12T01:35:55.617912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617790+0000","last_change":"2024-09-12T01:35:55.617790+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617790+0000","last_undegraded":"2024-09-12T01:35:55.617790+0000","last_fullsized":"2024-09-12T01:35:55.617790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631417+0000","last_change":"2024-09-12T01:35:55.632404+0000","last_active":"2024-09-12T01:35:57.631417+0000","last_peered":"2024-09-12T01:35:57.631417+0000","last_clean":"2024-09-12T01:35:57.631417+0000","last_became_active":"2024-09-12T01:35:55.631711+0000","last_became_peered":"2024-09-12T01:35:55.631711+0000","last_unstale":"2024-09-12T01:35:57.631417+0000","last_undegraded":"2024-09-12T01:35:57.631417+0000","last_fullsized":"2024-09-12T01:35:57.631417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:51.791206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:36:00.410 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-12T01:36:00.410 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.628171+0000', 'last_change': '2024-09-12T01:35:55.628171+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.628171+0000', 'last_undegraded': '2024-09-12T01:35:55.628171+0000', 'last_fullsized': '2024-09-12T01:35:55.628171+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.410 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-12T01:36:00.410 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.619679+0000', 'last_change': '2024-09-12T01:35:55.619679+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.619679+0000', 'last_undegraded': '2024-09-12T01:35:55.619679+0000', 'last_fullsized': '2024-09-12T01:35:55.619679+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.410 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-12T01:36:00.410 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.617675+0000', 'last_change': '2024-09-12T01:35:55.617675+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.617675+0000', 'last_undegraded': '2024-09-12T01:35:55.617675+0000', 'last_fullsized': '2024-09-12T01:35:55.617675+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.410 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-12T01:36:00.410 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.620008+0000', 'last_change': '2024-09-12T01:35:55.620008+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.620008+0000', 'last_undegraded': '2024-09-12T01:35:55.620008+0000', 'last_fullsized': '2024-09-12T01:35:55.620008+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:00.411 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-12T01:36:00.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.623789+0000', 'last_change': '2024-09-12T01:35:55.623789+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.623789+0000', 'last_undegraded': '2024-09-12T01:35:55.623789+0000', 'last_fullsized': '2024-09-12T01:35:55.623789+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.411 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-12T01:36:00.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.619901+0000', 'last_change': '2024-09-12T01:35:55.619901+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.619901+0000', 'last_undegraded': '2024-09-12T01:35:55.619901+0000', 'last_fullsized': '2024-09-12T01:35:55.619901+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:00.411 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-12T01:36:00.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.622730+0000', 'last_change': '2024-09-12T01:35:55.622730+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.622730+0000', 'last_undegraded': '2024-09-12T01:35:55.622730+0000', 'last_fullsized': '2024-09-12T01:35:55.622730+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.411 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-12T01:36:00.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.619838+0000', 'last_change': '2024-09-12T01:35:55.619838+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.619838+0000', 'last_undegraded': '2024-09-12T01:35:55.619838+0000', 'last_fullsized': '2024-09-12T01:35:55.619838+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.411 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-12T01:36:00.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.617420+0000', 'last_change': '2024-09-12T01:35:55.617420+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.617420+0000', 'last_undegraded': '2024-09-12T01:35:55.617420+0000', 'last_fullsized': '2024-09-12T01:35:55.617420+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:36:00.411 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-12T01:36:00.411 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.624063+0000', 'last_change': '2024-09-12T01:35:55.624063+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.624063+0000', 'last_undegraded': '2024-09-12T01:35:55.624063+0000', 'last_fullsized': '2024-09-12T01:35:55.624063+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.412 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-12T01:36:00.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.625169+0000', 'last_change': '2024-09-12T01:35:55.625169+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.625169+0000', 'last_undegraded': '2024-09-12T01:35:55.625169+0000', 'last_fullsized': '2024-09-12T01:35:55.625169+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.412 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-12T01:36:00.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.625373+0000', 'last_change': '2024-09-12T01:35:55.625373+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.625373+0000', 'last_undegraded': '2024-09-12T01:35:55.625373+0000', 'last_fullsized': '2024-09-12T01:35:55.625373+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.412 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-12T01:36:00.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:35:55.610782+0000', 'last_change': '2024-09-12T01:35:55.610782+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.610782+0000', 'last_undegraded': '2024-09-12T01:35:55.610782+0000', 'last_fullsized': '2024-09-12T01:35:55.610782+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:00.412 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-12T01:36:00.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:35:55.610782+0000', 'last_change': '2024-09-12T01:35:55.610782+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.610782+0000', 'last_undegraded': '2024-09-12T01:35:55.610782+0000', 'last_fullsized': '2024-09-12T01:35:55.610782+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:00.412 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-12T01:36:00.412 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.618586+0000', 'last_change': '2024-09-12T01:35:55.618586+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.618586+0000', 'last_undegraded': '2024-09-12T01:35:55.618586+0000', 'last_fullsized': '2024-09-12T01:35:55.618586+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.412 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-12T01:36:00.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.625198+0000', 'last_change': '2024-09-12T01:35:55.625198+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.625198+0000', 'last_undegraded': '2024-09-12T01:35:55.625198+0000', 'last_fullsized': '2024-09-12T01:35:55.625198+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.413 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-12T01:36:00.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.622142+0000', 'last_change': '2024-09-12T01:35:55.622142+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.622142+0000', 'last_undegraded': '2024-09-12T01:35:55.622142+0000', 'last_fullsized': '2024-09-12T01:35:55.622142+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.413 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-12T01:36:00.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.620296+0000', 'last_change': '2024-09-12T01:35:55.620296+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.620296+0000', 'last_undegraded': '2024-09-12T01:35:55.620296+0000', 'last_fullsized': '2024-09-12T01:35:55.620296+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:36:00.413 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-12T01:36:00.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.623080+0000', 'last_change': '2024-09-12T01:35:55.623080+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.623080+0000', 'last_undegraded': '2024-09-12T01:35:55.623080+0000', 'last_fullsized': '2024-09-12T01:35:55.623080+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.413 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-12T01:36:00.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.624919+0000', 'last_change': '2024-09-12T01:35:55.624919+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.624919+0000', 'last_undegraded': '2024-09-12T01:35:55.624919+0000', 'last_fullsized': '2024-09-12T01:35:55.624919+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.413 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-12T01:36:00.413 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.618101+0000', 'last_change': '2024-09-12T01:35:55.618101+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.618101+0000', 'last_undegraded': '2024-09-12T01:35:55.618101+0000', 'last_fullsized': '2024-09-12T01:35:55.618101+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:36:00.414 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-12T01:36:00.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.617490+0000', 'last_change': '2024-09-12T01:35:55.617490+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.617490+0000', 'last_undegraded': '2024-09-12T01:35:55.617490+0000', 'last_fullsized': '2024-09-12T01:35:55.617490+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.414 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-12T01:36:00.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.622303+0000', 'last_change': '2024-09-12T01:35:55.622303+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.622303+0000', 'last_undegraded': '2024-09-12T01:35:55.622303+0000', 'last_fullsized': '2024-09-12T01:35:55.622303+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.414 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-12T01:36:00.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.619766+0000', 'last_change': '2024-09-12T01:35:55.619766+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.619766+0000', 'last_undegraded': '2024-09-12T01:35:55.619766+0000', 'last_fullsized': '2024-09-12T01:35:55.619766+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.414 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-12T01:36:00.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.621156+0000', 'last_change': '2024-09-12T01:35:55.621156+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.621156+0000', 'last_undegraded': '2024-09-12T01:35:55.621156+0000', 'last_fullsized': '2024-09-12T01:35:55.621156+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:00.414 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-12T01:36:00.414 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:35:55.610782+0000', 'last_change': '2024-09-12T01:35:55.610782+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.610782+0000', 'last_undegraded': '2024-09-12T01:35:55.610782+0000', 'last_fullsized': '2024-09-12T01:35:55.610782+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:00.414 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-12T01:36:00.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:35:55.610782+0000', 'last_change': '2024-09-12T01:35:55.610782+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.610782+0000', 'last_undegraded': '2024-09-12T01:35:55.610782+0000', 'last_fullsized': '2024-09-12T01:35:55.610782+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:00.415 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-12T01:36:00.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.617690+0000', 'last_change': '2024-09-12T01:35:55.617690+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.617690+0000', 'last_undegraded': '2024-09-12T01:35:55.617690+0000', 'last_fullsized': '2024-09-12T01:35:55.617690+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.415 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-12T01:36:00.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.621917+0000', 'last_change': '2024-09-12T01:35:55.621917+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.621917+0000', 'last_undegraded': '2024-09-12T01:35:55.621917+0000', 'last_fullsized': '2024-09-12T01:35:55.621917+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.415 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-12T01:36:00.415 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.620388+0000', 'last_change': '2024-09-12T01:35:55.620388+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.620388+0000', 'last_undegraded': '2024-09-12T01:35:55.620388+0000', 'last_fullsized': '2024-09-12T01:35:55.620388+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:36:00.415 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-12T01:36:00.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.619468+0000', 'last_change': '2024-09-12T01:35:55.619468+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.619468+0000', 'last_undegraded': '2024-09-12T01:35:55.619468+0000', 'last_fullsized': '2024-09-12T01:35:55.619468+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:00.416 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-12T01:36:00.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.617380+0000', 'last_change': '2024-09-12T01:35:55.617380+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.617380+0000', 'last_undegraded': '2024-09-12T01:35:55.617380+0000', 'last_fullsized': '2024-09-12T01:35:55.617380+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:36:00.416 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1b is not active+clean 2024-09-12T01:36:00.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.619533+0000', 'last_change': '2024-09-12T01:35:55.619533+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.619533+0000', 'last_undegraded': '2024-09-12T01:35:55.619533+0000', 'last_fullsized': '2024-09-12T01:35:55.619533+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': ['5', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.416 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-12T01:36:00.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.620979+0000', 'last_change': '2024-09-12T01:35:55.620979+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.620979+0000', 'last_undegraded': '2024-09-12T01:35:55.620979+0000', 'last_fullsized': '2024-09-12T01:35:55.620979+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.416 INFO:tasks.ceph.ceph_manager.ceph:PG 2.19 is not active+clean 2024-09-12T01:36:00.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:54.616863+0000', 'last_change': '2024-09-12T01:35:54.616863+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:54.616863+0000', 'last_undegraded': '2024-09-12T01:35:54.616863+0000', 'last_fullsized': '2024-09-12T01:35:54.616863+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:36:00.416 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-12T01:36:00.416 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.617529+0000', 'last_change': '2024-09-12T01:35:55.617529+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.617529+0000', 'last_undegraded': '2024-09-12T01:35:55.617529+0000', 'last_fullsized': '2024-09-12T01:35:55.617529+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.417 INFO:tasks.ceph.ceph_manager.ceph:PG 2.18 is not active+clean 2024-09-12T01:36:00.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.621628+0000', 'last_change': '2024-09-12T01:35:55.621628+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.621628+0000', 'last_undegraded': '2024-09-12T01:35:55.621628+0000', 'last_fullsized': '2024-09-12T01:35:55.621628+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': ['3', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.417 INFO:tasks.ceph.ceph_manager.ceph:PG 2.17 is not active+clean 2024-09-12T01:36:00.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.617259+0000', 'last_change': '2024-09-12T01:35:55.617259+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.617259+0000', 'last_undegraded': '2024-09-12T01:35:55.617259+0000', 'last_fullsized': '2024-09-12T01:35:55.617259+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': ['1', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:36:00.417 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-12T01:36:00.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.620673+0000', 'last_change': '2024-09-12T01:35:55.620673+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.620673+0000', 'last_undegraded': '2024-09-12T01:35:55.620673+0000', 'last_fullsized': '2024-09-12T01:35:55.620673+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:00.417 INFO:tasks.ceph.ceph_manager.ceph:PG 2.16 is not active+clean 2024-09-12T01:36:00.417 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.621631+0000', 'last_change': '2024-09-12T01:35:55.621631+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.621631+0000', 'last_undegraded': '2024-09-12T01:35:55.621631+0000', 'last_fullsized': '2024-09-12T01:35:55.621631+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.417 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-12T01:36:00.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.617596+0000', 'last_change': '2024-09-12T01:35:55.617596+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.617596+0000', 'last_undegraded': '2024-09-12T01:35:55.617596+0000', 'last_fullsized': '2024-09-12T01:35:55.617596+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.418 INFO:tasks.ceph.ceph_manager.ceph:PG 2.15 is not active+clean 2024-09-12T01:36:00.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:54.616803+0000', 'last_change': '2024-09-12T01:35:54.616803+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:54.616803+0000', 'last_undegraded': '2024-09-12T01:35:54.616803+0000', 'last_fullsized': '2024-09-12T01:35:54.616803+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:36:00.418 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-12T01:36:00.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.622699+0000', 'last_change': '2024-09-12T01:35:55.622699+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.622699+0000', 'last_undegraded': '2024-09-12T01:35:55.622699+0000', 'last_fullsized': '2024-09-12T01:35:55.622699+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.418 INFO:tasks.ceph.ceph_manager.ceph:PG 2.14 is not active+clean 2024-09-12T01:36:00.418 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.615864+0000', 'last_change': '2024-09-12T01:35:55.615864+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.615864+0000', 'last_undegraded': '2024-09-12T01:35:55.615864+0000', 'last_fullsized': '2024-09-12T01:35:55.615864+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': ['2', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:00.419 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-12T01:36:00.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.624634+0000', 'last_change': '2024-09-12T01:35:55.624634+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.624634+0000', 'last_undegraded': '2024-09-12T01:35:55.624634+0000', 'last_fullsized': '2024-09-12T01:35:55.624634+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.419 INFO:tasks.ceph.ceph_manager.ceph:PG 2.13 is not active+clean 2024-09-12T01:36:00.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:54.616840+0000', 'last_change': '2024-09-12T01:35:54.616840+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:54.616840+0000', 'last_undegraded': '2024-09-12T01:35:54.616840+0000', 'last_fullsized': '2024-09-12T01:35:54.616840+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:36:00.419 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-12T01:36:00.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:35:55.610782+0000', 'last_change': '2024-09-12T01:35:55.610782+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.610782+0000', 'last_undegraded': '2024-09-12T01:35:55.610782+0000', 'last_fullsized': '2024-09-12T01:35:55.610782+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:00.419 INFO:tasks.ceph.ceph_manager.ceph:PG 2.12 is not active+clean 2024-09-12T01:36:00.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.620906+0000', 'last_change': '2024-09-12T01:35:55.620906+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.620906+0000', 'last_undegraded': '2024-09-12T01:35:55.620906+0000', 'last_fullsized': '2024-09-12T01:35:55.620906+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': ['3', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.419 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-12T01:36:00.419 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.623965+0000', 'last_change': '2024-09-12T01:35:55.623965+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.623965+0000', 'last_undegraded': '2024-09-12T01:35:55.623965+0000', 'last_fullsized': '2024-09-12T01:35:55.623965+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.419 INFO:tasks.ceph.ceph_manager.ceph:PG 2.11 is not active+clean 2024-09-12T01:36:00.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.622266+0000', 'last_change': '2024-09-12T01:35:55.622266+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.622266+0000', 'last_undegraded': '2024-09-12T01:35:55.622266+0000', 'last_fullsized': '2024-09-12T01:35:55.622266+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': ['0', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.420 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-12T01:36:00.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.617336+0000', 'last_change': '2024-09-12T01:35:55.617336+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.617336+0000', 'last_undegraded': '2024-09-12T01:35:55.617336+0000', 'last_fullsized': '2024-09-12T01:35:55.617336+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:36:00.420 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-12T01:36:00.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.621216+0000', 'last_change': '2024-09-12T01:35:55.621216+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.621216+0000', 'last_undegraded': '2024-09-12T01:35:55.621216+0000', 'last_fullsized': '2024-09-12T01:35:55.621216+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.420 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-12T01:36:00.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.625866+0000', 'last_change': '2024-09-12T01:35:55.625866+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.625866+0000', 'last_undegraded': '2024-09-12T01:35:55.625866+0000', 'last_fullsized': '2024-09-12T01:35:55.625866+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': ['0', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.420 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-12T01:36:00.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.619560+0000', 'last_change': '2024-09-12T01:35:55.619560+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.619560+0000', 'last_undegraded': '2024-09-12T01:35:55.619560+0000', 'last_fullsized': '2024-09-12T01:35:55.619560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:00.420 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-12T01:36:00.420 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.625776+0000', 'last_change': '2024-09-12T01:35:55.625776+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.625776+0000', 'last_undegraded': '2024-09-12T01:35:55.625776+0000', 'last_fullsized': '2024-09-12T01:35:55.625776+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.421 INFO:tasks.ceph.ceph_manager.ceph:PG 2.d is not active+clean 2024-09-12T01:36:00.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.620076+0000', 'last_change': '2024-09-12T01:35:55.620076+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.620076+0000', 'last_undegraded': '2024-09-12T01:35:55.620076+0000', 'last_fullsized': '2024-09-12T01:35:55.620076+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.421 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-12T01:36:00.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.623700+0000', 'last_change': '2024-09-12T01:35:55.623700+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.623700+0000', 'last_undegraded': '2024-09-12T01:35:55.623700+0000', 'last_fullsized': '2024-09-12T01:35:55.623700+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.421 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-12T01:36:00.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:54.617520+0000', 'last_change': '2024-09-12T01:35:54.617520+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:54.617520+0000', 'last_undegraded': '2024-09-12T01:35:54.617520+0000', 'last_fullsized': '2024-09-12T01:35:54.617520+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:36:00.421 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-12T01:36:00.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.624235+0000', 'last_change': '2024-09-12T01:35:55.624235+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.624235+0000', 'last_undegraded': '2024-09-12T01:35:55.624235+0000', 'last_fullsized': '2024-09-12T01:35:55.624235+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.421 INFO:tasks.ceph.ceph_manager.ceph:PG 2.3 is not active+clean 2024-09-12T01:36:00.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.622144+0000', 'last_change': '2024-09-12T01:35:55.622144+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.622144+0000', 'last_undegraded': '2024-09-12T01:35:55.622144+0000', 'last_fullsized': '2024-09-12T01:35:55.622144+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.421 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-12T01:36:00.421 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.621589+0000', 'last_change': '2024-09-12T01:35:55.621589+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.621589+0000', 'last_undegraded': '2024-09-12T01:35:55.621589+0000', 'last_fullsized': '2024-09-12T01:35:55.621589+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': ['3', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.422 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-12T01:36:00.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:35:55.610782+0000', 'last_change': '2024-09-12T01:35:55.610782+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.610782+0000', 'last_undegraded': '2024-09-12T01:35:55.610782+0000', 'last_fullsized': '2024-09-12T01:35:55.610782+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:00.422 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-12T01:36:00.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.621251+0000', 'last_change': '2024-09-12T01:35:55.621251+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.621251+0000', 'last_undegraded': '2024-09-12T01:35:55.621251+0000', 'last_fullsized': '2024-09-12T01:35:55.621251+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': ['7', '5'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:36:00.422 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-12T01:36:00.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.619326+0000', 'last_change': '2024-09-12T01:35:55.619326+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.619326+0000', 'last_undegraded': '2024-09-12T01:35:55.619326+0000', 'last_fullsized': '2024-09-12T01:35:55.619326+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.422 INFO:tasks.ceph.ceph_manager.ceph:PG 2.2 is not active+clean 2024-09-12T01:36:00.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.620581+0000', 'last_change': '2024-09-12T01:35:55.620581+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.620581+0000', 'last_undegraded': '2024-09-12T01:35:55.620581+0000', 'last_fullsized': '2024-09-12T01:35:55.620581+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': ['3', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.422 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-12T01:36:00.422 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.626444+0000', 'last_change': '2024-09-12T01:35:55.626444+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.626444+0000', 'last_undegraded': '2024-09-12T01:35:55.626444+0000', 'last_fullsized': '2024-09-12T01:35:55.626444+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.422 INFO:tasks.ceph.ceph_manager.ceph:PG 2.4 is not active+clean 2024-09-12T01:36:00.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.618319+0000', 'last_change': '2024-09-12T01:35:55.618319+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.618319+0000', 'last_undegraded': '2024-09-12T01:35:55.618319+0000', 'last_fullsized': '2024-09-12T01:35:55.618319+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': ['5', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.423 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-12T01:36:00.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.619440+0000', 'last_change': '2024-09-12T01:35:55.619440+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.619440+0000', 'last_undegraded': '2024-09-12T01:35:55.619440+0000', 'last_fullsized': '2024-09-12T01:35:55.619440+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:00.423 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-12T01:36:00.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.621690+0000', 'last_change': '2024-09-12T01:35:55.621690+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.621690+0000', 'last_undegraded': '2024-09-12T01:35:55.621690+0000', 'last_fullsized': '2024-09-12T01:35:55.621690+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': ['3', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.423 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-12T01:36:00.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:35:55.610782+0000', 'last_change': '2024-09-12T01:35:55.610782+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.610782+0000', 'last_undegraded': '2024-09-12T01:35:55.610782+0000', 'last_fullsized': '2024-09-12T01:35:55.610782+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:00.423 INFO:tasks.ceph.ceph_manager.ceph:PG 2.7 is not active+clean 2024-09-12T01:36:00.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.620792+0000', 'last_change': '2024-09-12T01:35:55.620792+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.620792+0000', 'last_undegraded': '2024-09-12T01:35:55.620792+0000', 'last_fullsized': '2024-09-12T01:35:55.620792+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': ['3', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.423 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-12T01:36:00.423 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 4, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.629279+0000', 'last_change': '2024-09-12T01:35:55.621704+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.629279+0000', 'last_undegraded': '2024-09-12T01:35:55.629279+0000', 'last_fullsized': '2024-09-12T01:35:55.629279+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.424 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-12T01:36:00.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.620599+0000', 'last_change': '2024-09-12T01:35:55.620599+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.620599+0000', 'last_undegraded': '2024-09-12T01:35:55.620599+0000', 'last_fullsized': '2024-09-12T01:35:55.620599+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.424 INFO:tasks.ceph.ceph_manager.ceph:PG 2.a is not active+clean 2024-09-12T01:36:00.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:54.617559+0000', 'last_change': '2024-09-12T01:35:54.617559+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:54.617559+0000', 'last_undegraded': '2024-09-12T01:35:54.617559+0000', 'last_fullsized': '2024-09-12T01:35:54.617559+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:36:00.424 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-12T01:36:00.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.620277+0000', 'last_change': '2024-09-12T01:35:55.620277+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.620277+0000', 'last_undegraded': '2024-09-12T01:35:55.620277+0000', 'last_fullsized': '2024-09-12T01:35:55.620277+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:36:00.424 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-12T01:36:00.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.622581+0000', 'last_change': '2024-09-12T01:35:55.622581+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.622581+0000', 'last_undegraded': '2024-09-12T01:35:55.622581+0000', 'last_fullsized': '2024-09-12T01:35:55.622581+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': ['3', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.424 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-12T01:36:00.424 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.621419+0000', 'last_change': '2024-09-12T01:35:55.621419+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.621419+0000', 'last_undegraded': '2024-09-12T01:35:55.621419+0000', 'last_fullsized': '2024-09-12T01:35:55.621419+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.425 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-12T01:36:00.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.624687+0000', 'last_change': '2024-09-12T01:35:55.624687+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.624687+0000', 'last_undegraded': '2024-09-12T01:35:55.624687+0000', 'last_fullsized': '2024-09-12T01:35:55.624687+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:00.425 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-12T01:36:00.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.625951+0000', 'last_change': '2024-09-12T01:35:55.625951+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.625951+0000', 'last_undegraded': '2024-09-12T01:35:55.625951+0000', 'last_fullsized': '2024-09-12T01:35:55.625951+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.425 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-12T01:36:00.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.617407+0000', 'last_change': '2024-09-12T01:35:55.617407+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.617407+0000', 'last_undegraded': '2024-09-12T01:35:55.617407+0000', 'last_fullsized': '2024-09-12T01:35:55.617407+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:36:00.425 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-12T01:36:00.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.624201+0000', 'last_change': '2024-09-12T01:35:55.624201+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.624201+0000', 'last_undegraded': '2024-09-12T01:35:55.624201+0000', 'last_fullsized': '2024-09-12T01:35:55.624201+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:00.425 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-12T01:36:00.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.618323+0000', 'last_change': '2024-09-12T01:35:55.618323+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.618323+0000', 'last_undegraded': '2024-09-12T01:35:55.618323+0000', 'last_fullsized': '2024-09-12T01:35:55.618323+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.425 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1e is not active+clean 2024-09-12T01:36:00.425 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 21, 'state': 'creating+activating', 'last_fresh': '2024-09-12T01:35:55.617912+0000', 'last_change': '2024-09-12T01:35:55.617912+0000', 'last_active': '2024-09-12T01:35:54.606018+0000', 'last_peered': '2024-09-12T01:35:54.606018+0000', 'last_clean': '2024-09-12T01:35:54.606018+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.617912+0000', 'last_undegraded': '2024-09-12T01:35:55.617912+0000', 'last_fullsized': '2024-09-12T01:35:55.617912+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:54.606018+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.426 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-12T01:36:00.426 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:35:55.617790+0000', 'last_change': '2024-09-12T01:35:55.617790+0000', 'last_active': '2024-09-12T01:35:55.610782+0000', 'last_peered': '2024-09-12T01:35:55.610782+0000', 'last_clean': '2024-09-12T01:35:55.610782+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:35:55.617790+0000', 'last_undegraded': '2024-09-12T01:35:55.617790+0000', 'last_fullsized': '2024-09-12T01:35:55.617790+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'last_clean_scrub_stamp': '2024-09-12T01:35:55.610782+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:00.426 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:36:00.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.547+0000 7f348e4af640 1 Processor -- start 2024-09-12T01:36:00.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.547+0000 7f348e4af640 1 -- start start 2024-09-12T01:36:00.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.548+0000 7f348e4af640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f348815e660 0x7f34880cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.548+0000 7f348e4af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34880d3310 0x7f34880d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.548+0000 7f348e4af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f348815ea40 con 0x7f34880d1650 2024-09-12T01:36:00.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.548+0000 7f348e4af640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f34880d1ac0 con 0x7f348815e660 2024-09-12T01:36:00.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.548+0000 7f348e4af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f34880d3870 con 0x7f34880d3310 2024-09-12T01:36:00.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.548+0000 7f348ca4c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f34880d1650 0x7f348806bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:57858/0 (socket says 172.21.15.60:57858) 2024-09-12T01:36:00.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.548+0000 7f348ca4c640 1 -- 172.21.15.60:0/3050191519 learned_addr learned my addr 172.21.15.60:0/3050191519 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:00.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.548+0000 7f3487fff640 1 --2- 172.21.15.60:0/3050191519 >> v2:172.21.15.105:3300/0 conn(0x7f348815e660 0x7f34880cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.548+0000 7f34877fe640 1 --2- 172.21.15.60:0/3050191519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34880d3310 0x7f34880d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.548+0000 7f3486ffd640 1 -- 172.21.15.60:0/3050191519 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2783423473 0 0) 0x7f348815ea40 con 0x7f34880d1650 2024-09-12T01:36:00.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.548+0000 7f3486ffd640 1 -- 172.21.15.60:0/3050191519 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3470003520 con 0x7f34880d1650 2024-09-12T01:36:00.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.549+0000 7f3486ffd640 1 -- 172.21.15.60:0/3050191519 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2823075923 0 0) 0x7f3470003520 con 0x7f34880d1650 2024-09-12T01:36:00.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.549+0000 7f3487fff640 1 -- 172.21.15.60:0/3050191519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34880d3310 msgr2=0x7f34880d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:00.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.549+0000 7f3487fff640 1 --2- 172.21.15.60:0/3050191519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34880d3310 0x7f34880d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.549+0000 7f3487fff640 1 -- 172.21.15.60:0/3050191519 >> v1:172.21.15.60:6789/0 conn(0x7f34880d1650 legacy=0x7f348806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.549+0000 7f3487fff640 1 -- 172.21.15.60:0/3050191519 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34880d3b50 con 0x7f348815e660 2024-09-12T01:36:00.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.549+0000 7f34877fe640 1 --2- 172.21.15.60:0/3050191519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34880d3310 0x7f34880d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.549+0000 7f3487fff640 1 --2- 172.21.15.60:0/3050191519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f348815e660 0x7f34880cf730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f34780097a0 tx=0x7f347802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3c88156d22851e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.549+0000 7f3486ffd640 1 -- 172.21.15.60:0/3050191519 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478037070 con 0x7f348815e660 2024-09-12T01:36:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.550+0000 7f3486ffd640 1 -- 172.21.15.60:0/3050191519 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f347802aba0 con 0x7f348815e660 2024-09-12T01:36:00.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.550+0000 7f3486ffd640 1 -- 172.21.15.60:0/3050191519 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34800019f0 con 0x7f348815e660 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.550+0000 7f348e4af640 1 -- 172.21.15.60:0/3050191519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f348815e660 msgr2=0x7f34880cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.550+0000 7f348e4af640 1 --2- 172.21.15.60:0/3050191519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f348815e660 0x7f34880cf730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f34780097a0 tx=0x7f347802a110 comp rx=0 tx=0).stop 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.550+0000 7f348e4af640 1 -- 172.21.15.60:0/3050191519 shutdown_connections 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.550+0000 7f348e4af640 1 --2- 172.21.15.60:0/3050191519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34880d3310 0x7f34880d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.550+0000 7f348e4af640 1 --2- 172.21.15.60:0/3050191519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f348815e660 0x7f34880cf730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.550+0000 7f348e4af640 1 -- 172.21.15.60:0/3050191519 >> 172.21.15.60:0/3050191519 conn(0x7f34880b6410 msgr2=0x7f34880b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.550+0000 7f348e4af640 1 -- 172.21.15.60:0/3050191519 shutdown_connections 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.550+0000 7f348e4af640 1 -- 172.21.15.60:0/3050191519 wait complete. 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.551+0000 7f348e4af640 1 Processor -- start 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.551+0000 7f348e4af640 1 -- start start 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.552+0000 7f348e4af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34880d1650 0x7f34881613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.552+0000 7f348e4af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34880d3310 0x7f3488150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.552+0000 7f348e4af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f348815e660 0x7f34880c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.552+0000 7f348e4af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f34880d43f0 con 0x7f348815e660 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.552+0000 7f348e4af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f34880d4110 con 0x7f34880d3310 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.552+0000 7f348e4af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f34880cfc70 con 0x7f34880d1650 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.552+0000 7f348ca4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f348815e660 0x7f34880c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.552+0000 7f348ca4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f348815e660 0x7f34880c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33856/0 (socket says 172.21.15.60:33856) 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.552+0000 7f348ca4c640 1 -- 172.21.15.60:0/4207037810 learned_addr learned my addr 172.21.15.60:0/4207037810 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.552+0000 7f34877fe640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34880d3310 0x7f3488150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.552+0000 7f3487fff640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34880d1650 0x7f34881613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.553+0000 7f348ca4c640 1 -- 172.21.15.60:0/4207037810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34880d1650 msgr2=0x7f34881613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.553+0000 7f348ca4c640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34880d1650 0x7f34881613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.553+0000 7f348ca4c640 1 -- 172.21.15.60:0/4207037810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34880d3310 msgr2=0x7f3488150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.553+0000 7f348ca4c640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34880d3310 0x7f3488150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.553+0000 7f348ca4c640 1 -- 172.21.15.60:0/4207037810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34880c8890 con 0x7f348815e660 2024-09-12T01:36:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.553+0000 7f348ca4c640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f348815e660 0x7f34880c8040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3480001b60 tx=0x7f348000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.553+0000 7f3484ff9640 1 -- 172.21.15.60:0/4207037810 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480017070 con 0x7f348815e660 2024-09-12T01:36:00.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.553+0000 7f3484ff9640 1 -- 172.21.15.60:0/4207037810 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3480012400 con 0x7f348815e660 2024-09-12T01:36:00.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.553+0000 7f348e4af640 1 -- 172.21.15.60:0/4207037810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34880c8b70 con 0x7f348815e660 2024-09-12T01:36:00.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.553+0000 7f3484ff9640 1 -- 172.21.15.60:0/4207037810 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34800127b0 con 0x7f348815e660 2024-09-12T01:36:00.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.553+0000 7f348e4af640 1 -- 172.21.15.60:0/4207037810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34880c9130 con 0x7f348815e660 2024-09-12T01:36:00.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.554+0000 7f348e4af640 1 -- 172.21.15.60:0/4207037810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34880d1110 con 0x7f348815e660 2024-09-12T01:36:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.555+0000 7f3484ff9640 1 -- 172.21.15.60:0/4207037810 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f348001a070 con 0x7f348815e660 2024-09-12T01:36:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.555+0000 7f3484ff9640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f347406be30 0x7f347406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.555+0000 7f3484ff9640 1 -- 172.21.15.60:0/4207037810 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f348008acb0 con 0x7f348815e660 2024-09-12T01:36:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.555+0000 7f3487fff640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f347406be30 0x7f347406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.556+0000 7f3487fff640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f347406be30 0x7f347406e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3478034000 tx=0x7f347802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.559+0000 7f3484ff9640 1 -- 172.21.15.60:0/4207037810 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3480059010 con 0x7f348815e660 2024-09-12T01:36:00.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.805+0000 7f348e4af640 1 -- 172.21.15.60:0/4207037810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f348815b860 con 0x7f348815e660 2024-09-12T01:36:00.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.805+0000 7f3484ff9640 1 -- 172.21.15.60:0/4207037810 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1262 (secure 0 0 0) 0x7f348005d310 con 0x7f348815e660 2024-09-12T01:36:00.806 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:00.806 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":27,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1726104944,"num_in_osds":8,"osd_in_since":1726104934,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":55},{"state_name":"creating+activating","count":22},{"state_name":"active+clean","count":13},{"state_name":"unknown","count":7}],"num_pgs":97,"num_pools":3,"num_objects":10,"data_bytes":590950,"bytes_used":241270784,"bytes_avail":772852842496,"bytes_total":773094113280,"unknown_pgs_ratio":0.072164945304393768,"inactive_pgs_ratio":0.79381442070007324,"write_bytes_sec":181,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":7,"btime":"2024-09-12T01:35:58:740642+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4294}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-12T01:35:31.949606+0000","services":{}},"progress_events":{}} 2024-09-12T01:36:00.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.808+0000 7f348e4af640 1 -- 172.21.15.60:0/4207037810 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f347406be30 msgr2=0x7f347406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.808+0000 7f348e4af640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f347406be30 0x7f347406e2f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3478034000 tx=0x7f347802e000 comp rx=0 tx=0).stop 2024-09-12T01:36:00.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.808+0000 7f348e4af640 1 -- 172.21.15.60:0/4207037810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f348815e660 msgr2=0x7f34880c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.808+0000 7f348e4af640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f348815e660 0x7f34880c8040 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3480001b60 tx=0x7f348000a430 comp rx=0 tx=0).stop 2024-09-12T01:36:00.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.808+0000 7f348e4af640 1 -- 172.21.15.60:0/4207037810 shutdown_connections 2024-09-12T01:36:00.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.808+0000 7f348e4af640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f348815e660 0x7f34880c8040 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.808+0000 7f348e4af640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34880d3310 0x7f3488150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.808+0000 7f348e4af640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f347406be30 0x7f347406e2f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.808+0000 7f348e4af640 1 --2- 172.21.15.60:0/4207037810 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34880d1650 0x7f34881613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.808+0000 7f348e4af640 1 -- 172.21.15.60:0/4207037810 >> 172.21.15.60:0/4207037810 conn(0x7f34880b6410 msgr2=0x7f34880b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.808+0000 7f348e4af640 1 -- 172.21.15.60:0/4207037810 shutdown_connections 2024-09-12T01:36:00.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.808+0000 7f348e4af640 1 -- 172.21.15.60:0/4207037810 wait complete. 2024-09-12T01:36:00.819 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:36:00.819 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:36:00.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.921+0000 7f0ea7cf1640 1 Processor -- start 2024-09-12T01:36:00.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.921+0000 7f0ea7cf1640 1 -- start start 2024-09-12T01:36:00.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.922+0000 7f0ea7cf1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0ea015e860 0x7f0ea00d2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.922+0000 7f0ea7cf1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0ea00d2ff0 0x7f0ea00b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.922+0000 7f0ea7cf1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ea00b66a0 0x7f0ea006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.922+0000 7f0ea7cf1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea00b6b10 con 0x7f0ea00d2ff0 2024-09-12T01:36:00.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.922+0000 7f0ea7cf1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0ea00d40d0 con 0x7f0ea015e860 2024-09-12T01:36:00.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.922+0000 7f0ea7cf1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea00d34c0 con 0x7f0ea00b66a0 2024-09-12T01:36:00.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.922+0000 7f0ea528c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0ea00d2ff0 0x7f0ea00b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.922+0000 7f0ea528c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0ea00d2ff0 0x7f0ea00b6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33870/0 (socket says 172.21.15.60:33870) 2024-09-12T01:36:00.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.922+0000 7f0ea528c640 1 -- 172.21.15.60:0/1528230289 learned_addr learned my addr 172.21.15.60:0/1528230289 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.922+0000 7f0ea5a8d640 1 --2- 172.21.15.60:0/1528230289 >> v2:172.21.15.105:3300/0 conn(0x7f0ea015e860 0x7f0ea00d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.923+0000 7f0ea528c640 1 -- 172.21.15.60:0/1528230289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ea00b66a0 msgr2=0x7f0ea006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.923+0000 7f0ea628e640 1 --2- 172.21.15.60:0/1528230289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ea00b66a0 0x7f0ea006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.923+0000 7f0ea528c640 1 --2- 172.21.15.60:0/1528230289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ea00b66a0 0x7f0ea006bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.923+0000 7f0ea528c640 1 -- 172.21.15.60:0/1528230289 >> v2:172.21.15.105:3300/0 conn(0x7f0ea015e860 msgr2=0x7f0ea00d2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.923+0000 7f0ea528c640 1 --2- 172.21.15.60:0/1528230289 >> v2:172.21.15.105:3300/0 conn(0x7f0ea015e860 0x7f0ea00d2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.923+0000 7f0ea528c640 1 -- 172.21.15.60:0/1528230289 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea00d37a0 con 0x7f0ea00d2ff0 2024-09-12T01:36:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.923+0000 7f0ea5a8d640 1 --2- 172.21.15.60:0/1528230289 >> v2:172.21.15.105:3300/0 conn(0x7f0ea015e860 0x7f0ea00d2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.923+0000 7f0ea628e640 1 --2- 172.21.15.60:0/1528230289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ea00b66a0 0x7f0ea006bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.923+0000 7f0ea528c640 1 --2- 172.21.15.60:0/1528230289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ea00d2ff0 0x7f0ea00b6160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ea006cfc0 tx=0x7f0e9002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f149e95292e39d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.923+0000 7f0ea4a8b640 1 -- 172.21.15.60:0/1528230289 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90037070 con 0x7f0ea00d2ff0 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.923+0000 7f0ea4a8b640 1 -- 172.21.15.60:0/1528230289 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e90032440 con 0x7f0ea00d2ff0 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.924+0000 7f0ea4a8b640 1 -- 172.21.15.60:0/1528230289 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e90032810 con 0x7f0ea00d2ff0 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.924+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/1528230289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ea00d2ff0 msgr2=0x7f0ea00b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.924+0000 7f0ea7cf1640 1 --2- 172.21.15.60:0/1528230289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ea00d2ff0 0x7f0ea00b6160 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ea006cfc0 tx=0x7f0e9002a1e0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.924+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/1528230289 shutdown_connections 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.924+0000 7f0ea7cf1640 1 --2- 172.21.15.60:0/1528230289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ea00b66a0 0x7f0ea006bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.924+0000 7f0ea7cf1640 1 --2- 172.21.15.60:0/1528230289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ea00d2ff0 0x7f0ea00b6160 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.924+0000 7f0ea7cf1640 1 --2- 172.21.15.60:0/1528230289 >> v2:172.21.15.105:3300/0 conn(0x7f0ea015e860 0x7f0ea00d2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.924+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/1528230289 >> 172.21.15.60:0/1528230289 conn(0x7f0ea0062c60 msgr2=0x7f0ea00d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.924+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/1528230289 shutdown_connections 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.924+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/1528230289 wait complete. 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.925+0000 7f0ea7cf1640 1 Processor -- start 2024-09-12T01:36:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.925+0000 7f0ea7cf1640 1 -- start start 2024-09-12T01:36:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea7cf1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ea00b66a0 0x7f0ea00cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea7cf1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ea00d2ff0 0x7f0ea01f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea7cf1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ea015e860 0x7f0ea00ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea7cf1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00b3890 con 0x7f0ea015e860 2024-09-12T01:36:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea7cf1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ea00d3d60 con 0x7f0ea00d2ff0 2024-09-12T01:36:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea7cf1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ea00b3a10 con 0x7f0ea00b66a0 2024-09-12T01:36:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea628e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ea015e860 0x7f0ea00ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea628e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ea015e860 0x7f0ea00ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33878/0 (socket says 172.21.15.60:33878) 2024-09-12T01:36:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea628e640 1 -- 172.21.15.60:0/755915373 learned_addr learned my addr 172.21.15.60:0/755915373 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea528c640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ea00d2ff0 0x7f0ea01f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea5a8d640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ea00b66a0 0x7f0ea00cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea628e640 1 -- 172.21.15.60:0/755915373 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ea00b66a0 msgr2=0x7f0ea00cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea628e640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ea00b66a0 0x7f0ea00cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea628e640 1 -- 172.21.15.60:0/755915373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ea00d2ff0 msgr2=0x7f0ea01f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea628e640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ea00d2ff0 0x7f0ea01f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.926+0000 7f0ea628e640 1 -- 172.21.15.60:0/755915373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea00ccd40 con 0x7f0ea015e860 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.927+0000 7f0ea628e640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ea015e860 0x7f0ea00ca6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800cf20 tx=0x7f0e9800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.927+0000 7f0e967fc640 1 -- 172.21.15.60:0/755915373 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9801a070 con 0x7f0ea015e860 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.927+0000 7f0e967fc640 1 -- 172.21.15.60:0/755915373 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e9800d840 con 0x7f0ea015e860 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.927+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/755915373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea01f4ed0 con 0x7f0ea015e860 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.927+0000 7f0e967fc640 1 -- 172.21.15.60:0/755915373 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800dc30 con 0x7f0ea015e860 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.927+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/755915373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ea00c90a0 con 0x7f0ea015e860 2024-09-12T01:36:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.928+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/755915373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ea00b6160 con 0x7f0ea015e860 2024-09-12T01:36:00.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.928+0000 7f0e967fc640 1 -- 172.21.15.60:0/755915373 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e9801d070 con 0x7f0ea015e860 2024-09-12T01:36:00.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.929+0000 7f0e967fc640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e8406be30 0x7f0e8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:00.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.929+0000 7f0e967fc640 1 -- 172.21.15.60:0/755915373 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0e9808b5e0 con 0x7f0ea015e860 2024-09-12T01:36:00.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.929+0000 7f0ea5a8d640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e8406be30 0x7f0e8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:00.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.929+0000 7f0ea5a8d640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e8406be30 0x7f0e8406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ea015f5f0 tx=0x7f0e9c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:00.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:00.933+0000 7f0e967fc640 1 -- 172.21.15.60:0/755915373 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0ea01f4ed0 con 0x7f0ea015e860 2024-09-12T01:36:01.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.105+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/755915373 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0ea00b79e0 con 0x7f0e8406be30 2024-09-12T01:36:01.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.110+0000 7f0e967fc640 1 -- 172.21.15.60:0/755915373 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244858 (secure 0 0 0) 0x7f0ea00b79e0 con 0x7f0e8406be30 2024-09-12T01:36:01.113 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:01.114 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:36:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.114+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/755915373 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e8406be30 msgr2=0x7f0e8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.114+0000 7f0ea7cf1640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e8406be30 0x7f0e8406e2f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0ea015f5f0 tx=0x7f0e9c008040 comp rx=0 tx=0).stop 2024-09-12T01:36:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.114+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/755915373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ea015e860 msgr2=0x7f0ea00ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.114+0000 7f0ea7cf1640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ea015e860 0x7f0ea00ca6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800cf20 tx=0x7f0e9800a710 comp rx=0 tx=0).stop 2024-09-12T01:36:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.114+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/755915373 shutdown_connections 2024-09-12T01:36:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.114+0000 7f0ea7cf1640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ea015e860 0x7f0ea00ca6a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.114+0000 7f0ea7cf1640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ea00d2ff0 0x7f0ea01f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.114+0000 7f0ea7cf1640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e8406be30 0x7f0e8406e2f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.114+0000 7f0ea7cf1640 1 --2- 172.21.15.60:0/755915373 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ea00b66a0 0x7f0ea00cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.114+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/755915373 >> 172.21.15.60:0/755915373 conn(0x7f0ea0062c60 msgr2=0x7f0ea00b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:01.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.114+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/755915373 shutdown_connections 2024-09-12T01:36:01.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:01.114+0000 7f0ea7cf1640 1 -- 172.21.15.60:0/755915373 wait complete. 2024-09-12T01:36:01.125 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-12T01:36:00.260706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":179,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":180,"acting":180,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235616,"kb_used_data":2752,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739104,"statfs":{"total":773094113280,"available":772852842496,"internally_reserved":0,"allocated":2818048,"data_stored":1697450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.649358"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.628171+0000","last_change":"2024-09-12T01:35:55.628171+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.628171+0000","last_undegraded":"2024-09-12T01:35:55.628171+0000","last_fullsized":"2024-09-12T01:35:55.628171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619679+0000","last_change":"2024-09-12T01:35:55.619679+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619679+0000","last_undegraded":"2024-09-12T01:35:55.619679+0000","last_fullsized":"2024-09-12T01:35:55.619679+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617675+0000","last_change":"2024-09-12T01:35:55.617675+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617675+0000","last_undegraded":"2024-09-12T01:35:55.617675+0000","last_fullsized":"2024-09-12T01:35:55.617675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620008+0000","last_change":"2024-09-12T01:35:55.620008+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620008+0000","last_undegraded":"2024-09-12T01:35:55.620008+0000","last_fullsized":"2024-09-12T01:35:55.620008+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623789+0000","last_change":"2024-09-12T01:35:55.623789+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623789+0000","last_undegraded":"2024-09-12T01:35:55.623789+0000","last_fullsized":"2024-09-12T01:35:55.623789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619901+0000","last_change":"2024-09-12T01:35:55.619901+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619901+0000","last_undegraded":"2024-09-12T01:35:55.619901+0000","last_fullsized":"2024-09-12T01:35:55.619901+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622730+0000","last_change":"2024-09-12T01:35:55.622730+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622730+0000","last_undegraded":"2024-09-12T01:35:55.622730+0000","last_fullsized":"2024-09-12T01:35:55.622730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619838+0000","last_change":"2024-09-12T01:35:55.619838+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619838+0000","last_undegraded":"2024-09-12T01:35:55.619838+0000","last_fullsized":"2024-09-12T01:35:55.619838+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617420+0000","last_change":"2024-09-12T01:35:55.617420+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617420+0000","last_undegraded":"2024-09-12T01:35:55.617420+0000","last_fullsized":"2024-09-12T01:35:55.617420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624063+0000","last_change":"2024-09-12T01:35:55.624063+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624063+0000","last_undegraded":"2024-09-12T01:35:55.624063+0000","last_fullsized":"2024-09-12T01:35:55.624063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625169+0000","last_change":"2024-09-12T01:35:55.625169+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625169+0000","last_undegraded":"2024-09-12T01:35:55.625169+0000","last_fullsized":"2024-09-12T01:35:55.625169+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625373+0000","last_change":"2024-09-12T01:35:55.625373+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625373+0000","last_undegraded":"2024-09-12T01:35:55.625373+0000","last_fullsized":"2024-09-12T01:35:55.625373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.618586+0000","last_change":"2024-09-12T01:35:55.618586+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618586+0000","last_undegraded":"2024-09-12T01:35:55.618586+0000","last_fullsized":"2024-09-12T01:35:55.618586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625198+0000","last_change":"2024-09-12T01:35:55.625198+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625198+0000","last_undegraded":"2024-09-12T01:35:55.625198+0000","last_fullsized":"2024-09-12T01:35:55.625198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622142+0000","last_change":"2024-09-12T01:35:55.622142+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622142+0000","last_undegraded":"2024-09-12T01:35:55.622142+0000","last_fullsized":"2024-09-12T01:35:55.622142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620296+0000","last_change":"2024-09-12T01:35:55.620296+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620296+0000","last_undegraded":"2024-09-12T01:35:55.620296+0000","last_fullsized":"2024-09-12T01:35:55.620296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623080+0000","last_change":"2024-09-12T01:35:55.623080+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623080+0000","last_undegraded":"2024-09-12T01:35:55.623080+0000","last_fullsized":"2024-09-12T01:35:55.623080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624919+0000","last_change":"2024-09-12T01:35:55.624919+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624919+0000","last_undegraded":"2024-09-12T01:35:55.624919+0000","last_fullsized":"2024-09-12T01:35:55.624919+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630212+0000","last_change":"2024-09-12T01:35:56.630997+0000","last_active":"2024-09-12T01:35:57.630212+0000","last_peered":"2024-09-12T01:35:57.630212+0000","last_clean":"2024-09-12T01:35:57.630212+0000","last_became_active":"2024-09-12T01:35:56.630704+0000","last_became_peered":"2024-09-12T01:35:56.630704+0000","last_unstale":"2024-09-12T01:35:57.630212+0000","last_undegraded":"2024-09-12T01:35:57.630212+0000","last_fullsized":"2024-09-12T01:35:57.630212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:33.242417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.618101+0000","last_change":"2024-09-12T01:35:55.618101+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618101+0000","last_undegraded":"2024-09-12T01:35:55.618101+0000","last_fullsized":"2024-09-12T01:35:55.618101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617490+0000","last_change":"2024-09-12T01:35:55.617490+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617490+0000","last_undegraded":"2024-09-12T01:35:55.617490+0000","last_fullsized":"2024-09-12T01:35:55.617490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622303+0000","last_change":"2024-09-12T01:35:55.622303+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622303+0000","last_undegraded":"2024-09-12T01:35:55.622303+0000","last_fullsized":"2024-09-12T01:35:55.622303+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619766+0000","last_change":"2024-09-12T01:35:55.619766+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619766+0000","last_undegraded":"2024-09-12T01:35:55.619766+0000","last_fullsized":"2024-09-12T01:35:55.619766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621156+0000","last_change":"2024-09-12T01:35:55.621156+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621156+0000","last_undegraded":"2024-09-12T01:35:55.621156+0000","last_fullsized":"2024-09-12T01:35:55.621156+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617690+0000","last_change":"2024-09-12T01:35:55.617690+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617690+0000","last_undegraded":"2024-09-12T01:35:55.617690+0000","last_fullsized":"2024-09-12T01:35:55.617690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621917+0000","last_change":"2024-09-12T01:35:55.621917+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621917+0000","last_undegraded":"2024-09-12T01:35:55.621917+0000","last_fullsized":"2024-09-12T01:35:55.621917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620388+0000","last_change":"2024-09-12T01:35:55.620388+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620388+0000","last_undegraded":"2024-09-12T01:35:55.620388+0000","last_fullsized":"2024-09-12T01:35:55.620388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619468+0000","last_change":"2024-09-12T01:35:55.619468+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619468+0000","last_undegraded":"2024-09-12T01:35:55.619468+0000","last_fullsized":"2024-09-12T01:35:55.619468+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617380+0000","last_change":"2024-09-12T01:35:55.617380+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617380+0000","last_undegraded":"2024-09-12T01:35:55.617380+0000","last_fullsized":"2024-09-12T01:35:55.617380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.619533+0000","last_change":"2024-09-12T01:35:55.619533+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619533+0000","last_undegraded":"2024-09-12T01:35:55.619533+0000","last_fullsized":"2024-09-12T01:35:55.619533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630355+0000","last_change":"2024-09-12T01:35:56.650933+0000","last_active":"2024-09-12T01:35:57.630355+0000","last_peered":"2024-09-12T01:35:57.630355+0000","last_clean":"2024-09-12T01:35:57.630355+0000","last_became_active":"2024-09-12T01:35:56.649511+0000","last_became_peered":"2024-09-12T01:35:56.649511+0000","last_unstale":"2024-09-12T01:35:57.630355+0000","last_undegraded":"2024-09-12T01:35:57.630355+0000","last_fullsized":"2024-09-12T01:35:57.630355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:37.930582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620979+0000","last_change":"2024-09-12T01:35:55.620979+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620979+0000","last_undegraded":"2024-09-12T01:35:55.620979+0000","last_fullsized":"2024-09-12T01:35:55.620979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.616863+0000","last_change":"2024-09-12T01:35:54.616863+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.616863+0000","last_undegraded":"2024-09-12T01:35:54.616863+0000","last_fullsized":"2024-09-12T01:35:54.616863+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617529+0000","last_change":"2024-09-12T01:35:55.617529+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617529+0000","last_undegraded":"2024-09-12T01:35:55.617529+0000","last_fullsized":"2024-09-12T01:35:55.617529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621628+0000","last_change":"2024-09-12T01:35:55.621628+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621628+0000","last_undegraded":"2024-09-12T01:35:55.621628+0000","last_fullsized":"2024-09-12T01:35:55.621628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":["3","1"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630785+0000","last_change":"2024-09-12T01:35:56.639249+0000","last_active":"2024-09-12T01:35:57.630785+0000","last_peered":"2024-09-12T01:35:57.630785+0000","last_clean":"2024-09-12T01:35:57.630785+0000","last_became_active":"2024-09-12T01:35:56.638993+0000","last_became_peered":"2024-09-12T01:35:56.638993+0000","last_unstale":"2024-09-12T01:35:57.630785+0000","last_undegraded":"2024-09-12T01:35:57.630785+0000","last_fullsized":"2024-09-12T01:35:57.630785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:52.928010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.617259+0000","last_change":"2024-09-12T01:35:55.617259+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617259+0000","last_undegraded":"2024-09-12T01:35:55.617259+0000","last_fullsized":"2024-09-12T01:35:55.617259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":["1","4"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620673+0000","last_change":"2024-09-12T01:35:55.620673+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620673+0000","last_undegraded":"2024-09-12T01:35:55.620673+0000","last_fullsized":"2024-09-12T01:35:55.620673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621631+0000","last_change":"2024-09-12T01:35:55.621631+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621631+0000","last_undegraded":"2024-09-12T01:35:55.621631+0000","last_fullsized":"2024-09-12T01:35:55.621631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617596+0000","last_change":"2024-09-12T01:35:55.617596+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617596+0000","last_undegraded":"2024-09-12T01:35:55.617596+0000","last_fullsized":"2024-09-12T01:35:55.617596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.616803+0000","last_change":"2024-09-12T01:35:54.616803+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.616803+0000","last_undegraded":"2024-09-12T01:35:54.616803+0000","last_fullsized":"2024-09-12T01:35:54.616803+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.622699+0000","last_change":"2024-09-12T01:35:55.622699+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622699+0000","last_undegraded":"2024-09-12T01:35:55.622699+0000","last_fullsized":"2024-09-12T01:35:55.622699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.615864+0000","last_change":"2024-09-12T01:35:55.615864+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.615864+0000","last_undegraded":"2024-09-12T01:35:55.615864+0000","last_fullsized":"2024-09-12T01:35:55.615864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":["2","4"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624634+0000","last_change":"2024-09-12T01:35:55.624634+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624634+0000","last_undegraded":"2024-09-12T01:35:55.624634+0000","last_fullsized":"2024-09-12T01:35:55.624634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.616840+0000","last_change":"2024-09-12T01:35:54.616840+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.616840+0000","last_undegraded":"2024-09-12T01:35:54.616840+0000","last_fullsized":"2024-09-12T01:35:54.616840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620906+0000","last_change":"2024-09-12T01:35:55.620906+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620906+0000","last_undegraded":"2024-09-12T01:35:55.620906+0000","last_fullsized":"2024-09-12T01:35:55.620906+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":["3","7"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623965+0000","last_change":"2024-09-12T01:35:55.623965+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623965+0000","last_undegraded":"2024-09-12T01:35:55.623965+0000","last_fullsized":"2024-09-12T01:35:55.623965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.622266+0000","last_change":"2024-09-12T01:35:55.622266+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622266+0000","last_undegraded":"2024-09-12T01:35:55.622266+0000","last_fullsized":"2024-09-12T01:35:55.622266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":["0","3"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617336+0000","last_change":"2024-09-12T01:35:55.617336+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617336+0000","last_undegraded":"2024-09-12T01:35:55.617336+0000","last_fullsized":"2024-09-12T01:35:55.617336+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630113+0000","last_change":"2024-09-12T01:35:55.633512+0000","last_active":"2024-09-12T01:35:57.630113+0000","last_peered":"2024-09-12T01:35:57.630113+0000","last_clean":"2024-09-12T01:35:57.630113+0000","last_became_active":"2024-09-12T01:35:55.630924+0000","last_became_peered":"2024-09-12T01:35:55.630924+0000","last_unstale":"2024-09-12T01:35:57.630113+0000","last_undegraded":"2024-09-12T01:35:57.630113+0000","last_fullsized":"2024-09-12T01:35:57.630113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:22.281284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621216+0000","last_change":"2024-09-12T01:35:55.621216+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621216+0000","last_undegraded":"2024-09-12T01:35:55.621216+0000","last_fullsized":"2024-09-12T01:35:55.621216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.625866+0000","last_change":"2024-09-12T01:35:55.625866+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625866+0000","last_undegraded":"2024-09-12T01:35:55.625866+0000","last_fullsized":"2024-09-12T01:35:55.625866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":["0","5"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619560+0000","last_change":"2024-09-12T01:35:55.619560+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619560+0000","last_undegraded":"2024-09-12T01:35:55.619560+0000","last_fullsized":"2024-09-12T01:35:55.619560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630591+0000","last_change":"2024-09-12T01:35:55.632582+0000","last_active":"2024-09-12T01:35:57.630591+0000","last_peered":"2024-09-12T01:35:57.630591+0000","last_clean":"2024-09-12T01:35:57.630591+0000","last_became_active":"2024-09-12T01:35:55.631969+0000","last_became_peered":"2024-09-12T01:35:55.631969+0000","last_unstale":"2024-09-12T01:35:57.630591+0000","last_undegraded":"2024-09-12T01:35:57.630591+0000","last_fullsized":"2024-09-12T01:35:57.630591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:04.556922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.625776+0000","last_change":"2024-09-12T01:35:55.625776+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625776+0000","last_undegraded":"2024-09-12T01:35:55.625776+0000","last_fullsized":"2024-09-12T01:35:55.625776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620076+0000","last_change":"2024-09-12T01:35:55.620076+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620076+0000","last_undegraded":"2024-09-12T01:35:55.620076+0000","last_fullsized":"2024-09-12T01:35:55.620076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.623700+0000","last_change":"2024-09-12T01:35:55.623700+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.623700+0000","last_undegraded":"2024-09-12T01:35:55.623700+0000","last_fullsized":"2024-09-12T01:35:55.623700+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.617520+0000","last_change":"2024-09-12T01:35:54.617520+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.617520+0000","last_undegraded":"2024-09-12T01:35:54.617520+0000","last_fullsized":"2024-09-12T01:35:54.617520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624235+0000","last_change":"2024-09-12T01:35:55.624235+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624235+0000","last_undegraded":"2024-09-12T01:35:55.624235+0000","last_fullsized":"2024-09-12T01:35:55.624235+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T01:35:55.618559+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:35:55.618559+0000","last_peered":"2024-09-12T01:35:55.618559+0000","last_clean":"2024-09-12T01:35:55.618559+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:35:55.618559+0000","last_undegraded":"2024-09-12T01:35:55.618559+0000","last_fullsized":"2024-09-12T01:35:55.618559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.622144+0000","last_change":"2024-09-12T01:35:55.622144+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622144+0000","last_undegraded":"2024-09-12T01:35:55.622144+0000","last_fullsized":"2024-09-12T01:35:55.622144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630356+0000","last_change":"2024-09-12T01:35:56.631140+0000","last_active":"2024-09-12T01:35:57.630356+0000","last_peered":"2024-09-12T01:35:57.630356+0000","last_clean":"2024-09-12T01:35:57.630356+0000","last_became_active":"2024-09-12T01:35:56.630798+0000","last_became_peered":"2024-09-12T01:35:56.630798+0000","last_unstale":"2024-09-12T01:35:57.630356+0000","last_undegraded":"2024-09-12T01:35:57.630356+0000","last_fullsized":"2024-09-12T01:35:57.630356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:16.316634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621589+0000","last_change":"2024-09-12T01:35:55.621589+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621589+0000","last_undegraded":"2024-09-12T01:35:55.621589+0000","last_fullsized":"2024-09-12T01:35:55.621589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":["3","5"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621251+0000","last_change":"2024-09-12T01:35:55.621251+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621251+0000","last_undegraded":"2024-09-12T01:35:55.621251+0000","last_fullsized":"2024-09-12T01:35:55.621251+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":["7","5"],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619326+0000","last_change":"2024-09-12T01:35:55.619326+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619326+0000","last_undegraded":"2024-09-12T01:35:55.619326+0000","last_fullsized":"2024-09-12T01:35:55.619326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620581+0000","last_change":"2024-09-12T01:35:55.620581+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620581+0000","last_undegraded":"2024-09-12T01:35:55.620581+0000","last_fullsized":"2024-09-12T01:35:55.620581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":["3","6"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.626444+0000","last_change":"2024-09-12T01:35:55.626444+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.626444+0000","last_undegraded":"2024-09-12T01:35:55.626444+0000","last_fullsized":"2024-09-12T01:35:55.626444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.618319+0000","last_change":"2024-09-12T01:35:55.618319+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618319+0000","last_undegraded":"2024-09-12T01:35:55.618319+0000","last_fullsized":"2024-09-12T01:35:55.618319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.619440+0000","last_change":"2024-09-12T01:35:55.619440+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.619440+0000","last_undegraded":"2024-09-12T01:35:55.619440+0000","last_fullsized":"2024-09-12T01:35:55.619440+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.621690+0000","last_change":"2024-09-12T01:35:55.621690+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621690+0000","last_undegraded":"2024-09-12T01:35:55.621690+0000","last_fullsized":"2024-09-12T01:35:55.621690+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":["3","4"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:35:55.610782+0000","last_change":"2024-09-12T01:35:55.610782+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.610782+0000","last_undegraded":"2024-09-12T01:35:55.610782+0000","last_fullsized":"2024-09-12T01:35:55.610782+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641362+0000","last_change":"2024-09-12T01:35:55.636276+0000","last_active":"2024-09-12T01:35:57.641362+0000","last_peered":"2024-09-12T01:35:57.641362+0000","last_clean":"2024-09-12T01:35:57.641362+0000","last_became_active":"2024-09-12T01:35:55.635996+0000","last_became_peered":"2024-09-12T01:35:55.635996+0000","last_unstale":"2024-09-12T01:35:57.641362+0000","last_undegraded":"2024-09-12T01:35:57.641362+0000","last_fullsized":"2024-09-12T01:35:57.641362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:44.922761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631351+0000","last_change":"2024-09-12T01:35:56.641708+0000","last_active":"2024-09-12T01:35:57.631351+0000","last_peered":"2024-09-12T01:35:57.631351+0000","last_clean":"2024-09-12T01:35:57.631351+0000","last_became_active":"2024-09-12T01:35:56.641436+0000","last_became_peered":"2024-09-12T01:35:56.641436+0000","last_unstale":"2024-09-12T01:35:57.631351+0000","last_undegraded":"2024-09-12T01:35:57.631351+0000","last_fullsized":"2024-09-12T01:35:57.631351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:30.517423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.620792+0000","last_change":"2024-09-12T01:35:55.620792+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620792+0000","last_undegraded":"2024-09-12T01:35:55.620792+0000","last_fullsized":"2024-09-12T01:35:55.620792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":["3","0"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630498+0000","last_change":"2024-09-12T01:35:56.638352+0000","last_active":"2024-09-12T01:35:57.630498+0000","last_peered":"2024-09-12T01:35:57.630498+0000","last_clean":"2024-09-12T01:35:57.630498+0000","last_became_active":"2024-09-12T01:35:56.637106+0000","last_became_peered":"2024-09-12T01:35:56.637106+0000","last_unstale":"2024-09-12T01:35:57.630498+0000","last_undegraded":"2024-09-12T01:35:57.630498+0000","last_fullsized":"2024-09-12T01:35:57.630498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:04.733539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":4,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.629279+0000","last_change":"2024-09-12T01:35:55.621704+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.629279+0000","last_undegraded":"2024-09-12T01:35:55.629279+0000","last_fullsized":"2024-09-12T01:35:55.629279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620599+0000","last_change":"2024-09-12T01:35:55.620599+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620599+0000","last_undegraded":"2024-09-12T01:35:55.620599+0000","last_fullsized":"2024-09-12T01:35:55.620599+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631240+0000","last_change":"2024-09-12T01:35:55.635445+0000","last_active":"2024-09-12T01:35:57.631240+0000","last_peered":"2024-09-12T01:35:57.631240+0000","last_clean":"2024-09-12T01:35:57.631240+0000","last_became_active":"2024-09-12T01:35:55.635147+0000","last_became_peered":"2024-09-12T01:35:55.635147+0000","last_unstale":"2024-09-12T01:35:57.631240+0000","last_undegraded":"2024-09-12T01:35:57.631240+0000","last_fullsized":"2024-09-12T01:35:57.631240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:26.672278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630175+0000","last_change":"2024-09-12T01:35:56.638375+0000","last_active":"2024-09-12T01:35:57.630175+0000","last_peered":"2024-09-12T01:35:57.630175+0000","last_clean":"2024-09-12T01:35:57.630175+0000","last_became_active":"2024-09-12T01:35:56.637081+0000","last_became_peered":"2024-09-12T01:35:56.637081+0000","last_unstale":"2024-09-12T01:35:57.630175+0000","last_undegraded":"2024-09-12T01:35:57.630175+0000","last_fullsized":"2024-09-12T01:35:57.630175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:53.842225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-09-12T01:35:54.617559+0000","last_change":"2024-09-12T01:35:54.617559+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:54.617559+0000","last_undegraded":"2024-09-12T01:35:54.617559+0000","last_fullsized":"2024-09-12T01:35:54.617559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.620277+0000","last_change":"2024-09-12T01:35:55.620277+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.620277+0000","last_undegraded":"2024-09-12T01:35:55.620277+0000","last_fullsized":"2024-09-12T01:35:55.620277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.622581+0000","last_change":"2024-09-12T01:35:55.622581+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.622581+0000","last_undegraded":"2024-09-12T01:35:55.622581+0000","last_fullsized":"2024-09-12T01:35:55.622581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":["3","2"],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.621419+0000","last_change":"2024-09-12T01:35:55.621419+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.621419+0000","last_undegraded":"2024-09-12T01:35:55.621419+0000","last_fullsized":"2024-09-12T01:35:55.621419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.624687+0000","last_change":"2024-09-12T01:35:55.624687+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624687+0000","last_undegraded":"2024-09-12T01:35:55.624687+0000","last_fullsized":"2024-09-12T01:35:55.624687+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.625951+0000","last_change":"2024-09-12T01:35:55.625951+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.625951+0000","last_undegraded":"2024-09-12T01:35:55.625951+0000","last_fullsized":"2024-09-12T01:35:55.625951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617407+0000","last_change":"2024-09-12T01:35:55.617407+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617407+0000","last_undegraded":"2024-09-12T01:35:55.617407+0000","last_fullsized":"2024-09-12T01:35:55.617407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.624201+0000","last_change":"2024-09-12T01:35:55.624201+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.624201+0000","last_undegraded":"2024-09-12T01:35:55.624201+0000","last_fullsized":"2024-09-12T01:35:55.624201+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.618323+0000","last_change":"2024-09-12T01:35:55.618323+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.618323+0000","last_undegraded":"2024-09-12T01:35:55.618323+0000","last_fullsized":"2024-09-12T01:35:55.618323+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":3,"reported_epoch":21,"state":"creating+activating","last_fresh":"2024-09-12T01:35:55.617912+0000","last_change":"2024-09-12T01:35:55.617912+0000","last_active":"2024-09-12T01:35:54.606018+0000","last_peered":"2024-09-12T01:35:54.606018+0000","last_clean":"2024-09-12T01:35:54.606018+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617912+0000","last_undegraded":"2024-09-12T01:35:55.617912+0000","last_fullsized":"2024-09-12T01:35:55.617912+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-12T01:35:55.617790+0000","last_change":"2024-09-12T01:35:55.617790+0000","last_active":"2024-09-12T01:35:55.610782+0000","last_peered":"2024-09-12T01:35:55.610782+0000","last_clean":"2024-09-12T01:35:55.610782+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:35:55.617790+0000","last_undegraded":"2024-09-12T01:35:55.617790+0000","last_fullsized":"2024-09-12T01:35:55.617790+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631417+0000","last_change":"2024-09-12T01:35:55.632404+0000","last_active":"2024-09-12T01:35:57.631417+0000","last_peered":"2024-09-12T01:35:57.631417+0000","last_clean":"2024-09-12T01:35:57.631417+0000","last_became_active":"2024-09-12T01:35:55.631711+0000","last_became_peered":"2024-09-12T01:35:55.631711+0000","last_unstale":"2024-09-12T01:35:57.631417+0000","last_undegraded":"2024-09-12T01:35:57.631417+0000","last_fullsized":"2024-09-12T01:35:57.631417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:51.791206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:36:01.605 INFO:tasks.ceph.mds.d.smithi105.stderr:2024-09-12T01:36:01.605+0000 7f3d3c9cc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:36:04.129 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:36:04.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.246+0000 7f3f1d41e640 1 Processor -- start 2024-09-12T01:36:04.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.246+0000 7f3f1d41e640 1 -- start start 2024-09-12T01:36:04.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.246+0000 7f3f1d41e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f180d1820 0x7f3f181691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.246+0000 7f3f1d41e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f1815ea40 con 0x7f3f1815e660 2024-09-12T01:36:04.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.246+0000 7f3f1d41e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f180d3870 con 0x7f3f180d3310 2024-09-12T01:36:04.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.246+0000 7f3f1d41e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3f180d3b50 con 0x7f3f180d1820 2024-09-12T01:36:04.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.246+0000 7f3f16ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3f1815e660 0x7f3f180cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50088/0 (socket says 172.21.15.60:50088) 2024-09-12T01:36:04.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.246+0000 7f3f16ffd640 1 -- 172.21.15.60:0/3968073434 learned_addr learned my addr 172.21.15.60:0/3968073434 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:04.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.246+0000 7f3f177fe640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f180d1820 0x7f3f181691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.246+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437896950 0 0) 0x7f3f1815ea40 con 0x7f3f1815e660 2024-09-12T01:36:04.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.246+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f00003520 con 0x7f3f1815e660 2024-09-12T01:36:04.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3598365281 0 0) 0x7f3f180d3870 con 0x7f3f180d3310 2024-09-12T01:36:04.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f1815ea40 con 0x7f3f180d3310 2024-09-12T01:36:04.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3398420042 0 0) 0x7f3f00003520 con 0x7f3f1815e660 2024-09-12T01:36:04.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f180d1820 msgr2=0x7f3f181691c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:04.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f180d1820 0x7f3f181691c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 >> v1:172.21.15.105:6789/0 conn(0x7f3f180d3310 legacy=0x7f3f180d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f180d3e30 con 0x7f3f1815e660 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f3f08001670 con 0x7f3f1815e660 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 >> v1:172.21.15.60:6789/0 conn(0x7f3f1815e660 legacy=0x7f3f180cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f00003b70 0x7f3f00003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f00004800 0x7f3f00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f180d1820 0x7f3f000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3f180d3b50 con 0x7f3f00004800 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0000ba70 con 0x7f3f00003b70 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3f0000bc70 con 0x7f3f180d1820 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f167fc640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f00004800 0x7f3f00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f16ffd640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f00003b70 0x7f3f00003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f177fe640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f180d1820 0x7f3f000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f167fc640 1 -- 172.21.15.60:0/3968073434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f180d1820 msgr2=0x7f3f000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f167fc640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f180d1820 0x7f3f000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f167fc640 1 -- 172.21.15.60:0/3968073434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f00003b70 msgr2=0x7f3f00003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f167fc640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f00003b70 0x7f3f00003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f167fc640 1 -- 172.21.15.60:0/3968073434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f00003520 con 0x7f3f00004800 2024-09-12T01:36:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.247+0000 7f3f177fe640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f180d1820 0x7f3f000051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.248+0000 7f3f167fc640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f00004800 0x7f3f00004c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0018d0 tx=0x7f3f00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f2368729ec265e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.248+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c0014f0 con 0x7f3f00004800 2024-09-12T01:36:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.248+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f0c0052d0 con 0x7f3f00004800 2024-09-12T01:36:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.248+0000 7f3f15ffb640 1 -- 172.21.15.60:0/3968073434 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c02aca0 con 0x7f3f00004800 2024-09-12T01:36:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.249+0000 7f3f1d41e640 1 -- 172.21.15.60:0/3968073434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f00004800 msgr2=0x7f3f00004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.249+0000 7f3f1d41e640 1 --2- 172.21.15.60:0/3968073434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f00004800 0x7f3f00004c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0018d0 tx=0x7f3f00005830 comp rx=0 tx=0).stop 2024-09-12T01:36:04.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.249+0000 7f3f177fe640 1 -- 172.21.15.60:0/3968073434 reap_dead start 2024-09-12T01:36:04.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.249+0000 7f3f1d41e640 1 -- 172.21.15.60:0/3968073434 shutdown_connections 2024-09-12T01:36:04.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.249+0000 7f3f1d41e640 1 -- 172.21.15.60:0/3968073434 >> 172.21.15.60:0/3968073434 conn(0x7f3f180b6410 msgr2=0x7f3f180b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:04.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.249+0000 7f3f1d41e640 1 -- 172.21.15.60:0/3968073434 shutdown_connections 2024-09-12T01:36:04.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.249+0000 7f3f1d41e640 1 -- 172.21.15.60:0/3968073434 wait complete. 2024-09-12T01:36:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.250+0000 7f3f1d41e640 1 Processor -- start 2024-09-12T01:36:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.250+0000 7f3f1d41e640 1 -- start start 2024-09-12T01:36:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f1d41e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f00004800 0x7f3f181479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f1d41e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f181546c0 0x7f3f18154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f1d41e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f1815ecf0 0x7f3f1815f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f1d41e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3f180b8b80 con 0x7f3f1815ecf0 2024-09-12T01:36:04.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f1d41e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3f180d43f0 con 0x7f3f00004800 2024-09-12T01:36:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f1d41e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3f180b8d00 con 0x7f3f181546c0 2024-09-12T01:36:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f177fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f1815ecf0 0x7f3f1815f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f177fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f1815ecf0 0x7f3f1815f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48954/0 (socket says 172.21.15.60:48954) 2024-09-12T01:36:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f177fe640 1 -- 172.21.15.60:0/696441723 learned_addr learned my addr 172.21.15.60:0/696441723 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f167fc640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f181546c0 0x7f3f18154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f16ffd640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f00004800 0x7f3f181479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f177fe640 1 -- 172.21.15.60:0/696441723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f181546c0 msgr2=0x7f3f18154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f177fe640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f181546c0 0x7f3f18154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f177fe640 1 -- 172.21.15.60:0/696441723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f00004800 msgr2=0x7f3f181479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f177fe640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f00004800 0x7f3f181479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f177fe640 1 -- 172.21.15.60:0/696441723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1815fa40 con 0x7f3f1815ecf0 2024-09-12T01:36:04.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f16ffd640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f00004800 0x7f3f181479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.251+0000 7f3f167fc640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f181546c0 0x7f3f18154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.252+0000 7f3f177fe640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f1815ecf0 0x7f3f1815f170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f180cb760 tx=0x7f3f10009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.252+0000 7f3eff7fe640 1 -- 172.21.15.60:0/696441723 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10010e80 con 0x7f3f1815ecf0 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.252+0000 7f3eff7fe640 1 -- 172.21.15.60:0/696441723 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f10003990 con 0x7f3f1815ecf0 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.252+0000 7f3eff7fe640 1 -- 172.21.15.60:0/696441723 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10003da0 con 0x7f3f1815ecf0 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.252+0000 7f3f1d41e640 1 -- 172.21.15.60:0/696441723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1815fd20 con 0x7f3f1815ecf0 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.252+0000 7f3f1d41e640 1 -- 172.21.15.60:0/696441723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f181602e0 con 0x7f3f1815ecf0 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.253+0000 7f3f1d41e640 1 -- 172.21.15.60:0/696441723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f181605f0 con 0x7f3f1815ecf0 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.253+0000 7f3eff7fe640 1 -- 172.21.15.60:0/696441723 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3f10005d10 con 0x7f3f1815ecf0 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.254+0000 7f3eff7fe640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3f0406be60 0x7f3f0406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.254+0000 7f3eff7fe640 1 -- 172.21.15.60:0/696441723 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3f1008b560 con 0x7f3f1815ecf0 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.254+0000 7f3f16ffd640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3f0406be60 0x7f3f0406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.254+0000 7f3f16ffd640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3f0406be60 0x7f3f0406e320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3f08007c20 tx=0x7f3f08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:04.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.259+0000 7f3eff7fe640 1 -- 172.21.15.60:0/696441723 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3f10025020 con 0x7f3f1815ecf0 2024-09-12T01:36:04.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.430+0000 7f3f1d41e640 1 -- 172.21.15.60:0/696441723 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f18155040 con 0x7f3f0406be60 2024-09-12T01:36:04.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.436+0000 7f3eff7fe640 1 -- 172.21.15.60:0/696441723 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251932 (secure 0 0 0) 0x7f3f18155040 con 0x7f3f0406be60 2024-09-12T01:36:04.439 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:04.442 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:36:04.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.440+0000 7f3f1d41e640 1 -- 172.21.15.60:0/696441723 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3f0406be60 msgr2=0x7f3f0406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.440+0000 7f3f1d41e640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3f0406be60 0x7f3f0406e320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3f08007c20 tx=0x7f3f08009040 comp rx=0 tx=0).stop 2024-09-12T01:36:04.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.440+0000 7f3f1d41e640 1 -- 172.21.15.60:0/696441723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f1815ecf0 msgr2=0x7f3f1815f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.440+0000 7f3f1d41e640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f1815ecf0 0x7f3f1815f170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f180cb760 tx=0x7f3f10009f90 comp rx=0 tx=0).stop 2024-09-12T01:36:04.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.440+0000 7f3f1d41e640 1 -- 172.21.15.60:0/696441723 shutdown_connections 2024-09-12T01:36:04.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.440+0000 7f3f1d41e640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3f1815ecf0 0x7f3f1815f170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.440+0000 7f3f1d41e640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3f0406be60 0x7f3f0406e320 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.440+0000 7f3f1d41e640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3f181546c0 0x7f3f18154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.440+0000 7f3f1d41e640 1 --2- 172.21.15.60:0/696441723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3f00004800 0x7f3f181479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.440+0000 7f3f1d41e640 1 -- 172.21.15.60:0/696441723 >> 172.21.15.60:0/696441723 conn(0x7f3f180b6410 msgr2=0x7f3f1815cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:04.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.440+0000 7f3f1d41e640 1 -- 172.21.15.60:0/696441723 shutdown_connections 2024-09-12T01:36:04.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.440+0000 7f3f1d41e640 1 -- 172.21.15.60:0/696441723 wait complete. 2024-09-12T01:36:04.451 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-12T01:36:04.261484+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235960,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738760,"statfs":{"total":773094113280,"available":772852490240,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001504"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642326+0000","last_change":"2024-09-12T01:35:56.652538+0000","last_active":"2024-09-12T01:35:57.642326+0000","last_peered":"2024-09-12T01:35:57.642326+0000","last_clean":"2024-09-12T01:35:57.642326+0000","last_became_active":"2024-09-12T01:35:56.649758+0000","last_became_peered":"2024-09-12T01:35:56.649758+0000","last_unstale":"2024-09-12T01:35:57.642326+0000","last_undegraded":"2024-09-12T01:35:57.642326+0000","last_fullsized":"2024-09-12T01:35:57.642326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.371469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631042+0000","last_change":"2024-09-12T01:35:56.645029+0000","last_active":"2024-09-12T01:35:57.631042+0000","last_peered":"2024-09-12T01:35:57.631042+0000","last_clean":"2024-09-12T01:35:57.631042+0000","last_became_active":"2024-09-12T01:35:56.644727+0000","last_became_peered":"2024-09-12T01:35:56.644727+0000","last_unstale":"2024-09-12T01:35:57.631042+0000","last_undegraded":"2024-09-12T01:35:57.631042+0000","last_fullsized":"2024-09-12T01:35:57.631042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:35.999998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630619+0000","last_change":"2024-09-12T01:35:56.639030+0000","last_active":"2024-09-12T01:35:57.630619+0000","last_peered":"2024-09-12T01:35:57.630619+0000","last_clean":"2024-09-12T01:35:57.630619+0000","last_became_active":"2024-09-12T01:35:56.636574+0000","last_became_peered":"2024-09-12T01:35:56.636574+0000","last_unstale":"2024-09-12T01:35:57.630619+0000","last_undegraded":"2024-09-12T01:35:57.630619+0000","last_fullsized":"2024-09-12T01:35:57.630619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.394879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801812+0000","last_change":"2024-09-12T01:35:56.634505+0000","last_active":"2024-09-12T01:35:57.801812+0000","last_peered":"2024-09-12T01:35:57.801812+0000","last_clean":"2024-09-12T01:35:57.801812+0000","last_became_active":"2024-09-12T01:35:56.630851+0000","last_became_peered":"2024-09-12T01:35:56.630851+0000","last_unstale":"2024-09-12T01:35:57.801812+0000","last_undegraded":"2024-09-12T01:35:57.801812+0000","last_fullsized":"2024-09-12T01:35:57.801812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:07.092256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642095+0000","last_change":"2024-09-12T01:35:56.656191+0000","last_active":"2024-09-12T01:35:57.642095+0000","last_peered":"2024-09-12T01:35:57.642095+0000","last_clean":"2024-09-12T01:35:57.642095+0000","last_became_active":"2024-09-12T01:35:56.655089+0000","last_became_peered":"2024-09-12T01:35:56.655089+0000","last_unstale":"2024-09-12T01:35:57.642095+0000","last_undegraded":"2024-09-12T01:35:57.642095+0000","last_fullsized":"2024-09-12T01:35:57.642095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:35.999998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801857+0000","last_change":"2024-09-12T01:35:56.637190+0000","last_active":"2024-09-12T01:35:57.801857+0000","last_peered":"2024-09-12T01:35:57.801857+0000","last_clean":"2024-09-12T01:35:57.801857+0000","last_became_active":"2024-09-12T01:35:56.636370+0000","last_became_peered":"2024-09-12T01:35:56.636370+0000","last_unstale":"2024-09-12T01:35:57.801857+0000","last_undegraded":"2024-09-12T01:35:57.801857+0000","last_fullsized":"2024-09-12T01:35:57.801857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:33.731216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641815+0000","last_change":"2024-09-12T01:35:56.645910+0000","last_active":"2024-09-12T01:35:57.641815+0000","last_peered":"2024-09-12T01:35:57.641815+0000","last_clean":"2024-09-12T01:35:57.641815+0000","last_became_active":"2024-09-12T01:35:56.644399+0000","last_became_peered":"2024-09-12T01:35:56.644399+0000","last_unstale":"2024-09-12T01:35:57.641815+0000","last_undegraded":"2024-09-12T01:35:57.641815+0000","last_fullsized":"2024-09-12T01:35:57.641815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.394879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630527+0000","last_change":"2024-09-12T01:35:56.645704+0000","last_active":"2024-09-12T01:35:57.630527+0000","last_peered":"2024-09-12T01:35:57.630527+0000","last_clean":"2024-09-12T01:35:57.630527+0000","last_became_active":"2024-09-12T01:35:56.645446+0000","last_became_peered":"2024-09-12T01:35:56.645446+0000","last_unstale":"2024-09-12T01:35:57.630527+0000","last_undegraded":"2024-09-12T01:35:57.630527+0000","last_fullsized":"2024-09-12T01:35:57.630527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:58.408814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802258+0000","last_change":"2024-09-12T01:35:56.640496+0000","last_active":"2024-09-12T01:35:57.802258+0000","last_peered":"2024-09-12T01:35:57.802258+0000","last_clean":"2024-09-12T01:35:57.802258+0000","last_became_active":"2024-09-12T01:35:56.640151+0000","last_became_peered":"2024-09-12T01:35:56.640151+0000","last_unstale":"2024-09-12T01:35:57.802258+0000","last_undegraded":"2024-09-12T01:35:57.802258+0000","last_fullsized":"2024-09-12T01:35:57.802258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:19.084585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642330+0000","last_change":"2024-09-12T01:35:56.646582+0000","last_active":"2024-09-12T01:35:57.642330+0000","last_peered":"2024-09-12T01:35:57.642330+0000","last_clean":"2024-09-12T01:35:57.642330+0000","last_became_active":"2024-09-12T01:35:56.646282+0000","last_became_peered":"2024-09-12T01:35:56.646282+0000","last_unstale":"2024-09-12T01:35:57.642330+0000","last_undegraded":"2024-09-12T01:35:57.642330+0000","last_fullsized":"2024-09-12T01:35:57.642330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:51.888372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642049+0000","last_change":"2024-09-12T01:35:56.647738+0000","last_active":"2024-09-12T01:35:57.642049+0000","last_peered":"2024-09-12T01:35:57.642049+0000","last_clean":"2024-09-12T01:35:57.642049+0000","last_became_active":"2024-09-12T01:35:56.647449+0000","last_became_peered":"2024-09-12T01:35:56.647449+0000","last_unstale":"2024-09-12T01:35:57.642049+0000","last_undegraded":"2024-09-12T01:35:57.642049+0000","last_fullsized":"2024-09-12T01:35:57.642049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:45.869660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642039+0000","last_change":"2024-09-12T01:35:56.656184+0000","last_active":"2024-09-12T01:35:57.642039+0000","last_peered":"2024-09-12T01:35:57.642039+0000","last_clean":"2024-09-12T01:35:57.642039+0000","last_became_active":"2024-09-12T01:35:56.655377+0000","last_became_peered":"2024-09-12T01:35:56.655377+0000","last_unstale":"2024-09-12T01:35:57.642039+0000","last_undegraded":"2024-09-12T01:35:57.642039+0000","last_fullsized":"2024-09-12T01:35:57.642039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.332152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801933+0000","last_change":"2024-09-12T01:35:56.657060+0000","last_active":"2024-09-12T01:35:57.801933+0000","last_peered":"2024-09-12T01:35:57.801933+0000","last_clean":"2024-09-12T01:35:57.801933+0000","last_became_active":"2024-09-12T01:35:56.656754+0000","last_became_peered":"2024-09-12T01:35:56.656754+0000","last_unstale":"2024-09-12T01:35:57.801933+0000","last_undegraded":"2024-09-12T01:35:57.801933+0000","last_fullsized":"2024-09-12T01:35:57.801933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:15.773656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802474+0000","last_change":"2024-09-12T01:35:56.643585+0000","last_active":"2024-09-12T01:35:57.802474+0000","last_peered":"2024-09-12T01:35:57.802474+0000","last_clean":"2024-09-12T01:35:57.802474+0000","last_became_active":"2024-09-12T01:35:56.643312+0000","last_became_peered":"2024-09-12T01:35:56.643312+0000","last_unstale":"2024-09-12T01:35:57.802474+0000","last_undegraded":"2024-09-12T01:35:57.802474+0000","last_fullsized":"2024-09-12T01:35:57.802474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:17.807421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630738+0000","last_change":"2024-09-12T01:35:56.659070+0000","last_active":"2024-09-12T01:35:57.630738+0000","last_peered":"2024-09-12T01:35:57.630738+0000","last_clean":"2024-09-12T01:35:57.630738+0000","last_became_active":"2024-09-12T01:35:56.658797+0000","last_became_peered":"2024-09-12T01:35:56.658797+0000","last_unstale":"2024-09-12T01:35:57.630738+0000","last_undegraded":"2024-09-12T01:35:57.630738+0000","last_fullsized":"2024-09-12T01:35:57.630738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.332152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.626923+0000","last_change":"2024-09-12T01:35:56.645396+0000","last_active":"2024-09-12T01:35:57.626923+0000","last_peered":"2024-09-12T01:35:57.626923+0000","last_clean":"2024-09-12T01:35:57.626923+0000","last_became_active":"2024-09-12T01:35:56.645072+0000","last_became_peered":"2024-09-12T01:35:56.645072+0000","last_unstale":"2024-09-12T01:35:57.626923+0000","last_undegraded":"2024-09-12T01:35:57.626923+0000","last_fullsized":"2024-09-12T01:35:57.626923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.371469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627612+0000","last_change":"2024-09-12T01:35:56.660353+0000","last_active":"2024-09-12T01:35:57.627612+0000","last_peered":"2024-09-12T01:35:57.627612+0000","last_clean":"2024-09-12T01:35:57.627612+0000","last_became_active":"2024-09-12T01:35:56.659742+0000","last_became_peered":"2024-09-12T01:35:56.659742+0000","last_unstale":"2024-09-12T01:35:57.627612+0000","last_undegraded":"2024-09-12T01:35:57.627612+0000","last_fullsized":"2024-09-12T01:35:57.627612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:35.865103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802429+0000","last_change":"2024-09-12T01:35:56.645188+0000","last_active":"2024-09-12T01:35:57.802429+0000","last_peered":"2024-09-12T01:35:57.802429+0000","last_clean":"2024-09-12T01:35:57.802429+0000","last_became_active":"2024-09-12T01:35:56.644908+0000","last_became_peered":"2024-09-12T01:35:56.644908+0000","last_unstale":"2024-09-12T01:35:57.802429+0000","last_undegraded":"2024-09-12T01:35:57.802429+0000","last_fullsized":"2024-09-12T01:35:57.802429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:35.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627360+0000","last_change":"2024-09-12T01:35:56.652945+0000","last_active":"2024-09-12T01:35:57.627360+0000","last_peered":"2024-09-12T01:35:57.627360+0000","last_clean":"2024-09-12T01:35:57.627360+0000","last_became_active":"2024-09-12T01:35:56.652621+0000","last_became_peered":"2024-09-12T01:35:56.652621+0000","last_unstale":"2024-09-12T01:35:57.627360+0000","last_undegraded":"2024-09-12T01:35:57.627360+0000","last_fullsized":"2024-09-12T01:35:57.627360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:56.037938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642061+0000","last_change":"2024-09-12T01:35:56.656055+0000","last_active":"2024-09-12T01:35:57.642061+0000","last_peered":"2024-09-12T01:35:57.642061+0000","last_clean":"2024-09-12T01:35:57.642061+0000","last_became_active":"2024-09-12T01:35:56.654905+0000","last_became_peered":"2024-09-12T01:35:56.654905+0000","last_unstale":"2024-09-12T01:35:57.642061+0000","last_undegraded":"2024-09-12T01:35:57.642061+0000","last_fullsized":"2024-09-12T01:35:57.642061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:21.267324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630212+0000","last_change":"2024-09-12T01:35:56.630997+0000","last_active":"2024-09-12T01:35:57.630212+0000","last_peered":"2024-09-12T01:35:57.630212+0000","last_clean":"2024-09-12T01:35:57.630212+0000","last_became_active":"2024-09-12T01:35:56.630704+0000","last_became_peered":"2024-09-12T01:35:56.630704+0000","last_unstale":"2024-09-12T01:35:57.630212+0000","last_undegraded":"2024-09-12T01:35:57.630212+0000","last_fullsized":"2024-09-12T01:35:57.630212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:33.242417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801745+0000","last_change":"2024-09-12T01:35:56.655607+0000","last_active":"2024-09-12T01:35:57.801745+0000","last_peered":"2024-09-12T01:35:57.801745+0000","last_clean":"2024-09-12T01:35:57.801745+0000","last_became_active":"2024-09-12T01:35:56.655296+0000","last_became_peered":"2024-09-12T01:35:56.655296+0000","last_unstale":"2024-09-12T01:35:57.801745+0000","last_undegraded":"2024-09-12T01:35:57.801745+0000","last_fullsized":"2024-09-12T01:35:57.801745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:43.447041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630934+0000","last_change":"2024-09-12T01:35:56.633081+0000","last_active":"2024-09-12T01:35:57.630934+0000","last_peered":"2024-09-12T01:35:57.630934+0000","last_clean":"2024-09-12T01:35:57.630934+0000","last_became_active":"2024-09-12T01:35:56.632706+0000","last_became_peered":"2024-09-12T01:35:56.632706+0000","last_unstale":"2024-09-12T01:35:57.630934+0000","last_undegraded":"2024-09-12T01:35:57.630934+0000","last_fullsized":"2024-09-12T01:35:57.630934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:21.267324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.626950+0000","last_change":"2024-09-12T01:35:56.647872+0000","last_active":"2024-09-12T01:35:57.626950+0000","last_peered":"2024-09-12T01:35:57.626950+0000","last_clean":"2024-09-12T01:35:57.626950+0000","last_became_active":"2024-09-12T01:35:56.647557+0000","last_became_peered":"2024-09-12T01:35:56.647557+0000","last_unstale":"2024-09-12T01:35:57.626950+0000","last_undegraded":"2024-09-12T01:35:57.626950+0000","last_fullsized":"2024-09-12T01:35:57.626950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:51.888372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631144+0000","last_change":"2024-09-12T01:35:56.647973+0000","last_active":"2024-09-12T01:35:57.631144+0000","last_peered":"2024-09-12T01:35:57.631144+0000","last_clean":"2024-09-12T01:35:57.631144+0000","last_became_active":"2024-09-12T01:35:56.647548+0000","last_became_peered":"2024-09-12T01:35:56.647548+0000","last_unstale":"2024-09-12T01:35:57.631144+0000","last_undegraded":"2024-09-12T01:35:57.631144+0000","last_fullsized":"2024-09-12T01:35:57.631144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:14.579275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801953+0000","last_change":"2024-09-12T01:35:56.640025+0000","last_active":"2024-09-12T01:35:57.801953+0000","last_peered":"2024-09-12T01:35:57.801953+0000","last_clean":"2024-09-12T01:35:57.801953+0000","last_became_active":"2024-09-12T01:35:56.639534+0000","last_became_peered":"2024-09-12T01:35:56.639534+0000","last_unstale":"2024-09-12T01:35:57.801953+0000","last_undegraded":"2024-09-12T01:35:57.801953+0000","last_fullsized":"2024-09-12T01:35:57.801953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:28.894518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802022+0000","last_change":"2024-09-12T01:35:56.639831+0000","last_active":"2024-09-12T01:35:57.802022+0000","last_peered":"2024-09-12T01:35:57.802022+0000","last_clean":"2024-09-12T01:35:57.802022+0000","last_became_active":"2024-09-12T01:35:56.639541+0000","last_became_peered":"2024-09-12T01:35:56.639541+0000","last_unstale":"2024-09-12T01:35:57.802022+0000","last_undegraded":"2024-09-12T01:35:57.802022+0000","last_fullsized":"2024-09-12T01:35:57.802022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:27.826729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801870+0000","last_change":"2024-09-12T01:35:56.656888+0000","last_active":"2024-09-12T01:35:57.801870+0000","last_peered":"2024-09-12T01:35:57.801870+0000","last_clean":"2024-09-12T01:35:57.801870+0000","last_became_active":"2024-09-12T01:35:56.656593+0000","last_became_peered":"2024-09-12T01:35:56.656593+0000","last_unstale":"2024-09-12T01:35:57.801870+0000","last_undegraded":"2024-09-12T01:35:57.801870+0000","last_fullsized":"2024-09-12T01:35:57.801870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:28.894518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630352+0000","last_change":"2024-09-12T01:35:56.642012+0000","last_active":"2024-09-12T01:35:57.630352+0000","last_peered":"2024-09-12T01:35:57.630352+0000","last_clean":"2024-09-12T01:35:57.630352+0000","last_became_active":"2024-09-12T01:35:56.639930+0000","last_became_peered":"2024-09-12T01:35:56.639930+0000","last_unstale":"2024-09-12T01:35:57.630352+0000","last_undegraded":"2024-09-12T01:35:57.630352+0000","last_fullsized":"2024-09-12T01:35:57.630352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:43.345557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627036+0000","last_change":"2024-09-12T01:35:56.649019+0000","last_active":"2024-09-12T01:35:57.627036+0000","last_peered":"2024-09-12T01:35:57.627036+0000","last_clean":"2024-09-12T01:35:57.627036+0000","last_became_active":"2024-09-12T01:35:56.648688+0000","last_became_peered":"2024-09-12T01:35:56.648688+0000","last_unstale":"2024-09-12T01:35:57.627036+0000","last_undegraded":"2024-09-12T01:35:57.627036+0000","last_fullsized":"2024-09-12T01:35:57.627036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:30.634946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802089+0000","last_change":"2024-09-12T01:35:56.638917+0000","last_active":"2024-09-12T01:35:57.802089+0000","last_peered":"2024-09-12T01:35:57.802089+0000","last_clean":"2024-09-12T01:35:57.802089+0000","last_became_active":"2024-09-12T01:35:56.638636+0000","last_became_peered":"2024-09-12T01:35:56.638636+0000","last_unstale":"2024-09-12T01:35:57.802089+0000","last_undegraded":"2024-09-12T01:35:57.802089+0000","last_fullsized":"2024-09-12T01:35:57.802089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:43.959102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801561+0000","last_change":"2024-09-12T01:35:56.641065+0000","last_active":"2024-09-12T01:35:57.801561+0000","last_peered":"2024-09-12T01:35:57.801561+0000","last_clean":"2024-09-12T01:35:57.801561+0000","last_became_active":"2024-09-12T01:35:56.640725+0000","last_became_peered":"2024-09-12T01:35:56.640725+0000","last_unstale":"2024-09-12T01:35:57.801561+0000","last_undegraded":"2024-09-12T01:35:57.801561+0000","last_fullsized":"2024-09-12T01:35:57.801561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:35.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802049+0000","last_change":"2024-09-12T01:35:56.648505+0000","last_active":"2024-09-12T01:35:57.802049+0000","last_peered":"2024-09-12T01:35:57.802049+0000","last_clean":"2024-09-12T01:35:57.802049+0000","last_became_active":"2024-09-12T01:35:56.648227+0000","last_became_peered":"2024-09-12T01:35:56.648227+0000","last_unstale":"2024-09-12T01:35:57.802049+0000","last_undegraded":"2024-09-12T01:35:57.802049+0000","last_fullsized":"2024-09-12T01:35:57.802049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:35.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630446+0000","last_change":"2024-09-12T01:35:55.632500+0000","last_active":"2024-09-12T01:35:57.630446+0000","last_peered":"2024-09-12T01:35:57.630446+0000","last_clean":"2024-09-12T01:35:57.630446+0000","last_became_active":"2024-09-12T01:35:55.632216+0000","last_became_peered":"2024-09-12T01:35:55.632216+0000","last_unstale":"2024-09-12T01:35:57.630446+0000","last_undegraded":"2024-09-12T01:35:57.630446+0000","last_fullsized":"2024-09-12T01:35:57.630446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:01.774510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630355+0000","last_change":"2024-09-12T01:35:56.650933+0000","last_active":"2024-09-12T01:35:57.630355+0000","last_peered":"2024-09-12T01:35:57.630355+0000","last_clean":"2024-09-12T01:35:57.630355+0000","last_became_active":"2024-09-12T01:35:56.649511+0000","last_became_peered":"2024-09-12T01:35:56.649511+0000","last_unstale":"2024-09-12T01:35:57.630355+0000","last_undegraded":"2024-09-12T01:35:57.630355+0000","last_fullsized":"2024-09-12T01:35:57.630355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:37.930582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627176+0000","last_change":"2024-09-12T01:35:55.638359+0000","last_active":"2024-09-12T01:35:57.627176+0000","last_peered":"2024-09-12T01:35:57.627176+0000","last_clean":"2024-09-12T01:35:57.627176+0000","last_became_active":"2024-09-12T01:35:55.638062+0000","last_became_peered":"2024-09-12T01:35:55.638062+0000","last_unstale":"2024-09-12T01:35:57.627176+0000","last_undegraded":"2024-09-12T01:35:57.627176+0000","last_fullsized":"2024-09-12T01:35:57.627176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:06.087492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801675+0000","last_change":"2024-09-12T01:35:55.635922+0000","last_active":"2024-09-12T01:35:57.801675+0000","last_peered":"2024-09-12T01:35:57.801675+0000","last_clean":"2024-09-12T01:35:57.801675+0000","last_became_active":"2024-09-12T01:35:55.635602+0000","last_became_peered":"2024-09-12T01:35:55.635602+0000","last_unstale":"2024-09-12T01:35:57.801675+0000","last_undegraded":"2024-09-12T01:35:57.801675+0000","last_fullsized":"2024-09-12T01:35:57.801675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:33.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630802+0000","last_change":"2024-09-12T01:35:56.645491+0000","last_active":"2024-09-12T01:35:57.630802+0000","last_peered":"2024-09-12T01:35:57.630802+0000","last_clean":"2024-09-12T01:35:57.630802+0000","last_became_active":"2024-09-12T01:35:56.645076+0000","last_became_peered":"2024-09-12T01:35:56.645076+0000","last_unstale":"2024-09-12T01:35:57.630802+0000","last_undegraded":"2024-09-12T01:35:57.630802+0000","last_fullsized":"2024-09-12T01:35:57.630802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:45.869660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627065+0000","last_change":"2024-09-12T01:35:55.633626+0000","last_active":"2024-09-12T01:35:57.627065+0000","last_peered":"2024-09-12T01:35:57.627065+0000","last_clean":"2024-09-12T01:35:57.627065+0000","last_became_active":"2024-09-12T01:35:55.632528+0000","last_became_peered":"2024-09-12T01:35:55.632528+0000","last_unstale":"2024-09-12T01:35:57.627065+0000","last_undegraded":"2024-09-12T01:35:57.627065+0000","last_fullsized":"2024-09-12T01:35:57.627065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:42.442278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630785+0000","last_change":"2024-09-12T01:35:56.639249+0000","last_active":"2024-09-12T01:35:57.630785+0000","last_peered":"2024-09-12T01:35:57.630785+0000","last_clean":"2024-09-12T01:35:57.630785+0000","last_became_active":"2024-09-12T01:35:56.638993+0000","last_became_peered":"2024-09-12T01:35:56.638993+0000","last_unstale":"2024-09-12T01:35:57.630785+0000","last_undegraded":"2024-09-12T01:35:57.630785+0000","last_fullsized":"2024-09-12T01:35:57.630785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:52.928010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802311+0000","last_change":"2024-09-12T01:35:55.632875+0000","last_active":"2024-09-12T01:35:57.802311+0000","last_peered":"2024-09-12T01:35:57.802311+0000","last_clean":"2024-09-12T01:35:57.802311+0000","last_became_active":"2024-09-12T01:35:55.632586+0000","last_became_peered":"2024-09-12T01:35:55.632586+0000","last_unstale":"2024-09-12T01:35:57.802311+0000","last_undegraded":"2024-09-12T01:35:57.802311+0000","last_fullsized":"2024-09-12T01:35:57.802311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:33.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802016+0000","last_change":"2024-09-12T01:35:56.639811+0000","last_active":"2024-09-12T01:35:57.802016+0000","last_peered":"2024-09-12T01:35:57.802016+0000","last_clean":"2024-09-12T01:35:57.802016+0000","last_became_active":"2024-09-12T01:35:56.639110+0000","last_became_peered":"2024-09-12T01:35:56.639110+0000","last_unstale":"2024-09-12T01:35:57.802016+0000","last_undegraded":"2024-09-12T01:35:57.802016+0000","last_fullsized":"2024-09-12T01:35:57.802016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:15.773656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642266+0000","last_change":"2024-09-12T01:35:55.636348+0000","last_active":"2024-09-12T01:35:57.642266+0000","last_peered":"2024-09-12T01:35:57.642266+0000","last_clean":"2024-09-12T01:35:57.642266+0000","last_became_active":"2024-09-12T01:35:55.636057+0000","last_became_peered":"2024-09-12T01:35:55.636057+0000","last_unstale":"2024-09-12T01:35:57.642266+0000","last_undegraded":"2024-09-12T01:35:57.642266+0000","last_fullsized":"2024-09-12T01:35:57.642266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:42.954339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631280+0000","last_change":"2024-09-12T01:35:56.641538+0000","last_active":"2024-09-12T01:35:57.631280+0000","last_peered":"2024-09-12T01:35:57.631280+0000","last_clean":"2024-09-12T01:35:57.631280+0000","last_became_active":"2024-09-12T01:35:56.641220+0000","last_became_peered":"2024-09-12T01:35:56.641220+0000","last_unstale":"2024-09-12T01:35:57.631280+0000","last_undegraded":"2024-09-12T01:35:57.631280+0000","last_fullsized":"2024-09-12T01:35:57.631280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:51.888372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802271+0000","last_change":"2024-09-12T01:35:55.632890+0000","last_active":"2024-09-12T01:35:57.802271+0000","last_peered":"2024-09-12T01:35:57.802271+0000","last_clean":"2024-09-12T01:35:57.802271+0000","last_became_active":"2024-09-12T01:35:55.632588+0000","last_became_peered":"2024-09-12T01:35:55.632588+0000","last_unstale":"2024-09-12T01:35:57.802271+0000","last_undegraded":"2024-09-12T01:35:57.802271+0000","last_fullsized":"2024-09-12T01:35:57.802271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:33.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627170+0000","last_change":"2024-09-12T01:35:56.647269+0000","last_active":"2024-09-12T01:35:57.627170+0000","last_peered":"2024-09-12T01:35:57.627170+0000","last_clean":"2024-09-12T01:35:57.627170+0000","last_became_active":"2024-09-12T01:35:56.646958+0000","last_became_peered":"2024-09-12T01:35:56.646958+0000","last_unstale":"2024-09-12T01:35:57.627170+0000","last_undegraded":"2024-09-12T01:35:57.627170+0000","last_fullsized":"2024-09-12T01:35:57.627170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:15.653414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801903+0000","last_change":"2024-09-12T01:35:55.629925+0000","last_active":"2024-09-12T01:35:57.801903+0000","last_peered":"2024-09-12T01:35:57.801903+0000","last_clean":"2024-09-12T01:35:57.801903+0000","last_became_active":"2024-09-12T01:35:55.629615+0000","last_became_peered":"2024-09-12T01:35:55.629615+0000","last_unstale":"2024-09-12T01:35:57.801903+0000","last_undegraded":"2024-09-12T01:35:57.801903+0000","last_fullsized":"2024-09-12T01:35:57.801903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:52.436733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642153+0000","last_change":"2024-09-12T01:35:56.645643+0000","last_active":"2024-09-12T01:35:57.642153+0000","last_peered":"2024-09-12T01:35:57.642153+0000","last_clean":"2024-09-12T01:35:57.642153+0000","last_became_active":"2024-09-12T01:35:56.644779+0000","last_became_peered":"2024-09-12T01:35:56.644779+0000","last_unstale":"2024-09-12T01:35:57.642153+0000","last_undegraded":"2024-09-12T01:35:57.642153+0000","last_fullsized":"2024-09-12T01:35:57.642153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:14.579275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802154+0000","last_change":"2024-09-12T01:35:55.636452+0000","last_active":"2024-09-12T01:35:57.802154+0000","last_peered":"2024-09-12T01:35:57.802154+0000","last_clean":"2024-09-12T01:35:57.802154+0000","last_became_active":"2024-09-12T01:35:55.636112+0000","last_became_peered":"2024-09-12T01:35:55.636112+0000","last_unstale":"2024-09-12T01:35:57.802154+0000","last_undegraded":"2024-09-12T01:35:57.802154+0000","last_fullsized":"2024-09-12T01:35:57.802154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:01.774510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802166+0000","last_change":"2024-09-12T01:35:56.641707+0000","last_active":"2024-09-12T01:35:57.802166+0000","last_peered":"2024-09-12T01:35:57.802166+0000","last_clean":"2024-09-12T01:35:57.802166+0000","last_became_active":"2024-09-12T01:35:56.641414+0000","last_became_peered":"2024-09-12T01:35:56.641414+0000","last_unstale":"2024-09-12T01:35:57.802166+0000","last_undegraded":"2024-09-12T01:35:57.802166+0000","last_fullsized":"2024-09-12T01:35:57.802166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:33.497449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627317+0000","last_change":"2024-09-12T01:35:55.631399+0000","last_active":"2024-09-12T01:35:57.627317+0000","last_peered":"2024-09-12T01:35:57.627317+0000","last_clean":"2024-09-12T01:35:57.627317+0000","last_became_active":"2024-09-12T01:35:55.631049+0000","last_became_peered":"2024-09-12T01:35:55.631049+0000","last_unstale":"2024-09-12T01:35:57.627317+0000","last_undegraded":"2024-09-12T01:35:57.627317+0000","last_fullsized":"2024-09-12T01:35:57.627317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:32.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627114+0000","last_change":"2024-09-12T01:35:56.649037+0000","last_active":"2024-09-12T01:35:57.627114+0000","last_peered":"2024-09-12T01:35:57.627114+0000","last_clean":"2024-09-12T01:35:57.627114+0000","last_became_active":"2024-09-12T01:35:56.648741+0000","last_became_peered":"2024-09-12T01:35:56.648741+0000","last_unstale":"2024-09-12T01:35:57.627114+0000","last_undegraded":"2024-09-12T01:35:57.627114+0000","last_fullsized":"2024-09-12T01:35:57.627114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:38.847972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641868+0000","last_change":"2024-09-12T01:35:55.640137+0000","last_active":"2024-09-12T01:35:57.641868+0000","last_peered":"2024-09-12T01:35:57.641868+0000","last_clean":"2024-09-12T01:35:57.641868+0000","last_became_active":"2024-09-12T01:35:55.639846+0000","last_became_peered":"2024-09-12T01:35:55.639846+0000","last_unstale":"2024-09-12T01:35:57.641868+0000","last_undegraded":"2024-09-12T01:35:57.641868+0000","last_fullsized":"2024-09-12T01:35:57.641868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:34.990543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801732+0000","last_change":"2024-09-12T01:35:56.649723+0000","last_active":"2024-09-12T01:35:57.801732+0000","last_peered":"2024-09-12T01:35:57.801732+0000","last_clean":"2024-09-12T01:35:57.801732+0000","last_became_active":"2024-09-12T01:35:56.649279+0000","last_became_peered":"2024-09-12T01:35:56.649279+0000","last_unstale":"2024-09-12T01:35:57.801732+0000","last_undegraded":"2024-09-12T01:35:57.801732+0000","last_fullsized":"2024-09-12T01:35:57.801732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:43.959102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630113+0000","last_change":"2024-09-12T01:35:55.633512+0000","last_active":"2024-09-12T01:35:57.630113+0000","last_peered":"2024-09-12T01:35:57.630113+0000","last_clean":"2024-09-12T01:35:57.630113+0000","last_became_active":"2024-09-12T01:35:55.630924+0000","last_became_peered":"2024-09-12T01:35:55.630924+0000","last_unstale":"2024-09-12T01:35:57.630113+0000","last_undegraded":"2024-09-12T01:35:57.630113+0000","last_fullsized":"2024-09-12T01:35:57.630113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:22.281284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.626998+0000","last_change":"2024-09-12T01:35:56.645807+0000","last_active":"2024-09-12T01:35:57.626998+0000","last_peered":"2024-09-12T01:35:57.626998+0000","last_clean":"2024-09-12T01:35:57.626998+0000","last_became_active":"2024-09-12T01:35:56.644972+0000","last_became_peered":"2024-09-12T01:35:56.644972+0000","last_unstale":"2024-09-12T01:35:57.626998+0000","last_undegraded":"2024-09-12T01:35:57.626998+0000","last_fullsized":"2024-09-12T01:35:57.626998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:08.484922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642433+0000","last_change":"2024-09-12T01:35:55.641623+0000","last_active":"2024-09-12T01:35:57.642433+0000","last_peered":"2024-09-12T01:35:57.642433+0000","last_clean":"2024-09-12T01:35:57.642433+0000","last_became_active":"2024-09-12T01:35:55.641317+0000","last_became_peered":"2024-09-12T01:35:55.641317+0000","last_unstale":"2024-09-12T01:35:57.642433+0000","last_undegraded":"2024-09-12T01:35:57.642433+0000","last_fullsized":"2024-09-12T01:35:57.642433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:34.433183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802092+0000","last_change":"2024-09-12T01:35:56.647599+0000","last_active":"2024-09-12T01:35:57.802092+0000","last_peered":"2024-09-12T01:35:57.802092+0000","last_clean":"2024-09-12T01:35:57.802092+0000","last_became_active":"2024-09-12T01:35:56.646578+0000","last_became_peered":"2024-09-12T01:35:56.646578+0000","last_unstale":"2024-09-12T01:35:57.802092+0000","last_undegraded":"2024-09-12T01:35:57.802092+0000","last_fullsized":"2024-09-12T01:35:57.802092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:22.084315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630591+0000","last_change":"2024-09-12T01:35:55.632582+0000","last_active":"2024-09-12T01:35:57.630591+0000","last_peered":"2024-09-12T01:35:57.630591+0000","last_clean":"2024-09-12T01:35:57.630591+0000","last_became_active":"2024-09-12T01:35:55.631969+0000","last_became_peered":"2024-09-12T01:35:55.631969+0000","last_unstale":"2024-09-12T01:35:57.630591+0000","last_undegraded":"2024-09-12T01:35:57.630591+0000","last_fullsized":"2024-09-12T01:35:57.630591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:04.556922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642328+0000","last_change":"2024-09-12T01:35:56.655329+0000","last_active":"2024-09-12T01:35:57.642328+0000","last_peered":"2024-09-12T01:35:57.642328+0000","last_clean":"2024-09-12T01:35:57.642328+0000","last_became_active":"2024-09-12T01:35:56.654876+0000","last_became_peered":"2024-09-12T01:35:56.654876+0000","last_unstale":"2024-09-12T01:35:57.642328+0000","last_undegraded":"2024-09-12T01:35:57.642328+0000","last_fullsized":"2024-09-12T01:35:57.642328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:08.484922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630712+0000","last_change":"2024-09-12T01:35:55.629712+0000","last_active":"2024-09-12T01:35:57.630712+0000","last_peered":"2024-09-12T01:35:57.630712+0000","last_clean":"2024-09-12T01:35:57.630712+0000","last_became_active":"2024-09-12T01:35:55.629457+0000","last_became_peered":"2024-09-12T01:35:55.629457+0000","last_unstale":"2024-09-12T01:35:57.630712+0000","last_undegraded":"2024-09-12T01:35:57.630712+0000","last_fullsized":"2024-09-12T01:35:57.630712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:09.561090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642186+0000","last_change":"2024-09-12T01:35:56.657760+0000","last_active":"2024-09-12T01:35:57.642186+0000","last_peered":"2024-09-12T01:35:57.642186+0000","last_clean":"2024-09-12T01:35:57.642186+0000","last_became_active":"2024-09-12T01:35:56.657481+0000","last_became_peered":"2024-09-12T01:35:56.657481+0000","last_unstale":"2024-09-12T01:35:57.642186+0000","last_undegraded":"2024-09-12T01:35:57.642186+0000","last_fullsized":"2024-09-12T01:35:57.642186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:10.654187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802129+0000","last_change":"2024-09-12T01:35:55.635927+0000","last_active":"2024-09-12T01:35:57.802129+0000","last_peered":"2024-09-12T01:35:57.802129+0000","last_clean":"2024-09-12T01:35:57.802129+0000","last_became_active":"2024-09-12T01:35:55.635603+0000","last_became_peered":"2024-09-12T01:35:55.635603+0000","last_unstale":"2024-09-12T01:35:57.802129+0000","last_undegraded":"2024-09-12T01:35:57.802129+0000","last_fullsized":"2024-09-12T01:35:57.802129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:01.774510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627390+0000","last_change":"2024-09-12T01:35:56.639413+0000","last_active":"2024-09-12T01:35:57.627390+0000","last_peered":"2024-09-12T01:35:57.627390+0000","last_clean":"2024-09-12T01:35:57.627390+0000","last_became_active":"2024-09-12T01:35:56.639131+0000","last_became_peered":"2024-09-12T01:35:56.639131+0000","last_unstale":"2024-09-12T01:35:57.627390+0000","last_undegraded":"2024-09-12T01:35:57.627390+0000","last_fullsized":"2024-09-12T01:35:57.627390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:44.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801831+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:35:57.801831+0000","last_peered":"2024-09-12T01:35:57.801831+0000","last_clean":"2024-09-12T01:35:57.801831+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:35:57.801831+0000","last_undegraded":"2024-09-12T01:35:57.801831+0000","last_fullsized":"2024-09-12T01:35:57.801831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627331+0000","last_change":"2024-09-12T01:35:55.631018+0000","last_active":"2024-09-12T01:35:57.627331+0000","last_peered":"2024-09-12T01:35:57.627331+0000","last_clean":"2024-09-12T01:35:57.627331+0000","last_became_active":"2024-09-12T01:35:55.630101+0000","last_became_peered":"2024-09-12T01:35:55.630101+0000","last_unstale":"2024-09-12T01:35:57.627331+0000","last_undegraded":"2024-09-12T01:35:57.627331+0000","last_fullsized":"2024-09-12T01:35:57.627331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:18.079821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630356+0000","last_change":"2024-09-12T01:35:56.631140+0000","last_active":"2024-09-12T01:35:57.630356+0000","last_peered":"2024-09-12T01:35:57.630356+0000","last_clean":"2024-09-12T01:35:57.630356+0000","last_became_active":"2024-09-12T01:35:56.630798+0000","last_became_peered":"2024-09-12T01:35:56.630798+0000","last_unstale":"2024-09-12T01:35:57.630356+0000","last_undegraded":"2024-09-12T01:35:57.630356+0000","last_fullsized":"2024-09-12T01:35:57.630356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:16.316634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627112+0000","last_change":"2024-09-12T01:35:55.634960+0000","last_active":"2024-09-12T01:35:57.627112+0000","last_peered":"2024-09-12T01:35:57.627112+0000","last_clean":"2024-09-12T01:35:57.627112+0000","last_became_active":"2024-09-12T01:35:55.634555+0000","last_became_peered":"2024-09-12T01:35:55.634555+0000","last_unstale":"2024-09-12T01:35:57.627112+0000","last_undegraded":"2024-09-12T01:35:57.627112+0000","last_fullsized":"2024-09-12T01:35:57.627112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:42.954339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801808+0000","last_change":"2024-09-12T01:35:56.640662+0000","last_active":"2024-09-12T01:35:57.801808+0000","last_peered":"2024-09-12T01:35:57.801808+0000","last_clean":"2024-09-12T01:35:57.801808+0000","last_became_active":"2024-09-12T01:35:56.639928+0000","last_became_peered":"2024-09-12T01:35:56.639928+0000","last_unstale":"2024-09-12T01:35:57.801808+0000","last_undegraded":"2024-09-12T01:35:57.801808+0000","last_fullsized":"2024-09-12T01:35:57.801808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:33.731216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802192+0000","last_change":"2024-09-12T01:35:55.630072+0000","last_active":"2024-09-12T01:35:57.802192+0000","last_peered":"2024-09-12T01:35:57.802192+0000","last_clean":"2024-09-12T01:35:57.802192+0000","last_became_active":"2024-09-12T01:35:55.629790+0000","last_became_peered":"2024-09-12T01:35:55.629790+0000","last_unstale":"2024-09-12T01:35:57.802192+0000","last_undegraded":"2024-09-12T01:35:57.802192+0000","last_fullsized":"2024-09-12T01:35:57.802192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:20.127450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630665+0000","last_change":"2024-09-12T01:35:56.638343+0000","last_active":"2024-09-12T01:35:57.630665+0000","last_peered":"2024-09-12T01:35:57.630665+0000","last_clean":"2024-09-12T01:35:57.630665+0000","last_became_active":"2024-09-12T01:35:56.638013+0000","last_became_peered":"2024-09-12T01:35:56.638013+0000","last_unstale":"2024-09-12T01:35:57.630665+0000","last_undegraded":"2024-09-12T01:35:57.630665+0000","last_fullsized":"2024-09-12T01:35:57.630665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:11.512801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627422+0000","last_change":"2024-09-12T01:35:55.639076+0000","last_active":"2024-09-12T01:35:57.627422+0000","last_peered":"2024-09-12T01:35:57.627422+0000","last_clean":"2024-09-12T01:35:57.627422+0000","last_became_active":"2024-09-12T01:35:55.638798+0000","last_became_peered":"2024-09-12T01:35:55.638798+0000","last_unstale":"2024-09-12T01:35:57.627422+0000","last_undegraded":"2024-09-12T01:35:57.627422+0000","last_fullsized":"2024-09-12T01:35:57.627422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:27.889754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641933+0000","last_change":"2024-09-12T01:35:56.652542+0000","last_active":"2024-09-12T01:35:57.641933+0000","last_peered":"2024-09-12T01:35:57.641933+0000","last_clean":"2024-09-12T01:35:57.641933+0000","last_became_active":"2024-09-12T01:35:56.652248+0000","last_became_peered":"2024-09-12T01:35:56.652248+0000","last_unstale":"2024-09-12T01:35:57.641933+0000","last_undegraded":"2024-09-12T01:35:57.641933+0000","last_fullsized":"2024-09-12T01:35:57.641933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:11.512801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630573+0000","last_change":"2024-09-12T01:35:55.632520+0000","last_active":"2024-09-12T01:35:57.630573+0000","last_peered":"2024-09-12T01:35:57.630573+0000","last_clean":"2024-09-12T01:35:57.630573+0000","last_became_active":"2024-09-12T01:35:55.632252+0000","last_became_peered":"2024-09-12T01:35:55.632252+0000","last_unstale":"2024-09-12T01:35:57.630573+0000","last_undegraded":"2024-09-12T01:35:57.630573+0000","last_fullsized":"2024-09-12T01:35:57.630573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:20.127450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801605+0000","last_change":"2024-09-12T01:35:56.641368+0000","last_active":"2024-09-12T01:35:57.801605+0000","last_peered":"2024-09-12T01:35:57.801605+0000","last_clean":"2024-09-12T01:35:57.801605+0000","last_became_active":"2024-09-12T01:35:56.641015+0000","last_became_peered":"2024-09-12T01:35:56.641015+0000","last_unstale":"2024-09-12T01:35:57.801605+0000","last_undegraded":"2024-09-12T01:35:57.801605+0000","last_fullsized":"2024-09-12T01:35:57.801605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:19.084585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627467+0000","last_change":"2024-09-12T01:35:55.636659+0000","last_active":"2024-09-12T01:35:57.627467+0000","last_peered":"2024-09-12T01:35:57.627467+0000","last_clean":"2024-09-12T01:35:57.627467+0000","last_became_active":"2024-09-12T01:35:55.635695+0000","last_became_peered":"2024-09-12T01:35:55.635695+0000","last_unstale":"2024-09-12T01:35:57.627467+0000","last_undegraded":"2024-09-12T01:35:57.627467+0000","last_fullsized":"2024-09-12T01:35:57.627467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:21.079552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801992+0000","last_change":"2024-09-12T01:35:56.647287+0000","last_active":"2024-09-12T01:35:57.801992+0000","last_peered":"2024-09-12T01:35:57.801992+0000","last_clean":"2024-09-12T01:35:57.801992+0000","last_became_active":"2024-09-12T01:35:56.646952+0000","last_became_peered":"2024-09-12T01:35:56.646952+0000","last_unstale":"2024-09-12T01:35:57.801992+0000","last_undegraded":"2024-09-12T01:35:57.801992+0000","last_fullsized":"2024-09-12T01:35:57.801992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:22.084315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641362+0000","last_change":"2024-09-12T01:35:55.636276+0000","last_active":"2024-09-12T01:35:57.641362+0000","last_peered":"2024-09-12T01:35:57.641362+0000","last_clean":"2024-09-12T01:35:57.641362+0000","last_became_active":"2024-09-12T01:35:55.635996+0000","last_became_peered":"2024-09-12T01:35:55.635996+0000","last_unstale":"2024-09-12T01:35:57.641362+0000","last_undegraded":"2024-09-12T01:35:57.641362+0000","last_fullsized":"2024-09-12T01:35:57.641362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:44.922761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631351+0000","last_change":"2024-09-12T01:35:56.641708+0000","last_active":"2024-09-12T01:35:57.631351+0000","last_peered":"2024-09-12T01:35:57.631351+0000","last_clean":"2024-09-12T01:35:57.631351+0000","last_became_active":"2024-09-12T01:35:56.641436+0000","last_became_peered":"2024-09-12T01:35:56.641436+0000","last_unstale":"2024-09-12T01:35:57.631351+0000","last_undegraded":"2024-09-12T01:35:57.631351+0000","last_fullsized":"2024-09-12T01:35:57.631351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:30.517423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627608+0000","last_change":"2024-09-12T01:35:55.638372+0000","last_active":"2024-09-12T01:35:57.627608+0000","last_peered":"2024-09-12T01:35:57.627608+0000","last_clean":"2024-09-12T01:35:57.627608+0000","last_became_active":"2024-09-12T01:35:55.638089+0000","last_became_peered":"2024-09-12T01:35:55.638089+0000","last_unstale":"2024-09-12T01:35:57.627608+0000","last_undegraded":"2024-09-12T01:35:57.627608+0000","last_fullsized":"2024-09-12T01:35:57.627608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:14.768892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630498+0000","last_change":"2024-09-12T01:35:56.638352+0000","last_active":"2024-09-12T01:35:57.630498+0000","last_peered":"2024-09-12T01:35:57.630498+0000","last_clean":"2024-09-12T01:35:57.630498+0000","last_became_active":"2024-09-12T01:35:56.637106+0000","last_became_peered":"2024-09-12T01:35:56.637106+0000","last_unstale":"2024-09-12T01:35:57.630498+0000","last_undegraded":"2024-09-12T01:35:57.630498+0000","last_fullsized":"2024-09-12T01:35:57.630498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:04.733539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641681+0000","last_change":"2024-09-12T01:35:55.630390+0000","last_active":"2024-09-12T01:35:57.641681+0000","last_peered":"2024-09-12T01:35:57.641681+0000","last_clean":"2024-09-12T01:35:57.641681+0000","last_became_active":"2024-09-12T01:35:55.630086+0000","last_became_peered":"2024-09-12T01:35:55.630086+0000","last_unstale":"2024-09-12T01:35:57.641681+0000","last_undegraded":"2024-09-12T01:35:57.641681+0000","last_fullsized":"2024-09-12T01:35:57.641681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:20.004524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627068+0000","last_change":"2024-09-12T01:35:56.643851+0000","last_active":"2024-09-12T01:35:57.627068+0000","last_peered":"2024-09-12T01:35:57.627068+0000","last_clean":"2024-09-12T01:35:57.627068+0000","last_became_active":"2024-09-12T01:35:56.643495+0000","last_became_peered":"2024-09-12T01:35:56.643495+0000","last_unstale":"2024-09-12T01:35:57.627068+0000","last_undegraded":"2024-09-12T01:35:57.627068+0000","last_fullsized":"2024-09-12T01:35:57.627068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:23.892900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631240+0000","last_change":"2024-09-12T01:35:55.635445+0000","last_active":"2024-09-12T01:35:57.631240+0000","last_peered":"2024-09-12T01:35:57.631240+0000","last_clean":"2024-09-12T01:35:57.631240+0000","last_became_active":"2024-09-12T01:35:55.635147+0000","last_became_peered":"2024-09-12T01:35:55.635147+0000","last_unstale":"2024-09-12T01:35:57.631240+0000","last_undegraded":"2024-09-12T01:35:57.631240+0000","last_fullsized":"2024-09-12T01:35:57.631240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:26.672278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630175+0000","last_change":"2024-09-12T01:35:56.638375+0000","last_active":"2024-09-12T01:35:57.630175+0000","last_peered":"2024-09-12T01:35:57.630175+0000","last_clean":"2024-09-12T01:35:57.630175+0000","last_became_active":"2024-09-12T01:35:56.637081+0000","last_became_peered":"2024-09-12T01:35:56.637081+0000","last_unstale":"2024-09-12T01:35:57.630175+0000","last_undegraded":"2024-09-12T01:35:57.630175+0000","last_fullsized":"2024-09-12T01:35:57.630175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:53.842225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802281+0000","last_change":"2024-09-12T01:35:55.631801+0000","last_active":"2024-09-12T01:35:57.802281+0000","last_peered":"2024-09-12T01:35:57.802281+0000","last_clean":"2024-09-12T01:35:57.802281+0000","last_became_active":"2024-09-12T01:35:55.631442+0000","last_became_peered":"2024-09-12T01:35:55.631442+0000","last_unstale":"2024-09-12T01:35:57.802281+0000","last_undegraded":"2024-09-12T01:35:57.802281+0000","last_fullsized":"2024-09-12T01:35:57.802281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:20.127450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802203+0000","last_change":"2024-09-12T01:35:56.643729+0000","last_active":"2024-09-12T01:35:57.802203+0000","last_peered":"2024-09-12T01:35:57.802203+0000","last_clean":"2024-09-12T01:35:57.802203+0000","last_became_active":"2024-09-12T01:35:56.643320+0000","last_became_peered":"2024-09-12T01:35:56.643320+0000","last_unstale":"2024-09-12T01:35:57.802203+0000","last_undegraded":"2024-09-12T01:35:57.802203+0000","last_fullsized":"2024-09-12T01:35:57.802203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:43.447041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627174+0000","last_change":"2024-09-12T01:35:55.630866+0000","last_active":"2024-09-12T01:35:57.627174+0000","last_peered":"2024-09-12T01:35:57.627174+0000","last_clean":"2024-09-12T01:35:57.627174+0000","last_became_active":"2024-09-12T01:35:55.630519+0000","last_became_peered":"2024-09-12T01:35:55.630519+0000","last_unstale":"2024-09-12T01:35:57.627174+0000","last_undegraded":"2024-09-12T01:35:57.627174+0000","last_fullsized":"2024-09-12T01:35:57.627174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:34.433183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627480+0000","last_change":"2024-09-12T01:35:56.639972+0000","last_active":"2024-09-12T01:35:57.627480+0000","last_peered":"2024-09-12T01:35:57.627480+0000","last_clean":"2024-09-12T01:35:57.627480+0000","last_became_active":"2024-09-12T01:35:56.639672+0000","last_became_peered":"2024-09-12T01:35:56.639672+0000","last_unstale":"2024-09-12T01:35:57.627480+0000","last_undegraded":"2024-09-12T01:35:57.627480+0000","last_fullsized":"2024-09-12T01:35:57.627480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:26.684231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627193+0000","last_change":"2024-09-12T01:35:56.656222+0000","last_active":"2024-09-12T01:35:57.627193+0000","last_peered":"2024-09-12T01:35:57.627193+0000","last_clean":"2024-09-12T01:35:57.627193+0000","last_became_active":"2024-09-12T01:35:56.655900+0000","last_became_peered":"2024-09-12T01:35:56.655900+0000","last_unstale":"2024-09-12T01:35:57.627193+0000","last_undegraded":"2024-09-12T01:35:57.627193+0000","last_fullsized":"2024-09-12T01:35:57.627193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:56.033431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642181+0000","last_change":"2024-09-12T01:35:55.638839+0000","last_active":"2024-09-12T01:35:57.642181+0000","last_peered":"2024-09-12T01:35:57.642181+0000","last_clean":"2024-09-12T01:35:57.642181+0000","last_became_active":"2024-09-12T01:35:55.638568+0000","last_became_peered":"2024-09-12T01:35:55.638568+0000","last_unstale":"2024-09-12T01:35:57.642181+0000","last_undegraded":"2024-09-12T01:35:57.642181+0000","last_fullsized":"2024-09-12T01:35:57.642181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:42.442278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802279+0000","last_change":"2024-09-12T01:35:56.659616+0000","last_active":"2024-09-12T01:35:57.802279+0000","last_peered":"2024-09-12T01:35:57.802279+0000","last_clean":"2024-09-12T01:35:57.802279+0000","last_became_active":"2024-09-12T01:35:56.659256+0000","last_became_peered":"2024-09-12T01:35:56.659256+0000","last_unstale":"2024-09-12T01:35:57.802279+0000","last_undegraded":"2024-09-12T01:35:57.802279+0000","last_fullsized":"2024-09-12T01:35:57.802279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:07.092256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642158+0000","last_change":"2024-09-12T01:35:55.637256+0000","last_active":"2024-09-12T01:35:57.642158+0000","last_peered":"2024-09-12T01:35:57.642158+0000","last_clean":"2024-09-12T01:35:57.642158+0000","last_became_active":"2024-09-12T01:35:55.636691+0000","last_became_peered":"2024-09-12T01:35:55.636691+0000","last_unstale":"2024-09-12T01:35:57.642158+0000","last_undegraded":"2024-09-12T01:35:57.642158+0000","last_fullsized":"2024-09-12T01:35:57.642158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:09.561090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631268+0000","last_change":"2024-09-12T01:35:56.647464+0000","last_active":"2024-09-12T01:35:57.631268+0000","last_peered":"2024-09-12T01:35:57.631268+0000","last_clean":"2024-09-12T01:35:57.631268+0000","last_became_active":"2024-09-12T01:35:56.647164+0000","last_became_peered":"2024-09-12T01:35:56.647164+0000","last_unstale":"2024-09-12T01:35:57.631268+0000","last_undegraded":"2024-09-12T01:35:57.631268+0000","last_fullsized":"2024-09-12T01:35:57.631268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.371469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631248+0000","last_change":"2024-09-12T01:35:55.629578+0000","last_active":"2024-09-12T01:35:57.631248+0000","last_peered":"2024-09-12T01:35:57.631248+0000","last_clean":"2024-09-12T01:35:57.631248+0000","last_became_active":"2024-09-12T01:35:55.629296+0000","last_became_peered":"2024-09-12T01:35:55.629296+0000","last_unstale":"2024-09-12T01:35:57.631248+0000","last_undegraded":"2024-09-12T01:35:57.631248+0000","last_fullsized":"2024-09-12T01:35:57.631248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:20.004524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631264+0000","last_change":"2024-09-12T01:35:56.632127+0000","last_active":"2024-09-12T01:35:57.631264+0000","last_peered":"2024-09-12T01:35:57.631264+0000","last_clean":"2024-09-12T01:35:57.631264+0000","last_became_active":"2024-09-12T01:35:56.631788+0000","last_became_peered":"2024-09-12T01:35:56.631788+0000","last_unstale":"2024-09-12T01:35:57.631264+0000","last_undegraded":"2024-09-12T01:35:57.631264+0000","last_fullsized":"2024-09-12T01:35:57.631264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:10.654187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631417+0000","last_change":"2024-09-12T01:35:55.632404+0000","last_active":"2024-09-12T01:35:57.631417+0000","last_peered":"2024-09-12T01:35:57.631417+0000","last_clean":"2024-09-12T01:35:57.631417+0000","last_became_active":"2024-09-12T01:35:55.631711+0000","last_became_peered":"2024-09-12T01:35:55.631711+0000","last_unstale":"2024-09-12T01:35:57.631417+0000","last_undegraded":"2024-09-12T01:35:57.631417+0000","last_fullsized":"2024-09-12T01:35:57.631417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:51.791206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509447,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:36:04.455 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:36:04.455 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T01:36:04.455 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T01:36:04.456 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T01:36:04.456 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T01:36:04.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.593+0000 7f2d76250640 1 Processor -- start 2024-09-12T01:36:04.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.593+0000 7f2d76250640 1 -- start start 2024-09-12T01:36:04.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d76250640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2d7015e860 0x7f2d700d2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d76250640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2d700d2ff0 0x7f2d700b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d76250640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d700d34c0 con 0x7f2d700b66a0 2024-09-12T01:36:04.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d76250640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2d700d40d0 con 0x7f2d7015e860 2024-09-12T01:36:04.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d76250640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2d700b6ad0 con 0x7f2d700d2ff0 2024-09-12T01:36:04.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d6f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2d7015e860 0x7f2d700d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d6f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2d7015e860 0x7f2d700d2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48958/0 (socket says 172.21.15.60:48958) 2024-09-12T01:36:04.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d6f7fe640 1 -- 172.21.15.60:0/3177629180 learned_addr learned my addr 172.21.15.60:0/3177629180 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:04.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d6effd640 1 --2- 172.21.15.60:0/3177629180 >> v2:172.21.15.105:3300/0 conn(0x7f2d700d2ff0 0x7f2d700b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d6f7fe640 1 -- 172.21.15.60:0/3177629180 >> v2:172.21.15.105:3300/0 conn(0x7f2d700d2ff0 msgr2=0x7f2d700b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:04.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d6f7fe640 1 --2- 172.21.15.60:0/3177629180 >> v2:172.21.15.105:3300/0 conn(0x7f2d700d2ff0 0x7f2d700b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d6f7fe640 1 -- 172.21.15.60:0/3177629180 >> v1:172.21.15.105:6789/0 conn(0x7f2d700b66a0 legacy=0x7f2d7006bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:04.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d6f7fe640 1 -- 172.21.15.60:0/3177629180 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d700d37a0 con 0x7f2d7015e860 2024-09-12T01:36:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d6f7fe640 1 --2- 172.21.15.60:0/3177629180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d7015e860 0x7f2d700d2ab0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2d700ba850 tx=0x7f2d6002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acda8f01ce5e1b13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d6e7fc640 1 -- 172.21.15.60:0/3177629180 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60037070 con 0x7f2d7015e860 2024-09-12T01:36:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d6e7fc640 1 -- 172.21.15.60:0/3177629180 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d60032440 con 0x7f2d7015e860 2024-09-12T01:36:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.595+0000 7f2d6e7fc640 1 -- 172.21.15.60:0/3177629180 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60032810 con 0x7f2d7015e860 2024-09-12T01:36:04.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.596+0000 7f2d76250640 1 -- 172.21.15.60:0/3177629180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d7015e860 msgr2=0x7f2d700d2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.596+0000 7f2d76250640 1 --2- 172.21.15.60:0/3177629180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d7015e860 0x7f2d700d2ab0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2d700ba850 tx=0x7f2d6002a230 comp rx=0 tx=0).stop 2024-09-12T01:36:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.596+0000 7f2d76250640 1 -- 172.21.15.60:0/3177629180 shutdown_connections 2024-09-12T01:36:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.596+0000 7f2d76250640 1 --2- 172.21.15.60:0/3177629180 >> v2:172.21.15.105:3300/0 conn(0x7f2d700d2ff0 0x7f2d700b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.596+0000 7f2d76250640 1 --2- 172.21.15.60:0/3177629180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d7015e860 0x7f2d700d2ab0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.596+0000 7f2d76250640 1 -- 172.21.15.60:0/3177629180 >> 172.21.15.60:0/3177629180 conn(0x7f2d70062c60 msgr2=0x7f2d700d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.596+0000 7f2d76250640 1 -- 172.21.15.60:0/3177629180 shutdown_connections 2024-09-12T01:36:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.596+0000 7f2d76250640 1 -- 172.21.15.60:0/3177629180 wait complete. 2024-09-12T01:36:04.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.597+0000 7f2d76250640 1 Processor -- start 2024-09-12T01:36:04.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.597+0000 7f2d76250640 1 -- start start 2024-09-12T01:36:04.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d76250640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d700b66a0 0x7f2d70152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d76250640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700d2ff0 0x7f2d700cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d76250640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d7015e860 0x7f2d700ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d76250640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2d700b3890 con 0x7f2d700d2ff0 2024-09-12T01:36:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d76250640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2d700d3d60 con 0x7f2d7015e860 2024-09-12T01:36:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d76250640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2d700b3a10 con 0x7f2d700b66a0 2024-09-12T01:36:04.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d6effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700d2ff0 0x7f2d700cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d6effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700d2ff0 0x7f2d700cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48964/0 (socket says 172.21.15.60:48964) 2024-09-12T01:36:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d6effd640 1 -- 172.21.15.60:0/125801087 learned_addr learned my addr 172.21.15.60:0/125801087 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d6f7fe640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d700b66a0 0x7f2d70152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d6ffff640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d7015e860 0x7f2d700ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d6effd640 1 -- 172.21.15.60:0/125801087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d700b66a0 msgr2=0x7f2d70152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d6effd640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d700b66a0 0x7f2d70152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d6effd640 1 -- 172.21.15.60:0/125801087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d7015e860 msgr2=0x7f2d700ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d6effd640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d7015e860 0x7f2d700ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.598+0000 7f2d6effd640 1 -- 172.21.15.60:0/125801087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7015f810 con 0x7f2d700d2ff0 2024-09-12T01:36:04.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.599+0000 7f2d6effd640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700d2ff0 0x7f2d700cdd20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400d7d0 tx=0x7f2d6400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:04.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.599+0000 7f2d57fff640 1 -- 172.21.15.60:0/125801087 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400b6c0 con 0x7f2d700d2ff0 2024-09-12T01:36:04.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.599+0000 7f2d57fff640 1 -- 172.21.15.60:0/125801087 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d64019070 con 0x7f2d700d2ff0 2024-09-12T01:36:04.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.599+0000 7f2d76250640 1 -- 172.21.15.60:0/125801087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7015faf0 con 0x7f2d700d2ff0 2024-09-12T01:36:04.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.599+0000 7f2d57fff640 1 -- 172.21.15.60:0/125801087 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400bac0 con 0x7f2d700d2ff0 2024-09-12T01:36:04.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.599+0000 7f2d76250640 1 -- 172.21.15.60:0/125801087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d701600b0 con 0x7f2d700d2ff0 2024-09-12T01:36:04.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.600+0000 7f2d76250640 1 -- 172.21.15.60:0/125801087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d700cb040 con 0x7f2d700d2ff0 2024-09-12T01:36:04.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.600+0000 7f2d57fff640 1 -- 172.21.15.60:0/125801087 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2d6400bc60 con 0x7f2d700d2ff0 2024-09-12T01:36:04.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.601+0000 7f2d57fff640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2d5c06be30 0x7f2d5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.601+0000 7f2d57fff640 1 -- 172.21.15.60:0/125801087 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2d6408b1b0 con 0x7f2d700d2ff0 2024-09-12T01:36:04.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.601+0000 7f2d6f7fe640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2d5c06be30 0x7f2d5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.601+0000 7f2d6f7fe640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2d5c06be30 0x7f2d5c06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2d60034000 tx=0x7f2d6002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:04.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.605+0000 7f2d57fff640 1 -- 172.21.15.60:0/125801087 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2d640595a0 con 0x7f2d700d2ff0 2024-09-12T01:36:04.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.830+0000 7f2d76250640 1 -- 172.21.15.60:0/125801087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2d700b7bc0 con 0x7f2d700d2ff0 2024-09-12T01:36:04.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.833+0000 7f2d57fff640 1 -- 172.21.15.60:0/125801087 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172938 (secure 0 0 0) 0x7f2d6405d8a0 con 0x7f2d700d2ff0 2024-09-12T01:36:04.835 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:04.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.836+0000 7f2d76250640 1 -- 172.21.15.60:0/125801087 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2d5c06be30 msgr2=0x7f2d5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.836+0000 7f2d76250640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2d5c06be30 0x7f2d5c06e2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2d60034000 tx=0x7f2d6002e000 comp rx=0 tx=0).stop 2024-09-12T01:36:04.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.836+0000 7f2d76250640 1 -- 172.21.15.60:0/125801087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700d2ff0 msgr2=0x7f2d700cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.836+0000 7f2d76250640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700d2ff0 0x7f2d700cdd20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400d7d0 tx=0x7f2d6400dc90 comp rx=0 tx=0).stop 2024-09-12T01:36:04.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.836+0000 7f2d76250640 1 -- 172.21.15.60:0/125801087 shutdown_connections 2024-09-12T01:36:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.836+0000 7f2d76250640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2d7015e860 0x7f2d700ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.836+0000 7f2d76250640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2d700d2ff0 0x7f2d700cdd20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.836+0000 7f2d76250640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2d5c06be30 0x7f2d5c06e2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.836+0000 7f2d76250640 1 --2- 172.21.15.60:0/125801087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2d700b66a0 0x7f2d70152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.836+0000 7f2d76250640 1 -- 172.21.15.60:0/125801087 >> 172.21.15.60:0/125801087 conn(0x7f2d70062c60 msgr2=0x7f2d700b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.836+0000 7f2d76250640 1 -- 172.21.15.60:0/125801087 shutdown_connections 2024-09-12T01:36:04.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.836+0000 7f2d76250640 1 -- 172.21.15.60:0/125801087 wait complete. 2024-09-12T01:36:04.848 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":2696595369},{"type":"v1","addr":"172.21.15.60:6801","nonce":2696595369}]},"active_addr":"172.21.15.60:6801/2696595369","active_change":"2024-09-12T01:35:36.253249+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":440334077}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":1313007511}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":4160698085}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":3747566656}]}]} 2024-09-12T01:36:04.853 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T01:36:04.853 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T01:36:04.853 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:36:04.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f2035865640 1 Processor -- start 2024-09-12T01:36:04.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f2035865640 1 -- start start 2024-09-12T01:36:04.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f2035865640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f203015c2b0 0x7f20300b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f2035865640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f203015fb10 con 0x7f203015f200 2024-09-12T01:36:04.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f2035865640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20300b5900 con 0x7f20300b72f0 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f2035865640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f203015f830 con 0x7f203015c2b0 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202f7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f203015f200 0x7f203006d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50096/0 (socket says 172.21.15.60:50096) 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202f7fe640 1 -- 172.21.15.60:0/3430566942 learned_addr learned my addr 172.21.15.60:0/3430566942 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202effd640 1 --2- 172.21.15.60:0/3430566942 >> v2:172.21.15.105:3300/0 conn(0x7f203015c2b0 0x7f20300b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897040432 0 0) 0x7f203015fb10 con 0x7f203015f200 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2018003520 con 0x7f203015f200 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287785270 0 0) 0x7f20300b5900 con 0x7f20300b72f0 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f203015fb10 con 0x7f20300b72f0 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1366391390 0 0) 0x7f2018003520 con 0x7f203015f200 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 >> v2:172.21.15.105:3300/0 conn(0x7f203015c2b0 msgr2=0x7f20300b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 --2- 172.21.15.60:0/3430566942 >> v2:172.21.15.105:3300/0 conn(0x7f203015c2b0 0x7f20300b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 >> v1:172.21.15.105:6789/0 conn(0x7f20300b72f0 legacy=0x7f203015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203006ce30 con 0x7f203015f200 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f20280019f0 con 0x7f203015f200 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202effd640 1 --2- 172.21.15.60:0/3430566942 >> v2:172.21.15.105:3300/0 conn(0x7f203015c2b0 0x7f20300b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 >> v1:172.21.15.60:6789/0 conn(0x7f203015f200 legacy=0x7f203006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 --2- 172.21.15.60:0/3430566942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2018003b40 0x7f2018003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 --2- 172.21.15.60:0/3430566942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2018004800 0x7f2018004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 --2- 172.21.15.60:0/3430566942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20180051c0 0x7f201800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f203015f830 con 0x7f2018004800 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f201800c040 con 0x7f20180051c0 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f201800c240 con 0x7f2018003b40 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.956+0000 7f202e7fc640 1 --2- 172.21.15.60:0/3430566942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2018004800 0x7f2018004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.957+0000 7f202effd640 1 --2- 172.21.15.60:0/3430566942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2018003b40 0x7f2018003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.957+0000 7f202f7fe640 1 --2- 172.21.15.60:0/3430566942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20180051c0 0x7f201800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.957+0000 7f202e7fc640 1 -- 172.21.15.60:0/3430566942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2018003b40 msgr2=0x7f2018003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.957+0000 7f202e7fc640 1 --2- 172.21.15.60:0/3430566942 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2018003b40 0x7f2018003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.957+0000 7f202e7fc640 1 -- 172.21.15.60:0/3430566942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20180051c0 msgr2=0x7f201800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.957+0000 7f202e7fc640 1 --2- 172.21.15.60:0/3430566942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20180051c0 0x7f201800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.957+0000 7f202e7fc640 1 -- 172.21.15.60:0/3430566942 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2018003520 con 0x7f2018004800 2024-09-12T01:36:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.957+0000 7f202f7fe640 1 --2- 172.21.15.60:0/3430566942 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20180051c0 0x7f201800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.957+0000 7f202f7fe640 1 -- 172.21.15.60:0/3430566942 reap_dead start 2024-09-12T01:36:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.957+0000 7f202e7fc640 1 --2- 172.21.15.60:0/3430566942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2018004800 0x7f2018004c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f20240018d0 tx=0x7f2018005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ee1cb4d18646fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.958+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20240014f0 con 0x7f2018004800 2024-09-12T01:36:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.958+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20240052d0 con 0x7f2018004800 2024-09-12T01:36:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.958+0000 7f202dffb640 1 -- 172.21.15.60:0/3430566942 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202402ac70 con 0x7f2018004800 2024-09-12T01:36:04.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.958+0000 7f2035865640 1 -- 172.21.15.60:0/3430566942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2018004800 msgr2=0x7f2018004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.958+0000 7f2035865640 1 --2- 172.21.15.60:0/3430566942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2018004800 0x7f2018004c80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f20240018d0 tx=0x7f2018005830 comp rx=0 tx=0).stop 2024-09-12T01:36:04.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.958+0000 7f2035865640 1 -- 172.21.15.60:0/3430566942 shutdown_connections 2024-09-12T01:36:04.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.958+0000 7f2035865640 1 --2- 172.21.15.60:0/3430566942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2018004800 0x7f2018004c80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.958+0000 7f2035865640 1 -- 172.21.15.60:0/3430566942 >> 172.21.15.60:0/3430566942 conn(0x7f20300b4240 msgr2=0x7f20300b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:04.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.958+0000 7f2035865640 1 -- 172.21.15.60:0/3430566942 shutdown_connections 2024-09-12T01:36:04.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.958+0000 7f2035865640 1 -- 172.21.15.60:0/3430566942 wait complete. 2024-09-12T01:36:04.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.959+0000 7f2035865640 1 Processor -- start 2024-09-12T01:36:04.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.960+0000 7f2035865640 1 -- start start 2024-09-12T01:36:04.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.960+0000 7f2035865640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2018004800 0x7f20300cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.960+0000 7f2035865640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20301550c0 0x7f203014bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.960+0000 7f2035865640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20300cda90 0x7f20300cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.960+0000 7f2035865640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f20300b7760 con 0x7f20301550c0 2024-09-12T01:36:04.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.960+0000 7f2035865640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f203006d3f0 con 0x7f20300cda90 2024-09-12T01:36:04.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.960+0000 7f2035865640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f20300b6db0 con 0x7f2018004800 2024-09-12T01:36:04.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.960+0000 7f202e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20301550c0 0x7f203014bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.960+0000 7f202e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20301550c0 0x7f203014bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48982/0 (socket says 172.21.15.60:48982) 2024-09-12T01:36:04.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.960+0000 7f202e7fc640 1 -- 172.21.15.60:0/402567360 learned_addr learned my addr 172.21.15.60:0/402567360 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:04.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f202effd640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2018004800 0x7f20300cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f202f7fe640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20300cda90 0x7f20300cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f202e7fc640 1 -- 172.21.15.60:0/402567360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2018004800 msgr2=0x7f20300cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f202e7fc640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2018004800 0x7f20300cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f202e7fc640 1 -- 172.21.15.60:0/402567360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20300cda90 msgr2=0x7f20300cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:04.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f202e7fc640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20300cda90 0x7f20300cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:04.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f202e7fc640 1 -- 172.21.15.60:0/402567360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20300d1dc0 con 0x7f20301550c0 2024-09-12T01:36:04.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f202e7fc640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20301550c0 0x7f203014bf00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2024000c00 tx=0x7f20240012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:04.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f2017fff640 1 -- 172.21.15.60:0/402567360 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024037040 con 0x7f20301550c0 2024-09-12T01:36:04.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f2017fff640 1 -- 172.21.15.60:0/402567360 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2024005480 con 0x7f20301550c0 2024-09-12T01:36:04.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f2035865640 1 -- 172.21.15.60:0/402567360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20300d20a0 con 0x7f20301550c0 2024-09-12T01:36:04.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f2017fff640 1 -- 172.21.15.60:0/402567360 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20240014f0 con 0x7f20301550c0 2024-09-12T01:36:04.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.961+0000 7f2035865640 1 -- 172.21.15.60:0/402567360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20300d2660 con 0x7f20301550c0 2024-09-12T01:36:04.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.962+0000 7f2035865640 1 -- 172.21.15.60:0/402567360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20300ce450 con 0x7f20301550c0 2024-09-12T01:36:04.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.963+0000 7f2017fff640 1 -- 172.21.15.60:0/402567360 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2024044020 con 0x7f20301550c0 2024-09-12T01:36:04.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.963+0000 7f2017fff640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f201c06be60 0x7f201c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:04.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.963+0000 7f2017fff640 1 -- 172.21.15.60:0/402567360 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f20240aa730 con 0x7f20301550c0 2024-09-12T01:36:04.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.963+0000 7f202effd640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f201c06be60 0x7f201c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:04.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.964+0000 7f202effd640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f201c06be60 0x7f201c06e320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2020009ce0 tx=0x7f2020009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:04.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:04.968+0000 7f2017fff640 1 -- 172.21.15.60:0/402567360 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f202404b020 con 0x7f20301550c0 2024-09-12T01:36:05.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.142+0000 7f2035865640 1 -- 172.21.15.60:0/402567360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20300d2b80 con 0x7f20301550c0 2024-09-12T01:36:05.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.144+0000 7f2017fff640 1 -- 172.21.15.60:0/402567360 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7f20300d2b80 con 0x7f20301550c0 2024-09-12T01:36:05.143 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:05.143 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:57.624089+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:35:53.846331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:35:54.965757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:36:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.145+0000 7f2035865640 1 -- 172.21.15.60:0/402567360 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f201c06be60 msgr2=0x7f201c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.145+0000 7f2035865640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f201c06be60 0x7f201c06e320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2020009ce0 tx=0x7f2020009190 comp rx=0 tx=0).stop 2024-09-12T01:36:05.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.145+0000 7f2035865640 1 -- 172.21.15.60:0/402567360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20301550c0 msgr2=0x7f203014bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.145+0000 7f2035865640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20301550c0 0x7f203014bf00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2024000c00 tx=0x7f20240012d0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.145+0000 7f2035865640 1 -- 172.21.15.60:0/402567360 shutdown_connections 2024-09-12T01:36:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.146+0000 7f2035865640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20300cda90 0x7f20300cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.146+0000 7f2035865640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20301550c0 0x7f203014bf00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.146+0000 7f2035865640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f201c06be60 0x7f201c06e320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.146+0000 7f2035865640 1 --2- 172.21.15.60:0/402567360 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2018004800 0x7f20300cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.146+0000 7f2035865640 1 -- 172.21.15.60:0/402567360 >> 172.21.15.60:0/402567360 conn(0x7f20300b4240 msgr2=0x7f203006e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.146+0000 7f2035865640 1 -- 172.21.15.60:0/402567360 shutdown_connections 2024-09-12T01:36:05.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.146+0000 7f2035865640 1 -- 172.21.15.60:0/402567360 wait complete. 2024-09-12T01:36:05.156 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T01:36:05.157 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:36:05.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.259+0000 7f38768c0640 1 Processor -- start 2024-09-12T01:36:05.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.259+0000 7f38768c0640 1 -- start start 2024-09-12T01:36:05.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f38768c0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38700d27e0 0x7f38700d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f38768c0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f38700b84b0 0x7f38700b8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f38768c0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38700b7d20 con 0x7f38700b6260 2024-09-12T01:36:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f38768c0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f38700b8020 con 0x7f38700d27e0 2024-09-12T01:36:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f38768c0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f38700d3560 con 0x7f38700b84b0 2024-09-12T01:36:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f386f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38700d27e0 0x7f38700d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f386f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38700d27e0 0x7f38700d2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48990/0 (socket says 172.21.15.60:48990) 2024-09-12T01:36:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f386f7fe640 1 -- 172.21.15.60:0/1055747932 learned_addr learned my addr 172.21.15.60:0/1055747932 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f3874e5d640 1 --2- 172.21.15.60:0/1055747932 >> v2:172.21.15.105:3300/0 conn(0x7f38700b84b0 0x7f38700b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f386f7fe640 1 -- 172.21.15.60:0/1055747932 >> v2:172.21.15.105:3300/0 conn(0x7f38700b84b0 msgr2=0x7f38700b8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f386f7fe640 1 --2- 172.21.15.60:0/1055747932 >> v2:172.21.15.105:3300/0 conn(0x7f38700b84b0 0x7f38700b8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f386f7fe640 1 -- 172.21.15.60:0/1055747932 >> v1:172.21.15.105:6789/0 conn(0x7f38700b6260 legacy=0x7f38700b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.260+0000 7f386f7fe640 1 -- 172.21.15.60:0/1055747932 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38700d3840 con 0x7f38700d27e0 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.261+0000 7f386f7fe640 1 --2- 172.21.15.60:0/1055747932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38700d27e0 0x7f38700d2c70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3864009870 tx=0x7f386402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a4faddb6123542 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.261+0000 7f386effd640 1 -- 172.21.15.60:0/1055747932 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864037070 con 0x7f38700d27e0 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.261+0000 7f386effd640 1 -- 172.21.15.60:0/1055747932 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3864032440 con 0x7f38700d27e0 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.261+0000 7f386effd640 1 -- 172.21.15.60:0/1055747932 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864032810 con 0x7f38700d27e0 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.261+0000 7f38768c0640 1 -- 172.21.15.60:0/1055747932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38700d27e0 msgr2=0x7f38700d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.261+0000 7f38768c0640 1 --2- 172.21.15.60:0/1055747932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38700d27e0 0x7f38700d2c70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3864009870 tx=0x7f386402a270 comp rx=0 tx=0).stop 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.261+0000 7f38768c0640 1 -- 172.21.15.60:0/1055747932 shutdown_connections 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.262+0000 7f38768c0640 1 --2- 172.21.15.60:0/1055747932 >> v2:172.21.15.105:3300/0 conn(0x7f38700b84b0 0x7f38700b8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.262+0000 7f38768c0640 1 --2- 172.21.15.60:0/1055747932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38700d27e0 0x7f38700d2c70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.262+0000 7f38768c0640 1 -- 172.21.15.60:0/1055747932 >> 172.21.15.60:0/1055747932 conn(0x7f3870062c60 msgr2=0x7f38700d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.262+0000 7f38768c0640 1 -- 172.21.15.60:0/1055747932 shutdown_connections 2024-09-12T01:36:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.262+0000 7f38768c0640 1 -- 172.21.15.60:0/1055747932 wait complete. 2024-09-12T01:36:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.263+0000 7f38768c0640 1 Processor -- start 2024-09-12T01:36:05.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.263+0000 7f38768c0640 1 -- start start 2024-09-12T01:36:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f38768c0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38700b6260 0x7f3870157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f38768c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38700b84b0 0x7f3870154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f38768c0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38700d27e0 0x7f387015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f38768c0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38700d31b0 con 0x7f38700b84b0 2024-09-12T01:36:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f38768c0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f387015eb60 con 0x7f38700d27e0 2024-09-12T01:36:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f38768c0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3870154e90 con 0x7f38700b6260 2024-09-12T01:36:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38700b84b0 0x7f3870154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38700b84b0 0x7f3870154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48998/0 (socket says 172.21.15.60:48998) 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386f7fe640 1 -- 172.21.15.60:0/2252246641 learned_addr learned my addr 172.21.15.60:0/2252246641 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f3874e5d640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38700d27e0 0x7f387015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386ffff640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38700b6260 0x7f3870157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386f7fe640 1 -- 172.21.15.60:0/2252246641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38700b6260 msgr2=0x7f3870157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386f7fe640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38700b6260 0x7f3870157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386f7fe640 1 -- 172.21.15.60:0/2252246641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38700d27e0 msgr2=0x7f387015b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386f7fe640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38700d27e0 0x7f387015b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386f7fe640 1 -- 172.21.15.60:0/2252246641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38701f4b90 con 0x7f38700b84b0 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386f7fe640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38700b84b0 0x7f3870154950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38640090b0 tx=0x7f38640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386cff9640 1 -- 172.21.15.60:0/2252246641 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864037040 con 0x7f38700b84b0 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386cff9640 1 -- 172.21.15.60:0/2252246641 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3864004230 con 0x7f38700b84b0 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f38768c0640 1 -- 172.21.15.60:0/2252246641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38701f4e70 con 0x7f38700b84b0 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.264+0000 7f386cff9640 1 -- 172.21.15.60:0/2252246641 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3864003610 con 0x7f38700b84b0 2024-09-12T01:36:05.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.265+0000 7f38768c0640 1 -- 172.21.15.60:0/2252246641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38701f5430 con 0x7f38700b84b0 2024-09-12T01:36:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.265+0000 7f38768c0640 1 -- 172.21.15.60:0/2252246641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38701f48e0 con 0x7f38700b84b0 2024-09-12T01:36:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.266+0000 7f386cff9640 1 -- 172.21.15.60:0/2252246641 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38640037b0 con 0x7f38700b84b0 2024-09-12T01:36:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.266+0000 7f386cff9640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f385c06be30 0x7f385c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.266+0000 7f386ffff640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f385c06be30 0x7f385c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.266+0000 7f386cff9640 1 -- 172.21.15.60:0/2252246641 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f38640aba70 con 0x7f38700b84b0 2024-09-12T01:36:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.267+0000 7f386ffff640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f385c06be30 0x7f385c06e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3860006fd0 tx=0x7f3860009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.271+0000 7f386cff9640 1 -- 172.21.15.60:0/2252246641 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3864079dd0 con 0x7f38700b84b0 2024-09-12T01:36:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.445+0000 7f38768c0640 1 -- 172.21.15.60:0/2252246641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38701f48e0 con 0x7f38700b84b0 2024-09-12T01:36:05.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.446+0000 7f386cff9640 1 -- 172.21.15.60:0/2252246641 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7f386407e0d0 con 0x7f38700b84b0 2024-09-12T01:36:05.446 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:05.446 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:57.624089+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:35:53.846331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:35:54.965757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:36:05.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.448+0000 7f38768c0640 1 -- 172.21.15.60:0/2252246641 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f385c06be30 msgr2=0x7f385c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.448+0000 7f38768c0640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f385c06be30 0x7f385c06e2f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3860006fd0 tx=0x7f3860009060 comp rx=0 tx=0).stop 2024-09-12T01:36:05.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.448+0000 7f38768c0640 1 -- 172.21.15.60:0/2252246641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38700b84b0 msgr2=0x7f3870154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.448+0000 7f38768c0640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38700b84b0 0x7f3870154950 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f38640090b0 tx=0x7f38640046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.448+0000 7f38768c0640 1 -- 172.21.15.60:0/2252246641 shutdown_connections 2024-09-12T01:36:05.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.448+0000 7f38768c0640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38700d27e0 0x7f387015b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.448+0000 7f38768c0640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38700b84b0 0x7f3870154950 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.448+0000 7f38768c0640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f385c06be30 0x7f385c06e2f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.448+0000 7f38768c0640 1 --2- 172.21.15.60:0/2252246641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38700b6260 0x7f3870157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.448+0000 7f38768c0640 1 -- 172.21.15.60:0/2252246641 >> 172.21.15.60:0/2252246641 conn(0x7f3870062c60 msgr2=0x7f38700ba180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.448+0000 7f38768c0640 1 -- 172.21.15.60:0/2252246641 shutdown_connections 2024-09-12T01:36:05.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.448+0000 7f38768c0640 1 -- 172.21.15.60:0/2252246641 wait complete. 2024-09-12T01:36:05.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T01:36:05.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T01:36:05.463 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T01:36:05.463 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T01:36:05.464 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T01:36:05.464 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T01:36:05.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T01:36:05.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T01:36:05.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.641+0000 7fb594931640 1 Processor -- start 2024-09-12T01:36:05.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.641+0000 7fb594931640 1 -- start start 2024-09-12T01:36:05.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.642+0000 7fa5f7dd6640 1 Processor -- start 2024-09-12T01:36:05.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.642+0000 7fb594931640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb59006c320 0x7fb590162d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.642+0000 7fb594931640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb590073800 con 0x7fb590164550 2024-09-12T01:36:05.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.642+0000 7fb594931640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb590073ae0 con 0x7fb590162930 2024-09-12T01:36:05.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.642+0000 7fb594931640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb590073dc0 con 0x7fb59006c320 2024-09-12T01:36:05.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.643+0000 7fb58dd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb59006c320 0x7fb590162d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.643+0000 7fb58dd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb59006c320 0x7fb590162d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49002/0 (socket says 172.21.15.60:49002) 2024-09-12T01:36:05.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.643+0000 7fb58dd9b640 1 -- 172.21.15.60:0/1015417003 learned_addr learned my addr 172.21.15.60:0/1015417003 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.643+0000 7fa5f7dd6640 1 -- start start 2024-09-12T01:36:05.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.643+0000 7fb58dd9b640 1 -- 172.21.15.60:0/1015417003 >> v1:172.21.15.105:6789/0 conn(0x7fb590162930 legacy=0x7fb59006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.643+0000 7fb58dd9b640 1 -- 172.21.15.60:0/1015417003 >> v1:172.21.15.60:6789/0 conn(0x7fb590164550 legacy=0x7fb5900b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.643+0000 7fb58dd9b640 1 -- 172.21.15.60:0/1015417003 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5900740a0 con 0x7fb59006c320 2024-09-12T01:36:05.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.644+0000 7fa5f7dd6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f01492f0 0x7fa5f01666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.644+0000 7fa5f7dd6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa5f00b60e0 0x7fa5f0166be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.644+0000 7fa5f7dd6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f00b3f40 con 0x7fa5f0167120 2024-09-12T01:36:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.644+0000 7fa5f7dd6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f0070fb0 con 0x7fa5f00b60e0 2024-09-12T01:36:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.644+0000 7fa5f7dd6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f0071200 con 0x7fa5f01492f0 2024-09-12T01:36:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.644+0000 7fa5f6373640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fa5f0167120 0x7fa5f0072a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:49348/0 (socket says 172.21.15.60:49348) 2024-09-12T01:36:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.644+0000 7fa5f6373640 1 -- 172.21.15.60:0/678812903 learned_addr learned my addr 172.21.15.60:0/678812903 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.645+0000 7fa5f5b72640 1 --2- 172.21.15.60:0/678812903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f01492f0 0x7fa5f01666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.645+0000 7fa5f5371640 1 --2- 172.21.15.60:0/678812903 >> v2:172.21.15.60:3300/0 conn(0x7fa5f00b60e0 0x7fa5f0166be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.645+0000 7fa5f4b70640 1 -- 172.21.15.60:0/678812903 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3361409180 0 0) 0x7fa5f00b3f40 con 0x7fa5f0167120 2024-09-12T01:36:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.645+0000 7f65f7add640 1 Processor -- start 2024-09-12T01:36:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.645+0000 7fa5f4b70640 1 -- 172.21.15.60:0/678812903 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5dc003520 con 0x7fa5f0167120 2024-09-12T01:36:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.645+0000 7f65f7add640 1 -- start start 2024-09-12T01:36:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.645+0000 7fa5f5b72640 1 -- 172.21.15.60:0/678812903 >> v2:172.21.15.60:3300/0 conn(0x7fa5f00b60e0 msgr2=0x7fa5f0166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.645+0000 7fa5f5b72640 1 --2- 172.21.15.60:0/678812903 >> v2:172.21.15.60:3300/0 conn(0x7fa5f00b60e0 0x7fa5f0166be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.646+0000 7fa5f5b72640 1 -- 172.21.15.60:0/678812903 >> v1:172.21.15.105:6789/0 conn(0x7fa5f0167120 legacy=0x7fa5f0072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.646+0000 7fb58dd9b640 1 --2- 172.21.15.60:0/1015417003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb59006c320 0x7fb590162d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb584009870 tx=0x7fb58402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727095fd314d8fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.646+0000 7fa5f5b72640 1 -- 172.21.15.60:0/678812903 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f0073d90 con 0x7fa5f01492f0 2024-09-12T01:36:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.646+0000 7fb58d59a640 1 -- 172.21.15.60:0/1015417003 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584037070 con 0x7fb59006c320 2024-09-12T01:36:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.646+0000 7fb58d59a640 1 -- 172.21.15.60:0/1015417003 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb584032440 con 0x7fb59006c320 2024-09-12T01:36:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.646+0000 7fb58d59a640 1 -- 172.21.15.60:0/1015417003 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb584032810 con 0x7fb59006c320 2024-09-12T01:36:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.646+0000 7f6f438dd640 1 Processor -- start 2024-09-12T01:36:05.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f9299968640 1 Processor -- start 2024-09-12T01:36:05.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f755e1f1640 1 Processor -- start 2024-09-12T01:36:05.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f65f7add640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65f0161d70 0x7f65f00b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f6f438dd640 1 -- start start 2024-09-12T01:36:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f9299968640 1 -- start start 2024-09-12T01:36:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f9299968640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9294073500 0x7f92940d31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f9299968640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92940b6890 0x7f92940b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f9299968640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92940d3940 con 0x7f92940d22d0 2024-09-12T01:36:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f9299968640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f92940738e0 con 0x7f9294073500 2024-09-12T01:36:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f9299968640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f92940d3700 con 0x7f92940b6890 2024-09-12T01:36:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f9292ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9294073500 0x7f92940d31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f9292ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9294073500 0x7f92940d31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49030/0 (socket says 172.21.15.60:49030) 2024-09-12T01:36:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f9292ffd640 1 -- 172.21.15.60:0/61402682 learned_addr learned my addr 172.21.15.60:0/61402682 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f65f5078640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f65f0162150 0x7f65f00b6180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50116/0 (socket says 172.21.15.60:50116) 2024-09-12T01:36:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f65f5078640 1 -- 172.21.15.60:0/563695561 learned_addr learned my addr 172.21.15.60:0/563695561 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f65f7add640 1 -- 172.21.15.60:0/563695561 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65f00cf2a0 con 0x7f65f0162150 2024-09-12T01:36:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f65f5879640 1 --2- 172.21.15.60:0/563695561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65f0161d70 0x7f65f00b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f65f7add640 1 -- 172.21.15.60:0/563695561 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65f00cf9b0 con 0x7f65f00b6890 2024-09-12T01:36:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f65f7add640 1 -- 172.21.15.60:0/563695561 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f65f00cf760 con 0x7f65f0161d70 2024-09-12T01:36:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f65f4877640 1 -- 172.21.15.60:0/563695561 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3763268311 0 0) 0x7f65f00cf2a0 con 0x7f65f0162150 2024-09-12T01:36:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f65f4877640 1 -- 172.21.15.60:0/563695561 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65dc003520 con 0x7f65f0162150 2024-09-12T01:36:05.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f65f4877640 1 -- 172.21.15.60:0/563695561 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726227625 0 0) 0x7f65f00cf9b0 con 0x7f65f00b6890 2024-09-12T01:36:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f65f4877640 1 -- 172.21.15.60:0/563695561 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65f00cf2a0 con 0x7f65f00b6890 2024-09-12T01:36:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f65f5879640 1 -- 172.21.15.60:0/563695561 >> v1:172.21.15.105:6789/0 conn(0x7f65f00b6890 legacy=0x7f65f00d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7fa5f5b72640 1 --2- 172.21.15.60:0/678812903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f01492f0 0x7fa5f01666a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0071130 tx=0x7fa5ec02a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fad465c131870db server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7fa5f4b70640 1 -- 172.21.15.60:0/678812903 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec037070 con 0x7fa5f01492f0 2024-09-12T01:36:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7fa5f4b70640 1 -- 172.21.15.60:0/678812903 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ec02ae40 con 0x7fa5f01492f0 2024-09-12T01:36:05.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7fa5f4b70640 1 -- 172.21.15.60:0/678812903 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec032640 con 0x7fa5f01492f0 2024-09-12T01:36:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f755e1f1640 1 -- start start 2024-09-12T01:36:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f755e1f1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f75500e28e0 0x7f7550053070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f755e1f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f755003bc50 0x7f75500535b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7fb594931640 1 -- 172.21.15.60:0/1015417003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb59006c320 msgr2=0x7fb590162d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7fb594931640 1 --2- 172.21.15.60:0/1015417003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb59006c320 0x7fb590162d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb584009870 tx=0x7fb58402a210 comp rx=0 tx=0).stop 2024-09-12T01:36:05.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f6f438dd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3c161d70 0x7f6f3c0b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f6f438dd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6f3c162150 0x7f6f3c0b6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f6b628ba640 1 Processor -- start 2024-09-12T01:36:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f65f5879640 1 -- 172.21.15.60:0/563695561 >> v1:172.21.15.60:6789/0 conn(0x7f65f0162150 legacy=0x7f65f00b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f65f5879640 1 -- 172.21.15.60:0/563695561 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f00cfc90 con 0x7f65f0161d70 2024-09-12T01:36:05.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f65f4877640 1 -- 172.21.15.60:0/563695561 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3816007536 0 0) 0x7f65dc003520 con 0x7f65f0162150 2024-09-12T01:36:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.648+0000 7f755d1ef640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f75500e28e0 0x7f7550053070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f755d1ef640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f75500e28e0 0x7f7550053070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48040/0 (socket says 172.21.15.60:48040) 2024-09-12T01:36:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f755d1ef640 1 -- 172.21.15.60:0/4277129375 learned_addr learned my addr 172.21.15.60:0/4277129375 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f755c9ee640 1 --2- 172.21.15.60:0/4277129375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f755003bc50 0x7f75500535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7fb594931640 1 -- 172.21.15.60:0/1015417003 shutdown_connections 2024-09-12T01:36:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7fb594931640 1 --2- 172.21.15.60:0/1015417003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb59006c320 0x7fb590162d10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7fb594931640 1 -- 172.21.15.60:0/1015417003 >> 172.21.15.60:0/1015417003 conn(0x7fb59006cd20 msgr2=0x7fb59006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f6f438dd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f3c0d4260 0x7f6f3c0b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7fb594931640 1 -- 172.21.15.60:0/1015417003 shutdown_connections 2024-09-12T01:36:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7fb594931640 1 -- 172.21.15.60:0/1015417003 wait complete. 2024-09-12T01:36:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f755e1f1640 1 -- 172.21.15.60:0/4277129375 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7550057d70 con 0x7f7550057820 2024-09-12T01:36:05.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f755e1f1640 1 -- 172.21.15.60:0/4277129375 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f75500076b0 con 0x7f75500e28e0 2024-09-12T01:36:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f755e1f1640 1 -- 172.21.15.60:0/4277129375 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7550058050 con 0x7f755003bc50 2024-09-12T01:36:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.647+0000 7f6b628ba640 1 -- start start 2024-09-12T01:36:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f6f41e7a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f3c0d4260 0x7f6f3c0b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f6f41e7a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f3c0d4260 0x7f6f3c0b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49038/0 (socket says 172.21.15.60:49038) 2024-09-12T01:36:05.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f6f41e7a640 1 -- 172.21.15.60:0/1504200992 learned_addr learned my addr 172.21.15.60:0/1504200992 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89957188 0 0) 0x7f92940d3940 con 0x7f92940d22d0 2024-09-12T01:36:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f927c003520 con 0x7f92940d22d0 2024-09-12T01:36:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f6f438dd640 1 -- 172.21.15.60:0/1504200992 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6f3c0cf760 con 0x7f6f3c0d4260 2024-09-12T01:36:05.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f6f41679640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3c161d70 0x7f6f3c0b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f92937fe640 1 --2- 172.21.15.60:0/61402682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92940b6890 0x7f92940b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f6f438dd640 1 -- 172.21.15.60:0/1504200992 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6f3c0cf2a0 con 0x7f6f3c162150 2024-09-12T01:36:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f6f438dd640 1 -- 172.21.15.60:0/1504200992 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6f3c0cf9b0 con 0x7f6f3c161d70 2024-09-12T01:36:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 <== mon.1 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1368731541 0 0) 0x7f927c003520 con 0x7f92940d22d0 2024-09-12T01:36:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92940b6890 msgr2=0x7f92940b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f9291ffb640 1 --2- 172.21.15.60:0/61402682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f92940b6890 0x7f92940b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 >> v2:172.21.15.60:3300/0 conn(0x7f9294073500 msgr2=0x7f92940d31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f9291ffb640 1 --2- 172.21.15.60:0/61402682 >> v2:172.21.15.60:3300/0 conn(0x7f9294073500 0x7f92940d31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92940d3c20 con 0x7f92940d22d0 2024-09-12T01:36:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 <== mon.1 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f9288001670 con 0x7f92940d22d0 2024-09-12T01:36:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 >> v1:172.21.15.105:6789/0 conn(0x7f92940d22d0 legacy=0x7f92940b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f9291ffb640 1 --2- 172.21.15.60:0/61402682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c0039d0 0x7f927c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f9291ffb640 1 --2- 172.21.15.60:0/61402682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f927c004800 0x7f927c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f9291ffb640 1 --2- 172.21.15.60:0/61402682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f927c0051c0 0x7f927c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f92940d3700 con 0x7f927c0039d0 2024-09-12T01:36:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f927c00bf60 con 0x7f927c0051c0 2024-09-12T01:36:05.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f927c00c160 con 0x7f927c004800 2024-09-12T01:36:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f6b628ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b5c1492f0 0x7f6b5c1666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6b628ba640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6b5c0b4700 0x7f6b5c0b4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6b628ba640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b5c0b3f40 con 0x7f6b5c0b60e0 2024-09-12T01:36:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6b628ba640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6b5c070fb0 con 0x7f6b5c0b4700 2024-09-12T01:36:05.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6b628ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6b5c071200 con 0x7f6b5c1492f0 2024-09-12T01:36:05.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f92927fc640 1 --2- 172.21.15.60:0/61402682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f927c004800 0x7f927c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f9292ffd640 1 --2- 172.21.15.60:0/61402682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c0039d0 0x7f927c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f65f5879640 1 --2- 172.21.15.60:0/563695561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65f0161d70 0x7f65f00b3390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097d0 tx=0x7f65e002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e640fe87d10ca7fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7fa5f7dd6640 1 -- 172.21.15.60:0/678812903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f01492f0 msgr2=0x7fa5f01666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7fa5f7dd6640 1 --2- 172.21.15.60:0/678812903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f01492f0 0x7fa5f01666a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0071130 tx=0x7fa5ec02a0f0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f755d1ef640 1 -- 172.21.15.60:0/4277129375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f755003bc50 msgr2=0x7f75500535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f755d1ef640 1 --2- 172.21.15.60:0/4277129375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f755003bc50 0x7f75500535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f755d1ef640 1 -- 172.21.15.60:0/4277129375 >> v1:172.21.15.105:6789/0 conn(0x7f7550057820 legacy=0x7f75500e66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.649+0000 7f755d1ef640 1 -- 172.21.15.60:0/4277129375 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7550005ea0 con 0x7f75500e28e0 2024-09-12T01:36:05.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6b5b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6b5c0b60e0 0x7f6b5c166be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50126/0 (socket says 172.21.15.60:50126) 2024-09-12T01:36:05.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6b5b7fe640 1 -- 172.21.15.60:0/1024217716 learned_addr learned my addr 172.21.15.60:0/1024217716 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:05.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6b60e57640 1 --2- 172.21.15.60:0/1024217716 >> v2:172.21.15.105:3300/0 conn(0x7f6b5c0b4700 0x7f6b5c0b4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f755d1ef640 1 --2- 172.21.15.60:0/4277129375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75500e28e0 0x7f7550053070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7554009870 tx=0x7f755402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d69309084423628c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1246200830 0 0) 0x7f6b5c0b3f40 con 0x7f6b5c0b60e0 2024-09-12T01:36:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f92937fe640 1 --2- 172.21.15.60:0/61402682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f927c0051c0 0x7f927c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6f41679640 1 -- 172.21.15.60:0/1504200992 >> v2:172.21.15.105:3300/0 conn(0x7f6f3c162150 msgr2=0x7f6f3c0b6180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:36:05.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6f41679640 1 --2- 172.21.15.60:0/1504200992 >> v2:172.21.15.105:3300/0 conn(0x7f6f3c162150 0x7f6f3c0b6180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6f41679640 1 -- 172.21.15.60:0/1504200992 >> v2:172.21.15.60:3300/0 conn(0x7f6f3c0d4260 msgr2=0x7f6f3c0b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6f41679640 1 --2- 172.21.15.60:0/1504200992 >> v2:172.21.15.60:3300/0 conn(0x7f6f3c0d4260 0x7f6f3c0b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b44003520 con 0x7f6b5c0b60e0 2024-09-12T01:36:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f65f4877640 1 -- 172.21.15.60:0/563695561 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e0037070 con 0x7f65f0161d70 2024-09-12T01:36:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f65f4877640 1 -- 172.21.15.60:0/563695561 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e002ac30 con 0x7f65f0161d70 2024-09-12T01:36:05.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f65f4877640 1 -- 172.21.15.60:0/563695561 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0015a0 con 0x7f65f0161d70 2024-09-12T01:36:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6f41679640 1 -- 172.21.15.60:0/1504200992 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3c0cfc90 con 0x7f6f3c161d70 2024-09-12T01:36:05.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.650+0000 7f6f41e7a640 1 --2- 172.21.15.60:0/1504200992 >> v2:172.21.15.60:3300/0 conn(0x7f6f3c0d4260 0x7f6f3c0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:05.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7fb594931640 1 Processor -- start 2024-09-12T01:36:05.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7fa5f7dd6640 1 -- 172.21.15.60:0/678812903 shutdown_connections 2024-09-12T01:36:05.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7fa5f7dd6640 1 --2- 172.21.15.60:0/678812903 >> v2:172.21.15.60:3300/0 conn(0x7fa5f00b60e0 0x7fa5f0166be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7fa5f7dd6640 1 --2- 172.21.15.60:0/678812903 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f01492f0 0x7fa5f01666a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7fa5f7dd6640 1 -- 172.21.15.60:0/678812903 >> 172.21.15.60:0/678812903 conn(0x7fa5f006d0f0 msgr2=0x7fa5f006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f754ffff640 1 -- 172.21.15.60:0/4277129375 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554037070 con 0x7f75500e28e0 2024-09-12T01:36:05.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7fb15e42e640 1 Processor -- start 2024-09-12T01:36:05.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f6b5bfff640 1 --2- 172.21.15.60:0/1024217716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b5c1492f0 0x7f6b5c1666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f754ffff640 1 -- 172.21.15.60:0/4277129375 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7554032440 con 0x7f75500e28e0 2024-09-12T01:36:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1414648896 0 0) 0x7f6b44003520 con 0x7f6b5c0b60e0 2024-09-12T01:36:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b5c1492f0 msgr2=0x7f6b5c1666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f6b5affd640 1 --2- 172.21.15.60:0/1024217716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b5c1492f0 0x7f6b5c1666a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7fb15e42e640 1 -- start start 2024-09-12T01:36:05.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 >> v2:172.21.15.105:3300/0 conn(0x7f6b5c0b4700 msgr2=0x7f6b5c0b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f6b5affd640 1 --2- 172.21.15.60:0/1024217716 >> v2:172.21.15.105:3300/0 conn(0x7f6b5c0b4700 0x7f6b5c0b4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f754ffff640 1 -- 172.21.15.60:0/4277129375 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554032850 con 0x7f75500e28e0 2024-09-12T01:36:05.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5c073d90 con 0x7f6b5c0b60e0 2024-09-12T01:36:05.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f9292ffd640 1 -- 172.21.15.60:0/61402682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f927c004800 msgr2=0x7f927c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f9292ffd640 1 --2- 172.21.15.60:0/61402682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f927c004800 0x7f927c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f9292ffd640 1 -- 172.21.15.60:0/61402682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f927c0051c0 msgr2=0x7f927c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f9292ffd640 1 --2- 172.21.15.60:0/61402682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f927c0051c0 0x7f927c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f9292ffd640 1 -- 172.21.15.60:0/61402682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92940d3c20 con 0x7f927c0039d0 2024-09-12T01:36:05.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f65f7add640 1 -- 172.21.15.60:0/563695561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65f0161d70 msgr2=0x7f65f00b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f65f7add640 1 --2- 172.21.15.60:0/563695561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65f0161d70 0x7f65f00b3390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097d0 tx=0x7f65e002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f65f7add640 1 -- 172.21.15.60:0/563695561 shutdown_connections 2024-09-12T01:36:05.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f6b50001670 con 0x7f6b5c0b60e0 2024-09-12T01:36:05.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 >> v1:172.21.15.60:6789/0 conn(0x7f6b5c0b60e0 legacy=0x7f6b5c166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f65f7add640 1 --2- 172.21.15.60:0/563695561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65f0161d70 0x7f65f00b3390 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f65f7add640 1 -- 172.21.15.60:0/563695561 >> 172.21.15.60:0/563695561 conn(0x7f65f006c500 msgr2=0x7f65f006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f6b5affd640 1 --2- 172.21.15.60:0/1024217716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b440039b0 0x7f6b44003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7f6b5affd640 1 --2- 172.21.15.60:0/1024217716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b44004800 0x7f6b44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6b5affd640 1 --2- 172.21.15.60:0/1024217716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b440051c0 0x7f6b4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5c070fb0 con 0x7f6b44004800 2024-09-12T01:36:05.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5c071200 con 0x7f6b440039b0 2024-09-12T01:36:05.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4400c060 con 0x7f6b440051c0 2024-09-12T01:36:05.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.651+0000 7fb594931640 1 -- start start 2024-09-12T01:36:05.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6f41679640 1 --2- 172.21.15.60:0/1504200992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3c161d70 0x7f6f3c0b3390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0d5800 tx=0x7f6f3802a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c721be8154407109 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6b60e57640 1 --2- 172.21.15.60:0/1024217716 >> v2:172.21.15.105:3300/0 conn(0x7f6b5c0b4700 0x7f6b5c0b4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:05.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f755e1f1640 1 -- 172.21.15.60:0/4277129375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75500e28e0 msgr2=0x7f7550053070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f755e1f1640 1 --2- 172.21.15.60:0/4277129375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75500e28e0 0x7f7550053070 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7554009870 tx=0x7f755402a230 comp rx=0 tx=0).stop 2024-09-12T01:36:05.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f65f7add640 1 -- 172.21.15.60:0/563695561 shutdown_connections 2024-09-12T01:36:05.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6b5b7fe640 1 --2- 172.21.15.60:0/1024217716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b44004800 0x7f6b44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6b60e57640 1 --2- 172.21.15.60:0/1024217716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b440051c0 0x7f6b4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f65f7add640 1 -- 172.21.15.60:0/563695561 wait complete. 2024-09-12T01:36:05.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7fa5f7dd6640 1 -- 172.21.15.60:0/678812903 shutdown_connections 2024-09-12T01:36:05.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7fa5f7dd6640 1 -- 172.21.15.60:0/678812903 wait complete. 2024-09-12T01:36:05.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6f2ffff640 1 -- 172.21.15.60:0/1504200992 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38037070 con 0x7f6f3c161d70 2024-09-12T01:36:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7fb594931640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb59006c320 0x7fb5901611a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7fb594931640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb590162930 0x7fb590155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6f2ffff640 1 -- 172.21.15.60:0/1504200992 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f38032440 con 0x7f6f3c161d70 2024-09-12T01:36:05.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6f2ffff640 1 -- 172.21.15.60:0/1504200992 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f38032810 con 0x7f6f3c161d70 2024-09-12T01:36:05.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7fb594931640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb590164550 0x7fb5901555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7fb58e59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb59006c320 0x7fb5901611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7fb58e59c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb59006c320 0x7fb5901611a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:53732/0 (socket says 172.21.15.60:53732) 2024-09-12T01:36:05.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb58e59c640 1 -- 172.21.15.60:0/1913968077 learned_addr learned my addr 172.21.15.60:0/1913968077 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb594931640 1 -- 172.21.15.60:0/1913968077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb59006f060 con 0x7fb590164550 2024-09-12T01:36:05.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb594931640 1 -- 172.21.15.60:0/1913968077 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb59006eee0 con 0x7fb590162930 2024-09-12T01:36:05.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb594931640 1 -- 172.21.15.60:0/1913968077 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb5900b4a10 con 0x7fb59006c320 2024-09-12T01:36:05.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb15e42e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb15806e6e0 0x7fb15806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6b5b7fe640 1 -- 172.21.15.60:0/1024217716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b440051c0 msgr2=0x7f6b4400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7f755e1f1640 1 -- 172.21.15.60:0/4277129375 shutdown_connections 2024-09-12T01:36:05.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7f755e1f1640 1 --2- 172.21.15.60:0/4277129375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f755003bc50 0x7f75500535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7f755e1f1640 1 --2- 172.21.15.60:0/4277129375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75500e28e0 0x7f7550053070 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7f755e1f1640 1 -- 172.21.15.60:0/4277129375 >> 172.21.15.60:0/4277129375 conn(0x7f755003a510 msgr2=0x7f755003a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb15e42e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb15815f810 0x7fb158071df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6b5b7fe640 1 --2- 172.21.15.60:0/1024217716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b440051c0 0x7f6b4400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6b5b7fe640 1 -- 172.21.15.60:0/1024217716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b440039b0 msgr2=0x7f6b44003df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:36:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6b5b7fe640 1 --2- 172.21.15.60:0/1024217716 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b440039b0 0x7f6b44003df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.652+0000 7f6b5b7fe640 1 -- 172.21.15.60:0/1024217716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b44003520 con 0x7f6b44004800 2024-09-12T01:36:05.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb58ed9d640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb590164550 0x7fb5901555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7f755e1f1640 1 -- 172.21.15.60:0/4277129375 shutdown_connections 2024-09-12T01:36:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb157fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb15806e6e0 0x7fb15806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb157fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb15806e6e0 0x7fb15806eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48104/0 (socket says 172.21.15.60:48104) 2024-09-12T01:36:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb58e59c640 1 -- 172.21.15.60:0/1913968077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb590162930 msgr2=0x7fb590155080 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:36:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb58e59c640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb590162930 0x7fb590155080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb58e59c640 1 -- 172.21.15.60:0/1913968077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb590164550 msgr2=0x7fb5901555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb58e59c640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb590164550 0x7fb5901555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb58e59c640 1 -- 172.21.15.60:0/1913968077 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5900af300 con 0x7fb59006c320 2024-09-12T01:36:05.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb157fff640 1 -- 172.21.15.60:0/1163763414 learned_addr learned my addr 172.21.15.60:0/1163763414 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb15e42e640 1 -- 172.21.15.60:0/1163763414 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1580b3080 con 0x7fb15813eaa0 2024-09-12T01:36:05.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb15e42e640 1 -- 172.21.15.60:0/1163763414 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb158071960 con 0x7fb15806e6e0 2024-09-12T01:36:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb15e42e640 1 -- 172.21.15.60:0/1163763414 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb15806f000 con 0x7fb15815f810 2024-09-12T01:36:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7f755e1f1640 1 -- 172.21.15.60:0/4277129375 wait complete. 2024-09-12T01:36:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7fb58e59c640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb59006c320 0x7fb5901611a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb58000c430 tx=0x7fb58000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7fb15c9cb640 1 --2- 172.21.15.60:0/1163763414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb15815f810 0x7fb158071df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7fb156ffd640 1 -- 172.21.15.60:0/1163763414 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291250415 0 0) 0x7fb1580b3080 con 0x7fb15813eaa0 2024-09-12T01:36:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7fa5f7dd6640 1 Processor -- start 2024-09-12T01:36:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7fb57effd640 1 -- 172.21.15.60:0/1913968077 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb580011790 con 0x7fb59006c320 2024-09-12T01:36:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7fb57effd640 1 -- 172.21.15.60:0/1913968077 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb580017070 con 0x7fb59006c320 2024-09-12T01:36:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7fb57effd640 1 -- 172.21.15.60:0/1913968077 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb580011bb0 con 0x7fb59006c320 2024-09-12T01:36:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7fb594931640 1 -- 172.21.15.60:0/1913968077 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5900af5e0 con 0x7fb59006c320 2024-09-12T01:36:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f6f438dd640 1 -- 172.21.15.60:0/1504200992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3c161d70 msgr2=0x7f6f3c0b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f6f438dd640 1 --2- 172.21.15.60:0/1504200992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3c161d70 0x7f6f3c0b3390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0d5800 tx=0x7f6f3802a130 comp rx=0 tx=0).stop 2024-09-12T01:36:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f65f7add640 1 Processor -- start 2024-09-12T01:36:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f6f438dd640 1 -- 172.21.15.60:0/1504200992 shutdown_connections 2024-09-12T01:36:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7f9292ffd640 1 --2- 172.21.15.60:0/61402682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c0039d0 0x7f927c003e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9284009c10 tx=0x7f927c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7a9e43866fff7a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9284036070 con 0x7f927c0039d0 2024-09-12T01:36:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9284031400 con 0x7f927c0039d0 2024-09-12T01:36:05.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.653+0000 7f9291ffb640 1 -- 172.21.15.60:0/61402682 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92840097e0 con 0x7f927c0039d0 2024-09-12T01:36:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f9299968640 1 -- 172.21.15.60:0/61402682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c0039d0 msgr2=0x7f927c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f9299968640 1 --2- 172.21.15.60:0/61402682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f927c0039d0 0x7f927c003e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9284009c10 tx=0x7f927c005830 comp rx=0 tx=0).stop 2024-09-12T01:36:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f92937fe640 1 -- 172.21.15.60:0/61402682 reap_dead start 2024-09-12T01:36:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f9299968640 1 -- 172.21.15.60:0/61402682 shutdown_connections 2024-09-12T01:36:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f9299968640 1 -- 172.21.15.60:0/61402682 >> 172.21.15.60:0/61402682 conn(0x7f92940d1360 msgr2=0x7f92940d1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f9299968640 1 -- 172.21.15.60:0/61402682 shutdown_connections 2024-09-12T01:36:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f9299968640 1 -- 172.21.15.60:0/61402682 wait complete. 2024-09-12T01:36:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f6f438dd640 1 --2- 172.21.15.60:0/1504200992 >> v2:172.21.15.105:3300/0 conn(0x7f6f3c162150 0x7f6f3c0b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f6f438dd640 1 --2- 172.21.15.60:0/1504200992 >> v2:172.21.15.60:3300/0 conn(0x7f6f3c0d4260 0x7f6f3c0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7fb157fff640 1 -- 172.21.15.60:0/1163763414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb15815f810 msgr2=0x7fb158071df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7fb157fff640 1 --2- 172.21.15.60:0/1163763414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb15815f810 0x7fb158071df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7fb157fff640 1 -- 172.21.15.60:0/1163763414 >> v1:172.21.15.60:6789/0 conn(0x7fb15813eaa0 legacy=0x7fb15815f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7fb157fff640 1 -- 172.21.15.60:0/1163763414 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb158071050 con 0x7fb15806e6e0 2024-09-12T01:36:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f6f438dd640 1 --2- 172.21.15.60:0/1504200992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3c161d70 0x7f6f3c0b3390 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7f755e1f1640 1 Processor -- start 2024-09-12T01:36:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7f755e1f1640 1 -- start start 2024-09-12T01:36:05.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7f6b5b7fe640 1 --2- 172.21.15.60:0/1024217716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b44004800 0x7f6b44004c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6b50007fd0 tx=0x7f6b44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd52292e44ef273 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7f6f438dd640 1 -- 172.21.15.60:0/1504200992 >> 172.21.15.60:0/1504200992 conn(0x7f6f3c06c500 msgr2=0x7f6f3c06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7f6f438dd640 1 -- 172.21.15.60:0/1504200992 shutdown_connections 2024-09-12T01:36:05.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7f6f438dd640 1 -- 172.21.15.60:0/1504200992 wait complete. 2024-09-12T01:36:05.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50007ca0 con 0x7f6b44004800 2024-09-12T01:36:05.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f9299968640 1 Processor -- start 2024-09-12T01:36:05.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f9299968640 1 -- start start 2024-09-12T01:36:05.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7f65f7add640 1 -- start start 2024-09-12T01:36:05.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f65f7add640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65f00b6890 0x7f65f0157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f65f7add640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65f0161d70 0x7f65f00b9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f65f7add640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65f0162150 0x7f65f00b9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f65f5078640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65f0161d70 0x7f65f00b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f65f5078640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65f0161d70 0x7f65f00b9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48132/0 (socket says 172.21.15.60:48132) 2024-09-12T01:36:05.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f65f5078640 1 -- 172.21.15.60:0/3109128004 learned_addr learned my addr 172.21.15.60:0/3109128004 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f65f607a640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65f0162150 0x7f65f00b9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f65f00d43e0 con 0x7f65f00b6890 2024-09-12T01:36:05.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f65f00d4260 con 0x7f65f0161d70 2024-09-12T01:36:05.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f65f00d4560 con 0x7f65f0162150 2024-09-12T01:36:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.654+0000 7fa5f7dd6640 1 -- start start 2024-09-12T01:36:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7fa5f7dd6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f00b60e0 0x7fa5f00c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7fa5f7dd6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f01492f0 0x7fa5f0141030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f7dd6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5f0167120 0x7fa5f01f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f7dd6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f00b5890 con 0x7fa5f0167120 2024-09-12T01:36:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f7dd6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f00b5710 con 0x7fa5f01492f0 2024-09-12T01:36:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f7dd6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f0073170 con 0x7fa5f00b60e0 2024-09-12T01:36:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f5b72640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f00b60e0 0x7fa5f00c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f6373640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5f0167120 0x7fa5f01f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f5371640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f01492f0 0x7fa5f0141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f6373640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5f0167120 0x7fa5f01f8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49076/0 (socket says 172.21.15.60:49076) 2024-09-12T01:36:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f6373640 1 -- 172.21.15.60:0/3419445675 learned_addr learned my addr 172.21.15.60:0/3419445675 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f6373640 1 -- 172.21.15.60:0/3419445675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f00b60e0 msgr2=0x7fa5f00c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f6373640 1 --2- 172.21.15.60:0/3419445675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5f00b60e0 0x7fa5f00c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f6373640 1 -- 172.21.15.60:0/3419445675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f01492f0 msgr2=0x7fa5f0141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f6373640 1 --2- 172.21.15.60:0/3419445675 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5f01492f0 0x7fa5f0141030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fa5f6373640 1 -- 172.21.15.60:0/3419445675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f0162350 con 0x7fa5f0167120 2024-09-12T01:36:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7fa5f6373640 1 --2- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5f0167120 0x7fa5f01f8b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800ca50 tx=0x7fa5e800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7fa5e67fc640 1 -- 172.21.15.60:0/3419445675 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8017070 con 0x7fa5f0167120 2024-09-12T01:36:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7fa5f7dd6640 1 -- 172.21.15.60:0/3419445675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f0141a10 con 0x7fa5f0167120 2024-09-12T01:36:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7f755e1f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755003bc50 0x7f75500e3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7f755d1ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755003bc50 0x7f75500e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7f755d1ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755003bc50 0x7f75500e3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49088/0 (socket says 172.21.15.60:49088) 2024-09-12T01:36:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7f755d1ef640 1 -- 172.21.15.60:0/3822480326 learned_addr learned my addr 172.21.15.60:0/3822480326 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7f755e1f1640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7550057820 0x7f75500d9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7f755e1f1640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75500e28e0 0x7f75500da360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7f755c9ee640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7550057820 0x7f75500d9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f75500e2cc0 con 0x7f755003bc50 2024-09-12T01:36:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75500568b0 con 0x7f75500e28e0 2024-09-12T01:36:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f755d9f0640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75500e28e0 0x7f75500da360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f75500e2e40 con 0x7f7550057820 2024-09-12T01:36:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fb594931640 1 -- 172.21.15.60:0/1913968077 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5900afba0 con 0x7fb59006c320 2024-09-12T01:36:05.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fb57effd640 1 -- 172.21.15.60:0/1913968077 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb58001c460 con 0x7fb59006c320 2024-09-12T01:36:05.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7fb57effd640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb57006be80 0x7fb57006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f6f438dd640 1 Processor -- start 2024-09-12T01:36:05.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f6f438dd640 1 -- start start 2024-09-12T01:36:05.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b50005ad0 con 0x7f6b44004800 2024-09-12T01:36:05.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.655+0000 7f6b5affd640 1 -- 172.21.15.60:0/1024217716 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50007070 con 0x7f6b44004800 2024-09-12T01:36:05.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7fa5f7dd6640 1 -- 172.21.15.60:0/3419445675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f0141fd0 con 0x7fa5f0167120 2024-09-12T01:36:05.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7fb58dd9b640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb57006be80 0x7fb57006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7fb594931640 1 -- 172.21.15.60:0/1913968077 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb590162d10 con 0x7fb59006c320 2024-09-12T01:36:05.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.656+0000 7fb157fff640 1 --2- 172.21.15.60:0/1163763414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb15806e6e0 0x7fb15806eac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb158071ae0 tx=0x7fb15002c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=555f7d080a969a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7fb156ffd640 1 -- 172.21.15.60:0/1163763414 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150039070 con 0x7fb15806e6e0 2024-09-12T01:36:05.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7fb156ffd640 1 -- 172.21.15.60:0/1163763414 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb150034680 con 0x7fb15806e6e0 2024-09-12T01:36:05.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7fb156ffd640 1 -- 172.21.15.60:0/1163763414 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb150034a50 con 0x7fb15806e6e0 2024-09-12T01:36:05.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7fb57effd640 1 -- 172.21.15.60:0/1913968077 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb58008f060 con 0x7fb59006c320 2024-09-12T01:36:05.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7fb57effd640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] conn(0x7fb570074020 0x7fb570076440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7fb57effd640 1 -- 172.21.15.60:0/1913968077 --> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb570076af0 con 0x7fb570074020 2024-09-12T01:36:05.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f755d1ef640 1 -- 172.21.15.60:0/3822480326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7550057820 msgr2=0x7f75500d9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f755d1ef640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7550057820 0x7f75500d9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f755d1ef640 1 -- 172.21.15.60:0/3822480326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75500e28e0 msgr2=0x7f75500da360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f755d1ef640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75500e28e0 0x7f75500da360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f755d1ef640 1 -- 172.21.15.60:0/3822480326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75500e3b10 con 0x7f755003bc50 2024-09-12T01:36:05.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7fb57effd640 1 -- 172.21.15.60:0/1913968077 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb580054950 con 0x7fb59006c320 2024-09-12T01:36:05.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f9299968640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9294163140 0x7f929406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f9299968640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9294070490 0x7f92940b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f9299968640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92940b6030 0x7f92941fb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f9299968640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f92940b3160 con 0x7f9294070490 2024-09-12T01:36:05.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f9299968640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f92940b8240 con 0x7f92940b6030 2024-09-12T01:36:05.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f9299968640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f92940b32e0 con 0x7f9294163140 2024-09-12T01:36:05.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7fb58ed9d640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] conn(0x7fb570074020 0x7fb570076440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7fb58dd9b640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb57006be80 0x7fb57006e340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb584034000 tx=0x7fb58402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f755d9f0640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75500e28e0 0x7f75500da360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:05.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f6b628ba640 1 -- 172.21.15.60:0/1024217716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b44004800 msgr2=0x7f6b44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f92937fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92940b6030 0x7f92941fb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f92937fe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92940b6030 0x7f92941fb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48148/0 (socket says 172.21.15.60:48148) 2024-09-12T01:36:05.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f92937fe640 1 -- 172.21.15.60:0/3828141367 learned_addr learned my addr 172.21.15.60:0/3828141367 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f6b628ba640 1 --2- 172.21.15.60:0/1024217716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b44004800 0x7f6b44004c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6b50007fd0 tx=0x7f6b44005830 comp rx=0 tx=0).stop 2024-09-12T01:36:05.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.657+0000 7f6b60e57640 1 -- 172.21.15.60:0/1024217716 reap_dead start 2024-09-12T01:36:05.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7fb15e42e640 1 -- 172.21.15.60:0/1163763414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb15806e6e0 msgr2=0x7fb15806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6b628ba640 1 -- 172.21.15.60:0/1024217716 shutdown_connections 2024-09-12T01:36:05.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6b628ba640 1 -- 172.21.15.60:0/1024217716 >> 172.21.15.60:0/1024217716 conn(0x7f6b5c06d0f0 msgr2=0x7f6b5c06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7fb15e42e640 1 --2- 172.21.15.60:0/1163763414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb15806e6e0 0x7fb15806eac0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb158071ae0 tx=0x7fb15002c890 comp rx=0 tx=0).stop 2024-09-12T01:36:05.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.658+0000 7f65f5879640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65f00b6890 0x7f65f0157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6f438dd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f3c0d4260 0x7f6f3c15e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6b628ba640 1 -- 172.21.15.60:0/1024217716 shutdown_connections 2024-09-12T01:36:05.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6b628ba640 1 -- 172.21.15.60:0/1024217716 wait complete. 2024-09-12T01:36:05.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7fb58ed9d640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] conn(0x7fb570074020 0x7fb570076440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f92937fe640 1 -- 172.21.15.60:0/3828141367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9294163140 msgr2=0x7f929406ff50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:36:05.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f92937fe640 1 --2- 172.21.15.60:0/3828141367 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9294163140 0x7f929406ff50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7fb15e42e640 1 -- 172.21.15.60:0/1163763414 shutdown_connections 2024-09-12T01:36:05.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7fb15e42e640 1 --2- 172.21.15.60:0/1163763414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb15815f810 0x7fb158071df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7fb15e42e640 1 --2- 172.21.15.60:0/1163763414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb15806e6e0 0x7fb15806eac0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7fb15e42e640 1 -- 172.21.15.60:0/1163763414 >> 172.21.15.60:0/1163763414 conn(0x7fb1580d03e0 msgr2=0x7fb1580d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f92937fe640 1 -- 172.21.15.60:0/3828141367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9294070490 msgr2=0x7f92940b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f92937fe640 1 --2- 172.21.15.60:0/3828141367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9294070490 0x7f92940b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f92937fe640 1 -- 172.21.15.60:0/3828141367 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9294070a10 con 0x7f92940b6030 2024-09-12T01:36:05.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7fb15e42e640 1 -- 172.21.15.60:0/1163763414 shutdown_connections 2024-09-12T01:36:05.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6f438dd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c161d70 0x7f6f3c157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7fa5e67fc640 1 -- 172.21.15.60:0/3419445675 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e800ab50 con 0x7fa5f0167120 2024-09-12T01:36:05.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6f41679640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f3c0d4260 0x7f6f3c15e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7fb15e42e640 1 -- 172.21.15.60:0/1163763414 wait complete. 2024-09-12T01:36:05.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6f41679640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f3c0d4260 0x7f6f3c15e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49114/0 (socket says 172.21.15.60:49114) 2024-09-12T01:36:05.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f92937fe640 1 --2- 172.21.15.60:0/3828141367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92940b6030 0x7f92941fb980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f929406d390 tx=0x7f928c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6f41679640 1 -- 172.21.15.60:0/2017416215 learned_addr learned my addr 172.21.15.60:0/2017416215 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6f40e78640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c161d70 0x7f6f3c157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6f438dd640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3c162150 0x7f6f3c1f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f927bfff640 1 -- 172.21.15.60:0/3828141367 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c007c70 con 0x7f92940b6030 2024-09-12T01:36:05.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f9299968640 1 -- 172.21.15.60:0/3828141367 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9294070cf0 con 0x7f92940b6030 2024-09-12T01:36:05.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c0ceed0 con 0x7f6f3c0d4260 2024-09-12T01:36:05.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6f41e7a640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3c162150 0x7f6f3c1f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f9299968640 1 -- 172.21.15.60:0/3828141367 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92940712b0 con 0x7f92940b6030 2024-09-12T01:36:05.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.659+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3c0ced50 con 0x7f6f3c161d70 2024-09-12T01:36:05.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6f3c0cf050 con 0x7f6f3c162150 2024-09-12T01:36:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f927bfff640 1 -- 172.21.15.60:0/3828141367 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928c019070 con 0x7f92940b6030 2024-09-12T01:36:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f927bfff640 1 -- 172.21.15.60:0/3828141367 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c014630 con 0x7f92940b6030 2024-09-12T01:36:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f65f607a640 1 -- 172.21.15.60:0/3109128004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65f0161d70 msgr2=0x7f65f00b9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f65f607a640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f65f0161d70 0x7f65f00b9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f65f607a640 1 -- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65f00b6890 msgr2=0x7f65f0157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f65f607a640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65f00b6890 0x7f65f0157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f65f607a640 1 -- 172.21.15.60:0/3109128004 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f0159e80 con 0x7f65f0162150 2024-09-12T01:36:05.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7fb57effd640 1 -- 172.21.15.60:0/1913968077 <== osd.4 v2:172.21.15.105:6808/3941434125 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb570076af0 con 0x7fb570074020 2024-09-12T01:36:05.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f6f40e78640 1 -- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3c162150 msgr2=0x7f6f3c1f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f6f40e78640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f3c162150 0x7f6f3c1f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7fa5e67fc640 1 -- 172.21.15.60:0/3419445675 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8012400 con 0x7fa5f0167120 2024-09-12T01:36:05.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f6f40e78640 1 -- 172.21.15.60:0/2017416215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f3c0d4260 msgr2=0x7f6f3c15e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f65f607a640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65f0162150 0x7f65f00b9860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f65f008dba0 tx=0x7f65e800cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f6f40e78640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f3c0d4260 0x7f6f3c15e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f6f40e78640 1 -- 172.21.15.60:0/2017416215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f3c158210 con 0x7f6f3c161d70 2024-09-12T01:36:05.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.660+0000 7f6f40e78640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c161d70 0x7f6f3c157cd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c162570 tx=0x7f6f3000b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f9299968640 1 -- 172.21.15.60:0/3828141367 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9274001030 con 0x7f92940b6030 2024-09-12T01:36:05.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f6f2dffb640 1 -- 172.21.15.60:0/2017416215 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f30015020 con 0x7f6f3c161d70 2024-09-12T01:36:05.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f65e67fc640 1 -- 172.21.15.60:0/3109128004 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e8003b70 con 0x7f65f0162150 2024-09-12T01:36:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f6f2dffb640 1 -- 172.21.15.60:0/2017416215 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f30011830 con 0x7f6f3c161d70 2024-09-12T01:36:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f3c1f4a20 con 0x7f6f3c161d70 2024-09-12T01:36:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f6f2dffb640 1 -- 172.21.15.60:0/2017416215 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f30011be0 con 0x7f6f3c161d70 2024-09-12T01:36:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f6b628ba640 1 Processor -- start 2024-09-12T01:36:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f00ca4c0 con 0x7f65f0162150 2024-09-12T01:36:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f00caa80 con 0x7f65f0162150 2024-09-12T01:36:05.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f65e67fc640 1 -- 172.21.15.60:0/3109128004 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65e8003d10 con 0x7f65f0162150 2024-09-12T01:36:05.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f755d1ef640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755003bc50 0x7f75500e3130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f75540090b0 tx=0x7f75540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f3c1f4cc0 con 0x7f6f3c161d70 2024-09-12T01:36:05.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7f6b628ba640 1 -- start start 2024-09-12T01:36:05.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7fb15e42e640 1 Processor -- start 2024-09-12T01:36:05.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7fb15e42e640 1 -- start start 2024-09-12T01:36:05.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.662+0000 7f927bfff640 1 -- 172.21.15.60:0/3828141367 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f928c0147d0 con 0x7f92940b6030 2024-09-12T01:36:05.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.662+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f3c0b3390 con 0x7f6f3c161d70 2024-09-12T01:36:05.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.662+0000 7f65e67fc640 1 -- 172.21.15.60:0/3109128004 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e80052f0 con 0x7f65f0162150 2024-09-12T01:36:05.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.661+0000 7fa5e67fc640 1 -- 172.21.15.60:0/3419445675 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa5e801a070 con 0x7fa5f0167120 2024-09-12T01:36:05.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.662+0000 7fa5dbfff640 1 -- 172.21.15.60:0/3419445675 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa5d0001030 con 0x7fa5f0167120 2024-09-12T01:36:05.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.662+0000 7f927bfff640 1 --2- 172.21.15.60:0/3828141367 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f928006be30 0x7f928006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7f927bfff640 1 -- 172.21.15.60:0/3828141367 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f928c08b330 con 0x7f92940b6030 2024-09-12T01:36:05.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7f9292ffd640 1 --2- 172.21.15.60:0/3828141367 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f928006be30 0x7f928006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7f927bfff640 1 --2- 172.21.15.60:0/3828141367 >> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] conn(0x7f9280074050 0x7f9280076470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7f927bfff640 1 -- 172.21.15.60:0/3828141367 --> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9280076b20 con 0x7f9280074050 2024-09-12T01:36:05.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7f927bfff640 1 -- 172.21.15.60:0/3828141367 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f928c092050 con 0x7f92940b6030 2024-09-12T01:36:05.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7f92927fc640 1 --2- 172.21.15.60:0/3828141367 >> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] conn(0x7f9280074050 0x7f9280076470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7f754dffb640 1 -- 172.21.15.60:0/3822480326 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554041020 con 0x7f755003bc50 2024-09-12T01:36:05.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7f754dffb640 1 -- 172.21.15.60:0/3822480326 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7554030a70 con 0x7f755003bc50 2024-09-12T01:36:05.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75500e3df0 con 0x7f755003bc50 2024-09-12T01:36:05.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7f9292ffd640 1 --2- 172.21.15.60:0/3828141367 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f928006be30 0x7f928006e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9284033000 tx=0x7f9284008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7fa5e67fc640 1 --2- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa5d406bf30 0x7fa5d406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7f754dffb640 1 -- 172.21.15.60:0/3822480326 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7554037040 con 0x7f755003bc50 2024-09-12T01:36:05.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.663+0000 7f6b628ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b44004800 0x7f6b5c158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75500e43b0 con 0x7f755003bc50 2024-09-12T01:36:05.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7fa5f5b72640 1 --2- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa5d406bf30 0x7fa5d406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7fa5e67fc640 1 -- 172.21.15.60:0/3419445675 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa5e808ab60 con 0x7fa5f0167120 2024-09-12T01:36:05.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7f6b628ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b5c141c30 0x7f6b5c0c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7f92927fc640 1 --2- 172.21.15.60:0/3828141367 >> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] conn(0x7f9280074050 0x7f9280076470 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7f6b5bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b44004800 0x7f6b5c158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7f6b5bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b44004800 0x7f6b5c158010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:53786/0 (socket says 172.21.15.60:53786) 2024-09-12T01:36:05.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7fa5e67fc640 1 --2- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] conn(0x7fa5d40740d0 0x7fa5d40764f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7fb15e42e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb15806e6e0 0x7fb1581547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7fb15e42e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb15813eaa0 0x7fb1580b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7fb15e42e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb15815f810 0x7fb15813adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7fb15e42e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb15815fe30 con 0x7fb15806e6e0 2024-09-12T01:36:05.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7fb15e42e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb1580715f0 con 0x7fb15815f810 2024-09-12T01:36:05.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7fb15e42e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb158072330 con 0x7fb15813eaa0 2024-09-12T01:36:05.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7fa5e67fc640 1 -- 172.21.15.60:0/3419445675 --> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5e800ab50 con 0x7fa5d40740d0 2024-09-12T01:36:05.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7fa5e67fc640 1 -- 172.21.15.60:0/3419445675 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fa5e8091050 con 0x7fa5f0167120 2024-09-12T01:36:05.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7fb1577fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb15813eaa0 0x7fb1580b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7fa5f5371640 1 --2- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] conn(0x7fa5d40740d0 0x7fa5d40764f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.664+0000 7f6f2dffb640 1 -- 172.21.15.60:0/2017416215 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f30018020 con 0x7f6f3c161d70 2024-09-12T01:36:05.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f927bfff640 1 -- 172.21.15.60:0/3828141367 <== osd.0 v2:172.21.15.60:6818/1570261314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9280076b20 con 0x7f9280074050 2024-09-12T01:36:05.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6f2dffb640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f2006be30 0x7f6f2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6f2dffb640 1 -- 172.21.15.60:0/2017416215 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6f3008abd0 con 0x7f6f3c161d70 2024-09-12T01:36:05.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6f2dffb640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] conn(0x7f6f20074030 0x7f6f20076450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6f2dffb640 1 -- 172.21.15.60:0/2017416215 --> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f3001fe80 con 0x7f6f20074030 2024-09-12T01:36:05.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6b628ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b5c1420b0 0x7f6b5c0c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6b628ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5c167470 con 0x7f6b5c141c30 2024-09-12T01:36:05.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6b628ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5c1672f0 con 0x7f6b5c1420b0 2024-09-12T01:36:05.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6b628ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6b5c1666a0 con 0x7f6b44004800 2024-09-12T01:36:05.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6b5b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b5c141c30 0x7f6b5c0c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6b5bfff640 1 -- 172.21.15.60:0/1160576866 learned_addr learned my addr 172.21.15.60:0/1160576866 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6f2dffb640 1 -- 172.21.15.60:0/2017416215 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6f30055110 con 0x7f6f3c161d70 2024-09-12T01:36:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7fb1577fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb15813eaa0 0x7fb1580b5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:53798/0 (socket says 172.21.15.60:53798) 2024-09-12T01:36:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7fb1577fe640 1 -- 172.21.15.60:0/3899373607 learned_addr learned my addr 172.21.15.60:0/3899373607 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7fb15c9cb640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb15815f810 0x7fb15813adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6f41e7a640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] conn(0x7f6f20074030 0x7f6f20076450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7fa5f5b72640 1 --2- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa5d406bf30 0x7fa5d406e3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec034000 tx=0x7fa5ec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7fb157fff640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb15806e6e0 0x7fb1581547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7550008850 con 0x7f755003bc50 2024-09-12T01:36:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f65d8001030 con 0x7f65f0162150 2024-09-12T01:36:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6b5b7fe640 1 -- 172.21.15.60:0/1160576866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b44004800 msgr2=0x7f6b5c158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6b5b7fe640 1 --2- 172.21.15.60:0/1160576866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b44004800 0x7f6b5c158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6b5b7fe640 1 -- 172.21.15.60:0/1160576866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b5c1420b0 msgr2=0x7f6b5c0c7160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:36:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6b5b7fe640 1 --2- 172.21.15.60:0/1160576866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b5c1420b0 0x7f6b5c0c7160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.665+0000 7f6b5b7fe640 1 -- 172.21.15.60:0/1160576866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5c142610 con 0x7f6b5c141c30 2024-09-12T01:36:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7fb15c9cb640 1 -- 172.21.15.60:0/3899373607 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb15813eaa0 msgr2=0x7fb1580b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7f6f41679640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f2006be30 0x7f6f2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7f65e67fc640 1 -- 172.21.15.60:0/3109128004 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f65e80054d0 con 0x7f65f0162150 2024-09-12T01:36:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7f6f41e7a640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] conn(0x7f6f20074030 0x7f6f20076450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7fa5f5371640 1 --2- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] conn(0x7fa5d40740d0 0x7fa5d40764f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7f6b5b7fe640 1 --2- 172.21.15.60:0/1160576866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b5c141c30 0x7f6b5c0c6c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6b5002f000 tx=0x7f6b50001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.667+0000 7f65e67fc640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f65d406bf30 0x7f65d406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7fb15c9cb640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb15813eaa0 0x7fb1580b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7fb15c9cb640 1 -- 172.21.15.60:0/3899373607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb15806e6e0 msgr2=0x7fb1581547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7fb15c9cb640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb15806e6e0 0x7fb1581547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.666+0000 7fb15c9cb640 1 -- 172.21.15.60:0/3899373607 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1580b5650 con 0x7fb15815f810 2024-09-12T01:36:05.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.667+0000 7f65e67fc640 1 -- 172.21.15.60:0/3109128004 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f65e808aa80 con 0x7f65f0162150 2024-09-12T01:36:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.667+0000 7f6f41679640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f2006be30 0x7f6f2006e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009560 tx=0x7f6f3802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.667+0000 7f65e67fc640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] conn(0x7f65d4074150 0x7f65d4076570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.667+0000 7f65e67fc640 1 -- 172.21.15.60:0/3109128004 --> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65e8010e50 con 0x7f65d4074150 2024-09-12T01:36:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.667+0000 7f754dffb640 1 -- 172.21.15.60:0/3822480326 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7554044020 con 0x7f755003bc50 2024-09-12T01:36:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.667+0000 7f6f2dffb640 1 -- 172.21.15.60:0/2017416215 <== osd.6 v2:172.21.15.105:6800/48914195 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f3001fe80 con 0x7f6f20074030 2024-09-12T01:36:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.667+0000 7f65e67fc640 1 -- 172.21.15.60:0/3109128004 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f65e808ce60 con 0x7f65f0162150 2024-09-12T01:36:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.667+0000 7f6b58ff9640 1 -- 172.21.15.60:0/1160576866 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b50037040 con 0x7f6b5c141c30 2024-09-12T01:36:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.667+0000 7f6b58ff9640 1 -- 172.21.15.60:0/1160576866 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b50041070 con 0x7f6b5c141c30 2024-09-12T01:36:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.668+0000 7f65f5879640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f65d406bf30 0x7f65d406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.668+0000 7fa5e67fc640 1 -- 172.21.15.60:0/3419445675 <== osd.2 v2:172.21.15.60:6802/939860136 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5e800ab50 con 0x7fa5d40740d0 2024-09-12T01:36:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.668+0000 7f754dffb640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f753c06be30 0x7f753c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.668+0000 7f754dffb640 1 -- 172.21.15.60:0/3822480326 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f75540aba80 con 0x7f755003bc50 2024-09-12T01:36:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.668+0000 7f754dffb640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] conn(0x7f753c074030 0x7f753c076450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.668+0000 7f754dffb640 1 -- 172.21.15.60:0/3822480326 --> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f753c076b00 con 0x7f753c074030 2024-09-12T01:36:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.668+0000 7f754dffb640 1 -- 172.21.15.60:0/3822480326 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f75540b02c0 con 0x7f755003bc50 2024-09-12T01:36:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.668+0000 7fb15c9cb640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb15815f810 0x7fb15813adc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00d490 tx=0x7fb14c00d950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.668+0000 7fb154ff9640 1 -- 172.21.15.60:0/3899373607 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c004020 con 0x7fb15815f810 2024-09-12T01:36:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.668+0000 7fb154ff9640 1 -- 172.21.15.60:0/3899373607 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14c0041e0 con 0x7fb15815f810 2024-09-12T01:36:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.667+0000 7f6b58ff9640 1 -- 172.21.15.60:0/1160576866 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b500049e0 con 0x7f6b5c141c30 2024-09-12T01:36:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.667+0000 7f6b628ba640 1 -- 172.21.15.60:0/1160576866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5c1428f0 con 0x7f6b5c141c30 2024-09-12T01:36:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.668+0000 7f6b628ba640 1 -- 172.21.15.60:0/1160576866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b5c142eb0 con 0x7f6b5c141c30 2024-09-12T01:36:05.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.669+0000 7f755c9ee640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f753c06be30 0x7f753c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.669+0000 7f65f5879640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f65d406bf30 0x7f65d406e3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65e0034000 tx=0x7f65e002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.669+0000 7f65f5078640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] conn(0x7f65d4074150 0x7f65d4076570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.669+0000 7f6b628ba640 1 -- 172.21.15.60:0/1160576866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b5c166a60 con 0x7f6b5c141c30 2024-09-12T01:36:05.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.669+0000 7f755d9f0640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] conn(0x7f753c074030 0x7f753c076450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.669+0000 7f65f5078640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] conn(0x7f65d4074150 0x7f65d4076570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.669+0000 7fb15e42e640 1 -- 172.21.15.60:0/3899373607 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1580b5930 con 0x7fb15815f810 2024-09-12T01:36:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.669+0000 7fb15e42e640 1 -- 172.21.15.60:0/3899373607 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1580b4220 con 0x7fb15815f810 2024-09-12T01:36:05.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.670+0000 7fb15e42e640 1 -- 172.21.15.60:0/3899373607 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb15806eac0 con 0x7fb15815f810 2024-09-12T01:36:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.670+0000 7f6b58ff9640 1 -- 172.21.15.60:0/1160576866 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b50004b80 con 0x7f6b5c141c30 2024-09-12T01:36:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.671+0000 7f755c9ee640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f753c06be30 0x7f753c06e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75500e1770 tx=0x7f7548008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.671+0000 7f65e67fc640 1 -- 172.21.15.60:0/3109128004 <== osd.1 v2:172.21.15.60:6810/1439609768 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f65e8010e50 con 0x7f65d4074150 2024-09-12T01:36:05.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.671+0000 7f755d9f0640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] conn(0x7f753c074030 0x7f753c076450 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.671+0000 7f6b58ff9640 1 --2- 172.21.15.60:0/1160576866 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b4806be30 0x7f6b4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.671+0000 7f6b58ff9640 1 -- 172.21.15.60:0/1160576866 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6b500a9f80 con 0x7f6b5c141c30 2024-09-12T01:36:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.671+0000 7f6b5bfff640 1 --2- 172.21.15.60:0/1160576866 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b4806be30 0x7f6b4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.671+0000 7f6b58ff9640 1 --2- 172.21.15.60:0/1160576866 >> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] conn(0x7f6b48073fd0 0x7f6b480763f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.671+0000 7f6b58ff9640 1 -- 172.21.15.60:0/1160576866 --> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b48076aa0 con 0x7f6b48073fd0 2024-09-12T01:36:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.671+0000 7f6b58ff9640 1 -- 172.21.15.60:0/1160576866 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f6b500af060 con 0x7f6b5c141c30 2024-09-12T01:36:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.671+0000 7fb154ff9640 1 -- 172.21.15.60:0/3899373607 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0043d0 con 0x7fb15815f810 2024-09-12T01:36:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.672+0000 7fb154ff9640 1 -- 172.21.15.60:0/3899373607 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb14c01b020 con 0x7fb15815f810 2024-09-12T01:36:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.672+0000 7f6b5bfff640 1 --2- 172.21.15.60:0/1160576866 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b4806be30 0x7f6b4806e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0c6610 tx=0x7f6b5400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.672+0000 7f6b60e57640 1 --2- 172.21.15.60:0/1160576866 >> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] conn(0x7f6b48073fd0 0x7f6b480763f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.672+0000 7f754dffb640 1 -- 172.21.15.60:0/3822480326 <== osd.3 v2:172.21.15.60:6826/3508972949 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f753c076b00 con 0x7f753c074030 2024-09-12T01:36:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.672+0000 7fb154ff9640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb14406bf30 0x7fb14406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.672+0000 7fb154ff9640 1 -- 172.21.15.60:0/3899373607 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb14c08b3a0 con 0x7fb15815f810 2024-09-12T01:36:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.673+0000 7fb154ff9640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] conn(0x7fb144074150 0x7fb144076570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.673+0000 7fb154ff9640 1 -- 172.21.15.60:0/3899373607 --> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb14c0041e0 con 0x7fb144074150 2024-09-12T01:36:05.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.673+0000 7fb154ff9640 1 -- 172.21.15.60:0/3899373607 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fb14c08b790 con 0x7fb15815f810 2024-09-12T01:36:05.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.673+0000 7fb157fff640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb14406bf30 0x7fb14406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.673+0000 7fb1577fe640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] conn(0x7fb144074150 0x7fb144076570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:05.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.673+0000 7f6b60e57640 1 --2- 172.21.15.60:0/1160576866 >> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] conn(0x7f6b48073fd0 0x7f6b480763f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.673+0000 7fb157fff640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb14406bf30 0x7fb14406e3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb150036000 tx=0x7fb150009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.673+0000 7fb1577fe640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] conn(0x7fb144074150 0x7fb144076570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:05.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.674+0000 7f6b58ff9640 1 -- 172.21.15.60:0/1160576866 <== osd.7 v2:172.21.15.105:6824/2648783557 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b48076aa0 con 0x7f6b48073fd0 2024-09-12T01:36:05.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.674+0000 7fb154ff9640 1 -- 172.21.15.60:0/3899373607 <== osd.5 v2:172.21.15.105:6816/16466051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb14c0041e0 con 0x7fb144074150 2024-09-12T01:36:05.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.689+0000 7fb594931640 1 -- 172.21.15.60:0/1913968077 --> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb59006e7b0 con 0x7fb570074020 2024-09-12T01:36:05.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.690+0000 7fb57effd640 1 -- 172.21.15.60:0/1913968077 <== osd.4 v2:172.21.15.105:6808/3941434125 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb59006e7b0 con 0x7fb570074020 2024-09-12T01:36:05.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.690+0000 7fb57cff9640 1 -- 172.21.15.60:0/1913968077 >> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] conn(0x7fb570074020 msgr2=0x7fb570076440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.690+0000 7fb57cff9640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] conn(0x7fb570074020 0x7fb570076440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.691+0000 7fb57cff9640 1 -- 172.21.15.60:0/1913968077 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb57006be80 msgr2=0x7fb57006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.691+0000 7fb57cff9640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb57006be80 0x7fb57006e340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb584034000 tx=0x7fb58402e000 comp rx=0 tx=0).stop 2024-09-12T01:36:05.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.691+0000 7fb57cff9640 1 -- 172.21.15.60:0/1913968077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb59006c320 msgr2=0x7fb5901611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.691+0000 7fb57cff9640 1 --2- 172.21.15.60:0/1913968077 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb59006c320 0x7fb5901611a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb58000c430 tx=0x7fb58000c8f0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.691+0000 7fb58ed9d640 1 -- 172.21.15.60:0/1913968077 reap_dead start 2024-09-12T01:36:05.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.691+0000 7fb57cff9640 1 -- 172.21.15.60:0/1913968077 shutdown_connections 2024-09-12T01:36:05.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.691+0000 7fb57cff9640 1 -- 172.21.15.60:0/1913968077 >> 172.21.15.60:0/1913968077 conn(0x7fb59006cd20 msgr2=0x7fb590161c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.692+0000 7fb57cff9640 1 -- 172.21.15.60:0/1913968077 shutdown_connections 2024-09-12T01:36:05.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.695+0000 7fb57cff9640 1 -- 172.21.15.60:0/1913968077 wait complete. 2024-09-12T01:36:05.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.697+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 --> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f755004c2d0 con 0x7f753c074030 2024-09-12T01:36:05.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.698+0000 7f9299968640 1 -- 172.21.15.60:0/3828141367 --> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9274002dd0 con 0x7f9280074050 2024-09-12T01:36:05.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.698+0000 7f754dffb640 1 -- 172.21.15.60:0/3822480326 <== osd.3 v2:172.21.15.60:6826/3508972949 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f755004c2d0 con 0x7f753c074030 2024-09-12T01:36:05.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.698+0000 7f927bfff640 1 -- 172.21.15.60:0/3828141367 <== osd.0 v2:172.21.15.60:6818/1570261314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9274002dd0 con 0x7f9280074050 2024-09-12T01:36:05.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f9299968640 1 -- 172.21.15.60:0/3828141367 >> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] conn(0x7f9280074050 msgr2=0x7f9280076470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f9299968640 1 --2- 172.21.15.60:0/3828141367 >> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] conn(0x7f9280074050 0x7f9280076470 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f9299968640 1 -- 172.21.15.60:0/3828141367 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f928006be30 msgr2=0x7f928006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f9299968640 1 --2- 172.21.15.60:0/3828141367 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f928006be30 0x7f928006e2f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9284033000 tx=0x7f9284008030 comp rx=0 tx=0).stop 2024-09-12T01:36:05.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f9299968640 1 -- 172.21.15.60:0/3828141367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92940b6030 msgr2=0x7f92941fb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f9299968640 1 --2- 172.21.15.60:0/3828141367 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92940b6030 0x7f92941fb980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f929406d390 tx=0x7f928c009bf0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f92937fe640 1 -- 172.21.15.60:0/3828141367 reap_dead start 2024-09-12T01:36:05.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] conn(0x7f753c074030 msgr2=0x7f753c076450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f755e1f1640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] conn(0x7f753c074030 0x7f753c076450 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f753c06be30 msgr2=0x7f753c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f9299968640 1 -- 172.21.15.60:0/3828141367 shutdown_connections 2024-09-12T01:36:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f755e1f1640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f753c06be30 0x7f753c06e2f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75500e1770 tx=0x7f7548008040 comp rx=0 tx=0).stop 2024-09-12T01:36:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755003bc50 msgr2=0x7f75500e3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f755e1f1640 1 --2- 172.21.15.60:0/3822480326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f755003bc50 0x7f75500e3130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f75540090b0 tx=0x7f75540046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f9299968640 1 -- 172.21.15.60:0/3828141367 >> 172.21.15.60:0/3828141367 conn(0x7f92940d1360 msgr2=0x7f92940b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.699+0000 7f755d9f0640 1 -- 172.21.15.60:0/3822480326 reap_dead start 2024-09-12T01:36:05.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.700+0000 7f9299968640 1 -- 172.21.15.60:0/3828141367 shutdown_connections 2024-09-12T01:36:05.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.700+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 shutdown_connections 2024-09-12T01:36:05.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.700+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 >> 172.21.15.60:0/3822480326 conn(0x7f755003a510 msgr2=0x7f755003e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.700+0000 7f9299968640 1 -- 172.21.15.60:0/3828141367 wait complete. 2024-09-12T01:36:05.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.700+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 shutdown_connections 2024-09-12T01:36:05.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.700+0000 7f755e1f1640 1 -- 172.21.15.60:0/3822480326 wait complete. 2024-09-12T01:36:05.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.701+0000 7fa5dbfff640 1 -- 172.21.15.60:0/3419445675 --> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa5d0002dd0 con 0x7fa5d40740d0 2024-09-12T01:36:05.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.701+0000 7fa5e67fc640 1 -- 172.21.15.60:0/3419445675 <== osd.2 v2:172.21.15.60:6802/939860136 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa5d0002dd0 con 0x7fa5d40740d0 2024-09-12T01:36:05.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.702+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 --> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f65d8002dd0 con 0x7f65d4074150 2024-09-12T01:36:05.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.702+0000 7f65e67fc640 1 -- 172.21.15.60:0/3109128004 <== osd.1 v2:172.21.15.60:6810/1439609768 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f65d8002dd0 con 0x7f65d4074150 2024-09-12T01:36:05.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.703+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 --> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6f3c1f51f0 con 0x7f6f20074030 2024-09-12T01:36:05.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.703+0000 7fa5dbfff640 1 -- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] conn(0x7fa5d40740d0 msgr2=0x7fa5d40764f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.703+0000 7fa5dbfff640 1 --2- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] conn(0x7fa5d40740d0 0x7fa5d40764f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.703+0000 7fa5dbfff640 1 -- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa5d406bf30 msgr2=0x7fa5d406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.703+0000 7fa5dbfff640 1 --2- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa5d406bf30 0x7fa5d406e3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec034000 tx=0x7fa5ec02e000 comp rx=0 tx=0).stop 2024-09-12T01:36:05.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.703+0000 7fa5dbfff640 1 -- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5f0167120 msgr2=0x7fa5f01f8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.703+0000 7fa5dbfff640 1 --2- 172.21.15.60:0/3419445675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5f0167120 0x7fa5f01f8b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800ca50 tx=0x7fa5e800cf10 comp rx=0 tx=0).stop 2024-09-12T01:36:05.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.703+0000 7fa5f6373640 1 -- 172.21.15.60:0/3419445675 reap_dead start 2024-09-12T01:36:05.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.703+0000 7f6f2dffb640 1 -- 172.21.15.60:0/2017416215 <== osd.6 v2:172.21.15.105:6800/48914195 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6f3c1f51f0 con 0x7f6f20074030 2024-09-12T01:36:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] conn(0x7f65d4074150 msgr2=0x7f65d4076570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f65f7add640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] conn(0x7f65d4074150 0x7f65d4076570 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f65d406bf30 msgr2=0x7f65d406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f65f7add640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f65d406bf30 0x7f65d406e3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f65e0034000 tx=0x7f65e002e000 comp rx=0 tx=0).stop 2024-09-12T01:36:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65f0162150 msgr2=0x7f65f00b9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f65f7add640 1 --2- 172.21.15.60:0/3109128004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f65f0162150 0x7f65f00b9860 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f65f008dba0 tx=0x7f65e800cb90 comp rx=0 tx=0).stop 2024-09-12T01:36:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f65f607a640 1 -- 172.21.15.60:0/3109128004 reap_dead start 2024-09-12T01:36:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7fa5dbfff640 1 -- 172.21.15.60:0/3419445675 shutdown_connections 2024-09-12T01:36:05.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7fa5dbfff640 1 -- 172.21.15.60:0/3419445675 >> 172.21.15.60:0/3419445675 conn(0x7fa5f006d0f0 msgr2=0x7fa5f0147c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 shutdown_connections 2024-09-12T01:36:05.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 >> 172.21.15.60:0/3109128004 conn(0x7f65f006c500 msgr2=0x7f65f00b8130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7fa5dbfff640 1 -- 172.21.15.60:0/3419445675 shutdown_connections 2024-09-12T01:36:05.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7fa5dbfff640 1 -- 172.21.15.60:0/3419445675 wait complete. 2024-09-12T01:36:05.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] conn(0x7f6f20074030 msgr2=0x7f6f20076450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f6f438dd640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] conn(0x7f6f20074030 0x7f6f20076450 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f2006be30 msgr2=0x7f6f2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f6f438dd640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f2006be30 0x7f6f2006e2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009560 tx=0x7f6f3802e000 comp rx=0 tx=0).stop 2024-09-12T01:36:05.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.704+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c161d70 msgr2=0x7f6f3c157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.705+0000 7f6f438dd640 1 --2- 172.21.15.60:0/2017416215 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f3c161d70 0x7f6f3c157cd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c162570 tx=0x7f6f3000b8f0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.705+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 shutdown_connections 2024-09-12T01:36:05.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.705+0000 7f6f41e7a640 1 -- 172.21.15.60:0/2017416215 reap_dead start 2024-09-12T01:36:05.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.705+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 shutdown_connections 2024-09-12T01:36:05.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.705+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 >> 172.21.15.60:0/2017416215 conn(0x7f6f3c06c500 msgr2=0x7f6f3c0b46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.705+0000 7f65f7add640 1 -- 172.21.15.60:0/3109128004 wait complete. 2024-09-12T01:36:05.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.705+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 shutdown_connections 2024-09-12T01:36:05.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.705+0000 7f6f438dd640 1 -- 172.21.15.60:0/2017416215 wait complete. 2024-09-12T01:36:05.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.706+0000 7f6b628ba640 1 -- 172.21.15.60:0/1160576866 --> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6b5c073230 con 0x7f6b48073fd0 2024-09-12T01:36:05.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.706+0000 7fb15e42e640 1 -- 172.21.15.60:0/3899373607 --> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb15806eac0 con 0x7fb144074150 2024-09-12T01:36:05.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.707+0000 7fb154ff9640 1 -- 172.21.15.60:0/3899373607 <== osd.5 v2:172.21.15.105:6816/16466051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb15806eac0 con 0x7fb144074150 2024-09-12T01:36:05.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.707+0000 7f6b58ff9640 1 -- 172.21.15.60:0/1160576866 <== osd.7 v2:172.21.15.105:6824/2648783557 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6b5c073230 con 0x7f6b48073fd0 2024-09-12T01:36:05.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.707+0000 7fb15e42e640 1 -- 172.21.15.60:0/3899373607 >> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] conn(0x7fb144074150 msgr2=0x7fb144076570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.707+0000 7fb15e42e640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] conn(0x7fb144074150 0x7fb144076570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7fb15e42e640 1 -- 172.21.15.60:0/3899373607 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb14406bf30 msgr2=0x7fb14406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7fb15e42e640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb14406bf30 0x7fb14406e3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb150036000 tx=0x7fb150009000 comp rx=0 tx=0).stop 2024-09-12T01:36:05.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7f6b628ba640 1 -- 172.21.15.60:0/1160576866 >> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] conn(0x7f6b48073fd0 msgr2=0x7f6b480763f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7f6b628ba640 1 --2- 172.21.15.60:0/1160576866 >> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] conn(0x7f6b48073fd0 0x7f6b480763f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:05.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7fb15e42e640 1 -- 172.21.15.60:0/3899373607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb15815f810 msgr2=0x7fb15813adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7fb15e42e640 1 --2- 172.21.15.60:0/3899373607 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb15815f810 0x7fb15813adc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb14c00d490 tx=0x7fb14c00d950 comp rx=0 tx=0).stop 2024-09-12T01:36:05.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7fb15c9cb640 1 -- 172.21.15.60:0/3899373607 reap_dead start 2024-09-12T01:36:05.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7f6b628ba640 1 -- 172.21.15.60:0/1160576866 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b4806be30 msgr2=0x7f6b4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7f6b628ba640 1 --2- 172.21.15.60:0/1160576866 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b4806be30 0x7f6b4806e2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0c6610 tx=0x7f6b5400b040 comp rx=0 tx=0).stop 2024-09-12T01:36:05.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7f6b628ba640 1 -- 172.21.15.60:0/1160576866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b5c141c30 msgr2=0x7f6b5c0c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:05.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7f6b628ba640 1 --2- 172.21.15.60:0/1160576866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b5c141c30 0x7f6b5c0c6c20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6b5002f000 tx=0x7f6b50001970 comp rx=0 tx=0).stop 2024-09-12T01:36:05.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7f6b60e57640 1 -- 172.21.15.60:0/1160576866 reap_dead start 2024-09-12T01:36:05.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7f6b628ba640 1 -- 172.21.15.60:0/1160576866 shutdown_connections 2024-09-12T01:36:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7f6b628ba640 1 -- 172.21.15.60:0/1160576866 >> 172.21.15.60:0/1160576866 conn(0x7f6b5c06d0f0 msgr2=0x7f6b5c0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.708+0000 7f6b628ba640 1 -- 172.21.15.60:0/1160576866 shutdown_connections 2024-09-12T01:36:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.709+0000 7f6b628ba640 1 -- 172.21.15.60:0/1160576866 wait complete. 2024-09-12T01:36:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.709+0000 7fb15e42e640 1 -- 172.21.15.60:0/3899373607 shutdown_connections 2024-09-12T01:36:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.709+0000 7fb15e42e640 1 -- 172.21.15.60:0/3899373607 >> 172.21.15.60:0/3899373607 conn(0x7fb1580d03e0 msgr2=0x7fb1580b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.709+0000 7fb15e42e640 1 -- 172.21.15.60:0/3899373607 shutdown_connections 2024-09-12T01:36:05.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:05.709+0000 7fb15e42e640 1 -- 172.21.15.60:0/3899373607 wait complete. 2024-09-12T01:36:05.791 INFO:teuthology.orchestra.run.smithi060.stdout:55834574855 2024-09-12T01:36:05.791 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T01:36:05.792 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T01:36:05.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T01:36:05.793 INFO:teuthology.orchestra.run.smithi060.stdout:64424509448 2024-09-12T01:36:05.794 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T01:36:05.794 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T01:36:05.795 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T01:36:05.795 INFO:teuthology.orchestra.run.smithi060.stdout:64424509449 2024-09-12T01:36:05.796 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T01:36:05.796 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T01:36:05.797 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T01:36:05.797 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T01:36:05.798 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T01:36:05.798 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T01:36:05.799 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T01:36:06.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.007+0000 7fc691284640 1 Processor -- start 2024-09-12T01:36:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.009+0000 7ff1c77b9640 1 Processor -- start 2024-09-12T01:36:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.008+0000 7fc691284640 1 -- start start 2024-09-12T01:36:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.009+0000 7fc691284640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc684036730 0x7fc68404ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.009+0000 7fc691284640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc6840551b0 0x7fc68404f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.009+0000 7fc691284640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc684039630 con 0x7fc68400a4f0 2024-09-12T01:36:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.009+0000 7fc691284640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc684039910 con 0x7fc684036730 2024-09-12T01:36:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.009+0000 7fc691284640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc684039bf0 con 0x7fc6840551b0 2024-09-12T01:36:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.010+0000 7fc68b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc684036730 0x7fc68404ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.010+0000 7fc68b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc684036730 0x7fc68404ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49124/0 (socket says 172.21.15.60:49124) 2024-09-12T01:36:06.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.010+0000 7fc68b7fe640 1 -- 172.21.15.60:0/2550454493 learned_addr learned my addr 172.21.15.60:0/2550454493 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.009+0000 7fc016574640 1 Processor -- start 2024-09-12T01:36:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.009+0000 7fc016574640 1 -- start start 2024-09-12T01:36:06.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.009+0000 7ff1c77b9640 1 -- start start 2024-09-12T01:36:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.010+0000 7fc68b7fe640 1 -- 172.21.15.60:0/2550454493 >> v2:172.21.15.105:3300/0 conn(0x7fc6840551b0 msgr2=0x7fc68404f480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:36:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7fc68b7fe640 1 --2- 172.21.15.60:0/2550454493 >> v2:172.21.15.105:3300/0 conn(0x7fc6840551b0 0x7fc68404f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7fc68b7fe640 1 -- 172.21.15.60:0/2550454493 >> v1:172.21.15.105:6789/0 conn(0x7fc68400a4f0 legacy=0x7fc684036020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:36:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.010+0000 7fc016574640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0080e09c0 0x7fc0080556a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7fc68b7fe640 1 -- 172.21.15.60:0/2550454493 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc684039ed0 con 0x7fc684036730 2024-09-12T01:36:06.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.010+0000 7fc016574640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0080354c0 0x7fc008038940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.010+0000 7fc016574640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc008038e80 con 0x7fc008035a80 2024-09-12T01:36:06.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.010+0000 7fc016574640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc008039100 con 0x7fc0080e09c0 2024-09-12T01:36:06.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.010+0000 7fc016574640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc008057400 con 0x7fc0080354c0 2024-09-12T01:36:06.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.010+0000 7fc015572640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0080e09c0 0x7fc0080556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7fc015572640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0080e09c0 0x7fc0080556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49132/0 (socket says 172.21.15.60:49132) 2024-09-12T01:36:06.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7fc015572640 1 -- 172.21.15.60:0/169353493 learned_addr learned my addr 172.21.15.60:0/169353493 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:06.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7fc015d73640 1 --2- 172.21.15.60:0/169353493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0080354c0 0x7fc008038940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7fc015572640 1 -- 172.21.15.60:0/169353493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0080354c0 msgr2=0x7fc008038940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:06.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7fc015572640 1 --2- 172.21.15.60:0/169353493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0080354c0 0x7fc008038940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7fc015572640 1 -- 172.21.15.60:0/169353493 >> v1:172.21.15.105:6789/0 conn(0x7fc008035a80 legacy=0x7fc008038230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7fc015572640 1 -- 172.21.15.60:0/169353493 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc008054ea0 con 0x7fc0080e09c0 2024-09-12T01:36:06.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7fc015d73640 1 --2- 172.21.15.60:0/169353493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0080354c0 0x7fc008038940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:06.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.010+0000 7ff1c77b9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1b8047c10 0x7ff1b8006910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7ff1c5555640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff1b80e6f80 0x7ff1b8006200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50144/0 (socket says 172.21.15.60:50144) 2024-09-12T01:36:06.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.011+0000 7ff1c4d54640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1b8047c10 0x7ff1b8006910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.012+0000 7ff1c4d54640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1b8047c10 0x7ff1b8006910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:53800/0 (socket says 172.21.15.60:53800) 2024-09-12T01:36:06.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.012+0000 7ff1c77b9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b800b6c0 con 0x7ff1b80e6f80 2024-09-12T01:36:06.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.012+0000 7ff1c77b9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b800b9a0 con 0x7ff1b8033a00 2024-09-12T01:36:06.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.012+0000 7ff1c77b9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b8047780 con 0x7ff1b8047c10 2024-09-12T01:36:06.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.012+0000 7ff1c5555640 1 -- 172.21.15.60:0/3068980268 learned_addr learned my addr 172.21.15.60:0/3068980268 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:06.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.012+0000 7fdc0ec96640 1 Processor -- start 2024-09-12T01:36:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.012+0000 7fc68b7fe640 1 --2- 172.21.15.60:0/2550454493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc684036730 0x7fc68404ef40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc684036e60 tx=0x7fc67802a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c163f4100cdf0d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.012+0000 7fdc0ec96640 1 -- start start 2024-09-12T01:36:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.013+0000 7fc68affd640 1 -- 172.21.15.60:0/2550454493 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc678036070 con 0x7fc684036730 2024-09-12T01:36:06.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.013+0000 7fc68affd640 1 -- 172.21.15.60:0/2550454493 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc678031600 con 0x7fc684036730 2024-09-12T01:36:06.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.013+0000 7fb77b75f640 1 Processor -- start 2024-09-12T01:36:06.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.013+0000 7ff1b7fff640 1 -- 172.21.15.60:0/3068980268 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848634463 0 0) 0x7ff1b800b9a0 con 0x7ff1b8033a00 2024-09-12T01:36:06.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.013+0000 7ff1c4d54640 1 -- 172.21.15.60:0/3068980268 >> v1:172.21.15.105:6789/0 conn(0x7ff1b8033a00 legacy=0x7ff1b8036020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.013+0000 7ff1c4d54640 1 -- 172.21.15.60:0/3068980268 >> v1:172.21.15.60:6789/0 conn(0x7ff1b80e6f80 legacy=0x7ff1b8006200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.013+0000 7ff1c4d54640 1 -- 172.21.15.60:0/3068980268 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b8005ba0 con 0x7ff1b8047c10 2024-09-12T01:36:06.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.013+0000 7fb77b75f640 1 -- start start 2024-09-12T01:36:06.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.013+0000 7fc015572640 1 --2- 172.21.15.60:0/169353493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0080e09c0 0x7fc0080556a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0143b0 tx=0x7fc00c033060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11dc5e54edf9178b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.013+0000 7fdc0ec96640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc080d1c20 0x7fdc080cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fdc0ec96640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc080d4530 con 0x7fdc080d1130 2024-09-12T01:36:06.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fdc0ec96640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc080d3490 con 0x7fdc080cf590 2024-09-12T01:36:06.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fdc0ec96640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdc080d40a0 con 0x7fdc080d1c20 2024-09-12T01:36:06.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.013+0000 7fc68affd640 1 -- 172.21.15.60:0/2550454493 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6780319d0 con 0x7fc684036730 2024-09-12T01:36:06.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fc691284640 1 -- 172.21.15.60:0/2550454493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc684036730 msgr2=0x7fc68404ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fc691284640 1 --2- 172.21.15.60:0/2550454493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc684036730 0x7fc68404ef40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc684036e60 tx=0x7fc67802a4a0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fdc07fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc080d1c20 0x7fdc080cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fdc0ca32640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdc080d1130 0x7fdc080d1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50152/0 (socket says 172.21.15.60:50152) 2024-09-12T01:36:06.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fdc0ca32640 1 -- 172.21.15.60:0/3399310657 learned_addr learned my addr 172.21.15.60:0/3399310657 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:06.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fc691284640 1 -- 172.21.15.60:0/2550454493 shutdown_connections 2024-09-12T01:36:06.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fc691284640 1 --2- 172.21.15.60:0/2550454493 >> v2:172.21.15.105:3300/0 conn(0x7fc6840551b0 0x7fc68404f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fc691284640 1 --2- 172.21.15.60:0/2550454493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc684036730 0x7fc68404ef40 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc684036e60 tx=0x7fc67802a4a0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fc691284640 1 -- 172.21.15.60:0/2550454493 >> 172.21.15.60:0/2550454493 conn(0x7fc68401d930 msgr2=0x7fc6840545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7ff1c4d54640 1 --2- 172.21.15.60:0/3068980268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1b8047c10 0x7ff1b8006910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0009800 tx=0x7ff1b002a0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4446085392826f44 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fc007fff640 1 -- 172.21.15.60:0/169353493 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c040070 con 0x7fc0080e09c0 2024-09-12T01:36:06.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fc007fff640 1 -- 172.21.15.60:0/169353493 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc00c033bb0 con 0x7fc0080e09c0 2024-09-12T01:36:06.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fc007fff640 1 -- 172.21.15.60:0/169353493 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c03b440 con 0x7fc0080e09c0 2024-09-12T01:36:06.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fb77b75f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb76c009fe0 0x7fb76c007290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fb77b75f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76c005f80 con 0x7fb76c0df150 2024-09-12T01:36:06.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.014+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779138947 0 0) 0x7fdc080d4530 con 0x7fdc080d1130 2024-09-12T01:36:06.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7ff1b7fff640 1 -- 172.21.15.60:0/3068980268 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b0037070 con 0x7ff1b8047c10 2024-09-12T01:36:06.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7ff1b7fff640 1 -- 172.21.15.60:0/3068980268 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1b002ad60 con 0x7ff1b8047c10 2024-09-12T01:36:06.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbf8003520 con 0x7fdc080d1130 2024-09-12T01:36:06.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fb77b75f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb76c006260 con 0x7fb76c00a3c0 2024-09-12T01:36:06.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7ff20dbea640 1 Processor -- start 2024-09-12T01:36:06.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fb77b75f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb76c007870 con 0x7fb76c009fe0 2024-09-12T01:36:06.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fb778cfa640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb76c0df150 0x7fb76c036e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50160/0 (socket says 172.21.15.60:50160) 2024-09-12T01:36:06.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7ff20dbea640 1 -- start start 2024-09-12T01:36:06.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fb778cfa640 1 -- 172.21.15.60:0/1827329394 learned_addr learned my addr 172.21.15.60:0/1827329394 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:06.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fc691284640 1 -- 172.21.15.60:0/2550454493 shutdown_connections 2024-09-12T01:36:06.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987201174 0 0) 0x7fb76c005f80 con 0x7fb76c0df150 2024-09-12T01:36:06.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb760003520 con 0x7fb76c0df150 2024-09-12T01:36:06.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7f753cb74640 1 Processor -- start 2024-09-12T01:36:06.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fb7794fb640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb76c009fe0 0x7fb76c007290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fc016574640 1 -- 172.21.15.60:0/169353493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0080e09c0 msgr2=0x7fc0080556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fc016574640 1 --2- 172.21.15.60:0/169353493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0080e09c0 0x7fc0080556a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0143b0 tx=0x7fc00c033060 comp rx=0 tx=0).stop 2024-09-12T01:36:06.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fc016574640 1 -- 172.21.15.60:0/169353493 shutdown_connections 2024-09-12T01:36:06.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fc016574640 1 --2- 172.21.15.60:0/169353493 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0080354c0 0x7fc008038940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fc016574640 1 --2- 172.21.15.60:0/169353493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0080e09c0 0x7fc0080556a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7fc016574640 1 -- 172.21.15.60:0/169353493 >> 172.21.15.60:0/169353493 conn(0x7fc0080567b0 msgr2=0x7fc008056bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1608898255 0 0) 0x7fb760003520 con 0x7fb76c0df150 2024-09-12T01:36:06.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb76c009fe0 msgr2=0x7fb76c007290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:06.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb76c009fe0 0x7fb76c007290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 >> v1:172.21.15.105:6789/0 conn(0x7fb76c00a3c0 legacy=0x7fb76c0396a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c006540 con 0x7fb76c0df150 2024-09-12T01:36:06.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7ff1c77b9640 1 -- 172.21.15.60:0/3068980268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1b8047c10 msgr2=0x7ff1b8006910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7ff1c77b9640 1 --2- 172.21.15.60:0/3068980268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1b8047c10 0x7ff1b8006910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0009800 tx=0x7ff1b002a0d0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7ff1c77b9640 1 -- 172.21.15.60:0/3068980268 shutdown_connections 2024-09-12T01:36:06.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7ff1c77b9640 1 --2- 172.21.15.60:0/3068980268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1b8047c10 0x7ff1b8006910 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7ff1c77b9640 1 -- 172.21.15.60:0/3068980268 >> 172.21.15.60:0/3068980268 conn(0x7ff1b801d930 msgr2=0x7ff1b80545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fc016574640 1 -- 172.21.15.60:0/169353493 shutdown_connections 2024-09-12T01:36:06.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fc016574640 1 -- 172.21.15.60:0/169353493 wait complete. 2024-09-12T01:36:06.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 420711327 0 0) 0x7fdc080d3490 con 0x7fdc080cf590 2024-09-12T01:36:06.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc080d4530 con 0x7fdc080cf590 2024-09-12T01:36:06.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3760473042 0 0) 0x7fdbf8003520 con 0x7fdc080d1130 2024-09-12T01:36:06.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc080d1c20 msgr2=0x7fdc080cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:06.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 --2- 172.21.15.60:0/3399310657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc080d1c20 0x7fdc080cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 >> v1:172.21.15.105:6789/0 conn(0x7fdc080cf590 legacy=0x7fdc080cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc080d3770 con 0x7fdc080d1130 2024-09-12T01:36:06.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fdbfc001670 con 0x7fdc080d1130 2024-09-12T01:36:06.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 >> v1:172.21.15.60:6789/0 conn(0x7fdc080d1130 legacy=0x7fdc080d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 --2- 172.21.15.60:0/3399310657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8004bd0 0x7fdbf8004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fb770001650 con 0x7fb76c0df150 2024-09-12T01:36:06.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 >> v1:172.21.15.60:6789/0 conn(0x7fb76c0df150 legacy=0x7fb76c036e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb760003a00 0x7fb760003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7600043c0 0x7fb7600048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7600050a0 0x7fb76000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c007870 con 0x7fb7600050a0 2024-09-12T01:36:06.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb7600103c0 con 0x7fb760003a00 2024-09-12T01:36:06.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb7600105c0 con 0x7fb7600043c0 2024-09-12T01:36:06.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 --2- 172.21.15.60:0/3399310657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf80037a0 0x7fdbf8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 --2- 172.21.15.60:0/3399310657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbf8004160 0x7fdbf800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdc080d40a0 con 0x7fdbf8004bd0 2024-09-12T01:36:06.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdbf800bfb0 con 0x7fdbf8004160 2024-09-12T01:36:06.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdbf800c180 con 0x7fdbf80037a0 2024-09-12T01:36:06.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc07fff640 1 --2- 172.21.15.60:0/3399310657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc080d1c20 0x7fdc080cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:06.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fc691284640 1 -- 172.21.15.60:0/2550454493 wait complete. 2024-09-12T01:36:06.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.015+0000 7f753cb74640 1 -- start start 2024-09-12T01:36:06.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc0d233640 1 --2- 172.21.15.60:0/3399310657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbf8004160 0x7fdbf800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fdc0ca32640 1 --2- 172.21.15.60:0/3399310657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8004bd0 0x7fdbf8004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb779cfc640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7600050a0 0x7fb76000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb7794fb640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb760003a00 0x7fb760003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7fb778cfa640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7600043c0 0x7fb7600048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7fdc07fff640 1 --2- 172.21.15.60:0/3399310657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf80037a0 0x7fdbf8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7ff1c77b9640 1 -- 172.21.15.60:0/3068980268 shutdown_connections 2024-09-12T01:36:06.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.016+0000 7ff1c77b9640 1 -- 172.21.15.60:0/3068980268 wait complete. 2024-09-12T01:36:06.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7ff20dbea640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff2000323c0 0x7ff200052350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7ff20dbea640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff200009af0 0x7ff200009f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7ff20dbea640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff20001c5c0 con 0x7ff2000dec70 2024-09-12T01:36:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7ff20dbea640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff20000a480 con 0x7ff2000323c0 2024-09-12T01:36:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7f753cb74640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f75380b6630 0x7f7538169140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7fb7794fb640 1 -- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7600043c0 msgr2=0x7fb7600048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7fb7794fb640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7600043c0 0x7fb7600048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7fb7794fb640 1 -- 172.21.15.60:0/1827329394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7600050a0 msgr2=0x7fb76000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7fb7794fb640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7600050a0 0x7fb76000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7fb7794fb640 1 -- 172.21.15.60:0/1827329394 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c006540 con 0x7fb760003a00 2024-09-12T01:36:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7ff20dbea640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff20001c830 con 0x7ff200009af0 2024-09-12T01:36:06.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7fb778cfa640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7600043c0 0x7fb7600048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7f7537fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f75380b6630 0x7f7538169140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7f75377fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f753815e6b0 0x7f75380cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:49430/0 (socket says 172.21.15.60:49430) 2024-09-12T01:36:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7f753cb74640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75380d35e0 con 0x7f75380d3150 2024-09-12T01:36:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7f753cb74640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75380d38c0 con 0x7f753815e6b0 2024-09-12T01:36:06.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7f753cb74640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f75380d41f0 con 0x7f75380b6630 2024-09-12T01:36:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7ff20cbe8640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff2000dec70 0x7ff200006500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:49414/0 (socket says 172.21.15.60:49414) 2024-09-12T01:36:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7ff20cbe8640 1 -- 172.21.15.60:0/841917712 learned_addr learned my addr 172.21.15.60:0/841917712 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7ff20d3e9640 1 --2- 172.21.15.60:0/841917712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff200009af0 0x7ff200009f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7f7537fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f75380b6630 0x7f7538169140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48224/0 (socket says 172.21.15.60:48224) 2024-09-12T01:36:06.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7f7537fff640 1 -- 172.21.15.60:0/3492417641 learned_addr learned my addr 172.21.15.60:0/3492417641 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7fdc0ca32640 1 -- 172.21.15.60:0/3399310657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf80037a0 msgr2=0x7fdbf8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7fdc0ca32640 1 --2- 172.21.15.60:0/3399310657 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdbf80037a0 0x7fdbf8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7fdc0ca32640 1 -- 172.21.15.60:0/3399310657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbf8004160 msgr2=0x7fdbf800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7fdc0ca32640 1 --2- 172.21.15.60:0/3399310657 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdbf8004160 0x7fdbf800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7fc016574640 1 Processor -- start 2024-09-12T01:36:06.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.017+0000 7fdc0ca32640 1 -- 172.21.15.60:0/3399310657 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbf8003520 con 0x7fdbf8004bd0 2024-09-12T01:36:06.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7fc016574640 1 -- start start 2024-09-12T01:36:06.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7fc691284640 1 Processor -- start 2024-09-12T01:36:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7fdc0ca32640 1 --2- 172.21.15.60:0/3399310657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8004bd0 0x7fdbf8004fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00c0e0 tx=0x7fdbf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fffa7b0d2b6d11c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.019+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc007c00 con 0x7fdbf8004bd0 2024-09-12T01:36:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.019+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbfc005af0 con 0x7fdbf8004bd0 2024-09-12T01:36:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.019+0000 7fdc077fe640 1 -- 172.21.15.60:0/3399310657 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc007070 con 0x7fdbf8004bd0 2024-09-12T01:36:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7ff1c77b9640 1 Processor -- start 2024-09-12T01:36:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7ff1c77b9640 1 -- start start 2024-09-12T01:36:06.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7ff20d3e9640 1 -- 172.21.15.60:0/841917712 >> v2:172.21.15.105:3300/0 conn(0x7ff2000323c0 msgr2=0x7ff200052350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-12T01:36:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7ff20d3e9640 1 --2- 172.21.15.60:0/841917712 >> v2:172.21.15.105:3300/0 conn(0x7ff2000323c0 0x7ff200052350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7ff20d3e9640 1 -- 172.21.15.60:0/841917712 >> v1:172.21.15.105:6789/0 conn(0x7ff2000dec70 legacy=0x7ff200006500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7ff20d3e9640 1 -- 172.21.15.60:0/841917712 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20001cb10 con 0x7ff200009af0 2024-09-12T01:36:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7fc691284640 1 -- start start 2024-09-12T01:36:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.019+0000 7fc691284640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6840551b0 0x7fc68417da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc691284640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc68404c630 0x7fc68417fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc691284640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc684034e10 0x7fc6840352a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc691284640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc684054e30 con 0x7fc684034e10 2024-09-12T01:36:06.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc691284640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc684054cb0 con 0x7fc68404c630 2024-09-12T01:36:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7f7537fff640 1 -- 172.21.15.60:0/3492417641 >> v1:172.21.15.105:6789/0 conn(0x7f753815e6b0 legacy=0x7f75380cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7f7537fff640 1 -- 172.21.15.60:0/3492417641 >> v1:172.21.15.60:6789/0 conn(0x7f75380d3150 legacy=0x7f75380b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.018+0000 7f7537fff640 1 -- 172.21.15.60:0/3492417641 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75380d3ba0 con 0x7f75380b6630 2024-09-12T01:36:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7f7537fff640 1 --2- 172.21.15.60:0/3492417641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75380b6630 0x7f7538169140 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7530009e50 tx=0x7f753002a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=628a51cdc3d97b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.019+0000 7ff20d3e9640 1 --2- 172.21.15.60:0/841917712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff200009af0 0x7ff200009f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00a8c0 tx=0x7ff1fc02b250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d930d726c642ca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.019+0000 7ff2077fe640 1 -- 172.21.15.60:0/841917712 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc038070 con 0x7ff200009af0 2024-09-12T01:36:06.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7ff2077fe640 1 -- 172.21.15.60:0/841917712 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1fc033440 con 0x7ff200009af0 2024-09-12T01:36:06.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7ff2077fe640 1 -- 172.21.15.60:0/841917712 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1fc033810 con 0x7ff200009af0 2024-09-12T01:36:06.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.019+0000 7fb7794fb640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb760003a00 0x7fb760003e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c210 tx=0x7fb760005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3354b84f30ce6bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.019+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764036070 con 0x7fb760003a00 2024-09-12T01:36:06.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.019+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb764031400 con 0x7fb760003a00 2024-09-12T01:36:06.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc691284640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc684007070 con 0x7fc6840551b0 2024-09-12T01:36:06.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc690a83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc684034e10 0x7fc6840352a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc68bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6840551b0 0x7fc68417da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc690a83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc684034e10 0x7fc6840352a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49154/0 (socket says 172.21.15.60:49154) 2024-09-12T01:36:06.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc690a83640 1 -- 172.21.15.60:0/1347660513 learned_addr learned my addr 172.21.15.60:0/1347660513 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:06.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc68b7fe640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc68404c630 0x7fc68417fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7ff1c77b9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b8033a00 0x7ff1b804e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7ff1c77b9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1b80e6f80 0x7ff1b817d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7f75367fc640 1 -- 172.21.15.60:0/3492417641 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530036070 con 0x7f75380b6630 2024-09-12T01:36:06.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7f75367fc640 1 -- 172.21.15.60:0/3492417641 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7530031600 con 0x7f75380b6630 2024-09-12T01:36:06.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7f75367fc640 1 -- 172.21.15.60:0/3492417641 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75300319d0 con 0x7f75380b6630 2024-09-12T01:36:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7ff1c77b9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1b804b5e0 0x7ff1b804fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fdc0ec96640 1 -- 172.21.15.60:0/3399310657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8004bd0 msgr2=0x7fdbf8004fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fdc0ec96640 1 --2- 172.21.15.60:0/3399310657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8004bd0 0x7fdbf8004fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc00c0e0 tx=0x7fdbf8005830 comp rx=0 tx=0).stop 2024-09-12T01:36:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fdc0d233640 1 -- 172.21.15.60:0/3399310657 reap_dead start 2024-09-12T01:36:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fdc0ec96640 1 -- 172.21.15.60:0/3399310657 shutdown_connections 2024-09-12T01:36:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fdc0ec96640 1 -- 172.21.15.60:0/3399310657 >> 172.21.15.60:0/3399310657 conn(0x7fdc0806c020 msgr2=0x7fdc0806c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fdc0ec96640 1 -- 172.21.15.60:0/3399310657 shutdown_connections 2024-09-12T01:36:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7ff1c77b9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b80e7360 con 0x7ff1b8033a00 2024-09-12T01:36:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7ff1c77b9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b8006e50 con 0x7ff1b804b5e0 2024-09-12T01:36:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7ff1c77b9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b804c540 con 0x7ff1b80e6f80 2024-09-12T01:36:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7ff1c5555640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b8033a00 0x7ff1b804e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7ff1c5555640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b8033a00 0x7ff1b804e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49164/0 (socket says 172.21.15.60:49164) 2024-09-12T01:36:06.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7ff1c5555640 1 -- 172.21.15.60:0/2507180391 learned_addr learned my addr 172.21.15.60:0/2507180391 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fdc0ec96640 1 -- 172.21.15.60:0/3399310657 wait complete. 2024-09-12T01:36:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc68bfff640 1 -- 172.21.15.60:0/1347660513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc68404c630 msgr2=0x7fc68417fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc68bfff640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc68404c630 0x7fc68417fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc68bfff640 1 -- 172.21.15.60:0/1347660513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc684034e10 msgr2=0x7fc6840352a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc68bfff640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc684034e10 0x7fc6840352a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc68bfff640 1 -- 172.21.15.60:0/1347660513 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc68404d640 con 0x7fc6840551b0 2024-09-12T01:36:06.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fb77b75f640 1 -- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb760003a00 msgr2=0x7fb760003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fb76bfff640 1 -- 172.21.15.60:0/1827329394 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764036070 con 0x7fb760003a00 2024-09-12T01:36:06.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.019+0000 7fc016574640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0080354c0 0x7fc0080d67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fb77b75f640 1 --2- 172.21.15.60:0/1827329394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb760003a00 0x7fb760003e40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c210 tx=0x7fb760005830 comp rx=0 tx=0).stop 2024-09-12T01:36:06.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.020+0000 7fc016574640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc008035a80 0x7fc0080dbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fb779cfc640 1 -- 172.21.15.60:0/1827329394 reap_dead start 2024-09-12T01:36:06.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff20dbea640 1 -- 172.21.15.60:0/841917712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff200009af0 msgr2=0x7ff200009f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff20dbea640 1 --2- 172.21.15.60:0/841917712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff200009af0 0x7ff200009f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc00a8c0 tx=0x7ff1fc02b250 comp rx=0 tx=0).stop 2024-09-12T01:36:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc016574640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0080e09c0 0x7fc0080defe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff20dbea640 1 -- 172.21.15.60:0/841917712 shutdown_connections 2024-09-12T01:36:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff20dbea640 1 --2- 172.21.15.60:0/841917712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff200009af0 0x7ff200009f40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff20dbea640 1 --2- 172.21.15.60:0/841917712 >> v2:172.21.15.105:3300/0 conn(0x7ff2000323c0 0x7ff200052350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff20dbea640 1 -- 172.21.15.60:0/841917712 >> 172.21.15.60:0/841917712 conn(0x7ff200036090 msgr2=0x7ff2000364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fb77b75f640 1 -- 172.21.15.60:0/1827329394 shutdown_connections 2024-09-12T01:36:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fb77b75f640 1 -- 172.21.15.60:0/1827329394 >> 172.21.15.60:0/1827329394 conn(0x7fb76c01dd80 msgr2=0x7fb76c0549f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc014d71640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc008035a80 0x7fc0080dbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fb77b75f640 1 -- 172.21.15.60:0/1827329394 shutdown_connections 2024-09-12T01:36:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc68bfff640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6840551b0 0x7fc68417da90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc68000b410 tx=0x7fc680009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc014d71640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc008035a80 0x7fc0080dbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:53874/0 (socket says 172.21.15.60:53874) 2024-09-12T01:36:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc015d73640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0080e09c0 0x7fc0080defe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc015d73640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0080e09c0 0x7fc0080defe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49172/0 (socket says 172.21.15.60:49172) 2024-09-12T01:36:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc016574640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc008051620 con 0x7fc0080e09c0 2024-09-12T01:36:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc016574640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc0080514a0 con 0x7fc0080354c0 2024-09-12T01:36:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc016574640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc0080517a0 con 0x7fc008035a80 2024-09-12T01:36:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc015572640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0080354c0 0x7fc0080d67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc015572640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0080354c0 0x7fc0080d67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48240/0 (socket says 172.21.15.60:48240) 2024-09-12T01:36:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc014d71640 1 -- 172.21.15.60:0/138823651 learned_addr learned my addr 172.21.15.60:0/138823651 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff1c5555640 1 -- 172.21.15.60:0/2507180391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1b80e6f80 msgr2=0x7ff1b817d370 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:36:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff1c5555640 1 --2- 172.21.15.60:0/2507180391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1b80e6f80 0x7ff1b817d370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff1c5555640 1 -- 172.21.15.60:0/2507180391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1b804b5e0 msgr2=0x7ff1b804fb90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:36:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff1c5555640 1 --2- 172.21.15.60:0/2507180391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1b804b5e0 0x7ff1b804fb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff1c5555640 1 -- 172.21.15.60:0/2507180391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b804bf80 con 0x7ff1b8033a00 2024-09-12T01:36:06.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fb77b75f640 1 -- 172.21.15.60:0/1827329394 wait complete. 2024-09-12T01:36:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff20dbea640 1 -- 172.21.15.60:0/841917712 shutdown_connections 2024-09-12T01:36:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc688ff9640 1 -- 172.21.15.60:0/1347660513 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680015030 con 0x7fc6840551b0 2024-09-12T01:36:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc688ff9640 1 -- 172.21.15.60:0/1347660513 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6800059c0 con 0x7fc6840551b0 2024-09-12T01:36:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7ff20dbea640 1 -- 172.21.15.60:0/841917712 wait complete. 2024-09-12T01:36:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.021+0000 7fc691284640 1 -- 172.21.15.60:0/1347660513 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc68404cac0 con 0x7fc6840551b0 2024-09-12T01:36:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7fc688ff9640 1 -- 172.21.15.60:0/1347660513 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680005dd0 con 0x7fc6840551b0 2024-09-12T01:36:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7fc014d71640 1 -- 172.21.15.60:0/138823651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0080354c0 msgr2=0x7fc0080d67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7fc014d71640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0080354c0 0x7fc0080d67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7fc014d71640 1 -- 172.21.15.60:0/138823651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0080e09c0 msgr2=0x7fc0080defe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7fc014d71640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0080e09c0 0x7fc0080defe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7fc014d71640 1 -- 172.21.15.60:0/138823651 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0080374d0 con 0x7fc008035a80 2024-09-12T01:36:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7fc015572640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0080354c0 0x7fc0080d67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7fc014d71640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc008035a80 0x7fc0080dbc50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc00000c450 tx=0x7fc00000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7fc015d73640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0080e09c0 0x7fc0080defe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7fc691284640 1 -- 172.21.15.60:0/1347660513 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc68404d080 con 0x7fc6840551b0 2024-09-12T01:36:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7ff1c5555640 1 --2- 172.21.15.60:0/2507180391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b8033a00 0x7ff1b804e1e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00bd80 tx=0x7ff1bc009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7ff1b5ffb640 1 -- 172.21.15.60:0/2507180391 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc006480 con 0x7ff1b8033a00 2024-09-12T01:36:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7f753cb74640 1 -- 172.21.15.60:0/3492417641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75380b6630 msgr2=0x7f7538169140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7f753cb74640 1 --2- 172.21.15.60:0/3492417641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75380b6630 0x7f7538169140 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7530009e50 tx=0x7f753002a760 comp rx=0 tx=0).stop 2024-09-12T01:36:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.023+0000 7f68999f8640 1 Processor -- start 2024-09-12T01:36:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.023+0000 7fb77b75f640 1 Processor -- start 2024-09-12T01:36:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.023+0000 7fdc0ec96640 1 Processor -- start 2024-09-12T01:36:06.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.023+0000 7ff20dbea640 1 Processor -- start 2024-09-12T01:36:06.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.023+0000 7fdc0ec96640 1 -- start start 2024-09-12T01:36:06.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.023+0000 7fb77b75f640 1 -- start start 2024-09-12T01:36:06.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.023+0000 7ff20dbea640 1 -- start start 2024-09-12T01:36:06.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.023+0000 7f68999f8640 1 -- start start 2024-09-12T01:36:06.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7f753cb74640 1 -- 172.21.15.60:0/3492417641 shutdown_connections 2024-09-12T01:36:06.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7f753cb74640 1 --2- 172.21.15.60:0/3492417641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75380b6630 0x7f7538169140 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7f753cb74640 1 -- 172.21.15.60:0/3492417641 >> 172.21.15.60:0/3492417641 conn(0x7f75380d0f20 msgr2=0x7f75380d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7fb77b75f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb760003a00 0x7fb76c054ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7fdc0ec96640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8004bd0 0x7fdc081f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7fdc0ec96640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc081f4bc0 0x7fdc0814a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7fb77b75f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb76c1753f0 0x7fb76c174080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7fdc0ec96640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc080b9090 0x7fdc080b9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7fdc0ec96640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdc080d0150 con 0x7fdbf8004bd0 2024-09-12T01:36:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7fdc0ec96640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdc080d3d30 con 0x7fdc080b9090 2024-09-12T01:36:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7fdc0ec96640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdc080d02d0 con 0x7fdc081f4bc0 2024-09-12T01:36:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7ff20dbea640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff200009af0 0x7ff2000e1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fb77b75f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb76c0504c0 0x7fb76c050940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7ff20dbea640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2000323c0 0x7ff20004d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fc005ffb640 1 -- 172.21.15.60:0/138823651 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0000052d0 con 0x7fc008035a80 2024-09-12T01:36:06.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fc005ffb640 1 -- 172.21.15.60:0/138823651 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc000005470 con 0x7fc008035a80 2024-09-12T01:36:06.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fc005ffb640 1 -- 172.21.15.60:0/138823651 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc000012850 con 0x7fc008035a80 2024-09-12T01:36:06.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7ff20dbea640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2000dec70 0x7ff20000a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7f68999f8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f68940b60e0 0x7f6894166db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7f6892ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f68941492f0 0x7f68941666a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50178/0 (socket says 172.21.15.60:50178) 2024-09-12T01:36:06.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7f6892ffd640 1 -- 172.21.15.60:0/218394009 learned_addr learned my addr 172.21.15.60:0/218394009 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:06.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7f68999f8640 1 --2- 172.21.15.60:0/218394009 >> v2:172.21.15.105:3300/0 conn(0x7f68940b4700 0x7f68940b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fc016574640 1 -- 172.21.15.60:0/138823651 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0080d6d20 con 0x7fc008035a80 2024-09-12T01:36:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7ff20dbea640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff200032980 con 0x7ff2000323c0 2024-09-12T01:36:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7f68927fc640 1 --2- 172.21.15.60:0/218394009 >> v2:172.21.15.60:3300/0 conn(0x7f68940b60e0 0x7f6894166db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7ff20dbea640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff2000df050 con 0x7ff2000dec70 2024-09-12T01:36:06.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fdc0ca32640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8004bd0 0x7fdc081f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fb77b75f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c006d40 con 0x7fb76c0504c0 2024-09-12T01:36:06.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fb77b75f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb76c0068b0 con 0x7fb76c1753f0 2024-09-12T01:36:06.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fb77b75f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb76c175aa0 con 0x7fb760003a00 2024-09-12T01:36:06.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fb7794fb640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb760003a00 0x7fb76c054ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fb7794fb640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb760003a00 0x7fb76c054ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:53884/0 (socket says 172.21.15.60:53884) 2024-09-12T01:36:06.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fb7794fb640 1 -- 172.21.15.60:0/425558835 learned_addr learned my addr 172.21.15.60:0/425558835 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:06.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fb779cfc640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb76c0504c0 0x7fb76c050940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fb778cfa640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb76c1753f0 0x7fb76c174080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7ff20d3e9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2000dec70 0x7ff20000a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7ff20d3e9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2000dec70 0x7ff20000a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48270/0 (socket says 172.21.15.60:48270) 2024-09-12T01:36:06.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7ff20d3e9640 1 -- 172.21.15.60:0/2608325063 learned_addr learned my addr 172.21.15.60:0/2608325063 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:06.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7ff207fff640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2000323c0 0x7ff20004d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7ff20dbea640 1 -- 172.21.15.60:0/2608325063 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff200052890 con 0x7ff200009af0 2024-09-12T01:36:06.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fdc0ca32640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8004bd0 0x7fdc081f52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49200/0 (socket says 172.21.15.60:49200) 2024-09-12T01:36:06.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fdc0ca32640 1 -- 172.21.15.60:0/2006303406 learned_addr learned my addr 172.21.15.60:0/2006303406 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:06.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7ff1b5ffb640 1 -- 172.21.15.60:0/2507180391 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1bc010070 con 0x7ff1b8033a00 2024-09-12T01:36:06.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7ff1b5ffb640 1 -- 172.21.15.60:0/2507180391 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc0068c0 con 0x7ff1b8033a00 2024-09-12T01:36:06.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.022+0000 7ff1c77b9640 1 -- 172.21.15.60:0/2507180391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b804c260 con 0x7ff1b8033a00 2024-09-12T01:36:06.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.023+0000 7ff1c77b9640 1 -- 172.21.15.60:0/2507180391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b817d8b0 con 0x7ff1b8033a00 2024-09-12T01:36:06.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7ff1c77b9640 1 -- 172.21.15.60:0/2507180391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b8047c10 con 0x7ff1b8033a00 2024-09-12T01:36:06.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fc016574640 1 -- 172.21.15.60:0/138823651 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc008037a50 con 0x7fc008035a80 2024-09-12T01:36:06.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fb778cfa640 1 -- 172.21.15.60:0/425558835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb760003a00 msgr2=0x7fb76c054ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fdc07fff640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc081f4bc0 0x7fdc0814a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fb778cfa640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb760003a00 0x7fb76c054ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7fb778cfa640 1 -- 172.21.15.60:0/425558835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb76c0504c0 msgr2=0x7fb76c050940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7f753cb74640 1 -- 172.21.15.60:0/3492417641 shutdown_connections 2024-09-12T01:36:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7fb778cfa640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb76c0504c0 0x7fb76c050940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7fdc0d233640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc080b9090 0x7fdc080b9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7fb778cfa640 1 -- 172.21.15.60:0/425558835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb76c175850 con 0x7fb76c1753f0 2024-09-12T01:36:06.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7f68999f8640 1 -- 172.21.15.60:0/218394009 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68940b3f40 con 0x7f68941492f0 2024-09-12T01:36:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7f68999f8640 1 -- 172.21.15.60:0/218394009 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6894070fb0 con 0x7f68940b60e0 2024-09-12T01:36:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7f68999f8640 1 -- 172.21.15.60:0/218394009 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6894071200 con 0x7f68940b4700 2024-09-12T01:36:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7f68937fe640 1 --2- 172.21.15.60:0/218394009 >> v2:172.21.15.105:3300/0 conn(0x7f68940b4700 0x7f68940b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7ff1b5ffb640 1 -- 172.21.15.60:0/2507180391 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1bc015470 con 0x7ff1b8033a00 2024-09-12T01:36:06.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7ff1b5ffb640 1 --2- 172.21.15.60:0/2507180391 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1a406be30 0x7ff1a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.025+0000 7ff20cbe8640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff200009af0 0x7ff2000e1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7ff20cbe8640 1 -- 172.21.15.60:0/2608325063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2000dec70 msgr2=0x7ff20000a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7ff20cbe8640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2000dec70 0x7ff20000a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7ff20cbe8640 1 -- 172.21.15.60:0/2608325063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2000323c0 msgr2=0x7ff20004d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7ff20cbe8640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2000323c0 0x7ff20004d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7ff20cbe8640 1 -- 172.21.15.60:0/2608325063 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2000e02c0 con 0x7ff200009af0 2024-09-12T01:36:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.024+0000 7fc6767fc640 1 -- 172.21.15.60:0/1347660513 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc684007340 con 0x7fc6840551b0 2024-09-12T01:36:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7fc688ff9640 1 -- 172.21.15.60:0/1347660513 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc680018070 con 0x7fc6840551b0 2024-09-12T01:36:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7fc688ff9640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc67006bf00 0x7fc67006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.027+0000 7fc688ff9640 1 -- 172.21.15.60:0/1347660513 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc68008a7d0 con 0x7fc6840551b0 2024-09-12T01:36:06.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7fb779cfc640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb76c0504c0 0x7fb76c050940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:06.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.027+0000 7fb7794fb640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb760003a00 0x7fb76c054ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:06.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7f753cb74640 1 -- 172.21.15.60:0/3492417641 wait complete. 2024-09-12T01:36:06.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7fdc0d233640 1 -- 172.21.15.60:0/2006303406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc081f4bc0 msgr2=0x7fdc0814a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7fdc0d233640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc081f4bc0 0x7fdc0814a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7fdc0d233640 1 -- 172.21.15.60:0/2006303406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8004bd0 msgr2=0x7fdc081f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7fdc0d233640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8004bd0 0x7fdc081f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7fdc0d233640 1 -- 172.21.15.60:0/2006303406 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0815ab00 con 0x7fdc080b9090 2024-09-12T01:36:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7ff1c4d54640 1 --2- 172.21.15.60:0/2507180391 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1a406be30 0x7ff1a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.027+0000 7ff1b5ffb640 1 -- 172.21.15.60:0/2507180391 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff1bc08b970 con 0x7ff1b8033a00 2024-09-12T01:36:06.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.027+0000 7fc016574640 1 -- 172.21.15.60:0/138823651 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0080108d0 con 0x7fc008035a80 2024-09-12T01:36:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.027+0000 7fb778cfa640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb76c1753f0 0x7fb76c174080 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00b440 tx=0x7fb77000dc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.027+0000 7fc68b7fe640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc67006bf00 0x7fc67006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7f68937fe640 1 -- 172.21.15.60:0/218394009 >> v2:172.21.15.60:3300/0 conn(0x7f68940b60e0 msgr2=0x7f6894166db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7f68937fe640 1 --2- 172.21.15.60:0/218394009 >> v2:172.21.15.60:3300/0 conn(0x7f68940b60e0 0x7f6894166db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7f68937fe640 1 -- 172.21.15.60:0/218394009 >> v1:172.21.15.60:6789/0 conn(0x7f68941492f0 legacy=0x7f68941666a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.026+0000 7f68937fe640 1 -- 172.21.15.60:0/218394009 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6894073d90 con 0x7f68940b4700 2024-09-12T01:36:06.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.027+0000 7f68927fc640 1 --2- 172.21.15.60:0/218394009 >> v2:172.21.15.60:3300/0 conn(0x7f68940b60e0 0x7f6894166db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.027+0000 7fdc0d233640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc080b9090 0x7fdc080b9540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdc080d5860 tx=0x7fdc0000ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.027+0000 7fb769ffb640 1 -- 172.21.15.60:0/425558835 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770019070 con 0x7fb76c1753f0 2024-09-12T01:36:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.027+0000 7fb77b75f640 1 -- 172.21.15.60:0/425558835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb76c055170 con 0x7fb76c1753f0 2024-09-12T01:36:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.027+0000 7ff1c4d54640 1 --2- 172.21.15.60:0/2507180391 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1a406be30 0x7ff1a406e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0034000 tx=0x7ff1b002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7ff20cbe8640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff200009af0 0x7ff2000e1360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400b3c0 tx=0x7ff1f400b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7fdc057fa640 1 -- 172.21.15.60:0/2006303406 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00006b50 con 0x7fdc080b9090 2024-09-12T01:36:06.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7f753cb74640 1 Processor -- start 2024-09-12T01:36:06.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7fdc057fa640 1 -- 172.21.15.60:0/2006303406 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc00006cf0 con 0x7fdc080b9090 2024-09-12T01:36:06.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7fdc057fa640 1 -- 172.21.15.60:0/2006303406 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00003970 con 0x7fdc080b9090 2024-09-12T01:36:06.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7f753cb74640 1 -- start start 2024-09-12T01:36:06.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7f68937fe640 1 --2- 172.21.15.60:0/218394009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b4700 0x7f68940b4b90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6894070d70 tx=0x7f688802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34ad180b4d578f28 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7fc68b7fe640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc67006bf00 0x7fc67006e3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc678033000 tx=0x7fc678008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7f6891ffb640 1 -- 172.21.15.60:0/218394009 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888037070 con 0x7f68940b4700 2024-09-12T01:36:06.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7f6891ffb640 1 -- 172.21.15.60:0/218394009 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6888032440 con 0x7f68940b4700 2024-09-12T01:36:06.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7fb77b75f640 1 -- 172.21.15.60:0/425558835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb76c175d40 con 0x7fb76c1753f0 2024-09-12T01:36:06.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7fb769ffb640 1 -- 172.21.15.60:0/425558835 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7700074e0 con 0x7fb76c1753f0 2024-09-12T01:36:06.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.028+0000 7fb769ffb640 1 -- 172.21.15.60:0/425558835 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770019070 con 0x7fb76c1753f0 2024-09-12T01:36:06.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7fdc0ec96640 1 -- 172.21.15.60:0/2006303406 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc08159f80 con 0x7fdc080b9090 2024-09-12T01:36:06.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7fdc0ec96640 1 -- 172.21.15.60:0/2006303406 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0815a540 con 0x7fdc080b9090 2024-09-12T01:36:06.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7fc005ffb640 1 -- 172.21.15.60:0/138823651 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0000129f0 con 0x7fc008035a80 2024-09-12T01:36:06.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f6891ffb640 1 -- 172.21.15.60:0/218394009 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688802ae60 con 0x7f68940b4700 2024-09-12T01:36:06.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7fb77b75f640 1 -- 172.21.15.60:0/425558835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb754005290 con 0x7fb76c1753f0 2024-09-12T01:36:06.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f753cb74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75380b6630 0x7f75381e98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f753cb74640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f753815e6b0 0x7f7538160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f68999f8640 1 -- 172.21.15.60:0/218394009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b4700 msgr2=0x7f68940b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f68999f8640 1 --2- 172.21.15.60:0/218394009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b4700 0x7f68940b4b90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6894070d70 tx=0x7f688802a110 comp rx=0 tx=0).stop 2024-09-12T01:36:06.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f753cb74640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75381e8950 0x7f75381e6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f68999f8640 1 -- 172.21.15.60:0/218394009 shutdown_connections 2024-09-12T01:36:06.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f68999f8640 1 --2- 172.21.15.60:0/218394009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b4700 0x7f68940b4b90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f68999f8640 1 --2- 172.21.15.60:0/218394009 >> v2:172.21.15.60:3300/0 conn(0x7f68940b60e0 0x7f6894166db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f68999f8640 1 -- 172.21.15.60:0/218394009 >> 172.21.15.60:0/218394009 conn(0x7f689406d0f0 msgr2=0x7f689406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f753cb74640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f75380b8aa0 con 0x7f75380b6630 2024-09-12T01:36:06.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f753cb74640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75380b8920 con 0x7f75381e8950 2024-09-12T01:36:06.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f753cb74640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f75380b8c20 con 0x7f753815e6b0 2024-09-12T01:36:06.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f75377fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75380b6630 0x7f75381e98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f75377fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75380b6630 0x7f75381e98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49238/0 (socket says 172.21.15.60:49238) 2024-09-12T01:36:06.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.029+0000 7f75377fe640 1 -- 172.21.15.60:0/1193494836 learned_addr learned my addr 172.21.15.60:0/1193494836 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:06.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7fc005ffb640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbff406be80 0x7fbff406e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7f7536ffd640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f753815e6b0 0x7f7538160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7f7537fff640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75381e8950 0x7f75381e6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7fc015572640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbff406be80 0x7fbff406e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7f68999f8640 1 -- 172.21.15.60:0/218394009 shutdown_connections 2024-09-12T01:36:06.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7f68999f8640 1 -- 172.21.15.60:0/218394009 wait complete. 2024-09-12T01:36:06.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7f7536ffd640 1 -- 172.21.15.60:0/1193494836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75381e8950 msgr2=0x7f75381e6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7f7536ffd640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75381e8950 0x7f75381e6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7f7536ffd640 1 -- 172.21.15.60:0/1193494836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75380b6630 msgr2=0x7f75381e98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7fdc0ec96640 1 -- 172.21.15.60:0/2006303406 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc0815bd20 con 0x7fdc080b9090 2024-09-12T01:36:06.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7f7536ffd640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75380b6630 0x7f75381e98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7f7536ffd640 1 -- 172.21.15.60:0/1193494836 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75381e7c00 con 0x7f753815e6b0 2024-09-12T01:36:06.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.030+0000 7f7536ffd640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f753815e6b0 0x7f7538160ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f75380d55a0 tx=0x7f752800c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.031+0000 7fb769ffb640 1 -- 172.21.15.60:0/425558835 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7700047e0 con 0x7fb76c1753f0 2024-09-12T01:36:06.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.031+0000 7fc015572640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbff406be80 0x7fbff406e340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc00c03d000 tx=0x7fc00c037000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.031+0000 7fdc057fa640 1 -- 172.21.15.60:0/2006303406 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc0001a020 con 0x7fdc080b9090 2024-09-12T01:36:06.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.031+0000 7fb769ffb640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb75806c260 0x7fb75806e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.031+0000 7fb769ffb640 1 -- 172.21.15.60:0/425558835 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb7700072e0 con 0x7fb76c1753f0 2024-09-12T01:36:06.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.031+0000 7fb7794fb640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb75806c260 0x7fb75806e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.031+0000 7fdc057fa640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdbec06be80 0x7fdbec06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.032+0000 7f68999f8640 1 Processor -- start 2024-09-12T01:36:06.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.032+0000 7fdc057fa640 1 -- 172.21.15.60:0/2006303406 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdc0008a430 con 0x7fdc080b9090 2024-09-12T01:36:06.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.032+0000 7fdc0ca32640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdbec06be80 0x7fdbec06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.032+0000 7f68999f8640 1 -- start start 2024-09-12T01:36:06.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.032+0000 7fb7794fb640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb75806c260 0x7fb75806e720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb7640093c0 tx=0x7fb764008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.032+0000 7fdc0ca32640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdbec06be80 0x7fdbec06e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc001dc0 tx=0x7fdbfc02d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.032+0000 7f752ffff640 1 -- 172.21.15.60:0/1193494836 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528005220 con 0x7f753815e6b0 2024-09-12T01:36:06.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.032+0000 7fc005ffb640 1 -- 172.21.15.60:0/138823651 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc000056d20 con 0x7fc008035a80 2024-09-12T01:36:06.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.032+0000 7ff2057fa640 1 -- 172.21.15.60:0/2608325063 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4016070 con 0x7ff200009af0 2024-09-12T01:36:06.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f753cb74640 1 -- 172.21.15.60:0/1193494836 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75381e7e70 con 0x7f753815e6b0 2024-09-12T01:36:06.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7fc688ff9640 1 -- 172.21.15.60:0/1347660513 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc680059160 con 0x7fc6840551b0 2024-09-12T01:36:06.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7ff20dbea640 1 -- 172.21.15.60:0/2608325063 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2000e05a0 con 0x7ff200009af0 2024-09-12T01:36:06.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7ff20dbea640 1 -- 172.21.15.60:0/2608325063 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2000e0b60 con 0x7ff200009af0 2024-09-12T01:36:06.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f68999f8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b4700 0x7f68940c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f753cb74640 1 -- 172.21.15.60:0/1193494836 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75381e8430 con 0x7f753815e6b0 2024-09-12T01:36:06.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7ff1b5ffb640 1 -- 172.21.15.60:0/2507180391 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1bc05a310 con 0x7ff1b8033a00 2024-09-12T01:36:06.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f68999f8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68940b60e0 0x7f6894142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f68999f8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68941492f0 0x7f6894144560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f68999f8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6894167470 con 0x7f68940b60e0 2024-09-12T01:36:06.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f68999f8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68941672f0 con 0x7f68940b4700 2024-09-12T01:36:06.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f68999f8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68940b50d0 con 0x7f68941492f0 2024-09-12T01:36:06.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f6892ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b4700 0x7f68940c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f6892ffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b4700 0x7f68940c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48298/0 (socket says 172.21.15.60:48298) 2024-09-12T01:36:06.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f6892ffd640 1 -- 172.21.15.60:0/1531243467 learned_addr learned my addr 172.21.15.60:0/1531243467 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:06.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f68927fc640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68940b60e0 0x7f6894142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f68937fe640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68941492f0 0x7f6894144560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f6892ffd640 1 -- 172.21.15.60:0/1531243467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68941492f0 msgr2=0x7f6894144560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f6892ffd640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68941492f0 0x7f6894144560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f6892ffd640 1 -- 172.21.15.60:0/1531243467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68940b60e0 msgr2=0x7f6894142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f6892ffd640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68940b60e0 0x7f6894142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f6892ffd640 1 -- 172.21.15.60:0/1531243467 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68940c6510 con 0x7f68940b4700 2024-09-12T01:36:06.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.033+0000 7f68937fe640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68941492f0 0x7f6894144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:06.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.034+0000 7f6892ffd640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b4700 0x7f68940c5e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f688400c3f0 tx=0x7f688400c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.034+0000 7f753cb74640 1 -- 172.21.15.60:0/1193494836 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75380b5f20 con 0x7f753815e6b0 2024-09-12T01:36:06.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.034+0000 7ff20dbea640 1 -- 172.21.15.60:0/2608325063 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff20004ddd0 con 0x7ff200009af0 2024-09-12T01:36:06.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.040+0000 7fb769ffb640 1 -- 172.21.15.60:0/425558835 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb770022020 con 0x7fb76c1753f0 2024-09-12T01:36:06.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.042+0000 7ff2057fa640 1 -- 172.21.15.60:0/2608325063 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f4006070 con 0x7ff200009af0 2024-09-12T01:36:06.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.042+0000 7ff2057fa640 1 -- 172.21.15.60:0/2608325063 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4020060 con 0x7ff200009af0 2024-09-12T01:36:06.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.042+0000 7f752ffff640 1 -- 172.21.15.60:0/1193494836 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75280053c0 con 0x7f753815e6b0 2024-09-12T01:36:06.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.042+0000 7f752ffff640 1 -- 172.21.15.60:0/1193494836 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7528007250 con 0x7f753815e6b0 2024-09-12T01:36:06.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.043+0000 7fc005ffb640 1 -- 172.21.15.60:0/138823651 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc008038e80 con 0x7fc008035a80 2024-09-12T01:36:06.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.044+0000 7ff2057fa640 1 -- 172.21.15.60:0/2608325063 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff1f4019070 con 0x7ff200009af0 2024-09-12T01:36:06.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.044+0000 7f752ffff640 1 -- 172.21.15.60:0/1193494836 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7528019020 con 0x7f753815e6b0 2024-09-12T01:36:06.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.044+0000 7ff2057fa640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1ec06be30 0x7ff1ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.044+0000 7ff2057fa640 1 -- 172.21.15.60:0/2608325063 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff1f408a9f0 con 0x7ff200009af0 2024-09-12T01:36:06.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.045+0000 7f752ffff640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f751806be60 0x7f751806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.045+0000 7f752ffff640 1 -- 172.21.15.60:0/1193494836 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f752808a280 con 0x7f753815e6b0 2024-09-12T01:36:06.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.045+0000 7f75377fe640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f751806be60 0x7f751806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.045+0000 7ff207fff640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1ec06be30 0x7ff1ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.045+0000 7f75377fe640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f751806be60 0x7f751806e320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f75381fbf30 tx=0x7f7520009110 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.045+0000 7ff207fff640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1ec06be30 0x7ff1ec06e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2080518b0 tx=0x7ff20806e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.049+0000 7f687bfff640 1 -- 172.21.15.60:0/1531243467 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6884017070 con 0x7f68940b4700 2024-09-12T01:36:06.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.049+0000 7fdc057fa640 1 -- 172.21.15.60:0/2006303406 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc00058f50 con 0x7fdc080b9090 2024-09-12T01:36:06.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.049+0000 7f687bfff640 1 -- 172.21.15.60:0/1531243467 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6884005ce0 con 0x7f68940b4700 2024-09-12T01:36:06.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.049+0000 7f68999f8640 1 -- 172.21.15.60:0/1531243467 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68940c67f0 con 0x7f68940b4700 2024-09-12T01:36:06.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.049+0000 7f687bfff640 1 -- 172.21.15.60:0/1531243467 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68840072f0 con 0x7f68940b4700 2024-09-12T01:36:06.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.049+0000 7f68999f8640 1 -- 172.21.15.60:0/1531243467 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68940c6db0 con 0x7f68940b4700 2024-09-12T01:36:06.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.052+0000 7ff2057fa640 1 -- 172.21.15.60:0/2608325063 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff1f4058ca0 con 0x7ff200009af0 2024-09-12T01:36:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.052+0000 7f687bfff640 1 -- 172.21.15.60:0/1531243467 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f688401a070 con 0x7f68940b4700 2024-09-12T01:36:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.052+0000 7f687bfff640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f688006be80 0x7f688006e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.052+0000 7f687bfff640 1 -- 172.21.15.60:0/1531243467 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f688408a060 con 0x7f68940b4700 2024-09-12T01:36:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.053+0000 7f68927fc640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f688006be80 0x7f688006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.053+0000 7f68927fc640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f688006be80 0x7f688006e340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f68941fbfb0 tx=0x7f688c007810 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.053+0000 7f68999f8640 1 -- 172.21.15.60:0/1531243467 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68940cdfd0 con 0x7f68940b4700 2024-09-12T01:36:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.057+0000 7f752ffff640 1 -- 172.21.15.60:0/1193494836 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75280585c0 con 0x7f753815e6b0 2024-09-12T01:36:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.061+0000 7f687bfff640 1 -- 172.21.15.60:0/1531243467 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f68940cdfd0 con 0x7f68940b4700 2024-09-12T01:36:06.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.445+0000 7ff1c77b9640 1 -- 172.21.15.60:0/2507180391 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff1b80e2820 con 0x7ff1b8033a00 2024-09-12T01:36:06.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.446+0000 7ff1b5ffb640 1 -- 172.21.15.60:0/2507180391 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff1bc059c10 con 0x7ff1b8033a00 2024-09-12T01:36:06.445 INFO:teuthology.orchestra.run.smithi060.stdout:64424509445 2024-09-12T01:36:06.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.448+0000 7fc6767fc640 1 -- 172.21.15.60:0/1347660513 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc684051e00 con 0x7fc6840551b0 2024-09-12T01:36:06.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7ff1c77b9640 1 -- 172.21.15.60:0/2507180391 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1a406be30 msgr2=0x7ff1a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7ff1c77b9640 1 --2- 172.21.15.60:0/2507180391 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1a406be30 0x7ff1a406e2f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff1b0034000 tx=0x7ff1b002e000 comp rx=0 tx=0).stop 2024-09-12T01:36:06.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7ff1c77b9640 1 -- 172.21.15.60:0/2507180391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b8033a00 msgr2=0x7ff1b804e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7ff1c77b9640 1 --2- 172.21.15.60:0/2507180391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b8033a00 0x7ff1b804e1e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00bd80 tx=0x7ff1bc009ed0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7ff1c77b9640 1 -- 172.21.15.60:0/2507180391 shutdown_connections 2024-09-12T01:36:06.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7ff1c77b9640 1 --2- 172.21.15.60:0/2507180391 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1b804b5e0 0x7ff1b804fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7ff1c77b9640 1 --2- 172.21.15.60:0/2507180391 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1a406be30 0x7ff1a406e2f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7ff1c77b9640 1 --2- 172.21.15.60:0/2507180391 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff1b80e6f80 0x7ff1b817d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7ff1c77b9640 1 --2- 172.21.15.60:0/2507180391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1b8033a00 0x7ff1b804e1e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7ff1c77b9640 1 -- 172.21.15.60:0/2507180391 >> 172.21.15.60:0/2507180391 conn(0x7ff1b801d930 msgr2=0x7ff1b80e5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7ff1c77b9640 1 -- 172.21.15.60:0/2507180391 shutdown_connections 2024-09-12T01:36:06.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7ff1c77b9640 1 -- 172.21.15.60:0/2507180391 wait complete. 2024-09-12T01:36:06.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.449+0000 7fc688ff9640 1 -- 172.21.15.60:0/1347660513 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc680058a60 con 0x7fc6840551b0 2024-09-12T01:36:06.449 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2024-09-12T01:36:06.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.451+0000 7fb77b75f640 1 -- 172.21.15.60:0/425558835 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb754005850 con 0x7fb76c1753f0 2024-09-12T01:36:06.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.452+0000 7fb769ffb640 1 -- 172.21.15.60:0/425558835 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb770058880 con 0x7fb76c1753f0 2024-09-12T01:36:06.451 INFO:teuthology.orchestra.run.smithi060.stdout:64424509445 2024-09-12T01:36:06.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.452+0000 7fc016574640 1 -- 172.21.15.60:0/138823651 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc008034130 con 0x7fc008035a80 2024-09-12T01:36:06.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.453+0000 7fc005ffb640 1 -- 172.21.15.60:0/138823651 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc000058c80 con 0x7fc008035a80 2024-09-12T01:36:06.452 INFO:teuthology.orchestra.run.smithi060.stdout:64424509445 2024-09-12T01:36:06.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.453+0000 7fc6767fc640 1 -- 172.21.15.60:0/1347660513 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc67006bf00 msgr2=0x7fc67006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.453+0000 7fc6767fc640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc67006bf00 0x7fc67006e3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc678033000 tx=0x7fc678008030 comp rx=0 tx=0).stop 2024-09-12T01:36:06.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.453+0000 7fc6767fc640 1 -- 172.21.15.60:0/1347660513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6840551b0 msgr2=0x7fc68417da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.454+0000 7fc6767fc640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6840551b0 0x7fc68417da90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc68000b410 tx=0x7fc680009f90 comp rx=0 tx=0).stop 2024-09-12T01:36:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.454+0000 7fc6767fc640 1 -- 172.21.15.60:0/1347660513 shutdown_connections 2024-09-12T01:36:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.454+0000 7fc6767fc640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc684034e10 0x7fc6840352a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.454+0000 7fc6767fc640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc68404c630 0x7fc68417fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.454+0000 7fc6767fc640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc67006bf00 0x7fc67006e3c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.454+0000 7fc6767fc640 1 --2- 172.21.15.60:0/1347660513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6840551b0 0x7fc68417da90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.454+0000 7fc6767fc640 1 -- 172.21.15.60:0/1347660513 >> 172.21.15.60:0/1347660513 conn(0x7fc68401d930 msgr2=0x7fc6840540f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.455+0000 7fc6767fc640 1 -- 172.21.15.60:0/1347660513 shutdown_connections 2024-09-12T01:36:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.455+0000 7fc6767fc640 1 -- 172.21.15.60:0/1347660513 wait complete. 2024-09-12T01:36:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.455+0000 7fb77b75f640 1 -- 172.21.15.60:0/425558835 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb75806c260 msgr2=0x7fb75806e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.455+0000 7fb77b75f640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb75806c260 0x7fb75806e720 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb7640093c0 tx=0x7fb764008030 comp rx=0 tx=0).stop 2024-09-12T01:36:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.455+0000 7fb77b75f640 1 -- 172.21.15.60:0/425558835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb76c1753f0 msgr2=0x7fb76c174080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.455+0000 7fb77b75f640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb76c1753f0 0x7fb76c174080 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00b440 tx=0x7fb77000dc50 comp rx=0 tx=0).stop 2024-09-12T01:36:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.456+0000 7fb77b75f640 1 -- 172.21.15.60:0/425558835 shutdown_connections 2024-09-12T01:36:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.456+0000 7fb77b75f640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb76c0504c0 0x7fb76c050940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.456+0000 7fb77b75f640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb76c1753f0 0x7fb76c174080 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.456+0000 7fb77b75f640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb75806c260 0x7fb75806e720 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.456+0000 7fb77b75f640 1 --2- 172.21.15.60:0/425558835 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb760003a00 0x7fb76c054ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.456+0000 7fb77b75f640 1 -- 172.21.15.60:0/425558835 >> 172.21.15.60:0/425558835 conn(0x7fb76c01dd80 msgr2=0x7fb76c036e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.456+0000 7fb77b75f640 1 -- 172.21.15.60:0/425558835 shutdown_connections 2024-09-12T01:36:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.456+0000 7fb77b75f640 1 -- 172.21.15.60:0/425558835 wait complete. 2024-09-12T01:36:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.456+0000 7fc016574640 1 -- 172.21.15.60:0/138823651 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbff406be80 msgr2=0x7fbff406e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.456+0000 7fc016574640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbff406be80 0x7fbff406e340 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc00c03d000 tx=0x7fc00c037000 comp rx=0 tx=0).stop 2024-09-12T01:36:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.457+0000 7fc016574640 1 -- 172.21.15.60:0/138823651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc008035a80 msgr2=0x7fc0080dbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.457+0000 7fc016574640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc008035a80 0x7fc0080dbc50 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc00000c450 tx=0x7fc00000c910 comp rx=0 tx=0).stop 2024-09-12T01:36:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.457+0000 7fc016574640 1 -- 172.21.15.60:0/138823651 shutdown_connections 2024-09-12T01:36:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.457+0000 7fc016574640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0080e09c0 0x7fc0080defe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.457+0000 7fc016574640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbff406be80 0x7fbff406e340 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc00c03d000 tx=0x7fc00c037000 comp rx=0 tx=0).stop 2024-09-12T01:36:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.457+0000 7fc016574640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc008035a80 0x7fc0080dbc50 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.457+0000 7fc016574640 1 --2- 172.21.15.60:0/138823651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0080354c0 0x7fc0080d67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.457+0000 7fc016574640 1 -- 172.21.15.60:0/138823651 >> 172.21.15.60:0/138823651 conn(0x7fc0080567b0 msgr2=0x7fc008051b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.457+0000 7fc016574640 1 -- 172.21.15.60:0/138823651 shutdown_connections 2024-09-12T01:36:06.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.457+0000 7fc016574640 1 -- 172.21.15.60:0/138823651 wait complete. 2024-09-12T01:36:06.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.462+0000 7fdc0ec96640 1 -- 172.21.15.60:0/2006303406 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fdc0815ba40 con 0x7fdc080b9090 2024-09-12T01:36:06.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.462+0000 7fdc057fa640 1 -- 172.21.15.60:0/2006303406 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdc00058850 con 0x7fdc080b9090 2024-09-12T01:36:06.462 INFO:teuthology.orchestra.run.smithi060.stdout:64424509445 2024-09-12T01:36:06.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.464+0000 7ff20dbea640 1 -- 172.21.15.60:0/2608325063 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff200053e60 con 0x7ff200009af0 2024-09-12T01:36:06.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.465+0000 7ff2057fa640 1 -- 172.21.15.60:0/2608325063 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff1f405cfa0 con 0x7ff200009af0 2024-09-12T01:36:06.464 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T01:36:06.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.467+0000 7fdc0ec96640 1 -- 172.21.15.60:0/2006303406 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdbec06be80 msgr2=0x7fdbec06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.467+0000 7fdc0ec96640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdbec06be80 0x7fdbec06e340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc001dc0 tx=0x7fdbfc02d000 comp rx=0 tx=0).stop 2024-09-12T01:36:06.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.467+0000 7fdc0ec96640 1 -- 172.21.15.60:0/2006303406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc080b9090 msgr2=0x7fdc080b9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.467+0000 7fdc0ec96640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc080b9090 0x7fdc080b9540 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdc080d5860 tx=0x7fdc0000ebc0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.467+0000 7fdc0ec96640 1 -- 172.21.15.60:0/2006303406 shutdown_connections 2024-09-12T01:36:06.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.467+0000 7fdc0ec96640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc080b9090 0x7fdc080b9540 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.468+0000 7fdc0ec96640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdbec06be80 0x7fdbec06e340 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.468+0000 7fdc0ec96640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc081f4bc0 0x7fdc0814a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.468+0000 7fdc0ec96640 1 --2- 172.21.15.60:0/2006303406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbf8004bd0 0x7fdc081f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.468+0000 7fdc0ec96640 1 -- 172.21.15.60:0/2006303406 >> 172.21.15.60:0/2006303406 conn(0x7fdc0806c020 msgr2=0x7fdc080d2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.3 2024-09-12T01:36:06.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.469+0000 7fdc0ec96640 1 -- 172.21.15.60:0/2006303406 shutdown_connections 2024-09-12T01:36:06.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.469+0000 7fdc0ec96640 1 -- 172.21.15.60:0/2006303406 wait complete. 2024-09-12T01:36:06.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.469+0000 7ff20dbea640 1 -- 172.21.15.60:0/2608325063 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1ec06be30 msgr2=0x7ff1ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.469+0000 7ff20dbea640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1ec06be30 0x7ff1ec06e2f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2080518b0 tx=0x7ff20806e040 comp rx=0 tx=0).stop 2024-09-12T01:36:06.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.469+0000 7ff20dbea640 1 -- 172.21.15.60:0/2608325063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff200009af0 msgr2=0x7ff2000e1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.469+0000 7ff20dbea640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff200009af0 0x7ff2000e1360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff1f400b3c0 tx=0x7ff1f400b880 comp rx=0 tx=0).stop 2024-09-12T01:36:06.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.470+0000 7ff20dbea640 1 -- 172.21.15.60:0/2608325063 shutdown_connections 2024-09-12T01:36:06.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.470+0000 7ff20dbea640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2000dec70 0x7ff20000a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.470+0000 7ff20dbea640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2000323c0 0x7ff20004d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.470+0000 7ff20dbea640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1ec06be30 0x7ff1ec06e2f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.470+0000 7ff20dbea640 1 --2- 172.21.15.60:0/2608325063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff200009af0 0x7ff2000e1360 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.470+0000 7ff20dbea640 1 -- 172.21.15.60:0/2608325063 >> 172.21.15.60:0/2608325063 conn(0x7ff200036090 msgr2=0x7ff200034aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.470+0000 7ff20dbea640 1 -- 172.21.15.60:0/2608325063 shutdown_connections 2024-09-12T01:36:06.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.470+0000 7ff20dbea640 1 -- 172.21.15.60:0/2608325063 wait complete. 2024-09-12T01:36:06.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.471+0000 7f753cb74640 1 -- 172.21.15.60:0/1193494836 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f75381e8600 con 0x7f753815e6b0 2024-09-12T01:36:06.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.471+0000 7f752ffff640 1 -- 172.21.15.60:0/1193494836 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f752805c8c0 con 0x7f753815e6b0 2024-09-12T01:36:06.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.471+0000 7f68999f8640 1 -- 172.21.15.60:0/1531243467 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6894144aa0 con 0x7f68940b4700 2024-09-12T01:36:06.472 INFO:teuthology.orchestra.run.smithi060.stdout:64424509446 2024-09-12T01:36:06.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.472+0000 7f687bfff640 1 -- 172.21.15.60:0/1531243467 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f68840584a0 con 0x7f68940b4700 2024-09-12T01:36:06.473 INFO:teuthology.orchestra.run.smithi060.stdout:64424509445 2024-09-12T01:36:06.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2024-09-12T01:36:06.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f753cb74640 1 -- 172.21.15.60:0/1193494836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f751806be60 msgr2=0x7f751806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f753cb74640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f751806be60 0x7f751806e320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f75381fbf30 tx=0x7f7520009110 comp rx=0 tx=0).stop 2024-09-12T01:36:06.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f753cb74640 1 -- 172.21.15.60:0/1193494836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f753815e6b0 msgr2=0x7f7538160ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f753cb74640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f753815e6b0 0x7f7538160ed0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f75380d55a0 tx=0x7f752800c820 comp rx=0 tx=0).stop 2024-09-12T01:36:06.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f753cb74640 1 -- 172.21.15.60:0/1193494836 shutdown_connections 2024-09-12T01:36:06.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f753cb74640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75381e8950 0x7f75381e6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f753cb74640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f751806be60 0x7f751806e320 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f75381fbf30 tx=0x7f7520009110 comp rx=0 tx=0).stop 2024-09-12T01:36:06.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f753cb74640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f753815e6b0 0x7f7538160ed0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f753cb74640 1 --2- 172.21.15.60:0/1193494836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75380b6630 0x7f75381e98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f753cb74640 1 -- 172.21.15.60:0/1193494836 >> 172.21.15.60:0/1193494836 conn(0x7f75380d0f20 msgr2=0x7f75380b96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f68999f8640 1 -- 172.21.15.60:0/1531243467 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f688006be80 msgr2=0x7f688006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f68999f8640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f688006be80 0x7f688006e340 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f68941fbfb0 tx=0x7f688c007810 comp rx=0 tx=0).stop 2024-09-12T01:36:06.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f68999f8640 1 -- 172.21.15.60:0/1531243467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b4700 msgr2=0x7f68940c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:06.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.475+0000 7f68999f8640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b4700 0x7f68940c5e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f688400c3f0 tx=0x7f688400c8b0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.476+0000 7f68999f8640 1 -- 172.21.15.60:0/1531243467 shutdown_connections 2024-09-12T01:36:06.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.476+0000 7f68999f8640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f688006be80 0x7f688006e340 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.476+0000 7f68999f8640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68941492f0 0x7f6894144560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.476+0000 7f68999f8640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68940b60e0 0x7f6894142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.476+0000 7f753cb74640 1 -- 172.21.15.60:0/1193494836 shutdown_connections 2024-09-12T01:36:06.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.476+0000 7f68999f8640 1 --2- 172.21.15.60:0/1531243467 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68940b4700 0x7f68940c5e10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:06.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.476+0000 7f68999f8640 1 -- 172.21.15.60:0/1531243467 >> 172.21.15.60:0/1531243467 conn(0x7f689406d0f0 msgr2=0x7f689406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:06.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.476+0000 7f753cb74640 1 -- 172.21.15.60:0/1193494836 wait complete. 2024-09-12T01:36:06.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.476+0000 7f68999f8640 1 -- 172.21.15.60:0/1531243467 shutdown_connections 2024-09-12T01:36:06.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:06.476+0000 7f68999f8640 1 -- 172.21.15.60:0/1531243467 wait complete. 2024-09-12T01:36:06.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.5 2024-09-12T01:36:06.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.2 2024-09-12T01:36:06.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.1 2024-09-12T01:36:06.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509447 for osd.7 2024-09-12T01:36:06.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.6 2024-09-12T01:36:06.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509446 for osd.0 2024-09-12T01:36:07.470 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T01:36:07.475 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T01:36:07.479 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T01:36:07.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T01:36:07.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T01:36:07.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T01:36:07.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T01:36:07.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T01:36:07.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.642+0000 7f7d735fd640 1 Processor -- start 2024-09-12T01:36:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.642+0000 7f7d735fd640 1 -- start start 2024-09-12T01:36:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.643+0000 7f7d735fd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d6c06edf0 0x7f7d6c16d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.643+0000 7f7d735fd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d6c0736a0 con 0x7f7d6c149240 2024-09-12T01:36:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.643+0000 7f7d735fd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d6c073980 con 0x7f7d6c070fb0 2024-09-12T01:36:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.643+0000 7f7d735fd640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7d6c073fd0 con 0x7f7d6c06edf0 2024-09-12T01:36:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.644+0000 7f7d71399640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7d6c149240 0x7f7d6c0b6030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50180/0 (socket says 172.21.15.60:50180) 2024-09-12T01:36:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.644+0000 7f7d71399640 1 -- 172.21.15.60:0/4174376990 learned_addr learned my addr 172.21.15.60:0/4174376990 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.644+0000 7f7d71b9a640 1 --2- 172.21.15.60:0/4174376990 >> v2:172.21.15.60:3300/0 conn(0x7f7d6c06edf0 0x7f7d6c16d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.644+0000 7f7d71b9a640 1 -- 172.21.15.60:0/4174376990 >> v1:172.21.15.105:6789/0 conn(0x7f7d6c070fb0 legacy=0x7f7d6c06e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.645+0000 7f7d71b9a640 1 -- 172.21.15.60:0/4174376990 >> v1:172.21.15.60:6789/0 conn(0x7f7d6c149240 legacy=0x7f7d6c0b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.645+0000 7f7d71b9a640 1 -- 172.21.15.60:0/4174376990 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6c073c60 con 0x7f7d6c06edf0 2024-09-12T01:36:07.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.646+0000 7f7d71b9a640 1 --2- 172.21.15.60:0/4174376990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d6c06edf0 0x7f7d6c16d780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009d90 tx=0x7f7d6402a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996a4310390b3d2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.646+0000 7f7d63fff640 1 -- 172.21.15.60:0/4174376990 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d64007740 con 0x7f7d6c06edf0 2024-09-12T01:36:07.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.647+0000 7f7d63fff640 1 -- 172.21.15.60:0/4174376990 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d640078e0 con 0x7f7d6c06edf0 2024-09-12T01:36:07.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.648+0000 7f7d735fd640 1 -- 172.21.15.60:0/4174376990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d6c06edf0 msgr2=0x7f7d6c16d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.648+0000 7f7d735fd640 1 --2- 172.21.15.60:0/4174376990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d6c06edf0 0x7f7d6c16d780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009d90 tx=0x7f7d6402a560 comp rx=0 tx=0).stop 2024-09-12T01:36:07.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.648+0000 7f7d735fd640 1 -- 172.21.15.60:0/4174376990 shutdown_connections 2024-09-12T01:36:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.648+0000 7f7d735fd640 1 --2- 172.21.15.60:0/4174376990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d6c06edf0 0x7f7d6c16d780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.648+0000 7f7d735fd640 1 -- 172.21.15.60:0/4174376990 >> 172.21.15.60:0/4174376990 conn(0x7f7d6c0d03e0 msgr2=0x7f7d6c0d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:07.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.649+0000 7f7d735fd640 1 -- 172.21.15.60:0/4174376990 shutdown_connections 2024-09-12T01:36:07.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.649+0000 7f7d735fd640 1 -- 172.21.15.60:0/4174376990 wait complete. 2024-09-12T01:36:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.651+0000 7f7d735fd640 1 Processor -- start 2024-09-12T01:36:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.651+0000 7f7d735fd640 1 -- start start 2024-09-12T01:36:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.652+0000 7f7d735fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d6c06edf0 0x7f7d6c14a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.652+0000 7f7d735fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d6c070fb0 0x7f7d6c14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.652+0000 7f7d735fd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d6c149240 0x7f7d6c163da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.652+0000 7f7d70b98640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d6c070fb0 0x7f7d6c14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.652+0000 7f7d70b98640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d6c070fb0 0x7f7d6c14ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49274/0 (socket says 172.21.15.60:49274) 2024-09-12T01:36:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.652+0000 7f7d735fd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c0b46b0 con 0x7f7d6c070fb0 2024-09-12T01:36:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.652+0000 7f7d735fd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c0b4530 con 0x7f7d6c149240 2024-09-12T01:36:07.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.652+0000 7f7d735fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7d6c0b4830 con 0x7f7d6c06edf0 2024-09-12T01:36:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.653+0000 7f7d70b98640 1 -- 172.21.15.60:0/1009449839 learned_addr learned my addr 172.21.15.60:0/1009449839 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.653+0000 7f7d71b9a640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d6c149240 0x7f7d6c163da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.653+0000 7f7d70b98640 1 -- 172.21.15.60:0/1009449839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d6c06edf0 msgr2=0x7f7d6c14a7a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-12T01:36:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.653+0000 7f7d70b98640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d6c06edf0 0x7f7d6c14a7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.653+0000 7f7d70b98640 1 -- 172.21.15.60:0/1009449839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d6c149240 msgr2=0x7f7d6c163da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.653+0000 7f7d70b98640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d6c149240 0x7f7d6c163da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.653+0000 7f7d70b98640 1 -- 172.21.15.60:0/1009449839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6c1430c0 con 0x7f7d6c070fb0 2024-09-12T01:36:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.654+0000 7f7d70b98640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d6c070fb0 0x7f7d6c14ace0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800c750 tx=0x7f7d6800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.655+0000 7f7d61ffb640 1 -- 172.21.15.60:0/1009449839 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d680050d0 con 0x7f7d6c070fb0 2024-09-12T01:36:07.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.655+0000 7f7d735fd640 1 -- 172.21.15.60:0/1009449839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d6c13d100 con 0x7f7d6c070fb0 2024-09-12T01:36:07.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.656+0000 7f7d735fd640 1 -- 172.21.15.60:0/1009449839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d6c13d6c0 con 0x7f7d6c070fb0 2024-09-12T01:36:07.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.658+0000 7f7d61ffb640 1 -- 172.21.15.60:0/1009449839 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d68005270 con 0x7f7d6c070fb0 2024-09-12T01:36:07.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.659+0000 7f7d61ffb640 1 -- 172.21.15.60:0/1009449839 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800a640 con 0x7f7d6c070fb0 2024-09-12T01:36:07.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.659+0000 7f7d61ffb640 1 -- 172.21.15.60:0/1009449839 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d6800a880 con 0x7f7d6c070fb0 2024-09-12T01:36:07.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.659+0000 7f7d61ffb640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d5006bf30 0x7f7d5006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.659+0000 7f7d61ffb640 1 -- 172.21.15.60:0/1009449839 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7d6808ab80 con 0x7f7d6c070fb0 2024-09-12T01:36:07.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.660+0000 7f7d71399640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d5006bf30 0x7f7d5006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.661+0000 7f7d71399640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d5006bf30 0x7f7d5006e3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c001680 tx=0x7f7d5c0079e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.661+0000 7f7d735fd640 1 -- 172.21.15.60:0/1009449839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d4c005290 con 0x7f7d6c070fb0 2024-09-12T01:36:07.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.671+0000 7f7d61ffb640 1 -- 172.21.15.60:0/1009449839 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d680102e0 con 0x7f7d6c070fb0 2024-09-12T01:36:07.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.693+0000 7f354f0e9640 1 Processor -- start 2024-09-12T01:36:07.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.693+0000 7f354f0e9640 1 -- start start 2024-09-12T01:36:07.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.694+0000 7f354f0e9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35480b39c0 0x7f35480cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.694+0000 7f354f0e9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f354815e010 con 0x7f35480d0ae0 2024-09-12T01:36:07.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.694+0000 7f354f0e9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f354815e2f0 con 0x7f3548158030 2024-09-12T01:36:07.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.694+0000 7f354f0e9640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f354815e5d0 con 0x7f35480b39c0 2024-09-12T01:36:07.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.695+0000 7f354d8e6640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f35480d0ae0 0x7f35480cf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50182/0 (socket says 172.21.15.60:50182) 2024-09-12T01:36:07.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.695+0000 7f354d8e6640 1 -- 172.21.15.60:0/3128552483 learned_addr learned my addr 172.21.15.60:0/3128552483 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:07.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.695+0000 7f354e8e8640 1 --2- 172.21.15.60:0/3128552483 >> v2:172.21.15.60:3300/0 conn(0x7f35480b39c0 0x7f35480cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.695+0000 7f354d0e5640 1 -- 172.21.15.60:0/3128552483 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3467897344 0 0) 0x7f354815e2f0 con 0x7f3548158030 2024-09-12T01:36:07.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.695+0000 7f354d0e5640 1 -- 172.21.15.60:0/3128552483 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3534003520 con 0x7f3548158030 2024-09-12T01:36:07.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.695+0000 7f354e8e8640 1 -- 172.21.15.60:0/3128552483 >> v1:172.21.15.105:6789/0 conn(0x7f3548158030 legacy=0x7f35480d03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.695+0000 7f354e8e8640 1 -- 172.21.15.60:0/3128552483 >> v1:172.21.15.60:6789/0 conn(0x7f35480d0ae0 legacy=0x7f35480cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.695+0000 7f354e8e8640 1 -- 172.21.15.60:0/3128552483 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f354815e8b0 con 0x7f35480b39c0 2024-09-12T01:36:07.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.696+0000 7f354e8e8640 1 --2- 172.21.15.60:0/3128552483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35480b39c0 0x7f35480cfa50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f35380097a0 tx=0x7f353802c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ad828ce5f94b53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.697+0000 7f354d0e5640 1 -- 172.21.15.60:0/3128552483 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538038070 con 0x7f35480b39c0 2024-09-12T01:36:07.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.697+0000 7f354d0e5640 1 -- 172.21.15.60:0/3128552483 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3538031710 con 0x7f35480b39c0 2024-09-12T01:36:07.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.698+0000 7f354d0e5640 1 -- 172.21.15.60:0/3128552483 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538031ae0 con 0x7f35480b39c0 2024-09-12T01:36:07.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.698+0000 7f354f0e9640 1 -- 172.21.15.60:0/3128552483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35480b39c0 msgr2=0x7f35480cfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.698+0000 7f354f0e9640 1 --2- 172.21.15.60:0/3128552483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35480b39c0 0x7f35480cfa50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f35380097a0 tx=0x7f353802c440 comp rx=0 tx=0).stop 2024-09-12T01:36:07.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.698+0000 7f7a8883b640 1 Processor -- start 2024-09-12T01:36:07.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.698+0000 7f7a8883b640 1 -- start start 2024-09-12T01:36:07.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.698+0000 7f354f0e9640 1 -- 172.21.15.60:0/3128552483 shutdown_connections 2024-09-12T01:36:07.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.698+0000 7f354f0e9640 1 --2- 172.21.15.60:0/3128552483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35480b39c0 0x7f35480cfa50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.698+0000 7f354f0e9640 1 -- 172.21.15.60:0/3128552483 >> 172.21.15.60:0/3128552483 conn(0x7f354806d0f0 msgr2=0x7f354806d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:07.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.699+0000 7f354f0e9640 1 -- 172.21.15.60:0/3128552483 shutdown_connections 2024-09-12T01:36:07.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.699+0000 7fa459682640 1 Processor -- start 2024-09-12T01:36:07.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.699+0000 7fa459682640 1 -- start start 2024-09-12T01:36:07.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.700+0000 7f7a8883b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7a8415f820 0x7f7a840b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.700+0000 7f7a8883b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a84072740 0x7f7a84072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.700+0000 7f7a8883b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a8415b750 con 0x7f7a8406de30 2024-09-12T01:36:07.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.700+0000 7f7a82d9d640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f7a8406de30 0x7f7a8406e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:49458/0 (socket says 172.21.15.60:49458) 2024-09-12T01:36:07.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.700+0000 7f7a82d9d640 1 -- 172.21.15.60:0/2739404844 learned_addr learned my addr 172.21.15.60:0/2739404844 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:07.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.700+0000 7f7a8883b640 1 -- 172.21.15.60:0/2739404844 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7a8415ba30 con 0x7f7a8415f820 2024-09-12T01:36:07.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.700+0000 7f7a8883b640 1 -- 172.21.15.60:0/2739404844 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8415bd10 con 0x7f7a84072740 2024-09-12T01:36:07.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.700+0000 7f354f0e9640 1 -- 172.21.15.60:0/3128552483 wait complete. 2024-09-12T01:36:07.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.700+0000 7f7a8359e640 1 --2- 172.21.15.60:0/2739404844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a84072740 0x7f7a84072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.700+0000 7fa459682640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa454155880 0x7fa45415f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.700+0000 7f7a8259c640 1 --2- 172.21.15.60:0/2739404844 >> v2:172.21.15.60:3300/0 conn(0x7f7a8415f820 0x7f7a840b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7fa459682640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa4540b4d60 0x7fa4540b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7f7a81d9b640 1 -- 172.21.15.60:0/2739404844 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18664485 0 0) 0x7f7a8415b750 con 0x7f7a8406de30 2024-09-12T01:36:07.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7f7a81d9b640 1 -- 172.21.15.60:0/2739404844 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a70003520 con 0x7f7a8406de30 2024-09-12T01:36:07.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7fa459682640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa45415bb60 con 0x7fa45406f630 2024-09-12T01:36:07.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7fa4527fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa4540b4d60 0x7fa4540b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7fa4527fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa4540b4d60 0x7fa4540b51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48318/0 (socket says 172.21.15.60:48318) 2024-09-12T01:36:07.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7fa4527fc640 1 -- 172.21.15.60:0/1611667084 learned_addr learned my addr 172.21.15.60:0/1611667084 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:07.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7fa459682640 1 -- 172.21.15.60:0/1611667084 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa454155c60 con 0x7fa454155880 2024-09-12T01:36:07.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7fa459682640 1 -- 172.21.15.60:0/1611667084 --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa45415fcb0 con 0x7fa4540b4d60 2024-09-12T01:36:07.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7f7a8259c640 1 -- 172.21.15.60:0/2739404844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a84072740 msgr2=0x7f7a84072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:07.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7f7a8259c640 1 --2- 172.21.15.60:0/2739404844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a84072740 0x7f7a84072b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7f7a8259c640 1 -- 172.21.15.60:0/2739404844 >> v1:172.21.15.105:6789/0 conn(0x7f7a8406de30 legacy=0x7f7a8406e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7f7a8259c640 1 -- 172.21.15.60:0/2739404844 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8415bff0 con 0x7f7a8415f820 2024-09-12T01:36:07.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7fa452ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa454155880 0x7fa45415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7f354f0e9640 1 Processor -- start 2024-09-12T01:36:07.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.701+0000 7f354f0e9640 1 -- start start 2024-09-12T01:36:07.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7fa452ffd640 1 -- 172.21.15.60:0/1611667084 >> v2:172.21.15.105:3300/0 conn(0x7fa4540b4d60 msgr2=0x7fa4540b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:07.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7ff599a4d640 1 Processor -- start 2024-09-12T01:36:07.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7ff599a4d640 1 -- start start 2024-09-12T01:36:07.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7fd558042640 1 Processor -- start 2024-09-12T01:36:07.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7fa452ffd640 1 --2- 172.21.15.60:0/1611667084 >> v2:172.21.15.105:3300/0 conn(0x7fa4540b4d60 0x7fa4540b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7fd558042640 1 -- start start 2024-09-12T01:36:07.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7fa452ffd640 1 -- 172.21.15.60:0/1611667084 >> v1:172.21.15.60:6789/0 conn(0x7fa45406f630 legacy=0x7fa45406fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:07.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7fa452ffd640 1 -- 172.21.15.60:0/1611667084 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa45415be40 con 0x7fa454155880 2024-09-12T01:36:07.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7fd8ea7cf640 1 Processor -- start 2024-09-12T01:36:07.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7f354f0e9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35480b39c0 0x7f3548073070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7f354f0e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35480d0ae0 0x7f35481489c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7f354f0e9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3548158030 0x7f354814ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7f354f0e9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f354806dd60 con 0x7f35480d0ae0 2024-09-12T01:36:07.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7f354f0e9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f354806dbe0 con 0x7f35480b39c0 2024-09-12T01:36:07.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7f354f0e9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f354815aaf0 con 0x7f3548158030 2024-09-12T01:36:07.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.702+0000 7fd8ea7cf640 1 -- start start 2024-09-12T01:36:07.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7f354d8e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35480d0ae0 0x7f35481489c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7f354d8e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35480d0ae0 0x7f35481489c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49314/0 (socket says 172.21.15.60:49314) 2024-09-12T01:36:07.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7f354d8e6640 1 -- 172.21.15.60:0/3731299766 learned_addr learned my addr 172.21.15.60:0/3731299766 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:07.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7f354e8e8640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3548158030 0x7f354814ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7f354e0e7640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35480b39c0 0x7f3548073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7ff599a4d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 0x7ff5940d4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7ff599a4d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5940d39c0 0x7ff5940d4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7ff599a4d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5940d1e20 con 0x7ff5940d1050 2024-09-12T01:36:07.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7ff599a4d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff5940d1bf0 con 0x7ff5940d39c0 2024-09-12T01:36:07.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7ff599a4d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff5940d2c00 con 0x7ff594155820 2024-09-12T01:36:07.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7f354d8e6640 1 -- 172.21.15.60:0/3731299766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3548158030 msgr2=0x7f354814ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7f354d8e6640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3548158030 0x7f354814ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7f354d8e6640 1 -- 172.21.15.60:0/3731299766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35480b39c0 msgr2=0x7f3548073070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7f354d8e6640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35480b39c0 0x7f3548073070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7f354d8e6640 1 -- 172.21.15.60:0/3731299766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35480738c0 con 0x7f35480d0ae0 2024-09-12T01:36:07.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7f354e0e7640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35480b39c0 0x7f3548073070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:07.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7f354e8e8640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3548158030 0x7f354814ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:07.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.703+0000 7fa4527fc640 1 --2- 172.21.15.60:0/1611667084 >> v2:172.21.15.105:3300/0 conn(0x7fa4540b4d60 0x7fa4540b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd558042640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd55015a680 0x7fd55006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7ff598a4b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 0x7ff5940d4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7ff59924c640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff5940d1050 0x7ff5940d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:49462/0 (socket says 172.21.15.60:49462) 2024-09-12T01:36:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7ff59924c640 1 -- 172.21.15.60:0/2776428863 learned_addr learned my addr 172.21.15.60:0/2776428863 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7ff593fff640 1 --2- 172.21.15.60:0/2776428863 >> v2:172.21.15.60:3300/0 conn(0x7ff5940d39c0 0x7ff5940d4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd555dde640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd55015a680 0x7fd55006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd555dde640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd55015a680 0x7fd55006e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49332/0 (socket says 172.21.15.60:49332) 2024-09-12T01:36:07.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd555dde640 1 -- 172.21.15.60:0/295158224 learned_addr learned my addr 172.21.15.60:0/295158224 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:07.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd558042640 1 --2- 172.21.15.60:0/295158224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd55006ec20 0x7fd550073b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd8ea7cf640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd8e41492f0 0x7fd8e41666a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd8ea7cf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8e40b60e0 0x7fd8e4166be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd8ea7cf640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8e4167120 0x7fd8e4072a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd8ea7cf640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd8e4070fb0 con 0x7fd8e4167120 2024-09-12T01:36:07.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd8ea7cf640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd8e40b3f40 con 0x7fd8e41492f0 2024-09-12T01:36:07.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd8ea7cf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e4071200 con 0x7fd8e40b60e0 2024-09-12T01:36:07.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7ff5937fe640 1 -- 172.21.15.60:0/2776428863 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506339316 0 0) 0x7ff5940d1e20 con 0x7ff5940d1050 2024-09-12T01:36:07.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7ff5937fe640 1 -- 172.21.15.60:0/2776428863 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff57c003520 con 0x7ff5940d1050 2024-09-12T01:36:07.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fa452ffd640 1 --2- 172.21.15.60:0/1611667084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa454155880 0x7fa45415f770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa4540d1360 tx=0x7fa44402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e8ed78dadd6068 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd558042640 1 -- 172.21.15.60:0/295158224 --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd55015aa60 con 0x7fd5500d0ed0 2024-09-12T01:36:07.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd8e3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd8e41492f0 0x7fd8e41666a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd8e3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd8e41492f0 0x7fd8e41666a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48336/0 (socket says 172.21.15.60:48336) 2024-09-12T01:36:07.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd8e3fff640 1 -- 172.21.15.60:0/3618783737 learned_addr learned my addr 172.21.15.60:0/3618783737 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:07.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd8e37fe640 1 --2- 172.21.15.60:0/3618783737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8e40b60e0 0x7fd8e4166be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd558042640 1 -- 172.21.15.60:0/295158224 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd550071c20 con 0x7fd55015a680 2024-09-12T01:36:07.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd5565df640 1 --2- 172.21.15.60:0/295158224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd55006ec20 0x7fd550073b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd558042640 1 -- 172.21.15.60:0/295158224 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd550071050 con 0x7fd55006ec20 2024-09-12T01:36:07.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7fd8e8d6c640 1 --2- 172.21.15.60:0/3618783737 >> v2:172.21.15.60:3300/0 conn(0x7fd8e4167120 0x7fd8e4072a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7ff598a4b640 1 -- 172.21.15.60:0/2776428863 >> v2:172.21.15.60:3300/0 conn(0x7ff5940d39c0 msgr2=0x7ff5940d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:07.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7ff598a4b640 1 --2- 172.21.15.60:0/2776428863 >> v2:172.21.15.60:3300/0 conn(0x7ff5940d39c0 0x7ff5940d4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7ff598a4b640 1 -- 172.21.15.60:0/2776428863 >> v1:172.21.15.105:6789/0 conn(0x7ff5940d1050 legacy=0x7ff5940d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7ff598a4b640 1 -- 172.21.15.60:0/2776428863 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5940d2ee0 con 0x7ff594155820 2024-09-12T01:36:07.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.704+0000 7f354d8e6640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35480d0ae0 0x7f35481489c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f354400d550 tx=0x7f354400da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fd8e3fff640 1 -- 172.21.15.60:0/3618783737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8e40b60e0 msgr2=0x7fd8e4166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:07.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fd8e3fff640 1 --2- 172.21.15.60:0/3618783737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8e40b60e0 0x7fd8e4166be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fd8e3fff640 1 -- 172.21.15.60:0/3618783737 >> v2:172.21.15.60:3300/0 conn(0x7fd8e4167120 msgr2=0x7fd8e4072a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:07.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fd8e3fff640 1 --2- 172.21.15.60:0/3618783737 >> v2:172.21.15.60:3300/0 conn(0x7fd8e4167120 0x7fd8e4072a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fd8e3fff640 1 -- 172.21.15.60:0/3618783737 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e4073d90 con 0x7fd8e41492f0 2024-09-12T01:36:07.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fa451ffb640 1 -- 172.21.15.60:0/1611667084 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444037070 con 0x7fa454155880 2024-09-12T01:36:07.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fd555dde640 1 -- 172.21.15.60:0/295158224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd55006ec20 msgr2=0x7fd550073b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:07.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fd555dde640 1 --2- 172.21.15.60:0/295158224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd55006ec20 0x7fd550073b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7f353effd640 1 -- 172.21.15.60:0/3731299766 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544014070 con 0x7f35480d0ae0 2024-09-12T01:36:07.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7f354f0e9640 1 -- 172.21.15.60:0/3731299766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3548073ba0 con 0x7f35480d0ae0 2024-09-12T01:36:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7f354f0e9640 1 -- 172.21.15.60:0/3731299766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35481559a0 con 0x7f35480d0ae0 2024-09-12T01:36:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fa451ffb640 1 -- 172.21.15.60:0/1611667084 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa444032440 con 0x7fa454155880 2024-09-12T01:36:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fa451ffb640 1 -- 172.21.15.60:0/1611667084 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444037070 con 0x7fa454155880 2024-09-12T01:36:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fd555dde640 1 -- 172.21.15.60:0/295158224 >> v1:172.21.15.105:6789/0 conn(0x7fd5500d0ed0 legacy=0x7fd550073470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fd554ddc640 1 -- 172.21.15.60:0/295158224 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112245280 0 0) 0x7fd55015aa60 con 0x7fd5500d0ed0 2024-09-12T01:36:07.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7f353effd640 1 -- 172.21.15.60:0/3731299766 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3544009040 con 0x7f35480d0ae0 2024-09-12T01:36:07.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7f353effd640 1 -- 172.21.15.60:0/3731299766 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354400f850 con 0x7f35480d0ae0 2024-09-12T01:36:07.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7f7a8259c640 1 --2- 172.21.15.60:0/2739404844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a8415f820 0x7f7a840b4d10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009d90 tx=0x7f7a7402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefe211aa068e1d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.705+0000 7fd555dde640 1 -- 172.21.15.60:0/295158224 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5500712f0 con 0x7fd55015a680 2024-09-12T01:36:07.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7fd8e3fff640 1 --2- 172.21.15.60:0/3618783737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8e41492f0 0x7fd8e41666a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4070b00 tx=0x7fd8dc02a610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f265359fdbb62b06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7f7d0ad6d640 1 Processor -- start 2024-09-12T01:36:07.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7fd8e2ffd640 1 -- 172.21.15.60:0/3618783737 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc036070 con 0x7fd8e41492f0 2024-09-12T01:36:07.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7fd8e2ffd640 1 -- 172.21.15.60:0/3618783737 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8dc031600 con 0x7fd8e41492f0 2024-09-12T01:36:07.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7fd8e2ffd640 1 -- 172.21.15.60:0/3618783737 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc0319d0 con 0x7fd8e41492f0 2024-09-12T01:36:07.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7f7d0ad6d640 1 -- start start 2024-09-12T01:36:07.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7fd555dde640 1 --2- 172.21.15.60:0/295158224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55015a680 0x7fd55006e6e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd550071da0 tx=0x7fd54c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe07375a9fa969c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7fa459682640 1 -- 172.21.15.60:0/1611667084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa454155880 msgr2=0x7fa45415f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7fa459682640 1 --2- 172.21.15.60:0/1611667084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa454155880 0x7fa45415f770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa4540d1360 tx=0x7fa44402a150 comp rx=0 tx=0).stop 2024-09-12T01:36:07.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7fa459682640 1 -- 172.21.15.60:0/1611667084 shutdown_connections 2024-09-12T01:36:07.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7fa459682640 1 --2- 172.21.15.60:0/1611667084 >> v2:172.21.15.105:3300/0 conn(0x7fa4540b4d60 0x7fa4540b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7fa459682640 1 --2- 172.21.15.60:0/1611667084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa454155880 0x7fa45415f770 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa4540d1360 tx=0x7fa44402a150 comp rx=0 tx=0).stop 2024-09-12T01:36:07.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7fa459682640 1 -- 172.21.15.60:0/1611667084 >> 172.21.15.60:0/1611667084 conn(0x7fa4540d1390 msgr2=0x7fa4540d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:07.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.706+0000 7ff598a4b640 1 --2- 172.21.15.60:0/2776428863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 0x7ff5940d4550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5880097a0 tx=0x7ff58802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60295b5375b189df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7fa459682640 1 -- 172.21.15.60:0/1611667084 shutdown_connections 2024-09-12T01:36:07.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7fa459682640 1 -- 172.21.15.60:0/1611667084 wait complete. 2024-09-12T01:36:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7ff5937fe640 1 -- 172.21.15.60:0/2776428863 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588037070 con 0x7ff594155820 2024-09-12T01:36:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7ff5937fe640 1 -- 172.21.15.60:0/2776428863 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff588032440 con 0x7ff594155820 2024-09-12T01:36:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7ff5937fe640 1 -- 172.21.15.60:0/2776428863 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588032850 con 0x7ff594155820 2024-09-12T01:36:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7fd554ddc640 1 -- 172.21.15.60:0/295158224 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c037070 con 0x7fd55015a680 2024-09-12T01:36:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/3618783737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8e41492f0 msgr2=0x7fd8e41666a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7fd554ddc640 1 -- 172.21.15.60:0/295158224 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd54c032440 con 0x7fd55015a680 2024-09-12T01:36:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7fd554ddc640 1 -- 172.21.15.60:0/295158224 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c032810 con 0x7fd55015a680 2024-09-12T01:36:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7fd8ea7cf640 1 --2- 172.21.15.60:0/3618783737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8e41492f0 0x7fd8e41666a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4070b00 tx=0x7fd8dc02a610 comp rx=0 tx=0).stop 2024-09-12T01:36:07.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/3618783737 shutdown_connections 2024-09-12T01:36:07.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7fd8ea7cf640 1 --2- 172.21.15.60:0/3618783737 >> v2:172.21.15.60:3300/0 conn(0x7fd8e4167120 0x7fd8e4072a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7fd8ea7cf640 1 --2- 172.21.15.60:0/3618783737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8e40b60e0 0x7fd8e4166be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7fd8ea7cf640 1 --2- 172.21.15.60:0/3618783737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8e41492f0 0x7fd8e41666a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.707+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/3618783737 >> 172.21.15.60:0/3618783737 conn(0x7fd8e406d0f0 msgr2=0x7fd8e406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:07.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7a81d9b640 1 -- 172.21.15.60:0/2739404844 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74007740 con 0x7f7a8415f820 2024-09-12T01:36:07.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/3618783737 shutdown_connections 2024-09-12T01:36:07.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/3618783737 wait complete. 2024-09-12T01:36:07.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7a81d9b640 1 -- 172.21.15.60:0/2739404844 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a740078e0 con 0x7f7a8415f820 2024-09-12T01:36:07.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7a81d9b640 1 -- 172.21.15.60:0/2739404844 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74007740 con 0x7f7a8415f820 2024-09-12T01:36:07.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7f7a8883b640 1 -- 172.21.15.60:0/2739404844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a8415f820 msgr2=0x7f7a840b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7f7a8883b640 1 --2- 172.21.15.60:0/2739404844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a8415f820 0x7f7a840b4d10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009d90 tx=0x7f7a7402a660 comp rx=0 tx=0).stop 2024-09-12T01:36:07.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7ff599a4d640 1 -- 172.21.15.60:0/2776428863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 msgr2=0x7ff5940d4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7ff599a4d640 1 --2- 172.21.15.60:0/2776428863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 0x7ff5940d4550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff5880097a0 tx=0x7ff58802a1a0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f353effd640 1 -- 172.21.15.60:0/3731299766 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3544017070 con 0x7f35480d0ae0 2024-09-12T01:36:07.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7d0ad6d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d040b40e0 0x7f7d04165680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7d0ad6d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d040b4620 con 0x7f7d04072bf0 2024-09-12T01:36:07.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7d0ad6d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d0415e630 con 0x7f7d04144500 2024-09-12T01:36:07.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7d09d6b640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f7d04144500 0x7f7d040724e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:49480/0 (socket says 172.21.15.60:49480) 2024-09-12T01:36:07.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7d09d6b640 1 -- 172.21.15.60:0/3401365093 learned_addr learned my addr 172.21.15.60:0/3401365093 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:07.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7d0ad6d640 1 -- 172.21.15.60:0/3401365093 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7d040b5760 con 0x7f7d040b40e0 2024-09-12T01:36:07.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7d0a56c640 1 --2- 172.21.15.60:0/3401365093 >> v2:172.21.15.60:3300/0 conn(0x7f7d040b40e0 0x7f7d04165680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7fd558042640 1 -- 172.21.15.60:0/295158224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55015a680 msgr2=0x7fd55006e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7fd558042640 1 --2- 172.21.15.60:0/295158224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55015a680 0x7fd55006e6e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd550071da0 tx=0x7fd54c02a250 comp rx=0 tx=0).stop 2024-09-12T01:36:07.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7fd558042640 1 -- 172.21.15.60:0/295158224 shutdown_connections 2024-09-12T01:36:07.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7fd558042640 1 --2- 172.21.15.60:0/295158224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd55006ec20 0x7fd550073b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7fd558042640 1 --2- 172.21.15.60:0/295158224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd55015a680 0x7fd55006e6e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7fd558042640 1 -- 172.21.15.60:0/295158224 >> 172.21.15.60:0/295158224 conn(0x7fd5500d03e0 msgr2=0x7fd5500d07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:07.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7f353effd640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f352c06be30 0x7f352c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7f353effd640 1 -- 172.21.15.60:0/3731299766 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f354408ad70 con 0x7f35480d0ae0 2024-09-12T01:36:07.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7d0a56c640 1 -- 172.21.15.60:0/3401365093 >> v1:172.21.15.105:6789/0 conn(0x7f7d04144500 legacy=0x7f7d040724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:07.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7d0a56c640 1 -- 172.21.15.60:0/3401365093 >> v1:172.21.15.60:6789/0 conn(0x7f7d04072bf0 legacy=0x7f7d040b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.708+0000 7f7d0a56c640 1 -- 172.21.15.60:0/3401365093 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0415e910 con 0x7f7d040b40e0 2024-09-12T01:36:07.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7fa459682640 1 Processor -- start 2024-09-12T01:36:07.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7ff599a4d640 1 -- 172.21.15.60:0/2776428863 shutdown_connections 2024-09-12T01:36:07.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7ff599a4d640 1 --2- 172.21.15.60:0/2776428863 >> v2:172.21.15.60:3300/0 conn(0x7ff5940d39c0 0x7ff5940d4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7ff599a4d640 1 --2- 172.21.15.60:0/2776428863 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 0x7ff5940d4550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7ff599a4d640 1 -- 172.21.15.60:0/2776428863 >> 172.21.15.60:0/2776428863 conn(0x7ff594062630 msgr2=0x7ff594062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:07.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7fa459682640 1 -- start start 2024-09-12T01:36:07.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7f7a8883b640 1 -- 172.21.15.60:0/2739404844 shutdown_connections 2024-09-12T01:36:07.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7f7a8883b640 1 --2- 172.21.15.60:0/2739404844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a84072740 0x7f7a84072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7f7a8883b640 1 --2- 172.21.15.60:0/2739404844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a8415f820 0x7f7a840b4d10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7f7a8883b640 1 -- 172.21.15.60:0/2739404844 >> 172.21.15.60:0/2739404844 conn(0x7f7a840b2f00 msgr2=0x7f7a840b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:07.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7f354e0e7640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f352c06be30 0x7f352c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7fd558042640 1 -- 172.21.15.60:0/295158224 shutdown_connections 2024-09-12T01:36:07.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.709+0000 7fd558042640 1 -- 172.21.15.60:0/295158224 wait complete. 2024-09-12T01:36:07.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.710+0000 7f7a8883b640 1 -- 172.21.15.60:0/2739404844 shutdown_connections 2024-09-12T01:36:07.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.710+0000 7f7a8883b640 1 -- 172.21.15.60:0/2739404844 wait complete. 2024-09-12T01:36:07.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.710+0000 7f354e0e7640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f352c06be30 0x7f352c06e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3540001560 tx=0x7f3540009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.710+0000 7f7d0a56c640 1 --2- 172.21.15.60:0/3401365093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d040b40e0 0x7f7d04165680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d000097a0 tx=0x7f7d0002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332a90d8126d1e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.710+0000 7fd8ea7cf640 1 Processor -- start 2024-09-12T01:36:07.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7ff599a4d640 1 -- 172.21.15.60:0/2776428863 shutdown_connections 2024-09-12T01:36:07.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.710+0000 7fa459682640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa45406f630 0x7fa45414c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.710+0000 7f7d08d69640 1 -- 172.21.15.60:0/3401365093 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d00037070 con 0x7f7d040b40e0 2024-09-12T01:36:07.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7f7d08d69640 1 -- 172.21.15.60:0/3401365093 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0002ae50 con 0x7f7d040b40e0 2024-09-12T01:36:07.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7f7d08d69640 1 -- 172.21.15.60:0/3401365093 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d00032660 con 0x7f7d040b40e0 2024-09-12T01:36:07.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.710+0000 7fa459682640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4540b4d60 0x7fa45406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.710+0000 7fa459682640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45406ff50 0x7fa454072c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.710+0000 7fa459682640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa45415c6e0 con 0x7fa45406f630 2024-09-12T01:36:07.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.710+0000 7fa459682640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa45415c400 con 0x7fa45406ff50 2024-09-12T01:36:07.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.710+0000 7fa459682640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa45415b770 con 0x7fa4540b4d60 2024-09-12T01:36:07.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fa452ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa45406f630 0x7fa45414c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fa452ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa45406f630 0x7fa45414c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49352/0 (socket says 172.21.15.60:49352) 2024-09-12T01:36:07.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fa452ffd640 1 -- 172.21.15.60:0/4172281230 learned_addr learned my addr 172.21.15.60:0/4172281230 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:07.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7ff599a4d640 1 -- 172.21.15.60:0/2776428863 wait complete. 2024-09-12T01:36:07.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fd8ea7cf640 1 -- start start 2024-09-12T01:36:07.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7f354f0e9640 1 -- 172.21.15.60:0/3731299766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3530005290 con 0x7f35480d0ae0 2024-09-12T01:36:07.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fa4537fe640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45406ff50 0x7fa454072c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fa452ffd640 1 -- 172.21.15.60:0/4172281230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4540b4d60 msgr2=0x7fa45406fa10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:36:07.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fa452ffd640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4540b4d60 0x7fa45406fa10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fa452ffd640 1 -- 172.21.15.60:0/4172281230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45406ff50 msgr2=0x7fa454072c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fa452ffd640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45406ff50 0x7fa454072c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fa452ffd640 1 -- 172.21.15.60:0/4172281230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4540af4b0 con 0x7fa45406f630 2024-09-12T01:36:07.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fa4537fe640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45406ff50 0x7fa454072c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:07.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fd558042640 1 Processor -- start 2024-09-12T01:36:07.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.711+0000 7fd558042640 1 -- start start 2024-09-12T01:36:07.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7fa452ffd640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa45406f630 0x7fa45414c1f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa444000c00 tx=0x7fa4440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7f7d0ad6d640 1 -- 172.21.15.60:0/3401365093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d040b40e0 msgr2=0x7f7d04165680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7f7d0ad6d640 1 --2- 172.21.15.60:0/3401365093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d040b40e0 0x7f7d04165680 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d000097a0 tx=0x7f7d0002a140 comp rx=0 tx=0).stop 2024-09-12T01:36:07.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7f7d0ad6d640 1 -- 172.21.15.60:0/3401365093 shutdown_connections 2024-09-12T01:36:07.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7f7d0ad6d640 1 --2- 172.21.15.60:0/3401365093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d040b40e0 0x7f7d04165680 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7f7d0ad6d640 1 -- 172.21.15.60:0/3401365093 >> 172.21.15.60:0/3401365093 conn(0x7f7d040d09a0 msgr2=0x7f7d040d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:07.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7f7d0ad6d640 1 -- 172.21.15.60:0/3401365093 shutdown_connections 2024-09-12T01:36:07.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7f7a8883b640 1 Processor -- start 2024-09-12T01:36:07.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7fd8ea7cf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8e40b60e0 0x7fd8e41621e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7fd8ea7cf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8e41492f0 0x7fd8e41411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7fd8ea7cf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e4167120 0x7fd8e41f8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7fd8ea7cf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e4073120 con 0x7fd8e4167120 2024-09-12T01:36:07.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7fd8ea7cf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e4072fa0 con 0x7fd8e41492f0 2024-09-12T01:36:07.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7fd8ea7cf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd8e40732a0 con 0x7fd8e40b60e0 2024-09-12T01:36:07.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.712+0000 7f7d0ad6d640 1 -- 172.21.15.60:0/3401365093 wait complete. 2024-09-12T01:36:07.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd8e8d6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e4167120 0x7fd8e41f8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd8e8d6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e4167120 0x7fd8e41f8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49358/0 (socket says 172.21.15.60:49358) 2024-09-12T01:36:07.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd8e8d6c640 1 -- 172.21.15.60:0/4233886162 learned_addr learned my addr 172.21.15.60:0/4233886162 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:07.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7f7a8883b640 1 -- start start 2024-09-12T01:36:07.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fa43b7fe640 1 -- 172.21.15.60:0/4172281230 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa444041020 con 0x7fa45406f630 2024-09-12T01:36:07.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fa459682640 1 -- 172.21.15.60:0/4172281230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4540af790 con 0x7fa45406f630 2024-09-12T01:36:07.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fa459682640 1 -- 172.21.15.60:0/4172281230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4540afd50 con 0x7fa45406f630 2024-09-12T01:36:07.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd558042640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55006ec20 0x7fd5501f8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd558042640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5500d0ed0 0x7fd550140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd558042640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd55015a680 0x7fd5500b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd558042640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd5500b4840 con 0x7fd5500d0ed0 2024-09-12T01:36:07.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd558042640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd5500718b0 con 0x7fd55006ec20 2024-09-12T01:36:07.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd558042640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd550164210 con 0x7fd55015a680 2024-09-12T01:36:07.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd5565df640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd55015a680 0x7fd5500b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd5565df640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd55015a680 0x7fd5500b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:53994/0 (socket says 172.21.15.60:53994) 2024-09-12T01:36:07.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd5565df640 1 -- 172.21.15.60:0/3076964278 learned_addr learned my addr 172.21.15.60:0/3076964278 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:07.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd5565df640 1 -- 172.21.15.60:0/3076964278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55006ec20 msgr2=0x7fd5501f8320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-12T01:36:07.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd5565df640 1 --2- 172.21.15.60:0/3076964278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55006ec20 0x7fd5501f8320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd5565df640 1 -- 172.21.15.60:0/3076964278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5500d0ed0 msgr2=0x7fd550140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd5565df640 1 --2- 172.21.15.60:0/3076964278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5500d0ed0 0x7fd550140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7fd5565df640 1 -- 172.21.15.60:0/3076964278 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5501f92f0 con 0x7fd55015a680 2024-09-12T01:36:07.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7fa43b7fe640 1 -- 172.21.15.60:0/4172281230 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa444032440 con 0x7fa45406f630 2024-09-12T01:36:07.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7fa43b7fe640 1 -- 172.21.15.60:0/4172281230 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa44402ae60 con 0x7fa45406f630 2024-09-12T01:36:07.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7fd8e3fff640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8e40b60e0 0x7fd8e41621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7fd5565df640 1 --2- 172.21.15.60:0/3076964278 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd55015a680 0x7fd5500b3a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd548009dd0 tx=0x7fd54800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7f7a8883b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a8406de30 0x7f7a841585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7fd5467fc640 1 -- 172.21.15.60:0/3076964278 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd548018020 con 0x7fd55015a680 2024-09-12T01:36:07.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7ff599a4d640 1 Processor -- start 2024-09-12T01:36:07.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.713+0000 7ff599a4d640 1 -- start start 2024-09-12T01:36:07.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7ff599a4d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5940d1050 0x7ff5942009c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7ff599a4d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5940d39c0 0x7ff594151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7ff599a4d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 0x7ff594156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7ff599a4d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff594155c00 con 0x7ff5940d1050 2024-09-12T01:36:07.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7ff599a4d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff5940d34a0 con 0x7ff5940d39c0 2024-09-12T01:36:07.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7ff599a4d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff5940cee20 con 0x7ff594155820 2024-09-12T01:36:07.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7fd558042640 1 -- 172.21.15.60:0/3076964278 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5501f8a50 con 0x7fd55015a680 2024-09-12T01:36:07.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7fd8e8d6c640 1 -- 172.21.15.60:0/4233886162 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8e40b60e0 msgr2=0x7fd8e41621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7fd8e8d6c640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8e40b60e0 0x7fd8e41621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7fd8e8d6c640 1 -- 172.21.15.60:0/4233886162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8e41492f0 msgr2=0x7fd8e41411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7fd8e8d6c640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8e41492f0 0x7fd8e41411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7fd8e8d6c640 1 -- 172.21.15.60:0/4233886162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e4141720 con 0x7fd8e4167120 2024-09-12T01:36:07.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7fa459682640 1 -- 172.21.15.60:0/4172281230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa454070360 con 0x7fa45406f630 2024-09-12T01:36:07.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.714+0000 7f7a82d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a8406de30 0x7f7a841585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7fd558042640 1 -- 172.21.15.60:0/3076964278 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5501f9010 con 0x7fd55015a680 2024-09-12T01:36:07.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7f7a82d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a8406de30 0x7f7a841585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49372/0 (socket says 172.21.15.60:49372) 2024-09-12T01:36:07.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7f7a82d9d640 1 -- 172.21.15.60:0/466436703 learned_addr learned my addr 172.21.15.60:0/466436703 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:07.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7f7d0ad6d640 1 Processor -- start 2024-09-12T01:36:07.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7f7a8883b640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a84072740 0x7f7a840af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7f7a8883b640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a8415f820 0x7f7a84149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7f7d0ad6d640 1 -- start start 2024-09-12T01:36:07.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7f7a8259c640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a84072740 0x7f7a840af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7a84073090 con 0x7f7a8406de30 2024-09-12T01:36:07.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7ff593fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5940d39c0 0x7ff594151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7f7a8359e640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a8415f820 0x7f7a84149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a840b5460 con 0x7f7a84072740 2024-09-12T01:36:07.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a84073210 con 0x7f7a8415f820 2024-09-12T01:36:07.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7ff59924c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 0x7ff594156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7ff59924c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 0x7ff594156190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:54010/0 (socket says 172.21.15.60:54010) 2024-09-12T01:36:07.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7ff59924c640 1 -- 172.21.15.60:0/1146460332 learned_addr learned my addr 172.21.15.60:0/1146460332 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:07.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7ff598a4b640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5940d1050 0x7ff5942009c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7fd5467fc640 1 -- 172.21.15.60:0/3076964278 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd548014480 con 0x7fd55015a680 2024-09-12T01:36:07.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.715+0000 7fd5467fc640 1 -- 172.21.15.60:0/3076964278 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd548014870 con 0x7fd55015a680 2024-09-12T01:36:07.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7fd8e8d6c640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e4167120 0x7fd8e41f8ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800d5d0 tx=0x7fd8d800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7fd558042640 1 -- 172.21.15.60:0/3076964278 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd538005290 con 0x7fd55015a680 2024-09-12T01:36:07.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7ff59924c640 1 -- 172.21.15.60:0/1146460332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5940d39c0 msgr2=0x7ff594151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7ff59924c640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5940d39c0 0x7ff594151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7ff59924c640 1 -- 172.21.15.60:0/1146460332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5940d1050 msgr2=0x7ff5942009c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7ff59924c640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5940d1050 0x7ff5942009c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7ff59924c640 1 -- 172.21.15.60:0/1146460332 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5941526a0 con 0x7ff594155820 2024-09-12T01:36:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7ff598a4b640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5940d1050 0x7ff5942009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7f7a8359e640 1 -- 172.21.15.60:0/466436703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a84072740 msgr2=0x7f7a840af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7f7a8359e640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a84072740 0x7f7a840af7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7f7a8359e640 1 -- 172.21.15.60:0/466436703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a8406de30 msgr2=0x7f7a841585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7f7a8359e640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a8406de30 0x7f7a841585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.716+0000 7f7a8359e640 1 -- 172.21.15.60:0/466436703 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a840b0040 con 0x7f7a8415f820 2024-09-12T01:36:07.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0ad6d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d04072bf0 0x7f7d04130ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0ad6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d040b40e0 0x7f7d04150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0ad6d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d04144500 0x7f7d041514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0ad6d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0415f320 con 0x7f7d040b40e0 2024-09-12T01:36:07.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7a8359e640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a8415f820 0x7f7a84149b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c010da0 tx=0x7f7a7c00e730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0ad6d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d040b4900 con 0x7f7d04072bf0 2024-09-12T01:36:07.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0ad6d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0416ac60 con 0x7f7d04144500 2024-09-12T01:36:07.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7ff593fff640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5940d39c0 0x7ff594151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:07.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d09d6b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d04072bf0 0x7f7d04130ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0a56c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d04144500 0x7f7d041514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7ff59924c640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 0x7ff594156190 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00caa0 tx=0x7ff58c00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0956a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d040b40e0 0x7f7d04150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0a56c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d04144500 0x7f7d041514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:54032/0 (socket says 172.21.15.60:54032) 2024-09-12T01:36:07.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0a56c640 1 -- 172.21.15.60:0/1428343623 learned_addr learned my addr 172.21.15.60:0/1428343623 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:07.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d09d6b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d04072bf0 0x7f7d04130ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48394/0 (socket says 172.21.15.60:48394) 2024-09-12T01:36:07.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7fd5467fc640 1 -- 172.21.15.60:0/3076964278 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd548005d10 con 0x7fd55015a680 2024-09-12T01:36:07.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0a56c640 1 -- 172.21.15.60:0/1428343623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d04072bf0 msgr2=0x7f7d04130ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0a56c640 1 --2- 172.21.15.60:0/1428343623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d04072bf0 0x7f7d04130ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0a56c640 1 -- 172.21.15.60:0/1428343623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d040b40e0 msgr2=0x7f7d04150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:07.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0a56c640 1 --2- 172.21.15.60:0/1428343623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d040b40e0 0x7f7d04150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:07.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0a56c640 1 -- 172.21.15.60:0/1428343623 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d041318d0 con 0x7f7d04144500 2024-09-12T01:36:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.717+0000 7f7d0a56c640 1 --2- 172.21.15.60:0/1428343623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d04144500 0x7f7d041514a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d000098c0 tx=0x7f7d000046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.718+0000 7fd5467fc640 1 --2- 172.21.15.60:0/3076964278 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd53406be30 0x7fd53406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.718+0000 7fd555dde640 1 --2- 172.21.15.60:0/3076964278 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd53406be30 0x7fd53406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.718+0000 7fd5467fc640 1 -- 172.21.15.60:0/3076964278 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd54808ba20 con 0x7fd55015a680 2024-09-12T01:36:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.718+0000 7fd555dde640 1 --2- 172.21.15.60:0/3076964278 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd53406be30 0x7fd53406e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd54c034000 tx=0x7fd54c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.720+0000 7f353effd640 1 -- 172.21.15.60:0/3731299766 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3544059710 con 0x7f35480d0ae0 2024-09-12T01:36:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.720+0000 7fd8e0ff9640 1 -- 172.21.15.60:0/4233886162 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80125f0 con 0x7fd8e4167120 2024-09-12T01:36:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.721+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/4233886162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e41f9010 con 0x7fd8e4167120 2024-09-12T01:36:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.721+0000 7fd8e0ff9640 1 -- 172.21.15.60:0/4233886162 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d8019070 con 0x7fd8e4167120 2024-09-12T01:36:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.721+0000 7fd8e0ff9640 1 -- 172.21.15.60:0/4233886162 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80129f0 con 0x7fd8e4167120 2024-09-12T01:36:07.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.721+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/4233886162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e41f95c0 con 0x7fd8e4167120 2024-09-12T01:36:07.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.721+0000 7f7a7b7fe640 1 -- 172.21.15.60:0/466436703 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c01e070 con 0x7f7a8415f820 2024-09-12T01:36:07.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.722+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a840b0320 con 0x7f7a8415f820 2024-09-12T01:36:07.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.722+0000 7fd5467fc640 1 -- 172.21.15.60:0/3076964278 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd548022070 con 0x7fd55015a680 2024-09-12T01:36:07.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.722+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a840ab080 con 0x7f7a8415f820 2024-09-12T01:36:07.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.722+0000 7f7a7b7fe640 1 -- 172.21.15.60:0/466436703 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a7c011660 con 0x7f7a8415f820 2024-09-12T01:36:07.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.722+0000 7fa43b7fe640 1 -- 172.21.15.60:0/4172281230 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa444044020 con 0x7fa45406f630 2024-09-12T01:36:07.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.723+0000 7fa43b7fe640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa44006be30 0x7fa44006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.722+0000 7ff5917fa640 1 -- 172.21.15.60:0/1146460332 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c017070 con 0x7ff594155820 2024-09-12T01:36:07.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.722+0000 7ff5917fa640 1 -- 172.21.15.60:0/1146460332 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff58c00aba0 con 0x7ff594155820 2024-09-12T01:36:07.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.722+0000 7ff5917fa640 1 -- 172.21.15.60:0/1146460332 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c012400 con 0x7ff594155820 2024-09-12T01:36:07.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.723+0000 7fa43b7fe640 1 -- 172.21.15.60:0/4172281230 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa4440ab980 con 0x7fa45406f630 2024-09-12T01:36:07.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.723+0000 7f7a7b7fe640 1 -- 172.21.15.60:0/466436703 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c011a70 con 0x7f7a8415f820 2024-09-12T01:36:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.723+0000 7f7cfa7fc640 1 -- 172.21.15.60:0/1428343623 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d00042020 con 0x7f7d04144500 2024-09-12T01:36:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.723+0000 7f7cfa7fc640 1 -- 172.21.15.60:0/1428343623 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0003d670 con 0x7f7d04144500 2024-09-12T01:36:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.723+0000 7f7cfa7fc640 1 -- 172.21.15.60:0/1428343623 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d00037040 con 0x7f7d04144500 2024-09-12T01:36:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.724+0000 7ff599a4d640 1 -- 172.21.15.60:0/1146460332 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff594152980 con 0x7ff594155820 2024-09-12T01:36:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.724+0000 7ff599a4d640 1 -- 172.21.15.60:0/1146460332 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff594152f40 con 0x7ff594155820 2024-09-12T01:36:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.724+0000 7fa4527fc640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa44006be30 0x7fa44006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.725+0000 7fa4527fc640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa44006be30 0x7fa44006e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa45415e420 tx=0x7fa448008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.724+0000 7f7d0ad6d640 1 -- 172.21.15.60:0/1428343623 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d04131bb0 con 0x7f7d04144500 2024-09-12T01:36:07.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.724+0000 7f7d0ad6d640 1 -- 172.21.15.60:0/1428343623 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d04132da0 con 0x7f7d04144500 2024-09-12T01:36:07.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.725+0000 7ff57affd640 1 -- 172.21.15.60:0/1146460332 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff594155f90 con 0x7ff594155820 2024-09-12T01:36:07.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.725+0000 7f7a7b7fe640 1 -- 172.21.15.60:0/466436703 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a7c021070 con 0x7f7a8415f820 2024-09-12T01:36:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.722+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/4233886162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8c4005290 con 0x7fd8e4167120 2024-09-12T01:36:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.726+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a68005290 con 0x7f7a8415f820 2024-09-12T01:36:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.726+0000 7f7a7b7fe640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a6406bf00 0x7f7a6406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.726+0000 7f7a7b7fe640 1 -- 172.21.15.60:0/466436703 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7a7c08d950 con 0x7f7a8415f820 2024-09-12T01:36:07.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.727+0000 7f7ce7fff640 1 -- 172.21.15.60:0/1428343623 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d040b39d0 con 0x7f7d04144500 2024-09-12T01:36:07.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.727+0000 7ff5917fa640 1 -- 172.21.15.60:0/1146460332 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff58c01a070 con 0x7ff594155820 2024-09-12T01:36:07.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.727+0000 7f7cfa7fc640 1 -- 172.21.15.60:0/1428343623 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d00045020 con 0x7f7d04144500 2024-09-12T01:36:07.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.727+0000 7f7a82d9d640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a6406bf00 0x7f7a6406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.727+0000 7f7cfa7fc640 1 --2- 172.21.15.60:0/1428343623 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ce806bf00 0x7f7ce806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.727+0000 7ff5917fa640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff58006bf00 0x7ff58006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.728+0000 7ff5917fa640 1 -- 172.21.15.60:0/1146460332 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff58c08acf0 con 0x7ff594155820 2024-09-12T01:36:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.728+0000 7ff598a4b640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff58006bf00 0x7ff58006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.728+0000 7f7d09d6b640 1 --2- 172.21.15.60:0/1428343623 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ce806bf00 0x7f7ce806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.728+0000 7ff598a4b640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff58006bf00 0x7ff58006e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff588034000 tx=0x7ff58802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.728+0000 7f7a82d9d640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a6406bf00 0x7f7a6406e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c005880 tx=0x7f7a6c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.728+0000 7f7cfa7fc640 1 -- 172.21.15.60:0/1428343623 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7d000ab610 con 0x7f7d04144500 2024-09-12T01:36:07.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.729+0000 7f7d09d6b640 1 --2- 172.21.15.60:0/1428343623 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ce806bf00 0x7f7ce806e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009400 tx=0x7f7cfc009350 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.729+0000 7fa43b7fe640 1 -- 172.21.15.60:0/4172281230 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa454070360 con 0x7fa45406f630 2024-09-12T01:36:07.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.731+0000 7fd8e0ff9640 1 -- 172.21.15.60:0/4233886162 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8d8012b90 con 0x7fd8e4167120 2024-09-12T01:36:07.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.731+0000 7f7a7b7fe640 1 -- 172.21.15.60:0/466436703 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a7c05bcd0 con 0x7f7a8415f820 2024-09-12T01:36:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.731+0000 7fd8e0ff9640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8d006be30 0x7fd8d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.732+0000 7fd8e0ff9640 1 -- 172.21.15.60:0/4233886162 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd8d808bc90 con 0x7fd8e4167120 2024-09-12T01:36:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.732+0000 7fd8e3fff640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8d006be30 0x7fd8d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.733+0000 7fd8e3fff640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8d006be30 0x7fd8d006e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc033000 tx=0x7fd8dc009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.735+0000 7fd8e0ff9640 1 -- 172.21.15.60:0/4233886162 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8d805a630 con 0x7fd8e4167120 2024-09-12T01:36:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.735+0000 7f7cfa7fc640 1 -- 172.21.15.60:0/1428343623 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d0004c030 con 0x7f7d04144500 2024-09-12T01:36:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:07.739+0000 7ff5917fa640 1 -- 172.21.15.60:0/1146460332 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff58c0595f0 con 0x7ff594155820 2024-09-12T01:36:08.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.064+0000 7f7d735fd640 1 -- 172.21.15.60:0/1009449839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7d4c005580 con 0x7f7d6c070fb0 2024-09-12T01:36:08.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.065+0000 7f7d61ffb640 1 -- 172.21.15.60:0/1009449839 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7d68059510 con 0x7f7d6c070fb0 2024-09-12T01:36:08.064 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T01:36:08.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.068+0000 7f7d577fe640 1 -- 172.21.15.60:0/1009449839 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d5006bf30 msgr2=0x7f7d5006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.068+0000 7f7d577fe640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d5006bf30 0x7f7d5006e3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c001680 tx=0x7f7d5c0079e0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.069+0000 7f7d577fe640 1 -- 172.21.15.60:0/1009449839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d6c070fb0 msgr2=0x7f7d6c14ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.069+0000 7f7d577fe640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d6c070fb0 0x7f7d6c14ace0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800c750 tx=0x7f7d6800cc10 comp rx=0 tx=0).stop 2024-09-12T01:36:08.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.069+0000 7f7d577fe640 1 -- 172.21.15.60:0/1009449839 shutdown_connections 2024-09-12T01:36:08.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.069+0000 7f7d577fe640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d6c149240 0x7f7d6c163da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.069+0000 7f7d577fe640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d6c070fb0 0x7f7d6c14ace0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.069+0000 7f7d577fe640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d5006bf30 0x7f7d5006e3f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.069+0000 7f7d577fe640 1 --2- 172.21.15.60:0/1009449839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d6c06edf0 0x7f7d6c14a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.070+0000 7f7d577fe640 1 -- 172.21.15.60:0/1009449839 >> 172.21.15.60:0/1009449839 conn(0x7f7d6c0d03e0 msgr2=0x7f7d6c0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.070+0000 7f7d577fe640 1 -- 172.21.15.60:0/1009449839 shutdown_connections 2024-09-12T01:36:08.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.070+0000 7f7d577fe640 1 -- 172.21.15.60:0/1009449839 wait complete. 2024-09-12T01:36:08.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-09-12T01:36:08.086 DEBUG:teuthology.parallel:result is None 2024-09-12T01:36:08.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.107+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7a68005580 con 0x7f7a8415f820 2024-09-12T01:36:08.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.108+0000 7f7a7b7fe640 1 -- 172.21.15.60:0/466436703 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7a7c05ffd0 con 0x7f7a8415f820 2024-09-12T01:36:08.107 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T01:36:08.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.110+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a6406bf00 msgr2=0x7f7a6406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.110+0000 7f7a8883b640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a6406bf00 0x7f7a6406e3c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c005880 tx=0x7f7a6c009040 comp rx=0 tx=0).stop 2024-09-12T01:36:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.110+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a8415f820 msgr2=0x7f7a84149b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.110+0000 7f7a8883b640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a8415f820 0x7f7a84149b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c010da0 tx=0x7f7a7c00e730 comp rx=0 tx=0).stop 2024-09-12T01:36:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.110+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 shutdown_connections 2024-09-12T01:36:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.110+0000 7f7a8883b640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a6406bf00 0x7f7a6406e3c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.110+0000 7f7a8883b640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a8415f820 0x7f7a84149b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.110+0000 7f7a8883b640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a84072740 0x7f7a840af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.110+0000 7f7a8883b640 1 --2- 172.21.15.60:0/466436703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a8406de30 0x7f7a841585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.110+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 >> 172.21.15.60:0/466436703 conn(0x7f7a840b2f00 msgr2=0x7f7a840b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.111+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 shutdown_connections 2024-09-12T01:36:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.111+0000 7f7a8883b640 1 -- 172.21.15.60:0/466436703 wait complete. 2024-09-12T01:36:08.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-09-12T01:36:08.121 DEBUG:teuthology.parallel:result is None 2024-09-12T01:36:08.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.134+0000 7f354f0e9640 1 -- 172.21.15.60:0/3731299766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3530005580 con 0x7f35480d0ae0 2024-09-12T01:36:08.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.134+0000 7f353effd640 1 -- 172.21.15.60:0/3731299766 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3544059010 con 0x7f35480d0ae0 2024-09-12T01:36:08.133 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T01:36:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.137+0000 7f354f0e9640 1 -- 172.21.15.60:0/3731299766 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f352c06be30 msgr2=0x7f352c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.137+0000 7f354f0e9640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f352c06be30 0x7f352c06e2f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3540001560 tx=0x7f3540009040 comp rx=0 tx=0).stop 2024-09-12T01:36:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.138+0000 7f354f0e9640 1 -- 172.21.15.60:0/3731299766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35480d0ae0 msgr2=0x7f35481489c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.138+0000 7f354f0e9640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35480d0ae0 0x7f35481489c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f354400d550 tx=0x7f354400da10 comp rx=0 tx=0).stop 2024-09-12T01:36:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.138+0000 7f354f0e9640 1 -- 172.21.15.60:0/3731299766 shutdown_connections 2024-09-12T01:36:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.138+0000 7f354f0e9640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f352c06be30 0x7f352c06e2f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.138+0000 7f354f0e9640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3548158030 0x7f354814ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.138+0000 7f354f0e9640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35480d0ae0 0x7f35481489c0 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f354400d550 tx=0x7f354400da10 comp rx=0 tx=0).stop 2024-09-12T01:36:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.138+0000 7f354f0e9640 1 --2- 172.21.15.60:0/3731299766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35480b39c0 0x7f3548073070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.138+0000 7f354f0e9640 1 -- 172.21.15.60:0/3731299766 >> 172.21.15.60:0/3731299766 conn(0x7f354806d0f0 msgr2=0x7f35480cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.138+0000 7f354f0e9640 1 -- 172.21.15.60:0/3731299766 shutdown_connections 2024-09-12T01:36:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.138+0000 7f354f0e9640 1 -- 172.21.15.60:0/3731299766 wait complete. 2024-09-12T01:36:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.139+0000 7fd558042640 1 -- 172.21.15.60:0/3076964278 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd538005850 con 0x7fd55015a680 2024-09-12T01:36:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.139+0000 7fd5467fc640 1 -- 172.21.15.60:0/3076964278 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd548010040 con 0x7fd55015a680 2024-09-12T01:36:08.139 INFO:teuthology.orchestra.run.smithi060.stdout:64424509448 2024-09-12T01:36:08.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.141+0000 7fa459682640 1 -- 172.21.15.60:0/4172281230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa45415eb20 con 0x7fa45406f630 2024-09-12T01:36:08.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.141+0000 7fa43b7fe640 1 -- 172.21.15.60:0/4172281230 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa44404b030 con 0x7fa45406f630 2024-09-12T01:36:08.141 INFO:teuthology.orchestra.run.smithi060.stdout:64424509449 2024-09-12T01:36:08.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.142+0000 7fd558042640 1 -- 172.21.15.60:0/3076964278 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd53406be30 msgr2=0x7fd53406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.142+0000 7fd558042640 1 --2- 172.21.15.60:0/3076964278 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd53406be30 0x7fd53406e2f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd54c034000 tx=0x7fd54c02e000 comp rx=0 tx=0).stop 2024-09-12T01:36:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.142+0000 7fd558042640 1 -- 172.21.15.60:0/3076964278 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd55015a680 msgr2=0x7fd5500b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.142+0000 7fd558042640 1 --2- 172.21.15.60:0/3076964278 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd55015a680 0x7fd5500b3a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd548009dd0 tx=0x7fd54800c490 comp rx=0 tx=0).stop 2024-09-12T01:36:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.142+0000 7fd558042640 1 -- 172.21.15.60:0/3076964278 shutdown_connections 2024-09-12T01:36:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.142+0000 7fd558042640 1 --2- 172.21.15.60:0/3076964278 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd53406be30 0x7fd53406e2f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.142+0000 7fd558042640 1 --2- 172.21.15.60:0/3076964278 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd55015a680 0x7fd5500b3a50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.142+0000 7fd558042640 1 --2- 172.21.15.60:0/3076964278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5500d0ed0 0x7fd550140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.142+0000 7fd558042640 1 --2- 172.21.15.60:0/3076964278 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd55006ec20 0x7fd5501f8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.142+0000 7fd558042640 1 -- 172.21.15.60:0/3076964278 >> 172.21.15.60:0/3076964278 conn(0x7fd5500d03e0 msgr2=0x7fd5500b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.142+0000 7fd558042640 1 -- 172.21.15.60:0/3076964278 shutdown_connections 2024-09-12T01:36:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.142+0000 7fd558042640 1 -- 172.21.15.60:0/3076964278 wait complete. 2024-09-12T01:36:08.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.144+0000 7fa459682640 1 -- 172.21.15.60:0/4172281230 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa44006be30 msgr2=0x7fa44006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.144+0000 7fa459682640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa44006be30 0x7fa44006e2f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa45415e420 tx=0x7fa448008040 comp rx=0 tx=0).stop 2024-09-12T01:36:08.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.144+0000 7fa459682640 1 -- 172.21.15.60:0/4172281230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa45406f630 msgr2=0x7fa45414c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.144+0000 7fa459682640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa45406f630 0x7fa45414c1f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa444000c00 tx=0x7fa4440046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.144+0000 7fa459682640 1 -- 172.21.15.60:0/4172281230 shutdown_connections 2024-09-12T01:36:08.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.144+0000 7fa459682640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45406ff50 0x7fa454072c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.144+0000 7fa459682640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa44006be30 0x7fa44006e2f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.144+0000 7fa459682640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4540b4d60 0x7fa45406fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.144+0000 7fa459682640 1 --2- 172.21.15.60:0/4172281230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa45406f630 0x7fa45414c1f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.144+0000 7fa459682640 1 -- 172.21.15.60:0/4172281230 >> 172.21.15.60:0/4172281230 conn(0x7fa4540d1390 msgr2=0x7fa4540b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.144+0000 7fa459682640 1 -- 172.21.15.60:0/4172281230 shutdown_connections 2024-09-12T01:36:08.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.144+0000 7fa459682640 1 -- 172.21.15.60:0/4172281230 wait complete. 2024-09-12T01:36:08.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.145+0000 7f7ce7fff640 1 -- 172.21.15.60:0/1428343623 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f7d0415b630 con 0x7f7d04144500 2024-09-12T01:36:08.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.145+0000 7f7cfa7fc640 1 -- 172.21.15.60:0/1428343623 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7d00079950 con 0x7f7d04144500 2024-09-12T01:36:08.145 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T01:36:08.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.146+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/4233886162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd8c4005850 con 0x7fd8e4167120 2024-09-12T01:36:08.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.147+0000 7fd8e0ff9640 1 -- 172.21.15.60:0/4233886162 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd8d8059f30 con 0x7fd8e4167120 2024-09-12T01:36:08.146 INFO:teuthology.orchestra.run.smithi060.stdout:55834574855 2024-09-12T01:36:08.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.149+0000 7f7ce7fff640 1 -- 172.21.15.60:0/1428343623 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ce806bf00 msgr2=0x7f7ce806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.149+0000 7f7ce7fff640 1 --2- 172.21.15.60:0/1428343623 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ce806bf00 0x7f7ce806e3c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009400 tx=0x7f7cfc009350 comp rx=0 tx=0).stop 2024-09-12T01:36:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.149+0000 7f7ce7fff640 1 -- 172.21.15.60:0/1428343623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d04144500 msgr2=0x7f7d041514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.149+0000 7f7ce7fff640 1 --2- 172.21.15.60:0/1428343623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d04144500 0x7f7d041514a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d000098c0 tx=0x7f7d000046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.149+0000 7f7ce7fff640 1 -- 172.21.15.60:0/1428343623 shutdown_connections 2024-09-12T01:36:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.149+0000 7f7ce7fff640 1 --2- 172.21.15.60:0/1428343623 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ce806bf00 0x7f7ce806e3c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.149+0000 7f7ce7fff640 1 --2- 172.21.15.60:0/1428343623 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d04144500 0x7f7d041514a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.149+0000 7f7ce7fff640 1 --2- 172.21.15.60:0/1428343623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d040b40e0 0x7f7d04150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.149+0000 7f7ce7fff640 1 --2- 172.21.15.60:0/1428343623 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d04072bf0 0x7f7d04130ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.149+0000 7f7ce7fff640 1 -- 172.21.15.60:0/1428343623 >> 172.21.15.60:0/1428343623 conn(0x7f7d040d09a0 msgr2=0x7f7d0415ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.149+0000 7f7ce7fff640 1 -- 172.21.15.60:0/1428343623 shutdown_connections 2024-09-12T01:36:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.149+0000 7f7ce7fff640 1 -- 172.21.15.60:0/1428343623 wait complete. 2024-09-12T01:36:08.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.150+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/4233886162 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8d006be30 msgr2=0x7fd8d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.150+0000 7fd8ea7cf640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8d006be30 0x7fd8d006e2f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc033000 tx=0x7fd8dc009000 comp rx=0 tx=0).stop 2024-09-12T01:36:08.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.150+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/4233886162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e4167120 msgr2=0x7fd8e41f8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.150+0000 7fd8ea7cf640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e4167120 0x7fd8e41f8ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800d5d0 tx=0x7fd8d800da90 comp rx=0 tx=0).stop 2024-09-12T01:36:08.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.150+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/4233886162 shutdown_connections 2024-09-12T01:36:08.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.150+0000 7fd8ea7cf640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8e4167120 0x7fd8e41f8ad0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.150+0000 7fd8ea7cf640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8e41492f0 0x7fd8e41411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.150+0000 7fd8ea7cf640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8d006be30 0x7fd8d006e2f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.150+0000 7fd8ea7cf640 1 --2- 172.21.15.60:0/4233886162 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8e40b60e0 0x7fd8e41621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.150+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/4233886162 >> 172.21.15.60:0/4233886162 conn(0x7fd8e406d0f0 msgr2=0x7fd8e4147590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.150+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/4233886162 shutdown_connections 2024-09-12T01:36:08.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.150+0000 7fd8ea7cf640 1 -- 172.21.15.60:0/4233886162 wait complete. 2024-09-12T01:36:08.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.151+0000 7ff57affd640 1 -- 172.21.15.60:0/1146460332 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff5940d14e0 con 0x7ff594155820 2024-09-12T01:36:08.152 INFO:teuthology.orchestra.run.smithi060.stdout:64424509447 2024-09-12T01:36:08.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.152+0000 7ff5917fa640 1 -- 172.21.15.60:0/1146460332 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff58c058ef0 con 0x7ff594155820 2024-09-12T01:36:08.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.155+0000 7ff57affd640 1 -- 172.21.15.60:0/1146460332 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff58006bf00 msgr2=0x7ff58006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.155+0000 7ff57affd640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff58006bf00 0x7ff58006e3c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff588034000 tx=0x7ff58802e000 comp rx=0 tx=0).stop 2024-09-12T01:36:08.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.155+0000 7ff57affd640 1 -- 172.21.15.60:0/1146460332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 msgr2=0x7ff594156190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.155+0000 7ff57affd640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 0x7ff594156190 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00caa0 tx=0x7ff58c00cf60 comp rx=0 tx=0).stop 2024-09-12T01:36:08.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.155+0000 7ff57affd640 1 -- 172.21.15.60:0/1146460332 shutdown_connections 2024-09-12T01:36:08.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.155+0000 7ff57affd640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff58006bf00 0x7ff58006e3c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.155+0000 7ff57affd640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff594155820 0x7ff594156190 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.155+0000 7ff57affd640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5940d39c0 0x7ff594151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.155+0000 7ff57affd640 1 --2- 172.21.15.60:0/1146460332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5940d1050 0x7ff5942009c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.155+0000 7ff57affd640 1 -- 172.21.15.60:0/1146460332 >> 172.21.15.60:0/1146460332 conn(0x7ff594062630 msgr2=0x7ff594161900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.155+0000 7ff57affd640 1 -- 172.21.15.60:0/1146460332 shutdown_connections 2024-09-12T01:36:08.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.156+0000 7ff57affd640 1 -- 172.21.15.60:0/1146460332 wait complete. 2024-09-12T01:36:08.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-09-12T01:36:08.157 DEBUG:teuthology.parallel:result is None 2024-09-12T01:36:08.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.0 2024-09-12T01:36:08.158 DEBUG:teuthology.parallel:result is None 2024-09-12T01:36:08.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.7 2024-09-12T01:36:08.162 DEBUG:teuthology.parallel:result is None 2024-09-12T01:36:08.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-09-12T01:36:08.165 DEBUG:teuthology.parallel:result is None 2024-09-12T01:36:08.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2024-09-12T01:36:08.168 DEBUG:teuthology.parallel:result is None 2024-09-12T01:36:08.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-09-12T01:36:08.171 DEBUG:teuthology.parallel:result is None 2024-09-12T01:36:08.171 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:36:08.171 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:36:08.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.315+0000 7f81dd8ba640 1 Processor -- start 2024-09-12T01:36:08.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.315+0000 7f81dd8ba640 1 -- start start 2024-09-12T01:36:08.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81dd8ba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f81d815e660 0x7f81d80cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81dd8ba640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f81d80d3310 0x7f81d80d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81dd8ba640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d815ea40 con 0x7f81d80d1650 2024-09-12T01:36:08.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81dd8ba640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f81d80d1ac0 con 0x7f81d815e660 2024-09-12T01:36:08.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81dd8ba640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f81d80d3870 con 0x7f81d80d3310 2024-09-12T01:36:08.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81d6ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f81d815e660 0x7f81d80cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81d6ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f81d815e660 0x7f81d80cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49386/0 (socket says 172.21.15.60:49386) 2024-09-12T01:36:08.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81d6ffd640 1 -- 172.21.15.60:0/625048144 learned_addr learned my addr 172.21.15.60:0/625048144 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:08.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81d67fc640 1 --2- 172.21.15.60:0/625048144 >> v2:172.21.15.105:3300/0 conn(0x7f81d80d3310 0x7f81d80d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81d6ffd640 1 -- 172.21.15.60:0/625048144 >> v2:172.21.15.105:3300/0 conn(0x7f81d80d3310 msgr2=0x7f81d80d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:08.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81d6ffd640 1 --2- 172.21.15.60:0/625048144 >> v2:172.21.15.105:3300/0 conn(0x7f81d80d3310 0x7f81d80d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81d6ffd640 1 -- 172.21.15.60:0/625048144 >> v1:172.21.15.105:6789/0 conn(0x7f81d80d1650 legacy=0x7f81d806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.316+0000 7f81d6ffd640 1 -- 172.21.15.60:0/625048144 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d80d3b50 con 0x7f81d815e660 2024-09-12T01:36:08.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.317+0000 7f81d6ffd640 1 --2- 172.21.15.60:0/625048144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81d815e660 0x7f81d80cf730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f81d80c8020 tx=0x7f81c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced93ca174d58fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:08.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.317+0000 7f81d5ffb640 1 -- 172.21.15.60:0/625048144 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8037070 con 0x7f81d815e660 2024-09-12T01:36:08.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.317+0000 7f81d5ffb640 1 -- 172.21.15.60:0/625048144 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c8032440 con 0x7f81d815e660 2024-09-12T01:36:08.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.317+0000 7f81d5ffb640 1 -- 172.21.15.60:0/625048144 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8032810 con 0x7f81d815e660 2024-09-12T01:36:08.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.318+0000 7f81dd8ba640 1 -- 172.21.15.60:0/625048144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81d815e660 msgr2=0x7f81d80cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.318+0000 7f81dd8ba640 1 --2- 172.21.15.60:0/625048144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81d815e660 0x7f81d80cf730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f81d80c8020 tx=0x7f81c802a270 comp rx=0 tx=0).stop 2024-09-12T01:36:08.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.318+0000 7f81dd8ba640 1 -- 172.21.15.60:0/625048144 shutdown_connections 2024-09-12T01:36:08.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.318+0000 7f81dd8ba640 1 --2- 172.21.15.60:0/625048144 >> v2:172.21.15.105:3300/0 conn(0x7f81d80d3310 0x7f81d80d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.318+0000 7f81dd8ba640 1 --2- 172.21.15.60:0/625048144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81d815e660 0x7f81d80cf730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.318+0000 7f81dd8ba640 1 -- 172.21.15.60:0/625048144 >> 172.21.15.60:0/625048144 conn(0x7f81d80b6410 msgr2=0x7f81d80b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.318+0000 7f81dd8ba640 1 -- 172.21.15.60:0/625048144 shutdown_connections 2024-09-12T01:36:08.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.318+0000 7f81dd8ba640 1 -- 172.21.15.60:0/625048144 wait complete. 2024-09-12T01:36:08.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.319+0000 7f81dd8ba640 1 Processor -- start 2024-09-12T01:36:08.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.319+0000 7f81dd8ba640 1 -- start start 2024-09-12T01:36:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81dd8ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81d80d1650 0x7f81d814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81dd8ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81d80d3310 0x7f81d815f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81dd8ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81d815e660 0x7f81d815fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81dd8ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f81d80d43f0 con 0x7f81d80d3310 2024-09-12T01:36:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81dd8ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f81d80d4110 con 0x7f81d80d1650 2024-09-12T01:36:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81dd8ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f81d80cfc70 con 0x7f81d815e660 2024-09-12T01:36:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81d67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81d80d3310 0x7f81d815f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81d67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81d80d3310 0x7f81d815f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49392/0 (socket says 172.21.15.60:49392) 2024-09-12T01:36:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81d67fc640 1 -- 172.21.15.60:0/1408863124 learned_addr learned my addr 172.21.15.60:0/1408863124 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81d77fe640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81d815e660 0x7f81d815fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81d6ffd640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81d80d1650 0x7f81d814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81d67fc640 1 -- 172.21.15.60:0/1408863124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81d815e660 msgr2=0x7f81d815fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81d67fc640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81d815e660 0x7f81d815fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81d67fc640 1 -- 172.21.15.60:0/1408863124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81d80d1650 msgr2=0x7f81d814fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81d67fc640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81d80d1650 0x7f81d814fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81d67fc640 1 -- 172.21.15.60:0/1408863124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d8156150 con 0x7f81d80d3310 2024-09-12T01:36:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81d67fc640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81d80d3310 0x7f81d815f620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00d5d0 tx=0x7f81cc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81bffff640 1 -- 172.21.15.60:0/1408863124 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0125f0 con 0x7f81d80d3310 2024-09-12T01:36:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81bffff640 1 -- 172.21.15.60:0/1408863124 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81cc019070 con 0x7f81d80d3310 2024-09-12T01:36:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81dd8ba640 1 -- 172.21.15.60:0/1408863124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d8160190 con 0x7f81d80d3310 2024-09-12T01:36:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.320+0000 7f81bffff640 1 -- 172.21.15.60:0/1408863124 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0129f0 con 0x7f81d80d3310 2024-09-12T01:36:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.321+0000 7f81dd8ba640 1 -- 172.21.15.60:0/1408863124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d8160750 con 0x7f81d80d3310 2024-09-12T01:36:08.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.322+0000 7f81dd8ba640 1 -- 172.21.15.60:0/1408863124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81d80d1110 con 0x7f81d80d3310 2024-09-12T01:36:08.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.322+0000 7f81bffff640 1 -- 172.21.15.60:0/1408863124 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81cc012b90 con 0x7f81d80d3310 2024-09-12T01:36:08.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.322+0000 7f81bffff640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81c406be30 0x7f81c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.323+0000 7f81bffff640 1 -- 172.21.15.60:0/1408863124 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f81cc08b180 con 0x7f81d80d3310 2024-09-12T01:36:08.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.323+0000 7f81d6ffd640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81c406be30 0x7f81c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.323+0000 7f81d6ffd640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81c406be30 0x7f81c406e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f81c8034000 tx=0x7f81c802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:08.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.327+0000 7f81bffff640 1 -- 172.21.15.60:0/1408863124 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81cc0594e0 con 0x7f81d80d3310 2024-09-12T01:36:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.498+0000 7f81dd8ba640 1 -- 172.21.15.60:0/1408863124 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81d81500e0 con 0x7f81c406be30 2024-09-12T01:36:08.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.504+0000 7f81bffff640 1 -- 172.21.15.60:0/1408863124 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251833 (secure 0 0 0) 0x7f81d81500e0 con 0x7f81c406be30 2024-09-12T01:36:08.506 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:08.507 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:36:08.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.507+0000 7f81dd8ba640 1 -- 172.21.15.60:0/1408863124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81c406be30 msgr2=0x7f81c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.507+0000 7f81dd8ba640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81c406be30 0x7f81c406e2f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f81c8034000 tx=0x7f81c802e000 comp rx=0 tx=0).stop 2024-09-12T01:36:08.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.507+0000 7f81dd8ba640 1 -- 172.21.15.60:0/1408863124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81d80d3310 msgr2=0x7f81d815f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.507+0000 7f81dd8ba640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81d80d3310 0x7f81d815f620 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00d5d0 tx=0x7f81cc00da90 comp rx=0 tx=0).stop 2024-09-12T01:36:08.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.507+0000 7f81dd8ba640 1 -- 172.21.15.60:0/1408863124 shutdown_connections 2024-09-12T01:36:08.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.507+0000 7f81dd8ba640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81c406be30 0x7f81c406e2f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.507+0000 7f81dd8ba640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81d815e660 0x7f81d815fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.507+0000 7f81dd8ba640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81d80d3310 0x7f81d815f620 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.507+0000 7f81dd8ba640 1 --2- 172.21.15.60:0/1408863124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81d80d1650 0x7f81d814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.507+0000 7f81dd8ba640 1 -- 172.21.15.60:0/1408863124 >> 172.21.15.60:0/1408863124 conn(0x7f81d80b6410 msgr2=0x7f81d81519f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.507+0000 7f81dd8ba640 1 -- 172.21.15.60:0/1408863124 shutdown_connections 2024-09-12T01:36:08.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.507+0000 7f81dd8ba640 1 -- 172.21.15.60:0/1408863124 wait complete. 2024-09-12T01:36:08.517 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-12T01:36:08.262812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235960,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738760,"statfs":{"total":773094113280,"available":772852490240,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.637109"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642326+0000","last_change":"2024-09-12T01:35:56.652538+0000","last_active":"2024-09-12T01:35:57.642326+0000","last_peered":"2024-09-12T01:35:57.642326+0000","last_clean":"2024-09-12T01:35:57.642326+0000","last_became_active":"2024-09-12T01:35:56.649758+0000","last_became_peered":"2024-09-12T01:35:56.649758+0000","last_unstale":"2024-09-12T01:35:57.642326+0000","last_undegraded":"2024-09-12T01:35:57.642326+0000","last_fullsized":"2024-09-12T01:35:57.642326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.371469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631042+0000","last_change":"2024-09-12T01:35:56.645029+0000","last_active":"2024-09-12T01:35:57.631042+0000","last_peered":"2024-09-12T01:35:57.631042+0000","last_clean":"2024-09-12T01:35:57.631042+0000","last_became_active":"2024-09-12T01:35:56.644727+0000","last_became_peered":"2024-09-12T01:35:56.644727+0000","last_unstale":"2024-09-12T01:35:57.631042+0000","last_undegraded":"2024-09-12T01:35:57.631042+0000","last_fullsized":"2024-09-12T01:35:57.631042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:35.999998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630619+0000","last_change":"2024-09-12T01:35:56.639030+0000","last_active":"2024-09-12T01:35:57.630619+0000","last_peered":"2024-09-12T01:35:57.630619+0000","last_clean":"2024-09-12T01:35:57.630619+0000","last_became_active":"2024-09-12T01:35:56.636574+0000","last_became_peered":"2024-09-12T01:35:56.636574+0000","last_unstale":"2024-09-12T01:35:57.630619+0000","last_undegraded":"2024-09-12T01:35:57.630619+0000","last_fullsized":"2024-09-12T01:35:57.630619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.394879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801812+0000","last_change":"2024-09-12T01:35:56.634505+0000","last_active":"2024-09-12T01:35:57.801812+0000","last_peered":"2024-09-12T01:35:57.801812+0000","last_clean":"2024-09-12T01:35:57.801812+0000","last_became_active":"2024-09-12T01:35:56.630851+0000","last_became_peered":"2024-09-12T01:35:56.630851+0000","last_unstale":"2024-09-12T01:35:57.801812+0000","last_undegraded":"2024-09-12T01:35:57.801812+0000","last_fullsized":"2024-09-12T01:35:57.801812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:07.092256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642095+0000","last_change":"2024-09-12T01:35:56.656191+0000","last_active":"2024-09-12T01:35:57.642095+0000","last_peered":"2024-09-12T01:35:57.642095+0000","last_clean":"2024-09-12T01:35:57.642095+0000","last_became_active":"2024-09-12T01:35:56.655089+0000","last_became_peered":"2024-09-12T01:35:56.655089+0000","last_unstale":"2024-09-12T01:35:57.642095+0000","last_undegraded":"2024-09-12T01:35:57.642095+0000","last_fullsized":"2024-09-12T01:35:57.642095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:35.999998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801857+0000","last_change":"2024-09-12T01:35:56.637190+0000","last_active":"2024-09-12T01:35:57.801857+0000","last_peered":"2024-09-12T01:35:57.801857+0000","last_clean":"2024-09-12T01:35:57.801857+0000","last_became_active":"2024-09-12T01:35:56.636370+0000","last_became_peered":"2024-09-12T01:35:56.636370+0000","last_unstale":"2024-09-12T01:35:57.801857+0000","last_undegraded":"2024-09-12T01:35:57.801857+0000","last_fullsized":"2024-09-12T01:35:57.801857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:33.731216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641815+0000","last_change":"2024-09-12T01:35:56.645910+0000","last_active":"2024-09-12T01:35:57.641815+0000","last_peered":"2024-09-12T01:35:57.641815+0000","last_clean":"2024-09-12T01:35:57.641815+0000","last_became_active":"2024-09-12T01:35:56.644399+0000","last_became_peered":"2024-09-12T01:35:56.644399+0000","last_unstale":"2024-09-12T01:35:57.641815+0000","last_undegraded":"2024-09-12T01:35:57.641815+0000","last_fullsized":"2024-09-12T01:35:57.641815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.394879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630527+0000","last_change":"2024-09-12T01:35:56.645704+0000","last_active":"2024-09-12T01:35:57.630527+0000","last_peered":"2024-09-12T01:35:57.630527+0000","last_clean":"2024-09-12T01:35:57.630527+0000","last_became_active":"2024-09-12T01:35:56.645446+0000","last_became_peered":"2024-09-12T01:35:56.645446+0000","last_unstale":"2024-09-12T01:35:57.630527+0000","last_undegraded":"2024-09-12T01:35:57.630527+0000","last_fullsized":"2024-09-12T01:35:57.630527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:58.408814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802258+0000","last_change":"2024-09-12T01:35:56.640496+0000","last_active":"2024-09-12T01:35:57.802258+0000","last_peered":"2024-09-12T01:35:57.802258+0000","last_clean":"2024-09-12T01:35:57.802258+0000","last_became_active":"2024-09-12T01:35:56.640151+0000","last_became_peered":"2024-09-12T01:35:56.640151+0000","last_unstale":"2024-09-12T01:35:57.802258+0000","last_undegraded":"2024-09-12T01:35:57.802258+0000","last_fullsized":"2024-09-12T01:35:57.802258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:19.084585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642330+0000","last_change":"2024-09-12T01:35:56.646582+0000","last_active":"2024-09-12T01:35:57.642330+0000","last_peered":"2024-09-12T01:35:57.642330+0000","last_clean":"2024-09-12T01:35:57.642330+0000","last_became_active":"2024-09-12T01:35:56.646282+0000","last_became_peered":"2024-09-12T01:35:56.646282+0000","last_unstale":"2024-09-12T01:35:57.642330+0000","last_undegraded":"2024-09-12T01:35:57.642330+0000","last_fullsized":"2024-09-12T01:35:57.642330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:51.888372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642049+0000","last_change":"2024-09-12T01:35:56.647738+0000","last_active":"2024-09-12T01:35:57.642049+0000","last_peered":"2024-09-12T01:35:57.642049+0000","last_clean":"2024-09-12T01:35:57.642049+0000","last_became_active":"2024-09-12T01:35:56.647449+0000","last_became_peered":"2024-09-12T01:35:56.647449+0000","last_unstale":"2024-09-12T01:35:57.642049+0000","last_undegraded":"2024-09-12T01:35:57.642049+0000","last_fullsized":"2024-09-12T01:35:57.642049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:45.869660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642039+0000","last_change":"2024-09-12T01:35:56.656184+0000","last_active":"2024-09-12T01:35:57.642039+0000","last_peered":"2024-09-12T01:35:57.642039+0000","last_clean":"2024-09-12T01:35:57.642039+0000","last_became_active":"2024-09-12T01:35:56.655377+0000","last_became_peered":"2024-09-12T01:35:56.655377+0000","last_unstale":"2024-09-12T01:35:57.642039+0000","last_undegraded":"2024-09-12T01:35:57.642039+0000","last_fullsized":"2024-09-12T01:35:57.642039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.332152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801933+0000","last_change":"2024-09-12T01:35:56.657060+0000","last_active":"2024-09-12T01:35:57.801933+0000","last_peered":"2024-09-12T01:35:57.801933+0000","last_clean":"2024-09-12T01:35:57.801933+0000","last_became_active":"2024-09-12T01:35:56.656754+0000","last_became_peered":"2024-09-12T01:35:56.656754+0000","last_unstale":"2024-09-12T01:35:57.801933+0000","last_undegraded":"2024-09-12T01:35:57.801933+0000","last_fullsized":"2024-09-12T01:35:57.801933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:15.773656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802474+0000","last_change":"2024-09-12T01:35:56.643585+0000","last_active":"2024-09-12T01:35:57.802474+0000","last_peered":"2024-09-12T01:35:57.802474+0000","last_clean":"2024-09-12T01:35:57.802474+0000","last_became_active":"2024-09-12T01:35:56.643312+0000","last_became_peered":"2024-09-12T01:35:56.643312+0000","last_unstale":"2024-09-12T01:35:57.802474+0000","last_undegraded":"2024-09-12T01:35:57.802474+0000","last_fullsized":"2024-09-12T01:35:57.802474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:17.807421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630738+0000","last_change":"2024-09-12T01:35:56.659070+0000","last_active":"2024-09-12T01:35:57.630738+0000","last_peered":"2024-09-12T01:35:57.630738+0000","last_clean":"2024-09-12T01:35:57.630738+0000","last_became_active":"2024-09-12T01:35:56.658797+0000","last_became_peered":"2024-09-12T01:35:56.658797+0000","last_unstale":"2024-09-12T01:35:57.630738+0000","last_undegraded":"2024-09-12T01:35:57.630738+0000","last_fullsized":"2024-09-12T01:35:57.630738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.332152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.626923+0000","last_change":"2024-09-12T01:35:56.645396+0000","last_active":"2024-09-12T01:35:57.626923+0000","last_peered":"2024-09-12T01:35:57.626923+0000","last_clean":"2024-09-12T01:35:57.626923+0000","last_became_active":"2024-09-12T01:35:56.645072+0000","last_became_peered":"2024-09-12T01:35:56.645072+0000","last_unstale":"2024-09-12T01:35:57.626923+0000","last_undegraded":"2024-09-12T01:35:57.626923+0000","last_fullsized":"2024-09-12T01:35:57.626923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.371469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627612+0000","last_change":"2024-09-12T01:35:56.660353+0000","last_active":"2024-09-12T01:35:57.627612+0000","last_peered":"2024-09-12T01:35:57.627612+0000","last_clean":"2024-09-12T01:35:57.627612+0000","last_became_active":"2024-09-12T01:35:56.659742+0000","last_became_peered":"2024-09-12T01:35:56.659742+0000","last_unstale":"2024-09-12T01:35:57.627612+0000","last_undegraded":"2024-09-12T01:35:57.627612+0000","last_fullsized":"2024-09-12T01:35:57.627612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:35.865103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802429+0000","last_change":"2024-09-12T01:35:56.645188+0000","last_active":"2024-09-12T01:35:57.802429+0000","last_peered":"2024-09-12T01:35:57.802429+0000","last_clean":"2024-09-12T01:35:57.802429+0000","last_became_active":"2024-09-12T01:35:56.644908+0000","last_became_peered":"2024-09-12T01:35:56.644908+0000","last_unstale":"2024-09-12T01:35:57.802429+0000","last_undegraded":"2024-09-12T01:35:57.802429+0000","last_fullsized":"2024-09-12T01:35:57.802429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:35.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627360+0000","last_change":"2024-09-12T01:35:56.652945+0000","last_active":"2024-09-12T01:35:57.627360+0000","last_peered":"2024-09-12T01:35:57.627360+0000","last_clean":"2024-09-12T01:35:57.627360+0000","last_became_active":"2024-09-12T01:35:56.652621+0000","last_became_peered":"2024-09-12T01:35:56.652621+0000","last_unstale":"2024-09-12T01:35:57.627360+0000","last_undegraded":"2024-09-12T01:35:57.627360+0000","last_fullsized":"2024-09-12T01:35:57.627360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:56.037938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642061+0000","last_change":"2024-09-12T01:35:56.656055+0000","last_active":"2024-09-12T01:35:57.642061+0000","last_peered":"2024-09-12T01:35:57.642061+0000","last_clean":"2024-09-12T01:35:57.642061+0000","last_became_active":"2024-09-12T01:35:56.654905+0000","last_became_peered":"2024-09-12T01:35:56.654905+0000","last_unstale":"2024-09-12T01:35:57.642061+0000","last_undegraded":"2024-09-12T01:35:57.642061+0000","last_fullsized":"2024-09-12T01:35:57.642061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:21.267324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630212+0000","last_change":"2024-09-12T01:35:56.630997+0000","last_active":"2024-09-12T01:35:57.630212+0000","last_peered":"2024-09-12T01:35:57.630212+0000","last_clean":"2024-09-12T01:35:57.630212+0000","last_became_active":"2024-09-12T01:35:56.630704+0000","last_became_peered":"2024-09-12T01:35:56.630704+0000","last_unstale":"2024-09-12T01:35:57.630212+0000","last_undegraded":"2024-09-12T01:35:57.630212+0000","last_fullsized":"2024-09-12T01:35:57.630212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:33.242417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801745+0000","last_change":"2024-09-12T01:35:56.655607+0000","last_active":"2024-09-12T01:35:57.801745+0000","last_peered":"2024-09-12T01:35:57.801745+0000","last_clean":"2024-09-12T01:35:57.801745+0000","last_became_active":"2024-09-12T01:35:56.655296+0000","last_became_peered":"2024-09-12T01:35:56.655296+0000","last_unstale":"2024-09-12T01:35:57.801745+0000","last_undegraded":"2024-09-12T01:35:57.801745+0000","last_fullsized":"2024-09-12T01:35:57.801745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:43.447041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630934+0000","last_change":"2024-09-12T01:35:56.633081+0000","last_active":"2024-09-12T01:35:57.630934+0000","last_peered":"2024-09-12T01:35:57.630934+0000","last_clean":"2024-09-12T01:35:57.630934+0000","last_became_active":"2024-09-12T01:35:56.632706+0000","last_became_peered":"2024-09-12T01:35:56.632706+0000","last_unstale":"2024-09-12T01:35:57.630934+0000","last_undegraded":"2024-09-12T01:35:57.630934+0000","last_fullsized":"2024-09-12T01:35:57.630934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:21.267324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.626950+0000","last_change":"2024-09-12T01:35:56.647872+0000","last_active":"2024-09-12T01:35:57.626950+0000","last_peered":"2024-09-12T01:35:57.626950+0000","last_clean":"2024-09-12T01:35:57.626950+0000","last_became_active":"2024-09-12T01:35:56.647557+0000","last_became_peered":"2024-09-12T01:35:56.647557+0000","last_unstale":"2024-09-12T01:35:57.626950+0000","last_undegraded":"2024-09-12T01:35:57.626950+0000","last_fullsized":"2024-09-12T01:35:57.626950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:51.888372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631144+0000","last_change":"2024-09-12T01:35:56.647973+0000","last_active":"2024-09-12T01:35:57.631144+0000","last_peered":"2024-09-12T01:35:57.631144+0000","last_clean":"2024-09-12T01:35:57.631144+0000","last_became_active":"2024-09-12T01:35:56.647548+0000","last_became_peered":"2024-09-12T01:35:56.647548+0000","last_unstale":"2024-09-12T01:35:57.631144+0000","last_undegraded":"2024-09-12T01:35:57.631144+0000","last_fullsized":"2024-09-12T01:35:57.631144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:14.579275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801953+0000","last_change":"2024-09-12T01:35:56.640025+0000","last_active":"2024-09-12T01:35:57.801953+0000","last_peered":"2024-09-12T01:35:57.801953+0000","last_clean":"2024-09-12T01:35:57.801953+0000","last_became_active":"2024-09-12T01:35:56.639534+0000","last_became_peered":"2024-09-12T01:35:56.639534+0000","last_unstale":"2024-09-12T01:35:57.801953+0000","last_undegraded":"2024-09-12T01:35:57.801953+0000","last_fullsized":"2024-09-12T01:35:57.801953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:28.894518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802022+0000","last_change":"2024-09-12T01:35:56.639831+0000","last_active":"2024-09-12T01:35:57.802022+0000","last_peered":"2024-09-12T01:35:57.802022+0000","last_clean":"2024-09-12T01:35:57.802022+0000","last_became_active":"2024-09-12T01:35:56.639541+0000","last_became_peered":"2024-09-12T01:35:56.639541+0000","last_unstale":"2024-09-12T01:35:57.802022+0000","last_undegraded":"2024-09-12T01:35:57.802022+0000","last_fullsized":"2024-09-12T01:35:57.802022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:27.826729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801870+0000","last_change":"2024-09-12T01:35:56.656888+0000","last_active":"2024-09-12T01:35:57.801870+0000","last_peered":"2024-09-12T01:35:57.801870+0000","last_clean":"2024-09-12T01:35:57.801870+0000","last_became_active":"2024-09-12T01:35:56.656593+0000","last_became_peered":"2024-09-12T01:35:56.656593+0000","last_unstale":"2024-09-12T01:35:57.801870+0000","last_undegraded":"2024-09-12T01:35:57.801870+0000","last_fullsized":"2024-09-12T01:35:57.801870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:28.894518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630352+0000","last_change":"2024-09-12T01:35:56.642012+0000","last_active":"2024-09-12T01:35:57.630352+0000","last_peered":"2024-09-12T01:35:57.630352+0000","last_clean":"2024-09-12T01:35:57.630352+0000","last_became_active":"2024-09-12T01:35:56.639930+0000","last_became_peered":"2024-09-12T01:35:56.639930+0000","last_unstale":"2024-09-12T01:35:57.630352+0000","last_undegraded":"2024-09-12T01:35:57.630352+0000","last_fullsized":"2024-09-12T01:35:57.630352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:43.345557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627036+0000","last_change":"2024-09-12T01:35:56.649019+0000","last_active":"2024-09-12T01:35:57.627036+0000","last_peered":"2024-09-12T01:35:57.627036+0000","last_clean":"2024-09-12T01:35:57.627036+0000","last_became_active":"2024-09-12T01:35:56.648688+0000","last_became_peered":"2024-09-12T01:35:56.648688+0000","last_unstale":"2024-09-12T01:35:57.627036+0000","last_undegraded":"2024-09-12T01:35:57.627036+0000","last_fullsized":"2024-09-12T01:35:57.627036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:30.634946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802089+0000","last_change":"2024-09-12T01:35:56.638917+0000","last_active":"2024-09-12T01:35:57.802089+0000","last_peered":"2024-09-12T01:35:57.802089+0000","last_clean":"2024-09-12T01:35:57.802089+0000","last_became_active":"2024-09-12T01:35:56.638636+0000","last_became_peered":"2024-09-12T01:35:56.638636+0000","last_unstale":"2024-09-12T01:35:57.802089+0000","last_undegraded":"2024-09-12T01:35:57.802089+0000","last_fullsized":"2024-09-12T01:35:57.802089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:43.959102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801561+0000","last_change":"2024-09-12T01:35:56.641065+0000","last_active":"2024-09-12T01:35:57.801561+0000","last_peered":"2024-09-12T01:35:57.801561+0000","last_clean":"2024-09-12T01:35:57.801561+0000","last_became_active":"2024-09-12T01:35:56.640725+0000","last_became_peered":"2024-09-12T01:35:56.640725+0000","last_unstale":"2024-09-12T01:35:57.801561+0000","last_undegraded":"2024-09-12T01:35:57.801561+0000","last_fullsized":"2024-09-12T01:35:57.801561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:35.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802049+0000","last_change":"2024-09-12T01:35:56.648505+0000","last_active":"2024-09-12T01:35:57.802049+0000","last_peered":"2024-09-12T01:35:57.802049+0000","last_clean":"2024-09-12T01:35:57.802049+0000","last_became_active":"2024-09-12T01:35:56.648227+0000","last_became_peered":"2024-09-12T01:35:56.648227+0000","last_unstale":"2024-09-12T01:35:57.802049+0000","last_undegraded":"2024-09-12T01:35:57.802049+0000","last_fullsized":"2024-09-12T01:35:57.802049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:35.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630446+0000","last_change":"2024-09-12T01:35:55.632500+0000","last_active":"2024-09-12T01:35:57.630446+0000","last_peered":"2024-09-12T01:35:57.630446+0000","last_clean":"2024-09-12T01:35:57.630446+0000","last_became_active":"2024-09-12T01:35:55.632216+0000","last_became_peered":"2024-09-12T01:35:55.632216+0000","last_unstale":"2024-09-12T01:35:57.630446+0000","last_undegraded":"2024-09-12T01:35:57.630446+0000","last_fullsized":"2024-09-12T01:35:57.630446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:01.774510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630355+0000","last_change":"2024-09-12T01:35:56.650933+0000","last_active":"2024-09-12T01:35:57.630355+0000","last_peered":"2024-09-12T01:35:57.630355+0000","last_clean":"2024-09-12T01:35:57.630355+0000","last_became_active":"2024-09-12T01:35:56.649511+0000","last_became_peered":"2024-09-12T01:35:56.649511+0000","last_unstale":"2024-09-12T01:35:57.630355+0000","last_undegraded":"2024-09-12T01:35:57.630355+0000","last_fullsized":"2024-09-12T01:35:57.630355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:37.930582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627176+0000","last_change":"2024-09-12T01:35:55.638359+0000","last_active":"2024-09-12T01:35:57.627176+0000","last_peered":"2024-09-12T01:35:57.627176+0000","last_clean":"2024-09-12T01:35:57.627176+0000","last_became_active":"2024-09-12T01:35:55.638062+0000","last_became_peered":"2024-09-12T01:35:55.638062+0000","last_unstale":"2024-09-12T01:35:57.627176+0000","last_undegraded":"2024-09-12T01:35:57.627176+0000","last_fullsized":"2024-09-12T01:35:57.627176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:06.087492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801675+0000","last_change":"2024-09-12T01:35:55.635922+0000","last_active":"2024-09-12T01:35:57.801675+0000","last_peered":"2024-09-12T01:35:57.801675+0000","last_clean":"2024-09-12T01:35:57.801675+0000","last_became_active":"2024-09-12T01:35:55.635602+0000","last_became_peered":"2024-09-12T01:35:55.635602+0000","last_unstale":"2024-09-12T01:35:57.801675+0000","last_undegraded":"2024-09-12T01:35:57.801675+0000","last_fullsized":"2024-09-12T01:35:57.801675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:33.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630802+0000","last_change":"2024-09-12T01:35:56.645491+0000","last_active":"2024-09-12T01:35:57.630802+0000","last_peered":"2024-09-12T01:35:57.630802+0000","last_clean":"2024-09-12T01:35:57.630802+0000","last_became_active":"2024-09-12T01:35:56.645076+0000","last_became_peered":"2024-09-12T01:35:56.645076+0000","last_unstale":"2024-09-12T01:35:57.630802+0000","last_undegraded":"2024-09-12T01:35:57.630802+0000","last_fullsized":"2024-09-12T01:35:57.630802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:45.869660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627065+0000","last_change":"2024-09-12T01:35:55.633626+0000","last_active":"2024-09-12T01:35:57.627065+0000","last_peered":"2024-09-12T01:35:57.627065+0000","last_clean":"2024-09-12T01:35:57.627065+0000","last_became_active":"2024-09-12T01:35:55.632528+0000","last_became_peered":"2024-09-12T01:35:55.632528+0000","last_unstale":"2024-09-12T01:35:57.627065+0000","last_undegraded":"2024-09-12T01:35:57.627065+0000","last_fullsized":"2024-09-12T01:35:57.627065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:42.442278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630785+0000","last_change":"2024-09-12T01:35:56.639249+0000","last_active":"2024-09-12T01:35:57.630785+0000","last_peered":"2024-09-12T01:35:57.630785+0000","last_clean":"2024-09-12T01:35:57.630785+0000","last_became_active":"2024-09-12T01:35:56.638993+0000","last_became_peered":"2024-09-12T01:35:56.638993+0000","last_unstale":"2024-09-12T01:35:57.630785+0000","last_undegraded":"2024-09-12T01:35:57.630785+0000","last_fullsized":"2024-09-12T01:35:57.630785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:52.928010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802311+0000","last_change":"2024-09-12T01:35:55.632875+0000","last_active":"2024-09-12T01:35:57.802311+0000","last_peered":"2024-09-12T01:35:57.802311+0000","last_clean":"2024-09-12T01:35:57.802311+0000","last_became_active":"2024-09-12T01:35:55.632586+0000","last_became_peered":"2024-09-12T01:35:55.632586+0000","last_unstale":"2024-09-12T01:35:57.802311+0000","last_undegraded":"2024-09-12T01:35:57.802311+0000","last_fullsized":"2024-09-12T01:35:57.802311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:33.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802016+0000","last_change":"2024-09-12T01:35:56.639811+0000","last_active":"2024-09-12T01:35:57.802016+0000","last_peered":"2024-09-12T01:35:57.802016+0000","last_clean":"2024-09-12T01:35:57.802016+0000","last_became_active":"2024-09-12T01:35:56.639110+0000","last_became_peered":"2024-09-12T01:35:56.639110+0000","last_unstale":"2024-09-12T01:35:57.802016+0000","last_undegraded":"2024-09-12T01:35:57.802016+0000","last_fullsized":"2024-09-12T01:35:57.802016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:15.773656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642266+0000","last_change":"2024-09-12T01:35:55.636348+0000","last_active":"2024-09-12T01:35:57.642266+0000","last_peered":"2024-09-12T01:35:57.642266+0000","last_clean":"2024-09-12T01:35:57.642266+0000","last_became_active":"2024-09-12T01:35:55.636057+0000","last_became_peered":"2024-09-12T01:35:55.636057+0000","last_unstale":"2024-09-12T01:35:57.642266+0000","last_undegraded":"2024-09-12T01:35:57.642266+0000","last_fullsized":"2024-09-12T01:35:57.642266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:42.954339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631280+0000","last_change":"2024-09-12T01:35:56.641538+0000","last_active":"2024-09-12T01:35:57.631280+0000","last_peered":"2024-09-12T01:35:57.631280+0000","last_clean":"2024-09-12T01:35:57.631280+0000","last_became_active":"2024-09-12T01:35:56.641220+0000","last_became_peered":"2024-09-12T01:35:56.641220+0000","last_unstale":"2024-09-12T01:35:57.631280+0000","last_undegraded":"2024-09-12T01:35:57.631280+0000","last_fullsized":"2024-09-12T01:35:57.631280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:51.888372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802271+0000","last_change":"2024-09-12T01:35:55.632890+0000","last_active":"2024-09-12T01:35:57.802271+0000","last_peered":"2024-09-12T01:35:57.802271+0000","last_clean":"2024-09-12T01:35:57.802271+0000","last_became_active":"2024-09-12T01:35:55.632588+0000","last_became_peered":"2024-09-12T01:35:55.632588+0000","last_unstale":"2024-09-12T01:35:57.802271+0000","last_undegraded":"2024-09-12T01:35:57.802271+0000","last_fullsized":"2024-09-12T01:35:57.802271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:33.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627170+0000","last_change":"2024-09-12T01:35:56.647269+0000","last_active":"2024-09-12T01:35:57.627170+0000","last_peered":"2024-09-12T01:35:57.627170+0000","last_clean":"2024-09-12T01:35:57.627170+0000","last_became_active":"2024-09-12T01:35:56.646958+0000","last_became_peered":"2024-09-12T01:35:56.646958+0000","last_unstale":"2024-09-12T01:35:57.627170+0000","last_undegraded":"2024-09-12T01:35:57.627170+0000","last_fullsized":"2024-09-12T01:35:57.627170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:15.653414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801903+0000","last_change":"2024-09-12T01:35:55.629925+0000","last_active":"2024-09-12T01:35:57.801903+0000","last_peered":"2024-09-12T01:35:57.801903+0000","last_clean":"2024-09-12T01:35:57.801903+0000","last_became_active":"2024-09-12T01:35:55.629615+0000","last_became_peered":"2024-09-12T01:35:55.629615+0000","last_unstale":"2024-09-12T01:35:57.801903+0000","last_undegraded":"2024-09-12T01:35:57.801903+0000","last_fullsized":"2024-09-12T01:35:57.801903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:52.436733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642153+0000","last_change":"2024-09-12T01:35:56.645643+0000","last_active":"2024-09-12T01:35:57.642153+0000","last_peered":"2024-09-12T01:35:57.642153+0000","last_clean":"2024-09-12T01:35:57.642153+0000","last_became_active":"2024-09-12T01:35:56.644779+0000","last_became_peered":"2024-09-12T01:35:56.644779+0000","last_unstale":"2024-09-12T01:35:57.642153+0000","last_undegraded":"2024-09-12T01:35:57.642153+0000","last_fullsized":"2024-09-12T01:35:57.642153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:14.579275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802154+0000","last_change":"2024-09-12T01:35:55.636452+0000","last_active":"2024-09-12T01:35:57.802154+0000","last_peered":"2024-09-12T01:35:57.802154+0000","last_clean":"2024-09-12T01:35:57.802154+0000","last_became_active":"2024-09-12T01:35:55.636112+0000","last_became_peered":"2024-09-12T01:35:55.636112+0000","last_unstale":"2024-09-12T01:35:57.802154+0000","last_undegraded":"2024-09-12T01:35:57.802154+0000","last_fullsized":"2024-09-12T01:35:57.802154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:01.774510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802166+0000","last_change":"2024-09-12T01:35:56.641707+0000","last_active":"2024-09-12T01:35:57.802166+0000","last_peered":"2024-09-12T01:35:57.802166+0000","last_clean":"2024-09-12T01:35:57.802166+0000","last_became_active":"2024-09-12T01:35:56.641414+0000","last_became_peered":"2024-09-12T01:35:56.641414+0000","last_unstale":"2024-09-12T01:35:57.802166+0000","last_undegraded":"2024-09-12T01:35:57.802166+0000","last_fullsized":"2024-09-12T01:35:57.802166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:33.497449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627317+0000","last_change":"2024-09-12T01:35:55.631399+0000","last_active":"2024-09-12T01:35:57.627317+0000","last_peered":"2024-09-12T01:35:57.627317+0000","last_clean":"2024-09-12T01:35:57.627317+0000","last_became_active":"2024-09-12T01:35:55.631049+0000","last_became_peered":"2024-09-12T01:35:55.631049+0000","last_unstale":"2024-09-12T01:35:57.627317+0000","last_undegraded":"2024-09-12T01:35:57.627317+0000","last_fullsized":"2024-09-12T01:35:57.627317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:32.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627114+0000","last_change":"2024-09-12T01:35:56.649037+0000","last_active":"2024-09-12T01:35:57.627114+0000","last_peered":"2024-09-12T01:35:57.627114+0000","last_clean":"2024-09-12T01:35:57.627114+0000","last_became_active":"2024-09-12T01:35:56.648741+0000","last_became_peered":"2024-09-12T01:35:56.648741+0000","last_unstale":"2024-09-12T01:35:57.627114+0000","last_undegraded":"2024-09-12T01:35:57.627114+0000","last_fullsized":"2024-09-12T01:35:57.627114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:38.847972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641868+0000","last_change":"2024-09-12T01:35:55.640137+0000","last_active":"2024-09-12T01:35:57.641868+0000","last_peered":"2024-09-12T01:35:57.641868+0000","last_clean":"2024-09-12T01:35:57.641868+0000","last_became_active":"2024-09-12T01:35:55.639846+0000","last_became_peered":"2024-09-12T01:35:55.639846+0000","last_unstale":"2024-09-12T01:35:57.641868+0000","last_undegraded":"2024-09-12T01:35:57.641868+0000","last_fullsized":"2024-09-12T01:35:57.641868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:34.990543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801732+0000","last_change":"2024-09-12T01:35:56.649723+0000","last_active":"2024-09-12T01:35:57.801732+0000","last_peered":"2024-09-12T01:35:57.801732+0000","last_clean":"2024-09-12T01:35:57.801732+0000","last_became_active":"2024-09-12T01:35:56.649279+0000","last_became_peered":"2024-09-12T01:35:56.649279+0000","last_unstale":"2024-09-12T01:35:57.801732+0000","last_undegraded":"2024-09-12T01:35:57.801732+0000","last_fullsized":"2024-09-12T01:35:57.801732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:43.959102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630113+0000","last_change":"2024-09-12T01:35:55.633512+0000","last_active":"2024-09-12T01:35:57.630113+0000","last_peered":"2024-09-12T01:35:57.630113+0000","last_clean":"2024-09-12T01:35:57.630113+0000","last_became_active":"2024-09-12T01:35:55.630924+0000","last_became_peered":"2024-09-12T01:35:55.630924+0000","last_unstale":"2024-09-12T01:35:57.630113+0000","last_undegraded":"2024-09-12T01:35:57.630113+0000","last_fullsized":"2024-09-12T01:35:57.630113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:22.281284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.626998+0000","last_change":"2024-09-12T01:35:56.645807+0000","last_active":"2024-09-12T01:35:57.626998+0000","last_peered":"2024-09-12T01:35:57.626998+0000","last_clean":"2024-09-12T01:35:57.626998+0000","last_became_active":"2024-09-12T01:35:56.644972+0000","last_became_peered":"2024-09-12T01:35:56.644972+0000","last_unstale":"2024-09-12T01:35:57.626998+0000","last_undegraded":"2024-09-12T01:35:57.626998+0000","last_fullsized":"2024-09-12T01:35:57.626998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:08.484922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642433+0000","last_change":"2024-09-12T01:35:55.641623+0000","last_active":"2024-09-12T01:35:57.642433+0000","last_peered":"2024-09-12T01:35:57.642433+0000","last_clean":"2024-09-12T01:35:57.642433+0000","last_became_active":"2024-09-12T01:35:55.641317+0000","last_became_peered":"2024-09-12T01:35:55.641317+0000","last_unstale":"2024-09-12T01:35:57.642433+0000","last_undegraded":"2024-09-12T01:35:57.642433+0000","last_fullsized":"2024-09-12T01:35:57.642433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:34.433183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802092+0000","last_change":"2024-09-12T01:35:56.647599+0000","last_active":"2024-09-12T01:35:57.802092+0000","last_peered":"2024-09-12T01:35:57.802092+0000","last_clean":"2024-09-12T01:35:57.802092+0000","last_became_active":"2024-09-12T01:35:56.646578+0000","last_became_peered":"2024-09-12T01:35:56.646578+0000","last_unstale":"2024-09-12T01:35:57.802092+0000","last_undegraded":"2024-09-12T01:35:57.802092+0000","last_fullsized":"2024-09-12T01:35:57.802092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:22.084315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630591+0000","last_change":"2024-09-12T01:35:55.632582+0000","last_active":"2024-09-12T01:35:57.630591+0000","last_peered":"2024-09-12T01:35:57.630591+0000","last_clean":"2024-09-12T01:35:57.630591+0000","last_became_active":"2024-09-12T01:35:55.631969+0000","last_became_peered":"2024-09-12T01:35:55.631969+0000","last_unstale":"2024-09-12T01:35:57.630591+0000","last_undegraded":"2024-09-12T01:35:57.630591+0000","last_fullsized":"2024-09-12T01:35:57.630591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:04.556922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642328+0000","last_change":"2024-09-12T01:35:56.655329+0000","last_active":"2024-09-12T01:35:57.642328+0000","last_peered":"2024-09-12T01:35:57.642328+0000","last_clean":"2024-09-12T01:35:57.642328+0000","last_became_active":"2024-09-12T01:35:56.654876+0000","last_became_peered":"2024-09-12T01:35:56.654876+0000","last_unstale":"2024-09-12T01:35:57.642328+0000","last_undegraded":"2024-09-12T01:35:57.642328+0000","last_fullsized":"2024-09-12T01:35:57.642328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:08.484922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630712+0000","last_change":"2024-09-12T01:35:55.629712+0000","last_active":"2024-09-12T01:35:57.630712+0000","last_peered":"2024-09-12T01:35:57.630712+0000","last_clean":"2024-09-12T01:35:57.630712+0000","last_became_active":"2024-09-12T01:35:55.629457+0000","last_became_peered":"2024-09-12T01:35:55.629457+0000","last_unstale":"2024-09-12T01:35:57.630712+0000","last_undegraded":"2024-09-12T01:35:57.630712+0000","last_fullsized":"2024-09-12T01:35:57.630712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:09.561090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642186+0000","last_change":"2024-09-12T01:35:56.657760+0000","last_active":"2024-09-12T01:35:57.642186+0000","last_peered":"2024-09-12T01:35:57.642186+0000","last_clean":"2024-09-12T01:35:57.642186+0000","last_became_active":"2024-09-12T01:35:56.657481+0000","last_became_peered":"2024-09-12T01:35:56.657481+0000","last_unstale":"2024-09-12T01:35:57.642186+0000","last_undegraded":"2024-09-12T01:35:57.642186+0000","last_fullsized":"2024-09-12T01:35:57.642186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:10.654187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802129+0000","last_change":"2024-09-12T01:35:55.635927+0000","last_active":"2024-09-12T01:35:57.802129+0000","last_peered":"2024-09-12T01:35:57.802129+0000","last_clean":"2024-09-12T01:35:57.802129+0000","last_became_active":"2024-09-12T01:35:55.635603+0000","last_became_peered":"2024-09-12T01:35:55.635603+0000","last_unstale":"2024-09-12T01:35:57.802129+0000","last_undegraded":"2024-09-12T01:35:57.802129+0000","last_fullsized":"2024-09-12T01:35:57.802129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:01.774510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627390+0000","last_change":"2024-09-12T01:35:56.639413+0000","last_active":"2024-09-12T01:35:57.627390+0000","last_peered":"2024-09-12T01:35:57.627390+0000","last_clean":"2024-09-12T01:35:57.627390+0000","last_became_active":"2024-09-12T01:35:56.639131+0000","last_became_peered":"2024-09-12T01:35:56.639131+0000","last_unstale":"2024-09-12T01:35:57.627390+0000","last_undegraded":"2024-09-12T01:35:57.627390+0000","last_fullsized":"2024-09-12T01:35:57.627390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:44.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801831+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:35:57.801831+0000","last_peered":"2024-09-12T01:35:57.801831+0000","last_clean":"2024-09-12T01:35:57.801831+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:35:57.801831+0000","last_undegraded":"2024-09-12T01:35:57.801831+0000","last_fullsized":"2024-09-12T01:35:57.801831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627331+0000","last_change":"2024-09-12T01:35:55.631018+0000","last_active":"2024-09-12T01:35:57.627331+0000","last_peered":"2024-09-12T01:35:57.627331+0000","last_clean":"2024-09-12T01:35:57.627331+0000","last_became_active":"2024-09-12T01:35:55.630101+0000","last_became_peered":"2024-09-12T01:35:55.630101+0000","last_unstale":"2024-09-12T01:35:57.627331+0000","last_undegraded":"2024-09-12T01:35:57.627331+0000","last_fullsized":"2024-09-12T01:35:57.627331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:18.079821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630356+0000","last_change":"2024-09-12T01:35:56.631140+0000","last_active":"2024-09-12T01:35:57.630356+0000","last_peered":"2024-09-12T01:35:57.630356+0000","last_clean":"2024-09-12T01:35:57.630356+0000","last_became_active":"2024-09-12T01:35:56.630798+0000","last_became_peered":"2024-09-12T01:35:56.630798+0000","last_unstale":"2024-09-12T01:35:57.630356+0000","last_undegraded":"2024-09-12T01:35:57.630356+0000","last_fullsized":"2024-09-12T01:35:57.630356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:16.316634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627112+0000","last_change":"2024-09-12T01:35:55.634960+0000","last_active":"2024-09-12T01:35:57.627112+0000","last_peered":"2024-09-12T01:35:57.627112+0000","last_clean":"2024-09-12T01:35:57.627112+0000","last_became_active":"2024-09-12T01:35:55.634555+0000","last_became_peered":"2024-09-12T01:35:55.634555+0000","last_unstale":"2024-09-12T01:35:57.627112+0000","last_undegraded":"2024-09-12T01:35:57.627112+0000","last_fullsized":"2024-09-12T01:35:57.627112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:42.954339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801808+0000","last_change":"2024-09-12T01:35:56.640662+0000","last_active":"2024-09-12T01:35:57.801808+0000","last_peered":"2024-09-12T01:35:57.801808+0000","last_clean":"2024-09-12T01:35:57.801808+0000","last_became_active":"2024-09-12T01:35:56.639928+0000","last_became_peered":"2024-09-12T01:35:56.639928+0000","last_unstale":"2024-09-12T01:35:57.801808+0000","last_undegraded":"2024-09-12T01:35:57.801808+0000","last_fullsized":"2024-09-12T01:35:57.801808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:33.731216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802192+0000","last_change":"2024-09-12T01:35:55.630072+0000","last_active":"2024-09-12T01:35:57.802192+0000","last_peered":"2024-09-12T01:35:57.802192+0000","last_clean":"2024-09-12T01:35:57.802192+0000","last_became_active":"2024-09-12T01:35:55.629790+0000","last_became_peered":"2024-09-12T01:35:55.629790+0000","last_unstale":"2024-09-12T01:35:57.802192+0000","last_undegraded":"2024-09-12T01:35:57.802192+0000","last_fullsized":"2024-09-12T01:35:57.802192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:20.127450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630665+0000","last_change":"2024-09-12T01:35:56.638343+0000","last_active":"2024-09-12T01:35:57.630665+0000","last_peered":"2024-09-12T01:35:57.630665+0000","last_clean":"2024-09-12T01:35:57.630665+0000","last_became_active":"2024-09-12T01:35:56.638013+0000","last_became_peered":"2024-09-12T01:35:56.638013+0000","last_unstale":"2024-09-12T01:35:57.630665+0000","last_undegraded":"2024-09-12T01:35:57.630665+0000","last_fullsized":"2024-09-12T01:35:57.630665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:11.512801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627422+0000","last_change":"2024-09-12T01:35:55.639076+0000","last_active":"2024-09-12T01:35:57.627422+0000","last_peered":"2024-09-12T01:35:57.627422+0000","last_clean":"2024-09-12T01:35:57.627422+0000","last_became_active":"2024-09-12T01:35:55.638798+0000","last_became_peered":"2024-09-12T01:35:55.638798+0000","last_unstale":"2024-09-12T01:35:57.627422+0000","last_undegraded":"2024-09-12T01:35:57.627422+0000","last_fullsized":"2024-09-12T01:35:57.627422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:27.889754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641933+0000","last_change":"2024-09-12T01:35:56.652542+0000","last_active":"2024-09-12T01:35:57.641933+0000","last_peered":"2024-09-12T01:35:57.641933+0000","last_clean":"2024-09-12T01:35:57.641933+0000","last_became_active":"2024-09-12T01:35:56.652248+0000","last_became_peered":"2024-09-12T01:35:56.652248+0000","last_unstale":"2024-09-12T01:35:57.641933+0000","last_undegraded":"2024-09-12T01:35:57.641933+0000","last_fullsized":"2024-09-12T01:35:57.641933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:11.512801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630573+0000","last_change":"2024-09-12T01:35:55.632520+0000","last_active":"2024-09-12T01:35:57.630573+0000","last_peered":"2024-09-12T01:35:57.630573+0000","last_clean":"2024-09-12T01:35:57.630573+0000","last_became_active":"2024-09-12T01:35:55.632252+0000","last_became_peered":"2024-09-12T01:35:55.632252+0000","last_unstale":"2024-09-12T01:35:57.630573+0000","last_undegraded":"2024-09-12T01:35:57.630573+0000","last_fullsized":"2024-09-12T01:35:57.630573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:20.127450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801605+0000","last_change":"2024-09-12T01:35:56.641368+0000","last_active":"2024-09-12T01:35:57.801605+0000","last_peered":"2024-09-12T01:35:57.801605+0000","last_clean":"2024-09-12T01:35:57.801605+0000","last_became_active":"2024-09-12T01:35:56.641015+0000","last_became_peered":"2024-09-12T01:35:56.641015+0000","last_unstale":"2024-09-12T01:35:57.801605+0000","last_undegraded":"2024-09-12T01:35:57.801605+0000","last_fullsized":"2024-09-12T01:35:57.801605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:19.084585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627467+0000","last_change":"2024-09-12T01:35:55.636659+0000","last_active":"2024-09-12T01:35:57.627467+0000","last_peered":"2024-09-12T01:35:57.627467+0000","last_clean":"2024-09-12T01:35:57.627467+0000","last_became_active":"2024-09-12T01:35:55.635695+0000","last_became_peered":"2024-09-12T01:35:55.635695+0000","last_unstale":"2024-09-12T01:35:57.627467+0000","last_undegraded":"2024-09-12T01:35:57.627467+0000","last_fullsized":"2024-09-12T01:35:57.627467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:21.079552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801992+0000","last_change":"2024-09-12T01:35:56.647287+0000","last_active":"2024-09-12T01:35:57.801992+0000","last_peered":"2024-09-12T01:35:57.801992+0000","last_clean":"2024-09-12T01:35:57.801992+0000","last_became_active":"2024-09-12T01:35:56.646952+0000","last_became_peered":"2024-09-12T01:35:56.646952+0000","last_unstale":"2024-09-12T01:35:57.801992+0000","last_undegraded":"2024-09-12T01:35:57.801992+0000","last_fullsized":"2024-09-12T01:35:57.801992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:22.084315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641362+0000","last_change":"2024-09-12T01:35:55.636276+0000","last_active":"2024-09-12T01:35:57.641362+0000","last_peered":"2024-09-12T01:35:57.641362+0000","last_clean":"2024-09-12T01:35:57.641362+0000","last_became_active":"2024-09-12T01:35:55.635996+0000","last_became_peered":"2024-09-12T01:35:55.635996+0000","last_unstale":"2024-09-12T01:35:57.641362+0000","last_undegraded":"2024-09-12T01:35:57.641362+0000","last_fullsized":"2024-09-12T01:35:57.641362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:44.922761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631351+0000","last_change":"2024-09-12T01:35:56.641708+0000","last_active":"2024-09-12T01:35:57.631351+0000","last_peered":"2024-09-12T01:35:57.631351+0000","last_clean":"2024-09-12T01:35:57.631351+0000","last_became_active":"2024-09-12T01:35:56.641436+0000","last_became_peered":"2024-09-12T01:35:56.641436+0000","last_unstale":"2024-09-12T01:35:57.631351+0000","last_undegraded":"2024-09-12T01:35:57.631351+0000","last_fullsized":"2024-09-12T01:35:57.631351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:30.517423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627608+0000","last_change":"2024-09-12T01:35:55.638372+0000","last_active":"2024-09-12T01:35:57.627608+0000","last_peered":"2024-09-12T01:35:57.627608+0000","last_clean":"2024-09-12T01:35:57.627608+0000","last_became_active":"2024-09-12T01:35:55.638089+0000","last_became_peered":"2024-09-12T01:35:55.638089+0000","last_unstale":"2024-09-12T01:35:57.627608+0000","last_undegraded":"2024-09-12T01:35:57.627608+0000","last_fullsized":"2024-09-12T01:35:57.627608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:14.768892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630498+0000","last_change":"2024-09-12T01:35:56.638352+0000","last_active":"2024-09-12T01:35:57.630498+0000","last_peered":"2024-09-12T01:35:57.630498+0000","last_clean":"2024-09-12T01:35:57.630498+0000","last_became_active":"2024-09-12T01:35:56.637106+0000","last_became_peered":"2024-09-12T01:35:56.637106+0000","last_unstale":"2024-09-12T01:35:57.630498+0000","last_undegraded":"2024-09-12T01:35:57.630498+0000","last_fullsized":"2024-09-12T01:35:57.630498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:04.733539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641681+0000","last_change":"2024-09-12T01:35:55.630390+0000","last_active":"2024-09-12T01:35:57.641681+0000","last_peered":"2024-09-12T01:35:57.641681+0000","last_clean":"2024-09-12T01:35:57.641681+0000","last_became_active":"2024-09-12T01:35:55.630086+0000","last_became_peered":"2024-09-12T01:35:55.630086+0000","last_unstale":"2024-09-12T01:35:57.641681+0000","last_undegraded":"2024-09-12T01:35:57.641681+0000","last_fullsized":"2024-09-12T01:35:57.641681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:20.004524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627068+0000","last_change":"2024-09-12T01:35:56.643851+0000","last_active":"2024-09-12T01:35:57.627068+0000","last_peered":"2024-09-12T01:35:57.627068+0000","last_clean":"2024-09-12T01:35:57.627068+0000","last_became_active":"2024-09-12T01:35:56.643495+0000","last_became_peered":"2024-09-12T01:35:56.643495+0000","last_unstale":"2024-09-12T01:35:57.627068+0000","last_undegraded":"2024-09-12T01:35:57.627068+0000","last_fullsized":"2024-09-12T01:35:57.627068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:23.892900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631240+0000","last_change":"2024-09-12T01:35:55.635445+0000","last_active":"2024-09-12T01:35:57.631240+0000","last_peered":"2024-09-12T01:35:57.631240+0000","last_clean":"2024-09-12T01:35:57.631240+0000","last_became_active":"2024-09-12T01:35:55.635147+0000","last_became_peered":"2024-09-12T01:35:55.635147+0000","last_unstale":"2024-09-12T01:35:57.631240+0000","last_undegraded":"2024-09-12T01:35:57.631240+0000","last_fullsized":"2024-09-12T01:35:57.631240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:26.672278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630175+0000","last_change":"2024-09-12T01:35:56.638375+0000","last_active":"2024-09-12T01:35:57.630175+0000","last_peered":"2024-09-12T01:35:57.630175+0000","last_clean":"2024-09-12T01:35:57.630175+0000","last_became_active":"2024-09-12T01:35:56.637081+0000","last_became_peered":"2024-09-12T01:35:56.637081+0000","last_unstale":"2024-09-12T01:35:57.630175+0000","last_undegraded":"2024-09-12T01:35:57.630175+0000","last_fullsized":"2024-09-12T01:35:57.630175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:53.842225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802281+0000","last_change":"2024-09-12T01:35:55.631801+0000","last_active":"2024-09-12T01:35:57.802281+0000","last_peered":"2024-09-12T01:35:57.802281+0000","last_clean":"2024-09-12T01:35:57.802281+0000","last_became_active":"2024-09-12T01:35:55.631442+0000","last_became_peered":"2024-09-12T01:35:55.631442+0000","last_unstale":"2024-09-12T01:35:57.802281+0000","last_undegraded":"2024-09-12T01:35:57.802281+0000","last_fullsized":"2024-09-12T01:35:57.802281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:20.127450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802203+0000","last_change":"2024-09-12T01:35:56.643729+0000","last_active":"2024-09-12T01:35:57.802203+0000","last_peered":"2024-09-12T01:35:57.802203+0000","last_clean":"2024-09-12T01:35:57.802203+0000","last_became_active":"2024-09-12T01:35:56.643320+0000","last_became_peered":"2024-09-12T01:35:56.643320+0000","last_unstale":"2024-09-12T01:35:57.802203+0000","last_undegraded":"2024-09-12T01:35:57.802203+0000","last_fullsized":"2024-09-12T01:35:57.802203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:43.447041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627174+0000","last_change":"2024-09-12T01:35:55.630866+0000","last_active":"2024-09-12T01:35:57.627174+0000","last_peered":"2024-09-12T01:35:57.627174+0000","last_clean":"2024-09-12T01:35:57.627174+0000","last_became_active":"2024-09-12T01:35:55.630519+0000","last_became_peered":"2024-09-12T01:35:55.630519+0000","last_unstale":"2024-09-12T01:35:57.627174+0000","last_undegraded":"2024-09-12T01:35:57.627174+0000","last_fullsized":"2024-09-12T01:35:57.627174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:34.433183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627480+0000","last_change":"2024-09-12T01:35:56.639972+0000","last_active":"2024-09-12T01:35:57.627480+0000","last_peered":"2024-09-12T01:35:57.627480+0000","last_clean":"2024-09-12T01:35:57.627480+0000","last_became_active":"2024-09-12T01:35:56.639672+0000","last_became_peered":"2024-09-12T01:35:56.639672+0000","last_unstale":"2024-09-12T01:35:57.627480+0000","last_undegraded":"2024-09-12T01:35:57.627480+0000","last_fullsized":"2024-09-12T01:35:57.627480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:26.684231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627193+0000","last_change":"2024-09-12T01:35:56.656222+0000","last_active":"2024-09-12T01:35:57.627193+0000","last_peered":"2024-09-12T01:35:57.627193+0000","last_clean":"2024-09-12T01:35:57.627193+0000","last_became_active":"2024-09-12T01:35:56.655900+0000","last_became_peered":"2024-09-12T01:35:56.655900+0000","last_unstale":"2024-09-12T01:35:57.627193+0000","last_undegraded":"2024-09-12T01:35:57.627193+0000","last_fullsized":"2024-09-12T01:35:57.627193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:56.033431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642181+0000","last_change":"2024-09-12T01:35:55.638839+0000","last_active":"2024-09-12T01:35:57.642181+0000","last_peered":"2024-09-12T01:35:57.642181+0000","last_clean":"2024-09-12T01:35:57.642181+0000","last_became_active":"2024-09-12T01:35:55.638568+0000","last_became_peered":"2024-09-12T01:35:55.638568+0000","last_unstale":"2024-09-12T01:35:57.642181+0000","last_undegraded":"2024-09-12T01:35:57.642181+0000","last_fullsized":"2024-09-12T01:35:57.642181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:42.442278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802279+0000","last_change":"2024-09-12T01:35:56.659616+0000","last_active":"2024-09-12T01:35:57.802279+0000","last_peered":"2024-09-12T01:35:57.802279+0000","last_clean":"2024-09-12T01:35:57.802279+0000","last_became_active":"2024-09-12T01:35:56.659256+0000","last_became_peered":"2024-09-12T01:35:56.659256+0000","last_unstale":"2024-09-12T01:35:57.802279+0000","last_undegraded":"2024-09-12T01:35:57.802279+0000","last_fullsized":"2024-09-12T01:35:57.802279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:07.092256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642158+0000","last_change":"2024-09-12T01:35:55.637256+0000","last_active":"2024-09-12T01:35:57.642158+0000","last_peered":"2024-09-12T01:35:57.642158+0000","last_clean":"2024-09-12T01:35:57.642158+0000","last_became_active":"2024-09-12T01:35:55.636691+0000","last_became_peered":"2024-09-12T01:35:55.636691+0000","last_unstale":"2024-09-12T01:35:57.642158+0000","last_undegraded":"2024-09-12T01:35:57.642158+0000","last_fullsized":"2024-09-12T01:35:57.642158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:09.561090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631268+0000","last_change":"2024-09-12T01:35:56.647464+0000","last_active":"2024-09-12T01:35:57.631268+0000","last_peered":"2024-09-12T01:35:57.631268+0000","last_clean":"2024-09-12T01:35:57.631268+0000","last_became_active":"2024-09-12T01:35:56.647164+0000","last_became_peered":"2024-09-12T01:35:56.647164+0000","last_unstale":"2024-09-12T01:35:57.631268+0000","last_undegraded":"2024-09-12T01:35:57.631268+0000","last_fullsized":"2024-09-12T01:35:57.631268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.371469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631248+0000","last_change":"2024-09-12T01:35:55.629578+0000","last_active":"2024-09-12T01:35:57.631248+0000","last_peered":"2024-09-12T01:35:57.631248+0000","last_clean":"2024-09-12T01:35:57.631248+0000","last_became_active":"2024-09-12T01:35:55.629296+0000","last_became_peered":"2024-09-12T01:35:55.629296+0000","last_unstale":"2024-09-12T01:35:57.631248+0000","last_undegraded":"2024-09-12T01:35:57.631248+0000","last_fullsized":"2024-09-12T01:35:57.631248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:20.004524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631264+0000","last_change":"2024-09-12T01:35:56.632127+0000","last_active":"2024-09-12T01:35:57.631264+0000","last_peered":"2024-09-12T01:35:57.631264+0000","last_clean":"2024-09-12T01:35:57.631264+0000","last_became_active":"2024-09-12T01:35:56.631788+0000","last_became_peered":"2024-09-12T01:35:56.631788+0000","last_unstale":"2024-09-12T01:35:57.631264+0000","last_undegraded":"2024-09-12T01:35:57.631264+0000","last_fullsized":"2024-09-12T01:35:57.631264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:10.654187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631417+0000","last_change":"2024-09-12T01:35:55.632404+0000","last_active":"2024-09-12T01:35:57.631417+0000","last_peered":"2024-09-12T01:35:57.631417+0000","last_clean":"2024-09-12T01:35:57.631417+0000","last_became_active":"2024-09-12T01:35:55.631711+0000","last_became_peered":"2024-09-12T01:35:55.631711+0000","last_unstale":"2024-09-12T01:35:57.631417+0000","last_undegraded":"2024-09-12T01:35:57.631417+0000","last_fullsized":"2024-09-12T01:35:57.631417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:51.791206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:36:08.522 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:36:08.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.661+0000 7f09e150a640 1 Processor -- start 2024-09-12T01:36:08.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.661+0000 7f09e150a640 1 -- start start 2024-09-12T01:36:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.662+0000 7f09e150a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f09dc15e7a0 0x7f09dc0ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.662+0000 7f09e150a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09dc0d4430 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.662+0000 7f09e150a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09dc0d2f40 con 0x7f09dc0d3fe0 2024-09-12T01:36:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.662+0000 7f09e150a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f09dc0d3220 con 0x7f09dc15e7a0 2024-09-12T01:36:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.662+0000 7f09db7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f09dc0cf2f0 0x7f09dc0b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50200/0 (socket says 172.21.15.60:50200) 2024-09-12T01:36:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.662+0000 7f09db7fe640 1 -- 172.21.15.60:0/1781478495 learned_addr learned my addr 172.21.15.60:0/1781478495 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.662+0000 7f09daffd640 1 --2- 172.21.15.60:0/1781478495 >> v2:172.21.15.105:3300/0 conn(0x7f09dc15e7a0 0x7f09dc0ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.662+0000 7f09d9ffb640 1 -- 172.21.15.60:0/1781478495 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 279196659 0 0) 0x7f09dc0d4430 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.662+0000 7f09d9ffb640 1 -- 172.21.15.60:0/1781478495 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09c4003520 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.662+0000 7f09d9ffb640 1 -- 172.21.15.60:0/1781478495 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931846323 0 0) 0x7f09dc0d2f40 con 0x7f09dc0d3fe0 2024-09-12T01:36:08.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.663+0000 7f09d9ffb640 1 -- 172.21.15.60:0/1781478495 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09dc0d4430 con 0x7f09dc0d3fe0 2024-09-12T01:36:08.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.663+0000 7f09daffd640 1 -- 172.21.15.60:0/1781478495 >> v1:172.21.15.105:6789/0 conn(0x7f09dc0d3fe0 legacy=0x7f09dc0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.663+0000 7f09daffd640 1 -- 172.21.15.60:0/1781478495 >> v1:172.21.15.60:6789/0 conn(0x7f09dc0cf2f0 legacy=0x7f09dc0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.663+0000 7f09daffd640 1 -- 172.21.15.60:0/1781478495 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc0d3500 con 0x7f09dc15e7a0 2024-09-12T01:36:08.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.663+0000 7f09daffd640 1 --2- 172.21.15.60:0/1781478495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09dc15e7a0 0x7f09dc0ba240 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0097a0 tx=0x7f09cc02a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0f46b0979703412 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:08.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.664+0000 7f09d9ffb640 1 -- 172.21.15.60:0/1781478495 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc037070 con 0x7f09dc15e7a0 2024-09-12T01:36:08.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.664+0000 7f09d9ffb640 1 -- 172.21.15.60:0/1781478495 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc032640 con 0x7f09dc15e7a0 2024-09-12T01:36:08.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.664+0000 7f09d9ffb640 1 -- 172.21.15.60:0/1781478495 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0329f0 con 0x7f09dc15e7a0 2024-09-12T01:36:08.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.664+0000 7f09e150a640 1 -- 172.21.15.60:0/1781478495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09dc15e7a0 msgr2=0x7f09dc0ba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.664+0000 7f09e150a640 1 --2- 172.21.15.60:0/1781478495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09dc15e7a0 0x7f09dc0ba240 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0097a0 tx=0x7f09cc02a2c0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.664+0000 7f09e150a640 1 -- 172.21.15.60:0/1781478495 shutdown_connections 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.664+0000 7f09e150a640 1 --2- 172.21.15.60:0/1781478495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09dc15e7a0 0x7f09dc0ba240 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.664+0000 7f09e150a640 1 -- 172.21.15.60:0/1781478495 >> 172.21.15.60:0/1781478495 conn(0x7f09dc0d1550 msgr2=0x7f09dc0d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.664+0000 7f09e150a640 1 -- 172.21.15.60:0/1781478495 shutdown_connections 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.664+0000 7f09e150a640 1 -- 172.21.15.60:0/1781478495 wait complete. 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.665+0000 7f09e150a640 1 Processor -- start 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.666+0000 7f09e150a640 1 -- start start 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.666+0000 7f09e150a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09dc0cf2f0 0x7f09dc0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.666+0000 7f09e150a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09dc0d3fe0 0x7f09dc1f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.666+0000 7f09e150a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09dc15e7a0 0x7f09dc15a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.666+0000 7f09e150a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc15eb80 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.666+0000 7f09e150a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc0d3ac0 con 0x7f09dc15e7a0 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.666+0000 7f09e150a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f09dc15ed00 con 0x7f09dc0d3fe0 2024-09-12T01:36:08.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.666+0000 7f09daffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09dc0cf2f0 0x7f09dc0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.666+0000 7f09daffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09dc0cf2f0 0x7f09dc0cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49408/0 (socket says 172.21.15.60:49408) 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.666+0000 7f09daffd640 1 -- 172.21.15.60:0/641733310 learned_addr learned my addr 172.21.15.60:0/641733310 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09db7fe640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09dc15e7a0 0x7f09dc15a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09da7fc640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09dc0d3fe0 0x7f09dc1f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09daffd640 1 -- 172.21.15.60:0/641733310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09dc0d3fe0 msgr2=0x7f09dc1f86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09daffd640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09dc0d3fe0 0x7f09dc1f86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09daffd640 1 -- 172.21.15.60:0/641733310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09dc15e7a0 msgr2=0x7f09dc15a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09daffd640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09dc15e7a0 0x7f09dc15a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09daffd640 1 -- 172.21.15.60:0/641733310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc0cd210 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09daffd640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09dc0cf2f0 0x7f09dc0cbab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f09cc02a300 tx=0x7f09cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09c37fe640 1 -- 172.21.15.60:0/641733310 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc041020 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09c37fe640 1 -- 172.21.15.60:0/641733310 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc0044c0 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09e150a640 1 -- 172.21.15.60:0/641733310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09dc0cc170 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09c37fe640 1 -- 172.21.15.60:0/641733310 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc037040 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.667+0000 7f09e150a640 1 -- 172.21.15.60:0/641733310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09dc0cc730 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.668+0000 7f09e150a640 1 -- 172.21.15.60:0/641733310 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09dc0ba240 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.669+0000 7f09c37fe640 1 -- 172.21.15.60:0/641733310 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f09cc044020 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.669+0000 7f09c37fe640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f09c806be30 0x7f09c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:08.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.669+0000 7f09c37fe640 1 -- 172.21.15.60:0/641733310 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f09cc0ab600 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.669+0000 7f09da7fc640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f09c806be30 0x7f09c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:08.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.670+0000 7f09da7fc640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f09c806be30 0x7f09c806e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f09dc15dfe0 tx=0x7f09d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:08.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.674+0000 7f09c37fe640 1 -- 172.21.15.60:0/641733310 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f09cc04b030 con 0x7f09dc0cf2f0 2024-09-12T01:36:08.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.848+0000 7f09e150a640 1 -- 172.21.15.60:0/641733310 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09dc0b5150 con 0x7f09c806be30 2024-09-12T01:36:08.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.854+0000 7f09c37fe640 1 -- 172.21.15.60:0/641733310 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251833 (secure 0 0 0) 0x7f09dc0b5150 con 0x7f09c806be30 2024-09-12T01:36:08.855 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:08.862 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:36:08.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.857+0000 7f09e150a640 1 -- 172.21.15.60:0/641733310 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f09c806be30 msgr2=0x7f09c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.857+0000 7f09e150a640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f09c806be30 0x7f09c806e2f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f09dc15dfe0 tx=0x7f09d0009040 comp rx=0 tx=0).stop 2024-09-12T01:36:08.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.857+0000 7f09e150a640 1 -- 172.21.15.60:0/641733310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09dc0cf2f0 msgr2=0x7f09dc0cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:08.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.857+0000 7f09e150a640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09dc0cf2f0 0x7f09dc0cbab0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f09cc02a300 tx=0x7f09cc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.857+0000 7f09e150a640 1 -- 172.21.15.60:0/641733310 shutdown_connections 2024-09-12T01:36:08.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.857+0000 7f09e150a640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f09dc15e7a0 0x7f09dc15a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.857+0000 7f09e150a640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f09c806be30 0x7f09c806e2f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.857+0000 7f09e150a640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09dc0d3fe0 0x7f09dc1f86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.857+0000 7f09e150a640 1 --2- 172.21.15.60:0/641733310 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f09dc0cf2f0 0x7f09dc0cbab0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:08.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.857+0000 7f09e150a640 1 -- 172.21.15.60:0/641733310 >> 172.21.15.60:0/641733310 conn(0x7f09dc0d1550 msgr2=0x7f09dc0b5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:08.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.857+0000 7f09e150a640 1 -- 172.21.15.60:0/641733310 shutdown_connections 2024-09-12T01:36:08.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:08.857+0000 7f09e150a640 1 -- 172.21.15.60:0/641733310 wait complete. 2024-09-12T01:36:08.868 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-12T01:36:08.262812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235960,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738760,"statfs":{"total":773094113280,"available":772852490240,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.637109"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642326+0000","last_change":"2024-09-12T01:35:56.652538+0000","last_active":"2024-09-12T01:35:57.642326+0000","last_peered":"2024-09-12T01:35:57.642326+0000","last_clean":"2024-09-12T01:35:57.642326+0000","last_became_active":"2024-09-12T01:35:56.649758+0000","last_became_peered":"2024-09-12T01:35:56.649758+0000","last_unstale":"2024-09-12T01:35:57.642326+0000","last_undegraded":"2024-09-12T01:35:57.642326+0000","last_fullsized":"2024-09-12T01:35:57.642326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.371469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631042+0000","last_change":"2024-09-12T01:35:56.645029+0000","last_active":"2024-09-12T01:35:57.631042+0000","last_peered":"2024-09-12T01:35:57.631042+0000","last_clean":"2024-09-12T01:35:57.631042+0000","last_became_active":"2024-09-12T01:35:56.644727+0000","last_became_peered":"2024-09-12T01:35:56.644727+0000","last_unstale":"2024-09-12T01:35:57.631042+0000","last_undegraded":"2024-09-12T01:35:57.631042+0000","last_fullsized":"2024-09-12T01:35:57.631042+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:35.999998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630619+0000","last_change":"2024-09-12T01:35:56.639030+0000","last_active":"2024-09-12T01:35:57.630619+0000","last_peered":"2024-09-12T01:35:57.630619+0000","last_clean":"2024-09-12T01:35:57.630619+0000","last_became_active":"2024-09-12T01:35:56.636574+0000","last_became_peered":"2024-09-12T01:35:56.636574+0000","last_unstale":"2024-09-12T01:35:57.630619+0000","last_undegraded":"2024-09-12T01:35:57.630619+0000","last_fullsized":"2024-09-12T01:35:57.630619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.394879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801812+0000","last_change":"2024-09-12T01:35:56.634505+0000","last_active":"2024-09-12T01:35:57.801812+0000","last_peered":"2024-09-12T01:35:57.801812+0000","last_clean":"2024-09-12T01:35:57.801812+0000","last_became_active":"2024-09-12T01:35:56.630851+0000","last_became_peered":"2024-09-12T01:35:56.630851+0000","last_unstale":"2024-09-12T01:35:57.801812+0000","last_undegraded":"2024-09-12T01:35:57.801812+0000","last_fullsized":"2024-09-12T01:35:57.801812+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:07.092256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642095+0000","last_change":"2024-09-12T01:35:56.656191+0000","last_active":"2024-09-12T01:35:57.642095+0000","last_peered":"2024-09-12T01:35:57.642095+0000","last_clean":"2024-09-12T01:35:57.642095+0000","last_became_active":"2024-09-12T01:35:56.655089+0000","last_became_peered":"2024-09-12T01:35:56.655089+0000","last_unstale":"2024-09-12T01:35:57.642095+0000","last_undegraded":"2024-09-12T01:35:57.642095+0000","last_fullsized":"2024-09-12T01:35:57.642095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:35.999998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801857+0000","last_change":"2024-09-12T01:35:56.637190+0000","last_active":"2024-09-12T01:35:57.801857+0000","last_peered":"2024-09-12T01:35:57.801857+0000","last_clean":"2024-09-12T01:35:57.801857+0000","last_became_active":"2024-09-12T01:35:56.636370+0000","last_became_peered":"2024-09-12T01:35:56.636370+0000","last_unstale":"2024-09-12T01:35:57.801857+0000","last_undegraded":"2024-09-12T01:35:57.801857+0000","last_fullsized":"2024-09-12T01:35:57.801857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:33.731216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641815+0000","last_change":"2024-09-12T01:35:56.645910+0000","last_active":"2024-09-12T01:35:57.641815+0000","last_peered":"2024-09-12T01:35:57.641815+0000","last_clean":"2024-09-12T01:35:57.641815+0000","last_became_active":"2024-09-12T01:35:56.644399+0000","last_became_peered":"2024-09-12T01:35:56.644399+0000","last_unstale":"2024-09-12T01:35:57.641815+0000","last_undegraded":"2024-09-12T01:35:57.641815+0000","last_fullsized":"2024-09-12T01:35:57.641815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:48.394879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630527+0000","last_change":"2024-09-12T01:35:56.645704+0000","last_active":"2024-09-12T01:35:57.630527+0000","last_peered":"2024-09-12T01:35:57.630527+0000","last_clean":"2024-09-12T01:35:57.630527+0000","last_became_active":"2024-09-12T01:35:56.645446+0000","last_became_peered":"2024-09-12T01:35:56.645446+0000","last_unstale":"2024-09-12T01:35:57.630527+0000","last_undegraded":"2024-09-12T01:35:57.630527+0000","last_fullsized":"2024-09-12T01:35:57.630527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:58.408814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802258+0000","last_change":"2024-09-12T01:35:56.640496+0000","last_active":"2024-09-12T01:35:57.802258+0000","last_peered":"2024-09-12T01:35:57.802258+0000","last_clean":"2024-09-12T01:35:57.802258+0000","last_became_active":"2024-09-12T01:35:56.640151+0000","last_became_peered":"2024-09-12T01:35:56.640151+0000","last_unstale":"2024-09-12T01:35:57.802258+0000","last_undegraded":"2024-09-12T01:35:57.802258+0000","last_fullsized":"2024-09-12T01:35:57.802258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:19.084585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642330+0000","last_change":"2024-09-12T01:35:56.646582+0000","last_active":"2024-09-12T01:35:57.642330+0000","last_peered":"2024-09-12T01:35:57.642330+0000","last_clean":"2024-09-12T01:35:57.642330+0000","last_became_active":"2024-09-12T01:35:56.646282+0000","last_became_peered":"2024-09-12T01:35:56.646282+0000","last_unstale":"2024-09-12T01:35:57.642330+0000","last_undegraded":"2024-09-12T01:35:57.642330+0000","last_fullsized":"2024-09-12T01:35:57.642330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:51.888372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642049+0000","last_change":"2024-09-12T01:35:56.647738+0000","last_active":"2024-09-12T01:35:57.642049+0000","last_peered":"2024-09-12T01:35:57.642049+0000","last_clean":"2024-09-12T01:35:57.642049+0000","last_became_active":"2024-09-12T01:35:56.647449+0000","last_became_peered":"2024-09-12T01:35:56.647449+0000","last_unstale":"2024-09-12T01:35:57.642049+0000","last_undegraded":"2024-09-12T01:35:57.642049+0000","last_fullsized":"2024-09-12T01:35:57.642049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:45.869660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642039+0000","last_change":"2024-09-12T01:35:56.656184+0000","last_active":"2024-09-12T01:35:57.642039+0000","last_peered":"2024-09-12T01:35:57.642039+0000","last_clean":"2024-09-12T01:35:57.642039+0000","last_became_active":"2024-09-12T01:35:56.655377+0000","last_became_peered":"2024-09-12T01:35:56.655377+0000","last_unstale":"2024-09-12T01:35:57.642039+0000","last_undegraded":"2024-09-12T01:35:57.642039+0000","last_fullsized":"2024-09-12T01:35:57.642039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.332152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801933+0000","last_change":"2024-09-12T01:35:56.657060+0000","last_active":"2024-09-12T01:35:57.801933+0000","last_peered":"2024-09-12T01:35:57.801933+0000","last_clean":"2024-09-12T01:35:57.801933+0000","last_became_active":"2024-09-12T01:35:56.656754+0000","last_became_peered":"2024-09-12T01:35:56.656754+0000","last_unstale":"2024-09-12T01:35:57.801933+0000","last_undegraded":"2024-09-12T01:35:57.801933+0000","last_fullsized":"2024-09-12T01:35:57.801933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:15.773656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802474+0000","last_change":"2024-09-12T01:35:56.643585+0000","last_active":"2024-09-12T01:35:57.802474+0000","last_peered":"2024-09-12T01:35:57.802474+0000","last_clean":"2024-09-12T01:35:57.802474+0000","last_became_active":"2024-09-12T01:35:56.643312+0000","last_became_peered":"2024-09-12T01:35:56.643312+0000","last_unstale":"2024-09-12T01:35:57.802474+0000","last_undegraded":"2024-09-12T01:35:57.802474+0000","last_fullsized":"2024-09-12T01:35:57.802474+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:17.807421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630738+0000","last_change":"2024-09-12T01:35:56.659070+0000","last_active":"2024-09-12T01:35:57.630738+0000","last_peered":"2024-09-12T01:35:57.630738+0000","last_clean":"2024-09-12T01:35:57.630738+0000","last_became_active":"2024-09-12T01:35:56.658797+0000","last_became_peered":"2024-09-12T01:35:56.658797+0000","last_unstale":"2024-09-12T01:35:57.630738+0000","last_undegraded":"2024-09-12T01:35:57.630738+0000","last_fullsized":"2024-09-12T01:35:57.630738+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.332152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.626923+0000","last_change":"2024-09-12T01:35:56.645396+0000","last_active":"2024-09-12T01:35:57.626923+0000","last_peered":"2024-09-12T01:35:57.626923+0000","last_clean":"2024-09-12T01:35:57.626923+0000","last_became_active":"2024-09-12T01:35:56.645072+0000","last_became_peered":"2024-09-12T01:35:56.645072+0000","last_unstale":"2024-09-12T01:35:57.626923+0000","last_undegraded":"2024-09-12T01:35:57.626923+0000","last_fullsized":"2024-09-12T01:35:57.626923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.371469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627612+0000","last_change":"2024-09-12T01:35:56.660353+0000","last_active":"2024-09-12T01:35:57.627612+0000","last_peered":"2024-09-12T01:35:57.627612+0000","last_clean":"2024-09-12T01:35:57.627612+0000","last_became_active":"2024-09-12T01:35:56.659742+0000","last_became_peered":"2024-09-12T01:35:56.659742+0000","last_unstale":"2024-09-12T01:35:57.627612+0000","last_undegraded":"2024-09-12T01:35:57.627612+0000","last_fullsized":"2024-09-12T01:35:57.627612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:35.865103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802429+0000","last_change":"2024-09-12T01:35:56.645188+0000","last_active":"2024-09-12T01:35:57.802429+0000","last_peered":"2024-09-12T01:35:57.802429+0000","last_clean":"2024-09-12T01:35:57.802429+0000","last_became_active":"2024-09-12T01:35:56.644908+0000","last_became_peered":"2024-09-12T01:35:56.644908+0000","last_unstale":"2024-09-12T01:35:57.802429+0000","last_undegraded":"2024-09-12T01:35:57.802429+0000","last_fullsized":"2024-09-12T01:35:57.802429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:35.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627360+0000","last_change":"2024-09-12T01:35:56.652945+0000","last_active":"2024-09-12T01:35:57.627360+0000","last_peered":"2024-09-12T01:35:57.627360+0000","last_clean":"2024-09-12T01:35:57.627360+0000","last_became_active":"2024-09-12T01:35:56.652621+0000","last_became_peered":"2024-09-12T01:35:56.652621+0000","last_unstale":"2024-09-12T01:35:57.627360+0000","last_undegraded":"2024-09-12T01:35:57.627360+0000","last_fullsized":"2024-09-12T01:35:57.627360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:56.037938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642061+0000","last_change":"2024-09-12T01:35:56.656055+0000","last_active":"2024-09-12T01:35:57.642061+0000","last_peered":"2024-09-12T01:35:57.642061+0000","last_clean":"2024-09-12T01:35:57.642061+0000","last_became_active":"2024-09-12T01:35:56.654905+0000","last_became_peered":"2024-09-12T01:35:56.654905+0000","last_unstale":"2024-09-12T01:35:57.642061+0000","last_undegraded":"2024-09-12T01:35:57.642061+0000","last_fullsized":"2024-09-12T01:35:57.642061+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:21.267324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630212+0000","last_change":"2024-09-12T01:35:56.630997+0000","last_active":"2024-09-12T01:35:57.630212+0000","last_peered":"2024-09-12T01:35:57.630212+0000","last_clean":"2024-09-12T01:35:57.630212+0000","last_became_active":"2024-09-12T01:35:56.630704+0000","last_became_peered":"2024-09-12T01:35:56.630704+0000","last_unstale":"2024-09-12T01:35:57.630212+0000","last_undegraded":"2024-09-12T01:35:57.630212+0000","last_fullsized":"2024-09-12T01:35:57.630212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:33.242417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801745+0000","last_change":"2024-09-12T01:35:56.655607+0000","last_active":"2024-09-12T01:35:57.801745+0000","last_peered":"2024-09-12T01:35:57.801745+0000","last_clean":"2024-09-12T01:35:57.801745+0000","last_became_active":"2024-09-12T01:35:56.655296+0000","last_became_peered":"2024-09-12T01:35:56.655296+0000","last_unstale":"2024-09-12T01:35:57.801745+0000","last_undegraded":"2024-09-12T01:35:57.801745+0000","last_fullsized":"2024-09-12T01:35:57.801745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:43.447041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630934+0000","last_change":"2024-09-12T01:35:56.633081+0000","last_active":"2024-09-12T01:35:57.630934+0000","last_peered":"2024-09-12T01:35:57.630934+0000","last_clean":"2024-09-12T01:35:57.630934+0000","last_became_active":"2024-09-12T01:35:56.632706+0000","last_became_peered":"2024-09-12T01:35:56.632706+0000","last_unstale":"2024-09-12T01:35:57.630934+0000","last_undegraded":"2024-09-12T01:35:57.630934+0000","last_fullsized":"2024-09-12T01:35:57.630934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:21.267324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.626950+0000","last_change":"2024-09-12T01:35:56.647872+0000","last_active":"2024-09-12T01:35:57.626950+0000","last_peered":"2024-09-12T01:35:57.626950+0000","last_clean":"2024-09-12T01:35:57.626950+0000","last_became_active":"2024-09-12T01:35:56.647557+0000","last_became_peered":"2024-09-12T01:35:56.647557+0000","last_unstale":"2024-09-12T01:35:57.626950+0000","last_undegraded":"2024-09-12T01:35:57.626950+0000","last_fullsized":"2024-09-12T01:35:57.626950+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:51.888372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631144+0000","last_change":"2024-09-12T01:35:56.647973+0000","last_active":"2024-09-12T01:35:57.631144+0000","last_peered":"2024-09-12T01:35:57.631144+0000","last_clean":"2024-09-12T01:35:57.631144+0000","last_became_active":"2024-09-12T01:35:56.647548+0000","last_became_peered":"2024-09-12T01:35:56.647548+0000","last_unstale":"2024-09-12T01:35:57.631144+0000","last_undegraded":"2024-09-12T01:35:57.631144+0000","last_fullsized":"2024-09-12T01:35:57.631144+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:14.579275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801953+0000","last_change":"2024-09-12T01:35:56.640025+0000","last_active":"2024-09-12T01:35:57.801953+0000","last_peered":"2024-09-12T01:35:57.801953+0000","last_clean":"2024-09-12T01:35:57.801953+0000","last_became_active":"2024-09-12T01:35:56.639534+0000","last_became_peered":"2024-09-12T01:35:56.639534+0000","last_unstale":"2024-09-12T01:35:57.801953+0000","last_undegraded":"2024-09-12T01:35:57.801953+0000","last_fullsized":"2024-09-12T01:35:57.801953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:28.894518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802022+0000","last_change":"2024-09-12T01:35:56.639831+0000","last_active":"2024-09-12T01:35:57.802022+0000","last_peered":"2024-09-12T01:35:57.802022+0000","last_clean":"2024-09-12T01:35:57.802022+0000","last_became_active":"2024-09-12T01:35:56.639541+0000","last_became_peered":"2024-09-12T01:35:56.639541+0000","last_unstale":"2024-09-12T01:35:57.802022+0000","last_undegraded":"2024-09-12T01:35:57.802022+0000","last_fullsized":"2024-09-12T01:35:57.802022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:27.826729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801870+0000","last_change":"2024-09-12T01:35:56.656888+0000","last_active":"2024-09-12T01:35:57.801870+0000","last_peered":"2024-09-12T01:35:57.801870+0000","last_clean":"2024-09-12T01:35:57.801870+0000","last_became_active":"2024-09-12T01:35:56.656593+0000","last_became_peered":"2024-09-12T01:35:56.656593+0000","last_unstale":"2024-09-12T01:35:57.801870+0000","last_undegraded":"2024-09-12T01:35:57.801870+0000","last_fullsized":"2024-09-12T01:35:57.801870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:28.894518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630352+0000","last_change":"2024-09-12T01:35:56.642012+0000","last_active":"2024-09-12T01:35:57.630352+0000","last_peered":"2024-09-12T01:35:57.630352+0000","last_clean":"2024-09-12T01:35:57.630352+0000","last_became_active":"2024-09-12T01:35:56.639930+0000","last_became_peered":"2024-09-12T01:35:56.639930+0000","last_unstale":"2024-09-12T01:35:57.630352+0000","last_undegraded":"2024-09-12T01:35:57.630352+0000","last_fullsized":"2024-09-12T01:35:57.630352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:43.345557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627036+0000","last_change":"2024-09-12T01:35:56.649019+0000","last_active":"2024-09-12T01:35:57.627036+0000","last_peered":"2024-09-12T01:35:57.627036+0000","last_clean":"2024-09-12T01:35:57.627036+0000","last_became_active":"2024-09-12T01:35:56.648688+0000","last_became_peered":"2024-09-12T01:35:56.648688+0000","last_unstale":"2024-09-12T01:35:57.627036+0000","last_undegraded":"2024-09-12T01:35:57.627036+0000","last_fullsized":"2024-09-12T01:35:57.627036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:30.634946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802089+0000","last_change":"2024-09-12T01:35:56.638917+0000","last_active":"2024-09-12T01:35:57.802089+0000","last_peered":"2024-09-12T01:35:57.802089+0000","last_clean":"2024-09-12T01:35:57.802089+0000","last_became_active":"2024-09-12T01:35:56.638636+0000","last_became_peered":"2024-09-12T01:35:56.638636+0000","last_unstale":"2024-09-12T01:35:57.802089+0000","last_undegraded":"2024-09-12T01:35:57.802089+0000","last_fullsized":"2024-09-12T01:35:57.802089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:43.959102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801561+0000","last_change":"2024-09-12T01:35:56.641065+0000","last_active":"2024-09-12T01:35:57.801561+0000","last_peered":"2024-09-12T01:35:57.801561+0000","last_clean":"2024-09-12T01:35:57.801561+0000","last_became_active":"2024-09-12T01:35:56.640725+0000","last_became_peered":"2024-09-12T01:35:56.640725+0000","last_unstale":"2024-09-12T01:35:57.801561+0000","last_undegraded":"2024-09-12T01:35:57.801561+0000","last_fullsized":"2024-09-12T01:35:57.801561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:35.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802049+0000","last_change":"2024-09-12T01:35:56.648505+0000","last_active":"2024-09-12T01:35:57.802049+0000","last_peered":"2024-09-12T01:35:57.802049+0000","last_clean":"2024-09-12T01:35:57.802049+0000","last_became_active":"2024-09-12T01:35:56.648227+0000","last_became_peered":"2024-09-12T01:35:56.648227+0000","last_unstale":"2024-09-12T01:35:57.802049+0000","last_undegraded":"2024-09-12T01:35:57.802049+0000","last_fullsized":"2024-09-12T01:35:57.802049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:35.437946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630446+0000","last_change":"2024-09-12T01:35:55.632500+0000","last_active":"2024-09-12T01:35:57.630446+0000","last_peered":"2024-09-12T01:35:57.630446+0000","last_clean":"2024-09-12T01:35:57.630446+0000","last_became_active":"2024-09-12T01:35:55.632216+0000","last_became_peered":"2024-09-12T01:35:55.632216+0000","last_unstale":"2024-09-12T01:35:57.630446+0000","last_undegraded":"2024-09-12T01:35:57.630446+0000","last_fullsized":"2024-09-12T01:35:57.630446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:01.774510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630355+0000","last_change":"2024-09-12T01:35:56.650933+0000","last_active":"2024-09-12T01:35:57.630355+0000","last_peered":"2024-09-12T01:35:57.630355+0000","last_clean":"2024-09-12T01:35:57.630355+0000","last_became_active":"2024-09-12T01:35:56.649511+0000","last_became_peered":"2024-09-12T01:35:56.649511+0000","last_unstale":"2024-09-12T01:35:57.630355+0000","last_undegraded":"2024-09-12T01:35:57.630355+0000","last_fullsized":"2024-09-12T01:35:57.630355+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:37.930582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627176+0000","last_change":"2024-09-12T01:35:55.638359+0000","last_active":"2024-09-12T01:35:57.627176+0000","last_peered":"2024-09-12T01:35:57.627176+0000","last_clean":"2024-09-12T01:35:57.627176+0000","last_became_active":"2024-09-12T01:35:55.638062+0000","last_became_peered":"2024-09-12T01:35:55.638062+0000","last_unstale":"2024-09-12T01:35:57.627176+0000","last_undegraded":"2024-09-12T01:35:57.627176+0000","last_fullsized":"2024-09-12T01:35:57.627176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:06.087492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801675+0000","last_change":"2024-09-12T01:35:55.635922+0000","last_active":"2024-09-12T01:35:57.801675+0000","last_peered":"2024-09-12T01:35:57.801675+0000","last_clean":"2024-09-12T01:35:57.801675+0000","last_became_active":"2024-09-12T01:35:55.635602+0000","last_became_peered":"2024-09-12T01:35:55.635602+0000","last_unstale":"2024-09-12T01:35:57.801675+0000","last_undegraded":"2024-09-12T01:35:57.801675+0000","last_fullsized":"2024-09-12T01:35:57.801675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:33.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630802+0000","last_change":"2024-09-12T01:35:56.645491+0000","last_active":"2024-09-12T01:35:57.630802+0000","last_peered":"2024-09-12T01:35:57.630802+0000","last_clean":"2024-09-12T01:35:57.630802+0000","last_became_active":"2024-09-12T01:35:56.645076+0000","last_became_peered":"2024-09-12T01:35:56.645076+0000","last_unstale":"2024-09-12T01:35:57.630802+0000","last_undegraded":"2024-09-12T01:35:57.630802+0000","last_fullsized":"2024-09-12T01:35:57.630802+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:45.869660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627065+0000","last_change":"2024-09-12T01:35:55.633626+0000","last_active":"2024-09-12T01:35:57.627065+0000","last_peered":"2024-09-12T01:35:57.627065+0000","last_clean":"2024-09-12T01:35:57.627065+0000","last_became_active":"2024-09-12T01:35:55.632528+0000","last_became_peered":"2024-09-12T01:35:55.632528+0000","last_unstale":"2024-09-12T01:35:57.627065+0000","last_undegraded":"2024-09-12T01:35:57.627065+0000","last_fullsized":"2024-09-12T01:35:57.627065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:42.442278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630785+0000","last_change":"2024-09-12T01:35:56.639249+0000","last_active":"2024-09-12T01:35:57.630785+0000","last_peered":"2024-09-12T01:35:57.630785+0000","last_clean":"2024-09-12T01:35:57.630785+0000","last_became_active":"2024-09-12T01:35:56.638993+0000","last_became_peered":"2024-09-12T01:35:56.638993+0000","last_unstale":"2024-09-12T01:35:57.630785+0000","last_undegraded":"2024-09-12T01:35:57.630785+0000","last_fullsized":"2024-09-12T01:35:57.630785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:52.928010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802311+0000","last_change":"2024-09-12T01:35:55.632875+0000","last_active":"2024-09-12T01:35:57.802311+0000","last_peered":"2024-09-12T01:35:57.802311+0000","last_clean":"2024-09-12T01:35:57.802311+0000","last_became_active":"2024-09-12T01:35:55.632586+0000","last_became_peered":"2024-09-12T01:35:55.632586+0000","last_unstale":"2024-09-12T01:35:57.802311+0000","last_undegraded":"2024-09-12T01:35:57.802311+0000","last_fullsized":"2024-09-12T01:35:57.802311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:33.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802016+0000","last_change":"2024-09-12T01:35:56.639811+0000","last_active":"2024-09-12T01:35:57.802016+0000","last_peered":"2024-09-12T01:35:57.802016+0000","last_clean":"2024-09-12T01:35:57.802016+0000","last_became_active":"2024-09-12T01:35:56.639110+0000","last_became_peered":"2024-09-12T01:35:56.639110+0000","last_unstale":"2024-09-12T01:35:57.802016+0000","last_undegraded":"2024-09-12T01:35:57.802016+0000","last_fullsized":"2024-09-12T01:35:57.802016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:15.773656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642266+0000","last_change":"2024-09-12T01:35:55.636348+0000","last_active":"2024-09-12T01:35:57.642266+0000","last_peered":"2024-09-12T01:35:57.642266+0000","last_clean":"2024-09-12T01:35:57.642266+0000","last_became_active":"2024-09-12T01:35:55.636057+0000","last_became_peered":"2024-09-12T01:35:55.636057+0000","last_unstale":"2024-09-12T01:35:57.642266+0000","last_undegraded":"2024-09-12T01:35:57.642266+0000","last_fullsized":"2024-09-12T01:35:57.642266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:42.954339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631280+0000","last_change":"2024-09-12T01:35:56.641538+0000","last_active":"2024-09-12T01:35:57.631280+0000","last_peered":"2024-09-12T01:35:57.631280+0000","last_clean":"2024-09-12T01:35:57.631280+0000","last_became_active":"2024-09-12T01:35:56.641220+0000","last_became_peered":"2024-09-12T01:35:56.641220+0000","last_unstale":"2024-09-12T01:35:57.631280+0000","last_undegraded":"2024-09-12T01:35:57.631280+0000","last_fullsized":"2024-09-12T01:35:57.631280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:51.888372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802271+0000","last_change":"2024-09-12T01:35:55.632890+0000","last_active":"2024-09-12T01:35:57.802271+0000","last_peered":"2024-09-12T01:35:57.802271+0000","last_clean":"2024-09-12T01:35:57.802271+0000","last_became_active":"2024-09-12T01:35:55.632588+0000","last_became_peered":"2024-09-12T01:35:55.632588+0000","last_unstale":"2024-09-12T01:35:57.802271+0000","last_undegraded":"2024-09-12T01:35:57.802271+0000","last_fullsized":"2024-09-12T01:35:57.802271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:33.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627170+0000","last_change":"2024-09-12T01:35:56.647269+0000","last_active":"2024-09-12T01:35:57.627170+0000","last_peered":"2024-09-12T01:35:57.627170+0000","last_clean":"2024-09-12T01:35:57.627170+0000","last_became_active":"2024-09-12T01:35:56.646958+0000","last_became_peered":"2024-09-12T01:35:56.646958+0000","last_unstale":"2024-09-12T01:35:57.627170+0000","last_undegraded":"2024-09-12T01:35:57.627170+0000","last_fullsized":"2024-09-12T01:35:57.627170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:15.653414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801903+0000","last_change":"2024-09-12T01:35:55.629925+0000","last_active":"2024-09-12T01:35:57.801903+0000","last_peered":"2024-09-12T01:35:57.801903+0000","last_clean":"2024-09-12T01:35:57.801903+0000","last_became_active":"2024-09-12T01:35:55.629615+0000","last_became_peered":"2024-09-12T01:35:55.629615+0000","last_unstale":"2024-09-12T01:35:57.801903+0000","last_undegraded":"2024-09-12T01:35:57.801903+0000","last_fullsized":"2024-09-12T01:35:57.801903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:52.436733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642153+0000","last_change":"2024-09-12T01:35:56.645643+0000","last_active":"2024-09-12T01:35:57.642153+0000","last_peered":"2024-09-12T01:35:57.642153+0000","last_clean":"2024-09-12T01:35:57.642153+0000","last_became_active":"2024-09-12T01:35:56.644779+0000","last_became_peered":"2024-09-12T01:35:56.644779+0000","last_unstale":"2024-09-12T01:35:57.642153+0000","last_undegraded":"2024-09-12T01:35:57.642153+0000","last_fullsized":"2024-09-12T01:35:57.642153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:14.579275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802154+0000","last_change":"2024-09-12T01:35:55.636452+0000","last_active":"2024-09-12T01:35:57.802154+0000","last_peered":"2024-09-12T01:35:57.802154+0000","last_clean":"2024-09-12T01:35:57.802154+0000","last_became_active":"2024-09-12T01:35:55.636112+0000","last_became_peered":"2024-09-12T01:35:55.636112+0000","last_unstale":"2024-09-12T01:35:57.802154+0000","last_undegraded":"2024-09-12T01:35:57.802154+0000","last_fullsized":"2024-09-12T01:35:57.802154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:01.774510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802166+0000","last_change":"2024-09-12T01:35:56.641707+0000","last_active":"2024-09-12T01:35:57.802166+0000","last_peered":"2024-09-12T01:35:57.802166+0000","last_clean":"2024-09-12T01:35:57.802166+0000","last_became_active":"2024-09-12T01:35:56.641414+0000","last_became_peered":"2024-09-12T01:35:56.641414+0000","last_unstale":"2024-09-12T01:35:57.802166+0000","last_undegraded":"2024-09-12T01:35:57.802166+0000","last_fullsized":"2024-09-12T01:35:57.802166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:33.497449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627317+0000","last_change":"2024-09-12T01:35:55.631399+0000","last_active":"2024-09-12T01:35:57.627317+0000","last_peered":"2024-09-12T01:35:57.627317+0000","last_clean":"2024-09-12T01:35:57.627317+0000","last_became_active":"2024-09-12T01:35:55.631049+0000","last_became_peered":"2024-09-12T01:35:55.631049+0000","last_unstale":"2024-09-12T01:35:57.627317+0000","last_undegraded":"2024-09-12T01:35:57.627317+0000","last_fullsized":"2024-09-12T01:35:57.627317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:32.726452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627114+0000","last_change":"2024-09-12T01:35:56.649037+0000","last_active":"2024-09-12T01:35:57.627114+0000","last_peered":"2024-09-12T01:35:57.627114+0000","last_clean":"2024-09-12T01:35:57.627114+0000","last_became_active":"2024-09-12T01:35:56.648741+0000","last_became_peered":"2024-09-12T01:35:56.648741+0000","last_unstale":"2024-09-12T01:35:57.627114+0000","last_undegraded":"2024-09-12T01:35:57.627114+0000","last_fullsized":"2024-09-12T01:35:57.627114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:38.847972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641868+0000","last_change":"2024-09-12T01:35:55.640137+0000","last_active":"2024-09-12T01:35:57.641868+0000","last_peered":"2024-09-12T01:35:57.641868+0000","last_clean":"2024-09-12T01:35:57.641868+0000","last_became_active":"2024-09-12T01:35:55.639846+0000","last_became_peered":"2024-09-12T01:35:55.639846+0000","last_unstale":"2024-09-12T01:35:57.641868+0000","last_undegraded":"2024-09-12T01:35:57.641868+0000","last_fullsized":"2024-09-12T01:35:57.641868+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:34.990543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801732+0000","last_change":"2024-09-12T01:35:56.649723+0000","last_active":"2024-09-12T01:35:57.801732+0000","last_peered":"2024-09-12T01:35:57.801732+0000","last_clean":"2024-09-12T01:35:57.801732+0000","last_became_active":"2024-09-12T01:35:56.649279+0000","last_became_peered":"2024-09-12T01:35:56.649279+0000","last_unstale":"2024-09-12T01:35:57.801732+0000","last_undegraded":"2024-09-12T01:35:57.801732+0000","last_fullsized":"2024-09-12T01:35:57.801732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:43.959102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630113+0000","last_change":"2024-09-12T01:35:55.633512+0000","last_active":"2024-09-12T01:35:57.630113+0000","last_peered":"2024-09-12T01:35:57.630113+0000","last_clean":"2024-09-12T01:35:57.630113+0000","last_became_active":"2024-09-12T01:35:55.630924+0000","last_became_peered":"2024-09-12T01:35:55.630924+0000","last_unstale":"2024-09-12T01:35:57.630113+0000","last_undegraded":"2024-09-12T01:35:57.630113+0000","last_fullsized":"2024-09-12T01:35:57.630113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:22.281284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.626998+0000","last_change":"2024-09-12T01:35:56.645807+0000","last_active":"2024-09-12T01:35:57.626998+0000","last_peered":"2024-09-12T01:35:57.626998+0000","last_clean":"2024-09-12T01:35:57.626998+0000","last_became_active":"2024-09-12T01:35:56.644972+0000","last_became_peered":"2024-09-12T01:35:56.644972+0000","last_unstale":"2024-09-12T01:35:57.626998+0000","last_undegraded":"2024-09-12T01:35:57.626998+0000","last_fullsized":"2024-09-12T01:35:57.626998+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:08.484922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642433+0000","last_change":"2024-09-12T01:35:55.641623+0000","last_active":"2024-09-12T01:35:57.642433+0000","last_peered":"2024-09-12T01:35:57.642433+0000","last_clean":"2024-09-12T01:35:57.642433+0000","last_became_active":"2024-09-12T01:35:55.641317+0000","last_became_peered":"2024-09-12T01:35:55.641317+0000","last_unstale":"2024-09-12T01:35:57.642433+0000","last_undegraded":"2024-09-12T01:35:57.642433+0000","last_fullsized":"2024-09-12T01:35:57.642433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:34.433183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802092+0000","last_change":"2024-09-12T01:35:56.647599+0000","last_active":"2024-09-12T01:35:57.802092+0000","last_peered":"2024-09-12T01:35:57.802092+0000","last_clean":"2024-09-12T01:35:57.802092+0000","last_became_active":"2024-09-12T01:35:56.646578+0000","last_became_peered":"2024-09-12T01:35:56.646578+0000","last_unstale":"2024-09-12T01:35:57.802092+0000","last_undegraded":"2024-09-12T01:35:57.802092+0000","last_fullsized":"2024-09-12T01:35:57.802092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:22.084315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630591+0000","last_change":"2024-09-12T01:35:55.632582+0000","last_active":"2024-09-12T01:35:57.630591+0000","last_peered":"2024-09-12T01:35:57.630591+0000","last_clean":"2024-09-12T01:35:57.630591+0000","last_became_active":"2024-09-12T01:35:55.631969+0000","last_became_peered":"2024-09-12T01:35:55.631969+0000","last_unstale":"2024-09-12T01:35:57.630591+0000","last_undegraded":"2024-09-12T01:35:57.630591+0000","last_fullsized":"2024-09-12T01:35:57.630591+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:04.556922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642328+0000","last_change":"2024-09-12T01:35:56.655329+0000","last_active":"2024-09-12T01:35:57.642328+0000","last_peered":"2024-09-12T01:35:57.642328+0000","last_clean":"2024-09-12T01:35:57.642328+0000","last_became_active":"2024-09-12T01:35:56.654876+0000","last_became_peered":"2024-09-12T01:35:56.654876+0000","last_unstale":"2024-09-12T01:35:57.642328+0000","last_undegraded":"2024-09-12T01:35:57.642328+0000","last_fullsized":"2024-09-12T01:35:57.642328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:08.484922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630712+0000","last_change":"2024-09-12T01:35:55.629712+0000","last_active":"2024-09-12T01:35:57.630712+0000","last_peered":"2024-09-12T01:35:57.630712+0000","last_clean":"2024-09-12T01:35:57.630712+0000","last_became_active":"2024-09-12T01:35:55.629457+0000","last_became_peered":"2024-09-12T01:35:55.629457+0000","last_unstale":"2024-09-12T01:35:57.630712+0000","last_undegraded":"2024-09-12T01:35:57.630712+0000","last_fullsized":"2024-09-12T01:35:57.630712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:09.561090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642186+0000","last_change":"2024-09-12T01:35:56.657760+0000","last_active":"2024-09-12T01:35:57.642186+0000","last_peered":"2024-09-12T01:35:57.642186+0000","last_clean":"2024-09-12T01:35:57.642186+0000","last_became_active":"2024-09-12T01:35:56.657481+0000","last_became_peered":"2024-09-12T01:35:56.657481+0000","last_unstale":"2024-09-12T01:35:57.642186+0000","last_undegraded":"2024-09-12T01:35:57.642186+0000","last_fullsized":"2024-09-12T01:35:57.642186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:10.654187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802129+0000","last_change":"2024-09-12T01:35:55.635927+0000","last_active":"2024-09-12T01:35:57.802129+0000","last_peered":"2024-09-12T01:35:57.802129+0000","last_clean":"2024-09-12T01:35:57.802129+0000","last_became_active":"2024-09-12T01:35:55.635603+0000","last_became_peered":"2024-09-12T01:35:55.635603+0000","last_unstale":"2024-09-12T01:35:57.802129+0000","last_undegraded":"2024-09-12T01:35:57.802129+0000","last_fullsized":"2024-09-12T01:35:57.802129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:01.774510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627390+0000","last_change":"2024-09-12T01:35:56.639413+0000","last_active":"2024-09-12T01:35:57.627390+0000","last_peered":"2024-09-12T01:35:57.627390+0000","last_clean":"2024-09-12T01:35:57.627390+0000","last_became_active":"2024-09-12T01:35:56.639131+0000","last_became_peered":"2024-09-12T01:35:56.639131+0000","last_unstale":"2024-09-12T01:35:57.627390+0000","last_undegraded":"2024-09-12T01:35:57.627390+0000","last_fullsized":"2024-09-12T01:35:57.627390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:44.381772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801831+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:35:57.801831+0000","last_peered":"2024-09-12T01:35:57.801831+0000","last_clean":"2024-09-12T01:35:57.801831+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:35:57.801831+0000","last_undegraded":"2024-09-12T01:35:57.801831+0000","last_fullsized":"2024-09-12T01:35:57.801831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627331+0000","last_change":"2024-09-12T01:35:55.631018+0000","last_active":"2024-09-12T01:35:57.627331+0000","last_peered":"2024-09-12T01:35:57.627331+0000","last_clean":"2024-09-12T01:35:57.627331+0000","last_became_active":"2024-09-12T01:35:55.630101+0000","last_became_peered":"2024-09-12T01:35:55.630101+0000","last_unstale":"2024-09-12T01:35:57.627331+0000","last_undegraded":"2024-09-12T01:35:57.627331+0000","last_fullsized":"2024-09-12T01:35:57.627331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:18.079821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630356+0000","last_change":"2024-09-12T01:35:56.631140+0000","last_active":"2024-09-12T01:35:57.630356+0000","last_peered":"2024-09-12T01:35:57.630356+0000","last_clean":"2024-09-12T01:35:57.630356+0000","last_became_active":"2024-09-12T01:35:56.630798+0000","last_became_peered":"2024-09-12T01:35:56.630798+0000","last_unstale":"2024-09-12T01:35:57.630356+0000","last_undegraded":"2024-09-12T01:35:57.630356+0000","last_fullsized":"2024-09-12T01:35:57.630356+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:16.316634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627112+0000","last_change":"2024-09-12T01:35:55.634960+0000","last_active":"2024-09-12T01:35:57.627112+0000","last_peered":"2024-09-12T01:35:57.627112+0000","last_clean":"2024-09-12T01:35:57.627112+0000","last_became_active":"2024-09-12T01:35:55.634555+0000","last_became_peered":"2024-09-12T01:35:55.634555+0000","last_unstale":"2024-09-12T01:35:57.627112+0000","last_undegraded":"2024-09-12T01:35:57.627112+0000","last_fullsized":"2024-09-12T01:35:57.627112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:42.954339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801808+0000","last_change":"2024-09-12T01:35:56.640662+0000","last_active":"2024-09-12T01:35:57.801808+0000","last_peered":"2024-09-12T01:35:57.801808+0000","last_clean":"2024-09-12T01:35:57.801808+0000","last_became_active":"2024-09-12T01:35:56.639928+0000","last_became_peered":"2024-09-12T01:35:56.639928+0000","last_unstale":"2024-09-12T01:35:57.801808+0000","last_undegraded":"2024-09-12T01:35:57.801808+0000","last_fullsized":"2024-09-12T01:35:57.801808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:33.731216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802192+0000","last_change":"2024-09-12T01:35:55.630072+0000","last_active":"2024-09-12T01:35:57.802192+0000","last_peered":"2024-09-12T01:35:57.802192+0000","last_clean":"2024-09-12T01:35:57.802192+0000","last_became_active":"2024-09-12T01:35:55.629790+0000","last_became_peered":"2024-09-12T01:35:55.629790+0000","last_unstale":"2024-09-12T01:35:57.802192+0000","last_undegraded":"2024-09-12T01:35:57.802192+0000","last_fullsized":"2024-09-12T01:35:57.802192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:20.127450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630665+0000","last_change":"2024-09-12T01:35:56.638343+0000","last_active":"2024-09-12T01:35:57.630665+0000","last_peered":"2024-09-12T01:35:57.630665+0000","last_clean":"2024-09-12T01:35:57.630665+0000","last_became_active":"2024-09-12T01:35:56.638013+0000","last_became_peered":"2024-09-12T01:35:56.638013+0000","last_unstale":"2024-09-12T01:35:57.630665+0000","last_undegraded":"2024-09-12T01:35:57.630665+0000","last_fullsized":"2024-09-12T01:35:57.630665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:11.512801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627422+0000","last_change":"2024-09-12T01:35:55.639076+0000","last_active":"2024-09-12T01:35:57.627422+0000","last_peered":"2024-09-12T01:35:57.627422+0000","last_clean":"2024-09-12T01:35:57.627422+0000","last_became_active":"2024-09-12T01:35:55.638798+0000","last_became_peered":"2024-09-12T01:35:55.638798+0000","last_unstale":"2024-09-12T01:35:57.627422+0000","last_undegraded":"2024-09-12T01:35:57.627422+0000","last_fullsized":"2024-09-12T01:35:57.627422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:27.889754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641933+0000","last_change":"2024-09-12T01:35:56.652542+0000","last_active":"2024-09-12T01:35:57.641933+0000","last_peered":"2024-09-12T01:35:57.641933+0000","last_clean":"2024-09-12T01:35:57.641933+0000","last_became_active":"2024-09-12T01:35:56.652248+0000","last_became_peered":"2024-09-12T01:35:56.652248+0000","last_unstale":"2024-09-12T01:35:57.641933+0000","last_undegraded":"2024-09-12T01:35:57.641933+0000","last_fullsized":"2024-09-12T01:35:57.641933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:11.512801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630573+0000","last_change":"2024-09-12T01:35:55.632520+0000","last_active":"2024-09-12T01:35:57.630573+0000","last_peered":"2024-09-12T01:35:57.630573+0000","last_clean":"2024-09-12T01:35:57.630573+0000","last_became_active":"2024-09-12T01:35:55.632252+0000","last_became_peered":"2024-09-12T01:35:55.632252+0000","last_unstale":"2024-09-12T01:35:57.630573+0000","last_undegraded":"2024-09-12T01:35:57.630573+0000","last_fullsized":"2024-09-12T01:35:57.630573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:20.127450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801605+0000","last_change":"2024-09-12T01:35:56.641368+0000","last_active":"2024-09-12T01:35:57.801605+0000","last_peered":"2024-09-12T01:35:57.801605+0000","last_clean":"2024-09-12T01:35:57.801605+0000","last_became_active":"2024-09-12T01:35:56.641015+0000","last_became_peered":"2024-09-12T01:35:56.641015+0000","last_unstale":"2024-09-12T01:35:57.801605+0000","last_undegraded":"2024-09-12T01:35:57.801605+0000","last_fullsized":"2024-09-12T01:35:57.801605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:19.084585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627467+0000","last_change":"2024-09-12T01:35:55.636659+0000","last_active":"2024-09-12T01:35:57.627467+0000","last_peered":"2024-09-12T01:35:57.627467+0000","last_clean":"2024-09-12T01:35:57.627467+0000","last_became_active":"2024-09-12T01:35:55.635695+0000","last_became_peered":"2024-09-12T01:35:55.635695+0000","last_unstale":"2024-09-12T01:35:57.627467+0000","last_undegraded":"2024-09-12T01:35:57.627467+0000","last_fullsized":"2024-09-12T01:35:57.627467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:21.079552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.801992+0000","last_change":"2024-09-12T01:35:56.647287+0000","last_active":"2024-09-12T01:35:57.801992+0000","last_peered":"2024-09-12T01:35:57.801992+0000","last_clean":"2024-09-12T01:35:57.801992+0000","last_became_active":"2024-09-12T01:35:56.646952+0000","last_became_peered":"2024-09-12T01:35:56.646952+0000","last_unstale":"2024-09-12T01:35:57.801992+0000","last_undegraded":"2024-09-12T01:35:57.801992+0000","last_fullsized":"2024-09-12T01:35:57.801992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:22.084315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641362+0000","last_change":"2024-09-12T01:35:55.636276+0000","last_active":"2024-09-12T01:35:57.641362+0000","last_peered":"2024-09-12T01:35:57.641362+0000","last_clean":"2024-09-12T01:35:57.641362+0000","last_became_active":"2024-09-12T01:35:55.635996+0000","last_became_peered":"2024-09-12T01:35:55.635996+0000","last_unstale":"2024-09-12T01:35:57.641362+0000","last_undegraded":"2024-09-12T01:35:57.641362+0000","last_fullsized":"2024-09-12T01:35:57.641362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:44.922761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631351+0000","last_change":"2024-09-12T01:35:56.641708+0000","last_active":"2024-09-12T01:35:57.631351+0000","last_peered":"2024-09-12T01:35:57.631351+0000","last_clean":"2024-09-12T01:35:57.631351+0000","last_became_active":"2024-09-12T01:35:56.641436+0000","last_became_peered":"2024-09-12T01:35:56.641436+0000","last_unstale":"2024-09-12T01:35:57.631351+0000","last_undegraded":"2024-09-12T01:35:57.631351+0000","last_fullsized":"2024-09-12T01:35:57.631351+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:30.517423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627608+0000","last_change":"2024-09-12T01:35:55.638372+0000","last_active":"2024-09-12T01:35:57.627608+0000","last_peered":"2024-09-12T01:35:57.627608+0000","last_clean":"2024-09-12T01:35:57.627608+0000","last_became_active":"2024-09-12T01:35:55.638089+0000","last_became_peered":"2024-09-12T01:35:55.638089+0000","last_unstale":"2024-09-12T01:35:57.627608+0000","last_undegraded":"2024-09-12T01:35:57.627608+0000","last_fullsized":"2024-09-12T01:35:57.627608+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:14.768892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630498+0000","last_change":"2024-09-12T01:35:56.638352+0000","last_active":"2024-09-12T01:35:57.630498+0000","last_peered":"2024-09-12T01:35:57.630498+0000","last_clean":"2024-09-12T01:35:57.630498+0000","last_became_active":"2024-09-12T01:35:56.637106+0000","last_became_peered":"2024-09-12T01:35:56.637106+0000","last_unstale":"2024-09-12T01:35:57.630498+0000","last_undegraded":"2024-09-12T01:35:57.630498+0000","last_fullsized":"2024-09-12T01:35:57.630498+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:04.733539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.641681+0000","last_change":"2024-09-12T01:35:55.630390+0000","last_active":"2024-09-12T01:35:57.641681+0000","last_peered":"2024-09-12T01:35:57.641681+0000","last_clean":"2024-09-12T01:35:57.641681+0000","last_became_active":"2024-09-12T01:35:55.630086+0000","last_became_peered":"2024-09-12T01:35:55.630086+0000","last_unstale":"2024-09-12T01:35:57.641681+0000","last_undegraded":"2024-09-12T01:35:57.641681+0000","last_fullsized":"2024-09-12T01:35:57.641681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:20.004524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627068+0000","last_change":"2024-09-12T01:35:56.643851+0000","last_active":"2024-09-12T01:35:57.627068+0000","last_peered":"2024-09-12T01:35:57.627068+0000","last_clean":"2024-09-12T01:35:57.627068+0000","last_became_active":"2024-09-12T01:35:56.643495+0000","last_became_peered":"2024-09-12T01:35:56.643495+0000","last_unstale":"2024-09-12T01:35:57.627068+0000","last_undegraded":"2024-09-12T01:35:57.627068+0000","last_fullsized":"2024-09-12T01:35:57.627068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:23.892900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631240+0000","last_change":"2024-09-12T01:35:55.635445+0000","last_active":"2024-09-12T01:35:57.631240+0000","last_peered":"2024-09-12T01:35:57.631240+0000","last_clean":"2024-09-12T01:35:57.631240+0000","last_became_active":"2024-09-12T01:35:55.635147+0000","last_became_peered":"2024-09-12T01:35:55.635147+0000","last_unstale":"2024-09-12T01:35:57.631240+0000","last_undegraded":"2024-09-12T01:35:57.631240+0000","last_fullsized":"2024-09-12T01:35:57.631240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:26.672278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.630175+0000","last_change":"2024-09-12T01:35:56.638375+0000","last_active":"2024-09-12T01:35:57.630175+0000","last_peered":"2024-09-12T01:35:57.630175+0000","last_clean":"2024-09-12T01:35:57.630175+0000","last_became_active":"2024-09-12T01:35:56.637081+0000","last_became_peered":"2024-09-12T01:35:56.637081+0000","last_unstale":"2024-09-12T01:35:57.630175+0000","last_undegraded":"2024-09-12T01:35:57.630175+0000","last_fullsized":"2024-09-12T01:35:57.630175+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:53.842225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802281+0000","last_change":"2024-09-12T01:35:55.631801+0000","last_active":"2024-09-12T01:35:57.802281+0000","last_peered":"2024-09-12T01:35:57.802281+0000","last_clean":"2024-09-12T01:35:57.802281+0000","last_became_active":"2024-09-12T01:35:55.631442+0000","last_became_peered":"2024-09-12T01:35:55.631442+0000","last_unstale":"2024-09-12T01:35:57.802281+0000","last_undegraded":"2024-09-12T01:35:57.802281+0000","last_fullsized":"2024-09-12T01:35:57.802281+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:20.127450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802203+0000","last_change":"2024-09-12T01:35:56.643729+0000","last_active":"2024-09-12T01:35:57.802203+0000","last_peered":"2024-09-12T01:35:57.802203+0000","last_clean":"2024-09-12T01:35:57.802203+0000","last_became_active":"2024-09-12T01:35:56.643320+0000","last_became_peered":"2024-09-12T01:35:56.643320+0000","last_unstale":"2024-09-12T01:35:57.802203+0000","last_undegraded":"2024-09-12T01:35:57.802203+0000","last_fullsized":"2024-09-12T01:35:57.802203+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:43.447041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627174+0000","last_change":"2024-09-12T01:35:55.630866+0000","last_active":"2024-09-12T01:35:57.627174+0000","last_peered":"2024-09-12T01:35:57.627174+0000","last_clean":"2024-09-12T01:35:57.627174+0000","last_became_active":"2024-09-12T01:35:55.630519+0000","last_became_peered":"2024-09-12T01:35:55.630519+0000","last_unstale":"2024-09-12T01:35:57.627174+0000","last_undegraded":"2024-09-12T01:35:57.627174+0000","last_fullsized":"2024-09-12T01:35:57.627174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:34.433183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627480+0000","last_change":"2024-09-12T01:35:56.639972+0000","last_active":"2024-09-12T01:35:57.627480+0000","last_peered":"2024-09-12T01:35:57.627480+0000","last_clean":"2024-09-12T01:35:57.627480+0000","last_became_active":"2024-09-12T01:35:56.639672+0000","last_became_peered":"2024-09-12T01:35:56.639672+0000","last_unstale":"2024-09-12T01:35:57.627480+0000","last_undegraded":"2024-09-12T01:35:57.627480+0000","last_fullsized":"2024-09-12T01:35:57.627480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:26.684231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.627193+0000","last_change":"2024-09-12T01:35:56.656222+0000","last_active":"2024-09-12T01:35:57.627193+0000","last_peered":"2024-09-12T01:35:57.627193+0000","last_clean":"2024-09-12T01:35:57.627193+0000","last_became_active":"2024-09-12T01:35:56.655900+0000","last_became_peered":"2024-09-12T01:35:56.655900+0000","last_unstale":"2024-09-12T01:35:57.627193+0000","last_undegraded":"2024-09-12T01:35:57.627193+0000","last_fullsized":"2024-09-12T01:35:57.627193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:56.033431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642181+0000","last_change":"2024-09-12T01:35:55.638839+0000","last_active":"2024-09-12T01:35:57.642181+0000","last_peered":"2024-09-12T01:35:57.642181+0000","last_clean":"2024-09-12T01:35:57.642181+0000","last_became_active":"2024-09-12T01:35:55.638568+0000","last_became_peered":"2024-09-12T01:35:55.638568+0000","last_unstale":"2024-09-12T01:35:57.642181+0000","last_undegraded":"2024-09-12T01:35:57.642181+0000","last_fullsized":"2024-09-12T01:35:57.642181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:42.442278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.802279+0000","last_change":"2024-09-12T01:35:56.659616+0000","last_active":"2024-09-12T01:35:57.802279+0000","last_peered":"2024-09-12T01:35:57.802279+0000","last_clean":"2024-09-12T01:35:57.802279+0000","last_became_active":"2024-09-12T01:35:56.659256+0000","last_became_peered":"2024-09-12T01:35:56.659256+0000","last_unstale":"2024-09-12T01:35:57.802279+0000","last_undegraded":"2024-09-12T01:35:57.802279+0000","last_fullsized":"2024-09-12T01:35:57.802279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:07.092256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.642158+0000","last_change":"2024-09-12T01:35:55.637256+0000","last_active":"2024-09-12T01:35:57.642158+0000","last_peered":"2024-09-12T01:35:57.642158+0000","last_clean":"2024-09-12T01:35:57.642158+0000","last_became_active":"2024-09-12T01:35:55.636691+0000","last_became_peered":"2024-09-12T01:35:55.636691+0000","last_unstale":"2024-09-12T01:35:57.642158+0000","last_undegraded":"2024-09-12T01:35:57.642158+0000","last_fullsized":"2024-09-12T01:35:57.642158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:09.561090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631268+0000","last_change":"2024-09-12T01:35:56.647464+0000","last_active":"2024-09-12T01:35:57.631268+0000","last_peered":"2024-09-12T01:35:57.631268+0000","last_clean":"2024-09-12T01:35:57.631268+0000","last_became_active":"2024-09-12T01:35:56.647164+0000","last_became_peered":"2024-09-12T01:35:56.647164+0000","last_unstale":"2024-09-12T01:35:57.631268+0000","last_undegraded":"2024-09-12T01:35:57.631268+0000","last_fullsized":"2024-09-12T01:35:57.631268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:58.371469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631248+0000","last_change":"2024-09-12T01:35:55.629578+0000","last_active":"2024-09-12T01:35:57.631248+0000","last_peered":"2024-09-12T01:35:57.631248+0000","last_clean":"2024-09-12T01:35:57.631248+0000","last_became_active":"2024-09-12T01:35:55.629296+0000","last_became_peered":"2024-09-12T01:35:55.629296+0000","last_unstale":"2024-09-12T01:35:57.631248+0000","last_undegraded":"2024-09-12T01:35:57.631248+0000","last_fullsized":"2024-09-12T01:35:57.631248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:20.004524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631264+0000","last_change":"2024-09-12T01:35:56.632127+0000","last_active":"2024-09-12T01:35:57.631264+0000","last_peered":"2024-09-12T01:35:57.631264+0000","last_clean":"2024-09-12T01:35:57.631264+0000","last_became_active":"2024-09-12T01:35:56.631788+0000","last_became_peered":"2024-09-12T01:35:56.631788+0000","last_unstale":"2024-09-12T01:35:57.631264+0000","last_undegraded":"2024-09-12T01:35:57.631264+0000","last_fullsized":"2024-09-12T01:35:57.631264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:55.610782+0000","last_clean_scrub_stamp":"2024-09-12T01:35:55.610782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:10.654187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.631417+0000","last_change":"2024-09-12T01:35:55.632404+0000","last_active":"2024-09-12T01:35:57.631417+0000","last_peered":"2024-09-12T01:35:57.631417+0000","last_clean":"2024-09-12T01:35:57.631417+0000","last_became_active":"2024-09-12T01:35:55.631711+0000","last_became_peered":"2024-09-12T01:35:55.631711+0000","last_unstale":"2024-09-12T01:35:57.631417+0000","last_undegraded":"2024-09-12T01:35:57.631417+0000","last_fullsized":"2024-09-12T01:35:57.631417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:54.606018+0000","last_clean_scrub_stamp":"2024-09-12T01:35:54.606018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:51.791206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":241664,"data_stored":81359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":835584,"data_stored":671695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":237568,"data_stored":81817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":831488,"data_stored":671673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":241664,"data_stored":81291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":83519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:36:08.871 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:36:08.871 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T01:36:08.872 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T01:36:08.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:36:09.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.031+0000 7efcbcce6640 1 Processor -- start 2024-09-12T01:36:09.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.032+0000 7efcbcce6640 1 -- start start 2024-09-12T01:36:09.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.032+0000 7efcbcce6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efcb8155800 0x7efcb80b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.032+0000 7efcbcce6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb815c330 0x7efcb80b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcbcce6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcb80b50a0 con 0x7efcb80cf570 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcbcce6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efcb80b4e60 con 0x7efcb8155800 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcbcce6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efcb815c7a0 con 0x7efcb815c330 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb6d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efcb80cf570 0x7efcb815c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50206/0 (socket says 172.21.15.60:50206) 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb6d9d640 1 -- 172.21.15.60:0/3038615821 learned_addr learned my addr 172.21.15.60:0/3038615821 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb5d9b640 1 --2- 172.21.15.60:0/3038615821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb815c330 0x7efcb80b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb659c640 1 --2- 172.21.15.60:0/3038615821 >> v2:172.21.15.105:3300/0 conn(0x7efcb8155800 0x7efcb80b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597946416 0 0) 0x7efcb80b50a0 con 0x7efcb80cf570 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efca0003520 con 0x7efcb80cf570 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2248256451 0 0) 0x7efca0003520 con 0x7efcb80cf570 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb815c330 msgr2=0x7efcb80b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 --2- 172.21.15.60:0/3038615821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb815c330 0x7efcb80b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 >> v2:172.21.15.105:3300/0 conn(0x7efcb8155800 msgr2=0x7efcb80b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 --2- 172.21.15.60:0/3038615821 >> v2:172.21.15.105:3300/0 conn(0x7efcb8155800 0x7efcb80b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb80b5380 con 0x7efcb80cf570 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7efcb00019f0 con 0x7efcb80cf570 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 >> v1:172.21.15.60:6789/0 conn(0x7efcb80cf570 legacy=0x7efcb815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 --2- 172.21.15.60:0/3038615821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb815c330 0x7efca00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 --2- 172.21.15.60:0/3038615821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca0003f30 0x7efca0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 --2- 172.21.15.60:0/3038615821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca0004d40 0x7efca00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efcb80b4e60 con 0x7efca0003f30 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efcb815c7a0 con 0x7efca0004d40 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efca000dbd0 con 0x7efcb815c330 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb5d9b640 1 --2- 172.21.15.60:0/3038615821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca0003f30 0x7efca0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb659c640 1 --2- 172.21.15.60:0/3038615821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb815c330 0x7efca00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.033+0000 7efcb6d9d640 1 --2- 172.21.15.60:0/3038615821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca0004d40 0x7efca00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.034+0000 7efcb5d9b640 1 -- 172.21.15.60:0/3038615821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb815c330 msgr2=0x7efca00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.034+0000 7efcb5d9b640 1 --2- 172.21.15.60:0/3038615821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb815c330 0x7efca00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.034+0000 7efcb5d9b640 1 -- 172.21.15.60:0/3038615821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca0004d40 msgr2=0x7efca00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.034+0000 7efcb5d9b640 1 --2- 172.21.15.60:0/3038615821 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efca0004d40 0x7efca00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.034+0000 7efcb5d9b640 1 -- 172.21.15.60:0/3038615821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca0003520 con 0x7efca0003f30 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.034+0000 7efcb5d9b640 1 --2- 172.21.15.60:0/3038615821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca0003f30 0x7efca0004800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efcac009ac0 tx=0x7efca0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5deb8638ac00599 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.035+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac036070 con 0x7efca0003f30 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.035+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcac031400 con 0x7efca0003f30 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.035+0000 7efcb559a640 1 -- 172.21.15.60:0/3038615821 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcac009690 con 0x7efca0003f30 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.035+0000 7efcbcce6640 1 -- 172.21.15.60:0/3038615821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca0003f30 msgr2=0x7efca0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.035+0000 7efcbcce6640 1 --2- 172.21.15.60:0/3038615821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca0003f30 0x7efca0004800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7efcac009ac0 tx=0x7efca0005830 comp rx=0 tx=0).stop 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.035+0000 7efcb6d9d640 1 -- 172.21.15.60:0/3038615821 reap_dead start 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.035+0000 7efcbcce6640 1 -- 172.21.15.60:0/3038615821 shutdown_connections 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.035+0000 7efcbcce6640 1 -- 172.21.15.60:0/3038615821 >> 172.21.15.60:0/3038615821 conn(0x7efcb806bc10 msgr2=0x7efcb806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.035+0000 7efcbcce6640 1 -- 172.21.15.60:0/3038615821 shutdown_connections 2024-09-12T01:36:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.035+0000 7efcbcce6640 1 -- 172.21.15.60:0/3038615821 wait complete. 2024-09-12T01:36:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.037+0000 7efcbcce6640 1 Processor -- start 2024-09-12T01:36:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.037+0000 7efcbcce6640 1 -- start start 2024-09-12T01:36:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.037+0000 7efcbcce6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca0003f30 0x7efcb8145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.037+0000 7efcbcce6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb8158700 0x7efcb815dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.037+0000 7efcbcce6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcb81544b0 0x7efcb815e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.037+0000 7efcbcce6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efcb80b5c20 con 0x7efca0003f30 2024-09-12T01:36:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.037+0000 7efcbcce6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efcb80b5940 con 0x7efcb81544b0 2024-09-12T01:36:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.037+0000 7efcbcce6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efcb8155be0 con 0x7efcb8158700 2024-09-12T01:36:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.037+0000 7efcb659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca0003f30 0x7efcb8145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.037+0000 7efcb659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca0003f30 0x7efcb8145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49426/0 (socket says 172.21.15.60:49426) 2024-09-12T01:36:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.037+0000 7efcb659c640 1 -- 172.21.15.60:0/2404216575 learned_addr learned my addr 172.21.15.60:0/2404216575 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efcb6d9d640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcb81544b0 0x7efcb815e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efcb5d9b640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb8158700 0x7efcb815dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efcb659c640 1 -- 172.21.15.60:0/2404216575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb8158700 msgr2=0x7efcb815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efcb659c640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb8158700 0x7efcb815dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efcb659c640 1 -- 172.21.15.60:0/2404216575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcb81544b0 msgr2=0x7efcb815e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efcb659c640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcb81544b0 0x7efcb815e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efcb659c640 1 -- 172.21.15.60:0/2404216575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb81464e0 con 0x7efca0003f30 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efcb5d9b640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb8158700 0x7efcb815dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efcb659c640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca0003f30 0x7efcb8145fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efca8011a70 tx=0x7efca8011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efca6ffd640 1 -- 172.21.15.60:0/2404216575 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca800fb50 con 0x7efca0003f30 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efca6ffd640 1 -- 172.21.15.60:0/2404216575 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efca800fcf0 con 0x7efca0003f30 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efca6ffd640 1 -- 172.21.15.60:0/2404216575 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca800fea0 con 0x7efca0003f30 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efcbcce6640 1 -- 172.21.15.60:0/2404216575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb8152150 con 0x7efca0003f30 2024-09-12T01:36:09.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.038+0000 7efcbcce6640 1 -- 172.21.15.60:0/2404216575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb8152710 con 0x7efca0003f30 2024-09-12T01:36:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.039+0000 7efcbcce6640 1 -- 172.21.15.60:0/2404216575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb80b6140 con 0x7efca0003f30 2024-09-12T01:36:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.040+0000 7efca6ffd640 1 -- 172.21.15.60:0/2404216575 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efca8012040 con 0x7efca0003f30 2024-09-12T01:36:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.040+0000 7efca6ffd640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efc9806be30 0x7efc9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.040+0000 7efca6ffd640 1 -- 172.21.15.60:0/2404216575 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7efca808b570 con 0x7efca0003f30 2024-09-12T01:36:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.040+0000 7efcb5d9b640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efc9806be30 0x7efc9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.040+0000 7efcb5d9b640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efc9806be30 0x7efc9806e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efcac033000 tx=0x7efcac008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.044+0000 7efca6ffd640 1 -- 172.21.15.60:0/2404216575 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efcb81464e0 con 0x7efca0003f30 2024-09-12T01:36:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.257+0000 7efcbcce6640 1 -- 172.21.15.60:0/2404216575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efcb80ce3a0 con 0x7efca0003f30 2024-09-12T01:36:09.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.257+0000 7efca6ffd640 1 -- 172.21.15.60:0/2404216575 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7efca8019030 con 0x7efca0003f30 2024-09-12T01:36:09.256 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:09.256 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T01:36:09.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.259+0000 7efcbcce6640 1 -- 172.21.15.60:0/2404216575 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efc9806be30 msgr2=0x7efc9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.259+0000 7efcbcce6640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efc9806be30 0x7efc9806e2f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7efcac033000 tx=0x7efcac008030 comp rx=0 tx=0).stop 2024-09-12T01:36:09.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.259+0000 7efcbcce6640 1 -- 172.21.15.60:0/2404216575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca0003f30 msgr2=0x7efcb8145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.259+0000 7efcbcce6640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca0003f30 0x7efcb8145fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efca8011a70 tx=0x7efca8011f30 comp rx=0 tx=0).stop 2024-09-12T01:36:09.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.259+0000 7efcbcce6640 1 -- 172.21.15.60:0/2404216575 shutdown_connections 2024-09-12T01:36:09.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.259+0000 7efcbcce6640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcb81544b0 0x7efcb815e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.259+0000 7efcbcce6640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efc9806be30 0x7efc9806e2f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.259+0000 7efcbcce6640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcb8158700 0x7efcb815dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.259+0000 7efcbcce6640 1 --2- 172.21.15.60:0/2404216575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efca0003f30 0x7efcb8145fa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.259+0000 7efcbcce6640 1 -- 172.21.15.60:0/2404216575 >> 172.21.15.60:0/2404216575 conn(0x7efcb806bc10 msgr2=0x7efcb80cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:09.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.259+0000 7efcbcce6640 1 -- 172.21.15.60:0/2404216575 shutdown_connections 2024-09-12T01:36:09.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.259+0000 7efcbcce6640 1 -- 172.21.15.60:0/2404216575 wait complete. 2024-09-12T01:36:09.269 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T01:36:09.269 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:36:09.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.372+0000 7f4dc642c640 1 Processor -- start 2024-09-12T01:36:09.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.372+0000 7f4dc642c640 1 -- start start 2024-09-12T01:36:09.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dc642c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4dc00b63d0 0x7f4dc00d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dc642c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dc00cf6b0 0x7f4dc00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dc642c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc00cfc20 con 0x7f4dc00d1c80 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dc642c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4dc00d2ed0 con 0x7f4dc00b63d0 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dc642c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc00d31b0 con 0x7f4dc00cf6b0 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dbffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4dc00b63d0 0x7f4dc00d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dbffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4dc00b63d0 0x7f4dc00d39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49436/0 (socket says 172.21.15.60:49436) 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dbffff640 1 -- 172.21.15.60:0/3960737064 learned_addr learned my addr 172.21.15.60:0/3960737064 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dbf7fe640 1 --2- 172.21.15.60:0/3960737064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dc00cf6b0 0x7f4dc00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dbffff640 1 -- 172.21.15.60:0/3960737064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dc00cf6b0 msgr2=0x7f4dc00b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dbffff640 1 --2- 172.21.15.60:0/3960737064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dc00cf6b0 0x7f4dc00b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dbffff640 1 -- 172.21.15.60:0/3960737064 >> v1:172.21.15.105:6789/0 conn(0x7f4dc00d1c80 legacy=0x7f4dc00b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dbffff640 1 -- 172.21.15.60:0/3960737064 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc00d3490 con 0x7f4dc00b63d0 2024-09-12T01:36:09.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.373+0000 7f4dbf7fe640 1 --2- 172.21.15.60:0/3960737064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dc00cf6b0 0x7f4dc00b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:09.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.374+0000 7f4dbffff640 1 --2- 172.21.15.60:0/3960737064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc00b63d0 0x7f4dc00d39b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009870 tx=0x7f4db002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31830e20601d6cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:09.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.374+0000 7f4dbeffd640 1 -- 172.21.15.60:0/3960737064 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0037070 con 0x7f4dc00b63d0 2024-09-12T01:36:09.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.374+0000 7f4dbeffd640 1 -- 172.21.15.60:0/3960737064 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db0032440 con 0x7f4dc00b63d0 2024-09-12T01:36:09.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.374+0000 7f4dbeffd640 1 -- 172.21.15.60:0/3960737064 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0032810 con 0x7f4dc00b63d0 2024-09-12T01:36:09.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.374+0000 7f4dc642c640 1 -- 172.21.15.60:0/3960737064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc00b63d0 msgr2=0x7f4dc00d39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.374+0000 7f4dc642c640 1 --2- 172.21.15.60:0/3960737064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc00b63d0 0x7f4dc00d39b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009870 tx=0x7f4db002a270 comp rx=0 tx=0).stop 2024-09-12T01:36:09.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.375+0000 7f4dc642c640 1 -- 172.21.15.60:0/3960737064 shutdown_connections 2024-09-12T01:36:09.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.375+0000 7f4dc642c640 1 --2- 172.21.15.60:0/3960737064 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dc00cf6b0 0x7f4dc00b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.375+0000 7f4dc642c640 1 --2- 172.21.15.60:0/3960737064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc00b63d0 0x7f4dc00d39b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.375+0000 7f4dc642c640 1 -- 172.21.15.60:0/3960737064 >> 172.21.15.60:0/3960737064 conn(0x7f4dc00d1160 msgr2=0x7f4dc00d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:09.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.375+0000 7f4dc642c640 1 -- 172.21.15.60:0/3960737064 shutdown_connections 2024-09-12T01:36:09.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.375+0000 7f4dc642c640 1 -- 172.21.15.60:0/3960737064 wait complete. 2024-09-12T01:36:09.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.376+0000 7f4dc642c640 1 Processor -- start 2024-09-12T01:36:09.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.376+0000 7f4dc642c640 1 -- start start 2024-09-12T01:36:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc642c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dc00b63d0 0x7f4dc0151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc642c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4dc00cf6b0 0x7f4dc00c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc642c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc00d1c80 0x7f4dc01e9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc642c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc00d4070 con 0x7f4dc00d1c80 2024-09-12T01:36:09.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc642c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc00d3ef0 con 0x7f4dc00cf6b0 2024-09-12T01:36:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc642c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc00b67b0 con 0x7f4dc00b63d0 2024-09-12T01:36:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc49c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc00d1c80 0x7f4dc01e9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc49c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc00d1c80 0x7f4dc01e9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49442/0 (socket says 172.21.15.60:49442) 2024-09-12T01:36:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc49c9640 1 -- 172.21.15.60:0/1755517886 learned_addr learned my addr 172.21.15.60:0/1755517886 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dbffff640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dc00b63d0 0x7f4dc0151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dbf7fe640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4dc00cf6b0 0x7f4dc00c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc49c9640 1 -- 172.21.15.60:0/1755517886 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dc00b63d0 msgr2=0x7f4dc0151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc49c9640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dc00b63d0 0x7f4dc0151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc49c9640 1 -- 172.21.15.60:0/1755517886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4dc00cf6b0 msgr2=0x7f4dc00c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc49c9640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4dc00cf6b0 0x7f4dc00c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc49c9640 1 -- 172.21.15.60:0/1755517886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc00c9ea0 con 0x7f4dc00d1c80 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc49c9640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc00d1c80 0x7f4dc01e9720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4db800c6e0 tx=0x7f4db800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dbcff9640 1 -- 172.21.15.60:0/1755517886 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8003b70 con 0x7f4dc00d1c80 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dbcff9640 1 -- 172.21.15.60:0/1755517886 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db8003d30 con 0x7f4dc00d1c80 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc642c640 1 -- 172.21.15.60:0/1755517886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc00ca180 con 0x7f4dc00d1c80 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dbcff9640 1 -- 172.21.15.60:0/1755517886 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db8005310 con 0x7f4dc00d1c80 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.377+0000 7f4dc642c640 1 -- 172.21.15.60:0/1755517886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc00ca740 con 0x7f4dc00d1c80 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.378+0000 7f4dc642c640 1 -- 172.21.15.60:0/1755517886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc00d39b0 con 0x7f4dc00d1c80 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.379+0000 7f4dbcff9640 1 -- 172.21.15.60:0/1755517886 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4db80054b0 con 0x7f4dc00d1c80 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.379+0000 7f4dbcff9640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4dac06be30 0x7f4dac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.379+0000 7f4dbffff640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4dac06be30 0x7f4dac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.379+0000 7f4dbcff9640 1 -- 172.21.15.60:0/1755517886 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4db808ab10 con 0x7f4dc00d1c80 2024-09-12T01:36:09.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.380+0000 7f4dbffff640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4dac06be30 0x7f4dac06e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4db0034000 tx=0x7f4db002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:09.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.384+0000 7f4dbcff9640 1 -- 172.21.15.60:0/1755517886 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4db8058e70 con 0x7f4dc00d1c80 2024-09-12T01:36:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.595+0000 7f4dc642c640 1 -- 172.21.15.60:0/1755517886 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4dc00b6d00 con 0x7f4dc00d1c80 2024-09-12T01:36:09.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.596+0000 7f4dbcff9640 1 -- 172.21.15.60:0/1755517886 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5223 (secure 0 0 0) 0x7f4db805d170 con 0x7f4dc00d1c80 2024-09-12T01:36:09.595 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:09.595 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"btime":"2024-09-12T01:35:58:740642+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3216581844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3216581844},{"type":"v1","addr":"172.21.15.60:6836","nonce":3216581844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1706637770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1706637770},{"type":"v1","addr":"172.21.15.105:6833","nonce":1706637770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3645806076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3645806076},{"type":"v1","addr":"172.21.15.60:6837","nonce":3645806076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:35:55.984648+0000","modified":"2024-09-12T01:35:58.083477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3695785914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3695785914},{"type":"v1","addr":"172.21.15.105:6835","nonce":3695785914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-12T01:36:09.596 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2024-09-12T01:36:09.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.598+0000 7f4dc642c640 1 -- 172.21.15.60:0/1755517886 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4dac06be30 msgr2=0x7f4dac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.598+0000 7f4dc642c640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4dac06be30 0x7f4dac06e2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4db0034000 tx=0x7f4db002e000 comp rx=0 tx=0).stop 2024-09-12T01:36:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.598+0000 7f4dc642c640 1 -- 172.21.15.60:0/1755517886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc00d1c80 msgr2=0x7f4dc01e9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.598+0000 7f4dc642c640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc00d1c80 0x7f4dc01e9720 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4db800c6e0 tx=0x7f4db800cba0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.598+0000 7f4dc642c640 1 -- 172.21.15.60:0/1755517886 shutdown_connections 2024-09-12T01:36:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.598+0000 7f4dc642c640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dc00d1c80 0x7f4dc01e9720 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.598+0000 7f4dc642c640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4dc00cf6b0 0x7f4dc00c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.598+0000 7f4dc642c640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4dac06be30 0x7f4dac06e2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.598+0000 7f4dc642c640 1 --2- 172.21.15.60:0/1755517886 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4dc00b63d0 0x7f4dc0151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.598+0000 7f4dc642c640 1 -- 172.21.15.60:0/1755517886 >> 172.21.15.60:0/1755517886 conn(0x7f4dc00d1160 msgr2=0x7f4dc00b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.598+0000 7f4dc642c640 1 -- 172.21.15.60:0/1755517886 shutdown_connections 2024-09-12T01:36:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.598+0000 7f4dc642c640 1 -- 172.21.15.60:0/1755517886 wait complete. 2024-09-12T01:36:09.609 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:36:09.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.711+0000 7fc5cd25c640 1 Processor -- start 2024-09-12T01:36:09.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.711+0000 7fc5cd25c640 1 -- start start 2024-09-12T01:36:09.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.712+0000 7fc5cd25c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc5c80d3310 0x7fc5c80d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.712+0000 7fc5cd25c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c815ea40 con 0x7fc5c815e660 2024-09-12T01:36:09.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.712+0000 7fc5cd25c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5c80d3870 con 0x7fc5c80d1650 2024-09-12T01:36:09.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.712+0000 7fc5cd25c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc5c80d1ac0 con 0x7fc5c80d3310 2024-09-12T01:36:09.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.712+0000 7fc5c659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc5c80d3310 0x7fc5c80d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.712+0000 7fc5c659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc5c80d3310 0x7fc5c80d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49444/0 (socket says 172.21.15.60:49444) 2024-09-12T01:36:09.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.712+0000 7fc5c6d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc5c815e660 0x7fc5c80cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50210/0 (socket says 172.21.15.60:50210) 2024-09-12T01:36:09.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.712+0000 7fc5c659c640 1 -- 172.21.15.60:0/1381167293 learned_addr learned my addr 172.21.15.60:0/1381167293 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:09.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.713+0000 7fc5c659c640 1 -- 172.21.15.60:0/1381167293 >> v1:172.21.15.105:6789/0 conn(0x7fc5c80d1650 legacy=0x7fc5c80b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:09.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.713+0000 7fc5c659c640 1 -- 172.21.15.60:0/1381167293 >> v1:172.21.15.60:6789/0 conn(0x7fc5c815e660 legacy=0x7fc5c80cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.713+0000 7fc5c659c640 1 -- 172.21.15.60:0/1381167293 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c80d3b50 con 0x7fc5c80d3310 2024-09-12T01:36:09.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.713+0000 7fc5c5d9b640 1 -- 172.21.15.60:0/1381167293 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526485936 0 0) 0x7fc5c815ea40 con 0x7fc5c815e660 2024-09-12T01:36:09.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.713+0000 7fc5c659c640 1 --2- 172.21.15.60:0/1381167293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80d3310 0x7fc5c80d1110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009870 tx=0x7fc5b002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aece2d2588b5fdd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:09.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.713+0000 7fc5c5d9b640 1 -- 172.21.15.60:0/1381167293 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0037070 con 0x7fc5c80d3310 2024-09-12T01:36:09.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.713+0000 7fc5c5d9b640 1 -- 172.21.15.60:0/1381167293 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b0032440 con 0x7fc5c80d3310 2024-09-12T01:36:09.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.713+0000 7fc5c5d9b640 1 -- 172.21.15.60:0/1381167293 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0032810 con 0x7fc5c80d3310 2024-09-12T01:36:09.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.714+0000 7fc5cd25c640 1 -- 172.21.15.60:0/1381167293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80d3310 msgr2=0x7fc5c80d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.714+0000 7fc5cd25c640 1 --2- 172.21.15.60:0/1381167293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80d3310 0x7fc5c80d1110 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009870 tx=0x7fc5b002a2a0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.714+0000 7fc5cd25c640 1 -- 172.21.15.60:0/1381167293 shutdown_connections 2024-09-12T01:36:09.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.714+0000 7fc5cd25c640 1 --2- 172.21.15.60:0/1381167293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80d3310 0x7fc5c80d1110 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.714+0000 7fc5cd25c640 1 -- 172.21.15.60:0/1381167293 >> 172.21.15.60:0/1381167293 conn(0x7fc5c80b6410 msgr2=0x7fc5c80b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:09.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.714+0000 7fc5cd25c640 1 -- 172.21.15.60:0/1381167293 shutdown_connections 2024-09-12T01:36:09.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.714+0000 7fc5cd25c640 1 -- 172.21.15.60:0/1381167293 wait complete. 2024-09-12T01:36:09.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.715+0000 7fc5cd25c640 1 Processor -- start 2024-09-12T01:36:09.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.716+0000 7fc5cd25c640 1 -- start start 2024-09-12T01:36:09.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.716+0000 7fc5cd25c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c80d1650 0x7fc5c8161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.716+0000 7fc5cd25c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80d3310 0x7fc5c8154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.716+0000 7fc5cd25c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5c815e660 0x7fc5c8154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.716+0000 7fc5cd25c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c80d43f0 con 0x7fc5c80d3310 2024-09-12T01:36:09.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.716+0000 7fc5cd25c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c80d4110 con 0x7fc5c80d1650 2024-09-12T01:36:09.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.716+0000 7fc5cd25c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc5c80b8280 con 0x7fc5c815e660 2024-09-12T01:36:09.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.716+0000 7fc5c659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80d3310 0x7fc5c8154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.716+0000 7fc5c659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80d3310 0x7fc5c8154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49454/0 (socket says 172.21.15.60:49454) 2024-09-12T01:36:09.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.716+0000 7fc5c659c640 1 -- 172.21.15.60:0/786587676 learned_addr learned my addr 172.21.15.60:0/786587676 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:09.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5c6d9d640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c80d1650 0x7fc5c8161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5c759e640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5c815e660 0x7fc5c8154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5c659c640 1 -- 172.21.15.60:0/786587676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5c815e660 msgr2=0x7fc5c8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5c659c640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5c815e660 0x7fc5c8154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5c659c640 1 -- 172.21.15.60:0/786587676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c80d1650 msgr2=0x7fc5c8161330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5c659c640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c80d1650 0x7fc5c8161330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5c659c640 1 -- 172.21.15.60:0/786587676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c8151070 con 0x7fc5c80d3310 2024-09-12T01:36:09.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5c6d9d640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c80d1650 0x7fc5c8161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:09.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5c659c640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80d3310 0x7fc5c8154a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009870 tx=0x7fc5b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5bf7fe640 1 -- 172.21.15.60:0/786587676 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0041070 con 0x7fc5c80d3310 2024-09-12T01:36:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5bf7fe640 1 -- 172.21.15.60:0/786587676 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5b003c870 con 0x7fc5c80d3310 2024-09-12T01:36:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5cd25c640 1 -- 172.21.15.60:0/786587676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c815ebe0 con 0x7fc5c80d3310 2024-09-12T01:36:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5bf7fe640 1 -- 172.21.15.60:0/786587676 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0037040 con 0x7fc5c80d3310 2024-09-12T01:36:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.717+0000 7fc5cd25c640 1 -- 172.21.15.60:0/786587676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c815f1a0 con 0x7fc5c80d3310 2024-09-12T01:36:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.718+0000 7fc5cd25c640 1 -- 172.21.15.60:0/786587676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c80d1110 con 0x7fc5c80d3310 2024-09-12T01:36:09.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.718+0000 7fc5bf7fe640 1 -- 172.21.15.60:0/786587676 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc5b0044070 con 0x7fc5c80d3310 2024-09-12T01:36:09.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.719+0000 7fc5bf7fe640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc5a806be30 0x7fc5a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:09.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.719+0000 7fc5bf7fe640 1 -- 172.21.15.60:0/786587676 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc5b00abb70 con 0x7fc5c80d3310 2024-09-12T01:36:09.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.719+0000 7fc5c6d9d640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc5a806be30 0x7fc5a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:09.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.719+0000 7fc5c6d9d640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc5a806be30 0x7fc5a806e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80012e0 tx=0x7fc5b8005b90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:09.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.723+0000 7fc5bf7fe640 1 -- 172.21.15.60:0/786587676 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc5b007a640 con 0x7fc5c80d3310 2024-09-12T01:36:09.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.933+0000 7fc5cd25c640 1 -- 172.21.15.60:0/786587676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5c80d5380 con 0x7fc5c80d3310 2024-09-12T01:36:09.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.934+0000 7fc5bf7fe640 1 -- 172.21.15.60:0/786587676 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5223 (secure 0 0 0) 0x7fc5b0079f40 con 0x7fc5c80d3310 2024-09-12T01:36:09.933 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:09.933 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"btime":"2024-09-12T01:35:58:740642+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3216581844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3216581844},{"type":"v1","addr":"172.21.15.60:6836","nonce":3216581844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1706637770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1706637770},{"type":"v1","addr":"172.21.15.105:6833","nonce":1706637770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3645806076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3645806076},{"type":"v1","addr":"172.21.15.60:6837","nonce":3645806076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:35:55.984648+0000","modified":"2024-09-12T01:35:58.083477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3695785914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3695785914},{"type":"v1","addr":"172.21.15.105:6835","nonce":3695785914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-12T01:36:09.934 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2024-09-12T01:36:09.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.936+0000 7fc5cd25c640 1 -- 172.21.15.60:0/786587676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc5a806be30 msgr2=0x7fc5a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.936+0000 7fc5cd25c640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc5a806be30 0x7fc5a806e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80012e0 tx=0x7fc5b8005b90 comp rx=0 tx=0).stop 2024-09-12T01:36:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.936+0000 7fc5cd25c640 1 -- 172.21.15.60:0/786587676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80d3310 msgr2=0x7fc5c8154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.936+0000 7fc5cd25c640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80d3310 0x7fc5c8154a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0009870 tx=0x7fc5b00046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.936+0000 7fc5cd25c640 1 -- 172.21.15.60:0/786587676 shutdown_connections 2024-09-12T01:36:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.936+0000 7fc5cd25c640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc5a806be30 0x7fc5a806e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.936+0000 7fc5cd25c640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc5c815e660 0x7fc5c8154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.936+0000 7fc5cd25c640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80d3310 0x7fc5c8154a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.936+0000 7fc5cd25c640 1 --2- 172.21.15.60:0/786587676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc5c80d1650 0x7fc5c8161330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.936+0000 7fc5cd25c640 1 -- 172.21.15.60:0/786587676 >> 172.21.15.60:0/786587676 conn(0x7fc5c80b6410 msgr2=0x7fc5c80b4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.936+0000 7fc5cd25c640 1 -- 172.21.15.60:0/786587676 shutdown_connections 2024-09-12T01:36:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:09.936+0000 7fc5cd25c640 1 -- 172.21.15.60:0/786587676 wait complete. 2024-09-12T01:36:09.946 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:36:10.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.049+0000 7effeb5f1640 1 Processor -- start 2024-09-12T01:36:10.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.049+0000 7effeb5f1640 1 -- start start 2024-09-12T01:36:10.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.050+0000 7effeb5f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe40ba240 0x7effe40d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.050+0000 7effeb5f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effe40ba660 con 0x7effe40cf2f0 2024-09-12T01:36:10.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.050+0000 7effeb5f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effe40d2f40 con 0x7effe415e7a0 2024-09-12T01:36:10.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.050+0000 7effeb5f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7effe40d3220 con 0x7effe40ba240 2024-09-12T01:36:10.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.050+0000 7effe9b8e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7effe40cf2f0 0x7effe40b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50214/0 (socket says 172.21.15.60:50214) 2024-09-12T01:36:10.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.050+0000 7effe9b8e640 1 -- 172.21.15.60:0/4289145553 learned_addr learned my addr 172.21.15.60:0/4289145553 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:10.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.050+0000 7effe8b8c640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe40ba240 0x7effe40d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.050+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2122794572 0 0) 0x7effe40ba660 con 0x7effe40cf2f0 2024-09-12T01:36:10.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.050+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effd0003520 con 0x7effe40cf2f0 2024-09-12T01:36:10.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1360230732 0 0) 0x7effd0003520 con 0x7effe40cf2f0 2024-09-12T01:36:10.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe40ba240 msgr2=0x7effe40d3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:10.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe40ba240 0x7effe40d3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 >> v1:172.21.15.105:6789/0 conn(0x7effe415e7a0 legacy=0x7effe40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe40d3500 con 0x7effe40cf2f0 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7effdc0019f0 con 0x7effe40cf2f0 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 >> v1:172.21.15.60:6789/0 conn(0x7effe40cf2f0 legacy=0x7effe40b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd00039e0 0x7effd0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe40ba240 0x7effd0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effd0004d40 0x7effd00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7effe40d3220 con 0x7effd00039e0 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7effd000b9c0 con 0x7effd0004d40 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7effd000bbc0 con 0x7effe40ba240 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effe938d640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd00039e0 0x7effd0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effe8b8c640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe40ba240 0x7effd0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effe9b8e640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effd0004d40 0x7effd00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effe938d640 1 -- 172.21.15.60:0/4289145553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe40ba240 msgr2=0x7effd0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effe938d640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe40ba240 0x7effd0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effe938d640 1 -- 172.21.15.60:0/4289145553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effd0004d40 msgr2=0x7effd00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effe938d640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effd0004d40 0x7effd00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effe938d640 1 -- 172.21.15.60:0/4289145553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd0003520 con 0x7effd00039e0 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.051+0000 7effe9b8e640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effd0004d40 0x7effd00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.052+0000 7effe938d640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd00039e0 0x7effd0003dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7effe0001860 tx=0x7effd0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf1809d1ea39992 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.052+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0037070 con 0x7effd00039e0 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.052+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe002ab60 con 0x7effd00039e0 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.052+0000 7effdbfff640 1 -- 172.21.15.60:0/4289145553 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0001430 con 0x7effd00039e0 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.052+0000 7effeb5f1640 1 -- 172.21.15.60:0/4289145553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd00039e0 msgr2=0x7effd0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.052+0000 7effeb5f1640 1 --2- 172.21.15.60:0/4289145553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effd00039e0 0x7effd0003dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7effe0001860 tx=0x7effd0005830 comp rx=0 tx=0).stop 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.052+0000 7effe9b8e640 1 -- 172.21.15.60:0/4289145553 reap_dead start 2024-09-12T01:36:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.052+0000 7effeb5f1640 1 -- 172.21.15.60:0/4289145553 shutdown_connections 2024-09-12T01:36:10.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.052+0000 7effeb5f1640 1 -- 172.21.15.60:0/4289145553 >> 172.21.15.60:0/4289145553 conn(0x7effe40d1550 msgr2=0x7effe40d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:10.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.053+0000 7effeb5f1640 1 -- 172.21.15.60:0/4289145553 shutdown_connections 2024-09-12T01:36:10.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.053+0000 7effeb5f1640 1 -- 172.21.15.60:0/4289145553 wait complete. 2024-09-12T01:36:10.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.054+0000 7effeb5f1640 1 Processor -- start 2024-09-12T01:36:10.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.054+0000 7effeb5f1640 1 -- start start 2024-09-12T01:36:10.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effeb5f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effd00039e0 0x7effe40ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effeb5f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe41f73d0 0x7effe40ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effeb5f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe40ac560 0x7effe415ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effeb5f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7effe415eb80 con 0x7effe40ac560 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effeb5f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7effe40d3ac0 con 0x7effd00039e0 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effeb5f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7effe415ed00 con 0x7effe41f73d0 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effe9b8e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe40ac560 0x7effe415ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effe9b8e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe40ac560 0x7effe415ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49474/0 (socket says 172.21.15.60:49474) 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effe9b8e640 1 -- 172.21.15.60:0/535030520 learned_addr learned my addr 172.21.15.60:0/535030520 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effe938d640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effd00039e0 0x7effe40ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effe8b8c640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe41f73d0 0x7effe40ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effe9b8e640 1 -- 172.21.15.60:0/535030520 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe41f73d0 msgr2=0x7effe40ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effe9b8e640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe41f73d0 0x7effe40ac020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effe9b8e640 1 -- 172.21.15.60:0/535030520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effd00039e0 msgr2=0x7effe40ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effe9b8e640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effd00039e0 0x7effe40ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effe9b8e640 1 -- 172.21.15.60:0/535030520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe41f7e20 con 0x7effe40ac560 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effe9b8e640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe40ac560 0x7effe415ff00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7effe406e920 tx=0x7effdc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effd9ffb640 1 -- 172.21.15.60:0/535030520 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc00ebc0 con 0x7effe40ac560 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effd9ffb640 1 -- 172.21.15.60:0/535030520 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effdc00ed60 con 0x7effe40ac560 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effeb5f1640 1 -- 172.21.15.60:0/535030520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe41f8100 con 0x7effe40ac560 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.055+0000 7effd9ffb640 1 -- 172.21.15.60:0/535030520 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effdc014650 con 0x7effe40ac560 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.056+0000 7effeb5f1640 1 -- 172.21.15.60:0/535030520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe40abb00 con 0x7effe40ac560 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.057+0000 7effeb5f1640 1 -- 172.21.15.60:0/535030520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe40abd00 con 0x7effe40ac560 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.057+0000 7effd9ffb640 1 -- 172.21.15.60:0/535030520 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effdc0147f0 con 0x7effe40ac560 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.058+0000 7effd9ffb640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7effc806be60 0x7effc806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.058+0000 7effd9ffb640 1 -- 172.21.15.60:0/535030520 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7effdc08ab30 con 0x7effe40ac560 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.058+0000 7effe938d640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7effc806be60 0x7effc806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.058+0000 7effe938d640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7effc806be60 0x7effc806e320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7effe0034000 tx=0x7effe0009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:10.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.062+0000 7effd9ffb640 1 -- 172.21.15.60:0/535030520 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7effe40abd00 con 0x7effe40ac560 2024-09-12T01:36:10.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.237+0000 7effeb5f1640 1 -- 172.21.15.60:0/535030520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7effe40ab610 con 0x7effe40ac560 2024-09-12T01:36:10.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.238+0000 7effd9ffb640 1 -- 172.21.15.60:0/535030520 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7effdc058e90 con 0x7effe40ac560 2024-09-12T01:36:10.238 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:10.238 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:57.624089+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:35:53.846331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:35:54.965757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:36:10.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.241+0000 7effeb5f1640 1 -- 172.21.15.60:0/535030520 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7effc806be60 msgr2=0x7effc806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.241+0000 7effeb5f1640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7effc806be60 0x7effc806e320 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7effe0034000 tx=0x7effe0009030 comp rx=0 tx=0).stop 2024-09-12T01:36:10.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.241+0000 7effeb5f1640 1 -- 172.21.15.60:0/535030520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe40ac560 msgr2=0x7effe415ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.241+0000 7effeb5f1640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe40ac560 0x7effe415ff00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7effe406e920 tx=0x7effdc00e530 comp rx=0 tx=0).stop 2024-09-12T01:36:10.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.241+0000 7effeb5f1640 1 -- 172.21.15.60:0/535030520 shutdown_connections 2024-09-12T01:36:10.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.241+0000 7effeb5f1640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe40ac560 0x7effe415ff00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.241+0000 7effeb5f1640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7effc806be60 0x7effc806e320 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.241+0000 7effeb5f1640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effe41f73d0 0x7effe40ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.241+0000 7effeb5f1640 1 --2- 172.21.15.60:0/535030520 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effd00039e0 0x7effe40ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.241+0000 7effeb5f1640 1 -- 172.21.15.60:0/535030520 >> 172.21.15.60:0/535030520 conn(0x7effe40d1550 msgr2=0x7effe40b7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:10.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.241+0000 7effeb5f1640 1 -- 172.21.15.60:0/535030520 shutdown_connections 2024-09-12T01:36:10.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.241+0000 7effeb5f1640 1 -- 172.21.15.60:0/535030520 wait complete. 2024-09-12T01:36:10.251 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:36:10.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.353+0000 7f21c5027640 1 Processor -- start 2024-09-12T01:36:10.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.353+0000 7f21c5027640 1 -- start start 2024-09-12T01:36:10.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.354+0000 7f21c5027640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21c006f340 0x7f21c006f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.354+0000 7f21c5027640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21c0073350 0x7f21c0073800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.354+0000 7f21c5027640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21c00d1870 con 0x7f21c00cfb90 2024-09-12T01:36:10.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.354+0000 7f21c5027640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f21c015d810 con 0x7f21c0073350 2024-09-12T01:36:10.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.354+0000 7f21c5027640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21c006fcc0 con 0x7f21c006f340 2024-09-12T01:36:10.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.354+0000 7f21bf59e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21c0073350 0x7f21c0073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.354+0000 7f21bf59e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21c0073350 0x7f21c0073800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49478/0 (socket says 172.21.15.60:49478) 2024-09-12T01:36:10.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.354+0000 7f21bf59e640 1 -- 172.21.15.60:0/1989426908 learned_addr learned my addr 172.21.15.60:0/1989426908 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.355+0000 7f21be59c640 1 --2- 172.21.15.60:0/1989426908 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21c006f340 0x7f21c006f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.355+0000 7f21bf59e640 1 -- 172.21.15.60:0/1989426908 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21c006f340 msgr2=0x7f21c006f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.355+0000 7f21bf59e640 1 --2- 172.21.15.60:0/1989426908 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21c006f340 0x7f21c006f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.355+0000 7f21bf59e640 1 -- 172.21.15.60:0/1989426908 >> v1:172.21.15.105:6789/0 conn(0x7f21c00cfb90 legacy=0x7f21c00d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.355+0000 7f21bf59e640 1 -- 172.21.15.60:0/1989426908 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c015cc00 con 0x7f21c0073350 2024-09-12T01:36:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.355+0000 7f21bf59e640 1 --2- 172.21.15.60:0/1989426908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21c0073350 0x7f21c0073800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009e50 tx=0x7f21b002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3aeab3d7221517d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.356+0000 7f21bdd9b640 1 -- 172.21.15.60:0/1989426908 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0036070 con 0x7f21c0073350 2024-09-12T01:36:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.356+0000 7f21bdd9b640 1 -- 172.21.15.60:0/1989426908 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21b0031600 con 0x7f21c0073350 2024-09-12T01:36:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.356+0000 7f21bdd9b640 1 -- 172.21.15.60:0/1989426908 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b00319d0 con 0x7f21c0073350 2024-09-12T01:36:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.356+0000 7f21c5027640 1 -- 172.21.15.60:0/1989426908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21c0073350 msgr2=0x7f21c0073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.356+0000 7f21c5027640 1 --2- 172.21.15.60:0/1989426908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21c0073350 0x7f21c0073800 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009e50 tx=0x7f21b002a710 comp rx=0 tx=0).stop 2024-09-12T01:36:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.356+0000 7f21c5027640 1 -- 172.21.15.60:0/1989426908 shutdown_connections 2024-09-12T01:36:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.356+0000 7f21c5027640 1 --2- 172.21.15.60:0/1989426908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21c0073350 0x7f21c0073800 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.356+0000 7f21c5027640 1 --2- 172.21.15.60:0/1989426908 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21c006f340 0x7f21c006f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.356+0000 7f21c5027640 1 -- 172.21.15.60:0/1989426908 >> 172.21.15.60:0/1989426908 conn(0x7f21c0062630 msgr2=0x7f21c0062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:10.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.356+0000 7f21c5027640 1 -- 172.21.15.60:0/1989426908 shutdown_connections 2024-09-12T01:36:10.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.356+0000 7f21c5027640 1 -- 172.21.15.60:0/1989426908 wait complete. 2024-09-12T01:36:10.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.358+0000 7f21c5027640 1 Processor -- start 2024-09-12T01:36:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.358+0000 7f21c5027640 1 -- start start 2024-09-12T01:36:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.358+0000 7f21c5027640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21c006f340 0x7f21c014bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.358+0000 7f21c5027640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21c0073350 0x7f21c01556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.358+0000 7f21c5027640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21c00cfb90 0x7f21c0155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.358+0000 7f21c5027640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f21c015d4a0 con 0x7f21c0073350 2024-09-12T01:36:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.358+0000 7f21c5027640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21c015d1c0 con 0x7f21c006f340 2024-09-12T01:36:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.358+0000 7f21c5027640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21c00d2260 con 0x7f21c00cfb90 2024-09-12T01:36:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.358+0000 7f21be59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21c0073350 0x7f21c01556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21be59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21c0073350 0x7f21c01556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49488/0 (socket says 172.21.15.60:49488) 2024-09-12T01:36:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21be59c640 1 -- 172.21.15.60:0/196202923 learned_addr learned my addr 172.21.15.60:0/196202923 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21bed9d640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21c006f340 0x7f21c014bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21bf59e640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21c00cfb90 0x7f21c0155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21be59c640 1 -- 172.21.15.60:0/196202923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21c00cfb90 msgr2=0x7f21c0155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21be59c640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21c00cfb90 0x7f21c0155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21be59c640 1 -- 172.21.15.60:0/196202923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21c006f340 msgr2=0x7f21c014bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21be59c640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21c006f340 0x7f21c014bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21be59c640 1 -- 172.21.15.60:0/196202923 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c00ab320 con 0x7f21c0073350 2024-09-12T01:36:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21be59c640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21c0073350 0x7f21c01556c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21a800d7d0 tx=0x7f21a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21b77fe640 1 -- 172.21.15.60:0/196202923 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a800b6c0 con 0x7f21c0073350 2024-09-12T01:36:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21b77fe640 1 -- 172.21.15.60:0/196202923 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21a8019070 con 0x7f21c0073350 2024-09-12T01:36:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21c5027640 1 -- 172.21.15.60:0/196202923 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c00ab600 con 0x7f21c0073350 2024-09-12T01:36:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21b77fe640 1 -- 172.21.15.60:0/196202923 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a800bac0 con 0x7f21c0073350 2024-09-12T01:36:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.359+0000 7f21c5027640 1 -- 172.21.15.60:0/196202923 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c00abbc0 con 0x7f21c0073350 2024-09-12T01:36:10.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.360+0000 7f21c5027640 1 -- 172.21.15.60:0/196202923 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21c00cff70 con 0x7f21c0073350 2024-09-12T01:36:10.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.361+0000 7f21b77fe640 1 -- 172.21.15.60:0/196202923 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21a800bc60 con 0x7f21c0073350 2024-09-12T01:36:10.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.361+0000 7f21b77fe640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21a006be30 0x7f21a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:10.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.361+0000 7f21b77fe640 1 -- 172.21.15.60:0/196202923 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f21a808b1e0 con 0x7f21c0073350 2024-09-12T01:36:10.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.361+0000 7f21bed9d640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21a006be30 0x7f21a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:10.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.362+0000 7f21bed9d640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21a006be30 0x7f21a006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f21c0156850 tx=0x7f21b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:10.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.365+0000 7f21b77fe640 1 -- 172.21.15.60:0/196202923 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21a8059540 con 0x7f21c0073350 2024-09-12T01:36:10.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.575+0000 7f21c5027640 1 -- 172.21.15.60:0/196202923 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21c0073730 con 0x7f21c0073350 2024-09-12T01:36:10.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.576+0000 7f21b77fe640 1 -- 172.21.15.60:0/196202923 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5223 (secure 0 0 0) 0x7f21a805d840 con 0x7f21c0073350 2024-09-12T01:36:10.575 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:10.576 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"btime":"2024-09-12T01:35:58:740642+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3216581844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3216581844},{"type":"v1","addr":"172.21.15.60:6836","nonce":3216581844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1706637770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1706637770},{"type":"v1","addr":"172.21.15.105:6833","nonce":1706637770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3645806076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3645806076},{"type":"v1","addr":"172.21.15.60:6837","nonce":3645806076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:35:55.984648+0000","modified":"2024-09-12T01:35:58.083477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3695785914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3695785914},{"type":"v1","addr":"172.21.15.105:6835","nonce":3695785914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-12T01:36:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2024-09-12T01:36:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.578+0000 7f21c5027640 1 -- 172.21.15.60:0/196202923 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21a006be30 msgr2=0x7f21a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.578+0000 7f21c5027640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21a006be30 0x7f21a006e2f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f21c0156850 tx=0x7f21b8009040 comp rx=0 tx=0).stop 2024-09-12T01:36:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.578+0000 7f21c5027640 1 -- 172.21.15.60:0/196202923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21c0073350 msgr2=0x7f21c01556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.578+0000 7f21c5027640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21c0073350 0x7f21c01556c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f21a800d7d0 tx=0x7f21a800dc90 comp rx=0 tx=0).stop 2024-09-12T01:36:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.578+0000 7f21c5027640 1 -- 172.21.15.60:0/196202923 shutdown_connections 2024-09-12T01:36:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.578+0000 7f21c5027640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21a006be30 0x7f21a006e2f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.578+0000 7f21c5027640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21c00cfb90 0x7f21c0155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.578+0000 7f21c5027640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21c0073350 0x7f21c01556c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.578+0000 7f21c5027640 1 --2- 172.21.15.60:0/196202923 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21c006f340 0x7f21c014bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.578+0000 7f21c5027640 1 -- 172.21.15.60:0/196202923 >> 172.21.15.60:0/196202923 conn(0x7f21c0062630 msgr2=0x7f21c015e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.578+0000 7f21c5027640 1 -- 172.21.15.60:0/196202923 shutdown_connections 2024-09-12T01:36:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:10.578+0000 7f21c5027640 1 -- 172.21.15.60:0/196202923 wait complete. 2024-09-12T01:36:10.991 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:35:55.984648+0000', 'modified': '2024-09-12T01:35:58.083477+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4294': {'gid': 4294, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/3695785914', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 3695785914}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 3695785914}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4294, 'qdb_cluster': [4294]} 2024-09-12T01:36:10.991 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:36:10.991 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T01:36:11.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.098+0000 7f869ce8d640 1 Processor -- start 2024-09-12T01:36:11.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.098+0000 7f869ce8d640 1 -- start start 2024-09-12T01:36:11.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f869ce8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86980b6850 0x7f86980b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f869ce8d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f86980ba440 0x7f86980b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f869ce8d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f869815ed20 con 0x7f869815e940 2024-09-12T01:36:11.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f869ce8d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f86980d3ef0 con 0x7f86980ba440 2024-09-12T01:36:11.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f869ce8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86980d32e0 con 0x7f86980b6850 2024-09-12T01:36:11.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f8696d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f86980ba440 0x7f86980b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f869659c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f869815e940 0x7f86980b6140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50228/0 (socket says 172.21.15.60:50228) 2024-09-12T01:36:11.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f8696d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f86980ba440 0x7f86980b80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49502/0 (socket says 172.21.15.60:49502) 2024-09-12T01:36:11.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f869659c640 1 -- 172.21.15.60:0/2573103836 learned_addr learned my addr 172.21.15.60:0/2573103836 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:11.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f8695d9b640 1 --2- 172.21.15.60:0/2573103836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86980b6850 0x7f86980b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f8696d9d640 1 -- 172.21.15.60:0/2573103836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86980b6850 msgr2=0x7f86980b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:11.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f8696d9d640 1 --2- 172.21.15.60:0/2573103836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86980b6850 0x7f86980b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f8696d9d640 1 -- 172.21.15.60:0/2573103836 >> v1:172.21.15.60:6789/0 conn(0x7f869815e940 legacy=0x7f86980b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f869559a640 1 -- 172.21.15.60:0/2573103836 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088464523 0 0) 0x7f869815ed20 con 0x7f869815e940 2024-09-12T01:36:11.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.099+0000 7f8696d9d640 1 -- 172.21.15.60:0/2573103836 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86980d35c0 con 0x7f86980ba440 2024-09-12T01:36:11.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.100+0000 7f8696d9d640 1 --2- 172.21.15.60:0/2573103836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86980ba440 0x7f86980b80e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8690009d90 tx=0x7f869002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=657c94b4161d8d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:11.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.100+0000 7f869559a640 1 -- 172.21.15.60:0/2573103836 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690031600 con 0x7f86980ba440 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.100+0000 7f869559a640 1 -- 172.21.15.60:0/2573103836 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86900317a0 con 0x7f86980ba440 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.100+0000 7f869559a640 1 -- 172.21.15.60:0/2573103836 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690031b70 con 0x7f86980ba440 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.101+0000 7f869ce8d640 1 -- 172.21.15.60:0/2573103836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86980ba440 msgr2=0x7f86980b80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.101+0000 7f869ce8d640 1 --2- 172.21.15.60:0/2573103836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86980ba440 0x7f86980b80e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8690009d90 tx=0x7f869002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.101+0000 7f869ce8d640 1 -- 172.21.15.60:0/2573103836 shutdown_connections 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.101+0000 7f869ce8d640 1 --2- 172.21.15.60:0/2573103836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86980ba440 0x7f86980b80e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.101+0000 7f869ce8d640 1 --2- 172.21.15.60:0/2573103836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86980b6850 0x7f86980b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.101+0000 7f869ce8d640 1 -- 172.21.15.60:0/2573103836 >> 172.21.15.60:0/2573103836 conn(0x7f86980d1140 msgr2=0x7f86980d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.101+0000 7f869ce8d640 1 -- 172.21.15.60:0/2573103836 shutdown_connections 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.101+0000 7f869ce8d640 1 -- 172.21.15.60:0/2573103836 wait complete. 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.102+0000 7f869ce8d640 1 Processor -- start 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.102+0000 7f869ce8d640 1 -- start start 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f869ce8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86980b6850 0x7f869815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f869ce8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86980ba440 0x7f86980cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f869ce8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869815e940 0x7f86980c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f869ce8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f86980b7510 con 0x7f869815e940 2024-09-12T01:36:11.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f869ce8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86980d3b80 con 0x7f86980ba440 2024-09-12T01:36:11.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f869ce8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86980d2290 con 0x7f86980b6850 2024-09-12T01:36:11.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f8696d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869815e940 0x7f86980c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f8696d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869815e940 0x7f86980c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49518/0 (socket says 172.21.15.60:49518) 2024-09-12T01:36:11.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f8696d9d640 1 -- 172.21.15.60:0/1139981599 learned_addr learned my addr 172.21.15.60:0/1139981599 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:11.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f869659c640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86980b6850 0x7f869815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f8695d9b640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86980ba440 0x7f86980cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f8696d9d640 1 -- 172.21.15.60:0/1139981599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86980b6850 msgr2=0x7f869815bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f8696d9d640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86980b6850 0x7f869815bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f8696d9d640 1 -- 172.21.15.60:0/1139981599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86980ba440 msgr2=0x7f86980cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f8696d9d640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86980ba440 0x7f86980cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.103+0000 7f8696d9d640 1 -- 172.21.15.60:0/1139981599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86980cc250 con 0x7f869815e940 2024-09-12T01:36:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.104+0000 7f8696d9d640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869815e940 0x7f86980c9cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8690009d90 tx=0x7f8690004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.104+0000 7f8686ffd640 1 -- 172.21.15.60:0/1139981599 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690040070 con 0x7f869815e940 2024-09-12T01:36:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.104+0000 7f8686ffd640 1 -- 172.21.15.60:0/1139981599 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8690030b60 con 0x7f869815e940 2024-09-12T01:36:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.104+0000 7f869ce8d640 1 -- 172.21.15.60:0/1139981599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86980cc530 con 0x7f869815e940 2024-09-12T01:36:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.104+0000 7f8686ffd640 1 -- 172.21.15.60:0/1139981599 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690009450 con 0x7f869815e940 2024-09-12T01:36:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.104+0000 7f869ce8d640 1 -- 172.21.15.60:0/1139981599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86980ccaf0 con 0x7f869815e940 2024-09-12T01:36:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.105+0000 7f8686ffd640 1 -- 172.21.15.60:0/1139981599 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8690039040 con 0x7f869815e940 2024-09-12T01:36:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.106+0000 7f8686ffd640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f867806be60 0x7f867806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.106+0000 7f8686ffd640 1 -- 172.21.15.60:0/1139981599 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f86900abf70 con 0x7f869815e940 2024-09-12T01:36:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.106+0000 7f869659c640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f867806be60 0x7f867806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.106+0000 7f869659c640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f867806be60 0x7f867806e320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8688007fd0 tx=0x7f8688007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.107+0000 7f869fc28740 1 Processor -- start 2024-09-12T01:36:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.107+0000 7f869fc28740 1 -- start start 2024-09-12T01:36:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869fc28740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565385302c0 0x556538575a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869fc28740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55653852da80 0x5565385306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869fc28740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x556538531a50 0x55653852a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869fc28740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556538492520 con 0x5565385302c0 2024-09-12T01:36:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869fc28740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55653843a3e0 con 0x55653852da80 2024-09-12T01:36:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869fc28740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55653848e4e0 con 0x556538531a50 2024-09-12T01:36:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565385302c0 0x556538575a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565385302c0 0x556538575a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49534/0 (socket says 172.21.15.60:49534) 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869659c640 1 -- 172.21.15.60:0/2206448671 learned_addr learned my addr 172.21.15.60:0/2206448671 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f8696d9d640 1 --2- 172.21.15.60:0/2206448671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x556538531a50 0x55653852a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869659c640 1 -- 172.21.15.60:0/2206448671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x556538531a50 msgr2=0x55653852a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f8695d9b640 1 --2- 172.21.15.60:0/2206448671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55653852da80 0x5565385306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869659c640 1 --2- 172.21.15.60:0/2206448671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x556538531a50 0x55653852a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869659c640 1 -- 172.21.15.60:0/2206448671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55653852da80 msgr2=0x5565385306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869659c640 1 --2- 172.21.15.60:0/2206448671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55653852da80 0x5565385306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869659c640 1 -- 172.21.15.60:0/2206448671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565384552f0 con 0x5565385302c0 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f869659c640 1 --2- 172.21.15.60:0/2206448671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565385302c0 0x556538575a60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8688001860 tx=0x7f8688013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b881e0c5cf1bce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f8677fff640 1 -- 172.21.15.60:0/2206448671 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8688026070 con 0x5565385302c0 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f8677fff640 1 -- 172.21.15.60:0/2206448671 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8688001d20 con 0x5565385302c0 2024-09-12T01:36:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.108+0000 7f8677fff640 1 -- 172.21.15.60:0/2206448671 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8688013da0 con 0x5565385302c0 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.109+0000 7f869fc28740 1 -- 172.21.15.60:0/2206448671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565385302c0 msgr2=0x556538575a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.109+0000 7f869fc28740 1 --2- 172.21.15.60:0/2206448671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565385302c0 0x556538575a60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8688001860 tx=0x7f8688013000 comp rx=0 tx=0).stop 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.109+0000 7f869fc28740 1 -- 172.21.15.60:0/2206448671 shutdown_connections 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.109+0000 7f869fc28740 1 --2- 172.21.15.60:0/2206448671 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x556538531a50 0x55653852a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.109+0000 7f869fc28740 1 --2- 172.21.15.60:0/2206448671 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55653852da80 0x5565385306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.109+0000 7f869fc28740 1 --2- 172.21.15.60:0/2206448671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5565385302c0 0x556538575a60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.109+0000 7f869fc28740 1 -- 172.21.15.60:0/2206448671 >> 172.21.15.60:0/2206448671 conn(0x55653852ca80 msgr2=0x556538574f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.109+0000 7f869fc28740 1 -- 172.21.15.60:0/2206448671 shutdown_connections 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.109+0000 7f869fc28740 1 -- 172.21.15.60:0/2206448671 wait complete. 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.110+0000 7f869fc28740 1 -- start start 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.110+0000 7f869fc28740 1 Processor -- start 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f869fc28740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5565385302c0 0x55653852b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f869fc28740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 0x55653856ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f869fc28740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55653854f6f0 0x556538556400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f869fc28740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55653852bf20 con 0x556538531a50 2024-09-12T01:36:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f869fc28740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55653841b450 con 0x55653854f6f0 2024-09-12T01:36:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f869fc28740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x556538576290 con 0x5565385302c0 2024-09-12T01:36:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f869fc28740 10 client.0 _ll_register_callbacks cb 0x5565381a4ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f8695d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 0x55653856ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f8695d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 0x55653856ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49538/0 (socket says 172.21.15.60:49538) 2024-09-12T01:36:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f8695d9b640 1 -- 172.21.15.60:0/3058287169 learned_addr learned my addr 172.21.15.60:0/3058287169 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f8696d9d640 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55653854f6f0 0x556538556400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f869659c640 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5565385302c0 0x55653852b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f8695d9b640 1 -- 172.21.15.60:0/3058287169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5565385302c0 msgr2=0x55653852b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:11.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f8695d9b640 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5565385302c0 0x55653852b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f8695d9b640 1 -- 172.21.15.60:0/3058287169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55653854f6f0 msgr2=0x556538556400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:11.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f8695d9b640 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55653854f6f0 0x556538556400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f8695d9b640 1 -- 172.21.15.60:0/3058287169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565381a52d0 con 0x556538531a50 2024-09-12T01:36:11.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f8695d9b640 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 0x55653856ecd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f869808d440 tx=0x7f868c0136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f4a0097e9f5c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:11.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f86757fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:36:11.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f86757fa640 1 -- 172.21.15.60:0/3058287169 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c01b020 con 0x556538531a50 2024-09-12T01:36:11.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f86757fa640 1 -- 172.21.15.60:0/3058287169 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f868c004240 con 0x556538531a50 2024-09-12T01:36:11.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.111+0000 7f869fc28740 1 -- 172.21.15.60:0/3058287169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55653849fc50 con 0x556538531a50 2024-09-12T01:36:11.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f86757fa640 1 -- 172.21.15.60:0/3058287169 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f868c025050 con 0x556538531a50 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f869fc28740 10 client.4635 fetch_fsmap learned FSMap version 7 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f869fc28740 1 -- 172.21.15.60:0/3058287169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55653826f6b0 con 0x556538531a50 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f86757fa640 1 -- 172.21.15.60:0/3058287169 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55653849fc50 con 0x556538531a50 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f86757fa640 1 -- 172.21.15.60:0/3058287169 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f868c028020 con 0x556538531a50 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f869fc28740 10 client.4635 fetch_fsmap finished waiting for FSMap version 7 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f869fc28740 10 client.4635 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f869fc28740 20 client.4635 populate_metadata read hostname 'smithi060' 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f869fc28740 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.105:6834/3695785914,v1:172.21.15.105:6835/3695785914] conn(0x556538588dc0 0x5565385891a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f869fc28740 4 client.4635 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f869fc28740 1 -- 172.21.15.60:0/3058287169 --> [v2:172.21.15.105:6834/3695785914,v1:172.21.15.105:6835/3695785914] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556538499fa0 con 0x556538588dc0 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f869659c640 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.105:6834/3695785914,v1:172.21.15.105:6835/3695785914] conn(0x556538588dc0 0x5565385891a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f86757fa640 10 client.4635 ms_handle_connect on v2:172.21.15.105:6834/3695785914 2024-09-12T01:36:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.112+0000 7f869659c640 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.105:6834/3695785914,v1:172.21.15.105:6835/3695785914] conn(0x556538588dc0 0x5565385891a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ed1f068b6b64f27 server_cookie=f55da17f56b8bb2d in_seq=0 out_seq=0 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.113+0000 7f86757fa640 1 -- 172.21.15.60:0/3058287169 <== mds.0 v2:172.21.15.105:6834/3695785914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556538499fa0 con 0x556538588dc0 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.113+0000 7f86757fa640 10 client.4635 handle_command_reply: tid=0 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.113+0000 7f869fc28740 1 client.4635 shutdown 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.113+0000 7f869fc28740 1 -- 172.21.15.60:0/3058287169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 msgr2=0x55653856ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.113+0000 7f869fc28740 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 0x55653856ecd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f869808d440 tx=0x7f868c0136b0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.114+0000 7f869fc28740 1 -- 172.21.15.60:0/3058287169 shutdown_connections 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.114+0000 7f869fc28740 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.105:6834/3695785914,v1:172.21.15.105:6835/3695785914] conn(0x556538588dc0 0x5565385891a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.114+0000 7f869fc28740 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55653854f6f0 0x556538556400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.114+0000 7f869fc28740 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 0x55653856ecd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.114+0000 7f869fc28740 1 --2- 172.21.15.60:0/3058287169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5565385302c0 0x55653852b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.114+0000 7f86757fa640 0 client.4635 ms_handle_reset on v2:172.21.15.105:6834/3695785914 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.114+0000 7f869fc28740 1 -- 172.21.15.60:0/3058287169 >> 172.21.15.60:0/3058287169 conn(0x55653852da80 msgr2=0x5565385745a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.114+0000 7f869fc28740 1 -- 172.21.15.60:0/3058287169 shutdown_connections 2024-09-12T01:36:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.114+0000 7f869fc28740 1 -- 172.21.15.60:0/3058287169 wait complete. 2024-09-12T01:36:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.114+0000 7f869fc28740 20 client.4635 trim_cache size 0 max 16384 2024-09-12T01:36:11.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.132+0000 7f869fc28740 1 Processor -- start 2024-09-12T01:36:11.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.132+0000 7f869fc28740 1 -- start start 2024-09-12T01:36:11.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.132+0000 7f869fc28740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5565385302c0 0x5565385753b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.132+0000 7f869fc28740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556538531a50 0x556538568350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.132+0000 7f869fc28740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55653854f6f0 0x556538550f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.132+0000 7f869fc28740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f86981ffaf0 con 0x55653854f6f0 2024-09-12T01:36:11.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.132+0000 7f869fc28740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86981f4b50 con 0x556538531a50 2024-09-12T01:36:11.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.132+0000 7f869fc28740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86981f51a0 con 0x5565385302c0 2024-09-12T01:36:11.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.132+0000 7f8696d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55653854f6f0 0x556538550f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.132+0000 7f8696d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55653854f6f0 0x556538550f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49554/0 (socket says 172.21.15.60:49554) 2024-09-12T01:36:11.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f8696d9d640 1 -- 172.21.15.60:0/536238116 learned_addr learned my addr 172.21.15.60:0/536238116 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:11.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f8696d9d640 1 -- 172.21.15.60:0/536238116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5565385302c0 msgr2=0x5565385753b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:11.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f8696d9d640 1 --2- 172.21.15.60:0/536238116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5565385302c0 0x5565385753b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f8696d9d640 1 -- 172.21.15.60:0/536238116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556538531a50 msgr2=0x556538568350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:11.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f8696d9d640 1 --2- 172.21.15.60:0/536238116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556538531a50 0x556538568350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f8696d9d640 1 -- 172.21.15.60:0/536238116 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556538556770 con 0x55653854f6f0 2024-09-12T01:36:11.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f8696d9d640 1 --2- 172.21.15.60:0/536238116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55653854f6f0 0x556538550f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f869007a060 tx=0x7f8690031f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a930f3df74f497d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:11.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f86777fe640 1 -- 172.21.15.60:0/536238116 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690092070 con 0x55653854f6f0 2024-09-12T01:36:11.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f86777fe640 1 -- 172.21.15.60:0/536238116 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8690031700 con 0x55653854f6f0 2024-09-12T01:36:11.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f86777fe640 1 -- 172.21.15.60:0/536238116 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8690092210 con 0x55653854f6f0 2024-09-12T01:36:11.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f869fc28740 1 -- 172.21.15.60:0/536238116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55653854f6f0 msgr2=0x556538550f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f869fc28740 1 --2- 172.21.15.60:0/536238116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55653854f6f0 0x556538550f20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f869007a060 tx=0x7f8690031f30 comp rx=0 tx=0).stop 2024-09-12T01:36:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f869fc28740 1 -- 172.21.15.60:0/536238116 shutdown_connections 2024-09-12T01:36:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f869fc28740 1 --2- 172.21.15.60:0/536238116 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55653854f6f0 0x556538550f20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f869fc28740 1 --2- 172.21.15.60:0/536238116 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x556538531a50 0x556538568350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.133+0000 7f869fc28740 1 --2- 172.21.15.60:0/536238116 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5565385302c0 0x5565385753b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.134+0000 7f869fc28740 1 -- 172.21.15.60:0/536238116 >> 172.21.15.60:0/536238116 conn(0x55653852da80 msgr2=0x556538525ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.134+0000 7f869fc28740 1 -- 172.21.15.60:0/536238116 shutdown_connections 2024-09-12T01:36:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.134+0000 7f869fc28740 1 -- 172.21.15.60:0/536238116 wait complete. 2024-09-12T01:36:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.134+0000 7f869fc28740 1 -- start start 2024-09-12T01:36:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.134+0000 7f869fc28740 1 Processor -- start 2024-09-12T01:36:11.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f869fc28740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5565385302c0 0x5565385f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f869fc28740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 0x556538599540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f869fc28740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55653854f6f0 0x556538599a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f869fc28740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55653856f210 con 0x556538531a50 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f869fc28740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x556538529900 con 0x5565385302c0 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f869fc28740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55653852a080 con 0x55653854f6f0 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f869fc28740 10 client.0 _ll_register_callbacks cb 0x7f868c009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f8695d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 0x556538599540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f8695d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 0x556538599540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49562/0 (socket says 172.21.15.60:49562) 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f8695d9b640 1 -- 172.21.15.60:0/1937517645 learned_addr learned my addr 172.21.15.60:0/1937517645 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f869659c640 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5565385302c0 0x5565385f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f8696d9d640 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55653854f6f0 0x556538599a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f8695d9b640 1 -- 172.21.15.60:0/1937517645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55653854f6f0 msgr2=0x556538599a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f8695d9b640 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55653854f6f0 0x556538599a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f8695d9b640 1 -- 172.21.15.60:0/1937517645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5565385302c0 msgr2=0x5565385f32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f8695d9b640 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5565385302c0 0x5565385f32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.135+0000 7f8695d9b640 1 -- 172.21.15.60:0/1937517645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653856e6c0 con 0x556538531a50 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f8695d9b640 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 0x556538599540 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f868c008010 tx=0x7f868c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696875a6ec682ba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f86757fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f86757fa640 1 -- 172.21.15.60:0/1937517645 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c01b030 con 0x556538531a50 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f86757fa640 1 -- 172.21.15.60:0/1937517645 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f868c013bb0 con 0x556538531a50 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f869fc28740 1 -- 172.21.15.60:0/1937517645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8690031700 con 0x556538531a50 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f86757fa640 1 -- 172.21.15.60:0/1937517645 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f868c038050 con 0x556538531a50 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f869fc28740 10 client.4641 fetch_fsmap learned FSMap version 7 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f869fc28740 1 -- 172.21.15.60:0/1937517645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5565385f3820 con 0x556538531a50 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f86757fa640 1 -- 172.21.15.60:0/1937517645 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8690031700 con 0x556538531a50 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f86757fa640 1 -- 172.21.15.60:0/1937517645 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f868c03b020 con 0x556538531a50 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f869fc28740 10 client.4641 fetch_fsmap finished waiting for FSMap version 7 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f869fc28740 10 client.4641 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:36:11.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f869fc28740 20 client.4641 populate_metadata read hostname 'smithi060' 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f869fc28740 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.105:6834/3695785914,v1:172.21.15.105:6835/3695785914] conn(0x556538567d60 0x55653856add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f869fc28740 4 client.4641 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f869fc28740 1 -- 172.21.15.60:0/1937517645 --> [v2:172.21.15.105:6834/3695785914,v1:172.21.15.105:6835/3695785914] -- command(tid 0: {"prefix": "status"}) -- 0x556538416b80 con 0x556538567d60 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.136+0000 7f869659c640 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.105:6834/3695785914,v1:172.21.15.105:6835/3695785914] conn(0x556538567d60 0x55653856add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f86757fa640 10 client.4641 ms_handle_connect on v2:172.21.15.105:6834/3695785914 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869659c640 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.105:6834/3695785914,v1:172.21.15.105:6835/3695785914] conn(0x556538567d60 0x55653856add0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=747fa9580090bb2e server_cookie=f45c960d83901531 in_seq=0 out_seq=0 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f86757fa640 1 -- 172.21.15.60:0/1937517645 <== mds.0 v2:172.21.15.105:6834/3695785914 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x556538416b80 con 0x556538567d60 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f86757fa640 10 client.4641 handle_command_reply: tid=0 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869fc28740 1 client.4641 shutdown 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869fc28740 1 -- 172.21.15.60:0/1937517645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 msgr2=0x556538599540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869fc28740 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 0x556538599540 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f868c008010 tx=0x7f868c004730 comp rx=0 tx=0).stop 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869fc28740 1 -- 172.21.15.60:0/1937517645 shutdown_connections 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869fc28740 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.105:6834/3695785914,v1:172.21.15.105:6835/3695785914] conn(0x556538567d60 0x55653856add0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869fc28740 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55653854f6f0 0x556538599a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869fc28740 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556538531a50 0x556538599540 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f86757fa640 0 client.4641 ms_handle_reset on v2:172.21.15.105:6834/3695785914 2024-09-12T01:36:11.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869fc28740 1 --2- 172.21.15.60:0/1937517645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5565385302c0 0x5565385f32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869fc28740 1 -- 172.21.15.60:0/1937517645 >> 172.21.15.60:0/1937517645 conn(0x55653852da80 msgr2=0x556538568570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:11.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869fc28740 1 -- 172.21.15.60:0/1937517645 shutdown_connections 2024-09-12T01:36:11.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869fc28740 1 -- 172.21.15.60:0/1937517645 wait complete. 2024-09-12T01:36:11.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.137+0000 7f869fc28740 20 client.4641 trim_cache size 0 max 16384 2024-09-12T01:36:11.144 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:36:11.144 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "5401bd8a-3492-4b21-b6c0-d6616ff39793", 2024-09-12T01:36:11.144 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T01:36:11.145 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 4294, 2024-09-12T01:36:11.145 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T01:36:11.145 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T01:36:11.145 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-12T01:36:11.145 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 14.501404407000001, 2024-09-12T01:36:11.145 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 7, 2024-09-12T01:36:11.145 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 23, 2024-09-12T01:36:11.145 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 23, 2024-09-12T01:36:11.145 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 20.523727074 2024-09-12T01:36:11.145 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:36:11.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.138+0000 7f869ce8d640 1 -- 172.21.15.60:0/1139981599 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f867806be60 msgr2=0x7f867806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.138+0000 7f869ce8d640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f867806be60 0x7f867806e320 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8688007fd0 tx=0x7f8688007de0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.138+0000 7f869ce8d640 1 -- 172.21.15.60:0/1139981599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869815e940 msgr2=0x7f86980c9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.138+0000 7f869ce8d640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869815e940 0x7f86980c9cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8690009d90 tx=0x7f8690004a40 comp rx=0 tx=0).stop 2024-09-12T01:36:11.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.138+0000 7f869ce8d640 1 -- 172.21.15.60:0/1139981599 shutdown_connections 2024-09-12T01:36:11.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.138+0000 7f869ce8d640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f869815e940 0x7f86980c9cc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.138+0000 7f869ce8d640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86980ba440 0x7f86980cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.138+0000 7f869ce8d640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f867806be60 0x7f867806e320 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.138+0000 7f869ce8d640 1 --2- 172.21.15.60:0/1139981599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86980b6850 0x7f869815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.138+0000 7f869ce8d640 1 -- 172.21.15.60:0/1139981599 >> 172.21.15.60:0/1139981599 conn(0x7f86980d1140 msgr2=0x7f86980b4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:11.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.138+0000 7f869ce8d640 1 -- 172.21.15.60:0/1139981599 shutdown_connections 2024-09-12T01:36:11.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.138+0000 7f869ce8d640 1 -- 172.21.15.60:0/1139981599 wait complete. 2024-09-12T01:36:11.149 INFO:teuthology.run_tasks:Running task sequential... 2024-09-12T01:36:11.161 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-12T01:36:11.161 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-12T01:36:11.162 INFO:teuthology.task.print:Enabling mgr modules 2024-09-12T01:36:11.162 INFO:teuthology.run_tasks:Running task kclient... 2024-09-12T01:36:11.284 INFO:tasks.kclient:Mounting kernel clients... 2024-09-12T01:36:11.285 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-12T01:36:11.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:11.285 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:36:11.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:11.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-09-12T01:36:11.370 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2024-09-12T01:36:11.371 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:36:11.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:11.372 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:36:11.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:11.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-09-12T01:36:11.494 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2024-09-12T01:36:11.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:36:11.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:11.496 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:36:11.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:11.516 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-09-12T01:36:11.589 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2024-09-12T01:36:11.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:36:11.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:11.591 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:36:11.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:11.649 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-09-12T01:36:11.718 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2024-09-12T01:36:11.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:36:11.719 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-12T01:36:11.719 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:36:11.720 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:11.720 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:36:11.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.824+0000 7fe1e610c640 1 Processor -- start 2024-09-12T01:36:11.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.824+0000 7fe1e610c640 1 -- start start 2024-09-12T01:36:11.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.825+0000 7fe1e610c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e00cd780 0x7fe1e00cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.825+0000 7fe1e610c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e00ce4f0 con 0x7fe1e00b4d00 2024-09-12T01:36:11.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.825+0000 7fe1e610c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e00ce7d0 con 0x7fe1e00b4920 2024-09-12T01:36:11.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.825+0000 7fe1e610c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e00cf100 con 0x7fe1e00cd780 2024-09-12T01:36:11.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.825+0000 7fe1deffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe1e00b4d00 0x7fe1e00b5170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50230/0 (socket says 172.21.15.60:50230) 2024-09-12T01:36:11.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.825+0000 7fe1deffd640 1 -- 172.21.15.60:0/1805609234 learned_addr learned my addr 172.21.15.60:0/1805609234 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:11.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.825+0000 7fe1dffff640 1 --2- 172.21.15.60:0/1805609234 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e00cd780 0x7fe1e00cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.825+0000 7fe1de7fc640 1 -- 172.21.15.60:0/1805609234 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838214721 0 0) 0x7fe1e00ce4f0 con 0x7fe1e00b4d00 2024-09-12T01:36:11.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.825+0000 7fe1de7fc640 1 -- 172.21.15.60:0/1805609234 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1c8005730 con 0x7fe1e00b4d00 2024-09-12T01:36:11.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.825+0000 7fe1de7fc640 1 -- 172.21.15.60:0/1805609234 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4288030868 0 0) 0x7fe1e00ce7d0 con 0x7fe1e00b4920 2024-09-12T01:36:11.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.826+0000 7fe1de7fc640 1 -- 172.21.15.60:0/1805609234 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1e00ce4f0 con 0x7fe1e00b4920 2024-09-12T01:36:11.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.826+0000 7fe1dffff640 1 -- 172.21.15.60:0/1805609234 >> v1:172.21.15.105:6789/0 conn(0x7fe1e00b4920 legacy=0x7fe1e015b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.826+0000 7fe1dffff640 1 -- 172.21.15.60:0/1805609234 >> v1:172.21.15.60:6789/0 conn(0x7fe1e00b4d00 legacy=0x7fe1e00b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.826+0000 7fe1de7fc640 1 -- 172.21.15.60:0/1805609234 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3006842418 0 0) 0x7fe1c8005730 con 0x7fe1e00b4d00 2024-09-12T01:36:11.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.826+0000 7fe1dffff640 1 -- 172.21.15.60:0/1805609234 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e00ceab0 con 0x7fe1e00cd780 2024-09-12T01:36:11.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.826+0000 7fe1dffff640 1 --2- 172.21.15.60:0/1805609234 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e00cd780 0x7fe1e00cdbd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009dc0 tx=0x7fe1d802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1fb1a1150eeef41 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:11.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.827+0000 7fe1de7fc640 1 -- 172.21.15.60:0/1805609234 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4001670 con 0x7fe1e00cd780 2024-09-12T01:36:11.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.827+0000 7fe1de7fc640 1 -- 172.21.15.60:0/1805609234 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d8007540 con 0x7fe1e00cd780 2024-09-12T01:36:11.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.827+0000 7fe1de7fc640 1 -- 172.21.15.60:0/1805609234 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8007910 con 0x7fe1e00cd780 2024-09-12T01:36:11.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.827+0000 7fe1e610c640 1 -- 172.21.15.60:0/1805609234 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e00cd780 msgr2=0x7fe1e00cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.827+0000 7fe1e610c640 1 --2- 172.21.15.60:0/1805609234 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e00cd780 0x7fe1e00cdbd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009dc0 tx=0x7fe1d802a660 comp rx=0 tx=0).stop 2024-09-12T01:36:11.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.827+0000 7fe1e610c640 1 -- 172.21.15.60:0/1805609234 shutdown_connections 2024-09-12T01:36:11.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.827+0000 7fe1e610c640 1 --2- 172.21.15.60:0/1805609234 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e00cd780 0x7fe1e00cdbd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.827+0000 7fe1e610c640 1 -- 172.21.15.60:0/1805609234 >> 172.21.15.60:0/1805609234 conn(0x7fe1e006bc10 msgr2=0x7fe1e006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:11.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.827+0000 7fe1e610c640 1 -- 172.21.15.60:0/1805609234 shutdown_connections 2024-09-12T01:36:11.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.827+0000 7fe1e610c640 1 -- 172.21.15.60:0/1805609234 wait complete. 2024-09-12T01:36:11.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.828+0000 7fe1e610c640 1 Processor -- start 2024-09-12T01:36:11.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.828+0000 7fe1e610c640 1 -- start start 2024-09-12T01:36:11.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.829+0000 7fe1e610c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e00b4920 0x7fe1e0152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.829+0000 7fe1e610c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e00b4d00 0x7fe1e0146030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.829+0000 7fe1e610c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1e00cd780 0x7fe1e015d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.829+0000 7fe1e610c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e00ce290 con 0x7fe1e00cd780 2024-09-12T01:36:11.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.829+0000 7fe1e610c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e00ce110 con 0x7fe1e00b4d00 2024-09-12T01:36:11.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.829+0000 7fe1e610c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e00cf590 con 0x7fe1e00b4920 2024-09-12T01:36:11.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.829+0000 7fe1dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1e00cd780 0x7fe1e015d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.829+0000 7fe1dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1e00cd780 0x7fe1e015d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49568/0 (socket says 172.21.15.60:49568) 2024-09-12T01:36:11.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.829+0000 7fe1dffff640 1 -- 172.21.15.60:0/1462044044 learned_addr learned my addr 172.21.15.60:0/1462044044 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:11.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.829+0000 7fe1deffd640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e00b4d00 0x7fe1e0146030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.829+0000 7fe1df7fe640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e00b4920 0x7fe1e0152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.830+0000 7fe1dffff640 1 -- 172.21.15.60:0/1462044044 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e00b4920 msgr2=0x7fe1e0152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.830+0000 7fe1dffff640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e00b4920 0x7fe1e0152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.830+0000 7fe1dffff640 1 -- 172.21.15.60:0/1462044044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e00b4d00 msgr2=0x7fe1e0146030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.830+0000 7fe1dffff640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e00b4d00 0x7fe1e0146030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.830+0000 7fe1dffff640 1 -- 172.21.15.60:0/1462044044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e0146570 con 0x7fe1e00cd780 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.830+0000 7fe1dffff640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1e00cd780 0x7fe1e015d450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009ee0 tx=0x7fe1d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.830+0000 7fe1c7fff640 1 -- 172.21.15.60:0/1462044044 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d803f070 con 0x7fe1e00cd780 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.830+0000 7fe1c7fff640 1 -- 172.21.15.60:0/1462044044 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d803b820 con 0x7fe1e00cd780 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.830+0000 7fe1e610c640 1 -- 172.21.15.60:0/1462044044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e0153550 con 0x7fe1e00cd780 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.830+0000 7fe1c7fff640 1 -- 172.21.15.60:0/1462044044 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d803bbd0 con 0x7fe1e00cd780 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.830+0000 7fe1e610c640 1 -- 172.21.15.60:0/1462044044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e0151990 con 0x7fe1e00cd780 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.831+0000 7fe1e610c640 1 -- 172.21.15.60:0/1462044044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e00cdbd0 con 0x7fe1e00cd780 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.831+0000 7fe1c7fff640 1 -- 172.21.15.60:0/1462044044 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe1d8031400 con 0x7fe1e00cd780 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.832+0000 7fe1c7fff640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe1cc06be30 0x7fe1cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:11.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.832+0000 7fe1c7fff640 1 -- 172.21.15.60:0/1462044044 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe1d80ac300 con 0x7fe1e00cd780 2024-09-12T01:36:11.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.832+0000 7fe1df7fe640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe1cc06be30 0x7fe1cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:11.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.832+0000 7fe1df7fe640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe1cc06be30 0x7fe1cc06e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00011e0 tx=0x7fe1d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:11.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:11.836+0000 7fe1c7fff640 1 -- 172.21.15.60:0/1462044044 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe1e0146570 con 0x7fe1e00cd780 2024-09-12T01:36:12.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.046+0000 7fe1e610c640 1 -- 172.21.15.60:0/1462044044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe1e0153830 con 0x7fe1e00cd780 2024-09-12T01:36:12.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.046+0000 7fe1c7fff640 1 -- 172.21.15.60:0/1462044044 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fe1d807a660 con 0x7fe1e00cd780 2024-09-12T01:36:12.046 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:36:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.048+0000 7fe1e610c640 1 -- 172.21.15.60:0/1462044044 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe1cc06be30 msgr2=0x7fe1cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.048+0000 7fe1e610c640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe1cc06be30 0x7fe1cc06e2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe1d00011e0 tx=0x7fe1d0009040 comp rx=0 tx=0).stop 2024-09-12T01:36:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.048+0000 7fe1e610c640 1 -- 172.21.15.60:0/1462044044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1e00cd780 msgr2=0x7fe1e015d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.048+0000 7fe1e610c640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1e00cd780 0x7fe1e015d450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009ee0 tx=0x7fe1d8004a40 comp rx=0 tx=0).stop 2024-09-12T01:36:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.048+0000 7fe1e610c640 1 -- 172.21.15.60:0/1462044044 shutdown_connections 2024-09-12T01:36:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.048+0000 7fe1e610c640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1e00cd780 0x7fe1e015d450 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.048+0000 7fe1e610c640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1e00b4d00 0x7fe1e0146030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:12.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.048+0000 7fe1e610c640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe1cc06be30 0x7fe1cc06e2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:12.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.048+0000 7fe1e610c640 1 --2- 172.21.15.60:0/1462044044 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1e00b4920 0x7fe1e0152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:12.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.048+0000 7fe1e610c640 1 -- 172.21.15.60:0/1462044044 >> 172.21.15.60:0/1462044044 conn(0x7fe1e006bc10 msgr2=0x7fe1e0072700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:12.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.048+0000 7fe1e610c640 1 -- 172.21.15.60:0/1462044044 shutdown_connections 2024-09-12T01:36:12.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12.048+0000 7fe1e610c640 1 -- 172.21.15.60:0/1462044044 wait complete. 2024-09-12T01:36:12.058 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:36:12.058 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:36:12.059 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T01:36:12.059 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:36:12.059 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:12.059 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:36:12.059 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:36:12.059 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:36:12.059 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:36:12.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:12.059 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T01:36:12.075 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:36:12.075 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:36:12.075 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T01:36:12.076 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:36:12.077 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42748sec preferred_lft 42748sec 2024-09-12T01:36:12.077 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T01:36:12.077 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:12.077 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:12.077 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:12.077 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T01:36:12.077 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T01:36:12.077 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:12.078 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:36:12.078 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add name ceph-brx type bridge 2024-09-12T01:36:12.078 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr flush dev ceph-brx 2024-09-12T01:36:12.078 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set ceph-brx up 2024-09-12T01:36:12.078 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T01:36:12.078 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:36:12.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:12.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:12.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:12.277 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:36:12.303 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T01:36:12.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:12.305 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T01:36:12.382 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T01:36:12.382 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:36:12.382 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:36:12.382 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:36:12.383 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:36:12.383 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:12.384 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:36:12.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:36:12.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:36:12.384 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:36:12.385 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:36:12.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:12.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:12.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:12.697 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:36:12.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:12.714 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2024-09-12T01:36:12.771 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:12.771 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:36:12.771 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:36:12.771 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-12T01:36:12.771 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:36:12.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:12.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:12.892 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-12T01:36:12.892 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:12.892 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:36:12.892 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-12T01:36:12.893 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T01:36:12.893 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-12T01:36:12.893 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-12T01:36:12.893 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-12T01:36:12.893 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:36:12.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:13.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:13.051 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:13.051 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:36:13.051 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-12T01:36:13.051 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T01:36:13.052 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:36:13.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:13.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:13.132 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:36:13.132 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:13.149 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:36:13.149 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:36:13.149 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:13.204 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T01:36:13.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:13.205 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:13.298 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:13.298 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:36:13.441 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:36:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:36:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:36:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:36:13.442 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:36:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:36:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:36:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:36:13.443 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:36:13.444 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:36:13.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:13.445 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:13.471 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:13.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:13.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:13.574 INFO:teuthology.orchestra.run.smithi060.stdout:client34409 2024-09-12T01:36:13.574 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:13.574 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:13.590 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:13.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:13.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:13.694 INFO:teuthology.orchestra.run.smithi060.stdout:client34409 2024-09-12T01:36:13.694 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:13.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:13.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:13.757 INFO:teuthology.orchestra.run.smithi060.stdout:client34409 2024-09-12T01:36:13.758 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5401bd8a-3492-4b21-b6c0-d6616ff39793.client34409/status') 2024-09-12T01:36:13.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:instance: client.34409 (3)172.21.15.60:0/3299399202 2024-09-12T01:36:13.824 INFO:teuthology.orchestra.run.smithi060.stdout:blocklisted: false 2024-09-12T01:36:13.825 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2024-09-12T01:36:13.825 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2024-09-12T01:36:13.825 INFO:teuthology.orchestra.run.smithi060.stderr:71 bytes copied, 2.3704e-05 s, 3.0 MB/s 2024-09-12T01:36:13.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:13.832 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-12T01:36:13.832 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:36:13.832 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T01:36:13.832 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:36:13.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.935+0000 7fd9c55a2640 1 Processor -- start 2024-09-12T01:36:13.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.935+0000 7fd9c55a2640 1 -- start start 2024-09-12T01:36:13.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.936+0000 7fd9c55a2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9c00b30e0 0x7fd9c00b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:13.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.936+0000 7fd9c55a2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd9c00cf630 0x7fd9c00cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:13.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.936+0000 7fd9c55a2640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9c00b2690 con 0x7fd9c00b1d70 2024-09-12T01:36:13.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.936+0000 7fd9c55a2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd9c00cdbc0 con 0x7fd9c00cf630 2024-09-12T01:36:13.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.936+0000 7fd9c55a2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c00cf1a0 con 0x7fd9c00b30e0 2024-09-12T01:36:13.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.937+0000 7fd9c4da1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd9c00cf630 0x7fd9c00cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:13.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.937+0000 7fd9c4da1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd9c00cf630 0x7fd9c00cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52004/0 (socket says 172.21.15.60:52004) 2024-09-12T01:36:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.937+0000 7fd9c4da1640 1 -- 172.21.15.60:0/1129455084 learned_addr learned my addr 172.21.15.60:0/1129455084 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.937+0000 7fd9bf7fe640 1 --2- 172.21.15.60:0/1129455084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9c00b30e0 0x7fd9c00b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.937+0000 7fd9c4da1640 1 -- 172.21.15.60:0/1129455084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9c00b30e0 msgr2=0x7fd9c00b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.937+0000 7fd9c4da1640 1 --2- 172.21.15.60:0/1129455084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9c00b30e0 0x7fd9c00b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.937+0000 7fd9c4da1640 1 -- 172.21.15.60:0/1129455084 >> v1:172.21.15.105:6789/0 conn(0x7fd9c00b1d70 legacy=0x7fd9c00b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:13.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.937+0000 7fd9c4da1640 1 -- 172.21.15.60:0/1129455084 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c00b4010 con 0x7fd9c00cf630 2024-09-12T01:36:13.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.938+0000 7fd9c4da1640 1 --2- 172.21.15.60:0/1129455084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c00cf630 0x7fd9c00cfae0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009e50 tx=0x7fd9b802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72205a3e8b89cee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:13.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.938+0000 7fd9beffd640 1 -- 172.21.15.60:0/1129455084 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8036070 con 0x7fd9c00cf630 2024-09-12T01:36:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.938+0000 7fd9beffd640 1 -- 172.21.15.60:0/1129455084 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b8031600 con 0x7fd9c00cf630 2024-09-12T01:36:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.938+0000 7fd9beffd640 1 -- 172.21.15.60:0/1129455084 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80319d0 con 0x7fd9c00cf630 2024-09-12T01:36:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.938+0000 7fd9c55a2640 1 -- 172.21.15.60:0/1129455084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c00cf630 msgr2=0x7fd9c00cfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.938+0000 7fd9c55a2640 1 --2- 172.21.15.60:0/1129455084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c00cf630 0x7fd9c00cfae0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009e50 tx=0x7fd9b802a710 comp rx=0 tx=0).stop 2024-09-12T01:36:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.939+0000 7fd9c55a2640 1 -- 172.21.15.60:0/1129455084 shutdown_connections 2024-09-12T01:36:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.939+0000 7fd9c55a2640 1 --2- 172.21.15.60:0/1129455084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c00cf630 0x7fd9c00cfae0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.939+0000 7fd9c55a2640 1 --2- 172.21.15.60:0/1129455084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9c00b30e0 0x7fd9c00b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.939+0000 7fd9c55a2640 1 -- 172.21.15.60:0/1129455084 >> 172.21.15.60:0/1129455084 conn(0x7fd9c0062a20 msgr2=0x7fd9c006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.939+0000 7fd9c55a2640 1 -- 172.21.15.60:0/1129455084 shutdown_connections 2024-09-12T01:36:13.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.939+0000 7fd9c55a2640 1 -- 172.21.15.60:0/1129455084 wait complete. 2024-09-12T01:36:13.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.940+0000 7fd9c55a2640 1 Processor -- start 2024-09-12T01:36:13.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.940+0000 7fd9c55a2640 1 -- start start 2024-09-12T01:36:13.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c55a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9c00b1d70 0x7fd9c01fafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c55a2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9c00b30e0 0x7fd9c01f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c55a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c00cf630 0x7fd9c015c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c55a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c00b48b0 con 0x7fd9c00cf630 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c55a2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9c00b45d0 con 0x7fd9c00b1d70 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c55a2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9c00739f0 con 0x7fd9c00b30e0 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c4da1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c00cf630 0x7fd9c015c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c4da1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c00cf630 0x7fd9c015c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52020/0 (socket says 172.21.15.60:52020) 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c4da1640 1 -- 172.21.15.60:0/154970609 learned_addr learned my addr 172.21.15.60:0/154970609 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9bf7fe640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9c00b30e0 0x7fd9c01f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9bffff640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9c00b1d70 0x7fd9c01fafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c4da1640 1 -- 172.21.15.60:0/154970609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9c00b30e0 msgr2=0x7fd9c01f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c4da1640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9c00b30e0 0x7fd9c01f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:13.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c4da1640 1 -- 172.21.15.60:0/154970609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9c00b1d70 msgr2=0x7fd9c01fafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c4da1640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9c00b1d70 0x7fd9c01fafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c4da1640 1 -- 172.21.15.60:0/154970609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9c0165ba0 con 0x7fd9c00cf630 2024-09-12T01:36:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.941+0000 7fd9c4da1640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c00cf630 0x7fd9c015c6b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8034040 tx=0x7fd9b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.942+0000 7fd9bcff9640 1 -- 172.21.15.60:0/154970609 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8041020 con 0x7fd9c00cf630 2024-09-12T01:36:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.942+0000 7fd9bcff9640 1 -- 172.21.15.60:0/154970609 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9b80077a0 con 0x7fd9c00cf630 2024-09-12T01:36:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.942+0000 7fd9c55a2640 1 -- 172.21.15.60:0/154970609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9c0162cf0 con 0x7fd9c00cf630 2024-09-12T01:36:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.942+0000 7fd9bcff9640 1 -- 172.21.15.60:0/154970609 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8036040 con 0x7fd9c00cf630 2024-09-12T01:36:13.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.942+0000 7fd9c55a2640 1 -- 172.21.15.60:0/154970609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9c01632b0 con 0x7fd9c00cf630 2024-09-12T01:36:13.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.943+0000 7fd9c55a2640 1 -- 172.21.15.60:0/154970609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9c00b2150 con 0x7fd9c00cf630 2024-09-12T01:36:13.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.943+0000 7fd9bcff9640 1 -- 172.21.15.60:0/154970609 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd9b8044020 con 0x7fd9c00cf630 2024-09-12T01:36:13.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.944+0000 7fd9bcff9640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd9ac06be30 0x7fd9ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:13.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.944+0000 7fd9bcff9640 1 -- 172.21.15.60:0/154970609 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd9b80ab8f0 con 0x7fd9c00cf630 2024-09-12T01:36:13.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.944+0000 7fd9bffff640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd9ac06be30 0x7fd9ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:13.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.944+0000 7fd9bffff640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd9ac06be30 0x7fd9ac06e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd9c01655c0 tx=0x7fd9b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:13.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:13.948+0000 7fd9bcff9640 1 -- 172.21.15.60:0/154970609 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd9b804b030 con 0x7fd9c00cf630 2024-09-12T01:36:14.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.158+0000 7fd9c55a2640 1 -- 172.21.15.60:0/154970609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd9c01fb510 con 0x7fd9c00cf630 2024-09-12T01:36:14.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.158+0000 7fd9bcff9640 1 -- 172.21.15.60:0/154970609 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fd9b8079ce0 con 0x7fd9c00cf630 2024-09-12T01:36:14.157 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:36:14.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.160+0000 7fd9c55a2640 1 -- 172.21.15.60:0/154970609 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd9ac06be30 msgr2=0x7fd9ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:14.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.160+0000 7fd9c55a2640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd9ac06be30 0x7fd9ac06e2f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd9c01655c0 tx=0x7fd9b4009040 comp rx=0 tx=0).stop 2024-09-12T01:36:14.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.160+0000 7fd9c55a2640 1 -- 172.21.15.60:0/154970609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c00cf630 msgr2=0x7fd9c015c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:14.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.160+0000 7fd9c55a2640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c00cf630 0x7fd9c015c6b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8034040 tx=0x7fd9b8004a40 comp rx=0 tx=0).stop 2024-09-12T01:36:14.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.160+0000 7fd9c55a2640 1 -- 172.21.15.60:0/154970609 shutdown_connections 2024-09-12T01:36:14.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.160+0000 7fd9c55a2640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9c00cf630 0x7fd9c015c6b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:14.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.160+0000 7fd9c55a2640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd9ac06be30 0x7fd9ac06e2f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:14.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.160+0000 7fd9c55a2640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9c00b30e0 0x7fd9c01f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:14.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.160+0000 7fd9c55a2640 1 --2- 172.21.15.60:0/154970609 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd9c00b1d70 0x7fd9c01fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:14.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.160+0000 7fd9c55a2640 1 -- 172.21.15.60:0/154970609 >> 172.21.15.60:0/154970609 conn(0x7fd9c0062a20 msgr2=0x7fd9c00b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:14.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.160+0000 7fd9c55a2640 1 -- 172.21.15.60:0/154970609 shutdown_connections 2024-09-12T01:36:14.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14.160+0000 7fd9c55a2640 1 -- 172.21.15.60:0/154970609 wait complete. 2024-09-12T01:36:14.170 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:36:14.170 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:36:14.170 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T01:36:14.170 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-12T01:36:14.170 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-12T01:36:14.171 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:36:14.171 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:36:14.171 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:36:14.171 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-12T01:36:14.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:14.171 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T01:36:14.188 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:36:14.188 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:36:14.188 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:36:14.188 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.188 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:36:14.188 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.188 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:14.188 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:14.188 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T01:36:14.188 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:14.189 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:14.189 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T01:36:14.189 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:36:14.189 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:14.189 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T01:36:14.189 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:36:14.189 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42746sec preferred_lft 42746sec 2024-09-12T01:36:14.189 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T01:36:14.189 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.189 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:14.189 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:14.189 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T01:36:14.190 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:36:14.190 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 72:47:53:4d:4f:c7 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:14.190 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:36:14.190 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.190 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e8cb:28ff:fea3:34fb/64 scope link 2024-09-12T01:36:14.190 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.190 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:36:14.190 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 72:47:53:4d:4f:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:36:14.190 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7047:53ff:fe4d:4fc7/64 scope link tentative 2024-09-12T01:36:14.190 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:14.191 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:36:14.252 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T01:36:14.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:14.254 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T01:36:14.311 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T01:36:14.311 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:36:14.311 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:36:14.311 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:36:14.312 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:36:14.312 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:14.312 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:36:14.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:36:14.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:36:14.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:36:14.312 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:36:14.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:14.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:14.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:14.440 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:36:14.456 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:36:14.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:14.457 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list-id 2024-09-12T01:36:14.513 INFO:teuthology.orchestra.run.smithi060.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-12T01:36:14.514 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:14.514 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:36:14.514 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:36:14.514 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-12T01:36:14.514 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:36:14.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:14.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:14.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:14.633 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T01:36:14.658 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:36:14.658 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:36:14.658 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:36:14.658 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.659 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:36:14.659 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.659 INFO:teuthology.orchestra.run.smithi060.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:36:14.659 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 62:b7:98:cb:79:df brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T01:36:14.659 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T01:36:14.659 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.659 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::60b7:98ff:fecb:79df/64 scope link 2024-09-12T01:36:14.659 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:14.660 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-12T01:36:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:36:14.726 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:36:14.726 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:36:14.726 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.726 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:36:14.726 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.726 INFO:teuthology.orchestra.run.smithi060.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:36:14.726 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 62:b7:98:cb:79:df brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T01:36:14.726 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T01:36:14.726 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.727 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::60b7:98ff:fecb:79df/64 scope link 2024-09-12T01:36:14.727 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:14.728 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-12T01:36:14.728 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:14.728 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:36:14.728 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-12T01:36:14.728 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T01:36:14.728 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-12T01:36:14.728 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-12T01:36:14.728 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-12T01:36:14.728 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:36:14.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:14.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:14.885 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:14.886 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:36:14.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.1 up 2024-09-12T01:36:14.886 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T01:36:14.886 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:36:14.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:14.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:14.965 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:36:14.965 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-12T01:36:14.981 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-12T01:36:14.981 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:36:14.981 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-12T01:36:15.037 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-12T01:36:15.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:15.038 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:15.123 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:15.123 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:36:15.134 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:15.135 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:36:15.135 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:36:15.135 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 2@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:36:15.135 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:36:15.135 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-12T01:36:15.135 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:36:15.135 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:36:15.135 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:36:15.136 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:36:15.140 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:36:15.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:15.140 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-12T01:36:15.166 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:15.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:15.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:15.264 INFO:teuthology.orchestra.run.smithi060.stdout:client4606 2024-09-12T01:36:15.264 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:15.264 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:15.281 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:15.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:15.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:15.378 INFO:teuthology.orchestra.run.smithi060.stdout:client4606 2024-09-12T01:36:15.378 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:15.435 INFO:teuthology.orchestra.run.smithi060.stdout:client4606 2024-09-12T01:36:15.435 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5401bd8a-3492-4b21-b6c0-d6616ff39793.client4606/status') 2024-09-12T01:36:15.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:15.496 INFO:teuthology.orchestra.run.smithi060.stdout:instance: client.4606 (3)172.21.15.60:0/320373222 2024-09-12T01:36:15.497 INFO:teuthology.orchestra.run.smithi060.stdout:blocklisted: false 2024-09-12T01:36:15.497 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2024-09-12T01:36:15.497 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2024-09-12T01:36:15.497 INFO:teuthology.orchestra.run.smithi060.stderr:69 bytes copied, 2.324e-05 s, 3.0 MB/s 2024-09-12T01:36:15.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:15.502 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-12T01:36:15.502 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:36:15.503 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:36:15.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:36:15.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.605+0000 7fa5abfe8640 1 Processor -- start 2024-09-12T01:36:15.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.606+0000 7fa5abfe8640 1 -- start start 2024-09-12T01:36:15.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.606+0000 7fa5abfe8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa5a415e660 0x7fa5a40cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:15.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.606+0000 7fa5abfe8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa5a40d3310 0x7fa5a40d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:15.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.606+0000 7fa5abfe8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a415ea40 con 0x7fa5a40d1650 2024-09-12T01:36:15.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.606+0000 7fa5abfe8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a40d1ac0 con 0x7fa5a415e660 2024-09-12T01:36:15.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.606+0000 7fa5abfe8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a40d3870 con 0x7fa5a40d3310 2024-09-12T01:36:15.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.606+0000 7fa5a9d84640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa5a415e660 0x7fa5a40cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:15.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.606+0000 7fa5a9d84640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa5a415e660 0x7fa5a40cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52030/0 (socket says 172.21.15.60:52030) 2024-09-12T01:36:15.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.606+0000 7fa5a9d84640 1 -- 172.21.15.60:0/3973026433 learned_addr learned my addr 172.21.15.60:0/3973026433 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:15.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.607+0000 7fa5a9583640 1 --2- 172.21.15.60:0/3973026433 >> v2:172.21.15.105:3300/0 conn(0x7fa5a40d3310 0x7fa5a40d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:15.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.607+0000 7fa5a9d84640 1 -- 172.21.15.60:0/3973026433 >> v2:172.21.15.105:3300/0 conn(0x7fa5a40d3310 msgr2=0x7fa5a40d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:15.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.607+0000 7fa5a9d84640 1 --2- 172.21.15.60:0/3973026433 >> v2:172.21.15.105:3300/0 conn(0x7fa5a40d3310 0x7fa5a40d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:15.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.607+0000 7fa5a9d84640 1 -- 172.21.15.60:0/3973026433 >> v1:172.21.15.105:6789/0 conn(0x7fa5a40d1650 legacy=0x7fa5a406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:15.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.607+0000 7fa5a9d84640 1 -- 172.21.15.60:0/3973026433 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a40d3b50 con 0x7fa5a415e660 2024-09-12T01:36:15.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.607+0000 7fa5a9583640 1 --2- 172.21.15.60:0/3973026433 >> v2:172.21.15.105:3300/0 conn(0x7fa5a40d3310 0x7fa5a40d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.607+0000 7fa5a9d84640 1 --2- 172.21.15.60:0/3973026433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a415e660 0x7fa5a40cf730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40c8020 tx=0x7fa5a002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a193265381288190 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.608+0000 7fa5a8d82640 1 -- 172.21.15.60:0/3973026433 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0037070 con 0x7fa5a415e660 2024-09-12T01:36:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.608+0000 7fa5a8d82640 1 -- 172.21.15.60:0/3973026433 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a0032440 con 0x7fa5a415e660 2024-09-12T01:36:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.608+0000 7fa5a8d82640 1 -- 172.21.15.60:0/3973026433 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0032810 con 0x7fa5a415e660 2024-09-12T01:36:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.608+0000 7fa5abfe8640 1 -- 172.21.15.60:0/3973026433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a415e660 msgr2=0x7fa5a40cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.608+0000 7fa5abfe8640 1 --2- 172.21.15.60:0/3973026433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a415e660 0x7fa5a40cf730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40c8020 tx=0x7fa5a002a230 comp rx=0 tx=0).stop 2024-09-12T01:36:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.608+0000 7fa5abfe8640 1 -- 172.21.15.60:0/3973026433 shutdown_connections 2024-09-12T01:36:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.608+0000 7fa5abfe8640 1 --2- 172.21.15.60:0/3973026433 >> v2:172.21.15.105:3300/0 conn(0x7fa5a40d3310 0x7fa5a40d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.608+0000 7fa5abfe8640 1 --2- 172.21.15.60:0/3973026433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a415e660 0x7fa5a40cf730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.608+0000 7fa5abfe8640 1 -- 172.21.15.60:0/3973026433 >> 172.21.15.60:0/3973026433 conn(0x7fa5a40b6410 msgr2=0x7fa5a40b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:15.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.608+0000 7fa5abfe8640 1 -- 172.21.15.60:0/3973026433 shutdown_connections 2024-09-12T01:36:15.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.608+0000 7fa5abfe8640 1 -- 172.21.15.60:0/3973026433 wait complete. 2024-09-12T01:36:15.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.609+0000 7fa5abfe8640 1 Processor -- start 2024-09-12T01:36:15.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.610+0000 7fa5abfe8640 1 -- start start 2024-09-12T01:36:15.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.610+0000 7fa5abfe8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a40d1650 0x7fa5a415ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:15.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.610+0000 7fa5abfe8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a40d3310 0x7fa5a415cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:15.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.610+0000 7fa5abfe8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a415e660 0x7fa5a41600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:15.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.610+0000 7fa5abfe8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a40d43f0 con 0x7fa5a40d1650 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.610+0000 7fa5abfe8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a40d4110 con 0x7fa5a40d3310 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.610+0000 7fa5abfe8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a40cfc70 con 0x7fa5a415e660 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.610+0000 7fa5a9d84640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a40d1650 0x7fa5a415ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.610+0000 7fa5a9d84640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a40d1650 0x7fa5a415ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52044/0 (socket says 172.21.15.60:52044) 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.610+0000 7fa5a9d84640 1 -- 172.21.15.60:0/4190827258 learned_addr learned my addr 172.21.15.60:0/4190827258 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa5aa585640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a415e660 0x7fa5a41600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa5a9583640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a40d3310 0x7fa5a415cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa5a9d84640 1 -- 172.21.15.60:0/4190827258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a415e660 msgr2=0x7fa5a41600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa5a9d84640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a415e660 0x7fa5a41600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa5a9d84640 1 -- 172.21.15.60:0/4190827258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a40d3310 msgr2=0x7fa5a415cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa5a9d84640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a40d3310 0x7fa5a415cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa5a9d84640 1 -- 172.21.15.60:0/4190827258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a40c8230 con 0x7fa5a40d1650 2024-09-12T01:36:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa5aa585640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a415e660 0x7fa5a41600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa5a9d84640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a40d1650 0x7fa5a415ca40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa5a002a270 tx=0x7fa5a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa59a7fc640 1 -- 172.21.15.60:0/4190827258 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0037040 con 0x7fa5a40d1650 2024-09-12T01:36:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa59a7fc640 1 -- 172.21.15.60:0/4190827258 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a0042070 con 0x7fa5a40d1650 2024-09-12T01:36:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa5abfe8640 1 -- 172.21.15.60:0/4190827258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a40c8510 con 0x7fa5a40d1650 2024-09-12T01:36:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa59a7fc640 1 -- 172.21.15.60:0/4190827258 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0030bb0 con 0x7fa5a40d1650 2024-09-12T01:36:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.611+0000 7fa5abfe8640 1 -- 172.21.15.60:0/4190827258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a40c8ad0 con 0x7fa5a40d1650 2024-09-12T01:36:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.612+0000 7fa5abfe8640 1 -- 172.21.15.60:0/4190827258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a40d1110 con 0x7fa5a40d1650 2024-09-12T01:36:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.613+0000 7fa59a7fc640 1 -- 172.21.15.60:0/4190827258 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa5a0047460 con 0x7fa5a40d1650 2024-09-12T01:36:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.613+0000 7fa59a7fc640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa58806be60 0x7fa58806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.613+0000 7fa59a7fc640 1 -- 172.21.15.60:0/4190827258 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa5a00ab9d0 con 0x7fa5a40d1650 2024-09-12T01:36:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.613+0000 7fa5a9583640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa58806be60 0x7fa58806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:15.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.614+0000 7fa5a9583640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa58806be60 0x7fa58806e320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40b9fa0 tx=0x7fa594008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:15.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.617+0000 7fa59a7fc640 1 -- 172.21.15.60:0/4190827258 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa5a007a380 con 0x7fa5a40d1650 2024-09-12T01:36:15.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.827+0000 7fa5abfe8640 1 -- 172.21.15.60:0/4190827258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa5a40d1110 con 0x7fa5a40d1650 2024-09-12T01:36:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.827+0000 7fa59a7fc640 1 -- 172.21.15.60:0/4190827258 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fa5a0079c80 con 0x7fa5a40d1650 2024-09-12T01:36:15.827 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:36:15.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.829+0000 7fa5abfe8640 1 -- 172.21.15.60:0/4190827258 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa58806be60 msgr2=0x7fa58806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.829+0000 7fa5abfe8640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa58806be60 0x7fa58806e320 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40b9fa0 tx=0x7fa594008040 comp rx=0 tx=0).stop 2024-09-12T01:36:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.829+0000 7fa5abfe8640 1 -- 172.21.15.60:0/4190827258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a40d1650 msgr2=0x7fa5a415ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.829+0000 7fa5abfe8640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a40d1650 0x7fa5a415ca40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa5a002a270 tx=0x7fa5a00046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.829+0000 7fa5abfe8640 1 -- 172.21.15.60:0/4190827258 shutdown_connections 2024-09-12T01:36:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.829+0000 7fa5abfe8640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa58806be60 0x7fa58806e320 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.829+0000 7fa5abfe8640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5a415e660 0x7fa5a41600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.829+0000 7fa5abfe8640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5a40d3310 0x7fa5a415cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.829+0000 7fa5abfe8640 1 --2- 172.21.15.60:0/4190827258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a40d1650 0x7fa5a415ca40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.829+0000 7fa5abfe8640 1 -- 172.21.15.60:0/4190827258 >> 172.21.15.60:0/4190827258 conn(0x7fa5a40b6410 msgr2=0x7fa5a40b9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.830+0000 7fa5abfe8640 1 -- 172.21.15.60:0/4190827258 shutdown_connections 2024-09-12T01:36:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:15.830+0000 7fa5abfe8640 1 -- 172.21.15.60:0/4190827258 wait complete. 2024-09-12T01:36:15.839 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:36:15.840 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:36:15.840 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T01:36:15.840 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:36:15.840 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:36:15.840 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:36:15.840 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:36:15.840 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:36:15.840 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:36:15.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:15.841 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T01:36:15.859 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:36:15.859 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:36:15.859 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:36:15.860 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:15.860 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:36:15.860 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:15.860 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:15.860 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:15.860 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T01:36:15.861 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:15.861 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:15.861 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T01:36:15.861 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:15.861 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:15.861 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:36:15.862 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:15.862 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:36:15.862 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-09-12T01:36:15.862 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T01:36:15.862 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:15.862 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-12T01:36:15.862 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:15.862 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:36:15.862 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add name ceph-brx type bridge 2024-09-12T01:36:15.863 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip addr flush dev ceph-brx 2024-09-12T01:36:15.863 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set ceph-brx up 2024-09-12T01:36:15.863 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-12T01:36:15.863 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:36:15.953 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:16.133 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:16.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:16.140 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:36:16.165 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:36:16.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:16.167 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T01:36:16.243 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T01:36:16.243 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:36:16.243 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:36:16.243 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:36:16.243 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:36:16.244 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:16.244 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:36:16.244 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:36:16.244 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:36:16.244 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:36:16.244 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:36:16.331 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:16.522 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:16.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:16.528 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:36:16.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:16.544 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list-id 2024-09-12T01:36:16.600 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:16.600 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:36:16.600 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:36:16.600 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-12T01:36:16.600 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:36:16.691 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:16.716 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:16.722 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-12T01:36:16.723 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:16.723 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:36:16.723 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-12T01:36:16.723 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-12T01:36:16.723 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-12T01:36:16.723 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-12T01:36:16.723 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-12T01:36:16.723 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:36:16.771 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:16.846 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:16.852 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:16.852 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:36:16.853 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-12T01:36:16.853 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set dev brx.0 master ceph-brx 2024-09-12T01:36:16.853 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:36:16.902 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:16.925 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:16.931 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:36:16.931 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:36:16.946 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:36:16.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:36:16.946 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:36:17.002 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T01:36:17.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:17.002 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:17.094 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:17.095 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:36:17.218 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:17.218 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:36:17.218 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:36:17.218 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 1@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:36:17.218 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:36:17.219 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:36:17.219 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:36:17.219 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:36:17.219 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:36:17.220 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:36:17.221 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:36:17.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:17.221 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:36:17.246 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:17.335 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:17.336 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:17.342 INFO:teuthology.orchestra.run.smithi105.stdout:client34421 2024-09-12T01:36:17.343 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:36:17.343 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:17.359 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:17.448 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:17.449 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:17.455 INFO:teuthology.orchestra.run.smithi105.stdout:client34421 2024-09-12T01:36:17.456 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:17.465 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:36:17.468 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:36:17.503 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:17.504 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:17.510 INFO:teuthology.orchestra.run.smithi105.stdout:client34421 2024-09-12T01:36:17.511 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5401bd8a-3492-4b21-b6c0-d6616ff39793.client34421/status') 2024-09-12T01:36:17.600 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:17.610 INFO:teuthology.orchestra.run.smithi105.stdout:instance: client.34421 (3)192.168.0.1:0/2599450356 2024-09-12T01:36:17.610 INFO:teuthology.orchestra.run.smithi105.stdout:blocklisted: false 2024-09-12T01:36:17.610 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2024-09-12T01:36:17.610 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2024-09-12T01:36:17.610 INFO:teuthology.orchestra.run.smithi105.stderr:70 bytes copied, 2.2361e-05 s, 3.1 MB/s 2024-09-12T01:36:17.611 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:17.618 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-12T01:36:17.618 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-12T01:36:17.618 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T01:36:17.618 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:36:17.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.732+0000 7fbf9def1640 1 Processor -- start 2024-09-12T01:36:17.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.732+0000 7fbf9def1640 1 -- start start 2024-09-12T01:36:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.733+0000 7fbf9def1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf980b63d0 0x7fbf980d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.733+0000 7fbf9def1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf980d1c80 0x7fbf980b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.733+0000 7fbf9def1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf980cfc20 con 0x7fbf980cf6b0 2024-09-12T01:36:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.733+0000 7fbf9def1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbf980d2ed0 con 0x7fbf980b63d0 2024-09-12T01:36:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.733+0000 7fbf9def1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbf980d31b0 con 0x7fbf980d1c80 2024-09-12T01:36:17.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.733+0000 7fbf977fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf980b63d0 0x7fbf980d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.733+0000 7fbf977fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf980b63d0 0x7fbf980d39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52048/0 (socket says 172.21.15.60:52048) 2024-09-12T01:36:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.733+0000 7fbf977fe640 1 -- 172.21.15.60:0/1898251107 learned_addr learned my addr 172.21.15.60:0/1898251107 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.734+0000 7fbf97fff640 1 --2- 172.21.15.60:0/1898251107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf980d1c80 0x7fbf980b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.734+0000 7fbf977fe640 1 -- 172.21.15.60:0/1898251107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf980d1c80 msgr2=0x7fbf980b7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.734+0000 7fbf977fe640 1 --2- 172.21.15.60:0/1898251107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf980d1c80 0x7fbf980b7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.734+0000 7fbf977fe640 1 -- 172.21.15.60:0/1898251107 >> v1:172.21.15.60:6789/0 conn(0x7fbf980cf6b0 legacy=0x7fbf980b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:17.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.734+0000 7fbf977fe640 1 -- 172.21.15.60:0/1898251107 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf980d3490 con 0x7fbf980b63d0 2024-09-12T01:36:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.734+0000 7fbf967fc640 1 -- 172.21.15.60:0/1898251107 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1991872558 0 0) 0x7fbf980cfc20 con 0x7fbf980cf6b0 2024-09-12T01:36:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.734+0000 7fbf97fff640 1 --2- 172.21.15.60:0/1898251107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf980d1c80 0x7fbf980b7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.735+0000 7fbf977fe640 1 --2- 172.21.15.60:0/1898251107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf980b63d0 0x7fbf980d39b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009870 tx=0x7fbf8802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afe62b99a0e2585 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.735+0000 7fbf967fc640 1 -- 172.21.15.60:0/1898251107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88037070 con 0x7fbf980b63d0 2024-09-12T01:36:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.735+0000 7fbf967fc640 1 -- 172.21.15.60:0/1898251107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf88032440 con 0x7fbf980b63d0 2024-09-12T01:36:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.735+0000 7fbf967fc640 1 -- 172.21.15.60:0/1898251107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88032810 con 0x7fbf980b63d0 2024-09-12T01:36:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.735+0000 7fbf9def1640 1 -- 172.21.15.60:0/1898251107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf980b63d0 msgr2=0x7fbf980d39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.735+0000 7fbf9def1640 1 --2- 172.21.15.60:0/1898251107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf980b63d0 0x7fbf980d39b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009870 tx=0x7fbf8802a1c0 comp rx=0 tx=0).stop 2024-09-12T01:36:17.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.735+0000 7fbf9def1640 1 -- 172.21.15.60:0/1898251107 shutdown_connections 2024-09-12T01:36:17.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.735+0000 7fbf9def1640 1 --2- 172.21.15.60:0/1898251107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf980d1c80 0x7fbf980b7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:17.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.735+0000 7fbf9def1640 1 --2- 172.21.15.60:0/1898251107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf980b63d0 0x7fbf980d39b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:17.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.735+0000 7fbf9def1640 1 -- 172.21.15.60:0/1898251107 >> 172.21.15.60:0/1898251107 conn(0x7fbf980d1160 msgr2=0x7fbf980d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:17.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.735+0000 7fbf9def1640 1 -- 172.21.15.60:0/1898251107 shutdown_connections 2024-09-12T01:36:17.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.735+0000 7fbf9def1640 1 -- 172.21.15.60:0/1898251107 wait complete. 2024-09-12T01:36:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.737+0000 7fbf9def1640 1 Processor -- start 2024-09-12T01:36:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.737+0000 7fbf9def1640 1 -- start start 2024-09-12T01:36:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.737+0000 7fbf9def1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf980b63d0 0x7fbf9815fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf9def1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf980cf6b0 0x7fbf980c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf9def1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf980d1c80 0x7fbf981f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf9def1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbf980d4070 con 0x7fbf980b63d0 2024-09-12T01:36:17.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf9def1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbf980d3ef0 con 0x7fbf980cf6b0 2024-09-12T01:36:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf9def1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbf980b67b0 con 0x7fbf980d1c80 2024-09-12T01:36:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf977fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf980b63d0 0x7fbf9815fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf977fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf980b63d0 0x7fbf9815fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52064/0 (socket says 172.21.15.60:52064) 2024-09-12T01:36:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf977fe640 1 -- 172.21.15.60:0/3818615837 learned_addr learned my addr 172.21.15.60:0/3818615837 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf97fff640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf980d1c80 0x7fbf981f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf96ffd640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf980cf6b0 0x7fbf980c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:17.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf977fe640 1 -- 172.21.15.60:0/3818615837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf980d1c80 msgr2=0x7fbf981f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf977fe640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf980d1c80 0x7fbf981f4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf977fe640 1 -- 172.21.15.60:0/3818615837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf980cf6b0 msgr2=0x7fbf980c95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf977fe640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf980cf6b0 0x7fbf980c95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf977fe640 1 -- 172.21.15.60:0/3818615837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf980cca10 con 0x7fbf980b63d0 2024-09-12T01:36:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf977fe640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf980b63d0 0x7fbf9815fd10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbf88000c00 tx=0x7fbf880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf7ffff640 1 -- 172.21.15.60:0/3818615837 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88041020 con 0x7fbf980b63d0 2024-09-12T01:36:17.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf7ffff640 1 -- 172.21.15.60:0/3818615837 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf880306c0 con 0x7fbf980b63d0 2024-09-12T01:36:17.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf9def1640 1 -- 172.21.15.60:0/3818615837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf980cccf0 con 0x7fbf980b63d0 2024-09-12T01:36:17.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf7ffff640 1 -- 172.21.15.60:0/3818615837 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88037040 con 0x7fbf980b63d0 2024-09-12T01:36:17.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.738+0000 7fbf9def1640 1 -- 172.21.15.60:0/3818615837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf980c90d0 con 0x7fbf980b63d0 2024-09-12T01:36:17.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.739+0000 7fbf9def1640 1 -- 172.21.15.60:0/3818615837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf980d39b0 con 0x7fbf980b63d0 2024-09-12T01:36:17.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.740+0000 7fbf7ffff640 1 -- 172.21.15.60:0/3818615837 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf88044020 con 0x7fbf980b63d0 2024-09-12T01:36:17.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.740+0000 7fbf7ffff640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf8406be30 0x7fbf8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:17.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.740+0000 7fbf7ffff640 1 -- 172.21.15.60:0/3818615837 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbf880ab4d0 con 0x7fbf980b63d0 2024-09-12T01:36:17.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.740+0000 7fbf96ffd640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf8406be30 0x7fbf8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:17.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.741+0000 7fbf96ffd640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf8406be30 0x7fbf8406e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbf980ceec0 tx=0x7fbf8c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:17.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.745+0000 7fbf7ffff640 1 -- 172.21.15.60:0/3818615837 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf8804b030 con 0x7fbf980b63d0 2024-09-12T01:36:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.957+0000 7fbf9def1640 1 -- 172.21.15.60:0/3818615837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbf980cf280 con 0x7fbf980b63d0 2024-09-12T01:36:17.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.957+0000 7fbf7ffff640 1 -- 172.21.15.60:0/3818615837 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fbf880a9e20 con 0x7fbf980b63d0 2024-09-12T01:36:17.957 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:36:17.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.959+0000 7fbf9def1640 1 -- 172.21.15.60:0/3818615837 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf8406be30 msgr2=0x7fbf8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:17.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.959+0000 7fbf9def1640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf8406be30 0x7fbf8406e2f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbf980ceec0 tx=0x7fbf8c009040 comp rx=0 tx=0).stop 2024-09-12T01:36:17.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.959+0000 7fbf9def1640 1 -- 172.21.15.60:0/3818615837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf980b63d0 msgr2=0x7fbf9815fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:17.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.959+0000 7fbf9def1640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf980b63d0 0x7fbf9815fd10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbf88000c00 tx=0x7fbf880046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:17.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.959+0000 7fbf9def1640 1 -- 172.21.15.60:0/3818615837 shutdown_connections 2024-09-12T01:36:17.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.959+0000 7fbf9def1640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf8406be30 0x7fbf8406e2f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:17.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.959+0000 7fbf9def1640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf980d1c80 0x7fbf981f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:17.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.959+0000 7fbf9def1640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf980cf6b0 0x7fbf980c95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:17.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.959+0000 7fbf9def1640 1 --2- 172.21.15.60:0/3818615837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf980b63d0 0x7fbf9815fd10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:17.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.959+0000 7fbf9def1640 1 -- 172.21.15.60:0/3818615837 >> 172.21.15.60:0/3818615837 conn(0x7fbf980d1160 msgr2=0x7fbf980b77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:17.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.960+0000 7fbf9def1640 1 -- 172.21.15.60:0/3818615837 shutdown_connections 2024-09-12T01:36:17.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:17.960+0000 7fbf9def1640 1 -- 172.21.15.60:0/3818615837 wait complete. 2024-09-12T01:36:17.969 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-12T01:36:17.969 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:36:17.969 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T01:36:17.969 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-12T01:36:17.970 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-12T01:36:17.970 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-12T01:36:17.970 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-12T01:36:17.970 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:36:17.970 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-12T01:36:17.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:17.970 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T01:36:17.986 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:36:17.987 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:36:17.987 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:36:17.987 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:17.987 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:36:17.987 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:17.987 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:17.987 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:17.987 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42745sec preferred_lft 42745sec 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 56:66:28:3d:b2:45 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:17.988 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:36:17.989 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:17.989 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::c46c:baff:feeb:1f5e/64 scope link 2024-09-12T01:36:17.989 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:17.989 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:36:17.989 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 56:66:28:3d:b2:45 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:36:17.989 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::5466:28ff:fe3d:b245/64 scope link tentative 2024-09-12T01:36:17.989 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:17.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:17.990 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:36:18.051 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:36:18.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:18.053 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T01:36:18.110 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T01:36:18.110 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:36:18.110 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:36:18.110 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:36:18.111 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:36:18.111 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:18.111 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:36:18.111 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:36:18.111 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:36:18.111 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:36:18.111 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:36:18.198 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:18.230 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:18.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:18.237 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:36:18.252 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:36:18.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:18.253 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list-id 2024-09-12T01:36:18.309 INFO:teuthology.orchestra.run.smithi105.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-12T01:36:18.310 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:18.310 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:36:18.310 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:36:18.310 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-12T01:36:18.310 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:36:18.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:18.420 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:18.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:18.426 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T01:36:18.450 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:36:18.450 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:36:18.450 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:36:18.450 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:18.451 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:36:18.451 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:18.451 INFO:teuthology.orchestra.run.smithi105.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:36:18.451 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 72:fc:29:3c:3e:0f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T01:36:18.451 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T01:36:18.451 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:18.451 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::70fc:29ff:fe3c:3e0f/64 scope link tentative 2024-09-12T01:36:18.451 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:18.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:18.452 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-12T01:36:18.517 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:36:18.518 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:36:18.518 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:36:18.518 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:18.518 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:36:18.518 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:18.518 INFO:teuthology.orchestra.run.smithi105.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:36:18.518 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 72:fc:29:3c:3e:0f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-12T01:36:18.518 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-12T01:36:18.518 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:18.518 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::70fc:29ff:fe3c:3e0f/64 scope link tentative 2024-09-12T01:36:18.519 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:18.519 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-12T01:36:18.520 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:18.520 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:36:18.520 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-12T01:36:18.520 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-12T01:36:18.520 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-12T01:36:18.520 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-12T01:36:18.520 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-12T01:36:18.520 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:36:18.607 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:18.665 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:18.672 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:18.672 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:36:18.672 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.1 up 2024-09-12T01:36:18.672 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set dev brx.1 master ceph-brx 2024-09-12T01:36:18.672 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:36:18.719 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:18.741 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:18.748 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:36:18.749 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-12T01:36:18.775 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-12T01:36:18.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:36:18.775 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-12T01:36:18.831 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-12T01:36:18.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:18.831 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:18.915 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:18.915 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:36:18.927 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:18.927 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:36:18.927 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:36:18.928 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 3@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:36:18.928 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:36:18.928 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-12T01:36:18.928 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:36:18.928 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:36:18.928 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:36:18.928 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:36:18.932 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:36:18.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:18.932 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-12T01:36:19.000 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:19.096 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:19.097 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:19.103 INFO:teuthology.orchestra.run.smithi105.stdout:client34430 2024-09-12T01:36:19.103 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:36:19.103 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:19.120 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:19.210 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:19.212 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:19.218 INFO:teuthology.orchestra.run.smithi105.stdout:client34430 2024-09-12T01:36:19.218 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:19.267 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:19.268 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:19.274 INFO:teuthology.orchestra.run.smithi105.stdout:client34430 2024-09-12T01:36:19.274 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5401bd8a-3492-4b21-b6c0-d6616ff39793.client34430/status') 2024-09-12T01:36:19.322 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:19.332 INFO:teuthology.orchestra.run.smithi105.stdout:instance: client.34430 (3)192.168.0.2:0/4187651011 2024-09-12T01:36:19.332 INFO:teuthology.orchestra.run.smithi105.stdout:blocklisted: false 2024-09-12T01:36:19.332 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records in 2024-09-12T01:36:19.332 INFO:teuthology.orchestra.run.smithi105.stderr:0+1 records out 2024-09-12T01:36:19.332 INFO:teuthology.orchestra.run.smithi105.stderr:70 bytes copied, 2.2529e-05 s, 3.1 MB/s 2024-09-12T01:36:19.333 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:19.339 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-12T01:36:19.396 INFO:tasks.cephfs_test_runner:Starting test: test_cap_acquisition_throttle_readdir (tasks.cephfs.test_client_limits.TestClientLimits) Mostly readdir acquires caps faster than the mds recalls, so the cap 2024-09-12T01:36:19.396 INFO:tasks.cephfs_test_runner:test_cap_acquisition_throttle_readdir (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-12T01:36:19.396 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:36:19.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.513+0000 7fceaa7b7640 1 Processor -- start 2024-09-12T01:36:19.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.513+0000 7fceaa7b7640 1 -- start start 2024-09-12T01:36:19.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.514+0000 7fceaa7b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcea415e660 0x7fcea40cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.514+0000 7fceaa7b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea40d3310 0x7fcea40d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.514+0000 7fceaa7b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcea415ea40 con 0x7fcea40d1650 2024-09-12T01:36:19.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.514+0000 7fceaa7b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcea40d1ac0 con 0x7fcea415e660 2024-09-12T01:36:19.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.514+0000 7fceaa7b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcea40d3870 con 0x7fcea40d3310 2024-09-12T01:36:19.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.515+0000 7fcea3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcea415e660 0x7fcea40cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.515+0000 7fcea8d54640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fcea40d1650 0x7fcea406bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:34452/0 (socket says 172.21.15.60:34452) 2024-09-12T01:36:19.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.515+0000 7fcea8d54640 1 -- 172.21.15.60:0/1847110011 learned_addr learned my addr 172.21.15.60:0/1847110011 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:19.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.515+0000 7fcea37fe640 1 --2- 172.21.15.60:0/1847110011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea40d3310 0x7fcea40d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.515+0000 7fcea2ffd640 1 -- 172.21.15.60:0/1847110011 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1621065438 0 0) 0x7fcea415ea40 con 0x7fcea40d1650 2024-09-12T01:36:19.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.515+0000 7fcea2ffd640 1 -- 172.21.15.60:0/1847110011 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce8c003520 con 0x7fcea40d1650 2024-09-12T01:36:19.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.515+0000 7fcea37fe640 1 -- 172.21.15.60:0/1847110011 >> v2:172.21.15.105:3300/0 conn(0x7fcea415e660 msgr2=0x7fcea40cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:19.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.515+0000 7fcea37fe640 1 --2- 172.21.15.60:0/1847110011 >> v2:172.21.15.105:3300/0 conn(0x7fcea415e660 0x7fcea40cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.515+0000 7fcea37fe640 1 -- 172.21.15.60:0/1847110011 >> v1:172.21.15.105:6789/0 conn(0x7fcea40d1650 legacy=0x7fcea406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:19.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.515+0000 7fcea37fe640 1 -- 172.21.15.60:0/1847110011 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea40d3b50 con 0x7fcea40d3310 2024-09-12T01:36:19.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.515+0000 7fcea3fff640 1 --2- 172.21.15.60:0/1847110011 >> v2:172.21.15.105:3300/0 conn(0x7fcea415e660 0x7fcea40cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:19.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.516+0000 7fcea37fe640 1 --2- 172.21.15.60:0/1847110011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea40d3310 0x7fcea40d1110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce980097a0 tx=0x7fce9802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16eab86dbc39f2f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:19.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.516+0000 7fcea2ffd640 1 -- 172.21.15.60:0/1847110011 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98037070 con 0x7fcea40d3310 2024-09-12T01:36:19.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.516+0000 7fcea2ffd640 1 -- 172.21.15.60:0/1847110011 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce98032440 con 0x7fcea40d3310 2024-09-12T01:36:19.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.516+0000 7fcea2ffd640 1 -- 172.21.15.60:0/1847110011 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce980327f0 con 0x7fcea40d3310 2024-09-12T01:36:19.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.517+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1847110011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea40d3310 msgr2=0x7fcea40d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:19.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.517+0000 7fceaa7b7640 1 --2- 172.21.15.60:0/1847110011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea40d3310 0x7fcea40d1110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce980097a0 tx=0x7fce9802a180 comp rx=0 tx=0).stop 2024-09-12T01:36:19.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.517+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1847110011 shutdown_connections 2024-09-12T01:36:19.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.517+0000 7fceaa7b7640 1 --2- 172.21.15.60:0/1847110011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea40d3310 0x7fcea40d1110 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.517+0000 7fceaa7b7640 1 --2- 172.21.15.60:0/1847110011 >> v2:172.21.15.105:3300/0 conn(0x7fcea415e660 0x7fcea40cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.517+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1847110011 >> 172.21.15.60:0/1847110011 conn(0x7fcea40b6410 msgr2=0x7fcea40b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:19.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.517+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1847110011 shutdown_connections 2024-09-12T01:36:19.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.517+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1847110011 wait complete. 2024-09-12T01:36:19.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.518+0000 7fceaa7b7640 1 Processor -- start 2024-09-12T01:36:19.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.518+0000 7fceaa7b7640 1 -- start start 2024-09-12T01:36:19.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fceaa7b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcea40d1650 0x7fcea414dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fceaa7b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea40d3310 0x7fcea40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fceaa7b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcea415e660 0x7fcea4157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fceaa7b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcea40d43f0 con 0x7fcea40d1650 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fceaa7b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcea40d4110 con 0x7fcea415e660 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fceaa7b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcea40cfc70 con 0x7fcea40d3310 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fcea3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcea40d1650 0x7fcea414dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fcea3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcea40d1650 0x7fcea414dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52074/0 (socket says 172.21.15.60:52074) 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fcea3fff640 1 -- 172.21.15.60:0/1459575544 learned_addr learned my addr 172.21.15.60:0/1459575544 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fcea8d54640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcea415e660 0x7fcea4157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fcea37fe640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea40d3310 0x7fcea40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fcea37fe640 1 -- 172.21.15.60:0/1459575544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcea415e660 msgr2=0x7fcea4157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fcea37fe640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcea415e660 0x7fcea4157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fcea37fe640 1 -- 172.21.15.60:0/1459575544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcea40d1650 msgr2=0x7fcea414dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fcea37fe640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcea40d1650 0x7fcea414dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fcea37fe640 1 -- 172.21.15.60:0/1459575544 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea40cd740 con 0x7fcea40d3310 2024-09-12T01:36:19.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.519+0000 7fcea3fff640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcea40d1650 0x7fcea414dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:19.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.520+0000 7fcea37fe640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea40d3310 0x7fcea40ccea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fce98031000 tx=0x7fce980046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:19.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.520+0000 7fcea0ff9640 1 -- 172.21.15.60:0/1459575544 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98041030 con 0x7fcea40d3310 2024-09-12T01:36:19.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.520+0000 7fcea0ff9640 1 -- 172.21.15.60:0/1459575544 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce9803d420 con 0x7fcea40d3310 2024-09-12T01:36:19.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.520+0000 7fcea0ff9640 1 -- 172.21.15.60:0/1459575544 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce98037040 con 0x7fcea40d3310 2024-09-12T01:36:19.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.520+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1459575544 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea41f4010 con 0x7fcea40d3310 2024-09-12T01:36:19.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.520+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1459575544 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea41f45d0 con 0x7fcea40d3310 2024-09-12T01:36:19.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.521+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1459575544 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea40d1110 con 0x7fcea40d3310 2024-09-12T01:36:19.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.521+0000 7fcea0ff9640 1 -- 172.21.15.60:0/1459575544 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce98044070 con 0x7fcea40d3310 2024-09-12T01:36:19.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.522+0000 7fcea0ff9640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce9006be30 0x7fce9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.522+0000 7fcea0ff9640 1 -- 172.21.15.60:0/1459575544 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fce980ab380 con 0x7fcea40d3310 2024-09-12T01:36:19.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.522+0000 7fcea3fff640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce9006be30 0x7fce9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.523+0000 7fcea3fff640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce9006be30 0x7fce9006e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcea41609e0 tx=0x7fce94009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:19.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.527+0000 7fcea0ff9640 1 -- 172.21.15.60:0/1459575544 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce980796d0 con 0x7fcea40d3310 2024-09-12T01:36:19.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.706+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1459575544 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcea406cb70 con 0x7fcea40d3310 2024-09-12T01:36:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.707+0000 7fcea0ff9640 1 -- 172.21.15.60:0/1459575544 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7fce9807d9d0 con 0x7fcea40d3310 2024-09-12T01:36:19.707 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:19.707 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:57.624089+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:35:53.846331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:35:54.965757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:36:19.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.709+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1459575544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce9006be30 msgr2=0x7fce9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.709+0000 7fceaa7b7640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce9006be30 0x7fce9006e2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcea41609e0 tx=0x7fce94009190 comp rx=0 tx=0).stop 2024-09-12T01:36:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.709+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1459575544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea40d3310 msgr2=0x7fcea40ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.709+0000 7fceaa7b7640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea40d3310 0x7fcea40ccea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fce98031000 tx=0x7fce980046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.709+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1459575544 shutdown_connections 2024-09-12T01:36:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.709+0000 7fceaa7b7640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcea415e660 0x7fcea4157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.709+0000 7fceaa7b7640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce9006be30 0x7fce9006e2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.709+0000 7fceaa7b7640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcea40d3310 0x7fcea40ccea0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.709+0000 7fceaa7b7640 1 --2- 172.21.15.60:0/1459575544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcea40d1650 0x7fcea414dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.709+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1459575544 >> 172.21.15.60:0/1459575544 conn(0x7fcea40b6410 msgr2=0x7fcea415c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.710+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1459575544 shutdown_connections 2024-09-12T01:36:19.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.710+0000 7fceaa7b7640 1 -- 172.21.15.60:0/1459575544 wait complete. 2024-09-12T01:36:19.720 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:35:46.304939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-12T01:35:53.846331+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-12T01:35:54.965757+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:36:19.720 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:36:19.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.826+0000 7fc16834b640 1 Processor -- start 2024-09-12T01:36:19.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.826+0000 7fc16834b640 1 -- start start 2024-09-12T01:36:19.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.827+0000 7fc16834b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc16015e600 0x7fc1600d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.827+0000 7fc16834b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc1600d1a40 0x7fc1600cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.827+0000 7fc16834b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1600cf2f0 0x7fc1600b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.827+0000 7fc16834b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc1600d1e90 con 0x7fc16015e600 2024-09-12T01:36:19.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.827+0000 7fc16834b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc1600d2ee0 con 0x7fc1600d1a40 2024-09-12T01:36:19.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.827+0000 7fc16834b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc1600cf780 con 0x7fc1600cf2f0 2024-09-12T01:36:19.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.827+0000 7fc1660e7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc16015e600 0x7fc1600d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.827+0000 7fc1660e7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc16015e600 0x7fc1600d1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52086/0 (socket says 172.21.15.60:52086) 2024-09-12T01:36:19.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.827+0000 7fc1660e7640 1 -- 172.21.15.60:0/1465103938 learned_addr learned my addr 172.21.15.60:0/1465103938 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:19.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.827+0000 7fc1668e8640 1 --2- 172.21.15.60:0/1465103938 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1600cf2f0 0x7fc1600b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.827+0000 7fc1658e6640 1 --2- 172.21.15.60:0/1465103938 >> v2:172.21.15.105:3300/0 conn(0x7fc1600d1a40 0x7fc1600cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.828+0000 7fc1660e7640 1 -- 172.21.15.60:0/1465103938 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1600cf2f0 msgr2=0x7fc1600b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:19.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.828+0000 7fc1660e7640 1 --2- 172.21.15.60:0/1465103938 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1600cf2f0 0x7fc1600b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.828+0000 7fc1660e7640 1 -- 172.21.15.60:0/1465103938 >> v2:172.21.15.105:3300/0 conn(0x7fc1600d1a40 msgr2=0x7fc1600cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:19.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.828+0000 7fc1660e7640 1 --2- 172.21.15.60:0/1465103938 >> v2:172.21.15.105:3300/0 conn(0x7fc1600d1a40 0x7fc1600cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.828+0000 7fc1660e7640 1 -- 172.21.15.60:0/1465103938 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1600b7ad0 con 0x7fc16015e600 2024-09-12T01:36:19.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.828+0000 7fc1660e7640 1 --2- 172.21.15.60:0/1465103938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc16015e600 0x7fc1600d1500 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc1601621b0 tx=0x7fc15c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6436523dc3caed50 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:19.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.830+0000 7fc1650e5640 1 -- 172.21.15.60:0/1465103938 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c037070 con 0x7fc16015e600 2024-09-12T01:36:19.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.830+0000 7fc1650e5640 1 -- 172.21.15.60:0/1465103938 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c032440 con 0x7fc16015e600 2024-09-12T01:36:19.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.830+0000 7fc1650e5640 1 -- 172.21.15.60:0/1465103938 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c032810 con 0x7fc16015e600 2024-09-12T01:36:19.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.831+0000 7fc16834b640 1 -- 172.21.15.60:0/1465103938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc16015e600 msgr2=0x7fc1600d1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:19.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.831+0000 7fc16834b640 1 --2- 172.21.15.60:0/1465103938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc16015e600 0x7fc1600d1500 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc1601621b0 tx=0x7fc15c02a210 comp rx=0 tx=0).stop 2024-09-12T01:36:19.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.831+0000 7fc16834b640 1 -- 172.21.15.60:0/1465103938 shutdown_connections 2024-09-12T01:36:19.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.831+0000 7fc16834b640 1 --2- 172.21.15.60:0/1465103938 >> v2:172.21.15.105:3300/0 conn(0x7fc1600d1a40 0x7fc1600cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.831+0000 7fc16834b640 1 --2- 172.21.15.60:0/1465103938 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1600cf2f0 0x7fc1600b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.831+0000 7fc16834b640 1 --2- 172.21.15.60:0/1465103938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc16015e600 0x7fc1600d1500 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.831+0000 7fc16834b640 1 -- 172.21.15.60:0/1465103938 >> 172.21.15.60:0/1465103938 conn(0x7fc16006c2c0 msgr2=0x7fc16006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:19.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.831+0000 7fc16834b640 1 -- 172.21.15.60:0/1465103938 shutdown_connections 2024-09-12T01:36:19.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.831+0000 7fc16834b640 1 -- 172.21.15.60:0/1465103938 wait complete. 2024-09-12T01:36:19.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.832+0000 7fc16834b640 1 Processor -- start 2024-09-12T01:36:19.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.832+0000 7fc16834b640 1 -- start start 2024-09-12T01:36:19.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc16834b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1600cf2f0 0x7fc16015d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc16834b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1600d1a40 0x7fc160149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc16834b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc16015e600 0x7fc1601497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc16834b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc1600cffa0 con 0x7fc16015e600 2024-09-12T01:36:19.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc16834b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc1600cfcc0 con 0x7fc1600cf2f0 2024-09-12T01:36:19.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc16834b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc1600d2b70 con 0x7fc1600d1a40 2024-09-12T01:36:19.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc1668e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc16015e600 0x7fc1601497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc1668e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc16015e600 0x7fc1601497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52098/0 (socket says 172.21.15.60:52098) 2024-09-12T01:36:19.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc1658e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1600d1a40 0x7fc160149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc1668e8640 1 -- 172.21.15.60:0/3458503825 learned_addr learned my addr 172.21.15.60:0/3458503825 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc1660e7640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1600cf2f0 0x7fc16015d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc1668e8640 1 -- 172.21.15.60:0/3458503825 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1600d1a40 msgr2=0x7fc160149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc1668e8640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1600d1a40 0x7fc160149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc1668e8640 1 -- 172.21.15.60:0/3458503825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1600cf2f0 msgr2=0x7fc16015d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc1668e8640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1600cf2f0 0x7fc16015d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc1668e8640 1 -- 172.21.15.60:0/3458503825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16015c760 con 0x7fc16015e600 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc1660e7640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1600cf2f0 0x7fc16015d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.833+0000 7fc1668e8640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc16015e600 0x7fc1601497a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc158007e60 tx=0x7fc15800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.834+0000 7fc156ffd640 1 -- 172.21.15.60:0/3458503825 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158014620 con 0x7fc16015e600 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.834+0000 7fc156ffd640 1 -- 172.21.15.60:0/3458503825 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc158019070 con 0x7fc16015e600 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.834+0000 7fc16834b640 1 -- 172.21.15.60:0/3458503825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16015ca40 con 0x7fc16015e600 2024-09-12T01:36:19.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.834+0000 7fc156ffd640 1 -- 172.21.15.60:0/3458503825 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158014a20 con 0x7fc16015e600 2024-09-12T01:36:19.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.834+0000 7fc16834b640 1 -- 172.21.15.60:0/3458503825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16015c470 con 0x7fc16015e600 2024-09-12T01:36:19.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.835+0000 7fc16834b640 1 -- 172.21.15.60:0/3458503825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1600d0560 con 0x7fc16015e600 2024-09-12T01:36:19.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.835+0000 7fc156ffd640 1 -- 172.21.15.60:0/3458503825 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc158014bc0 con 0x7fc16015e600 2024-09-12T01:36:19.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.836+0000 7fc156ffd640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc14406be30 0x7fc14406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:19.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.836+0000 7fc156ffd640 1 -- 172.21.15.60:0/3458503825 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc15808b5b0 con 0x7fc16015e600 2024-09-12T01:36:19.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.836+0000 7fc1660e7640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc14406be30 0x7fc14406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:19.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.836+0000 7fc1660e7640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc14406be30 0x7fc14406e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc15c034000 tx=0x7fc15c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:19.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:19.840+0000 7fc156ffd640 1 -- 172.21.15.60:0/3458503825 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1600d0560 con 0x7fc16015e600 2024-09-12T01:36:20.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.018+0000 7fc16834b640 1 -- 172.21.15.60:0/3458503825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc16015e9e0 con 0x7fc16015e600 2024-09-12T01:36:20.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.018+0000 7fc156ffd640 1 -- 172.21.15.60:0/3458503825 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fc158059910 con 0x7fc16015e600 2024-09-12T01:36:20.018 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-12T01:36:20.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.021+0000 7fc16834b640 1 -- 172.21.15.60:0/3458503825 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc14406be30 msgr2=0x7fc14406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.021+0000 7fc16834b640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc14406be30 0x7fc14406e2f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc15c034000 tx=0x7fc15c02e000 comp rx=0 tx=0).stop 2024-09-12T01:36:20.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.021+0000 7fc16834b640 1 -- 172.21.15.60:0/3458503825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc16015e600 msgr2=0x7fc1601497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.021+0000 7fc16834b640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc16015e600 0x7fc1601497a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc158007e60 tx=0x7fc15800e4b0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.021+0000 7fc16834b640 1 -- 172.21.15.60:0/3458503825 shutdown_connections 2024-09-12T01:36:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.021+0000 7fc16834b640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc16015e600 0x7fc1601497a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.021+0000 7fc16834b640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc14406be30 0x7fc14406e2f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.021+0000 7fc16834b640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1600d1a40 0x7fc160149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.021+0000 7fc16834b640 1 --2- 172.21.15.60:0/3458503825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc1600cf2f0 0x7fc16015d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.021+0000 7fc16834b640 1 -- 172.21.15.60:0/3458503825 >> 172.21.15.60:0/3458503825 conn(0x7fc16006c2c0 msgr2=0x7fc1600b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.021+0000 7fc16834b640 1 -- 172.21.15.60:0/3458503825 shutdown_connections 2024-09-12T01:36:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.021+0000 7fc16834b640 1 -- 172.21.15.60:0/3458503825 wait complete. 2024-09-12T01:36:20.031 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-12T01:36:20.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.137+0000 7f0ae972a640 1 Processor -- start 2024-09-12T01:36:20.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.137+0000 7f0ae972a640 1 -- start start 2024-09-12T01:36:20.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.138+0000 7f0ae972a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ae415e940 0x7f0ae40b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.138+0000 7f0ae972a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae40cfd40 con 0x7f0ae40ba440 2024-09-12T01:36:20.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.138+0000 7f0ae972a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae415ed20 con 0x7f0ae40d2290 2024-09-12T01:36:20.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.138+0000 7f0ae972a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae40d3ef0 con 0x7f0ae415e940 2024-09-12T01:36:20.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.138+0000 7f0ada7fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0ae40ba440 0x7f0ae40cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55298/0 (socket says 172.21.15.60:55298) 2024-09-12T01:36:20.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.138+0000 7f0ada7fc640 1 -- 172.21.15.60:0/1975235573 learned_addr learned my addr 172.21.15.60:0/1975235573 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:20.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.138+0000 7f0ae2ffd640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ae415e940 0x7f0ae40b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.138+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034733977 0 0) 0x7f0ae40cfd40 con 0x7f0ae40ba440 2024-09-12T01:36:20.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.138+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ad0003520 con 0x7f0ae40ba440 2024-09-12T01:36:20.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.138+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4030020480 0 0) 0x7f0ad0003520 con 0x7f0ae40ba440 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.138+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ae415e940 msgr2=0x7f0ae40b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.138+0000 7f0ae27fc640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ae415e940 0x7f0ae40b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 >> v1:172.21.15.105:6789/0 conn(0x7f0ae40d2290 legacy=0x7f0ae40cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae40d32e0 con 0x7f0ae40ba440 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f0acc001670 con 0x7f0ae40ba440 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 >> v1:172.21.15.60:6789/0 conn(0x7f0ae40ba440 legacy=0x7f0ae40cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae27fc640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ad00039e0 0x7f0ad0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae27fc640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ad0004390 0x7f0ad0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae27fc640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ad00050b0 0x7f0ad000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae40d3ef0 con 0x7f0ad00050b0 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad000bfe0 con 0x7f0ad00039e0 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ad000c1e0 con 0x7f0ad0004390 2024-09-12T01:36:20.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae2ffd640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ae415e940 0x7f0ae40b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae37fe640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ad00050b0 0x7f0ad000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ada7fc640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ad0004390 0x7f0ad0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae2ffd640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ad00039e0 0x7f0ad0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae37fe640 1 -- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ad0004390 msgr2=0x7f0ad0004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae37fe640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ad0004390 0x7f0ad0004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae37fe640 1 -- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ad00039e0 msgr2=0x7f0ad0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae37fe640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ad00039e0 0x7f0ad0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae37fe640 1 -- 172.21.15.60:0/1975235573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad0003520 con 0x7f0ad00050b0 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.139+0000 7f0ae2ffd640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ad00039e0 0x7f0ad0003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.140+0000 7f0ae37fe640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ad00050b0 0x7f0ad000b9c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0adc001f60 tx=0x7f0ad0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697c098e76c06323 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.140+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc001b30 con 0x7f0ad00050b0 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.140+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0adc031620 con 0x7f0ad00050b0 2024-09-12T01:36:20.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.140+0000 7f0ae27fc640 1 -- 172.21.15.60:0/1975235573 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc031a10 con 0x7f0ad00050b0 2024-09-12T01:36:20.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.140+0000 7f0ae972a640 1 -- 172.21.15.60:0/1975235573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ad00050b0 msgr2=0x7f0ad000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.140+0000 7f0ae972a640 1 --2- 172.21.15.60:0/1975235573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ad00050b0 0x7f0ad000b9c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0adc001f60 tx=0x7f0ad0005830 comp rx=0 tx=0).stop 2024-09-12T01:36:20.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.140+0000 7f0ae37fe640 1 -- 172.21.15.60:0/1975235573 reap_dead start 2024-09-12T01:36:20.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.140+0000 7f0ae972a640 1 -- 172.21.15.60:0/1975235573 shutdown_connections 2024-09-12T01:36:20.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.140+0000 7f0ae972a640 1 -- 172.21.15.60:0/1975235573 >> 172.21.15.60:0/1975235573 conn(0x7f0ae40d1140 msgr2=0x7f0ae40d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:20.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.141+0000 7f0ae972a640 1 -- 172.21.15.60:0/1975235573 shutdown_connections 2024-09-12T01:36:20.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.141+0000 7f0ae972a640 1 -- 172.21.15.60:0/1975235573 wait complete. 2024-09-12T01:36:20.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.142+0000 7f0ae972a640 1 Processor -- start 2024-09-12T01:36:20.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.142+0000 7f0ae972a640 1 -- start start 2024-09-12T01:36:20.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae972a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ae414d470 0x7f0ae40ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae972a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ae414db70 0x7f0ae41e7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae972a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae415ab60 0x7f0ae41e7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae972a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae40d3b80 con 0x7f0ae415ab60 2024-09-12T01:36:20.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae972a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae40d38a0 con 0x7f0ae414d470 2024-09-12T01:36:20.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae972a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae40b7510 con 0x7f0ae414db70 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae415ab60 0x7f0ae41e7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae415ab60 0x7f0ae41e7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52114/0 (socket says 172.21.15.60:52114) 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae37fe640 1 -- 172.21.15.60:0/2177815023 learned_addr learned my addr 172.21.15.60:0/2177815023 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae2ffd640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ae414d470 0x7f0ae40ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ada7fc640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ae414db70 0x7f0ae41e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae37fe640 1 -- 172.21.15.60:0/2177815023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ae414db70 msgr2=0x7f0ae41e7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae37fe640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ae414db70 0x7f0ae41e7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae37fe640 1 -- 172.21.15.60:0/2177815023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ae414d470 msgr2=0x7f0ae40ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae37fe640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ae414d470 0x7f0ae40ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae37fe640 1 -- 172.21.15.60:0/2177815023 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae40cc1d0 con 0x7f0ae415ab60 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae37fe640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae415ab60 0x7f0ae41e7840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0adc02aa00 tx=0x7f0adc0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0adbfff640 1 -- 172.21.15.60:0/2177815023 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc001b30 con 0x7f0ae415ab60 2024-09-12T01:36:20.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0adbfff640 1 -- 172.21.15.60:0/2177815023 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0adc003b80 con 0x7f0ae415ab60 2024-09-12T01:36:20.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0ae972a640 1 -- 172.21.15.60:0/2177815023 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae40cc4b0 con 0x7f0ae415ab60 2024-09-12T01:36:20.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.143+0000 7f0adbfff640 1 -- 172.21.15.60:0/2177815023 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc006b50 con 0x7f0ae415ab60 2024-09-12T01:36:20.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.144+0000 7f0ae972a640 1 -- 172.21.15.60:0/2177815023 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae40c9fb0 con 0x7f0ae415ab60 2024-09-12T01:36:20.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.145+0000 7f0ae972a640 1 -- 172.21.15.60:0/2177815023 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae415ed20 con 0x7f0ae415ab60 2024-09-12T01:36:20.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.145+0000 7f0adbfff640 1 -- 172.21.15.60:0/2177815023 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0adc045020 con 0x7f0ae415ab60 2024-09-12T01:36:20.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.146+0000 7f0adbfff640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0ac406be60 0x7f0ac406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.146+0000 7f0ae2ffd640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0ac406be60 0x7f0ac406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.146+0000 7f0adbfff640 1 -- 172.21.15.60:0/2177815023 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0adc0aadd0 con 0x7f0ae415ab60 2024-09-12T01:36:20.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.146+0000 7f0ae2ffd640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0ac406be60 0x7f0ac406e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40cecc0 tx=0x7f0ad4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:20.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.150+0000 7f0adbfff640 1 -- 172.21.15.60:0/2177815023 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0adc079130 con 0x7f0ae415ab60 2024-09-12T01:36:20.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.326+0000 7f0ae972a640 1 -- 172.21.15.60:0/2177815023 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0ae40ca180 con 0x7f0ae415ab60 2024-09-12T01:36:20.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.326+0000 7f0adbfff640 1 -- 172.21.15.60:0/2177815023 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f0adc07d430 con 0x7f0ae415ab60 2024-09-12T01:36:20.326 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 32 2024-09-12T01:36:20.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.328+0000 7f0ae972a640 1 -- 172.21.15.60:0/2177815023 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0ac406be60 msgr2=0x7f0ac406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.328+0000 7f0ae972a640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0ac406be60 0x7f0ac406e320 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40cecc0 tx=0x7f0ad4008040 comp rx=0 tx=0).stop 2024-09-12T01:36:20.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.328+0000 7f0ae972a640 1 -- 172.21.15.60:0/2177815023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae415ab60 msgr2=0x7f0ae41e7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.328+0000 7f0ae972a640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae415ab60 0x7f0ae41e7840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0adc02aa00 tx=0x7f0adc0015b0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.328+0000 7f0ae972a640 1 -- 172.21.15.60:0/2177815023 shutdown_connections 2024-09-12T01:36:20.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.328+0000 7f0ae972a640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ae415ab60 0x7f0ae41e7840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.328+0000 7f0ae972a640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0ac406be60 0x7f0ac406e320 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.328+0000 7f0ae972a640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0ae414db70 0x7f0ae41e7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.328+0000 7f0ae972a640 1 --2- 172.21.15.60:0/2177815023 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0ae414d470 0x7f0ae40ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.328+0000 7f0ae972a640 1 -- 172.21.15.60:0/2177815023 >> 172.21.15.60:0/2177815023 conn(0x7f0ae40d1140 msgr2=0x7f0ae415feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:20.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.328+0000 7f0ae972a640 1 -- 172.21.15.60:0/2177815023 shutdown_connections 2024-09-12T01:36:20.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.328+0000 7f0ae972a640 1 -- 172.21.15.60:0/2177815023 wait complete. 2024-09-12T01:36:20.338 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-12T01:36:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.444+0000 7f20dc20e640 1 Processor -- start 2024-09-12T01:36:20.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.445+0000 7f20dc20e640 1 -- start start 2024-09-12T01:36:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.445+0000 7f20dc20e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f20d415e7a0 0x7f20d406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.445+0000 7f20dc20e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d40cf860 con 0x7f20d40b68f0 2024-09-12T01:36:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.445+0000 7f20dc20e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d40cfb40 con 0x7f20d40cf1f0 2024-09-12T01:36:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.445+0000 7f20dc20e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f20d40d2ca0 con 0x7f20d415e7a0 2024-09-12T01:36:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.446+0000 7f20d9faa640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f20d415e7a0 0x7f20d406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.446+0000 7f20d9faa640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f20d415e7a0 0x7f20d406caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52128/0 (socket says 172.21.15.60:52128) 2024-09-12T01:36:20.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.446+0000 7f20da7ab640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f20d40b68f0 0x7f20d40d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55300/0 (socket says 172.21.15.60:55300) 2024-09-12T01:36:20.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.446+0000 7f20d9faa640 1 -- 172.21.15.60:0/4216188986 learned_addr learned my addr 172.21.15.60:0/4216188986 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:20.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.446+0000 7f20d9faa640 1 -- 172.21.15.60:0/4216188986 >> v1:172.21.15.105:6789/0 conn(0x7f20d40cf1f0 legacy=0x7f20d40b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.446+0000 7f20d9faa640 1 -- 172.21.15.60:0/4216188986 >> v1:172.21.15.60:6789/0 conn(0x7f20d40b68f0 legacy=0x7f20d40d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.446+0000 7f20d8fa8640 1 -- 172.21.15.60:0/4216188986 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3778712937 0 0) 0x7f20d40cf860 con 0x7f20d40b68f0 2024-09-12T01:36:20.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.446+0000 7f20d9faa640 1 -- 172.21.15.60:0/4216188986 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d40cfe20 con 0x7f20d415e7a0 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.447+0000 7f20d9faa640 1 --2- 172.21.15.60:0/4216188986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d415e7a0 0x7f20d406caa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009870 tx=0x7f20d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cc135dbae7d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.447+0000 7f20d8fa8640 1 -- 172.21.15.60:0/4216188986 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0037070 con 0x7f20d415e7a0 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.447+0000 7f20d8fa8640 1 -- 172.21.15.60:0/4216188986 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d0032440 con 0x7f20d415e7a0 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.447+0000 7f20d8fa8640 1 -- 172.21.15.60:0/4216188986 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d0032810 con 0x7f20d415e7a0 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.447+0000 7f20dc20e640 1 -- 172.21.15.60:0/4216188986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d415e7a0 msgr2=0x7f20d406caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.447+0000 7f20dc20e640 1 --2- 172.21.15.60:0/4216188986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d415e7a0 0x7f20d406caa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009870 tx=0x7f20d002a270 comp rx=0 tx=0).stop 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.447+0000 7f20dc20e640 1 -- 172.21.15.60:0/4216188986 shutdown_connections 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.447+0000 7f20dc20e640 1 --2- 172.21.15.60:0/4216188986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d415e7a0 0x7f20d406caa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.447+0000 7f20dc20e640 1 -- 172.21.15.60:0/4216188986 >> 172.21.15.60:0/4216188986 conn(0x7f20d40d11e0 msgr2=0x7f20d40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.447+0000 7f20dc20e640 1 -- 172.21.15.60:0/4216188986 shutdown_connections 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.447+0000 7f20dc20e640 1 -- 172.21.15.60:0/4216188986 wait complete. 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20dc20e640 1 Processor -- start 2024-09-12T01:36:20.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20dc20e640 1 -- start start 2024-09-12T01:36:20.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20dc20e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d40b68f0 0x7f20d4161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20dc20e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d40cf1f0 0x7f20d41e81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20dc20e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d415e7a0 0x7f20d415fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20dc20e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f20d406cfe0 con 0x7f20d415e7a0 2024-09-12T01:36:20.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20dc20e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20d40b7a00 con 0x7f20d40cf1f0 2024-09-12T01:36:20.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20dc20e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f20d415eb80 con 0x7f20d40b68f0 2024-09-12T01:36:20.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20da7ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d415e7a0 0x7f20d415fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20da7ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d415e7a0 0x7f20d415fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52136/0 (socket says 172.21.15.60:52136) 2024-09-12T01:36:20.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20da7ab640 1 -- 172.21.15.60:0/1609462435 learned_addr learned my addr 172.21.15.60:0/1609462435 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:20.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20d9faa640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d40b68f0 0x7f20d4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.449+0000 7f20d97a9640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d40cf1f0 0x7f20d41e81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.450+0000 7f20da7ab640 1 -- 172.21.15.60:0/1609462435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d40b68f0 msgr2=0x7f20d4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.450+0000 7f20da7ab640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d40b68f0 0x7f20d4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.450+0000 7f20da7ab640 1 -- 172.21.15.60:0/1609462435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d40cf1f0 msgr2=0x7f20d41e81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.450+0000 7f20da7ab640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d40cf1f0 0x7f20d41e81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.450+0000 7f20da7ab640 1 -- 172.21.15.60:0/1609462435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d41e88f0 con 0x7f20d415e7a0 2024-09-12T01:36:20.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.450+0000 7f20da7ab640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d415e7a0 0x7f20d415fe70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00c780 tx=0x7f20cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:20.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.450+0000 7f20ca7fc640 1 -- 172.21.15.60:0/1609462435 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc018070 con 0x7f20d415e7a0 2024-09-12T01:36:20.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.450+0000 7f20ca7fc640 1 -- 172.21.15.60:0/1609462435 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20cc00ce30 con 0x7f20d415e7a0 2024-09-12T01:36:20.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.450+0000 7f20dc20e640 1 -- 172.21.15.60:0/1609462435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d4146ae0 con 0x7f20d415e7a0 2024-09-12T01:36:20.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.450+0000 7f20ca7fc640 1 -- 172.21.15.60:0/1609462435 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20cc00a840 con 0x7f20d415e7a0 2024-09-12T01:36:20.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.450+0000 7f20dc20e640 1 -- 172.21.15.60:0/1609462435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d41470a0 con 0x7f20d415e7a0 2024-09-12T01:36:20.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.451+0000 7f20dc20e640 1 -- 172.21.15.60:0/1609462435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d406caa0 con 0x7f20d415e7a0 2024-09-12T01:36:20.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.452+0000 7f20ca7fc640 1 -- 172.21.15.60:0/1609462435 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20cc01b070 con 0x7f20d415e7a0 2024-09-12T01:36:20.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.452+0000 7f20ca7fc640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f20b806be60 0x7f20b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.452+0000 7f20ca7fc640 1 -- 172.21.15.60:0/1609462435 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f20cc08a2d0 con 0x7f20d415e7a0 2024-09-12T01:36:20.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.452+0000 7f20d9faa640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f20b806be60 0x7f20b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.453+0000 7f20d9faa640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f20b806be60 0x7f20b806e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f20d0034000 tx=0x7f20d002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:20.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.456+0000 7f20ca7fc640 1 -- 172.21.15.60:0/1609462435 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20cc0585a0 con 0x7f20d415e7a0 2024-09-12T01:36:20.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.630+0000 7f20dc20e640 1 -- 172.21.15.60:0/1609462435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f20d40d2a80 con 0x7f20d415e7a0 2024-09-12T01:36:20.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.630+0000 7f20ca7fc640 1 -- 172.21.15.60:0/1609462435 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f20cc05c8a0 con 0x7f20d415e7a0 2024-09-12T01:36:20.629 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 64 2024-09-12T01:36:20.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.632+0000 7f20dc20e640 1 -- 172.21.15.60:0/1609462435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f20b806be60 msgr2=0x7f20b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.632+0000 7f20dc20e640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f20b806be60 0x7f20b806e320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f20d0034000 tx=0x7f20d002e000 comp rx=0 tx=0).stop 2024-09-12T01:36:20.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.632+0000 7f20dc20e640 1 -- 172.21.15.60:0/1609462435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d415e7a0 msgr2=0x7f20d415fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.632+0000 7f20dc20e640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d415e7a0 0x7f20d415fe70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00c780 tx=0x7f20cc00cc40 comp rx=0 tx=0).stop 2024-09-12T01:36:20.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.632+0000 7f20dc20e640 1 -- 172.21.15.60:0/1609462435 shutdown_connections 2024-09-12T01:36:20.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.632+0000 7f20dc20e640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d415e7a0 0x7f20d415fe70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.632+0000 7f20dc20e640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d40cf1f0 0x7f20d41e81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.632+0000 7f20dc20e640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f20b806be60 0x7f20b806e320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.632+0000 7f20dc20e640 1 --2- 172.21.15.60:0/1609462435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d40b68f0 0x7f20d4161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.632+0000 7f20dc20e640 1 -- 172.21.15.60:0/1609462435 >> 172.21.15.60:0/1609462435 conn(0x7f20d40d11e0 msgr2=0x7f20d40d48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:20.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.632+0000 7f20dc20e640 1 -- 172.21.15.60:0/1609462435 shutdown_connections 2024-09-12T01:36:20.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.633+0000 7f20dc20e640 1 -- 172.21.15.60:0/1609462435 wait complete. 2024-09-12T01:36:20.644 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir' 2024-09-12T01:36:20.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.747+0000 7f28aaf9f640 1 Processor -- start 2024-09-12T01:36:20.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.747+0000 7f28aaf9f640 1 -- start start 2024-09-12T01:36:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.748+0000 7f28aaf9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a415e7a0 0x7f28a40ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.748+0000 7f28aaf9f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f28a40cf2f0 0x7f28a40cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.748+0000 7f28aaf9f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a40d4400 con 0x7f28a40d3fe0 2024-09-12T01:36:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.748+0000 7f28aaf9f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f28a40d2f40 con 0x7f28a40cf2f0 2024-09-12T01:36:20.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.748+0000 7f28aaf9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f28a40d3220 con 0x7f28a415e7a0 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.748+0000 7f289bfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f28a40d3fe0 0x7f28a40d2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55314/0 (socket says 172.21.15.60:55314) 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.748+0000 7f289bfff640 1 -- 172.21.15.60:0/1914547133 learned_addr learned my addr 172.21.15.60:0/1914547133 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f28a953c640 1 --2- 172.21.15.60:0/1914547133 >> v2:172.21.15.105:3300/0 conn(0x7f28a40cf2f0 0x7f28a40cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f28a8d3b640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a415e7a0 0x7f28a40ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3849018507 0 0) 0x7f28a40d4400 con 0x7f28a40d3fe0 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f288c003520 con 0x7f28a40d3fe0 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3084573732 0 0) 0x7f288c003520 con 0x7f28a40d3fe0 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a415e7a0 msgr2=0x7f28a40ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a415e7a0 0x7f28a40ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 >> v2:172.21.15.105:3300/0 conn(0x7f28a40cf2f0 msgr2=0x7f28a40cf7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 --2- 172.21.15.60:0/1914547133 >> v2:172.21.15.105:3300/0 conn(0x7f28a40cf2f0 0x7f28a40cf7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a40d3500 con 0x7f28a40d3fe0 2024-09-12T01:36:20.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f2894001670 con 0x7f28a40d3fe0 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 >> v1:172.21.15.60:6789/0 conn(0x7f28a40d3fe0 legacy=0x7f28a40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f288c0039b0 0x7f288c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288c004800 0x7f288c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a415e7a0 0x7f288c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40d2f40 con 0x7f288c0039b0 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40d3220 con 0x7f288c004800 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f288c00b9c0 con 0x7f28a415e7a0 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f28a8d3b640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f288c0039b0 0x7f288c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f289bfff640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288c004800 0x7f288c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f28a953c640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a415e7a0 0x7f288c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f28a8d3b640 1 -- 172.21.15.60:0/1914547133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a415e7a0 msgr2=0x7f288c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f28a8d3b640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a415e7a0 0x7f288c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f28a8d3b640 1 -- 172.21.15.60:0/1914547133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288c004800 msgr2=0x7f288c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f28a8d3b640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288c004800 0x7f288c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f28a8d3b640 1 -- 172.21.15.60:0/1914547133 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288c003520 con 0x7f288c0039b0 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.749+0000 7f28a953c640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a415e7a0 0x7f288c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.750+0000 7f28a8d3b640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f288c0039b0 0x7f288c003dd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009ac0 tx=0x7f288c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc25cb4959f6c1a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.750+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a0036070 con 0x7f288c0039b0 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.750+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28a0031400 con 0x7f288c0039b0 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.750+0000 7f289b7fe640 1 -- 172.21.15.60:0/1914547133 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a0009690 con 0x7f288c0039b0 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.751+0000 7f28aaf9f640 1 -- 172.21.15.60:0/1914547133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f288c0039b0 msgr2=0x7f288c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.751+0000 7f28aaf9f640 1 --2- 172.21.15.60:0/1914547133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f288c0039b0 0x7f288c003dd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009ac0 tx=0x7f288c005830 comp rx=0 tx=0).stop 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.751+0000 7f28a953c640 1 -- 172.21.15.60:0/1914547133 reap_dead start 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.751+0000 7f28aaf9f640 1 -- 172.21.15.60:0/1914547133 shutdown_connections 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.751+0000 7f28aaf9f640 1 -- 172.21.15.60:0/1914547133 >> 172.21.15.60:0/1914547133 conn(0x7f28a40d1550 msgr2=0x7f28a40d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:20.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.751+0000 7f28aaf9f640 1 -- 172.21.15.60:0/1914547133 shutdown_connections 2024-09-12T01:36:20.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.751+0000 7f28aaf9f640 1 -- 172.21.15.60:0/1914547133 wait complete. 2024-09-12T01:36:20.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.752+0000 7f28aaf9f640 1 Processor -- start 2024-09-12T01:36:20.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.752+0000 7f28aaf9f640 1 -- start start 2024-09-12T01:36:20.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f28aaf9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288c0039b0 0x7f28a4160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f28aaf9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40cb6f0 0x7f28a41515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f28aaf9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40cbb50 0x7f28a4151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f28aaf9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f28a415eb80 con 0x7f28a40cb6f0 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f28aaf9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40d3ac0 con 0x7f288c0039b0 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f28aaf9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f28a415ed00 con 0x7f28a40cbb50 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f289bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40cb6f0 0x7f28a41515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f289bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40cb6f0 0x7f28a41515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52148/0 (socket says 172.21.15.60:52148) 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f289bfff640 1 -- 172.21.15.60:0/4292400797 learned_addr learned my addr 172.21.15.60:0/4292400797 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f28a8d3b640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288c0039b0 0x7f28a4160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f28a953c640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40cbb50 0x7f28a4151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f289bfff640 1 -- 172.21.15.60:0/4292400797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40cbb50 msgr2=0x7f28a4151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f289bfff640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40cbb50 0x7f28a4151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f289bfff640 1 -- 172.21.15.60:0/4292400797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288c0039b0 msgr2=0x7f28a4160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f289bfff640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288c0039b0 0x7f28a4160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.753+0000 7f289bfff640 1 -- 172.21.15.60:0/4292400797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a4152070 con 0x7f28a40cb6f0 2024-09-12T01:36:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.754+0000 7f289bfff640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40cb6f0 0x7f28a41515f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2894007310 tx=0x7f28940077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.754+0000 7f28997fa640 1 -- 172.21.15.60:0/4292400797 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289400f9c0 con 0x7f28a40cb6f0 2024-09-12T01:36:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.754+0000 7f28997fa640 1 -- 172.21.15.60:0/4292400797 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2894018070 con 0x7f28a40cb6f0 2024-09-12T01:36:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.754+0000 7f28997fa640 1 -- 172.21.15.60:0/4292400797 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289400fdc0 con 0x7f28a40cb6f0 2024-09-12T01:36:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.754+0000 7f28aaf9f640 1 -- 172.21.15.60:0/4292400797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a40cc060 con 0x7f28a40cb6f0 2024-09-12T01:36:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.754+0000 7f28aaf9f640 1 -- 172.21.15.60:0/4292400797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a40cc900 con 0x7f28a40cb6f0 2024-09-12T01:36:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.755+0000 7f28aaf9f640 1 -- 172.21.15.60:0/4292400797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a40ba240 con 0x7f28a40cb6f0 2024-09-12T01:36:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.755+0000 7f28997fa640 1 -- 172.21.15.60:0/4292400797 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f289401d460 con 0x7f28a40cb6f0 2024-09-12T01:36:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.756+0000 7f28997fa640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f289006be60 0x7f289006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.756+0000 7f28997fa640 1 -- 172.21.15.60:0/4292400797 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f289408af90 con 0x7f28a40cb6f0 2024-09-12T01:36:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.756+0000 7f28a8d3b640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f289006be60 0x7f289006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:20.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.756+0000 7f28a8d3b640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f289006be60 0x7f289006e320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f28a0033000 tx=0x7f28a0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:20.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:20.760+0000 7f28997fa640 1 -- 172.21.15.60:0/4292400797 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2894059940 con 0x7f28a40cb6f0 2024-09-12T01:36:21.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.006+0000 7f28aaf9f640 1 -- 172.21.15.60:0/4292400797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]} v 0) -- 0x7f28a40cc3f0 con 0x7f28a40cb6f0 2024-09-12T01:36:21.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.834+0000 7f28997fa640 1 -- 172.21.15.60:0/4292400797 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]}]=0 v49) ==== 168+0+0 (secure 0 0 0) 0x7f2894059240 con 0x7f28a40cb6f0 2024-09-12T01:36:21.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.837+0000 7f28aaf9f640 1 -- 172.21.15.60:0/4292400797 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f289006be60 msgr2=0x7f289006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:21.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.837+0000 7f28aaf9f640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f289006be60 0x7f289006e320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f28a0033000 tx=0x7f28a0008030 comp rx=0 tx=0).stop 2024-09-12T01:36:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.837+0000 7f28aaf9f640 1 -- 172.21.15.60:0/4292400797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40cb6f0 msgr2=0x7f28a41515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.837+0000 7f28aaf9f640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40cb6f0 0x7f28a41515f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2894007310 tx=0x7f28940077d0 comp rx=0 tx=0).stop 2024-09-12T01:36:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.837+0000 7f28aaf9f640 1 -- 172.21.15.60:0/4292400797 shutdown_connections 2024-09-12T01:36:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.837+0000 7f28aaf9f640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f289006be60 0x7f289006e320 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.837+0000 7f28aaf9f640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40cbb50 0x7f28a4151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.837+0000 7f28aaf9f640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40cb6f0 0x7f28a41515f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.837+0000 7f28aaf9f640 1 --2- 172.21.15.60:0/4292400797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f288c0039b0 0x7f28a4160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.837+0000 7f28aaf9f640 1 -- 172.21.15.60:0/4292400797 >> 172.21.15.60:0/4292400797 conn(0x7f28a40d1550 msgr2=0x7f28a406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.837+0000 7f28aaf9f640 1 -- 172.21.15.60:0/4292400797 shutdown_connections 2024-09-12T01:36:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.837+0000 7f28aaf9f640 1 -- 172.21.15.60:0/4292400797 wait complete. 2024-09-12T01:36:21.850 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:36:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.963+0000 7f62569d6640 1 Processor -- start 2024-09-12T01:36:21.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.963+0000 7f62569d6640 1 -- start start 2024-09-12T01:36:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.964+0000 7f62569d6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f62500d1130 0x7f62500d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.964+0000 7f62569d6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62500d4530 con 0x7f62500d0060 2024-09-12T01:36:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.964+0000 7f62569d6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62500d3490 con 0x7f62500d1a50 2024-09-12T01:36:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.964+0000 7f62569d6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f62500d40a0 con 0x7f62500d1130 2024-09-12T01:36:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.964+0000 7f624ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f62500d1130 0x7f62500d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.964+0000 7f624ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f62500d1130 0x7f62500d1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52152/0 (socket says 172.21.15.60:52152) 2024-09-12T01:36:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.964+0000 7f624ffff640 1 -- 172.21.15.60:0/2623119660 learned_addr learned my addr 172.21.15.60:0/2623119660 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.964+0000 7f6254f73640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f62500d0060 0x7f62500b8330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55324/0 (socket says 172.21.15.60:55324) 2024-09-12T01:36:21.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.965+0000 7f624ffff640 1 -- 172.21.15.60:0/2623119660 >> v1:172.21.15.105:6789/0 conn(0x7f62500d1a50 legacy=0x7f62500b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.965+0000 7f624ffff640 1 -- 172.21.15.60:0/2623119660 >> v1:172.21.15.60:6789/0 conn(0x7f62500d0060 legacy=0x7f62500b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.965+0000 7f624effd640 1 -- 172.21.15.60:0/2623119660 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318734890 0 0) 0x7f62500d4530 con 0x7f62500d0060 2024-09-12T01:36:21.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.965+0000 7f624ffff640 1 -- 172.21.15.60:0/2623119660 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62500d3770 con 0x7f62500d1130 2024-09-12T01:36:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.965+0000 7f624ffff640 1 --2- 172.21.15.60:0/2623119660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62500d1130 0x7f62500d1510 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6240009870 tx=0x7f624002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66391c72c640272 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.966+0000 7f624effd640 1 -- 172.21.15.60:0/2623119660 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240037070 con 0x7f62500d1130 2024-09-12T01:36:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.966+0000 7f624effd640 1 -- 172.21.15.60:0/2623119660 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6240032440 con 0x7f62500d1130 2024-09-12T01:36:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.966+0000 7f624effd640 1 -- 172.21.15.60:0/2623119660 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240032810 con 0x7f62500d1130 2024-09-12T01:36:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.966+0000 7f62569d6640 1 -- 172.21.15.60:0/2623119660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62500d1130 msgr2=0x7f62500d1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.966+0000 7f62569d6640 1 --2- 172.21.15.60:0/2623119660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62500d1130 0x7f62500d1510 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6240009870 tx=0x7f624002a270 comp rx=0 tx=0).stop 2024-09-12T01:36:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.966+0000 7f62569d6640 1 -- 172.21.15.60:0/2623119660 shutdown_connections 2024-09-12T01:36:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.966+0000 7f62569d6640 1 --2- 172.21.15.60:0/2623119660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62500d1130 0x7f62500d1510 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:21.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.966+0000 7f62569d6640 1 -- 172.21.15.60:0/2623119660 >> 172.21.15.60:0/2623119660 conn(0x7f625006c020 msgr2=0x7f625006c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.966+0000 7f62569d6640 1 -- 172.21.15.60:0/2623119660 shutdown_connections 2024-09-12T01:36:21.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.966+0000 7f62569d6640 1 -- 172.21.15.60:0/2623119660 wait complete. 2024-09-12T01:36:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.967+0000 7f62569d6640 1 Processor -- start 2024-09-12T01:36:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.968+0000 7f62569d6640 1 -- start start 2024-09-12T01:36:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.968+0000 7f62569d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62500d1130 0x7f62500ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.968+0000 7f62569d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62500d1a50 0x7f62501e64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.968+0000 7f62569d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62501e69e0 0x7f62501e84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.968+0000 7f62569d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f62500d1e90 con 0x7f62500d1a50 2024-09-12T01:36:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.968+0000 7f62569d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62500d3d30 con 0x7f62500d1130 2024-09-12T01:36:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.968+0000 7f62569d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f62500d3070 con 0x7f62501e69e0 2024-09-12T01:36:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.968+0000 7f624f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62500d1a50 0x7f62501e64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.968+0000 7f624f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62500d1a50 0x7f62501e64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52168/0 (socket says 172.21.15.60:52168) 2024-09-12T01:36:21.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f624f7fe640 1 -- 172.21.15.60:0/3304477987 learned_addr learned my addr 172.21.15.60:0/3304477987 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f624ffff640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62500d1130 0x7f62500ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f6254f73640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62501e69e0 0x7f62501e84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f624f7fe640 1 -- 172.21.15.60:0/3304477987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62501e69e0 msgr2=0x7f62501e84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f624f7fe640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62501e69e0 0x7f62501e84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f624f7fe640 1 -- 172.21.15.60:0/3304477987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62500d1130 msgr2=0x7f62500ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f624f7fe640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62500d1130 0x7f62500ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f624f7fe640 1 -- 172.21.15.60:0/3304477987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6250159440 con 0x7f62500d1a50 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f6254f73640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62501e69e0 0x7f62501e84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f624f7fe640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62500d1a50 0x7f62501e64a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f624400c430 tx=0x7f624400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f624cff9640 1 -- 172.21.15.60:0/3304477987 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244017070 con 0x7f62500d1a50 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f624cff9640 1 -- 172.21.15.60:0/3304477987 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62440052d0 con 0x7f62500d1a50 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f624cff9640 1 -- 172.21.15.60:0/3304477987 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6244003830 con 0x7f62500d1a50 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f62569d6640 1 -- 172.21.15.60:0/3304477987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62501e91b0 con 0x7f62500d1a50 2024-09-12T01:36:21.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.969+0000 7f62569d6640 1 -- 172.21.15.60:0/3304477987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62501e9770 con 0x7f62500d1a50 2024-09-12T01:36:21.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.970+0000 7f62569d6640 1 -- 172.21.15.60:0/3304477987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62500d1510 con 0x7f62500d1a50 2024-09-12T01:36:21.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.971+0000 7f624cff9640 1 -- 172.21.15.60:0/3304477987 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f624401a070 con 0x7f62500d1a50 2024-09-12T01:36:21.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.971+0000 7f624cff9640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f623c06be30 0x7f623c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:21.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.971+0000 7f624cff9640 1 -- 172.21.15.60:0/3304477987 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f624408a140 con 0x7f62500d1a50 2024-09-12T01:36:21.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.971+0000 7f624ffff640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f623c06be30 0x7f623c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:21.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.972+0000 7f624ffff640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f623c06be30 0x7f623c06e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6240034000 tx=0x7f624002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:21.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:21.976+0000 7f624cff9640 1 -- 172.21.15.60:0/3304477987 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6250159440 con 0x7f62500d1a50 2024-09-12T01:36:22.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.150+0000 7f62569d6640 1 -- 172.21.15.60:0/3304477987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f62500cc8e0 con 0x7f62500d1a50 2024-09-12T01:36:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.153+0000 7f624cff9640 1 -- 172.21.15.60:0/3304477987 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f62440584a0 con 0x7f62500d1a50 2024-09-12T01:36:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.155+0000 7f62569d6640 1 -- 172.21.15.60:0/3304477987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f623c06be30 msgr2=0x7f623c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.155+0000 7f62569d6640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f623c06be30 0x7f623c06e2f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6240034000 tx=0x7f624002e000 comp rx=0 tx=0).stop 2024-09-12T01:36:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.155+0000 7f62569d6640 1 -- 172.21.15.60:0/3304477987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62500d1a50 msgr2=0x7f62501e64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.155+0000 7f62569d6640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62500d1a50 0x7f62501e64a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f624400c430 tx=0x7f624400c8f0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.155+0000 7f62569d6640 1 -- 172.21.15.60:0/3304477987 shutdown_connections 2024-09-12T01:36:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.155+0000 7f62569d6640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f623c06be30 0x7f623c06e2f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.155+0000 7f62569d6640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62501e69e0 0x7f62501e84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.155+0000 7f62569d6640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62500d1a50 0x7f62501e64a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.155+0000 7f62569d6640 1 --2- 172.21.15.60:0/3304477987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f62500d1130 0x7f62500ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.155+0000 7f62569d6640 1 -- 172.21.15.60:0/3304477987 >> 172.21.15.60:0/3304477987 conn(0x7f625006c020 msgr2=0x7f62500b9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.155+0000 7f62569d6640 1 -- 172.21.15.60:0/3304477987 shutdown_connections 2024-09-12T01:36:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.155+0000 7f62569d6640 1 -- 172.21.15.60:0/3304477987 wait complete. 2024-09-12T01:36:22.166 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:36:22.166 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:36:22.207 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:36:22.255 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:36:22.255 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:22.256 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:22.272 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:22.272 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:22.328 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:22.329 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:22.386 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:36:22.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.530+0000 7fc96dae6640 1 Processor -- start 2024-09-12T01:36:22.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.530+0000 7fc96dae6640 1 -- start start 2024-09-12T01:36:22.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc96dae6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc96815c490 0x7fc96806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:22.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc96dae6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9680b66a0 0x7fc9680cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:22.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc96dae6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc968073290 con 0x7fc9680b6230 2024-09-12T01:36:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc96dae6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc9680742f0 con 0x7fc96815c490 2024-09-12T01:36:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc96dae6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc968073b30 con 0x7fc9680b66a0 2024-09-12T01:36:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc9677fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc96815c490 0x7fc96806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc95ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc9680b6230 0x7fc9680d08f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55326/0 (socket says 172.21.15.60:55326) 2024-09-12T01:36:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc95ffff640 1 -- 172.21.15.60:0/3374301909 learned_addr learned my addr 172.21.15.60:0/3374301909 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc9677fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc96815c490 0x7fc96806fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52184/0 (socket says 172.21.15.60:52184) 2024-09-12T01:36:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc967fff640 1 --2- 172.21.15.60:0/3374301909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9680b66a0 0x7fc9680cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc9677fe640 1 -- 172.21.15.60:0/3374301909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9680b66a0 msgr2=0x7fc9680cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc9677fe640 1 --2- 172.21.15.60:0/3374301909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9680b66a0 0x7fc9680cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc9677fe640 1 -- 172.21.15.60:0/3374301909 >> v1:172.21.15.60:6789/0 conn(0x7fc9680b6230 legacy=0x7fc9680d08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc9677fe640 1 -- 172.21.15.60:0/3374301909 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc968073530 con 0x7fc96815c490 2024-09-12T01:36:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc966ffd640 1 -- 172.21.15.60:0/3374301909 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 145280159 0 0) 0x7fc968073290 con 0x7fc9680b6230 2024-09-12T01:36:22.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.531+0000 7fc967fff640 1 --2- 172.21.15.60:0/3374301909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9680b66a0 0x7fc9680cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:22.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.532+0000 7fc9677fe640 1 --2- 172.21.15.60:0/3374301909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc96815c490 0x7fc96806fd70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc9580097a0 tx=0x7fc95802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eef2df0d5a8093c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:22.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.532+0000 7fc966ffd640 1 -- 172.21.15.60:0/3374301909 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958037070 con 0x7fc96815c490 2024-09-12T01:36:22.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.532+0000 7fc966ffd640 1 -- 172.21.15.60:0/3374301909 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc958032440 con 0x7fc96815c490 2024-09-12T01:36:22.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.532+0000 7fc966ffd640 1 -- 172.21.15.60:0/3374301909 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc958032810 con 0x7fc96815c490 2024-09-12T01:36:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.533+0000 7fc96dae6640 1 -- 172.21.15.60:0/3374301909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc96815c490 msgr2=0x7fc96806fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.533+0000 7fc96dae6640 1 --2- 172.21.15.60:0/3374301909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc96815c490 0x7fc96806fd70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc9580097a0 tx=0x7fc95802a210 comp rx=0 tx=0).stop 2024-09-12T01:36:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.533+0000 7fc96dae6640 1 -- 172.21.15.60:0/3374301909 shutdown_connections 2024-09-12T01:36:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.533+0000 7fc96dae6640 1 --2- 172.21.15.60:0/3374301909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9680b66a0 0x7fc9680cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.533+0000 7fc96dae6640 1 --2- 172.21.15.60:0/3374301909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc96815c490 0x7fc96806fd70 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.533+0000 7fc96dae6640 1 -- 172.21.15.60:0/3374301909 >> 172.21.15.60:0/3374301909 conn(0x7fc9680b7d70 msgr2=0x7fc968062630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.533+0000 7fc96dae6640 1 -- 172.21.15.60:0/3374301909 shutdown_connections 2024-09-12T01:36:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.533+0000 7fc96dae6640 1 -- 172.21.15.60:0/3374301909 wait complete. 2024-09-12T01:36:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.534+0000 7fc96dae6640 1 Processor -- start 2024-09-12T01:36:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.534+0000 7fc96dae6640 1 -- start start 2024-09-12T01:36:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc96dae6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9680b6230 0x7fc96814c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc96dae6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9680b66a0 0x7fc9680ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc96dae6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc96815c490 0x7fc9681596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc96dae6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc9680702b0 con 0x7fc9680b66a0 2024-09-12T01:36:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc96dae6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc968073810 con 0x7fc96815c490 2024-09-12T01:36:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc96dae6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc9680d1000 con 0x7fc9680b6230 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc95ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9680b66a0 0x7fc9680ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc95ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9680b66a0 0x7fc9680ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52186/0 (socket says 172.21.15.60:52186) 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc95ffff640 1 -- 172.21.15.60:0/1191394256 learned_addr learned my addr 172.21.15.60:0/1191394256 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc95ffff640 1 -- 172.21.15.60:0/1191394256 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9680b6230 msgr2=0x7fc96814c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc95ffff640 1 --2- 172.21.15.60:0/1191394256 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9680b6230 0x7fc96814c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc95ffff640 1 -- 172.21.15.60:0/1191394256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc96815c490 msgr2=0x7fc9681596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc95ffff640 1 --2- 172.21.15.60:0/1191394256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc96815c490 0x7fc9681596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc95ffff640 1 -- 172.21.15.60:0/1191394256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9680af230 con 0x7fc9680b66a0 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.535+0000 7fc95ffff640 1 --2- 172.21.15.60:0/1191394256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9680b66a0 0x7fc9680ae890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc95000c4d0 tx=0x7fc95000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.536+0000 7fc964ff9640 1 -- 172.21.15.60:0/1191394256 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950018070 con 0x7fc9680b66a0 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.536+0000 7fc964ff9640 1 -- 172.21.15.60:0/1191394256 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc950007500 con 0x7fc9680b66a0 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.536+0000 7fc96dae6640 1 -- 172.21.15.60:0/1191394256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9680af510 con 0x7fc9680b66a0 2024-09-12T01:36:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.536+0000 7fc964ff9640 1 -- 172.21.15.60:0/1191394256 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc950004a20 con 0x7fc9680b66a0 2024-09-12T01:36:22.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.536+0000 7fc96dae6640 1 -- 172.21.15.60:0/1191394256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9680afad0 con 0x7fc9680b66a0 2024-09-12T01:36:22.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.537+0000 7fc96dae6640 1 -- 172.21.15.60:0/1191394256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc96806c740 con 0x7fc9680b66a0 2024-09-12T01:36:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.537+0000 7fc964ff9640 1 -- 172.21.15.60:0/1191394256 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc95001b070 con 0x7fc9680b66a0 2024-09-12T01:36:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.538+0000 7fc964ff9640 1 --2- 172.21.15.60:0/1191394256 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc94806be30 0x7fc94806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.538+0000 7fc964ff9640 1 -- 172.21.15.60:0/1191394256 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc95008a1f0 con 0x7fc9680b66a0 2024-09-12T01:36:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.538+0000 7fc9677fe640 1 --2- 172.21.15.60:0/1191394256 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc94806be30 0x7fc94806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.538+0000 7fc9677fe640 1 --2- 172.21.15.60:0/1191394256 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc94806be30 0x7fc94806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc958034000 tx=0x7fc95802c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:22.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.542+0000 7fc964ff9640 1 -- 172.21.15.60:0/1191394256 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc950058b90 con 0x7fc9680b66a0 2024-09-12T01:36:22.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.729+0000 7fc96dae6640 1 -- 172.21.15.60:0/1191394256 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc9680629b0 con 0x7fc9680b66a0 2024-09-12T01:36:22.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.729+0000 7fc964ff9640 1 -- 172.21.15.60:0/1191394256 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fc950058490 con 0x7fc9680b66a0 2024-09-12T01:36:22.729 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:36:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.731+0000 7fc96dae6640 1 -- 172.21.15.60:0/1191394256 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc94806be30 msgr2=0x7fc94806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.731+0000 7fc96dae6640 1 --2- 172.21.15.60:0/1191394256 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc94806be30 0x7fc94806e2f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc958034000 tx=0x7fc95802c000 comp rx=0 tx=0).stop 2024-09-12T01:36:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.731+0000 7fc96dae6640 1 -- 172.21.15.60:0/1191394256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9680b66a0 msgr2=0x7fc9680ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.731+0000 7fc96dae6640 1 --2- 172.21.15.60:0/1191394256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9680b66a0 0x7fc9680ae890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc95000c4d0 tx=0x7fc95000c990 comp rx=0 tx=0).stop 2024-09-12T01:36:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.731+0000 7fc96dae6640 1 -- 172.21.15.60:0/1191394256 shutdown_connections 2024-09-12T01:36:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.731+0000 7fc96dae6640 1 --2- 172.21.15.60:0/1191394256 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc96815c490 0x7fc9681596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.731+0000 7fc96dae6640 1 --2- 172.21.15.60:0/1191394256 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9680b66a0 0x7fc9680ae890 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.731+0000 7fc96dae6640 1 --2- 172.21.15.60:0/1191394256 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc94806be30 0x7fc94806e2f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.731+0000 7fc96dae6640 1 --2- 172.21.15.60:0/1191394256 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9680b6230 0x7fc96814c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.731+0000 7fc96dae6640 1 -- 172.21.15.60:0/1191394256 >> 172.21.15.60:0/1191394256 conn(0x7fc9680b7d70 msgr2=0x7fc9680b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.731+0000 7fc96dae6640 1 -- 172.21.15.60:0/1191394256 shutdown_connections 2024-09-12T01:36:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:22.731+0000 7fc96dae6640 1 -- 172.21.15.60:0/1191394256 wait complete. 2024-09-12T01:36:22.742 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:36:22.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:22.742 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-12T01:36:22.769 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:36:22.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:22.769 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:36:22.831 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:36:22.831 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:22.851 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:36:22.852 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:22.910 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:36:22.910 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:22.969 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:36:23.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.074+0000 7f6ae6e1e640 1 Processor -- start 2024-09-12T01:36:23.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.074+0000 7f6ae6e1e640 1 -- start start 2024-09-12T01:36:23.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6ae6e1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00b6850 0x7f6ae00b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6ae6e1e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae015ed20 con 0x7f6ae015e940 2024-09-12T01:36:23.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6ae6e1e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ae00d32e0 con 0x7f6ae00ba440 2024-09-12T01:36:23.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6ae6e1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae00d3ef0 con 0x7f6ae00b6850 2024-09-12T01:36:23.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6ae4bba640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6ae015e940 0x7f6ae00b6140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48866/0 (socket says 172.21.15.60:48866) 2024-09-12T01:36:23.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6ae4bba640 1 -- 172.21.15.60:0/3010294157 learned_addr learned my addr 172.21.15.60:0/3010294157 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:23.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adffff640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00b6850 0x7f6ae00b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382143561 0 0) 0x7f6ae015ed20 con 0x7f6ae015e940 2024-09-12T01:36:23.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad0003520 con 0x7f6ae015e940 2024-09-12T01:36:23.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419741353 0 0) 0x7f6ae00d32e0 con 0x7f6ae00ba440 2024-09-12T01:36:23.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ae015ed20 con 0x7f6ae00ba440 2024-09-12T01:36:23.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3307520942 0 0) 0x7f6ad0003520 con 0x7f6ae015e940 2024-09-12T01:36:23.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00b6850 msgr2=0x7f6ae00b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:23.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adf7fe640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00b6850 0x7f6ae00b7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 >> v1:172.21.15.105:6789/0 conn(0x7f6ae00ba440 legacy=0x7f6ae00b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae00d35c0 con 0x7f6ae015e940 2024-09-12T01:36:23.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f6ad40015f0 con 0x7f6ae015e940 2024-09-12T01:36:23.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adffff640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00b6850 0x7f6ae00b7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:23.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.075+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 >> v1:172.21.15.60:6789/0 conn(0x7f6ae015e940 legacy=0x7f6ae00b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6adf7fe640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00b6850 0x7f6ad0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6adf7fe640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad0004100 0x7f6ad0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6adf7fe640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ad0004d40 0x7f6ad00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae00d3ef0 con 0x7f6ad0004d40 2024-09-12T01:36:23.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad000bb80 con 0x7f6ad0004100 2024-09-12T01:36:23.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6ad000bd80 con 0x7f6ae00b6850 2024-09-12T01:36:23.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6ae53bb640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ad0004d40 0x7f6ad00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6ae4bba640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00b6850 0x7f6ad0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6adffff640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad0004100 0x7f6ad0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6ae53bb640 1 -- 172.21.15.60:0/3010294157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00b6850 msgr2=0x7f6ad0003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6ae53bb640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00b6850 0x7f6ad0003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6ae53bb640 1 -- 172.21.15.60:0/3010294157 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad0004100 msgr2=0x7f6ad0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6ae53bb640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ad0004100 0x7f6ad0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.076+0000 7f6ae53bb640 1 -- 172.21.15.60:0/3010294157 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad0003520 con 0x7f6ad0004d40 2024-09-12T01:36:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.077+0000 7f6ae53bb640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ad0004d40 0x7f6ad00051c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8001fa0 tx=0x7f6ad0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f408e07b192d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.077+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8001bf0 con 0x7f6ad0004d40 2024-09-12T01:36:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.077+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad8003b70 con 0x7f6ad0004d40 2024-09-12T01:36:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.077+0000 7f6adf7fe640 1 -- 172.21.15.60:0/3010294157 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80050d0 con 0x7f6ad0004d40 2024-09-12T01:36:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.077+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/3010294157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ad0004d40 msgr2=0x7f6ad00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.077+0000 7f6ae6e1e640 1 --2- 172.21.15.60:0/3010294157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ad0004d40 0x7f6ad00051c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8001fa0 tx=0x7f6ad0005830 comp rx=0 tx=0).stop 2024-09-12T01:36:23.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.077+0000 7f6ae53bb640 1 -- 172.21.15.60:0/3010294157 reap_dead start 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.077+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/3010294157 shutdown_connections 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.077+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/3010294157 >> 172.21.15.60:0/3010294157 conn(0x7f6ae00d1140 msgr2=0x7f6ae00d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.077+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/3010294157 shutdown_connections 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.078+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/3010294157 wait complete. 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.079+0000 7f6ae6e1e640 1 Processor -- start 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.079+0000 7f6ae6e1e640 1 -- start start 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae6e1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ad0004d40 0x7f6ae00ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae6e1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae00cdf70 0x7f6ae015dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae6e1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00cc9b0 0x7f6ae015ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae6e1e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae00b7510 con 0x7f6ad0004d40 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae6e1e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6ae00d3b80 con 0x7f6ae00cdf70 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae6e1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6ae00d2290 con 0x7f6ae00cc9b0 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae4bba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ad0004d40 0x7f6ae00ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae4bba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ad0004d40 0x7f6ae00ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53808/0 (socket says 172.21.15.60:53808) 2024-09-12T01:36:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae4bba640 1 -- 172.21.15.60:0/1768101529 learned_addr learned my addr 172.21.15.60:0/1768101529 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae53bb640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00cc9b0 0x7f6ae015ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6adffff640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae00cdf70 0x7f6ae015dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae4bba640 1 -- 172.21.15.60:0/1768101529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00cc9b0 msgr2=0x7f6ae015ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae4bba640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00cc9b0 0x7f6ae015ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae4bba640 1 -- 172.21.15.60:0/1768101529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae00cdf70 msgr2=0x7f6ae015dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae4bba640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae00cdf70 0x7f6ae015dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae4bba640 1 -- 172.21.15.60:0/1768101529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ae00cb910 con 0x7f6ad0004d40 2024-09-12T01:36:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae53bb640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00cc9b0 0x7f6ae015ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6adffff640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae00cdf70 0x7f6ae015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae4bba640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ad0004d40 0x7f6ae00ab0e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4004df0 tx=0x7f6ad4007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:23.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6add7fa640 1 -- 172.21.15.60:0/1768101529 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400f750 con 0x7f6ad0004d40 2024-09-12T01:36:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6add7fa640 1 -- 172.21.15.60:0/1768101529 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ad4018070 con 0x7f6ad0004d40 2024-09-12T01:36:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6add7fa640 1 -- 172.21.15.60:0/1768101529 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400fb70 con 0x7f6ad0004d40 2024-09-12T01:36:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/1768101529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ae00cbbf0 con 0x7f6ad0004d40 2024-09-12T01:36:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.080+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/1768101529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ae00cc1b0 con 0x7f6ad0004d40 2024-09-12T01:36:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.081+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/1768101529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae00b6140 con 0x7f6ad0004d40 2024-09-12T01:36:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.082+0000 7f6add7fa640 1 -- 172.21.15.60:0/1768101529 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6ad400fd10 con 0x7f6ad0004d40 2024-09-12T01:36:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.082+0000 7f6add7fa640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ac406be60 0x7f6ac406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.082+0000 7f6add7fa640 1 -- 172.21.15.60:0/1768101529 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6ad408ad60 con 0x7f6ad0004d40 2024-09-12T01:36:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.083+0000 7f6adffff640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ac406be60 0x7f6ac406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.083+0000 7f6adffff640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ac406be60 0x7f6ac406e320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6ae01eacc0 tx=0x7f6acc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:23.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.087+0000 7f6add7fa640 1 -- 172.21.15.60:0/1768101529 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6ad4059710 con 0x7f6ad0004d40 2024-09-12T01:36:23.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.295+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/1768101529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6ae00d0460 con 0x7f6ad0004d40 2024-09-12T01:36:23.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.295+0000 7f6add7fa640 1 -- 172.21.15.60:0/1768101529 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f6ad4059010 con 0x7f6ad0004d40 2024-09-12T01:36:23.294 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:36:23.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.297+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/1768101529 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ac406be60 msgr2=0x7f6ac406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.297+0000 7f6ae6e1e640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ac406be60 0x7f6ac406e320 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6ae01eacc0 tx=0x7f6acc008040 comp rx=0 tx=0).stop 2024-09-12T01:36:23.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.297+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/1768101529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ad0004d40 msgr2=0x7f6ae00ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.297+0000 7f6ae6e1e640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ad0004d40 0x7f6ae00ab0e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4004df0 tx=0x7f6ad4007430 comp rx=0 tx=0).stop 2024-09-12T01:36:23.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.297+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/1768101529 shutdown_connections 2024-09-12T01:36:23.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.297+0000 7f6ae6e1e640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ac406be60 0x7f6ac406e320 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.297+0000 7f6ae6e1e640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ae00cc9b0 0x7f6ae015ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.297+0000 7f6ae6e1e640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ae00cdf70 0x7f6ae015dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.297+0000 7f6ae6e1e640 1 --2- 172.21.15.60:0/1768101529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ad0004d40 0x7f6ae00ab0e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.297+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/1768101529 >> 172.21.15.60:0/1768101529 conn(0x7f6ae00d1140 msgr2=0x7f6ae00cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:23.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.297+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/1768101529 shutdown_connections 2024-09-12T01:36:23.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.297+0000 7f6ae6e1e640 1 -- 172.21.15.60:0/1768101529 wait complete. 2024-09-12T01:36:23.308 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:36:23.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:23.308 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-12T01:36:23.340 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:36:23.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:23.341 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:36:23.436 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:23.436 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:23.453 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:23.453 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:23.509 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:23.509 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:23.566 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:36:23.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.712+0000 7fd8368af640 1 Processor -- start 2024-09-12T01:36:23.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.712+0000 7fd8368af640 1 -- start start 2024-09-12T01:36:23.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd8368af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015e940 0x7fd8300b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd8368af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8300cfd40 con 0x7fd8300d2290 2024-09-12T01:36:23.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd8368af640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83015ed20 con 0x7fd8300ba440 2024-09-12T01:36:23.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd8368af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd8300d3ef0 con 0x7fd83015e940 2024-09-12T01:36:23.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd834e4c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd8300d2290 0x7fd8300cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48870/0 (socket says 172.21.15.60:48870) 2024-09-12T01:36:23.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd834e4c640 1 -- 172.21.15.60:0/1026006843 learned_addr learned my addr 172.21.15.60:0/1026006843 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:23.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854698199 0 0) 0x7fd8300cfd40 con 0x7fd8300d2290 2024-09-12T01:36:23.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd82ffff640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015e940 0x7fd8300b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd818003520 con 0x7fd8300d2290 2024-09-12T01:36:23.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3983942766 0 0) 0x7fd818003520 con 0x7fd8300d2290 2024-09-12T01:36:23.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015e940 msgr2=0x7fd8300b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:23.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd82effd640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015e940 0x7fd8300b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 >> v1:172.21.15.105:6789/0 conn(0x7fd8300ba440 legacy=0x7fd8300cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8300d32e0 con 0x7fd8300d2290 2024-09-12T01:36:23.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fd8280019f0 con 0x7fd8300d2290 2024-09-12T01:36:23.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 >> v1:172.21.15.60:6789/0 conn(0x7fd8300d2290 legacy=0x7fd8300cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd82effd640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8180039e0 0x7fd818003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.713+0000 7fd82effd640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015e940 0x7fd818004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd82effd640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd818004d40 0x7fd8180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd8300d3ef0 con 0x7fd818004d40 2024-09-12T01:36:23.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd81800baf0 con 0x7fd8180039e0 2024-09-12T01:36:23.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd81800bcf0 con 0x7fd83015e940 2024-09-12T01:36:23.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd834e4c640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd818004d40 0x7fd8180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd82ffff640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8180039e0 0x7fd818003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd82f7fe640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015e940 0x7fd818004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd834e4c640 1 -- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015e940 msgr2=0x7fd818004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:23.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd834e4c640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015e940 0x7fd818004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd834e4c640 1 -- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8180039e0 msgr2=0x7fd818003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:23.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd834e4c640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8180039e0 0x7fd818003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd834e4c640 1 -- 172.21.15.60:0/1026006843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd818003520 con 0x7fd818004d40 2024-09-12T01:36:23.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd82f7fe640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015e940 0x7fd818004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:23.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.714+0000 7fd82ffff640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8180039e0 0x7fd818003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:23.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.715+0000 7fd834e4c640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd818004d40 0x7fd8180051c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd82800a840 tx=0x7fd818005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cb8d2c1e15f712 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:23.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.715+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82800a460 con 0x7fd818004d40 2024-09-12T01:36:23.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.715+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd82802f070 con 0x7fd818004d40 2024-09-12T01:36:23.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.715+0000 7fd82effd640 1 -- 172.21.15.60:0/1026006843 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82802bcb0 con 0x7fd818004d40 2024-09-12T01:36:23.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.715+0000 7fd8368af640 1 -- 172.21.15.60:0/1026006843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd818004d40 msgr2=0x7fd8180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.715+0000 7fd8368af640 1 --2- 172.21.15.60:0/1026006843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd818004d40 0x7fd8180051c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd82800a840 tx=0x7fd818005830 comp rx=0 tx=0).stop 2024-09-12T01:36:23.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.715+0000 7fd834e4c640 1 -- 172.21.15.60:0/1026006843 reap_dead start 2024-09-12T01:36:23.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.715+0000 7fd8368af640 1 -- 172.21.15.60:0/1026006843 shutdown_connections 2024-09-12T01:36:23.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.715+0000 7fd8368af640 1 -- 172.21.15.60:0/1026006843 >> 172.21.15.60:0/1026006843 conn(0x7fd8300d1140 msgr2=0x7fd8300d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:23.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.715+0000 7fd8368af640 1 -- 172.21.15.60:0/1026006843 shutdown_connections 2024-09-12T01:36:23.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.715+0000 7fd8368af640 1 -- 172.21.15.60:0/1026006843 wait complete. 2024-09-12T01:36:23.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.717+0000 7fd8368af640 1 Processor -- start 2024-09-12T01:36:23.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.717+0000 7fd8368af640 1 -- start start 2024-09-12T01:36:23.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.717+0000 7fd8368af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd818004d40 0x7fd83015db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.717+0000 7fd8368af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015bf90 0x7fd8300cec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.717+0000 7fd8368af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8300cf1c0 0x7fd8300abef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.717+0000 7fd8368af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd8300d3b80 con 0x7fd818004d40 2024-09-12T01:36:23.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.717+0000 7fd8368af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd8300d38a0 con 0x7fd8300cf1c0 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.717+0000 7fd8368af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd8300b7510 con 0x7fd83015bf90 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd818004d40 0x7fd83015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd818004d40 0x7fd83015db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53828/0 (socket says 172.21.15.60:53828) 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82ffff640 1 -- 172.21.15.60:0/3678187495 learned_addr learned my addr 172.21.15.60:0/3678187495 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82f7fe640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015bf90 0x7fd8300cec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd834e4c640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8300cf1c0 0x7fd8300abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82ffff640 1 -- 172.21.15.60:0/3678187495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015bf90 msgr2=0x7fd8300cec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82ffff640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015bf90 0x7fd8300cec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82ffff640 1 -- 172.21.15.60:0/3678187495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8300cf1c0 msgr2=0x7fd8300abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82ffff640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8300cf1c0 0x7fd8300abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82ffff640 1 -- 172.21.15.60:0/3678187495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8300cb930 con 0x7fd818004d40 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82ffff640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd818004d40 0x7fd83015db90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd8200115a0 tx=0x7fd820011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:23.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82cff9640 1 -- 172.21.15.60:0/3678187495 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820015870 con 0x7fd818004d40 2024-09-12T01:36:23.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82cff9640 1 -- 172.21.15.60:0/3678187495 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd820015a10 con 0x7fd818004d40 2024-09-12T01:36:23.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd8368af640 1 -- 172.21.15.60:0/3678187495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8300cbbd0 con 0x7fd818004d40 2024-09-12T01:36:23.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd82cff9640 1 -- 172.21.15.60:0/3678187495 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820015dc0 con 0x7fd818004d40 2024-09-12T01:36:23.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.718+0000 7fd8368af640 1 -- 172.21.15.60:0/3678187495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8300cc190 con 0x7fd818004d40 2024-09-12T01:36:23.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.719+0000 7fd8368af640 1 -- 172.21.15.60:0/3678187495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8300b6140 con 0x7fd818004d40 2024-09-12T01:36:23.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.720+0000 7fd82cff9640 1 -- 172.21.15.60:0/3678187495 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd82001d400 con 0x7fd818004d40 2024-09-12T01:36:23.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.720+0000 7fd82cff9640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd81c06be30 0x7fd81c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:23.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.720+0000 7fd82cff9640 1 -- 172.21.15.60:0/3678187495 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd82008b770 con 0x7fd818004d40 2024-09-12T01:36:23.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.720+0000 7fd82f7fe640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd81c06be30 0x7fd81c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:23.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.721+0000 7fd82f7fe640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd81c06be30 0x7fd81c06e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd8300ab590 tx=0x7fd824009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:23.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.725+0000 7fd82cff9640 1 -- 172.21.15.60:0/3678187495 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd820019030 con 0x7fd818004d40 2024-09-12T01:36:23.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.912+0000 7fd8368af640 1 -- 172.21.15.60:0/3678187495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd830161030 con 0x7fd818004d40 2024-09-12T01:36:23.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.913+0000 7fd82cff9640 1 -- 172.21.15.60:0/3678187495 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fd82005a080 con 0x7fd818004d40 2024-09-12T01:36:23.913 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:36:23.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.915+0000 7fd8368af640 1 -- 172.21.15.60:0/3678187495 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd81c06be30 msgr2=0x7fd81c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.915+0000 7fd8368af640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd81c06be30 0x7fd81c06e2f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd8300ab590 tx=0x7fd824009040 comp rx=0 tx=0).stop 2024-09-12T01:36:23.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.915+0000 7fd8368af640 1 -- 172.21.15.60:0/3678187495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd818004d40 msgr2=0x7fd83015db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:23.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.915+0000 7fd8368af640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd818004d40 0x7fd83015db90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd8200115a0 tx=0x7fd820011a60 comp rx=0 tx=0).stop 2024-09-12T01:36:23.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.915+0000 7fd8368af640 1 -- 172.21.15.60:0/3678187495 shutdown_connections 2024-09-12T01:36:23.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.915+0000 7fd8368af640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8300cf1c0 0x7fd8300abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.915+0000 7fd8368af640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd81c06be30 0x7fd81c06e2f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.915+0000 7fd8368af640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd83015bf90 0x7fd8300cec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.915+0000 7fd8368af640 1 --2- 172.21.15.60:0/3678187495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd818004d40 0x7fd83015db90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:23.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.915+0000 7fd8368af640 1 -- 172.21.15.60:0/3678187495 >> 172.21.15.60:0/3678187495 conn(0x7fd8300d1140 msgr2=0x7fd830161ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:23.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.915+0000 7fd8368af640 1 -- 172.21.15.60:0/3678187495 shutdown_connections 2024-09-12T01:36:23.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:23.915+0000 7fd8368af640 1 -- 172.21.15.60:0/3678187495 wait complete. 2024-09-12T01:36:23.925 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-12T01:36:23.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:23.926 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-12T01:36:23.952 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:36:23.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:23.953 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-12T01:36:24.009 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:36:24.009 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:24.029 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:36:24.029 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:24.088 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:36:24.088 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:24.148 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:36:24.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.260+0000 7fe878f03640 1 Processor -- start 2024-09-12T01:36:24.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.261+0000 7fe878f03640 1 -- start start 2024-09-12T01:36:24.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe878f03640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe87415c290 0x7fe87406d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe878f03640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87406cc20 con 0x7fe87406fe20 2024-09-12T01:36:24.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe878f03640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87406be60 con 0x7fe87415d680 2024-09-12T01:36:24.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe878f03640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe87406bc10 con 0x7fe87415c290 2024-09-12T01:36:24.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe872d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe87406fe20 0x7fe8740cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48884/0 (socket says 172.21.15.60:48884) 2024-09-12T01:36:24.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe872d9d640 1 -- 172.21.15.60:0/2822948138 learned_addr learned my addr 172.21.15.60:0/2822948138 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:24.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743295802 0 0) 0x7fe87406cc20 con 0x7fe87406fe20 2024-09-12T01:36:24.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe860003520 con 0x7fe87406fe20 2024-09-12T01:36:24.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87259c640 1 --2- 172.21.15.60:0/2822948138 >> v2:172.21.15.105:3300/0 conn(0x7fe87415c290 0x7fe87406d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 464455265 0 0) 0x7fe860003520 con 0x7fe87406fe20 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 >> v2:172.21.15.105:3300/0 conn(0x7fe87415c290 msgr2=0x7fe87406d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 --2- 172.21.15.60:0/2822948138 >> v2:172.21.15.105:3300/0 conn(0x7fe87415c290 0x7fe87406d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 >> v1:172.21.15.105:6789/0 conn(0x7fe87415d680 legacy=0x7fe87406f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87406c140 con 0x7fe87406fe20 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fe864001670 con 0x7fe87406fe20 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 >> v1:172.21.15.60:6789/0 conn(0x7fe87406fe20 legacy=0x7fe8740cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 --2- 172.21.15.60:0/2822948138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8600039b0 0x7fe860003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 --2- 172.21.15.60:0/2822948138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 0x7fe860004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 --2- 172.21.15.60:0/2822948138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8600051c0 0x7fe86000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe87406bc10 con 0x7fe860004800 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe86000c160 con 0x7fe8600051c0 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.262+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe86000c360 con 0x7fe8600039b0 2024-09-12T01:36:24.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.263+0000 7fe871d9b640 1 --2- 172.21.15.60:0/2822948138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 0x7fe860004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.263+0000 7fe87259c640 1 --2- 172.21.15.60:0/2822948138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8600039b0 0x7fe860003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.263+0000 7fe872d9d640 1 --2- 172.21.15.60:0/2822948138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8600051c0 0x7fe86000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.263+0000 7fe871d9b640 1 -- 172.21.15.60:0/2822948138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8600039b0 msgr2=0x7fe860003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.263+0000 7fe871d9b640 1 --2- 172.21.15.60:0/2822948138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8600039b0 0x7fe860003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.263+0000 7fe871d9b640 1 -- 172.21.15.60:0/2822948138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8600051c0 msgr2=0x7fe86000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.263+0000 7fe871d9b640 1 --2- 172.21.15.60:0/2822948138 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8600051c0 0x7fe86000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.263+0000 7fe872d9d640 1 -- 172.21.15.60:0/2822948138 reap_dead start 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.263+0000 7fe871d9b640 1 -- 172.21.15.60:0/2822948138 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe860003520 con 0x7fe860004800 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.263+0000 7fe87259c640 1 --2- 172.21.15.60:0/2822948138 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8600039b0 0x7fe860003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.264+0000 7fe871d9b640 1 --2- 172.21.15.60:0/2822948138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 0x7fe860004c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe85c001750 tx=0x7fe860005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36406f90a7f3ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.264+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c001370 con 0x7fe860004800 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.264+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85c0052d0 con 0x7fe860004800 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.264+0000 7fe87159a640 1 -- 172.21.15.60:0/2822948138 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c02abc0 con 0x7fe860004800 2024-09-12T01:36:24.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.264+0000 7fe878f03640 1 -- 172.21.15.60:0/2822948138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 msgr2=0x7fe860004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.264+0000 7fe878f03640 1 --2- 172.21.15.60:0/2822948138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 0x7fe860004c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe85c001750 tx=0x7fe860005830 comp rx=0 tx=0).stop 2024-09-12T01:36:24.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.264+0000 7fe878f03640 1 -- 172.21.15.60:0/2822948138 shutdown_connections 2024-09-12T01:36:24.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.264+0000 7fe878f03640 1 --2- 172.21.15.60:0/2822948138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 0x7fe860004c80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.264+0000 7fe878f03640 1 -- 172.21.15.60:0/2822948138 >> 172.21.15.60:0/2822948138 conn(0x7fe8740b3070 msgr2=0x7fe8740b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:24.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.264+0000 7fe878f03640 1 -- 172.21.15.60:0/2822948138 shutdown_connections 2024-09-12T01:36:24.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.264+0000 7fe878f03640 1 -- 172.21.15.60:0/2822948138 wait complete. 2024-09-12T01:36:24.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.266+0000 7fe878f03640 1 Processor -- start 2024-09-12T01:36:24.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.266+0000 7fe878f03640 1 -- start start 2024-09-12T01:36:24.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.266+0000 7fe878f03640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 0x7fe874150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe878f03640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8741525f0 0x7fe8741f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe878f03640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8741f2d20 0x7fe874153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe878f03640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe87415c670 con 0x7fe860004800 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe878f03640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe87406c700 con 0x7fe8741f2d20 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe878f03640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe87415c7f0 con 0x7fe8741525f0 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe87259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 0x7fe874150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe87259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 0x7fe874150860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53846/0 (socket says 172.21.15.60:53846) 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe87259c640 1 -- 172.21.15.60:0/3811535685 learned_addr learned my addr 172.21.15.60:0/3811535685 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe87259c640 1 -- 172.21.15.60:0/3811535685 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8741525f0 msgr2=0x7fe8741f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe87259c640 1 --2- 172.21.15.60:0/3811535685 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8741525f0 0x7fe8741f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe87259c640 1 -- 172.21.15.60:0/3811535685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8741f2d20 msgr2=0x7fe874153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe87259c640 1 --2- 172.21.15.60:0/3811535685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8741f2d20 0x7fe874153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe87259c640 1 -- 172.21.15.60:0/3811535685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8741f31d0 con 0x7fe860004800 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe87259c640 1 --2- 172.21.15.60:0/3811535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 0x7fe874150860 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009fc0 tx=0x7fe86c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:24.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe86affd640 1 -- 172.21.15.60:0/3811535685 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c01a030 con 0x7fe860004800 2024-09-12T01:36:24.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe86affd640 1 -- 172.21.15.60:0/3811535685 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe86c003990 con 0x7fe860004800 2024-09-12T01:36:24.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe878f03640 1 -- 172.21.15.60:0/3811535685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8741f3490 con 0x7fe860004800 2024-09-12T01:36:24.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe86affd640 1 -- 172.21.15.60:0/3811535685 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c003d60 con 0x7fe860004800 2024-09-12T01:36:24.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.267+0000 7fe878f03640 1 -- 172.21.15.60:0/3811535685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe874155480 con 0x7fe860004800 2024-09-12T01:36:24.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.268+0000 7fe878f03640 1 -- 172.21.15.60:0/3811535685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87406f7a0 con 0x7fe860004800 2024-09-12T01:36:24.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.269+0000 7fe86affd640 1 -- 172.21.15.60:0/3811535685 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe86c01d070 con 0x7fe860004800 2024-09-12T01:36:24.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.269+0000 7fe86affd640 1 --2- 172.21.15.60:0/3811535685 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe85406be30 0x7fe85406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.269+0000 7fe86affd640 1 -- 172.21.15.60:0/3811535685 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe86c08bc30 con 0x7fe860004800 2024-09-12T01:36:24.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.269+0000 7fe871d9b640 1 --2- 172.21.15.60:0/3811535685 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe85406be30 0x7fe85406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.270+0000 7fe871d9b640 1 --2- 172.21.15.60:0/3811535685 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe85406be30 0x7fe85406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe85c032000 tx=0x7fe85c02c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:24.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.274+0000 7fe86affd640 1 -- 172.21.15.60:0/3811535685 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe86c05a670 con 0x7fe860004800 2024-09-12T01:36:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.459+0000 7fe878f03640 1 -- 172.21.15.60:0/3811535685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe87415df80 con 0x7fe860004800 2024-09-12T01:36:24.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.459+0000 7fe86affd640 1 -- 172.21.15.60:0/3811535685 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fe86c059f70 con 0x7fe860004800 2024-09-12T01:36:24.459 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:36:24.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.461+0000 7fe878f03640 1 -- 172.21.15.60:0/3811535685 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe85406be30 msgr2=0x7fe85406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.461+0000 7fe878f03640 1 --2- 172.21.15.60:0/3811535685 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe85406be30 0x7fe85406e2f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe85c032000 tx=0x7fe85c02c000 comp rx=0 tx=0).stop 2024-09-12T01:36:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.461+0000 7fe878f03640 1 -- 172.21.15.60:0/3811535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 msgr2=0x7fe874150860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.461+0000 7fe878f03640 1 --2- 172.21.15.60:0/3811535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 0x7fe874150860 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe86c009fc0 tx=0x7fe86c010590 comp rx=0 tx=0).stop 2024-09-12T01:36:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.461+0000 7fe878f03640 1 -- 172.21.15.60:0/3811535685 shutdown_connections 2024-09-12T01:36:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.461+0000 7fe878f03640 1 --2- 172.21.15.60:0/3811535685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8741f2d20 0x7fe874153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.461+0000 7fe878f03640 1 --2- 172.21.15.60:0/3811535685 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe85406be30 0x7fe85406e2f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.461+0000 7fe878f03640 1 --2- 172.21.15.60:0/3811535685 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8741525f0 0x7fe8741f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.461+0000 7fe878f03640 1 --2- 172.21.15.60:0/3811535685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe860004800 0x7fe874150860 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.461+0000 7fe878f03640 1 -- 172.21.15.60:0/3811535685 >> 172.21.15.60:0/3811535685 conn(0x7fe8740b3070 msgr2=0x7fe87415c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:24.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.461+0000 7fe878f03640 1 -- 172.21.15.60:0/3811535685 shutdown_connections 2024-09-12T01:36:24.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.461+0000 7fe878f03640 1 -- 172.21.15.60:0/3811535685 wait complete. 2024-09-12T01:36:24.471 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-12T01:36:24.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:24.471 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-12T01:36:24.504 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:36:24.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:24.504 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-12T01:36:24.562 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:36:24.563 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:36:24.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.666+0000 7ffbc6c53640 1 Processor -- start 2024-09-12T01:36:24.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.666+0000 7ffbc6c53640 1 -- start start 2024-09-12T01:36:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.667+0000 7ffbc6c53640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffbc00b63d0 0x7ffbc00d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.667+0000 7ffbc6c53640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffbc00cf6b0 0x7ffbc00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.667+0000 7ffbc6c53640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc00cfc20 con 0x7ffbc00d1c80 2024-09-12T01:36:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.667+0000 7ffbc6c53640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc00d2ed0 con 0x7ffbc00b63d0 2024-09-12T01:36:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.667+0000 7ffbc6c53640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc00d31b0 con 0x7ffbc00cf6b0 2024-09-12T01:36:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.667+0000 7ffbc49ef640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffbc00b63d0 0x7ffbc00d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.667+0000 7ffbc49ef640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffbc00b63d0 0x7ffbc00d39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53854/0 (socket says 172.21.15.60:53854) 2024-09-12T01:36:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.667+0000 7ffbc49ef640 1 -- 172.21.15.60:0/1203612962 learned_addr learned my addr 172.21.15.60:0/1203612962 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.667+0000 7ffbbffff640 1 --2- 172.21.15.60:0/1203612962 >> v2:172.21.15.105:3300/0 conn(0x7ffbc00cf6b0 0x7ffbc00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.667+0000 7ffbc49ef640 1 -- 172.21.15.60:0/1203612962 >> v2:172.21.15.105:3300/0 conn(0x7ffbc00cf6b0 msgr2=0x7ffbc00b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.668+0000 7ffbc49ef640 1 --2- 172.21.15.60:0/1203612962 >> v2:172.21.15.105:3300/0 conn(0x7ffbc00cf6b0 0x7ffbc00b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.668+0000 7ffbc49ef640 1 -- 172.21.15.60:0/1203612962 >> v1:172.21.15.105:6789/0 conn(0x7ffbc00d1c80 legacy=0x7ffbc00b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:24.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.668+0000 7ffbc49ef640 1 -- 172.21.15.60:0/1203612962 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc00d3490 con 0x7ffbc00b63d0 2024-09-12T01:36:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.668+0000 7ffbc49ef640 1 --2- 172.21.15.60:0/1203612962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc00b63d0 0x7ffbc00d39b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00b40e0 tx=0x7ffbb002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34f5af1707ca36d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.668+0000 7ffbbf7fe640 1 -- 172.21.15.60:0/1203612962 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0037070 con 0x7ffbc00b63d0 2024-09-12T01:36:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.668+0000 7ffbbf7fe640 1 -- 172.21.15.60:0/1203612962 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb0032440 con 0x7ffbc00b63d0 2024-09-12T01:36:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.668+0000 7ffbbf7fe640 1 -- 172.21.15.60:0/1203612962 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0032810 con 0x7ffbc00b63d0 2024-09-12T01:36:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.669+0000 7ffbc6c53640 1 -- 172.21.15.60:0/1203612962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc00b63d0 msgr2=0x7ffbc00d39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.669+0000 7ffbc6c53640 1 --2- 172.21.15.60:0/1203612962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc00b63d0 0x7ffbc00d39b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00b40e0 tx=0x7ffbb002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.669+0000 7ffbc6c53640 1 -- 172.21.15.60:0/1203612962 shutdown_connections 2024-09-12T01:36:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.669+0000 7ffbc6c53640 1 --2- 172.21.15.60:0/1203612962 >> v2:172.21.15.105:3300/0 conn(0x7ffbc00cf6b0 0x7ffbc00b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.669+0000 7ffbc6c53640 1 --2- 172.21.15.60:0/1203612962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc00b63d0 0x7ffbc00d39b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.669+0000 7ffbc6c53640 1 -- 172.21.15.60:0/1203612962 >> 172.21.15.60:0/1203612962 conn(0x7ffbc00d1160 msgr2=0x7ffbc00d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.669+0000 7ffbc6c53640 1 -- 172.21.15.60:0/1203612962 shutdown_connections 2024-09-12T01:36:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.669+0000 7ffbc6c53640 1 -- 172.21.15.60:0/1203612962 wait complete. 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.670+0000 7ffbc6c53640 1 Processor -- start 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.670+0000 7ffbc6c53640 1 -- start start 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.671+0000 7ffbc6c53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc00b63d0 0x7ffbc0155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.671+0000 7ffbc6c53640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbc00cf6b0 0x7ffbc015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.671+0000 7ffbc6c53640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc00d1c80 0x7ffbc00b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.671+0000 7ffbc6c53640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc00d4070 con 0x7ffbc00b63d0 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.671+0000 7ffbc6c53640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc00d3ef0 con 0x7ffbc00d1c80 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.671+0000 7ffbc6c53640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc00b67b0 con 0x7ffbc00cf6b0 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.671+0000 7ffbc49ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc00b63d0 0x7ffbc0155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.671+0000 7ffbc49ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc00b63d0 0x7ffbc0155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53864/0 (socket says 172.21.15.60:53864) 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.671+0000 7ffbc49ef640 1 -- 172.21.15.60:0/3470437624 learned_addr learned my addr 172.21.15.60:0/3470437624 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.671+0000 7ffbbffff640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbc00cf6b0 0x7ffbc015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.671+0000 7ffbc51f0640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc00d1c80 0x7ffbc00b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.672+0000 7ffbc49ef640 1 -- 172.21.15.60:0/3470437624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbc00cf6b0 msgr2=0x7ffbc015ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.672+0000 7ffbc49ef640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbc00cf6b0 0x7ffbc015ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.672+0000 7ffbc49ef640 1 -- 172.21.15.60:0/3470437624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc00d1c80 msgr2=0x7ffbc00b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.672+0000 7ffbc49ef640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc00d1c80 0x7ffbc00b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.672+0000 7ffbc49ef640 1 -- 172.21.15.60:0/3470437624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc015b750 con 0x7ffbc00b63d0 2024-09-12T01:36:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.672+0000 7ffbc51f0640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc00d1c80 0x7ffbc00b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.672+0000 7ffbc49ef640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc00b63d0 0x7ffbc0155c20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0000c00 tx=0x7ffbb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.672+0000 7ffbbd7fa640 1 -- 172.21.15.60:0/3470437624 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0041020 con 0x7ffbc00b63d0 2024-09-12T01:36:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.672+0000 7ffbbd7fa640 1 -- 172.21.15.60:0/3470437624 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb00306c0 con 0x7ffbc00b63d0 2024-09-12T01:36:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.672+0000 7ffbc6c53640 1 -- 172.21.15.60:0/3470437624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc015ba30 con 0x7ffbc00b63d0 2024-09-12T01:36:24.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.672+0000 7ffbbd7fa640 1 -- 172.21.15.60:0/3470437624 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0037040 con 0x7ffbc00b63d0 2024-09-12T01:36:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.672+0000 7ffbc6c53640 1 -- 172.21.15.60:0/3470437624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc015bff0 con 0x7ffbc00b63d0 2024-09-12T01:36:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.673+0000 7ffbc6c53640 1 -- 172.21.15.60:0/3470437624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc00d39b0 con 0x7ffbc00b63d0 2024-09-12T01:36:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.673+0000 7ffbbd7fa640 1 -- 172.21.15.60:0/3470437624 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffbb0044020 con 0x7ffbc00b63d0 2024-09-12T01:36:24.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.674+0000 7ffbbd7fa640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffbac06be30 0x7ffbac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:24.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.674+0000 7ffbbd7fa640 1 -- 172.21.15.60:0/3470437624 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ffbb00ab6a0 con 0x7ffbc00b63d0 2024-09-12T01:36:24.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.674+0000 7ffbbffff640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffbac06be30 0x7ffbac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:24.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.674+0000 7ffbbffff640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffbac06be30 0x7ffbac06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00b9140 tx=0x7ffbb4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:24.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.678+0000 7ffbbd7fa640 1 -- 172.21.15.60:0/3470437624 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffbb004b030 con 0x7ffbc00b63d0 2024-09-12T01:36:24.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.888+0000 7ffbc6c53640 1 -- 172.21.15.60:0/3470437624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffbc00b6d00 con 0x7ffbc00b63d0 2024-09-12T01:36:24.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.888+0000 7ffbbd7fa640 1 -- 172.21.15.60:0/3470437624 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5223 (secure 0 0 0) 0x7ffbb007a050 con 0x7ffbc00b63d0 2024-09-12T01:36:24.888 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:24.888 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"btime":"2024-09-12T01:35:58:740642+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3216581844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3216581844},{"type":"v1","addr":"172.21.15.60:6836","nonce":3216581844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1706637770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1706637770},{"type":"v1","addr":"172.21.15.105:6833","nonce":1706637770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3645806076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3645806076},{"type":"v1","addr":"172.21.15.60:6837","nonce":3645806076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:35:55.984648+0000","modified":"2024-09-12T01:35:58.083477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3695785914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3695785914},{"type":"v1","addr":"172.21.15.105:6835","nonce":3695785914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-12T01:36:24.888 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2024-09-12T01:36:24.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.890+0000 7ffbc6c53640 1 -- 172.21.15.60:0/3470437624 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffbac06be30 msgr2=0x7ffbac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.890+0000 7ffbc6c53640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffbac06be30 0x7ffbac06e2f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00b9140 tx=0x7ffbb4008040 comp rx=0 tx=0).stop 2024-09-12T01:36:24.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.890+0000 7ffbc6c53640 1 -- 172.21.15.60:0/3470437624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc00b63d0 msgr2=0x7ffbc0155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:24.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.890+0000 7ffbc6c53640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc00b63d0 0x7ffbc0155c20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0000c00 tx=0x7ffbb00046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.891+0000 7ffbc6c53640 1 -- 172.21.15.60:0/3470437624 shutdown_connections 2024-09-12T01:36:24.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.891+0000 7ffbc6c53640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc00d1c80 0x7ffbc00b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.891+0000 7ffbc6c53640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffbac06be30 0x7ffbac06e2f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.891+0000 7ffbc6c53640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbc00cf6b0 0x7ffbc015ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.891+0000 7ffbc6c53640 1 --2- 172.21.15.60:0/3470437624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc00b63d0 0x7ffbc0155c20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:24.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.891+0000 7ffbc6c53640 1 -- 172.21.15.60:0/3470437624 >> 172.21.15.60:0/3470437624 conn(0x7ffbc00d1160 msgr2=0x7ffbc0162be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:24.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.891+0000 7ffbc6c53640 1 -- 172.21.15.60:0/3470437624 shutdown_connections 2024-09-12T01:36:24.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:24.891+0000 7ffbc6c53640 1 -- 172.21.15.60:0/3470437624 wait complete. 2024-09-12T01:36:24.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:36:25.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.005+0000 7f2278f4b640 1 Processor -- start 2024-09-12T01:36:25.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.005+0000 7f2278f4b640 1 -- start start 2024-09-12T01:36:25.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2278f4b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f227415e660 0x7f22740cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2278f4b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22740d3310 0x7f22740d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2278f4b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f227415ea40 con 0x7f22740d1650 2024-09-12T01:36:25.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2278f4b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f22740d1ac0 con 0x7f22740d3310 2024-09-12T01:36:25.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2278f4b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f22740d3870 con 0x7f227415e660 2024-09-12T01:36:25.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2271d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22740d3310 0x7f22740d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2271d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22740d3310 0x7f22740d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53878/0 (socket says 172.21.15.60:53878) 2024-09-12T01:36:25.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2271d9b640 1 -- 172.21.15.60:0/2238661502 learned_addr learned my addr 172.21.15.60:0/2238661502 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:25.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2272d9d640 1 --1- 172.21.15.60:0/2238661502 >> v1:172.21.15.60:6789/0 conn(0x7f22740d1650 0x7f227406bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48898/0 (socket says 172.21.15.60:48898) 2024-09-12T01:36:25.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f227259c640 1 --2- 172.21.15.60:0/2238661502 >> v2:172.21.15.105:3300/0 conn(0x7f227415e660 0x7f22740cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2271d9b640 1 -- 172.21.15.60:0/2238661502 >> v2:172.21.15.105:3300/0 conn(0x7f227415e660 msgr2=0x7f22740cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:25.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2271d9b640 1 --2- 172.21.15.60:0/2238661502 >> v2:172.21.15.105:3300/0 conn(0x7f227415e660 0x7f22740cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2271d9b640 1 -- 172.21.15.60:0/2238661502 >> v1:172.21.15.60:6789/0 conn(0x7f22740d1650 legacy=0x7f227406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f2271d9b640 1 -- 172.21.15.60:0/2238661502 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22740d3b50 con 0x7f22740d3310 2024-09-12T01:36:25.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.006+0000 7f227159a640 1 -- 172.21.15.60:0/2238661502 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1651178103 0 0) 0x7f227415ea40 con 0x7f22740d1650 2024-09-12T01:36:25.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.007+0000 7f2271d9b640 1 --2- 172.21.15.60:0/2238661502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22740d3310 0x7f22740d1110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f22740d10e0 tx=0x7f226802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7db9617634b2942 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:25.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.007+0000 7f227159a640 1 -- 172.21.15.60:0/2238661502 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268037070 con 0x7f22740d3310 2024-09-12T01:36:25.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.007+0000 7f227159a640 1 -- 172.21.15.60:0/2238661502 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2268032440 con 0x7f22740d3310 2024-09-12T01:36:25.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.007+0000 7f227159a640 1 -- 172.21.15.60:0/2238661502 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268032810 con 0x7f22740d3310 2024-09-12T01:36:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.008+0000 7f2278f4b640 1 -- 172.21.15.60:0/2238661502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22740d3310 msgr2=0x7f22740d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.008+0000 7f2278f4b640 1 --2- 172.21.15.60:0/2238661502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22740d3310 0x7f22740d1110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f22740d10e0 tx=0x7f226802a270 comp rx=0 tx=0).stop 2024-09-12T01:36:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.008+0000 7f2278f4b640 1 -- 172.21.15.60:0/2238661502 shutdown_connections 2024-09-12T01:36:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.008+0000 7f2278f4b640 1 --2- 172.21.15.60:0/2238661502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22740d3310 0x7f22740d1110 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.008+0000 7f2278f4b640 1 --2- 172.21.15.60:0/2238661502 >> v2:172.21.15.105:3300/0 conn(0x7f227415e660 0x7f22740cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.008+0000 7f2278f4b640 1 -- 172.21.15.60:0/2238661502 >> 172.21.15.60:0/2238661502 conn(0x7f22740b6410 msgr2=0x7f22740b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.008+0000 7f2278f4b640 1 -- 172.21.15.60:0/2238661502 shutdown_connections 2024-09-12T01:36:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.008+0000 7f2278f4b640 1 -- 172.21.15.60:0/2238661502 wait complete. 2024-09-12T01:36:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.009+0000 7f2278f4b640 1 Processor -- start 2024-09-12T01:36:25.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.009+0000 7f2278f4b640 1 -- start start 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2278f4b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22740d1650 0x7f22740ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2278f4b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22740d3310 0x7f227415ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2278f4b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f227415e660 0x7f2274161110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2278f4b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f22740d43f0 con 0x7f22740d3310 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2278f4b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22740d4110 con 0x7f227415e660 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2278f4b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f22740cfc70 con 0x7f22740d1650 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2271d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22740d3310 0x7f227415ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2271d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22740d3310 0x7f227415ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53886/0 (socket says 172.21.15.60:53886) 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2271d9b640 1 -- 172.21.15.60:0/365603063 learned_addr learned my addr 172.21.15.60:0/365603063 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2272d9d640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f227415e660 0x7f2274161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f227259c640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22740d1650 0x7f22740ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2271d9b640 1 -- 172.21.15.60:0/365603063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22740d1650 msgr2=0x7f22740ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2271d9b640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22740d1650 0x7f22740ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2271d9b640 1 -- 172.21.15.60:0/365603063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f227415e660 msgr2=0x7f2274161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2271d9b640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f227415e660 0x7f2274161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2271d9b640 1 -- 172.21.15.60:0/365603063 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227415f3b0 con 0x7f22740d3310 2024-09-12T01:36:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f2272d9d640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f227415e660 0x7f2274161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.010+0000 7f227259c640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22740d1650 0x7f22740ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.011+0000 7f2271d9b640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22740d3310 0x7f227415ea40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2268035040 tx=0x7f22680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.011+0000 7f2262ffd640 1 -- 172.21.15.60:0/365603063 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268037040 con 0x7f22740d3310 2024-09-12T01:36:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.011+0000 7f2262ffd640 1 -- 172.21.15.60:0/365603063 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2268004030 con 0x7f22740d3310 2024-09-12T01:36:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.011+0000 7f2278f4b640 1 -- 172.21.15.60:0/365603063 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227415f690 con 0x7f22740d3310 2024-09-12T01:36:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.011+0000 7f2262ffd640 1 -- 172.21.15.60:0/365603063 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268004420 con 0x7f22740d3310 2024-09-12T01:36:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.011+0000 7f2278f4b640 1 -- 172.21.15.60:0/365603063 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f227415fc50 con 0x7f22740d3310 2024-09-12T01:36:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.012+0000 7f2278f4b640 1 -- 172.21.15.60:0/365603063 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22740d1110 con 0x7f22740d3310 2024-09-12T01:36:25.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.012+0000 7f2262ffd640 1 -- 172.21.15.60:0/365603063 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f226803a070 con 0x7f22740d3310 2024-09-12T01:36:25.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.013+0000 7f2262ffd640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f225406be30 0x7f225406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.013+0000 7f2262ffd640 1 -- 172.21.15.60:0/365603063 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f22680ab530 con 0x7f22740d3310 2024-09-12T01:36:25.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.013+0000 7f227259c640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f225406be30 0x7f225406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.013+0000 7f227259c640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f225406be30 0x7f225406e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2264006fd0 tx=0x7f2264008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:25.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.017+0000 7f2262ffd640 1 -- 172.21.15.60:0/365603063 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2268041020 con 0x7f22740d3310 2024-09-12T01:36:25.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.227+0000 7f2278f4b640 1 -- 172.21.15.60:0/365603063 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f227415b480 con 0x7f22740d3310 2024-09-12T01:36:25.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.227+0000 7f2262ffd640 1 -- 172.21.15.60:0/365603063 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5223 (secure 0 0 0) 0x7f2268079ee0 con 0x7f22740d3310 2024-09-12T01:36:25.227 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:25.227 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"btime":"2024-09-12T01:35:58:740642+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3216581844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3216581844},{"type":"v1","addr":"172.21.15.60:6836","nonce":3216581844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1706637770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1706637770},{"type":"v1","addr":"172.21.15.105:6833","nonce":1706637770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3645806076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3645806076},{"type":"v1","addr":"172.21.15.60:6837","nonce":3645806076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:35:55.984648+0000","modified":"2024-09-12T01:35:58.083477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3695785914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3695785914},{"type":"v1","addr":"172.21.15.105:6835","nonce":3695785914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-12T01:36:25.227 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2024-09-12T01:36:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.229+0000 7f2278f4b640 1 -- 172.21.15.60:0/365603063 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f225406be30 msgr2=0x7f225406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.229+0000 7f2278f4b640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f225406be30 0x7f225406e2f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2264006fd0 tx=0x7f2264008040 comp rx=0 tx=0).stop 2024-09-12T01:36:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.230+0000 7f2278f4b640 1 -- 172.21.15.60:0/365603063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22740d3310 msgr2=0x7f227415ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.230+0000 7f2278f4b640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22740d3310 0x7f227415ea40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2268035040 tx=0x7f22680046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.230+0000 7f2278f4b640 1 -- 172.21.15.60:0/365603063 shutdown_connections 2024-09-12T01:36:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.230+0000 7f2278f4b640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f227415e660 0x7f2274161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.230+0000 7f2278f4b640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22740d3310 0x7f227415ea40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.230+0000 7f2278f4b640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f225406be30 0x7f225406e2f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.230+0000 7f2278f4b640 1 --2- 172.21.15.60:0/365603063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22740d1650 0x7f22740ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.230+0000 7f2278f4b640 1 -- 172.21.15.60:0/365603063 >> 172.21.15.60:0/365603063 conn(0x7f22740b6410 msgr2=0x7f227415a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.230+0000 7f2278f4b640 1 -- 172.21.15.60:0/365603063 shutdown_connections 2024-09-12T01:36:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.230+0000 7f2278f4b640 1 -- 172.21.15.60:0/365603063 wait complete. 2024-09-12T01:36:25.240 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:36:25.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.344+0000 7fe8e5c5e640 1 Processor -- start 2024-09-12T01:36:25.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.344+0000 7fe8e5c5e640 1 -- start start 2024-09-12T01:36:25.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8e5c5e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8e00d3310 0x7fe8e00d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8e5c5e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8e00d1650 0x7fe8e00b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8e5c5e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e015ea40 con 0x7fe8e015e660 2024-09-12T01:36:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8e5c5e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe8e00d1ac0 con 0x7fe8e00d1650 2024-09-12T01:36:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8e5c5e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e00d3870 con 0x7fe8e00d3310 2024-09-12T01:36:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8dffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8e00d1650 0x7fe8e00b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8dffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8e00d1650 0x7fe8e00b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53890/0 (socket says 172.21.15.60:53890) 2024-09-12T01:36:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8dffff640 1 -- 172.21.15.60:0/889067642 learned_addr learned my addr 172.21.15.60:0/889067642 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8deffd640 1 --2- 172.21.15.60:0/889067642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8e00d3310 0x7fe8e00d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8dffff640 1 -- 172.21.15.60:0/889067642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8e00d3310 msgr2=0x7fe8e00d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:25.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8dffff640 1 --2- 172.21.15.60:0/889067642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8e00d3310 0x7fe8e00d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8dffff640 1 -- 172.21.15.60:0/889067642 >> v1:172.21.15.105:6789/0 conn(0x7fe8e015e660 legacy=0x7fe8e00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:25.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.345+0000 7fe8dffff640 1 -- 172.21.15.60:0/889067642 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e00d3b50 con 0x7fe8e00d1650 2024-09-12T01:36:25.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.346+0000 7fe8dffff640 1 --2- 172.21.15.60:0/889067642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e00d1650 0x7fe8e00b7b70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009e50 tx=0x7fe8d802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7244838d97212cdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:25.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.346+0000 7fe8de7fc640 1 -- 172.21.15.60:0/889067642 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8036070 con 0x7fe8e00d1650 2024-09-12T01:36:25.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.346+0000 7fe8de7fc640 1 -- 172.21.15.60:0/889067642 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d8031600 con 0x7fe8e00d1650 2024-09-12T01:36:25.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.346+0000 7fe8de7fc640 1 -- 172.21.15.60:0/889067642 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d80319d0 con 0x7fe8e00d1650 2024-09-12T01:36:25.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.347+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/889067642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e00d1650 msgr2=0x7fe8e00b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.347+0000 7fe8e5c5e640 1 --2- 172.21.15.60:0/889067642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e00d1650 0x7fe8e00b7b70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe8d8009e50 tx=0x7fe8d802a6c0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.347+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/889067642 shutdown_connections 2024-09-12T01:36:25.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.347+0000 7fe8e5c5e640 1 --2- 172.21.15.60:0/889067642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e00d1650 0x7fe8e00b7b70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.347+0000 7fe8e5c5e640 1 --2- 172.21.15.60:0/889067642 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8e00d3310 0x7fe8e00d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.347+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/889067642 >> 172.21.15.60:0/889067642 conn(0x7fe8e00b6410 msgr2=0x7fe8e00b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:25.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.347+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/889067642 shutdown_connections 2024-09-12T01:36:25.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.347+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/889067642 wait complete. 2024-09-12T01:36:25.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.348+0000 7fe8e5c5e640 1 Processor -- start 2024-09-12T01:36:25.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.348+0000 7fe8e5c5e640 1 -- start start 2024-09-12T01:36:25.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8e5c5e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8e00d1650 0x7fe8e01ea150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8e5c5e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e00d3310 0x7fe8e01ea690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8e5c5e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8e015e660 0x7fe8e0147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8e5c5e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e00d43f0 con 0x7fe8e00d3310 2024-09-12T01:36:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8e5c5e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e00d4110 con 0x7fe8e015e660 2024-09-12T01:36:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8e5c5e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e00b80b0 con 0x7fe8e00d1650 2024-09-12T01:36:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e00d3310 0x7fe8e01ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8deffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e00d3310 0x7fe8e01ea690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53906/0 (socket says 172.21.15.60:53906) 2024-09-12T01:36:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8deffd640 1 -- 172.21.15.60:0/1938296749 learned_addr learned my addr 172.21.15.60:0/1938296749 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8df7fe640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8e00d1650 0x7fe8e01ea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8dffff640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8e015e660 0x7fe8e0147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8deffd640 1 -- 172.21.15.60:0/1938296749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8e00d1650 msgr2=0x7fe8e01ea150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8deffd640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8e00d1650 0x7fe8e01ea150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8deffd640 1 -- 172.21.15.60:0/1938296749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8e015e660 msgr2=0x7fe8e0147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8deffd640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8e015e660 0x7fe8e0147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.349+0000 7fe8deffd640 1 -- 172.21.15.60:0/1938296749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e01613c0 con 0x7fe8e00d3310 2024-09-12T01:36:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.350+0000 7fe8deffd640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e00d3310 0x7fe8e01ea690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400d800 tx=0x7fe8d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.350+0000 7fe8c7fff640 1 -- 172.21.15.60:0/1938296749 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400b6c0 con 0x7fe8e00d3310 2024-09-12T01:36:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.350+0000 7fe8c7fff640 1 -- 172.21.15.60:0/1938296749 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d4019070 con 0x7fe8e00d3310 2024-09-12T01:36:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.350+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/1938296749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e01457b0 con 0x7fe8e00d3310 2024-09-12T01:36:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.350+0000 7fe8c7fff640 1 -- 172.21.15.60:0/1938296749 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400ba80 con 0x7fe8e00d3310 2024-09-12T01:36:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.350+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/1938296749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e0145d70 con 0x7fe8e00d3310 2024-09-12T01:36:25.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.351+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/1938296749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e00b7b70 con 0x7fe8e00d3310 2024-09-12T01:36:25.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.351+0000 7fe8c7fff640 1 -- 172.21.15.60:0/1938296749 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8d400bc20 con 0x7fe8e00d3310 2024-09-12T01:36:25.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.352+0000 7fe8c7fff640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe8cc06be30 0x7fe8cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.352+0000 7fe8c7fff640 1 -- 172.21.15.60:0/1938296749 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe8d408b250 con 0x7fe8e00d3310 2024-09-12T01:36:25.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.352+0000 7fe8df7fe640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe8cc06be30 0x7fe8cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.352+0000 7fe8df7fe640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe8cc06be30 0x7fe8cc06e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0006fd0 tx=0x7fe8d0009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:25.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.356+0000 7fe8c7fff640 1 -- 172.21.15.60:0/1938296749 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8d4059510 con 0x7fe8e00d3310 2024-09-12T01:36:25.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.535+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/1938296749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8e015ca20 con 0x7fe8e00d3310 2024-09-12T01:36:25.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.536+0000 7fe8c7fff640 1 -- 172.21.15.60:0/1938296749 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7fe8d405d810 con 0x7fe8e00d3310 2024-09-12T01:36:25.535 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:25.536 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:57.624089+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:35:53.846331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:35:54.965757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:36:25.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.538+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/1938296749 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe8cc06be30 msgr2=0x7fe8cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.538+0000 7fe8e5c5e640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe8cc06be30 0x7fe8cc06e2f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0006fd0 tx=0x7fe8d0009060 comp rx=0 tx=0).stop 2024-09-12T01:36:25.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.538+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/1938296749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e00d3310 msgr2=0x7fe8e01ea690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.538+0000 7fe8e5c5e640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e00d3310 0x7fe8e01ea690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400d800 tx=0x7fe8d400dcc0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.538+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/1938296749 shutdown_connections 2024-09-12T01:36:25.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.538+0000 7fe8e5c5e640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8e015e660 0x7fe8e0147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.538+0000 7fe8e5c5e640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e00d3310 0x7fe8e01ea690 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.538+0000 7fe8e5c5e640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe8cc06be30 0x7fe8cc06e2f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.538+0000 7fe8e5c5e640 1 --2- 172.21.15.60:0/1938296749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8e00d1650 0x7fe8e01ea150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.538+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/1938296749 >> 172.21.15.60:0/1938296749 conn(0x7fe8e00b6410 msgr2=0x7fe8e00b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:25.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.538+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/1938296749 shutdown_connections 2024-09-12T01:36:25.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.539+0000 7fe8e5c5e640 1 -- 172.21.15.60:0/1938296749 wait complete. 2024-09-12T01:36:25.549 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:36:25.549 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:36:25.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.653+0000 7f6d8ee1e640 1 Processor -- start 2024-09-12T01:36:25.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.653+0000 7f6d8ee1e640 1 -- start start 2024-09-12T01:36:25.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.654+0000 7f6d8ee1e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6d8815e640 0x7f6d880d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.654+0000 7f6d8ee1e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d880cfd80 con 0x7f6d880d18c0 2024-09-12T01:36:25.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.654+0000 7f6d8ee1e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d880d3c60 con 0x7f6d880cf940 2024-09-12T01:36:25.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.654+0000 7f6d8ee1e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6d880d3f40 con 0x7f6d8815e640 2024-09-12T01:36:25.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.654+0000 7f6d8cbba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6d8815e640 0x7f6d880d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.654+0000 7f6d8cbba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6d8815e640 0x7f6d880d4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53912/0 (socket says 172.21.15.60:53912) 2024-09-12T01:36:25.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.654+0000 7f6d8d3bb640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6d880d18c0 0x7f6d880b7850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48900/0 (socket says 172.21.15.60:48900) 2024-09-12T01:36:25.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.654+0000 7f6d8cbba640 1 -- 172.21.15.60:0/2069867258 learned_addr learned my addr 172.21.15.60:0/2069867258 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:25.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.655+0000 7f6d8cbba640 1 -- 172.21.15.60:0/2069867258 >> v1:172.21.15.105:6789/0 conn(0x7f6d880cf940 legacy=0x7f6d880d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.655+0000 7f6d8cbba640 1 -- 172.21.15.60:0/2069867258 >> v1:172.21.15.60:6789/0 conn(0x7f6d880d18c0 legacy=0x7f6d880b7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.655+0000 7f6d7f7fe640 1 -- 172.21.15.60:0/2069867258 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 105233176 0 0) 0x7f6d880cfd80 con 0x7f6d880d18c0 2024-09-12T01:36:25.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.655+0000 7f6d8cbba640 1 -- 172.21.15.60:0/2069867258 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d880d4220 con 0x7f6d8815e640 2024-09-12T01:36:25.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.655+0000 7f6d8cbba640 1 --2- 172.21.15.60:0/2069867258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d8815e640 0x7f6d880d4d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009870 tx=0x7f6d8402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be935cca7f33b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:25.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.655+0000 7f6d7f7fe640 1 -- 172.21.15.60:0/2069867258 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84037070 con 0x7f6d8815e640 2024-09-12T01:36:25.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.655+0000 7f6d7f7fe640 1 -- 172.21.15.60:0/2069867258 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d8402ae50 con 0x7f6d8815e640 2024-09-12T01:36:25.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.655+0000 7f6d7f7fe640 1 -- 172.21.15.60:0/2069867258 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d84032860 con 0x7f6d8815e640 2024-09-12T01:36:25.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.656+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/2069867258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d8815e640 msgr2=0x7f6d880d4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.656+0000 7f6d8ee1e640 1 --2- 172.21.15.60:0/2069867258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d8815e640 0x7f6d880d4d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009870 tx=0x7f6d8402a300 comp rx=0 tx=0).stop 2024-09-12T01:36:25.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.656+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/2069867258 shutdown_connections 2024-09-12T01:36:25.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.656+0000 7f6d8ee1e640 1 --2- 172.21.15.60:0/2069867258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d8815e640 0x7f6d880d4d00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.656+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/2069867258 >> 172.21.15.60:0/2069867258 conn(0x7f6d88062a50 msgr2=0x7f6d88062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:25.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.656+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/2069867258 shutdown_connections 2024-09-12T01:36:25.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.656+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/2069867258 wait complete. 2024-09-12T01:36:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.658+0000 7f6d8ee1e640 1 Processor -- start 2024-09-12T01:36:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.658+0000 7f6d8ee1e640 1 -- start start 2024-09-12T01:36:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.658+0000 7f6d8ee1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d880cf940 0x7f6d88154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.658+0000 7f6d8ee1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880d18c0 0x7f6d880c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.658+0000 7f6d8ee1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d8815e640 0x7f6d880c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.658+0000 7f6d8ee1e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8815eba0 con 0x7f6d880d18c0 2024-09-12T01:36:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.658+0000 7f6d8ee1e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8815ea20 con 0x7f6d880cf940 2024-09-12T01:36:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.658+0000 7f6d8ee1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6d880d34f0 con 0x7f6d8815e640 2024-09-12T01:36:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d7ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880d18c0 0x7f6d880c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d7ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880d18c0 0x7f6d880c92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53922/0 (socket says 172.21.15.60:53922) 2024-09-12T01:36:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d7ffff640 1 -- 172.21.15.60:0/3873127331 learned_addr learned my addr 172.21.15.60:0/3873127331 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d8d3bb640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d8815e640 0x7f6d880c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d8cbba640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d880cf940 0x7f6d88154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d7ffff640 1 -- 172.21.15.60:0/3873127331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d8815e640 msgr2=0x7f6d880c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d7ffff640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d8815e640 0x7f6d880c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d7ffff640 1 -- 172.21.15.60:0/3873127331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d880cf940 msgr2=0x7f6d88154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d7ffff640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d880cf940 0x7f6d88154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d7ffff640 1 -- 172.21.15.60:0/3873127331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d880c84e0 con 0x7f6d880d18c0 2024-09-12T01:36:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d8d3bb640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d8815e640 0x7f6d880c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d8cbba640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d880cf940 0x7f6d88154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d7ffff640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880d18c0 0x7f6d880c92a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800c480 tx=0x7f6d7800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d7d7fa640 1 -- 172.21.15.60:0/3873127331 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d780052d0 con 0x7f6d880d18c0 2024-09-12T01:36:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d7d7fa640 1 -- 172.21.15.60:0/3873127331 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d78005490 con 0x7f6d880d18c0 2024-09-12T01:36:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/3873127331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d880c87c0 con 0x7f6d880d18c0 2024-09-12T01:36:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.659+0000 7f6d7d7fa640 1 -- 172.21.15.60:0/3873127331 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d78003880 con 0x7f6d880d18c0 2024-09-12T01:36:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.660+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/3873127331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d880c8d80 con 0x7f6d880d18c0 2024-09-12T01:36:25.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.661+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/3873127331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d880d38f0 con 0x7f6d880d18c0 2024-09-12T01:36:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.661+0000 7f6d7d7fa640 1 -- 172.21.15.60:0/3873127331 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d78003a20 con 0x7f6d880d18c0 2024-09-12T01:36:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.662+0000 7f6d7d7fa640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6d7406be30 0x7f6d7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.662+0000 7f6d7d7fa640 1 -- 172.21.15.60:0/3873127331 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6d7808aad0 con 0x7f6d880d18c0 2024-09-12T01:36:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.662+0000 7f6d8cbba640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6d7406be30 0x7f6d7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:25.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.662+0000 7f6d8cbba640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6d7406be30 0x7f6d7406e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6d84034000 tx=0x7f6d8402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.666+0000 7f6d7d7fa640 1 -- 172.21.15.60:0/3873127331 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d78059510 con 0x7f6d880d18c0 2024-09-12T01:36:25.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.881+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/3873127331 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d880d2610 con 0x7f6d880d18c0 2024-09-12T01:36:25.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.881+0000 7f6d7d7fa640 1 -- 172.21.15.60:0/3873127331 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5223 (secure 0 0 0) 0x7f6d78058e10 con 0x7f6d880d18c0 2024-09-12T01:36:25.881 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:25.881 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"btime":"2024-09-12T01:35:58:740642+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3216581844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3216581844},{"type":"v1","addr":"172.21.15.60:6836","nonce":3216581844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1706637770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1706637770},{"type":"v1","addr":"172.21.15.105:6833","nonce":1706637770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3645806076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3645806076},{"type":"v1","addr":"172.21.15.60:6837","nonce":3645806076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:35:55.984648+0000","modified":"2024-09-12T01:35:58.083477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3695785914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3695785914},{"type":"v1","addr":"172.21.15.105:6835","nonce":3695785914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-12T01:36:25.881 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2024-09-12T01:36:25.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.884+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/3873127331 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6d7406be30 msgr2=0x7f6d7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.884+0000 7f6d8ee1e640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6d7406be30 0x7f6d7406e2f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6d84034000 tx=0x7f6d8402e000 comp rx=0 tx=0).stop 2024-09-12T01:36:25.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.884+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/3873127331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880d18c0 msgr2=0x7f6d880c92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:25.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.884+0000 7f6d8ee1e640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880d18c0 0x7f6d880c92a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6d7800c480 tx=0x7f6d7800c940 comp rx=0 tx=0).stop 2024-09-12T01:36:25.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.884+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/3873127331 shutdown_connections 2024-09-12T01:36:25.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.884+0000 7f6d8ee1e640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6d7406be30 0x7f6d7406e2f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.884+0000 7f6d8ee1e640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d8815e640 0x7f6d880c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.884+0000 7f6d8ee1e640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d880d18c0 0x7f6d880c92a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.884+0000 7f6d8ee1e640 1 --2- 172.21.15.60:0/3873127331 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d880cf940 0x7f6d88154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:25.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.884+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/3873127331 >> 172.21.15.60:0/3873127331 conn(0x7f6d88062a50 msgr2=0x7f6d88062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:25.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.884+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/3873127331 shutdown_connections 2024-09-12T01:36:25.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.884+0000 7f6d8ee1e640 1 -- 172.21.15.60:0/3873127331 wait complete. 2024-09-12T01:36:25.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:36:25.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.999+0000 7f0784ca5640 1 Processor -- start 2024-09-12T01:36:25.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:25.999+0000 7f0784ca5640 1 -- start start 2024-09-12T01:36:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.000+0000 7f0784ca5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f078015c170 0x7f078015c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.000+0000 7f0784ca5640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f07800cf6c0 0x7f07800cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.000+0000 7f0784ca5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b5dd0 0x7f07800b6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.000+0000 7f0784ca5640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f078015ca90 con 0x7f078015c170 2024-09-12T01:36:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.000+0000 7f0784ca5640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f07800b4cf0 con 0x7f07800cf6c0 2024-09-12T01:36:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.000+0000 7f0784ca5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f07800b4fd0 con 0x7f07800b5dd0 2024-09-12T01:36:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.000+0000 7f077e59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f078015c170 0x7f078015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.000+0000 7f077e59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f078015c170 0x7f078015c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53930/0 (socket says 172.21.15.60:53930) 2024-09-12T01:36:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.000+0000 7f077e59c640 1 -- 172.21.15.60:0/1701302190 learned_addr learned my addr 172.21.15.60:0/1701302190 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.001+0000 7f077dd9b640 1 --2- 172.21.15.60:0/1701302190 >> v2:172.21.15.105:3300/0 conn(0x7f07800cf6c0 0x7f07800cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.001+0000 7f077ed9d640 1 --2- 172.21.15.60:0/1701302190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b5dd0 0x7f07800b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.001+0000 7f077e59c640 1 -- 172.21.15.60:0/1701302190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b5dd0 msgr2=0x7f07800b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.001+0000 7f077e59c640 1 --2- 172.21.15.60:0/1701302190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b5dd0 0x7f07800b6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.001+0000 7f077e59c640 1 -- 172.21.15.60:0/1701302190 >> v2:172.21.15.105:3300/0 conn(0x7f07800cf6c0 msgr2=0x7f07800cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.001+0000 7f077e59c640 1 --2- 172.21.15.60:0/1701302190 >> v2:172.21.15.105:3300/0 conn(0x7f07800cf6c0 0x7f07800cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.001+0000 7f077e59c640 1 -- 172.21.15.60:0/1701302190 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07800b52b0 con 0x7f078015c170 2024-09-12T01:36:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.001+0000 7f077ed9d640 1 --2- 172.21.15.60:0/1701302190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b5dd0 0x7f07800b6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.001+0000 7f077e59c640 1 --2- 172.21.15.60:0/1701302190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f078015c170 0x7f078015c550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0770009870 tx=0x7f077002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86890bd204ac363f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.002+0000 7f077d59a640 1 -- 172.21.15.60:0/1701302190 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770037070 con 0x7f078015c170 2024-09-12T01:36:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.002+0000 7f077d59a640 1 -- 172.21.15.60:0/1701302190 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0770032440 con 0x7f078015c170 2024-09-12T01:36:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.002+0000 7f077d59a640 1 -- 172.21.15.60:0/1701302190 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0770032810 con 0x7f078015c170 2024-09-12T01:36:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.002+0000 7f0784ca5640 1 -- 172.21.15.60:0/1701302190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f078015c170 msgr2=0x7f078015c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.002+0000 7f0784ca5640 1 --2- 172.21.15.60:0/1701302190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f078015c170 0x7f078015c550 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0770009870 tx=0x7f077002a210 comp rx=0 tx=0).stop 2024-09-12T01:36:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.002+0000 7f0784ca5640 1 -- 172.21.15.60:0/1701302190 shutdown_connections 2024-09-12T01:36:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.002+0000 7f0784ca5640 1 --2- 172.21.15.60:0/1701302190 >> v2:172.21.15.105:3300/0 conn(0x7f07800cf6c0 0x7f07800cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.002+0000 7f0784ca5640 1 --2- 172.21.15.60:0/1701302190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b5dd0 0x7f07800b6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.002+0000 7f0784ca5640 1 --2- 172.21.15.60:0/1701302190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f078015c170 0x7f078015c550 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.002+0000 7f0784ca5640 1 -- 172.21.15.60:0/1701302190 >> 172.21.15.60:0/1701302190 conn(0x7f078006bc10 msgr2=0x7f078006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.002+0000 7f0784ca5640 1 -- 172.21.15.60:0/1701302190 shutdown_connections 2024-09-12T01:36:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.002+0000 7f0784ca5640 1 -- 172.21.15.60:0/1701302190 wait complete. 2024-09-12T01:36:26.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.004+0000 7f0784ca5640 1 Processor -- start 2024-09-12T01:36:26.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.004+0000 7f0784ca5640 1 -- start start 2024-09-12T01:36:26.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.004+0000 7f0784ca5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b5dd0 0x7f0780143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.004+0000 7f0784ca5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07800cf6c0 0x7f078015dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f0784ca5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f078015c170 0x7f078015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f0784ca5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07800b5b50 con 0x7f07800cf6c0 2024-09-12T01:36:26.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f0784ca5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f07800b5870 con 0x7f078015c170 2024-09-12T01:36:26.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f0784ca5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f078015ffb0 con 0x7f07800b5dd0 2024-09-12T01:36:26.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f077dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07800cf6c0 0x7f078015dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f077dd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07800cf6c0 0x7f078015dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53932/0 (socket says 172.21.15.60:53932) 2024-09-12T01:36:26.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f077dd9b640 1 -- 172.21.15.60:0/3219777050 learned_addr learned my addr 172.21.15.60:0/3219777050 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:26.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f077e59c640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b5dd0 0x7f0780143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f077ed9d640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f078015c170 0x7f078015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f077dd9b640 1 -- 172.21.15.60:0/3219777050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b5dd0 msgr2=0x7f0780143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f077dd9b640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b5dd0 0x7f0780143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f077dd9b640 1 -- 172.21.15.60:0/3219777050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f078015c170 msgr2=0x7f078015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f077dd9b640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f078015c170 0x7f078015e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f077dd9b640 1 -- 172.21.15.60:0/3219777050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07800c8930 con 0x7f07800cf6c0 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f077dd9b640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07800cf6c0 0x7f078015dee0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f077400e9e0 tx=0x7f077400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f076effd640 1 -- 172.21.15.60:0/3219777050 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0774017070 con 0x7f07800cf6c0 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f076effd640 1 -- 172.21.15.60:0/3219777050 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f077400c9d0 con 0x7f07800cf6c0 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f0784ca5640 1 -- 172.21.15.60:0/3219777050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07800c7890 con 0x7f07800cf6c0 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f076effd640 1 -- 172.21.15.60:0/3219777050 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f077400cdc0 con 0x7f07800cf6c0 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.005+0000 7f0784ca5640 1 -- 172.21.15.60:0/3219777050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07800c7e50 con 0x7f07800cf6c0 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.006+0000 7f0784ca5640 1 -- 172.21.15.60:0/3219777050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f078015c550 con 0x7f07800cf6c0 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.007+0000 7f076effd640 1 -- 172.21.15.60:0/3219777050 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f077401a070 con 0x7f07800cf6c0 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.007+0000 7f076effd640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f076006be30 0x7f076006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.008+0000 7f076effd640 1 -- 172.21.15.60:0/3219777050 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f077408ade0 con 0x7f07800cf6c0 2024-09-12T01:36:26.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.008+0000 7f077e59c640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f076006be30 0x7f076006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.008+0000 7f077e59c640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f076006be30 0x7f076006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0770034000 tx=0x7f077002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:26.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.012+0000 7f076effd640 1 -- 172.21.15.60:0/3219777050 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0774059140 con 0x7f07800cf6c0 2024-09-12T01:36:26.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.222+0000 7f0784ca5640 1 -- 172.21.15.60:0/3219777050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07800b4810 con 0x7f07800cf6c0 2024-09-12T01:36:26.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.222+0000 7f076effd640 1 -- 172.21.15.60:0/3219777050 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5223 (secure 0 0 0) 0x7f077405d440 con 0x7f07800cf6c0 2024-09-12T01:36:26.222 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:26.222 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":7,"btime":"2024-09-12T01:35:58:740642+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3216581844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3216581844},{"type":"v1","addr":"172.21.15.60:6836","nonce":3216581844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/1706637770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1706637770},{"type":"v1","addr":"172.21.15.105:6833","nonce":1706637770}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3645806076","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3645806076},{"type":"v1","addr":"172.21.15.60:6837","nonce":3645806076}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:35:55.984648+0000","modified":"2024-09-12T01:35:58.083477+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3695785914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":3695785914},{"type":"v1","addr":"172.21.15.105:6835","nonce":3695785914}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4294,"qdb_cluster":[4294]},"id":1}]} 2024-09-12T01:36:26.222 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 7 2024-09-12T01:36:26.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.224+0000 7f0784ca5640 1 -- 172.21.15.60:0/3219777050 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f076006be30 msgr2=0x7f076006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.224+0000 7f0784ca5640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f076006be30 0x7f076006e2f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0770034000 tx=0x7f077002e000 comp rx=0 tx=0).stop 2024-09-12T01:36:26.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.224+0000 7f0784ca5640 1 -- 172.21.15.60:0/3219777050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07800cf6c0 msgr2=0x7f078015dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.224+0000 7f0784ca5640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07800cf6c0 0x7f078015dee0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f077400e9e0 tx=0x7f077400eea0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.224+0000 7f0784ca5640 1 -- 172.21.15.60:0/3219777050 shutdown_connections 2024-09-12T01:36:26.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.224+0000 7f0784ca5640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f078015c170 0x7f078015e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.224+0000 7f0784ca5640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07800cf6c0 0x7f078015dee0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.224+0000 7f0784ca5640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f076006be30 0x7f076006e2f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.224+0000 7f0784ca5640 1 --2- 172.21.15.60:0/3219777050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07800b5dd0 0x7f0780143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.224+0000 7f0784ca5640 1 -- 172.21.15.60:0/3219777050 >> 172.21.15.60:0/3219777050 conn(0x7f078006bc10 msgr2=0x7f07800b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.225+0000 7f0784ca5640 1 -- 172.21.15.60:0/3219777050 shutdown_connections 2024-09-12T01:36:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.225+0000 7f0784ca5640 1 -- 172.21.15.60:0/3219777050 wait complete. 2024-09-12T01:36:26.235 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:36:26.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.339+0000 7f3d09e5a640 1 Processor -- start 2024-09-12T01:36:26.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.339+0000 7f3d09e5a640 1 -- start start 2024-09-12T01:36:26.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.340+0000 7f3d09e5a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3d040d18c0 0x7f3d040d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.340+0000 7f3d09e5a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d040cf940 0x7f3d040d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.340+0000 7f3d09e5a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d040cfdb0 con 0x7f3d0415e640 2024-09-12T01:36:26.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.340+0000 7f3d09e5a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3d040d3a30 con 0x7f3d040cf940 2024-09-12T01:36:26.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.340+0000 7f3d09e5a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3d040d3c60 con 0x7f3d040d18c0 2024-09-12T01:36:26.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.340+0000 7f3d037fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3d0415e640 0x7f3d040d11b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48908/0 (socket says 172.21.15.60:48908) 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.340+0000 7f3d037fe640 1 -- 172.21.15.60:0/1947842863 learned_addr learned my addr 172.21.15.60:0/1947842863 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.340+0000 7f3d03fff640 1 --2- 172.21.15.60:0/1947842863 >> v2:172.21.15.60:3300/0 conn(0x7f3d040cf940 0x7f3d040d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.340+0000 7f3d02ffd640 1 --2- 172.21.15.60:0/1947842863 >> v2:172.21.15.105:3300/0 conn(0x7f3d040d18c0 0x7f3d040d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.340+0000 7f3d027fc640 1 -- 172.21.15.60:0/1947842863 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385030516 0 0) 0x7f3d040cfdb0 con 0x7f3d0415e640 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.341+0000 7f3d027fc640 1 -- 172.21.15.60:0/1947842863 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cf0003520 con 0x7f3d0415e640 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.341+0000 7f3d03fff640 1 -- 172.21.15.60:0/1947842863 >> v2:172.21.15.105:3300/0 conn(0x7f3d040d18c0 msgr2=0x7f3d040d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.341+0000 7f3d03fff640 1 --2- 172.21.15.60:0/1947842863 >> v2:172.21.15.105:3300/0 conn(0x7f3d040d18c0 0x7f3d040d4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.341+0000 7f3d03fff640 1 -- 172.21.15.60:0/1947842863 >> v1:172.21.15.60:6789/0 conn(0x7f3d0415e640 legacy=0x7f3d040d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.341+0000 7f3d03fff640 1 -- 172.21.15.60:0/1947842863 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d040d3f40 con 0x7f3d040cf940 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.341+0000 7f3d02ffd640 1 --2- 172.21.15.60:0/1947842863 >> v2:172.21.15.105:3300/0 conn(0x7f3d040d18c0 0x7f3d040d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.341+0000 7f3d03fff640 1 --2- 172.21.15.60:0/1947842863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d040cf940 0x7f3d040d34f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d040d0200 tx=0x7f3cfc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc239d6a9bf8457 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.341+0000 7f3d027fc640 1 -- 172.21.15.60:0/1947842863 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc007740 con 0x7f3d040cf940 2024-09-12T01:36:26.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.342+0000 7f3d027fc640 1 -- 172.21.15.60:0/1947842863 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cfc0078e0 con 0x7f3d040cf940 2024-09-12T01:36:26.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.342+0000 7f3d027fc640 1 -- 172.21.15.60:0/1947842863 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc007cb0 con 0x7f3d040cf940 2024-09-12T01:36:26.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.342+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1947842863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d040cf940 msgr2=0x7f3d040d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.342+0000 7f3d09e5a640 1 --2- 172.21.15.60:0/1947842863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d040cf940 0x7f3d040d34f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3d040d0200 tx=0x7f3cfc02a680 comp rx=0 tx=0).stop 2024-09-12T01:36:26.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.342+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1947842863 shutdown_connections 2024-09-12T01:36:26.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.342+0000 7f3d09e5a640 1 --2- 172.21.15.60:0/1947842863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d040cf940 0x7f3d040d34f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.342+0000 7f3d09e5a640 1 --2- 172.21.15.60:0/1947842863 >> v2:172.21.15.105:3300/0 conn(0x7f3d040d18c0 0x7f3d040d4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.342+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1947842863 >> 172.21.15.60:0/1947842863 conn(0x7f3d04062a50 msgr2=0x7f3d04062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:26.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.342+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1947842863 shutdown_connections 2024-09-12T01:36:26.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.342+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1947842863 wait complete. 2024-09-12T01:36:26.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.343+0000 7f3d09e5a640 1 Processor -- start 2024-09-12T01:36:26.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.344+0000 7f3d09e5a640 1 -- start start 2024-09-12T01:36:26.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.344+0000 7f3d09e5a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d040cf940 0x7f3d04157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.344+0000 7f3d09e5a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d040d18c0 0x7f3d040ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.344+0000 7f3d09e5a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0415e640 0x7f3d0414b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.344+0000 7f3d09e5a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0415ea20 con 0x7f3d0415e640 2024-09-12T01:36:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.344+0000 7f3d09e5a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3d040d4500 con 0x7f3d040cf940 2024-09-12T01:36:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.344+0000 7f3d09e5a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3d0415eba0 con 0x7f3d040d18c0 2024-09-12T01:36:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.344+0000 7f3d03fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0415e640 0x7f3d0414b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.344+0000 7f3d03fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0415e640 0x7f3d0414b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53958/0 (socket says 172.21.15.60:53958) 2024-09-12T01:36:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d03fff640 1 -- 172.21.15.60:0/1751476933 learned_addr learned my addr 172.21.15.60:0/1751476933 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d02ffd640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d040d18c0 0x7f3d040ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d037fe640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d040cf940 0x7f3d04157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d03fff640 1 -- 172.21.15.60:0/1751476933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d040d18c0 msgr2=0x7f3d040ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d03fff640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d040d18c0 0x7f3d040ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d03fff640 1 -- 172.21.15.60:0/1751476933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d040cf940 msgr2=0x7f3d04157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d03fff640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d040cf940 0x7f3d04157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d03fff640 1 -- 172.21.15.60:0/1751476933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d04156aa0 con 0x7f3d0415e640 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d037fe640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d040cf940 0x7f3d04157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d02ffd640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d040d18c0 0x7f3d040ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d03fff640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0415e640 0x7f3d0414b7a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009e50 tx=0x7f3cfc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3cfbfff640 1 -- 172.21.15.60:0/1751476933 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc03f070 con 0x7f3d0415e640 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3cfbfff640 1 -- 172.21.15.60:0/1751476933 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cfc031bf0 con 0x7f3d0415e640 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1751476933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d04156d80 con 0x7f3d0415e640 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3cfbfff640 1 -- 172.21.15.60:0/1751476933 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc009450 con 0x7f3d0415e640 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.345+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1751476933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d04157340 con 0x7f3d0415e640 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.346+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1751476933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d040d34f0 con 0x7f3d0415e640 2024-09-12T01:36:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.347+0000 7f3cfbfff640 1 -- 172.21.15.60:0/1751476933 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3cfc03b410 con 0x7f3d0415e640 2024-09-12T01:36:26.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.348+0000 7f3cfbfff640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3ce406be30 0x7f3ce406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.348+0000 7f3d037fe640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3ce406be30 0x7f3ce406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.348+0000 7f3cfbfff640 1 -- 172.21.15.60:0/1751476933 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3cfc0ac520 con 0x7f3d0415e640 2024-09-12T01:36:26.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.348+0000 7f3d037fe640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3ce406be30 0x7f3ce406e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3cec005880 tx=0x7f3cec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:26.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.352+0000 7f3cfbfff640 1 -- 172.21.15.60:0/1751476933 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3cfc07a910 con 0x7f3d0415e640 2024-09-12T01:36:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.530+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1751476933 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3d04163180 con 0x7f3d0415e640 2024-09-12T01:36:26.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.531+0000 7f3cfbfff640 1 -- 172.21.15.60:0/1751476933 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16633 (secure 0 0 0) 0x7f3cfc07ec10 con 0x7f3d0415e640 2024-09-12T01:36:26.530 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:26.530 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:35:57.624089+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:35:53.846331+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-12T01:35:54.965757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:36:26.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.533+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1751476933 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3ce406be30 msgr2=0x7f3ce406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.533+0000 7f3d09e5a640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3ce406be30 0x7f3ce406e2f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3cec005880 tx=0x7f3cec009040 comp rx=0 tx=0).stop 2024-09-12T01:36:26.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.533+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1751476933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0415e640 msgr2=0x7f3d0414b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.533+0000 7f3d09e5a640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0415e640 0x7f3d0414b7a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009e50 tx=0x7f3cfc004a40 comp rx=0 tx=0).stop 2024-09-12T01:36:26.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.533+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1751476933 shutdown_connections 2024-09-12T01:36:26.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.533+0000 7f3d09e5a640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d0415e640 0x7f3d0414b7a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.533+0000 7f3d09e5a640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3ce406be30 0x7f3ce406e2f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.533+0000 7f3d09e5a640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d040d18c0 0x7f3d040ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.533+0000 7f3d09e5a640 1 --2- 172.21.15.60:0/1751476933 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d040cf940 0x7f3d04157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.533+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1751476933 >> 172.21.15.60:0/1751476933 conn(0x7f3d04062a50 msgr2=0x7f3d0415ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:26.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.533+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1751476933 shutdown_connections 2024-09-12T01:36:26.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.533+0000 7f3d09e5a640 1 -- 172.21.15.60:0/1751476933 wait complete. 2024-09-12T01:36:26.546 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:36:26.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.650+0000 7fc29f8ba640 1 Processor -- start 2024-09-12T01:36:26.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.650+0000 7fc29f8ba640 1 -- start start 2024-09-12T01:36:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29f8ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2980b64a0 0x7fc2980b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29f8ba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc2980b7f50 0x7fc2980b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29f8ba640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2980b7790 con 0x7fc29815e750 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29f8ba640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc2980d43c0 con 0x7fc2980b7f50 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29f8ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc2980d33b0 con 0x7fc2980b64a0 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29de57640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc2980b7f50 0x7fc2980b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29de57640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc2980b7f50 0x7fc2980b83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53960/0 (socket says 172.21.15.60:53960) 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29de57640 1 -- 172.21.15.60:0/2382293361 learned_addr learned my addr 172.21.15.60:0/2382293361 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29d656640 1 --1- 172.21.15.60:0/2382293361 >> v1:172.21.15.60:6789/0 conn(0x7fc29815e750 0x7fc2980cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48918/0 (socket says 172.21.15.60:48918) 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29ce55640 1 --2- 172.21.15.60:0/2382293361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2980b64a0 0x7fc2980b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29de57640 1 -- 172.21.15.60:0/2382293361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2980b64a0 msgr2=0x7fc2980b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29de57640 1 --2- 172.21.15.60:0/2382293361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2980b64a0 0x7fc2980b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29de57640 1 -- 172.21.15.60:0/2382293361 >> v1:172.21.15.60:6789/0 conn(0x7fc29815e750 legacy=0x7fc2980cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc28ffff640 1 -- 172.21.15.60:0/2382293361 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4098459081 0 0) 0x7fc2980b7790 con 0x7fc29815e750 2024-09-12T01:36:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.651+0000 7fc29de57640 1 -- 172.21.15.60:0/2382293361 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2980d3600 con 0x7fc2980b7f50 2024-09-12T01:36:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.652+0000 7fc29de57640 1 --2- 172.21.15.60:0/2382293361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2980b7f50 0x7fc2980b83e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc290009e50 tx=0x7fc29002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7dc8dd7826d113 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.652+0000 7fc28ffff640 1 -- 172.21.15.60:0/2382293361 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc290036070 con 0x7fc2980b7f50 2024-09-12T01:36:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.652+0000 7fc28ffff640 1 -- 172.21.15.60:0/2382293361 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc290031600 con 0x7fc2980b7f50 2024-09-12T01:36:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.652+0000 7fc28ffff640 1 -- 172.21.15.60:0/2382293361 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2900319d0 con 0x7fc2980b7f50 2024-09-12T01:36:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.653+0000 7fc29f8ba640 1 -- 172.21.15.60:0/2382293361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2980b7f50 msgr2=0x7fc2980b83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.653+0000 7fc29f8ba640 1 --2- 172.21.15.60:0/2382293361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2980b7f50 0x7fc2980b83e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc290009e50 tx=0x7fc29002a710 comp rx=0 tx=0).stop 2024-09-12T01:36:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.653+0000 7fc29f8ba640 1 -- 172.21.15.60:0/2382293361 shutdown_connections 2024-09-12T01:36:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.653+0000 7fc29f8ba640 1 --2- 172.21.15.60:0/2382293361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2980b7f50 0x7fc2980b83e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.653+0000 7fc29f8ba640 1 --2- 172.21.15.60:0/2382293361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2980b64a0 0x7fc2980b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.653+0000 7fc29f8ba640 1 -- 172.21.15.60:0/2382293361 >> 172.21.15.60:0/2382293361 conn(0x7fc2980d1500 msgr2=0x7fc2980d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.653+0000 7fc29f8ba640 1 -- 172.21.15.60:0/2382293361 shutdown_connections 2024-09-12T01:36:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.653+0000 7fc29f8ba640 1 -- 172.21.15.60:0/2382293361 wait complete. 2024-09-12T01:36:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.654+0000 7fc29f8ba640 1 Processor -- start 2024-09-12T01:36:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.654+0000 7fc29f8ba640 1 -- start start 2024-09-12T01:36:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29f8ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2980b64a0 0x7fc298153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29f8ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2980b7f50 0x7fc29815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29f8ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc29815e750 0x7fc298146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29f8ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc2980b6e20 con 0x7fc29815e750 2024-09-12T01:36:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29f8ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc2980b7ac0 con 0x7fc2980b64a0 2024-09-12T01:36:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29f8ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc2980d3bc0 con 0x7fc2980b7f50 2024-09-12T01:36:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29de57640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc29815e750 0x7fc298146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29de57640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc29815e750 0x7fc298146840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53966/0 (socket says 172.21.15.60:53966) 2024-09-12T01:36:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29de57640 1 -- 172.21.15.60:0/49433129 learned_addr learned my addr 172.21.15.60:0/49433129 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29de57640 1 -- 172.21.15.60:0/49433129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2980b7f50 msgr2=0x7fc29815b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29de57640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2980b7f50 0x7fc29815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29d656640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2980b64a0 0x7fc298153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29de57640 1 -- 172.21.15.60:0/49433129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2980b64a0 msgr2=0x7fc298153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29de57640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2980b64a0 0x7fc298153660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29de57640 1 -- 172.21.15.60:0/49433129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2981471f0 con 0x7fc29815e750 2024-09-12T01:36:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.655+0000 7fc29de57640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc29815e750 0x7fc298146840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc290034040 tx=0x7fc290004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.656+0000 7fc28dffb640 1 -- 172.21.15.60:0/49433129 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc290036050 con 0x7fc29815e750 2024-09-12T01:36:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.656+0000 7fc28dffb640 1 -- 172.21.15.60:0/49433129 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc290042070 con 0x7fc29815e750 2024-09-12T01:36:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.656+0000 7fc29f8ba640 1 -- 172.21.15.60:0/49433129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2981474d0 con 0x7fc29815e750 2024-09-12T01:36:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.656+0000 7fc28dffb640 1 -- 172.21.15.60:0/49433129 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc290009510 con 0x7fc29815e750 2024-09-12T01:36:26.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.656+0000 7fc29f8ba640 1 -- 172.21.15.60:0/49433129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29815ac30 con 0x7fc29815e750 2024-09-12T01:36:26.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.657+0000 7fc29f8ba640 1 -- 172.21.15.60:0/49433129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29806d300 con 0x7fc29815e750 2024-09-12T01:36:26.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.657+0000 7fc28dffb640 1 -- 172.21.15.60:0/49433129 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc290007bd0 con 0x7fc29815e750 2024-09-12T01:36:26.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.658+0000 7fc28dffb640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc27c06be30 0x7fc27c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.658+0000 7fc28dffb640 1 -- 172.21.15.60:0/49433129 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc2900abd80 con 0x7fc29815e750 2024-09-12T01:36:26.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.658+0000 7fc29d656640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc27c06be30 0x7fc27c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.658+0000 7fc29d656640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc27c06be30 0x7fc27c06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc294000f60 tx=0x7fc294009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:26.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.662+0000 7fc28dffb640 1 -- 172.21.15.60:0/49433129 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc29806d300 con 0x7fc29815e750 2024-09-12T01:36:26.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.874+0000 7fc29f8ba640 1 -- 172.21.15.60:0/49433129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc2980b68e0 con 0x7fc29815e750 2024-09-12T01:36:26.874 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-12T01:36:26.875+0000 7f58b98dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:36:26.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.876+0000 7fc28dffb640 1 -- 172.21.15.60:0/49433129 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7fc290045360 con 0x7fc29815e750 2024-09-12T01:36:26.876 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:36:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.879+0000 7fc29f8ba640 1 -- 172.21.15.60:0/49433129 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc27c06be30 msgr2=0x7fc27c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.879+0000 7fc29f8ba640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc27c06be30 0x7fc27c06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc294000f60 tx=0x7fc294009040 comp rx=0 tx=0).stop 2024-09-12T01:36:26.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.879+0000 7fc29f8ba640 1 -- 172.21.15.60:0/49433129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc29815e750 msgr2=0x7fc298146840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.879+0000 7fc29f8ba640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc29815e750 0x7fc298146840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc290034040 tx=0x7fc290004a40 comp rx=0 tx=0).stop 2024-09-12T01:36:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.879+0000 7fc29f8ba640 1 -- 172.21.15.60:0/49433129 shutdown_connections 2024-09-12T01:36:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.879+0000 7fc29f8ba640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc29815e750 0x7fc298146840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.879+0000 7fc29f8ba640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc27c06be30 0x7fc27c06e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.879+0000 7fc29f8ba640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2980b7f50 0x7fc29815b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.879+0000 7fc29f8ba640 1 --2- 172.21.15.60:0/49433129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2980b64a0 0x7fc298153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.879+0000 7fc29f8ba640 1 -- 172.21.15.60:0/49433129 >> 172.21.15.60:0/49433129 conn(0x7fc2980d1500 msgr2=0x7fc2980cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.879+0000 7fc29f8ba640 1 -- 172.21.15.60:0/49433129 shutdown_connections 2024-09-12T01:36:26.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.879+0000 7fc29f8ba640 1 -- 172.21.15.60:0/49433129 wait complete. 2024-09-12T01:36:26.883 INFO:tasks.ceph.mds.d.smithi105.stderr: -6705> 2024-09-12T01:36:01.605+0000 7f3d3c9cc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:36:26.890 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:36:26.918 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:36:26.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.995+0000 7f3a61694640 1 Processor -- start 2024-09-12T01:36:26.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.995+0000 7f3a61694640 1 -- start start 2024-09-12T01:36:26.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a61694640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a5c15e7a0 0x7f3a5c06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a61694640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3a5c0b68f0 0x7f3a5c0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a61694640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a5c0cf860 con 0x7f3a5c0cf1f0 2024-09-12T01:36:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a61694640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3a5c0d2ca0 con 0x7f3a5c15e7a0 2024-09-12T01:36:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a61694640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3a5c0cfb40 con 0x7f3a5c0b68f0 2024-09-12T01:36:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a5affd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a5c15e7a0 0x7f3a5c06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a5a7fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3a5c0cf1f0 0x7f3a5c0b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48930/0 (socket says 172.21.15.60:48930) 2024-09-12T01:36:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a5a7fc640 1 -- 172.21.15.60:0/1686779365 learned_addr learned my addr 172.21.15.60:0/1686779365 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a5b7fe640 1 --2- 172.21.15.60:0/1686779365 >> v2:172.21.15.105:3300/0 conn(0x7f3a5c0b68f0 0x7f3a5c0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a5affd640 1 -- 172.21.15.60:0/1686779365 >> v2:172.21.15.105:3300/0 conn(0x7f3a5c0b68f0 msgr2=0x7f3a5c0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a5affd640 1 --2- 172.21.15.60:0/1686779365 >> v2:172.21.15.105:3300/0 conn(0x7f3a5c0b68f0 0x7f3a5c0d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a5affd640 1 -- 172.21.15.60:0/1686779365 >> v1:172.21.15.60:6789/0 conn(0x7f3a5c0cf1f0 legacy=0x7f3a5c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a5affd640 1 -- 172.21.15.60:0/1686779365 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c0cfe20 con 0x7f3a5c15e7a0 2024-09-12T01:36:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.996+0000 7f3a5b7fe640 1 --2- 172.21.15.60:0/1686779365 >> v2:172.21.15.105:3300/0 conn(0x7f3a5c0b68f0 0x7f3a5c0d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.997+0000 7f3a5affd640 1 --2- 172.21.15.60:0/1686779365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c15e7a0 0x7f3a5c06caa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c08d930 tx=0x7f3a4c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6a829c57a39b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.997+0000 7f3a59ffb640 1 -- 172.21.15.60:0/1686779365 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c037070 con 0x7f3a5c15e7a0 2024-09-12T01:36:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.997+0000 7f3a59ffb640 1 -- 172.21.15.60:0/1686779365 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4c032440 con 0x7f3a5c15e7a0 2024-09-12T01:36:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.997+0000 7f3a59ffb640 1 -- 172.21.15.60:0/1686779365 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c02ae60 con 0x7f3a5c15e7a0 2024-09-12T01:36:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.998+0000 7f3a61694640 1 -- 172.21.15.60:0/1686779365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c15e7a0 msgr2=0x7f3a5c06caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.998+0000 7f3a61694640 1 --2- 172.21.15.60:0/1686779365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c15e7a0 0x7f3a5c06caa0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c08d930 tx=0x7f3a4c02a110 comp rx=0 tx=0).stop 2024-09-12T01:36:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.998+0000 7f3a61694640 1 -- 172.21.15.60:0/1686779365 shutdown_connections 2024-09-12T01:36:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.998+0000 7f3a61694640 1 --2- 172.21.15.60:0/1686779365 >> v2:172.21.15.105:3300/0 conn(0x7f3a5c0b68f0 0x7f3a5c0d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.998+0000 7f3a61694640 1 --2- 172.21.15.60:0/1686779365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c15e7a0 0x7f3a5c06caa0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.998+0000 7f3a61694640 1 -- 172.21.15.60:0/1686779365 >> 172.21.15.60:0/1686779365 conn(0x7f3a5c0d11e0 msgr2=0x7f3a5c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.998+0000 7f3a61694640 1 -- 172.21.15.60:0/1686779365 shutdown_connections 2024-09-12T01:36:26.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.998+0000 7f3a61694640 1 -- 172.21.15.60:0/1686779365 wait complete. 2024-09-12T01:36:27.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.999+0000 7f3a61694640 1 Processor -- start 2024-09-12T01:36:27.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:26.999+0000 7f3a61694640 1 -- start start 2024-09-12T01:36:27.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a61694640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a5c0b68f0 0x7f3a5c14eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:27.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a61694640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0cf1f0 0x7f3a5c0ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:27.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a61694640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a5c15e7a0 0x7f3a5c0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:27.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a61694640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c06cfe0 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a61694640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c0b7a00 con 0x7f3a5c15e7a0 2024-09-12T01:36:27.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a61694640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5c15eb80 con 0x7f3a5c0b68f0 2024-09-12T01:36:27.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a5a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0cf1f0 0x7f3a5c0ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:27.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a5a7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0cf1f0 0x7f3a5c0ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53982/0 (socket says 172.21.15.60:53982) 2024-09-12T01:36:27.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a5a7fc640 1 -- 172.21.15.60:0/587382517 learned_addr learned my addr 172.21.15.60:0/587382517 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a5affd640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a5c0b68f0 0x7f3a5c14eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a5b7fe640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a5c15e7a0 0x7f3a5c0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a5a7fc640 1 -- 172.21.15.60:0/587382517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a5c0b68f0 msgr2=0x7f3a5c14eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a5a7fc640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a5c0b68f0 0x7f3a5c14eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a5a7fc640 1 -- 172.21.15.60:0/587382517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a5c15e7a0 msgr2=0x7f3a5c0cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.000+0000 7f3a5a7fc640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a5c15e7a0 0x7f3a5c0cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.001+0000 7f3a5a7fc640 1 -- 172.21.15.60:0/587382517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c14f0c0 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.001+0000 7f3a5affd640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a5c0b68f0 0x7f3a5c14eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.001+0000 7f3a5b7fe640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a5c15e7a0 0x7f3a5c0cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.001+0000 7f3a5a7fc640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0cf1f0 0x7f3a5c0ca8a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000c400 tx=0x7f3a5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.001+0000 7f3a437fe640 1 -- 172.21.15.60:0/587382517 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50017070 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.001+0000 7f3a437fe640 1 -- 172.21.15.60:0/587382517 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a50005ce0 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.001+0000 7f3a61694640 1 -- 172.21.15.60:0/587382517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5c15ee20 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.001+0000 7f3a437fe640 1 -- 172.21.15.60:0/587382517 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a500072f0 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.001+0000 7f3a61694640 1 -- 172.21.15.60:0/587382517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5c15f3e0 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.002+0000 7f3a61694640 1 -- 172.21.15.60:0/587382517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5c06caa0 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.002+0000 7f3a437fe640 1 -- 172.21.15.60:0/587382517 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a5001a070 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.003+0000 7f3a437fe640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a4806be30 0x7f3a4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:27.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.003+0000 7f3a5affd640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a4806be30 0x7f3a4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:27.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.003+0000 7f3a437fe640 1 -- 172.21.15.60:0/587382517 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7f3a5008a260 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.004+0000 7f3a5affd640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a4806be30 0x7f3a4806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c034000 tx=0x7f3a4c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:27.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.008+0000 7f3a437fe640 1 -- 172.21.15.60:0/587382517 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a50058c40 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.221+0000 7f3a61694640 1 -- 172.21.15.60:0/587382517 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3a5c0b8790 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.878+0000 7f3a437fe640 1 -- 172.21.15.60:0/587382517 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7f3a50058540 con 0x7f3a5c0cf1f0 2024-09-12T01:36:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.881+0000 7f3a61694640 1 -- 172.21.15.60:0/587382517 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a4806be30 msgr2=0x7f3a4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.881+0000 7f3a61694640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a4806be30 0x7f3a4806e2f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c034000 tx=0x7f3a4c02e000 comp rx=0 tx=0).stop 2024-09-12T01:36:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.881+0000 7f3a61694640 1 -- 172.21.15.60:0/587382517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0cf1f0 msgr2=0x7f3a5c0ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.881+0000 7f3a61694640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0cf1f0 0x7f3a5c0ca8a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000c400 tx=0x7f3a5000c8c0 comp rx=0 tx=0).stop 2024-09-12T01:36:27.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.881+0000 7f3a61694640 1 -- 172.21.15.60:0/587382517 shutdown_connections 2024-09-12T01:36:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.881+0000 7f3a61694640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a5c15e7a0 0x7f3a5c0cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.881+0000 7f3a61694640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a5c0cf1f0 0x7f3a5c0ca8a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.881+0000 7f3a61694640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a4806be30 0x7f3a4806e2f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.881+0000 7f3a61694640 1 --2- 172.21.15.60:0/587382517 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a5c0b68f0 0x7f3a5c14eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.881+0000 7f3a61694640 1 -- 172.21.15.60:0/587382517 >> 172.21.15.60:0/587382517 conn(0x7f3a5c0d11e0 msgr2=0x7f3a5c15ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.881+0000 7f3a61694640 1 -- 172.21.15.60:0/587382517 shutdown_connections 2024-09-12T01:36:27.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:27.881+0000 7f3a61694640 1 -- 172.21.15.60:0/587382517 wait complete. 2024-09-12T01:36:27.895 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:36:28.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.009+0000 7fe4ccf9f640 1 Processor -- start 2024-09-12T01:36:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.009+0000 7fe4ccf9f640 1 -- start start 2024-09-12T01:36:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.010+0000 7fe4ccf9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c80d4380 0x7fe4c80d47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.010+0000 7fe4ccf9f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe4c80b7510 0x7fe4c80b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.010+0000 7fe4ccf9f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c80d40d0 con 0x7fe4c815e700 2024-09-12T01:36:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.010+0000 7fe4ccf9f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c80cfb70 con 0x7fe4c80b7510 2024-09-12T01:36:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.010+0000 7fe4ccf9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c80cead0 con 0x7fe4c80d4380 2024-09-12T01:36:28.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.010+0000 7fe4c77fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe4c815e700 0x7fe4c80d39c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48940/0 (socket says 172.21.15.60:48940) 2024-09-12T01:36:28.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.010+0000 7fe4c77fe640 1 -- 172.21.15.60:0/2529237204 learned_addr learned my addr 172.21.15.60:0/2529237204 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:28.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.010+0000 7fe4c6ffd640 1 --2- 172.21.15.60:0/2529237204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c80d4380 0x7fe4c80d47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:28.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.010+0000 7fe4c7fff640 1 --2- 172.21.15.60:0/2529237204 >> v2:172.21.15.105:3300/0 conn(0x7fe4c80b7510 0x7fe4c80b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.010+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775555529 0 0) 0x7fe4c80d40d0 con 0x7fe4c815e700 2024-09-12T01:36:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.010+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4b0003520 con 0x7fe4c815e700 2024-09-12T01:36:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3219115866 0 0) 0x7fe4b0003520 con 0x7fe4c815e700 2024-09-12T01:36:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c80d4380 msgr2=0x7fe4c80d47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 --2- 172.21.15.60:0/2529237204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c80d4380 0x7fe4c80d47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 >> v2:172.21.15.105:3300/0 conn(0x7fe4c80b7510 msgr2=0x7fe4c80b79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 --2- 172.21.15.60:0/2529237204 >> v2:172.21.15.105:3300/0 conn(0x7fe4c80b7510 0x7fe4c80b79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c80cedb0 con 0x7fe4c815e700 2024-09-12T01:36:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fe4b8001670 con 0x7fe4c815e700 2024-09-12T01:36:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 >> v1:172.21.15.60:6789/0 conn(0x7fe4c815e700 legacy=0x7fe4c80d39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 --2- 172.21.15.60:0/2529237204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4b00039b0 0x7fe4b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:28.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 --2- 172.21.15.60:0/2529237204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4b0004800 0x7fe4b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 --2- 172.21.15.60:0/2529237204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c80d4380 0x7fe4b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c80cead0 con 0x7fe4b0004800 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b000b9c0 con 0x7fe4b00039b0 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b000bb40 con 0x7fe4c80d4380 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c6ffd640 1 --2- 172.21.15.60:0/2529237204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4b0004800 0x7fe4b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c77fe640 1 --2- 172.21.15.60:0/2529237204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4b00039b0 0x7fe4b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c7fff640 1 --2- 172.21.15.60:0/2529237204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c80d4380 0x7fe4b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c6ffd640 1 -- 172.21.15.60:0/2529237204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c80d4380 msgr2=0x7fe4b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c6ffd640 1 --2- 172.21.15.60:0/2529237204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c80d4380 0x7fe4b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c6ffd640 1 -- 172.21.15.60:0/2529237204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4b00039b0 msgr2=0x7fe4b0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c6ffd640 1 --2- 172.21.15.60:0/2529237204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4b00039b0 0x7fe4b0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.011+0000 7fe4c6ffd640 1 -- 172.21.15.60:0/2529237204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b0003520 con 0x7fe4b0004800 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.012+0000 7fe4c6ffd640 1 --2- 172.21.15.60:0/2529237204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4b0004800 0x7fe4b0004c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009ac0 tx=0x7fe4b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f212711ce93a53d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:28.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.012+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc036070 con 0x7fe4b0004800 2024-09-12T01:36:28.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.012+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc031400 con 0x7fe4b0004800 2024-09-12T01:36:28.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.012+0000 7fe4c67fc640 1 -- 172.21.15.60:0/2529237204 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc009690 con 0x7fe4b0004800 2024-09-12T01:36:28.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.013+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/2529237204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4b0004800 msgr2=0x7fe4b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:28.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.013+0000 7fe4ccf9f640 1 --2- 172.21.15.60:0/2529237204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4b0004800 0x7fe4b0004c80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009ac0 tx=0x7fe4b0005830 comp rx=0 tx=0).stop 2024-09-12T01:36:28.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.013+0000 7fe4c7fff640 1 -- 172.21.15.60:0/2529237204 reap_dead start 2024-09-12T01:36:28.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.013+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/2529237204 shutdown_connections 2024-09-12T01:36:28.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.013+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/2529237204 >> 172.21.15.60:0/2529237204 conn(0x7fe4c8062a20 msgr2=0x7fe4c8062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:28.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.013+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/2529237204 shutdown_connections 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.013+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/2529237204 wait complete. 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.014+0000 7fe4ccf9f640 1 Processor -- start 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.014+0000 7fe4ccf9f640 1 -- start start 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4ccf9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4b0004800 0x7fe4c814a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4ccf9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c80cb550 0x7fe4c80ce2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4ccf9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c814b0a0 0x7fe4c815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4ccf9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c80cf650 con 0x7fe4c80cb550 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4ccf9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c80cf370 con 0x7fe4c814b0a0 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4ccf9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c80b6c60 con 0x7fe4b0004800 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c80cb550 0x7fe4c80ce2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c80cb550 0x7fe4c80ce2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53992/0 (socket says 172.21.15.60:53992) 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c6ffd640 1 -- 172.21.15.60:0/1841704469 learned_addr learned my addr 172.21.15.60:0/1841704469 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:28.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c77fe640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4b0004800 0x7fe4c814a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c7fff640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c814b0a0 0x7fe4c815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c6ffd640 1 -- 172.21.15.60:0/1841704469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4b0004800 msgr2=0x7fe4c814a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c6ffd640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4b0004800 0x7fe4c814a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c6ffd640 1 -- 172.21.15.60:0/1841704469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c814b0a0 msgr2=0x7fe4c815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c6ffd640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c814b0a0 0x7fe4c815cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c6ffd640 1 -- 172.21.15.60:0/1841704469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c80cb9e0 con 0x7fe4c80cb550 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c77fe640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4b0004800 0x7fe4c814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c7fff640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c814b0a0 0x7fe4c815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.015+0000 7fe4c6ffd640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c80cb550 0x7fe4c80ce2a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009ac0 tx=0x7fe4bc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.016+0000 7fe4affff640 1 -- 172.21.15.60:0/1841704469 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc040020 con 0x7fe4c80cb550 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.016+0000 7fe4affff640 1 -- 172.21.15.60:0/1841704469 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc003bc0 con 0x7fe4c80cb550 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.016+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/1841704469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c815fe90 con 0x7fe4c80cb550 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.016+0000 7fe4affff640 1 -- 172.21.15.60:0/1841704469 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc036040 con 0x7fe4c80cb550 2024-09-12T01:36:28.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.016+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/1841704469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c8160450 con 0x7fe4c80cb550 2024-09-12T01:36:28.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.017+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/1841704469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c80d47c0 con 0x7fe4c80cb550 2024-09-12T01:36:28.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.017+0000 7fe4affff640 1 -- 172.21.15.60:0/1841704469 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe4bc043020 con 0x7fe4c80cb550 2024-09-12T01:36:28.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.018+0000 7fe4affff640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe4b406be30 0x7fe4b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:28.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.018+0000 7fe4affff640 1 -- 172.21.15.60:0/1841704469 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7fe4bc0ab040 con 0x7fe4c80cb550 2024-09-12T01:36:28.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.018+0000 7fe4c77fe640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe4b406be30 0x7fe4b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:28.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.018+0000 7fe4c77fe640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe4b406be30 0x7fe4b406e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8001050 tx=0x7fe4b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:28.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.022+0000 7fe4affff640 1 -- 172.21.15.60:0/1841704469 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe4bc04a070 con 0x7fe4c80cb550 2024-09-12T01:36:28.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.197+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/1841704469 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe4c80c7cc0 con 0x7fe4c80cb550 2024-09-12T01:36:28.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.882+0000 7fe4affff640 1 -- 172.21.15.60:0/1841704469 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7fe4bc0044e0 con 0x7fe4c80cb550 2024-09-12T01:36:28.882 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:36:28.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.887+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/1841704469 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe4b406be30 msgr2=0x7fe4b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:28.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.887+0000 7fe4ccf9f640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe4b406be30 0x7fe4b406e2f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8001050 tx=0x7fe4b8009040 comp rx=0 tx=0).stop 2024-09-12T01:36:28.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.887+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/1841704469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c80cb550 msgr2=0x7fe4c80ce2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.887+0000 7fe4ccf9f640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c80cb550 0x7fe4c80ce2a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009ac0 tx=0x7fe4bc004730 comp rx=0 tx=0).stop 2024-09-12T01:36:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.887+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/1841704469 shutdown_connections 2024-09-12T01:36:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.887+0000 7fe4ccf9f640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c814b0a0 0x7fe4c815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.887+0000 7fe4ccf9f640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c80cb550 0x7fe4c80ce2a0 secure :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009ac0 tx=0x7fe4bc004730 comp rx=0 tx=0).stop 2024-09-12T01:36:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.887+0000 7fe4ccf9f640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe4b406be30 0x7fe4b406e2f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.887+0000 7fe4ccf9f640 1 --2- 172.21.15.60:0/1841704469 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4b0004800 0x7fe4c814a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.887+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/1841704469 >> 172.21.15.60:0/1841704469 conn(0x7fe4c8062a20 msgr2=0x7fe4c8062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.887+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/1841704469 shutdown_connections 2024-09-12T01:36:28.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:28.887+0000 7fe4ccf9f640 1 -- 172.21.15.60:0/1841704469 wait complete. 2024-09-12T01:36:28.901 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:36:29.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.018+0000 7ffaa0d9f640 1 Processor -- start 2024-09-12T01:36:29.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.018+0000 7ffaa0d9f640 1 -- start start 2024-09-12T01:36:29.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.019+0000 7ffaa0d9f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffa9c06fe40 0x7ffa9c0cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:29.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.019+0000 7ffaa0d9f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa9c0d0ca0 con 0x7ffa9c15e0e0 2024-09-12T01:36:29.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.019+0000 7ffaa0d9f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa9c0d0f80 con 0x7ffa9c15e4c0 2024-09-12T01:36:29.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.019+0000 7ffaa0d9f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ffa9c0d1260 con 0x7ffa9c06fe40 2024-09-12T01:36:29.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.019+0000 7ffa92ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffa9c06fe40 0x7ffa9c0cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:29.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.019+0000 7ffa9b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ffa9c15e0e0 0x7ffa9c06f730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48944/0 (socket says 172.21.15.60:48944) 2024-09-12T01:36:29.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.019+0000 7ffa9b7fe640 1 -- 172.21.15.60:0/3625574753 learned_addr learned my addr 172.21.15.60:0/3625574753 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:29.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.020+0000 7ffa92ffd640 1 -- 172.21.15.60:0/3625574753 >> v1:172.21.15.105:6789/0 conn(0x7ffa9c15e4c0 legacy=0x7ffa9c06c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:29.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.020+0000 7ffa92ffd640 1 -- 172.21.15.60:0/3625574753 >> v1:172.21.15.60:6789/0 conn(0x7ffa9c15e0e0 legacy=0x7ffa9c06f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:29.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.020+0000 7ffa92ffd640 1 -- 172.21.15.60:0/3625574753 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9c06bcb0 con 0x7ffa9c06fe40 2024-09-12T01:36:29.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.020+0000 7ffa9affd640 1 -- 172.21.15.60:0/3625574753 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507093804 0 0) 0x7ffa9c0d0ca0 con 0x7ffa9c15e0e0 2024-09-12T01:36:29.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.020+0000 7ffa92ffd640 1 --2- 172.21.15.60:0/3625574753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa9c06fe40 0x7ffa9c0cffc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffa840097a0 tx=0x7ffa8402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331d0c44a3ad5107 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:29.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.021+0000 7ffa9affd640 1 -- 172.21.15.60:0/3625574753 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa84037070 con 0x7ffa9c06fe40 2024-09-12T01:36:29.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.021+0000 7ffa9affd640 1 -- 172.21.15.60:0/3625574753 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa84032440 con 0x7ffa9c06fe40 2024-09-12T01:36:29.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.021+0000 7ffa9affd640 1 -- 172.21.15.60:0/3625574753 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa84032810 con 0x7ffa9c06fe40 2024-09-12T01:36:29.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.021+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3625574753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa9c06fe40 msgr2=0x7ffa9c0cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:29.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.021+0000 7ffaa0d9f640 1 --2- 172.21.15.60:0/3625574753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa9c06fe40 0x7ffa9c0cffc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffa840097a0 tx=0x7ffa8402a230 comp rx=0 tx=0).stop 2024-09-12T01:36:29.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.021+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3625574753 shutdown_connections 2024-09-12T01:36:29.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.021+0000 7ffaa0d9f640 1 --2- 172.21.15.60:0/3625574753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa9c06fe40 0x7ffa9c0cffc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:29.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.021+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3625574753 >> 172.21.15.60:0/3625574753 conn(0x7ffa9c06e200 msgr2=0x7ffa9c06e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:29.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.021+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3625574753 shutdown_connections 2024-09-12T01:36:29.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.021+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3625574753 wait complete. 2024-09-12T01:36:29.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.022+0000 7ffaa0d9f640 1 Processor -- start 2024-09-12T01:36:29.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.023+0000 7ffaa0d9f640 1 -- start start 2024-09-12T01:36:29.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.023+0000 7ffaa0d9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa9c06fe40 0x7ffa9c14e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:29.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.023+0000 7ffaa0d9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa9c15e0e0 0x7ffa9c14ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:29.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.023+0000 7ffaa0d9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa9c15e4c0 0x7ffa9c152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:29.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.023+0000 7ffaa0d9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c0d0680 con 0x7ffa9c06fe40 2024-09-12T01:36:29.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.023+0000 7ffaa0d9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9c0d0500 con 0x7ffa9c15e4c0 2024-09-12T01:36:29.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.023+0000 7ffaa0d9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffa9c0d0800 con 0x7ffa9c15e0e0 2024-09-12T01:36:29.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.023+0000 7ffa9b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa9c06fe40 0x7ffa9c14e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:29.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.023+0000 7ffa9b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa9c06fe40 0x7ffa9c14e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54016/0 (socket says 172.21.15.60:54016) 2024-09-12T01:36:29.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.023+0000 7ffa9b7fe640 1 -- 172.21.15.60:0/3970935815 learned_addr learned my addr 172.21.15.60:0/3970935815 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffa92ffd640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa9c15e0e0 0x7ffa9c14ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffa9bfff640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa9c15e4c0 0x7ffa9c152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffa9b7fe640 1 -- 172.21.15.60:0/3970935815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa9c15e0e0 msgr2=0x7ffa9c14ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffa9b7fe640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa9c15e0e0 0x7ffa9c14ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffa9b7fe640 1 -- 172.21.15.60:0/3970935815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa9c15e4c0 msgr2=0x7ffa9c152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffa9b7fe640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa9c15e4c0 0x7ffa9c152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffa9b7fe640 1 -- 172.21.15.60:0/3970935815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa9c14f1b0 con 0x7ffa9c06fe40 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffa9b7fe640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa9c06fe40 0x7ffa9c14e300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c4d0 tx=0x7ffa8c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffa98ff9640 1 -- 172.21.15.60:0/3970935815 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c018070 con 0x7ffa9c06fe40 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffa98ff9640 1 -- 172.21.15.60:0/3970935815 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa8c0074e0 con 0x7ffa9c06fe40 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3970935815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa9c14f450 con 0x7ffa9c06fe40 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffa98ff9640 1 -- 172.21.15.60:0/3970935815 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c004a20 con 0x7ffa9c06fe40 2024-09-12T01:36:29.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.024+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3970935815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa9c14fa10 con 0x7ffa9c06fe40 2024-09-12T01:36:29.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.025+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3970935815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa9c0cffc0 con 0x7ffa9c06fe40 2024-09-12T01:36:29.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.026+0000 7ffa98ff9640 1 -- 172.21.15.60:0/3970935815 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa8c004bc0 con 0x7ffa9c06fe40 2024-09-12T01:36:29.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.026+0000 7ffa98ff9640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa7c06be30 0x7ffa7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:29.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.026+0000 7ffa98ff9640 1 -- 172.21.15.60:0/3970935815 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5357+0+0 (secure 0 0 0) 0x7ffa8c089fa0 con 0x7ffa9c06fe40 2024-09-12T01:36:29.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.026+0000 7ffa92ffd640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa7c06be30 0x7ffa7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:29.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.027+0000 7ffa92ffd640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa7c06be30 0x7ffa7c06e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa84034000 tx=0x7ffa8402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:29.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.031+0000 7ffa98ff9640 1 -- 172.21.15.60:0/3970935815 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa8c058470 con 0x7ffa9c06fe40 2024-09-12T01:36:29.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.205+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3970935815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ffa9c0b70a0 con 0x7ffa9c06fe40 2024-09-12T01:36:29.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.888+0000 7ffa98ff9640 1 -- 172.21.15.60:0/3970935815 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7ffa8c05c770 con 0x7ffa9c06fe40 2024-09-12T01:36:29.888 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-12T01:36:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.892+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3970935815 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa7c06be30 msgr2=0x7ffa7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:29.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.892+0000 7ffaa0d9f640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa7c06be30 0x7ffa7c06e2f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa84034000 tx=0x7ffa8402e000 comp rx=0 tx=0).stop 2024-09-12T01:36:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.892+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3970935815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa9c06fe40 msgr2=0x7ffa9c14e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.892+0000 7ffaa0d9f640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa9c06fe40 0x7ffa9c14e300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c4d0 tx=0x7ffa8c00c990 comp rx=0 tx=0).stop 2024-09-12T01:36:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.892+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3970935815 shutdown_connections 2024-09-12T01:36:29.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.892+0000 7ffaa0d9f640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa9c15e4c0 0x7ffa9c152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.892+0000 7ffaa0d9f640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa7c06be30 0x7ffa7c06e2f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.892+0000 7ffaa0d9f640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa9c15e0e0 0x7ffa9c14ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.892+0000 7ffaa0d9f640 1 --2- 172.21.15.60:0/3970935815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa9c06fe40 0x7ffa9c14e300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.892+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3970935815 >> 172.21.15.60:0/3970935815 conn(0x7ffa9c06e200 msgr2=0x7ffa9c15d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.893+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3970935815 shutdown_connections 2024-09-12T01:36:29.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:29.893+0000 7ffaa0d9f640 1 -- 172.21.15.60:0/3970935815 wait complete. 2024-09-12T01:36:29.910 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:36:29.910 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:36:29.911 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:36:29.911 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:36:29.911 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:36:29.911 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:36:29.911 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:36:29.911 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:36:29.912 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:36:29.912 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:36:29.912 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:36:29.912 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:36:29.912 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:36:29.912 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:36:29.913 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:36:29.913 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:36:29.924 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:36:29.924 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:36:29.925 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:36:29.925 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:36:29.927 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:36:29.927 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:36:29.928 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:36:29.928 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:36:29.967 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:36:29.967 DEBUG:teuthology.parallel:result is None 2024-09-12T01:36:29.968 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:36:29.968 DEBUG:teuthology.parallel:result is None 2024-09-12T01:36:29.970 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:36:29.970 DEBUG:teuthology.parallel:result is None 2024-09-12T01:36:29.971 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:36:29.971 DEBUG:teuthology.parallel:result is None 2024-09-12T01:36:29.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:36:30.048 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:36:30.049 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:36:30.053 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2024-09-12T01:36:30.054 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2024-09-12T01:36:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.083+0000 7f56a3c27640 1 Processor -- start 2024-09-12T01:36:30.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.083+0000 7f56a3c27640 1 -- start start 2024-09-12T01:36:30.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a3c27640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f569c0cf1f0 0x7f569c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a3c27640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f569c0b6720 0x7f569c0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a3c27640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f569c0cf860 con 0x7f569c15e7a0 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a3c27640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f569c0b6b90 con 0x7f569c0cf1f0 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a3c27640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f569c0d2ca0 con 0x7f569c0b6720 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a11c2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f569c0cf1f0 0x7f569c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a19c3640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f569c15e7a0 0x7f569c06caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48972/0 (socket says 172.21.15.60:48972) 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a19c3640 1 -- 172.21.15.60:0/1381633146 learned_addr learned my addr 172.21.15.60:0/1381633146 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a21c4640 1 --2- 172.21.15.60:0/1381633146 >> v2:172.21.15.105:3300/0 conn(0x7f569c0b6720 0x7f569c0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a11c2640 1 -- 172.21.15.60:0/1381633146 >> v2:172.21.15.105:3300/0 conn(0x7f569c0b6720 msgr2=0x7f569c0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a11c2640 1 --2- 172.21.15.60:0/1381633146 >> v2:172.21.15.105:3300/0 conn(0x7f569c0b6720 0x7f569c0d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a11c2640 1 -- 172.21.15.60:0/1381633146 >> v1:172.21.15.60:6789/0 conn(0x7f569c15e7a0 legacy=0x7f569c06caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a09c1640 1 -- 172.21.15.60:0/1381633146 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498909672 0 0) 0x7f569c0cf860 con 0x7f569c15e7a0 2024-09-12T01:36:30.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.084+0000 7f56a11c2640 1 -- 172.21.15.60:0/1381633146 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569c0cfb40 con 0x7f569c0cf1f0 2024-09-12T01:36:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.085+0000 7f56a11c2640 1 --2- 172.21.15.60:0/1381633146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f569c0cf1f0 0x7f569c0b61e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f569c08d930 tx=0x7f569002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ef9a619b452fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.085+0000 7f56a09c1640 1 -- 172.21.15.60:0/1381633146 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5690037070 con 0x7f569c0cf1f0 2024-09-12T01:36:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.085+0000 7f56a09c1640 1 -- 172.21.15.60:0/1381633146 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5690032440 con 0x7f569c0cf1f0 2024-09-12T01:36:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.085+0000 7f56a09c1640 1 -- 172.21.15.60:0/1381633146 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f569002ae60 con 0x7f569c0cf1f0 2024-09-12T01:36:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.086+0000 7f56a3c27640 1 -- 172.21.15.60:0/1381633146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f569c0cf1f0 msgr2=0x7f569c0b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.086+0000 7f56a3c27640 1 --2- 172.21.15.60:0/1381633146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f569c0cf1f0 0x7f569c0b61e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f569c08d930 tx=0x7f569002a110 comp rx=0 tx=0).stop 2024-09-12T01:36:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.086+0000 7f56a3c27640 1 -- 172.21.15.60:0/1381633146 shutdown_connections 2024-09-12T01:36:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.086+0000 7f56a3c27640 1 --2- 172.21.15.60:0/1381633146 >> v2:172.21.15.105:3300/0 conn(0x7f569c0b6720 0x7f569c0d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.086+0000 7f56a3c27640 1 --2- 172.21.15.60:0/1381633146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f569c0cf1f0 0x7f569c0b61e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.086+0000 7f56a3c27640 1 -- 172.21.15.60:0/1381633146 >> 172.21.15.60:0/1381633146 conn(0x7f569c0d11e0 msgr2=0x7f569c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.086+0000 7f56a3c27640 1 -- 172.21.15.60:0/1381633146 shutdown_connections 2024-09-12T01:36:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.086+0000 7f56a3c27640 1 -- 172.21.15.60:0/1381633146 wait complete. 2024-09-12T01:36:30.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.087+0000 7f56a3c27640 1 Processor -- start 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.087+0000 7f56a3c27640 1 -- start start 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.088+0000 7f56a3c27640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f569c0b6720 0x7f569c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.088+0000 7f56a3c27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f569c15e7a0 0x7f569c14df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.088+0000 7f56a3c27640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f569c0b96d0 0x7f569c14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.088+0000 7f56a3c27640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f569c0b7a00 con 0x7f569c0b96d0 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.088+0000 7f56a3c27640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f569c0d2ef0 con 0x7f569c15e7a0 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.088+0000 7f56a3c27640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f569c15eb80 con 0x7f569c0b6720 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.088+0000 7f56a19c3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f569c0b6720 0x7f569c1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.088+0000 7f56a19c3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f569c0b6720 0x7f569c1514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:41758/0 (socket says 172.21.15.60:41758) 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.088+0000 7f56a11c2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f569c15e7a0 0x7f569c14df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.088+0000 7f56a19c3640 1 -- 172.21.15.60:0/953823010 learned_addr learned my addr 172.21.15.60:0/953823010 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.088+0000 7f56a21c4640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f569c0b96d0 0x7f569c14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:30.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.089+0000 7f56a19c3640 1 -- 172.21.15.60:0/953823010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f569c15e7a0 msgr2=0x7f569c14df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:30.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.089+0000 7f56a19c3640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f569c15e7a0 0x7f569c14df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:30.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.089+0000 7f56a19c3640 1 -- 172.21.15.60:0/953823010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f569c0b96d0 msgr2=0x7f569c14fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:30.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.089+0000 7f56a19c3640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f569c0b96d0 0x7f569c14fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:30.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.089+0000 7f56a19c3640 1 -- 172.21.15.60:0/953823010 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569c150420 con 0x7f569c0b6720 2024-09-12T01:36:30.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.089+0000 7f56a19c3640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f569c0b6720 0x7f569c1514c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f569800c4a0 tx=0x7f569800c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:30.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.089+0000 7f568e7fc640 1 -- 172.21.15.60:0/953823010 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5698018070 con 0x7f569c0b6720 2024-09-12T01:36:30.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.089+0000 7f568e7fc640 1 -- 172.21.15.60:0/953823010 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56980074e0 con 0x7f569c0b6720 2024-09-12T01:36:30.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.089+0000 7f56a3c27640 1 -- 172.21.15.60:0/953823010 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569c150700 con 0x7f569c0b6720 2024-09-12T01:36:30.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.089+0000 7f568e7fc640 1 -- 172.21.15.60:0/953823010 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5698004a20 con 0x7f569c0b6720 2024-09-12T01:36:30.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.089+0000 7f56a3c27640 1 -- 172.21.15.60:0/953823010 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f569c150cc0 con 0x7f569c0b6720 2024-09-12T01:36:30.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.090+0000 7f56a3c27640 1 -- 172.21.15.60:0/953823010 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f569c0b61e0 con 0x7f569c0b6720 2024-09-12T01:36:30.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.091+0000 7f568e7fc640 1 -- 172.21.15.60:0/953823010 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f569801b070 con 0x7f569c0b6720 2024-09-12T01:36:30.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.091+0000 7f568e7fc640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f568006be60 0x7f568006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:30.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.091+0000 7f568e7fc640 1 -- 172.21.15.60:0/953823010 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7f5698089d30 con 0x7f569c0b6720 2024-09-12T01:36:30.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.091+0000 7f56a11c2640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f568006be60 0x7f568006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:30.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.092+0000 7f56a11c2640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f568006be60 0x7f568006e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5690034000 tx=0x7f569002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:30.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.096+0000 7f568e7fc640 1 -- 172.21.15.60:0/953823010 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5698058400 con 0x7f569c0b6720 2024-09-12T01:36:30.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.284+0000 7f56a3c27640 1 -- 172.21.15.60:0/953823010 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f569c15c400 con 0x7f569c0b6720 2024-09-12T01:36:30.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.903+0000 7f568e7fc640 1 -- 172.21.15.60:0/953823010 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7f569805c700 con 0x7f569c0b6720 2024-09-12T01:36:30.903 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2024-09-12T01:36:30.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.907+0000 7f56a3c27640 1 -- 172.21.15.60:0/953823010 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f568006be60 msgr2=0x7f568006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:30.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.907+0000 7f56a3c27640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f568006be60 0x7f568006e320 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5690034000 tx=0x7f569002e000 comp rx=0 tx=0).stop 2024-09-12T01:36:30.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.907+0000 7f56a3c27640 1 -- 172.21.15.60:0/953823010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f569c0b6720 msgr2=0x7f569c1514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:30.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.907+0000 7f56a3c27640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f569c0b6720 0x7f569c1514c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f569800c4a0 tx=0x7f569800c960 comp rx=0 tx=0).stop 2024-09-12T01:36:30.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.907+0000 7f56a3c27640 1 -- 172.21.15.60:0/953823010 shutdown_connections 2024-09-12T01:36:30.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.907+0000 7f56a3c27640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f569c0b96d0 0x7f569c14fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:30.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.907+0000 7f56a3c27640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f569c15e7a0 0x7f569c14df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:30.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.907+0000 7f56a3c27640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f568006be60 0x7f568006e320 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:30.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.907+0000 7f56a3c27640 1 --2- 172.21.15.60:0/953823010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f569c0b6720 0x7f569c1514c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:30.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.907+0000 7f56a3c27640 1 -- 172.21.15.60:0/953823010 >> 172.21.15.60:0/953823010 conn(0x7f569c0d11e0 msgr2=0x7f569c157490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:30.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.907+0000 7f56a3c27640 1 -- 172.21.15.60:0/953823010 shutdown_connections 2024-09-12T01:36:30.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:30.907+0000 7f56a3c27640 1 -- 172.21.15.60:0/953823010 wait complete. 2024-09-12T01:36:30.921 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:36:31.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.030+0000 7f64df549640 1 Processor -- start 2024-09-12T01:36:31.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.030+0000 7f64df549640 1 -- start start 2024-09-12T01:36:31.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.031+0000 7f64df549640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64d815e800 0x7f64d80b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.031+0000 7f64df549640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64d806ea60 con 0x7f64d80b7560 2024-09-12T01:36:31.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.031+0000 7f64df549640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64d806cde0 con 0x7f64d815ebe0 2024-09-12T01:36:31.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.031+0000 7f64df549640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f64d806ed40 con 0x7f64d815e800 2024-09-12T01:36:31.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.031+0000 7f64dd2e5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64d815e800 0x7f64d80b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.031+0000 7f64ddae6640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f64d80b7560 0x7f64d806d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48974/0 (socket says 172.21.15.60:48974) 2024-09-12T01:36:31.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.032+0000 7f64ddae6640 1 -- 172.21.15.60:0/2058031325 learned_addr learned my addr 172.21.15.60:0/2058031325 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:31.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.032+0000 7f64dd2e5640 1 -- 172.21.15.60:0/2058031325 >> v1:172.21.15.105:6789/0 conn(0x7f64d815ebe0 legacy=0x7f64d80b6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:31.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.032+0000 7f64dd2e5640 1 -- 172.21.15.60:0/2058031325 >> v1:172.21.15.60:6789/0 conn(0x7f64d80b7560 legacy=0x7f64d806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.032+0000 7f64dd2e5640 1 -- 172.21.15.60:0/2058031325 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d806d0c0 con 0x7f64d815e800 2024-09-12T01:36:31.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.032+0000 7f64cffff640 1 -- 172.21.15.60:0/2058031325 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2672222549 0 0) 0x7f64d806ea60 con 0x7f64d80b7560 2024-09-12T01:36:31.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.033+0000 7f64dd2e5640 1 --2- 172.21.15.60:0/2058031325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d815e800 0x7f64d80b5460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f64d40097a0 tx=0x7f64d402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82283ba7b62a45f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:31.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.033+0000 7f64cffff640 1 -- 172.21.15.60:0/2058031325 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4037070 con 0x7f64d815e800 2024-09-12T01:36:31.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.033+0000 7f64cffff640 1 -- 172.21.15.60:0/2058031325 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d4032440 con 0x7f64d815e800 2024-09-12T01:36:31.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.033+0000 7f64cffff640 1 -- 172.21.15.60:0/2058031325 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4032810 con 0x7f64d815e800 2024-09-12T01:36:31.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.033+0000 7f64df549640 1 -- 172.21.15.60:0/2058031325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d815e800 msgr2=0x7f64d80b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.033+0000 7f64df549640 1 --2- 172.21.15.60:0/2058031325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d815e800 0x7f64d80b5460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f64d40097a0 tx=0x7f64d402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.033+0000 7f64df549640 1 -- 172.21.15.60:0/2058031325 shutdown_connections 2024-09-12T01:36:31.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.033+0000 7f64df549640 1 --2- 172.21.15.60:0/2058031325 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d815e800 0x7f64d80b5460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.033+0000 7f64df549640 1 -- 172.21.15.60:0/2058031325 >> 172.21.15.60:0/2058031325 conn(0x7f64d80d24d0 msgr2=0x7f64d80d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:31.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.033+0000 7f64df549640 1 -- 172.21.15.60:0/2058031325 shutdown_connections 2024-09-12T01:36:31.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.033+0000 7f64df549640 1 -- 172.21.15.60:0/2058031325 wait complete. 2024-09-12T01:36:31.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.035+0000 7f64df549640 1 Processor -- start 2024-09-12T01:36:31.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.035+0000 7f64df549640 1 -- start start 2024-09-12T01:36:31.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.035+0000 7f64df549640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d80b7560 0x7f64d81f4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.035+0000 7f64df549640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64d815e800 0x7f64d815b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.035+0000 7f64df549640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64d815ebe0 0x7f64d80ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.035+0000 7f64df549640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f64d806e680 con 0x7f64d80b7560 2024-09-12T01:36:31.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.035+0000 7f64df549640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f64d80d31e0 con 0x7f64d815e800 2024-09-12T01:36:31.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.035+0000 7f64df549640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f64d806e800 con 0x7f64d815ebe0 2024-09-12T01:36:31.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64dd2e5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d80b7560 0x7f64d81f4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64dd2e5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d80b7560 0x7f64d81f4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54068/0 (socket says 172.21.15.60:54068) 2024-09-12T01:36:31.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64dd2e5640 1 -- 172.21.15.60:0/4038266142 learned_addr learned my addr 172.21.15.60:0/4038266142 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:31.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64ddae6640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64d815ebe0 0x7f64d80ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64dcae4640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64d815e800 0x7f64d815b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64dd2e5640 1 -- 172.21.15.60:0/4038266142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64d815ebe0 msgr2=0x7f64d80ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64dd2e5640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64d815ebe0 0x7f64d80ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64dd2e5640 1 -- 172.21.15.60:0/4038266142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64d815e800 msgr2=0x7f64d815b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64dd2e5640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64d815e800 0x7f64d815b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64dd2e5640 1 -- 172.21.15.60:0/4038266142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d815a7f0 con 0x7f64d80b7560 2024-09-12T01:36:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64dd2e5640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d80b7560 0x7f64d81f4d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64d40097a0 tx=0x7f64d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64cdffb640 1 -- 172.21.15.60:0/4038266142 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4041070 con 0x7f64d80b7560 2024-09-12T01:36:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64cdffb640 1 -- 172.21.15.60:0/4038266142 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64d403c870 con 0x7f64d80b7560 2024-09-12T01:36:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64df549640 1 -- 172.21.15.60:0/4038266142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64d80cc740 con 0x7f64d80b7560 2024-09-12T01:36:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.036+0000 7f64cdffb640 1 -- 172.21.15.60:0/4038266142 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64d4037040 con 0x7f64d80b7560 2024-09-12T01:36:31.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.037+0000 7f64df549640 1 -- 172.21.15.60:0/4038266142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64d815b7f0 con 0x7f64d80b7560 2024-09-12T01:36:31.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.037+0000 7f64df549640 1 -- 172.21.15.60:0/4038266142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64d80b5460 con 0x7f64d80b7560 2024-09-12T01:36:31.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.038+0000 7f64cdffb640 1 -- 172.21.15.60:0/4038266142 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f64d4044070 con 0x7f64d80b7560 2024-09-12T01:36:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.038+0000 7f64cdffb640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f64bc06be30 0x7f64bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.038+0000 7f64cdffb640 1 -- 172.21.15.60:0/4038266142 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f64d40ab970 con 0x7f64d80b7560 2024-09-12T01:36:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.039+0000 7f64dcae4640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f64bc06be30 0x7f64bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.039+0000 7f64dcae4640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f64bc06be30 0x7f64bc06e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f64c8006fd0 tx=0x7f64c8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.043+0000 7f64cdffb640 1 -- 172.21.15.60:0/4038266142 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f64d407a6f0 con 0x7f64d80b7560 2024-09-12T01:36:31.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.284+0000 7f64df549640 1 -- 172.21.15.60:0/4038266142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f64d80cca20 con 0x7f64d80b7560 2024-09-12T01:36:31.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.284+0000 7f64cdffb640 1 -- 172.21.15.60:0/4038266142 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) ==== 80+0+6645 (secure 0 0 0) 0x7f64d4079ff0 con 0x7f64d80b7560 2024-09-12T01:36:31.284 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:31.284 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:36:31.284 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2024-09-12T01:36:31.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.284 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2024-09-12T01:36:31.284 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmIK3fKxAAM9RkghDZwJZWuKouIbObDw==", 2024-09-12T01:36:31.284 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.284 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmzqHZNxAAnhCo4gGwLgYDVzzYnoiDFA==", 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:36:31.285 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmksMWMxAAp3xMDD09rfphgPZwQcEABA==", 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmvLw/AxAApd4hl5LRD1QddnPPjRw2Kg==", 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA7ReJmc3D/JxAAXiw6n1Q3n9sCXln6YSiCBA==", 2024-09-12T01:36:31.287 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA/ReJmEOu3CxAA4uu1neLh0mpeG9nia+/VqQ==", 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBCReJm3HHtDhAAoAdKVsjuXmpcf5R5zTtFKg==", 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBFReJmtRLuIBAA/BBibpGfpXsFXqVjVrmXWA==", 2024-09-12T01:36:31.289 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBMReJmdDNXKhAAeh5aCvMw+70z3tnwjb9Hjg==", 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBQReJm/tsIHRAAmgx+5WifY/VITGHAbUV2CQ==", 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBUReJmQFaBHhAA1vH01tePCoJQFXlHB5gcVg==", 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.291 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBYReJmTHqLAhAAtUB94Pa3eihlVdaupZ8Ggg==", 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ==", 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmTopGEBAAY0K3iZm2PotQc8a489uO/Q==", 2024-09-12T01:36:31.293 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmqUgQDRAAAp5SAwNM9aSxZ1VVRwroNA==", 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:36:31.294 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmGfzeFRAAE2xCnzeyX/KBo3NBrkixYQ==", 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2024-09-12T01:36:31.295 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmOfXYDxAA0hydSyRvFmmNvFcRwPaXqg==", 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-mds", 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBjReJmlomLOBAAe3LcjD4y6mk/OpT1d/+Vxg==", 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-mds" 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-mgr", 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBjReJmw5KLOBAALvAOC5zGLGLnUMT9nS8sPQ==", 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-osd", 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBjReJmqpqLOBAAMfhWs5P1I670xWZau/ZzIg==", 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-osd" 2024-09-12T01:36:31.297 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rbd", 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBjReJmLKKLOBAA1g5WrrokCl5PeWxtAf0JWA==", 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBjReJmsKmLOBAAYLO0HY3eCT4yuK0UKc46Hw==", 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-12T01:36:31.298 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rgw", 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBjReJmZ7GLOBAAyJdnL1SMtCL1AstM/v8u0w==", 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmjpyMKBAAMSGgYJddHs7TtCV0NszZAQ==", 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:36:31.299 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJm3Ei+JBAAhwgXWq0baTlDtaLedcaHmg==", 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T01:36:31.300 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:36:31.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.286+0000 7f64df549640 1 -- 172.21.15.60:0/4038266142 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f64bc06be30 msgr2=0x7f64bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.286+0000 7f64df549640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f64bc06be30 0x7f64bc06e2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f64c8006fd0 tx=0x7f64c8008040 comp rx=0 tx=0).stop 2024-09-12T01:36:31.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.286+0000 7f64df549640 1 -- 172.21.15.60:0/4038266142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d80b7560 msgr2=0x7f64d81f4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.286+0000 7f64df549640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d80b7560 0x7f64d81f4d10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f64d40097a0 tx=0x7f64d40046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.286+0000 7f64df549640 1 -- 172.21.15.60:0/4038266142 shutdown_connections 2024-09-12T01:36:31.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.286+0000 7f64df549640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f64bc06be30 0x7f64bc06e2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.286+0000 7f64df549640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f64d815ebe0 0x7f64d80ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.286+0000 7f64df549640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f64d815e800 0x7f64d815b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.286+0000 7f64df549640 1 --2- 172.21.15.60:0/4038266142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64d80b7560 0x7f64d81f4d10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.286+0000 7f64df549640 1 -- 172.21.15.60:0/4038266142 >> 172.21.15.60:0/4038266142 conn(0x7f64d80d24d0 msgr2=0x7f64d80b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:31.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.286+0000 7f64df549640 1 -- 172.21.15.60:0/4038266142 shutdown_connections 2024-09-12T01:36:31.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.287+0000 7f64df549640 1 -- 172.21.15.60:0/4038266142 wait complete. 2024-09-12T01:36:31.303 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-12T01:36:31.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.406+0000 7f57927df640 1 Processor -- start 2024-09-12T01:36:31.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.406+0000 7f57927df640 1 -- start start 2024-09-12T01:36:31.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.407+0000 7f57927df640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f578c15e7a0 0x7f578c06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.407+0000 7f57927df640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c0cf1f0 0x7f578c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.407+0000 7f57927df640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f578c0b6720 0x7f578c1623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.407+0000 7f57927df640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f578c0d2ca0 con 0x7f578c0b6720 2024-09-12T01:36:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.407+0000 7f57927df640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f578c0cf860 con 0x7f578c15e7a0 2024-09-12T01:36:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.407+0000 7f57927df640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f578c0cfb40 con 0x7f578c0cf1f0 2024-09-12T01:36:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.408+0000 7f5790d7c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f578c0b6720 0x7f578c1623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.408+0000 7f5790d7c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f578c0b6720 0x7f578c1623c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54082/0 (socket says 172.21.15.60:54082) 2024-09-12T01:36:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.408+0000 7f5790d7c640 1 -- 172.21.15.60:0/436920374 learned_addr learned my addr 172.21.15.60:0/436920374 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.408+0000 7f578b7fe640 1 --2- 172.21.15.60:0/436920374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c0cf1f0 0x7f578c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.408+0000 7f578bfff640 1 --2- 172.21.15.60:0/436920374 >> v2:172.21.15.105:3300/0 conn(0x7f578c15e7a0 0x7f578c06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.408+0000 7f5790d7c640 1 -- 172.21.15.60:0/436920374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c0cf1f0 msgr2=0x7f578c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.408+0000 7f5790d7c640 1 --2- 172.21.15.60:0/436920374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c0cf1f0 0x7f578c0b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.408+0000 7f5790d7c640 1 -- 172.21.15.60:0/436920374 >> v2:172.21.15.105:3300/0 conn(0x7f578c15e7a0 msgr2=0x7f578c06caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.408+0000 7f5790d7c640 1 --2- 172.21.15.60:0/436920374 >> v2:172.21.15.105:3300/0 conn(0x7f578c15e7a0 0x7f578c06caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.408+0000 7f5790d7c640 1 -- 172.21.15.60:0/436920374 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578c0cfe20 con 0x7f578c0b6720 2024-09-12T01:36:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f5790d7c640 1 --2- 172.21.15.60:0/436920374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c0b6720 0x7f578c1623c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f578c0d5820 tx=0x7f578402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e550bfa89b6e5d90 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f578affd640 1 -- 172.21.15.60:0/436920374 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784036070 con 0x7f578c0b6720 2024-09-12T01:36:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f578affd640 1 -- 172.21.15.60:0/436920374 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5784031600 con 0x7f578c0b6720 2024-09-12T01:36:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f578affd640 1 -- 172.21.15.60:0/436920374 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57840319d0 con 0x7f578c0b6720 2024-09-12T01:36:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f57927df640 1 -- 172.21.15.60:0/436920374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c0b6720 msgr2=0x7f578c1623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f57927df640 1 --2- 172.21.15.60:0/436920374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c0b6720 0x7f578c1623c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f578c0d5820 tx=0x7f578402a610 comp rx=0 tx=0).stop 2024-09-12T01:36:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f57927df640 1 -- 172.21.15.60:0/436920374 shutdown_connections 2024-09-12T01:36:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f57927df640 1 --2- 172.21.15.60:0/436920374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c0b6720 0x7f578c1623c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f57927df640 1 --2- 172.21.15.60:0/436920374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c0cf1f0 0x7f578c0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f57927df640 1 --2- 172.21.15.60:0/436920374 >> v2:172.21.15.105:3300/0 conn(0x7f578c15e7a0 0x7f578c06caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f57927df640 1 -- 172.21.15.60:0/436920374 >> 172.21.15.60:0/436920374 conn(0x7f578c0d11e0 msgr2=0x7f578c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:31.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f57927df640 1 -- 172.21.15.60:0/436920374 shutdown_connections 2024-09-12T01:36:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.409+0000 7f57927df640 1 -- 172.21.15.60:0/436920374 wait complete. 2024-09-12T01:36:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.410+0000 7f57927df640 1 Processor -- start 2024-09-12T01:36:31.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.411+0000 7f57927df640 1 -- start start 2024-09-12T01:36:31.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.411+0000 7f57927df640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0b6720 0x7f578c0c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.411+0000 7f57927df640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c0cf1f0 0x7f578c152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.411+0000 7f57927df640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15e7a0 0x7f578c1e8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.411+0000 7f57927df640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f578c06cfe0 con 0x7f578c15e7a0 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.411+0000 7f57927df640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f578c0b7a00 con 0x7f578c0b6720 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.411+0000 7f57927df640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f578c15eb80 con 0x7f578c0cf1f0 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f5790d7c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15e7a0 0x7f578c1e8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f5790d7c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15e7a0 0x7f578c1e8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54092/0 (socket says 172.21.15.60:54092) 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f5790d7c640 1 -- 172.21.15.60:0/3084242830 learned_addr learned my addr 172.21.15.60:0/3084242830 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f578b7fe640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c0cf1f0 0x7f578c152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f578bfff640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0b6720 0x7f578c0c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f5790d7c640 1 -- 172.21.15.60:0/3084242830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c0cf1f0 msgr2=0x7f578c152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f5790d7c640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c0cf1f0 0x7f578c152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f5790d7c640 1 -- 172.21.15.60:0/3084242830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0b6720 msgr2=0x7f578c0c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f5790d7c640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0b6720 0x7f578c0c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f5790d7c640 1 -- 172.21.15.60:0/3084242830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578c1e90f0 con 0x7f578c15e7a0 2024-09-12T01:36:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f5790d7c640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15e7a0 0x7f578c1e8bb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5784034040 tx=0x7f5784004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f5788ff9640 1 -- 172.21.15.60:0/3084242830 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784041020 con 0x7f578c15e7a0 2024-09-12T01:36:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f5788ff9640 1 -- 172.21.15.60:0/3084242830 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57840077a0 con 0x7f578c15e7a0 2024-09-12T01:36:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f57927df640 1 -- 172.21.15.60:0/3084242830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578c0c89b0 con 0x7f578c15e7a0 2024-09-12T01:36:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f5788ff9640 1 -- 172.21.15.60:0/3084242830 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784036040 con 0x7f578c15e7a0 2024-09-12T01:36:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.412+0000 7f57927df640 1 -- 172.21.15.60:0/3084242830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578c0c8f70 con 0x7f578c15e7a0 2024-09-12T01:36:31.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.413+0000 7f57927df640 1 -- 172.21.15.60:0/3084242830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578c0b61e0 con 0x7f578c15e7a0 2024-09-12T01:36:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.414+0000 7f5788ff9640 1 -- 172.21.15.60:0/3084242830 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5784044020 con 0x7f578c15e7a0 2024-09-12T01:36:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.414+0000 7f5788ff9640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f577806be30 0x7f577806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.414+0000 7f5788ff9640 1 -- 172.21.15.60:0/3084242830 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f57840ab610 con 0x7f578c15e7a0 2024-09-12T01:36:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.414+0000 7f578bfff640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f577806be30 0x7f577806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.415+0000 7f578bfff640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f577806be30 0x7f577806e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f577c009a10 tx=0x7f577c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:31.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.418+0000 7f5788ff9640 1 -- 172.21.15.60:0/3084242830 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f578404b030 con 0x7f578c15e7a0 2024-09-12T01:36:31.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.665+0000 7f57927df640 1 -- 172.21.15.60:0/3084242830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f578c0d2a80 con 0x7f578c15e7a0 2024-09-12T01:36:31.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.668+0000 7f5788ff9640 1 -- 172.21.15.60:0/3084242830 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f578407a3a0 con 0x7f578c15e7a0 2024-09-12T01:36:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.670+0000 7f57927df640 1 -- 172.21.15.60:0/3084242830 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f577806be30 msgr2=0x7f577806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.670+0000 7f57927df640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f577806be30 0x7f577806e2f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f577c009a10 tx=0x7f577c008040 comp rx=0 tx=0).stop 2024-09-12T01:36:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.670+0000 7f57927df640 1 -- 172.21.15.60:0/3084242830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15e7a0 msgr2=0x7f578c1e8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.670+0000 7f57927df640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15e7a0 0x7f578c1e8bb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5784034040 tx=0x7f5784004a40 comp rx=0 tx=0).stop 2024-09-12T01:36:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.670+0000 7f57927df640 1 -- 172.21.15.60:0/3084242830 shutdown_connections 2024-09-12T01:36:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.670+0000 7f57927df640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15e7a0 0x7f578c1e8bb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.670+0000 7f57927df640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f577806be30 0x7f577806e2f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.670+0000 7f57927df640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c0cf1f0 0x7f578c152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.670+0000 7f57927df640 1 --2- 172.21.15.60:0/3084242830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0b6720 0x7f578c0c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.670+0000 7f57927df640 1 -- 172.21.15.60:0/3084242830 >> 172.21.15.60:0/3084242830 conn(0x7f578c0d11e0 msgr2=0x7f578c0d15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.671+0000 7f57927df640 1 -- 172.21.15.60:0/3084242830 shutdown_connections 2024-09-12T01:36:31.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.671+0000 7f57927df640 1 -- 172.21.15.60:0/3084242830 wait complete. 2024-09-12T01:36:31.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-12T01:36:31.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.785+0000 7f795f8d9640 1 Processor -- start 2024-09-12T01:36:31.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.785+0000 7f795f8d9640 1 -- start start 2024-09-12T01:36:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.786+0000 7f795f8d9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f795815e7a0 0x7f795806caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.786+0000 7f795f8d9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f79580b68f0 0x7f79580d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.786+0000 7f795f8d9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79580cf860 con 0x7f79580cf1f0 2024-09-12T01:36:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.786+0000 7f795f8d9640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f79580d2ca0 con 0x7f795815e7a0 2024-09-12T01:36:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.786+0000 7f795f8d9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f79580cfb40 con 0x7f79580b68f0 2024-09-12T01:36:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.786+0000 7f795d675640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f795815e7a0 0x7f795806caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.786+0000 7f795d675640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f795815e7a0 0x7f795806caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54098/0 (socket says 172.21.15.60:54098) 2024-09-12T01:36:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.786+0000 7f795d675640 1 -- 172.21.15.60:0/3361393522 learned_addr learned my addr 172.21.15.60:0/3361393522 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.787+0000 7f795d675640 1 -- 172.21.15.60:0/3361393522 >> v2:172.21.15.105:3300/0 conn(0x7f79580b68f0 msgr2=0x7f79580d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.787+0000 7f795de76640 1 --2- 172.21.15.60:0/3361393522 >> v2:172.21.15.105:3300/0 conn(0x7f79580b68f0 0x7f79580d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.787+0000 7f795d675640 1 --2- 172.21.15.60:0/3361393522 >> v2:172.21.15.105:3300/0 conn(0x7f79580b68f0 0x7f79580d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.787+0000 7f795d675640 1 -- 172.21.15.60:0/3361393522 >> v1:172.21.15.105:6789/0 conn(0x7f79580cf1f0 legacy=0x7f79580b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.787+0000 7f795d675640 1 -- 172.21.15.60:0/3361393522 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79580cfe20 con 0x7f795815e7a0 2024-09-12T01:36:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.787+0000 7f795de76640 1 --2- 172.21.15.60:0/3361393522 >> v2:172.21.15.105:3300/0 conn(0x7f79580b68f0 0x7f79580d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.787+0000 7f795d675640 1 --2- 172.21.15.60:0/3361393522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f795815e7a0 0x7f795806caa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f795808d930 tx=0x7f795002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3970bbaccaa0853a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.788+0000 7f7957fff640 1 -- 172.21.15.60:0/3361393522 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7950037070 con 0x7f795815e7a0 2024-09-12T01:36:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.788+0000 7f7957fff640 1 -- 172.21.15.60:0/3361393522 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7950032440 con 0x7f795815e7a0 2024-09-12T01:36:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.788+0000 7f7957fff640 1 -- 172.21.15.60:0/3361393522 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7950032810 con 0x7f795815e7a0 2024-09-12T01:36:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.788+0000 7f795f8d9640 1 -- 172.21.15.60:0/3361393522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f795815e7a0 msgr2=0x7f795806caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.788+0000 7f795f8d9640 1 --2- 172.21.15.60:0/3361393522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f795815e7a0 0x7f795806caa0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f795808d930 tx=0x7f795002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.788+0000 7f795f8d9640 1 -- 172.21.15.60:0/3361393522 shutdown_connections 2024-09-12T01:36:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.788+0000 7f795f8d9640 1 --2- 172.21.15.60:0/3361393522 >> v2:172.21.15.105:3300/0 conn(0x7f79580b68f0 0x7f79580d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.788+0000 7f795f8d9640 1 --2- 172.21.15.60:0/3361393522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f795815e7a0 0x7f795806caa0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.788+0000 7f795f8d9640 1 -- 172.21.15.60:0/3361393522 >> 172.21.15.60:0/3361393522 conn(0x7f79580d11e0 msgr2=0x7f79580d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.788+0000 7f795f8d9640 1 -- 172.21.15.60:0/3361393522 shutdown_connections 2024-09-12T01:36:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.788+0000 7f795f8d9640 1 -- 172.21.15.60:0/3361393522 wait complete. 2024-09-12T01:36:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.790+0000 7f795f8d9640 1 Processor -- start 2024-09-12T01:36:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.790+0000 7f795f8d9640 1 -- start start 2024-09-12T01:36:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.790+0000 7f795f8d9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79580b68f0 0x7f79580c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.790+0000 7f795f8d9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79580cf1f0 0x7f79580caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.790+0000 7f795f8d9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f795815e7a0 0x7f79580b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.790+0000 7f795f8d9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f795806cfe0 con 0x7f79580b68f0 2024-09-12T01:36:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.790+0000 7f795f8d9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f79580b7a00 con 0x7f79580cf1f0 2024-09-12T01:36:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.790+0000 7f795f8d9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f795815eb80 con 0x7f795815e7a0 2024-09-12T01:36:31.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795d675640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79580b68f0 0x7f79580c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795d675640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79580b68f0 0x7f79580c8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54104/0 (socket says 172.21.15.60:54104) 2024-09-12T01:36:31.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795d675640 1 -- 172.21.15.60:0/4039476192 learned_addr learned my addr 172.21.15.60:0/4039476192 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:31.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795ce74640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79580cf1f0 0x7f79580caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795de76640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f795815e7a0 0x7f79580b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795d675640 1 -- 172.21.15.60:0/4039476192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f795815e7a0 msgr2=0x7f79580b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795d675640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f795815e7a0 0x7f79580b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795d675640 1 -- 172.21.15.60:0/4039476192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79580cf1f0 msgr2=0x7f79580caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795d675640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79580cf1f0 0x7f79580caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795d675640 1 -- 172.21.15.60:0/4039476192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79580c8870 con 0x7f79580b68f0 2024-09-12T01:36:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795d675640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79580b68f0 0x7f79580c8290 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7950000c00 tx=0x7f79500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f7955ffb640 1 -- 172.21.15.60:0/4039476192 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7950041020 con 0x7f79580b68f0 2024-09-12T01:36:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f7955ffb640 1 -- 172.21.15.60:0/4039476192 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7950030970 con 0x7f79580b68f0 2024-09-12T01:36:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795f8d9640 1 -- 172.21.15.60:0/4039476192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79580c8b50 con 0x7f79580b68f0 2024-09-12T01:36:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f7955ffb640 1 -- 172.21.15.60:0/4039476192 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7950037040 con 0x7f79580b68f0 2024-09-12T01:36:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.791+0000 7f795f8d9640 1 -- 172.21.15.60:0/4039476192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79580ce810 con 0x7f79580b68f0 2024-09-12T01:36:31.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.792+0000 7f795f8d9640 1 -- 172.21.15.60:0/4039476192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f795806caa0 con 0x7f79580b68f0 2024-09-12T01:36:31.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.793+0000 7f7955ffb640 1 -- 172.21.15.60:0/4039476192 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7950044020 con 0x7f79580b68f0 2024-09-12T01:36:31.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.793+0000 7f7955ffb640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f794406be30 0x7f794406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:31.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.794+0000 7f7955ffb640 1 -- 172.21.15.60:0/4039476192 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f79500ab400 con 0x7f79580b68f0 2024-09-12T01:36:31.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.794+0000 7f795ce74640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f794406be30 0x7f794406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:31.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.794+0000 7f795ce74640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f794406be30 0x7f794406e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f79580cdf30 tx=0x7f794c007e30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:31.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:31.798+0000 7f7955ffb640 1 -- 172.21.15.60:0/4039476192 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f795004b030 con 0x7f79580b68f0 2024-09-12T01:36:32.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.045+0000 7f795f8d9640 1 -- 172.21.15.60:0/4039476192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f79580d1770 con 0x7f79580b68f0 2024-09-12T01:36:32.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.047+0000 7f7955ffb640 1 -- 172.21.15.60:0/4039476192 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f795007a190 con 0x7f79580b68f0 2024-09-12T01:36:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.049+0000 7f795f8d9640 1 -- 172.21.15.60:0/4039476192 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f794406be30 msgr2=0x7f794406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.049+0000 7f795f8d9640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f794406be30 0x7f794406e2f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f79580cdf30 tx=0x7f794c007e30 comp rx=0 tx=0).stop 2024-09-12T01:36:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.049+0000 7f795f8d9640 1 -- 172.21.15.60:0/4039476192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79580b68f0 msgr2=0x7f79580c8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.049+0000 7f795f8d9640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79580b68f0 0x7f79580c8290 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7950000c00 tx=0x7f79500046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.049+0000 7f795f8d9640 1 -- 172.21.15.60:0/4039476192 shutdown_connections 2024-09-12T01:36:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.049+0000 7f795f8d9640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f794406be30 0x7f794406e2f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.049+0000 7f795f8d9640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f795815e7a0 0x7f79580b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.049+0000 7f795f8d9640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79580cf1f0 0x7f79580caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.049+0000 7f795f8d9640 1 --2- 172.21.15.60:0/4039476192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79580b68f0 0x7f79580c8290 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.049+0000 7f795f8d9640 1 -- 172.21.15.60:0/4039476192 >> 172.21.15.60:0/4039476192 conn(0x7f79580d11e0 msgr2=0x7f795815d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:32.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.049+0000 7f795f8d9640 1 -- 172.21.15.60:0/4039476192 shutdown_connections 2024-09-12T01:36:32.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.049+0000 7f795f8d9640 1 -- 172.21.15.60:0/4039476192 wait complete. 2024-09-12T01:36:32.059 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-12T01:36:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.163+0000 7f033db03640 1 Processor -- start 2024-09-12T01:36:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.163+0000 7f033db03640 1 -- start start 2024-09-12T01:36:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f033db03640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f033815e6f0 0x7f033806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f033db03640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f03380b7450 0x7f033815f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f033db03640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033806e990 con 0x7f03380b54d0 2024-09-12T01:36:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f033db03640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f033806ec70 con 0x7f03380b7450 2024-09-12T01:36:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f033db03640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f033815ec70 con 0x7f033815e6f0 2024-09-12T01:36:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f0337fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f03380b7450 0x7f033815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f03377fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f033815e6f0 0x7f033806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f03377fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f033815e6f0 0x7f033806fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:41804/0 (socket says 172.21.15.60:41804) 2024-09-12T01:36:32.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f0336ffd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f03380b54d0 0x7f03380b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:37922/0 (socket says 172.21.15.60:37922) 2024-09-12T01:36:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f03377fe640 1 -- 172.21.15.60:0/3367100789 learned_addr learned my addr 172.21.15.60:0/3367100789 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f0337fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f03380b7450 0x7f033815f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:56948/0 (socket says 172.21.15.60:56948) 2024-09-12T01:36:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f0337fff640 1 -- 172.21.15.60:0/3367100789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f033815e6f0 msgr2=0x7f033806fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f0337fff640 1 --2- 172.21.15.60:0/3367100789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f033815e6f0 0x7f033806fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f0337fff640 1 -- 172.21.15.60:0/3367100789 >> v1:172.21.15.105:6789/0 conn(0x7f03380b54d0 legacy=0x7f03380b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f03367fc640 1 -- 172.21.15.60:0/3367100789 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 969028457 0 0) 0x7f033806e990 con 0x7f03380b54d0 2024-09-12T01:36:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f0337fff640 1 -- 172.21.15.60:0/3367100789 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033815ef50 con 0x7f03380b7450 2024-09-12T01:36:32.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.164+0000 7f03377fe640 1 --2- 172.21.15.60:0/3367100789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f033815e6f0 0x7f033806fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:32.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.165+0000 7f0337fff640 1 --2- 172.21.15.60:0/3367100789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03380b7450 0x7f033815f750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0330009d90 tx=0x7f033002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10032606bd5ea374 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.165+0000 7f03367fc640 1 -- 172.21.15.60:0/3367100789 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330007740 con 0x7f03380b7450 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.165+0000 7f03367fc640 1 -- 172.21.15.60:0/3367100789 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03300078e0 con 0x7f03380b7450 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.165+0000 7f03367fc640 1 -- 172.21.15.60:0/3367100789 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330007cb0 con 0x7f03380b7450 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.166+0000 7f033db03640 1 -- 172.21.15.60:0/3367100789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03380b7450 msgr2=0x7f033815f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.166+0000 7f033db03640 1 --2- 172.21.15.60:0/3367100789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03380b7450 0x7f033815f750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0330009d90 tx=0x7f033002a660 comp rx=0 tx=0).stop 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.166+0000 7f033db03640 1 -- 172.21.15.60:0/3367100789 shutdown_connections 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.166+0000 7f033db03640 1 --2- 172.21.15.60:0/3367100789 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03380b7450 0x7f033815f750 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.166+0000 7f033db03640 1 --2- 172.21.15.60:0/3367100789 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f033815e6f0 0x7f033806fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.166+0000 7f033db03640 1 -- 172.21.15.60:0/3367100789 >> 172.21.15.60:0/3367100789 conn(0x7f03380d2430 msgr2=0x7f03380d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.166+0000 7f033db03640 1 -- 172.21.15.60:0/3367100789 shutdown_connections 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.166+0000 7f033db03640 1 -- 172.21.15.60:0/3367100789 wait complete. 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.167+0000 7f033db03640 1 Processor -- start 2024-09-12T01:36:32.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.167+0000 7f033db03640 1 -- start start 2024-09-12T01:36:32.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.168+0000 7f033db03640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03380b54d0 0x7f0338155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.168+0000 7f033db03640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03380b7450 0x7f0338153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.168+0000 7f033db03640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f033815e6f0 0x7f0338150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.168+0000 7f033db03640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f033806e730 con 0x7f03380b54d0 2024-09-12T01:36:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.168+0000 7f033db03640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f033806e5b0 con 0x7f033815e6f0 2024-09-12T01:36:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.168+0000 7f033db03640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0338070830 con 0x7f03380b7450 2024-09-12T01:36:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.168+0000 7f03377fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03380b54d0 0x7f0338155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.168+0000 7f03377fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03380b54d0 0x7f0338155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54108/0 (socket says 172.21.15.60:54108) 2024-09-12T01:36:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.168+0000 7f03377fe640 1 -- 172.21.15.60:0/3249302328 learned_addr learned my addr 172.21.15.60:0/3249302328 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.168+0000 7f0337fff640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f033815e6f0 0x7f0338150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.168+0000 7f0336ffd640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03380b7450 0x7f0338153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.169+0000 7f03377fe640 1 -- 172.21.15.60:0/3249302328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03380b7450 msgr2=0x7f0338153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.169+0000 7f03377fe640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03380b7450 0x7f0338153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.169+0000 7f03377fe640 1 -- 172.21.15.60:0/3249302328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f033815e6f0 msgr2=0x7f0338150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.169+0000 7f03377fe640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f033815e6f0 0x7f0338150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.169+0000 7f03377fe640 1 -- 172.21.15.60:0/3249302328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0338150890 con 0x7f03380b54d0 2024-09-12T01:36:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.169+0000 7f0336ffd640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03380b7450 0x7f0338153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.169+0000 7f03377fe640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03380b54d0 0x7f0338155e80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f032800e9e0 tx=0x7f032800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.169+0000 7f031ffff640 1 -- 172.21.15.60:0/3249302328 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328017070 con 0x7f03380b54d0 2024-09-12T01:36:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.169+0000 7f031ffff640 1 -- 172.21.15.60:0/3249302328 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f032800c9d0 con 0x7f03380b54d0 2024-09-12T01:36:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.169+0000 7f033db03640 1 -- 172.21.15.60:0/3249302328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033815d400 con 0x7f03380b54d0 2024-09-12T01:36:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.169+0000 7f031ffff640 1 -- 172.21.15.60:0/3249302328 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032800cd80 con 0x7f03380b54d0 2024-09-12T01:36:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.169+0000 7f033db03640 1 -- 172.21.15.60:0/3249302328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0338155680 con 0x7f03380b54d0 2024-09-12T01:36:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.170+0000 7f033db03640 1 -- 172.21.15.60:0/3249302328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f033806c6c0 con 0x7f03380b54d0 2024-09-12T01:36:32.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.170+0000 7f031ffff640 1 -- 172.21.15.60:0/3249302328 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f032801a070 con 0x7f03380b54d0 2024-09-12T01:36:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.171+0000 7f031ffff640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f032406be30 0x7f032406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.171+0000 7f031ffff640 1 -- 172.21.15.60:0/3249302328 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f032808a870 con 0x7f03380b54d0 2024-09-12T01:36:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.171+0000 7f0336ffd640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f032406be30 0x7f032406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.171+0000 7f0336ffd640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f032406be30 0x7f032406e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f03381f7d00 tx=0x7f032c007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:32.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.175+0000 7f031ffff640 1 -- 172.21.15.60:0/3249302328 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0328058fb0 con 0x7f03380b54d0 2024-09-12T01:36:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.417+0000 7f033db03640 1 -- 172.21.15.60:0/3249302328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f033815a8f0 con 0x7f03380b54d0 2024-09-12T01:36:32.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.419+0000 7f031ffff640 1 -- 172.21.15.60:0/3249302328 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f032805d2b0 con 0x7f03380b54d0 2024-09-12T01:36:32.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.422+0000 7f033db03640 1 -- 172.21.15.60:0/3249302328 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f032406be30 msgr2=0x7f032406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.422+0000 7f033db03640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f032406be30 0x7f032406e2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f03381f7d00 tx=0x7f032c007c10 comp rx=0 tx=0).stop 2024-09-12T01:36:32.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.422+0000 7f033db03640 1 -- 172.21.15.60:0/3249302328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03380b54d0 msgr2=0x7f0338155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.422+0000 7f033db03640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03380b54d0 0x7f0338155e80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f032800e9e0 tx=0x7f032800eea0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.422+0000 7f033db03640 1 -- 172.21.15.60:0/3249302328 shutdown_connections 2024-09-12T01:36:32.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.422+0000 7f033db03640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f033815e6f0 0x7f0338150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.422+0000 7f033db03640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f032406be30 0x7f032406e2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.422+0000 7f033db03640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03380b7450 0x7f0338153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.422+0000 7f033db03640 1 --2- 172.21.15.60:0/3249302328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03380b54d0 0x7f0338155e80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.422+0000 7f033db03640 1 -- 172.21.15.60:0/3249302328 >> 172.21.15.60:0/3249302328 conn(0x7f03380d2430 msgr2=0x7f033815ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:32.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.422+0000 7f033db03640 1 -- 172.21.15.60:0/3249302328 shutdown_connections 2024-09-12T01:36:32.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.422+0000 7f033db03640 1 -- 172.21.15.60:0/3249302328 wait complete. 2024-09-12T01:36:32.432 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-12T01:36:32.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.535+0000 7f8d4bfa1640 1 Processor -- start 2024-09-12T01:36:32.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.536+0000 7f8d4bfa1640 1 -- start start 2024-09-12T01:36:32.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.536+0000 7f8d4bfa1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8d4415e7a0 0x7f8d4406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.536+0000 7f8d4bfa1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d440cf1f0 0x7f8d440b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.536+0000 7f8d4bfa1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8d440b6720 0x7f8d441623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.536+0000 7f8d4bfa1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f8d440d2ca0 con 0x7f8d440b6720 2024-09-12T01:36:32.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.536+0000 7f8d4bfa1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8d440cf860 con 0x7f8d4415e7a0 2024-09-12T01:36:32.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.536+0000 7f8d4bfa1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8d440cfb40 con 0x7f8d440cf1f0 2024-09-12T01:36:32.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.537+0000 7f8d4a53e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8d440b6720 0x7f8d441623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.537+0000 7f8d4a53e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8d440b6720 0x7f8d441623c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54122/0 (socket says 172.21.15.60:54122) 2024-09-12T01:36:32.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.537+0000 7f8d4a53e640 1 -- 172.21.15.60:0/774488968 learned_addr learned my addr 172.21.15.60:0/774488968 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:32.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.537+0000 7f8d4a53e640 1 -- 172.21.15.60:0/774488968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d440cf1f0 msgr2=0x7f8d440b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:32.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.537+0000 7f8d49d3d640 1 --2- 172.21.15.60:0/774488968 >> v2:172.21.15.105:3300/0 conn(0x7f8d4415e7a0 0x7f8d4406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.537+0000 7f8d4953c640 1 --2- 172.21.15.60:0/774488968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d440cf1f0 0x7f8d440b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.537+0000 7f8d4a53e640 1 --2- 172.21.15.60:0/774488968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d440cf1f0 0x7f8d440b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.537+0000 7f8d4a53e640 1 -- 172.21.15.60:0/774488968 >> v2:172.21.15.105:3300/0 conn(0x7f8d4415e7a0 msgr2=0x7f8d4406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:32.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.537+0000 7f8d4a53e640 1 --2- 172.21.15.60:0/774488968 >> v2:172.21.15.105:3300/0 conn(0x7f8d4415e7a0 0x7f8d4406caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.537+0000 7f8d4a53e640 1 -- 172.21.15.60:0/774488968 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d440cfe20 con 0x7f8d440b6720 2024-09-12T01:36:32.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.537+0000 7f8d49d3d640 1 --2- 172.21.15.60:0/774488968 >> v2:172.21.15.105:3300/0 conn(0x7f8d4415e7a0 0x7f8d4406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.538+0000 7f8d4a53e640 1 --2- 172.21.15.60:0/774488968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d440b6720 0x7f8d441623c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8d440d5820 tx=0x7f8d3402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618ba555a7fa3784 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.538+0000 7f8d48d3b640 1 -- 172.21.15.60:0/774488968 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34036070 con 0x7f8d440b6720 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.538+0000 7f8d48d3b640 1 -- 172.21.15.60:0/774488968 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d34031600 con 0x7f8d440b6720 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.538+0000 7f8d48d3b640 1 -- 172.21.15.60:0/774488968 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d340319d0 con 0x7f8d440b6720 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.538+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/774488968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d440b6720 msgr2=0x7f8d441623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.538+0000 7f8d4bfa1640 1 --2- 172.21.15.60:0/774488968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d440b6720 0x7f8d441623c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8d440d5820 tx=0x7f8d3402a610 comp rx=0 tx=0).stop 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.538+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/774488968 shutdown_connections 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.538+0000 7f8d4bfa1640 1 --2- 172.21.15.60:0/774488968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d440b6720 0x7f8d441623c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.538+0000 7f8d4bfa1640 1 --2- 172.21.15.60:0/774488968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d440cf1f0 0x7f8d440b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.538+0000 7f8d4bfa1640 1 --2- 172.21.15.60:0/774488968 >> v2:172.21.15.105:3300/0 conn(0x7f8d4415e7a0 0x7f8d4406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.538+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/774488968 >> 172.21.15.60:0/774488968 conn(0x7f8d440d11e0 msgr2=0x7f8d440d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.538+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/774488968 shutdown_connections 2024-09-12T01:36:32.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.539+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/774488968 wait complete. 2024-09-12T01:36:32.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.540+0000 7f8d4bfa1640 1 Processor -- start 2024-09-12T01:36:32.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.540+0000 7f8d4bfa1640 1 -- start start 2024-09-12T01:36:32.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.540+0000 7f8d4bfa1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d440b6720 0x7f8d4414e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.540+0000 7f8d4bfa1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d440cf1f0 0x7f8d44160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.540+0000 7f8d4bfa1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d4415e7a0 0x7f8d4415f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.540+0000 7f8d4bfa1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4406cfe0 con 0x7f8d440cf1f0 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.540+0000 7f8d4bfa1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440b7a00 con 0x7f8d4415e7a0 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.540+0000 7f8d4bfa1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8d4415eb80 con 0x7f8d440b6720 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.540+0000 7f8d4953c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d440cf1f0 0x7f8d44160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d4953c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d440cf1f0 0x7f8d44160960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54134/0 (socket says 172.21.15.60:54134) 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d4953c640 1 -- 172.21.15.60:0/814475244 learned_addr learned my addr 172.21.15.60:0/814475244 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d49d3d640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d440b6720 0x7f8d4414e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d4a53e640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d4415e7a0 0x7f8d4415f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d4953c640 1 -- 172.21.15.60:0/814475244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d440b6720 msgr2=0x7f8d4414e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d4953c640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d440b6720 0x7f8d4414e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d4953c640 1 -- 172.21.15.60:0/814475244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d4415e7a0 msgr2=0x7f8d4415f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d4953c640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d4415e7a0 0x7f8d4415f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d4953c640 1 -- 172.21.15.60:0/814475244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4415f620 con 0x7f8d440cf1f0 2024-09-12T01:36:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d4a53e640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d4415e7a0 0x7f8d4415f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d4953c640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d440cf1f0 0x7f8d44160960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800c570 tx=0x7f8d3800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d427fc640 1 -- 172.21.15.60:0/814475244 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38015070 con 0x7f8d440cf1f0 2024-09-12T01:36:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d427fc640 1 -- 172.21.15.60:0/814475244 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d38004220 con 0x7f8d440cf1f0 2024-09-12T01:36:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/814475244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d4415f8c0 con 0x7f8d440cf1f0 2024-09-12T01:36:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d427fc640 1 -- 172.21.15.60:0/814475244 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38003610 con 0x7f8d440cf1f0 2024-09-12T01:36:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.541+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/814475244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d4415fe80 con 0x7f8d440cf1f0 2024-09-12T01:36:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.542+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/814475244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d440cdd20 con 0x7f8d440cf1f0 2024-09-12T01:36:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.543+0000 7f8d427fc640 1 -- 172.21.15.60:0/814475244 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d380037b0 con 0x7f8d440cf1f0 2024-09-12T01:36:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.543+0000 7f8d427fc640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8d3006be30 0x7f8d3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.543+0000 7f8d427fc640 1 -- 172.21.15.60:0/814475244 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f8d3808a7d0 con 0x7f8d440cf1f0 2024-09-12T01:36:32.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.543+0000 7f8d49d3d640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8d3006be30 0x7f8d3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.544+0000 7f8d49d3d640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8d3006be30 0x7f8d3006e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00ab60 tx=0x7f8d3c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:32.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.548+0000 7f8d427fc640 1 -- 172.21.15.60:0/814475244 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d440cdd20 con 0x7f8d440cf1f0 2024-09-12T01:36:32.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.787+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/814475244 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f8d440b61e0 con 0x7f8d440cf1f0 2024-09-12T01:36:32.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.789+0000 7f8d427fc640 1 -- 172.21.15.60:0/814475244 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f8d38058df0 con 0x7f8d440cf1f0 2024-09-12T01:36:32.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.791+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/814475244 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8d3006be30 msgr2=0x7f8d3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.791+0000 7f8d4bfa1640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8d3006be30 0x7f8d3006e2f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00ab60 tx=0x7f8d3c008040 comp rx=0 tx=0).stop 2024-09-12T01:36:32.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.791+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/814475244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d440cf1f0 msgr2=0x7f8d44160960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.791+0000 7f8d4bfa1640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d440cf1f0 0x7f8d44160960 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800c570 tx=0x7f8d3800ca30 comp rx=0 tx=0).stop 2024-09-12T01:36:32.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.791+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/814475244 shutdown_connections 2024-09-12T01:36:32.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.791+0000 7f8d4bfa1640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d4415e7a0 0x7f8d4415f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.791+0000 7f8d4bfa1640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d440cf1f0 0x7f8d44160960 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.791+0000 7f8d4bfa1640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8d3006be30 0x7f8d3006e2f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.791+0000 7f8d4bfa1640 1 --2- 172.21.15.60:0/814475244 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d440b6720 0x7f8d4414e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.791+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/814475244 >> 172.21.15.60:0/814475244 conn(0x7f8d440d11e0 msgr2=0x7f8d440b5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:32.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.792+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/814475244 shutdown_connections 2024-09-12T01:36:32.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.792+0000 7f8d4bfa1640 1 -- 172.21.15.60:0/814475244 wait complete. 2024-09-12T01:36:32.802 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-12T01:36:32.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.906+0000 7fdeba0c9640 1 Processor -- start 2024-09-12T01:36:32.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.906+0000 7fdeba0c9640 1 -- start start 2024-09-12T01:36:32.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeba0c9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdeb415c770 0x7fdeb40d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeba0c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeb40b7670 0x7fdeb40b5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeba0c9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeb40d0860 con 0x7fdeb4073160 2024-09-12T01:36:32.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeba0c9640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdeb40d2310 con 0x7fdeb415c770 2024-09-12T01:36:32.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeba0c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb40d0b20 con 0x7fdeb40b7670 2024-09-12T01:36:32.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeb37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdeb415c770 0x7fdeb40d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeb37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdeb415c770 0x7fdeb40d0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50474/0 (socket says 172.21.15.60:50474) 2024-09-12T01:36:32.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeb37fe640 1 -- 172.21.15.60:0/374844683 learned_addr learned my addr 172.21.15.60:0/374844683 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:32.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeb3fff640 1 --2- 172.21.15.60:0/374844683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeb40b7670 0x7fdeb40b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeb37fe640 1 -- 172.21.15.60:0/374844683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeb40b7670 msgr2=0x7fdeb40b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:32.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeb37fe640 1 --2- 172.21.15.60:0/374844683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeb40b7670 0x7fdeb40b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeb37fe640 1 -- 172.21.15.60:0/374844683 >> v1:172.21.15.105:6789/0 conn(0x7fdeb4073160 legacy=0x7fdeb40b6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.907+0000 7fdeb37fe640 1 -- 172.21.15.60:0/374844683 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb40d0e00 con 0x7fdeb415c770 2024-09-12T01:36:32.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.908+0000 7fdeb37fe640 1 --2- 172.21.15.60:0/374844683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb415c770 0x7fdeb40d0320 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009870 tx=0x7fdea402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62091ccc006063c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:32.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.908+0000 7fdeb27fc640 1 -- 172.21.15.60:0/374844683 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4037070 con 0x7fdeb415c770 2024-09-12T01:36:32.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.908+0000 7fdeb27fc640 1 -- 172.21.15.60:0/374844683 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea4032440 con 0x7fdeb415c770 2024-09-12T01:36:32.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.908+0000 7fdeb27fc640 1 -- 172.21.15.60:0/374844683 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4032810 con 0x7fdeb415c770 2024-09-12T01:36:32.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.909+0000 7fdeba0c9640 1 -- 172.21.15.60:0/374844683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb415c770 msgr2=0x7fdeb40d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.909+0000 7fdeba0c9640 1 --2- 172.21.15.60:0/374844683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb415c770 0x7fdeb40d0320 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdea4009870 tx=0x7fdea402a270 comp rx=0 tx=0).stop 2024-09-12T01:36:32.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.909+0000 7fdeba0c9640 1 -- 172.21.15.60:0/374844683 shutdown_connections 2024-09-12T01:36:32.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.909+0000 7fdeba0c9640 1 --2- 172.21.15.60:0/374844683 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeb40b7670 0x7fdeb40b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.909+0000 7fdeba0c9640 1 --2- 172.21.15.60:0/374844683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb415c770 0x7fdeb40d0320 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.909+0000 7fdeba0c9640 1 -- 172.21.15.60:0/374844683 >> 172.21.15.60:0/374844683 conn(0x7fdeb40d24d0 msgr2=0x7fdeb40d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:32.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.909+0000 7fdeba0c9640 1 -- 172.21.15.60:0/374844683 shutdown_connections 2024-09-12T01:36:32.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.909+0000 7fdeba0c9640 1 -- 172.21.15.60:0/374844683 wait complete. 2024-09-12T01:36:32.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.910+0000 7fdeba0c9640 1 Processor -- start 2024-09-12T01:36:32.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.910+0000 7fdeba0c9640 1 -- start start 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeba0c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb4073160 0x7fdeb4151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeba0c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeb40b7670 0x7fdeb414dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeba0c9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb415c770 0x7fdeb41505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeba0c9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb40b5d60 con 0x7fdeb4073160 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeba0c9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb40d13c0 con 0x7fdeb415c770 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeba0c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb40b5ee0 con 0x7fdeb40b7670 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb4073160 0x7fdeb4151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb4073160 0x7fdeb4151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50488/0 (socket says 172.21.15.60:50488) 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb37fe640 1 -- 172.21.15.60:0/3539999892 learned_addr learned my addr 172.21.15.60:0/3539999892 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb3fff640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb415c770 0x7fdeb41505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb2ffd640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeb40b7670 0x7fdeb414dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb37fe640 1 -- 172.21.15.60:0/3539999892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeb40b7670 msgr2=0x7fdeb414dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb37fe640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeb40b7670 0x7fdeb414dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb37fe640 1 -- 172.21.15.60:0/3539999892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb415c770 msgr2=0x7fdeb41505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb37fe640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb415c770 0x7fdeb41505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb37fe640 1 -- 172.21.15.60:0/3539999892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb406e770 con 0x7fdeb4073160 2024-09-12T01:36:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb3fff640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb415c770 0x7fdeb41505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb2ffd640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeb40b7670 0x7fdeb414dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fdeb37fe640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb4073160 0x7fdeb4151190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdea4000c00 tx=0x7fdea40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.911+0000 7fde9bfff640 1 -- 172.21.15.60:0/3539999892 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4037040 con 0x7fdeb4073160 2024-09-12T01:36:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.912+0000 7fde9bfff640 1 -- 172.21.15.60:0/3539999892 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea4042070 con 0x7fdeb4073160 2024-09-12T01:36:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.912+0000 7fde9bfff640 1 -- 172.21.15.60:0/3539999892 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4030880 con 0x7fdeb4073160 2024-09-12T01:36:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.912+0000 7fdeba0c9640 1 -- 172.21.15.60:0/3539999892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeb406d9b0 con 0x7fdeb4073160 2024-09-12T01:36:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.912+0000 7fdeba0c9640 1 -- 172.21.15.60:0/3539999892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeb406df70 con 0x7fdeb4073160 2024-09-12T01:36:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.913+0000 7fdeba0c9640 1 -- 172.21.15.60:0/3539999892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeb40b5820 con 0x7fdeb4073160 2024-09-12T01:36:32.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.913+0000 7fde9bfff640 1 -- 172.21.15.60:0/3539999892 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdea4030a20 con 0x7fdeb4073160 2024-09-12T01:36:32.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.913+0000 7fde9bfff640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdea006be30 0x7fdea006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:32.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.914+0000 7fde9bfff640 1 -- 172.21.15.60:0/3539999892 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fdea40ab2c0 con 0x7fdeb4073160 2024-09-12T01:36:32.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.914+0000 7fdeb2ffd640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdea006be30 0x7fdea006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:32.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.914+0000 7fdeb2ffd640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdea006be30 0x7fdea006e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdeb41516d0 tx=0x7fdea8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:32.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:32.918+0000 7fde9bfff640 1 -- 172.21.15.60:0/3539999892 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdea407a050 con 0x7fdeb4073160 2024-09-12T01:36:33.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.162+0000 7fdeba0c9640 1 -- 172.21.15.60:0/3539999892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fdeb40cede0 con 0x7fdeb4073160 2024-09-12T01:36:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.164+0000 7fde9bfff640 1 -- 172.21.15.60:0/3539999892 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v10) ==== 97+0+0 (secure 0 0 0) 0x7fdea4079950 con 0x7fdeb4073160 2024-09-12T01:36:33.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.166+0000 7fdeba0c9640 1 -- 172.21.15.60:0/3539999892 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdea006be30 msgr2=0x7fdea006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.166+0000 7fdeba0c9640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdea006be30 0x7fdea006e2f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdeb41516d0 tx=0x7fdea8009040 comp rx=0 tx=0).stop 2024-09-12T01:36:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.166+0000 7fdeba0c9640 1 -- 172.21.15.60:0/3539999892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb4073160 msgr2=0x7fdeb4151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.166+0000 7fdeba0c9640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb4073160 0x7fdeb4151190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdea4000c00 tx=0x7fdea40046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.166+0000 7fdeba0c9640 1 -- 172.21.15.60:0/3539999892 shutdown_connections 2024-09-12T01:36:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.166+0000 7fdeba0c9640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdeb415c770 0x7fdeb41505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.166+0000 7fdeba0c9640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdea006be30 0x7fdea006e2f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.166+0000 7fdeba0c9640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdeb40b7670 0x7fdeb414dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.166+0000 7fdeba0c9640 1 --2- 172.21.15.60:0/3539999892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdeb4073160 0x7fdeb4151190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.166+0000 7fdeba0c9640 1 -- 172.21.15.60:0/3539999892 >> 172.21.15.60:0/3539999892 conn(0x7fdeb40d24d0 msgr2=0x7fdeb40cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.166+0000 7fdeba0c9640 1 -- 172.21.15.60:0/3539999892 shutdown_connections 2024-09-12T01:36:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.166+0000 7fdeba0c9640 1 -- 172.21.15.60:0/3539999892 wait complete. 2024-09-12T01:36:33.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-12T01:36:33.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.281+0000 7f3065f9d640 1 Processor -- start 2024-09-12T01:36:33.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.281+0000 7f3065f9d640 1 -- start start 2024-09-12T01:36:33.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f3065f9d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f30600d3bd0 0x7f30600b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f3065f9d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f306015e9d0 con 0x7f306015e5f0 2024-09-12T01:36:33.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f3065f9d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30600b8f20 con 0x7f30600d1590 2024-09-12T01:36:33.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f3065f9d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f30600b9b30 con 0x7f30600d3bd0 2024-09-12T01:36:33.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f3064f9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f306015e5f0 0x7f30600d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40002/0 (socket says 172.21.15.60:40002) 2024-09-12T01:36:33.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f3064f9b640 1 -- 172.21.15.60:0/451603900 learned_addr learned my addr 172.21.15.60:0/451603900 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:33.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 15432826 0 0) 0x7f306015e9d0 con 0x7f306015e5f0 2024-09-12T01:36:33.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f306579c640 1 --2- 172.21.15.60:0/451603900 >> v2:172.21.15.105:3300/0 conn(0x7f30600d3bd0 0x7f30600b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3050003520 con 0x7f306015e5f0 2024-09-12T01:36:33.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2144099645 0 0) 0x7f3050003520 con 0x7f306015e5f0 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 >> v2:172.21.15.105:3300/0 conn(0x7f30600d3bd0 msgr2=0x7f30600b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f305f7fe640 1 --2- 172.21.15.60:0/451603900 >> v2:172.21.15.105:3300/0 conn(0x7f30600d3bd0 0x7f30600b8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 >> v1:172.21.15.105:6789/0 conn(0x7f30600d1590 legacy=0x7f30600b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30600b9200 con 0x7f306015e5f0 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.282+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f3054001670 con 0x7f306015e5f0 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 >> v1:172.21.15.60:6789/0 conn(0x7f306015e5f0 legacy=0x7f30600d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f305f7fe640 1 --2- 172.21.15.60:0/451603900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30500039b0 0x7f3050003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f305f7fe640 1 --2- 172.21.15.60:0/451603900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3050004800 0x7f3050004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f305f7fe640 1 --2- 172.21.15.60:0/451603900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30500051c0 0x7f305000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f305000c130 con 0x7f30500051c0 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f305000c2e0 con 0x7f30500039b0 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f305000c4e0 con 0x7f3050004800 2024-09-12T01:36:33.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f306579c640 1 --2- 172.21.15.60:0/451603900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30500051c0 0x7f305000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f3064f9b640 1 --2- 172.21.15.60:0/451603900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30500039b0 0x7f3050003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f305ffff640 1 --2- 172.21.15.60:0/451603900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3050004800 0x7f3050004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f306579c640 1 -- 172.21.15.60:0/451603900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3050004800 msgr2=0x7f3050004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f306579c640 1 --2- 172.21.15.60:0/451603900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3050004800 0x7f3050004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f306579c640 1 -- 172.21.15.60:0/451603900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30500039b0 msgr2=0x7f3050003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f306579c640 1 --2- 172.21.15.60:0/451603900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30500039b0 0x7f3050003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f306579c640 1 -- 172.21.15.60:0/451603900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3050003520 con 0x7f30500051c0 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.283+0000 7f305ffff640 1 --2- 172.21.15.60:0/451603900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3050004800 0x7f3050004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.284+0000 7f306579c640 1 -- 172.21.15.60:0/451603900 reap_dead start 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.284+0000 7f306579c640 1 --2- 172.21.15.60:0/451603900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30500051c0 0x7f305000b9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3058009fc0 tx=0x7f3050005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231ef9a700b54699 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.284+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058035020 con 0x7f30500051c0 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.284+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3058003bd0 con 0x7f30500051c0 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.284+0000 7f305f7fe640 1 -- 172.21.15.60:0/451603900 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3058009c10 con 0x7f30500051c0 2024-09-12T01:36:33.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.284+0000 7f3065f9d640 1 -- 172.21.15.60:0/451603900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30500051c0 msgr2=0x7f305000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.284+0000 7f3065f9d640 1 --2- 172.21.15.60:0/451603900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30500051c0 0x7f305000b9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3058009fc0 tx=0x7f3050005830 comp rx=0 tx=0).stop 2024-09-12T01:36:33.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.284+0000 7f3065f9d640 1 -- 172.21.15.60:0/451603900 shutdown_connections 2024-09-12T01:36:33.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.284+0000 7f3065f9d640 1 --2- 172.21.15.60:0/451603900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30500051c0 0x7f305000b9c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.284+0000 7f3065f9d640 1 -- 172.21.15.60:0/451603900 >> 172.21.15.60:0/451603900 conn(0x7f3060062630 msgr2=0x7f3060062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:33.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.284+0000 7f3065f9d640 1 -- 172.21.15.60:0/451603900 shutdown_connections 2024-09-12T01:36:33.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.285+0000 7f3065f9d640 1 -- 172.21.15.60:0/451603900 wait complete. 2024-09-12T01:36:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.286+0000 7f3065f9d640 1 Processor -- start 2024-09-12T01:36:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.286+0000 7f3065f9d640 1 -- start start 2024-09-12T01:36:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f3065f9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30500051c0 0x7f30601f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f3065f9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30600b5280 0x7f30600c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f3065f9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30600b5700 0x7f30600c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f3065f9d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f30600d0e80 con 0x7f30600b5280 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f3065f9d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f30600b97c0 con 0x7f30600b5700 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f3065f9d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f30600d1000 con 0x7f30500051c0 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f305ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30600b5280 0x7f30600c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f305ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30600b5280 0x7f30600c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50508/0 (socket says 172.21.15.60:50508) 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f305ffff640 1 -- 172.21.15.60:0/133951321 learned_addr learned my addr 172.21.15.60:0/133951321 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f306579c640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30600b5700 0x7f30600c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f3064f9b640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30500051c0 0x7f30601f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f305ffff640 1 -- 172.21.15.60:0/133951321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30500051c0 msgr2=0x7f30601f5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f305ffff640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30500051c0 0x7f30601f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f305ffff640 1 -- 172.21.15.60:0/133951321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30600b5700 msgr2=0x7f30600c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f305ffff640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30600b5700 0x7f30600c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f305ffff640 1 -- 172.21.15.60:0/133951321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30600c9bd0 con 0x7f30600b5280 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f306579c640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30600b5700 0x7f30600c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f305ffff640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30600b5280 0x7f30600c8ff0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f304c00e460 tx=0x7f304c00e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f305d7fa640 1 -- 172.21.15.60:0/133951321 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c0052e0 con 0x7f30600b5280 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f305d7fa640 1 -- 172.21.15.60:0/133951321 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f304c018070 con 0x7f30600b5280 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f3065f9d640 1 -- 172.21.15.60:0/133951321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30600c9eb0 con 0x7f30600b5280 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f305d7fa640 1 -- 172.21.15.60:0/133951321 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c003830 con 0x7f30600b5280 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.287+0000 7f3065f9d640 1 -- 172.21.15.60:0/133951321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f306015f170 con 0x7f30600b5280 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.288+0000 7f3065f9d640 1 -- 172.21.15.60:0/133951321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3060069c20 con 0x7f30600b5280 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.289+0000 7f305d7fa640 1 -- 172.21.15.60:0/133951321 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f304c0039d0 con 0x7f30600b5280 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.289+0000 7f305d7fa640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f304406be30 0x7f304406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.289+0000 7f305d7fa640 1 -- 172.21.15.60:0/133951321 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f304c08a700 con 0x7f30600b5280 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.289+0000 7f3064f9b640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f304406be30 0x7f304406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.290+0000 7f3064f9b640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f304406be30 0x7f304406e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3054001050 tx=0x7f3054009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.294+0000 7f305d7fa640 1 -- 172.21.15.60:0/133951321 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f304c0593f0 con 0x7f30600b5280 2024-09-12T01:36:33.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.534+0000 7f3065f9d640 1 -- 172.21.15.60:0/133951321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f30600b81f0 con 0x7f30600b5280 2024-09-12T01:36:33.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.539+0000 7f305d7fa640 1 -- 172.21.15.60:0/133951321 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f304c058cf0 con 0x7f30600b5280 2024-09-12T01:36:33.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.540+0000 7f3065f9d640 1 -- 172.21.15.60:0/133951321 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f304406be30 msgr2=0x7f304406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.540+0000 7f3065f9d640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f304406be30 0x7f304406e2f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3054001050 tx=0x7f3054009040 comp rx=0 tx=0).stop 2024-09-12T01:36:33.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.540+0000 7f3065f9d640 1 -- 172.21.15.60:0/133951321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30600b5280 msgr2=0x7f30600c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.540+0000 7f3065f9d640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30600b5280 0x7f30600c8ff0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f304c00e460 tx=0x7f304c00e920 comp rx=0 tx=0).stop 2024-09-12T01:36:33.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.541+0000 7f3065f9d640 1 -- 172.21.15.60:0/133951321 shutdown_connections 2024-09-12T01:36:33.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.541+0000 7f3065f9d640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30600b5700 0x7f30600c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.541+0000 7f3065f9d640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30600b5280 0x7f30600c8ff0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.541+0000 7f3065f9d640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f304406be30 0x7f304406e2f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.541+0000 7f3065f9d640 1 --2- 172.21.15.60:0/133951321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30500051c0 0x7f30601f5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.541+0000 7f3065f9d640 1 -- 172.21.15.60:0/133951321 >> 172.21.15.60:0/133951321 conn(0x7f3060062630 msgr2=0x7f30600cd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:33.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.541+0000 7f3065f9d640 1 -- 172.21.15.60:0/133951321 shutdown_connections 2024-09-12T01:36:33.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.541+0000 7f3065f9d640 1 -- 172.21.15.60:0/133951321 wait complete. 2024-09-12T01:36:33.551 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:36:33.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.656+0000 7ff91a227640 1 Processor -- start 2024-09-12T01:36:33.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.656+0000 7ff91a227640 1 -- start start 2024-09-12T01:36:33.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff91a227640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415c550 0x7ff9140b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff91a227640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff9140b6310 0x7ff9140b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff91a227640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9140b4cf0 con 0x7ff91415c170 2024-09-12T01:36:33.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff91a227640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff9140b4fd0 con 0x7ff9140b6310 2024-09-12T01:36:33.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff91a227640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff9140b52b0 con 0x7ff91415c550 2024-09-12T01:36:33.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff912ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415c550 0x7ff9140b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff913fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff9140b6310 0x7ff9140b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff9137fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff91415c170 0x7ff9140cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:60180/0 (socket says 172.21.15.60:60180) 2024-09-12T01:36:33.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff9137fe640 1 -- 172.21.15.60:0/2566893552 learned_addr learned my addr 172.21.15.60:0/2566893552 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:33.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff9127fc640 1 -- 172.21.15.60:0/2566893552 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4183079222 0 0) 0x7ff9140b4cf0 con 0x7ff91415c170 2024-09-12T01:36:33.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff912ffd640 1 -- 172.21.15.60:0/2566893552 >> v2:172.21.15.105:3300/0 conn(0x7ff9140b6310 msgr2=0x7ff9140b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff912ffd640 1 --2- 172.21.15.60:0/2566893552 >> v2:172.21.15.105:3300/0 conn(0x7ff9140b6310 0x7ff9140b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff912ffd640 1 -- 172.21.15.60:0/2566893552 >> v1:172.21.15.105:6789/0 conn(0x7ff91415c170 legacy=0x7ff9140cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff912ffd640 1 -- 172.21.15.60:0/2566893552 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9140b5590 con 0x7ff91415c550 2024-09-12T01:36:33.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.657+0000 7ff913fff640 1 --2- 172.21.15.60:0/2566893552 >> v2:172.21.15.105:3300/0 conn(0x7ff9140b6310 0x7ff9140b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.658+0000 7ff912ffd640 1 --2- 172.21.15.60:0/2566893552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415c550 0x7ff9140b5dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9080097a0 tx=0x7ff90802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6b5a77345354a7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.658+0000 7ff9127fc640 1 -- 172.21.15.60:0/2566893552 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908037070 con 0x7ff91415c550 2024-09-12T01:36:33.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.658+0000 7ff9127fc640 1 -- 172.21.15.60:0/2566893552 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff908032440 con 0x7ff91415c550 2024-09-12T01:36:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.658+0000 7ff9127fc640 1 -- 172.21.15.60:0/2566893552 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff908032810 con 0x7ff91415c550 2024-09-12T01:36:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.659+0000 7ff91a227640 1 -- 172.21.15.60:0/2566893552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415c550 msgr2=0x7ff9140b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.659+0000 7ff91a227640 1 --2- 172.21.15.60:0/2566893552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415c550 0x7ff9140b5dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff9080097a0 tx=0x7ff90802a180 comp rx=0 tx=0).stop 2024-09-12T01:36:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.659+0000 7ff91a227640 1 -- 172.21.15.60:0/2566893552 shutdown_connections 2024-09-12T01:36:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.659+0000 7ff91a227640 1 --2- 172.21.15.60:0/2566893552 >> v2:172.21.15.105:3300/0 conn(0x7ff9140b6310 0x7ff9140b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.659+0000 7ff91a227640 1 --2- 172.21.15.60:0/2566893552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415c550 0x7ff9140b5dd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.659+0000 7ff91a227640 1 -- 172.21.15.60:0/2566893552 >> 172.21.15.60:0/2566893552 conn(0x7ff91406bc10 msgr2=0x7ff91406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.659+0000 7ff91a227640 1 -- 172.21.15.60:0/2566893552 shutdown_connections 2024-09-12T01:36:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.659+0000 7ff91a227640 1 -- 172.21.15.60:0/2566893552 wait complete. 2024-09-12T01:36:33.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.660+0000 7ff91a227640 1 Processor -- start 2024-09-12T01:36:33.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.660+0000 7ff91a227640 1 -- start start 2024-09-12T01:36:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.661+0000 7ff91a227640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b6310 0x7ff91413ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.661+0000 7ff91a227640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415c170 0x7ff9140ce500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.661+0000 7ff91a227640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff91415c550 0x7ff914140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.661+0000 7ff91a227640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff91415c990 con 0x7ff9140b6310 2024-09-12T01:36:33.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.661+0000 7ff91a227640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff9140b5b50 con 0x7ff91415c550 2024-09-12T01:36:33.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.661+0000 7ff91a227640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff9140cfdd0 con 0x7ff91415c170 2024-09-12T01:36:33.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.661+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b6310 0x7ff91413ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.661+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b6310 0x7ff91413ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50520/0 (socket says 172.21.15.60:50520) 2024-09-12T01:36:33.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.661+0000 7ff9137fe640 1 -- 172.21.15.60:0/1786381333 learned_addr learned my addr 172.21.15.60:0/1786381333 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:33.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.661+0000 7ff913fff640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff91415c550 0x7ff914140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.661+0000 7ff912ffd640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415c170 0x7ff9140ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.662+0000 7ff9137fe640 1 -- 172.21.15.60:0/1786381333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415c170 msgr2=0x7ff9140ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.662+0000 7ff9137fe640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415c170 0x7ff9140ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.662+0000 7ff9137fe640 1 -- 172.21.15.60:0/1786381333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff91415c550 msgr2=0x7ff914140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.662+0000 7ff9137fe640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff91415c550 0x7ff914140760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.662+0000 7ff9137fe640 1 -- 172.21.15.60:0/1786381333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91415cb10 con 0x7ff9140b6310 2024-09-12T01:36:33.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.662+0000 7ff9137fe640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b6310 0x7ff91413ffd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff90400c4d0 tx=0x7ff90400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.662+0000 7ff8fbfff640 1 -- 172.21.15.60:0/1786381333 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904018070 con 0x7ff9140b6310 2024-09-12T01:36:33.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.662+0000 7ff8fbfff640 1 -- 172.21.15.60:0/1786381333 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff904007500 con 0x7ff9140b6310 2024-09-12T01:36:33.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.662+0000 7ff8fbfff640 1 -- 172.21.15.60:0/1786381333 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904004a20 con 0x7ff9140b6310 2024-09-12T01:36:33.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.662+0000 7ff91a227640 1 -- 172.21.15.60:0/1786381333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91415cdf0 con 0x7ff9140b6310 2024-09-12T01:36:33.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.662+0000 7ff91a227640 1 -- 172.21.15.60:0/1786381333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff91415d3b0 con 0x7ff9140b6310 2024-09-12T01:36:33.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.663+0000 7ff91a227640 1 -- 172.21.15.60:0/1786381333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9140b5dd0 con 0x7ff9140b6310 2024-09-12T01:36:33.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.664+0000 7ff8fbfff640 1 -- 172.21.15.60:0/1786381333 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff90401b070 con 0x7ff9140b6310 2024-09-12T01:36:33.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.664+0000 7ff8fbfff640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff90006be30 0x7ff90006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.664+0000 7ff8fbfff640 1 -- 172.21.15.60:0/1786381333 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7ff904089de0 con 0x7ff9140b6310 2024-09-12T01:36:33.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.664+0000 7ff912ffd640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff90006be30 0x7ff90006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.664+0000 7ff912ffd640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff90006be30 0x7ff90006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff908034000 tx=0x7ff90802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.668+0000 7ff8fbfff640 1 -- 172.21.15.60:0/1786381333 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff904058490 con 0x7ff9140b6310 2024-09-12T01:36:33.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.844+0000 7ff91a227640 1 -- 172.21.15.60:0/1786381333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff914143550 con 0x7ff9140b6310 2024-09-12T01:36:33.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.845+0000 7ff8fbfff640 1 -- 172.21.15.60:0/1786381333 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7ff90405c790 con 0x7ff9140b6310 2024-09-12T01:36:33.844 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:33.844 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T01:36:33.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:36:33.844 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T01:36:33.844 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T01:36:33.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:36:33.845 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T01:36:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.847+0000 7ff91a227640 1 -- 172.21.15.60:0/1786381333 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff90006be30 msgr2=0x7ff90006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.847+0000 7ff91a227640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff90006be30 0x7ff90006e2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff908034000 tx=0x7ff90802e000 comp rx=0 tx=0).stop 2024-09-12T01:36:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.847+0000 7ff91a227640 1 -- 172.21.15.60:0/1786381333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b6310 msgr2=0x7ff91413ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.847+0000 7ff91a227640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b6310 0x7ff91413ffd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff90400c4d0 tx=0x7ff90400c990 comp rx=0 tx=0).stop 2024-09-12T01:36:33.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.847+0000 7ff91a227640 1 -- 172.21.15.60:0/1786381333 shutdown_connections 2024-09-12T01:36:33.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.847+0000 7ff91a227640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff91415c550 0x7ff914140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.847+0000 7ff91a227640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff90006be30 0x7ff90006e2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.847+0000 7ff91a227640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415c170 0x7ff9140ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.847+0000 7ff91a227640 1 --2- 172.21.15.60:0/1786381333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b6310 0x7ff91413ffd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.847+0000 7ff91a227640 1 -- 172.21.15.60:0/1786381333 >> 172.21.15.60:0/1786381333 conn(0x7ff91406bc10 msgr2=0x7ff914070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:33.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.847+0000 7ff91a227640 1 -- 172.21.15.60:0/1786381333 shutdown_connections 2024-09-12T01:36:33.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.847+0000 7ff91a227640 1 -- 172.21.15.60:0/1786381333 wait complete. 2024-09-12T01:36:33.857 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:36:33.857 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:36:33.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.965+0000 7f9550bfd640 1 Processor -- start 2024-09-12T01:36:33.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.965+0000 7f9550bfd640 1 -- start start 2024-09-12T01:36:33.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.966+0000 7f9550bfd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f954c15e990 0x7f954c0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.966+0000 7f9550bfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c162450 0x7f954c162890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.966+0000 7f9550bfd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f954c15ed70 con 0x7f954c162dd0 2024-09-12T01:36:33.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.966+0000 7f9550bfd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f954c0cff20 con 0x7f954c15e990 2024-09-12T01:36:33.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.966+0000 7f9550bfd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f954c163280 con 0x7f954c162450 2024-09-12T01:36:33.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.966+0000 7f954ad9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f954c162dd0 0x7f954c0b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40014/0 (socket says 172.21.15.60:40014) 2024-09-12T01:36:33.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.966+0000 7f954ad9d640 1 -- 172.21.15.60:0/210052784 learned_addr learned my addr 172.21.15.60:0/210052784 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:33.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.966+0000 7f954a59c640 1 --2- 172.21.15.60:0/210052784 >> v2:172.21.15.105:3300/0 conn(0x7f954c15e990 0x7f954c0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.966+0000 7f9549d9b640 1 --2- 172.21.15.60:0/210052784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c162450 0x7f954c162890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.966+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634796474 0 0) 0x7f9544001490 con 0x7f954c162dd0 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.966+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9534003520 con 0x7f954c162dd0 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1260151533 0 0) 0x7f9534003520 con 0x7f954c162dd0 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c162450 msgr2=0x7f954c162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 --2- 172.21.15.60:0/210052784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c162450 0x7f954c162890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 >> v2:172.21.15.105:3300/0 conn(0x7f954c15e990 msgr2=0x7f954c0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 --2- 172.21.15.60:0/210052784 >> v2:172.21.15.105:3300/0 conn(0x7f954c15e990 0x7f954c0b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c0d1fa0 con 0x7f954c162dd0 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f9544001bc0 con 0x7f954c162dd0 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 >> v1:172.21.15.60:6789/0 conn(0x7f954c162dd0 legacy=0x7f954c0b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 --2- 172.21.15.60:0/210052784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c162450 0x7f95340039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 --2- 172.21.15.60:0/210052784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9534003f30 0x7f9534004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 --2- 172.21.15.60:0/210052784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9534004d40 0x7f95340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f954c0cff20 con 0x7f9534004d40 2024-09-12T01:36:33.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f954c163280 con 0x7f9534003f30 2024-09-12T01:36:33.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f953400ba10 con 0x7f954c162450 2024-09-12T01:36:33.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954ad9d640 1 --2- 172.21.15.60:0/210052784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9534004d40 0x7f95340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f9549d9b640 1 --2- 172.21.15.60:0/210052784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9534003f30 0x7f9534004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954a59c640 1 --2- 172.21.15.60:0/210052784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c162450 0x7f95340039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954ad9d640 1 -- 172.21.15.60:0/210052784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c162450 msgr2=0x7f95340039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954ad9d640 1 --2- 172.21.15.60:0/210052784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f954c162450 0x7f95340039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954ad9d640 1 -- 172.21.15.60:0/210052784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9534003f30 msgr2=0x7f9534004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:33.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954ad9d640 1 --2- 172.21.15.60:0/210052784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9534003f30 0x7f9534004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.967+0000 7f954ad9d640 1 -- 172.21.15.60:0/210052784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9534003520 con 0x7f9534004d40 2024-09-12T01:36:33.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.968+0000 7f954ad9d640 1 --2- 172.21.15.60:0/210052784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9534004d40 0x7f95340051c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f954400aaa0 tx=0x7f9534005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec04b93ca4609c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.968+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954400a690 con 0x7f9534004d40 2024-09-12T01:36:33.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.968+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f954402f070 con 0x7f9534004d40 2024-09-12T01:36:33.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.968+0000 7f954959a640 1 -- 172.21.15.60:0/210052784 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544034470 con 0x7f9534004d40 2024-09-12T01:36:33.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.969+0000 7f9550bfd640 1 -- 172.21.15.60:0/210052784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9534004d40 msgr2=0x7f95340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.969+0000 7f9550bfd640 1 --2- 172.21.15.60:0/210052784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9534004d40 0x7f95340051c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f954400aaa0 tx=0x7f9534005830 comp rx=0 tx=0).stop 2024-09-12T01:36:33.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.969+0000 7f954ad9d640 1 -- 172.21.15.60:0/210052784 reap_dead start 2024-09-12T01:36:33.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.969+0000 7f9550bfd640 1 -- 172.21.15.60:0/210052784 shutdown_connections 2024-09-12T01:36:33.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.969+0000 7f9550bfd640 1 -- 172.21.15.60:0/210052784 >> 172.21.15.60:0/210052784 conn(0x7f954c0d1200 msgr2=0x7f954c0d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:33.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.969+0000 7f9550bfd640 1 -- 172.21.15.60:0/210052784 shutdown_connections 2024-09-12T01:36:33.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.969+0000 7f9550bfd640 1 -- 172.21.15.60:0/210052784 wait complete. 2024-09-12T01:36:33.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.970+0000 7f9550bfd640 1 Processor -- start 2024-09-12T01:36:33.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.970+0000 7f9550bfd640 1 -- start start 2024-09-12T01:36:33.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f9550bfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9534004d40 0x7f954c152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f9550bfd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c1f4ea0 0x7f954c0ce530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f9550bfd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c1f5650 0x7f954c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f9550bfd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f954c0d39b0 con 0x7f954c1f5650 2024-09-12T01:36:33.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f9550bfd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f954c0cfc40 con 0x7f954c1f4ea0 2024-09-12T01:36:33.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f9550bfd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f954c0d3b30 con 0x7f9534004d40 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f954ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c1f5650 0x7f954c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f954ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c1f5650 0x7f954c0b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50536/0 (socket says 172.21.15.60:50536) 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f954ad9d640 1 -- 172.21.15.60:0/3815387818 learned_addr learned my addr 172.21.15.60:0/3815387818 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f954a59c640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9534004d40 0x7f954c152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f9549d9b640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c1f4ea0 0x7f954c0ce530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f954ad9d640 1 -- 172.21.15.60:0/3815387818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9534004d40 msgr2=0x7f954c152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f954ad9d640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9534004d40 0x7f954c152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f954ad9d640 1 -- 172.21.15.60:0/3815387818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c1f4ea0 msgr2=0x7f954c0ce530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f954ad9d640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c1f4ea0 0x7f954c0ce530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f954ad9d640 1 -- 172.21.15.60:0/3815387818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c0b5420 con 0x7f954c1f5650 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.971+0000 7f9549d9b640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c1f4ea0 0x7f954c0ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.972+0000 7f954ad9d640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c1f5650 0x7f954c0b61e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f954400aaa0 tx=0x7f9544001f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.972+0000 7f953affd640 1 -- 172.21.15.60:0/3815387818 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9544039070 con 0x7f954c1f5650 2024-09-12T01:36:33.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.972+0000 7f953affd640 1 -- 172.21.15.60:0/3815387818 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9544001bb0 con 0x7f954c1f5650 2024-09-12T01:36:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.972+0000 7f9550bfd640 1 -- 172.21.15.60:0/3815387818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954c0b5700 con 0x7f954c1f5650 2024-09-12T01:36:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.972+0000 7f953affd640 1 -- 172.21.15.60:0/3815387818 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954400a690 con 0x7f954c1f5650 2024-09-12T01:36:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.972+0000 7f9550bfd640 1 -- 172.21.15.60:0/3815387818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954c0b5cc0 con 0x7f954c1f5650 2024-09-12T01:36:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.973+0000 7f9550bfd640 1 -- 172.21.15.60:0/3815387818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f954c162890 con 0x7f954c1f5650 2024-09-12T01:36:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.973+0000 7f953affd640 1 -- 172.21.15.60:0/3815387818 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f954403d030 con 0x7f954c1f5650 2024-09-12T01:36:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.974+0000 7f953affd640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f952c06be60 0x7f952c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.974+0000 7f953affd640 1 -- 172.21.15.60:0/3815387818 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f95440aa8f0 con 0x7f954c1f5650 2024-09-12T01:36:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.974+0000 7f954a59c640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f952c06be60 0x7f952c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:33.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.974+0000 7f954a59c640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f952c06be60 0x7f952c06e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f954c153840 tx=0x7f953c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:33.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:33.978+0000 7f953affd640 1 -- 172.21.15.60:0/3815387818 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9544045060 con 0x7f954c1f5650 2024-09-12T01:36:34.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.155+0000 7f9550bfd640 1 -- 172.21.15.60:0/3815387818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f954c0ba700 con 0x7f954c1f5650 2024-09-12T01:36:34.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.910+0000 7f953affd640 1 -- 172.21.15.60:0/3815387818 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7f954c15ed70 con 0x7f954c1f5650 2024-09-12T01:36:34.909 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-12T01:36:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.913+0000 7f9550bfd640 1 -- 172.21.15.60:0/3815387818 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f952c06be60 msgr2=0x7f952c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.913+0000 7f9550bfd640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f952c06be60 0x7f952c06e320 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f954c153840 tx=0x7f953c008040 comp rx=0 tx=0).stop 2024-09-12T01:36:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.913+0000 7f9550bfd640 1 -- 172.21.15.60:0/3815387818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c1f5650 msgr2=0x7f954c0b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.913+0000 7f9550bfd640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c1f5650 0x7f954c0b61e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f954400aaa0 tx=0x7f9544001f90 comp rx=0 tx=0).stop 2024-09-12T01:36:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.914+0000 7f9550bfd640 1 -- 172.21.15.60:0/3815387818 shutdown_connections 2024-09-12T01:36:34.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.914+0000 7f9550bfd640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f954c1f5650 0x7f954c0b61e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:34.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.914+0000 7f9550bfd640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f954c1f4ea0 0x7f954c0ce530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:34.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.914+0000 7f9550bfd640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f952c06be60 0x7f952c06e320 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:34.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.914+0000 7f9550bfd640 1 --2- 172.21.15.60:0/3815387818 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9534004d40 0x7f954c152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:34.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.914+0000 7f9550bfd640 1 -- 172.21.15.60:0/3815387818 >> 172.21.15.60:0/3815387818 conn(0x7f954c0d1200 msgr2=0x7f954c0b79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:34.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.914+0000 7f9550bfd640 1 -- 172.21.15.60:0/3815387818 shutdown_connections 2024-09-12T01:36:34.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:34.914+0000 7f9550bfd640 1 -- 172.21.15.60:0/3815387818 wait complete. 2024-09-12T01:36:34.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:36:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.047+0000 7f6e4e9b7640 1 Processor -- start 2024-09-12T01:36:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.047+0000 7f6e4e9b7640 1 -- start start 2024-09-12T01:36:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.048+0000 7f6e4e9b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6e4815a060 0x7f6e4806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.048+0000 7f6e4e9b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e480b1990 0x7f6e4806f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.048+0000 7f6e4e9b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e48071770 con 0x7f6e4815d3d0 2024-09-12T01:36:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.048+0000 7f6e4e9b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6e480712e0 con 0x7f6e4815a060 2024-09-12T01:36:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.048+0000 7f6e4e9b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6e480709b0 con 0x7f6e480b1990 2024-09-12T01:36:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.048+0000 7f6e3ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6e4815d3d0 0x7f6e4815ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40016/0 (socket says 172.21.15.60:40016) 2024-09-12T01:36:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.048+0000 7f6e3ffff640 1 -- 172.21.15.60:0/1902407421 learned_addr learned my addr 172.21.15.60:0/1902407421 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e47fff640 1 --2- 172.21.15.60:0/1902407421 >> v2:172.21.15.105:3300/0 conn(0x7f6e4815a060 0x7f6e4806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e4cf54640 1 --2- 172.21.15.60:0/1902407421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e480b1990 0x7f6e4806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147314813 0 0) 0x7f6e48071770 con 0x7f6e4815d3d0 2024-09-12T01:36:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e34003520 con 0x7f6e4815d3d0 2024-09-12T01:36:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2226164570 0 0) 0x7f6e34003520 con 0x7f6e4815d3d0 2024-09-12T01:36:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e480b1990 msgr2=0x7f6e4806f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 --2- 172.21.15.60:0/1902407421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e480b1990 0x7f6e4806f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 >> v2:172.21.15.105:3300/0 conn(0x7f6e4815a060 msgr2=0x7f6e4806f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 --2- 172.21.15.60:0/1902407421 >> v2:172.21.15.105:3300/0 conn(0x7f6e4815a060 0x7f6e4806f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e48070c90 con 0x7f6e4815d3d0 2024-09-12T01:36:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f6e30001670 con 0x7f6e4815d3d0 2024-09-12T01:36:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 >> v1:172.21.15.60:6789/0 conn(0x7f6e4815d3d0 legacy=0x7f6e4815ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 --2- 172.21.15.60:0/1902407421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e340039b0 0x7f6e34003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 --2- 172.21.15.60:0/1902407421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e480b1990 0x7f6e34004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 --2- 172.21.15.60:0/1902407421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e34004d40 0x7f6e340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6e480712e0 con 0x7f6e34004d40 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6e480709b0 con 0x7f6e340039b0 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3400b9c0 con 0x7f6e480b1990 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e4cf54640 1 --2- 172.21.15.60:0/1902407421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e34004d40 0x7f6e340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e47fff640 1 --2- 172.21.15.60:0/1902407421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e340039b0 0x7f6e34003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e3ffff640 1 --2- 172.21.15.60:0/1902407421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e480b1990 0x7f6e34004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e4cf54640 1 -- 172.21.15.60:0/1902407421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e480b1990 msgr2=0x7f6e34004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e4cf54640 1 --2- 172.21.15.60:0/1902407421 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e480b1990 0x7f6e34004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e4cf54640 1 -- 172.21.15.60:0/1902407421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e340039b0 msgr2=0x7f6e34003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e4cf54640 1 --2- 172.21.15.60:0/1902407421 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e340039b0 0x7f6e34003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.049+0000 7f6e4cf54640 1 -- 172.21.15.60:0/1902407421 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e34003520 con 0x7f6e34004d40 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.050+0000 7f6e4cf54640 1 --2- 172.21.15.60:0/1902407421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e34004d40 0x7f6e340051c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009fc0 tx=0x7f6e34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e71fbaea0beb510 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.050+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40009c10 con 0x7f6e34004d40 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.050+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e40036070 con 0x7f6e34004d40 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.050+0000 7f6e477fe640 1 -- 172.21.15.60:0/1902407421 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40031880 con 0x7f6e34004d40 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.051+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/1902407421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e34004d40 msgr2=0x7f6e340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.051+0000 7f6e4e9b7640 1 --2- 172.21.15.60:0/1902407421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e34004d40 0x7f6e340051c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6e40009fc0 tx=0x7f6e34005830 comp rx=0 tx=0).stop 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.051+0000 7f6e4cf54640 1 -- 172.21.15.60:0/1902407421 reap_dead start 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.051+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/1902407421 shutdown_connections 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.051+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/1902407421 >> 172.21.15.60:0/1902407421 conn(0x7f6e480d2430 msgr2=0x7f6e480d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.051+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/1902407421 shutdown_connections 2024-09-12T01:36:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.051+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/1902407421 wait complete. 2024-09-12T01:36:35.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.052+0000 7f6e4e9b7640 1 Processor -- start 2024-09-12T01:36:35.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.052+0000 7f6e4e9b7640 1 -- start start 2024-09-12T01:36:35.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4e9b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e34004d40 0x7f6e4814dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4e9b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e48152650 0x7f6e48152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4e9b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e48156330 0x7f6e481567b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4e9b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6e480d1460 con 0x7f6e48156330 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4e9b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6e480d12e0 con 0x7f6e34004d40 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4e9b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6e4806feb0 con 0x7f6e48152650 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4cf54640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e48156330 0x7f6e481567b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4cf54640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e48156330 0x7f6e481567b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50556/0 (socket says 172.21.15.60:50556) 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4cf54640 1 -- 172.21.15.60:0/3677464197 learned_addr learned my addr 172.21.15.60:0/3677464197 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e3ffff640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e48152650 0x7f6e48152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e47fff640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e34004d40 0x7f6e4814dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4cf54640 1 -- 172.21.15.60:0/3677464197 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e48152650 msgr2=0x7f6e48152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4cf54640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e48152650 0x7f6e48152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4cf54640 1 -- 172.21.15.60:0/3677464197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e34004d40 msgr2=0x7f6e4814dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4cf54640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e34004d40 0x7f6e4814dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e4cf54640 1 -- 172.21.15.60:0/3677464197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e4815ecc0 con 0x7f6e48156330 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e47fff640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e34004d40 0x7f6e4814dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:35.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.053+0000 7f6e3ffff640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e48152650 0x7f6e48152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.054+0000 7f6e4cf54640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e48156330 0x7f6e481567b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6e40033040 tx=0x7f6e40009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.054+0000 7f6e457fa640 1 -- 172.21.15.60:0/3677464197 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40009c10 con 0x7f6e48156330 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.054+0000 7f6e457fa640 1 -- 172.21.15.60:0/3677464197 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e40031dd0 con 0x7f6e48156330 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.054+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/3677464197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e4815d940 con 0x7f6e48156330 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.054+0000 7f6e457fa640 1 -- 172.21.15.60:0/3677464197 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40003bd0 con 0x7f6e48156330 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.054+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/3677464197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e4815df00 con 0x7f6e48156330 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.055+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/3677464197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e4806c6c0 con 0x7f6e48156330 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.055+0000 7f6e457fa640 1 -- 172.21.15.60:0/3677464197 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e40005d10 con 0x7f6e48156330 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.056+0000 7f6e457fa640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e2806be60 0x7f6e2806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.056+0000 7f6e47fff640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e2806be60 0x7f6e2806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.056+0000 7f6e457fa640 1 -- 172.21.15.60:0/3677464197 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7f6e400ac3a0 con 0x7f6e48156330 2024-09-12T01:36:35.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.057+0000 7f6e47fff640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e2806be60 0x7f6e2806e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009bc0 tx=0x7f6e38008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:35.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.061+0000 7f6e457fa640 1 -- 172.21.15.60:0/3677464197 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e4004a060 con 0x7f6e48156330 2024-09-12T01:36:35.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.235+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/3677464197 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f6e4806f2f0 con 0x7f6e48156330 2024-09-12T01:36:35.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.912+0000 7f6e457fa640 1 -- 172.21.15.60:0/3677464197 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7f6e4007af30 con 0x7f6e48156330 2024-09-12T01:36:35.912 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-12T01:36:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.917+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/3677464197 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e2806be60 msgr2=0x7f6e2806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:35.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.917+0000 7f6e4e9b7640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e2806be60 0x7f6e2806e320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009bc0 tx=0x7f6e38008040 comp rx=0 tx=0).stop 2024-09-12T01:36:35.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.917+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/3677464197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e48156330 msgr2=0x7f6e481567b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:35.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.917+0000 7f6e4e9b7640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e48156330 0x7f6e481567b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6e40033040 tx=0x7f6e40009750 comp rx=0 tx=0).stop 2024-09-12T01:36:35.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.917+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/3677464197 shutdown_connections 2024-09-12T01:36:35.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.917+0000 7f6e4e9b7640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e48156330 0x7f6e481567b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.917+0000 7f6e4e9b7640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e2806be60 0x7f6e2806e320 secure :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6e38009bc0 tx=0x7f6e38008040 comp rx=0 tx=0).stop 2024-09-12T01:36:35.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.917+0000 7f6e4e9b7640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e48152650 0x7f6e48152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.917+0000 7f6e4e9b7640 1 --2- 172.21.15.60:0/3677464197 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e34004d40 0x7f6e4814dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:35.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.918+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/3677464197 >> 172.21.15.60:0/3677464197 conn(0x7f6e480d2430 msgr2=0x7f6e48158a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.927+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/3677464197 shutdown_connections 2024-09-12T01:36:35.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:35.929+0000 7f6e4e9b7640 1 -- 172.21.15.60:0/3677464197 wait complete. 2024-09-12T01:36:35.946 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:36:36.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.059+0000 7fe69cd86640 1 Processor -- start 2024-09-12T01:36:36.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.060+0000 7fe69cd86640 1 -- start start 2024-09-12T01:36:36.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.060+0000 7fe69cd86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe69815e7a0 0x7fe69806caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.061+0000 7fe69cd86640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe6980b68f0 0x7fe6980d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.061+0000 7fe69cd86640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6980cf860 con 0x7fe6980cf1f0 2024-09-12T01:36:36.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.061+0000 7fe69cd86640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe6980d2ca0 con 0x7fe6980b68f0 2024-09-12T01:36:36.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.061+0000 7fe69cd86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe6980cfb40 con 0x7fe69815e7a0 2024-09-12T01:36:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.061+0000 7fe696d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe6980b68f0 0x7fe6980d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.061+0000 7fe695d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe6980cf1f0 0x7fe6980b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40030/0 (socket says 172.21.15.60:40030) 2024-09-12T01:36:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.061+0000 7fe695d9b640 1 -- 172.21.15.60:0/2117921030 learned_addr learned my addr 172.21.15.60:0/2117921030 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.061+0000 7fe69659c640 1 --2- 172.21.15.60:0/2117921030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe69815e7a0 0x7fe69806caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.061+0000 7fe696d9d640 1 -- 172.21.15.60:0/2117921030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe69815e7a0 msgr2=0x7fe69806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.061+0000 7fe696d9d640 1 --2- 172.21.15.60:0/2117921030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe69815e7a0 0x7fe69806caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.061+0000 7fe696d9d640 1 -- 172.21.15.60:0/2117921030 >> v1:172.21.15.60:6789/0 conn(0x7fe6980cf1f0 legacy=0x7fe6980b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.061+0000 7fe696d9d640 1 -- 172.21.15.60:0/2117921030 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6980cfe20 con 0x7fe6980b68f0 2024-09-12T01:36:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.062+0000 7fe696d9d640 1 --2- 172.21.15.60:0/2117921030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6980b68f0 0x7fe6980d3410 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe690009d90 tx=0x7fe69002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51b4ca1f21e6780 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.062+0000 7fe69559a640 1 -- 172.21.15.60:0/2117921030 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690031600 con 0x7fe6980b68f0 2024-09-12T01:36:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.062+0000 7fe69559a640 1 -- 172.21.15.60:0/2117921030 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6900317a0 con 0x7fe6980b68f0 2024-09-12T01:36:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.062+0000 7fe69559a640 1 -- 172.21.15.60:0/2117921030 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690031b70 con 0x7fe6980b68f0 2024-09-12T01:36:36.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.062+0000 7fe69cd86640 1 -- 172.21.15.60:0/2117921030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6980b68f0 msgr2=0x7fe6980d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.062+0000 7fe69cd86640 1 --2- 172.21.15.60:0/2117921030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6980b68f0 0x7fe6980d3410 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe690009d90 tx=0x7fe69002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.063+0000 7fe69cd86640 1 -- 172.21.15.60:0/2117921030 shutdown_connections 2024-09-12T01:36:36.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.063+0000 7fe69cd86640 1 --2- 172.21.15.60:0/2117921030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6980b68f0 0x7fe6980d3410 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.063+0000 7fe69cd86640 1 --2- 172.21.15.60:0/2117921030 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe69815e7a0 0x7fe69806caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.063+0000 7fe69cd86640 1 -- 172.21.15.60:0/2117921030 >> 172.21.15.60:0/2117921030 conn(0x7fe6980d11e0 msgr2=0x7fe6980d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:36.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.063+0000 7fe69cd86640 1 -- 172.21.15.60:0/2117921030 shutdown_connections 2024-09-12T01:36:36.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.063+0000 7fe69cd86640 1 -- 172.21.15.60:0/2117921030 wait complete. 2024-09-12T01:36:36.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.064+0000 7fe69cd86640 1 Processor -- start 2024-09-12T01:36:36.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.064+0000 7fe69cd86640 1 -- start start 2024-09-12T01:36:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe69cd86640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6980b68f0 0x7fe6981f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe69cd86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6980cf1f0 0x7fe6980cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe69cd86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69815e7a0 0x7fe698159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe69cd86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe69806cfe0 con 0x7fe69815e7a0 2024-09-12T01:36:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe69cd86640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe6980b7a00 con 0x7fe6980b68f0 2024-09-12T01:36:36.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe69cd86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe69815eb80 con 0x7fe6980cf1f0 2024-09-12T01:36:36.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe696d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69815e7a0 0x7fe698159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe696d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69815e7a0 0x7fe698159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50562/0 (socket says 172.21.15.60:50562) 2024-09-12T01:36:36.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe696d9d640 1 -- 172.21.15.60:0/2029647126 learned_addr learned my addr 172.21.15.60:0/2029647126 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:36.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe695d9b640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6980cf1f0 0x7fe6980cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe69659c640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6980b68f0 0x7fe6981f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe696d9d640 1 -- 172.21.15.60:0/2029647126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6980cf1f0 msgr2=0x7fe6980cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe696d9d640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6980cf1f0 0x7fe6980cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe696d9d640 1 -- 172.21.15.60:0/2029647126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6980b68f0 msgr2=0x7fe6981f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe696d9d640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6980b68f0 0x7fe6981f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe696d9d640 1 -- 172.21.15.60:0/2029647126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe69815fff0 con 0x7fe69815e7a0 2024-09-12T01:36:36.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.065+0000 7fe69659c640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6980b68f0 0x7fe6981f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:36.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.066+0000 7fe696d9d640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69815e7a0 0x7fe698159590 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe690009eb0 tx=0x7fe690004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:36.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.066+0000 7fe686ffd640 1 -- 172.21.15.60:0/2029647126 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69003f070 con 0x7fe69815e7a0 2024-09-12T01:36:36.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.066+0000 7fe686ffd640 1 -- 172.21.15.60:0/2029647126 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe690030b60 con 0x7fe69815e7a0 2024-09-12T01:36:36.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.066+0000 7fe686ffd640 1 -- 172.21.15.60:0/2029647126 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690009450 con 0x7fe69815e7a0 2024-09-12T01:36:36.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.066+0000 7fe69cd86640 1 -- 172.21.15.60:0/2029647126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6981602b0 con 0x7fe69815e7a0 2024-09-12T01:36:36.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.066+0000 7fe69cd86640 1 -- 172.21.15.60:0/2029647126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe698160870 con 0x7fe69815e7a0 2024-09-12T01:36:36.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.067+0000 7fe69cd86640 1 -- 172.21.15.60:0/2029647126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe698160c50 con 0x7fe69815e7a0 2024-09-12T01:36:36.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.068+0000 7fe686ffd640 1 -- 172.21.15.60:0/2029647126 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe69003b410 con 0x7fe69815e7a0 2024-09-12T01:36:36.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.068+0000 7fe686ffd640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe67806be30 0x7fe67806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:36.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.068+0000 7fe686ffd640 1 -- 172.21.15.60:0/2029647126 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7fe6900ac290 con 0x7fe69815e7a0 2024-09-12T01:36:36.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.068+0000 7fe69659c640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe67806be30 0x7fe67806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:36.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.069+0000 7fe69659c640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe67806be30 0x7fe67806e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe688006fd0 tx=0x7fe688008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:36.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.073+0000 7fe686ffd640 1 -- 172.21.15.60:0/2029647126 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe698160c50 con 0x7fe69815e7a0 2024-09-12T01:36:36.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.283+0000 7fe69cd86640 1 -- 172.21.15.60:0/2029647126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe69806caa0 con 0x7fe69815e7a0 2024-09-12T01:36:36.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.928+0000 7fe686ffd640 1 -- 172.21.15.60:0/2029647126 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7fe69007ad30 con 0x7fe69815e7a0 2024-09-12T01:36:36.928 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 4 and data pool 5 2024-09-12T01:36:36.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.932+0000 7fe69cd86640 1 -- 172.21.15.60:0/2029647126 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe67806be30 msgr2=0x7fe67806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.932+0000 7fe69cd86640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe67806be30 0x7fe67806e2f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe688006fd0 tx=0x7fe688008040 comp rx=0 tx=0).stop 2024-09-12T01:36:36.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.932+0000 7fe69cd86640 1 -- 172.21.15.60:0/2029647126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69815e7a0 msgr2=0x7fe698159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:36.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.932+0000 7fe69cd86640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69815e7a0 0x7fe698159590 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe690009eb0 tx=0x7fe690004a40 comp rx=0 tx=0).stop 2024-09-12T01:36:36.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.932+0000 7fe69cd86640 1 -- 172.21.15.60:0/2029647126 shutdown_connections 2024-09-12T01:36:36.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.932+0000 7fe69cd86640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe69815e7a0 0x7fe698159590 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.932+0000 7fe69cd86640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe67806be30 0x7fe67806e2f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.932+0000 7fe69cd86640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6980cf1f0 0x7fe6980cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.932+0000 7fe69cd86640 1 --2- 172.21.15.60:0/2029647126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe6980b68f0 0x7fe6981f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:36.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.932+0000 7fe69cd86640 1 -- 172.21.15.60:0/2029647126 >> 172.21.15.60:0/2029647126 conn(0x7fe6980d11e0 msgr2=0x7fe6980d3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:36.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.933+0000 7fe69cd86640 1 -- 172.21.15.60:0/2029647126 shutdown_connections 2024-09-12T01:36:36.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:36.933+0000 7fe69cd86640 1 -- 172.21.15.60:0/2029647126 wait complete. 2024-09-12T01:36:36.959 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:36:37.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.064+0000 7fae69ae4640 1 Processor -- start 2024-09-12T01:36:37.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.064+0000 7fae69ae4640 1 -- start start 2024-09-12T01:36:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.065+0000 7fae69ae4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fae640d1b40 0x7fae641618a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.065+0000 7fae69ae4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae640708d0 con 0x7fae640b6eb0 2024-09-12T01:36:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.065+0000 7fae69ae4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae64070bb0 con 0x7fae640b7290 2024-09-12T01:36:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.065+0000 7fae69ae4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fae64070e90 con 0x7fae640d1b40 2024-09-12T01:36:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.065+0000 7fae637fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fae640b6eb0 0x7fae6406fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40040/0 (socket says 172.21.15.60:40040) 2024-09-12T01:36:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.065+0000 7fae637fe640 1 -- 172.21.15.60:0/1402799131 learned_addr learned my addr 172.21.15.60:0/1402799131 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.065+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277698433 0 0) 0x7fae640708d0 con 0x7fae640b6eb0 2024-09-12T01:36:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.065+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae4c003520 con 0x7fae640b6eb0 2024-09-12T01:36:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.065+0000 7fae62ffd640 1 --2- 172.21.15.60:0/1402799131 >> v2:172.21.15.105:3300/0 conn(0x7fae640d1b40 0x7fae641618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1985056915 0 0) 0x7fae4c003520 con 0x7fae640b6eb0 2024-09-12T01:36:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 >> v2:172.21.15.105:3300/0 conn(0x7fae640d1b40 msgr2=0x7fae641618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 --2- 172.21.15.60:0/1402799131 >> v2:172.21.15.105:3300/0 conn(0x7fae640d1b40 0x7fae641618a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 >> v1:172.21.15.105:6789/0 conn(0x7fae640b7290 legacy=0x7fae64161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae64071170 con 0x7fae640b6eb0 2024-09-12T01:36:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fae54001670 con 0x7fae640b6eb0 2024-09-12T01:36:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 >> v1:172.21.15.60:6789/0 conn(0x7fae640b6eb0 legacy=0x7fae6406fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 --2- 172.21.15.60:0/1402799131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae4c0039b0 0x7fae4c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 --2- 172.21.15.60:0/1402799131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae4c004800 0x7fae4c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 --2- 172.21.15.60:0/1402799131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae4c0052e0 0x7fae4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fae64070e90 con 0x7fae4c0039b0 2024-09-12T01:36:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fae4c00c1b0 con 0x7fae4c004800 2024-09-12T01:36:37.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fae4c00c3b0 con 0x7fae4c0052e0 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae637fe640 1 --2- 172.21.15.60:0/1402799131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae4c0039b0 0x7fae4c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae62ffd640 1 --2- 172.21.15.60:0/1402799131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae4c004800 0x7fae4c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae63fff640 1 --2- 172.21.15.60:0/1402799131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae4c0052e0 0x7fae4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae637fe640 1 -- 172.21.15.60:0/1402799131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae4c0052e0 msgr2=0x7fae4c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae637fe640 1 --2- 172.21.15.60:0/1402799131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae4c0052e0 0x7fae4c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae637fe640 1 -- 172.21.15.60:0/1402799131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae4c004800 msgr2=0x7fae4c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae637fe640 1 --2- 172.21.15.60:0/1402799131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae4c004800 0x7fae4c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae637fe640 1 -- 172.21.15.60:0/1402799131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4c003520 con 0x7fae4c0039b0 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae63fff640 1 -- 172.21.15.60:0/1402799131 reap_dead start 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.066+0000 7fae62ffd640 1 --2- 172.21.15.60:0/1402799131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae4c004800 0x7fae4c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.067+0000 7fae637fe640 1 --2- 172.21.15.60:0/1402799131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae4c0039b0 0x7fae4c003dd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fae5400c210 tx=0x7fae4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a351ad9e01bd86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.067+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae54007cf0 con 0x7fae4c0039b0 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.067+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae54005ad0 con 0x7fae4c0039b0 2024-09-12T01:36:37.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.067+0000 7fae627fc640 1 -- 172.21.15.60:0/1402799131 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae54007070 con 0x7fae4c0039b0 2024-09-12T01:36:37.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.067+0000 7fae69ae4640 1 -- 172.21.15.60:0/1402799131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae4c0039b0 msgr2=0x7fae4c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.067+0000 7fae69ae4640 1 --2- 172.21.15.60:0/1402799131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae4c0039b0 0x7fae4c003dd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fae5400c210 tx=0x7fae4c005830 comp rx=0 tx=0).stop 2024-09-12T01:36:37.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.067+0000 7fae69ae4640 1 -- 172.21.15.60:0/1402799131 shutdown_connections 2024-09-12T01:36:37.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.067+0000 7fae69ae4640 1 --2- 172.21.15.60:0/1402799131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae4c0039b0 0x7fae4c003dd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.068+0000 7fae69ae4640 1 -- 172.21.15.60:0/1402799131 >> 172.21.15.60:0/1402799131 conn(0x7fae640d2450 msgr2=0x7fae640d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:37.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.068+0000 7fae69ae4640 1 -- 172.21.15.60:0/1402799131 shutdown_connections 2024-09-12T01:36:37.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.068+0000 7fae69ae4640 1 -- 172.21.15.60:0/1402799131 wait complete. 2024-09-12T01:36:37.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.069+0000 7fae69ae4640 1 Processor -- start 2024-09-12T01:36:37.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.069+0000 7fae69ae4640 1 -- start start 2024-09-12T01:36:37.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae69ae4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae4c0039b0 0x7fae6415ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae69ae4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae64144dc0 0x7fae64144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae69ae4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae64141a20 0x7fae641445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae69ae4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fae64071af0 con 0x7fae64144dc0 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae69ae4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fae64071970 con 0x7fae64141a20 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae69ae4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fae6406fd00 con 0x7fae4c0039b0 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae62ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae64144dc0 0x7fae64144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae62ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae64144dc0 0x7fae64144080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50570/0 (socket says 172.21.15.60:50570) 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae62ffd640 1 -- 172.21.15.60:0/91287567 learned_addr learned my addr 172.21.15.60:0/91287567 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae637fe640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae4c0039b0 0x7fae6415ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae63fff640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae64141a20 0x7fae641445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae62ffd640 1 -- 172.21.15.60:0/91287567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae4c0039b0 msgr2=0x7fae6415ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae62ffd640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae4c0039b0 0x7fae6415ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae62ffd640 1 -- 172.21.15.60:0/91287567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae64141a20 msgr2=0x7fae641445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae62ffd640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae64141a20 0x7fae641445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae62ffd640 1 -- 172.21.15.60:0/91287567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae6415f750 con 0x7fae64144dc0 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae637fe640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae4c0039b0 0x7fae6415ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae63fff640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae64141a20 0x7fae641445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae62ffd640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae64144dc0 0x7fae64144080 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fae58011540 tx=0x7fae58011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae4bfff640 1 -- 172.21.15.60:0/91287567 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae58015870 con 0x7fae64144dc0 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae4bfff640 1 -- 172.21.15.60:0/91287567 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae58015a10 con 0x7fae64144dc0 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae4bfff640 1 -- 172.21.15.60:0/91287567 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae58015e00 con 0x7fae64144dc0 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae69ae4640 1 -- 172.21.15.60:0/91287567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae641571f0 con 0x7fae64144dc0 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.070+0000 7fae69ae4640 1 -- 172.21.15.60:0/91287567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6415f9f0 con 0x7fae64144dc0 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.071+0000 7fae69ae4640 1 -- 172.21.15.60:0/91287567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae64070090 con 0x7fae64144dc0 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.072+0000 7fae4bfff640 1 -- 172.21.15.60:0/91287567 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fae5801d400 con 0x7fae64144dc0 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.072+0000 7fae4bfff640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fae5006be60 0x7fae5006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.072+0000 7fae4bfff640 1 -- 172.21.15.60:0/91287567 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fae5808b420 con 0x7fae64144dc0 2024-09-12T01:36:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.073+0000 7fae637fe640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fae5006be60 0x7fae5006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.073+0000 7fae637fe640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fae5006be60 0x7fae5006e320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fae54032000 tx=0x7fae54009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:37.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.077+0000 7fae4bfff640 1 -- 172.21.15.60:0/91287567 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fae58019030 con 0x7fae64144dc0 2024-09-12T01:36:37.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.253+0000 7fae69ae4640 1 -- 172.21.15.60:0/91287567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fae640b19b0 con 0x7fae64144dc0 2024-09-12T01:36:37.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.254+0000 7fae4bfff640 1 -- 172.21.15.60:0/91287567 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16646 (secure 0 0 0) 0x7fae58059e60 con 0x7fae64144dc0 2024-09-12T01:36:37.254 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:37.254 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":33,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:36:36.284442+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:36:34.185888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T01:36:35.265632+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:36:37.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.256+0000 7fae69ae4640 1 -- 172.21.15.60:0/91287567 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fae5006be60 msgr2=0x7fae5006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.256+0000 7fae69ae4640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fae5006be60 0x7fae5006e320 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fae54032000 tx=0x7fae54009030 comp rx=0 tx=0).stop 2024-09-12T01:36:37.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.256+0000 7fae69ae4640 1 -- 172.21.15.60:0/91287567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae64144dc0 msgr2=0x7fae64144080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.256+0000 7fae69ae4640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae64144dc0 0x7fae64144080 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fae58011540 tx=0x7fae58011a00 comp rx=0 tx=0).stop 2024-09-12T01:36:37.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.256+0000 7fae69ae4640 1 -- 172.21.15.60:0/91287567 shutdown_connections 2024-09-12T01:36:37.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.256+0000 7fae69ae4640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae64141a20 0x7fae641445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.256+0000 7fae69ae4640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae64144dc0 0x7fae64144080 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.256+0000 7fae69ae4640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fae5006be60 0x7fae5006e320 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.256+0000 7fae69ae4640 1 --2- 172.21.15.60:0/91287567 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae4c0039b0 0x7fae6415ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.256+0000 7fae69ae4640 1 -- 172.21.15.60:0/91287567 >> 172.21.15.60:0/91287567 conn(0x7fae640d2450 msgr2=0x7fae640b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:37.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.256+0000 7fae69ae4640 1 -- 172.21.15.60:0/91287567 shutdown_connections 2024-09-12T01:36:37.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.256+0000 7fae69ae4640 1 -- 172.21.15.60:0/91287567 wait complete. 2024-09-12T01:36:37.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:36:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.370+0000 7f9c5d2af640 1 Processor -- start 2024-09-12T01:36:37.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.370+0000 7f9c5d2af640 1 -- start start 2024-09-12T01:36:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.371+0000 7f9c5d2af640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c58073ce0 0x7f9c58169260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.371+0000 7f9c5d2af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c5815eb10 con 0x7f9c5806e910 2024-09-12T01:36:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.371+0000 7f9c5d2af640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c5815edd0 con 0x7f9c5815c100 2024-09-12T01:36:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.371+0000 7f9c5d2af640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9c58074170 con 0x7f9c58073ce0 2024-09-12T01:36:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.371+0000 7f9c577fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c58073ce0 0x7f9c58169260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.371+0000 7f9c567fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9c5806e910 0x7f9c580735d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40048/0 (socket says 172.21.15.60:40048) 2024-09-12T01:36:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.371+0000 7f9c567fc640 1 -- 172.21.15.60:0/3943827904 learned_addr learned my addr 172.21.15.60:0/3943827904 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.372+0000 7f9c577fe640 1 -- 172.21.15.60:0/3943827904 >> v1:172.21.15.105:6789/0 conn(0x7f9c5815c100 legacy=0x7f9c5806e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:37.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.372+0000 7f9c577fe640 1 -- 172.21.15.60:0/3943827904 >> v1:172.21.15.60:6789/0 conn(0x7f9c5806e910 legacy=0x7f9c580735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.372+0000 7f9c577fe640 1 -- 172.21.15.60:0/3943827904 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5815f0b0 con 0x7f9c58073ce0 2024-09-12T01:36:37.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.372+0000 7f9c577fe640 1 --2- 172.21.15.60:0/3943827904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c58073ce0 0x7f9c58169260 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009d90 tx=0x7f9c4802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51377cfddf017554 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:37.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.373+0000 7f9c55ffb640 1 -- 172.21.15.60:0/3943827904 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48007740 con 0x7f9c58073ce0 2024-09-12T01:36:37.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.373+0000 7f9c55ffb640 1 -- 172.21.15.60:0/3943827904 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c480078e0 con 0x7f9c58073ce0 2024-09-12T01:36:37.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.373+0000 7f9c55ffb640 1 -- 172.21.15.60:0/3943827904 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48007cb0 con 0x7f9c58073ce0 2024-09-12T01:36:37.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.373+0000 7f9c5d2af640 1 -- 172.21.15.60:0/3943827904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c58073ce0 msgr2=0x7f9c58169260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.373+0000 7f9c5d2af640 1 --2- 172.21.15.60:0/3943827904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c58073ce0 0x7f9c58169260 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009d90 tx=0x7f9c4802a6a0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.373+0000 7f9c5d2af640 1 -- 172.21.15.60:0/3943827904 shutdown_connections 2024-09-12T01:36:37.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.373+0000 7f9c5d2af640 1 --2- 172.21.15.60:0/3943827904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c58073ce0 0x7f9c58169260 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.373+0000 7f9c5d2af640 1 -- 172.21.15.60:0/3943827904 >> 172.21.15.60:0/3943827904 conn(0x7f9c580b6ec0 msgr2=0x7f9c580b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:37.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.373+0000 7f9c5d2af640 1 -- 172.21.15.60:0/3943827904 shutdown_connections 2024-09-12T01:36:37.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.373+0000 7f9c5d2af640 1 -- 172.21.15.60:0/3943827904 wait complete. 2024-09-12T01:36:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.375+0000 7f9c5d2af640 1 Processor -- start 2024-09-12T01:36:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.375+0000 7f9c5d2af640 1 -- start start 2024-09-12T01:36:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.375+0000 7f9c5d2af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c5806e910 0x7f9c5814efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.375+0000 7f9c5d2af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c58073ce0 0x7f9c5815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.375+0000 7f9c5d2af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c5815c100 0x7f9c580afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.375+0000 7f9c5d2af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5815c4e0 con 0x7f9c5815c100 2024-09-12T01:36:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.375+0000 7f9c5d2af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5815f670 con 0x7f9c5806e910 2024-09-12T01:36:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.375+0000 7f9c5d2af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9c580b5380 con 0x7f9c58073ce0 2024-09-12T01:36:37.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.375+0000 7f9c577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c5815c100 0x7f9c580afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c5815c100 0x7f9c580afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50592/0 (socket says 172.21.15.60:50592) 2024-09-12T01:36:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c577fe640 1 -- 172.21.15.60:0/2134593204 learned_addr learned my addr 172.21.15.60:0/2134593204 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c567fc640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c58073ce0 0x7f9c5815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c56ffd640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c5806e910 0x7f9c5814efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c577fe640 1 -- 172.21.15.60:0/2134593204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c58073ce0 msgr2=0x7f9c5815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c577fe640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c58073ce0 0x7f9c5815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c577fe640 1 -- 172.21.15.60:0/2134593204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c5806e910 msgr2=0x7f9c5814efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c577fe640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c5806e910 0x7f9c5814efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c577fe640 1 -- 172.21.15.60:0/2134593204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5815b8d0 con 0x7f9c5815c100 2024-09-12T01:36:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c577fe640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c5815c100 0x7f9c580afda0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009d90 tx=0x7f9c48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:37.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c4f7fe640 1 -- 172.21.15.60:0/2134593204 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48040070 con 0x7f9c5815c100 2024-09-12T01:36:37.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c4f7fe640 1 -- 172.21.15.60:0/2134593204 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c48031c90 con 0x7f9c5815c100 2024-09-12T01:36:37.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c5d2af640 1 -- 172.21.15.60:0/2134593204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c580cfc10 con 0x7f9c5815c100 2024-09-12T01:36:37.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c4f7fe640 1 -- 172.21.15.60:0/2134593204 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4803c640 con 0x7f9c5815c100 2024-09-12T01:36:37.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.376+0000 7f9c5d2af640 1 -- 172.21.15.60:0/2134593204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c580d01d0 con 0x7f9c5815c100 2024-09-12T01:36:37.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.377+0000 7f9c5d2af640 1 -- 172.21.15.60:0/2134593204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c580735d0 con 0x7f9c5815c100 2024-09-12T01:36:37.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.378+0000 7f9c4f7fe640 1 -- 172.21.15.60:0/2134593204 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c48039040 con 0x7f9c5815c100 2024-09-12T01:36:37.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.378+0000 7f9c4f7fe640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9c3806be30 0x7f9c3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.378+0000 7f9c4f7fe640 1 -- 172.21.15.60:0/2134593204 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f9c480ac340 con 0x7f9c5815c100 2024-09-12T01:36:37.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.378+0000 7f9c56ffd640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9c3806be30 0x7f9c3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.379+0000 7f9c56ffd640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9c3806be30 0x7f9c3806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006fd0 tx=0x7f9c50009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:37.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.383+0000 7f9c4f7fe640 1 -- 172.21.15.60:0/2134593204 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c4807a760 con 0x7f9c5815c100 2024-09-12T01:36:37.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.558+0000 7f9c5d2af640 1 -- 172.21.15.60:0/2134593204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c5806e2a0 con 0x7f9c5815c100 2024-09-12T01:36:37.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.559+0000 7f9c4f7fe640 1 -- 172.21.15.60:0/2134593204 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16646 (secure 0 0 0) 0x7f9c4807ea60 con 0x7f9c5815c100 2024-09-12T01:36:37.559 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:37.559 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":33,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:36:36.284442+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:36:34.185888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T01:36:35.265632+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:36:37.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.561+0000 7f9c5d2af640 1 -- 172.21.15.60:0/2134593204 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9c3806be30 msgr2=0x7f9c3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.561+0000 7f9c5d2af640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9c3806be30 0x7f9c3806e2f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9c50006fd0 tx=0x7f9c50009060 comp rx=0 tx=0).stop 2024-09-12T01:36:37.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.561+0000 7f9c5d2af640 1 -- 172.21.15.60:0/2134593204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c5815c100 msgr2=0x7f9c580afda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.561+0000 7f9c5d2af640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c5815c100 0x7f9c580afda0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009d90 tx=0x7f9c48004a40 comp rx=0 tx=0).stop 2024-09-12T01:36:37.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.561+0000 7f9c5d2af640 1 -- 172.21.15.60:0/2134593204 shutdown_connections 2024-09-12T01:36:37.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.561+0000 7f9c5d2af640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c5815c100 0x7f9c580afda0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.561+0000 7f9c5d2af640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9c3806be30 0x7f9c3806e2f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.561+0000 7f9c5d2af640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c58073ce0 0x7f9c5815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.561+0000 7f9c5d2af640 1 --2- 172.21.15.60:0/2134593204 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c5806e910 0x7f9c5814efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.561+0000 7f9c5d2af640 1 -- 172.21.15.60:0/2134593204 >> 172.21.15.60:0/2134593204 conn(0x7f9c580b6ec0 msgr2=0x7f9c580b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:37.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.561+0000 7f9c5d2af640 1 -- 172.21.15.60:0/2134593204 shutdown_connections 2024-09-12T01:36:37.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.562+0000 7f9c5d2af640 1 -- 172.21.15.60:0/2134593204 wait complete. 2024-09-12T01:36:37.572 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:36:37.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.678+0000 7f38d58a6640 1 Processor -- start 2024-09-12T01:36:37.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.678+0000 7f38d58a6640 1 -- start start 2024-09-12T01:36:37.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38d58a6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f38d015e750 0x7f38d00cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38d58a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38d00cfb70 0x7f38d00b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38d58a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38d00b69e0 0x7f38d006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38d58a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f38d00d43c0 con 0x7f38d00b69e0 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38d58a6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f38d00d33b0 con 0x7f38d015e750 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38d58a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f38d00b7ac0 con 0x7f38d00cfb70 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38cf7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38d00b69e0 0x7f38d006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38cf7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38d00b69e0 0x7f38d006bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50600/0 (socket says 172.21.15.60:50600) 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38cf7fe640 1 -- 172.21.15.60:0/2151178699 learned_addr learned my addr 172.21.15.60:0/2151178699 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38ce7fc640 1 --2- 172.21.15.60:0/2151178699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38d00cfb70 0x7f38d00b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38cf7fe640 1 -- 172.21.15.60:0/2151178699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38d00cfb70 msgr2=0x7f38d00b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38ceffd640 1 --2- 172.21.15.60:0/2151178699 >> v2:172.21.15.105:3300/0 conn(0x7f38d015e750 0x7f38d00cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38cf7fe640 1 --2- 172.21.15.60:0/2151178699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38d00cfb70 0x7f38d00b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38cf7fe640 1 -- 172.21.15.60:0/2151178699 >> v2:172.21.15.105:3300/0 conn(0x7f38d015e750 msgr2=0x7f38d00cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:37.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38cf7fe640 1 --2- 172.21.15.60:0/2151178699 >> v2:172.21.15.105:3300/0 conn(0x7f38d015e750 0x7f38d00cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38cf7fe640 1 -- 172.21.15.60:0/2151178699 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d00b7790 con 0x7f38d00b69e0 2024-09-12T01:36:37.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.679+0000 7f38ceffd640 1 --2- 172.21.15.60:0/2151178699 >> v2:172.21.15.105:3300/0 conn(0x7f38d015e750 0x7f38d00cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:37.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.680+0000 7f38cf7fe640 1 --2- 172.21.15.60:0/2151178699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00b69e0 0x7f38d006bfd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f38d00b7c40 tx=0x7f38c802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d793f0a906275c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:37.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.680+0000 7f38cdffb640 1 -- 172.21.15.60:0/2151178699 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c8036070 con 0x7f38d00b69e0 2024-09-12T01:36:37.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.680+0000 7f38cdffb640 1 -- 172.21.15.60:0/2151178699 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c8031600 con 0x7f38d00b69e0 2024-09-12T01:36:37.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.680+0000 7f38cdffb640 1 -- 172.21.15.60:0/2151178699 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c80319d0 con 0x7f38d00b69e0 2024-09-12T01:36:37.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.681+0000 7f38d58a6640 1 -- 172.21.15.60:0/2151178699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00b69e0 msgr2=0x7f38d006bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.681+0000 7f38d58a6640 1 --2- 172.21.15.60:0/2151178699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00b69e0 0x7f38d006bfd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f38d00b7c40 tx=0x7f38c802a5f0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.681+0000 7f38d58a6640 1 -- 172.21.15.60:0/2151178699 shutdown_connections 2024-09-12T01:36:37.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.681+0000 7f38d58a6640 1 --2- 172.21.15.60:0/2151178699 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00b69e0 0x7f38d006bfd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.681+0000 7f38d58a6640 1 --2- 172.21.15.60:0/2151178699 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38d00cfb70 0x7f38d00b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.681+0000 7f38d58a6640 1 --2- 172.21.15.60:0/2151178699 >> v2:172.21.15.105:3300/0 conn(0x7f38d015e750 0x7f38d00cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.681+0000 7f38d58a6640 1 -- 172.21.15.60:0/2151178699 >> 172.21.15.60:0/2151178699 conn(0x7f38d00d1500 msgr2=0x7f38d00d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:37.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.681+0000 7f38d58a6640 1 -- 172.21.15.60:0/2151178699 shutdown_connections 2024-09-12T01:36:37.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.681+0000 7f38d58a6640 1 -- 172.21.15.60:0/2151178699 wait complete. 2024-09-12T01:36:37.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.682+0000 7f38d58a6640 1 Processor -- start 2024-09-12T01:36:37.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.682+0000 7f38d58a6640 1 -- start start 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38d58a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38d00b69e0 0x7f38d00cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38d58a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00cfb70 0x7f38d00ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38d58a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38d015e750 0x7f38d015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38d58a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38d00d3bc0 con 0x7f38d00cfb70 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38d58a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38d00d38e0 con 0x7f38d00b69e0 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38d58a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f38d015eb30 con 0x7f38d015e750 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38ce7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00cfb70 0x7f38d00ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38ce7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00cfb70 0x7f38d00ce6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50610/0 (socket says 172.21.15.60:50610) 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38ce7fc640 1 -- 172.21.15.60:0/957298299 learned_addr learned my addr 172.21.15.60:0/957298299 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38cf7fe640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38d015e750 0x7f38d015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38ceffd640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38d00b69e0 0x7f38d00cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38ce7fc640 1 -- 172.21.15.60:0/957298299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38d015e750 msgr2=0x7f38d015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38ce7fc640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38d015e750 0x7f38d015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38ce7fc640 1 -- 172.21.15.60:0/957298299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38d00b69e0 msgr2=0x7f38d00cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38ce7fc640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38d00b69e0 0x7f38d00cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38ce7fc640 1 -- 172.21.15.60:0/957298299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d015a280 con 0x7f38d00cfb70 2024-09-12T01:36:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38ceffd640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38d00b69e0 0x7f38d00cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38ce7fc640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00cfb70 0x7f38d00ce6b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f38c400c7f0 tx=0x7f38c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.683+0000 7f38b7fff640 1 -- 172.21.15.60:0/957298299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4015070 con 0x7f38d00cfb70 2024-09-12T01:36:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.684+0000 7f38b7fff640 1 -- 172.21.15.60:0/957298299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38c4004220 con 0x7f38d00cfb70 2024-09-12T01:36:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.684+0000 7f38b7fff640 1 -- 172.21.15.60:0/957298299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38c4007620 con 0x7f38d00cfb70 2024-09-12T01:36:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.684+0000 7f38d58a6640 1 -- 172.21.15.60:0/957298299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d015a560 con 0x7f38d00cfb70 2024-09-12T01:36:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.684+0000 7f38d58a6640 1 -- 172.21.15.60:0/957298299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d015ab20 con 0x7f38d00cfb70 2024-09-12T01:36:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.685+0000 7f38d58a6640 1 -- 172.21.15.60:0/957298299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d015af60 con 0x7f38d00cfb70 2024-09-12T01:36:37.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.685+0000 7f38b7fff640 1 -- 172.21.15.60:0/957298299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f38c40079d0 con 0x7f38d00cfb70 2024-09-12T01:36:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.686+0000 7f38b7fff640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f38bc06be30 0x7f38bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.686+0000 7f38ceffd640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f38bc06be30 0x7f38bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.686+0000 7f38b7fff640 1 -- 172.21.15.60:0/957298299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f38c408b180 con 0x7f38d00cfb70 2024-09-12T01:36:37.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.686+0000 7f38ceffd640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f38bc06be30 0x7f38bc06e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f38c000a990 tx=0x7f38c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:37.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.690+0000 7f38b7fff640 1 -- 172.21.15.60:0/957298299 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38c40594d0 con 0x7f38d00cfb70 2024-09-12T01:36:37.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.904+0000 7f38d58a6640 1 -- 172.21.15.60:0/957298299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f38d00b64a0 con 0x7f38d00cfb70 2024-09-12T01:36:37.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.944+0000 7f38b7fff640 1 -- 172.21.15.60:0/957298299 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7f38c405d7d0 con 0x7f38d00cfb70 2024-09-12T01:36:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.946+0000 7f38d58a6640 1 -- 172.21.15.60:0/957298299 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f38bc06be30 msgr2=0x7f38bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.946+0000 7f38d58a6640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f38bc06be30 0x7f38bc06e2f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f38c000a990 tx=0x7f38c0008040 comp rx=0 tx=0).stop 2024-09-12T01:36:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.946+0000 7f38d58a6640 1 -- 172.21.15.60:0/957298299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00cfb70 msgr2=0x7f38d00ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.946+0000 7f38d58a6640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00cfb70 0x7f38d00ce6b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f38c400c7f0 tx=0x7f38c400ccb0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.946+0000 7f38d58a6640 1 -- 172.21.15.60:0/957298299 shutdown_connections 2024-09-12T01:36:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.946+0000 7f38d58a6640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f38bc06be30 0x7f38bc06e2f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.946+0000 7f38d58a6640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38d015e750 0x7f38d015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.946+0000 7f38d58a6640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00cfb70 0x7f38d00ce6b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.946+0000 7f38d58a6640 1 --2- 172.21.15.60:0/957298299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38d00b69e0 0x7f38d00cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.946+0000 7f38d58a6640 1 -- 172.21.15.60:0/957298299 >> 172.21.15.60:0/957298299 conn(0x7f38d00d1500 msgr2=0x7f38d00b5360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.946+0000 7f38d58a6640 1 -- 172.21.15.60:0/957298299 shutdown_connections 2024-09-12T01:36:37.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:37.946+0000 7f38d58a6640 1 -- 172.21.15.60:0/957298299 wait complete. 2024-09-12T01:36:37.957 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:36:37.957 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:36:38.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.064+0000 7fb2997b9640 1 Processor -- start 2024-09-12T01:36:38.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.064+0000 7fb2997b9640 1 -- start start 2024-09-12T01:36:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.065+0000 7fb2997b9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb294155880 0x7fb29415f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.065+0000 7fb2997b9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb29415dc30 0x7fb2940b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.065+0000 7fb2997b9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29415bb60 con 0x7fb2940b4d60 2024-09-12T01:36:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.065+0000 7fb2997b9640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb294155c60 con 0x7fb29415dc30 2024-09-12T01:36:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.065+0000 7fb2997b9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb29415fcb0 con 0x7fb294155880 2024-09-12T01:36:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.065+0000 7fb2937fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb29415dc30 0x7fb2940b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.065+0000 7fb2937fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb29415dc30 0x7fb2940b51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50614/0 (socket says 172.21.15.60:50614) 2024-09-12T01:36:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.065+0000 7fb2937fe640 1 -- 172.21.15.60:0/3526781783 learned_addr learned my addr 172.21.15.60:0/3526781783 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.065+0000 7fb292ffd640 1 --2- 172.21.15.60:0/3526781783 >> v2:172.21.15.105:3300/0 conn(0x7fb294155880 0x7fb29415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.066+0000 7fb2937fe640 1 -- 172.21.15.60:0/3526781783 >> v2:172.21.15.105:3300/0 conn(0x7fb294155880 msgr2=0x7fb29415f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:38.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.066+0000 7fb2937fe640 1 --2- 172.21.15.60:0/3526781783 >> v2:172.21.15.105:3300/0 conn(0x7fb294155880 0x7fb29415f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.066+0000 7fb2937fe640 1 -- 172.21.15.60:0/3526781783 >> v1:172.21.15.105:6789/0 conn(0x7fb2940b4d60 legacy=0x7fb29406f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.066+0000 7fb2937fe640 1 -- 172.21.15.60:0/3526781783 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb29415be40 con 0x7fb29415dc30 2024-09-12T01:36:38.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.066+0000 7fb2937fe640 1 --2- 172.21.15.60:0/3526781783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb29415dc30 0x7fb2940b51f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb2940b7560 tx=0x7fb28402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefed1571acc217e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:38.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.067+0000 7fb291ffb640 1 -- 172.21.15.60:0/3526781783 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb284036070 con 0x7fb29415dc30 2024-09-12T01:36:38.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.067+0000 7fb291ffb640 1 -- 172.21.15.60:0/3526781783 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb284031600 con 0x7fb29415dc30 2024-09-12T01:36:38.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.067+0000 7fb291ffb640 1 -- 172.21.15.60:0/3526781783 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2840319d0 con 0x7fb29415dc30 2024-09-12T01:36:38.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.067+0000 7fb2997b9640 1 -- 172.21.15.60:0/3526781783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb29415dc30 msgr2=0x7fb2940b51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.067+0000 7fb2997b9640 1 --2- 172.21.15.60:0/3526781783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb29415dc30 0x7fb2940b51f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb2940b7560 tx=0x7fb28402a730 comp rx=0 tx=0).stop 2024-09-12T01:36:38.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.067+0000 7fb2997b9640 1 -- 172.21.15.60:0/3526781783 shutdown_connections 2024-09-12T01:36:38.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.067+0000 7fb2997b9640 1 --2- 172.21.15.60:0/3526781783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb29415dc30 0x7fb2940b51f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.067+0000 7fb2997b9640 1 --2- 172.21.15.60:0/3526781783 >> v2:172.21.15.105:3300/0 conn(0x7fb294155880 0x7fb29415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.067+0000 7fb2997b9640 1 -- 172.21.15.60:0/3526781783 >> 172.21.15.60:0/3526781783 conn(0x7fb2940d1390 msgr2=0x7fb2940d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:38.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.067+0000 7fb2997b9640 1 -- 172.21.15.60:0/3526781783 shutdown_connections 2024-09-12T01:36:38.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.067+0000 7fb2997b9640 1 -- 172.21.15.60:0/3526781783 wait complete. 2024-09-12T01:36:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.069+0000 7fb2997b9640 1 Processor -- start 2024-09-12T01:36:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.069+0000 7fb2997b9640 1 -- start start 2024-09-12T01:36:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.069+0000 7fb2997b9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2940b4d60 0x7fb294157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.069+0000 7fb2997b9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb294155880 0x7fb29414bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.069+0000 7fb2997b9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29415dc30 0x7fb294158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.069+0000 7fb2997b9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb29415c6e0 con 0x7fb2940b4d60 2024-09-12T01:36:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.069+0000 7fb2997b9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb29415c400 con 0x7fb29415dc30 2024-09-12T01:36:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.069+0000 7fb2997b9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb29415b770 con 0x7fb294155880 2024-09-12T01:36:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.069+0000 7fb292ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2940b4d60 0x7fb294157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.069+0000 7fb292ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2940b4d60 0x7fb294157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50626/0 (socket says 172.21.15.60:50626) 2024-09-12T01:36:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.069+0000 7fb292ffd640 1 -- 172.21.15.60:0/2407777840 learned_addr learned my addr 172.21.15.60:0/2407777840 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb2937fe640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29415dc30 0x7fb294158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb2927fc640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb294155880 0x7fb29414bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb292ffd640 1 -- 172.21.15.60:0/2407777840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb294155880 msgr2=0x7fb29414bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb292ffd640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb294155880 0x7fb29414bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb292ffd640 1 -- 172.21.15.60:0/2407777840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29415dc30 msgr2=0x7fb294158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb292ffd640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29415dc30 0x7fb294158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb292ffd640 1 -- 172.21.15.60:0/2407777840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb294155230 con 0x7fb2940b4d60 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb2927fc640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb294155880 0x7fb29414bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb292ffd640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2940b4d60 0x7fb294157320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb28c00e9b0 tx=0x7fb28c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb28b7fe640 1 -- 172.21.15.60:0/2407777840 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c017070 con 0x7fb2940b4d60 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb28b7fe640 1 -- 172.21.15.60:0/2407777840 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb28c00c9a0 con 0x7fb2940b4d60 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb2997b9640 1 -- 172.21.15.60:0/2407777840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb294156280 con 0x7fb2940b4d60 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb28b7fe640 1 -- 172.21.15.60:0/2407777840 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb28c00cd90 con 0x7fb2940b4d60 2024-09-12T01:36:38.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.070+0000 7fb2997b9640 1 -- 172.21.15.60:0/2407777840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb294156840 con 0x7fb2940b4d60 2024-09-12T01:36:38.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.071+0000 7fb2997b9640 1 -- 172.21.15.60:0/2407777840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb294070330 con 0x7fb2940b4d60 2024-09-12T01:36:38.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.072+0000 7fb28b7fe640 1 -- 172.21.15.60:0/2407777840 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb28c01a070 con 0x7fb2940b4d60 2024-09-12T01:36:38.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.072+0000 7fb28b7fe640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb27406be60 0x7fb27406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:38.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.072+0000 7fb28b7fe640 1 -- 172.21.15.60:0/2407777840 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb28c08ae40 con 0x7fb2940b4d60 2024-09-12T01:36:38.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.072+0000 7fb2927fc640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb27406be60 0x7fb27406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:38.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.073+0000 7fb2927fc640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb27406be60 0x7fb27406e320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb2941555e0 tx=0x7fb27c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:38.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.076+0000 7fb28b7fe640 1 -- 172.21.15.60:0/2407777840 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb294070330 con 0x7fb2940b4d60 2024-09-12T01:36:38.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.293+0000 7fb2997b9640 1 -- 172.21.15.60:0/2407777840 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb2940cd8a0 con 0x7fb2940b4d60 2024-09-12T01:36:38.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.949+0000 7fb28b7fe640 1 -- 172.21.15.60:0/2407777840 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fb28c0597f0 con 0x7fb2940b4d60 2024-09-12T01:36:38.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.952+0000 7fb2997b9640 1 -- 172.21.15.60:0/2407777840 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb27406be60 msgr2=0x7fb27406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.952+0000 7fb2997b9640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb27406be60 0x7fb27406e320 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb2941555e0 tx=0x7fb27c009040 comp rx=0 tx=0).stop 2024-09-12T01:36:38.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.952+0000 7fb2997b9640 1 -- 172.21.15.60:0/2407777840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2940b4d60 msgr2=0x7fb294157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:38.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.952+0000 7fb2997b9640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2940b4d60 0x7fb294157320 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb28c00e9b0 tx=0x7fb28c00ee70 comp rx=0 tx=0).stop 2024-09-12T01:36:38.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.952+0000 7fb2997b9640 1 -- 172.21.15.60:0/2407777840 shutdown_connections 2024-09-12T01:36:38.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.952+0000 7fb2997b9640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb29415dc30 0x7fb294158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.952+0000 7fb2997b9640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb27406be60 0x7fb27406e320 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.952+0000 7fb2997b9640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb294155880 0x7fb29414bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.952+0000 7fb2997b9640 1 --2- 172.21.15.60:0/2407777840 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2940b4d60 0x7fb294157320 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:38.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.952+0000 7fb2997b9640 1 -- 172.21.15.60:0/2407777840 >> 172.21.15.60:0/2407777840 conn(0x7fb2940d1390 msgr2=0x7fb29406fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:38.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.952+0000 7fb2997b9640 1 -- 172.21.15.60:0/2407777840 shutdown_connections 2024-09-12T01:36:38.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:38.952+0000 7fb2997b9640 1 -- 172.21.15.60:0/2407777840 wait complete. 2024-09-12T01:36:38.965 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:36:38.966 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:36:39.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.075+0000 7f5d8cae4640 1 Processor -- start 2024-09-12T01:36:39.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.075+0000 7f5d8cae4640 1 -- start start 2024-09-12T01:36:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8cae4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5d8815c2b0 0x7f5d880b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8cae4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5d880b72f0 0x7f5d8815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8cae4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d8815f030 0x7f5d8806f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8cae4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f5d8815fb10 con 0x7f5d8815c2b0 2024-09-12T01:36:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8cae4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5d880b5900 con 0x7f5d880b72f0 2024-09-12T01:36:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8cae4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5d8815f830 con 0x7f5d8815f030 2024-09-12T01:36:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5d8815c2b0 0x7f5d880b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5d8815c2b0 0x7f5d880b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50636/0 (socket says 172.21.15.60:50636) 2024-09-12T01:36:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8659c640 1 -- 172.21.15.60:0/3609095481 learned_addr learned my addr 172.21.15.60:0/3609095481 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d85d9b640 1 --2- 172.21.15.60:0/3609095481 >> v2:172.21.15.105:3300/0 conn(0x7f5d880b72f0 0x7f5d8815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d86d9d640 1 --2- 172.21.15.60:0/3609095481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d8815f030 0x7f5d8806f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8659c640 1 -- 172.21.15.60:0/3609095481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d8815f030 msgr2=0x7f5d8806f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8659c640 1 --2- 172.21.15.60:0/3609095481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d8815f030 0x7f5d8806f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8659c640 1 -- 172.21.15.60:0/3609095481 >> v2:172.21.15.105:3300/0 conn(0x7f5d880b72f0 msgr2=0x7f5d8815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8659c640 1 --2- 172.21.15.60:0/3609095481 >> v2:172.21.15.105:3300/0 conn(0x7f5d880b72f0 0x7f5d8815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.076+0000 7f5d8659c640 1 -- 172.21.15.60:0/3609095481 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8806ce30 con 0x7f5d8815c2b0 2024-09-12T01:36:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.077+0000 7f5d8659c640 1 --2- 172.21.15.60:0/3609095481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8815c2b0 0x7f5d880b6db0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5d88071d10 tx=0x7f5d7802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c72c34cf35b076 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.077+0000 7f5d8559a640 1 -- 172.21.15.60:0/3609095481 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78037070 con 0x7f5d8815c2b0 2024-09-12T01:36:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.077+0000 7f5d8559a640 1 -- 172.21.15.60:0/3609095481 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d78032440 con 0x7f5d8815c2b0 2024-09-12T01:36:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.077+0000 7f5d8559a640 1 -- 172.21.15.60:0/3609095481 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78032810 con 0x7f5d8815c2b0 2024-09-12T01:36:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.078+0000 7f5d8cae4640 1 -- 172.21.15.60:0/3609095481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8815c2b0 msgr2=0x7f5d880b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.078+0000 7f5d8cae4640 1 --2- 172.21.15.60:0/3609095481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8815c2b0 0x7f5d880b6db0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5d88071d10 tx=0x7f5d7802a1e0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.078+0000 7f5d8cae4640 1 -- 172.21.15.60:0/3609095481 shutdown_connections 2024-09-12T01:36:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.078+0000 7f5d8cae4640 1 --2- 172.21.15.60:0/3609095481 >> v2:172.21.15.105:3300/0 conn(0x7f5d880b72f0 0x7f5d8815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.078+0000 7f5d8cae4640 1 --2- 172.21.15.60:0/3609095481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d8815f030 0x7f5d8806f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.078+0000 7f5d8cae4640 1 --2- 172.21.15.60:0/3609095481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d8815c2b0 0x7f5d880b6db0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.078+0000 7f5d8cae4640 1 -- 172.21.15.60:0/3609095481 >> 172.21.15.60:0/3609095481 conn(0x7f5d880b4240 msgr2=0x7f5d880b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.078+0000 7f5d8cae4640 1 -- 172.21.15.60:0/3609095481 shutdown_connections 2024-09-12T01:36:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.078+0000 7f5d8cae4640 1 -- 172.21.15.60:0/3609095481 wait complete. 2024-09-12T01:36:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.079+0000 7f5d8cae4640 1 Processor -- start 2024-09-12T01:36:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.079+0000 7f5d8cae4640 1 -- start start 2024-09-12T01:36:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.080+0000 7f5d8cae4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d880b72f0 0x7f5d88156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.080+0000 7f5d8cae4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d8815c2b0 0x7f5d88148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.080+0000 7f5d8cae4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d8815f030 0x7f5d88158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.080+0000 7f5d8cae4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5d880b7760 con 0x7f5d880b72f0 2024-09-12T01:36:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.080+0000 7f5d8cae4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8806d3f0 con 0x7f5d8815c2b0 2024-09-12T01:36:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.080+0000 7f5d8cae4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5d8815f4c0 con 0x7f5d8815f030 2024-09-12T01:36:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.080+0000 7f5d8659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d880b72f0 0x7f5d88156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.080+0000 7f5d8659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d880b72f0 0x7f5d88156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50646/0 (socket says 172.21.15.60:50646) 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.080+0000 7f5d8659c640 1 -- 172.21.15.60:0/1819505787 learned_addr learned my addr 172.21.15.60:0/1819505787 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.080+0000 7f5d85d9b640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d8815c2b0 0x7f5d88148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.080+0000 7f5d86d9d640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d8815f030 0x7f5d88158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d8659c640 1 -- 172.21.15.60:0/1819505787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d8815f030 msgr2=0x7f5d88158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d8659c640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d8815f030 0x7f5d88158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d8659c640 1 -- 172.21.15.60:0/1819505787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d8815c2b0 msgr2=0x7f5d88148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d8659c640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d8815c2b0 0x7f5d88148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d8659c640 1 -- 172.21.15.60:0/1819505787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d881572c0 con 0x7f5d880b72f0 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d85d9b640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d8815c2b0 0x7f5d88148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d86d9d640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d8815f030 0x7f5d88158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d8659c640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d880b72f0 0x7f5d88156c30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5d78000c00 tx=0x7f5d780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d76ffd640 1 -- 172.21.15.60:0/1819505787 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78041020 con 0x7f5d880b72f0 2024-09-12T01:36:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d76ffd640 1 -- 172.21.15.60:0/1819505787 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d780306c0 con 0x7f5d880b72f0 2024-09-12T01:36:39.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d8cae4640 1 -- 172.21.15.60:0/1819505787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d881575a0 con 0x7f5d880b72f0 2024-09-12T01:36:39.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d76ffd640 1 -- 172.21.15.60:0/1819505787 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78037040 con 0x7f5d880b72f0 2024-09-12T01:36:39.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.081+0000 7f5d8cae4640 1 -- 172.21.15.60:0/1819505787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d88157b60 con 0x7f5d880b72f0 2024-09-12T01:36:39.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.082+0000 7f5d8cae4640 1 -- 172.21.15.60:0/1819505787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d8815eaf0 con 0x7f5d880b72f0 2024-09-12T01:36:39.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.083+0000 7f5d76ffd640 1 -- 172.21.15.60:0/1819505787 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d78044020 con 0x7f5d880b72f0 2024-09-12T01:36:39.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.083+0000 7f5d76ffd640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5d6806be30 0x7f5d6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.083+0000 7f5d76ffd640 1 -- 172.21.15.60:0/1819505787 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f5d780ab6f0 con 0x7f5d880b72f0 2024-09-12T01:36:39.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.083+0000 7f5d85d9b640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5d6806be30 0x7f5d6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.084+0000 7f5d85d9b640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5d6806be30 0x7f5d6806e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5d8815d820 tx=0x7f5d7c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.087+0000 7f5d76ffd640 1 -- 172.21.15.60:0/1819505787 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d7804b030 con 0x7f5d880b72f0 2024-09-12T01:36:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.299+0000 7f5d8cae4640 1 -- 172.21.15.60:0/1819505787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5d880693c0 con 0x7f5d880b72f0 2024-09-12T01:36:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.300+0000 7f5d76ffd640 1 -- 172.21.15.60:0/1819505787 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7f5d7807a0a0 con 0x7f5d880b72f0 2024-09-12T01:36:39.299 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:39.299 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":14,"btime":"2024-09-12T01:36:38:945222+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3644892545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3644892545},{"type":"v1","addr":"172.21.15.105:6835","nonce":3644892545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/458109310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458109310},{"type":"v1","addr":"172.21.15.60:6836","nonce":458109310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4741,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1415668038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1415668038},{"type":"v1","addr":"172.21.15.60:6837","nonce":1415668038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:36:36.284771+0000","modified":"2024-09-12T01:36:38.293895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34520":{"gid":34520,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/1200480020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1200480020},{"type":"v1","addr":"172.21.15.105:6834","nonce":1200480020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34520,"qdb_cluster":[34520]},"id":2}]} 2024-09-12T01:36:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 14 2024-09-12T01:36:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.302+0000 7f5d8cae4640 1 -- 172.21.15.60:0/1819505787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5d6806be30 msgr2=0x7f5d6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.302+0000 7f5d8cae4640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5d6806be30 0x7f5d6806e2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5d8815d820 tx=0x7f5d7c008040 comp rx=0 tx=0).stop 2024-09-12T01:36:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.302+0000 7f5d8cae4640 1 -- 172.21.15.60:0/1819505787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d880b72f0 msgr2=0x7f5d88156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.302+0000 7f5d8cae4640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d880b72f0 0x7f5d88156c30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5d78000c00 tx=0x7f5d780046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.302+0000 7f5d8cae4640 1 -- 172.21.15.60:0/1819505787 shutdown_connections 2024-09-12T01:36:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.302+0000 7f5d8cae4640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5d6806be30 0x7f5d6806e2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.302+0000 7f5d8cae4640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d8815f030 0x7f5d88158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.302+0000 7f5d8cae4640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d8815c2b0 0x7f5d88148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.302+0000 7f5d8cae4640 1 --2- 172.21.15.60:0/1819505787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d880b72f0 0x7f5d88156c30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.302+0000 7f5d8cae4640 1 -- 172.21.15.60:0/1819505787 >> 172.21.15.60:0/1819505787 conn(0x7f5d880b4240 msgr2=0x7f5d880cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:39.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.302+0000 7f5d8cae4640 1 -- 172.21.15.60:0/1819505787 shutdown_connections 2024-09-12T01:36:39.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.302+0000 7f5d8cae4640 1 -- 172.21.15.60:0/1819505787 wait complete. 2024-09-12T01:36:39.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:36:39.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.415+0000 7f76db83c640 1 Processor -- start 2024-09-12T01:36:39.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.415+0000 7f76db83c640 1 -- start start 2024-09-12T01:36:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.416+0000 7f76db83c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d415e7a0 0x7f76d40ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.416+0000 7f76db83c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f76d40d3fe0 0x7f76d40d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.416+0000 7f76db83c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76d40cf2f0 0x7f76d40cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.416+0000 7f76db83c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f76d40d2cc0 con 0x7f76d40cf2f0 2024-09-12T01:36:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.416+0000 7f76db83c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f76d40d4400 con 0x7f76d40d3fe0 2024-09-12T01:36:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.416+0000 7f76db83c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f76d40d2f40 con 0x7f76d415e7a0 2024-09-12T01:36:39.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.416+0000 7f76d9dd9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76d40cf2f0 0x7f76d40cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.416+0000 7f76d9dd9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76d40cf2f0 0x7f76d40cf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50660/0 (socket says 172.21.15.60:50660) 2024-09-12T01:36:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.416+0000 7f76d9dd9640 1 -- 172.21.15.60:0/4208212845 learned_addr learned my addr 172.21.15.60:0/4208212845 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.416+0000 7f76d95d8640 1 --2- 172.21.15.60:0/4208212845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d415e7a0 0x7f76d40ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.416+0000 7f76d8dd7640 1 --2- 172.21.15.60:0/4208212845 >> v2:172.21.15.105:3300/0 conn(0x7f76d40d3fe0 0x7f76d40d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.417+0000 7f76d9dd9640 1 -- 172.21.15.60:0/4208212845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d415e7a0 msgr2=0x7f76d40ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.417+0000 7f76d9dd9640 1 --2- 172.21.15.60:0/4208212845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d415e7a0 0x7f76d40ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.417+0000 7f76d9dd9640 1 -- 172.21.15.60:0/4208212845 >> v2:172.21.15.105:3300/0 conn(0x7f76d40d3fe0 msgr2=0x7f76d40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.417+0000 7f76d9dd9640 1 --2- 172.21.15.60:0/4208212845 >> v2:172.21.15.105:3300/0 conn(0x7f76d40d3fe0 0x7f76d40d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.417+0000 7f76d9dd9640 1 -- 172.21.15.60:0/4208212845 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d40d3220 con 0x7f76d40cf2f0 2024-09-12T01:36:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.417+0000 7f76d9dd9640 1 --2- 172.21.15.60:0/4208212845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40cf2f0 0x7f76d40cf7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f76d40696f0 tx=0x7f76cc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c9bc031d893c36 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.417+0000 7f76cbfff640 1 -- 172.21.15.60:0/4208212845 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc036070 con 0x7f76d40cf2f0 2024-09-12T01:36:39.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.417+0000 7f76cbfff640 1 -- 172.21.15.60:0/4208212845 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76cc031600 con 0x7f76d40cf2f0 2024-09-12T01:36:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.418+0000 7f76cbfff640 1 -- 172.21.15.60:0/4208212845 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0319d0 con 0x7f76d40cf2f0 2024-09-12T01:36:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.418+0000 7f76db83c640 1 -- 172.21.15.60:0/4208212845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40cf2f0 msgr2=0x7f76d40cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.418+0000 7f76db83c640 1 --2- 172.21.15.60:0/4208212845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40cf2f0 0x7f76d40cf7a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f76d40696f0 tx=0x7f76cc02a730 comp rx=0 tx=0).stop 2024-09-12T01:36:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.418+0000 7f76db83c640 1 -- 172.21.15.60:0/4208212845 shutdown_connections 2024-09-12T01:36:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.418+0000 7f76db83c640 1 --2- 172.21.15.60:0/4208212845 >> v2:172.21.15.105:3300/0 conn(0x7f76d40d3fe0 0x7f76d40d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.418+0000 7f76db83c640 1 --2- 172.21.15.60:0/4208212845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40cf2f0 0x7f76d40cf7a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.418+0000 7f76db83c640 1 --2- 172.21.15.60:0/4208212845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d415e7a0 0x7f76d40ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.418+0000 7f76db83c640 1 -- 172.21.15.60:0/4208212845 >> 172.21.15.60:0/4208212845 conn(0x7f76d40d1550 msgr2=0x7f76d40d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.418+0000 7f76db83c640 1 -- 172.21.15.60:0/4208212845 shutdown_connections 2024-09-12T01:36:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.418+0000 7f76db83c640 1 -- 172.21.15.60:0/4208212845 wait complete. 2024-09-12T01:36:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.419+0000 7f76db83c640 1 Processor -- start 2024-09-12T01:36:39.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.419+0000 7f76db83c640 1 -- start start 2024-09-12T01:36:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.420+0000 7f76db83c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d40cf2f0 0x7f76d40b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.420+0000 7f76db83c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40d3fe0 0x7f76d41e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.420+0000 7f76db83c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d415e7a0 0x7f76d414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.420+0000 7f76db83c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f76d40d3ac0 con 0x7f76d40d3fe0 2024-09-12T01:36:39.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.420+0000 7f76db83c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f76d40d37e0 con 0x7f76d40cf2f0 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.420+0000 7f76db83c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f76d415eb80 con 0x7f76d415e7a0 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.420+0000 7f76d8dd7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40d3fe0 0x7f76d41e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.420+0000 7f76d8dd7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40d3fe0 0x7f76d41e8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50674/0 (socket says 172.21.15.60:50674) 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.420+0000 7f76d8dd7640 1 -- 172.21.15.60:0/2839542836 learned_addr learned my addr 172.21.15.60:0/2839542836 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.420+0000 7f76d9dd9640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d415e7a0 0x7f76d414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.420+0000 7f76d95d8640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d40cf2f0 0x7f76d40b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.421+0000 7f76d8dd7640 1 -- 172.21.15.60:0/2839542836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d415e7a0 msgr2=0x7f76d414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.421+0000 7f76d8dd7640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d415e7a0 0x7f76d414d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.421+0000 7f76d8dd7640 1 -- 172.21.15.60:0/2839542836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d40cf2f0 msgr2=0x7f76d40b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.421+0000 7f76d8dd7640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d40cf2f0 0x7f76d40b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.421+0000 7f76d8dd7640 1 -- 172.21.15.60:0/2839542836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d40b3970 con 0x7f76d40d3fe0 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.421+0000 7f76d8dd7640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40d3fe0 0x7f76d41e8a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f76c400e980 tx=0x7f76c400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.421+0000 7f76c9ffb640 1 -- 172.21.15.60:0/2839542836 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4017070 con 0x7f76d40d3fe0 2024-09-12T01:36:39.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.421+0000 7f76c9ffb640 1 -- 172.21.15.60:0/2839542836 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c400ca00 con 0x7f76d40d3fe0 2024-09-12T01:36:39.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.421+0000 7f76db83c640 1 -- 172.21.15.60:0/2839542836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d41e94b0 con 0x7f76d40d3fe0 2024-09-12T01:36:39.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.421+0000 7f76c9ffb640 1 -- 172.21.15.60:0/2839542836 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c400cdd0 con 0x7f76d40d3fe0 2024-09-12T01:36:39.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.421+0000 7f76db83c640 1 -- 172.21.15.60:0/2839542836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d41e9a70 con 0x7f76d40d3fe0 2024-09-12T01:36:39.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.422+0000 7f76db83c640 1 -- 172.21.15.60:0/2839542836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d40d2780 con 0x7f76d40d3fe0 2024-09-12T01:36:39.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.423+0000 7f76c9ffb640 1 -- 172.21.15.60:0/2839542836 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f76c401a070 con 0x7f76d40d3fe0 2024-09-12T01:36:39.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.423+0000 7f76c9ffb640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f76b806be30 0x7f76b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.423+0000 7f76c9ffb640 1 -- 172.21.15.60:0/2839542836 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f76c408ae50 con 0x7f76d40d3fe0 2024-09-12T01:36:39.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.423+0000 7f76d95d8640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f76b806be30 0x7f76b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.424+0000 7f76d95d8640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f76b806be30 0x7f76b806e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76d0009a20 tx=0x7f76d0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.427+0000 7f76c9ffb640 1 -- 172.21.15.60:0/2839542836 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f76c4059120 con 0x7f76d40d3fe0 2024-09-12T01:36:39.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.606+0000 7f76db83c640 1 -- 172.21.15.60:0/2839542836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76d40b9a70 con 0x7f76d40d3fe0 2024-09-12T01:36:39.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.608+0000 7f76c9ffb640 1 -- 172.21.15.60:0/2839542836 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16633 (secure 0 0 0) 0x7f76c405d420 con 0x7f76d40d3fe0 2024-09-12T01:36:39.607 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:39.607 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:36:37.938269+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:36:34.185888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T01:36:35.265632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:36:39.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.610+0000 7f76db83c640 1 -- 172.21.15.60:0/2839542836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f76b806be30 msgr2=0x7f76b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.610+0000 7f76db83c640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f76b806be30 0x7f76b806e2f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76d0009a20 tx=0x7f76d0009190 comp rx=0 tx=0).stop 2024-09-12T01:36:39.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.610+0000 7f76db83c640 1 -- 172.21.15.60:0/2839542836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40d3fe0 msgr2=0x7f76d41e8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.610+0000 7f76db83c640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40d3fe0 0x7f76d41e8a10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f76c400e980 tx=0x7f76c400ee40 comp rx=0 tx=0).stop 2024-09-12T01:36:39.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.610+0000 7f76db83c640 1 -- 172.21.15.60:0/2839542836 shutdown_connections 2024-09-12T01:36:39.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.610+0000 7f76db83c640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f76b806be30 0x7f76b806e2f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.610+0000 7f76db83c640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f76d415e7a0 0x7f76d414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.610+0000 7f76db83c640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d40d3fe0 0x7f76d41e8a10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.610+0000 7f76db83c640 1 --2- 172.21.15.60:0/2839542836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f76d40cf2f0 0x7f76d40b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.610+0000 7f76db83c640 1 -- 172.21.15.60:0/2839542836 >> 172.21.15.60:0/2839542836 conn(0x7f76d40d1550 msgr2=0x7f76d40b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:39.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.610+0000 7f76db83c640 1 -- 172.21.15.60:0/2839542836 shutdown_connections 2024-09-12T01:36:39.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.610+0000 7f76db83c640 1 -- 172.21.15.60:0/2839542836 wait complete. 2024-09-12T01:36:39.621 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:36:39.621 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:36:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.725+0000 7f9e54198640 1 Processor -- start 2024-09-12T01:36:39.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.725+0000 7f9e54198640 1 -- start start 2024-09-12T01:36:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e54198640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9e4c155800 0x7f9e4c0b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e54198640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e4c0cfc80 0x7f9e4c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e54198640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e4c0b50a0 con 0x7f9e4c15c330 2024-09-12T01:36:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e54198640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9e4c0b4e60 con 0x7f9e4c155800 2024-09-12T01:36:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e54198640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9e4c15c7a0 con 0x7f9e4c0cfc80 2024-09-12T01:36:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e51733640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9e4c15c330 0x7f9e4c0cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40064/0 (socket says 172.21.15.60:40064) 2024-09-12T01:36:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e51733640 1 -- 172.21.15.60:0/1110914325 learned_addr learned my addr 172.21.15.60:0/1110914325 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e52735640 1 --2- 172.21.15.60:0/1110914325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e4c0cfc80 0x7f9e4c0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e51f34640 1 --2- 172.21.15.60:0/1110914325 >> v2:172.21.15.105:3300/0 conn(0x7f9e4c155800 0x7f9e4c0b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e50f32640 1 -- 172.21.15.60:0/1110914325 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534978731 0 0) 0x7f9e4c0b50a0 con 0x7f9e4c15c330 2024-09-12T01:36:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e50f32640 1 -- 172.21.15.60:0/1110914325 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e38003520 con 0x7f9e4c15c330 2024-09-12T01:36:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e50f32640 1 -- 172.21.15.60:0/1110914325 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3417773949 0 0) 0x7f9e38003520 con 0x7f9e4c15c330 2024-09-12T01:36:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e51f34640 1 -- 172.21.15.60:0/1110914325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e4c0cfc80 msgr2=0x7f9e4c0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:39.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e51f34640 1 --2- 172.21.15.60:0/1110914325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e4c0cfc80 0x7f9e4c0b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e51f34640 1 -- 172.21.15.60:0/1110914325 >> v1:172.21.15.60:6789/0 conn(0x7f9e4c15c330 legacy=0x7f9e4c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.726+0000 7f9e51f34640 1 -- 172.21.15.60:0/1110914325 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4c0b5380 con 0x7f9e4c155800 2024-09-12T01:36:39.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.727+0000 7f9e51f34640 1 --2- 172.21.15.60:0/1110914325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e4c155800 0x7f9e4c0b6140 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e480097a0 tx=0x7f9e4802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4079e6b5044c980e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.727+0000 7f9e50f32640 1 -- 172.21.15.60:0/1110914325 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e48037070 con 0x7f9e4c155800 2024-09-12T01:36:39.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.727+0000 7f9e50f32640 1 -- 172.21.15.60:0/1110914325 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e4802aba0 con 0x7f9e4c155800 2024-09-12T01:36:39.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.727+0000 7f9e50f32640 1 -- 172.21.15.60:0/1110914325 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c001670 con 0x7f9e4c155800 2024-09-12T01:36:39.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.728+0000 7f9e54198640 1 -- 172.21.15.60:0/1110914325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e4c155800 msgr2=0x7f9e4c0b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.728+0000 7f9e54198640 1 --2- 172.21.15.60:0/1110914325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e4c155800 0x7f9e4c0b6140 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e480097a0 tx=0x7f9e4802a110 comp rx=0 tx=0).stop 2024-09-12T01:36:39.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.728+0000 7f9e54198640 1 -- 172.21.15.60:0/1110914325 shutdown_connections 2024-09-12T01:36:39.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.728+0000 7f9e54198640 1 --2- 172.21.15.60:0/1110914325 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e4c0cfc80 0x7f9e4c0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.728+0000 7f9e54198640 1 --2- 172.21.15.60:0/1110914325 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e4c155800 0x7f9e4c0b6140 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.728+0000 7f9e54198640 1 -- 172.21.15.60:0/1110914325 >> 172.21.15.60:0/1110914325 conn(0x7f9e4c06bc10 msgr2=0x7f9e4c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:39.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.728+0000 7f9e54198640 1 -- 172.21.15.60:0/1110914325 shutdown_connections 2024-09-12T01:36:39.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.728+0000 7f9e54198640 1 -- 172.21.15.60:0/1110914325 wait complete. 2024-09-12T01:36:39.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.729+0000 7f9e54198640 1 Processor -- start 2024-09-12T01:36:39.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.729+0000 7f9e54198640 1 -- start start 2024-09-12T01:36:39.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.730+0000 7f9e54198640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e4c0cfc80 0x7f9e4c14a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.730+0000 7f9e54198640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c155800 0x7f9e4c157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.730+0000 7f9e54198640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e4c15c330 0x7f9e4c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.730+0000 7f9e54198640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c0b5c20 con 0x7f9e4c155800 2024-09-12T01:36:39.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.730+0000 7f9e54198640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9e4c0b5940 con 0x7f9e4c0cfc80 2024-09-12T01:36:39.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.730+0000 7f9e54198640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9e4c155be0 con 0x7f9e4c15c330 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.730+0000 7f9e51733640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c155800 0x7f9e4c157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.730+0000 7f9e51733640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c155800 0x7f9e4c157cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50680/0 (socket says 172.21.15.60:50680) 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.730+0000 7f9e51733640 1 -- 172.21.15.60:0/345840029 learned_addr learned my addr 172.21.15.60:0/345840029 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.730+0000 7f9e51f34640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e4c0cfc80 0x7f9e4c14a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.730+0000 7f9e52735640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e4c15c330 0x7f9e4c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.731+0000 7f9e51733640 1 -- 172.21.15.60:0/345840029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e4c15c330 msgr2=0x7f9e4c15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.731+0000 7f9e51733640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e4c15c330 0x7f9e4c15a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.731+0000 7f9e51733640 1 -- 172.21.15.60:0/345840029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e4c0cfc80 msgr2=0x7f9e4c14a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.731+0000 7f9e51733640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e4c0cfc80 0x7f9e4c14a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.731+0000 7f9e51733640 1 -- 172.21.15.60:0/345840029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4c155f20 con 0x7f9e4c155800 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.731+0000 7f9e51733640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c155800 0x7f9e4c157cf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00e960 tx=0x7f9e3c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.731+0000 7f9e427fc640 1 -- 172.21.15.60:0/345840029 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c015070 con 0x7f9e4c155800 2024-09-12T01:36:39.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.731+0000 7f9e427fc640 1 -- 172.21.15.60:0/345840029 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e3c005ce0 con 0x7f9e4c155800 2024-09-12T01:36:39.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.731+0000 7f9e54198640 1 -- 172.21.15.60:0/345840029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e4c156200 con 0x7f9e4c155800 2024-09-12T01:36:39.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.731+0000 7f9e427fc640 1 -- 172.21.15.60:0/345840029 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00ca50 con 0x7f9e4c155800 2024-09-12T01:36:39.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.731+0000 7f9e54198640 1 -- 172.21.15.60:0/345840029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e4c1567c0 con 0x7f9e4c155800 2024-09-12T01:36:39.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.732+0000 7f9e54198640 1 -- 172.21.15.60:0/345840029 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e4c1569c0 con 0x7f9e4c155800 2024-09-12T01:36:39.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.732+0000 7f9e427fc640 1 -- 172.21.15.60:0/345840029 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e3c018070 con 0x7f9e4c155800 2024-09-12T01:36:39.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.733+0000 7f9e427fc640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9e3006be30 0x7f9e3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:39.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.733+0000 7f9e427fc640 1 -- 172.21.15.60:0/345840029 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9e3c08d180 con 0x7f9e4c155800 2024-09-12T01:36:39.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.733+0000 7f9e51f34640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9e3006be30 0x7f9e3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:39.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.733+0000 7f9e51f34640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9e3006be30 0x7f9e3006e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e48034000 tx=0x7f9e4802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:39.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.737+0000 7f9e427fc640 1 -- 172.21.15.60:0/345840029 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e3c05b570 con 0x7f9e4c155800 2024-09-12T01:36:39.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.912+0000 7f9e54198640 1 -- 172.21.15.60:0/345840029 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e4c15bc80 con 0x7f9e3006be30 2024-09-12T01:36:39.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.918+0000 7f9e427fc640 1 -- 172.21.15.60:0/345840029 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239643 (secure 0 0 0) 0x7f9e4c15bc80 con 0x7f9e3006be30 2024-09-12T01:36:39.920 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:39.922 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:36:39.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.921+0000 7f9e54198640 1 -- 172.21.15.60:0/345840029 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9e3006be30 msgr2=0x7f9e3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.921+0000 7f9e54198640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9e3006be30 0x7f9e3006e2f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e48034000 tx=0x7f9e4802e000 comp rx=0 tx=0).stop 2024-09-12T01:36:39.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.921+0000 7f9e54198640 1 -- 172.21.15.60:0/345840029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c155800 msgr2=0x7f9e4c157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:39.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.921+0000 7f9e54198640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c155800 0x7f9e4c157cf0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00e960 tx=0x7f9e3c00ee20 comp rx=0 tx=0).stop 2024-09-12T01:36:39.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.921+0000 7f9e54198640 1 -- 172.21.15.60:0/345840029 shutdown_connections 2024-09-12T01:36:39.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.921+0000 7f9e54198640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9e3006be30 0x7f9e3006e2f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.921+0000 7f9e54198640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e4c15c330 0x7f9e4c15a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.921+0000 7f9e54198640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e4c155800 0x7f9e4c157cf0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.921+0000 7f9e54198640 1 --2- 172.21.15.60:0/345840029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e4c0cfc80 0x7f9e4c14a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:39.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.921+0000 7f9e54198640 1 -- 172.21.15.60:0/345840029 >> 172.21.15.60:0/345840029 conn(0x7f9e4c06bc10 msgr2=0x7f9e4c0ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:39.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.921+0000 7f9e54198640 1 -- 172.21.15.60:0/345840029 shutdown_connections 2024-09-12T01:36:39.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:39.921+0000 7f9e54198640 1 -- 172.21.15.60:0/345840029 wait complete. 2024-09-12T01:36:39.932 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-12T01:36:38.267737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":240828,"kb_used_data":3780,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733892,"statfs":{"total":773094113280,"available":772847505408,"internally_reserved":0,"allocated":3870720,"data_stored":2163965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000616"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917752+0000","last_change":"2024-09-12T01:36:34.917752+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917752+0000","last_undegraded":"2024-09-12T01:36:34.917752+0000","last_fullsized":"2024-09-12T01:36:34.917752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:34.906027+0000","last_change":"2024-09-12T01:36:34.906027+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.906027+0000","last_undegraded":"2024-09-12T01:36:34.906027+0000","last_fullsized":"2024-09-12T01:36:34.906027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917729+0000","last_change":"2024-09-12T01:36:34.917729+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917729+0000","last_undegraded":"2024-09-12T01:36:34.917729+0000","last_fullsized":"2024-09-12T01:36:34.917729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:34.906027+0000","last_change":"2024-09-12T01:36:34.906027+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.906027+0000","last_undegraded":"2024-09-12T01:36:34.906027+0000","last_fullsized":"2024-09-12T01:36:34.906027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.916084+0000","last_change":"2024-09-12T01:36:34.916084+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.916084+0000","last_undegraded":"2024-09-12T01:36:34.916084+0000","last_fullsized":"2024-09-12T01:36:34.916084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915892+0000","last_change":"2024-09-12T01:36:34.915892+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915892+0000","last_undegraded":"2024-09-12T01:36:34.915892+0000","last_fullsized":"2024-09-12T01:36:34.915892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917744+0000","last_change":"2024-09-12T01:36:34.917744+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917744+0000","last_undegraded":"2024-09-12T01:36:34.917744+0000","last_fullsized":"2024-09-12T01:36:34.917744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915520+0000","last_change":"2024-09-12T01:36:34.915520+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915520+0000","last_undegraded":"2024-09-12T01:36:34.915520+0000","last_fullsized":"2024-09-12T01:36:34.915520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915615+0000","last_change":"2024-09-12T01:36:34.915615+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915615+0000","last_undegraded":"2024-09-12T01:36:34.915615+0000","last_fullsized":"2024-09-12T01:36:34.915615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915727+0000","last_change":"2024-09-12T01:36:34.915727+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915727+0000","last_undegraded":"2024-09-12T01:36:34.915727+0000","last_fullsized":"2024-09-12T01:36:34.915727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.918919+0000","last_change":"2024-09-12T01:36:34.918919+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.918919+0000","last_undegraded":"2024-09-12T01:36:34.918919+0000","last_fullsized":"2024-09-12T01:36:34.918919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.923483+0000","last_change":"2024-09-12T01:36:34.923483+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.923483+0000","last_undegraded":"2024-09-12T01:36:34.923483+0000","last_fullsized":"2024-09-12T01:36:34.923483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915372+0000","last_change":"2024-09-12T01:36:34.915372+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915372+0000","last_undegraded":"2024-09-12T01:36:34.915372+0000","last_fullsized":"2024-09-12T01:36:34.915372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:34.906027+0000","last_change":"2024-09-12T01:36:34.906027+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.906027+0000","last_undegraded":"2024-09-12T01:36:34.906027+0000","last_fullsized":"2024-09-12T01:36:34.906027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:34.906027+0000","last_change":"2024-09-12T01:36:34.906027+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.906027+0000","last_undegraded":"2024-09-12T01:36:34.906027+0000","last_fullsized":"2024-09-12T01:36:34.906027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917800+0000","last_change":"2024-09-12T01:36:34.917800+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917800+0000","last_undegraded":"2024-09-12T01:36:34.917800+0000","last_fullsized":"2024-09-12T01:36:34.917800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.918052+0000","last_change":"2024-09-12T01:36:34.918052+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.918052+0000","last_undegraded":"2024-09-12T01:36:34.918052+0000","last_fullsized":"2024-09-12T01:36:34.918052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915402+0000","last_change":"2024-09-12T01:36:34.915402+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915402+0000","last_undegraded":"2024-09-12T01:36:34.915402+0000","last_fullsized":"2024-09-12T01:36:34.915402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.918396+0000","last_change":"2024-09-12T01:36:34.918396+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.918396+0000","last_undegraded":"2024-09-12T01:36:34.918396+0000","last_fullsized":"2024-09-12T01:36:34.918396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.913221+0000","last_change":"2024-09-12T01:36:34.913221+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.913221+0000","last_undegraded":"2024-09-12T01:36:34.913221+0000","last_fullsized":"2024-09-12T01:36:34.913221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915167+0000","last_change":"2024-09-12T01:36:34.915167+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915167+0000","last_undegraded":"2024-09-12T01:36:34.915167+0000","last_fullsized":"2024-09-12T01:36:34.915167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915322+0000","last_change":"2024-09-12T01:36:34.915322+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915322+0000","last_undegraded":"2024-09-12T01:36:34.915322+0000","last_fullsized":"2024-09-12T01:36:34.915322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.913131+0000","last_change":"2024-09-12T01:36:34.913131+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.913131+0000","last_undegraded":"2024-09-12T01:36:34.913131+0000","last_fullsized":"2024-09-12T01:36:34.913131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917760+0000","last_change":"2024-09-12T01:36:34.917760+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917760+0000","last_undegraded":"2024-09-12T01:36:34.917760+0000","last_fullsized":"2024-09-12T01:36:34.917760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922697+0000","last_change":"2024-09-12T01:36:34.922697+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922697+0000","last_undegraded":"2024-09-12T01:36:34.922697+0000","last_fullsized":"2024-09-12T01:36:34.922697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915198+0000","last_change":"2024-09-12T01:36:34.915198+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915198+0000","last_undegraded":"2024-09-12T01:36:34.915198+0000","last_fullsized":"2024-09-12T01:36:34.915198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922947+0000","last_change":"2024-09-12T01:36:34.922947+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922947+0000","last_undegraded":"2024-09-12T01:36:34.922947+0000","last_fullsized":"2024-09-12T01:36:34.922947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922734+0000","last_change":"2024-09-12T01:36:34.922734+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922734+0000","last_undegraded":"2024-09-12T01:36:34.922734+0000","last_fullsized":"2024-09-12T01:36:34.922734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922683+0000","last_change":"2024-09-12T01:36:34.922683+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922683+0000","last_undegraded":"2024-09-12T01:36:34.922683+0000","last_fullsized":"2024-09-12T01:36:34.922683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915279+0000","last_change":"2024-09-12T01:36:34.915279+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915279+0000","last_undegraded":"2024-09-12T01:36:34.915279+0000","last_fullsized":"2024-09-12T01:36:34.915279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:34.906027+0000","last_change":"2024-09-12T01:36:34.906027+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.906027+0000","last_undegraded":"2024-09-12T01:36:34.906027+0000","last_fullsized":"2024-09-12T01:36:34.906027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917934+0000","last_change":"2024-09-12T01:36:34.917934+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917934+0000","last_undegraded":"2024-09-12T01:36:34.917934+0000","last_fullsized":"2024-09-12T01:36:34.917934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T01:36:34.912937+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:36:34.912937+0000","last_peered":"2024-09-12T01:36:34.912937+0000","last_clean":"2024-09-12T01:36:34.912937+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:36:34.912937+0000","last_undegraded":"2024-09-12T01:36:34.912937+0000","last_fullsized":"2024-09-12T01:36:34.912937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35680,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336160,"statfs":{"total":96636764160,"available":96600227840,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:36:39.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:36:40.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.076+0000 7fa329a80640 1 Processor -- start 2024-09-12T01:36:40.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.076+0000 7fa329a80640 1 -- start start 2024-09-12T01:36:40.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.077+0000 7fa329a80640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa3240d1c80 0x7fa3240b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.077+0000 7fa329a80640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3240cfc20 con 0x7fa3240b63d0 2024-09-12T01:36:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.077+0000 7fa329a80640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3240d2ed0 con 0x7fa3240cf6b0 2024-09-12T01:36:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.077+0000 7fa329a80640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa3240d40c0 con 0x7fa3240d1c80 2024-09-12T01:36:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.077+0000 7fa3237fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa3240b63d0 0x7fa3240d39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40068/0 (socket says 172.21.15.60:40068) 2024-09-12T01:36:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.077+0000 7fa3237fe640 1 -- 172.21.15.60:0/1165612647 learned_addr learned my addr 172.21.15.60:0/1165612647 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.077+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827604676 0 0) 0x7fa3240cfc20 con 0x7fa3240b63d0 2024-09-12T01:36:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.077+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa30c003520 con 0x7fa3240b63d0 2024-09-12T01:36:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.077+0000 7fa323fff640 1 --2- 172.21.15.60:0/1165612647 >> v2:172.21.15.105:3300/0 conn(0x7fa3240d1c80 0x7fa3240b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 393648329 0 0) 0x7fa30c003520 con 0x7fa3240b63d0 2024-09-12T01:36:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 >> v2:172.21.15.105:3300/0 conn(0x7fa3240d1c80 msgr2=0x7fa3240b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:40.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 --2- 172.21.15.60:0/1165612647 >> v2:172.21.15.105:3300/0 conn(0x7fa3240d1c80 0x7fa3240b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 >> v1:172.21.15.105:6789/0 conn(0x7fa3240cf6b0 legacy=0x7fa3241629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3240d31b0 con 0x7fa3240b63d0 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fa314001670 con 0x7fa3240b63d0 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 >> v1:172.21.15.60:6789/0 conn(0x7fa3240b63d0 legacy=0x7fa3240d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 --2- 172.21.15.60:0/1165612647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c0039b0 0x7fa30c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 --2- 172.21.15.60:0/1165612647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30c004800 0x7fa30c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 --2- 172.21.15.60:0/1165612647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa30c0051c0 0x7fa30c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3240d40c0 con 0x7fa30c0039b0 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa30c00c160 con 0x7fa30c004800 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa30c00c360 con 0x7fa30c0051c0 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3237fe640 1 --2- 172.21.15.60:0/1165612647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c0039b0 0x7fa30c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa322ffd640 1 --2- 172.21.15.60:0/1165612647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30c004800 0x7fa30c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa323fff640 1 --2- 172.21.15.60:0/1165612647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa30c0051c0 0x7fa30c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3237fe640 1 -- 172.21.15.60:0/1165612647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa30c0051c0 msgr2=0x7fa30c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3237fe640 1 --2- 172.21.15.60:0/1165612647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa30c0051c0 0x7fa30c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3237fe640 1 -- 172.21.15.60:0/1165612647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30c004800 msgr2=0x7fa30c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3237fe640 1 --2- 172.21.15.60:0/1165612647 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa30c004800 0x7fa30c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa3237fe640 1 -- 172.21.15.60:0/1165612647 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30c003520 con 0x7fa30c0039b0 2024-09-12T01:36:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.078+0000 7fa323fff640 1 -- 172.21.15.60:0/1165612647 reap_dead start 2024-09-12T01:36:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.079+0000 7fa3237fe640 1 --2- 172.21.15.60:0/1165612647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c0039b0 0x7fa30c003dd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c290 tx=0x7fa30c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496eb7c8e210dd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.079+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314007d30 con 0x7fa30c0039b0 2024-09-12T01:36:40.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.079+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa314005af0 con 0x7fa30c0039b0 2024-09-12T01:36:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.079+0000 7fa3227fc640 1 -- 172.21.15.60:0/1165612647 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314007070 con 0x7fa30c0039b0 2024-09-12T01:36:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.079+0000 7fa329a80640 1 -- 172.21.15.60:0/1165612647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c0039b0 msgr2=0x7fa30c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.079+0000 7fa329a80640 1 --2- 172.21.15.60:0/1165612647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c0039b0 0x7fa30c003dd0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c290 tx=0x7fa30c005830 comp rx=0 tx=0).stop 2024-09-12T01:36:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.080+0000 7fa329a80640 1 -- 172.21.15.60:0/1165612647 shutdown_connections 2024-09-12T01:36:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.080+0000 7fa329a80640 1 --2- 172.21.15.60:0/1165612647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa30c0039b0 0x7fa30c003dd0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.080+0000 7fa329a80640 1 -- 172.21.15.60:0/1165612647 >> 172.21.15.60:0/1165612647 conn(0x7fa3240d1160 msgr2=0x7fa3240d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.080+0000 7fa329a80640 1 -- 172.21.15.60:0/1165612647 shutdown_connections 2024-09-12T01:36:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.080+0000 7fa329a80640 1 -- 172.21.15.60:0/1165612647 wait complete. 2024-09-12T01:36:40.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.081+0000 7fa329a80640 1 Processor -- start 2024-09-12T01:36:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.081+0000 7fa329a80640 1 -- start start 2024-09-12T01:36:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa329a80640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa30c0039b0 0x7fa3240cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa329a80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3241602f0 0x7fa3240c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa329a80640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa324160770 0x7fa3240c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa329a80640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3240cb5c0 con 0x7fa3241602f0 2024-09-12T01:36:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa329a80640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3240cb440 con 0x7fa324160770 2024-09-12T01:36:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa329a80640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3240b67b0 con 0x7fa30c0039b0 2024-09-12T01:36:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa322ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3241602f0 0x7fa3240c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa322ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3241602f0 0x7fa3240c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50700/0 (socket says 172.21.15.60:50700) 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa322ffd640 1 -- 172.21.15.60:0/386181745 learned_addr learned my addr 172.21.15.60:0/386181745 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa323fff640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa324160770 0x7fa3240c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa3237fe640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa30c0039b0 0x7fa3240cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa322ffd640 1 -- 172.21.15.60:0/386181745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa30c0039b0 msgr2=0x7fa3240cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa322ffd640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa30c0039b0 0x7fa3240cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa322ffd640 1 -- 172.21.15.60:0/386181745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa324160770 msgr2=0x7fa3240c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa322ffd640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa324160770 0x7fa3240c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa322ffd640 1 -- 172.21.15.60:0/386181745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3240ccab0 con 0x7fa3241602f0 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa323fff640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa324160770 0x7fa3240c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa322ffd640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3241602f0 0x7fa3240c8c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa31800f620 tx=0x7fa31800fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa30bfff640 1 -- 172.21.15.60:0/386181745 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3180052e0 con 0x7fa3241602f0 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa30bfff640 1 -- 172.21.15.60:0/386181745 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa318018070 con 0x7fa3241602f0 2024-09-12T01:36:40.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa329a80640 1 -- 172.21.15.60:0/386181745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3240ccd90 con 0x7fa3241602f0 2024-09-12T01:36:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.082+0000 7fa30bfff640 1 -- 172.21.15.60:0/386181745 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318003810 con 0x7fa3241602f0 2024-09-12T01:36:40.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.083+0000 7fa329a80640 1 -- 172.21.15.60:0/386181745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3240cd350 con 0x7fa3241602f0 2024-09-12T01:36:40.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.083+0000 7fa329a80640 1 -- 172.21.15.60:0/386181745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3240d39b0 con 0x7fa3241602f0 2024-09-12T01:36:40.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.084+0000 7fa30bfff640 1 -- 172.21.15.60:0/386181745 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa3180039b0 con 0x7fa3241602f0 2024-09-12T01:36:40.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.084+0000 7fa30bfff640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa31006be30 0x7fa31006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.085+0000 7fa30bfff640 1 -- 172.21.15.60:0/386181745 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa31808acf0 con 0x7fa3241602f0 2024-09-12T01:36:40.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.085+0000 7fa3237fe640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa31006be30 0x7fa31006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.085+0000 7fa3237fe640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa31006be30 0x7fa31006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa314032000 tx=0x7fa314009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:40.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.089+0000 7fa30bfff640 1 -- 172.21.15.60:0/386181745 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa318059600 con 0x7fa3241602f0 2024-09-12T01:36:40.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.262+0000 7fa329a80640 1 -- 172.21.15.60:0/386181745 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3240c7f20 con 0x7fa31006be30 2024-09-12T01:36:40.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.268+0000 7fa30bfff640 1 -- 172.21.15.60:0/386181745 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239643 (secure 0 0 0) 0x7fa3240c7f20 con 0x7fa31006be30 2024-09-12T01:36:40.270 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:40.271 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:36:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.271+0000 7fa329a80640 1 -- 172.21.15.60:0/386181745 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa31006be30 msgr2=0x7fa31006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.271+0000 7fa329a80640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa31006be30 0x7fa31006e2f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa314032000 tx=0x7fa314009030 comp rx=0 tx=0).stop 2024-09-12T01:36:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.271+0000 7fa329a80640 1 -- 172.21.15.60:0/386181745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3241602f0 msgr2=0x7fa3240c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.271+0000 7fa329a80640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3241602f0 0x7fa3240c8c20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa31800f620 tx=0x7fa31800fae0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.271+0000 7fa329a80640 1 -- 172.21.15.60:0/386181745 shutdown_connections 2024-09-12T01:36:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.271+0000 7fa329a80640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa324160770 0x7fa3240c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.271+0000 7fa329a80640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3241602f0 0x7fa3240c8c20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.271+0000 7fa329a80640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa31006be30 0x7fa31006e2f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.271+0000 7fa329a80640 1 --2- 172.21.15.60:0/386181745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa30c0039b0 0x7fa3240cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.271+0000 7fa329a80640 1 -- 172.21.15.60:0/386181745 >> 172.21.15.60:0/386181745 conn(0x7fa3240d1160 msgr2=0x7fa3240b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.271+0000 7fa329a80640 1 -- 172.21.15.60:0/386181745 shutdown_connections 2024-09-12T01:36:40.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.271+0000 7fa329a80640 1 -- 172.21.15.60:0/386181745 wait complete. 2024-09-12T01:36:40.285 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-12T01:36:38.267737+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":240828,"kb_used_data":3780,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733892,"statfs":{"total":773094113280,"available":772847505408,"internally_reserved":0,"allocated":3870720,"data_stored":2163965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000616"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917752+0000","last_change":"2024-09-12T01:36:34.917752+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917752+0000","last_undegraded":"2024-09-12T01:36:34.917752+0000","last_fullsized":"2024-09-12T01:36:34.917752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:34.906027+0000","last_change":"2024-09-12T01:36:34.906027+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.906027+0000","last_undegraded":"2024-09-12T01:36:34.906027+0000","last_fullsized":"2024-09-12T01:36:34.906027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917729+0000","last_change":"2024-09-12T01:36:34.917729+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917729+0000","last_undegraded":"2024-09-12T01:36:34.917729+0000","last_fullsized":"2024-09-12T01:36:34.917729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:34.906027+0000","last_change":"2024-09-12T01:36:34.906027+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.906027+0000","last_undegraded":"2024-09-12T01:36:34.906027+0000","last_fullsized":"2024-09-12T01:36:34.906027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.916084+0000","last_change":"2024-09-12T01:36:34.916084+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.916084+0000","last_undegraded":"2024-09-12T01:36:34.916084+0000","last_fullsized":"2024-09-12T01:36:34.916084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915892+0000","last_change":"2024-09-12T01:36:34.915892+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915892+0000","last_undegraded":"2024-09-12T01:36:34.915892+0000","last_fullsized":"2024-09-12T01:36:34.915892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917744+0000","last_change":"2024-09-12T01:36:34.917744+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917744+0000","last_undegraded":"2024-09-12T01:36:34.917744+0000","last_fullsized":"2024-09-12T01:36:34.917744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915520+0000","last_change":"2024-09-12T01:36:34.915520+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915520+0000","last_undegraded":"2024-09-12T01:36:34.915520+0000","last_fullsized":"2024-09-12T01:36:34.915520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915615+0000","last_change":"2024-09-12T01:36:34.915615+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915615+0000","last_undegraded":"2024-09-12T01:36:34.915615+0000","last_fullsized":"2024-09-12T01:36:34.915615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915727+0000","last_change":"2024-09-12T01:36:34.915727+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915727+0000","last_undegraded":"2024-09-12T01:36:34.915727+0000","last_fullsized":"2024-09-12T01:36:34.915727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.918919+0000","last_change":"2024-09-12T01:36:34.918919+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.918919+0000","last_undegraded":"2024-09-12T01:36:34.918919+0000","last_fullsized":"2024-09-12T01:36:34.918919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.923483+0000","last_change":"2024-09-12T01:36:34.923483+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.923483+0000","last_undegraded":"2024-09-12T01:36:34.923483+0000","last_fullsized":"2024-09-12T01:36:34.923483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915372+0000","last_change":"2024-09-12T01:36:34.915372+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915372+0000","last_undegraded":"2024-09-12T01:36:34.915372+0000","last_fullsized":"2024-09-12T01:36:34.915372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:34.906027+0000","last_change":"2024-09-12T01:36:34.906027+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.906027+0000","last_undegraded":"2024-09-12T01:36:34.906027+0000","last_fullsized":"2024-09-12T01:36:34.906027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:34.906027+0000","last_change":"2024-09-12T01:36:34.906027+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.906027+0000","last_undegraded":"2024-09-12T01:36:34.906027+0000","last_fullsized":"2024-09-12T01:36:34.906027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917800+0000","last_change":"2024-09-12T01:36:34.917800+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917800+0000","last_undegraded":"2024-09-12T01:36:34.917800+0000","last_fullsized":"2024-09-12T01:36:34.917800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.918052+0000","last_change":"2024-09-12T01:36:34.918052+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.918052+0000","last_undegraded":"2024-09-12T01:36:34.918052+0000","last_fullsized":"2024-09-12T01:36:34.918052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915402+0000","last_change":"2024-09-12T01:36:34.915402+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915402+0000","last_undegraded":"2024-09-12T01:36:34.915402+0000","last_fullsized":"2024-09-12T01:36:34.915402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.918396+0000","last_change":"2024-09-12T01:36:34.918396+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.918396+0000","last_undegraded":"2024-09-12T01:36:34.918396+0000","last_fullsized":"2024-09-12T01:36:34.918396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.913221+0000","last_change":"2024-09-12T01:36:34.913221+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.913221+0000","last_undegraded":"2024-09-12T01:36:34.913221+0000","last_fullsized":"2024-09-12T01:36:34.913221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915167+0000","last_change":"2024-09-12T01:36:34.915167+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915167+0000","last_undegraded":"2024-09-12T01:36:34.915167+0000","last_fullsized":"2024-09-12T01:36:34.915167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915322+0000","last_change":"2024-09-12T01:36:34.915322+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915322+0000","last_undegraded":"2024-09-12T01:36:34.915322+0000","last_fullsized":"2024-09-12T01:36:34.915322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.913131+0000","last_change":"2024-09-12T01:36:34.913131+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.913131+0000","last_undegraded":"2024-09-12T01:36:34.913131+0000","last_fullsized":"2024-09-12T01:36:34.913131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917760+0000","last_change":"2024-09-12T01:36:34.917760+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917760+0000","last_undegraded":"2024-09-12T01:36:34.917760+0000","last_fullsized":"2024-09-12T01:36:34.917760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922697+0000","last_change":"2024-09-12T01:36:34.922697+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922697+0000","last_undegraded":"2024-09-12T01:36:34.922697+0000","last_fullsized":"2024-09-12T01:36:34.922697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915198+0000","last_change":"2024-09-12T01:36:34.915198+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915198+0000","last_undegraded":"2024-09-12T01:36:34.915198+0000","last_fullsized":"2024-09-12T01:36:34.915198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922947+0000","last_change":"2024-09-12T01:36:34.922947+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922947+0000","last_undegraded":"2024-09-12T01:36:34.922947+0000","last_fullsized":"2024-09-12T01:36:34.922947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922734+0000","last_change":"2024-09-12T01:36:34.922734+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922734+0000","last_undegraded":"2024-09-12T01:36:34.922734+0000","last_fullsized":"2024-09-12T01:36:34.922734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922683+0000","last_change":"2024-09-12T01:36:34.922683+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922683+0000","last_undegraded":"2024-09-12T01:36:34.922683+0000","last_fullsized":"2024-09-12T01:36:34.922683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915279+0000","last_change":"2024-09-12T01:36:34.915279+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915279+0000","last_undegraded":"2024-09-12T01:36:34.915279+0000","last_fullsized":"2024-09-12T01:36:34.915279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:34.906027+0000","last_change":"2024-09-12T01:36:34.906027+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.906027+0000","last_undegraded":"2024-09-12T01:36:34.906027+0000","last_fullsized":"2024-09-12T01:36:34.906027+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917934+0000","last_change":"2024-09-12T01:36:34.917934+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917934+0000","last_undegraded":"2024-09-12T01:36:34.917934+0000","last_fullsized":"2024-09-12T01:36:34.917934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T01:36:34.912937+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:36:34.912937+0000","last_peered":"2024-09-12T01:36:34.912937+0000","last_clean":"2024-09-12T01:36:34.912937+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:36:34.912937+0000","last_undegraded":"2024-09-12T01:36:34.912937+0000","last_fullsized":"2024-09-12T01:36:34.912937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35680,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336160,"statfs":{"total":96636764160,"available":96600227840,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:36:40.289 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:36:40.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.428+0000 7f2a9205e640 1 Processor -- start 2024-09-12T01:36:40.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.429+0000 7f2a9205e640 1 -- start start 2024-09-12T01:36:40.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.429+0000 7f2a9205e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a8c15c170 0x7f2a8c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.429+0000 7f2a9205e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2a8c0cf6c0 0x7f2a8c0cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.429+0000 7f2a9205e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2a8c0b5dd0 0x7f2a8c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.429+0000 7f2a9205e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2a8c15ca90 con 0x7f2a8c0b5dd0 2024-09-12T01:36:40.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.429+0000 7f2a9205e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2a8c0b4cf0 con 0x7f2a8c0cf6c0 2024-09-12T01:36:40.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.429+0000 7f2a9205e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2a8c0b4fd0 con 0x7f2a8c15c170 2024-09-12T01:36:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.430+0000 7f2a8bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2a8c0b5dd0 0x7f2a8c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.430+0000 7f2a8bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2a8c0b5dd0 0x7f2a8c0b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50716/0 (socket says 172.21.15.60:50716) 2024-09-12T01:36:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.430+0000 7f2a8bfff640 1 -- 172.21.15.60:0/3753049625 learned_addr learned my addr 172.21.15.60:0/3753049625 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.430+0000 7f2a8bfff640 1 -- 172.21.15.60:0/3753049625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a8c15c170 msgr2=0x7f2a8c15c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.430+0000 7f2a8bfff640 1 --2- 172.21.15.60:0/3753049625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a8c15c170 0x7f2a8c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.430+0000 7f2a8bfff640 1 -- 172.21.15.60:0/3753049625 >> v2:172.21.15.105:3300/0 conn(0x7f2a8c0cf6c0 msgr2=0x7f2a8c0cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.430+0000 7f2a8bfff640 1 --2- 172.21.15.60:0/3753049625 >> v2:172.21.15.105:3300/0 conn(0x7f2a8c0cf6c0 0x7f2a8c0cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.430+0000 7f2a8bfff640 1 -- 172.21.15.60:0/3753049625 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8c0b52b0 con 0x7f2a8c0b5dd0 2024-09-12T01:36:40.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a8bfff640 1 --2- 172.21.15.60:0/3753049625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a8c0b5dd0 0x7f2a8c0b6260 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c06c960 tx=0x7f2a8402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb9abc4ee954e64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:40.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a8a7fc640 1 -- 172.21.15.60:0/3753049625 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84036070 con 0x7f2a8c0b5dd0 2024-09-12T01:36:40.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a8a7fc640 1 -- 172.21.15.60:0/3753049625 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a84031600 con 0x7f2a8c0b5dd0 2024-09-12T01:36:40.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a8a7fc640 1 -- 172.21.15.60:0/3753049625 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a840319d0 con 0x7f2a8c0b5dd0 2024-09-12T01:36:40.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a9205e640 1 -- 172.21.15.60:0/3753049625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a8c0b5dd0 msgr2=0x7f2a8c0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a9205e640 1 --2- 172.21.15.60:0/3753049625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a8c0b5dd0 0x7f2a8c0b6260 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c06c960 tx=0x7f2a8402a6a0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a9205e640 1 -- 172.21.15.60:0/3753049625 shutdown_connections 2024-09-12T01:36:40.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a9205e640 1 --2- 172.21.15.60:0/3753049625 >> v2:172.21.15.105:3300/0 conn(0x7f2a8c0cf6c0 0x7f2a8c0cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a9205e640 1 --2- 172.21.15.60:0/3753049625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a8c0b5dd0 0x7f2a8c0b6260 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a9205e640 1 --2- 172.21.15.60:0/3753049625 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a8c15c170 0x7f2a8c15c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a9205e640 1 -- 172.21.15.60:0/3753049625 >> 172.21.15.60:0/3753049625 conn(0x7f2a8c06bc10 msgr2=0x7f2a8c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a9205e640 1 -- 172.21.15.60:0/3753049625 shutdown_connections 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.431+0000 7f2a9205e640 1 -- 172.21.15.60:0/3753049625 wait complete. 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.432+0000 7f2a9205e640 1 Processor -- start 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.433+0000 7f2a9205e640 1 -- start start 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.433+0000 7f2a9205e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a8c0b5dd0 0x7f2a8c158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.433+0000 7f2a9205e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a8c0cf6c0 0x7f2a8c152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.433+0000 7f2a9205e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a8c15c170 0x7f2a8c15d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.433+0000 7f2a9205e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c0b5b50 con 0x7f2a8c15c170 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.433+0000 7f2a9205e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8c0b5870 con 0x7f2a8c0cf6c0 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.433+0000 7f2a9205e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2a8c15ffb0 con 0x7f2a8c0b5dd0 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.433+0000 7f2a8bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a8c15c170 0x7f2a8c15d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a8bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a8c15c170 0x7f2a8c15d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50724/0 (socket says 172.21.15.60:50724) 2024-09-12T01:36:40.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a8bfff640 1 -- 172.21.15.60:0/3389677739 learned_addr learned my addr 172.21.15.60:0/3389677739 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a8b7fe640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a8c0b5dd0 0x7f2a8c158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a8affd640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a8c0cf6c0 0x7f2a8c152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a8bfff640 1 -- 172.21.15.60:0/3389677739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a8c0b5dd0 msgr2=0x7f2a8c158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a8bfff640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a8c0b5dd0 0x7f2a8c158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a8bfff640 1 -- 172.21.15.60:0/3389677739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a8c0cf6c0 msgr2=0x7f2a8c152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a8bfff640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a8c0cf6c0 0x7f2a8c152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a8bfff640 1 -- 172.21.15.60:0/3389677739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8c155970 con 0x7f2a8c15c170 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a8affd640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a8c0cf6c0 0x7f2a8c152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a8bfff640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a8c15c170 0x7f2a8c15d400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2a84034040 tx=0x7f2a84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a73fff640 1 -- 172.21.15.60:0/3389677739 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84041020 con 0x7f2a8c15c170 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a73fff640 1 -- 172.21.15.60:0/3389677739 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a840077a0 con 0x7f2a8c15c170 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a73fff640 1 -- 172.21.15.60:0/3389677739 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84036040 con 0x7f2a8c15c170 2024-09-12T01:36:40.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a9205e640 1 -- 172.21.15.60:0/3389677739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8c155c50 con 0x7f2a8c15c170 2024-09-12T01:36:40.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.434+0000 7f2a9205e640 1 -- 172.21.15.60:0/3389677739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a8c15d940 con 0x7f2a8c15c170 2024-09-12T01:36:40.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.435+0000 7f2a9205e640 1 -- 172.21.15.60:0/3389677739 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a8c15c550 con 0x7f2a8c15c170 2024-09-12T01:36:40.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.436+0000 7f2a73fff640 1 -- 172.21.15.60:0/3389677739 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a84044020 con 0x7f2a8c15c170 2024-09-12T01:36:40.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.436+0000 7f2a73fff640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a7806be30 0x7f2a7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.436+0000 7f2a73fff640 1 -- 172.21.15.60:0/3389677739 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2a840abb30 con 0x7f2a8c15c170 2024-09-12T01:36:40.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.436+0000 7f2a8b7fe640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a7806be30 0x7f2a7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.437+0000 7f2a8b7fe640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a7806be30 0x7f2a7806e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0098e0 tx=0x7f2a7c009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:40.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.441+0000 7f2a73fff640 1 -- 172.21.15.60:0/3389677739 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a8404b030 con 0x7f2a8c15c170 2024-09-12T01:36:40.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.614+0000 7f2a9205e640 1 -- 172.21.15.60:0/3389677739 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a8c06d360 con 0x7f2a7806be30 2024-09-12T01:36:40.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.620+0000 7f2a73fff640 1 -- 172.21.15.60:0/3389677739 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242073 (secure 0 0 0) 0x7f2a8c06d360 con 0x7f2a7806be30 2024-09-12T01:36:40.622 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:40.623 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:36:40.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.623+0000 7f2a9205e640 1 -- 172.21.15.60:0/3389677739 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a7806be30 msgr2=0x7f2a7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.623+0000 7f2a9205e640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a7806be30 0x7f2a7806e2f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0098e0 tx=0x7f2a7c009060 comp rx=0 tx=0).stop 2024-09-12T01:36:40.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.623+0000 7f2a9205e640 1 -- 172.21.15.60:0/3389677739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a8c15c170 msgr2=0x7f2a8c15d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.623+0000 7f2a9205e640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a8c15c170 0x7f2a8c15d400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2a84034040 tx=0x7f2a84004a40 comp rx=0 tx=0).stop 2024-09-12T01:36:40.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.623+0000 7f2a9205e640 1 -- 172.21.15.60:0/3389677739 shutdown_connections 2024-09-12T01:36:40.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.623+0000 7f2a9205e640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a8c15c170 0x7f2a8c15d400 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.623+0000 7f2a9205e640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a8c0cf6c0 0x7f2a8c152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.623+0000 7f2a9205e640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a7806be30 0x7f2a7806e2f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.623+0000 7f2a9205e640 1 --2- 172.21.15.60:0/3389677739 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a8c0b5dd0 0x7f2a8c158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.623+0000 7f2a9205e640 1 -- 172.21.15.60:0/3389677739 >> 172.21.15.60:0/3389677739 conn(0x7f2a8c06bc10 msgr2=0x7f2a8c0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:40.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.624+0000 7f2a9205e640 1 -- 172.21.15.60:0/3389677739 shutdown_connections 2024-09-12T01:36:40.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.624+0000 7f2a9205e640 1 -- 172.21.15.60:0/3389677739 wait complete. 2024-09-12T01:36:40.634 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-12T01:36:40.268660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240880,"kb_used_data":3832,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733840,"statfs":{"total":773094113280,"available":772847452160,"internally_reserved":0,"allocated":3923968,"data_stored":2184466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.357576"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943920+0000","last_change":"2024-09-12T01:36:36.957801+0000","last_active":"2024-09-12T01:36:37.943920+0000","last_peered":"2024-09-12T01:36:37.943920+0000","last_clean":"2024-09-12T01:36:37.943920+0000","last_became_active":"2024-09-12T01:36:36.957534+0000","last_became_peered":"2024-09-12T01:36:36.957534+0000","last_unstale":"2024-09-12T01:36:37.943920+0000","last_undegraded":"2024-09-12T01:36:37.943920+0000","last_fullsized":"2024-09-12T01:36:37.943920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:50.643715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944308+0000","last_change":"2024-09-12T01:36:36.953248+0000","last_active":"2024-09-12T01:36:37.944308+0000","last_peered":"2024-09-12T01:36:37.944308+0000","last_clean":"2024-09-12T01:36:37.944308+0000","last_became_active":"2024-09-12T01:36:36.952957+0000","last_became_peered":"2024-09-12T01:36:36.952957+0000","last_unstale":"2024-09-12T01:36:37.944308+0000","last_undegraded":"2024-09-12T01:36:37.944308+0000","last_fullsized":"2024-09-12T01:36:37.944308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:21.471509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942927+0000","last_change":"2024-09-12T01:36:36.950183+0000","last_active":"2024-09-12T01:36:37.942927+0000","last_peered":"2024-09-12T01:36:37.942927+0000","last_clean":"2024-09-12T01:36:37.942927+0000","last_became_active":"2024-09-12T01:36:36.949691+0000","last_became_peered":"2024-09-12T01:36:36.949691+0000","last_unstale":"2024-09-12T01:36:37.942927+0000","last_undegraded":"2024-09-12T01:36:37.942927+0000","last_fullsized":"2024-09-12T01:36:37.942927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:43.773335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944292+0000","last_change":"2024-09-12T01:36:36.948968+0000","last_active":"2024-09-12T01:36:37.944292+0000","last_peered":"2024-09-12T01:36:37.944292+0000","last_clean":"2024-09-12T01:36:37.944292+0000","last_became_active":"2024-09-12T01:36:36.948252+0000","last_became_peered":"2024-09-12T01:36:36.948252+0000","last_unstale":"2024-09-12T01:36:37.944292+0000","last_undegraded":"2024-09-12T01:36:37.944292+0000","last_fullsized":"2024-09-12T01:36:37.944292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:37.561280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944268+0000","last_change":"2024-09-12T01:36:36.952664+0000","last_active":"2024-09-12T01:36:37.944268+0000","last_peered":"2024-09-12T01:36:37.944268+0000","last_clean":"2024-09-12T01:36:37.944268+0000","last_became_active":"2024-09-12T01:36:36.949903+0000","last_became_peered":"2024-09-12T01:36:36.949903+0000","last_unstale":"2024-09-12T01:36:37.944268+0000","last_undegraded":"2024-09-12T01:36:37.944268+0000","last_fullsized":"2024-09-12T01:36:37.944268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:07.465038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917752+0000","last_change":"2024-09-12T01:36:34.917752+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917752+0000","last_undegraded":"2024-09-12T01:36:34.917752+0000","last_fullsized":"2024-09-12T01:36:34.917752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944393+0000","last_change":"2024-09-12T01:36:35.929496+0000","last_active":"2024-09-12T01:36:37.944393+0000","last_peered":"2024-09-12T01:36:37.944393+0000","last_clean":"2024-09-12T01:36:37.944393+0000","last_became_active":"2024-09-12T01:36:35.929228+0000","last_became_peered":"2024-09-12T01:36:35.929228+0000","last_unstale":"2024-09-12T01:36:37.944393+0000","last_undegraded":"2024-09-12T01:36:37.944393+0000","last_fullsized":"2024-09-12T01:36:37.944393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:40.249371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917729+0000","last_change":"2024-09-12T01:36:34.917729+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917729+0000","last_undegraded":"2024-09-12T01:36:34.917729+0000","last_fullsized":"2024-09-12T01:36:34.917729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944239+0000","last_change":"2024-09-12T01:36:36.949253+0000","last_active":"2024-09-12T01:36:37.944239+0000","last_peered":"2024-09-12T01:36:37.944239+0000","last_clean":"2024-09-12T01:36:37.944239+0000","last_became_active":"2024-09-12T01:36:36.948587+0000","last_became_peered":"2024-09-12T01:36:36.948587+0000","last_unstale":"2024-09-12T01:36:37.944239+0000","last_undegraded":"2024-09-12T01:36:37.944239+0000","last_fullsized":"2024-09-12T01:36:37.944239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:09.195087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944041+0000","last_change":"2024-09-12T01:36:35.933669+0000","last_active":"2024-09-12T01:36:37.944041+0000","last_peered":"2024-09-12T01:36:37.944041+0000","last_clean":"2024-09-12T01:36:37.944041+0000","last_became_active":"2024-09-12T01:36:35.933265+0000","last_became_peered":"2024-09-12T01:36:35.933265+0000","last_unstale":"2024-09-12T01:36:37.944041+0000","last_undegraded":"2024-09-12T01:36:37.944041+0000","last_fullsized":"2024-09-12T01:36:37.944041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:57.668650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.916084+0000","last_change":"2024-09-12T01:36:34.916084+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.916084+0000","last_undegraded":"2024-09-12T01:36:34.916084+0000","last_fullsized":"2024-09-12T01:36:34.916084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915892+0000","last_change":"2024-09-12T01:36:34.915892+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915892+0000","last_undegraded":"2024-09-12T01:36:34.915892+0000","last_fullsized":"2024-09-12T01:36:34.915892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917744+0000","last_change":"2024-09-12T01:36:34.917744+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917744+0000","last_undegraded":"2024-09-12T01:36:34.917744+0000","last_fullsized":"2024-09-12T01:36:34.917744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942957+0000","last_change":"2024-09-12T01:36:36.949000+0000","last_active":"2024-09-12T01:36:37.942957+0000","last_peered":"2024-09-12T01:36:37.942957+0000","last_clean":"2024-09-12T01:36:37.942957+0000","last_became_active":"2024-09-12T01:36:36.948725+0000","last_became_peered":"2024-09-12T01:36:36.948725+0000","last_unstale":"2024-09-12T01:36:37.942957+0000","last_undegraded":"2024-09-12T01:36:37.942957+0000","last_fullsized":"2024-09-12T01:36:37.942957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:26.769451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915520+0000","last_change":"2024-09-12T01:36:34.915520+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915520+0000","last_undegraded":"2024-09-12T01:36:34.915520+0000","last_fullsized":"2024-09-12T01:36:34.915520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915615+0000","last_change":"2024-09-12T01:36:34.915615+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915615+0000","last_undegraded":"2024-09-12T01:36:34.915615+0000","last_fullsized":"2024-09-12T01:36:34.915615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944291+0000","last_change":"2024-09-12T01:36:36.949700+0000","last_active":"2024-09-12T01:36:37.944291+0000","last_peered":"2024-09-12T01:36:37.944291+0000","last_clean":"2024-09-12T01:36:37.944291+0000","last_became_active":"2024-09-12T01:36:36.949417+0000","last_became_peered":"2024-09-12T01:36:36.949417+0000","last_unstale":"2024-09-12T01:36:37.944291+0000","last_undegraded":"2024-09-12T01:36:37.944291+0000","last_fullsized":"2024-09-12T01:36:37.944291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:11.246164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915727+0000","last_change":"2024-09-12T01:36:34.915727+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915727+0000","last_undegraded":"2024-09-12T01:36:34.915727+0000","last_fullsized":"2024-09-12T01:36:34.915727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943958+0000","last_change":"2024-09-12T01:36:36.958443+0000","last_active":"2024-09-12T01:36:37.943958+0000","last_peered":"2024-09-12T01:36:37.943958+0000","last_clean":"2024-09-12T01:36:37.943958+0000","last_became_active":"2024-09-12T01:36:36.956647+0000","last_became_peered":"2024-09-12T01:36:36.956647+0000","last_unstale":"2024-09-12T01:36:37.943958+0000","last_undegraded":"2024-09-12T01:36:37.943958+0000","last_fullsized":"2024-09-12T01:36:37.943958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:33.625549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.918919+0000","last_change":"2024-09-12T01:36:34.918919+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.918919+0000","last_undegraded":"2024-09-12T01:36:34.918919+0000","last_fullsized":"2024-09-12T01:36:34.918919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.923483+0000","last_change":"2024-09-12T01:36:34.923483+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.923483+0000","last_undegraded":"2024-09-12T01:36:34.923483+0000","last_fullsized":"2024-09-12T01:36:34.923483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915372+0000","last_change":"2024-09-12T01:36:34.915372+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915372+0000","last_undegraded":"2024-09-12T01:36:34.915372+0000","last_fullsized":"2024-09-12T01:36:34.915372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943072+0000","last_change":"2024-09-12T01:36:36.956493+0000","last_active":"2024-09-12T01:36:37.943072+0000","last_peered":"2024-09-12T01:36:37.943072+0000","last_clean":"2024-09-12T01:36:37.943072+0000","last_became_active":"2024-09-12T01:36:36.955918+0000","last_became_peered":"2024-09-12T01:36:36.955918+0000","last_unstale":"2024-09-12T01:36:37.943072+0000","last_undegraded":"2024-09-12T01:36:37.943072+0000","last_fullsized":"2024-09-12T01:36:37.943072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:28.071193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942937+0000","last_change":"2024-09-12T01:36:35.930525+0000","last_active":"2024-09-12T01:36:37.942937+0000","last_peered":"2024-09-12T01:36:37.942937+0000","last_clean":"2024-09-12T01:36:37.942937+0000","last_became_active":"2024-09-12T01:36:35.930304+0000","last_became_peered":"2024-09-12T01:36:35.930304+0000","last_unstale":"2024-09-12T01:36:37.942937+0000","last_undegraded":"2024-09-12T01:36:37.942937+0000","last_fullsized":"2024-09-12T01:36:37.942937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:21.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942798+0000","last_change":"2024-09-12T01:36:35.929417+0000","last_active":"2024-09-12T01:36:37.942798+0000","last_peered":"2024-09-12T01:36:37.942798+0000","last_clean":"2024-09-12T01:36:37.942798+0000","last_became_active":"2024-09-12T01:36:35.928565+0000","last_became_peered":"2024-09-12T01:36:35.928565+0000","last_unstale":"2024-09-12T01:36:37.942798+0000","last_undegraded":"2024-09-12T01:36:37.942798+0000","last_fullsized":"2024-09-12T01:36:37.942798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:34.117880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917800+0000","last_change":"2024-09-12T01:36:34.917800+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917800+0000","last_undegraded":"2024-09-12T01:36:34.917800+0000","last_fullsized":"2024-09-12T01:36:34.917800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.918052+0000","last_change":"2024-09-12T01:36:34.918052+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.918052+0000","last_undegraded":"2024-09-12T01:36:34.918052+0000","last_fullsized":"2024-09-12T01:36:34.918052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915402+0000","last_change":"2024-09-12T01:36:34.915402+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915402+0000","last_undegraded":"2024-09-12T01:36:34.915402+0000","last_fullsized":"2024-09-12T01:36:34.915402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.918396+0000","last_change":"2024-09-12T01:36:34.918396+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.918396+0000","last_undegraded":"2024-09-12T01:36:34.918396+0000","last_fullsized":"2024-09-12T01:36:34.918396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.913221+0000","last_change":"2024-09-12T01:36:34.913221+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.913221+0000","last_undegraded":"2024-09-12T01:36:34.913221+0000","last_fullsized":"2024-09-12T01:36:34.913221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915167+0000","last_change":"2024-09-12T01:36:34.915167+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915167+0000","last_undegraded":"2024-09-12T01:36:34.915167+0000","last_fullsized":"2024-09-12T01:36:34.915167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915322+0000","last_change":"2024-09-12T01:36:34.915322+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915322+0000","last_undegraded":"2024-09-12T01:36:34.915322+0000","last_fullsized":"2024-09-12T01:36:34.915322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.913131+0000","last_change":"2024-09-12T01:36:34.913131+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.913131+0000","last_undegraded":"2024-09-12T01:36:34.913131+0000","last_fullsized":"2024-09-12T01:36:34.913131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917760+0000","last_change":"2024-09-12T01:36:34.917760+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917760+0000","last_undegraded":"2024-09-12T01:36:34.917760+0000","last_fullsized":"2024-09-12T01:36:34.917760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922697+0000","last_change":"2024-09-12T01:36:34.922697+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922697+0000","last_undegraded":"2024-09-12T01:36:34.922697+0000","last_fullsized":"2024-09-12T01:36:34.922697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915198+0000","last_change":"2024-09-12T01:36:34.915198+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915198+0000","last_undegraded":"2024-09-12T01:36:34.915198+0000","last_fullsized":"2024-09-12T01:36:34.915198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922947+0000","last_change":"2024-09-12T01:36:34.922947+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922947+0000","last_undegraded":"2024-09-12T01:36:34.922947+0000","last_fullsized":"2024-09-12T01:36:34.922947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922734+0000","last_change":"2024-09-12T01:36:34.922734+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922734+0000","last_undegraded":"2024-09-12T01:36:34.922734+0000","last_fullsized":"2024-09-12T01:36:34.922734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943152+0000","last_change":"2024-09-12T01:36:36.953248+0000","last_active":"2024-09-12T01:36:37.943152+0000","last_peered":"2024-09-12T01:36:37.943152+0000","last_clean":"2024-09-12T01:36:37.943152+0000","last_became_active":"2024-09-12T01:36:36.951771+0000","last_became_peered":"2024-09-12T01:36:36.951771+0000","last_unstale":"2024-09-12T01:36:37.943152+0000","last_undegraded":"2024-09-12T01:36:37.943152+0000","last_fullsized":"2024-09-12T01:36:37.943152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:31.145637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922683+0000","last_change":"2024-09-12T01:36:34.922683+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922683+0000","last_undegraded":"2024-09-12T01:36:34.922683+0000","last_fullsized":"2024-09-12T01:36:34.922683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942796+0000","last_change":"2024-09-12T01:36:36.951657+0000","last_active":"2024-09-12T01:36:37.942796+0000","last_peered":"2024-09-12T01:36:37.942796+0000","last_clean":"2024-09-12T01:36:37.942796+0000","last_became_active":"2024-09-12T01:36:36.950874+0000","last_became_peered":"2024-09-12T01:36:36.950874+0000","last_unstale":"2024-09-12T01:36:37.942796+0000","last_undegraded":"2024-09-12T01:36:37.942796+0000","last_fullsized":"2024-09-12T01:36:37.942796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:20.771473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915279+0000","last_change":"2024-09-12T01:36:34.915279+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915279+0000","last_undegraded":"2024-09-12T01:36:34.915279+0000","last_fullsized":"2024-09-12T01:36:34.915279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942730+0000","last_change":"2024-09-12T01:36:35.927729+0000","last_active":"2024-09-12T01:36:37.942730+0000","last_peered":"2024-09-12T01:36:37.942730+0000","last_clean":"2024-09-12T01:36:37.942730+0000","last_became_active":"2024-09-12T01:36:35.927450+0000","last_became_peered":"2024-09-12T01:36:35.927450+0000","last_unstale":"2024-09-12T01:36:37.942730+0000","last_undegraded":"2024-09-12T01:36:37.942730+0000","last_fullsized":"2024-09-12T01:36:37.942730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:32.938884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917934+0000","last_change":"2024-09-12T01:36:34.917934+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917934+0000","last_undegraded":"2024-09-12T01:36:34.917934+0000","last_fullsized":"2024-09-12T01:36:34.917934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T01:36:34.912937+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:36:34.912937+0000","last_peered":"2024-09-12T01:36:34.912937+0000","last_clean":"2024-09-12T01:36:34.912937+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:36:34.912937+0000","last_undegraded":"2024-09-12T01:36:34.912937+0000","last_fullsized":"2024-09-12T01:36:34.912937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35680,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336160,"statfs":{"total":96636764160,"available":96600227840,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":139769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:36:40.639 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-12T01:36:40.639 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.640 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-12T01:36:40.640 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.640 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-12T01:36:40.640 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.640 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-12T01:36:40.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.641 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-12T01:36:40.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.641 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-12T01:36:40.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.641 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-12T01:36:40.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.641 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-12T01:36:40.641 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.642 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-12T01:36:40.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.642 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-12T01:36:40.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.642 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-12T01:36:40.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.642 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-12T01:36:40.642 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.643 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-12T01:36:40.643 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.643 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-12T01:36:40.643 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.643 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-12T01:36:40.643 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.643 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-12T01:36:40.643 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.643 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-12T01:36:40.643 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.643 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-12T01:36:40.644 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.644 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-12T01:36:40.644 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.644 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-12T01:36:40.644 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.644 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-12T01:36:40.644 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.644 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-12T01:36:40.644 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.645 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-12T01:36:40.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.645 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-12T01:36:40.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.645 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-12T01:36:40.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.645 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-12T01:36:40.645 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.646 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-12T01:36:40.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.646 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-12T01:36:40.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.646 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-12T01:36:40.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.917752+0000', 'last_change': '2024-09-12T01:36:34.917752+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.917752+0000', 'last_undegraded': '2024-09-12T01:36:34.917752+0000', 'last_fullsized': '2024-09-12T01:36:34.917752+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:40.646 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-12T01:36:40.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.646 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-12T01:36:40.646 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.647 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-12T01:36:40.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.917729+0000', 'last_change': '2024-09-12T01:36:34.917729+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.917729+0000', 'last_undegraded': '2024-09-12T01:36:34.917729+0000', 'last_fullsized': '2024-09-12T01:36:34.917729+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:36:40.647 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-12T01:36:40.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.647 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-12T01:36:40.647 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.916084+0000', 'last_change': '2024-09-12T01:36:34.916084+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.916084+0000', 'last_undegraded': '2024-09-12T01:36:34.916084+0000', 'last_fullsized': '2024-09-12T01:36:34.916084+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:40.648 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-12T01:36:40.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.648 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-12T01:36:40.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.915892+0000', 'last_change': '2024-09-12T01:36:34.915892+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.915892+0000', 'last_undegraded': '2024-09-12T01:36:34.915892+0000', 'last_fullsized': '2024-09-12T01:36:34.915892+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:40.648 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-12T01:36:40.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.648 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-12T01:36:40.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.917744+0000', 'last_change': '2024-09-12T01:36:34.917744+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.917744+0000', 'last_undegraded': '2024-09-12T01:36:34.917744+0000', 'last_fullsized': '2024-09-12T01:36:34.917744+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:36:40.648 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-12T01:36:40.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.915520+0000', 'last_change': '2024-09-12T01:36:34.915520+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.915520+0000', 'last_undegraded': '2024-09-12T01:36:34.915520+0000', 'last_fullsized': '2024-09-12T01:36:34.915520+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:40.648 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-12T01:36:40.648 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.649 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-09-12T01:36:40.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.915615+0000', 'last_change': '2024-09-12T01:36:34.915615+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.915615+0000', 'last_undegraded': '2024-09-12T01:36:34.915615+0000', 'last_fullsized': '2024-09-12T01:36:34.915615+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:40.649 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-12T01:36:40.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.915727+0000', 'last_change': '2024-09-12T01:36:34.915727+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.915727+0000', 'last_undegraded': '2024-09-12T01:36:34.915727+0000', 'last_fullsized': '2024-09-12T01:36:34.915727+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:40.649 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-12T01:36:40.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.918919+0000', 'last_change': '2024-09-12T01:36:34.918919+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.918919+0000', 'last_undegraded': '2024-09-12T01:36:34.918919+0000', 'last_fullsized': '2024-09-12T01:36:34.918919+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:40.649 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-12T01:36:40.649 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.650 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-12T01:36:40.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.923483+0000', 'last_change': '2024-09-12T01:36:34.923483+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.923483+0000', 'last_undegraded': '2024-09-12T01:36:34.923483+0000', 'last_fullsized': '2024-09-12T01:36:34.923483+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:36:40.650 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-12T01:36:40.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.650 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-12T01:36:40.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.915372+0000', 'last_change': '2024-09-12T01:36:34.915372+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.915372+0000', 'last_undegraded': '2024-09-12T01:36:34.915372+0000', 'last_fullsized': '2024-09-12T01:36:34.915372+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:40.651 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-12T01:36:40.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.651 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-12T01:36:40.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.651 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-09-12T01:36:40.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.917800+0000', 'last_change': '2024-09-12T01:36:34.917800+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.917800+0000', 'last_undegraded': '2024-09-12T01:36:34.917800+0000', 'last_fullsized': '2024-09-12T01:36:34.917800+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:36:40.652 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-12T01:36:40.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.652 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-12T01:36:40.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.918052+0000', 'last_change': '2024-09-12T01:36:34.918052+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.918052+0000', 'last_undegraded': '2024-09-12T01:36:34.918052+0000', 'last_fullsized': '2024-09-12T01:36:34.918052+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:36:40.652 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-12T01:36:40.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.653 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-12T01:36:40.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.915402+0000', 'last_change': '2024-09-12T01:36:34.915402+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.915402+0000', 'last_undegraded': '2024-09-12T01:36:34.915402+0000', 'last_fullsized': '2024-09-12T01:36:34.915402+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:40.653 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-12T01:36:40.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.653 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-12T01:36:40.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.918396+0000', 'last_change': '2024-09-12T01:36:34.918396+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.918396+0000', 'last_undegraded': '2024-09-12T01:36:34.918396+0000', 'last_fullsized': '2024-09-12T01:36:34.918396+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:40.653 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-12T01:36:40.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.653 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-12T01:36:40.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.913221+0000', 'last_change': '2024-09-12T01:36:34.913221+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.913221+0000', 'last_undegraded': '2024-09-12T01:36:34.913221+0000', 'last_fullsized': '2024-09-12T01:36:34.913221+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:36:40.654 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-12T01:36:40.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.654 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-12T01:36:40.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.915167+0000', 'last_change': '2024-09-12T01:36:34.915167+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.915167+0000', 'last_undegraded': '2024-09-12T01:36:34.915167+0000', 'last_fullsized': '2024-09-12T01:36:34.915167+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:40.654 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-12T01:36:40.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.654 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-12T01:36:40.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.915322+0000', 'last_change': '2024-09-12T01:36:34.915322+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.915322+0000', 'last_undegraded': '2024-09-12T01:36:34.915322+0000', 'last_fullsized': '2024-09-12T01:36:34.915322+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:40.654 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-12T01:36:40.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.655 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-12T01:36:40.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.913131+0000', 'last_change': '2024-09-12T01:36:34.913131+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.913131+0000', 'last_undegraded': '2024-09-12T01:36:34.913131+0000', 'last_fullsized': '2024-09-12T01:36:34.913131+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:36:40.655 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-12T01:36:40.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.655 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-12T01:36:40.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.917760+0000', 'last_change': '2024-09-12T01:36:34.917760+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.917760+0000', 'last_undegraded': '2024-09-12T01:36:34.917760+0000', 'last_fullsized': '2024-09-12T01:36:34.917760+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:40.656 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-12T01:36:40.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.656 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-12T01:36:40.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.922697+0000', 'last_change': '2024-09-12T01:36:34.922697+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.922697+0000', 'last_undegraded': '2024-09-12T01:36:34.922697+0000', 'last_fullsized': '2024-09-12T01:36:34.922697+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:36:40.656 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-12T01:36:40.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.656 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-12T01:36:40.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.915198+0000', 'last_change': '2024-09-12T01:36:34.915198+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.915198+0000', 'last_undegraded': '2024-09-12T01:36:34.915198+0000', 'last_fullsized': '2024-09-12T01:36:34.915198+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:36:40.657 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-12T01:36:40.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.657 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-12T01:36:40.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.922947+0000', 'last_change': '2024-09-12T01:36:34.922947+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.922947+0000', 'last_undegraded': '2024-09-12T01:36:34.922947+0000', 'last_fullsized': '2024-09-12T01:36:34.922947+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:36:40.657 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-12T01:36:40.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.658 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-12T01:36:40.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.922734+0000', 'last_change': '2024-09-12T01:36:34.922734+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.922734+0000', 'last_undegraded': '2024-09-12T01:36:34.922734+0000', 'last_fullsized': '2024-09-12T01:36:34.922734+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:36:40.658 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-12T01:36:40.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.922683+0000', 'last_change': '2024-09-12T01:36:34.922683+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.922683+0000', 'last_undegraded': '2024-09-12T01:36:34.922683+0000', 'last_fullsized': '2024-09-12T01:36:34.922683+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:36:40.658 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-12T01:36:40.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.915279+0000', 'last_change': '2024-09-12T01:36:34.915279+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.915279+0000', 'last_undegraded': '2024-09-12T01:36:34.915279+0000', 'last_fullsized': '2024-09-12T01:36:34.915279+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:36:40.658 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-12T01:36:40.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.658 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-12T01:36:40.659 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:36:35.910560+0000', 'last_change': '2024-09-12T01:36:35.910560+0000', 'last_active': '2024-09-12T01:36:35.910560+0000', 'last_peered': '2024-09-12T01:36:35.910560+0000', 'last_clean': '2024-09-12T01:36:35.910560+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:35.910560+0000', 'last_undegraded': '2024-09-12T01:36:35.910560+0000', 'last_fullsized': '2024-09-12T01:36:35.910560+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:35.910560+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:36:40.659 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-12T01:36:40.659 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:36:34.917934+0000', 'last_change': '2024-09-12T01:36:34.917934+0000', 'last_active': '2024-09-12T01:36:34.906027+0000', 'last_peered': '2024-09-12T01:36:34.906027+0000', 'last_clean': '2024-09-12T01:36:34.906027+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:36:34.917934+0000', 'last_undegraded': '2024-09-12T01:36:34.917934+0000', 'last_fullsized': '2024-09-12T01:36:34.917934+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'last_clean_scrub_stamp': '2024-09-12T01:36:34.906027+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:36:40.659 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:36:40.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.776+0000 7fac0df5f640 1 Processor -- start 2024-09-12T01:36:40.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.776+0000 7fac0df5f640 1 -- start start 2024-09-12T01:36:40.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.777+0000 7fac0df5f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac080cf6b0 0x7fac081629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.777+0000 7fac0df5f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac08162f30 0x7fac080b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.777+0000 7fac0df5f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac080cfc20 con 0x7fac080b63d0 2024-09-12T01:36:40.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.777+0000 7fac0df5f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fac080d40c0 con 0x7fac08162f30 2024-09-12T01:36:40.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.777+0000 7fac0df5f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac080d2ed0 con 0x7fac080cf6b0 2024-09-12T01:36:40.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.777+0000 7fac077fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fac080b63d0 0x7fac080d39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40070/0 (socket says 172.21.15.60:40070) 2024-09-12T01:36:40.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.777+0000 7fac077fe640 1 -- 172.21.15.60:0/1052604750 learned_addr learned my addr 172.21.15.60:0/1052604750 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:40.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.777+0000 7fac07fff640 1 --2- 172.21.15.60:0/1052604750 >> v2:172.21.15.60:3300/0 conn(0x7fac08162f30 0x7fac080b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.777+0000 7fac067fc640 1 -- 172.21.15.60:0/1052604750 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703806986 0 0) 0x7fac080cfc20 con 0x7fac080b63d0 2024-09-12T01:36:40.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.777+0000 7fac067fc640 1 -- 172.21.15.60:0/1052604750 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabf0003520 con 0x7fac080b63d0 2024-09-12T01:36:40.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.777+0000 7fac06ffd640 1 --2- 172.21.15.60:0/1052604750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac080cf6b0 0x7fac081629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.778+0000 7fac07fff640 1 -- 172.21.15.60:0/1052604750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac080cf6b0 msgr2=0x7fac081629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:40.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.778+0000 7fac07fff640 1 --2- 172.21.15.60:0/1052604750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac080cf6b0 0x7fac081629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.778+0000 7fac07fff640 1 -- 172.21.15.60:0/1052604750 >> v1:172.21.15.60:6789/0 conn(0x7fac080b63d0 legacy=0x7fac080d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.778+0000 7fac07fff640 1 -- 172.21.15.60:0/1052604750 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac080d31b0 con 0x7fac08162f30 2024-09-12T01:36:40.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.778+0000 7fac07fff640 1 --2- 172.21.15.60:0/1052604750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac08162f30 0x7fac080b7880 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fac00009d90 tx=0x7fac0002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d996f581256e649 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:40.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.778+0000 7fac067fc640 1 -- 172.21.15.60:0/1052604750 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00007740 con 0x7fac08162f30 2024-09-12T01:36:40.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.778+0000 7fac067fc640 1 -- 172.21.15.60:0/1052604750 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac000078e0 con 0x7fac08162f30 2024-09-12T01:36:40.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.778+0000 7fac067fc640 1 -- 172.21.15.60:0/1052604750 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00007cb0 con 0x7fac08162f30 2024-09-12T01:36:40.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.779+0000 7fac0df5f640 1 -- 172.21.15.60:0/1052604750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac08162f30 msgr2=0x7fac080b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.779+0000 7fac0df5f640 1 --2- 172.21.15.60:0/1052604750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac08162f30 0x7fac080b7880 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fac00009d90 tx=0x7fac0002a660 comp rx=0 tx=0).stop 2024-09-12T01:36:40.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.779+0000 7fac0df5f640 1 -- 172.21.15.60:0/1052604750 shutdown_connections 2024-09-12T01:36:40.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.779+0000 7fac0df5f640 1 --2- 172.21.15.60:0/1052604750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac08162f30 0x7fac080b7880 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.779+0000 7fac0df5f640 1 --2- 172.21.15.60:0/1052604750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac080cf6b0 0x7fac081629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.779+0000 7fac0df5f640 1 -- 172.21.15.60:0/1052604750 >> 172.21.15.60:0/1052604750 conn(0x7fac080d1160 msgr2=0x7fac080d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:40.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.779+0000 7fac0df5f640 1 -- 172.21.15.60:0/1052604750 shutdown_connections 2024-09-12T01:36:40.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.779+0000 7fac0df5f640 1 -- 172.21.15.60:0/1052604750 wait complete. 2024-09-12T01:36:40.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.780+0000 7fac0df5f640 1 Processor -- start 2024-09-12T01:36:40.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.780+0000 7fac0df5f640 1 -- start start 2024-09-12T01:36:40.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.781+0000 7fac0df5f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac080b63d0 0x7fac080cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.781+0000 7fac0df5f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac080cf6b0 0x7fac080ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.781+0000 7fac0df5f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac08162f30 0x7fac080ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.781+0000 7fac0df5f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fac080cb5c0 con 0x7fac080cf6b0 2024-09-12T01:36:40.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.781+0000 7fac0df5f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fac080cb440 con 0x7fac08162f30 2024-09-12T01:36:40.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.781+0000 7fac0df5f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac080d1c80 con 0x7fac080b63d0 2024-09-12T01:36:40.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.781+0000 7fac06ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac080cf6b0 0x7fac080ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.781+0000 7fac06ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac080cf6b0 0x7fac080ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50740/0 (socket says 172.21.15.60:50740) 2024-09-12T01:36:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.781+0000 7fac06ffd640 1 -- 172.21.15.60:0/3772187659 learned_addr learned my addr 172.21.15.60:0/3772187659 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fac077fe640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac080b63d0 0x7fac080cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fac07fff640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac08162f30 0x7fac080ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fac06ffd640 1 -- 172.21.15.60:0/3772187659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac080b63d0 msgr2=0x7fac080cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fac06ffd640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac080b63d0 0x7fac080cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fac06ffd640 1 -- 172.21.15.60:0/3772187659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac08162f30 msgr2=0x7fac080ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fac06ffd640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac08162f30 0x7fac080ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fac06ffd640 1 -- 172.21.15.60:0/3772187659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac080c8460 con 0x7fac080cf6b0 2024-09-12T01:36:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fac06ffd640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac080cf6b0 0x7fac080ccab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00c7f0 tx=0x7fabfc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fabeffff640 1 -- 172.21.15.60:0/3772187659 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc015070 con 0x7fac080cf6b0 2024-09-12T01:36:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fabeffff640 1 -- 172.21.15.60:0/3772187659 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabfc004240 con 0x7fac080cf6b0 2024-09-12T01:36:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fac0df5f640 1 -- 172.21.15.60:0/3772187659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac080c8740 con 0x7fac080cf6b0 2024-09-12T01:36:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fabeffff640 1 -- 172.21.15.60:0/3772187659 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabfc007620 con 0x7fac080cf6b0 2024-09-12T01:36:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.782+0000 7fac0df5f640 1 -- 172.21.15.60:0/3772187659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac080cb0d0 con 0x7fac080cf6b0 2024-09-12T01:36:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.783+0000 7fac0df5f640 1 -- 172.21.15.60:0/3772187659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac080b8590 con 0x7fac080cf6b0 2024-09-12T01:36:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.783+0000 7fabeffff640 1 -- 172.21.15.60:0/3772187659 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fabfc0079d0 con 0x7fac080cf6b0 2024-09-12T01:36:40.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.784+0000 7fabeffff640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fabf406be60 0x7fabf406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:40.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.784+0000 7fac077fe640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fabf406be60 0x7fabf406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:40.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.784+0000 7fabeffff640 1 -- 172.21.15.60:0/3772187659 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fabfc08afe0 con 0x7fac080cf6b0 2024-09-12T01:36:40.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.785+0000 7fac077fe640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fabf406be60 0x7fabf406e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabf8000f60 tx=0x7fabf8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:40.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:40.789+0000 7fabeffff640 1 -- 172.21.15.60:0/3772187659 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac080b8590 con 0x7fac080cf6b0 2024-09-12T01:36:40.902 INFO:tasks.ceph.mds.b.smithi105.stderr:2024-09-12T01:36:40.903+0000 7f57d3390640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:36:41.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.031+0000 7fac0df5f640 1 -- 172.21.15.60:0/3772187659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fac080b67b0 con 0x7fac080cf6b0 2024-09-12T01:36:41.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.032+0000 7fabeffff640 1 -- 172.21.15.60:0/3772187659 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2826 (secure 0 0 0) 0x7fabfc059910 con 0x7fac080cf6b0 2024-09-12T01:36:41.031 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:41.031 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":68,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1726104944,"num_in_osds":8,"osd_in_since":1726104934,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":52},{"state_name":"creating+peering","count":27},{"state_name":"active+clean","count":18}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590368,"bytes_used":246661120,"bytes_avail":772847452160,"bytes_total":773094113280,"unknown_pgs_ratio":0.53608244657516479,"inactive_pgs_ratio":0.27835050225257874,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":14,"btime":"2024-09-12T01:36:38:945222+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":34520}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-12T01:36:38.267793+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T01:36:41.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.034+0000 7fac0df5f640 1 -- 172.21.15.60:0/3772187659 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fabf406be60 msgr2=0x7fabf406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.034+0000 7fac0df5f640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fabf406be60 0x7fabf406e320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fabf8000f60 tx=0x7fabf8009040 comp rx=0 tx=0).stop 2024-09-12T01:36:41.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.034+0000 7fac0df5f640 1 -- 172.21.15.60:0/3772187659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac080cf6b0 msgr2=0x7fac080ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.034+0000 7fac0df5f640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac080cf6b0 0x7fac080ccab0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fabfc00c7f0 tx=0x7fabfc00ccb0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.034+0000 7fac0df5f640 1 -- 172.21.15.60:0/3772187659 shutdown_connections 2024-09-12T01:36:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.034+0000 7fac0df5f640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac08162f30 0x7fac080ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.034+0000 7fac0df5f640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac080cf6b0 0x7fac080ccab0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.034+0000 7fac0df5f640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fabf406be60 0x7fabf406e320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.034+0000 7fac0df5f640 1 --2- 172.21.15.60:0/3772187659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac080b63d0 0x7fac080cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.034+0000 7fac0df5f640 1 -- 172.21.15.60:0/3772187659 >> 172.21.15.60:0/3772187659 conn(0x7fac080d1160 msgr2=0x7fac080b9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.034+0000 7fac0df5f640 1 -- 172.21.15.60:0/3772187659 shutdown_connections 2024-09-12T01:36:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.034+0000 7fac0df5f640 1 -- 172.21.15.60:0/3772187659 wait complete. 2024-09-12T01:36:41.044 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:36:41.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:36:41.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.147+0000 7f313525e640 1 Processor -- start 2024-09-12T01:36:41.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.147+0000 7f313525e640 1 -- start start 2024-09-12T01:36:41.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f313525e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f313015e660 0x7f31300cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f313525e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31300d3310 0x7f31300d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f313525e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f31300d1650 0x7f313006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f313525e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f31300d1ac0 con 0x7f313015e660 2024-09-12T01:36:41.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f313525e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f313015ea40 con 0x7f31300d1650 2024-09-12T01:36:41.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f313525e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31300d3870 con 0x7f31300d3310 2024-09-12T01:36:41.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f312ed9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f313015e660 0x7f31300cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f312ed9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f313015e660 0x7f31300cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50748/0 (socket says 172.21.15.60:50748) 2024-09-12T01:36:41.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f312ed9d640 1 -- 172.21.15.60:0/2134527364 learned_addr learned my addr 172.21.15.60:0/2134527364 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:41.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f312ed9d640 1 -- 172.21.15.60:0/2134527364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31300d3310 msgr2=0x7f31300d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f312f59e640 1 --2- 172.21.15.60:0/2134527364 >> v2:172.21.15.105:3300/0 conn(0x7f31300d1650 0x7f313006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f312e59c640 1 --2- 172.21.15.60:0/2134527364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31300d3310 0x7f31300d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.148+0000 7f312ed9d640 1 --2- 172.21.15.60:0/2134527364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31300d3310 0x7f31300d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.149+0000 7f312ed9d640 1 -- 172.21.15.60:0/2134527364 >> v2:172.21.15.105:3300/0 conn(0x7f31300d1650 msgr2=0x7f313006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.149+0000 7f312ed9d640 1 --2- 172.21.15.60:0/2134527364 >> v2:172.21.15.105:3300/0 conn(0x7f31300d1650 0x7f313006bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.149+0000 7f312ed9d640 1 -- 172.21.15.60:0/2134527364 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31300d3b50 con 0x7f313015e660 2024-09-12T01:36:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.149+0000 7f312f59e640 1 --2- 172.21.15.60:0/2134527364 >> v2:172.21.15.105:3300/0 conn(0x7f31300d1650 0x7f313006bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.149+0000 7f312e59c640 1 --2- 172.21.15.60:0/2134527364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31300d3310 0x7f31300d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.149+0000 7f312ed9d640 1 --2- 172.21.15.60:0/2134527364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f313015e660 0x7f31300cf730 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f31300cb760 tx=0x7f312002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfb678b50a8b13b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.149+0000 7f312dd9b640 1 -- 172.21.15.60:0/2134527364 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120037070 con 0x7f313015e660 2024-09-12T01:36:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.149+0000 7f312dd9b640 1 -- 172.21.15.60:0/2134527364 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3120032440 con 0x7f313015e660 2024-09-12T01:36:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.149+0000 7f312dd9b640 1 -- 172.21.15.60:0/2134527364 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3120032810 con 0x7f313015e660 2024-09-12T01:36:41.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.150+0000 7f313525e640 1 -- 172.21.15.60:0/2134527364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f313015e660 msgr2=0x7f31300cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.150+0000 7f313525e640 1 --2- 172.21.15.60:0/2134527364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f313015e660 0x7f31300cf730 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f31300cb760 tx=0x7f312002a1e0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.150+0000 7f313525e640 1 -- 172.21.15.60:0/2134527364 shutdown_connections 2024-09-12T01:36:41.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.150+0000 7f313525e640 1 --2- 172.21.15.60:0/2134527364 >> v2:172.21.15.105:3300/0 conn(0x7f31300d1650 0x7f313006bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.150+0000 7f313525e640 1 --2- 172.21.15.60:0/2134527364 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31300d3310 0x7f31300d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.150+0000 7f313525e640 1 --2- 172.21.15.60:0/2134527364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f313015e660 0x7f31300cf730 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.150+0000 7f313525e640 1 -- 172.21.15.60:0/2134527364 >> 172.21.15.60:0/2134527364 conn(0x7f31300b6410 msgr2=0x7f31300b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.150+0000 7f313525e640 1 -- 172.21.15.60:0/2134527364 shutdown_connections 2024-09-12T01:36:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.150+0000 7f313525e640 1 -- 172.21.15.60:0/2134527364 wait complete. 2024-09-12T01:36:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.151+0000 7f313525e640 1 Processor -- start 2024-09-12T01:36:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.152+0000 7f313525e640 1 -- start start 2024-09-12T01:36:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.152+0000 7f313525e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31300d1650 0x7f313015ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.152+0000 7f313525e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31300d3310 0x7f31301612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.152+0000 7f313525e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f313015e660 0x7f31301473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.152+0000 7f313525e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31300d43f0 con 0x7f31300d3310 2024-09-12T01:36:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.152+0000 7f313525e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31300d4110 con 0x7f313015e660 2024-09-12T01:36:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.152+0000 7f313525e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31300cfc70 con 0x7f31300d1650 2024-09-12T01:36:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.152+0000 7f312e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31300d3310 0x7f31301612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.152+0000 7f312e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31300d3310 0x7f31301612b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50756/0 (socket says 172.21.15.60:50756) 2024-09-12T01:36:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.152+0000 7f312e59c640 1 -- 172.21.15.60:0/2786738916 learned_addr learned my addr 172.21.15.60:0/2786738916 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f312ed9d640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31300d1650 0x7f313015ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f312f59e640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f313015e660 0x7f31301473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f312e59c640 1 -- 172.21.15.60:0/2786738916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31300d1650 msgr2=0x7f313015ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f312e59c640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31300d1650 0x7f313015ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f312e59c640 1 -- 172.21.15.60:0/2786738916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f313015e660 msgr2=0x7f31301473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f312e59c640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f313015e660 0x7f31301473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f312e59c640 1 -- 172.21.15.60:0/2786738916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3130160210 con 0x7f31300d3310 2024-09-12T01:36:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f312e59c640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31300d3310 0x7f31301612b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f312400c7f0 tx=0x7f312400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f31177fe640 1 -- 172.21.15.60:0/2786738916 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124015070 con 0x7f31300d3310 2024-09-12T01:36:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f31177fe640 1 -- 172.21.15.60:0/2786738916 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3124007820 con 0x7f31300d3310 2024-09-12T01:36:41.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f313525e640 1 -- 172.21.15.60:0/2786738916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31301604f0 con 0x7f31300d3310 2024-09-12T01:36:41.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f31177fe640 1 -- 172.21.15.60:0/2786738916 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3124007bd0 con 0x7f31300d3310 2024-09-12T01:36:41.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.153+0000 7f313525e640 1 -- 172.21.15.60:0/2786738916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3130160d90 con 0x7f31300d3310 2024-09-12T01:36:41.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.154+0000 7f313525e640 1 -- 172.21.15.60:0/2786738916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31300d1110 con 0x7f31300d3310 2024-09-12T01:36:41.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.155+0000 7f31177fe640 1 -- 172.21.15.60:0/2786738916 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3124018070 con 0x7f31300d3310 2024-09-12T01:36:41.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.155+0000 7f31177fe640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f311c06be30 0x7f311c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:41.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.155+0000 7f31177fe640 1 -- 172.21.15.60:0/2786738916 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f312408aeb0 con 0x7f31300d3310 2024-09-12T01:36:41.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.155+0000 7f312ed9d640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f311c06be30 0x7f311c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:41.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.156+0000 7f312ed9d640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f311c06be30 0x7f311c06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3120034000 tx=0x7f312002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:41.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.160+0000 7f31177fe640 1 -- 172.21.15.60:0/2786738916 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3124059210 con 0x7f31300d3310 2024-09-12T01:36:41.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.333+0000 7f313525e640 1 -- 172.21.15.60:0/2786738916 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f313015ba20 con 0x7f311c06be30 2024-09-12T01:36:41.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.339+0000 7f31177fe640 1 -- 172.21.15.60:0/2786738916 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242073 (secure 0 0 0) 0x7f313015ba20 con 0x7f311c06be30 2024-09-12T01:36:41.340 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:41.342 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:36:41.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.342+0000 7f313525e640 1 -- 172.21.15.60:0/2786738916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f311c06be30 msgr2=0x7f311c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.342+0000 7f313525e640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f311c06be30 0x7f311c06e2f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3120034000 tx=0x7f312002e000 comp rx=0 tx=0).stop 2024-09-12T01:36:41.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.342+0000 7f313525e640 1 -- 172.21.15.60:0/2786738916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31300d3310 msgr2=0x7f31301612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:41.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.342+0000 7f313525e640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31300d3310 0x7f31301612b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f312400c7f0 tx=0x7f312400ccb0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.342+0000 7f313525e640 1 -- 172.21.15.60:0/2786738916 shutdown_connections 2024-09-12T01:36:41.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.342+0000 7f313525e640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f313015e660 0x7f31301473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.342+0000 7f313525e640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31300d3310 0x7f31301612b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.342+0000 7f313525e640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f311c06be30 0x7f311c06e2f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.342+0000 7f313525e640 1 --2- 172.21.15.60:0/2786738916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31300d1650 0x7f313015ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:41.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.342+0000 7f313525e640 1 -- 172.21.15.60:0/2786738916 >> 172.21.15.60:0/2786738916 conn(0x7f31300b6410 msgr2=0x7f31300b5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:41.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.342+0000 7f313525e640 1 -- 172.21.15.60:0/2786738916 shutdown_connections 2024-09-12T01:36:41.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:41.342+0000 7f313525e640 1 -- 172.21.15.60:0/2786738916 wait complete. 2024-09-12T01:36:41.353 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-12T01:36:40.268660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":90,"acting":90,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240880,"kb_used_data":3832,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733840,"statfs":{"total":773094113280,"available":772847452160,"internally_reserved":0,"allocated":3923968,"data_stored":2184466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.357576"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943920+0000","last_change":"2024-09-12T01:36:36.957801+0000","last_active":"2024-09-12T01:36:37.943920+0000","last_peered":"2024-09-12T01:36:37.943920+0000","last_clean":"2024-09-12T01:36:37.943920+0000","last_became_active":"2024-09-12T01:36:36.957534+0000","last_became_peered":"2024-09-12T01:36:36.957534+0000","last_unstale":"2024-09-12T01:36:37.943920+0000","last_undegraded":"2024-09-12T01:36:37.943920+0000","last_fullsized":"2024-09-12T01:36:37.943920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:50.643715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944308+0000","last_change":"2024-09-12T01:36:36.953248+0000","last_active":"2024-09-12T01:36:37.944308+0000","last_peered":"2024-09-12T01:36:37.944308+0000","last_clean":"2024-09-12T01:36:37.944308+0000","last_became_active":"2024-09-12T01:36:36.952957+0000","last_became_peered":"2024-09-12T01:36:36.952957+0000","last_unstale":"2024-09-12T01:36:37.944308+0000","last_undegraded":"2024-09-12T01:36:37.944308+0000","last_fullsized":"2024-09-12T01:36:37.944308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:21.471509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942927+0000","last_change":"2024-09-12T01:36:36.950183+0000","last_active":"2024-09-12T01:36:37.942927+0000","last_peered":"2024-09-12T01:36:37.942927+0000","last_clean":"2024-09-12T01:36:37.942927+0000","last_became_active":"2024-09-12T01:36:36.949691+0000","last_became_peered":"2024-09-12T01:36:36.949691+0000","last_unstale":"2024-09-12T01:36:37.942927+0000","last_undegraded":"2024-09-12T01:36:37.942927+0000","last_fullsized":"2024-09-12T01:36:37.942927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:43.773335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944292+0000","last_change":"2024-09-12T01:36:36.948968+0000","last_active":"2024-09-12T01:36:37.944292+0000","last_peered":"2024-09-12T01:36:37.944292+0000","last_clean":"2024-09-12T01:36:37.944292+0000","last_became_active":"2024-09-12T01:36:36.948252+0000","last_became_peered":"2024-09-12T01:36:36.948252+0000","last_unstale":"2024-09-12T01:36:37.944292+0000","last_undegraded":"2024-09-12T01:36:37.944292+0000","last_fullsized":"2024-09-12T01:36:37.944292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:37.561280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944268+0000","last_change":"2024-09-12T01:36:36.952664+0000","last_active":"2024-09-12T01:36:37.944268+0000","last_peered":"2024-09-12T01:36:37.944268+0000","last_clean":"2024-09-12T01:36:37.944268+0000","last_became_active":"2024-09-12T01:36:36.949903+0000","last_became_peered":"2024-09-12T01:36:36.949903+0000","last_unstale":"2024-09-12T01:36:37.944268+0000","last_undegraded":"2024-09-12T01:36:37.944268+0000","last_fullsized":"2024-09-12T01:36:37.944268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:07.465038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917752+0000","last_change":"2024-09-12T01:36:34.917752+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917752+0000","last_undegraded":"2024-09-12T01:36:34.917752+0000","last_fullsized":"2024-09-12T01:36:34.917752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944393+0000","last_change":"2024-09-12T01:36:35.929496+0000","last_active":"2024-09-12T01:36:37.944393+0000","last_peered":"2024-09-12T01:36:37.944393+0000","last_clean":"2024-09-12T01:36:37.944393+0000","last_became_active":"2024-09-12T01:36:35.929228+0000","last_became_peered":"2024-09-12T01:36:35.929228+0000","last_unstale":"2024-09-12T01:36:37.944393+0000","last_undegraded":"2024-09-12T01:36:37.944393+0000","last_fullsized":"2024-09-12T01:36:37.944393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:40.249371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917729+0000","last_change":"2024-09-12T01:36:34.917729+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917729+0000","last_undegraded":"2024-09-12T01:36:34.917729+0000","last_fullsized":"2024-09-12T01:36:34.917729+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944239+0000","last_change":"2024-09-12T01:36:36.949253+0000","last_active":"2024-09-12T01:36:37.944239+0000","last_peered":"2024-09-12T01:36:37.944239+0000","last_clean":"2024-09-12T01:36:37.944239+0000","last_became_active":"2024-09-12T01:36:36.948587+0000","last_became_peered":"2024-09-12T01:36:36.948587+0000","last_unstale":"2024-09-12T01:36:37.944239+0000","last_undegraded":"2024-09-12T01:36:37.944239+0000","last_fullsized":"2024-09-12T01:36:37.944239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:09.195087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944041+0000","last_change":"2024-09-12T01:36:35.933669+0000","last_active":"2024-09-12T01:36:37.944041+0000","last_peered":"2024-09-12T01:36:37.944041+0000","last_clean":"2024-09-12T01:36:37.944041+0000","last_became_active":"2024-09-12T01:36:35.933265+0000","last_became_peered":"2024-09-12T01:36:35.933265+0000","last_unstale":"2024-09-12T01:36:37.944041+0000","last_undegraded":"2024-09-12T01:36:37.944041+0000","last_fullsized":"2024-09-12T01:36:37.944041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:57.668650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.916084+0000","last_change":"2024-09-12T01:36:34.916084+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.916084+0000","last_undegraded":"2024-09-12T01:36:34.916084+0000","last_fullsized":"2024-09-12T01:36:34.916084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915892+0000","last_change":"2024-09-12T01:36:34.915892+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915892+0000","last_undegraded":"2024-09-12T01:36:34.915892+0000","last_fullsized":"2024-09-12T01:36:34.915892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917744+0000","last_change":"2024-09-12T01:36:34.917744+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917744+0000","last_undegraded":"2024-09-12T01:36:34.917744+0000","last_fullsized":"2024-09-12T01:36:34.917744+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942957+0000","last_change":"2024-09-12T01:36:36.949000+0000","last_active":"2024-09-12T01:36:37.942957+0000","last_peered":"2024-09-12T01:36:37.942957+0000","last_clean":"2024-09-12T01:36:37.942957+0000","last_became_active":"2024-09-12T01:36:36.948725+0000","last_became_peered":"2024-09-12T01:36:36.948725+0000","last_unstale":"2024-09-12T01:36:37.942957+0000","last_undegraded":"2024-09-12T01:36:37.942957+0000","last_fullsized":"2024-09-12T01:36:37.942957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:26.769451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915520+0000","last_change":"2024-09-12T01:36:34.915520+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915520+0000","last_undegraded":"2024-09-12T01:36:34.915520+0000","last_fullsized":"2024-09-12T01:36:34.915520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915615+0000","last_change":"2024-09-12T01:36:34.915615+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915615+0000","last_undegraded":"2024-09-12T01:36:34.915615+0000","last_fullsized":"2024-09-12T01:36:34.915615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944291+0000","last_change":"2024-09-12T01:36:36.949700+0000","last_active":"2024-09-12T01:36:37.944291+0000","last_peered":"2024-09-12T01:36:37.944291+0000","last_clean":"2024-09-12T01:36:37.944291+0000","last_became_active":"2024-09-12T01:36:36.949417+0000","last_became_peered":"2024-09-12T01:36:36.949417+0000","last_unstale":"2024-09-12T01:36:37.944291+0000","last_undegraded":"2024-09-12T01:36:37.944291+0000","last_fullsized":"2024-09-12T01:36:37.944291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:11.246164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915727+0000","last_change":"2024-09-12T01:36:34.915727+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915727+0000","last_undegraded":"2024-09-12T01:36:34.915727+0000","last_fullsized":"2024-09-12T01:36:34.915727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943958+0000","last_change":"2024-09-12T01:36:36.958443+0000","last_active":"2024-09-12T01:36:37.943958+0000","last_peered":"2024-09-12T01:36:37.943958+0000","last_clean":"2024-09-12T01:36:37.943958+0000","last_became_active":"2024-09-12T01:36:36.956647+0000","last_became_peered":"2024-09-12T01:36:36.956647+0000","last_unstale":"2024-09-12T01:36:37.943958+0000","last_undegraded":"2024-09-12T01:36:37.943958+0000","last_fullsized":"2024-09-12T01:36:37.943958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:33.625549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.918919+0000","last_change":"2024-09-12T01:36:34.918919+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.918919+0000","last_undegraded":"2024-09-12T01:36:34.918919+0000","last_fullsized":"2024-09-12T01:36:34.918919+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.923483+0000","last_change":"2024-09-12T01:36:34.923483+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.923483+0000","last_undegraded":"2024-09-12T01:36:34.923483+0000","last_fullsized":"2024-09-12T01:36:34.923483+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915372+0000","last_change":"2024-09-12T01:36:34.915372+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915372+0000","last_undegraded":"2024-09-12T01:36:34.915372+0000","last_fullsized":"2024-09-12T01:36:34.915372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943072+0000","last_change":"2024-09-12T01:36:36.956493+0000","last_active":"2024-09-12T01:36:37.943072+0000","last_peered":"2024-09-12T01:36:37.943072+0000","last_clean":"2024-09-12T01:36:37.943072+0000","last_became_active":"2024-09-12T01:36:36.955918+0000","last_became_peered":"2024-09-12T01:36:36.955918+0000","last_unstale":"2024-09-12T01:36:37.943072+0000","last_undegraded":"2024-09-12T01:36:37.943072+0000","last_fullsized":"2024-09-12T01:36:37.943072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:28.071193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942937+0000","last_change":"2024-09-12T01:36:35.930525+0000","last_active":"2024-09-12T01:36:37.942937+0000","last_peered":"2024-09-12T01:36:37.942937+0000","last_clean":"2024-09-12T01:36:37.942937+0000","last_became_active":"2024-09-12T01:36:35.930304+0000","last_became_peered":"2024-09-12T01:36:35.930304+0000","last_unstale":"2024-09-12T01:36:37.942937+0000","last_undegraded":"2024-09-12T01:36:37.942937+0000","last_fullsized":"2024-09-12T01:36:37.942937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:21.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942798+0000","last_change":"2024-09-12T01:36:35.929417+0000","last_active":"2024-09-12T01:36:37.942798+0000","last_peered":"2024-09-12T01:36:37.942798+0000","last_clean":"2024-09-12T01:36:37.942798+0000","last_became_active":"2024-09-12T01:36:35.928565+0000","last_became_peered":"2024-09-12T01:36:35.928565+0000","last_unstale":"2024-09-12T01:36:37.942798+0000","last_undegraded":"2024-09-12T01:36:37.942798+0000","last_fullsized":"2024-09-12T01:36:37.942798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:34.117880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917800+0000","last_change":"2024-09-12T01:36:34.917800+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917800+0000","last_undegraded":"2024-09-12T01:36:34.917800+0000","last_fullsized":"2024-09-12T01:36:34.917800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.918052+0000","last_change":"2024-09-12T01:36:34.918052+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.918052+0000","last_undegraded":"2024-09-12T01:36:34.918052+0000","last_fullsized":"2024-09-12T01:36:34.918052+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915402+0000","last_change":"2024-09-12T01:36:34.915402+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915402+0000","last_undegraded":"2024-09-12T01:36:34.915402+0000","last_fullsized":"2024-09-12T01:36:34.915402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.918396+0000","last_change":"2024-09-12T01:36:34.918396+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.918396+0000","last_undegraded":"2024-09-12T01:36:34.918396+0000","last_fullsized":"2024-09-12T01:36:34.918396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.913221+0000","last_change":"2024-09-12T01:36:34.913221+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.913221+0000","last_undegraded":"2024-09-12T01:36:34.913221+0000","last_fullsized":"2024-09-12T01:36:34.913221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915167+0000","last_change":"2024-09-12T01:36:34.915167+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915167+0000","last_undegraded":"2024-09-12T01:36:34.915167+0000","last_fullsized":"2024-09-12T01:36:34.915167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915322+0000","last_change":"2024-09-12T01:36:34.915322+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915322+0000","last_undegraded":"2024-09-12T01:36:34.915322+0000","last_fullsized":"2024-09-12T01:36:34.915322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.913131+0000","last_change":"2024-09-12T01:36:34.913131+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.913131+0000","last_undegraded":"2024-09-12T01:36:34.913131+0000","last_fullsized":"2024-09-12T01:36:34.913131+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917760+0000","last_change":"2024-09-12T01:36:34.917760+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917760+0000","last_undegraded":"2024-09-12T01:36:34.917760+0000","last_fullsized":"2024-09-12T01:36:34.917760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922697+0000","last_change":"2024-09-12T01:36:34.922697+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922697+0000","last_undegraded":"2024-09-12T01:36:34.922697+0000","last_fullsized":"2024-09-12T01:36:34.922697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915198+0000","last_change":"2024-09-12T01:36:34.915198+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915198+0000","last_undegraded":"2024-09-12T01:36:34.915198+0000","last_fullsized":"2024-09-12T01:36:34.915198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922947+0000","last_change":"2024-09-12T01:36:34.922947+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922947+0000","last_undegraded":"2024-09-12T01:36:34.922947+0000","last_fullsized":"2024-09-12T01:36:34.922947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922734+0000","last_change":"2024-09-12T01:36:34.922734+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922734+0000","last_undegraded":"2024-09-12T01:36:34.922734+0000","last_fullsized":"2024-09-12T01:36:34.922734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943152+0000","last_change":"2024-09-12T01:36:36.953248+0000","last_active":"2024-09-12T01:36:37.943152+0000","last_peered":"2024-09-12T01:36:37.943152+0000","last_clean":"2024-09-12T01:36:37.943152+0000","last_became_active":"2024-09-12T01:36:36.951771+0000","last_became_peered":"2024-09-12T01:36:36.951771+0000","last_unstale":"2024-09-12T01:36:37.943152+0000","last_undegraded":"2024-09-12T01:36:37.943152+0000","last_fullsized":"2024-09-12T01:36:37.943152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:31.145637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.922683+0000","last_change":"2024-09-12T01:36:34.922683+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.922683+0000","last_undegraded":"2024-09-12T01:36:34.922683+0000","last_fullsized":"2024-09-12T01:36:34.922683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942796+0000","last_change":"2024-09-12T01:36:36.951657+0000","last_active":"2024-09-12T01:36:37.942796+0000","last_peered":"2024-09-12T01:36:37.942796+0000","last_clean":"2024-09-12T01:36:37.942796+0000","last_became_active":"2024-09-12T01:36:36.950874+0000","last_became_peered":"2024-09-12T01:36:36.950874+0000","last_unstale":"2024-09-12T01:36:37.942796+0000","last_undegraded":"2024-09-12T01:36:37.942796+0000","last_fullsized":"2024-09-12T01:36:37.942796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:20.771473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.915279+0000","last_change":"2024-09-12T01:36:34.915279+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.915279+0000","last_undegraded":"2024-09-12T01:36:34.915279+0000","last_fullsized":"2024-09-12T01:36:34.915279+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942730+0000","last_change":"2024-09-12T01:36:35.927729+0000","last_active":"2024-09-12T01:36:37.942730+0000","last_peered":"2024-09-12T01:36:37.942730+0000","last_clean":"2024-09-12T01:36:37.942730+0000","last_became_active":"2024-09-12T01:36:35.927450+0000","last_became_peered":"2024-09-12T01:36:35.927450+0000","last_unstale":"2024-09-12T01:36:37.942730+0000","last_undegraded":"2024-09-12T01:36:37.942730+0000","last_fullsized":"2024-09-12T01:36:37.942730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:32.938884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:36:35.910560+0000","last_change":"2024-09-12T01:36:35.910560+0000","last_active":"2024-09-12T01:36:35.910560+0000","last_peered":"2024-09-12T01:36:35.910560+0000","last_clean":"2024-09-12T01:36:35.910560+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:35.910560+0000","last_undegraded":"2024-09-12T01:36:35.910560+0000","last_fullsized":"2024-09-12T01:36:35.910560+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-12T01:36:34.917934+0000","last_change":"2024-09-12T01:36:34.917934+0000","last_active":"2024-09-12T01:36:34.906027+0000","last_peered":"2024-09-12T01:36:34.906027+0000","last_clean":"2024-09-12T01:36:34.906027+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:36:34.917934+0000","last_undegraded":"2024-09-12T01:36:34.917934+0000","last_fullsized":"2024-09-12T01:36:34.917934+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":186,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-12T01:36:34.912937+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:36:34.912937+0000","last_peered":"2024-09-12T01:36:34.912937+0000","last_clean":"2024-09-12T01:36:34.912937+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:36:34.912937+0000","last_undegraded":"2024-09-12T01:36:34.912937+0000","last_fullsized":"2024-09-12T01:36:34.912937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27360,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35680,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336160,"statfs":{"total":96636764160,"available":96600227840,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32100,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339740,"statfs":{"total":96636764160,"available":96603893760,"internally_reserved":0,"allocated":933888,"data_stored":715453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":339968,"data_stored":125085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":139769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:36:44.358 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:36:44.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.475+0000 7f964b9a6640 1 Processor -- start 2024-09-12T01:36:44.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.475+0000 7f964b9a6640 1 -- start start 2024-09-12T01:36:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.476+0000 7f964b9a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f964415c2b0 0x7f96440b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.476+0000 7f964b9a6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f964415f200 0x7f964406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.476+0000 7f964b9a6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f964415fb10 con 0x7f96440b72f0 2024-09-12T01:36:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.476+0000 7f964b9a6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f96440b5900 con 0x7f964415f200 2024-09-12T01:36:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.476+0000 7f964b9a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f964415f830 con 0x7f964415c2b0 2024-09-12T01:36:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.476+0000 7f9648f41640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f96440b72f0 0x7f964415eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33120/0 (socket says 172.21.15.60:33120) 2024-09-12T01:36:44.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.476+0000 7f9648f41640 1 -- 172.21.15.60:0/3375018750 learned_addr learned my addr 172.21.15.60:0/3375018750 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:44.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.476+0000 7f9649f43640 1 --2- 172.21.15.60:0/3375018750 >> v2:172.21.15.105:3300/0 conn(0x7f964415f200 0x7f964406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.476+0000 7f9649742640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f964415c2b0 0x7f96440b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.476+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595643749 0 0) 0x7f964415fb10 con 0x7f96440b72f0 2024-09-12T01:36:44.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.476+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9630003520 con 0x7f96440b72f0 2024-09-12T01:36:44.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3926973402 0 0) 0x7f9630003520 con 0x7f96440b72f0 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f964415c2b0 msgr2=0x7f96440b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f964415c2b0 0x7f96440b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 >> v2:172.21.15.105:3300/0 conn(0x7f964415f200 msgr2=0x7f964406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 --2- 172.21.15.60:0/3375018750 >> v2:172.21.15.105:3300/0 conn(0x7f964415f200 0x7f964406d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f964406ce30 con 0x7f96440b72f0 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f9634001670 con 0x7f96440b72f0 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 >> v1:172.21.15.60:6789/0 conn(0x7f96440b72f0 legacy=0x7f964415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96300039b0 0x7f9630003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9630004800 0x7f9630004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f964415c2b0 0x7f96300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96440b5900 con 0x7f9630004800 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f964415f830 con 0x7f96300039b0 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f963000b9c0 con 0x7f964415c2b0 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f9648f41640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9630004800 0x7f9630004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f9649742640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96300039b0 0x7f9630003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f9649f43640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f964415c2b0 0x7f96300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f9648f41640 1 -- 172.21.15.60:0/3375018750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f964415c2b0 msgr2=0x7f96300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f9648f41640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f964415c2b0 0x7f96300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f9648f41640 1 -- 172.21.15.60:0/3375018750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96300039b0 msgr2=0x7f9630003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f9648f41640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96300039b0 0x7f9630003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f9648f41640 1 -- 172.21.15.60:0/3375018750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9630003520 con 0x7f9630004800 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.477+0000 7f9649742640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96300039b0 0x7f9630003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.478+0000 7f9648f41640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9630004800 0x7f9630004c80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9644071730 tx=0x7f9630005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1df2997fcf688f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.478+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634007d50 con 0x7f9630004800 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.478+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96340058d0 con 0x7f9630004800 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.478+0000 7f963bfff640 1 -- 172.21.15.60:0/3375018750 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634005cc0 con 0x7f9630004800 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.479+0000 7f964b9a6640 1 -- 172.21.15.60:0/3375018750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9630004800 msgr2=0x7f9630004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.479+0000 7f964b9a6640 1 --2- 172.21.15.60:0/3375018750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9630004800 0x7f9630004c80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9644071730 tx=0x7f9630005830 comp rx=0 tx=0).stop 2024-09-12T01:36:44.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.479+0000 7f9649f43640 1 -- 172.21.15.60:0/3375018750 reap_dead start 2024-09-12T01:36:44.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.479+0000 7f964b9a6640 1 -- 172.21.15.60:0/3375018750 shutdown_connections 2024-09-12T01:36:44.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.479+0000 7f964b9a6640 1 -- 172.21.15.60:0/3375018750 >> 172.21.15.60:0/3375018750 conn(0x7f96440b4240 msgr2=0x7f96440b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:44.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.479+0000 7f964b9a6640 1 -- 172.21.15.60:0/3375018750 shutdown_connections 2024-09-12T01:36:44.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.479+0000 7f964b9a6640 1 -- 172.21.15.60:0/3375018750 wait complete. 2024-09-12T01:36:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.480+0000 7f964b9a6640 1 Processor -- start 2024-09-12T01:36:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.480+0000 7f964b9a6640 1 -- start start 2024-09-12T01:36:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f964b9a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9630004800 0x7f96441e8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f964b9a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96441e6dd0 0x7f96441586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f964b9a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9644147fe0 0x7f96440cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f964b9a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96440b7730 con 0x7f96441e6dd0 2024-09-12T01:36:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f964b9a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f964406d3f0 con 0x7f9630004800 2024-09-12T01:36:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f964b9a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f96440b6db0 con 0x7f9644147fe0 2024-09-12T01:36:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f9648f41640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96441e6dd0 0x7f96441586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f9648f41640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96441e6dd0 0x7f96441586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56866/0 (socket says 172.21.15.60:56866) 2024-09-12T01:36:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f9648f41640 1 -- 172.21.15.60:0/680171299 learned_addr learned my addr 172.21.15.60:0/680171299 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:44.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f9649742640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9630004800 0x7f96441e8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f9649f43640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9644147fe0 0x7f96440cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f9648f41640 1 -- 172.21.15.60:0/680171299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9644147fe0 msgr2=0x7f96440cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f9648f41640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9644147fe0 0x7f96440cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f9648f41640 1 -- 172.21.15.60:0/680171299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9630004800 msgr2=0x7f96441e8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f9648f41640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9630004800 0x7f96441e8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.481+0000 7f9648f41640 1 -- 172.21.15.60:0/680171299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9644157700 con 0x7f96441e6dd0 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.482+0000 7f9648f41640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96441e6dd0 0x7f96441586e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f963402adf0 tx=0x7f964406cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.482+0000 7f9639ffb640 1 -- 172.21.15.60:0/680171299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634007d50 con 0x7f96441e6dd0 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.482+0000 7f9639ffb640 1 -- 172.21.15.60:0/680171299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9634041070 con 0x7f96441e6dd0 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.482+0000 7f964b9a6640 1 -- 172.21.15.60:0/680171299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96441579e0 con 0x7f96441e6dd0 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.482+0000 7f9639ffb640 1 -- 172.21.15.60:0/680171299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634001cb0 con 0x7f96441e6dd0 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.482+0000 7f964b9a6640 1 -- 172.21.15.60:0/680171299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96441581c0 con 0x7f96441e6dd0 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.483+0000 7f964b9a6640 1 -- 172.21.15.60:0/680171299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f964415eaf0 con 0x7f96441e6dd0 2024-09-12T01:36:44.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.484+0000 7f9639ffb640 1 -- 172.21.15.60:0/680171299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f963403b070 con 0x7f96441e6dd0 2024-09-12T01:36:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.484+0000 7f9639ffb640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f962806be60 0x7f962806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.484+0000 7f9639ffb640 1 -- 172.21.15.60:0/680171299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f96340aa4e0 con 0x7f96441e6dd0 2024-09-12T01:36:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.484+0000 7f9649742640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f962806be60 0x7f962806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.485+0000 7f9649742640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f962806be60 0x7f962806e320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9640009c00 tx=0x7f9640009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:44.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.489+0000 7f9639ffb640 1 -- 172.21.15.60:0/680171299 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9634078840 con 0x7f96441e6dd0 2024-09-12T01:36:44.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.659+0000 7f964b9a6640 1 -- 172.21.15.60:0/680171299 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f96441574b0 con 0x7f962806be60 2024-09-12T01:36:44.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.665+0000 7f9639ffb640 1 -- 172.21.15.60:0/680171299 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251943 (secure 0 0 0) 0x7f96441574b0 con 0x7f962806be60 2024-09-12T01:36:44.667 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:44.668 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:36:44.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.669+0000 7f964b9a6640 1 -- 172.21.15.60:0/680171299 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f962806be60 msgr2=0x7f962806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:44.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.669+0000 7f964b9a6640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f962806be60 0x7f962806e320 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9640009c00 tx=0x7f9640009190 comp rx=0 tx=0).stop 2024-09-12T01:36:44.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.669+0000 7f964b9a6640 1 -- 172.21.15.60:0/680171299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96441e6dd0 msgr2=0x7f96441586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:44.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.669+0000 7f964b9a6640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96441e6dd0 0x7f96441586e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f963402adf0 tx=0x7f964406cd20 comp rx=0 tx=0).stop 2024-09-12T01:36:44.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.669+0000 7f964b9a6640 1 -- 172.21.15.60:0/680171299 shutdown_connections 2024-09-12T01:36:44.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.669+0000 7f964b9a6640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f962806be60 0x7f962806e320 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.669+0000 7f964b9a6640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9644147fe0 0x7f96440cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.669+0000 7f964b9a6640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96441e6dd0 0x7f96441586e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.669+0000 7f964b9a6640 1 --2- 172.21.15.60:0/680171299 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9630004800 0x7f96441e8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.669+0000 7f964b9a6640 1 -- 172.21.15.60:0/680171299 >> 172.21.15.60:0/680171299 conn(0x7f96440b4240 msgr2=0x7f964406e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:44.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.669+0000 7f964b9a6640 1 -- 172.21.15.60:0/680171299 shutdown_connections 2024-09-12T01:36:44.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.669+0000 7f964b9a6640 1 -- 172.21.15.60:0/680171299 wait complete. 2024-09-12T01:36:44.679 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-12T01:36:44.269604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241196,"kb_used_data":4168,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733524,"statfs":{"total":773094113280,"available":772847128576,"internally_reserved":0,"allocated":4268032,"data_stored":2341036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":242535984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002175"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782947+0000","last_change":"2024-09-12T01:36:36.939298+0000","last_active":"2024-09-12T01:36:38.782947+0000","last_peered":"2024-09-12T01:36:38.782947+0000","last_clean":"2024-09-12T01:36:38.782947+0000","last_became_active":"2024-09-12T01:36:36.939014+0000","last_became_peered":"2024-09-12T01:36:36.939014+0000","last_unstale":"2024-09-12T01:36:38.782947+0000","last_undegraded":"2024-09-12T01:36:38.782947+0000","last_fullsized":"2024-09-12T01:36:38.782947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:47.727620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782657+0000","last_change":"2024-09-12T01:36:36.956230+0000","last_active":"2024-09-12T01:36:38.782657+0000","last_peered":"2024-09-12T01:36:38.782657+0000","last_clean":"2024-09-12T01:36:38.782657+0000","last_became_active":"2024-09-12T01:36:36.955953+0000","last_became_peered":"2024-09-12T01:36:36.955953+0000","last_unstale":"2024-09-12T01:36:38.782657+0000","last_undegraded":"2024-09-12T01:36:38.782657+0000","last_fullsized":"2024-09-12T01:36:38.782657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:44.966933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.281591+0000","last_change":"2024-09-12T01:36:36.946051+0000","last_active":"2024-09-12T01:36:38.281591+0000","last_peered":"2024-09-12T01:36:38.281591+0000","last_clean":"2024-09-12T01:36:38.281591+0000","last_became_active":"2024-09-12T01:36:36.945810+0000","last_became_peered":"2024-09-12T01:36:36.945810+0000","last_unstale":"2024-09-12T01:36:38.281591+0000","last_undegraded":"2024-09-12T01:36:38.281591+0000","last_fullsized":"2024-09-12T01:36:38.281591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:06.984008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943920+0000","last_change":"2024-09-12T01:36:36.957801+0000","last_active":"2024-09-12T01:36:37.943920+0000","last_peered":"2024-09-12T01:36:37.943920+0000","last_clean":"2024-09-12T01:36:37.943920+0000","last_became_active":"2024-09-12T01:36:36.957534+0000","last_became_peered":"2024-09-12T01:36:36.957534+0000","last_unstale":"2024-09-12T01:36:37.943920+0000","last_undegraded":"2024-09-12T01:36:37.943920+0000","last_fullsized":"2024-09-12T01:36:37.943920+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:50.643715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782521+0000","last_change":"2024-09-12T01:36:36.959445+0000","last_active":"2024-09-12T01:36:38.782521+0000","last_peered":"2024-09-12T01:36:38.782521+0000","last_clean":"2024-09-12T01:36:38.782521+0000","last_became_active":"2024-09-12T01:36:36.959162+0000","last_became_peered":"2024-09-12T01:36:36.959162+0000","last_unstale":"2024-09-12T01:36:38.782521+0000","last_undegraded":"2024-09-12T01:36:38.782521+0000","last_fullsized":"2024-09-12T01:36:38.782521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:58.423600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943297+0000","last_change":"2024-09-12T01:36:36.950788+0000","last_active":"2024-09-12T01:36:37.943297+0000","last_peered":"2024-09-12T01:36:37.943297+0000","last_clean":"2024-09-12T01:36:37.943297+0000","last_became_active":"2024-09-12T01:36:36.950311+0000","last_became_peered":"2024-09-12T01:36:36.950311+0000","last_unstale":"2024-09-12T01:36:37.943297+0000","last_undegraded":"2024-09-12T01:36:37.943297+0000","last_fullsized":"2024-09-12T01:36:37.943297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:55.953192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782918+0000","last_change":"2024-09-12T01:36:36.941015+0000","last_active":"2024-09-12T01:36:38.782918+0000","last_peered":"2024-09-12T01:36:38.782918+0000","last_clean":"2024-09-12T01:36:38.782918+0000","last_became_active":"2024-09-12T01:36:36.940752+0000","last_became_peered":"2024-09-12T01:36:36.940752+0000","last_unstale":"2024-09-12T01:36:38.782918+0000","last_undegraded":"2024-09-12T01:36:38.782918+0000","last_fullsized":"2024-09-12T01:36:38.782918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:37.991777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782137+0000","last_change":"2024-09-12T01:36:36.948405+0000","last_active":"2024-09-12T01:36:38.782137+0000","last_peered":"2024-09-12T01:36:38.782137+0000","last_clean":"2024-09-12T01:36:38.782137+0000","last_became_active":"2024-09-12T01:36:36.948143+0000","last_became_peered":"2024-09-12T01:36:36.948143+0000","last_unstale":"2024-09-12T01:36:38.782137+0000","last_undegraded":"2024-09-12T01:36:38.782137+0000","last_fullsized":"2024-09-12T01:36:38.782137+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:18.034405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.281396+0000","last_change":"2024-09-12T01:36:36.950770+0000","last_active":"2024-09-12T01:36:38.281396+0000","last_peered":"2024-09-12T01:36:38.281396+0000","last_clean":"2024-09-12T01:36:38.281396+0000","last_became_active":"2024-09-12T01:36:36.950507+0000","last_became_peered":"2024-09-12T01:36:36.950507+0000","last_unstale":"2024-09-12T01:36:38.281396+0000","last_undegraded":"2024-09-12T01:36:38.281396+0000","last_fullsized":"2024-09-12T01:36:38.281396+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:19.147749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944308+0000","last_change":"2024-09-12T01:36:36.953248+0000","last_active":"2024-09-12T01:36:37.944308+0000","last_peered":"2024-09-12T01:36:37.944308+0000","last_clean":"2024-09-12T01:36:37.944308+0000","last_became_active":"2024-09-12T01:36:36.952957+0000","last_became_peered":"2024-09-12T01:36:36.952957+0000","last_unstale":"2024-09-12T01:36:37.944308+0000","last_undegraded":"2024-09-12T01:36:37.944308+0000","last_fullsized":"2024-09-12T01:36:37.944308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:21.471509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941798+0000","last_change":"2024-09-12T01:36:36.957413+0000","last_active":"2024-09-12T01:36:37.941798+0000","last_peered":"2024-09-12T01:36:37.941798+0000","last_clean":"2024-09-12T01:36:37.941798+0000","last_became_active":"2024-09-12T01:36:36.957151+0000","last_became_peered":"2024-09-12T01:36:36.957151+0000","last_unstale":"2024-09-12T01:36:37.941798+0000","last_undegraded":"2024-09-12T01:36:37.941798+0000","last_fullsized":"2024-09-12T01:36:37.941798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:56.197537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.281505+0000","last_change":"2024-09-12T01:36:36.955582+0000","last_active":"2024-09-12T01:36:38.281505+0000","last_peered":"2024-09-12T01:36:38.281505+0000","last_clean":"2024-09-12T01:36:38.281505+0000","last_became_active":"2024-09-12T01:36:36.955303+0000","last_became_peered":"2024-09-12T01:36:36.955303+0000","last_unstale":"2024-09-12T01:36:38.281505+0000","last_undegraded":"2024-09-12T01:36:38.281505+0000","last_fullsized":"2024-09-12T01:36:38.281505+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:24.681549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782793+0000","last_change":"2024-09-12T01:36:36.959515+0000","last_active":"2024-09-12T01:36:38.782793+0000","last_peered":"2024-09-12T01:36:38.782793+0000","last_clean":"2024-09-12T01:36:38.782793+0000","last_became_active":"2024-09-12T01:36:36.959096+0000","last_became_peered":"2024-09-12T01:36:36.959096+0000","last_unstale":"2024-09-12T01:36:38.782793+0000","last_undegraded":"2024-09-12T01:36:38.782793+0000","last_fullsized":"2024-09-12T01:36:38.782793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:35.739583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942927+0000","last_change":"2024-09-12T01:36:36.950183+0000","last_active":"2024-09-12T01:36:37.942927+0000","last_peered":"2024-09-12T01:36:37.942927+0000","last_clean":"2024-09-12T01:36:37.942927+0000","last_became_active":"2024-09-12T01:36:36.949691+0000","last_became_peered":"2024-09-12T01:36:36.949691+0000","last_unstale":"2024-09-12T01:36:37.942927+0000","last_undegraded":"2024-09-12T01:36:37.942927+0000","last_fullsized":"2024-09-12T01:36:37.942927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:43.773335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782271+0000","last_change":"2024-09-12T01:36:36.942655+0000","last_active":"2024-09-12T01:36:38.782271+0000","last_peered":"2024-09-12T01:36:38.782271+0000","last_clean":"2024-09-12T01:36:38.782271+0000","last_became_active":"2024-09-12T01:36:36.940992+0000","last_became_peered":"2024-09-12T01:36:36.940992+0000","last_unstale":"2024-09-12T01:36:38.782271+0000","last_undegraded":"2024-09-12T01:36:38.782271+0000","last_fullsized":"2024-09-12T01:36:38.782271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:25.998461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782048+0000","last_change":"2024-09-12T01:36:36.954545+0000","last_active":"2024-09-12T01:36:38.782048+0000","last_peered":"2024-09-12T01:36:38.782048+0000","last_clean":"2024-09-12T01:36:38.782048+0000","last_became_active":"2024-09-12T01:36:36.954242+0000","last_became_peered":"2024-09-12T01:36:36.954242+0000","last_unstale":"2024-09-12T01:36:38.782048+0000","last_undegraded":"2024-09-12T01:36:38.782048+0000","last_fullsized":"2024-09-12T01:36:38.782048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:57.291829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941790+0000","last_change":"2024-09-12T01:36:36.942772+0000","last_active":"2024-09-12T01:36:37.941790+0000","last_peered":"2024-09-12T01:36:37.941790+0000","last_clean":"2024-09-12T01:36:37.941790+0000","last_became_active":"2024-09-12T01:36:36.942491+0000","last_became_peered":"2024-09-12T01:36:36.942491+0000","last_unstale":"2024-09-12T01:36:37.941790+0000","last_undegraded":"2024-09-12T01:36:37.941790+0000","last_fullsized":"2024-09-12T01:36:37.941790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:13:34.436749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943321+0000","last_change":"2024-09-12T01:36:36.953551+0000","last_active":"2024-09-12T01:36:37.943321+0000","last_peered":"2024-09-12T01:36:37.943321+0000","last_clean":"2024-09-12T01:36:37.943321+0000","last_became_active":"2024-09-12T01:36:36.953303+0000","last_became_peered":"2024-09-12T01:36:36.953303+0000","last_unstale":"2024-09-12T01:36:37.943321+0000","last_undegraded":"2024-09-12T01:36:37.943321+0000","last_fullsized":"2024-09-12T01:36:37.943321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:36.333209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943455+0000","last_change":"2024-09-12T01:36:36.952779+0000","last_active":"2024-09-12T01:36:37.943455+0000","last_peered":"2024-09-12T01:36:37.943455+0000","last_clean":"2024-09-12T01:36:37.943455+0000","last_became_active":"2024-09-12T01:36:36.952311+0000","last_became_peered":"2024-09-12T01:36:36.952311+0000","last_unstale":"2024-09-12T01:36:37.943455+0000","last_undegraded":"2024-09-12T01:36:37.943455+0000","last_fullsized":"2024-09-12T01:36:37.943455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:19.147749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782956+0000","last_change":"2024-09-12T01:36:36.951186+0000","last_active":"2024-09-12T01:36:38.782956+0000","last_peered":"2024-09-12T01:36:38.782956+0000","last_clean":"2024-09-12T01:36:38.782956+0000","last_became_active":"2024-09-12T01:36:36.950914+0000","last_became_peered":"2024-09-12T01:36:36.950914+0000","last_unstale":"2024-09-12T01:36:38.782956+0000","last_undegraded":"2024-09-12T01:36:38.782956+0000","last_fullsized":"2024-09-12T01:36:38.782956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:57.291829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782331+0000","last_change":"2024-09-12T01:36:36.943443+0000","last_active":"2024-09-12T01:36:38.782331+0000","last_peered":"2024-09-12T01:36:38.782331+0000","last_clean":"2024-09-12T01:36:38.782331+0000","last_became_active":"2024-09-12T01:36:36.943156+0000","last_became_peered":"2024-09-12T01:36:36.943156+0000","last_unstale":"2024-09-12T01:36:38.782331+0000","last_undegraded":"2024-09-12T01:36:38.782331+0000","last_fullsized":"2024-09-12T01:36:38.782331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.948352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782451+0000","last_change":"2024-09-12T01:36:36.951049+0000","last_active":"2024-09-12T01:36:38.782451+0000","last_peered":"2024-09-12T01:36:38.782451+0000","last_clean":"2024-09-12T01:36:38.782451+0000","last_became_active":"2024-09-12T01:36:36.950781+0000","last_became_peered":"2024-09-12T01:36:36.950781+0000","last_unstale":"2024-09-12T01:36:38.782451+0000","last_undegraded":"2024-09-12T01:36:38.782451+0000","last_fullsized":"2024-09-12T01:36:38.782451+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.948352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782295+0000","last_change":"2024-09-12T01:36:36.953119+0000","last_active":"2024-09-12T01:36:38.782295+0000","last_peered":"2024-09-12T01:36:38.782295+0000","last_clean":"2024-09-12T01:36:38.782295+0000","last_became_active":"2024-09-12T01:36:36.952824+0000","last_became_peered":"2024-09-12T01:36:36.952824+0000","last_unstale":"2024-09-12T01:36:38.782295+0000","last_undegraded":"2024-09-12T01:36:38.782295+0000","last_fullsized":"2024-09-12T01:36:38.782295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:16.515003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.783128+0000","last_change":"2024-09-12T01:36:36.951776+0000","last_active":"2024-09-12T01:36:38.783128+0000","last_peered":"2024-09-12T01:36:38.783128+0000","last_clean":"2024-09-12T01:36:38.783128+0000","last_became_active":"2024-09-12T01:36:36.951496+0000","last_became_peered":"2024-09-12T01:36:36.951496+0000","last_unstale":"2024-09-12T01:36:38.783128+0000","last_undegraded":"2024-09-12T01:36:38.783128+0000","last_fullsized":"2024-09-12T01:36:38.783128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:29.725354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944292+0000","last_change":"2024-09-12T01:36:36.948968+0000","last_active":"2024-09-12T01:36:37.944292+0000","last_peered":"2024-09-12T01:36:37.944292+0000","last_clean":"2024-09-12T01:36:37.944292+0000","last_became_active":"2024-09-12T01:36:36.948252+0000","last_became_peered":"2024-09-12T01:36:36.948252+0000","last_unstale":"2024-09-12T01:36:37.944292+0000","last_undegraded":"2024-09-12T01:36:37.944292+0000","last_fullsized":"2024-09-12T01:36:37.944292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:37.561280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944268+0000","last_change":"2024-09-12T01:36:36.952664+0000","last_active":"2024-09-12T01:36:37.944268+0000","last_peered":"2024-09-12T01:36:37.944268+0000","last_clean":"2024-09-12T01:36:37.944268+0000","last_became_active":"2024-09-12T01:36:36.949903+0000","last_became_peered":"2024-09-12T01:36:36.949903+0000","last_unstale":"2024-09-12T01:36:37.944268+0000","last_undegraded":"2024-09-12T01:36:37.944268+0000","last_fullsized":"2024-09-12T01:36:37.944268+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:07.465038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782660+0000","last_change":"2024-09-12T01:36:36.944631+0000","last_active":"2024-09-12T01:36:38.782660+0000","last_peered":"2024-09-12T01:36:38.782660+0000","last_clean":"2024-09-12T01:36:38.782660+0000","last_became_active":"2024-09-12T01:36:36.944361+0000","last_became_peered":"2024-09-12T01:36:36.944361+0000","last_unstale":"2024-09-12T01:36:38.782660+0000","last_undegraded":"2024-09-12T01:36:38.782660+0000","last_fullsized":"2024-09-12T01:36:38.782660+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:37.991777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782672+0000","last_change":"2024-09-12T01:36:36.954407+0000","last_active":"2024-09-12T01:36:38.782672+0000","last_peered":"2024-09-12T01:36:38.782672+0000","last_clean":"2024-09-12T01:36:38.782672+0000","last_became_active":"2024-09-12T01:36:36.953889+0000","last_became_peered":"2024-09-12T01:36:36.953889+0000","last_unstale":"2024-09-12T01:36:38.782672+0000","last_undegraded":"2024-09-12T01:36:38.782672+0000","last_fullsized":"2024-09-12T01:36:38.782672+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:58.423600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782368+0000","last_change":"2024-09-12T01:36:36.951788+0000","last_active":"2024-09-12T01:36:38.782368+0000","last_peered":"2024-09-12T01:36:38.782368+0000","last_clean":"2024-09-12T01:36:38.782368+0000","last_became_active":"2024-09-12T01:36:36.951477+0000","last_became_peered":"2024-09-12T01:36:36.951477+0000","last_unstale":"2024-09-12T01:36:38.782368+0000","last_undegraded":"2024-09-12T01:36:38.782368+0000","last_fullsized":"2024-09-12T01:36:38.782368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:58.423600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782255+0000","last_change":"2024-09-12T01:36:36.940590+0000","last_active":"2024-09-12T01:36:38.782255+0000","last_peered":"2024-09-12T01:36:38.782255+0000","last_clean":"2024-09-12T01:36:38.782255+0000","last_became_active":"2024-09-12T01:36:36.939819+0000","last_became_peered":"2024-09-12T01:36:36.939819+0000","last_unstale":"2024-09-12T01:36:38.782255+0000","last_undegraded":"2024-09-12T01:36:38.782255+0000","last_fullsized":"2024-09-12T01:36:38.782255+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:18.034405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782908+0000","last_change":"2024-09-12T01:36:36.953022+0000","last_active":"2024-09-12T01:36:38.782908+0000","last_peered":"2024-09-12T01:36:38.782908+0000","last_clean":"2024-09-12T01:36:38.782908+0000","last_became_active":"2024-09-12T01:36:36.952605+0000","last_became_peered":"2024-09-12T01:36:36.952605+0000","last_unstale":"2024-09-12T01:36:38.782908+0000","last_undegraded":"2024-09-12T01:36:38.782908+0000","last_fullsized":"2024-09-12T01:36:38.782908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:54.701210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941438+0000","last_change":"2024-09-12T01:36:36.945227+0000","last_active":"2024-09-12T01:36:37.941438+0000","last_peered":"2024-09-12T01:36:37.941438+0000","last_clean":"2024-09-12T01:36:37.941438+0000","last_became_active":"2024-09-12T01:36:36.944947+0000","last_became_peered":"2024-09-12T01:36:36.944947+0000","last_unstale":"2024-09-12T01:36:37.941438+0000","last_undegraded":"2024-09-12T01:36:37.941438+0000","last_fullsized":"2024-09-12T01:36:37.941438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:12.875298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782732+0000","last_change":"2024-09-12T01:36:36.945308+0000","last_active":"2024-09-12T01:36:38.782732+0000","last_peered":"2024-09-12T01:36:38.782732+0000","last_clean":"2024-09-12T01:36:38.782732+0000","last_became_active":"2024-09-12T01:36:36.945007+0000","last_became_peered":"2024-09-12T01:36:36.945007+0000","last_unstale":"2024-09-12T01:36:38.782732+0000","last_undegraded":"2024-09-12T01:36:38.782732+0000","last_fullsized":"2024-09-12T01:36:38.782732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:19.313035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941981+0000","last_change":"2024-09-12T01:36:35.926539+0000","last_active":"2024-09-12T01:36:37.941981+0000","last_peered":"2024-09-12T01:36:37.941981+0000","last_clean":"2024-09-12T01:36:37.941981+0000","last_became_active":"2024-09-12T01:36:35.926255+0000","last_became_peered":"2024-09-12T01:36:35.926255+0000","last_unstale":"2024-09-12T01:36:37.941981+0000","last_undegraded":"2024-09-12T01:36:37.941981+0000","last_fullsized":"2024-09-12T01:36:37.941981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:36.987244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.783115+0000","last_change":"2024-09-12T01:36:36.941262+0000","last_active":"2024-09-12T01:36:38.783115+0000","last_peered":"2024-09-12T01:36:38.783115+0000","last_clean":"2024-09-12T01:36:38.783115+0000","last_became_active":"2024-09-12T01:36:36.940916+0000","last_became_peered":"2024-09-12T01:36:36.940916+0000","last_unstale":"2024-09-12T01:36:38.783115+0000","last_undegraded":"2024-09-12T01:36:38.783115+0000","last_fullsized":"2024-09-12T01:36:38.783115+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:16.009758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944393+0000","last_change":"2024-09-12T01:36:35.929496+0000","last_active":"2024-09-12T01:36:37.944393+0000","last_peered":"2024-09-12T01:36:37.944393+0000","last_clean":"2024-09-12T01:36:37.944393+0000","last_became_active":"2024-09-12T01:36:35.929228+0000","last_became_peered":"2024-09-12T01:36:35.929228+0000","last_unstale":"2024-09-12T01:36:37.944393+0000","last_undegraded":"2024-09-12T01:36:37.944393+0000","last_fullsized":"2024-09-12T01:36:37.944393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:40.249371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782901+0000","last_change":"2024-09-12T01:36:36.958260+0000","last_active":"2024-09-12T01:36:38.782901+0000","last_peered":"2024-09-12T01:36:38.782901+0000","last_clean":"2024-09-12T01:36:38.782901+0000","last_became_active":"2024-09-12T01:36:36.957839+0000","last_became_peered":"2024-09-12T01:36:36.957839+0000","last_unstale":"2024-09-12T01:36:38.782901+0000","last_undegraded":"2024-09-12T01:36:38.782901+0000","last_fullsized":"2024-09-12T01:36:38.782901+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:44.966933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943655+0000","last_change":"2024-09-12T01:36:35.935579+0000","last_active":"2024-09-12T01:36:37.943655+0000","last_peered":"2024-09-12T01:36:37.943655+0000","last_clean":"2024-09-12T01:36:37.943655+0000","last_became_active":"2024-09-12T01:36:35.935042+0000","last_became_peered":"2024-09-12T01:36:35.935042+0000","last_unstale":"2024-09-12T01:36:37.943655+0000","last_undegraded":"2024-09-12T01:36:37.943655+0000","last_fullsized":"2024-09-12T01:36:37.943655+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:25.164904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944239+0000","last_change":"2024-09-12T01:36:36.949253+0000","last_active":"2024-09-12T01:36:37.944239+0000","last_peered":"2024-09-12T01:36:37.944239+0000","last_clean":"2024-09-12T01:36:37.944239+0000","last_became_active":"2024-09-12T01:36:36.948587+0000","last_became_peered":"2024-09-12T01:36:36.948587+0000","last_unstale":"2024-09-12T01:36:37.944239+0000","last_undegraded":"2024-09-12T01:36:37.944239+0000","last_fullsized":"2024-09-12T01:36:37.944239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:09.195087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944041+0000","last_change":"2024-09-12T01:36:35.933669+0000","last_active":"2024-09-12T01:36:37.944041+0000","last_peered":"2024-09-12T01:36:37.944041+0000","last_clean":"2024-09-12T01:36:37.944041+0000","last_became_active":"2024-09-12T01:36:35.933265+0000","last_became_peered":"2024-09-12T01:36:35.933265+0000","last_unstale":"2024-09-12T01:36:37.944041+0000","last_undegraded":"2024-09-12T01:36:37.944041+0000","last_fullsized":"2024-09-12T01:36:37.944041+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:57.668650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.281353+0000","last_change":"2024-09-12T01:36:36.955689+0000","last_active":"2024-09-12T01:36:38.281353+0000","last_peered":"2024-09-12T01:36:38.281353+0000","last_clean":"2024-09-12T01:36:38.281353+0000","last_became_active":"2024-09-12T01:36:36.955372+0000","last_became_peered":"2024-09-12T01:36:36.955372+0000","last_unstale":"2024-09-12T01:36:38.281353+0000","last_undegraded":"2024-09-12T01:36:38.281353+0000","last_fullsized":"2024-09-12T01:36:38.281353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:36.333209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782935+0000","last_change":"2024-09-12T01:36:35.926335+0000","last_active":"2024-09-12T01:36:38.782935+0000","last_peered":"2024-09-12T01:36:38.782935+0000","last_clean":"2024-09-12T01:36:38.782935+0000","last_became_active":"2024-09-12T01:36:35.926068+0000","last_became_peered":"2024-09-12T01:36:35.926068+0000","last_unstale":"2024-09-12T01:36:38.782935+0000","last_undegraded":"2024-09-12T01:36:38.782935+0000","last_fullsized":"2024-09-12T01:36:38.782935+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:35.328676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782972+0000","last_change":"2024-09-12T01:36:36.952881+0000","last_active":"2024-09-12T01:36:38.782972+0000","last_peered":"2024-09-12T01:36:38.782972+0000","last_clean":"2024-09-12T01:36:38.782972+0000","last_became_active":"2024-09-12T01:36:36.952571+0000","last_became_peered":"2024-09-12T01:36:36.952571+0000","last_unstale":"2024-09-12T01:36:38.782972+0000","last_undegraded":"2024-09-12T01:36:38.782972+0000","last_fullsized":"2024-09-12T01:36:38.782972+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:50.865897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782522+0000","last_change":"2024-09-12T01:36:35.933380+0000","last_active":"2024-09-12T01:36:38.782522+0000","last_peered":"2024-09-12T01:36:38.782522+0000","last_clean":"2024-09-12T01:36:38.782522+0000","last_became_active":"2024-09-12T01:36:35.933059+0000","last_became_peered":"2024-09-12T01:36:35.933059+0000","last_unstale":"2024-09-12T01:36:38.782522+0000","last_undegraded":"2024-09-12T01:36:38.782522+0000","last_fullsized":"2024-09-12T01:36:38.782522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:35.333183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.281312+0000","last_change":"2024-09-12T01:36:36.941432+0000","last_active":"2024-09-12T01:36:38.281312+0000","last_peered":"2024-09-12T01:36:38.281312+0000","last_clean":"2024-09-12T01:36:38.281312+0000","last_became_active":"2024-09-12T01:36:36.941143+0000","last_became_peered":"2024-09-12T01:36:36.941143+0000","last_unstale":"2024-09-12T01:36:38.281312+0000","last_undegraded":"2024-09-12T01:36:38.281312+0000","last_fullsized":"2024-09-12T01:36:38.281312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:55.953192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942993+0000","last_change":"2024-09-12T01:36:35.936007+0000","last_active":"2024-09-12T01:36:37.942993+0000","last_peered":"2024-09-12T01:36:37.942993+0000","last_clean":"2024-09-12T01:36:37.942993+0000","last_became_active":"2024-09-12T01:36:35.935537+0000","last_became_peered":"2024-09-12T01:36:35.935537+0000","last_unstale":"2024-09-12T01:36:37.942993+0000","last_undegraded":"2024-09-12T01:36:37.942993+0000","last_fullsized":"2024-09-12T01:36:37.942993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:15.295242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942957+0000","last_change":"2024-09-12T01:36:36.949000+0000","last_active":"2024-09-12T01:36:37.942957+0000","last_peered":"2024-09-12T01:36:37.942957+0000","last_clean":"2024-09-12T01:36:37.942957+0000","last_became_active":"2024-09-12T01:36:36.948725+0000","last_became_peered":"2024-09-12T01:36:36.948725+0000","last_unstale":"2024-09-12T01:36:37.942957+0000","last_undegraded":"2024-09-12T01:36:37.942957+0000","last_fullsized":"2024-09-12T01:36:37.942957+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:26.769451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782371+0000","last_change":"2024-09-12T01:36:35.927732+0000","last_active":"2024-09-12T01:36:38.782371+0000","last_peered":"2024-09-12T01:36:38.782371+0000","last_clean":"2024-09-12T01:36:38.782371+0000","last_became_active":"2024-09-12T01:36:35.927452+0000","last_became_peered":"2024-09-12T01:36:35.927452+0000","last_unstale":"2024-09-12T01:36:38.782371+0000","last_undegraded":"2024-09-12T01:36:38.782371+0000","last_fullsized":"2024-09-12T01:36:38.782371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:47.150819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941778+0000","last_change":"2024-09-12T01:36:36.955030+0000","last_active":"2024-09-12T01:36:37.941778+0000","last_peered":"2024-09-12T01:36:37.941778+0000","last_clean":"2024-09-12T01:36:37.941778+0000","last_became_active":"2024-09-12T01:36:36.954747+0000","last_became_peered":"2024-09-12T01:36:36.954747+0000","last_unstale":"2024-09-12T01:36:37.941778+0000","last_undegraded":"2024-09-12T01:36:37.941778+0000","last_fullsized":"2024-09-12T01:36:37.941778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:54.813008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782866+0000","last_change":"2024-09-12T01:36:35.925002+0000","last_active":"2024-09-12T01:36:38.782866+0000","last_peered":"2024-09-12T01:36:38.782866+0000","last_clean":"2024-09-12T01:36:38.782866+0000","last_became_active":"2024-09-12T01:36:35.924647+0000","last_became_peered":"2024-09-12T01:36:35.924647+0000","last_unstale":"2024-09-12T01:36:38.782866+0000","last_undegraded":"2024-09-12T01:36:38.782866+0000","last_fullsized":"2024-09-12T01:36:38.782866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:52.650502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.944291+0000","last_change":"2024-09-12T01:36:36.949700+0000","last_active":"2024-09-12T01:36:37.944291+0000","last_peered":"2024-09-12T01:36:37.944291+0000","last_clean":"2024-09-12T01:36:37.944291+0000","last_became_active":"2024-09-12T01:36:36.949417+0000","last_became_peered":"2024-09-12T01:36:36.949417+0000","last_unstale":"2024-09-12T01:36:37.944291+0000","last_undegraded":"2024-09-12T01:36:37.944291+0000","last_fullsized":"2024-09-12T01:36:37.944291+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:11.246164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782709+0000","last_change":"2024-09-12T01:36:35.928853+0000","last_active":"2024-09-12T01:36:38.782709+0000","last_peered":"2024-09-12T01:36:38.782709+0000","last_clean":"2024-09-12T01:36:38.782709+0000","last_became_active":"2024-09-12T01:36:35.928107+0000","last_became_peered":"2024-09-12T01:36:35.928107+0000","last_unstale":"2024-09-12T01:36:38.782709+0000","last_undegraded":"2024-09-12T01:36:38.782709+0000","last_fullsized":"2024-09-12T01:36:38.782709+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:41.950953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943958+0000","last_change":"2024-09-12T01:36:36.958443+0000","last_active":"2024-09-12T01:36:37.943958+0000","last_peered":"2024-09-12T01:36:37.943958+0000","last_clean":"2024-09-12T01:36:37.943958+0000","last_became_active":"2024-09-12T01:36:36.956647+0000","last_became_peered":"2024-09-12T01:36:36.956647+0000","last_unstale":"2024-09-12T01:36:37.943958+0000","last_undegraded":"2024-09-12T01:36:37.943958+0000","last_fullsized":"2024-09-12T01:36:37.943958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:33.625549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941694+0000","last_change":"2024-09-12T01:36:35.926570+0000","last_active":"2024-09-12T01:36:37.941694+0000","last_peered":"2024-09-12T01:36:37.941694+0000","last_clean":"2024-09-12T01:36:37.941694+0000","last_became_active":"2024-09-12T01:36:35.926299+0000","last_became_peered":"2024-09-12T01:36:35.926299+0000","last_unstale":"2024-09-12T01:36:37.941694+0000","last_undegraded":"2024-09-12T01:36:37.941694+0000","last_fullsized":"2024-09-12T01:36:37.941694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:46.723087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941635+0000","last_change":"2024-09-12T01:36:36.956961+0000","last_active":"2024-09-12T01:36:37.941635+0000","last_peered":"2024-09-12T01:36:37.941635+0000","last_clean":"2024-09-12T01:36:37.941635+0000","last_became_active":"2024-09-12T01:36:36.956686+0000","last_became_peered":"2024-09-12T01:36:36.956686+0000","last_unstale":"2024-09-12T01:36:37.941635+0000","last_undegraded":"2024-09-12T01:36:37.941635+0000","last_fullsized":"2024-09-12T01:36:37.941635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:15.593094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782997+0000","last_change":"2024-09-12T01:36:35.932642+0000","last_active":"2024-09-12T01:36:38.782997+0000","last_peered":"2024-09-12T01:36:38.782997+0000","last_clean":"2024-09-12T01:36:38.782997+0000","last_became_active":"2024-09-12T01:36:35.931796+0000","last_became_peered":"2024-09-12T01:36:35.931796+0000","last_unstale":"2024-09-12T01:36:38.782997+0000","last_undegraded":"2024-09-12T01:36:38.782997+0000","last_fullsized":"2024-09-12T01:36:38.782997+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:23.677016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782443+0000","last_change":"2024-09-12T01:36:36.955525+0000","last_active":"2024-09-12T01:36:38.782443+0000","last_peered":"2024-09-12T01:36:38.782443+0000","last_clean":"2024-09-12T01:36:38.782443+0000","last_became_active":"2024-09-12T01:36:36.954730+0000","last_became_peered":"2024-09-12T01:36:36.954730+0000","last_unstale":"2024-09-12T01:36:38.782443+0000","last_undegraded":"2024-09-12T01:36:38.782443+0000","last_fullsized":"2024-09-12T01:36:38.782443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:42.955486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.783025+0000","last_change":"2024-09-12T01:36:35.934012+0000","last_active":"2024-09-12T01:36:38.783025+0000","last_peered":"2024-09-12T01:36:38.783025+0000","last_clean":"2024-09-12T01:36:38.783025+0000","last_became_active":"2024-09-12T01:36:35.933673+0000","last_became_peered":"2024-09-12T01:36:35.933673+0000","last_unstale":"2024-09-12T01:36:38.783025+0000","last_undegraded":"2024-09-12T01:36:38.783025+0000","last_fullsized":"2024-09-12T01:36:38.783025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:18.143216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943072+0000","last_change":"2024-09-12T01:36:36.956493+0000","last_active":"2024-09-12T01:36:37.943072+0000","last_peered":"2024-09-12T01:36:37.943072+0000","last_clean":"2024-09-12T01:36:37.943072+0000","last_became_active":"2024-09-12T01:36:36.955918+0000","last_became_peered":"2024-09-12T01:36:36.955918+0000","last_unstale":"2024-09-12T01:36:37.943072+0000","last_undegraded":"2024-09-12T01:36:37.943072+0000","last_fullsized":"2024-09-12T01:36:37.943072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:28.071193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942937+0000","last_change":"2024-09-12T01:36:35.930525+0000","last_active":"2024-09-12T01:36:37.942937+0000","last_peered":"2024-09-12T01:36:37.942937+0000","last_clean":"2024-09-12T01:36:37.942937+0000","last_became_active":"2024-09-12T01:36:35.930304+0000","last_became_peered":"2024-09-12T01:36:35.930304+0000","last_unstale":"2024-09-12T01:36:37.942937+0000","last_undegraded":"2024-09-12T01:36:37.942937+0000","last_fullsized":"2024-09-12T01:36:37.942937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:21.327981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782311+0000","last_change":"2024-09-12T01:36:36.941735+0000","last_active":"2024-09-12T01:36:38.782311+0000","last_peered":"2024-09-12T01:36:38.782311+0000","last_clean":"2024-09-12T01:36:38.782311+0000","last_became_active":"2024-09-12T01:36:36.941482+0000","last_became_peered":"2024-09-12T01:36:36.941482+0000","last_unstale":"2024-09-12T01:36:38.782311+0000","last_undegraded":"2024-09-12T01:36:38.782311+0000","last_fullsized":"2024-09-12T01:36:38.782311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:25.998461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942798+0000","last_change":"2024-09-12T01:36:35.929417+0000","last_active":"2024-09-12T01:36:37.942798+0000","last_peered":"2024-09-12T01:36:37.942798+0000","last_clean":"2024-09-12T01:36:37.942798+0000","last_became_active":"2024-09-12T01:36:35.928565+0000","last_became_peered":"2024-09-12T01:36:35.928565+0000","last_unstale":"2024-09-12T01:36:37.942798+0000","last_undegraded":"2024-09-12T01:36:37.942798+0000","last_fullsized":"2024-09-12T01:36:37.942798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:34.117880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941492+0000","last_change":"2024-09-12T01:36:36.945896+0000","last_active":"2024-09-12T01:36:37.941492+0000","last_peered":"2024-09-12T01:36:37.941492+0000","last_clean":"2024-09-12T01:36:37.941492+0000","last_became_active":"2024-09-12T01:36:36.945619+0000","last_became_peered":"2024-09-12T01:36:36.945619+0000","last_unstale":"2024-09-12T01:36:37.941492+0000","last_undegraded":"2024-09-12T01:36:37.941492+0000","last_fullsized":"2024-09-12T01:36:37.941492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:09.964720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942705+0000","last_change":"2024-09-12T01:36:35.935168+0000","last_active":"2024-09-12T01:36:37.942705+0000","last_peered":"2024-09-12T01:36:37.942705+0000","last_clean":"2024-09-12T01:36:37.942705+0000","last_became_active":"2024-09-12T01:36:35.934892+0000","last_became_peered":"2024-09-12T01:36:35.934892+0000","last_unstale":"2024-09-12T01:36:37.942705+0000","last_undegraded":"2024-09-12T01:36:37.942705+0000","last_fullsized":"2024-09-12T01:36:37.942705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:53.874519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941839+0000","last_change":"2024-09-12T01:36:36.952307+0000","last_active":"2024-09-12T01:36:37.941839+0000","last_peered":"2024-09-12T01:36:37.941839+0000","last_clean":"2024-09-12T01:36:37.941839+0000","last_became_active":"2024-09-12T01:36:36.952035+0000","last_became_peered":"2024-09-12T01:36:36.952035+0000","last_unstale":"2024-09-12T01:36:37.941839+0000","last_undegraded":"2024-09-12T01:36:37.941839+0000","last_fullsized":"2024-09-12T01:36:37.941839+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:01.857934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943430+0000","last_change":"2024-09-12T01:36:35.934430+0000","last_active":"2024-09-12T01:36:37.943430+0000","last_peered":"2024-09-12T01:36:37.943430+0000","last_clean":"2024-09-12T01:36:37.943430+0000","last_became_active":"2024-09-12T01:36:35.934149+0000","last_became_peered":"2024-09-12T01:36:35.934149+0000","last_unstale":"2024-09-12T01:36:37.943430+0000","last_undegraded":"2024-09-12T01:36:37.943430+0000","last_fullsized":"2024-09-12T01:36:37.943430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:00.562569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.281432+0000","last_change":"2024-09-12T01:36:36.941646+0000","last_active":"2024-09-12T01:36:38.281432+0000","last_peered":"2024-09-12T01:36:38.281432+0000","last_clean":"2024-09-12T01:36:38.281432+0000","last_became_active":"2024-09-12T01:36:36.941387+0000","last_became_peered":"2024-09-12T01:36:36.941387+0000","last_unstale":"2024-09-12T01:36:38.281432+0000","last_undegraded":"2024-09-12T01:36:38.281432+0000","last_fullsized":"2024-09-12T01:36:38.281432+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:36.337716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782591+0000","last_change":"2024-09-12T01:36:35.933683+0000","last_active":"2024-09-12T01:36:38.782591+0000","last_peered":"2024-09-12T01:36:38.782591+0000","last_clean":"2024-09-12T01:36:38.782591+0000","last_became_active":"2024-09-12T01:36:35.933277+0000","last_became_peered":"2024-09-12T01:36:35.933277+0000","last_unstale":"2024-09-12T01:36:38.782591+0000","last_undegraded":"2024-09-12T01:36:38.782591+0000","last_fullsized":"2024-09-12T01:36:38.782591+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:23.677016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782447+0000","last_change":"2024-09-12T01:36:36.945327+0000","last_active":"2024-09-12T01:36:38.782447+0000","last_peered":"2024-09-12T01:36:38.782447+0000","last_clean":"2024-09-12T01:36:38.782447+0000","last_became_active":"2024-09-12T01:36:36.945059+0000","last_became_peered":"2024-09-12T01:36:36.945059+0000","last_unstale":"2024-09-12T01:36:38.782447+0000","last_undegraded":"2024-09-12T01:36:38.782447+0000","last_fullsized":"2024-09-12T01:36:38.782447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:22.948352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941846+0000","last_change":"2024-09-12T01:36:35.927905+0000","last_active":"2024-09-12T01:36:37.941846+0000","last_peered":"2024-09-12T01:36:37.941846+0000","last_clean":"2024-09-12T01:36:37.941846+0000","last_became_active":"2024-09-12T01:36:35.927604+0000","last_became_peered":"2024-09-12T01:36:35.927604+0000","last_unstale":"2024-09-12T01:36:37.941846+0000","last_undegraded":"2024-09-12T01:36:37.941846+0000","last_fullsized":"2024-09-12T01:36:37.941846+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:49.861364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943462+0000","last_change":"2024-09-12T01:36:36.945532+0000","last_active":"2024-09-12T01:36:37.943462+0000","last_peered":"2024-09-12T01:36:37.943462+0000","last_clean":"2024-09-12T01:36:37.943462+0000","last_became_active":"2024-09-12T01:36:36.945231+0000","last_became_peered":"2024-09-12T01:36:36.945231+0000","last_unstale":"2024-09-12T01:36:37.943462+0000","last_undegraded":"2024-09-12T01:36:37.943462+0000","last_fullsized":"2024-09-12T01:36:37.943462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:36.337716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782684+0000","last_change":"2024-09-12T01:36:35.933192+0000","last_active":"2024-09-12T01:36:38.782684+0000","last_peered":"2024-09-12T01:36:38.782684+0000","last_clean":"2024-09-12T01:36:38.782684+0000","last_became_active":"2024-09-12T01:36:35.932896+0000","last_became_peered":"2024-09-12T01:36:35.932896+0000","last_unstale":"2024-09-12T01:36:38.782684+0000","last_undegraded":"2024-09-12T01:36:38.782684+0000","last_fullsized":"2024-09-12T01:36:38.782684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:20.434555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782668+0000","last_change":"2024-09-12T01:36:36.952087+0000","last_active":"2024-09-12T01:36:38.782668+0000","last_peered":"2024-09-12T01:36:38.782668+0000","last_clean":"2024-09-12T01:36:38.782668+0000","last_became_active":"2024-09-12T01:36:36.950967+0000","last_became_peered":"2024-09-12T01:36:36.950967+0000","last_unstale":"2024-09-12T01:36:38.782668+0000","last_undegraded":"2024-09-12T01:36:38.782668+0000","last_fullsized":"2024-09-12T01:36:38.782668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:41.389810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782745+0000","last_change":"2024-09-12T01:36:35.928358+0000","last_active":"2024-09-12T01:36:38.782745+0000","last_peered":"2024-09-12T01:36:38.782745+0000","last_clean":"2024-09-12T01:36:38.782745+0000","last_became_active":"2024-09-12T01:36:35.928065+0000","last_became_peered":"2024-09-12T01:36:35.928065+0000","last_unstale":"2024-09-12T01:36:38.782745+0000","last_undegraded":"2024-09-12T01:36:38.782745+0000","last_fullsized":"2024-09-12T01:36:38.782745+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:15.510470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782766+0000","last_change":"2024-09-12T01:36:36.947393+0000","last_active":"2024-09-12T01:36:38.782766+0000","last_peered":"2024-09-12T01:36:38.782766+0000","last_clean":"2024-09-12T01:36:38.782766+0000","last_became_active":"2024-09-12T01:36:36.947124+0000","last_became_peered":"2024-09-12T01:36:36.947124+0000","last_unstale":"2024-09-12T01:36:38.782766+0000","last_undegraded":"2024-09-12T01:36:38.782766+0000","last_fullsized":"2024-09-12T01:36:38.782766+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:54.701210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782647+0000","last_change":"2024-09-12T01:36:35.932810+0000","last_active":"2024-09-12T01:36:38.782647+0000","last_peered":"2024-09-12T01:36:38.782647+0000","last_clean":"2024-09-12T01:36:38.782647+0000","last_became_active":"2024-09-12T01:36:35.932353+0000","last_became_peered":"2024-09-12T01:36:35.932353+0000","last_unstale":"2024-09-12T01:36:38.782647+0000","last_undegraded":"2024-09-12T01:36:38.782647+0000","last_fullsized":"2024-09-12T01:36:38.782647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:15.160347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782310+0000","last_change":"2024-09-12T01:36:36.958680+0000","last_active":"2024-09-12T01:36:38.782310+0000","last_peered":"2024-09-12T01:36:38.782310+0000","last_clean":"2024-09-12T01:36:38.782310+0000","last_became_active":"2024-09-12T01:36:36.958303+0000","last_became_peered":"2024-09-12T01:36:36.958303+0000","last_unstale":"2024-09-12T01:36:38.782310+0000","last_undegraded":"2024-09-12T01:36:38.782310+0000","last_fullsized":"2024-09-12T01:36:38.782310+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:53.655035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.281187+0000","last_change":"2024-09-12T01:36:35.919982+0000","last_active":"2024-09-12T01:36:38.281187+0000","last_peered":"2024-09-12T01:36:38.281187+0000","last_clean":"2024-09-12T01:36:38.281187+0000","last_became_active":"2024-09-12T01:36:35.919601+0000","last_became_peered":"2024-09-12T01:36:35.919601+0000","last_unstale":"2024-09-12T01:36:38.281187+0000","last_undegraded":"2024-09-12T01:36:38.281187+0000","last_fullsized":"2024-09-12T01:36:38.281187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:25.164904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.281311+0000","last_change":"2024-09-12T01:36:36.944321+0000","last_active":"2024-09-12T01:36:38.281311+0000","last_peered":"2024-09-12T01:36:38.281311+0000","last_clean":"2024-09-12T01:36:38.281311+0000","last_became_active":"2024-09-12T01:36:36.944058+0000","last_became_peered":"2024-09-12T01:36:36.944058+0000","last_unstale":"2024-09-12T01:36:38.281311+0000","last_undegraded":"2024-09-12T01:36:38.281311+0000","last_fullsized":"2024-09-12T01:36:38.281311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:04.192678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941379+0000","last_change":"2024-09-12T01:36:35.927035+0000","last_active":"2024-09-12T01:36:37.941379+0000","last_peered":"2024-09-12T01:36:37.941379+0000","last_clean":"2024-09-12T01:36:37.941379+0000","last_became_active":"2024-09-12T01:36:35.926763+0000","last_became_peered":"2024-09-12T01:36:35.926763+0000","last_unstale":"2024-09-12T01:36:37.941379+0000","last_undegraded":"2024-09-12T01:36:37.941379+0000","last_fullsized":"2024-09-12T01:36:37.941379+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:53.696677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943469+0000","last_change":"2024-09-12T01:36:36.956401+0000","last_active":"2024-09-12T01:36:37.943469+0000","last_peered":"2024-09-12T01:36:37.943469+0000","last_clean":"2024-09-12T01:36:37.943469+0000","last_became_active":"2024-09-12T01:36:36.956134+0000","last_became_peered":"2024-09-12T01:36:36.956134+0000","last_unstale":"2024-09-12T01:36:37.943469+0000","last_undegraded":"2024-09-12T01:36:37.943469+0000","last_fullsized":"2024-09-12T01:36:37.943469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:24.681549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782553+0000","last_change":"2024-09-12T01:36:35.932133+0000","last_active":"2024-09-12T01:36:38.782553+0000","last_peered":"2024-09-12T01:36:38.782553+0000","last_clean":"2024-09-12T01:36:38.782553+0000","last_became_active":"2024-09-12T01:36:35.931652+0000","last_became_peered":"2024-09-12T01:36:35.931652+0000","last_unstale":"2024-09-12T01:36:38.782553+0000","last_undegraded":"2024-09-12T01:36:38.782553+0000","last_fullsized":"2024-09-12T01:36:38.782553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:35.328676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941946+0000","last_change":"2024-09-12T01:36:36.953376+0000","last_active":"2024-09-12T01:36:37.941946+0000","last_peered":"2024-09-12T01:36:37.941946+0000","last_clean":"2024-09-12T01:36:37.941946+0000","last_became_active":"2024-09-12T01:36:36.953028+0000","last_became_peered":"2024-09-12T01:36:36.953028+0000","last_unstale":"2024-09-12T01:36:37.941946+0000","last_undegraded":"2024-09-12T01:36:37.941946+0000","last_fullsized":"2024-09-12T01:36:37.941946+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:39.915999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782907+0000","last_change":"2024-09-12T01:36:35.929069+0000","last_active":"2024-09-12T01:36:38.782907+0000","last_peered":"2024-09-12T01:36:38.782907+0000","last_clean":"2024-09-12T01:36:38.782907+0000","last_became_active":"2024-09-12T01:36:35.928594+0000","last_became_peered":"2024-09-12T01:36:35.928594+0000","last_unstale":"2024-09-12T01:36:38.782907+0000","last_undegraded":"2024-09-12T01:36:38.782907+0000","last_fullsized":"2024-09-12T01:36:38.782907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:40.385277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943639+0000","last_change":"2024-09-12T01:36:36.961255+0000","last_active":"2024-09-12T01:36:37.943639+0000","last_peered":"2024-09-12T01:36:37.943639+0000","last_clean":"2024-09-12T01:36:37.943639+0000","last_became_active":"2024-09-12T01:36:36.960971+0000","last_became_peered":"2024-09-12T01:36:36.960971+0000","last_unstale":"2024-09-12T01:36:37.943639+0000","last_undegraded":"2024-09-12T01:36:37.943639+0000","last_fullsized":"2024-09-12T01:36:37.943639+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:06.984008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.783047+0000","last_change":"2024-09-12T01:36:35.932642+0000","last_active":"2024-09-12T01:36:38.783047+0000","last_peered":"2024-09-12T01:36:38.783047+0000","last_clean":"2024-09-12T01:36:38.783047+0000","last_became_active":"2024-09-12T01:36:35.931758+0000","last_became_peered":"2024-09-12T01:36:35.931758+0000","last_unstale":"2024-09-12T01:36:38.783047+0000","last_undegraded":"2024-09-12T01:36:38.783047+0000","last_fullsized":"2024-09-12T01:36:38.783047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:05.979475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782423+0000","last_change":"2024-09-12T01:36:36.948192+0000","last_active":"2024-09-12T01:36:38.782423+0000","last_peered":"2024-09-12T01:36:38.782423+0000","last_clean":"2024-09-12T01:36:38.782423+0000","last_became_active":"2024-09-12T01:36:36.947909+0000","last_became_peered":"2024-09-12T01:36:36.947909+0000","last_unstale":"2024-09-12T01:36:38.782423+0000","last_undegraded":"2024-09-12T01:36:38.782423+0000","last_fullsized":"2024-09-12T01:36:38.782423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:44.966933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782783+0000","last_change":"2024-09-12T01:36:35.932306+0000","last_active":"2024-09-12T01:36:38.782783+0000","last_peered":"2024-09-12T01:36:38.782783+0000","last_clean":"2024-09-12T01:36:38.782783+0000","last_became_active":"2024-09-12T01:36:35.931880+0000","last_became_peered":"2024-09-12T01:36:35.931880+0000","last_unstale":"2024-09-12T01:36:38.782783+0000","last_undegraded":"2024-09-12T01:36:38.782783+0000","last_fullsized":"2024-09-12T01:36:38.782783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:18.143216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.943152+0000","last_change":"2024-09-12T01:36:36.953248+0000","last_active":"2024-09-12T01:36:37.943152+0000","last_peered":"2024-09-12T01:36:37.943152+0000","last_clean":"2024-09-12T01:36:37.943152+0000","last_became_active":"2024-09-12T01:36:36.951771+0000","last_became_peered":"2024-09-12T01:36:36.951771+0000","last_unstale":"2024-09-12T01:36:37.943152+0000","last_undegraded":"2024-09-12T01:36:37.943152+0000","last_fullsized":"2024-09-12T01:36:37.943152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:31.145637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782498+0000","last_change":"2024-09-12T01:36:35.932260+0000","last_active":"2024-09-12T01:36:38.782498+0000","last_peered":"2024-09-12T01:36:38.782498+0000","last_clean":"2024-09-12T01:36:38.782498+0000","last_became_active":"2024-09-12T01:36:35.931884+0000","last_became_peered":"2024-09-12T01:36:35.931884+0000","last_unstale":"2024-09-12T01:36:38.782498+0000","last_undegraded":"2024-09-12T01:36:38.782498+0000","last_fullsized":"2024-09-12T01:36:38.782498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:35.333183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942796+0000","last_change":"2024-09-12T01:36:36.951657+0000","last_active":"2024-09-12T01:36:37.942796+0000","last_peered":"2024-09-12T01:36:37.942796+0000","last_clean":"2024-09-12T01:36:37.942796+0000","last_became_active":"2024-09-12T01:36:36.950874+0000","last_became_peered":"2024-09-12T01:36:36.950874+0000","last_unstale":"2024-09-12T01:36:37.942796+0000","last_undegraded":"2024-09-12T01:36:37.942796+0000","last_fullsized":"2024-09-12T01:36:37.942796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:20.771473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782968+0000","last_change":"2024-09-12T01:36:35.932830+0000","last_active":"2024-09-12T01:36:38.782968+0000","last_peered":"2024-09-12T01:36:38.782968+0000","last_clean":"2024-09-12T01:36:38.782968+0000","last_became_active":"2024-09-12T01:36:35.932514+0000","last_became_peered":"2024-09-12T01:36:35.932514+0000","last_unstale":"2024-09-12T01:36:38.782968+0000","last_undegraded":"2024-09-12T01:36:38.782968+0000","last_fullsized":"2024-09-12T01:36:38.782968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:05.979475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941546+0000","last_change":"2024-09-12T01:36:36.956326+0000","last_active":"2024-09-12T01:36:37.941546+0000","last_peered":"2024-09-12T01:36:37.941546+0000","last_clean":"2024-09-12T01:36:37.941546+0000","last_became_active":"2024-09-12T01:36:36.956047+0000","last_became_peered":"2024-09-12T01:36:36.956047+0000","last_unstale":"2024-09-12T01:36:37.941546+0000","last_undegraded":"2024-09-12T01:36:37.941546+0000","last_fullsized":"2024-09-12T01:36:37.941546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.692293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.942730+0000","last_change":"2024-09-12T01:36:35.927729+0000","last_active":"2024-09-12T01:36:37.942730+0000","last_peered":"2024-09-12T01:36:37.942730+0000","last_clean":"2024-09-12T01:36:37.942730+0000","last_became_active":"2024-09-12T01:36:35.927450+0000","last_became_peered":"2024-09-12T01:36:35.927450+0000","last_unstale":"2024-09-12T01:36:37.942730+0000","last_undegraded":"2024-09-12T01:36:37.942730+0000","last_fullsized":"2024-09-12T01:36:37.942730+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:32.938884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.782623+0000","last_change":"2024-09-12T01:36:36.954910+0000","last_active":"2024-09-12T01:36:38.782623+0000","last_peered":"2024-09-12T01:36:38.782623+0000","last_clean":"2024-09-12T01:36:38.782623+0000","last_became_active":"2024-09-12T01:36:36.954449+0000","last_became_peered":"2024-09-12T01:36:36.954449+0000","last_unstale":"2024-09-12T01:36:38.782623+0000","last_undegraded":"2024-09-12T01:36:38.782623+0000","last_fullsized":"2024-09-12T01:36:38.782623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:35.910560+0000","last_clean_scrub_stamp":"2024-09-12T01:36:35.910560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:37.991777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:37.941886+0000","last_change":"2024-09-12T01:36:35.928371+0000","last_active":"2024-09-12T01:36:37.941886+0000","last_peered":"2024-09-12T01:36:37.941886+0000","last_clean":"2024-09-12T01:36:37.941886+0000","last_became_active":"2024-09-12T01:36:35.928066+0000","last_became_peered":"2024-09-12T01:36:35.928066+0000","last_unstale":"2024-09-12T01:36:37.941886+0000","last_undegraded":"2024-09-12T01:36:37.941886+0000","last_fullsized":"2024-09-12T01:36:37.941886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:36:34.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:36:34.906027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:28.720821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":192,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T01:36:38.281160+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:36:38.281160+0000","last_peered":"2024-09-12T01:36:38.281160+0000","last_clean":"2024-09-12T01:36:38.281160+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:36:38.281160+0000","last_undegraded":"2024-09-12T01:36:38.281160+0000","last_fullsized":"2024-09-12T01:36:38.281160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509456,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":144457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":146047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":974848,"data_stored":735385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35732,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336108,"statfs":{"total":96636764160,"available":96600174592,"internally_reserved":0,"allocated":393216,"data_stored":145211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":380928,"data_stored":144469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":734873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":380928,"data_stored":144525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":393216,"data_stored":146069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:36:44.683 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:36:44.683 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:36:44.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.834+0000 7f48bb3d6640 1 Processor -- start 2024-09-12T01:36:44.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.834+0000 7f48bb3d6640 1 -- start start 2024-09-12T01:36:44.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.835+0000 7f48bb3d6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f48b415e600 0x7f48b40d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.835+0000 7f48bb3d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b40cf4c0 0x7f48b40d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.835+0000 7f48bb3d6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48b40b7ad0 con 0x7f48b40d1a40 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.835+0000 7f48bb3d6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f48b40d1e90 con 0x7f48b415e600 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.835+0000 7f48bb3d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f48b40d2ee0 con 0x7f48b40cf4c0 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.835+0000 7f48b8971640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f48b40d1a40 0x7f48b40cedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33130/0 (socket says 172.21.15.60:33130) 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.835+0000 7f48b8971640 1 -- 172.21.15.60:0/3632061590 learned_addr learned my addr 172.21.15.60:0/3632061590 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183908761 0 0) 0x7f48a8001110 con 0x7f48b40d1a40 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f489c003520 con 0x7f48b40d1a40 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b9973640 1 --2- 172.21.15.60:0/3632061590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b40cf4c0 0x7f48b40d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b9172640 1 --2- 172.21.15.60:0/3632061590 >> v2:172.21.15.105:3300/0 conn(0x7f48b415e600 0x7f48b40d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2418498609 0 0) 0x7f489c003520 con 0x7f48b40d1a40 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b40cf4c0 msgr2=0x7f48b40d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 --2- 172.21.15.60:0/3632061590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b40cf4c0 0x7f48b40d3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 >> v2:172.21.15.105:3300/0 conn(0x7f48b415e600 msgr2=0x7f48b40d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 --2- 172.21.15.60:0/3632061590 >> v2:172.21.15.105:3300/0 conn(0x7f48b415e600 0x7f48b40d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b40cf9e0 con 0x7f48b40d1a40 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f48a8001840 con 0x7f48b40d1a40 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 >> v1:172.21.15.60:6789/0 conn(0x7f48b40d1a40 legacy=0x7f48b40cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 --2- 172.21.15.60:0/3632061590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b40cf4c0 0x7f489c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 --2- 172.21.15.60:0/3632061590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f489c003f30 0x7f489c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 --2- 172.21.15.60:0/3632061590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f489c004d40 0x7f489c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f48b40d1e90 con 0x7f489c003f30 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f48b40d2ee0 con 0x7f489c004d40 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f489c00b9c0 con 0x7f48b40cf4c0 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b8971640 1 --2- 172.21.15.60:0/3632061590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f489c003f30 0x7f489c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b9172640 1 --2- 172.21.15.60:0/3632061590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b40cf4c0 0x7f489c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b9973640 1 --2- 172.21.15.60:0/3632061590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f489c004d40 0x7f489c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b8971640 1 -- 172.21.15.60:0/3632061590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b40cf4c0 msgr2=0x7f489c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b8971640 1 --2- 172.21.15.60:0/3632061590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b40cf4c0 0x7f489c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b8971640 1 -- 172.21.15.60:0/3632061590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f489c004d40 msgr2=0x7f489c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b8971640 1 --2- 172.21.15.60:0/3632061590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f489c004d40 0x7f489c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.836+0000 7f48b8971640 1 -- 172.21.15.60:0/3632061590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489c003520 con 0x7f489c003f30 2024-09-12T01:36:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.837+0000 7f48b8971640 1 --2- 172.21.15.60:0/3632061590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f489c003f30 0x7f489c004800 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f48a800c4c0 tx=0x7f489c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a8e8a887e2231c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.837+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a800c0e0 con 0x7f489c003f30 2024-09-12T01:36:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.837+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a8034070 con 0x7f489c003f30 2024-09-12T01:36:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.837+0000 7f48b3fff640 1 -- 172.21.15.60:0/3632061590 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a8005d30 con 0x7f489c003f30 2024-09-12T01:36:44.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.838+0000 7f48bb3d6640 1 -- 172.21.15.60:0/3632061590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f489c003f30 msgr2=0x7f489c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:44.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.838+0000 7f48bb3d6640 1 --2- 172.21.15.60:0/3632061590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f489c003f30 0x7f489c004800 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f48a800c4c0 tx=0x7f489c005830 comp rx=0 tx=0).stop 2024-09-12T01:36:44.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.838+0000 7f48b9973640 1 -- 172.21.15.60:0/3632061590 reap_dead start 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.838+0000 7f48bb3d6640 1 -- 172.21.15.60:0/3632061590 shutdown_connections 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.838+0000 7f48bb3d6640 1 -- 172.21.15.60:0/3632061590 >> 172.21.15.60:0/3632061590 conn(0x7f48b406c2c0 msgr2=0x7f48b406c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.838+0000 7f48bb3d6640 1 -- 172.21.15.60:0/3632061590 shutdown_connections 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.838+0000 7f48bb3d6640 1 -- 172.21.15.60:0/3632061590 wait complete. 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.839+0000 7f48bb3d6640 1 Processor -- start 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.839+0000 7f48bb3d6640 1 -- start start 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48bb3d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f489c003f30 0x7f48b41f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48bb3d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b41e8db0 0x7f48b41e9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48bb3d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48b40c8e20 0x7f48b40c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48bb3d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f48b40d2b70 con 0x7f489c003f30 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48bb3d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f48b40cffa0 con 0x7f48b40c8e20 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48bb3d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f48b415e9e0 con 0x7f48b41e8db0 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48b9172640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f489c003f30 0x7f48b41f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48b9172640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f489c003f30 0x7f48b41f74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56880/0 (socket says 172.21.15.60:56880) 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48b9172640 1 -- 172.21.15.60:0/4078741669 learned_addr learned my addr 172.21.15.60:0/4078741669 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48b8971640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b41e8db0 0x7f48b41e9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48b9973640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48b40c8e20 0x7f48b40c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48b9172640 1 -- 172.21.15.60:0/4078741669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b41e8db0 msgr2=0x7f48b41e9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48b9172640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b41e8db0 0x7f48b41e9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48b9172640 1 -- 172.21.15.60:0/4078741669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48b40c8e20 msgr2=0x7f48b40c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48b9172640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48b40c8e20 0x7f48b40c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.840+0000 7f48b9172640 1 -- 172.21.15.60:0/4078741669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b41f79e0 con 0x7f489c003f30 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.841+0000 7f48b9172640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f489c003f30 0x7f48b41f74a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f48a4011e60 tx=0x7f48a400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.841+0000 7f48b1ffb640 1 -- 172.21.15.60:0/4078741669 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a400fea0 con 0x7f489c003f30 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.841+0000 7f48b1ffb640 1 -- 172.21.15.60:0/4078741669 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48a4015630 con 0x7f489c003f30 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.841+0000 7f48bb3d6640 1 -- 172.21.15.60:0/4078741669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b41e3b50 con 0x7f489c003f30 2024-09-12T01:36:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.841+0000 7f48b1ffb640 1 -- 172.21.15.60:0/4078741669 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a4015a00 con 0x7f489c003f30 2024-09-12T01:36:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.841+0000 7f48bb3d6640 1 -- 172.21.15.60:0/4078741669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b41e4110 con 0x7f489c003f30 2024-09-12T01:36:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.842+0000 7f48bb3d6640 1 -- 172.21.15.60:0/4078741669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b41e9770 con 0x7f489c003f30 2024-09-12T01:36:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.842+0000 7f48b1ffb640 1 -- 172.21.15.60:0/4078741669 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f48a4015ba0 con 0x7f489c003f30 2024-09-12T01:36:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.843+0000 7f48b1ffb640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f48a006be60 0x7f48a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.843+0000 7f48b1ffb640 1 -- 172.21.15.60:0/4078741669 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f48a408bed0 con 0x7f489c003f30 2024-09-12T01:36:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.843+0000 7f48b8971640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f48a006be60 0x7f48a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.843+0000 7f48b8971640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f48a006be60 0x7f48a006e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48a8033000 tx=0x7f48a8009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:44.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:44.847+0000 7f48b1ffb640 1 -- 172.21.15.60:0/4078741669 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f48a4019030 con 0x7f489c003f30 2024-09-12T01:36:45.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.091+0000 7f48bb3d6640 1 -- 172.21.15.60:0/4078741669 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f48b40b5fa0 con 0x7f489c003f30 2024-09-12T01:36:45.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.093+0000 7f48b1ffb640 1 -- 172.21.15.60:0/4078741669 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f48b40b5fa0 con 0x7f489c003f30 2024-09-12T01:36:45.093 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-12T01:36:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ== 2024-09-12T01:36:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: caps mds = "allow" 2024-09-12T01:36:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: caps mon = "allow r" 2024-09-12T01:36:45.093 INFO:teuthology.orchestra.run.smithi060.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:36:45.093 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2024-09-12T01:36:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.096+0000 7f48bb3d6640 1 -- 172.21.15.60:0/4078741669 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f48a006be60 msgr2=0x7f48a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.096+0000 7f48bb3d6640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f48a006be60 0x7f48a006e320 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f48a8033000 tx=0x7f48a8009030 comp rx=0 tx=0).stop 2024-09-12T01:36:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.096+0000 7f48bb3d6640 1 -- 172.21.15.60:0/4078741669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f489c003f30 msgr2=0x7f48b41f74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.096+0000 7f48bb3d6640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f489c003f30 0x7f48b41f74a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f48a4011e60 tx=0x7f48a400f580 comp rx=0 tx=0).stop 2024-09-12T01:36:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.096+0000 7f48bb3d6640 1 -- 172.21.15.60:0/4078741669 shutdown_connections 2024-09-12T01:36:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.096+0000 7f48bb3d6640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f48b40c8e20 0x7f48b40c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.096+0000 7f48bb3d6640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f48a006be60 0x7f48a006e320 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.096+0000 7f48bb3d6640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48b41e8db0 0x7f48b41e9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.096+0000 7f48bb3d6640 1 --2- 172.21.15.60:0/4078741669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f489c003f30 0x7f48b41f74a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.096+0000 7f48bb3d6640 1 -- 172.21.15.60:0/4078741669 >> 172.21.15.60:0/4078741669 conn(0x7f48b406c2c0 msgr2=0x7f48b40b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.096+0000 7f48bb3d6640 1 -- 172.21.15.60:0/4078741669 shutdown_connections 2024-09-12T01:36:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.096+0000 7f48bb3d6640 1 -- 172.21.15.60:0/4078741669 wait complete. 2024-09-12T01:36:45.107 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.210+0000 7f9c1db0c640 1 Processor -- start 2024-09-12T01:36:45.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.210+0000 7f9c1db0c640 1 -- start start 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.211+0000 7f9c1db0c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c1815e660 0x7f9c180cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.211+0000 7f9c1db0c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c180d3310 0x7f9c180d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.211+0000 7f9c1db0c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9c180d1650 0x7f9c1806bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.211+0000 7f9c1db0c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9c180d1ac0 con 0x7f9c1815e660 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.211+0000 7f9c1db0c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9c1815ea40 con 0x7f9c180d1650 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.211+0000 7f9c1db0c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9c180d3870 con 0x7f9c180d3310 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.211+0000 7f9c177fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c1815e660 0x7f9c180cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.211+0000 7f9c177fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c1815e660 0x7f9c180cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56892/0 (socket says 172.21.15.60:56892) 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.211+0000 7f9c177fe640 1 -- 172.21.15.60:0/3029916449 learned_addr learned my addr 172.21.15.60:0/3029916449 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.212+0000 7f9c16ffd640 1 --2- 172.21.15.60:0/3029916449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c180d3310 0x7f9c180d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.212+0000 7f9c17fff640 1 --2- 172.21.15.60:0/3029916449 >> v2:172.21.15.105:3300/0 conn(0x7f9c180d1650 0x7f9c1806bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.212+0000 7f9c177fe640 1 -- 172.21.15.60:0/3029916449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c180d3310 msgr2=0x7f9c180d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.212+0000 7f9c177fe640 1 --2- 172.21.15.60:0/3029916449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c180d3310 0x7f9c180d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.212+0000 7f9c177fe640 1 -- 172.21.15.60:0/3029916449 >> v2:172.21.15.105:3300/0 conn(0x7f9c180d1650 msgr2=0x7f9c1806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.212+0000 7f9c177fe640 1 --2- 172.21.15.60:0/3029916449 >> v2:172.21.15.105:3300/0 conn(0x7f9c180d1650 0x7f9c1806bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.212+0000 7f9c177fe640 1 -- 172.21.15.60:0/3029916449 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c180d3b50 con 0x7f9c1815e660 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.212+0000 7f9c177fe640 1 --2- 172.21.15.60:0/3029916449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c1815e660 0x7f9c180cf730 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9c180cb760 tx=0x7f9c0802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cd42aa9676530d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.213+0000 7f9c167fc640 1 -- 172.21.15.60:0/3029916449 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08037070 con 0x7f9c1815e660 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.213+0000 7f9c167fc640 1 -- 172.21.15.60:0/3029916449 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c08032440 con 0x7f9c1815e660 2024-09-12T01:36:45.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.213+0000 7f9c167fc640 1 -- 172.21.15.60:0/3029916449 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c08032810 con 0x7f9c1815e660 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.213+0000 7f9c1db0c640 1 -- 172.21.15.60:0/3029916449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c1815e660 msgr2=0x7f9c180cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.213+0000 7f9c1db0c640 1 --2- 172.21.15.60:0/3029916449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c1815e660 0x7f9c180cf730 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9c180cb760 tx=0x7f9c0802a1e0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.213+0000 7f9c1db0c640 1 -- 172.21.15.60:0/3029916449 shutdown_connections 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.213+0000 7f9c1db0c640 1 --2- 172.21.15.60:0/3029916449 >> v2:172.21.15.105:3300/0 conn(0x7f9c180d1650 0x7f9c1806bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.213+0000 7f9c1db0c640 1 --2- 172.21.15.60:0/3029916449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c180d3310 0x7f9c180d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.213+0000 7f9c1db0c640 1 --2- 172.21.15.60:0/3029916449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c1815e660 0x7f9c180cf730 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.213+0000 7f9c1db0c640 1 -- 172.21.15.60:0/3029916449 >> 172.21.15.60:0/3029916449 conn(0x7f9c180b6410 msgr2=0x7f9c180b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.213+0000 7f9c1db0c640 1 -- 172.21.15.60:0/3029916449 shutdown_connections 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.213+0000 7f9c1db0c640 1 -- 172.21.15.60:0/3029916449 wait complete. 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.214+0000 7f9c1db0c640 1 Processor -- start 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.215+0000 7f9c1db0c640 1 -- start start 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.215+0000 7f9c1db0c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c180d1650 0x7f9c181501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.215+0000 7f9c1db0c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c180d3310 0x7f9c18156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.215+0000 7f9c1db0c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c1815e660 0x7f9c18152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.215+0000 7f9c1db0c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9c180d43f0 con 0x7f9c180d3310 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.215+0000 7f9c1db0c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9c180d4110 con 0x7f9c180d1650 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.215+0000 7f9c1db0c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9c180cfc70 con 0x7f9c1815e660 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.215+0000 7f9c16ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c180d3310 0x7f9c18156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.215+0000 7f9c16ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c180d3310 0x7f9c18156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56904/0 (socket says 172.21.15.60:56904) 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.215+0000 7f9c16ffd640 1 -- 172.21.15.60:0/1343966963 learned_addr learned my addr 172.21.15.60:0/1343966963 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9c17fff640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c1815e660 0x7f9c18152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9c177fe640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c180d1650 0x7f9c181501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9c16ffd640 1 -- 172.21.15.60:0/1343966963 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c1815e660 msgr2=0x7f9c18152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9c16ffd640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c1815e660 0x7f9c18152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9c16ffd640 1 -- 172.21.15.60:0/1343966963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c180d1650 msgr2=0x7f9c181501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9c16ffd640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c180d1650 0x7f9c181501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9c16ffd640 1 -- 172.21.15.60:0/1343966963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c181557d0 con 0x7f9c180d3310 2024-09-12T01:36:45.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9c16ffd640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c180d3310 0x7f9c18156d30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00d620 tx=0x7f9c0c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9bfffff640 1 -- 172.21.15.60:0/1343966963 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00b620 con 0x7f9c180d3310 2024-09-12T01:36:45.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9bfffff640 1 -- 172.21.15.60:0/1343966963 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c0c019070 con 0x7f9c180d3310 2024-09-12T01:36:45.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9c1db0c640 1 -- 172.21.15.60:0/1343966963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c1815edb0 con 0x7f9c180d3310 2024-09-12T01:36:45.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9bfffff640 1 -- 172.21.15.60:0/1343966963 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c0c00ba00 con 0x7f9c180d3310 2024-09-12T01:36:45.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.216+0000 7f9c1db0c640 1 -- 172.21.15.60:0/1343966963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c1815f370 con 0x7f9c180d3310 2024-09-12T01:36:45.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.217+0000 7f9c1db0c640 1 -- 172.21.15.60:0/1343966963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c180d1110 con 0x7f9c180d3310 2024-09-12T01:36:45.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.218+0000 7f9bfffff640 1 -- 172.21.15.60:0/1343966963 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9c0c00bba0 con 0x7f9c180d3310 2024-09-12T01:36:45.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.218+0000 7f9bfffff640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9c0406be30 0x7f9c0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.218+0000 7f9bfffff640 1 -- 172.21.15.60:0/1343966963 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9c0c08b1d0 con 0x7f9c180d3310 2024-09-12T01:36:45.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.218+0000 7f9c177fe640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9c0406be30 0x7f9c0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.219+0000 7f9c177fe640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9c0406be30 0x7f9c0406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9c08034000 tx=0x7f9c0802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.222+0000 7f9bfffff640 1 -- 172.21.15.60:0/1343966963 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9c0c0594a0 con 0x7f9c180d3310 2024-09-12T01:36:45.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.433+0000 7f9c1db0c640 1 -- 172.21.15.60:0/1343966963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c180ba510 con 0x7f9c180d3310 2024-09-12T01:36:45.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.434+0000 7f9bfffff640 1 -- 172.21.15.60:0/1343966963 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7f9c0c05d7a0 con 0x7f9c180d3310 2024-09-12T01:36:45.433 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:36:45.433 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":14,"btime":"2024-09-12T01:36:38:945222+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3644892545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3644892545},{"type":"v1","addr":"172.21.15.105:6835","nonce":3644892545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/458109310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458109310},{"type":"v1","addr":"172.21.15.60:6836","nonce":458109310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4741,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1415668038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1415668038},{"type":"v1","addr":"172.21.15.60:6837","nonce":1415668038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:36:36.284771+0000","modified":"2024-09-12T01:36:38.293895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34520":{"gid":34520,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/1200480020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1200480020},{"type":"v1","addr":"172.21.15.105:6834","nonce":1200480020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34520,"qdb_cluster":[34520]},"id":2}]} 2024-09-12T01:36:45.434 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 14 2024-09-12T01:36:45.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.436+0000 7f9c1db0c640 1 -- 172.21.15.60:0/1343966963 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9c0406be30 msgr2=0x7f9c0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.436+0000 7f9c1db0c640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9c0406be30 0x7f9c0406e2f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9c08034000 tx=0x7f9c0802e000 comp rx=0 tx=0).stop 2024-09-12T01:36:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.436+0000 7f9c1db0c640 1 -- 172.21.15.60:0/1343966963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c180d3310 msgr2=0x7f9c18156d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.436+0000 7f9c1db0c640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c180d3310 0x7f9c18156d30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c00d620 tx=0x7f9c0c00dae0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.436+0000 7f9c1db0c640 1 -- 172.21.15.60:0/1343966963 shutdown_connections 2024-09-12T01:36:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.436+0000 7f9c1db0c640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9c0406be30 0x7f9c0406e2f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.436+0000 7f9c1db0c640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9c1815e660 0x7f9c18152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.436+0000 7f9c1db0c640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c180d3310 0x7f9c18156d30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.436+0000 7f9c1db0c640 1 --2- 172.21.15.60:0/1343966963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9c180d1650 0x7f9c181501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.436+0000 7f9c1db0c640 1 -- 172.21.15.60:0/1343966963 >> 172.21.15.60:0/1343966963 conn(0x7f9c180b6410 msgr2=0x7f9c180b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.436+0000 7f9c1db0c640 1 -- 172.21.15.60:0/1343966963 shutdown_connections 2024-09-12T01:36:45.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.436+0000 7f9c1db0c640 1 -- 172.21.15.60:0/1343966963 wait complete. 2024-09-12T01:36:45.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:36:36.284771+0000', 'modified': '2024-09-12T01:36:38.293895+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34520}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34520': {'gid': 34520, 'name': 'b', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6834/1200480020', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 1200480020}, {'type': 'v1', 'addr': '172.21.15.105:6834', 'nonce': 1200480020}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34520, 'qdb_cluster': [34520]} 2024-09-12T01:36:45.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:36:45.850 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T01:36:45.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.957+0000 7ff930718640 1 Processor -- start 2024-09-12T01:36:45.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.957+0000 7ff930718640 1 -- start start 2024-09-12T01:36:45.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.958+0000 7ff930718640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280cf1f0 0x7ff9280b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.958+0000 7ff930718640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff9280b6720 0x7ff9280d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.958+0000 7ff930718640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9280cf860 con 0x7ff92815e7a0 2024-09-12T01:36:45.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.958+0000 7ff930718640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff9280d2ca0 con 0x7ff9280b6720 2024-09-12T01:36:45.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.958+0000 7ff930718640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff9280cfb40 con 0x7ff9280cf1f0 2024-09-12T01:36:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92ecb5640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff9280b6720 0x7ff9280d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92dcb3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280cf1f0 0x7ff9280b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92dcb3640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280cf1f0 0x7ff9280b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:33756/0 (socket says 172.21.15.60:33756) 2024-09-12T01:36:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92e4b4640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff92815e7a0 0x7ff92806caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45710/0 (socket says 172.21.15.60:45710) 2024-09-12T01:36:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92ecb5640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff9280b6720 0x7ff9280d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:53868/0 (socket says 172.21.15.60:53868) 2024-09-12T01:36:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92e4b4640 1 -- 172.21.15.60:0/3386699552 learned_addr learned my addr 172.21.15.60:0/3386699552 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92d4b2640 1 -- 172.21.15.60:0/3386699552 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1810572959 0 0) 0x7ff9280cf860 con 0x7ff92815e7a0 2024-09-12T01:36:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92d4b2640 1 -- 172.21.15.60:0/3386699552 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff910003520 con 0x7ff92815e7a0 2024-09-12T01:36:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92dcb3640 1 -- 172.21.15.60:0/3386699552 >> v2:172.21.15.105:3300/0 conn(0x7ff9280b6720 msgr2=0x7ff9280d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/3386699552 >> v2:172.21.15.105:3300/0 conn(0x7ff9280b6720 0x7ff9280d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92dcb3640 1 -- 172.21.15.60:0/3386699552 >> v1:172.21.15.105:6789/0 conn(0x7ff92815e7a0 legacy=0x7ff92806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92dcb3640 1 -- 172.21.15.60:0/3386699552 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9280cfe20 con 0x7ff9280cf1f0 2024-09-12T01:36:45.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.959+0000 7ff92ecb5640 1 --2- 172.21.15.60:0/3386699552 >> v2:172.21.15.105:3300/0 conn(0x7ff9280b6720 0x7ff9280d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:45.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.960+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/3386699552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280cf1f0 0x7ff9280b61e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0097a0 tx=0x7ff91c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da633570e509b62a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.960+0000 7ff92d4b2640 1 -- 172.21.15.60:0/3386699552 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c037070 con 0x7ff9280cf1f0 2024-09-12T01:36:45.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.960+0000 7ff92d4b2640 1 -- 172.21.15.60:0/3386699552 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91c02ae50 con 0x7ff9280cf1f0 2024-09-12T01:36:45.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.960+0000 7ff92d4b2640 1 -- 172.21.15.60:0/3386699552 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c032640 con 0x7ff9280cf1f0 2024-09-12T01:36:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.961+0000 7ff930718640 1 -- 172.21.15.60:0/3386699552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280cf1f0 msgr2=0x7ff9280b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.961+0000 7ff930718640 1 --2- 172.21.15.60:0/3386699552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280cf1f0 0x7ff9280b61e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0097a0 tx=0x7ff91c02a100 comp rx=0 tx=0).stop 2024-09-12T01:36:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.961+0000 7ff930718640 1 -- 172.21.15.60:0/3386699552 shutdown_connections 2024-09-12T01:36:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.961+0000 7ff930718640 1 --2- 172.21.15.60:0/3386699552 >> v2:172.21.15.105:3300/0 conn(0x7ff9280b6720 0x7ff9280d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.961+0000 7ff930718640 1 --2- 172.21.15.60:0/3386699552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280cf1f0 0x7ff9280b61e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.961+0000 7ff930718640 1 -- 172.21.15.60:0/3386699552 >> 172.21.15.60:0/3386699552 conn(0x7ff9280d11e0 msgr2=0x7ff9280d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.961+0000 7ff930718640 1 -- 172.21.15.60:0/3386699552 shutdown_connections 2024-09-12T01:36:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.961+0000 7ff930718640 1 -- 172.21.15.60:0/3386699552 wait complete. 2024-09-12T01:36:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.962+0000 7ff930718640 1 Processor -- start 2024-09-12T01:36:45.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.962+0000 7ff930718640 1 -- start start 2024-09-12T01:36:45.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff930718640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280b6720 0x7ff9281f84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff930718640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9280cf1f0 0x7ff9280d4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff930718640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff92815e7a0 0x7ff92814f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff930718640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff92815eb80 con 0x7ff92815e7a0 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff930718640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff9280b7a00 con 0x7ff9280cf1f0 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff930718640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff92815ed00 con 0x7ff9280b6720 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92ecb5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff92815e7a0 0x7ff92814f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92ecb5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff92815e7a0 0x7ff92814f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56908/0 (socket says 172.21.15.60:56908) 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92ecb5640 1 -- 172.21.15.60:0/1148260544 learned_addr learned my addr 172.21.15.60:0/1148260544 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92e4b4640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280b6720 0x7ff9281f84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9280cf1f0 0x7ff9280d4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92ecb5640 1 -- 172.21.15.60:0/1148260544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280b6720 msgr2=0x7ff9281f84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92ecb5640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280b6720 0x7ff9281f84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92ecb5640 1 -- 172.21.15.60:0/1148260544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9280cf1f0 msgr2=0x7ff9280d4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92ecb5640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9280cf1f0 0x7ff9280d4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92ecb5640 1 -- 172.21.15.60:0/1148260544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9281f89e0 con 0x7ff92815e7a0 2024-09-12T01:36:45.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92e4b4640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280b6720 0x7ff9281f84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:45.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9280cf1f0 0x7ff9280d4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:36:45.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.963+0000 7ff92ecb5640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff92815e7a0 0x7ff92814f7f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff92000e930 tx=0x7ff92000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.964+0000 7ff926ffd640 1 -- 172.21.15.60:0/1148260544 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff920017070 con 0x7ff92815e7a0 2024-09-12T01:36:45.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.964+0000 7ff926ffd640 1 -- 172.21.15.60:0/1148260544 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff92000ca00 con 0x7ff92815e7a0 2024-09-12T01:36:45.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.964+0000 7ff930718640 1 -- 172.21.15.60:0/1148260544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9280ccf70 con 0x7ff92815e7a0 2024-09-12T01:36:45.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.964+0000 7ff926ffd640 1 -- 172.21.15.60:0/1148260544 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff92000cdd0 con 0x7ff92815e7a0 2024-09-12T01:36:45.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.964+0000 7ff930718640 1 -- 172.21.15.60:0/1148260544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9280cd7b0 con 0x7ff92815e7a0 2024-09-12T01:36:45.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.966+0000 7ff926ffd640 1 -- 172.21.15.60:0/1148260544 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff920004020 con 0x7ff92815e7a0 2024-09-12T01:36:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.966+0000 7ff926ffd640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff91406be30 0x7ff91406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.966+0000 7ff926ffd640 1 -- 172.21.15.60:0/1148260544 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff92008acf0 con 0x7ff92815e7a0 2024-09-12T01:36:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.966+0000 7ff92e4b4640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff91406be30 0x7ff91406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.967+0000 7ff92e4b4640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff91406be30 0x7ff91406e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff918005c00 tx=0x7ff918009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.967+0000 7ff9334b3740 1 Processor -- start 2024-09-12T01:36:45.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.967+0000 7ff9334b3740 1 -- start start 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff9334b3740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab892c0 0x562a5abcea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff9334b3740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab86a80 0x562a5ab896a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff9334b3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 0x562a5ab838b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff9334b3740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562a5aaeb520 con 0x562a5ab86a80 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff9334b3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562a5aa933e0 con 0x562a5ab8aa50 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff9334b3740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x562a5aae74e0 con 0x562a5ab892c0 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff92dcb3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab86a80 0x562a5ab896a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff92dcb3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab86a80 0x562a5ab896a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56912/0 (socket says 172.21.15.60:56912) 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff92dcb3640 1 -- 172.21.15.60:0/1373189545 learned_addr learned my addr 172.21.15.60:0/1373189545 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff92e4b4640 1 --2- 172.21.15.60:0/1373189545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab892c0 0x562a5abcea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff92ecb5640 1 --2- 172.21.15.60:0/1373189545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 0x562a5ab838b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff92dcb3640 1 -- 172.21.15.60:0/1373189545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab892c0 msgr2=0x562a5abcea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/1373189545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab892c0 0x562a5abcea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff92dcb3640 1 -- 172.21.15.60:0/1373189545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 msgr2=0x562a5ab838b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/1373189545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 0x562a5ab838b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff92dcb3640 1 -- 172.21.15.60:0/1373189545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a5aaae2f0 con 0x562a5ab86a80 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.968+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/1373189545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab86a80 0x562a5ab896a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0098c0 tx=0x7ff91c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61f9f84d3c7f373 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.969+0000 7ff90ffff640 1 -- 172.21.15.60:0/1373189545 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c037040 con 0x562a5ab86a80 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.969+0000 7ff90ffff640 1 -- 172.21.15.60:0/1373189545 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91c0326c0 con 0x562a5ab86a80 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.969+0000 7ff90ffff640 1 -- 172.21.15.60:0/1373189545 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff91c032a70 con 0x562a5ab86a80 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.969+0000 7ff9334b3740 1 -- 172.21.15.60:0/1373189545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab86a80 msgr2=0x562a5ab896a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.969+0000 7ff9334b3740 1 --2- 172.21.15.60:0/1373189545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab86a80 0x562a5ab896a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff91c0098c0 tx=0x7ff91c02c000 comp rx=0 tx=0).stop 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.969+0000 7ff9334b3740 1 -- 172.21.15.60:0/1373189545 shutdown_connections 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.969+0000 7ff9334b3740 1 --2- 172.21.15.60:0/1373189545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 0x562a5ab838b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.969+0000 7ff9334b3740 1 --2- 172.21.15.60:0/1373189545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab86a80 0x562a5ab896a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.969+0000 7ff9334b3740 1 --2- 172.21.15.60:0/1373189545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab892c0 0x562a5abcea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.969+0000 7ff9334b3740 1 -- 172.21.15.60:0/1373189545 >> 172.21.15.60:0/1373189545 conn(0x562a5ab85a80 msgr2=0x562a5abcdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.969+0000 7ff9334b3740 1 -- 172.21.15.60:0/1373189545 shutdown_connections 2024-09-12T01:36:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.969+0000 7ff9334b3740 1 -- 172.21.15.60:0/1373189545 wait complete. 2024-09-12T01:36:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.970+0000 7ff9334b3740 1 -- start start 2024-09-12T01:36:45.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.970+0000 7ff9334b3740 1 Processor -- start 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.971+0000 7ff9334b3740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 0x562a5abe16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.971+0000 7ff9334b3740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab8aa50 0x562a5abe0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.971+0000 7ff9334b3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5abb27f0 0x562a5abb2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.971+0000 7ff9334b3740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562a5ab84f20 con 0x562a5ab892c0 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.971+0000 7ff9334b3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562a5aa74450 con 0x562a5abb27f0 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.971+0000 7ff9334b3740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x562a5abcf290 con 0x562a5ab8aa50 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.971+0000 7ff9334b3740 10 client.0 _ll_register_callbacks cb 0x562a5a7fdac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.971+0000 7ff92e4b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 0x562a5abe16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.971+0000 7ff92e4b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 0x562a5abe16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56924/0 (socket says 172.21.15.60:56924) 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.971+0000 7ff92e4b4640 1 -- 172.21.15.60:0/13103019 learned_addr learned my addr 172.21.15.60:0/13103019 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.971+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab8aa50 0x562a5abe0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.971+0000 7ff92ecb5640 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5abb27f0 0x562a5abb2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff92e4b4640 1 -- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab8aa50 msgr2=0x562a5abe0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff92e4b4640 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab8aa50 0x562a5abe0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff92e4b4640 1 -- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5abb27f0 msgr2=0x562a5abb2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff92e4b4640 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5abb27f0 0x562a5abb2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff92e4b4640 1 -- 172.21.15.60:0/13103019 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a5a7fe2d0 con 0x562a5ab892c0 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab8aa50 0x562a5abe0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff92e4b4640 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 0x562a5abe16f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff918007aa0 tx=0x7ff918001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23768ffbec1cbf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff90d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff90d7fa640 1 -- 172.21.15.60:0/13103019 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918026060 con 0x562a5ab892c0 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff9334b3740 1 -- 172.21.15.60:0/13103019 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff91c0326c0 con 0x562a5ab892c0 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff90d7fa640 1 -- 172.21.15.60:0/13103019 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff918021450 con 0x562a5ab892c0 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff90d7fa640 1 -- 172.21.15.60:0/13103019 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ff91802c050 con 0x562a5ab892c0 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff9334b3740 10 client.5016 fetch_fsmap learned FSMap version 14 2024-09-12T01:36:45.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff9334b3740 1 -- 172.21.15.60:0/13103019 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562a5a8c86b0 con 0x562a5ab892c0 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff90d7fa640 1 -- 172.21.15.60:0/13103019 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91c0326c0 con 0x562a5ab892c0 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff90d7fa640 1 -- 172.21.15.60:0/13103019 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7ff91802f020 con 0x562a5ab892c0 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff9334b3740 10 client.5016 fetch_fsmap finished waiting for FSMap version 14 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff9334b3740 10 client.5016 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff9334b3740 20 client.5016 populate_metadata read hostname 'smithi060' 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff9334b3740 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x562a5abb62b0 0x562a5abb66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff9334b3740 4 client.5016 mds_command: new command op to 34520 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.972+0000 7ff9334b3740 1 -- 172.21.15.60:0/13103019 --> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a5aaf8c50 con 0x562a5abb62b0 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.973+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x562a5abb62b0 0x562a5abb66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.973+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x562a5abb62b0 0x562a5abb66b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=948a55e939f5b5e8 server_cookie=fd6a4eb8270700e9 in_seq=0 out_seq=0 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.973+0000 7ff90d7fa640 10 client.5016 ms_handle_connect on v2:172.21.15.105:6832/1200480020 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff90d7fa640 1 -- 172.21.15.60:0/13103019 <== mds.0 v2:172.21.15.105:6832/1200480020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562a5aaf8c50 con 0x562a5abb62b0 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff90d7fa640 10 client.5016 handle_command_reply: tid=0 2024-09-12T01:36:45.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff9334b3740 1 client.5016 shutdown 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff9334b3740 1 -- 172.21.15.60:0/13103019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 msgr2=0x562a5abe16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff9334b3740 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 0x562a5abe16f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff918007aa0 tx=0x7ff918001250 comp rx=0 tx=0).stop 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff9334b3740 1 -- 172.21.15.60:0/13103019 shutdown_connections 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff9334b3740 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x562a5abb62b0 0x562a5abb66b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff9334b3740 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5abb27f0 0x562a5abb2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff9334b3740 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab8aa50 0x562a5abe0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff90d7fa640 0 client.5016 ms_handle_reset on v2:172.21.15.105:6832/1200480020 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff9334b3740 1 --2- 172.21.15.60:0/13103019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 0x562a5abe16f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff9334b3740 1 -- 172.21.15.60:0/13103019 >> 172.21.15.60:0/13103019 conn(0x562a5ab86a80 msgr2=0x562a5abcfa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.974+0000 7ff9334b3740 1 -- 172.21.15.60:0/13103019 shutdown_connections 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.975+0000 7ff9334b3740 1 -- 172.21.15.60:0/13103019 wait complete. 2024-09-12T01:36:45.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.975+0000 7ff9334b3740 20 client.5016 trim_cache size 0 max 16384 2024-09-12T01:36:45.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.992+0000 7ff9334b3740 1 Processor -- start 2024-09-12T01:36:45.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.993+0000 7ff9334b3740 1 -- start start 2024-09-12T01:36:45.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.993+0000 7ff9334b3740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab892c0 0x562a5abcd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.993+0000 7ff9334b3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 0x562a5abcde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.993+0000 7ff9334b3740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5abb27f0 0x562a5abce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:45.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.993+0000 7ff9334b3740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff92815ffd0 con 0x562a5abb27f0 2024-09-12T01:36:45.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.993+0000 7ff9334b3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff9280b86f0 con 0x562a5ab8aa50 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.993+0000 7ff9334b3740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff92815f980 con 0x562a5ab892c0 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.993+0000 7ff92ecb5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5abb27f0 0x562a5abce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.993+0000 7ff92ecb5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5abb27f0 0x562a5abce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56940/0 (socket says 172.21.15.60:56940) 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.993+0000 7ff92ecb5640 1 -- 172.21.15.60:0/362612689 learned_addr learned my addr 172.21.15.60:0/362612689 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.994+0000 7ff92e4b4640 1 --2- 172.21.15.60:0/362612689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab892c0 0x562a5abcd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.994+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/362612689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 0x562a5abcde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.994+0000 7ff92ecb5640 1 -- 172.21.15.60:0/362612689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab892c0 msgr2=0x562a5abcd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.994+0000 7ff92ecb5640 1 --2- 172.21.15.60:0/362612689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab892c0 0x562a5abcd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.994+0000 7ff92ecb5640 1 -- 172.21.15.60:0/362612689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 msgr2=0x562a5abcde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.994+0000 7ff92ecb5640 1 --2- 172.21.15.60:0/362612689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 0x562a5abcde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.994+0000 7ff92ecb5640 1 -- 172.21.15.60:0/362612689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a5ab868b0 con 0x562a5abb27f0 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.994+0000 7ff92ecb5640 1 --2- 172.21.15.60:0/362612689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5abb27f0 0x562a5abce380 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff920058d70 tx=0x7ff920055390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562390de996b1ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:45.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.994+0000 7ff90f7fe640 1 -- 172.21.15.60:0/362612689 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff920020070 con 0x562a5abb27f0 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.994+0000 7ff90f7fe640 1 -- 172.21.15.60:0/362612689 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff920061c50 con 0x562a5abb27f0 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.994+0000 7ff90f7fe640 1 -- 172.21.15.60:0/362612689 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff920057370 con 0x562a5abb27f0 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.995+0000 7ff9334b3740 1 -- 172.21.15.60:0/362612689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5abb27f0 msgr2=0x562a5abce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.995+0000 7ff9334b3740 1 --2- 172.21.15.60:0/362612689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5abb27f0 0x562a5abce380 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff920058d70 tx=0x7ff920055390 comp rx=0 tx=0).stop 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.995+0000 7ff9334b3740 1 -- 172.21.15.60:0/362612689 shutdown_connections 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.995+0000 7ff9334b3740 1 --2- 172.21.15.60:0/362612689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5abb27f0 0x562a5abce380 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.995+0000 7ff9334b3740 1 --2- 172.21.15.60:0/362612689 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 0x562a5abcde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.995+0000 7ff9334b3740 1 --2- 172.21.15.60:0/362612689 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5ab892c0 0x562a5abcd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.995+0000 7ff9334b3740 1 -- 172.21.15.60:0/362612689 >> 172.21.15.60:0/362612689 conn(0x562a5ab86a80 msgr2=0x562a5ab7eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.995+0000 7ff9334b3740 1 -- 172.21.15.60:0/362612689 shutdown_connections 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.995+0000 7ff9334b3740 1 -- 172.21.15.60:0/362612689 wait complete. 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.995+0000 7ff9334b3740 1 -- start start 2024-09-12T01:36:45.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.995+0000 7ff9334b3740 1 Processor -- start 2024-09-12T01:36:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.996+0000 7ff9334b3740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 0x562a5abe47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.996+0000 7ff9334b3740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 0x562a5ac49ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.996+0000 7ff9334b3740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5abb27f0 0x562a5ac4ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.996+0000 7ff9334b3740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562a5abb7170 con 0x562a5ab892c0 2024-09-12T01:36:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.996+0000 7ff9334b3740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x562a5abb5bd0 con 0x562a5ab8aa50 2024-09-12T01:36:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.996+0000 7ff9334b3740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x562a5abb4800 con 0x562a5abb27f0 2024-09-12T01:36:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.996+0000 7ff9334b3740 10 client.0 _ll_register_callbacks cb 0x7ff91800dd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:36:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.996+0000 7ff92e4b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 0x562a5abe47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.996+0000 7ff92e4b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 0x562a5abe47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56942/0 (socket says 172.21.15.60:56942) 2024-09-12T01:36:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.996+0000 7ff92e4b4640 1 -- 172.21.15.60:0/4135679356 learned_addr learned my addr 172.21.15.60:0/4135679356 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.996+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 0x562a5ac49ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.996+0000 7ff92ecb5640 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5abb27f0 0x562a5ac4ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff92e4b4640 1 -- 172.21.15.60:0/4135679356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5abb27f0 msgr2=0x562a5ac4ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff92e4b4640 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5abb27f0 0x562a5ac4ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff92e4b4640 1 -- 172.21.15.60:0/4135679356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 msgr2=0x562a5ac49ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff92e4b4640 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 0x562a5ac49ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff92e4b4640 1 -- 172.21.15.60:0/4135679356 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a5abe8450 con 0x562a5ab892c0 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff92e4b4640 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 0x562a5abe47f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff918007aa0 tx=0x7ff918012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a650d48c70240de7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff90d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff90d7fa640 1 -- 172.21.15.60:0/4135679356 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918021e10 con 0x562a5ab892c0 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff90d7fa640 1 -- 172.21.15.60:0/4135679356 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff9180303f0 con 0x562a5ab892c0 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff9334b3740 1 -- 172.21.15.60:0/4135679356 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff920061c50 con 0x562a5ab892c0 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff90d7fa640 1 -- 172.21.15.60:0/4135679356 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ff91803d050 con 0x562a5ab892c0 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff9334b3740 10 client.5022 fetch_fsmap learned FSMap version 14 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff9334b3740 1 -- 172.21.15.60:0/4135679356 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562a5abe4df0 con 0x562a5ab892c0 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff90d7fa640 1 -- 172.21.15.60:0/4135679356 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff920061c50 con 0x562a5ab892c0 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff90d7fa640 1 -- 172.21.15.60:0/4135679356 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7ff918040020 con 0x562a5ab892c0 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff9334b3740 10 client.5022 fetch_fsmap finished waiting for FSMap version 14 2024-09-12T01:36:46.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff9334b3740 10 client.5022 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff9334b3740 20 client.5022 populate_metadata read hostname 'smithi060' 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff9334b3740 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x562a5abce180 0x562a5abca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff9334b3740 4 client.5022 mds_command: new command op to 34520 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.997+0000 7ff9334b3740 1 -- 172.21.15.60:0/4135679356 --> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] -- command(tid 0: {"prefix": "status"}) -- 0x562a5aaf2fa0 con 0x562a5abce180 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.998+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x562a5abce180 0x562a5abca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.998+0000 7ff92dcb3640 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x562a5abce180 0x562a5abca0f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97a5f8af443e1854 server_cookie=9301d0f0ec741b00 in_seq=0 out_seq=0 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.998+0000 7ff90d7fa640 10 client.5022 ms_handle_connect on v2:172.21.15.105:6832/1200480020 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.998+0000 7ff90d7fa640 1 -- 172.21.15.60:0/4135679356 <== mds.0 v2:172.21.15.105:6832/1200480020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x562a5aaf2fa0 con 0x562a5abce180 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.998+0000 7ff90d7fa640 10 client.5022 handle_command_reply: tid=0 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff9334b3740 1 client.5022 shutdown 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff9334b3740 1 -- 172.21.15.60:0/4135679356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 msgr2=0x562a5abe47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff9334b3740 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 0x562a5abe47f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff918007aa0 tx=0x7ff918012000 comp rx=0 tx=0).stop 2024-09-12T01:36:46.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff9334b3740 1 -- 172.21.15.60:0/4135679356 shutdown_connections 2024-09-12T01:36:46.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff9334b3740 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x562a5abb27f0 0x562a5ac4ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff9334b3740 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x562a5abce180 0x562a5abca0f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff9334b3740 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x562a5ab8aa50 0x562a5ac49ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff9334b3740 1 --2- 172.21.15.60:0/4135679356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562a5ab892c0 0x562a5abe47f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff90d7fa640 0 client.5022 ms_handle_reset on v2:172.21.15.105:6832/1200480020 2024-09-12T01:36:46.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff9334b3740 1 -- 172.21.15.60:0/4135679356 >> 172.21.15.60:0/4135679356 conn(0x562a5ab86a80 msgr2=0x562a5ab7eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:46.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff9334b3740 1 -- 172.21.15.60:0/4135679356 shutdown_connections 2024-09-12T01:36:46.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff9334b3740 1 -- 172.21.15.60:0/4135679356 wait complete. 2024-09-12T01:36:46.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff9334b3740 20 client.5022 trim_cache size 0 max 16384 2024-09-12T01:36:46.005 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:36:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "5401bd8a-3492-4b21-b6c0-d6616ff39793", 2024-09-12T01:36:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T01:36:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 34520, 2024-09-12T01:36:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T01:36:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T01:36:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-12T01:36:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 9.0702232830000007, 2024-09-12T01:36:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 14, 2024-09-12T01:36:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 34, 2024-09-12T01:36:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 34, 2024-09-12T01:36:46.006 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 15.948886812 2024-09-12T01:36:46.006 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:36:46.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff930718640 1 -- 172.21.15.60:0/1148260544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff91406be30 msgr2=0x7ff91406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff930718640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff91406be30 0x7ff91406e2f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff918005c00 tx=0x7ff918009040 comp rx=0 tx=0).stop 2024-09-12T01:36:46.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff930718640 1 -- 172.21.15.60:0/1148260544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff92815e7a0 msgr2=0x7ff92814f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff930718640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff92815e7a0 0x7ff92814f7f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff92000e930 tx=0x7ff92000edf0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff930718640 1 -- 172.21.15.60:0/1148260544 shutdown_connections 2024-09-12T01:36:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff930718640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff92815e7a0 0x7ff92814f7f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff930718640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9280cf1f0 0x7ff9280d4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff930718640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff91406be30 0x7ff91406e2f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff930718640 1 --2- 172.21.15.60:0/1148260544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9280b6720 0x7ff9281f84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:45.999+0000 7ff930718640 1 -- 172.21.15.60:0/1148260544 >> 172.21.15.60:0/1148260544 conn(0x7ff9280d11e0 msgr2=0x7ff9280b53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.000+0000 7ff930718640 1 -- 172.21.15.60:0/1148260544 shutdown_connections 2024-09-12T01:36:46.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.000+0000 7ff930718640 1 -- 172.21.15.60:0/1148260544 wait complete. 2024-09-12T01:36:46.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:36:46.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.113+0000 7f00273b7640 1 Processor -- start 2024-09-12T01:36:46.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.113+0000 7f00273b7640 1 -- start start 2024-09-12T01:36:46.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.114+0000 7f00273b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f002015e660 0x7f00200cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.114+0000 7f00273b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f00200d1820 0x7f00200b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.114+0000 7f00273b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002015ea40 con 0x7f00200d3310 2024-09-12T01:36:46.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.114+0000 7f00273b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f00200d3870 con 0x7f00200d1820 2024-09-12T01:36:46.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.114+0000 7f00273b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f00200d3b50 con 0x7f002015e660 2024-09-12T01:36:46.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.115+0000 7f0025153640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f002015e660 0x7f00200cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.115+0000 7f0025954640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f00200d1820 0x7f00200b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.115+0000 7f0025153640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f002015e660 0x7f00200cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:33796/0 (socket says 172.21.15.60:33796) 2024-09-12T01:36:46.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.115+0000 7f0025153640 1 -- 172.21.15.60:0/3454714502 learned_addr learned my addr 172.21.15.60:0/3454714502 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:46.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.115+0000 7f0024952640 1 --1- 172.21.15.60:0/3454714502 >> v1:172.21.15.105:6789/0 conn(0x7f00200d3310 0x7f00200d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45714/0 (socket says 172.21.15.60:45714) 2024-09-12T01:36:46.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.115+0000 7f0025153640 1 -- 172.21.15.60:0/3454714502 >> v2:172.21.15.105:3300/0 conn(0x7f00200d1820 msgr2=0x7f00200b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:46.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.115+0000 7f0025153640 1 --2- 172.21.15.60:0/3454714502 >> v2:172.21.15.105:3300/0 conn(0x7f00200d1820 0x7f00200b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.115+0000 7f0025153640 1 -- 172.21.15.60:0/3454714502 >> v1:172.21.15.105:6789/0 conn(0x7f00200d3310 legacy=0x7f00200d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.115+0000 7f0025153640 1 -- 172.21.15.60:0/3454714502 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00200d3e30 con 0x7f002015e660 2024-09-12T01:36:46.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.115+0000 7f0025954640 1 --2- 172.21.15.60:0/3454714502 >> v2:172.21.15.105:3300/0 conn(0x7f00200d1820 0x7f00200b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:46.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.116+0000 7f0025153640 1 --2- 172.21.15.60:0/3454714502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f002015e660 0x7f00200cf730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0010009e50 tx=0x7f001002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e07453066843f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:46.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.116+0000 7f001ffff640 1 -- 172.21.15.60:0/3454714502 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010036070 con 0x7f002015e660 2024-09-12T01:36:46.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.116+0000 7f001ffff640 1 -- 172.21.15.60:0/3454714502 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0010031600 con 0x7f002015e660 2024-09-12T01:36:46.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.116+0000 7f001ffff640 1 -- 172.21.15.60:0/3454714502 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00100319d0 con 0x7f002015e660 2024-09-12T01:36:46.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.116+0000 7f00273b7640 1 -- 172.21.15.60:0/3454714502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f002015e660 msgr2=0x7f00200cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.116+0000 7f00273b7640 1 --2- 172.21.15.60:0/3454714502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f002015e660 0x7f00200cf730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0010009e50 tx=0x7f001002a710 comp rx=0 tx=0).stop 2024-09-12T01:36:46.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.116+0000 7f00273b7640 1 -- 172.21.15.60:0/3454714502 shutdown_connections 2024-09-12T01:36:46.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.116+0000 7f00273b7640 1 --2- 172.21.15.60:0/3454714502 >> v2:172.21.15.105:3300/0 conn(0x7f00200d1820 0x7f00200b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.116+0000 7f00273b7640 1 --2- 172.21.15.60:0/3454714502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f002015e660 0x7f00200cf730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.116+0000 7f00273b7640 1 -- 172.21.15.60:0/3454714502 >> 172.21.15.60:0/3454714502 conn(0x7f00200b6410 msgr2=0x7f00200b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:46.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.117+0000 7f00273b7640 1 -- 172.21.15.60:0/3454714502 shutdown_connections 2024-09-12T01:36:46.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.117+0000 7f00273b7640 1 -- 172.21.15.60:0/3454714502 wait complete. 2024-09-12T01:36:46.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.118+0000 7f00273b7640 1 Processor -- start 2024-09-12T01:36:46.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.118+0000 7f00273b7640 1 -- start start 2024-09-12T01:36:46.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.118+0000 7f00273b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00200d1820 0x7f00201f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.118+0000 7f00273b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00200d3310 0x7f00201f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.118+0000 7f00273b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f002015e660 0x7f0020160e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.118+0000 7f00273b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f00200cfc70 con 0x7f00200d1820 2024-09-12T01:36:46.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.118+0000 7f00273b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f00200d43f0 con 0x7f00200d3310 2024-09-12T01:36:46.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.118+0000 7f00273b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f00200b80b0 con 0x7f002015e660 2024-09-12T01:36:46.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f0025153640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00200d1820 0x7f00201f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f0025153640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00200d1820 0x7f00201f4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56958/0 (socket says 172.21.15.60:56958) 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f0025153640 1 -- 172.21.15.60:0/3021001411 learned_addr learned my addr 172.21.15.60:0/3021001411 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f0025954640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f002015e660 0x7f0020160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f0024952640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00200d3310 0x7f00201f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f0025153640 1 -- 172.21.15.60:0/3021001411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f002015e660 msgr2=0x7f0020160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f0025153640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f002015e660 0x7f0020160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f0025153640 1 -- 172.21.15.60:0/3021001411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00200d3310 msgr2=0x7f00201f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f0025153640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00200d3310 0x7f00201f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f0025153640 1 -- 172.21.15.60:0/3021001411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00201f55d0 con 0x7f00200d1820 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f0025153640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00200d1820 0x7f00201f4a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0010034040 tx=0x7f0010004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f001dffb640 1 -- 172.21.15.60:0/3021001411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010041020 con 0x7f00200d1820 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f001dffb640 1 -- 172.21.15.60:0/3021001411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0010007820 con 0x7f00200d1820 2024-09-12T01:36:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f00273b7640 1 -- 172.21.15.60:0/3021001411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00201f58b0 con 0x7f00200d1820 2024-09-12T01:36:46.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.119+0000 7f001dffb640 1 -- 172.21.15.60:0/3021001411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0010036040 con 0x7f00200d1820 2024-09-12T01:36:46.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.120+0000 7f00273b7640 1 -- 172.21.15.60:0/3021001411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00200cb160 con 0x7f00200d1820 2024-09-12T01:36:46.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.121+0000 7f00273b7640 1 -- 172.21.15.60:0/3021001411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002015ba50 con 0x7f00200d1820 2024-09-12T01:36:46.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.121+0000 7f001dffb640 1 -- 172.21.15.60:0/3021001411 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0010044020 con 0x7f00200d1820 2024-09-12T01:36:46.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.121+0000 7f001dffb640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f000c06be30 0x7f000c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:46.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.121+0000 7f001dffb640 1 -- 172.21.15.60:0/3021001411 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f00100ab940 con 0x7f00200d1820 2024-09-12T01:36:46.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.121+0000 7f0024952640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f000c06be30 0x7f000c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:46.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.122+0000 7f0024952640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f000c06be30 0x7f000c06e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f00200d21d0 tx=0x7f0014007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:46.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.126+0000 7f001dffb640 1 -- 172.21.15.60:0/3021001411 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f002015ba50 con 0x7f00200d1820 2024-09-12T01:36:46.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.340+0000 7f00273b7640 1 -- 172.21.15.60:0/3021001411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0020150ac0 con 0x7f00200d1820 2024-09-12T01:36:46.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.341+0000 7f001dffb640 1 -- 172.21.15.60:0/3021001411 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f001004b030 con 0x7f00200d1820 2024-09-12T01:36:46.341 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:36:46.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.342+0000 7f00273b7640 1 -- 172.21.15.60:0/3021001411 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f000c06be30 msgr2=0x7f000c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.342+0000 7f00273b7640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f000c06be30 0x7f000c06e2f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f00200d21d0 tx=0x7f0014007e80 comp rx=0 tx=0).stop 2024-09-12T01:36:46.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.343+0000 7f00273b7640 1 -- 172.21.15.60:0/3021001411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00200d1820 msgr2=0x7f00201f4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:46.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.343+0000 7f00273b7640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00200d1820 0x7f00201f4a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0010034040 tx=0x7f0010004a40 comp rx=0 tx=0).stop 2024-09-12T01:36:46.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.343+0000 7f00273b7640 1 -- 172.21.15.60:0/3021001411 shutdown_connections 2024-09-12T01:36:46.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.343+0000 7f00273b7640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f000c06be30 0x7f000c06e2f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.343+0000 7f00273b7640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f002015e660 0x7f0020160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.343+0000 7f00273b7640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f00200d3310 0x7f00201f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.343+0000 7f00273b7640 1 --2- 172.21.15.60:0/3021001411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00200d1820 0x7f00201f4a80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:46.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.343+0000 7f00273b7640 1 -- 172.21.15.60:0/3021001411 >> 172.21.15.60:0/3021001411 conn(0x7f00200b6410 msgr2=0x7f002006bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:46.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.343+0000 7f00273b7640 1 -- 172.21.15.60:0/3021001411 shutdown_connections 2024-09-12T01:36:46.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46.343+0000 7f00273b7640 1 -- 172.21.15.60:0/3021001411 wait complete. 2024-09-12T01:36:46.354 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:36:46.354 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:36:46.354 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T01:36:46.354 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:36:46.354 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:46.354 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:36:46.354 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:36:46.354 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:36:46.354 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:36:46.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:46.355 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T01:36:46.371 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:36:46.371 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:36:46.371 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:36:46.371 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:46.371 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:36:46.371 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:46.371 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42714sec preferred_lft 42714sec 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:46.372 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e8cb:28ff:fea3:34fb/64 scope link 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 72:47:53:4d:4f:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7047:53ff:fe4d:4fc7/64 scope link 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:46.373 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:36:46.374 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:36:46.374 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::183c:47ff:fec1:173/64 scope link 2024-09-12T01:36:46.374 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:46.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:46.374 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:36:46.435 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T01:36:46.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:46.437 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T01:36:46.493 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T01:36:46.493 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:36:46.493 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:36:46.493 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:36:46.493 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:36:46.494 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:46.494 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:36:46.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:36:46.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:36:46.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:36:46.494 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:36:46.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:46.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:46.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:46.622 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:36:46.641 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:36:46.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:46.641 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-12T01:36:46.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:36:46.707 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:46.763 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:36:46.763 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:36:46.763 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:46.818 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T01:36:46.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:46.819 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:46.904 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:46.904 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:36:46.914 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:46.914 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:36:46.914 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:36:46.914 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:36:46.914 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:36:46.915 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:36:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:36:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:36:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:36:46.915 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:36:46.917 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:36:46.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:46.917 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:46.944 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:47.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:47.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:47.051 INFO:teuthology.orchestra.run.smithi060.stdout:client4903 2024-09-12T01:36:47.051 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:47.051 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:47.067 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:36:47.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.208+0000 7f2a804ba640 1 Processor -- start 2024-09-12T01:36:47.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.209+0000 7f2a804ba640 1 -- start start 2024-09-12T01:36:47.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a804ba640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2a78073080 0x7f2a780b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:47.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a804ba640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a78071750 con 0x7f2a780b1990 2024-09-12T01:36:47.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a804ba640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a780b59a0 con 0x7f2a7815c670 2024-09-12T01:36:47.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a804ba640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2a780d0c60 con 0x7f2a78073080 2024-09-12T01:36:47.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a7ea57640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2a780b1990 0x7f2a780d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33136/0 (socket says 172.21.15.60:33136) 2024-09-12T01:36:47.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a7ea57640 1 -- 172.21.15.60:0/4033072033 learned_addr learned my addr 172.21.15.60:0/4033072033 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:36:47.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a7e256640 1 --2- 172.21.15.60:0/4033072033 >> v2:172.21.15.105:3300/0 conn(0x7f2a78073080 0x7f2a780b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:47.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a7d254640 1 -- 172.21.15.60:0/4033072033 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454705334 0 0) 0x7f2a78071750 con 0x7f2a780b1990 2024-09-12T01:36:47.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a7d254640 1 -- 172.21.15.60:0/4033072033 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a60003520 con 0x7f2a780b1990 2024-09-12T01:36:47.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a7e256640 1 -- 172.21.15.60:0/4033072033 >> v1:172.21.15.105:6789/0 conn(0x7f2a7815c670 legacy=0x7f2a78073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:47.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a7e256640 1 -- 172.21.15.60:0/4033072033 >> v1:172.21.15.60:6789/0 conn(0x7f2a780b1990 legacy=0x7f2a780d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:47.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a7d254640 1 -- 172.21.15.60:0/4033072033 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327718655 0 0) 0x7f2a780b59a0 con 0x7f2a7815c670 2024-09-12T01:36:47.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.210+0000 7f2a7e256640 1 -- 172.21.15.60:0/4033072033 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a780d0370 con 0x7f2a78073080 2024-09-12T01:36:47.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.211+0000 7f2a7e256640 1 --2- 172.21.15.60:0/4033072033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a78073080 0x7f2a780b5460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2a700097a0 tx=0x7f2a7002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=debb6b1549fc69ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:47.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.211+0000 7f2a7d254640 1 -- 172.21.15.60:0/4033072033 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a70037070 con 0x7f2a78073080 2024-09-12T01:36:47.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.211+0000 7f2a7d254640 1 -- 172.21.15.60:0/4033072033 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a7002ac30 con 0x7f2a78073080 2024-09-12T01:36:47.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.211+0000 7f2a7d254640 1 -- 172.21.15.60:0/4033072033 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68001970 con 0x7f2a78073080 2024-09-12T01:36:47.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.212+0000 7f2a804ba640 1 -- 172.21.15.60:0/4033072033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a78073080 msgr2=0x7f2a780b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:47.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.212+0000 7f2a804ba640 1 --2- 172.21.15.60:0/4033072033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a78073080 0x7f2a780b5460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2a700097a0 tx=0x7f2a7002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:36:47.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.212+0000 7f2a804ba640 1 -- 172.21.15.60:0/4033072033 shutdown_connections 2024-09-12T01:36:47.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.212+0000 7f2a804ba640 1 --2- 172.21.15.60:0/4033072033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a78073080 0x7f2a780b5460 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:47.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.212+0000 7f2a804ba640 1 -- 172.21.15.60:0/4033072033 >> 172.21.15.60:0/4033072033 conn(0x7f2a780d24d0 msgr2=0x7f2a780d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:47.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.212+0000 7f2a804ba640 1 -- 172.21.15.60:0/4033072033 shutdown_connections 2024-09-12T01:36:47.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.212+0000 7f2a804ba640 1 -- 172.21.15.60:0/4033072033 wait complete. 2024-09-12T01:36:47.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.213+0000 7f2a804ba640 1 Processor -- start 2024-09-12T01:36:47.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.213+0000 7f2a804ba640 1 -- start start 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.214+0000 7f2a804ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a78073080 0x7f2a78143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.214+0000 7f2a804ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a780b1990 0x7f2a78154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.214+0000 7f2a804ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7815c670 0x7f2a78140cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.214+0000 7f2a804ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a780d0610 con 0x7f2a7815c670 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.214+0000 7f2a804ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2a78071470 con 0x7f2a780b1990 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.214+0000 7f2a804ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2a780d08f0 con 0x7f2a78073080 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.214+0000 7f2a7ea57640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7815c670 0x7f2a78140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.214+0000 7f2a7ea57640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7815c670 0x7f2a78140cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56964/0 (socket says 172.21.15.60:56964) 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.214+0000 7f2a7ea57640 1 -- 172.21.15.60:0/1950605344 learned_addr learned my addr 172.21.15.60:0/1950605344 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.214+0000 7f2a7da55640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a780b1990 0x7f2a78154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.214+0000 7f2a7e256640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a78073080 0x7f2a78143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.215+0000 7f2a7ea57640 1 -- 172.21.15.60:0/1950605344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a78073080 msgr2=0x7f2a78143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.215+0000 7f2a7ea57640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a78073080 0x7f2a78143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:47.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.215+0000 7f2a7ea57640 1 -- 172.21.15.60:0/1950605344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a780b1990 msgr2=0x7f2a78154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:47.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.215+0000 7f2a7ea57640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a780b1990 0x7f2a78154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:47.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.215+0000 7f2a7ea57640 1 -- 172.21.15.60:0/1950605344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7815daf0 con 0x7f2a7815c670 2024-09-12T01:36:47.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.215+0000 7f2a7da55640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a780b1990 0x7f2a78154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:36:47.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.215+0000 7f2a7ea57640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7815c670 0x7f2a78140cd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800cac0 tx=0x7f2a6800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:47.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.215+0000 7f2a76ffd640 1 -- 172.21.15.60:0/1950605344 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a68018070 con 0x7f2a7815c670 2024-09-12T01:36:47.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.215+0000 7f2a76ffd640 1 -- 172.21.15.60:0/1950605344 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a6800a700 con 0x7f2a7815c670 2024-09-12T01:36:47.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.215+0000 7f2a76ffd640 1 -- 172.21.15.60:0/1950605344 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800aaf0 con 0x7f2a7815c670 2024-09-12T01:36:47.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.215+0000 7f2a804ba640 1 -- 172.21.15.60:0/1950605344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7815ddb0 con 0x7f2a7815c670 2024-09-12T01:36:47.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.215+0000 7f2a804ba640 1 -- 172.21.15.60:0/1950605344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a7815e370 con 0x7f2a7815c670 2024-09-12T01:36:47.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.216+0000 7f2a804ba640 1 -- 172.21.15.60:0/1950605344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a780d1f00 con 0x7f2a7815c670 2024-09-12T01:36:47.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.216+0000 7f2a76ffd640 1 -- 172.21.15.60:0/1950605344 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2a6800ac90 con 0x7f2a7815c670 2024-09-12T01:36:47.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.217+0000 7f2a76ffd640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a6406be60 0x7f2a6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:47.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.217+0000 7f2a7e256640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a6406be60 0x7f2a6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:47.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.217+0000 7f2a76ffd640 1 -- 172.21.15.60:0/1950605344 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f2a6808a730 con 0x7f2a7815c670 2024-09-12T01:36:47.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.218+0000 7f2a7e256640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a6406be60 0x7f2a6406e320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a70034000 tx=0x7f2a7002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:47.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.222+0000 7f2a76ffd640 1 -- 172.21.15.60:0/1950605344 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2a680589f0 con 0x7f2a7815c670 2024-09-12T01:36:47.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.431+0000 7f2a804ba640 1 -- 172.21.15.60:0/1950605344 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2a780d3050 con 0x7f2a7815c670 2024-09-12T01:36:47.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.432+0000 7f2a76ffd640 1 -- 172.21.15.60:0/1950605344 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f2a6805ccf0 con 0x7f2a7815c670 2024-09-12T01:36:47.432 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:36:47.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.433+0000 7f2a804ba640 1 -- 172.21.15.60:0/1950605344 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a6406be60 msgr2=0x7f2a6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:47.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.433+0000 7f2a804ba640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a6406be60 0x7f2a6406e320 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2a70034000 tx=0x7f2a7002e000 comp rx=0 tx=0).stop 2024-09-12T01:36:47.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.433+0000 7f2a804ba640 1 -- 172.21.15.60:0/1950605344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7815c670 msgr2=0x7f2a78140cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:47.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.433+0000 7f2a804ba640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7815c670 0x7f2a78140cd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2a6800cac0 tx=0x7f2a6800cf80 comp rx=0 tx=0).stop 2024-09-12T01:36:47.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.434+0000 7f2a804ba640 1 -- 172.21.15.60:0/1950605344 shutdown_connections 2024-09-12T01:36:47.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.434+0000 7f2a804ba640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a7815c670 0x7f2a78140cd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:47.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.434+0000 7f2a804ba640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2a780b1990 0x7f2a78154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:47.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.434+0000 7f2a804ba640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a6406be60 0x7f2a6406e320 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:47.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.434+0000 7f2a804ba640 1 --2- 172.21.15.60:0/1950605344 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2a78073080 0x7f2a78143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:47.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.434+0000 7f2a804ba640 1 -- 172.21.15.60:0/1950605344 >> 172.21.15.60:0/1950605344 conn(0x7f2a780d24d0 msgr2=0x7f2a78073460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:47.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.434+0000 7f2a804ba640 1 -- 172.21.15.60:0/1950605344 shutdown_connections 2024-09-12T01:36:47.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:47.434+0000 7f2a804ba640 1 -- 172.21.15.60:0/1950605344 wait complete. 2024-09-12T01:36:47.445 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:36:47.445 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:36:47.445 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T01:36:47.445 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:36:47.445 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:36:47.445 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:36:47.445 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:36:47.445 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:36:47.445 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:36:47.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:47.446 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T01:36:47.465 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:36:47.466 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42715sec preferred_lft 42715sec 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::c46c:baff:feeb:1f5e/64 scope link 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:36:47.467 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 56:66:28:3d:b2:45 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:36:47.468 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::5466:28ff:fe3d:b245/64 scope link 2024-09-12T01:36:47.468 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:47.468 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:36:47.468 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:36:47.468 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::2036:4aff:fe87:b9cb/64 scope link 2024-09-12T01:36:47.468 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:36:47.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:47.468 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:36:47.533 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:36:47.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:47.535 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T01:36:47.571 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:36:47.574 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:36:47.593 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T01:36:47.594 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:36:47.594 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:36:47.594 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:36:47.594 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:36:47.594 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:36:47.594 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:36:47.594 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:36:47.594 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:36:47.594 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:36:47.594 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:36:47.685 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:36:47.718 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:47.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:47.724 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:36:47.740 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T01:36:47.740 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:36:47.740 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:36:47.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:47.740 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-12T01:36:47.806 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:36:47.806 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:36:47.861 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:36:47.861 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:36:47.861 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:36:47.916 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T01:36:47.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:47.917 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:48.001 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:48.001 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:36:48.008 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:36:48.008 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:36:48.008 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:36:48.008 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 1@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:36:48.008 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:36:48.009 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:36:48.009 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:36:48.009 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:36:48.009 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:36:48.009 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:36:48.011 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:36:48.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:36:48.011 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:36:48.036 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:48.124 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:48.126 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:36:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:48.132 INFO:teuthology.orchestra.run.smithi105.stdout:client4915 2024-09-12T01:36:48.133 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:36:48.133 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:48.148 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_max_caps_per_client 1 2024-09-12T01:36:48.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.261+0000 7f7ac3082640 1 Processor -- start 2024-09-12T01:36:48.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.261+0000 7f7ac3082640 1 -- start start 2024-09-12T01:36:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7ac3082640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7abc15e6f0 0x7f7abc06fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7ac3082640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7abc0b54d0 0x7f7abc15f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7ac3082640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7abc06e990 con 0x7f7abc0b6d40 2024-09-12T01:36:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7ac3082640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7abc06ec70 con 0x7f7abc0b54d0 2024-09-12T01:36:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7ac3082640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7abc15ec70 con 0x7f7abc15e6f0 2024-09-12T01:36:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7abbfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7abc0b54d0 0x7f7abc15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7abbfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7abc0b54d0 0x7f7abc15f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56976/0 (socket says 172.21.15.60:56976) 2024-09-12T01:36:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7abbfff640 1 -- 172.21.15.60:0/2668442931 learned_addr learned my addr 172.21.15.60:0/2668442931 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7ac0e1e640 1 --2- 172.21.15.60:0/2668442931 >> v2:172.21.15.105:3300/0 conn(0x7f7abc15e6f0 0x7f7abc06fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7abbfff640 1 -- 172.21.15.60:0/2668442931 >> v2:172.21.15.105:3300/0 conn(0x7f7abc15e6f0 msgr2=0x7f7abc06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7abbfff640 1 --2- 172.21.15.60:0/2668442931 >> v2:172.21.15.105:3300/0 conn(0x7f7abc15e6f0 0x7f7abc06fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7abbfff640 1 -- 172.21.15.60:0/2668442931 >> v1:172.21.15.105:6789/0 conn(0x7f7abc0b6d40 legacy=0x7f7abc0b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.262+0000 7f7abbfff640 1 -- 172.21.15.60:0/2668442931 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc15ef50 con 0x7f7abc0b54d0 2024-09-12T01:36:48.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.263+0000 7f7abbfff640 1 --2- 172.21.15.60:0/2668442931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7abc0b54d0 0x7f7abc15f750 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7abc069920 tx=0x7f7aac02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4064b9e928414100 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.263+0000 7f7abb7fe640 1 -- 172.21.15.60:0/2668442931 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac036070 con 0x7f7abc0b54d0 2024-09-12T01:36:48.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.263+0000 7f7abb7fe640 1 -- 172.21.15.60:0/2668442931 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac031600 con 0x7f7abc0b54d0 2024-09-12T01:36:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.263+0000 7f7abb7fe640 1 -- 172.21.15.60:0/2668442931 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0319d0 con 0x7f7abc0b54d0 2024-09-12T01:36:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.264+0000 7f7ac3082640 1 -- 172.21.15.60:0/2668442931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7abc0b54d0 msgr2=0x7f7abc15f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.264+0000 7f7ac3082640 1 --2- 172.21.15.60:0/2668442931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7abc0b54d0 0x7f7abc15f750 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7abc069920 tx=0x7f7aac02a730 comp rx=0 tx=0).stop 2024-09-12T01:36:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.264+0000 7f7ac3082640 1 -- 172.21.15.60:0/2668442931 shutdown_connections 2024-09-12T01:36:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.264+0000 7f7ac3082640 1 --2- 172.21.15.60:0/2668442931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7abc0b54d0 0x7f7abc15f750 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.264+0000 7f7ac3082640 1 --2- 172.21.15.60:0/2668442931 >> v2:172.21.15.105:3300/0 conn(0x7f7abc15e6f0 0x7f7abc06fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.264+0000 7f7ac3082640 1 -- 172.21.15.60:0/2668442931 >> 172.21.15.60:0/2668442931 conn(0x7f7abc0d2430 msgr2=0x7f7abc0d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.264+0000 7f7ac3082640 1 -- 172.21.15.60:0/2668442931 shutdown_connections 2024-09-12T01:36:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.264+0000 7f7ac3082640 1 -- 172.21.15.60:0/2668442931 wait complete. 2024-09-12T01:36:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.265+0000 7f7ac3082640 1 Processor -- start 2024-09-12T01:36:48.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.265+0000 7f7ac3082640 1 -- start start 2024-09-12T01:36:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.266+0000 7f7ac3082640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7abc0b54d0 0x7f7abc1613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.266+0000 7f7ac3082640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7abc0b6d40 0x7f7abc0d1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.266+0000 7f7ac3082640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7abc15e6f0 0x7f7abc0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.266+0000 7f7ac3082640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc06e730 con 0x7f7abc0b6d40 2024-09-12T01:36:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.266+0000 7f7ac3082640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc06e5b0 con 0x7f7abc0b54d0 2024-09-12T01:36:48.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.266+0000 7f7ac3082640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7abc070830 con 0x7f7abc15e6f0 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.266+0000 7f7abbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7abc0b6d40 0x7f7abc0d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.266+0000 7f7abbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7abc0b6d40 0x7f7abc0d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56980/0 (socket says 172.21.15.60:56980) 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.266+0000 7f7abbfff640 1 -- 172.21.15.60:0/795638093 learned_addr learned my addr 172.21.15.60:0/795638093 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.266+0000 7f7ac0e1e640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7abc0b54d0 0x7f7abc1613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.266+0000 7f7ac161f640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7abc15e6f0 0x7f7abc0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.267+0000 7f7abbfff640 1 -- 172.21.15.60:0/795638093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7abc15e6f0 msgr2=0x7f7abc0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.267+0000 7f7abbfff640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7abc15e6f0 0x7f7abc0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.267+0000 7f7abbfff640 1 -- 172.21.15.60:0/795638093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7abc0b54d0 msgr2=0x7f7abc1613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.267+0000 7f7abbfff640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7abc0b54d0 0x7f7abc1613c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.267+0000 7f7abbfff640 1 -- 172.21.15.60:0/795638093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc1619a0 con 0x7f7abc0b6d40 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.267+0000 7f7abbfff640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7abc0b6d40 0x7f7abc0d1670 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7aac034040 tx=0x7f7aac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.267+0000 7f7ab97fa640 1 -- 172.21.15.60:0/795638093 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac036050 con 0x7f7abc0b6d40 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.267+0000 7f7ab97fa640 1 -- 172.21.15.60:0/795638093 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aac042070 con 0x7f7abc0b6d40 2024-09-12T01:36:48.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.267+0000 7f7ac3082640 1 -- 172.21.15.60:0/795638093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7abc161c80 con 0x7f7abc0b6d40 2024-09-12T01:36:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.267+0000 7f7ab97fa640 1 -- 172.21.15.60:0/795638093 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac009510 con 0x7f7abc0b6d40 2024-09-12T01:36:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.267+0000 7f7ac3082640 1 -- 172.21.15.60:0/795638093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7abc162240 con 0x7f7abc0b6d40 2024-09-12T01:36:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.268+0000 7f7ac3082640 1 -- 172.21.15.60:0/795638093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7abc06c6c0 con 0x7f7abc0b6d40 2024-09-12T01:36:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.268+0000 7f7ab97fa640 1 -- 172.21.15.60:0/795638093 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7aac007c50 con 0x7f7abc0b6d40 2024-09-12T01:36:48.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.269+0000 7f7ab97fa640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a9c06be30 0x7f7a9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.269+0000 7f7ac0e1e640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a9c06be30 0x7f7a9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.269+0000 7f7ab97fa640 1 -- 172.21.15.60:0/795638093 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7aac0abaa0 con 0x7f7abc0b6d40 2024-09-12T01:36:48.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.269+0000 7f7ac0e1e640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a9c06be30 0x7f7a9c06e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009aa0 tx=0x7f7ab4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:48.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.274+0000 7f7ab97fa640 1 -- 172.21.15.60:0/795638093 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7aac079e90 con 0x7f7abc0b6d40 2024-09-12T01:36:48.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.448+0000 7f7ac3082640 1 -- 172.21.15.60:0/795638093 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_max_caps_per_client}] v 0) -- 0x7f7abc0cbb30 con 0x7f7abc0b6d40 2024-09-12T01:36:48.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.451+0000 7f7ab97fa640 1 -- 172.21.15.60:0/795638093 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_max_caps_per_client}]=0 v11)=0 v11) ==== 121+0+0 (secure 0 0 0) 0x7f7aac07e190 con 0x7f7abc0b6d40 2024-09-12T01:36:48.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.453+0000 7f7ac3082640 1 -- 172.21.15.60:0/795638093 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a9c06be30 msgr2=0x7f7a9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.453+0000 7f7ac3082640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a9c06be30 0x7f7a9c06e2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009aa0 tx=0x7f7ab4009190 comp rx=0 tx=0).stop 2024-09-12T01:36:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.453+0000 7f7ac3082640 1 -- 172.21.15.60:0/795638093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7abc0b6d40 msgr2=0x7f7abc0d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.453+0000 7f7ac3082640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7abc0b6d40 0x7f7abc0d1670 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7aac034040 tx=0x7f7aac004a40 comp rx=0 tx=0).stop 2024-09-12T01:36:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.453+0000 7f7ac3082640 1 -- 172.21.15.60:0/795638093 shutdown_connections 2024-09-12T01:36:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.453+0000 7f7ac3082640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a9c06be30 0x7f7a9c06e2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.453+0000 7f7ac3082640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7abc15e6f0 0x7f7abc0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.453+0000 7f7ac3082640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7abc0b6d40 0x7f7abc0d1670 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.453+0000 7f7ac3082640 1 --2- 172.21.15.60:0/795638093 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7abc0b54d0 0x7f7abc1613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.453+0000 7f7ac3082640 1 -- 172.21.15.60:0/795638093 >> 172.21.15.60:0/795638093 conn(0x7f7abc0d2430 msgr2=0x7f7abc15bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.453+0000 7f7ac3082640 1 -- 172.21.15.60:0/795638093 shutdown_connections 2024-09-12T01:36:48.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.453+0000 7f7ac3082640 1 -- 172.21.15.60:0/795638093 wait complete. 2024-09-12T01:36:48.464 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_session_cap_acquisition_throttle 37 2024-09-12T01:36:48.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.569+0000 7fd3070d0640 1 Processor -- start 2024-09-12T01:36:48.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.569+0000 7fd3070d0640 1 -- start start 2024-09-12T01:36:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.570+0000 7fd3070d0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd30015b480 0x7fd3000b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.570+0000 7fd3070d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3000b60c0 0x7fd300071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.570+0000 7fd3070d0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd300072530 0x7fd300070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.570+0000 7fd3070d0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd3000b6500 con 0x7fd300072530 2024-09-12T01:36:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.570+0000 7fd3070d0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd300072970 con 0x7fd30015b480 2024-09-12T01:36:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.570+0000 7fd3070d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd3000ccff0 con 0x7fd3000b60c0 2024-09-12T01:36:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.570+0000 7fd30566d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd300072530 0x7fd300070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.570+0000 7fd30566d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd300072530 0x7fd300070fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56990/0 (socket says 172.21.15.60:56990) 2024-09-12T01:36:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.570+0000 7fd30566d640 1 -- 172.21.15.60:0/4193914166 learned_addr learned my addr 172.21.15.60:0/4193914166 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:48.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.570+0000 7fd2fffff640 1 --2- 172.21.15.60:0/4193914166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3000b60c0 0x7fd300071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.570+0000 7fd304e6c640 1 --2- 172.21.15.60:0/4193914166 >> v2:172.21.15.105:3300/0 conn(0x7fd30015b480 0x7fd3000b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.571+0000 7fd30566d640 1 -- 172.21.15.60:0/4193914166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3000b60c0 msgr2=0x7fd300071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.571+0000 7fd30566d640 1 --2- 172.21.15.60:0/4193914166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3000b60c0 0x7fd300071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.571+0000 7fd30566d640 1 -- 172.21.15.60:0/4193914166 >> v2:172.21.15.105:3300/0 conn(0x7fd30015b480 msgr2=0x7fd3000b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:36:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.571+0000 7fd30566d640 1 --2- 172.21.15.60:0/4193914166 >> v2:172.21.15.105:3300/0 conn(0x7fd30015b480 0x7fd3000b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.571+0000 7fd30566d640 1 -- 172.21.15.60:0/4193914166 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3000cd2d0 con 0x7fd300072530 2024-09-12T01:36:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.571+0000 7fd304e6c640 1 --2- 172.21.15.60:0/4193914166 >> v2:172.21.15.105:3300/0 conn(0x7fd30015b480 0x7fd3000b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:36:48.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.571+0000 7fd30566d640 1 --2- 172.21.15.60:0/4193914166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd300072530 0x7fd300070fb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd3000694d0 tx=0x7fd2f002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43189d10fd80f5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.572+0000 7fd2ff7fe640 1 -- 172.21.15.60:0/4193914166 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0037070 con 0x7fd300072530 2024-09-12T01:36:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.572+0000 7fd2ff7fe640 1 -- 172.21.15.60:0/4193914166 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f0032440 con 0x7fd300072530 2024-09-12T01:36:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.572+0000 7fd2ff7fe640 1 -- 172.21.15.60:0/4193914166 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0032810 con 0x7fd300072530 2024-09-12T01:36:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.572+0000 7fd3070d0640 1 -- 172.21.15.60:0/4193914166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd300072530 msgr2=0x7fd300070fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.572+0000 7fd3070d0640 1 --2- 172.21.15.60:0/4193914166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd300072530 0x7fd300070fb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd3000694d0 tx=0x7fd2f002a140 comp rx=0 tx=0).stop 2024-09-12T01:36:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.572+0000 7fd3070d0640 1 -- 172.21.15.60:0/4193914166 shutdown_connections 2024-09-12T01:36:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.572+0000 7fd3070d0640 1 --2- 172.21.15.60:0/4193914166 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd300072530 0x7fd300070fb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.572+0000 7fd3070d0640 1 --2- 172.21.15.60:0/4193914166 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3000b60c0 0x7fd300071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.572+0000 7fd3070d0640 1 --2- 172.21.15.60:0/4193914166 >> v2:172.21.15.105:3300/0 conn(0x7fd30015b480 0x7fd3000b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.572+0000 7fd3070d0640 1 -- 172.21.15.60:0/4193914166 >> 172.21.15.60:0/4193914166 conn(0x7fd30006d0f0 msgr2=0x7fd30006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:48.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.572+0000 7fd3070d0640 1 -- 172.21.15.60:0/4193914166 shutdown_connections 2024-09-12T01:36:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.572+0000 7fd3070d0640 1 -- 172.21.15.60:0/4193914166 wait complete. 2024-09-12T01:36:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.573+0000 7fd3070d0640 1 Processor -- start 2024-09-12T01:36:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.574+0000 7fd3070d0640 1 -- start start 2024-09-12T01:36:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.574+0000 7fd3070d0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd300072530 0x7fd300147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.574+0000 7fd3070d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3000b60c0 0x7fd3000c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.574+0000 7fd3070d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd30015b480 0x7fd3000c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.574+0000 7fd3070d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd3000cdb70 con 0x7fd30015b480 2024-09-12T01:36:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.574+0000 7fd3070d0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3000cd890 con 0x7fd300072530 2024-09-12T01:36:48.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.574+0000 7fd3070d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd30015b860 con 0x7fd3000b60c0 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd30566d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd30015b480 0x7fd3000c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd304e6c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd300072530 0x7fd300147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd2fffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3000b60c0 0x7fd3000c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd30566d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd30015b480 0x7fd3000c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56994/0 (socket says 172.21.15.60:56994) 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd30566d640 1 -- 172.21.15.60:0/69820556 learned_addr learned my addr 172.21.15.60:0/69820556 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd30566d640 1 -- 172.21.15.60:0/69820556 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3000b60c0 msgr2=0x7fd3000c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd30566d640 1 --2- 172.21.15.60:0/69820556 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3000b60c0 0x7fd3000c7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd30566d640 1 -- 172.21.15.60:0/69820556 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd300072530 msgr2=0x7fd300147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd30566d640 1 --2- 172.21.15.60:0/69820556 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd300072530 0x7fd300147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd30566d640 1 -- 172.21.15.60:0/69820556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3000ca970 con 0x7fd30015b480 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd30566d640 1 --2- 172.21.15.60:0/69820556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd30015b480 0x7fd3000c7b50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00090b0 tx=0x7fd2f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd2fd7fa640 1 -- 172.21.15.60:0/69820556 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0041020 con 0x7fd30015b480 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd2fd7fa640 1 -- 172.21.15.60:0/69820556 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f003d640 con 0x7fd30015b480 2024-09-12T01:36:48.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd2fd7fa640 1 -- 172.21.15.60:0/69820556 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0037040 con 0x7fd30015b480 2024-09-12T01:36:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd3070d0640 1 -- 172.21.15.60:0/69820556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3000cac50 con 0x7fd30015b480 2024-09-12T01:36:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.575+0000 7fd3070d0640 1 -- 172.21.15.60:0/69820556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3001484e0 con 0x7fd30015b480 2024-09-12T01:36:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.576+0000 7fd3070d0640 1 -- 172.21.15.60:0/69820556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd300071ff0 con 0x7fd30015b480 2024-09-12T01:36:48.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.577+0000 7fd2fd7fa640 1 -- 172.21.15.60:0/69820556 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2f0044020 con 0x7fd30015b480 2024-09-12T01:36:48.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.577+0000 7fd2fd7fa640 1 --2- 172.21.15.60:0/69820556 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd2ec06be30 0x7fd2ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:36:48.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.577+0000 7fd304e6c640 1 --2- 172.21.15.60:0/69820556 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd2ec06be30 0x7fd2ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:36:48.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.577+0000 7fd2fd7fa640 1 -- 172.21.15.60:0/69820556 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd2f00ab450 con 0x7fd30015b480 2024-09-12T01:36:48.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.578+0000 7fd304e6c640 1 --2- 172.21.15.60:0/69820556 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd2ec06be30 0x7fd2ec06e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd3001f5550 tx=0x7fd2f80097f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:36:48.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.581+0000 7fd2fd7fa640 1 -- 172.21.15.60:0/69820556 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd2f004b030 con 0x7fd30015b480 2024-09-12T01:36:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.759+0000 7fd3070d0640 1 -- 172.21.15.60:0/69820556 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_session_cap_acquisition_throttle}] v 0) -- 0x7fd300063360 con 0x7fd30015b480 2024-09-12T01:36:48.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.762+0000 7fd2fd7fa640 1 -- 172.21.15.60:0/69820556 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_session_cap_acquisition_throttle}]=0 v12)=0 v12) ==== 135+0+0 (secure 0 0 0) 0x7fd2f00797c0 con 0x7fd30015b480 2024-09-12T01:36:48.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.764+0000 7fd3070d0640 1 -- 172.21.15.60:0/69820556 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd2ec06be30 msgr2=0x7fd2ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:48.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.764+0000 7fd3070d0640 1 --2- 172.21.15.60:0/69820556 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd2ec06be30 0x7fd2ec06e2f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd3001f5550 tx=0x7fd2f80097f0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.764+0000 7fd3070d0640 1 -- 172.21.15.60:0/69820556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd30015b480 msgr2=0x7fd3000c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:36:48.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.764+0000 7fd3070d0640 1 --2- 172.21.15.60:0/69820556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd30015b480 0x7fd3000c7b50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00090b0 tx=0x7fd2f00046c0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.764+0000 7fd3070d0640 1 -- 172.21.15.60:0/69820556 shutdown_connections 2024-09-12T01:36:48.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.764+0000 7fd3070d0640 1 --2- 172.21.15.60:0/69820556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd30015b480 0x7fd3000c7b50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.764+0000 7fd3070d0640 1 --2- 172.21.15.60:0/69820556 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd2ec06be30 0x7fd2ec06e2f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.764+0000 7fd3070d0640 1 --2- 172.21.15.60:0/69820556 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3000b60c0 0x7fd3000c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.764+0000 7fd3070d0640 1 --2- 172.21.15.60:0/69820556 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd300072530 0x7fd300147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:36:48.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.764+0000 7fd3070d0640 1 -- 172.21.15.60:0/69820556 >> 172.21.15.60:0/69820556 conn(0x7fd30006d0f0 msgr2=0x7fd300070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:36:48.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.764+0000 7fd3070d0640 1 -- 172.21.15.60:0/69820556 shutdown_connections 2024-09-12T01:36:48.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:48.764+0000 7fd3070d0640 1 -- 172.21.15.60:0/69820556 wait complete. 2024-09-12T01:36:48.775 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:48.776 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:48.792 DEBUG:teuthology.orchestra.run.smithi060:> stdin-killer -- python3 -c ' 2024-09-12T01:36:48.792 DEBUG:teuthology.orchestra.run.smithi060:> import os 2024-09-12T01:36:48.792 DEBUG:teuthology.orchestra.run.smithi060:> import uuid 2024-09-12T01:36:48.793 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:48.793 DEBUG:teuthology.orchestra.run.smithi060:> n = 25 2024-09-12T01:36:48.793 DEBUG:teuthology.orchestra.run.smithi060:> create_hard_links = False 2024-09-12T01:36:48.793 DEBUG:teuthology.orchestra.run.smithi060:> if 0 > 0: 2024-09-12T01:36:48.793 DEBUG:teuthology.orchestra.run.smithi060:> create_hard_links = True 2024-09-12T01:36:48.793 DEBUG:teuthology.orchestra.run.smithi060:> path = "/home/ubuntu/cephtest/mnt.0/dir1/file" 2024-09-12T01:36:48.793 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:48.793 DEBUG:teuthology.orchestra.run.smithi060:> dpath = os.path.dirname(path) 2024-09-12T01:36:48.793 DEBUG:teuthology.orchestra.run.smithi060:> fnameprefix = os.path.basename(path) 2024-09-12T01:36:48.793 DEBUG:teuthology.orchestra.run.smithi060:> os.makedirs(dpath, exist_ok=True) 2024-09-12T01:36:48.793 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> try: 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> for i in range(n): 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> f.write(f"{i}") 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> if True: 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> f.flush() 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f.fileno()) 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> os.unlink(fpath) 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(dirfd) 2024-09-12T01:36:48.794 DEBUG:teuthology.orchestra.run.smithi060:> if create_hard_links: 2024-09-12T01:36:48.795 DEBUG:teuthology.orchestra.run.smithi060:> for j in range(0): 2024-09-12T01:36:48.795 DEBUG:teuthology.orchestra.run.smithi060:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T01:36:48.795 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:36:48.795 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(dirfd) 2024-09-12T01:36:48.795 DEBUG:teuthology.orchestra.run.smithi060:> finally: 2024-09-12T01:36:48.795 DEBUG:teuthology.orchestra.run.smithi060:> os.close(dirfd) 2024-09-12T01:36:48.795 DEBUG:teuthology.orchestra.run.smithi060:> ' 2024-09-12T01:36:49.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:49.035 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:49.035 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:49.092 DEBUG:teuthology.orchestra.run.smithi060:> stdin-killer -- python3 -c ' 2024-09-12T01:36:49.092 DEBUG:teuthology.orchestra.run.smithi060:> import os 2024-09-12T01:36:49.092 DEBUG:teuthology.orchestra.run.smithi060:> import uuid 2024-09-12T01:36:49.092 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:49.093 DEBUG:teuthology.orchestra.run.smithi060:> n = 25 2024-09-12T01:36:49.093 DEBUG:teuthology.orchestra.run.smithi060:> create_hard_links = False 2024-09-12T01:36:49.093 DEBUG:teuthology.orchestra.run.smithi060:> if 0 > 0: 2024-09-12T01:36:49.093 DEBUG:teuthology.orchestra.run.smithi060:> create_hard_links = True 2024-09-12T01:36:49.093 DEBUG:teuthology.orchestra.run.smithi060:> path = "/home/ubuntu/cephtest/mnt.0/dir2/file" 2024-09-12T01:36:49.093 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:49.093 DEBUG:teuthology.orchestra.run.smithi060:> dpath = os.path.dirname(path) 2024-09-12T01:36:49.093 DEBUG:teuthology.orchestra.run.smithi060:> fnameprefix = os.path.basename(path) 2024-09-12T01:36:49.093 DEBUG:teuthology.orchestra.run.smithi060:> os.makedirs(dpath, exist_ok=True) 2024-09-12T01:36:49.093 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> try: 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> for i in range(n): 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> f.write(f"{i}") 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> if True: 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> f.flush() 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f.fileno()) 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> os.unlink(fpath) 2024-09-12T01:36:49.094 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:36:49.095 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(dirfd) 2024-09-12T01:36:49.095 DEBUG:teuthology.orchestra.run.smithi060:> if create_hard_links: 2024-09-12T01:36:49.095 DEBUG:teuthology.orchestra.run.smithi060:> for j in range(0): 2024-09-12T01:36:49.095 DEBUG:teuthology.orchestra.run.smithi060:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T01:36:49.095 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:36:49.095 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(dirfd) 2024-09-12T01:36:49.095 DEBUG:teuthology.orchestra.run.smithi060:> finally: 2024-09-12T01:36:49.095 DEBUG:teuthology.orchestra.run.smithi060:> os.close(dirfd) 2024-09-12T01:36:49.096 DEBUG:teuthology.orchestra.run.smithi060:> ' 2024-09-12T01:36:49.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:49.335 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:49.335 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:49.393 DEBUG:teuthology.orchestra.run.smithi060:> stdin-killer -- python3 -c ' 2024-09-12T01:36:49.394 DEBUG:teuthology.orchestra.run.smithi060:> import os 2024-09-12T01:36:49.394 DEBUG:teuthology.orchestra.run.smithi060:> import uuid 2024-09-12T01:36:49.394 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:49.394 DEBUG:teuthology.orchestra.run.smithi060:> n = 25 2024-09-12T01:36:49.394 DEBUG:teuthology.orchestra.run.smithi060:> create_hard_links = False 2024-09-12T01:36:49.395 DEBUG:teuthology.orchestra.run.smithi060:> if 0 > 0: 2024-09-12T01:36:49.395 DEBUG:teuthology.orchestra.run.smithi060:> create_hard_links = True 2024-09-12T01:36:49.395 DEBUG:teuthology.orchestra.run.smithi060:> path = "/home/ubuntu/cephtest/mnt.0/dir3/file" 2024-09-12T01:36:49.395 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:49.395 DEBUG:teuthology.orchestra.run.smithi060:> dpath = os.path.dirname(path) 2024-09-12T01:36:49.395 DEBUG:teuthology.orchestra.run.smithi060:> fnameprefix = os.path.basename(path) 2024-09-12T01:36:49.396 DEBUG:teuthology.orchestra.run.smithi060:> os.makedirs(dpath, exist_ok=True) 2024-09-12T01:36:49.396 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:49.396 DEBUG:teuthology.orchestra.run.smithi060:> try: 2024-09-12T01:36:49.396 DEBUG:teuthology.orchestra.run.smithi060:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T01:36:49.396 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:49.396 DEBUG:teuthology.orchestra.run.smithi060:> for i in range(n): 2024-09-12T01:36:49.397 DEBUG:teuthology.orchestra.run.smithi060:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T01:36:49.397 DEBUG:teuthology.orchestra.run.smithi060:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T01:36:49.397 DEBUG:teuthology.orchestra.run.smithi060:> f.write(f"{i}") 2024-09-12T01:36:49.397 DEBUG:teuthology.orchestra.run.smithi060:> if True: 2024-09-12T01:36:49.397 DEBUG:teuthology.orchestra.run.smithi060:> f.flush() 2024-09-12T01:36:49.397 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f.fileno()) 2024-09-12T01:36:49.398 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:36:49.398 DEBUG:teuthology.orchestra.run.smithi060:> os.unlink(fpath) 2024-09-12T01:36:49.398 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:36:49.398 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(dirfd) 2024-09-12T01:36:49.398 DEBUG:teuthology.orchestra.run.smithi060:> if create_hard_links: 2024-09-12T01:36:49.398 DEBUG:teuthology.orchestra.run.smithi060:> for j in range(0): 2024-09-12T01:36:49.398 DEBUG:teuthology.orchestra.run.smithi060:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T01:36:49.399 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:36:49.399 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(dirfd) 2024-09-12T01:36:49.399 DEBUG:teuthology.orchestra.run.smithi060:> finally: 2024-09-12T01:36:49.399 DEBUG:teuthology.orchestra.run.smithi060:> os.close(dirfd) 2024-09-12T01:36:49.399 DEBUG:teuthology.orchestra.run.smithi060:> ' 2024-09-12T01:36:49.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:49.629 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:49.629 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:49.686 DEBUG:teuthology.orchestra.run.smithi060:> stdin-killer -- python3 -c ' 2024-09-12T01:36:49.686 DEBUG:teuthology.orchestra.run.smithi060:> import os 2024-09-12T01:36:49.686 DEBUG:teuthology.orchestra.run.smithi060:> import uuid 2024-09-12T01:36:49.686 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:49.686 DEBUG:teuthology.orchestra.run.smithi060:> n = 25 2024-09-12T01:36:49.686 DEBUG:teuthology.orchestra.run.smithi060:> create_hard_links = False 2024-09-12T01:36:49.686 DEBUG:teuthology.orchestra.run.smithi060:> if 0 > 0: 2024-09-12T01:36:49.686 DEBUG:teuthology.orchestra.run.smithi060:> create_hard_links = True 2024-09-12T01:36:49.687 DEBUG:teuthology.orchestra.run.smithi060:> path = "/home/ubuntu/cephtest/mnt.0/dir4/file" 2024-09-12T01:36:49.687 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:49.687 DEBUG:teuthology.orchestra.run.smithi060:> dpath = os.path.dirname(path) 2024-09-12T01:36:49.687 DEBUG:teuthology.orchestra.run.smithi060:> fnameprefix = os.path.basename(path) 2024-09-12T01:36:49.687 DEBUG:teuthology.orchestra.run.smithi060:> os.makedirs(dpath, exist_ok=True) 2024-09-12T01:36:49.687 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:49.687 DEBUG:teuthology.orchestra.run.smithi060:> try: 2024-09-12T01:36:49.687 DEBUG:teuthology.orchestra.run.smithi060:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T01:36:49.687 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> for i in range(n): 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> f.write(f"{i}") 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> if True: 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> f.flush() 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f.fileno()) 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> os.unlink(fpath) 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(dirfd) 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> if create_hard_links: 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> for j in range(0): 2024-09-12T01:36:49.688 DEBUG:teuthology.orchestra.run.smithi060:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T01:36:49.689 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:36:49.689 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(dirfd) 2024-09-12T01:36:49.689 DEBUG:teuthology.orchestra.run.smithi060:> finally: 2024-09-12T01:36:49.689 DEBUG:teuthology.orchestra.run.smithi060:> os.close(dirfd) 2024-09-12T01:36:49.689 DEBUG:teuthology.orchestra.run.smithi060:> ' 2024-09-12T01:36:49.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:49.923 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:36:49.923 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:36:49.982 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:36:50.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:36:50.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:36:50.083 INFO:teuthology.orchestra.run.smithi060.stdout:client4903 2024-09-12T01:36:50.083 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'find . | wc') 2024-09-12T01:36:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:36:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:37:17.734 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:37:17.737 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:37:29.152 INFO:teuthology.orchestra.run.smithi060.stdout: 105 105 1490 2024-09-12T01:37:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:37:29.161 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:37:29.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.275+0000 7f4958650640 1 Processor -- start 2024-09-12T01:37:29.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.275+0000 7f4958650640 1 -- start start 2024-09-12T01:37:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f4958650640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49500b74c0 0x7f495015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f4958650640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f495015f030 0x7f495006d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f4958650640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f495015fb10 con 0x7f495015c2b0 2024-09-12T01:37:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f4958650640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f49500b5900 con 0x7f495015f030 2024-09-12T01:37:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f4958650640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f495015f830 con 0x7f49500b74c0 2024-09-12T01:37:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f49563ec640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f495015c2b0 0x7f49500b6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37108/0 (socket says 172.21.15.60:37108) 2024-09-12T01:37:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f49563ec640 1 -- 172.21.15.60:0/3029887527 learned_addr learned my addr 172.21.15.60:0/3029887527 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f4956bed640 1 --2- 172.21.15.60:0/3029887527 >> v2:172.21.15.105:3300/0 conn(0x7f495015f030 0x7f495006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f4955beb640 1 --2- 172.21.15.60:0/3029887527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49500b74c0 0x7f495015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3092034408 0 0) 0x7f495015fb10 con 0x7f495015c2b0 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f493c003520 con 0x7f495015c2b0 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1914151381 0 0) 0x7f493c003520 con 0x7f495015c2b0 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49500b74c0 msgr2=0x7f495015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f49553ea640 1 --2- 172.21.15.60:0/3029887527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49500b74c0 0x7f495015eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 >> v2:172.21.15.105:3300/0 conn(0x7f495015f030 msgr2=0x7f495006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f49553ea640 1 --2- 172.21.15.60:0/3029887527 >> v2:172.21.15.105:3300/0 conn(0x7f495015f030 0x7f495006d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495006ce30 con 0x7f495015c2b0 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f494c001670 con 0x7f495015c2b0 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.276+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 >> v1:172.21.15.60:6789/0 conn(0x7f495015c2b0 legacy=0x7f49500b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f49553ea640 1 --2- 172.21.15.60:0/3029887527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49500b74c0 0x7f493c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f49553ea640 1 --2- 172.21.15.60:0/3029887527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f493c003f30 0x7f493c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f49553ea640 1 --2- 172.21.15.60:0/3029887527 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493c004d40 0x7f493c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f49500b5900 con 0x7f493c003f30 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f495015f830 con 0x7f493c004d40 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f493c00b9c0 con 0x7f49500b74c0 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f4955beb640 1 --2- 172.21.15.60:0/3029887527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f493c003f30 0x7f493c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f49563ec640 1 --2- 172.21.15.60:0/3029887527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49500b74c0 0x7f493c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f4956bed640 1 --2- 172.21.15.60:0/3029887527 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493c004d40 0x7f493c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f4955beb640 1 -- 172.21.15.60:0/3029887527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49500b74c0 msgr2=0x7f493c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f4955beb640 1 --2- 172.21.15.60:0/3029887527 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f49500b74c0 0x7f493c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f4955beb640 1 -- 172.21.15.60:0/3029887527 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493c004d40 msgr2=0x7f493c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f4955beb640 1 --2- 172.21.15.60:0/3029887527 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493c004d40 0x7f493c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.277+0000 7f4955beb640 1 -- 172.21.15.60:0/3029887527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c003520 con 0x7f493c003f30 2024-09-12T01:37:29.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.278+0000 7f4955beb640 1 --2- 172.21.15.60:0/3029887527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f493c003f30 0x7f493c004800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4940009ac0 tx=0x7f493c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166e33cfe05ec2c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:29.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.278+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940036070 con 0x7f493c003f30 2024-09-12T01:37:29.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.278+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4940031400 con 0x7f493c003f30 2024-09-12T01:37:29.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.278+0000 7f49553ea640 1 -- 172.21.15.60:0/3029887527 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940009690 con 0x7f493c003f30 2024-09-12T01:37:29.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.278+0000 7f4958650640 1 -- 172.21.15.60:0/3029887527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f493c003f30 msgr2=0x7f493c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.278+0000 7f4958650640 1 --2- 172.21.15.60:0/3029887527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f493c003f30 0x7f493c004800 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4940009ac0 tx=0x7f493c005830 comp rx=0 tx=0).stop 2024-09-12T01:37:29.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.279+0000 7f4956bed640 1 -- 172.21.15.60:0/3029887527 reap_dead start 2024-09-12T01:37:29.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.279+0000 7f4958650640 1 -- 172.21.15.60:0/3029887527 shutdown_connections 2024-09-12T01:37:29.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.279+0000 7f4958650640 1 -- 172.21.15.60:0/3029887527 >> 172.21.15.60:0/3029887527 conn(0x7f49500b4240 msgr2=0x7f49500b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:29.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.279+0000 7f4958650640 1 -- 172.21.15.60:0/3029887527 shutdown_connections 2024-09-12T01:37:29.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.279+0000 7f4958650640 1 -- 172.21.15.60:0/3029887527 wait complete. 2024-09-12T01:37:29.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.280+0000 7f4958650640 1 Processor -- start 2024-09-12T01:37:29.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.280+0000 7f4958650640 1 -- start start 2024-09-12T01:37:29.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4958650640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493c003f30 0x7f4950155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4958650640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495014c120 0x7f49500d1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4958650640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4950159380 0x7f4950159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4958650640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f495015f4c0 con 0x7f495014c120 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4958650640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f495006d3f0 con 0x7f493c003f30 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4958650640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f495015eaf0 con 0x7f4950159380 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4955beb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495014c120 0x7f49500d1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4955beb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495014c120 0x7f49500d1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34658/0 (socket says 172.21.15.60:34658) 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4955beb640 1 -- 172.21.15.60:0/66842899 learned_addr learned my addr 172.21.15.60:0/66842899 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4956bed640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4950159380 0x7f4950159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f49563ec640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493c003f30 0x7f4950155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4955beb640 1 -- 172.21.15.60:0/66842899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4950159380 msgr2=0x7f4950159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4955beb640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4950159380 0x7f4950159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4955beb640 1 -- 172.21.15.60:0/66842899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493c003f30 msgr2=0x7f4950155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4955beb640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493c003f30 0x7f4950155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4955beb640 1 -- 172.21.15.60:0/66842899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495014c5a0 con 0x7f495014c120 2024-09-12T01:37:29.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.281+0000 7f4955beb640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495014c120 0x7f49500d1840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4940000c00 tx=0x7f4940004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:29.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.282+0000 7f4946ffd640 1 -- 172.21.15.60:0/66842899 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940040020 con 0x7f495014c120 2024-09-12T01:37:29.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.282+0000 7f4946ffd640 1 -- 172.21.15.60:0/66842899 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4940003c60 con 0x7f495014c120 2024-09-12T01:37:29.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.282+0000 7f4958650640 1 -- 172.21.15.60:0/66842899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49500d2100 con 0x7f495014c120 2024-09-12T01:37:29.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.282+0000 7f4946ffd640 1 -- 172.21.15.60:0/66842899 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940036040 con 0x7f495014c120 2024-09-12T01:37:29.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.282+0000 7f4958650640 1 -- 172.21.15.60:0/66842899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49500d26c0 con 0x7f495014c120 2024-09-12T01:37:29.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.283+0000 7f4958650640 1 -- 172.21.15.60:0/66842899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4950160170 con 0x7f495014c120 2024-09-12T01:37:29.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.283+0000 7f4946ffd640 1 -- 172.21.15.60:0/66842899 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4940043020 con 0x7f495014c120 2024-09-12T01:37:29.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.283+0000 7f4946ffd640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f493406be60 0x7f493406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.284+0000 7f4946ffd640 1 -- 172.21.15.60:0/66842899 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f49400aa8f0 con 0x7f495014c120 2024-09-12T01:37:29.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.284+0000 7f49563ec640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f493406be60 0x7f493406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.284+0000 7f49563ec640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f493406be60 0x7f493406e320 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f494c001050 tx=0x7f494c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:29.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.288+0000 7f4946ffd640 1 -- 172.21.15.60:0/66842899 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f49400044e0 con 0x7f495014c120 2024-09-12T01:37:29.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.499+0000 7f4958650640 1 -- 172.21.15.60:0/66842899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f495015fe90 con 0x7f495014c120 2024-09-12T01:37:29.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.499+0000 7f4946ffd640 1 -- 172.21.15.60:0/66842899 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7f49400792a0 con 0x7f495014c120 2024-09-12T01:37:29.500 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:29.500 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":14,"btime":"2024-09-12T01:36:38:945222+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3644892545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3644892545},{"type":"v1","addr":"172.21.15.105:6835","nonce":3644892545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/458109310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458109310},{"type":"v1","addr":"172.21.15.60:6836","nonce":458109310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4741,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1415668038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1415668038},{"type":"v1","addr":"172.21.15.60:6837","nonce":1415668038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:36:36.284771+0000","modified":"2024-09-12T01:36:38.293895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34520":{"gid":34520,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/1200480020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1200480020},{"type":"v1","addr":"172.21.15.105:6834","nonce":1200480020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34520,"qdb_cluster":[34520]},"id":2}]} 2024-09-12T01:37:29.500 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 14 2024-09-12T01:37:29.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.501+0000 7f4958650640 1 -- 172.21.15.60:0/66842899 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f493406be60 msgr2=0x7f493406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.501+0000 7f4958650640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f493406be60 0x7f493406e320 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f494c001050 tx=0x7f494c009040 comp rx=0 tx=0).stop 2024-09-12T01:37:29.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.501+0000 7f4958650640 1 -- 172.21.15.60:0/66842899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495014c120 msgr2=0x7f49500d1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.501+0000 7f4958650640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495014c120 0x7f49500d1840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4940000c00 tx=0x7f4940004730 comp rx=0 tx=0).stop 2024-09-12T01:37:29.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.501+0000 7f4958650640 1 -- 172.21.15.60:0/66842899 shutdown_connections 2024-09-12T01:37:29.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.501+0000 7f4958650640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f493406be60 0x7f493406e320 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.501+0000 7f4958650640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4950159380 0x7f4950159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.501+0000 7f4958650640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495014c120 0x7f49500d1840 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.501+0000 7f4958650640 1 --2- 172.21.15.60:0/66842899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f493c003f30 0x7f4950155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.501+0000 7f4958650640 1 -- 172.21.15.60:0/66842899 >> 172.21.15.60:0/66842899 conn(0x7f49500b4240 msgr2=0x7f495015a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:29.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.501+0000 7f4958650640 1 -- 172.21.15.60:0/66842899 shutdown_connections 2024-09-12T01:37:29.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.501+0000 7f4958650640 1 -- 172.21.15.60:0/66842899 wait complete. 2024-09-12T01:37:29.513 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json perf dump 2024-09-12T01:37:29.636 INFO:teuthology.orchestra.run.smithi105.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":513,"msgr_send_messages":589,"msgr_recv_bytes":142423,"msgr_send_bytes":753838,"msgr_created_connections":9,"msgr_active_connections":5,"msgr_running_total_time":0.034250139,"msgr_running_send_time":0.012396338,"msgr_running_recv_time":0.018651393,"msgr_running_fast_dispatch_time":0.005125738,"msgr_send_messages_queue_lat":{"avgcount":588,"sum":0.042142036,"avgtime":0.000071670},"msgr_handle_ack_lat":{"avgcount":826,"sum":0.000114485,"avgtime":0.000000138},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":131,"msgr_send_messages":87,"msgr_recv_bytes":139924,"msgr_send_bytes":36104,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.017463623,"msgr_running_send_time":0.005455640,"msgr_running_recv_time":0.012844140,"msgr_running_fast_dispatch_time":0.002588961,"msgr_send_messages_queue_lat":{"avgcount":87,"sum":0.190193932,"avgtime":0.002186137},"msgr_handle_ack_lat":{"avgcount":62,"sum":0.000010587,"avgtime":0.000000170},"msgr_recv_encrypted_bytes":115104,"msgr_send_encrypted_bytes":17136},"AsyncMessenger::Worker-2":{"msgr_recv_messages":15,"msgr_send_messages":29,"msgr_recv_bytes":3962,"msgr_send_bytes":121435,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.004967195,"msgr_running_send_time":0.001068556,"msgr_running_recv_time":0.003254492,"msgr_running_fast_dispatch_time":0.000368316,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.077580333,"avgtime":0.002873345},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":108512},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":250,"sum":0.066819327,"avgtime":0.000267277}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":2,"sum":0.000012605,"avgtime":0.000006302}},"mds":{"request":148,"reply":148,"reply_latency":{"avgcount":148,"sum":39.094532187,"avgtime":0.264152244},"slow_reply":0,"forward":0,"dir_fetch_complete":0,"dir_fetch_keys":0,"dir_commit":12,"dir_split":0,"dir_merge":0,"inodes":114,"inodes_top":0,"inodes_bottom":114,"inodes_pin_tail":0,"inodes_pinned":114,"inodes_expired":0,"inodes_with_caps":100,"caps":101,"subtrees":2,"traverse":188,"traverse_hit":174,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":100,"root_rbytes":160,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":4,"ceph_cap_op_grant":112,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":104,"handle_client_caps_dirty":100,"handle_client_cap_release":1,"process_request_cap_release":14},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":219,"evex":0,"evtrm":0,"ev":219,"evexg":0,"evexd":0,"segadd":2,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4639770,"rdpos":0,"jlat":{"avgcount":109,"sum":0.168492746,"avgtime":0.001545805},"replayed":0},"mds_mem":{"ino":117,"ino+":117,"ino-":0,"dir":16,"dir+":16,"dir-":0,"dn":114,"dn+":115,"dn-":1,"cap":101,"cap+":106,"cap-":5,"rss":51516,"heap":231788},"mds_server":{"dispatch_client_request":230,"dispatch_server_request":0,"handle_client_request":148,"handle_client_session":106,"handle_peer_request":0,"req_create_latency":{"avgcount":100,"sum":0.065727422,"avgtime":0.000657274},"req_getattr_latency":{"avgcount":32,"sum":0.007785028,"avgtime":0.000243282},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":4,"sum":0.000428079,"avgtime":0.000107019},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":4,"sum":0.004730475,"avgtime":0.001182618},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":2,"sum":0.000325445,"avgtime":0.000162722},"req_readdir_latency":{"avgcount":5,"sum":39.015024214,"avgtime":7.803004842},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":1,"sum":0.000511524,"avgtime":0.000511524},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":78,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":2,"session_add":2,"session_remove":0,"sessions_open":2,"sessions_stale":0,"total_load":93,"average_load":46,"avg_session_uptime":37,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":230329,"buffer_anon_items":208,"buffer_meta_bytes":1584,"buffer_meta_items":18,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5312,"osdmap_items":75,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":420136,"mds_co_items":4385,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":151,"op_send_bytes":463299,"op_resend":28,"op_reply":151,"op_latency":{"avgcount":151,"sum":1.033978900,"avgtime":0.006847542},"op_inflight":0,"oplen_avg":{"avgcount":151,"sum":178},"op":151,"op_r":0,"op_w":151,"op_rmw":0,"op_pg":0,"osdop_stat":0,"osdop_create":11,"osdop_read":0,"osdop_write":109,"osdop_writefull":8,"osdop_writesame":0,"osdop_append":0,"osdop_zero":0,"osdop_truncate":0,"osdop_delete":6,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":0,"osdop_setxattr":22,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":34,"map_full":0,"map_inc":1,"osd_sessions":6,"osd_session_open":6,"osd_session_close":0,"osd_laggy":0,"omap_wr":20,"omap_rd":0,"omap_del":2},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":2},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":655,"get_sum":222983,"get_or_fail_fail":0,"get_or_fail_success":655,"take":0,"take_sum":0,"put":655,"put_sum":222983,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":151,"take_sum":463299,"put":151,"put_sum":463299,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":151,"take_sum":151,"put":151,"put_sum":151,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55b6a1ec2500":{"val":0,"max":3758096384,"get_started":0,"get":219,"get_sum":445466,"get_or_fail_fail":0,"get_or_fail_success":219,"take":0,"take_sum":0,"put":109,"put_sum":445466,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-12T01:37:29.638 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 5, "msgr_created_connections": 9, "msgr_handle_ack_lat": { "avgcount": 826, "avgtime": 1.38e-07, "sum": 0.000114485 }, "msgr_recv_bytes": 142423, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 513, "msgr_running_fast_dispatch_time": 0.005125738, "msgr_running_recv_time": 0.018651393, "msgr_running_send_time": 0.012396338, "msgr_running_total_time": 0.034250139, "msgr_send_bytes": 753838, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 589, "msgr_send_messages_queue_lat": { "avgcount": 588, "avgtime": 7.167e-05, "sum": 0.042142036 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 62, "avgtime": 1.7e-07, "sum": 1.0587e-05 }, "msgr_recv_bytes": 139924, "msgr_recv_encrypted_bytes": 115104, "msgr_recv_messages": 131, "msgr_running_fast_dispatch_time": 0.002588961, "msgr_running_recv_time": 0.01284414, "msgr_running_send_time": 0.00545564, "msgr_running_total_time": 0.017463623, "msgr_send_bytes": 36104, "msgr_send_encrypted_bytes": 17136, "msgr_send_messages": 87, "msgr_send_messages_queue_lat": { "avgcount": 87, "avgtime": 0.002186137, "sum": 0.190193932 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 3962, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 15, "msgr_running_fast_dispatch_time": 0.000368316, "msgr_running_recv_time": 0.003254492, "msgr_running_send_time": 0.001068556, "msgr_running_total_time": 0.004967195, "msgr_send_bytes": 121435, "msgr_send_encrypted_bytes": 108512, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.002873345, "sum": 0.077580333 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 250, "avgtime": 0.000267277, "sum": 0.066819327 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 2, "avgtime": 6.302e-06, "sum": 1.2605e-05 }, "queue_len": 0 }, "mds": { "caps": 101, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 112, "ceph_cap_op_revoke": 4, "ceph_cap_op_trunc": 0, "dir_commit": 12, "dir_fetch_complete": 0, "dir_fetch_keys": 0, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 1, "handle_client_caps": 104, "handle_client_caps_dirty": 100, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 114, "inodes_bottom": 114, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 114, "inodes_top": 0, "inodes_with_caps": 100, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 14, "q": 0, "reply": 148, "reply_latency": { "avgcount": 148, "avgtime": 0.264152244, "sum": 39.094532187 }, "request": 148, "root_rbytes": 160, "root_rfiles": 100, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 188, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 174, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 219, "evadd": 219, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 109, "avgtime": 0.001545805, "sum": 0.168492746 }, "rdpos": 0, "replayed": 0, "seg": 2, "segadd": 2, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4639770 }, "mds_mem": { "cap": 101, "cap+": 106, "cap-": 5, "dir": 16, "dir+": 16, "dir-": 0, "dn": 114, "dn+": 115, "dn-": 1, "heap": 231788, "ino": 117, "ino+": 117, "ino-": 0, "rss": 51516 }, "mds_server": { "cap_acquisition_throttle": 78, "cap_revoke_eviction": 0, "dispatch_client_request": 230, "dispatch_server_request": 0, "handle_client_request": 148, "handle_client_session": 106, "handle_peer_request": 0, "req_create_latency": { "avgcount": 100, "avgtime": 0.000657274, "sum": 0.065727422 }, "req_getattr_latency": { "avgcount": 32, "avgtime": 0.000243282, "sum": 0.007785028 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 4, "avgtime": 0.000107019, "sum": 0.000428079 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 4, "avgtime": 0.001182618, "sum": 0.004730475 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 2, "avgtime": 0.000162722, "sum": 0.000325445 }, "req_readdir_latency": { "avgcount": 5, "avgtime": 7.803004842, "sum": 39.015024214 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 1, "avgtime": 0.000511524, "sum": 0.000511524 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 46, "avg_session_uptime": 37, "mdthresh_evicted": 0, "session_add": 2, "session_count": 2, "session_remove": 0, "sessions_open": 2, "sessions_stale": 0, "total_load": 93 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 230329, "buffer_anon_items": 208, "buffer_meta_bytes": 1584, "buffer_meta_items": 18, "mds_co_bytes": 420136, "mds_co_items": 4385, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5312, "osdmap_items": 75, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 34, "map_full": 0, "map_inc": 1, "omap_del": 2, "omap_rd": 0, "omap_wr": 20, "op": 151, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 151, "avgtime": 0.006847542, "sum": 1.0339789 }, "op_pg": 0, "op_r": 0, "op_reply": 151, "op_resend": 28, "op_rmw": 0, "op_send": 151, "op_send_bytes": 463299, "op_w": 151, "oplen_avg": { "avgcount": 151, "sum": 178 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 6, "osd_sessions": 6, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 11, "osdop_delete": 6, "osdop_getxattr": 0, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 0, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 22, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 0, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 109, "osdop_writefull": 8, "osdop_writesame": 0, "osdop_zero": 0, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 1, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 2 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 655, "get_or_fail_fail": 0, "get_or_fail_success": 655, "get_started": 0, "get_sum": 222983, "max": 104857600, "put": 655, "put_sum": 222983, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 151, "put_sum": 463299, "take": 151, "take_sum": 463299, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 151, "put_sum": 151, "take": 151, "take_sum": 151, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55b6a1ec2500": { "get": 219, "get_or_fail_fail": 0, "get_or_fail_success": 219, "get_started": 0, "get_sum": 445466, "max": 3758096384, "put": 109, "put_sum": 445466, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-12T01:37:29.638 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:37:29.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.740+0000 7fb6d79d8640 1 Processor -- start 2024-09-12T01:37:29.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.741+0000 7fb6d79d8640 1 -- start start 2024-09-12T01:37:29.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.741+0000 7fb6d79d8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb6d00d3310 0x7fb6d00d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.741+0000 7fb6d79d8640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d015ea40 con 0x7fb6d015e660 2024-09-12T01:37:29.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.741+0000 7fb6d79d8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d00d3870 con 0x7fb6d00d1650 2024-09-12T01:37:29.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.741+0000 7fb6d79d8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d00d1ac0 con 0x7fb6d00d3310 2024-09-12T01:37:29.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.741+0000 7fb6d5774640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb6d015e660 0x7fb6d00cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37110/0 (socket says 172.21.15.60:37110) 2024-09-12T01:37:29.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.741+0000 7fb6d4f73640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb6d00d3310 0x7fb6d00d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.741+0000 7fb6d5774640 1 -- 172.21.15.60:0/663934996 learned_addr learned my addr 172.21.15.60:0/663934996 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:29.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.742+0000 7fb6cffff640 1 -- 172.21.15.60:0/663934996 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77768917 0 0) 0x7fb6d015ea40 con 0x7fb6d015e660 2024-09-12T01:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.742+0000 7fb6cffff640 1 -- 172.21.15.60:0/663934996 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6b8003520 con 0x7fb6d015e660 2024-09-12T01:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.742+0000 7fb6d4f73640 1 -- 172.21.15.60:0/663934996 >> v1:172.21.15.105:6789/0 conn(0x7fb6d00d1650 legacy=0x7fb6d00b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.742+0000 7fb6d4f73640 1 -- 172.21.15.60:0/663934996 >> v1:172.21.15.60:6789/0 conn(0x7fb6d015e660 legacy=0x7fb6d00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.742+0000 7fb6d4f73640 1 -- 172.21.15.60:0/663934996 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d00d3b50 con 0x7fb6d00d3310 2024-09-12T01:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.743+0000 7fb6d4f73640 1 --2- 172.21.15.60:0/663934996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6d00d3310 0x7fb6d00d1110 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40097a0 tx=0x7fb6c402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fda055045e2c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.743+0000 7fb6cffff640 1 -- 172.21.15.60:0/663934996 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4037070 con 0x7fb6d00d3310 2024-09-12T01:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.743+0000 7fb6cffff640 1 -- 172.21.15.60:0/663934996 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c4032440 con 0x7fb6d00d3310 2024-09-12T01:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.743+0000 7fb6cffff640 1 -- 172.21.15.60:0/663934996 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4032810 con 0x7fb6d00d3310 2024-09-12T01:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.743+0000 7fb6d79d8640 1 -- 172.21.15.60:0/663934996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6d00d3310 msgr2=0x7fb6d00d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.743+0000 7fb6d79d8640 1 --2- 172.21.15.60:0/663934996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6d00d3310 0x7fb6d00d1110 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40097a0 tx=0x7fb6c402a230 comp rx=0 tx=0).stop 2024-09-12T01:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.743+0000 7fb6d79d8640 1 -- 172.21.15.60:0/663934996 shutdown_connections 2024-09-12T01:37:29.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.743+0000 7fb6d79d8640 1 --2- 172.21.15.60:0/663934996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6d00d3310 0x7fb6d00d1110 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.743+0000 7fb6d79d8640 1 -- 172.21.15.60:0/663934996 >> 172.21.15.60:0/663934996 conn(0x7fb6d00b6410 msgr2=0x7fb6d00b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:29.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.743+0000 7fb6d79d8640 1 -- 172.21.15.60:0/663934996 shutdown_connections 2024-09-12T01:37:29.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.743+0000 7fb6d79d8640 1 -- 172.21.15.60:0/663934996 wait complete. 2024-09-12T01:37:29.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.745+0000 7fb6d79d8640 1 Processor -- start 2024-09-12T01:37:29.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.745+0000 7fb6d79d8640 1 -- start start 2024-09-12T01:37:29.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.745+0000 7fb6d79d8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6d00d1650 0x7fb6d01614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.745+0000 7fb6d79d8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6d00d3310 0x7fb6d01f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.745+0000 7fb6d79d8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6d015e660 0x7fb6d015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.745+0000 7fb6d79d8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d00d43f0 con 0x7fb6d00d3310 2024-09-12T01:37:29.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.745+0000 7fb6d79d8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d00d4110 con 0x7fb6d015e660 2024-09-12T01:37:29.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.745+0000 7fb6d79d8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d00b8280 con 0x7fb6d00d1650 2024-09-12T01:37:29.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.745+0000 7fb6d4f73640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6d00d3310 0x7fb6d01f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.745+0000 7fb6d4f73640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6d00d3310 0x7fb6d01f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34676/0 (socket says 172.21.15.60:34676) 2024-09-12T01:37:29.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.745+0000 7fb6d4f73640 1 -- 172.21.15.60:0/504783784 learned_addr learned my addr 172.21.15.60:0/504783784 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:29.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6d5774640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6d00d1650 0x7fb6d01614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6d5f75640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6d015e660 0x7fb6d015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6d4f73640 1 -- 172.21.15.60:0/504783784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6d00d1650 msgr2=0x7fb6d01614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6d4f73640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6d00d1650 0x7fb6d01614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6d4f73640 1 -- 172.21.15.60:0/504783784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6d015e660 msgr2=0x7fb6d015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6d4f73640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6d015e660 0x7fb6d015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6d4f73640 1 -- 172.21.15.60:0/504783784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d00c95c0 con 0x7fb6d00d3310 2024-09-12T01:37:29.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6d5f75640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6d015e660 0x7fb6d015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:29.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6d4f73640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6d00d3310 0x7fb6d01f3b80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4035040 tx=0x7fb6c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:29.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6cdffb640 1 -- 172.21.15.60:0/504783784 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4037040 con 0x7fb6d00d3310 2024-09-12T01:37:29.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6cdffb640 1 -- 172.21.15.60:0/504783784 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c4030500 con 0x7fb6d00d3310 2024-09-12T01:37:29.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6d79d8640 1 -- 172.21.15.60:0/504783784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d0161a20 con 0x7fb6d00d3310 2024-09-12T01:37:29.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6cdffb640 1 -- 172.21.15.60:0/504783784 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40308d0 con 0x7fb6d00d3310 2024-09-12T01:37:29.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.746+0000 7fb6d79d8640 1 -- 172.21.15.60:0/504783784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d00c9830 con 0x7fb6d00d3310 2024-09-12T01:37:29.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.747+0000 7fb6d79d8640 1 -- 172.21.15.60:0/504783784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d00d1110 con 0x7fb6d00d3310 2024-09-12T01:37:29.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.748+0000 7fb6cdffb640 1 -- 172.21.15.60:0/504783784 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb6c4044020 con 0x7fb6d00d3310 2024-09-12T01:37:29.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.748+0000 7fb6cdffb640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb6bc06be30 0x7fb6bc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:29.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.748+0000 7fb6cdffb640 1 -- 172.21.15.60:0/504783784 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb6c40ab140 con 0x7fb6d00d3310 2024-09-12T01:37:29.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.748+0000 7fb6d5774640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb6bc06be30 0x7fb6bc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:29.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.749+0000 7fb6d5774640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb6bc06be30 0x7fb6bc06e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80011e0 tx=0x7fb6c8007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:29.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.752+0000 7fb6cdffb640 1 -- 172.21.15.60:0/504783784 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb6c4079a50 con 0x7fb6d00d3310 2024-09-12T01:37:29.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.961+0000 7fb6d79d8640 1 -- 172.21.15.60:0/504783784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6d00b8b70 con 0x7fb6d00d3310 2024-09-12T01:37:29.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.962+0000 7fb6cdffb640 1 -- 172.21.15.60:0/504783784 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7fb6c4079350 con 0x7fb6d00d3310 2024-09-12T01:37:29.962 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:29.962 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":14,"btime":"2024-09-12T01:36:38:945222+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3644892545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3644892545},{"type":"v1","addr":"172.21.15.105:6835","nonce":3644892545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/458109310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458109310},{"type":"v1","addr":"172.21.15.60:6836","nonce":458109310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4741,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1415668038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1415668038},{"type":"v1","addr":"172.21.15.60:6837","nonce":1415668038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:36:36.284771+0000","modified":"2024-09-12T01:36:38.293895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34520":{"gid":34520,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/1200480020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1200480020},{"type":"v1","addr":"172.21.15.105:6834","nonce":1200480020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34520,"qdb_cluster":[34520]},"id":2}]} 2024-09-12T01:37:29.962 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 14 2024-09-12T01:37:29.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.963+0000 7fb6d79d8640 1 -- 172.21.15.60:0/504783784 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb6bc06be30 msgr2=0x7fb6bc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.964+0000 7fb6d79d8640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb6bc06be30 0x7fb6bc06e2f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80011e0 tx=0x7fb6c8007d30 comp rx=0 tx=0).stop 2024-09-12T01:37:29.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.964+0000 7fb6d79d8640 1 -- 172.21.15.60:0/504783784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6d00d3310 msgr2=0x7fb6d01f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:29.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.964+0000 7fb6d79d8640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6d00d3310 0x7fb6d01f3b80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4035040 tx=0x7fb6c40046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.964+0000 7fb6d79d8640 1 -- 172.21.15.60:0/504783784 shutdown_connections 2024-09-12T01:37:29.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.964+0000 7fb6d79d8640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb6d015e660 0x7fb6d015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.964+0000 7fb6d79d8640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6d00d3310 0x7fb6d01f3b80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.964+0000 7fb6d79d8640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb6bc06be30 0x7fb6bc06e2f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.964+0000 7fb6d79d8640 1 --2- 172.21.15.60:0/504783784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb6d00d1650 0x7fb6d01614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.964+0000 7fb6d79d8640 1 -- 172.21.15.60:0/504783784 >> 172.21.15.60:0/504783784 conn(0x7fb6d00b6410 msgr2=0x7fb6d00b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.964+0000 7fb6d79d8640 1 -- 172.21.15.60:0/504783784 shutdown_connections 2024-09-12T01:37:29.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:29.964+0000 7fb6d79d8640 1 -- 172.21.15.60:0/504783784 wait complete. 2024-09-12T01:37:29.975 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-12T01:37:30.093 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":4915,"entity":{"name":{"type":"client","num":4915},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":959229817}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":2,"uptime":42.079142183999998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":8.188849099658194,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.4915 192.168.0.1:0/959229817","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi105","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":4903,"entity":{"name":{"type":"client","num":4903},"addr":{"type":"any","addr":"172.21.15.60:0","nonce":3367638186}},"state":"open","num_leases":1,"num_caps":100,"request_load_avg":90,"uptime":43.174119861999998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":12.799204287448015,"halflife":60},"release_caps":{"value":3.2934288294586969,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":194.79755233057153,"halflife":300},"cap_acquisition":{"value":60.467383533680888,"halflife":30},"last_trim_completed_requests_tid":144,"last_trim_completed_flushes_tid":101,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.4903 172.21.15.60:0/3367638186","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000025c","length":899}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi060","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-12T01:37:30.094 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi105", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 959229817, "type": "any" }, "name": { "num": 4915, "type": "client" } }, "id": 4915, "inst": "client.4915 192.168.0.1:0/959229817", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 8.188849099658194 }, "state": "open", "uptime": 42.079142184 }, { "cap_acquisition": { "halflife": 30, "value": 60.46738353368089 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi060", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.60:0", "nonce": 3367638186, "type": "any" }, "name": { "num": 4903, "type": "client" } }, "id": 4903, "inst": "client.4903 172.21.15.60:0/3367638186", "last_trim_completed_flushes_tid": 101, "last_trim_completed_requests_tid": 144, "num_caps": 100, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 899, "start": "0x1000000025c" } ], "recall_caps": { "halflife": 60, "value": 12.799204287448015 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 3.293428829458697 }, "request_load_avg": 90, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 194.79755233057153 }, "state": "open", "uptime": 43.174119862 } ] 2024-09-12T01:37:30.094 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 dump_historic_ops 2024-09-12T01:37:30.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.198+0000 7fb863152640 1 Processor -- start 2024-09-12T01:37:30.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.198+0000 7fb863152640 1 -- start start 2024-09-12T01:37:30.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb863152640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb85c15e750 0x7fb85c0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb863152640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb85c0cfb70 0x7fb85c0b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb863152640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85c0b6e00 con 0x7fb85c0b69e0 2024-09-12T01:37:30.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb863152640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb85c0d43c0 con 0x7fb85c15e750 2024-09-12T01:37:30.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb863152640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb85c0d33b0 con 0x7fb85c0cfb70 2024-09-12T01:37:30.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb860eee640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb85c15e750 0x7fb85c0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb8616ef640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb85c0b69e0 0x7fb85c06bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37124/0 (socket says 172.21.15.60:37124) 2024-09-12T01:37:30.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb8616ef640 1 -- 172.21.15.60:0/2837077001 learned_addr learned my addr 172.21.15.60:0/2837077001 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:30.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb853fff640 1 --2- 172.21.15.60:0/2837077001 >> v2:172.21.15.105:3300/0 conn(0x7fb85c0cfb70 0x7fb85c0b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb8537fe640 1 -- 172.21.15.60:0/2837077001 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318293994 0 0) 0x7fb85c0b6e00 con 0x7fb85c0b69e0 2024-09-12T01:37:30.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb8537fe640 1 -- 172.21.15.60:0/2837077001 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb844003520 con 0x7fb85c0b69e0 2024-09-12T01:37:30.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb860eee640 1 -- 172.21.15.60:0/2837077001 >> v2:172.21.15.105:3300/0 conn(0x7fb85c0cfb70 msgr2=0x7fb85c0b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:30.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb860eee640 1 --2- 172.21.15.60:0/2837077001 >> v2:172.21.15.105:3300/0 conn(0x7fb85c0cfb70 0x7fb85c0b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb860eee640 1 -- 172.21.15.60:0/2837077001 >> v1:172.21.15.60:6789/0 conn(0x7fb85c0b69e0 legacy=0x7fb85c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.199+0000 7fb860eee640 1 -- 172.21.15.60:0/2837077001 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c0b7790 con 0x7fb85c15e750 2024-09-12T01:37:30.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.200+0000 7fb860eee640 1 --2- 172.21.15.60:0/2837077001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85c15e750 0x7fb85c0cf630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb85c162220 tx=0x7fb85802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4707d7c18be764d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:30.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.200+0000 7fb8537fe640 1 -- 172.21.15.60:0/2837077001 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858037070 con 0x7fb85c15e750 2024-09-12T01:37:30.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.200+0000 7fb8537fe640 1 -- 172.21.15.60:0/2837077001 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb858032440 con 0x7fb85c15e750 2024-09-12T01:37:30.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.200+0000 7fb8537fe640 1 -- 172.21.15.60:0/2837077001 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8580327f0 con 0x7fb85c15e750 2024-09-12T01:37:30.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.201+0000 7fb863152640 1 -- 172.21.15.60:0/2837077001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85c15e750 msgr2=0x7fb85c0cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.201+0000 7fb863152640 1 --2- 172.21.15.60:0/2837077001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85c15e750 0x7fb85c0cf630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb85c162220 tx=0x7fb85802a1a0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.201+0000 7fb863152640 1 -- 172.21.15.60:0/2837077001 shutdown_connections 2024-09-12T01:37:30.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.201+0000 7fb863152640 1 --2- 172.21.15.60:0/2837077001 >> v2:172.21.15.105:3300/0 conn(0x7fb85c0cfb70 0x7fb85c0b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.201+0000 7fb863152640 1 --2- 172.21.15.60:0/2837077001 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85c15e750 0x7fb85c0cf630 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.201+0000 7fb863152640 1 -- 172.21.15.60:0/2837077001 >> 172.21.15.60:0/2837077001 conn(0x7fb85c0d1500 msgr2=0x7fb85c0d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:30.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.201+0000 7fb863152640 1 -- 172.21.15.60:0/2837077001 shutdown_connections 2024-09-12T01:37:30.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.201+0000 7fb863152640 1 -- 172.21.15.60:0/2837077001 wait complete. 2024-09-12T01:37:30.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.202+0000 7fb863152640 1 Processor -- start 2024-09-12T01:37:30.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.202+0000 7fb863152640 1 -- start start 2024-09-12T01:37:30.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb863152640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85c0b69e0 0x7fb85c0abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb863152640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c0cfb70 0x7fb85c0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb863152640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb85c15e750 0x7fb85c0b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb863152640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c0d38e0 con 0x7fb85c0b69e0 2024-09-12T01:37:30.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb863152640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c0b7ac0 con 0x7fb85c0cfb70 2024-09-12T01:37:30.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb863152640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb85c0d3bc0 con 0x7fb85c15e750 2024-09-12T01:37:30.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb860eee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85c0b69e0 0x7fb85c0abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb860eee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85c0b69e0 0x7fb85c0abcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34686/0 (socket says 172.21.15.60:34686) 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb860eee640 1 -- 172.21.15.60:0/2503767598 learned_addr learned my addr 172.21.15.60:0/2503767598 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb853fff640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c0cfb70 0x7fb85c0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb8616ef640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb85c15e750 0x7fb85c0b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb860eee640 1 -- 172.21.15.60:0/2503767598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb85c15e750 msgr2=0x7fb85c0b2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb860eee640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb85c15e750 0x7fb85c0b2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb860eee640 1 -- 172.21.15.60:0/2503767598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c0cfb70 msgr2=0x7fb85c0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb860eee640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c0cfb70 0x7fb85c0b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb860eee640 1 -- 172.21.15.60:0/2503767598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c0b33f0 con 0x7fb85c0b69e0 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.203+0000 7fb8616ef640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb85c15e750 0x7fb85c0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.204+0000 7fb860eee640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85c0b69e0 0x7fb85c0abcb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb85802a1e0 tx=0x7fb8580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.204+0000 7fb8517fa640 1 -- 172.21.15.60:0/2503767598 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858041030 con 0x7fb85c0b69e0 2024-09-12T01:37:30.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.204+0000 7fb8517fa640 1 -- 172.21.15.60:0/2503767598 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb85803d420 con 0x7fb85c0b69e0 2024-09-12T01:37:30.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.204+0000 7fb863152640 1 -- 172.21.15.60:0/2503767598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85c0b1e10 con 0x7fb85c0b69e0 2024-09-12T01:37:30.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.204+0000 7fb8517fa640 1 -- 172.21.15.60:0/2503767598 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858037040 con 0x7fb85c0b69e0 2024-09-12T01:37:30.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.204+0000 7fb863152640 1 -- 172.21.15.60:0/2503767598 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85c0b23d0 con 0x7fb85c0b69e0 2024-09-12T01:37:30.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.205+0000 7fb8517fa640 1 -- 172.21.15.60:0/2503767598 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb858044070 con 0x7fb85c0b69e0 2024-09-12T01:37:30.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.206+0000 7fb8517fa640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb84806be30 0x7fb84806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.206+0000 7fb8517fa640 1 -- 172.21.15.60:0/2503767598 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb8580ab540 con 0x7fb85c0b69e0 2024-09-12T01:37:30.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.206+0000 7fb853fff640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb84806be30 0x7fb84806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.206+0000 7fb853fff640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb84806be30 0x7fb84806e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb85c1f7610 tx=0x7fb84c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:30.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.207+0000 7fb865fcc740 1 Processor -- start 2024-09-12T01:37:30.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.207+0000 7fb865fcc740 1 -- start start 2024-09-12T01:37:30.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.207+0000 7fb865fcc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafd0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.207+0000 7fb865fcc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf88d00 0x5603daf8b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb865fcc740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 0x5603daf85ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb865fcc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5603daeee5e0 con 0x5603daf88d00 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb865fcc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5603dae96400 con 0x5603daf8b540 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb865fcc740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5603daeea5a0 con 0x5603daf8ccd0 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb853fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf88d00 0x5603daf8b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb853fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf88d00 0x5603daf8b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34694/0 (socket says 172.21.15.60:34694) 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb853fff640 1 -- 172.21.15.60:0/3408525259 learned_addr learned my addr 172.21.15.60:0/3408525259 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb860eee640 1 --2- 172.21.15.60:0/3408525259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafd0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb8616ef640 1 --2- 172.21.15.60:0/3408525259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 0x5603daf85ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb853fff640 1 -- 172.21.15.60:0/3408525259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 msgr2=0x5603daf85ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb853fff640 1 --2- 172.21.15.60:0/3408525259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 0x5603daf85ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb853fff640 1 -- 172.21.15.60:0/3408525259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 msgr2=0x5603dafd0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb853fff640 1 --2- 172.21.15.60:0/3408525259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafd0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb853fff640 1 -- 172.21.15.60:0/3408525259 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603daebbe90 con 0x5603daf88d00 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb860eee640 1 --2- 172.21.15.60:0/3408525259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafd0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb853fff640 1 --2- 172.21.15.60:0/3408525259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf88d00 0x5603daf8b920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb84c011ea0 tx=0x7fb84c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da84aedd0fe24ee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb8427fc640 1 -- 172.21.15.60:0/3408525259 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c01b070 con 0x5603daf88d00 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb8427fc640 1 -- 172.21.15.60:0/3408525259 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c027070 con 0x5603daf88d00 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.208+0000 7fb8427fc640 1 -- 172.21.15.60:0/3408525259 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c003a40 con 0x5603daf88d00 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.209+0000 7fb865fcc740 1 -- 172.21.15.60:0/3408525259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf88d00 msgr2=0x5603daf8b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.209+0000 7fb865fcc740 1 --2- 172.21.15.60:0/3408525259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf88d00 0x5603daf8b920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb84c011ea0 tx=0x7fb84c014000 comp rx=0 tx=0).stop 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.209+0000 7fb865fcc740 1 -- 172.21.15.60:0/3408525259 shutdown_connections 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.209+0000 7fb865fcc740 1 --2- 172.21.15.60:0/3408525259 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 0x5603daf85ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.209+0000 7fb865fcc740 1 --2- 172.21.15.60:0/3408525259 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf88d00 0x5603daf8b920 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.209+0000 7fb865fcc740 1 --2- 172.21.15.60:0/3408525259 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafd0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.209+0000 7fb865fcc740 1 -- 172.21.15.60:0/3408525259 >> 172.21.15.60:0/3408525259 conn(0x5603daf87d00 msgr2=0x5603dafd01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:30.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.209+0000 7fb865fcc740 1 -- 172.21.15.60:0/3408525259 shutdown_connections 2024-09-12T01:37:30.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.209+0000 7fb865fcc740 1 -- 172.21.15.60:0/3408525259 wait complete. 2024-09-12T01:37:30.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.210+0000 7fb865fcc740 1 -- start start 2024-09-12T01:37:30.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.210+0000 7fb865fcc740 1 Processor -- start 2024-09-12T01:37:30.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb865fcc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8b540 0x5603dafb3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb865fcc740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 0x5603dafe0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb865fcc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603dafacac0 0x5603dafb41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb865fcc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5603daf87150 con 0x5603daf8b540 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb865fcc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5603dae77350 con 0x5603dafacac0 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb865fcc740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5603dafd1510 con 0x5603daf8ccd0 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb865fcc740 10 client.0 _ll_register_callbacks cb 0x5603dae9b3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb860eee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8b540 0x5603dafb3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb860eee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8b540 0x5603dafb3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34706/0 (socket says 172.21.15.60:34706) 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb860eee640 1 -- 172.21.15.60:0/579365561 learned_addr learned my addr 172.21.15.60:0/579365561 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb853fff640 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 0x5603dafe0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb8616ef640 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603dafacac0 0x5603dafb41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb860eee640 1 -- 172.21.15.60:0/579365561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 msgr2=0x5603dafe0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb860eee640 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 0x5603dafe0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb860eee640 1 -- 172.21.15.60:0/579365561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603dafacac0 msgr2=0x5603dafb41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb860eee640 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603dafacac0 0x5603dafb41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb860eee640 1 -- 172.21.15.60:0/579365561 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603dac013f0 con 0x5603daf8b540 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb860eee640 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8b540 0x5603dafb3a50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb8580796f0 tx=0x7fb858079e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78bcc93d81c4c5e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb83b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb83b7fe640 1 -- 172.21.15.60:0/579365561 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85807db10 con 0x5603daf8b540 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb83b7fe640 1 -- 172.21.15.60:0/579365561 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb858081eb0 con 0x5603daf8b540 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.211+0000 7fb865fcc740 1 -- 172.21.15.60:0/579365561 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb84c027070 con 0x5603daf8b540 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb83b7fe640 1 -- 172.21.15.60:0/579365561 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fb858082340 con 0x5603daf8b540 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb865fcc740 10 client.5073 fetch_fsmap learned FSMap version 14 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb865fcc740 1 -- 172.21.15.60:0/579365561 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5603dacc9760 con 0x5603daf8b540 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb83b7fe640 1 -- 172.21.15.60:0/579365561 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c027070 con 0x5603daf8b540 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb83b7fe640 1 -- 172.21.15.60:0/579365561 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fb85804e060 con 0x5603daf8b540 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb865fcc740 10 client.5073 fetch_fsmap finished waiting for FSMap version 14 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb865fcc740 10 client.5073 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb865fcc740 20 client.5073 populate_metadata read hostname 'smithi060' 2024-09-12T01:37:30.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb865fcc740 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x5603dafb4720 0x5603dafaf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb865fcc740 4 client.5073 mds_command: new command op to 34520 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb865fcc740 1 -- 172.21.15.60:0/579365561 --> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603daefbd10 con 0x5603dafb4720 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb853fff640 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x5603dafb4720 0x5603dafaf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb83b7fe640 10 client.5073 ms_handle_connect on v2:172.21.15.105:6832/1200480020 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.212+0000 7fb853fff640 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x5603dafb4720 0x5603dafaf4c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e866851a23c28809 server_cookie=aaa7b68d26e7a7ff in_seq=0 out_seq=0 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.213+0000 7fb83b7fe640 1 -- 172.21.15.60:0/579365561 <== mds.0 v2:172.21.15.105:6832/1200480020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603daefbd10 con 0x5603dafb4720 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.213+0000 7fb83b7fe640 10 client.5073 handle_command_reply: tid=0 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.213+0000 7fb865fcc740 1 client.5073 shutdown 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.213+0000 7fb865fcc740 1 -- 172.21.15.60:0/579365561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8b540 msgr2=0x5603dafb3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.213+0000 7fb865fcc740 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8b540 0x5603dafb3a50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb8580796f0 tx=0x7fb858079e60 comp rx=0 tx=0).stop 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.214+0000 7fb865fcc740 1 -- 172.21.15.60:0/579365561 shutdown_connections 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.214+0000 7fb865fcc740 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x5603dafb4720 0x5603dafaf4c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.214+0000 7fb865fcc740 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603dafacac0 0x5603dafb41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.214+0000 7fb865fcc740 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 0x5603dafe0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.214+0000 7fb865fcc740 1 --2- 172.21.15.60:0/579365561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8b540 0x5603dafb3a50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.214+0000 7fb83b7fe640 0 client.5073 ms_handle_reset on v2:172.21.15.105:6832/1200480020 2024-09-12T01:37:30.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.214+0000 7fb865fcc740 1 -- 172.21.15.60:0/579365561 >> 172.21.15.60:0/579365561 conn(0x5603daf88d00 msgr2=0x5603dafcf950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:30.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.214+0000 7fb865fcc740 1 -- 172.21.15.60:0/579365561 shutdown_connections 2024-09-12T01:37:30.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.214+0000 7fb865fcc740 1 -- 172.21.15.60:0/579365561 wait complete. 2024-09-12T01:37:30.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.214+0000 7fb865fcc740 20 client.5073 trim_cache size 0 max 16384 2024-09-12T01:37:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.228+0000 7fb865fcc740 1 Processor -- start 2024-09-12T01:37:30.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.228+0000 7fb865fcc740 1 -- start start 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb865fcc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb865fcc740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 0x5603dafd33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb865fcc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dafacac0 0x5603dafd3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb865fcc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c200920 con 0x5603dafacac0 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb865fcc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c1ffa40 con 0x5603daf8b540 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb865fcc740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb85c1f7940 con 0x5603daf8ccd0 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb8616ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dafacac0 0x5603dafd3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb8616ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dafacac0 0x5603dafd3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34710/0 (socket says 172.21.15.60:34710) 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb8616ef640 1 -- 172.21.15.60:0/1358295982 learned_addr learned my addr 172.21.15.60:0/1358295982 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb860eee640 1 --2- 172.21.15.60:0/1358295982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb853fff640 1 --2- 172.21.15.60:0/1358295982 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 0x5603dafd33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb8616ef640 1 -- 172.21.15.60:0/1358295982 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 msgr2=0x5603dafd33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:30.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb8616ef640 1 --2- 172.21.15.60:0/1358295982 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 0x5603dafd33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb8616ef640 1 -- 172.21.15.60:0/1358295982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 msgr2=0x5603dafce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb8616ef640 1 --2- 172.21.15.60:0/1358295982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb8616ef640 1 -- 172.21.15.60:0/1358295982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603daefae50 con 0x5603dafacac0 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb8616ef640 1 --2- 172.21.15.60:0/1358295982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dafacac0 0x5603dafd3920 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb8540020b0 tx=0x7fb8540021a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5227eb9cad1c8b9b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.229+0000 7fb841ffb640 1 -- 172.21.15.60:0/1358295982 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85401a020 con 0x5603dafacac0 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.230+0000 7fb841ffb640 1 -- 172.21.15.60:0/1358295982 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb854007810 con 0x5603dafacac0 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.230+0000 7fb841ffb640 1 -- 172.21.15.60:0/1358295982 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854016450 con 0x5603dafacac0 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.230+0000 7fb865fcc740 1 -- 172.21.15.60:0/1358295982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dafacac0 msgr2=0x5603dafd3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.230+0000 7fb865fcc740 1 --2- 172.21.15.60:0/1358295982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dafacac0 0x5603dafd3920 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb8540020b0 tx=0x7fb8540021a0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.230+0000 7fb865fcc740 1 -- 172.21.15.60:0/1358295982 shutdown_connections 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.230+0000 7fb865fcc740 1 --2- 172.21.15.60:0/1358295982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dafacac0 0x5603dafd3920 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.230+0000 7fb865fcc740 1 --2- 172.21.15.60:0/1358295982 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603daf8ccd0 0x5603dafd33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.230+0000 7fb865fcc740 1 --2- 172.21.15.60:0/1358295982 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.230+0000 7fb865fcc740 1 -- 172.21.15.60:0/1358295982 >> 172.21.15.60:0/1358295982 conn(0x5603daf88d00 msgr2=0x5603dafcf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:30.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.230+0000 7fb865fcc740 1 -- 172.21.15.60:0/1358295982 shutdown_connections 2024-09-12T01:37:30.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.230+0000 7fb865fcc740 1 -- 172.21.15.60:0/1358295982 wait complete. 2024-09-12T01:37:30.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.231+0000 7fb865fcc740 1 -- start start 2024-09-12T01:37:30.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.231+0000 7fb865fcc740 1 Processor -- start 2024-09-12T01:37:30.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb865fcc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafaee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb865fcc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8ccd0 0x5603db033a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb865fcc740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603dafacac0 0x5603dafb4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb865fcc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5603dafb4570 con 0x5603daf8ccd0 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb865fcc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c1f7f90 con 0x5603daf8b540 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb865fcc740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5603daf80630 con 0x5603dafacac0 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb865fcc740 10 client.0 _ll_register_callbacks cb 0x7fb8580792a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb853fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8ccd0 0x5603db033a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb853fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8ccd0 0x5603db033a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34726/0 (socket says 172.21.15.60:34726) 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb853fff640 1 -- 172.21.15.60:0/1831062803 learned_addr learned my addr 172.21.15.60:0/1831062803 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb860eee640 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafaee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb8616ef640 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603dafacac0 0x5603dafb4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb853fff640 1 -- 172.21.15.60:0/1831062803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603dafacac0 msgr2=0x5603dafb4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb853fff640 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603dafacac0 0x5603dafb4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb853fff640 1 -- 172.21.15.60:0/1831062803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 msgr2=0x5603dafaee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb853fff640 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafaee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb853fff640 1 -- 172.21.15.60:0/1831062803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603dafcfba0 con 0x5603daf8ccd0 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb853fff640 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8ccd0 0x5603db033a50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0096a0 tx=0x7fb84c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a114b2be27759757 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb83b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.232+0000 7fb83b7fe640 1 -- 172.21.15.60:0/1831062803 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c01b040 con 0x5603daf8ccd0 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb83b7fe640 1 -- 172.21.15.60:0/1831062803 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb84c003cb0 con 0x5603daf8ccd0 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb865fcc740 1 -- 172.21.15.60:0/1831062803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb854007810 con 0x5603daf8ccd0 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb83b7fe640 1 -- 172.21.15.60:0/1831062803 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fb84c022470 con 0x5603daf8ccd0 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb865fcc740 10 client.5079 fetch_fsmap learned FSMap version 14 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb865fcc740 1 -- 172.21.15.60:0/1831062803 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5603db033f90 con 0x5603daf8ccd0 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb83b7fe640 1 -- 172.21.15.60:0/1831062803 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb854007810 con 0x5603daf8ccd0 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb83b7fe640 1 -- 172.21.15.60:0/1831062803 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7fb84c022610 con 0x5603daf8ccd0 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb865fcc740 10 client.5079 fetch_fsmap finished waiting for FSMap version 14 2024-09-12T01:37:30.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb865fcc740 10 client.5079 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.b 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb865fcc740 20 client.5079 populate_metadata read hostname 'smithi060' 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb865fcc740 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x5603dafb54e0 0x5603dafb0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb865fcc740 4 client.5079 mds_command: new command op to 34520 tid=0 multi_id=0 [{"prefix": "dump_historic_ops"}] 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb865fcc740 1 -- 172.21.15.60:0/1831062803 --> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] -- command(tid 0: {"prefix": "dump_historic_ops"}) -- 0x5603daef6060 con 0x5603dafb54e0 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.233+0000 7fb860eee640 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x5603dafb54e0 0x5603dafb0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.234+0000 7fb860eee640 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x5603dafb54e0 0x5603dafb0fc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a83a413cf03bcc62 server_cookie=f96cd808cc06df96 in_seq=0 out_seq=0 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.234+0000 7fb83b7fe640 10 client.5079 ms_handle_connect on v2:172.21.15.105:6832/1200480020 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb83b7fe640 1 -- 172.21.15.60:0/1831062803 <== mds.0 v2:172.21.15.105:6832/1200480020 1 ==== command_reply(tid 0: 0 ) ==== 8+0+71232 (crc 0 0 0) 0x5603daef6060 con 0x5603dafb54e0 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb83b7fe640 10 client.5079 handle_command_reply: tid=0 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb865fcc740 1 client.5079 shutdown 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb865fcc740 1 -- 172.21.15.60:0/1831062803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8ccd0 msgr2=0x5603db033a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb865fcc740 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8ccd0 0x5603db033a50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0096a0 tx=0x7fb84c004730 comp rx=0 tx=0).stop 2024-09-12T01:37:30.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb865fcc740 1 -- 172.21.15.60:0/1831062803 shutdown_connections 2024-09-12T01:37:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb865fcc740 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5603dafacac0 0x5603dafb4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb865fcc740 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603daf8ccd0 0x5603db033a50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb865fcc740 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.105:6832/1200480020,v1:172.21.15.105:6834/1200480020] conn(0x5603dafb54e0 0x5603dafb0fc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb865fcc740 1 --2- 172.21.15.60:0/1831062803 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5603daf8b540 0x5603dafaee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb83b7fe640 0 client.5079 ms_handle_reset on v2:172.21.15.105:6832/1200480020 2024-09-12T01:37:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb865fcc740 1 -- 172.21.15.60:0/1831062803 >> 172.21.15.60:0/1831062803 conn(0x5603daf88d00 msgr2=0x5603dafb01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb865fcc740 1 -- 172.21.15.60:0/1831062803 shutdown_connections 2024-09-12T01:37:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb865fcc740 1 -- 172.21.15.60:0/1831062803 wait complete. 2024-09-12T01:37:30.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.235+0000 7fb865fcc740 20 client.5079 trim_cache size 0 max 16384 2024-09-12T01:37:30.241 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:37:30.241 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 20, 2024-09-12T01:37:30.241 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 600, 2024-09-12T01:37:30.241 INFO:teuthology.orchestra.run.smithi060.stdout: "ops": [ 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:2 setattr mode=041777 #0x1 2024-09-12T01:36:46.941987+0000 caller_uid=0, caller_gid=0{0,})", 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:46.943544+0000", 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 43.292054276000002, 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 1.0653480870000001, 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.242 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 2 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:46.943544+0000", 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:46.943544+0000", 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.243 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:46.943546+0000", 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:46.943559+0000", 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:46.943650+0000", 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.244 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:46.943960+0000", 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:46.944077+0000", 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:46.944078+0000", 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.008766+0000", 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.245 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.008801+0000", 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.008875+0000", 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.008892+0000", 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.246 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.008893+0000", 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:27 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_0 2024-09-12T01:36:48.907965+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:48.909455+0000", 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.326143770999998, 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.005576447, 2024-09-12T01:37:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 27 2024-09-12T01:37:30.248 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.909455+0000", 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.909455+0000", 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.909455+0000", 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.249 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.909462+0000", 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.909479+0000", 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.909656+0000", 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.250 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.909935+0000", 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.909935+0000", 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.914721+0000", 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.914863+0000", 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.914946+0000", 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.915030+0000", 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.915031+0000", 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.252 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:29 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_2 2024-09-12T01:36:48.918965+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:48.919747+0000", 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.315851850000001, 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0055062260000000003, 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.253 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 29 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.919747+0000", 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.254 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.919747+0000", 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.919747+0000", 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.919752+0000", 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.919772+0000", 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.255 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.920031+0000", 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.920330+0000", 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.920330+0000", 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.256 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.924948+0000", 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.925082+0000", 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.925167+0000", 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.925252+0000", 2024-09-12T01:37:30.257 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.258 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.925253+0000", 2024-09-12T01:37:30.258 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.258 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.258 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.258 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.258 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.258 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.258 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.258 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:36 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_9 2024-09-12T01:36:48.950964+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.258 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:48.952174+0000", 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.283424611999997, 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053107980000000003, 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 36 2024-09-12T01:37:30.259 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.952174+0000", 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.952174+0000", 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.952175+0000", 2024-09-12T01:37:30.260 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.952178+0000", 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.952200+0000", 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.952592+0000", 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.261 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.953120+0000", 2024-09-12T01:37:30.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.953121+0000", 2024-09-12T01:37:30.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.262 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.957168+0000", 2024-09-12T01:37:30.262 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.262 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.262 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.957294+0000", 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.957379+0000", 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.957484+0000", 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.957485+0000", 2024-09-12T01:37:30.263 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:41 create owner_uid=1000, owner_gid=1333 #0x10000000000/file_14 2024-09-12T01:36:48.973964+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:48.975257+0000", 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 41.260342049000002, 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052128260000000003, 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.264 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 41 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.975257+0000", 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.975257+0000", 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.975257+0000", 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.975262+0000", 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.266 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.975284+0000", 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.975582+0000", 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.976101+0000", 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.976102+0000", 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.267 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.979941+0000", 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.980167+0000", 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.980337+0000", 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.268 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.980468+0000", 2024-09-12T01:37:30.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.269 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.269 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:48.980470+0000", 2024-09-12T01:37:30.269 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.269 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.269 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.269 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.269 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.269 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.272 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.272 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:65 create owner_uid=1000, owner_gid=1333 #0x1000000020e/file_10 2024-09-12T01:36:49.248961+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.272 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.250390+0000", 2024-09-12T01:37:30.272 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.985208841999999, 2024-09-12T01:37:30.272 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0064959149999999997, 2024-09-12T01:37:30.272 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.272 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 65 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.250390+0000", 2024-09-12T01:37:30.273 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.250390+0000", 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.250390+0000", 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.250395+0000", 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.274 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.250417+0000", 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.250701+0000", 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.251013+0000", 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.275 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.251014+0000", 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.256563+0000", 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.256690+0000", 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.256786+0000", 2024-09-12T01:37:30.276 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.256884+0000", 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.256886+0000", 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.277 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:66 create owner_uid=1000, owner_gid=1333 #0x1000000020e/file_11 2024-09-12T01:36:49.255961+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.256912+0000", 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.978686527999997, 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.009809824, 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 66 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.256912+0000", 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.256912+0000", 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.256913+0000", 2024-09-12T01:37:30.279 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.256920+0000", 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.256960+0000", 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.257212+0000", 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.280 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.257531+0000", 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.257531+0000", 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.266412+0000", 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.281 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.266538+0000", 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.266621+0000", 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.266721+0000", 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.266722+0000", 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.282 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:70 create owner_uid=1000, owner_gid=1333 #0x1000000020e/file_15 2024-09-12T01:36:49.278961+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.280041+0000", 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.955557808999998, 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0065234830000000001, 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.283 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 70 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.280041+0000", 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.284 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.280041+0000", 2024-09-12T01:37:30.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.280041+0000", 2024-09-12T01:37:30.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.285 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.280045+0000", 2024-09-12T01:37:30.285 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.285 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.280067+0000", 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.280350+0000", 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.280662+0000", 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.280662+0000", 2024-09-12T01:37:30.286 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.286249+0000", 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.286379+0000", 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.286466+0000", 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.287 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.286563+0000", 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.286564+0000", 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.288 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:73 create owner_uid=1000, owner_gid=1333 #0x1000000020e/file_18 2024-09-12T01:36:49.293961+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.294674+0000", 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.940924611, 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0056397799999999996, 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.289 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 73 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.294674+0000", 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.294674+0000", 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.290 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.294674+0000", 2024-09-12T01:37:30.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.294678+0000", 2024-09-12T01:37:30.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.291 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.294698+0000", 2024-09-12T01:37:30.291 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.291 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.291 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.294895+0000", 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.295220+0000", 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.295221+0000", 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300004+0000", 2024-09-12T01:37:30.292 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300128+0000", 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300211+0000", 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300313+0000", 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300314+0000", 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:74 create owner_uid=1000, owner_gid=1333 #0x1000000020e/file_19 2024-09-12T01:36:49.298960+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.300336+0000", 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.935262751000003, 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0056114390000000002, 2024-09-12T01:37:30.294 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 74 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.295 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300336+0000", 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300336+0000", 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300336+0000", 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.296 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300340+0000", 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300359+0000", 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300642+0000", 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300964+0000", 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.297 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.300965+0000", 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.305621+0000", 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.305750+0000", 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.298 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.305844+0000", 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.305946+0000", 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.305947+0000", 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.299 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:82 mkdir owner_uid=1000, owner_gid=1333 #0x1/dir3 2024-09-12T01:36:49.507958+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.509184+0000", 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.726415060000001, 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.006462415, 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.300 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 82 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.509184+0000", 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.509184+0000", 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.509184+0000", 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.509187+0000", 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.509200+0000", 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.302 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.509401+0000", 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "failed to wrlock, waiting" 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.509709+0000", 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.509985+0000", 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.509985+0000", 2024-09-12T01:37:30.303 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.515436+0000", 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.515540+0000", 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.515614+0000", 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.304 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.515646+0000", 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.515646+0000", 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:83 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_0 2024-09-12T01:36:49.508958+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.510325+0000", 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.725273952999999, 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0056019879999999996, 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 83 2024-09-12T01:37:30.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.510325+0000", 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.510325+0000", 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.510325+0000", 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.510328+0000", 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.510344+0000", 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.510505+0000", 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.510793+0000", 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.510794+0000", 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.515648+0000", 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.309 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.515760+0000", 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.515837+0000", 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.515925+0000", 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.515927+0000", 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.310 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:85 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_2 2024-09-12T01:36:49.519958+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.520811+0000", 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.714787588999997, 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0059957839999999997, 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.311 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 85 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.520811+0000", 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.312 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.520811+0000", 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.520812+0000", 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.520815+0000", 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.520835+0000", 2024-09-12T01:37:30.313 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.521096+0000", 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.521402+0000", 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.521403+0000", 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.314 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.526504+0000", 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.526635+0000", 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.526715+0000", 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.315 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.526806+0000", 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.526807+0000", 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:88 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_5 2024-09-12T01:36:49.533958+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.316 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.534531+0000", 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.701067889999997, 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0056426569999999997, 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 88 2024-09-12T01:37:30.317 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.534531+0000", 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.534531+0000", 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.534531+0000", 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.318 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.534535+0000", 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.534552+0000", 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.534812+0000", 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.319 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.535139+0000", 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.535140+0000", 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.539866+0000", 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.539998+0000", 2024-09-12T01:37:30.320 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.540082+0000", 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.540172+0000", 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.540173+0000", 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.321 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:96 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_13 2024-09-12T01:36:49.566957+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.567804+0000", 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.667794385999997, 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0053791660000000003, 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.322 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 96 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.567804+0000", 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.323 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.567804+0000", 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.567805+0000", 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.567810+0000", 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.324 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.567827+0000", 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.568154+0000", 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.568467+0000", 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.568468+0000", 2024-09-12T01:37:30.325 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.572845+0000", 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.572993+0000", 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.573077+0000", 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.326 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.573182+0000", 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.573184+0000", 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.327 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:99 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_16 2024-09-12T01:36:49.579957+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.328 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.580931+0000", 2024-09-12T01:37:30.328 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.654667752000002, 2024-09-12T01:37:30.328 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0054204650000000002, 2024-09-12T01:37:30.328 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.328 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.328 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.328 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.328 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.328 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.328 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.328 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.328 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 99 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.580931+0000", 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.580931+0000", 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.329 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.580931+0000", 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.580936+0000", 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.580956+0000", 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.581271+0000", 2024-09-12T01:37:30.330 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.581595+0000", 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.581596+0000", 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.586038+0000", 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.331 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.586170+0000", 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.586254+0000", 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.586351+0000", 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.586351+0000", 2024-09-12T01:37:30.332 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:100 create owner_uid=1000, owner_gid=1333 #0x10000000228/file_17 2024-09-12T01:36:49.585957+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.586542+0000", 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.649056649000002, 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0052931189999999998, 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.333 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 100 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.586542+0000", 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.334 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.586542+0000", 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.586543+0000", 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.586547+0000", 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.335 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.586565+0000", 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.586736+0000", 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.587050+0000", 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.336 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.587051+0000", 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.591501+0000", 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.591636+0000", 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.591730+0000", 2024-09-12T01:37:30.337 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.591834+0000", 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.591835+0000", 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.338 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:131 create owner_uid=1000, owner_gid=1333 #0x10000000242/file_20 2024-09-12T01:36:49.886954+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:49.887814+0000", 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.347784300999997, 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 0.0056762339999999996, 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.339 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 131 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.887814+0000", 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.887814+0000", 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.340 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.887815+0000", 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.887818+0000", 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.887836+0000", 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.888090+0000", 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.888495+0000", 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "early_replied" 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.888496+0000", 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "submit entry: journal_and_reply" 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.893026+0000", 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "journal_committed: " 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.342 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.893216+0000", 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.893341+0000", 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.893489+0000", 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:49.893491+0000", 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.343 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:143 readdir #0x10000000242 2024-09-12T01:36:50.137951+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:36:50.138683+0000", 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 40.096915469999999, 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 16.506010855, 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.344 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 143 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:50.138683+0000", 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.345 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:50.138683+0000", 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:50.138684+0000", 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:50.138687+0000", 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.346 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:50.138701+0000", 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:50.138775+0000", 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:50.638901+0000", 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:51.139064+0000", 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.347 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:51.639232+0000", 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:52.139362+0000", 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:52.639536+0000", 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.348 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:53.139664+0000", 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:53.639829+0000", 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:54.139969+0000", 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.349 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:54.640140+0000", 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:55.140300+0000", 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:55.640488+0000", 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:56.140646+0000", 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:56.640814+0000", 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:57.140980+0000", 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:57.641111+0000", 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.351 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:58.141288+0000", 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:58.641391+0000", 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:59.141546+0000", 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.352 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:36:59.641753+0000", 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:00.141932+0000", 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:00.642052+0000", 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:01.142224+0000", 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.353 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:01.642395+0000", 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:02.142574+0000", 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:02.642697+0000", 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:03.142872+0000", 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:03.643041+0000", 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:04.143198+0000", 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:04.643321+0000", 2024-09-12T01:37:30.355 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:05.143483+0000", 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:05.643643+0000", 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:06.143803+0000", 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:06.644066+0000", 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:06.644523+0000", 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:06.644567+0000", 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:06.644693+0000", 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:06.644694+0000", 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.358 INFO:teuthology.orchestra.run.smithi060.stdout: "description": "client_request(client.4903:144 readdir #0x10000000228 2024-09-12T01:37:06.643764+0000 caller_uid=1000, caller_gid=1333{6,36,1000,1333,})", 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: "initiated_at": "2024-09-12T01:37:06.645108+0000", 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: "age": 23.590490867, 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 22.507982554000002, 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: "continuous": false, 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: "type_data": { 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: "result": 0, 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: "flag_point": "done", 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: "reqid": { 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": { 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "client", 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: "num": 4903 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: "tid": 144 2024-09-12T01:37:30.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: "op_type": "client_request", 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: "events": [ 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:06.645108+0000", 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "initiated" 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:06.645108+0000", 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "header_read" 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:06.645108+0000", 2024-09-12T01:37:30.360 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "throttled" 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:06.645112+0000", 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "all_read" 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:06.645216+0000", 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "dispatched" 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:06.645322+0000", 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:07.145457+0000", 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:07.645635+0000", 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:08.145791+0000", 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.362 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:08.645963+0000", 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:09.146164+0000", 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:09.646286+0000", 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:10.146445+0000", 2024-09-12T01:37:30.363 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:10.646627+0000", 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:11.146794+0000", 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:11.646976+0000", 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:12.147089+0000", 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:12.647214+0000", 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:13.147375+0000", 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:13.647504+0000", 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:14.147619+0000", 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:14.647812+0000", 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.366 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:15.147972+0000", 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:15.648081+0000", 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:16.148212+0000", 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:16.648374+0000", 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.367 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:17.148516+0000", 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:17.648665+0000", 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:18.148837+0000", 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.368 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:18.648958+0000", 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:19.149093+0000", 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:19.649268+0000", 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:20.149356+0000", 2024-09-12T01:37:30.369 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:20.649503+0000", 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:21.149688+0000", 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:21.649817+0000", 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.370 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:22.149988+0000", 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:22.650152+0000", 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:23.150326+0000", 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:23.650491+0000", 2024-09-12T01:37:30.371 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:24.150644+0000", 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:24.650813+0000", 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:25.150930+0000", 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.372 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:25.651097+0000", 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:26.151239+0000", 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:26.651409+0000", 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:27.151587+0000", 2024-09-12T01:37:30.373 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:27.651756+0000", 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:28.151944+0000", 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:28.652105+0000", 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cap_acquisition_throttle" 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:29.152417+0000", 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "acquired locks" 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:29.152924+0000", 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "replying" 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:29.152973+0000", 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "finishing request" 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:29.153089+0000", 2024-09-12T01:37:30.375 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "cleaned up request" 2024-09-12T01:37:30.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:30.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:30.376 INFO:teuthology.orchestra.run.smithi060.stdout: "time": "2024-09-12T01:37:29.153090+0000", 2024-09-12T01:37:30.376 INFO:teuthology.orchestra.run.smithi060.stdout: "event": "done" 2024-09-12T01:37:30.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.376 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2024-09-12T01:37:30.376 INFO:teuthology.orchestra.run.smithi060.stdout: "locks": null 2024-09-12T01:37:30.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.376 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:30.376 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T01:37:30.376 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:37:30.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.236+0000 7fb863152640 1 -- 172.21.15.60:0/2503767598 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb84806be30 msgr2=0x7fb84806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.236+0000 7fb863152640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb84806be30 0x7fb84806e2f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb85c1f7610 tx=0x7fb84c009190 comp rx=0 tx=0).stop 2024-09-12T01:37:30.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.236+0000 7fb863152640 1 -- 172.21.15.60:0/2503767598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85c0b69e0 msgr2=0x7fb85c0abcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.236+0000 7fb863152640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85c0b69e0 0x7fb85c0abcb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb85802a1e0 tx=0x7fb8580046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.236+0000 7fb863152640 1 -- 172.21.15.60:0/2503767598 shutdown_connections 2024-09-12T01:37:30.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.236+0000 7fb863152640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb84806be30 0x7fb84806e2f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.236+0000 7fb863152640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb85c15e750 0x7fb85c0b2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.236+0000 7fb863152640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb85c0cfb70 0x7fb85c0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.236+0000 7fb863152640 1 --2- 172.21.15.60:0/2503767598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb85c0b69e0 0x7fb85c0abcb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.236+0000 7fb863152640 1 -- 172.21.15.60:0/2503767598 >> 172.21.15.60:0/2503767598 conn(0x7fb85c0d1500 msgr2=0x7fb85c0b7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:30.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.236+0000 7fb863152640 1 -- 172.21.15.60:0/2503767598 shutdown_connections 2024-09-12T01:37:30.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.236+0000 7fb863152640 1 -- 172.21.15.60:0/2503767598 wait complete. 2024-09-12T01:37:30.380 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:37:30.380 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:37:30.421 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:37:30.477 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:37:30.477 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:37:30.478 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:37:30.478 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:30.495 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:37:30.495 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:30.552 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:37:30.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.695+0000 7f4726103640 1 Processor -- start 2024-09-12T01:37:30.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.695+0000 7f4726103640 1 -- start start 2024-09-12T01:37:30.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.695+0000 7f4726103640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f472015ad10 0x7f47200719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.695+0000 7f4726103640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47200cca40 0x7f4720071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.695+0000 7f4726103640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4720071720 con 0x7f47200cc360 2024-09-12T01:37:30.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.695+0000 7f4726103640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4720070fb0 con 0x7f47200cca40 2024-09-12T01:37:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.695+0000 7f4726103640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4720073920 con 0x7f472015ad10 2024-09-12T01:37:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.696+0000 7f471ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f47200cc360 0x7f472015e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37140/0 (socket says 172.21.15.60:37140) 2024-09-12T01:37:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.696+0000 7f471effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47200cca40 0x7f4720071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.696+0000 7f471ffff640 1 -- 172.21.15.60:0/2866090650 learned_addr learned my addr 172.21.15.60:0/2866090650 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.696+0000 7f471f7fe640 1 --2- 172.21.15.60:0/2866090650 >> v2:172.21.15.105:3300/0 conn(0x7f472015ad10 0x7f47200719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.696+0000 7f471effd640 1 -- 172.21.15.60:0/2866090650 >> v2:172.21.15.105:3300/0 conn(0x7f472015ad10 msgr2=0x7f47200719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.696+0000 7f471effd640 1 --2- 172.21.15.60:0/2866090650 >> v2:172.21.15.105:3300/0 conn(0x7f472015ad10 0x7f47200719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.696+0000 7f471effd640 1 -- 172.21.15.60:0/2866090650 >> v1:172.21.15.60:6789/0 conn(0x7f47200cc360 legacy=0x7f472015e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.696+0000 7f471effd640 1 -- 172.21.15.60:0/2866090650 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4720073c00 con 0x7f47200cca40 2024-09-12T01:37:30.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.697+0000 7f471effd640 1 --2- 172.21.15.60:0/2866090650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47200cca40 0x7f4720071f00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4720069530 tx=0x7f471402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0fb4621bd94bdb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:30.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.697+0000 7f471e7fc640 1 -- 172.21.15.60:0/2866090650 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4714007740 con 0x7f47200cca40 2024-09-12T01:37:30.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.697+0000 7f471e7fc640 1 -- 172.21.15.60:0/2866090650 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47140078e0 con 0x7f47200cca40 2024-09-12T01:37:30.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.697+0000 7f471e7fc640 1 -- 172.21.15.60:0/2866090650 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4714007cb0 con 0x7f47200cca40 2024-09-12T01:37:30.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.697+0000 7f4726103640 1 -- 172.21.15.60:0/2866090650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47200cca40 msgr2=0x7f4720071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.697+0000 7f4726103640 1 --2- 172.21.15.60:0/2866090650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47200cca40 0x7f4720071f00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4720069530 tx=0x7f471402a5f0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.697+0000 7f4726103640 1 -- 172.21.15.60:0/2866090650 shutdown_connections 2024-09-12T01:37:30.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.697+0000 7f4726103640 1 --2- 172.21.15.60:0/2866090650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47200cca40 0x7f4720071f00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.697+0000 7f4726103640 1 --2- 172.21.15.60:0/2866090650 >> v2:172.21.15.105:3300/0 conn(0x7f472015ad10 0x7f47200719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.697+0000 7f4726103640 1 -- 172.21.15.60:0/2866090650 >> 172.21.15.60:0/2866090650 conn(0x7f472006d0f0 msgr2=0x7f472006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:30.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.698+0000 7f4726103640 1 -- 172.21.15.60:0/2866090650 shutdown_connections 2024-09-12T01:37:30.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.698+0000 7f4726103640 1 -- 172.21.15.60:0/2866090650 wait complete. 2024-09-12T01:37:30.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.699+0000 7f4726103640 1 Processor -- start 2024-09-12T01:37:30.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.699+0000 7f4726103640 1 -- start start 2024-09-12T01:37:30.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f4726103640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47200cc360 0x7f472006d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f4726103640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47200cca40 0x7f472006da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f4726103640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f472015ad10 0x7f4720151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f4726103640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47200b4eb0 con 0x7f472015ad10 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f4726103640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4720071200 con 0x7f47200cca40 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f4726103640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f472015ee20 con 0x7f47200cc360 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f471ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f472015ad10 0x7f4720151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f471ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f472015ad10 0x7f4720151730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34740/0 (socket says 172.21.15.60:34740) 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f471ffff640 1 -- 172.21.15.60:0/1960456696 learned_addr learned my addr 172.21.15.60:0/1960456696 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f471effd640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47200cca40 0x7f472006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f471f7fe640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47200cc360 0x7f472006d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f471ffff640 1 -- 172.21.15.60:0/1960456696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47200cc360 msgr2=0x7f472006d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f471ffff640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47200cc360 0x7f472006d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f471ffff640 1 -- 172.21.15.60:0/1960456696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47200cca40 msgr2=0x7f472006da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f471ffff640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47200cca40 0x7f472006da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f471ffff640 1 -- 172.21.15.60:0/1960456696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472014e1a0 con 0x7f472015ad10 2024-09-12T01:37:30.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f471f7fe640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47200cc360 0x7f472006d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:30.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f471ffff640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f472015ad10 0x7f4720151730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f471800c430 tx=0x7f471800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:30.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f4707fff640 1 -- 172.21.15.60:0/1960456696 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718017070 con 0x7f472015ad10 2024-09-12T01:37:30.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f4707fff640 1 -- 172.21.15.60:0/1960456696 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4718005ce0 con 0x7f472015ad10 2024-09-12T01:37:30.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f4726103640 1 -- 172.21.15.60:0/1960456696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472014e440 con 0x7f472015ad10 2024-09-12T01:37:30.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.700+0000 7f4707fff640 1 -- 172.21.15.60:0/1960456696 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47180072d0 con 0x7f472015ad10 2024-09-12T01:37:30.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.701+0000 7f4726103640 1 -- 172.21.15.60:0/1960456696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f472014ea00 con 0x7f472015ad10 2024-09-12T01:37:30.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.702+0000 7f4726103640 1 -- 172.21.15.60:0/1960456696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f472015f1b0 con 0x7f472015ad10 2024-09-12T01:37:30.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.702+0000 7f4707fff640 1 -- 172.21.15.60:0/1960456696 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f471801a070 con 0x7f472015ad10 2024-09-12T01:37:30.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.702+0000 7f4707fff640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f470c06be30 0x7f470c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:30.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.703+0000 7f4707fff640 1 -- 172.21.15.60:0/1960456696 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f471808a140 con 0x7f472015ad10 2024-09-12T01:37:30.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.703+0000 7f471f7fe640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f470c06be30 0x7f470c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:30.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.703+0000 7f471f7fe640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f470c06be30 0x7f470c06e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f472015a790 tx=0x7f4710008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:30.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.707+0000 7f4707fff640 1 -- 172.21.15.60:0/1960456696 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4718058400 con 0x7f472015ad10 2024-09-12T01:37:30.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.898+0000 7f4726103640 1 -- 172.21.15.60:0/1960456696 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f47200ce7d0 con 0x7f472015ad10 2024-09-12T01:37:30.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.899+0000 7f4707fff640 1 -- 172.21.15.60:0/1960456696 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f471805c700 con 0x7f472015ad10 2024-09-12T01:37:30.899 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:37:30.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.901+0000 7f4726103640 1 -- 172.21.15.60:0/1960456696 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f470c06be30 msgr2=0x7f470c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.901+0000 7f4726103640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f470c06be30 0x7f470c06e2f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f472015a790 tx=0x7f4710008040 comp rx=0 tx=0).stop 2024-09-12T01:37:30.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.901+0000 7f4726103640 1 -- 172.21.15.60:0/1960456696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f472015ad10 msgr2=0x7f4720151730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:30.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.901+0000 7f4726103640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f472015ad10 0x7f4720151730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f471800c430 tx=0x7f471800c8f0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.901+0000 7f4726103640 1 -- 172.21.15.60:0/1960456696 shutdown_connections 2024-09-12T01:37:30.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.901+0000 7f4726103640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f472015ad10 0x7f4720151730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.901+0000 7f4726103640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47200cca40 0x7f472006da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.901+0000 7f4726103640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f470c06be30 0x7f470c06e2f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.901+0000 7f4726103640 1 --2- 172.21.15.60:0/1960456696 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47200cc360 0x7f472006d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:30.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.901+0000 7f4726103640 1 -- 172.21.15.60:0/1960456696 >> 172.21.15.60:0/1960456696 conn(0x7f472006d0f0 msgr2=0x7f47200cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:30.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.901+0000 7f4726103640 1 -- 172.21.15.60:0/1960456696 shutdown_connections 2024-09-12T01:37:30.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:30.901+0000 7f4726103640 1 -- 172.21.15.60:0/1960456696 wait complete. 2024-09-12T01:37:30.912 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:37:30.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:30.912 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:37:31.004 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:37:31.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:31.004 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:37:31.032 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:37:31.032 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:37:31.032 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:31.060 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:37:31.060 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:31.128 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:37:31.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.234+0000 7f83a26ac640 1 Processor -- start 2024-09-12T01:37:31.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.234+0000 7f83a26ac640 1 -- start start 2024-09-12T01:37:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.234+0000 7f83a26ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f839c15ad10 0x7f839c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.234+0000 7f83a26ac640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f839c0cca40 0x7f839c071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f83a26ac640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f839c0cc360 0x7f839c15e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f83a26ac640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f839c070fb0 con 0x7f839c0cc360 2024-09-12T01:37:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f83a26ac640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f839c071720 con 0x7f839c0cca40 2024-09-12T01:37:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f83a26ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f839c0b4fb0 con 0x7f839c15ad10 2024-09-12T01:37:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f83a0c49640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f839c0cc360 0x7f839c15e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f83a0c49640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f839c0cc360 0x7f839c15e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34746/0 (socket says 172.21.15.60:34746) 2024-09-12T01:37:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f83a0c49640 1 -- 172.21.15.60:0/3171341016 learned_addr learned my addr 172.21.15.60:0/3171341016 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f839bfff640 1 --2- 172.21.15.60:0/3171341016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f839c15ad10 0x7f839c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f839b7fe640 1 --2- 172.21.15.60:0/3171341016 >> v2:172.21.15.105:3300/0 conn(0x7f839c0cca40 0x7f839c071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f83a0c49640 1 -- 172.21.15.60:0/3171341016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f839c15ad10 msgr2=0x7f839c0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f83a0c49640 1 --2- 172.21.15.60:0/3171341016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f839c15ad10 0x7f839c0719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f83a0c49640 1 -- 172.21.15.60:0/3171341016 >> v2:172.21.15.105:3300/0 conn(0x7f839c0cca40 msgr2=0x7f839c071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f83a0c49640 1 --2- 172.21.15.60:0/3171341016 >> v2:172.21.15.105:3300/0 conn(0x7f839c0cca40 0x7f839c071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.235+0000 7f83a0c49640 1 -- 172.21.15.60:0/3171341016 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c073920 con 0x7f839c0cc360 2024-09-12T01:37:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.236+0000 7f83a0c49640 1 --2- 172.21.15.60:0/3171341016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f839c0cc360 0x7f839c15e710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f839c075800 tx=0x7f839402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b611af69af560e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.236+0000 7f839affd640 1 -- 172.21.15.60:0/3171341016 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394036070 con 0x7f839c0cc360 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.236+0000 7f839affd640 1 -- 172.21.15.60:0/3171341016 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8394031600 con 0x7f839c0cc360 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.236+0000 7f839affd640 1 -- 172.21.15.60:0/3171341016 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83940319d0 con 0x7f839c0cc360 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.236+0000 7f83a26ac640 1 -- 172.21.15.60:0/3171341016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f839c0cc360 msgr2=0x7f839c15e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.236+0000 7f83a26ac640 1 --2- 172.21.15.60:0/3171341016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f839c0cc360 0x7f839c15e710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f839c075800 tx=0x7f839402a630 comp rx=0 tx=0).stop 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.236+0000 7f83a26ac640 1 -- 172.21.15.60:0/3171341016 shutdown_connections 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.236+0000 7f83a26ac640 1 --2- 172.21.15.60:0/3171341016 >> v2:172.21.15.105:3300/0 conn(0x7f839c0cca40 0x7f839c071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.236+0000 7f83a26ac640 1 --2- 172.21.15.60:0/3171341016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f839c0cc360 0x7f839c15e710 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.236+0000 7f83a26ac640 1 --2- 172.21.15.60:0/3171341016 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f839c15ad10 0x7f839c0719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.237+0000 7f83a26ac640 1 -- 172.21.15.60:0/3171341016 >> 172.21.15.60:0/3171341016 conn(0x7f839c06d0f0 msgr2=0x7f839c06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.237+0000 7f83a26ac640 1 -- 172.21.15.60:0/3171341016 shutdown_connections 2024-09-12T01:37:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.237+0000 7f83a26ac640 1 -- 172.21.15.60:0/3171341016 wait complete. 2024-09-12T01:37:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.238+0000 7f83a26ac640 1 Processor -- start 2024-09-12T01:37:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.238+0000 7f83a26ac640 1 -- start start 2024-09-12T01:37:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a26ac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f839c0cc360 0x7f839c0c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a26ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f839c0cca40 0x7f839c153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a26ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f839c15ad10 0x7f839c0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a26ac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f839c071200 con 0x7f839c15ad10 2024-09-12T01:37:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a26ac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f839c073ee0 con 0x7f839c0cc360 2024-09-12T01:37:31.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a26ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f839c15ec50 con 0x7f839c0cca40 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a0c49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f839c15ad10 0x7f839c0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f839bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f839c0cc360 0x7f839c0c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a0c49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f839c15ad10 0x7f839c0d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34760/0 (socket says 172.21.15.60:34760) 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a0c49640 1 -- 172.21.15.60:0/3139505461 learned_addr learned my addr 172.21.15.60:0/3139505461 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f839b7fe640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f839c0cca40 0x7f839c153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a0c49640 1 -- 172.21.15.60:0/3139505461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f839c0cca40 msgr2=0x7f839c153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a0c49640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f839c0cca40 0x7f839c153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a0c49640 1 -- 172.21.15.60:0/3139505461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f839c0cc360 msgr2=0x7f839c0c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a0c49640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f839c0cc360 0x7f839c0c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a0c49640 1 -- 172.21.15.60:0/3139505461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f839c0c6330 con 0x7f839c15ad10 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a0c49640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f839c15ad10 0x7f839c0d0510 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8394034040 tx=0x7f8394004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f8398ff9640 1 -- 172.21.15.60:0/3139505461 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394036050 con 0x7f839c15ad10 2024-09-12T01:37:31.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f8398ff9640 1 -- 172.21.15.60:0/3139505461 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8394042070 con 0x7f839c15ad10 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f8398ff9640 1 -- 172.21.15.60:0/3139505461 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394009510 con 0x7f839c15ad10 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.239+0000 7f83a26ac640 1 -- 172.21.15.60:0/3139505461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f839c1f3530 con 0x7f839c15ad10 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.240+0000 7f83a26ac640 1 -- 172.21.15.60:0/3139505461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f839c1f3af0 con 0x7f839c15ad10 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.241+0000 7f83a26ac640 1 -- 172.21.15.60:0/3139505461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f839c15e710 con 0x7f839c15ad10 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.241+0000 7f8398ff9640 1 -- 172.21.15.60:0/3139505461 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8394007b50 con 0x7f839c15ad10 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.242+0000 7f8398ff9640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f838806be30 0x7f838806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.242+0000 7f839bfff640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f838806be30 0x7f838806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.242+0000 7f8398ff9640 1 -- 172.21.15.60:0/3139505461 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f83940abb40 con 0x7f839c15ad10 2024-09-12T01:37:31.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.242+0000 7f839bfff640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f838806be30 0x7f838806e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f839c157ca0 tx=0x7f838c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:31.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.246+0000 7f8398ff9640 1 -- 172.21.15.60:0/3139505461 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8394079f30 con 0x7f839c15ad10 2024-09-12T01:37:31.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.435+0000 7f83a26ac640 1 -- 172.21.15.60:0/3139505461 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f839c159070 con 0x7f839c15ad10 2024-09-12T01:37:31.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.435+0000 7f8398ff9640 1 -- 172.21.15.60:0/3139505461 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7f839407e230 con 0x7f839c15ad10 2024-09-12T01:37:31.436 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:37:31.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.437+0000 7f83a26ac640 1 -- 172.21.15.60:0/3139505461 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f838806be30 msgr2=0x7f838806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.437+0000 7f83a26ac640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f838806be30 0x7f838806e2f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f839c157ca0 tx=0x7f838c008040 comp rx=0 tx=0).stop 2024-09-12T01:37:31.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.437+0000 7f83a26ac640 1 -- 172.21.15.60:0/3139505461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f839c15ad10 msgr2=0x7f839c0d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.437+0000 7f83a26ac640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f839c15ad10 0x7f839c0d0510 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8394034040 tx=0x7f8394004a40 comp rx=0 tx=0).stop 2024-09-12T01:37:31.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.438+0000 7f83a26ac640 1 -- 172.21.15.60:0/3139505461 shutdown_connections 2024-09-12T01:37:31.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.438+0000 7f83a26ac640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f839c15ad10 0x7f839c0d0510 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.438+0000 7f83a26ac640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f838806be30 0x7f838806e2f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.438+0000 7f83a26ac640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f839c0cca40 0x7f839c153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.438+0000 7f83a26ac640 1 --2- 172.21.15.60:0/3139505461 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f839c0cc360 0x7f839c0c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.438+0000 7f83a26ac640 1 -- 172.21.15.60:0/3139505461 >> 172.21.15.60:0/3139505461 conn(0x7f839c06d0f0 msgr2=0x7f839c15d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:31.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.438+0000 7f83a26ac640 1 -- 172.21.15.60:0/3139505461 shutdown_connections 2024-09-12T01:37:31.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.438+0000 7f83a26ac640 1 -- 172.21.15.60:0/3139505461 wait complete. 2024-09-12T01:37:31.449 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:37:31.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:31.449 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T01:37:31.483 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:37:31.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:31.484 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:37:31.542 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:37:31.542 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:37:31.542 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:31.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:37:31.560 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:37:31.560 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:37:31.561 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:31.599 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:37:31.599 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:37:31.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.705+0000 7f97d38af640 1 Processor -- start 2024-09-12T01:37:31.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.705+0000 7f97d38af640 1 -- start start 2024-09-12T01:37:31.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.706+0000 7f97d38af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97cc155800 0x7f97cc0b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.706+0000 7f97d38af640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f97cc15c330 0x7f97cc0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.706+0000 7f97d38af640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97cc15c770 con 0x7f97cc0cf570 2024-09-12T01:37:31.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.706+0000 7f97d38af640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f97cc0b4e60 con 0x7f97cc15c330 2024-09-12T01:37:31.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.706+0000 7f97d38af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc0b50a0 con 0x7f97cc155800 2024-09-12T01:37:31.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.706+0000 7f97d0e4a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f97cc15c330 0x7f97cc0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.706+0000 7f97d0e4a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f97cc15c330 0x7f97cc0b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34764/0 (socket says 172.21.15.60:34764) 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.706+0000 7f97d0e4a640 1 -- 172.21.15.60:0/516514301 learned_addr learned my addr 172.21.15.60:0/516514301 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.706+0000 7f97d164b640 1 --2- 172.21.15.60:0/516514301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97cc155800 0x7f97cc0b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.706+0000 7f97d0e4a640 1 -- 172.21.15.60:0/516514301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97cc155800 msgr2=0x7f97cc0b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.706+0000 7f97d0e4a640 1 --2- 172.21.15.60:0/516514301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97cc155800 0x7f97cc0b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.706+0000 7f97d0e4a640 1 -- 172.21.15.60:0/516514301 >> v1:172.21.15.105:6789/0 conn(0x7f97cc0cf570 legacy=0x7f97cc15c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.707+0000 7f97d0e4a640 1 -- 172.21.15.60:0/516514301 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc0b5380 con 0x7f97cc15c330 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.707+0000 7f97d0e4a640 1 --2- 172.21.15.60:0/516514301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc15c330 0x7f97cc0b4920 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f97c000bb10 tx=0x7f97c002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acff91b3c971b707 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.707+0000 7f97cbfff640 1 -- 172.21.15.60:0/516514301 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0036020 con 0x7f97cc15c330 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.707+0000 7f97cbfff640 1 -- 172.21.15.60:0/516514301 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c0032820 con 0x7f97cc15c330 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.707+0000 7f97cbfff640 1 -- 172.21.15.60:0/516514301 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c0032bf0 con 0x7f97cc15c330 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.708+0000 7f97d38af640 1 -- 172.21.15.60:0/516514301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc15c330 msgr2=0x7f97cc0b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.708+0000 7f97d38af640 1 --2- 172.21.15.60:0/516514301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc15c330 0x7f97cc0b4920 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f97c000bb10 tx=0x7f97c002c920 comp rx=0 tx=0).stop 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.708+0000 7f97d38af640 1 -- 172.21.15.60:0/516514301 shutdown_connections 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.708+0000 7f97d38af640 1 --2- 172.21.15.60:0/516514301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc15c330 0x7f97cc0b4920 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.708+0000 7f97d38af640 1 --2- 172.21.15.60:0/516514301 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97cc155800 0x7f97cc0b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.708+0000 7f97d38af640 1 -- 172.21.15.60:0/516514301 >> 172.21.15.60:0/516514301 conn(0x7f97cc06bc10 msgr2=0x7f97cc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.708+0000 7f97d38af640 1 -- 172.21.15.60:0/516514301 shutdown_connections 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.708+0000 7f97d38af640 1 -- 172.21.15.60:0/516514301 wait complete. 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.709+0000 7f97d38af640 1 Processor -- start 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.709+0000 7f97d38af640 1 -- start start 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d38af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc0cf570 0x7f97cc157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d38af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97cc155800 0x7f97cc14a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d38af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97cc15c330 0x7f97cc154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d38af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0b5c20 con 0x7f97cc0cf570 2024-09-12T01:37:31.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d38af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0b5940 con 0x7f97cc155800 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d38af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc155be0 con 0x7f97cc15c330 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d164b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc0cf570 0x7f97cc157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d164b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc0cf570 0x7f97cc157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34772/0 (socket says 172.21.15.60:34772) 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d164b640 1 -- 172.21.15.60:0/2822301889 learned_addr learned my addr 172.21.15.60:0/2822301889 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d0e4a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97cc155800 0x7f97cc14a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d1e4c640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97cc15c330 0x7f97cc154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d164b640 1 -- 172.21.15.60:0/2822301889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97cc15c330 msgr2=0x7f97cc154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d164b640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97cc15c330 0x7f97cc154100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d164b640 1 -- 172.21.15.60:0/2822301889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97cc155800 msgr2=0x7f97cc14a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d164b640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97cc155800 0x7f97cc14a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.710+0000 7f97d164b640 1 -- 172.21.15.60:0/2822301889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc1f0aa0 con 0x7f97cc0cf570 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.711+0000 7f97d164b640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc0cf570 0x7f97cc157310 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009db0 tx=0x7f97bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.711+0000 7f97c9ffb640 1 -- 172.21.15.60:0/2822301889 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc018020 con 0x7f97cc0cf570 2024-09-12T01:37:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.711+0000 7f97c9ffb640 1 -- 172.21.15.60:0/2822301889 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97bc014480 con 0x7f97cc0cf570 2024-09-12T01:37:31.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.711+0000 7f97c9ffb640 1 -- 172.21.15.60:0/2822301889 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc014850 con 0x7f97cc0cf570 2024-09-12T01:37:31.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.711+0000 7f97d38af640 1 -- 172.21.15.60:0/2822301889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97cc157850 con 0x7f97cc0cf570 2024-09-12T01:37:31.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.711+0000 7f97d38af640 1 -- 172.21.15.60:0/2822301889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97cc1f04e0 con 0x7f97cc0cf570 2024-09-12T01:37:31.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.712+0000 7f97d38af640 1 -- 172.21.15.60:0/2822301889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97cc0b6140 con 0x7f97cc0cf570 2024-09-12T01:37:31.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.713+0000 7f97c9ffb640 1 -- 172.21.15.60:0/2822301889 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f97bc005d10 con 0x7f97cc0cf570 2024-09-12T01:37:31.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.713+0000 7f97c9ffb640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f97b806be30 0x7f97b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:31.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.713+0000 7f97c9ffb640 1 -- 172.21.15.60:0/2822301889 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f97bc08b880 con 0x7f97cc0cf570 2024-09-12T01:37:31.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.713+0000 7f97d0e4a640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f97b806be30 0x7f97b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:31.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.714+0000 7f97d0e4a640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f97b806be30 0x7f97b806e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f97c0037000 tx=0x7f97c003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:31.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.717+0000 7f97c9ffb640 1 -- 172.21.15.60:0/2822301889 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f97bc022070 con 0x7f97cc0cf570 2024-09-12T01:37:31.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.930+0000 7f97d38af640 1 -- 172.21.15.60:0/2822301889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97cc0633d0 con 0x7f97cc0cf570 2024-09-12T01:37:31.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.931+0000 7f97c9ffb640 1 -- 172.21.15.60:0/2822301889 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7f97bc010040 con 0x7f97cc0cf570 2024-09-12T01:37:31.932 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:31.932 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":14,"btime":"2024-09-12T01:36:38:945222+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3644892545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3644892545},{"type":"v1","addr":"172.21.15.105:6835","nonce":3644892545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/458109310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458109310},{"type":"v1","addr":"172.21.15.60:6836","nonce":458109310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4741,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1415668038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1415668038},{"type":"v1","addr":"172.21.15.60:6837","nonce":1415668038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:36:36.284771+0000","modified":"2024-09-12T01:36:38.293895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34520":{"gid":34520,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/1200480020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1200480020},{"type":"v1","addr":"172.21.15.105:6834","nonce":1200480020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34520,"qdb_cluster":[34520]},"id":2}]} 2024-09-12T01:37:31.932 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 14 2024-09-12T01:37:31.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.933+0000 7f97d38af640 1 -- 172.21.15.60:0/2822301889 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f97b806be30 msgr2=0x7f97b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.933+0000 7f97d38af640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f97b806be30 0x7f97b806e2f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f97c0037000 tx=0x7f97c003d040 comp rx=0 tx=0).stop 2024-09-12T01:37:31.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.933+0000 7f97d38af640 1 -- 172.21.15.60:0/2822301889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc0cf570 msgr2=0x7f97cc157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:31.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.933+0000 7f97d38af640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc0cf570 0x7f97cc157310 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009db0 tx=0x7f97bc00c490 comp rx=0 tx=0).stop 2024-09-12T01:37:31.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.933+0000 7f97d38af640 1 -- 172.21.15.60:0/2822301889 shutdown_connections 2024-09-12T01:37:31.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.933+0000 7f97d38af640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f97b806be30 0x7f97b806e2f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.933+0000 7f97d38af640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97cc15c330 0x7f97cc154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.933+0000 7f97d38af640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f97cc155800 0x7f97cc14a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.933+0000 7f97d38af640 1 --2- 172.21.15.60:0/2822301889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f97cc0cf570 0x7f97cc157310 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:31.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.933+0000 7f97d38af640 1 -- 172.21.15.60:0/2822301889 >> 172.21.15.60:0/2822301889 conn(0x7f97cc06bc10 msgr2=0x7f97cc072960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:31.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.933+0000 7f97d38af640 1 -- 172.21.15.60:0/2822301889 shutdown_connections 2024-09-12T01:37:31.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:31.933+0000 7f97d38af640 1 -- 172.21.15.60:0/2822301889 wait complete. 2024-09-12T01:37:31.945 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:37:32.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.047+0000 7f75a23d6640 1 Processor -- start 2024-09-12T01:37:32.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.047+0000 7f75a23d6640 1 -- start start 2024-09-12T01:37:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f75a23d6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f759c15c2b0 0x7f759c0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f75a23d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f759c0b72f0 0x7f759c15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f75a23d6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f759c15fb10 con 0x7f759c15f030 2024-09-12T01:37:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f75a23d6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f759c0b5900 con 0x7f759c15c2b0 2024-09-12T01:37:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f75a23d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f759c15f830 con 0x7f759c0b72f0 2024-09-12T01:37:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f759bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f759c15c2b0 0x7f759c0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f759bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f759c15c2b0 0x7f759c0b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34782/0 (socket says 172.21.15.60:34782) 2024-09-12T01:37:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f759bfff640 1 -- 172.21.15.60:0/97408576 learned_addr learned my addr 172.21.15.60:0/97408576 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f7593fff640 1 --2- 172.21.15.60:0/97408576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f759c0b72f0 0x7f759c15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f759bfff640 1 -- 172.21.15.60:0/97408576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f759c0b72f0 msgr2=0x7f759c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:32.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f759bfff640 1 --2- 172.21.15.60:0/97408576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f759c0b72f0 0x7f759c15eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f759bfff640 1 -- 172.21.15.60:0/97408576 >> v1:172.21.15.105:6789/0 conn(0x7f759c15f030 legacy=0x7f759c06f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f759bfff640 1 -- 172.21.15.60:0/97408576 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c06ce30 con 0x7f759c15c2b0 2024-09-12T01:37:32.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.048+0000 7f7593fff640 1 --2- 172.21.15.60:0/97408576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f759c0b72f0 0x7f759c15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:32.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.049+0000 7f759bfff640 1 --2- 172.21.15.60:0/97408576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f759c15c2b0 0x7f759c0b6db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f758c009870 tx=0x7f758c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad31354c3e872bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:32.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.049+0000 7f759b7fe640 1 -- 172.21.15.60:0/97408576 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c037070 con 0x7f759c15c2b0 2024-09-12T01:37:32.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.049+0000 7f759b7fe640 1 -- 172.21.15.60:0/97408576 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758c032440 con 0x7f759c15c2b0 2024-09-12T01:37:32.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.049+0000 7f759b7fe640 1 -- 172.21.15.60:0/97408576 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c032810 con 0x7f759c15c2b0 2024-09-12T01:37:32.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.050+0000 7f75a23d6640 1 -- 172.21.15.60:0/97408576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f759c15c2b0 msgr2=0x7f759c0b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.050+0000 7f75a23d6640 1 --2- 172.21.15.60:0/97408576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f759c15c2b0 0x7f759c0b6db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f758c009870 tx=0x7f758c02a270 comp rx=0 tx=0).stop 2024-09-12T01:37:32.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.050+0000 7f75a23d6640 1 -- 172.21.15.60:0/97408576 shutdown_connections 2024-09-12T01:37:32.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.050+0000 7f75a23d6640 1 --2- 172.21.15.60:0/97408576 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f759c0b72f0 0x7f759c15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.050+0000 7f75a23d6640 1 --2- 172.21.15.60:0/97408576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f759c15c2b0 0x7f759c0b6db0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.050+0000 7f75a23d6640 1 -- 172.21.15.60:0/97408576 >> 172.21.15.60:0/97408576 conn(0x7f759c0b4240 msgr2=0x7f759c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:32.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.050+0000 7f75a23d6640 1 -- 172.21.15.60:0/97408576 shutdown_connections 2024-09-12T01:37:32.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.050+0000 7f75a23d6640 1 -- 172.21.15.60:0/97408576 wait complete. 2024-09-12T01:37:32.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.051+0000 7f75a23d6640 1 Processor -- start 2024-09-12T01:37:32.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.051+0000 7f75a23d6640 1 -- start start 2024-09-12T01:37:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f75a23d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f759c0b72f0 0x7f759c14de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f75a23d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f759c15c2b0 0x7f759c1e8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f75a23d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f759c15f030 0x7f759c0d1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f75a23d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f759c0b7730 con 0x7f759c0b72f0 2024-09-12T01:37:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f75a23d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f759c06d3f0 con 0x7f759c15c2b0 2024-09-12T01:37:32.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f75a23d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f759c15f4c0 con 0x7f759c15f030 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f759bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f759c0b72f0 0x7f759c14de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f759bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f759c0b72f0 0x7f759c14de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34788/0 (socket says 172.21.15.60:34788) 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f759bfff640 1 -- 172.21.15.60:0/1926263115 learned_addr learned my addr 172.21.15.60:0/1926263115 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f7593fff640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f759c15c2b0 0x7f759c1e8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f75a0973640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f759c15f030 0x7f759c0d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f759bfff640 1 -- 172.21.15.60:0/1926263115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f759c15f030 msgr2=0x7f759c0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f759bfff640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f759c15f030 0x7f759c0d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f759bfff640 1 -- 172.21.15.60:0/1926263115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f759c15c2b0 msgr2=0x7f759c1e8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f759bfff640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f759c15c2b0 0x7f759c1e8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f759bfff640 1 -- 172.21.15.60:0/1926263115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f759c14e3c0 con 0x7f759c0b72f0 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.052+0000 7f759bfff640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f759c0b72f0 0x7f759c14de80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f758c02a2b0 tx=0x7f758c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.053+0000 7f75997fa640 1 -- 172.21.15.60:0/1926263115 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c041020 con 0x7f759c0b72f0 2024-09-12T01:37:32.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.053+0000 7f75997fa640 1 -- 172.21.15.60:0/1926263115 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f758c0306c0 con 0x7f759c0b72f0 2024-09-12T01:37:32.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.053+0000 7f75a23d6640 1 -- 172.21.15.60:0/1926263115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f759c1e94f0 con 0x7f759c0b72f0 2024-09-12T01:37:32.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.053+0000 7f75997fa640 1 -- 172.21.15.60:0/1926263115 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c037040 con 0x7f759c0b72f0 2024-09-12T01:37:32.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.053+0000 7f75a23d6640 1 -- 172.21.15.60:0/1926263115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f759c0cee50 con 0x7f759c0b72f0 2024-09-12T01:37:32.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.054+0000 7f75a23d6640 1 -- 172.21.15.60:0/1926263115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f759c15eaf0 con 0x7f759c0b72f0 2024-09-12T01:37:32.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.054+0000 7f75997fa640 1 -- 172.21.15.60:0/1926263115 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f758c044020 con 0x7f759c0b72f0 2024-09-12T01:37:32.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.055+0000 7f75997fa640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f757c06be30 0x7f757c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.055+0000 7f75997fa640 1 -- 172.21.15.60:0/1926263115 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f758c0ab4a0 con 0x7f759c0b72f0 2024-09-12T01:37:32.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.055+0000 7f7593fff640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f757c06be30 0x7f757c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.055+0000 7f7593fff640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f757c06be30 0x7f757c06e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f759c15b7e0 tx=0x7f7584008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:32.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.059+0000 7f75997fa640 1 -- 172.21.15.60:0/1926263115 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f758c04b030 con 0x7f759c0b72f0 2024-09-12T01:37:32.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.269+0000 7f75a23d6640 1 -- 172.21.15.60:0/1926263115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f759c1e9a10 con 0x7f759c0b72f0 2024-09-12T01:37:32.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.270+0000 7f75997fa640 1 -- 172.21.15.60:0/1926263115 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7f758c079890 con 0x7f759c0b72f0 2024-09-12T01:37:32.270 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:32.271 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":14,"btime":"2024-09-12T01:36:38:945222+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3644892545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3644892545},{"type":"v1","addr":"172.21.15.105:6835","nonce":3644892545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/458109310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458109310},{"type":"v1","addr":"172.21.15.60:6836","nonce":458109310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4741,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1415668038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1415668038},{"type":"v1","addr":"172.21.15.60:6837","nonce":1415668038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:36:36.284771+0000","modified":"2024-09-12T01:36:38.293895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34520":{"gid":34520,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/1200480020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1200480020},{"type":"v1","addr":"172.21.15.105:6834","nonce":1200480020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34520,"qdb_cluster":[34520]},"id":2}]} 2024-09-12T01:37:32.271 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 14 2024-09-12T01:37:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.272+0000 7f75a23d6640 1 -- 172.21.15.60:0/1926263115 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f757c06be30 msgr2=0x7f757c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.272+0000 7f75a23d6640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f757c06be30 0x7f757c06e2f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f759c15b7e0 tx=0x7f7584008040 comp rx=0 tx=0).stop 2024-09-12T01:37:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.272+0000 7f75a23d6640 1 -- 172.21.15.60:0/1926263115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f759c0b72f0 msgr2=0x7f759c14de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.272+0000 7f75a23d6640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f759c0b72f0 0x7f759c14de80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f758c02a2b0 tx=0x7f758c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.272+0000 7f75a23d6640 1 -- 172.21.15.60:0/1926263115 shutdown_connections 2024-09-12T01:37:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.272+0000 7f75a23d6640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f757c06be30 0x7f757c06e2f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.272+0000 7f75a23d6640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f759c15f030 0x7f759c0d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.272+0000 7f75a23d6640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f759c15c2b0 0x7f759c1e8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.272+0000 7f75a23d6640 1 --2- 172.21.15.60:0/1926263115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f759c0b72f0 0x7f759c14de80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.272+0000 7f75a23d6640 1 -- 172.21.15.60:0/1926263115 >> 172.21.15.60:0/1926263115 conn(0x7f759c0b4240 msgr2=0x7f759c06d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.272+0000 7f75a23d6640 1 -- 172.21.15.60:0/1926263115 shutdown_connections 2024-09-12T01:37:32.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.272+0000 7f75a23d6640 1 -- 172.21.15.60:0/1926263115 wait complete. 2024-09-12T01:37:32.283 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:37:32.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.385+0000 7f0c96e5c640 1 Processor -- start 2024-09-12T01:37:32.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.385+0000 7f0c96e5c640 1 -- start start 2024-09-12T01:37:32.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.386+0000 7f0c96e5c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0c900b63d0 0x7f0c900d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.386+0000 7f0c96e5c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c900cf6b0 0x7f0c900b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.386+0000 7f0c96e5c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c900cfc20 con 0x7f0c900d1c80 2024-09-12T01:37:32.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.386+0000 7f0c96e5c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0c900d2ed0 con 0x7f0c900cf6b0 2024-09-12T01:37:32.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.386+0000 7f0c96e5c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0c900d31b0 con 0x7f0c900b63d0 2024-09-12T01:37:32.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.386+0000 7f0c8ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c900cf6b0 0x7f0c900b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.386+0000 7f0c953f9640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0c900d1c80 0x7f0c900b7dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:37142/0 (socket says 172.21.15.60:37142) 2024-09-12T01:37:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.386+0000 7f0c953f9640 1 -- 172.21.15.60:0/938138432 learned_addr learned my addr 172.21.15.60:0/938138432 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.387+0000 7f0c94bf8640 1 --2- 172.21.15.60:0/938138432 >> v2:172.21.15.105:3300/0 conn(0x7f0c900b63d0 0x7f0c900d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.387+0000 7f0c8ffff640 1 -- 172.21.15.60:0/938138432 >> v2:172.21.15.105:3300/0 conn(0x7f0c900b63d0 msgr2=0x7f0c900d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.387+0000 7f0c8ffff640 1 --2- 172.21.15.60:0/938138432 >> v2:172.21.15.105:3300/0 conn(0x7f0c900b63d0 0x7f0c900d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.387+0000 7f0c8ffff640 1 -- 172.21.15.60:0/938138432 >> v1:172.21.15.60:6789/0 conn(0x7f0c900d1c80 legacy=0x7f0c900b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.387+0000 7f0c8ffff640 1 -- 172.21.15.60:0/938138432 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c900d3490 con 0x7f0c900cf6b0 2024-09-12T01:37:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.387+0000 7f0c8f7fe640 1 -- 172.21.15.60:0/938138432 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1227807793 0 0) 0x7f0c900cfc20 con 0x7f0c900d1c80 2024-09-12T01:37:32.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.387+0000 7f0c94bf8640 1 --2- 172.21.15.60:0/938138432 >> v2:172.21.15.105:3300/0 conn(0x7f0c900b63d0 0x7f0c900d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:32.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.387+0000 7f0c8ffff640 1 --2- 172.21.15.60:0/938138432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c900cf6b0 0x7f0c900b7880 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0c90050260 tx=0x7f0c7c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f00d19a817f59ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.388+0000 7f0c8f7fe640 1 -- 172.21.15.60:0/938138432 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c037070 con 0x7f0c900cf6b0 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.388+0000 7f0c8f7fe640 1 -- 172.21.15.60:0/938138432 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7c032440 con 0x7f0c900cf6b0 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.388+0000 7f0c8f7fe640 1 -- 172.21.15.60:0/938138432 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c02ae60 con 0x7f0c900cf6b0 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.388+0000 7f0c96e5c640 1 -- 172.21.15.60:0/938138432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c900cf6b0 msgr2=0x7f0c900b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.388+0000 7f0c96e5c640 1 --2- 172.21.15.60:0/938138432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c900cf6b0 0x7f0c900b7880 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0c90050260 tx=0x7f0c7c02a110 comp rx=0 tx=0).stop 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.388+0000 7f0c96e5c640 1 -- 172.21.15.60:0/938138432 shutdown_connections 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.388+0000 7f0c96e5c640 1 --2- 172.21.15.60:0/938138432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c900cf6b0 0x7f0c900b7880 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.388+0000 7f0c96e5c640 1 --2- 172.21.15.60:0/938138432 >> v2:172.21.15.105:3300/0 conn(0x7f0c900b63d0 0x7f0c900d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.388+0000 7f0c96e5c640 1 -- 172.21.15.60:0/938138432 >> 172.21.15.60:0/938138432 conn(0x7f0c900d1160 msgr2=0x7f0c900d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.388+0000 7f0c96e5c640 1 -- 172.21.15.60:0/938138432 shutdown_connections 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.388+0000 7f0c96e5c640 1 -- 172.21.15.60:0/938138432 wait complete. 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.389+0000 7f0c96e5c640 1 Processor -- start 2024-09-12T01:37:32.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.389+0000 7f0c96e5c640 1 -- start start 2024-09-12T01:37:32.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.390+0000 7f0c96e5c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c900b63d0 0x7f0c901608f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.390+0000 7f0c96e5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c900cf6b0 0x7f0c901e9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.390+0000 7f0c96e5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c900d1c80 0x7f0c9015fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.390+0000 7f0c96e5c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0c900d4070 con 0x7f0c900cf6b0 2024-09-12T01:37:32.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.390+0000 7f0c96e5c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c900d3ef0 con 0x7f0c900b63d0 2024-09-12T01:37:32.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.390+0000 7f0c96e5c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c900b67b0 con 0x7f0c900d1c80 2024-09-12T01:37:32.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.390+0000 7f0c8ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c900cf6b0 0x7f0c901e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.390+0000 7f0c8ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c900cf6b0 0x7f0c901e9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34804/0 (socket says 172.21.15.60:34804) 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.390+0000 7f0c8ffff640 1 -- 172.21.15.60:0/1280821022 learned_addr learned my addr 172.21.15.60:0/1280821022 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.391+0000 7f0c8ffff640 1 -- 172.21.15.60:0/1280821022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c900d1c80 msgr2=0x7f0c9015fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.391+0000 7f0c8ffff640 1 --2- 172.21.15.60:0/1280821022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c900d1c80 0x7f0c9015fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.391+0000 7f0c8ffff640 1 -- 172.21.15.60:0/1280821022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c900b63d0 msgr2=0x7f0c901608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.391+0000 7f0c8ffff640 1 --2- 172.21.15.60:0/1280821022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c900b63d0 0x7f0c901608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.391+0000 7f0c8ffff640 1 -- 172.21.15.60:0/1280821022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c901e9db0 con 0x7f0c900cf6b0 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.391+0000 7f0c8ffff640 1 --2- 172.21.15.60:0/1280821022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c900cf6b0 0x7f0c901e9870 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c000c00 tx=0x7f0c7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.391+0000 7f0c8d7fa640 1 -- 172.21.15.60:0/1280821022 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c037050 con 0x7f0c900cf6b0 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.391+0000 7f0c8d7fa640 1 -- 172.21.15.60:0/1280821022 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7c038040 con 0x7f0c900cf6b0 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.391+0000 7f0c96e5c640 1 -- 172.21.15.60:0/1280821022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c900ce340 con 0x7f0c900cf6b0 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.391+0000 7f0c8d7fa640 1 -- 172.21.15.60:0/1280821022 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c004470 con 0x7f0c900cf6b0 2024-09-12T01:37:32.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.391+0000 7f0c96e5c640 1 -- 172.21.15.60:0/1280821022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c901e8d90 con 0x7f0c900cf6b0 2024-09-12T01:37:32.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.392+0000 7f0c96e5c640 1 -- 172.21.15.60:0/1280821022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c900d39b0 con 0x7f0c900cf6b0 2024-09-12T01:37:32.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.392+0000 7f0c8d7fa640 1 -- 172.21.15.60:0/1280821022 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c7c030900 con 0x7f0c900cf6b0 2024-09-12T01:37:32.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.393+0000 7f0c8d7fa640 1 --2- 172.21.15.60:0/1280821022 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c7406be60 0x7f0c7406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.393+0000 7f0c8d7fa640 1 -- 172.21.15.60:0/1280821022 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0c7c0aba70 con 0x7f0c900cf6b0 2024-09-12T01:37:32.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.393+0000 7f0c94bf8640 1 --2- 172.21.15.60:0/1280821022 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c7406be60 0x7f0c7406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.393+0000 7f0c94bf8640 1 --2- 172.21.15.60:0/1280821022 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c7406be60 0x7f0c7406e320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0c84006fd0 tx=0x7f0c84008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:32.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.397+0000 7f0c8d7fa640 1 -- 172.21.15.60:0/1280821022 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c7c07a540 con 0x7f0c900cf6b0 2024-09-12T01:37:32.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.575+0000 7f0c96e5c640 1 -- 172.21.15.60:0/1280821022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c900cf280 con 0x7f0c900cf6b0 2024-09-12T01:37:32.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.576+0000 7f0c8d7fa640 1 -- 172.21.15.60:0/1280821022 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16633 (secure 0 0 0) 0x7f0c7c079e40 con 0x7f0c900cf6b0 2024-09-12T01:37:32.577 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:32.577 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:36:37.938269+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:36:34.185888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T01:36:35.265632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:37:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.578+0000 7f0c96e5c640 1 -- 172.21.15.60:0/1280821022 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c7406be60 msgr2=0x7f0c7406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.578+0000 7f0c96e5c640 1 --2- 172.21.15.60:0/1280821022 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c7406be60 0x7f0c7406e320 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0c84006fd0 tx=0x7f0c84008040 comp rx=0 tx=0).stop 2024-09-12T01:37:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.578+0000 7f0c96e5c640 1 -- 172.21.15.60:0/1280821022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c900cf6b0 msgr2=0x7f0c901e9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.578+0000 7f0c96e5c640 1 --2- 172.21.15.60:0/1280821022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c900cf6b0 0x7f0c901e9870 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c000c00 tx=0x7f0c7c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.579+0000 7f0c96e5c640 1 -- 172.21.15.60:0/1280821022 shutdown_connections 2024-09-12T01:37:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.579+0000 7f0c96e5c640 1 --2- 172.21.15.60:0/1280821022 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c7406be60 0x7f0c7406e320 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.579+0000 7f0c96e5c640 1 --2- 172.21.15.60:0/1280821022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c900d1c80 0x7f0c9015fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.579+0000 7f0c96e5c640 1 --2- 172.21.15.60:0/1280821022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c900cf6b0 0x7f0c901e9870 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.579+0000 7f0c96e5c640 1 --2- 172.21.15.60:0/1280821022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c900b63d0 0x7f0c901608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.579+0000 7f0c96e5c640 1 -- 172.21.15.60:0/1280821022 >> 172.21.15.60:0/1280821022 conn(0x7f0c900d1160 msgr2=0x7f0c900b8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.579+0000 7f0c96e5c640 1 -- 172.21.15.60:0/1280821022 shutdown_connections 2024-09-12T01:37:32.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.579+0000 7f0c96e5c640 1 -- 172.21.15.60:0/1280821022 wait complete. 2024-09-12T01:37:32.590 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:37:32.591 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:37:32.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.693+0000 7f42a87a1640 1 Processor -- start 2024-09-12T01:37:32.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.693+0000 7f42a87a1640 1 -- start start 2024-09-12T01:37:32.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a87a1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a015c550 0x7f42a00b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a87a1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a00b4cf0 con 0x7f42a015c170 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a87a1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42a00b4fd0 con 0x7f42a00b6310 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a87a1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f42a00b52b0 con 0x7f42a015c550 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a653d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f42a015c170 0x7f42a00cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51778/0 (socket says 172.21.15.60:51778) 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a653d640 1 -- 172.21.15.60:0/2344291585 learned_addr learned my addr 172.21.15.60:0/2344291585 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a5d3c640 1 --2- 172.21.15.60:0/2344291585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a015c550 0x7f42a00b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a553b640 1 -- 172.21.15.60:0/2344291585 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296870894 0 0) 0x7f42a00b4cf0 con 0x7f42a015c170 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a553b640 1 -- 172.21.15.60:0/2344291585 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f428c003520 con 0x7f42a015c170 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a553b640 1 -- 172.21.15.60:0/2344291585 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776662703 0 0) 0x7f42a00b4fd0 con 0x7f42a00b6310 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a553b640 1 -- 172.21.15.60:0/2344291585 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a00b4cf0 con 0x7f42a00b6310 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a5d3c640 1 -- 172.21.15.60:0/2344291585 >> v1:172.21.15.105:6789/0 conn(0x7f42a00b6310 legacy=0x7f42a00b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a5d3c640 1 -- 172.21.15.60:0/2344291585 >> v1:172.21.15.60:6789/0 conn(0x7f42a015c170 legacy=0x7f42a00cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a553b640 1 -- 172.21.15.60:0/2344291585 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2496632346 0 0) 0x7f428c003520 con 0x7f42a015c170 2024-09-12T01:37:32.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a5d3c640 1 -- 172.21.15.60:0/2344291585 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a00b5590 con 0x7f42a015c550 2024-09-12T01:37:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a5d3c640 1 --2- 172.21.15.60:0/2344291585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a015c550 0x7f42a00b5dd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42900097d0 tx=0x7f429002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37f26419354d8ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a553b640 1 -- 172.21.15.60:0/2344291585 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4290037070 con 0x7f42a015c550 2024-09-12T01:37:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a553b640 1 -- 172.21.15.60:0/2344291585 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429002ac30 con 0x7f42a015c550 2024-09-12T01:37:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.694+0000 7f42a553b640 1 -- 172.21.15.60:0/2344291585 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c001670 con 0x7f42a015c550 2024-09-12T01:37:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.695+0000 7f42a87a1640 1 -- 172.21.15.60:0/2344291585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a015c550 msgr2=0x7f42a00b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.695+0000 7f42a87a1640 1 --2- 172.21.15.60:0/2344291585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a015c550 0x7f42a00b5dd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f42900097d0 tx=0x7f429002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.695+0000 7f42a87a1640 1 -- 172.21.15.60:0/2344291585 shutdown_connections 2024-09-12T01:37:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.695+0000 7f42a87a1640 1 --2- 172.21.15.60:0/2344291585 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a015c550 0x7f42a00b5dd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.695+0000 7f42a87a1640 1 -- 172.21.15.60:0/2344291585 >> 172.21.15.60:0/2344291585 conn(0x7f42a006bc10 msgr2=0x7f42a006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.695+0000 7f42a87a1640 1 -- 172.21.15.60:0/2344291585 shutdown_connections 2024-09-12T01:37:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.695+0000 7f42a87a1640 1 -- 172.21.15.60:0/2344291585 wait complete. 2024-09-12T01:37:32.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.696+0000 7f42a87a1640 1 Processor -- start 2024-09-12T01:37:32.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.696+0000 7f42a87a1640 1 -- start start 2024-09-12T01:37:32.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a87a1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00b6310 0x7f42a015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a87a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42a015c170 0x7f42a00b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a87a1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a015c550 0x7f42a014abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a87a1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f42a015c990 con 0x7f42a00b6310 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a87a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42a00b5b50 con 0x7f42a015c170 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a87a1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f42a00cfdd0 con 0x7f42a015c550 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a653d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00b6310 0x7f42a015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a653d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00b6310 0x7f42a015f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43764/0 (socket says 172.21.15.60:43764) 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a653d640 1 -- 172.21.15.60:0/3966352708 learned_addr learned my addr 172.21.15.60:0/3966352708 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a5d3c640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42a015c170 0x7f42a00b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a6d3e640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a015c550 0x7f42a014abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a653d640 1 -- 172.21.15.60:0/3966352708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a015c550 msgr2=0x7f42a014abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a653d640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a015c550 0x7f42a014abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a653d640 1 -- 172.21.15.60:0/3966352708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42a015c170 msgr2=0x7f42a00b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a653d640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42a015c170 0x7f42a00b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a653d640 1 -- 172.21.15.60:0/3966352708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a015f6e0 con 0x7f42a00b6310 2024-09-12T01:37:32.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a5d3c640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42a015c170 0x7f42a00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:32.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f42a653d640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00b6310 0x7f42a015f1a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f429c001eb0 tx=0x7f429c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:32.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.697+0000 7f4296ffd640 1 -- 172.21.15.60:0/3966352708 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c017070 con 0x7f42a00b6310 2024-09-12T01:37:32.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.698+0000 7f4296ffd640 1 -- 172.21.15.60:0/3966352708 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f429c005ad0 con 0x7f42a00b6310 2024-09-12T01:37:32.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.698+0000 7f42a87a1640 1 -- 172.21.15.60:0/3966352708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a0156760 con 0x7f42a00b6310 2024-09-12T01:37:32.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.698+0000 7f4296ffd640 1 -- 172.21.15.60:0/3966352708 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429c007070 con 0x7f42a00b6310 2024-09-12T01:37:32.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.698+0000 7f42a87a1640 1 -- 172.21.15.60:0/3966352708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a0156d20 con 0x7f42a00b6310 2024-09-12T01:37:32.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.699+0000 7f42a87a1640 1 -- 172.21.15.60:0/3966352708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a00b4b10 con 0x7f42a00b6310 2024-09-12T01:37:32.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.699+0000 7f4296ffd640 1 -- 172.21.15.60:0/3966352708 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f429c01a070 con 0x7f42a00b6310 2024-09-12T01:37:32.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.700+0000 7f4296ffd640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f428406be30 0x7f428406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:32.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.700+0000 7f4296ffd640 1 -- 172.21.15.60:0/3966352708 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f429c08a3f0 con 0x7f42a00b6310 2024-09-12T01:37:32.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.700+0000 7f42a5d3c640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f428406be30 0x7f428406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:32.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.700+0000 7f42a5d3c640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f428406be30 0x7f428406e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4290034000 tx=0x7f429002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:32.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.705+0000 7f4296ffd640 1 -- 172.21.15.60:0/3966352708 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42a00b4b10 con 0x7f42a00b6310 2024-09-12T01:37:32.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.913+0000 7f42a87a1640 1 -- 172.21.15.60:0/3966352708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42a00b5dd0 con 0x7f42a00b6310 2024-09-12T01:37:32.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.913+0000 7f4296ffd640 1 -- 172.21.15.60:0/3966352708 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7f429c058da0 con 0x7f42a00b6310 2024-09-12T01:37:32.914 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:32.914 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":14,"btime":"2024-09-12T01:36:38:945222+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3644892545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3644892545},{"type":"v1","addr":"172.21.15.105:6835","nonce":3644892545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/458109310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458109310},{"type":"v1","addr":"172.21.15.60:6836","nonce":458109310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4741,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1415668038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1415668038},{"type":"v1","addr":"172.21.15.60:6837","nonce":1415668038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:36:36.284771+0000","modified":"2024-09-12T01:36:38.293895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34520":{"gid":34520,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/1200480020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1200480020},{"type":"v1","addr":"172.21.15.105:6834","nonce":1200480020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34520,"qdb_cluster":[34520]},"id":2}]} 2024-09-12T01:37:32.914 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 14 2024-09-12T01:37:32.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.916+0000 7f42a87a1640 1 -- 172.21.15.60:0/3966352708 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f428406be30 msgr2=0x7f428406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.916+0000 7f42a87a1640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f428406be30 0x7f428406e2f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4290034000 tx=0x7f429002e000 comp rx=0 tx=0).stop 2024-09-12T01:37:32.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.916+0000 7f42a87a1640 1 -- 172.21.15.60:0/3966352708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00b6310 msgr2=0x7f42a015f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:32.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.916+0000 7f42a87a1640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00b6310 0x7f42a015f1a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f429c001eb0 tx=0x7f429c00cbe0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.916+0000 7f42a87a1640 1 -- 172.21.15.60:0/3966352708 shutdown_connections 2024-09-12T01:37:32.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.916+0000 7f42a87a1640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f428406be30 0x7f428406e2f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.916+0000 7f42a87a1640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a015c550 0x7f42a014abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.916+0000 7f42a87a1640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42a015c170 0x7f42a00b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.916+0000 7f42a87a1640 1 --2- 172.21.15.60:0/3966352708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a00b6310 0x7f42a015f1a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:32.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.916+0000 7f42a87a1640 1 -- 172.21.15.60:0/3966352708 >> 172.21.15.60:0/3966352708 conn(0x7f42a006bc10 msgr2=0x7f42a0151cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:32.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.916+0000 7f42a87a1640 1 -- 172.21.15.60:0/3966352708 shutdown_connections 2024-09-12T01:37:32.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:32.916+0000 7f42a87a1640 1 -- 172.21.15.60:0/3966352708 wait complete. 2024-09-12T01:37:32.927 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:37:33.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.031+0000 7f0c81786640 1 Processor -- start 2024-09-12T01:37:33.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.031+0000 7f0c81786640 1 -- start start 2024-09-12T01:37:33.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.032+0000 7f0c81786640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c7c161e00 0x7f0c7c073e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.032+0000 7f0c81786640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0c7c0b60c0 0x7f0c7c06f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.032+0000 7f0c81786640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c06f880 0x7f0c7c1622b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.032+0000 7f0c81786640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0c7c06fcb0 con 0x7f0c7c161e00 2024-09-12T01:37:33.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.032+0000 7f0c81786640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0c7c0b56e0 con 0x7f0c7c0b60c0 2024-09-12T01:37:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.032+0000 7f0c81786640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7c0b59c0 con 0x7f0c7c06f880 2024-09-12T01:37:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.032+0000 7f0c7affd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c7c161e00 0x7f0c7c073e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.033+0000 7f0c7affd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0c7c161e00 0x7f0c7c073e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43776/0 (socket says 172.21.15.60:43776) 2024-09-12T01:37:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.033+0000 7f0c7affd640 1 -- 172.21.15.60:0/1024169796 learned_addr learned my addr 172.21.15.60:0/1024169796 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.033+0000 7f0c7b7fe640 1 --2- 172.21.15.60:0/1024169796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c06f880 0x7f0c7c1622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.033+0000 7f0c7a7fc640 1 --2- 172.21.15.60:0/1024169796 >> v2:172.21.15.105:3300/0 conn(0x7f0c7c0b60c0 0x7f0c7c06f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.033+0000 7f0c7affd640 1 -- 172.21.15.60:0/1024169796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c06f880 msgr2=0x7f0c7c1622b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.033+0000 7f0c7affd640 1 --2- 172.21.15.60:0/1024169796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c06f880 0x7f0c7c1622b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.033+0000 7f0c7affd640 1 -- 172.21.15.60:0/1024169796 >> v2:172.21.15.105:3300/0 conn(0x7f0c7c0b60c0 msgr2=0x7f0c7c06f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.033+0000 7f0c7affd640 1 --2- 172.21.15.60:0/1024169796 >> v2:172.21.15.105:3300/0 conn(0x7f0c7c0b60c0 0x7f0c7c06f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.033+0000 7f0c7affd640 1 -- 172.21.15.60:0/1024169796 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7c06d460 con 0x7f0c7c161e00 2024-09-12T01:37:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c7affd640 1 --2- 172.21.15.60:0/1024169796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c161e00 0x7f0c7c073e00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c072b40 tx=0x7f0c7402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a8a59779802307 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c79ffb640 1 -- 172.21.15.60:0/1024169796 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74037070 con 0x7f0c7c161e00 2024-09-12T01:37:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c79ffb640 1 -- 172.21.15.60:0/1024169796 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c74032440 con 0x7f0c7c161e00 2024-09-12T01:37:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c79ffb640 1 -- 172.21.15.60:0/1024169796 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74032810 con 0x7f0c7c161e00 2024-09-12T01:37:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c81786640 1 -- 172.21.15.60:0/1024169796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c161e00 msgr2=0x7f0c7c073e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c81786640 1 --2- 172.21.15.60:0/1024169796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c161e00 0x7f0c7c073e00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c072b40 tx=0x7f0c7402a140 comp rx=0 tx=0).stop 2024-09-12T01:37:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c81786640 1 -- 172.21.15.60:0/1024169796 shutdown_connections 2024-09-12T01:37:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c81786640 1 --2- 172.21.15.60:0/1024169796 >> v2:172.21.15.105:3300/0 conn(0x7f0c7c0b60c0 0x7f0c7c06f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c81786640 1 --2- 172.21.15.60:0/1024169796 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c06f880 0x7f0c7c1622b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c81786640 1 --2- 172.21.15.60:0/1024169796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c161e00 0x7f0c7c073e00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c81786640 1 -- 172.21.15.60:0/1024169796 >> 172.21.15.60:0/1024169796 conn(0x7f0c7c062630 msgr2=0x7f0c7c062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c81786640 1 -- 172.21.15.60:0/1024169796 shutdown_connections 2024-09-12T01:37:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.034+0000 7f0c81786640 1 -- 172.21.15.60:0/1024169796 wait complete. 2024-09-12T01:37:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.036+0000 7f0c81786640 1 Processor -- start 2024-09-12T01:37:33.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.036+0000 7f0c81786640 1 -- start start 2024-09-12T01:37:33.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.036+0000 7f0c81786640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c06f880 0x7f0c7c159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.036+0000 7f0c81786640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c7c0b60c0 0x7f0c7c1574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.036+0000 7f0c81786640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c161e00 0x7f0c7c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.036+0000 7f0c81786640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c0b5ca0 con 0x7f0c7c06f880 2024-09-12T01:37:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.036+0000 7f0c81786640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c0b6830 con 0x7f0c7c0b60c0 2024-09-12T01:37:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.036+0000 7f0c81786640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7c1627f0 con 0x7f0c7c161e00 2024-09-12T01:37:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c7affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c06f880 0x7f0c7c159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c7affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c06f880 0x7f0c7c159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43786/0 (socket says 172.21.15.60:43786) 2024-09-12T01:37:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c7affd640 1 -- 172.21.15.60:0/2909672035 learned_addr learned my addr 172.21.15.60:0/2909672035 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c7a7fc640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c7c0b60c0 0x7f0c7c1574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c7b7fe640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c161e00 0x7f0c7c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c7affd640 1 -- 172.21.15.60:0/2909672035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c161e00 msgr2=0x7f0c7c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c7affd640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c161e00 0x7f0c7c15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c7affd640 1 -- 172.21.15.60:0/2909672035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c7c0b60c0 msgr2=0x7f0c7c1574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c7affd640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c7c0b60c0 0x7f0c7c1574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c7affd640 1 -- 172.21.15.60:0/2909672035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7c15a1a0 con 0x7f0c7c06f880 2024-09-12T01:37:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c7a7fc640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c7c0b60c0 0x7f0c7c1574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c7affd640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c06f880 0x7f0c7c159c60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0c7402a180 tx=0x7f0c740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c737fe640 1 -- 172.21.15.60:0/2909672035 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74037040 con 0x7f0c7c06f880 2024-09-12T01:37:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c737fe640 1 -- 172.21.15.60:0/2909672035 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c74042070 con 0x7f0c7c06f880 2024-09-12T01:37:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c81786640 1 -- 172.21.15.60:0/2909672035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c7c1594a0 con 0x7f0c7c06f880 2024-09-12T01:37:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c737fe640 1 -- 172.21.15.60:0/2909672035 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74030bb0 con 0x7f0c7c06f880 2024-09-12T01:37:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.037+0000 7f0c81786640 1 -- 172.21.15.60:0/2909672035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c7c0b0fc0 con 0x7f0c7c06f880 2024-09-12T01:37:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.038+0000 7f0c81786640 1 -- 172.21.15.60:0/2909672035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c7c070d70 con 0x7f0c7c06f880 2024-09-12T01:37:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.039+0000 7f0c737fe640 1 -- 172.21.15.60:0/2909672035 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c74047460 con 0x7f0c7c06f880 2024-09-12T01:37:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.039+0000 7f0c737fe640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c5c06be30 0x7f0c5c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.040+0000 7f0c7a7fc640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c5c06be30 0x7f0c5c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.040+0000 7f0c737fe640 1 -- 172.21.15.60:0/2909672035 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0c740abaa0 con 0x7f0c7c06f880 2024-09-12T01:37:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.040+0000 7f0c7a7fc640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c5c06be30 0x7f0c5c06e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c15c280 tx=0x7f0c64008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:33.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.044+0000 7f0c737fe640 1 -- 172.21.15.60:0/2909672035 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c7c070d70 con 0x7f0c7c06f880 2024-09-12T01:37:33.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.259+0000 7f0c81786640 1 -- 172.21.15.60:0/2909672035 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c7c162290 con 0x7f0c7c06f880 2024-09-12T01:37:33.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.260+0000 7f0c737fe640 1 -- 172.21.15.60:0/2909672035 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5231 (secure 0 0 0) 0x7f0c74045360 con 0x7f0c7c06f880 2024-09-12T01:37:33.260 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:33.261 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":14,"btime":"2024-09-12T01:36:38:945222+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3644892545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3644892545},{"type":"v1","addr":"172.21.15.105:6835","nonce":3644892545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/458109310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458109310},{"type":"v1","addr":"172.21.15.60:6836","nonce":458109310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4741,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1415668038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1415668038},{"type":"v1","addr":"172.21.15.60:6837","nonce":1415668038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:36:36.284771+0000","modified":"2024-09-12T01:36:38.293895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34520},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34520":{"gid":34520,"name":"b","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/1200480020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1200480020},{"type":"v1","addr":"172.21.15.105:6834","nonce":1200480020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34520,"qdb_cluster":[34520]},"id":2}]} 2024-09-12T01:37:33.261 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 14 2024-09-12T01:37:33.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.262+0000 7f0c81786640 1 -- 172.21.15.60:0/2909672035 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c5c06be30 msgr2=0x7f0c5c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.262+0000 7f0c81786640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c5c06be30 0x7f0c5c06e2f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c15c280 tx=0x7f0c64008040 comp rx=0 tx=0).stop 2024-09-12T01:37:33.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.262+0000 7f0c81786640 1 -- 172.21.15.60:0/2909672035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c06f880 msgr2=0x7f0c7c159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.262+0000 7f0c81786640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c06f880 0x7f0c7c159c60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0c7402a180 tx=0x7f0c740046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.262+0000 7f0c81786640 1 -- 172.21.15.60:0/2909672035 shutdown_connections 2024-09-12T01:37:33.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.262+0000 7f0c81786640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c5c06be30 0x7f0c5c06e2f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.262+0000 7f0c81786640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c7c161e00 0x7f0c7c15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.262+0000 7f0c81786640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c7c0b60c0 0x7f0c7c1574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.262+0000 7f0c81786640 1 --2- 172.21.15.60:0/2909672035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c7c06f880 0x7f0c7c159c60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.262+0000 7f0c81786640 1 -- 172.21.15.60:0/2909672035 >> 172.21.15.60:0/2909672035 conn(0x7f0c7c062630 msgr2=0x7f0c7c0d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:33.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.262+0000 7f0c81786640 1 -- 172.21.15.60:0/2909672035 shutdown_connections 2024-09-12T01:37:33.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.262+0000 7f0c81786640 1 -- 172.21.15.60:0/2909672035 wait complete. 2024-09-12T01:37:33.273 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:37:33.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.375+0000 7fe359b0a640 1 Processor -- start 2024-09-12T01:37:33.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.375+0000 7fe359b0a640 1 -- start start 2024-09-12T01:37:33.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe359b0a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe35415c550 0x7fe3540715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe359b0a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3540b6e10 0x7fe3540b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe359b0a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3540d0270 con 0x7fe354073160 2024-09-12T01:37:33.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe359b0a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe35415c930 con 0x7fe3540b6e10 2024-09-12T01:37:33.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe359b0a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe3540d04f0 con 0x7fe35415c550 2024-09-12T01:37:33.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe352ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3540b6e10 0x7fe3540b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe352ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3540b6e10 0x7fe3540b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43792/0 (socket says 172.21.15.60:43792) 2024-09-12T01:37:33.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe352ffd640 1 -- 172.21.15.60:0/3806627516 learned_addr learned my addr 172.21.15.60:0/3806627516 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:33.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe3537fe640 1 --2- 172.21.15.60:0/3806627516 >> v2:172.21.15.105:3300/0 conn(0x7fe35415c550 0x7fe3540715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe352ffd640 1 -- 172.21.15.60:0/3806627516 >> v2:172.21.15.105:3300/0 conn(0x7fe35415c550 msgr2=0x7fe3540715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:33.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe352ffd640 1 --2- 172.21.15.60:0/3806627516 >> v2:172.21.15.105:3300/0 conn(0x7fe35415c550 0x7fe3540715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe352ffd640 1 -- 172.21.15.60:0/3806627516 >> v1:172.21.15.105:6789/0 conn(0x7fe354073160 legacy=0x7fe3540d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:33.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.376+0000 7fe352ffd640 1 -- 172.21.15.60:0/3806627516 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3540b7580 con 0x7fe3540b6e10 2024-09-12T01:37:33.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.377+0000 7fe352ffd640 1 --2- 172.21.15.60:0/3806627516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3540b6e10 0x7fe3540b5540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe35406f010 tx=0x7fe33c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4a9f99fb41c884 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:33.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.377+0000 7fe3527fc640 1 -- 172.21.15.60:0/3806627516 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c037070 con 0x7fe3540b6e10 2024-09-12T01:37:33.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.377+0000 7fe3527fc640 1 -- 172.21.15.60:0/3806627516 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33c032440 con 0x7fe3540b6e10 2024-09-12T01:37:33.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.377+0000 7fe3527fc640 1 -- 172.21.15.60:0/3806627516 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c032810 con 0x7fe3540b6e10 2024-09-12T01:37:33.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.378+0000 7fe359b0a640 1 -- 172.21.15.60:0/3806627516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3540b6e10 msgr2=0x7fe3540b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.378+0000 7fe359b0a640 1 --2- 172.21.15.60:0/3806627516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3540b6e10 0x7fe3540b5540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe35406f010 tx=0x7fe33c02a230 comp rx=0 tx=0).stop 2024-09-12T01:37:33.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.378+0000 7fe359b0a640 1 -- 172.21.15.60:0/3806627516 shutdown_connections 2024-09-12T01:37:33.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.378+0000 7fe359b0a640 1 --2- 172.21.15.60:0/3806627516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3540b6e10 0x7fe3540b5540 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.378+0000 7fe359b0a640 1 --2- 172.21.15.60:0/3806627516 >> v2:172.21.15.105:3300/0 conn(0x7fe35415c550 0x7fe3540715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.378+0000 7fe359b0a640 1 -- 172.21.15.60:0/3806627516 >> 172.21.15.60:0/3806627516 conn(0x7fe3540b4240 msgr2=0x7fe3540b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:33.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.378+0000 7fe359b0a640 1 -- 172.21.15.60:0/3806627516 shutdown_connections 2024-09-12T01:37:33.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.378+0000 7fe359b0a640 1 -- 172.21.15.60:0/3806627516 wait complete. 2024-09-12T01:37:33.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.379+0000 7fe359b0a640 1 Processor -- start 2024-09-12T01:37:33.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.379+0000 7fe359b0a640 1 -- start start 2024-09-12T01:37:33.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe359b0a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe354073160 0x7fe35406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe359b0a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3540b6e10 0x7fe35414a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe359b0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415c550 0x7fe354159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe359b0a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe3540b7280 con 0x7fe354073160 2024-09-12T01:37:33.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe359b0a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe3540d07b0 con 0x7fe35415c550 2024-09-12T01:37:33.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe359b0a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe3540b5a80 con 0x7fe3540b6e10 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe3537fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe354073160 0x7fe35406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe3537fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe354073160 0x7fe35406cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43794/0 (socket says 172.21.15.60:43794) 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe3537fe640 1 -- 172.21.15.60:0/2989298224 learned_addr learned my addr 172.21.15.60:0/2989298224 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe352ffd640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3540b6e10 0x7fe35414a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe353fff640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415c550 0x7fe354159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe3537fe640 1 -- 172.21.15.60:0/2989298224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3540b6e10 msgr2=0x7fe35414a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe3537fe640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3540b6e10 0x7fe35414a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe3537fe640 1 -- 172.21.15.60:0/2989298224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415c550 msgr2=0x7fe354159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe3537fe640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415c550 0x7fe354159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.380+0000 7fe3537fe640 1 -- 172.21.15.60:0/2989298224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35414a740 con 0x7fe354073160 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.381+0000 7fe3537fe640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe354073160 0x7fe35406cd20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe34400d5f0 tx=0x7fe34400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.381+0000 7fe34bfff640 1 -- 172.21.15.60:0/2989298224 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3440125f0 con 0x7fe354073160 2024-09-12T01:37:33.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.381+0000 7fe34bfff640 1 -- 172.21.15.60:0/2989298224 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe344019070 con 0x7fe354073160 2024-09-12T01:37:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.381+0000 7fe359b0a640 1 -- 172.21.15.60:0/2989298224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe35415a450 con 0x7fe354073160 2024-09-12T01:37:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.381+0000 7fe34bfff640 1 -- 172.21.15.60:0/2989298224 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3440129d0 con 0x7fe354073160 2024-09-12T01:37:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.381+0000 7fe359b0a640 1 -- 172.21.15.60:0/2989298224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe35415e290 con 0x7fe354073160 2024-09-12T01:37:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.382+0000 7fe359b0a640 1 -- 172.21.15.60:0/2989298224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3540b5540 con 0x7fe354073160 2024-09-12T01:37:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.382+0000 7fe34bfff640 1 -- 172.21.15.60:0/2989298224 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe344012b70 con 0x7fe354073160 2024-09-12T01:37:33.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.383+0000 7fe34bfff640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe33406be30 0x7fe33406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.383+0000 7fe352ffd640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe33406be30 0x7fe33406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.383+0000 7fe34bfff640 1 -- 172.21.15.60:0/2989298224 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe34408b090 con 0x7fe354073160 2024-09-12T01:37:33.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.384+0000 7fe352ffd640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe33406be30 0x7fe33406e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe33c034000 tx=0x7fe33c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:33.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.387+0000 7fe34bfff640 1 -- 172.21.15.60:0/2989298224 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe344059480 con 0x7fe354073160 2024-09-12T01:37:33.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.563+0000 7fe359b0a640 1 -- 172.21.15.60:0/2989298224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3540b2750 con 0x7fe354073160 2024-09-12T01:37:33.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.564+0000 7fe34bfff640 1 -- 172.21.15.60:0/2989298224 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16633 (secure 0 0 0) 0x7fe34405d780 con 0x7fe354073160 2024-09-12T01:37:33.565 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:33.565 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":34,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:36:37.938269+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:36:34.185888+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-12T01:36:35.265632+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:37:33.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.567+0000 7fe359b0a640 1 -- 172.21.15.60:0/2989298224 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe33406be30 msgr2=0x7fe33406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.567+0000 7fe359b0a640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe33406be30 0x7fe33406e2f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe33c034000 tx=0x7fe33c02e000 comp rx=0 tx=0).stop 2024-09-12T01:37:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.567+0000 7fe359b0a640 1 -- 172.21.15.60:0/2989298224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe354073160 msgr2=0x7fe35406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.567+0000 7fe359b0a640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe354073160 0x7fe35406cd20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe34400d5f0 tx=0x7fe34400dab0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.567+0000 7fe359b0a640 1 -- 172.21.15.60:0/2989298224 shutdown_connections 2024-09-12T01:37:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.567+0000 7fe359b0a640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe35415c550 0x7fe354159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.567+0000 7fe359b0a640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe33406be30 0x7fe33406e2f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.567+0000 7fe359b0a640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe3540b6e10 0x7fe35414a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.567+0000 7fe359b0a640 1 --2- 172.21.15.60:0/2989298224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe354073160 0x7fe35406cd20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.567+0000 7fe359b0a640 1 -- 172.21.15.60:0/2989298224 >> 172.21.15.60:0/2989298224 conn(0x7fe3540b4240 msgr2=0x7fe3540d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.567+0000 7fe359b0a640 1 -- 172.21.15.60:0/2989298224 shutdown_connections 2024-09-12T01:37:33.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.567+0000 7fe359b0a640 1 -- 172.21.15.60:0/2989298224 wait complete. 2024-09-12T01:37:33.578 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:37:33.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.682+0000 7f9d268a5640 1 Processor -- start 2024-09-12T01:37:33.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.682+0000 7f9d268a5640 1 -- start start 2024-09-12T01:37:33.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d268a5640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9d20072700 0x7f9d20166120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d268a5640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d200ccff0 con 0x7f9d2015b480 2024-09-12T01:37:33.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d268a5640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d200cd2d0 con 0x7f9d200b6290 2024-09-12T01:37:33.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d268a5640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9d200cd5b0 con 0x7f9d20072700 2024-09-12T01:37:33.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9d2015b480 0x7f9d200b5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51788/0 (socket says 172.21.15.60:51788) 2024-09-12T01:37:33.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1ffff640 1 -- 172.21.15.60:0/108751920 learned_addr learned my addr 172.21.15.60:0/108751920 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:33.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d24e42640 1 --2- 172.21.15.60:0/108751920 >> v2:172.21.15.105:3300/0 conn(0x7f9d20072700 0x7f9d20166120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3978330420 0 0) 0x7f9d200ccff0 con 0x7f9d2015b480 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d08003520 con 0x7f9d2015b480 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3101580398 0 0) 0x7f9d08003520 con 0x7f9d2015b480 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 >> v2:172.21.15.105:3300/0 conn(0x7f9d20072700 msgr2=0x7f9d20166120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 --2- 172.21.15.60:0/108751920 >> v2:172.21.15.105:3300/0 conn(0x7f9d20072700 0x7f9d20166120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 >> v1:172.21.15.105:6789/0 conn(0x7f9d200b6290 legacy=0x7f9d20071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d200cd890 con 0x7f9d2015b480 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f9d10001670 con 0x7f9d2015b480 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 >> v1:172.21.15.60:6789/0 conn(0x7f9d2015b480 legacy=0x7f9d200b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 --2- 172.21.15.60:0/108751920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d080039b0 0x7f9d08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 --2- 172.21.15.60:0/108751920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d08004800 0x7f9d08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 --2- 172.21.15.60:0/108751920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d080051c0 0x7f9d0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9d200cd5b0 con 0x7f9d080039b0 2024-09-12T01:37:33.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0800c160 con 0x7f9d080051c0 2024-09-12T01:37:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0800c360 con 0x7f9d08004800 2024-09-12T01:37:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1ffff640 1 --2- 172.21.15.60:0/108751920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d080039b0 0x7f9d08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d24e42640 1 --2- 172.21.15.60:0/108751920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d080051c0 0x7f9d0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1f7fe640 1 --2- 172.21.15.60:0/108751920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d08004800 0x7f9d08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1ffff640 1 -- 172.21.15.60:0/108751920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d08004800 msgr2=0x7f9d08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1ffff640 1 --2- 172.21.15.60:0/108751920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d08004800 0x7f9d08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1ffff640 1 -- 172.21.15.60:0/108751920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d080051c0 msgr2=0x7f9d0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1ffff640 1 --2- 172.21.15.60:0/108751920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d080051c0 0x7f9d0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d24e42640 1 -- 172.21.15.60:0/108751920 reap_dead start 2024-09-12T01:37:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1ffff640 1 -- 172.21.15.60:0/108751920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d08003520 con 0x7f9d080039b0 2024-09-12T01:37:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.683+0000 7f9d1f7fe640 1 --2- 172.21.15.60:0/108751920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d08004800 0x7f9d08004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:33.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.684+0000 7f9d1ffff640 1 --2- 172.21.15.60:0/108751920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d080039b0 0x7f9d08003dd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000c240 tx=0x7f9d08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd58dcd5d4be79a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.684+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10007d10 con 0x7f9d080039b0 2024-09-12T01:37:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.684+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d10005ad0 con 0x7f9d080039b0 2024-09-12T01:37:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.684+0000 7f9d1effd640 1 -- 172.21.15.60:0/108751920 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10007070 con 0x7f9d080039b0 2024-09-12T01:37:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.684+0000 7f9d268a5640 1 -- 172.21.15.60:0/108751920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d080039b0 msgr2=0x7f9d08003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.684+0000 7f9d268a5640 1 --2- 172.21.15.60:0/108751920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d080039b0 0x7f9d08003dd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000c240 tx=0x7f9d08005830 comp rx=0 tx=0).stop 2024-09-12T01:37:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.684+0000 7f9d268a5640 1 -- 172.21.15.60:0/108751920 shutdown_connections 2024-09-12T01:37:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.684+0000 7f9d268a5640 1 --2- 172.21.15.60:0/108751920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d080039b0 0x7f9d08003dd0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.684+0000 7f9d268a5640 1 -- 172.21.15.60:0/108751920 >> 172.21.15.60:0/108751920 conn(0x7f9d2006d0f0 msgr2=0x7f9d2006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.684+0000 7f9d268a5640 1 -- 172.21.15.60:0/108751920 shutdown_connections 2024-09-12T01:37:33.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.684+0000 7f9d268a5640 1 -- 172.21.15.60:0/108751920 wait complete. 2024-09-12T01:37:33.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.686+0000 7f9d268a5640 1 Processor -- start 2024-09-12T01:37:33.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.686+0000 7f9d268a5640 1 -- start start 2024-09-12T01:37:33.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.686+0000 7f9d268a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d080039b0 0x7f9d200c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.686+0000 7f9d268a5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d200c5940 0x7f9d20153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d268a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201542c0 0x7f9d201e4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d268a5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2015b9e0 con 0x7f9d201542c0 2024-09-12T01:37:33.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d268a5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2015b860 con 0x7f9d080039b0 2024-09-12T01:37:33.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d268a5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9d20071ff0 con 0x7f9d200c5940 2024-09-12T01:37:33.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d24e42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201542c0 0x7f9d201e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d24e42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201542c0 0x7f9d201e4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43818/0 (socket says 172.21.15.60:43818) 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d24e42640 1 -- 172.21.15.60:0/2232777056 learned_addr learned my addr 172.21.15.60:0/2232777056 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d1f7fe640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d200c5940 0x7f9d20153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d1ffff640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d080039b0 0x7f9d200c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d24e42640 1 -- 172.21.15.60:0/2232777056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d200c5940 msgr2=0x7f9d20153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d24e42640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d200c5940 0x7f9d20153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d24e42640 1 -- 172.21.15.60:0/2232777056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d080039b0 msgr2=0x7f9d200c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d24e42640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d080039b0 0x7f9d200c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d24e42640 1 -- 172.21.15.60:0/2232777056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d201e5480 con 0x7f9d201542c0 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d1ffff640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d080039b0 0x7f9d200c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d24e42640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201542c0 0x7f9d201e4800 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9d200cdf50 tx=0x7f9d1800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d1cff9640 1 -- 172.21.15.60:0/2232777056 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1800fd80 con 0x7f9d201542c0 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d1cff9640 1 -- 172.21.15.60:0/2232777056 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1801d070 con 0x7f9d201542c0 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d268a5640 1 -- 172.21.15.60:0/2232777056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d201e5760 con 0x7f9d201542c0 2024-09-12T01:37:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d1cff9640 1 -- 172.21.15.60:0/2232777056 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18015670 con 0x7f9d201542c0 2024-09-12T01:37:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.687+0000 7f9d268a5640 1 -- 172.21.15.60:0/2232777056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d201e5d20 con 0x7f9d201542c0 2024-09-12T01:37:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.689+0000 7f9d268a5640 1 -- 172.21.15.60:0/2232777056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d20072380 con 0x7f9d201542c0 2024-09-12T01:37:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.689+0000 7f9d1cff9640 1 -- 172.21.15.60:0/2232777056 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d18015810 con 0x7f9d201542c0 2024-09-12T01:37:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.689+0000 7f9d1cff9640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9d0c06be30 0x7f9d0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.690+0000 7f9d1cff9640 1 -- 172.21.15.60:0/2232777056 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9d1808b990 con 0x7f9d201542c0 2024-09-12T01:37:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.690+0000 7f9d1ffff640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9d0c06be30 0x7f9d0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.690+0000 7f9d1ffff640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9d0c06be30 0x7f9d0c06e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9d10032000 tx=0x7f9d10034040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.695+0000 7f9d1cff9640 1 -- 172.21.15.60:0/2232777056 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d18027020 con 0x7f9d201542c0 2024-09-12T01:37:33.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.904+0000 7f9d268a5640 1 -- 172.21.15.60:0/2232777056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9d200c5d20 con 0x7f9d201542c0 2024-09-12T01:37:33.904 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-12T01:37:33.905+0000 7f58b98dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:37:33.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.906+0000 7f9d1cff9640 1 -- 172.21.15.60:0/2232777056 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7f9d18010040 con 0x7f9d201542c0 2024-09-12T01:37:33.905 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:37:33.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.909+0000 7f9d268a5640 1 -- 172.21.15.60:0/2232777056 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9d0c06be30 msgr2=0x7f9d0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.909+0000 7f9d268a5640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9d0c06be30 0x7f9d0c06e2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9d10032000 tx=0x7f9d10034040 comp rx=0 tx=0).stop 2024-09-12T01:37:33.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.909+0000 7f9d268a5640 1 -- 172.21.15.60:0/2232777056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201542c0 msgr2=0x7f9d201e4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:33.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.909+0000 7f9d268a5640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201542c0 0x7f9d201e4800 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9d200cdf50 tx=0x7f9d1800f580 comp rx=0 tx=0).stop 2024-09-12T01:37:33.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.909+0000 7f9d268a5640 1 -- 172.21.15.60:0/2232777056 shutdown_connections 2024-09-12T01:37:33.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.909+0000 7f9d268a5640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d201542c0 0x7f9d201e4800 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.909+0000 7f9d268a5640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9d0c06be30 0x7f9d0c06e2f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.909+0000 7f9d268a5640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d200c5940 0x7f9d20153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.909+0000 7f9d268a5640 1 --2- 172.21.15.60:0/2232777056 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d080039b0 0x7f9d200c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:33.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.909+0000 7f9d268a5640 1 -- 172.21.15.60:0/2232777056 >> 172.21.15.60:0/2232777056 conn(0x7f9d2006d0f0 msgr2=0x7f9d200b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:33.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.909+0000 7f9d268a5640 1 -- 172.21.15.60:0/2232777056 shutdown_connections 2024-09-12T01:37:33.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:33.909+0000 7f9d268a5640 1 -- 172.21.15.60:0/2232777056 wait complete. 2024-09-12T01:37:33.920 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:37:33.948 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:37:34.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.025+0000 7f784223c640 1 Processor -- start 2024-09-12T01:37:34.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.025+0000 7f784223c640 1 -- start start 2024-09-12T01:37:34.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.026+0000 7f784223c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f783c15e600 0x7f783c0d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:34.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.026+0000 7f784223c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783c0d1e60 con 0x7f783c0d1a40 2024-09-12T01:37:34.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.026+0000 7f784223c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783c0b7ad0 con 0x7f783c0cf4c0 2024-09-12T01:37:34.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.026+0000 7f784223c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f783c0d2ee0 con 0x7f783c15e600 2024-09-12T01:37:34.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.026+0000 7f783affd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f783c0d1a40 0x7f783c0cedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51790/0 (socket says 172.21.15.60:51790) 2024-09-12T01:37:34.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.026+0000 7f783affd640 1 -- 172.21.15.60:0/3487113882 learned_addr learned my addr 172.21.15.60:0/3487113882 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:34.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.026+0000 7f783b7fe640 1 --2- 172.21.15.60:0/3487113882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f783c15e600 0x7f783c0d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:34.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.026+0000 7f783a7fc640 1 -- 172.21.15.60:0/3487113882 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698702160 0 0) 0x7f783c0d1e60 con 0x7f783c0d1a40 2024-09-12T01:37:34.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.026+0000 7f783a7fc640 1 -- 172.21.15.60:0/3487113882 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7824003520 con 0x7f783c0d1a40 2024-09-12T01:37:34.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.026+0000 7f783a7fc640 1 -- 172.21.15.60:0/3487113882 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 661913203 0 0) 0x7f7834001490 con 0x7f783c0cf4c0 2024-09-12T01:37:34.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.026+0000 7f783a7fc640 1 -- 172.21.15.60:0/3487113882 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f783c0d1e60 con 0x7f783c0cf4c0 2024-09-12T01:37:34.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.027+0000 7f783b7fe640 1 -- 172.21.15.60:0/3487113882 >> v1:172.21.15.105:6789/0 conn(0x7f783c0cf4c0 legacy=0x7f783c0d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:34.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.027+0000 7f783b7fe640 1 -- 172.21.15.60:0/3487113882 >> v1:172.21.15.60:6789/0 conn(0x7f783c0d1a40 legacy=0x7f783c0cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:34.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.027+0000 7f783b7fe640 1 -- 172.21.15.60:0/3487113882 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c0cf9e0 con 0x7f783c15e600 2024-09-12T01:37:34.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.027+0000 7f783b7fe640 1 --2- 172.21.15.60:0/3487113882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f783c15e600 0x7f783c0d1500 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f782c0097d0 tx=0x7f782c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3a150a3d8e7aecb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:34.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.027+0000 7f783a7fc640 1 -- 172.21.15.60:0/3487113882 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c037070 con 0x7f783c15e600 2024-09-12T01:37:34.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.028+0000 7f783a7fc640 1 -- 172.21.15.60:0/3487113882 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782c032440 con 0x7f783c15e600 2024-09-12T01:37:34.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.028+0000 7f783a7fc640 1 -- 172.21.15.60:0/3487113882 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c032810 con 0x7f783c15e600 2024-09-12T01:37:34.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.028+0000 7f784223c640 1 -- 172.21.15.60:0/3487113882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f783c15e600 msgr2=0x7f783c0d1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:34.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.028+0000 7f784223c640 1 --2- 172.21.15.60:0/3487113882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f783c15e600 0x7f783c0d1500 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f782c0097d0 tx=0x7f782c02a210 comp rx=0 tx=0).stop 2024-09-12T01:37:34.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.028+0000 7f784223c640 1 -- 172.21.15.60:0/3487113882 shutdown_connections 2024-09-12T01:37:34.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.028+0000 7f784223c640 1 --2- 172.21.15.60:0/3487113882 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f783c15e600 0x7f783c0d1500 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:34.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.028+0000 7f784223c640 1 -- 172.21.15.60:0/3487113882 >> 172.21.15.60:0/3487113882 conn(0x7f783c06c2c0 msgr2=0x7f783c06c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:34.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.028+0000 7f784223c640 1 -- 172.21.15.60:0/3487113882 shutdown_connections 2024-09-12T01:37:34.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.028+0000 7f784223c640 1 -- 172.21.15.60:0/3487113882 wait complete. 2024-09-12T01:37:34.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.029+0000 7f784223c640 1 Processor -- start 2024-09-12T01:37:34.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.030+0000 7f784223c640 1 -- start start 2024-09-12T01:37:34.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.030+0000 7f784223c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f783c0cf4c0 0x7f783c145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:34.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.030+0000 7f784223c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f783c0d1a40 0x7f783c156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:34.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.030+0000 7f784223c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f783c15e600 0x7f783c0d46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:34.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.030+0000 7f784223c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f783c0d2b70 con 0x7f783c15e600 2024-09-12T01:37:34.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.030+0000 7f784223c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f783c0cffa0 con 0x7f783c0d1a40 2024-09-12T01:37:34.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.030+0000 7f784223c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f783c15e9e0 con 0x7f783c0cf4c0 2024-09-12T01:37:34.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.030+0000 7f783bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f783c15e600 0x7f783c0d46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:34.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.030+0000 7f783bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f783c15e600 0x7f783c0d46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43832/0 (socket says 172.21.15.60:43832) 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f783bfff640 1 -- 172.21.15.60:0/2255170984 learned_addr learned my addr 172.21.15.60:0/2255170984 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f783b7fe640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f783c0cf4c0 0x7f783c145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f783affd640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f783c0d1a40 0x7f783c156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f783bfff640 1 -- 172.21.15.60:0/2255170984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f783c0cf4c0 msgr2=0x7f783c145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f783bfff640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f783c0cf4c0 0x7f783c145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f783bfff640 1 -- 172.21.15.60:0/2255170984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f783c0d1a40 msgr2=0x7f783c156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f783bfff640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f783c0d1a40 0x7f783c156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f783bfff640 1 -- 172.21.15.60:0/2255170984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c1f4410 con 0x7f783c15e600 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f783bfff640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f783c15e600 0x7f783c0d46a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f783400c7b0 tx=0x7f783400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f7823fff640 1 -- 172.21.15.60:0/2255170984 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834016020 con 0x7f783c15e600 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f7823fff640 1 -- 172.21.15.60:0/2255170984 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7834006d50 con 0x7f783c15e600 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f784223c640 1 -- 172.21.15.60:0/2255170984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783c1577f0 con 0x7f783c15e600 2024-09-12T01:37:34.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f7823fff640 1 -- 172.21.15.60:0/2255170984 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834003bb0 con 0x7f783c15e600 2024-09-12T01:37:34.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.031+0000 7f784223c640 1 -- 172.21.15.60:0/2255170984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f783c151b40 con 0x7f783c15e600 2024-09-12T01:37:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.032+0000 7f784223c640 1 -- 172.21.15.60:0/2255170984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f783c0d1500 con 0x7f783c15e600 2024-09-12T01:37:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.033+0000 7f7823fff640 1 -- 172.21.15.60:0/2255170984 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f783400a7f0 con 0x7f783c15e600 2024-09-12T01:37:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.033+0000 7f7823fff640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f782806be30 0x7f782806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.033+0000 7f7823fff640 1 -- 172.21.15.60:0/2255170984 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f783408aa40 con 0x7f783c15e600 2024-09-12T01:37:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.034+0000 7f783b7fe640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f782806be30 0x7f782806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.034+0000 7f783b7fe640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f782806be30 0x7f782806e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f782c034000 tx=0x7f782c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:34.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.038+0000 7f7823fff640 1 -- 172.21.15.60:0/2255170984 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7834020020 con 0x7f783c15e600 2024-09-12T01:37:34.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.249+0000 7f784223c640 1 -- 172.21.15.60:0/2255170984 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f783c0d25f0 con 0x7f783c15e600 2024-09-12T01:37:34.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.910+0000 7f7823fff640 1 -- 172.21.15.60:0/2255170984 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7f783c0b7ad0 con 0x7f783c15e600 2024-09-12T01:37:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.912+0000 7f784223c640 1 -- 172.21.15.60:0/2255170984 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f782806be30 msgr2=0x7f782806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.912+0000 7f784223c640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f782806be30 0x7f782806e2f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f782c034000 tx=0x7f782c02e000 comp rx=0 tx=0).stop 2024-09-12T01:37:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.912+0000 7f784223c640 1 -- 172.21.15.60:0/2255170984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f783c15e600 msgr2=0x7f783c0d46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.912+0000 7f784223c640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f783c15e600 0x7f783c0d46a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f783400c7b0 tx=0x7f783400cc70 comp rx=0 tx=0).stop 2024-09-12T01:37:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.912+0000 7f784223c640 1 -- 172.21.15.60:0/2255170984 shutdown_connections 2024-09-12T01:37:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.912+0000 7f784223c640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f783c15e600 0x7f783c0d46a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.912+0000 7f784223c640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f783c0d1a40 0x7f783c156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.912+0000 7f784223c640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f782806be30 0x7f782806e2f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:34.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.912+0000 7f784223c640 1 --2- 172.21.15.60:0/2255170984 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f783c0cf4c0 0x7f783c145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.912+0000 7f784223c640 1 -- 172.21.15.60:0/2255170984 >> 172.21.15.60:0/2255170984 conn(0x7f783c06c2c0 msgr2=0x7f783c161290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.913+0000 7f784223c640 1 -- 172.21.15.60:0/2255170984 shutdown_connections 2024-09-12T01:37:34.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:34.913+0000 7f784223c640 1 -- 172.21.15.60:0/2255170984 wait complete. 2024-09-12T01:37:34.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:37:35.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.036+0000 7fce46cd0640 1 Processor -- start 2024-09-12T01:37:35.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.036+0000 7fce46cd0640 1 -- start start 2024-09-12T01:37:35.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.037+0000 7fce46cd0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fce400d1c80 0x7fce40162d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:35.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.037+0000 7fce46cd0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fce400b3360 0x7fce400d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:35.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.037+0000 7fce46cd0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce400cfe70 con 0x7fce40161be0 2024-09-12T01:37:35.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.037+0000 7fce46cd0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fce401632d0 con 0x7fce400d1c80 2024-09-12T01:37:35.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.037+0000 7fce46cd0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fce400cedd0 con 0x7fce400b3360 2024-09-12T01:37:35.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.037+0000 7fce3ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fce400d1c80 0x7fce40162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:35.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.037+0000 7fce44a6c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fce40161be0 0x7fce400d1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51798/0 (socket says 172.21.15.60:51798) 2024-09-12T01:37:35.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.037+0000 7fce44a6c640 1 -- 172.21.15.60:0/3863532366 learned_addr learned my addr 172.21.15.60:0/3863532366 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:35.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.037+0000 7fce3ffff640 1 -- 172.21.15.60:0/3863532366 >> v2:172.21.15.105:3300/0 conn(0x7fce400b3360 msgr2=0x7fce400d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:35.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.037+0000 7fce4526d640 1 --2- 172.21.15.60:0/3863532366 >> v2:172.21.15.105:3300/0 conn(0x7fce400b3360 0x7fce400d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:35.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.038+0000 7fce3ffff640 1 --2- 172.21.15.60:0/3863532366 >> v2:172.21.15.105:3300/0 conn(0x7fce400b3360 0x7fce400d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:35.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.038+0000 7fce3f7fe640 1 -- 172.21.15.60:0/3863532366 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 962997103 0 0) 0x7fce400cfe70 con 0x7fce40161be0 2024-09-12T01:37:35.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.038+0000 7fce3ffff640 1 -- 172.21.15.60:0/3863532366 >> v1:172.21.15.60:6789/0 conn(0x7fce40161be0 legacy=0x7fce400d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:35.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.038+0000 7fce3ffff640 1 -- 172.21.15.60:0/3863532366 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce400cf0b0 con 0x7fce400d1c80 2024-09-12T01:37:35.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.038+0000 7fce4526d640 1 --2- 172.21.15.60:0/3863532366 >> v2:172.21.15.105:3300/0 conn(0x7fce400b3360 0x7fce400d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:35.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.038+0000 7fce3ffff640 1 --2- 172.21.15.60:0/3863532366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce400d1c80 0x7fce40162d90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fce400d2820 tx=0x7fce3402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2414f47f27586d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:35.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.038+0000 7fce3f7fe640 1 -- 172.21.15.60:0/3863532366 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce34037070 con 0x7fce400d1c80 2024-09-12T01:37:35.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.038+0000 7fce3f7fe640 1 -- 172.21.15.60:0/3863532366 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce34032440 con 0x7fce400d1c80 2024-09-12T01:37:35.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.039+0000 7fce3f7fe640 1 -- 172.21.15.60:0/3863532366 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce3402ae60 con 0x7fce400d1c80 2024-09-12T01:37:35.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.039+0000 7fce46cd0640 1 -- 172.21.15.60:0/3863532366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce400d1c80 msgr2=0x7fce40162d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:35.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.039+0000 7fce46cd0640 1 --2- 172.21.15.60:0/3863532366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce400d1c80 0x7fce40162d90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fce400d2820 tx=0x7fce3402a110 comp rx=0 tx=0).stop 2024-09-12T01:37:35.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.039+0000 7fce46cd0640 1 -- 172.21.15.60:0/3863532366 shutdown_connections 2024-09-12T01:37:35.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.039+0000 7fce46cd0640 1 --2- 172.21.15.60:0/3863532366 >> v2:172.21.15.105:3300/0 conn(0x7fce400b3360 0x7fce400d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:35.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.039+0000 7fce46cd0640 1 --2- 172.21.15.60:0/3863532366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce400d1c80 0x7fce40162d90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:35.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.039+0000 7fce46cd0640 1 -- 172.21.15.60:0/3863532366 >> 172.21.15.60:0/3863532366 conn(0x7fce4006c2c0 msgr2=0x7fce4006c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:35.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.039+0000 7fce46cd0640 1 -- 172.21.15.60:0/3863532366 shutdown_connections 2024-09-12T01:37:35.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.039+0000 7fce46cd0640 1 -- 172.21.15.60:0/3863532366 wait complete. 2024-09-12T01:37:35.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.040+0000 7fce46cd0640 1 Processor -- start 2024-09-12T01:37:35.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.040+0000 7fce46cd0640 1 -- start start 2024-09-12T01:37:35.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.041+0000 7fce46cd0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce400b3360 0x7fce401f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:35.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.041+0000 7fce46cd0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce400d1c80 0x7fce4014e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:35.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.041+0000 7fce46cd0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce40161be0 0x7fce400b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:35.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.041+0000 7fce46cd0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fce400cf950 con 0x7fce400b3360 2024-09-12T01:37:35.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.041+0000 7fce46cd0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce400cf670 con 0x7fce40161be0 2024-09-12T01:37:35.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.041+0000 7fce46cd0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fce40161fc0 con 0x7fce400d1c80 2024-09-12T01:37:35.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.041+0000 7fce44a6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce400b3360 0x7fce401f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.041+0000 7fce44a6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce400b3360 0x7fce401f45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43856/0 (socket says 172.21.15.60:43856) 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.041+0000 7fce44a6c640 1 -- 172.21.15.60:0/4103219551 learned_addr learned my addr 172.21.15.60:0/4103219551 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce4526d640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce40161be0 0x7fce400b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce3ffff640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce400d1c80 0x7fce4014e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce44a6c640 1 -- 172.21.15.60:0/4103219551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce400d1c80 msgr2=0x7fce4014e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce44a6c640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce400d1c80 0x7fce4014e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce44a6c640 1 -- 172.21.15.60:0/4103219551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce40161be0 msgr2=0x7fce400b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce44a6c640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce40161be0 0x7fce400b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce44a6c640 1 -- 172.21.15.60:0/4103219551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce400cd8c0 con 0x7fce400b3360 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce44a6c640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce400b3360 0x7fce401f45f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fce3000c4d0 tx=0x7fce3000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce3d7fa640 1 -- 172.21.15.60:0/4103219551 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30018070 con 0x7fce400b3360 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce3d7fa640 1 -- 172.21.15.60:0/4103219551 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce30007500 con 0x7fce400b3360 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce46cd0640 1 -- 172.21.15.60:0/4103219551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce400cdba0 con 0x7fce400b3360 2024-09-12T01:37:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce3d7fa640 1 -- 172.21.15.60:0/4103219551 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce30004a20 con 0x7fce400b3360 2024-09-12T01:37:35.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.042+0000 7fce46cd0640 1 -- 172.21.15.60:0/4103219551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce400cb7b0 con 0x7fce400b3360 2024-09-12T01:37:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.043+0000 7fce46cd0640 1 -- 172.21.15.60:0/4103219551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce400ba3f0 con 0x7fce400b3360 2024-09-12T01:37:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.044+0000 7fce3d7fa640 1 -- 172.21.15.60:0/4103219551 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce3001b070 con 0x7fce400b3360 2024-09-12T01:37:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.044+0000 7fce3d7fa640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce2c06be30 0x7fce2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.044+0000 7fce3d7fa640 1 -- 172.21.15.60:0/4103219551 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7fce3008a190 con 0x7fce400b3360 2024-09-12T01:37:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.044+0000 7fce3ffff640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce2c06be30 0x7fce2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.045+0000 7fce3ffff640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce2c06be30 0x7fce2c06e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce34034000 tx=0x7fce3402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.048+0000 7fce3d7fa640 1 -- 172.21.15.60:0/4103219551 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce30058490 con 0x7fce400b3360 2024-09-12T01:37:35.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.224+0000 7fce46cd0640 1 -- 172.21.15.60:0/4103219551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fce400d2460 con 0x7fce400b3360 2024-09-12T01:37:35.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.911+0000 7fce3d7fa640 1 -- 172.21.15.60:0/4103219551 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7fce3005c790 con 0x7fce400b3360 2024-09-12T01:37:35.911 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:37:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.915+0000 7fce46cd0640 1 -- 172.21.15.60:0/4103219551 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce2c06be30 msgr2=0x7fce2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.915+0000 7fce46cd0640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce2c06be30 0x7fce2c06e2f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce34034000 tx=0x7fce3402e000 comp rx=0 tx=0).stop 2024-09-12T01:37:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.915+0000 7fce46cd0640 1 -- 172.21.15.60:0/4103219551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce400b3360 msgr2=0x7fce401f45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.915+0000 7fce46cd0640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce400b3360 0x7fce401f45f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fce3000c4d0 tx=0x7fce3000c990 comp rx=0 tx=0).stop 2024-09-12T01:37:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.916+0000 7fce46cd0640 1 -- 172.21.15.60:0/4103219551 shutdown_connections 2024-09-12T01:37:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.916+0000 7fce46cd0640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce40161be0 0x7fce400b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.916+0000 7fce46cd0640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce2c06be30 0x7fce2c06e2f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.916+0000 7fce46cd0640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce400d1c80 0x7fce4014e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.916+0000 7fce46cd0640 1 --2- 172.21.15.60:0/4103219551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce400b3360 0x7fce401f45f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:35.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.916+0000 7fce46cd0640 1 -- 172.21.15.60:0/4103219551 >> 172.21.15.60:0/4103219551 conn(0x7fce4006c2c0 msgr2=0x7fce400b9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.916+0000 7fce46cd0640 1 -- 172.21.15.60:0/4103219551 shutdown_connections 2024-09-12T01:37:35.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:35.916+0000 7fce46cd0640 1 -- 172.21.15.60:0/4103219551 wait complete. 2024-09-12T01:37:35.930 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:37:36.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.044+0000 7fb2698a6640 1 Processor -- start 2024-09-12T01:37:36.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.044+0000 7fb2698a6640 1 -- start start 2024-09-12T01:37:36.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.044+0000 7fb2698a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb2640b6290 0x7fb264071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:36.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.044+0000 7fb2698a6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb264072530 0x7fb26415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:36.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.044+0000 7fb2698a6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2640ccff0 con 0x7fb26415b480 2024-09-12T01:37:36.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.044+0000 7fb2698a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb2640cd2d0 con 0x7fb2640b6290 2024-09-12T01:37:36.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.044+0000 7fb2698a6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb2640cd5b0 con 0x7fb264072530 2024-09-12T01:37:36.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.045+0000 7fb2627fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb2640b6290 0x7fb264071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:36.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.045+0000 7fb262ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb26415b480 0x7fb2640b5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51808/0 (socket says 172.21.15.60:51808) 2024-09-12T01:37:36.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.045+0000 7fb262ffd640 1 -- 172.21.15.60:0/468932029 learned_addr learned my addr 172.21.15.60:0/468932029 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:36.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.045+0000 7fb2637fe640 1 --2- 172.21.15.60:0/468932029 >> v2:172.21.15.105:3300/0 conn(0x7fb264072530 0x7fb26415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:36.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.045+0000 7fb2627fc640 1 -- 172.21.15.60:0/468932029 >> v2:172.21.15.105:3300/0 conn(0x7fb264072530 msgr2=0x7fb26415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:36.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.045+0000 7fb2627fc640 1 --2- 172.21.15.60:0/468932029 >> v2:172.21.15.105:3300/0 conn(0x7fb264072530 0x7fb26415bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:36.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.045+0000 7fb2627fc640 1 -- 172.21.15.60:0/468932029 >> v1:172.21.15.60:6789/0 conn(0x7fb26415b480 legacy=0x7fb2640b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:36.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.045+0000 7fb2627fc640 1 -- 172.21.15.60:0/468932029 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2640cd890 con 0x7fb2640b6290 2024-09-12T01:37:36.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.045+0000 7fb261ffb640 1 -- 172.21.15.60:0/468932029 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 160894304 0 0) 0x7fb2640ccff0 con 0x7fb26415b480 2024-09-12T01:37:36.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.046+0000 7fb2627fc640 1 --2- 172.21.15.60:0/468932029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2640b6290 0x7fb264071ff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb2640733f0 tx=0x7fb25802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f4b6481206f4c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:36.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.046+0000 7fb261ffb640 1 -- 172.21.15.60:0/468932029 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb258037070 con 0x7fb2640b6290 2024-09-12T01:37:36.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.046+0000 7fb261ffb640 1 -- 172.21.15.60:0/468932029 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb258032440 con 0x7fb2640b6290 2024-09-12T01:37:36.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.046+0000 7fb261ffb640 1 -- 172.21.15.60:0/468932029 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25802ae60 con 0x7fb2640b6290 2024-09-12T01:37:36.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.046+0000 7fb2698a6640 1 -- 172.21.15.60:0/468932029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2640b6290 msgr2=0x7fb264071ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:36.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.046+0000 7fb2698a6640 1 --2- 172.21.15.60:0/468932029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2640b6290 0x7fb264071ff0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb2640733f0 tx=0x7fb25802a110 comp rx=0 tx=0).stop 2024-09-12T01:37:36.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.046+0000 7fb2698a6640 1 -- 172.21.15.60:0/468932029 shutdown_connections 2024-09-12T01:37:36.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.046+0000 7fb2698a6640 1 --2- 172.21.15.60:0/468932029 >> v2:172.21.15.105:3300/0 conn(0x7fb264072530 0x7fb26415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:36.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.046+0000 7fb2698a6640 1 --2- 172.21.15.60:0/468932029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2640b6290 0x7fb264071ff0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:36.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.046+0000 7fb2698a6640 1 -- 172.21.15.60:0/468932029 >> 172.21.15.60:0/468932029 conn(0x7fb26406d0f0 msgr2=0x7fb26406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:36.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.046+0000 7fb2698a6640 1 -- 172.21.15.60:0/468932029 shutdown_connections 2024-09-12T01:37:36.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.046+0000 7fb2698a6640 1 -- 172.21.15.60:0/468932029 wait complete. 2024-09-12T01:37:36.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.048+0000 7fb2698a6640 1 Processor -- start 2024-09-12T01:37:36.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.048+0000 7fb2698a6640 1 -- start start 2024-09-12T01:37:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2698a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb264072530 0x7fb2640ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2698a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb26415b480 0x7fb2640cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2698a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264152e50 0x7fb2641532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2698a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb26415b9e0 con 0x7fb264152e50 2024-09-12T01:37:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2698a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb26415b860 con 0x7fb26415b480 2024-09-12T01:37:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2698a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb26415c1a0 con 0x7fb264072530 2024-09-12T01:37:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264152e50 0x7fb2641532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264152e50 0x7fb2641532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43868/0 (socket says 172.21.15.60:43868) 2024-09-12T01:37:36.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2637fe640 1 -- 172.21.15.60:0/1781355049 learned_addr learned my addr 172.21.15.60:0/1781355049 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2627fc640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb26415b480 0x7fb2640cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb262ffd640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb264072530 0x7fb2640ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2637fe640 1 -- 172.21.15.60:0/1781355049 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb264072530 msgr2=0x7fb2640ce2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2637fe640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb264072530 0x7fb2640ce2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2637fe640 1 -- 172.21.15.60:0/1781355049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb26415b480 msgr2=0x7fb2640cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2637fe640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb26415b480 0x7fb2640cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2637fe640 1 -- 172.21.15.60:0/1781355049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2640ab210 con 0x7fb264152e50 2024-09-12T01:37:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb262ffd640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb264072530 0x7fb2640ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2637fe640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264152e50 0x7fb2641532d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb25c007e40 tx=0x7fb25c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb24bfff640 1 -- 172.21.15.60:0/1781355049 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c014620 con 0x7fb264152e50 2024-09-12T01:37:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb24bfff640 1 -- 172.21.15.60:0/1781355049 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb25c019070 con 0x7fb264152e50 2024-09-12T01:37:36.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2698a6640 1 -- 172.21.15.60:0/1781355049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2640ab4f0 con 0x7fb264152e50 2024-09-12T01:37:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb24bfff640 1 -- 172.21.15.60:0/1781355049 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c014a20 con 0x7fb264152e50 2024-09-12T01:37:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.049+0000 7fb2698a6640 1 -- 172.21.15.60:0/1781355049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2640abab0 con 0x7fb264152e50 2024-09-12T01:37:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.050+0000 7fb2698a6640 1 -- 172.21.15.60:0/1781355049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26415bc60 con 0x7fb264152e50 2024-09-12T01:37:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.051+0000 7fb24bfff640 1 -- 172.21.15.60:0/1781355049 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb25c014bc0 con 0x7fb264152e50 2024-09-12T01:37:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.051+0000 7fb24bfff640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb25006be30 0x7fb25006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.052+0000 7fb24bfff640 1 -- 172.21.15.60:0/1781355049 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7fb25c08b460 con 0x7fb264152e50 2024-09-12T01:37:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.052+0000 7fb262ffd640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb25006be30 0x7fb25006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:36.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.052+0000 7fb262ffd640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb25006be30 0x7fb25006e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb254000f60 tx=0x7fb254007cc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:36.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.056+0000 7fb24bfff640 1 -- 172.21.15.60:0/1781355049 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb25c05a000 con 0x7fb264152e50 2024-09-12T01:37:36.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.234+0000 7fb2698a6640 1 -- 172.21.15.60:0/1781355049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb2641f4040 con 0x7fb264152e50 2024-09-12T01:37:36.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.916+0000 7fb24bfff640 1 -- 172.21.15.60:0/1781355049 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7fb25c059900 con 0x7fb264152e50 2024-09-12T01:37:36.916 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-12T01:37:36.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.920+0000 7fb2698a6640 1 -- 172.21.15.60:0/1781355049 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb25006be30 msgr2=0x7fb25006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:36.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.920+0000 7fb2698a6640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb25006be30 0x7fb25006e2f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb254000f60 tx=0x7fb254007cc0 comp rx=0 tx=0).stop 2024-09-12T01:37:36.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.920+0000 7fb2698a6640 1 -- 172.21.15.60:0/1781355049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264152e50 msgr2=0x7fb2641532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:36.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.920+0000 7fb2698a6640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264152e50 0x7fb2641532d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb25c007e40 tx=0x7fb25c00e4b0 comp rx=0 tx=0).stop 2024-09-12T01:37:36.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.922+0000 7fb2698a6640 1 -- 172.21.15.60:0/1781355049 shutdown_connections 2024-09-12T01:37:36.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.922+0000 7fb2698a6640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb264152e50 0x7fb2641532d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:36.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.922+0000 7fb2698a6640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb26415b480 0x7fb2640cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:36.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.922+0000 7fb2698a6640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb25006be30 0x7fb25006e2f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:36.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.922+0000 7fb2698a6640 1 --2- 172.21.15.60:0/1781355049 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb264072530 0x7fb2640ce2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:36.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.922+0000 7fb2698a6640 1 -- 172.21.15.60:0/1781355049 >> 172.21.15.60:0/1781355049 conn(0x7fb26406d0f0 msgr2=0x7fb2640b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:36.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.923+0000 7fb2698a6640 1 -- 172.21.15.60:0/1781355049 shutdown_connections 2024-09-12T01:37:36.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:36.924+0000 7fb2698a6640 1 -- 172.21.15.60:0/1781355049 wait complete. 2024-09-12T01:37:36.938 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_session_cap_acquisition_throttle 2024-09-12T01:37:37.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.045+0000 7f594951a640 1 Processor -- start 2024-09-12T01:37:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.045+0000 7f594951a640 1 -- start start 2024-09-12T01:37:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.046+0000 7f594951a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59440d1c10 0x7f59440cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.046+0000 7f594951a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59440b7ad0 con 0x7f59440cf2f0 2024-09-12T01:37:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.046+0000 7f594951a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59440cf760 con 0x7f594415e600 2024-09-12T01:37:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.046+0000 7f594951a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f59440d2ee0 con 0x7f59440d1c10 2024-09-12T01:37:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.046+0000 7f59427fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59440d1c10 0x7f59440cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.046+0000 7f59427fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59440d1c10 0x7f59440cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43870/0 (socket says 172.21.15.60:43870) 2024-09-12T01:37:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.046+0000 7f59437fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f59440cf2f0 0x7f59440d3370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51820/0 (socket says 172.21.15.60:51820) 2024-09-12T01:37:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.046+0000 7f59427fc640 1 -- 172.21.15.60:0/329204414 learned_addr learned my addr 172.21.15.60:0/329204414 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.046+0000 7f59427fc640 1 -- 172.21.15.60:0/329204414 >> v1:172.21.15.105:6789/0 conn(0x7f594415e600 legacy=0x7f59440d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.046+0000 7f59427fc640 1 -- 172.21.15.60:0/329204414 >> v1:172.21.15.60:6789/0 conn(0x7f59440cf2f0 legacy=0x7f59440d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.046+0000 7f59427fc640 1 -- 172.21.15.60:0/329204414 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59440cf9e0 con 0x7f59440d1c10 2024-09-12T01:37:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.047+0000 7f59427fc640 1 --2- 172.21.15.60:0/329204414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59440d1c10 0x7f59440cedb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f59440d3060 tx=0x7f592c02a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b5240919cf67a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.047+0000 7f5941ffb640 1 -- 172.21.15.60:0/329204414 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c037070 con 0x7f59440d1c10 2024-09-12T01:37:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.047+0000 7f5941ffb640 1 -- 172.21.15.60:0/329204414 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f592c032640 con 0x7f59440d1c10 2024-09-12T01:37:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.047+0000 7f5941ffb640 1 -- 172.21.15.60:0/329204414 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c032a10 con 0x7f59440d1c10 2024-09-12T01:37:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.048+0000 7f594951a640 1 -- 172.21.15.60:0/329204414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59440d1c10 msgr2=0x7f59440cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.048+0000 7f594951a640 1 --2- 172.21.15.60:0/329204414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59440d1c10 0x7f59440cedb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f59440d3060 tx=0x7f592c02a2e0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.048+0000 7f594951a640 1 -- 172.21.15.60:0/329204414 shutdown_connections 2024-09-12T01:37:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.048+0000 7f594951a640 1 --2- 172.21.15.60:0/329204414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59440d1c10 0x7f59440cedb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.048+0000 7f594951a640 1 -- 172.21.15.60:0/329204414 >> 172.21.15.60:0/329204414 conn(0x7f594406c2c0 msgr2=0x7f594406c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.048+0000 7f594951a640 1 -- 172.21.15.60:0/329204414 shutdown_connections 2024-09-12T01:37:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.048+0000 7f594951a640 1 -- 172.21.15.60:0/329204414 wait complete. 2024-09-12T01:37:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.049+0000 7f594951a640 1 Processor -- start 2024-09-12T01:37:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.049+0000 7f594951a640 1 -- start start 2024-09-12T01:37:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f594951a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59440cf2f0 0x7f5944159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f594951a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59440d1c10 0x7f59441f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f594951a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f594415e600 0x7f59441e8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f594951a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f59440d2b70 con 0x7f59440d1c10 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f594951a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f59440cffa0 con 0x7f59440cf2f0 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f594951a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f594415e9e0 con 0x7f594415e600 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f59427fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59440d1c10 0x7f59441f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f59427fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59440d1c10 0x7f59441f5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43878/0 (socket says 172.21.15.60:43878) 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f59427fc640 1 -- 172.21.15.60:0/1615860946 learned_addr learned my addr 172.21.15.60:0/1615860946 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f5942ffd640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59440cf2f0 0x7f5944159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f59437fe640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f594415e600 0x7f59441e8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f59427fc640 1 -- 172.21.15.60:0/1615860946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f594415e600 msgr2=0x7f59441e8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f59427fc640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f594415e600 0x7f59441e8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f59427fc640 1 -- 172.21.15.60:0/1615860946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59440cf2f0 msgr2=0x7f5944159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.050+0000 7f59427fc640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59440cf2f0 0x7f5944159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.051+0000 7f59427fc640 1 -- 172.21.15.60:0/1615860946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594415a860 con 0x7f59440d1c10 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.051+0000 7f59427fc640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59440d1c10 0x7f59441f5590 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f592c02a320 tx=0x7f592c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.051+0000 7f593b7fe640 1 -- 172.21.15.60:0/1615860946 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c037040 con 0x7f59440d1c10 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.051+0000 7f593b7fe640 1 -- 172.21.15.60:0/1615860946 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f592c042070 con 0x7f59440d1c10 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.051+0000 7f594951a640 1 -- 172.21.15.60:0/1615860946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594415ab40 con 0x7f59440d1c10 2024-09-12T01:37:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.051+0000 7f593b7fe640 1 -- 172.21.15.60:0/1615860946 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c030bb0 con 0x7f59440d1c10 2024-09-12T01:37:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.051+0000 7f594951a640 1 -- 172.21.15.60:0/1615860946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594415b100 con 0x7f59440d1c10 2024-09-12T01:37:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.052+0000 7f594951a640 1 -- 172.21.15.60:0/1615860946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59440cedb0 con 0x7f59440d1c10 2024-09-12T01:37:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.052+0000 7f593b7fe640 1 -- 172.21.15.60:0/1615860946 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f592c032500 con 0x7f59440d1c10 2024-09-12T01:37:37.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.053+0000 7f593b7fe640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f592406be60 0x7f592406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.053+0000 7f593b7fe640 1 -- 172.21.15.60:0/1615860946 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f592c0ab5a0 con 0x7f59440d1c10 2024-09-12T01:37:37.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.053+0000 7f5942ffd640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f592406be60 0x7f592406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.053+0000 7f5942ffd640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f592406be60 0x7f592406e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f593c0016e0 tx=0x7f593c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:37.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.057+0000 7f593b7fe640 1 -- 172.21.15.60:0/1615860946 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f592c079b70 con 0x7f59440d1c10 2024-09-12T01:37:37.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.230+0000 7f594951a640 1 -- 172.21.15.60:0/1615860946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_session_cap_acquisition_throttle"} v 0) -- 0x7f59440d25f0 con 0x7f59440d1c10 2024-09-12T01:37:37.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.233+0000 7f593b7fe640 1 -- 172.21.15.60:0/1615860946 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_session_cap_acquisition_throttle"}]=0 v13) ==== 119+0+0 (secure 0 0 0) 0x7f592c07de70 con 0x7f59440d1c10 2024-09-12T01:37:37.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.235+0000 7f594951a640 1 -- 172.21.15.60:0/1615860946 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f592406be60 msgr2=0x7f592406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.235+0000 7f594951a640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f592406be60 0x7f592406e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f593c0016e0 tx=0x7f593c009040 comp rx=0 tx=0).stop 2024-09-12T01:37:37.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.235+0000 7f594951a640 1 -- 172.21.15.60:0/1615860946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59440d1c10 msgr2=0x7f59441f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.235+0000 7f594951a640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59440d1c10 0x7f59441f5590 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f592c02a320 tx=0x7f592c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.235+0000 7f594951a640 1 -- 172.21.15.60:0/1615860946 shutdown_connections 2024-09-12T01:37:37.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.235+0000 7f594951a640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f592406be60 0x7f592406e320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.235+0000 7f594951a640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f594415e600 0x7f59441e8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.235+0000 7f594951a640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59440d1c10 0x7f59441f5590 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.235+0000 7f594951a640 1 --2- 172.21.15.60:0/1615860946 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f59440cf2f0 0x7f5944159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.235+0000 7f594951a640 1 -- 172.21.15.60:0/1615860946 >> 172.21.15.60:0/1615860946 conn(0x7f594406c2c0 msgr2=0x7f59440d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:37.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.236+0000 7f594951a640 1 -- 172.21.15.60:0/1615860946 shutdown_connections 2024-09-12T01:37:37.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.236+0000 7f594951a640 1 -- 172.21.15.60:0/1615860946 wait complete. 2024-09-12T01:37:37.246 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_max_caps_per_client 2024-09-12T01:37:37.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.355+0000 7f4ffca0e640 1 Processor -- start 2024-09-12T01:37:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.355+0000 7f4ffca0e640 1 -- start start 2024-09-12T01:37:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.356+0000 7f4ffca0e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ff80cf1f0 0x7f4ff80b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.356+0000 7f4ffca0e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80b6720 0x7f4ff80d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.356+0000 7f4ffca0e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff80cf860 con 0x7f4ff815e7a0 2024-09-12T01:37:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.356+0000 7f4ffca0e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4ff80d2ca0 con 0x7f4ff80cf1f0 2024-09-12T01:37:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.356+0000 7f4ffca0e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff80cfb40 con 0x7f4ff80b6720 2024-09-12T01:37:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.356+0000 7f4ff5d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ff80cf1f0 0x7f4ff80b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.356+0000 7f4ff5d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ff80cf1f0 0x7f4ff80b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43892/0 (socket says 172.21.15.60:43892) 2024-09-12T01:37:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.356+0000 7f4ff5d9b640 1 -- 172.21.15.60:0/2978543142 learned_addr learned my addr 172.21.15.60:0/2978543142 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.356+0000 7f4ff659c640 1 --1- 172.21.15.60:0/2978543142 >> v1:172.21.15.60:6789/0 conn(0x7f4ff815e7a0 0x7f4ff806caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51836/0 (socket says 172.21.15.60:51836) 2024-09-12T01:37:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.356+0000 7f4ff6d9d640 1 --2- 172.21.15.60:0/2978543142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80b6720 0x7f4ff80d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.357+0000 7f4ff5d9b640 1 -- 172.21.15.60:0/2978543142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80b6720 msgr2=0x7f4ff80d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.357+0000 7f4ff5d9b640 1 --2- 172.21.15.60:0/2978543142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80b6720 0x7f4ff80d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.357+0000 7f4ff5d9b640 1 -- 172.21.15.60:0/2978543142 >> v1:172.21.15.60:6789/0 conn(0x7f4ff815e7a0 legacy=0x7f4ff806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.357+0000 7f4ff5d9b640 1 -- 172.21.15.60:0/2978543142 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff80cfe20 con 0x7f4ff80cf1f0 2024-09-12T01:37:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.357+0000 7f4ff559a640 1 -- 172.21.15.60:0/2978543142 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3825982645 0 0) 0x7f4ff80cf860 con 0x7f4ff815e7a0 2024-09-12T01:37:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.357+0000 7f4ff5d9b640 1 --2- 172.21.15.60:0/2978543142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf1f0 0x7f4ff80b61e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009870 tx=0x7f4fec02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465215b754d83aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.357+0000 7f4ff559a640 1 -- 172.21.15.60:0/2978543142 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec037070 con 0x7f4ff80cf1f0 2024-09-12T01:37:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.358+0000 7f4ff559a640 1 -- 172.21.15.60:0/2978543142 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fec032440 con 0x7f4ff80cf1f0 2024-09-12T01:37:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.358+0000 7f4ff559a640 1 -- 172.21.15.60:0/2978543142 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fec032810 con 0x7f4ff80cf1f0 2024-09-12T01:37:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.358+0000 7f4ffca0e640 1 -- 172.21.15.60:0/2978543142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf1f0 msgr2=0x7f4ff80b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.358+0000 7f4ffca0e640 1 --2- 172.21.15.60:0/2978543142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf1f0 0x7f4ff80b61e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4fec009870 tx=0x7f4fec02a1c0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.358+0000 7f4ffca0e640 1 -- 172.21.15.60:0/2978543142 shutdown_connections 2024-09-12T01:37:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.358+0000 7f4ffca0e640 1 --2- 172.21.15.60:0/2978543142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80b6720 0x7f4ff80d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.358+0000 7f4ffca0e640 1 --2- 172.21.15.60:0/2978543142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf1f0 0x7f4ff80b61e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.358+0000 7f4ffca0e640 1 -- 172.21.15.60:0/2978543142 >> 172.21.15.60:0/2978543142 conn(0x7f4ff80d11e0 msgr2=0x7f4ff80d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.358+0000 7f4ffca0e640 1 -- 172.21.15.60:0/2978543142 shutdown_connections 2024-09-12T01:37:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.358+0000 7f4ffca0e640 1 -- 172.21.15.60:0/2978543142 wait complete. 2024-09-12T01:37:37.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.360+0000 7f4ffca0e640 1 Processor -- start 2024-09-12T01:37:37.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.360+0000 7f4ffca0e640 1 -- start start 2024-09-12T01:37:37.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.360+0000 7f4ffca0e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80b6720 0x7f4ff80ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.360+0000 7f4ffca0e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ff80cf1f0 0x7f4ff81f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.360+0000 7f4ffca0e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff815e7a0 0x7f4ff80d4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.360+0000 7f4ffca0e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff815eb80 con 0x7f4ff80b6720 2024-09-12T01:37:37.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.360+0000 7f4ffca0e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff80b7a00 con 0x7f4ff80cf1f0 2024-09-12T01:37:37.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.360+0000 7f4ffca0e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff815ed00 con 0x7f4ff815e7a0 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.360+0000 7f4ff659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80b6720 0x7f4ff80ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ff659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80b6720 0x7f4ff80ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43900/0 (socket says 172.21.15.60:43900) 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ff659c640 1 -- 172.21.15.60:0/367344398 learned_addr learned my addr 172.21.15.60:0/367344398 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ff6d9d640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff815e7a0 0x7f4ff80d4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ff5d9b640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ff80cf1f0 0x7f4ff81f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ff659c640 1 -- 172.21.15.60:0/367344398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff815e7a0 msgr2=0x7f4ff80d4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ff659c640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff815e7a0 0x7f4ff80d4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ff659c640 1 -- 172.21.15.60:0/367344398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ff80cf1f0 msgr2=0x7f4ff81f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ff659c640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ff80cf1f0 0x7f4ff81f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ff659c640 1 -- 172.21.15.60:0/367344398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff81f80c0 con 0x7f4ff80b6720 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ff5d9b640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ff80cf1f0 0x7f4ff81f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ff6d9d640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff815e7a0 0x7f4ff80d4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:37.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ff659c640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80b6720 0x7f4ff80ce8d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800c430 tx=0x7f4fe800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:37.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4fe6ffd640 1 -- 172.21.15.60:0/367344398 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe80074e0 con 0x7f4ff80b6720 2024-09-12T01:37:37.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4fe6ffd640 1 -- 172.21.15.60:0/367344398 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe80047e0 con 0x7f4ff80b6720 2024-09-12T01:37:37.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ffca0e640 1 -- 172.21.15.60:0/367344398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff81f83a0 con 0x7f4ff80b6720 2024-09-12T01:37:37.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4fe6ffd640 1 -- 172.21.15.60:0/367344398 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8004bd0 con 0x7f4ff80b6720 2024-09-12T01:37:37.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.361+0000 7f4ffca0e640 1 -- 172.21.15.60:0/367344398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff8158bf0 con 0x7f4ff80b6720 2024-09-12T01:37:37.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.362+0000 7f4ffca0e640 1 -- 172.21.15.60:0/367344398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff80b61e0 con 0x7f4ff80b6720 2024-09-12T01:37:37.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.363+0000 7f4fe6ffd640 1 -- 172.21.15.60:0/367344398 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fe8011070 con 0x7f4ff80b6720 2024-09-12T01:37:37.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.363+0000 7f4fe6ffd640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fd806be30 0x7f4fd806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.363+0000 7f4fe6ffd640 1 -- 172.21.15.60:0/367344398 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f4fe808a800 con 0x7f4ff80b6720 2024-09-12T01:37:37.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.363+0000 7f4ff5d9b640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fd806be30 0x7f4fd806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.364+0000 7f4ff5d9b640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fd806be30 0x7f4fd806e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4fec034000 tx=0x7f4fec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:37.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.367+0000 7f4fe6ffd640 1 -- 172.21.15.60:0/367344398 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4fe800e280 con 0x7f4ff80b6720 2024-09-12T01:37:37.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.545+0000 7f4ffca0e640 1 -- 172.21.15.60:0/367344398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"} v 0) -- 0x7f4ff80d2a80 con 0x7f4ff80b6720 2024-09-12T01:37:37.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.548+0000 7f4fe6ffd640 1 -- 172.21.15.60:0/367344398 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"}]=0 v14) ==== 106+0+0 (secure 0 0 0) 0x7f4fe80594b0 con 0x7f4ff80b6720 2024-09-12T01:37:37.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.551+0000 7f4ffca0e640 1 -- 172.21.15.60:0/367344398 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fd806be30 msgr2=0x7f4fd806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.551+0000 7f4ffca0e640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fd806be30 0x7f4fd806e2f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4fec034000 tx=0x7f4fec02e000 comp rx=0 tx=0).stop 2024-09-12T01:37:37.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.551+0000 7f4ffca0e640 1 -- 172.21.15.60:0/367344398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80b6720 msgr2=0x7f4ff80ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.551+0000 7f4ffca0e640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80b6720 0x7f4ff80ce8d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4fe800c430 tx=0x7f4fe800c8f0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.551+0000 7f4ffca0e640 1 -- 172.21.15.60:0/367344398 shutdown_connections 2024-09-12T01:37:37.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.551+0000 7f4ffca0e640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fd806be30 0x7f4fd806e2f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.551+0000 7f4ffca0e640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff815e7a0 0x7f4ff80d4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.551+0000 7f4ffca0e640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ff80cf1f0 0x7f4ff81f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.551+0000 7f4ffca0e640 1 --2- 172.21.15.60:0/367344398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80b6720 0x7f4ff80ce8d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.551+0000 7f4ffca0e640 1 -- 172.21.15.60:0/367344398 >> 172.21.15.60:0/367344398 conn(0x7f4ff80d11e0 msgr2=0x7f4ff815c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:37.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.551+0000 7f4ffca0e640 1 -- 172.21.15.60:0/367344398 shutdown_connections 2024-09-12T01:37:37.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.551+0000 7f4ffca0e640 1 -- 172.21.15.60:0/367344398 wait complete. 2024-09-12T01:37:37.561 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T01:37:37.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.665+0000 7f3d468e6640 1 Processor -- start 2024-09-12T01:37:37.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.666+0000 7f3d468e6640 1 -- start start 2024-09-12T01:37:37.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.666+0000 7f3d468e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d4015e7a0 0x7f3d4006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.666+0000 7f3d468e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d400cf1f0 0x7f3d400b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.666+0000 7f3d468e6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3d400b6720 0x7f3d401623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.666+0000 7f3d468e6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3d400d2ca0 con 0x7f3d400cf1f0 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.666+0000 7f3d468e6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3d400cf860 con 0x7f3d400b6720 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.666+0000 7f3d468e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3d400cfb40 con 0x7f3d4015e7a0 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.667+0000 7f3d3f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d400cf1f0 0x7f3d400b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.667+0000 7f3d3f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d400cf1f0 0x7f3d400b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43902/0 (socket says 172.21.15.60:43902) 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.667+0000 7f3d3f7fe640 1 -- 172.21.15.60:0/3731370997 learned_addr learned my addr 172.21.15.60:0/3731370997 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.667+0000 7f3d3ffff640 1 --2- 172.21.15.60:0/3731370997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d4015e7a0 0x7f3d4006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.667+0000 7f3d44e83640 1 --2- 172.21.15.60:0/3731370997 >> v2:172.21.15.105:3300/0 conn(0x7f3d400b6720 0x7f3d401623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.667+0000 7f3d3f7fe640 1 -- 172.21.15.60:0/3731370997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d4015e7a0 msgr2=0x7f3d4006caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.667+0000 7f3d3f7fe640 1 --2- 172.21.15.60:0/3731370997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d4015e7a0 0x7f3d4006caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.667+0000 7f3d3f7fe640 1 -- 172.21.15.60:0/3731370997 >> v2:172.21.15.105:3300/0 conn(0x7f3d400b6720 msgr2=0x7f3d401623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.667+0000 7f3d3f7fe640 1 --2- 172.21.15.60:0/3731370997 >> v2:172.21.15.105:3300/0 conn(0x7f3d400b6720 0x7f3d401623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.667+0000 7f3d3f7fe640 1 -- 172.21.15.60:0/3731370997 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d400cfe20 con 0x7f3d400cf1f0 2024-09-12T01:37:37.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.667+0000 7f3d3ffff640 1 --2- 172.21.15.60:0/3731370997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d4015e7a0 0x7f3d4006caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d3f7fe640 1 --2- 172.21.15.60:0/3731370997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d400cf1f0 0x7f3d400b61e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3d40163460 tx=0x7f3d3402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b9c5d6c5f13c7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d3effd640 1 -- 172.21.15.60:0/3731370997 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34037070 con 0x7f3d400cf1f0 2024-09-12T01:37:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d3effd640 1 -- 172.21.15.60:0/3731370997 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d34032440 con 0x7f3d400cf1f0 2024-09-12T01:37:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d3effd640 1 -- 172.21.15.60:0/3731370997 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d34032810 con 0x7f3d400cf1f0 2024-09-12T01:37:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d468e6640 1 -- 172.21.15.60:0/3731370997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d400cf1f0 msgr2=0x7f3d400b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d468e6640 1 --2- 172.21.15.60:0/3731370997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d400cf1f0 0x7f3d400b61e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3d40163460 tx=0x7f3d3402a140 comp rx=0 tx=0).stop 2024-09-12T01:37:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d468e6640 1 -- 172.21.15.60:0/3731370997 shutdown_connections 2024-09-12T01:37:37.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d468e6640 1 --2- 172.21.15.60:0/3731370997 >> v2:172.21.15.105:3300/0 conn(0x7f3d400b6720 0x7f3d401623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d468e6640 1 --2- 172.21.15.60:0/3731370997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d400cf1f0 0x7f3d400b61e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d468e6640 1 --2- 172.21.15.60:0/3731370997 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d4015e7a0 0x7f3d4006caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d468e6640 1 -- 172.21.15.60:0/3731370997 >> 172.21.15.60:0/3731370997 conn(0x7f3d400d11e0 msgr2=0x7f3d400d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:37.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d468e6640 1 -- 172.21.15.60:0/3731370997 shutdown_connections 2024-09-12T01:37:37.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.668+0000 7f3d468e6640 1 -- 172.21.15.60:0/3731370997 wait complete. 2024-09-12T01:37:37.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.670+0000 7f3d468e6640 1 Processor -- start 2024-09-12T01:37:37.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.670+0000 7f3d468e6640 1 -- start start 2024-09-12T01:37:37.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.670+0000 7f3d468e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d400b6720 0x7f3d400caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.670+0000 7f3d468e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d400cf1f0 0x7f3d400c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d468e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d4015e7a0 0x7f3d400ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d468e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4006cfe0 con 0x7f3d4015e7a0 2024-09-12T01:37:37.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d468e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3d400b7a00 con 0x7f3d400cf1f0 2024-09-12T01:37:37.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d468e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4015eb80 con 0x7f3d400b6720 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d44e83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d4015e7a0 0x7f3d400ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d44e83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d4015e7a0 0x7f3d400ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43906/0 (socket says 172.21.15.60:43906) 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d44e83640 1 -- 172.21.15.60:0/2366979900 learned_addr learned my addr 172.21.15.60:0/2366979900 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d3ffff640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d400b6720 0x7f3d400caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d3f7fe640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d400cf1f0 0x7f3d400c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d44e83640 1 -- 172.21.15.60:0/2366979900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d400b6720 msgr2=0x7f3d400caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d44e83640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d400b6720 0x7f3d400caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d44e83640 1 -- 172.21.15.60:0/2366979900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d400cf1f0 msgr2=0x7f3d400c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d44e83640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d400cf1f0 0x7f3d400c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d44e83640 1 -- 172.21.15.60:0/2366979900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d40161580 con 0x7f3d4015e7a0 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d44e83640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d4015e7a0 0x7f3d400ca450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3d38007d20 tx=0x7f3d3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d3cff9640 1 -- 172.21.15.60:0/2366979900 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38014420 con 0x7f3d4015e7a0 2024-09-12T01:37:37.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d3cff9640 1 -- 172.21.15.60:0/2366979900 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d38019070 con 0x7f3d4015e7a0 2024-09-12T01:37:37.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d468e6640 1 -- 172.21.15.60:0/2366979900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d40161860 con 0x7f3d4015e7a0 2024-09-12T01:37:37.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d3cff9640 1 -- 172.21.15.60:0/2366979900 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d38014820 con 0x7f3d4015e7a0 2024-09-12T01:37:37.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.671+0000 7f3d468e6640 1 -- 172.21.15.60:0/2366979900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d400c8160 con 0x7f3d4015e7a0 2024-09-12T01:37:37.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.673+0000 7f3d468e6640 1 -- 172.21.15.60:0/2366979900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d400b61e0 con 0x7f3d4015e7a0 2024-09-12T01:37:37.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.673+0000 7f3d3cff9640 1 -- 172.21.15.60:0/2366979900 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3d380149c0 con 0x7f3d4015e7a0 2024-09-12T01:37:37.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.673+0000 7f3d3cff9640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3d2c06be60 0x7f3d2c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.674+0000 7f3d3cff9640 1 -- 172.21.15.60:0/2366979900 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f3d3808b150 con 0x7f3d4015e7a0 2024-09-12T01:37:37.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.674+0000 7f3d3ffff640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3d2c06be60 0x7f3d2c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.674+0000 7f3d3ffff640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3d2c06be60 0x7f3d2c06e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d30006fd0 tx=0x7f3d30008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:37.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.678+0000 7f3d3cff9640 1 -- 172.21.15.60:0/2366979900 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3d38059840 con 0x7f3d4015e7a0 2024-09-12T01:37:37.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.850+0000 7f3d468e6640 1 -- 172.21.15.60:0/2366979900 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f3d400d2a80 con 0x7f3d4015e7a0 2024-09-12T01:37:37.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.854+0000 7f3d3cff9640 1 -- 172.21.15.60:0/2366979900 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7f3d3805db40 con 0x7f3d4015e7a0 2024-09-12T01:37:37.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.856+0000 7f3d468e6640 1 -- 172.21.15.60:0/2366979900 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3d2c06be60 msgr2=0x7f3d2c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.856+0000 7f3d468e6640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3d2c06be60 0x7f3d2c06e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3d30006fd0 tx=0x7f3d30008040 comp rx=0 tx=0).stop 2024-09-12T01:37:37.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.856+0000 7f3d468e6640 1 -- 172.21.15.60:0/2366979900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d4015e7a0 msgr2=0x7f3d400ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.856+0000 7f3d468e6640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d4015e7a0 0x7f3d400ca450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3d38007d20 tx=0x7f3d3800e4b0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.856+0000 7f3d468e6640 1 -- 172.21.15.60:0/2366979900 shutdown_connections 2024-09-12T01:37:37.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.856+0000 7f3d468e6640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d4015e7a0 0x7f3d400ca450 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.856+0000 7f3d468e6640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3d400cf1f0 0x7f3d400c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.856+0000 7f3d468e6640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3d2c06be60 0x7f3d2c06e320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.856+0000 7f3d468e6640 1 --2- 172.21.15.60:0/2366979900 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3d400b6720 0x7f3d400caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.856+0000 7f3d468e6640 1 -- 172.21.15.60:0/2366979900 >> 172.21.15.60:0/2366979900 conn(0x7f3d400d11e0 msgr2=0x7f3d400d3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:37.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.856+0000 7f3d468e6640 1 -- 172.21.15.60:0/2366979900 shutdown_connections 2024-09-12T01:37:37.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.856+0000 7f3d468e6640 1 -- 172.21.15.60:0/2366979900 wait complete. 2024-09-12T01:37:37.867 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir' 2024-09-12T01:37:37.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.971+0000 7fbe68bfd640 1 Processor -- start 2024-09-12T01:37:37.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.971+0000 7fbe68bfd640 1 -- start start 2024-09-12T01:37:37.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe68bfd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbe6415e660 0x7fbe640cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe68bfd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe640d3310 0x7fbe640d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe68bfd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe6415ea40 con 0x7fbe640d1650 2024-09-12T01:37:37.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe68bfd640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbe640d1ac0 con 0x7fbe640d3310 2024-09-12T01:37:37.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe68bfd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbe640d3870 con 0x7fbe6415e660 2024-09-12T01:37:37.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe61d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe640d3310 0x7fbe640d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe61d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe640d3310 0x7fbe640d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43910/0 (socket says 172.21.15.60:43910) 2024-09-12T01:37:37.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe61d9b640 1 -- 172.21.15.60:0/1383981991 learned_addr learned my addr 172.21.15.60:0/1383981991 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:37.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe62d9d640 1 --1- 172.21.15.60:0/1383981991 >> v1:172.21.15.60:6789/0 conn(0x7fbe640d1650 0x7fbe6406bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51842/0 (socket says 172.21.15.60:51842) 2024-09-12T01:37:37.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe6259c640 1 --2- 172.21.15.60:0/1383981991 >> v2:172.21.15.105:3300/0 conn(0x7fbe6415e660 0x7fbe640cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe61d9b640 1 -- 172.21.15.60:0/1383981991 >> v2:172.21.15.105:3300/0 conn(0x7fbe6415e660 msgr2=0x7fbe640cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:37.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe61d9b640 1 --2- 172.21.15.60:0/1383981991 >> v2:172.21.15.105:3300/0 conn(0x7fbe6415e660 0x7fbe640cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe61d9b640 1 -- 172.21.15.60:0/1383981991 >> v1:172.21.15.60:6789/0 conn(0x7fbe640d1650 legacy=0x7fbe6406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.972+0000 7fbe61d9b640 1 -- 172.21.15.60:0/1383981991 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe640d3b50 con 0x7fbe640d3310 2024-09-12T01:37:37.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.973+0000 7fbe61d9b640 1 --2- 172.21.15.60:0/1383981991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe640d3310 0x7fbe640d1110 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbe640d10e0 tx=0x7fbe5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1addc85541a0066d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:37.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.973+0000 7fbe6159a640 1 -- 172.21.15.60:0/1383981991 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58037070 con 0x7fbe640d3310 2024-09-12T01:37:37.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.973+0000 7fbe6159a640 1 -- 172.21.15.60:0/1383981991 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe58032440 con 0x7fbe640d3310 2024-09-12T01:37:37.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.973+0000 7fbe6159a640 1 -- 172.21.15.60:0/1383981991 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58032810 con 0x7fbe640d3310 2024-09-12T01:37:37.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.974+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1383981991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe640d3310 msgr2=0x7fbe640d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.974+0000 7fbe68bfd640 1 --2- 172.21.15.60:0/1383981991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe640d3310 0x7fbe640d1110 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbe640d10e0 tx=0x7fbe5802a270 comp rx=0 tx=0).stop 2024-09-12T01:37:37.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.974+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1383981991 shutdown_connections 2024-09-12T01:37:37.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.974+0000 7fbe68bfd640 1 --2- 172.21.15.60:0/1383981991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe640d3310 0x7fbe640d1110 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.974+0000 7fbe68bfd640 1 --2- 172.21.15.60:0/1383981991 >> v2:172.21.15.105:3300/0 conn(0x7fbe6415e660 0x7fbe640cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.974+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1383981991 >> 172.21.15.60:0/1383981991 conn(0x7fbe640b6410 msgr2=0x7fbe640b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:37.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.974+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1383981991 shutdown_connections 2024-09-12T01:37:37.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.974+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1383981991 wait complete. 2024-09-12T01:37:37.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.975+0000 7fbe68bfd640 1 Processor -- start 2024-09-12T01:37:37.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.975+0000 7fbe68bfd640 1 -- start start 2024-09-12T01:37:37.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe68bfd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe640d1650 0x7fbe6414d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe68bfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe640d3310 0x7fbe6415ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe68bfd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6415e660 0x7fbe6415bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe68bfd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbe640d43f0 con 0x7fbe640d1650 2024-09-12T01:37:37.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe68bfd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe640d4110 con 0x7fbe6415e660 2024-09-12T01:37:37.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe68bfd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbe640cfc70 con 0x7fbe640d3310 2024-09-12T01:37:37.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe6259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe640d1650 0x7fbe6414d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe6259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe640d1650 0x7fbe6414d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43920/0 (socket says 172.21.15.60:43920) 2024-09-12T01:37:37.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe6259c640 1 -- 172.21.15.60:0/1477568916 learned_addr learned my addr 172.21.15.60:0/1477568916 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:37.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe62d9d640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6415e660 0x7fbe6415bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe61d9b640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe640d3310 0x7fbe6415ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe6259c640 1 -- 172.21.15.60:0/1477568916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe640d3310 msgr2=0x7fbe6415ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe6259c640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe640d3310 0x7fbe6415ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe6259c640 1 -- 172.21.15.60:0/1477568916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6415e660 msgr2=0x7fbe6415bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:37.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe6259c640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6415e660 0x7fbe6415bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:37.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe6259c640 1 -- 172.21.15.60:0/1477568916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6415f660 con 0x7fbe640d1650 2024-09-12T01:37:37.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.976+0000 7fbe61d9b640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe640d3310 0x7fbe6415ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:37.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.977+0000 7fbe6259c640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe640d1650 0x7fbe6414d4b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400d800 tx=0x7fbe5400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:37.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.977+0000 7fbe52ffd640 1 -- 172.21.15.60:0/1477568916 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5400b6c0 con 0x7fbe640d1650 2024-09-12T01:37:37.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.977+0000 7fbe52ffd640 1 -- 172.21.15.60:0/1477568916 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe54019070 con 0x7fbe640d1650 2024-09-12T01:37:37.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.977+0000 7fbe52ffd640 1 -- 172.21.15.60:0/1477568916 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5400ba80 con 0x7fbe640d1650 2024-09-12T01:37:37.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.977+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1477568916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6415f940 con 0x7fbe640d1650 2024-09-12T01:37:37.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.977+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1477568916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe6414df00 con 0x7fbe640d1650 2024-09-12T01:37:37.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.978+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1477568916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe640d1110 con 0x7fbe640d1650 2024-09-12T01:37:37.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.978+0000 7fbe52ffd640 1 -- 172.21.15.60:0/1477568916 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe5400bc20 con 0x7fbe640d1650 2024-09-12T01:37:37.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.979+0000 7fbe52ffd640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe4406be30 0x7fbe4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:37.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.979+0000 7fbe52ffd640 1 -- 172.21.15.60:0/1477568916 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fbe5408af60 con 0x7fbe640d1650 2024-09-12T01:37:37.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.979+0000 7fbe61d9b640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe4406be30 0x7fbe4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:37.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.979+0000 7fbe61d9b640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe4406be30 0x7fbe4406e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe58034000 tx=0x7fbe5802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:37.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:37.983+0000 7fbe52ffd640 1 -- 172.21.15.60:0/1477568916 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe54059c10 con 0x7fbe640d1650 2024-09-12T01:37:38.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.224+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1477568916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]} v 0) -- 0x7fbe6406d2a0 con 0x7fbe640d1650 2024-09-12T01:37:38.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.925+0000 7fbe52ffd640 1 -- 172.21.15.60:0/1477568916 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_cap_acquisition_throttle_readdir"]}]=0 v104) ==== 165+0+0 (secure 0 0 0) 0x7fbe54059510 con 0x7fbe640d1650 2024-09-12T01:37:38.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.928+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1477568916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe4406be30 msgr2=0x7fbe4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:38.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.928+0000 7fbe68bfd640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe4406be30 0x7fbe4406e2f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe58034000 tx=0x7fbe5802e000 comp rx=0 tx=0).stop 2024-09-12T01:37:38.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.928+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1477568916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe640d1650 msgr2=0x7fbe6414d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:38.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.928+0000 7fbe68bfd640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe640d1650 0x7fbe6414d4b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbe5400d800 tx=0x7fbe5400dcc0 comp rx=0 tx=0).stop 2024-09-12T01:37:38.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.928+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1477568916 shutdown_connections 2024-09-12T01:37:38.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.928+0000 7fbe68bfd640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6415e660 0x7fbe6415bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:38.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.928+0000 7fbe68bfd640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe4406be30 0x7fbe4406e2f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:38.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.928+0000 7fbe68bfd640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe640d3310 0x7fbe6415ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:38.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.928+0000 7fbe68bfd640 1 --2- 172.21.15.60:0/1477568916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe640d1650 0x7fbe6414d4b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:38.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.928+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1477568916 >> 172.21.15.60:0/1477568916 conn(0x7fbe640b6410 msgr2=0x7fbe640b9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:38.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.928+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1477568916 shutdown_connections 2024-09-12T01:37:38.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:38.928+0000 7fbe68bfd640 1 -- 172.21.15.60:0/1477568916 wait complete. 2024-09-12T01:37:38.942 INFO:tasks.cephfs_test_runner:Mostly readdir acquires caps faster than the mds recalls, so the cap ... ok 2024-09-12T01:37:38.942 INFO:tasks.cephfs_test_runner:Starting test: test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) that a client is blocklisted when its encoded session metadata exceeds the 2024-09-12T01:37:38.942 INFO:tasks.cephfs_test_runner:test_client_blocklisted_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-12T01:37:38.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:37:39.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.055+0000 7fdff76ac640 1 Processor -- start 2024-09-12T01:37:39.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.055+0000 7fdff76ac640 1 -- start start 2024-09-12T01:37:39.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.056+0000 7fdff76ac640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdff015c170 0x7fdff015c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.056+0000 7fdff76ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdff00cf6c0 0x7fdff00cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.056+0000 7fdff76ac640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdff00b5dd0 0x7fdff00b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.056+0000 7fdff76ac640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdff015ca90 con 0x7fdff00b5dd0 2024-09-12T01:37:39.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.056+0000 7fdff76ac640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdff00b4cf0 con 0x7fdff015c170 2024-09-12T01:37:39.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.056+0000 7fdff76ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdff00b4fd0 con 0x7fdff00cf6c0 2024-09-12T01:37:39.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.056+0000 7fdff5c49640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdff00b5dd0 0x7fdff00b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.056+0000 7fdff5c49640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdff00b5dd0 0x7fdff00b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43928/0 (socket says 172.21.15.60:43928) 2024-09-12T01:37:39.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.056+0000 7fdff5c49640 1 -- 172.21.15.60:0/800182273 learned_addr learned my addr 172.21.15.60:0/800182273 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:39.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.057+0000 7fdff5448640 1 --2- 172.21.15.60:0/800182273 >> v2:172.21.15.105:3300/0 conn(0x7fdff015c170 0x7fdff015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.057+0000 7fdff5c49640 1 -- 172.21.15.60:0/800182273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdff00cf6c0 msgr2=0x7fdff00cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:39.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.057+0000 7fdff4c47640 1 --2- 172.21.15.60:0/800182273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdff00cf6c0 0x7fdff00cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.057+0000 7fdff5c49640 1 --2- 172.21.15.60:0/800182273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdff00cf6c0 0x7fdff00cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.057+0000 7fdff5c49640 1 -- 172.21.15.60:0/800182273 >> v2:172.21.15.105:3300/0 conn(0x7fdff015c170 msgr2=0x7fdff015c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:39.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.057+0000 7fdff5c49640 1 --2- 172.21.15.60:0/800182273 >> v2:172.21.15.105:3300/0 conn(0x7fdff015c170 0x7fdff015c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.057+0000 7fdff5c49640 1 -- 172.21.15.60:0/800182273 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff00b52b0 con 0x7fdff00b5dd0 2024-09-12T01:37:39.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.057+0000 7fdff5448640 1 --2- 172.21.15.60:0/800182273 >> v2:172.21.15.105:3300/0 conn(0x7fdff015c170 0x7fdff015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:39.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.057+0000 7fdff4c47640 1 --2- 172.21.15.60:0/800182273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdff00cf6c0 0x7fdff00cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:39.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.057+0000 7fdff5c49640 1 --2- 172.21.15.60:0/800182273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff00b5dd0 0x7fdff00b6260 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdff006f340 tx=0x7fdfe802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faaf754b3fc15d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:39.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.058+0000 7fdfeffff640 1 -- 172.21.15.60:0/800182273 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8037070 con 0x7fdff00b5dd0 2024-09-12T01:37:39.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.058+0000 7fdfeffff640 1 -- 172.21.15.60:0/800182273 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe8032440 con 0x7fdff00b5dd0 2024-09-12T01:37:39.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.058+0000 7fdfeffff640 1 -- 172.21.15.60:0/800182273 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8032810 con 0x7fdff00b5dd0 2024-09-12T01:37:39.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.058+0000 7fdff76ac640 1 -- 172.21.15.60:0/800182273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff00b5dd0 msgr2=0x7fdff00b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.058+0000 7fdff76ac640 1 --2- 172.21.15.60:0/800182273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff00b5dd0 0x7fdff00b6260 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdff006f340 tx=0x7fdfe802a1e0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.058+0000 7fdff76ac640 1 -- 172.21.15.60:0/800182273 shutdown_connections 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.058+0000 7fdff76ac640 1 --2- 172.21.15.60:0/800182273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff00b5dd0 0x7fdff00b6260 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.058+0000 7fdff76ac640 1 --2- 172.21.15.60:0/800182273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdff00cf6c0 0x7fdff00cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.058+0000 7fdff76ac640 1 --2- 172.21.15.60:0/800182273 >> v2:172.21.15.105:3300/0 conn(0x7fdff015c170 0x7fdff015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.058+0000 7fdff76ac640 1 -- 172.21.15.60:0/800182273 >> 172.21.15.60:0/800182273 conn(0x7fdff006bc10 msgr2=0x7fdff006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.058+0000 7fdff76ac640 1 -- 172.21.15.60:0/800182273 shutdown_connections 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.058+0000 7fdff76ac640 1 -- 172.21.15.60:0/800182273 wait complete. 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.059+0000 7fdff76ac640 1 Processor -- start 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.060+0000 7fdff76ac640 1 -- start start 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.060+0000 7fdff76ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff00b5dd0 0x7fdff00726f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.060+0000 7fdff76ac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdff00cf6c0 0x7fdff00ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.060+0000 7fdff76ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdff015c170 0x7fdff00ce960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.060+0000 7fdff76ac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdff00b5b50 con 0x7fdff00b5dd0 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.060+0000 7fdff76ac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdff00b5870 con 0x7fdff00cf6c0 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.060+0000 7fdff76ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdff015ffb0 con 0x7fdff015c170 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.060+0000 7fdff5448640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff00b5dd0 0x7fdff00726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.060+0000 7fdff5448640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff00b5dd0 0x7fdff00726f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43930/0 (socket says 172.21.15.60:43930) 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.060+0000 7fdff5448640 1 -- 172.21.15.60:0/1489727436 learned_addr learned my addr 172.21.15.60:0/1489727436 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdff5c49640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdff015c170 0x7fdff00ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdff4c47640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdff00cf6c0 0x7fdff00ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdff5448640 1 -- 172.21.15.60:0/1489727436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdff015c170 msgr2=0x7fdff00ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdff5448640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdff015c170 0x7fdff00ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdff5448640 1 -- 172.21.15.60:0/1489727436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdff00cf6c0 msgr2=0x7fdff00ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdff5448640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdff00cf6c0 0x7fdff00ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdff5448640 1 -- 172.21.15.60:0/1489727436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff01f7640 con 0x7fdff00b5dd0 2024-09-12T01:37:39.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdff5c49640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdff015c170 0x7fdff00ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:39.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdff4c47640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdff00cf6c0 0x7fdff00ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:39.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdff5448640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff00b5dd0 0x7fdff00726f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000ce00 tx=0x7fdfe000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:39.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdfedffb640 1 -- 172.21.15.60:0/1489727436 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000f890 con 0x7fdff00b5dd0 2024-09-12T01:37:39.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdfedffb640 1 -- 172.21.15.60:0/1489727436 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfe000fa30 con 0x7fdff00b5dd0 2024-09-12T01:37:39.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdff76ac640 1 -- 172.21.15.60:0/1489727436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdff01f78e0 con 0x7fdff00b5dd0 2024-09-12T01:37:39.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdfedffb640 1 -- 172.21.15.60:0/1489727436 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000fe40 con 0x7fdff00b5dd0 2024-09-12T01:37:39.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.061+0000 7fdff76ac640 1 -- 172.21.15.60:0/1489727436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdff00cf000 con 0x7fdff00b5dd0 2024-09-12T01:37:39.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.062+0000 7fdff76ac640 1 -- 172.21.15.60:0/1489727436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdff01f7ab0 con 0x7fdff00b5dd0 2024-09-12T01:37:39.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.063+0000 7fdfedffb640 1 -- 172.21.15.60:0/1489727436 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdfe0018400 con 0x7fdff00b5dd0 2024-09-12T01:37:39.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.063+0000 7fdfedffb640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdfdc06be30 0x7fdfdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.063+0000 7fdfedffb640 1 -- 172.21.15.60:0/1489727436 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fdfe008b970 con 0x7fdff00b5dd0 2024-09-12T01:37:39.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.063+0000 7fdff4c47640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdfdc06be30 0x7fdfdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.064+0000 7fdff4c47640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdfdc06be30 0x7fdfdc06e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdff0155b20 tx=0x7fdfe4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:39.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.068+0000 7fdfedffb640 1 -- 172.21.15.60:0/1489727436 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdfe0014030 con 0x7fdff00b5dd0 2024-09-12T01:37:39.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.245+0000 7fdff76ac640 1 -- 172.21.15.60:0/1489727436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdff015c550 con 0x7fdff00b5dd0 2024-09-12T01:37:39.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.246+0000 7fdfedffb640 1 -- 172.21.15.60:0/1489727436 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+12998 (secure 0 0 0) 0x7fdfe000ae20 con 0x7fdff00b5dd0 2024-09-12T01:37:39.245 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:39.245 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":37,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:37:36.912642+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6834/1200480020":"2024-09-13T01:37:33.905318+0000","172.21.15.105:6832/1200480020":"2024-09-13T01:37:33.905318+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:37:39.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.248+0000 7fdff76ac640 1 -- 172.21.15.60:0/1489727436 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdfdc06be30 msgr2=0x7fdfdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.248+0000 7fdff76ac640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdfdc06be30 0x7fdfdc06e2f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fdff0155b20 tx=0x7fdfe4008040 comp rx=0 tx=0).stop 2024-09-12T01:37:39.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.248+0000 7fdff76ac640 1 -- 172.21.15.60:0/1489727436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff00b5dd0 msgr2=0x7fdff00726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.248+0000 7fdff76ac640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff00b5dd0 0x7fdff00726f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000ce00 tx=0x7fdfe000a650 comp rx=0 tx=0).stop 2024-09-12T01:37:39.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.248+0000 7fdff76ac640 1 -- 172.21.15.60:0/1489727436 shutdown_connections 2024-09-12T01:37:39.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.248+0000 7fdff76ac640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdfdc06be30 0x7fdfdc06e2f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.248+0000 7fdff76ac640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdff015c170 0x7fdff00ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.248+0000 7fdff76ac640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdff00cf6c0 0x7fdff00ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.248+0000 7fdff76ac640 1 --2- 172.21.15.60:0/1489727436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff00b5dd0 0x7fdff00726f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.249+0000 7fdff76ac640 1 -- 172.21.15.60:0/1489727436 >> 172.21.15.60:0/1489727436 conn(0x7fdff006bc10 msgr2=0x7fdff01568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.249+0000 7fdff76ac640 1 -- 172.21.15.60:0/1489727436 shutdown_connections 2024-09-12T01:37:39.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.249+0000 7fdff76ac640 1 -- 172.21.15.60:0/1489727436 wait complete. 2024-09-12T01:37:39.259 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:35:46.304939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:37:39.259 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:37:39.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.365+0000 7f22de7a1640 1 Processor -- start 2024-09-12T01:37:39.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.365+0000 7f22de7a1640 1 -- start start 2024-09-12T01:37:39.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.366+0000 7f22de7a1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22d815e940 0x7f22d80b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.366+0000 7f22de7a1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22d80d2290 0x7f22d80b6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.366+0000 7f22de7a1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d815ed20 con 0x7f22d80ba440 2024-09-12T01:37:39.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.366+0000 7f22de7a1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f22d80d3ef0 con 0x7f22d815e940 2024-09-12T01:37:39.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.366+0000 7f22de7a1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f22d80d32e0 con 0x7f22d80d2290 2024-09-12T01:37:39.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.366+0000 7f22d7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22d815e940 0x7f22d80b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.366+0000 7f22d7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22d815e940 0x7f22d80b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43940/0 (socket says 172.21.15.60:43940) 2024-09-12T01:37:39.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.366+0000 7f22d7fff640 1 -- 172.21.15.60:0/1136106280 learned_addr learned my addr 172.21.15.60:0/1136106280 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:39.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.367+0000 7f22dcd3e640 1 --2- 172.21.15.60:0/1136106280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22d80d2290 0x7f22d80b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.367+0000 7f22d7fff640 1 -- 172.21.15.60:0/1136106280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22d80d2290 msgr2=0x7f22d80b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:39.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.367+0000 7f22d7fff640 1 --2- 172.21.15.60:0/1136106280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22d80d2290 0x7f22d80b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.367+0000 7f22d7fff640 1 -- 172.21.15.60:0/1136106280 >> v1:172.21.15.105:6789/0 conn(0x7f22d80ba440 legacy=0x7f22d80cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.367+0000 7f22d7fff640 1 -- 172.21.15.60:0/1136106280 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d80d35c0 con 0x7f22d815e940 2024-09-12T01:37:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.367+0000 7f22d7fff640 1 --2- 172.21.15.60:0/1136106280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d815e940 0x7f22d80b6140 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009870 tx=0x7f22c802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72be3c0403b52319 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.368+0000 7f22d6ffd640 1 -- 172.21.15.60:0/1136106280 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8037070 con 0x7f22d815e940 2024-09-12T01:37:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.368+0000 7f22d6ffd640 1 -- 172.21.15.60:0/1136106280 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c8032440 con 0x7f22d815e940 2024-09-12T01:37:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.368+0000 7f22d6ffd640 1 -- 172.21.15.60:0/1136106280 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c8032810 con 0x7f22d815e940 2024-09-12T01:37:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.368+0000 7f22de7a1640 1 -- 172.21.15.60:0/1136106280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d815e940 msgr2=0x7f22d80b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.368+0000 7f22de7a1640 1 --2- 172.21.15.60:0/1136106280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d815e940 0x7f22d80b6140 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009870 tx=0x7f22c802a1c0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.368+0000 7f22de7a1640 1 -- 172.21.15.60:0/1136106280 shutdown_connections 2024-09-12T01:37:39.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.368+0000 7f22de7a1640 1 --2- 172.21.15.60:0/1136106280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22d80d2290 0x7f22d80b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.368+0000 7f22de7a1640 1 --2- 172.21.15.60:0/1136106280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d815e940 0x7f22d80b6140 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.368+0000 7f22de7a1640 1 -- 172.21.15.60:0/1136106280 >> 172.21.15.60:0/1136106280 conn(0x7f22d80d1140 msgr2=0x7f22d80d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:39.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.368+0000 7f22de7a1640 1 -- 172.21.15.60:0/1136106280 shutdown_connections 2024-09-12T01:37:39.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.368+0000 7f22de7a1640 1 -- 172.21.15.60:0/1136106280 wait complete. 2024-09-12T01:37:39.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.369+0000 7f22de7a1640 1 Processor -- start 2024-09-12T01:37:39.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.370+0000 7f22de7a1640 1 -- start start 2024-09-12T01:37:39.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.370+0000 7f22de7a1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22d80ba440 0x7f22d80ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.370+0000 7f22de7a1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d80d2290 0x7f22d80cc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.370+0000 7f22de7a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22d815e940 0x7f22d814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.370+0000 7f22de7a1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f22d80b7510 con 0x7f22d80d2290 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.370+0000 7f22de7a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22d80d3b80 con 0x7f22d815e940 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.370+0000 7f22de7a1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f22d80b8bb0 con 0x7f22d80ba440 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.370+0000 7f22d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d80d2290 0x7f22d80cc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d80d2290 0x7f22d80cc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43944/0 (socket says 172.21.15.60:43944) 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22d77fe640 1 -- 172.21.15.60:0/4025552645 learned_addr learned my addr 172.21.15.60:0/4025552645 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22d7fff640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22d80ba440 0x7f22d80ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22dcd3e640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22d815e940 0x7f22d814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22d77fe640 1 -- 172.21.15.60:0/4025552645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22d80ba440 msgr2=0x7f22d80ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22d77fe640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22d80ba440 0x7f22d80ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22d77fe640 1 -- 172.21.15.60:0/4025552645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22d815e940 msgr2=0x7f22d814ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22d77fe640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22d815e940 0x7f22d814ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22d77fe640 1 -- 172.21.15.60:0/4025552645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d80cce00 con 0x7f22d80d2290 2024-09-12T01:37:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22d77fe640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d80d2290 0x7f22d80cc170 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00c400 tx=0x7f22cc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22d4ff9640 1 -- 172.21.15.60:0/4025552645 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0052d0 con 0x7f22d80d2290 2024-09-12T01:37:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22d4ff9640 1 -- 172.21.15.60:0/4025552645 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22cc005490 con 0x7f22d80d2290 2024-09-12T01:37:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22d4ff9640 1 -- 172.21.15.60:0/4025552645 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc007260 con 0x7f22d80d2290 2024-09-12T01:37:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22de7a1640 1 -- 172.21.15.60:0/4025552645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d80cd0e0 con 0x7f22d80d2290 2024-09-12T01:37:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.371+0000 7f22de7a1640 1 -- 172.21.15.60:0/4025552645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d80cd6a0 con 0x7f22d80d2290 2024-09-12T01:37:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.372+0000 7f22de7a1640 1 -- 172.21.15.60:0/4025552645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d80d0a20 con 0x7f22d80d2290 2024-09-12T01:37:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.373+0000 7f22d4ff9640 1 -- 172.21.15.60:0/4025552645 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f22cc007400 con 0x7f22d80d2290 2024-09-12T01:37:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.373+0000 7f22d4ff9640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f22c406be30 0x7f22c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.373+0000 7f22d4ff9640 1 -- 172.21.15.60:0/4025552645 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f22cc08a0c0 con 0x7f22d80d2290 2024-09-12T01:37:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.373+0000 7f22d7fff640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f22c406be30 0x7f22c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.374+0000 7f22d7fff640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f22c406be30 0x7f22c406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f22c8034000 tx=0x7f22c802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:39.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.377+0000 7f22d4ff9640 1 -- 172.21.15.60:0/4025552645 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f22d80d0a20 con 0x7f22d80d2290 2024-09-12T01:37:39.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.550+0000 7f22de7a1640 1 -- 172.21.15.60:0/4025552645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f22d80d0260 con 0x7f22d80d2290 2024-09-12T01:37:39.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.551+0000 7f22d4ff9640 1 -- 172.21.15.60:0/4025552645 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7f22cc0586a0 con 0x7f22d80d2290 2024-09-12T01:37:39.550 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-12T01:37:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.553+0000 7f22de7a1640 1 -- 172.21.15.60:0/4025552645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f22c406be30 msgr2=0x7f22c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.553+0000 7f22de7a1640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f22c406be30 0x7f22c406e2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f22c8034000 tx=0x7f22c802e000 comp rx=0 tx=0).stop 2024-09-12T01:37:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.553+0000 7f22de7a1640 1 -- 172.21.15.60:0/4025552645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d80d2290 msgr2=0x7f22d80cc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.553+0000 7f22de7a1640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d80d2290 0x7f22d80cc170 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00c400 tx=0x7f22cc00c8c0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.553+0000 7f22de7a1640 1 -- 172.21.15.60:0/4025552645 shutdown_connections 2024-09-12T01:37:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.553+0000 7f22de7a1640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22d815e940 0x7f22d814ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.553+0000 7f22de7a1640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d80d2290 0x7f22d80cc170 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.553+0000 7f22de7a1640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f22c406be30 0x7f22c406e2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.553+0000 7f22de7a1640 1 --2- 172.21.15.60:0/4025552645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22d80ba440 0x7f22d80ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.553+0000 7f22de7a1640 1 -- 172.21.15.60:0/4025552645 >> 172.21.15.60:0/4025552645 conn(0x7f22d80d1140 msgr2=0x7f22d80ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.553+0000 7f22de7a1640 1 -- 172.21.15.60:0/4025552645 shutdown_connections 2024-09-12T01:37:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.553+0000 7f22de7a1640 1 -- 172.21.15.60:0/4025552645 wait complete. 2024-09-12T01:37:39.563 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid' 2024-09-12T01:37:39.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.666+0000 7f4a38ef1640 1 Processor -- start 2024-09-12T01:37:39.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.666+0000 7f4a38ef1640 1 -- start start 2024-09-12T01:37:39.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.667+0000 7f4a38ef1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4a3415e660 0x7f4a340cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.667+0000 7f4a38ef1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4a340d3310 0x7f4a340d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.667+0000 7f4a38ef1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3415ea40 con 0x7f4a340d1650 2024-09-12T01:37:39.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.667+0000 7f4a38ef1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4a340d1ac0 con 0x7f4a3415e660 2024-09-12T01:37:39.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.667+0000 7f4a38ef1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4a340d3870 con 0x7f4a340d3310 2024-09-12T01:37:39.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.667+0000 7f4a3259c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4a3415e660 0x7f4a340cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.668+0000 7f4a32d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4a340d1650 0x7f4a3406bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51856/0 (socket says 172.21.15.60:51856) 2024-09-12T01:37:39.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.668+0000 7f4a32d9d640 1 -- 172.21.15.60:0/1180802810 learned_addr learned my addr 172.21.15.60:0/1180802810 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:39.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.668+0000 7f4a31d9b640 1 --2- 172.21.15.60:0/1180802810 >> v2:172.21.15.105:3300/0 conn(0x7f4a340d3310 0x7f4a340d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.668+0000 7f4a3259c640 1 -- 172.21.15.60:0/1180802810 >> v2:172.21.15.105:3300/0 conn(0x7f4a340d3310 msgr2=0x7f4a340d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:39.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.668+0000 7f4a3259c640 1 --2- 172.21.15.60:0/1180802810 >> v2:172.21.15.105:3300/0 conn(0x7f4a340d3310 0x7f4a340d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.668+0000 7f4a3259c640 1 -- 172.21.15.60:0/1180802810 >> v1:172.21.15.60:6789/0 conn(0x7f4a340d1650 legacy=0x7f4a3406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.668+0000 7f4a3259c640 1 -- 172.21.15.60:0/1180802810 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a340d3b50 con 0x7f4a3415e660 2024-09-12T01:37:39.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.668+0000 7f4a3159a640 1 -- 172.21.15.60:0/1180802810 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290563663 0 0) 0x7f4a3415ea40 con 0x7f4a340d1650 2024-09-12T01:37:39.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.668+0000 7f4a31d9b640 1 --2- 172.21.15.60:0/1180802810 >> v2:172.21.15.105:3300/0 conn(0x7f4a340d3310 0x7f4a340d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:39.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.669+0000 7f4a3259c640 1 --2- 172.21.15.60:0/1180802810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a3415e660 0x7f4a340cf730 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4a340c8020 tx=0x7f4a2402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff2d61b1fc26949 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:39.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.669+0000 7f4a3159a640 1 -- 172.21.15.60:0/1180802810 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24007740 con 0x7f4a3415e660 2024-09-12T01:37:39.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.669+0000 7f4a3159a640 1 -- 172.21.15.60:0/1180802810 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a240078e0 con 0x7f4a3415e660 2024-09-12T01:37:39.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.669+0000 7f4a3159a640 1 -- 172.21.15.60:0/1180802810 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a24007cb0 con 0x7f4a3415e660 2024-09-12T01:37:39.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.669+0000 7f4a38ef1640 1 -- 172.21.15.60:0/1180802810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a3415e660 msgr2=0x7f4a340cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.669+0000 7f4a38ef1640 1 --2- 172.21.15.60:0/1180802810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a3415e660 0x7f4a340cf730 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4a340c8020 tx=0x7f4a2402a680 comp rx=0 tx=0).stop 2024-09-12T01:37:39.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.669+0000 7f4a38ef1640 1 -- 172.21.15.60:0/1180802810 shutdown_connections 2024-09-12T01:37:39.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.669+0000 7f4a38ef1640 1 --2- 172.21.15.60:0/1180802810 >> v2:172.21.15.105:3300/0 conn(0x7f4a340d3310 0x7f4a340d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.669+0000 7f4a38ef1640 1 --2- 172.21.15.60:0/1180802810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a3415e660 0x7f4a340cf730 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.669+0000 7f4a38ef1640 1 -- 172.21.15.60:0/1180802810 >> 172.21.15.60:0/1180802810 conn(0x7f4a340b6410 msgr2=0x7f4a340b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:39.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.669+0000 7f4a38ef1640 1 -- 172.21.15.60:0/1180802810 shutdown_connections 2024-09-12T01:37:39.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.669+0000 7f4a38ef1640 1 -- 172.21.15.60:0/1180802810 wait complete. 2024-09-12T01:37:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.671+0000 7f4a38ef1640 1 Processor -- start 2024-09-12T01:37:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.671+0000 7f4a38ef1640 1 -- start start 2024-09-12T01:37:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.671+0000 7f4a38ef1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a340d1650 0x7f4a34150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.671+0000 7f4a38ef1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a340d3310 0x7f4a3415c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.671+0000 7f4a38ef1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a3415e660 0x7f4a34154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.671+0000 7f4a38ef1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4a340d43f0 con 0x7f4a3415e660 2024-09-12T01:37:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.671+0000 7f4a38ef1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4a340d4110 con 0x7f4a340d3310 2024-09-12T01:37:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.671+0000 7f4a38ef1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4a340cfc70 con 0x7f4a340d1650 2024-09-12T01:37:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a32d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a3415e660 0x7f4a34154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a32d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a3415e660 0x7f4a34154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43968/0 (socket says 172.21.15.60:43968) 2024-09-12T01:37:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a32d9d640 1 -- 172.21.15.60:0/4076788775 learned_addr learned my addr 172.21.15.60:0/4076788775 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a3259c640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a340d1650 0x7f4a34150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a31d9b640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a340d3310 0x7f4a3415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a32d9d640 1 -- 172.21.15.60:0/4076788775 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a340d1650 msgr2=0x7f4a34150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a32d9d640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a340d1650 0x7f4a34150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a32d9d640 1 -- 172.21.15.60:0/4076788775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a340d3310 msgr2=0x7f4a3415c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a32d9d640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a340d3310 0x7f4a3415c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a32d9d640 1 -- 172.21.15.60:0/4076788775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a34151030 con 0x7f4a3415e660 2024-09-12T01:37:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a32d9d640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a3415e660 0x7f4a34154620 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00c410 tx=0x7f4a2c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a2affd640 1 -- 172.21.15.60:0/4076788775 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c0074e0 con 0x7f4a3415e660 2024-09-12T01:37:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a2affd640 1 -- 172.21.15.60:0/4076788775 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2c0047e0 con 0x7f4a3415e660 2024-09-12T01:37:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a38ef1640 1 -- 172.21.15.60:0/4076788775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a34152d70 con 0x7f4a3415e660 2024-09-12T01:37:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a2affd640 1 -- 172.21.15.60:0/4076788775 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c004bd0 con 0x7f4a3415e660 2024-09-12T01:37:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.672+0000 7f4a38ef1640 1 -- 172.21.15.60:0/4076788775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a34153330 con 0x7f4a3415e660 2024-09-12T01:37:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.673+0000 7f4a38ef1640 1 -- 172.21.15.60:0/4076788775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a340d1110 con 0x7f4a3415e660 2024-09-12T01:37:39.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.674+0000 7f4a2affd640 1 -- 172.21.15.60:0/4076788775 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a2c011070 con 0x7f4a3415e660 2024-09-12T01:37:39.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.674+0000 7f4a2affd640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4a1406be30 0x7f4a1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.674+0000 7f4a2affd640 1 -- 172.21.15.60:0/4076788775 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f4a2c08a690 con 0x7f4a3415e660 2024-09-12T01:37:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.674+0000 7f4a3259c640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4a1406be30 0x7f4a1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:39.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.675+0000 7f4a3259c640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4a1406be30 0x7f4a1406e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4a24034000 tx=0x7f4a2402f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:39.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.679+0000 7f4a2affd640 1 -- 172.21.15.60:0/4076788775 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a2c058c50 con 0x7f4a3415e660 2024-09-12T01:37:39.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.920+0000 7f4a38ef1640 1 -- 172.21.15.60:0/4076788775 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]} v 0) -- 0x7f4a340b9830 con 0x7f4a3415e660 2024-09-12T01:37:39.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.926+0000 7f4a2affd640 1 -- 172.21.15.60:0/4076788775 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]}]=0 v105) ==== 165+0+0 (secure 0 0 0) 0x7f4a2c05cf50 con 0x7f4a3415e660 2024-09-12T01:37:39.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.928+0000 7f4a38ef1640 1 -- 172.21.15.60:0/4076788775 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4a1406be30 msgr2=0x7f4a1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.928+0000 7f4a38ef1640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4a1406be30 0x7f4a1406e2f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4a24034000 tx=0x7f4a2402f000 comp rx=0 tx=0).stop 2024-09-12T01:37:39.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.928+0000 7f4a38ef1640 1 -- 172.21.15.60:0/4076788775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a3415e660 msgr2=0x7f4a34154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:39.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.928+0000 7f4a38ef1640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a3415e660 0x7f4a34154620 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00c410 tx=0x7f4a2c00c8d0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.928+0000 7f4a38ef1640 1 -- 172.21.15.60:0/4076788775 shutdown_connections 2024-09-12T01:37:39.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.928+0000 7f4a38ef1640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a3415e660 0x7f4a34154620 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.928+0000 7f4a38ef1640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a340d3310 0x7f4a3415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.928+0000 7f4a38ef1640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4a1406be30 0x7f4a1406e2f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.928+0000 7f4a38ef1640 1 --2- 172.21.15.60:0/4076788775 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4a340d1650 0x7f4a34150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:39.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.928+0000 7f4a38ef1640 1 -- 172.21.15.60:0/4076788775 >> 172.21.15.60:0/4076788775 conn(0x7f4a340b6410 msgr2=0x7f4a340b88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:39.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.928+0000 7f4a38ef1640 1 -- 172.21.15.60:0/4076788775 shutdown_connections 2024-09-12T01:37:39.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:39.928+0000 7f4a38ef1640 1 -- 172.21.15.60:0/4076788775 wait complete. 2024-09-12T01:37:39.939 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:37:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.045+0000 7fcc84d31640 1 Processor -- start 2024-09-12T01:37:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.046+0000 7fcc84d31640 1 -- start start 2024-09-12T01:37:40.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.046+0000 7fcc84d31640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcc8006f710 0x7fcc8006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.046+0000 7fcc84d31640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcc8006bc10 0x7fcc8006c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.046+0000 7fcc84d31640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc80074120 con 0x7fcc8015c2a0 2024-09-12T01:37:40.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.046+0000 7fcc84d31640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcc8015c680 con 0x7fcc8006bc10 2024-09-12T01:37:40.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.046+0000 7fcc84d31640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcc8015ef00 con 0x7fcc8006f710 2024-09-12T01:37:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.047+0000 7fcc7ed9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcc8006bc10 0x7fcc8006c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.047+0000 7fcc7e59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcc8015c2a0 0x7fcc800735d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51858/0 (socket says 172.21.15.60:51858) 2024-09-12T01:37:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.047+0000 7fcc7e59c640 1 -- 172.21.15.60:0/1674724931 learned_addr learned my addr 172.21.15.60:0/1674724931 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.047+0000 7fcc7dd9b640 1 --2- 172.21.15.60:0/1674724931 >> v2:172.21.15.105:3300/0 conn(0x7fcc8006f710 0x7fcc8006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.047+0000 7fcc7ed9d640 1 -- 172.21.15.60:0/1674724931 >> v2:172.21.15.105:3300/0 conn(0x7fcc8006f710 msgr2=0x7fcc8006fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.047+0000 7fcc7ed9d640 1 --2- 172.21.15.60:0/1674724931 >> v2:172.21.15.105:3300/0 conn(0x7fcc8006f710 0x7fcc8006fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.047+0000 7fcc7ed9d640 1 -- 172.21.15.60:0/1674724931 >> v1:172.21.15.60:6789/0 conn(0x7fcc8015c2a0 legacy=0x7fcc800735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.047+0000 7fcc7ed9d640 1 -- 172.21.15.60:0/1674724931 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8015f1e0 con 0x7fcc8006bc10 2024-09-12T01:37:40.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.047+0000 7fcc7d59a640 1 -- 172.21.15.60:0/1674724931 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 759719711 0 0) 0x7fcc80074120 con 0x7fcc8015c2a0 2024-09-12T01:37:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.047+0000 7fcc7dd9b640 1 --2- 172.21.15.60:0/1674724931 >> v2:172.21.15.105:3300/0 conn(0x7fcc8006f710 0x7fcc8006fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.048+0000 7fcc7ed9d640 1 --2- 172.21.15.60:0/1674724931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8006bc10 0x7fcc8006c080 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcc80072d80 tx=0x7fcc7802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b65f32db700998 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.048+0000 7fcc7d59a640 1 -- 172.21.15.60:0/1674724931 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78007740 con 0x7fcc8006bc10 2024-09-12T01:37:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.048+0000 7fcc7d59a640 1 -- 172.21.15.60:0/1674724931 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc780078e0 con 0x7fcc8006bc10 2024-09-12T01:37:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.048+0000 7fcc7d59a640 1 -- 172.21.15.60:0/1674724931 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78007cb0 con 0x7fcc8006bc10 2024-09-12T01:37:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.048+0000 7fcc84d31640 1 -- 172.21.15.60:0/1674724931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8006bc10 msgr2=0x7fcc8006c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.048+0000 7fcc84d31640 1 --2- 172.21.15.60:0/1674724931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8006bc10 0x7fcc8006c080 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcc80072d80 tx=0x7fcc7802a680 comp rx=0 tx=0).stop 2024-09-12T01:37:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.048+0000 7fcc84d31640 1 -- 172.21.15.60:0/1674724931 shutdown_connections 2024-09-12T01:37:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.048+0000 7fcc84d31640 1 --2- 172.21.15.60:0/1674724931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8006bc10 0x7fcc8006c080 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.048+0000 7fcc84d31640 1 --2- 172.21.15.60:0/1674724931 >> v2:172.21.15.105:3300/0 conn(0x7fcc8006f710 0x7fcc8006fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.048+0000 7fcc84d31640 1 -- 172.21.15.60:0/1674724931 >> 172.21.15.60:0/1674724931 conn(0x7fcc800b3070 msgr2=0x7fcc800b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:40.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.049+0000 7fcc84d31640 1 -- 172.21.15.60:0/1674724931 shutdown_connections 2024-09-12T01:37:40.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.049+0000 7fcc84d31640 1 -- 172.21.15.60:0/1674724931 wait complete. 2024-09-12T01:37:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.050+0000 7fcc84d31640 1 Processor -- start 2024-09-12T01:37:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.050+0000 7fcc84d31640 1 -- start start 2024-09-12T01:37:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc84d31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8006bc10 0x7fcc8014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc84d31640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc8006f710 0x7fcc80160b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc84d31640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc8015c2a0 0x7fcc80161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc84d31640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc800b5f20 con 0x7fcc8006bc10 2024-09-12T01:37:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc84d31640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8015ebf0 con 0x7fcc8015c2a0 2024-09-12T01:37:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc84d31640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc800b60a0 con 0x7fcc8006f710 2024-09-12T01:37:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc7e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8006bc10 0x7fcc8014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc7e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8006bc10 0x7fcc8014bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43986/0 (socket says 172.21.15.60:43986) 2024-09-12T01:37:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc7e59c640 1 -- 172.21.15.60:0/3741410358 learned_addr learned my addr 172.21.15.60:0/3741410358 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:40.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc7ed9d640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc8015c2a0 0x7fcc80161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc7dd9b640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc8006f710 0x7fcc80160b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc7e59c640 1 -- 172.21.15.60:0/3741410358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc8006f710 msgr2=0x7fcc80160b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc7e59c640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc8006f710 0x7fcc80160b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc7e59c640 1 -- 172.21.15.60:0/3741410358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc8015c2a0 msgr2=0x7fcc80161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc7e59c640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc8015c2a0 0x7fcc80161050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc7e59c640 1 -- 172.21.15.60:0/3741410358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8015cca0 con 0x7fcc8006bc10 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc7dd9b640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc8006f710 0x7fcc80160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc7e59c640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8006bc10 0x7fcc8014bea0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000c460 tx=0x7fcc7000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc6effd640 1 -- 172.21.15.60:0/3741410358 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70018070 con 0x7fcc8006bc10 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc6effd640 1 -- 172.21.15.60:0/3741410358 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc70007500 con 0x7fcc8006bc10 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc84d31640 1 -- 172.21.15.60:0/3741410358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc8015cf80 con 0x7fcc8006bc10 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc6effd640 1 -- 172.21.15.60:0/3741410358 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70004a20 con 0x7fcc8006bc10 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.051+0000 7fcc84d31640 1 -- 172.21.15.60:0/3741410358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc8015fea0 con 0x7fcc8006bc10 2024-09-12T01:37:40.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.052+0000 7fcc84d31640 1 -- 172.21.15.60:0/3741410358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc800b6670 con 0x7fcc8006bc10 2024-09-12T01:37:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.053+0000 7fcc6effd640 1 -- 172.21.15.60:0/3741410358 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcc7001b070 con 0x7fcc8006bc10 2024-09-12T01:37:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.053+0000 7fcc6effd640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcc6006be30 0x7fcc6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.054+0000 7fcc6effd640 1 -- 172.21.15.60:0/3741410358 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fcc70089e10 con 0x7fcc8006bc10 2024-09-12T01:37:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.054+0000 7fcc7dd9b640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcc6006be30 0x7fcc6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.054+0000 7fcc7dd9b640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcc6006be30 0x7fcc6006e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcc74006fd0 tx=0x7fcc74008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:40.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.058+0000 7fcc6effd640 1 -- 172.21.15.60:0/3741410358 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcc70058ac0 con 0x7fcc8006bc10 2024-09-12T01:37:40.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.236+0000 7fcc84d31640 1 -- 172.21.15.60:0/3741410358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fcc8015f9e0 con 0x7fcc8006bc10 2024-09-12T01:37:40.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.239+0000 7fcc6effd640 1 -- 172.21.15.60:0/3741410358 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fcc700583c0 con 0x7fcc8006bc10 2024-09-12T01:37:40.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.241+0000 7fcc84d31640 1 -- 172.21.15.60:0/3741410358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcc6006be30 msgr2=0x7fcc6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.241+0000 7fcc84d31640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcc6006be30 0x7fcc6006e2f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcc74006fd0 tx=0x7fcc74008040 comp rx=0 tx=0).stop 2024-09-12T01:37:40.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.241+0000 7fcc84d31640 1 -- 172.21.15.60:0/3741410358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8006bc10 msgr2=0x7fcc8014bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.241+0000 7fcc84d31640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8006bc10 0x7fcc8014bea0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000c460 tx=0x7fcc7000c920 comp rx=0 tx=0).stop 2024-09-12T01:37:40.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.241+0000 7fcc84d31640 1 -- 172.21.15.60:0/3741410358 shutdown_connections 2024-09-12T01:37:40.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.241+0000 7fcc84d31640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc8015c2a0 0x7fcc80161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.241+0000 7fcc84d31640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcc6006be30 0x7fcc6006e2f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.241+0000 7fcc84d31640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc8006f710 0x7fcc80160b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.241+0000 7fcc84d31640 1 --2- 172.21.15.60:0/3741410358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc8006bc10 0x7fcc8014bea0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.241+0000 7fcc84d31640 1 -- 172.21.15.60:0/3741410358 >> 172.21.15.60:0/3741410358 conn(0x7fcc800b3070 msgr2=0x7fcc800ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:40.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.241+0000 7fcc84d31640 1 -- 172.21.15.60:0/3741410358 shutdown_connections 2024-09-12T01:37:40.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.241+0000 7fcc84d31640 1 -- 172.21.15.60:0/3741410358 wait complete. 2024-09-12T01:37:40.251 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:37:40.251 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:37:40.292 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:37:40.342 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:37:40.342 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:37:40.342 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:40.359 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:37:40.359 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:37:40.359 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:40.377 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:37:40.377 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:37:40.377 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:40.415 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:37:40.415 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:37:40.415 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:40.434 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:37:40.434 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:37:40.435 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:37:40.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.557+0000 7fbafaca5640 1 Processor -- start 2024-09-12T01:37:40.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.557+0000 7fbafaca5640 1 -- start start 2024-09-12T01:37:40.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.558+0000 7fbafaca5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf415c2b0 0x7fbaf40b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.558+0000 7fbafaca5640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbaf40b72f0 0x7fbaf415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.558+0000 7fbafaca5640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf415fb10 con 0x7fbaf415f030 2024-09-12T01:37:40.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.558+0000 7fbafaca5640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf40b5900 con 0x7fbaf40b72f0 2024-09-12T01:37:40.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.558+0000 7fbafaca5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf415f830 con 0x7fbaf415c2b0 2024-09-12T01:37:40.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.559+0000 7fbaf3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbaf40b72f0 0x7fbaf415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.559+0000 7fbaf8a41640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf415c2b0 0x7fbaf40b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.559+0000 7fbaf9242640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fbaf415f030 0x7fbaf406f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:39210/0 (socket says 172.21.15.60:39210) 2024-09-12T01:37:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.559+0000 7fbaf8a41640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf415c2b0 0x7fbaf40b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:60674/0 (socket says 172.21.15.60:60674) 2024-09-12T01:37:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.559+0000 7fbaf3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbaf40b72f0 0x7fbaf415eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54920/0 (socket says 172.21.15.60:54920) 2024-09-12T01:37:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.559+0000 7fbaf9242640 1 -- 172.21.15.60:0/3011310317 learned_addr learned my addr 172.21.15.60:0/3011310317 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.559+0000 7fbaf8a41640 1 -- 172.21.15.60:0/3011310317 >> v2:172.21.15.105:3300/0 conn(0x7fbaf40b72f0 msgr2=0x7fbaf415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.559+0000 7fbaf8a41640 1 --2- 172.21.15.60:0/3011310317 >> v2:172.21.15.105:3300/0 conn(0x7fbaf40b72f0 0x7fbaf415eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.559+0000 7fbaf8a41640 1 -- 172.21.15.60:0/3011310317 >> v1:172.21.15.105:6789/0 conn(0x7fbaf415f030 legacy=0x7fbaf406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.559+0000 7fbaf8a41640 1 -- 172.21.15.60:0/3011310317 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf406ce30 con 0x7fbaf415c2b0 2024-09-12T01:37:40.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.559+0000 7fbaf3fff640 1 --2- 172.21.15.60:0/3011310317 >> v2:172.21.15.105:3300/0 conn(0x7fbaf40b72f0 0x7fbaf415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:37:40.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.560+0000 7fbaf8a41640 1 --2- 172.21.15.60:0/3011310317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf415c2b0 0x7fbaf40b6db0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbae40097a0 tx=0x7fbae402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd98f3fdd314f537 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:40.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.560+0000 7fbaf37fe640 1 -- 172.21.15.60:0/3011310317 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4037070 con 0x7fbaf415c2b0 2024-09-12T01:37:40.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.560+0000 7fbaf37fe640 1 -- 172.21.15.60:0/3011310317 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae4032440 con 0x7fbaf415c2b0 2024-09-12T01:37:40.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.560+0000 7fbaf37fe640 1 -- 172.21.15.60:0/3011310317 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae4032810 con 0x7fbaf415c2b0 2024-09-12T01:37:40.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.561+0000 7fbafaca5640 1 -- 172.21.15.60:0/3011310317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf415c2b0 msgr2=0x7fbaf40b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.561+0000 7fbafaca5640 1 --2- 172.21.15.60:0/3011310317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf415c2b0 0x7fbaf40b6db0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbae40097a0 tx=0x7fbae402a180 comp rx=0 tx=0).stop 2024-09-12T01:37:40.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.561+0000 7fbafaca5640 1 -- 172.21.15.60:0/3011310317 shutdown_connections 2024-09-12T01:37:40.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.561+0000 7fbafaca5640 1 --2- 172.21.15.60:0/3011310317 >> v2:172.21.15.105:3300/0 conn(0x7fbaf40b72f0 0x7fbaf415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.561+0000 7fbafaca5640 1 --2- 172.21.15.60:0/3011310317 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf415c2b0 0x7fbaf40b6db0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.561+0000 7fbafaca5640 1 -- 172.21.15.60:0/3011310317 >> 172.21.15.60:0/3011310317 conn(0x7fbaf40b4240 msgr2=0x7fbaf40b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:40.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.561+0000 7fbafaca5640 1 -- 172.21.15.60:0/3011310317 shutdown_connections 2024-09-12T01:37:40.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.561+0000 7fbafaca5640 1 -- 172.21.15.60:0/3011310317 wait complete. 2024-09-12T01:37:40.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.562+0000 7fbafaca5640 1 Processor -- start 2024-09-12T01:37:40.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.562+0000 7fbafaca5640 1 -- start start 2024-09-12T01:37:40.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbafaca5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf40b72f0 0x7fbaf4148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbafaca5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf415c2b0 0x7fbaf4156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbafaca5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf415f030 0x7fbaf41553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbafaca5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf40b7730 con 0x7fbaf415f030 2024-09-12T01:37:40.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbafaca5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf406d3f0 con 0x7fbaf415c2b0 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbafaca5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf415f4e0 con 0x7fbaf40b72f0 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbaf9242640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf415f030 0x7fbaf41553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbaf9242640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf415f030 0x7fbaf41553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43988/0 (socket says 172.21.15.60:43988) 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbaf3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf415c2b0 0x7fbaf4156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbaf9242640 1 -- 172.21.15.60:0/2231657871 learned_addr learned my addr 172.21.15.60:0/2231657871 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbaf8a41640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf40b72f0 0x7fbaf4148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbaf9242640 1 -- 172.21.15.60:0/2231657871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf40b72f0 msgr2=0x7fbaf4148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbaf9242640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf40b72f0 0x7fbaf4148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbaf9242640 1 -- 172.21.15.60:0/2231657871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf415c2b0 msgr2=0x7fbaf4156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbaf9242640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf415c2b0 0x7fbaf4156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbaf9242640 1 -- 172.21.15.60:0/2231657871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf4157980 con 0x7fbaf415f030 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.563+0000 7fbaf3fff640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf415c2b0 0x7fbaf4156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:37:40.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.564+0000 7fbaf9242640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf415f030 0x7fbaf41553a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00c370 tx=0x7fbaec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:40.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.564+0000 7fbaf17fa640 1 -- 172.21.15.60:0/2231657871 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec017070 con 0x7fbaf415f030 2024-09-12T01:37:40.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.564+0000 7fbaf17fa640 1 -- 172.21.15.60:0/2231657871 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaec005ce0 con 0x7fbaf415f030 2024-09-12T01:37:40.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.564+0000 7fbafaca5640 1 -- 172.21.15.60:0/2231657871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf4157c60 con 0x7fbaf415f030 2024-09-12T01:37:40.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.564+0000 7fbaf17fa640 1 -- 172.21.15.60:0/2231657871 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0072d0 con 0x7fbaf415f030 2024-09-12T01:37:40.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.564+0000 7fbafaca5640 1 -- 172.21.15.60:0/2231657871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf4158220 con 0x7fbaf415f030 2024-09-12T01:37:40.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.565+0000 7fbafaca5640 1 -- 172.21.15.60:0/2231657871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf415eaf0 con 0x7fbaf415f030 2024-09-12T01:37:40.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.565+0000 7fbaf17fa640 1 -- 172.21.15.60:0/2231657871 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbaec01a070 con 0x7fbaf415f030 2024-09-12T01:37:40.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.566+0000 7fbaf17fa640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbad406be30 0x7fbad406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.566+0000 7fbaf17fa640 1 -- 172.21.15.60:0/2231657871 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fbaec089e80 con 0x7fbaf415f030 2024-09-12T01:37:40.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.566+0000 7fbaf8a41640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbad406be30 0x7fbad406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.566+0000 7fbaf8a41640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbad406be30 0x7fbad406e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbae4034000 tx=0x7fbae402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:40.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.570+0000 7fbaf17fa640 1 -- 172.21.15.60:0/2231657871 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbaec0583d0 con 0x7fbaf415f030 2024-09-12T01:37:40.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.782+0000 7fbafaca5640 1 -- 172.21.15.60:0/2231657871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbaf4148590 con 0x7fbaf415f030 2024-09-12T01:37:40.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.782+0000 7fbaf17fa640 1 -- 172.21.15.60:0/2231657871 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3914 (secure 0 0 0) 0x7fbaec05c6d0 con 0x7fbaf415f030 2024-09-12T01:37:40.782 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:40.782 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"btime":"2024-09-12T01:37:34:907102+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4735,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3644892545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3644892545},{"type":"v1","addr":"172.21.15.105:6835","nonce":3644892545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4738,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/458109310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458109310},{"type":"v1","addr":"172.21.15.60:6836","nonce":458109310}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4741,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1415668038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1415668038},{"type":"v1","addr":"172.21.15.60:6837","nonce":1415668038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5011,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1695104192","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1695104192},{"type":"v1","addr":"172.21.15.105:6834","nonce":1695104192}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[]} 2024-09-12T01:37:40.782 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2024-09-12T01:37:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.784+0000 7fbafaca5640 1 -- 172.21.15.60:0/2231657871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbad406be30 msgr2=0x7fbad406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.784+0000 7fbafaca5640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbad406be30 0x7fbad406e2f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbae4034000 tx=0x7fbae402e000 comp rx=0 tx=0).stop 2024-09-12T01:37:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.784+0000 7fbafaca5640 1 -- 172.21.15.60:0/2231657871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf415f030 msgr2=0x7fbaf41553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.784+0000 7fbafaca5640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf415f030 0x7fbaf41553a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fbaec00c370 tx=0x7fbaec00c830 comp rx=0 tx=0).stop 2024-09-12T01:37:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.784+0000 7fbafaca5640 1 -- 172.21.15.60:0/2231657871 shutdown_connections 2024-09-12T01:37:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.784+0000 7fbafaca5640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbaf415f030 0x7fbaf41553a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.784+0000 7fbafaca5640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbaf415c2b0 0x7fbaf4156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.784+0000 7fbafaca5640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbad406be30 0x7fbad406e2f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.784+0000 7fbafaca5640 1 --2- 172.21.15.60:0/2231657871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbaf40b72f0 0x7fbaf4148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.784+0000 7fbafaca5640 1 -- 172.21.15.60:0/2231657871 >> 172.21.15.60:0/2231657871 conn(0x7fbaf40b4240 msgr2=0x7fbaf41606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.784+0000 7fbafaca5640 1 -- 172.21.15.60:0/2231657871 shutdown_connections 2024-09-12T01:37:40.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.784+0000 7fbafaca5640 1 -- 172.21.15.60:0/2231657871 wait complete. 2024-09-12T01:37:40.795 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:37:40.795 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:37:40.795 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:37:40.795 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:37:40.795 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:37:40.796 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:37:40.796 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:37:40.796 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:37:40.796 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:37:40.796 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:37:40.796 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:37:40.796 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:37:40.796 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:37:40.797 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:37:40.797 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:37:40.797 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:37:40.805 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:37:40.805 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:37:40.807 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:37:40.807 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:37:40.808 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:37:40.809 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:37:40.810 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:37:40.810 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:37:40.848 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:37:40.848 DEBUG:teuthology.parallel:result is None 2024-09-12T01:37:40.849 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:37:40.849 DEBUG:teuthology.parallel:result is None 2024-09-12T01:37:40.852 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:37:40.852 DEBUG:teuthology.parallel:result is None 2024-09-12T01:37:40.853 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:37:40.853 DEBUG:teuthology.parallel:result is None 2024-09-12T01:37:40.854 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:37:40.925 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2024-09-12T01:37:40.925 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2024-09-12T01:37:40.935 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:37:40.935 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:37:40.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.964+0000 7f9385331640 1 Processor -- start 2024-09-12T01:37:40.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.964+0000 7f9385331640 1 -- start start 2024-09-12T01:37:40.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f9385331640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f938015e6f0 0x7f938006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f9385331640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f93800b7450 0x7f938015f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f9385331640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f938006e990 con 0x7f93800b54d0 2024-09-12T01:37:40.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f9385331640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f938006ec70 con 0x7f93800b7450 2024-09-12T01:37:40.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f9385331640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f938015ec70 con 0x7f938015e6f0 2024-09-12T01:37:40.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f937f7fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f93800b7450 0x7f938015f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f937effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f938015e6f0 0x7f938006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f937f7fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f93800b7450 0x7f938015f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54946/0 (socket says 172.21.15.60:54946) 2024-09-12T01:37:40.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f937e7fc640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f93800b54d0 0x7f93800b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:39232/0 (socket says 172.21.15.60:39232) 2024-09-12T01:37:40.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f937effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f938015e6f0 0x7f938006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:60732/0 (socket says 172.21.15.60:60732) 2024-09-12T01:37:40.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f937f7fe640 1 -- 172.21.15.60:0/3999823012 learned_addr learned my addr 172.21.15.60:0/3999823012 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:40.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f937effd640 1 -- 172.21.15.60:0/3999823012 >> v2:172.21.15.105:3300/0 conn(0x7f93800b7450 msgr2=0x7f938015f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:40.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f937effd640 1 --2- 172.21.15.60:0/3999823012 >> v2:172.21.15.105:3300/0 conn(0x7f93800b7450 0x7f938015f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f937dffb640 1 -- 172.21.15.60:0/3999823012 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3847139837 0 0) 0x7f938006e990 con 0x7f93800b54d0 2024-09-12T01:37:40.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f937effd640 1 -- 172.21.15.60:0/3999823012 >> v1:172.21.15.105:6789/0 conn(0x7f93800b54d0 legacy=0x7f93800b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.965+0000 7f937effd640 1 -- 172.21.15.60:0/3999823012 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938015ef50 con 0x7f938015e6f0 2024-09-12T01:37:40.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.966+0000 7f937effd640 1 --2- 172.21.15.60:0/3999823012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f938015e6f0 0x7f938006fd00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93680097a0 tx=0x7f936802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e8cb85937042be5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:40.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.966+0000 7f937dffb640 1 -- 172.21.15.60:0/3999823012 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368037070 con 0x7f938015e6f0 2024-09-12T01:37:40.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.966+0000 7f937dffb640 1 -- 172.21.15.60:0/3999823012 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9368032440 con 0x7f938015e6f0 2024-09-12T01:37:40.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.966+0000 7f937dffb640 1 -- 172.21.15.60:0/3999823012 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9368032810 con 0x7f938015e6f0 2024-09-12T01:37:40.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.967+0000 7f9385331640 1 -- 172.21.15.60:0/3999823012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f938015e6f0 msgr2=0x7f938006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.967+0000 7f9385331640 1 --2- 172.21.15.60:0/3999823012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f938015e6f0 0x7f938006fd00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f93680097a0 tx=0x7f936802a180 comp rx=0 tx=0).stop 2024-09-12T01:37:40.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.967+0000 7f9385331640 1 -- 172.21.15.60:0/3999823012 shutdown_connections 2024-09-12T01:37:40.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.967+0000 7f9385331640 1 --2- 172.21.15.60:0/3999823012 >> v2:172.21.15.105:3300/0 conn(0x7f93800b7450 0x7f938015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.967+0000 7f9385331640 1 --2- 172.21.15.60:0/3999823012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f938015e6f0 0x7f938006fd00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.967+0000 7f9385331640 1 -- 172.21.15.60:0/3999823012 >> 172.21.15.60:0/3999823012 conn(0x7f93800d2430 msgr2=0x7f93800d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:40.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.967+0000 7f9385331640 1 -- 172.21.15.60:0/3999823012 shutdown_connections 2024-09-12T01:37:40.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.967+0000 7f9385331640 1 -- 172.21.15.60:0/3999823012 wait complete. 2024-09-12T01:37:40.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.968+0000 7f9385331640 1 Processor -- start 2024-09-12T01:37:40.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.968+0000 7f9385331640 1 -- start start 2024-09-12T01:37:40.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.969+0000 7f9385331640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93800b54d0 0x7f93801625d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.969+0000 7f9385331640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93800b7450 0x7f93800cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.969+0000 7f9385331640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f938015e6f0 0x7f9380157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.969+0000 7f9385331640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f938006e730 con 0x7f938015e6f0 2024-09-12T01:37:40.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.969+0000 7f9385331640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f938006e5b0 con 0x7f93800b54d0 2024-09-12T01:37:40.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.969+0000 7f9385331640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9380070830 con 0x7f93800b7450 2024-09-12T01:37:40.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.969+0000 7f937f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f938015e6f0 0x7f9380157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.969+0000 7f937f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f938015e6f0 0x7f9380157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44014/0 (socket says 172.21.15.60:44014) 2024-09-12T01:37:40.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.969+0000 7f937f7fe640 1 -- 172.21.15.60:0/845485174 learned_addr learned my addr 172.21.15.60:0/845485174 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:40.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.969+0000 7f937e7fc640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93800b7450 0x7f93800cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.969+0000 7f937effd640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93800b54d0 0x7f93801625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.970+0000 7f937f7fe640 1 -- 172.21.15.60:0/845485174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93800b7450 msgr2=0x7f93800cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.970+0000 7f937f7fe640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93800b7450 0x7f93800cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.970+0000 7f937f7fe640 1 -- 172.21.15.60:0/845485174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93800b54d0 msgr2=0x7f93801625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.970+0000 7f937f7fe640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93800b54d0 0x7f93801625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.970+0000 7f937f7fe640 1 -- 172.21.15.60:0/845485174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93800cb910 con 0x7f938015e6f0 2024-09-12T01:37:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.970+0000 7f937f7fe640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f938015e6f0 0x7f9380157c10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f937800efc0 tx=0x7f937800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.970+0000 7f93777fe640 1 -- 172.21.15.60:0/845485174 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f937800cd20 con 0x7f938015e6f0 2024-09-12T01:37:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.970+0000 7f93777fe640 1 -- 172.21.15.60:0/845485174 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9378003990 con 0x7f938015e6f0 2024-09-12T01:37:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.970+0000 7f9385331640 1 -- 172.21.15.60:0/845485174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93800cbbf0 con 0x7f938015e6f0 2024-09-12T01:37:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.970+0000 7f93777fe640 1 -- 172.21.15.60:0/845485174 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9378003d80 con 0x7f938015e6f0 2024-09-12T01:37:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.970+0000 7f9385331640 1 -- 172.21.15.60:0/845485174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93800cc490 con 0x7f938015e6f0 2024-09-12T01:37:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.971+0000 7f9385331640 1 -- 172.21.15.60:0/845485174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f938006c6c0 con 0x7f938015e6f0 2024-09-12T01:37:40.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.972+0000 7f93777fe640 1 -- 172.21.15.60:0/845485174 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9378012050 con 0x7f938015e6f0 2024-09-12T01:37:40.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.972+0000 7f93777fe640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f936006be30 0x7f936006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:40.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.972+0000 7f93777fe640 1 -- 172.21.15.60:0/845485174 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f937808aec0 con 0x7f938015e6f0 2024-09-12T01:37:40.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.972+0000 7f937effd640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f936006be30 0x7f936006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:40.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.973+0000 7f937effd640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f936006be30 0x7f936006e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9368034000 tx=0x7f936802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:40.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:40.977+0000 7f93777fe640 1 -- 172.21.15.60:0/845485174 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9378010040 con 0x7f938015e6f0 2024-09-12T01:37:41.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:41.165+0000 7f9385331640 1 -- 172.21.15.60:0/845485174 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9380159520 con 0x7f938015e6f0 2024-09-12T01:37:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.249+0000 7f93777fe640 1 -- 172.21.15.60:0/845485174 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) ==== 97+0+0 (secure 0 0 0) 0x7f93780595b0 con 0x7f938015e6f0 2024-09-12T01:37:42.248 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2024-09-12T01:37:42.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.252+0000 7f9385331640 1 -- 172.21.15.60:0/845485174 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f936006be30 msgr2=0x7f936006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.252+0000 7f9385331640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f936006be30 0x7f936006e2f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9368034000 tx=0x7f936802e000 comp rx=0 tx=0).stop 2024-09-12T01:37:42.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.252+0000 7f9385331640 1 -- 172.21.15.60:0/845485174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f938015e6f0 msgr2=0x7f9380157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.252+0000 7f9385331640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f938015e6f0 0x7f9380157c10 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f937800efc0 tx=0x7f937800c490 comp rx=0 tx=0).stop 2024-09-12T01:37:42.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.252+0000 7f9385331640 1 -- 172.21.15.60:0/845485174 shutdown_connections 2024-09-12T01:37:42.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.252+0000 7f9385331640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f938015e6f0 0x7f9380157c10 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.252+0000 7f9385331640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f936006be30 0x7f936006e2f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.252+0000 7f9385331640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93800b7450 0x7f93800cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.252+0000 7f9385331640 1 --2- 172.21.15.60:0/845485174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93800b54d0 0x7f93801625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.252+0000 7f9385331640 1 -- 172.21.15.60:0/845485174 >> 172.21.15.60:0/845485174 conn(0x7f93800d2430 msgr2=0x7f93800b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:42.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.253+0000 7f9385331640 1 -- 172.21.15.60:0/845485174 shutdown_connections 2024-09-12T01:37:42.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.253+0000 7f9385331640 1 -- 172.21.15.60:0/845485174 wait complete. 2024-09-12T01:37:42.265 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:37:42.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.376+0000 7f66549a2640 1 Processor -- start 2024-09-12T01:37:42.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.376+0000 7f66549a2640 1 -- start start 2024-09-12T01:37:42.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.377+0000 7f66549a2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 0x7f66500b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:42.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.377+0000 7f66549a2640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f66500b8730 0x7f66500d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:42.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.377+0000 7f66549a2640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665015e9d0 con 0x7f665015e5f0 2024-09-12T01:37:42.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.377+0000 7f66549a2640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f66500b9b30 con 0x7f66500b8730 2024-09-12T01:37:42.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.377+0000 7f66549a2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f66500b8f20 con 0x7f66500d1590 2024-09-12T01:37:42.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664ffff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f66500b8730 0x7f66500d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:42.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 0x7f66500b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:42.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664f7fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f665015e5f0 0x7f66500d0e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:39248/0 (socket says 172.21.15.60:39248) 2024-09-12T01:37:42.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664ffff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f66500b8730 0x7f66500d2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:54966/0 (socket says 172.21.15.60:54966) 2024-09-12T01:37:42.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664f7fe640 1 -- 172.21.15.60:0/2392687292 learned_addr learned my addr 172.21.15.60:0/2392687292 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:42.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 0x7f66500b81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:60752/0 (socket says 172.21.15.60:60752) 2024-09-12T01:37:42.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664e7fc640 1 -- 172.21.15.60:0/2392687292 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3196113595 0 0) 0x7f665015e9d0 con 0x7f665015e5f0 2024-09-12T01:37:42.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664e7fc640 1 -- 172.21.15.60:0/2392687292 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6638003520 con 0x7f665015e5f0 2024-09-12T01:37:42.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664ffff640 1 -- 172.21.15.60:0/2392687292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 msgr2=0x7f66500b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:42.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664ffff640 1 --2- 172.21.15.60:0/2392687292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 0x7f66500b81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664ffff640 1 -- 172.21.15.60:0/2392687292 >> v1:172.21.15.105:6789/0 conn(0x7f665015e5f0 legacy=0x7f66500d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664ffff640 1 -- 172.21.15.60:0/2392687292 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66500b9200 con 0x7f66500b8730 2024-09-12T01:37:42.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.378+0000 7f664effd640 1 --2- 172.21.15.60:0/2392687292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 0x7f66500b81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:37:42.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.379+0000 7f664ffff640 1 --2- 172.21.15.60:0/2392687292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66500b8730 0x7f66500d2bc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6648009d90 tx=0x7f664802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e86c1ac480fa254 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.379+0000 7f664e7fc640 1 -- 172.21.15.60:0/2392687292 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648007740 con 0x7f66500b8730 2024-09-12T01:37:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.379+0000 7f664e7fc640 1 -- 172.21.15.60:0/2392687292 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66480078e0 con 0x7f66500b8730 2024-09-12T01:37:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.379+0000 7f664e7fc640 1 -- 172.21.15.60:0/2392687292 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648007c90 con 0x7f66500b8730 2024-09-12T01:37:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.380+0000 7f66549a2640 1 -- 172.21.15.60:0/2392687292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66500b8730 msgr2=0x7f66500d2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.380+0000 7f66549a2640 1 --2- 172.21.15.60:0/2392687292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66500b8730 0x7f66500d2bc0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6648009d90 tx=0x7f664802a660 comp rx=0 tx=0).stop 2024-09-12T01:37:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.380+0000 7f66549a2640 1 -- 172.21.15.60:0/2392687292 shutdown_connections 2024-09-12T01:37:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.380+0000 7f66549a2640 1 --2- 172.21.15.60:0/2392687292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66500b8730 0x7f66500d2bc0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.380+0000 7f66549a2640 1 --2- 172.21.15.60:0/2392687292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 0x7f66500b81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.380+0000 7f66549a2640 1 -- 172.21.15.60:0/2392687292 >> 172.21.15.60:0/2392687292 conn(0x7f6650062630 msgr2=0x7f6650062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.380+0000 7f66549a2640 1 -- 172.21.15.60:0/2392687292 shutdown_connections 2024-09-12T01:37:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.380+0000 7f66549a2640 1 -- 172.21.15.60:0/2392687292 wait complete. 2024-09-12T01:37:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.381+0000 7f66549a2640 1 Processor -- start 2024-09-12T01:37:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.381+0000 7f66549a2640 1 -- start start 2024-09-12T01:37:42.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f66549a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66500b8730 0x7f66501f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:42.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f66549a2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 0x7f6650160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:42.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f66549a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f665015e5f0 0x7f66500d3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:42.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f66549a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f66500b8ba0 con 0x7f665015e5f0 2024-09-12T01:37:42.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f66549a2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66500b97c0 con 0x7f66500b8730 2024-09-12T01:37:42.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f66549a2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f66500d3100 con 0x7f66500d1590 2024-09-12T01:37:42.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f664ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f665015e5f0 0x7f66500d3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:42.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f664ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f665015e5f0 0x7f66500d3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44026/0 (socket says 172.21.15.60:44026) 2024-09-12T01:37:42.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f664ffff640 1 -- 172.21.15.60:0/3591475082 learned_addr learned my addr 172.21.15.60:0/3591475082 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f664effd640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 0x7f6650160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f664f7fe640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66500b8730 0x7f66501f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f664ffff640 1 -- 172.21.15.60:0/3591475082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 msgr2=0x7f6650160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f664ffff640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 0x7f6650160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f664ffff640 1 -- 172.21.15.60:0/3591475082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66500b8730 msgr2=0x7f66501f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f664ffff640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66500b8730 0x7f66501f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f664ffff640 1 -- 172.21.15.60:0/3591475082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66500c9f50 con 0x7f665015e5f0 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.382+0000 7f664effd640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 0x7f6650160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.383+0000 7f664ffff640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f665015e5f0 0x7f66500d3530 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6648009d90 tx=0x7f6648004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.383+0000 7f6637fff640 1 -- 172.21.15.60:0/3591475082 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648009450 con 0x7f665015e5f0 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.383+0000 7f6637fff640 1 -- 172.21.15.60:0/3591475082 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6648004240 con 0x7f665015e5f0 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.383+0000 7f6637fff640 1 -- 172.21.15.60:0/3591475082 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648004630 con 0x7f665015e5f0 2024-09-12T01:37:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.383+0000 7f66549a2640 1 -- 172.21.15.60:0/3591475082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66500ca230 con 0x7f665015e5f0 2024-09-12T01:37:42.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.383+0000 7f66549a2640 1 -- 172.21.15.60:0/3591475082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66500ca7f0 con 0x7f665015e5f0 2024-09-12T01:37:42.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.384+0000 7f66549a2640 1 -- 172.21.15.60:0/3591475082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66500b4f80 con 0x7f665015e5f0 2024-09-12T01:37:42.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.384+0000 7f6637fff640 1 -- 172.21.15.60:0/3591475082 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6648039040 con 0x7f665015e5f0 2024-09-12T01:37:42.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.385+0000 7f6637fff640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f663c06be30 0x7f663c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:42.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.385+0000 7f6637fff640 1 -- 172.21.15.60:0/3591475082 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f66480aba90 con 0x7f665015e5f0 2024-09-12T01:37:42.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.385+0000 7f664f7fe640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f663c06be30 0x7f663c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:42.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.385+0000 7f664f7fe640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f663c06be30 0x7f663c06e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6640001200 tx=0x7f6640000bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:42.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.389+0000 7f6637fff640 1 -- 172.21.15.60:0/3591475082 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66500b4f80 con 0x7f665015e5f0 2024-09-12T01:37:42.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.630+0000 7f66549a2640 1 -- 172.21.15.60:0/3591475082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f66500d2bc0 con 0x7f665015e5f0 2024-09-12T01:37:42.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.631+0000 7f6637fff640 1 -- 172.21.15.60:0/3591475082 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f6648040030 con 0x7f665015e5f0 2024-09-12T01:37:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:42.630 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:37:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2024-09-12T01:37:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.630 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2024-09-12T01:37:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmIK3fKxAAM9RkghDZwJZWuKouIbObDw==", 2024-09-12T01:37:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:37:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:37:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:37:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2024-09-12T01:37:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmzqHZNxAAnhCo4gGwLgYDVzzYnoiDFA==", 2024-09-12T01:37:42.631 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmksMWMxAAp3xMDD09rfphgPZwQcEABA==", 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:37:42.632 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmvLw/AxAApd4hl5LRD1QddnPPjRw2Kg==", 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.633 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA7ReJmc3D/JxAAXiw6n1Q3n9sCXln6YSiCBA==", 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA/ReJmEOu3CxAA4uu1neLh0mpeG9nia+/VqQ==", 2024-09-12T01:37:42.634 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBCReJm3HHtDhAAoAdKVsjuXmpcf5R5zTtFKg==", 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBFReJmtRLuIBAA/BBibpGfpXsFXqVjVrmXWA==", 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBMReJmdDNXKhAAeh5aCvMw+70z3tnwjb9Hjg==", 2024-09-12T01:37:42.636 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBQReJm/tsIHRAAmgx+5WifY/VITGHAbUV2CQ==", 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBUReJmQFaBHhAA1vH01tePCoJQFXlHB5gcVg==", 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBYReJmTHqLAhAAtUB94Pa3eihlVdaupZ8Ggg==", 2024-09-12T01:37:42.638 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ==", 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmTopGEBAAY0K3iZm2PotQc8a489uO/Q==", 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2024-09-12T01:37:42.640 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmqUgQDRAAAp5SAwNM9aSxZ1VVRwroNA==", 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmGfzeFRAAE2xCnzeyX/KBo3NBrkixYQ==", 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:37:42.641 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmOfXYDxAA0hydSyRvFmmNvFcRwPaXqg==", 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.642 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmjpyMKBAAMSGgYJddHs7TtCV0NszZAQ==", 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJm3Ei+JBAAhwgXWq0baTlDtaLedcaHmg==", 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:37:42.643 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:37:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:37:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.644 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T01:37:42.644 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:37:42.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.632+0000 7f66549a2640 1 -- 172.21.15.60:0/3591475082 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f663c06be30 msgr2=0x7f663c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.632+0000 7f66549a2640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f663c06be30 0x7f663c06e2f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6640001200 tx=0x7f6640000bc0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.633+0000 7f66549a2640 1 -- 172.21.15.60:0/3591475082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f665015e5f0 msgr2=0x7f66500d3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.633+0000 7f66549a2640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f665015e5f0 0x7f66500d3530 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6648009d90 tx=0x7f6648004a40 comp rx=0 tx=0).stop 2024-09-12T01:37:42.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.633+0000 7f66549a2640 1 -- 172.21.15.60:0/3591475082 shutdown_connections 2024-09-12T01:37:42.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.633+0000 7f66549a2640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f665015e5f0 0x7f66500d3530 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.633+0000 7f66549a2640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f663c06be30 0x7f663c06e2f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.633+0000 7f66549a2640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66500d1590 0x7f6650160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.633+0000 7f66549a2640 1 --2- 172.21.15.60:0/3591475082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66500b8730 0x7f66501f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.633+0000 7f66549a2640 1 -- 172.21.15.60:0/3591475082 >> 172.21.15.60:0/3591475082 conn(0x7f6650062630 msgr2=0x7f66500ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:42.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.633+0000 7f66549a2640 1 -- 172.21.15.60:0/3591475082 shutdown_connections 2024-09-12T01:37:42.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.633+0000 7f66549a2640 1 -- 172.21.15.60:0/3591475082 wait complete. 2024-09-12T01:37:42.647 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:37:42.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.750+0000 7f500021e640 1 Processor -- start 2024-09-12T01:37:42.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.750+0000 7f500021e640 1 -- start start 2024-09-12T01:37:42.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.751+0000 7f500021e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80b63d0 0x7f4ff80d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:42.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.751+0000 7f500021e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ff80cf6b0 0x7f4ff80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:42.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.751+0000 7f500021e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff80cfc20 con 0x7f4ff80d1c80 2024-09-12T01:37:42.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.751+0000 7f500021e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4ff80d2ed0 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.751+0000 7f500021e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff80d31b0 con 0x7f4ff80b63d0 2024-09-12T01:37:42.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.751+0000 7f4ffd7b9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ff80cf6b0 0x7f4ff80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:42.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.751+0000 7f4ffd7b9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ff80cf6b0 0x7f4ff80b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51802/0 (socket says 172.21.15.60:51802) 2024-09-12T01:37:42.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.751+0000 7f4ffd7b9640 1 -- 172.21.15.60:0/1720596330 learned_addr learned my addr 172.21.15.60:0/1720596330 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:42.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.751+0000 7f4ffdfba640 1 --2- 172.21.15.60:0/1720596330 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80b63d0 0x7f4ff80d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:42.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.752+0000 7f4ffd7b9640 1 -- 172.21.15.60:0/1720596330 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80b63d0 msgr2=0x7f4ff80d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:42.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.752+0000 7f4ffd7b9640 1 --2- 172.21.15.60:0/1720596330 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80b63d0 0x7f4ff80d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.752+0000 7f4ffd7b9640 1 -- 172.21.15.60:0/1720596330 >> v1:172.21.15.105:6789/0 conn(0x7f4ff80d1c80 legacy=0x7f4ff80b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.752+0000 7f4ffcfb8640 1 -- 172.21.15.60:0/1720596330 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1005325538 0 0) 0x7f4ff80cfc20 con 0x7f4ff80d1c80 2024-09-12T01:37:42.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.752+0000 7f4ffd7b9640 1 -- 172.21.15.60:0/1720596330 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff80d3490 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.752+0000 7f4ffd7b9640 1 --2- 172.21.15.60:0/1720596330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf6b0 0x7f4ff80b7880 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009870 tx=0x7f4fe802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5043f30df905c4fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.752+0000 7f4ffcfb8640 1 -- 172.21.15.60:0/1720596330 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8037070 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.752+0000 7f4ffcfb8640 1 -- 172.21.15.60:0/1720596330 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe8032440 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.752+0000 7f4ffcfb8640 1 -- 172.21.15.60:0/1720596330 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8032810 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.753+0000 7f500021e640 1 -- 172.21.15.60:0/1720596330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf6b0 msgr2=0x7f4ff80b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.753+0000 7f500021e640 1 --2- 172.21.15.60:0/1720596330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf6b0 0x7f4ff80b7880 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009870 tx=0x7f4fe802a130 comp rx=0 tx=0).stop 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.753+0000 7f500021e640 1 -- 172.21.15.60:0/1720596330 shutdown_connections 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.753+0000 7f500021e640 1 --2- 172.21.15.60:0/1720596330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf6b0 0x7f4ff80b7880 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.753+0000 7f500021e640 1 --2- 172.21.15.60:0/1720596330 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80b63d0 0x7f4ff80d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.753+0000 7f500021e640 1 -- 172.21.15.60:0/1720596330 >> 172.21.15.60:0/1720596330 conn(0x7f4ff80d1160 msgr2=0x7f4ff80d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.753+0000 7f500021e640 1 -- 172.21.15.60:0/1720596330 shutdown_connections 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.753+0000 7f500021e640 1 -- 172.21.15.60:0/1720596330 wait complete. 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.754+0000 7f500021e640 1 Processor -- start 2024-09-12T01:37:42.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.754+0000 7f500021e640 1 -- start start 2024-09-12T01:37:42.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f500021e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ff80b63d0 0x7f4ff8155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:42.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f500021e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf6b0 0x7f4ff80ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:42.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f500021e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80d1c80 0x7f4ff80ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:42.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f500021e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff80d4070 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f500021e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff80d3ef0 con 0x7f4ff80b63d0 2024-09-12T01:37:42.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f500021e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff80b67b0 con 0x7f4ff80d1c80 2024-09-12T01:37:42.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f4ffd7b9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf6b0 0x7f4ff80ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:42.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f4ffd7b9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf6b0 0x7f4ff80ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51810/0 (socket says 172.21.15.60:51810) 2024-09-12T01:37:42.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f4ffd7b9640 1 -- 172.21.15.60:0/4086338889 learned_addr learned my addr 172.21.15.60:0/4086338889 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:42.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f4ffdfba640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ff80b63d0 0x7f4ff8155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:42.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f4ffe7bb640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80d1c80 0x7f4ff80ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:42.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f4ffd7b9640 1 -- 172.21.15.60:0/4086338889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80d1c80 msgr2=0x7f4ff80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.755+0000 7f4ffd7b9640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80d1c80 0x7f4ff80ceb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.756+0000 7f4ffd7b9640 1 -- 172.21.15.60:0/4086338889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ff80b63d0 msgr2=0x7f4ff8155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.756+0000 7f4ffd7b9640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ff80b63d0 0x7f4ff8155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.756+0000 7f4ffd7b9640 1 -- 172.21.15.60:0/4086338889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff81f56b0 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.756+0000 7f4ffd7b9640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf6b0 0x7f4ff80ce640 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8000c00 tx=0x7f4fe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:42.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.756+0000 7f4fee7fc640 1 -- 172.21.15.60:0/4086338889 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8041020 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.756+0000 7f4fee7fc640 1 -- 172.21.15.60:0/4086338889 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe8030640 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.756+0000 7f500021e640 1 -- 172.21.15.60:0/4086338889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff80abfd0 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.756+0000 7f4fee7fc640 1 -- 172.21.15.60:0/4086338889 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe8037040 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.756+0000 7f500021e640 1 -- 172.21.15.60:0/4086338889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff80cb950 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.757+0000 7f500021e640 1 -- 172.21.15.60:0/4086338889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff80ac4f0 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.757+0000 7f4fee7fc640 1 -- 172.21.15.60:0/4086338889 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fe8044020 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.758+0000 7f4fee7fc640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fdc06be30 0x7f4fdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:42.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.758+0000 7f4ffdfba640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fdc06be30 0x7f4fdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:42.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.758+0000 7f4fee7fc640 1 -- 172.21.15.60:0/4086338889 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7f4fe80ab1a0 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.759+0000 7f4ffdfba640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fdc06be30 0x7f4fdc06e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80cd500 tx=0x7f4ff4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:42.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.763+0000 7f4fee7fc640 1 -- 172.21.15.60:0/4086338889 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ff80ac4f0 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.938+0000 7f500021e640 1 -- 172.21.15.60:0/4086338889 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f4ff80d39b0 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.939+0000 7f4fee7fc640 1 -- 172.21.15.60:0/4086338889 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) ==== 84+0+65 (secure 0 0 0) 0x7f4fe804b030 con 0x7f4ff80cf6b0 2024-09-12T01:37:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:42.938 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T01:37:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:37:42.938 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T01:37:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T01:37:42.939 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:37:42.939 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T01:37:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.941+0000 7f500021e640 1 -- 172.21.15.60:0/4086338889 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fdc06be30 msgr2=0x7f4fdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.941+0000 7f500021e640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fdc06be30 0x7f4fdc06e2f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4ff80cd500 tx=0x7f4ff4009190 comp rx=0 tx=0).stop 2024-09-12T01:37:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.941+0000 7f500021e640 1 -- 172.21.15.60:0/4086338889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf6b0 msgr2=0x7f4ff80ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.941+0000 7f500021e640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf6b0 0x7f4ff80ce640 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8000c00 tx=0x7f4fe80046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.941+0000 7f500021e640 1 -- 172.21.15.60:0/4086338889 shutdown_connections 2024-09-12T01:37:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.941+0000 7f500021e640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fdc06be30 0x7f4fdc06e2f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.941+0000 7f500021e640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ff80d1c80 0x7f4ff80ceb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.941+0000 7f500021e640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ff80cf6b0 0x7f4ff80ce640 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.941+0000 7f500021e640 1 --2- 172.21.15.60:0/4086338889 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ff80b63d0 0x7f4ff8155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:42.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.941+0000 7f500021e640 1 -- 172.21.15.60:0/4086338889 >> 172.21.15.60:0/4086338889 conn(0x7f4ff80d1160 msgr2=0x7f4ff80b77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:42.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.941+0000 7f500021e640 1 -- 172.21.15.60:0/4086338889 shutdown_connections 2024-09-12T01:37:42.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:42.941+0000 7f500021e640 1 -- 172.21.15.60:0/4086338889 wait complete. 2024-09-12T01:37:42.951 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:37:42.952 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:37:43.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.060+0000 7fad9d453640 1 Processor -- start 2024-09-12T01:37:43.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.060+0000 7fad9d453640 1 -- start start 2024-09-12T01:37:43.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad9d453640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9815b480 0x7fad980b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad9d453640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad980ccff0 con 0x7fad980b60c0 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad9d453640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad980cd2d0 con 0x7fad98072700 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad9d453640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad980b6500 con 0x7fad9815b480 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad967fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fad980b60c0 0x7fad98071ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42272/0 (socket says 172.21.15.60:42272) 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad967fc640 1 -- 172.21.15.60:0/1960987451 learned_addr learned my addr 172.21.15.60:0/1960987451 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad96ffd640 1 --2- 172.21.15.60:0/1960987451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9815b480 0x7fad980b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad95ffb640 1 -- 172.21.15.60:0/1960987451 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826914472 0 0) 0x7fad980ccff0 con 0x7fad980b60c0 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad95ffb640 1 -- 172.21.15.60:0/1960987451 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad80003520 con 0x7fad980b60c0 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad95ffb640 1 -- 172.21.15.60:0/1960987451 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2671525317 0 0) 0x7fad980cd2d0 con 0x7fad98072700 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad95ffb640 1 -- 172.21.15.60:0/1960987451 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad980ccff0 con 0x7fad98072700 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad96ffd640 1 -- 172.21.15.60:0/1960987451 >> v1:172.21.15.105:6789/0 conn(0x7fad98072700 legacy=0x7fad9815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad96ffd640 1 -- 172.21.15.60:0/1960987451 >> v1:172.21.15.60:6789/0 conn(0x7fad980b60c0 legacy=0x7fad98071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:43.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.061+0000 7fad96ffd640 1 -- 172.21.15.60:0/1960987451 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad980cd5b0 con 0x7fad9815b480 2024-09-12T01:37:43.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.062+0000 7fad96ffd640 1 --2- 172.21.15.60:0/1960987451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9815b480 0x7fad980b5b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad880097d0 tx=0x7fad8802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68c7f07619d997d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:43.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.062+0000 7fad95ffb640 1 -- 172.21.15.60:0/1960987451 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad88037070 con 0x7fad9815b480 2024-09-12T01:37:43.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.062+0000 7fad95ffb640 1 -- 172.21.15.60:0/1960987451 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad88032440 con 0x7fad9815b480 2024-09-12T01:37:43.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.062+0000 7fad95ffb640 1 -- 172.21.15.60:0/1960987451 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad880327f0 con 0x7fad9815b480 2024-09-12T01:37:43.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.063+0000 7fad9d453640 1 -- 172.21.15.60:0/1960987451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9815b480 msgr2=0x7fad980b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:43.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.063+0000 7fad9d453640 1 --2- 172.21.15.60:0/1960987451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9815b480 0x7fad980b5b80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad880097d0 tx=0x7fad8802a180 comp rx=0 tx=0).stop 2024-09-12T01:37:43.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.063+0000 7fad9d453640 1 -- 172.21.15.60:0/1960987451 shutdown_connections 2024-09-12T01:37:43.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.063+0000 7fad9d453640 1 --2- 172.21.15.60:0/1960987451 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9815b480 0x7fad980b5b80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:43.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.063+0000 7fad9d453640 1 -- 172.21.15.60:0/1960987451 >> 172.21.15.60:0/1960987451 conn(0x7fad9806d0f0 msgr2=0x7fad9806d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:43.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.063+0000 7fad9d453640 1 -- 172.21.15.60:0/1960987451 shutdown_connections 2024-09-12T01:37:43.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.063+0000 7fad9d453640 1 -- 172.21.15.60:0/1960987451 wait complete. 2024-09-12T01:37:43.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.064+0000 7fad9d453640 1 Processor -- start 2024-09-12T01:37:43.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.064+0000 7fad9d453640 1 -- start start 2024-09-12T01:37:43.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad9d453640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad98072700 0x7fad9813f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:43.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad9d453640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad980b60c0 0x7fad981504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:43.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad9d453640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815b480 0x7fad980d0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad9d453640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fad9815b860 con 0x7fad98072700 2024-09-12T01:37:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad9d453640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad980cdb70 con 0x7fad9815b480 2024-09-12T01:37:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad9d453640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad9815b9e0 con 0x7fad980b60c0 2024-09-12T01:37:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad96ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad98072700 0x7fad9813f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad96ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad98072700 0x7fad9813f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51822/0 (socket says 172.21.15.60:51822) 2024-09-12T01:37:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad96ffd640 1 -- 172.21.15.60:0/2528057937 learned_addr learned my addr 172.21.15.60:0/2528057937 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad967fc640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad980b60c0 0x7fad981504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad96ffd640 1 -- 172.21.15.60:0/2528057937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad980b60c0 msgr2=0x7fad981504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad977fe640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815b480 0x7fad980d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad96ffd640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad980b60c0 0x7fad981504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:43.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad96ffd640 1 -- 172.21.15.60:0/2528057937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815b480 msgr2=0x7fad980d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad96ffd640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815b480 0x7fad980d0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.065+0000 7fad96ffd640 1 -- 172.21.15.60:0/2528057937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad98140320 con 0x7fad98072700 2024-09-12T01:37:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.066+0000 7fad96ffd640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad98072700 0x7fad9813f8d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fad8802a1c0 tx=0x7fad880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.066+0000 7fad7f7fe640 1 -- 172.21.15.60:0/2528057937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad88037040 con 0x7fad98072700 2024-09-12T01:37:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.066+0000 7fad7f7fe640 1 -- 172.21.15.60:0/2528057937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad88042070 con 0x7fad98072700 2024-09-12T01:37:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.066+0000 7fad9d453640 1 -- 172.21.15.60:0/2528057937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad9813fe10 con 0x7fad98072700 2024-09-12T01:37:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.066+0000 7fad7f7fe640 1 -- 172.21.15.60:0/2528057937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad880308c0 con 0x7fad98072700 2024-09-12T01:37:43.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.066+0000 7fad9d453640 1 -- 172.21.15.60:0/2528057937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad9813d080 con 0x7fad98072700 2024-09-12T01:37:43.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.067+0000 7fad9d453640 1 -- 172.21.15.60:0/2528057937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad980b5b80 con 0x7fad98072700 2024-09-12T01:37:43.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.067+0000 7fad7f7fe640 1 -- 172.21.15.60:0/2528057937 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad88030a60 con 0x7fad98072700 2024-09-12T01:37:43.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.068+0000 7fad7f7fe640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad8406be30 0x7fad8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:43.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.068+0000 7fad7f7fe640 1 -- 172.21.15.60:0/2528057937 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4857+0+0 (secure 0 0 0) 0x7fad880ab500 con 0x7fad98072700 2024-09-12T01:37:43.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.068+0000 7fad967fc640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad8406be30 0x7fad8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:43.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.068+0000 7fad967fc640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad8406be30 0x7fad8406e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad98143540 tx=0x7fad8c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:43.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.072+0000 7fad7f7fe640 1 -- 172.21.15.60:0/2528057937 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad9813fe10 con 0x7fad98072700 2024-09-12T01:37:43.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.246+0000 7fad9d453640 1 -- 172.21.15.60:0/2528057937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fad980cfe00 con 0x7fad98072700 2024-09-12T01:37:43.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.939+0000 7fad7f7fe640 1 -- 172.21.15.60:0/2528057937 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) ==== 138+0+0 (secure 0 0 0) 0x7fad98140320 con 0x7fad98072700 2024-09-12T01:37:43.939 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-12T01:37:43.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.943+0000 7fad9d453640 1 -- 172.21.15.60:0/2528057937 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad8406be30 msgr2=0x7fad8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:43.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.943+0000 7fad9d453640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad8406be30 0x7fad8406e2f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fad98143540 tx=0x7fad8c009040 comp rx=0 tx=0).stop 2024-09-12T01:37:43.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.943+0000 7fad9d453640 1 -- 172.21.15.60:0/2528057937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad98072700 msgr2=0x7fad9813f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:43.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.943+0000 7fad9d453640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad98072700 0x7fad9813f8d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fad8802a1c0 tx=0x7fad880046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:43.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.944+0000 7fad9d453640 1 -- 172.21.15.60:0/2528057937 shutdown_connections 2024-09-12T01:37:43.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.944+0000 7fad9d453640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9815b480 0x7fad980d0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:43.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.944+0000 7fad9d453640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad8406be30 0x7fad8406e2f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:43.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.944+0000 7fad9d453640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad980b60c0 0x7fad981504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:43.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.944+0000 7fad9d453640 1 --2- 172.21.15.60:0/2528057937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad98072700 0x7fad9813f8d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:43.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.944+0000 7fad9d453640 1 -- 172.21.15.60:0/2528057937 >> 172.21.15.60:0/2528057937 conn(0x7fad9806d0f0 msgr2=0x7fad981579c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:43.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.944+0000 7fad9d453640 1 -- 172.21.15.60:0/2528057937 shutdown_connections 2024-09-12T01:37:43.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:43.944+0000 7fad9d453640 1 -- 172.21.15.60:0/2528057937 wait complete. 2024-09-12T01:37:43.961 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:37:44.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.078+0000 7f0972d86640 1 Processor -- start 2024-09-12T01:37:44.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.079+0000 7f0972d86640 1 -- start start 2024-09-12T01:37:44.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.079+0000 7f0972d86640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f096c15e7a0 0x7f096c06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:44.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.079+0000 7f0972d86640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f096c0cf1f0 0x7f096c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:44.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.079+0000 7f0972d86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f096c0b6720 0x7f096c1623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:44.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.079+0000 7f0972d86640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f096c0d2ca0 con 0x7f096c15e7a0 2024-09-12T01:37:44.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.079+0000 7f0972d86640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f096c0cf860 con 0x7f096c0cf1f0 2024-09-12T01:37:44.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.079+0000 7f0972d86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f096c0cfb40 con 0x7f096c0b6720 2024-09-12T01:37:44.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.079+0000 7f0970b22640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f096c15e7a0 0x7f096c06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:44.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.080+0000 7f0970b22640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f096c15e7a0 0x7f096c06caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51826/0 (socket says 172.21.15.60:51826) 2024-09-12T01:37:44.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.080+0000 7f0970b22640 1 -- 172.21.15.60:0/3124004555 learned_addr learned my addr 172.21.15.60:0/3124004555 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:44.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.080+0000 7f096bfff640 1 --2- 172.21.15.60:0/3124004555 >> v2:172.21.15.105:3300/0 conn(0x7f096c0cf1f0 0x7f096c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:44.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.080+0000 7f0971323640 1 --2- 172.21.15.60:0/3124004555 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f096c0b6720 0x7f096c1623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:44.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.080+0000 7f0970b22640 1 -- 172.21.15.60:0/3124004555 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f096c0b6720 msgr2=0x7f096c1623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:44.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.080+0000 7f0970b22640 1 --2- 172.21.15.60:0/3124004555 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f096c0b6720 0x7f096c1623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:44.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.080+0000 7f0970b22640 1 -- 172.21.15.60:0/3124004555 >> v2:172.21.15.105:3300/0 conn(0x7f096c0cf1f0 msgr2=0x7f096c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:44.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.080+0000 7f0970b22640 1 --2- 172.21.15.60:0/3124004555 >> v2:172.21.15.105:3300/0 conn(0x7f096c0cf1f0 0x7f096c0b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:44.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.080+0000 7f0970b22640 1 -- 172.21.15.60:0/3124004555 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c0cfe20 con 0x7f096c15e7a0 2024-09-12T01:37:44.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.080+0000 7f096bfff640 1 --2- 172.21.15.60:0/3124004555 >> v2:172.21.15.105:3300/0 conn(0x7f096c0cf1f0 0x7f096c0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:44.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.080+0000 7f0971323640 1 --2- 172.21.15.60:0/3124004555 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f096c0b6720 0x7f096c1623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f0970b22640 1 --2- 172.21.15.60:0/3124004555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096c15e7a0 0x7f096c06caa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f096c0d2110 tx=0x7f095c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6784e712eeab36ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f096b7fe640 1 -- 172.21.15.60:0/3124004555 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c036070 con 0x7f096c15e7a0 2024-09-12T01:37:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f096b7fe640 1 -- 172.21.15.60:0/3124004555 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095c031600 con 0x7f096c15e7a0 2024-09-12T01:37:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f096b7fe640 1 -- 172.21.15.60:0/3124004555 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f095c0319d0 con 0x7f096c15e7a0 2024-09-12T01:37:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f0972d86640 1 -- 172.21.15.60:0/3124004555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096c15e7a0 msgr2=0x7f096c06caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f0972d86640 1 --2- 172.21.15.60:0/3124004555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096c15e7a0 0x7f096c06caa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f096c0d2110 tx=0x7f095c02a610 comp rx=0 tx=0).stop 2024-09-12T01:37:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f0972d86640 1 -- 172.21.15.60:0/3124004555 shutdown_connections 2024-09-12T01:37:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f0972d86640 1 --2- 172.21.15.60:0/3124004555 >> v2:172.21.15.105:3300/0 conn(0x7f096c0cf1f0 0x7f096c0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f0972d86640 1 --2- 172.21.15.60:0/3124004555 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f096c0b6720 0x7f096c1623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f0972d86640 1 --2- 172.21.15.60:0/3124004555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096c15e7a0 0x7f096c06caa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f0972d86640 1 -- 172.21.15.60:0/3124004555 >> 172.21.15.60:0/3124004555 conn(0x7f096c0d11e0 msgr2=0x7f096c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f0972d86640 1 -- 172.21.15.60:0/3124004555 shutdown_connections 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.081+0000 7f0972d86640 1 -- 172.21.15.60:0/3124004555 wait complete. 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.083+0000 7f0972d86640 1 Processor -- start 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.083+0000 7f0972d86640 1 -- start start 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.083+0000 7f0972d86640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f096c0b6720 0x7f096c0ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.083+0000 7f0972d86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f096c0cf1f0 0x7f096c0d3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0972d86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096c15e7a0 0x7f096c15ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0972d86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f096c06cfe0 con 0x7f096c15e7a0 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0972d86640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f096c0b7a00 con 0x7f096c0b6720 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0972d86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f096c15eb80 con 0x7f096c0cf1f0 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0971323640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096c15e7a0 0x7f096c15ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:44.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0971323640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096c15e7a0 0x7f096c15ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51834/0 (socket says 172.21.15.60:51834) 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0971323640 1 -- 172.21.15.60:0/2649521601 learned_addr learned my addr 172.21.15.60:0/2649521601 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f096bfff640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f096c0cf1f0 0x7f096c0d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0970b22640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f096c0b6720 0x7f096c0ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0971323640 1 -- 172.21.15.60:0/2649521601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f096c0cf1f0 msgr2=0x7f096c0d3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0971323640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f096c0cf1f0 0x7f096c0d3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0971323640 1 -- 172.21.15.60:0/2649521601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f096c0b6720 msgr2=0x7f096c0ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0971323640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f096c0b6720 0x7f096c0ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0971323640 1 -- 172.21.15.60:0/2649521601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c0b8590 con 0x7f096c15e7a0 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0971323640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096c15e7a0 0x7f096c15ee70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f096400afd0 tx=0x7f096400ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f09697fa640 1 -- 172.21.15.60:0/2649521601 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964015020 con 0x7f096c15e7a0 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f09697fa640 1 -- 172.21.15.60:0/2649521601 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0964004440 con 0x7f096c15e7a0 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0972d86640 1 -- 172.21.15.60:0/2649521601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096c0b8870 con 0x7f096c15e7a0 2024-09-12T01:37:44.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f09697fa640 1 -- 172.21.15.60:0/2649521601 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0964003850 con 0x7f096c15e7a0 2024-09-12T01:37:44.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.084+0000 7f0972d86640 1 -- 172.21.15.60:0/2649521601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096c160d60 con 0x7f096c15e7a0 2024-09-12T01:37:44.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.086+0000 7f0972d86640 1 -- 172.21.15.60:0/2649521601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f096c0b61e0 con 0x7f096c15e7a0 2024-09-12T01:37:44.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.086+0000 7f09697fa640 1 -- 172.21.15.60:0/2649521601 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0964018020 con 0x7f096c15e7a0 2024-09-12T01:37:44.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.087+0000 7f09697fa640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f094c06be30 0x7f094c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:44.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.087+0000 7f09697fa640 1 -- 172.21.15.60:0/2649521601 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5227+0+0 (secure 0 0 0) 0x7f096408abc0 con 0x7f096c15e7a0 2024-09-12T01:37:44.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.087+0000 7f0970b22640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f094c06be30 0x7f094c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:44.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.087+0000 7f0970b22640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f094c06be30 0x7f094c06e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f095c033000 tx=0x7f095c009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:44.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.092+0000 7f09697fa640 1 -- 172.21.15.60:0/2649521601 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f096401f020 con 0x7f096c15e7a0 2024-09-12T01:37:44.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.267+0000 7f0972d86640 1 -- 172.21.15.60:0/2649521601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f096c0d2a80 con 0x7f096c15e7a0 2024-09-12T01:37:44.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.948+0000 7f09697fa640 1 -- 172.21.15.60:0/2649521601 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) ==== 170+0+0 (secure 0 0 0) 0x7f09640597e0 con 0x7f096c15e7a0 2024-09-12T01:37:44.947 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-12T01:37:44.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.951+0000 7f0972d86640 1 -- 172.21.15.60:0/2649521601 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f094c06be30 msgr2=0x7f094c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:44.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.951+0000 7f0972d86640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f094c06be30 0x7f094c06e2f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f095c033000 tx=0x7f095c009000 comp rx=0 tx=0).stop 2024-09-12T01:37:44.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.951+0000 7f0972d86640 1 -- 172.21.15.60:0/2649521601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096c15e7a0 msgr2=0x7f096c15ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:44.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.951+0000 7f0972d86640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096c15e7a0 0x7f096c15ee70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f096400afd0 tx=0x7f096400ca20 comp rx=0 tx=0).stop 2024-09-12T01:37:44.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.951+0000 7f0972d86640 1 -- 172.21.15.60:0/2649521601 shutdown_connections 2024-09-12T01:37:44.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.951+0000 7f0972d86640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f096c15e7a0 0x7f096c15ee70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:44.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.951+0000 7f0972d86640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f094c06be30 0x7f094c06e2f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:44.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.951+0000 7f0972d86640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f096c0cf1f0 0x7f096c0d3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:44.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.951+0000 7f0972d86640 1 --2- 172.21.15.60:0/2649521601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f096c0b6720 0x7f096c0ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:44.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.951+0000 7f0972d86640 1 -- 172.21.15.60:0/2649521601 >> 172.21.15.60:0/2649521601 conn(0x7f096c0d11e0 msgr2=0x7f096c0b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:44.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.951+0000 7f0972d86640 1 -- 172.21.15.60:0/2649521601 shutdown_connections 2024-09-12T01:37:44.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:44.951+0000 7f0972d86640 1 -- 172.21.15.60:0/2649521601 wait complete. 2024-09-12T01:37:44.979 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:37:45.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.089+0000 7f8d3b8af640 1 Processor -- start 2024-09-12T01:37:45.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.089+0000 7f8d3b8af640 1 -- start start 2024-09-12T01:37:45.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.090+0000 7f8d3b8af640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8d3415e7a0 0x7f8d3406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:45.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.090+0000 7f8d3b8af640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8d340b68f0 0x7f8d340d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:45.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.090+0000 7f8d3b8af640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d340cf860 con 0x7f8d340cf1f0 2024-09-12T01:37:45.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.090+0000 7f8d3b8af640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f8d340d2ca0 con 0x7f8d340b68f0 2024-09-12T01:37:45.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.090+0000 7f8d3b8af640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8d340cfb40 con 0x7f8d3415e7a0 2024-09-12T01:37:45.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.090+0000 7f8d39e4c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8d340b68f0 0x7f8d340d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:45.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.090+0000 7f8d39e4c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8d340b68f0 0x7f8d340d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51842/0 (socket says 172.21.15.60:51842) 2024-09-12T01:37:45.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.090+0000 7f8d39e4c640 1 -- 172.21.15.60:0/2604054426 learned_addr learned my addr 172.21.15.60:0/2604054426 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:45.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.091+0000 7f8d3964b640 1 --2- 172.21.15.60:0/2604054426 >> v2:172.21.15.105:3300/0 conn(0x7f8d3415e7a0 0x7f8d3406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:45.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.091+0000 7f8d39e4c640 1 -- 172.21.15.60:0/2604054426 >> v2:172.21.15.105:3300/0 conn(0x7f8d3415e7a0 msgr2=0x7f8d3406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:45.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.091+0000 7f8d39e4c640 1 --2- 172.21.15.60:0/2604054426 >> v2:172.21.15.105:3300/0 conn(0x7f8d3415e7a0 0x7f8d3406caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:45.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.091+0000 7f8d39e4c640 1 -- 172.21.15.60:0/2604054426 >> v1:172.21.15.105:6789/0 conn(0x7f8d340cf1f0 legacy=0x7f8d340b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:45.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.091+0000 7f8d39e4c640 1 -- 172.21.15.60:0/2604054426 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d340cfe20 con 0x7f8d340b68f0 2024-09-12T01:37:45.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.091+0000 7f8d39e4c640 1 --2- 172.21.15.60:0/2604054426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d340b68f0 0x7f8d340d3410 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8d340d5820 tx=0x7f8d2c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a642de45c7148852 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:45.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.092+0000 7f8d2bfff640 1 -- 172.21.15.60:0/2604054426 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c036070 con 0x7f8d340b68f0 2024-09-12T01:37:45.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.092+0000 7f8d2bfff640 1 -- 172.21.15.60:0/2604054426 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2c031600 con 0x7f8d340b68f0 2024-09-12T01:37:45.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.092+0000 7f8d2bfff640 1 -- 172.21.15.60:0/2604054426 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c0319d0 con 0x7f8d340b68f0 2024-09-12T01:37:45.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.092+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2604054426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d340b68f0 msgr2=0x7f8d340d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:45.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.092+0000 7f8d3b8af640 1 --2- 172.21.15.60:0/2604054426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d340b68f0 0x7f8d340d3410 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8d340d5820 tx=0x7f8d2c02a6a0 comp rx=0 tx=0).stop 2024-09-12T01:37:45.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.092+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2604054426 shutdown_connections 2024-09-12T01:37:45.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.092+0000 7f8d3b8af640 1 --2- 172.21.15.60:0/2604054426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d340b68f0 0x7f8d340d3410 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:45.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.092+0000 7f8d3b8af640 1 --2- 172.21.15.60:0/2604054426 >> v2:172.21.15.105:3300/0 conn(0x7f8d3415e7a0 0x7f8d3406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:45.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.092+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2604054426 >> 172.21.15.60:0/2604054426 conn(0x7f8d340d11e0 msgr2=0x7f8d340d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:45.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.092+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2604054426 shutdown_connections 2024-09-12T01:37:45.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.092+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2604054426 wait complete. 2024-09-12T01:37:45.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.093+0000 7f8d3b8af640 1 Processor -- start 2024-09-12T01:37:45.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.093+0000 7f8d3b8af640 1 -- start start 2024-09-12T01:37:45.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.094+0000 7f8d3b8af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d340b68f0 0x7f8d3414eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:45.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.094+0000 7f8d3b8af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d340cf1f0 0x7f8d341f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:45.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.094+0000 7f8d3b8af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d3415e7a0 0x7f8d340b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:45.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.094+0000 7f8d3b8af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3406cfe0 con 0x7f8d340b68f0 2024-09-12T01:37:45.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.094+0000 7f8d3b8af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8d340b7a00 con 0x7f8d3415e7a0 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.094+0000 7f8d3b8af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8d3415eb80 con 0x7f8d340cf1f0 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.094+0000 7f8d3964b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d340b68f0 0x7f8d3414eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.094+0000 7f8d3964b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d340b68f0 0x7f8d3414eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51858/0 (socket says 172.21.15.60:51858) 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.094+0000 7f8d3964b640 1 -- 172.21.15.60:0/2755822111 learned_addr learned my addr 172.21.15.60:0/2755822111 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.094+0000 7f8d38e4a640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d340cf1f0 0x7f8d341f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.094+0000 7f8d39e4c640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d3415e7a0 0x7f8d340b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.095+0000 7f8d3964b640 1 -- 172.21.15.60:0/2755822111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d340cf1f0 msgr2=0x7f8d341f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.095+0000 7f8d3964b640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d340cf1f0 0x7f8d341f52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.095+0000 7f8d3964b640 1 -- 172.21.15.60:0/2755822111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d3415e7a0 msgr2=0x7f8d340b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.095+0000 7f8d3964b640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d3415e7a0 0x7f8d340b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.095+0000 7f8d3964b640 1 -- 172.21.15.60:0/2755822111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d341f57f0 con 0x7f8d340b68f0 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.095+0000 7f8d38e4a640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d340cf1f0 0x7f8d341f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:45.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.095+0000 7f8d3964b640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d340b68f0 0x7f8d3414eca0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000d830 tx=0x7f8d3000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.095+0000 7f8d29ffb640 1 -- 172.21.15.60:0/2755822111 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000b6c0 con 0x7f8d340b68f0 2024-09-12T01:37:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.095+0000 7f8d29ffb640 1 -- 172.21.15.60:0/2755822111 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d30019070 con 0x7f8d340b68f0 2024-09-12T01:37:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.095+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2755822111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d341e75d0 con 0x7f8d340b68f0 2024-09-12T01:37:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.095+0000 7f8d29ffb640 1 -- 172.21.15.60:0/2755822111 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000bac0 con 0x7f8d340b68f0 2024-09-12T01:37:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.095+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2755822111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d341e7b90 con 0x7f8d340b68f0 2024-09-12T01:37:45.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.096+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2755822111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3406caa0 con 0x7f8d340b68f0 2024-09-12T01:37:45.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.097+0000 7f8d29ffb640 1 -- 172.21.15.60:0/2755822111 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8d3001e460 con 0x7f8d340b68f0 2024-09-12T01:37:45.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.097+0000 7f8d29ffb640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8d1806be60 0x7f8d1806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:45.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.097+0000 7f8d29ffb640 1 -- 172.21.15.60:0/2755822111 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5609+0+0 (secure 0 0 0) 0x7f8d3008b430 con 0x7f8d340b68f0 2024-09-12T01:37:45.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.097+0000 7f8d38e4a640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8d1806be60 0x7f8d1806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:45.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.098+0000 7f8d38e4a640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8d1806be60 0x7f8d1806e320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d340b4170 tx=0x7f8d24009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:45.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.102+0000 7f8d29ffb640 1 -- 172.21.15.60:0/2755822111 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8d341f57f0 con 0x7f8d340b68f0 2024-09-12T01:37:45.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.313+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2755822111 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8d340d2a80 con 0x7f8d340b68f0 2024-09-12T01:37:45.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.950+0000 7f8d29ffb640 1 -- 172.21.15.60:0/2755822111 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) ==== 172+0+0 (secure 0 0 0) 0x7f8d30059e40 con 0x7f8d340b68f0 2024-09-12T01:37:45.949 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 6 and data pool 7 2024-09-12T01:37:45.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.954+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2755822111 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8d1806be60 msgr2=0x7f8d1806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:45.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.954+0000 7f8d3b8af640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8d1806be60 0x7f8d1806e320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d340b4170 tx=0x7f8d24009040 comp rx=0 tx=0).stop 2024-09-12T01:37:45.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.954+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2755822111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d340b68f0 msgr2=0x7f8d3414eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:45.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.954+0000 7f8d3b8af640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d340b68f0 0x7f8d3414eca0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000d830 tx=0x7f8d3000dcf0 comp rx=0 tx=0).stop 2024-09-12T01:37:45.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.954+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2755822111 shutdown_connections 2024-09-12T01:37:45.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.954+0000 7f8d3b8af640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8d3415e7a0 0x7f8d340b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:45.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.954+0000 7f8d3b8af640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8d1806be60 0x7f8d1806e320 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:45.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.954+0000 7f8d3b8af640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8d340cf1f0 0x7f8d341f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:45.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.954+0000 7f8d3b8af640 1 --2- 172.21.15.60:0/2755822111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d340b68f0 0x7f8d3414eca0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:45.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.954+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2755822111 >> 172.21.15.60:0/2755822111 conn(0x7f8d340d11e0 msgr2=0x7f8d3415d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:45.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.955+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2755822111 shutdown_connections 2024-09-12T01:37:45.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:45.956+0000 7f8d3b8af640 1 -- 172.21.15.60:0/2755822111 wait complete. 2024-09-12T01:37:45.985 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:37:46.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.093+0000 7f383d277640 1 Processor -- start 2024-09-12T01:37:46.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.093+0000 7f383d277640 1 -- start start 2024-09-12T01:37:46.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.094+0000 7f383d277640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f383815e7a0 0x7f38380ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.094+0000 7f383d277640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f38380cf2f0 0x7f38380cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.094+0000 7f383d277640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38380d4430 con 0x7f38380d3fe0 2024-09-12T01:37:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.094+0000 7f383d277640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f38380cfca0 con 0x7f383815e7a0 2024-09-12T01:37:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.094+0000 7f383d277640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f38380d2f40 con 0x7f38380cf2f0 2024-09-12T01:37:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.094+0000 7f3836ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f383815e7a0 0x7f38380ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.094+0000 7f382ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f38380d3fe0 0x7f38380d2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42280/0 (socket says 172.21.15.60:42280) 2024-09-12T01:37:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.094+0000 7f382ffff640 1 -- 172.21.15.60:0/2844907043 learned_addr learned my addr 172.21.15.60:0/2844907043 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.094+0000 7f3836ffd640 1 -- 172.21.15.60:0/2844907043 >> v2:172.21.15.105:3300/0 conn(0x7f38380cf2f0 msgr2=0x7f38380cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.094+0000 7f3836ffd640 1 --2- 172.21.15.60:0/2844907043 >> v2:172.21.15.105:3300/0 conn(0x7f38380cf2f0 0x7f38380cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.094+0000 7f3836ffd640 1 -- 172.21.15.60:0/2844907043 >> v1:172.21.15.60:6789/0 conn(0x7f38380d3fe0 legacy=0x7f38380d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.094+0000 7f3836ffd640 1 -- 172.21.15.60:0/2844907043 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38380d3220 con 0x7f383815e7a0 2024-09-12T01:37:46.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.095+0000 7f3836ffd640 1 --2- 172.21.15.60:0/2844907043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f383815e7a0 0x7f38380ba240 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f38380b6130 tx=0x7f382802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac87285108b5d893 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.095+0000 7f38367fc640 1 -- 172.21.15.60:0/2844907043 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828037070 con 0x7f383815e7a0 2024-09-12T01:37:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.095+0000 7f38367fc640 1 -- 172.21.15.60:0/2844907043 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3828032440 con 0x7f383815e7a0 2024-09-12T01:37:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.095+0000 7f38367fc640 1 -- 172.21.15.60:0/2844907043 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3828032810 con 0x7f383815e7a0 2024-09-12T01:37:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.096+0000 7f383d277640 1 -- 172.21.15.60:0/2844907043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f383815e7a0 msgr2=0x7f38380ba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.096+0000 7f383d277640 1 --2- 172.21.15.60:0/2844907043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f383815e7a0 0x7f38380ba240 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f38380b6130 tx=0x7f382802a230 comp rx=0 tx=0).stop 2024-09-12T01:37:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.096+0000 7f383d277640 1 -- 172.21.15.60:0/2844907043 shutdown_connections 2024-09-12T01:37:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.096+0000 7f383d277640 1 --2- 172.21.15.60:0/2844907043 >> v2:172.21.15.105:3300/0 conn(0x7f38380cf2f0 0x7f38380cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.096+0000 7f383d277640 1 --2- 172.21.15.60:0/2844907043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f383815e7a0 0x7f38380ba240 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.096+0000 7f383d277640 1 -- 172.21.15.60:0/2844907043 >> 172.21.15.60:0/2844907043 conn(0x7f38380d1550 msgr2=0x7f38380d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.096+0000 7f383d277640 1 -- 172.21.15.60:0/2844907043 shutdown_connections 2024-09-12T01:37:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.096+0000 7f383d277640 1 -- 172.21.15.60:0/2844907043 wait complete. 2024-09-12T01:37:46.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.097+0000 7f383d277640 1 Processor -- start 2024-09-12T01:37:46.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.097+0000 7f383d277640 1 -- start start 2024-09-12T01:37:46.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f383d277640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38380cf2f0 0x7f38381610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f383d277640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38380d3fe0 0x7f38381619d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f383d277640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f383815e7a0 0x7f3838150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f383d277640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38380d3ac0 con 0x7f38380d3fe0 2024-09-12T01:37:46.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f383d277640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38380d37e0 con 0x7f38380cf2f0 2024-09-12T01:37:46.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f383d277640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f383815eb80 con 0x7f383815e7a0 2024-09-12T01:37:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f382ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38380d3fe0 0x7f38381619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f382ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38380d3fe0 0x7f38381619d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51876/0 (socket says 172.21.15.60:51876) 2024-09-12T01:37:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f382ffff640 1 -- 172.21.15.60:0/3905226849 learned_addr learned my addr 172.21.15.60:0/3905226849 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f3836ffd640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38380cf2f0 0x7f38381610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f38377fe640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f383815e7a0 0x7f3838150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f382ffff640 1 -- 172.21.15.60:0/3905226849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f383815e7a0 msgr2=0x7f3838150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f382ffff640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f383815e7a0 0x7f3838150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f382ffff640 1 -- 172.21.15.60:0/3905226849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38380cf2f0 msgr2=0x7f38381610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f382ffff640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38380cf2f0 0x7f38381610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f382ffff640 1 -- 172.21.15.60:0/3905226849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3838161610 con 0x7f38380d3fe0 2024-09-12T01:37:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.098+0000 7f382ffff640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38380d3fe0 0x7f38381619d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f382000c400 tx=0x7f382000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:46.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.099+0000 7f382f7fe640 1 -- 172.21.15.60:0/3905226849 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3820017070 con 0x7f38380d3fe0 2024-09-12T01:37:46.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.099+0000 7f382f7fe640 1 -- 172.21.15.60:0/3905226849 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3820005ce0 con 0x7f38380d3fe0 2024-09-12T01:37:46.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.099+0000 7f383d277640 1 -- 172.21.15.60:0/3905226849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3838161f10 con 0x7f38380d3fe0 2024-09-12T01:37:46.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.099+0000 7f382f7fe640 1 -- 172.21.15.60:0/3905226849 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38200072f0 con 0x7f38380d3fe0 2024-09-12T01:37:46.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.099+0000 7f383d277640 1 -- 172.21.15.60:0/3905226849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3838160310 con 0x7f38380d3fe0 2024-09-12T01:37:46.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.100+0000 7f383d277640 1 -- 172.21.15.60:0/3905226849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38380cf760 con 0x7f38380d3fe0 2024-09-12T01:37:46.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.100+0000 7f382f7fe640 1 -- 172.21.15.60:0/3905226849 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f382001a070 con 0x7f38380d3fe0 2024-09-12T01:37:46.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.100+0000 7f382f7fe640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f381806be60 0x7f381806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.101+0000 7f382f7fe640 1 -- 172.21.15.60:0/3905226849 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f382008a280 con 0x7f38380d3fe0 2024-09-12T01:37:46.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.101+0000 7f3836ffd640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f381806be60 0x7f381806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.101+0000 7f3836ffd640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f381806be60 0x7f381806e320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3828034000 tx=0x7f382802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:46.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.105+0000 7f382f7fe640 1 -- 172.21.15.60:0/3905226849 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3820058550 con 0x7f38380d3fe0 2024-09-12T01:37:46.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.280+0000 7f383d277640 1 -- 172.21.15.60:0/3905226849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38380b44d0 con 0x7f38380d3fe0 2024-09-12T01:37:46.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.281+0000 7f382f7fe640 1 -- 172.21.15.60:0/3905226849 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16646 (secure 0 0 0) 0x7f382005c850 con 0x7f38380d3fe0 2024-09-12T01:37:46.281 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:46.281 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":45,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:37:45.314401+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:37:43.276989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T01:37:44.298899+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:37:46.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.283+0000 7f383d277640 1 -- 172.21.15.60:0/3905226849 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f381806be60 msgr2=0x7f381806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.283+0000 7f383d277640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f381806be60 0x7f381806e320 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3828034000 tx=0x7f382802e000 comp rx=0 tx=0).stop 2024-09-12T01:37:46.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.283+0000 7f383d277640 1 -- 172.21.15.60:0/3905226849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38380d3fe0 msgr2=0x7f38381619d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.283+0000 7f383d277640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38380d3fe0 0x7f38381619d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f382000c400 tx=0x7f382000c8c0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.283+0000 7f383d277640 1 -- 172.21.15.60:0/3905226849 shutdown_connections 2024-09-12T01:37:46.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.283+0000 7f383d277640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f381806be60 0x7f381806e320 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.283+0000 7f383d277640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f383815e7a0 0x7f3838150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.283+0000 7f383d277640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38380d3fe0 0x7f38381619d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.283+0000 7f383d277640 1 --2- 172.21.15.60:0/3905226849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f38380cf2f0 0x7f38381610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.283+0000 7f383d277640 1 -- 172.21.15.60:0/3905226849 >> 172.21.15.60:0/3905226849 conn(0x7f38380d1550 msgr2=0x7f38380cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:46.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.283+0000 7f383d277640 1 -- 172.21.15.60:0/3905226849 shutdown_connections 2024-09-12T01:37:46.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.283+0000 7f383d277640 1 -- 172.21.15.60:0/3905226849 wait complete. 2024-09-12T01:37:46.294 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:37:46.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.397+0000 7f823691a640 1 Processor -- start 2024-09-12T01:37:46.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.397+0000 7f823691a640 1 -- start start 2024-09-12T01:37:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.398+0000 7f823691a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8230148420 0x7f823006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.398+0000 7f823691a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823006c560 con 0x7f823006c150 2024-09-12T01:37:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.398+0000 7f823691a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823006e5c0 con 0x7f8230148040 2024-09-12T01:37:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.398+0000 7f823691a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f823006e8a0 con 0x7f8230148420 2024-09-12T01:37:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.398+0000 7f8234eb7640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f823006c150 0x7f823006d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42282/0 (socket says 172.21.15.60:42282) 2024-09-12T01:37:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.398+0000 7f8234eb7640 1 -- 172.21.15.60:0/646166358 learned_addr learned my addr 172.21.15.60:0/646166358 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.398+0000 7f822f7fe640 1 --2- 172.21.15.60:0/646166358 >> v2:172.21.15.105:3300/0 conn(0x7f8230148420 0x7f823006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.398+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3952755401 0 0) 0x7f8228001490 con 0x7f823006c150 2024-09-12T01:37:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.398+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8218003520 con 0x7f823006c150 2024-09-12T01:37:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.398+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1994630752 0 0) 0x7f8218003520 con 0x7f823006c150 2024-09-12T01:37:46.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.398+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 >> v2:172.21.15.105:3300/0 conn(0x7f8230148420 msgr2=0x7f823006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822effd640 1 --2- 172.21.15.60:0/646166358 >> v2:172.21.15.105:3300/0 conn(0x7f8230148420 0x7f823006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 >> v1:172.21.15.105:6789/0 conn(0x7f8230148040 legacy=0x7f82300713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82300ae930 con 0x7f823006c150 2024-09-12T01:37:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f8228001bc0 con 0x7f823006c150 2024-09-12T01:37:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822f7fe640 1 --2- 172.21.15.60:0/646166358 >> v2:172.21.15.105:3300/0 conn(0x7f8230148420 0x7f823006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:37:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 >> v1:172.21.15.60:6789/0 conn(0x7f823006c150 legacy=0x7f823006d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822effd640 1 --2- 172.21.15.60:0/646166358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82180039b0 0x7f8218003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822effd640 1 --2- 172.21.15.60:0/646166358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8218004800 0x7f8218004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822effd640 1 --2- 172.21.15.60:0/646166358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82180051c0 0x7f821800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f823006e8a0 con 0x7f8218004800 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f821800c060 con 0x7f82180051c0 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f821800c260 con 0x7f82180039b0 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822f7fe640 1 --2- 172.21.15.60:0/646166358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8218004800 0x7f8218004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822ffff640 1 --2- 172.21.15.60:0/646166358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82180039b0 0x7f8218003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f8234eb7640 1 --2- 172.21.15.60:0/646166358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82180051c0 0x7f821800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822f7fe640 1 -- 172.21.15.60:0/646166358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82180039b0 msgr2=0x7f8218003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822f7fe640 1 --2- 172.21.15.60:0/646166358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82180039b0 0x7f8218003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822f7fe640 1 -- 172.21.15.60:0/646166358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82180051c0 msgr2=0x7f821800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822f7fe640 1 --2- 172.21.15.60:0/646166358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82180051c0 0x7f821800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822f7fe640 1 -- 172.21.15.60:0/646166358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8218003520 con 0x7f8218004800 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f8234eb7640 1 -- 172.21.15.60:0/646166358 reap_dead start 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.399+0000 7f822ffff640 1 --2- 172.21.15.60:0/646166358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82180039b0 0x7f8218003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.400+0000 7f822f7fe640 1 --2- 172.21.15.60:0/646166358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8218004800 0x7f8218004c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8224009c60 tx=0x7f8218005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b983f513a690df44 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:46.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.400+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224036070 con 0x7f8218004800 2024-09-12T01:37:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.400+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8224031400 con 0x7f8218004800 2024-09-12T01:37:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.400+0000 7f822effd640 1 -- 172.21.15.60:0/646166358 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224009860 con 0x7f8218004800 2024-09-12T01:37:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.400+0000 7f823691a640 1 -- 172.21.15.60:0/646166358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8218004800 msgr2=0x7f8218004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.400+0000 7f823691a640 1 --2- 172.21.15.60:0/646166358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8218004800 0x7f8218004c80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8224009c60 tx=0x7f8218005830 comp rx=0 tx=0).stop 2024-09-12T01:37:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.400+0000 7f823691a640 1 -- 172.21.15.60:0/646166358 shutdown_connections 2024-09-12T01:37:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.400+0000 7f823691a640 1 --2- 172.21.15.60:0/646166358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8218004800 0x7f8218004c80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.400+0000 7f823691a640 1 -- 172.21.15.60:0/646166358 >> 172.21.15.60:0/646166358 conn(0x7f82300b2430 msgr2=0x7f82300b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.401+0000 7f823691a640 1 -- 172.21.15.60:0/646166358 shutdown_connections 2024-09-12T01:37:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.401+0000 7f823691a640 1 -- 172.21.15.60:0/646166358 wait complete. 2024-09-12T01:37:46.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.402+0000 7f823691a640 1 Processor -- start 2024-09-12T01:37:46.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.402+0000 7f823691a640 1 -- start start 2024-09-12T01:37:46.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f823691a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8218004800 0x7f823015f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f823691a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8230160c10 0x7f8230161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f823691a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f823014e5f0 0x7f823014ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f823691a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f823006bc10 con 0x7f8230160c10 2024-09-12T01:37:46.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f823691a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82300aeef0 con 0x7f8218004800 2024-09-12T01:37:46.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f823691a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f823006bd90 con 0x7f823014e5f0 2024-09-12T01:37:46.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f822f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8230160c10 0x7f8230161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f822f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8230160c10 0x7f8230161070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51896/0 (socket says 172.21.15.60:51896) 2024-09-12T01:37:46.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f822f7fe640 1 -- 172.21.15.60:0/1710484787 learned_addr learned my addr 172.21.15.60:0/1710484787 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:46.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f822f7fe640 1 -- 172.21.15.60:0/1710484787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f823014e5f0 msgr2=0x7f823014ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f822f7fe640 1 --2- 172.21.15.60:0/1710484787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f823014e5f0 0x7f823014ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f822f7fe640 1 -- 172.21.15.60:0/1710484787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8218004800 msgr2=0x7f823015f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f822f7fe640 1 --2- 172.21.15.60:0/1710484787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8218004800 0x7f823015f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f822f7fe640 1 -- 172.21.15.60:0/1710484787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823014efb0 con 0x7f8230160c10 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f822f7fe640 1 --2- 172.21.15.60:0/1710484787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8230160c10 0x7f8230161070 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8224009d80 tx=0x7f8224004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f822cff9640 1 -- 172.21.15.60:0/1710484787 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224040020 con 0x7f8230160c10 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f822cff9640 1 -- 172.21.15.60:0/1710484787 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f822403b680 con 0x7f8230160c10 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f823691a640 1 -- 172.21.15.60:0/1710484787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823014d550 con 0x7f8230160c10 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.403+0000 7f822cff9640 1 -- 172.21.15.60:0/1710484787 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224036040 con 0x7f8230160c10 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.404+0000 7f823691a640 1 -- 172.21.15.60:0/1710484787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823014db10 con 0x7f8230160c10 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.405+0000 7f823691a640 1 -- 172.21.15.60:0/1710484787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82300713c0 con 0x7f8230160c10 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.405+0000 7f822cff9640 1 -- 172.21.15.60:0/1710484787 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8224043020 con 0x7f8230160c10 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.406+0000 7f822cff9640 1 --2- 172.21.15.60:0/1710484787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f821c06be60 0x7f821c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.406+0000 7f822cff9640 1 -- 172.21.15.60:0/1710484787 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f82240ab5b0 con 0x7f8230160c10 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.406+0000 7f822ffff640 1 --2- 172.21.15.60:0/1710484787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f821c06be60 0x7f821c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.406+0000 7f822ffff640 1 --2- 172.21.15.60:0/1710484787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f821c06be60 0x7f821c06e320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8230051220 tx=0x7f8220009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.410+0000 7f822cff9640 1 -- 172.21.15.60:0/1710484787 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f822404a030 con 0x7f8230160c10 2024-09-12T01:37:46.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.587+0000 7f823691a640 1 -- 172.21.15.60:0/1710484787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f82300729c0 con 0x7f8230160c10 2024-09-12T01:37:46.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.588+0000 7f822cff9640 1 -- 172.21.15.60:0/1710484787 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16646 (secure 0 0 0) 0x7f8224079e30 con 0x7f8230160c10 2024-09-12T01:37:46.587 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:46.588 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":45,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:37:45.314401+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:37:43.276989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T01:37:44.298899+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:37:46.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.590+0000 7f823691a640 1 -- 172.21.15.60:0/1710484787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f821c06be60 msgr2=0x7f821c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.590+0000 7f823691a640 1 --2- 172.21.15.60:0/1710484787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f821c06be60 0x7f821c06e320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8230051220 tx=0x7f8220009040 comp rx=0 tx=0).stop 2024-09-12T01:37:46.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.590+0000 7f823691a640 1 -- 172.21.15.60:0/1710484787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8230160c10 msgr2=0x7f8230161070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.590+0000 7f823691a640 1 --2- 172.21.15.60:0/1710484787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8230160c10 0x7f8230161070 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8224009d80 tx=0x7f8224004730 comp rx=0 tx=0).stop 2024-09-12T01:37:46.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.590+0000 7f823691a640 1 -- 172.21.15.60:0/1710484787 shutdown_connections 2024-09-12T01:37:46.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.591+0000 7f823691a640 1 --2- 172.21.15.60:0/1710484787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f821c06be60 0x7f821c06e320 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.591+0000 7f823691a640 1 --2- 172.21.15.60:0/1710484787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f823014e5f0 0x7f823014ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.591+0000 7f823691a640 1 --2- 172.21.15.60:0/1710484787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8230160c10 0x7f8230161070 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.591+0000 7f823691a640 1 --2- 172.21.15.60:0/1710484787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8218004800 0x7f823015f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.591+0000 7f823691a640 1 -- 172.21.15.60:0/1710484787 >> 172.21.15.60:0/1710484787 conn(0x7f82300b2430 msgr2=0x7f82300d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:46.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.591+0000 7f823691a640 1 -- 172.21.15.60:0/1710484787 shutdown_connections 2024-09-12T01:37:46.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.591+0000 7f823691a640 1 -- 172.21.15.60:0/1710484787 wait complete. 2024-09-12T01:37:46.601 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:37:46.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.708+0000 7fb8a6a65640 1 Processor -- start 2024-09-12T01:37:46.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.708+0000 7fb8a6a65640 1 -- start start 2024-09-12T01:37:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.709+0000 7fb8a6a65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8a0158a00 0x7fb8a0071f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.709+0000 7fb8a6a65640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a00728f0 con 0x7fb8a0072470 2024-09-12T01:37:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.709+0000 7fb8a6a65640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8a0072bd0 con 0x7fb8a0158de0 2024-09-12T01:37:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.709+0000 7fb8a6a65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a0072eb0 con 0x7fb8a0158a00 2024-09-12T01:37:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.709+0000 7fb89ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb8a0072470 0x7fb8a00b4e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42284/0 (socket says 172.21.15.60:42284) 2024-09-12T01:37:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.709+0000 7fb89ffff640 1 -- 172.21.15.60:0/4014992553 learned_addr learned my addr 172.21.15.60:0/4014992553 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.709+0000 7fb8a4801640 1 --2- 172.21.15.60:0/4014992553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8a0158a00 0x7fb8a0071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.709+0000 7fb89f7fe640 1 -- 172.21.15.60:0/4014992553 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 827152861 0 0) 0x7fb8a00728f0 con 0x7fb8a0072470 2024-09-12T01:37:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.709+0000 7fb89f7fe640 1 -- 172.21.15.60:0/4014992553 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb890003520 con 0x7fb8a0072470 2024-09-12T01:37:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.710+0000 7fb89f7fe640 1 -- 172.21.15.60:0/4014992553 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049923283 0 0) 0x7fb8a0072bd0 con 0x7fb8a0158de0 2024-09-12T01:37:46.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.710+0000 7fb8a4801640 1 -- 172.21.15.60:0/4014992553 >> v1:172.21.15.105:6789/0 conn(0x7fb8a0158de0 legacy=0x7fb8a006eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.710+0000 7fb8a4801640 1 -- 172.21.15.60:0/4014992553 >> v1:172.21.15.60:6789/0 conn(0x7fb8a0072470 legacy=0x7fb8a00b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.710+0000 7fb8a4801640 1 -- 172.21.15.60:0/4014992553 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a0073190 con 0x7fb8a0158a00 2024-09-12T01:37:46.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.710+0000 7fb8a4801640 1 --2- 172.21.15.60:0/4014992553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8a0158a00 0x7fb8a0071f30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8940097d0 tx=0x7fb89402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b604181d3588d8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:46.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.711+0000 7fb89f7fe640 1 -- 172.21.15.60:0/4014992553 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894037070 con 0x7fb8a0158a00 2024-09-12T01:37:46.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.711+0000 7fb89f7fe640 1 -- 172.21.15.60:0/4014992553 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb894032440 con 0x7fb8a0158a00 2024-09-12T01:37:46.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.711+0000 7fb89f7fe640 1 -- 172.21.15.60:0/4014992553 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8940327f0 con 0x7fb8a0158a00 2024-09-12T01:37:46.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.711+0000 7fb8a6a65640 1 -- 172.21.15.60:0/4014992553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8a0158a00 msgr2=0x7fb8a0071f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.711+0000 7fb8a6a65640 1 --2- 172.21.15.60:0/4014992553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8a0158a00 0x7fb8a0071f30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb8940097d0 tx=0x7fb89402a210 comp rx=0 tx=0).stop 2024-09-12T01:37:46.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.711+0000 7fb8a6a65640 1 -- 172.21.15.60:0/4014992553 shutdown_connections 2024-09-12T01:37:46.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.711+0000 7fb8a6a65640 1 --2- 172.21.15.60:0/4014992553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8a0158a00 0x7fb8a0071f30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.711+0000 7fb8a6a65640 1 -- 172.21.15.60:0/4014992553 >> 172.21.15.60:0/4014992553 conn(0x7fb8a006cb50 msgr2=0x7fb8a006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:46.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.711+0000 7fb8a6a65640 1 -- 172.21.15.60:0/4014992553 shutdown_connections 2024-09-12T01:37:46.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.711+0000 7fb8a6a65640 1 -- 172.21.15.60:0/4014992553 wait complete. 2024-09-12T01:37:46.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.713+0000 7fb8a6a65640 1 Processor -- start 2024-09-12T01:37:46.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.713+0000 7fb8a6a65640 1 -- start start 2024-09-12T01:37:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.713+0000 7fb8a6a65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8a0072470 0x7fb8a01f3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.713+0000 7fb8a6a65640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8a0158a00 0x7fb8a0156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a6a65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8a0158de0 0x7fb8a00ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a6a65640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a00b5ca0 con 0x7fb8a0072470 2024-09-12T01:37:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a6a65640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a00b5b20 con 0x7fb8a0158a00 2024-09-12T01:37:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a6a65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a00b5570 con 0x7fb8a0158de0 2024-09-12T01:37:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a4801640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8a0072470 0x7fb8a01f3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a4801640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8a0072470 0x7fb8a01f3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51904/0 (socket says 172.21.15.60:51904) 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a4801640 1 -- 172.21.15.60:0/1139323549 learned_addr learned my addr 172.21.15.60:0/1139323549 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a5002640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8a0158de0 0x7fb8a00ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb89ffff640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8a0158a00 0x7fb8a0156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a4801640 1 -- 172.21.15.60:0/1139323549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8a0158de0 msgr2=0x7fb8a00ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a4801640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8a0158de0 0x7fb8a00ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a4801640 1 -- 172.21.15.60:0/1139323549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8a0158a00 msgr2=0x7fb8a0156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a4801640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8a0158a00 0x7fb8a0156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a4801640 1 -- 172.21.15.60:0/1139323549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a0157510 con 0x7fb8a0072470 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a5002640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8a0158de0 0x7fb8a00ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a4801640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8a0072470 0x7fb8a01f3530 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb894000c00 tx=0x7fb8940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb89d7fa640 1 -- 172.21.15.60:0/1139323549 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894037040 con 0x7fb8a0072470 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb89d7fa640 1 -- 172.21.15.60:0/1139323549 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb894042070 con 0x7fb8a0072470 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a6a65640 1 -- 172.21.15.60:0/1139323549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a01577f0 con 0x7fb8a0072470 2024-09-12T01:37:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb89d7fa640 1 -- 172.21.15.60:0/1139323549 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb894030900 con 0x7fb8a0072470 2024-09-12T01:37:46.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.714+0000 7fb8a6a65640 1 -- 172.21.15.60:0/1139323549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a0157db0 con 0x7fb8a0072470 2024-09-12T01:37:46.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.715+0000 7fb8a6a65640 1 -- 172.21.15.60:0/1139323549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a0157ff0 con 0x7fb8a0072470 2024-09-12T01:37:46.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.716+0000 7fb89d7fa640 1 -- 172.21.15.60:0/1139323549 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb894030aa0 con 0x7fb8a0072470 2024-09-12T01:37:46.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.716+0000 7fb89d7fa640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb88406be30 0x7fb88406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:46.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.716+0000 7fb89d7fa640 1 -- 172.21.15.60:0/1139323549 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb8940ab890 con 0x7fb8a0072470 2024-09-12T01:37:46.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.717+0000 7fb89ffff640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb88406be30 0x7fb88406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:46.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.717+0000 7fb89ffff640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb88406be30 0x7fb88406e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0154790 tx=0x7fb88c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:46.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.721+0000 7fb89d7fa640 1 -- 172.21.15.60:0/1139323549 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb8a0157ff0 con 0x7fb8a0072470 2024-09-12T01:37:46.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:46.931+0000 7fb8a6a65640 1 -- 172.21.15.60:0/1139323549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb8a00b1750 con 0x7fb8a0072470 2024-09-12T01:37:46.937 INFO:tasks.ceph.mds.d.smithi105.stderr:2024-09-12T01:37:46.937+0000 7ff5bb26f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:37:47.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.755+0000 7fb89d7fa640 1 -- 172.21.15.60:0/1139323549 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) ==== 118+0+0 (secure 0 0 0) 0x7fb894045360 con 0x7fb8a0072470 2024-09-12T01:37:47.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.759+0000 7fb8a6a65640 1 -- 172.21.15.60:0/1139323549 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb88406be30 msgr2=0x7fb88406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:47.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.759+0000 7fb8a6a65640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb88406be30 0x7fb88406e2f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0154790 tx=0x7fb88c009040 comp rx=0 tx=0).stop 2024-09-12T01:37:47.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.759+0000 7fb8a6a65640 1 -- 172.21.15.60:0/1139323549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8a0072470 msgr2=0x7fb8a01f3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:47.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.759+0000 7fb8a6a65640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8a0072470 0x7fb8a01f3530 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb894000c00 tx=0x7fb8940046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:47.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.759+0000 7fb8a6a65640 1 -- 172.21.15.60:0/1139323549 shutdown_connections 2024-09-12T01:37:47.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.759+0000 7fb8a6a65640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb88406be30 0x7fb88406e2f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:47.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.759+0000 7fb8a6a65640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8a0158de0 0x7fb8a00ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:47.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.759+0000 7fb8a6a65640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb8a0158a00 0x7fb8a0156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:47.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.759+0000 7fb8a6a65640 1 --2- 172.21.15.60:0/1139323549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8a0072470 0x7fb8a01f3530 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:47.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.759+0000 7fb8a6a65640 1 -- 172.21.15.60:0/1139323549 >> 172.21.15.60:0/1139323549 conn(0x7fb8a006cb50 msgr2=0x7fb8a00aeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:47.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.759+0000 7fb8a6a65640 1 -- 172.21.15.60:0/1139323549 shutdown_connections 2024-09-12T01:37:47.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.759+0000 7fb8a6a65640 1 -- 172.21.15.60:0/1139323549 wait complete. 2024-09-12T01:37:47.772 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:37:47.773 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:37:47.878 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:37:47.881 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:37:47.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.886+0000 7f86753c4640 1 Processor -- start 2024-09-12T01:37:47.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.886+0000 7f86753c4640 1 -- start start 2024-09-12T01:37:47.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.887+0000 7f86753c4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8670147fe0 0x7f86700d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:47.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.887+0000 7f86753c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86700b36a0 0x7f86700b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:47.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.887+0000 7f86753c4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86700b66a0 con 0x7f86700732a0 2024-09-12T01:37:47.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.887+0000 7f86753c4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f86700b4010 con 0x7f8670147fe0 2024-09-12T01:37:47.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.887+0000 7f86753c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86701483c0 con 0x7f86700b36a0 2024-09-12T01:37:47.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.888+0000 7f866f7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f86700732a0 0x7f86700736f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42296/0 (socket says 172.21.15.60:42296) 2024-09-12T01:37:47.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.888+0000 7f866f7fe640 1 -- 172.21.15.60:0/153076936 learned_addr learned my addr 172.21.15.60:0/153076936 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:47.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.888+0000 7f866e7fc640 1 --2- 172.21.15.60:0/153076936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86700b36a0 0x7f86700b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:47.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.888+0000 7f866effd640 1 --2- 172.21.15.60:0/153076936 >> v2:172.21.15.105:3300/0 conn(0x7f8670147fe0 0x7f86700d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:47.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.888+0000 7f866dffb640 1 -- 172.21.15.60:0/153076936 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080021562 0 0) 0x7f86700b66a0 con 0x7f86700732a0 2024-09-12T01:37:47.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.888+0000 7f866dffb640 1 -- 172.21.15.60:0/153076936 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f865c003520 con 0x7f86700732a0 2024-09-12T01:37:47.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.888+0000 7f866e7fc640 1 -- 172.21.15.60:0/153076936 >> v2:172.21.15.105:3300/0 conn(0x7f8670147fe0 msgr2=0x7f86700d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:47.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.888+0000 7f866e7fc640 1 --2- 172.21.15.60:0/153076936 >> v2:172.21.15.105:3300/0 conn(0x7f8670147fe0 0x7f86700d1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:47.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.888+0000 7f866e7fc640 1 -- 172.21.15.60:0/153076936 >> v1:172.21.15.60:6789/0 conn(0x7f86700732a0 legacy=0x7f86700736f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:47.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.888+0000 7f866e7fc640 1 -- 172.21.15.60:0/153076936 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86700b45f0 con 0x7f86700b36a0 2024-09-12T01:37:47.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.889+0000 7f866e7fc640 1 --2- 172.21.15.60:0/153076936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86700b36a0 0x7f86700b3ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86580097a0 tx=0x7f865802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=679f1d66e00ba5a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:47.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.889+0000 7f866dffb640 1 -- 172.21.15.60:0/153076936 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658037070 con 0x7f86700b36a0 2024-09-12T01:37:47.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.889+0000 7f866dffb640 1 -- 172.21.15.60:0/153076936 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8658032440 con 0x7f86700b36a0 2024-09-12T01:37:47.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.889+0000 7f866dffb640 1 -- 172.21.15.60:0/153076936 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658032810 con 0x7f86700b36a0 2024-09-12T01:37:47.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.890+0000 7f86753c4640 1 -- 172.21.15.60:0/153076936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86700b36a0 msgr2=0x7f86700b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:47.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.890+0000 7f86753c4640 1 --2- 172.21.15.60:0/153076936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86700b36a0 0x7f86700b3ad0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86580097a0 tx=0x7f865802a180 comp rx=0 tx=0).stop 2024-09-12T01:37:47.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.890+0000 7f86753c4640 1 -- 172.21.15.60:0/153076936 shutdown_connections 2024-09-12T01:37:47.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.890+0000 7f86753c4640 1 --2- 172.21.15.60:0/153076936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86700b36a0 0x7f86700b3ad0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.890+0000 7f86753c4640 1 --2- 172.21.15.60:0/153076936 >> v2:172.21.15.105:3300/0 conn(0x7f8670147fe0 0x7f86700d1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.890+0000 7f86753c4640 1 -- 172.21.15.60:0/153076936 >> 172.21.15.60:0/153076936 conn(0x7f86700b6b50 msgr2=0x7f86700b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.890+0000 7f86753c4640 1 -- 172.21.15.60:0/153076936 shutdown_connections 2024-09-12T01:37:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.890+0000 7f86753c4640 1 -- 172.21.15.60:0/153076936 wait complete. 2024-09-12T01:37:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.891+0000 7f86753c4640 1 Processor -- start 2024-09-12T01:37:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.891+0000 7f86753c4640 1 -- start start 2024-09-12T01:37:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.892+0000 7f86753c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86700732a0 0x7f8670143060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.892+0000 7f86753c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86700b36a0 0x7f867015e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.892+0000 7f86753c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8670147fe0 0x7f8670145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.892+0000 7f86753c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f86700b4e90 con 0x7f86700b36a0 2024-09-12T01:37:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.892+0000 7f86753c4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86700b4bb0 con 0x7f8670147fe0 2024-09-12T01:37:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.892+0000 7f86753c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86700b5170 con 0x7f86700732a0 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.892+0000 7f866e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86700b36a0 0x7f867015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.892+0000 7f866e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86700b36a0 0x7f867015e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51912/0 (socket says 172.21.15.60:51912) 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.892+0000 7f866e7fc640 1 -- 172.21.15.60:0/505195393 learned_addr learned my addr 172.21.15.60:0/505195393 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.892+0000 7f866effd640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86700732a0 0x7f8670143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.892+0000 7f866f7fe640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8670147fe0 0x7f8670145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.892+0000 7f866e7fc640 1 -- 172.21.15.60:0/505195393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86700732a0 msgr2=0x7f8670143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.893+0000 7f866e7fc640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86700732a0 0x7f8670143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.893+0000 7f866e7fc640 1 -- 172.21.15.60:0/505195393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8670147fe0 msgr2=0x7f8670145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.893+0000 7f866e7fc640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8670147fe0 0x7f8670145190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.893+0000 7f866e7fc640 1 -- 172.21.15.60:0/505195393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8670145ff0 con 0x7f86700b36a0 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.893+0000 7f866e7fc640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86700b36a0 0x7f867015e010 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f865802a1c0 tx=0x7f86580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.893+0000 7f86677fe640 1 -- 172.21.15.60:0/505195393 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658037040 con 0x7f86700b36a0 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.893+0000 7f86677fe640 1 -- 172.21.15.60:0/505195393 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8658042070 con 0x7f86700b36a0 2024-09-12T01:37:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.893+0000 7f86677fe640 1 -- 172.21.15.60:0/505195393 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865803b930 con 0x7f86700b36a0 2024-09-12T01:37:47.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.893+0000 7f86753c4640 1 -- 172.21.15.60:0/505195393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f867013c240 con 0x7f86700b36a0 2024-09-12T01:37:47.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.893+0000 7f86753c4640 1 -- 172.21.15.60:0/505195393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f867015f3f0 con 0x7f86700b36a0 2024-09-12T01:37:47.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.894+0000 7f86753c4640 1 -- 172.21.15.60:0/505195393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86700ae890 con 0x7f86700b36a0 2024-09-12T01:37:47.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.895+0000 7f86677fe640 1 -- 172.21.15.60:0/505195393 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f865803bad0 con 0x7f86700b36a0 2024-09-12T01:37:47.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.895+0000 7f86677fe640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f865006be30 0x7f865006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:47.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.895+0000 7f86677fe640 1 -- 172.21.15.60:0/505195393 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f86580ab550 con 0x7f86700b36a0 2024-09-12T01:37:47.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.895+0000 7f866effd640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f865006be30 0x7f865006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:47.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.896+0000 7f866effd640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f865006be30 0x7f865006e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8660009aa0 tx=0x7f8660009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:47.900+0000 7f86677fe640 1 -- 172.21.15.60:0/505195393 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8658079940 con 0x7f86700b36a0 2024-09-12T01:37:48.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.115+0000 7f86753c4640 1 -- 172.21.15.60:0/505195393 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f86700b20c0 con 0x7f86700b36a0 2024-09-12T01:37:48.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.970+0000 7f86677fe640 1 -- 172.21.15.60:0/505195393 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7f865807dc40 con 0x7f86700b36a0 2024-09-12T01:37:48.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.974+0000 7f86753c4640 1 -- 172.21.15.60:0/505195393 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f865006be30 msgr2=0x7f865006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:48.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.974+0000 7f86753c4640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f865006be30 0x7f865006e2f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8660009aa0 tx=0x7f8660009190 comp rx=0 tx=0).stop 2024-09-12T01:37:48.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.974+0000 7f86753c4640 1 -- 172.21.15.60:0/505195393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86700b36a0 msgr2=0x7f867015e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:48.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.974+0000 7f86753c4640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86700b36a0 0x7f867015e010 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f865802a1c0 tx=0x7f86580046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:48.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.974+0000 7f86753c4640 1 -- 172.21.15.60:0/505195393 shutdown_connections 2024-09-12T01:37:48.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.974+0000 7f86753c4640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8670147fe0 0x7f8670145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:48.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.974+0000 7f86753c4640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86700b36a0 0x7f867015e010 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:48.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.974+0000 7f86753c4640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f865006be30 0x7f865006e2f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:48.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.974+0000 7f86753c4640 1 --2- 172.21.15.60:0/505195393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f86700732a0 0x7f8670143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:48.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.974+0000 7f86753c4640 1 -- 172.21.15.60:0/505195393 >> 172.21.15.60:0/505195393 conn(0x7f86700b6b50 msgr2=0x7f86700d06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:48.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.974+0000 7f86753c4640 1 -- 172.21.15.60:0/505195393 shutdown_connections 2024-09-12T01:37:48.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:48.974+0000 7f86753c4640 1 -- 172.21.15.60:0/505195393 wait complete. 2024-09-12T01:37:48.987 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:37:48.987 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:37:49.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.097+0000 7f061f166640 1 Processor -- start 2024-09-12T01:37:49.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.097+0000 7f061f166640 1 -- start start 2024-09-12T01:37:49.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f061f166640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f06180735b0 0x7f06180cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f061f166640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f061806faf0 con 0x7f061815e950 2024-09-12T01:37:49.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f061f166640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f061806fdd0 con 0x7f061806d540 2024-09-12T01:37:49.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f061f166640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f06180700b0 con 0x7f06180735b0 2024-09-12T01:37:49.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f061cf02640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f061815e950 0x7f061806ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42308/0 (socket says 172.21.15.60:42308) 2024-09-12T01:37:49.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f061cf02640 1 -- 172.21.15.60:0/2490910180 learned_addr learned my addr 172.21.15.60:0/2490910180 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:49.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1785158998 0 0) 0x7f061806faf0 con 0x7f061815e950 2024-09-12T01:37:49.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0600003520 con 0x7f061815e950 2024-09-12T01:37:49.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f061d703640 1 --2- 172.21.15.60:0/2490910180 >> v2:172.21.15.105:3300/0 conn(0x7f06180735b0 0x7f06180cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1529952256 0 0) 0x7f0600003520 con 0x7f061815e950 2024-09-12T01:37:49.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 >> v2:172.21.15.105:3300/0 conn(0x7f06180735b0 msgr2=0x7f06180cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:49.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f060f7fe640 1 --2- 172.21.15.60:0/2490910180 >> v2:172.21.15.105:3300/0 conn(0x7f06180735b0 0x7f06180cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 >> v1:172.21.15.105:6789/0 conn(0x7f061806d540 legacy=0x7f06180cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0618070390 con 0x7f061815e950 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f0614001670 con 0x7f061815e950 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.098+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 >> v1:172.21.15.60:6789/0 conn(0x7f061815e950 legacy=0x7f061806ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f060f7fe640 1 --2- 172.21.15.60:0/2490910180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06000039b0 0x7f0600003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f060f7fe640 1 --2- 172.21.15.60:0/2490910180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0600004800 0x7f0600004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f060f7fe640 1 --2- 172.21.15.60:0/2490910180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06000051c0 0x7f060000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f06180700b0 con 0x7f0600004800 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f060000c060 con 0x7f06000051c0 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f060000c260 con 0x7f06000039b0 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f060ffff640 1 --2- 172.21.15.60:0/2490910180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0600004800 0x7f0600004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f061d703640 1 --2- 172.21.15.60:0/2490910180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06000051c0 0x7f060000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f061cf02640 1 --2- 172.21.15.60:0/2490910180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06000039b0 0x7f0600003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f060ffff640 1 -- 172.21.15.60:0/2490910180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06000039b0 msgr2=0x7f0600003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:49.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f060ffff640 1 --2- 172.21.15.60:0/2490910180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06000039b0 0x7f0600003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f060ffff640 1 -- 172.21.15.60:0/2490910180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06000051c0 msgr2=0x7f060000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:49.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f060ffff640 1 --2- 172.21.15.60:0/2490910180 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06000051c0 0x7f060000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f060ffff640 1 -- 172.21.15.60:0/2490910180 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0600003520 con 0x7f0600004800 2024-09-12T01:37:49.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f061d703640 1 -- 172.21.15.60:0/2490910180 reap_dead start 2024-09-12T01:37:49.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.099+0000 7f061cf02640 1 --2- 172.21.15.60:0/2490910180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06000039b0 0x7f0600003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:49.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.100+0000 7f060ffff640 1 --2- 172.21.15.60:0/2490910180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0600004800 0x7f0600004c80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0608001750 tx=0x7f0600005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc9e8a9e46f0dfb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:49.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.100+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608001370 con 0x7f0600004800 2024-09-12T01:37:49.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.100+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06080052d0 con 0x7f0600004800 2024-09-12T01:37:49.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.100+0000 7f060f7fe640 1 -- 172.21.15.60:0/2490910180 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060802abc0 con 0x7f0600004800 2024-09-12T01:37:49.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.100+0000 7f061f166640 1 -- 172.21.15.60:0/2490910180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0600004800 msgr2=0x7f0600004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.100+0000 7f061f166640 1 --2- 172.21.15.60:0/2490910180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0600004800 0x7f0600004c80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0608001750 tx=0x7f0600005830 comp rx=0 tx=0).stop 2024-09-12T01:37:49.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.100+0000 7f061f166640 1 -- 172.21.15.60:0/2490910180 shutdown_connections 2024-09-12T01:37:49.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.100+0000 7f061f166640 1 --2- 172.21.15.60:0/2490910180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0600004800 0x7f0600004c80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.100+0000 7f061f166640 1 -- 172.21.15.60:0/2490910180 >> 172.21.15.60:0/2490910180 conn(0x7f06180d14d0 msgr2=0x7f06180d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:49.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.100+0000 7f061f166640 1 -- 172.21.15.60:0/2490910180 shutdown_connections 2024-09-12T01:37:49.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.101+0000 7f061f166640 1 -- 172.21.15.60:0/2490910180 wait complete. 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.102+0000 7f061f166640 1 Processor -- start 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.102+0000 7f061f166640 1 -- start start 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f061f166640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0600004800 0x7f0618157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f061f166640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06180cb380 0x7f0618158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f061f166640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f061814b010 0x7f0618159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f061f166640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f06180721d0 con 0x7f06180cb380 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f061f166640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0618072050 con 0x7f0600004800 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f061f166640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0618072350 con 0x7f061814b010 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f060ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06180cb380 0x7f0618158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f060ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06180cb380 0x7f0618158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51930/0 (socket says 172.21.15.60:51930) 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f060ffff640 1 -- 172.21.15.60:0/1302615419 learned_addr learned my addr 172.21.15.60:0/1302615419 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f061d703640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f061814b010 0x7f0618159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f061cf02640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0600004800 0x7f0618157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f060ffff640 1 -- 172.21.15.60:0/1302615419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f061814b010 msgr2=0x7f0618159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f060ffff640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f061814b010 0x7f0618159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f060ffff640 1 -- 172.21.15.60:0/1302615419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0600004800 msgr2=0x7f0618157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f060ffff640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0600004800 0x7f0618157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f060ffff640 1 -- 172.21.15.60:0/1302615419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06181593b0 con 0x7f06180cb380 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f060ffff640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06180cb380 0x7f0618158c80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0608000c00 tx=0x7f0608001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f060d7fa640 1 -- 172.21.15.60:0/1302615419 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608040030 con 0x7f06180cb380 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f060d7fa640 1 -- 172.21.15.60:0/1302615419 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060802be50 con 0x7f06180cb380 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.103+0000 7f061f166640 1 -- 172.21.15.60:0/1302615419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0618159690 con 0x7f06180cb380 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.104+0000 7f060d7fa640 1 -- 172.21.15.60:0/1302615419 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0608001370 con 0x7f06180cb380 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.104+0000 7f061f166640 1 -- 172.21.15.60:0/1302615419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0618155200 con 0x7f06180cb380 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.105+0000 7f061f166640 1 -- 172.21.15.60:0/1302615419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f061806ce30 con 0x7f06180cb380 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.105+0000 7f060d7fa640 1 -- 172.21.15.60:0/1302615419 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0608043070 con 0x7f06180cb380 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.106+0000 7f060d7fa640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f060406be60 0x7f060406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.106+0000 7f060d7fa640 1 -- 172.21.15.60:0/1302615419 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f06080aa8a0 con 0x7f06180cb380 2024-09-12T01:37:49.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.106+0000 7f061cf02640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f060406be60 0x7f060406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.106+0000 7f061cf02640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f060406be60 0x7f060406e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f06180b42b0 tx=0x7f0614007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:49.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.110+0000 7f060d7fa640 1 -- 172.21.15.60:0/1302615419 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f060804a070 con 0x7f06180cb380 2024-09-12T01:37:49.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.322+0000 7f061f166640 1 -- 172.21.15.60:0/1302615419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0618158030 con 0x7f06180cb380 2024-09-12T01:37:49.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.323+0000 7f060d7fa640 1 -- 172.21.15.60:0/1302615419 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5235 (secure 0 0 0) 0x7f0608078c00 con 0x7f06180cb380 2024-09-12T01:37:49.322 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:49.323 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"btime":"2024-09-12T01:37:48:964735+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2903062918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2903062918},{"type":"v1","addr":"172.21.15.105:6835","nonce":2903062918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1613307735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1613307735},{"type":"v1","addr":"172.21.15.60:6836","nonce":1613307735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/4169562393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":4169562393},{"type":"v1","addr":"172.21.15.60:6837","nonce":4169562393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:37:45.314718+0000","modified":"2024-09-12T01:37:48.116046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34778":{"gid":34778,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/2704792080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2704792080},{"type":"v1","addr":"172.21.15.105:6834","nonce":2704792080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34778,"qdb_cluster":[34778]},"id":3}]} 2024-09-12T01:37:49.323 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 21 2024-09-12T01:37:49.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.325+0000 7f061f166640 1 -- 172.21.15.60:0/1302615419 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f060406be60 msgr2=0x7f060406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.325+0000 7f061f166640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f060406be60 0x7f060406e320 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f06180b42b0 tx=0x7f0614007040 comp rx=0 tx=0).stop 2024-09-12T01:37:49.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.325+0000 7f061f166640 1 -- 172.21.15.60:0/1302615419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06180cb380 msgr2=0x7f0618158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.325+0000 7f061f166640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06180cb380 0x7f0618158c80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0608000c00 tx=0x7f0608001120 comp rx=0 tx=0).stop 2024-09-12T01:37:49.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.325+0000 7f061f166640 1 -- 172.21.15.60:0/1302615419 shutdown_connections 2024-09-12T01:37:49.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.325+0000 7f061f166640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f060406be60 0x7f060406e320 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.325+0000 7f061f166640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f061814b010 0x7f0618159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.325+0000 7f061f166640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06180cb380 0x7f0618158c80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.325+0000 7f061f166640 1 --2- 172.21.15.60:0/1302615419 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0600004800 0x7f0618157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.325+0000 7f061f166640 1 -- 172.21.15.60:0/1302615419 >> 172.21.15.60:0/1302615419 conn(0x7f06180d14d0 msgr2=0x7f06180b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:49.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.325+0000 7f061f166640 1 -- 172.21.15.60:0/1302615419 shutdown_connections 2024-09-12T01:37:49.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.325+0000 7f061f166640 1 -- 172.21.15.60:0/1302615419 wait complete. 2024-09-12T01:37:49.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:37:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.440+0000 7f536ab2a640 1 Processor -- start 2024-09-12T01:37:49.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.440+0000 7f536ab2a640 1 -- start start 2024-09-12T01:37:49.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.441+0000 7f536ab2a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f53640b64e0 0x7f5364167110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.441+0000 7f536ab2a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53640b49c0 con 0x7f536415c170 2024-09-12T01:37:49.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.441+0000 7f536ab2a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53640b4cf0 con 0x7f536415c550 2024-09-12T01:37:49.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.441+0000 7f536ab2a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f53640b4fd0 con 0x7f53640b64e0 2024-09-12T01:37:49.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.441+0000 7f53690c7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f53640b64e0 0x7f5364167110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.441+0000 7f53690c7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f53640b64e0 0x7f5364167110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51944/0 (socket says 172.21.15.60:51944) 2024-09-12T01:37:49.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.441+0000 7f53688c6640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f536415c170 0x7f53640cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42320/0 (socket says 172.21.15.60:42320) 2024-09-12T01:37:49.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.441+0000 7f53690c7640 1 -- 172.21.15.60:0/1132511508 learned_addr learned my addr 172.21.15.60:0/1132511508 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:49.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.441+0000 7f53690c7640 1 -- 172.21.15.60:0/1132511508 >> v1:172.21.15.105:6789/0 conn(0x7f536415c550 legacy=0x7f53640b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:49.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.441+0000 7f53690c7640 1 -- 172.21.15.60:0/1132511508 >> v1:172.21.15.60:6789/0 conn(0x7f536415c170 legacy=0x7f53640cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.441+0000 7f53690c7640 1 -- 172.21.15.60:0/1132511508 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53640b52b0 con 0x7f53640b64e0 2024-09-12T01:37:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.442+0000 7f53690c7640 1 --2- 172.21.15.60:0/1132511508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53640b64e0 0x7f5364167110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f535c009e80 tx=0x7f535c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4968fd7df2121252 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.442+0000 7f535b7fe640 1 -- 172.21.15.60:0/1132511508 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c036070 con 0x7f53640b64e0 2024-09-12T01:37:49.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.442+0000 7f535b7fe640 1 -- 172.21.15.60:0/1132511508 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f535c031600 con 0x7f53640b64e0 2024-09-12T01:37:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.442+0000 7f535b7fe640 1 -- 172.21.15.60:0/1132511508 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c0319d0 con 0x7f53640b64e0 2024-09-12T01:37:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.443+0000 7f536ab2a640 1 -- 172.21.15.60:0/1132511508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53640b64e0 msgr2=0x7f5364167110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.443+0000 7f536ab2a640 1 --2- 172.21.15.60:0/1132511508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53640b64e0 0x7f5364167110 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f535c009e80 tx=0x7f535c02a710 comp rx=0 tx=0).stop 2024-09-12T01:37:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.443+0000 7f536ab2a640 1 -- 172.21.15.60:0/1132511508 shutdown_connections 2024-09-12T01:37:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.443+0000 7f536ab2a640 1 --2- 172.21.15.60:0/1132511508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53640b64e0 0x7f5364167110 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.443+0000 7f536ab2a640 1 -- 172.21.15.60:0/1132511508 >> 172.21.15.60:0/1132511508 conn(0x7f536406bc10 msgr2=0x7f536406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.443+0000 7f536ab2a640 1 -- 172.21.15.60:0/1132511508 shutdown_connections 2024-09-12T01:37:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.443+0000 7f536ab2a640 1 -- 172.21.15.60:0/1132511508 wait complete. 2024-09-12T01:37:49.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.444+0000 7f536ab2a640 1 Processor -- start 2024-09-12T01:37:49.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.444+0000 7f536ab2a640 1 -- start start 2024-09-12T01:37:49.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f536ab2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53640b64e0 0x7f5364147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f536ab2a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f536415c170 0x7f5364148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f536ab2a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f536415c550 0x7f5364149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f536ab2a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f53640b5b50 con 0x7f53640b64e0 2024-09-12T01:37:49.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f536ab2a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f53640b5870 con 0x7f536415c170 2024-09-12T01:37:49.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f536ab2a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f536415c9c0 con 0x7f536415c550 2024-09-12T01:37:49.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f53688c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53640b64e0 0x7f5364147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f53688c6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53640b64e0 0x7f5364147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51952/0 (socket says 172.21.15.60:51952) 2024-09-12T01:37:49.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f53688c6640 1 -- 172.21.15.60:0/3345442634 learned_addr learned my addr 172.21.15.60:0/3345442634 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f53688c6640 1 -- 172.21.15.60:0/3345442634 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f536415c550 msgr2=0x7f5364149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f53688c6640 1 --2- 172.21.15.60:0/3345442634 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f536415c550 0x7f5364149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f53688c6640 1 -- 172.21.15.60:0/3345442634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f536415c170 msgr2=0x7f5364148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f53688c6640 1 --2- 172.21.15.60:0/3345442634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f536415c170 0x7f5364148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f53688c6640 1 -- 172.21.15.60:0/3345442634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53641f65a0 con 0x7f53640b64e0 2024-09-12T01:37:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f53688c6640 1 --2- 172.21.15.60:0/3345442634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53640b64e0 0x7f5364147670 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f536000c400 tx=0x7f536000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f53597fa640 1 -- 172.21.15.60:0/3345442634 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53600074e0 con 0x7f53640b64e0 2024-09-12T01:37:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f53597fa640 1 -- 172.21.15.60:0/3345442634 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5360007680 con 0x7f53640b64e0 2024-09-12T01:37:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.445+0000 7f536ab2a640 1 -- 172.21.15.60:0/3345442634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53641f6840 con 0x7f53640b64e0 2024-09-12T01:37:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.446+0000 7f53597fa640 1 -- 172.21.15.60:0/3345442634 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360004a00 con 0x7f53640b64e0 2024-09-12T01:37:49.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.446+0000 7f536ab2a640 1 -- 172.21.15.60:0/3345442634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5364148ae0 con 0x7f53640b64e0 2024-09-12T01:37:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.446+0000 7f536ab2a640 1 -- 172.21.15.60:0/3345442634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53640b5dd0 con 0x7f53640b64e0 2024-09-12T01:37:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.447+0000 7f53597fa640 1 -- 172.21.15.60:0/3345442634 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f536001a020 con 0x7f53640b64e0 2024-09-12T01:37:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.447+0000 7f53597fa640 1 --2- 172.21.15.60:0/3345442634 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f535006be30 0x7f535006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.448+0000 7f53597fa640 1 -- 172.21.15.60:0/3345442634 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f536008a6d0 con 0x7f53640b64e0 2024-09-12T01:37:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.448+0000 7f535bfff640 1 --2- 172.21.15.60:0/3345442634 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f535006be30 0x7f535006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.448+0000 7f535bfff640 1 --2- 172.21.15.60:0/3345442634 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f535006be30 0x7f535006e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5354006fd0 tx=0x7f5354006bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:49.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.452+0000 7f53597fa640 1 -- 172.21.15.60:0/3345442634 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5360059070 con 0x7f53640b64e0 2024-09-12T01:37:49.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.630+0000 7f536ab2a640 1 -- 172.21.15.60:0/3345442634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f536406d360 con 0x7f53640b64e0 2024-09-12T01:37:49.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.631+0000 7f53597fa640 1 -- 172.21.15.60:0/3345442634 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16633 (secure 0 0 0) 0x7f5360058970 con 0x7f53640b64e0 2024-09-12T01:37:49.631 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:49.631 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":46,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:37:46.959406+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:37:43.276989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T01:37:44.298899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:37:49.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.634+0000 7f536ab2a640 1 -- 172.21.15.60:0/3345442634 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f535006be30 msgr2=0x7f535006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.634+0000 7f536ab2a640 1 --2- 172.21.15.60:0/3345442634 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f535006be30 0x7f535006e2f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5354006fd0 tx=0x7f5354006bc0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.634+0000 7f536ab2a640 1 -- 172.21.15.60:0/3345442634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53640b64e0 msgr2=0x7f5364147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.634+0000 7f536ab2a640 1 --2- 172.21.15.60:0/3345442634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53640b64e0 0x7f5364147670 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f536000c400 tx=0x7f536000c8c0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.634+0000 7f536ab2a640 1 -- 172.21.15.60:0/3345442634 shutdown_connections 2024-09-12T01:37:49.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.634+0000 7f536ab2a640 1 --2- 172.21.15.60:0/3345442634 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f535006be30 0x7f535006e2f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.634+0000 7f536ab2a640 1 --2- 172.21.15.60:0/3345442634 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f536415c550 0x7f5364149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.634+0000 7f536ab2a640 1 --2- 172.21.15.60:0/3345442634 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f536415c170 0x7f5364148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.634+0000 7f536ab2a640 1 --2- 172.21.15.60:0/3345442634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53640b64e0 0x7f5364147670 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.634+0000 7f536ab2a640 1 -- 172.21.15.60:0/3345442634 >> 172.21.15.60:0/3345442634 conn(0x7f536406bc10 msgr2=0x7f536406d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:49.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.634+0000 7f536ab2a640 1 -- 172.21.15.60:0/3345442634 shutdown_connections 2024-09-12T01:37:49.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.634+0000 7f536ab2a640 1 -- 172.21.15.60:0/3345442634 wait complete. 2024-09-12T01:37:49.644 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:37:49.644 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:37:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.747+0000 7f90cc21e640 1 Processor -- start 2024-09-12T01:37:49.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.747+0000 7f90cc21e640 1 -- start start 2024-09-12T01:37:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.748+0000 7f90cc21e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f90c415c2b0 0x7f90c40b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.748+0000 7f90cc21e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90c415fb10 con 0x7f90c40b72f0 2024-09-12T01:37:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.748+0000 7f90cc21e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90c40b5900 con 0x7f90c415f200 2024-09-12T01:37:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.748+0000 7f90cc21e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f90c415f830 con 0x7f90c415c2b0 2024-09-12T01:37:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.748+0000 7f90c9fba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f90c415c2b0 0x7f90c40b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.747 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.748+0000 7f90c97b9640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f90c40b72f0 0x7f90c415eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42322/0 (socket says 172.21.15.60:42322) 2024-09-12T01:37:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.748+0000 7f90c97b9640 1 -- 172.21.15.60:0/3790948735 learned_addr learned my addr 172.21.15.60:0/3790948735 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:49.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.748+0000 7f90c9fba640 1 -- 172.21.15.60:0/3790948735 >> v1:172.21.15.105:6789/0 conn(0x7f90c415f200 legacy=0x7f90c406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:49.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.748+0000 7f90c9fba640 1 -- 172.21.15.60:0/3790948735 >> v1:172.21.15.60:6789/0 conn(0x7f90c40b72f0 legacy=0x7f90c415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.748+0000 7f90c8fb8640 1 -- 172.21.15.60:0/3790948735 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3638913914 0 0) 0x7f90c415fb10 con 0x7f90c40b72f0 2024-09-12T01:37:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.748+0000 7f90c9fba640 1 -- 172.21.15.60:0/3790948735 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c406ce30 con 0x7f90c415c2b0 2024-09-12T01:37:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.749+0000 7f90c9fba640 1 --2- 172.21.15.60:0/3790948735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90c415c2b0 0x7f90c40b6db0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f90c00097a0 tx=0x7f90c002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc6af380518886d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.749+0000 7f90c8fb8640 1 -- 172.21.15.60:0/3790948735 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0037070 con 0x7f90c415c2b0 2024-09-12T01:37:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.749+0000 7f90c8fb8640 1 -- 172.21.15.60:0/3790948735 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c0032440 con 0x7f90c415c2b0 2024-09-12T01:37:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.749+0000 7f90c8fb8640 1 -- 172.21.15.60:0/3790948735 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0032810 con 0x7f90c415c2b0 2024-09-12T01:37:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.750+0000 7f90cc21e640 1 -- 172.21.15.60:0/3790948735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90c415c2b0 msgr2=0x7f90c40b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.750+0000 7f90cc21e640 1 --2- 172.21.15.60:0/3790948735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90c415c2b0 0x7f90c40b6db0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f90c00097a0 tx=0x7f90c002a1e0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.750+0000 7f90cc21e640 1 -- 172.21.15.60:0/3790948735 shutdown_connections 2024-09-12T01:37:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.750+0000 7f90cc21e640 1 --2- 172.21.15.60:0/3790948735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90c415c2b0 0x7f90c40b6db0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.750+0000 7f90cc21e640 1 -- 172.21.15.60:0/3790948735 >> 172.21.15.60:0/3790948735 conn(0x7f90c40b4240 msgr2=0x7f90c40b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.750+0000 7f90cc21e640 1 -- 172.21.15.60:0/3790948735 shutdown_connections 2024-09-12T01:37:49.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.750+0000 7f90cc21e640 1 -- 172.21.15.60:0/3790948735 wait complete. 2024-09-12T01:37:49.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.751+0000 7f90cc21e640 1 Processor -- start 2024-09-12T01:37:49.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.751+0000 7f90cc21e640 1 -- start start 2024-09-12T01:37:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90cc21e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90c40b72f0 0x7f90c4152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90cc21e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90c415c2b0 0x7f90c4156d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90cc21e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90c415f200 0x7f90c4155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90cc21e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f90c40b7760 con 0x7f90c40b72f0 2024-09-12T01:37:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90cc21e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90c406d3f0 con 0x7f90c415c2b0 2024-09-12T01:37:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90cc21e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f90c406e020 con 0x7f90c415f200 2024-09-12T01:37:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90c9fba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90c40b72f0 0x7f90c4152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90c9fba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90c40b72f0 0x7f90c4152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51960/0 (socket says 172.21.15.60:51960) 2024-09-12T01:37:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90c9fba640 1 -- 172.21.15.60:0/2673281033 learned_addr learned my addr 172.21.15.60:0/2673281033 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90c97b9640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90c415c2b0 0x7f90c4156d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90ca7bb640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90c415f200 0x7f90c4155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90c9fba640 1 -- 172.21.15.60:0/2673281033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90c415f200 msgr2=0x7f90c4155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90c9fba640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90c415f200 0x7f90c4155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90c9fba640 1 -- 172.21.15.60:0/2673281033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90c415c2b0 msgr2=0x7f90c4156d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90c9fba640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90c415c2b0 0x7f90c4156d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90c9fba640 1 -- 172.21.15.60:0/2673281033 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c41576a0 con 0x7f90c40b72f0 2024-09-12T01:37:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.752+0000 7f90c9fba640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90c40b72f0 0x7f90c4152a90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f90c00097a0 tx=0x7f90c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.753+0000 7f90ba7fc640 1 -- 172.21.15.60:0/2673281033 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0041070 con 0x7f90c40b72f0 2024-09-12T01:37:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.753+0000 7f90ba7fc640 1 -- 172.21.15.60:0/2673281033 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c003c870 con 0x7f90c40b72f0 2024-09-12T01:37:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.753+0000 7f90ba7fc640 1 -- 172.21.15.60:0/2673281033 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0037040 con 0x7f90c40b72f0 2024-09-12T01:37:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.753+0000 7f90cc21e640 1 -- 172.21.15.60:0/2673281033 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90c4157980 con 0x7f90c40b72f0 2024-09-12T01:37:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.753+0000 7f90cc21e640 1 -- 172.21.15.60:0/2673281033 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c4157f40 con 0x7f90c40b72f0 2024-09-12T01:37:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.754+0000 7f90cc21e640 1 -- 172.21.15.60:0/2673281033 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90c40b6db0 con 0x7f90c40b72f0 2024-09-12T01:37:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.754+0000 7f90ba7fc640 1 -- 172.21.15.60:0/2673281033 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f90c0044070 con 0x7f90c40b72f0 2024-09-12T01:37:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.755+0000 7f90ba7fc640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f90a806be30 0x7f90a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.755+0000 7f90ba7fc640 1 -- 172.21.15.60:0/2673281033 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f90c00aba20 con 0x7f90c40b72f0 2024-09-12T01:37:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.755+0000 7f90c97b9640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f90a806be30 0x7f90a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.755+0000 7f90c97b9640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f90a806be30 0x7f90a806e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f90b4007fd0 tx=0x7f90b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:49.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.759+0000 7f90ba7fc640 1 -- 172.21.15.60:0/2673281033 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90c007a4f0 con 0x7f90c40b72f0 2024-09-12T01:37:49.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.931+0000 7f90cc21e640 1 -- 172.21.15.60:0/2673281033 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90c40b3fb0 con 0x7f90a806be30 2024-09-12T01:37:49.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.937+0000 7f90ba7fc640 1 -- 172.21.15.60:0/2673281033 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245254 (secure 0 0 0) 0x7f90c40b3fb0 con 0x7f90a806be30 2024-09-12T01:37:49.939 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:49.940 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:37:49.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.940+0000 7f90cc21e640 1 -- 172.21.15.60:0/2673281033 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f90a806be30 msgr2=0x7f90a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.940+0000 7f90cc21e640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f90a806be30 0x7f90a806e2f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f90b4007fd0 tx=0x7f90b4009040 comp rx=0 tx=0).stop 2024-09-12T01:37:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.940+0000 7f90cc21e640 1 -- 172.21.15.60:0/2673281033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90c40b72f0 msgr2=0x7f90c4152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.940+0000 7f90cc21e640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90c40b72f0 0x7f90c4152a90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f90c00097a0 tx=0x7f90c00046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.940+0000 7f90cc21e640 1 -- 172.21.15.60:0/2673281033 shutdown_connections 2024-09-12T01:37:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.941+0000 7f90cc21e640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f90a806be30 0x7f90a806e2f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.941+0000 7f90cc21e640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90c415f200 0x7f90c4155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.941+0000 7f90cc21e640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90c415c2b0 0x7f90c4156d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.941+0000 7f90cc21e640 1 --2- 172.21.15.60:0/2673281033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90c40b72f0 0x7f90c4152a90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.941+0000 7f90cc21e640 1 -- 172.21.15.60:0/2673281033 >> 172.21.15.60:0/2673281033 conn(0x7f90c40b4240 msgr2=0x7f90c4071050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.941+0000 7f90cc21e640 1 -- 172.21.15.60:0/2673281033 shutdown_connections 2024-09-12T01:37:49.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:49.941+0000 7f90cc21e640 1 -- 172.21.15.60:0/2673281033 wait complete. 2024-09-12T01:37:49.950 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-12T01:37:48.285112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":168,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":246288,"kb_used_data":5092,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754728432,"statfs":{"total":773094113280,"available":772841914368,"internally_reserved":0,"allocated":5214208,"data_stored":2761369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.344271"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963264+0000","last_change":"2024-09-12T01:37:44.963264+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963264+0000","last_undegraded":"2024-09-12T01:37:44.963264+0000","last_fullsized":"2024-09-12T01:37:44.963264+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955766+0000","last_change":"2024-09-12T01:37:44.955766+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955766+0000","last_undegraded":"2024-09-12T01:37:44.955766+0000","last_fullsized":"2024-09-12T01:37:44.955766+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962486+0000","last_change":"2024-09-12T01:37:44.962486+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962486+0000","last_undegraded":"2024-09-12T01:37:44.962486+0000","last_fullsized":"2024-09-12T01:37:44.962486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961519+0000","last_change":"2024-09-12T01:37:44.961519+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961519+0000","last_undegraded":"2024-09-12T01:37:44.961519+0000","last_fullsized":"2024-09-12T01:37:44.961519+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960619+0000","last_change":"2024-09-12T01:37:44.960619+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960619+0000","last_undegraded":"2024-09-12T01:37:44.960619+0000","last_fullsized":"2024-09-12T01:37:44.960619+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.953689+0000","last_change":"2024-09-12T01:37:44.953689+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.953689+0000","last_undegraded":"2024-09-12T01:37:44.953689+0000","last_fullsized":"2024-09-12T01:37:44.953689+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.957441+0000","last_change":"2024-09-12T01:37:44.957441+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.957441+0000","last_undegraded":"2024-09-12T01:37:44.957441+0000","last_fullsized":"2024-09-12T01:37:44.957441+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962521+0000","last_change":"2024-09-12T01:37:44.962521+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962521+0000","last_undegraded":"2024-09-12T01:37:44.962521+0000","last_fullsized":"2024-09-12T01:37:44.962521+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954510+0000","last_change":"2024-09-12T01:37:44.954510+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954510+0000","last_undegraded":"2024-09-12T01:37:44.954510+0000","last_fullsized":"2024-09-12T01:37:44.954510+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961685+0000","last_change":"2024-09-12T01:37:44.961685+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961685+0000","last_undegraded":"2024-09-12T01:37:44.961685+0000","last_fullsized":"2024-09-12T01:37:44.961685+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955145+0000","last_change":"2024-09-12T01:37:44.955145+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955145+0000","last_undegraded":"2024-09-12T01:37:44.955145+0000","last_fullsized":"2024-09-12T01:37:44.955145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955869+0000","last_change":"2024-09-12T01:37:44.955869+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955869+0000","last_undegraded":"2024-09-12T01:37:44.955869+0000","last_fullsized":"2024-09-12T01:37:44.955869+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961968+0000","last_change":"2024-09-12T01:37:44.961968+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961968+0000","last_undegraded":"2024-09-12T01:37:44.961968+0000","last_fullsized":"2024-09-12T01:37:44.961968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962634+0000","last_change":"2024-09-12T01:37:44.962634+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962634+0000","last_undegraded":"2024-09-12T01:37:44.962634+0000","last_fullsized":"2024-09-12T01:37:44.962634+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.959470+0000","last_change":"2024-09-12T01:37:44.959470+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.959470+0000","last_undegraded":"2024-09-12T01:37:44.959470+0000","last_fullsized":"2024-09-12T01:37:44.959470+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954225+0000","last_change":"2024-09-12T01:37:44.954225+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954225+0000","last_undegraded":"2024-09-12T01:37:44.954225+0000","last_fullsized":"2024-09-12T01:37:44.954225+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963992+0000","last_change":"2024-09-12T01:37:44.963992+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963992+0000","last_undegraded":"2024-09-12T01:37:44.963992+0000","last_fullsized":"2024-09-12T01:37:44.963992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963241+0000","last_change":"2024-09-12T01:37:44.963241+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963241+0000","last_undegraded":"2024-09-12T01:37:44.963241+0000","last_fullsized":"2024-09-12T01:37:44.963241+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961929+0000","last_change":"2024-09-12T01:37:44.961929+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961929+0000","last_undegraded":"2024-09-12T01:37:44.961929+0000","last_fullsized":"2024-09-12T01:37:44.961929+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958375+0000","last_change":"2024-09-12T01:37:44.958375+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958375+0000","last_undegraded":"2024-09-12T01:37:44.958375+0000","last_fullsized":"2024-09-12T01:37:44.958375+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955012+0000","last_change":"2024-09-12T01:37:44.955012+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955012+0000","last_undegraded":"2024-09-12T01:37:44.955012+0000","last_fullsized":"2024-09-12T01:37:44.955012+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954255+0000","last_change":"2024-09-12T01:37:44.954255+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954255+0000","last_undegraded":"2024-09-12T01:37:44.954255+0000","last_fullsized":"2024-09-12T01:37:44.954255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961974+0000","last_change":"2024-09-12T01:37:44.961974+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961974+0000","last_undegraded":"2024-09-12T01:37:44.961974+0000","last_fullsized":"2024-09-12T01:37:44.961974+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961110+0000","last_change":"2024-09-12T01:37:44.961110+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961110+0000","last_undegraded":"2024-09-12T01:37:44.961110+0000","last_fullsized":"2024-09-12T01:37:44.961110+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.956717+0000","last_change":"2024-09-12T01:37:44.956717+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.956717+0000","last_undegraded":"2024-09-12T01:37:44.956717+0000","last_fullsized":"2024-09-12T01:37:44.956717+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954907+0000","last_change":"2024-09-12T01:37:44.954907+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954907+0000","last_undegraded":"2024-09-12T01:37:44.954907+0000","last_fullsized":"2024-09-12T01:37:44.954907+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960158+0000","last_change":"2024-09-12T01:37:44.960158+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960158+0000","last_undegraded":"2024-09-12T01:37:44.960158+0000","last_fullsized":"2024-09-12T01:37:44.960158+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954672+0000","last_change":"2024-09-12T01:37:44.954672+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954672+0000","last_undegraded":"2024-09-12T01:37:44.954672+0000","last_fullsized":"2024-09-12T01:37:44.954672+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954289+0000","last_change":"2024-09-12T01:37:44.954289+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954289+0000","last_undegraded":"2024-09-12T01:37:44.954289+0000","last_fullsized":"2024-09-12T01:37:44.954289+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962063+0000","last_change":"2024-09-12T01:37:44.962063+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962063+0000","last_undegraded":"2024-09-12T01:37:44.962063+0000","last_fullsized":"2024-09-12T01:37:44.962063+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.959199+0000","last_change":"2024-09-12T01:37:44.959199+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.959199+0000","last_undegraded":"2024-09-12T01:37:44.959199+0000","last_fullsized":"2024-09-12T01:37:44.959199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.971959+0000","last_change":"2024-09-12T01:37:44.967687+0000","last_active":"2024-09-12T01:37:44.971959+0000","last_peered":"2024-09-12T01:37:44.971959+0000","last_clean":"2024-09-12T01:37:44.971959+0000","last_became_active":"2024-09-12T01:37:44.967371+0000","last_became_peered":"2024-09-12T01:37:44.967371+0000","last_unstale":"2024-09-12T01:37:44.971959+0000","last_undegraded":"2024-09-12T01:37:44.971959+0000","last_fullsized":"2024-09-12T01:37:44.971959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:02.837499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961540+0000","last_change":"2024-09-12T01:37:44.961540+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961540+0000","last_undegraded":"2024-09-12T01:37:44.961540+0000","last_fullsized":"2024-09-12T01:37:44.961540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.965257+0000","last_change":"2024-09-12T01:37:44.961291+0000","last_active":"2024-09-12T01:37:44.965257+0000","last_peered":"2024-09-12T01:37:44.965257+0000","last_clean":"2024-09-12T01:37:44.965257+0000","last_became_active":"2024-09-12T01:37:44.960579+0000","last_became_peered":"2024-09-12T01:37:44.960579+0000","last_unstale":"2024-09-12T01:37:44.965257+0000","last_undegraded":"2024-09-12T01:37:44.965257+0000","last_fullsized":"2024-09-12T01:37:44.965257+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:32.455115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954243+0000","last_change":"2024-09-12T01:37:44.954243+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954243+0000","last_undegraded":"2024-09-12T01:37:44.954243+0000","last_fullsized":"2024-09-12T01:37:44.954243+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972368+0000","last_change":"2024-09-12T01:37:44.970297+0000","last_active":"2024-09-12T01:37:44.972368+0000","last_peered":"2024-09-12T01:37:44.972368+0000","last_clean":"2024-09-12T01:37:44.972368+0000","last_became_active":"2024-09-12T01:37:44.969412+0000","last_became_peered":"2024-09-12T01:37:44.969412+0000","last_unstale":"2024-09-12T01:37:44.972368+0000","last_undegraded":"2024-09-12T01:37:44.972368+0000","last_fullsized":"2024-09-12T01:37:44.972368+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:04.222028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961206+0000","last_change":"2024-09-12T01:37:44.961206+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961206+0000","last_undegraded":"2024-09-12T01:37:44.961206+0000","last_fullsized":"2024-09-12T01:37:44.961206+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.964069+0000","last_change":"2024-09-12T01:37:44.960326+0000","last_active":"2024-09-12T01:37:44.964069+0000","last_peered":"2024-09-12T01:37:44.964069+0000","last_clean":"2024-09-12T01:37:44.964069+0000","last_became_active":"2024-09-12T01:37:44.960035+0000","last_became_peered":"2024-09-12T01:37:44.960035+0000","last_unstale":"2024-09-12T01:37:44.964069+0000","last_undegraded":"2024-09-12T01:37:44.964069+0000","last_fullsized":"2024-09-12T01:37:44.964069+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:35.165479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955662+0000","last_change":"2024-09-12T01:37:44.955662+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955662+0000","last_undegraded":"2024-09-12T01:37:44.955662+0000","last_fullsized":"2024-09-12T01:37:44.955662+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969065+0000","last_change":"2024-09-12T01:37:44.963126+0000","last_active":"2024-09-12T01:37:44.969065+0000","last_peered":"2024-09-12T01:37:44.969065+0000","last_clean":"2024-09-12T01:37:44.969065+0000","last_became_active":"2024-09-12T01:37:44.962716+0000","last_became_peered":"2024-09-12T01:37:44.962716+0000","last_unstale":"2024-09-12T01:37:44.969065+0000","last_undegraded":"2024-09-12T01:37:44.969065+0000","last_fullsized":"2024-09-12T01:37:44.969065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:23.617585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973377+0000","last_change":"2024-09-12T01:37:44.971445+0000","last_active":"2024-09-12T01:37:44.973377+0000","last_peered":"2024-09-12T01:37:44.973377+0000","last_clean":"2024-09-12T01:37:44.973377+0000","last_became_active":"2024-09-12T01:37:44.971101+0000","last_became_peered":"2024-09-12T01:37:44.971101+0000","last_unstale":"2024-09-12T01:37:44.973377+0000","last_undegraded":"2024-09-12T01:37:44.973377+0000","last_fullsized":"2024-09-12T01:37:44.973377+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:20.679198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973105+0000","last_change":"2024-09-12T01:37:44.971595+0000","last_active":"2024-09-12T01:37:44.973105+0000","last_peered":"2024-09-12T01:37:44.973105+0000","last_clean":"2024-09-12T01:37:44.973105+0000","last_became_active":"2024-09-12T01:37:44.971330+0000","last_became_peered":"2024-09-12T01:37:44.971330+0000","last_unstale":"2024-09-12T01:37:44.973105+0000","last_undegraded":"2024-09-12T01:37:44.973105+0000","last_fullsized":"2024-09-12T01:37:44.973105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:47.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.956335+0000","last_change":"2024-09-12T01:37:44.956335+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.956335+0000","last_undegraded":"2024-09-12T01:37:44.956335+0000","last_fullsized":"2024-09-12T01:37:44.956335+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:43.935051+0000","last_change":"2024-09-12T01:37:43.935051+0000","last_active":"2024-09-12T01:37:43.935051+0000","last_peered":"2024-09-12T01:37:43.935051+0000","last_clean":"2024-09-12T01:37:43.935051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:43.935051+0000","last_undegraded":"2024-09-12T01:37:43.935051+0000","last_fullsized":"2024-09-12T01:37:43.935051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963318+0000","last_change":"2024-09-12T01:37:44.963318+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963318+0000","last_undegraded":"2024-09-12T01:37:44.963318+0000","last_fullsized":"2024-09-12T01:37:44.963318+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972851+0000","last_change":"2024-09-12T01:37:44.971685+0000","last_active":"2024-09-12T01:37:44.972851+0000","last_peered":"2024-09-12T01:37:44.972851+0000","last_clean":"2024-09-12T01:37:44.972851+0000","last_became_active":"2024-09-12T01:37:44.971412+0000","last_became_peered":"2024-09-12T01:37:44.971412+0000","last_unstale":"2024-09-12T01:37:44.972851+0000","last_undegraded":"2024-09-12T01:37:44.972851+0000","last_fullsized":"2024-09-12T01:37:44.972851+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:18.933000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962598+0000","last_change":"2024-09-12T01:37:44.962598+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962598+0000","last_undegraded":"2024-09-12T01:37:44.962598+0000","last_fullsized":"2024-09-12T01:37:44.962598+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:43.935051+0000","last_change":"2024-09-12T01:37:43.935051+0000","last_active":"2024-09-12T01:37:43.935051+0000","last_peered":"2024-09-12T01:37:43.935051+0000","last_clean":"2024-09-12T01:37:43.935051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:43.935051+0000","last_undegraded":"2024-09-12T01:37:43.935051+0000","last_fullsized":"2024-09-12T01:37:43.935051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960726+0000","last_change":"2024-09-12T01:37:44.960726+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960726+0000","last_undegraded":"2024-09-12T01:37:44.960726+0000","last_fullsized":"2024-09-12T01:37:44.960726+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.970591+0000","last_change":"2024-09-12T01:37:44.969932+0000","last_active":"2024-09-12T01:37:44.970591+0000","last_peered":"2024-09-12T01:37:44.970591+0000","last_clean":"2024-09-12T01:37:44.970591+0000","last_became_active":"2024-09-12T01:37:44.969660+0000","last_became_peered":"2024-09-12T01:37:44.969660+0000","last_unstale":"2024-09-12T01:37:44.970591+0000","last_undegraded":"2024-09-12T01:37:44.970591+0000","last_fullsized":"2024-09-12T01:37:44.970591+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:47.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955819+0000","last_change":"2024-09-12T01:37:44.955819+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955819+0000","last_undegraded":"2024-09-12T01:37:44.955819+0000","last_fullsized":"2024-09-12T01:37:44.955819+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:43.935051+0000","last_change":"2024-09-12T01:37:43.935051+0000","last_active":"2024-09-12T01:37:43.935051+0000","last_peered":"2024-09-12T01:37:43.935051+0000","last_clean":"2024-09-12T01:37:43.935051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:43.935051+0000","last_undegraded":"2024-09-12T01:37:43.935051+0000","last_fullsized":"2024-09-12T01:37:43.935051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961847+0000","last_change":"2024-09-12T01:37:44.961847+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961847+0000","last_undegraded":"2024-09-12T01:37:44.961847+0000","last_fullsized":"2024-09-12T01:37:44.961847+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969414+0000","last_change":"2024-09-12T01:37:44.966599+0000","last_active":"2024-09-12T01:37:44.969414+0000","last_peered":"2024-09-12T01:37:44.969414+0000","last_clean":"2024-09-12T01:37:44.969414+0000","last_became_active":"2024-09-12T01:37:44.966307+0000","last_became_peered":"2024-09-12T01:37:44.966307+0000","last_unstale":"2024-09-12T01:37:44.969414+0000","last_undegraded":"2024-09-12T01:37:44.969414+0000","last_fullsized":"2024-09-12T01:37:44.969414+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.034249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958973+0000","last_change":"2024-09-12T01:37:44.958973+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958973+0000","last_undegraded":"2024-09-12T01:37:44.958973+0000","last_fullsized":"2024-09-12T01:37:44.958973+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.970105+0000","last_change":"2024-09-12T01:37:44.969334+0000","last_active":"2024-09-12T01:37:44.970105+0000","last_peered":"2024-09-12T01:37:44.970105+0000","last_clean":"2024-09-12T01:37:44.970105+0000","last_became_active":"2024-09-12T01:37:44.969042+0000","last_became_peered":"2024-09-12T01:37:44.969042+0000","last_unstale":"2024-09-12T01:37:44.970105+0000","last_undegraded":"2024-09-12T01:37:44.970105+0000","last_fullsized":"2024-09-12T01:37:44.970105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:09.882425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958352+0000","last_change":"2024-09-12T01:37:44.958352+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958352+0000","last_undegraded":"2024-09-12T01:37:44.958352+0000","last_fullsized":"2024-09-12T01:37:44.958352+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.975211+0000","last_change":"2024-09-12T01:37:44.974432+0000","last_active":"2024-09-12T01:37:44.975211+0000","last_peered":"2024-09-12T01:37:44.975211+0000","last_clean":"2024-09-12T01:37:44.975211+0000","last_became_active":"2024-09-12T01:37:44.974089+0000","last_became_peered":"2024-09-12T01:37:44.974089+0000","last_unstale":"2024-09-12T01:37:44.975211+0000","last_undegraded":"2024-09-12T01:37:44.975211+0000","last_fullsized":"2024-09-12T01:37:44.975211+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:09.882425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954331+0000","last_change":"2024-09-12T01:37:44.954331+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954331+0000","last_undegraded":"2024-09-12T01:37:44.954331+0000","last_fullsized":"2024-09-12T01:37:44.954331+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:43.935051+0000","last_change":"2024-09-12T01:37:43.935051+0000","last_active":"2024-09-12T01:37:43.935051+0000","last_peered":"2024-09-12T01:37:43.935051+0000","last_clean":"2024-09-12T01:37:43.935051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:43.935051+0000","last_undegraded":"2024-09-12T01:37:43.935051+0000","last_fullsized":"2024-09-12T01:37:43.935051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958438+0000","last_change":"2024-09-12T01:37:44.958438+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958438+0000","last_undegraded":"2024-09-12T01:37:44.958438+0000","last_fullsized":"2024-09-12T01:37:44.958438+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969328+0000","last_change":"2024-09-12T01:37:44.967523+0000","last_active":"2024-09-12T01:37:44.969328+0000","last_peered":"2024-09-12T01:37:44.969328+0000","last_clean":"2024-09-12T01:37:44.969328+0000","last_became_active":"2024-09-12T01:37:44.967216+0000","last_became_peered":"2024-09-12T01:37:44.967216+0000","last_unstale":"2024-09-12T01:37:44.969328+0000","last_undegraded":"2024-09-12T01:37:44.969328+0000","last_fullsized":"2024-09-12T01:37:44.969328+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:09.882425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958540+0000","last_change":"2024-09-12T01:37:44.958540+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958540+0000","last_undegraded":"2024-09-12T01:37:44.958540+0000","last_fullsized":"2024-09-12T01:37:44.958540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.974989+0000","last_change":"2024-09-12T01:37:44.973988+0000","last_active":"2024-09-12T01:37:44.974989+0000","last_peered":"2024-09-12T01:37:44.974989+0000","last_clean":"2024-09-12T01:37:44.974989+0000","last_became_active":"2024-09-12T01:37:44.973403+0000","last_became_peered":"2024-09-12T01:37:44.973403+0000","last_unstale":"2024-09-12T01:37:44.974989+0000","last_undegraded":"2024-09-12T01:37:44.974989+0000","last_fullsized":"2024-09-12T01:37:44.974989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:38.172494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.953487+0000","last_change":"2024-09-12T01:37:44.953487+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.953487+0000","last_undegraded":"2024-09-12T01:37:44.953487+0000","last_fullsized":"2024-09-12T01:37:44.953487+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972785+0000","last_change":"2024-09-12T01:37:44.971512+0000","last_active":"2024-09-12T01:37:44.972785+0000","last_peered":"2024-09-12T01:37:44.972785+0000","last_clean":"2024-09-12T01:37:44.972785+0000","last_became_active":"2024-09-12T01:37:44.970650+0000","last_became_peered":"2024-09-12T01:37:44.970650+0000","last_unstale":"2024-09-12T01:37:44.972785+0000","last_undegraded":"2024-09-12T01:37:44.972785+0000","last_fullsized":"2024-09-12T01:37:44.972785+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.034249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961058+0000","last_change":"2024-09-12T01:37:44.961058+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961058+0000","last_undegraded":"2024-09-12T01:37:44.961058+0000","last_fullsized":"2024-09-12T01:37:44.961058+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972279+0000","last_change":"2024-09-12T01:37:44.968846+0000","last_active":"2024-09-12T01:37:44.972279+0000","last_peered":"2024-09-12T01:37:44.972279+0000","last_clean":"2024-09-12T01:37:44.972279+0000","last_became_active":"2024-09-12T01:37:44.968560+0000","last_became_peered":"2024-09-12T01:37:44.968560+0000","last_unstale":"2024-09-12T01:37:44.972279+0000","last_undegraded":"2024-09-12T01:37:44.972279+0000","last_fullsized":"2024-09-12T01:37:44.972279+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:42.461240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:43.935051+0000","last_change":"2024-09-12T01:37:43.935051+0000","last_active":"2024-09-12T01:37:43.935051+0000","last_peered":"2024-09-12T01:37:43.935051+0000","last_clean":"2024-09-12T01:37:43.935051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:43.935051+0000","last_undegraded":"2024-09-12T01:37:43.935051+0000","last_fullsized":"2024-09-12T01:37:43.935051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955372+0000","last_change":"2024-09-12T01:37:44.955372+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955372+0000","last_undegraded":"2024-09-12T01:37:44.955372+0000","last_fullsized":"2024-09-12T01:37:44.955372+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973101+0000","last_change":"2024-09-12T01:37:44.971996+0000","last_active":"2024-09-12T01:37:44.973101+0000","last_peered":"2024-09-12T01:37:44.973101+0000","last_clean":"2024-09-12T01:37:44.973101+0000","last_became_active":"2024-09-12T01:37:44.971733+0000","last_became_peered":"2024-09-12T01:37:44.971733+0000","last_unstale":"2024-09-12T01:37:44.973101+0000","last_undegraded":"2024-09-12T01:37:44.973101+0000","last_fullsized":"2024-09-12T01:37:44.973101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:09.711449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.959951+0000","last_change":"2024-09-12T01:37:44.959951+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.959951+0000","last_undegraded":"2024-09-12T01:37:44.959951+0000","last_fullsized":"2024-09-12T01:37:44.959951+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:43.935051+0000","last_change":"2024-09-12T01:37:43.935051+0000","last_active":"2024-09-12T01:37:43.935051+0000","last_peered":"2024-09-12T01:37:43.935051+0000","last_clean":"2024-09-12T01:37:43.935051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:43.935051+0000","last_undegraded":"2024-09-12T01:37:43.935051+0000","last_fullsized":"2024-09-12T01:37:43.935051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958660+0000","last_change":"2024-09-12T01:37:44.958660+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958660+0000","last_undegraded":"2024-09-12T01:37:44.958660+0000","last_fullsized":"2024-09-12T01:37:44.958660+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.971193+0000","last_change":"2024-09-12T01:37:44.970013+0000","last_active":"2024-09-12T01:37:44.971193+0000","last_peered":"2024-09-12T01:37:44.971193+0000","last_clean":"2024-09-12T01:37:44.971193+0000","last_became_active":"2024-09-12T01:37:44.969654+0000","last_became_peered":"2024-09-12T01:37:44.969654+0000","last_unstale":"2024-09-12T01:37:44.971193+0000","last_undegraded":"2024-09-12T01:37:44.971193+0000","last_fullsized":"2024-09-12T01:37:44.971193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:58.402489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.956256+0000","last_change":"2024-09-12T01:37:44.956256+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.956256+0000","last_undegraded":"2024-09-12T01:37:44.956256+0000","last_fullsized":"2024-09-12T01:37:44.956256+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972446+0000","last_change":"2024-09-12T01:37:44.970664+0000","last_active":"2024-09-12T01:37:44.972446+0000","last_peered":"2024-09-12T01:37:44.972446+0000","last_clean":"2024-09-12T01:37:44.972446+0000","last_became_active":"2024-09-12T01:37:44.970398+0000","last_became_peered":"2024-09-12T01:37:44.970398+0000","last_unstale":"2024-09-12T01:37:44.972446+0000","last_undegraded":"2024-09-12T01:37:44.972446+0000","last_fullsized":"2024-09-12T01:37:44.972446+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:47.940491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.975234+0000","last_change":"2024-09-12T01:37:44.974675+0000","last_active":"2024-09-12T01:37:44.975234+0000","last_peered":"2024-09-12T01:37:44.975234+0000","last_clean":"2024-09-12T01:37:44.975234+0000","last_became_active":"2024-09-12T01:37:44.974293+0000","last_became_peered":"2024-09-12T01:37:44.974293+0000","last_unstale":"2024-09-12T01:37:44.975234+0000","last_undegraded":"2024-09-12T01:37:44.975234+0000","last_fullsized":"2024-09-12T01:37:44.975234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:09.321760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955245+0000","last_change":"2024-09-12T01:37:44.955245+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955245+0000","last_undegraded":"2024-09-12T01:37:44.955245+0000","last_fullsized":"2024-09-12T01:37:44.955245+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972191+0000","last_change":"2024-09-12T01:37:44.970246+0000","last_active":"2024-09-12T01:37:44.972191+0000","last_peered":"2024-09-12T01:37:44.972191+0000","last_clean":"2024-09-12T01:37:44.972191+0000","last_became_active":"2024-09-12T01:37:44.969914+0000","last_became_peered":"2024-09-12T01:37:44.969914+0000","last_unstale":"2024-09-12T01:37:44.972191+0000","last_undegraded":"2024-09-12T01:37:44.972191+0000","last_fullsized":"2024-09-12T01:37:44.972191+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:18.933000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973096+0000","last_change":"2024-09-12T01:37:44.970613+0000","last_active":"2024-09-12T01:37:44.973096+0000","last_peered":"2024-09-12T01:37:44.973096+0000","last_clean":"2024-09-12T01:37:44.973096+0000","last_became_active":"2024-09-12T01:37:44.970284+0000","last_became_peered":"2024-09-12T01:37:44.970284+0000","last_unstale":"2024-09-12T01:37:44.973096+0000","last_undegraded":"2024-09-12T01:37:44.973096+0000","last_fullsized":"2024-09-12T01:37:44.973096+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:47.940491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962345+0000","last_change":"2024-09-12T01:37:44.962345+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962345+0000","last_undegraded":"2024-09-12T01:37:44.962345+0000","last_fullsized":"2024-09-12T01:37:44.962345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.965660+0000","last_change":"2024-09-12T01:37:44.964928+0000","last_active":"2024-09-12T01:37:44.965660+0000","last_peered":"2024-09-12T01:37:44.965660+0000","last_clean":"2024-09-12T01:37:44.965660+0000","last_became_active":"2024-09-12T01:37:44.964539+0000","last_became_peered":"2024-09-12T01:37:44.964539+0000","last_unstale":"2024-09-12T01:37:44.965660+0000","last_undegraded":"2024-09-12T01:37:44.965660+0000","last_fullsized":"2024-09-12T01:37:44.965660+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:16.673738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963231+0000","last_change":"2024-09-12T01:37:44.963231+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963231+0000","last_undegraded":"2024-09-12T01:37:44.963231+0000","last_fullsized":"2024-09-12T01:37:44.963231+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.968975+0000","last_change":"2024-09-12T01:37:44.962377+0000","last_active":"2024-09-12T01:37:44.968975+0000","last_peered":"2024-09-12T01:37:44.968975+0000","last_clean":"2024-09-12T01:37:44.968975+0000","last_became_active":"2024-09-12T01:37:44.962116+0000","last_became_peered":"2024-09-12T01:37:44.962116+0000","last_unstale":"2024-09-12T01:37:44.968975+0000","last_undegraded":"2024-09-12T01:37:44.968975+0000","last_fullsized":"2024-09-12T01:37:44.968975+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:24.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.953494+0000","last_change":"2024-09-12T01:37:44.953494+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.953494+0000","last_undegraded":"2024-09-12T01:37:44.953494+0000","last_fullsized":"2024-09-12T01:37:44.953494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.968870+0000","last_change":"2024-09-12T01:37:44.965413+0000","last_active":"2024-09-12T01:37:44.968870+0000","last_peered":"2024-09-12T01:37:44.968870+0000","last_clean":"2024-09-12T01:37:44.968870+0000","last_became_active":"2024-09-12T01:37:44.965122+0000","last_became_peered":"2024-09-12T01:37:44.965122+0000","last_unstale":"2024-09-12T01:37:44.968870+0000","last_undegraded":"2024-09-12T01:37:44.968870+0000","last_fullsized":"2024-09-12T01:37:44.968870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:37.749845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960345+0000","last_change":"2024-09-12T01:37:44.960345+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960345+0000","last_undegraded":"2024-09-12T01:37:44.960345+0000","last_fullsized":"2024-09-12T01:37:44.960345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969737+0000","last_change":"2024-09-12T01:37:44.968753+0000","last_active":"2024-09-12T01:37:44.969737+0000","last_peered":"2024-09-12T01:37:44.969737+0000","last_clean":"2024-09-12T01:37:44.969737+0000","last_became_active":"2024-09-12T01:37:44.968465+0000","last_became_peered":"2024-09-12T01:37:44.968465+0000","last_unstale":"2024-09-12T01:37:44.969737+0000","last_undegraded":"2024-09-12T01:37:44.969737+0000","last_fullsized":"2024-09-12T01:37:44.969737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:55.452436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":209,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.967587+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:37:44.967587+0000","last_peered":"2024-09-12T01:37:44.967587+0000","last_clean":"2024-09-12T01:37:44.967587+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:37:44.967587+0000","last_undegraded":"2024-09-12T01:37:44.967587+0000","last_fullsized":"2024-09-12T01:37:44.967587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509467,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":783968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":790243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31660,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":483328,"data_stored":187783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:37:49.955 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:37:50.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.094+0000 7fa494b52640 1 Processor -- start 2024-09-12T01:37:50.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.095+0000 7fa494b52640 1 -- start start 2024-09-12T01:37:50.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.095+0000 7fa494b52640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa49015c670 0x7fa490073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.096+0000 7fa494b52640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa490071750 con 0x7fa490073080 2024-09-12T01:37:50.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.096+0000 7fa494b52640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4900d0370 con 0x7fa4900b1990 2024-09-12T01:37:50.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.096+0000 7fa494b52640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa4900d0c60 con 0x7fa49015c670 2024-09-12T01:37:50.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.096+0000 7fa48dd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa49015c670 0x7fa490073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.096+0000 7fa48e59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa490073080 0x7fa4900b5460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:42334/0 (socket says 172.21.15.60:42334) 2024-09-12T01:37:50.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.096+0000 7fa48e59c640 1 -- 172.21.15.60:0/240993320 learned_addr learned my addr 172.21.15.60:0/240993320 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:50.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.096+0000 7fa48dd9b640 1 -- 172.21.15.60:0/240993320 >> v1:172.21.15.105:6789/0 conn(0x7fa4900b1990 legacy=0x7fa4900d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:50.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.096+0000 7fa48dd9b640 1 -- 172.21.15.60:0/240993320 >> v1:172.21.15.60:6789/0 conn(0x7fa490073080 legacy=0x7fa4900b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.096+0000 7fa48dd9b640 1 -- 172.21.15.60:0/240993320 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4900739a0 con 0x7fa49015c670 2024-09-12T01:37:50.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.096+0000 7fa48d59a640 1 -- 172.21.15.60:0/240993320 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4096390584 0 0) 0x7fa490071750 con 0x7fa490073080 2024-09-12T01:37:50.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.097+0000 7fa48dd9b640 1 --2- 172.21.15.60:0/240993320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49015c670 0x7fa490073460 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa4840097a0 tx=0x7fa48402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad911fb36f2f055 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:50.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.097+0000 7fa48d59a640 1 -- 172.21.15.60:0/240993320 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484037070 con 0x7fa49015c670 2024-09-12T01:37:50.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.097+0000 7fa48d59a640 1 -- 172.21.15.60:0/240993320 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa484032440 con 0x7fa49015c670 2024-09-12T01:37:50.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.097+0000 7fa48d59a640 1 -- 172.21.15.60:0/240993320 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa484032810 con 0x7fa49015c670 2024-09-12T01:37:50.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.097+0000 7fa494b52640 1 -- 172.21.15.60:0/240993320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49015c670 msgr2=0x7fa490073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.097+0000 7fa494b52640 1 --2- 172.21.15.60:0/240993320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49015c670 0x7fa490073460 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa4840097a0 tx=0x7fa48402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.098+0000 7fa494b52640 1 -- 172.21.15.60:0/240993320 shutdown_connections 2024-09-12T01:37:50.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.098+0000 7fa494b52640 1 --2- 172.21.15.60:0/240993320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49015c670 0x7fa490073460 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.098+0000 7fa494b52640 1 -- 172.21.15.60:0/240993320 >> 172.21.15.60:0/240993320 conn(0x7fa4900d24d0 msgr2=0x7fa4900d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:50.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.098+0000 7fa494b52640 1 -- 172.21.15.60:0/240993320 shutdown_connections 2024-09-12T01:37:50.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.098+0000 7fa494b52640 1 -- 172.21.15.60:0/240993320 wait complete. 2024-09-12T01:37:50.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.099+0000 7fa494b52640 1 Processor -- start 2024-09-12T01:37:50.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.099+0000 7fa494b52640 1 -- start start 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa494b52640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa490073080 0x7fa49013d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa494b52640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4900b1990 0x7fa49014e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa494b52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49015c670 0x7fa49014ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa494b52640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4900d0610 con 0x7fa49015c670 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa494b52640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa490071470 con 0x7fa4900b1990 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa494b52640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4900d08f0 con 0x7fa490073080 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49015c670 0x7fa49014ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49015c670 0x7fa49014ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51986/0 (socket says 172.21.15.60:51986) 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48ed9d640 1 -- 172.21.15.60:0/2969071286 learned_addr learned my addr 172.21.15.60:0/2969071286 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48dd9b640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4900b1990 0x7fa49014e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48e59c640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa490073080 0x7fa49013d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48ed9d640 1 -- 172.21.15.60:0/2969071286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa490073080 msgr2=0x7fa49013d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48ed9d640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa490073080 0x7fa49013d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48ed9d640 1 -- 172.21.15.60:0/2969071286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4900b1990 msgr2=0x7fa49014e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48ed9d640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4900b1990 0x7fa49014e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48ed9d640 1 -- 172.21.15.60:0/2969071286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4901514f0 con 0x7fa49015c670 2024-09-12T01:37:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48dd9b640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4900b1990 0x7fa49014e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48e59c640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa490073080 0x7fa49013d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa48ed9d640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49015c670 0x7fa49014ec40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa48800c700 tx=0x7fa48800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa47effd640 1 -- 172.21.15.60:0/2969071286 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa488016020 con 0x7fa49015c670 2024-09-12T01:37:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.100+0000 7fa47effd640 1 -- 172.21.15.60:0/2969071286 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa48800aa50 con 0x7fa49015c670 2024-09-12T01:37:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.101+0000 7fa494b52640 1 -- 172.21.15.60:0/2969071286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4901517d0 con 0x7fa49015c670 2024-09-12T01:37:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.101+0000 7fa47effd640 1 -- 172.21.15.60:0/2969071286 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa48800ce10 con 0x7fa49015c670 2024-09-12T01:37:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.101+0000 7fa494b52640 1 -- 172.21.15.60:0/2969071286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa49013dac0 con 0x7fa49015c670 2024-09-12T01:37:50.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.102+0000 7fa494b52640 1 -- 172.21.15.60:0/2969071286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4900d1f00 con 0x7fa49015c670 2024-09-12T01:37:50.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.102+0000 7fa47effd640 1 -- 172.21.15.60:0/2969071286 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa488019020 con 0x7fa49015c670 2024-09-12T01:37:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.102+0000 7fa47effd640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa47006be30 0x7fa47006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.103+0000 7fa47effd640 1 -- 172.21.15.60:0/2969071286 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fa48808b130 con 0x7fa49015c670 2024-09-12T01:37:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.103+0000 7fa48e59c640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa47006be30 0x7fa47006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.103+0000 7fa48e59c640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa47006be30 0x7fa47006e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa480000f60 tx=0x7fa480009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:50.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.107+0000 7fa47effd640 1 -- 172.21.15.60:0/2969071286 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa488020020 con 0x7fa49015c670 2024-09-12T01:37:50.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.278+0000 7fa494b52640 1 -- 172.21.15.60:0/2969071286 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa4900d3050 con 0x7fa47006be30 2024-09-12T01:37:50.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.284+0000 7fa47effd640 1 -- 172.21.15.60:0/2969071286 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245254 (secure 0 0 0) 0x7fa4900d3050 con 0x7fa47006be30 2024-09-12T01:37:50.286 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:50.287 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:37:50.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.287+0000 7fa494b52640 1 -- 172.21.15.60:0/2969071286 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa47006be30 msgr2=0x7fa47006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.287+0000 7fa494b52640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa47006be30 0x7fa47006e2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa480000f60 tx=0x7fa480009040 comp rx=0 tx=0).stop 2024-09-12T01:37:50.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.287+0000 7fa494b52640 1 -- 172.21.15.60:0/2969071286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49015c670 msgr2=0x7fa49014ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.287+0000 7fa494b52640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49015c670 0x7fa49014ec40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa48800c700 tx=0x7fa48800cbc0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.287+0000 7fa494b52640 1 -- 172.21.15.60:0/2969071286 shutdown_connections 2024-09-12T01:37:50.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.287+0000 7fa494b52640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa49015c670 0x7fa49014ec40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.287+0000 7fa494b52640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4900b1990 0x7fa49014e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.287+0000 7fa494b52640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa47006be30 0x7fa47006e2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.287+0000 7fa494b52640 1 --2- 172.21.15.60:0/2969071286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa490073080 0x7fa49013d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.287+0000 7fa494b52640 1 -- 172.21.15.60:0/2969071286 >> 172.21.15.60:0/2969071286 conn(0x7fa4900d24d0 msgr2=0x7fa490157650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:50.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.288+0000 7fa494b52640 1 -- 172.21.15.60:0/2969071286 shutdown_connections 2024-09-12T01:37:50.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.288+0000 7fa494b52640 1 -- 172.21.15.60:0/2969071286 wait complete. 2024-09-12T01:37:50.298 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-09-12T01:37:48.285112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":168,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":246288,"kb_used_data":5092,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754728432,"statfs":{"total":773094113280,"available":772841914368,"internally_reserved":0,"allocated":5214208,"data_stored":2761369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.344271"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963264+0000","last_change":"2024-09-12T01:37:44.963264+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963264+0000","last_undegraded":"2024-09-12T01:37:44.963264+0000","last_fullsized":"2024-09-12T01:37:44.963264+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955766+0000","last_change":"2024-09-12T01:37:44.955766+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955766+0000","last_undegraded":"2024-09-12T01:37:44.955766+0000","last_fullsized":"2024-09-12T01:37:44.955766+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962486+0000","last_change":"2024-09-12T01:37:44.962486+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962486+0000","last_undegraded":"2024-09-12T01:37:44.962486+0000","last_fullsized":"2024-09-12T01:37:44.962486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961519+0000","last_change":"2024-09-12T01:37:44.961519+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961519+0000","last_undegraded":"2024-09-12T01:37:44.961519+0000","last_fullsized":"2024-09-12T01:37:44.961519+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960619+0000","last_change":"2024-09-12T01:37:44.960619+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960619+0000","last_undegraded":"2024-09-12T01:37:44.960619+0000","last_fullsized":"2024-09-12T01:37:44.960619+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.953689+0000","last_change":"2024-09-12T01:37:44.953689+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.953689+0000","last_undegraded":"2024-09-12T01:37:44.953689+0000","last_fullsized":"2024-09-12T01:37:44.953689+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.957441+0000","last_change":"2024-09-12T01:37:44.957441+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.957441+0000","last_undegraded":"2024-09-12T01:37:44.957441+0000","last_fullsized":"2024-09-12T01:37:44.957441+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962521+0000","last_change":"2024-09-12T01:37:44.962521+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962521+0000","last_undegraded":"2024-09-12T01:37:44.962521+0000","last_fullsized":"2024-09-12T01:37:44.962521+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954510+0000","last_change":"2024-09-12T01:37:44.954510+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954510+0000","last_undegraded":"2024-09-12T01:37:44.954510+0000","last_fullsized":"2024-09-12T01:37:44.954510+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961685+0000","last_change":"2024-09-12T01:37:44.961685+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961685+0000","last_undegraded":"2024-09-12T01:37:44.961685+0000","last_fullsized":"2024-09-12T01:37:44.961685+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955145+0000","last_change":"2024-09-12T01:37:44.955145+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955145+0000","last_undegraded":"2024-09-12T01:37:44.955145+0000","last_fullsized":"2024-09-12T01:37:44.955145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955869+0000","last_change":"2024-09-12T01:37:44.955869+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955869+0000","last_undegraded":"2024-09-12T01:37:44.955869+0000","last_fullsized":"2024-09-12T01:37:44.955869+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961968+0000","last_change":"2024-09-12T01:37:44.961968+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961968+0000","last_undegraded":"2024-09-12T01:37:44.961968+0000","last_fullsized":"2024-09-12T01:37:44.961968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962634+0000","last_change":"2024-09-12T01:37:44.962634+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962634+0000","last_undegraded":"2024-09-12T01:37:44.962634+0000","last_fullsized":"2024-09-12T01:37:44.962634+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.959470+0000","last_change":"2024-09-12T01:37:44.959470+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.959470+0000","last_undegraded":"2024-09-12T01:37:44.959470+0000","last_fullsized":"2024-09-12T01:37:44.959470+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954225+0000","last_change":"2024-09-12T01:37:44.954225+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954225+0000","last_undegraded":"2024-09-12T01:37:44.954225+0000","last_fullsized":"2024-09-12T01:37:44.954225+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963992+0000","last_change":"2024-09-12T01:37:44.963992+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963992+0000","last_undegraded":"2024-09-12T01:37:44.963992+0000","last_fullsized":"2024-09-12T01:37:44.963992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963241+0000","last_change":"2024-09-12T01:37:44.963241+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963241+0000","last_undegraded":"2024-09-12T01:37:44.963241+0000","last_fullsized":"2024-09-12T01:37:44.963241+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961929+0000","last_change":"2024-09-12T01:37:44.961929+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961929+0000","last_undegraded":"2024-09-12T01:37:44.961929+0000","last_fullsized":"2024-09-12T01:37:44.961929+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958375+0000","last_change":"2024-09-12T01:37:44.958375+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958375+0000","last_undegraded":"2024-09-12T01:37:44.958375+0000","last_fullsized":"2024-09-12T01:37:44.958375+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955012+0000","last_change":"2024-09-12T01:37:44.955012+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955012+0000","last_undegraded":"2024-09-12T01:37:44.955012+0000","last_fullsized":"2024-09-12T01:37:44.955012+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954255+0000","last_change":"2024-09-12T01:37:44.954255+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954255+0000","last_undegraded":"2024-09-12T01:37:44.954255+0000","last_fullsized":"2024-09-12T01:37:44.954255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961974+0000","last_change":"2024-09-12T01:37:44.961974+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961974+0000","last_undegraded":"2024-09-12T01:37:44.961974+0000","last_fullsized":"2024-09-12T01:37:44.961974+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961110+0000","last_change":"2024-09-12T01:37:44.961110+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961110+0000","last_undegraded":"2024-09-12T01:37:44.961110+0000","last_fullsized":"2024-09-12T01:37:44.961110+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.956717+0000","last_change":"2024-09-12T01:37:44.956717+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.956717+0000","last_undegraded":"2024-09-12T01:37:44.956717+0000","last_fullsized":"2024-09-12T01:37:44.956717+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954907+0000","last_change":"2024-09-12T01:37:44.954907+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954907+0000","last_undegraded":"2024-09-12T01:37:44.954907+0000","last_fullsized":"2024-09-12T01:37:44.954907+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960158+0000","last_change":"2024-09-12T01:37:44.960158+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960158+0000","last_undegraded":"2024-09-12T01:37:44.960158+0000","last_fullsized":"2024-09-12T01:37:44.960158+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954672+0000","last_change":"2024-09-12T01:37:44.954672+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954672+0000","last_undegraded":"2024-09-12T01:37:44.954672+0000","last_fullsized":"2024-09-12T01:37:44.954672+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954289+0000","last_change":"2024-09-12T01:37:44.954289+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954289+0000","last_undegraded":"2024-09-12T01:37:44.954289+0000","last_fullsized":"2024-09-12T01:37:44.954289+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962063+0000","last_change":"2024-09-12T01:37:44.962063+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962063+0000","last_undegraded":"2024-09-12T01:37:44.962063+0000","last_fullsized":"2024-09-12T01:37:44.962063+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.959199+0000","last_change":"2024-09-12T01:37:44.959199+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.959199+0000","last_undegraded":"2024-09-12T01:37:44.959199+0000","last_fullsized":"2024-09-12T01:37:44.959199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.971959+0000","last_change":"2024-09-12T01:37:44.967687+0000","last_active":"2024-09-12T01:37:44.971959+0000","last_peered":"2024-09-12T01:37:44.971959+0000","last_clean":"2024-09-12T01:37:44.971959+0000","last_became_active":"2024-09-12T01:37:44.967371+0000","last_became_peered":"2024-09-12T01:37:44.967371+0000","last_unstale":"2024-09-12T01:37:44.971959+0000","last_undegraded":"2024-09-12T01:37:44.971959+0000","last_fullsized":"2024-09-12T01:37:44.971959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:02.837499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961540+0000","last_change":"2024-09-12T01:37:44.961540+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961540+0000","last_undegraded":"2024-09-12T01:37:44.961540+0000","last_fullsized":"2024-09-12T01:37:44.961540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.965257+0000","last_change":"2024-09-12T01:37:44.961291+0000","last_active":"2024-09-12T01:37:44.965257+0000","last_peered":"2024-09-12T01:37:44.965257+0000","last_clean":"2024-09-12T01:37:44.965257+0000","last_became_active":"2024-09-12T01:37:44.960579+0000","last_became_peered":"2024-09-12T01:37:44.960579+0000","last_unstale":"2024-09-12T01:37:44.965257+0000","last_undegraded":"2024-09-12T01:37:44.965257+0000","last_fullsized":"2024-09-12T01:37:44.965257+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:32.455115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954243+0000","last_change":"2024-09-12T01:37:44.954243+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954243+0000","last_undegraded":"2024-09-12T01:37:44.954243+0000","last_fullsized":"2024-09-12T01:37:44.954243+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972368+0000","last_change":"2024-09-12T01:37:44.970297+0000","last_active":"2024-09-12T01:37:44.972368+0000","last_peered":"2024-09-12T01:37:44.972368+0000","last_clean":"2024-09-12T01:37:44.972368+0000","last_became_active":"2024-09-12T01:37:44.969412+0000","last_became_peered":"2024-09-12T01:37:44.969412+0000","last_unstale":"2024-09-12T01:37:44.972368+0000","last_undegraded":"2024-09-12T01:37:44.972368+0000","last_fullsized":"2024-09-12T01:37:44.972368+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:04.222028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961206+0000","last_change":"2024-09-12T01:37:44.961206+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961206+0000","last_undegraded":"2024-09-12T01:37:44.961206+0000","last_fullsized":"2024-09-12T01:37:44.961206+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.964069+0000","last_change":"2024-09-12T01:37:44.960326+0000","last_active":"2024-09-12T01:37:44.964069+0000","last_peered":"2024-09-12T01:37:44.964069+0000","last_clean":"2024-09-12T01:37:44.964069+0000","last_became_active":"2024-09-12T01:37:44.960035+0000","last_became_peered":"2024-09-12T01:37:44.960035+0000","last_unstale":"2024-09-12T01:37:44.964069+0000","last_undegraded":"2024-09-12T01:37:44.964069+0000","last_fullsized":"2024-09-12T01:37:44.964069+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:35.165479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955662+0000","last_change":"2024-09-12T01:37:44.955662+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955662+0000","last_undegraded":"2024-09-12T01:37:44.955662+0000","last_fullsized":"2024-09-12T01:37:44.955662+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969065+0000","last_change":"2024-09-12T01:37:44.963126+0000","last_active":"2024-09-12T01:37:44.969065+0000","last_peered":"2024-09-12T01:37:44.969065+0000","last_clean":"2024-09-12T01:37:44.969065+0000","last_became_active":"2024-09-12T01:37:44.962716+0000","last_became_peered":"2024-09-12T01:37:44.962716+0000","last_unstale":"2024-09-12T01:37:44.969065+0000","last_undegraded":"2024-09-12T01:37:44.969065+0000","last_fullsized":"2024-09-12T01:37:44.969065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:23.617585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973377+0000","last_change":"2024-09-12T01:37:44.971445+0000","last_active":"2024-09-12T01:37:44.973377+0000","last_peered":"2024-09-12T01:37:44.973377+0000","last_clean":"2024-09-12T01:37:44.973377+0000","last_became_active":"2024-09-12T01:37:44.971101+0000","last_became_peered":"2024-09-12T01:37:44.971101+0000","last_unstale":"2024-09-12T01:37:44.973377+0000","last_undegraded":"2024-09-12T01:37:44.973377+0000","last_fullsized":"2024-09-12T01:37:44.973377+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:20.679198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973105+0000","last_change":"2024-09-12T01:37:44.971595+0000","last_active":"2024-09-12T01:37:44.973105+0000","last_peered":"2024-09-12T01:37:44.973105+0000","last_clean":"2024-09-12T01:37:44.973105+0000","last_became_active":"2024-09-12T01:37:44.971330+0000","last_became_peered":"2024-09-12T01:37:44.971330+0000","last_unstale":"2024-09-12T01:37:44.973105+0000","last_undegraded":"2024-09-12T01:37:44.973105+0000","last_fullsized":"2024-09-12T01:37:44.973105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:47.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.956335+0000","last_change":"2024-09-12T01:37:44.956335+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.956335+0000","last_undegraded":"2024-09-12T01:37:44.956335+0000","last_fullsized":"2024-09-12T01:37:44.956335+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:43.935051+0000","last_change":"2024-09-12T01:37:43.935051+0000","last_active":"2024-09-12T01:37:43.935051+0000","last_peered":"2024-09-12T01:37:43.935051+0000","last_clean":"2024-09-12T01:37:43.935051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:43.935051+0000","last_undegraded":"2024-09-12T01:37:43.935051+0000","last_fullsized":"2024-09-12T01:37:43.935051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963318+0000","last_change":"2024-09-12T01:37:44.963318+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963318+0000","last_undegraded":"2024-09-12T01:37:44.963318+0000","last_fullsized":"2024-09-12T01:37:44.963318+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972851+0000","last_change":"2024-09-12T01:37:44.971685+0000","last_active":"2024-09-12T01:37:44.972851+0000","last_peered":"2024-09-12T01:37:44.972851+0000","last_clean":"2024-09-12T01:37:44.972851+0000","last_became_active":"2024-09-12T01:37:44.971412+0000","last_became_peered":"2024-09-12T01:37:44.971412+0000","last_unstale":"2024-09-12T01:37:44.972851+0000","last_undegraded":"2024-09-12T01:37:44.972851+0000","last_fullsized":"2024-09-12T01:37:44.972851+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:18.933000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962598+0000","last_change":"2024-09-12T01:37:44.962598+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962598+0000","last_undegraded":"2024-09-12T01:37:44.962598+0000","last_fullsized":"2024-09-12T01:37:44.962598+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:43.935051+0000","last_change":"2024-09-12T01:37:43.935051+0000","last_active":"2024-09-12T01:37:43.935051+0000","last_peered":"2024-09-12T01:37:43.935051+0000","last_clean":"2024-09-12T01:37:43.935051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:43.935051+0000","last_undegraded":"2024-09-12T01:37:43.935051+0000","last_fullsized":"2024-09-12T01:37:43.935051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960726+0000","last_change":"2024-09-12T01:37:44.960726+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960726+0000","last_undegraded":"2024-09-12T01:37:44.960726+0000","last_fullsized":"2024-09-12T01:37:44.960726+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.970591+0000","last_change":"2024-09-12T01:37:44.969932+0000","last_active":"2024-09-12T01:37:44.970591+0000","last_peered":"2024-09-12T01:37:44.970591+0000","last_clean":"2024-09-12T01:37:44.970591+0000","last_became_active":"2024-09-12T01:37:44.969660+0000","last_became_peered":"2024-09-12T01:37:44.969660+0000","last_unstale":"2024-09-12T01:37:44.970591+0000","last_undegraded":"2024-09-12T01:37:44.970591+0000","last_fullsized":"2024-09-12T01:37:44.970591+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:47.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955819+0000","last_change":"2024-09-12T01:37:44.955819+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955819+0000","last_undegraded":"2024-09-12T01:37:44.955819+0000","last_fullsized":"2024-09-12T01:37:44.955819+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:43.935051+0000","last_change":"2024-09-12T01:37:43.935051+0000","last_active":"2024-09-12T01:37:43.935051+0000","last_peered":"2024-09-12T01:37:43.935051+0000","last_clean":"2024-09-12T01:37:43.935051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:43.935051+0000","last_undegraded":"2024-09-12T01:37:43.935051+0000","last_fullsized":"2024-09-12T01:37:43.935051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961847+0000","last_change":"2024-09-12T01:37:44.961847+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961847+0000","last_undegraded":"2024-09-12T01:37:44.961847+0000","last_fullsized":"2024-09-12T01:37:44.961847+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969414+0000","last_change":"2024-09-12T01:37:44.966599+0000","last_active":"2024-09-12T01:37:44.969414+0000","last_peered":"2024-09-12T01:37:44.969414+0000","last_clean":"2024-09-12T01:37:44.969414+0000","last_became_active":"2024-09-12T01:37:44.966307+0000","last_became_peered":"2024-09-12T01:37:44.966307+0000","last_unstale":"2024-09-12T01:37:44.969414+0000","last_undegraded":"2024-09-12T01:37:44.969414+0000","last_fullsized":"2024-09-12T01:37:44.969414+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.034249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958973+0000","last_change":"2024-09-12T01:37:44.958973+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958973+0000","last_undegraded":"2024-09-12T01:37:44.958973+0000","last_fullsized":"2024-09-12T01:37:44.958973+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.970105+0000","last_change":"2024-09-12T01:37:44.969334+0000","last_active":"2024-09-12T01:37:44.970105+0000","last_peered":"2024-09-12T01:37:44.970105+0000","last_clean":"2024-09-12T01:37:44.970105+0000","last_became_active":"2024-09-12T01:37:44.969042+0000","last_became_peered":"2024-09-12T01:37:44.969042+0000","last_unstale":"2024-09-12T01:37:44.970105+0000","last_undegraded":"2024-09-12T01:37:44.970105+0000","last_fullsized":"2024-09-12T01:37:44.970105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:09.882425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958352+0000","last_change":"2024-09-12T01:37:44.958352+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958352+0000","last_undegraded":"2024-09-12T01:37:44.958352+0000","last_fullsized":"2024-09-12T01:37:44.958352+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.975211+0000","last_change":"2024-09-12T01:37:44.974432+0000","last_active":"2024-09-12T01:37:44.975211+0000","last_peered":"2024-09-12T01:37:44.975211+0000","last_clean":"2024-09-12T01:37:44.975211+0000","last_became_active":"2024-09-12T01:37:44.974089+0000","last_became_peered":"2024-09-12T01:37:44.974089+0000","last_unstale":"2024-09-12T01:37:44.975211+0000","last_undegraded":"2024-09-12T01:37:44.975211+0000","last_fullsized":"2024-09-12T01:37:44.975211+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:09.882425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954331+0000","last_change":"2024-09-12T01:37:44.954331+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954331+0000","last_undegraded":"2024-09-12T01:37:44.954331+0000","last_fullsized":"2024-09-12T01:37:44.954331+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:43.935051+0000","last_change":"2024-09-12T01:37:43.935051+0000","last_active":"2024-09-12T01:37:43.935051+0000","last_peered":"2024-09-12T01:37:43.935051+0000","last_clean":"2024-09-12T01:37:43.935051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:43.935051+0000","last_undegraded":"2024-09-12T01:37:43.935051+0000","last_fullsized":"2024-09-12T01:37:43.935051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958438+0000","last_change":"2024-09-12T01:37:44.958438+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958438+0000","last_undegraded":"2024-09-12T01:37:44.958438+0000","last_fullsized":"2024-09-12T01:37:44.958438+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969328+0000","last_change":"2024-09-12T01:37:44.967523+0000","last_active":"2024-09-12T01:37:44.969328+0000","last_peered":"2024-09-12T01:37:44.969328+0000","last_clean":"2024-09-12T01:37:44.969328+0000","last_became_active":"2024-09-12T01:37:44.967216+0000","last_became_peered":"2024-09-12T01:37:44.967216+0000","last_unstale":"2024-09-12T01:37:44.969328+0000","last_undegraded":"2024-09-12T01:37:44.969328+0000","last_fullsized":"2024-09-12T01:37:44.969328+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:09.882425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958540+0000","last_change":"2024-09-12T01:37:44.958540+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958540+0000","last_undegraded":"2024-09-12T01:37:44.958540+0000","last_fullsized":"2024-09-12T01:37:44.958540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.974989+0000","last_change":"2024-09-12T01:37:44.973988+0000","last_active":"2024-09-12T01:37:44.974989+0000","last_peered":"2024-09-12T01:37:44.974989+0000","last_clean":"2024-09-12T01:37:44.974989+0000","last_became_active":"2024-09-12T01:37:44.973403+0000","last_became_peered":"2024-09-12T01:37:44.973403+0000","last_unstale":"2024-09-12T01:37:44.974989+0000","last_undegraded":"2024-09-12T01:37:44.974989+0000","last_fullsized":"2024-09-12T01:37:44.974989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:38.172494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.953487+0000","last_change":"2024-09-12T01:37:44.953487+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.953487+0000","last_undegraded":"2024-09-12T01:37:44.953487+0000","last_fullsized":"2024-09-12T01:37:44.953487+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972785+0000","last_change":"2024-09-12T01:37:44.971512+0000","last_active":"2024-09-12T01:37:44.972785+0000","last_peered":"2024-09-12T01:37:44.972785+0000","last_clean":"2024-09-12T01:37:44.972785+0000","last_became_active":"2024-09-12T01:37:44.970650+0000","last_became_peered":"2024-09-12T01:37:44.970650+0000","last_unstale":"2024-09-12T01:37:44.972785+0000","last_undegraded":"2024-09-12T01:37:44.972785+0000","last_fullsized":"2024-09-12T01:37:44.972785+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.034249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961058+0000","last_change":"2024-09-12T01:37:44.961058+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961058+0000","last_undegraded":"2024-09-12T01:37:44.961058+0000","last_fullsized":"2024-09-12T01:37:44.961058+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972279+0000","last_change":"2024-09-12T01:37:44.968846+0000","last_active":"2024-09-12T01:37:44.972279+0000","last_peered":"2024-09-12T01:37:44.972279+0000","last_clean":"2024-09-12T01:37:44.972279+0000","last_became_active":"2024-09-12T01:37:44.968560+0000","last_became_peered":"2024-09-12T01:37:44.968560+0000","last_unstale":"2024-09-12T01:37:44.972279+0000","last_undegraded":"2024-09-12T01:37:44.972279+0000","last_fullsized":"2024-09-12T01:37:44.972279+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:42.461240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:43.935051+0000","last_change":"2024-09-12T01:37:43.935051+0000","last_active":"2024-09-12T01:37:43.935051+0000","last_peered":"2024-09-12T01:37:43.935051+0000","last_clean":"2024-09-12T01:37:43.935051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:43.935051+0000","last_undegraded":"2024-09-12T01:37:43.935051+0000","last_fullsized":"2024-09-12T01:37:43.935051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955372+0000","last_change":"2024-09-12T01:37:44.955372+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955372+0000","last_undegraded":"2024-09-12T01:37:44.955372+0000","last_fullsized":"2024-09-12T01:37:44.955372+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973101+0000","last_change":"2024-09-12T01:37:44.971996+0000","last_active":"2024-09-12T01:37:44.973101+0000","last_peered":"2024-09-12T01:37:44.973101+0000","last_clean":"2024-09-12T01:37:44.973101+0000","last_became_active":"2024-09-12T01:37:44.971733+0000","last_became_peered":"2024-09-12T01:37:44.971733+0000","last_unstale":"2024-09-12T01:37:44.973101+0000","last_undegraded":"2024-09-12T01:37:44.973101+0000","last_fullsized":"2024-09-12T01:37:44.973101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:09.711449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.959951+0000","last_change":"2024-09-12T01:37:44.959951+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.959951+0000","last_undegraded":"2024-09-12T01:37:44.959951+0000","last_fullsized":"2024-09-12T01:37:44.959951+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:43.935051+0000","last_change":"2024-09-12T01:37:43.935051+0000","last_active":"2024-09-12T01:37:43.935051+0000","last_peered":"2024-09-12T01:37:43.935051+0000","last_clean":"2024-09-12T01:37:43.935051+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:43.935051+0000","last_undegraded":"2024-09-12T01:37:43.935051+0000","last_fullsized":"2024-09-12T01:37:43.935051+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958660+0000","last_change":"2024-09-12T01:37:44.958660+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958660+0000","last_undegraded":"2024-09-12T01:37:44.958660+0000","last_fullsized":"2024-09-12T01:37:44.958660+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.971193+0000","last_change":"2024-09-12T01:37:44.970013+0000","last_active":"2024-09-12T01:37:44.971193+0000","last_peered":"2024-09-12T01:37:44.971193+0000","last_clean":"2024-09-12T01:37:44.971193+0000","last_became_active":"2024-09-12T01:37:44.969654+0000","last_became_peered":"2024-09-12T01:37:44.969654+0000","last_unstale":"2024-09-12T01:37:44.971193+0000","last_undegraded":"2024-09-12T01:37:44.971193+0000","last_fullsized":"2024-09-12T01:37:44.971193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:58.402489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.956256+0000","last_change":"2024-09-12T01:37:44.956256+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.956256+0000","last_undegraded":"2024-09-12T01:37:44.956256+0000","last_fullsized":"2024-09-12T01:37:44.956256+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972446+0000","last_change":"2024-09-12T01:37:44.970664+0000","last_active":"2024-09-12T01:37:44.972446+0000","last_peered":"2024-09-12T01:37:44.972446+0000","last_clean":"2024-09-12T01:37:44.972446+0000","last_became_active":"2024-09-12T01:37:44.970398+0000","last_became_peered":"2024-09-12T01:37:44.970398+0000","last_unstale":"2024-09-12T01:37:44.972446+0000","last_undegraded":"2024-09-12T01:37:44.972446+0000","last_fullsized":"2024-09-12T01:37:44.972446+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:47.940491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.975234+0000","last_change":"2024-09-12T01:37:44.974675+0000","last_active":"2024-09-12T01:37:44.975234+0000","last_peered":"2024-09-12T01:37:44.975234+0000","last_clean":"2024-09-12T01:37:44.975234+0000","last_became_active":"2024-09-12T01:37:44.974293+0000","last_became_peered":"2024-09-12T01:37:44.974293+0000","last_unstale":"2024-09-12T01:37:44.975234+0000","last_undegraded":"2024-09-12T01:37:44.975234+0000","last_fullsized":"2024-09-12T01:37:44.975234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:09.321760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955245+0000","last_change":"2024-09-12T01:37:44.955245+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955245+0000","last_undegraded":"2024-09-12T01:37:44.955245+0000","last_fullsized":"2024-09-12T01:37:44.955245+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972191+0000","last_change":"2024-09-12T01:37:44.970246+0000","last_active":"2024-09-12T01:37:44.972191+0000","last_peered":"2024-09-12T01:37:44.972191+0000","last_clean":"2024-09-12T01:37:44.972191+0000","last_became_active":"2024-09-12T01:37:44.969914+0000","last_became_peered":"2024-09-12T01:37:44.969914+0000","last_unstale":"2024-09-12T01:37:44.972191+0000","last_undegraded":"2024-09-12T01:37:44.972191+0000","last_fullsized":"2024-09-12T01:37:44.972191+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:18.933000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:37:44.940932+0000","last_change":"2024-09-12T01:37:44.940932+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.940932+0000","last_undegraded":"2024-09-12T01:37:44.940932+0000","last_fullsized":"2024-09-12T01:37:44.940932+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973096+0000","last_change":"2024-09-12T01:37:44.970613+0000","last_active":"2024-09-12T01:37:44.973096+0000","last_peered":"2024-09-12T01:37:44.973096+0000","last_clean":"2024-09-12T01:37:44.973096+0000","last_became_active":"2024-09-12T01:37:44.970284+0000","last_became_peered":"2024-09-12T01:37:44.970284+0000","last_unstale":"2024-09-12T01:37:44.973096+0000","last_undegraded":"2024-09-12T01:37:44.973096+0000","last_fullsized":"2024-09-12T01:37:44.973096+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:47.940491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962345+0000","last_change":"2024-09-12T01:37:44.962345+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962345+0000","last_undegraded":"2024-09-12T01:37:44.962345+0000","last_fullsized":"2024-09-12T01:37:44.962345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.965660+0000","last_change":"2024-09-12T01:37:44.964928+0000","last_active":"2024-09-12T01:37:44.965660+0000","last_peered":"2024-09-12T01:37:44.965660+0000","last_clean":"2024-09-12T01:37:44.965660+0000","last_became_active":"2024-09-12T01:37:44.964539+0000","last_became_peered":"2024-09-12T01:37:44.964539+0000","last_unstale":"2024-09-12T01:37:44.965660+0000","last_undegraded":"2024-09-12T01:37:44.965660+0000","last_fullsized":"2024-09-12T01:37:44.965660+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:16.673738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963231+0000","last_change":"2024-09-12T01:37:44.963231+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963231+0000","last_undegraded":"2024-09-12T01:37:44.963231+0000","last_fullsized":"2024-09-12T01:37:44.963231+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.968975+0000","last_change":"2024-09-12T01:37:44.962377+0000","last_active":"2024-09-12T01:37:44.968975+0000","last_peered":"2024-09-12T01:37:44.968975+0000","last_clean":"2024-09-12T01:37:44.968975+0000","last_became_active":"2024-09-12T01:37:44.962116+0000","last_became_peered":"2024-09-12T01:37:44.962116+0000","last_unstale":"2024-09-12T01:37:44.968975+0000","last_undegraded":"2024-09-12T01:37:44.968975+0000","last_fullsized":"2024-09-12T01:37:44.968975+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:24.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.953494+0000","last_change":"2024-09-12T01:37:44.953494+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.953494+0000","last_undegraded":"2024-09-12T01:37:44.953494+0000","last_fullsized":"2024-09-12T01:37:44.953494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.968870+0000","last_change":"2024-09-12T01:37:44.965413+0000","last_active":"2024-09-12T01:37:44.968870+0000","last_peered":"2024-09-12T01:37:44.968870+0000","last_clean":"2024-09-12T01:37:44.968870+0000","last_became_active":"2024-09-12T01:37:44.965122+0000","last_became_peered":"2024-09-12T01:37:44.965122+0000","last_unstale":"2024-09-12T01:37:44.968870+0000","last_undegraded":"2024-09-12T01:37:44.968870+0000","last_fullsized":"2024-09-12T01:37:44.968870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:37.749845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960345+0000","last_change":"2024-09-12T01:37:44.960345+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960345+0000","last_undegraded":"2024-09-12T01:37:44.960345+0000","last_fullsized":"2024-09-12T01:37:44.960345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969737+0000","last_change":"2024-09-12T01:37:44.968753+0000","last_active":"2024-09-12T01:37:44.969737+0000","last_peered":"2024-09-12T01:37:44.969737+0000","last_clean":"2024-09-12T01:37:44.969737+0000","last_became_active":"2024-09-12T01:37:44.968465+0000","last_became_peered":"2024-09-12T01:37:44.968465+0000","last_unstale":"2024-09-12T01:37:44.969737+0000","last_undegraded":"2024-09-12T01:37:44.969737+0000","last_fullsized":"2024-09-12T01:37:44.969737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:55.452436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":209,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.967587+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:37:44.967587+0000","last_peered":"2024-09-12T01:37:44.967587+0000","last_clean":"2024-09-12T01:37:44.967587+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:37:44.967587+0000","last_undegraded":"2024-09-12T01:37:44.967587+0000","last_fullsized":"2024-09-12T01:37:44.967587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509467,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":783968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":790243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31660,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":483328,"data_stored":187783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:37:50.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:37:50.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.442+0000 7fe7137e4640 1 Processor -- start 2024-09-12T01:37:50.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.442+0000 7fe7137e4640 1 -- start start 2024-09-12T01:37:50.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.443+0000 7fe7137e4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe70c15e950 0x7fe70c06ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.443+0000 7fe7137e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe70c0735b0 0x7fe70c06d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.443+0000 7fe7137e4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe70c06faf0 con 0x7fe70c072050 2024-09-12T01:37:50.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.443+0000 7fe7137e4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe70c06fdd0 con 0x7fe70c15e950 2024-09-12T01:37:50.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.443+0000 7fe7137e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe70c0700b0 con 0x7fe70c0735b0 2024-09-12T01:37:50.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.443+0000 7fe710d7f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe70c0735b0 0x7fe70c06d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.443+0000 7fe711580640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe70c15e950 0x7fe70c06ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.443+0000 7fe710d7f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe70c0735b0 0x7fe70c06d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:43022/0 (socket says 172.21.15.60:43022) 2024-09-12T01:37:50.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.443+0000 7fe711580640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe70c15e950 0x7fe70c06ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39042/0 (socket says 172.21.15.60:39042) 2024-09-12T01:37:50.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.443+0000 7fe710d7f640 1 -- 172.21.15.60:0/3011700621 learned_addr learned my addr 172.21.15.60:0/3011700621 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:50.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.443+0000 7fe711d81640 1 --1- 172.21.15.60:0/3011700621 >> v1:172.21.15.105:6789/0 conn(0x7fe70c072050 0x7fe70c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:58284/0 (socket says 172.21.15.60:58284) 2024-09-12T01:37:50.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.444+0000 7fe710d7f640 1 -- 172.21.15.60:0/3011700621 >> v2:172.21.15.105:3300/0 conn(0x7fe70c15e950 msgr2=0x7fe70c06ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:50.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.444+0000 7fe710d7f640 1 --2- 172.21.15.60:0/3011700621 >> v2:172.21.15.105:3300/0 conn(0x7fe70c15e950 0x7fe70c06ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.444+0000 7fe710d7f640 1 -- 172.21.15.60:0/3011700621 >> v1:172.21.15.105:6789/0 conn(0x7fe70c072050 legacy=0x7fe70c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.444+0000 7fe70bfff640 1 -- 172.21.15.60:0/3011700621 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405028678 0 0) 0x7fe70c06faf0 con 0x7fe70c072050 2024-09-12T01:37:50.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.444+0000 7fe710d7f640 1 -- 172.21.15.60:0/3011700621 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70c070390 con 0x7fe70c0735b0 2024-09-12T01:37:50.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.444+0000 7fe711580640 1 --2- 172.21.15.60:0/3011700621 >> v2:172.21.15.105:3300/0 conn(0x7fe70c15e950 0x7fe70c06ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:37:50.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.445+0000 7fe710d7f640 1 --2- 172.21.15.60:0/3011700621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe70c0735b0 0x7fe70c06d370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe700009870 tx=0x7fe70002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9d80f1608300e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:50.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.445+0000 7fe70bfff640 1 -- 172.21.15.60:0/3011700621 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700037070 con 0x7fe70c0735b0 2024-09-12T01:37:50.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.445+0000 7fe70bfff640 1 -- 172.21.15.60:0/3011700621 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe700032440 con 0x7fe70c0735b0 2024-09-12T01:37:50.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.445+0000 7fe70bfff640 1 -- 172.21.15.60:0/3011700621 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700032810 con 0x7fe70c0735b0 2024-09-12T01:37:50.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.445+0000 7fe7137e4640 1 -- 172.21.15.60:0/3011700621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe70c0735b0 msgr2=0x7fe70c06d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.445+0000 7fe7137e4640 1 --2- 172.21.15.60:0/3011700621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe70c0735b0 0x7fe70c06d370 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe700009870 tx=0x7fe70002a270 comp rx=0 tx=0).stop 2024-09-12T01:37:50.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.445+0000 7fe7137e4640 1 -- 172.21.15.60:0/3011700621 shutdown_connections 2024-09-12T01:37:50.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.445+0000 7fe7137e4640 1 --2- 172.21.15.60:0/3011700621 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe70c0735b0 0x7fe70c06d370 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.445+0000 7fe7137e4640 1 --2- 172.21.15.60:0/3011700621 >> v2:172.21.15.105:3300/0 conn(0x7fe70c15e950 0x7fe70c06ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.445+0000 7fe7137e4640 1 -- 172.21.15.60:0/3011700621 >> 172.21.15.60:0/3011700621 conn(0x7fe70c0d14d0 msgr2=0x7fe70c0d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:50.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.445+0000 7fe7137e4640 1 -- 172.21.15.60:0/3011700621 shutdown_connections 2024-09-12T01:37:50.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.445+0000 7fe7137e4640 1 -- 172.21.15.60:0/3011700621 wait complete. 2024-09-12T01:37:50.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.447+0000 7fe7137e4640 1 Processor -- start 2024-09-12T01:37:50.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.447+0000 7fe7137e4640 1 -- start start 2024-09-12T01:37:50.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.447+0000 7fe7137e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe70c072050 0x7fe70c14b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.447+0000 7fe7137e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe70c0735b0 0x7fe70c157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.447+0000 7fe7137e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe70c15e950 0x7fe70c15a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.447+0000 7fe7137e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c0d0230 con 0x7fe70c072050 2024-09-12T01:37:50.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.447+0000 7fe7137e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe70c0d00b0 con 0x7fe70c0735b0 2024-09-12T01:37:50.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.447+0000 7fe7137e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe70c0d03b0 con 0x7fe70c15e950 2024-09-12T01:37:50.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.447+0000 7fe711580640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe70c072050 0x7fe70c14b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.447+0000 7fe711580640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe70c072050 0x7fe70c14b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51998/0 (socket says 172.21.15.60:51998) 2024-09-12T01:37:50.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe711580640 1 -- 172.21.15.60:0/3857845708 learned_addr learned my addr 172.21.15.60:0/3857845708 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:50.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe711d81640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe70c15e950 0x7fe70c15a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe710d7f640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe70c0735b0 0x7fe70c157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe711580640 1 -- 172.21.15.60:0/3857845708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe70c15e950 msgr2=0x7fe70c15a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe711580640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe70c15e950 0x7fe70c15a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe711580640 1 -- 172.21.15.60:0/3857845708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe70c0735b0 msgr2=0x7fe70c157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe711580640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe70c0735b0 0x7fe70c157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe711580640 1 -- 172.21.15.60:0/3857845708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70c159740 con 0x7fe70c072050 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe711580640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe70c072050 0x7fe70c14b010 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00efc0 tx=0x7fe6fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe709ffb640 1 -- 172.21.15.60:0/3857845708 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc018020 con 0x7fe70c072050 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe709ffb640 1 -- 172.21.15.60:0/3857845708 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6fc014680 con 0x7fe70c072050 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe7137e4640 1 -- 172.21.15.60:0/3857845708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70c159180 con 0x7fe70c072050 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe709ffb640 1 -- 172.21.15.60:0/3857845708 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc014a50 con 0x7fe70c072050 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.448+0000 7fe7137e4640 1 -- 172.21.15.60:0/3857845708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe70c155090 con 0x7fe70c072050 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.449+0000 7fe7137e4640 1 -- 172.21.15.60:0/3857845708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe70c06ce30 con 0x7fe70c072050 2024-09-12T01:37:50.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.450+0000 7fe709ffb640 1 -- 172.21.15.60:0/3857845708 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe6fc005d10 con 0x7fe70c072050 2024-09-12T01:37:50.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.450+0000 7fe709ffb640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe6f806be30 0x7fe6f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.450+0000 7fe709ffb640 1 -- 172.21.15.60:0/3857845708 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fe6fc08bbd0 con 0x7fe70c072050 2024-09-12T01:37:50.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.451+0000 7fe710d7f640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe6f806be30 0x7fe6f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.451+0000 7fe710d7f640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe6f806be30 0x7fe6f806e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe700034000 tx=0x7fe70002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:50.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.455+0000 7fe709ffb640 1 -- 172.21.15.60:0/3857845708 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe6fc022030 con 0x7fe70c072050 2024-09-12T01:37:50.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.627+0000 7fe7137e4640 1 -- 172.21.15.60:0/3857845708 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe70c0b3d90 con 0x7fe6f806be30 2024-09-12T01:37:50.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.633+0000 7fe709ffb640 1 -- 172.21.15.60:0/3857845708 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247249 (secure 0 0 0) 0x7fe70c0b3d90 con 0x7fe6f806be30 2024-09-12T01:37:50.635 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:50.636 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:37:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.636+0000 7fe7137e4640 1 -- 172.21.15.60:0/3857845708 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe6f806be30 msgr2=0x7fe6f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.636+0000 7fe7137e4640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe6f806be30 0x7fe6f806e2f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe700034000 tx=0x7fe70002e000 comp rx=0 tx=0).stop 2024-09-12T01:37:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.636+0000 7fe7137e4640 1 -- 172.21.15.60:0/3857845708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe70c072050 msgr2=0x7fe70c14b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.636+0000 7fe7137e4640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe70c072050 0x7fe70c14b010 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00efc0 tx=0x7fe6fc00c490 comp rx=0 tx=0).stop 2024-09-12T01:37:50.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.636+0000 7fe7137e4640 1 -- 172.21.15.60:0/3857845708 shutdown_connections 2024-09-12T01:37:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.636+0000 7fe7137e4640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe6f806be30 0x7fe6f806e2f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.636+0000 7fe7137e4640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe70c15e950 0x7fe70c15a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.636+0000 7fe7137e4640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe70c0735b0 0x7fe70c157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.636+0000 7fe7137e4640 1 --2- 172.21.15.60:0/3857845708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe70c072050 0x7fe70c14b010 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.636+0000 7fe7137e4640 1 -- 172.21.15.60:0/3857845708 >> 172.21.15.60:0/3857845708 conn(0x7fe70c0d14d0 msgr2=0x7fe70c0b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.636+0000 7fe7137e4640 1 -- 172.21.15.60:0/3857845708 shutdown_connections 2024-09-12T01:37:50.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.636+0000 7fe7137e4640 1 -- 172.21.15.60:0/3857845708 wait complete. 2024-09-12T01:37:50.646 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-09-12T01:37:50.285386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246364,"kb_used_data":5160,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754728356,"statfs":{"total":773094113280,"available":772841836544,"internally_reserved":0,"allocated":5283840,"data_stored":2788240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001071"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963264+0000","last_change":"2024-09-12T01:37:44.963264+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963264+0000","last_undegraded":"2024-09-12T01:37:44.963264+0000","last_fullsized":"2024-09-12T01:37:44.963264+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955766+0000","last_change":"2024-09-12T01:37:44.955766+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955766+0000","last_undegraded":"2024-09-12T01:37:44.955766+0000","last_fullsized":"2024-09-12T01:37:44.955766+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962486+0000","last_change":"2024-09-12T01:37:44.962486+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962486+0000","last_undegraded":"2024-09-12T01:37:44.962486+0000","last_fullsized":"2024-09-12T01:37:44.962486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961519+0000","last_change":"2024-09-12T01:37:44.961519+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961519+0000","last_undegraded":"2024-09-12T01:37:44.961519+0000","last_fullsized":"2024-09-12T01:37:44.961519+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960619+0000","last_change":"2024-09-12T01:37:44.960619+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960619+0000","last_undegraded":"2024-09-12T01:37:44.960619+0000","last_fullsized":"2024-09-12T01:37:44.960619+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.953689+0000","last_change":"2024-09-12T01:37:44.953689+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.953689+0000","last_undegraded":"2024-09-12T01:37:44.953689+0000","last_fullsized":"2024-09-12T01:37:44.953689+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.957441+0000","last_change":"2024-09-12T01:37:44.957441+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.957441+0000","last_undegraded":"2024-09-12T01:37:44.957441+0000","last_fullsized":"2024-09-12T01:37:44.957441+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962521+0000","last_change":"2024-09-12T01:37:44.962521+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962521+0000","last_undegraded":"2024-09-12T01:37:44.962521+0000","last_fullsized":"2024-09-12T01:37:44.962521+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954510+0000","last_change":"2024-09-12T01:37:44.954510+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954510+0000","last_undegraded":"2024-09-12T01:37:44.954510+0000","last_fullsized":"2024-09-12T01:37:44.954510+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966202+0000","last_change":"2024-09-12T01:37:45.978987+0000","last_active":"2024-09-12T01:37:46.966202+0000","last_peered":"2024-09-12T01:37:46.966202+0000","last_clean":"2024-09-12T01:37:46.966202+0000","last_became_active":"2024-09-12T01:37:45.978701+0000","last_became_peered":"2024-09-12T01:37:45.978701+0000","last_unstale":"2024-09-12T01:37:46.966202+0000","last_undegraded":"2024-09-12T01:37:46.966202+0000","last_fullsized":"2024-09-12T01:37:46.966202+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:31.220991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961685+0000","last_change":"2024-09-12T01:37:44.961685+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961685+0000","last_undegraded":"2024-09-12T01:37:44.961685+0000","last_fullsized":"2024-09-12T01:37:44.961685+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955145+0000","last_change":"2024-09-12T01:37:44.955145+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955145+0000","last_undegraded":"2024-09-12T01:37:44.955145+0000","last_fullsized":"2024-09-12T01:37:44.955145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955869+0000","last_change":"2024-09-12T01:37:44.955869+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955869+0000","last_undegraded":"2024-09-12T01:37:44.955869+0000","last_fullsized":"2024-09-12T01:37:44.955869+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961968+0000","last_change":"2024-09-12T01:37:44.961968+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961968+0000","last_undegraded":"2024-09-12T01:37:44.961968+0000","last_fullsized":"2024-09-12T01:37:44.961968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962634+0000","last_change":"2024-09-12T01:37:44.962634+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962634+0000","last_undegraded":"2024-09-12T01:37:44.962634+0000","last_fullsized":"2024-09-12T01:37:44.962634+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.959470+0000","last_change":"2024-09-12T01:37:44.959470+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.959470+0000","last_undegraded":"2024-09-12T01:37:44.959470+0000","last_fullsized":"2024-09-12T01:37:44.959470+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954225+0000","last_change":"2024-09-12T01:37:44.954225+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954225+0000","last_undegraded":"2024-09-12T01:37:44.954225+0000","last_fullsized":"2024-09-12T01:37:44.954225+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963992+0000","last_change":"2024-09-12T01:37:44.963992+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963992+0000","last_undegraded":"2024-09-12T01:37:44.963992+0000","last_fullsized":"2024-09-12T01:37:44.963992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963241+0000","last_change":"2024-09-12T01:37:44.963241+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963241+0000","last_undegraded":"2024-09-12T01:37:44.963241+0000","last_fullsized":"2024-09-12T01:37:44.963241+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966129+0000","last_change":"2024-09-12T01:37:45.980489+0000","last_active":"2024-09-12T01:37:46.966129+0000","last_peered":"2024-09-12T01:37:46.966129+0000","last_clean":"2024-09-12T01:37:46.966129+0000","last_became_active":"2024-09-12T01:37:45.979971+0000","last_became_peered":"2024-09-12T01:37:45.979971+0000","last_unstale":"2024-09-12T01:37:46.966129+0000","last_undegraded":"2024-09-12T01:37:46.966129+0000","last_fullsized":"2024-09-12T01:37:46.966129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:17.192041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961929+0000","last_change":"2024-09-12T01:37:44.961929+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961929+0000","last_undegraded":"2024-09-12T01:37:44.961929+0000","last_fullsized":"2024-09-12T01:37:44.961929+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958375+0000","last_change":"2024-09-12T01:37:44.958375+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958375+0000","last_undegraded":"2024-09-12T01:37:44.958375+0000","last_fullsized":"2024-09-12T01:37:44.958375+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955012+0000","last_change":"2024-09-12T01:37:44.955012+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955012+0000","last_undegraded":"2024-09-12T01:37:44.955012+0000","last_fullsized":"2024-09-12T01:37:44.955012+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954255+0000","last_change":"2024-09-12T01:37:44.954255+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954255+0000","last_undegraded":"2024-09-12T01:37:44.954255+0000","last_fullsized":"2024-09-12T01:37:44.954255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961974+0000","last_change":"2024-09-12T01:37:44.961974+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961974+0000","last_undegraded":"2024-09-12T01:37:44.961974+0000","last_fullsized":"2024-09-12T01:37:44.961974+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961110+0000","last_change":"2024-09-12T01:37:44.961110+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961110+0000","last_undegraded":"2024-09-12T01:37:44.961110+0000","last_fullsized":"2024-09-12T01:37:44.961110+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.956717+0000","last_change":"2024-09-12T01:37:44.956717+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.956717+0000","last_undegraded":"2024-09-12T01:37:44.956717+0000","last_fullsized":"2024-09-12T01:37:44.956717+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954907+0000","last_change":"2024-09-12T01:37:44.954907+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954907+0000","last_undegraded":"2024-09-12T01:37:44.954907+0000","last_fullsized":"2024-09-12T01:37:44.954907+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960158+0000","last_change":"2024-09-12T01:37:44.960158+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960158+0000","last_undegraded":"2024-09-12T01:37:44.960158+0000","last_fullsized":"2024-09-12T01:37:44.960158+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954672+0000","last_change":"2024-09-12T01:37:44.954672+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954672+0000","last_undegraded":"2024-09-12T01:37:44.954672+0000","last_fullsized":"2024-09-12T01:37:44.954672+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954289+0000","last_change":"2024-09-12T01:37:44.954289+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954289+0000","last_undegraded":"2024-09-12T01:37:44.954289+0000","last_fullsized":"2024-09-12T01:37:44.954289+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962063+0000","last_change":"2024-09-12T01:37:44.962063+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962063+0000","last_undegraded":"2024-09-12T01:37:44.962063+0000","last_fullsized":"2024-09-12T01:37:44.962063+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.959199+0000","last_change":"2024-09-12T01:37:44.959199+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.959199+0000","last_undegraded":"2024-09-12T01:37:44.959199+0000","last_fullsized":"2024-09-12T01:37:44.959199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.971959+0000","last_change":"2024-09-12T01:37:44.967687+0000","last_active":"2024-09-12T01:37:44.971959+0000","last_peered":"2024-09-12T01:37:44.971959+0000","last_clean":"2024-09-12T01:37:44.971959+0000","last_became_active":"2024-09-12T01:37:44.967371+0000","last_became_peered":"2024-09-12T01:37:44.967371+0000","last_unstale":"2024-09-12T01:37:44.971959+0000","last_undegraded":"2024-09-12T01:37:44.971959+0000","last_fullsized":"2024-09-12T01:37:44.971959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:02.837499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961540+0000","last_change":"2024-09-12T01:37:44.961540+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961540+0000","last_undegraded":"2024-09-12T01:37:44.961540+0000","last_fullsized":"2024-09-12T01:37:44.961540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.965257+0000","last_change":"2024-09-12T01:37:44.961291+0000","last_active":"2024-09-12T01:37:44.965257+0000","last_peered":"2024-09-12T01:37:44.965257+0000","last_clean":"2024-09-12T01:37:44.965257+0000","last_became_active":"2024-09-12T01:37:44.960579+0000","last_became_peered":"2024-09-12T01:37:44.960579+0000","last_unstale":"2024-09-12T01:37:44.965257+0000","last_undegraded":"2024-09-12T01:37:44.965257+0000","last_fullsized":"2024-09-12T01:37:44.965257+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:32.455115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954243+0000","last_change":"2024-09-12T01:37:44.954243+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954243+0000","last_undegraded":"2024-09-12T01:37:44.954243+0000","last_fullsized":"2024-09-12T01:37:44.954243+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972368+0000","last_change":"2024-09-12T01:37:44.970297+0000","last_active":"2024-09-12T01:37:44.972368+0000","last_peered":"2024-09-12T01:37:44.972368+0000","last_clean":"2024-09-12T01:37:44.972368+0000","last_became_active":"2024-09-12T01:37:44.969412+0000","last_became_peered":"2024-09-12T01:37:44.969412+0000","last_unstale":"2024-09-12T01:37:44.972368+0000","last_undegraded":"2024-09-12T01:37:44.972368+0000","last_fullsized":"2024-09-12T01:37:44.972368+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:04.222028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961206+0000","last_change":"2024-09-12T01:37:44.961206+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961206+0000","last_undegraded":"2024-09-12T01:37:44.961206+0000","last_fullsized":"2024-09-12T01:37:44.961206+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.964069+0000","last_change":"2024-09-12T01:37:44.960326+0000","last_active":"2024-09-12T01:37:44.964069+0000","last_peered":"2024-09-12T01:37:44.964069+0000","last_clean":"2024-09-12T01:37:44.964069+0000","last_became_active":"2024-09-12T01:37:44.960035+0000","last_became_peered":"2024-09-12T01:37:44.960035+0000","last_unstale":"2024-09-12T01:37:44.964069+0000","last_undegraded":"2024-09-12T01:37:44.964069+0000","last_fullsized":"2024-09-12T01:37:44.964069+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:35.165479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955662+0000","last_change":"2024-09-12T01:37:44.955662+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955662+0000","last_undegraded":"2024-09-12T01:37:44.955662+0000","last_fullsized":"2024-09-12T01:37:44.955662+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969065+0000","last_change":"2024-09-12T01:37:44.963126+0000","last_active":"2024-09-12T01:37:44.969065+0000","last_peered":"2024-09-12T01:37:44.969065+0000","last_clean":"2024-09-12T01:37:44.969065+0000","last_became_active":"2024-09-12T01:37:44.962716+0000","last_became_peered":"2024-09-12T01:37:44.962716+0000","last_unstale":"2024-09-12T01:37:44.969065+0000","last_undegraded":"2024-09-12T01:37:44.969065+0000","last_fullsized":"2024-09-12T01:37:44.969065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:23.617585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965845+0000","last_change":"2024-09-12T01:37:45.979316+0000","last_active":"2024-09-12T01:37:46.965845+0000","last_peered":"2024-09-12T01:37:46.965845+0000","last_clean":"2024-09-12T01:37:46.965845+0000","last_became_active":"2024-09-12T01:37:45.979057+0000","last_became_peered":"2024-09-12T01:37:45.979057+0000","last_unstale":"2024-09-12T01:37:46.965845+0000","last_undegraded":"2024-09-12T01:37:46.965845+0000","last_fullsized":"2024-09-12T01:37:46.965845+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:53.791353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973377+0000","last_change":"2024-09-12T01:37:44.971445+0000","last_active":"2024-09-12T01:37:44.973377+0000","last_peered":"2024-09-12T01:37:44.973377+0000","last_clean":"2024-09-12T01:37:44.973377+0000","last_became_active":"2024-09-12T01:37:44.971101+0000","last_became_peered":"2024-09-12T01:37:44.971101+0000","last_unstale":"2024-09-12T01:37:44.973377+0000","last_undegraded":"2024-09-12T01:37:44.973377+0000","last_fullsized":"2024-09-12T01:37:44.973377+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:20.679198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965690+0000","last_change":"2024-09-12T01:37:45.978821+0000","last_active":"2024-09-12T01:37:46.965690+0000","last_peered":"2024-09-12T01:37:46.965690+0000","last_clean":"2024-09-12T01:37:46.965690+0000","last_became_active":"2024-09-12T01:37:45.978351+0000","last_became_peered":"2024-09-12T01:37:45.978351+0000","last_unstale":"2024-09-12T01:37:46.965690+0000","last_undegraded":"2024-09-12T01:37:46.965690+0000","last_fullsized":"2024-09-12T01:37:46.965690+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973105+0000","last_change":"2024-09-12T01:37:44.971595+0000","last_active":"2024-09-12T01:37:44.973105+0000","last_peered":"2024-09-12T01:37:44.973105+0000","last_clean":"2024-09-12T01:37:44.973105+0000","last_became_active":"2024-09-12T01:37:44.971330+0000","last_became_peered":"2024-09-12T01:37:44.971330+0000","last_unstale":"2024-09-12T01:37:44.973105+0000","last_undegraded":"2024-09-12T01:37:44.973105+0000","last_fullsized":"2024-09-12T01:37:44.973105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:47.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.956335+0000","last_change":"2024-09-12T01:37:44.956335+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.956335+0000","last_undegraded":"2024-09-12T01:37:44.956335+0000","last_fullsized":"2024-09-12T01:37:44.956335+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965453+0000","last_change":"2024-09-12T01:37:44.965704+0000","last_active":"2024-09-12T01:37:46.965453+0000","last_peered":"2024-09-12T01:37:46.965453+0000","last_clean":"2024-09-12T01:37:46.965453+0000","last_became_active":"2024-09-12T01:37:44.965433+0000","last_became_peered":"2024-09-12T01:37:44.965433+0000","last_unstale":"2024-09-12T01:37:46.965453+0000","last_undegraded":"2024-09-12T01:37:46.965453+0000","last_fullsized":"2024-09-12T01:37:46.965453+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:42.232596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963318+0000","last_change":"2024-09-12T01:37:44.963318+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963318+0000","last_undegraded":"2024-09-12T01:37:44.963318+0000","last_fullsized":"2024-09-12T01:37:44.963318+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972851+0000","last_change":"2024-09-12T01:37:44.971685+0000","last_active":"2024-09-12T01:37:44.972851+0000","last_peered":"2024-09-12T01:37:44.972851+0000","last_clean":"2024-09-12T01:37:44.972851+0000","last_became_active":"2024-09-12T01:37:44.971412+0000","last_became_peered":"2024-09-12T01:37:44.971412+0000","last_unstale":"2024-09-12T01:37:44.972851+0000","last_undegraded":"2024-09-12T01:37:44.972851+0000","last_fullsized":"2024-09-12T01:37:44.972851+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:18.933000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962598+0000","last_change":"2024-09-12T01:37:44.962598+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962598+0000","last_undegraded":"2024-09-12T01:37:44.962598+0000","last_fullsized":"2024-09-12T01:37:44.962598+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966211+0000","last_change":"2024-09-12T01:37:44.970742+0000","last_active":"2024-09-12T01:37:46.966211+0000","last_peered":"2024-09-12T01:37:46.966211+0000","last_clean":"2024-09-12T01:37:46.966211+0000","last_became_active":"2024-09-12T01:37:44.969993+0000","last_became_peered":"2024-09-12T01:37:44.969993+0000","last_unstale":"2024-09-12T01:37:46.966211+0000","last_undegraded":"2024-09-12T01:37:46.966211+0000","last_fullsized":"2024-09-12T01:37:46.966211+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:51.678899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960726+0000","last_change":"2024-09-12T01:37:44.960726+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960726+0000","last_undegraded":"2024-09-12T01:37:44.960726+0000","last_fullsized":"2024-09-12T01:37:44.960726+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.970591+0000","last_change":"2024-09-12T01:37:44.969932+0000","last_active":"2024-09-12T01:37:44.970591+0000","last_peered":"2024-09-12T01:37:44.970591+0000","last_clean":"2024-09-12T01:37:44.970591+0000","last_became_active":"2024-09-12T01:37:44.969660+0000","last_became_peered":"2024-09-12T01:37:44.969660+0000","last_unstale":"2024-09-12T01:37:44.970591+0000","last_undegraded":"2024-09-12T01:37:44.970591+0000","last_fullsized":"2024-09-12T01:37:44.970591+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:47.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955819+0000","last_change":"2024-09-12T01:37:44.955819+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955819+0000","last_undegraded":"2024-09-12T01:37:44.955819+0000","last_fullsized":"2024-09-12T01:37:44.955819+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966245+0000","last_change":"2024-09-12T01:37:44.961045+0000","last_active":"2024-09-12T01:37:46.966245+0000","last_peered":"2024-09-12T01:37:46.966245+0000","last_clean":"2024-09-12T01:37:46.966245+0000","last_became_active":"2024-09-12T01:37:44.960234+0000","last_became_peered":"2024-09-12T01:37:44.960234+0000","last_unstale":"2024-09-12T01:37:46.966245+0000","last_undegraded":"2024-09-12T01:37:46.966245+0000","last_fullsized":"2024-09-12T01:37:46.966245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:07.399927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961847+0000","last_change":"2024-09-12T01:37:44.961847+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961847+0000","last_undegraded":"2024-09-12T01:37:44.961847+0000","last_fullsized":"2024-09-12T01:37:44.961847+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969414+0000","last_change":"2024-09-12T01:37:44.966599+0000","last_active":"2024-09-12T01:37:44.969414+0000","last_peered":"2024-09-12T01:37:44.969414+0000","last_clean":"2024-09-12T01:37:44.969414+0000","last_became_active":"2024-09-12T01:37:44.966307+0000","last_became_peered":"2024-09-12T01:37:44.966307+0000","last_unstale":"2024-09-12T01:37:44.969414+0000","last_undegraded":"2024-09-12T01:37:44.969414+0000","last_fullsized":"2024-09-12T01:37:44.969414+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.034249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958973+0000","last_change":"2024-09-12T01:37:44.958973+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958973+0000","last_undegraded":"2024-09-12T01:37:44.958973+0000","last_fullsized":"2024-09-12T01:37:44.958973+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.970105+0000","last_change":"2024-09-12T01:37:44.969334+0000","last_active":"2024-09-12T01:37:44.970105+0000","last_peered":"2024-09-12T01:37:44.970105+0000","last_clean":"2024-09-12T01:37:44.970105+0000","last_became_active":"2024-09-12T01:37:44.969042+0000","last_became_peered":"2024-09-12T01:37:44.969042+0000","last_unstale":"2024-09-12T01:37:44.970105+0000","last_undegraded":"2024-09-12T01:37:44.970105+0000","last_fullsized":"2024-09-12T01:37:44.970105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:09.882425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958352+0000","last_change":"2024-09-12T01:37:44.958352+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958352+0000","last_undegraded":"2024-09-12T01:37:44.958352+0000","last_fullsized":"2024-09-12T01:37:44.958352+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.975211+0000","last_change":"2024-09-12T01:37:44.974432+0000","last_active":"2024-09-12T01:37:44.975211+0000","last_peered":"2024-09-12T01:37:44.975211+0000","last_clean":"2024-09-12T01:37:44.975211+0000","last_became_active":"2024-09-12T01:37:44.974089+0000","last_became_peered":"2024-09-12T01:37:44.974089+0000","last_unstale":"2024-09-12T01:37:44.975211+0000","last_undegraded":"2024-09-12T01:37:44.975211+0000","last_fullsized":"2024-09-12T01:37:44.975211+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:09.882425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954331+0000","last_change":"2024-09-12T01:37:44.954331+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954331+0000","last_undegraded":"2024-09-12T01:37:44.954331+0000","last_fullsized":"2024-09-12T01:37:44.954331+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965714+0000","last_change":"2024-09-12T01:37:44.962639+0000","last_active":"2024-09-12T01:37:46.965714+0000","last_peered":"2024-09-12T01:37:46.965714+0000","last_clean":"2024-09-12T01:37:46.965714+0000","last_became_active":"2024-09-12T01:37:44.962334+0000","last_became_peered":"2024-09-12T01:37:44.962334+0000","last_unstale":"2024-09-12T01:37:46.965714+0000","last_undegraded":"2024-09-12T01:37:46.965714+0000","last_fullsized":"2024-09-12T01:37:46.965714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:51.995342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958438+0000","last_change":"2024-09-12T01:37:44.958438+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958438+0000","last_undegraded":"2024-09-12T01:37:44.958438+0000","last_fullsized":"2024-09-12T01:37:44.958438+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969328+0000","last_change":"2024-09-12T01:37:44.967523+0000","last_active":"2024-09-12T01:37:44.969328+0000","last_peered":"2024-09-12T01:37:44.969328+0000","last_clean":"2024-09-12T01:37:44.969328+0000","last_became_active":"2024-09-12T01:37:44.967216+0000","last_became_peered":"2024-09-12T01:37:44.967216+0000","last_unstale":"2024-09-12T01:37:44.969328+0000","last_undegraded":"2024-09-12T01:37:44.969328+0000","last_fullsized":"2024-09-12T01:37:44.969328+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:09.882425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958540+0000","last_change":"2024-09-12T01:37:44.958540+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958540+0000","last_undegraded":"2024-09-12T01:37:44.958540+0000","last_fullsized":"2024-09-12T01:37:44.958540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.974989+0000","last_change":"2024-09-12T01:37:44.973988+0000","last_active":"2024-09-12T01:37:44.974989+0000","last_peered":"2024-09-12T01:37:44.974989+0000","last_clean":"2024-09-12T01:37:44.974989+0000","last_became_active":"2024-09-12T01:37:44.973403+0000","last_became_peered":"2024-09-12T01:37:44.973403+0000","last_unstale":"2024-09-12T01:37:44.974989+0000","last_undegraded":"2024-09-12T01:37:44.974989+0000","last_fullsized":"2024-09-12T01:37:44.974989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:38.172494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.953487+0000","last_change":"2024-09-12T01:37:44.953487+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.953487+0000","last_undegraded":"2024-09-12T01:37:44.953487+0000","last_fullsized":"2024-09-12T01:37:44.953487+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972785+0000","last_change":"2024-09-12T01:37:44.971512+0000","last_active":"2024-09-12T01:37:44.972785+0000","last_peered":"2024-09-12T01:37:44.972785+0000","last_clean":"2024-09-12T01:37:44.972785+0000","last_became_active":"2024-09-12T01:37:44.970650+0000","last_became_peered":"2024-09-12T01:37:44.970650+0000","last_unstale":"2024-09-12T01:37:44.972785+0000","last_undegraded":"2024-09-12T01:37:44.972785+0000","last_fullsized":"2024-09-12T01:37:44.972785+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.034249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961058+0000","last_change":"2024-09-12T01:37:44.961058+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961058+0000","last_undegraded":"2024-09-12T01:37:44.961058+0000","last_fullsized":"2024-09-12T01:37:44.961058+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972279+0000","last_change":"2024-09-12T01:37:44.968846+0000","last_active":"2024-09-12T01:37:44.972279+0000","last_peered":"2024-09-12T01:37:44.972279+0000","last_clean":"2024-09-12T01:37:44.972279+0000","last_became_active":"2024-09-12T01:37:44.968560+0000","last_became_peered":"2024-09-12T01:37:44.968560+0000","last_unstale":"2024-09-12T01:37:44.972279+0000","last_undegraded":"2024-09-12T01:37:44.972279+0000","last_fullsized":"2024-09-12T01:37:44.972279+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:42.461240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965823+0000","last_change":"2024-09-12T01:37:45.983036+0000","last_active":"2024-09-12T01:37:46.965823+0000","last_peered":"2024-09-12T01:37:46.965823+0000","last_clean":"2024-09-12T01:37:46.965823+0000","last_became_active":"2024-09-12T01:37:45.982728+0000","last_became_peered":"2024-09-12T01:37:45.982728+0000","last_unstale":"2024-09-12T01:37:46.965823+0000","last_undegraded":"2024-09-12T01:37:46.965823+0000","last_fullsized":"2024-09-12T01:37:46.965823+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:18.427659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965784+0000","last_change":"2024-09-12T01:37:44.970363+0000","last_active":"2024-09-12T01:37:46.965784+0000","last_peered":"2024-09-12T01:37:46.965784+0000","last_clean":"2024-09-12T01:37:46.965784+0000","last_became_active":"2024-09-12T01:37:44.969934+0000","last_became_peered":"2024-09-12T01:37:44.969934+0000","last_unstale":"2024-09-12T01:37:46.965784+0000","last_undegraded":"2024-09-12T01:37:46.965784+0000","last_fullsized":"2024-09-12T01:37:46.965784+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:43.133304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955372+0000","last_change":"2024-09-12T01:37:44.955372+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955372+0000","last_undegraded":"2024-09-12T01:37:44.955372+0000","last_fullsized":"2024-09-12T01:37:44.955372+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973101+0000","last_change":"2024-09-12T01:37:44.971996+0000","last_active":"2024-09-12T01:37:44.973101+0000","last_peered":"2024-09-12T01:37:44.973101+0000","last_clean":"2024-09-12T01:37:44.973101+0000","last_became_active":"2024-09-12T01:37:44.971733+0000","last_became_peered":"2024-09-12T01:37:44.971733+0000","last_unstale":"2024-09-12T01:37:44.973101+0000","last_undegraded":"2024-09-12T01:37:44.973101+0000","last_fullsized":"2024-09-12T01:37:44.973101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:09.711449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.959951+0000","last_change":"2024-09-12T01:37:44.959951+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.959951+0000","last_undegraded":"2024-09-12T01:37:44.959951+0000","last_fullsized":"2024-09-12T01:37:44.959951+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965602+0000","last_change":"2024-09-12T01:37:44.971190+0000","last_active":"2024-09-12T01:37:46.965602+0000","last_peered":"2024-09-12T01:37:46.965602+0000","last_clean":"2024-09-12T01:37:46.965602+0000","last_became_active":"2024-09-12T01:37:44.970906+0000","last_became_peered":"2024-09-12T01:37:44.970906+0000","last_unstale":"2024-09-12T01:37:46.965602+0000","last_undegraded":"2024-09-12T01:37:46.965602+0000","last_fullsized":"2024-09-12T01:37:46.965602+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:57.572375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958660+0000","last_change":"2024-09-12T01:37:44.958660+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958660+0000","last_undegraded":"2024-09-12T01:37:44.958660+0000","last_fullsized":"2024-09-12T01:37:44.958660+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.971193+0000","last_change":"2024-09-12T01:37:44.970013+0000","last_active":"2024-09-12T01:37:44.971193+0000","last_peered":"2024-09-12T01:37:44.971193+0000","last_clean":"2024-09-12T01:37:44.971193+0000","last_became_active":"2024-09-12T01:37:44.969654+0000","last_became_peered":"2024-09-12T01:37:44.969654+0000","last_unstale":"2024-09-12T01:37:44.971193+0000","last_undegraded":"2024-09-12T01:37:44.971193+0000","last_fullsized":"2024-09-12T01:37:44.971193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:58.402489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.956256+0000","last_change":"2024-09-12T01:37:44.956256+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.956256+0000","last_undegraded":"2024-09-12T01:37:44.956256+0000","last_fullsized":"2024-09-12T01:37:44.956256+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972446+0000","last_change":"2024-09-12T01:37:44.970664+0000","last_active":"2024-09-12T01:37:44.972446+0000","last_peered":"2024-09-12T01:37:44.972446+0000","last_clean":"2024-09-12T01:37:44.972446+0000","last_became_active":"2024-09-12T01:37:44.970398+0000","last_became_peered":"2024-09-12T01:37:44.970398+0000","last_unstale":"2024-09-12T01:37:44.972446+0000","last_undegraded":"2024-09-12T01:37:44.972446+0000","last_fullsized":"2024-09-12T01:37:44.972446+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:47.940491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966137+0000","last_change":"2024-09-12T01:37:45.980042+0000","last_active":"2024-09-12T01:37:46.966137+0000","last_peered":"2024-09-12T01:37:46.966137+0000","last_clean":"2024-09-12T01:37:46.966137+0000","last_became_active":"2024-09-12T01:37:45.978314+0000","last_became_peered":"2024-09-12T01:37:45.978314+0000","last_unstale":"2024-09-12T01:37:46.966137+0000","last_undegraded":"2024-09-12T01:37:46.966137+0000","last_fullsized":"2024-09-12T01:37:46.966137+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:46.861826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.975234+0000","last_change":"2024-09-12T01:37:44.974675+0000","last_active":"2024-09-12T01:37:44.975234+0000","last_peered":"2024-09-12T01:37:44.975234+0000","last_clean":"2024-09-12T01:37:44.975234+0000","last_became_active":"2024-09-12T01:37:44.974293+0000","last_became_peered":"2024-09-12T01:37:44.974293+0000","last_unstale":"2024-09-12T01:37:44.975234+0000","last_undegraded":"2024-09-12T01:37:44.975234+0000","last_fullsized":"2024-09-12T01:37:44.975234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:09.321760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955245+0000","last_change":"2024-09-12T01:37:44.955245+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955245+0000","last_undegraded":"2024-09-12T01:37:44.955245+0000","last_fullsized":"2024-09-12T01:37:44.955245+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972191+0000","last_change":"2024-09-12T01:37:44.970246+0000","last_active":"2024-09-12T01:37:44.972191+0000","last_peered":"2024-09-12T01:37:44.972191+0000","last_clean":"2024-09-12T01:37:44.972191+0000","last_became_active":"2024-09-12T01:37:44.969914+0000","last_became_peered":"2024-09-12T01:37:44.969914+0000","last_unstale":"2024-09-12T01:37:44.972191+0000","last_undegraded":"2024-09-12T01:37:44.972191+0000","last_fullsized":"2024-09-12T01:37:44.972191+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:18.933000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966003+0000","last_change":"2024-09-12T01:37:45.981676+0000","last_active":"2024-09-12T01:37:46.966003+0000","last_peered":"2024-09-12T01:37:46.966003+0000","last_clean":"2024-09-12T01:37:46.966003+0000","last_became_active":"2024-09-12T01:37:45.981323+0000","last_became_peered":"2024-09-12T01:37:45.981323+0000","last_unstale":"2024-09-12T01:37:46.966003+0000","last_undegraded":"2024-09-12T01:37:46.966003+0000","last_fullsized":"2024-09-12T01:37:46.966003+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:48.993545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973096+0000","last_change":"2024-09-12T01:37:44.970613+0000","last_active":"2024-09-12T01:37:44.973096+0000","last_peered":"2024-09-12T01:37:44.973096+0000","last_clean":"2024-09-12T01:37:44.973096+0000","last_became_active":"2024-09-12T01:37:44.970284+0000","last_became_peered":"2024-09-12T01:37:44.970284+0000","last_unstale":"2024-09-12T01:37:44.973096+0000","last_undegraded":"2024-09-12T01:37:44.973096+0000","last_fullsized":"2024-09-12T01:37:44.973096+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:47.940491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962345+0000","last_change":"2024-09-12T01:37:44.962345+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962345+0000","last_undegraded":"2024-09-12T01:37:44.962345+0000","last_fullsized":"2024-09-12T01:37:44.962345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.965660+0000","last_change":"2024-09-12T01:37:44.964928+0000","last_active":"2024-09-12T01:37:44.965660+0000","last_peered":"2024-09-12T01:37:44.965660+0000","last_clean":"2024-09-12T01:37:44.965660+0000","last_became_active":"2024-09-12T01:37:44.964539+0000","last_became_peered":"2024-09-12T01:37:44.964539+0000","last_unstale":"2024-09-12T01:37:44.965660+0000","last_undegraded":"2024-09-12T01:37:44.965660+0000","last_fullsized":"2024-09-12T01:37:44.965660+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:16.673738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963231+0000","last_change":"2024-09-12T01:37:44.963231+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963231+0000","last_undegraded":"2024-09-12T01:37:44.963231+0000","last_fullsized":"2024-09-12T01:37:44.963231+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.968975+0000","last_change":"2024-09-12T01:37:44.962377+0000","last_active":"2024-09-12T01:37:44.968975+0000","last_peered":"2024-09-12T01:37:44.968975+0000","last_clean":"2024-09-12T01:37:44.968975+0000","last_became_active":"2024-09-12T01:37:44.962116+0000","last_became_peered":"2024-09-12T01:37:44.962116+0000","last_unstale":"2024-09-12T01:37:44.968975+0000","last_undegraded":"2024-09-12T01:37:44.968975+0000","last_fullsized":"2024-09-12T01:37:44.968975+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:24.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.953494+0000","last_change":"2024-09-12T01:37:44.953494+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.953494+0000","last_undegraded":"2024-09-12T01:37:44.953494+0000","last_fullsized":"2024-09-12T01:37:44.953494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.968870+0000","last_change":"2024-09-12T01:37:44.965413+0000","last_active":"2024-09-12T01:37:44.968870+0000","last_peered":"2024-09-12T01:37:44.968870+0000","last_clean":"2024-09-12T01:37:44.968870+0000","last_became_active":"2024-09-12T01:37:44.965122+0000","last_became_peered":"2024-09-12T01:37:44.965122+0000","last_unstale":"2024-09-12T01:37:44.968870+0000","last_undegraded":"2024-09-12T01:37:44.968870+0000","last_fullsized":"2024-09-12T01:37:44.968870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:37.749845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960345+0000","last_change":"2024-09-12T01:37:44.960345+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960345+0000","last_undegraded":"2024-09-12T01:37:44.960345+0000","last_fullsized":"2024-09-12T01:37:44.960345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969737+0000","last_change":"2024-09-12T01:37:44.968753+0000","last_active":"2024-09-12T01:37:44.969737+0000","last_peered":"2024-09-12T01:37:44.969737+0000","last_clean":"2024-09-12T01:37:44.969737+0000","last_became_active":"2024-09-12T01:37:44.968465+0000","last_became_peered":"2024-09-12T01:37:44.968465+0000","last_unstale":"2024-09-12T01:37:44.969737+0000","last_undegraded":"2024-09-12T01:37:44.969737+0000","last_fullsized":"2024-09-12T01:37:44.969737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:55.452436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":209,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.967587+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:37:44.967587+0000","last_peered":"2024-09-12T01:37:44.967587+0000","last_clean":"2024-09-12T01:37:44.967587+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:37:44.967587+0000","last_undegraded":"2024-09-12T01:37:44.967587+0000","last_fullsized":"2024-09-12T01:37:44.967587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509467,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":783968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":790243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":552960,"data_stored":214654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:37:50.650 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3f is not active+clean 2024-09-12T01:37:50.650 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.963264+0000', 'last_change': '2024-09-12T01:37:44.963264+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.963264+0000', 'last_undegraded': '2024-09-12T01:37:44.963264+0000', 'last_fullsized': '2024-09-12T01:37:44.963264+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:37:50.650 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3e is not active+clean 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.955766+0000', 'last_change': '2024-09-12T01:37:44.955766+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.955766+0000', 'last_undegraded': '2024-09-12T01:37:44.955766+0000', 'last_fullsized': '2024-09-12T01:37:44.955766+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3d is not active+clean 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.962486+0000', 'last_change': '2024-09-12T01:37:44.962486+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.962486+0000', 'last_undegraded': '2024-09-12T01:37:44.962486+0000', 'last_fullsized': '2024-09-12T01:37:44.962486+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.961519+0000', 'last_change': '2024-09-12T01:37:44.961519+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.961519+0000', 'last_undegraded': '2024-09-12T01:37:44.961519+0000', 'last_fullsized': '2024-09-12T01:37:44.961519+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3b is not active+clean 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.960619+0000', 'last_change': '2024-09-12T01:37:44.960619+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.960619+0000', 'last_undegraded': '2024-09-12T01:37:44.960619+0000', 'last_fullsized': '2024-09-12T01:37:44.960619+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3a is not active+clean 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.953689+0000', 'last_change': '2024-09-12T01:37:44.953689+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.953689+0000', 'last_undegraded': '2024-09-12T01:37:44.953689+0000', 'last_fullsized': '2024-09-12T01:37:44.953689+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:PG 7.39 is not active+clean 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.957441+0000', 'last_change': '2024-09-12T01:37:44.957441+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.957441+0000', 'last_undegraded': '2024-09-12T01:37:44.957441+0000', 'last_fullsized': '2024-09-12T01:37:44.957441+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-09-12T01:37:50.651 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.962521+0000', 'last_change': '2024-09-12T01:37:44.962521+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.962521+0000', 'last_undegraded': '2024-09-12T01:37:44.962521+0000', 'last_fullsized': '2024-09-12T01:37:44.962521+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.652 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-09-12T01:37:50.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.954510+0000', 'last_change': '2024-09-12T01:37:44.954510+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.954510+0000', 'last_undegraded': '2024-09-12T01:37:44.954510+0000', 'last_fullsized': '2024-09-12T01:37:44.954510+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:37:50.652 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-09-12T01:37:50.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.961685+0000', 'last_change': '2024-09-12T01:37:44.961685+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.961685+0000', 'last_undegraded': '2024-09-12T01:37:44.961685+0000', 'last_fullsized': '2024-09-12T01:37:44.961685+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.652 INFO:tasks.ceph.ceph_manager.ceph:PG 7.34 is not active+clean 2024-09-12T01:37:50.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.955145+0000', 'last_change': '2024-09-12T01:37:44.955145+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.955145+0000', 'last_undegraded': '2024-09-12T01:37:44.955145+0000', 'last_fullsized': '2024-09-12T01:37:44.955145+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:37:50.652 INFO:tasks.ceph.ceph_manager.ceph:PG 7.33 is not active+clean 2024-09-12T01:37:50.652 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.955869+0000', 'last_change': '2024-09-12T01:37:44.955869+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.955869+0000', 'last_undegraded': '2024-09-12T01:37:44.955869+0000', 'last_fullsized': '2024-09-12T01:37:44.955869+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:37:50.652 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-09-12T01:37:50.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.961968+0000', 'last_change': '2024-09-12T01:37:44.961968+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.961968+0000', 'last_undegraded': '2024-09-12T01:37:44.961968+0000', 'last_fullsized': '2024-09-12T01:37:44.961968+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.653 INFO:tasks.ceph.ceph_manager.ceph:PG 7.31 is not active+clean 2024-09-12T01:37:50.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.962634+0000', 'last_change': '2024-09-12T01:37:44.962634+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.962634+0000', 'last_undegraded': '2024-09-12T01:37:44.962634+0000', 'last_fullsized': '2024-09-12T01:37:44.962634+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.653 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-09-12T01:37:50.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.959470+0000', 'last_change': '2024-09-12T01:37:44.959470+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.959470+0000', 'last_undegraded': '2024-09-12T01:37:44.959470+0000', 'last_fullsized': '2024-09-12T01:37:44.959470+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:37:50.653 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2f is not active+clean 2024-09-12T01:37:50.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.954225+0000', 'last_change': '2024-09-12T01:37:44.954225+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.954225+0000', 'last_undegraded': '2024-09-12T01:37:44.954225+0000', 'last_fullsized': '2024-09-12T01:37:44.954225+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:37:50.653 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2e is not active+clean 2024-09-12T01:37:50.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.963992+0000', 'last_change': '2024-09-12T01:37:44.963992+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.963992+0000', 'last_undegraded': '2024-09-12T01:37:44.963992+0000', 'last_fullsized': '2024-09-12T01:37:44.963992+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:37:50.653 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-09-12T01:37:50.653 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.963241+0000', 'last_change': '2024-09-12T01:37:44.963241+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.963241+0000', 'last_undegraded': '2024-09-12T01:37:44.963241+0000', 'last_fullsized': '2024-09-12T01:37:44.963241+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:37:50.654 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2b is not active+clean 2024-09-12T01:37:50.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.961929+0000', 'last_change': '2024-09-12T01:37:44.961929+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.961929+0000', 'last_undegraded': '2024-09-12T01:37:44.961929+0000', 'last_fullsized': '2024-09-12T01:37:44.961929+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.654 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-09-12T01:37:50.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.958375+0000', 'last_change': '2024-09-12T01:37:44.958375+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.958375+0000', 'last_undegraded': '2024-09-12T01:37:44.958375+0000', 'last_fullsized': '2024-09-12T01:37:44.958375+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:37:50.654 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-09-12T01:37:50.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.955012+0000', 'last_change': '2024-09-12T01:37:44.955012+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.955012+0000', 'last_undegraded': '2024-09-12T01:37:44.955012+0000', 'last_fullsized': '2024-09-12T01:37:44.955012+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:37:50.654 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-09-12T01:37:50.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.954255+0000', 'last_change': '2024-09-12T01:37:44.954255+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.954255+0000', 'last_undegraded': '2024-09-12T01:37:44.954255+0000', 'last_fullsized': '2024-09-12T01:37:44.954255+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:37:50.654 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-09-12T01:37:50.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.961974+0000', 'last_change': '2024-09-12T01:37:44.961974+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.961974+0000', 'last_undegraded': '2024-09-12T01:37:44.961974+0000', 'last_fullsized': '2024-09-12T01:37:44.961974+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:37:50.654 INFO:tasks.ceph.ceph_manager.ceph:PG 7.26 is not active+clean 2024-09-12T01:37:50.654 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.961110+0000', 'last_change': '2024-09-12T01:37:44.961110+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.961110+0000', 'last_undegraded': '2024-09-12T01:37:44.961110+0000', 'last_fullsized': '2024-09-12T01:37:44.961110+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.655 INFO:tasks.ceph.ceph_manager.ceph:PG 7.25 is not active+clean 2024-09-12T01:37:50.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.956717+0000', 'last_change': '2024-09-12T01:37:44.956717+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.956717+0000', 'last_undegraded': '2024-09-12T01:37:44.956717+0000', 'last_fullsized': '2024-09-12T01:37:44.956717+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:37:50.655 INFO:tasks.ceph.ceph_manager.ceph:PG 7.24 is not active+clean 2024-09-12T01:37:50.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.954907+0000', 'last_change': '2024-09-12T01:37:44.954907+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.954907+0000', 'last_undegraded': '2024-09-12T01:37:44.954907+0000', 'last_fullsized': '2024-09-12T01:37:44.954907+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:37:50.655 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-09-12T01:37:50.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.960158+0000', 'last_change': '2024-09-12T01:37:44.960158+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.960158+0000', 'last_undegraded': '2024-09-12T01:37:44.960158+0000', 'last_fullsized': '2024-09-12T01:37:44.960158+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:37:50.655 INFO:tasks.ceph.ceph_manager.ceph:PG 7.22 is not active+clean 2024-09-12T01:37:50.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.954672+0000', 'last_change': '2024-09-12T01:37:44.954672+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.954672+0000', 'last_undegraded': '2024-09-12T01:37:44.954672+0000', 'last_fullsized': '2024-09-12T01:37:44.954672+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:37:50.655 INFO:tasks.ceph.ceph_manager.ceph:PG 7.21 is not active+clean 2024-09-12T01:37:50.655 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.954289+0000', 'last_change': '2024-09-12T01:37:44.954289+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.954289+0000', 'last_undegraded': '2024-09-12T01:37:44.954289+0000', 'last_fullsized': '2024-09-12T01:37:44.954289+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:37:50.656 INFO:tasks.ceph.ceph_manager.ceph:PG 7.20 is not active+clean 2024-09-12T01:37:50.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.962063+0000', 'last_change': '2024-09-12T01:37:44.962063+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.962063+0000', 'last_undegraded': '2024-09-12T01:37:44.962063+0000', 'last_fullsized': '2024-09-12T01:37:44.962063+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.656 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-09-12T01:37:50.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.959199+0000', 'last_change': '2024-09-12T01:37:44.959199+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.959199+0000', 'last_undegraded': '2024-09-12T01:37:44.959199+0000', 'last_fullsized': '2024-09-12T01:37:44.959199+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:37:50.656 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-09-12T01:37:50.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.961540+0000', 'last_change': '2024-09-12T01:37:44.961540+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.961540+0000', 'last_undegraded': '2024-09-12T01:37:44.961540+0000', 'last_fullsized': '2024-09-12T01:37:44.961540+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:37:50.656 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-09-12T01:37:50.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.954243+0000', 'last_change': '2024-09-12T01:37:44.954243+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.954243+0000', 'last_undegraded': '2024-09-12T01:37:44.954243+0000', 'last_fullsized': '2024-09-12T01:37:44.954243+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:37:50.656 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-12T01:37:50.656 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.961206+0000', 'last_change': '2024-09-12T01:37:44.961206+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.961206+0000', 'last_undegraded': '2024-09-12T01:37:44.961206+0000', 'last_fullsized': '2024-09-12T01:37:44.961206+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.656 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-09-12T01:37:50.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.955662+0000', 'last_change': '2024-09-12T01:37:44.955662+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.955662+0000', 'last_undegraded': '2024-09-12T01:37:44.955662+0000', 'last_fullsized': '2024-09-12T01:37:44.955662+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:37:50.657 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-09-12T01:37:50.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.956335+0000', 'last_change': '2024-09-12T01:37:44.956335+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.956335+0000', 'last_undegraded': '2024-09-12T01:37:44.956335+0000', 'last_fullsized': '2024-09-12T01:37:44.956335+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:37:50.657 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-09-12T01:37:50.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.963318+0000', 'last_change': '2024-09-12T01:37:44.963318+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.963318+0000', 'last_undegraded': '2024-09-12T01:37:44.963318+0000', 'last_fullsized': '2024-09-12T01:37:44.963318+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:37:50.657 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-09-12T01:37:50.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.962598+0000', 'last_change': '2024-09-12T01:37:44.962598+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.962598+0000', 'last_undegraded': '2024-09-12T01:37:44.962598+0000', 'last_fullsized': '2024-09-12T01:37:44.962598+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:37:50.657 INFO:tasks.ceph.ceph_manager.ceph:PG 7.14 is not active+clean 2024-09-12T01:37:50.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.960726+0000', 'last_change': '2024-09-12T01:37:44.960726+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.960726+0000', 'last_undegraded': '2024-09-12T01:37:44.960726+0000', 'last_fullsized': '2024-09-12T01:37:44.960726+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.657 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-09-12T01:37:50.657 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.955819+0000', 'last_change': '2024-09-12T01:37:44.955819+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.955819+0000', 'last_undegraded': '2024-09-12T01:37:44.955819+0000', 'last_fullsized': '2024-09-12T01:37:44.955819+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:37:50.658 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-09-12T01:37:50.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.961847+0000', 'last_change': '2024-09-12T01:37:44.961847+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.961847+0000', 'last_undegraded': '2024-09-12T01:37:44.961847+0000', 'last_fullsized': '2024-09-12T01:37:44.961847+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:37:50.658 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-12T01:37:50.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.958973+0000', 'last_change': '2024-09-12T01:37:44.958973+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.958973+0000', 'last_undegraded': '2024-09-12T01:37:44.958973+0000', 'last_fullsized': '2024-09-12T01:37:44.958973+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:37:50.658 INFO:tasks.ceph.ceph_manager.ceph:PG 7.10 is not active+clean 2024-09-12T01:37:50.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.958352+0000', 'last_change': '2024-09-12T01:37:44.958352+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.958352+0000', 'last_undegraded': '2024-09-12T01:37:44.958352+0000', 'last_fullsized': '2024-09-12T01:37:44.958352+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:37:50.658 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-09-12T01:37:50.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.954331+0000', 'last_change': '2024-09-12T01:37:44.954331+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.954331+0000', 'last_undegraded': '2024-09-12T01:37:44.954331+0000', 'last_fullsized': '2024-09-12T01:37:44.954331+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:37:50.658 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-09-12T01:37:50.658 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.958438+0000', 'last_change': '2024-09-12T01:37:44.958438+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.958438+0000', 'last_undegraded': '2024-09-12T01:37:44.958438+0000', 'last_fullsized': '2024-09-12T01:37:44.958438+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:37:50.659 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-12T01:37:50.659 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.958540+0000', 'last_change': '2024-09-12T01:37:44.958540+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.958540+0000', 'last_undegraded': '2024-09-12T01:37:44.958540+0000', 'last_fullsized': '2024-09-12T01:37:44.958540+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:37:50.659 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-09-12T01:37:50.659 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.953487+0000', 'last_change': '2024-09-12T01:37:44.953487+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.953487+0000', 'last_undegraded': '2024-09-12T01:37:44.953487+0000', 'last_fullsized': '2024-09-12T01:37:44.953487+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:37:50.659 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-09-12T01:37:50.659 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.961058+0000', 'last_change': '2024-09-12T01:37:44.961058+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.961058+0000', 'last_undegraded': '2024-09-12T01:37:44.961058+0000', 'last_fullsized': '2024-09-12T01:37:44.961058+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:37:50.659 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-09-12T01:37:50.659 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.955372+0000', 'last_change': '2024-09-12T01:37:44.955372+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.955372+0000', 'last_undegraded': '2024-09-12T01:37:44.955372+0000', 'last_fullsized': '2024-09-12T01:37:44.955372+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:37:50.659 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-09-12T01:37:50.660 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.959951+0000', 'last_change': '2024-09-12T01:37:44.959951+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.959951+0000', 'last_undegraded': '2024-09-12T01:37:44.959951+0000', 'last_fullsized': '2024-09-12T01:37:44.959951+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.660 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-12T01:37:50.660 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.958660+0000', 'last_change': '2024-09-12T01:37:44.958660+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.958660+0000', 'last_undegraded': '2024-09-12T01:37:44.958660+0000', 'last_fullsized': '2024-09-12T01:37:44.958660+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.660 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-09-12T01:37:50.660 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.956256+0000', 'last_change': '2024-09-12T01:37:44.956256+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.956256+0000', 'last_undegraded': '2024-09-12T01:37:44.956256+0000', 'last_fullsized': '2024-09-12T01:37:44.956256+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:37:50.660 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-09-12T01:37:50.660 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.955245+0000', 'last_change': '2024-09-12T01:37:44.955245+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.955245+0000', 'last_undegraded': '2024-09-12T01:37:44.955245+0000', 'last_fullsized': '2024-09-12T01:37:44.955245+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:37:50.660 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3 is not active+clean 2024-09-12T01:37:50.661 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.962345+0000', 'last_change': '2024-09-12T01:37:44.962345+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.962345+0000', 'last_undegraded': '2024-09-12T01:37:44.962345+0000', 'last_fullsized': '2024-09-12T01:37:44.962345+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.661 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-09-12T01:37:50.661 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.963231+0000', 'last_change': '2024-09-12T01:37:44.963231+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.963231+0000', 'last_undegraded': '2024-09-12T01:37:44.963231+0000', 'last_fullsized': '2024-09-12T01:37:44.963231+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:37:50.661 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-09-12T01:37:50.661 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.953494+0000', 'last_change': '2024-09-12T01:37:44.953494+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.953494+0000', 'last_undegraded': '2024-09-12T01:37:44.953494+0000', 'last_fullsized': '2024-09-12T01:37:44.953494+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:37:50.661 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-12T01:37:50.661 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:37:44.960345+0000', 'last_change': '2024-09-12T01:37:44.960345+0000', 'last_active': '2024-09-12T01:37:44.940932+0000', 'last_peered': '2024-09-12T01:37:44.940932+0000', 'last_clean': '2024-09-12T01:37:44.940932+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:37:44.960345+0000', 'last_undegraded': '2024-09-12T01:37:44.960345+0000', 'last_fullsized': '2024-09-12T01:37:44.960345+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'last_clean_scrub_stamp': '2024-09-12T01:37:44.940932+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:37:50.662 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:37:50.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.789+0000 7f4e6298d640 1 Processor -- start 2024-09-12T01:37:50.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.789+0000 7f4e6298d640 1 -- start start 2024-09-12T01:37:50.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.790+0000 7f4e6298d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4e5c1450d0 0x7f4e5c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.790+0000 7f4e6298d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4e5c0cdcb0 0x7f4e5c06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.790+0000 7f4e6298d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e5c06eb00 0x7f4e5c071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.790+0000 7f4e6298d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4e5c15f1d0 con 0x7f4e5c0cdcb0 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.790+0000 7f4e6298d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4e5c15f4b0 con 0x7f4e5c1450d0 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.790+0000 7f4e6298d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5c15f790 con 0x7f4e5c06eb00 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.791+0000 7f4e5b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4e5c0cdcb0 0x7f4e5c06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.791+0000 7f4e5b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4e5c0cdcb0 0x7f4e5c06e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52004/0 (socket says 172.21.15.60:52004) 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.791+0000 7f4e5b7fe640 1 -- 172.21.15.60:0/3954473846 learned_addr learned my addr 172.21.15.60:0/3954473846 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.791+0000 7f4e60f2a640 1 --2- 172.21.15.60:0/3954473846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e5c06eb00 0x7f4e5c071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.791+0000 7f4e5bfff640 1 --2- 172.21.15.60:0/3954473846 >> v2:172.21.15.105:3300/0 conn(0x7f4e5c1450d0 0x7f4e5c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.791+0000 7f4e5b7fe640 1 -- 172.21.15.60:0/3954473846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e5c06eb00 msgr2=0x7f4e5c071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.791+0000 7f4e5b7fe640 1 --2- 172.21.15.60:0/3954473846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e5c06eb00 0x7f4e5c071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.791+0000 7f4e5b7fe640 1 -- 172.21.15.60:0/3954473846 >> v2:172.21.15.105:3300/0 conn(0x7f4e5c1450d0 msgr2=0x7f4e5c0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.791+0000 7f4e5b7fe640 1 --2- 172.21.15.60:0/3954473846 >> v2:172.21.15.105:3300/0 conn(0x7f4e5c1450d0 0x7f4e5c0cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.791+0000 7f4e5b7fe640 1 -- 172.21.15.60:0/3954473846 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5c15fa70 con 0x7f4e5c0cdcb0 2024-09-12T01:37:50.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.791+0000 7f4e60f2a640 1 --2- 172.21.15.60:0/3954473846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e5c06eb00 0x7f4e5c071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:50.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.791+0000 7f4e5bfff640 1 --2- 172.21.15.60:0/3954473846 >> v2:172.21.15.105:3300/0 conn(0x7f4e5c1450d0 0x7f4e5c0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:50.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.792+0000 7f4e5b7fe640 1 --2- 172.21.15.60:0/3954473846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5c0cdcb0 0x7f4e5c06e5c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009870 tx=0x7f4e5002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac7432474f6dc3c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:50.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.792+0000 7f4e5affd640 1 -- 172.21.15.60:0/3954473846 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50037070 con 0x7f4e5c0cdcb0 2024-09-12T01:37:50.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.792+0000 7f4e5affd640 1 -- 172.21.15.60:0/3954473846 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e50032440 con 0x7f4e5c0cdcb0 2024-09-12T01:37:50.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.792+0000 7f4e5affd640 1 -- 172.21.15.60:0/3954473846 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e50032810 con 0x7f4e5c0cdcb0 2024-09-12T01:37:50.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.792+0000 7f4e6298d640 1 -- 172.21.15.60:0/3954473846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5c0cdcb0 msgr2=0x7f4e5c06e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.792+0000 7f4e6298d640 1 --2- 172.21.15.60:0/3954473846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5c0cdcb0 0x7f4e5c06e5c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009870 tx=0x7f4e5002a180 comp rx=0 tx=0).stop 2024-09-12T01:37:50.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.792+0000 7f4e6298d640 1 -- 172.21.15.60:0/3954473846 shutdown_connections 2024-09-12T01:37:50.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.792+0000 7f4e6298d640 1 --2- 172.21.15.60:0/3954473846 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e5c06eb00 0x7f4e5c071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.792+0000 7f4e6298d640 1 --2- 172.21.15.60:0/3954473846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5c0cdcb0 0x7f4e5c06e5c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.792+0000 7f4e6298d640 1 --2- 172.21.15.60:0/3954473846 >> v2:172.21.15.105:3300/0 conn(0x7f4e5c1450d0 0x7f4e5c0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.792+0000 7f4e6298d640 1 -- 172.21.15.60:0/3954473846 >> 172.21.15.60:0/3954473846 conn(0x7f4e5c06e1e0 msgr2=0x7f4e5c0b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:50.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.792+0000 7f4e6298d640 1 -- 172.21.15.60:0/3954473846 shutdown_connections 2024-09-12T01:37:50.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.793+0000 7f4e6298d640 1 -- 172.21.15.60:0/3954473846 wait complete. 2024-09-12T01:37:50.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.794+0000 7f4e6298d640 1 Processor -- start 2024-09-12T01:37:50.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.794+0000 7f4e6298d640 1 -- start start 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e6298d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5c06eb00 0x7f4e5c06c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e6298d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e5c0cdcb0 0x7f4e5c1f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e6298d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5c1450d0 0x7f4e5c0ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e6298d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5c0cd560 con 0x7f4e5c1450d0 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e6298d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5c0cd3e0 con 0x7f4e5c06eb00 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e6298d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5c072500 con 0x7f4e5c0cdcb0 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e60f2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5c1450d0 0x7f4e5c0ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e60f2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5c1450d0 0x7f4e5c0ad880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52012/0 (socket says 172.21.15.60:52012) 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e60f2a640 1 -- 172.21.15.60:0/3068704860 learned_addr learned my addr 172.21.15.60:0/3068704860 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e5b7fe640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e5c0cdcb0 0x7f4e5c1f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e5bfff640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5c06eb00 0x7f4e5c06c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e60f2a640 1 -- 172.21.15.60:0/3068704860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e5c0cdcb0 msgr2=0x7f4e5c1f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e60f2a640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e5c0cdcb0 0x7f4e5c1f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e60f2a640 1 -- 172.21.15.60:0/3068704860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5c06eb00 msgr2=0x7f4e5c06c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e60f2a640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5c06eb00 0x7f4e5c06c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e60f2a640 1 -- 172.21.15.60:0/3068704860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5c0ab1b0 con 0x7f4e5c1450d0 2024-09-12T01:37:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e5b7fe640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e5c0cdcb0 0x7f4e5c1f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e5bfff640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5c06eb00 0x7f4e5c06c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e60f2a640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5c1450d0 0x7f4e5c0ad880 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4e54007e40 tx=0x7f4e5400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e58ff9640 1 -- 172.21.15.60:0/3068704860 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5401a070 con 0x7f4e5c1450d0 2024-09-12T01:37:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e58ff9640 1 -- 172.21.15.60:0/3068704860 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e54003b90 con 0x7f4e5c1450d0 2024-09-12T01:37:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e6298d640 1 -- 172.21.15.60:0/3068704860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5c0ab490 con 0x7f4e5c1450d0 2024-09-12T01:37:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e58ff9640 1 -- 172.21.15.60:0/3068704860 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400de80 con 0x7f4e5c1450d0 2024-09-12T01:37:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.795+0000 7f4e6298d640 1 -- 172.21.15.60:0/3068704860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e5c0abd30 con 0x7f4e5c1450d0 2024-09-12T01:37:50.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.796+0000 7f4e6298d640 1 -- 172.21.15.60:0/3068704860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e5c0ab660 con 0x7f4e5c1450d0 2024-09-12T01:37:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.797+0000 7f4e58ff9640 1 -- 172.21.15.60:0/3068704860 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e5401d070 con 0x7f4e5c1450d0 2024-09-12T01:37:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.797+0000 7f4e58ff9640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e4806be30 0x7f4e4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.797+0000 7f4e58ff9640 1 -- 172.21.15.60:0/3068704860 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f4e5408b110 con 0x7f4e5c1450d0 2024-09-12T01:37:50.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.797+0000 7f4e5bfff640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e4806be30 0x7f4e4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:50.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.798+0000 7f4e5bfff640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e4806be30 0x7f4e4806e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c006fd0 tx=0x7f4e4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:50.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:50.802+0000 7f4e58ff9640 1 -- 172.21.15.60:0/3068704860 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e54010070 con 0x7f4e5c1450d0 2024-09-12T01:37:51.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.044+0000 7f4e6298d640 1 -- 172.21.15.60:0/3068704860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f4e5c06e5c0 con 0x7f4e5c1450d0 2024-09-12T01:37:51.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.044+0000 7f4e58ff9640 1 -- 172.21.15.60:0/3068704860 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1141 (secure 0 0 0) 0x7f4e54059ac0 con 0x7f4e5c1450d0 2024-09-12T01:37:51.043 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:51.044 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":138,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":46,"num_osds":8,"num_up_osds":8,"osd_up_since":1726104944,"num_in_osds":8,"osd_in_since":1726104934,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":57},{"state_name":"active+clean","count":40}],"num_pgs":97,"num_pools":3,"num_objects":11,"data_bytes":591980,"bytes_used":252276736,"bytes_avail":772841836544,"bytes_total":773094113280,"inactive_pgs_ratio":0.58762884140014648,"write_bytes_sec":511,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":21,"btime":"2024-09-12T01:37:48:964735+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":34778}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-12T01:37:34.282605+0000","services":{}},"progress_events":{}} 2024-09-12T01:37:51.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.046+0000 7f4e6298d640 1 -- 172.21.15.60:0/3068704860 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e4806be30 msgr2=0x7f4e4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:51.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.046+0000 7f4e6298d640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e4806be30 0x7f4e4806e2f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c006fd0 tx=0x7f4e4c008040 comp rx=0 tx=0).stop 2024-09-12T01:37:51.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.046+0000 7f4e6298d640 1 -- 172.21.15.60:0/3068704860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5c1450d0 msgr2=0x7f4e5c0ad880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:51.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.046+0000 7f4e6298d640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5c1450d0 0x7f4e5c0ad880 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4e54007e40 tx=0x7f4e5400d4a0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.046+0000 7f4e6298d640 1 -- 172.21.15.60:0/3068704860 shutdown_connections 2024-09-12T01:37:51.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.046+0000 7f4e6298d640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5c1450d0 0x7f4e5c0ad880 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.046+0000 7f4e6298d640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e4806be30 0x7f4e4806e2f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.046+0000 7f4e6298d640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e5c0cdcb0 0x7f4e5c1f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.046+0000 7f4e6298d640 1 --2- 172.21.15.60:0/3068704860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5c06eb00 0x7f4e5c06c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.046+0000 7f4e6298d640 1 -- 172.21.15.60:0/3068704860 >> 172.21.15.60:0/3068704860 conn(0x7f4e5c06e1e0 msgr2=0x7f4e5c0b6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:51.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.046+0000 7f4e6298d640 1 -- 172.21.15.60:0/3068704860 shutdown_connections 2024-09-12T01:37:51.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.046+0000 7f4e6298d640 1 -- 172.21.15.60:0/3068704860 wait complete. 2024-09-12T01:37:51.056 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:37:51.057 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:37:51.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.160+0000 7f88c6a47640 1 Processor -- start 2024-09-12T01:37:51.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.160+0000 7f88c6a47640 1 -- start start 2024-09-12T01:37:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.161+0000 7f88c6a47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c00d3310 0x7f88c00d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.161+0000 7f88c6a47640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f88c00d1650 0x7f88c00b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.161+0000 7f88c6a47640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88c015ea40 con 0x7f88c015e660 2024-09-12T01:37:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.161+0000 7f88c6a47640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f88c00d1ac0 con 0x7f88c00d1650 2024-09-12T01:37:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.161+0000 7f88c6a47640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f88c00d3870 con 0x7f88c00d3310 2024-09-12T01:37:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.161+0000 7f88c4fe4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f88c00d1650 0x7f88c00b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.161+0000 7f88c4fe4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f88c00d1650 0x7f88c00b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52018/0 (socket says 172.21.15.60:52018) 2024-09-12T01:37:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.161+0000 7f88c4fe4640 1 -- 172.21.15.60:0/1775019749 learned_addr learned my addr 172.21.15.60:0/1775019749 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:51.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.161+0000 7f88bf7fe640 1 --2- 172.21.15.60:0/1775019749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c00d3310 0x7f88c00d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:51.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.161+0000 7f88c4fe4640 1 -- 172.21.15.60:0/1775019749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c00d3310 msgr2=0x7f88c00d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:51.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.162+0000 7f88c4fe4640 1 --2- 172.21.15.60:0/1775019749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c00d3310 0x7f88c00d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.162+0000 7f88c4fe4640 1 -- 172.21.15.60:0/1775019749 >> v1:172.21.15.105:6789/0 conn(0x7f88c015e660 legacy=0x7f88c00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:51.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.162+0000 7f88c4fe4640 1 -- 172.21.15.60:0/1775019749 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c00d3b50 con 0x7f88c00d1650 2024-09-12T01:37:51.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.162+0000 7f88bf7fe640 1 --2- 172.21.15.60:0/1775019749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c00d3310 0x7f88c00d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:51.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.162+0000 7f88c4fe4640 1 --2- 172.21.15.60:0/1775019749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c00d1650 0x7f88c00b7b70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009e50 tx=0x7f88b802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11888125eb8cdfa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:51.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.162+0000 7f88beffd640 1 -- 172.21.15.60:0/1775019749 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8036070 con 0x7f88c00d1650 2024-09-12T01:37:51.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.162+0000 7f88beffd640 1 -- 172.21.15.60:0/1775019749 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8031600 con 0x7f88c00d1650 2024-09-12T01:37:51.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.163+0000 7f88beffd640 1 -- 172.21.15.60:0/1775019749 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b80319d0 con 0x7f88c00d1650 2024-09-12T01:37:51.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.163+0000 7f88c6a47640 1 -- 172.21.15.60:0/1775019749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c00d1650 msgr2=0x7f88c00b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:51.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.163+0000 7f88c6a47640 1 --2- 172.21.15.60:0/1775019749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c00d1650 0x7f88c00b7b70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009e50 tx=0x7f88b802a6d0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.163+0000 7f88c6a47640 1 -- 172.21.15.60:0/1775019749 shutdown_connections 2024-09-12T01:37:51.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.163+0000 7f88c6a47640 1 --2- 172.21.15.60:0/1775019749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c00d1650 0x7f88c00b7b70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.163+0000 7f88c6a47640 1 --2- 172.21.15.60:0/1775019749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c00d3310 0x7f88c00d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.163+0000 7f88c6a47640 1 -- 172.21.15.60:0/1775019749 >> 172.21.15.60:0/1775019749 conn(0x7f88c00b6410 msgr2=0x7f88c00b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:51.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.163+0000 7f88c6a47640 1 -- 172.21.15.60:0/1775019749 shutdown_connections 2024-09-12T01:37:51.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.163+0000 7f88c6a47640 1 -- 172.21.15.60:0/1775019749 wait complete. 2024-09-12T01:37:51.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.164+0000 7f88c6a47640 1 Processor -- start 2024-09-12T01:37:51.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.164+0000 7f88c6a47640 1 -- start start 2024-09-12T01:37:51.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.165+0000 7f88c6a47640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88c00d1650 0x7f88c0150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:51.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.165+0000 7f88c6a47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c00d3310 0x7f88c01505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:51.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.165+0000 7f88c6a47640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c015e660 0x7f88c0159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:51.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.165+0000 7f88c6a47640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f88c00d43f0 con 0x7f88c015e660 2024-09-12T01:37:51.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.165+0000 7f88c6a47640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88c00d4110 con 0x7f88c00d1650 2024-09-12T01:37:51.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.165+0000 7f88c6a47640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f88c00b80b0 con 0x7f88c00d3310 2024-09-12T01:37:51.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.165+0000 7f88c4fe4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c015e660 0x7f88c0159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.165+0000 7f88c4fe4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c015e660 0x7f88c0159d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52022/0 (socket says 172.21.15.60:52022) 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.165+0000 7f88c4fe4640 1 -- 172.21.15.60:0/2363945562 learned_addr learned my addr 172.21.15.60:0/2363945562 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.165+0000 7f88bf7fe640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c00d3310 0x7f88c01505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.165+0000 7f88bffff640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88c00d1650 0x7f88c0150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88c4fe4640 1 -- 172.21.15.60:0/2363945562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c00d3310 msgr2=0x7f88c01505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88c4fe4640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c00d3310 0x7f88c01505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88c4fe4640 1 -- 172.21.15.60:0/2363945562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88c00d1650 msgr2=0x7f88c0150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88c4fe4640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88c00d1650 0x7f88c0150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88c4fe4640 1 -- 172.21.15.60:0/2363945562 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c015c340 con 0x7f88c015e660 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88bf7fe640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c00d3310 0x7f88c01505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88bffff640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88c00d1650 0x7f88c0150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88c4fe4640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c015e660 0x7f88c0159d30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009e50 tx=0x7f88b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:51.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88bcff9640 1 -- 172.21.15.60:0/2363945562 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8036050 con 0x7f88c015e660 2024-09-12T01:37:51.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88bcff9640 1 -- 172.21.15.60:0/2363945562 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b8042070 con 0x7f88c015e660 2024-09-12T01:37:51.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88c6a47640 1 -- 172.21.15.60:0/2363945562 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c015c620 con 0x7f88c015e660 2024-09-12T01:37:51.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88bcff9640 1 -- 172.21.15.60:0/2363945562 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b8009510 con 0x7f88c015e660 2024-09-12T01:37:51.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.166+0000 7f88c6a47640 1 -- 172.21.15.60:0/2363945562 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c015ef90 con 0x7f88c015e660 2024-09-12T01:37:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.167+0000 7f88c6a47640 1 -- 172.21.15.60:0/2363945562 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c00b7b70 con 0x7f88c015e660 2024-09-12T01:37:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.167+0000 7f88bcff9640 1 -- 172.21.15.60:0/2363945562 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f88b8007bd0 con 0x7f88c015e660 2024-09-12T01:37:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.168+0000 7f88bcff9640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f88ac06be30 0x7f88ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.168+0000 7f88bcff9640 1 -- 172.21.15.60:0/2363945562 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f88b80abe10 con 0x7f88c015e660 2024-09-12T01:37:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.168+0000 7f88bffff640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f88ac06be30 0x7f88ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:51.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.168+0000 7f88bffff640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f88ac06be30 0x7f88ac06e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f88b0006fd0 tx=0x7f88b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:51.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.172+0000 7f88bcff9640 1 -- 172.21.15.60:0/2363945562 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88b807a7c0 con 0x7f88c015e660 2024-09-12T01:37:51.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.347+0000 7f88c6a47640 1 -- 172.21.15.60:0/2363945562 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88c015a270 con 0x7f88ac06be30 2024-09-12T01:37:51.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.353+0000 7f88bcff9640 1 -- 172.21.15.60:0/2363945562 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247249 (secure 0 0 0) 0x7f88c015a270 con 0x7f88ac06be30 2024-09-12T01:37:51.355 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:51.357 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:37:51.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.356+0000 7f88c6a47640 1 -- 172.21.15.60:0/2363945562 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f88ac06be30 msgr2=0x7f88ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:51.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.356+0000 7f88c6a47640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f88ac06be30 0x7f88ac06e2f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f88b0006fd0 tx=0x7f88b0008040 comp rx=0 tx=0).stop 2024-09-12T01:37:51.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.356+0000 7f88c6a47640 1 -- 172.21.15.60:0/2363945562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c015e660 msgr2=0x7f88c0159d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:51.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.356+0000 7f88c6a47640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c015e660 0x7f88c0159d30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009e50 tx=0x7f88b8004a40 comp rx=0 tx=0).stop 2024-09-12T01:37:51.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.356+0000 7f88c6a47640 1 -- 172.21.15.60:0/2363945562 shutdown_connections 2024-09-12T01:37:51.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.356+0000 7f88c6a47640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88c015e660 0x7f88c0159d30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.356+0000 7f88c6a47640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f88ac06be30 0x7f88ac06e2f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.356+0000 7f88c6a47640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f88c00d3310 0x7f88c01505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.356+0000 7f88c6a47640 1 --2- 172.21.15.60:0/2363945562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88c00d1650 0x7f88c0150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:51.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.356+0000 7f88c6a47640 1 -- 172.21.15.60:0/2363945562 >> 172.21.15.60:0/2363945562 conn(0x7f88c00b6410 msgr2=0x7f88c00b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:51.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.357+0000 7f88c6a47640 1 -- 172.21.15.60:0/2363945562 shutdown_connections 2024-09-12T01:37:51.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:51.357+0000 7f88c6a47640 1 -- 172.21.15.60:0/2363945562 wait complete. 2024-09-12T01:37:51.367 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-09-12T01:37:50.285386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":178,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":65,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246364,"kb_used_data":5160,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754728356,"statfs":{"total":773094113280,"available":772841836544,"internally_reserved":0,"allocated":5283840,"data_stored":2788240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001071"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963264+0000","last_change":"2024-09-12T01:37:44.963264+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963264+0000","last_undegraded":"2024-09-12T01:37:44.963264+0000","last_fullsized":"2024-09-12T01:37:44.963264+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955766+0000","last_change":"2024-09-12T01:37:44.955766+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955766+0000","last_undegraded":"2024-09-12T01:37:44.955766+0000","last_fullsized":"2024-09-12T01:37:44.955766+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962486+0000","last_change":"2024-09-12T01:37:44.962486+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962486+0000","last_undegraded":"2024-09-12T01:37:44.962486+0000","last_fullsized":"2024-09-12T01:37:44.962486+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961519+0000","last_change":"2024-09-12T01:37:44.961519+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961519+0000","last_undegraded":"2024-09-12T01:37:44.961519+0000","last_fullsized":"2024-09-12T01:37:44.961519+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960619+0000","last_change":"2024-09-12T01:37:44.960619+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960619+0000","last_undegraded":"2024-09-12T01:37:44.960619+0000","last_fullsized":"2024-09-12T01:37:44.960619+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.953689+0000","last_change":"2024-09-12T01:37:44.953689+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.953689+0000","last_undegraded":"2024-09-12T01:37:44.953689+0000","last_fullsized":"2024-09-12T01:37:44.953689+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.957441+0000","last_change":"2024-09-12T01:37:44.957441+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.957441+0000","last_undegraded":"2024-09-12T01:37:44.957441+0000","last_fullsized":"2024-09-12T01:37:44.957441+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962521+0000","last_change":"2024-09-12T01:37:44.962521+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962521+0000","last_undegraded":"2024-09-12T01:37:44.962521+0000","last_fullsized":"2024-09-12T01:37:44.962521+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954510+0000","last_change":"2024-09-12T01:37:44.954510+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954510+0000","last_undegraded":"2024-09-12T01:37:44.954510+0000","last_fullsized":"2024-09-12T01:37:44.954510+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966202+0000","last_change":"2024-09-12T01:37:45.978987+0000","last_active":"2024-09-12T01:37:46.966202+0000","last_peered":"2024-09-12T01:37:46.966202+0000","last_clean":"2024-09-12T01:37:46.966202+0000","last_became_active":"2024-09-12T01:37:45.978701+0000","last_became_peered":"2024-09-12T01:37:45.978701+0000","last_unstale":"2024-09-12T01:37:46.966202+0000","last_undegraded":"2024-09-12T01:37:46.966202+0000","last_fullsized":"2024-09-12T01:37:46.966202+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:31.220991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961685+0000","last_change":"2024-09-12T01:37:44.961685+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961685+0000","last_undegraded":"2024-09-12T01:37:44.961685+0000","last_fullsized":"2024-09-12T01:37:44.961685+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955145+0000","last_change":"2024-09-12T01:37:44.955145+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955145+0000","last_undegraded":"2024-09-12T01:37:44.955145+0000","last_fullsized":"2024-09-12T01:37:44.955145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955869+0000","last_change":"2024-09-12T01:37:44.955869+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955869+0000","last_undegraded":"2024-09-12T01:37:44.955869+0000","last_fullsized":"2024-09-12T01:37:44.955869+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961968+0000","last_change":"2024-09-12T01:37:44.961968+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961968+0000","last_undegraded":"2024-09-12T01:37:44.961968+0000","last_fullsized":"2024-09-12T01:37:44.961968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962634+0000","last_change":"2024-09-12T01:37:44.962634+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962634+0000","last_undegraded":"2024-09-12T01:37:44.962634+0000","last_fullsized":"2024-09-12T01:37:44.962634+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.959470+0000","last_change":"2024-09-12T01:37:44.959470+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.959470+0000","last_undegraded":"2024-09-12T01:37:44.959470+0000","last_fullsized":"2024-09-12T01:37:44.959470+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954225+0000","last_change":"2024-09-12T01:37:44.954225+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954225+0000","last_undegraded":"2024-09-12T01:37:44.954225+0000","last_fullsized":"2024-09-12T01:37:44.954225+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963992+0000","last_change":"2024-09-12T01:37:44.963992+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963992+0000","last_undegraded":"2024-09-12T01:37:44.963992+0000","last_fullsized":"2024-09-12T01:37:44.963992+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963241+0000","last_change":"2024-09-12T01:37:44.963241+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963241+0000","last_undegraded":"2024-09-12T01:37:44.963241+0000","last_fullsized":"2024-09-12T01:37:44.963241+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966129+0000","last_change":"2024-09-12T01:37:45.980489+0000","last_active":"2024-09-12T01:37:46.966129+0000","last_peered":"2024-09-12T01:37:46.966129+0000","last_clean":"2024-09-12T01:37:46.966129+0000","last_became_active":"2024-09-12T01:37:45.979971+0000","last_became_peered":"2024-09-12T01:37:45.979971+0000","last_unstale":"2024-09-12T01:37:46.966129+0000","last_undegraded":"2024-09-12T01:37:46.966129+0000","last_fullsized":"2024-09-12T01:37:46.966129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:17.192041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961929+0000","last_change":"2024-09-12T01:37:44.961929+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961929+0000","last_undegraded":"2024-09-12T01:37:44.961929+0000","last_fullsized":"2024-09-12T01:37:44.961929+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958375+0000","last_change":"2024-09-12T01:37:44.958375+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958375+0000","last_undegraded":"2024-09-12T01:37:44.958375+0000","last_fullsized":"2024-09-12T01:37:44.958375+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955012+0000","last_change":"2024-09-12T01:37:44.955012+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955012+0000","last_undegraded":"2024-09-12T01:37:44.955012+0000","last_fullsized":"2024-09-12T01:37:44.955012+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954255+0000","last_change":"2024-09-12T01:37:44.954255+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954255+0000","last_undegraded":"2024-09-12T01:37:44.954255+0000","last_fullsized":"2024-09-12T01:37:44.954255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961974+0000","last_change":"2024-09-12T01:37:44.961974+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961974+0000","last_undegraded":"2024-09-12T01:37:44.961974+0000","last_fullsized":"2024-09-12T01:37:44.961974+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961110+0000","last_change":"2024-09-12T01:37:44.961110+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961110+0000","last_undegraded":"2024-09-12T01:37:44.961110+0000","last_fullsized":"2024-09-12T01:37:44.961110+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.956717+0000","last_change":"2024-09-12T01:37:44.956717+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.956717+0000","last_undegraded":"2024-09-12T01:37:44.956717+0000","last_fullsized":"2024-09-12T01:37:44.956717+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954907+0000","last_change":"2024-09-12T01:37:44.954907+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954907+0000","last_undegraded":"2024-09-12T01:37:44.954907+0000","last_fullsized":"2024-09-12T01:37:44.954907+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960158+0000","last_change":"2024-09-12T01:37:44.960158+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960158+0000","last_undegraded":"2024-09-12T01:37:44.960158+0000","last_fullsized":"2024-09-12T01:37:44.960158+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954672+0000","last_change":"2024-09-12T01:37:44.954672+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954672+0000","last_undegraded":"2024-09-12T01:37:44.954672+0000","last_fullsized":"2024-09-12T01:37:44.954672+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954289+0000","last_change":"2024-09-12T01:37:44.954289+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954289+0000","last_undegraded":"2024-09-12T01:37:44.954289+0000","last_fullsized":"2024-09-12T01:37:44.954289+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962063+0000","last_change":"2024-09-12T01:37:44.962063+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962063+0000","last_undegraded":"2024-09-12T01:37:44.962063+0000","last_fullsized":"2024-09-12T01:37:44.962063+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.959199+0000","last_change":"2024-09-12T01:37:44.959199+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.959199+0000","last_undegraded":"2024-09-12T01:37:44.959199+0000","last_fullsized":"2024-09-12T01:37:44.959199+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.971959+0000","last_change":"2024-09-12T01:37:44.967687+0000","last_active":"2024-09-12T01:37:44.971959+0000","last_peered":"2024-09-12T01:37:44.971959+0000","last_clean":"2024-09-12T01:37:44.971959+0000","last_became_active":"2024-09-12T01:37:44.967371+0000","last_became_peered":"2024-09-12T01:37:44.967371+0000","last_unstale":"2024-09-12T01:37:44.971959+0000","last_undegraded":"2024-09-12T01:37:44.971959+0000","last_fullsized":"2024-09-12T01:37:44.971959+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:02.837499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961540+0000","last_change":"2024-09-12T01:37:44.961540+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961540+0000","last_undegraded":"2024-09-12T01:37:44.961540+0000","last_fullsized":"2024-09-12T01:37:44.961540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.965257+0000","last_change":"2024-09-12T01:37:44.961291+0000","last_active":"2024-09-12T01:37:44.965257+0000","last_peered":"2024-09-12T01:37:44.965257+0000","last_clean":"2024-09-12T01:37:44.965257+0000","last_became_active":"2024-09-12T01:37:44.960579+0000","last_became_peered":"2024-09-12T01:37:44.960579+0000","last_unstale":"2024-09-12T01:37:44.965257+0000","last_undegraded":"2024-09-12T01:37:44.965257+0000","last_fullsized":"2024-09-12T01:37:44.965257+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:32.455115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954243+0000","last_change":"2024-09-12T01:37:44.954243+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954243+0000","last_undegraded":"2024-09-12T01:37:44.954243+0000","last_fullsized":"2024-09-12T01:37:44.954243+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972368+0000","last_change":"2024-09-12T01:37:44.970297+0000","last_active":"2024-09-12T01:37:44.972368+0000","last_peered":"2024-09-12T01:37:44.972368+0000","last_clean":"2024-09-12T01:37:44.972368+0000","last_became_active":"2024-09-12T01:37:44.969412+0000","last_became_peered":"2024-09-12T01:37:44.969412+0000","last_unstale":"2024-09-12T01:37:44.972368+0000","last_undegraded":"2024-09-12T01:37:44.972368+0000","last_fullsized":"2024-09-12T01:37:44.972368+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:04.222028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961206+0000","last_change":"2024-09-12T01:37:44.961206+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961206+0000","last_undegraded":"2024-09-12T01:37:44.961206+0000","last_fullsized":"2024-09-12T01:37:44.961206+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.964069+0000","last_change":"2024-09-12T01:37:44.960326+0000","last_active":"2024-09-12T01:37:44.964069+0000","last_peered":"2024-09-12T01:37:44.964069+0000","last_clean":"2024-09-12T01:37:44.964069+0000","last_became_active":"2024-09-12T01:37:44.960035+0000","last_became_peered":"2024-09-12T01:37:44.960035+0000","last_unstale":"2024-09-12T01:37:44.964069+0000","last_undegraded":"2024-09-12T01:37:44.964069+0000","last_fullsized":"2024-09-12T01:37:44.964069+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:35.165479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955662+0000","last_change":"2024-09-12T01:37:44.955662+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955662+0000","last_undegraded":"2024-09-12T01:37:44.955662+0000","last_fullsized":"2024-09-12T01:37:44.955662+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969065+0000","last_change":"2024-09-12T01:37:44.963126+0000","last_active":"2024-09-12T01:37:44.969065+0000","last_peered":"2024-09-12T01:37:44.969065+0000","last_clean":"2024-09-12T01:37:44.969065+0000","last_became_active":"2024-09-12T01:37:44.962716+0000","last_became_peered":"2024-09-12T01:37:44.962716+0000","last_unstale":"2024-09-12T01:37:44.969065+0000","last_undegraded":"2024-09-12T01:37:44.969065+0000","last_fullsized":"2024-09-12T01:37:44.969065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:23.617585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965845+0000","last_change":"2024-09-12T01:37:45.979316+0000","last_active":"2024-09-12T01:37:46.965845+0000","last_peered":"2024-09-12T01:37:46.965845+0000","last_clean":"2024-09-12T01:37:46.965845+0000","last_became_active":"2024-09-12T01:37:45.979057+0000","last_became_peered":"2024-09-12T01:37:45.979057+0000","last_unstale":"2024-09-12T01:37:46.965845+0000","last_undegraded":"2024-09-12T01:37:46.965845+0000","last_fullsized":"2024-09-12T01:37:46.965845+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:53.791353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973377+0000","last_change":"2024-09-12T01:37:44.971445+0000","last_active":"2024-09-12T01:37:44.973377+0000","last_peered":"2024-09-12T01:37:44.973377+0000","last_clean":"2024-09-12T01:37:44.973377+0000","last_became_active":"2024-09-12T01:37:44.971101+0000","last_became_peered":"2024-09-12T01:37:44.971101+0000","last_unstale":"2024-09-12T01:37:44.973377+0000","last_undegraded":"2024-09-12T01:37:44.973377+0000","last_fullsized":"2024-09-12T01:37:44.973377+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:20.679198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965690+0000","last_change":"2024-09-12T01:37:45.978821+0000","last_active":"2024-09-12T01:37:46.965690+0000","last_peered":"2024-09-12T01:37:46.965690+0000","last_clean":"2024-09-12T01:37:46.965690+0000","last_became_active":"2024-09-12T01:37:45.978351+0000","last_became_peered":"2024-09-12T01:37:45.978351+0000","last_unstale":"2024-09-12T01:37:46.965690+0000","last_undegraded":"2024-09-12T01:37:46.965690+0000","last_fullsized":"2024-09-12T01:37:46.965690+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973105+0000","last_change":"2024-09-12T01:37:44.971595+0000","last_active":"2024-09-12T01:37:44.973105+0000","last_peered":"2024-09-12T01:37:44.973105+0000","last_clean":"2024-09-12T01:37:44.973105+0000","last_became_active":"2024-09-12T01:37:44.971330+0000","last_became_peered":"2024-09-12T01:37:44.971330+0000","last_unstale":"2024-09-12T01:37:44.973105+0000","last_undegraded":"2024-09-12T01:37:44.973105+0000","last_fullsized":"2024-09-12T01:37:44.973105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:47.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.956335+0000","last_change":"2024-09-12T01:37:44.956335+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.956335+0000","last_undegraded":"2024-09-12T01:37:44.956335+0000","last_fullsized":"2024-09-12T01:37:44.956335+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965453+0000","last_change":"2024-09-12T01:37:44.965704+0000","last_active":"2024-09-12T01:37:46.965453+0000","last_peered":"2024-09-12T01:37:46.965453+0000","last_clean":"2024-09-12T01:37:46.965453+0000","last_became_active":"2024-09-12T01:37:44.965433+0000","last_became_peered":"2024-09-12T01:37:44.965433+0000","last_unstale":"2024-09-12T01:37:46.965453+0000","last_undegraded":"2024-09-12T01:37:46.965453+0000","last_fullsized":"2024-09-12T01:37:46.965453+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:42.232596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963318+0000","last_change":"2024-09-12T01:37:44.963318+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963318+0000","last_undegraded":"2024-09-12T01:37:44.963318+0000","last_fullsized":"2024-09-12T01:37:44.963318+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972851+0000","last_change":"2024-09-12T01:37:44.971685+0000","last_active":"2024-09-12T01:37:44.972851+0000","last_peered":"2024-09-12T01:37:44.972851+0000","last_clean":"2024-09-12T01:37:44.972851+0000","last_became_active":"2024-09-12T01:37:44.971412+0000","last_became_peered":"2024-09-12T01:37:44.971412+0000","last_unstale":"2024-09-12T01:37:44.972851+0000","last_undegraded":"2024-09-12T01:37:44.972851+0000","last_fullsized":"2024-09-12T01:37:44.972851+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:18.933000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962598+0000","last_change":"2024-09-12T01:37:44.962598+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962598+0000","last_undegraded":"2024-09-12T01:37:44.962598+0000","last_fullsized":"2024-09-12T01:37:44.962598+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966211+0000","last_change":"2024-09-12T01:37:44.970742+0000","last_active":"2024-09-12T01:37:46.966211+0000","last_peered":"2024-09-12T01:37:46.966211+0000","last_clean":"2024-09-12T01:37:46.966211+0000","last_became_active":"2024-09-12T01:37:44.969993+0000","last_became_peered":"2024-09-12T01:37:44.969993+0000","last_unstale":"2024-09-12T01:37:46.966211+0000","last_undegraded":"2024-09-12T01:37:46.966211+0000","last_fullsized":"2024-09-12T01:37:46.966211+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:51.678899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960726+0000","last_change":"2024-09-12T01:37:44.960726+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960726+0000","last_undegraded":"2024-09-12T01:37:44.960726+0000","last_fullsized":"2024-09-12T01:37:44.960726+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.970591+0000","last_change":"2024-09-12T01:37:44.969932+0000","last_active":"2024-09-12T01:37:44.970591+0000","last_peered":"2024-09-12T01:37:44.970591+0000","last_clean":"2024-09-12T01:37:44.970591+0000","last_became_active":"2024-09-12T01:37:44.969660+0000","last_became_peered":"2024-09-12T01:37:44.969660+0000","last_unstale":"2024-09-12T01:37:44.970591+0000","last_undegraded":"2024-09-12T01:37:44.970591+0000","last_fullsized":"2024-09-12T01:37:44.970591+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:47.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955819+0000","last_change":"2024-09-12T01:37:44.955819+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955819+0000","last_undegraded":"2024-09-12T01:37:44.955819+0000","last_fullsized":"2024-09-12T01:37:44.955819+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966245+0000","last_change":"2024-09-12T01:37:44.961045+0000","last_active":"2024-09-12T01:37:46.966245+0000","last_peered":"2024-09-12T01:37:46.966245+0000","last_clean":"2024-09-12T01:37:46.966245+0000","last_became_active":"2024-09-12T01:37:44.960234+0000","last_became_peered":"2024-09-12T01:37:44.960234+0000","last_unstale":"2024-09-12T01:37:46.966245+0000","last_undegraded":"2024-09-12T01:37:46.966245+0000","last_fullsized":"2024-09-12T01:37:46.966245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:07.399927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961847+0000","last_change":"2024-09-12T01:37:44.961847+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961847+0000","last_undegraded":"2024-09-12T01:37:44.961847+0000","last_fullsized":"2024-09-12T01:37:44.961847+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969414+0000","last_change":"2024-09-12T01:37:44.966599+0000","last_active":"2024-09-12T01:37:44.969414+0000","last_peered":"2024-09-12T01:37:44.969414+0000","last_clean":"2024-09-12T01:37:44.969414+0000","last_became_active":"2024-09-12T01:37:44.966307+0000","last_became_peered":"2024-09-12T01:37:44.966307+0000","last_unstale":"2024-09-12T01:37:44.969414+0000","last_undegraded":"2024-09-12T01:37:44.969414+0000","last_fullsized":"2024-09-12T01:37:44.969414+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.034249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958973+0000","last_change":"2024-09-12T01:37:44.958973+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958973+0000","last_undegraded":"2024-09-12T01:37:44.958973+0000","last_fullsized":"2024-09-12T01:37:44.958973+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.970105+0000","last_change":"2024-09-12T01:37:44.969334+0000","last_active":"2024-09-12T01:37:44.970105+0000","last_peered":"2024-09-12T01:37:44.970105+0000","last_clean":"2024-09-12T01:37:44.970105+0000","last_became_active":"2024-09-12T01:37:44.969042+0000","last_became_peered":"2024-09-12T01:37:44.969042+0000","last_unstale":"2024-09-12T01:37:44.970105+0000","last_undegraded":"2024-09-12T01:37:44.970105+0000","last_fullsized":"2024-09-12T01:37:44.970105+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:09.882425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958352+0000","last_change":"2024-09-12T01:37:44.958352+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958352+0000","last_undegraded":"2024-09-12T01:37:44.958352+0000","last_fullsized":"2024-09-12T01:37:44.958352+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.975211+0000","last_change":"2024-09-12T01:37:44.974432+0000","last_active":"2024-09-12T01:37:44.975211+0000","last_peered":"2024-09-12T01:37:44.975211+0000","last_clean":"2024-09-12T01:37:44.975211+0000","last_became_active":"2024-09-12T01:37:44.974089+0000","last_became_peered":"2024-09-12T01:37:44.974089+0000","last_unstale":"2024-09-12T01:37:44.975211+0000","last_undegraded":"2024-09-12T01:37:44.975211+0000","last_fullsized":"2024-09-12T01:37:44.975211+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:09.882425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.954331+0000","last_change":"2024-09-12T01:37:44.954331+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.954331+0000","last_undegraded":"2024-09-12T01:37:44.954331+0000","last_fullsized":"2024-09-12T01:37:44.954331+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965714+0000","last_change":"2024-09-12T01:37:44.962639+0000","last_active":"2024-09-12T01:37:46.965714+0000","last_peered":"2024-09-12T01:37:46.965714+0000","last_clean":"2024-09-12T01:37:46.965714+0000","last_became_active":"2024-09-12T01:37:44.962334+0000","last_became_peered":"2024-09-12T01:37:44.962334+0000","last_unstale":"2024-09-12T01:37:46.965714+0000","last_undegraded":"2024-09-12T01:37:46.965714+0000","last_fullsized":"2024-09-12T01:37:46.965714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:51.995342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958438+0000","last_change":"2024-09-12T01:37:44.958438+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958438+0000","last_undegraded":"2024-09-12T01:37:44.958438+0000","last_fullsized":"2024-09-12T01:37:44.958438+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969328+0000","last_change":"2024-09-12T01:37:44.967523+0000","last_active":"2024-09-12T01:37:44.969328+0000","last_peered":"2024-09-12T01:37:44.969328+0000","last_clean":"2024-09-12T01:37:44.969328+0000","last_became_active":"2024-09-12T01:37:44.967216+0000","last_became_peered":"2024-09-12T01:37:44.967216+0000","last_unstale":"2024-09-12T01:37:44.969328+0000","last_undegraded":"2024-09-12T01:37:44.969328+0000","last_fullsized":"2024-09-12T01:37:44.969328+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:09.882425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958540+0000","last_change":"2024-09-12T01:37:44.958540+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958540+0000","last_undegraded":"2024-09-12T01:37:44.958540+0000","last_fullsized":"2024-09-12T01:37:44.958540+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.974989+0000","last_change":"2024-09-12T01:37:44.973988+0000","last_active":"2024-09-12T01:37:44.974989+0000","last_peered":"2024-09-12T01:37:44.974989+0000","last_clean":"2024-09-12T01:37:44.974989+0000","last_became_active":"2024-09-12T01:37:44.973403+0000","last_became_peered":"2024-09-12T01:37:44.973403+0000","last_unstale":"2024-09-12T01:37:44.974989+0000","last_undegraded":"2024-09-12T01:37:44.974989+0000","last_fullsized":"2024-09-12T01:37:44.974989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:38.172494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.953487+0000","last_change":"2024-09-12T01:37:44.953487+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.953487+0000","last_undegraded":"2024-09-12T01:37:44.953487+0000","last_fullsized":"2024-09-12T01:37:44.953487+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972785+0000","last_change":"2024-09-12T01:37:44.971512+0000","last_active":"2024-09-12T01:37:44.972785+0000","last_peered":"2024-09-12T01:37:44.972785+0000","last_clean":"2024-09-12T01:37:44.972785+0000","last_became_active":"2024-09-12T01:37:44.970650+0000","last_became_peered":"2024-09-12T01:37:44.970650+0000","last_unstale":"2024-09-12T01:37:44.972785+0000","last_undegraded":"2024-09-12T01:37:44.972785+0000","last_fullsized":"2024-09-12T01:37:44.972785+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:24.034249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.961058+0000","last_change":"2024-09-12T01:37:44.961058+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.961058+0000","last_undegraded":"2024-09-12T01:37:44.961058+0000","last_fullsized":"2024-09-12T01:37:44.961058+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972279+0000","last_change":"2024-09-12T01:37:44.968846+0000","last_active":"2024-09-12T01:37:44.972279+0000","last_peered":"2024-09-12T01:37:44.972279+0000","last_clean":"2024-09-12T01:37:44.972279+0000","last_became_active":"2024-09-12T01:37:44.968560+0000","last_became_peered":"2024-09-12T01:37:44.968560+0000","last_unstale":"2024-09-12T01:37:44.972279+0000","last_undegraded":"2024-09-12T01:37:44.972279+0000","last_fullsized":"2024-09-12T01:37:44.972279+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:42.461240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965823+0000","last_change":"2024-09-12T01:37:45.983036+0000","last_active":"2024-09-12T01:37:46.965823+0000","last_peered":"2024-09-12T01:37:46.965823+0000","last_clean":"2024-09-12T01:37:46.965823+0000","last_became_active":"2024-09-12T01:37:45.982728+0000","last_became_peered":"2024-09-12T01:37:45.982728+0000","last_unstale":"2024-09-12T01:37:46.965823+0000","last_undegraded":"2024-09-12T01:37:46.965823+0000","last_fullsized":"2024-09-12T01:37:46.965823+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:18.427659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965784+0000","last_change":"2024-09-12T01:37:44.970363+0000","last_active":"2024-09-12T01:37:46.965784+0000","last_peered":"2024-09-12T01:37:46.965784+0000","last_clean":"2024-09-12T01:37:46.965784+0000","last_became_active":"2024-09-12T01:37:44.969934+0000","last_became_peered":"2024-09-12T01:37:44.969934+0000","last_unstale":"2024-09-12T01:37:46.965784+0000","last_undegraded":"2024-09-12T01:37:46.965784+0000","last_fullsized":"2024-09-12T01:37:46.965784+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:43.133304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955372+0000","last_change":"2024-09-12T01:37:44.955372+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955372+0000","last_undegraded":"2024-09-12T01:37:44.955372+0000","last_fullsized":"2024-09-12T01:37:44.955372+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973101+0000","last_change":"2024-09-12T01:37:44.971996+0000","last_active":"2024-09-12T01:37:44.973101+0000","last_peered":"2024-09-12T01:37:44.973101+0000","last_clean":"2024-09-12T01:37:44.973101+0000","last_became_active":"2024-09-12T01:37:44.971733+0000","last_became_peered":"2024-09-12T01:37:44.971733+0000","last_unstale":"2024-09-12T01:37:44.973101+0000","last_undegraded":"2024-09-12T01:37:44.973101+0000","last_fullsized":"2024-09-12T01:37:44.973101+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:09.711449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.959951+0000","last_change":"2024-09-12T01:37:44.959951+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.959951+0000","last_undegraded":"2024-09-12T01:37:44.959951+0000","last_fullsized":"2024-09-12T01:37:44.959951+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965602+0000","last_change":"2024-09-12T01:37:44.971190+0000","last_active":"2024-09-12T01:37:46.965602+0000","last_peered":"2024-09-12T01:37:46.965602+0000","last_clean":"2024-09-12T01:37:46.965602+0000","last_became_active":"2024-09-12T01:37:44.970906+0000","last_became_peered":"2024-09-12T01:37:44.970906+0000","last_unstale":"2024-09-12T01:37:46.965602+0000","last_undegraded":"2024-09-12T01:37:46.965602+0000","last_fullsized":"2024-09-12T01:37:46.965602+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:57.572375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.958660+0000","last_change":"2024-09-12T01:37:44.958660+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.958660+0000","last_undegraded":"2024-09-12T01:37:44.958660+0000","last_fullsized":"2024-09-12T01:37:44.958660+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.971193+0000","last_change":"2024-09-12T01:37:44.970013+0000","last_active":"2024-09-12T01:37:44.971193+0000","last_peered":"2024-09-12T01:37:44.971193+0000","last_clean":"2024-09-12T01:37:44.971193+0000","last_became_active":"2024-09-12T01:37:44.969654+0000","last_became_peered":"2024-09-12T01:37:44.969654+0000","last_unstale":"2024-09-12T01:37:44.971193+0000","last_undegraded":"2024-09-12T01:37:44.971193+0000","last_fullsized":"2024-09-12T01:37:44.971193+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:58.402489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.956256+0000","last_change":"2024-09-12T01:37:44.956256+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.956256+0000","last_undegraded":"2024-09-12T01:37:44.956256+0000","last_fullsized":"2024-09-12T01:37:44.956256+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972446+0000","last_change":"2024-09-12T01:37:44.970664+0000","last_active":"2024-09-12T01:37:44.972446+0000","last_peered":"2024-09-12T01:37:44.972446+0000","last_clean":"2024-09-12T01:37:44.972446+0000","last_became_active":"2024-09-12T01:37:44.970398+0000","last_became_peered":"2024-09-12T01:37:44.970398+0000","last_unstale":"2024-09-12T01:37:44.972446+0000","last_undegraded":"2024-09-12T01:37:44.972446+0000","last_fullsized":"2024-09-12T01:37:44.972446+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:47.940491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966137+0000","last_change":"2024-09-12T01:37:45.980042+0000","last_active":"2024-09-12T01:37:46.966137+0000","last_peered":"2024-09-12T01:37:46.966137+0000","last_clean":"2024-09-12T01:37:46.966137+0000","last_became_active":"2024-09-12T01:37:45.978314+0000","last_became_peered":"2024-09-12T01:37:45.978314+0000","last_unstale":"2024-09-12T01:37:46.966137+0000","last_undegraded":"2024-09-12T01:37:46.966137+0000","last_fullsized":"2024-09-12T01:37:46.966137+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:46.861826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.975234+0000","last_change":"2024-09-12T01:37:44.974675+0000","last_active":"2024-09-12T01:37:44.975234+0000","last_peered":"2024-09-12T01:37:44.975234+0000","last_clean":"2024-09-12T01:37:44.975234+0000","last_became_active":"2024-09-12T01:37:44.974293+0000","last_became_peered":"2024-09-12T01:37:44.974293+0000","last_unstale":"2024-09-12T01:37:44.975234+0000","last_undegraded":"2024-09-12T01:37:44.975234+0000","last_fullsized":"2024-09-12T01:37:44.975234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:09.321760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.955245+0000","last_change":"2024-09-12T01:37:44.955245+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.955245+0000","last_undegraded":"2024-09-12T01:37:44.955245+0000","last_fullsized":"2024-09-12T01:37:44.955245+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.972191+0000","last_change":"2024-09-12T01:37:44.970246+0000","last_active":"2024-09-12T01:37:44.972191+0000","last_peered":"2024-09-12T01:37:44.972191+0000","last_clean":"2024-09-12T01:37:44.972191+0000","last_became_active":"2024-09-12T01:37:44.969914+0000","last_became_peered":"2024-09-12T01:37:44.969914+0000","last_unstale":"2024-09-12T01:37:44.972191+0000","last_undegraded":"2024-09-12T01:37:44.972191+0000","last_fullsized":"2024-09-12T01:37:44.972191+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:18.933000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966003+0000","last_change":"2024-09-12T01:37:45.981676+0000","last_active":"2024-09-12T01:37:46.966003+0000","last_peered":"2024-09-12T01:37:46.966003+0000","last_clean":"2024-09-12T01:37:46.966003+0000","last_became_active":"2024-09-12T01:37:45.981323+0000","last_became_peered":"2024-09-12T01:37:45.981323+0000","last_unstale":"2024-09-12T01:37:46.966003+0000","last_undegraded":"2024-09-12T01:37:46.966003+0000","last_fullsized":"2024-09-12T01:37:46.966003+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:48.993545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.973096+0000","last_change":"2024-09-12T01:37:44.970613+0000","last_active":"2024-09-12T01:37:44.973096+0000","last_peered":"2024-09-12T01:37:44.973096+0000","last_clean":"2024-09-12T01:37:44.973096+0000","last_became_active":"2024-09-12T01:37:44.970284+0000","last_became_peered":"2024-09-12T01:37:44.970284+0000","last_unstale":"2024-09-12T01:37:44.973096+0000","last_undegraded":"2024-09-12T01:37:44.973096+0000","last_fullsized":"2024-09-12T01:37:44.973096+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:47.940491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.962345+0000","last_change":"2024-09-12T01:37:44.962345+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.962345+0000","last_undegraded":"2024-09-12T01:37:44.962345+0000","last_fullsized":"2024-09-12T01:37:44.962345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.965660+0000","last_change":"2024-09-12T01:37:44.964928+0000","last_active":"2024-09-12T01:37:44.965660+0000","last_peered":"2024-09-12T01:37:44.965660+0000","last_clean":"2024-09-12T01:37:44.965660+0000","last_became_active":"2024-09-12T01:37:44.964539+0000","last_became_peered":"2024-09-12T01:37:44.964539+0000","last_unstale":"2024-09-12T01:37:44.965660+0000","last_undegraded":"2024-09-12T01:37:44.965660+0000","last_fullsized":"2024-09-12T01:37:44.965660+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:16.673738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.963231+0000","last_change":"2024-09-12T01:37:44.963231+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.963231+0000","last_undegraded":"2024-09-12T01:37:44.963231+0000","last_fullsized":"2024-09-12T01:37:44.963231+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.968975+0000","last_change":"2024-09-12T01:37:44.962377+0000","last_active":"2024-09-12T01:37:44.968975+0000","last_peered":"2024-09-12T01:37:44.968975+0000","last_clean":"2024-09-12T01:37:44.968975+0000","last_became_active":"2024-09-12T01:37:44.962116+0000","last_became_peered":"2024-09-12T01:37:44.962116+0000","last_unstale":"2024-09-12T01:37:44.968975+0000","last_undegraded":"2024-09-12T01:37:44.968975+0000","last_fullsized":"2024-09-12T01:37:44.968975+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:24.716785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.953494+0000","last_change":"2024-09-12T01:37:44.953494+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.953494+0000","last_undegraded":"2024-09-12T01:37:44.953494+0000","last_fullsized":"2024-09-12T01:37:44.953494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.968870+0000","last_change":"2024-09-12T01:37:44.965413+0000","last_active":"2024-09-12T01:37:44.968870+0000","last_peered":"2024-09-12T01:37:44.968870+0000","last_clean":"2024-09-12T01:37:44.968870+0000","last_became_active":"2024-09-12T01:37:44.965122+0000","last_became_peered":"2024-09-12T01:37:44.965122+0000","last_unstale":"2024-09-12T01:37:44.968870+0000","last_undegraded":"2024-09-12T01:37:44.968870+0000","last_fullsized":"2024-09-12T01:37:44.968870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:37.749845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-09-12T01:37:44.960345+0000","last_change":"2024-09-12T01:37:44.960345+0000","last_active":"2024-09-12T01:37:44.940932+0000","last_peered":"2024-09-12T01:37:44.940932+0000","last_clean":"2024-09-12T01:37:44.940932+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:37:44.960345+0000","last_undegraded":"2024-09-12T01:37:44.960345+0000","last_fullsized":"2024-09-12T01:37:44.960345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.969737+0000","last_change":"2024-09-12T01:37:44.968753+0000","last_active":"2024-09-12T01:37:44.969737+0000","last_peered":"2024-09-12T01:37:44.969737+0000","last_clean":"2024-09-12T01:37:44.969737+0000","last_became_active":"2024-09-12T01:37:44.968465+0000","last_became_peered":"2024-09-12T01:37:44.968465+0000","last_unstale":"2024-09-12T01:37:44.969737+0000","last_undegraded":"2024-09-12T01:37:44.969737+0000","last_fullsized":"2024-09-12T01:37:44.969737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:55.452436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":209,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.967587+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:37:44.967587+0000","last_peered":"2024-09-12T01:37:44.967587+0000","last_clean":"2024-09-12T01:37:44.967587+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:37:44.967587+0000","last_undegraded":"2024-09-12T01:37:44.967587+0000","last_fullsized":"2024-09-12T01:37:44.967587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509467,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509467,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28092,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343748,"statfs":{"total":96636764160,"available":96607997952,"internally_reserved":0,"allocated":1089536,"data_stored":783968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35848,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335992,"statfs":{"total":96636764160,"available":96600055808,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31684,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340156,"statfs":{"total":96636764160,"available":96604319744,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509467,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32264,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339576,"statfs":{"total":96636764160,"available":96603725824,"internally_reserved":0,"allocated":1101824,"data_stored":790243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31688,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340152,"statfs":{"total":96636764160,"available":96604315648,"internally_reserved":0,"allocated":507904,"data_stored":199875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":552960,"data_stored":214654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:37:54.372 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:37:54.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.489+0000 7fe5f938d640 1 Processor -- start 2024-09-12T01:37:54.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.489+0000 7fe5f938d640 1 -- start start 2024-09-12T01:37:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f938d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5f415c2b0 0x7fe5f40b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f938d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5f40b72f0 0x7fe5f415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f938d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe5f415f030 0x7fe5f406f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f938d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe5f415fb10 con 0x7fe5f40b72f0 2024-09-12T01:37:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f938d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe5f40b5900 con 0x7fe5f415f030 2024-09-12T01:37:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f938d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f415f830 con 0x7fe5f415c2b0 2024-09-12T01:37:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f27fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5f40b72f0 0x7fe5f415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f27fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5f40b72f0 0x7fe5f415eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42950/0 (socket says 172.21.15.60:42950) 2024-09-12T01:37:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f27fc640 1 -- 172.21.15.60:0/4088034231 learned_addr learned my addr 172.21.15.60:0/4088034231 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:54.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f2ffd640 1 --2- 172.21.15.60:0/4088034231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5f415c2b0 0x7fe5f40b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f37fe640 1 --2- 172.21.15.60:0/4088034231 >> v2:172.21.15.105:3300/0 conn(0x7fe5f415f030 0x7fe5f406f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f27fc640 1 -- 172.21.15.60:0/4088034231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5f415c2b0 msgr2=0x7fe5f40b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f27fc640 1 --2- 172.21.15.60:0/4088034231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5f415c2b0 0x7fe5f40b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f27fc640 1 -- 172.21.15.60:0/4088034231 >> v2:172.21.15.105:3300/0 conn(0x7fe5f415f030 msgr2=0x7fe5f406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f27fc640 1 --2- 172.21.15.60:0/4088034231 >> v2:172.21.15.105:3300/0 conn(0x7fe5f415f030 0x7fe5f406f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.490+0000 7fe5f27fc640 1 -- 172.21.15.60:0/4088034231 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f406ce30 con 0x7fe5f40b72f0 2024-09-12T01:37:54.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.491+0000 7fe5f27fc640 1 --2- 172.21.15.60:0/4088034231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f40b72f0 0x7fe5f415eaf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4070ff0 tx=0x7fe5dc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a80b836e7801a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:54.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.491+0000 7fe5f1ffb640 1 -- 172.21.15.60:0/4088034231 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc037070 con 0x7fe5f40b72f0 2024-09-12T01:37:54.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.491+0000 7fe5f1ffb640 1 -- 172.21.15.60:0/4088034231 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5dc032440 con 0x7fe5f40b72f0 2024-09-12T01:37:54.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.491+0000 7fe5f1ffb640 1 -- 172.21.15.60:0/4088034231 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc032810 con 0x7fe5f40b72f0 2024-09-12T01:37:54.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.492+0000 7fe5f938d640 1 -- 172.21.15.60:0/4088034231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f40b72f0 msgr2=0x7fe5f415eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:54.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.492+0000 7fe5f938d640 1 --2- 172.21.15.60:0/4088034231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f40b72f0 0x7fe5f415eaf0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe5f4070ff0 tx=0x7fe5dc02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.492+0000 7fe5f938d640 1 -- 172.21.15.60:0/4088034231 shutdown_connections 2024-09-12T01:37:54.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.492+0000 7fe5f938d640 1 --2- 172.21.15.60:0/4088034231 >> v2:172.21.15.105:3300/0 conn(0x7fe5f415f030 0x7fe5f406f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.492+0000 7fe5f938d640 1 --2- 172.21.15.60:0/4088034231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f40b72f0 0x7fe5f415eaf0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.492+0000 7fe5f938d640 1 --2- 172.21.15.60:0/4088034231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5f415c2b0 0x7fe5f40b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.492+0000 7fe5f938d640 1 -- 172.21.15.60:0/4088034231 >> 172.21.15.60:0/4088034231 conn(0x7fe5f40b4240 msgr2=0x7fe5f40b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:54.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.492+0000 7fe5f938d640 1 -- 172.21.15.60:0/4088034231 shutdown_connections 2024-09-12T01:37:54.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.492+0000 7fe5f938d640 1 -- 172.21.15.60:0/4088034231 wait complete. 2024-09-12T01:37:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.493+0000 7fe5f938d640 1 Processor -- start 2024-09-12T01:37:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.494+0000 7fe5f938d640 1 -- start start 2024-09-12T01:37:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.494+0000 7fe5f938d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f40b72f0 0x7fe5f4159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.494+0000 7fe5f938d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5f415c2b0 0x7fe5f4145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.494+0000 7fe5f938d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5f415f030 0x7fe5f4145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.494+0000 7fe5f938d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f40b7730 con 0x7fe5f40b72f0 2024-09-12T01:37:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.494+0000 7fe5f938d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f406d3f0 con 0x7fe5f415f030 2024-09-12T01:37:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.494+0000 7fe5f938d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f415f4e0 con 0x7fe5f415c2b0 2024-09-12T01:37:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.494+0000 7fe5f2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f40b72f0 0x7fe5f4159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:54.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.494+0000 7fe5f2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f40b72f0 0x7fe5f4159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42958/0 (socket says 172.21.15.60:42958) 2024-09-12T01:37:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.494+0000 7fe5f2ffd640 1 -- 172.21.15.60:0/411921782 learned_addr learned my addr 172.21.15.60:0/411921782 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.494+0000 7fe5f27fc640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5f415c2b0 0x7fe5f4145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.495+0000 7fe5f37fe640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5f415f030 0x7fe5f4145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.495+0000 7fe5f2ffd640 1 -- 172.21.15.60:0/411921782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5f415c2b0 msgr2=0x7fe5f4145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.495+0000 7fe5f2ffd640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5f415c2b0 0x7fe5f4145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.495+0000 7fe5f2ffd640 1 -- 172.21.15.60:0/411921782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5f415f030 msgr2=0x7fe5f4145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.495+0000 7fe5f2ffd640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5f415f030 0x7fe5f4145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.495+0000 7fe5f2ffd640 1 -- 172.21.15.60:0/411921782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f415a130 con 0x7fe5f40b72f0 2024-09-12T01:37:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.495+0000 7fe5f2ffd640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f40b72f0 0x7fe5f4159bf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4007f20 tx=0x7fe5e400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.495+0000 7fe5eb7fe640 1 -- 172.21.15.60:0/411921782 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4014620 con 0x7fe5f40b72f0 2024-09-12T01:37:54.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.495+0000 7fe5eb7fe640 1 -- 172.21.15.60:0/411921782 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e4019070 con 0x7fe5f40b72f0 2024-09-12T01:37:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.495+0000 7fe5f938d640 1 -- 172.21.15.60:0/411921782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f40cdda0 con 0x7fe5f40b72f0 2024-09-12T01:37:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.495+0000 7fe5eb7fe640 1 -- 172.21.15.60:0/411921782 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4014a00 con 0x7fe5f40b72f0 2024-09-12T01:37:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.495+0000 7fe5f938d640 1 -- 172.21.15.60:0/411921782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f40ce640 con 0x7fe5f40b72f0 2024-09-12T01:37:54.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.496+0000 7fe5f938d640 1 -- 172.21.15.60:0/411921782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f415eaf0 con 0x7fe5f40b72f0 2024-09-12T01:37:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.497+0000 7fe5eb7fe640 1 -- 172.21.15.60:0/411921782 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5e4014ba0 con 0x7fe5f40b72f0 2024-09-12T01:37:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.497+0000 7fe5eb7fe640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe5d406be30 0x7fe5d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.497+0000 7fe5eb7fe640 1 -- 172.21.15.60:0/411921782 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fe5e408b610 con 0x7fe5f40b72f0 2024-09-12T01:37:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.497+0000 7fe5f27fc640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe5d406be30 0x7fe5d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:54.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.498+0000 7fe5f27fc640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe5d406be30 0x7fe5d406e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc034000 tx=0x7fe5dc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:54.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.502+0000 7fe5eb7fe640 1 -- 172.21.15.60:0/411921782 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5e4059960 con 0x7fe5f40b72f0 2024-09-12T01:37:54.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.679+0000 7fe5f938d640 1 -- 172.21.15.60:0/411921782 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5f40693c0 con 0x7fe5d406be30 2024-09-12T01:37:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.685+0000 7fe5eb7fe640 1 -- 172.21.15.60:0/411921782 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7fe5f40693c0 con 0x7fe5d406be30 2024-09-12T01:37:54.687 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:54.688 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:37:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.688+0000 7fe5f938d640 1 -- 172.21.15.60:0/411921782 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe5d406be30 msgr2=0x7fe5d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.688+0000 7fe5f938d640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe5d406be30 0x7fe5d406e2f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc034000 tx=0x7fe5dc02e000 comp rx=0 tx=0).stop 2024-09-12T01:37:54.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.688+0000 7fe5f938d640 1 -- 172.21.15.60:0/411921782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f40b72f0 msgr2=0x7fe5f4159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.688+0000 7fe5f938d640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f40b72f0 0x7fe5f4159bf0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4007f20 tx=0x7fe5e400e570 comp rx=0 tx=0).stop 2024-09-12T01:37:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.688+0000 7fe5f938d640 1 -- 172.21.15.60:0/411921782 shutdown_connections 2024-09-12T01:37:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.688+0000 7fe5f938d640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5f415f030 0x7fe5f4145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.688+0000 7fe5f938d640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe5d406be30 0x7fe5d406e2f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.688+0000 7fe5f938d640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5f415c2b0 0x7fe5f4145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.688+0000 7fe5f938d640 1 --2- 172.21.15.60:0/411921782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5f40b72f0 0x7fe5f4159bf0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.688+0000 7fe5f938d640 1 -- 172.21.15.60:0/411921782 >> 172.21.15.60:0/411921782 conn(0x7fe5f40b4240 msgr2=0x7fe5f415d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.688+0000 7fe5f938d640 1 -- 172.21.15.60:0/411921782 shutdown_connections 2024-09-12T01:37:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.688+0000 7fe5f938d640 1 -- 172.21.15.60:0/411921782 wait complete. 2024-09-12T01:37:54.698 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2024-09-12T01:37:54.286487+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246584,"kb_used_data":5384,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754728136,"statfs":{"total":773094113280,"available":772841611264,"internally_reserved":0,"allocated":5513216,"data_stored":2889156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.335228"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117768+0000","last_change":"2024-09-12T01:37:45.976676+0000","last_active":"2024-09-12T01:37:48.117768+0000","last_peered":"2024-09-12T01:37:48.117768+0000","last_clean":"2024-09-12T01:37:48.117768+0000","last_became_active":"2024-09-12T01:37:45.975333+0000","last_became_peered":"2024-09-12T01:37:45.975333+0000","last_unstale":"2024-09-12T01:37:48.117768+0000","last_undegraded":"2024-09-12T01:37:48.117768+0000","last_fullsized":"2024-09-12T01:37:48.117768+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:40.504408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.964976+0000","last_change":"2024-09-12T01:37:45.984335+0000","last_active":"2024-09-12T01:37:46.964976+0000","last_peered":"2024-09-12T01:37:46.964976+0000","last_clean":"2024-09-12T01:37:46.964976+0000","last_became_active":"2024-09-12T01:37:45.984055+0000","last_became_peered":"2024-09-12T01:37:45.984055+0000","last_unstale":"2024-09-12T01:37:46.964976+0000","last_undegraded":"2024-09-12T01:37:46.964976+0000","last_fullsized":"2024-09-12T01:37:46.964976+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:19.524067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117284+0000","last_change":"2024-09-12T01:37:45.985195+0000","last_active":"2024-09-12T01:37:48.117284+0000","last_peered":"2024-09-12T01:37:48.117284+0000","last_clean":"2024-09-12T01:37:48.117284+0000","last_became_active":"2024-09-12T01:37:45.984915+0000","last_became_peered":"2024-09-12T01:37:45.984915+0000","last_unstale":"2024-09-12T01:37:48.117284+0000","last_undegraded":"2024-09-12T01:37:48.117284+0000","last_fullsized":"2024-09-12T01:37:48.117284+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:05.227909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.967075+0000","last_change":"2024-09-12T01:37:45.962924+0000","last_active":"2024-09-12T01:37:46.967075+0000","last_peered":"2024-09-12T01:37:46.967075+0000","last_clean":"2024-09-12T01:37:46.967075+0000","last_became_active":"2024-09-12T01:37:45.962635+0000","last_became_peered":"2024-09-12T01:37:45.962635+0000","last_unstale":"2024-09-12T01:37:46.967075+0000","last_undegraded":"2024-09-12T01:37:46.967075+0000","last_fullsized":"2024-09-12T01:37:46.967075+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:36.171360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117189+0000","last_change":"2024-09-12T01:37:45.968913+0000","last_active":"2024-09-12T01:37:48.117189+0000","last_peered":"2024-09-12T01:37:48.117189+0000","last_clean":"2024-09-12T01:37:48.117189+0000","last_became_active":"2024-09-12T01:37:45.968615+0000","last_became_peered":"2024-09-12T01:37:45.968615+0000","last_unstale":"2024-09-12T01:37:48.117189+0000","last_undegraded":"2024-09-12T01:37:48.117189+0000","last_fullsized":"2024-09-12T01:37:48.117189+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:24.824982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116883+0000","last_change":"2024-09-12T01:37:45.975325+0000","last_active":"2024-09-12T01:37:48.116883+0000","last_peered":"2024-09-12T01:37:48.116883+0000","last_clean":"2024-09-12T01:37:48.116883+0000","last_became_active":"2024-09-12T01:37:45.974985+0000","last_became_peered":"2024-09-12T01:37:45.974985+0000","last_unstale":"2024-09-12T01:37:48.116883+0000","last_undegraded":"2024-09-12T01:37:48.116883+0000","last_fullsized":"2024-09-12T01:37:48.116883+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:01.777883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117213+0000","last_change":"2024-09-12T01:37:45.972989+0000","last_active":"2024-09-12T01:37:48.117213+0000","last_peered":"2024-09-12T01:37:48.117213+0000","last_clean":"2024-09-12T01:37:48.117213+0000","last_became_active":"2024-09-12T01:37:45.965185+0000","last_became_peered":"2024-09-12T01:37:45.965185+0000","last_unstale":"2024-09-12T01:37:48.117213+0000","last_undegraded":"2024-09-12T01:37:48.117213+0000","last_fullsized":"2024-09-12T01:37:48.117213+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:49.113545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965673+0000","last_change":"2024-09-12T01:37:45.963595+0000","last_active":"2024-09-12T01:37:46.965673+0000","last_peered":"2024-09-12T01:37:46.965673+0000","last_clean":"2024-09-12T01:37:46.965673+0000","last_became_active":"2024-09-12T01:37:45.963293+0000","last_became_peered":"2024-09-12T01:37:45.963293+0000","last_unstale":"2024-09-12T01:37:46.965673+0000","last_undegraded":"2024-09-12T01:37:46.965673+0000","last_fullsized":"2024-09-12T01:37:46.965673+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:25.114250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117315+0000","last_change":"2024-09-12T01:37:45.979068+0000","last_active":"2024-09-12T01:37:48.117315+0000","last_peered":"2024-09-12T01:37:48.117315+0000","last_clean":"2024-09-12T01:37:48.117315+0000","last_became_active":"2024-09-12T01:37:45.978782+0000","last_became_peered":"2024-09-12T01:37:45.978782+0000","last_unstale":"2024-09-12T01:37:48.117315+0000","last_undegraded":"2024-09-12T01:37:48.117315+0000","last_fullsized":"2024-09-12T01:37:48.117315+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:00.110098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966202+0000","last_change":"2024-09-12T01:37:45.978987+0000","last_active":"2024-09-12T01:37:46.966202+0000","last_peered":"2024-09-12T01:37:46.966202+0000","last_clean":"2024-09-12T01:37:46.966202+0000","last_became_active":"2024-09-12T01:37:45.978701+0000","last_became_peered":"2024-09-12T01:37:45.978701+0000","last_unstale":"2024-09-12T01:37:46.966202+0000","last_undegraded":"2024-09-12T01:37:46.966202+0000","last_fullsized":"2024-09-12T01:37:46.966202+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:31.220991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966723+0000","last_change":"2024-09-12T01:37:45.968926+0000","last_active":"2024-09-12T01:37:46.966723+0000","last_peered":"2024-09-12T01:37:46.966723+0000","last_clean":"2024-09-12T01:37:46.966723+0000","last_became_active":"2024-09-12T01:37:45.968667+0000","last_became_peered":"2024-09-12T01:37:45.968667+0000","last_unstale":"2024-09-12T01:37:46.966723+0000","last_undegraded":"2024-09-12T01:37:46.966723+0000","last_fullsized":"2024-09-12T01:37:46.966723+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:56.488826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.964681+0000","last_change":"2024-09-12T01:37:45.970215+0000","last_active":"2024-09-12T01:37:46.964681+0000","last_peered":"2024-09-12T01:37:46.964681+0000","last_clean":"2024-09-12T01:37:46.964681+0000","last_became_active":"2024-09-12T01:37:45.968093+0000","last_became_peered":"2024-09-12T01:37:45.968093+0000","last_unstale":"2024-09-12T01:37:46.964681+0000","last_undegraded":"2024-09-12T01:37:46.964681+0000","last_fullsized":"2024-09-12T01:37:46.964681+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:25.114250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116792+0000","last_change":"2024-09-12T01:37:45.976495+0000","last_active":"2024-09-12T01:37:48.116792+0000","last_peered":"2024-09-12T01:37:48.116792+0000","last_clean":"2024-09-12T01:37:48.116792+0000","last_became_active":"2024-09-12T01:37:45.976207+0000","last_became_peered":"2024-09-12T01:37:45.976207+0000","last_unstale":"2024-09-12T01:37:48.116792+0000","last_undegraded":"2024-09-12T01:37:48.116792+0000","last_fullsized":"2024-09-12T01:37:48.116792+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.872675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966690+0000","last_change":"2024-09-12T01:37:45.979676+0000","last_active":"2024-09-12T01:37:46.966690+0000","last_peered":"2024-09-12T01:37:46.966690+0000","last_clean":"2024-09-12T01:37:46.966690+0000","last_became_active":"2024-09-12T01:37:45.979351+0000","last_became_peered":"2024-09-12T01:37:45.979351+0000","last_unstale":"2024-09-12T01:37:46.966690+0000","last_undegraded":"2024-09-12T01:37:46.966690+0000","last_fullsized":"2024-09-12T01:37:46.966690+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:14.558569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966366+0000","last_change":"2024-09-12T01:37:45.976535+0000","last_active":"2024-09-12T01:37:46.966366+0000","last_peered":"2024-09-12T01:37:46.966366+0000","last_clean":"2024-09-12T01:37:46.966366+0000","last_became_active":"2024-09-12T01:37:45.976223+0000","last_became_peered":"2024-09-12T01:37:45.976223+0000","last_unstale":"2024-09-12T01:37:46.966366+0000","last_undegraded":"2024-09-12T01:37:46.966366+0000","last_fullsized":"2024-09-12T01:37:46.966366+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:19.524067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116595+0000","last_change":"2024-09-12T01:37:45.971393+0000","last_active":"2024-09-12T01:37:48.116595+0000","last_peered":"2024-09-12T01:37:48.116595+0000","last_clean":"2024-09-12T01:37:48.116595+0000","last_became_active":"2024-09-12T01:37:45.970672+0000","last_became_peered":"2024-09-12T01:37:45.970672+0000","last_unstale":"2024-09-12T01:37:48.116595+0000","last_undegraded":"2024-09-12T01:37:48.116595+0000","last_fullsized":"2024-09-12T01:37:48.116595+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:25.114250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965004+0000","last_change":"2024-09-12T01:37:45.969769+0000","last_active":"2024-09-12T01:37:46.965004+0000","last_peered":"2024-09-12T01:37:46.965004+0000","last_clean":"2024-09-12T01:37:46.965004+0000","last_became_active":"2024-09-12T01:37:45.969496+0000","last_became_peered":"2024-09-12T01:37:45.969496+0000","last_unstale":"2024-09-12T01:37:46.965004+0000","last_undegraded":"2024-09-12T01:37:46.965004+0000","last_fullsized":"2024-09-12T01:37:46.965004+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:40.504408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117502+0000","last_change":"2024-09-12T01:37:45.974904+0000","last_active":"2024-09-12T01:37:48.117502+0000","last_peered":"2024-09-12T01:37:48.117502+0000","last_clean":"2024-09-12T01:37:48.117502+0000","last_became_active":"2024-09-12T01:37:45.974598+0000","last_became_peered":"2024-09-12T01:37:45.974598+0000","last_unstale":"2024-09-12T01:37:48.117502+0000","last_undegraded":"2024-09-12T01:37:48.117502+0000","last_fullsized":"2024-09-12T01:37:48.117502+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:48.630385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117286+0000","last_change":"2024-09-12T01:37:45.974424+0000","last_active":"2024-09-12T01:37:48.117286+0000","last_peered":"2024-09-12T01:37:48.117286+0000","last_clean":"2024-09-12T01:37:48.117286+0000","last_became_active":"2024-09-12T01:37:45.970474+0000","last_became_peered":"2024-09-12T01:37:45.970474+0000","last_unstale":"2024-09-12T01:37:48.117286+0000","last_undegraded":"2024-09-12T01:37:48.117286+0000","last_fullsized":"2024-09-12T01:37:48.117286+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:43.118511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966129+0000","last_change":"2024-09-12T01:37:45.980489+0000","last_active":"2024-09-12T01:37:46.966129+0000","last_peered":"2024-09-12T01:37:46.966129+0000","last_clean":"2024-09-12T01:37:46.966129+0000","last_became_active":"2024-09-12T01:37:45.979971+0000","last_became_peered":"2024-09-12T01:37:45.979971+0000","last_unstale":"2024-09-12T01:37:46.966129+0000","last_undegraded":"2024-09-12T01:37:46.966129+0000","last_fullsized":"2024-09-12T01:37:46.966129+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:17.192041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.967381+0000","last_change":"2024-09-12T01:37:45.960592+0000","last_active":"2024-09-12T01:37:46.967381+0000","last_peered":"2024-09-12T01:37:46.967381+0000","last_clean":"2024-09-12T01:37:46.967381+0000","last_became_active":"2024-09-12T01:37:45.960305+0000","last_became_peered":"2024-09-12T01:37:45.960305+0000","last_unstale":"2024-09-12T01:37:46.967381+0000","last_undegraded":"2024-09-12T01:37:46.967381+0000","last_fullsized":"2024-09-12T01:37:46.967381+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:59.408370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116884+0000","last_change":"2024-09-12T01:37:45.977796+0000","last_active":"2024-09-12T01:37:48.116884+0000","last_peered":"2024-09-12T01:37:48.116884+0000","last_clean":"2024-09-12T01:37:48.116884+0000","last_became_active":"2024-09-12T01:37:45.977536+0000","last_became_peered":"2024-09-12T01:37:45.977536+0000","last_unstale":"2024-09-12T01:37:48.116884+0000","last_undegraded":"2024-09-12T01:37:48.116884+0000","last_fullsized":"2024-09-12T01:37:48.116884+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:24.623466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117536+0000","last_change":"2024-09-12T01:37:45.973033+0000","last_active":"2024-09-12T01:37:48.117536+0000","last_peered":"2024-09-12T01:37:48.117536+0000","last_clean":"2024-09-12T01:37:48.117536+0000","last_became_active":"2024-09-12T01:37:45.965903+0000","last_became_peered":"2024-09-12T01:37:45.965903+0000","last_unstale":"2024-09-12T01:37:48.117536+0000","last_undegraded":"2024-09-12T01:37:48.117536+0000","last_fullsized":"2024-09-12T01:37:48.117536+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:52.987111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.964467+0000","last_change":"2024-09-12T01:37:45.968060+0000","last_active":"2024-09-12T01:37:46.964467+0000","last_peered":"2024-09-12T01:37:46.964467+0000","last_clean":"2024-09-12T01:37:46.964467+0000","last_became_active":"2024-09-12T01:37:45.967711+0000","last_became_peered":"2024-09-12T01:37:45.967711+0000","last_unstale":"2024-09-12T01:37:46.964467+0000","last_undegraded":"2024-09-12T01:37:46.964467+0000","last_fullsized":"2024-09-12T01:37:46.964467+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:05.872675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117899+0000","last_change":"2024-09-12T01:37:45.976390+0000","last_active":"2024-09-12T01:37:48.117899+0000","last_peered":"2024-09-12T01:37:48.117899+0000","last_clean":"2024-09-12T01:37:48.117899+0000","last_became_active":"2024-09-12T01:37:45.974938+0000","last_became_peered":"2024-09-12T01:37:45.974938+0000","last_unstale":"2024-09-12T01:37:48.117899+0000","last_undegraded":"2024-09-12T01:37:48.117899+0000","last_fullsized":"2024-09-12T01:37:48.117899+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:38.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.967100+0000","last_change":"2024-09-12T01:37:45.969773+0000","last_active":"2024-09-12T01:37:46.967100+0000","last_peered":"2024-09-12T01:37:46.967100+0000","last_clean":"2024-09-12T01:37:46.967100+0000","last_became_active":"2024-09-12T01:37:45.969493+0000","last_became_peered":"2024-09-12T01:37:45.969493+0000","last_unstale":"2024-09-12T01:37:46.967100+0000","last_undegraded":"2024-09-12T01:37:46.967100+0000","last_fullsized":"2024-09-12T01:37:46.967100+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:33.460996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116796+0000","last_change":"2024-09-12T01:37:45.972040+0000","last_active":"2024-09-12T01:37:48.116796+0000","last_peered":"2024-09-12T01:37:48.116796+0000","last_clean":"2024-09-12T01:37:48.116796+0000","last_became_active":"2024-09-12T01:37:45.971723+0000","last_became_peered":"2024-09-12T01:37:45.971723+0000","last_unstale":"2024-09-12T01:37:48.116796+0000","last_undegraded":"2024-09-12T01:37:48.116796+0000","last_fullsized":"2024-09-12T01:37:48.116796+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:39.717720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116892+0000","last_change":"2024-09-12T01:37:45.961143+0000","last_active":"2024-09-12T01:37:48.116892+0000","last_peered":"2024-09-12T01:37:48.116892+0000","last_clean":"2024-09-12T01:37:48.116892+0000","last_became_active":"2024-09-12T01:37:45.960791+0000","last_became_peered":"2024-09-12T01:37:45.960791+0000","last_unstale":"2024-09-12T01:37:48.116892+0000","last_undegraded":"2024-09-12T01:37:48.116892+0000","last_fullsized":"2024-09-12T01:37:48.116892+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:27.806038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117351+0000","last_change":"2024-09-12T01:37:45.985109+0000","last_active":"2024-09-12T01:37:48.117351+0000","last_peered":"2024-09-12T01:37:48.117351+0000","last_clean":"2024-09-12T01:37:48.117351+0000","last_became_active":"2024-09-12T01:37:45.984807+0000","last_became_peered":"2024-09-12T01:37:45.984807+0000","last_unstale":"2024-09-12T01:37:48.117351+0000","last_undegraded":"2024-09-12T01:37:48.117351+0000","last_fullsized":"2024-09-12T01:37:48.117351+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:19.524067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.964520+0000","last_change":"2024-09-12T01:37:45.966191+0000","last_active":"2024-09-12T01:37:46.964520+0000","last_peered":"2024-09-12T01:37:46.964520+0000","last_clean":"2024-09-12T01:37:46.964520+0000","last_became_active":"2024-09-12T01:37:45.965887+0000","last_became_peered":"2024-09-12T01:37:45.965887+0000","last_unstale":"2024-09-12T01:37:46.964520+0000","last_undegraded":"2024-09-12T01:37:46.964520+0000","last_fullsized":"2024-09-12T01:37:46.964520+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:00.110098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116523+0000","last_change":"2024-09-12T01:37:45.968347+0000","last_active":"2024-09-12T01:37:48.116523+0000","last_peered":"2024-09-12T01:37:48.116523+0000","last_clean":"2024-09-12T01:37:48.116523+0000","last_became_active":"2024-09-12T01:37:45.967999+0000","last_became_peered":"2024-09-12T01:37:45.967999+0000","last_unstale":"2024-09-12T01:37:48.116523+0000","last_undegraded":"2024-09-12T01:37:48.116523+0000","last_fullsized":"2024-09-12T01:37:48.116523+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:14.401968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965907+0000","last_change":"2024-09-12T01:37:45.967205+0000","last_active":"2024-09-12T01:37:46.965907+0000","last_peered":"2024-09-12T01:37:46.965907+0000","last_clean":"2024-09-12T01:37:46.965907+0000","last_became_active":"2024-09-12T01:37:45.965407+0000","last_became_peered":"2024-09-12T01:37:45.965407+0000","last_unstale":"2024-09-12T01:37:46.965907+0000","last_undegraded":"2024-09-12T01:37:46.965907+0000","last_fullsized":"2024-09-12T01:37:46.965907+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:24.824982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117306+0000","last_change":"2024-09-12T01:37:45.983159+0000","last_active":"2024-09-12T01:37:48.117306+0000","last_peered":"2024-09-12T01:37:48.117306+0000","last_clean":"2024-09-12T01:37:48.117306+0000","last_became_active":"2024-09-12T01:37:45.982840+0000","last_became_peered":"2024-09-12T01:37:45.982840+0000","last_unstale":"2024-09-12T01:37:48.117306+0000","last_undegraded":"2024-09-12T01:37:48.117306+0000","last_fullsized":"2024-09-12T01:37:48.117306+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:10.888306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117269+0000","last_change":"2024-09-12T01:37:44.967687+0000","last_active":"2024-09-12T01:37:48.117269+0000","last_peered":"2024-09-12T01:37:48.117269+0000","last_clean":"2024-09-12T01:37:48.117269+0000","last_became_active":"2024-09-12T01:37:44.967371+0000","last_became_peered":"2024-09-12T01:37:44.967371+0000","last_unstale":"2024-09-12T01:37:48.117269+0000","last_undegraded":"2024-09-12T01:37:48.117269+0000","last_fullsized":"2024-09-12T01:37:48.117269+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:59.799350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.118024+0000","last_change":"2024-09-12T01:37:45.969769+0000","last_active":"2024-09-12T01:37:48.118024+0000","last_peered":"2024-09-12T01:37:48.118024+0000","last_clean":"2024-09-12T01:37:48.118024+0000","last_became_active":"2024-09-12T01:37:45.969498+0000","last_became_peered":"2024-09-12T01:37:45.969498+0000","last_unstale":"2024-09-12T01:37:48.118024+0000","last_undegraded":"2024-09-12T01:37:48.118024+0000","last_fullsized":"2024-09-12T01:37:48.118024+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:56.488826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116917+0000","last_change":"2024-09-12T01:37:44.961291+0000","last_active":"2024-09-12T01:37:48.116917+0000","last_peered":"2024-09-12T01:37:48.116917+0000","last_clean":"2024-09-12T01:37:48.116917+0000","last_became_active":"2024-09-12T01:37:44.960579+0000","last_became_peered":"2024-09-12T01:37:44.960579+0000","last_unstale":"2024-09-12T01:37:48.116917+0000","last_undegraded":"2024-09-12T01:37:48.116917+0000","last_fullsized":"2024-09-12T01:37:48.116917+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:58.490388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.964830+0000","last_change":"2024-09-12T01:37:45.984346+0000","last_active":"2024-09-12T01:37:46.964830+0000","last_peered":"2024-09-12T01:37:46.964830+0000","last_clean":"2024-09-12T01:37:46.964830+0000","last_became_active":"2024-09-12T01:37:45.984086+0000","last_became_peered":"2024-09-12T01:37:45.984086+0000","last_unstale":"2024-09-12T01:37:46.964830+0000","last_undegraded":"2024-09-12T01:37:46.964830+0000","last_fullsized":"2024-09-12T01:37:46.964830+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:43.118511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116679+0000","last_change":"2024-09-12T01:37:44.970297+0000","last_active":"2024-09-12T01:37:48.116679+0000","last_peered":"2024-09-12T01:37:48.116679+0000","last_clean":"2024-09-12T01:37:48.116679+0000","last_became_active":"2024-09-12T01:37:44.969412+0000","last_became_peered":"2024-09-12T01:37:44.969412+0000","last_unstale":"2024-09-12T01:37:48.116679+0000","last_undegraded":"2024-09-12T01:37:48.116679+0000","last_fullsized":"2024-09-12T01:37:48.116679+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:09.321760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966748+0000","last_change":"2024-09-12T01:37:45.962199+0000","last_active":"2024-09-12T01:37:46.966748+0000","last_peered":"2024-09-12T01:37:46.966748+0000","last_clean":"2024-09-12T01:37:46.966748+0000","last_became_active":"2024-09-12T01:37:45.961912+0000","last_became_peered":"2024-09-12T01:37:45.961912+0000","last_unstale":"2024-09-12T01:37:46.966748+0000","last_undegraded":"2024-09-12T01:37:46.966748+0000","last_fullsized":"2024-09-12T01:37:46.966748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:19.153430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116990+0000","last_change":"2024-09-12T01:37:44.960326+0000","last_active":"2024-09-12T01:37:48.116990+0000","last_peered":"2024-09-12T01:37:48.116990+0000","last_clean":"2024-09-12T01:37:48.116990+0000","last_became_active":"2024-09-12T01:37:44.960035+0000","last_became_peered":"2024-09-12T01:37:44.960035+0000","last_unstale":"2024-09-12T01:37:48.116990+0000","last_undegraded":"2024-09-12T01:37:48.116990+0000","last_fullsized":"2024-09-12T01:37:48.116990+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:40.043165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116984+0000","last_change":"2024-09-12T01:37:45.976790+0000","last_active":"2024-09-12T01:37:48.116984+0000","last_peered":"2024-09-12T01:37:48.116984+0000","last_clean":"2024-09-12T01:37:48.116984+0000","last_became_active":"2024-09-12T01:37:45.976406+0000","last_became_peered":"2024-09-12T01:37:45.976406+0000","last_unstale":"2024-09-12T01:37:48.116984+0000","last_undegraded":"2024-09-12T01:37:48.116984+0000","last_fullsized":"2024-09-12T01:37:48.116984+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:14.300834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117013+0000","last_change":"2024-09-12T01:37:44.963126+0000","last_active":"2024-09-12T01:37:48.117013+0000","last_peered":"2024-09-12T01:37:48.117013+0000","last_clean":"2024-09-12T01:37:48.117013+0000","last_became_active":"2024-09-12T01:37:44.962716+0000","last_became_peered":"2024-09-12T01:37:44.962716+0000","last_unstale":"2024-09-12T01:37:48.117013+0000","last_undegraded":"2024-09-12T01:37:48.117013+0000","last_fullsized":"2024-09-12T01:37:48.117013+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:56.359552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965845+0000","last_change":"2024-09-12T01:37:45.979316+0000","last_active":"2024-09-12T01:37:46.965845+0000","last_peered":"2024-09-12T01:37:46.965845+0000","last_clean":"2024-09-12T01:37:46.965845+0000","last_became_active":"2024-09-12T01:37:45.979057+0000","last_became_peered":"2024-09-12T01:37:45.979057+0000","last_unstale":"2024-09-12T01:37:46.965845+0000","last_undegraded":"2024-09-12T01:37:46.965845+0000","last_fullsized":"2024-09-12T01:37:46.965845+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:53.791353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117087+0000","last_change":"2024-09-12T01:37:44.971445+0000","last_active":"2024-09-12T01:37:48.117087+0000","last_peered":"2024-09-12T01:37:48.117087+0000","last_clean":"2024-09-12T01:37:48.117087+0000","last_became_active":"2024-09-12T01:37:44.971101+0000","last_became_peered":"2024-09-12T01:37:44.971101+0000","last_unstale":"2024-09-12T01:37:48.117087+0000","last_undegraded":"2024-09-12T01:37:48.117087+0000","last_fullsized":"2024-09-12T01:37:48.117087+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:24.178887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965690+0000","last_change":"2024-09-12T01:37:45.978821+0000","last_active":"2024-09-12T01:37:46.965690+0000","last_peered":"2024-09-12T01:37:46.965690+0000","last_clean":"2024-09-12T01:37:46.965690+0000","last_became_active":"2024-09-12T01:37:45.978351+0000","last_became_peered":"2024-09-12T01:37:45.978351+0000","last_unstale":"2024-09-12T01:37:46.965690+0000","last_undegraded":"2024-09-12T01:37:46.965690+0000","last_fullsized":"2024-09-12T01:37:46.965690+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.466839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116552+0000","last_change":"2024-09-12T01:37:44.971595+0000","last_active":"2024-09-12T01:37:48.116552+0000","last_peered":"2024-09-12T01:37:48.116552+0000","last_clean":"2024-09-12T01:37:48.116552+0000","last_became_active":"2024-09-12T01:37:44.971330+0000","last_became_peered":"2024-09-12T01:37:44.971330+0000","last_unstale":"2024-09-12T01:37:48.116552+0000","last_undegraded":"2024-09-12T01:37:48.116552+0000","last_fullsized":"2024-09-12T01:37:48.116552+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:59.799350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117347+0000","last_change":"2024-09-12T01:37:45.975777+0000","last_active":"2024-09-12T01:37:48.117347+0000","last_peered":"2024-09-12T01:37:48.117347+0000","last_clean":"2024-09-12T01:37:48.117347+0000","last_became_active":"2024-09-12T01:37:45.975494+0000","last_became_peered":"2024-09-12T01:37:45.975494+0000","last_unstale":"2024-09-12T01:37:48.117347+0000","last_undegraded":"2024-09-12T01:37:48.117347+0000","last_fullsized":"2024-09-12T01:37:48.117347+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:25.848728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965453+0000","last_change":"2024-09-12T01:37:44.965704+0000","last_active":"2024-09-12T01:37:46.965453+0000","last_peered":"2024-09-12T01:37:46.965453+0000","last_clean":"2024-09-12T01:37:46.965453+0000","last_became_active":"2024-09-12T01:37:44.965433+0000","last_became_peered":"2024-09-12T01:37:44.965433+0000","last_unstale":"2024-09-12T01:37:46.965453+0000","last_undegraded":"2024-09-12T01:37:46.965453+0000","last_fullsized":"2024-09-12T01:37:46.965453+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:42.232596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117627+0000","last_change":"2024-09-12T01:37:45.970897+0000","last_active":"2024-09-12T01:37:48.117627+0000","last_peered":"2024-09-12T01:37:48.117627+0000","last_clean":"2024-09-12T01:37:48.117627+0000","last_became_active":"2024-09-12T01:37:45.970633+0000","last_became_peered":"2024-09-12T01:37:45.970633+0000","last_unstale":"2024-09-12T01:37:48.117627+0000","last_undegraded":"2024-09-12T01:37:48.117627+0000","last_fullsized":"2024-09-12T01:37:48.117627+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:10.717330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117496+0000","last_change":"2024-09-12T01:37:44.971685+0000","last_active":"2024-09-12T01:37:48.117496+0000","last_peered":"2024-09-12T01:37:48.117496+0000","last_clean":"2024-09-12T01:37:48.117496+0000","last_became_active":"2024-09-12T01:37:44.971412+0000","last_became_peered":"2024-09-12T01:37:44.971412+0000","last_unstale":"2024-09-12T01:37:48.117496+0000","last_undegraded":"2024-09-12T01:37:48.117496+0000","last_fullsized":"2024-09-12T01:37:48.117496+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:19.360136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117399+0000","last_change":"2024-09-12T01:37:45.981066+0000","last_active":"2024-09-12T01:37:48.117399+0000","last_peered":"2024-09-12T01:37:48.117399+0000","last_clean":"2024-09-12T01:37:48.117399+0000","last_became_active":"2024-09-12T01:37:45.980646+0000","last_became_peered":"2024-09-12T01:37:45.980646+0000","last_unstale":"2024-09-12T01:37:48.117399+0000","last_undegraded":"2024-09-12T01:37:48.117399+0000","last_fullsized":"2024-09-12T01:37:48.117399+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:10.888306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966211+0000","last_change":"2024-09-12T01:37:44.970742+0000","last_active":"2024-09-12T01:37:46.966211+0000","last_peered":"2024-09-12T01:37:46.966211+0000","last_clean":"2024-09-12T01:37:46.966211+0000","last_became_active":"2024-09-12T01:37:44.969993+0000","last_became_peered":"2024-09-12T01:37:44.969993+0000","last_unstale":"2024-09-12T01:37:46.966211+0000","last_undegraded":"2024-09-12T01:37:46.966211+0000","last_fullsized":"2024-09-12T01:37:46.966211+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:51.678899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966658+0000","last_change":"2024-09-12T01:37:45.985136+0000","last_active":"2024-09-12T01:37:46.966658+0000","last_peered":"2024-09-12T01:37:46.966658+0000","last_clean":"2024-09-12T01:37:46.966658+0000","last_became_active":"2024-09-12T01:37:45.984789+0000","last_became_peered":"2024-09-12T01:37:45.984789+0000","last_unstale":"2024-09-12T01:37:46.966658+0000","last_undegraded":"2024-09-12T01:37:46.966658+0000","last_fullsized":"2024-09-12T01:37:46.966658+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:38.371716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.964594+0000","last_change":"2024-09-12T01:37:44.969932+0000","last_active":"2024-09-12T01:37:46.964594+0000","last_peered":"2024-09-12T01:37:46.964594+0000","last_clean":"2024-09-12T01:37:46.964594+0000","last_became_active":"2024-09-12T01:37:44.969660+0000","last_became_peered":"2024-09-12T01:37:44.969660+0000","last_unstale":"2024-09-12T01:37:46.964594+0000","last_undegraded":"2024-09-12T01:37:46.964594+0000","last_fullsized":"2024-09-12T01:37:46.964594+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:09.711449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116954+0000","last_change":"2024-09-12T01:37:45.970583+0000","last_active":"2024-09-12T01:37:48.116954+0000","last_peered":"2024-09-12T01:37:48.116954+0000","last_clean":"2024-09-12T01:37:48.116954+0000","last_became_active":"2024-09-12T01:37:45.965068+0000","last_became_peered":"2024-09-12T01:37:45.965068+0000","last_unstale":"2024-09-12T01:37:48.116954+0000","last_undegraded":"2024-09-12T01:37:48.116954+0000","last_fullsized":"2024-09-12T01:37:48.116954+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:55.682781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":20,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966245+0000","last_change":"2024-09-12T01:37:44.961045+0000","last_active":"2024-09-12T01:37:46.966245+0000","last_peered":"2024-09-12T01:37:46.966245+0000","last_clean":"2024-09-12T01:37:46.966245+0000","last_became_active":"2024-09-12T01:37:44.960234+0000","last_became_peered":"2024-09-12T01:37:44.960234+0000","last_unstale":"2024-09-12T01:37:46.966245+0000","last_undegraded":"2024-09-12T01:37:46.966245+0000","last_fullsized":"2024-09-12T01:37:46.966245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:07.399927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117807+0000","last_change":"2024-09-12T01:37:45.982625+0000","last_active":"2024-09-12T01:37:48.117807+0000","last_peered":"2024-09-12T01:37:48.117807+0000","last_clean":"2024-09-12T01:37:48.117807+0000","last_became_active":"2024-09-12T01:37:45.982298+0000","last_became_peered":"2024-09-12T01:37:45.982298+0000","last_unstale":"2024-09-12T01:37:48.117807+0000","last_undegraded":"2024-09-12T01:37:48.117807+0000","last_fullsized":"2024-09-12T01:37:48.117807+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:10.327641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117253+0000","last_change":"2024-09-12T01:37:44.966599+0000","last_active":"2024-09-12T01:37:48.117253+0000","last_peered":"2024-09-12T01:37:48.117253+0000","last_clean":"2024-09-12T01:37:48.117253+0000","last_became_active":"2024-09-12T01:37:44.966307+0000","last_became_peered":"2024-09-12T01:37:44.966307+0000","last_unstale":"2024-09-12T01:37:48.117253+0000","last_undegraded":"2024-09-12T01:37:48.117253+0000","last_fullsized":"2024-09-12T01:37:48.117253+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:26.943464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117159+0000","last_change":"2024-09-12T01:37:45.972427+0000","last_active":"2024-09-12T01:37:48.117159+0000","last_peered":"2024-09-12T01:37:48.117159+0000","last_clean":"2024-09-12T01:37:48.117159+0000","last_became_active":"2024-09-12T01:37:45.972154+0000","last_became_peered":"2024-09-12T01:37:45.972154+0000","last_unstale":"2024-09-12T01:37:48.117159+0000","last_undegraded":"2024-09-12T01:37:48.117159+0000","last_fullsized":"2024-09-12T01:37:48.117159+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:05.227909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117650+0000","last_change":"2024-09-12T01:37:44.969334+0000","last_active":"2024-09-12T01:37:48.117650+0000","last_peered":"2024-09-12T01:37:48.117650+0000","last_clean":"2024-09-12T01:37:48.117650+0000","last_became_active":"2024-09-12T01:37:44.969042+0000","last_became_peered":"2024-09-12T01:37:44.969042+0000","last_unstale":"2024-09-12T01:37:48.117650+0000","last_undegraded":"2024-09-12T01:37:48.117650+0000","last_fullsized":"2024-09-12T01:37:48.117650+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:56.359552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116988+0000","last_change":"2024-09-12T01:37:45.983036+0000","last_active":"2024-09-12T01:37:48.116988+0000","last_peered":"2024-09-12T01:37:48.116988+0000","last_clean":"2024-09-12T01:37:48.116988+0000","last_became_active":"2024-09-12T01:37:45.982756+0000","last_became_peered":"2024-09-12T01:37:45.982756+0000","last_unstale":"2024-09-12T01:37:48.116988+0000","last_undegraded":"2024-09-12T01:37:48.116988+0000","last_fullsized":"2024-09-12T01:37:48.116988+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:03.843380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116514+0000","last_change":"2024-09-12T01:37:44.974432+0000","last_active":"2024-09-12T01:37:48.116514+0000","last_peered":"2024-09-12T01:37:48.116514+0000","last_clean":"2024-09-12T01:37:48.116514+0000","last_became_active":"2024-09-12T01:37:44.974089+0000","last_became_peered":"2024-09-12T01:37:44.974089+0000","last_unstale":"2024-09-12T01:37:48.116514+0000","last_undegraded":"2024-09-12T01:37:48.116514+0000","last_fullsized":"2024-09-12T01:37:48.116514+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:09.711449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.964481+0000","last_change":"2024-09-12T01:37:45.963906+0000","last_active":"2024-09-12T01:37:46.964481+0000","last_peered":"2024-09-12T01:37:46.964481+0000","last_clean":"2024-09-12T01:37:46.964481+0000","last_became_active":"2024-09-12T01:37:45.963638+0000","last_became_peered":"2024-09-12T01:37:45.963638+0000","last_unstale":"2024-09-12T01:37:46.964481+0000","last_undegraded":"2024-09-12T01:37:46.964481+0000","last_fullsized":"2024-09-12T01:37:46.964481+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:01.777883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":22,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965714+0000","last_change":"2024-09-12T01:37:44.962639+0000","last_active":"2024-09-12T01:37:46.965714+0000","last_peered":"2024-09-12T01:37:46.965714+0000","last_clean":"2024-09-12T01:37:46.965714+0000","last_became_active":"2024-09-12T01:37:44.962334+0000","last_became_peered":"2024-09-12T01:37:44.962334+0000","last_unstale":"2024-09-12T01:37:46.965714+0000","last_undegraded":"2024-09-12T01:37:46.965714+0000","last_fullsized":"2024-09-12T01:37:46.965714+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:51.995342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117429+0000","last_change":"2024-09-12T01:37:45.978510+0000","last_active":"2024-09-12T01:37:48.117429+0000","last_peered":"2024-09-12T01:37:48.117429+0000","last_clean":"2024-09-12T01:37:48.117429+0000","last_became_active":"2024-09-12T01:37:45.978238+0000","last_became_peered":"2024-09-12T01:37:45.978238+0000","last_unstale":"2024-09-12T01:37:48.117429+0000","last_undegraded":"2024-09-12T01:37:48.117429+0000","last_fullsized":"2024-09-12T01:37:48.117429+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:48.946372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966856+0000","last_change":"2024-09-12T01:37:44.967523+0000","last_active":"2024-09-12T01:37:46.966856+0000","last_peered":"2024-09-12T01:37:46.966856+0000","last_clean":"2024-09-12T01:37:46.966856+0000","last_became_active":"2024-09-12T01:37:44.967216+0000","last_became_peered":"2024-09-12T01:37:44.967216+0000","last_unstale":"2024-09-12T01:37:46.966856+0000","last_undegraded":"2024-09-12T01:37:46.966856+0000","last_fullsized":"2024-09-12T01:37:46.966856+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:09.711449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117067+0000","last_change":"2024-09-12T01:37:45.980917+0000","last_active":"2024-09-12T01:37:48.117067+0000","last_peered":"2024-09-12T01:37:48.117067+0000","last_clean":"2024-09-12T01:37:48.117067+0000","last_became_active":"2024-09-12T01:37:45.980609+0000","last_became_peered":"2024-09-12T01:37:45.980609+0000","last_unstale":"2024-09-12T01:37:48.117067+0000","last_undegraded":"2024-09-12T01:37:48.117067+0000","last_fullsized":"2024-09-12T01:37:48.117067+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:43.467121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117727+0000","last_change":"2024-09-12T01:37:44.973988+0000","last_active":"2024-09-12T01:37:48.117727+0000","last_peered":"2024-09-12T01:37:48.117727+0000","last_clean":"2024-09-12T01:37:48.117727+0000","last_became_active":"2024-09-12T01:37:44.973403+0000","last_became_peered":"2024-09-12T01:37:44.973403+0000","last_unstale":"2024-09-12T01:37:48.117727+0000","last_undegraded":"2024-09-12T01:37:48.117727+0000","last_fullsized":"2024-09-12T01:37:48.117727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:07.271439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.964822+0000","last_change":"2024-09-12T01:37:45.968746+0000","last_active":"2024-09-12T01:37:46.964822+0000","last_peered":"2024-09-12T01:37:46.964822+0000","last_clean":"2024-09-12T01:37:46.964822+0000","last_became_active":"2024-09-12T01:37:45.968429+0000","last_became_peered":"2024-09-12T01:37:45.968429+0000","last_unstale":"2024-09-12T01:37:46.964822+0000","last_undegraded":"2024-09-12T01:37:46.964822+0000","last_fullsized":"2024-09-12T01:37:46.964822+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:24.824982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117533+0000","last_change":"2024-09-12T01:37:44.971512+0000","last_active":"2024-09-12T01:37:48.117533+0000","last_peered":"2024-09-12T01:37:48.117533+0000","last_clean":"2024-09-12T01:37:48.117533+0000","last_became_active":"2024-09-12T01:37:44.970650+0000","last_became_peered":"2024-09-12T01:37:44.970650+0000","last_unstale":"2024-09-12T01:37:48.117533+0000","last_undegraded":"2024-09-12T01:37:48.117533+0000","last_fullsized":"2024-09-12T01:37:48.117533+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:26.943464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117430+0000","last_change":"2024-09-12T01:37:45.985167+0000","last_active":"2024-09-12T01:37:48.117430+0000","last_peered":"2024-09-12T01:37:48.117430+0000","last_clean":"2024-09-12T01:37:48.117430+0000","last_became_active":"2024-09-12T01:37:45.984775+0000","last_became_peered":"2024-09-12T01:37:45.984775+0000","last_unstale":"2024-09-12T01:37:48.117430+0000","last_undegraded":"2024-09-12T01:37:48.117430+0000","last_fullsized":"2024-09-12T01:37:48.117430+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:48.946372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116691+0000","last_change":"2024-09-12T01:37:44.968846+0000","last_active":"2024-09-12T01:37:48.116691+0000","last_peered":"2024-09-12T01:37:48.116691+0000","last_clean":"2024-09-12T01:37:48.116691+0000","last_became_active":"2024-09-12T01:37:44.968560+0000","last_became_peered":"2024-09-12T01:37:44.968560+0000","last_unstale":"2024-09-12T01:37:48.116691+0000","last_undegraded":"2024-09-12T01:37:48.116691+0000","last_fullsized":"2024-09-12T01:37:48.116691+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:47.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965823+0000","last_change":"2024-09-12T01:37:45.983036+0000","last_active":"2024-09-12T01:37:46.965823+0000","last_peered":"2024-09-12T01:37:46.965823+0000","last_clean":"2024-09-12T01:37:46.965823+0000","last_became_active":"2024-09-12T01:37:45.982728+0000","last_became_peered":"2024-09-12T01:37:45.982728+0000","last_unstale":"2024-09-12T01:37:46.965823+0000","last_undegraded":"2024-09-12T01:37:46.965823+0000","last_fullsized":"2024-09-12T01:37:46.965823+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:18.427659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965784+0000","last_change":"2024-09-12T01:37:44.970363+0000","last_active":"2024-09-12T01:37:46.965784+0000","last_peered":"2024-09-12T01:37:46.965784+0000","last_clean":"2024-09-12T01:37:46.965784+0000","last_became_active":"2024-09-12T01:37:44.969934+0000","last_became_peered":"2024-09-12T01:37:44.969934+0000","last_unstale":"2024-09-12T01:37:46.965784+0000","last_undegraded":"2024-09-12T01:37:46.965784+0000","last_fullsized":"2024-09-12T01:37:46.965784+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:43.133304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116912+0000","last_change":"2024-09-12T01:37:45.975876+0000","last_active":"2024-09-12T01:37:48.116912+0000","last_peered":"2024-09-12T01:37:48.116912+0000","last_clean":"2024-09-12T01:37:48.116912+0000","last_became_active":"2024-09-12T01:37:45.975227+0000","last_became_peered":"2024-09-12T01:37:45.975227+0000","last_unstale":"2024-09-12T01:37:48.116912+0000","last_undegraded":"2024-09-12T01:37:48.116912+0000","last_fullsized":"2024-09-12T01:37:48.116912+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:49.399917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117649+0000","last_change":"2024-09-12T01:37:44.971996+0000","last_active":"2024-09-12T01:37:48.117649+0000","last_peered":"2024-09-12T01:37:48.117649+0000","last_clean":"2024-09-12T01:37:48.117649+0000","last_became_active":"2024-09-12T01:37:44.971733+0000","last_became_peered":"2024-09-12T01:37:44.971733+0000","last_unstale":"2024-09-12T01:37:48.117649+0000","last_undegraded":"2024-09-12T01:37:48.117649+0000","last_fullsized":"2024-09-12T01:37:48.117649+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:52.261389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966058+0000","last_change":"2024-09-12T01:37:45.973058+0000","last_active":"2024-09-12T01:37:46.966058+0000","last_peered":"2024-09-12T01:37:46.966058+0000","last_clean":"2024-09-12T01:37:46.966058+0000","last_became_active":"2024-09-12T01:37:45.972750+0000","last_became_peered":"2024-09-12T01:37:45.972750+0000","last_unstale":"2024-09-12T01:37:46.966058+0000","last_undegraded":"2024-09-12T01:37:46.966058+0000","last_fullsized":"2024-09-12T01:37:46.966058+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:43.118511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.965602+0000","last_change":"2024-09-12T01:37:44.971190+0000","last_active":"2024-09-12T01:37:46.965602+0000","last_peered":"2024-09-12T01:37:46.965602+0000","last_clean":"2024-09-12T01:37:46.965602+0000","last_became_active":"2024-09-12T01:37:44.970906+0000","last_became_peered":"2024-09-12T01:37:44.970906+0000","last_unstale":"2024-09-12T01:37:46.965602+0000","last_undegraded":"2024-09-12T01:37:46.965602+0000","last_fullsized":"2024-09-12T01:37:46.965602+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:57.572375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966464+0000","last_change":"2024-09-12T01:37:45.979114+0000","last_active":"2024-09-12T01:37:46.966464+0000","last_peered":"2024-09-12T01:37:46.966464+0000","last_clean":"2024-09-12T01:37:46.966464+0000","last_became_active":"2024-09-12T01:37:45.978817+0000","last_became_peered":"2024-09-12T01:37:45.978817+0000","last_unstale":"2024-09-12T01:37:46.966464+0000","last_undegraded":"2024-09-12T01:37:46.966464+0000","last_fullsized":"2024-09-12T01:37:46.966464+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:40.504408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116719+0000","last_change":"2024-09-12T01:37:44.970013+0000","last_active":"2024-09-12T01:37:48.116719+0000","last_peered":"2024-09-12T01:37:48.116719+0000","last_clean":"2024-09-12T01:37:48.116719+0000","last_became_active":"2024-09-12T01:37:44.969654+0000","last_became_peered":"2024-09-12T01:37:44.969654+0000","last_unstale":"2024-09-12T01:37:48.116719+0000","last_undegraded":"2024-09-12T01:37:48.116719+0000","last_fullsized":"2024-09-12T01:37:48.116719+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:59.141869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116759+0000","last_change":"2024-09-12T01:37:45.974774+0000","last_active":"2024-09-12T01:37:48.116759+0000","last_peered":"2024-09-12T01:37:48.116759+0000","last_clean":"2024-09-12T01:37:48.116759+0000","last_became_active":"2024-09-12T01:37:45.974486+0000","last_became_peered":"2024-09-12T01:37:45.974486+0000","last_unstale":"2024-09-12T01:37:48.116759+0000","last_undegraded":"2024-09-12T01:37:48.116759+0000","last_fullsized":"2024-09-12T01:37:48.116759+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:57.505203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.967225+0000","last_change":"2024-09-12T01:37:44.970664+0000","last_active":"2024-09-12T01:37:46.967225+0000","last_peered":"2024-09-12T01:37:46.967225+0000","last_clean":"2024-09-12T01:37:46.967225+0000","last_became_active":"2024-09-12T01:37:44.970398+0000","last_became_peered":"2024-09-12T01:37:44.970398+0000","last_unstale":"2024-09-12T01:37:46.967225+0000","last_undegraded":"2024-09-12T01:37:46.967225+0000","last_fullsized":"2024-09-12T01:37:46.967225+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:47.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966137+0000","last_change":"2024-09-12T01:37:45.980042+0000","last_active":"2024-09-12T01:37:46.966137+0000","last_peered":"2024-09-12T01:37:46.966137+0000","last_clean":"2024-09-12T01:37:46.966137+0000","last_became_active":"2024-09-12T01:37:45.978314+0000","last_became_peered":"2024-09-12T01:37:45.978314+0000","last_unstale":"2024-09-12T01:37:46.966137+0000","last_undegraded":"2024-09-12T01:37:46.966137+0000","last_fullsized":"2024-09-12T01:37:46.966137+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:46.861826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117336+0000","last_change":"2024-09-12T01:37:44.974675+0000","last_active":"2024-09-12T01:37:48.117336+0000","last_peered":"2024-09-12T01:37:48.117336+0000","last_clean":"2024-09-12T01:37:48.117336+0000","last_became_active":"2024-09-12T01:37:44.974293+0000","last_became_peered":"2024-09-12T01:37:44.974293+0000","last_unstale":"2024-09-12T01:37:48.117336+0000","last_undegraded":"2024-09-12T01:37:48.117336+0000","last_fullsized":"2024-09-12T01:37:48.117336+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:58.440749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117059+0000","last_change":"2024-09-12T01:37:45.970944+0000","last_active":"2024-09-12T01:37:48.117059+0000","last_peered":"2024-09-12T01:37:48.117059+0000","last_clean":"2024-09-12T01:37:48.117059+0000","last_became_active":"2024-09-12T01:37:45.965601+0000","last_became_peered":"2024-09-12T01:37:45.965601+0000","last_unstale":"2024-09-12T01:37:48.117059+0000","last_undegraded":"2024-09-12T01:37:48.117059+0000","last_fullsized":"2024-09-12T01:37:48.117059+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:23.369495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117295+0000","last_change":"2024-09-12T01:37:44.970246+0000","last_active":"2024-09-12T01:37:48.117295+0000","last_peered":"2024-09-12T01:37:48.117295+0000","last_clean":"2024-09-12T01:37:48.117295+0000","last_became_active":"2024-09-12T01:37:44.969914+0000","last_became_peered":"2024-09-12T01:37:44.969914+0000","last_unstale":"2024-09-12T01:37:48.117295+0000","last_undegraded":"2024-09-12T01:37:48.117295+0000","last_fullsized":"2024-09-12T01:37:48.117295+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:19.360136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.966003+0000","last_change":"2024-09-12T01:37:45.981676+0000","last_active":"2024-09-12T01:37:46.966003+0000","last_peered":"2024-09-12T01:37:46.966003+0000","last_clean":"2024-09-12T01:37:46.966003+0000","last_became_active":"2024-09-12T01:37:45.981323+0000","last_became_peered":"2024-09-12T01:37:45.981323+0000","last_unstale":"2024-09-12T01:37:46.966003+0000","last_undegraded":"2024-09-12T01:37:46.966003+0000","last_fullsized":"2024-09-12T01:37:46.966003+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:48.993545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117439+0000","last_change":"2024-09-12T01:37:44.970613+0000","last_active":"2024-09-12T01:37:48.117439+0000","last_peered":"2024-09-12T01:37:48.117439+0000","last_clean":"2024-09-12T01:37:48.117439+0000","last_became_active":"2024-09-12T01:37:44.970284+0000","last_became_peered":"2024-09-12T01:37:44.970284+0000","last_unstale":"2024-09-12T01:37:48.117439+0000","last_undegraded":"2024-09-12T01:37:48.117439+0000","last_fullsized":"2024-09-12T01:37:48.117439+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:08.855723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.967330+0000","last_change":"2024-09-12T01:37:45.962870+0000","last_active":"2024-09-12T01:37:46.967330+0000","last_peered":"2024-09-12T01:37:46.967330+0000","last_clean":"2024-09-12T01:37:46.967330+0000","last_became_active":"2024-09-12T01:37:45.962525+0000","last_became_peered":"2024-09-12T01:37:45.962525+0000","last_unstale":"2024-09-12T01:37:46.967330+0000","last_undegraded":"2024-09-12T01:37:46.967330+0000","last_fullsized":"2024-09-12T01:37:46.967330+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:56.458317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.117189+0000","last_change":"2024-09-12T01:37:44.964928+0000","last_active":"2024-09-12T01:37:48.117189+0000","last_peered":"2024-09-12T01:37:48.117189+0000","last_clean":"2024-09-12T01:37:48.117189+0000","last_became_active":"2024-09-12T01:37:44.964539+0000","last_became_peered":"2024-09-12T01:37:44.964539+0000","last_unstale":"2024-09-12T01:37:48.117189+0000","last_undegraded":"2024-09-12T01:37:48.117189+0000","last_fullsized":"2024-09-12T01:37:48.117189+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:44.955166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116814+0000","last_change":"2024-09-12T01:37:45.972488+0000","last_active":"2024-09-12T01:37:48.116814+0000","last_peered":"2024-09-12T01:37:48.116814+0000","last_clean":"2024-09-12T01:37:48.116814+0000","last_became_active":"2024-09-12T01:37:45.972217+0000","last_became_peered":"2024-09-12T01:37:45.972217+0000","last_unstale":"2024-09-12T01:37:48.116814+0000","last_undegraded":"2024-09-12T01:37:48.116814+0000","last_fullsized":"2024-09-12T01:37:48.116814+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:43.467121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116622+0000","last_change":"2024-09-12T01:37:44.962377+0000","last_active":"2024-09-12T01:37:48.116622+0000","last_peered":"2024-09-12T01:37:48.116622+0000","last_clean":"2024-09-12T01:37:48.116622+0000","last_became_active":"2024-09-12T01:37:44.962116+0000","last_became_peered":"2024-09-12T01:37:44.962116+0000","last_unstale":"2024-09-12T01:37:48.116622+0000","last_undegraded":"2024-09-12T01:37:48.116622+0000","last_fullsized":"2024-09-12T01:37:48.116622+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:29.748329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.964504+0000","last_change":"2024-09-12T01:37:45.978030+0000","last_active":"2024-09-12T01:37:46.964504+0000","last_peered":"2024-09-12T01:37:46.964504+0000","last_clean":"2024-09-12T01:37:46.964504+0000","last_became_active":"2024-09-12T01:37:45.977698+0000","last_became_peered":"2024-09-12T01:37:45.977698+0000","last_unstale":"2024-09-12T01:37:46.964504+0000","last_undegraded":"2024-09-12T01:37:46.964504+0000","last_fullsized":"2024-09-12T01:37:46.964504+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:49.399917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116920+0000","last_change":"2024-09-12T01:37:44.965413+0000","last_active":"2024-09-12T01:37:48.116920+0000","last_peered":"2024-09-12T01:37:48.116920+0000","last_clean":"2024-09-12T01:37:48.116920+0000","last_became_active":"2024-09-12T01:37:44.965122+0000","last_became_peered":"2024-09-12T01:37:44.965122+0000","last_unstale":"2024-09-12T01:37:48.116920+0000","last_undegraded":"2024-09-12T01:37:48.116920+0000","last_fullsized":"2024-09-12T01:37:48.116920+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:07.271439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.967224+0000","last_change":"2024-09-12T01:37:45.964252+0000","last_active":"2024-09-12T01:37:46.967224+0000","last_peered":"2024-09-12T01:37:46.967224+0000","last_clean":"2024-09-12T01:37:46.967224+0000","last_became_active":"2024-09-12T01:37:45.963831+0000","last_became_peered":"2024-09-12T01:37:45.963831+0000","last_unstale":"2024-09-12T01:37:46.967224+0000","last_undegraded":"2024-09-12T01:37:46.967224+0000","last_fullsized":"2024-09-12T01:37:46.967224+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.940932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.940932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:17.679619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116864+0000","last_change":"2024-09-12T01:37:44.968753+0000","last_active":"2024-09-12T01:37:48.116864+0000","last_peered":"2024-09-12T01:37:48.116864+0000","last_clean":"2024-09-12T01:37:48.116864+0000","last_became_active":"2024-09-12T01:37:44.968465+0000","last_became_peered":"2024-09-12T01:37:44.968465+0000","last_unstale":"2024-09-12T01:37:48.116864+0000","last_undegraded":"2024-09-12T01:37:48.116864+0000","last_fullsized":"2024-09-12T01:37:48.116864+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:43.935051+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.935051+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:46.065887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":214,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.116612+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:37:48.116612+0000","last_peered":"2024-09-12T01:37:48.116612+0000","last_clean":"2024-09-12T01:37:48.116612+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:37:48.116612+0000","last_undegraded":"2024-09-12T01:37:48.116612+0000","last_fullsized":"2024-09-12T01:37:48.116612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":212984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509468,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":540672,"data_stored":213566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1130496,"data_stored":803340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509468,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35880,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335960,"statfs":{"total":96636764160,"available":96600023040,"internally_reserved":0,"allocated":544768,"data_stored":214562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31720,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340120,"statfs":{"total":96636764160,"available":96604282880,"internally_reserved":0,"allocated":536576,"data_stored":213040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509468,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1130496,"data_stored":803388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509469,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":540672,"data_stored":213622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31736,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340104,"statfs":{"total":96636764160,"available":96604266496,"internally_reserved":0,"allocated":552960,"data_stored":214654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:37:54.702 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:37:54.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:37:54.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.849+0000 7f778b250640 1 Processor -- start 2024-09-12T01:37:54.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.850+0000 7f778b250640 1 -- start start 2024-09-12T01:37:54.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.850+0000 7f778b250640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77840cf1f0 0x7f77840b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:54.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.850+0000 7f778b250640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77840cf860 con 0x7f77840b6720 2024-09-12T01:37:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.850+0000 7f778b250640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77840cfb40 con 0x7f778415e7a0 2024-09-12T01:37:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.850+0000 7f778b250640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f77840d2ca0 con 0x7f77840cf1f0 2024-09-12T01:37:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.850+0000 7f77897ed640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f77840b6720 0x7f77840d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44198/0 (socket says 172.21.15.60:44198) 2024-09-12T01:37:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.850+0000 7f77897ed640 1 -- 172.21.15.60:0/1161543852 learned_addr learned my addr 172.21.15.60:0/1161543852 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.851+0000 7f7783fff640 1 --2- 172.21.15.60:0/1161543852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77840cf1f0 0x7f77840b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.851+0000 7f77837fe640 1 -- 172.21.15.60:0/1161543852 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3631384753 0 0) 0x7f77840cf860 con 0x7f77840b6720 2024-09-12T01:37:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.851+0000 7f77837fe640 1 -- 172.21.15.60:0/1161543852 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f776c003520 con 0x7f77840b6720 2024-09-12T01:37:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.851+0000 7f77837fe640 1 -- 172.21.15.60:0/1161543852 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268113205 0 0) 0x7f77840cfb40 con 0x7f778415e7a0 2024-09-12T01:37:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.851+0000 7f77837fe640 1 -- 172.21.15.60:0/1161543852 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77840cf860 con 0x7f778415e7a0 2024-09-12T01:37:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.851+0000 7f7783fff640 1 -- 172.21.15.60:0/1161543852 >> v1:172.21.15.105:6789/0 conn(0x7f778415e7a0 legacy=0x7f778406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.851+0000 7f7783fff640 1 -- 172.21.15.60:0/1161543852 >> v1:172.21.15.60:6789/0 conn(0x7f77840b6720 legacy=0x7f77840d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.851+0000 7f7783fff640 1 -- 172.21.15.60:0/1161543852 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77840cfe20 con 0x7f77840cf1f0 2024-09-12T01:37:54.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.852+0000 7f7783fff640 1 --2- 172.21.15.60:0/1161543852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77840cf1f0 0x7f77840b61e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f77780097d0 tx=0x7f777802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23e9a452f0a0a121 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:54.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.852+0000 7f77837fe640 1 -- 172.21.15.60:0/1161543852 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778037070 con 0x7f77840cf1f0 2024-09-12T01:37:54.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.852+0000 7f77837fe640 1 -- 172.21.15.60:0/1161543852 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7778032440 con 0x7f77840cf1f0 2024-09-12T01:37:54.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.852+0000 7f77837fe640 1 -- 172.21.15.60:0/1161543852 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778032810 con 0x7f77840cf1f0 2024-09-12T01:37:54.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.852+0000 7f778b250640 1 -- 172.21.15.60:0/1161543852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77840cf1f0 msgr2=0x7f77840b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:54.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.852+0000 7f778b250640 1 --2- 172.21.15.60:0/1161543852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77840cf1f0 0x7f77840b61e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f77780097d0 tx=0x7f777802a180 comp rx=0 tx=0).stop 2024-09-12T01:37:54.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.853+0000 7f778b250640 1 -- 172.21.15.60:0/1161543852 shutdown_connections 2024-09-12T01:37:54.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.853+0000 7f778b250640 1 --2- 172.21.15.60:0/1161543852 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77840cf1f0 0x7f77840b61e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.853+0000 7f778b250640 1 -- 172.21.15.60:0/1161543852 >> 172.21.15.60:0/1161543852 conn(0x7f77840d11e0 msgr2=0x7f77840d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:54.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.853+0000 7f778b250640 1 -- 172.21.15.60:0/1161543852 shutdown_connections 2024-09-12T01:37:54.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.853+0000 7f778b250640 1 -- 172.21.15.60:0/1161543852 wait complete. 2024-09-12T01:37:54.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.854+0000 7f778b250640 1 Processor -- start 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.854+0000 7f778b250640 1 -- start start 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f778b250640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77840b6720 0x7f77841f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f778b250640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77840cf1f0 0x7f77840c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f778b250640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f778415e7a0 0x7f77841620f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f778b250640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f778415eb80 con 0x7f77840cf1f0 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f778b250640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f77840b7a00 con 0x7f77840b6720 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f778b250640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f778415ed00 con 0x7f778415e7a0 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f7783fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77840cf1f0 0x7f77840c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f7783fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77840cf1f0 0x7f77840c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42960/0 (socket says 172.21.15.60:42960) 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f7783fff640 1 -- 172.21.15.60:0/4247866045 learned_addr learned my addr 172.21.15.60:0/4247866045 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f7788fec640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77840b6720 0x7f77841f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f77897ed640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f778415e7a0 0x7f77841620f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f7783fff640 1 -- 172.21.15.60:0/4247866045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f778415e7a0 msgr2=0x7f77841620f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:54.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f7783fff640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f778415e7a0 0x7f77841620f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f7783fff640 1 -- 172.21.15.60:0/4247866045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77840b6720 msgr2=0x7f77841f4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:54.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f7783fff640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77840b6720 0x7f77841f4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:54.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f7783fff640 1 -- 172.21.15.60:0/4247866045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77841f4460 con 0x7f77840cf1f0 2024-09-12T01:37:54.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f77897ed640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f778415e7a0 0x7f77841620f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:54.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f7783fff640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77840cf1f0 0x7f77840c8250 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7778035040 tx=0x7f77780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:54.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.855+0000 7f77817fa640 1 -- 172.21.15.60:0/4247866045 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778041020 con 0x7f77840cf1f0 2024-09-12T01:37:54.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.856+0000 7f77817fa640 1 -- 172.21.15.60:0/4247866045 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f777803d720 con 0x7f77840cf1f0 2024-09-12T01:37:54.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.856+0000 7f778b250640 1 -- 172.21.15.60:0/4247866045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77840c8790 con 0x7f77840cf1f0 2024-09-12T01:37:54.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.856+0000 7f77817fa640 1 -- 172.21.15.60:0/4247866045 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7778037040 con 0x7f77840cf1f0 2024-09-12T01:37:54.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.856+0000 7f778b250640 1 -- 172.21.15.60:0/4247866045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77840c8d20 con 0x7f77840cf1f0 2024-09-12T01:37:54.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.857+0000 7f778b250640 1 -- 172.21.15.60:0/4247866045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7784163170 con 0x7f77840cf1f0 2024-09-12T01:37:54.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.857+0000 7f77817fa640 1 -- 172.21.15.60:0/4247866045 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7778044020 con 0x7f77840cf1f0 2024-09-12T01:37:54.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.857+0000 7f77817fa640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f777006be30 0x7f777006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:54.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.858+0000 7f77817fa640 1 -- 172.21.15.60:0/4247866045 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f77780ab5a0 con 0x7f77840cf1f0 2024-09-12T01:37:54.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.858+0000 7f7788fec640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f777006be30 0x7f777006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:54.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.858+0000 7f7788fec640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f777006be30 0x7f777006e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f77740015b0 tx=0x7f7774009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:54.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:54.862+0000 7f77817fa640 1 -- 172.21.15.60:0/4247866045 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f777804b030 con 0x7f77840cf1f0 2024-09-12T01:37:55.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.109+0000 7f778b250640 1 -- 172.21.15.60:0/4247866045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f77840b61e0 con 0x7f77840cf1f0 2024-09-12T01:37:55.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.111+0000 7f77817fa640 1 -- 172.21.15.60:0/4247866045 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f77841f4460 con 0x7f77840cf1f0 2024-09-12T01:37:55.111 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-12T01:37:55.111 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ== 2024-09-12T01:37:55.111 INFO:teuthology.orchestra.run.smithi060.stdout: caps mds = "allow" 2024-09-12T01:37:55.111 INFO:teuthology.orchestra.run.smithi060.stdout: caps mon = "allow r" 2024-09-12T01:37:55.111 INFO:teuthology.orchestra.run.smithi060.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:37:55.112 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2024-09-12T01:37:55.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.113+0000 7f778b250640 1 -- 172.21.15.60:0/4247866045 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f777006be30 msgr2=0x7f777006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.113+0000 7f778b250640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f777006be30 0x7f777006e2f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f77740015b0 tx=0x7f7774009040 comp rx=0 tx=0).stop 2024-09-12T01:37:55.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.113+0000 7f778b250640 1 -- 172.21.15.60:0/4247866045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77840cf1f0 msgr2=0x7f77840c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.113+0000 7f778b250640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77840cf1f0 0x7f77840c8250 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7778035040 tx=0x7f77780046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.114+0000 7f778b250640 1 -- 172.21.15.60:0/4247866045 shutdown_connections 2024-09-12T01:37:55.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.114+0000 7f778b250640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f777006be30 0x7f777006e2f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.114+0000 7f778b250640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f778415e7a0 0x7f77841620f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.114+0000 7f778b250640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77840cf1f0 0x7f77840c8250 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.114+0000 7f778b250640 1 --2- 172.21.15.60:0/4247866045 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77840b6720 0x7f77841f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.114+0000 7f778b250640 1 -- 172.21.15.60:0/4247866045 >> 172.21.15.60:0/4247866045 conn(0x7f77840d11e0 msgr2=0x7f778415d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:55.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.114+0000 7f778b250640 1 -- 172.21.15.60:0/4247866045 shutdown_connections 2024-09-12T01:37:55.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.114+0000 7f778b250640 1 -- 172.21.15.60:0/4247866045 wait complete. 2024-09-12T01:37:55.124 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:37:55.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.227+0000 7fea2d8fa640 1 Processor -- start 2024-09-12T01:37:55.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.227+0000 7fea2d8fa640 1 -- start start 2024-09-12T01:37:55.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea2d8fa640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea2815c2b0 0x7fea280b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea2d8fa640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fea280b72f0 0x7fea2815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea2d8fa640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fea2815f030 0x7fea2806f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea2d8fa640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fea2815fb10 con 0x7fea280b72f0 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea2d8fa640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fea280b5900 con 0x7fea2815f030 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea2d8fa640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fea2815f830 con 0x7fea2815c2b0 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea267fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fea280b72f0 0x7fea2815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea267fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fea280b72f0 0x7fea2815eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42968/0 (socket says 172.21.15.60:42968) 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea267fc640 1 -- 172.21.15.60:0/1482191612 learned_addr learned my addr 172.21.15.60:0/1482191612 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea26ffd640 1 --2- 172.21.15.60:0/1482191612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea2815c2b0 0x7fea280b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea277fe640 1 --2- 172.21.15.60:0/1482191612 >> v2:172.21.15.105:3300/0 conn(0x7fea2815f030 0x7fea2806f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea267fc640 1 -- 172.21.15.60:0/1482191612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea2815c2b0 msgr2=0x7fea280b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea267fc640 1 --2- 172.21.15.60:0/1482191612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea2815c2b0 0x7fea280b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea267fc640 1 -- 172.21.15.60:0/1482191612 >> v2:172.21.15.105:3300/0 conn(0x7fea2815f030 msgr2=0x7fea2806f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:55.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea267fc640 1 --2- 172.21.15.60:0/1482191612 >> v2:172.21.15.105:3300/0 conn(0x7fea2815f030 0x7fea2806f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea267fc640 1 -- 172.21.15.60:0/1482191612 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2806ce30 con 0x7fea280b72f0 2024-09-12T01:37:55.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea26ffd640 1 --2- 172.21.15.60:0/1482191612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea2815c2b0 0x7fea280b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:55.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.228+0000 7fea277fe640 1 --2- 172.21.15.60:0/1482191612 >> v2:172.21.15.105:3300/0 conn(0x7fea2815f030 0x7fea2806f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:55.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.229+0000 7fea267fc640 1 --2- 172.21.15.60:0/1482191612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea280b72f0 0x7fea2815eaf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fea28070ff0 tx=0x7fea1002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71ddda997138eb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:55.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.229+0000 7fea25ffb640 1 -- 172.21.15.60:0/1482191612 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea10037070 con 0x7fea280b72f0 2024-09-12T01:37:55.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.229+0000 7fea25ffb640 1 -- 172.21.15.60:0/1482191612 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea10032440 con 0x7fea280b72f0 2024-09-12T01:37:55.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.229+0000 7fea25ffb640 1 -- 172.21.15.60:0/1482191612 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea10032810 con 0x7fea280b72f0 2024-09-12T01:37:55.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.230+0000 7fea2d8fa640 1 -- 172.21.15.60:0/1482191612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea280b72f0 msgr2=0x7fea2815eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.230+0000 7fea2d8fa640 1 --2- 172.21.15.60:0/1482191612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea280b72f0 0x7fea2815eaf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fea28070ff0 tx=0x7fea1002a1e0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.230+0000 7fea2d8fa640 1 -- 172.21.15.60:0/1482191612 shutdown_connections 2024-09-12T01:37:55.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.230+0000 7fea2d8fa640 1 --2- 172.21.15.60:0/1482191612 >> v2:172.21.15.105:3300/0 conn(0x7fea2815f030 0x7fea2806f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.230+0000 7fea2d8fa640 1 --2- 172.21.15.60:0/1482191612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea280b72f0 0x7fea2815eaf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.230+0000 7fea2d8fa640 1 --2- 172.21.15.60:0/1482191612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea2815c2b0 0x7fea280b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.230+0000 7fea2d8fa640 1 -- 172.21.15.60:0/1482191612 >> 172.21.15.60:0/1482191612 conn(0x7fea280b4240 msgr2=0x7fea280b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:55.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.230+0000 7fea2d8fa640 1 -- 172.21.15.60:0/1482191612 shutdown_connections 2024-09-12T01:37:55.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.230+0000 7fea2d8fa640 1 -- 172.21.15.60:0/1482191612 wait complete. 2024-09-12T01:37:55.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.231+0000 7fea2d8fa640 1 Processor -- start 2024-09-12T01:37:55.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.231+0000 7fea2d8fa640 1 -- start start 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea2d8fa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea280b72f0 0x7fea28159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea2d8fa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea2815c2b0 0x7fea280b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea2d8fa640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea2815f030 0x7fea28146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea2d8fa640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fea280b7730 con 0x7fea280b72f0 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea2d8fa640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fea2806d3f0 con 0x7fea2815c2b0 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea2d8fa640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fea2815f4e0 con 0x7fea2815f030 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea26ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea280b72f0 0x7fea28159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea26ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea280b72f0 0x7fea28159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42984/0 (socket says 172.21.15.60:42984) 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea26ffd640 1 -- 172.21.15.60:0/2209384949 learned_addr learned my addr 172.21.15.60:0/2209384949 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea267fc640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea2815c2b0 0x7fea280b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea277fe640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea2815f030 0x7fea28146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea26ffd640 1 -- 172.21.15.60:0/2209384949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea2815f030 msgr2=0x7fea28146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea26ffd640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea2815f030 0x7fea28146d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea26ffd640 1 -- 172.21.15.60:0/2209384949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea2815c2b0 msgr2=0x7fea280b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea26ffd640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea2815c2b0 0x7fea280b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea26ffd640 1 -- 172.21.15.60:0/2209384949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea280b2530 con 0x7fea280b72f0 2024-09-12T01:37:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea267fc640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea2815c2b0 0x7fea280b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.232+0000 7fea277fe640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea2815f030 0x7fea28146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.233+0000 7fea26ffd640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea280b72f0 0x7fea28159990 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fea1800cf90 tx=0x7fea1800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.233+0000 7fea1ffff640 1 -- 172.21.15.60:0/2209384949 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1801a070 con 0x7fea280b72f0 2024-09-12T01:37:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.233+0000 7fea1ffff640 1 -- 172.21.15.60:0/2209384949 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea1800d840 con 0x7fea280b72f0 2024-09-12T01:37:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.233+0000 7fea2d8fa640 1 -- 172.21.15.60:0/2209384949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea280b2810 con 0x7fea280b72f0 2024-09-12T01:37:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.233+0000 7fea1ffff640 1 -- 172.21.15.60:0/2209384949 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1800dc10 con 0x7fea280b72f0 2024-09-12T01:37:55.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.233+0000 7fea2d8fa640 1 -- 172.21.15.60:0/2209384949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea280b2dd0 con 0x7fea280b72f0 2024-09-12T01:37:55.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.234+0000 7fea2d8fa640 1 -- 172.21.15.60:0/2209384949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea2815eaf0 con 0x7fea280b72f0 2024-09-12T01:37:55.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.234+0000 7fea1ffff640 1 -- 172.21.15.60:0/2209384949 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea1801d070 con 0x7fea280b72f0 2024-09-12T01:37:55.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.235+0000 7fea1ffff640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea0806be30 0x7fea0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.235+0000 7fea1ffff640 1 -- 172.21.15.60:0/2209384949 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fea1808b5a0 con 0x7fea280b72f0 2024-09-12T01:37:55.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.235+0000 7fea267fc640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea0806be30 0x7fea0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.235+0000 7fea267fc640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea0806be30 0x7fea0806e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fea10034000 tx=0x7fea1002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:55.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.239+0000 7fea1ffff640 1 -- 172.21.15.60:0/2209384949 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea18059990 con 0x7fea280b72f0 2024-09-12T01:37:55.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.450+0000 7fea2d8fa640 1 -- 172.21.15.60:0/2209384949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea281617e0 con 0x7fea280b72f0 2024-09-12T01:37:55.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.450+0000 7fea1ffff640 1 -- 172.21.15.60:0/2209384949 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5235 (secure 0 0 0) 0x7fea1805ee20 con 0x7fea280b72f0 2024-09-12T01:37:55.450 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:55.450 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"btime":"2024-09-12T01:37:48:964735+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2903062918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2903062918},{"type":"v1","addr":"172.21.15.105:6835","nonce":2903062918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1613307735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1613307735},{"type":"v1","addr":"172.21.15.60:6836","nonce":1613307735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/4169562393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":4169562393},{"type":"v1","addr":"172.21.15.60:6837","nonce":4169562393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:37:45.314718+0000","modified":"2024-09-12T01:37:48.116046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34778":{"gid":34778,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/2704792080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2704792080},{"type":"v1","addr":"172.21.15.105:6834","nonce":2704792080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34778,"qdb_cluster":[34778]},"id":3}]} 2024-09-12T01:37:55.450 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 21 2024-09-12T01:37:55.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.452+0000 7fea2d8fa640 1 -- 172.21.15.60:0/2209384949 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea0806be30 msgr2=0x7fea0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.452+0000 7fea2d8fa640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea0806be30 0x7fea0806e2f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fea10034000 tx=0x7fea1002e000 comp rx=0 tx=0).stop 2024-09-12T01:37:55.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.452+0000 7fea2d8fa640 1 -- 172.21.15.60:0/2209384949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea280b72f0 msgr2=0x7fea28159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.452+0000 7fea2d8fa640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea280b72f0 0x7fea28159990 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fea1800cf90 tx=0x7fea1800a7d0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.452+0000 7fea2d8fa640 1 -- 172.21.15.60:0/2209384949 shutdown_connections 2024-09-12T01:37:55.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.452+0000 7fea2d8fa640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea0806be30 0x7fea0806e2f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.452+0000 7fea2d8fa640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea2815f030 0x7fea28146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.452+0000 7fea2d8fa640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea2815c2b0 0x7fea280b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.452+0000 7fea2d8fa640 1 --2- 172.21.15.60:0/2209384949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea280b72f0 0x7fea28159990 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.452+0000 7fea2d8fa640 1 -- 172.21.15.60:0/2209384949 >> 172.21.15.60:0/2209384949 conn(0x7fea280b4240 msgr2=0x7fea2815d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:55.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.452+0000 7fea2d8fa640 1 -- 172.21.15.60:0/2209384949 shutdown_connections 2024-09-12T01:37:55.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.452+0000 7fea2d8fa640 1 -- 172.21.15.60:0/2209384949 wait complete. 2024-09-12T01:37:55.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:37:45.314718+0000', 'modified': '2024-09-12T01:37:48.116046+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34778}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34778': {'gid': 34778, 'name': 'd', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6834/2704792080', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 2704792080}, {'type': 'v1', 'addr': '172.21.15.105:6834', 'nonce': 2704792080}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34778, 'qdb_cluster': [34778]} 2024-09-12T01:37:55.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:37:55.866 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T01:37:55.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.973+0000 7f9957082640 1 Processor -- start 2024-09-12T01:37:55.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.973+0000 7f9957082640 1 -- start start 2024-09-12T01:37:55.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.973+0000 7f9957082640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f995015e7a0 0x7f995006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.974+0000 7f9957082640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99500b68f0 0x7f99500d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.974+0000 7f9957082640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99500cf860 con 0x7f99500cf1f0 2024-09-12T01:37:55.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.974+0000 7f9957082640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f99500d2ca0 con 0x7f995015e7a0 2024-09-12T01:37:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.974+0000 7f9957082640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f99500cfb40 con 0x7f99500b68f0 2024-09-12T01:37:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.974+0000 7f9954e1e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f995015e7a0 0x7f995006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.974+0000 7f9954e1e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f995015e7a0 0x7f995006caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42986/0 (socket says 172.21.15.60:42986) 2024-09-12T01:37:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.974+0000 7f9954e1e640 1 -- 172.21.15.60:0/1576520893 learned_addr learned my addr 172.21.15.60:0/1576520893 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.974+0000 7f995561f640 1 --2- 172.21.15.60:0/1576520893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99500b68f0 0x7f99500d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.974+0000 7f9954e1e640 1 -- 172.21.15.60:0/1576520893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99500b68f0 msgr2=0x7f99500d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.974+0000 7f9954e1e640 1 --2- 172.21.15.60:0/1576520893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99500b68f0 0x7f99500d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.974+0000 7f9954e1e640 1 -- 172.21.15.60:0/1576520893 >> v1:172.21.15.105:6789/0 conn(0x7f99500cf1f0 legacy=0x7f99500b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.974+0000 7f9954e1e640 1 -- 172.21.15.60:0/1576520893 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99500cfe20 con 0x7f995015e7a0 2024-09-12T01:37:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.975+0000 7f9954e1e640 1 --2- 172.21.15.60:0/1576520893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f995015e7a0 0x7f995006caa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9938009870 tx=0x7f993802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10bff5f2125840c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.975+0000 7f994f7fe640 1 -- 172.21.15.60:0/1576520893 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938037070 con 0x7f995015e7a0 2024-09-12T01:37:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.975+0000 7f994f7fe640 1 -- 172.21.15.60:0/1576520893 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9938032440 con 0x7f995015e7a0 2024-09-12T01:37:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.975+0000 7f994f7fe640 1 -- 172.21.15.60:0/1576520893 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938032810 con 0x7f995015e7a0 2024-09-12T01:37:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.975+0000 7f9957082640 1 -- 172.21.15.60:0/1576520893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f995015e7a0 msgr2=0x7f995006caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.975+0000 7f9957082640 1 --2- 172.21.15.60:0/1576520893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f995015e7a0 0x7f995006caa0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9938009870 tx=0x7f993802a1c0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.976+0000 7f9957082640 1 -- 172.21.15.60:0/1576520893 shutdown_connections 2024-09-12T01:37:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.976+0000 7f9957082640 1 --2- 172.21.15.60:0/1576520893 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99500b68f0 0x7f99500d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.976+0000 7f9957082640 1 --2- 172.21.15.60:0/1576520893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f995015e7a0 0x7f995006caa0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.976+0000 7f9957082640 1 -- 172.21.15.60:0/1576520893 >> 172.21.15.60:0/1576520893 conn(0x7f99500d11e0 msgr2=0x7f99500d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.976+0000 7f9957082640 1 -- 172.21.15.60:0/1576520893 shutdown_connections 2024-09-12T01:37:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.976+0000 7f9957082640 1 -- 172.21.15.60:0/1576520893 wait complete. 2024-09-12T01:37:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.977+0000 7f9957082640 1 Processor -- start 2024-09-12T01:37:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.977+0000 7f9957082640 1 -- start start 2024-09-12T01:37:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9957082640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99500b68f0 0x7f99501614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9957082640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99500cf1f0 0x7f995015ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9957082640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f995015e7a0 0x7f995014b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9957082640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f995006cfe0 con 0x7f99500b68f0 2024-09-12T01:37:55.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9957082640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f99500b7a00 con 0x7f995015e7a0 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9957082640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f995015eb80 con 0x7f99500cf1f0 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9954e1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99500b68f0 0x7f99501614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9954e1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99500b68f0 0x7f99501614e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42992/0 (socket says 172.21.15.60:42992) 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9954e1e640 1 -- 172.21.15.60:0/3177411041 learned_addr learned my addr 172.21.15.60:0/3177411041 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f995561f640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f995015e7a0 0x7f995014b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f994ffff640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99500cf1f0 0x7f995015ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9954e1e640 1 -- 172.21.15.60:0/3177411041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99500cf1f0 msgr2=0x7f995015ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9954e1e640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99500cf1f0 0x7f995015ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9954e1e640 1 -- 172.21.15.60:0/3177411041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f995015e7a0 msgr2=0x7f995014b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9954e1e640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f995015e7a0 0x7f995014b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9954e1e640 1 -- 172.21.15.60:0/3177411041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995015f8b0 con 0x7f99500b68f0 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.978+0000 7f9954e1e640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99500b68f0 0x7f99501614e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9938000c00 tx=0x7f99380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:55.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.979+0000 7f994d7fa640 1 -- 172.21.15.60:0/3177411041 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938037040 con 0x7f99500b68f0 2024-09-12T01:37:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.979+0000 7f994d7fa640 1 -- 172.21.15.60:0/3177411041 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9938042070 con 0x7f99500b68f0 2024-09-12T01:37:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.979+0000 7f994d7fa640 1 -- 172.21.15.60:0/3177411041 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938030880 con 0x7f99500b68f0 2024-09-12T01:37:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.979+0000 7f9957082640 1 -- 172.21.15.60:0/3177411041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f995015fb90 con 0x7f99500b68f0 2024-09-12T01:37:55.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.979+0000 7f9957082640 1 -- 172.21.15.60:0/3177411041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9950160150 con 0x7f99500b68f0 2024-09-12T01:37:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.980+0000 7f994d7fa640 1 -- 172.21.15.60:0/3177411041 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f993802ad10 con 0x7f99500b68f0 2024-09-12T01:37:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.981+0000 7f994d7fa640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f993006be30 0x7f993006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.981+0000 7f994d7fa640 1 -- 172.21.15.60:0/3177411041 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f99380ab490 con 0x7f99500b68f0 2024-09-12T01:37:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.981+0000 7f994ffff640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f993006be30 0x7f993006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.981+0000 7f994ffff640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f993006be30 0x7f993006e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f99500b92a0 tx=0x7f9940009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.982+0000 7f9959e1e740 1 Processor -- start 2024-09-12T01:37:55.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.982+0000 7f9959e1e740 1 -- start start 2024-09-12T01:37:55.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f9959e1e740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c54772c0 0x5598c54bca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f9959e1e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5474a80 0x5598c54776a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f9959e1e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c5478a50 0x5598c54718b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f9959e1e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5598c53d9520 con 0x5598c5478a50 2024-09-12T01:37:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f9959e1e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5598c53813e0 con 0x5598c5474a80 2024-09-12T01:37:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f9959e1e740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5598c53d54e0 con 0x5598c54772c0 2024-09-12T01:37:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f995561f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c5478a50 0x5598c54718b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f995561f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c5478a50 0x5598c54718b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43006/0 (socket says 172.21.15.60:43006) 2024-09-12T01:37:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f995561f640 1 -- 172.21.15.60:0/4155431579 learned_addr learned my addr 172.21.15.60:0/4155431579 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f9954e1e640 1 --2- 172.21.15.60:0/4155431579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c54772c0 0x5598c54bca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f994ffff640 1 --2- 172.21.15.60:0/4155431579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5474a80 0x5598c54776a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f995561f640 1 -- 172.21.15.60:0/4155431579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c54772c0 msgr2=0x5598c54bca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:55.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f995561f640 1 --2- 172.21.15.60:0/4155431579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c54772c0 0x5598c54bca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f995561f640 1 -- 172.21.15.60:0/4155431579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5474a80 msgr2=0x5598c54776a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f995561f640 1 --2- 172.21.15.60:0/4155431579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5474a80 0x5598c54776a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f995561f640 1 -- 172.21.15.60:0/4155431579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c539c2f0 con 0x5598c5478a50 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f995561f640 1 --2- 172.21.15.60:0/4155431579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c5478a50 0x5598c54718b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9948009b30 tx=0x7f9948009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e293a6530f41ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f99467fc640 1 -- 172.21.15.60:0/4155431579 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948011c20 con 0x5598c5478a50 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f99467fc640 1 -- 172.21.15.60:0/4155431579 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9948011dc0 con 0x5598c5478a50 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.983+0000 7f99467fc640 1 -- 172.21.15.60:0/4155431579 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9948004270 con 0x5598c5478a50 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.984+0000 7f9959e1e740 1 -- 172.21.15.60:0/4155431579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c5478a50 msgr2=0x5598c54718b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.984+0000 7f9959e1e740 1 --2- 172.21.15.60:0/4155431579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c5478a50 0x5598c54718b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9948009b30 tx=0x7f9948009190 comp rx=0 tx=0).stop 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.984+0000 7f9959e1e740 1 -- 172.21.15.60:0/4155431579 shutdown_connections 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.984+0000 7f9959e1e740 1 --2- 172.21.15.60:0/4155431579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c5478a50 0x5598c54718b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.984+0000 7f9959e1e740 1 --2- 172.21.15.60:0/4155431579 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5474a80 0x5598c54776a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.984+0000 7f9959e1e740 1 --2- 172.21.15.60:0/4155431579 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c54772c0 0x5598c54bca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.984+0000 7f9959e1e740 1 -- 172.21.15.60:0/4155431579 >> 172.21.15.60:0/4155431579 conn(0x5598c5473a80 msgr2=0x5598c54bbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:55.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.984+0000 7f9959e1e740 1 -- 172.21.15.60:0/4155431579 shutdown_connections 2024-09-12T01:37:55.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.984+0000 7f9959e1e740 1 -- 172.21.15.60:0/4155431579 wait complete. 2024-09-12T01:37:55.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.985+0000 7f9959e1e740 1 -- start start 2024-09-12T01:37:55.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.985+0000 7f9959e1e740 1 Processor -- start 2024-09-12T01:37:55.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9959e1e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c5497140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9959e1e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5478a50 0x5598c5497a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9959e1e740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5495a40 0x5598c54719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9959e1e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5598c5472f20 con 0x5598c54772c0 2024-09-12T01:37:55.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9959e1e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5598c5362450 con 0x5598c5478a50 2024-09-12T01:37:55.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9959e1e740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5598c54bd290 con 0x5598c5495a40 2024-09-12T01:37:55.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9959e1e740 10 client.0 _ll_register_callbacks cb 0x5598c50ebac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9954e1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c5497140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9954e1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c5497140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43008/0 (socket says 172.21.15.60:43008) 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9954e1e640 1 -- 172.21.15.60:0/139303171 learned_addr learned my addr 172.21.15.60:0/139303171 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f995561f640 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5495a40 0x5598c54719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f994ffff640 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5478a50 0x5598c5497a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9954e1e640 1 -- 172.21.15.60:0/139303171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5495a40 msgr2=0x5598c54719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9954e1e640 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5495a40 0x5598c54719f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9954e1e640 1 -- 172.21.15.60:0/139303171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5478a50 msgr2=0x5598c5497a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9954e1e640 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5478a50 0x5598c5497a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9954e1e640 1 -- 172.21.15.60:0/139303171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c50ec2d0 con 0x5598c54772c0 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9954e1e640 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c5497140 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9938009870 tx=0x7f9938079e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a425238a77536b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f992f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:37:55.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f992f7fe640 1 -- 172.21.15.60:0/139303171 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938082280 con 0x5598c54772c0 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f992f7fe640 1 -- 172.21.15.60:0/139303171 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f99380ab0b0 con 0x5598c54772c0 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9959e1e740 1 -- 172.21.15.60:0/139303171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9948011dc0 con 0x5598c54772c0 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f992f7fe640 1 -- 172.21.15.60:0/139303171 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f99380ab2b0 con 0x5598c54772c0 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9959e1e740 10 client.5391 fetch_fsmap learned FSMap version 21 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.986+0000 7f9959e1e740 1 -- 172.21.15.60:0/139303171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5598c51b66b0 con 0x5598c54772c0 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.987+0000 7f992f7fe640 1 -- 172.21.15.60:0/139303171 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9948011dc0 con 0x5598c54772c0 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.987+0000 7f992f7fe640 1 -- 172.21.15.60:0/139303171 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f993803a070 con 0x5598c54772c0 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.987+0000 7f9959e1e740 10 client.5391 fetch_fsmap finished waiting for FSMap version 21 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.987+0000 7f9959e1e740 10 client.5391 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.987+0000 7f9959e1e740 20 client.5391 populate_metadata read hostname 'smithi060' 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.987+0000 7f9959e1e740 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.105:6832/2704792080,v1:172.21.15.105:6834/2704792080] conn(0x5598c54707d0 0x5598c5470bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.987+0000 7f9959e1e740 4 client.5391 mds_command: new command op to 34778 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.987+0000 7f9959e1e740 1 -- 172.21.15.60:0/139303171 --> [v2:172.21.15.105:6832/2704792080,v1:172.21.15.105:6834/2704792080] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598c53e6c50 con 0x5598c54707d0 2024-09-12T01:37:55.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.987+0000 7f994ffff640 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.105:6832/2704792080,v1:172.21.15.105:6834/2704792080] conn(0x5598c54707d0 0x5598c5470bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.987+0000 7f992f7fe640 10 client.5391 ms_handle_connect on v2:172.21.15.105:6832/2704792080 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.987+0000 7f994ffff640 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.105:6832/2704792080,v1:172.21.15.105:6834/2704792080] conn(0x5598c54707d0 0x5598c5470bb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4919e6ab62c58ef server_cookie=bf068ba3915c1a8b in_seq=0 out_seq=0 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.988+0000 7f992f7fe640 1 -- 172.21.15.60:0/139303171 <== mds.0 v2:172.21.15.105:6832/2704792080 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598c53e6c50 con 0x5598c54707d0 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.988+0000 7f992f7fe640 10 client.5391 handle_command_reply: tid=0 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.988+0000 7f9959e1e740 1 client.5391 shutdown 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.989+0000 7f9959e1e740 1 -- 172.21.15.60:0/139303171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 msgr2=0x5598c5497140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.989+0000 7f9959e1e740 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c5497140 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9938009870 tx=0x7f9938079e60 comp rx=0 tx=0).stop 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.989+0000 7f9959e1e740 1 -- 172.21.15.60:0/139303171 shutdown_connections 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.989+0000 7f9959e1e740 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.105:6832/2704792080,v1:172.21.15.105:6834/2704792080] conn(0x5598c54707d0 0x5598c5470bb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.989+0000 7f9959e1e740 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5495a40 0x5598c54719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.989+0000 7f9959e1e740 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5478a50 0x5598c5497a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.989+0000 7f9959e1e740 1 --2- 172.21.15.60:0/139303171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c5497140 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:55.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.989+0000 7f9959e1e740 1 -- 172.21.15.60:0/139303171 >> 172.21.15.60:0/139303171 conn(0x5598c5474a80 msgr2=0x5598c54b9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:55.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.989+0000 7f992f7fe640 0 client.5391 ms_handle_reset on v2:172.21.15.105:6832/2704792080 2024-09-12T01:37:55.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.989+0000 7f9959e1e740 1 -- 172.21.15.60:0/139303171 shutdown_connections 2024-09-12T01:37:55.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.989+0000 7f9959e1e740 1 -- 172.21.15.60:0/139303171 wait complete. 2024-09-12T01:37:55.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:55.989+0000 7f9959e1e740 20 client.5391 trim_cache size 0 max 16384 2024-09-12T01:37:56.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.007+0000 7f9959e1e740 1 Processor -- start 2024-09-12T01:37:56.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.007+0000 7f9959e1e740 1 -- start start 2024-09-12T01:37:56.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9959e1e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c54a1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9959e1e740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5478a50 0x5598c54a1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9959e1e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5495a40 0x5598c54ba1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9959e1e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f99500cd640 con 0x5598c54772c0 2024-09-12T01:37:56.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9959e1e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f99501e8d60 con 0x5598c5495a40 2024-09-12T01:37:56.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9959e1e740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f99500ccff0 con 0x5598c5478a50 2024-09-12T01:37:56.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9954e1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c54a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9954e1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c54a1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43010/0 (socket says 172.21.15.60:43010) 2024-09-12T01:37:56.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9954e1e640 1 -- 172.21.15.60:0/3496571965 learned_addr learned my addr 172.21.15.60:0/3496571965 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:56.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f994ffff640 1 --2- 172.21.15.60:0/3496571965 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5478a50 0x5598c54a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f995561f640 1 --2- 172.21.15.60:0/3496571965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5495a40 0x5598c54ba1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9954e1e640 1 -- 172.21.15.60:0/3496571965 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5478a50 msgr2=0x5598c54a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9954e1e640 1 --2- 172.21.15.60:0/3496571965 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5478a50 0x5598c54a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9954e1e640 1 -- 172.21.15.60:0/3496571965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5495a40 msgr2=0x5598c54ba1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9954e1e640 1 --2- 172.21.15.60:0/3496571965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5495a40 0x5598c54ba1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9954e1e640 1 -- 172.21.15.60:0/3496571965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598c5473260 con 0x5598c54772c0 2024-09-12T01:37:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.008+0000 7f9954e1e640 1 --2- 172.21.15.60:0/3496571965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c54a1270 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f99380ab010 tx=0x7f9938049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd50cbc4d1a42973 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.009+0000 7f9945ffb640 1 -- 172.21.15.60:0/3496571965 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938082280 con 0x5598c54772c0 2024-09-12T01:37:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.009+0000 7f9945ffb640 1 -- 172.21.15.60:0/3496571965 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9938079ae0 con 0x5598c54772c0 2024-09-12T01:37:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.009+0000 7f9945ffb640 1 -- 172.21.15.60:0/3496571965 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938081df0 con 0x5598c54772c0 2024-09-12T01:37:56.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.009+0000 7f9959e1e740 1 -- 172.21.15.60:0/3496571965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 msgr2=0x5598c54a1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:56.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.009+0000 7f9959e1e740 1 --2- 172.21.15.60:0/3496571965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c54a1270 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f99380ab010 tx=0x7f9938049000 comp rx=0 tx=0).stop 2024-09-12T01:37:56.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.009+0000 7f9959e1e740 1 -- 172.21.15.60:0/3496571965 shutdown_connections 2024-09-12T01:37:56.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.009+0000 7f9959e1e740 1 --2- 172.21.15.60:0/3496571965 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5495a40 0x5598c54ba1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.009+0000 7f9959e1e740 1 --2- 172.21.15.60:0/3496571965 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5478a50 0x5598c54a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.009+0000 7f9959e1e740 1 --2- 172.21.15.60:0/3496571965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c54a1270 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.009+0000 7f9959e1e740 1 -- 172.21.15.60:0/3496571965 >> 172.21.15.60:0/3496571965 conn(0x5598c5474a80 msgr2=0x5598c5475020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.009+0000 7f9959e1e740 1 -- 172.21.15.60:0/3496571965 shutdown_connections 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.009+0000 7f9959e1e740 1 -- 172.21.15.60:0/3496571965 wait complete. 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.010+0000 7f9959e1e740 1 -- start start 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.010+0000 7f9959e1e740 1 Processor -- start 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9959e1e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c553a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9959e1e740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5478a50 0x5598c54dfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9959e1e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5495a40 0x5598c5523070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9959e1e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5598c54723b0 con 0x5598c54772c0 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9959e1e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5598c5496c20 con 0x5598c5495a40 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9959e1e740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5598c5495f40 con 0x5598c5478a50 2024-09-12T01:37:56.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9959e1e740 10 client.0 _ll_register_callbacks cb 0x7f993802a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9954e1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c553a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9954e1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c553a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43020/0 (socket says 172.21.15.60:43020) 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9954e1e640 1 -- 172.21.15.60:0/1890401734 learned_addr learned my addr 172.21.15.60:0/1890401734 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f994ffff640 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5478a50 0x5598c54dfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f995561f640 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5495a40 0x5598c5523070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9954e1e640 1 -- 172.21.15.60:0/1890401734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5478a50 msgr2=0x5598c54dfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9954e1e640 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5478a50 0x5598c54dfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9954e1e640 1 -- 172.21.15.60:0/1890401734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5495a40 msgr2=0x5598c5523070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9954e1e640 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5495a40 0x5598c5523070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9954e1e640 1 -- 172.21.15.60:0/1890401734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598c54e03c0 con 0x5598c54772c0 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f9954e1e640 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c553a090 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9938009870 tx=0x7f99380a97f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4499291c35f720 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.011+0000 7f992f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f992f7fe640 1 -- 172.21.15.60:0/1890401734 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938082280 con 0x5598c54772c0 2024-09-12T01:37:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f992f7fe640 1 -- 172.21.15.60:0/1890401734 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f99380ab0b0 con 0x5598c54772c0 2024-09-12T01:37:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f9959e1e740 1 -- 172.21.15.60:0/1890401734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9938079ae0 con 0x5598c54772c0 2024-09-12T01:37:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f992f7fe640 1 -- 172.21.15.60:0/1890401734 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9938079900 con 0x5598c54772c0 2024-09-12T01:37:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f9959e1e740 10 client.5397 fetch_fsmap learned FSMap version 21 2024-09-12T01:37:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f9959e1e740 1 -- 172.21.15.60:0/1890401734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x5598c54e03c0 con 0x5598c54772c0 2024-09-12T01:37:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f992f7fe640 1 -- 172.21.15.60:0/1890401734 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9938079ae0 con 0x5598c54772c0 2024-09-12T01:37:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f992f7fe640 1 -- 172.21.15.60:0/1890401734 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f993803a070 con 0x5598c54772c0 2024-09-12T01:37:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f9959e1e740 10 client.5397 fetch_fsmap finished waiting for FSMap version 21 2024-09-12T01:37:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f9959e1e740 10 client.5397 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:37:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f9959e1e740 20 client.5397 populate_metadata read hostname 'smithi060' 2024-09-12T01:37:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f9959e1e740 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.105:6832/2704792080,v1:172.21.15.105:6834/2704792080] conn(0x5598c549deb0 0x5598c549e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f9959e1e740 4 client.5397 mds_command: new command op to 34778 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:37:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f9959e1e740 1 -- 172.21.15.60:0/1890401734 --> [v2:172.21.15.105:6832/2704792080,v1:172.21.15.105:6834/2704792080] -- command(tid 0: {"prefix": "status"}) -- 0x5598c54a0010 con 0x5598c549deb0 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.012+0000 7f994ffff640 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.105:6832/2704792080,v1:172.21.15.105:6834/2704792080] conn(0x5598c549deb0 0x5598c549e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f992f7fe640 10 client.5397 ms_handle_connect on v2:172.21.15.105:6832/2704792080 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f994ffff640 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.105:6832/2704792080,v1:172.21.15.105:6834/2704792080] conn(0x5598c549deb0 0x5598c549e290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdf88661b69ee57 server_cookie=f7d0476fb6c6c6b5 in_seq=0 out_seq=0 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f992f7fe640 1 -- 172.21.15.60:0/1890401734 <== mds.0 v2:172.21.15.105:6832/2704792080 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5598c54a0010 con 0x5598c549deb0 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f992f7fe640 10 client.5397 handle_command_reply: tid=0 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f9959e1e740 1 client.5397 shutdown 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f9959e1e740 1 -- 172.21.15.60:0/1890401734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 msgr2=0x5598c553a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f9959e1e740 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c553a090 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9938009870 tx=0x7f99380a97f0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f9959e1e740 1 -- 172.21.15.60:0/1890401734 shutdown_connections 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f9959e1e740 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.105:6832/2704792080,v1:172.21.15.105:6834/2704792080] conn(0x5598c549deb0 0x5598c549e290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f9959e1e740 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5598c5495a40 0x5598c5523070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f9959e1e740 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5598c5478a50 0x5598c54dfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f992f7fe640 0 client.5397 ms_handle_reset on v2:172.21.15.105:6832/2704792080 2024-09-12T01:37:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f9959e1e740 1 --2- 172.21.15.60:0/1890401734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5598c54772c0 0x5598c553a090 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f9959e1e740 1 -- 172.21.15.60:0/1890401734 >> 172.21.15.60:0/1890401734 conn(0x5598c5474a80 msgr2=0x5598c54b94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:56.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f9959e1e740 1 -- 172.21.15.60:0/1890401734 shutdown_connections 2024-09-12T01:37:56.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f9959e1e740 1 -- 172.21.15.60:0/1890401734 wait complete. 2024-09-12T01:37:56.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.013+0000 7f9959e1e740 20 client.5397 trim_cache size 0 max 16384 2024-09-12T01:37:56.018 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:37:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "5401bd8a-3492-4b21-b6c0-d6616ff39793", 2024-09-12T01:37:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T01:37:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 34778, 2024-09-12T01:37:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T01:37:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T01:37:56.018 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-12T01:37:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 10.062386546999999, 2024-09-12T01:37:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 21, 2024-09-12T01:37:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 46, 2024-09-12T01:37:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 46, 2024-09-12T01:37:56.019 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 15.075774681 2024-09-12T01:37:56.019 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:37:56.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.014+0000 7f9957082640 1 -- 172.21.15.60:0/3177411041 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f993006be30 msgr2=0x7f993006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:56.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.014+0000 7f9957082640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f993006be30 0x7f993006e2f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f99500b92a0 tx=0x7f9940009040 comp rx=0 tx=0).stop 2024-09-12T01:37:56.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.014+0000 7f9957082640 1 -- 172.21.15.60:0/3177411041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99500b68f0 msgr2=0x7f99501614e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:56.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.014+0000 7f9957082640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99500b68f0 0x7f99501614e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9938000c00 tx=0x7f99380046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.014+0000 7f9957082640 1 -- 172.21.15.60:0/3177411041 shutdown_connections 2024-09-12T01:37:56.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.014+0000 7f9957082640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f995015e7a0 0x7f995014b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.014+0000 7f9957082640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f993006be30 0x7f993006e2f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.014+0000 7f9957082640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f99500cf1f0 0x7f995015ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.014+0000 7f9957082640 1 --2- 172.21.15.60:0/3177411041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99500b68f0 0x7f99501614e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.014+0000 7f9957082640 1 -- 172.21.15.60:0/3177411041 >> 172.21.15.60:0/3177411041 conn(0x7f99500d11e0 msgr2=0x7f99500d4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.014+0000 7f9957082640 1 -- 172.21.15.60:0/3177411041 shutdown_connections 2024-09-12T01:37:56.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.014+0000 7f9957082640 1 -- 172.21.15.60:0/3177411041 wait complete. 2024-09-12T01:37:56.025 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:37:56.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.127+0000 7f06ad3e8640 1 Processor -- start 2024-09-12T01:37:56.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.128+0000 7f06ad3e8640 1 -- start start 2024-09-12T01:37:56.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.128+0000 7f06ad3e8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f06a815e660 0x7f06a80cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.128+0000 7f06ad3e8640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a815ea40 con 0x7f06a80d1820 2024-09-12T01:37:56.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.128+0000 7f06ad3e8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06a80d3870 con 0x7f06a80d3310 2024-09-12T01:37:56.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.128+0000 7f06ad3e8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f06a80d3b50 con 0x7f06a815e660 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.128+0000 7f06a77fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f06a80d1820 0x7f06a80b7b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44202/0 (socket says 172.21.15.60:44202) 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.128+0000 7f06a77fe640 1 -- 172.21.15.60:0/1945635570 learned_addr learned my addr 172.21.15.60:0/1945635570 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a6ffd640 1 --2- 172.21.15.60:0/1945635570 >> v2:172.21.15.105:3300/0 conn(0x7f06a815e660 0x7f06a80cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29991606 0 0) 0x7f06a815ea40 con 0x7f06a80d1820 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0690003520 con 0x7f06a80d1820 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1474299527 0 0) 0x7f0690003520 con 0x7f06a80d1820 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 >> v2:172.21.15.105:3300/0 conn(0x7f06a815e660 msgr2=0x7f06a80cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 --2- 172.21.15.60:0/1945635570 >> v2:172.21.15.105:3300/0 conn(0x7f06a815e660 0x7f06a80cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 >> v1:172.21.15.105:6789/0 conn(0x7f06a80d3310 legacy=0x7f06a80d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a80d3e30 con 0x7f06a80d1820 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f06a0001670 con 0x7f06a80d1820 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 >> v1:172.21.15.60:6789/0 conn(0x7f06a80d1820 legacy=0x7f06a80b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 --2- 172.21.15.60:0/1945635570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06900039b0 0x7f0690003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 --2- 172.21.15.60:0/1945635570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 0x7f0690004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 --2- 172.21.15.60:0/1945635570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06900051c0 0x7f069000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f06a80d3b50 con 0x7f0690004800 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f069000c060 con 0x7f06900039b0 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f069000c260 con 0x7f06900051c0 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a6ffd640 1 --2- 172.21.15.60:0/1945635570 >> v2:172.21.15.105:3300/0 conn(0x7f06a815e660 0x7f06a80cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a67fc640 1 --2- 172.21.15.60:0/1945635570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 0x7f0690004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a77fe640 1 --2- 172.21.15.60:0/1945635570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06900051c0 0x7f069000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a6ffd640 1 --2- 172.21.15.60:0/1945635570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06900039b0 0x7f0690003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a67fc640 1 -- 172.21.15.60:0/1945635570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06900051c0 msgr2=0x7f069000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a67fc640 1 --2- 172.21.15.60:0/1945635570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06900051c0 0x7f069000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a67fc640 1 -- 172.21.15.60:0/1945635570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06900039b0 msgr2=0x7f0690003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.129+0000 7f06a67fc640 1 --2- 172.21.15.60:0/1945635570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06900039b0 0x7f0690003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.130+0000 7f06a67fc640 1 -- 172.21.15.60:0/1945635570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0690003520 con 0x7f0690004800 2024-09-12T01:37:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.130+0000 7f06a77fe640 1 -- 172.21.15.60:0/1945635570 reap_dead start 2024-09-12T01:37:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.130+0000 7f06a67fc640 1 --2- 172.21.15.60:0/1945635570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 0x7f0690004c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f069c001750 tx=0x7f0690005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb99879c4afc61 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.130+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c001370 con 0x7f0690004800 2024-09-12T01:37:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.130+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f069c0052d0 con 0x7f0690004800 2024-09-12T01:37:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.130+0000 7f06a5ffb640 1 -- 172.21.15.60:0/1945635570 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c02abc0 con 0x7f0690004800 2024-09-12T01:37:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.131+0000 7f06ad3e8640 1 -- 172.21.15.60:0/1945635570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 msgr2=0x7f0690004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.131+0000 7f06ad3e8640 1 --2- 172.21.15.60:0/1945635570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 0x7f0690004c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f069c001750 tx=0x7f0690005830 comp rx=0 tx=0).stop 2024-09-12T01:37:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.131+0000 7f06ad3e8640 1 -- 172.21.15.60:0/1945635570 shutdown_connections 2024-09-12T01:37:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.131+0000 7f06ad3e8640 1 --2- 172.21.15.60:0/1945635570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 0x7f0690004c80 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.131+0000 7f06ad3e8640 1 -- 172.21.15.60:0/1945635570 >> 172.21.15.60:0/1945635570 conn(0x7f06a80b6410 msgr2=0x7f06a80b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.131+0000 7f06ad3e8640 1 -- 172.21.15.60:0/1945635570 shutdown_connections 2024-09-12T01:37:56.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.131+0000 7f06ad3e8640 1 -- 172.21.15.60:0/1945635570 wait complete. 2024-09-12T01:37:56.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.132+0000 7f06ad3e8640 1 Processor -- start 2024-09-12T01:37:56.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.132+0000 7f06ad3e8640 1 -- start start 2024-09-12T01:37:56.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.133+0000 7f06ad3e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 0x7f06a8150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.133+0000 7f06ad3e8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06a81f43f0 0x7f06a80ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.133+0000 7f06ad3e8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06a815c2f0 0x7f06a815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.133+0000 7f06ad3e8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f06a80d1110 con 0x7f0690004800 2024-09-12T01:37:56.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.133+0000 7f06ad3e8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f06a80d43f0 con 0x7f06a815c2f0 2024-09-12T01:37:56.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.133+0000 7f06ad3e8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f06a80d1290 con 0x7f06a81f43f0 2024-09-12T01:37:56.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.133+0000 7f06a6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 0x7f06a8150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.133+0000 7f06a6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 0x7f06a8150b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43032/0 (socket says 172.21.15.60:43032) 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.133+0000 7f06a6ffd640 1 -- 172.21.15.60:0/4269974458 learned_addr learned my addr 172.21.15.60:0/4269974458 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.133+0000 7f06a67fc640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06a81f43f0 0x7f06a80ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.133+0000 7f06a77fe640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06a815c2f0 0x7f06a815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.134+0000 7f06a6ffd640 1 -- 172.21.15.60:0/4269974458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06a81f43f0 msgr2=0x7f06a80ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.134+0000 7f06a6ffd640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06a81f43f0 0x7f06a80ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.134+0000 7f06a6ffd640 1 -- 172.21.15.60:0/4269974458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06a815c2f0 msgr2=0x7f06a815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.134+0000 7f06a6ffd640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06a815c2f0 0x7f06a815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.134+0000 7f06a6ffd640 1 -- 172.21.15.60:0/4269974458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a81510a0 con 0x7f0690004800 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.134+0000 7f06a6ffd640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 0x7f06a8150b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0698011480 tx=0x7f0698011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.134+0000 7f068f7fe640 1 -- 172.21.15.60:0/4269974458 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069801a020 con 0x7f0690004800 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.134+0000 7f068f7fe640 1 -- 172.21.15.60:0/4269974458 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0698016740 con 0x7f0690004800 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.134+0000 7f06ad3e8640 1 -- 172.21.15.60:0/4269974458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a81f48b0 con 0x7f0690004800 2024-09-12T01:37:56.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.134+0000 7f068f7fe640 1 -- 172.21.15.60:0/4269974458 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0698016b10 con 0x7f0690004800 2024-09-12T01:37:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.134+0000 7f06ad3e8640 1 -- 172.21.15.60:0/4269974458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a81f4e70 con 0x7f0690004800 2024-09-12T01:37:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.135+0000 7f06ad3e8640 1 -- 172.21.15.60:0/4269974458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a80c9650 con 0x7f0690004800 2024-09-12T01:37:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.135+0000 7f068f7fe640 1 -- 172.21.15.60:0/4269974458 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0698005d10 con 0x7f0690004800 2024-09-12T01:37:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.136+0000 7f068f7fe640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f069406be30 0x7f069406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.136+0000 7f068f7fe640 1 -- 172.21.15.60:0/4269974458 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f069808bf70 con 0x7f0690004800 2024-09-12T01:37:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.136+0000 7f06a67fc640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f069406be30 0x7f069406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:56.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.136+0000 7f06a67fc640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f069406be30 0x7f069406e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f069c032000 tx=0x7f069c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:56.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.140+0000 7f068f7fe640 1 -- 172.21.15.60:0/4269974458 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0698024030 con 0x7f0690004800 2024-09-12T01:37:56.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.353+0000 7f06ad3e8640 1 -- 172.21.15.60:0/4269974458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f06a80cf730 con 0x7f0690004800 2024-09-12T01:37:56.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.353+0000 7f068f7fe640 1 -- 172.21.15.60:0/4269974458 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7f069805a360 con 0x7f0690004800 2024-09-12T01:37:56.353 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:37:56.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.355+0000 7f06ad3e8640 1 -- 172.21.15.60:0/4269974458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f069406be30 msgr2=0x7f069406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:56.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.355+0000 7f06ad3e8640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f069406be30 0x7f069406e2f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f069c032000 tx=0x7f069c02e000 comp rx=0 tx=0).stop 2024-09-12T01:37:56.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.355+0000 7f06ad3e8640 1 -- 172.21.15.60:0/4269974458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 msgr2=0x7f06a8150b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:56.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.355+0000 7f06ad3e8640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 0x7f06a8150b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0698011480 tx=0x7f0698011940 comp rx=0 tx=0).stop 2024-09-12T01:37:56.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.356+0000 7f06ad3e8640 1 -- 172.21.15.60:0/4269974458 shutdown_connections 2024-09-12T01:37:56.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.356+0000 7f06ad3e8640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f06a815c2f0 0x7f06a815c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.356+0000 7f06ad3e8640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f069406be30 0x7f069406e2f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.356+0000 7f06ad3e8640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f06a81f43f0 0x7f06a80ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.356+0000 7f06ad3e8640 1 --2- 172.21.15.60:0/4269974458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0690004800 0x7f06a8150b60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:56.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.356+0000 7f06ad3e8640 1 -- 172.21.15.60:0/4269974458 >> 172.21.15.60:0/4269974458 conn(0x7f06a80b6410 msgr2=0x7f06a806bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:56.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.356+0000 7f06ad3e8640 1 -- 172.21.15.60:0/4269974458 shutdown_connections 2024-09-12T01:37:56.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56.356+0000 7f06ad3e8640 1 -- 172.21.15.60:0/4269974458 wait complete. 2024-09-12T01:37:56.366 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:37:56.366 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:37:56.366 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T01:37:56.366 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:37:56.366 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:37:56.366 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:37:56.366 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:37:56.366 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:37:56.366 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:37:56.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:56.367 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T01:37:56.383 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:37:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:37:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:37:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:37:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:56.384 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:37:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:37:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T01:37:56.384 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:37:56.384 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:37:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T01:37:56.385 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:37:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:37:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T01:37:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:37:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42644sec preferred_lft 42644sec 2024-09-12T01:37:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T01:37:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:56.385 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:37:56.385 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e8cb:28ff:fea3:34fb/64 scope link 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 72:47:53:4d:4f:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7047:53ff:fe4d:4fc7/64 scope link 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:37:56.386 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:37:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::183c:47ff:fec1:173/64 scope link 2024-09-12T01:37:56.387 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:56.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:56.387 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:37:56.448 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T01:37:56.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:56.453 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T01:37:56.509 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T01:37:56.510 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:37:56.510 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:37:56.510 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:37:56.510 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:37:56.510 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:37:56.510 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:37:56.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:37:56.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:37:56.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:37:56.510 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:37:56.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:37:56.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:37:56.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:56.639 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:37:56.655 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:37:56.655 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:37:56.655 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:37:56.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:56.655 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-12T01:37:56.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:37:56.721 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:37:56.777 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:37:56.777 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:37:56.778 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:37:56.832 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T01:37:56.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:56.833 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:37:56.918 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:37:56.918 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:37:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:37:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:37:56.926 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:37:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:37:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:37:56.927 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:37:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:37:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:37:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:37:56.927 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:37:56.929 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:37:56.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:56.929 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:37:56.956 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:37:57.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:37:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:37:57.060 INFO:teuthology.orchestra.run.smithi060.stdout:client5406 2024-09-12T01:37:57.060 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:37:57.060 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:57.077 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:37:57.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.220+0000 7f4e43149640 1 Processor -- start 2024-09-12T01:37:57.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.220+0000 7f4e43149640 1 -- start start 2024-09-12T01:37:57.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e43149640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e3c155800 0x7f4e3c0b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:57.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e43149640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4e3c0cfc80 0x7f4e3c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:57.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e43149640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e3c15c770 con 0x7f4e3c15c330 2024-09-12T01:37:57.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e43149640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4e3c0b4e60 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e43149640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3c0b50a0 con 0x7f4e3c155800 2024-09-12T01:37:57.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e416e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4e3c0cfc80 0x7f4e3c0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:57.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e416e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4e3c0cfc80 0x7f4e3c0b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43042/0 (socket says 172.21.15.60:43042) 2024-09-12T01:37:57.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e416e6640 1 -- 172.21.15.60:0/3466825271 learned_addr learned my addr 172.21.15.60:0/3466825271 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:57.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e33fff640 1 --1- 172.21.15.60:0/3466825271 >> v1:172.21.15.60:6789/0 conn(0x7f4e3c15c330 0x7f4e3c0cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44214/0 (socket says 172.21.15.60:44214) 2024-09-12T01:37:57.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e40ee5640 1 --2- 172.21.15.60:0/3466825271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e3c155800 0x7f4e3c0b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:57.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e416e6640 1 -- 172.21.15.60:0/3466825271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e3c155800 msgr2=0x7f4e3c0b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:57.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e416e6640 1 --2- 172.21.15.60:0/3466825271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e3c155800 0x7f4e3c0b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:57.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e416e6640 1 -- 172.21.15.60:0/3466825271 >> v1:172.21.15.60:6789/0 conn(0x7f4e3c15c330 legacy=0x7f4e3c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:57.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e337fe640 1 -- 172.21.15.60:0/3466825271 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2660872263 0 0) 0x7f4e2c001110 con 0x7f4e3c15c330 2024-09-12T01:37:57.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.221+0000 7f4e416e6640 1 -- 172.21.15.60:0/3466825271 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3c0b5380 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.222+0000 7f4e416e6640 1 --2- 172.21.15.60:0/3466825271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e3c0cfc80 0x7f4e3c0b4920 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009e50 tx=0x7f4e3402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa860c03e3197dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:57.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.222+0000 7f4e337fe640 1 -- 172.21.15.60:0/3466825271 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e34036070 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.222+0000 7f4e337fe640 1 -- 172.21.15.60:0/3466825271 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e34031600 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.222+0000 7f4e337fe640 1 -- 172.21.15.60:0/3466825271 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e340319d0 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.223+0000 7f4e43149640 1 -- 172.21.15.60:0/3466825271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e3c0cfc80 msgr2=0x7f4e3c0b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:57.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.223+0000 7f4e43149640 1 --2- 172.21.15.60:0/3466825271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e3c0cfc80 0x7f4e3c0b4920 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009e50 tx=0x7f4e3402a710 comp rx=0 tx=0).stop 2024-09-12T01:37:57.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.223+0000 7f4e43149640 1 -- 172.21.15.60:0/3466825271 shutdown_connections 2024-09-12T01:37:57.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.223+0000 7f4e43149640 1 --2- 172.21.15.60:0/3466825271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e3c0cfc80 0x7f4e3c0b4920 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:57.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.223+0000 7f4e43149640 1 --2- 172.21.15.60:0/3466825271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e3c155800 0x7f4e3c0b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:57.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.223+0000 7f4e43149640 1 -- 172.21.15.60:0/3466825271 >> 172.21.15.60:0/3466825271 conn(0x7f4e3c06bc10 msgr2=0x7f4e3c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:57.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.223+0000 7f4e43149640 1 -- 172.21.15.60:0/3466825271 shutdown_connections 2024-09-12T01:37:57.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.223+0000 7f4e43149640 1 -- 172.21.15.60:0/3466825271 wait complete. 2024-09-12T01:37:57.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.224+0000 7f4e43149640 1 Processor -- start 2024-09-12T01:37:57.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.224+0000 7f4e43149640 1 -- start start 2024-09-12T01:37:57.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e43149640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e3c0cfc80 0x7f4e3c150b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:57.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e43149640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e3c155800 0x7f4e3c1f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e43149640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e3c15c330 0x7f4e3c0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e43149640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3c0b5c20 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e43149640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3c0b5940 con 0x7f4e3c155800 2024-09-12T01:37:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e43149640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3c155be0 con 0x7f4e3c15c330 2024-09-12T01:37:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e40ee5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e3c0cfc80 0x7f4e3c150b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e40ee5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e3c0cfc80 0x7f4e3c150b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43054/0 (socket says 172.21.15.60:43054) 2024-09-12T01:37:57.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e40ee5640 1 -- 172.21.15.60:0/1338018015 learned_addr learned my addr 172.21.15.60:0/1338018015 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:57.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e416e6640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e3c15c330 0x7f4e3c0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:57.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e33fff640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e3c155800 0x7f4e3c1f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:57.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e40ee5640 1 -- 172.21.15.60:0/1338018015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e3c15c330 msgr2=0x7f4e3c0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:57.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e40ee5640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e3c15c330 0x7f4e3c0cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:57.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e40ee5640 1 -- 172.21.15.60:0/1338018015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e3c155800 msgr2=0x7f4e3c1f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:57.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e40ee5640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e3c155800 0x7f4e3c1f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:57.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.225+0000 7f4e40ee5640 1 -- 172.21.15.60:0/1338018015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e3c155fa0 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.226+0000 7f4e40ee5640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e3c0cfc80 0x7f4e3c150b70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800d800 tx=0x7f4e3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:57.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.226+0000 7f4e317fa640 1 -- 172.21.15.60:0/1338018015 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800b6c0 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.226+0000 7f4e317fa640 1 -- 172.21.15.60:0/1338018015 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e38019070 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.226+0000 7f4e43149640 1 -- 172.21.15.60:0/1338018015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e3c156280 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.226+0000 7f4e317fa640 1 -- 172.21.15.60:0/1338018015 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800ba80 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.226+0000 7f4e43149640 1 -- 172.21.15.60:0/1338018015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e3c156840 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.227+0000 7f4e43149640 1 -- 172.21.15.60:0/1338018015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e3c0b4920 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.227+0000 7f4e317fa640 1 -- 172.21.15.60:0/1338018015 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e3800bc20 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.228+0000 7f4e317fa640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e2806be30 0x7f4e2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:57.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.228+0000 7f4e317fa640 1 -- 172.21.15.60:0/1338018015 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f4e3808b340 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.228+0000 7f4e33fff640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e2806be30 0x7f4e2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:57.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.228+0000 7f4e33fff640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e2806be30 0x7f4e2806e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c14f210 tx=0x7f4e2c007c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:57.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.232+0000 7f4e317fa640 1 -- 172.21.15.60:0/1338018015 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e38059ce0 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.443+0000 7f4e43149640 1 -- 172.21.15.60:0/1338018015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4e3c0633d0 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.444+0000 7f4e317fa640 1 -- 172.21.15.60:0/1338018015 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7f4e380595e0 con 0x7f4e3c0cfc80 2024-09-12T01:37:57.443 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:37:57.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.446+0000 7f4e43149640 1 -- 172.21.15.60:0/1338018015 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e2806be30 msgr2=0x7f4e2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:57.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.446+0000 7f4e43149640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e2806be30 0x7f4e2806e2f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c14f210 tx=0x7f4e2c007c00 comp rx=0 tx=0).stop 2024-09-12T01:37:57.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.446+0000 7f4e43149640 1 -- 172.21.15.60:0/1338018015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e3c0cfc80 msgr2=0x7f4e3c150b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:57.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.446+0000 7f4e43149640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e3c0cfc80 0x7f4e3c150b70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800d800 tx=0x7f4e3800dcc0 comp rx=0 tx=0).stop 2024-09-12T01:37:57.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.446+0000 7f4e43149640 1 -- 172.21.15.60:0/1338018015 shutdown_connections 2024-09-12T01:37:57.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.446+0000 7f4e43149640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e2806be30 0x7f4e2806e2f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:57.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.446+0000 7f4e43149640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e3c15c330 0x7f4e3c0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:57.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.446+0000 7f4e43149640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e3c155800 0x7f4e3c1f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:57.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.446+0000 7f4e43149640 1 --2- 172.21.15.60:0/1338018015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e3c0cfc80 0x7f4e3c150b70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:57.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.446+0000 7f4e43149640 1 -- 172.21.15.60:0/1338018015 >> 172.21.15.60:0/1338018015 conn(0x7f4e3c06bc10 msgr2=0x7f4e3c0b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:57.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.446+0000 7f4e43149640 1 -- 172.21.15.60:0/1338018015 shutdown_connections 2024-09-12T01:37:57.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:57.446+0000 7f4e43149640 1 -- 172.21.15.60:0/1338018015 wait complete. 2024-09-12T01:37:57.456 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:37:57.456 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:37:57.456 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T01:37:57.456 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:37:57.456 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:37:57.456 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:37:57.456 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:37:57.456 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:37:57.456 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:37:57.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:57.457 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T01:37:57.476 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:37:57.477 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:37:57.477 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:37:57.477 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:57.477 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:37:57.477 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:57.477 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:37:57.477 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:37:57.477 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T01:37:57.478 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:37:57.478 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:37:57.478 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T01:37:57.478 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:37:57.478 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:37:57.478 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:37:57.478 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:37:57.478 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:37:57.478 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42645sec preferred_lft 42645sec 2024-09-12T01:37:57.478 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T01:37:57.478 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:57.478 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::c46c:baff:feeb:1f5e/64 scope link 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 56:66:28:3d:b2:45 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::5466:28ff:fe3d:b245/64 scope link 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::2036:4aff:fe87:b9cb/64 scope link 2024-09-12T01:37:57.479 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:37:57.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:57.480 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:37:57.546 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:37:57.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:57.548 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T01:37:57.608 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T01:37:57.608 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:37:57.608 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:37:57.608 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:37:57.609 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:37:57.609 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:37:57.609 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:37:57.609 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:37:57.609 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:37:57.609 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:37:57.609 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:37:57.703 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:37:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:37:57.736 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:37:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:37:57.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:57.743 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:37:57.758 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T01:37:57.758 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:37:57.758 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:37:57.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:57.759 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-12T01:37:57.824 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:37:57.824 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:37:57.880 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:37:57.880 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:37:57.881 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:37:57.936 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T01:37:57.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:57.936 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:37:58.020 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:37:58.020 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:37:58.027 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:37:58.028 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:37:58.028 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:37:58.028 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 1@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:37:58.028 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:37:58.028 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:37:58.028 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:37:58.028 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:37:58.028 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:37:58.029 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:37:58.030 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:37:58.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:58.030 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:37:58.095 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:37:58.184 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:37:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:37:58.185 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:37:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:37:58.191 INFO:teuthology.orchestra.run.smithi105.stdout:client5418 2024-09-12T01:37:58.191 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:37:58.192 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:58.208 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:37:58.208 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:37:58.256 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:37:58.290 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:37:58.290 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:37:58.290 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:37:58.291 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:58.310 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:37:58.310 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:58.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:37:58.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.523+0000 7fa428742640 1 Processor -- start 2024-09-12T01:37:58.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.523+0000 7fa428742640 1 -- start start 2024-09-12T01:37:58.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.524+0000 7fa428742640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa42015e7a0 0x7fa42006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:58.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.524+0000 7fa428742640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4200cf1f0 0x7fa4200b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:58.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.524+0000 7fa428742640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa4200b6720 0x7fa4201623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:58.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.524+0000 7fa428742640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa4200d2ca0 con 0x7fa4200b6720 2024-09-12T01:37:58.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.524+0000 7fa428742640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa4200cf860 con 0x7fa42015e7a0 2024-09-12T01:37:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.524+0000 7fa428742640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4200cfb40 con 0x7fa4200cf1f0 2024-09-12T01:37:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.525+0000 7fa426cdf640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa4200b6720 0x7fa4201623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.525+0000 7fa426cdf640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa4200b6720 0x7fa4201623c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43066/0 (socket says 172.21.15.60:43066) 2024-09-12T01:37:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.525+0000 7fa426cdf640 1 -- 172.21.15.60:0/4056096638 learned_addr learned my addr 172.21.15.60:0/4056096638 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.525+0000 7fa4264de640 1 --2- 172.21.15.60:0/4056096638 >> v2:172.21.15.105:3300/0 conn(0x7fa42015e7a0 0x7fa42006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.525+0000 7fa425cdd640 1 --2- 172.21.15.60:0/4056096638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4200cf1f0 0x7fa4200b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.525+0000 7fa426cdf640 1 -- 172.21.15.60:0/4056096638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4200cf1f0 msgr2=0x7fa4200b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.525+0000 7fa426cdf640 1 --2- 172.21.15.60:0/4056096638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4200cf1f0 0x7fa4200b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.525+0000 7fa426cdf640 1 -- 172.21.15.60:0/4056096638 >> v2:172.21.15.105:3300/0 conn(0x7fa42015e7a0 msgr2=0x7fa42006caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.525+0000 7fa426cdf640 1 --2- 172.21.15.60:0/4056096638 >> v2:172.21.15.105:3300/0 conn(0x7fa42015e7a0 0x7fa42006caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:58.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.525+0000 7fa426cdf640 1 -- 172.21.15.60:0/4056096638 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4200cfe20 con 0x7fa4200b6720 2024-09-12T01:37:58.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.526+0000 7fa426cdf640 1 --2- 172.21.15.60:0/4056096638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4200b6720 0x7fa4201623c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa4200d5820 tx=0x7fa41802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c41a552229c8af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:58.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.526+0000 7fa4254dc640 1 -- 172.21.15.60:0/4056096638 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa418036070 con 0x7fa4200b6720 2024-09-12T01:37:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.526+0000 7fa4254dc640 1 -- 172.21.15.60:0/4056096638 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa418031600 con 0x7fa4200b6720 2024-09-12T01:37:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.526+0000 7fa4254dc640 1 -- 172.21.15.60:0/4056096638 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4180319d0 con 0x7fa4200b6720 2024-09-12T01:37:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.526+0000 7fa428742640 1 -- 172.21.15.60:0/4056096638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4200b6720 msgr2=0x7fa4201623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.526+0000 7fa428742640 1 --2- 172.21.15.60:0/4056096638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4200b6720 0x7fa4201623c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa4200d5820 tx=0x7fa41802a610 comp rx=0 tx=0).stop 2024-09-12T01:37:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.527+0000 7fa428742640 1 -- 172.21.15.60:0/4056096638 shutdown_connections 2024-09-12T01:37:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.527+0000 7fa428742640 1 --2- 172.21.15.60:0/4056096638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4200b6720 0x7fa4201623c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.527+0000 7fa428742640 1 --2- 172.21.15.60:0/4056096638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4200cf1f0 0x7fa4200b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.527+0000 7fa428742640 1 --2- 172.21.15.60:0/4056096638 >> v2:172.21.15.105:3300/0 conn(0x7fa42015e7a0 0x7fa42006caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.527+0000 7fa428742640 1 -- 172.21.15.60:0/4056096638 >> 172.21.15.60:0/4056096638 conn(0x7fa4200d11e0 msgr2=0x7fa4200d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.527+0000 7fa428742640 1 -- 172.21.15.60:0/4056096638 shutdown_connections 2024-09-12T01:37:58.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.527+0000 7fa428742640 1 -- 172.21.15.60:0/4056096638 wait complete. 2024-09-12T01:37:58.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.528+0000 7fa428742640 1 Processor -- start 2024-09-12T01:37:58.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.528+0000 7fa428742640 1 -- start start 2024-09-12T01:37:58.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa428742640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4200b6720 0x7fa4200c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:58.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa428742640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4200cf1f0 0x7fa420152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa428742640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa42015e7a0 0x7fa4201e8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa428742640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa42006cfe0 con 0x7fa4200b6720 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa428742640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4200b7a00 con 0x7fa42015e7a0 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa428742640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa42015eb80 con 0x7fa4200cf1f0 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa4264de640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4200b6720 0x7fa4200c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa4264de640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4200b6720 0x7fa4200c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43076/0 (socket says 172.21.15.60:43076) 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa4264de640 1 -- 172.21.15.60:0/2385511920 learned_addr learned my addr 172.21.15.60:0/2385511920 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa425cdd640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4200cf1f0 0x7fa420152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa426cdf640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa42015e7a0 0x7fa4201e8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa4264de640 1 -- 172.21.15.60:0/2385511920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4200cf1f0 msgr2=0x7fa420152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa4264de640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4200cf1f0 0x7fa420152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa4264de640 1 -- 172.21.15.60:0/2385511920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa42015e7a0 msgr2=0x7fa4201e8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:58.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa4264de640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa42015e7a0 0x7fa4201e8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:58.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa4264de640 1 -- 172.21.15.60:0/2385511920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4201e90f0 con 0x7fa4200b6720 2024-09-12T01:37:58.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa4264de640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4200b6720 0x7fa4200c83d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00e9b0 tx=0x7fa41c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:58.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.529+0000 7fa416ffd640 1 -- 172.21.15.60:0/2385511920 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c017070 con 0x7fa4200b6720 2024-09-12T01:37:58.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.530+0000 7fa416ffd640 1 -- 172.21.15.60:0/2385511920 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa41c00c9a0 con 0x7fa4200b6720 2024-09-12T01:37:58.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.530+0000 7fa428742640 1 -- 172.21.15.60:0/2385511920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4200c89b0 con 0x7fa4200b6720 2024-09-12T01:37:58.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.530+0000 7fa416ffd640 1 -- 172.21.15.60:0/2385511920 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c00cd90 con 0x7fa4200b6720 2024-09-12T01:37:58.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.530+0000 7fa428742640 1 -- 172.21.15.60:0/2385511920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4200c8f70 con 0x7fa4200b6720 2024-09-12T01:37:58.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.530+0000 7fa428742640 1 -- 172.21.15.60:0/2385511920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4200b61e0 con 0x7fa4200b6720 2024-09-12T01:37:58.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.531+0000 7fa416ffd640 1 -- 172.21.15.60:0/2385511920 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa41c01a070 con 0x7fa4200b6720 2024-09-12T01:37:58.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.532+0000 7fa416ffd640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa40406be30 0x7fa40406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:58.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.532+0000 7fa416ffd640 1 -- 172.21.15.60:0/2385511920 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fa41c08b120 con 0x7fa4200b6720 2024-09-12T01:37:58.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.532+0000 7fa425cdd640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa40406be30 0x7fa40406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:58.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.532+0000 7fa425cdd640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa40406be30 0x7fa40406e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa4200cb3f0 tx=0x7fa410009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:58.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.536+0000 7fa416ffd640 1 -- 172.21.15.60:0/2385511920 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa41c059510 con 0x7fa4200b6720 2024-09-12T01:37:58.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.726+0000 7fa428742640 1 -- 172.21.15.60:0/2385511920 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa4200cefb0 con 0x7fa4200b6720 2024-09-12T01:37:58.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.726+0000 7fa416ffd640 1 -- 172.21.15.60:0/2385511920 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) ==== 80+0+0 (secure 0 0 0) 0x7fa41c05d810 con 0x7fa4200b6720 2024-09-12T01:37:58.726 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:37:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.728+0000 7fa428742640 1 -- 172.21.15.60:0/2385511920 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa40406be30 msgr2=0x7fa40406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.728+0000 7fa428742640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa40406be30 0x7fa40406e2f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa4200cb3f0 tx=0x7fa410009190 comp rx=0 tx=0).stop 2024-09-12T01:37:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.728+0000 7fa428742640 1 -- 172.21.15.60:0/2385511920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4200b6720 msgr2=0x7fa4200c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.728+0000 7fa428742640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4200b6720 0x7fa4200c83d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00e9b0 tx=0x7fa41c00ee70 comp rx=0 tx=0).stop 2024-09-12T01:37:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.728+0000 7fa428742640 1 -- 172.21.15.60:0/2385511920 shutdown_connections 2024-09-12T01:37:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.728+0000 7fa428742640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa42015e7a0 0x7fa4201e8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.728+0000 7fa428742640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa40406be30 0x7fa40406e2f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.728+0000 7fa428742640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4200cf1f0 0x7fa420152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.728+0000 7fa428742640 1 --2- 172.21.15.60:0/2385511920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4200b6720 0x7fa4200c83d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.728+0000 7fa428742640 1 -- 172.21.15.60:0/2385511920 >> 172.21.15.60:0/2385511920 conn(0x7fa4200d11e0 msgr2=0x7fa4200d15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.728+0000 7fa428742640 1 -- 172.21.15.60:0/2385511920 shutdown_connections 2024-09-12T01:37:58.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:58.728+0000 7fa428742640 1 -- 172.21.15.60:0/2385511920 wait complete. 2024-09-12T01:37:58.739 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:37:58.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:58.739 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:37:58.768 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:37:58.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:58.768 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:37:58.824 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:37:58.824 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:37:58.824 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:58.841 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:37:58.841 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:58.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:37:59.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.003+0000 7fd7be01e640 1 Processor -- start 2024-09-12T01:37:59.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.003+0000 7fd7be01e640 1 -- start start 2024-09-12T01:37:59.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7be01e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd7b815e790 0x7fd7b8162ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7be01e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80d1bf0 0x7fd7b806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7be01e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7b80b57d0 con 0x7fd7b80b6e20 2024-09-12T01:37:59.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7be01e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd7b815eb70 con 0x7fd7b815e790 2024-09-12T01:37:59.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7be01e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b8073390 con 0x7fd7b80d1bf0 2024-09-12T01:37:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7b77fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd7b815e790 0x7fd7b8162ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7b77fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd7b815e790 0x7fd7b8162ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:41512/0 (socket says 172.21.15.60:41512) 2024-09-12T01:37:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7b77fe640 1 -- 172.21.15.60:0/3476123755 learned_addr learned my addr 172.21.15.60:0/3476123755 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7b6ffd640 1 --2- 172.21.15.60:0/3476123755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80d1bf0 0x7fd7b806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7b77fe640 1 -- 172.21.15.60:0/3476123755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80d1bf0 msgr2=0x7fd7b806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7b77fe640 1 --2- 172.21.15.60:0/3476123755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80d1bf0 0x7fd7b806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7b77fe640 1 -- 172.21.15.60:0/3476123755 >> v1:172.21.15.105:6789/0 conn(0x7fd7b80b6e20 legacy=0x7fd7b8073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7b77fe640 1 -- 172.21.15.60:0/3476123755 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b806e8c0 con 0x7fd7b815e790 2024-09-12T01:37:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.004+0000 7fd7b6ffd640 1 --2- 172.21.15.60:0/3476123755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80d1bf0 0x7fd7b806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:37:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.005+0000 7fd7b77fe640 1 --2- 172.21.15.60:0/3476123755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b815e790 0x7fd7b8162ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009870 tx=0x7fd7a802a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2381b041a0e9556 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.005+0000 7fd7b67fc640 1 -- 172.21.15.60:0/3476123755 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8037070 con 0x7fd7b815e790 2024-09-12T01:37:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.005+0000 7fd7b67fc640 1 -- 172.21.15.60:0/3476123755 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a802ae50 con 0x7fd7b815e790 2024-09-12T01:37:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.005+0000 7fd7b67fc640 1 -- 172.21.15.60:0/3476123755 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8032860 con 0x7fd7b815e790 2024-09-12T01:37:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.006+0000 7fd7be01e640 1 -- 172.21.15.60:0/3476123755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b815e790 msgr2=0x7fd7b8162ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.006+0000 7fd7be01e640 1 --2- 172.21.15.60:0/3476123755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b815e790 0x7fd7b8162ca0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009870 tx=0x7fd7a802a300 comp rx=0 tx=0).stop 2024-09-12T01:37:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.006+0000 7fd7be01e640 1 -- 172.21.15.60:0/3476123755 shutdown_connections 2024-09-12T01:37:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.006+0000 7fd7be01e640 1 --2- 172.21.15.60:0/3476123755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80d1bf0 0x7fd7b806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.006+0000 7fd7be01e640 1 --2- 172.21.15.60:0/3476123755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b815e790 0x7fd7b8162ca0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.006+0000 7fd7be01e640 1 -- 172.21.15.60:0/3476123755 >> 172.21.15.60:0/3476123755 conn(0x7fd7b80d24d0 msgr2=0x7fd7b80d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.006+0000 7fd7be01e640 1 -- 172.21.15.60:0/3476123755 shutdown_connections 2024-09-12T01:37:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.006+0000 7fd7be01e640 1 -- 172.21.15.60:0/3476123755 wait complete. 2024-09-12T01:37:59.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.007+0000 7fd7be01e640 1 Processor -- start 2024-09-12T01:37:59.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.007+0000 7fd7be01e640 1 -- start start 2024-09-12T01:37:59.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7be01e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80b6e20 0x7fd7b8152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7be01e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7b80d1bf0 0x7fd7b8161940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7be01e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b815e790 0x7fd7b815fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7be01e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b806d3e0 con 0x7fd7b80d1bf0 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7be01e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b806d260 con 0x7fd7b815e790 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7be01e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd7b8073f30 con 0x7fd7b80b6e20 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7b6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7b80d1bf0 0x7fd7b8161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7b77fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80b6e20 0x7fd7b8152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7b77fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80b6e20 0x7fd7b8152f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:43754/0 (socket says 172.21.15.60:43754) 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7b77fe640 1 -- 172.21.15.60:0/1852543075 learned_addr learned my addr 172.21.15.60:0/1852543075 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7b7fff640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b815e790 0x7fd7b815fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7b77fe640 1 -- 172.21.15.60:0/1852543075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b815e790 msgr2=0x7fd7b815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.008+0000 7fd7b77fe640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b815e790 0x7fd7b815fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.009+0000 7fd7b77fe640 1 -- 172.21.15.60:0/1852543075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7b80d1bf0 msgr2=0x7fd7b8161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.009+0000 7fd7b77fe640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7b80d1bf0 0x7fd7b8161940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.009+0000 7fd7b77fe640 1 -- 172.21.15.60:0/1852543075 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b815ecf0 con 0x7fd7b80b6e20 2024-09-12T01:37:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.009+0000 7fd7b77fe640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80b6e20 0x7fd7b8152f70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009870 tx=0x7fd7a80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.009+0000 7fd79ffff640 1 -- 172.21.15.60:0/1852543075 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8042070 con 0x7fd7b80b6e20 2024-09-12T01:37:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.009+0000 7fd79ffff640 1 -- 172.21.15.60:0/1852543075 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7a803e660 con 0x7fd7b80b6e20 2024-09-12T01:37:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.009+0000 7fd7be01e640 1 -- 172.21.15.60:0/1852543075 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b815efd0 con 0x7fd7b80b6e20 2024-09-12T01:37:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.009+0000 7fd79ffff640 1 -- 172.21.15.60:0/1852543075 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8037040 con 0x7fd7b80b6e20 2024-09-12T01:37:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.009+0000 7fd7be01e640 1 -- 172.21.15.60:0/1852543075 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b815f590 con 0x7fd7b80b6e20 2024-09-12T01:37:59.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.010+0000 7fd7be01e640 1 -- 172.21.15.60:0/1852543075 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b806cd20 con 0x7fd7b80b6e20 2024-09-12T01:37:59.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.010+0000 7fd79ffff640 1 -- 172.21.15.60:0/1852543075 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd7a8045070 con 0x7fd7b80b6e20 2024-09-12T01:37:59.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.011+0000 7fd79ffff640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd7a406be60 0x7fd7a406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.011+0000 7fd79ffff640 1 -- 172.21.15.60:0/1852543075 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fd7a80ab650 con 0x7fd7b80b6e20 2024-09-12T01:37:59.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.011+0000 7fd7b6ffd640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd7a406be60 0x7fd7a406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.011+0000 7fd7b6ffd640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd7a406be60 0x7fd7a406e320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009560 tx=0x7fd7ac009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:59.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.016+0000 7fd79ffff640 1 -- 172.21.15.60:0/1852543075 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd7b806cd20 con 0x7fd7b80b6e20 2024-09-12T01:37:59.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.201+0000 7fd7be01e640 1 -- 172.21.15.60:0/1852543075 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd7b8074230 con 0x7fd7b80b6e20 2024-09-12T01:37:59.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.202+0000 7fd79ffff640 1 -- 172.21.15.60:0/1852543075 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) ==== 80+0+0 (secure 0 0 0) 0x7fd7a8079910 con 0x7fd7b80b6e20 2024-09-12T01:37:59.202 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:37:59.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.204+0000 7fd7be01e640 1 -- 172.21.15.60:0/1852543075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd7a406be60 msgr2=0x7fd7a406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.204+0000 7fd7be01e640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd7a406be60 0x7fd7a406e320 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009560 tx=0x7fd7ac009190 comp rx=0 tx=0).stop 2024-09-12T01:37:59.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.205+0000 7fd7be01e640 1 -- 172.21.15.60:0/1852543075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80b6e20 msgr2=0x7fd7b8152f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.205+0000 7fd7be01e640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80b6e20 0x7fd7b8152f70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8009870 tx=0x7fd7a80046c0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.205+0000 7fd7be01e640 1 -- 172.21.15.60:0/1852543075 shutdown_connections 2024-09-12T01:37:59.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.205+0000 7fd7be01e640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd7b815e790 0x7fd7b815fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.205+0000 7fd7be01e640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7b80d1bf0 0x7fd7b8161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.205+0000 7fd7be01e640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd7a406be60 0x7fd7a406e320 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.205+0000 7fd7be01e640 1 --2- 172.21.15.60:0/1852543075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd7b80b6e20 0x7fd7b8152f70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.205+0000 7fd7be01e640 1 -- 172.21.15.60:0/1852543075 >> 172.21.15.60:0/1852543075 conn(0x7fd7b80d24d0 msgr2=0x7fd7b80b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:59.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.205+0000 7fd7be01e640 1 -- 172.21.15.60:0/1852543075 shutdown_connections 2024-09-12T01:37:59.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.205+0000 7fd7be01e640 1 -- 172.21.15.60:0/1852543075 wait complete. 2024-09-12T01:37:59.215 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:37:59.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:59.215 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T01:37:59.245 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:37:59.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:37:59.245 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:37:59.302 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:37:59.302 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:37:59.302 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:59.320 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:37:59.320 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:37:59.320 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:37:59.320 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:37:59.359 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:37:59.359 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:37:59.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.462+0000 7f725eb28640 1 Processor -- start 2024-09-12T01:37:59.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.462+0000 7f725eb28640 1 -- start start 2024-09-12T01:37:59.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.463+0000 7f725eb28640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7258155800 0x7f72580b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.463+0000 7f725eb28640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72580cfc80 0x7f72580b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.463+0000 7f725eb28640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72580b50a0 con 0x7f725815c330 2024-09-12T01:37:59.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.463+0000 7f725eb28640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f72580b4e60 con 0x7f7258155800 2024-09-12T01:37:59.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.463+0000 7f725eb28640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f725815c7a0 con 0x7f72580cfc80 2024-09-12T01:37:59.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.463+0000 7f725c8c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7258155800 0x7f72580b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.463+0000 7f725c8c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7258155800 0x7f72580b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43100/0 (socket says 172.21.15.60:43100) 2024-09-12T01:37:59.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.463+0000 7f725c8c4640 1 -- 172.21.15.60:0/1712150380 learned_addr learned my addr 172.21.15.60:0/1712150380 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:59.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.464+0000 7f725d0c5640 1 --2- 172.21.15.60:0/1712150380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72580cfc80 0x7f72580b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.464+0000 7f725c8c4640 1 -- 172.21.15.60:0/1712150380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72580cfc80 msgr2=0x7f72580b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:59.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.464+0000 7f725c8c4640 1 --2- 172.21.15.60:0/1712150380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72580cfc80 0x7f72580b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.464+0000 7f725c8c4640 1 -- 172.21.15.60:0/1712150380 >> v1:172.21.15.105:6789/0 conn(0x7f725815c330 legacy=0x7f72580cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.464+0000 7f725c8c4640 1 -- 172.21.15.60:0/1712150380 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72580b5380 con 0x7f7258155800 2024-09-12T01:37:59.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.464+0000 7f725c8c4640 1 --2- 172.21.15.60:0/1712150380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258155800 0x7f72580b6140 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7250009e50 tx=0x7f725002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2657fe8e1cda679 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:59.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.465+0000 7f72577fe640 1 -- 172.21.15.60:0/1712150380 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7250036070 con 0x7f7258155800 2024-09-12T01:37:59.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.465+0000 7f72577fe640 1 -- 172.21.15.60:0/1712150380 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7250031600 con 0x7f7258155800 2024-09-12T01:37:59.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.465+0000 7f72577fe640 1 -- 172.21.15.60:0/1712150380 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72500319d0 con 0x7f7258155800 2024-09-12T01:37:59.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.465+0000 7f725eb28640 1 -- 172.21.15.60:0/1712150380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258155800 msgr2=0x7f72580b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.465+0000 7f725eb28640 1 --2- 172.21.15.60:0/1712150380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258155800 0x7f72580b6140 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7250009e50 tx=0x7f725002a710 comp rx=0 tx=0).stop 2024-09-12T01:37:59.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.465+0000 7f725eb28640 1 -- 172.21.15.60:0/1712150380 shutdown_connections 2024-09-12T01:37:59.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.465+0000 7f725eb28640 1 --2- 172.21.15.60:0/1712150380 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72580cfc80 0x7f72580b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.465+0000 7f725eb28640 1 --2- 172.21.15.60:0/1712150380 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258155800 0x7f72580b6140 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.465+0000 7f725eb28640 1 -- 172.21.15.60:0/1712150380 >> 172.21.15.60:0/1712150380 conn(0x7f725806bc10 msgr2=0x7f725806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:59.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.465+0000 7f725eb28640 1 -- 172.21.15.60:0/1712150380 shutdown_connections 2024-09-12T01:37:59.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.465+0000 7f725eb28640 1 -- 172.21.15.60:0/1712150380 wait complete. 2024-09-12T01:37:59.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.466+0000 7f725eb28640 1 Processor -- start 2024-09-12T01:37:59.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.466+0000 7f725eb28640 1 -- start start 2024-09-12T01:37:59.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.467+0000 7f725eb28640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72580cfc80 0x7f7258157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.467+0000 7f725eb28640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258155800 0x7f725814f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.467+0000 7f725eb28640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f725815c330 0x7f72581e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.467+0000 7f725eb28640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f72580b5c20 con 0x7f7258155800 2024-09-12T01:37:59.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.467+0000 7f725eb28640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f72580b5940 con 0x7f725815c330 2024-09-12T01:37:59.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.467+0000 7f725eb28640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7258155be0 con 0x7f72580cfc80 2024-09-12T01:37:59.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.467+0000 7f7257fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258155800 0x7f725814f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.467+0000 7f7257fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258155800 0x7f725814f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43106/0 (socket says 172.21.15.60:43106) 2024-09-12T01:37:59.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.467+0000 7f7257fff640 1 -- 172.21.15.60:0/2656461593 learned_addr learned my addr 172.21.15.60:0/2656461593 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:59.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.467+0000 7f725c8c4640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72580cfc80 0x7f7258157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.467+0000 7f725d0c5640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f725815c330 0x7f72581e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.468+0000 7f7257fff640 1 -- 172.21.15.60:0/2656461593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72580cfc80 msgr2=0x7f7258157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.468+0000 7f7257fff640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72580cfc80 0x7f7258157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.468+0000 7f7257fff640 1 -- 172.21.15.60:0/2656461593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f725815c330 msgr2=0x7f72581e6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.468+0000 7f7257fff640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f725815c330 0x7f72581e6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.468+0000 7f7257fff640 1 -- 172.21.15.60:0/2656461593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725814fa30 con 0x7f7258155800 2024-09-12T01:37:59.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.468+0000 7f7257fff640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258155800 0x7f725814f4f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f724800c3c0 tx=0x7f724800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:59.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.468+0000 7f72557fa640 1 -- 172.21.15.60:0/2656461593 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72480052d0 con 0x7f7258155800 2024-09-12T01:37:59.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.468+0000 7f72557fa640 1 -- 172.21.15.60:0/2656461593 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7248005490 con 0x7f7258155800 2024-09-12T01:37:59.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.468+0000 7f725eb28640 1 -- 172.21.15.60:0/2656461593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725814ff40 con 0x7f7258155800 2024-09-12T01:37:59.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.468+0000 7f72557fa640 1 -- 172.21.15.60:0/2656461593 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7248007260 con 0x7f7258155800 2024-09-12T01:37:59.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.468+0000 7f725eb28640 1 -- 172.21.15.60:0/2656461593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72581e5c90 con 0x7f7258155800 2024-09-12T01:37:59.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.469+0000 7f725eb28640 1 -- 172.21.15.60:0/2656461593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72580b4920 con 0x7f7258155800 2024-09-12T01:37:59.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.470+0000 7f72557fa640 1 -- 172.21.15.60:0/2656461593 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7248007400 con 0x7f7258155800 2024-09-12T01:37:59.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.470+0000 7f72557fa640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f723806be60 0x7f723806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.470+0000 7f72557fa640 1 -- 172.21.15.60:0/2656461593 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f724808a230 con 0x7f7258155800 2024-09-12T01:37:59.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.470+0000 7f725c8c4640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f723806be60 0x7f723806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.471+0000 7f725c8c4640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f723806be60 0x7f723806e320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7250033000 tx=0x7f7250009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:59.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.474+0000 7f72557fa640 1 -- 172.21.15.60:0/2656461593 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7248058590 con 0x7f7258155800 2024-09-12T01:37:59.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.687+0000 7f725eb28640 1 -- 172.21.15.60:0/2656461593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72580633d0 con 0x7f7258155800 2024-09-12T01:37:59.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.687+0000 7f72557fa640 1 -- 172.21.15.60:0/2656461593 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5235 (secure 0 0 0) 0x7f724805c890 con 0x7f7258155800 2024-09-12T01:37:59.687 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:37:59.687 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"btime":"2024-09-12T01:37:48:964735+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2903062918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2903062918},{"type":"v1","addr":"172.21.15.105:6835","nonce":2903062918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1613307735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1613307735},{"type":"v1","addr":"172.21.15.60:6836","nonce":1613307735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/4169562393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":4169562393},{"type":"v1","addr":"172.21.15.60:6837","nonce":4169562393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:37:45.314718+0000","modified":"2024-09-12T01:37:48.116046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34778":{"gid":34778,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/2704792080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2704792080},{"type":"v1","addr":"172.21.15.105:6834","nonce":2704792080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34778,"qdb_cluster":[34778]},"id":3}]} 2024-09-12T01:37:59.687 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 21 2024-09-12T01:37:59.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.690+0000 7f725eb28640 1 -- 172.21.15.60:0/2656461593 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f723806be60 msgr2=0x7f723806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.690+0000 7f725eb28640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f723806be60 0x7f723806e320 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7250033000 tx=0x7f7250009000 comp rx=0 tx=0).stop 2024-09-12T01:37:59.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.690+0000 7f725eb28640 1 -- 172.21.15.60:0/2656461593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258155800 msgr2=0x7f725814f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.690+0000 7f725eb28640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258155800 0x7f725814f4f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f724800c3c0 tx=0x7f724800c880 comp rx=0 tx=0).stop 2024-09-12T01:37:59.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.690+0000 7f725eb28640 1 -- 172.21.15.60:0/2656461593 shutdown_connections 2024-09-12T01:37:59.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.690+0000 7f725eb28640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f725815c330 0x7f72581e6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.690+0000 7f725eb28640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7258155800 0x7f725814f4f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.690+0000 7f725eb28640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f723806be60 0x7f723806e320 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.690+0000 7f725eb28640 1 --2- 172.21.15.60:0/2656461593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f72580cfc80 0x7f7258157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.690+0000 7f725eb28640 1 -- 172.21.15.60:0/2656461593 >> 172.21.15.60:0/2656461593 conn(0x7f725806bc10 msgr2=0x7f72580ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:59.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.690+0000 7f725eb28640 1 -- 172.21.15.60:0/2656461593 shutdown_connections 2024-09-12T01:37:59.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.690+0000 7f725eb28640 1 -- 172.21.15.60:0/2656461593 wait complete. 2024-09-12T01:37:59.700 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:37:59.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.803+0000 7f6f60168640 1 Processor -- start 2024-09-12T01:37:59.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.803+0000 7f6f60168640 1 -- start start 2024-09-12T01:37:59.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f60168640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6f5815c2b0 0x7f6f580b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f60168640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f5815f200 0x7f6f5806d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f60168640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f5815fb10 con 0x7f6f580b72f0 2024-09-12T01:37:59.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f60168640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6f580b5900 con 0x7f6f5815f200 2024-09-12T01:37:59.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f60168640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6f5815f830 con 0x7f6f5815c2b0 2024-09-12T01:37:59.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f5e705640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f5815f200 0x7f6f5806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f5e705640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f5815f200 0x7f6f5806d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43116/0 (socket says 172.21.15.60:43116) 2024-09-12T01:37:59.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f5e705640 1 -- 172.21.15.60:0/627380236 learned_addr learned my addr 172.21.15.60:0/627380236 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:59.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f5df04640 1 --2- 172.21.15.60:0/627380236 >> v2:172.21.15.105:3300/0 conn(0x7f6f5815c2b0 0x7f6f580b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f5e705640 1 -- 172.21.15.60:0/627380236 >> v2:172.21.15.105:3300/0 conn(0x7f6f5815c2b0 msgr2=0x7f6f580b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:59.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f5e705640 1 --2- 172.21.15.60:0/627380236 >> v2:172.21.15.105:3300/0 conn(0x7f6f5815c2b0 0x7f6f580b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f5e705640 1 -- 172.21.15.60:0/627380236 >> v1:172.21.15.105:6789/0 conn(0x7f6f580b72f0 legacy=0x7f6f5815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:37:59.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f5e705640 1 -- 172.21.15.60:0/627380236 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5806ce30 con 0x7f6f5815f200 2024-09-12T01:37:59.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.804+0000 7f6f5df04640 1 --2- 172.21.15.60:0/627380236 >> v2:172.21.15.105:3300/0 conn(0x7f6f5815c2b0 0x7f6f580b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:37:59.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.805+0000 7f6f5e705640 1 --2- 172.21.15.60:0/627380236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f5815f200 0x7f6f5806d910 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6f5806f040 tx=0x7f6f5002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4db1d3fa75a576 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:59.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.805+0000 7f6f5cf02640 1 -- 172.21.15.60:0/627380236 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50037070 con 0x7f6f5815f200 2024-09-12T01:37:59.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.805+0000 7f6f5cf02640 1 -- 172.21.15.60:0/627380236 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f50032440 con 0x7f6f5815f200 2024-09-12T01:37:59.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.805+0000 7f6f5cf02640 1 -- 172.21.15.60:0/627380236 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50032810 con 0x7f6f5815f200 2024-09-12T01:37:59.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.806+0000 7f6f60168640 1 -- 172.21.15.60:0/627380236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f5815f200 msgr2=0x7f6f5806d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.806+0000 7f6f60168640 1 --2- 172.21.15.60:0/627380236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f5815f200 0x7f6f5806d910 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6f5806f040 tx=0x7f6f5002a230 comp rx=0 tx=0).stop 2024-09-12T01:37:59.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.806+0000 7f6f60168640 1 -- 172.21.15.60:0/627380236 shutdown_connections 2024-09-12T01:37:59.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.806+0000 7f6f60168640 1 --2- 172.21.15.60:0/627380236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f5815f200 0x7f6f5806d910 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.806+0000 7f6f60168640 1 --2- 172.21.15.60:0/627380236 >> v2:172.21.15.105:3300/0 conn(0x7f6f5815c2b0 0x7f6f580b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.806+0000 7f6f60168640 1 -- 172.21.15.60:0/627380236 >> 172.21.15.60:0/627380236 conn(0x7f6f580b4240 msgr2=0x7f6f580b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:37:59.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.806+0000 7f6f60168640 1 -- 172.21.15.60:0/627380236 shutdown_connections 2024-09-12T01:37:59.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.806+0000 7f6f60168640 1 -- 172.21.15.60:0/627380236 wait complete. 2024-09-12T01:37:59.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.807+0000 7f6f60168640 1 Processor -- start 2024-09-12T01:37:59.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.807+0000 7f6f60168640 1 -- start start 2024-09-12T01:37:59.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f60168640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f580b72f0 0x7f6f580b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f60168640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f5815c2b0 0x7f6f580b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f60168640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f5815f200 0x7f6f581f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f60168640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6f580b7760 con 0x7f6f5815c2b0 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f60168640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5806d3f0 con 0x7f6f5815f200 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f60168640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5806de50 con 0x7f6f580b72f0 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f5d703640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f5815c2b0 0x7f6f580b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f5d703640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f5815c2b0 0x7f6f580b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43128/0 (socket says 172.21.15.60:43128) 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f5d703640 1 -- 172.21.15.60:0/1826145663 learned_addr learned my addr 172.21.15.60:0/1826145663 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f5df04640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f580b72f0 0x7f6f580b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f5e705640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f5815f200 0x7f6f581f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f5d703640 1 -- 172.21.15.60:0/1826145663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f580b72f0 msgr2=0x7f6f580b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f5d703640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f580b72f0 0x7f6f580b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f5d703640 1 -- 172.21.15.60:0/1826145663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f5815f200 msgr2=0x7f6f581f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:37:59.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f5d703640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f5815f200 0x7f6f581f4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:37:59.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f5d703640 1 -- 172.21.15.60:0/1826145663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f581f4f00 con 0x7f6f5815c2b0 2024-09-12T01:37:59.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f5e705640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f5815f200 0x7f6f581f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:37:59.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.808+0000 7f6f5d703640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f5815c2b0 0x7f6f580b35a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c430 tx=0x7f6f4c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:59.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.809+0000 7f6f567fc640 1 -- 172.21.15.60:0/1826145663 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c011790 con 0x7f6f5815c2b0 2024-09-12T01:37:59.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.809+0000 7f6f567fc640 1 -- 172.21.15.60:0/1826145663 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c017070 con 0x7f6f5815c2b0 2024-09-12T01:37:59.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.809+0000 7f6f60168640 1 -- 172.21.15.60:0/1826145663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f581f79a0 con 0x7f6f5815c2b0 2024-09-12T01:37:59.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.809+0000 7f6f567fc640 1 -- 172.21.15.60:0/1826145663 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c011bb0 con 0x7f6f5815c2b0 2024-09-12T01:37:59.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.809+0000 7f6f60168640 1 -- 172.21.15.60:0/1826145663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f581f7f60 con 0x7f6f5815c2b0 2024-09-12T01:37:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.810+0000 7f6f60168640 1 -- 172.21.15.60:0/1826145663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f581f8160 con 0x7f6f5815c2b0 2024-09-12T01:37:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.810+0000 7f6f567fc640 1 -- 172.21.15.60:0/1826145663 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f4c01c460 con 0x7f6f5815c2b0 2024-09-12T01:37:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.811+0000 7f6f567fc640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f4406be30 0x7f6f4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:37:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.811+0000 7f6f567fc640 1 -- 172.21.15.60:0/1826145663 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f6f4c08ad20 con 0x7f6f5815c2b0 2024-09-12T01:37:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.811+0000 7f6f5df04640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f4406be30 0x7f6f4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:37:59.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.811+0000 7f6f5df04640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f4406be30 0x7f6f4406e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800d620 tx=0x7f6f48007810 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:37:59.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:37:59.815+0000 7f6f567fc640 1 -- 172.21.15.60:0/1826145663 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f581f8160 con 0x7f6f5815c2b0 2024-09-12T01:38:00.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.028+0000 7f6f60168640 1 -- 172.21.15.60:0/1826145663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f580b6db0 con 0x7f6f5815c2b0 2024-09-12T01:38:00.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.029+0000 7f6f567fc640 1 -- 172.21.15.60:0/1826145663 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5235 (secure 0 0 0) 0x7f6f4c059630 con 0x7f6f5815c2b0 2024-09-12T01:38:00.028 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:00.029 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"btime":"2024-09-12T01:37:48:964735+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2903062918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2903062918},{"type":"v1","addr":"172.21.15.105:6835","nonce":2903062918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1613307735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1613307735},{"type":"v1","addr":"172.21.15.60:6836","nonce":1613307735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/4169562393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":4169562393},{"type":"v1","addr":"172.21.15.60:6837","nonce":4169562393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:37:45.314718+0000","modified":"2024-09-12T01:37:48.116046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34778":{"gid":34778,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/2704792080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2704792080},{"type":"v1","addr":"172.21.15.105:6834","nonce":2704792080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34778,"qdb_cluster":[34778]},"id":3}]} 2024-09-12T01:38:00.029 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 21 2024-09-12T01:38:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.031+0000 7f6f60168640 1 -- 172.21.15.60:0/1826145663 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f4406be30 msgr2=0x7f6f4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.031+0000 7f6f60168640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f4406be30 0x7f6f4406e2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800d620 tx=0x7f6f48007810 comp rx=0 tx=0).stop 2024-09-12T01:38:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.031+0000 7f6f60168640 1 -- 172.21.15.60:0/1826145663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f5815c2b0 msgr2=0x7f6f580b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.031+0000 7f6f60168640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f5815c2b0 0x7f6f580b35a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c00c430 tx=0x7f6f4c00c8f0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.031+0000 7f6f60168640 1 -- 172.21.15.60:0/1826145663 shutdown_connections 2024-09-12T01:38:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.031+0000 7f6f60168640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f5815f200 0x7f6f581f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.031+0000 7f6f60168640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f5815c2b0 0x7f6f580b35a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.031+0000 7f6f60168640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f4406be30 0x7f6f4406e2f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.031+0000 7f6f60168640 1 --2- 172.21.15.60:0/1826145663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f580b72f0 0x7f6f580b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.031+0000 7f6f60168640 1 -- 172.21.15.60:0/1826145663 >> 172.21.15.60:0/1826145663 conn(0x7f6f580b4240 msgr2=0x7f6f58071050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:00.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.031+0000 7f6f60168640 1 -- 172.21.15.60:0/1826145663 shutdown_connections 2024-09-12T01:38:00.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.031+0000 7f6f60168640 1 -- 172.21.15.60:0/1826145663 wait complete. 2024-09-12T01:38:00.041 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.144+0000 7fc3e46dd640 1 Processor -- start 2024-09-12T01:38:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.144+0000 7fc3e46dd640 1 -- start start 2024-09-12T01:38:00.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.145+0000 7fc3e46dd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc3dc15c170 0x7fc3dc15c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.145+0000 7fc3e46dd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3dc0b4cf0 con 0x7fc3dc0b64e0 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.145+0000 7fc3e46dd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3dc0b4fd0 con 0x7fc3dc0cf6c0 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.145+0000 7fc3e46dd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc3dc15ca90 con 0x7fc3dc15c170 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.145+0000 7fc3e2c7a640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc3dc0b64e0 0x7fc3dc0b39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44218/0 (socket says 172.21.15.60:44218) 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.145+0000 7fc3e2c7a640 1 -- 172.21.15.60:0/974735614 learned_addr learned my addr 172.21.15.60:0/974735614 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.145+0000 7fc3e2479640 1 --2- 172.21.15.60:0/974735614 >> v2:172.21.15.105:3300/0 conn(0x7fc3dc15c170 0x7fc3dc15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.145+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2809624620 0 0) 0x7fc3dc0b4cf0 con 0x7fc3dc0b64e0 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.145+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3c8003520 con 0x7fc3dc0b64e0 2024-09-12T01:38:00.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2306260874 0 0) 0x7fc3c8003520 con 0x7fc3dc0b64e0 2024-09-12T01:38:00.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 >> v2:172.21.15.105:3300/0 conn(0x7fc3dc15c170 msgr2=0x7fc3dc15c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:00.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 --2- 172.21.15.60:0/974735614 >> v2:172.21.15.105:3300/0 conn(0x7fc3dc15c170 0x7fc3dc15c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 >> v1:172.21.15.105:6789/0 conn(0x7fc3dc0cf6c0 legacy=0x7fc3dc0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3dc0b52b0 con 0x7fc3dc0b64e0 2024-09-12T01:38:00.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fc3d40019f0 con 0x7fc3dc0b64e0 2024-09-12T01:38:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e2479640 1 --2- 172.21.15.60:0/974735614 >> v2:172.21.15.105:3300/0 conn(0x7fc3dc15c170 0x7fc3dc15c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 >> v1:172.21.15.60:6789/0 conn(0x7fc3dc0b64e0 legacy=0x7fc3dc0b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 --2- 172.21.15.60:0/974735614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c80039b0 0x7fc3c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 --2- 172.21.15.60:0/974735614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c8004800 0x7fc3c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 --2- 172.21.15.60:0/974735614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3c80051c0 0x7fc3c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc15ca90 con 0x7fc3c8004800 2024-09-12T01:38:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc3c800c160 con 0x7fc3c80039b0 2024-09-12T01:38:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc3c800c360 con 0x7fc3c80051c0 2024-09-12T01:38:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1c78640 1 --2- 172.21.15.60:0/974735614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c8004800 0x7fc3c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e2479640 1 --2- 172.21.15.60:0/974735614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c80039b0 0x7fc3c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e2c7a640 1 --2- 172.21.15.60:0/974735614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3c80051c0 0x7fc3c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1c78640 1 -- 172.21.15.60:0/974735614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3c80051c0 msgr2=0x7fc3c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1c78640 1 --2- 172.21.15.60:0/974735614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3c80051c0 0x7fc3c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1c78640 1 -- 172.21.15.60:0/974735614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c80039b0 msgr2=0x7fc3c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1c78640 1 --2- 172.21.15.60:0/974735614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c80039b0 0x7fc3c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e2c7a640 1 -- 172.21.15.60:0/974735614 reap_dead start 2024-09-12T01:38:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.146+0000 7fc3e1c78640 1 -- 172.21.15.60:0/974735614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3c8003520 con 0x7fc3c8004800 2024-09-12T01:38:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.147+0000 7fc3e1c78640 1 --2- 172.21.15.60:0/974735614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c8004800 0x7fc3c8004c80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8001750 tx=0x7fc3c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9c3405f3c9f0fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.147+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8001370 con 0x7fc3c8004800 2024-09-12T01:38:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.147+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d80052d0 con 0x7fc3c8004800 2024-09-12T01:38:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.147+0000 7fc3e1477640 1 -- 172.21.15.60:0/974735614 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d802abc0 con 0x7fc3c8004800 2024-09-12T01:38:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.147+0000 7fc3e46dd640 1 -- 172.21.15.60:0/974735614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c8004800 msgr2=0x7fc3c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.147+0000 7fc3e46dd640 1 --2- 172.21.15.60:0/974735614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c8004800 0x7fc3c8004c80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8001750 tx=0x7fc3c8005830 comp rx=0 tx=0).stop 2024-09-12T01:38:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.148+0000 7fc3e46dd640 1 -- 172.21.15.60:0/974735614 shutdown_connections 2024-09-12T01:38:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.148+0000 7fc3e46dd640 1 --2- 172.21.15.60:0/974735614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3c8004800 0x7fc3c8004c80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.148+0000 7fc3e46dd640 1 -- 172.21.15.60:0/974735614 >> 172.21.15.60:0/974735614 conn(0x7fc3dc06bc10 msgr2=0x7fc3dc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.148+0000 7fc3e46dd640 1 -- 172.21.15.60:0/974735614 shutdown_connections 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.148+0000 7fc3e46dd640 1 -- 172.21.15.60:0/974735614 wait complete. 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.149+0000 7fc3e46dd640 1 Processor -- start 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.149+0000 7fc3e46dd640 1 -- start start 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e46dd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c8004800 0x7fc3dc15f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e46dd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3dc1514a0 0x7fc3dc143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e46dd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc14fe90 0x7fc3dc150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e46dd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc0b5b50 con 0x7fc3dc14fe90 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e46dd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc3dc0b5870 con 0x7fc3c8004800 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e46dd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc3dc15c550 con 0x7fc3dc1514a0 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e2c7a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc14fe90 0x7fc3dc150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e2c7a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc14fe90 0x7fc3dc150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43140/0 (socket says 172.21.15.60:43140) 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e2c7a640 1 -- 172.21.15.60:0/295948179 learned_addr learned my addr 172.21.15.60:0/295948179 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e1c78640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3dc1514a0 0x7fc3dc143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e2479640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c8004800 0x7fc3dc15f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e2c7a640 1 -- 172.21.15.60:0/295948179 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3dc1514a0 msgr2=0x7fc3dc143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e2c7a640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3dc1514a0 0x7fc3dc143fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e2c7a640 1 -- 172.21.15.60:0/295948179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c8004800 msgr2=0x7fc3dc15f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e2c7a640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c8004800 0x7fc3dc15f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e2c7a640 1 -- 172.21.15.60:0/295948179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3dc1519a0 con 0x7fc3dc14fe90 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e2479640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c8004800 0x7fc3dc15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e2c7a640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc14fe90 0x7fc3dc150320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc15ff10 tx=0x7fc3d4007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3d2ffd640 1 -- 172.21.15.60:0/295948179 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400aac0 con 0x7fc3dc14fe90 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3d2ffd640 1 -- 172.21.15.60:0/295948179 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d4018070 con 0x7fc3dc14fe90 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e46dd640 1 -- 172.21.15.60:0/295948179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3dc151c80 con 0x7fc3dc14fe90 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3d2ffd640 1 -- 172.21.15.60:0/295948179 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d40133f0 con 0x7fc3dc14fe90 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.150+0000 7fc3e46dd640 1 -- 172.21.15.60:0/295948179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3dc152240 con 0x7fc3dc14fe90 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.151+0000 7fc3e46dd640 1 -- 172.21.15.60:0/295948179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3dc0cfb30 con 0x7fc3dc14fe90 2024-09-12T01:38:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.152+0000 7fc3d2ffd640 1 -- 172.21.15.60:0/295948179 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc3d4013590 con 0x7fc3dc14fe90 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.152+0000 7fc3d2ffd640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc3c006be30 0x7fc3c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.152+0000 7fc3d2ffd640 1 -- 172.21.15.60:0/295948179 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fc3d408b3b0 con 0x7fc3dc14fe90 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.152+0000 7fc3e2479640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc3c006be30 0x7fc3c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.153+0000 7fc3e2479640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc3c006be30 0x7fc3c006e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc06f390 tx=0x7fc3cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.157+0000 7fc3d2ffd640 1 -- 172.21.15.60:0/295948179 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc3d4059cd0 con 0x7fc3dc14fe90 2024-09-12T01:38:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.334+0000 7fc3e46dd640 1 -- 172.21.15.60:0/295948179 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3dc160c70 con 0x7fc3dc14fe90 2024-09-12T01:38:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.336+0000 7fc3d2ffd640 1 -- 172.21.15.60:0/295948179 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16633 (secure 0 0 0) 0x7fc3d40595d0 con 0x7fc3dc14fe90 2024-09-12T01:38:00.335 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:00.335 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":46,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:37:46.959406+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:37:43.276989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T01:37:44.298899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:00.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.337+0000 7fc3e46dd640 1 -- 172.21.15.60:0/295948179 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc3c006be30 msgr2=0x7fc3c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.337+0000 7fc3e46dd640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc3c006be30 0x7fc3c006e2f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc06f390 tx=0x7fc3cc008040 comp rx=0 tx=0).stop 2024-09-12T01:38:00.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.338+0000 7fc3e46dd640 1 -- 172.21.15.60:0/295948179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc14fe90 msgr2=0x7fc3dc150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.338+0000 7fc3e46dd640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc14fe90 0x7fc3dc150320 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc15ff10 tx=0x7fc3d4007a90 comp rx=0 tx=0).stop 2024-09-12T01:38:00.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.338+0000 7fc3e46dd640 1 -- 172.21.15.60:0/295948179 shutdown_connections 2024-09-12T01:38:00.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.338+0000 7fc3e46dd640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc3dc14fe90 0x7fc3dc150320 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.338+0000 7fc3e46dd640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc3c006be30 0x7fc3c006e2f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.338+0000 7fc3e46dd640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3dc1514a0 0x7fc3dc143fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.338+0000 7fc3e46dd640 1 --2- 172.21.15.60:0/295948179 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3c8004800 0x7fc3dc15f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.338+0000 7fc3e46dd640 1 -- 172.21.15.60:0/295948179 >> 172.21.15.60:0/295948179 conn(0x7fc3dc06bc10 msgr2=0x7fc3dc15ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:00.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.338+0000 7fc3e46dd640 1 -- 172.21.15.60:0/295948179 shutdown_connections 2024-09-12T01:38:00.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.338+0000 7fc3e46dd640 1 -- 172.21.15.60:0/295948179 wait complete. 2024-09-12T01:38:00.348 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:38:00.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:00.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.451+0000 7f88707e4640 1 Processor -- start 2024-09-12T01:38:00.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.451+0000 7f88707e4640 1 -- start start 2024-09-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.452+0000 7f88707e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886815c170 0x7f886815c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.452+0000 7f88707e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f88680cf6c0 0x7f88680cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.452+0000 7f88707e4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88680b49c0 con 0x7f88680b5dd0 2024-09-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.452+0000 7f88707e4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f886815ca90 con 0x7f88680cf6c0 2024-09-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.452+0000 7f88707e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f88680b4cf0 con 0x7f886815c170 2024-09-12T01:38:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.452+0000 7f886dd7f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f88680cf6c0 0x7f88680cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.452+0000 7f886dd7f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f88680cf6c0 0x7f88680cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43148/0 (socket says 172.21.15.60:43148) 2024-09-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.452+0000 7f886dd7f640 1 -- 172.21.15.60:0/2984399114 learned_addr learned my addr 172.21.15.60:0/2984399114 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.452+0000 7f886e580640 1 --2- 172.21.15.60:0/2984399114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886815c170 0x7f886815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.453+0000 7f886dd7f640 1 -- 172.21.15.60:0/2984399114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886815c170 msgr2=0x7f886815c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.453+0000 7f886dd7f640 1 --2- 172.21.15.60:0/2984399114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886815c170 0x7f886815c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.453+0000 7f886dd7f640 1 -- 172.21.15.60:0/2984399114 >> v1:172.21.15.105:6789/0 conn(0x7f88680b5dd0 legacy=0x7f886815ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.453+0000 7f886dd7f640 1 -- 172.21.15.60:0/2984399114 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88680b4fd0 con 0x7f88680cf6c0 2024-09-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.453+0000 7f886dd7f640 1 --2- 172.21.15.60:0/2984399114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88680cf6c0 0x7f88680cfb00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f885c009870 tx=0x7f885c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e810710b8053d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.454+0000 7f886d57e640 1 -- 172.21.15.60:0/2984399114 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885c037070 con 0x7f88680cf6c0 2024-09-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.454+0000 7f886d57e640 1 -- 172.21.15.60:0/2984399114 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f885c032440 con 0x7f88680cf6c0 2024-09-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.454+0000 7f886d57e640 1 -- 172.21.15.60:0/2984399114 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f885c032810 con 0x7f88680cf6c0 2024-09-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.454+0000 7f88707e4640 1 -- 172.21.15.60:0/2984399114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88680cf6c0 msgr2=0x7f88680cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.454+0000 7f88707e4640 1 --2- 172.21.15.60:0/2984399114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88680cf6c0 0x7f88680cfb00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f885c009870 tx=0x7f885c02a270 comp rx=0 tx=0).stop 2024-09-12T01:38:00.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.454+0000 7f88707e4640 1 -- 172.21.15.60:0/2984399114 shutdown_connections 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.454+0000 7f88707e4640 1 --2- 172.21.15.60:0/2984399114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88680cf6c0 0x7f88680cfb00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.454+0000 7f88707e4640 1 --2- 172.21.15.60:0/2984399114 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886815c170 0x7f886815c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.454+0000 7f88707e4640 1 -- 172.21.15.60:0/2984399114 >> 172.21.15.60:0/2984399114 conn(0x7f886806bc10 msgr2=0x7f886806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.454+0000 7f88707e4640 1 -- 172.21.15.60:0/2984399114 shutdown_connections 2024-09-12T01:38:00.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.454+0000 7f88707e4640 1 -- 172.21.15.60:0/2984399114 wait complete. 2024-09-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.455+0000 7f88707e4640 1 Processor -- start 2024-09-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.456+0000 7f88707e4640 1 -- start start 2024-09-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.456+0000 7f88707e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88680b5dd0 0x7f886814b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.456+0000 7f88707e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88680cf6c0 0x7f88681605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.456+0000 7f88707e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886815c170 0x7f886814f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.456+0000 7f88707e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f88680b5870 con 0x7f88680b5dd0 2024-09-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.456+0000 7f88707e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f88680b5590 con 0x7f88680cf6c0 2024-09-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.456+0000 7f88707e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f88680b5b50 con 0x7f886815c170 2024-09-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.456+0000 7f886e580640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88680b5dd0 0x7f886814b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.456+0000 7f886e580640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88680b5dd0 0x7f886814b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43158/0 (socket says 172.21.15.60:43158) 2024-09-12T01:38:00.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.456+0000 7f886e580640 1 -- 172.21.15.60:0/3920716156 learned_addr learned my addr 172.21.15.60:0/3920716156 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.456+0000 7f886dd7f640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88680cf6c0 0x7f88681605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.456+0000 7f886ed81640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886815c170 0x7f886814f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.457+0000 7f886e580640 1 -- 172.21.15.60:0/3920716156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886815c170 msgr2=0x7f886814f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.457+0000 7f886e580640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886815c170 0x7f886814f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.457+0000 7f886e580640 1 -- 172.21.15.60:0/3920716156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88680cf6c0 msgr2=0x7f88681605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.457+0000 7f886e580640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88680cf6c0 0x7f88681605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.457+0000 7f886e580640 1 -- 172.21.15.60:0/3920716156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88681524e0 con 0x7f88680b5dd0 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.457+0000 7f886ed81640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886815c170 0x7f886814f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.457+0000 7f886e580640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88680b5dd0 0x7f886814b0f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f885800efc0 tx=0x7f885800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.457+0000 7f8866ffd640 1 -- 172.21.15.60:0/3920716156 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858018020 con 0x7f88680b5dd0 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.457+0000 7f8866ffd640 1 -- 172.21.15.60:0/3920716156 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8858014480 con 0x7f88680b5dd0 2024-09-12T01:38:00.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.457+0000 7f8866ffd640 1 -- 172.21.15.60:0/3920716156 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858014850 con 0x7f88680b5dd0 2024-09-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.457+0000 7f88707e4640 1 -- 172.21.15.60:0/3920716156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8868151c40 con 0x7f88680b5dd0 2024-09-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.457+0000 7f88707e4640 1 -- 172.21.15.60:0/3920716156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8868152200 con 0x7f88680b5dd0 2024-09-12T01:38:00.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.458+0000 7f88707e4640 1 -- 172.21.15.60:0/3920716156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88681581f0 con 0x7f88680b5dd0 2024-09-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.459+0000 7f8866ffd640 1 -- 172.21.15.60:0/3920716156 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8858005d10 con 0x7f88680b5dd0 2024-09-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.459+0000 7f8866ffd640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f885406be30 0x7f885406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.460+0000 7f886dd7f640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f885406be30 0x7f885406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.460+0000 7f8866ffd640 1 -- 172.21.15.60:0/3920716156 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f885808bb00 con 0x7f88680b5dd0 2024-09-12T01:38:00.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.460+0000 7f886dd7f640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f885406be30 0x7f885406e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f885c034000 tx=0x7f885c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:00.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.464+0000 7f8866ffd640 1 -- 172.21.15.60:0/3920716156 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f88681581f0 con 0x7f88680b5dd0 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.676+0000 7f88707e4640 1 -- 172.21.15.60:0/3920716156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88680cfb00 con 0x7f88680b5dd0 2024-09-12T01:38:00.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.676+0000 7f8866ffd640 1 -- 172.21.15.60:0/3920716156 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5235 (secure 0 0 0) 0x7f8858022030 con 0x7f88680b5dd0 2024-09-12T01:38:00.676 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:00.676 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"btime":"2024-09-12T01:37:48:964735+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2903062918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2903062918},{"type":"v1","addr":"172.21.15.105:6835","nonce":2903062918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1613307735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1613307735},{"type":"v1","addr":"172.21.15.60:6836","nonce":1613307735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/4169562393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":4169562393},{"type":"v1","addr":"172.21.15.60:6837","nonce":4169562393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:37:45.314718+0000","modified":"2024-09-12T01:37:48.116046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34778":{"gid":34778,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/2704792080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2704792080},{"type":"v1","addr":"172.21.15.105:6834","nonce":2704792080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34778,"qdb_cluster":[34778]},"id":3}]} 2024-09-12T01:38:00.676 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 21 2024-09-12T01:38:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.678+0000 7f88707e4640 1 -- 172.21.15.60:0/3920716156 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f885406be30 msgr2=0x7f885406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.678+0000 7f88707e4640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f885406be30 0x7f885406e2f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f885c034000 tx=0x7f885c02e000 comp rx=0 tx=0).stop 2024-09-12T01:38:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.678+0000 7f88707e4640 1 -- 172.21.15.60:0/3920716156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88680b5dd0 msgr2=0x7f886814b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.678+0000 7f88707e4640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88680b5dd0 0x7f886814b0f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f885800efc0 tx=0x7f885800c490 comp rx=0 tx=0).stop 2024-09-12T01:38:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.678+0000 7f88707e4640 1 -- 172.21.15.60:0/3920716156 shutdown_connections 2024-09-12T01:38:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.678+0000 7f88707e4640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f885406be30 0x7f885406e2f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.678+0000 7f88707e4640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f886815c170 0x7f886814f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.678+0000 7f88707e4640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f88680cf6c0 0x7f88681605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.678+0000 7f88707e4640 1 --2- 172.21.15.60:0/3920716156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88680b5dd0 0x7f886814b0f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.678+0000 7f88707e4640 1 -- 172.21.15.60:0/3920716156 >> 172.21.15.60:0/3920716156 conn(0x7f886806bc10 msgr2=0x7f8868154b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.678+0000 7f88707e4640 1 -- 172.21.15.60:0/3920716156 shutdown_connections 2024-09-12T01:38:00.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.678+0000 7f88707e4640 1 -- 172.21.15.60:0/3920716156 wait complete. 2024-09-12T01:38:00.689 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:00.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.791+0000 7f0e61d9f640 1 Processor -- start 2024-09-12T01:38:00.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.791+0000 7f0e61d9f640 1 -- start start 2024-09-12T01:38:00.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.792+0000 7f0e61d9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e5c15e5f0 0x7f0e5c0d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.792+0000 7f0e61d9f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0e5c0d13c0 0x7f0e5c0b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.792+0000 7f0e61d9f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e5c15e9d0 con 0x7f0e5c0b8730 2024-09-12T01:38:00.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.792+0000 7f0e61d9f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0e5c0b9b30 con 0x7f0e5c0d13c0 2024-09-12T01:38:00.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.792+0000 7f0e61d9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5c0d1820 con 0x7f0e5c15e5f0 2024-09-12T01:38:00.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.792+0000 7f0e5bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0e5c0d13c0 0x7f0e5c0b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.792+0000 7f0e6159e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0e5c0b8730 0x7f0e5c0ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44224/0 (socket says 172.21.15.60:44224) 2024-09-12T01:38:00.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.792+0000 7f0e6159e640 1 -- 172.21.15.60:0/1643654366 learned_addr learned my addr 172.21.15.60:0/1643654366 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:00.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.792+0000 7f0e60d9d640 1 --2- 172.21.15.60:0/1643654366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e5c15e5f0 0x7f0e5c0d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.793+0000 7f0e5bfff640 1 -- 172.21.15.60:0/1643654366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e5c15e5f0 msgr2=0x7f0e5c0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:00.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.793+0000 7f0e5bfff640 1 --2- 172.21.15.60:0/1643654366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e5c15e5f0 0x7f0e5c0d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.793+0000 7f0e5bfff640 1 -- 172.21.15.60:0/1643654366 >> v1:172.21.15.60:6789/0 conn(0x7f0e5c0b8730 legacy=0x7f0e5c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.793+0000 7f0e5b7fe640 1 -- 172.21.15.60:0/1643654366 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328994930 0 0) 0x7f0e5c15e9d0 con 0x7f0e5c0b8730 2024-09-12T01:38:00.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.793+0000 7f0e5bfff640 1 -- 172.21.15.60:0/1643654366 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5c0b8f20 con 0x7f0e5c0d13c0 2024-09-12T01:38:00.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.793+0000 7f0e5bfff640 1 --2- 172.21.15.60:0/1643654366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5c0d13c0 0x7f0e5c0b81f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0e440097a0 tx=0x7f0e4402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a7864ee42749bd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:00.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.793+0000 7f0e5b7fe640 1 -- 172.21.15.60:0/1643654366 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e44037070 con 0x7f0e5c0d13c0 2024-09-12T01:38:00.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.793+0000 7f0e5b7fe640 1 -- 172.21.15.60:0/1643654366 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e44032440 con 0x7f0e5c0d13c0 2024-09-12T01:38:00.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.793+0000 7f0e5b7fe640 1 -- 172.21.15.60:0/1643654366 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e44032810 con 0x7f0e5c0d13c0 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.794+0000 7f0e61d9f640 1 -- 172.21.15.60:0/1643654366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5c0d13c0 msgr2=0x7f0e5c0b81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.794+0000 7f0e61d9f640 1 --2- 172.21.15.60:0/1643654366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5c0d13c0 0x7f0e5c0b81f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0e440097a0 tx=0x7f0e4402a180 comp rx=0 tx=0).stop 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.794+0000 7f0e61d9f640 1 -- 172.21.15.60:0/1643654366 shutdown_connections 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.794+0000 7f0e61d9f640 1 --2- 172.21.15.60:0/1643654366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5c0d13c0 0x7f0e5c0b81f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.794+0000 7f0e61d9f640 1 --2- 172.21.15.60:0/1643654366 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e5c15e5f0 0x7f0e5c0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.794+0000 7f0e61d9f640 1 -- 172.21.15.60:0/1643654366 >> 172.21.15.60:0/1643654366 conn(0x7f0e5c062630 msgr2=0x7f0e5c062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.794+0000 7f0e61d9f640 1 -- 172.21.15.60:0/1643654366 shutdown_connections 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.794+0000 7f0e61d9f640 1 -- 172.21.15.60:0/1643654366 wait complete. 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.795+0000 7f0e61d9f640 1 Processor -- start 2024-09-12T01:38:00.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.795+0000 7f0e61d9f640 1 -- start start 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.796+0000 7f0e61d9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5c0b8730 0x7f0e5c160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.796+0000 7f0e61d9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e5c0d13c0 0x7f0e5c0c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.796+0000 7f0e61d9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e5c15e5f0 0x7f0e5c0d4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.796+0000 7f0e61d9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c0b97c0 con 0x7f0e5c0b8730 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.796+0000 7f0e61d9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0e5c0b94e0 con 0x7f0e5c15e5f0 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.796+0000 7f0e61d9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0e5c0b8bc0 con 0x7f0e5c0d13c0 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.796+0000 7f0e60d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5c0b8730 0x7f0e5c160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.796+0000 7f0e60d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5c0b8730 0x7f0e5c160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43176/0 (socket says 172.21.15.60:43176) 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.796+0000 7f0e60d9d640 1 -- 172.21.15.60:0/44402362 learned_addr learned my addr 172.21.15.60:0/44402362 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.796+0000 7f0e5bfff640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e5c0d13c0 0x7f0e5c0c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.796+0000 7f0e6159e640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e5c15e5f0 0x7f0e5c0d4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.797+0000 7f0e60d9d640 1 -- 172.21.15.60:0/44402362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e5c0d13c0 msgr2=0x7f0e5c0c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.797+0000 7f0e60d9d640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e5c0d13c0 0x7f0e5c0c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.797+0000 7f0e60d9d640 1 -- 172.21.15.60:0/44402362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e5c15e5f0 msgr2=0x7f0e5c0d4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.797+0000 7f0e60d9d640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e5c15e5f0 0x7f0e5c0d4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.797+0000 7f0e60d9d640 1 -- 172.21.15.60:0/44402362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e5c0c9e20 con 0x7f0e5c0b8730 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.797+0000 7f0e6159e640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e5c15e5f0 0x7f0e5c0d4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.797+0000 7f0e60d9d640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5c0b8730 0x7f0e5c160370 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c007e40 tx=0x7f0e4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.797+0000 7f0e597fa640 1 -- 172.21.15.60:0/44402362 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c014620 con 0x7f0e5c0b8730 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.797+0000 7f0e597fa640 1 -- 172.21.15.60:0/44402362 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e4c019070 con 0x7f0e5c0b8730 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.797+0000 7f0e61d9f640 1 -- 172.21.15.60:0/44402362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e5c0ca100 con 0x7f0e5c0b8730 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.797+0000 7f0e597fa640 1 -- 172.21.15.60:0/44402362 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c014a00 con 0x7f0e5c0b8730 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.797+0000 7f0e61d9f640 1 -- 172.21.15.60:0/44402362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e5c0ca9a0 con 0x7f0e5c0b8730 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.798+0000 7f0e61d9f640 1 -- 172.21.15.60:0/44402362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e5c0ca2d0 con 0x7f0e5c0b8730 2024-09-12T01:38:00.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.798+0000 7f0e597fa640 1 -- 172.21.15.60:0/44402362 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0e4c014ba0 con 0x7f0e5c0b8730 2024-09-12T01:38:00.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.799+0000 7f0e597fa640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e3c06be30 0x7f0e3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:00.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.799+0000 7f0e5bfff640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e3c06be30 0x7f0e3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:00.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.799+0000 7f0e597fa640 1 -- 172.21.15.60:0/44402362 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f0e4c08b650 con 0x7f0e5c0b8730 2024-09-12T01:38:00.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.800+0000 7f0e5bfff640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e3c06be30 0x7f0e3c06e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0e44034000 tx=0x7f0e4402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:00.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:00.803+0000 7f0e597fa640 1 -- 172.21.15.60:0/44402362 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0e4c05a000 con 0x7f0e5c0b8730 2024-09-12T01:38:01.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.016+0000 7f0e61d9f640 1 -- 172.21.15.60:0/44402362 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e5c069c20 con 0x7f0e5c0b8730 2024-09-12T01:38:01.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.017+0000 7f0e597fa640 1 -- 172.21.15.60:0/44402362 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5235 (secure 0 0 0) 0x7f0e4c059900 con 0x7f0e5c0b8730 2024-09-12T01:38:01.017 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:01.017 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"btime":"2024-09-12T01:37:48:964735+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2903062918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2903062918},{"type":"v1","addr":"172.21.15.105:6835","nonce":2903062918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1613307735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1613307735},{"type":"v1","addr":"172.21.15.60:6836","nonce":1613307735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/4169562393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":4169562393},{"type":"v1","addr":"172.21.15.60:6837","nonce":4169562393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:37:45.314718+0000","modified":"2024-09-12T01:37:48.116046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34778},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34778":{"gid":34778,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/2704792080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2704792080},{"type":"v1","addr":"172.21.15.105:6834","nonce":2704792080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34778,"qdb_cluster":[34778]},"id":3}]} 2024-09-12T01:38:01.017 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 21 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.019+0000 7f0e61d9f640 1 -- 172.21.15.60:0/44402362 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e3c06be30 msgr2=0x7f0e3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.019+0000 7f0e61d9f640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e3c06be30 0x7f0e3c06e2f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0e44034000 tx=0x7f0e4402e000 comp rx=0 tx=0).stop 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.019+0000 7f0e61d9f640 1 -- 172.21.15.60:0/44402362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5c0b8730 msgr2=0x7f0e5c160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.019+0000 7f0e61d9f640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5c0b8730 0x7f0e5c160370 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0e4c007e40 tx=0x7f0e4c00e4b0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.019+0000 7f0e61d9f640 1 -- 172.21.15.60:0/44402362 shutdown_connections 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.019+0000 7f0e61d9f640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0e5c15e5f0 0x7f0e5c0d4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.019+0000 7f0e61d9f640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0e3c06be30 0x7f0e3c06e2f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.019+0000 7f0e61d9f640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0e5c0d13c0 0x7f0e5c0c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.019+0000 7f0e61d9f640 1 --2- 172.21.15.60:0/44402362 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0e5c0b8730 0x7f0e5c160370 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.020+0000 7f0e61d9f640 1 -- 172.21.15.60:0/44402362 >> 172.21.15.60:0/44402362 conn(0x7f0e5c062630 msgr2=0x7f0e5c0b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.020+0000 7f0e61d9f640 1 -- 172.21.15.60:0/44402362 shutdown_connections 2024-09-12T01:38:01.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.020+0000 7f0e61d9f640 1 -- 172.21.15.60:0/44402362 wait complete. 2024-09-12T01:38:01.030 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:01.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.133+0000 7fc4db126640 1 Processor -- start 2024-09-12T01:38:01.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.133+0000 7fc4db126640 1 -- start start 2024-09-12T01:38:01.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.133+0000 7fc4db126640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc4d40ba240 0x7fc4d40d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.133+0000 7fc4db126640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc4d40cf2f0 0x7fc4d40cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.133+0000 7fc4db126640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d40d2f40 con 0x7fc4d415e7a0 2024-09-12T01:38:01.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.133+0000 7fc4db126640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40cfca0 con 0x7fc4d40ba240 2024-09-12T01:38:01.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.133+0000 7fc4db126640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40ba690 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.134+0000 7fc4d3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc4d40ba240 0x7fc4d40d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.134+0000 7fc4d3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc4d40ba240 0x7fc4d40d3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43192/0 (socket says 172.21.15.60:43192) 2024-09-12T01:38:01.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.134+0000 7fc4d3fff640 1 -- 172.21.15.60:0/1754359267 learned_addr learned my addr 172.21.15.60:0/1754359267 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:01.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.134+0000 7fc4d96c3640 1 --2- 172.21.15.60:0/1754359267 >> v2:172.21.15.105:3300/0 conn(0x7fc4d40cf2f0 0x7fc4d40cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.134+0000 7fc4d3fff640 1 -- 172.21.15.60:0/1754359267 >> v2:172.21.15.105:3300/0 conn(0x7fc4d40cf2f0 msgr2=0x7fc4d40cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:01.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.134+0000 7fc4d3fff640 1 --2- 172.21.15.60:0/1754359267 >> v2:172.21.15.105:3300/0 conn(0x7fc4d40cf2f0 0x7fc4d40cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.134+0000 7fc4d3fff640 1 -- 172.21.15.60:0/1754359267 >> v1:172.21.15.105:6789/0 conn(0x7fc4d415e7a0 legacy=0x7fc4d40d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.134+0000 7fc4d3fff640 1 -- 172.21.15.60:0/1754359267 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40d3220 con 0x7fc4d40ba240 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.135+0000 7fc4d3fff640 1 --2- 172.21.15.60:0/1754359267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4d40ba240 0x7fc4d40d3fe0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40b6130 tx=0x7fc4c002a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbda4d248297ce86 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.135+0000 7fc4d37fe640 1 -- 172.21.15.60:0/1754359267 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0037070 con 0x7fc4d40ba240 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.135+0000 7fc4d37fe640 1 -- 172.21.15.60:0/1754359267 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c0032640 con 0x7fc4d40ba240 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.135+0000 7fc4d37fe640 1 -- 172.21.15.60:0/1754359267 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0032a10 con 0x7fc4d40ba240 2024-09-12T01:38:01.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.135+0000 7fc4db126640 1 -- 172.21.15.60:0/1754359267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4d40ba240 msgr2=0x7fc4d40d3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.135+0000 7fc4db126640 1 --2- 172.21.15.60:0/1754359267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4d40ba240 0x7fc4d40d3fe0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40b6130 tx=0x7fc4c002a330 comp rx=0 tx=0).stop 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.135+0000 7fc4db126640 1 -- 172.21.15.60:0/1754359267 shutdown_connections 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.135+0000 7fc4db126640 1 --2- 172.21.15.60:0/1754359267 >> v2:172.21.15.105:3300/0 conn(0x7fc4d40cf2f0 0x7fc4d40cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.135+0000 7fc4db126640 1 --2- 172.21.15.60:0/1754359267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4d40ba240 0x7fc4d40d3fe0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.136+0000 7fc4db126640 1 -- 172.21.15.60:0/1754359267 >> 172.21.15.60:0/1754359267 conn(0x7fc4d40d1550 msgr2=0x7fc4d40d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.136+0000 7fc4db126640 1 -- 172.21.15.60:0/1754359267 shutdown_connections 2024-09-12T01:38:01.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.136+0000 7fc4db126640 1 -- 172.21.15.60:0/1754359267 wait complete. 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.137+0000 7fc4db126640 1 Processor -- start 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.137+0000 7fc4db126640 1 -- start start 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4db126640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4d40ba240 0x7fc4d41f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4db126640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4d40cf2f0 0x7fc4d41f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4db126640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4d415e7a0 0x7fc4d4159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4db126640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40d3ac0 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4db126640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40d37e0 con 0x7fc4d40ba240 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4db126640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d415eb80 con 0x7fc4d415e7a0 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4d40cf2f0 0x7fc4d41f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4d40cf2f0 0x7fc4d41f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43200/0 (socket says 172.21.15.60:43200) 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d3fff640 1 -- 172.21.15.60:0/4076224763 learned_addr learned my addr 172.21.15.60:0/4076224763 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d96c3640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4d415e7a0 0x7fc4d4159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d8ec2640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4d40ba240 0x7fc4d41f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d3fff640 1 -- 172.21.15.60:0/4076224763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4d415e7a0 msgr2=0x7fc4d4159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d3fff640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4d415e7a0 0x7fc4d4159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d3fff640 1 -- 172.21.15.60:0/4076224763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4d40ba240 msgr2=0x7fc4d41f4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d3fff640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4d40ba240 0x7fc4d41f4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d3fff640 1 -- 172.21.15.60:0/4076224763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d41f8780 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d3fff640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4d40cf2f0 0x7fc4d41f8240 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc4c002a370 tx=0x7fc4c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d17fa640 1 -- 172.21.15.60:0/4076224763 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0037040 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d17fa640 1 -- 172.21.15.60:0/4076224763 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c0042070 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4db126640 1 -- 172.21.15.60:0/4076224763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d4160fa0 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.138+0000 7fc4d17fa640 1 -- 172.21.15.60:0/4076224763 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0030990 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.139+0000 7fc4db126640 1 -- 172.21.15.60:0/4076224763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d41f43a0 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.139+0000 7fc4db126640 1 -- 172.21.15.60:0/4076224763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d40cf760 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.140+0000 7fc4d17fa640 1 -- 172.21.15.60:0/4076224763 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4c0030b30 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.140+0000 7fc4d17fa640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4b806be30 0x7fc4b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.140+0000 7fc4d17fa640 1 -- 172.21.15.60:0/4076224763 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7fc4c00ab500 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.141+0000 7fc4d8ec2640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4b806be30 0x7fc4b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.141+0000 7fc4d8ec2640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4b806be30 0x7fc4b806e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40cf1c0 tx=0x7fc4c8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:01.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.145+0000 7fc4d17fa640 1 -- 172.21.15.60:0/4076224763 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4c0030e20 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.320+0000 7fc4db126640 1 -- 172.21.15.60:0/4076224763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc4d40d41a0 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.321+0000 7fc4d17fa640 1 -- 172.21.15.60:0/4076224763 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) ==== 74+0+16633 (secure 0 0 0) 0x7fc4c00798f0 con 0x7fc4d40cf2f0 2024-09-12T01:38:01.321 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:01.321 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":46,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:37:46.959406+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:37:43.276989+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-12T01:37:44.298899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:01.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.323+0000 7fc4db126640 1 -- 172.21.15.60:0/4076224763 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4b806be30 msgr2=0x7fc4b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.323+0000 7fc4db126640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4b806be30 0x7fc4b806e2f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40cf1c0 tx=0x7fc4c8009040 comp rx=0 tx=0).stop 2024-09-12T01:38:01.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.323+0000 7fc4db126640 1 -- 172.21.15.60:0/4076224763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4d40cf2f0 msgr2=0x7fc4d41f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.323+0000 7fc4db126640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4d40cf2f0 0x7fc4d41f8240 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc4c002a370 tx=0x7fc4c00046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.323+0000 7fc4db126640 1 -- 172.21.15.60:0/4076224763 shutdown_connections 2024-09-12T01:38:01.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.323+0000 7fc4db126640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4b806be30 0x7fc4b806e2f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.323+0000 7fc4db126640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4d415e7a0 0x7fc4d4159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.323+0000 7fc4db126640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4d40cf2f0 0x7fc4d41f8240 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.323+0000 7fc4db126640 1 --2- 172.21.15.60:0/4076224763 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4d40ba240 0x7fc4d41f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.323+0000 7fc4db126640 1 -- 172.21.15.60:0/4076224763 >> 172.21.15.60:0/4076224763 conn(0x7fc4d40d1550 msgr2=0x7fc4d40c8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:01.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.323+0000 7fc4db126640 1 -- 172.21.15.60:0/4076224763 shutdown_connections 2024-09-12T01:38:01.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.323+0000 7fc4db126640 1 -- 172.21.15.60:0/4076224763 wait complete. 2024-09-12T01:38:01.334 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:38:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.438+0000 7f21ad9e4640 1 Processor -- start 2024-09-12T01:38:01.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.438+0000 7f21ad9e4640 1 -- start start 2024-09-12T01:38:01.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21ad9e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a815e760 0x7f21a8073e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21ad9e4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21a806f410 0x7f21a806f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21ad9e4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a8070240 con 0x7f21a806fd90 2024-09-12T01:38:01.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21ad9e4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f21a815eb40 con 0x7f21a806f410 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21ad9e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21a80d1250 con 0x7f21a815e760 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a77fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f21a806fd90 0x7f21a81621c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44238/0 (socket says 172.21.15.60:44238) 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a77fe640 1 -- 172.21.15.60:0/3836838709 learned_addr learned my addr 172.21.15.60:0/3836838709 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 558567980 0 0) 0x7f21a0001490 con 0x7f21a806fd90 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a6ffd640 1 --2- 172.21.15.60:0/3836838709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a815e760 0x7f21a8073e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2190003520 con 0x7f21a806fd90 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a67fc640 1 --2- 172.21.15.60:0/3836838709 >> v2:172.21.15.105:3300/0 conn(0x7f21a806f410 0x7f21a806f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1447682789 0 0) 0x7f2190003520 con 0x7f21a806fd90 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a815e760 msgr2=0x7f21a8073e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 --2- 172.21.15.60:0/3836838709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a815e760 0x7f21a8073e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 >> v2:172.21.15.105:3300/0 conn(0x7f21a806f410 msgr2=0x7f21a806f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 --2- 172.21.15.60:0/3836838709 >> v2:172.21.15.105:3300/0 conn(0x7f21a806f410 0x7f21a806f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a806d7b0 con 0x7f21a806fd90 2024-09-12T01:38:01.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f21a0001bc0 con 0x7f21a806fd90 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 >> v1:172.21.15.60:6789/0 conn(0x7f21a806fd90 legacy=0x7f21a81621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 --2- 172.21.15.60:0/3836838709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21900039b0 0x7f2190003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 --2- 172.21.15.60:0/3836838709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2190004800 0x7f2190004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 --2- 172.21.15.60:0/3836838709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a815e760 0x7f21900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f21a815eb40 con 0x7f21900039b0 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21a80d1250 con 0x7f2190004800 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.439+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f219000ba40 con 0x7f21a815e760 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.440+0000 7f21a6ffd640 1 --2- 172.21.15.60:0/3836838709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21900039b0 0x7f2190003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.440+0000 7f21a77fe640 1 --2- 172.21.15.60:0/3836838709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a815e760 0x7f21900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.440+0000 7f21a67fc640 1 --2- 172.21.15.60:0/3836838709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2190004800 0x7f2190004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.440+0000 7f21a6ffd640 1 -- 172.21.15.60:0/3836838709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a815e760 msgr2=0x7f21900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.440+0000 7f21a6ffd640 1 --2- 172.21.15.60:0/3836838709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a815e760 0x7f21900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.440+0000 7f21a6ffd640 1 -- 172.21.15.60:0/3836838709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2190004800 msgr2=0x7f2190004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:01.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.440+0000 7f21a6ffd640 1 --2- 172.21.15.60:0/3836838709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2190004800 0x7f2190004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.440+0000 7f21a6ffd640 1 -- 172.21.15.60:0/3836838709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2190003520 con 0x7f21900039b0 2024-09-12T01:38:01.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.441+0000 7f21a6ffd640 1 --2- 172.21.15.60:0/3836838709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21900039b0 0x7f2190003dd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2198009ac0 tx=0x7f2190005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3589f6fd9345d7fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:01.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.441+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2198036070 con 0x7f21900039b0 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.441+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2198031400 con 0x7f21900039b0 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.441+0000 7f21a5ffb640 1 -- 172.21.15.60:0/3836838709 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2198009690 con 0x7f21900039b0 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.441+0000 7f21ad9e4640 1 -- 172.21.15.60:0/3836838709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21900039b0 msgr2=0x7f2190003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.441+0000 7f21ad9e4640 1 --2- 172.21.15.60:0/3836838709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21900039b0 0x7f2190003dd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2198009ac0 tx=0x7f2190005830 comp rx=0 tx=0).stop 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.441+0000 7f21a77fe640 1 -- 172.21.15.60:0/3836838709 reap_dead start 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.441+0000 7f21ad9e4640 1 -- 172.21.15.60:0/3836838709 shutdown_connections 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.441+0000 7f21ad9e4640 1 -- 172.21.15.60:0/3836838709 >> 172.21.15.60:0/3836838709 conn(0x7f21a80b7d70 msgr2=0x7f21a8062630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.441+0000 7f21ad9e4640 1 -- 172.21.15.60:0/3836838709 shutdown_connections 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.441+0000 7f21ad9e4640 1 -- 172.21.15.60:0/3836838709 wait complete. 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.443+0000 7f21ad9e4640 1 Processor -- start 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.443+0000 7f21ad9e4640 1 -- start start 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.443+0000 7f21ad9e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21900039b0 0x7f21a80cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.443+0000 7f21ad9e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80b0fd0 0x7f21a81591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.443+0000 7f21ad9e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a815d7f0 0x7f21a8159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.443+0000 7f21ad9e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f21a80d0ee0 con 0x7f21900039b0 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.443+0000 7f21ad9e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21a80d2c60 con 0x7f21a815d7f0 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.443+0000 7f21ad9e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21a806dd70 con 0x7f21a80b0fd0 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21a6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21900039b0 0x7f21a80cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21a6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21900039b0 0x7f21a80cda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43220/0 (socket says 172.21.15.60:43220) 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21a6ffd640 1 -- 172.21.15.60:0/1936813453 learned_addr learned my addr 172.21.15.60:0/1936813453 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21a77fe640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a815d7f0 0x7f21a8159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21a67fc640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80b0fd0 0x7f21a81591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21a6ffd640 1 -- 172.21.15.60:0/1936813453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80b0fd0 msgr2=0x7f21a81591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21a6ffd640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80b0fd0 0x7f21a81591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21a6ffd640 1 -- 172.21.15.60:0/1936813453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a815d7f0 msgr2=0x7f21a8159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21a6ffd640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a815d7f0 0x7f21a8159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21a6ffd640 1 -- 172.21.15.60:0/1936813453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a815dd90 con 0x7f21900039b0 2024-09-12T01:38:01.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21a67fc640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80b0fd0 0x7f21a81591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21a6ffd640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21900039b0 0x7f21a80cda30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2198034040 tx=0x7f2198004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f218ffff640 1 -- 172.21.15.60:0/1936813453 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2198040020 con 0x7f21900039b0 2024-09-12T01:38:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f218ffff640 1 -- 172.21.15.60:0/1936813453 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2198003bc0 con 0x7f21900039b0 2024-09-12T01:38:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21ad9e4640 1 -- 172.21.15.60:0/1936813453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a80cb9c0 con 0x7f21900039b0 2024-09-12T01:38:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f218ffff640 1 -- 172.21.15.60:0/1936813453 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2198036040 con 0x7f21900039b0 2024-09-12T01:38:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.444+0000 7f21ad9e4640 1 -- 172.21.15.60:0/1936813453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a80cbf80 con 0x7f21900039b0 2024-09-12T01:38:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.445+0000 7f21ad9e4640 1 -- 172.21.15.60:0/1936813453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a80cb7e0 con 0x7f21900039b0 2024-09-12T01:38:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.446+0000 7f218ffff640 1 -- 172.21.15.60:0/1936813453 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2198043020 con 0x7f21900039b0 2024-09-12T01:38:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.446+0000 7f218ffff640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f219406be30 0x7f219406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.446+0000 7f218ffff640 1 -- 172.21.15.60:0/1936813453 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5709+0+0 (secure 0 0 0) 0x7f21980aaf40 con 0x7f21900039b0 2024-09-12T01:38:01.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.446+0000 7f21a67fc640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f219406be30 0x7f219406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.447+0000 7f21a67fc640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f219406be30 0x7f219406e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f21a80d33f0 tx=0x7f219c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:01.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.451+0000 7f218ffff640 1 -- 172.21.15.60:0/1936813453 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21a80cb7e0 con 0x7f21900039b0 2024-09-12T01:38:01.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.661+0000 7f21ad9e4640 1 -- 172.21.15.60:0/1936813453 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f21a80b3b10 con 0x7f21900039b0 2024-09-12T01:38:01.661 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-12T01:38:01.662+0000 7f58b98dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:38:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.664+0000 7f218ffff640 1 -- 172.21.15.60:0/1936813453 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7f219804a070 con 0x7f21900039b0 2024-09-12T01:38:01.663 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:38:01.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.666+0000 7f21ad9e4640 1 -- 172.21.15.60:0/1936813453 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f219406be30 msgr2=0x7f219406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.666+0000 7f21ad9e4640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f219406be30 0x7f219406e2f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f21a80d33f0 tx=0x7f219c008040 comp rx=0 tx=0).stop 2024-09-12T01:38:01.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.666+0000 7f21ad9e4640 1 -- 172.21.15.60:0/1936813453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21900039b0 msgr2=0x7f21a80cda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.666+0000 7f21ad9e4640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21900039b0 0x7f21a80cda30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f2198034040 tx=0x7f2198004730 comp rx=0 tx=0).stop 2024-09-12T01:38:01.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.666+0000 7f21ad9e4640 1 -- 172.21.15.60:0/1936813453 shutdown_connections 2024-09-12T01:38:01.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.666+0000 7f21ad9e4640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a815d7f0 0x7f21a8159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.666+0000 7f21ad9e4640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f219406be30 0x7f219406e2f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.666+0000 7f21ad9e4640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a80b0fd0 0x7f21a81591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.666+0000 7f21ad9e4640 1 --2- 172.21.15.60:0/1936813453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21900039b0 0x7f21a80cda30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.666+0000 7f21ad9e4640 1 -- 172.21.15.60:0/1936813453 >> 172.21.15.60:0/1936813453 conn(0x7f21a80b7d70 msgr2=0x7f21a80d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.666+0000 7f21ad9e4640 1 -- 172.21.15.60:0/1936813453 shutdown_connections 2024-09-12T01:38:01.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.666+0000 7f21ad9e4640 1 -- 172.21.15.60:0/1936813453 wait complete. 2024-09-12T01:38:01.669 INFO:tasks.ceph.mds.d.smithi105.stderr: -2217> 2024-09-12T01:37:46.937+0000 7ff5bb26f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:38:01.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:38:01.699 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:38:01.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.783+0000 7f1221b4b640 1 Processor -- start 2024-09-12T01:38:01.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.783+0000 7f1221b4b640 1 -- start start 2024-09-12T01:38:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f1221b4b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f121c15e7a0 0x7f121c06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f1221b4b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f121c0b68f0 0x7f121c0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f1221b4b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f121c0cf860 con 0x7f121c0cf1f0 2024-09-12T01:38:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f1221b4b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f121c0d2ca0 con 0x7f121c15e7a0 2024-09-12T01:38:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f1221b4b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f121c0cfb40 con 0x7f121c0b68f0 2024-09-12T01:38:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f121b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f121c15e7a0 0x7f121c06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f121affd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f121c0cf1f0 0x7f121c0b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44240/0 (socket says 172.21.15.60:44240) 2024-09-12T01:38:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f121affd640 1 -- 172.21.15.60:0/850229999 learned_addr learned my addr 172.21.15.60:0/850229999 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f121bfff640 1 --2- 172.21.15.60:0/850229999 >> v2:172.21.15.105:3300/0 conn(0x7f121c0b68f0 0x7f121c0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f121b7fe640 1 -- 172.21.15.60:0/850229999 >> v2:172.21.15.105:3300/0 conn(0x7f121c0b68f0 msgr2=0x7f121c0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f121b7fe640 1 --2- 172.21.15.60:0/850229999 >> v2:172.21.15.105:3300/0 conn(0x7f121c0b68f0 0x7f121c0d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f121b7fe640 1 -- 172.21.15.60:0/850229999 >> v1:172.21.15.60:6789/0 conn(0x7f121c0cf1f0 legacy=0x7f121c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.784+0000 7f121a7fc640 1 -- 172.21.15.60:0/850229999 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2463931865 0 0) 0x7f121c0cf860 con 0x7f121c0cf1f0 2024-09-12T01:38:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.785+0000 7f121b7fe640 1 -- 172.21.15.60:0/850229999 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121c0cfe20 con 0x7f121c15e7a0 2024-09-12T01:38:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.785+0000 7f121b7fe640 1 --2- 172.21.15.60:0/850229999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f121c15e7a0 0x7f121c06caa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f121c08d930 tx=0x7f120c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e5d52f128a1567 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.785+0000 7f121a7fc640 1 -- 172.21.15.60:0/850229999 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c037070 con 0x7f121c15e7a0 2024-09-12T01:38:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.785+0000 7f121a7fc640 1 -- 172.21.15.60:0/850229999 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120c032440 con 0x7f121c15e7a0 2024-09-12T01:38:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.785+0000 7f121a7fc640 1 -- 172.21.15.60:0/850229999 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120c02ae60 con 0x7f121c15e7a0 2024-09-12T01:38:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.786+0000 7f1221b4b640 1 -- 172.21.15.60:0/850229999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f121c15e7a0 msgr2=0x7f121c06caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.786+0000 7f1221b4b640 1 --2- 172.21.15.60:0/850229999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f121c15e7a0 0x7f121c06caa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f121c08d930 tx=0x7f120c02a110 comp rx=0 tx=0).stop 2024-09-12T01:38:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.786+0000 7f1221b4b640 1 -- 172.21.15.60:0/850229999 shutdown_connections 2024-09-12T01:38:01.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.786+0000 7f1221b4b640 1 --2- 172.21.15.60:0/850229999 >> v2:172.21.15.105:3300/0 conn(0x7f121c0b68f0 0x7f121c0d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.786+0000 7f1221b4b640 1 --2- 172.21.15.60:0/850229999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f121c15e7a0 0x7f121c06caa0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.786+0000 7f1221b4b640 1 -- 172.21.15.60:0/850229999 >> 172.21.15.60:0/850229999 conn(0x7f121c0d11e0 msgr2=0x7f121c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:01.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.786+0000 7f1221b4b640 1 -- 172.21.15.60:0/850229999 shutdown_connections 2024-09-12T01:38:01.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.786+0000 7f1221b4b640 1 -- 172.21.15.60:0/850229999 wait complete. 2024-09-12T01:38:01.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.787+0000 7f1221b4b640 1 Processor -- start 2024-09-12T01:38:01.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.787+0000 7f1221b4b640 1 -- start start 2024-09-12T01:38:01.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f1221b4b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f121c0b68f0 0x7f121c0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f1221b4b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121c0cf1f0 0x7f121c0c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f1221b4b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f121c15e7a0 0x7f121c0c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f1221b4b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f121c06cfe0 con 0x7f121c15e7a0 2024-09-12T01:38:01.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f1221b4b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f121c0b7a00 con 0x7f121c0b68f0 2024-09-12T01:38:01.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f1221b4b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f121c15eb80 con 0x7f121c0cf1f0 2024-09-12T01:38:01.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f121bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f121c15e7a0 0x7f121c0c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f121bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f121c15e7a0 0x7f121c0c9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43242/0 (socket says 172.21.15.60:43242) 2024-09-12T01:38:01.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f121bfff640 1 -- 172.21.15.60:0/1146390940 learned_addr learned my addr 172.21.15.60:0/1146390940 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:01.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f121affd640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121c0cf1f0 0x7f121c0c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f121bfff640 1 -- 172.21.15.60:0/1146390940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121c0cf1f0 msgr2=0x7f121c0c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f121b7fe640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f121c0b68f0 0x7f121c0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f121bfff640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121c0cf1f0 0x7f121c0c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f121bfff640 1 -- 172.21.15.60:0/1146390940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f121c0b68f0 msgr2=0x7f121c0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:01.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f121bfff640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f121c0b68f0 0x7f121c0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:01.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f121bfff640 1 -- 172.21.15.60:0/1146390940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121c15f6f0 con 0x7f121c15e7a0 2024-09-12T01:38:01.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f121affd640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121c0cf1f0 0x7f121c0c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:01.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.788+0000 7f121b7fe640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f121c0b68f0 0x7f121c0cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:01.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.789+0000 7f121bfff640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f121c15e7a0 0x7f121c0c9a90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1214007d40 tx=0x7f121400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:01.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.789+0000 7f1203fff640 1 -- 172.21.15.60:0/1146390940 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214014420 con 0x7f121c15e7a0 2024-09-12T01:38:01.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.789+0000 7f1203fff640 1 -- 172.21.15.60:0/1146390940 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1214019070 con 0x7f121c15e7a0 2024-09-12T01:38:01.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.789+0000 7f1221b4b640 1 -- 172.21.15.60:0/1146390940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121c0cd5c0 con 0x7f121c15e7a0 2024-09-12T01:38:01.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.789+0000 7f1203fff640 1 -- 172.21.15.60:0/1146390940 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1214014820 con 0x7f121c15e7a0 2024-09-12T01:38:01.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.789+0000 7f1221b4b640 1 -- 172.21.15.60:0/1146390940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f121c0c9fd0 con 0x7f121c15e7a0 2024-09-12T01:38:01.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.790+0000 7f1221b4b640 1 -- 172.21.15.60:0/1146390940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f121c0b93e0 con 0x7f121c15e7a0 2024-09-12T01:38:01.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.790+0000 7f1203fff640 1 -- 172.21.15.60:0/1146390940 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f12140149c0 con 0x7f121c15e7a0 2024-09-12T01:38:01.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.791+0000 7f1203fff640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f120806be30 0x7f120806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:01.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.791+0000 7f1203fff640 1 -- 172.21.15.60:0/1146390940 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5795+0+0 (secure 0 0 0) 0x7f121408b5f0 con 0x7f121c15e7a0 2024-09-12T01:38:01.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.791+0000 7f121b7fe640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f120806be30 0x7f120806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:01.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.791+0000 7f121b7fe640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f120806be30 0x7f120806e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f120c034000 tx=0x7f120c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:01.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:01.795+0000 7f1203fff640 1 -- 172.21.15.60:0/1146390940 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f121c0b93e0 con 0x7f121c15e7a0 2024-09-12T01:38:02.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.011+0000 7f1221b4b640 1 -- 172.21.15.60:0/1146390940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f121c06caa0 con 0x7f121c15e7a0 2024-09-12T01:38:02.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.665+0000 7f1203fff640 1 -- 172.21.15.60:0/1146390940 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f1214059fd0 con 0x7f121c15e7a0 2024-09-12T01:38:02.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.668+0000 7f1221b4b640 1 -- 172.21.15.60:0/1146390940 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f120806be30 msgr2=0x7f120806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.668+0000 7f1221b4b640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f120806be30 0x7f120806e2f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f120c034000 tx=0x7f120c02e000 comp rx=0 tx=0).stop 2024-09-12T01:38:02.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.668+0000 7f1221b4b640 1 -- 172.21.15.60:0/1146390940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f121c15e7a0 msgr2=0x7f121c0c9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.668+0000 7f1221b4b640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f121c15e7a0 0x7f121c0c9a90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1214007d40 tx=0x7f121400e4b0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.668+0000 7f1221b4b640 1 -- 172.21.15.60:0/1146390940 shutdown_connections 2024-09-12T01:38:02.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.668+0000 7f1221b4b640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f121c15e7a0 0x7f121c0c9a90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.668+0000 7f1221b4b640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f120806be30 0x7f120806e2f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.668+0000 7f1221b4b640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f121c0cf1f0 0x7f121c0c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.668+0000 7f1221b4b640 1 --2- 172.21.15.60:0/1146390940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f121c0b68f0 0x7f121c0cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.668+0000 7f1221b4b640 1 -- 172.21.15.60:0/1146390940 >> 172.21.15.60:0/1146390940 conn(0x7f121c0d11e0 msgr2=0x7f121c0b8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:02.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.668+0000 7f1221b4b640 1 -- 172.21.15.60:0/1146390940 shutdown_connections 2024-09-12T01:38:02.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.668+0000 7f1221b4b640 1 -- 172.21.15.60:0/1146390940 wait complete. 2024-09-12T01:38:02.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:38:02.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.797+0000 7f2f5560e640 1 Processor -- start 2024-09-12T01:38:02.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.797+0000 7f2f5560e640 1 -- start start 2024-09-12T01:38:02.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.798+0000 7f2f5560e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f5006fb10 0x7f2f500b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.798+0000 7f2f5560e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f500714a0 0x7f2f5015e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.798+0000 7f2f5560e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5015f020 con 0x7f2f5015e570 2024-09-12T01:38:02.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.798+0000 7f2f5560e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5015fc30 con 0x7f2f5006fb10 2024-09-12T01:38:02.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.798+0000 7f2f5560e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5015f300 con 0x7f2f500714a0 2024-09-12T01:38:02.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.798+0000 7f2f4e7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f5006fb10 0x7f2f500b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.798+0000 7f2f4e7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f5006fb10 0x7f2f500b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52702/0 (socket says 172.21.15.60:52702) 2024-09-12T01:38:02.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.798+0000 7f2f4e7fc640 1 -- 172.21.15.60:0/3698842905 learned_addr learned my addr 172.21.15.60:0/3698842905 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:02.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.798+0000 7f2f4f7fe640 1 --2- 172.21.15.60:0/3698842905 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f500714a0 0x7f2f5015e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.799+0000 7f2f4e7fc640 1 -- 172.21.15.60:0/3698842905 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f500714a0 msgr2=0x7f2f5015e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:02.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.799+0000 7f2f4e7fc640 1 --2- 172.21.15.60:0/3698842905 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f500714a0 0x7f2f5015e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.799+0000 7f2f4e7fc640 1 -- 172.21.15.60:0/3698842905 >> v1:172.21.15.105:6789/0 conn(0x7f2f5015e570 legacy=0x7f2f5006f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.799+0000 7f2f4e7fc640 1 -- 172.21.15.60:0/3698842905 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5015f5e0 con 0x7f2f5006fb10 2024-09-12T01:38:02.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.799+0000 7f2f4e7fc640 1 --2- 172.21.15.60:0/3698842905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5006fb10 0x7f2f500b5540 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009870 tx=0x7f2f3802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b341ff5016bc8230 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:02.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.800+0000 7f2f4dffb640 1 -- 172.21.15.60:0/3698842905 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38037070 con 0x7f2f5006fb10 2024-09-12T01:38:02.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.800+0000 7f2f4dffb640 1 -- 172.21.15.60:0/3698842905 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f38032440 con 0x7f2f5006fb10 2024-09-12T01:38:02.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.800+0000 7f2f4dffb640 1 -- 172.21.15.60:0/3698842905 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38032810 con 0x7f2f5006fb10 2024-09-12T01:38:02.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.800+0000 7f2f5560e640 1 -- 172.21.15.60:0/3698842905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5006fb10 msgr2=0x7f2f500b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.800+0000 7f2f5560e640 1 --2- 172.21.15.60:0/3698842905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5006fb10 0x7f2f500b5540 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009870 tx=0x7f2f3802a270 comp rx=0 tx=0).stop 2024-09-12T01:38:02.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.800+0000 7f2f5560e640 1 -- 172.21.15.60:0/3698842905 shutdown_connections 2024-09-12T01:38:02.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.800+0000 7f2f5560e640 1 --2- 172.21.15.60:0/3698842905 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f500714a0 0x7f2f5015e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.800+0000 7f2f5560e640 1 --2- 172.21.15.60:0/3698842905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5006fb10 0x7f2f500b5540 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.800+0000 7f2f5560e640 1 -- 172.21.15.60:0/3698842905 >> 172.21.15.60:0/3698842905 conn(0x7f2f500b4240 msgr2=0x7f2f500b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:02.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.800+0000 7f2f5560e640 1 -- 172.21.15.60:0/3698842905 shutdown_connections 2024-09-12T01:38:02.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.800+0000 7f2f5560e640 1 -- 172.21.15.60:0/3698842905 wait complete. 2024-09-12T01:38:02.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.802+0000 7f2f5560e640 1 Processor -- start 2024-09-12T01:38:02.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.802+0000 7f2f5560e640 1 -- start start 2024-09-12T01:38:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.802+0000 7f2f5560e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f5006fb10 0x7f2f5014c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.802+0000 7f2f5560e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f500714a0 0x7f2f500cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.802+0000 7f2f5560e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f5015e570 0x7f2f50156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.802+0000 7f2f5560e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5006d0e0 con 0x7f2f500714a0 2024-09-12T01:38:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.802+0000 7f2f5560e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5006cf60 con 0x7f2f5006fb10 2024-09-12T01:38:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.802+0000 7f2f5560e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5006d260 con 0x7f2f5015e570 2024-09-12T01:38:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f4e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f500714a0 0x7f2f500cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f4e7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f500714a0 0x7f2f500cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52706/0 (socket says 172.21.15.60:52706) 2024-09-12T01:38:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f4e7fc640 1 -- 172.21.15.60:0/3681907341 learned_addr learned my addr 172.21.15.60:0/3681907341 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f4f7fe640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f5015e570 0x7f2f50156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f4effd640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f5006fb10 0x7f2f5014c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f4e7fc640 1 -- 172.21.15.60:0/3681907341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f5015e570 msgr2=0x7f2f50156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f4e7fc640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f5015e570 0x7f2f50156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f4e7fc640 1 -- 172.21.15.60:0/3681907341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f5006fb10 msgr2=0x7f2f5014c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f4e7fc640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f5006fb10 0x7f2f5014c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f4e7fc640 1 -- 172.21.15.60:0/3681907341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f50155ba0 con 0x7f2f500714a0 2024-09-12T01:38:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f4e7fc640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f500714a0 0x7f2f500cdb30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2f38000c00 tx=0x7f2f380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f477fe640 1 -- 172.21.15.60:0/3681907341 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38037040 con 0x7f2f500714a0 2024-09-12T01:38:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f477fe640 1 -- 172.21.15.60:0/3681907341 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f38042070 con 0x7f2f500714a0 2024-09-12T01:38:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f477fe640 1 -- 172.21.15.60:0/3681907341 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f38030880 con 0x7f2f500714a0 2024-09-12T01:38:02.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f5560e640 1 -- 172.21.15.60:0/3681907341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f500cd2d0 con 0x7f2f500714a0 2024-09-12T01:38:02.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.803+0000 7f2f5560e640 1 -- 172.21.15.60:0/3681907341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f50155e40 con 0x7f2f500714a0 2024-09-12T01:38:02.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.804+0000 7f2f5560e640 1 -- 172.21.15.60:0/3681907341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f500b5540 con 0x7f2f500714a0 2024-09-12T01:38:02.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.805+0000 7f2f477fe640 1 -- 172.21.15.60:0/3681907341 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f38030a20 con 0x7f2f500714a0 2024-09-12T01:38:02.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.805+0000 7f2f477fe640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f3006be30 0x7f2f3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:02.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.805+0000 7f2f477fe640 1 -- 172.21.15.60:0/3681907341 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5795+0+0 (secure 0 0 0) 0x7f2f380ab540 con 0x7f2f500714a0 2024-09-12T01:38:02.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.805+0000 7f2f4effd640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f3006be30 0x7f2f3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:02.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.806+0000 7f2f4effd640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f3006be30 0x7f2f3006e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2f40001e70 tx=0x7f2f40009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:02.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.810+0000 7f2f477fe640 1 -- 172.21.15.60:0/3681907341 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f380798d0 con 0x7f2f500714a0 2024-09-12T01:38:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:02.985+0000 7f2f5560e640 1 -- 172.21.15.60:0/3681907341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2f500b1a30 con 0x7f2f500714a0 2024-09-12T01:38:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.666+0000 7f2f477fe640 1 -- 172.21.15.60:0/3681907341 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v48) ==== 181+0+0 (secure 0 0 0) 0x7f2f3807dbd0 con 0x7f2f500714a0 2024-09-12T01:38:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:38:03.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.670+0000 7f2f5560e640 1 -- 172.21.15.60:0/3681907341 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f3006be30 msgr2=0x7f2f3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:03.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.670+0000 7f2f5560e640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f3006be30 0x7f2f3006e2f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2f40001e70 tx=0x7f2f40009040 comp rx=0 tx=0).stop 2024-09-12T01:38:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.670+0000 7f2f5560e640 1 -- 172.21.15.60:0/3681907341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f500714a0 msgr2=0x7f2f500cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.670+0000 7f2f5560e640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f500714a0 0x7f2f500cdb30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2f38000c00 tx=0x7f2f380046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.670+0000 7f2f5560e640 1 -- 172.21.15.60:0/3681907341 shutdown_connections 2024-09-12T01:38:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.670+0000 7f2f5560e640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f3006be30 0x7f2f3006e2f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.670+0000 7f2f5560e640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f5015e570 0x7f2f50156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.670+0000 7f2f5560e640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f500714a0 0x7f2f500cdb30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.670+0000 7f2f5560e640 1 --2- 172.21.15.60:0/3681907341 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f5006fb10 0x7f2f5014c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.670+0000 7f2f5560e640 1 -- 172.21.15.60:0/3681907341 >> 172.21.15.60:0/3681907341 conn(0x7f2f500b4240 msgr2=0x7f2f5006f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.670+0000 7f2f5560e640 1 -- 172.21.15.60:0/3681907341 shutdown_connections 2024-09-12T01:38:03.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.670+0000 7f2f5560e640 1 -- 172.21.15.60:0/3681907341 wait complete. 2024-09-12T01:38:03.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:38:03.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.792+0000 7fe864152640 1 Processor -- start 2024-09-12T01:38:03.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.792+0000 7fe864152640 1 -- start start 2024-09-12T01:38:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.793+0000 7fe864152640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe85c15e970 0x7fe85c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.793+0000 7fe864152640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe85c0d1cd0 0x7fe85c0b6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.793+0000 7fe864152640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe85c162430 0x7fe85c1628c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.793+0000 7fe864152640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe85c0cf7c0 con 0x7fe85c15e970 2024-09-12T01:38:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.793+0000 7fe864152640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe85c0d2560 con 0x7fe85c0d1cd0 2024-09-12T01:38:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.793+0000 7fe864152640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe85c15ed50 con 0x7fe85c162430 2024-09-12T01:38:03.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.793+0000 7fe861eee640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe85c15e970 0x7fe85c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.793+0000 7fe861eee640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe85c15e970 0x7fe85c0b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52716/0 (socket says 172.21.15.60:52716) 2024-09-12T01:38:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.793+0000 7fe861eee640 1 -- 172.21.15.60:0/1435067109 learned_addr learned my addr 172.21.15.60:0/1435067109 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.793+0000 7fe8626ef640 1 --2- 172.21.15.60:0/1435067109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe85c162430 0x7fe85c1628c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.793+0000 7fe8616ed640 1 --2- 172.21.15.60:0/1435067109 >> v2:172.21.15.105:3300/0 conn(0x7fe85c0d1cd0 0x7fe85c0b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.794+0000 7fe861eee640 1 -- 172.21.15.60:0/1435067109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe85c162430 msgr2=0x7fe85c1628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.794+0000 7fe861eee640 1 --2- 172.21.15.60:0/1435067109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe85c162430 0x7fe85c1628c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.794+0000 7fe861eee640 1 -- 172.21.15.60:0/1435067109 >> v2:172.21.15.105:3300/0 conn(0x7fe85c0d1cd0 msgr2=0x7fe85c0b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.794+0000 7fe861eee640 1 --2- 172.21.15.60:0/1435067109 >> v2:172.21.15.105:3300/0 conn(0x7fe85c0d1cd0 0x7fe85c0b6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:03.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.794+0000 7fe861eee640 1 -- 172.21.15.60:0/1435067109 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c0cffd0 con 0x7fe85c15e970 2024-09-12T01:38:03.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.794+0000 7fe861eee640 1 --2- 172.21.15.60:0/1435067109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe85c15e970 0x7fe85c0b61e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0d0620 tx=0x7fe85802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64578b424d92b63f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:03.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.794+0000 7fe860eec640 1 -- 172.21.15.60:0/1435067109 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858037070 con 0x7fe85c15e970 2024-09-12T01:38:03.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.794+0000 7fe860eec640 1 -- 172.21.15.60:0/1435067109 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe858032440 con 0x7fe85c15e970 2024-09-12T01:38:03.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.794+0000 7fe860eec640 1 -- 172.21.15.60:0/1435067109 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858032810 con 0x7fe85c15e970 2024-09-12T01:38:03.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.795+0000 7fe864152640 1 -- 172.21.15.60:0/1435067109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe85c15e970 msgr2=0x7fe85c0b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:03.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.795+0000 7fe864152640 1 --2- 172.21.15.60:0/1435067109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe85c15e970 0x7fe85c0b61e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0d0620 tx=0x7fe85802a140 comp rx=0 tx=0).stop 2024-09-12T01:38:03.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.795+0000 7fe864152640 1 -- 172.21.15.60:0/1435067109 shutdown_connections 2024-09-12T01:38:03.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.795+0000 7fe864152640 1 --2- 172.21.15.60:0/1435067109 >> v2:172.21.15.105:3300/0 conn(0x7fe85c0d1cd0 0x7fe85c0b6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:03.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.795+0000 7fe864152640 1 --2- 172.21.15.60:0/1435067109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe85c162430 0x7fe85c1628c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:03.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.795+0000 7fe864152640 1 --2- 172.21.15.60:0/1435067109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe85c15e970 0x7fe85c0b61e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:03.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.795+0000 7fe864152640 1 -- 172.21.15.60:0/1435067109 >> 172.21.15.60:0/1435067109 conn(0x7fe85c0d11e0 msgr2=0x7fe85c0d15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:03.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.795+0000 7fe864152640 1 -- 172.21.15.60:0/1435067109 shutdown_connections 2024-09-12T01:38:03.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.795+0000 7fe864152640 1 -- 172.21.15.60:0/1435067109 wait complete. 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.796+0000 7fe864152640 1 Processor -- start 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.796+0000 7fe864152640 1 -- start start 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe864152640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe85c0d1cd0 0x7fe85c0cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe864152640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe85c15e970 0x7fe85c0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe864152640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe85c162430 0x7fe85c1ea400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe864152640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c06d9a0 con 0x7fe85c162430 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe864152640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c0cfcf0 con 0x7fe85c0d1cd0 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe864152640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe85c06db20 con 0x7fe85c15e970 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe8626ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe85c162430 0x7fe85c1ea400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe8626ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe85c162430 0x7fe85c1ea400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52728/0 (socket says 172.21.15.60:52728) 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe8626ef640 1 -- 172.21.15.60:0/1575840545 learned_addr learned my addr 172.21.15.60:0/1575840545 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe8616ed640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe85c15e970 0x7fe85c0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe861eee640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe85c0d1cd0 0x7fe85c0cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:03.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe8626ef640 1 -- 172.21.15.60:0/1575840545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe85c15e970 msgr2=0x7fe85c0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe8626ef640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe85c15e970 0x7fe85c0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe8626ef640 1 -- 172.21.15.60:0/1575840545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe85c0d1cd0 msgr2=0x7fe85c0cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.797+0000 7fe8626ef640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe85c0d1cd0 0x7fe85c0cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.798+0000 7fe8626ef640 1 -- 172.21.15.60:0/1575840545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c1594a0 con 0x7fe85c162430 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.798+0000 7fe8626ef640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe85c162430 0x7fe85c1ea400 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe85400efc0 tx=0x7fe85400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.798+0000 7fe8527fc640 1 -- 172.21.15.60:0/1575840545 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854018020 con 0x7fe85c162430 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.798+0000 7fe8527fc640 1 -- 172.21.15.60:0/1575840545 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe854014480 con 0x7fe85c162430 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.798+0000 7fe864152640 1 -- 172.21.15.60:0/1575840545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe85c159780 con 0x7fe85c162430 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.798+0000 7fe8527fc640 1 -- 172.21.15.60:0/1575840545 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854014870 con 0x7fe85c162430 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.798+0000 7fe864152640 1 -- 172.21.15.60:0/1575840545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe85c159d40 con 0x7fe85c162430 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.799+0000 7fe864152640 1 -- 172.21.15.60:0/1575840545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85c0b3920 con 0x7fe85c162430 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.799+0000 7fe8527fc640 1 -- 172.21.15.60:0/1575840545 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe854005d10 con 0x7fe85c162430 2024-09-12T01:38:03.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.800+0000 7fe8527fc640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84006be30 0x7fe84006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:03.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.800+0000 7fe861eee640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84006be30 0x7fe84006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:03.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.800+0000 7fe8527fc640 1 -- 172.21.15.60:0/1575840545 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5357+0+0 (secure 0 0 0) 0x7fe85408b8a0 con 0x7fe85c162430 2024-09-12T01:38:03.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.800+0000 7fe861eee640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84006be30 0x7fe84006e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe858034000 tx=0x7fe85802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:03.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.804+0000 7fe8527fc640 1 -- 172.21.15.60:0/1575840545 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe854022030 con 0x7fe85c162430 2024-09-12T01:38:03.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:03.977+0000 7fe864152640 1 -- 172.21.15.60:0/1575840545 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe85c0d0d30 con 0x7fe85c162430 2024-09-12T01:38:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.671+0000 7fe8527fc640 1 -- 172.21.15.60:0/1575840545 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v49) ==== 169+0+0 (secure 0 0 0) 0x7fe854010040 con 0x7fe85c162430 2024-09-12T01:38:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-12T01:38:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.675+0000 7fe864152640 1 -- 172.21.15.60:0/1575840545 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84006be30 msgr2=0x7fe84006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.675+0000 7fe864152640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84006be30 0x7fe84006e2f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe858034000 tx=0x7fe85802e000 comp rx=0 tx=0).stop 2024-09-12T01:38:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.675+0000 7fe864152640 1 -- 172.21.15.60:0/1575840545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe85c162430 msgr2=0x7fe85c1ea400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:04.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.675+0000 7fe864152640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe85c162430 0x7fe85c1ea400 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe85400efc0 tx=0x7fe85400c490 comp rx=0 tx=0).stop 2024-09-12T01:38:04.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.676+0000 7fe864152640 1 -- 172.21.15.60:0/1575840545 shutdown_connections 2024-09-12T01:38:04.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.676+0000 7fe864152640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe85c162430 0x7fe85c1ea400 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.676+0000 7fe864152640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84006be30 0x7fe84006e2f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.676+0000 7fe864152640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe85c15e970 0x7fe85c0cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.676+0000 7fe864152640 1 --2- 172.21.15.60:0/1575840545 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe85c0d1cd0 0x7fe85c0cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.676+0000 7fe864152640 1 -- 172.21.15.60:0/1575840545 >> 172.21.15.60:0/1575840545 conn(0x7fe85c0d11e0 msgr2=0x7fe85c0b8170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:04.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.676+0000 7fe864152640 1 -- 172.21.15.60:0/1575840545 shutdown_connections 2024-09-12T01:38:04.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.676+0000 7fe864152640 1 -- 172.21.15.60:0/1575840545 wait complete. 2024-09-12T01:38:04.696 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T01:38:04.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.806+0000 7feed17cf640 1 Processor -- start 2024-09-12T01:38:04.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.807+0000 7feed17cf640 1 -- start start 2024-09-12T01:38:04.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.807+0000 7feed17cf640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feecc15e7a0 0x7feecc06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:04.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.807+0000 7feed17cf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feecc0cf1f0 0x7feecc0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:04.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.807+0000 7feed17cf640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feecc0cf860 con 0x7feecc0b6720 2024-09-12T01:38:04.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.807+0000 7feed17cf640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7feecc0d2ca0 con 0x7feecc15e7a0 2024-09-12T01:38:04.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.807+0000 7feed17cf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feecc0cfb40 con 0x7feecc0cf1f0 2024-09-12T01:38:04.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.808+0000 7feeca7fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feecc0cf1f0 0x7feecc0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:04.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.808+0000 7feecaffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feecc15e7a0 0x7feecc06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:04.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.808+0000 7feecb7fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7feecc0b6720 0x7feecc1623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:34802/0 (socket says 172.21.15.60:34802) 2024-09-12T01:38:04.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.808+0000 7feecb7fe640 1 -- 172.21.15.60:0/2704995241 learned_addr learned my addr 172.21.15.60:0/2704995241 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:04.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.808+0000 7feecaffd640 1 -- 172.21.15.60:0/2704995241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feecc0cf1f0 msgr2=0x7feecc0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:04.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.808+0000 7feecaffd640 1 --2- 172.21.15.60:0/2704995241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feecc0cf1f0 0x7feecc0b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.808+0000 7feecaffd640 1 -- 172.21.15.60:0/2704995241 >> v1:172.21.15.105:6789/0 conn(0x7feecc0b6720 legacy=0x7feecc1623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:04.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.808+0000 7feecaffd640 1 -- 172.21.15.60:0/2704995241 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc0cfe20 con 0x7feecc15e7a0 2024-09-12T01:38:04.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.808+0000 7feeca7fc640 1 --2- 172.21.15.60:0/2704995241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feecc0cf1f0 0x7feecc0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:04.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.809+0000 7feecaffd640 1 --2- 172.21.15.60:0/2704995241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feecc15e7a0 0x7feecc06caa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feebc009d90 tx=0x7feebc02a4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63a54a49e2ccc433 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:04.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.809+0000 7feec9ffb640 1 -- 172.21.15.60:0/2704995241 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc007740 con 0x7feecc15e7a0 2024-09-12T01:38:04.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.809+0000 7feec9ffb640 1 -- 172.21.15.60:0/2704995241 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feebc0078e0 con 0x7feecc15e7a0 2024-09-12T01:38:04.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.809+0000 7feec9ffb640 1 -- 172.21.15.60:0/2704995241 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feebc007cb0 con 0x7feecc15e7a0 2024-09-12T01:38:04.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.810+0000 7feed17cf640 1 -- 172.21.15.60:0/2704995241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feecc15e7a0 msgr2=0x7feecc06caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:04.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.810+0000 7feed17cf640 1 --2- 172.21.15.60:0/2704995241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feecc15e7a0 0x7feecc06caa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feebc009d90 tx=0x7feebc02a4d0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.810+0000 7feed17cf640 1 -- 172.21.15.60:0/2704995241 shutdown_connections 2024-09-12T01:38:04.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.810+0000 7feed17cf640 1 --2- 172.21.15.60:0/2704995241 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feecc0cf1f0 0x7feecc0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.810+0000 7feed17cf640 1 --2- 172.21.15.60:0/2704995241 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feecc15e7a0 0x7feecc06caa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.810+0000 7feed17cf640 1 -- 172.21.15.60:0/2704995241 >> 172.21.15.60:0/2704995241 conn(0x7feecc0d11e0 msgr2=0x7feecc0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:04.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.810+0000 7feed17cf640 1 -- 172.21.15.60:0/2704995241 shutdown_connections 2024-09-12T01:38:04.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.810+0000 7feed17cf640 1 -- 172.21.15.60:0/2704995241 wait complete. 2024-09-12T01:38:04.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.811+0000 7feed17cf640 1 Processor -- start 2024-09-12T01:38:04.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.811+0000 7feed17cf640 1 -- start start 2024-09-12T01:38:04.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.812+0000 7feed17cf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feecc0b6720 0x7feecc14cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:04.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.812+0000 7feed17cf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feecc0cf1f0 0x7feecc15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:04.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.812+0000 7feed17cf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feecc15e7a0 0x7feecc15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:04.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.812+0000 7feed17cf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feecc06cfe0 con 0x7feecc0cf1f0 2024-09-12T01:38:04.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.812+0000 7feed17cf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feecc0b7a00 con 0x7feecc0b6720 2024-09-12T01:38:04.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.812+0000 7feed17cf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feecc0d4420 con 0x7feecc15e7a0 2024-09-12T01:38:04.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.812+0000 7feeca7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feecc0cf1f0 0x7feecc15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:04.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.812+0000 7feeca7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feecc0cf1f0 0x7feecc15c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52736/0 (socket says 172.21.15.60:52736) 2024-09-12T01:38:04.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.812+0000 7feeca7fc640 1 -- 172.21.15.60:0/740926083 learned_addr learned my addr 172.21.15.60:0/740926083 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:04.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.812+0000 7feecaffd640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feecc0b6720 0x7feecc14cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:04.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.812+0000 7feecb7fe640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feecc15e7a0 0x7feecc15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:04.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.813+0000 7feeca7fc640 1 -- 172.21.15.60:0/740926083 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feecc15e7a0 msgr2=0x7feecc15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:04.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.813+0000 7feeca7fc640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feecc15e7a0 0x7feecc15cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.813+0000 7feeca7fc640 1 -- 172.21.15.60:0/740926083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feecc0b6720 msgr2=0x7feecc14cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:04.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.813+0000 7feeca7fc640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feecc0b6720 0x7feecc14cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:04.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.813+0000 7feeca7fc640 1 -- 172.21.15.60:0/740926083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc14d050 con 0x7feecc0cf1f0 2024-09-12T01:38:04.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.813+0000 7feeca7fc640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feecc0cf1f0 0x7feecc15c730 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7feeb400ebb0 tx=0x7feeb400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:04.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.813+0000 7feec37fe640 1 -- 172.21.15.60:0/740926083 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4017070 con 0x7feecc0cf1f0 2024-09-12T01:38:04.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.813+0000 7feec37fe640 1 -- 172.21.15.60:0/740926083 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb400cc30 con 0x7feecc0cf1f0 2024-09-12T01:38:04.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.813+0000 7feec37fe640 1 -- 172.21.15.60:0/740926083 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb4013470 con 0x7feecc0cf1f0 2024-09-12T01:38:04.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.813+0000 7feed17cf640 1 -- 172.21.15.60:0/740926083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feecc1627c0 con 0x7feecc0cf1f0 2024-09-12T01:38:04.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.813+0000 7feed17cf640 1 -- 172.21.15.60:0/740926083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feecc162d80 con 0x7feecc0cf1f0 2024-09-12T01:38:04.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.814+0000 7feed17cf640 1 -- 172.21.15.60:0/740926083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feecc15eb80 con 0x7feecc0cf1f0 2024-09-12T01:38:04.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.815+0000 7feec37fe640 1 -- 172.21.15.60:0/740926083 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feeb401a070 con 0x7feecc0cf1f0 2024-09-12T01:38:04.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.815+0000 7feec37fe640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feeac06be60 0x7feeac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:04.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.815+0000 7feec37fe640 1 -- 172.21.15.60:0/740926083 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7feeb408a950 con 0x7feecc0cf1f0 2024-09-12T01:38:04.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.815+0000 7feecaffd640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feeac06be60 0x7feeac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:04.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.816+0000 7feecaffd640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feeac06be60 0x7feeac06e320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feebc034000 tx=0x7feebc02f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:04.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.820+0000 7feec37fe640 1 -- 172.21.15.60:0/740926083 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feeb4059040 con 0x7feecc0cf1f0 2024-09-12T01:38:04.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.995+0000 7feed17cf640 1 -- 172.21.15.60:0/740926083 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7feecc06cda0 con 0x7feecc0cf1f0 2024-09-12T01:38:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:04.998+0000 7feec37fe640 1 -- 172.21.15.60:0/740926083 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7feeb405d340 con 0x7feecc0cf1f0 2024-09-12T01:38:05.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.000+0000 7feed17cf640 1 -- 172.21.15.60:0/740926083 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feeac06be60 msgr2=0x7feeac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.000+0000 7feed17cf640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feeac06be60 0x7feeac06e320 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7feebc034000 tx=0x7feebc02f000 comp rx=0 tx=0).stop 2024-09-12T01:38:05.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.000+0000 7feed17cf640 1 -- 172.21.15.60:0/740926083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feecc0cf1f0 msgr2=0x7feecc15c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.000+0000 7feed17cf640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feecc0cf1f0 0x7feecc15c730 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7feeb400ebb0 tx=0x7feeb400c520 comp rx=0 tx=0).stop 2024-09-12T01:38:05.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.000+0000 7feed17cf640 1 -- 172.21.15.60:0/740926083 shutdown_connections 2024-09-12T01:38:05.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.000+0000 7feed17cf640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feeac06be60 0x7feeac06e320 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.000+0000 7feed17cf640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feecc15e7a0 0x7feecc15cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.000+0000 7feed17cf640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feecc0cf1f0 0x7feecc15c730 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.000+0000 7feed17cf640 1 --2- 172.21.15.60:0/740926083 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feecc0b6720 0x7feecc14cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.000+0000 7feed17cf640 1 -- 172.21.15.60:0/740926083 >> 172.21.15.60:0/740926083 conn(0x7feecc0d11e0 msgr2=0x7feecc158a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:05.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.000+0000 7feed17cf640 1 -- 172.21.15.60:0/740926083 shutdown_connections 2024-09-12T01:38:05.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.001+0000 7feed17cf640 1 -- 172.21.15.60:0/740926083 wait complete. 2024-09-12T01:38:05.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid' 2024-09-12T01:38:05.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.114+0000 7ff71602e640 1 Processor -- start 2024-09-12T01:38:05.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.114+0000 7ff71602e640 1 -- start start 2024-09-12T01:38:05.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.115+0000 7ff71602e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff71015e7a0 0x7ff7100ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.115+0000 7ff71602e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff7100d3fe0 0x7ff7100d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.115+0000 7ff71602e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7100d2cc0 con 0x7ff7100cf2f0 2024-09-12T01:38:05.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.115+0000 7ff71602e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff7100d4400 con 0x7ff7100d3fe0 2024-09-12T01:38:05.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.115+0000 7ff71602e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff7100d2f40 con 0x7ff71015e7a0 2024-09-12T01:38:05.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.115+0000 7ff70f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff71015e7a0 0x7ff7100ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.115+0000 7ff70effd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff7100d3fe0 0x7ff7100d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.115+0000 7ff70effd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff7100d3fe0 0x7ff7100d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:57990/0 (socket says 172.21.15.60:57990) 2024-09-12T01:38:05.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.115+0000 7ff70f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff71015e7a0 0x7ff7100ba240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:56800/0 (socket says 172.21.15.60:56800) 2024-09-12T01:38:05.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.115+0000 7ff70effd640 1 -- 172.21.15.60:0/2868220701 learned_addr learned my addr 172.21.15.60:0/2868220701 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:05.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.115+0000 7ff70ffff640 1 --1- 172.21.15.60:0/2868220701 >> v1:172.21.15.105:6789/0 conn(0x7ff7100cf2f0 0x7ff7100b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:34816/0 (socket says 172.21.15.60:34816) 2024-09-12T01:38:05.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.116+0000 7ff70f7fe640 1 -- 172.21.15.60:0/2868220701 >> v2:172.21.15.105:3300/0 conn(0x7ff7100d3fe0 msgr2=0x7ff7100d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:05.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.116+0000 7ff70f7fe640 1 --2- 172.21.15.60:0/2868220701 >> v2:172.21.15.105:3300/0 conn(0x7ff7100d3fe0 0x7ff7100d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.116+0000 7ff70f7fe640 1 -- 172.21.15.60:0/2868220701 >> v1:172.21.15.105:6789/0 conn(0x7ff7100cf2f0 legacy=0x7ff7100b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.116+0000 7ff70f7fe640 1 -- 172.21.15.60:0/2868220701 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7100d3220 con 0x7ff71015e7a0 2024-09-12T01:38:05.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.116+0000 7ff70effd640 1 --2- 172.21.15.60:0/2868220701 >> v2:172.21.15.105:3300/0 conn(0x7ff7100d3fe0 0x7ff7100d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.117+0000 7ff70f7fe640 1 --2- 172.21.15.60:0/2868220701 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff71015e7a0 0x7ff7100ba240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff7000097a0 tx=0x7ff70002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c40a0589cbdfe7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.117+0000 7ff70e7fc640 1 -- 172.21.15.60:0/2868220701 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700037070 con 0x7ff71015e7a0 2024-09-12T01:38:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.117+0000 7ff70e7fc640 1 -- 172.21.15.60:0/2868220701 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff700032440 con 0x7ff71015e7a0 2024-09-12T01:38:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.117+0000 7ff70e7fc640 1 -- 172.21.15.60:0/2868220701 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff700032810 con 0x7ff71015e7a0 2024-09-12T01:38:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.117+0000 7ff71602e640 1 -- 172.21.15.60:0/2868220701 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff71015e7a0 msgr2=0x7ff7100ba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.117+0000 7ff71602e640 1 --2- 172.21.15.60:0/2868220701 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff71015e7a0 0x7ff7100ba240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff7000097a0 tx=0x7ff70002a210 comp rx=0 tx=0).stop 2024-09-12T01:38:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.117+0000 7ff71602e640 1 -- 172.21.15.60:0/2868220701 shutdown_connections 2024-09-12T01:38:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.117+0000 7ff71602e640 1 --2- 172.21.15.60:0/2868220701 >> v2:172.21.15.105:3300/0 conn(0x7ff7100d3fe0 0x7ff7100d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.117+0000 7ff71602e640 1 --2- 172.21.15.60:0/2868220701 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff71015e7a0 0x7ff7100ba240 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.117+0000 7ff71602e640 1 -- 172.21.15.60:0/2868220701 >> 172.21.15.60:0/2868220701 conn(0x7ff7100d1550 msgr2=0x7ff7100d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:05.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.117+0000 7ff71602e640 1 -- 172.21.15.60:0/2868220701 shutdown_connections 2024-09-12T01:38:05.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.117+0000 7ff71602e640 1 -- 172.21.15.60:0/2868220701 wait complete. 2024-09-12T01:38:05.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.119+0000 7ff71602e640 1 Processor -- start 2024-09-12T01:38:05.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.119+0000 7ff71602e640 1 -- start start 2024-09-12T01:38:05.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff71602e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7100cf2f0 0x7ff710157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff71602e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7100d3fe0 0x7ff710160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff71602e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71015e7a0 0x7ff71015c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff71602e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff7100d3ac0 con 0x7ff71015e7a0 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff71602e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7100d37e0 con 0x7ff7100d3fe0 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff71602e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff71015eb80 con 0x7ff7100cf2f0 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff70ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71015e7a0 0x7ff71015c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff70ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71015e7a0 0x7ff71015c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52750/0 (socket says 172.21.15.60:52750) 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff70ffff640 1 -- 172.21.15.60:0/3374747427 learned_addr learned my addr 172.21.15.60:0/3374747427 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff70effd640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7100d3fe0 0x7ff710160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff70f7fe640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7100cf2f0 0x7ff710157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff70ffff640 1 -- 172.21.15.60:0/3374747427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7100cf2f0 msgr2=0x7ff710157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff70ffff640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7100cf2f0 0x7ff710157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff70ffff640 1 -- 172.21.15.60:0/3374747427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7100d3fe0 msgr2=0x7ff710160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff70ffff640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7100d3fe0 0x7ff710160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff70ffff640 1 -- 172.21.15.60:0/3374747427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff710161310 con 0x7ff71015e7a0 2024-09-12T01:38:05.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff70ffff640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71015e7a0 0x7ff71015c990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff70800c780 tx=0x7ff70800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:05.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.120+0000 7ff6f7fff640 1 -- 172.21.15.60:0/3374747427 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff708017070 con 0x7ff71015e7a0 2024-09-12T01:38:05.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.121+0000 7ff6f7fff640 1 -- 172.21.15.60:0/3374747427 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff70800a640 con 0x7ff71015e7a0 2024-09-12T01:38:05.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.121+0000 7ff71602e640 1 -- 172.21.15.60:0/3374747427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7101615f0 con 0x7ff71015e7a0 2024-09-12T01:38:05.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.121+0000 7ff6f7fff640 1 -- 172.21.15.60:0/3374747427 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70800aa30 con 0x7ff71015e7a0 2024-09-12T01:38:05.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.121+0000 7ff71602e640 1 -- 172.21.15.60:0/3374747427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff71015f0d0 con 0x7ff71015e7a0 2024-09-12T01:38:05.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.121+0000 7ff71602e640 1 -- 172.21.15.60:0/3374747427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff710161b10 con 0x7ff71015e7a0 2024-09-12T01:38:05.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.122+0000 7ff6f7fff640 1 -- 172.21.15.60:0/3374747427 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff70801a070 con 0x7ff71015e7a0 2024-09-12T01:38:05.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.122+0000 7ff6f7fff640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6fc06be60 0x7ff6fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.123+0000 7ff70f7fe640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6fc06be60 0x7ff6fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.123+0000 7ff6f7fff640 1 -- 172.21.15.60:0/3374747427 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7ff70808a030 con 0x7ff71015e7a0 2024-09-12T01:38:05.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.123+0000 7ff70f7fe640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6fc06be60 0x7ff6fc06e320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff700034000 tx=0x7ff70002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:05.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.127+0000 7ff6f7fff640 1 -- 172.21.15.60:0/3374747427 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff710161b10 con 0x7ff71015e7a0 2024-09-12T01:38:05.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.368+0000 7ff71602e640 1 -- 172.21.15.60:0/3374747427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]} v 0) -- 0x7ff7100d2780 con 0x7ff71015e7a0 2024-09-12T01:38:05.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.673+0000 7ff6f7fff640 1 -- 172.21.15.60:0/3374747427 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_blocklisted_oldest_tid"]}]=0 v129) ==== 162+0+0 (secure 0 0 0) 0x7ff7100d2cc0 con 0x7ff71015e7a0 2024-09-12T01:38:05.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.677+0000 7ff71602e640 1 -- 172.21.15.60:0/3374747427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6fc06be60 msgr2=0x7ff6fc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.677+0000 7ff71602e640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6fc06be60 0x7ff6fc06e320 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff700034000 tx=0x7ff70002e000 comp rx=0 tx=0).stop 2024-09-12T01:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.677+0000 7ff71602e640 1 -- 172.21.15.60:0/3374747427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71015e7a0 msgr2=0x7ff71015c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.677+0000 7ff71602e640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71015e7a0 0x7ff71015c990 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff70800c780 tx=0x7ff70800cc40 comp rx=0 tx=0).stop 2024-09-12T01:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.677+0000 7ff71602e640 1 -- 172.21.15.60:0/3374747427 shutdown_connections 2024-09-12T01:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.677+0000 7ff71602e640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff71015e7a0 0x7ff71015c990 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.677+0000 7ff71602e640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff7100d3fe0 0x7ff710160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.677+0000 7ff71602e640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6fc06be60 0x7ff6fc06e320 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.677+0000 7ff71602e640 1 --2- 172.21.15.60:0/3374747427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7100cf2f0 0x7ff710157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.677+0000 7ff71602e640 1 -- 172.21.15.60:0/3374747427 >> 172.21.15.60:0/3374747427 conn(0x7ff7100d1550 msgr2=0x7ff71006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.677+0000 7ff71602e640 1 -- 172.21.15.60:0/3374747427 shutdown_connections 2024-09-12T01:38:05.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.678+0000 7ff71602e640 1 -- 172.21.15.60:0/3374747427 wait complete. 2024-09-12T01:38:05.689 INFO:tasks.cephfs_test_runner:that a client is blocklisted when its encoded session metadata exceeds the ... skipped 'Require FUSE client to inject client release failure' 2024-09-12T01:38:05.689 INFO:tasks.cephfs_test_runner:Starting test: test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-12T01:38:05.690 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.793+0000 7fa4cc0e6640 1 Processor -- start 2024-09-12T01:38:05.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.793+0000 7fa4cc0e6640 1 -- start start 2024-09-12T01:38:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4cc0e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa4c415c670 0x7fa4c4073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4cc0e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4c40b1990 0x7fa4c40d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4cc0e6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c4071750 con 0x7fa4c4073080 2024-09-12T01:38:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4cc0e6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa4c40d0c60 con 0x7fa4c415c670 2024-09-12T01:38:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4cc0e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c40d0370 con 0x7fa4c40b1990 2024-09-12T01:38:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4c9681640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa4c415c670 0x7fa4c4073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4c9e82640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa4c4073080 0x7fa4c40b5460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40210/0 (socket says 172.21.15.60:40210) 2024-09-12T01:38:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4c9e82640 1 -- 172.21.15.60:0/2011438007 learned_addr learned my addr 172.21.15.60:0/2011438007 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4c9681640 1 -- 172.21.15.60:0/2011438007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4c40b1990 msgr2=0x7fa4c40d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4c9681640 1 --2- 172.21.15.60:0/2011438007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4c40b1990 0x7fa4c40d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4c9681640 1 -- 172.21.15.60:0/2011438007 >> v1:172.21.15.60:6789/0 conn(0x7fa4c4073080 legacy=0x7fa4c40b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4c9681640 1 -- 172.21.15.60:0/2011438007 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c40739a0 con 0x7fa4c415c670 2024-09-12T01:38:05.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.794+0000 7fa4c8e80640 1 -- 172.21.15.60:0/2011438007 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615260108 0 0) 0x7fa4c4071750 con 0x7fa4c4073080 2024-09-12T01:38:05.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.795+0000 7fa4c9681640 1 --2- 172.21.15.60:0/2011438007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4c415c670 0x7fa4c4073460 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40097a0 tx=0x7fa4b402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3037569e418a7fd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:05.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.795+0000 7fa4c8e80640 1 -- 172.21.15.60:0/2011438007 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4037070 con 0x7fa4c415c670 2024-09-12T01:38:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.795+0000 7fa4c8e80640 1 -- 172.21.15.60:0/2011438007 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b4032440 con 0x7fa4c415c670 2024-09-12T01:38:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.795+0000 7fa4c8e80640 1 -- 172.21.15.60:0/2011438007 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4032810 con 0x7fa4c415c670 2024-09-12T01:38:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.796+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/2011438007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4c415c670 msgr2=0x7fa4c4073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.796+0000 7fa4cc0e6640 1 --2- 172.21.15.60:0/2011438007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4c415c670 0x7fa4c4073460 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40097a0 tx=0x7fa4b402a180 comp rx=0 tx=0).stop 2024-09-12T01:38:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.796+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/2011438007 shutdown_connections 2024-09-12T01:38:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.796+0000 7fa4cc0e6640 1 --2- 172.21.15.60:0/2011438007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4c40b1990 0x7fa4c40d10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.796+0000 7fa4cc0e6640 1 --2- 172.21.15.60:0/2011438007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4c415c670 0x7fa4c4073460 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.796+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/2011438007 >> 172.21.15.60:0/2011438007 conn(0x7fa4c40d24d0 msgr2=0x7fa4c40d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.796+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/2011438007 shutdown_connections 2024-09-12T01:38:05.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.796+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/2011438007 wait complete. 2024-09-12T01:38:05.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.797+0000 7fa4cc0e6640 1 Processor -- start 2024-09-12T01:38:05.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.797+0000 7fa4cc0e6640 1 -- start start 2024-09-12T01:38:05.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4cc0e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4c4073080 0x7fa4c415e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4cc0e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4c40b1990 0x7fa4c415a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4cc0e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c415c670 0x7fa4c41405f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4cc0e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c40d0610 con 0x7fa4c40b1990 2024-09-12T01:38:05.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4cc0e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c4071470 con 0x7fa4c415c670 2024-09-12T01:38:05.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4cc0e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4c40d08f0 con 0x7fa4c4073080 2024-09-12T01:38:05.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4c9681640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4c40b1990 0x7fa4c415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4c9681640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4c40b1990 0x7fa4c415a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52766/0 (socket says 172.21.15.60:52766) 2024-09-12T01:38:05.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4c9681640 1 -- 172.21.15.60:0/1714802811 learned_addr learned my addr 172.21.15.60:0/1714802811 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:05.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4c9e82640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4c4073080 0x7fa4c415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4ca683640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c415c670 0x7fa4c41405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4c9681640 1 -- 172.21.15.60:0/1714802811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4c4073080 msgr2=0x7fa4c415e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4c9681640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4c4073080 0x7fa4c415e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4c9681640 1 -- 172.21.15.60:0/1714802811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c415c670 msgr2=0x7fa4c41405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4c9681640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c415c670 0x7fa4c41405f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4c9681640 1 -- 172.21.15.60:0/1714802811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c415bb90 con 0x7fa4c40b1990 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4ca683640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c415c670 0x7fa4c41405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4c9681640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4c40b1990 0x7fa4c415a610 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40098c0 tx=0x7fa4b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.798+0000 7fa4ba7fc640 1 -- 172.21.15.60:0/1714802811 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4042020 con 0x7fa4c40b1990 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.799+0000 7fa4ba7fc640 1 -- 172.21.15.60:0/1714802811 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4b4030970 con 0x7fa4c40b1990 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.799+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/1714802811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c415b070 con 0x7fa4c40b1990 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.799+0000 7fa4ba7fc640 1 -- 172.21.15.60:0/1714802811 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b4037040 con 0x7fa4c40b1990 2024-09-12T01:38:05.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.799+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/1714802811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c415b8b0 con 0x7fa4c40b1990 2024-09-12T01:38:05.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.799+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/1714802811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c40d1f00 con 0x7fa4c40b1990 2024-09-12T01:38:05.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.800+0000 7fa4ba7fc640 1 -- 172.21.15.60:0/1714802811 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4b4045020 con 0x7fa4c40b1990 2024-09-12T01:38:05.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.800+0000 7fa4ba7fc640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa4a806be30 0x7fa4a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:05.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.801+0000 7fa4ba7fc640 1 -- 172.21.15.60:0/1714802811 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7fa4b40ab800 con 0x7fa4c40b1990 2024-09-12T01:38:05.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.801+0000 7fa4c9e82640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa4a806be30 0x7fa4a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:05.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.801+0000 7fa4c9e82640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa4a806be30 0x7fa4a806e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0000f60 tx=0x7fa4c0007c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:05.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.805+0000 7fa4ba7fc640 1 -- 172.21.15.60:0/1714802811 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4b404c030 con 0x7fa4c40b1990 2024-09-12T01:38:05.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.983+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/1714802811 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4c40d3050 con 0x7fa4c40b1990 2024-09-12T01:38:05.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.984+0000 7fa4ba7fc640 1 -- 172.21.15.60:0/1714802811 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) ==== 74+0+12998 (secure 0 0 0) 0x7fa4c415b070 con 0x7fa4c40b1990 2024-09-12T01:38:05.983 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:05.983 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":49,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:38:04.667688+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6834/2704792080":"2024-09-13T01:38:01.662803+0000","172.21.15.105:6832/2704792080":"2024-09-13T01:38:01.662803+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.986+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/1714802811 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa4a806be30 msgr2=0x7fa4a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.986+0000 7fa4cc0e6640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa4a806be30 0x7fa4a806e2f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0000f60 tx=0x7fa4c0007c00 comp rx=0 tx=0).stop 2024-09-12T01:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.986+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/1714802811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4c40b1990 msgr2=0x7fa4c415a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.986+0000 7fa4cc0e6640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4c40b1990 0x7fa4c415a610 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40098c0 tx=0x7fa4b40046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.986+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/1714802811 shutdown_connections 2024-09-12T01:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.986+0000 7fa4cc0e6640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4c415c670 0x7fa4c41405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.986+0000 7fa4cc0e6640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4c40b1990 0x7fa4c415a610 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.986+0000 7fa4cc0e6640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa4a806be30 0x7fa4a806e2f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.986+0000 7fa4cc0e6640 1 --2- 172.21.15.60:0/1714802811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4c4073080 0x7fa4c415e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.986+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/1714802811 >> 172.21.15.60:0/1714802811 conn(0x7fa4c40d24d0 msgr2=0x7fa4c41576e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:05.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.986+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/1714802811 shutdown_connections 2024-09-12T01:38:05.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:05.986+0000 7fa4cc0e6640 1 -- 172.21.15.60:0/1714802811 wait complete. 2024-09-12T01:38:05.997 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:35:46.304939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:38:05.997 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:38:06.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.103+0000 7f474c703640 1 Processor -- start 2024-09-12T01:38:06.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.103+0000 7f474c703640 1 -- start start 2024-09-12T01:38:06.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f474c703640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f474415e600 0x7f47440d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f474c703640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47440d1a40 0x7f47440cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f474c703640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47440b7ad0 con 0x7f47440cf2f0 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f474c703640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f47440d1e90 con 0x7f47440d1a40 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f474c703640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f47440d2ee0 con 0x7f474415e600 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f4749c9e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47440d1a40 0x7f47440cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f4749c9e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47440d1a40 0x7f47440cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52780/0 (socket says 172.21.15.60:52780) 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f4749c9e640 1 -- 172.21.15.60:0/3637847156 learned_addr learned my addr 172.21.15.60:0/3637847156 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f4749c9e640 1 -- 172.21.15.60:0/3637847156 >> v2:172.21.15.105:3300/0 conn(0x7f474415e600 msgr2=0x7f47440d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f474a49f640 1 --2- 172.21.15.60:0/3637847156 >> v2:172.21.15.105:3300/0 conn(0x7f474415e600 0x7f47440d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f4749c9e640 1 --2- 172.21.15.60:0/3637847156 >> v2:172.21.15.105:3300/0 conn(0x7f474415e600 0x7f47440d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f4749c9e640 1 -- 172.21.15.60:0/3637847156 >> v1:172.21.15.105:6789/0 conn(0x7f47440cf2f0 legacy=0x7f47440b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f4749c9e640 1 -- 172.21.15.60:0/3637847156 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47440cf9e0 con 0x7f47440d1a40 2024-09-12T01:38:06.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.104+0000 7f474a49f640 1 --2- 172.21.15.60:0/3637847156 >> v2:172.21.15.105:3300/0 conn(0x7f474415e600 0x7f47440d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.105+0000 7f4749c9e640 1 --2- 172.21.15.60:0/3637847156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440d1a40 0x7f47440cedb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f474408d1e0 tx=0x7f473402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a7674dee42d676 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.105+0000 7f474949d640 1 -- 172.21.15.60:0/3637847156 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734037070 con 0x7f47440d1a40 2024-09-12T01:38:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.105+0000 7f474949d640 1 -- 172.21.15.60:0/3637847156 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4734032440 con 0x7f47440d1a40 2024-09-12T01:38:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.105+0000 7f474949d640 1 -- 172.21.15.60:0/3637847156 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734032810 con 0x7f47440d1a40 2024-09-12T01:38:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.105+0000 7f474c703640 1 -- 172.21.15.60:0/3637847156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440d1a40 msgr2=0x7f47440cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.105+0000 7f474c703640 1 --2- 172.21.15.60:0/3637847156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440d1a40 0x7f47440cedb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f474408d1e0 tx=0x7f473402a230 comp rx=0 tx=0).stop 2024-09-12T01:38:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.106+0000 7f474c703640 1 -- 172.21.15.60:0/3637847156 shutdown_connections 2024-09-12T01:38:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.106+0000 7f474c703640 1 --2- 172.21.15.60:0/3637847156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47440d1a40 0x7f47440cedb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.106+0000 7f474c703640 1 --2- 172.21.15.60:0/3637847156 >> v2:172.21.15.105:3300/0 conn(0x7f474415e600 0x7f47440d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.106+0000 7f474c703640 1 -- 172.21.15.60:0/3637847156 >> 172.21.15.60:0/3637847156 conn(0x7f474406c2c0 msgr2=0x7f474406c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:06.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.106+0000 7f474c703640 1 -- 172.21.15.60:0/3637847156 shutdown_connections 2024-09-12T01:38:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.106+0000 7f474c703640 1 -- 172.21.15.60:0/3637847156 wait complete. 2024-09-12T01:38:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.107+0000 7f474c703640 1 Processor -- start 2024-09-12T01:38:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.107+0000 7f474c703640 1 -- start start 2024-09-12T01:38:06.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474c703640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47440cf2f0 0x7f4744153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474c703640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47440d1a40 0x7f474415a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474c703640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f474415e600 0x7f47440c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474c703640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47440cffa0 con 0x7f474415e600 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474c703640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47440cf780 con 0x7f47440cf2f0 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474c703640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47440d2b70 con 0x7f47440d1a40 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474aca0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f474415e600 0x7f47440c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474aca0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f474415e600 0x7f47440c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52786/0 (socket says 172.21.15.60:52786) 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474aca0640 1 -- 172.21.15.60:0/2874195205 learned_addr learned my addr 172.21.15.60:0/2874195205 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474a49f640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47440cf2f0 0x7f4744153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f4749c9e640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47440d1a40 0x7f474415a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474aca0640 1 -- 172.21.15.60:0/2874195205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47440d1a40 msgr2=0x7f474415a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474aca0640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47440d1a40 0x7f474415a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474aca0640 1 -- 172.21.15.60:0/2874195205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47440cf2f0 msgr2=0x7f4744153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474aca0640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47440cf2f0 0x7f4744153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474aca0640 1 -- 172.21.15.60:0/2874195205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47440cb8d0 con 0x7f474415e600 2024-09-12T01:38:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474aca0640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f474415e600 0x7f47440c9ec0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f473c00c780 tx=0x7f473c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f473affd640 1 -- 172.21.15.60:0/2874195205 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c017070 con 0x7f474415e600 2024-09-12T01:38:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f473affd640 1 -- 172.21.15.60:0/2874195205 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f473c003da0 con 0x7f474415e600 2024-09-12T01:38:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474c703640 1 -- 172.21.15.60:0/2874195205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47441616a0 con 0x7f474415e600 2024-09-12T01:38:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f473affd640 1 -- 172.21.15.60:0/2874195205 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473c0052b0 con 0x7f474415e600 2024-09-12T01:38:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.108+0000 7f474c703640 1 -- 172.21.15.60:0/2874195205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4744161980 con 0x7f474415e600 2024-09-12T01:38:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.109+0000 7f474c703640 1 -- 172.21.15.60:0/2874195205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47440d1800 con 0x7f474415e600 2024-09-12T01:38:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.110+0000 7f473affd640 1 -- 172.21.15.60:0/2874195205 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f473c01a070 con 0x7f474415e600 2024-09-12T01:38:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.110+0000 7f473affd640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f472806be30 0x7f472806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.110+0000 7f473affd640 1 -- 172.21.15.60:0/2874195205 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f473c08a070 con 0x7f474415e600 2024-09-12T01:38:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.110+0000 7f474a49f640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f472806be30 0x7f472806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.111+0000 7f474a49f640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f472806be30 0x7f472806e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f474000aac0 tx=0x7f4740008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:06.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.115+0000 7f473affd640 1 -- 172.21.15.60:0/2874195205 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47440d1800 con 0x7f474415e600 2024-09-12T01:38:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.289+0000 7f474c703640 1 -- 172.21.15.60:0/2874195205 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f47440d5620 con 0x7f474415e600 2024-09-12T01:38:06.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.290+0000 7f473affd640 1 -- 172.21.15.60:0/2874195205 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) ==== 93+0+10 (secure 0 0 0) 0x7f47440d5620 con 0x7f474415e600 2024-09-12T01:38:06.289 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-12T01:38:06.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.292+0000 7f474c703640 1 -- 172.21.15.60:0/2874195205 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f472806be30 msgr2=0x7f472806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.292+0000 7f474c703640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f472806be30 0x7f472806e2f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f474000aac0 tx=0x7f4740008040 comp rx=0 tx=0).stop 2024-09-12T01:38:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.292+0000 7f474c703640 1 -- 172.21.15.60:0/2874195205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f474415e600 msgr2=0x7f47440c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.292+0000 7f474c703640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f474415e600 0x7f47440c9ec0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f473c00c780 tx=0x7f473c00cc40 comp rx=0 tx=0).stop 2024-09-12T01:38:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.292+0000 7f474c703640 1 -- 172.21.15.60:0/2874195205 shutdown_connections 2024-09-12T01:38:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.292+0000 7f474c703640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f474415e600 0x7f47440c9ec0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.292+0000 7f474c703640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f472806be30 0x7f472806e2f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.292+0000 7f474c703640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47440d1a40 0x7f474415a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.292+0000 7f474c703640 1 --2- 172.21.15.60:0/2874195205 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47440cf2f0 0x7f4744153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.292+0000 7f474c703640 1 -- 172.21.15.60:0/2874195205 >> 172.21.15.60:0/2874195205 conn(0x7f474406c2c0 msgr2=0x7f47440b8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.292+0000 7f474c703640 1 -- 172.21.15.60:0/2874195205 shutdown_connections 2024-09-12T01:38:06.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.292+0000 7f474c703640 1 -- 172.21.15.60:0/2874195205 wait complete. 2024-09-12T01:38:06.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size' 2024-09-12T01:38:06.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.405+0000 7f7fcfbcf640 1 Processor -- start 2024-09-12T01:38:06.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.406+0000 7f7fcfbcf640 1 -- start start 2024-09-12T01:38:06.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.406+0000 7f7fcfbcf640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7fc815e950 0x7f7fc806ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.406+0000 7f7fcfbcf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc80735b0 0x7f7fc806d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.406+0000 7f7fcfbcf640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc806faf0 con 0x7f7fc8072050 2024-09-12T01:38:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.406+0000 7f7fcfbcf640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7fc806fdd0 con 0x7f7fc815e950 2024-09-12T01:38:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.406+0000 7f7fcfbcf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc80700b0 con 0x7f7fc80735b0 2024-09-12T01:38:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.407+0000 7f7fcd96b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7fc815e950 0x7f7fc806ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.407+0000 7f7fce16c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7fc8072050 0x7f7fc806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40224/0 (socket says 172.21.15.60:40224) 2024-09-12T01:38:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.407+0000 7f7fce16c640 1 -- 172.21.15.60:0/1363321332 learned_addr learned my addr 172.21.15.60:0/1363321332 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.407+0000 7f7fcd16a640 1 --2- 172.21.15.60:0/1363321332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc80735b0 0x7f7fc806d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.407+0000 7f7fcd96b640 1 -- 172.21.15.60:0/1363321332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc80735b0 msgr2=0x7f7fc806d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.407+0000 7f7fcd96b640 1 --2- 172.21.15.60:0/1363321332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc80735b0 0x7f7fc806d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.407+0000 7f7fcd96b640 1 -- 172.21.15.60:0/1363321332 >> v1:172.21.15.60:6789/0 conn(0x7f7fc8072050 legacy=0x7f7fc806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.407+0000 7f7fcc969640 1 -- 172.21.15.60:0/1363321332 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1508768061 0 0) 0x7f7fc806faf0 con 0x7f7fc8072050 2024-09-12T01:38:06.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.407+0000 7f7fcd96b640 1 -- 172.21.15.60:0/1363321332 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc8070390 con 0x7f7fc815e950 2024-09-12T01:38:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.408+0000 7f7fcd96b640 1 --2- 172.21.15.60:0/1363321332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc815e950 0x7f7fc806ce30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40097a0 tx=0x7f7fc402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ed485c42a0a592 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.408+0000 7f7fcc969640 1 -- 172.21.15.60:0/1363321332 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4037070 con 0x7f7fc815e950 2024-09-12T01:38:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.408+0000 7f7fcc969640 1 -- 172.21.15.60:0/1363321332 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc4032440 con 0x7f7fc815e950 2024-09-12T01:38:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.408+0000 7f7fcc969640 1 -- 172.21.15.60:0/1363321332 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4032810 con 0x7f7fc815e950 2024-09-12T01:38:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.408+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/1363321332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc815e950 msgr2=0x7f7fc806ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.408+0000 7f7fcfbcf640 1 --2- 172.21.15.60:0/1363321332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc815e950 0x7f7fc806ce30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40097a0 tx=0x7f7fc402a180 comp rx=0 tx=0).stop 2024-09-12T01:38:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.408+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/1363321332 shutdown_connections 2024-09-12T01:38:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.408+0000 7f7fcfbcf640 1 --2- 172.21.15.60:0/1363321332 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc80735b0 0x7f7fc806d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.408+0000 7f7fcfbcf640 1 --2- 172.21.15.60:0/1363321332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc815e950 0x7f7fc806ce30 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.408+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/1363321332 >> 172.21.15.60:0/1363321332 conn(0x7f7fc80d14d0 msgr2=0x7f7fc80d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.409+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/1363321332 shutdown_connections 2024-09-12T01:38:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.409+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/1363321332 wait complete. 2024-09-12T01:38:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.410+0000 7f7fcfbcf640 1 Processor -- start 2024-09-12T01:38:06.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.410+0000 7f7fcfbcf640 1 -- start start 2024-09-12T01:38:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.410+0000 7f7fcfbcf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc8072050 0x7f7fc80cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.410+0000 7f7fcfbcf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc80735b0 0x7f7fc80cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.410+0000 7f7fcfbcf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc815e950 0x7f7fc814e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.410+0000 7f7fcfbcf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80d0230 con 0x7f7fc815e950 2024-09-12T01:38:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.410+0000 7f7fcfbcf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc80d00b0 con 0x7f7fc80735b0 2024-09-12T01:38:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.410+0000 7f7fcfbcf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7fc80d03b0 con 0x7f7fc8072050 2024-09-12T01:38:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fce16c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc815e950 0x7f7fc814e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fce16c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc815e950 0x7f7fc814e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52802/0 (socket says 172.21.15.60:52802) 2024-09-12T01:38:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fce16c640 1 -- 172.21.15.60:0/20537084 learned_addr learned my addr 172.21.15.60:0/20537084 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fcd96b640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc8072050 0x7f7fc80cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fcd16a640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc80735b0 0x7f7fc80cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fce16c640 1 -- 172.21.15.60:0/20537084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc8072050 msgr2=0x7f7fc80cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fce16c640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc8072050 0x7f7fc80cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fce16c640 1 -- 172.21.15.60:0/20537084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc80735b0 msgr2=0x7f7fc80cd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fce16c640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc80735b0 0x7f7fc80cd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fce16c640 1 -- 172.21.15.60:0/20537084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc80cae50 con 0x7f7fc815e950 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fcd96b640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc8072050 0x7f7fc80cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fcd16a640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc80735b0 0x7f7fc80cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fce16c640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc815e950 0x7f7fc814e070 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000c6d0 tx=0x7f7fc000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fbe7fc640 1 -- 172.21.15.60:0/20537084 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0018070 con 0x7f7fc815e950 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fbe7fc640 1 -- 172.21.15.60:0/20537084 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc0004d60 con 0x7f7fc815e950 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fbe7fc640 1 -- 172.21.15.60:0/20537084 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc000a880 con 0x7f7fc815e950 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/20537084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc80cb130 con 0x7f7fc815e950 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.411+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/20537084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc80cb9d0 con 0x7f7fc815e950 2024-09-12T01:38:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.412+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/20537084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fc806ce30 con 0x7f7fc815e950 2024-09-12T01:38:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.413+0000 7f7fbe7fc640 1 -- 172.21.15.60:0/20537084 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7fc000aa20 con 0x7f7fc815e950 2024-09-12T01:38:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.413+0000 7f7fbe7fc640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7fac06be60 0x7f7fac06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.414+0000 7f7fcd96b640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7fac06be60 0x7f7fac06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.414+0000 7f7fbe7fc640 1 -- 172.21.15.60:0/20537084 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f7fc0089f90 con 0x7f7fc815e950 2024-09-12T01:38:06.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.414+0000 7f7fcd96b640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7fac06be60 0x7f7fac06e320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4034000 tx=0x7f7fc402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.418+0000 7f7fbe7fc640 1 -- 172.21.15.60:0/20537084 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7fc0058cd0 con 0x7f7fc815e950 2024-09-12T01:38:06.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.659+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/20537084 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]} v 0) -- 0x7f7fc80cb300 con 0x7f7fc815e950 2024-09-12T01:38:06.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.678+0000 7f7fbe7fc640 1 -- 172.21.15.60:0/20537084 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]}]=0 v130) ==== 153+0+0 (secure 0 0 0) 0x7f7fc00585d0 con 0x7f7fc815e950 2024-09-12T01:38:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.680+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/20537084 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7fac06be60 msgr2=0x7f7fac06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.680+0000 7f7fcfbcf640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7fac06be60 0x7f7fac06e320 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4034000 tx=0x7f7fc402e000 comp rx=0 tx=0).stop 2024-09-12T01:38:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.680+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/20537084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc815e950 msgr2=0x7f7fc814e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.680+0000 7f7fcfbcf640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc815e950 0x7f7fc814e070 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000c6d0 tx=0x7f7fc000cb90 comp rx=0 tx=0).stop 2024-09-12T01:38:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.680+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/20537084 shutdown_connections 2024-09-12T01:38:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.680+0000 7f7fcfbcf640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fc815e950 0x7f7fc814e070 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.680+0000 7f7fcfbcf640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7fc80735b0 0x7f7fc80cd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.680+0000 7f7fcfbcf640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7fac06be60 0x7f7fac06e320 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.680+0000 7f7fcfbcf640 1 --2- 172.21.15.60:0/20537084 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7fc8072050 0x7f7fc80cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.680+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/20537084 >> 172.21.15.60:0/20537084 conn(0x7f7fc80d14d0 msgr2=0x7f7fc80cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.680+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/20537084 shutdown_connections 2024-09-12T01:38:06.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.680+0000 7f7fcfbcf640 1 -- 172.21.15.60:0/20537084 wait complete. 2024-09-12T01:38:06.690 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:38:06.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.797+0000 7f0c3cceb640 1 Processor -- start 2024-09-12T01:38:06.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.797+0000 7f0c3cceb640 1 -- start start 2024-09-12T01:38:06.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.798+0000 7f0c3cceb640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0c380b6290 0x7f0c38071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.798+0000 7f0c3cceb640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c38072530 0x7f0c3815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.798+0000 7f0c3cceb640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c380ccff0 con 0x7f0c3815b480 2024-09-12T01:38:06.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.798+0000 7f0c3cceb640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0c380cd2d0 con 0x7f0c380b6290 2024-09-12T01:38:06.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.798+0000 7f0c3cceb640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c380cd5b0 con 0x7f0c38072530 2024-09-12T01:38:06.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.798+0000 7f0c35d9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0c380b6290 0x7f0c38071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.798+0000 7f0c36d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c38072530 0x7f0c3815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.798+0000 7f0c35d9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0c380b6290 0x7f0c38071ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:58028/0 (socket says 172.21.15.60:58028) 2024-09-12T01:38:06.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.798+0000 7f0c35d9b640 1 -- 172.21.15.60:0/4293131692 learned_addr learned my addr 172.21.15.60:0/4293131692 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:06.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.798+0000 7f0c3659c640 1 --1- 172.21.15.60:0/4293131692 >> v1:172.21.15.105:6789/0 conn(0x7f0c3815b480 0x7f0c380b5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:34836/0 (socket says 172.21.15.60:34836) 2024-09-12T01:38:06.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.799+0000 7f0c36d9d640 1 -- 172.21.15.60:0/4293131692 >> v2:172.21.15.105:3300/0 conn(0x7f0c380b6290 msgr2=0x7f0c38071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:06.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.799+0000 7f0c36d9d640 1 --2- 172.21.15.60:0/4293131692 >> v2:172.21.15.105:3300/0 conn(0x7f0c380b6290 0x7f0c38071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.799+0000 7f0c36d9d640 1 -- 172.21.15.60:0/4293131692 >> v1:172.21.15.105:6789/0 conn(0x7f0c3815b480 legacy=0x7f0c380b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.799+0000 7f0c36d9d640 1 -- 172.21.15.60:0/4293131692 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c380cd890 con 0x7f0c38072530 2024-09-12T01:38:06.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.799+0000 7f0c35d9b640 1 --2- 172.21.15.60:0/4293131692 >> v2:172.21.15.105:3300/0 conn(0x7f0c380b6290 0x7f0c38071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:06.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.800+0000 7f0c36d9d640 1 --2- 172.21.15.60:0/4293131692 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c38072530 0x7f0c3815bc60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009d90 tx=0x7f0c3002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ad8b24285dce218 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:06.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.800+0000 7f0c3559a640 1 -- 172.21.15.60:0/4293131692 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30031600 con 0x7f0c38072530 2024-09-12T01:38:06.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.800+0000 7f0c3559a640 1 -- 172.21.15.60:0/4293131692 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c300317a0 con 0x7f0c38072530 2024-09-12T01:38:06.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.800+0000 7f0c3559a640 1 -- 172.21.15.60:0/4293131692 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c30031b70 con 0x7f0c38072530 2024-09-12T01:38:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.800+0000 7f0c3cceb640 1 -- 172.21.15.60:0/4293131692 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c38072530 msgr2=0x7f0c3815bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.800+0000 7f0c3cceb640 1 --2- 172.21.15.60:0/4293131692 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c38072530 0x7f0c3815bc60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009d90 tx=0x7f0c3002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.800+0000 7f0c3cceb640 1 -- 172.21.15.60:0/4293131692 shutdown_connections 2024-09-12T01:38:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.800+0000 7f0c3cceb640 1 --2- 172.21.15.60:0/4293131692 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c38072530 0x7f0c3815bc60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.800+0000 7f0c3cceb640 1 --2- 172.21.15.60:0/4293131692 >> v2:172.21.15.105:3300/0 conn(0x7f0c380b6290 0x7f0c38071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.800+0000 7f0c3cceb640 1 -- 172.21.15.60:0/4293131692 >> 172.21.15.60:0/4293131692 conn(0x7f0c3806d0f0 msgr2=0x7f0c3806d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:06.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.800+0000 7f0c3cceb640 1 -- 172.21.15.60:0/4293131692 shutdown_connections 2024-09-12T01:38:06.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.800+0000 7f0c3cceb640 1 -- 172.21.15.60:0/4293131692 wait complete. 2024-09-12T01:38:06.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.802+0000 7f0c3cceb640 1 Processor -- start 2024-09-12T01:38:06.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.802+0000 7f0c3cceb640 1 -- start start 2024-09-12T01:38:06.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3cceb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c38072530 0x7f0c38144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3cceb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c3815b480 0x7f0c38148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3cceb640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c38158d20 0x7f0c381591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3cceb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3815b9e0 con 0x7f0c38072530 2024-09-12T01:38:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3cceb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3815b860 con 0x7f0c3815b480 2024-09-12T01:38:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3cceb640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c3815c1a0 con 0x7f0c38158d20 2024-09-12T01:38:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c38072530 0x7f0c38144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c38072530 0x7f0c38144c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52804/0 (socket says 172.21.15.60:52804) 2024-09-12T01:38:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3659c640 1 -- 172.21.15.60:0/2774772828 learned_addr learned my addr 172.21.15.60:0/2774772828 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c35d9b640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c3815b480 0x7f0c38148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c36d9d640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c38158d20 0x7f0c381591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3659c640 1 -- 172.21.15.60:0/2774772828 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c38158d20 msgr2=0x7f0c381591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3659c640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c38158d20 0x7f0c381591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3659c640 1 -- 172.21.15.60:0/2774772828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c3815b480 msgr2=0x7f0c38148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3659c640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c3815b480 0x7f0c38148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3659c640 1 -- 172.21.15.60:0/2774772828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c38148fd0 con 0x7f0c38072530 2024-09-12T01:38:06.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c35d9b640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c3815b480 0x7f0c38148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:06.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3659c640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c38072530 0x7f0c38144c40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800c3c0 tx=0x7f0c2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:06.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c26ffd640 1 -- 172.21.15.60:0/2774772828 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c280074e0 con 0x7f0c38072530 2024-09-12T01:38:06.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c26ffd640 1 -- 172.21.15.60:0/2774772828 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c28007680 con 0x7f0c38072530 2024-09-12T01:38:06.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c26ffd640 1 -- 172.21.15.60:0/2774772828 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c28004a00 con 0x7f0c38072530 2024-09-12T01:38:06.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.803+0000 7f0c3cceb640 1 -- 172.21.15.60:0/2774772828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3814a470 con 0x7f0c38072530 2024-09-12T01:38:06.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.804+0000 7f0c3cceb640 1 -- 172.21.15.60:0/2774772828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c38148290 con 0x7f0c38072530 2024-09-12T01:38:06.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.805+0000 7f0c3cceb640 1 -- 172.21.15.60:0/2774772828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c3815bc60 con 0x7f0c38072530 2024-09-12T01:38:06.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.805+0000 7f0c26ffd640 1 -- 172.21.15.60:0/2774772828 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c2801a020 con 0x7f0c38072530 2024-09-12T01:38:06.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.806+0000 7f0c26ffd640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c1806be30 0x7f0c1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:06.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.806+0000 7f0c26ffd640 1 -- 172.21.15.60:0/2774772828 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f0c2808a380 con 0x7f0c38072530 2024-09-12T01:38:06.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.806+0000 7f0c35d9b640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c1806be30 0x7f0c1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:06.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.806+0000 7f0c35d9b640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c1806be30 0x7f0c1806e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009630 tx=0x7f0c2c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:06.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.810+0000 7f0c26ffd640 1 -- 172.21.15.60:0/2774772828 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c28010300 con 0x7f0c38072530 2024-09-12T01:38:06.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.987+0000 7f0c3cceb640 1 -- 172.21.15.60:0/2774772828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0c380cfe80 con 0x7f0c38072530 2024-09-12T01:38:06.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.990+0000 7f0c26ffd640 1 -- 172.21.15.60:0/2774772828 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f0c28059030 con 0x7f0c38072530 2024-09-12T01:38:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.992+0000 7f0c3cceb640 1 -- 172.21.15.60:0/2774772828 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c1806be30 msgr2=0x7f0c1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.992+0000 7f0c3cceb640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c1806be30 0x7f0c1806e2f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009630 tx=0x7f0c2c008040 comp rx=0 tx=0).stop 2024-09-12T01:38:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.992+0000 7f0c3cceb640 1 -- 172.21.15.60:0/2774772828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c38072530 msgr2=0x7f0c38144c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.992+0000 7f0c3cceb640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c38072530 0x7f0c38144c40 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0c2800c3c0 tx=0x7f0c2800c880 comp rx=0 tx=0).stop 2024-09-12T01:38:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.992+0000 7f0c3cceb640 1 -- 172.21.15.60:0/2774772828 shutdown_connections 2024-09-12T01:38:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.992+0000 7f0c3cceb640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c1806be30 0x7f0c1806e2f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.992+0000 7f0c3cceb640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c38158d20 0x7f0c381591d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.992+0000 7f0c3cceb640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c3815b480 0x7f0c38148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.992+0000 7f0c3cceb640 1 --2- 172.21.15.60:0/2774772828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c38072530 0x7f0c38144c40 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.992+0000 7f0c3cceb640 1 -- 172.21.15.60:0/2774772828 >> 172.21.15.60:0/2774772828 conn(0x7f0c3806d0f0 msgr2=0x7f0c380ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.992+0000 7f0c3cceb640 1 -- 172.21.15.60:0/2774772828 shutdown_connections 2024-09-12T01:38:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:06.992+0000 7f0c3cceb640 1 -- 172.21.15.60:0/2774772828 wait complete. 2024-09-12T01:38:07.003 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:38:07.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:38:07.055 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:38:07.100 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:38:07.101 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:07.101 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:07.117 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:38:07.117 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:38:07.117 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:07.159 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:38:07.159 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:07.159 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:07.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:38:07.175 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:38:07.175 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:07.218 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:38:07.218 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:38:07.218 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:07.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.321+0000 7f0210349640 1 Processor -- start 2024-09-12T01:38:07.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.321+0000 7f0210349640 1 -- start start 2024-09-12T01:38:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.322+0000 7f0210349640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f02080715e0 0x7f02080b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.322+0000 7f0210349640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0208073160 0x7f0208073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.322+0000 7f0210349640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02080d0270 con 0x7f020815c550 2024-09-12T01:38:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.322+0000 7f0210349640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f02080b7350 con 0x7f02080715e0 2024-09-12T01:38:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.322+0000 7f0210349640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f020815c930 con 0x7f0208073160 2024-09-12T01:38:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.322+0000 7f020d8e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f02080715e0 0x7f02080b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.322+0000 7f020d8e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f02080715e0 0x7f02080b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52808/0 (socket says 172.21.15.60:52808) 2024-09-12T01:38:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.322+0000 7f020d8e4640 1 -- 172.21.15.60:0/3872399548 learned_addr learned my addr 172.21.15.60:0/3872399548 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.322+0000 7f020e8e6640 1 --2- 172.21.15.60:0/3872399548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0208073160 0x7f0208073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.323+0000 7f020d8e4640 1 -- 172.21.15.60:0/3872399548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0208073160 msgr2=0x7f0208073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:07.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.323+0000 7f020d8e4640 1 --2- 172.21.15.60:0/3872399548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0208073160 0x7f0208073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.323+0000 7f020d8e4640 1 -- 172.21.15.60:0/3872399548 >> v1:172.21.15.105:6789/0 conn(0x7f020815c550 legacy=0x7f02080b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:07.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.323+0000 7f020d8e4640 1 -- 172.21.15.60:0/3872399548 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0208071a50 con 0x7f02080715e0 2024-09-12T01:38:07.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.323+0000 7f020d8e4640 1 --2- 172.21.15.60:0/3872399548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02080715e0 0x7f02080b6e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009870 tx=0x7f01fc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec429f3062c7e92 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:07.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.323+0000 7f020d0e3640 1 -- 172.21.15.60:0/3872399548 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc037070 con 0x7f02080715e0 2024-09-12T01:38:07.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.323+0000 7f020d0e3640 1 -- 172.21.15.60:0/3872399548 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01fc032440 con 0x7f02080715e0 2024-09-12T01:38:07.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.323+0000 7f020d0e3640 1 -- 172.21.15.60:0/3872399548 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01fc032810 con 0x7f02080715e0 2024-09-12T01:38:07.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.324+0000 7f0210349640 1 -- 172.21.15.60:0/3872399548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02080715e0 msgr2=0x7f02080b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.324+0000 7f0210349640 1 --2- 172.21.15.60:0/3872399548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02080715e0 0x7f02080b6e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009870 tx=0x7f01fc02a210 comp rx=0 tx=0).stop 2024-09-12T01:38:07.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.324+0000 7f0210349640 1 -- 172.21.15.60:0/3872399548 shutdown_connections 2024-09-12T01:38:07.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.324+0000 7f0210349640 1 --2- 172.21.15.60:0/3872399548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0208073160 0x7f0208073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.324+0000 7f0210349640 1 --2- 172.21.15.60:0/3872399548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02080715e0 0x7f02080b6e10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.324+0000 7f0210349640 1 -- 172.21.15.60:0/3872399548 >> 172.21.15.60:0/3872399548 conn(0x7f02080b4240 msgr2=0x7f02080b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.324+0000 7f0210349640 1 -- 172.21.15.60:0/3872399548 shutdown_connections 2024-09-12T01:38:07.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.324+0000 7f0210349640 1 -- 172.21.15.60:0/3872399548 wait complete. 2024-09-12T01:38:07.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.325+0000 7f0210349640 1 Processor -- start 2024-09-12T01:38:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.325+0000 7f0210349640 1 -- start start 2024-09-12T01:38:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f0210349640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02080715e0 0x7f02081569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f0210349640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0208073160 0x7f020806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f0210349640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f020815c550 0x7f020806e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f0210349640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f02080b7580 con 0x7f02080715e0 2024-09-12T01:38:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f0210349640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0208073ad0 con 0x7f0208073160 2024-09-12T01:38:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f0210349640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02080b7860 con 0x7f020815c550 2024-09-12T01:38:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f020e0e5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02080715e0 0x7f02081569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f020e0e5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02080715e0 0x7f02081569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52824/0 (socket says 172.21.15.60:52824) 2024-09-12T01:38:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f020e0e5640 1 -- 172.21.15.60:0/1290227740 learned_addr learned my addr 172.21.15.60:0/1290227740 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f020d8e4640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0208073160 0x7f020806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f020e8e6640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f020815c550 0x7f020806e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f020e0e5640 1 -- 172.21.15.60:0/1290227740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f020815c550 msgr2=0x7f020806e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f020e0e5640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f020815c550 0x7f020806e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.326+0000 7f020e0e5640 1 -- 172.21.15.60:0/1290227740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0208073160 msgr2=0x7f020806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.327+0000 7f020e0e5640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0208073160 0x7f020806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.327+0000 7f020e0e5640 1 -- 172.21.15.60:0/1290227740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f020806d470 con 0x7f02080715e0 2024-09-12T01:38:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.327+0000 7f020e0e5640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02080715e0 0x7f02081569e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f01f800ba50 tx=0x7f01f800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.327+0000 7f0206ffd640 1 -- 172.21.15.60:0/1290227740 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8019070 con 0x7f02080715e0 2024-09-12T01:38:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.327+0000 7f0206ffd640 1 -- 172.21.15.60:0/1290227740 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01f800cc20 con 0x7f02080715e0 2024-09-12T01:38:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.327+0000 7f0210349640 1 -- 172.21.15.60:0/1290227740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f020806d750 con 0x7f02080715e0 2024-09-12T01:38:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.327+0000 7f0206ffd640 1 -- 172.21.15.60:0/1290227740 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f8014680 con 0x7f02080715e0 2024-09-12T01:38:07.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.327+0000 7f0210349640 1 -- 172.21.15.60:0/1290227740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f020806dd10 con 0x7f02080715e0 2024-09-12T01:38:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.328+0000 7f0210349640 1 -- 172.21.15.60:0/1290227740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02080b6610 con 0x7f02080715e0 2024-09-12T01:38:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.328+0000 7f0206ffd640 1 -- 172.21.15.60:0/1290227740 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f01f801c070 con 0x7f02080715e0 2024-09-12T01:38:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.329+0000 7f0206ffd640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f01f406be30 0x7f01f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.329+0000 7f0206ffd640 1 -- 172.21.15.60:0/1290227740 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f01f808a890 con 0x7f02080715e0 2024-09-12T01:38:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.329+0000 7f020d8e4640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f01f406be30 0x7f01f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.329+0000 7f020d8e4640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f01f406be30 0x7f01f406e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f01fc034000 tx=0x7f01fc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:07.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.333+0000 7f0206ffd640 1 -- 172.21.15.60:0/1290227740 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02080b6610 con 0x7f02080715e0 2024-09-12T01:38:07.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.543+0000 7f0210349640 1 -- 172.21.15.60:0/1290227740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02080d07b0 con 0x7f02080715e0 2024-09-12T01:38:07.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.544+0000 7f0206ffd640 1 -- 172.21.15.60:0/1290227740 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+3919 (secure 0 0 0) 0x7f01f8058f00 con 0x7f02080715e0 2024-09-12T01:38:07.543 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:07.543 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"btime":"2024-09-12T01:38:02:664519+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5098,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2903062918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2903062918},{"type":"v1","addr":"172.21.15.105:6835","nonce":2903062918}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":5244,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/1613307735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1613307735},{"type":"v1","addr":"172.21.15.60:6836","nonce":1613307735}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34772,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/4169562393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":4169562393},{"type":"v1","addr":"172.21.15.60:6837","nonce":4169562393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34925,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3165253836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3165253836},{"type":"v1","addr":"172.21.15.105:6834","nonce":3165253836}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[]} 2024-09-12T01:38:07.544 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 23 2024-09-12T01:38:07.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.546+0000 7f0210349640 1 -- 172.21.15.60:0/1290227740 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f01f406be30 msgr2=0x7f01f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.546+0000 7f0210349640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f01f406be30 0x7f01f406e2f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f01fc034000 tx=0x7f01fc02e000 comp rx=0 tx=0).stop 2024-09-12T01:38:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.546+0000 7f0210349640 1 -- 172.21.15.60:0/1290227740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02080715e0 msgr2=0x7f02081569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.546+0000 7f0210349640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02080715e0 0x7f02081569e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f01f800ba50 tx=0x7f01f800bf10 comp rx=0 tx=0).stop 2024-09-12T01:38:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.546+0000 7f0210349640 1 -- 172.21.15.60:0/1290227740 shutdown_connections 2024-09-12T01:38:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.546+0000 7f0210349640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f01f406be30 0x7f01f406e2f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.546+0000 7f0210349640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f020815c550 0x7f020806e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.546+0000 7f0210349640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0208073160 0x7f020806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.546+0000 7f0210349640 1 --2- 172.21.15.60:0/1290227740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02080715e0 0x7f02081569e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.546+0000 7f0210349640 1 -- 172.21.15.60:0/1290227740 >> 172.21.15.60:0/1290227740 conn(0x7f02080b4240 msgr2=0x7f02080d2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.546+0000 7f0210349640 1 -- 172.21.15.60:0/1290227740 shutdown_connections 2024-09-12T01:38:07.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.546+0000 7f0210349640 1 -- 172.21.15.60:0/1290227740 wait complete. 2024-09-12T01:38:07.557 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:38:07.557 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:38:07.557 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:38:07.557 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:38:07.558 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:38:07.558 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:38:07.558 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:38:07.558 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:38:07.558 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:38:07.558 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:38:07.559 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:38:07.559 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:38:07.559 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:38:07.559 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:38:07.559 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:38:07.559 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:38:07.567 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:38:07.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:38:07.568 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:38:07.569 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:38:07.571 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:38:07.571 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:38:07.572 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:38:07.572 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:38:07.610 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:38:07.610 DEBUG:teuthology.parallel:result is None 2024-09-12T01:38:07.611 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:38:07.611 DEBUG:teuthology.parallel:result is None 2024-09-12T01:38:07.613 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:38:07.614 DEBUG:teuthology.parallel:result is None 2024-09-12T01:38:07.614 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:38:07.615 DEBUG:teuthology.parallel:result is None 2024-09-12T01:38:07.615 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:38:07.688 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2024-09-12T01:38:07.689 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2024-09-12T01:38:07.697 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:38:07.697 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:38:07.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.725+0000 7f455d81e640 1 Processor -- start 2024-09-12T01:38:07.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.725+0000 7f455d81e640 1 -- start start 2024-09-12T01:38:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.726+0000 7f455d81e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f455815e7a0 0x7f455806caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.726+0000 7f455d81e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45580cf860 con 0x7f45580cf1f0 2024-09-12T01:38:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.726+0000 7f455d81e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45580cfb40 con 0x7f45580b68f0 2024-09-12T01:38:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.726+0000 7f455d81e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f45580d2ca0 con 0x7f455815e7a0 2024-09-12T01:38:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.726+0000 7f4556ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f455815e7a0 0x7f455806caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.726+0000 7f4556ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f455815e7a0 0x7f455806caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52870/0 (socket says 172.21.15.60:52870) 2024-09-12T01:38:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.726+0000 7f4556ffd640 1 -- 172.21.15.60:0/1514461263 learned_addr learned my addr 172.21.15.60:0/1514461263 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.727+0000 7f4556ffd640 1 -- 172.21.15.60:0/1514461263 >> v1:172.21.15.105:6789/0 conn(0x7f45580b68f0 legacy=0x7f45580d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.727+0000 7f4556ffd640 1 -- 172.21.15.60:0/1514461263 >> v1:172.21.15.60:6789/0 conn(0x7f45580cf1f0 legacy=0x7f45580b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.727+0000 7f45567fc640 1 -- 172.21.15.60:0/1514461263 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2800511063 0 0) 0x7f45580cf860 con 0x7f45580cf1f0 2024-09-12T01:38:07.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.727+0000 7f4556ffd640 1 -- 172.21.15.60:0/1514461263 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45580cfe20 con 0x7f455815e7a0 2024-09-12T01:38:07.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.727+0000 7f4556ffd640 1 --2- 172.21.15.60:0/1514461263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f455815e7a0 0x7f455806caa0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4548009870 tx=0x7f454802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b90a103fa79f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:07.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.728+0000 7f45567fc640 1 -- 172.21.15.60:0/1514461263 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548037070 con 0x7f455815e7a0 2024-09-12T01:38:07.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.728+0000 7f45567fc640 1 -- 172.21.15.60:0/1514461263 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4548032440 con 0x7f455815e7a0 2024-09-12T01:38:07.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.728+0000 7f45567fc640 1 -- 172.21.15.60:0/1514461263 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4548032810 con 0x7f455815e7a0 2024-09-12T01:38:07.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.728+0000 7f455d81e640 1 -- 172.21.15.60:0/1514461263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f455815e7a0 msgr2=0x7f455806caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.728+0000 7f455d81e640 1 --2- 172.21.15.60:0/1514461263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f455815e7a0 0x7f455806caa0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4548009870 tx=0x7f454802a270 comp rx=0 tx=0).stop 2024-09-12T01:38:07.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.728+0000 7f455d81e640 1 -- 172.21.15.60:0/1514461263 shutdown_connections 2024-09-12T01:38:07.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.728+0000 7f455d81e640 1 --2- 172.21.15.60:0/1514461263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f455815e7a0 0x7f455806caa0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.728+0000 7f455d81e640 1 -- 172.21.15.60:0/1514461263 >> 172.21.15.60:0/1514461263 conn(0x7f45580d11e0 msgr2=0x7f45580d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:07.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.728+0000 7f455d81e640 1 -- 172.21.15.60:0/1514461263 shutdown_connections 2024-09-12T01:38:07.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.728+0000 7f455d81e640 1 -- 172.21.15.60:0/1514461263 wait complete. 2024-09-12T01:38:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.729+0000 7f455d81e640 1 Processor -- start 2024-09-12T01:38:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.729+0000 7f455d81e640 1 -- start start 2024-09-12T01:38:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.730+0000 7f455d81e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45580b68f0 0x7f4558159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.730+0000 7f455d81e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45580cf1f0 0x7f45580ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.730+0000 7f455d81e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f455815e7a0 0x7f45580ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.730+0000 7f455d81e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f455806cfe0 con 0x7f455815e7a0 2024-09-12T01:38:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.730+0000 7f455d81e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f45580b7a00 con 0x7f45580b68f0 2024-09-12T01:38:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.730+0000 7f455d81e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f455815eb80 con 0x7f45580cf1f0 2024-09-12T01:38:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.730+0000 7f45577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f455815e7a0 0x7f45580ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.730+0000 7f45577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f455815e7a0 0x7f45580ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52886/0 (socket says 172.21.15.60:52886) 2024-09-12T01:38:07.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.730+0000 7f45577fe640 1 -- 172.21.15.60:0/53598474 learned_addr learned my addr 172.21.15.60:0/53598474 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.730+0000 7f4556ffd640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45580b68f0 0x7f4558159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.730+0000 7f454ffff640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45580cf1f0 0x7f45580ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.731+0000 7f45577fe640 1 -- 172.21.15.60:0/53598474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45580cf1f0 msgr2=0x7f45580ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.731+0000 7f45577fe640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45580cf1f0 0x7f45580ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.731+0000 7f45577fe640 1 -- 172.21.15.60:0/53598474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45580b68f0 msgr2=0x7f4558159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.731+0000 7f45577fe640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45580b68f0 0x7f4558159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.731+0000 7f45577fe640 1 -- 172.21.15.60:0/53598474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45580c96a0 con 0x7f455815e7a0 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.731+0000 7f454ffff640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45580cf1f0 0x7f45580ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.731+0000 7f45577fe640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f455815e7a0 0x7f45580ce9a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f455000c760 tx=0x7f455000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.731+0000 7f4554ff9640 1 -- 172.21.15.60:0/53598474 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4550003b70 con 0x7f455815e7a0 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.731+0000 7f4554ff9640 1 -- 172.21.15.60:0/53598474 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4550003d10 con 0x7f455815e7a0 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.731+0000 7f455d81e640 1 -- 172.21.15.60:0/53598474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45580c9980 con 0x7f455815e7a0 2024-09-12T01:38:07.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.731+0000 7f4554ff9640 1 -- 172.21.15.60:0/53598474 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f455000aa90 con 0x7f455815e7a0 2024-09-12T01:38:07.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.731+0000 7f455d81e640 1 -- 172.21.15.60:0/53598474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45580c9f40 con 0x7f455815e7a0 2024-09-12T01:38:07.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.732+0000 7f455d81e640 1 -- 172.21.15.60:0/53598474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455806caa0 con 0x7f455815e7a0 2024-09-12T01:38:07.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.732+0000 7f4554ff9640 1 -- 172.21.15.60:0/53598474 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f455000ac30 con 0x7f455815e7a0 2024-09-12T01:38:07.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.733+0000 7f4554ff9640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f453806be30 0x7f453806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:07.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.733+0000 7f4554ff9640 1 -- 172.21.15.60:0/53598474 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4943+0+0 (secure 0 0 0) 0x7f455008a990 con 0x7f455815e7a0 2024-09-12T01:38:07.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.733+0000 7f4556ffd640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f453806be30 0x7f453806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:07.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.734+0000 7f4556ffd640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f453806be30 0x7f453806e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4548034000 tx=0x7f454802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:07.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.737+0000 7f4554ff9640 1 -- 172.21.15.60:0/53598474 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4550059630 con 0x7f455815e7a0 2024-09-12T01:38:07.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:07.925+0000 7f455d81e640 1 -- 172.21.15.60:0/53598474 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f45580d2a80 con 0x7f455815e7a0 2024-09-12T01:38:08.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.694+0000 7f4554ff9640 1 -- 172.21.15.60:0/53598474 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) ==== 97+0+0 (secure 0 0 0) 0x7f4550058f30 con 0x7f455815e7a0 2024-09-12T01:38:08.693 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2024-09-12T01:38:08.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.697+0000 7f455d81e640 1 -- 172.21.15.60:0/53598474 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f453806be30 msgr2=0x7f453806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.697+0000 7f455d81e640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f453806be30 0x7f453806e2f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4548034000 tx=0x7f454802e000 comp rx=0 tx=0).stop 2024-09-12T01:38:08.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.697+0000 7f455d81e640 1 -- 172.21.15.60:0/53598474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f455815e7a0 msgr2=0x7f45580ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.697+0000 7f455d81e640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f455815e7a0 0x7f45580ce9a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f455000c760 tx=0x7f455000cc20 comp rx=0 tx=0).stop 2024-09-12T01:38:08.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.697+0000 7f455d81e640 1 -- 172.21.15.60:0/53598474 shutdown_connections 2024-09-12T01:38:08.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.697+0000 7f455d81e640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f455815e7a0 0x7f45580ce9a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.697+0000 7f455d81e640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f453806be30 0x7f453806e2f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.697+0000 7f455d81e640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f45580cf1f0 0x7f45580ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.697+0000 7f455d81e640 1 --2- 172.21.15.60:0/53598474 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45580b68f0 0x7f4558159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.697+0000 7f455d81e640 1 -- 172.21.15.60:0/53598474 >> 172.21.15.60:0/53598474 conn(0x7f45580d11e0 msgr2=0x7f455806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:08.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.698+0000 7f455d81e640 1 -- 172.21.15.60:0/53598474 shutdown_connections 2024-09-12T01:38:08.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.698+0000 7f455d81e640 1 -- 172.21.15.60:0/53598474 wait complete. 2024-09-12T01:38:08.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:38:08.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.822+0000 7fdc5203c640 1 Processor -- start 2024-09-12T01:38:08.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.822+0000 7fdc5203c640 1 -- start start 2024-09-12T01:38:08.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.823+0000 7fdc5203c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdc4c0d1b40 0x7fdc4c1618a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.823+0000 7fdc5203c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdc4c0b7290 0x7fdc4c161de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.823+0000 7fdc5203c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc4c0708d0 con 0x7fdc4c0b6eb0 2024-09-12T01:38:08.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.823+0000 7fdc5203c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdc4c070bb0 con 0x7fdc4c0d1b40 2024-09-12T01:38:08.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.823+0000 7fdc5203c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdc4c070e90 con 0x7fdc4c0b7290 2024-09-12T01:38:08.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.823+0000 7fdc42ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdc4c0d1b40 0x7fdc4c1618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.823+0000 7fdc42ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdc4c0d1b40 0x7fdc4c1618a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52896/0 (socket says 172.21.15.60:52896) 2024-09-12T01:38:08.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.823+0000 7fdc4b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdc4c0b6eb0 0x7fdc4c06fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40260/0 (socket says 172.21.15.60:40260) 2024-09-12T01:38:08.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.823+0000 7fdc42ffd640 1 -- 172.21.15.60:0/1016210518 learned_addr learned my addr 172.21.15.60:0/1016210518 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:08.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.824+0000 7fdc42ffd640 1 -- 172.21.15.60:0/1016210518 >> v2:172.21.15.105:3300/0 conn(0x7fdc4c0b7290 msgr2=0x7fdc4c161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:08.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.824+0000 7fdc42ffd640 1 --2- 172.21.15.60:0/1016210518 >> v2:172.21.15.105:3300/0 conn(0x7fdc4c0b7290 0x7fdc4c161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.824+0000 7fdc42ffd640 1 -- 172.21.15.60:0/1016210518 >> v1:172.21.15.60:6789/0 conn(0x7fdc4c0b6eb0 legacy=0x7fdc4c06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.824+0000 7fdc42ffd640 1 -- 172.21.15.60:0/1016210518 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4c071170 con 0x7fdc4c0d1b40 2024-09-12T01:38:08.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.824+0000 7fdc4affd640 1 -- 172.21.15.60:0/1016210518 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 740288304 0 0) 0x7fdc4c0708d0 con 0x7fdc4c0b6eb0 2024-09-12T01:38:08.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.824+0000 7fdc42ffd640 1 --2- 172.21.15.60:0/1016210518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc4c0d1b40 0x7fdc4c1618a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0759a0 tx=0x7fdc3402a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d27a441d684f94a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:08.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.824+0000 7fdc4affd640 1 -- 172.21.15.60:0/1016210518 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc34037070 con 0x7fdc4c0d1b40 2024-09-12T01:38:08.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.824+0000 7fdc4affd640 1 -- 172.21.15.60:0/1016210518 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc34032440 con 0x7fdc4c0d1b40 2024-09-12T01:38:08.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.825+0000 7fdc4affd640 1 -- 172.21.15.60:0/1016210518 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc34032810 con 0x7fdc4c0d1b40 2024-09-12T01:38:08.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.825+0000 7fdc5203c640 1 -- 172.21.15.60:0/1016210518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc4c0d1b40 msgr2=0x7fdc4c1618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.825+0000 7fdc5203c640 1 --2- 172.21.15.60:0/1016210518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc4c0d1b40 0x7fdc4c1618a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0759a0 tx=0x7fdc3402a150 comp rx=0 tx=0).stop 2024-09-12T01:38:08.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.825+0000 7fdc5203c640 1 -- 172.21.15.60:0/1016210518 shutdown_connections 2024-09-12T01:38:08.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.825+0000 7fdc5203c640 1 --2- 172.21.15.60:0/1016210518 >> v2:172.21.15.105:3300/0 conn(0x7fdc4c0b7290 0x7fdc4c161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.825+0000 7fdc5203c640 1 --2- 172.21.15.60:0/1016210518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc4c0d1b40 0x7fdc4c1618a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.825+0000 7fdc5203c640 1 -- 172.21.15.60:0/1016210518 >> 172.21.15.60:0/1016210518 conn(0x7fdc4c0d2450 msgr2=0x7fdc4c0d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:08.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.825+0000 7fdc5203c640 1 -- 172.21.15.60:0/1016210518 shutdown_connections 2024-09-12T01:38:08.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.825+0000 7fdc5203c640 1 -- 172.21.15.60:0/1016210518 wait complete. 2024-09-12T01:38:08.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.826+0000 7fdc5203c640 1 Processor -- start 2024-09-12T01:38:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.827+0000 7fdc5203c640 1 -- start start 2024-09-12T01:38:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.827+0000 7fdc5203c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc4c0b6eb0 0x7fdc4c152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.827+0000 7fdc5203c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc4c0b7290 0x7fdc4c153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.827+0000 7fdc5203c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc4c0d1b40 0x7fdc4c1ea330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.827+0000 7fdc5203c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c071af0 con 0x7fdc4c0b7290 2024-09-12T01:38:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.827+0000 7fdc5203c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4c071970 con 0x7fdc4c0b6eb0 2024-09-12T01:38:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.827+0000 7fdc5203c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4c162320 con 0x7fdc4c0d1b40 2024-09-12T01:38:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.827+0000 7fdc42ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc4c0b7290 0x7fdc4c153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.827+0000 7fdc42ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc4c0b7290 0x7fdc4c153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52902/0 (socket says 172.21.15.60:52902) 2024-09-12T01:38:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.827+0000 7fdc42ffd640 1 -- 172.21.15.60:0/200456871 learned_addr learned my addr 172.21.15.60:0/200456871 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc4b7fe640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc4c0b6eb0 0x7fdc4c152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc4bfff640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc4c0d1b40 0x7fdc4c1ea330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc42ffd640 1 -- 172.21.15.60:0/200456871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc4c0d1b40 msgr2=0x7fdc4c1ea330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc42ffd640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc4c0d1b40 0x7fdc4c1ea330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc42ffd640 1 -- 172.21.15.60:0/200456871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc4c0b6eb0 msgr2=0x7fdc4c152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc42ffd640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc4c0b6eb0 0x7fdc4c152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc42ffd640 1 -- 172.21.15.60:0/200456871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc4c154330 con 0x7fdc4c0b7290 2024-09-12T01:38:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc42ffd640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc4c0b7290 0x7fdc4c153a30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdc3402a190 tx=0x7fdc340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc48ff9640 1 -- 172.21.15.60:0/200456871 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc34041070 con 0x7fdc4c0b7290 2024-09-12T01:38:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc48ff9640 1 -- 172.21.15.60:0/200456871 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3403c870 con 0x7fdc4c0b7290 2024-09-12T01:38:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc5203c640 1 -- 172.21.15.60:0/200456871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc4c154610 con 0x7fdc4c0b7290 2024-09-12T01:38:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc48ff9640 1 -- 172.21.15.60:0/200456871 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc34037040 con 0x7fdc4c0b7290 2024-09-12T01:38:08.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.828+0000 7fdc5203c640 1 -- 172.21.15.60:0/200456871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc4c154bd0 con 0x7fdc4c0b7290 2024-09-12T01:38:08.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.829+0000 7fdc5203c640 1 -- 172.21.15.60:0/200456871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc4c06fd00 con 0x7fdc4c0b7290 2024-09-12T01:38:08.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.830+0000 7fdc48ff9640 1 -- 172.21.15.60:0/200456871 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc34044070 con 0x7fdc4c0b7290 2024-09-12T01:38:08.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.830+0000 7fdc48ff9640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdc2c06be60 0x7fdc2c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:08.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.830+0000 7fdc48ff9640 1 -- 172.21.15.60:0/200456871 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7fdc340ab740 con 0x7fdc4c0b7290 2024-09-12T01:38:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.831+0000 7fdc4b7fe640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdc2c06be60 0x7fdc2c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:08.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.831+0000 7fdc4b7fe640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdc2c06be60 0x7fdc2c06e320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c000f60 tx=0x7fdc3c007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:08.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:08.835+0000 7fdc48ff9640 1 -- 172.21.15.60:0/200456871 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc3407a560 con 0x7fdc4c0b7290 2024-09-12T01:38:09.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.077+0000 7fdc5203c640 1 -- 172.21.15.60:0/200456871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fdc4c0b19b0 con 0x7fdc4c0b7290 2024-09-12T01:38:09.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.078+0000 7fdc48ff9640 1 -- 172.21.15.60:0/200456871 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fdc34079e60 con 0x7fdc4c0b7290 2024-09-12T01:38:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:09.078 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:38:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2024-09-12T01:38:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2024-09-12T01:38:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmIK3fKxAAM9RkghDZwJZWuKouIbObDw==", 2024-09-12T01:38:09.078 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:38:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:38:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2024-09-12T01:38:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmzqHZNxAAnhCo4gGwLgYDVzzYnoiDFA==", 2024-09-12T01:38:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.079 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:38:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:38:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2024-09-12T01:38:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmksMWMxAAp3xMDD09rfphgPZwQcEABA==", 2024-09-12T01:38:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:09.080 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:38:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:38:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2024-09-12T01:38:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmvLw/AxAApd4hl5LRD1QddnPPjRw2Kg==", 2024-09-12T01:38:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.081 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:38:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:38:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.082 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA7ReJmc3D/JxAAXiw6n1Q3n9sCXln6YSiCBA==", 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA/ReJmEOu3CxAA4uu1neLh0mpeG9nia+/VqQ==", 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.083 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBCReJm3HHtDhAAoAdKVsjuXmpcf5R5zTtFKg==", 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:09.084 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBFReJmtRLuIBAA/BBibpGfpXsFXqVjVrmXWA==", 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.085 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2024-09-12T01:38:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBMReJmdDNXKhAAeh5aCvMw+70z3tnwjb9Hjg==", 2024-09-12T01:38:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2024-09-12T01:38:09.086 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBQReJm/tsIHRAAmgx+5WifY/VITGHAbUV2CQ==", 2024-09-12T01:38:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2024-09-12T01:38:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBUReJmQFaBHhAA1vH01tePCoJQFXlHB5gcVg==", 2024-09-12T01:38:09.087 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2024-09-12T01:38:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBYReJmTHqLAhAAtUB94Pa3eihlVdaupZ8Ggg==", 2024-09-12T01:38:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:09.088 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2024-09-12T01:38:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ==", 2024-09-12T01:38:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2024-09-12T01:38:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T01:38:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmTopGEBAAY0K3iZm2PotQc8a489uO/Q==", 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2024-09-12T01:38:09.090 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmqUgQDRAAAp5SAwNM9aSxZ1VVRwroNA==", 2024-09-12T01:38:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:38:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:38:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:38:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2024-09-12T01:38:09.091 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmGfzeFRAAE2xCnzeyX/KBo3NBrkixYQ==", 2024-09-12T01:38:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:38:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:38:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:38:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2024-09-12T01:38:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmOfXYDxAA0hydSyRvFmmNvFcRwPaXqg==", 2024-09-12T01:38:09.092 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:38:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:38:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:38:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2024-09-12T01:38:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmjpyMKBAAMSGgYJddHs7TtCV0NszZAQ==", 2024-09-12T01:38:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:38:09.093 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJm3Ei+JBAAhwgXWq0baTlDtaLedcaHmg==", 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.094 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T01:38:09.095 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:38:09.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.080+0000 7fdc5203c640 1 -- 172.21.15.60:0/200456871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdc2c06be60 msgr2=0x7fdc2c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.080+0000 7fdc5203c640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdc2c06be60 0x7fdc2c06e320 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c000f60 tx=0x7fdc3c007b50 comp rx=0 tx=0).stop 2024-09-12T01:38:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.080+0000 7fdc5203c640 1 -- 172.21.15.60:0/200456871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc4c0b7290 msgr2=0x7fdc4c153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.080+0000 7fdc5203c640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc4c0b7290 0x7fdc4c153a30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fdc3402a190 tx=0x7fdc340046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.080+0000 7fdc5203c640 1 -- 172.21.15.60:0/200456871 shutdown_connections 2024-09-12T01:38:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.080+0000 7fdc5203c640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdc2c06be60 0x7fdc2c06e320 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.080+0000 7fdc5203c640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc4c0d1b40 0x7fdc4c1ea330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.080+0000 7fdc5203c640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc4c0b7290 0x7fdc4c153a30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.080+0000 7fdc5203c640 1 --2- 172.21.15.60:0/200456871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc4c0b6eb0 0x7fdc4c152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.080+0000 7fdc5203c640 1 -- 172.21.15.60:0/200456871 >> 172.21.15.60:0/200456871 conn(0x7fdc4c0d2450 msgr2=0x7fdc4c06e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.080+0000 7fdc5203c640 1 -- 172.21.15.60:0/200456871 shutdown_connections 2024-09-12T01:38:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.080+0000 7fdc5203c640 1 -- 172.21.15.60:0/200456871 wait complete. 2024-09-12T01:38:09.098 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:38:09.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.202+0000 7fa1f89b0640 1 Processor -- start 2024-09-12T01:38:09.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.202+0000 7fa1f89b0640 1 -- start start 2024-09-12T01:38:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.202+0000 7fa1f89b0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f415e660 0x7fa1f40cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.202+0000 7fa1f89b0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f415ea40 con 0x7fa1f40d1820 2024-09-12T01:38:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f89b0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f40d3870 con 0x7fa1f40d3310 2024-09-12T01:38:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f89b0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f40d3b50 con 0x7fa1f415e660 2024-09-12T01:38:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f2d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa1f40d1820 0x7fa1f40b7b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40274/0 (socket says 172.21.15.60:40274) 2024-09-12T01:38:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f2d9d640 1 -- 172.21.15.60:0/3708731659 learned_addr learned my addr 172.21.15.60:0/3708731659 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f259c640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f415e660 0x7fa1f40cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126194691 0 0) 0x7fa1f415ea40 con 0x7fa1f40d1820 2024-09-12T01:38:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1e0003520 con 0x7fa1f40d1820 2024-09-12T01:38:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2466947015 0 0) 0x7fa1e0003520 con 0x7fa1f40d1820 2024-09-12T01:38:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f415e660 msgr2=0x7fa1f40cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f415e660 0x7fa1f40cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 >> v1:172.21.15.105:6789/0 conn(0x7fa1f40d3310 legacy=0x7fa1f40d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f40d3e30 con 0x7fa1f40d1820 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fa1ec0019f0 con 0x7fa1f40d1820 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 >> v1:172.21.15.60:6789/0 conn(0x7fa1f40d1820 legacy=0x7fa1f40b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1e00039e0 0x7fa1e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1e0004800 0x7fa1e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f415e660 0x7fa1e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f40d3b50 con 0x7fa1e00039e0 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e000ba70 con 0x7fa1e0004800 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa1e000bc70 con 0x7fa1f415e660 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.203+0000 7fa1f259c640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1e00039e0 0x7fa1e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.204+0000 7fa1f2d9d640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f415e660 0x7fa1e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.204+0000 7fa1ebfff640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1e0004800 0x7fa1e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.204+0000 7fa1f259c640 1 -- 172.21.15.60:0/3708731659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f415e660 msgr2=0x7fa1e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:09.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.204+0000 7fa1f259c640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f415e660 0x7fa1e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.204+0000 7fa1f259c640 1 -- 172.21.15.60:0/3708731659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1e0004800 msgr2=0x7fa1e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:09.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.204+0000 7fa1f259c640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1e0004800 0x7fa1e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.204+0000 7fa1f259c640 1 -- 172.21.15.60:0/3708731659 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1e0003520 con 0x7fa1e00039e0 2024-09-12T01:38:09.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.204+0000 7fa1ebfff640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1e0004800 0x7fa1e0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:09.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.204+0000 7fa1f259c640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1e00039e0 0x7fa1e0003e00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009a90 tx=0x7fa1e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb864b23ed8164 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:09.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.205+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4036070 con 0x7fa1e00039e0 2024-09-12T01:38:09.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.205+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4031400 con 0x7fa1e00039e0 2024-09-12T01:38:09.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.205+0000 7fa1f1d9b640 1 -- 172.21.15.60:0/3708731659 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4009690 con 0x7fa1e00039e0 2024-09-12T01:38:09.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.205+0000 7fa1f89b0640 1 -- 172.21.15.60:0/3708731659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1e00039e0 msgr2=0x7fa1e0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.205+0000 7fa1f89b0640 1 --2- 172.21.15.60:0/3708731659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1e00039e0 0x7fa1e0003e00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009a90 tx=0x7fa1e0005830 comp rx=0 tx=0).stop 2024-09-12T01:38:09.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.205+0000 7fa1f2d9d640 1 -- 172.21.15.60:0/3708731659 reap_dead start 2024-09-12T01:38:09.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.205+0000 7fa1f89b0640 1 -- 172.21.15.60:0/3708731659 shutdown_connections 2024-09-12T01:38:09.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.205+0000 7fa1f89b0640 1 -- 172.21.15.60:0/3708731659 >> 172.21.15.60:0/3708731659 conn(0x7fa1f40b6410 msgr2=0x7fa1f40b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:09.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.205+0000 7fa1f89b0640 1 -- 172.21.15.60:0/3708731659 shutdown_connections 2024-09-12T01:38:09.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.205+0000 7fa1f89b0640 1 -- 172.21.15.60:0/3708731659 wait complete. 2024-09-12T01:38:09.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.207+0000 7fa1f89b0640 1 Processor -- start 2024-09-12T01:38:09.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.207+0000 7fa1f89b0640 1 -- start start 2024-09-12T01:38:09.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.207+0000 7fa1f89b0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1e00039e0 0x7fa1f41f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.207+0000 7fa1f89b0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f41f4300 0x7fa1f41519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.207+0000 7fa1f89b0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f4151f30 0x7fa1f40b9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.207+0000 7fa1f89b0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f40cf730 con 0x7fa1e00039e0 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.207+0000 7fa1f89b0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f40d43f0 con 0x7fa1f4151f30 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.207+0000 7fa1f89b0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f40cf8b0 con 0x7fa1f41f4300 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.207+0000 7fa1f259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1e00039e0 0x7fa1f41f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.207+0000 7fa1f259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1e00039e0 0x7fa1f41f3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52914/0 (socket says 172.21.15.60:52914) 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.207+0000 7fa1f259c640 1 -- 172.21.15.60:0/1716988926 learned_addr learned my addr 172.21.15.60:0/1716988926 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1ebfff640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f41f4300 0x7fa1f41519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1f2d9d640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f4151f30 0x7fa1f40b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1f259c640 1 -- 172.21.15.60:0/1716988926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f41f4300 msgr2=0x7fa1f41519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1f259c640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f41f4300 0x7fa1f41519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1f259c640 1 -- 172.21.15.60:0/1716988926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f4151f30 msgr2=0x7fa1f40b9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1f259c640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f4151f30 0x7fa1f40b9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1f259c640 1 -- 172.21.15.60:0/1716988926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f40ce270 con 0x7fa1e00039e0 2024-09-12T01:38:09.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1f259c640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1e00039e0 0x7fa1f41f3dc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4034040 tx=0x7fa1e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:09.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1eaffd640 1 -- 172.21.15.60:0/1716988926 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4040020 con 0x7fa1e00039e0 2024-09-12T01:38:09.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1eaffd640 1 -- 172.21.15.60:0/1716988926 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4003bc0 con 0x7fa1e00039e0 2024-09-12T01:38:09.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1f89b0640 1 -- 172.21.15.60:0/1716988926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f40b9fd0 con 0x7fa1e00039e0 2024-09-12T01:38:09.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1eaffd640 1 -- 172.21.15.60:0/1716988926 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4036040 con 0x7fa1e00039e0 2024-09-12T01:38:09.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.208+0000 7fa1f89b0640 1 -- 172.21.15.60:0/1716988926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f41610a0 con 0x7fa1e00039e0 2024-09-12T01:38:09.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.209+0000 7fa1f89b0640 1 -- 172.21.15.60:0/1716988926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f40cfd10 con 0x7fa1e00039e0 2024-09-12T01:38:09.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.210+0000 7fa1eaffd640 1 -- 172.21.15.60:0/1716988926 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1e4043020 con 0x7fa1e00039e0 2024-09-12T01:38:09.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.210+0000 7fa1eaffd640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa1d406be60 0x7fa1d406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.210+0000 7fa1eaffd640 1 -- 172.21.15.60:0/1716988926 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7fa1e40aac20 con 0x7fa1e00039e0 2024-09-12T01:38:09.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.210+0000 7fa1ebfff640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa1d406be60 0x7fa1d406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.211+0000 7fa1ebfff640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa1d406be60 0x7fa1d406e320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc007fd0 tx=0x7fa1dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:09.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.215+0000 7fa1eaffd640 1 -- 172.21.15.60:0/1716988926 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1e404a070 con 0x7fa1e00039e0 2024-09-12T01:38:09.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.393+0000 7fa1f89b0640 1 -- 172.21.15.60:0/1716988926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa1f40ce6e0 con 0x7fa1e00039e0 2024-09-12T01:38:09.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.394+0000 7fa1eaffd640 1 -- 172.21.15.60:0/1716988926 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) ==== 84+0+65 (secure 0 0 0) 0x7fa1f40ce270 con 0x7fa1e00039e0 2024-09-12T01:38:09.394 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:09.394 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T01:38:09.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:09.394 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T01:38:09.394 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T01:38:09.394 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:09.394 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T01:38:09.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.396+0000 7fa1f89b0640 1 -- 172.21.15.60:0/1716988926 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa1d406be60 msgr2=0x7fa1d406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.396+0000 7fa1f89b0640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa1d406be60 0x7fa1d406e320 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc007fd0 tx=0x7fa1dc009040 comp rx=0 tx=0).stop 2024-09-12T01:38:09.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.396+0000 7fa1f89b0640 1 -- 172.21.15.60:0/1716988926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1e00039e0 msgr2=0x7fa1f41f3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.396+0000 7fa1f89b0640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1e00039e0 0x7fa1f41f3dc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4034040 tx=0x7fa1e4004730 comp rx=0 tx=0).stop 2024-09-12T01:38:09.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.396+0000 7fa1f89b0640 1 -- 172.21.15.60:0/1716988926 shutdown_connections 2024-09-12T01:38:09.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.396+0000 7fa1f89b0640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f4151f30 0x7fa1f40b9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.396+0000 7fa1f89b0640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa1d406be60 0x7fa1d406e320 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.396+0000 7fa1f89b0640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f41f4300 0x7fa1f41519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.396+0000 7fa1f89b0640 1 --2- 172.21.15.60:0/1716988926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1e00039e0 0x7fa1f41f3dc0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.396+0000 7fa1f89b0640 1 -- 172.21.15.60:0/1716988926 >> 172.21.15.60:0/1716988926 conn(0x7fa1f40b6410 msgr2=0x7fa1f40d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:09.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.396+0000 7fa1f89b0640 1 -- 172.21.15.60:0/1716988926 shutdown_connections 2024-09-12T01:38:09.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.396+0000 7fa1f89b0640 1 -- 172.21.15.60:0/1716988926 wait complete. 2024-09-12T01:38:09.406 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:38:09.407 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:38:09.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.514+0000 7fb634386640 1 Processor -- start 2024-09-12T01:38:09.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.514+0000 7fb634386640 1 -- start start 2024-09-12T01:38:09.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb634386640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb62c15c490 0x7fb62c0b7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb634386640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb62c071450 0x7fb62c0b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb634386640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb62c0719c0 con 0x7fb62c06f400 2024-09-12T01:38:09.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb634386640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb62c0b6860 con 0x7fb62c071450 2024-09-12T01:38:09.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb634386640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb62c0b6490 con 0x7fb62c15c490 2024-09-12T01:38:09.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb631921640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb62c071450 0x7fb62c0b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb631921640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb62c071450 0x7fb62c0b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52920/0 (socket says 172.21.15.60:52920) 2024-09-12T01:38:09.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb631921640 1 -- 172.21.15.60:0/634069575 learned_addr learned my addr 172.21.15.60:0/634069575 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:09.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb632923640 1 --1- 172.21.15.60:0/634069575 >> v1:172.21.15.60:6789/0 conn(0x7fb62c06f400 0x7fb62c06f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40286/0 (socket says 172.21.15.60:40286) 2024-09-12T01:38:09.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb632122640 1 --2- 172.21.15.60:0/634069575 >> v2:172.21.15.105:3300/0 conn(0x7fb62c15c490 0x7fb62c0b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb631921640 1 -- 172.21.15.60:0/634069575 >> v2:172.21.15.105:3300/0 conn(0x7fb62c15c490 msgr2=0x7fb62c0b7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:09.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb631921640 1 --2- 172.21.15.60:0/634069575 >> v2:172.21.15.105:3300/0 conn(0x7fb62c15c490 0x7fb62c0b7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb631921640 1 -- 172.21.15.60:0/634069575 >> v1:172.21.15.60:6789/0 conn(0x7fb62c06f400 legacy=0x7fb62c06f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb631921640 1 -- 172.21.15.60:0/634069575 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62c0b6ab0 con 0x7fb62c071450 2024-09-12T01:38:09.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb631120640 1 -- 172.21.15.60:0/634069575 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3657831312 0 0) 0x7fb62c0719c0 con 0x7fb62c06f400 2024-09-12T01:38:09.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.515+0000 7fb632122640 1 --2- 172.21.15.60:0/634069575 >> v2:172.21.15.105:3300/0 conn(0x7fb62c15c490 0x7fb62c0b7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:09.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.516+0000 7fb631921640 1 --2- 172.21.15.60:0/634069575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb62c071450 0x7fb62c0b5f50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0b4fc0 tx=0x7fb62002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7275c35d593b6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:09.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.516+0000 7fb631120640 1 -- 172.21.15.60:0/634069575 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620037070 con 0x7fb62c071450 2024-09-12T01:38:09.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.516+0000 7fb631120640 1 -- 172.21.15.60:0/634069575 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb620032440 con 0x7fb62c071450 2024-09-12T01:38:09.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.516+0000 7fb631120640 1 -- 172.21.15.60:0/634069575 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620032810 con 0x7fb62c071450 2024-09-12T01:38:09.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.517+0000 7fb634386640 1 -- 172.21.15.60:0/634069575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb62c071450 msgr2=0x7fb62c0b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.517+0000 7fb634386640 1 --2- 172.21.15.60:0/634069575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb62c071450 0x7fb62c0b5f50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0b4fc0 tx=0x7fb62002a270 comp rx=0 tx=0).stop 2024-09-12T01:38:09.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.517+0000 7fb634386640 1 -- 172.21.15.60:0/634069575 shutdown_connections 2024-09-12T01:38:09.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.517+0000 7fb634386640 1 --2- 172.21.15.60:0/634069575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb62c071450 0x7fb62c0b5f50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.517+0000 7fb634386640 1 --2- 172.21.15.60:0/634069575 >> v2:172.21.15.105:3300/0 conn(0x7fb62c15c490 0x7fb62c0b7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.517+0000 7fb634386640 1 -- 172.21.15.60:0/634069575 >> 172.21.15.60:0/634069575 conn(0x7fb62c0b4240 msgr2=0x7fb62c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.517+0000 7fb634386640 1 -- 172.21.15.60:0/634069575 shutdown_connections 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.517+0000 7fb634386640 1 -- 172.21.15.60:0/634069575 wait complete. 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.518+0000 7fb634386640 1 Processor -- start 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.518+0000 7fb634386640 1 -- start start 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb634386640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb62c06f400 0x7fb62c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb634386640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb62c071450 0x7fb62c155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb634386640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb62c15c490 0x7fb62c0c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb634386640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c15c870 con 0x7fb62c071450 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb634386640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c0b7070 con 0x7fb62c15c490 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb634386640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb62c0d0270 con 0x7fb62c06f400 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb631921640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb62c071450 0x7fb62c155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb631921640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb62c071450 0x7fb62c155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52932/0 (socket says 172.21.15.60:52932) 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb631921640 1 -- 172.21.15.60:0/732543007 learned_addr learned my addr 172.21.15.60:0/732543007 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb632122640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb62c06f400 0x7fb62c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb631921640 1 -- 172.21.15.60:0/732543007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb62c06f400 msgr2=0x7fb62c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb632923640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb62c15c490 0x7fb62c0c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb631921640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb62c06f400 0x7fb62c0cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb631921640 1 -- 172.21.15.60:0/732543007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb62c15c490 msgr2=0x7fb62c0c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb631921640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb62c15c490 0x7fb62c0c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb631921640 1 -- 172.21.15.60:0/732543007 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62c155990 con 0x7fb62c071450 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb631921640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb62c071450 0x7fb62c155220 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb620000c00 tx=0x7fb6200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.519+0000 7fb62affd640 1 -- 172.21.15.60:0/732543007 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620037040 con 0x7fb62c071450 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.520+0000 7fb62affd640 1 -- 172.21.15.60:0/732543007 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb620004030 con 0x7fb62c071450 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.520+0000 7fb634386640 1 -- 172.21.15.60:0/732543007 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62c155c70 con 0x7fb62c071450 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.520+0000 7fb62affd640 1 -- 172.21.15.60:0/732543007 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620004400 con 0x7fb62c071450 2024-09-12T01:38:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.520+0000 7fb634386640 1 -- 172.21.15.60:0/732543007 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb62c156230 con 0x7fb62c071450 2024-09-12T01:38:09.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.520+0000 7fb634386640 1 -- 172.21.15.60:0/732543007 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb62c0b5f50 con 0x7fb62c071450 2024-09-12T01:38:09.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.521+0000 7fb62affd640 1 -- 172.21.15.60:0/732543007 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb62003a070 con 0x7fb62c071450 2024-09-12T01:38:09.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.521+0000 7fb62affd640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb61806be30 0x7fb61806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:09.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.522+0000 7fb62affd640 1 -- 172.21.15.60:0/732543007 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 4857+0+0 (secure 0 0 0) 0x7fb6200ab1f0 con 0x7fb62c071450 2024-09-12T01:38:09.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.522+0000 7fb632122640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb61806be30 0x7fb61806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:09.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.522+0000 7fb632122640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb61806be30 0x7fb61806e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb6240096d0 tx=0x7fb624008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:09.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.526+0000 7fb62affd640 1 -- 172.21.15.60:0/732543007 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb620041020 con 0x7fb62c071450 2024-09-12T01:38:09.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:09.703+0000 7fb634386640 1 -- 172.21.15.60:0/732543007 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb62c0693c0 con 0x7fb62c071450 2024-09-12T01:38:10.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.703+0000 7fb62affd640 1 -- 172.21.15.60:0/732543007 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) ==== 138+0+0 (secure 0 0 0) 0x7fb620079e60 con 0x7fb62c071450 2024-09-12T01:38:10.703 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-12T01:38:10.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.707+0000 7fb634386640 1 -- 172.21.15.60:0/732543007 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb61806be30 msgr2=0x7fb61806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.707+0000 7fb634386640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb61806be30 0x7fb61806e2f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb6240096d0 tx=0x7fb624008040 comp rx=0 tx=0).stop 2024-09-12T01:38:10.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.707+0000 7fb634386640 1 -- 172.21.15.60:0/732543007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb62c071450 msgr2=0x7fb62c155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.707+0000 7fb634386640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb62c071450 0x7fb62c155220 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb620000c00 tx=0x7fb6200046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.707+0000 7fb634386640 1 -- 172.21.15.60:0/732543007 shutdown_connections 2024-09-12T01:38:10.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.707+0000 7fb634386640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb62c15c490 0x7fb62c0c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.707+0000 7fb634386640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb62c071450 0x7fb62c155220 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.707+0000 7fb634386640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb61806be30 0x7fb61806e2f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.707+0000 7fb634386640 1 --2- 172.21.15.60:0/732543007 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb62c06f400 0x7fb62c0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.707+0000 7fb634386640 1 -- 172.21.15.60:0/732543007 >> 172.21.15.60:0/732543007 conn(0x7fb62c0b4240 msgr2=0x7fb62c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:10.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.707+0000 7fb634386640 1 -- 172.21.15.60:0/732543007 shutdown_connections 2024-09-12T01:38:10.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.707+0000 7fb634386640 1 -- 172.21.15.60:0/732543007 wait complete. 2024-09-12T01:38:10.724 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:38:10.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.840+0000 7ffb73a8d640 1 Processor -- start 2024-09-12T01:38:10.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.840+0000 7ffb73a8d640 1 -- start start 2024-09-12T01:38:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.841+0000 7ffb73a8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c158a00 0x7ffb6c071f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.841+0000 7ffb73a8d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb6c158de0 0x7ffb6c06eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.841+0000 7ffb73a8d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6c0728f0 con 0x7ffb6c072470 2024-09-12T01:38:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.841+0000 7ffb73a8d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ffb6c072bd0 con 0x7ffb6c158de0 2024-09-12T01:38:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.841+0000 7ffb73a8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6c072eb0 con 0x7ffb6c158a00 2024-09-12T01:38:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.841+0000 7ffb7202a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb6c158de0 0x7ffb6c06eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.841+0000 7ffb7202a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb6c158de0 0x7ffb6c06eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52938/0 (socket says 172.21.15.60:52938) 2024-09-12T01:38:10.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.841+0000 7ffb7202a640 1 -- 172.21.15.60:0/1370533202 learned_addr learned my addr 172.21.15.60:0/1370533202 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:10.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.841+0000 7ffb71829640 1 --2- 172.21.15.60:0/1370533202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c158a00 0x7ffb6c071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.842+0000 7ffb7202a640 1 -- 172.21.15.60:0/1370533202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c158a00 msgr2=0x7ffb6c071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:10.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.842+0000 7ffb7202a640 1 --2- 172.21.15.60:0/1370533202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c158a00 0x7ffb6c071f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.842+0000 7ffb7202a640 1 -- 172.21.15.60:0/1370533202 >> v1:172.21.15.105:6789/0 conn(0x7ffb6c072470 legacy=0x7ffb6c0b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.842+0000 7ffb7202a640 1 -- 172.21.15.60:0/1370533202 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c073190 con 0x7ffb6c158de0 2024-09-12T01:38:10.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.842+0000 7ffb7202a640 1 --2- 172.21.15.60:0/1370533202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c158de0 0x7ffb6c06eae0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009e50 tx=0x7ffb5c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4eabb6c49f184c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:10.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.843+0000 7ffb70827640 1 -- 172.21.15.60:0/1370533202 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c036070 con 0x7ffb6c158de0 2024-09-12T01:38:10.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.843+0000 7ffb70827640 1 -- 172.21.15.60:0/1370533202 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5c031600 con 0x7ffb6c158de0 2024-09-12T01:38:10.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.843+0000 7ffb70827640 1 -- 172.21.15.60:0/1370533202 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0319d0 con 0x7ffb6c158de0 2024-09-12T01:38:10.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.843+0000 7ffb73a8d640 1 -- 172.21.15.60:0/1370533202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c158de0 msgr2=0x7ffb6c06eae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.843+0000 7ffb73a8d640 1 --2- 172.21.15.60:0/1370533202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c158de0 0x7ffb6c06eae0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009e50 tx=0x7ffb5c02a710 comp rx=0 tx=0).stop 2024-09-12T01:38:10.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.843+0000 7ffb73a8d640 1 -- 172.21.15.60:0/1370533202 shutdown_connections 2024-09-12T01:38:10.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.843+0000 7ffb73a8d640 1 --2- 172.21.15.60:0/1370533202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c158de0 0x7ffb6c06eae0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.843+0000 7ffb73a8d640 1 --2- 172.21.15.60:0/1370533202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c158a00 0x7ffb6c071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.843+0000 7ffb73a8d640 1 -- 172.21.15.60:0/1370533202 >> 172.21.15.60:0/1370533202 conn(0x7ffb6c06cb50 msgr2=0x7ffb6c06cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:10.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.843+0000 7ffb73a8d640 1 -- 172.21.15.60:0/1370533202 shutdown_connections 2024-09-12T01:38:10.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.843+0000 7ffb73a8d640 1 -- 172.21.15.60:0/1370533202 wait complete. 2024-09-12T01:38:10.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.844+0000 7ffb73a8d640 1 Processor -- start 2024-09-12T01:38:10.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.844+0000 7ffb73a8d640 1 -- start start 2024-09-12T01:38:10.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.845+0000 7ffb73a8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c072470 0x7ffb6c13d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.845+0000 7ffb73a8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c158a00 0x7ffb6c1f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.845+0000 7ffb73a8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb6c158de0 0x7ffb6c06e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.845+0000 7ffb73a8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c0b5ca0 con 0x7ffb6c158a00 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.845+0000 7ffb73a8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c0b5b20 con 0x7ffb6c158de0 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.845+0000 7ffb73a8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6c0b5570 con 0x7ffb6c072470 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.845+0000 7ffb71028640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c158a00 0x7ffb6c1f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.845+0000 7ffb71028640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c158a00 0x7ffb6c1f4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52948/0 (socket says 172.21.15.60:52948) 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.845+0000 7ffb71028640 1 -- 172.21.15.60:0/2912346342 learned_addr learned my addr 172.21.15.60:0/2912346342 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.845+0000 7ffb71829640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c072470 0x7ffb6c13d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.845+0000 7ffb7202a640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb6c158de0 0x7ffb6c06e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.846+0000 7ffb71028640 1 -- 172.21.15.60:0/2912346342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c072470 msgr2=0x7ffb6c13d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.846+0000 7ffb71028640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c072470 0x7ffb6c13d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.846+0000 7ffb71028640 1 -- 172.21.15.60:0/2912346342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb6c158de0 msgr2=0x7ffb6c06e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.846+0000 7ffb71028640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb6c158de0 0x7ffb6c06e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.846+0000 7ffb71028640 1 -- 172.21.15.60:0/2912346342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c13da70 con 0x7ffb6c158a00 2024-09-12T01:38:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.846+0000 7ffb71028640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c158a00 0x7ffb6c1f4a90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000c400 tx=0x7ffb6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:10.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.846+0000 7ffb6a7fc640 1 -- 172.21.15.60:0/2912346342 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb600052d0 con 0x7ffb6c158a00 2024-09-12T01:38:10.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.846+0000 7ffb6a7fc640 1 -- 172.21.15.60:0/2912346342 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb60005490 con 0x7ffb6c158a00 2024-09-12T01:38:10.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.846+0000 7ffb73a8d640 1 -- 172.21.15.60:0/2912346342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6c1f4fd0 con 0x7ffb6c158a00 2024-09-12T01:38:10.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.846+0000 7ffb6a7fc640 1 -- 172.21.15.60:0/2912346342 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60007260 con 0x7ffb6c158a00 2024-09-12T01:38:10.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.846+0000 7ffb73a8d640 1 -- 172.21.15.60:0/2912346342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb6c1f7ca0 con 0x7ffb6c158a00 2024-09-12T01:38:10.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.847+0000 7ffb73a8d640 1 -- 172.21.15.60:0/2912346342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb6c0b5890 con 0x7ffb6c158a00 2024-09-12T01:38:10.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.848+0000 7ffb6a7fc640 1 -- 172.21.15.60:0/2912346342 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb60007400 con 0x7ffb6c158a00 2024-09-12T01:38:10.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.848+0000 7ffb6a7fc640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb5806be60 0x7ffb5806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:10.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.848+0000 7ffb6a7fc640 1 -- 172.21.15.60:0/2912346342 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5227+0+0 (secure 0 0 0) 0x7ffb6008a060 con 0x7ffb6c158a00 2024-09-12T01:38:10.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.848+0000 7ffb71829640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb5806be60 0x7ffb5806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:10.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.849+0000 7ffb71829640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb5806be60 0x7ffb5806e320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffb64006fd0 tx=0x7ffb64008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:10.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:10.853+0000 7ffb6a7fc640 1 -- 172.21.15.60:0/2912346342 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb6c0b5890 con 0x7ffb6c158a00 2024-09-12T01:38:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.029+0000 7ffb73a8d640 1 -- 172.21.15.60:0/2912346342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7ffb6c071f30 con 0x7ffb6c158a00 2024-09-12T01:38:11.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.709+0000 7ffb6a7fc640 1 -- 172.21.15.60:0/2912346342 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) ==== 170+0+0 (secure 0 0 0) 0x7ffb60058630 con 0x7ffb6c158a00 2024-09-12T01:38:11.708 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-12T01:38:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.712+0000 7ffb73a8d640 1 -- 172.21.15.60:0/2912346342 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb5806be60 msgr2=0x7ffb5806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.712+0000 7ffb73a8d640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb5806be60 0x7ffb5806e320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ffb64006fd0 tx=0x7ffb64008040 comp rx=0 tx=0).stop 2024-09-12T01:38:11.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.712+0000 7ffb73a8d640 1 -- 172.21.15.60:0/2912346342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c158a00 msgr2=0x7ffb6c1f4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.712+0000 7ffb73a8d640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c158a00 0x7ffb6c1f4a90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000c400 tx=0x7ffb6000c8c0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.713+0000 7ffb73a8d640 1 -- 172.21.15.60:0/2912346342 shutdown_connections 2024-09-12T01:38:11.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.713+0000 7ffb73a8d640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb6c158de0 0x7ffb6c06e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.713+0000 7ffb73a8d640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c158a00 0x7ffb6c1f4a90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.713+0000 7ffb73a8d640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb5806be60 0x7ffb5806e320 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.713+0000 7ffb73a8d640 1 --2- 172.21.15.60:0/2912346342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c072470 0x7ffb6c13d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.713+0000 7ffb73a8d640 1 -- 172.21.15.60:0/2912346342 >> 172.21.15.60:0/2912346342 conn(0x7ffb6c06cb50 msgr2=0x7ffb6c0b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:11.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.713+0000 7ffb73a8d640 1 -- 172.21.15.60:0/2912346342 shutdown_connections 2024-09-12T01:38:11.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.713+0000 7ffb73a8d640 1 -- 172.21.15.60:0/2912346342 wait complete. 2024-09-12T01:38:11.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:38:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.849+0000 7f8fa5952640 1 Processor -- start 2024-09-12T01:38:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.849+0000 7f8fa5952640 1 -- start start 2024-09-12T01:38:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.849+0000 7f8fa5952640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8fa00b6290 0x7f8fa0071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8fa5952640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa00ccff0 con 0x7f8fa0072530 2024-09-12T01:38:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8fa5952640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fa00cd2d0 con 0x7f8fa015b480 2024-09-12T01:38:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8fa5952640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8fa00cd5b0 con 0x7f8fa00b6290 2024-09-12T01:38:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9f7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8fa0072530 0x7f8fa015bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40302/0 (socket says 172.21.15.60:40302) 2024-09-12T01:38:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9f7fe640 1 -- 172.21.15.60:0/3487106709 learned_addr learned my addr 172.21.15.60:0/3487106709 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9e7fc640 1 --2- 172.21.15.60:0/3487106709 >> v2:172.21.15.105:3300/0 conn(0x7f8fa00b6290 0x7f8fa0071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768324196 0 0) 0x7f8fa00ccff0 con 0x7f8fa0072530 2024-09-12T01:38:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f8c003520 con 0x7f8fa0072530 2024-09-12T01:38:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3078745479 0 0) 0x7f8fa00cd2d0 con 0x7f8fa015b480 2024-09-12T01:38:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fa00ccff0 con 0x7f8fa015b480 2024-09-12T01:38:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2337696627 0 0) 0x7f8f8c003520 con 0x7f8fa0072530 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 >> v2:172.21.15.105:3300/0 conn(0x7f8fa00b6290 msgr2=0x7f8fa0071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 --2- 172.21.15.60:0/3487106709 >> v2:172.21.15.105:3300/0 conn(0x7f8fa00b6290 0x7f8fa0071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 >> v1:172.21.15.105:6789/0 conn(0x7f8fa015b480 legacy=0x7f8fa00b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa00cd890 con 0x7f8fa0072530 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f8f98001670 con 0x7f8fa0072530 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 >> v1:172.21.15.60:6789/0 conn(0x7f8fa0072530 legacy=0x7f8fa015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 --2- 172.21.15.60:0/3487106709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f8c003b90 0x7f8f8c003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 --2- 172.21.15.60:0/3487106709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 0x7f8f8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 --2- 172.21.15.60:0/3487106709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f8c005210 0x7f8f8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa00cd5b0 con 0x7f8f8c004800 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c00c140 con 0x7f8f8c005210 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8f8c00c340 con 0x7f8f8c003b90 2024-09-12T01:38:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.850+0000 7f8f9e7fc640 1 --2- 172.21.15.60:0/3487106709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 0x7f8f8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.851+0000 7f8f9effd640 1 --2- 172.21.15.60:0/3487106709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f8c003b90 0x7f8f8c003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.851+0000 7f8f9f7fe640 1 --2- 172.21.15.60:0/3487106709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f8c005210 0x7f8f8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.851+0000 7f8f9e7fc640 1 -- 172.21.15.60:0/3487106709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f8c003b90 msgr2=0x7f8f8c003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.851+0000 7f8f9e7fc640 1 --2- 172.21.15.60:0/3487106709 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8f8c003b90 0x7f8f8c003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.851+0000 7f8f9e7fc640 1 -- 172.21.15.60:0/3487106709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f8c005210 msgr2=0x7f8f8c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.851+0000 7f8f9e7fc640 1 --2- 172.21.15.60:0/3487106709 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8f8c005210 0x7f8f8c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.851+0000 7f8f9e7fc640 1 -- 172.21.15.60:0/3487106709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c003520 con 0x7f8f8c004800 2024-09-12T01:38:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.851+0000 7f8f9f7fe640 1 -- 172.21.15.60:0/3487106709 reap_dead start 2024-09-12T01:38:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.852+0000 7f8f9e7fc640 1 --2- 172.21.15.60:0/3487106709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 0x7f8f8c004c80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009650 tx=0x7f8f8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a72e198eea6de02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.852+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f88038070 con 0x7f8f8c004800 2024-09-12T01:38:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.852+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f88033400 con 0x7f8f8c004800 2024-09-12T01:38:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.852+0000 7f8f9dffb640 1 -- 172.21.15.60:0/3487106709 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f88009690 con 0x7f8f8c004800 2024-09-12T01:38:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.852+0000 7f8fa5952640 1 -- 172.21.15.60:0/3487106709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 msgr2=0x7f8f8c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.852+0000 7f8fa5952640 1 --2- 172.21.15.60:0/3487106709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 0x7f8f8c004c80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009650 tx=0x7f8f8c005830 comp rx=0 tx=0).stop 2024-09-12T01:38:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.852+0000 7f8fa5952640 1 -- 172.21.15.60:0/3487106709 shutdown_connections 2024-09-12T01:38:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.852+0000 7f8fa5952640 1 --2- 172.21.15.60:0/3487106709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 0x7f8f8c004c80 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.852+0000 7f8fa5952640 1 -- 172.21.15.60:0/3487106709 >> 172.21.15.60:0/3487106709 conn(0x7f8fa006d0f0 msgr2=0x7f8fa006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.852+0000 7f8fa5952640 1 -- 172.21.15.60:0/3487106709 shutdown_connections 2024-09-12T01:38:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.852+0000 7f8fa5952640 1 -- 172.21.15.60:0/3487106709 wait complete. 2024-09-12T01:38:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.853+0000 7f8fa5952640 1 Processor -- start 2024-09-12T01:38:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.854+0000 7f8fa5952640 1 -- start start 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.854+0000 7f8fa5952640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 0x7f8fa014dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.854+0000 7f8fa5952640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8fa014e2d0 0x7f8fa0154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.854+0000 7f8fa5952640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8fa015d160 0x7f8fa015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.854+0000 7f8fa5952640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa015b9e0 con 0x7f8f8c004800 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.854+0000 7f8fa5952640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8fa015b860 con 0x7f8fa014e2d0 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.854+0000 7f8fa5952640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8fa0071ff0 con 0x7f8fa015d160 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f9effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 0x7f8fa014dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f9effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 0x7f8fa014dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52964/0 (socket says 172.21.15.60:52964) 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f9effd640 1 -- 172.21.15.60:0/117964447 learned_addr learned my addr 172.21.15.60:0/117964447 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f9e7fc640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8fa014e2d0 0x7f8fa0154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f9f7fe640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8fa015d160 0x7f8fa015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f9effd640 1 -- 172.21.15.60:0/117964447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8fa015d160 msgr2=0x7f8fa015d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f9effd640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8fa015d160 0x7f8fa015d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f9effd640 1 -- 172.21.15.60:0/117964447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8fa014e2d0 msgr2=0x7f8fa0154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f9effd640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8fa014e2d0 0x7f8fa0154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f9effd640 1 -- 172.21.15.60:0/117964447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fa00d05e0 con 0x7f8f8c004800 2024-09-12T01:38:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f9effd640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 0x7f8fa014dc40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000fb40 tx=0x7f8f9000d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f97fff640 1 -- 172.21.15.60:0/117964447 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f9001a070 con 0x7f8f8c004800 2024-09-12T01:38:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f97fff640 1 -- 172.21.15.60:0/117964447 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f90006d60 con 0x7f8f8c004800 2024-09-12T01:38:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8fa5952640 1 -- 172.21.15.60:0/117964447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fa00d0880 con 0x7f8f8c004800 2024-09-12T01:38:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8f97fff640 1 -- 172.21.15.60:0/117964447 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f90003bb0 con 0x7f8f8c004800 2024-09-12T01:38:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.855+0000 7f8fa5952640 1 -- 172.21.15.60:0/117964447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fa00d0e00 con 0x7f8f8c004800 2024-09-12T01:38:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.856+0000 7f8fa5952640 1 -- 172.21.15.60:0/117964447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fa00b5b80 con 0x7f8f8c004800 2024-09-12T01:38:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.857+0000 7f8f97fff640 1 -- 172.21.15.60:0/117964447 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8f9001d070 con 0x7f8f8c004800 2024-09-12T01:38:11.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.857+0000 7f8f97fff640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8f8006be30 0x7f8f8006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:11.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.857+0000 7f8f97fff640 1 -- 172.21.15.60:0/117964447 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5609+0+0 (secure 0 0 0) 0x7f8f9008a9e0 con 0x7f8f8c004800 2024-09-12T01:38:11.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.857+0000 7f8f9e7fc640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8f8006be30 0x7f8f8006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:11.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.858+0000 7f8f9e7fc640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8f8006be30 0x7f8f8006e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8f88035000 tx=0x7f8f88008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:11.862+0000 7f8f97fff640 1 -- 172.21.15.60:0/117964447 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8f90058d00 con 0x7f8f8c004800 2024-09-12T01:38:12.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.078+0000 7f8fa5952640 1 -- 172.21.15.60:0/117964447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f8fa0151630 con 0x7f8f8c004800 2024-09-12T01:38:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.721+0000 7f8f97fff640 1 -- 172.21.15.60:0/117964447 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) ==== 172+0+0 (secure 0 0 0) 0x7f8f9005d000 con 0x7f8f8c004800 2024-09-12T01:38:12.720 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 8 and data pool 9 2024-09-12T01:38:12.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.727+0000 7f8fa5952640 1 -- 172.21.15.60:0/117964447 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8f8006be30 msgr2=0x7f8f8006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:12.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.727+0000 7f8fa5952640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8f8006be30 0x7f8f8006e2f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8f88035000 tx=0x7f8f88008030 comp rx=0 tx=0).stop 2024-09-12T01:38:12.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.727+0000 7f8fa5952640 1 -- 172.21.15.60:0/117964447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 msgr2=0x7f8fa014dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:12.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.727+0000 7f8fa5952640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 0x7f8fa014dc40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000fb40 tx=0x7f8f9000d150 comp rx=0 tx=0).stop 2024-09-12T01:38:12.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.727+0000 7f8fa5952640 1 -- 172.21.15.60:0/117964447 shutdown_connections 2024-09-12T01:38:12.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.727+0000 7f8fa5952640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8f8006be30 0x7f8f8006e2f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:12.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.727+0000 7f8fa5952640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8fa015d160 0x7f8fa015d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:12.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.727+0000 7f8fa5952640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8fa014e2d0 0x7f8fa0154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:12.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.727+0000 7f8fa5952640 1 --2- 172.21.15.60:0/117964447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8f8c004800 0x7f8fa014dc40 secure :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000fb40 tx=0x7f8f9000d150 comp rx=0 tx=0).stop 2024-09-12T01:38:12.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.727+0000 7f8fa5952640 1 -- 172.21.15.60:0/117964447 >> 172.21.15.60:0/117964447 conn(0x7f8fa006d0f0 msgr2=0x7f8fa0159360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:12.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.728+0000 7f8fa5952640 1 -- 172.21.15.60:0/117964447 shutdown_connections 2024-09-12T01:38:12.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.728+0000 7f8fa5952640 1 -- 172.21.15.60:0/117964447 wait complete. 2024-09-12T01:38:12.747 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:12.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.853+0000 7f55e13b7640 1 Processor -- start 2024-09-12T01:38:12.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.853+0000 7f55e13b7640 1 -- start start 2024-09-12T01:38:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.854+0000 7f55e13b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f55dc15e640 0x7f55dc0d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.854+0000 7f55e13b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55dc0d18c0 0x7f55dc0d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.854+0000 7f55e13b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55dc0cfd80 con 0x7f55dc0cf940 2024-09-12T01:38:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.854+0000 7f55e13b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f55dc0d3a30 con 0x7f55dc15e640 2024-09-12T01:38:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.854+0000 7f55e13b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f55dc0d3c60 con 0x7f55dc0d18c0 2024-09-12T01:38:12.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.854+0000 7f55db7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55dc0d18c0 0x7f55dc0d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:12.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.854+0000 7f55daffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f55dc15e640 0x7f55dc0d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:12.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.854+0000 7f55da7fc640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f55dc0cf940 0x7f55dc0d11b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:54564/0 (socket says 172.21.15.60:54564) 2024-09-12T01:38:12.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.854+0000 7f55daffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f55dc15e640 0x7f55dc0d4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:60240/0 (socket says 172.21.15.60:60240) 2024-09-12T01:38:12.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.854+0000 7f55da7fc640 1 -- 172.21.15.60:0/2575713702 learned_addr learned my addr 172.21.15.60:0/2575713702 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:12.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.855+0000 7f55daffd640 1 -- 172.21.15.60:0/2575713702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55dc0d18c0 msgr2=0x7f55dc0d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:12.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.855+0000 7f55daffd640 1 --2- 172.21.15.60:0/2575713702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55dc0d18c0 0x7f55dc0d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:12.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.855+0000 7f55daffd640 1 -- 172.21.15.60:0/2575713702 >> v1:172.21.15.105:6789/0 conn(0x7f55dc0cf940 legacy=0x7f55dc0d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:12.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.855+0000 7f55daffd640 1 -- 172.21.15.60:0/2575713702 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc0d3f40 con 0x7f55dc15e640 2024-09-12T01:38:12.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.856+0000 7f55daffd640 1 --2- 172.21.15.60:0/2575713702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55dc15e640 0x7f55dc0d4d00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0097a0 tx=0x7f55cc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434eda0d4e60fa65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:12.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.856+0000 7f55d9ffb640 1 -- 172.21.15.60:0/2575713702 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc037070 con 0x7f55dc15e640 2024-09-12T01:38:12.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.856+0000 7f55d9ffb640 1 -- 172.21.15.60:0/2575713702 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55cc032440 con 0x7f55dc15e640 2024-09-12T01:38:12.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.856+0000 7f55d9ffb640 1 -- 172.21.15.60:0/2575713702 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55cc032810 con 0x7f55dc15e640 2024-09-12T01:38:12.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.856+0000 7f55e13b7640 1 -- 172.21.15.60:0/2575713702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55dc15e640 msgr2=0x7f55dc0d4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:12.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.856+0000 7f55e13b7640 1 --2- 172.21.15.60:0/2575713702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55dc15e640 0x7f55dc0d4d00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0097a0 tx=0x7f55cc02a180 comp rx=0 tx=0).stop 2024-09-12T01:38:12.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.856+0000 7f55e13b7640 1 -- 172.21.15.60:0/2575713702 shutdown_connections 2024-09-12T01:38:12.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.856+0000 7f55e13b7640 1 --2- 172.21.15.60:0/2575713702 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55dc0d18c0 0x7f55dc0d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:12.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.856+0000 7f55e13b7640 1 --2- 172.21.15.60:0/2575713702 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55dc15e640 0x7f55dc0d4d00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:12.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.856+0000 7f55e13b7640 1 -- 172.21.15.60:0/2575713702 >> 172.21.15.60:0/2575713702 conn(0x7f55dc062a50 msgr2=0x7f55dc062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:12.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.856+0000 7f55e13b7640 1 -- 172.21.15.60:0/2575713702 shutdown_connections 2024-09-12T01:38:12.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.856+0000 7f55e13b7640 1 -- 172.21.15.60:0/2575713702 wait complete. 2024-09-12T01:38:12.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.858+0000 7f55e13b7640 1 Processor -- start 2024-09-12T01:38:12.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.858+0000 7f55e13b7640 1 -- start start 2024-09-12T01:38:12.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.858+0000 7f55e13b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55dc0cf940 0x7f55dc151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:12.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.858+0000 7f55e13b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0d18c0 0x7f55dc0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:12.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.858+0000 7f55e13b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55dc15e640 0x7f55dc15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:12.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.858+0000 7f55e13b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc15ea20 con 0x7f55dc0d18c0 2024-09-12T01:38:12.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.858+0000 7f55e13b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f55dc0d4500 con 0x7f55dc0cf940 2024-09-12T01:38:12.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.858+0000 7f55e13b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f55dc15eba0 con 0x7f55dc15e640 2024-09-12T01:38:12.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55da7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0d18c0 0x7f55dc0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:12.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55da7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0d18c0 0x7f55dc0caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38294/0 (socket says 172.21.15.60:38294) 2024-09-12T01:38:12.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55da7fc640 1 -- 172.21.15.60:0/2942510570 learned_addr learned my addr 172.21.15.60:0/2942510570 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:12.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55daffd640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55dc0cf940 0x7f55dc151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:12.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55db7fe640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55dc15e640 0x7f55dc15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:12.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55da7fc640 1 -- 172.21.15.60:0/2942510570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55dc15e640 msgr2=0x7f55dc15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:12.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55da7fc640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55dc15e640 0x7f55dc15cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:12.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55da7fc640 1 -- 172.21.15.60:0/2942510570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55dc0cf940 msgr2=0x7f55dc151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:12.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55da7fc640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55dc0cf940 0x7f55dc151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:12.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55da7fc640 1 -- 172.21.15.60:0/2942510570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc0b7ca0 con 0x7f55dc0d18c0 2024-09-12T01:38:12.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55daffd640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55dc0cf940 0x7f55dc151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:12.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55da7fc640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0d18c0 0x7f55dc0caba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f55d000c400 tx=0x7f55d000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:12.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55c37fe640 1 -- 172.21.15.60:0/2942510570 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0017070 con 0x7f55dc0d18c0 2024-09-12T01:38:12.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55c37fe640 1 -- 172.21.15.60:0/2942510570 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55d0005d30 con 0x7f55dc0d18c0 2024-09-12T01:38:12.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55e13b7640 1 -- 172.21.15.60:0/2942510570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55dc0b7f80 con 0x7f55dc0d18c0 2024-09-12T01:38:12.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55c37fe640 1 -- 172.21.15.60:0/2942510570 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d00072f0 con 0x7f55dc0d18c0 2024-09-12T01:38:12.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.859+0000 7f55e13b7640 1 -- 172.21.15.60:0/2942510570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55dc0b8540 con 0x7f55dc0d18c0 2024-09-12T01:38:12.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.860+0000 7f55e13b7640 1 -- 172.21.15.60:0/2942510570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55dc0d34f0 con 0x7f55dc0d18c0 2024-09-12T01:38:12.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.861+0000 7f55c37fe640 1 -- 172.21.15.60:0/2942510570 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55d001a070 con 0x7f55dc0d18c0 2024-09-12T01:38:12.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.861+0000 7f55c37fe640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f55c806be30 0x7f55c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:12.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.861+0000 7f55c37fe640 1 -- 172.21.15.60:0/2942510570 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f55d008a200 con 0x7f55dc0d18c0 2024-09-12T01:38:12.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.862+0000 7f55daffd640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f55c806be30 0x7f55c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:12.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.862+0000 7f55daffd640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f55c806be30 0x7f55c806e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f55cc034000 tx=0x7f55cc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:12.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:12.866+0000 7f55c37fe640 1 -- 172.21.15.60:0/2942510570 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55d0058550 con 0x7f55dc0d18c0 2024-09-12T01:38:13.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.042+0000 7f55e13b7640 1 -- 172.21.15.60:0/2942510570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f55dc0ce5e0 con 0x7f55dc0d18c0 2024-09-12T01:38:13.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.044+0000 7f55c37fe640 1 -- 172.21.15.60:0/2942510570 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16702 (secure 0 0 0) 0x7f55d005c850 con 0x7f55dc0d18c0 2024-09-12T01:38:13.043 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:13.043 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":56,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:38:12.079081+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:38:09.733918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T01:38:11.059626+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:13.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.045+0000 7f55e13b7640 1 -- 172.21.15.60:0/2942510570 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f55c806be30 msgr2=0x7f55c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.045+0000 7f55e13b7640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f55c806be30 0x7f55c806e2f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f55cc034000 tx=0x7f55cc02e000 comp rx=0 tx=0).stop 2024-09-12T01:38:13.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.046+0000 7f55e13b7640 1 -- 172.21.15.60:0/2942510570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0d18c0 msgr2=0x7f55dc0caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.046+0000 7f55e13b7640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0d18c0 0x7f55dc0caba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f55d000c400 tx=0x7f55d000c8c0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.046+0000 7f55e13b7640 1 -- 172.21.15.60:0/2942510570 shutdown_connections 2024-09-12T01:38:13.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.046+0000 7f55e13b7640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f55c806be30 0x7f55c806e2f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.046+0000 7f55e13b7640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55dc15e640 0x7f55dc15cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.046+0000 7f55e13b7640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55dc0d18c0 0x7f55dc0caba0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.046+0000 7f55e13b7640 1 --2- 172.21.15.60:0/2942510570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55dc0cf940 0x7f55dc151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.046+0000 7f55e13b7640 1 -- 172.21.15.60:0/2942510570 >> 172.21.15.60:0/2942510570 conn(0x7f55dc062a50 msgr2=0x7f55dc0cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:13.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.046+0000 7f55e13b7640 1 -- 172.21.15.60:0/2942510570 shutdown_connections 2024-09-12T01:38:13.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.046+0000 7f55e13b7640 1 -- 172.21.15.60:0/2942510570 wait complete. 2024-09-12T01:38:13.056 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:13.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.160+0000 7f6cd233b640 1 Processor -- start 2024-09-12T01:38:13.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.160+0000 7f6cd233b640 1 -- start start 2024-09-12T01:38:13.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6cd233b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ccc15c2b0 0x7f6ccc0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6cd233b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6ccc15f200 0x7f6ccc06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6cd233b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ccc15fb10 con 0x7f6ccc0b72f0 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6cd233b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6ccc0b5900 con 0x7f6ccc15f200 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6cd233b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6ccc15f830 con 0x7f6ccc15c2b0 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6cd08d8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6ccc15f200 0x7f6ccc06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6ccb7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6ccc0b72f0 0x7f6ccc15eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34804/0 (socket says 172.21.15.60:34804) 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6ccb7fe640 1 -- 172.21.15.60:0/2117489939 learned_addr learned my addr 172.21.15.60:0/2117489939 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6ccbfff640 1 --2- 172.21.15.60:0/2117489939 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ccc15c2b0 0x7f6ccc0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6cd08d8640 1 -- 172.21.15.60:0/2117489939 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ccc15c2b0 msgr2=0x7f6ccc0b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6cd08d8640 1 --2- 172.21.15.60:0/2117489939 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ccc15c2b0 0x7f6ccc0b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6cd08d8640 1 -- 172.21.15.60:0/2117489939 >> v1:172.21.15.60:6789/0 conn(0x7f6ccc0b72f0 legacy=0x7f6ccc15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6ccaffd640 1 -- 172.21.15.60:0/2117489939 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541818051 0 0) 0x7f6ccc15fb10 con 0x7f6ccc0b72f0 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.161+0000 7f6cd08d8640 1 -- 172.21.15.60:0/2117489939 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc06ce30 con 0x7f6ccc15f200 2024-09-12T01:38:13.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.162+0000 7f6cd08d8640 1 --2- 172.21.15.60:0/2117489939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ccc15f200 0x7f6ccc06d910 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009d90 tx=0x7f6cc402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315259c6e5bf7e6a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:13.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.162+0000 7f6ccaffd640 1 -- 172.21.15.60:0/2117489939 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4007740 con 0x7f6ccc15f200 2024-09-12T01:38:13.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.162+0000 7f6ccaffd640 1 -- 172.21.15.60:0/2117489939 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc40078e0 con 0x7f6ccc15f200 2024-09-12T01:38:13.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.162+0000 7f6ccaffd640 1 -- 172.21.15.60:0/2117489939 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4007cb0 con 0x7f6ccc15f200 2024-09-12T01:38:13.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.163+0000 7f6cd233b640 1 -- 172.21.15.60:0/2117489939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ccc15f200 msgr2=0x7f6ccc06d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.163+0000 7f6cd233b640 1 --2- 172.21.15.60:0/2117489939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ccc15f200 0x7f6ccc06d910 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009d90 tx=0x7f6cc402a660 comp rx=0 tx=0).stop 2024-09-12T01:38:13.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.163+0000 7f6cd233b640 1 -- 172.21.15.60:0/2117489939 shutdown_connections 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.163+0000 7f6cd233b640 1 --2- 172.21.15.60:0/2117489939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ccc15f200 0x7f6ccc06d910 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.163+0000 7f6cd233b640 1 --2- 172.21.15.60:0/2117489939 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ccc15c2b0 0x7f6ccc0b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.163+0000 7f6cd233b640 1 -- 172.21.15.60:0/2117489939 >> 172.21.15.60:0/2117489939 conn(0x7f6ccc0b4240 msgr2=0x7f6ccc0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.163+0000 7f6cd233b640 1 -- 172.21.15.60:0/2117489939 shutdown_connections 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.163+0000 7f6cd233b640 1 -- 172.21.15.60:0/2117489939 wait complete. 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.164+0000 7f6cd233b640 1 Processor -- start 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.164+0000 7f6cd233b640 1 -- start start 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd233b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ccc0b72f0 0x7f6ccc155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd233b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ccc15c2b0 0x7f6ccc0cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd233b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ccc15f200 0x7f6ccc1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd233b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc0b7730 con 0x7f6ccc15f200 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd233b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc06d3f0 con 0x7f6ccc15c2b0 2024-09-12T01:38:13.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd233b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6ccc06de50 con 0x7f6ccc0b72f0 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd08d8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ccc15f200 0x7f6ccc1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd08d8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ccc15f200 0x7f6ccc1573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38314/0 (socket says 172.21.15.60:38314) 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd08d8640 1 -- 172.21.15.60:0/3115549977 learned_addr learned my addr 172.21.15.60:0/3115549977 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6ccbfff640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ccc0b72f0 0x7f6ccc155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6ccb7fe640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ccc15c2b0 0x7f6ccc0cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd08d8640 1 -- 172.21.15.60:0/3115549977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ccc0b72f0 msgr2=0x7f6ccc155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd08d8640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ccc0b72f0 0x7f6ccc155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd08d8640 1 -- 172.21.15.60:0/3115549977 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ccc15c2b0 msgr2=0x7f6ccc0cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd08d8640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ccc15c2b0 0x7f6ccc0cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd08d8640 1 -- 172.21.15.60:0/3115549977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc0cbe00 con 0x7f6ccc15f200 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.165+0000 7f6cd08d8640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ccc15f200 0x7f6ccc1573a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009d90 tx=0x7f6cc4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.166+0000 7f6cc8ff9640 1 -- 172.21.15.60:0/3115549977 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc403f070 con 0x7f6ccc15f200 2024-09-12T01:38:13.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.166+0000 7f6cc8ff9640 1 -- 172.21.15.60:0/3115549977 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc4031bc0 con 0x7f6ccc15f200 2024-09-12T01:38:13.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.166+0000 7f6cc8ff9640 1 -- 172.21.15.60:0/3115549977 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4009450 con 0x7f6ccc15f200 2024-09-12T01:38:13.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.166+0000 7f6cd233b640 1 -- 172.21.15.60:0/3115549977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ccc157bd0 con 0x7f6ccc15f200 2024-09-12T01:38:13.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.166+0000 7f6cd233b640 1 -- 172.21.15.60:0/3115549977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ccc155be0 con 0x7f6ccc15f200 2024-09-12T01:38:13.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.167+0000 7f6cd233b640 1 -- 172.21.15.60:0/3115549977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ccc0b6db0 con 0x7f6ccc15f200 2024-09-12T01:38:13.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.167+0000 7f6cc8ff9640 1 -- 172.21.15.60:0/3115549977 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cc403b410 con 0x7f6ccc15f200 2024-09-12T01:38:13.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.168+0000 7f6cc8ff9640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6cb806be30 0x7f6cb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:13.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.168+0000 7f6ccbfff640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6cb806be30 0x7f6cb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:13.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.168+0000 7f6cc8ff9640 1 -- 172.21.15.60:0/3115549977 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f6cc40ac290 con 0x7f6ccc15f200 2024-09-12T01:38:13.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.168+0000 7f6ccbfff640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6cb806be30 0x7f6cb806e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009ad0 tx=0x7f6cbc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:13.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.172+0000 7f6cc8ff9640 1 -- 172.21.15.60:0/3115549977 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6cc407ac30 con 0x7f6ccc15f200 2024-09-12T01:38:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.348+0000 7f6cd233b640 1 -- 172.21.15.60:0/3115549977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ccc1578e0 con 0x7f6ccc15f200 2024-09-12T01:38:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.349+0000 7f6cc8ff9640 1 -- 172.21.15.60:0/3115549977 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16702 (secure 0 0 0) 0x7f6cc407a530 con 0x7f6ccc15f200 2024-09-12T01:38:14.447 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:14.447 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":56,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:38:12.079081+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:38:09.733918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T01:38:11.059626+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.351+0000 7f6cd233b640 1 -- 172.21.15.60:0/3115549977 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6cb806be30 msgr2=0x7f6cb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.351+0000 7f6cd233b640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6cb806be30 0x7f6cb806e2f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc009ad0 tx=0x7f6cbc008040 comp rx=0 tx=0).stop 2024-09-12T01:38:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.351+0000 7f6cd233b640 1 -- 172.21.15.60:0/3115549977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ccc15f200 msgr2=0x7f6ccc1573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.351+0000 7f6cd233b640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ccc15f200 0x7f6ccc1573a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4009d90 tx=0x7f6cc4004a40 comp rx=0 tx=0).stop 2024-09-12T01:38:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.351+0000 7f6cd233b640 1 -- 172.21.15.60:0/3115549977 shutdown_connections 2024-09-12T01:38:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.351+0000 7f6cd233b640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6ccc15f200 0x7f6ccc1573a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.351+0000 7f6cd233b640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6ccc15c2b0 0x7f6ccc0cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.351+0000 7f6cd233b640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6cb806be30 0x7f6cb806e2f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.351+0000 7f6cd233b640 1 --2- 172.21.15.60:0/3115549977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6ccc0b72f0 0x7f6ccc155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.351+0000 7f6cd233b640 1 -- 172.21.15.60:0/3115549977 >> 172.21.15.60:0/3115549977 conn(0x7f6ccc0b4240 msgr2=0x7f6ccc0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:14.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.351+0000 7f6cd233b640 1 -- 172.21.15.60:0/3115549977 shutdown_connections 2024-09-12T01:38:14.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:13.351+0000 7f6cd233b640 1 -- 172.21.15.60:0/3115549977 wait complete. 2024-09-12T01:38:14.450 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:38:14.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.569+0000 7fbc273c4640 1 Processor -- start 2024-09-12T01:38:14.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.569+0000 7fbc273c4640 1 -- start start 2024-09-12T01:38:14.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc273c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc2015c2a0 0x7fbc200735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:14.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc273c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc20073b10 0x7fbc2006f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:14.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc273c4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbc2006fc50 0x7fbc2006cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:14.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc273c4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbc2015c680 con 0x7fbc20073b10 2024-09-12T01:38:14.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc273c4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbc20074120 con 0x7fbc2006fc50 2024-09-12T01:38:14.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc273c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbc2015ef00 con 0x7fbc2015c2a0 2024-09-12T01:38:14.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc2495f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc20073b10 0x7fbc2006f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:14.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc2495f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc20073b10 0x7fbc2006f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38320/0 (socket says 172.21.15.60:38320) 2024-09-12T01:38:14.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc2495f640 1 -- 172.21.15.60:0/1388324387 learned_addr learned my addr 172.21.15.60:0/1388324387 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:14.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc25160640 1 --2- 172.21.15.60:0/1388324387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc2015c2a0 0x7fbc200735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc25961640 1 --2- 172.21.15.60:0/1388324387 >> v2:172.21.15.105:3300/0 conn(0x7fbc2006fc50 0x7fbc2006cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc2495f640 1 -- 172.21.15.60:0/1388324387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc2015c2a0 msgr2=0x7fbc200735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc2495f640 1 --2- 172.21.15.60:0/1388324387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc2015c2a0 0x7fbc200735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc2495f640 1 -- 172.21.15.60:0/1388324387 >> v2:172.21.15.105:3300/0 conn(0x7fbc2006fc50 msgr2=0x7fbc2006cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc2495f640 1 --2- 172.21.15.60:0/1388324387 >> v2:172.21.15.105:3300/0 conn(0x7fbc2006fc50 0x7fbc2006cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.570+0000 7fbc2495f640 1 -- 172.21.15.60:0/1388324387 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2015f1e0 con 0x7fbc20073b10 2024-09-12T01:38:14.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.571+0000 7fbc2495f640 1 --2- 172.21.15.60:0/1388324387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc20073b10 0x7fbc2006f710 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbc200cdd00 tx=0x7fbc1002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6247d4952a8d5f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.571+0000 7fbc17fff640 1 -- 172.21.15.60:0/1388324387 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10037070 con 0x7fbc20073b10 2024-09-12T01:38:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.571+0000 7fbc17fff640 1 -- 172.21.15.60:0/1388324387 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc10032440 con 0x7fbc20073b10 2024-09-12T01:38:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.571+0000 7fbc17fff640 1 -- 172.21.15.60:0/1388324387 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10032810 con 0x7fbc20073b10 2024-09-12T01:38:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.572+0000 7fbc273c4640 1 -- 172.21.15.60:0/1388324387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc20073b10 msgr2=0x7fbc2006f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.572+0000 7fbc273c4640 1 --2- 172.21.15.60:0/1388324387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc20073b10 0x7fbc2006f710 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fbc200cdd00 tx=0x7fbc1002a1e0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.572+0000 7fbc273c4640 1 -- 172.21.15.60:0/1388324387 shutdown_connections 2024-09-12T01:38:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.572+0000 7fbc273c4640 1 --2- 172.21.15.60:0/1388324387 >> v2:172.21.15.105:3300/0 conn(0x7fbc2006fc50 0x7fbc2006cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.572+0000 7fbc273c4640 1 --2- 172.21.15.60:0/1388324387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc20073b10 0x7fbc2006f710 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.572+0000 7fbc273c4640 1 --2- 172.21.15.60:0/1388324387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc2015c2a0 0x7fbc200735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.572+0000 7fbc273c4640 1 -- 172.21.15.60:0/1388324387 >> 172.21.15.60:0/1388324387 conn(0x7fbc200b3070 msgr2=0x7fbc200b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:14.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.572+0000 7fbc273c4640 1 -- 172.21.15.60:0/1388324387 shutdown_connections 2024-09-12T01:38:14.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.572+0000 7fbc273c4640 1 -- 172.21.15.60:0/1388324387 wait complete. 2024-09-12T01:38:14.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.573+0000 7fbc273c4640 1 Processor -- start 2024-09-12T01:38:14.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.573+0000 7fbc273c4640 1 -- start start 2024-09-12T01:38:14.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc273c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc2006fc50 0x7fbc201f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:14.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc273c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc20073b10 0x7fbc201f8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:14.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc273c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2015c2a0 0x7fbc2014f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:14.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc273c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbc200b5f20 con 0x7fbc2015c2a0 2024-09-12T01:38:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc273c4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2015ebf0 con 0x7fbc2006fc50 2024-09-12T01:38:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc273c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbc200b60a0 con 0x7fbc20073b10 2024-09-12T01:38:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc25961640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2015c2a0 0x7fbc2014f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc25961640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2015c2a0 0x7fbc2014f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38336/0 (socket says 172.21.15.60:38336) 2024-09-12T01:38:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc25961640 1 -- 172.21.15.60:0/513562897 learned_addr learned my addr 172.21.15.60:0/513562897 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc25160640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc2006fc50 0x7fbc201f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc2495f640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc20073b10 0x7fbc201f8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc25961640 1 -- 172.21.15.60:0/513562897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc20073b10 msgr2=0x7fbc201f8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.574+0000 7fbc25961640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc20073b10 0x7fbc201f8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.575+0000 7fbc25961640 1 -- 172.21.15.60:0/513562897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc2006fc50 msgr2=0x7fbc201f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.575+0000 7fbc25961640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc2006fc50 0x7fbc201f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.575+0000 7fbc25961640 1 -- 172.21.15.60:0/513562897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc200ce260 con 0x7fbc2015c2a0 2024-09-12T01:38:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.575+0000 7fbc25160640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc2006fc50 0x7fbc201f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.575+0000 7fbc25961640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2015c2a0 0x7fbc2014f200 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbc18007e90 tx=0x7fbc1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.575+0000 7fbc15ffb640 1 -- 172.21.15.60:0/513562897 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18014420 con 0x7fbc2015c2a0 2024-09-12T01:38:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.575+0000 7fbc15ffb640 1 -- 172.21.15.60:0/513562897 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc18019070 con 0x7fbc2015c2a0 2024-09-12T01:38:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.575+0000 7fbc273c4640 1 -- 172.21.15.60:0/513562897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc200ce540 con 0x7fbc2015c2a0 2024-09-12T01:38:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.575+0000 7fbc15ffb640 1 -- 172.21.15.60:0/513562897 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc18014820 con 0x7fbc2015c2a0 2024-09-12T01:38:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.575+0000 7fbc273c4640 1 -- 172.21.15.60:0/513562897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc201f7e80 con 0x7fbc2015c2a0 2024-09-12T01:38:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.576+0000 7fbc273c4640 1 -- 172.21.15.60:0/513562897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc2015f9e0 con 0x7fbc2015c2a0 2024-09-12T01:38:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.576+0000 7fbc15ffb640 1 -- 172.21.15.60:0/513562897 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc180149c0 con 0x7fbc2015c2a0 2024-09-12T01:38:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.577+0000 7fbc15ffb640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc0406be30 0x7fbc0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.577+0000 7fbc15ffb640 1 -- 172.21.15.60:0/513562897 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fbc1808b6d0 con 0x7fbc2015c2a0 2024-09-12T01:38:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.577+0000 7fbc25160640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc0406be30 0x7fbc0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:14.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.577+0000 7fbc25160640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc0406be30 0x7fbc0406e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbc200af8c0 tx=0x7fbc1c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.581+0000 7fbc15ffb640 1 -- 172.21.15.60:0/513562897 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc1805a080 con 0x7fbc2015c2a0 2024-09-12T01:38:14.702 INFO:tasks.ceph.mds.b.smithi105.stderr:2024-09-12T01:38:14.702+0000 7fe3e6e0e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:38:14.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:14.799+0000 7fbc273c4640 1 -- 172.21.15.60:0/513562897 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbc201618e0 con 0x7fbc2015c2a0 2024-09-12T01:38:15.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.731+0000 7fbc15ffb640 1 -- 172.21.15.60:0/513562897 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7fbc18059980 con 0x7fbc2015c2a0 2024-09-12T01:38:15.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.734+0000 7fbc273c4640 1 -- 172.21.15.60:0/513562897 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc0406be30 msgr2=0x7fbc0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:15.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.734+0000 7fbc273c4640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc0406be30 0x7fbc0406e2f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbc200af8c0 tx=0x7fbc1c008040 comp rx=0 tx=0).stop 2024-09-12T01:38:15.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.734+0000 7fbc273c4640 1 -- 172.21.15.60:0/513562897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2015c2a0 msgr2=0x7fbc2014f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:15.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.734+0000 7fbc273c4640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2015c2a0 0x7fbc2014f200 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbc18007e90 tx=0x7fbc1800e4b0 comp rx=0 tx=0).stop 2024-09-12T01:38:15.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.734+0000 7fbc273c4640 1 -- 172.21.15.60:0/513562897 shutdown_connections 2024-09-12T01:38:15.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.734+0000 7fbc273c4640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc2015c2a0 0x7fbc2014f200 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:15.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.734+0000 7fbc273c4640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc0406be30 0x7fbc0406e2f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:15.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.734+0000 7fbc273c4640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc20073b10 0x7fbc201f8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:15.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.734+0000 7fbc273c4640 1 --2- 172.21.15.60:0/513562897 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc2006fc50 0x7fbc201f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:15.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.734+0000 7fbc273c4640 1 -- 172.21.15.60:0/513562897 >> 172.21.15.60:0/513562897 conn(0x7fbc200b3070 msgr2=0x7fbc200b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:15.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.734+0000 7fbc273c4640 1 -- 172.21.15.60:0/513562897 shutdown_connections 2024-09-12T01:38:15.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.734+0000 7fbc273c4640 1 -- 172.21.15.60:0/513562897 wait complete. 2024-09-12T01:38:15.748 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:38:15.748 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:38:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.862+0000 7fde45f86640 1 Processor -- start 2024-09-12T01:38:15.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.862+0000 7fde45f86640 1 -- start start 2024-09-12T01:38:15.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.863+0000 7fde45f86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4015c290 0x7fde4006d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:15.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.863+0000 7fde45f86640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fde4015d680 0x7fde4006f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:15.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.863+0000 7fde45f86640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde4006cc20 con 0x7fde4006fc50 2024-09-12T01:38:15.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.863+0000 7fde45f86640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fde4006bc10 con 0x7fde4015d680 2024-09-12T01:38:15.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.863+0000 7fde45f86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fde4006be60 con 0x7fde4015c290 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.863+0000 7fde3ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fde4006fc50 0x7fde4015ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34814/0 (socket says 172.21.15.60:34814) 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.863+0000 7fde3ffff640 1 -- 172.21.15.60:0/476153840 learned_addr learned my addr 172.21.15.60:0/476153840 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.863+0000 7fde3f7fe640 1 --2- 172.21.15.60:0/476153840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4015c290 0x7fde4006d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.863+0000 7fde3effd640 1 --2- 172.21.15.60:0/476153840 >> v2:172.21.15.105:3300/0 conn(0x7fde4015d680 0x7fde4006f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.863+0000 7fde3e7fc640 1 -- 172.21.15.60:0/476153840 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1801311023 0 0) 0x7fde4006cc20 con 0x7fde4006fc50 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.863+0000 7fde3e7fc640 1 -- 172.21.15.60:0/476153840 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde28003520 con 0x7fde4006fc50 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.864+0000 7fde3f7fe640 1 -- 172.21.15.60:0/476153840 >> v2:172.21.15.105:3300/0 conn(0x7fde4015d680 msgr2=0x7fde4006f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.864+0000 7fde3f7fe640 1 --2- 172.21.15.60:0/476153840 >> v2:172.21.15.105:3300/0 conn(0x7fde4015d680 0x7fde4006f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.864+0000 7fde3f7fe640 1 -- 172.21.15.60:0/476153840 >> v1:172.21.15.60:6789/0 conn(0x7fde4006fc50 legacy=0x7fde4015ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.864+0000 7fde3f7fe640 1 -- 172.21.15.60:0/476153840 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4006c140 con 0x7fde4015c290 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.864+0000 7fde3effd640 1 --2- 172.21.15.60:0/476153840 >> v2:172.21.15.105:3300/0 conn(0x7fde4015d680 0x7fde4006f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.864+0000 7fde3f7fe640 1 --2- 172.21.15.60:0/476153840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4015c290 0x7fde4006d500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde300097a0 tx=0x7fde3002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e86d9fbdc871e5d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.865+0000 7fde3e7fc640 1 -- 172.21.15.60:0/476153840 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30037070 con 0x7fde4015c290 2024-09-12T01:38:15.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.865+0000 7fde3e7fc640 1 -- 172.21.15.60:0/476153840 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde30032440 con 0x7fde4015c290 2024-09-12T01:38:15.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.865+0000 7fde3e7fc640 1 -- 172.21.15.60:0/476153840 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde30032810 con 0x7fde4015c290 2024-09-12T01:38:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.865+0000 7fde45f86640 1 -- 172.21.15.60:0/476153840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4015c290 msgr2=0x7fde4006d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.865+0000 7fde45f86640 1 --2- 172.21.15.60:0/476153840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4015c290 0x7fde4006d500 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde300097a0 tx=0x7fde3002a180 comp rx=0 tx=0).stop 2024-09-12T01:38:15.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.865+0000 7fde45f86640 1 -- 172.21.15.60:0/476153840 shutdown_connections 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.865+0000 7fde45f86640 1 --2- 172.21.15.60:0/476153840 >> v2:172.21.15.105:3300/0 conn(0x7fde4015d680 0x7fde4006f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.865+0000 7fde45f86640 1 --2- 172.21.15.60:0/476153840 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4015c290 0x7fde4006d500 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.865+0000 7fde45f86640 1 -- 172.21.15.60:0/476153840 >> 172.21.15.60:0/476153840 conn(0x7fde400b3070 msgr2=0x7fde400b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.865+0000 7fde45f86640 1 -- 172.21.15.60:0/476153840 shutdown_connections 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.865+0000 7fde45f86640 1 -- 172.21.15.60:0/476153840 wait complete. 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.866+0000 7fde45f86640 1 Processor -- start 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.867+0000 7fde45f86640 1 -- start start 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.867+0000 7fde45f86640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4006fc50 0x7fde40154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.867+0000 7fde45f86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4015c290 0x7fde400b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.867+0000 7fde45f86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde4015d680 0x7fde400b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.867+0000 7fde45f86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fde4006da40 con 0x7fde4015d680 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.867+0000 7fde45f86640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fde4006c700 con 0x7fde4006fc50 2024-09-12T01:38:15.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.867+0000 7fde45f86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fde4006dbc0 con 0x7fde4015c290 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde3ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde4015d680 0x7fde400b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde3ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde4015d680 0x7fde400b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38346/0 (socket says 172.21.15.60:38346) 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde3ffff640 1 -- 172.21.15.60:0/1953298925 learned_addr learned my addr 172.21.15.60:0/1953298925 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde3effd640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4015c290 0x7fde400b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde3f7fe640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4006fc50 0x7fde40154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde3ffff640 1 -- 172.21.15.60:0/1953298925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4015c290 msgr2=0x7fde400b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde3ffff640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4015c290 0x7fde400b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde3ffff640 1 -- 172.21.15.60:0/1953298925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4006fc50 msgr2=0x7fde40154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde3ffff640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4006fc50 0x7fde40154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde3ffff640 1 -- 172.21.15.60:0/1953298925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde400b5dd0 con 0x7fde4015d680 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde3ffff640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde4015d680 0x7fde400b4da0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fde3800cb40 tx=0x7fde3800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde27fff640 1 -- 172.21.15.60:0/1953298925 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38017070 con 0x7fde4015d680 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde27fff640 1 -- 172.21.15.60:0/1953298925 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde3800aca0 con 0x7fde4015d680 2024-09-12T01:38:15.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde45f86640 1 -- 172.21.15.60:0/1953298925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde400b60b0 con 0x7fde4015d680 2024-09-12T01:38:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde27fff640 1 -- 172.21.15.60:0/1953298925 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde38012620 con 0x7fde4015d680 2024-09-12T01:38:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.868+0000 7fde45f86640 1 -- 172.21.15.60:0/1953298925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde400b4880 con 0x7fde4015d680 2024-09-12T01:38:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.869+0000 7fde45f86640 1 -- 172.21.15.60:0/1953298925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde4015ce30 con 0x7fde4015d680 2024-09-12T01:38:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.870+0000 7fde27fff640 1 -- 172.21.15.60:0/1953298925 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde3801a070 con 0x7fde4015d680 2024-09-12T01:38:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.870+0000 7fde27fff640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde2c06be30 0x7fde2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.870+0000 7fde27fff640 1 -- 172.21.15.60:0/1953298925 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fde3808ac30 con 0x7fde4015d680 2024-09-12T01:38:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.870+0000 7fde3f7fe640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde2c06be30 0x7fde2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:15.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.871+0000 7fde3f7fe640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde2c06be30 0x7fde2c06e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fde30034000 tx=0x7fde3002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:15.875+0000 7fde27fff640 1 -- 172.21.15.60:0/1953298925 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde38058f80 con 0x7fde4015d680 2024-09-12T01:38:16.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.086+0000 7fde45f86640 1 -- 172.21.15.60:0/1953298925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fde4015ba50 con 0x7fde4015d680 2024-09-12T01:38:16.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.738+0000 7fde27fff640 1 -- 172.21.15.60:0/1953298925 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fde3805d280 con 0x7fde4015d680 2024-09-12T01:38:16.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.740+0000 7fde45f86640 1 -- 172.21.15.60:0/1953298925 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde2c06be30 msgr2=0x7fde2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.740+0000 7fde45f86640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde2c06be30 0x7fde2c06e2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fde30034000 tx=0x7fde3002e000 comp rx=0 tx=0).stop 2024-09-12T01:38:16.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.740+0000 7fde45f86640 1 -- 172.21.15.60:0/1953298925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde4015d680 msgr2=0x7fde400b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.740+0000 7fde45f86640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde4015d680 0x7fde400b4da0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fde3800cb40 tx=0x7fde3800a060 comp rx=0 tx=0).stop 2024-09-12T01:38:16.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.740+0000 7fde45f86640 1 -- 172.21.15.60:0/1953298925 shutdown_connections 2024-09-12T01:38:16.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.740+0000 7fde45f86640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde4015d680 0x7fde400b4da0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.740+0000 7fde45f86640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde2c06be30 0x7fde2c06e2f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.740+0000 7fde45f86640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde4015c290 0x7fde400b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.740+0000 7fde45f86640 1 --2- 172.21.15.60:0/1953298925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde4006fc50 0x7fde40154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.740+0000 7fde45f86640 1 -- 172.21.15.60:0/1953298925 >> 172.21.15.60:0/1953298925 conn(0x7fde400b3070 msgr2=0x7fde400d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:16.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.741+0000 7fde45f86640 1 -- 172.21.15.60:0/1953298925 shutdown_connections 2024-09-12T01:38:16.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.741+0000 7fde45f86640 1 -- 172.21.15.60:0/1953298925 wait complete. 2024-09-12T01:38:16.753 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:38:16.753 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:16.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.858+0000 7f5279e8b640 1 Processor -- start 2024-09-12T01:38:16.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.859+0000 7f5279e8b640 1 -- start start 2024-09-12T01:38:16.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.859+0000 7f5279e8b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f527415e660 0x7f52740cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.859+0000 7f5279e8b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52740d3310 0x7f52740d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.859+0000 7f5279e8b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f52740d1650 0x7f527406bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.859+0000 7f5279e8b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f52740d1ac0 con 0x7f52740d1650 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.859+0000 7f5279e8b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f527415ea40 con 0x7f527415e660 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.859+0000 7f5279e8b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f52740d3870 con 0x7f52740d3310 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.859+0000 7f5273fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f52740d1650 0x7f527406bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.859+0000 7f5273fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f52740d1650 0x7f527406bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38354/0 (socket says 172.21.15.60:38354) 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.860+0000 7f5273fff640 1 -- 172.21.15.60:0/3429114617 learned_addr learned my addr 172.21.15.60:0/3429114617 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.860+0000 7f5272ffd640 1 --2- 172.21.15.60:0/3429114617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52740d3310 0x7f52740d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.860+0000 7f52737fe640 1 --2- 172.21.15.60:0/3429114617 >> v2:172.21.15.105:3300/0 conn(0x7f527415e660 0x7f52740cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.860+0000 7f5273fff640 1 -- 172.21.15.60:0/3429114617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52740d3310 msgr2=0x7f52740d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.860+0000 7f5273fff640 1 --2- 172.21.15.60:0/3429114617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52740d3310 0x7f52740d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.860+0000 7f5273fff640 1 -- 172.21.15.60:0/3429114617 >> v2:172.21.15.105:3300/0 conn(0x7f527415e660 msgr2=0x7f52740cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.860+0000 7f5273fff640 1 --2- 172.21.15.60:0/3429114617 >> v2:172.21.15.105:3300/0 conn(0x7f527415e660 0x7f52740cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.860+0000 7f5273fff640 1 -- 172.21.15.60:0/3429114617 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52740d3b50 con 0x7f52740d1650 2024-09-12T01:38:16.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.860+0000 7f5272ffd640 1 --2- 172.21.15.60:0/3429114617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52740d3310 0x7f52740d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:16.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f5273fff640 1 --2- 172.21.15.60:0/3429114617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52740d1650 0x7f527406bfd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f52740d10e0 tx=0x7f526c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469ed5ca3151796d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:16.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f52727fc640 1 -- 172.21.15.60:0/3429114617 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c036070 con 0x7f52740d1650 2024-09-12T01:38:16.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f52727fc640 1 -- 172.21.15.60:0/3429114617 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c031600 con 0x7f52740d1650 2024-09-12T01:38:16.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f52727fc640 1 -- 172.21.15.60:0/3429114617 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c0319d0 con 0x7f52740d1650 2024-09-12T01:38:16.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f5279e8b640 1 -- 172.21.15.60:0/3429114617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52740d1650 msgr2=0x7f527406bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f5279e8b640 1 --2- 172.21.15.60:0/3429114617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52740d1650 0x7f527406bfd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f52740d10e0 tx=0x7f526c02a6a0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f5279e8b640 1 -- 172.21.15.60:0/3429114617 shutdown_connections 2024-09-12T01:38:16.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f5279e8b640 1 --2- 172.21.15.60:0/3429114617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52740d1650 0x7f527406bfd0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f5279e8b640 1 --2- 172.21.15.60:0/3429114617 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52740d3310 0x7f52740d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f5279e8b640 1 --2- 172.21.15.60:0/3429114617 >> v2:172.21.15.105:3300/0 conn(0x7f527415e660 0x7f52740cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f5279e8b640 1 -- 172.21.15.60:0/3429114617 >> 172.21.15.60:0/3429114617 conn(0x7f52740b6410 msgr2=0x7f52740b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:16.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f5279e8b640 1 -- 172.21.15.60:0/3429114617 shutdown_connections 2024-09-12T01:38:16.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.861+0000 7f5279e8b640 1 -- 172.21.15.60:0/3429114617 wait complete. 2024-09-12T01:38:16.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.863+0000 7f5279e8b640 1 Processor -- start 2024-09-12T01:38:16.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.863+0000 7f5279e8b640 1 -- start start 2024-09-12T01:38:16.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.863+0000 7f5279e8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52740d1650 0x7f527414ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.863+0000 7f5279e8b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52740d3310 0x7f52740c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.863+0000 7f5279e8b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f527415e660 0x7f5274160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5279e8b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f52740d43f0 con 0x7f52740d3310 2024-09-12T01:38:16.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5279e8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f52740d4110 con 0x7f52740d1650 2024-09-12T01:38:16.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5279e8b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f52740cfc70 con 0x7f527415e660 2024-09-12T01:38:16.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5272ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52740d3310 0x7f52740c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5272ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52740d3310 0x7f52740c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38370/0 (socket says 172.21.15.60:38370) 2024-09-12T01:38:16.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5272ffd640 1 -- 172.21.15.60:0/952427152 learned_addr learned my addr 172.21.15.60:0/952427152 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:16.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f52737fe640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52740d1650 0x7f527414ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5273fff640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f527415e660 0x7f5274160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5272ffd640 1 -- 172.21.15.60:0/952427152 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f527415e660 msgr2=0x7f5274160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5272ffd640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f527415e660 0x7f5274160420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5272ffd640 1 -- 172.21.15.60:0/952427152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52740d1650 msgr2=0x7f527414ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:16.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5272ffd640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52740d1650 0x7f527414ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:16.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5272ffd640 1 -- 172.21.15.60:0/952427152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527415f380 con 0x7f52740d3310 2024-09-12T01:38:16.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5272ffd640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52740d3310 0x7f52740c92f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f526800c820 tx=0x7f526800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:16.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f525bfff640 1 -- 172.21.15.60:0/952427152 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268015070 con 0x7f52740d3310 2024-09-12T01:38:16.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f525bfff640 1 -- 172.21.15.60:0/952427152 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52680079d0 con 0x7f52740d3310 2024-09-12T01:38:16.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5279e8b640 1 -- 172.21.15.60:0/952427152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527415f660 con 0x7f52740d3310 2024-09-12T01:38:16.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f525bfff640 1 -- 172.21.15.60:0/952427152 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5268007dc0 con 0x7f52740d3310 2024-09-12T01:38:16.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.864+0000 7f5279e8b640 1 -- 172.21.15.60:0/952427152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f527415fc20 con 0x7f52740d3310 2024-09-12T01:38:16.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.865+0000 7f5279e8b640 1 -- 172.21.15.60:0/952427152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52740d1110 con 0x7f52740d3310 2024-09-12T01:38:16.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.866+0000 7f525bfff640 1 -- 172.21.15.60:0/952427152 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5268018070 con 0x7f52740d3310 2024-09-12T01:38:16.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.866+0000 7f525bfff640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f526006be30 0x7f526006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:16.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.867+0000 7f52737fe640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f526006be30 0x7f526006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:16.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.867+0000 7f525bfff640 1 -- 172.21.15.60:0/952427152 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f526808ac30 con 0x7f52740d3310 2024-09-12T01:38:16.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.867+0000 7f52737fe640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f526006be30 0x7f526006e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f526400aac0 tx=0x7f5264008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:16.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:16.871+0000 7f525bfff640 1 -- 172.21.15.60:0/952427152 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5268058fa0 con 0x7f52740d3310 2024-09-12T01:38:17.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.081+0000 7f5279e8b640 1 -- 172.21.15.60:0/952427152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52740ba510 con 0x7f52740d3310 2024-09-12T01:38:17.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.082+0000 7f525bfff640 1 -- 172.21.15.60:0/952427152 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5223 (secure 0 0 0) 0x7f526805d2a0 con 0x7f52740d3310 2024-09-12T01:38:17.083 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:17.083 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"btime":"2024-09-12T01:38:16:732986+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3403684617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3403684617},{"type":"v1","addr":"172.21.15.60:6837","nonce":3403684617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/343463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":343463},{"type":"v1","addr":"172.21.15.60:6836","nonce":343463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":34985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2046884414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2046884414},{"type":"v1","addr":"172.21.15.105:6834","nonce":2046884414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:12.079385+0000","modified":"2024-09-12T01:38:16.088710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34988},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34988":{"gid":34988,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/4144770620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4144770620},{"type":"v1","addr":"172.21.15.105:6835","nonce":4144770620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34988,"qdb_cluster":[34988]},"id":4}]} 2024-09-12T01:38:17.084 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 30 2024-09-12T01:38:17.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.084+0000 7f5279e8b640 1 -- 172.21.15.60:0/952427152 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f526006be30 msgr2=0x7f526006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.084+0000 7f5279e8b640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f526006be30 0x7f526006e2f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f526400aac0 tx=0x7f5264008040 comp rx=0 tx=0).stop 2024-09-12T01:38:17.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.084+0000 7f5279e8b640 1 -- 172.21.15.60:0/952427152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52740d3310 msgr2=0x7f52740c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.084+0000 7f5279e8b640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52740d3310 0x7f52740c92f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f526800c820 tx=0x7f526800cce0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.084+0000 7f5279e8b640 1 -- 172.21.15.60:0/952427152 shutdown_connections 2024-09-12T01:38:17.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.084+0000 7f5279e8b640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f526006be30 0x7f526006e2f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.084+0000 7f5279e8b640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f527415e660 0x7f5274160420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.084+0000 7f5279e8b640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52740d3310 0x7f52740c92f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.084+0000 7f5279e8b640 1 --2- 172.21.15.60:0/952427152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52740d1650 0x7f527414ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.084+0000 7f5279e8b640 1 -- 172.21.15.60:0/952427152 >> 172.21.15.60:0/952427152 conn(0x7f52740b6410 msgr2=0x7f52741597e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:17.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.084+0000 7f5279e8b640 1 -- 172.21.15.60:0/952427152 shutdown_connections 2024-09-12T01:38:17.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.084+0000 7f5279e8b640 1 -- 172.21.15.60:0/952427152 wait complete. 2024-09-12T01:38:17.096 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:17.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.198+0000 7f41fbe65640 1 Processor -- start 2024-09-12T01:38:17.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.198+0000 7f41fbe65640 1 -- start start 2024-09-12T01:38:17.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.199+0000 7f41fbe65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41f4165740 0x7f41f40d0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.199+0000 7f41fbe65640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f40ce030 con 0x7f41f4162f20 2024-09-12T01:38:17.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.199+0000 7f41fbe65640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f40ce310 con 0x7f41f4163a10 2024-09-12T01:38:17.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.199+0000 7f41fbe65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f41f40ce5f0 con 0x7f41f4165740 2024-09-12T01:38:17.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.199+0000 7f41f9c01640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f41f4162f20 0x7f41f4163300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34818/0 (socket says 172.21.15.60:34818) 2024-09-12T01:38:17.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.199+0000 7f41f9c01640 1 -- 172.21.15.60:0/3470980865 learned_addr learned my addr 172.21.15.60:0/3470980865 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:17.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.199+0000 7f41f9400640 1 --2- 172.21.15.60:0/3470980865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41f4165740 0x7f41f40d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.200+0000 7f41f8bff640 1 -- 172.21.15.60:0/3470980865 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3963645236 0 0) 0x7f41f40ce030 con 0x7f41f4162f20 2024-09-12T01:38:17.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.200+0000 7f41f8bff640 1 -- 172.21.15.60:0/3470980865 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41dc003520 con 0x7f41f4162f20 2024-09-12T01:38:17.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.200+0000 7f41f8bff640 1 -- 172.21.15.60:0/3470980865 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371072854 0 0) 0x7f41f40ce310 con 0x7f41f4163a10 2024-09-12T01:38:17.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.200+0000 7f41f8bff640 1 -- 172.21.15.60:0/3470980865 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41f40ce030 con 0x7f41f4163a10 2024-09-12T01:38:17.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.200+0000 7f41f9400640 1 -- 172.21.15.60:0/3470980865 >> v1:172.21.15.105:6789/0 conn(0x7f41f4163a10 legacy=0x7f41f416c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.200+0000 7f41f9400640 1 -- 172.21.15.60:0/3470980865 >> v1:172.21.15.60:6789/0 conn(0x7f41f4162f20 legacy=0x7f41f4163300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.200+0000 7f41f9400640 1 -- 172.21.15.60:0/3470980865 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f4164210 con 0x7f41f4165740 2024-09-12T01:38:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.201+0000 7f41f9400640 1 --2- 172.21.15.60:0/3470980865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41f4165740 0x7f41f40d0010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41e80097d0 tx=0x7f41e802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21f2f5bca3fb241c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.201+0000 7f41f8bff640 1 -- 172.21.15.60:0/3470980865 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8037070 con 0x7f41f4165740 2024-09-12T01:38:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.201+0000 7f41f8bff640 1 -- 172.21.15.60:0/3470980865 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e8032440 con 0x7f41f4165740 2024-09-12T01:38:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.201+0000 7f41f8bff640 1 -- 172.21.15.60:0/3470980865 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e80327f0 con 0x7f41f4165740 2024-09-12T01:38:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.201+0000 7f41fbe65640 1 -- 172.21.15.60:0/3470980865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41f4165740 msgr2=0x7f41f40d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.201+0000 7f41fbe65640 1 --2- 172.21.15.60:0/3470980865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41f4165740 0x7f41f40d0010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41e80097d0 tx=0x7f41e802a210 comp rx=0 tx=0).stop 2024-09-12T01:38:17.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.201+0000 7f41fbe65640 1 -- 172.21.15.60:0/3470980865 shutdown_connections 2024-09-12T01:38:17.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.201+0000 7f41fbe65640 1 --2- 172.21.15.60:0/3470980865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41f4165740 0x7f41f40d0010 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.201+0000 7f41fbe65640 1 -- 172.21.15.60:0/3470980865 >> 172.21.15.60:0/3470980865 conn(0x7f41f406bc10 msgr2=0x7f41f406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:17.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.202+0000 7f41fbe65640 1 -- 172.21.15.60:0/3470980865 shutdown_connections 2024-09-12T01:38:17.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.202+0000 7f41fbe65640 1 -- 172.21.15.60:0/3470980865 wait complete. 2024-09-12T01:38:17.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.203+0000 7f41fbe65640 1 Processor -- start 2024-09-12T01:38:17.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.203+0000 7f41fbe65640 1 -- start start 2024-09-12T01:38:17.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fbe65640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41f4162f20 0x7f41f4142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fbe65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41f4163a10 0x7f41f4145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fbe65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4165740 0x7f41f414ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fbe65640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f41f40cda40 con 0x7f41f4165740 2024-09-12T01:38:17.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fbe65640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f41f40cd8c0 con 0x7f41f4162f20 2024-09-12T01:38:17.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fbe65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f41f40cdbc0 con 0x7f41f4163a10 2024-09-12T01:38:17.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fa402640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4165740 0x7f41f414ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fa402640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4165740 0x7f41f414ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38380/0 (socket says 172.21.15.60:38380) 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fa402640 1 -- 172.21.15.60:0/2216795153 learned_addr learned my addr 172.21.15.60:0/2216795153 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41f9400640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41f4163a10 0x7f41f4145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41f9c01640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41f4162f20 0x7f41f4142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fa402640 1 -- 172.21.15.60:0/2216795153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41f4163a10 msgr2=0x7f41f4145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fa402640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41f4163a10 0x7f41f4145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fa402640 1 -- 172.21.15.60:0/2216795153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41f4162f20 msgr2=0x7f41f4142ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fa402640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41f4162f20 0x7f41f4142ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fa402640 1 -- 172.21.15.60:0/2216795153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f4140530 con 0x7f41f4165740 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41f9400640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41f4163a10 0x7f41f4145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fa402640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4165740 0x7f41f414ad70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f41e400c700 tx=0x7f41e400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41f27fc640 1 -- 172.21.15.60:0/2216795153 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4003b70 con 0x7f41f4165740 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41f27fc640 1 -- 172.21.15.60:0/2216795153 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e4003d10 con 0x7f41f4165740 2024-09-12T01:38:17.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41fbe65640 1 -- 172.21.15.60:0/2216795153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f4140810 con 0x7f41f4165740 2024-09-12T01:38:17.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.204+0000 7f41f27fc640 1 -- 172.21.15.60:0/2216795153 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e40052d0 con 0x7f41f4165740 2024-09-12T01:38:17.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.205+0000 7f41fbe65640 1 -- 172.21.15.60:0/2216795153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f41fc0a0 con 0x7f41f4165740 2024-09-12T01:38:17.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.205+0000 7f41fbe65640 1 -- 172.21.15.60:0/2216795153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f40d0010 con 0x7f41f4165740 2024-09-12T01:38:17.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.206+0000 7f41f27fc640 1 -- 172.21.15.60:0/2216795153 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f41e4005470 con 0x7f41f4165740 2024-09-12T01:38:17.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.206+0000 7f41f27fc640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f41e006be30 0x7f41e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.207+0000 7f41f27fc640 1 -- 172.21.15.60:0/2216795153 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f41e408aca0 con 0x7f41f4165740 2024-09-12T01:38:17.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.207+0000 7f41f9c01640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f41e006be30 0x7f41e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.207+0000 7f41f9c01640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f41e006be30 0x7f41e006e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0011e0 tx=0x7f41ec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:17.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.211+0000 7f41f27fc640 1 -- 172.21.15.60:0/2216795153 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f41e4059660 con 0x7f41f4165740 2024-09-12T01:38:17.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.387+0000 7f41fbe65640 1 -- 172.21.15.60:0/2216795153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41f41473a0 con 0x7f41f4165740 2024-09-12T01:38:17.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.389+0000 7f41f27fc640 1 -- 172.21.15.60:0/2216795153 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16689 (secure 0 0 0) 0x7f41e4058f60 con 0x7f41f4165740 2024-09-12T01:38:17.389 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:17.389 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":57,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:38:13.711142+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:38:09.733918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T01:38:11.059626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:17.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.390+0000 7f41fbe65640 1 -- 172.21.15.60:0/2216795153 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f41e006be30 msgr2=0x7f41e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.390+0000 7f41fbe65640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f41e006be30 0x7f41e006e2f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0011e0 tx=0x7f41ec009040 comp rx=0 tx=0).stop 2024-09-12T01:38:17.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.390+0000 7f41fbe65640 1 -- 172.21.15.60:0/2216795153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4165740 msgr2=0x7f41f414ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.390+0000 7f41fbe65640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4165740 0x7f41f414ad70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f41e400c700 tx=0x7f41e400cbc0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.391+0000 7f41fbe65640 1 -- 172.21.15.60:0/2216795153 shutdown_connections 2024-09-12T01:38:17.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.391+0000 7f41fbe65640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4165740 0x7f41f414ad70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.391+0000 7f41fbe65640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f41e006be30 0x7f41e006e2f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.391+0000 7f41fbe65640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f41f4163a10 0x7f41f4145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.391+0000 7f41fbe65640 1 --2- 172.21.15.60:0/2216795153 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f41f4162f20 0x7f41f4142ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.391+0000 7f41fbe65640 1 -- 172.21.15.60:0/2216795153 >> 172.21.15.60:0/2216795153 conn(0x7f41f406bc10 msgr2=0x7f41f4072520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:17.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.391+0000 7f41fbe65640 1 -- 172.21.15.60:0/2216795153 shutdown_connections 2024-09-12T01:38:17.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.391+0000 7f41fbe65640 1 -- 172.21.15.60:0/2216795153 wait complete. 2024-09-12T01:38:17.402 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:38:17.403 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.504+0000 7f1ff0b52640 1 Processor -- start 2024-09-12T01:38:17.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.504+0000 7f1ff0b52640 1 -- start start 2024-09-12T01:38:17.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.505+0000 7f1ff0b52640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1fec15c2b0 0x7f1fec0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.505+0000 7f1ff0b52640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fec15f200 0x7f1fec06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.505+0000 7f1ff0b52640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fec15fb10 con 0x7f1fec0b72f0 2024-09-12T01:38:17.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.505+0000 7f1ff0b52640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1fec0b5900 con 0x7f1fec15c2b0 2024-09-12T01:38:17.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.505+0000 7f1ff0b52640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec15f830 con 0x7f1fec15f200 2024-09-12T01:38:17.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.505+0000 7f1fe9d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1fec0b72f0 0x7f1fec15eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34824/0 (socket says 172.21.15.60:34824) 2024-09-12T01:38:17.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.505+0000 7f1fe9d9b640 1 -- 172.21.15.60:0/3676352290 learned_addr learned my addr 172.21.15.60:0/3676352290 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:17.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.505+0000 7f1fead9d640 1 --2- 172.21.15.60:0/3676352290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fec15f200 0x7f1fec06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.505+0000 7f1fea59c640 1 --2- 172.21.15.60:0/3676352290 >> v2:172.21.15.105:3300/0 conn(0x7f1fec15c2b0 0x7f1fec0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.505+0000 7f1fe959a640 1 -- 172.21.15.60:0/3676352290 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229854381 0 0) 0x7f1fec15fb10 con 0x7f1fec0b72f0 2024-09-12T01:38:17.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.505+0000 7f1fe959a640 1 -- 172.21.15.60:0/3676352290 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fd8003520 con 0x7f1fec0b72f0 2024-09-12T01:38:17.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.506+0000 7f1fe959a640 1 -- 172.21.15.60:0/3676352290 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 944172220 0 0) 0x7f1fd8003520 con 0x7f1fec0b72f0 2024-09-12T01:38:17.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.506+0000 7f1fead9d640 1 -- 172.21.15.60:0/3676352290 >> v2:172.21.15.105:3300/0 conn(0x7f1fec15c2b0 msgr2=0x7f1fec0b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:17.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.506+0000 7f1fead9d640 1 --2- 172.21.15.60:0/3676352290 >> v2:172.21.15.105:3300/0 conn(0x7f1fec15c2b0 0x7f1fec0b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.506+0000 7f1fead9d640 1 -- 172.21.15.60:0/3676352290 >> v1:172.21.15.60:6789/0 conn(0x7f1fec0b72f0 legacy=0x7f1fec15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.506+0000 7f1fead9d640 1 -- 172.21.15.60:0/3676352290 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec06ce30 con 0x7f1fec15f200 2024-09-12T01:38:17.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.506+0000 7f1fead9d640 1 --2- 172.21.15.60:0/3676352290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fec15f200 0x7f1fec06d910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009d90 tx=0x7f1fdc02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dc5d15d155326c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:17.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.507+0000 7f1fe959a640 1 -- 172.21.15.60:0/3676352290 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4001670 con 0x7f1fec15f200 2024-09-12T01:38:17.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.507+0000 7f1fe959a640 1 -- 172.21.15.60:0/3676352290 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fdc007540 con 0x7f1fec15f200 2024-09-12T01:38:17.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.507+0000 7f1fe959a640 1 -- 172.21.15.60:0/3676352290 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc0078f0 con 0x7f1fec15f200 2024-09-12T01:38:17.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.507+0000 7f1ff0b52640 1 -- 172.21.15.60:0/3676352290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fec15f200 msgr2=0x7f1fec06d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.507+0000 7f1ff0b52640 1 --2- 172.21.15.60:0/3676352290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fec15f200 0x7f1fec06d910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc009d90 tx=0x7f1fdc02a5f0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.507+0000 7f1ff0b52640 1 -- 172.21.15.60:0/3676352290 shutdown_connections 2024-09-12T01:38:17.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.507+0000 7f1ff0b52640 1 --2- 172.21.15.60:0/3676352290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fec15f200 0x7f1fec06d910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.507+0000 7f1ff0b52640 1 --2- 172.21.15.60:0/3676352290 >> v2:172.21.15.105:3300/0 conn(0x7f1fec15c2b0 0x7f1fec0b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.507+0000 7f1ff0b52640 1 -- 172.21.15.60:0/3676352290 >> 172.21.15.60:0/3676352290 conn(0x7f1fec0b4240 msgr2=0x7f1fec0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:17.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.507+0000 7f1ff0b52640 1 -- 172.21.15.60:0/3676352290 shutdown_connections 2024-09-12T01:38:17.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.507+0000 7f1ff0b52640 1 -- 172.21.15.60:0/3676352290 wait complete. 2024-09-12T01:38:17.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.509+0000 7f1ff0b52640 1 Processor -- start 2024-09-12T01:38:17.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.509+0000 7f1ff0b52640 1 -- start start 2024-09-12T01:38:17.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.509+0000 7f1ff0b52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fec0b72f0 0x7f1fec0d1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.509+0000 7f1ff0b52640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fec15c2b0 0x7f1fec159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.509+0000 7f1ff0b52640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fec15f200 0x7f1fec14ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.509+0000 7f1ff0b52640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec0b7760 con 0x7f1fec0b72f0 2024-09-12T01:38:17.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.509+0000 7f1ff0b52640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1fec06d3f0 con 0x7f1fec15c2b0 2024-09-12T01:38:17.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.509+0000 7f1ff0b52640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1fec06de50 con 0x7f1fec15f200 2024-09-12T01:38:17.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fea59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fec0b72f0 0x7f1fec0d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fea59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fec0b72f0 0x7f1fec0d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38384/0 (socket says 172.21.15.60:38384) 2024-09-12T01:38:17.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fea59c640 1 -- 172.21.15.60:0/2740703873 learned_addr learned my addr 172.21.15.60:0/2740703873 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:17.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fead9d640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fec15f200 0x7f1fec14ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fe9d9b640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fec15c2b0 0x7f1fec159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fea59c640 1 -- 172.21.15.60:0/2740703873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fec15f200 msgr2=0x7f1fec14ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fea59c640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fec15f200 0x7f1fec14ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fea59c640 1 -- 172.21.15.60:0/2740703873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fec15c2b0 msgr2=0x7f1fec159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fea59c640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fec15c2b0 0x7f1fec159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fea59c640 1 -- 172.21.15.60:0/2740703873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fec1f7a50 con 0x7f1fec0b72f0 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fead9d640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fec15f200 0x7f1fec14ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fe9d9b640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fec15c2b0 0x7f1fec159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fea59c640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fec0b72f0 0x7f1fec0d1200 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400e9b0 tx=0x7f1fe400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fe2ffd640 1 -- 172.21.15.60:0/2740703873 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe4017070 con 0x7f1fec0b72f0 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fe2ffd640 1 -- 172.21.15.60:0/2740703873 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe400c9a0 con 0x7f1fec0b72f0 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1ff0b52640 1 -- 172.21.15.60:0/2740703873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fec1f7d30 con 0x7f1fec0b72f0 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1fe2ffd640 1 -- 172.21.15.60:0/2740703873 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe400cd90 con 0x7f1fec0b72f0 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.510+0000 7f1ff0b52640 1 -- 172.21.15.60:0/2740703873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fec1f82f0 con 0x7f1fec0b72f0 2024-09-12T01:38:17.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.511+0000 7f1ff0b52640 1 -- 172.21.15.60:0/2740703873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fec0b6db0 con 0x7f1fec0b72f0 2024-09-12T01:38:17.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.512+0000 7f1fe2ffd640 1 -- 172.21.15.60:0/2740703873 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1fe401a070 con 0x7f1fec0b72f0 2024-09-12T01:38:17.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.512+0000 7f1fe2ffd640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1fcc06be60 0x7f1fcc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.512+0000 7f1fe2ffd640 1 -- 172.21.15.60:0/2740703873 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f1fe408b1e0 con 0x7f1fec0b72f0 2024-09-12T01:38:17.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.512+0000 7f1fe9d9b640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1fcc06be60 0x7f1fcc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.513+0000 7f1fe9d9b640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1fcc06be60 0x7f1fcc06e320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0d0450 tx=0x7f1fd4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:17.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.517+0000 7f1fe2ffd640 1 -- 172.21.15.60:0/2740703873 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1fe4059b90 con 0x7f1fec0b72f0 2024-09-12T01:38:17.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.689+0000 7f1ff0b52640 1 -- 172.21.15.60:0/2740703873 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1fec0cee70 con 0x7f1fcc06be60 2024-09-12T01:38:17.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.695+0000 7f1fe2ffd640 1 -- 172.21.15.60:0/2740703873 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251954 (secure 0 0 0) 0x7f1fec0cee70 con 0x7f1fcc06be60 2024-09-12T01:38:17.701 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:17.703 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:38:17.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.698+0000 7f1ff0b52640 1 -- 172.21.15.60:0/2740703873 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1fcc06be60 msgr2=0x7f1fcc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.698+0000 7f1ff0b52640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1fcc06be60 0x7f1fcc06e320 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0d0450 tx=0x7f1fd4009040 comp rx=0 tx=0).stop 2024-09-12T01:38:17.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.698+0000 7f1ff0b52640 1 -- 172.21.15.60:0/2740703873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fec0b72f0 msgr2=0x7f1fec0d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.698+0000 7f1ff0b52640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fec0b72f0 0x7f1fec0d1200 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400e9b0 tx=0x7f1fe400ee70 comp rx=0 tx=0).stop 2024-09-12T01:38:17.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.698+0000 7f1ff0b52640 1 -- 172.21.15.60:0/2740703873 shutdown_connections 2024-09-12T01:38:17.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.698+0000 7f1ff0b52640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1fcc06be60 0x7f1fcc06e320 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.698+0000 7f1ff0b52640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1fec15f200 0x7f1fec14ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.698+0000 7f1ff0b52640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1fec15c2b0 0x7f1fec159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.698+0000 7f1ff0b52640 1 --2- 172.21.15.60:0/2740703873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fec0b72f0 0x7f1fec0d1200 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.698+0000 7f1ff0b52640 1 -- 172.21.15.60:0/2740703873 >> 172.21.15.60:0/2740703873 conn(0x7f1fec0b4240 msgr2=0x7f1fec0b3540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:17.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.699+0000 7f1ff0b52640 1 -- 172.21.15.60:0/2740703873 shutdown_connections 2024-09-12T01:38:17.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.699+0000 7f1ff0b52640 1 -- 172.21.15.60:0/2740703873 wait complete. 2024-09-12T01:38:17.709 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-09-12T01:38:16.290828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247696,"kb_used_data":6480,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754727024,"statfs":{"total":773094113280,"available":772840472576,"internally_reserved":0,"allocated":6635520,"data_stored":3382156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.585976"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733876+0000","last_change":"2024-09-12T01:38:12.733168+0000","last_active":"2024-09-12T01:38:14.733876+0000","last_peered":"2024-09-12T01:38:14.733876+0000","last_clean":"2024-09-12T01:38:14.733876+0000","last_became_active":"2024-09-12T01:38:12.732505+0000","last_became_peered":"2024-09-12T01:38:12.732505+0000","last_unstale":"2024-09-12T01:38:14.733876+0000","last_undegraded":"2024-09-12T01:38:14.733876+0000","last_fullsized":"2024-09-12T01:38:14.733876+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:15.877225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288721+0000","last_change":"2024-09-12T01:38:12.736432+0000","last_active":"2024-09-12T01:38:14.288721+0000","last_peered":"2024-09-12T01:38:14.288721+0000","last_clean":"2024-09-12T01:38:14.288721+0000","last_became_active":"2024-09-12T01:38:12.736159+0000","last_became_peered":"2024-09-12T01:38:12.736159+0000","last_unstale":"2024-09-12T01:38:14.288721+0000","last_undegraded":"2024-09-12T01:38:14.288721+0000","last_fullsized":"2024-09-12T01:38:14.288721+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:13.835448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714400+0000","last_change":"2024-09-12T01:38:12.728422+0000","last_active":"2024-09-12T01:38:13.714400+0000","last_peered":"2024-09-12T01:38:13.714400+0000","last_clean":"2024-09-12T01:38:13.714400+0000","last_became_active":"2024-09-12T01:38:12.727852+0000","last_became_peered":"2024-09-12T01:38:12.727852+0000","last_unstale":"2024-09-12T01:38:13.714400+0000","last_undegraded":"2024-09-12T01:38:13.714400+0000","last_fullsized":"2024-09-12T01:38:13.714400+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:50.133174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743670+0000","last_change":"2024-09-12T01:38:12.738640+0000","last_active":"2024-09-12T01:38:14.743670+0000","last_peered":"2024-09-12T01:38:14.743670+0000","last_clean":"2024-09-12T01:38:14.743670+0000","last_became_active":"2024-09-12T01:38:12.738174+0000","last_became_peered":"2024-09-12T01:38:12.738174+0000","last_unstale":"2024-09-12T01:38:14.743670+0000","last_undegraded":"2024-09-12T01:38:14.743670+0000","last_fullsized":"2024-09-12T01:38:14.743670+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:00.655897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733280+0000","last_change":"2024-09-12T01:38:12.740582+0000","last_active":"2024-09-12T01:38:14.733280+0000","last_peered":"2024-09-12T01:38:14.733280+0000","last_clean":"2024-09-12T01:38:14.733280+0000","last_became_active":"2024-09-12T01:38:12.736656+0000","last_became_peered":"2024-09-12T01:38:12.736656+0000","last_unstale":"2024-09-12T01:38:14.733280+0000","last_undegraded":"2024-09-12T01:38:14.733280+0000","last_fullsized":"2024-09-12T01:38:14.733280+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:06.481399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733142+0000","last_change":"2024-09-12T01:38:12.737860+0000","last_active":"2024-09-12T01:38:14.733142+0000","last_peered":"2024-09-12T01:38:14.733142+0000","last_clean":"2024-09-12T01:38:14.733142+0000","last_became_active":"2024-09-12T01:38:12.737572+0000","last_became_peered":"2024-09-12T01:38:12.737572+0000","last_unstale":"2024-09-12T01:38:14.733142+0000","last_undegraded":"2024-09-12T01:38:14.733142+0000","last_fullsized":"2024-09-12T01:38:14.733142+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:26.308081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743327+0000","last_change":"2024-09-12T01:38:12.720431+0000","last_active":"2024-09-12T01:38:14.743327+0000","last_peered":"2024-09-12T01:38:14.743327+0000","last_clean":"2024-09-12T01:38:14.743327+0000","last_became_active":"2024-09-12T01:38:12.720029+0000","last_became_peered":"2024-09-12T01:38:12.720029+0000","last_unstale":"2024-09-12T01:38:14.743327+0000","last_undegraded":"2024-09-12T01:38:14.743327+0000","last_fullsized":"2024-09-12T01:38:14.743327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:56.625687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.715686+0000","last_change":"2024-09-12T01:38:12.729091+0000","last_active":"2024-09-12T01:38:13.715686+0000","last_peered":"2024-09-12T01:38:13.715686+0000","last_clean":"2024-09-12T01:38:13.715686+0000","last_became_active":"2024-09-12T01:38:12.728826+0000","last_became_peered":"2024-09-12T01:38:12.728826+0000","last_unstale":"2024-09-12T01:38:13.715686+0000","last_undegraded":"2024-09-12T01:38:13.715686+0000","last_fullsized":"2024-09-12T01:38:13.715686+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:01.703411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197940+0000","last_change":"2024-09-12T01:38:12.739402+0000","last_active":"2024-09-12T01:38:14.197940+0000","last_peered":"2024-09-12T01:38:14.197940+0000","last_clean":"2024-09-12T01:38:14.197940+0000","last_became_active":"2024-09-12T01:38:12.739064+0000","last_became_peered":"2024-09-12T01:38:12.739064+0000","last_unstale":"2024-09-12T01:38:14.197940+0000","last_undegraded":"2024-09-12T01:38:14.197940+0000","last_fullsized":"2024-09-12T01:38:14.197940+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.724727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733739+0000","last_change":"2024-09-12T01:38:12.731228+0000","last_active":"2024-09-12T01:38:14.733739+0000","last_peered":"2024-09-12T01:38:14.733739+0000","last_clean":"2024-09-12T01:38:14.733739+0000","last_became_active":"2024-09-12T01:38:12.730647+0000","last_became_peered":"2024-09-12T01:38:12.730647+0000","last_unstale":"2024-09-12T01:38:14.733739+0000","last_undegraded":"2024-09-12T01:38:14.733739+0000","last_fullsized":"2024-09-12T01:38:14.733739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:41.064514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.749969+0000","last_change":"2024-09-12T01:38:12.747193+0000","last_active":"2024-09-12T01:38:12.749969+0000","last_peered":"2024-09-12T01:38:12.749969+0000","last_clean":"2024-09-12T01:38:12.749969+0000","last_became_active":"2024-09-12T01:38:12.746911+0000","last_became_peered":"2024-09-12T01:38:12.746911+0000","last_unstale":"2024-09-12T01:38:12.749969+0000","last_undegraded":"2024-09-12T01:38:12.749969+0000","last_fullsized":"2024-09-12T01:38:12.749969+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:45.483102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197793+0000","last_change":"2024-09-12T01:38:12.731203+0000","last_active":"2024-09-12T01:38:14.197793+0000","last_peered":"2024-09-12T01:38:14.197793+0000","last_clean":"2024-09-12T01:38:14.197793+0000","last_became_active":"2024-09-12T01:38:12.730876+0000","last_became_peered":"2024-09-12T01:38:12.730876+0000","last_unstale":"2024-09-12T01:38:14.197793+0000","last_undegraded":"2024-09-12T01:38:14.197793+0000","last_fullsized":"2024-09-12T01:38:14.197793+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:51.948448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743770+0000","last_change":"2024-09-12T01:38:12.730955+0000","last_active":"2024-09-12T01:38:14.743770+0000","last_peered":"2024-09-12T01:38:14.743770+0000","last_clean":"2024-09-12T01:38:14.743770+0000","last_became_active":"2024-09-12T01:38:12.730662+0000","last_became_peered":"2024-09-12T01:38:12.730662+0000","last_unstale":"2024-09-12T01:38:14.743770+0000","last_undegraded":"2024-09-12T01:38:14.743770+0000","last_fullsized":"2024-09-12T01:38:14.743770+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:14.685648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714264+0000","last_change":"2024-09-12T01:38:12.729691+0000","last_active":"2024-09-12T01:38:13.714264+0000","last_peered":"2024-09-12T01:38:13.714264+0000","last_clean":"2024-09-12T01:38:13.714264+0000","last_became_active":"2024-09-12T01:38:12.729396+0000","last_became_peered":"2024-09-12T01:38:12.729396+0000","last_unstale":"2024-09-12T01:38:13.714264+0000","last_undegraded":"2024-09-12T01:38:13.714264+0000","last_fullsized":"2024-09-12T01:38:13.714264+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:54.569718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743623+0000","last_change":"2024-09-12T01:38:12.734336+0000","last_active":"2024-09-12T01:38:14.743623+0000","last_peered":"2024-09-12T01:38:14.743623+0000","last_clean":"2024-09-12T01:38:14.743623+0000","last_became_active":"2024-09-12T01:38:12.734046+0000","last_became_peered":"2024-09-12T01:38:12.734046+0000","last_unstale":"2024-09-12T01:38:14.743623+0000","last_undegraded":"2024-09-12T01:38:14.743623+0000","last_fullsized":"2024-09-12T01:38:14.743623+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:26.308081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733259+0000","last_change":"2024-09-12T01:38:12.732980+0000","last_active":"2024-09-12T01:38:14.733259+0000","last_peered":"2024-09-12T01:38:14.733259+0000","last_clean":"2024-09-12T01:38:14.733259+0000","last_became_active":"2024-09-12T01:38:12.731088+0000","last_became_peered":"2024-09-12T01:38:12.731088+0000","last_unstale":"2024-09-12T01:38:14.733259+0000","last_undegraded":"2024-09-12T01:38:14.733259+0000","last_fullsized":"2024-09-12T01:38:14.733259+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:14.685648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733946+0000","last_change":"2024-09-12T01:38:12.732909+0000","last_active":"2024-09-12T01:38:14.733946+0000","last_peered":"2024-09-12T01:38:14.733946+0000","last_clean":"2024-09-12T01:38:14.733946+0000","last_became_active":"2024-09-12T01:38:12.732180+0000","last_became_peered":"2024-09-12T01:38:12.732180+0000","last_unstale":"2024-09-12T01:38:14.733946+0000","last_undegraded":"2024-09-12T01:38:14.733946+0000","last_fullsized":"2024-09-12T01:38:14.733946+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:52.612408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714363+0000","last_change":"2024-09-12T01:38:12.737122+0000","last_active":"2024-09-12T01:38:13.714363+0000","last_peered":"2024-09-12T01:38:13.714363+0000","last_clean":"2024-09-12T01:38:13.714363+0000","last_became_active":"2024-09-12T01:38:12.736811+0000","last_became_peered":"2024-09-12T01:38:12.736811+0000","last_unstale":"2024-09-12T01:38:13.714363+0000","last_undegraded":"2024-09-12T01:38:13.714363+0000","last_fullsized":"2024-09-12T01:38:13.714363+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:22.446461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288600+0000","last_change":"2024-09-12T01:38:12.735695+0000","last_active":"2024-09-12T01:38:14.288600+0000","last_peered":"2024-09-12T01:38:14.288600+0000","last_clean":"2024-09-12T01:38:14.288600+0000","last_became_active":"2024-09-12T01:38:12.735278+0000","last_became_peered":"2024-09-12T01:38:12.735278+0000","last_unstale":"2024-09-12T01:38:14.288600+0000","last_undegraded":"2024-09-12T01:38:14.288600+0000","last_fullsized":"2024-09-12T01:38:14.288600+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:26.911429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.749310+0000","last_change":"2024-09-12T01:38:12.745794+0000","last_active":"2024-09-12T01:38:12.749310+0000","last_peered":"2024-09-12T01:38:12.749310+0000","last_clean":"2024-09-12T01:38:12.749310+0000","last_became_active":"2024-09-12T01:38:12.745519+0000","last_became_peered":"2024-09-12T01:38:12.745519+0000","last_unstale":"2024-09-12T01:38:12.749310+0000","last_undegraded":"2024-09-12T01:38:12.749310+0000","last_fullsized":"2024-09-12T01:38:12.749310+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:10.213451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743911+0000","last_change":"2024-09-12T01:38:12.719434+0000","last_active":"2024-09-12T01:38:14.743911+0000","last_peered":"2024-09-12T01:38:14.743911+0000","last_clean":"2024-09-12T01:38:14.743911+0000","last_became_active":"2024-09-12T01:38:12.719137+0000","last_became_peered":"2024-09-12T01:38:12.719137+0000","last_unstale":"2024-09-12T01:38:14.743911+0000","last_undegraded":"2024-09-12T01:38:14.743911+0000","last_fullsized":"2024-09-12T01:38:14.743911+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:24.268882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.742664+0000","last_change":"2024-09-12T01:38:12.738838+0000","last_active":"2024-09-12T01:38:12.742664+0000","last_peered":"2024-09-12T01:38:12.742664+0000","last_clean":"2024-09-12T01:38:12.742664+0000","last_became_active":"2024-09-12T01:38:12.738511+0000","last_became_peered":"2024-09-12T01:38:12.738511+0000","last_unstale":"2024-09-12T01:38:12.742664+0000","last_undegraded":"2024-09-12T01:38:12.742664+0000","last_fullsized":"2024-09-12T01:38:12.742664+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:02.469603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743481+0000","last_change":"2024-09-12T01:38:12.738352+0000","last_active":"2024-09-12T01:38:14.743481+0000","last_peered":"2024-09-12T01:38:14.743481+0000","last_clean":"2024-09-12T01:38:14.743481+0000","last_became_active":"2024-09-12T01:38:12.737829+0000","last_became_peered":"2024-09-12T01:38:12.737829+0000","last_unstale":"2024-09-12T01:38:14.743481+0000","last_undegraded":"2024-09-12T01:38:14.743481+0000","last_fullsized":"2024-09-12T01:38:14.743481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:37.533483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197556+0000","last_change":"2024-09-12T01:38:12.743861+0000","last_active":"2024-09-12T01:38:14.197556+0000","last_peered":"2024-09-12T01:38:14.197556+0000","last_clean":"2024-09-12T01:38:14.197556+0000","last_became_active":"2024-09-12T01:38:12.743575+0000","last_became_peered":"2024-09-12T01:38:12.743575+0000","last_unstale":"2024-09-12T01:38:14.197556+0000","last_undegraded":"2024-09-12T01:38:14.197556+0000","last_fullsized":"2024-09-12T01:38:14.197556+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:26.172050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288784+0000","last_change":"2024-09-12T01:38:12.742076+0000","last_active":"2024-09-12T01:38:14.288784+0000","last_peered":"2024-09-12T01:38:14.288784+0000","last_clean":"2024-09-12T01:38:14.288784+0000","last_became_active":"2024-09-12T01:38:12.741783+0000","last_became_peered":"2024-09-12T01:38:12.741783+0000","last_unstale":"2024-09-12T01:38:14.288784+0000","last_undegraded":"2024-09-12T01:38:14.288784+0000","last_fullsized":"2024-09-12T01:38:14.288784+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.724727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.744045+0000","last_change":"2024-09-12T01:38:12.720073+0000","last_active":"2024-09-12T01:38:14.744045+0000","last_peered":"2024-09-12T01:38:14.744045+0000","last_clean":"2024-09-12T01:38:14.744045+0000","last_became_active":"2024-09-12T01:38:12.719394+0000","last_became_peered":"2024-09-12T01:38:12.719394+0000","last_unstale":"2024-09-12T01:38:14.744045+0000","last_undegraded":"2024-09-12T01:38:14.744045+0000","last_fullsized":"2024-09-12T01:38:14.744045+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:54.569718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288647+0000","last_change":"2024-09-12T01:38:12.736351+0000","last_active":"2024-09-12T01:38:14.288647+0000","last_peered":"2024-09-12T01:38:14.288647+0000","last_clean":"2024-09-12T01:38:14.288647+0000","last_became_active":"2024-09-12T01:38:12.736073+0000","last_became_peered":"2024-09-12T01:38:12.736073+0000","last_unstale":"2024-09-12T01:38:14.288647+0000","last_undegraded":"2024-09-12T01:38:14.288647+0000","last_fullsized":"2024-09-12T01:38:14.288647+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:51.948448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716566+0000","last_change":"2024-09-12T01:38:12.733757+0000","last_active":"2024-09-12T01:38:13.716566+0000","last_peered":"2024-09-12T01:38:13.716566+0000","last_clean":"2024-09-12T01:38:13.716566+0000","last_became_active":"2024-09-12T01:38:12.733461+0000","last_became_peered":"2024-09-12T01:38:12.733461+0000","last_unstale":"2024-09-12T01:38:13.716566+0000","last_undegraded":"2024-09-12T01:38:13.716566+0000","last_fullsized":"2024-09-12T01:38:13.716566+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:20.119030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.717090+0000","last_change":"2024-09-12T01:38:12.729757+0000","last_active":"2024-09-12T01:38:13.717090+0000","last_peered":"2024-09-12T01:38:13.717090+0000","last_clean":"2024-09-12T01:38:13.717090+0000","last_became_active":"2024-09-12T01:38:12.729485+0000","last_became_peered":"2024-09-12T01:38:12.729485+0000","last_unstale":"2024-09-12T01:38:13.717090+0000","last_undegraded":"2024-09-12T01:38:13.717090+0000","last_fullsized":"2024-09-12T01:38:13.717090+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:54.792034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743416+0000","last_change":"2024-09-12T01:38:12.721582+0000","last_active":"2024-09-12T01:38:14.743416+0000","last_peered":"2024-09-12T01:38:14.743416+0000","last_clean":"2024-09-12T01:38:14.743416+0000","last_became_active":"2024-09-12T01:38:12.721285+0000","last_became_peered":"2024-09-12T01:38:12.721285+0000","last_unstale":"2024-09-12T01:38:14.743416+0000","last_undegraded":"2024-09-12T01:38:14.743416+0000","last_fullsized":"2024-09-12T01:38:14.743416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:08.116539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288281+0000","last_change":"2024-09-12T01:38:12.735840+0000","last_active":"2024-09-12T01:38:14.288281+0000","last_peered":"2024-09-12T01:38:14.288281+0000","last_clean":"2024-09-12T01:38:14.288281+0000","last_became_active":"2024-09-12T01:38:12.735534+0000","last_became_peered":"2024-09-12T01:38:12.735534+0000","last_unstale":"2024-09-12T01:38:14.288281+0000","last_undegraded":"2024-09-12T01:38:14.288281+0000","last_fullsized":"2024-09-12T01:38:14.288281+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:44.443299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.746593+0000","last_change":"2024-09-12T01:38:12.740372+0000","last_active":"2024-09-12T01:38:12.746593+0000","last_peered":"2024-09-12T01:38:12.746593+0000","last_clean":"2024-09-12T01:38:12.746593+0000","last_became_active":"2024-09-12T01:38:12.740107+0000","last_became_peered":"2024-09-12T01:38:12.740107+0000","last_unstale":"2024-09-12T01:38:12.746593+0000","last_undegraded":"2024-09-12T01:38:12.746593+0000","last_fullsized":"2024-09-12T01:38:12.746593+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:41.042281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733738+0000","last_change":"2024-09-12T01:38:12.731913+0000","last_active":"2024-09-12T01:38:14.733738+0000","last_peered":"2024-09-12T01:38:14.733738+0000","last_clean":"2024-09-12T01:38:14.733738+0000","last_became_active":"2024-09-12T01:38:12.731547+0000","last_became_peered":"2024-09-12T01:38:12.731547+0000","last_unstale":"2024-09-12T01:38:14.733738+0000","last_undegraded":"2024-09-12T01:38:14.733738+0000","last_fullsized":"2024-09-12T01:38:14.733738+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:50.133174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.750028+0000","last_change":"2024-09-12T01:38:11.729176+0000","last_active":"2024-09-12T01:38:12.750028+0000","last_peered":"2024-09-12T01:38:12.750028+0000","last_clean":"2024-09-12T01:38:12.750028+0000","last_became_active":"2024-09-12T01:38:11.728895+0000","last_became_peered":"2024-09-12T01:38:11.728895+0000","last_unstale":"2024-09-12T01:38:12.750028+0000","last_undegraded":"2024-09-12T01:38:12.750028+0000","last_fullsized":"2024-09-12T01:38:12.750028+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:55.174050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.734032+0000","last_change":"2024-09-12T01:38:12.737754+0000","last_active":"2024-09-12T01:38:14.734032+0000","last_peered":"2024-09-12T01:38:14.734032+0000","last_clean":"2024-09-12T01:38:14.734032+0000","last_became_active":"2024-09-12T01:38:12.737437+0000","last_became_peered":"2024-09-12T01:38:12.737437+0000","last_unstale":"2024-09-12T01:38:14.734032+0000","last_undegraded":"2024-09-12T01:38:14.734032+0000","last_fullsized":"2024-09-12T01:38:14.734032+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:19.750791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288646+0000","last_change":"2024-09-12T01:38:11.726648+0000","last_active":"2024-09-12T01:38:14.288646+0000","last_peered":"2024-09-12T01:38:14.288646+0000","last_clean":"2024-09-12T01:38:14.288646+0000","last_became_active":"2024-09-12T01:38:11.726388+0000","last_became_peered":"2024-09-12T01:38:11.726388+0000","last_unstale":"2024-09-12T01:38:14.288646+0000","last_undegraded":"2024-09-12T01:38:14.288646+0000","last_fullsized":"2024-09-12T01:38:14.288646+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:15.155345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716730+0000","last_change":"2024-09-12T01:38:12.736398+0000","last_active":"2024-09-12T01:38:13.716730+0000","last_peered":"2024-09-12T01:38:13.716730+0000","last_clean":"2024-09-12T01:38:13.716730+0000","last_became_active":"2024-09-12T01:38:12.736152+0000","last_became_peered":"2024-09-12T01:38:12.736152+0000","last_unstale":"2024-09-12T01:38:13.716730+0000","last_undegraded":"2024-09-12T01:38:13.716730+0000","last_fullsized":"2024-09-12T01:38:13.716730+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:57.396929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733730+0000","last_change":"2024-09-12T01:38:11.724521+0000","last_active":"2024-09-12T01:38:14.733730+0000","last_peered":"2024-09-12T01:38:14.733730+0000","last_clean":"2024-09-12T01:38:14.733730+0000","last_became_active":"2024-09-12T01:38:11.724234+0000","last_became_peered":"2024-09-12T01:38:11.724234+0000","last_unstale":"2024-09-12T01:38:14.733730+0000","last_undegraded":"2024-09-12T01:38:14.733730+0000","last_fullsized":"2024-09-12T01:38:14.733730+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:25.163798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733592+0000","last_change":"2024-09-12T01:38:12.740097+0000","last_active":"2024-09-12T01:38:14.733592+0000","last_peered":"2024-09-12T01:38:14.733592+0000","last_clean":"2024-09-12T01:38:14.733592+0000","last_became_active":"2024-09-12T01:38:12.738238+0000","last_became_peered":"2024-09-12T01:38:12.738238+0000","last_unstale":"2024-09-12T01:38:14.733592+0000","last_undegraded":"2024-09-12T01:38:14.733592+0000","last_fullsized":"2024-09-12T01:38:14.733592+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:54.569718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743615+0000","last_change":"2024-09-12T01:38:11.726872+0000","last_active":"2024-09-12T01:38:14.743615+0000","last_peered":"2024-09-12T01:38:14.743615+0000","last_clean":"2024-09-12T01:38:14.743615+0000","last_became_active":"2024-09-12T01:38:11.725667+0000","last_became_peered":"2024-09-12T01:38:11.725667+0000","last_unstale":"2024-09-12T01:38:14.743615+0000","last_undegraded":"2024-09-12T01:38:14.743615+0000","last_fullsized":"2024-09-12T01:38:14.743615+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:16.877297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716393+0000","last_change":"2024-09-12T01:38:12.733968+0000","last_active":"2024-09-12T01:38:13.716393+0000","last_peered":"2024-09-12T01:38:13.716393+0000","last_clean":"2024-09-12T01:38:13.716393+0000","last_became_active":"2024-09-12T01:38:12.733600+0000","last_became_peered":"2024-09-12T01:38:12.733600+0000","last_unstale":"2024-09-12T01:38:13.716393+0000","last_undegraded":"2024-09-12T01:38:13.716393+0000","last_fullsized":"2024-09-12T01:38:13.716393+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:20.933567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714616+0000","last_change":"2024-09-12T01:38:11.730616+0000","last_active":"2024-09-12T01:38:13.714616+0000","last_peered":"2024-09-12T01:38:13.714616+0000","last_clean":"2024-09-12T01:38:13.714616+0000","last_became_active":"2024-09-12T01:38:11.730238+0000","last_became_peered":"2024-09-12T01:38:11.730238+0000","last_unstale":"2024-09-12T01:38:13.714616+0000","last_undegraded":"2024-09-12T01:38:13.714616+0000","last_fullsized":"2024-09-12T01:38:13.714616+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:12.827196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.742631+0000","last_change":"2024-09-12T01:38:12.738929+0000","last_active":"2024-09-12T01:38:12.742631+0000","last_peered":"2024-09-12T01:38:12.742631+0000","last_clean":"2024-09-12T01:38:12.742631+0000","last_became_active":"2024-09-12T01:38:12.738563+0000","last_became_peered":"2024-09-12T01:38:12.738563+0000","last_unstale":"2024-09-12T01:38:12.742631+0000","last_undegraded":"2024-09-12T01:38:12.742631+0000","last_fullsized":"2024-09-12T01:38:12.742631+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:55.380555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733278+0000","last_change":"2024-09-12T01:38:11.725637+0000","last_active":"2024-09-12T01:38:14.733278+0000","last_peered":"2024-09-12T01:38:14.733278+0000","last_clean":"2024-09-12T01:38:14.733278+0000","last_became_active":"2024-09-12T01:38:11.725293+0000","last_became_peered":"2024-09-12T01:38:11.725293+0000","last_unstale":"2024-09-12T01:38:14.733278+0000","last_undegraded":"2024-09-12T01:38:14.733278+0000","last_fullsized":"2024-09-12T01:38:14.733278+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:47.440507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714674+0000","last_change":"2024-09-12T01:38:12.719164+0000","last_active":"2024-09-12T01:38:13.714674+0000","last_peered":"2024-09-12T01:38:13.714674+0000","last_clean":"2024-09-12T01:38:13.714674+0000","last_became_active":"2024-09-12T01:38:12.718877+0000","last_became_peered":"2024-09-12T01:38:12.718877+0000","last_unstale":"2024-09-12T01:38:13.714674+0000","last_undegraded":"2024-09-12T01:38:13.714674+0000","last_fullsized":"2024-09-12T01:38:13.714674+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:08.270855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197640+0000","last_change":"2024-09-12T01:38:11.733684+0000","last_active":"2024-09-12T01:38:14.197640+0000","last_peered":"2024-09-12T01:38:14.197640+0000","last_clean":"2024-09-12T01:38:14.197640+0000","last_became_active":"2024-09-12T01:38:11.733363+0000","last_became_peered":"2024-09-12T01:38:11.733363+0000","last_unstale":"2024-09-12T01:38:14.197640+0000","last_undegraded":"2024-09-12T01:38:14.197640+0000","last_fullsized":"2024-09-12T01:38:14.197640+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:50.580410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733622+0000","last_change":"2024-09-12T01:38:12.737426+0000","last_active":"2024-09-12T01:38:14.733622+0000","last_peered":"2024-09-12T01:38:14.733622+0000","last_clean":"2024-09-12T01:38:14.733622+0000","last_became_active":"2024-09-12T01:38:12.731796+0000","last_became_peered":"2024-09-12T01:38:12.731796+0000","last_unstale":"2024-09-12T01:38:14.733622+0000","last_undegraded":"2024-09-12T01:38:14.733622+0000","last_fullsized":"2024-09-12T01:38:14.733622+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:22.446461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743241+0000","last_change":"2024-09-12T01:38:11.730108+0000","last_active":"2024-09-12T01:38:14.743241+0000","last_peered":"2024-09-12T01:38:14.743241+0000","last_clean":"2024-09-12T01:38:14.743241+0000","last_became_active":"2024-09-12T01:38:11.729812+0000","last_became_peered":"2024-09-12T01:38:11.729812+0000","last_unstale":"2024-09-12T01:38:14.743241+0000","last_undegraded":"2024-09-12T01:38:14.743241+0000","last_fullsized":"2024-09-12T01:38:14.743241+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:20.042794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.744078+0000","last_change":"2024-09-12T01:38:12.733905+0000","last_active":"2024-09-12T01:38:14.744078+0000","last_peered":"2024-09-12T01:38:14.744078+0000","last_clean":"2024-09-12T01:38:14.744078+0000","last_became_active":"2024-09-12T01:38:12.733550+0000","last_became_peered":"2024-09-12T01:38:12.733550+0000","last_unstale":"2024-09-12T01:38:14.744078+0000","last_undegraded":"2024-09-12T01:38:14.744078+0000","last_fullsized":"2024-09-12T01:38:14.744078+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:22.446461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197912+0000","last_change":"2024-09-12T01:38:11.726976+0000","last_active":"2024-09-12T01:38:14.197912+0000","last_peered":"2024-09-12T01:38:14.197912+0000","last_clean":"2024-09-12T01:38:14.197912+0000","last_became_active":"2024-09-12T01:38:11.726699+0000","last_became_peered":"2024-09-12T01:38:11.726699+0000","last_unstale":"2024-09-12T01:38:14.197912+0000","last_undegraded":"2024-09-12T01:38:14.197912+0000","last_fullsized":"2024-09-12T01:38:14.197912+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:06.259836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714477+0000","last_change":"2024-09-12T01:38:12.730041+0000","last_active":"2024-09-12T01:38:13.714477+0000","last_peered":"2024-09-12T01:38:13.714477+0000","last_clean":"2024-09-12T01:38:13.714477+0000","last_became_active":"2024-09-12T01:38:12.729772+0000","last_became_peered":"2024-09-12T01:38:12.729772+0000","last_unstale":"2024-09-12T01:38:13.714477+0000","last_undegraded":"2024-09-12T01:38:13.714477+0000","last_fullsized":"2024-09-12T01:38:13.714477+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:15.877225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716937+0000","last_change":"2024-09-12T01:38:11.732803+0000","last_active":"2024-09-12T01:38:13.716937+0000","last_peered":"2024-09-12T01:38:13.716937+0000","last_clean":"2024-09-12T01:38:13.716937+0000","last_became_active":"2024-09-12T01:38:11.732374+0000","last_became_peered":"2024-09-12T01:38:11.732374+0000","last_unstale":"2024-09-12T01:38:13.716937+0000","last_undegraded":"2024-09-12T01:38:13.716937+0000","last_fullsized":"2024-09-12T01:38:13.716937+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:05.473148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716944+0000","last_change":"2024-09-12T01:38:12.736088+0000","last_active":"2024-09-12T01:38:13.716944+0000","last_peered":"2024-09-12T01:38:13.716944+0000","last_clean":"2024-09-12T01:38:13.716944+0000","last_became_active":"2024-09-12T01:38:12.735803+0000","last_became_peered":"2024-09-12T01:38:12.735803+0000","last_unstale":"2024-09-12T01:38:13.716944+0000","last_undegraded":"2024-09-12T01:38:13.716944+0000","last_fullsized":"2024-09-12T01:38:13.716944+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:17.885548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743557+0000","last_change":"2024-09-12T01:38:11.725946+0000","last_active":"2024-09-12T01:38:14.743557+0000","last_peered":"2024-09-12T01:38:14.743557+0000","last_clean":"2024-09-12T01:38:14.743557+0000","last_became_active":"2024-09-12T01:38:11.725641+0000","last_became_peered":"2024-09-12T01:38:11.725641+0000","last_unstale":"2024-09-12T01:38:14.743557+0000","last_undegraded":"2024-09-12T01:38:14.743557+0000","last_fullsized":"2024-09-12T01:38:14.743557+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:19.110778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743290+0000","last_change":"2024-09-12T01:38:12.726779+0000","last_active":"2024-09-12T01:38:14.743290+0000","last_peered":"2024-09-12T01:38:14.743290+0000","last_clean":"2024-09-12T01:38:14.743290+0000","last_became_active":"2024-09-12T01:38:12.726506+0000","last_became_peered":"2024-09-12T01:38:12.726506+0000","last_unstale":"2024-09-12T01:38:14.743290+0000","last_undegraded":"2024-09-12T01:38:14.743290+0000","last_fullsized":"2024-09-12T01:38:14.743290+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:18.098154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.744032+0000","last_change":"2024-09-12T01:38:11.731727+0000","last_active":"2024-09-12T01:38:14.744032+0000","last_peered":"2024-09-12T01:38:14.744032+0000","last_clean":"2024-09-12T01:38:14.744032+0000","last_became_active":"2024-09-12T01:38:11.731443+0000","last_became_peered":"2024-09-12T01:38:11.731443+0000","last_unstale":"2024-09-12T01:38:14.744032+0000","last_undegraded":"2024-09-12T01:38:14.744032+0000","last_fullsized":"2024-09-12T01:38:14.744032+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:06.804474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197793+0000","last_change":"2024-09-12T01:38:12.735905+0000","last_active":"2024-09-12T01:38:14.197793+0000","last_peered":"2024-09-12T01:38:14.197793+0000","last_clean":"2024-09-12T01:38:14.197793+0000","last_became_active":"2024-09-12T01:38:12.735584+0000","last_became_peered":"2024-09-12T01:38:12.735584+0000","last_unstale":"2024-09-12T01:38:14.197793+0000","last_undegraded":"2024-09-12T01:38:14.197793+0000","last_fullsized":"2024-09-12T01:38:14.197793+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:13.835448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.717066+0000","last_change":"2024-09-12T01:38:11.732400+0000","last_active":"2024-09-12T01:38:13.717066+0000","last_peered":"2024-09-12T01:38:13.717066+0000","last_clean":"2024-09-12T01:38:13.717066+0000","last_became_active":"2024-09-12T01:38:11.732049+0000","last_became_peered":"2024-09-12T01:38:11.732049+0000","last_unstale":"2024-09-12T01:38:13.717066+0000","last_undegraded":"2024-09-12T01:38:13.717066+0000","last_fullsized":"2024-09-12T01:38:13.717066+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:21.438209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714559+0000","last_change":"2024-09-12T01:38:12.727984+0000","last_active":"2024-09-12T01:38:13.714559+0000","last_peered":"2024-09-12T01:38:13.714559+0000","last_clean":"2024-09-12T01:38:13.714559+0000","last_became_active":"2024-09-12T01:38:12.727733+0000","last_became_peered":"2024-09-12T01:38:12.727733+0000","last_unstale":"2024-09-12T01:38:13.714559+0000","last_undegraded":"2024-09-12T01:38:13.714559+0000","last_fullsized":"2024-09-12T01:38:13.714559+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:19.750791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743524+0000","last_change":"2024-09-12T01:38:11.720875+0000","last_active":"2024-09-12T01:38:14.743524+0000","last_peered":"2024-09-12T01:38:14.743524+0000","last_clean":"2024-09-12T01:38:14.743524+0000","last_became_active":"2024-09-12T01:38:11.720549+0000","last_became_peered":"2024-09-12T01:38:11.720549+0000","last_unstale":"2024-09-12T01:38:14.743524+0000","last_undegraded":"2024-09-12T01:38:14.743524+0000","last_fullsized":"2024-09-12T01:38:14.743524+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:56.388678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197756+0000","last_change":"2024-09-12T01:38:12.731105+0000","last_active":"2024-09-12T01:38:14.197756+0000","last_peered":"2024-09-12T01:38:14.197756+0000","last_clean":"2024-09-12T01:38:14.197756+0000","last_became_active":"2024-09-12T01:38:12.730819+0000","last_became_peered":"2024-09-12T01:38:12.730819+0000","last_unstale":"2024-09-12T01:38:14.197756+0000","last_undegraded":"2024-09-12T01:38:14.197756+0000","last_fullsized":"2024-09-12T01:38:14.197756+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:26.911429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743722+0000","last_change":"2024-09-12T01:38:11.729008+0000","last_active":"2024-09-12T01:38:14.743722+0000","last_peered":"2024-09-12T01:38:14.743722+0000","last_clean":"2024-09-12T01:38:14.743722+0000","last_became_active":"2024-09-12T01:38:11.728735+0000","last_became_peered":"2024-09-12T01:38:11.728735+0000","last_unstale":"2024-09-12T01:38:14.743722+0000","last_undegraded":"2024-09-12T01:38:14.743722+0000","last_fullsized":"2024-09-12T01:38:14.743722+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:44.311552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743632+0000","last_change":"2024-09-12T01:38:12.737825+0000","last_active":"2024-09-12T01:38:14.743632+0000","last_peered":"2024-09-12T01:38:14.743632+0000","last_clean":"2024-09-12T01:38:14.743632+0000","last_became_active":"2024-09-12T01:38:12.737511+0000","last_became_peered":"2024-09-12T01:38:12.737511+0000","last_unstale":"2024-09-12T01:38:14.743632+0000","last_undegraded":"2024-09-12T01:38:14.743632+0000","last_fullsized":"2024-09-12T01:38:14.743632+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:16.162718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":22,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743227+0000","last_change":"2024-09-12T01:38:11.721195+0000","last_active":"2024-09-12T01:38:14.743227+0000","last_peered":"2024-09-12T01:38:14.743227+0000","last_clean":"2024-09-12T01:38:14.743227+0000","last_became_active":"2024-09-12T01:38:11.720887+0000","last_became_peered":"2024-09-12T01:38:11.720887+0000","last_unstale":"2024-09-12T01:38:14.743227+0000","last_undegraded":"2024-09-12T01:38:14.743227+0000","last_fullsized":"2024-09-12T01:38:14.743227+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:19.925316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714402+0000","last_change":"2024-09-12T01:38:12.733185+0000","last_active":"2024-09-12T01:38:13.714402+0000","last_peered":"2024-09-12T01:38:13.714402+0000","last_clean":"2024-09-12T01:38:13.714402+0000","last_became_active":"2024-09-12T01:38:12.732777+0000","last_became_peered":"2024-09-12T01:38:12.732777+0000","last_unstale":"2024-09-12T01:38:13.714402+0000","last_undegraded":"2024-09-12T01:38:13.714402+0000","last_fullsized":"2024-09-12T01:38:13.714402+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:41.064514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288750+0000","last_change":"2024-09-12T01:38:11.724633+0000","last_active":"2024-09-12T01:38:14.288750+0000","last_peered":"2024-09-12T01:38:14.288750+0000","last_clean":"2024-09-12T01:38:14.288750+0000","last_became_active":"2024-09-12T01:38:11.724354+0000","last_became_peered":"2024-09-12T01:38:11.724354+0000","last_unstale":"2024-09-12T01:38:14.288750+0000","last_undegraded":"2024-09-12T01:38:14.288750+0000","last_fullsized":"2024-09-12T01:38:14.288750+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:25.865526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714543+0000","last_change":"2024-09-12T01:38:12.729998+0000","last_active":"2024-09-12T01:38:13.714543+0000","last_peered":"2024-09-12T01:38:13.714543+0000","last_clean":"2024-09-12T01:38:13.714543+0000","last_became_active":"2024-09-12T01:38:12.729748+0000","last_became_peered":"2024-09-12T01:38:12.729748+0000","last_unstale":"2024-09-12T01:38:13.714543+0000","last_undegraded":"2024-09-12T01:38:13.714543+0000","last_fullsized":"2024-09-12T01:38:13.714543+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:52.612408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.717069+0000","last_change":"2024-09-12T01:38:11.732368+0000","last_active":"2024-09-12T01:38:13.717069+0000","last_peered":"2024-09-12T01:38:13.717069+0000","last_clean":"2024-09-12T01:38:13.717069+0000","last_became_active":"2024-09-12T01:38:11.732068+0000","last_became_peered":"2024-09-12T01:38:11.732068+0000","last_unstale":"2024-09-12T01:38:13.717069+0000","last_undegraded":"2024-09-12T01:38:13.717069+0000","last_fullsized":"2024-09-12T01:38:13.717069+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:53.561466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288374+0000","last_change":"2024-09-12T01:38:12.734986+0000","last_active":"2024-09-12T01:38:14.288374+0000","last_peered":"2024-09-12T01:38:14.288374+0000","last_clean":"2024-09-12T01:38:14.288374+0000","last_became_active":"2024-09-12T01:38:12.734698+0000","last_became_peered":"2024-09-12T01:38:12.734698+0000","last_unstale":"2024-09-12T01:38:14.288374+0000","last_undegraded":"2024-09-12T01:38:14.288374+0000","last_fullsized":"2024-09-12T01:38:14.288374+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:26.172050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714578+0000","last_change":"2024-09-12T01:38:11.725283+0000","last_active":"2024-09-12T01:38:13.714578+0000","last_peered":"2024-09-12T01:38:13.714578+0000","last_clean":"2024-09-12T01:38:13.714578+0000","last_became_active":"2024-09-12T01:38:11.724867+0000","last_became_peered":"2024-09-12T01:38:11.724867+0000","last_unstale":"2024-09-12T01:38:13.714578+0000","last_undegraded":"2024-09-12T01:38:13.714578+0000","last_fullsized":"2024-09-12T01:38:13.714578+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:25.251697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743446+0000","last_change":"2024-09-12T01:38:12.738471+0000","last_active":"2024-09-12T01:38:14.743446+0000","last_peered":"2024-09-12T01:38:14.743446+0000","last_clean":"2024-09-12T01:38:14.743446+0000","last_became_active":"2024-09-12T01:38:12.738085+0000","last_became_peered":"2024-09-12T01:38:12.738085+0000","last_unstale":"2024-09-12T01:38:14.743446+0000","last_undegraded":"2024-09-12T01:38:14.743446+0000","last_fullsized":"2024-09-12T01:38:14.743446+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:22.270787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716878+0000","last_change":"2024-09-12T01:38:11.724538+0000","last_active":"2024-09-12T01:38:13.716878+0000","last_peered":"2024-09-12T01:38:13.716878+0000","last_clean":"2024-09-12T01:38:13.716878+0000","last_became_active":"2024-09-12T01:38:11.724255+0000","last_became_peered":"2024-09-12T01:38:11.724255+0000","last_unstale":"2024-09-12T01:38:13.716878+0000","last_undegraded":"2024-09-12T01:38:13.716878+0000","last_fullsized":"2024-09-12T01:38:13.716878+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:49.124922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197736+0000","last_change":"2024-09-12T01:38:12.733470+0000","last_active":"2024-09-12T01:38:14.197736+0000","last_peered":"2024-09-12T01:38:14.197736+0000","last_clean":"2024-09-12T01:38:14.197736+0000","last_became_active":"2024-09-12T01:38:12.733152+0000","last_became_peered":"2024-09-12T01:38:12.733152+0000","last_unstale":"2024-09-12T01:38:14.197736+0000","last_undegraded":"2024-09-12T01:38:14.197736+0000","last_fullsized":"2024-09-12T01:38:14.197736+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:48.448758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.749349+0000","last_change":"2024-09-12T01:38:11.733545+0000","last_active":"2024-09-12T01:38:12.749349+0000","last_peered":"2024-09-12T01:38:12.749349+0000","last_clean":"2024-09-12T01:38:12.749349+0000","last_became_active":"2024-09-12T01:38:11.733332+0000","last_became_peered":"2024-09-12T01:38:11.733332+0000","last_unstale":"2024-09-12T01:38:12.749349+0000","last_undegraded":"2024-09-12T01:38:12.749349+0000","last_fullsized":"2024-09-12T01:38:12.749349+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:16.569153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716954+0000","last_change":"2024-09-12T01:38:12.726454+0000","last_active":"2024-09-12T01:38:13.716954+0000","last_peered":"2024-09-12T01:38:13.716954+0000","last_clean":"2024-09-12T01:38:13.716954+0000","last_became_active":"2024-09-12T01:38:12.726193+0000","last_became_peered":"2024-09-12T01:38:12.726193+0000","last_unstale":"2024-09-12T01:38:13.716954+0000","last_undegraded":"2024-09-12T01:38:13.716954+0000","last_fullsized":"2024-09-12T01:38:13.716954+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:43.841874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716398+0000","last_change":"2024-09-12T01:38:11.732234+0000","last_active":"2024-09-12T01:38:13.716398+0000","last_peered":"2024-09-12T01:38:13.716398+0000","last_clean":"2024-09-12T01:38:13.716398+0000","last_became_active":"2024-09-12T01:38:11.731952+0000","last_became_peered":"2024-09-12T01:38:11.731952+0000","last_unstale":"2024-09-12T01:38:13.716398+0000","last_undegraded":"2024-09-12T01:38:13.716398+0000","last_fullsized":"2024-09-12T01:38:13.716398+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:40.056262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.715812+0000","last_change":"2024-09-12T01:38:12.725434+0000","last_active":"2024-09-12T01:38:13.715812+0000","last_peered":"2024-09-12T01:38:13.715812+0000","last_clean":"2024-09-12T01:38:13.715812+0000","last_became_active":"2024-09-12T01:38:12.725143+0000","last_became_peered":"2024-09-12T01:38:12.725143+0000","last_unstale":"2024-09-12T01:38:13.715812+0000","last_undegraded":"2024-09-12T01:38:13.715812+0000","last_fullsized":"2024-09-12T01:38:13.715812+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:11.587134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197837+0000","last_change":"2024-09-12T01:38:11.725899+0000","last_active":"2024-09-12T01:38:14.197837+0000","last_peered":"2024-09-12T01:38:14.197837+0000","last_clean":"2024-09-12T01:38:14.197837+0000","last_became_active":"2024-09-12T01:38:11.725643+0000","last_became_peered":"2024-09-12T01:38:11.725643+0000","last_unstale":"2024-09-12T01:38:14.197837+0000","last_undegraded":"2024-09-12T01:38:14.197837+0000","last_fullsized":"2024-09-12T01:38:14.197837+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:45.279495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714584+0000","last_change":"2024-09-12T01:38:12.727354+0000","last_active":"2024-09-12T01:38:13.714584+0000","last_peered":"2024-09-12T01:38:13.714584+0000","last_clean":"2024-09-12T01:38:13.714584+0000","last_became_active":"2024-09-12T01:38:12.727046+0000","last_became_peered":"2024-09-12T01:38:12.727046+0000","last_unstale":"2024-09-12T01:38:13.714584+0000","last_undegraded":"2024-09-12T01:38:13.714584+0000","last_fullsized":"2024-09-12T01:38:13.714584+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:50.089722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288814+0000","last_change":"2024-09-12T01:38:11.729295+0000","last_active":"2024-09-12T01:38:14.288814+0000","last_peered":"2024-09-12T01:38:14.288814+0000","last_clean":"2024-09-12T01:38:14.288814+0000","last_became_active":"2024-09-12T01:38:11.728988+0000","last_became_peered":"2024-09-12T01:38:11.728988+0000","last_unstale":"2024-09-12T01:38:14.288814+0000","last_undegraded":"2024-09-12T01:38:14.288814+0000","last_fullsized":"2024-09-12T01:38:14.288814+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:50.869678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714649+0000","last_change":"2024-09-12T01:38:12.719316+0000","last_active":"2024-09-12T01:38:13.714649+0000","last_peered":"2024-09-12T01:38:13.714649+0000","last_clean":"2024-09-12T01:38:13.714649+0000","last_became_active":"2024-09-12T01:38:12.718620+0000","last_became_peered":"2024-09-12T01:38:12.718620+0000","last_unstale":"2024-09-12T01:38:13.714649+0000","last_undegraded":"2024-09-12T01:38:13.714649+0000","last_fullsized":"2024-09-12T01:38:13.714649+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:43.842816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.735294+0000","last_change":"2024-09-12T01:38:11.725794+0000","last_active":"2024-09-12T01:38:14.735294+0000","last_peered":"2024-09-12T01:38:14.735294+0000","last_clean":"2024-09-12T01:38:14.735294+0000","last_became_active":"2024-09-12T01:38:11.725492+0000","last_became_peered":"2024-09-12T01:38:11.725492+0000","last_unstale":"2024-09-12T01:38:14.735294+0000","last_undegraded":"2024-09-12T01:38:14.735294+0000","last_fullsized":"2024-09-12T01:38:14.735294+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:22.213745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288519+0000","last_change":"2024-09-12T01:38:12.734405+0000","last_active":"2024-09-12T01:38:14.288519+0000","last_peered":"2024-09-12T01:38:14.288519+0000","last_clean":"2024-09-12T01:38:14.288519+0000","last_became_active":"2024-09-12T01:38:12.734031+0000","last_became_peered":"2024-09-12T01:38:12.734031+0000","last_unstale":"2024-09-12T01:38:14.288519+0000","last_undegraded":"2024-09-12T01:38:14.288519+0000","last_fullsized":"2024-09-12T01:38:14.288519+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:48.448758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197849+0000","last_change":"2024-09-12T01:38:11.730382+0000","last_active":"2024-09-12T01:38:14.197849+0000","last_peered":"2024-09-12T01:38:14.197849+0000","last_clean":"2024-09-12T01:38:14.197849+0000","last_became_active":"2024-09-12T01:38:11.730078+0000","last_became_peered":"2024-09-12T01:38:11.730078+0000","last_unstale":"2024-09-12T01:38:14.197849+0000","last_undegraded":"2024-09-12T01:38:14.197849+0000","last_fullsized":"2024-09-12T01:38:14.197849+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:08.873939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716612+0000","last_change":"2024-09-12T01:38:12.737652+0000","last_active":"2024-09-12T01:38:13.716612+0000","last_peered":"2024-09-12T01:38:13.716612+0000","last_clean":"2024-09-12T01:38:13.716612+0000","last_became_active":"2024-09-12T01:38:12.737182+0000","last_became_peered":"2024-09-12T01:38:12.737182+0000","last_unstale":"2024-09-12T01:38:13.716612+0000","last_undegraded":"2024-09-12T01:38:13.716612+0000","last_fullsized":"2024-09-12T01:38:13.716612+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:45.319803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714258+0000","last_change":"2024-09-12T01:38:11.726640+0000","last_active":"2024-09-12T01:38:13.714258+0000","last_peered":"2024-09-12T01:38:13.714258+0000","last_clean":"2024-09-12T01:38:13.714258+0000","last_became_active":"2024-09-12T01:38:11.726344+0000","last_became_peered":"2024-09-12T01:38:11.726344+0000","last_unstale":"2024-09-12T01:38:13.714258+0000","last_undegraded":"2024-09-12T01:38:13.714258+0000","last_fullsized":"2024-09-12T01:38:13.714258+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:06.804474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733225+0000","last_change":"2024-09-12T01:38:12.737263+0000","last_active":"2024-09-12T01:38:14.733225+0000","last_peered":"2024-09-12T01:38:14.733225+0000","last_clean":"2024-09-12T01:38:14.733225+0000","last_became_active":"2024-09-12T01:38:12.736811+0000","last_became_peered":"2024-09-12T01:38:12.736811+0000","last_unstale":"2024-09-12T01:38:14.733225+0000","last_undegraded":"2024-09-12T01:38:14.733225+0000","last_fullsized":"2024-09-12T01:38:14.733225+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:24.268882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288307+0000","last_change":"2024-09-12T01:38:11.725106+0000","last_active":"2024-09-12T01:38:14.288307+0000","last_peered":"2024-09-12T01:38:14.288307+0000","last_clean":"2024-09-12T01:38:14.288307+0000","last_became_active":"2024-09-12T01:38:11.724752+0000","last_became_peered":"2024-09-12T01:38:11.724752+0000","last_unstale":"2024-09-12T01:38:14.288307+0000","last_undegraded":"2024-09-12T01:38:14.288307+0000","last_fullsized":"2024-09-12T01:38:14.288307+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:27.533311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743930+0000","last_change":"2024-09-12T01:38:12.727841+0000","last_active":"2024-09-12T01:38:14.743930+0000","last_peered":"2024-09-12T01:38:14.743930+0000","last_clean":"2024-09-12T01:38:14.743930+0000","last_became_active":"2024-09-12T01:38:12.726703+0000","last_became_peered":"2024-09-12T01:38:12.726703+0000","last_unstale":"2024-09-12T01:38:14.743930+0000","last_undegraded":"2024-09-12T01:38:14.743930+0000","last_fullsized":"2024-09-12T01:38:14.743930+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:06.481399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714423+0000","last_change":"2024-09-12T01:38:11.724147+0000","last_active":"2024-09-12T01:38:13.714423+0000","last_peered":"2024-09-12T01:38:13.714423+0000","last_clean":"2024-09-12T01:38:13.714423+0000","last_became_active":"2024-09-12T01:38:11.723867+0000","last_became_peered":"2024-09-12T01:38:11.723867+0000","last_unstale":"2024-09-12T01:38:13.714423+0000","last_undegraded":"2024-09-12T01:38:13.714423+0000","last_fullsized":"2024-09-12T01:38:13.714423+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.716475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.715857+0000","last_change":"2024-09-12T01:38:12.730437+0000","last_active":"2024-09-12T01:38:13.715857+0000","last_peered":"2024-09-12T01:38:13.715857+0000","last_clean":"2024-09-12T01:38:13.715857+0000","last_became_active":"2024-09-12T01:38:12.730173+0000","last_became_peered":"2024-09-12T01:38:12.730173+0000","last_unstale":"2024-09-12T01:38:13.715857+0000","last_undegraded":"2024-09-12T01:38:13.715857+0000","last_fullsized":"2024-09-12T01:38:13.715857+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:59.090243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733482+0000","last_change":"2024-09-12T01:38:11.729599+0000","last_active":"2024-09-12T01:38:14.733482+0000","last_peered":"2024-09-12T01:38:14.733482+0000","last_clean":"2024-09-12T01:38:14.733482+0000","last_became_active":"2024-09-12T01:38:11.729302+0000","last_became_peered":"2024-09-12T01:38:11.729302+0000","last_unstale":"2024-09-12T01:38:14.733482+0000","last_undegraded":"2024-09-12T01:38:14.733482+0000","last_fullsized":"2024-09-12T01:38:14.733482+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:25.903178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288300+0000","last_change":"2024-09-12T01:38:12.735795+0000","last_active":"2024-09-12T01:38:14.288300+0000","last_peered":"2024-09-12T01:38:14.288300+0000","last_clean":"2024-09-12T01:38:14.288300+0000","last_became_active":"2024-09-12T01:38:12.735242+0000","last_became_peered":"2024-09-12T01:38:12.735242+0000","last_unstale":"2024-09-12T01:38:14.288300+0000","last_undegraded":"2024-09-12T01:38:14.288300+0000","last_fullsized":"2024-09-12T01:38:14.288300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:23.221997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.715967+0000","last_change":"2024-09-12T01:38:11.728987+0000","last_active":"2024-09-12T01:38:13.715967+0000","last_peered":"2024-09-12T01:38:13.715967+0000","last_clean":"2024-09-12T01:38:13.715967+0000","last_became_active":"2024-09-12T01:38:11.728543+0000","last_became_peered":"2024-09-12T01:38:11.728543+0000","last_unstale":"2024-09-12T01:38:13.715967+0000","last_undegraded":"2024-09-12T01:38:13.715967+0000","last_fullsized":"2024-09-12T01:38:13.715967+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:14.868973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716130+0000","last_change":"2024-09-12T01:38:12.736909+0000","last_active":"2024-09-12T01:38:13.716130+0000","last_peered":"2024-09-12T01:38:13.716130+0000","last_clean":"2024-09-12T01:38:13.716130+0000","last_became_active":"2024-09-12T01:38:12.736617+0000","last_became_peered":"2024-09-12T01:38:12.736617+0000","last_unstale":"2024-09-12T01:38:13.716130+0000","last_undegraded":"2024-09-12T01:38:13.716130+0000","last_fullsized":"2024-09-12T01:38:13.716130+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:16.258768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743719+0000","last_change":"2024-09-12T01:38:11.725890+0000","last_active":"2024-09-12T01:38:14.743719+0000","last_peered":"2024-09-12T01:38:14.743719+0000","last_clean":"2024-09-12T01:38:14.743719+0000","last_became_active":"2024-09-12T01:38:11.725628+0000","last_became_peered":"2024-09-12T01:38:11.725628+0000","last_unstale":"2024-09-12T01:38:14.743719+0000","last_undegraded":"2024-09-12T01:38:14.743719+0000","last_fullsized":"2024-09-12T01:38:14.743719+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:25.251697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":234,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197876+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:38:14.197876+0000","last_peered":"2024-09-12T01:38:14.197876+0000","last_clean":"2024-09-12T01:38:14.197876+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:38:14.197876+0000","last_undegraded":"2024-09-12T01:38:14.197876+0000","last_fullsized":"2024-09-12T01:38:14.197876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":276242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":276172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1273856,"data_stored":866552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":679936,"data_stored":276240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":696320,"data_stored":277922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1273856,"data_stored":867100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":675840,"data_stored":271462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":671744,"data_stored":270466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:17.713 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:17.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.852+0000 7fc1894dd640 1 Processor -- start 2024-09-12T01:38:17.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.853+0000 7fc1894dd640 1 -- start start 2024-09-12T01:38:17.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.853+0000 7fc1894dd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc18415e660 0x7fc1840cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.853+0000 7fc1894dd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc18415ea40 con 0x7fc1840d1820 2024-09-12T01:38:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.853+0000 7fc1894dd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1840d3870 con 0x7fc1840d3310 2024-09-12T01:38:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.853+0000 7fc1894dd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc1840d3b50 con 0x7fc18415e660 2024-09-12T01:38:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.853+0000 7fc1837fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc1840d1820 0x7fc1840b7b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34826/0 (socket says 172.21.15.60:34826) 2024-09-12T01:38:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.854+0000 7fc1837fe640 1 -- 172.21.15.60:0/2867510987 learned_addr learned my addr 172.21.15.60:0/2867510987 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.854+0000 7fc182ffd640 1 --2- 172.21.15.60:0/2867510987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc18415e660 0x7fc1840cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.854+0000 7fc181ffb640 1 -- 172.21.15.60:0/2867510987 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013357510 0 0) 0x7fc18415ea40 con 0x7fc1840d1820 2024-09-12T01:38:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.854+0000 7fc181ffb640 1 -- 172.21.15.60:0/2867510987 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc170003520 con 0x7fc1840d1820 2024-09-12T01:38:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.854+0000 7fc181ffb640 1 -- 172.21.15.60:0/2867510987 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193732713 0 0) 0x7fc1840d3870 con 0x7fc1840d3310 2024-09-12T01:38:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.854+0000 7fc181ffb640 1 -- 172.21.15.60:0/2867510987 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc18415ea40 con 0x7fc1840d3310 2024-09-12T01:38:17.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.854+0000 7fc181ffb640 1 -- 172.21.15.60:0/2867510987 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4273962576 0 0) 0x7fc170003520 con 0x7fc1840d1820 2024-09-12T01:38:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.854+0000 7fc182ffd640 1 -- 172.21.15.60:0/2867510987 >> v1:172.21.15.105:6789/0 conn(0x7fc1840d3310 legacy=0x7fc1840d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.854+0000 7fc182ffd640 1 -- 172.21.15.60:0/2867510987 >> v1:172.21.15.60:6789/0 conn(0x7fc1840d1820 legacy=0x7fc1840b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.854+0000 7fc182ffd640 1 -- 172.21.15.60:0/2867510987 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1840d3e30 con 0x7fc18415e660 2024-09-12T01:38:17.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.855+0000 7fc182ffd640 1 --2- 172.21.15.60:0/2867510987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc18415e660 0x7fc1840cf730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0097d0 tx=0x7fc17c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40f1a848eef907ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:17.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.855+0000 7fc181ffb640 1 -- 172.21.15.60:0/2867510987 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c037070 con 0x7fc18415e660 2024-09-12T01:38:17.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.855+0000 7fc181ffb640 1 -- 172.21.15.60:0/2867510987 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc17c02ac30 con 0x7fc18415e660 2024-09-12T01:38:17.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.855+0000 7fc181ffb640 1 -- 172.21.15.60:0/2867510987 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174001970 con 0x7fc18415e660 2024-09-12T01:38:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.856+0000 7fc1894dd640 1 -- 172.21.15.60:0/2867510987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc18415e660 msgr2=0x7fc1840cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.856+0000 7fc1894dd640 1 --2- 172.21.15.60:0/2867510987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc18415e660 0x7fc1840cf730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0097d0 tx=0x7fc17c02a1a0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.856+0000 7fc1894dd640 1 -- 172.21.15.60:0/2867510987 shutdown_connections 2024-09-12T01:38:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.856+0000 7fc1894dd640 1 --2- 172.21.15.60:0/2867510987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc18415e660 0x7fc1840cf730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.856+0000 7fc1894dd640 1 -- 172.21.15.60:0/2867510987 >> 172.21.15.60:0/2867510987 conn(0x7fc1840b6410 msgr2=0x7fc1840b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.856+0000 7fc1894dd640 1 -- 172.21.15.60:0/2867510987 shutdown_connections 2024-09-12T01:38:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.856+0000 7fc1894dd640 1 -- 172.21.15.60:0/2867510987 wait complete. 2024-09-12T01:38:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.857+0000 7fc1894dd640 1 Processor -- start 2024-09-12T01:38:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.857+0000 7fc1894dd640 1 -- start start 2024-09-12T01:38:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1894dd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1840d1820 0x7fc1841525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1894dd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840d3310 0x7fc1841f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1894dd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc18415e660 0x7fc1841f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1894dd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc1840cfc70 con 0x7fc1840d3310 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1894dd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc1840d43f0 con 0x7fc18415e660 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1894dd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc1840b8280 con 0x7fc1840d1820 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1827fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840d3310 0x7fc1841f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1827fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840d3310 0x7fc1841f3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38400/0 (socket says 172.21.15.60:38400) 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1827fc640 1 -- 172.21.15.60:0/301179396 learned_addr learned my addr 172.21.15.60:0/301179396 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1837fe640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc18415e660 0x7fc1841f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc182ffd640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1840d1820 0x7fc1841525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1827fc640 1 -- 172.21.15.60:0/301179396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1840d1820 msgr2=0x7fc1841525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1827fc640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1840d1820 0x7fc1841525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1827fc640 1 -- 172.21.15.60:0/301179396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc18415e660 msgr2=0x7fc1841f4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1827fc640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc18415e660 0x7fc1841f4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1827fc640 1 -- 172.21.15.60:0/301179396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc184154e40 con 0x7fc1840d3310 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc182ffd640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1840d1820 0x7fc1841525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1827fc640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840d3310 0x7fc1841f3f50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c4d0 tx=0x7fc16c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:17.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc17b7fe640 1 -- 172.21.15.60:0/301179396 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0052d0 con 0x7fc1840d3310 2024-09-12T01:38:17.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc17b7fe640 1 -- 172.21.15.60:0/301179396 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc16c005470 con 0x7fc1840d3310 2024-09-12T01:38:17.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc1894dd640 1 -- 172.21.15.60:0/301179396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc184155120 con 0x7fc1840d3310 2024-09-12T01:38:17.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.858+0000 7fc17b7fe640 1 -- 172.21.15.60:0/301179396 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c012870 con 0x7fc1840d3310 2024-09-12T01:38:17.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.859+0000 7fc1894dd640 1 -- 172.21.15.60:0/301179396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1841556e0 con 0x7fc1840d3310 2024-09-12T01:38:17.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.860+0000 7fc1894dd640 1 -- 172.21.15.60:0/301179396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1840d3870 con 0x7fc1840d3310 2024-09-12T01:38:17.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.860+0000 7fc17b7fe640 1 -- 172.21.15.60:0/301179396 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc16c012ad0 con 0x7fc1840d3310 2024-09-12T01:38:17.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.861+0000 7fc17b7fe640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc16406be30 0x7fc16406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:17.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.861+0000 7fc17b7fe640 1 -- 172.21.15.60:0/301179396 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fc16c08ab00 con 0x7fc1840d3310 2024-09-12T01:38:17.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.861+0000 7fc182ffd640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc16406be30 0x7fc16406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:17.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.861+0000 7fc182ffd640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc16406be30 0x7fc16406e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc17c034000 tx=0x7fc17c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:17.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:17.865+0000 7fc17b7fe640 1 -- 172.21.15.60:0/301179396 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc1840d3870 con 0x7fc1840d3310 2024-09-12T01:38:18.018 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:38:18.020 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:38:18.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.037+0000 7fc1894dd640 1 -- 172.21.15.60:0/301179396 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc1840cf730 con 0x7fc16406be30 2024-09-12T01:38:18.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.043+0000 7fc17b7fe640 1 -- 172.21.15.60:0/301179396 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251954 (secure 0 0 0) 0x7fc1840cf730 con 0x7fc16406be30 2024-09-12T01:38:18.046 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:18.047 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:38:18.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.046+0000 7fc1894dd640 1 -- 172.21.15.60:0/301179396 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc16406be30 msgr2=0x7fc16406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.046+0000 7fc1894dd640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc16406be30 0x7fc16406e2f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc17c034000 tx=0x7fc17c02e000 comp rx=0 tx=0).stop 2024-09-12T01:38:18.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.046+0000 7fc1894dd640 1 -- 172.21.15.60:0/301179396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840d3310 msgr2=0x7fc1841f3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.046+0000 7fc1894dd640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840d3310 0x7fc1841f3f50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00c4d0 tx=0x7fc16c00c990 comp rx=0 tx=0).stop 2024-09-12T01:38:18.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.046+0000 7fc1894dd640 1 -- 172.21.15.60:0/301179396 shutdown_connections 2024-09-12T01:38:18.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.046+0000 7fc1894dd640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc18415e660 0x7fc1841f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.046+0000 7fc1894dd640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840d3310 0x7fc1841f3f50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.046+0000 7fc1894dd640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc16406be30 0x7fc16406e2f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.046+0000 7fc1894dd640 1 --2- 172.21.15.60:0/301179396 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc1840d1820 0x7fc1841525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.046+0000 7fc1894dd640 1 -- 172.21.15.60:0/301179396 >> 172.21.15.60:0/301179396 conn(0x7fc1840b6410 msgr2=0x7fc1840b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:18.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.046+0000 7fc1894dd640 1 -- 172.21.15.60:0/301179396 shutdown_connections 2024-09-12T01:38:18.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.046+0000 7fc1894dd640 1 -- 172.21.15.60:0/301179396 wait complete. 2024-09-12T01:38:18.057 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2024-09-12T01:38:16.290828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247696,"kb_used_data":6480,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754727024,"statfs":{"total":773094113280,"available":772840472576,"internally_reserved":0,"allocated":6635520,"data_stored":3382156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.585976"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733876+0000","last_change":"2024-09-12T01:38:12.733168+0000","last_active":"2024-09-12T01:38:14.733876+0000","last_peered":"2024-09-12T01:38:14.733876+0000","last_clean":"2024-09-12T01:38:14.733876+0000","last_became_active":"2024-09-12T01:38:12.732505+0000","last_became_peered":"2024-09-12T01:38:12.732505+0000","last_unstale":"2024-09-12T01:38:14.733876+0000","last_undegraded":"2024-09-12T01:38:14.733876+0000","last_fullsized":"2024-09-12T01:38:14.733876+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:15.877225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288721+0000","last_change":"2024-09-12T01:38:12.736432+0000","last_active":"2024-09-12T01:38:14.288721+0000","last_peered":"2024-09-12T01:38:14.288721+0000","last_clean":"2024-09-12T01:38:14.288721+0000","last_became_active":"2024-09-12T01:38:12.736159+0000","last_became_peered":"2024-09-12T01:38:12.736159+0000","last_unstale":"2024-09-12T01:38:14.288721+0000","last_undegraded":"2024-09-12T01:38:14.288721+0000","last_fullsized":"2024-09-12T01:38:14.288721+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:13.835448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714400+0000","last_change":"2024-09-12T01:38:12.728422+0000","last_active":"2024-09-12T01:38:13.714400+0000","last_peered":"2024-09-12T01:38:13.714400+0000","last_clean":"2024-09-12T01:38:13.714400+0000","last_became_active":"2024-09-12T01:38:12.727852+0000","last_became_peered":"2024-09-12T01:38:12.727852+0000","last_unstale":"2024-09-12T01:38:13.714400+0000","last_undegraded":"2024-09-12T01:38:13.714400+0000","last_fullsized":"2024-09-12T01:38:13.714400+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:50.133174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743670+0000","last_change":"2024-09-12T01:38:12.738640+0000","last_active":"2024-09-12T01:38:14.743670+0000","last_peered":"2024-09-12T01:38:14.743670+0000","last_clean":"2024-09-12T01:38:14.743670+0000","last_became_active":"2024-09-12T01:38:12.738174+0000","last_became_peered":"2024-09-12T01:38:12.738174+0000","last_unstale":"2024-09-12T01:38:14.743670+0000","last_undegraded":"2024-09-12T01:38:14.743670+0000","last_fullsized":"2024-09-12T01:38:14.743670+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:00.655897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733280+0000","last_change":"2024-09-12T01:38:12.740582+0000","last_active":"2024-09-12T01:38:14.733280+0000","last_peered":"2024-09-12T01:38:14.733280+0000","last_clean":"2024-09-12T01:38:14.733280+0000","last_became_active":"2024-09-12T01:38:12.736656+0000","last_became_peered":"2024-09-12T01:38:12.736656+0000","last_unstale":"2024-09-12T01:38:14.733280+0000","last_undegraded":"2024-09-12T01:38:14.733280+0000","last_fullsized":"2024-09-12T01:38:14.733280+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:06.481399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733142+0000","last_change":"2024-09-12T01:38:12.737860+0000","last_active":"2024-09-12T01:38:14.733142+0000","last_peered":"2024-09-12T01:38:14.733142+0000","last_clean":"2024-09-12T01:38:14.733142+0000","last_became_active":"2024-09-12T01:38:12.737572+0000","last_became_peered":"2024-09-12T01:38:12.737572+0000","last_unstale":"2024-09-12T01:38:14.733142+0000","last_undegraded":"2024-09-12T01:38:14.733142+0000","last_fullsized":"2024-09-12T01:38:14.733142+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:26.308081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743327+0000","last_change":"2024-09-12T01:38:12.720431+0000","last_active":"2024-09-12T01:38:14.743327+0000","last_peered":"2024-09-12T01:38:14.743327+0000","last_clean":"2024-09-12T01:38:14.743327+0000","last_became_active":"2024-09-12T01:38:12.720029+0000","last_became_peered":"2024-09-12T01:38:12.720029+0000","last_unstale":"2024-09-12T01:38:14.743327+0000","last_undegraded":"2024-09-12T01:38:14.743327+0000","last_fullsized":"2024-09-12T01:38:14.743327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:56.625687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.715686+0000","last_change":"2024-09-12T01:38:12.729091+0000","last_active":"2024-09-12T01:38:13.715686+0000","last_peered":"2024-09-12T01:38:13.715686+0000","last_clean":"2024-09-12T01:38:13.715686+0000","last_became_active":"2024-09-12T01:38:12.728826+0000","last_became_peered":"2024-09-12T01:38:12.728826+0000","last_unstale":"2024-09-12T01:38:13.715686+0000","last_undegraded":"2024-09-12T01:38:13.715686+0000","last_fullsized":"2024-09-12T01:38:13.715686+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:01.703411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197940+0000","last_change":"2024-09-12T01:38:12.739402+0000","last_active":"2024-09-12T01:38:14.197940+0000","last_peered":"2024-09-12T01:38:14.197940+0000","last_clean":"2024-09-12T01:38:14.197940+0000","last_became_active":"2024-09-12T01:38:12.739064+0000","last_became_peered":"2024-09-12T01:38:12.739064+0000","last_unstale":"2024-09-12T01:38:14.197940+0000","last_undegraded":"2024-09-12T01:38:14.197940+0000","last_fullsized":"2024-09-12T01:38:14.197940+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.724727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733739+0000","last_change":"2024-09-12T01:38:12.731228+0000","last_active":"2024-09-12T01:38:14.733739+0000","last_peered":"2024-09-12T01:38:14.733739+0000","last_clean":"2024-09-12T01:38:14.733739+0000","last_became_active":"2024-09-12T01:38:12.730647+0000","last_became_peered":"2024-09-12T01:38:12.730647+0000","last_unstale":"2024-09-12T01:38:14.733739+0000","last_undegraded":"2024-09-12T01:38:14.733739+0000","last_fullsized":"2024-09-12T01:38:14.733739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:41.064514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.749969+0000","last_change":"2024-09-12T01:38:12.747193+0000","last_active":"2024-09-12T01:38:12.749969+0000","last_peered":"2024-09-12T01:38:12.749969+0000","last_clean":"2024-09-12T01:38:12.749969+0000","last_became_active":"2024-09-12T01:38:12.746911+0000","last_became_peered":"2024-09-12T01:38:12.746911+0000","last_unstale":"2024-09-12T01:38:12.749969+0000","last_undegraded":"2024-09-12T01:38:12.749969+0000","last_fullsized":"2024-09-12T01:38:12.749969+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:45.483102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197793+0000","last_change":"2024-09-12T01:38:12.731203+0000","last_active":"2024-09-12T01:38:14.197793+0000","last_peered":"2024-09-12T01:38:14.197793+0000","last_clean":"2024-09-12T01:38:14.197793+0000","last_became_active":"2024-09-12T01:38:12.730876+0000","last_became_peered":"2024-09-12T01:38:12.730876+0000","last_unstale":"2024-09-12T01:38:14.197793+0000","last_undegraded":"2024-09-12T01:38:14.197793+0000","last_fullsized":"2024-09-12T01:38:14.197793+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:51.948448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743770+0000","last_change":"2024-09-12T01:38:12.730955+0000","last_active":"2024-09-12T01:38:14.743770+0000","last_peered":"2024-09-12T01:38:14.743770+0000","last_clean":"2024-09-12T01:38:14.743770+0000","last_became_active":"2024-09-12T01:38:12.730662+0000","last_became_peered":"2024-09-12T01:38:12.730662+0000","last_unstale":"2024-09-12T01:38:14.743770+0000","last_undegraded":"2024-09-12T01:38:14.743770+0000","last_fullsized":"2024-09-12T01:38:14.743770+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:14.685648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714264+0000","last_change":"2024-09-12T01:38:12.729691+0000","last_active":"2024-09-12T01:38:13.714264+0000","last_peered":"2024-09-12T01:38:13.714264+0000","last_clean":"2024-09-12T01:38:13.714264+0000","last_became_active":"2024-09-12T01:38:12.729396+0000","last_became_peered":"2024-09-12T01:38:12.729396+0000","last_unstale":"2024-09-12T01:38:13.714264+0000","last_undegraded":"2024-09-12T01:38:13.714264+0000","last_fullsized":"2024-09-12T01:38:13.714264+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:54.569718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743623+0000","last_change":"2024-09-12T01:38:12.734336+0000","last_active":"2024-09-12T01:38:14.743623+0000","last_peered":"2024-09-12T01:38:14.743623+0000","last_clean":"2024-09-12T01:38:14.743623+0000","last_became_active":"2024-09-12T01:38:12.734046+0000","last_became_peered":"2024-09-12T01:38:12.734046+0000","last_unstale":"2024-09-12T01:38:14.743623+0000","last_undegraded":"2024-09-12T01:38:14.743623+0000","last_fullsized":"2024-09-12T01:38:14.743623+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:26.308081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733259+0000","last_change":"2024-09-12T01:38:12.732980+0000","last_active":"2024-09-12T01:38:14.733259+0000","last_peered":"2024-09-12T01:38:14.733259+0000","last_clean":"2024-09-12T01:38:14.733259+0000","last_became_active":"2024-09-12T01:38:12.731088+0000","last_became_peered":"2024-09-12T01:38:12.731088+0000","last_unstale":"2024-09-12T01:38:14.733259+0000","last_undegraded":"2024-09-12T01:38:14.733259+0000","last_fullsized":"2024-09-12T01:38:14.733259+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:14.685648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733946+0000","last_change":"2024-09-12T01:38:12.732909+0000","last_active":"2024-09-12T01:38:14.733946+0000","last_peered":"2024-09-12T01:38:14.733946+0000","last_clean":"2024-09-12T01:38:14.733946+0000","last_became_active":"2024-09-12T01:38:12.732180+0000","last_became_peered":"2024-09-12T01:38:12.732180+0000","last_unstale":"2024-09-12T01:38:14.733946+0000","last_undegraded":"2024-09-12T01:38:14.733946+0000","last_fullsized":"2024-09-12T01:38:14.733946+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:52.612408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714363+0000","last_change":"2024-09-12T01:38:12.737122+0000","last_active":"2024-09-12T01:38:13.714363+0000","last_peered":"2024-09-12T01:38:13.714363+0000","last_clean":"2024-09-12T01:38:13.714363+0000","last_became_active":"2024-09-12T01:38:12.736811+0000","last_became_peered":"2024-09-12T01:38:12.736811+0000","last_unstale":"2024-09-12T01:38:13.714363+0000","last_undegraded":"2024-09-12T01:38:13.714363+0000","last_fullsized":"2024-09-12T01:38:13.714363+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:22.446461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288600+0000","last_change":"2024-09-12T01:38:12.735695+0000","last_active":"2024-09-12T01:38:14.288600+0000","last_peered":"2024-09-12T01:38:14.288600+0000","last_clean":"2024-09-12T01:38:14.288600+0000","last_became_active":"2024-09-12T01:38:12.735278+0000","last_became_peered":"2024-09-12T01:38:12.735278+0000","last_unstale":"2024-09-12T01:38:14.288600+0000","last_undegraded":"2024-09-12T01:38:14.288600+0000","last_fullsized":"2024-09-12T01:38:14.288600+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:26.911429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.749310+0000","last_change":"2024-09-12T01:38:12.745794+0000","last_active":"2024-09-12T01:38:12.749310+0000","last_peered":"2024-09-12T01:38:12.749310+0000","last_clean":"2024-09-12T01:38:12.749310+0000","last_became_active":"2024-09-12T01:38:12.745519+0000","last_became_peered":"2024-09-12T01:38:12.745519+0000","last_unstale":"2024-09-12T01:38:12.749310+0000","last_undegraded":"2024-09-12T01:38:12.749310+0000","last_fullsized":"2024-09-12T01:38:12.749310+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:10.213451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743911+0000","last_change":"2024-09-12T01:38:12.719434+0000","last_active":"2024-09-12T01:38:14.743911+0000","last_peered":"2024-09-12T01:38:14.743911+0000","last_clean":"2024-09-12T01:38:14.743911+0000","last_became_active":"2024-09-12T01:38:12.719137+0000","last_became_peered":"2024-09-12T01:38:12.719137+0000","last_unstale":"2024-09-12T01:38:14.743911+0000","last_undegraded":"2024-09-12T01:38:14.743911+0000","last_fullsized":"2024-09-12T01:38:14.743911+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:24.268882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.742664+0000","last_change":"2024-09-12T01:38:12.738838+0000","last_active":"2024-09-12T01:38:12.742664+0000","last_peered":"2024-09-12T01:38:12.742664+0000","last_clean":"2024-09-12T01:38:12.742664+0000","last_became_active":"2024-09-12T01:38:12.738511+0000","last_became_peered":"2024-09-12T01:38:12.738511+0000","last_unstale":"2024-09-12T01:38:12.742664+0000","last_undegraded":"2024-09-12T01:38:12.742664+0000","last_fullsized":"2024-09-12T01:38:12.742664+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:02.469603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743481+0000","last_change":"2024-09-12T01:38:12.738352+0000","last_active":"2024-09-12T01:38:14.743481+0000","last_peered":"2024-09-12T01:38:14.743481+0000","last_clean":"2024-09-12T01:38:14.743481+0000","last_became_active":"2024-09-12T01:38:12.737829+0000","last_became_peered":"2024-09-12T01:38:12.737829+0000","last_unstale":"2024-09-12T01:38:14.743481+0000","last_undegraded":"2024-09-12T01:38:14.743481+0000","last_fullsized":"2024-09-12T01:38:14.743481+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:37.533483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197556+0000","last_change":"2024-09-12T01:38:12.743861+0000","last_active":"2024-09-12T01:38:14.197556+0000","last_peered":"2024-09-12T01:38:14.197556+0000","last_clean":"2024-09-12T01:38:14.197556+0000","last_became_active":"2024-09-12T01:38:12.743575+0000","last_became_peered":"2024-09-12T01:38:12.743575+0000","last_unstale":"2024-09-12T01:38:14.197556+0000","last_undegraded":"2024-09-12T01:38:14.197556+0000","last_fullsized":"2024-09-12T01:38:14.197556+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:26.172050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288784+0000","last_change":"2024-09-12T01:38:12.742076+0000","last_active":"2024-09-12T01:38:14.288784+0000","last_peered":"2024-09-12T01:38:14.288784+0000","last_clean":"2024-09-12T01:38:14.288784+0000","last_became_active":"2024-09-12T01:38:12.741783+0000","last_became_peered":"2024-09-12T01:38:12.741783+0000","last_unstale":"2024-09-12T01:38:14.288784+0000","last_undegraded":"2024-09-12T01:38:14.288784+0000","last_fullsized":"2024-09-12T01:38:14.288784+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:12.724727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.744045+0000","last_change":"2024-09-12T01:38:12.720073+0000","last_active":"2024-09-12T01:38:14.744045+0000","last_peered":"2024-09-12T01:38:14.744045+0000","last_clean":"2024-09-12T01:38:14.744045+0000","last_became_active":"2024-09-12T01:38:12.719394+0000","last_became_peered":"2024-09-12T01:38:12.719394+0000","last_unstale":"2024-09-12T01:38:14.744045+0000","last_undegraded":"2024-09-12T01:38:14.744045+0000","last_fullsized":"2024-09-12T01:38:14.744045+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:54.569718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288647+0000","last_change":"2024-09-12T01:38:12.736351+0000","last_active":"2024-09-12T01:38:14.288647+0000","last_peered":"2024-09-12T01:38:14.288647+0000","last_clean":"2024-09-12T01:38:14.288647+0000","last_became_active":"2024-09-12T01:38:12.736073+0000","last_became_peered":"2024-09-12T01:38:12.736073+0000","last_unstale":"2024-09-12T01:38:14.288647+0000","last_undegraded":"2024-09-12T01:38:14.288647+0000","last_fullsized":"2024-09-12T01:38:14.288647+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:51.948448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716566+0000","last_change":"2024-09-12T01:38:12.733757+0000","last_active":"2024-09-12T01:38:13.716566+0000","last_peered":"2024-09-12T01:38:13.716566+0000","last_clean":"2024-09-12T01:38:13.716566+0000","last_became_active":"2024-09-12T01:38:12.733461+0000","last_became_peered":"2024-09-12T01:38:12.733461+0000","last_unstale":"2024-09-12T01:38:13.716566+0000","last_undegraded":"2024-09-12T01:38:13.716566+0000","last_fullsized":"2024-09-12T01:38:13.716566+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:20.119030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.717090+0000","last_change":"2024-09-12T01:38:12.729757+0000","last_active":"2024-09-12T01:38:13.717090+0000","last_peered":"2024-09-12T01:38:13.717090+0000","last_clean":"2024-09-12T01:38:13.717090+0000","last_became_active":"2024-09-12T01:38:12.729485+0000","last_became_peered":"2024-09-12T01:38:12.729485+0000","last_unstale":"2024-09-12T01:38:13.717090+0000","last_undegraded":"2024-09-12T01:38:13.717090+0000","last_fullsized":"2024-09-12T01:38:13.717090+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:54.792034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743416+0000","last_change":"2024-09-12T01:38:12.721582+0000","last_active":"2024-09-12T01:38:14.743416+0000","last_peered":"2024-09-12T01:38:14.743416+0000","last_clean":"2024-09-12T01:38:14.743416+0000","last_became_active":"2024-09-12T01:38:12.721285+0000","last_became_peered":"2024-09-12T01:38:12.721285+0000","last_unstale":"2024-09-12T01:38:14.743416+0000","last_undegraded":"2024-09-12T01:38:14.743416+0000","last_fullsized":"2024-09-12T01:38:14.743416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:08.116539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288281+0000","last_change":"2024-09-12T01:38:12.735840+0000","last_active":"2024-09-12T01:38:14.288281+0000","last_peered":"2024-09-12T01:38:14.288281+0000","last_clean":"2024-09-12T01:38:14.288281+0000","last_became_active":"2024-09-12T01:38:12.735534+0000","last_became_peered":"2024-09-12T01:38:12.735534+0000","last_unstale":"2024-09-12T01:38:14.288281+0000","last_undegraded":"2024-09-12T01:38:14.288281+0000","last_fullsized":"2024-09-12T01:38:14.288281+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:44.443299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.746593+0000","last_change":"2024-09-12T01:38:12.740372+0000","last_active":"2024-09-12T01:38:12.746593+0000","last_peered":"2024-09-12T01:38:12.746593+0000","last_clean":"2024-09-12T01:38:12.746593+0000","last_became_active":"2024-09-12T01:38:12.740107+0000","last_became_peered":"2024-09-12T01:38:12.740107+0000","last_unstale":"2024-09-12T01:38:12.746593+0000","last_undegraded":"2024-09-12T01:38:12.746593+0000","last_fullsized":"2024-09-12T01:38:12.746593+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:41.042281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733738+0000","last_change":"2024-09-12T01:38:12.731913+0000","last_active":"2024-09-12T01:38:14.733738+0000","last_peered":"2024-09-12T01:38:14.733738+0000","last_clean":"2024-09-12T01:38:14.733738+0000","last_became_active":"2024-09-12T01:38:12.731547+0000","last_became_peered":"2024-09-12T01:38:12.731547+0000","last_unstale":"2024-09-12T01:38:14.733738+0000","last_undegraded":"2024-09-12T01:38:14.733738+0000","last_fullsized":"2024-09-12T01:38:14.733738+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:50.133174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"56'4","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.750028+0000","last_change":"2024-09-12T01:38:11.729176+0000","last_active":"2024-09-12T01:38:12.750028+0000","last_peered":"2024-09-12T01:38:12.750028+0000","last_clean":"2024-09-12T01:38:12.750028+0000","last_became_active":"2024-09-12T01:38:11.728895+0000","last_became_peered":"2024-09-12T01:38:11.728895+0000","last_unstale":"2024-09-12T01:38:12.750028+0000","last_undegraded":"2024-09-12T01:38:12.750028+0000","last_fullsized":"2024-09-12T01:38:12.750028+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:55.174050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.734032+0000","last_change":"2024-09-12T01:38:12.737754+0000","last_active":"2024-09-12T01:38:14.734032+0000","last_peered":"2024-09-12T01:38:14.734032+0000","last_clean":"2024-09-12T01:38:14.734032+0000","last_became_active":"2024-09-12T01:38:12.737437+0000","last_became_peered":"2024-09-12T01:38:12.737437+0000","last_unstale":"2024-09-12T01:38:14.734032+0000","last_undegraded":"2024-09-12T01:38:14.734032+0000","last_fullsized":"2024-09-12T01:38:14.734032+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:19.750791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288646+0000","last_change":"2024-09-12T01:38:11.726648+0000","last_active":"2024-09-12T01:38:14.288646+0000","last_peered":"2024-09-12T01:38:14.288646+0000","last_clean":"2024-09-12T01:38:14.288646+0000","last_became_active":"2024-09-12T01:38:11.726388+0000","last_became_peered":"2024-09-12T01:38:11.726388+0000","last_unstale":"2024-09-12T01:38:14.288646+0000","last_undegraded":"2024-09-12T01:38:14.288646+0000","last_fullsized":"2024-09-12T01:38:14.288646+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:15.155345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716730+0000","last_change":"2024-09-12T01:38:12.736398+0000","last_active":"2024-09-12T01:38:13.716730+0000","last_peered":"2024-09-12T01:38:13.716730+0000","last_clean":"2024-09-12T01:38:13.716730+0000","last_became_active":"2024-09-12T01:38:12.736152+0000","last_became_peered":"2024-09-12T01:38:12.736152+0000","last_unstale":"2024-09-12T01:38:13.716730+0000","last_undegraded":"2024-09-12T01:38:13.716730+0000","last_fullsized":"2024-09-12T01:38:13.716730+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:57.396929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733730+0000","last_change":"2024-09-12T01:38:11.724521+0000","last_active":"2024-09-12T01:38:14.733730+0000","last_peered":"2024-09-12T01:38:14.733730+0000","last_clean":"2024-09-12T01:38:14.733730+0000","last_became_active":"2024-09-12T01:38:11.724234+0000","last_became_peered":"2024-09-12T01:38:11.724234+0000","last_unstale":"2024-09-12T01:38:14.733730+0000","last_undegraded":"2024-09-12T01:38:14.733730+0000","last_fullsized":"2024-09-12T01:38:14.733730+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:25.163798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733592+0000","last_change":"2024-09-12T01:38:12.740097+0000","last_active":"2024-09-12T01:38:14.733592+0000","last_peered":"2024-09-12T01:38:14.733592+0000","last_clean":"2024-09-12T01:38:14.733592+0000","last_became_active":"2024-09-12T01:38:12.738238+0000","last_became_peered":"2024-09-12T01:38:12.738238+0000","last_unstale":"2024-09-12T01:38:14.733592+0000","last_undegraded":"2024-09-12T01:38:14.733592+0000","last_fullsized":"2024-09-12T01:38:14.733592+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:54.569718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743615+0000","last_change":"2024-09-12T01:38:11.726872+0000","last_active":"2024-09-12T01:38:14.743615+0000","last_peered":"2024-09-12T01:38:14.743615+0000","last_clean":"2024-09-12T01:38:14.743615+0000","last_became_active":"2024-09-12T01:38:11.725667+0000","last_became_peered":"2024-09-12T01:38:11.725667+0000","last_unstale":"2024-09-12T01:38:14.743615+0000","last_undegraded":"2024-09-12T01:38:14.743615+0000","last_fullsized":"2024-09-12T01:38:14.743615+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:16.877297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716393+0000","last_change":"2024-09-12T01:38:12.733968+0000","last_active":"2024-09-12T01:38:13.716393+0000","last_peered":"2024-09-12T01:38:13.716393+0000","last_clean":"2024-09-12T01:38:13.716393+0000","last_became_active":"2024-09-12T01:38:12.733600+0000","last_became_peered":"2024-09-12T01:38:12.733600+0000","last_unstale":"2024-09-12T01:38:13.716393+0000","last_undegraded":"2024-09-12T01:38:13.716393+0000","last_fullsized":"2024-09-12T01:38:13.716393+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:20.933567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714616+0000","last_change":"2024-09-12T01:38:11.730616+0000","last_active":"2024-09-12T01:38:13.714616+0000","last_peered":"2024-09-12T01:38:13.714616+0000","last_clean":"2024-09-12T01:38:13.714616+0000","last_became_active":"2024-09-12T01:38:11.730238+0000","last_became_peered":"2024-09-12T01:38:11.730238+0000","last_unstale":"2024-09-12T01:38:13.714616+0000","last_undegraded":"2024-09-12T01:38:13.714616+0000","last_fullsized":"2024-09-12T01:38:13.714616+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:12.827196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.742631+0000","last_change":"2024-09-12T01:38:12.738929+0000","last_active":"2024-09-12T01:38:12.742631+0000","last_peered":"2024-09-12T01:38:12.742631+0000","last_clean":"2024-09-12T01:38:12.742631+0000","last_became_active":"2024-09-12T01:38:12.738563+0000","last_became_peered":"2024-09-12T01:38:12.738563+0000","last_unstale":"2024-09-12T01:38:12.742631+0000","last_undegraded":"2024-09-12T01:38:12.742631+0000","last_fullsized":"2024-09-12T01:38:12.742631+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:55.380555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733278+0000","last_change":"2024-09-12T01:38:11.725637+0000","last_active":"2024-09-12T01:38:14.733278+0000","last_peered":"2024-09-12T01:38:14.733278+0000","last_clean":"2024-09-12T01:38:14.733278+0000","last_became_active":"2024-09-12T01:38:11.725293+0000","last_became_peered":"2024-09-12T01:38:11.725293+0000","last_unstale":"2024-09-12T01:38:14.733278+0000","last_undegraded":"2024-09-12T01:38:14.733278+0000","last_fullsized":"2024-09-12T01:38:14.733278+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:47.440507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714674+0000","last_change":"2024-09-12T01:38:12.719164+0000","last_active":"2024-09-12T01:38:13.714674+0000","last_peered":"2024-09-12T01:38:13.714674+0000","last_clean":"2024-09-12T01:38:13.714674+0000","last_became_active":"2024-09-12T01:38:12.718877+0000","last_became_peered":"2024-09-12T01:38:12.718877+0000","last_unstale":"2024-09-12T01:38:13.714674+0000","last_undegraded":"2024-09-12T01:38:13.714674+0000","last_fullsized":"2024-09-12T01:38:13.714674+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:08.270855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197640+0000","last_change":"2024-09-12T01:38:11.733684+0000","last_active":"2024-09-12T01:38:14.197640+0000","last_peered":"2024-09-12T01:38:14.197640+0000","last_clean":"2024-09-12T01:38:14.197640+0000","last_became_active":"2024-09-12T01:38:11.733363+0000","last_became_peered":"2024-09-12T01:38:11.733363+0000","last_unstale":"2024-09-12T01:38:14.197640+0000","last_undegraded":"2024-09-12T01:38:14.197640+0000","last_fullsized":"2024-09-12T01:38:14.197640+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:50.580410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733622+0000","last_change":"2024-09-12T01:38:12.737426+0000","last_active":"2024-09-12T01:38:14.733622+0000","last_peered":"2024-09-12T01:38:14.733622+0000","last_clean":"2024-09-12T01:38:14.733622+0000","last_became_active":"2024-09-12T01:38:12.731796+0000","last_became_peered":"2024-09-12T01:38:12.731796+0000","last_unstale":"2024-09-12T01:38:14.733622+0000","last_undegraded":"2024-09-12T01:38:14.733622+0000","last_fullsized":"2024-09-12T01:38:14.733622+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:22.446461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743241+0000","last_change":"2024-09-12T01:38:11.730108+0000","last_active":"2024-09-12T01:38:14.743241+0000","last_peered":"2024-09-12T01:38:14.743241+0000","last_clean":"2024-09-12T01:38:14.743241+0000","last_became_active":"2024-09-12T01:38:11.729812+0000","last_became_peered":"2024-09-12T01:38:11.729812+0000","last_unstale":"2024-09-12T01:38:14.743241+0000","last_undegraded":"2024-09-12T01:38:14.743241+0000","last_fullsized":"2024-09-12T01:38:14.743241+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:20.042794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.744078+0000","last_change":"2024-09-12T01:38:12.733905+0000","last_active":"2024-09-12T01:38:14.744078+0000","last_peered":"2024-09-12T01:38:14.744078+0000","last_clean":"2024-09-12T01:38:14.744078+0000","last_became_active":"2024-09-12T01:38:12.733550+0000","last_became_peered":"2024-09-12T01:38:12.733550+0000","last_unstale":"2024-09-12T01:38:14.744078+0000","last_undegraded":"2024-09-12T01:38:14.744078+0000","last_fullsized":"2024-09-12T01:38:14.744078+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:22.446461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197912+0000","last_change":"2024-09-12T01:38:11.726976+0000","last_active":"2024-09-12T01:38:14.197912+0000","last_peered":"2024-09-12T01:38:14.197912+0000","last_clean":"2024-09-12T01:38:14.197912+0000","last_became_active":"2024-09-12T01:38:11.726699+0000","last_became_peered":"2024-09-12T01:38:11.726699+0000","last_unstale":"2024-09-12T01:38:14.197912+0000","last_undegraded":"2024-09-12T01:38:14.197912+0000","last_fullsized":"2024-09-12T01:38:14.197912+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:06.259836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714477+0000","last_change":"2024-09-12T01:38:12.730041+0000","last_active":"2024-09-12T01:38:13.714477+0000","last_peered":"2024-09-12T01:38:13.714477+0000","last_clean":"2024-09-12T01:38:13.714477+0000","last_became_active":"2024-09-12T01:38:12.729772+0000","last_became_peered":"2024-09-12T01:38:12.729772+0000","last_unstale":"2024-09-12T01:38:13.714477+0000","last_undegraded":"2024-09-12T01:38:13.714477+0000","last_fullsized":"2024-09-12T01:38:13.714477+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:15.877225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716937+0000","last_change":"2024-09-12T01:38:11.732803+0000","last_active":"2024-09-12T01:38:13.716937+0000","last_peered":"2024-09-12T01:38:13.716937+0000","last_clean":"2024-09-12T01:38:13.716937+0000","last_became_active":"2024-09-12T01:38:11.732374+0000","last_became_peered":"2024-09-12T01:38:11.732374+0000","last_unstale":"2024-09-12T01:38:13.716937+0000","last_undegraded":"2024-09-12T01:38:13.716937+0000","last_fullsized":"2024-09-12T01:38:13.716937+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:05.473148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716944+0000","last_change":"2024-09-12T01:38:12.736088+0000","last_active":"2024-09-12T01:38:13.716944+0000","last_peered":"2024-09-12T01:38:13.716944+0000","last_clean":"2024-09-12T01:38:13.716944+0000","last_became_active":"2024-09-12T01:38:12.735803+0000","last_became_peered":"2024-09-12T01:38:12.735803+0000","last_unstale":"2024-09-12T01:38:13.716944+0000","last_undegraded":"2024-09-12T01:38:13.716944+0000","last_fullsized":"2024-09-12T01:38:13.716944+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:17.885548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"56'3","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743557+0000","last_change":"2024-09-12T01:38:11.725946+0000","last_active":"2024-09-12T01:38:14.743557+0000","last_peered":"2024-09-12T01:38:14.743557+0000","last_clean":"2024-09-12T01:38:14.743557+0000","last_became_active":"2024-09-12T01:38:11.725641+0000","last_became_peered":"2024-09-12T01:38:11.725641+0000","last_unstale":"2024-09-12T01:38:14.743557+0000","last_undegraded":"2024-09-12T01:38:14.743557+0000","last_fullsized":"2024-09-12T01:38:14.743557+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:19.110778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743290+0000","last_change":"2024-09-12T01:38:12.726779+0000","last_active":"2024-09-12T01:38:14.743290+0000","last_peered":"2024-09-12T01:38:14.743290+0000","last_clean":"2024-09-12T01:38:14.743290+0000","last_became_active":"2024-09-12T01:38:12.726506+0000","last_became_peered":"2024-09-12T01:38:12.726506+0000","last_unstale":"2024-09-12T01:38:14.743290+0000","last_undegraded":"2024-09-12T01:38:14.743290+0000","last_fullsized":"2024-09-12T01:38:14.743290+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:18.098154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.744032+0000","last_change":"2024-09-12T01:38:11.731727+0000","last_active":"2024-09-12T01:38:14.744032+0000","last_peered":"2024-09-12T01:38:14.744032+0000","last_clean":"2024-09-12T01:38:14.744032+0000","last_became_active":"2024-09-12T01:38:11.731443+0000","last_became_peered":"2024-09-12T01:38:11.731443+0000","last_unstale":"2024-09-12T01:38:14.744032+0000","last_undegraded":"2024-09-12T01:38:14.744032+0000","last_fullsized":"2024-09-12T01:38:14.744032+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:06.804474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197793+0000","last_change":"2024-09-12T01:38:12.735905+0000","last_active":"2024-09-12T01:38:14.197793+0000","last_peered":"2024-09-12T01:38:14.197793+0000","last_clean":"2024-09-12T01:38:14.197793+0000","last_became_active":"2024-09-12T01:38:12.735584+0000","last_became_peered":"2024-09-12T01:38:12.735584+0000","last_unstale":"2024-09-12T01:38:14.197793+0000","last_undegraded":"2024-09-12T01:38:14.197793+0000","last_fullsized":"2024-09-12T01:38:14.197793+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:13.835448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.717066+0000","last_change":"2024-09-12T01:38:11.732400+0000","last_active":"2024-09-12T01:38:13.717066+0000","last_peered":"2024-09-12T01:38:13.717066+0000","last_clean":"2024-09-12T01:38:13.717066+0000","last_became_active":"2024-09-12T01:38:11.732049+0000","last_became_peered":"2024-09-12T01:38:11.732049+0000","last_unstale":"2024-09-12T01:38:13.717066+0000","last_undegraded":"2024-09-12T01:38:13.717066+0000","last_fullsized":"2024-09-12T01:38:13.717066+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:21.438209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714559+0000","last_change":"2024-09-12T01:38:12.727984+0000","last_active":"2024-09-12T01:38:13.714559+0000","last_peered":"2024-09-12T01:38:13.714559+0000","last_clean":"2024-09-12T01:38:13.714559+0000","last_became_active":"2024-09-12T01:38:12.727733+0000","last_became_peered":"2024-09-12T01:38:12.727733+0000","last_unstale":"2024-09-12T01:38:13.714559+0000","last_undegraded":"2024-09-12T01:38:13.714559+0000","last_fullsized":"2024-09-12T01:38:13.714559+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:19.750791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743524+0000","last_change":"2024-09-12T01:38:11.720875+0000","last_active":"2024-09-12T01:38:14.743524+0000","last_peered":"2024-09-12T01:38:14.743524+0000","last_clean":"2024-09-12T01:38:14.743524+0000","last_became_active":"2024-09-12T01:38:11.720549+0000","last_became_peered":"2024-09-12T01:38:11.720549+0000","last_unstale":"2024-09-12T01:38:14.743524+0000","last_undegraded":"2024-09-12T01:38:14.743524+0000","last_fullsized":"2024-09-12T01:38:14.743524+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:56.388678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197756+0000","last_change":"2024-09-12T01:38:12.731105+0000","last_active":"2024-09-12T01:38:14.197756+0000","last_peered":"2024-09-12T01:38:14.197756+0000","last_clean":"2024-09-12T01:38:14.197756+0000","last_became_active":"2024-09-12T01:38:12.730819+0000","last_became_peered":"2024-09-12T01:38:12.730819+0000","last_unstale":"2024-09-12T01:38:14.197756+0000","last_undegraded":"2024-09-12T01:38:14.197756+0000","last_fullsized":"2024-09-12T01:38:14.197756+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:26.911429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743722+0000","last_change":"2024-09-12T01:38:11.729008+0000","last_active":"2024-09-12T01:38:14.743722+0000","last_peered":"2024-09-12T01:38:14.743722+0000","last_clean":"2024-09-12T01:38:14.743722+0000","last_became_active":"2024-09-12T01:38:11.728735+0000","last_became_peered":"2024-09-12T01:38:11.728735+0000","last_unstale":"2024-09-12T01:38:14.743722+0000","last_undegraded":"2024-09-12T01:38:14.743722+0000","last_fullsized":"2024-09-12T01:38:14.743722+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:44.311552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743632+0000","last_change":"2024-09-12T01:38:12.737825+0000","last_active":"2024-09-12T01:38:14.743632+0000","last_peered":"2024-09-12T01:38:14.743632+0000","last_clean":"2024-09-12T01:38:14.743632+0000","last_became_active":"2024-09-12T01:38:12.737511+0000","last_became_peered":"2024-09-12T01:38:12.737511+0000","last_unstale":"2024-09-12T01:38:14.743632+0000","last_undegraded":"2024-09-12T01:38:14.743632+0000","last_fullsized":"2024-09-12T01:38:14.743632+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:16.162718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"56'8","reported_seq":22,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743227+0000","last_change":"2024-09-12T01:38:11.721195+0000","last_active":"2024-09-12T01:38:14.743227+0000","last_peered":"2024-09-12T01:38:14.743227+0000","last_clean":"2024-09-12T01:38:14.743227+0000","last_became_active":"2024-09-12T01:38:11.720887+0000","last_became_peered":"2024-09-12T01:38:11.720887+0000","last_unstale":"2024-09-12T01:38:14.743227+0000","last_undegraded":"2024-09-12T01:38:14.743227+0000","last_fullsized":"2024-09-12T01:38:14.743227+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:19.925316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714402+0000","last_change":"2024-09-12T01:38:12.733185+0000","last_active":"2024-09-12T01:38:13.714402+0000","last_peered":"2024-09-12T01:38:13.714402+0000","last_clean":"2024-09-12T01:38:13.714402+0000","last_became_active":"2024-09-12T01:38:12.732777+0000","last_became_peered":"2024-09-12T01:38:12.732777+0000","last_unstale":"2024-09-12T01:38:13.714402+0000","last_undegraded":"2024-09-12T01:38:13.714402+0000","last_fullsized":"2024-09-12T01:38:13.714402+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:41.064514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288750+0000","last_change":"2024-09-12T01:38:11.724633+0000","last_active":"2024-09-12T01:38:14.288750+0000","last_peered":"2024-09-12T01:38:14.288750+0000","last_clean":"2024-09-12T01:38:14.288750+0000","last_became_active":"2024-09-12T01:38:11.724354+0000","last_became_peered":"2024-09-12T01:38:11.724354+0000","last_unstale":"2024-09-12T01:38:14.288750+0000","last_undegraded":"2024-09-12T01:38:14.288750+0000","last_fullsized":"2024-09-12T01:38:14.288750+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:25.865526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714543+0000","last_change":"2024-09-12T01:38:12.729998+0000","last_active":"2024-09-12T01:38:13.714543+0000","last_peered":"2024-09-12T01:38:13.714543+0000","last_clean":"2024-09-12T01:38:13.714543+0000","last_became_active":"2024-09-12T01:38:12.729748+0000","last_became_peered":"2024-09-12T01:38:12.729748+0000","last_unstale":"2024-09-12T01:38:13.714543+0000","last_undegraded":"2024-09-12T01:38:13.714543+0000","last_fullsized":"2024-09-12T01:38:13.714543+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:52.612408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.717069+0000","last_change":"2024-09-12T01:38:11.732368+0000","last_active":"2024-09-12T01:38:13.717069+0000","last_peered":"2024-09-12T01:38:13.717069+0000","last_clean":"2024-09-12T01:38:13.717069+0000","last_became_active":"2024-09-12T01:38:11.732068+0000","last_became_peered":"2024-09-12T01:38:11.732068+0000","last_unstale":"2024-09-12T01:38:13.717069+0000","last_undegraded":"2024-09-12T01:38:13.717069+0000","last_fullsized":"2024-09-12T01:38:13.717069+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:53.561466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288374+0000","last_change":"2024-09-12T01:38:12.734986+0000","last_active":"2024-09-12T01:38:14.288374+0000","last_peered":"2024-09-12T01:38:14.288374+0000","last_clean":"2024-09-12T01:38:14.288374+0000","last_became_active":"2024-09-12T01:38:12.734698+0000","last_became_peered":"2024-09-12T01:38:12.734698+0000","last_unstale":"2024-09-12T01:38:14.288374+0000","last_undegraded":"2024-09-12T01:38:14.288374+0000","last_fullsized":"2024-09-12T01:38:14.288374+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:26.172050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714578+0000","last_change":"2024-09-12T01:38:11.725283+0000","last_active":"2024-09-12T01:38:13.714578+0000","last_peered":"2024-09-12T01:38:13.714578+0000","last_clean":"2024-09-12T01:38:13.714578+0000","last_became_active":"2024-09-12T01:38:11.724867+0000","last_became_peered":"2024-09-12T01:38:11.724867+0000","last_unstale":"2024-09-12T01:38:13.714578+0000","last_undegraded":"2024-09-12T01:38:13.714578+0000","last_fullsized":"2024-09-12T01:38:13.714578+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:25.251697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743446+0000","last_change":"2024-09-12T01:38:12.738471+0000","last_active":"2024-09-12T01:38:14.743446+0000","last_peered":"2024-09-12T01:38:14.743446+0000","last_clean":"2024-09-12T01:38:14.743446+0000","last_became_active":"2024-09-12T01:38:12.738085+0000","last_became_peered":"2024-09-12T01:38:12.738085+0000","last_unstale":"2024-09-12T01:38:14.743446+0000","last_undegraded":"2024-09-12T01:38:14.743446+0000","last_fullsized":"2024-09-12T01:38:14.743446+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:22.270787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716878+0000","last_change":"2024-09-12T01:38:11.724538+0000","last_active":"2024-09-12T01:38:13.716878+0000","last_peered":"2024-09-12T01:38:13.716878+0000","last_clean":"2024-09-12T01:38:13.716878+0000","last_became_active":"2024-09-12T01:38:11.724255+0000","last_became_peered":"2024-09-12T01:38:11.724255+0000","last_unstale":"2024-09-12T01:38:13.716878+0000","last_undegraded":"2024-09-12T01:38:13.716878+0000","last_fullsized":"2024-09-12T01:38:13.716878+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:49.124922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197736+0000","last_change":"2024-09-12T01:38:12.733470+0000","last_active":"2024-09-12T01:38:14.197736+0000","last_peered":"2024-09-12T01:38:14.197736+0000","last_clean":"2024-09-12T01:38:14.197736+0000","last_became_active":"2024-09-12T01:38:12.733152+0000","last_became_peered":"2024-09-12T01:38:12.733152+0000","last_unstale":"2024-09-12T01:38:14.197736+0000","last_undegraded":"2024-09-12T01:38:14.197736+0000","last_fullsized":"2024-09-12T01:38:14.197736+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:48.448758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"56'2","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.749349+0000","last_change":"2024-09-12T01:38:11.733545+0000","last_active":"2024-09-12T01:38:12.749349+0000","last_peered":"2024-09-12T01:38:12.749349+0000","last_clean":"2024-09-12T01:38:12.749349+0000","last_became_active":"2024-09-12T01:38:11.733332+0000","last_became_peered":"2024-09-12T01:38:11.733332+0000","last_unstale":"2024-09-12T01:38:12.749349+0000","last_undegraded":"2024-09-12T01:38:12.749349+0000","last_fullsized":"2024-09-12T01:38:12.749349+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:16.569153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716954+0000","last_change":"2024-09-12T01:38:12.726454+0000","last_active":"2024-09-12T01:38:13.716954+0000","last_peered":"2024-09-12T01:38:13.716954+0000","last_clean":"2024-09-12T01:38:13.716954+0000","last_became_active":"2024-09-12T01:38:12.726193+0000","last_became_peered":"2024-09-12T01:38:12.726193+0000","last_unstale":"2024-09-12T01:38:13.716954+0000","last_undegraded":"2024-09-12T01:38:13.716954+0000","last_fullsized":"2024-09-12T01:38:13.716954+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:43.841874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716398+0000","last_change":"2024-09-12T01:38:11.732234+0000","last_active":"2024-09-12T01:38:13.716398+0000","last_peered":"2024-09-12T01:38:13.716398+0000","last_clean":"2024-09-12T01:38:13.716398+0000","last_became_active":"2024-09-12T01:38:11.731952+0000","last_became_peered":"2024-09-12T01:38:11.731952+0000","last_unstale":"2024-09-12T01:38:13.716398+0000","last_undegraded":"2024-09-12T01:38:13.716398+0000","last_fullsized":"2024-09-12T01:38:13.716398+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:40.056262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.715812+0000","last_change":"2024-09-12T01:38:12.725434+0000","last_active":"2024-09-12T01:38:13.715812+0000","last_peered":"2024-09-12T01:38:13.715812+0000","last_clean":"2024-09-12T01:38:13.715812+0000","last_became_active":"2024-09-12T01:38:12.725143+0000","last_became_peered":"2024-09-12T01:38:12.725143+0000","last_unstale":"2024-09-12T01:38:13.715812+0000","last_undegraded":"2024-09-12T01:38:13.715812+0000","last_fullsized":"2024-09-12T01:38:13.715812+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:11.587134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197837+0000","last_change":"2024-09-12T01:38:11.725899+0000","last_active":"2024-09-12T01:38:14.197837+0000","last_peered":"2024-09-12T01:38:14.197837+0000","last_clean":"2024-09-12T01:38:14.197837+0000","last_became_active":"2024-09-12T01:38:11.725643+0000","last_became_peered":"2024-09-12T01:38:11.725643+0000","last_unstale":"2024-09-12T01:38:14.197837+0000","last_undegraded":"2024-09-12T01:38:14.197837+0000","last_fullsized":"2024-09-12T01:38:14.197837+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:45.279495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714584+0000","last_change":"2024-09-12T01:38:12.727354+0000","last_active":"2024-09-12T01:38:13.714584+0000","last_peered":"2024-09-12T01:38:13.714584+0000","last_clean":"2024-09-12T01:38:13.714584+0000","last_became_active":"2024-09-12T01:38:12.727046+0000","last_became_peered":"2024-09-12T01:38:12.727046+0000","last_unstale":"2024-09-12T01:38:13.714584+0000","last_undegraded":"2024-09-12T01:38:13.714584+0000","last_fullsized":"2024-09-12T01:38:13.714584+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:50.089722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288814+0000","last_change":"2024-09-12T01:38:11.729295+0000","last_active":"2024-09-12T01:38:14.288814+0000","last_peered":"2024-09-12T01:38:14.288814+0000","last_clean":"2024-09-12T01:38:14.288814+0000","last_became_active":"2024-09-12T01:38:11.728988+0000","last_became_peered":"2024-09-12T01:38:11.728988+0000","last_unstale":"2024-09-12T01:38:14.288814+0000","last_undegraded":"2024-09-12T01:38:14.288814+0000","last_fullsized":"2024-09-12T01:38:14.288814+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:50.869678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714649+0000","last_change":"2024-09-12T01:38:12.719316+0000","last_active":"2024-09-12T01:38:13.714649+0000","last_peered":"2024-09-12T01:38:13.714649+0000","last_clean":"2024-09-12T01:38:13.714649+0000","last_became_active":"2024-09-12T01:38:12.718620+0000","last_became_peered":"2024-09-12T01:38:12.718620+0000","last_unstale":"2024-09-12T01:38:13.714649+0000","last_undegraded":"2024-09-12T01:38:13.714649+0000","last_fullsized":"2024-09-12T01:38:13.714649+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:43.842816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.735294+0000","last_change":"2024-09-12T01:38:11.725794+0000","last_active":"2024-09-12T01:38:14.735294+0000","last_peered":"2024-09-12T01:38:14.735294+0000","last_clean":"2024-09-12T01:38:14.735294+0000","last_became_active":"2024-09-12T01:38:11.725492+0000","last_became_peered":"2024-09-12T01:38:11.725492+0000","last_unstale":"2024-09-12T01:38:14.735294+0000","last_undegraded":"2024-09-12T01:38:14.735294+0000","last_fullsized":"2024-09-12T01:38:14.735294+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:22.213745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288519+0000","last_change":"2024-09-12T01:38:12.734405+0000","last_active":"2024-09-12T01:38:14.288519+0000","last_peered":"2024-09-12T01:38:14.288519+0000","last_clean":"2024-09-12T01:38:14.288519+0000","last_became_active":"2024-09-12T01:38:12.734031+0000","last_became_peered":"2024-09-12T01:38:12.734031+0000","last_unstale":"2024-09-12T01:38:14.288519+0000","last_undegraded":"2024-09-12T01:38:14.288519+0000","last_fullsized":"2024-09-12T01:38:14.288519+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:48.448758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197849+0000","last_change":"2024-09-12T01:38:11.730382+0000","last_active":"2024-09-12T01:38:14.197849+0000","last_peered":"2024-09-12T01:38:14.197849+0000","last_clean":"2024-09-12T01:38:14.197849+0000","last_became_active":"2024-09-12T01:38:11.730078+0000","last_became_peered":"2024-09-12T01:38:11.730078+0000","last_unstale":"2024-09-12T01:38:14.197849+0000","last_undegraded":"2024-09-12T01:38:14.197849+0000","last_fullsized":"2024-09-12T01:38:14.197849+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:08.873939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716612+0000","last_change":"2024-09-12T01:38:12.737652+0000","last_active":"2024-09-12T01:38:13.716612+0000","last_peered":"2024-09-12T01:38:13.716612+0000","last_clean":"2024-09-12T01:38:13.716612+0000","last_became_active":"2024-09-12T01:38:12.737182+0000","last_became_peered":"2024-09-12T01:38:12.737182+0000","last_unstale":"2024-09-12T01:38:13.716612+0000","last_undegraded":"2024-09-12T01:38:13.716612+0000","last_fullsized":"2024-09-12T01:38:13.716612+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:45.319803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714258+0000","last_change":"2024-09-12T01:38:11.726640+0000","last_active":"2024-09-12T01:38:13.714258+0000","last_peered":"2024-09-12T01:38:13.714258+0000","last_clean":"2024-09-12T01:38:13.714258+0000","last_became_active":"2024-09-12T01:38:11.726344+0000","last_became_peered":"2024-09-12T01:38:11.726344+0000","last_unstale":"2024-09-12T01:38:13.714258+0000","last_undegraded":"2024-09-12T01:38:13.714258+0000","last_fullsized":"2024-09-12T01:38:13.714258+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:06.804474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733225+0000","last_change":"2024-09-12T01:38:12.737263+0000","last_active":"2024-09-12T01:38:14.733225+0000","last_peered":"2024-09-12T01:38:14.733225+0000","last_clean":"2024-09-12T01:38:14.733225+0000","last_became_active":"2024-09-12T01:38:12.736811+0000","last_became_peered":"2024-09-12T01:38:12.736811+0000","last_unstale":"2024-09-12T01:38:14.733225+0000","last_undegraded":"2024-09-12T01:38:14.733225+0000","last_fullsized":"2024-09-12T01:38:14.733225+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:24.268882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288307+0000","last_change":"2024-09-12T01:38:11.725106+0000","last_active":"2024-09-12T01:38:14.288307+0000","last_peered":"2024-09-12T01:38:14.288307+0000","last_clean":"2024-09-12T01:38:14.288307+0000","last_became_active":"2024-09-12T01:38:11.724752+0000","last_became_peered":"2024-09-12T01:38:11.724752+0000","last_unstale":"2024-09-12T01:38:14.288307+0000","last_undegraded":"2024-09-12T01:38:14.288307+0000","last_fullsized":"2024-09-12T01:38:14.288307+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:36:27.533311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743930+0000","last_change":"2024-09-12T01:38:12.727841+0000","last_active":"2024-09-12T01:38:14.743930+0000","last_peered":"2024-09-12T01:38:14.743930+0000","last_clean":"2024-09-12T01:38:14.743930+0000","last_became_active":"2024-09-12T01:38:12.726703+0000","last_became_peered":"2024-09-12T01:38:12.726703+0000","last_unstale":"2024-09-12T01:38:14.743930+0000","last_undegraded":"2024-09-12T01:38:14.743930+0000","last_fullsized":"2024-09-12T01:38:14.743930+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:06.481399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.714423+0000","last_change":"2024-09-12T01:38:11.724147+0000","last_active":"2024-09-12T01:38:13.714423+0000","last_peered":"2024-09-12T01:38:13.714423+0000","last_clean":"2024-09-12T01:38:13.714423+0000","last_became_active":"2024-09-12T01:38:11.723867+0000","last_became_peered":"2024-09-12T01:38:11.723867+0000","last_unstale":"2024-09-12T01:38:13.714423+0000","last_undegraded":"2024-09-12T01:38:13.714423+0000","last_fullsized":"2024-09-12T01:38:13.714423+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:11.716475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.715857+0000","last_change":"2024-09-12T01:38:12.730437+0000","last_active":"2024-09-12T01:38:13.715857+0000","last_peered":"2024-09-12T01:38:13.715857+0000","last_clean":"2024-09-12T01:38:13.715857+0000","last_became_active":"2024-09-12T01:38:12.730173+0000","last_became_peered":"2024-09-12T01:38:12.730173+0000","last_unstale":"2024-09-12T01:38:13.715857+0000","last_undegraded":"2024-09-12T01:38:13.715857+0000","last_fullsized":"2024-09-12T01:38:13.715857+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:59.090243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.733482+0000","last_change":"2024-09-12T01:38:11.729599+0000","last_active":"2024-09-12T01:38:14.733482+0000","last_peered":"2024-09-12T01:38:14.733482+0000","last_clean":"2024-09-12T01:38:14.733482+0000","last_became_active":"2024-09-12T01:38:11.729302+0000","last_became_peered":"2024-09-12T01:38:11.729302+0000","last_unstale":"2024-09-12T01:38:14.733482+0000","last_undegraded":"2024-09-12T01:38:14.733482+0000","last_fullsized":"2024-09-12T01:38:14.733482+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:25.903178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.288300+0000","last_change":"2024-09-12T01:38:12.735795+0000","last_active":"2024-09-12T01:38:14.288300+0000","last_peered":"2024-09-12T01:38:14.288300+0000","last_clean":"2024-09-12T01:38:14.288300+0000","last_became_active":"2024-09-12T01:38:12.735242+0000","last_became_peered":"2024-09-12T01:38:12.735242+0000","last_unstale":"2024-09-12T01:38:14.288300+0000","last_undegraded":"2024-09-12T01:38:14.288300+0000","last_fullsized":"2024-09-12T01:38:14.288300+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:23.221997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.715967+0000","last_change":"2024-09-12T01:38:11.728987+0000","last_active":"2024-09-12T01:38:13.715967+0000","last_peered":"2024-09-12T01:38:13.715967+0000","last_clean":"2024-09-12T01:38:13.715967+0000","last_became_active":"2024-09-12T01:38:11.728543+0000","last_became_peered":"2024-09-12T01:38:11.728543+0000","last_unstale":"2024-09-12T01:38:13.715967+0000","last_undegraded":"2024-09-12T01:38:13.715967+0000","last_fullsized":"2024-09-12T01:38:13.715967+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:14.868973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.716130+0000","last_change":"2024-09-12T01:38:12.736909+0000","last_active":"2024-09-12T01:38:13.716130+0000","last_peered":"2024-09-12T01:38:13.716130+0000","last_clean":"2024-09-12T01:38:13.716130+0000","last_became_active":"2024-09-12T01:38:12.736617+0000","last_became_peered":"2024-09-12T01:38:12.736617+0000","last_unstale":"2024-09-12T01:38:13.716130+0000","last_undegraded":"2024-09-12T01:38:13.716130+0000","last_fullsized":"2024-09-12T01:38:13.716130+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.704612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.704612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:16.258768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.743719+0000","last_change":"2024-09-12T01:38:11.725890+0000","last_active":"2024-09-12T01:38:14.743719+0000","last_peered":"2024-09-12T01:38:14.743719+0000","last_clean":"2024-09-12T01:38:14.743719+0000","last_became_active":"2024-09-12T01:38:11.725628+0000","last_became_peered":"2024-09-12T01:38:11.725628+0000","last_unstale":"2024-09-12T01:38:14.743719+0000","last_undegraded":"2024-09-12T01:38:14.743719+0000","last_fullsized":"2024-09-12T01:38:14.743719+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.696360+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.696360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:25.251697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":234,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.197876+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:38:14.197876+0000","last_peered":"2024-09-12T01:38:14.197876+0000","last_clean":"2024-09-12T01:38:14.197876+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:38:14.197876+0000","last_undegraded":"2024-09-12T01:38:14.197876+0000","last_fullsized":"2024-09-12T01:38:14.197876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":276242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509473,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":276172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509473,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1273856,"data_stored":866552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509473,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36012,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335828,"statfs":{"total":96636764160,"available":96599887872,"internally_reserved":0,"allocated":679936,"data_stored":276240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":696320,"data_stored":277922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509473,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1273856,"data_stored":867100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509474,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":675840,"data_stored":271462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":671744,"data_stored":270466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:18.061 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:38:18.061 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:38:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.218+0000 7f5c79065640 1 Processor -- start 2024-09-12T01:38:18.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.218+0000 7f5c79065640 1 -- start start 2024-09-12T01:38:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.219+0000 7f5c79065640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c7415b480 0x7f5c740b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.219+0000 7f5c79065640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5c74072700 0x7f5c7415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.219+0000 7f5c79065640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c740ccff0 con 0x7f5c740b60c0 2024-09-12T01:38:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.219+0000 7f5c79065640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5c740b6500 con 0x7f5c74072700 2024-09-12T01:38:18.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.219+0000 7f5c79065640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5c740cd2d0 con 0x7f5c7415b480 2024-09-12T01:38:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.219+0000 7f5c72d9d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c7415b480 0x7f5c740b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.219+0000 7f5c7359e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5c74072700 0x7f5c7415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.219+0000 7f5c7259c640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f5c740b60c0 0x7f5c74071ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:54594/0 (socket says 172.21.15.60:54594) 2024-09-12T01:38:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.219+0000 7f5c7259c640 1 -- 172.21.15.60:0/520550658 learned_addr learned my addr 172.21.15.60:0/520550658 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.220+0000 7f5c7359e640 1 -- 172.21.15.60:0/520550658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c7415b480 msgr2=0x7f5c740b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.220+0000 7f5c7359e640 1 --2- 172.21.15.60:0/520550658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c7415b480 0x7f5c740b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.220+0000 7f5c7359e640 1 -- 172.21.15.60:0/520550658 >> v1:172.21.15.105:6789/0 conn(0x7f5c740b60c0 legacy=0x7f5c74071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.220+0000 7f5c7359e640 1 -- 172.21.15.60:0/520550658 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c740cd5b0 con 0x7f5c74072700 2024-09-12T01:38:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.220+0000 7f5c72d9d640 1 --2- 172.21.15.60:0/520550658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c7415b480 0x7f5c740b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:18.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.220+0000 7f5c7359e640 1 --2- 172.21.15.60:0/520550658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c74072700 0x7f5c7415bc60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0097a0 tx=0x7f5c6c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3dd12b75e8084f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.221+0000 7f5c71d9b640 1 -- 172.21.15.60:0/520550658 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c037070 con 0x7f5c74072700 2024-09-12T01:38:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.221+0000 7f5c71d9b640 1 -- 172.21.15.60:0/520550658 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6c02ae50 con 0x7f5c74072700 2024-09-12T01:38:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.221+0000 7f5c71d9b640 1 -- 172.21.15.60:0/520550658 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6c032660 con 0x7f5c74072700 2024-09-12T01:38:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.221+0000 7f5c79065640 1 -- 172.21.15.60:0/520550658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c74072700 msgr2=0x7f5c7415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.221+0000 7f5c79065640 1 --2- 172.21.15.60:0/520550658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c74072700 0x7f5c7415bc60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5c6c0097a0 tx=0x7f5c6c02a100 comp rx=0 tx=0).stop 2024-09-12T01:38:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.221+0000 7f5c79065640 1 -- 172.21.15.60:0/520550658 shutdown_connections 2024-09-12T01:38:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.221+0000 7f5c79065640 1 --2- 172.21.15.60:0/520550658 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c74072700 0x7f5c7415bc60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.221+0000 7f5c79065640 1 --2- 172.21.15.60:0/520550658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c7415b480 0x7f5c740b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.221+0000 7f5c79065640 1 -- 172.21.15.60:0/520550658 >> 172.21.15.60:0/520550658 conn(0x7f5c7406d0f0 msgr2=0x7f5c7406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.221+0000 7f5c79065640 1 -- 172.21.15.60:0/520550658 shutdown_connections 2024-09-12T01:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.221+0000 7f5c79065640 1 -- 172.21.15.60:0/520550658 wait complete. 2024-09-12T01:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.223+0000 7f5c79065640 1 Processor -- start 2024-09-12T01:38:18.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.223+0000 7f5c79065640 1 -- start start 2024-09-12T01:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.223+0000 7f5c79065640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c74072700 0x7f5c74148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c79065640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c740b60c0 0x7f5c7415db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c79065640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c7415b480 0x7f5c740ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c79065640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7415b860 con 0x7f5c74072700 2024-09-12T01:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c79065640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5c740cdb70 con 0x7f5c740b60c0 2024-09-12T01:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c79065640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5c7415b9e0 con 0x7f5c7415b480 2024-09-12T01:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c72d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c74072700 0x7f5c74148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c72d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c74072700 0x7f5c74148f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38406/0 (socket says 172.21.15.60:38406) 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c72d9d640 1 -- 172.21.15.60:0/1153210711 learned_addr learned my addr 172.21.15.60:0/1153210711 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c7259c640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c740b60c0 0x7f5c7415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c7359e640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c7415b480 0x7f5c740ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c72d9d640 1 -- 172.21.15.60:0/1153210711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c7415b480 msgr2=0x7f5c740ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c72d9d640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c7415b480 0x7f5c740ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c72d9d640 1 -- 172.21.15.60:0/1153210711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c740b60c0 msgr2=0x7f5c7415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c72d9d640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c740b60c0 0x7f5c7415db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c72d9d640 1 -- 172.21.15.60:0/1153210711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7415cdc0 con 0x7f5c74072700 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c72d9d640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c74072700 0x7f5c74148f40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400efc0 tx=0x7f5c6400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c6b7fe640 1 -- 172.21.15.60:0/1153210711 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64018020 con 0x7f5c74072700 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c6b7fe640 1 -- 172.21.15.60:0/1153210711 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c64014680 con 0x7f5c74072700 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c79065640 1 -- 172.21.15.60:0/1153210711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c7415d0a0 con 0x7f5c74072700 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.224+0000 7f5c6b7fe640 1 -- 172.21.15.60:0/1153210711 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64014a50 con 0x7f5c74072700 2024-09-12T01:38:18.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.225+0000 7f5c79065640 1 -- 172.21.15.60:0/1153210711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c74149480 con 0x7f5c74072700 2024-09-12T01:38:18.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.225+0000 7f5c79065640 1 -- 172.21.15.60:0/1153210711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c740b5b80 con 0x7f5c74072700 2024-09-12T01:38:18.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.226+0000 7f5c6b7fe640 1 -- 172.21.15.60:0/1153210711 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5c64005d10 con 0x7f5c74072700 2024-09-12T01:38:18.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.227+0000 7f5c6b7fe640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5c5406be60 0x7f5c5406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.227+0000 7f5c6b7fe640 1 -- 172.21.15.60:0/1153210711 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f5c6408ba20 con 0x7f5c74072700 2024-09-12T01:38:18.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.227+0000 7f5c7259c640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5c5406be60 0x7f5c5406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.227+0000 7f5c7259c640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5c5406be60 0x7f5c5406e320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c007fd0 tx=0x7f5c5c007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:18.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.231+0000 7f5c6b7fe640 1 -- 172.21.15.60:0/1153210711 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5c64022030 con 0x7f5c74072700 2024-09-12T01:38:18.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.472+0000 7f5c79065640 1 -- 172.21.15.60:0/1153210711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5c74071c80 con 0x7f5c74072700 2024-09-12T01:38:18.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.474+0000 7f5c6b7fe640 1 -- 172.21.15.60:0/1153210711 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f5c64010040 con 0x7f5c74072700 2024-09-12T01:38:18.474 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-12T01:38:18.474 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ== 2024-09-12T01:38:18.475 INFO:teuthology.orchestra.run.smithi060.stdout: caps mds = "allow" 2024-09-12T01:38:18.475 INFO:teuthology.orchestra.run.smithi060.stdout: caps mon = "allow r" 2024-09-12T01:38:18.475 INFO:teuthology.orchestra.run.smithi060.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:38:18.475 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2024-09-12T01:38:18.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.476+0000 7f5c79065640 1 -- 172.21.15.60:0/1153210711 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5c5406be60 msgr2=0x7f5c5406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.476+0000 7f5c79065640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5c5406be60 0x7f5c5406e320 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c007fd0 tx=0x7f5c5c007e80 comp rx=0 tx=0).stop 2024-09-12T01:38:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.476+0000 7f5c79065640 1 -- 172.21.15.60:0/1153210711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c74072700 msgr2=0x7f5c74148f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.476+0000 7f5c79065640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c74072700 0x7f5c74148f40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400efc0 tx=0x7f5c6400c490 comp rx=0 tx=0).stop 2024-09-12T01:38:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.476+0000 7f5c79065640 1 -- 172.21.15.60:0/1153210711 shutdown_connections 2024-09-12T01:38:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.476+0000 7f5c79065640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5c5406be60 0x7f5c5406e320 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.476+0000 7f5c79065640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5c7415b480 0x7f5c740ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.476+0000 7f5c79065640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5c740b60c0 0x7f5c7415db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.476+0000 7f5c79065640 1 --2- 172.21.15.60:0/1153210711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c74072700 0x7f5c74148f40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.476+0000 7f5c79065640 1 -- 172.21.15.60:0/1153210711 >> 172.21.15.60:0/1153210711 conn(0x7f5c7406d0f0 msgr2=0x7f5c7415a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.476+0000 7f5c79065640 1 -- 172.21.15.60:0/1153210711 shutdown_connections 2024-09-12T01:38:18.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.476+0000 7f5c79065640 1 -- 172.21.15.60:0/1153210711 wait complete. 2024-09-12T01:38:18.488 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:18.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.590+0000 7fc90a32a640 1 Processor -- start 2024-09-12T01:38:18.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.590+0000 7fc90a32a640 1 -- start start 2024-09-12T01:38:18.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc90a32a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9040713c0 0x7fc9040af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc90a32a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc90406e7b0 con 0x7fc90406bc10 2024-09-12T01:38:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc90a32a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9040aea30 con 0x7fc904071800 2024-09-12T01:38:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc90a32a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc90406ea90 con 0x7fc9040713c0 2024-09-12T01:38:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc903fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc90406bc10 0x7fc90406bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34836/0 (socket says 172.21.15.60:34836) 2024-09-12T01:38:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc903fff640 1 -- 172.21.15.60:0/1244034732 learned_addr learned my addr 172.21.15.60:0/1244034732 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3194213019 0 0) 0x7fc90406e7b0 con 0x7fc90406bc10 2024-09-12T01:38:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8ec003520 con 0x7fc90406bc10 2024-09-12T01:38:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc9037fe640 1 --2- 172.21.15.60:0/1244034732 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9040713c0 0x7fc9040af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1611780729 0 0) 0x7fc8ec003520 con 0x7fc90406bc10 2024-09-12T01:38:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9040713c0 msgr2=0x7fc9040af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc902ffd640 1 --2- 172.21.15.60:0/1244034732 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9040713c0 0x7fc9040af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 >> v1:172.21.15.105:6789/0 conn(0x7fc904071800 legacy=0x7fc9040afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9040aed10 con 0x7fc90406bc10 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.591+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fc8f4001670 con 0x7fc90406bc10 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 >> v1:172.21.15.60:6789/0 conn(0x7fc90406bc10 legacy=0x7fc90406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc902ffd640 1 --2- 172.21.15.60:0/1244034732 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9040713c0 0x7fc8ec0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc902ffd640 1 --2- 172.21.15.60:0/1244034732 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8ec003f60 0x7fc8ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc902ffd640 1 --2- 172.21.15.60:0/1244034732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ec004d40 0x7fc8ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc90406ea90 con 0x7fc8ec004d40 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc8ec00baa0 con 0x7fc8ec003f60 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc8ec00bca0 con 0x7fc9040713c0 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc903fff640 1 --2- 172.21.15.60:0/1244034732 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9040713c0 0x7fc8ec0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc9088c7640 1 --2- 172.21.15.60:0/1244034732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ec004d40 0x7fc8ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc9037fe640 1 --2- 172.21.15.60:0/1244034732 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8ec003f60 0x7fc8ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc9088c7640 1 -- 172.21.15.60:0/1244034732 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9040713c0 msgr2=0x7fc8ec0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc9088c7640 1 --2- 172.21.15.60:0/1244034732 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9040713c0 0x7fc8ec0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc9088c7640 1 -- 172.21.15.60:0/1244034732 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8ec003f60 msgr2=0x7fc8ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc9088c7640 1 --2- 172.21.15.60:0/1244034732 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8ec003f60 0x7fc8ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.592+0000 7fc9088c7640 1 -- 172.21.15.60:0/1244034732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8ec003520 con 0x7fc8ec004d40 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.593+0000 7fc9088c7640 1 --2- 172.21.15.60:0/1244034732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ec004d40 0x7fc8ec0051c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc001e20 tx=0x7fc8ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346e480196ba4e03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.593+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc001a70 con 0x7fc8ec004d40 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.593+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8fc02ae40 con 0x7fc8ec004d40 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.593+0000 7fc902ffd640 1 -- 172.21.15.60:0/1244034732 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc003bb0 con 0x7fc8ec004d40 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.593+0000 7fc90a32a640 1 -- 172.21.15.60:0/1244034732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ec004d40 msgr2=0x7fc8ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.593+0000 7fc90a32a640 1 --2- 172.21.15.60:0/1244034732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ec004d40 0x7fc8ec0051c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc001e20 tx=0x7fc8ec005830 comp rx=0 tx=0).stop 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.593+0000 7fc9088c7640 1 -- 172.21.15.60:0/1244034732 reap_dead start 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.594+0000 7fc90a32a640 1 -- 172.21.15.60:0/1244034732 shutdown_connections 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.594+0000 7fc90a32a640 1 -- 172.21.15.60:0/1244034732 >> 172.21.15.60:0/1244034732 conn(0x7fc9040b2430 msgr2=0x7fc9040b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.594+0000 7fc90a32a640 1 -- 172.21.15.60:0/1244034732 shutdown_connections 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.594+0000 7fc90a32a640 1 -- 172.21.15.60:0/1244034732 wait complete. 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.595+0000 7fc90a32a640 1 Processor -- start 2024-09-12T01:38:18.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.595+0000 7fc90a32a640 1 -- start start 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc90a32a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ec004d40 0x7fc9040cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc90a32a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc904155b30 0x7fc904159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc90a32a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc90415f630 0x7fc90415fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc90a32a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc90415ea10 con 0x7fc8ec004d40 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc90a32a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc9040af510 con 0x7fc90415f630 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc90a32a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc9041f7ce0 con 0x7fc904155b30 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc903fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ec004d40 0x7fc9040cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc903fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ec004d40 0x7fc9040cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38424/0 (socket says 172.21.15.60:38424) 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc903fff640 1 -- 172.21.15.60:0/4163151736 learned_addr learned my addr 172.21.15.60:0/4163151736 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc9037fe640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc904155b30 0x7fc904159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc9088c7640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc90415f630 0x7fc90415fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc903fff640 1 -- 172.21.15.60:0/4163151736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc904155b30 msgr2=0x7fc904159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc903fff640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc904155b30 0x7fc904159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc903fff640 1 -- 172.21.15.60:0/4163151736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc90415f630 msgr2=0x7fc90415fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc903fff640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc90415f630 0x7fc90415fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc903fff640 1 -- 172.21.15.60:0/4163151736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90415a580 con 0x7fc8ec004d40 2024-09-12T01:38:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc9037fe640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc904155b30 0x7fc904159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc903fff640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ec004d40 0x7fc9040cfb10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40072f0 tx=0x7fc8f40077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc900ff9640 1 -- 172.21.15.60:0/4163151736 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f400f8e0 con 0x7fc8ec004d40 2024-09-12T01:38:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc900ff9640 1 -- 172.21.15.60:0/4163151736 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f4018070 con 0x7fc8ec004d40 2024-09-12T01:38:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc90a32a640 1 -- 172.21.15.60:0/4163151736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9041f7f30 con 0x7fc8ec004d40 2024-09-12T01:38:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.596+0000 7fc900ff9640 1 -- 172.21.15.60:0/4163151736 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f400fcc0 con 0x7fc8ec004d40 2024-09-12T01:38:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.597+0000 7fc90a32a640 1 -- 172.21.15.60:0/4163151736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc90415a270 con 0x7fc8ec004d40 2024-09-12T01:38:18.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.597+0000 7fc90a32a640 1 -- 172.21.15.60:0/4163151736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc90415eb90 con 0x7fc8ec004d40 2024-09-12T01:38:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.598+0000 7fc900ff9640 1 -- 172.21.15.60:0/4163151736 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8f401d460 con 0x7fc8ec004d40 2024-09-12T01:38:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.598+0000 7fc900ff9640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc8f006be60 0x7fc8f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.599+0000 7fc9037fe640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc8f006be60 0x7fc8f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.599+0000 7fc900ff9640 1 -- 172.21.15.60:0/4163151736 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fc8f408af40 con 0x7fc8ec004d40 2024-09-12T01:38:18.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.599+0000 7fc9037fe640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc8f006be60 0x7fc8f006e320 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc9040b0090 tx=0x7fc8f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.603+0000 7fc900ff9640 1 -- 172.21.15.60:0/4163151736 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8f400fe60 con 0x7fc8ec004d40 2024-09-12T01:38:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.815+0000 7fc90a32a640 1 -- 172.21.15.60:0/4163151736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc90406bff0 con 0x7fc8ec004d40 2024-09-12T01:38:18.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.815+0000 7fc900ff9640 1 -- 172.21.15.60:0/4163151736 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5223 (secure 0 0 0) 0x7fc8f40598e0 con 0x7fc8ec004d40 2024-09-12T01:38:18.816 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:18.816 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"btime":"2024-09-12T01:38:16:732986+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3403684617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3403684617},{"type":"v1","addr":"172.21.15.60:6837","nonce":3403684617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/343463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":343463},{"type":"v1","addr":"172.21.15.60:6836","nonce":343463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":34985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2046884414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2046884414},{"type":"v1","addr":"172.21.15.105:6834","nonce":2046884414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:12.079385+0000","modified":"2024-09-12T01:38:16.088710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34988},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34988":{"gid":34988,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/4144770620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4144770620},{"type":"v1","addr":"172.21.15.105:6835","nonce":4144770620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34988,"qdb_cluster":[34988]},"id":4}]} 2024-09-12T01:38:18.816 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 30 2024-09-12T01:38:18.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.817+0000 7fc90a32a640 1 -- 172.21.15.60:0/4163151736 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc8f006be60 msgr2=0x7fc8f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.817+0000 7fc90a32a640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc8f006be60 0x7fc8f006e320 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc9040b0090 tx=0x7fc8f8008040 comp rx=0 tx=0).stop 2024-09-12T01:38:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.817+0000 7fc90a32a640 1 -- 172.21.15.60:0/4163151736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ec004d40 msgr2=0x7fc9040cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.817+0000 7fc90a32a640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ec004d40 0x7fc9040cfb10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40072f0 tx=0x7fc8f40077b0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.817+0000 7fc90a32a640 1 -- 172.21.15.60:0/4163151736 shutdown_connections 2024-09-12T01:38:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.817+0000 7fc90a32a640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc90415f630 0x7fc90415fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.817+0000 7fc90a32a640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc8f006be60 0x7fc8f006e320 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.817+0000 7fc90a32a640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc904155b30 0x7fc904159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.817+0000 7fc90a32a640 1 --2- 172.21.15.60:0/4163151736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8ec004d40 0x7fc9040cfb10 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.817+0000 7fc90a32a640 1 -- 172.21.15.60:0/4163151736 >> 172.21.15.60:0/4163151736 conn(0x7fc9040b2430 msgr2=0x7fc9040725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.817+0000 7fc90a32a640 1 -- 172.21.15.60:0/4163151736 shutdown_connections 2024-09-12T01:38:18.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:18.817+0000 7fc90a32a640 1 -- 172.21.15.60:0/4163151736 wait complete. 2024-09-12T01:38:19.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:38:12.079385+0000', 'modified': '2024-09-12T01:38:16.088710+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34988}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34988': {'gid': 34988, 'name': 'b', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/4144770620', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 4144770620}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 4144770620}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34988, 'qdb_cluster': [34988]} 2024-09-12T01:38:19.231 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:38:19.231 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T01:38:19.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.340+0000 7fce9ac82640 1 Processor -- start 2024-09-12T01:38:19.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.340+0000 7fce9ac82640 1 -- start start 2024-09-12T01:38:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce9ac82640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fce9415a050 0x7fce9415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce9ac82640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fce9415ee90 0x7fce94073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce9ac82640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce9415a430 con 0x7fce940731c0 2024-09-12T01:38:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce9ac82640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fce94073b40 con 0x7fce9415ee90 2024-09-12T01:38:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce9ac82640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fce9415d9a0 con 0x7fce9415a050 2024-09-12T01:38:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce9921f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fce9415ee90 0x7fce94073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce93fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fce940731c0 0x7fce9415ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34838/0 (socket says 172.21.15.60:34838) 2024-09-12T01:38:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce93fff640 1 -- 172.21.15.60:0/1503338406 learned_addr learned my addr 172.21.15.60:0/1503338406 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce98a1e640 1 --2- 172.21.15.60:0/1503338406 >> v2:172.21.15.105:3300/0 conn(0x7fce9415a050 0x7fce9415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce9921f640 1 -- 172.21.15.60:0/1503338406 >> v2:172.21.15.105:3300/0 conn(0x7fce9415a050 msgr2=0x7fce9415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce9921f640 1 --2- 172.21.15.60:0/1503338406 >> v2:172.21.15.105:3300/0 conn(0x7fce9415a050 0x7fce9415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce9921f640 1 -- 172.21.15.60:0/1503338406 >> v1:172.21.15.60:6789/0 conn(0x7fce940731c0 legacy=0x7fce9415ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce9921f640 1 -- 172.21.15.60:0/1503338406 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce940cd0a0 con 0x7fce9415ee90 2024-09-12T01:38:19.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.341+0000 7fce937fe640 1 -- 172.21.15.60:0/1503338406 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887969626 0 0) 0x7fce9415a430 con 0x7fce940731c0 2024-09-12T01:38:19.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.342+0000 7fce9921f640 1 --2- 172.21.15.60:0/1503338406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce9415ee90 0x7fce94073600 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fce94069470 tx=0x7fce8c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19409dc0dd67b858 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.342+0000 7fce937fe640 1 -- 172.21.15.60:0/1503338406 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c037070 con 0x7fce9415ee90 2024-09-12T01:38:19.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.342+0000 7fce937fe640 1 -- 172.21.15.60:0/1503338406 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c032440 con 0x7fce9415ee90 2024-09-12T01:38:19.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.342+0000 7fce937fe640 1 -- 172.21.15.60:0/1503338406 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c02ae60 con 0x7fce9415ee90 2024-09-12T01:38:19.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.343+0000 7fce9ac82640 1 -- 172.21.15.60:0/1503338406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce9415ee90 msgr2=0x7fce94073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.343+0000 7fce9ac82640 1 --2- 172.21.15.60:0/1503338406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce9415ee90 0x7fce94073600 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fce94069470 tx=0x7fce8c02a110 comp rx=0 tx=0).stop 2024-09-12T01:38:19.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.343+0000 7fce9ac82640 1 -- 172.21.15.60:0/1503338406 shutdown_connections 2024-09-12T01:38:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.343+0000 7fce9ac82640 1 --2- 172.21.15.60:0/1503338406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce9415ee90 0x7fce94073600 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.343+0000 7fce9ac82640 1 --2- 172.21.15.60:0/1503338406 >> v2:172.21.15.105:3300/0 conn(0x7fce9415a050 0x7fce9415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.343+0000 7fce9ac82640 1 -- 172.21.15.60:0/1503338406 >> 172.21.15.60:0/1503338406 conn(0x7fce9406d0f0 msgr2=0x7fce9406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.343+0000 7fce9ac82640 1 -- 172.21.15.60:0/1503338406 shutdown_connections 2024-09-12T01:38:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.343+0000 7fce9ac82640 1 -- 172.21.15.60:0/1503338406 wait complete. 2024-09-12T01:38:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.344+0000 7fce9ac82640 1 Processor -- start 2024-09-12T01:38:19.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.344+0000 7fce9ac82640 1 -- start start 2024-09-12T01:38:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce9ac82640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce940731c0 0x7fce940c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce9ac82640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce9415a050 0x7fce941f27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce9ac82640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce9415ee90 0x7fce940b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce9ac82640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fce940cd940 con 0x7fce940731c0 2024-09-12T01:38:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce9ac82640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce940cd660 con 0x7fce9415a050 2024-09-12T01:38:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce9ac82640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fce940cdc20 con 0x7fce9415ee90 2024-09-12T01:38:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce98a1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce940731c0 0x7fce940c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce98a1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce940731c0 0x7fce940c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38430/0 (socket says 172.21.15.60:38430) 2024-09-12T01:38:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce98a1e640 1 -- 172.21.15.60:0/2432157665 learned_addr learned my addr 172.21.15.60:0/2432157665 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:19.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce9921f640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce9415ee90 0x7fce940b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce93fff640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce9415a050 0x7fce941f27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce98a1e640 1 -- 172.21.15.60:0/2432157665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce9415ee90 msgr2=0x7fce940b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce98a1e640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce9415ee90 0x7fce940b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce98a1e640 1 -- 172.21.15.60:0/2432157665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce9415a050 msgr2=0x7fce941f27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce98a1e640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce9415a050 0x7fce941f27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce98a1e640 1 -- 172.21.15.60:0/2432157665 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce940c8cd0 con 0x7fce940731c0 2024-09-12T01:38:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.345+0000 7fce98a1e640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce940731c0 0x7fce940c8660 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fce84009db0 tx=0x7fce8400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.346+0000 7fce917fa640 1 -- 172.21.15.60:0/2432157665 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84018020 con 0x7fce940731c0 2024-09-12T01:38:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.346+0000 7fce917fa640 1 -- 172.21.15.60:0/2432157665 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce84014480 con 0x7fce940731c0 2024-09-12T01:38:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.346+0000 7fce9ac82640 1 -- 172.21.15.60:0/2432157665 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce940c8fb0 con 0x7fce940731c0 2024-09-12T01:38:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.346+0000 7fce917fa640 1 -- 172.21.15.60:0/2432157665 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84014850 con 0x7fce940731c0 2024-09-12T01:38:19.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.346+0000 7fce9ac82640 1 -- 172.21.15.60:0/2432157665 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce940c9570 con 0x7fce940731c0 2024-09-12T01:38:19.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.347+0000 7fce917fa640 1 -- 172.21.15.60:0/2432157665 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce84005d10 con 0x7fce940731c0 2024-09-12T01:38:19.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.348+0000 7fce917fa640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce7406be30 0x7fce7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.348+0000 7fce917fa640 1 -- 172.21.15.60:0/2432157665 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fce8408b9c0 con 0x7fce940731c0 2024-09-12T01:38:19.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.348+0000 7fce93fff640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce7406be30 0x7fce7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.348+0000 7fce93fff640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce7406be30 0x7fce7406e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fce94158ba0 tx=0x7fce7c007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.348+0000 7fce9da22740 1 Processor -- start 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.349+0000 7fce9da22740 1 -- start start 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.349+0000 7fce9da22740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 0x5555e4bc2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.349+0000 7fce9da22740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4bdcae0 0x5555e4bde290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.349+0000 7fce9da22740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b95a80 0x5555e4bde7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.349+0000 7fce9da22740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5555e4afa520 con 0x5555e4b95a80 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.349+0000 7fce9da22740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5555e4aa23e0 con 0x5555e4bc2120 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.349+0000 7fce9da22740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5555e4af64e0 con 0x5555e4bdcae0 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.349+0000 7fce9921f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b95a80 0x5555e4bde7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.349+0000 7fce9921f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b95a80 0x5555e4bde7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38442/0 (socket says 172.21.15.60:38442) 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.349+0000 7fce9921f640 1 -- 172.21.15.60:0/1210723068 learned_addr learned my addr 172.21.15.60:0/1210723068 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.349+0000 7fce93fff640 1 --2- 172.21.15.60:0/1210723068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4bdcae0 0x5555e4bde290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.349+0000 7fce98a1e640 1 --2- 172.21.15.60:0/1210723068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 0x5555e4bc2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.350+0000 7fce9921f640 1 -- 172.21.15.60:0/1210723068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4bdcae0 msgr2=0x5555e4bde290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.350+0000 7fce9921f640 1 --2- 172.21.15.60:0/1210723068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4bdcae0 0x5555e4bde290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.350+0000 7fce9921f640 1 -- 172.21.15.60:0/1210723068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 msgr2=0x5555e4bc2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.350+0000 7fce9921f640 1 --2- 172.21.15.60:0/1210723068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 0x5555e4bc2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.350+0000 7fce9921f640 1 -- 172.21.15.60:0/1210723068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555e4abd2f0 con 0x5555e4b95a80 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.350+0000 7fce9921f640 1 --2- 172.21.15.60:0/1210723068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b95a80 0x5555e4bde7d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009890 tx=0x7fce8c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e282d7fe72154d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.350+0000 7fce8a7fc640 1 -- 172.21.15.60:0/1210723068 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c037040 con 0x5555e4b95a80 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.350+0000 7fce8a7fc640 1 -- 172.21.15.60:0/1210723068 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c03e660 con 0x5555e4b95a80 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.350+0000 7fce8a7fc640 1 -- 172.21.15.60:0/1210723068 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8c03ea10 con 0x5555e4b95a80 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.351+0000 7fce9da22740 1 -- 172.21.15.60:0/1210723068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b95a80 msgr2=0x5555e4bde7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.351+0000 7fce9da22740 1 --2- 172.21.15.60:0/1210723068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b95a80 0x5555e4bde7d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009890 tx=0x7fce8c02c000 comp rx=0 tx=0).stop 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.351+0000 7fce9da22740 1 -- 172.21.15.60:0/1210723068 shutdown_connections 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.351+0000 7fce9da22740 1 --2- 172.21.15.60:0/1210723068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b95a80 0x5555e4bde7d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.351+0000 7fce9da22740 1 --2- 172.21.15.60:0/1210723068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4bdcae0 0x5555e4bde290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.351+0000 7fce9da22740 1 --2- 172.21.15.60:0/1210723068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 0x5555e4bc2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.351+0000 7fce9da22740 1 -- 172.21.15.60:0/1210723068 >> 172.21.15.60:0/1210723068 conn(0x5555e4b94a80 msgr2=0x5555e4bdcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.351+0000 7fce9da22740 1 -- 172.21.15.60:0/1210723068 shutdown_connections 2024-09-12T01:38:19.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.351+0000 7fce9da22740 1 -- 172.21.15.60:0/1210723068 wait complete. 2024-09-12T01:38:19.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.351+0000 7fce9da22740 1 -- start start 2024-09-12T01:38:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.352+0000 7fce9da22740 1 Processor -- start 2024-09-12T01:38:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.352+0000 7fce9da22740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 0x5555e4bc32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.352+0000 7fce9da22740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4bdcae0 0x5555e4bc3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.352+0000 7fce9da22740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4b975a0 0x5555e4bac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.352+0000 7fce9da22740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5555e4bc2ee0 con 0x5555e4bdcae0 2024-09-12T01:38:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.352+0000 7fce9da22740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5555e4a83450 con 0x5555e4bc2120 2024-09-12T01:38:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.352+0000 7fce9da22740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5555e4bdd770 con 0x5555e4b975a0 2024-09-12T01:38:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.352+0000 7fce9da22740 10 client.0 _ll_register_callbacks cb 0x5555e480cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.352+0000 7fce93fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4bdcae0 0x5555e4bc3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.352+0000 7fce93fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4bdcae0 0x5555e4bc3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38454/0 (socket says 172.21.15.60:38454) 2024-09-12T01:38:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.352+0000 7fce93fff640 1 -- 172.21.15.60:0/27793759 learned_addr learned my addr 172.21.15.60:0/27793759 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce98a1e640 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 0x5555e4bc32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce9921f640 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4b975a0 0x5555e4bac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce93fff640 1 -- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4b975a0 msgr2=0x5555e4bac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce93fff640 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4b975a0 0x5555e4bac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce93fff640 1 -- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 msgr2=0x5555e4bc32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce93fff640 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 0x5555e4bc32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce93fff640 1 -- 172.21.15.60:0/27793759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555e480d2d0 con 0x5555e4bdcae0 2024-09-12T01:38:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce9921f640 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4b975a0 0x5555e4bac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce93fff640 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4bdcae0 0x5555e4bc3820 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0011e0 tx=0x7fce7c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46688235d50ef1f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce737fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:38:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce737fe640 1 -- 172.21.15.60:0/27793759 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c0213f0 con 0x5555e4bdcae0 2024-09-12T01:38:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce737fe640 1 -- 172.21.15.60:0/27793759 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fce7c010040 con 0x5555e4bdcae0 2024-09-12T01:38:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce9da22740 1 -- 172.21.15.60:0/27793759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce8c03e660 con 0x5555e4bdcae0 2024-09-12T01:38:19.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce737fe640 1 -- 172.21.15.60:0/27793759 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fce7c02e050 con 0x5555e4bdcae0 2024-09-12T01:38:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce9da22740 10 client.5691 fetch_fsmap learned FSMap version 30 2024-09-12T01:38:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce9da22740 1 -- 172.21.15.60:0/27793759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5555e48d76b0 con 0x5555e4bdcae0 2024-09-12T01:38:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce737fe640 1 -- 172.21.15.60:0/27793759 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce8c03e660 con 0x5555e4bdcae0 2024-09-12T01:38:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce737fe640 1 -- 172.21.15.60:0/27793759 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7fce7c031020 con 0x5555e4bdcae0 2024-09-12T01:38:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce9da22740 10 client.5691 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T01:38:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce9da22740 10 client.5691 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:38:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce9da22740 20 client.5691 populate_metadata read hostname 'smithi060' 2024-09-12T01:38:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce9da22740 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:6833/4144770620,v1:172.21.15.105:6835/4144770620] conn(0x5555e4baeae0 0x5555e4baeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce9da22740 4 client.5691 mds_command: new command op to 34988 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.353+0000 7fce9da22740 1 -- 172.21.15.60:0/27793759 --> [v2:172.21.15.105:6833/4144770620,v1:172.21.15.105:6835/4144770620] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555e4b07c50 con 0x5555e4baeae0 2024-09-12T01:38:19.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.354+0000 7fce98a1e640 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:6833/4144770620,v1:172.21.15.105:6835/4144770620] conn(0x5555e4baeae0 0x5555e4baeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.354+0000 7fce98a1e640 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:6833/4144770620,v1:172.21.15.105:6835/4144770620] conn(0x5555e4baeae0 0x5555e4baeec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b919b8322ab3e128 server_cookie=26309c38e9fefdf3 in_seq=0 out_seq=0 2024-09-12T01:38:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.354+0000 7fce737fe640 10 client.5691 ms_handle_connect on v2:172.21.15.105:6833/4144770620 2024-09-12T01:38:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce737fe640 1 -- 172.21.15.60:0/27793759 <== mds.0 v2:172.21.15.105:6833/4144770620 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5555e4b07c50 con 0x5555e4baeae0 2024-09-12T01:38:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce737fe640 10 client.5691 handle_command_reply: tid=0 2024-09-12T01:38:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce9da22740 1 client.5691 shutdown 2024-09-12T01:38:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce9da22740 1 -- 172.21.15.60:0/27793759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4bdcae0 msgr2=0x5555e4bc3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce9da22740 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4bdcae0 0x5555e4bc3820 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0011e0 tx=0x7fce7c000ed0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce9da22740 1 -- 172.21.15.60:0/27793759 shutdown_connections 2024-09-12T01:38:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce9da22740 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:6833/4144770620,v1:172.21.15.105:6835/4144770620] conn(0x5555e4baeae0 0x5555e4baeec0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce9da22740 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4b975a0 0x5555e4bac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce9da22740 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4bdcae0 0x5555e4bc3820 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce737fe640 0 client.5691 ms_handle_reset on v2:172.21.15.105:6833/4144770620 2024-09-12T01:38:19.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce9da22740 1 --2- 172.21.15.60:0/27793759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 0x5555e4bc32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce9da22740 1 -- 172.21.15.60:0/27793759 >> 172.21.15.60:0/27793759 conn(0x5555e4b95a80 msgr2=0x5555e4be0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce9da22740 1 -- 172.21.15.60:0/27793759 shutdown_connections 2024-09-12T01:38:19.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce9da22740 1 -- 172.21.15.60:0/27793759 wait complete. 2024-09-12T01:38:19.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.355+0000 7fce9da22740 20 client.5691 trim_cache size 0 max 16384 2024-09-12T01:38:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.373+0000 7fce9da22740 1 Processor -- start 2024-09-12T01:38:19.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.373+0000 7fce9da22740 1 -- start start 2024-09-12T01:38:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce9da22740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 0x5555e4be0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce9da22740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4baeae0 0x5555e4bbcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce9da22740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 0x5555e4bbd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce9da22740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fce940721c0 con 0x5555e4b975a0 2024-09-12T01:38:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce9da22740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce941f3ed0 con 0x5555e4bc2120 2024-09-12T01:38:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce9da22740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fce941f4520 con 0x5555e4baeae0 2024-09-12T01:38:19.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce98a1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 0x5555e4be0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce98a1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 0x5555e4be0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38466/0 (socket says 172.21.15.60:38466) 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce98a1e640 1 -- 172.21.15.60:0/2154197105 learned_addr learned my addr 172.21.15.60:0/2154197105 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce93fff640 1 --2- 172.21.15.60:0/2154197105 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4baeae0 0x5555e4bbcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce98a1e640 1 -- 172.21.15.60:0/2154197105 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4baeae0 msgr2=0x5555e4bbcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce98a1e640 1 --2- 172.21.15.60:0/2154197105 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4baeae0 0x5555e4bbcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce98a1e640 1 -- 172.21.15.60:0/2154197105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 msgr2=0x5555e4bbd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce98a1e640 1 --2- 172.21.15.60:0/2154197105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 0x5555e4bbd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.374+0000 7fce98a1e640 1 -- 172.21.15.60:0/2154197105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555e4bddc50 con 0x5555e4b975a0 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce98a1e640 1 --2- 172.21.15.60:0/2154197105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 0x5555e4be0630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fce8400c990 tx=0x7fce8405d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c4dd746a3b588d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce89ffb640 1 -- 172.21.15.60:0/2154197105 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84071040 con 0x5555e4b975a0 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce89ffb640 1 -- 172.21.15.60:0/2154197105 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce84076070 con 0x5555e4b975a0 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce89ffb640 1 -- 172.21.15.60:0/2154197105 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce840562d0 con 0x5555e4b975a0 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce9da22740 1 -- 172.21.15.60:0/2154197105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 msgr2=0x5555e4be0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce9da22740 1 --2- 172.21.15.60:0/2154197105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 0x5555e4be0630 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fce8400c990 tx=0x7fce8405d040 comp rx=0 tx=0).stop 2024-09-12T01:38:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce9da22740 1 -- 172.21.15.60:0/2154197105 shutdown_connections 2024-09-12T01:38:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce9da22740 1 --2- 172.21.15.60:0/2154197105 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4bc2120 0x5555e4bbd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce9da22740 1 --2- 172.21.15.60:0/2154197105 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4baeae0 0x5555e4bbcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce9da22740 1 --2- 172.21.15.60:0/2154197105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 0x5555e4be0630 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce9da22740 1 -- 172.21.15.60:0/2154197105 >> 172.21.15.60:0/2154197105 conn(0x5555e4b95a80 msgr2=0x5555e4bdcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce9da22740 1 -- 172.21.15.60:0/2154197105 shutdown_connections 2024-09-12T01:38:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.375+0000 7fce9da22740 1 -- 172.21.15.60:0/2154197105 wait complete. 2024-09-12T01:38:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.376+0000 7fce9da22740 1 -- start start 2024-09-12T01:38:19.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.376+0000 7fce9da22740 1 Processor -- start 2024-09-12T01:38:19.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce9da22740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 0x5555e4c5f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce9da22740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4baeae0 0x5555e4b98390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce9da22740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4bc2120 0x5555e4bd91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce9da22740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5555e4b95f20 con 0x5555e4b975a0 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce9da22740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5555e4b97080 con 0x5555e4baeae0 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce9da22740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5555e4bc5db0 con 0x5555e4bc2120 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce9da22740 10 client.0 _ll_register_callbacks cb 0x7fce7c007250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce98a1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 0x5555e4c5f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce98a1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 0x5555e4c5f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38478/0 (socket says 172.21.15.60:38478) 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce98a1e640 1 -- 172.21.15.60:0/3179637459 learned_addr learned my addr 172.21.15.60:0/3179637459 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce9921f640 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4bc2120 0x5555e4bd91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce93fff640 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4baeae0 0x5555e4b98390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce98a1e640 1 -- 172.21.15.60:0/3179637459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4bc2120 msgr2=0x5555e4bd91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce98a1e640 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4bc2120 0x5555e4bd91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce98a1e640 1 -- 172.21.15.60:0/3179637459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4baeae0 msgr2=0x5555e4b98390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce98a1e640 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4baeae0 0x5555e4b98390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce98a1e640 1 -- 172.21.15.60:0/3179637459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555e4bfba70 con 0x5555e4b975a0 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce98a1e640 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 0x5555e4c5f4d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fce8400c990 tx=0x7fce7c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80af79067da99eec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.377+0000 7fce737fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce737fe640 1 -- 172.21.15.60:0/3179637459 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8407d070 con 0x5555e4b975a0 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce737fe640 1 -- 172.21.15.60:0/3179637459 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fce84011d40 con 0x5555e4b975a0 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce9da22740 1 -- 172.21.15.60:0/3179637459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce84076070 con 0x5555e4b975a0 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce737fe640 1 -- 172.21.15.60:0/3179637459 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fce84071040 con 0x5555e4b975a0 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce9da22740 10 client.5697 fetch_fsmap learned FSMap version 30 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce9da22740 1 -- 172.21.15.60:0/3179637459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) -- 0x5555e4bfb580 con 0x5555e4b975a0 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce737fe640 1 -- 172.21.15.60:0/3179637459 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce84076070 con 0x5555e4b975a0 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce737fe640 1 -- 172.21.15.60:0/3179637459 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 30) ==== 3502+0+0 (secure 0 0 0) 0x7fce840590b0 con 0x5555e4b975a0 2024-09-12T01:38:19.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce9da22740 10 client.5697 fetch_fsmap finished waiting for FSMap version 30 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce9da22740 10 client.5697 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce9da22740 20 client.5697 populate_metadata read hostname 'smithi060' 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce9da22740 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.105:6833/4144770620,v1:172.21.15.105:6835/4144770620] conn(0x5555e4bdcae0 0x5555e4bd9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce9da22740 4 client.5697 mds_command: new command op to 34988 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce9da22740 1 -- 172.21.15.60:0/3179637459 --> [v2:172.21.15.105:6833/4144770620,v1:172.21.15.105:6835/4144770620] -- command(tid 0: {"prefix": "status"}) -- 0x5555e4b01fa0 con 0x5555e4bdcae0 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.378+0000 7fce93fff640 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.105:6833/4144770620,v1:172.21.15.105:6835/4144770620] conn(0x5555e4bdcae0 0x5555e4bd9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce93fff640 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.105:6833/4144770620,v1:172.21.15.105:6835/4144770620] conn(0x5555e4bdcae0 0x5555e4bd9730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd81aa3fc19d1824 server_cookie=1a99ecc674a861d1 in_seq=0 out_seq=0 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce737fe640 10 client.5697 ms_handle_connect on v2:172.21.15.105:6833/4144770620 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce737fe640 1 -- 172.21.15.60:0/3179637459 <== mds.0 v2:172.21.15.105:6833/4144770620 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x5555e4b01fa0 con 0x5555e4bdcae0 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce737fe640 10 client.5697 handle_command_reply: tid=0 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce9da22740 1 client.5697 shutdown 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce9da22740 1 -- 172.21.15.60:0/3179637459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 msgr2=0x5555e4c5f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce9da22740 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 0x5555e4c5f4d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fce8400c990 tx=0x7fce7c012000 comp rx=0 tx=0).stop 2024-09-12T01:38:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce9da22740 1 -- 172.21.15.60:0/3179637459 shutdown_connections 2024-09-12T01:38:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce9da22740 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.105:6833/4144770620,v1:172.21.15.105:6835/4144770620] conn(0x5555e4bdcae0 0x5555e4bd9730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce9da22740 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5555e4bc2120 0x5555e4bd91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce9da22740 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5555e4baeae0 0x5555e4b98390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce737fe640 0 client.5697 ms_handle_reset on v2:172.21.15.105:6833/4144770620 2024-09-12T01:38:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce9da22740 1 --2- 172.21.15.60:0/3179637459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5555e4b975a0 0x5555e4c5f4d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce9da22740 1 -- 172.21.15.60:0/3179637459 >> 172.21.15.60:0/3179637459 conn(0x5555e4b95a80 msgr2=0x5555e4be0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce9da22740 1 -- 172.21.15.60:0/3179637459 shutdown_connections 2024-09-12T01:38:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce9da22740 1 -- 172.21.15.60:0/3179637459 wait complete. 2024-09-12T01:38:19.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.379+0000 7fce9da22740 20 client.5697 trim_cache size 0 max 16384 2024-09-12T01:38:19.385 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:38:19.386 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "5401bd8a-3492-4b21-b6c0-d6616ff39793", 2024-09-12T01:38:19.386 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T01:38:19.386 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 34988, 2024-09-12T01:38:19.386 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T01:38:19.386 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T01:38:19.386 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-12T01:38:19.386 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 6.657860984, 2024-09-12T01:38:19.386 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 30, 2024-09-12T01:38:19.386 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 57, 2024-09-12T01:38:19.386 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 57, 2024-09-12T01:38:19.386 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 11.680630963 2024-09-12T01:38:19.386 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:38:19.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.380+0000 7fce9ac82640 1 -- 172.21.15.60:0/2432157665 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce7406be30 msgr2=0x7fce7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.380+0000 7fce9ac82640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce7406be30 0x7fce7406e2f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fce94158ba0 tx=0x7fce7c007b50 comp rx=0 tx=0).stop 2024-09-12T01:38:19.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.380+0000 7fce9ac82640 1 -- 172.21.15.60:0/2432157665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce940731c0 msgr2=0x7fce940c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.380+0000 7fce9ac82640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce940731c0 0x7fce940c8660 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fce84009db0 tx=0x7fce8400c490 comp rx=0 tx=0).stop 2024-09-12T01:38:19.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.380+0000 7fce9ac82640 1 -- 172.21.15.60:0/2432157665 shutdown_connections 2024-09-12T01:38:19.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.380+0000 7fce9ac82640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce7406be30 0x7fce7406e2f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.380+0000 7fce9ac82640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce9415ee90 0x7fce940b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.380+0000 7fce9ac82640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce9415a050 0x7fce941f27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.380+0000 7fce9ac82640 1 --2- 172.21.15.60:0/2432157665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce940731c0 0x7fce940c8660 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.380+0000 7fce9ac82640 1 -- 172.21.15.60:0/2432157665 >> 172.21.15.60:0/2432157665 conn(0x7fce9406d0f0 msgr2=0x7fce940b46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.380+0000 7fce9ac82640 1 -- 172.21.15.60:0/2432157665 shutdown_connections 2024-09-12T01:38:19.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.380+0000 7fce9ac82640 1 -- 172.21.15.60:0/2432157665 wait complete. 2024-09-12T01:38:19.391 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:38:19.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.493+0000 7fded1f5f640 1 Processor -- start 2024-09-12T01:38:19.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.493+0000 7fded1f5f640 1 -- start start 2024-09-12T01:38:19.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.494+0000 7fded1f5f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdecc0d1b40 0x7fdecc1618a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.494+0000 7fded1f5f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdecc0708d0 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.494+0000 7fded1f5f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdecc070bb0 con 0x7fdecc0b7290 2024-09-12T01:38:19.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.494+0000 7fded1f5f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdecc070e90 con 0x7fdecc0d1b40 2024-09-12T01:38:19.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.494+0000 7fdecb7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdecc0b6eb0 0x7fdecc06fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34852/0 (socket says 172.21.15.60:34852) 2024-09-12T01:38:19.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.494+0000 7fdecb7fe640 1 -- 172.21.15.60:0/96471478 learned_addr learned my addr 172.21.15.60:0/96471478 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:19.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.494+0000 7fdecaffd640 1 --2- 172.21.15.60:0/96471478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdecc0d1b40 0x7fdecc1618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.494+0000 7fdeca7fc640 1 -- 172.21.15.60:0/96471478 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2938277720 0 0) 0x7fdecc0708d0 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.494+0000 7fdeca7fc640 1 -- 172.21.15.60:0/96471478 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb4003520 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.495+0000 7fdeca7fc640 1 -- 172.21.15.60:0/96471478 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 557596957 0 0) 0x7fdecc070bb0 con 0x7fdecc0b7290 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.495+0000 7fdeca7fc640 1 -- 172.21.15.60:0/96471478 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdecc0708d0 con 0x7fdecc0b7290 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.495+0000 7fdecaffd640 1 -- 172.21.15.60:0/96471478 >> v1:172.21.15.105:6789/0 conn(0x7fdecc0b7290 legacy=0x7fdecc161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.495+0000 7fdecaffd640 1 -- 172.21.15.60:0/96471478 >> v1:172.21.15.60:6789/0 conn(0x7fdecc0b6eb0 legacy=0x7fdecc06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.495+0000 7fdeca7fc640 1 -- 172.21.15.60:0/96471478 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2665876405 0 0) 0x7fdeb4003520 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.495+0000 7fdecaffd640 1 -- 172.21.15.60:0/96471478 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdecc071170 con 0x7fdecc0d1b40 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.496+0000 7fdecaffd640 1 --2- 172.21.15.60:0/96471478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdecc0d1b40 0x7fdecc1618a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdec00097d0 tx=0x7fdec002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8108665998cfb245 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.496+0000 7fdeca7fc640 1 -- 172.21.15.60:0/96471478 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0037070 con 0x7fdecc0d1b40 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.496+0000 7fdeca7fc640 1 -- 172.21.15.60:0/96471478 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec002ab90 con 0x7fdecc0d1b40 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.496+0000 7fdeca7fc640 1 -- 172.21.15.60:0/96471478 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc001670 con 0x7fdecc0d1b40 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.496+0000 7fded1f5f640 1 -- 172.21.15.60:0/96471478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdecc0d1b40 msgr2=0x7fdecc1618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.496+0000 7fded1f5f640 1 --2- 172.21.15.60:0/96471478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdecc0d1b40 0x7fdecc1618a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fdec00097d0 tx=0x7fdec002a100 comp rx=0 tx=0).stop 2024-09-12T01:38:19.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.496+0000 7fded1f5f640 1 -- 172.21.15.60:0/96471478 shutdown_connections 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.496+0000 7fded1f5f640 1 --2- 172.21.15.60:0/96471478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdecc0d1b40 0x7fdecc1618a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.496+0000 7fded1f5f640 1 -- 172.21.15.60:0/96471478 >> 172.21.15.60:0/96471478 conn(0x7fdecc0d2450 msgr2=0x7fdecc0d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.496+0000 7fded1f5f640 1 -- 172.21.15.60:0/96471478 shutdown_connections 2024-09-12T01:38:19.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.496+0000 7fded1f5f640 1 -- 172.21.15.60:0/96471478 wait complete. 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.497+0000 7fded1f5f640 1 Processor -- start 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.498+0000 7fded1f5f640 1 -- start start 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.498+0000 7fded1f5f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdecc0b6eb0 0x7fdecc152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.498+0000 7fded1f5f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdecc0b7290 0x7fdecc155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.498+0000 7fded1f5f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdecc0d1b40 0x7fdecc160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.498+0000 7fded1f5f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc071af0 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.498+0000 7fded1f5f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc071970 con 0x7fdecc0b7290 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.498+0000 7fded1f5f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdecc1624f0 con 0x7fdecc0d1b40 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.498+0000 7fdecb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdecc0b6eb0 0x7fdecc152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdecb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdecc0b6eb0 0x7fdecc152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38494/0 (socket says 172.21.15.60:38494) 2024-09-12T01:38:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdecb7fe640 1 -- 172.21.15.60:0/894154553 learned_addr learned my addr 172.21.15.60:0/894154553 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdecb7fe640 1 -- 172.21.15.60:0/894154553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdecc0d1b40 msgr2=0x7fdecc160040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdecbfff640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdecc0d1b40 0x7fdecc160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdecaffd640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdecc0b7290 0x7fdecc155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdecb7fe640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdecc0d1b40 0x7fdecc160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdecb7fe640 1 -- 172.21.15.60:0/894154553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdecc0b7290 msgr2=0x7fdecc155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdecb7fe640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdecc0b7290 0x7fdecc155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdecb7fe640 1 -- 172.21.15.60:0/894154553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdecc1f46f0 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdecb7fe640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdecc0b6eb0 0x7fdecc152b30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c5c0 tx=0x7fdebc00ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdeb3fff640 1 -- 172.21.15.60:0/894154553 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc017070 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdeb3fff640 1 -- 172.21.15.60:0/894154553 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdebc005ce0 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fded1f5f640 1 -- 172.21.15.60:0/894154553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdecc1f49b0 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fdeb3fff640 1 -- 172.21.15.60:0/894154553 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0072b0 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.499+0000 7fded1f5f640 1 -- 172.21.15.60:0/894154553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdecc1f4f70 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.500+0000 7fded1f5f640 1 -- 172.21.15.60:0/894154553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdecc162900 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.501+0000 7fdeb3fff640 1 -- 172.21.15.60:0/894154553 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdebc01a070 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.501+0000 7fdeb3fff640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdeb806be30 0x7fdeb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:19.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.501+0000 7fdeb3fff640 1 -- 172.21.15.60:0/894154553 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fdebc08a3b0 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.501+0000 7fdecaffd640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdeb806be30 0x7fdeb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:19.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.502+0000 7fdecaffd640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdeb806be30 0x7fdeb806e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdec0034000 tx=0x7fdec002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:19.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.505+0000 7fdeb3fff640 1 -- 172.21.15.60:0/894154553 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdebc058d60 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.718+0000 7fded1f5f640 1 -- 172.21.15.60:0/894154553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdecc0b19b0 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.718+0000 7fdeb3fff640 1 -- 172.21.15.60:0/894154553 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+73 (secure 0 0 0) 0x7fdebc058660 con 0x7fdecc0b6eb0 2024-09-12T01:38:19.719 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:38:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.720+0000 7fded1f5f640 1 -- 172.21.15.60:0/894154553 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdeb806be30 msgr2=0x7fdeb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.720+0000 7fded1f5f640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdeb806be30 0x7fdeb806e2f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdec0034000 tx=0x7fdec002e000 comp rx=0 tx=0).stop 2024-09-12T01:38:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.720+0000 7fded1f5f640 1 -- 172.21.15.60:0/894154553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdecc0b6eb0 msgr2=0x7fdecc152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.721+0000 7fded1f5f640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdecc0b6eb0 0x7fdecc152b30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c5c0 tx=0x7fdebc00ca80 comp rx=0 tx=0).stop 2024-09-12T01:38:19.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.721+0000 7fded1f5f640 1 -- 172.21.15.60:0/894154553 shutdown_connections 2024-09-12T01:38:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.721+0000 7fded1f5f640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdeb806be30 0x7fdeb806e2f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.721+0000 7fded1f5f640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdecc0d1b40 0x7fdecc160040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.721+0000 7fded1f5f640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdecc0b7290 0x7fdecc155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.721+0000 7fded1f5f640 1 --2- 172.21.15.60:0/894154553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdecc0b6eb0 0x7fdecc152b30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.721+0000 7fded1f5f640 1 -- 172.21.15.60:0/894154553 >> 172.21.15.60:0/894154553 conn(0x7fdecc0d2450 msgr2=0x7fdecc0b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.721+0000 7fded1f5f640 1 -- 172.21.15.60:0/894154553 shutdown_connections 2024-09-12T01:38:19.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19.721+0000 7fded1f5f640 1 -- 172.21.15.60:0/894154553 wait complete. 2024-09-12T01:38:19.733 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:38:19.733 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:38:19.733 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T01:38:19.733 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:38:19.733 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:38:19.733 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:38:19.733 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:38:19.733 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:38:19.733 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:38:19.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:19.734 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T01:38:19.750 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:38:19.750 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:38:19.750 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T01:38:19.751 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42620sec preferred_lft 42620sec 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e8cb:28ff:fea3:34fb/64 scope link 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:38:19.752 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 72:47:53:4d:4f:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:38:19.753 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7047:53ff:fe4d:4fc7/64 scope link 2024-09-12T01:38:19.753 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:19.753 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:38:19.753 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:38:19.753 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::183c:47ff:fec1:173/64 scope link 2024-09-12T01:38:19.753 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:19.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:19.753 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:38:19.816 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T01:38:19.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:19.817 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T01:38:19.874 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T01:38:19.874 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:38:19.874 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:38:19.874 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:38:19.874 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:38:19.875 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:38:19.875 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:38:19.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:38:19.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:38:19.875 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:38:19.875 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:38:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:38:19.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:38:20.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:20.003 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:38:20.019 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:38:20.019 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:38:20.020 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:38:20.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:20.020 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-12T01:38:20.086 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:38:20.086 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:38:20.142 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:38:20.142 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:38:20.143 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:38:20.198 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T01:38:20.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:20.198 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:38:20.283 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:38:20.283 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:38:20.295 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:38:20.295 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:38:20.295 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:38:20.295 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:38:20.296 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:38:20.296 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:38:20.296 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:38:20.296 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:38:20.296 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:38:20.296 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:38:20.298 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:38:20.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:20.298 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:38:20.324 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:38:20.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:38:20.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:38:20.428 INFO:teuthology.orchestra.run.smithi060.stdout:client5706 2024-09-12T01:38:20.429 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:20.429 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:20.445 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:38:20.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.587+0000 7f77fb186640 1 Processor -- start 2024-09-12T01:38:20.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.587+0000 7f77fb186640 1 -- start start 2024-09-12T01:38:20.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.587+0000 7f77fb186640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77f40d3310 0x7f77f40d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.587+0000 7f77fb186640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77f415ea40 con 0x7f77f40d1650 2024-09-12T01:38:20.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.587+0000 7f77fb186640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77f40d3870 con 0x7f77f415e660 2024-09-12T01:38:20.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.587+0000 7f77fb186640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f77f40d1ac0 con 0x7f77f40d3310 2024-09-12T01:38:20.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.588+0000 7f77f3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77f40d3310 0x7f77f40d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.588+0000 7f77f3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77f40d3310 0x7f77f40d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38498/0 (socket says 172.21.15.60:38498) 2024-09-12T01:38:20.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.588+0000 7f77f3fff640 1 -- 172.21.15.60:0/2407013691 learned_addr learned my addr 172.21.15.60:0/2407013691 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:20.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.588+0000 7f77f9723640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f77f40d1650 0x7f77f40b7b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34854/0 (socket says 172.21.15.60:34854) 2024-09-12T01:38:20.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.588+0000 7f77f3fff640 1 -- 172.21.15.60:0/2407013691 >> v1:172.21.15.105:6789/0 conn(0x7f77f415e660 legacy=0x7f77f40cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:20.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.588+0000 7f77f3fff640 1 -- 172.21.15.60:0/2407013691 >> v1:172.21.15.60:6789/0 conn(0x7f77f40d1650 legacy=0x7f77f40b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:20.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.588+0000 7f77f3fff640 1 -- 172.21.15.60:0/2407013691 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f40d3b50 con 0x7f77f40d3310 2024-09-12T01:38:20.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.588+0000 7f77f37fe640 1 -- 172.21.15.60:0/2407013691 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164378474 0 0) 0x7f77f415ea40 con 0x7f77f40d1650 2024-09-12T01:38:20.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.589+0000 7f77f3fff640 1 --2- 172.21.15.60:0/2407013691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77f40d3310 0x7f77f40d1110 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009870 tx=0x7f77e002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5c5b0fdf4f483c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:20.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.589+0000 7f77f37fe640 1 -- 172.21.15.60:0/2407013691 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0037070 con 0x7f77f40d3310 2024-09-12T01:38:20.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.589+0000 7f77f37fe640 1 -- 172.21.15.60:0/2407013691 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e0032440 con 0x7f77f40d3310 2024-09-12T01:38:20.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.589+0000 7f77f37fe640 1 -- 172.21.15.60:0/2407013691 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0032810 con 0x7f77f40d3310 2024-09-12T01:38:20.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.589+0000 7f77fb186640 1 -- 172.21.15.60:0/2407013691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77f40d3310 msgr2=0x7f77f40d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:20.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.589+0000 7f77fb186640 1 --2- 172.21.15.60:0/2407013691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77f40d3310 0x7f77f40d1110 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009870 tx=0x7f77e002a2a0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.589+0000 7f77fb186640 1 -- 172.21.15.60:0/2407013691 shutdown_connections 2024-09-12T01:38:20.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.589+0000 7f77fb186640 1 --2- 172.21.15.60:0/2407013691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77f40d3310 0x7f77f40d1110 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.589+0000 7f77fb186640 1 -- 172.21.15.60:0/2407013691 >> 172.21.15.60:0/2407013691 conn(0x7f77f40b6410 msgr2=0x7f77f40b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:20.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.589+0000 7f77fb186640 1 -- 172.21.15.60:0/2407013691 shutdown_connections 2024-09-12T01:38:20.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.589+0000 7f77fb186640 1 -- 172.21.15.60:0/2407013691 wait complete. 2024-09-12T01:38:20.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.591+0000 7f77fb186640 1 Processor -- start 2024-09-12T01:38:20.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.591+0000 7f77fb186640 1 -- start start 2024-09-12T01:38:20.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.591+0000 7f77fb186640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77f40d1650 0x7f77f41f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77fb186640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77f40d3310 0x7f77f4158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77fb186640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77f415e660 0x7f77f40cf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77fb186640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f77f40d43f0 con 0x7f77f40d3310 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77fb186640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f77f40d4110 con 0x7f77f40d1650 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77fb186640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f77f40b8280 con 0x7f77f415e660 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77f40d3310 0x7f77f4158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77f40d3310 0x7f77f4158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38508/0 (socket says 172.21.15.60:38508) 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f3fff640 1 -- 172.21.15.60:0/4228474798 learned_addr learned my addr 172.21.15.60:0/4228474798 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f9723640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77f415e660 0x7f77f40cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f8f22640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77f40d1650 0x7f77f41f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f3fff640 1 -- 172.21.15.60:0/4228474798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77f415e660 msgr2=0x7f77f40cf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f3fff640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77f415e660 0x7f77f40cf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f3fff640 1 -- 172.21.15.60:0/4228474798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77f40d1650 msgr2=0x7f77f41f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f3fff640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77f40d1650 0x7f77f41f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f3fff640 1 -- 172.21.15.60:0/4228474798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f40cfd50 con 0x7f77f40d3310 2024-09-12T01:38:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f9723640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77f415e660 0x7f77f40cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f8f22640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77f40d1650 0x7f77f41f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f3fff640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77f40d3310 0x7f77f4158c50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009870 tx=0x7f77e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f17fa640 1 -- 172.21.15.60:0/4228474798 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0037040 con 0x7f77f40d3310 2024-09-12T01:38:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f17fa640 1 -- 172.21.15.60:0/4228474798 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e0004250 con 0x7f77f40d3310 2024-09-12T01:38:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77fb186640 1 -- 172.21.15.60:0/4228474798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f40ccf10 con 0x7f77f40d3310 2024-09-12T01:38:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77f17fa640 1 -- 172.21.15.60:0/4228474798 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e003c670 con 0x7f77f40d3310 2024-09-12T01:38:20.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.592+0000 7f77fb186640 1 -- 172.21.15.60:0/4228474798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f40cd4d0 con 0x7f77f40d3310 2024-09-12T01:38:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.593+0000 7f77fb186640 1 -- 172.21.15.60:0/4228474798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f40d1110 con 0x7f77f40d3310 2024-09-12T01:38:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.594+0000 7f77f17fa640 1 -- 172.21.15.60:0/4228474798 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77e003a070 con 0x7f77f40d3310 2024-09-12T01:38:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.594+0000 7f77f17fa640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f77d806be30 0x7f77d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.594+0000 7f77f17fa640 1 -- 172.21.15.60:0/4228474798 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f77e00ab810 con 0x7f77f40d3310 2024-09-12T01:38:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.594+0000 7f77f8f22640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f77d806be30 0x7f77d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.595+0000 7f77f8f22640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f77d806be30 0x7f77d806e2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f77e800a830 tx=0x7f77e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:20.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.599+0000 7f77f17fa640 1 -- 172.21.15.60:0/4228474798 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f77e0041020 con 0x7f77f40d3310 2024-09-12T01:38:20.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.812+0000 7f77fb186640 1 -- 172.21.15.60:0/4228474798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f77f40b4360 con 0x7f77f40d3310 2024-09-12T01:38:20.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.812+0000 7f77f17fa640 1 -- 172.21.15.60:0/4228474798 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) ==== 53+0+73 (secure 0 0 0) 0x7f77e007a1c0 con 0x7f77f40d3310 2024-09-12T01:38:20.813 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:38:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.815+0000 7f77fb186640 1 -- 172.21.15.60:0/4228474798 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f77d806be30 msgr2=0x7f77d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.815+0000 7f77fb186640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f77d806be30 0x7f77d806e2f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f77e800a830 tx=0x7f77e8008040 comp rx=0 tx=0).stop 2024-09-12T01:38:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.815+0000 7f77fb186640 1 -- 172.21.15.60:0/4228474798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77f40d3310 msgr2=0x7f77f4158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.815+0000 7f77fb186640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77f40d3310 0x7f77f4158c50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009870 tx=0x7f77e00046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.815+0000 7f77fb186640 1 -- 172.21.15.60:0/4228474798 shutdown_connections 2024-09-12T01:38:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.815+0000 7f77fb186640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f77d806be30 0x7f77d806e2f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.815+0000 7f77fb186640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77f415e660 0x7f77f40cf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.815+0000 7f77fb186640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77f40d3310 0x7f77f4158c50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.815+0000 7f77fb186640 1 --2- 172.21.15.60:0/4228474798 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77f40d1650 0x7f77f41f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.815+0000 7f77fb186640 1 -- 172.21.15.60:0/4228474798 >> 172.21.15.60:0/4228474798 conn(0x7f77f40b6410 msgr2=0x7f77f415bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.815+0000 7f77fb186640 1 -- 172.21.15.60:0/4228474798 shutdown_connections 2024-09-12T01:38:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:20.815+0000 7f77fb186640 1 -- 172.21.15.60:0/4228474798 wait complete. 2024-09-12T01:38:20.826 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:38:20.826 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:38:20.826 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T01:38:20.827 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:38:20.827 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:38:20.827 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:38:20.827 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:38:20.827 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:38:20.827 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:38:20.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:20.827 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T01:38:20.847 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:38:20.847 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:38:20.847 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:38:20.848 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:20.848 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:38:20.848 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:20.848 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:38:20.848 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:20.848 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T01:38:20.848 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:38:20.848 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:20.848 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T01:38:20.848 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42622sec preferred_lft 42622sec 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::c46c:baff:feeb:1f5e/64 scope link 2024-09-12T01:38:20.849 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:20.850 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:38:20.850 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 56:66:28:3d:b2:45 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:38:20.850 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::5466:28ff:fe3d:b245/64 scope link 2024-09-12T01:38:20.850 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:20.850 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:38:20.850 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:38:20.850 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::2036:4aff:fe87:b9cb/64 scope link 2024-09-12T01:38:20.850 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:20.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:20.851 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:38:20.915 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:38:20.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:20.917 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T01:38:20.975 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T01:38:20.975 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:38:20.975 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:38:20.975 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:38:20.975 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:38:20.975 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:38:20.975 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:38:20.976 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:38:20.976 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:38:20.976 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:38:20.976 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:38:21.066 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:38:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:38:21.099 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:38:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:38:21.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:21.105 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:38:21.120 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T01:38:21.120 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:38:21.120 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:38:21.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:21.121 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-12T01:38:21.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:38:21.185 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:38:21.241 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:38:21.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:38:21.241 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:38:21.296 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T01:38:21.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:21.297 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:38:21.379 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:38:21.380 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:38:21.387 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:38:21.387 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:38:21.388 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:38:21.388 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 1@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:38:21.388 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:38:21.389 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:38:21.389 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:38:21.389 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:38:21.390 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:38:21.390 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:38:21.391 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:38:21.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:21.392 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:38:21.457 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:38:21.545 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:38:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:38:21.546 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:38:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:38:21.552 INFO:teuthology.orchestra.run.smithi105.stdout:client35075 2024-09-12T01:38:21.552 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:38:21.552 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:21.567 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:38:21.568 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:38:21.618 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:38:21.660 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:38:21.660 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:38:21.660 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:21.660 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:21.679 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:21.679 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:21.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:38:21.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.888+0000 7f8146d66640 1 Processor -- start 2024-09-12T01:38:21.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.889+0000 7f8146d66640 1 -- start start 2024-09-12T01:38:21.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.889+0000 7f8146d66640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f81400cf1f0 0x7f81400b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.889+0000 7f8146d66640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f81400b6720 0x7f81400d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.889+0000 7f8146d66640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81400cf860 con 0x7f814015e7a0 2024-09-12T01:38:21.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.889+0000 7f8146d66640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f81400b6b90 con 0x7f81400cf1f0 2024-09-12T01:38:21.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.889+0000 7f8146d66640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f81400d2ca0 con 0x7f81400b6720 2024-09-12T01:38:21.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.889+0000 7f813ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f81400cf1f0 0x7f81400b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.889+0000 7f8144b02640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f814015e7a0 0x7f814006caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34868/0 (socket says 172.21.15.60:34868) 2024-09-12T01:38:21.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.889+0000 7f8144b02640 1 -- 172.21.15.60:0/3999656897 learned_addr learned my addr 172.21.15.60:0/3999656897 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:21.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.890+0000 7f8145303640 1 --2- 172.21.15.60:0/3999656897 >> v2:172.21.15.105:3300/0 conn(0x7f81400b6720 0x7f81400d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.890+0000 7f813ffff640 1 -- 172.21.15.60:0/3999656897 >> v2:172.21.15.105:3300/0 conn(0x7f81400b6720 msgr2=0x7f81400d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:21.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.890+0000 7f813ffff640 1 --2- 172.21.15.60:0/3999656897 >> v2:172.21.15.105:3300/0 conn(0x7f81400b6720 0x7f81400d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.890+0000 7f813ffff640 1 -- 172.21.15.60:0/3999656897 >> v1:172.21.15.60:6789/0 conn(0x7f814015e7a0 legacy=0x7f814006caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:21.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.890+0000 7f813ffff640 1 -- 172.21.15.60:0/3999656897 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81400cfb40 con 0x7f81400cf1f0 2024-09-12T01:38:21.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.890+0000 7f813f7fe640 1 -- 172.21.15.60:0/3999656897 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1177207882 0 0) 0x7f81400cf860 con 0x7f814015e7a0 2024-09-12T01:38:21.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.891+0000 7f813ffff640 1 --2- 172.21.15.60:0/3999656897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81400cf1f0 0x7f81400b61e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f814008d930 tx=0x7f813402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21eea2baec7ad27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:21.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.891+0000 7f813f7fe640 1 -- 172.21.15.60:0/3999656897 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8134037070 con 0x7f81400cf1f0 2024-09-12T01:38:21.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.891+0000 7f813f7fe640 1 -- 172.21.15.60:0/3999656897 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8134032440 con 0x7f81400cf1f0 2024-09-12T01:38:21.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.891+0000 7f813f7fe640 1 -- 172.21.15.60:0/3999656897 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813402ae60 con 0x7f81400cf1f0 2024-09-12T01:38:21.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.891+0000 7f8146d66640 1 -- 172.21.15.60:0/3999656897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81400cf1f0 msgr2=0x7f81400b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:21.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.891+0000 7f8146d66640 1 --2- 172.21.15.60:0/3999656897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81400cf1f0 0x7f81400b61e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f814008d930 tx=0x7f813402a110 comp rx=0 tx=0).stop 2024-09-12T01:38:21.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.891+0000 7f8146d66640 1 -- 172.21.15.60:0/3999656897 shutdown_connections 2024-09-12T01:38:21.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.891+0000 7f8146d66640 1 --2- 172.21.15.60:0/3999656897 >> v2:172.21.15.105:3300/0 conn(0x7f81400b6720 0x7f81400d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.891+0000 7f8146d66640 1 --2- 172.21.15.60:0/3999656897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81400cf1f0 0x7f81400b61e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.891+0000 7f8146d66640 1 -- 172.21.15.60:0/3999656897 >> 172.21.15.60:0/3999656897 conn(0x7f81400d11e0 msgr2=0x7f81400d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:21.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.891+0000 7f8146d66640 1 -- 172.21.15.60:0/3999656897 shutdown_connections 2024-09-12T01:38:21.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.891+0000 7f8146d66640 1 -- 172.21.15.60:0/3999656897 wait complete. 2024-09-12T01:38:21.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.893+0000 7f8146d66640 1 Processor -- start 2024-09-12T01:38:21.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.893+0000 7f8146d66640 1 -- start start 2024-09-12T01:38:21.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.893+0000 7f8146d66640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81400b6720 0x7f81401539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.893+0000 7f8146d66640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81400cf1f0 0x7f81400c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.893+0000 7f8146d66640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814015e7a0 0x7f81400ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.893+0000 7f8146d66640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f81400b7a00 con 0x7f81400b6720 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.893+0000 7f8146d66640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f81400d2ef0 con 0x7f814015e7a0 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.893+0000 7f8146d66640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f814015eb80 con 0x7f81400cf1f0 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8144b02640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81400b6720 0x7f81401539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8144b02640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81400b6720 0x7f81401539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38526/0 (socket says 172.21.15.60:38526) 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8144b02640 1 -- 172.21.15.60:0/129827971 learned_addr learned my addr 172.21.15.60:0/129827971 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f813ffff640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81400cf1f0 0x7f81400c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8145303640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814015e7a0 0x7f81400ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8144b02640 1 -- 172.21.15.60:0/129827971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81400cf1f0 msgr2=0x7f81400c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8144b02640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81400cf1f0 0x7f81400c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8144b02640 1 -- 172.21.15.60:0/129827971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814015e7a0 msgr2=0x7f81400ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:21.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8144b02640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814015e7a0 0x7f81400ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8144b02640 1 -- 172.21.15.60:0/129827971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8140155080 con 0x7f81400b6720 2024-09-12T01:38:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8145303640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814015e7a0 0x7f81400ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8144b02640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81400b6720 0x7f81401539e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f813000c4d0 tx=0x7f813000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f813d7fa640 1 -- 172.21.15.60:0/129827971 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130018070 con 0x7f81400b6720 2024-09-12T01:38:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f813d7fa640 1 -- 172.21.15.60:0/129827971 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8130007500 con 0x7f81400b6720 2024-09-12T01:38:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f813d7fa640 1 -- 172.21.15.60:0/129827971 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130004a20 con 0x7f81400b6720 2024-09-12T01:38:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8146d66640 1 -- 172.21.15.60:0/129827971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8140153fe0 con 0x7f81400b6720 2024-09-12T01:38:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.894+0000 7f8146d66640 1 -- 172.21.15.60:0/129827971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81401545a0 con 0x7f81400b6720 2024-09-12T01:38:21.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.895+0000 7f8146d66640 1 -- 172.21.15.60:0/129827971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81400b61e0 con 0x7f81400b6720 2024-09-12T01:38:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.896+0000 7f813d7fa640 1 -- 172.21.15.60:0/129827971 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8130004bc0 con 0x7f81400b6720 2024-09-12T01:38:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.896+0000 7f813d7fa640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f812c06be60 0x7f812c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.896+0000 7f813d7fa640 1 -- 172.21.15.60:0/129827971 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f8130089f30 con 0x7f81400b6720 2024-09-12T01:38:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.896+0000 7f813ffff640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f812c06be60 0x7f812c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:21.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.897+0000 7f813ffff640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f812c06be60 0x7f812c06e320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8134034000 tx=0x7f813402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:21.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:21.901+0000 7f813d7fa640 1 -- 172.21.15.60:0/129827971 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8130058320 con 0x7f81400b6720 2024-09-12T01:38:22.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.086+0000 7f8146d66640 1 -- 172.21.15.60:0/129827971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f81400b9920 con 0x7f81400b6720 2024-09-12T01:38:22.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.086+0000 7f813d7fa640 1 -- 172.21.15.60:0/129827971 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7f813005c620 con 0x7f81400b6720 2024-09-12T01:38:22.087 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:38:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.088+0000 7f8146d66640 1 -- 172.21.15.60:0/129827971 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f812c06be60 msgr2=0x7f812c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.088+0000 7f8146d66640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f812c06be60 0x7f812c06e320 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8134034000 tx=0x7f813402e000 comp rx=0 tx=0).stop 2024-09-12T01:38:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.088+0000 7f8146d66640 1 -- 172.21.15.60:0/129827971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81400b6720 msgr2=0x7f81401539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.088+0000 7f8146d66640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81400b6720 0x7f81401539e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f813000c4d0 tx=0x7f813000c990 comp rx=0 tx=0).stop 2024-09-12T01:38:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.089+0000 7f8146d66640 1 -- 172.21.15.60:0/129827971 shutdown_connections 2024-09-12T01:38:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.089+0000 7f8146d66640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f814015e7a0 0x7f81400ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.089+0000 7f8146d66640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f812c06be60 0x7f812c06e320 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.089+0000 7f8146d66640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81400cf1f0 0x7f81400c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.089+0000 7f8146d66640 1 --2- 172.21.15.60:0/129827971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81400b6720 0x7f81401539e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.089+0000 7f8146d66640 1 -- 172.21.15.60:0/129827971 >> 172.21.15.60:0/129827971 conn(0x7f81400d11e0 msgr2=0x7f814006ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:22.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.089+0000 7f8146d66640 1 -- 172.21.15.60:0/129827971 shutdown_connections 2024-09-12T01:38:22.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.089+0000 7f8146d66640 1 -- 172.21.15.60:0/129827971 wait complete. 2024-09-12T01:38:22.100 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:38:22.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:22.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:38:22.129 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:38:22.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:22.130 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:38:22.186 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:38:22.186 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:38:22.186 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:22.202 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:38:22.202 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:22.258 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:38:22.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.362+0000 7f2597c96640 1 Processor -- start 2024-09-12T01:38:22.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.362+0000 7f2597c96640 1 -- start start 2024-09-12T01:38:22.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.363+0000 7f2597c96640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f259015a060 0x7f259006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.363+0000 7f2597c96640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f259015d3d0 0x7f259006f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.363+0000 7f2597c96640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f25900b1990 0x7f259015ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.363+0000 7f2597c96640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f25900712e0 con 0x7f25900b1990 2024-09-12T01:38:22.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.363+0000 7f2597c96640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2590071770 con 0x7f259015a060 2024-09-12T01:38:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.363+0000 7f2597c96640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f25900709b0 con 0x7f259015d3d0 2024-09-12T01:38:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.363+0000 7f2596233640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f25900b1990 0x7f259015ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.363+0000 7f2596233640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f25900b1990 0x7f259015ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38532/0 (socket says 172.21.15.60:38532) 2024-09-12T01:38:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.363+0000 7f2596233640 1 -- 172.21.15.60:0/2657489597 learned_addr learned my addr 172.21.15.60:0/2657489597 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.363+0000 7f2595231640 1 --2- 172.21.15.60:0/2657489597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f259015d3d0 0x7f259006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.363+0000 7f2595a32640 1 --2- 172.21.15.60:0/2657489597 >> v2:172.21.15.105:3300/0 conn(0x7f259015a060 0x7f259006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.364+0000 7f2596233640 1 -- 172.21.15.60:0/2657489597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f259015d3d0 msgr2=0x7f259006f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.364+0000 7f2596233640 1 --2- 172.21.15.60:0/2657489597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f259015d3d0 0x7f259006f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.364+0000 7f2596233640 1 -- 172.21.15.60:0/2657489597 >> v2:172.21.15.105:3300/0 conn(0x7f259015a060 msgr2=0x7f259006f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.364+0000 7f2596233640 1 --2- 172.21.15.60:0/2657489597 >> v2:172.21.15.105:3300/0 conn(0x7f259015a060 0x7f259006f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.364+0000 7f2596233640 1 -- 172.21.15.60:0/2657489597 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2590070c90 con 0x7f25900b1990 2024-09-12T01:38:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.364+0000 7f2596233640 1 --2- 172.21.15.60:0/2657489597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25900b1990 0x7f259015ff40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f25900759d0 tx=0x7f258002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48730877ce96e9f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.365+0000 7f2594a30640 1 -- 172.21.15.60:0/2657489597 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580036070 con 0x7f25900b1990 2024-09-12T01:38:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.365+0000 7f2594a30640 1 -- 172.21.15.60:0/2657489597 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2580031600 con 0x7f25900b1990 2024-09-12T01:38:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.365+0000 7f2594a30640 1 -- 172.21.15.60:0/2657489597 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25800319d0 con 0x7f25900b1990 2024-09-12T01:38:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.365+0000 7f2597c96640 1 -- 172.21.15.60:0/2657489597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25900b1990 msgr2=0x7f259015ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.365+0000 7f2597c96640 1 --2- 172.21.15.60:0/2657489597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25900b1990 0x7f259015ff40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f25900759d0 tx=0x7f258002a6a0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.365+0000 7f2597c96640 1 -- 172.21.15.60:0/2657489597 shutdown_connections 2024-09-12T01:38:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.365+0000 7f2597c96640 1 --2- 172.21.15.60:0/2657489597 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25900b1990 0x7f259015ff40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.365+0000 7f2597c96640 1 --2- 172.21.15.60:0/2657489597 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f259015d3d0 0x7f259006f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.365+0000 7f2597c96640 1 --2- 172.21.15.60:0/2657489597 >> v2:172.21.15.105:3300/0 conn(0x7f259015a060 0x7f259006f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.365+0000 7f2597c96640 1 -- 172.21.15.60:0/2657489597 >> 172.21.15.60:0/2657489597 conn(0x7f25900d2430 msgr2=0x7f25900d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:22.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.365+0000 7f2597c96640 1 -- 172.21.15.60:0/2657489597 shutdown_connections 2024-09-12T01:38:22.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.365+0000 7f2597c96640 1 -- 172.21.15.60:0/2657489597 wait complete. 2024-09-12T01:38:22.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.366+0000 7f2597c96640 1 Processor -- start 2024-09-12T01:38:22.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.366+0000 7f2597c96640 1 -- start start 2024-09-12T01:38:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.367+0000 7f2597c96640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f25900b1990 0x7f25901f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.367+0000 7f2597c96640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f259015a060 0x7f2590152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.367+0000 7f2597c96640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f259015d3d0 0x7f2590153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.367+0000 7f2597c96640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2590070030 con 0x7f259015a060 2024-09-12T01:38:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.367+0000 7f2597c96640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f259006feb0 con 0x7f259015d3d0 2024-09-12T01:38:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.367+0000 7f2597c96640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2590160480 con 0x7f25900b1990 2024-09-12T01:38:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.367+0000 7f2595231640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f259015a060 0x7f2590152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.367+0000 7f2595231640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f259015a060 0x7f2590152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38548/0 (socket says 172.21.15.60:38548) 2024-09-12T01:38:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.367+0000 7f2595231640 1 -- 172.21.15.60:0/4089491865 learned_addr learned my addr 172.21.15.60:0/4089491865 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.367+0000 7f2596233640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f259015d3d0 0x7f2590153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.367+0000 7f2595a32640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f25900b1990 0x7f25901f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.368+0000 7f2595231640 1 -- 172.21.15.60:0/4089491865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f25900b1990 msgr2=0x7f25901f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.368+0000 7f2595231640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f25900b1990 0x7f25901f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.368+0000 7f2595231640 1 -- 172.21.15.60:0/4089491865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f259015d3d0 msgr2=0x7f2590153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.368+0000 7f2595231640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f259015d3d0 0x7f2590153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.368+0000 7f2595231640 1 -- 172.21.15.60:0/4089491865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2590156da0 con 0x7f259015a060 2024-09-12T01:38:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.368+0000 7f2595231640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f259015a060 0x7f2590152e60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f258400e840 tx=0x7f258400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.368+0000 7f258e7fc640 1 -- 172.21.15.60:0/4089491865 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2584017070 con 0x7f259015a060 2024-09-12T01:38:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.368+0000 7f258e7fc640 1 -- 172.21.15.60:0/4089491865 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f258400c940 con 0x7f259015a060 2024-09-12T01:38:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.368+0000 7f2597c96640 1 -- 172.21.15.60:0/4089491865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25901f2590 con 0x7f259015a060 2024-09-12T01:38:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.368+0000 7f258e7fc640 1 -- 172.21.15.60:0/4089491865 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258400cd10 con 0x7f259015a060 2024-09-12T01:38:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.368+0000 7f2597c96640 1 -- 172.21.15.60:0/4089491865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25901533a0 con 0x7f259015a060 2024-09-12T01:38:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.369+0000 7f2597c96640 1 -- 172.21.15.60:0/4089491865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25901f2980 con 0x7f259015a060 2024-09-12T01:38:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.370+0000 7f258e7fc640 1 -- 172.21.15.60:0/4089491865 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f258401a070 con 0x7f259015a060 2024-09-12T01:38:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.370+0000 7f258e7fc640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f257c06be30 0x7f257c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.370+0000 7f258e7fc640 1 -- 172.21.15.60:0/4089491865 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f258408b090 con 0x7f259015a060 2024-09-12T01:38:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.370+0000 7f2595a32640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f257c06be30 0x7f257c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.371+0000 7f2595a32640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f257c06be30 0x7f257c06e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2590159220 tx=0x7f2588009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.374+0000 7f258e7fc640 1 -- 172.21.15.60:0/4089491865 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2584059350 con 0x7f259015a060 2024-09-12T01:38:22.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.562+0000 7f2597c96640 1 -- 172.21.15.60:0/4089491865 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f259006c6c0 con 0x7f259015a060 2024-09-12T01:38:22.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.563+0000 7f258e7fc640 1 -- 172.21.15.60:0/4089491865 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v57) ==== 80+0+0 (secure 0 0 0) 0x7f258405d650 con 0x7f259015a060 2024-09-12T01:38:22.563 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:38:22.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.565+0000 7f2597c96640 1 -- 172.21.15.60:0/4089491865 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f257c06be30 msgr2=0x7f257c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.565+0000 7f2597c96640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f257c06be30 0x7f257c06e2f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2590159220 tx=0x7f2588009190 comp rx=0 tx=0).stop 2024-09-12T01:38:22.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.565+0000 7f2597c96640 1 -- 172.21.15.60:0/4089491865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f259015a060 msgr2=0x7f2590152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.565+0000 7f2597c96640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f259015a060 0x7f2590152e60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f258400e840 tx=0x7f258400ed00 comp rx=0 tx=0).stop 2024-09-12T01:38:22.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.565+0000 7f2597c96640 1 -- 172.21.15.60:0/4089491865 shutdown_connections 2024-09-12T01:38:22.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.565+0000 7f2597c96640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f259015d3d0 0x7f2590153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.565+0000 7f2597c96640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f259015a060 0x7f2590152e60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.565+0000 7f2597c96640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f257c06be30 0x7f257c06e2f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.565+0000 7f2597c96640 1 --2- 172.21.15.60:0/4089491865 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f25900b1990 0x7f25901f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.565+0000 7f2597c96640 1 -- 172.21.15.60:0/4089491865 >> 172.21.15.60:0/4089491865 conn(0x7f25900d2430 msgr2=0x7f25900b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:22.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.565+0000 7f2597c96640 1 -- 172.21.15.60:0/4089491865 shutdown_connections 2024-09-12T01:38:22.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.565+0000 7f2597c96640 1 -- 172.21.15.60:0/4089491865 wait complete. 2024-09-12T01:38:22.576 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:38:22.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:22.577 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T01:38:22.606 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:38:22.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:22.606 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:38:22.663 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:38:22.663 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:22.663 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:22.679 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:38:22.679 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:38:22.680 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:38:22.680 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:22.720 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:38:22.720 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:22.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.822+0000 7fb83606e640 1 Processor -- start 2024-09-12T01:38:22.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.822+0000 7fb83606e640 1 -- start start 2024-09-12T01:38:22.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.823+0000 7fb83606e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb83015c2b0 0x7fb8300b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.823+0000 7fb83606e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb83015f200 0x7fb83006d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.823+0000 7fb83606e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb83015fb10 con 0x7fb8300b72f0 2024-09-12T01:38:22.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.823+0000 7fb83606e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb8300b5900 con 0x7fb83015c2b0 2024-09-12T01:38:22.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.823+0000 7fb83606e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb83015f830 con 0x7fb83015f200 2024-09-12T01:38:22.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.823+0000 7fb82f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb83015c2b0 0x7fb8300b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.823+0000 7fb82f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb83015c2b0 0x7fb8300b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50740/0 (socket says 172.21.15.60:50740) 2024-09-12T01:38:22.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.823+0000 7fb826ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb8300b72f0 0x7fb83015eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48868/0 (socket says 172.21.15.60:48868) 2024-09-12T01:38:22.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.823+0000 7fb82f7fe640 1 -- 172.21.15.60:0/1054996939 learned_addr learned my addr 172.21.15.60:0/1054996939 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:22.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.823+0000 7fb82ffff640 1 --2- 172.21.15.60:0/1054996939 >> v2:172.21.15.105:3300/0 conn(0x7fb83015f200 0x7fb83006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.823+0000 7fb82f7fe640 1 -- 172.21.15.60:0/1054996939 >> v2:172.21.15.105:3300/0 conn(0x7fb83015f200 msgr2=0x7fb83006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:22.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.824+0000 7fb82f7fe640 1 --2- 172.21.15.60:0/1054996939 >> v2:172.21.15.105:3300/0 conn(0x7fb83015f200 0x7fb83006d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.824+0000 7fb82f7fe640 1 -- 172.21.15.60:0/1054996939 >> v1:172.21.15.60:6789/0 conn(0x7fb8300b72f0 legacy=0x7fb83015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.824+0000 7fb82f7fe640 1 -- 172.21.15.60:0/1054996939 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83006ce30 con 0x7fb83015c2b0 2024-09-12T01:38:22.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.824+0000 7fb82effd640 1 -- 172.21.15.60:0/1054996939 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150549371 0 0) 0x7fb83015fb10 con 0x7fb8300b72f0 2024-09-12T01:38:22.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.824+0000 7fb82f7fe640 1 --2- 172.21.15.60:0/1054996939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83015c2b0 0x7fb8300b6db0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb830072d40 tx=0x7fb82002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787e2fe3e6fd47bf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:22.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.824+0000 7fb82effd640 1 -- 172.21.15.60:0/1054996939 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820037070 con 0x7fb83015c2b0 2024-09-12T01:38:22.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.824+0000 7fb82effd640 1 -- 172.21.15.60:0/1054996939 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb820032440 con 0x7fb83015c2b0 2024-09-12T01:38:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.824+0000 7fb82effd640 1 -- 172.21.15.60:0/1054996939 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb820032810 con 0x7fb83015c2b0 2024-09-12T01:38:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.825+0000 7fb83606e640 1 -- 172.21.15.60:0/1054996939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83015c2b0 msgr2=0x7fb8300b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.825+0000 7fb83606e640 1 --2- 172.21.15.60:0/1054996939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83015c2b0 0x7fb8300b6db0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb830072d40 tx=0x7fb82002a270 comp rx=0 tx=0).stop 2024-09-12T01:38:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.825+0000 7fb83606e640 1 -- 172.21.15.60:0/1054996939 shutdown_connections 2024-09-12T01:38:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.825+0000 7fb83606e640 1 --2- 172.21.15.60:0/1054996939 >> v2:172.21.15.105:3300/0 conn(0x7fb83015f200 0x7fb83006d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.825+0000 7fb83606e640 1 --2- 172.21.15.60:0/1054996939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83015c2b0 0x7fb8300b6db0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.825+0000 7fb83606e640 1 -- 172.21.15.60:0/1054996939 >> 172.21.15.60:0/1054996939 conn(0x7fb8300b4240 msgr2=0x7fb8300b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.825+0000 7fb83606e640 1 -- 172.21.15.60:0/1054996939 shutdown_connections 2024-09-12T01:38:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.825+0000 7fb83606e640 1 -- 172.21.15.60:0/1054996939 wait complete. 2024-09-12T01:38:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.826+0000 7fb83606e640 1 Processor -- start 2024-09-12T01:38:22.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.826+0000 7fb83606e640 1 -- start start 2024-09-12T01:38:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.827+0000 7fb83606e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8300b72f0 0x7fb830159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.827+0000 7fb83606e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83015c2b0 0x7fb83015a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.827+0000 7fb83606e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb83015f200 0x7fb8300d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.827+0000 7fb83606e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb8300b7760 con 0x7fb83015c2b0 2024-09-12T01:38:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.827+0000 7fb83606e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb83006d3f0 con 0x7fb83015f200 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.827+0000 7fb83606e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb83006de50 con 0x7fb8300b72f0 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.827+0000 7fb826ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83015c2b0 0x7fb83015a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.827+0000 7fb826ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83015c2b0 0x7fb83015a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50744/0 (socket says 172.21.15.60:50744) 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.827+0000 7fb826ffd640 1 -- 172.21.15.60:0/2689215377 learned_addr learned my addr 172.21.15.60:0/2689215377 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.827+0000 7fb82ffff640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb83015f200 0x7fb8300d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.827+0000 7fb82f7fe640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8300b72f0 0x7fb830159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.828+0000 7fb826ffd640 1 -- 172.21.15.60:0/2689215377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8300b72f0 msgr2=0x7fb830159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.828+0000 7fb826ffd640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8300b72f0 0x7fb830159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.828+0000 7fb826ffd640 1 -- 172.21.15.60:0/2689215377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb83015f200 msgr2=0x7fb8300d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.828+0000 7fb826ffd640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb83015f200 0x7fb8300d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.828+0000 7fb826ffd640 1 -- 172.21.15.60:0/2689215377 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8301e8c10 con 0x7fb83015c2b0 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.828+0000 7fb826ffd640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83015c2b0 0x7fb83015a3b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb81800c4d0 tx=0x7fb81800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.828+0000 7fb82cff9640 1 -- 172.21.15.60:0/2689215377 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818018070 con 0x7fb83015c2b0 2024-09-12T01:38:22.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.828+0000 7fb82cff9640 1 -- 172.21.15.60:0/2689215377 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb818007500 con 0x7fb83015c2b0 2024-09-12T01:38:22.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.828+0000 7fb83606e640 1 -- 172.21.15.60:0/2689215377 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8301e8ef0 con 0x7fb83015c2b0 2024-09-12T01:38:22.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.828+0000 7fb82cff9640 1 -- 172.21.15.60:0/2689215377 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818004a20 con 0x7fb83015c2b0 2024-09-12T01:38:22.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.828+0000 7fb83606e640 1 -- 172.21.15.60:0/2689215377 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8301e9790 con 0x7fb83015c2b0 2024-09-12T01:38:22.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.829+0000 7fb83606e640 1 -- 172.21.15.60:0/2689215377 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8300b6db0 con 0x7fb83015c2b0 2024-09-12T01:38:22.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.830+0000 7fb82cff9640 1 -- 172.21.15.60:0/2689215377 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb81801b070 con 0x7fb83015c2b0 2024-09-12T01:38:22.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.830+0000 7fb82cff9640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb81006be60 0x7fb81006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:22.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.830+0000 7fb82cff9640 1 -- 172.21.15.60:0/2689215377 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb81808a1b0 con 0x7fb83015c2b0 2024-09-12T01:38:22.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.830+0000 7fb82f7fe640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb81006be60 0x7fb81006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:22.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.830+0000 7fb82f7fe640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb81006be60 0x7fb81006e320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb820034000 tx=0x7fb82002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:22.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:22.834+0000 7fb82cff9640 1 -- 172.21.15.60:0/2689215377 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb818058b60 con 0x7fb83015c2b0 2024-09-12T01:38:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.043+0000 7fb83606e640 1 -- 172.21.15.60:0/2689215377 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8300712a0 con 0x7fb83015c2b0 2024-09-12T01:38:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.043+0000 7fb82cff9640 1 -- 172.21.15.60:0/2689215377 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5223 (secure 0 0 0) 0x7fb818058460 con 0x7fb83015c2b0 2024-09-12T01:38:23.045 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:23.045 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"btime":"2024-09-12T01:38:16:732986+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3403684617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3403684617},{"type":"v1","addr":"172.21.15.60:6837","nonce":3403684617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/343463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":343463},{"type":"v1","addr":"172.21.15.60:6836","nonce":343463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":34985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2046884414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2046884414},{"type":"v1","addr":"172.21.15.105:6834","nonce":2046884414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:12.079385+0000","modified":"2024-09-12T01:38:16.088710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34988},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34988":{"gid":34988,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/4144770620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4144770620},{"type":"v1","addr":"172.21.15.105:6835","nonce":4144770620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34988,"qdb_cluster":[34988]},"id":4}]} 2024-09-12T01:38:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 30 2024-09-12T01:38:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.045+0000 7fb83606e640 1 -- 172.21.15.60:0/2689215377 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb81006be60 msgr2=0x7fb81006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.045+0000 7fb83606e640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb81006be60 0x7fb81006e320 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb820034000 tx=0x7fb82002e000 comp rx=0 tx=0).stop 2024-09-12T01:38:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.045+0000 7fb83606e640 1 -- 172.21.15.60:0/2689215377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83015c2b0 msgr2=0x7fb83015a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.045+0000 7fb83606e640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83015c2b0 0x7fb83015a3b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb81800c4d0 tx=0x7fb81800c990 comp rx=0 tx=0).stop 2024-09-12T01:38:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.045+0000 7fb83606e640 1 -- 172.21.15.60:0/2689215377 shutdown_connections 2024-09-12T01:38:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.045+0000 7fb83606e640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb83015f200 0x7fb8300d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.045+0000 7fb83606e640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb83015c2b0 0x7fb83015a3b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.045+0000 7fb83606e640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb81006be60 0x7fb81006e320 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.045+0000 7fb83606e640 1 --2- 172.21.15.60:0/2689215377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb8300b72f0 0x7fb830159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.045+0000 7fb83606e640 1 -- 172.21.15.60:0/2689215377 >> 172.21.15.60:0/2689215377 conn(0x7fb8300b4240 msgr2=0x7fb83015e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.045+0000 7fb83606e640 1 -- 172.21.15.60:0/2689215377 shutdown_connections 2024-09-12T01:38:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.045+0000 7fb83606e640 1 -- 172.21.15.60:0/2689215377 wait complete. 2024-09-12T01:38:23.057 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.159+0000 7f111de74640 1 Processor -- start 2024-09-12T01:38:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.159+0000 7f111de74640 1 -- start start 2024-09-12T01:38:23.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f111de74640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f111815e7a0 0x7f11180ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f111de74640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11180d3fe0 0x7f11180d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f111de74640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11180d4430 con 0x7f11180cf2f0 2024-09-12T01:38:23.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f111de74640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f11180d2cc0 con 0x7f11180d3fe0 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f111de74640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f11180d2f40 con 0x7f111815e7a0 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f110effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11180d3fe0 0x7f11180d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f1117fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f11180cf2f0 0x7f11180b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48876/0 (socket says 172.21.15.60:48876) 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f110effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11180d3fe0 0x7f11180d2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50746/0 (socket says 172.21.15.60:50746) 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f1117fff640 1 -- 172.21.15.60:0/1478260837 learned_addr learned my addr 172.21.15.60:0/1478260837 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f11177fe640 1 --2- 172.21.15.60:0/1478260837 >> v2:172.21.15.105:3300/0 conn(0x7f111815e7a0 0x7f11180ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f110effd640 1 -- 172.21.15.60:0/1478260837 >> v2:172.21.15.105:3300/0 conn(0x7f111815e7a0 msgr2=0x7f11180ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f110effd640 1 --2- 172.21.15.60:0/1478260837 >> v2:172.21.15.105:3300/0 conn(0x7f111815e7a0 0x7f11180ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f110effd640 1 -- 172.21.15.60:0/1478260837 >> v1:172.21.15.60:6789/0 conn(0x7f11180cf2f0 legacy=0x7f11180b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f1116ffd640 1 -- 172.21.15.60:0/1478260837 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833535871 0 0) 0x7f11180d4430 con 0x7f11180cf2f0 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.160+0000 7f110effd640 1 -- 172.21.15.60:0/1478260837 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11180d3220 con 0x7f11180d3fe0 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.161+0000 7f110effd640 1 --2- 172.21.15.60:0/1478260837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11180d3fe0 0x7f11180d2780 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f11180b71e0 tx=0x7f110002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef48f3347f8df242 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.161+0000 7f1116ffd640 1 -- 172.21.15.60:0/1478260837 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100037070 con 0x7f11180d3fe0 2024-09-12T01:38:23.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.161+0000 7f1116ffd640 1 -- 172.21.15.60:0/1478260837 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1100032440 con 0x7f11180d3fe0 2024-09-12T01:38:23.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.161+0000 7f1116ffd640 1 -- 172.21.15.60:0/1478260837 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100032810 con 0x7f11180d3fe0 2024-09-12T01:38:23.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.162+0000 7f111de74640 1 -- 172.21.15.60:0/1478260837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11180d3fe0 msgr2=0x7f11180d2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.162+0000 7f111de74640 1 --2- 172.21.15.60:0/1478260837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11180d3fe0 0x7f11180d2780 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f11180b71e0 tx=0x7f110002a230 comp rx=0 tx=0).stop 2024-09-12T01:38:23.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.162+0000 7f111de74640 1 -- 172.21.15.60:0/1478260837 shutdown_connections 2024-09-12T01:38:23.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.162+0000 7f111de74640 1 --2- 172.21.15.60:0/1478260837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11180d3fe0 0x7f11180d2780 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.162+0000 7f111de74640 1 --2- 172.21.15.60:0/1478260837 >> v2:172.21.15.105:3300/0 conn(0x7f111815e7a0 0x7f11180ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.162+0000 7f111de74640 1 -- 172.21.15.60:0/1478260837 >> 172.21.15.60:0/1478260837 conn(0x7f11180d1550 msgr2=0x7f11180d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:23.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.162+0000 7f111de74640 1 -- 172.21.15.60:0/1478260837 shutdown_connections 2024-09-12T01:38:23.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.162+0000 7f111de74640 1 -- 172.21.15.60:0/1478260837 wait complete. 2024-09-12T01:38:23.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.163+0000 7f111de74640 1 Processor -- start 2024-09-12T01:38:23.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.163+0000 7f111de74640 1 -- start start 2024-09-12T01:38:23.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f111de74640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11180cf2f0 0x7f1118157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f111de74640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11180d3fe0 0x7f1118160a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f111de74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111815e7a0 0x7f1118160f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f111de74640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f11180d3ac0 con 0x7f111815e7a0 2024-09-12T01:38:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f111de74640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f11180d37e0 con 0x7f11180d3fe0 2024-09-12T01:38:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f111de74640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f111815eb80 con 0x7f11180cf2f0 2024-09-12T01:38:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f1117fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111815e7a0 0x7f1118160f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f1117fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111815e7a0 0x7f1118160f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50748/0 (socket says 172.21.15.60:50748) 2024-09-12T01:38:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f1117fff640 1 -- 172.21.15.60:0/968966067 learned_addr learned my addr 172.21.15.60:0/968966067 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f110effd640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11180d3fe0 0x7f1118160a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f11177fe640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11180cf2f0 0x7f1118157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f1117fff640 1 -- 172.21.15.60:0/968966067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11180cf2f0 msgr2=0x7f1118157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f1117fff640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11180cf2f0 0x7f1118157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f1117fff640 1 -- 172.21.15.60:0/968966067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11180d3fe0 msgr2=0x7f1118160a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.164+0000 7f1117fff640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11180d3fe0 0x7f1118160a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.165+0000 7f1117fff640 1 -- 172.21.15.60:0/968966067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11180cc470 con 0x7f111815e7a0 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.165+0000 7f110effd640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11180d3fe0 0x7f1118160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.165+0000 7f11177fe640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11180cf2f0 0x7f1118157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.165+0000 7f1117fff640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111815e7a0 0x7f1118160f90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f111000c7a0 tx=0x7f111000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.165+0000 7f1114ff9640 1 -- 172.21.15.60:0/968966067 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110018070 con 0x7f111815e7a0 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.165+0000 7f1114ff9640 1 -- 172.21.15.60:0/968966067 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f111000a640 con 0x7f111815e7a0 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.165+0000 7f111de74640 1 -- 172.21.15.60:0/968966067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11180cc750 con 0x7f111815e7a0 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.165+0000 7f1114ff9640 1 -- 172.21.15.60:0/968966067 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f111000aab0 con 0x7f111815e7a0 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.165+0000 7f111de74640 1 -- 172.21.15.60:0/968966067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11180ccd10 con 0x7f111815e7a0 2024-09-12T01:38:23.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.166+0000 7f111de74640 1 -- 172.21.15.60:0/968966067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11180d2780 con 0x7f111815e7a0 2024-09-12T01:38:23.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.166+0000 7f1114ff9640 1 -- 172.21.15.60:0/968966067 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f111001b070 con 0x7f111815e7a0 2024-09-12T01:38:23.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.167+0000 7f1114ff9640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f10f806be60 0x7f10f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.167+0000 7f1114ff9640 1 -- 172.21.15.60:0/968966067 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f111008a470 con 0x7f111815e7a0 2024-09-12T01:38:23.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.167+0000 7f11177fe640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f10f806be60 0x7f10f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.167+0000 7f11177fe640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f10f806be60 0x7f10f806e320 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1108006fd0 tx=0x7f1108008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.171+0000 7f1114ff9640 1 -- 172.21.15.60:0/968966067 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1110058e20 con 0x7f111815e7a0 2024-09-12T01:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.385+0000 7f111de74640 1 -- 172.21.15.60:0/968966067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11180ba1c0 con 0x7f111815e7a0 2024-09-12T01:38:23.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.385+0000 7f1114ff9640 1 -- 172.21.15.60:0/968966067 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5223 (secure 0 0 0) 0x7f1110058720 con 0x7f111815e7a0 2024-09-12T01:38:23.386 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:23.386 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"btime":"2024-09-12T01:38:16:732986+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3403684617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3403684617},{"type":"v1","addr":"172.21.15.60:6837","nonce":3403684617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/343463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":343463},{"type":"v1","addr":"172.21.15.60:6836","nonce":343463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":34985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2046884414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2046884414},{"type":"v1","addr":"172.21.15.105:6834","nonce":2046884414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:12.079385+0000","modified":"2024-09-12T01:38:16.088710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34988},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34988":{"gid":34988,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/4144770620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4144770620},{"type":"v1","addr":"172.21.15.105:6835","nonce":4144770620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34988,"qdb_cluster":[34988]},"id":4}]} 2024-09-12T01:38:23.386 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 30 2024-09-12T01:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.387+0000 7f111de74640 1 -- 172.21.15.60:0/968966067 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f10f806be60 msgr2=0x7f10f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.387+0000 7f111de74640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f10f806be60 0x7f10f806e320 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1108006fd0 tx=0x7f1108008040 comp rx=0 tx=0).stop 2024-09-12T01:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.387+0000 7f111de74640 1 -- 172.21.15.60:0/968966067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111815e7a0 msgr2=0x7f1118160f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.387+0000 7f111de74640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111815e7a0 0x7f1118160f90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f111000c7a0 tx=0x7f111000cc60 comp rx=0 tx=0).stop 2024-09-12T01:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.387+0000 7f111de74640 1 -- 172.21.15.60:0/968966067 shutdown_connections 2024-09-12T01:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.387+0000 7f111de74640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111815e7a0 0x7f1118160f90 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.387+0000 7f111de74640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f11180d3fe0 0x7f1118160a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.387+0000 7f111de74640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f10f806be60 0x7f10f806e320 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.387+0000 7f111de74640 1 --2- 172.21.15.60:0/968966067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f11180cf2f0 0x7f1118157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.387+0000 7f111de74640 1 -- 172.21.15.60:0/968966067 >> 172.21.15.60:0/968966067 conn(0x7f11180d1550 msgr2=0x7f111806d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.387+0000 7f111de74640 1 -- 172.21.15.60:0/968966067 shutdown_connections 2024-09-12T01:38:23.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.387+0000 7f111de74640 1 -- 172.21.15.60:0/968966067 wait complete. 2024-09-12T01:38:23.398 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:23.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.500+0000 7fb08b3a6640 1 Processor -- start 2024-09-12T01:38:23.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.500+0000 7fb08b3a6640 1 -- start start 2024-09-12T01:38:23.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.501+0000 7fb08b3a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb0840b4920 0x7fb08415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.501+0000 7fb08b3a6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb0840b4d00 0x7fb0840b5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.501+0000 7fb08b3a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0840cd780 0x7fb0840cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.501+0000 7fb08b3a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb0840cf100 con 0x7fb0840b4920 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.501+0000 7fb08b3a6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb0840ce4f0 con 0x7fb0840b4d00 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.501+0000 7fb08b3a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb0840ce7d0 con 0x7fb0840cd780 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.501+0000 7fb089142640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb0840b4920 0x7fb08415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.501+0000 7fb089142640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb0840b4920 0x7fb08415b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50760/0 (socket says 172.21.15.60:50760) 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.501+0000 7fb089142640 1 -- 172.21.15.60:0/2867315506 learned_addr learned my addr 172.21.15.60:0/2867315506 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.502+0000 7fb089943640 1 --2- 172.21.15.60:0/2867315506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0840cd780 0x7fb0840cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.502+0000 7fb088941640 1 --2- 172.21.15.60:0/2867315506 >> v2:172.21.15.105:3300/0 conn(0x7fb0840b4d00 0x7fb0840b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.502+0000 7fb089142640 1 -- 172.21.15.60:0/2867315506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0840cd780 msgr2=0x7fb0840cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.502+0000 7fb089142640 1 --2- 172.21.15.60:0/2867315506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0840cd780 0x7fb0840cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.502+0000 7fb089142640 1 -- 172.21.15.60:0/2867315506 >> v2:172.21.15.105:3300/0 conn(0x7fb0840b4d00 msgr2=0x7fb0840b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:23.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.502+0000 7fb089142640 1 --2- 172.21.15.60:0/2867315506 >> v2:172.21.15.105:3300/0 conn(0x7fb0840b4d00 0x7fb0840b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.502+0000 7fb089142640 1 -- 172.21.15.60:0/2867315506 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0840ceab0 con 0x7fb0840b4920 2024-09-12T01:38:23.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.502+0000 7fb089943640 1 --2- 172.21.15.60:0/2867315506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0840cd780 0x7fb0840cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:23.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.502+0000 7fb088941640 1 --2- 172.21.15.60:0/2867315506 >> v2:172.21.15.105:3300/0 conn(0x7fb0840b4d00 0x7fb0840b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:23.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.502+0000 7fb089142640 1 --2- 172.21.15.60:0/2867315506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0840b4920 0x7fb08415b7d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb0840b29e0 tx=0x7fb07c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af59588d6826c275 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.503+0000 7fb083fff640 1 -- 172.21.15.60:0/2867315506 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c037070 con 0x7fb0840b4920 2024-09-12T01:38:23.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.503+0000 7fb083fff640 1 -- 172.21.15.60:0/2867315506 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07c032440 con 0x7fb0840b4920 2024-09-12T01:38:23.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.503+0000 7fb083fff640 1 -- 172.21.15.60:0/2867315506 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c032810 con 0x7fb0840b4920 2024-09-12T01:38:23.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.503+0000 7fb08b3a6640 1 -- 172.21.15.60:0/2867315506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0840b4920 msgr2=0x7fb08415b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.503+0000 7fb08b3a6640 1 --2- 172.21.15.60:0/2867315506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0840b4920 0x7fb08415b7d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb0840b29e0 tx=0x7fb07c02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.503+0000 7fb08b3a6640 1 -- 172.21.15.60:0/2867315506 shutdown_connections 2024-09-12T01:38:23.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.503+0000 7fb08b3a6640 1 --2- 172.21.15.60:0/2867315506 >> v2:172.21.15.105:3300/0 conn(0x7fb0840b4d00 0x7fb0840b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.503+0000 7fb08b3a6640 1 --2- 172.21.15.60:0/2867315506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0840cd780 0x7fb0840cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.503+0000 7fb08b3a6640 1 --2- 172.21.15.60:0/2867315506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0840b4920 0x7fb08415b7d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.503+0000 7fb08b3a6640 1 -- 172.21.15.60:0/2867315506 >> 172.21.15.60:0/2867315506 conn(0x7fb08406bc10 msgr2=0x7fb08406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:23.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.503+0000 7fb08b3a6640 1 -- 172.21.15.60:0/2867315506 shutdown_connections 2024-09-12T01:38:23.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.503+0000 7fb08b3a6640 1 -- 172.21.15.60:0/2867315506 wait complete. 2024-09-12T01:38:23.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.504+0000 7fb08b3a6640 1 Processor -- start 2024-09-12T01:38:23.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.505+0000 7fb08b3a6640 1 -- start start 2024-09-12T01:38:23.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.505+0000 7fb08b3a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0840b4920 0x7fb084072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.505+0000 7fb08b3a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0840b4d00 0x7fb084142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.505+0000 7fb08b3a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0840cd780 0x7fb08414f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.505+0000 7fb08b3a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb08415bd10 con 0x7fb0840cd780 2024-09-12T01:38:23.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.505+0000 7fb08b3a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb0840b56b0 con 0x7fb0840b4d00 2024-09-12T01:38:23.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.505+0000 7fb08b3a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb0840ce110 con 0x7fb0840b4920 2024-09-12T01:38:23.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.505+0000 7fb089943640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0840cd780 0x7fb08414f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.505+0000 7fb089943640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0840cd780 0x7fb08414f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50770/0 (socket says 172.21.15.60:50770) 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.505+0000 7fb089943640 1 -- 172.21.15.60:0/884473130 learned_addr learned my addr 172.21.15.60:0/884473130 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.505+0000 7fb088941640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0840b4d00 0x7fb084142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.505+0000 7fb089142640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0840b4920 0x7fb084072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.506+0000 7fb089943640 1 -- 172.21.15.60:0/884473130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0840b4920 msgr2=0x7fb084072ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.506+0000 7fb089943640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0840b4920 0x7fb084072ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.506+0000 7fb089943640 1 -- 172.21.15.60:0/884473130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0840b4d00 msgr2=0x7fb084142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.506+0000 7fb089943640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0840b4d00 0x7fb084142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.506+0000 7fb089943640 1 -- 172.21.15.60:0/884473130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0841500a0 con 0x7fb0840cd780 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.506+0000 7fb089943640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0840cd780 0x7fb08414f850 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb07400cca0 tx=0x7fb07400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.506+0000 7fb081ffb640 1 -- 172.21.15.60:0/884473130 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07400f680 con 0x7fb0840cd780 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.506+0000 7fb081ffb640 1 -- 172.21.15.60:0/884473130 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb07400f840 con 0x7fb0840cd780 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.506+0000 7fb08b3a6640 1 -- 172.21.15.60:0/884473130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb084150380 con 0x7fb0840cd780 2024-09-12T01:38:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.506+0000 7fb081ffb640 1 -- 172.21.15.60:0/884473130 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07400fc30 con 0x7fb0840cd780 2024-09-12T01:38:23.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.506+0000 7fb08b3a6640 1 -- 172.21.15.60:0/884473130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb084150940 con 0x7fb0840cd780 2024-09-12T01:38:23.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.507+0000 7fb08b3a6640 1 -- 172.21.15.60:0/884473130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0840b5170 con 0x7fb0840cd780 2024-09-12T01:38:23.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.508+0000 7fb081ffb640 1 -- 172.21.15.60:0/884473130 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb0740213f0 con 0x7fb0840cd780 2024-09-12T01:38:23.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.508+0000 7fb081ffb640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb07006be30 0x7fb07006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.508+0000 7fb081ffb640 1 -- 172.21.15.60:0/884473130 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fb07408ba70 con 0x7fb0840cd780 2024-09-12T01:38:23.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.508+0000 7fb089142640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb07006be30 0x7fb07006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.509+0000 7fb089142640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb07006be30 0x7fb07006e2f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb07c034000 tx=0x7fb07c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.513+0000 7fb081ffb640 1 -- 172.21.15.60:0/884473130 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb074014030 con 0x7fb0840cd780 2024-09-12T01:38:23.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.689+0000 7fb08b3a6640 1 -- 172.21.15.60:0/884473130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0840cb7b0 con 0x7fb0840cd780 2024-09-12T01:38:23.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.690+0000 7fb081ffb640 1 -- 172.21.15.60:0/884473130 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16689 (secure 0 0 0) 0x7fb074059d40 con 0x7fb0840cd780 2024-09-12T01:38:23.691 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:23.691 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":57,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:38:13.711142+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:38:09.733918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T01:38:11.059626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:23.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.692+0000 7fb08b3a6640 1 -- 172.21.15.60:0/884473130 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb07006be30 msgr2=0x7fb07006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.692+0000 7fb08b3a6640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb07006be30 0x7fb07006e2f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fb07c034000 tx=0x7fb07c02e000 comp rx=0 tx=0).stop 2024-09-12T01:38:23.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.692+0000 7fb08b3a6640 1 -- 172.21.15.60:0/884473130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0840cd780 msgr2=0x7fb08414f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.692+0000 7fb08b3a6640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0840cd780 0x7fb08414f850 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fb07400cca0 tx=0x7fb07400a650 comp rx=0 tx=0).stop 2024-09-12T01:38:23.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.692+0000 7fb08b3a6640 1 -- 172.21.15.60:0/884473130 shutdown_connections 2024-09-12T01:38:23.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.692+0000 7fb08b3a6640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0840cd780 0x7fb08414f850 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.692+0000 7fb08b3a6640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0840b4d00 0x7fb084142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.692+0000 7fb08b3a6640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb07006be30 0x7fb07006e2f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.692+0000 7fb08b3a6640 1 --2- 172.21.15.60:0/884473130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0840b4920 0x7fb084072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.692+0000 7fb08b3a6640 1 -- 172.21.15.60:0/884473130 >> 172.21.15.60:0/884473130 conn(0x7fb08406bc10 msgr2=0x7fb0840cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:23.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.692+0000 7fb08b3a6640 1 -- 172.21.15.60:0/884473130 shutdown_connections 2024-09-12T01:38:23.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.692+0000 7fb08b3a6640 1 -- 172.21.15.60:0/884473130 wait complete. 2024-09-12T01:38:23.704 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:38:23.704 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:23.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.805+0000 7efdbcc23640 1 Processor -- start 2024-09-12T01:38:23.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.805+0000 7efdbcc23640 1 -- start start 2024-09-12T01:38:23.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.806+0000 7efdbcc23640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efdb80b74c0 0x7efdb815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.806+0000 7efdbcc23640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb815fb10 con 0x7efdb815f030 2024-09-12T01:38:23.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.806+0000 7efdbcc23640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb80b5900 con 0x7efdb815c2b0 2024-09-12T01:38:23.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.806+0000 7efdbcc23640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7efdb815f830 con 0x7efdb80b74c0 2024-09-12T01:38:23.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.807+0000 7efdb5d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efdb80b74c0 0x7efdb815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.807+0000 7efdb6d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efdb815f030 0x7efdb806d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48890/0 (socket says 172.21.15.60:48890) 2024-09-12T01:38:23.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.807+0000 7efdb5d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efdb80b74c0 0x7efdb815eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50786/0 (socket says 172.21.15.60:50786) 2024-09-12T01:38:23.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.807+0000 7efdb6d9d640 1 -- 172.21.15.60:0/429392928 learned_addr learned my addr 172.21.15.60:0/429392928 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:23.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.807+0000 7efdb5d9b640 1 -- 172.21.15.60:0/429392928 >> v1:172.21.15.105:6789/0 conn(0x7efdb815c2b0 legacy=0x7efdb80b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.807+0000 7efdb5d9b640 1 -- 172.21.15.60:0/429392928 >> v1:172.21.15.60:6789/0 conn(0x7efdb815f030 legacy=0x7efdb806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.807+0000 7efdb5d9b640 1 -- 172.21.15.60:0/429392928 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb806ce30 con 0x7efdb80b74c0 2024-09-12T01:38:23.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.807+0000 7efdb559a640 1 -- 172.21.15.60:0/429392928 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3794341796 0 0) 0x7efdb815fb10 con 0x7efdb815f030 2024-09-12T01:38:23.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.808+0000 7efdb5d9b640 1 --2- 172.21.15.60:0/429392928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb80b74c0 0x7efdb815eaf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efda00097a0 tx=0x7efda002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a713414925fbf2ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.808+0000 7efdb559a640 1 -- 172.21.15.60:0/429392928 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda0037070 con 0x7efdb80b74c0 2024-09-12T01:38:23.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.808+0000 7efdb559a640 1 -- 172.21.15.60:0/429392928 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda0032440 con 0x7efdb80b74c0 2024-09-12T01:38:23.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.808+0000 7efdb559a640 1 -- 172.21.15.60:0/429392928 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda0032810 con 0x7efdb80b74c0 2024-09-12T01:38:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.808+0000 7efdbcc23640 1 -- 172.21.15.60:0/429392928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb80b74c0 msgr2=0x7efdb815eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.808+0000 7efdbcc23640 1 --2- 172.21.15.60:0/429392928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb80b74c0 0x7efdb815eaf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efda00097a0 tx=0x7efda002a230 comp rx=0 tx=0).stop 2024-09-12T01:38:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.808+0000 7efdbcc23640 1 -- 172.21.15.60:0/429392928 shutdown_connections 2024-09-12T01:38:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.808+0000 7efdbcc23640 1 --2- 172.21.15.60:0/429392928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb80b74c0 0x7efdb815eaf0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.808+0000 7efdbcc23640 1 -- 172.21.15.60:0/429392928 >> 172.21.15.60:0/429392928 conn(0x7efdb80b4240 msgr2=0x7efdb80b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.808+0000 7efdbcc23640 1 -- 172.21.15.60:0/429392928 shutdown_connections 2024-09-12T01:38:23.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.809+0000 7efdbcc23640 1 -- 172.21.15.60:0/429392928 wait complete. 2024-09-12T01:38:23.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.810+0000 7efdbcc23640 1 Processor -- start 2024-09-12T01:38:23.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.810+0000 7efdbcc23640 1 -- start start 2024-09-12T01:38:23.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdbcc23640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdb80b74c0 0x7efdb8155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdbcc23640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb815c2b0 0x7efdb80cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdbcc23640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdb815f030 0x7efdb8154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdbcc23640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efdb815f480 con 0x7efdb815c2b0 2024-09-12T01:38:23.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdbcc23640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efdb806d3f0 con 0x7efdb80b74c0 2024-09-12T01:38:23.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdbcc23640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efdb80ce260 con 0x7efdb815f030 2024-09-12T01:38:23.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdb5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb815c2b0 0x7efdb80cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdb5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb815c2b0 0x7efdb80cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50796/0 (socket says 172.21.15.60:50796) 2024-09-12T01:38:23.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdb5d9b640 1 -- 172.21.15.60:0/2525605641 learned_addr learned my addr 172.21.15.60:0/2525605641 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:23.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdb6d9d640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdb815f030 0x7efdb8154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdb659c640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdb80b74c0 0x7efdb8155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdb5d9b640 1 -- 172.21.15.60:0/2525605641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdb815f030 msgr2=0x7efdb8154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdb5d9b640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdb815f030 0x7efdb8154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdb5d9b640 1 -- 172.21.15.60:0/2525605641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdb80b74c0 msgr2=0x7efdb8155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:23.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdb5d9b640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdb80b74c0 0x7efdb8155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:23.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdb5d9b640 1 -- 172.21.15.60:0/2525605641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb80ccc80 con 0x7efdb815c2b0 2024-09-12T01:38:23.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdb659c640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdb80b74c0 0x7efdb8155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:23.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdb5d9b640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb815c2b0 0x7efdb80cdd20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efda00098c0 tx=0x7efda00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdaeffd640 1 -- 172.21.15.60:0/2525605641 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda0037040 con 0x7efdb815c2b0 2024-09-12T01:38:23.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdaeffd640 1 -- 172.21.15.60:0/2525605641 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda0042070 con 0x7efdb815c2b0 2024-09-12T01:38:23.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdaeffd640 1 -- 172.21.15.60:0/2525605641 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda0030a70 con 0x7efdb815c2b0 2024-09-12T01:38:23.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdbcc23640 1 -- 172.21.15.60:0/2525605641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb80ccf60 con 0x7efdb815c2b0 2024-09-12T01:38:23.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.811+0000 7efdbcc23640 1 -- 172.21.15.60:0/2525605641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb80cd520 con 0x7efdb815c2b0 2024-09-12T01:38:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.813+0000 7efdbcc23640 1 -- 172.21.15.60:0/2525605641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb80705e0 con 0x7efdb815c2b0 2024-09-12T01:38:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.813+0000 7efdaeffd640 1 -- 172.21.15.60:0/2525605641 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efda0030c10 con 0x7efdb815c2b0 2024-09-12T01:38:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.813+0000 7efdaeffd640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efd9806be30 0x7efd9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.813+0000 7efdaeffd640 1 -- 172.21.15.60:0/2525605641 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7efda00ab810 con 0x7efdb815c2b0 2024-09-12T01:38:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.813+0000 7efdb659c640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efd9806be30 0x7efd9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:23.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.814+0000 7efdb659c640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efd9806be30 0x7efd9806e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efda80012e0 tx=0x7efda8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:23.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:23.818+0000 7efdaeffd640 1 -- 172.21.15.60:0/2525605641 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efdb80705e0 con 0x7efdb815c2b0 2024-09-12T01:38:24.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.028+0000 7efdbcc23640 1 -- 172.21.15.60:0/2525605641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdb815eaf0 con 0x7efdb815c2b0 2024-09-12T01:38:24.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.029+0000 7efdaeffd640 1 -- 172.21.15.60:0/2525605641 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5223 (secure 0 0 0) 0x7efda007a1c0 con 0x7efdb815c2b0 2024-09-12T01:38:24.029 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:24.029 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"btime":"2024-09-12T01:38:16:732986+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3403684617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3403684617},{"type":"v1","addr":"172.21.15.60:6837","nonce":3403684617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/343463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":343463},{"type":"v1","addr":"172.21.15.60:6836","nonce":343463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":34985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2046884414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2046884414},{"type":"v1","addr":"172.21.15.105:6834","nonce":2046884414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:12.079385+0000","modified":"2024-09-12T01:38:16.088710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34988},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34988":{"gid":34988,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/4144770620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4144770620},{"type":"v1","addr":"172.21.15.105:6835","nonce":4144770620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34988,"qdb_cluster":[34988]},"id":4}]} 2024-09-12T01:38:24.030 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 30 2024-09-12T01:38:24.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.031+0000 7efdbcc23640 1 -- 172.21.15.60:0/2525605641 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efd9806be30 msgr2=0x7efd9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.031+0000 7efdbcc23640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efd9806be30 0x7efd9806e2f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efda80012e0 tx=0x7efda8009040 comp rx=0 tx=0).stop 2024-09-12T01:38:24.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.031+0000 7efdbcc23640 1 -- 172.21.15.60:0/2525605641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb815c2b0 msgr2=0x7efdb80cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.031+0000 7efdbcc23640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb815c2b0 0x7efdb80cdd20 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7efda00098c0 tx=0x7efda00046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.031+0000 7efdbcc23640 1 -- 172.21.15.60:0/2525605641 shutdown_connections 2024-09-12T01:38:24.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.031+0000 7efdbcc23640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efd9806be30 0x7efd9806e2f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.031+0000 7efdbcc23640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efdb815f030 0x7efdb8154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.031+0000 7efdbcc23640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efdb815c2b0 0x7efdb80cdd20 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.031+0000 7efdbcc23640 1 --2- 172.21.15.60:0/2525605641 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efdb80b74c0 0x7efdb8155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.031+0000 7efdbcc23640 1 -- 172.21.15.60:0/2525605641 >> 172.21.15.60:0/2525605641 conn(0x7efdb80b4240 msgr2=0x7efdb806d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:24.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.031+0000 7efdbcc23640 1 -- 172.21.15.60:0/2525605641 shutdown_connections 2024-09-12T01:38:24.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.031+0000 7efdbcc23640 1 -- 172.21.15.60:0/2525605641 wait complete. 2024-09-12T01:38:24.042 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:24.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.144+0000 7fd68343c640 1 Processor -- start 2024-09-12T01:38:24.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.144+0000 7fd68343c640 1 -- start start 2024-09-12T01:38:24.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.145+0000 7fd68343c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd67c0b4920 0x7fd67c15b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.145+0000 7fd68343c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c0cd780 0x7fd67c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.145+0000 7fd68343c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd67c0ce4f0 con 0x7fd67c0b4d00 2024-09-12T01:38:24.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.145+0000 7fd68343c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd67c0cf100 con 0x7fd67c0b4920 2024-09-12T01:38:24.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.145+0000 7fd68343c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd67c0ce7d0 con 0x7fd67c0cd780 2024-09-12T01:38:24.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.145+0000 7fd6809d7640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd67c0b4d00 0x7fd67c0b5170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48904/0 (socket says 172.21.15.60:48904) 2024-09-12T01:38:24.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.145+0000 7fd6809d7640 1 -- 172.21.15.60:0/1723449126 learned_addr learned my addr 172.21.15.60:0/1723449126 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:24.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd6811d8640 1 --2- 172.21.15.60:0/1723449126 >> v2:172.21.15.105:3300/0 conn(0x7fd67c0b4920 0x7fd67c15b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd6819d9640 1 --2- 172.21.15.60:0/1723449126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c0cd780 0x7fd67c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3558303399 0 0) 0x7fd67c0ce4f0 con 0x7fd67c0b4d00 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd664003520 con 0x7fd67c0b4d00 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4235835007 0 0) 0x7fd664003520 con 0x7fd67c0b4d00 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c0cd780 msgr2=0x7fd67c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 --2- 172.21.15.60:0/1723449126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c0cd780 0x7fd67c0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 >> v2:172.21.15.105:3300/0 conn(0x7fd67c0b4920 msgr2=0x7fd67c15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 --2- 172.21.15.60:0/1723449126 >> v2:172.21.15.105:3300/0 conn(0x7fd67c0b4920 0x7fd67c15b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c0ceab0 con 0x7fd67c0b4d00 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fd670001670 con 0x7fd67c0b4d00 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 >> v1:172.21.15.60:6789/0 conn(0x7fd67c0b4d00 legacy=0x7fd67c0b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 --2- 172.21.15.60:0/1723449126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c0cd780 0x7fd6640039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 --2- 172.21.15.60:0/1723449126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd664003f30 0x7fd664004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 --2- 172.21.15.60:0/1723449126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd664004d40 0x7fd6640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c0cf100 con 0x7fd664004d40 2024-09-12T01:38:24.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c0ce7d0 con 0x7fd664003f30 2024-09-12T01:38:24.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd66400b9c0 con 0x7fd67c0cd780 2024-09-12T01:38:24.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd6819d9640 1 --2- 172.21.15.60:0/1723449126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd664004d40 0x7fd6640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd6811d8640 1 --2- 172.21.15.60:0/1723449126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c0cd780 0x7fd6640039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd6809d7640 1 --2- 172.21.15.60:0/1723449126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd664003f30 0x7fd664004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd6819d9640 1 -- 172.21.15.60:0/1723449126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c0cd780 msgr2=0x7fd6640039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:24.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd6819d9640 1 --2- 172.21.15.60:0/1723449126 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c0cd780 0x7fd6640039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd6819d9640 1 -- 172.21.15.60:0/1723449126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd664003f30 msgr2=0x7fd664004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:24.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd6819d9640 1 --2- 172.21.15.60:0/1723449126 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd664003f30 0x7fd664004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.146+0000 7fd6819d9640 1 -- 172.21.15.60:0/1723449126 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd664003520 con 0x7fd664004d40 2024-09-12T01:38:24.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.147+0000 7fd6819d9640 1 --2- 172.21.15.60:0/1723449126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd664004d40 0x7fd6640051c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd674009ac0 tx=0x7fd664005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92133bd41165c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:24.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.147+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674036070 con 0x7fd664004d40 2024-09-12T01:38:24.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.147+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd674031400 con 0x7fd664004d40 2024-09-12T01:38:24.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.147+0000 7fd67bfff640 1 -- 172.21.15.60:0/1723449126 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd674009690 con 0x7fd664004d40 2024-09-12T01:38:24.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.148+0000 7fd68343c640 1 -- 172.21.15.60:0/1723449126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd664004d40 msgr2=0x7fd6640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.148+0000 7fd68343c640 1 --2- 172.21.15.60:0/1723449126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd664004d40 0x7fd6640051c0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd674009ac0 tx=0x7fd664005830 comp rx=0 tx=0).stop 2024-09-12T01:38:24.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.148+0000 7fd6819d9640 1 -- 172.21.15.60:0/1723449126 reap_dead start 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.148+0000 7fd68343c640 1 -- 172.21.15.60:0/1723449126 shutdown_connections 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.148+0000 7fd68343c640 1 -- 172.21.15.60:0/1723449126 >> 172.21.15.60:0/1723449126 conn(0x7fd67c06bc10 msgr2=0x7fd67c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.148+0000 7fd68343c640 1 -- 172.21.15.60:0/1723449126 shutdown_connections 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.148+0000 7fd68343c640 1 -- 172.21.15.60:0/1723449126 wait complete. 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.149+0000 7fd68343c640 1 Processor -- start 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.149+0000 7fd68343c640 1 -- start start 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd68343c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c1f3490 0x7fd67c1f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd68343c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd67c1589f0 0x7fd67c1595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd68343c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd67c1536c0 0x7fd67c159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd68343c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c0cdbd0 con 0x7fd67c1589f0 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd68343c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c15bd10 con 0x7fd67c1536c0 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd68343c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd67c0cdd50 con 0x7fd67c1f3490 2024-09-12T01:38:24.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd6809d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd67c1589f0 0x7fd67c1595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd6809d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd67c1589f0 0x7fd67c1595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50810/0 (socket says 172.21.15.60:50810) 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd6809d7640 1 -- 172.21.15.60:0/1345973548 learned_addr learned my addr 172.21.15.60:0/1345973548 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd6811d8640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c1f3490 0x7fd67c1f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd6819d9640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd67c1536c0 0x7fd67c159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd6809d7640 1 -- 172.21.15.60:0/1345973548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c1f3490 msgr2=0x7fd67c1f1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd6809d7640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c1f3490 0x7fd67c1f1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd6809d7640 1 -- 172.21.15.60:0/1345973548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd67c1536c0 msgr2=0x7fd67c159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.150+0000 7fd6809d7640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd67c1536c0 0x7fd67c159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.151+0000 7fd6809d7640 1 -- 172.21.15.60:0/1345973548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c150c30 con 0x7fd67c1589f0 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.151+0000 7fd6819d9640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd67c1536c0 0x7fd67c159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.151+0000 7fd6809d7640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd67c1589f0 0x7fd67c1595b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd6700072c0 tx=0x7fd670007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.151+0000 7fd679ffb640 1 -- 172.21.15.60:0/1345973548 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67000f9c0 con 0x7fd67c1589f0 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.151+0000 7fd679ffb640 1 -- 172.21.15.60:0/1345973548 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd670018070 con 0x7fd67c1589f0 2024-09-12T01:38:24.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.151+0000 7fd68343c640 1 -- 172.21.15.60:0/1345973548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67c150f10 con 0x7fd67c1589f0 2024-09-12T01:38:24.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.151+0000 7fd679ffb640 1 -- 172.21.15.60:0/1345973548 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67000fdc0 con 0x7fd67c1589f0 2024-09-12T01:38:24.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.151+0000 7fd68343c640 1 -- 172.21.15.60:0/1345973548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67c157b00 con 0x7fd67c1589f0 2024-09-12T01:38:24.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.152+0000 7fd68343c640 1 -- 172.21.15.60:0/1345973548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67c0ce130 con 0x7fd67c1589f0 2024-09-12T01:38:24.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.152+0000 7fd679ffb640 1 -- 172.21.15.60:0/1345973548 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd67001d460 con 0x7fd67c1589f0 2024-09-12T01:38:24.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.153+0000 7fd679ffb640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd66806be30 0x7fd66806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.153+0000 7fd679ffb640 1 -- 172.21.15.60:0/1345973548 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fd67008aef0 con 0x7fd67c1589f0 2024-09-12T01:38:24.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.153+0000 7fd6811d8640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd66806be30 0x7fd66806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.153+0000 7fd6811d8640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd66806be30 0x7fd66806e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd66c014510 tx=0x7fd66c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:24.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.157+0000 7fd679ffb640 1 -- 172.21.15.60:0/1345973548 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd670059930 con 0x7fd67c1589f0 2024-09-12T01:38:24.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.368+0000 7fd68343c640 1 -- 172.21.15.60:0/1345973548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd67c06f190 con 0x7fd67c1589f0 2024-09-12T01:38:24.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.368+0000 7fd679ffb640 1 -- 172.21.15.60:0/1345973548 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+5223 (secure 0 0 0) 0x7fd670059230 con 0x7fd67c1589f0 2024-09-12T01:38:24.369 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:24.369 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"btime":"2024-09-12T01:38:16:732986+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3403684617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3403684617},{"type":"v1","addr":"172.21.15.60:6837","nonce":3403684617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/343463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":343463},{"type":"v1","addr":"172.21.15.60:6836","nonce":343463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":34985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2046884414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2046884414},{"type":"v1","addr":"172.21.15.105:6834","nonce":2046884414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:12.079385+0000","modified":"2024-09-12T01:38:16.088710+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34988},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34988":{"gid":34988,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/4144770620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4144770620},{"type":"v1","addr":"172.21.15.105:6835","nonce":4144770620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34988,"qdb_cluster":[34988]},"id":4}]} 2024-09-12T01:38:24.370 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 30 2024-09-12T01:38:24.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.370+0000 7fd68343c640 1 -- 172.21.15.60:0/1345973548 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd66806be30 msgr2=0x7fd66806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.370+0000 7fd68343c640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd66806be30 0x7fd66806e2f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd66c014510 tx=0x7fd66c00b040 comp rx=0 tx=0).stop 2024-09-12T01:38:24.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.370+0000 7fd68343c640 1 -- 172.21.15.60:0/1345973548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd67c1589f0 msgr2=0x7fd67c1595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.370+0000 7fd68343c640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd67c1589f0 0x7fd67c1595b0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd6700072c0 tx=0x7fd670007780 comp rx=0 tx=0).stop 2024-09-12T01:38:24.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.370+0000 7fd68343c640 1 -- 172.21.15.60:0/1345973548 shutdown_connections 2024-09-12T01:38:24.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.370+0000 7fd68343c640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd67c1536c0 0x7fd67c159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.370+0000 7fd68343c640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd67c1589f0 0x7fd67c1595b0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.370+0000 7fd68343c640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd66806be30 0x7fd66806e2f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.370+0000 7fd68343c640 1 --2- 172.21.15.60:0/1345973548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd67c1f3490 0x7fd67c1f1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.370+0000 7fd68343c640 1 -- 172.21.15.60:0/1345973548 >> 172.21.15.60:0/1345973548 conn(0x7fd67c06bc10 msgr2=0x7fd67c0b5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:24.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.370+0000 7fd68343c640 1 -- 172.21.15.60:0/1345973548 shutdown_connections 2024-09-12T01:38:24.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.371+0000 7fd68343c640 1 -- 172.21.15.60:0/1345973548 wait complete. 2024-09-12T01:38:24.381 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:24.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.484+0000 7f79a2952640 1 Processor -- start 2024-09-12T01:38:24.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.484+0000 7f79a2952640 1 -- start start 2024-09-12T01:38:24.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.484+0000 7f79a2952640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f799c15e660 0x7f799c0cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.484+0000 7f79a2952640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f799c0d1820 0x7f799c0b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.484+0000 7f79a2952640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f799c15ea40 con 0x7f799c0d3310 2024-09-12T01:38:24.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.484+0000 7f79a2952640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f799c0d3870 con 0x7f799c15e660 2024-09-12T01:38:24.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.484+0000 7f79a2952640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f799c0d3b50 con 0x7f799c0d1820 2024-09-12T01:38:24.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.485+0000 7f79a0eef640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f799c0d1820 0x7f799c0b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.485+0000 7f79a0eef640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f799c0d1820 0x7f799c0b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:60656/0 (socket says 172.21.15.60:60656) 2024-09-12T01:38:24.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.485+0000 7f79a0eef640 1 -- 172.21.15.60:0/3711601190 learned_addr learned my addr 172.21.15.60:0/3711601190 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:24.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.485+0000 7f799b7fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f799c0d3310 0x7f799c0d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:35980/0 (socket says 172.21.15.60:35980) 2024-09-12T01:38:24.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.485+0000 7f799bfff640 1 --2- 172.21.15.60:0/3711601190 >> v2:172.21.15.105:3300/0 conn(0x7f799c15e660 0x7f799c0cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.485+0000 7f79a0eef640 1 -- 172.21.15.60:0/3711601190 >> v2:172.21.15.105:3300/0 conn(0x7f799c15e660 msgr2=0x7f799c0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:24.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.485+0000 7f79a0eef640 1 --2- 172.21.15.60:0/3711601190 >> v2:172.21.15.105:3300/0 conn(0x7f799c15e660 0x7f799c0cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.485+0000 7f79a0eef640 1 -- 172.21.15.60:0/3711601190 >> v1:172.21.15.105:6789/0 conn(0x7f799c0d3310 legacy=0x7f799c0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.485+0000 7f79a0eef640 1 -- 172.21.15.60:0/3711601190 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799c0d3e30 con 0x7f799c0d1820 2024-09-12T01:38:24.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.486+0000 7f79a0eef640 1 --2- 172.21.15.60:0/3711601190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f799c0d1820 0x7f799c0b7b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7994009e50 tx=0x7f799402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=765d51a277c18221 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:24.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.486+0000 7f799affd640 1 -- 172.21.15.60:0/3711601190 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994036070 con 0x7f799c0d1820 2024-09-12T01:38:24.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.486+0000 7f799affd640 1 -- 172.21.15.60:0/3711601190 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7994031600 con 0x7f799c0d1820 2024-09-12T01:38:24.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.486+0000 7f799affd640 1 -- 172.21.15.60:0/3711601190 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79940319d0 con 0x7f799c0d1820 2024-09-12T01:38:24.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.487+0000 7f79a2952640 1 -- 172.21.15.60:0/3711601190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f799c0d1820 msgr2=0x7f799c0b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.487+0000 7f79a2952640 1 --2- 172.21.15.60:0/3711601190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f799c0d1820 0x7f799c0b7b70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7994009e50 tx=0x7f799402a710 comp rx=0 tx=0).stop 2024-09-12T01:38:24.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.487+0000 7f79a2952640 1 -- 172.21.15.60:0/3711601190 shutdown_connections 2024-09-12T01:38:24.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.487+0000 7f79a2952640 1 --2- 172.21.15.60:0/3711601190 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f799c0d1820 0x7f799c0b7b70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.487+0000 7f79a2952640 1 --2- 172.21.15.60:0/3711601190 >> v2:172.21.15.105:3300/0 conn(0x7f799c15e660 0x7f799c0cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.487+0000 7f79a2952640 1 -- 172.21.15.60:0/3711601190 >> 172.21.15.60:0/3711601190 conn(0x7f799c0b6410 msgr2=0x7f799c0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:24.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.487+0000 7f79a2952640 1 -- 172.21.15.60:0/3711601190 shutdown_connections 2024-09-12T01:38:24.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.487+0000 7f79a2952640 1 -- 172.21.15.60:0/3711601190 wait complete. 2024-09-12T01:38:24.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.488+0000 7f79a2952640 1 Processor -- start 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.488+0000 7f79a2952640 1 -- start start 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a2952640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f799c0d1820 0x7f799c1616c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a2952640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f799c0d3310 0x7f799c14fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a2952640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f799c15e660 0x7f799c157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a2952640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f799c0cfc70 con 0x7f799c15e660 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a2952640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f799c0d43f0 con 0x7f799c0d3310 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a2952640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f799c0b80b0 con 0x7f799c0d1820 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a0eef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f799c15e660 0x7f799c157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a0eef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f799c15e660 0x7f799c157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50824/0 (socket says 172.21.15.60:50824) 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f799bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f799c0d1820 0x7f799c1616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a0eef640 1 -- 172.21.15.60:0/3737011284 learned_addr learned my addr 172.21.15.60:0/3737011284 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f799b7fe640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f799c0d3310 0x7f799c14fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a0eef640 1 -- 172.21.15.60:0/3737011284 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f799c0d1820 msgr2=0x7f799c1616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a0eef640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f799c0d1820 0x7f799c1616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a0eef640 1 -- 172.21.15.60:0/3737011284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f799c0d3310 msgr2=0x7f799c14fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a0eef640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f799c0d3310 0x7f799c14fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.489+0000 7f79a0eef640 1 -- 172.21.15.60:0/3737011284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f799c160900 con 0x7f799c15e660 2024-09-12T01:38:24.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.490+0000 7f79a0eef640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f799c15e660 0x7f799c157f50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7994009f70 tx=0x7f7994004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:24.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.490+0000 7f7998ff9640 1 -- 172.21.15.60:0/3737011284 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799403f020 con 0x7f799c15e660 2024-09-12T01:38:24.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.490+0000 7f7998ff9640 1 -- 172.21.15.60:0/3737011284 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7994037040 con 0x7f799c15e660 2024-09-12T01:38:24.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.490+0000 7f7998ff9640 1 -- 172.21.15.60:0/3737011284 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994036070 con 0x7f799c15e660 2024-09-12T01:38:24.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.490+0000 7f79a2952640 1 -- 172.21.15.60:0/3737011284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f799c160be0 con 0x7f799c15e660 2024-09-12T01:38:24.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.490+0000 7f79a2952640 1 -- 172.21.15.60:0/3737011284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f799c1611a0 con 0x7f799c15e660 2024-09-12T01:38:24.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.491+0000 7f79a2952640 1 -- 172.21.15.60:0/3737011284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f799c0b7b70 con 0x7f799c15e660 2024-09-12T01:38:24.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.491+0000 7f7998ff9640 1 -- 172.21.15.60:0/3737011284 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7994042020 con 0x7f799c15e660 2024-09-12T01:38:24.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.492+0000 7f7998ff9640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f798806be30 0x7f798806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.492+0000 7f7998ff9640 1 -- 172.21.15.60:0/3737011284 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f79940ab040 con 0x7f799c15e660 2024-09-12T01:38:24.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.492+0000 7f799bfff640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f798806be30 0x7f798806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.492+0000 7f799bfff640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f798806be30 0x7f798806e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f798c009aa0 tx=0x7f798c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:24.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.496+0000 7f7998ff9640 1 -- 172.21.15.60:0/3737011284 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7994049030 con 0x7f799c15e660 2024-09-12T01:38:24.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.670+0000 7f79a2952640 1 -- 172.21.15.60:0/3737011284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f799c161370 con 0x7f799c15e660 2024-09-12T01:38:24.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.671+0000 7f7998ff9640 1 -- 172.21.15.60:0/3737011284 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16689 (secure 0 0 0) 0x7f7994079430 con 0x7f799c15e660 2024-09-12T01:38:24.672 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:24.672 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":57,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:38:13.711142+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:38:09.733918+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-12T01:38:11.059626+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.673+0000 7f79a2952640 1 -- 172.21.15.60:0/3737011284 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f798806be30 msgr2=0x7f798806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.673+0000 7f79a2952640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f798806be30 0x7f798806e2f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f798c009aa0 tx=0x7f798c009190 comp rx=0 tx=0).stop 2024-09-12T01:38:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.673+0000 7f79a2952640 1 -- 172.21.15.60:0/3737011284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f799c15e660 msgr2=0x7f799c157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.673+0000 7f79a2952640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f799c15e660 0x7f799c157f50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7994009f70 tx=0x7f7994004a40 comp rx=0 tx=0).stop 2024-09-12T01:38:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.673+0000 7f79a2952640 1 -- 172.21.15.60:0/3737011284 shutdown_connections 2024-09-12T01:38:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.673+0000 7f79a2952640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f799c15e660 0x7f799c157f50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.674+0000 7f79a2952640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f799c0d3310 0x7f799c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.674+0000 7f79a2952640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f798806be30 0x7f798806e2f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.674+0000 7f79a2952640 1 --2- 172.21.15.60:0/3737011284 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f799c0d1820 0x7f799c1616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.674+0000 7f79a2952640 1 -- 172.21.15.60:0/3737011284 >> 172.21.15.60:0/3737011284 conn(0x7f799c0b6410 msgr2=0x7f799c0d0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.674+0000 7f79a2952640 1 -- 172.21.15.60:0/3737011284 shutdown_connections 2024-09-12T01:38:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.674+0000 7f79a2952640 1 -- 172.21.15.60:0/3737011284 wait complete. 2024-09-12T01:38:24.685 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:38:24.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.789+0000 7fbbcb39f640 1 Processor -- start 2024-09-12T01:38:24.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.789+0000 7fbbcb39f640 1 -- start start 2024-09-12T01:38:24.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.790+0000 7fbbcb39f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbbc415e940 0x7fbbc40b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.790+0000 7fbbcb39f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbc40ba440 0x7fbbc40b6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.790+0000 7fbbcb39f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbbc40d2290 0x7fbbc40cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.790+0000 7fbbcb39f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc40d3ef0 con 0x7fbbc415e940 2024-09-12T01:38:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.790+0000 7fbbcb39f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc415ed20 con 0x7fbbc40d2290 2024-09-12T01:38:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.790+0000 7fbbcb39f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc40d32e0 con 0x7fbbc40ba440 2024-09-12T01:38:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.790+0000 7fbbc913b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbbc415e940 0x7fbbc40b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.790+0000 7fbbc913b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbbc415e940 0x7fbbc40b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50830/0 (socket says 172.21.15.60:50830) 2024-09-12T01:38:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.791+0000 7fbbc913b640 1 -- 172.21.15.60:0/2269827198 learned_addr learned my addr 172.21.15.60:0/2269827198 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.791+0000 7fbbc893a640 1 --2- 172.21.15.60:0/2269827198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbc40ba440 0x7fbbc40b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.791+0000 7fbbc993c640 1 --2- 172.21.15.60:0/2269827198 >> v2:172.21.15.105:3300/0 conn(0x7fbbc40d2290 0x7fbbc40cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.791+0000 7fbbc913b640 1 -- 172.21.15.60:0/2269827198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbc40ba440 msgr2=0x7fbbc40b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.791+0000 7fbbc913b640 1 --2- 172.21.15.60:0/2269827198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbc40ba440 0x7fbbc40b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.791+0000 7fbbc913b640 1 -- 172.21.15.60:0/2269827198 >> v2:172.21.15.105:3300/0 conn(0x7fbbc40d2290 msgr2=0x7fbbc40cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.791+0000 7fbbc913b640 1 --2- 172.21.15.60:0/2269827198 >> v2:172.21.15.105:3300/0 conn(0x7fbbc40d2290 0x7fbbc40cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.791+0000 7fbbc913b640 1 -- 172.21.15.60:0/2269827198 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc40d35c0 con 0x7fbbc415e940 2024-09-12T01:38:24.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.791+0000 7fbbc993c640 1 --2- 172.21.15.60:0/2269827198 >> v2:172.21.15.105:3300/0 conn(0x7fbbc40d2290 0x7fbbc40cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbc913b640 1 --2- 172.21.15.60:0/2269827198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbc415e940 0x7fbbc40b6140 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40d2110 tx=0x7fbbbc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e790d47c100aee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbc3fff640 1 -- 172.21.15.60:0/2269827198 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc037070 con 0x7fbbc415e940 2024-09-12T01:38:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbc3fff640 1 -- 172.21.15.60:0/2269827198 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbbc032440 con 0x7fbbc415e940 2024-09-12T01:38:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbc3fff640 1 -- 172.21.15.60:0/2269827198 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc032810 con 0x7fbbc415e940 2024-09-12T01:38:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbcb39f640 1 -- 172.21.15.60:0/2269827198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbc415e940 msgr2=0x7fbbc40b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbcb39f640 1 --2- 172.21.15.60:0/2269827198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbc415e940 0x7fbbc40b6140 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40d2110 tx=0x7fbbbc02a140 comp rx=0 tx=0).stop 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbcb39f640 1 -- 172.21.15.60:0/2269827198 shutdown_connections 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbcb39f640 1 --2- 172.21.15.60:0/2269827198 >> v2:172.21.15.105:3300/0 conn(0x7fbbc40d2290 0x7fbbc40cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbcb39f640 1 --2- 172.21.15.60:0/2269827198 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbc40ba440 0x7fbbc40b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbcb39f640 1 --2- 172.21.15.60:0/2269827198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbc415e940 0x7fbbc40b6140 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbcb39f640 1 -- 172.21.15.60:0/2269827198 >> 172.21.15.60:0/2269827198 conn(0x7fbbc40d1140 msgr2=0x7fbbc40d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbcb39f640 1 -- 172.21.15.60:0/2269827198 shutdown_connections 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.792+0000 7fbbcb39f640 1 -- 172.21.15.60:0/2269827198 wait complete. 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.794+0000 7fbbcb39f640 1 Processor -- start 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.794+0000 7fbbcb39f640 1 -- start start 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.794+0000 7fbbcb39f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbc40ba440 0x7fbbc41f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.794+0000 7fbbcb39f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbc40d2290 0x7fbbc40c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.794+0000 7fbbcb39f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbc415e940 0x7fbbc4160f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.794+0000 7fbbcb39f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc40b7510 con 0x7fbbc40ba440 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.794+0000 7fbbcb39f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc40d3b80 con 0x7fbbc40d2290 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.794+0000 7fbbcb39f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc40cf460 con 0x7fbbc415e940 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.794+0000 7fbbc913b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbc40ba440 0x7fbbc41f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc913b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbc40ba440 0x7fbbc41f3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50834/0 (socket says 172.21.15.60:50834) 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc913b640 1 -- 172.21.15.60:0/3732772292 learned_addr learned my addr 172.21.15.60:0/3732772292 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc993c640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbc415e940 0x7fbbc4160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc893a640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbc40d2290 0x7fbbc40c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc913b640 1 -- 172.21.15.60:0/3732772292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbc415e940 msgr2=0x7fbbc4160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc913b640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbc415e940 0x7fbbc4160f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc913b640 1 -- 172.21.15.60:0/3732772292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbc40d2290 msgr2=0x7fbbc40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc913b640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbc40d2290 0x7fbbc40c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc913b640 1 -- 172.21.15.60:0/3732772292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc40ce8e0 con 0x7fbbc40ba440 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc893a640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbc40d2290 0x7fbbc40c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc913b640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbc40ba440 0x7fbbc41f3a50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc02a180 tx=0x7fbbbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc1ffb640 1 -- 172.21.15.60:0/3732772292 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc037040 con 0x7fbbc40ba440 2024-09-12T01:38:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc1ffb640 1 -- 172.21.15.60:0/3732772292 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbbc042070 con 0x7fbbc40ba440 2024-09-12T01:38:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbcb39f640 1 -- 172.21.15.60:0/3732772292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc40cc720 con 0x7fbbc40ba440 2024-09-12T01:38:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbc1ffb640 1 -- 172.21.15.60:0/3732772292 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc030880 con 0x7fbbc40ba440 2024-09-12T01:38:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.795+0000 7fbbcb39f640 1 -- 172.21.15.60:0/3732772292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc40ccce0 con 0x7fbbc40ba440 2024-09-12T01:38:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.796+0000 7fbbcb39f640 1 -- 172.21.15.60:0/3732772292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc40b5550 con 0x7fbbc40ba440 2024-09-12T01:38:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.797+0000 7fbbc1ffb640 1 -- 172.21.15.60:0/3732772292 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbbbc030a20 con 0x7fbbc40ba440 2024-09-12T01:38:24.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.797+0000 7fbbc1ffb640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbbb006be30 0x7fbbb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:24.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.797+0000 7fbbc1ffb640 1 -- 172.21.15.60:0/3732772292 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fbbbc0ab6a0 con 0x7fbbc40ba440 2024-09-12T01:38:24.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.797+0000 7fbbc893a640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbbb006be30 0x7fbbb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:24.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.798+0000 7fbbc893a640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbbb006be30 0x7fbbb006e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40b9490 tx=0x7fbbb8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:24.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:24.802+0000 7fbbc1ffb640 1 -- 172.21.15.60:0/3732772292 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbbc40b5550 con 0x7fbbc40ba440 2024-09-12T01:38:25.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.012+0000 7fbbcb39f640 1 -- 172.21.15.60:0/3732772292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbbc40cef20 con 0x7fbbc40ba440 2024-09-12T01:38:25.012 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-12T01:38:25.012+0000 7f58b98dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:38:25.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.013+0000 7fbbc1ffb640 1 -- 172.21.15.60:0/3732772292 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) ==== 161+0+0 (secure 0 0 0) 0x7fbbc40ce8e0 con 0x7fbbc40ba440 2024-09-12T01:38:25.014 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:38:25.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.016+0000 7fbbcb39f640 1 -- 172.21.15.60:0/3732772292 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbbb006be30 msgr2=0x7fbbb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.016+0000 7fbbcb39f640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbbb006be30 0x7fbbb006e2f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40b9490 tx=0x7fbbb8008040 comp rx=0 tx=0).stop 2024-09-12T01:38:25.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.016+0000 7fbbcb39f640 1 -- 172.21.15.60:0/3732772292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbc40ba440 msgr2=0x7fbbc41f3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.016+0000 7fbbcb39f640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbc40ba440 0x7fbbc41f3a50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc02a180 tx=0x7fbbbc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.016+0000 7fbbcb39f640 1 -- 172.21.15.60:0/3732772292 shutdown_connections 2024-09-12T01:38:25.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.016+0000 7fbbcb39f640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbbb006be30 0x7fbbb006e2f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.016+0000 7fbbcb39f640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbbc415e940 0x7fbbc4160f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.016+0000 7fbbcb39f640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbbc40d2290 0x7fbbc40c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.016+0000 7fbbcb39f640 1 --2- 172.21.15.60:0/3732772292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbc40ba440 0x7fbbc41f3a50 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.016+0000 7fbbcb39f640 1 -- 172.21.15.60:0/3732772292 >> 172.21.15.60:0/3732772292 conn(0x7fbbc40d1140 msgr2=0x7fbbc40b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:25.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.016+0000 7fbbcb39f640 1 -- 172.21.15.60:0/3732772292 shutdown_connections 2024-09-12T01:38:25.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.016+0000 7fbbcb39f640 1 -- 172.21.15.60:0/3732772292 wait complete. 2024-09-12T01:38:25.019 INFO:tasks.ceph.mds.b.smithi105.stderr: -2118> 2024-09-12T01:38:14.702+0000 7fe3e6e0e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:38:25.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:38:25.048 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:38:25.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.132+0000 7f684bfff640 1 Processor -- start 2024-09-12T01:38:25.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.132+0000 7f684bfff640 1 -- start start 2024-09-12T01:38:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.133+0000 7f684bfff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f684c15e5f0 0x7f684c0d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.133+0000 7f684bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f684c0b8900 0x7f684c0d2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.133+0000 7f684bfff640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f684c15e9d0 con 0x7f684c0d13c0 2024-09-12T01:38:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.133+0000 7f684bfff640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f684c0b9b30 con 0x7f684c15e5f0 2024-09-12T01:38:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.133+0000 7f684bfff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f684c0b8f20 con 0x7f684c0b8900 2024-09-12T01:38:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.134+0000 7f684b7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f684c0b8900 0x7f684c0d2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.134+0000 7f684b7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f684c0b8900 0x7f684c0d2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:60692/0 (socket says 172.21.15.60:60692) 2024-09-12T01:38:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.134+0000 7f684b7fe640 1 -- 172.21.15.60:0/549463118 learned_addr learned my addr 172.21.15.60:0/549463118 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:25.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.134+0000 7f684affd640 1 --2- 172.21.15.60:0/549463118 >> v2:172.21.15.105:3300/0 conn(0x7f684c15e5f0 0x7f684c0d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.134+0000 7f684b7fe640 1 -- 172.21.15.60:0/549463118 >> v2:172.21.15.105:3300/0 conn(0x7f684c15e5f0 msgr2=0x7f684c0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:25.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.134+0000 7f684b7fe640 1 --2- 172.21.15.60:0/549463118 >> v2:172.21.15.105:3300/0 conn(0x7f684c15e5f0 0x7f684c0d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.134+0000 7f684b7fe640 1 -- 172.21.15.60:0/549463118 >> v1:172.21.15.105:6789/0 conn(0x7f684c0d13c0 legacy=0x7f684c0b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.134+0000 7f6849ffb640 1 -- 172.21.15.60:0/549463118 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3129525965 0 0) 0x7f684c15e9d0 con 0x7f684c0d13c0 2024-09-12T01:38:25.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.134+0000 7f684b7fe640 1 -- 172.21.15.60:0/549463118 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684c0b9200 con 0x7f684c0b8900 2024-09-12T01:38:25.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.135+0000 7f684b7fe640 1 --2- 172.21.15.60:0/549463118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f684c0b8900 0x7f684c0d2bc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6844009e50 tx=0x7f684402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=934f400822aefcf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:25.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.135+0000 7f6849ffb640 1 -- 172.21.15.60:0/549463118 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6844036070 con 0x7f684c0b8900 2024-09-12T01:38:25.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.135+0000 7f6849ffb640 1 -- 172.21.15.60:0/549463118 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6844031600 con 0x7f684c0b8900 2024-09-12T01:38:25.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.135+0000 7f6849ffb640 1 -- 172.21.15.60:0/549463118 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68440319d0 con 0x7f684c0b8900 2024-09-12T01:38:25.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.135+0000 7f684bfff640 1 -- 172.21.15.60:0/549463118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f684c0b8900 msgr2=0x7f684c0d2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.135+0000 7f684bfff640 1 --2- 172.21.15.60:0/549463118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f684c0b8900 0x7f684c0d2bc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6844009e50 tx=0x7f684402a710 comp rx=0 tx=0).stop 2024-09-12T01:38:25.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.136+0000 7f684bfff640 1 -- 172.21.15.60:0/549463118 shutdown_connections 2024-09-12T01:38:25.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.136+0000 7f684bfff640 1 --2- 172.21.15.60:0/549463118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f684c0b8900 0x7f684c0d2bc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.136+0000 7f684bfff640 1 --2- 172.21.15.60:0/549463118 >> v2:172.21.15.105:3300/0 conn(0x7f684c15e5f0 0x7f684c0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.136+0000 7f684bfff640 1 -- 172.21.15.60:0/549463118 >> 172.21.15.60:0/549463118 conn(0x7f684c062630 msgr2=0x7f684c062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:25.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.136+0000 7f684bfff640 1 -- 172.21.15.60:0/549463118 shutdown_connections 2024-09-12T01:38:25.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.136+0000 7f684bfff640 1 -- 172.21.15.60:0/549463118 wait complete. 2024-09-12T01:38:25.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.137+0000 7f684bfff640 1 Processor -- start 2024-09-12T01:38:25.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.137+0000 7f684bfff640 1 -- start start 2024-09-12T01:38:25.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f684c0b8900 0x7f684c0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f684c0d13c0 0x7f684c0cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684bfff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c15e5f0 0x7f684c152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684bfff640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f684c0d3100 con 0x7f684c0b8900 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684bfff640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f684c0b97c0 con 0x7f684c15e5f0 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684bfff640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f684c0d3280 con 0x7f684c0d13c0 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f684c0b8900 0x7f684c0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f684c0b8900 0x7f684c0cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50840/0 (socket says 172.21.15.60:50840) 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684affd640 1 -- 172.21.15.60:0/2193526363 learned_addr learned my addr 172.21.15.60:0/2193526363 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684b7fe640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c15e5f0 0x7f684c152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684a7fc640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f684c0d13c0 0x7f684c0cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684affd640 1 -- 172.21.15.60:0/2193526363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f684c0d13c0 msgr2=0x7f684c0cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684affd640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f684c0d13c0 0x7f684c0cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684affd640 1 -- 172.21.15.60:0/2193526363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c15e5f0 msgr2=0x7f684c152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684affd640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c15e5f0 0x7f684c152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:25.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684affd640 1 -- 172.21.15.60:0/2193526363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684c0cd510 con 0x7f684c0b8900 2024-09-12T01:38:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684b7fe640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c15e5f0 0x7f684c152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.138+0000 7f684affd640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f684c0b8900 0x7f684c0cdae0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f683c00e870 tx=0x7f683c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.139+0000 7f68337fe640 1 -- 172.21.15.60:0/2193526363 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c017070 con 0x7f684c0b8900 2024-09-12T01:38:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.139+0000 7f68337fe640 1 -- 172.21.15.60:0/2193526363 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f683c00c940 con 0x7f684c0b8900 2024-09-12T01:38:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.139+0000 7f684bfff640 1 -- 172.21.15.60:0/2193526363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684c0cb670 con 0x7f684c0b8900 2024-09-12T01:38:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.139+0000 7f68337fe640 1 -- 172.21.15.60:0/2193526363 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c00cd30 con 0x7f684c0b8900 2024-09-12T01:38:25.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.139+0000 7f684bfff640 1 -- 172.21.15.60:0/2193526363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f684c0cd150 con 0x7f684c0b8900 2024-09-12T01:38:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.140+0000 7f684bfff640 1 -- 172.21.15.60:0/2193526363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f684c069c20 con 0x7f684c0b8900 2024-09-12T01:38:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.140+0000 7f68337fe640 1 -- 172.21.15.60:0/2193526363 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f683c01a070 con 0x7f684c0b8900 2024-09-12T01:38:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.141+0000 7f68337fe640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f683806be30 0x7f683806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.141+0000 7f68337fe640 1 -- 172.21.15.60:0/2193526363 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5795+0+0 (secure 0 0 0) 0x7f683c08b050 con 0x7f684c0b8900 2024-09-12T01:38:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.141+0000 7f684a7fc640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f683806be30 0x7f683806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:25.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.141+0000 7f684a7fc640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f683806be30 0x7f683806e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f684c0cf6f0 tx=0x7f6840009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:25.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.145+0000 7f68337fe640 1 -- 172.21.15.60:0/2193526363 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f683c059a30 con 0x7f684c0b8900 2024-09-12T01:38:25.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:25.356+0000 7f684bfff640 1 -- 172.21.15.60:0/2193526363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f684c0d2bc0 con 0x7f684c0b8900 2024-09-12T01:38:26.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.015+0000 7f68337fe640 1 -- 172.21.15.60:0/2193526363 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) ==== 104+0+0 (secure 0 0 0) 0x7f683c059330 con 0x7f684c0b8900 2024-09-12T01:38:26.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.017+0000 7f684bfff640 1 -- 172.21.15.60:0/2193526363 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f683806be30 msgr2=0x7f683806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.017+0000 7f684bfff640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f683806be30 0x7f683806e2f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f684c0cf6f0 tx=0x7f6840009040 comp rx=0 tx=0).stop 2024-09-12T01:38:26.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.017+0000 7f684bfff640 1 -- 172.21.15.60:0/2193526363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f684c0b8900 msgr2=0x7f684c0cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.017+0000 7f684bfff640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f684c0b8900 0x7f684c0cdae0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f683c00e870 tx=0x7f683c00ed30 comp rx=0 tx=0).stop 2024-09-12T01:38:26.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.017+0000 7f684bfff640 1 -- 172.21.15.60:0/2193526363 shutdown_connections 2024-09-12T01:38:26.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.018+0000 7f684bfff640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f684c15e5f0 0x7f684c152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.018+0000 7f684bfff640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f683806be30 0x7f683806e2f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.018+0000 7f684bfff640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f684c0d13c0 0x7f684c0cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.018+0000 7f684bfff640 1 --2- 172.21.15.60:0/2193526363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f684c0b8900 0x7f684c0cdae0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.018+0000 7f684bfff640 1 -- 172.21.15.60:0/2193526363 >> 172.21.15.60:0/2193526363 conn(0x7f684c062630 msgr2=0x7f684c0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:26.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.018+0000 7f684bfff640 1 -- 172.21.15.60:0/2193526363 shutdown_connections 2024-09-12T01:38:26.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.018+0000 7f684bfff640 1 -- 172.21.15.60:0/2193526363 wait complete. 2024-09-12T01:38:26.032 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:38:26.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.143+0000 7fd33bab7640 1 Processor -- start 2024-09-12T01:38:26.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.144+0000 7fd33bab7640 1 -- start start 2024-09-12T01:38:26.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.144+0000 7fd33bab7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd33415e990 0x7fd3340b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.144+0000 7fd33bab7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd334162450 0x7fd334162890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.144+0000 7fd33bab7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd334162dd0 0x7fd3340b6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.144+0000 7fd33bab7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd3340cff20 con 0x7fd334162dd0 2024-09-12T01:38:26.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.144+0000 7fd33bab7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd33415ed70 con 0x7fd33415e990 2024-09-12T01:38:26.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.145+0000 7fd33bab7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd334163280 con 0x7fd334162450 2024-09-12T01:38:26.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.145+0000 7fd33a054640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd334162dd0 0x7fd3340b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.145+0000 7fd33a054640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd334162dd0 0x7fd3340b6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50846/0 (socket says 172.21.15.60:50846) 2024-09-12T01:38:26.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.145+0000 7fd33a054640 1 -- 172.21.15.60:0/3732801805 learned_addr learned my addr 172.21.15.60:0/3732801805 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:26.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.145+0000 7fd33a054640 1 -- 172.21.15.60:0/3732801805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd334162450 msgr2=0x7fd334162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:26.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.145+0000 7fd33a054640 1 --2- 172.21.15.60:0/3732801805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd334162450 0x7fd334162890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.145+0000 7fd33a054640 1 -- 172.21.15.60:0/3732801805 >> v2:172.21.15.105:3300/0 conn(0x7fd33415e990 msgr2=0x7fd3340b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:26.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.145+0000 7fd33a054640 1 --2- 172.21.15.60:0/3732801805 >> v2:172.21.15.105:3300/0 conn(0x7fd33415e990 0x7fd3340b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.145+0000 7fd33a054640 1 -- 172.21.15.60:0/3732801805 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3340d1fa0 con 0x7fd334162dd0 2024-09-12T01:38:26.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.146+0000 7fd33a054640 1 --2- 172.21.15.60:0/3732801805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd334162dd0 0x7fd3340b6200 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd334074330 tx=0x7fd32c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11689ab98f94080 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:26.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.146+0000 7fd338851640 1 -- 172.21.15.60:0/3732801805 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c036070 con 0x7fd334162dd0 2024-09-12T01:38:26.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.146+0000 7fd338851640 1 -- 172.21.15.60:0/3732801805 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32c031600 con 0x7fd334162dd0 2024-09-12T01:38:26.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.146+0000 7fd338851640 1 -- 172.21.15.60:0/3732801805 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c0319d0 con 0x7fd334162dd0 2024-09-12T01:38:26.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.146+0000 7fd33bab7640 1 -- 172.21.15.60:0/3732801805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd334162dd0 msgr2=0x7fd3340b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.146+0000 7fd33bab7640 1 --2- 172.21.15.60:0/3732801805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd334162dd0 0x7fd3340b6200 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd334074330 tx=0x7fd32c02a610 comp rx=0 tx=0).stop 2024-09-12T01:38:26.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.147+0000 7fd33bab7640 1 -- 172.21.15.60:0/3732801805 shutdown_connections 2024-09-12T01:38:26.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.147+0000 7fd33bab7640 1 --2- 172.21.15.60:0/3732801805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd334162dd0 0x7fd3340b6200 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.147+0000 7fd33bab7640 1 --2- 172.21.15.60:0/3732801805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd334162450 0x7fd334162890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.147+0000 7fd33bab7640 1 --2- 172.21.15.60:0/3732801805 >> v2:172.21.15.105:3300/0 conn(0x7fd33415e990 0x7fd3340b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.147+0000 7fd33bab7640 1 -- 172.21.15.60:0/3732801805 >> 172.21.15.60:0/3732801805 conn(0x7fd3340d1200 msgr2=0x7fd3340d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:26.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.147+0000 7fd33bab7640 1 -- 172.21.15.60:0/3732801805 shutdown_connections 2024-09-12T01:38:26.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.147+0000 7fd33bab7640 1 -- 172.21.15.60:0/3732801805 wait complete. 2024-09-12T01:38:26.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.148+0000 7fd33bab7640 1 Processor -- start 2024-09-12T01:38:26.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.148+0000 7fd33bab7640 1 -- start start 2024-09-12T01:38:26.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33bab7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd33415e990 0x7fd334158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33bab7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd334162450 0x7fd3340b91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33bab7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd334162dd0 0x7fd3340b9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33bab7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd3340b6740 con 0x7fd334162dd0 2024-09-12T01:38:26.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33bab7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3340cfc40 con 0x7fd33415e990 2024-09-12T01:38:26.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33bab7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd3340b68c0 con 0x7fd334162450 2024-09-12T01:38:26.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33a054640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd334162dd0 0x7fd3340b9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33a054640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd334162dd0 0x7fd3340b9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50854/0 (socket says 172.21.15.60:50854) 2024-09-12T01:38:26.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33a054640 1 -- 172.21.15.60:0/623652075 learned_addr learned my addr 172.21.15.60:0/623652075 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:26.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd339853640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd33415e990 0x7fd334158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd339052640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd334162450 0x7fd3340b91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33a054640 1 -- 172.21.15.60:0/623652075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd334162450 msgr2=0x7fd3340b91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33a054640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd334162450 0x7fd3340b91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33a054640 1 -- 172.21.15.60:0/623652075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd33415e990 msgr2=0x7fd334158f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:26.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33a054640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd33415e990 0x7fd334158f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:26.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33a054640 1 -- 172.21.15.60:0/623652075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33415eff0 con 0x7fd334162dd0 2024-09-12T01:38:26.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33a054640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd334162dd0 0x7fd3340b9700 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0093e0 tx=0x7fd32c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:26.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd32a7fc640 1 -- 172.21.15.60:0/623652075 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c041070 con 0x7fd334162dd0 2024-09-12T01:38:26.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd32a7fc640 1 -- 172.21.15.60:0/623652075 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd32c03c650 con 0x7fd334162dd0 2024-09-12T01:38:26.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.149+0000 7fd33bab7640 1 -- 172.21.15.60:0/623652075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33415f290 con 0x7fd334162dd0 2024-09-12T01:38:26.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.150+0000 7fd32a7fc640 1 -- 172.21.15.60:0/623652075 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c036040 con 0x7fd334162dd0 2024-09-12T01:38:26.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.150+0000 7fd33bab7640 1 -- 172.21.15.60:0/623652075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd33415f850 con 0x7fd334162dd0 2024-09-12T01:38:26.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.150+0000 7fd33bab7640 1 -- 172.21.15.60:0/623652075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3340b3580 con 0x7fd334162dd0 2024-09-12T01:38:26.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.151+0000 7fd32a7fc640 1 -- 172.21.15.60:0/623652075 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd32c044070 con 0x7fd334162dd0 2024-09-12T01:38:26.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.151+0000 7fd32a7fc640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd31806be30 0x7fd31806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:26.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.152+0000 7fd32a7fc640 1 -- 172.21.15.60:0/623652075 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5795+0+0 (secure 0 0 0) 0x7fd32c0ab9f0 con 0x7fd334162dd0 2024-09-12T01:38:26.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.152+0000 7fd339853640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd31806be30 0x7fd31806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:26.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.152+0000 7fd339853640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd31806be30 0x7fd31806e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd330009890 tx=0x7fd330008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:26.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.156+0000 7fd32a7fc640 1 -- 172.21.15.60:0/623652075 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd32c07a340 con 0x7fd334162dd0 2024-09-12T01:38:26.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:26.332+0000 7fd33bab7640 1 -- 172.21.15.60:0/623652075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd334162870 con 0x7fd334162dd0 2024-09-12T01:38:27.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.020+0000 7fd32a7fc640 1 -- 172.21.15.60:0/623652075 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) ==== 181+0+0 (secure 0 0 0) 0x7fd32c079c40 con 0x7fd334162dd0 2024-09-12T01:38:27.021 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:38:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.024+0000 7fd33bab7640 1 -- 172.21.15.60:0/623652075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd31806be30 msgr2=0x7fd31806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.024+0000 7fd33bab7640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd31806be30 0x7fd31806e2f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd330009890 tx=0x7fd330008040 comp rx=0 tx=0).stop 2024-09-12T01:38:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.024+0000 7fd33bab7640 1 -- 172.21.15.60:0/623652075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd334162dd0 msgr2=0x7fd3340b9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.024+0000 7fd33bab7640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd334162dd0 0x7fd3340b9700 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd32c0093e0 tx=0x7fd32c004a40 comp rx=0 tx=0).stop 2024-09-12T01:38:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.024+0000 7fd33bab7640 1 -- 172.21.15.60:0/623652075 shutdown_connections 2024-09-12T01:38:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.024+0000 7fd33bab7640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd334162dd0 0x7fd3340b9700 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.024+0000 7fd33bab7640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd31806be30 0x7fd31806e2f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.024+0000 7fd33bab7640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd334162450 0x7fd3340b91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.024+0000 7fd33bab7640 1 --2- 172.21.15.60:0/623652075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd33415e990 0x7fd334158f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.024+0000 7fd33bab7640 1 -- 172.21.15.60:0/623652075 >> 172.21.15.60:0/623652075 conn(0x7fd3340d1200 msgr2=0x7fd3340d4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:27.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.025+0000 7fd33bab7640 1 -- 172.21.15.60:0/623652075 shutdown_connections 2024-09-12T01:38:27.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.025+0000 7fd33bab7640 1 -- 172.21.15.60:0/623652075 wait complete. 2024-09-12T01:38:27.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:38:27.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.152+0000 7fb65c11f640 1 Processor -- start 2024-09-12T01:38:27.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.152+0000 7fb65c11f640 1 -- start start 2024-09-12T01:38:27.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.153+0000 7fb65c11f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb65406fb10 0x7fb6540b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.153+0000 7fb65c11f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb6540714a0 0x7fb65415e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.153+0000 7fb65c11f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb65415f020 con 0x7fb65415e570 2024-09-12T01:38:27.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.153+0000 7fb65c11f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb65415fc30 con 0x7fb65406fb10 2024-09-12T01:38:27.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.153+0000 7fb65c11f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb65415f300 con 0x7fb6540714a0 2024-09-12T01:38:27.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.153+0000 7fb6596ba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb65406fb10 0x7fb6540b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.153+0000 7fb6596ba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb65406fb10 0x7fb6540b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50868/0 (socket says 172.21.15.60:50868) 2024-09-12T01:38:27.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.153+0000 7fb6596ba640 1 -- 172.21.15.60:0/100967111 learned_addr learned my addr 172.21.15.60:0/100967111 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:27.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.154+0000 7fb65a6bc640 1 --2- 172.21.15.60:0/100967111 >> v2:172.21.15.105:3300/0 conn(0x7fb6540714a0 0x7fb65415e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.154+0000 7fb6596ba640 1 -- 172.21.15.60:0/100967111 >> v2:172.21.15.105:3300/0 conn(0x7fb6540714a0 msgr2=0x7fb65415e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:27.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.154+0000 7fb6596ba640 1 --2- 172.21.15.60:0/100967111 >> v2:172.21.15.105:3300/0 conn(0x7fb6540714a0 0x7fb65415e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.154+0000 7fb6596ba640 1 -- 172.21.15.60:0/100967111 >> v1:172.21.15.105:6789/0 conn(0x7fb65415e570 legacy=0x7fb65406f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:27.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.154+0000 7fb6596ba640 1 -- 172.21.15.60:0/100967111 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65415f5e0 con 0x7fb65406fb10 2024-09-12T01:38:27.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.154+0000 7fb6596ba640 1 --2- 172.21.15.60:0/100967111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb65406fb10 0x7fb6540b5540 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb6540b7c00 tx=0x7fb64802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88f6dd8deaf29f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:27.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.155+0000 7fb658eb9640 1 -- 172.21.15.60:0/100967111 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648037070 con 0x7fb65406fb10 2024-09-12T01:38:27.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.155+0000 7fb658eb9640 1 -- 172.21.15.60:0/100967111 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb648032440 con 0x7fb65406fb10 2024-09-12T01:38:27.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.155+0000 7fb658eb9640 1 -- 172.21.15.60:0/100967111 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648032810 con 0x7fb65406fb10 2024-09-12T01:38:27.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.155+0000 7fb65c11f640 1 -- 172.21.15.60:0/100967111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb65406fb10 msgr2=0x7fb6540b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.155+0000 7fb65c11f640 1 --2- 172.21.15.60:0/100967111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb65406fb10 0x7fb6540b5540 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb6540b7c00 tx=0x7fb64802a230 comp rx=0 tx=0).stop 2024-09-12T01:38:27.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.155+0000 7fb65c11f640 1 -- 172.21.15.60:0/100967111 shutdown_connections 2024-09-12T01:38:27.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.155+0000 7fb65c11f640 1 --2- 172.21.15.60:0/100967111 >> v2:172.21.15.105:3300/0 conn(0x7fb6540714a0 0x7fb65415e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.155+0000 7fb65c11f640 1 --2- 172.21.15.60:0/100967111 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb65406fb10 0x7fb6540b5540 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.155+0000 7fb65c11f640 1 -- 172.21.15.60:0/100967111 >> 172.21.15.60:0/100967111 conn(0x7fb6540b4240 msgr2=0x7fb6540b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:27.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.155+0000 7fb65c11f640 1 -- 172.21.15.60:0/100967111 shutdown_connections 2024-09-12T01:38:27.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.155+0000 7fb65c11f640 1 -- 172.21.15.60:0/100967111 wait complete. 2024-09-12T01:38:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.156+0000 7fb65c11f640 1 Processor -- start 2024-09-12T01:38:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.157+0000 7fb65c11f640 1 -- start start 2024-09-12T01:38:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.157+0000 7fb65c11f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb65406fb10 0x7fb6540d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.157+0000 7fb65c11f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540714a0 0x7fb6540cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.157+0000 7fb65c11f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65415e570 0x7fb6541f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.157+0000 7fb65c11f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb65406d0e0 con 0x7fb6540714a0 2024-09-12T01:38:27.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.157+0000 7fb65c11f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb65406cf60 con 0x7fb65406fb10 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.157+0000 7fb65c11f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb65406d260 con 0x7fb65415e570 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.157+0000 7fb6596ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540714a0 0x7fb6540cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.157+0000 7fb6596ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540714a0 0x7fb6540cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50870/0 (socket says 172.21.15.60:50870) 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.157+0000 7fb6596ba640 1 -- 172.21.15.60:0/3517167590 learned_addr learned my addr 172.21.15.60:0/3517167590 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb659ebb640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb65406fb10 0x7fb6540d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb65a6bc640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65415e570 0x7fb6541f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb6596ba640 1 -- 172.21.15.60:0/3517167590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65415e570 msgr2=0x7fb6541f3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb6596ba640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65415e570 0x7fb6541f3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb6596ba640 1 -- 172.21.15.60:0/3517167590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb65406fb10 msgr2=0x7fb6540d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb6596ba640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb65406fb10 0x7fb6540d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb6596ba640 1 -- 172.21.15.60:0/3517167590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6540cc340 con 0x7fb6540714a0 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb659ebb640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb65406fb10 0x7fb6540d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:27.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb6596ba640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540714a0 0x7fb6540cb8c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb648000c00 tx=0x7fb6480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:27.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb6527fc640 1 -- 172.21.15.60:0/3517167590 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648041020 con 0x7fb6540714a0 2024-09-12T01:38:27.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb6527fc640 1 -- 172.21.15.60:0/3517167590 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6480306c0 con 0x7fb6540714a0 2024-09-12T01:38:27.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb6527fc640 1 -- 172.21.15.60:0/3517167590 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648037040 con 0x7fb6540714a0 2024-09-12T01:38:27.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb65c11f640 1 -- 172.21.15.60:0/3517167590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6540cc620 con 0x7fb6540714a0 2024-09-12T01:38:27.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.158+0000 7fb65c11f640 1 -- 172.21.15.60:0/3517167590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6540ccbe0 con 0x7fb6540714a0 2024-09-12T01:38:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.159+0000 7fb65c11f640 1 -- 172.21.15.60:0/3517167590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6540b5540 con 0x7fb6540714a0 2024-09-12T01:38:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.160+0000 7fb6527fc640 1 -- 172.21.15.60:0/3517167590 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb648044020 con 0x7fb6540714a0 2024-09-12T01:38:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.160+0000 7fb6527fc640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb64006be60 0x7fb64006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.160+0000 7fb6527fc640 1 -- 172.21.15.60:0/3517167590 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5357+0+0 (secure 0 0 0) 0x7fb6480ab520 con 0x7fb6540714a0 2024-09-12T01:38:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.160+0000 7fb659ebb640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb64006be60 0x7fb64006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:27.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.161+0000 7fb659ebb640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb64006be60 0x7fb64006e320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb644009fc0 tx=0x7fb644009550 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:27.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.165+0000 7fb6527fc640 1 -- 172.21.15.60:0/3517167590 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb64804b030 con 0x7fb6540714a0 2024-09-12T01:38:27.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:27.341+0000 7fb65c11f640 1 -- 172.21.15.60:0/3517167590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb654161580 con 0x7fb6540714a0 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.021+0000 7fb6527fc640 1 -- 172.21.15.60:0/3517167590 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) ==== 169+0+0 (secure 0 0 0) 0x7fb64807a030 con 0x7fb6540714a0 2024-09-12T01:38:28.022 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.027+0000 7fb65c11f640 1 -- 172.21.15.60:0/3517167590 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb64006be60 msgr2=0x7fb64006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.027+0000 7fb65c11f640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb64006be60 0x7fb64006e320 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb644009fc0 tx=0x7fb644009550 comp rx=0 tx=0).stop 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.027+0000 7fb65c11f640 1 -- 172.21.15.60:0/3517167590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540714a0 msgr2=0x7fb6540cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.027+0000 7fb65c11f640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540714a0 0x7fb6540cb8c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb648000c00 tx=0x7fb6480046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.028+0000 7fb65c11f640 1 -- 172.21.15.60:0/3517167590 shutdown_connections 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.028+0000 7fb65c11f640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb64006be60 0x7fb64006e320 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.028+0000 7fb65c11f640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb65415e570 0x7fb6541f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.028+0000 7fb65c11f640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6540714a0 0x7fb6540cb8c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.028+0000 7fb65c11f640 1 --2- 172.21.15.60:0/3517167590 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb65406fb10 0x7fb6540d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.028+0000 7fb65c11f640 1 -- 172.21.15.60:0/3517167590 >> 172.21.15.60:0/3517167590 conn(0x7fb6540b4240 msgr2=0x7fb65415d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.029+0000 7fb65c11f640 1 -- 172.21.15.60:0/3517167590 shutdown_connections 2024-09-12T01:38:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.029+0000 7fb65c11f640 1 -- 172.21.15.60:0/3517167590 wait complete. 2024-09-12T01:38:28.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T01:38:28.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.154+0000 7f5cd4ea6640 1 Processor -- start 2024-09-12T01:38:28.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.154+0000 7f5cd4ea6640 1 -- start start 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.155+0000 7f5cd4ea6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5cd00b68f0 0x7f5cd01696f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.155+0000 7f5cd4ea6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd00cf860 con 0x7f5cd015e7a0 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.155+0000 7f5cd4ea6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cd00cfb40 con 0x7f5cd00cf1f0 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.155+0000 7f5cd4ea6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5cd00d2ca0 con 0x7f5cd00b68f0 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5cce59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5cd015e7a0 0x7f5cd006caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48912/0 (socket says 172.21.15.60:48912) 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5cce59c640 1 -- 172.21.15.60:0/2795593488 learned_addr learned my addr 172.21.15.60:0/2795593488 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5cced9d640 1 --2- 172.21.15.60:0/2795593488 >> v2:172.21.15.105:3300/0 conn(0x7f5cd00b68f0 0x7f5cd01696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755252840 0 0) 0x7f5cd00cf860 con 0x7f5cd015e7a0 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cb8003520 con 0x7f5cd015e7a0 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1763231781 0 0) 0x7f5cb8003520 con 0x7f5cd015e7a0 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 >> v2:172.21.15.105:3300/0 conn(0x7f5cd00b68f0 msgr2=0x7f5cd01696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 --2- 172.21.15.60:0/2795593488 >> v2:172.21.15.105:3300/0 conn(0x7f5cd00b68f0 0x7f5cd01696f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 >> v1:172.21.15.105:6789/0 conn(0x7f5cd00cf1f0 legacy=0x7f5cd00b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd00cfe20 con 0x7f5cd015e7a0 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f5cc00019f0 con 0x7f5cd015e7a0 2024-09-12T01:38:28.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 >> v1:172.21.15.60:6789/0 conn(0x7f5cd015e7a0 legacy=0x7f5cd006caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 --2- 172.21.15.60:0/2795593488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb80039b0 0x7f5cb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 --2- 172.21.15.60:0/2795593488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cb8004800 0x7f5cb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 --2- 172.21.15.60:0/2795593488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 0x7f5cb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd00d2ca0 con 0x7f5cb80051c0 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5cb800c160 con 0x7f5cb80039b0 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5cb800c360 con 0x7f5cb8004800 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5cced9d640 1 --2- 172.21.15.60:0/2795593488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 0x7f5cb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5cce59c640 1 --2- 172.21.15.60:0/2795593488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb80039b0 0x7f5cb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.156+0000 7f5ccdd9b640 1 --2- 172.21.15.60:0/2795593488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cb8004800 0x7f5cb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.157+0000 7f5cced9d640 1 -- 172.21.15.60:0/2795593488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cb8004800 msgr2=0x7f5cb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.157+0000 7f5cced9d640 1 --2- 172.21.15.60:0/2795593488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cb8004800 0x7f5cb8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.157+0000 7f5cced9d640 1 -- 172.21.15.60:0/2795593488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb80039b0 msgr2=0x7f5cb8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.157+0000 7f5cced9d640 1 --2- 172.21.15.60:0/2795593488 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cb80039b0 0x7f5cb8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.157+0000 7f5cced9d640 1 -- 172.21.15.60:0/2795593488 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cb8003520 con 0x7f5cb80051c0 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.157+0000 7f5ccdd9b640 1 --2- 172.21.15.60:0/2795593488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cb8004800 0x7f5cb8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.157+0000 7f5cced9d640 1 -- 172.21.15.60:0/2795593488 reap_dead start 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.157+0000 7f5cced9d640 1 --2- 172.21.15.60:0/2795593488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 0x7f5cb800b9c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0163480 tx=0x7f5cb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613c54affac7f536 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.157+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8036070 con 0x7f5cb80051c0 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.158+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc8031400 con 0x7f5cb80051c0 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.158+0000 7f5ccd59a640 1 -- 172.21.15.60:0/2795593488 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8009690 con 0x7f5cb80051c0 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.158+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/2795593488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 msgr2=0x7f5cb800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.158+0000 7f5cd4ea6640 1 --2- 172.21.15.60:0/2795593488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 0x7f5cb800b9c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0163480 tx=0x7f5cb8005830 comp rx=0 tx=0).stop 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.158+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/2795593488 shutdown_connections 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.158+0000 7f5cd4ea6640 1 --2- 172.21.15.60:0/2795593488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 0x7f5cb800b9c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.158+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/2795593488 >> 172.21.15.60:0/2795593488 conn(0x7f5cd00d11e0 msgr2=0x7f5cd00d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.158+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/2795593488 shutdown_connections 2024-09-12T01:38:28.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.158+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/2795593488 wait complete. 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.160+0000 7f5cd4ea6640 1 Processor -- start 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.160+0000 7f5cd4ea6640 1 -- start start 2024-09-12T01:38:28.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.160+0000 7f5cd4ea6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 0x7f5cd0150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.160+0000 7f5cd4ea6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd01f4df0 0x7f5cd015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.160+0000 7f5cd4ea6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cd015c600 0x7f5cd01f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.160+0000 7f5cd4ea6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd015eb80 con 0x7f5cb80051c0 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.160+0000 7f5cd4ea6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5cd00b7a00 con 0x7f5cd015c600 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.160+0000 7f5cd4ea6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5cd015ed00 con 0x7f5cd01f4df0 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.160+0000 7f5cce59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 0x7f5cd0150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.160+0000 7f5cce59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 0x7f5cd0150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50896/0 (socket says 172.21.15.60:50896) 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.160+0000 7f5cce59c640 1 -- 172.21.15.60:0/1916622557 learned_addr learned my addr 172.21.15.60:0/1916622557 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cced9d640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cd015c600 0x7f5cd01f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5ccdd9b640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd01f4df0 0x7f5cd015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cce59c640 1 -- 172.21.15.60:0/1916622557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd01f4df0 msgr2=0x7f5cd015c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cce59c640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd01f4df0 0x7f5cd015c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cce59c640 1 -- 172.21.15.60:0/1916622557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cd015c600 msgr2=0x7f5cd01f79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cce59c640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cd015c600 0x7f5cd01f79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cce59c640 1 -- 172.21.15.60:0/1916622557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cd0151170 con 0x7f5cb80051c0 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5ccdd9b640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd01f4df0 0x7f5cd015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cced9d640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cd015c600 0x7f5cd01f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cce59c640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 0x7f5cd0150c30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00079f0 tx=0x7f5cc000a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cbeffd640 1 -- 172.21.15.60:0/1916622557 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0017020 con 0x7f5cb80051c0 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cbeffd640 1 -- 172.21.15.60:0/1916622557 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc0001a30 con 0x7f5cb80051c0 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/1916622557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cd00c85c0 con 0x7f5cb80051c0 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cbeffd640 1 -- 172.21.15.60:0/1916622557 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0013630 con 0x7f5cb80051c0 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.161+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/1916622557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cd00c8b80 con 0x7f5cb80051c0 2024-09-12T01:38:28.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.162+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/1916622557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cd00b61e0 con 0x7f5cb80051c0 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.163+0000 7f5cbeffd640 1 -- 172.21.15.60:0/1916622557 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cc001a020 con 0x7f5cb80051c0 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.163+0000 7f5cbeffd640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5cb006be60 0x7f5cb006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.163+0000 7f5ccdd9b640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5cb006be60 0x7f5cb006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.163+0000 7f5cbeffd640 1 -- 172.21.15.60:0/1916622557 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f5cc008b4c0 con 0x7f5cb80051c0 2024-09-12T01:38:28.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.164+0000 7f5ccdd9b640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5cb006be60 0x7f5cb006e320 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4000c00 tx=0x7f5cc4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:28.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.168+0000 7f5cbeffd640 1 -- 172.21.15.60:0/1916622557 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5cc0021020 con 0x7f5cb80051c0 2024-09-12T01:38:28.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.342+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/1916622557 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f5cd006c7d0 con 0x7f5cb80051c0 2024-09-12T01:38:28.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.346+0000 7f5cbeffd640 1 -- 172.21.15.60:0/1916622557 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f5cd0151170 con 0x7f5cb80051c0 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.348+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/1916622557 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5cb006be60 msgr2=0x7f5cb006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.348+0000 7f5cd4ea6640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5cb006be60 0x7f5cb006e320 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4000c00 tx=0x7f5cc4009040 comp rx=0 tx=0).stop 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.348+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/1916622557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 msgr2=0x7f5cd0150c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.348+0000 7f5cd4ea6640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 0x7f5cd0150c30 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00079f0 tx=0x7f5cc000a6f0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.348+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/1916622557 shutdown_connections 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.348+0000 7f5cd4ea6640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cd015c600 0x7f5cd01f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.348+0000 7f5cd4ea6640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5cb006be60 0x7f5cb006e320 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.348+0000 7f5cd4ea6640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cd01f4df0 0x7f5cd015c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.348+0000 7f5cd4ea6640 1 --2- 172.21.15.60:0/1916622557 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cb80051c0 0x7f5cd0150c30 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.348+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/1916622557 >> 172.21.15.60:0/1916622557 conn(0x7f5cd00d11e0 msgr2=0x7f5cd015d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.348+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/1916622557 shutdown_connections 2024-09-12T01:38:28.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.348+0000 7f5cd4ea6640 1 -- 172.21.15.60:0/1916622557 wait complete. 2024-09-12T01:38:28.359 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size' 2024-09-12T01:38:28.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.461+0000 7f6f62282640 1 Processor -- start 2024-09-12T01:38:28.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.461+0000 7f6f62282640 1 -- start start 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.462+0000 7f6f62282640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c062a70 0x7f6f5c0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.462+0000 7f6f62282640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f5c15e9b0 con 0x7f6f5c15e5d0 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.462+0000 7f6f62282640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f5c162a50 con 0x7f6f5c0b5800 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.462+0000 7f6f62282640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5c162d30 con 0x7f6f5c062a70 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.462+0000 7f6f5bfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6f5c15e5d0 0x7f6f5c162170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48914/0 (socket says 172.21.15.60:48914) 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.462+0000 7f6f5bfff640 1 -- 172.21.15.60:0/573953375 learned_addr learned my addr 172.21.15.60:0/573953375 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.462+0000 7f6f5b7fe640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c062a70 0x7f6f5c0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.462+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315096272 0 0) 0x7f6f5c15e9b0 con 0x7f6f5c15e5d0 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.462+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f44003520 con 0x7f6f5c15e5d0 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450418397 0 0) 0x7f6f5c162a50 con 0x7f6f5c0b5800 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f5c15e9b0 con 0x7f6f5c0b5800 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1276050307 0 0) 0x7f6f44003520 con 0x7f6f5c15e5d0 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c062a70 msgr2=0x7f6f5c0b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c062a70 0x7f6f5c0b52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 >> v1:172.21.15.105:6789/0 conn(0x7f6f5c0b5800 legacy=0x7f6f5c072e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5c163010 con 0x7f6f5c15e5d0 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f6f4c001670 con 0x7f6f5c15e5d0 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5b7fe640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c062a70 0x7f6f5c0b52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:28.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 >> v1:172.21.15.60:6789/0 conn(0x7f6f5c15e5d0 legacy=0x7f6f5c162170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f44003b70 0x7f6f44003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c062a70 0x7f6f44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f44004d40 0x7f6f440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c162d30 con 0x7f6f44004d40 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4400bad0 con 0x7f6f44003b70 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6f4400bcd0 con 0x7f6f5c062a70 2024-09-12T01:38:28.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f6081f640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f44004d40 0x7f6f440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5bfff640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f44003b70 0x7f6f44003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f5b7fe640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c062a70 0x7f6f44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f6081f640 1 -- 172.21.15.60:0/573953375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c062a70 msgr2=0x7f6f44004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f6081f640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c062a70 0x7f6f44004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f6081f640 1 -- 172.21.15.60:0/573953375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f44003b70 msgr2=0x7f6f44003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f6081f640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f44003b70 0x7f6f44003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.463+0000 7f6f6081f640 1 -- 172.21.15.60:0/573953375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f44003520 con 0x7f6f44004d40 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.464+0000 7f6f6081f640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f44004d40 0x7f6f440051c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6f54001fd0 tx=0x7f6f44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f5fc3001292acf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.464+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f54001bf0 con 0x7f6f44004d40 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.464+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f54003b70 con 0x7f6f44004d40 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.464+0000 7f6f5affd640 1 -- 172.21.15.60:0/573953375 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f540050d0 con 0x7f6f44004d40 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.465+0000 7f6f62282640 1 -- 172.21.15.60:0/573953375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f44004d40 msgr2=0x7f6f440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.465+0000 7f6f62282640 1 --2- 172.21.15.60:0/573953375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f44004d40 0x7f6f440051c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6f54001fd0 tx=0x7f6f44005830 comp rx=0 tx=0).stop 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.465+0000 7f6f6081f640 1 -- 172.21.15.60:0/573953375 reap_dead start 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.465+0000 7f6f62282640 1 -- 172.21.15.60:0/573953375 shutdown_connections 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.465+0000 7f6f62282640 1 -- 172.21.15.60:0/573953375 >> 172.21.15.60:0/573953375 conn(0x7f6f5c06bc10 msgr2=0x7f6f5c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.465+0000 7f6f62282640 1 -- 172.21.15.60:0/573953375 shutdown_connections 2024-09-12T01:38:28.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.465+0000 7f6f62282640 1 -- 172.21.15.60:0/573953375 wait complete. 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.466+0000 7f6f62282640 1 Processor -- start 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.466+0000 7f6f62282640 1 -- start start 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f62282640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f44004d40 0x7f6f5c14d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f62282640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c1617b0 0x7f6f5c0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f62282640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f5c1509c0 0x7f6f5c150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f62282640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c073590 con 0x7f6f44004d40 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f62282640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6f5c071b90 con 0x7f6f5c1509c0 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f62282640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6f5c073710 con 0x7f6f5c1617b0 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f5bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f44004d40 0x7f6f5c14d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f5bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f44004d40 0x7f6f5c14d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50926/0 (socket says 172.21.15.60:50926) 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f5bfff640 1 -- 172.21.15.60:0/2236290334 learned_addr learned my addr 172.21.15.60:0/2236290334 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f6081f640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f5c1509c0 0x7f6f5c150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f5bfff640 1 -- 172.21.15.60:0/2236290334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c1617b0 msgr2=0x7f6f5c0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f5bfff640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c1617b0 0x7f6f5c0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f5bfff640 1 -- 172.21.15.60:0/2236290334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f5c1509c0 msgr2=0x7f6f5c150e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f5bfff640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f5c1509c0 0x7f6f5c150e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f5bfff640 1 -- 172.21.15.60:0/2236290334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f5c14e900 con 0x7f6f44004d40 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f5bfff640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f44004d40 0x7f6f5c14d8e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c007340 tx=0x7f6f4c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:28.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f58ff9640 1 -- 172.21.15.60:0/2236290334 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00f860 con 0x7f6f44004d40 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f58ff9640 1 -- 172.21.15.60:0/2236290334 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4c018070 con 0x7f6f44004d40 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f62282640 1 -- 172.21.15.60:0/2236290334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f5c14eba0 con 0x7f6f44004d40 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.467+0000 7f6f58ff9640 1 -- 172.21.15.60:0/2236290334 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00fc60 con 0x7f6f44004d40 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.468+0000 7f6f62282640 1 -- 172.21.15.60:0/2236290334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f5c1513b0 con 0x7f6f44004d40 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.468+0000 7f6f62282640 1 -- 172.21.15.60:0/2236290334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f5c0b52c0 con 0x7f6f44004d40 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.469+0000 7f6f58ff9640 1 -- 172.21.15.60:0/2236290334 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6f4c01d460 con 0x7f6f44004d40 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.469+0000 7f6f58ff9640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f4806be60 0x7f6f4806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.469+0000 7f6f58ff9640 1 -- 172.21.15.60:0/2236290334 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f6f4c08abe0 con 0x7f6f44004d40 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.470+0000 7f6f5b7fe640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f4806be60 0x7f6f4806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:28.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.470+0000 7f6f5b7fe640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f4806be60 0x7f6f4806e320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0b28b0 tx=0x7f6f500093a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:28.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.474+0000 7f6f58ff9640 1 -- 172.21.15.60:0/2236290334 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6f4c0598b0 con 0x7f6f44004d40 2024-09-12T01:38:28.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:28.725+0000 7f6f62282640 1 -- 172.21.15.60:0/2236290334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]} v 0) -- 0x7f6f5c06f2f0 con 0x7f6f44004d40 2024-09-12T01:38:29.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.026+0000 7f6f58ff9640 1 -- 172.21.15.60:0/2236290334 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_cache_size"]}]=0 v151) ==== 150+0+0 (secure 0 0 0) 0x7f6f4c0591b0 con 0x7f6f44004d40 2024-09-12T01:38:29.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.028+0000 7f6f62282640 1 -- 172.21.15.60:0/2236290334 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f4806be60 msgr2=0x7f6f4806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.028+0000 7f6f62282640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f4806be60 0x7f6f4806e320 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0b28b0 tx=0x7f6f500093a0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.028+0000 7f6f62282640 1 -- 172.21.15.60:0/2236290334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f44004d40 msgr2=0x7f6f5c14d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.028+0000 7f6f62282640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f44004d40 0x7f6f5c14d8e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c007340 tx=0x7f6f4c007800 comp rx=0 tx=0).stop 2024-09-12T01:38:29.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.028+0000 7f6f62282640 1 -- 172.21.15.60:0/2236290334 shutdown_connections 2024-09-12T01:38:29.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.028+0000 7f6f62282640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6f5c1509c0 0x7f6f5c150e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.028+0000 7f6f62282640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6f4806be60 0x7f6f4806e320 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.028+0000 7f6f62282640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6f5c1617b0 0x7f6f5c0cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.028+0000 7f6f62282640 1 --2- 172.21.15.60:0/2236290334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f44004d40 0x7f6f5c14d8e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.028+0000 7f6f62282640 1 -- 172.21.15.60:0/2236290334 >> 172.21.15.60:0/2236290334 conn(0x7f6f5c06bc10 msgr2=0x7f6f5c071fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:29.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.028+0000 7f6f62282640 1 -- 172.21.15.60:0/2236290334 shutdown_connections 2024-09-12T01:38:29.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.028+0000 7f6f62282640 1 -- 172.21.15.60:0/2236290334 wait complete. 2024-09-12T01:38:29.040 INFO:tasks.cephfs_test_runner:test_client_cache_size (tasks.cephfs.test_client_limits.TestClientLimits) ... skipped 'Require FUSE client to inject client release failure' 2024-09-12T01:38:29.040 INFO:tasks.cephfs_test_runner:Starting test: test_client_max_caps (tasks.cephfs.test_client_limits.TestClientLimits) That the MDS will not let a client sit above mds_max_caps_per_client caps. 2024-09-12T01:38:29.040 INFO:tasks.cephfs_test_runner:test_client_max_caps (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-12T01:38:29.041 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:29.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.143+0000 7fad93b2c640 1 Processor -- start 2024-09-12T01:38:29.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.143+0000 7fad93b2c640 1 -- start start 2024-09-12T01:38:29.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.144+0000 7fad93b2c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad8c0b6160 0x7fad8c0b6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.144+0000 7fad93b2c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad8c0b7880 0x7fad8c0b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.144+0000 7fad93b2c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad8c0b6ac0 con 0x7fad8c15e860 2024-09-12T01:38:29.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.144+0000 7fad93b2c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fad8c0d40d0 con 0x7fad8c0b7880 2024-09-12T01:38:29.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.144+0000 7fad93b2c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad8c0d34c0 con 0x7fad8c0b6160 2024-09-12T01:38:29.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.144+0000 7fad920c9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad8c0b7880 0x7fad8c0b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.144+0000 7fad920c9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad8c0b7880 0x7fad8c0b7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50938/0 (socket says 172.21.15.60:50938) 2024-09-12T01:38:29.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.144+0000 7fad920c9640 1 -- 172.21.15.60:0/2970186174 learned_addr learned my addr 172.21.15.60:0/2970186174 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:29.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.144+0000 7fad910c7640 1 --2- 172.21.15.60:0/2970186174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad8c0b6160 0x7fad8c0b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.145+0000 7fad920c9640 1 -- 172.21.15.60:0/2970186174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad8c0b6160 msgr2=0x7fad8c0b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:29.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.145+0000 7fad920c9640 1 --2- 172.21.15.60:0/2970186174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad8c0b6160 0x7fad8c0b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.145+0000 7fad920c9640 1 -- 172.21.15.60:0/2970186174 >> v1:172.21.15.105:6789/0 conn(0x7fad8c15e860 legacy=0x7fad8c0d2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.145+0000 7fad920c9640 1 -- 172.21.15.60:0/2970186174 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c0d37a0 con 0x7fad8c0b7880 2024-09-12T01:38:29.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.145+0000 7fad910c7640 1 --2- 172.21.15.60:0/2970186174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad8c0b6160 0x7fad8c0b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:29.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.145+0000 7fad920c9640 1 --2- 172.21.15.60:0/2970186174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad8c0b7880 0x7fad8c0b7d30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fad84009870 tx=0x7fad8402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c669ad126e1fdadc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:29.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.146+0000 7fad908c6640 1 -- 172.21.15.60:0/2970186174 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84037070 con 0x7fad8c0b7880 2024-09-12T01:38:29.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.146+0000 7fad908c6640 1 -- 172.21.15.60:0/2970186174 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad84032440 con 0x7fad8c0b7880 2024-09-12T01:38:29.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.146+0000 7fad908c6640 1 -- 172.21.15.60:0/2970186174 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad84032810 con 0x7fad8c0b7880 2024-09-12T01:38:29.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.146+0000 7fad93b2c640 1 -- 172.21.15.60:0/2970186174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad8c0b7880 msgr2=0x7fad8c0b7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.146+0000 7fad93b2c640 1 --2- 172.21.15.60:0/2970186174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad8c0b7880 0x7fad8c0b7d30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fad84009870 tx=0x7fad8402a270 comp rx=0 tx=0).stop 2024-09-12T01:38:29.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.146+0000 7fad93b2c640 1 -- 172.21.15.60:0/2970186174 shutdown_connections 2024-09-12T01:38:29.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.146+0000 7fad93b2c640 1 --2- 172.21.15.60:0/2970186174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad8c0b7880 0x7fad8c0b7d30 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.146+0000 7fad93b2c640 1 --2- 172.21.15.60:0/2970186174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad8c0b6160 0x7fad8c0b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.146+0000 7fad93b2c640 1 -- 172.21.15.60:0/2970186174 >> 172.21.15.60:0/2970186174 conn(0x7fad8c062c60 msgr2=0x7fad8c0d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:29.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.146+0000 7fad93b2c640 1 -- 172.21.15.60:0/2970186174 shutdown_connections 2024-09-12T01:38:29.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.146+0000 7fad93b2c640 1 -- 172.21.15.60:0/2970186174 wait complete. 2024-09-12T01:38:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.147+0000 7fad93b2c640 1 Processor -- start 2024-09-12T01:38:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.147+0000 7fad93b2c640 1 -- start start 2024-09-12T01:38:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.148+0000 7fad93b2c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad8c0b6160 0x7fad8c14db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.148+0000 7fad93b2c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad8c0b7880 0x7fad8c0c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.148+0000 7fad93b2c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad8c15e860 0x7fad8c0cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.148+0000 7fad93b2c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c0d31c0 con 0x7fad8c0b6160 2024-09-12T01:38:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.148+0000 7fad93b2c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad8c0d3d60 con 0x7fad8c0b7880 2024-09-12T01:38:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.148+0000 7fad93b2c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad8c0b3890 con 0x7fad8c15e860 2024-09-12T01:38:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.148+0000 7fad918c8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad8c0b6160 0x7fad8c14db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.148+0000 7fad918c8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad8c0b6160 0x7fad8c14db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50948/0 (socket says 172.21.15.60:50948) 2024-09-12T01:38:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.148+0000 7fad918c8640 1 -- 172.21.15.60:0/1493071872 learned_addr learned my addr 172.21.15.60:0/1493071872 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.148+0000 7fad910c7640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad8c0b7880 0x7fad8c0c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.148+0000 7fad920c9640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad8c15e860 0x7fad8c0cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.149+0000 7fad918c8640 1 -- 172.21.15.60:0/1493071872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad8c15e860 msgr2=0x7fad8c0cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.149+0000 7fad918c8640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad8c15e860 0x7fad8c0cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.149+0000 7fad918c8640 1 -- 172.21.15.60:0/1493071872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad8c0b7880 msgr2=0x7fad8c0c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.149+0000 7fad918c8640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad8c0b7880 0x7fad8c0c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.149+0000 7fad918c8640 1 -- 172.21.15.60:0/1493071872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad8c14e050 con 0x7fad8c0b6160 2024-09-12T01:38:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.149+0000 7fad920c9640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad8c15e860 0x7fad8c0cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.149+0000 7fad918c8640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad8c0b6160 0x7fad8c14db10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c760 tx=0x7fad8800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.149+0000 7fad827fc640 1 -- 172.21.15.60:0/1493071872 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad88003b70 con 0x7fad8c0b6160 2024-09-12T01:38:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.149+0000 7fad827fc640 1 -- 172.21.15.60:0/1493071872 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad88003d30 con 0x7fad8c0b6160 2024-09-12T01:38:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.149+0000 7fad93b2c640 1 -- 172.21.15.60:0/1493071872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad8c0c8cb0 con 0x7fad8c0b6160 2024-09-12T01:38:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.149+0000 7fad827fc640 1 -- 172.21.15.60:0/1493071872 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad8800aa90 con 0x7fad8c0b6160 2024-09-12T01:38:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.149+0000 7fad93b2c640 1 -- 172.21.15.60:0/1493071872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad8c0c9270 con 0x7fad8c0b6160 2024-09-12T01:38:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.150+0000 7fad93b2c640 1 -- 172.21.15.60:0/1493071872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad8c0b6580 con 0x7fad8c0b6160 2024-09-12T01:38:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.151+0000 7fad827fc640 1 -- 172.21.15.60:0/1493071872 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad8800ac30 con 0x7fad8c0b6160 2024-09-12T01:38:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.151+0000 7fad827fc640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad7006be60 0x7fad7006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.151+0000 7fad827fc640 1 -- 172.21.15.60:0/1493071872 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fad8808a9b0 con 0x7fad8c0b6160 2024-09-12T01:38:29.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.151+0000 7fad910c7640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad7006be60 0x7fad7006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.152+0000 7fad910c7640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad7006be60 0x7fad7006e320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0ccff0 tx=0x7fad7c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:29.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.155+0000 7fad827fc640 1 -- 172.21.15.60:0/1493071872 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad8c14e050 con 0x7fad8c0b6160 2024-09-12T01:38:29.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.332+0000 7fad93b2c640 1 -- 172.21.15.60:0/1493071872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fad8c0d1390 con 0x7fad8c0b6160 2024-09-12T01:38:29.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.333+0000 7fad827fc640 1 -- 172.21.15.60:0/1493071872 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) ==== 74+0+12998 (secure 0 0 0) 0x7fad88059660 con 0x7fad8c0b6160 2024-09-12T01:38:29.334 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:29.334 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":60,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:38:28.021750+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/4144770620":"2024-09-13T01:38:25.013776+0000","172.21.15.105:6833/4144770620":"2024-09-13T01:38:25.013776+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:29.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.335+0000 7fad93b2c640 1 -- 172.21.15.60:0/1493071872 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad7006be60 msgr2=0x7fad7006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.335+0000 7fad93b2c640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad7006be60 0x7fad7006e320 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0ccff0 tx=0x7fad7c008040 comp rx=0 tx=0).stop 2024-09-12T01:38:29.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.335+0000 7fad93b2c640 1 -- 172.21.15.60:0/1493071872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad8c0b6160 msgr2=0x7fad8c14db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.335+0000 7fad93b2c640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad8c0b6160 0x7fad8c14db10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c760 tx=0x7fad8800cc20 comp rx=0 tx=0).stop 2024-09-12T01:38:29.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.335+0000 7fad93b2c640 1 -- 172.21.15.60:0/1493071872 shutdown_connections 2024-09-12T01:38:29.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.335+0000 7fad93b2c640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad7006be60 0x7fad7006e320 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.335+0000 7fad93b2c640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad8c15e860 0x7fad8c0cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.335+0000 7fad93b2c640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad8c0b7880 0x7fad8c0c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.335+0000 7fad93b2c640 1 --2- 172.21.15.60:0/1493071872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad8c0b6160 0x7fad8c14db10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.335+0000 7fad93b2c640 1 -- 172.21.15.60:0/1493071872 >> 172.21.15.60:0/1493071872 conn(0x7fad8c062c60 msgr2=0x7fad8c0b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:29.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.336+0000 7fad93b2c640 1 -- 172.21.15.60:0/1493071872 shutdown_connections 2024-09-12T01:38:29.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.336+0000 7fad93b2c640 1 -- 172.21.15.60:0/1493071872 wait complete. 2024-09-12T01:38:29.347 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:35:46.304939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:38:29.348 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:38:29.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.452+0000 7fa0a90a6640 1 Processor -- start 2024-09-12T01:38:29.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.452+0000 7fa0a90a6640 1 -- start start 2024-09-12T01:38:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.453+0000 7fa0a90a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0a415e750 0x7fa0a40cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.453+0000 7fa0a90a6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0a40b7790 con 0x7fa0a40cfb70 2024-09-12T01:38:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.453+0000 7fa0a90a6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0a40d3600 con 0x7fa0a40b6bb0 2024-09-12T01:38:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.453+0000 7fa0a90a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa0a40d43c0 con 0x7fa0a415e750 2024-09-12T01:38:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.453+0000 7fa0a2d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0a415e750 0x7fa0a40cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.453+0000 7fa0a259c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa0a40cfb70 0x7fa0a40b64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48930/0 (socket says 172.21.15.60:48930) 2024-09-12T01:38:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.453+0000 7fa0a2d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0a415e750 0x7fa0a40cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50954/0 (socket says 172.21.15.60:50954) 2024-09-12T01:38:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.453+0000 7fa0a259c640 1 -- 172.21.15.60:0/2076184191 learned_addr learned my addr 172.21.15.60:0/2076184191 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.453+0000 7fa0a2d9d640 1 -- 172.21.15.60:0/2076184191 >> v1:172.21.15.105:6789/0 conn(0x7fa0a40b6bb0 legacy=0x7fa0a40b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.453+0000 7fa0a2d9d640 1 -- 172.21.15.60:0/2076184191 >> v1:172.21.15.60:6789/0 conn(0x7fa0a40cfb70 legacy=0x7fa0a40b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.453+0000 7fa0a1d9b640 1 -- 172.21.15.60:0/2076184191 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051168671 0 0) 0x7fa0a40b7790 con 0x7fa0a40cfb70 2024-09-12T01:38:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.453+0000 7fa0a2d9d640 1 -- 172.21.15.60:0/2076184191 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a40d38e0 con 0x7fa0a415e750 2024-09-12T01:38:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.454+0000 7fa0a2d9d640 1 --2- 172.21.15.60:0/2076184191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a415e750 0x7fa0a40cf630 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa094009d90 tx=0x7fa09402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede1ba1d45806986 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.454+0000 7fa0a1d9b640 1 -- 172.21.15.60:0/2076184191 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa094007740 con 0x7fa0a415e750 2024-09-12T01:38:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.454+0000 7fa0a1d9b640 1 -- 172.21.15.60:0/2076184191 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0940078e0 con 0x7fa0a415e750 2024-09-12T01:38:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.454+0000 7fa0a1d9b640 1 -- 172.21.15.60:0/2076184191 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa094007cb0 con 0x7fa0a415e750 2024-09-12T01:38:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.455+0000 7fa0a90a6640 1 -- 172.21.15.60:0/2076184191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a415e750 msgr2=0x7fa0a40cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.455+0000 7fa0a90a6640 1 --2- 172.21.15.60:0/2076184191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a415e750 0x7fa0a40cf630 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa094009d90 tx=0x7fa09402a6a0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.455+0000 7fa0a90a6640 1 -- 172.21.15.60:0/2076184191 shutdown_connections 2024-09-12T01:38:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.455+0000 7fa0a90a6640 1 --2- 172.21.15.60:0/2076184191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a415e750 0x7fa0a40cf630 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.455+0000 7fa0a90a6640 1 -- 172.21.15.60:0/2076184191 >> 172.21.15.60:0/2076184191 conn(0x7fa0a40d1500 msgr2=0x7fa0a40d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.455+0000 7fa0a90a6640 1 -- 172.21.15.60:0/2076184191 shutdown_connections 2024-09-12T01:38:29.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.455+0000 7fa0a90a6640 1 -- 172.21.15.60:0/2076184191 wait complete. 2024-09-12T01:38:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.456+0000 7fa0a90a6640 1 Processor -- start 2024-09-12T01:38:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.456+0000 7fa0a90a6640 1 -- start start 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a90a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0a40b6bb0 0x7fa0a415c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a90a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a40cfb70 0x7fa0a41f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a90a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0a415e750 0x7fa0a41f8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a90a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a40b7ac0 con 0x7fa0a40cfb70 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a90a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa0a40d33b0 con 0x7fa0a40b6bb0 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a90a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0a415eb30 con 0x7fa0a415e750 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a40cfb70 0x7fa0a41f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a40cfb70 0x7fa0a41f7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50964/0 (socket says 172.21.15.60:50964) 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a259c640 1 -- 172.21.15.60:0/4291348573 learned_addr learned my addr 172.21.15.60:0/4291348573 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a359e640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0a415e750 0x7fa0a41f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a2d9d640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0a40b6bb0 0x7fa0a415c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a259c640 1 -- 172.21.15.60:0/4291348573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0a415e750 msgr2=0x7fa0a41f8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a259c640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0a415e750 0x7fa0a41f8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a259c640 1 -- 172.21.15.60:0/4291348573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0a40b6bb0 msgr2=0x7fa0a415c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.457+0000 7fa0a259c640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0a40b6bb0 0x7fa0a415c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.458+0000 7fa0a259c640 1 -- 172.21.15.60:0/4291348573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0a40ac570 con 0x7fa0a40cfb70 2024-09-12T01:38:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.458+0000 7fa0a359e640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0a415e750 0x7fa0a41f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.458+0000 7fa0a2d9d640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0a40b6bb0 0x7fa0a415c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.458+0000 7fa0a259c640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a40cfb70 0x7fa0a41f7be0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c4a0 tx=0x7fa08c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.458+0000 7fa09b7fe640 1 -- 172.21.15.60:0/4291348573 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c017070 con 0x7fa0a40cfb70 2024-09-12T01:38:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.458+0000 7fa09b7fe640 1 -- 172.21.15.60:0/4291348573 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08c005ce0 con 0x7fa0a40cfb70 2024-09-12T01:38:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.458+0000 7fa09b7fe640 1 -- 172.21.15.60:0/4291348573 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08c0072b0 con 0x7fa0a40cfb70 2024-09-12T01:38:29.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.458+0000 7fa0a90a6640 1 -- 172.21.15.60:0/4291348573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0a40ac810 con 0x7fa0a40cfb70 2024-09-12T01:38:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.458+0000 7fa0a90a6640 1 -- 172.21.15.60:0/4291348573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0a40acdd0 con 0x7fa0a40cfb70 2024-09-12T01:38:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.459+0000 7fa0a90a6640 1 -- 172.21.15.60:0/4291348573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0a40cf630 con 0x7fa0a40cfb70 2024-09-12T01:38:29.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.459+0000 7fa09b7fe640 1 -- 172.21.15.60:0/4291348573 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa08c01a070 con 0x7fa0a40cfb70 2024-09-12T01:38:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.460+0000 7fa09b7fe640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa08406be30 0x7fa08406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.460+0000 7fa09b7fe640 1 -- 172.21.15.60:0/4291348573 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fa08c089fa0 con 0x7fa0a40cfb70 2024-09-12T01:38:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.460+0000 7fa0a2d9d640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa08406be30 0x7fa08406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.460+0000 7fa0a2d9d640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa08406be30 0x7fa08406e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa094034000 tx=0x7fa09402f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:29.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.464+0000 7fa09b7fe640 1 -- 172.21.15.60:0/4291348573 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa08c058bd0 con 0x7fa0a40cfb70 2024-09-12T01:38:29.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.638+0000 7fa0a90a6640 1 -- 172.21.15.60:0/4291348573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa0a40b5040 con 0x7fa0a40cfb70 2024-09-12T01:38:29.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.638+0000 7fa09b7fe640 1 -- 172.21.15.60:0/4291348573 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) ==== 93+0+10 (secure 0 0 0) 0x7fa08c0584d0 con 0x7fa0a40cfb70 2024-09-12T01:38:29.639 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-12T01:38:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.640+0000 7fa0a90a6640 1 -- 172.21.15.60:0/4291348573 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa08406be30 msgr2=0x7fa08406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.640+0000 7fa0a90a6640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa08406be30 0x7fa08406e2f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa094034000 tx=0x7fa09402f000 comp rx=0 tx=0).stop 2024-09-12T01:38:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.640+0000 7fa0a90a6640 1 -- 172.21.15.60:0/4291348573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a40cfb70 msgr2=0x7fa0a41f7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.640+0000 7fa0a90a6640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a40cfb70 0x7fa0a41f7be0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c4a0 tx=0x7fa08c00c960 comp rx=0 tx=0).stop 2024-09-12T01:38:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.640+0000 7fa0a90a6640 1 -- 172.21.15.60:0/4291348573 shutdown_connections 2024-09-12T01:38:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.640+0000 7fa0a90a6640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa08406be30 0x7fa08406e2f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.640+0000 7fa0a90a6640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0a415e750 0x7fa0a41f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.640+0000 7fa0a90a6640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0a40cfb70 0x7fa0a41f7be0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.640+0000 7fa0a90a6640 1 --2- 172.21.15.60:0/4291348573 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0a40b6bb0 0x7fa0a415c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.640+0000 7fa0a90a6640 1 -- 172.21.15.60:0/4291348573 >> 172.21.15.60:0/4291348573 conn(0x7fa0a40d1500 msgr2=0x7fa0a406bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.640+0000 7fa0a90a6640 1 -- 172.21.15.60:0/4291348573 shutdown_connections 2024-09-12T01:38:29.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.640+0000 7fa0a90a6640 1 -- 172.21.15.60:0/4291348573 wait complete. 2024-09-12T01:38:29.652 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps' 2024-09-12T01:38:29.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.754+0000 7feba0118640 1 Processor -- start 2024-09-12T01:38:29.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.754+0000 7feba0118640 1 -- start start 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.755+0000 7feba0118640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feb9815a9c0 0x7feb9815e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.755+0000 7feba0118640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feb980b5be0 0x7feb9815eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.755+0000 7feba0118640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb980b29a0 0x7feb980b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.755+0000 7feba0118640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7feb9815f410 con 0x7feb9815a9c0 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.755+0000 7feba0118640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7feb980b6830 con 0x7feb980b5be0 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.755+0000 7feba0118640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feb980cd0b0 con 0x7feb980b29a0 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.755+0000 7feb9deb4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feb9815a9c0 0x7feb9815e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.755+0000 7feb9deb4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feb9815a9c0 0x7feb9815e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50972/0 (socket says 172.21.15.60:50972) 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.755+0000 7feb9deb4640 1 -- 172.21.15.60:0/2991834131 learned_addr learned my addr 172.21.15.60:0/2991834131 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.756+0000 7feb9d6b3640 1 --2- 172.21.15.60:0/2991834131 >> v2:172.21.15.105:3300/0 conn(0x7feb980b5be0 0x7feb9815eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.756+0000 7feb9e6b5640 1 --2- 172.21.15.60:0/2991834131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb980b29a0 0x7feb980b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.756+0000 7feb9deb4640 1 -- 172.21.15.60:0/2991834131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb980b29a0 msgr2=0x7feb980b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.756+0000 7feb9deb4640 1 --2- 172.21.15.60:0/2991834131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb980b29a0 0x7feb980b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.756+0000 7feb9deb4640 1 -- 172.21.15.60:0/2991834131 >> v2:172.21.15.105:3300/0 conn(0x7feb980b5be0 msgr2=0x7feb9815eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.756+0000 7feb9deb4640 1 --2- 172.21.15.60:0/2991834131 >> v2:172.21.15.105:3300/0 conn(0x7feb980b5be0 0x7feb9815eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.756+0000 7feb9deb4640 1 -- 172.21.15.60:0/2991834131 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb980cd390 con 0x7feb9815a9c0 2024-09-12T01:38:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.756+0000 7feb9e6b5640 1 --2- 172.21.15.60:0/2991834131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb980b29a0 0x7feb980b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:29.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.756+0000 7feb9d6b3640 1 --2- 172.21.15.60:0/2991834131 >> v2:172.21.15.105:3300/0 conn(0x7feb980b5be0 0x7feb9815eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.756+0000 7feb9deb4640 1 --2- 172.21.15.60:0/2991834131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb9815a9c0 0x7feb9815e600 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feb980ccd90 tx=0x7feb8802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28895653ff18849 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.757+0000 7feb9ceb2640 1 -- 172.21.15.60:0/2991834131 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb88036070 con 0x7feb9815a9c0 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.757+0000 7feb9ceb2640 1 -- 172.21.15.60:0/2991834131 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb88031600 con 0x7feb9815a9c0 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.757+0000 7feb9ceb2640 1 -- 172.21.15.60:0/2991834131 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb880319d0 con 0x7feb9815a9c0 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.757+0000 7feba0118640 1 -- 172.21.15.60:0/2991834131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb9815a9c0 msgr2=0x7feb9815e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.757+0000 7feba0118640 1 --2- 172.21.15.60:0/2991834131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb9815a9c0 0x7feb9815e600 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feb980ccd90 tx=0x7feb8802a6a0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.757+0000 7feba0118640 1 -- 172.21.15.60:0/2991834131 shutdown_connections 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.757+0000 7feba0118640 1 --2- 172.21.15.60:0/2991834131 >> v2:172.21.15.105:3300/0 conn(0x7feb980b5be0 0x7feb9815eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.757+0000 7feba0118640 1 --2- 172.21.15.60:0/2991834131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb980b29a0 0x7feb980b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.757+0000 7feba0118640 1 --2- 172.21.15.60:0/2991834131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb9815a9c0 0x7feb9815e600 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.757+0000 7feba0118640 1 -- 172.21.15.60:0/2991834131 >> 172.21.15.60:0/2991834131 conn(0x7feb9806bc10 msgr2=0x7feb9806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.757+0000 7feba0118640 1 -- 172.21.15.60:0/2991834131 shutdown_connections 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.757+0000 7feba0118640 1 -- 172.21.15.60:0/2991834131 wait complete. 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.758+0000 7feba0118640 1 Processor -- start 2024-09-12T01:38:29.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.759+0000 7feba0118640 1 -- start start 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.759+0000 7feba0118640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb980b29a0 0x7feb981f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.759+0000 7feba0118640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb980b5be0 0x7feb9815d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.759+0000 7feba0118640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb9815a9c0 0x7feb9815d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.759+0000 7feba0118640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feb9815ada0 con 0x7feb980b5be0 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.759+0000 7feba0118640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feb980cd950 con 0x7feb9815a9c0 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.759+0000 7feba0118640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feb9815f080 con 0x7feb980b29a0 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.759+0000 7feb9d6b3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb980b5be0 0x7feb9815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.759+0000 7feb9d6b3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb980b5be0 0x7feb9815d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50986/0 (socket says 172.21.15.60:50986) 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.759+0000 7feb9d6b3640 1 -- 172.21.15.60:0/899080749 learned_addr learned my addr 172.21.15.60:0/899080749 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:29.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.760+0000 7feb9d6b3640 1 -- 172.21.15.60:0/899080749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb980b29a0 msgr2=0x7feb981f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.760+0000 7feb9d6b3640 1 --2- 172.21.15.60:0/899080749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb980b29a0 0x7feb981f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.760+0000 7feb9d6b3640 1 -- 172.21.15.60:0/899080749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb9815a9c0 msgr2=0x7feb9815d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.760+0000 7feb9d6b3640 1 --2- 172.21.15.60:0/899080749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb9815a9c0 0x7feb9815d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.760+0000 7feb9d6b3640 1 -- 172.21.15.60:0/899080749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb98146c40 con 0x7feb980b5be0 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.760+0000 7feb9d6b3640 1 --2- 172.21.15.60:0/899080749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb980b5be0 0x7feb9815d060 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c7f0 tx=0x7feb8c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.760+0000 7feb967fc640 1 -- 172.21.15.60:0/899080749 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c004230 con 0x7feb980b5be0 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.760+0000 7feb967fc640 1 -- 172.21.15.60:0/899080749 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8c0043d0 con 0x7feb980b5be0 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.760+0000 7feb967fc640 1 -- 172.21.15.60:0/899080749 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c007a70 con 0x7feb980b5be0 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.760+0000 7feba0118640 1 -- 172.21.15.60:0/899080749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb98146f20 con 0x7feb980b5be0 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.760+0000 7feba0118640 1 -- 172.21.15.60:0/899080749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb981f3560 con 0x7feb980b5be0 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.761+0000 7feba0118640 1 -- 172.21.15.60:0/899080749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb980cef80 con 0x7feb980b5be0 2024-09-12T01:38:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.761+0000 7feb967fc640 1 -- 172.21.15.60:0/899080749 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7feb8c007c10 con 0x7feb980b5be0 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.762+0000 7feb967fc640 1 --2- 172.21.15.60:0/899080749 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feb8406be30 0x7feb8406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.762+0000 7feb9deb4640 1 --2- 172.21.15.60:0/899080749 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feb8406be30 0x7feb8406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.762+0000 7feb967fc640 1 -- 172.21.15.60:0/899080749 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7feb8c08ac80 con 0x7feb980b5be0 2024-09-12T01:38:29.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.763+0000 7feb9deb4640 1 --2- 172.21.15.60:0/899080749 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feb8406be30 0x7feb8406e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feb88033000 tx=0x7feb8802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:29.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:29.767+0000 7feb967fc640 1 -- 172.21.15.60:0/899080749 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7feb8c015020 con 0x7feb980b5be0 2024-09-12T01:38:30.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.008+0000 7feba0118640 1 -- 172.21.15.60:0/899080749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]} v 0) -- 0x7feb981f37f0 con 0x7feb980b5be0 2024-09-12T01:38:30.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.027+0000 7feb967fc640 1 -- 172.21.15.60:0/899080749 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]}]=0 v152) ==== 151+0+0 (secure 0 0 0) 0x7feb8c059890 con 0x7feb980b5be0 2024-09-12T01:38:30.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.029+0000 7feba0118640 1 -- 172.21.15.60:0/899080749 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feb8406be30 msgr2=0x7feb8406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.029+0000 7feba0118640 1 --2- 172.21.15.60:0/899080749 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feb8406be30 0x7feb8406e2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7feb88033000 tx=0x7feb8802e000 comp rx=0 tx=0).stop 2024-09-12T01:38:30.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.029+0000 7feba0118640 1 -- 172.21.15.60:0/899080749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb980b5be0 msgr2=0x7feb9815d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.029+0000 7feba0118640 1 --2- 172.21.15.60:0/899080749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb980b5be0 0x7feb9815d060 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c7f0 tx=0x7feb8c00ccb0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.029+0000 7feba0118640 1 -- 172.21.15.60:0/899080749 shutdown_connections 2024-09-12T01:38:30.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.029+0000 7feba0118640 1 --2- 172.21.15.60:0/899080749 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feb9815a9c0 0x7feb9815d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.029+0000 7feba0118640 1 --2- 172.21.15.60:0/899080749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb980b5be0 0x7feb9815d060 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.029+0000 7feba0118640 1 --2- 172.21.15.60:0/899080749 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feb8406be30 0x7feb8406e2f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.029+0000 7feba0118640 1 --2- 172.21.15.60:0/899080749 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feb980b29a0 0x7feb981f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.029+0000 7feba0118640 1 -- 172.21.15.60:0/899080749 >> 172.21.15.60:0/899080749 conn(0x7feb9806bc10 msgr2=0x7feb980b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:30.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.029+0000 7feba0118640 1 -- 172.21.15.60:0/899080749 shutdown_connections 2024-09-12T01:38:30.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.029+0000 7feba0118640 1 -- 172.21.15.60:0/899080749 wait complete. 2024-09-12T01:38:30.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:38:30.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.145+0000 7f0c6dcac640 1 Processor -- start 2024-09-12T01:38:30.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.145+0000 7f0c6dcac640 1 -- start start 2024-09-12T01:38:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.146+0000 7f0c6dcac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6815a060 0x7f0c6806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.146+0000 7f0c6dcac640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0c6815d3d0 0x7f0c6806f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.146+0000 7f0c6dcac640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c68071770 con 0x7f0c680b1990 2024-09-12T01:38:30.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.146+0000 7f0c6dcac640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0c680712e0 con 0x7f0c6815d3d0 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.146+0000 7f0c6dcac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c680709b0 con 0x7f0c6815a060 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.146+0000 7f0c67fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0c680b1990 0x7f0c6815ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48946/0 (socket says 172.21.15.60:48946) 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.146+0000 7f0c67fff640 1 -- 172.21.15.60:0/2454080220 learned_addr learned my addr 172.21.15.60:0/2454080220 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c5ffff640 1 --2- 172.21.15.60:0/2454080220 >> v2:172.21.15.105:3300/0 conn(0x7f0c6815d3d0 0x7f0c6806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c677fe640 1 --2- 172.21.15.60:0/2454080220 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6815a060 0x7f0c6806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2738136614 0 0) 0x7f0c68071770 con 0x7f0c680b1990 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c54003520 con 0x7f0c680b1990 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3306311293 0 0) 0x7f0c54003520 con 0x7f0c680b1990 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6815a060 msgr2=0x7f0c6806f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 --2- 172.21.15.60:0/2454080220 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6815a060 0x7f0c6806f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 >> v2:172.21.15.105:3300/0 conn(0x7f0c6815d3d0 msgr2=0x7f0c6806f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 --2- 172.21.15.60:0/2454080220 >> v2:172.21.15.105:3300/0 conn(0x7f0c6815d3d0 0x7f0c6806f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c68070c90 con 0x7f0c680b1990 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f0c600019f0 con 0x7f0c680b1990 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 >> v1:172.21.15.60:6789/0 conn(0x7f0c680b1990 legacy=0x7f0c6815ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 --2- 172.21.15.60:0/2454080220 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c540039b0 0x7f0c54003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 --2- 172.21.15.60:0/2454080220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54004800 0x7f0c54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 --2- 172.21.15.60:0/2454080220 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6815a060 0x7f0c540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0c680712e0 con 0x7f0c54004800 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c680709b0 con 0x7f0c540039b0 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c5400b9c0 con 0x7f0c6815a060 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c5ffff640 1 --2- 172.21.15.60:0/2454080220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54004800 0x7f0c54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c677fe640 1 --2- 172.21.15.60:0/2454080220 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c540039b0 0x7f0c54003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c67fff640 1 --2- 172.21.15.60:0/2454080220 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6815a060 0x7f0c540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c5ffff640 1 -- 172.21.15.60:0/2454080220 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6815a060 msgr2=0x7f0c540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c5ffff640 1 --2- 172.21.15.60:0/2454080220 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c6815a060 0x7f0c540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c5ffff640 1 -- 172.21.15.60:0/2454080220 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c540039b0 msgr2=0x7f0c54003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.147+0000 7f0c5ffff640 1 --2- 172.21.15.60:0/2454080220 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c540039b0 0x7f0c54003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.148+0000 7f0c5ffff640 1 -- 172.21.15.60:0/2454080220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c54003520 con 0x7f0c54004800 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.148+0000 7f0c5ffff640 1 --2- 172.21.15.60:0/2454080220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54004800 0x7f0c54004c80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009a90 tx=0x7f0c54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73bacdba0b7a6cd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.148+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50036070 con 0x7f0c54004800 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.148+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c50031400 con 0x7f0c54004800 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.148+0000 7f0c66ffd640 1 -- 172.21.15.60:0/2454080220 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c50009690 con 0x7f0c54004800 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.149+0000 7f0c6dcac640 1 -- 172.21.15.60:0/2454080220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54004800 msgr2=0x7f0c54004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.149+0000 7f0c6dcac640 1 --2- 172.21.15.60:0/2454080220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c54004800 0x7f0c54004c80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009a90 tx=0x7f0c54005830 comp rx=0 tx=0).stop 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.149+0000 7f0c67fff640 1 -- 172.21.15.60:0/2454080220 reap_dead start 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.149+0000 7f0c6dcac640 1 -- 172.21.15.60:0/2454080220 shutdown_connections 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.149+0000 7f0c6dcac640 1 -- 172.21.15.60:0/2454080220 >> 172.21.15.60:0/2454080220 conn(0x7f0c680d2430 msgr2=0x7f0c680d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.149+0000 7f0c6dcac640 1 -- 172.21.15.60:0/2454080220 shutdown_connections 2024-09-12T01:38:30.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.149+0000 7f0c6dcac640 1 -- 172.21.15.60:0/2454080220 wait complete. 2024-09-12T01:38:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.150+0000 7f0c6dcac640 1 Processor -- start 2024-09-12T01:38:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.150+0000 7f0c6dcac640 1 -- start start 2024-09-12T01:38:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c6dcac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c54004800 0x7f0c6815da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c6dcac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c681f24c0 0x7f0c68145e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c6dcac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c680b6a50 0x7f0c680b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c6dcac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0c680d1460 con 0x7f0c680b6a50 2024-09-12T01:38:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c6dcac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0c680d12e0 con 0x7f0c681f24c0 2024-09-12T01:38:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c6dcac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0c6806feb0 con 0x7f0c54004800 2024-09-12T01:38:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c680b6a50 0x7f0c680b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c67fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c680b6a50 0x7f0c680b6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51016/0 (socket says 172.21.15.60:51016) 2024-09-12T01:38:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c67fff640 1 -- 172.21.15.60:0/4014884107 learned_addr learned my addr 172.21.15.60:0/4014884107 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c5ffff640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c681f24c0 0x7f0c68145e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c677fe640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c54004800 0x7f0c6815da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c67fff640 1 -- 172.21.15.60:0/4014884107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c54004800 msgr2=0x7f0c6815da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c67fff640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c54004800 0x7f0c6815da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c67fff640 1 -- 172.21.15.60:0/4014884107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c681f24c0 msgr2=0x7f0c68145e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c67fff640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c681f24c0 0x7f0c68145e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.151+0000 7f0c67fff640 1 -- 172.21.15.60:0/4014884107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c681f2c20 con 0x7f0c680b6a50 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.152+0000 7f0c67fff640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c680b6a50 0x7f0c680b6ed0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0c680b1f20 tx=0x7f0c60007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.152+0000 7f0c64ff9640 1 -- 172.21.15.60:0/4014884107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000ac80 con 0x7f0c680b6a50 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.152+0000 7f0c64ff9640 1 -- 172.21.15.60:0/4014884107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c60019070 con 0x7f0c680b6a50 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.152+0000 7f0c64ff9640 1 -- 172.21.15.60:0/4014884107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60013630 con 0x7f0c680b6a50 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.152+0000 7f0c6dcac640 1 -- 172.21.15.60:0/4014884107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c681f2f00 con 0x7f0c680b6a50 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.152+0000 7f0c6dcac640 1 -- 172.21.15.60:0/4014884107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c681f34c0 con 0x7f0c680b6a50 2024-09-12T01:38:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.153+0000 7f0c6dcac640 1 -- 172.21.15.60:0/4014884107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c680b7410 con 0x7f0c680b6a50 2024-09-12T01:38:30.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.153+0000 7f0c64ff9640 1 -- 172.21.15.60:0/4014884107 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0c600137d0 con 0x7f0c680b6a50 2024-09-12T01:38:30.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.154+0000 7f0c64ff9640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c4806be30 0x7f0c4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.154+0000 7f0c64ff9640 1 -- 172.21.15.60:0/4014884107 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f0c6008b140 con 0x7f0c680b6a50 2024-09-12T01:38:30.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.154+0000 7f0c677fe640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c4806be30 0x7f0c4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.154+0000 7f0c677fe640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c4806be30 0x7f0c4806e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009a60 tx=0x7f0c58009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:30.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.158+0000 7f0c64ff9640 1 -- 172.21.15.60:0/4014884107 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0c60059d40 con 0x7f0c680b6a50 2024-09-12T01:38:30.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.334+0000 7f0c6dcac640 1 -- 172.21.15.60:0/4014884107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0c6806c6c0 con 0x7f0c680b6a50 2024-09-12T01:38:30.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.337+0000 7f0c64ff9640 1 -- 172.21.15.60:0/4014884107 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7f0c6000ae20 con 0x7f0c680b6a50 2024-09-12T01:38:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.339+0000 7f0c6dcac640 1 -- 172.21.15.60:0/4014884107 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c4806be30 msgr2=0x7f0c4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.339+0000 7f0c6dcac640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c4806be30 0x7f0c4806e2f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009a60 tx=0x7f0c58009190 comp rx=0 tx=0).stop 2024-09-12T01:38:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.339+0000 7f0c6dcac640 1 -- 172.21.15.60:0/4014884107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c680b6a50 msgr2=0x7f0c680b6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.339+0000 7f0c6dcac640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c680b6a50 0x7f0c680b6ed0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0c680b1f20 tx=0x7f0c60007b10 comp rx=0 tx=0).stop 2024-09-12T01:38:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.339+0000 7f0c6dcac640 1 -- 172.21.15.60:0/4014884107 shutdown_connections 2024-09-12T01:38:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.339+0000 7f0c6dcac640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c680b6a50 0x7f0c680b6ed0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.339+0000 7f0c6dcac640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0c681f24c0 0x7f0c68145e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.339+0000 7f0c6dcac640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0c4806be30 0x7f0c4806e2f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.339+0000 7f0c6dcac640 1 --2- 172.21.15.60:0/4014884107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0c54004800 0x7f0c6815da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.339+0000 7f0c6dcac640 1 -- 172.21.15.60:0/4014884107 >> 172.21.15.60:0/4014884107 conn(0x7f0c680d2430 msgr2=0x7f0c68158da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.339+0000 7f0c6dcac640 1 -- 172.21.15.60:0/4014884107 shutdown_connections 2024-09-12T01:38:30.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.339+0000 7f0c6dcac640 1 -- 172.21.15.60:0/4014884107 wait complete. 2024-09-12T01:38:30.351 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:38:30.351 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:38:30.397 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:38:30.444 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:38:30.444 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:30.444 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:30.460 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:38:30.460 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:38:30.461 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:30.478 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:38:30.478 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:30.478 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:30.517 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:38:30.517 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:38:30.517 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:30.535 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:38:30.536 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:38:30.536 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:30.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.659+0000 7f0fc2f9f640 1 Processor -- start 2024-09-12T01:38:30.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.659+0000 7f0fc2f9f640 1 -- start start 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fc2f9f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0fbc15c2b0 0x7f0fbc0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fc2f9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fbc15f200 0x7f0fbc06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fc2f9f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fbc15fb10 con 0x7f0fbc0b72f0 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fc2f9f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0fbc0b5900 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fc2f9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc15f830 con 0x7f0fbc15f200 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fc0d3b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0fbc15c2b0 0x7f0fbc0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fbbfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0fbc0b72f0 0x7f0fbc15eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48952/0 (socket says 172.21.15.60:48952) 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fbbfff640 1 -- 172.21.15.60:0/703949645 learned_addr learned my addr 172.21.15.60:0/703949645 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fc153c640 1 --2- 172.21.15.60:0/703949645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fbc15f200 0x7f0fbc06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fc0d3b640 1 -- 172.21.15.60:0/703949645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fbc15f200 msgr2=0x7f0fbc06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fc0d3b640 1 --2- 172.21.15.60:0/703949645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fbc15f200 0x7f0fbc06d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fc0d3b640 1 -- 172.21.15.60:0/703949645 >> v1:172.21.15.60:6789/0 conn(0x7f0fbc0b72f0 legacy=0x7f0fbc15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fc0d3b640 1 -- 172.21.15.60:0/703949645 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc06ce30 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.660+0000 7f0fbb7fe640 1 -- 172.21.15.60:0/703949645 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897967879 0 0) 0x7f0fbc15fb10 con 0x7f0fbc0b72f0 2024-09-12T01:38:30.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.661+0000 7f0fc0d3b640 1 --2- 172.21.15.60:0/703949645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc15c2b0 0x7f0fbc0b6db0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0097a0 tx=0x7f0fac02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6ed061eaae2a10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.661+0000 7f0fbb7fe640 1 -- 172.21.15.60:0/703949645 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac037070 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.661+0000 7f0fbb7fe640 1 -- 172.21.15.60:0/703949645 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fac032440 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.661+0000 7f0fbb7fe640 1 -- 172.21.15.60:0/703949645 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac032810 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.662+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/703949645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc15c2b0 msgr2=0x7f0fbc0b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.662+0000 7f0fc2f9f640 1 --2- 172.21.15.60:0/703949645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc15c2b0 0x7f0fbc0b6db0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0097a0 tx=0x7f0fac02a180 comp rx=0 tx=0).stop 2024-09-12T01:38:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.662+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/703949645 shutdown_connections 2024-09-12T01:38:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.662+0000 7f0fc2f9f640 1 --2- 172.21.15.60:0/703949645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fbc15f200 0x7f0fbc06d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.662+0000 7f0fc2f9f640 1 --2- 172.21.15.60:0/703949645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc15c2b0 0x7f0fbc0b6db0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.662+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/703949645 >> 172.21.15.60:0/703949645 conn(0x7f0fbc0b4240 msgr2=0x7f0fbc0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.662+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/703949645 shutdown_connections 2024-09-12T01:38:30.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.662+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/703949645 wait complete. 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.663+0000 7f0fc2f9f640 1 Processor -- start 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.663+0000 7f0fc2f9f640 1 -- start start 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fc2f9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fbc0b72f0 0x7f0fbc0cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fc2f9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc15c2b0 0x7f0fbc155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fc2f9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fbc15f200 0x7f0fbc161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fc2f9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc0b7760 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fc2f9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0fbc06d3f0 con 0x7f0fbc0b72f0 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fc2f9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0fbc06de50 con 0x7f0fbc15f200 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fbbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc15c2b0 0x7f0fbc155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fbbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc15c2b0 0x7f0fbc155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51034/0 (socket says 172.21.15.60:51034) 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fbbfff640 1 -- 172.21.15.60:0/2212052061 learned_addr learned my addr 172.21.15.60:0/2212052061 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fc153c640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fbc15f200 0x7f0fbc161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fc0d3b640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fbc0b72f0 0x7f0fbc0cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fbbfff640 1 -- 172.21.15.60:0/2212052061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fbc15f200 msgr2=0x7f0fbc161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fbbfff640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fbc15f200 0x7f0fbc161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fbbfff640 1 -- 172.21.15.60:0/2212052061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fbc0b72f0 msgr2=0x7f0fbc0cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fbbfff640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fbc0b72f0 0x7f0fbc0cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fbbfff640 1 -- 172.21.15.60:0/2212052061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fbc159510 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.664+0000 7f0fc0d3b640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fbc0b72f0 0x7f0fbc0cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:30.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.665+0000 7f0fbbfff640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc15c2b0 0x7f0fbc155240 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c4d0 tx=0x7f0fb000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:30.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.665+0000 7f0fb97fa640 1 -- 172.21.15.60:0/2212052061 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0018070 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.665+0000 7f0fb97fa640 1 -- 172.21.15.60:0/2212052061 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb0007500 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.665+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/2212052061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fbc1e7910 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.665+0000 7f0fb97fa640 1 -- 172.21.15.60:0/2212052061 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0004a20 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.665+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/2212052061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fbc1e7bb0 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.666+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/2212052061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fbc0b6db0 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.666+0000 7f0fb97fa640 1 -- 172.21.15.60:0/2212052061 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0fb001b070 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.667+0000 7f0fb97fa640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0fa806be30 0x7f0fa806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.667+0000 7f0fb97fa640 1 -- 172.21.15.60:0/2212052061 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7f0fb0089e00 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.667+0000 7f0fc0d3b640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0fa806be30 0x7f0fa806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.667+0000 7f0fc0d3b640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0fa806be30 0x7f0fa806e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0fac034000 tx=0x7f0fac02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:30.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.671+0000 7f0fb97fa640 1 -- 172.21.15.60:0/2212052061 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0fb0058b40 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.879+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/2212052061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fbc155780 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.879+0000 7f0fb97fa640 1 -- 172.21.15.60:0/2212052061 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+3906 (secure 0 0 0) 0x7f0fb0058440 con 0x7f0fbc15c2b0 2024-09-12T01:38:30.880 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:30.880 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":32,"btime":"2024-09-12T01:38:26:015315+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3035828205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3035828205},{"type":"v1","addr":"172.21.15.105:6835","nonce":3035828205}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3403684617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3403684617},{"type":"v1","addr":"172.21.15.60:6837","nonce":3403684617}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/343463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":343463},{"type":"v1","addr":"172.21.15.60:6836","nonce":343463}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":34985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/2046884414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2046884414},{"type":"v1","addr":"172.21.15.105:6834","nonce":2046884414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[]} 2024-09-12T01:38:30.881 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 32 2024-09-12T01:38:30.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.881+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/2212052061 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0fa806be30 msgr2=0x7f0fa806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.881+0000 7f0fc2f9f640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0fa806be30 0x7f0fa806e2f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0fac034000 tx=0x7f0fac02e000 comp rx=0 tx=0).stop 2024-09-12T01:38:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.881+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/2212052061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc15c2b0 msgr2=0x7f0fbc155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.881+0000 7f0fc2f9f640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc15c2b0 0x7f0fbc155240 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0fb000c4d0 tx=0x7f0fb000c990 comp rx=0 tx=0).stop 2024-09-12T01:38:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.882+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/2212052061 shutdown_connections 2024-09-12T01:38:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.882+0000 7f0fc2f9f640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0fa806be30 0x7f0fa806e2f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.882+0000 7f0fc2f9f640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0fbc15f200 0x7f0fbc161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.882+0000 7f0fc2f9f640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fbc15c2b0 0x7f0fbc155240 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.882+0000 7f0fc2f9f640 1 --2- 172.21.15.60:0/2212052061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0fbc0b72f0 0x7f0fbc0cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.882+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/2212052061 >> 172.21.15.60:0/2212052061 conn(0x7f0fbc0b4240 msgr2=0x7f0fbc15e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.882+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/2212052061 shutdown_connections 2024-09-12T01:38:30.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:30.882+0000 7f0fc2f9f640 1 -- 172.21.15.60:0/2212052061 wait complete. 2024-09-12T01:38:30.893 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:38:30.894 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:38:30.894 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:38:30.894 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:38:30.894 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:38:30.894 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:38:30.894 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:38:30.894 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:38:30.895 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:38:30.895 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:38:30.895 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:38:30.895 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:38:30.895 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:38:30.895 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:38:30.895 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:38:30.895 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:38:30.903 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:38:30.903 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:38:30.904 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:38:30.904 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:38:30.907 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:38:30.908 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:38:30.908 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:38:30.908 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:38:30.948 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:38:30.948 DEBUG:teuthology.parallel:result is None 2024-09-12T01:38:30.949 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:38:30.949 DEBUG:teuthology.parallel:result is None 2024-09-12T01:38:30.950 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:38:30.951 DEBUG:teuthology.parallel:result is None 2024-09-12T01:38:30.951 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:38:30.951 DEBUG:teuthology.parallel:result is None 2024-09-12T01:38:30.951 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:38:31.026 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2024-09-12T01:38:31.026 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2024-09-12T01:38:31.035 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:38:31.036 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:38:31.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.058+0000 7fc8fc51f640 1 Processor -- start 2024-09-12T01:38:31.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.058+0000 7fc8fc51f640 1 -- start start 2024-09-12T01:38:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.059+0000 7fc8fc51f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f40cf1f0 0x7fc8f40b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.059+0000 7fc8fc51f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc8f40b6720 0x7fc8f40d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.059+0000 7fc8fc51f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8f40cf860 con 0x7fc8f415e7a0 2024-09-12T01:38:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.059+0000 7fc8fc51f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc8f40d2ca0 con 0x7fc8f40b6720 2024-09-12T01:38:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.059+0000 7fc8fc51f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f40cfb40 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.060+0000 7fc8f9aba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f40cf1f0 0x7fc8f40b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.060+0000 7fc8faabc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc8f40b6720 0x7fc8f40d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.060+0000 7fc8fa2bb640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fc8f415e7a0 0x7fc8f406caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:36054/0 (socket says 172.21.15.60:36054) 2024-09-12T01:38:31.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.060+0000 7fc8fa2bb640 1 -- 172.21.15.60:0/764752682 learned_addr learned my addr 172.21.15.60:0/764752682 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.060+0000 7fc8f9aba640 1 -- 172.21.15.60:0/764752682 >> v2:172.21.15.105:3300/0 conn(0x7fc8f40b6720 msgr2=0x7fc8f40d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.060+0000 7fc8f9aba640 1 --2- 172.21.15.60:0/764752682 >> v2:172.21.15.105:3300/0 conn(0x7fc8f40b6720 0x7fc8f40d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.060+0000 7fc8f9aba640 1 -- 172.21.15.60:0/764752682 >> v1:172.21.15.105:6789/0 conn(0x7fc8f415e7a0 legacy=0x7fc8f406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.060+0000 7fc8f9aba640 1 -- 172.21.15.60:0/764752682 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f40cfe20 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.060+0000 7fc8faabc640 1 --2- 172.21.15.60:0/764752682 >> v2:172.21.15.105:3300/0 conn(0x7fc8f40b6720 0x7fc8f40d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.061+0000 7fc8f9aba640 1 --2- 172.21.15.60:0/764752682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f40cf1f0 0x7fc8f40b61e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40097a0 tx=0x7fc8e402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c617812949e6ac88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.061+0000 7fc8f92b9640 1 -- 172.21.15.60:0/764752682 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4037070 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.061+0000 7fc8f92b9640 1 -- 172.21.15.60:0/764752682 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e402ae50 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.061+0000 7fc8f92b9640 1 -- 172.21.15.60:0/764752682 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4032660 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.061+0000 7fc8fc51f640 1 -- 172.21.15.60:0/764752682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f40cf1f0 msgr2=0x7fc8f40b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.061+0000 7fc8fc51f640 1 --2- 172.21.15.60:0/764752682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f40cf1f0 0x7fc8f40b61e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40097a0 tx=0x7fc8e402a100 comp rx=0 tx=0).stop 2024-09-12T01:38:31.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.061+0000 7fc8fc51f640 1 -- 172.21.15.60:0/764752682 shutdown_connections 2024-09-12T01:38:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.061+0000 7fc8fc51f640 1 --2- 172.21.15.60:0/764752682 >> v2:172.21.15.105:3300/0 conn(0x7fc8f40b6720 0x7fc8f40d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.061+0000 7fc8fc51f640 1 --2- 172.21.15.60:0/764752682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f40cf1f0 0x7fc8f40b61e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.061+0000 7fc8fc51f640 1 -- 172.21.15.60:0/764752682 >> 172.21.15.60:0/764752682 conn(0x7fc8f40d11e0 msgr2=0x7fc8f40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.061+0000 7fc8fc51f640 1 -- 172.21.15.60:0/764752682 shutdown_connections 2024-09-12T01:38:31.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.061+0000 7fc8fc51f640 1 -- 172.21.15.60:0/764752682 wait complete. 2024-09-12T01:38:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.062+0000 7fc8fc51f640 1 Processor -- start 2024-09-12T01:38:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.063+0000 7fc8fc51f640 1 -- start start 2024-09-12T01:38:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.063+0000 7fc8fc51f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8f40b6720 0x7fc8f414f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.063+0000 7fc8fc51f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8f40cf1f0 0x7fc8f4160b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.063+0000 7fc8fc51f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f415e7a0 0x7fc8f4158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.063+0000 7fc8fc51f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f415eb80 con 0x7fc8f40b6720 2024-09-12T01:38:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.063+0000 7fc8fc51f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f40b7a00 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.063+0000 7fc8fc51f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f415ed00 con 0x7fc8f415e7a0 2024-09-12T01:38:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.063+0000 7fc8fa2bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8f40b6720 0x7fc8f414f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.063+0000 7fc8f9aba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8f40cf1f0 0x7fc8f4160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.063+0000 7fc8fa2bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8f40b6720 0x7fc8f414f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51074/0 (socket says 172.21.15.60:51074) 2024-09-12T01:38:31.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.063+0000 7fc8fa2bb640 1 -- 172.21.15.60:0/1845239498 learned_addr learned my addr 172.21.15.60:0/1845239498 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8faabc640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f415e7a0 0x7fc8f4158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8f9aba640 1 -- 172.21.15.60:0/1845239498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f415e7a0 msgr2=0x7fc8f4158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8f9aba640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f415e7a0 0x7fc8f4158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8f9aba640 1 -- 172.21.15.60:0/1845239498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8f40b6720 msgr2=0x7fc8f414f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8f9aba640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8f40b6720 0x7fc8f414f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8f9aba640 1 -- 172.21.15.60:0/1845239498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f414fd30 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8fa2bb640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8f40b6720 0x7fc8f414f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8f9aba640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8f40cf1f0 0x7fc8f4160b40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4031000 tx=0x7fc8e40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:31.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8eaffd640 1 -- 172.21.15.60:0/1845239498 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4042070 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8eaffd640 1 -- 172.21.15.60:0/1845239498 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8e4032e20 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8fc51f640 1 -- 172.21.15.60:0/1845239498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f40cba80 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8eaffd640 1 -- 172.21.15.60:0/1845239498 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8e4037040 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.064+0000 7fc8fc51f640 1 -- 172.21.15.60:0/1845239498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f40cc040 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.065+0000 7fc8fc51f640 1 -- 172.21.15.60:0/1845239498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f40cb810 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.066+0000 7fc8eaffd640 1 -- 172.21.15.60:0/1845239498 <== mon.1 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8e4045070 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.066+0000 7fc8eaffd640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc8d806be30 0x7fc8d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:31.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.066+0000 7fc8fa2bb640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc8d806be30 0x7fc8d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:31.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.066+0000 7fc8eaffd640 1 -- 172.21.15.60:0/1845239498 <== mon.1 v2:172.21.15.105:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 4943+0+0 (secure 0 0 0) 0x7fc8e40ab450 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.067+0000 7fc8fa2bb640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc8d806be30 0x7fc8d806e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0004e60 tx=0x7fc8f0007f10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:31.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.071+0000 7fc8eaffd640 1 -- 172.21.15.60:0/1845239498 <== mon.1 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8e4079a10 con 0x7fc8f40cf1f0 2024-09-12T01:38:31.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:31.259+0000 7fc8fc51f640 1 -- 172.21.15.60:0/1845239498 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc8f40b4dc0 con 0x7fc8f40cf1f0 2024-09-12T01:38:32.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.044+0000 7fc8eaffd640 1 -- 172.21.15.60:0/1845239498 <== mon.1 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) ==== 97+0+0 (secure 0 0 0) 0x7fc8e407dd10 con 0x7fc8f40cf1f0 2024-09-12T01:38:32.045 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2024-09-12T01:38:32.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.047+0000 7fc8fc51f640 1 -- 172.21.15.60:0/1845239498 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc8d806be30 msgr2=0x7fc8d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.047+0000 7fc8fc51f640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc8d806be30 0x7fc8d806e2f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0004e60 tx=0x7fc8f0007f10 comp rx=0 tx=0).stop 2024-09-12T01:38:32.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.047+0000 7fc8fc51f640 1 -- 172.21.15.60:0/1845239498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8f40cf1f0 msgr2=0x7fc8f4160b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.047+0000 7fc8fc51f640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8f40cf1f0 0x7fc8f4160b40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4031000 tx=0x7fc8e40046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.048+0000 7fc8fc51f640 1 -- 172.21.15.60:0/1845239498 shutdown_connections 2024-09-12T01:38:32.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.048+0000 7fc8fc51f640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc8d806be30 0x7fc8d806e2f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.048+0000 7fc8fc51f640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8f415e7a0 0x7fc8f4158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.048+0000 7fc8fc51f640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8f40cf1f0 0x7fc8f4160b40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.048+0000 7fc8fc51f640 1 --2- 172.21.15.60:0/1845239498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8f40b6720 0x7fc8f414f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.048+0000 7fc8fc51f640 1 -- 172.21.15.60:0/1845239498 >> 172.21.15.60:0/1845239498 conn(0x7fc8f40d11e0 msgr2=0x7fc8f40d15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.048+0000 7fc8fc51f640 1 -- 172.21.15.60:0/1845239498 shutdown_connections 2024-09-12T01:38:32.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.048+0000 7fc8fc51f640 1 -- 172.21.15.60:0/1845239498 wait complete. 2024-09-12T01:38:32.062 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:38:32.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.172+0000 7f282d20e640 1 Processor -- start 2024-09-12T01:38:32.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.172+0000 7f282d20e640 1 -- start start 2024-09-12T01:38:32.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.173+0000 7f282d20e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28280b74c0 0x7f282815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.173+0000 7f282d20e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f282815fb10 con 0x7f282815f030 2024-09-12T01:38:32.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.173+0000 7f282d20e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28280b5900 con 0x7f282815c2b0 2024-09-12T01:38:32.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.173+0000 7f282d20e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f282815f830 con 0x7f28280b74c0 2024-09-12T01:38:32.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.173+0000 7f282759e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f282815f030 0x7f282806d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48978/0 (socket says 172.21.15.60:48978) 2024-09-12T01:38:32.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.173+0000 7f282759e640 1 -- 172.21.15.60:0/3729865824 learned_addr learned my addr 172.21.15.60:0/3729865824 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:32.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.173+0000 7f282659c640 1 --2- 172.21.15.60:0/3729865824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28280b74c0 0x7f282815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.173+0000 7f2825d9b640 1 -- 172.21.15.60:0/3729865824 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010262175 0 0) 0x7f282815fb10 con 0x7f282815f030 2024-09-12T01:38:32.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.173+0000 7f2825d9b640 1 -- 172.21.15.60:0/3729865824 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2814003520 con 0x7f282815f030 2024-09-12T01:38:32.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.174+0000 7f2825d9b640 1 -- 172.21.15.60:0/3729865824 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766721733 0 0) 0x7f28280b5900 con 0x7f282815c2b0 2024-09-12T01:38:32.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.174+0000 7f2825d9b640 1 -- 172.21.15.60:0/3729865824 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f282815fb10 con 0x7f282815c2b0 2024-09-12T01:38:32.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.174+0000 7f2825d9b640 1 -- 172.21.15.60:0/3729865824 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2521411210 0 0) 0x7f2814003520 con 0x7f282815f030 2024-09-12T01:38:32.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.174+0000 7f282659c640 1 -- 172.21.15.60:0/3729865824 >> v1:172.21.15.105:6789/0 conn(0x7f282815c2b0 legacy=0x7f28280b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.174+0000 7f282659c640 1 -- 172.21.15.60:0/3729865824 >> v1:172.21.15.60:6789/0 conn(0x7f282815f030 legacy=0x7f282806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.174+0000 7f282659c640 1 -- 172.21.15.60:0/3729865824 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282806ce30 con 0x7f28280b74c0 2024-09-12T01:38:32.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.174+0000 7f282659c640 1 --2- 172.21.15.60:0/3729865824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28280b74c0 0x7f282815eaf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f28100097d0 tx=0x7f281002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a63662a1e04bb83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:32.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.175+0000 7f2825d9b640 1 -- 172.21.15.60:0/3729865824 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810037070 con 0x7f28280b74c0 2024-09-12T01:38:32.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.175+0000 7f2825d9b640 1 -- 172.21.15.60:0/3729865824 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281002ac30 con 0x7f28280b74c0 2024-09-12T01:38:32.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.175+0000 7f2825d9b640 1 -- 172.21.15.60:0/3729865824 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820001670 con 0x7f28280b74c0 2024-09-12T01:38:32.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.175+0000 7f282d20e640 1 -- 172.21.15.60:0/3729865824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28280b74c0 msgr2=0x7f282815eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.175+0000 7f282d20e640 1 --2- 172.21.15.60:0/3729865824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28280b74c0 0x7f282815eaf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f28100097d0 tx=0x7f281002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.175+0000 7f282d20e640 1 -- 172.21.15.60:0/3729865824 shutdown_connections 2024-09-12T01:38:32.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.175+0000 7f282d20e640 1 --2- 172.21.15.60:0/3729865824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28280b74c0 0x7f282815eaf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.175+0000 7f282d20e640 1 -- 172.21.15.60:0/3729865824 >> 172.21.15.60:0/3729865824 conn(0x7f28280b4240 msgr2=0x7f28280b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:32.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.175+0000 7f282d20e640 1 -- 172.21.15.60:0/3729865824 shutdown_connections 2024-09-12T01:38:32.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.175+0000 7f282d20e640 1 -- 172.21.15.60:0/3729865824 wait complete. 2024-09-12T01:38:32.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.177+0000 7f282d20e640 1 Processor -- start 2024-09-12T01:38:32.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.177+0000 7f282d20e640 1 -- start start 2024-09-12T01:38:32.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.177+0000 7f282d20e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28280b74c0 0x7f2828160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282d20e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f282815c2b0 0x7f28281613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282d20e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f282815f030 0x7f28280cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282d20e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f282815f4c0 con 0x7f282815f030 2024-09-12T01:38:32.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282d20e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f282806d3f0 con 0x7f28280b74c0 2024-09-12T01:38:32.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282d20e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f282806e020 con 0x7f282815c2b0 2024-09-12T01:38:32.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f282815f030 0x7f28280cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f282815f030 0x7f28280cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51088/0 (socket says 172.21.15.60:51088) 2024-09-12T01:38:32.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282759e640 1 -- 172.21.15.60:0/1332511961 learned_addr learned my addr 172.21.15.60:0/1332511961 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:32.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f2826d9d640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28280b74c0 0x7f2828160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282659c640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f282815c2b0 0x7f28281613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282759e640 1 -- 172.21.15.60:0/1332511961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f282815c2b0 msgr2=0x7f28281613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282759e640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f282815c2b0 0x7f28281613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282759e640 1 -- 172.21.15.60:0/1332511961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28280b74c0 msgr2=0x7f2828160e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282759e640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28280b74c0 0x7f2828160e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282759e640 1 -- 172.21.15.60:0/1332511961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28281560d0 con 0x7f282815f030 2024-09-12T01:38:32.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282659c640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f282815c2b0 0x7f28281613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:32.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282759e640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f282815f030 0x7f28280cc910 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2820000fd0 tx=0x7f282000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:32.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f281f7fe640 1 -- 172.21.15.60:0/1332511961 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820017070 con 0x7f282815f030 2024-09-12T01:38:32.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f281f7fe640 1 -- 172.21.15.60:0/1332511961 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2820005ce0 con 0x7f282815f030 2024-09-12T01:38:32.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282d20e640 1 -- 172.21.15.60:0/1332511961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28281563b0 con 0x7f282815f030 2024-09-12T01:38:32.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f281f7fe640 1 -- 172.21.15.60:0/1332511961 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28200072b0 con 0x7f282815f030 2024-09-12T01:38:32.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.178+0000 7f282d20e640 1 -- 172.21.15.60:0/1332511961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28281554e0 con 0x7f282815f030 2024-09-12T01:38:32.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.180+0000 7f282d20e640 1 -- 172.21.15.60:0/1332511961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28280719d0 con 0x7f282815f030 2024-09-12T01:38:32.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.180+0000 7f281f7fe640 1 -- 172.21.15.60:0/1332511961 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f282001a070 con 0x7f282815f030 2024-09-12T01:38:32.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.181+0000 7f281f7fe640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f280806be60 0x7f280806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.181+0000 7f2826d9d640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f280806be60 0x7f280806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.181+0000 7f281f7fe640 1 -- 172.21.15.60:0/1332511961 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4857+0+0 (secure 0 0 0) 0x7f2820089f10 con 0x7f282815f030 2024-09-12T01:38:32.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.181+0000 7f2826d9d640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f280806be60 0x7f280806e320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2818001560 tx=0x7f2818009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:32.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.185+0000 7f281f7fe640 1 -- 172.21.15.60:0/1332511961 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f28280719d0 con 0x7f282815f030 2024-09-12T01:38:32.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.425+0000 7f282d20e640 1 -- 172.21.15.60:0/1332511961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f282815eaf0 con 0x7f282815f030 2024-09-12T01:38:32.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.426+0000 7f281f7fe640 1 -- 172.21.15.60:0/1332511961 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7f2820058c10 con 0x7f282815f030 2024-09-12T01:38:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:32.426 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:38:32.426 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmIK3fKxAAM9RkghDZwJZWuKouIbObDw==", 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2024-09-12T01:38:32.427 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmzqHZNxAAnhCo4gGwLgYDVzzYnoiDFA==", 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmksMWMxAAp3xMDD09rfphgPZwQcEABA==", 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:32.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmvLw/AxAApd4hl5LRD1QddnPPjRw2Kg==", 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA7ReJmc3D/JxAAXiw6n1Q3n9sCXln6YSiCBA==", 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA/ReJmEOu3CxAA4uu1neLh0mpeG9nia+/VqQ==", 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.430 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBCReJm3HHtDhAAoAdKVsjuXmpcf5R5zTtFKg==", 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBFReJmtRLuIBAA/BBibpGfpXsFXqVjVrmXWA==", 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBMReJmdDNXKhAAeh5aCvMw+70z3tnwjb9Hjg==", 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:32.432 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBQReJm/tsIHRAAmgx+5WifY/VITGHAbUV2CQ==", 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBUReJmQFaBHhAA1vH01tePCoJQFXlHB5gcVg==", 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBYReJmTHqLAhAAtUB94Pa3eihlVdaupZ8Ggg==", 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:38:32.434 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ==", 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.435 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmTopGEBAAY0K3iZm2PotQc8a489uO/Q==", 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmqUgQDRAAAp5SAwNM9aSxZ1VVRwroNA==", 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.436 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmGfzeFRAAE2xCnzeyX/KBo3NBrkixYQ==", 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:38:32.437 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmOfXYDxAA0hydSyRvFmmNvFcRwPaXqg==", 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.438 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2024-09-12T01:38:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmjpyMKBAAMSGgYJddHs7TtCV0NszZAQ==", 2024-09-12T01:38:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:38:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:38:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:38:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2024-09-12T01:38:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJm3Ei+JBAAhwgXWq0baTlDtaLedcaHmg==", 2024-09-12T01:38:32.439 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:38:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:38:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:38:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:38:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.440 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T01:38:32.440 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:38:32.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.428+0000 7f282d20e640 1 -- 172.21.15.60:0/1332511961 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f280806be60 msgr2=0x7f280806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.428+0000 7f282d20e640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f280806be60 0x7f280806e320 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2818001560 tx=0x7f2818009040 comp rx=0 tx=0).stop 2024-09-12T01:38:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.428+0000 7f282d20e640 1 -- 172.21.15.60:0/1332511961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f282815f030 msgr2=0x7f28280cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.428+0000 7f282d20e640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f282815f030 0x7f28280cc910 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2820000fd0 tx=0x7f282000c980 comp rx=0 tx=0).stop 2024-09-12T01:38:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.428+0000 7f282d20e640 1 -- 172.21.15.60:0/1332511961 shutdown_connections 2024-09-12T01:38:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.428+0000 7f282d20e640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f282815f030 0x7f28280cc910 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.428+0000 7f282d20e640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f280806be60 0x7f280806e320 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.428+0000 7f282d20e640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f282815c2b0 0x7f28281613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.428+0000 7f282d20e640 1 --2- 172.21.15.60:0/1332511961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28280b74c0 0x7f2828160e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.428+0000 7f282d20e640 1 -- 172.21.15.60:0/1332511961 >> 172.21.15.60:0/1332511961 conn(0x7f28280b4240 msgr2=0x7f2828158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.428+0000 7f282d20e640 1 -- 172.21.15.60:0/1332511961 shutdown_connections 2024-09-12T01:38:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.428+0000 7f282d20e640 1 -- 172.21.15.60:0/1332511961 wait complete. 2024-09-12T01:38:32.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:38:32.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.545+0000 7f7e76db7640 1 Processor -- start 2024-09-12T01:38:32.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.545+0000 7f7e76db7640 1 -- start start 2024-09-12T01:38:32.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e76db7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7e700b4920 0x7f7e7015b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e76db7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e700cd780 0x7f7e700cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e76db7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e700ce4f0 con 0x7f7e700b4d00 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e76db7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7e700cf100 con 0x7f7e700b4920 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e76db7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7e700ce7d0 con 0x7f7e700cd780 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e74b53640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7e700b4920 0x7f7e7015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e74b53640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7e700b4920 0x7f7e7015b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53874/0 (socket says 172.21.15.60:53874) 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e74b53640 1 -- 172.21.15.60:0/1886277155 learned_addr learned my addr 172.21.15.60:0/1886277155 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e74b53640 1 -- 172.21.15.60:0/1886277155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e700cd780 msgr2=0x7f7e700cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e75354640 1 --2- 172.21.15.60:0/1886277155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e700cd780 0x7f7e700cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e74b53640 1 --2- 172.21.15.60:0/1886277155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e700cd780 0x7f7e700cdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e74b53640 1 -- 172.21.15.60:0/1886277155 >> v1:172.21.15.105:6789/0 conn(0x7f7e700b4d00 legacy=0x7f7e700b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.546+0000 7f7e74b53640 1 -- 172.21.15.60:0/1886277155 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e700ceab0 con 0x7f7e700b4920 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.547+0000 7f7e74b53640 1 --2- 172.21.15.60:0/1886277155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e700b4920 0x7f7e7015b7d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009870 tx=0x7f7e6402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6e538996a64155 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.547+0000 7f7e6f7fe640 1 -- 172.21.15.60:0/1886277155 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64037070 con 0x7f7e700b4920 2024-09-12T01:38:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.547+0000 7f7e6f7fe640 1 -- 172.21.15.60:0/1886277155 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e64032440 con 0x7f7e700b4920 2024-09-12T01:38:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.547+0000 7f7e6f7fe640 1 -- 172.21.15.60:0/1886277155 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64032810 con 0x7f7e700b4920 2024-09-12T01:38:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.548+0000 7f7e76db7640 1 -- 172.21.15.60:0/1886277155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e700b4920 msgr2=0x7f7e7015b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.548+0000 7f7e76db7640 1 --2- 172.21.15.60:0/1886277155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e700b4920 0x7f7e7015b7d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009870 tx=0x7f7e6402a210 comp rx=0 tx=0).stop 2024-09-12T01:38:32.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.548+0000 7f7e76db7640 1 -- 172.21.15.60:0/1886277155 shutdown_connections 2024-09-12T01:38:32.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.548+0000 7f7e76db7640 1 --2- 172.21.15.60:0/1886277155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e700cd780 0x7f7e700cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.548+0000 7f7e76db7640 1 --2- 172.21.15.60:0/1886277155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e700b4920 0x7f7e7015b7d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.548+0000 7f7e76db7640 1 -- 172.21.15.60:0/1886277155 >> 172.21.15.60:0/1886277155 conn(0x7f7e7006bc10 msgr2=0x7f7e7006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:32.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.548+0000 7f7e76db7640 1 -- 172.21.15.60:0/1886277155 shutdown_connections 2024-09-12T01:38:32.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.548+0000 7f7e76db7640 1 -- 172.21.15.60:0/1886277155 wait complete. 2024-09-12T01:38:32.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.549+0000 7f7e76db7640 1 Processor -- start 2024-09-12T01:38:32.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.549+0000 7f7e76db7640 1 -- start start 2024-09-12T01:38:32.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e76db7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e700b4920 0x7f7e7015ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e76db7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e700b4d00 0x7f7e701e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e76db7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e700cd780 0x7f7e70154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e76db7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7e700ce110 con 0x7f7e700b4920 2024-09-12T01:38:32.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e76db7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7015bd10 con 0x7f7e700b4d00 2024-09-12T01:38:32.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e76db7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7e700ce290 con 0x7f7e700cd780 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e74b53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e700b4920 0x7f7e7015ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e74b53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e700b4920 0x7f7e7015ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53886/0 (socket says 172.21.15.60:53886) 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e74b53640 1 -- 172.21.15.60:0/351475173 learned_addr learned my addr 172.21.15.60:0/351475173 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e6ffff640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e700b4d00 0x7f7e701e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e75354640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e700cd780 0x7f7e70154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e74b53640 1 -- 172.21.15.60:0/351475173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e700cd780 msgr2=0x7f7e70154040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e74b53640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e700cd780 0x7f7e70154040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e74b53640 1 -- 172.21.15.60:0/351475173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e700b4d00 msgr2=0x7f7e701e3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e74b53640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e700b4d00 0x7f7e701e3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.550+0000 7f7e74b53640 1 -- 172.21.15.60:0/351475173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e701e4000 con 0x7f7e700b4920 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.551+0000 7f7e74b53640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e700b4920 0x7f7e7015ac00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009870 tx=0x7f7e640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.551+0000 7f7e6d7fa640 1 -- 172.21.15.60:0/351475173 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64041020 con 0x7f7e700b4920 2024-09-12T01:38:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.551+0000 7f7e6d7fa640 1 -- 172.21.15.60:0/351475173 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e64030970 con 0x7f7e700b4920 2024-09-12T01:38:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.551+0000 7f7e76db7640 1 -- 172.21.15.60:0/351475173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e701583c0 con 0x7f7e700b4920 2024-09-12T01:38:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.551+0000 7f7e6d7fa640 1 -- 172.21.15.60:0/351475173 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e64037040 con 0x7f7e700b4920 2024-09-12T01:38:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.551+0000 7f7e76db7640 1 -- 172.21.15.60:0/351475173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e70158980 con 0x7f7e700b4920 2024-09-12T01:38:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.552+0000 7f7e76db7640 1 -- 172.21.15.60:0/351475173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e700b5450 con 0x7f7e700b4920 2024-09-12T01:38:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.552+0000 7f7e6d7fa640 1 -- 172.21.15.60:0/351475173 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e64044020 con 0x7f7e700b4920 2024-09-12T01:38:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.553+0000 7f7e6d7fa640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7e5406be30 0x7f7e5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.553+0000 7f7e6d7fa640 1 -- 172.21.15.60:0/351475173 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4857+0+0 (secure 0 0 0) 0x7f7e640ab3a0 con 0x7f7e700b4920 2024-09-12T01:38:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.553+0000 7f7e6ffff640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7e5406be30 0x7f7e5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.553+0000 7f7e6ffff640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7e5406be30 0x7f7e5406e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7e701564b0 tx=0x7f7e5c007e30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:32.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.557+0000 7f7e6d7fa640 1 -- 172.21.15.60:0/351475173 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e6404b030 con 0x7f7e700b4920 2024-09-12T01:38:32.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.733+0000 7f7e76db7640 1 -- 172.21.15.60:0/351475173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7e700633d0 con 0x7f7e700b4920 2024-09-12T01:38:32.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.734+0000 7f7e6d7fa640 1 -- 172.21.15.60:0/351475173 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) ==== 84+0+65 (secure 0 0 0) 0x7f7e64079a50 con 0x7f7e700b4920 2024-09-12T01:38:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:32.734 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T01:38:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:38:32.734 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T01:38:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T01:38:32.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:38:32.735 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T01:38:32.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.735+0000 7f7e76db7640 1 -- 172.21.15.60:0/351475173 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7e5406be30 msgr2=0x7f7e5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.735+0000 7f7e76db7640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7e5406be30 0x7f7e5406e2f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7e701564b0 tx=0x7f7e5c007e30 comp rx=0 tx=0).stop 2024-09-12T01:38:32.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.735+0000 7f7e76db7640 1 -- 172.21.15.60:0/351475173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e700b4920 msgr2=0x7f7e7015ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.735+0000 7f7e76db7640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e700b4920 0x7f7e7015ac00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7e64009870 tx=0x7f7e640046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.736+0000 7f7e76db7640 1 -- 172.21.15.60:0/351475173 shutdown_connections 2024-09-12T01:38:32.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.736+0000 7f7e76db7640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7e5406be30 0x7f7e5406e2f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.736+0000 7f7e76db7640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e700cd780 0x7f7e70154040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.736+0000 7f7e76db7640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e700b4d00 0x7f7e701e3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.736+0000 7f7e76db7640 1 --2- 172.21.15.60:0/351475173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e700b4920 0x7f7e7015ac00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.736+0000 7f7e76db7640 1 -- 172.21.15.60:0/351475173 >> 172.21.15.60:0/351475173 conn(0x7f7e7006bc10 msgr2=0x7f7e70070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:32.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.736+0000 7f7e76db7640 1 -- 172.21.15.60:0/351475173 shutdown_connections 2024-09-12T01:38:32.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.736+0000 7f7e76db7640 1 -- 172.21.15.60:0/351475173 wait complete. 2024-09-12T01:38:32.746 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:38:32.747 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:38:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.852+0000 7f9f2c496640 1 Processor -- start 2024-09-12T01:38:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.852+0000 7f9f2c496640 1 -- start start 2024-09-12T01:38:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.853+0000 7f9f2c496640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9f240b3360 0x7f9f24162d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.853+0000 7f9f2c496640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f240cfe70 con 0x7f9f240d1c80 2024-09-12T01:38:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.853+0000 7f9f2c496640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f240cedd0 con 0x7f9f24161be0 2024-09-12T01:38:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.853+0000 7f9f2c496640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9f241632d0 con 0x7f9f240b3360 2024-09-12T01:38:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.853+0000 7f9f2aa33640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9f240b3360 0x7f9f24162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.853+0000 7f9f2aa33640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9f240b3360 0x7f9f24162d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53892/0 (socket says 172.21.15.60:53892) 2024-09-12T01:38:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.853+0000 7f9f2aa33640 1 -- 172.21.15.60:0/35961278 learned_addr learned my addr 172.21.15.60:0/35961278 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.853+0000 7f9f29a31640 1 --1- 172.21.15.60:0/35961278 >> v1:172.21.15.60:6789/0 conn(0x7f9f240d1c80 0x7f9f240d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45368/0 (socket says 172.21.15.60:45368) 2024-09-12T01:38:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.854+0000 7f9f2aa33640 1 -- 172.21.15.60:0/35961278 >> v1:172.21.15.105:6789/0 conn(0x7f9f24161be0 legacy=0x7f9f240d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.854+0000 7f9f2aa33640 1 -- 172.21.15.60:0/35961278 >> v1:172.21.15.60:6789/0 conn(0x7f9f240d1c80 legacy=0x7f9f240d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.854+0000 7f9f2aa33640 1 -- 172.21.15.60:0/35961278 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f240cf0b0 con 0x7f9f240b3360 2024-09-12T01:38:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.854+0000 7f9f29230640 1 -- 172.21.15.60:0/35961278 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1788613905 0 0) 0x7f9f240cfe70 con 0x7f9f240d1c80 2024-09-12T01:38:32.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.854+0000 7f9f2aa33640 1 --2- 172.21.15.60:0/35961278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f240b3360 0x7f9f24162d90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009e50 tx=0x7f9f1402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f327f85bbfc99a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:32.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.855+0000 7f9f29230640 1 -- 172.21.15.60:0/35961278 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14036070 con 0x7f9f240b3360 2024-09-12T01:38:32.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.855+0000 7f9f29230640 1 -- 172.21.15.60:0/35961278 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f14031600 con 0x7f9f240b3360 2024-09-12T01:38:32.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.855+0000 7f9f29230640 1 -- 172.21.15.60:0/35961278 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f140319d0 con 0x7f9f240b3360 2024-09-12T01:38:32.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.855+0000 7f9f2c496640 1 -- 172.21.15.60:0/35961278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f240b3360 msgr2=0x7f9f24162d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.855+0000 7f9f2c496640 1 --2- 172.21.15.60:0/35961278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f240b3360 0x7f9f24162d90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009e50 tx=0x7f9f1402a6d0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.855+0000 7f9f2c496640 1 -- 172.21.15.60:0/35961278 shutdown_connections 2024-09-12T01:38:32.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.855+0000 7f9f2c496640 1 --2- 172.21.15.60:0/35961278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f240b3360 0x7f9f24162d90 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.855+0000 7f9f2c496640 1 -- 172.21.15.60:0/35961278 >> 172.21.15.60:0/35961278 conn(0x7f9f2406c2c0 msgr2=0x7f9f2406c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:32.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.855+0000 7f9f2c496640 1 -- 172.21.15.60:0/35961278 shutdown_connections 2024-09-12T01:38:32.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.855+0000 7f9f2c496640 1 -- 172.21.15.60:0/35961278 wait complete. 2024-09-12T01:38:32.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.857+0000 7f9f2c496640 1 Processor -- start 2024-09-12T01:38:32.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.857+0000 7f9f2c496640 1 -- start start 2024-09-12T01:38:32.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.857+0000 7f9f2c496640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f240b3360 0x7f9f2415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.857+0000 7f9f2c496640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f240d1c80 0x7f9f240ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.857+0000 7f9f2c496640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f24161be0 0x7f9f240b9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.857+0000 7f9f2c496640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9f240cf950 con 0x7f9f24161be0 2024-09-12T01:38:32.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.857+0000 7f9f2c496640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9f240cf670 con 0x7f9f240b3360 2024-09-12T01:38:32.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.857+0000 7f9f2c496640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9f24161fc0 con 0x7f9f240d1c80 2024-09-12T01:38:32.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.857+0000 7f9f2aa33640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f24161be0 0x7f9f240b9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f2aa33640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f24161be0 0x7f9f240b9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53902/0 (socket says 172.21.15.60:53902) 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f2aa33640 1 -- 172.21.15.60:0/3207657542 learned_addr learned my addr 172.21.15.60:0/3207657542 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f29a31640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f240d1c80 0x7f9f240ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f2a232640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f240b3360 0x7f9f2415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f2aa33640 1 -- 172.21.15.60:0/3207657542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f240d1c80 msgr2=0x7f9f240ca810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f2aa33640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f240d1c80 0x7f9f240ca810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f2aa33640 1 -- 172.21.15.60:0/3207657542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f240b3360 msgr2=0x7f9f2415ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f2aa33640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f240b3360 0x7f9f2415ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f2aa33640 1 -- 172.21.15.60:0/3207657542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f240cc730 con 0x7f9f24161be0 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f2aa33640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f24161be0 0x7f9f240b9020 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009e50 tx=0x7f9f14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f22ffd640 1 -- 172.21.15.60:0/3207657542 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14041020 con 0x7f9f24161be0 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f22ffd640 1 -- 172.21.15.60:0/3207657542 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f140077a0 con 0x7f9f24161be0 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f22ffd640 1 -- 172.21.15.60:0/3207657542 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f14036040 con 0x7f9f24161be0 2024-09-12T01:38:32.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f2c496640 1 -- 172.21.15.60:0/3207657542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f240cca10 con 0x7f9f24161be0 2024-09-12T01:38:32.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.858+0000 7f9f2c496640 1 -- 172.21.15.60:0/3207657542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f240ccfd0 con 0x7f9f24161be0 2024-09-12T01:38:32.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.859+0000 7f9f2c496640 1 -- 172.21.15.60:0/3207657542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f24162d90 con 0x7f9f24161be0 2024-09-12T01:38:32.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.860+0000 7f9f22ffd640 1 -- 172.21.15.60:0/3207657542 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9f14044020 con 0x7f9f24161be0 2024-09-12T01:38:32.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.860+0000 7f9f22ffd640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9f1006be30 0x7f9f1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:32.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.860+0000 7f9f22ffd640 1 -- 172.21.15.60:0/3207657542 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 4857+0+0 (secure 0 0 0) 0x7f9f140ab900 con 0x7f9f24161be0 2024-09-12T01:38:32.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.860+0000 7f9f2a232640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9f1006be30 0x7f9f1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:32.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.861+0000 7f9f2a232640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9f1006be30 0x7f9f1006e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9f240b9d30 tx=0x7f9f1c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:32.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:32.864+0000 7f9f22ffd640 1 -- 172.21.15.60:0/3207657542 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9f1404b030 con 0x7f9f24161be0 2024-09-12T01:38:33.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:33.043+0000 7f9f2c496640 1 -- 172.21.15.60:0/3207657542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9f240ba3f0 con 0x7f9f24161be0 2024-09-12T01:38:34.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.050+0000 7f9f22ffd640 1 -- 172.21.15.60:0/3207657542 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) ==== 138+0+0 (secure 0 0 0) 0x7f9f1407a750 con 0x7f9f24161be0 2024-09-12T01:38:34.051 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-12T01:38:34.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.054+0000 7f9f2c496640 1 -- 172.21.15.60:0/3207657542 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9f1006be30 msgr2=0x7f9f1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:34.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.054+0000 7f9f2c496640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9f1006be30 0x7f9f1006e2f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9f240b9d30 tx=0x7f9f1c009040 comp rx=0 tx=0).stop 2024-09-12T01:38:34.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.054+0000 7f9f2c496640 1 -- 172.21.15.60:0/3207657542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f24161be0 msgr2=0x7f9f240b9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:34.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.054+0000 7f9f2c496640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f24161be0 0x7f9f240b9020 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9f14009e50 tx=0x7f9f14004a40 comp rx=0 tx=0).stop 2024-09-12T01:38:34.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.055+0000 7f9f2c496640 1 -- 172.21.15.60:0/3207657542 shutdown_connections 2024-09-12T01:38:34.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.055+0000 7f9f2c496640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f24161be0 0x7f9f240b9020 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:34.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.055+0000 7f9f2c496640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9f1006be30 0x7f9f1006e2f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:34.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.055+0000 7f9f2c496640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9f240d1c80 0x7f9f240ca810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:34.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.055+0000 7f9f2c496640 1 --2- 172.21.15.60:0/3207657542 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9f240b3360 0x7f9f2415ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:34.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.055+0000 7f9f2c496640 1 -- 172.21.15.60:0/3207657542 >> 172.21.15.60:0/3207657542 conn(0x7f9f2406c2c0 msgr2=0x7f9f240b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:34.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.056+0000 7f9f2c496640 1 -- 172.21.15.60:0/3207657542 shutdown_connections 2024-09-12T01:38:34.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.057+0000 7f9f2c496640 1 -- 172.21.15.60:0/3207657542 wait complete. 2024-09-12T01:38:34.072 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:38:34.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.187+0000 7f560794b640 1 Processor -- start 2024-09-12T01:38:34.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.188+0000 7f560794b640 1 -- start start 2024-09-12T01:38:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.188+0000 7f560794b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f560015b480 0x7f56000b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.188+0000 7f560794b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f56000b60c0 0x7f5600071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.188+0000 7f560794b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5600072530 0x7f5600070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.188+0000 7f560794b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f56000729a0 con 0x7f560015b480 2024-09-12T01:38:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.188+0000 7f560794b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f56000ccff0 con 0x7f56000b60c0 2024-09-12T01:38:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.188+0000 7f560794b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f56000cd2d0 con 0x7f5600072530 2024-09-12T01:38:34.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.189+0000 7f56056e7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f560015b480 0x7f56000b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.189+0000 7f56056e7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f560015b480 0x7f56000b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53914/0 (socket says 172.21.15.60:53914) 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.189+0000 7f56056e7640 1 -- 172.21.15.60:0/4207707158 learned_addr learned my addr 172.21.15.60:0/4207707158 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.189+0000 7f5604ee6640 1 --2- 172.21.15.60:0/4207707158 >> v2:172.21.15.105:3300/0 conn(0x7f56000b60c0 0x7f5600071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.189+0000 7f5605ee8640 1 --2- 172.21.15.60:0/4207707158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5600072530 0x7f5600070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.189+0000 7f56056e7640 1 -- 172.21.15.60:0/4207707158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5600072530 msgr2=0x7f5600070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.189+0000 7f56056e7640 1 --2- 172.21.15.60:0/4207707158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5600072530 0x7f5600070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.189+0000 7f56056e7640 1 -- 172.21.15.60:0/4207707158 >> v2:172.21.15.105:3300/0 conn(0x7f56000b60c0 msgr2=0x7f5600071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.189+0000 7f56056e7640 1 --2- 172.21.15.60:0/4207707158 >> v2:172.21.15.105:3300/0 conn(0x7f56000b60c0 0x7f5600071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.189+0000 7f56056e7640 1 -- 172.21.15.60:0/4207707158 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56000cd5b0 con 0x7f560015b480 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.189+0000 7f5604ee6640 1 --2- 172.21.15.60:0/4207707158 >> v2:172.21.15.105:3300/0 conn(0x7f56000b60c0 0x7f5600071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.189+0000 7f5605ee8640 1 --2- 172.21.15.60:0/4207707158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5600072530 0x7f5600070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.190+0000 7f56056e7640 1 --2- 172.21.15.60:0/4207707158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f560015b480 0x7f56000b5b80 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f56000b2ee0 tx=0x7f55fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bc4380bcf743c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:34.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.190+0000 7f55f7fff640 1 -- 172.21.15.60:0/4207707158 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc037070 con 0x7f560015b480 2024-09-12T01:38:34.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.190+0000 7f55f7fff640 1 -- 172.21.15.60:0/4207707158 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55fc032440 con 0x7f560015b480 2024-09-12T01:38:34.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.190+0000 7f55f7fff640 1 -- 172.21.15.60:0/4207707158 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc032810 con 0x7f560015b480 2024-09-12T01:38:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.190+0000 7f560794b640 1 -- 172.21.15.60:0/4207707158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f560015b480 msgr2=0x7f56000b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.190+0000 7f560794b640 1 --2- 172.21.15.60:0/4207707158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f560015b480 0x7f56000b5b80 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f56000b2ee0 tx=0x7f55fc02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:38:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.191+0000 7f560794b640 1 -- 172.21.15.60:0/4207707158 shutdown_connections 2024-09-12T01:38:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.191+0000 7f560794b640 1 --2- 172.21.15.60:0/4207707158 >> v2:172.21.15.105:3300/0 conn(0x7f56000b60c0 0x7f5600071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.191+0000 7f560794b640 1 --2- 172.21.15.60:0/4207707158 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5600072530 0x7f5600070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.191+0000 7f560794b640 1 --2- 172.21.15.60:0/4207707158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f560015b480 0x7f56000b5b80 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:34.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.191+0000 7f560794b640 1 -- 172.21.15.60:0/4207707158 >> 172.21.15.60:0/4207707158 conn(0x7f560006d0f0 msgr2=0x7f560006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.191+0000 7f560794b640 1 -- 172.21.15.60:0/4207707158 shutdown_connections 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.191+0000 7f560794b640 1 -- 172.21.15.60:0/4207707158 wait complete. 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.192+0000 7f560794b640 1 Processor -- start 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.192+0000 7f560794b640 1 -- start start 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f560794b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5600072530 0x7f5600141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f560794b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56000b60c0 0x7f5600151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f560794b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560015b480 0x7f5600159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f560794b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f560015b860 con 0x7f5600072530 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f560794b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f56000cdb70 con 0x7f56000b60c0 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f560794b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f560015b9e0 con 0x7f560015b480 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f56056e7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5600072530 0x7f5600141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f56056e7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5600072530 0x7f5600141b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53916/0 (socket says 172.21.15.60:53916) 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f56056e7640 1 -- 172.21.15.60:0/3818429960 learned_addr learned my addr 172.21.15.60:0/3818429960 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:34.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f56056e7640 1 -- 172.21.15.60:0/3818429960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560015b480 msgr2=0x7f5600159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f56056e7640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560015b480 0x7f5600159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f5604ee6640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56000b60c0 0x7f5600151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f56056e7640 1 -- 172.21.15.60:0/3818429960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56000b60c0 msgr2=0x7f5600151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f56056e7640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56000b60c0 0x7f5600151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f56056e7640 1 -- 172.21.15.60:0/3818429960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5600158a80 con 0x7f5600072530 2024-09-12T01:38:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f5604ee6640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56000b60c0 0x7f5600151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.193+0000 7f56056e7640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5600072530 0x7f5600141b80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f55fc02a220 tx=0x7f55fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.194+0000 7f55f5ffb640 1 -- 172.21.15.60:0/3818429960 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc037040 con 0x7f5600072530 2024-09-12T01:38:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.194+0000 7f55f5ffb640 1 -- 172.21.15.60:0/3818429960 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55fc042070 con 0x7f5600072530 2024-09-12T01:38:34.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.194+0000 7f560794b640 1 -- 172.21.15.60:0/3818429960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5600158d20 con 0x7f5600072530 2024-09-12T01:38:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.194+0000 7f55f5ffb640 1 -- 172.21.15.60:0/3818429960 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55fc030bb0 con 0x7f5600072530 2024-09-12T01:38:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.194+0000 7f560794b640 1 -- 172.21.15.60:0/3818429960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56001592e0 con 0x7f5600072530 2024-09-12T01:38:34.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.195+0000 7f560794b640 1 -- 172.21.15.60:0/3818429960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5600071ff0 con 0x7f5600072530 2024-09-12T01:38:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.195+0000 7f55f5ffb640 1 -- 172.21.15.60:0/3818429960 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f55fc047460 con 0x7f5600072530 2024-09-12T01:38:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.196+0000 7f55f5ffb640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f55e406be30 0x7f55e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.196+0000 7f55f5ffb640 1 -- 172.21.15.60:0/3818429960 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 5227+0+0 (secure 0 0 0) 0x7f55fc0ab7b0 con 0x7f5600072530 2024-09-12T01:38:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.196+0000 7f5604ee6640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f55e406be30 0x7f55e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:34.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.196+0000 7f5604ee6640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f55e406be30 0x7f55e406e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f55f0006fd0 tx=0x7f55f0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:34.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.201+0000 7f55f5ffb640 1 -- 172.21.15.60:0/3818429960 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f55fc045360 con 0x7f5600072530 2024-09-12T01:38:34.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:34.377+0000 7f560794b640 1 -- 172.21.15.60:0/3818429960 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5600063360 con 0x7f5600072530 2024-09-12T01:38:35.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.056+0000 7f55f5ffb640 1 -- 172.21.15.60:0/3818429960 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) ==== 170+0+0 (secure 0 0 0) 0x7f55fc07a3d0 con 0x7f5600072530 2024-09-12T01:38:35.057 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-12T01:38:35.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.061+0000 7f560794b640 1 -- 172.21.15.60:0/3818429960 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f55e406be30 msgr2=0x7f55e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:35.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.061+0000 7f560794b640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f55e406be30 0x7f55e406e2f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f55f0006fd0 tx=0x7f55f0008040 comp rx=0 tx=0).stop 2024-09-12T01:38:35.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.061+0000 7f560794b640 1 -- 172.21.15.60:0/3818429960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5600072530 msgr2=0x7f5600141b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:35.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.061+0000 7f560794b640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5600072530 0x7f5600141b80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f55fc02a220 tx=0x7f55fc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.061+0000 7f560794b640 1 -- 172.21.15.60:0/3818429960 shutdown_connections 2024-09-12T01:38:35.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.061+0000 7f560794b640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f55e406be30 0x7f55e406e2f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.061+0000 7f560794b640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f560015b480 0x7f5600159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.061+0000 7f560794b640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f56000b60c0 0x7f5600151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.061+0000 7f560794b640 1 --2- 172.21.15.60:0/3818429960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5600072530 0x7f5600141b80 secure :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f55fc02a220 tx=0x7f55fc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.061+0000 7f560794b640 1 -- 172.21.15.60:0/3818429960 >> 172.21.15.60:0/3818429960 conn(0x7f560006d0f0 msgr2=0x7f560015db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:35.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.062+0000 7f560794b640 1 -- 172.21.15.60:0/3818429960 shutdown_connections 2024-09-12T01:38:35.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.062+0000 7f560794b640 1 -- 172.21.15.60:0/3818429960 wait complete. 2024-09-12T01:38:35.088 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:38:35.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.195+0000 7f2c85366640 1 Processor -- start 2024-09-12T01:38:35.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.195+0000 7f2c85366640 1 -- start start 2024-09-12T01:38:35.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.196+0000 7f2c85366640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8015c520 0x7f2c800b4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:35.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.196+0000 7f2c85366640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2c80070040 0x7f2c800704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:35.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.196+0000 7f2c85366640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c800cf3d0 con 0x7f2c8006bc10 2024-09-12T01:38:35.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.196+0000 7f2c85366640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2c800cffe0 con 0x7f2c80070040 2024-09-12T01:38:35.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.196+0000 7f2c85366640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c800cf6b0 con 0x7f2c8015c520 2024-09-12T01:38:35.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.196+0000 7f2c7e7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2c80070040 0x7f2c800704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:35.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.196+0000 7f2c7e7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2c80070040 0x7f2c800704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53924/0 (socket says 172.21.15.60:53924) 2024-09-12T01:38:35.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.196+0000 7f2c7e7fc640 1 -- 172.21.15.60:0/4238152716 learned_addr learned my addr 172.21.15.60:0/4238152716 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:35.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.196+0000 7f2c7effd640 1 --2- 172.21.15.60:0/4238152716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8015c520 0x7f2c800b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:35.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.197+0000 7f2c7e7fc640 1 -- 172.21.15.60:0/4238152716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8015c520 msgr2=0x7f2c800b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:35.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.197+0000 7f2c7e7fc640 1 --2- 172.21.15.60:0/4238152716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8015c520 0x7f2c800b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.197+0000 7f2c7e7fc640 1 -- 172.21.15.60:0/4238152716 >> v1:172.21.15.105:6789/0 conn(0x7f2c8006bc10 legacy=0x7f2c800d0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:35.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.197+0000 7f2c7e7fc640 1 -- 172.21.15.60:0/4238152716 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c800cf990 con 0x7f2c80070040 2024-09-12T01:38:35.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.197+0000 7f2c7e7fc640 1 --2- 172.21.15.60:0/4238152716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c80070040 0x7f2c800704a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009870 tx=0x7f2c6802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be6f41fdfafa195 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:35.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.197+0000 7f2c7dffb640 1 -- 172.21.15.60:0/4238152716 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68037070 con 0x7f2c80070040 2024-09-12T01:38:35.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.198+0000 7f2c7dffb640 1 -- 172.21.15.60:0/4238152716 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c68032440 con 0x7f2c80070040 2024-09-12T01:38:35.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.198+0000 7f2c7dffb640 1 -- 172.21.15.60:0/4238152716 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c68032810 con 0x7f2c80070040 2024-09-12T01:38:35.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.198+0000 7f2c85366640 1 -- 172.21.15.60:0/4238152716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c80070040 msgr2=0x7f2c800704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:35.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.198+0000 7f2c85366640 1 --2- 172.21.15.60:0/4238152716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c80070040 0x7f2c800704a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009870 tx=0x7f2c6802a1c0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.198+0000 7f2c85366640 1 -- 172.21.15.60:0/4238152716 shutdown_connections 2024-09-12T01:38:35.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.198+0000 7f2c85366640 1 --2- 172.21.15.60:0/4238152716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c80070040 0x7f2c800704a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.198+0000 7f2c85366640 1 --2- 172.21.15.60:0/4238152716 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8015c520 0x7f2c800b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.198+0000 7f2c85366640 1 -- 172.21.15.60:0/4238152716 >> 172.21.15.60:0/4238152716 conn(0x7f2c800d1390 msgr2=0x7f2c800d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:35.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.198+0000 7f2c85366640 1 -- 172.21.15.60:0/4238152716 shutdown_connections 2024-09-12T01:38:35.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.198+0000 7f2c85366640 1 -- 172.21.15.60:0/4238152716 wait complete. 2024-09-12T01:38:35.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.199+0000 7f2c85366640 1 Processor -- start 2024-09-12T01:38:35.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.199+0000 7f2c85366640 1 -- start start 2024-09-12T01:38:35.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.200+0000 7f2c85366640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8006bc10 0x7f2c801f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:35.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.200+0000 7f2c85366640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c80070040 0x7f2c8015ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.200+0000 7f2c85366640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8015c520 0x7f2c8015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.200+0000 7f2c85366640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2c8006c0a0 con 0x7f2c8015c520 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.200+0000 7f2c85366640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c800cdb00 con 0x7f2c80070040 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.200+0000 7f2c85366640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c8006c220 con 0x7f2c8006bc10 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.200+0000 7f2c7f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8015c520 0x7f2c8015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.200+0000 7f2c7f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8015c520 0x7f2c8015b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53932/0 (socket says 172.21.15.60:53932) 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.200+0000 7f2c7f7fe640 1 -- 172.21.15.60:0/468407389 learned_addr learned my addr 172.21.15.60:0/468407389 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c7e7fc640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c80070040 0x7f2c8015ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c7effd640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8006bc10 0x7f2c801f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c7f7fe640 1 -- 172.21.15.60:0/468407389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8006bc10 msgr2=0x7f2c801f4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c7f7fe640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8006bc10 0x7f2c801f4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c7f7fe640 1 -- 172.21.15.60:0/468407389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c80070040 msgr2=0x7f2c8015ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c7f7fe640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c80070040 0x7f2c8015ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c7f7fe640 1 -- 172.21.15.60:0/468407389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c80153e20 con 0x7f2c8015c520 2024-09-12T01:38:35.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c7effd640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8006bc10 0x7f2c801f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:35.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c7f7fe640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8015c520 0x7f2c8015b0d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800c400 tx=0x7f2c7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:35.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c777fe640 1 -- 172.21.15.60:0/468407389 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78017070 con 0x7f2c8015c520 2024-09-12T01:38:35.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c777fe640 1 -- 172.21.15.60:0/468407389 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c780052d0 con 0x7f2c8015c520 2024-09-12T01:38:35.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c777fe640 1 -- 172.21.15.60:0/468407389 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c78003810 con 0x7f2c8015c520 2024-09-12T01:38:35.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c85366640 1 -- 172.21.15.60:0/468407389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c801f4860 con 0x7f2c8015c520 2024-09-12T01:38:35.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.201+0000 7f2c85366640 1 -- 172.21.15.60:0/468407389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c801540c0 con 0x7f2c8015c520 2024-09-12T01:38:35.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.202+0000 7f2c85366640 1 -- 172.21.15.60:0/468407389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c800704a0 con 0x7f2c8015c520 2024-09-12T01:38:35.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.203+0000 7f2c777fe640 1 -- 172.21.15.60:0/468407389 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c7801a070 con 0x7f2c8015c520 2024-09-12T01:38:35.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.203+0000 7f2c777fe640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2c6006be30 0x7f2c6006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:35.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.203+0000 7f2c777fe640 1 -- 172.21.15.60:0/468407389 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5609+0+0 (secure 0 0 0) 0x7f2c7808a1d0 con 0x7f2c8015c520 2024-09-12T01:38:35.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.203+0000 7f2c7effd640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2c6006be30 0x7f2c6006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:35.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.204+0000 7f2c7effd640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2c6006be30 0x7f2c6006e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2c800cce50 tx=0x7f2c7000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:35.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.208+0000 7f2c777fe640 1 -- 172.21.15.60:0/468407389 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c78058be0 con 0x7f2c8015c520 2024-09-12T01:38:35.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:35.417+0000 7f2c85366640 1 -- 172.21.15.60:0/468407389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2c8015bcd0 con 0x7f2c8015c520 2024-09-12T01:38:36.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.058+0000 7f2c777fe640 1 -- 172.21.15.60:0/468407389 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v35) ==== 174+0+0 (secure 0 0 0) 0x7f2c780584e0 con 0x7f2c8015c520 2024-09-12T01:38:36.058 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 10 and data pool 11 2024-09-12T01:38:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.062+0000 7f2c85366640 1 -- 172.21.15.60:0/468407389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2c6006be30 msgr2=0x7f2c6006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.062+0000 7f2c85366640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2c6006be30 0x7f2c6006e2f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2c800cce50 tx=0x7f2c7000b040 comp rx=0 tx=0).stop 2024-09-12T01:38:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.062+0000 7f2c85366640 1 -- 172.21.15.60:0/468407389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8015c520 msgr2=0x7f2c8015b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.062+0000 7f2c85366640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8015c520 0x7f2c8015b0d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2c7800c400 tx=0x7f2c7800c8c0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.063+0000 7f2c85366640 1 -- 172.21.15.60:0/468407389 shutdown_connections 2024-09-12T01:38:36.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.063+0000 7f2c85366640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c8015c520 0x7f2c8015b0d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.063+0000 7f2c85366640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c80070040 0x7f2c8015ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.063+0000 7f2c85366640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2c6006be30 0x7f2c6006e2f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.063+0000 7f2c85366640 1 --2- 172.21.15.60:0/468407389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c8006bc10 0x7f2c801f4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.063+0000 7f2c85366640 1 -- 172.21.15.60:0/468407389 >> 172.21.15.60:0/468407389 conn(0x7f2c800d1390 msgr2=0x7f2c800d0470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:36.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.063+0000 7f2c85366640 1 -- 172.21.15.60:0/468407389 shutdown_connections 2024-09-12T01:38:36.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.063+0000 7f2c85366640 1 -- 172.21.15.60:0/468407389 wait complete. 2024-09-12T01:38:36.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:36.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.206+0000 7f5bf61af640 1 Processor -- start 2024-09-12T01:38:36.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.207+0000 7f5bf61af640 1 -- start start 2024-09-12T01:38:36.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.207+0000 7f5bf61af640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5bf00b4920 0x7f5bf015b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.207+0000 7f5bf61af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bf00b4d00 0x7f5bf00b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.207+0000 7f5bf61af640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5bf00cd780 0x7f5bf00cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.207+0000 7f5bf61af640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f5bf00cf100 con 0x7f5bf00cd780 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.207+0000 7f5bf61af640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5bf00ce4f0 con 0x7f5bf00b4920 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.207+0000 7f5bf61af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf00ce7d0 con 0x7f5bf00b4d00 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.208+0000 7f5beffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5bf00cd780 0x7f5bf00cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.208+0000 7f5beffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5bf00cd780 0x7f5bf00cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53946/0 (socket says 172.21.15.60:53946) 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.208+0000 7f5beffff640 1 -- 172.21.15.60:0/339760231 learned_addr learned my addr 172.21.15.60:0/339760231 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.208+0000 7f5beeffd640 1 --2- 172.21.15.60:0/339760231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bf00b4d00 0x7f5bf00b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.208+0000 7f5bef7fe640 1 --2- 172.21.15.60:0/339760231 >> v2:172.21.15.105:3300/0 conn(0x7f5bf00b4920 0x7f5bf015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.208+0000 7f5beffff640 1 -- 172.21.15.60:0/339760231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bf00b4d00 msgr2=0x7f5bf00b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.208+0000 7f5beffff640 1 --2- 172.21.15.60:0/339760231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bf00b4d00 0x7f5bf00b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.208+0000 7f5beffff640 1 -- 172.21.15.60:0/339760231 >> v2:172.21.15.105:3300/0 conn(0x7f5bf00b4920 msgr2=0x7f5bf015b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.208+0000 7f5beffff640 1 --2- 172.21.15.60:0/339760231 >> v2:172.21.15.105:3300/0 conn(0x7f5bf00b4920 0x7f5bf015b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.208+0000 7f5beffff640 1 -- 172.21.15.60:0/339760231 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf00ceab0 con 0x7f5bf00cd780 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5beffff640 1 --2- 172.21.15.60:0/339760231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf00cd780 0x7f5bf00cdbf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5bf006cb00 tx=0x7f5be802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99fc5cfca6b17a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5bee7fc640 1 -- 172.21.15.60:0/339760231 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be8036070 con 0x7f5bf00cd780 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5bee7fc640 1 -- 172.21.15.60:0/339760231 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be8031600 con 0x7f5bf00cd780 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5bee7fc640 1 -- 172.21.15.60:0/339760231 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be80319d0 con 0x7f5bf00cd780 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5bf61af640 1 -- 172.21.15.60:0/339760231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf00cd780 msgr2=0x7f5bf00cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5bf61af640 1 --2- 172.21.15.60:0/339760231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf00cd780 0x7f5bf00cdbf0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5bf006cb00 tx=0x7f5be802a6a0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5bf61af640 1 -- 172.21.15.60:0/339760231 shutdown_connections 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5bf61af640 1 --2- 172.21.15.60:0/339760231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf00cd780 0x7f5bf00cdbf0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5bf61af640 1 --2- 172.21.15.60:0/339760231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bf00b4d00 0x7f5bf00b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5bf61af640 1 --2- 172.21.15.60:0/339760231 >> v2:172.21.15.105:3300/0 conn(0x7f5bf00b4920 0x7f5bf015b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5bf61af640 1 -- 172.21.15.60:0/339760231 >> 172.21.15.60:0/339760231 conn(0x7f5bf006bc10 msgr2=0x7f5bf006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5bf61af640 1 -- 172.21.15.60:0/339760231 shutdown_connections 2024-09-12T01:38:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.209+0000 7f5bf61af640 1 -- 172.21.15.60:0/339760231 wait complete. 2024-09-12T01:38:36.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.211+0000 7f5bf61af640 1 Processor -- start 2024-09-12T01:38:36.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.211+0000 7f5bf61af640 1 -- start start 2024-09-12T01:38:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bf61af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf00b4920 0x7f5bf0143100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bf61af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf00b4d00 0x7f5bf01e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bf61af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bf00cd780 0x7f5bf0153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bf61af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf00b5680 con 0x7f5bf00b4920 2024-09-12T01:38:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bf61af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf015bd10 con 0x7f5bf00b4d00 2024-09-12T01:38:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bf61af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5bf00ce130 con 0x7f5bf00cd780 2024-09-12T01:38:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bef7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf00b4920 0x7f5bf0143100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bef7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf00b4920 0x7f5bf0143100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53950/0 (socket says 172.21.15.60:53950) 2024-09-12T01:38:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bef7fe640 1 -- 172.21.15.60:0/601686234 learned_addr learned my addr 172.21.15.60:0/601686234 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5beeffd640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf00b4d00 0x7f5bf01e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5beffff640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bf00cd780 0x7f5bf0153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bef7fe640 1 -- 172.21.15.60:0/601686234 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bf00cd780 msgr2=0x7f5bf0153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bef7fe640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bf00cd780 0x7f5bf0153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bef7fe640 1 -- 172.21.15.60:0/601686234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf00b4d00 msgr2=0x7f5bf01e4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bef7fe640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf00b4d00 0x7f5bf01e4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bef7fe640 1 -- 172.21.15.60:0/601686234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf0151c80 con 0x7f5bf00b4920 2024-09-12T01:38:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bef7fe640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf00b4920 0x7f5bf0143100 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5be000d800 tx=0x7f5be000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bd7fff640 1 -- 172.21.15.60:0/601686234 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be000b6c0 con 0x7f5bf00b4920 2024-09-12T01:38:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bd7fff640 1 -- 172.21.15.60:0/601686234 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5be0019070 con 0x7f5bf00b4920 2024-09-12T01:38:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bd7fff640 1 -- 172.21.15.60:0/601686234 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5be000ba80 con 0x7f5bf00b4920 2024-09-12T01:38:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.212+0000 7f5bf61af640 1 -- 172.21.15.60:0/601686234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf0151f60 con 0x7f5bf00b4920 2024-09-12T01:38:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.213+0000 7f5bf61af640 1 -- 172.21.15.60:0/601686234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf0152520 con 0x7f5bf00b4920 2024-09-12T01:38:36.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.214+0000 7f5bf61af640 1 -- 172.21.15.60:0/601686234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf00b5140 con 0x7f5bf00b4920 2024-09-12T01:38:36.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.214+0000 7f5bd7fff640 1 -- 172.21.15.60:0/601686234 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5be000bc20 con 0x7f5bf00b4920 2024-09-12T01:38:36.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.214+0000 7f5bd7fff640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5bdc06be30 0x7f5bdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.215+0000 7f5bd7fff640 1 -- 172.21.15.60:0/601686234 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5709+0+0 (secure 0 0 0) 0x7f5be008b1b0 con 0x7f5bf00b4920 2024-09-12T01:38:36.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.215+0000 7f5beeffd640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5bdc06be30 0x7f5bdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.215+0000 7f5beeffd640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5bdc06be30 0x7f5bdc06e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5bf01e5830 tx=0x7f5be4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:36.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.219+0000 7f5bd7fff640 1 -- 172.21.15.60:0/601686234 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5be0059510 con 0x7f5bf00b4920 2024-09-12T01:38:36.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.397+0000 7f5bf61af640 1 -- 172.21.15.60:0/601686234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5bf015aff0 con 0x7f5bf00b4920 2024-09-12T01:38:36.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.398+0000 7f5bd7fff640 1 -- 172.21.15.60:0/601686234 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16645 (secure 0 0 0) 0x7f5be005d810 con 0x7f5bf00b4920 2024-09-12T01:38:36.399 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:36.399 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":67,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:38:35.419273+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:38:33.077570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T01:38:34.408910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.400+0000 7f5bf61af640 1 -- 172.21.15.60:0/601686234 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5bdc06be30 msgr2=0x7f5bdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.400+0000 7f5bf61af640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5bdc06be30 0x7f5bdc06e2f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5bf01e5830 tx=0x7f5be4008040 comp rx=0 tx=0).stop 2024-09-12T01:38:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.400+0000 7f5bf61af640 1 -- 172.21.15.60:0/601686234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf00b4920 msgr2=0x7f5bf0143100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.400+0000 7f5bf61af640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf00b4920 0x7f5bf0143100 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5be000d800 tx=0x7f5be000dcc0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.400+0000 7f5bf61af640 1 -- 172.21.15.60:0/601686234 shutdown_connections 2024-09-12T01:38:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.400+0000 7f5bf61af640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5bdc06be30 0x7f5bdc06e2f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.400+0000 7f5bf61af640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5bf00cd780 0x7f5bf0153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.400+0000 7f5bf61af640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5bf00b4d00 0x7f5bf01e4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.400+0000 7f5bf61af640 1 --2- 172.21.15.60:0/601686234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bf00b4920 0x7f5bf0143100 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.400+0000 7f5bf61af640 1 -- 172.21.15.60:0/601686234 >> 172.21.15.60:0/601686234 conn(0x7f5bf006bc10 msgr2=0x7f5bf0156680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:36.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.400+0000 7f5bf61af640 1 -- 172.21.15.60:0/601686234 shutdown_connections 2024-09-12T01:38:36.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.400+0000 7f5bf61af640 1 -- 172.21.15.60:0/601686234 wait complete. 2024-09-12T01:38:36.412 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:36.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.513+0000 7fab88eba640 1 Processor -- start 2024-09-12T01:38:36.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.513+0000 7fab88eba640 1 -- start start 2024-09-12T01:38:36.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.514+0000 7fab88eba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab8415e660 0x7fab840cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.514+0000 7fab88eba640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fab840d3310 0x7fab840d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.514+0000 7fab88eba640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab8415ea40 con 0x7fab840d1650 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.514+0000 7fab88eba640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fab840d3870 con 0x7fab840d3310 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.514+0000 7fab88eba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fab840d3b50 con 0x7fab8415e660 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.514+0000 7fab82d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fab840d1650 0x7fab8406bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45382/0 (socket says 172.21.15.60:45382) 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.514+0000 7fab82d9d640 1 -- 172.21.15.60:0/580860731 learned_addr learned my addr 172.21.15.60:0/580860731 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.515+0000 7fab8259c640 1 --2- 172.21.15.60:0/580860731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab8415e660 0x7fab840cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.515+0000 7fab81d9b640 1 --2- 172.21.15.60:0/580860731 >> v2:172.21.15.105:3300/0 conn(0x7fab840d3310 0x7fab840d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.515+0000 7fab8159a640 1 -- 172.21.15.60:0/580860731 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229701222 0 0) 0x7fab8415ea40 con 0x7fab840d1650 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.515+0000 7fab8159a640 1 -- 172.21.15.60:0/580860731 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab70003520 con 0x7fab840d1650 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.515+0000 7fab8259c640 1 -- 172.21.15.60:0/580860731 >> v2:172.21.15.105:3300/0 conn(0x7fab840d3310 msgr2=0x7fab840d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.515+0000 7fab8259c640 1 --2- 172.21.15.60:0/580860731 >> v2:172.21.15.105:3300/0 conn(0x7fab840d3310 0x7fab840d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.515+0000 7fab8259c640 1 -- 172.21.15.60:0/580860731 >> v1:172.21.15.60:6789/0 conn(0x7fab840d1650 legacy=0x7fab8406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.515+0000 7fab8159a640 1 -- 172.21.15.60:0/580860731 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 79611115 0 0) 0x7fab70003520 con 0x7fab840d1650 2024-09-12T01:38:36.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.515+0000 7fab8259c640 1 -- 172.21.15.60:0/580860731 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab840d3e30 con 0x7fab8415e660 2024-09-12T01:38:36.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.516+0000 7fab8259c640 1 --2- 172.21.15.60:0/580860731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab8415e660 0x7fab840cf730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab74009d90 tx=0x7fab7402a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c74b167488357817 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:36.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.516+0000 7fab8159a640 1 -- 172.21.15.60:0/580860731 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c001670 con 0x7fab8415e660 2024-09-12T01:38:36.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.516+0000 7fab8159a640 1 -- 172.21.15.60:0/580860731 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab74007540 con 0x7fab8415e660 2024-09-12T01:38:36.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.516+0000 7fab8159a640 1 -- 172.21.15.60:0/580860731 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74007910 con 0x7fab8415e660 2024-09-12T01:38:36.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.517+0000 7fab88eba640 1 -- 172.21.15.60:0/580860731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab8415e660 msgr2=0x7fab840cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.517+0000 7fab88eba640 1 --2- 172.21.15.60:0/580860731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab8415e660 0x7fab840cf730 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fab74009d90 tx=0x7fab7402a5f0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.517+0000 7fab88eba640 1 -- 172.21.15.60:0/580860731 shutdown_connections 2024-09-12T01:38:36.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.517+0000 7fab88eba640 1 --2- 172.21.15.60:0/580860731 >> v2:172.21.15.105:3300/0 conn(0x7fab840d3310 0x7fab840d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.517+0000 7fab88eba640 1 --2- 172.21.15.60:0/580860731 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab8415e660 0x7fab840cf730 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.517+0000 7fab88eba640 1 -- 172.21.15.60:0/580860731 >> 172.21.15.60:0/580860731 conn(0x7fab840b6410 msgr2=0x7fab840b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:36.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.517+0000 7fab88eba640 1 -- 172.21.15.60:0/580860731 shutdown_connections 2024-09-12T01:38:36.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.517+0000 7fab88eba640 1 -- 172.21.15.60:0/580860731 wait complete. 2024-09-12T01:38:36.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.518+0000 7fab88eba640 1 Processor -- start 2024-09-12T01:38:36.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.518+0000 7fab88eba640 1 -- start start 2024-09-12T01:38:36.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.519+0000 7fab88eba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab840d1650 0x7fab841f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.519+0000 7fab88eba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab840d3310 0x7fab84145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.519+0000 7fab88eba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab8415e660 0x7fab841582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.519+0000 7fab88eba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fab840cfc70 con 0x7fab840d1650 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.519+0000 7fab88eba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fab840d43f0 con 0x7fab840d3310 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.519+0000 7fab88eba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fab840b8b80 con 0x7fab8415e660 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.519+0000 7fab8259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab840d1650 0x7fab841f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.519+0000 7fab8259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab840d1650 0x7fab841f39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53958/0 (socket says 172.21.15.60:53958) 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.519+0000 7fab8259c640 1 -- 172.21.15.60:0/3143095071 learned_addr learned my addr 172.21.15.60:0/3143095071 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.519+0000 7fab82d9d640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab8415e660 0x7fab841582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.519+0000 7fab81d9b640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab840d3310 0x7fab84145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.520+0000 7fab8259c640 1 -- 172.21.15.60:0/3143095071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab8415e660 msgr2=0x7fab841582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.520+0000 7fab8259c640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab8415e660 0x7fab841582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.520+0000 7fab8259c640 1 -- 172.21.15.60:0/3143095071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab840d3310 msgr2=0x7fab84145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.520+0000 7fab8259c640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab840d3310 0x7fab84145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.520+0000 7fab8259c640 1 -- 172.21.15.60:0/3143095071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab84157240 con 0x7fab840d1650 2024-09-12T01:38:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.520+0000 7fab8259c640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab840d1650 0x7fab841f39c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fab74009d90 tx=0x7fab74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.520+0000 7fab7affd640 1 -- 172.21.15.60:0/3143095071 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7403f070 con 0x7fab840d1650 2024-09-12T01:38:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.520+0000 7fab7affd640 1 -- 172.21.15.60:0/3143095071 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab74031c40 con 0x7fab840d1650 2024-09-12T01:38:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.520+0000 7fab7affd640 1 -- 172.21.15.60:0/3143095071 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74009450 con 0x7fab840d1650 2024-09-12T01:38:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.520+0000 7fab88eba640 1 -- 172.21.15.60:0/3143095071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab84157520 con 0x7fab840d1650 2024-09-12T01:38:36.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.520+0000 7fab88eba640 1 -- 172.21.15.60:0/3143095071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab84157ae0 con 0x7fab840d1650 2024-09-12T01:38:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.521+0000 7fab88eba640 1 -- 172.21.15.60:0/3143095071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab840d1110 con 0x7fab840d1650 2024-09-12T01:38:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.522+0000 7fab7affd640 1 -- 172.21.15.60:0/3143095071 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab7403b410 con 0x7fab840d1650 2024-09-12T01:38:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.522+0000 7fab7affd640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fab6406be30 0x7fab6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.522+0000 7fab7affd640 1 -- 172.21.15.60:0/3143095071 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5709+0+0 (secure 0 0 0) 0x7fab740ac4e0 con 0x7fab840d1650 2024-09-12T01:38:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.522+0000 7fab81d9b640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fab6406be30 0x7fab6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.523+0000 7fab81d9b640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fab6406be30 0x7fab6406e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fab840cb2b0 tx=0x7fab6c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:36.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.527+0000 7fab7affd640 1 -- 172.21.15.60:0/3143095071 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab7407a840 con 0x7fab840d1650 2024-09-12T01:38:36.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.702+0000 7fab88eba640 1 -- 172.21.15.60:0/3143095071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab841f3f00 con 0x7fab840d1650 2024-09-12T01:38:36.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.703+0000 7fab7affd640 1 -- 172.21.15.60:0/3143095071 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16645 (secure 0 0 0) 0x7fab7407eb40 con 0x7fab840d1650 2024-09-12T01:38:36.704 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:36.705 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":67,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:38:35.419273+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:38:33.077570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T01:38:34.408910+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.705+0000 7fab88eba640 1 -- 172.21.15.60:0/3143095071 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fab6406be30 msgr2=0x7fab6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.705+0000 7fab88eba640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fab6406be30 0x7fab6406e2f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fab840cb2b0 tx=0x7fab6c009190 comp rx=0 tx=0).stop 2024-09-12T01:38:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.705+0000 7fab88eba640 1 -- 172.21.15.60:0/3143095071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab840d1650 msgr2=0x7fab841f39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.705+0000 7fab88eba640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab840d1650 0x7fab841f39c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fab74009d90 tx=0x7fab74004a40 comp rx=0 tx=0).stop 2024-09-12T01:38:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.705+0000 7fab88eba640 1 -- 172.21.15.60:0/3143095071 shutdown_connections 2024-09-12T01:38:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.705+0000 7fab88eba640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fab6406be30 0x7fab6406e2f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.705+0000 7fab88eba640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab8415e660 0x7fab841582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.705+0000 7fab88eba640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab840d3310 0x7fab84145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.705+0000 7fab88eba640 1 --2- 172.21.15.60:0/3143095071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab840d1650 0x7fab841f39c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.705+0000 7fab88eba640 1 -- 172.21.15.60:0/3143095071 >> 172.21.15.60:0/3143095071 conn(0x7fab840b6410 msgr2=0x7fab840b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.705+0000 7fab88eba640 1 -- 172.21.15.60:0/3143095071 shutdown_connections 2024-09-12T01:38:36.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.705+0000 7fab88eba640 1 -- 172.21.15.60:0/3143095071 wait complete. 2024-09-12T01:38:36.717 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:38:36.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.823+0000 7f4862a7b640 1 Processor -- start 2024-09-12T01:38:36.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.824+0000 7f4862a7b640 1 -- start start 2024-09-12T01:38:36.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.824+0000 7f4862a7b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f485c15e7a0 0x7f485c06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.824+0000 7f4862a7b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f485c0b68f0 0x7f485c0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.824+0000 7f4862a7b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f485c0cf860 con 0x7f485c0cf1f0 2024-09-12T01:38:36.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.824+0000 7f4862a7b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f485c0d2ca0 con 0x7f485c0b68f0 2024-09-12T01:38:36.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.824+0000 7f4862a7b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f485c0cfb40 con 0x7f485c15e7a0 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.825+0000 7f4861018640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f485c0b68f0 0x7f485c0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.825+0000 7f4861018640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f485c0b68f0 0x7f485c0d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53964/0 (socket says 172.21.15.60:53964) 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.825+0000 7f4861018640 1 -- 172.21.15.60:0/3131737215 learned_addr learned my addr 172.21.15.60:0/3131737215 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.825+0000 7f4860817640 1 --2- 172.21.15.60:0/3131737215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f485c15e7a0 0x7f485c06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.825+0000 7f4861018640 1 -- 172.21.15.60:0/3131737215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f485c15e7a0 msgr2=0x7f485c06caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.825+0000 7f4861018640 1 --2- 172.21.15.60:0/3131737215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f485c15e7a0 0x7f485c06caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.825+0000 7f4861018640 1 -- 172.21.15.60:0/3131737215 >> v1:172.21.15.105:6789/0 conn(0x7f485c0cf1f0 legacy=0x7f485c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.825+0000 7f4861018640 1 -- 172.21.15.60:0/3131737215 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c0cfe20 con 0x7f485c0b68f0 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.825+0000 7f4860817640 1 --2- 172.21.15.60:0/3131737215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f485c15e7a0 0x7f485c06caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.825+0000 7f4861018640 1 --2- 172.21.15.60:0/3131737215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f485c0b68f0 0x7f485c0d3410 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4854009e50 tx=0x7f485402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb9b9765799ac0f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.826+0000 7f485b7fe640 1 -- 172.21.15.60:0/3131737215 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854036070 con 0x7f485c0b68f0 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.826+0000 7f485b7fe640 1 -- 172.21.15.60:0/3131737215 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4854031600 con 0x7f485c0b68f0 2024-09-12T01:38:36.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.826+0000 7f485b7fe640 1 -- 172.21.15.60:0/3131737215 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48540319d0 con 0x7f485c0b68f0 2024-09-12T01:38:36.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.826+0000 7f4862a7b640 1 -- 172.21.15.60:0/3131737215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f485c0b68f0 msgr2=0x7f485c0d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.826+0000 7f4862a7b640 1 --2- 172.21.15.60:0/3131737215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f485c0b68f0 0x7f485c0d3410 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4854009e50 tx=0x7f485402a630 comp rx=0 tx=0).stop 2024-09-12T01:38:36.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.826+0000 7f4862a7b640 1 -- 172.21.15.60:0/3131737215 shutdown_connections 2024-09-12T01:38:36.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.826+0000 7f4862a7b640 1 --2- 172.21.15.60:0/3131737215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f485c0b68f0 0x7f485c0d3410 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.826+0000 7f4862a7b640 1 --2- 172.21.15.60:0/3131737215 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f485c15e7a0 0x7f485c06caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.826+0000 7f4862a7b640 1 -- 172.21.15.60:0/3131737215 >> 172.21.15.60:0/3131737215 conn(0x7f485c0d11e0 msgr2=0x7f485c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:36.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.826+0000 7f4862a7b640 1 -- 172.21.15.60:0/3131737215 shutdown_connections 2024-09-12T01:38:36.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.826+0000 7f4862a7b640 1 -- 172.21.15.60:0/3131737215 wait complete. 2024-09-12T01:38:36.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.827+0000 7f4862a7b640 1 Processor -- start 2024-09-12T01:38:36.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.828+0000 7f4862a7b640 1 -- start start 2024-09-12T01:38:36.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.828+0000 7f4862a7b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f485c0b68f0 0x7f485c0b9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.828+0000 7f4862a7b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f485c0cf1f0 0x7f485c0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.828+0000 7f4862a7b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f485c15e7a0 0x7f485c0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.828+0000 7f4862a7b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f485c06cfe0 con 0x7f485c0b68f0 2024-09-12T01:38:36.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.828+0000 7f4862a7b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f485c0b7a00 con 0x7f485c15e7a0 2024-09-12T01:38:36.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.828+0000 7f4862a7b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f485c15eb80 con 0x7f485c0cf1f0 2024-09-12T01:38:36.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f4860817640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f485c0b68f0 0x7f485c0b9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f4860817640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f485c0b68f0 0x7f485c0b9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53970/0 (socket says 172.21.15.60:53970) 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f4860817640 1 -- 172.21.15.60:0/173975804 learned_addr learned my addr 172.21.15.60:0/173975804 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f485bfff640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f485c0cf1f0 0x7f485c0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f4861018640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f485c15e7a0 0x7f485c0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f4860817640 1 -- 172.21.15.60:0/173975804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f485c0cf1f0 msgr2=0x7f485c0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f4860817640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f485c0cf1f0 0x7f485c0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f4860817640 1 -- 172.21.15.60:0/173975804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f485c15e7a0 msgr2=0x7f485c0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f4860817640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f485c15e7a0 0x7f485c0cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f4860817640 1 -- 172.21.15.60:0/173975804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c15f7c0 con 0x7f485c0b68f0 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f4860817640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f485c0b68f0 0x7f485c0b9bd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f484c00c820 tx=0x7f484c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f48597fa640 1 -- 172.21.15.60:0/173975804 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c015070 con 0x7f485c0b68f0 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f48597fa640 1 -- 172.21.15.60:0/173975804 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f484c007a30 con 0x7f485c0b68f0 2024-09-12T01:38:36.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f48597fa640 1 -- 172.21.15.60:0/173975804 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c007e00 con 0x7f485c0b68f0 2024-09-12T01:38:36.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f4862a7b640 1 -- 172.21.15.60:0/173975804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f485c158070 con 0x7f485c0b68f0 2024-09-12T01:38:36.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.829+0000 7f4862a7b640 1 -- 172.21.15.60:0/173975804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485c0cc6f0 con 0x7f485c0b68f0 2024-09-12T01:38:36.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.830+0000 7f4862a7b640 1 -- 172.21.15.60:0/173975804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f485c0cc8f0 con 0x7f485c0b68f0 2024-09-12T01:38:36.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.831+0000 7f48597fa640 1 -- 172.21.15.60:0/173975804 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f484c018070 con 0x7f485c0b68f0 2024-09-12T01:38:36.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.831+0000 7f48597fa640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f484806be30 0x7f484806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:36.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.831+0000 7f48597fa640 1 -- 172.21.15.60:0/173975804 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5709+0+0 (secure 0 0 0) 0x7f484c08ad10 con 0x7f485c0b68f0 2024-09-12T01:38:36.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.831+0000 7f485bfff640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f484806be30 0x7f484806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:36.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.832+0000 7f485bfff640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f484806be30 0x7f484806e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f485c0d1bf0 tx=0x7f4850007e30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:36.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:36.836+0000 7f48597fa640 1 -- 172.21.15.60:0/173975804 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f485c0cc8f0 con 0x7f485c0b68f0 2024-09-12T01:38:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.048+0000 7f4862a7b640 1 -- 172.21.15.60:0/173975804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f485c06caa0 con 0x7f485c0b68f0 2024-09-12T01:38:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.762+0000 7f48597fa640 1 -- 172.21.15.60:0/173975804 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) ==== 118+0+0 (secure 0 0 0) 0x7f485c158070 con 0x7f485c0b68f0 2024-09-12T01:38:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.765+0000 7f4862a7b640 1 -- 172.21.15.60:0/173975804 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f484806be30 msgr2=0x7f484806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.765+0000 7f4862a7b640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f484806be30 0x7f484806e2f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f485c0d1bf0 tx=0x7f4850007e30 comp rx=0 tx=0).stop 2024-09-12T01:38:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.765+0000 7f4862a7b640 1 -- 172.21.15.60:0/173975804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f485c0b68f0 msgr2=0x7f485c0b9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.765+0000 7f4862a7b640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f485c0b68f0 0x7f485c0b9bd0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f484c00c820 tx=0x7f484c00cc20 comp rx=0 tx=0).stop 2024-09-12T01:38:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.765+0000 7f4862a7b640 1 -- 172.21.15.60:0/173975804 shutdown_connections 2024-09-12T01:38:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.765+0000 7f4862a7b640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f485c15e7a0 0x7f485c0cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.765+0000 7f4862a7b640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f484806be30 0x7f484806e2f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.765+0000 7f4862a7b640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f485c0cf1f0 0x7f485c0cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.765+0000 7f4862a7b640 1 --2- 172.21.15.60:0/173975804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f485c0b68f0 0x7f485c0b9bd0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.765+0000 7f4862a7b640 1 -- 172.21.15.60:0/173975804 >> 172.21.15.60:0/173975804 conn(0x7f485c0d11e0 msgr2=0x7f485c0b61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.765+0000 7f4862a7b640 1 -- 172.21.15.60:0/173975804 shutdown_connections 2024-09-12T01:38:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.765+0000 7f4862a7b640 1 -- 172.21.15.60:0/173975804 wait complete. 2024-09-12T01:38:37.779 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:38:37.779 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:38:37.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.891+0000 7f582d99f640 1 Processor -- start 2024-09-12T01:38:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.891+0000 7f582d99f640 1 -- start start 2024-09-12T01:38:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f582d99f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f582815e6f0 0x7f582806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f582d99f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f58280b7450 0x7f582815f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f582d99f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f582806e990 con 0x7f58280b54d0 2024-09-12T01:38:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f582d99f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f582806ec70 con 0x7f582815e6f0 2024-09-12T01:38:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f582d99f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f582815ec70 con 0x7f58280b7450 2024-09-12T01:38:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f5826ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f582815e6f0 0x7f582806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f5826ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f582815e6f0 0x7f582806fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53986/0 (socket says 172.21.15.60:53986) 2024-09-12T01:38:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f5826ffd640 1 -- 172.21.15.60:0/2882826796 learned_addr learned my addr 172.21.15.60:0/2882826796 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f58277fe640 1 --2- 172.21.15.60:0/2882826796 >> v2:172.21.15.105:3300/0 conn(0x7f58280b7450 0x7f582815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:37.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f5826ffd640 1 -- 172.21.15.60:0/2882826796 >> v2:172.21.15.105:3300/0 conn(0x7f58280b7450 msgr2=0x7f582815f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f5826ffd640 1 --2- 172.21.15.60:0/2882826796 >> v2:172.21.15.105:3300/0 conn(0x7f58280b7450 0x7f582815f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f5826ffd640 1 -- 172.21.15.60:0/2882826796 >> v1:172.21.15.105:6789/0 conn(0x7f58280b54d0 legacy=0x7f58280b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.892+0000 7f5826ffd640 1 -- 172.21.15.60:0/2882826796 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582815ef50 con 0x7f582815e6f0 2024-09-12T01:38:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.893+0000 7f5826ffd640 1 --2- 172.21.15.60:0/2882826796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f582815e6f0 0x7f582806fd00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5828072df0 tx=0x7f581802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c7c5cf53fa1869 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.893+0000 7f5825ffb640 1 -- 172.21.15.60:0/2882826796 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5818036070 con 0x7f582815e6f0 2024-09-12T01:38:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.893+0000 7f5825ffb640 1 -- 172.21.15.60:0/2882826796 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5818031600 con 0x7f582815e6f0 2024-09-12T01:38:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.893+0000 7f5825ffb640 1 -- 172.21.15.60:0/2882826796 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58180319d0 con 0x7f582815e6f0 2024-09-12T01:38:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.894+0000 7f582d99f640 1 -- 172.21.15.60:0/2882826796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f582815e6f0 msgr2=0x7f582806fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.894+0000 7f582d99f640 1 --2- 172.21.15.60:0/2882826796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f582815e6f0 0x7f582806fd00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5828072df0 tx=0x7f581802a6f0 comp rx=0 tx=0).stop 2024-09-12T01:38:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.894+0000 7f582d99f640 1 -- 172.21.15.60:0/2882826796 shutdown_connections 2024-09-12T01:38:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.894+0000 7f582d99f640 1 --2- 172.21.15.60:0/2882826796 >> v2:172.21.15.105:3300/0 conn(0x7f58280b7450 0x7f582815f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.894+0000 7f582d99f640 1 --2- 172.21.15.60:0/2882826796 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f582815e6f0 0x7f582806fd00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.894+0000 7f582d99f640 1 -- 172.21.15.60:0/2882826796 >> 172.21.15.60:0/2882826796 conn(0x7f58280d2430 msgr2=0x7f58280d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.894+0000 7f582d99f640 1 -- 172.21.15.60:0/2882826796 shutdown_connections 2024-09-12T01:38:37.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.894+0000 7f582d99f640 1 -- 172.21.15.60:0/2882826796 wait complete. 2024-09-12T01:38:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.895+0000 7f582d99f640 1 Processor -- start 2024-09-12T01:38:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.895+0000 7f582d99f640 1 -- start start 2024-09-12T01:38:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.896+0000 7f582d99f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58280b54d0 0x7f5828152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.896+0000 7f582d99f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58280b7450 0x7f58281f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.896+0000 7f582d99f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f582815e6f0 0x7f5828161520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.896+0000 7f582d99f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f582806e730 con 0x7f582815e6f0 2024-09-12T01:38:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.896+0000 7f582d99f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f582806e5b0 con 0x7f58280b54d0 2024-09-12T01:38:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.896+0000 7f582d99f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5828070830 con 0x7f58280b7450 2024-09-12T01:38:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.896+0000 7f58277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f582815e6f0 0x7f5828161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.896+0000 7f58277fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f582815e6f0 0x7f5828161520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53996/0 (socket says 172.21.15.60:53996) 2024-09-12T01:38:37.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.896+0000 7f58277fe640 1 -- 172.21.15.60:0/1626159151 learned_addr learned my addr 172.21.15.60:0/1626159151 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.896+0000 7f5826ffd640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58280b54d0 0x7f5828152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.896+0000 7f58267fc640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58280b7450 0x7f58281f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.897+0000 7f58277fe640 1 -- 172.21.15.60:0/1626159151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58280b7450 msgr2=0x7f58281f4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.897+0000 7f58277fe640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58280b7450 0x7f58281f4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.897+0000 7f58277fe640 1 -- 172.21.15.60:0/1626159151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58280b54d0 msgr2=0x7f5828152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.897+0000 7f58277fe640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58280b54d0 0x7f5828152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.897+0000 7f58277fe640 1 -- 172.21.15.60:0/1626159151 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5828162230 con 0x7f582815e6f0 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.897+0000 7f58277fe640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f582815e6f0 0x7f5828161520 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f582000d830 tx=0x7f582000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.897+0000 7f581ffff640 1 -- 172.21.15.60:0/1626159151 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582000b6c0 con 0x7f582815e6f0 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.897+0000 7f581ffff640 1 -- 172.21.15.60:0/1626159151 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5820019070 con 0x7f582815e6f0 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.897+0000 7f582d99f640 1 -- 172.21.15.60:0/1626159151 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58281f47c0 con 0x7f582815e6f0 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.897+0000 7f581ffff640 1 -- 172.21.15.60:0/1626159151 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582000bac0 con 0x7f582815e6f0 2024-09-12T01:38:37.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.897+0000 7f582d99f640 1 -- 172.21.15.60:0/1626159151 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5828153b80 con 0x7f582815e6f0 2024-09-12T01:38:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.898+0000 7f582d99f640 1 -- 172.21.15.60:0/1626159151 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f582806c6c0 con 0x7f582815e6f0 2024-09-12T01:38:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.899+0000 7f581ffff640 1 -- 172.21.15.60:0/1626159151 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f582000bc60 con 0x7f582815e6f0 2024-09-12T01:38:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.899+0000 7f581ffff640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f580806be30 0x7f580806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:37.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.899+0000 7f581ffff640 1 -- 172.21.15.60:0/1626159151 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f582008b100 con 0x7f582815e6f0 2024-09-12T01:38:37.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.899+0000 7f5826ffd640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f580806be30 0x7f580806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:37.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.900+0000 7f5826ffd640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f580806be30 0x7f580806e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5818033000 tx=0x7f5818009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:37.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:37.903+0000 7f581ffff640 1 -- 172.21.15.60:0/1626159151 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58200594f0 con 0x7f582815e6f0 2024-09-12T01:38:38.051 INFO:tasks.ceph.mds.d.smithi105.stderr:2024-09-12T01:38:38.051+0000 7f5ced962640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:38:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:38.115+0000 7f582d99f640 1 -- 172.21.15.60:0/1626159151 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f582815f750 con 0x7f582815e6f0 2024-09-12T01:38:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.082+0000 7f581ffff640 1 -- 172.21.15.60:0/1626159151 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f582005d7f0 con 0x7f582815e6f0 2024-09-12T01:38:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.086+0000 7f582d99f640 1 -- 172.21.15.60:0/1626159151 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f580806be30 msgr2=0x7f580806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.086+0000 7f582d99f640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f580806be30 0x7f580806e2f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5818033000 tx=0x7f5818009000 comp rx=0 tx=0).stop 2024-09-12T01:38:39.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.086+0000 7f582d99f640 1 -- 172.21.15.60:0/1626159151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f582815e6f0 msgr2=0x7f5828161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.086+0000 7f582d99f640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f582815e6f0 0x7f5828161520 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f582000d830 tx=0x7f582000dcf0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.086+0000 7f582d99f640 1 -- 172.21.15.60:0/1626159151 shutdown_connections 2024-09-12T01:38:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.086+0000 7f582d99f640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f582815e6f0 0x7f5828161520 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.086+0000 7f582d99f640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f580806be30 0x7f580806e2f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.086+0000 7f582d99f640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58280b7450 0x7f58281f4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.086+0000 7f582d99f640 1 --2- 172.21.15.60:0/1626159151 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58280b54d0 0x7f5828152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.086+0000 7f582d99f640 1 -- 172.21.15.60:0/1626159151 >> 172.21.15.60:0/1626159151 conn(0x7f58280d2430 msgr2=0x7f58280b2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.086+0000 7f582d99f640 1 -- 172.21.15.60:0/1626159151 shutdown_connections 2024-09-12T01:38:39.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.086+0000 7f582d99f640 1 -- 172.21.15.60:0/1626159151 wait complete. 2024-09-12T01:38:39.100 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:38:39.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:39.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.209+0000 7f0bd8352640 1 Processor -- start 2024-09-12T01:38:39.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.209+0000 7f0bd8352640 1 -- start start 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.210+0000 7f0bd8352640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0bd015c170 0x7f0bd015c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.210+0000 7f0bd8352640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bd00b4cf0 con 0x7f0bd00b64e0 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.210+0000 7f0bd8352640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bd00b4fd0 con 0x7f0bd00cf6c0 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.210+0000 7f0bd8352640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0bd015ca90 con 0x7f0bd015c170 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.210+0000 7f0bd68ef640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0bd00b64e0 0x7f0bd00b39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45386/0 (socket says 172.21.15.60:45386) 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.210+0000 7f0bd68ef640 1 -- 172.21.15.60:0/2660570940 learned_addr learned my addr 172.21.15.60:0/2660570940 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.210+0000 7f0bd60ee640 1 --2- 172.21.15.60:0/2660570940 >> v2:172.21.15.105:3300/0 conn(0x7f0bd015c170 0x7f0bd015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.210+0000 7f0bd50ec640 1 -- 172.21.15.60:0/2660570940 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1605052805 0 0) 0x7f0bd00b4cf0 con 0x7f0bd00b64e0 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.210+0000 7f0bd50ec640 1 -- 172.21.15.60:0/2660570940 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bbc003520 con 0x7f0bd00b64e0 2024-09-12T01:38:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.211+0000 7f0bd60ee640 1 -- 172.21.15.60:0/2660570940 >> v1:172.21.15.105:6789/0 conn(0x7f0bd00cf6c0 legacy=0x7f0bd00b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.211+0000 7f0bd50ec640 1 -- 172.21.15.60:0/2660570940 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2875525399 0 0) 0x7f0bd00b4fd0 con 0x7f0bd00cf6c0 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.211+0000 7f0bd60ee640 1 -- 172.21.15.60:0/2660570940 >> v1:172.21.15.60:6789/0 conn(0x7f0bd00b64e0 legacy=0x7f0bd00b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.211+0000 7f0bd60ee640 1 -- 172.21.15.60:0/2660570940 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd00b52b0 con 0x7f0bd015c170 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.211+0000 7f0bd60ee640 1 --2- 172.21.15.60:0/2660570940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd015c170 0x7f0bd015c550 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097d0 tx=0x7f0bcc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22cc7cbf32f27334 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:39.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.211+0000 7f0bd50ec640 1 -- 172.21.15.60:0/2660570940 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc037070 con 0x7f0bd015c170 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.212+0000 7f0bd50ec640 1 -- 172.21.15.60:0/2660570940 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bcc032440 con 0x7f0bd015c170 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.212+0000 7f0bd50ec640 1 -- 172.21.15.60:0/2660570940 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc032810 con 0x7f0bd015c170 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.212+0000 7f0bd8352640 1 -- 172.21.15.60:0/2660570940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd015c170 msgr2=0x7f0bd015c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.212+0000 7f0bd8352640 1 --2- 172.21.15.60:0/2660570940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd015c170 0x7f0bd015c550 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0097d0 tx=0x7f0bcc02a1c0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.212+0000 7f0bd8352640 1 -- 172.21.15.60:0/2660570940 shutdown_connections 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.212+0000 7f0bd8352640 1 --2- 172.21.15.60:0/2660570940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd015c170 0x7f0bd015c550 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.212+0000 7f0bd8352640 1 -- 172.21.15.60:0/2660570940 >> 172.21.15.60:0/2660570940 conn(0x7f0bd006bc10 msgr2=0x7f0bd006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.212+0000 7f0bd8352640 1 -- 172.21.15.60:0/2660570940 shutdown_connections 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.212+0000 7f0bd8352640 1 -- 172.21.15.60:0/2660570940 wait complete. 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.213+0000 7f0bd8352640 1 Processor -- start 2024-09-12T01:38:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.213+0000 7f0bd8352640 1 -- start start 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd8352640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd00b64e0 0x7f0bd01f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd8352640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd00cf6c0 0x7f0bd01f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd8352640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd015c170 0x7f0bd00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd8352640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd00b5b50 con 0x7f0bd00b64e0 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd8352640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd00b58b0 con 0x7f0bd00cf6c0 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd8352640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0bd00cfb30 con 0x7f0bd015c170 2024-09-12T01:38:39.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd60ee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd00b64e0 0x7f0bd01f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd60ee640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd00b64e0 0x7f0bd01f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54006/0 (socket says 172.21.15.60:54006) 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd60ee640 1 -- 172.21.15.60:0/3123305124 learned_addr learned my addr 172.21.15.60:0/3123305124 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd58ed640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd00cf6c0 0x7f0bd01f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd68ef640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd015c170 0x7f0bd00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd60ee640 1 -- 172.21.15.60:0/3123305124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd015c170 msgr2=0x7f0bd00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.214+0000 7f0bd60ee640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd015c170 0x7f0bd00cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.215+0000 7f0bd60ee640 1 -- 172.21.15.60:0/3123305124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd00cf6c0 msgr2=0x7f0bd01f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.215+0000 7f0bd60ee640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd00cf6c0 0x7f0bd01f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.215+0000 7f0bd60ee640 1 -- 172.21.15.60:0/3123305124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd013ed50 con 0x7f0bd00b64e0 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.215+0000 7f0bd58ed640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd00cf6c0 0x7f0bd01f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.215+0000 7f0bd68ef640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd015c170 0x7f0bd00cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.215+0000 7f0bd60ee640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd00b64e0 0x7f0bd01f3090 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0098f0 tx=0x7f0bcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:39.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.215+0000 7f0bc6ffd640 1 -- 172.21.15.60:0/3123305124 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc041020 con 0x7f0bd00b64e0 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.215+0000 7f0bc6ffd640 1 -- 172.21.15.60:0/3123305124 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bcc03d700 con 0x7f0bd00b64e0 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.215+0000 7f0bd8352640 1 -- 172.21.15.60:0/3123305124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd013f030 con 0x7f0bd00b64e0 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.215+0000 7f0bc6ffd640 1 -- 172.21.15.60:0/3123305124 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc037040 con 0x7f0bd00b64e0 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.215+0000 7f0bd8352640 1 -- 172.21.15.60:0/3123305124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd013f5f0 con 0x7f0bd00b64e0 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.216+0000 7f0bd8352640 1 -- 172.21.15.60:0/3123305124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bd00cff20 con 0x7f0bd00b64e0 2024-09-12T01:38:39.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.216+0000 7f0bc6ffd640 1 -- 172.21.15.60:0/3123305124 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0bcc044020 con 0x7f0bd00b64e0 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.217+0000 7f0bc6ffd640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0bb406be30 0x7f0bb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.217+0000 7f0bc6ffd640 1 -- 172.21.15.60:0/3123305124 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f0bcc0ab650 con 0x7f0bd00b64e0 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.217+0000 7f0bd58ed640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0bb406be30 0x7f0bb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.217+0000 7f0bd58ed640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0bb406be30 0x7f0bb406e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00cc250 tx=0x7f0bc0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:39.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.221+0000 7f0bc6ffd640 1 -- 172.21.15.60:0/3123305124 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0bcc04b030 con 0x7f0bd00b64e0 2024-09-12T01:38:39.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.431+0000 7f0bd8352640 1 -- 172.21.15.60:0/3123305124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bd0071ad0 con 0x7f0bd00b64e0 2024-09-12T01:38:39.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.432+0000 7f0bc6ffd640 1 -- 172.21.15.60:0/3123305124 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f0bcc07a000 con 0x7f0bd00b64e0 2024-09-12T01:38:39.435 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:39.435 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":38,"btime":"2024-09-12T01:38:39:078790+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/672507371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":672507371},{"type":"v1","addr":"172.21.15.60:6836","nonce":672507371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/2426056287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2426056287},{"type":"v1","addr":"172.21.15.105:6833","nonce":2426056287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/183879558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":183879558},{"type":"v1","addr":"172.21.15.60:6837","nonce":183879558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:35.419604+0000","modified":"2024-09-12T01:38:38.117150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35168":{"gid":35168,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1216783001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1216783001},{"type":"v1","addr":"172.21.15.105:6835","nonce":1216783001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35168,"qdb_cluster":[35168]},"id":5}]} 2024-09-12T01:38:39.436 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 38 2024-09-12T01:38:39.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.433+0000 7f0bd8352640 1 -- 172.21.15.60:0/3123305124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0bb406be30 msgr2=0x7f0bb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.433+0000 7f0bd8352640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0bb406be30 0x7f0bb406e2f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0bd00cc250 tx=0x7f0bc0009040 comp rx=0 tx=0).stop 2024-09-12T01:38:39.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.434+0000 7f0bd8352640 1 -- 172.21.15.60:0/3123305124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd00b64e0 msgr2=0x7f0bd01f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.434+0000 7f0bd8352640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd00b64e0 0x7f0bd01f3090 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0098f0 tx=0x7f0bcc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.434+0000 7f0bd8352640 1 -- 172.21.15.60:0/3123305124 shutdown_connections 2024-09-12T01:38:39.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.434+0000 7f0bd8352640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0bb406be30 0x7f0bb406e2f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.434+0000 7f0bd8352640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0bd015c170 0x7f0bd00cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.434+0000 7f0bd8352640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0bd00cf6c0 0x7f0bd01f4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.434+0000 7f0bd8352640 1 --2- 172.21.15.60:0/3123305124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0bd00b64e0 0x7f0bd01f3090 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.434+0000 7f0bd8352640 1 -- 172.21.15.60:0/3123305124 >> 172.21.15.60:0/3123305124 conn(0x7f0bd006bc10 msgr2=0x7f0bd015ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:39.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.434+0000 7f0bd8352640 1 -- 172.21.15.60:0/3123305124 shutdown_connections 2024-09-12T01:38:39.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.434+0000 7f0bd8352640 1 -- 172.21.15.60:0/3123305124 wait complete. 2024-09-12T01:38:39.445 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:38:39.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.547+0000 7ff9b45fd640 1 Processor -- start 2024-09-12T01:38:39.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.547+0000 7ff9b45fd640 1 -- start start 2024-09-12T01:38:39.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b45fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9ac0cf6b0 0x7ff9ac1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b45fd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ac0cfc20 con 0x7ff9ac162f30 2024-09-12T01:38:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b45fd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9ac0d2ed0 con 0x7ff9ac0b63d0 2024-09-12T01:38:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b45fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac0d40c0 con 0x7ff9ac0cf6b0 2024-09-12T01:38:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b2b9a640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff9ac162f30 0x7ff9ac0b7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45388/0 (socket says 172.21.15.60:45388) 2024-09-12T01:38:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b2b9a640 1 -- 172.21.15.60:0/2807798314 learned_addr learned my addr 172.21.15.60:0/2807798314 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b1b98640 1 --2- 172.21.15.60:0/2807798314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9ac0cf6b0 0x7ff9ac1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 535633851 0 0) 0x7ff9ac0cfc20 con 0x7ff9ac162f30 2024-09-12T01:38:39.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff998003520 con 0x7ff9ac162f30 2024-09-12T01:38:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 621494897 0 0) 0x7ff998003520 con 0x7ff9ac162f30 2024-09-12T01:38:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9ac0cf6b0 msgr2=0x7ff9ac1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b1397640 1 --2- 172.21.15.60:0/2807798314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9ac0cf6b0 0x7ff9ac1629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 >> v1:172.21.15.105:6789/0 conn(0x7ff9ac0b63d0 legacy=0x7ff9ac0d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac0d31b0 con 0x7ff9ac162f30 2024-09-12T01:38:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7ff9a40019f0 con 0x7ff9ac162f30 2024-09-12T01:38:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 >> v1:172.21.15.60:6789/0 conn(0x7ff9ac162f30 legacy=0x7ff9ac0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b1397640 1 --2- 172.21.15.60:0/2807798314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9980039e0 0x7ff998003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.548+0000 7ff9b1397640 1 --2- 172.21.15.60:0/2807798314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9ac0cf6b0 0x7ff998004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.549+0000 7ff9b1397640 1 --2- 172.21.15.60:0/2807798314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff998004d40 0x7ff9980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.549+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0d40c0 con 0x7ff9980039e0 2024-09-12T01:38:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.549+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff99800baa0 con 0x7ff998004d40 2024-09-12T01:38:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.549+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff99800bca0 con 0x7ff9ac0cf6b0 2024-09-12T01:38:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.549+0000 7ff9b2399640 1 --2- 172.21.15.60:0/2807798314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9980039e0 0x7ff998003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.549+0000 7ff9b1b98640 1 --2- 172.21.15.60:0/2807798314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9ac0cf6b0 0x7ff998004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.549+0000 7ff9b2b9a640 1 --2- 172.21.15.60:0/2807798314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff998004d40 0x7ff9980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.549+0000 7ff9b2399640 1 -- 172.21.15.60:0/2807798314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9ac0cf6b0 msgr2=0x7ff998004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.549+0000 7ff9b2399640 1 --2- 172.21.15.60:0/2807798314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9ac0cf6b0 0x7ff998004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.549+0000 7ff9b2399640 1 -- 172.21.15.60:0/2807798314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff998004d40 msgr2=0x7ff9980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.549+0000 7ff9b2399640 1 --2- 172.21.15.60:0/2807798314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff998004d40 0x7ff9980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.549+0000 7ff9b2399640 1 -- 172.21.15.60:0/2807798314 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff998003520 con 0x7ff9980039e0 2024-09-12T01:38:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.550+0000 7ff9b2399640 1 --2- 172.21.15.60:0/2807798314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9980039e0 0x7ff998003e00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8001750 tx=0x7ff998005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22810d7e833648c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.550+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8001370 con 0x7ff9980039e0 2024-09-12T01:38:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.550+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a80052d0 con 0x7ff9980039e0 2024-09-12T01:38:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.550+0000 7ff9b1397640 1 -- 172.21.15.60:0/2807798314 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a802abe0 con 0x7ff9980039e0 2024-09-12T01:38:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.550+0000 7ff9b45fd640 1 -- 172.21.15.60:0/2807798314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9980039e0 msgr2=0x7ff998003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.550+0000 7ff9b45fd640 1 --2- 172.21.15.60:0/2807798314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9980039e0 0x7ff998003e00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8001750 tx=0x7ff998005830 comp rx=0 tx=0).stop 2024-09-12T01:38:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.550+0000 7ff9b2b9a640 1 -- 172.21.15.60:0/2807798314 reap_dead start 2024-09-12T01:38:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.550+0000 7ff9b45fd640 1 -- 172.21.15.60:0/2807798314 shutdown_connections 2024-09-12T01:38:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.550+0000 7ff9b45fd640 1 -- 172.21.15.60:0/2807798314 >> 172.21.15.60:0/2807798314 conn(0x7ff9ac0d1160 msgr2=0x7ff9ac0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.550+0000 7ff9b45fd640 1 -- 172.21.15.60:0/2807798314 shutdown_connections 2024-09-12T01:38:39.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.551+0000 7ff9b45fd640 1 -- 172.21.15.60:0/2807798314 wait complete. 2024-09-12T01:38:39.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.552+0000 7ff9b45fd640 1 Processor -- start 2024-09-12T01:38:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.552+0000 7ff9b45fd640 1 -- start start 2024-09-12T01:38:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.552+0000 7ff9b45fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980039e0 0x7ff9ac150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.552+0000 7ff9b45fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9ac1617b0 0x7ff9ac161c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.552+0000 7ff9b45fd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9ac15cbf0 0x7ff9ac15d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.552+0000 7ff9b45fd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0cb5c0 con 0x7ff9ac1617b0 2024-09-12T01:38:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.552+0000 7ff9b45fd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff9ac0cb440 con 0x7ff9ac15cbf0 2024-09-12T01:38:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.552+0000 7ff9b45fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff9ac0d1c80 con 0x7ff9980039e0 2024-09-12T01:38:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b1b98640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9ac1617b0 0x7ff9ac161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b1b98640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9ac1617b0 0x7ff9ac161c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54014/0 (socket says 172.21.15.60:54014) 2024-09-12T01:38:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b1b98640 1 -- 172.21.15.60:0/804364142 learned_addr learned my addr 172.21.15.60:0/804364142 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b2399640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980039e0 0x7ff9ac150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b2b9a640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9ac15cbf0 0x7ff9ac15d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b1b98640 1 -- 172.21.15.60:0/804364142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980039e0 msgr2=0x7ff9ac150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b1b98640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980039e0 0x7ff9ac150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b1b98640 1 -- 172.21.15.60:0/804364142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9ac15cbf0 msgr2=0x7ff9ac15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b1b98640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9ac15cbf0 0x7ff9ac15d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b1b98640 1 -- 172.21.15.60:0/804364142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9ac150540 con 0x7ff9ac1617b0 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b2b9a640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9ac15cbf0 0x7ff9ac15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b1b98640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9ac1617b0 0x7ff9ac161c30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff99c011a00 tx=0x7ff99c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9a2ffd640 1 -- 172.21.15.60:0/804364142 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00fb50 con 0x7ff9ac1617b0 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9a2ffd640 1 -- 172.21.15.60:0/804364142 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99c00fcf0 con 0x7ff9ac1617b0 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b45fd640 1 -- 172.21.15.60:0/804364142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9ac14d5f0 con 0x7ff9ac1617b0 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9a2ffd640 1 -- 172.21.15.60:0/804364142 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00fea0 con 0x7ff9ac1617b0 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.553+0000 7ff9b45fd640 1 -- 172.21.15.60:0/804364142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9ac14dbb0 con 0x7ff9ac1617b0 2024-09-12T01:38:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.554+0000 7ff9b45fd640 1 -- 172.21.15.60:0/804364142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9ac0b67b0 con 0x7ff9ac1617b0 2024-09-12T01:38:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.555+0000 7ff9a2ffd640 1 -- 172.21.15.60:0/804364142 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff99c012040 con 0x7ff9ac1617b0 2024-09-12T01:38:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.555+0000 7ff9a2ffd640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff99006be30 0x7ff99006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.555+0000 7ff9a2ffd640 1 -- 172.21.15.60:0/804364142 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7ff99c08b4d0 con 0x7ff9ac1617b0 2024-09-12T01:38:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.555+0000 7ff9b2399640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff99006be30 0x7ff99006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.556+0000 7ff9b2399640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff99006be30 0x7ff99006e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8032000 tx=0x7ff9a802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:39.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.560+0000 7ff9a2ffd640 1 -- 172.21.15.60:0/804364142 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff99c019030 con 0x7ff9ac1617b0 2024-09-12T01:38:39.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.734+0000 7ff9b45fd640 1 -- 172.21.15.60:0/804364142 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9ac0cf280 con 0x7ff9ac1617b0 2024-09-12T01:38:39.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.735+0000 7ff9a2ffd640 1 -- 172.21.15.60:0/804364142 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16632 (secure 0 0 0) 0x7ff99c089e20 con 0x7ff9ac1617b0 2024-09-12T01:38:39.736 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:39.736 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:38:37.067956+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:38:33.077570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T01:38:34.408910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:38:39.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.737+0000 7ff9b45fd640 1 -- 172.21.15.60:0/804364142 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff99006be30 msgr2=0x7ff99006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.737+0000 7ff9b45fd640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff99006be30 0x7ff99006e2f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8032000 tx=0x7ff9a802e000 comp rx=0 tx=0).stop 2024-09-12T01:38:39.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.737+0000 7ff9b45fd640 1 -- 172.21.15.60:0/804364142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9ac1617b0 msgr2=0x7ff9ac161c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.737+0000 7ff9b45fd640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9ac1617b0 0x7ff9ac161c30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff99c011a00 tx=0x7ff99c011ec0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.737+0000 7ff9b45fd640 1 -- 172.21.15.60:0/804364142 shutdown_connections 2024-09-12T01:38:39.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.737+0000 7ff9b45fd640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9ac15cbf0 0x7ff9ac15d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.737+0000 7ff9b45fd640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9ac1617b0 0x7ff9ac161c30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.737+0000 7ff9b45fd640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff99006be30 0x7ff99006e2f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.737+0000 7ff9b45fd640 1 --2- 172.21.15.60:0/804364142 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9980039e0 0x7ff9ac150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.737+0000 7ff9b45fd640 1 -- 172.21.15.60:0/804364142 >> 172.21.15.60:0/804364142 conn(0x7ff9ac0d1160 msgr2=0x7ff9ac162760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:39.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.737+0000 7ff9b45fd640 1 -- 172.21.15.60:0/804364142 shutdown_connections 2024-09-12T01:38:39.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.737+0000 7ff9b45fd640 1 -- 172.21.15.60:0/804364142 wait complete. 2024-09-12T01:38:39.749 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:38:39.749 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:39.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.851+0000 7f7353c77640 1 Processor -- start 2024-09-12T01:38:39.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.851+0000 7f7353c77640 1 -- start start 2024-09-12T01:38:39.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.852+0000 7f7353c77640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f734c0cfb90 0x7f734c0d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.852+0000 7f7353c77640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f734c06fa50 0x7f734c073350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.852+0000 7f7353c77640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f734c0d1870 con 0x7f734c0d2090 2024-09-12T01:38:39.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.852+0000 7f7353c77640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f734c15d810 con 0x7f734c06fa50 2024-09-12T01:38:39.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.852+0000 7f7353c77640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f734c15cc00 con 0x7f734c0cfb90 2024-09-12T01:38:39.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.852+0000 7f7351212640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f734c0d2090 0x7f734c06f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45404/0 (socket says 172.21.15.60:45404) 2024-09-12T01:38:39.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.852+0000 7f7351212640 1 -- 172.21.15.60:0/3500755548 learned_addr learned my addr 172.21.15.60:0/3500755548 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:39.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.852+0000 7f7352214640 1 --2- 172.21.15.60:0/3500755548 >> v2:172.21.15.105:3300/0 conn(0x7f734c06fa50 0x7f734c073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.852+0000 7f7351a13640 1 --2- 172.21.15.60:0/3500755548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f734c0cfb90 0x7f734c0d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.852+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2859574242 0 0) 0x7f734c0d1870 con 0x7f734c0d2090 2024-09-12T01:38:39.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.852+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7338003520 con 0x7f734c0d2090 2024-09-12T01:38:39.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1066726397 0 0) 0x7f7338003520 con 0x7f734c0d2090 2024-09-12T01:38:39.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f734c0cfb90 msgr2=0x7f734c0d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:39.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 --2- 172.21.15.60:0/3500755548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f734c0cfb90 0x7f734c0d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 >> v2:172.21.15.105:3300/0 conn(0x7f734c06fa50 msgr2=0x7f734c073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:39.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 --2- 172.21.15.60:0/3500755548 >> v2:172.21.15.105:3300/0 conn(0x7f734c06fa50 0x7f734c073350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c15cee0 con 0x7f734c0d2090 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f733c001670 con 0x7f734c0d2090 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7352214640 1 --2- 172.21.15.60:0/3500755548 >> v2:172.21.15.105:3300/0 conn(0x7f734c06fa50 0x7f734c073350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 >> v1:172.21.15.60:6789/0 conn(0x7f734c0d2090 legacy=0x7f734c06f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 --2- 172.21.15.60:0/3500755548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f734c0cfb90 0x7f73380039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 --2- 172.21.15.60:0/3500755548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7338003f30 0x7f7338004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 --2- 172.21.15.60:0/3500755548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7338004d40 0x7f73380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f734c15d810 con 0x7f7338003f30 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f734c15cc00 con 0x7f7338004d40 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f733800b9c0 con 0x7f734c0cfb90 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7351212640 1 --2- 172.21.15.60:0/3500755548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7338003f30 0x7f7338004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7351a13640 1 --2- 172.21.15.60:0/3500755548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f734c0cfb90 0x7f73380039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7352214640 1 --2- 172.21.15.60:0/3500755548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7338004d40 0x7f73380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7351212640 1 -- 172.21.15.60:0/3500755548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f734c0cfb90 msgr2=0x7f73380039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7351212640 1 --2- 172.21.15.60:0/3500755548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f734c0cfb90 0x7f73380039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7351212640 1 -- 172.21.15.60:0/3500755548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7338004d40 msgr2=0x7f73380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7351212640 1 --2- 172.21.15.60:0/3500755548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7338004d40 0x7f73380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.853+0000 7f7351212640 1 -- 172.21.15.60:0/3500755548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7338003520 con 0x7f7338003f30 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.854+0000 7f7351212640 1 --2- 172.21.15.60:0/3500755548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7338003f30 0x7f7338004800 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f733c007fd0 tx=0x7f7338005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7c01a97ab5ab2c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.854+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c007d50 con 0x7f7338003f30 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.854+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c005ad0 con 0x7f7338003f30 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.854+0000 7f7350a11640 1 -- 172.21.15.60:0/3500755548 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c007070 con 0x7f7338003f30 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.855+0000 7f7353c77640 1 -- 172.21.15.60:0/3500755548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7338003f30 msgr2=0x7f7338004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.855+0000 7f7353c77640 1 --2- 172.21.15.60:0/3500755548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7338003f30 0x7f7338004800 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f733c007fd0 tx=0x7f7338005830 comp rx=0 tx=0).stop 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.855+0000 7f7352214640 1 -- 172.21.15.60:0/3500755548 reap_dead start 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.855+0000 7f7353c77640 1 -- 172.21.15.60:0/3500755548 shutdown_connections 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.855+0000 7f7353c77640 1 -- 172.21.15.60:0/3500755548 >> 172.21.15.60:0/3500755548 conn(0x7f734c062630 msgr2=0x7f734c062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.855+0000 7f7353c77640 1 -- 172.21.15.60:0/3500755548 shutdown_connections 2024-09-12T01:38:39.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.855+0000 7f7353c77640 1 -- 172.21.15.60:0/3500755548 wait complete. 2024-09-12T01:38:39.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.856+0000 7f7353c77640 1 Processor -- start 2024-09-12T01:38:39.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.856+0000 7f7353c77640 1 -- start start 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7353c77640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7338003f30 0x7f734c140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7353c77640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0c7520 0x7f734c143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7353c77640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734c0b6230 0x7f734c0b66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7353c77640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f734c0cff70 con 0x7f734c0c7520 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7353c77640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f734c15d4a0 con 0x7f734c0b6230 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7353c77640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f734c0b55b0 con 0x7f7338003f30 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7351212640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0c7520 0x7f734c143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7351212640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0c7520 0x7f734c143920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54024/0 (socket says 172.21.15.60:54024) 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7351212640 1 -- 172.21.15.60:0/161617936 learned_addr learned my addr 172.21.15.60:0/161617936 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7352214640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734c0b6230 0x7f734c0b66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7351a13640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7338003f30 0x7f734c140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7351212640 1 -- 172.21.15.60:0/161617936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7338003f30 msgr2=0x7f734c140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7351212640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7338003f30 0x7f734c140760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7351212640 1 -- 172.21.15.60:0/161617936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734c0b6230 msgr2=0x7f734c0b66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7351212640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734c0b6230 0x7f734c0b66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7351212640 1 -- 172.21.15.60:0/161617936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734c143e60 con 0x7f734c0c7520 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7352214640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734c0b6230 0x7f734c0b66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7351a13640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7338003f30 0x7f734c140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f7351212640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0c7520 0x7f734c143920 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f733c02ae00 tx=0x7f734c15d780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.857+0000 7f73427fc640 1 -- 172.21.15.60:0/161617936 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c041020 con 0x7f734c0c7520 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.858+0000 7f73427fc640 1 -- 172.21.15.60:0/161617936 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733c0047e0 con 0x7f734c0c7520 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.858+0000 7f7353c77640 1 -- 172.21.15.60:0/161617936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734c156220 con 0x7f734c0c7520 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.858+0000 7f73427fc640 1 -- 172.21.15.60:0/161617936 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733c038040 con 0x7f734c0c7520 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.858+0000 7f7353c77640 1 -- 172.21.15.60:0/161617936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f734c155f40 con 0x7f734c0c7520 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.859+0000 7f7353c77640 1 -- 172.21.15.60:0/161617936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734c0b6bf0 con 0x7f734c0c7520 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.859+0000 7f73427fc640 1 -- 172.21.15.60:0/161617936 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f733c044020 con 0x7f734c0c7520 2024-09-12T01:38:39.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.859+0000 7f73427fc640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f733006be30 0x7f733006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:39.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.860+0000 7f73427fc640 1 -- 172.21.15.60:0/161617936 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f733c0aaba0 con 0x7f734c0c7520 2024-09-12T01:38:39.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.860+0000 7f7351a13640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f733006be30 0x7f733006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:39.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.860+0000 7f7351a13640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f733006be30 0x7f733006e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f73480099e0 tx=0x7f7348008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:39.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:39.864+0000 7f73427fc640 1 -- 172.21.15.60:0/161617936 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f734c143e60 con 0x7f734c0c7520 2024-09-12T01:38:40.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.035+0000 7f7353c77640 1 -- 172.21.15.60:0/161617936 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f734c0b7380 con 0x7f733006be30 2024-09-12T01:38:40.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.041+0000 7f73427fc640 1 -- 172.21.15.60:0/161617936 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+245446 (secure 0 0 0) 0x7f734c0b7380 con 0x7f733006be30 2024-09-12T01:38:40.044 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:40.045 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:38:40.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.044+0000 7f7353c77640 1 -- 172.21.15.60:0/161617936 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f733006be30 msgr2=0x7f733006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.044+0000 7f7353c77640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f733006be30 0x7f733006e2f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f73480099e0 tx=0x7f7348008040 comp rx=0 tx=0).stop 2024-09-12T01:38:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.044+0000 7f7353c77640 1 -- 172.21.15.60:0/161617936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0c7520 msgr2=0x7f734c143920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.044+0000 7f7353c77640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0c7520 0x7f734c143920 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f733c02ae00 tx=0x7f734c15d780 comp rx=0 tx=0).stop 2024-09-12T01:38:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.044+0000 7f7353c77640 1 -- 172.21.15.60:0/161617936 shutdown_connections 2024-09-12T01:38:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.044+0000 7f7353c77640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734c0b6230 0x7f734c0b66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.044+0000 7f7353c77640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f734c0c7520 0x7f734c143920 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.044+0000 7f7353c77640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f733006be30 0x7f733006e2f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.044+0000 7f7353c77640 1 --2- 172.21.15.60:0/161617936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7338003f30 0x7f734c140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.044+0000 7f7353c77640 1 -- 172.21.15.60:0/161617936 >> 172.21.15.60:0/161617936 conn(0x7f734c062630 msgr2=0x7f734c15aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.044+0000 7f7353c77640 1 -- 172.21.15.60:0/161617936 shutdown_connections 2024-09-12T01:38:40.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.044+0000 7f7353c77640 1 -- 172.21.15.60:0/161617936 wait complete. 2024-09-12T01:38:40.055 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-12T01:38:38.294532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":172,"acting":172,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":252672,"kb_used_data":7296,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754722048,"statfs":{"total":773094113280,"available":772835377152,"internally_reserved":0,"allocated":7471104,"data_stored":3753720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.242365"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.072994+0000","last_change":"2024-09-12T01:38:35.072994+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.072994+0000","last_undegraded":"2024-09-12T01:38:35.072994+0000","last_fullsized":"2024-09-12T01:38:35.072994+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066042+0000","last_change":"2024-09-12T01:38:35.066042+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066042+0000","last_undegraded":"2024-09-12T01:38:35.066042+0000","last_fullsized":"2024-09-12T01:38:35.066042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065873+0000","last_change":"2024-09-12T01:38:35.065873+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065873+0000","last_undegraded":"2024-09-12T01:38:35.065873+0000","last_fullsized":"2024-09-12T01:38:35.065873+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065654+0000","last_change":"2024-09-12T01:38:35.065654+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065654+0000","last_undegraded":"2024-09-12T01:38:35.065654+0000","last_fullsized":"2024-09-12T01:38:35.065654+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061113+0000","last_change":"2024-09-12T01:38:35.061113+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061113+0000","last_undegraded":"2024-09-12T01:38:35.061113+0000","last_fullsized":"2024-09-12T01:38:35.061113+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.068161+0000","last_change":"2024-09-12T01:38:35.068161+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.068161+0000","last_undegraded":"2024-09-12T01:38:35.068161+0000","last_fullsized":"2024-09-12T01:38:35.068161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069805+0000","last_change":"2024-09-12T01:38:35.069805+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069805+0000","last_undegraded":"2024-09-12T01:38:35.069805+0000","last_fullsized":"2024-09-12T01:38:35.069805+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.072551+0000","last_change":"2024-09-12T01:38:35.072551+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.072551+0000","last_undegraded":"2024-09-12T01:38:35.072551+0000","last_fullsized":"2024-09-12T01:38:35.072551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065795+0000","last_change":"2024-09-12T01:38:35.065795+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065795+0000","last_undegraded":"2024-09-12T01:38:35.065795+0000","last_fullsized":"2024-09-12T01:38:35.065795+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062440+0000","last_change":"2024-09-12T01:38:35.062440+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062440+0000","last_undegraded":"2024-09-12T01:38:35.062440+0000","last_fullsized":"2024-09-12T01:38:35.062440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.075204+0000","last_change":"2024-09-12T01:38:35.075204+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.075204+0000","last_undegraded":"2024-09-12T01:38:35.075204+0000","last_fullsized":"2024-09-12T01:38:35.075204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:38:35.052271+0000","last_change":"2024-09-12T01:38:35.052271+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.052271+0000","last_undegraded":"2024-09-12T01:38:35.052271+0000","last_fullsized":"2024-09-12T01:38:35.052271+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064920+0000","last_change":"2024-09-12T01:38:35.064920+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064920+0000","last_undegraded":"2024-09-12T01:38:35.064920+0000","last_fullsized":"2024-09-12T01:38:35.064920+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:38:35.052271+0000","last_change":"2024-09-12T01:38:35.052271+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.052271+0000","last_undegraded":"2024-09-12T01:38:35.052271+0000","last_fullsized":"2024-09-12T01:38:35.052271+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:38:35.052271+0000","last_change":"2024-09-12T01:38:35.052271+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.052271+0000","last_undegraded":"2024-09-12T01:38:35.052271+0000","last_fullsized":"2024-09-12T01:38:35.052271+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.070031+0000","last_change":"2024-09-12T01:38:35.070031+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.070031+0000","last_undegraded":"2024-09-12T01:38:35.070031+0000","last_fullsized":"2024-09-12T01:38:35.070031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061032+0000","last_change":"2024-09-12T01:38:35.061032+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061032+0000","last_undegraded":"2024-09-12T01:38:35.061032+0000","last_fullsized":"2024-09-12T01:38:35.061032+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062004+0000","last_change":"2024-09-12T01:38:35.062004+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062004+0000","last_undegraded":"2024-09-12T01:38:35.062004+0000","last_fullsized":"2024-09-12T01:38:35.062004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.074726+0000","last_change":"2024-09-12T01:38:35.074726+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.074726+0000","last_undegraded":"2024-09-12T01:38:35.074726+0000","last_fullsized":"2024-09-12T01:38:35.074726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061122+0000","last_change":"2024-09-12T01:38:35.061122+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061122+0000","last_undegraded":"2024-09-12T01:38:35.061122+0000","last_fullsized":"2024-09-12T01:38:35.061122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065481+0000","last_change":"2024-09-12T01:38:35.065481+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065481+0000","last_undegraded":"2024-09-12T01:38:35.065481+0000","last_fullsized":"2024-09-12T01:38:35.065481+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.067729+0000","last_change":"2024-09-12T01:38:35.067729+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.067729+0000","last_undegraded":"2024-09-12T01:38:35.067729+0000","last_fullsized":"2024-09-12T01:38:35.067729+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069348+0000","last_change":"2024-09-12T01:38:35.069348+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069348+0000","last_undegraded":"2024-09-12T01:38:35.069348+0000","last_fullsized":"2024-09-12T01:38:35.069348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069615+0000","last_change":"2024-09-12T01:38:35.069615+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069615+0000","last_undegraded":"2024-09-12T01:38:35.069615+0000","last_fullsized":"2024-09-12T01:38:35.069615+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.068672+0000","last_change":"2024-09-12T01:38:35.068672+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.068672+0000","last_undegraded":"2024-09-12T01:38:35.068672+0000","last_fullsized":"2024-09-12T01:38:35.068672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069144+0000","last_change":"2024-09-12T01:38:35.069144+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069144+0000","last_undegraded":"2024-09-12T01:38:35.069144+0000","last_fullsized":"2024-09-12T01:38:35.069144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063084+0000","last_change":"2024-09-12T01:38:35.063084+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063084+0000","last_undegraded":"2024-09-12T01:38:35.063084+0000","last_fullsized":"2024-09-12T01:38:35.063084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064633+0000","last_change":"2024-09-12T01:38:35.064633+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064633+0000","last_undegraded":"2024-09-12T01:38:35.064633+0000","last_fullsized":"2024-09-12T01:38:35.064633+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064224+0000","last_change":"2024-09-12T01:38:35.064224+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064224+0000","last_undegraded":"2024-09-12T01:38:35.064224+0000","last_fullsized":"2024-09-12T01:38:35.064224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066229+0000","last_change":"2024-09-12T01:38:35.066229+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066229+0000","last_undegraded":"2024-09-12T01:38:35.066229+0000","last_fullsized":"2024-09-12T01:38:35.066229+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066181+0000","last_change":"2024-09-12T01:38:35.066181+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066181+0000","last_undegraded":"2024-09-12T01:38:35.066181+0000","last_fullsized":"2024-09-12T01:38:35.066181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064710+0000","last_change":"2024-09-12T01:38:35.064710+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064710+0000","last_undegraded":"2024-09-12T01:38:35.064710+0000","last_fullsized":"2024-09-12T01:38:35.064710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.067351+0000","last_change":"2024-09-12T01:38:35.067351+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.067351+0000","last_undegraded":"2024-09-12T01:38:35.067351+0000","last_fullsized":"2024-09-12T01:38:35.067351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.077725+0000","last_change":"2024-09-12T01:38:35.074236+0000","last_active":"2024-09-12T01:38:35.077725+0000","last_peered":"2024-09-12T01:38:35.077725+0000","last_clean":"2024-09-12T01:38:35.077725+0000","last_became_active":"2024-09-12T01:38:35.073953+0000","last_became_peered":"2024-09-12T01:38:35.073953+0000","last_unstale":"2024-09-12T01:38:35.077725+0000","last_undegraded":"2024-09-12T01:38:35.077725+0000","last_fullsized":"2024-09-12T01:38:35.077725+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:38.599797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065351+0000","last_change":"2024-09-12T01:38:35.065351+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065351+0000","last_undegraded":"2024-09-12T01:38:35.065351+0000","last_fullsized":"2024-09-12T01:38:35.065351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079116+0000","last_change":"2024-09-12T01:38:35.074361+0000","last_active":"2024-09-12T01:38:35.079116+0000","last_peered":"2024-09-12T01:38:35.079116+0000","last_clean":"2024-09-12T01:38:35.079116+0000","last_became_active":"2024-09-12T01:38:35.074070+0000","last_became_peered":"2024-09-12T01:38:35.074070+0000","last_unstale":"2024-09-12T01:38:35.079116+0000","last_undegraded":"2024-09-12T01:38:35.079116+0000","last_fullsized":"2024-09-12T01:38:35.079116+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:59.874513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.067267+0000","last_change":"2024-09-12T01:38:35.067267+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.067267+0000","last_undegraded":"2024-09-12T01:38:35.067267+0000","last_fullsized":"2024-09-12T01:38:35.067267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081646+0000","last_change":"2024-09-12T01:38:35.081069+0000","last_active":"2024-09-12T01:38:35.081646+0000","last_peered":"2024-09-12T01:38:35.081646+0000","last_clean":"2024-09-12T01:38:35.081646+0000","last_became_active":"2024-09-12T01:38:35.080795+0000","last_became_peered":"2024-09-12T01:38:35.080795+0000","last_unstale":"2024-09-12T01:38:35.081646+0000","last_undegraded":"2024-09-12T01:38:35.081646+0000","last_fullsized":"2024-09-12T01:38:35.081646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:14.413274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063501+0000","last_change":"2024-09-12T01:38:35.063501+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063501+0000","last_undegraded":"2024-09-12T01:38:35.063501+0000","last_fullsized":"2024-09-12T01:38:35.063501+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.075330+0000","last_change":"2024-09-12T01:38:35.073070+0000","last_active":"2024-09-12T01:38:35.075330+0000","last_peered":"2024-09-12T01:38:35.075330+0000","last_clean":"2024-09-12T01:38:35.075330+0000","last_became_active":"2024-09-12T01:38:35.072758+0000","last_became_peered":"2024-09-12T01:38:35.072758+0000","last_unstale":"2024-09-12T01:38:35.075330+0000","last_undegraded":"2024-09-12T01:38:35.075330+0000","last_fullsized":"2024-09-12T01:38:35.075330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:33.928163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065638+0000","last_change":"2024-09-12T01:38:35.065638+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065638+0000","last_undegraded":"2024-09-12T01:38:35.065638+0000","last_fullsized":"2024-09-12T01:38:35.065638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:38:34.045641+0000","last_change":"2024-09-12T01:38:34.045641+0000","last_active":"2024-09-12T01:38:34.045641+0000","last_peered":"2024-09-12T01:38:34.045641+0000","last_clean":"2024-09-12T01:38:34.045641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:34.045641+0000","last_undegraded":"2024-09-12T01:38:34.045641+0000","last_fullsized":"2024-09-12T01:38:34.045641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066679+0000","last_change":"2024-09-12T01:38:35.066679+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066679+0000","last_undegraded":"2024-09-12T01:38:35.066679+0000","last_fullsized":"2024-09-12T01:38:35.066679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.072294+0000","last_change":"2024-09-12T01:38:35.070367+0000","last_active":"2024-09-12T01:38:35.072294+0000","last_peered":"2024-09-12T01:38:35.072294+0000","last_clean":"2024-09-12T01:38:35.072294+0000","last_became_active":"2024-09-12T01:38:35.069659+0000","last_became_peered":"2024-09-12T01:38:35.069659+0000","last_unstale":"2024-09-12T01:38:35.072294+0000","last_undegraded":"2024-09-12T01:38:35.072294+0000","last_fullsized":"2024-09-12T01:38:35.072294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:32.567712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064825+0000","last_change":"2024-09-12T01:38:35.064825+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064825+0000","last_undegraded":"2024-09-12T01:38:35.064825+0000","last_fullsized":"2024-09-12T01:38:35.064825+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081973+0000","last_change":"2024-09-12T01:38:35.075279+0000","last_active":"2024-09-12T01:38:35.081973+0000","last_peered":"2024-09-12T01:38:35.081973+0000","last_clean":"2024-09-12T01:38:35.081973+0000","last_became_active":"2024-09-12T01:38:35.074995+0000","last_became_peered":"2024-09-12T01:38:35.074995+0000","last_unstale":"2024-09-12T01:38:35.081973+0000","last_undegraded":"2024-09-12T01:38:35.081973+0000","last_fullsized":"2024-09-12T01:38:35.081973+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:25.323158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:38:35.052271+0000","last_change":"2024-09-12T01:38:35.052271+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.052271+0000","last_undegraded":"2024-09-12T01:38:35.052271+0000","last_fullsized":"2024-09-12T01:38:35.052271+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:38:34.045641+0000","last_change":"2024-09-12T01:38:34.045641+0000","last_active":"2024-09-12T01:38:34.045641+0000","last_peered":"2024-09-12T01:38:34.045641+0000","last_clean":"2024-09-12T01:38:34.045641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:34.045641+0000","last_undegraded":"2024-09-12T01:38:34.045641+0000","last_fullsized":"2024-09-12T01:38:34.045641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061904+0000","last_change":"2024-09-12T01:38:35.061904+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061904+0000","last_undegraded":"2024-09-12T01:38:35.061904+0000","last_fullsized":"2024-09-12T01:38:35.061904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078503+0000","last_change":"2024-09-12T01:38:35.077055+0000","last_active":"2024-09-12T01:38:35.078503+0000","last_peered":"2024-09-12T01:38:35.078503+0000","last_clean":"2024-09-12T01:38:35.078503+0000","last_became_active":"2024-09-12T01:38:35.076779+0000","last_became_peered":"2024-09-12T01:38:35.076779+0000","last_unstale":"2024-09-12T01:38:35.078503+0000","last_undegraded":"2024-09-12T01:38:35.078503+0000","last_fullsized":"2024-09-12T01:38:35.078503+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:14.530732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065512+0000","last_change":"2024-09-12T01:38:35.065512+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065512+0000","last_undegraded":"2024-09-12T01:38:35.065512+0000","last_fullsized":"2024-09-12T01:38:35.065512+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079028+0000","last_change":"2024-09-12T01:38:35.075612+0000","last_active":"2024-09-12T01:38:35.079028+0000","last_peered":"2024-09-12T01:38:35.079028+0000","last_clean":"2024-09-12T01:38:35.079028+0000","last_became_active":"2024-09-12T01:38:35.075338+0000","last_became_peered":"2024-09-12T01:38:35.075338+0000","last_unstale":"2024-09-12T01:38:35.079028+0000","last_undegraded":"2024-09-12T01:38:35.079028+0000","last_fullsized":"2024-09-12T01:38:35.079028+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:17.701250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066826+0000","last_change":"2024-09-12T01:38:35.066826+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066826+0000","last_undegraded":"2024-09-12T01:38:35.066826+0000","last_fullsized":"2024-09-12T01:38:35.066826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:38:34.045641+0000","last_change":"2024-09-12T01:38:34.045641+0000","last_active":"2024-09-12T01:38:34.045641+0000","last_peered":"2024-09-12T01:38:34.045641+0000","last_clean":"2024-09-12T01:38:34.045641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:34.045641+0000","last_undegraded":"2024-09-12T01:38:34.045641+0000","last_fullsized":"2024-09-12T01:38:34.045641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061071+0000","last_change":"2024-09-12T01:38:35.061071+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061071+0000","last_undegraded":"2024-09-12T01:38:35.061071+0000","last_fullsized":"2024-09-12T01:38:35.061071+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081914+0000","last_change":"2024-09-12T01:38:35.075264+0000","last_active":"2024-09-12T01:38:35.081914+0000","last_peered":"2024-09-12T01:38:35.081914+0000","last_clean":"2024-09-12T01:38:35.081914+0000","last_became_active":"2024-09-12T01:38:35.074931+0000","last_became_peered":"2024-09-12T01:38:35.074931+0000","last_unstale":"2024-09-12T01:38:35.081914+0000","last_undegraded":"2024-09-12T01:38:35.081914+0000","last_fullsized":"2024-09-12T01:38:35.081914+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:32.908068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066160+0000","last_change":"2024-09-12T01:38:35.066160+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066160+0000","last_undegraded":"2024-09-12T01:38:35.066160+0000","last_fullsized":"2024-09-12T01:38:35.066160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.082216+0000","last_change":"2024-09-12T01:38:35.076687+0000","last_active":"2024-09-12T01:38:35.082216+0000","last_peered":"2024-09-12T01:38:35.082216+0000","last_clean":"2024-09-12T01:38:35.082216+0000","last_became_active":"2024-09-12T01:38:35.076422+0000","last_became_peered":"2024-09-12T01:38:35.076422+0000","last_unstale":"2024-09-12T01:38:35.082216+0000","last_undegraded":"2024-09-12T01:38:35.082216+0000","last_fullsized":"2024-09-12T01:38:35.082216+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.044440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062325+0000","last_change":"2024-09-12T01:38:35.062325+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062325+0000","last_undegraded":"2024-09-12T01:38:35.062325+0000","last_fullsized":"2024-09-12T01:38:35.062325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.080062+0000","last_change":"2024-09-12T01:38:35.078231+0000","last_active":"2024-09-12T01:38:35.080062+0000","last_peered":"2024-09-12T01:38:35.080062+0000","last_clean":"2024-09-12T01:38:35.080062+0000","last_became_active":"2024-09-12T01:38:35.077610+0000","last_became_peered":"2024-09-12T01:38:35.077610+0000","last_unstale":"2024-09-12T01:38:35.080062+0000","last_undegraded":"2024-09-12T01:38:35.080062+0000","last_fullsized":"2024-09-12T01:38:35.080062+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:37.026677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061055+0000","last_change":"2024-09-12T01:38:35.061055+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061055+0000","last_undegraded":"2024-09-12T01:38:35.061055+0000","last_fullsized":"2024-09-12T01:38:35.061055+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.080026+0000","last_change":"2024-09-12T01:38:35.078333+0000","last_active":"2024-09-12T01:38:35.080026+0000","last_peered":"2024-09-12T01:38:35.080026+0000","last_clean":"2024-09-12T01:38:35.080026+0000","last_became_active":"2024-09-12T01:38:35.078039+0000","last_became_peered":"2024-09-12T01:38:35.078039+0000","last_unstale":"2024-09-12T01:38:35.080026+0000","last_undegraded":"2024-09-12T01:38:35.080026+0000","last_fullsized":"2024-09-12T01:38:35.080026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:46.609912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064823+0000","last_change":"2024-09-12T01:38:35.064823+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064823+0000","last_undegraded":"2024-09-12T01:38:35.064823+0000","last_fullsized":"2024-09-12T01:38:35.064823+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.072357+0000","last_change":"2024-09-12T01:38:35.070809+0000","last_active":"2024-09-12T01:38:35.072357+0000","last_peered":"2024-09-12T01:38:35.072357+0000","last_clean":"2024-09-12T01:38:35.072357+0000","last_became_active":"2024-09-12T01:38:35.070528+0000","last_became_peered":"2024-09-12T01:38:35.070528+0000","last_unstale":"2024-09-12T01:38:35.072357+0000","last_undegraded":"2024-09-12T01:38:35.072357+0000","last_fullsized":"2024-09-12T01:38:35.072357+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:31.440746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065588+0000","last_change":"2024-09-12T01:38:35.065588+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065588+0000","last_undegraded":"2024-09-12T01:38:35.065588+0000","last_fullsized":"2024-09-12T01:38:35.065588+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081087+0000","last_change":"2024-09-12T01:38:35.080550+0000","last_active":"2024-09-12T01:38:35.081087+0000","last_peered":"2024-09-12T01:38:35.081087+0000","last_clean":"2024-09-12T01:38:35.081087+0000","last_became_active":"2024-09-12T01:38:35.080117+0000","last_became_peered":"2024-09-12T01:38:35.080117+0000","last_unstale":"2024-09-12T01:38:35.081087+0000","last_undegraded":"2024-09-12T01:38:35.081087+0000","last_fullsized":"2024-09-12T01:38:35.081087+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:11.987486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065086+0000","last_change":"2024-09-12T01:38:35.065086+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065086+0000","last_undegraded":"2024-09-12T01:38:35.065086+0000","last_fullsized":"2024-09-12T01:38:35.065086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079010+0000","last_change":"2024-09-12T01:38:35.074670+0000","last_active":"2024-09-12T01:38:35.079010+0000","last_peered":"2024-09-12T01:38:35.079010+0000","last_clean":"2024-09-12T01:38:35.079010+0000","last_became_active":"2024-09-12T01:38:35.074402+0000","last_became_peered":"2024-09-12T01:38:35.074402+0000","last_unstale":"2024-09-12T01:38:35.079010+0000","last_undegraded":"2024-09-12T01:38:35.079010+0000","last_fullsized":"2024-09-12T01:38:35.079010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:30.611884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065164+0000","last_change":"2024-09-12T01:38:35.065164+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065164+0000","last_undegraded":"2024-09-12T01:38:35.065164+0000","last_fullsized":"2024-09-12T01:38:35.065164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079738+0000","last_change":"2024-09-12T01:38:35.078432+0000","last_active":"2024-09-12T01:38:35.079738+0000","last_peered":"2024-09-12T01:38:35.079738+0000","last_clean":"2024-09-12T01:38:35.079738+0000","last_became_active":"2024-09-12T01:38:35.078189+0000","last_became_peered":"2024-09-12T01:38:35.078189+0000","last_unstale":"2024-09-12T01:38:35.079738+0000","last_undegraded":"2024-09-12T01:38:35.079738+0000","last_fullsized":"2024-09-12T01:38:35.079738+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:45.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065108+0000","last_change":"2024-09-12T01:38:35.065108+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065108+0000","last_undegraded":"2024-09-12T01:38:35.065108+0000","last_fullsized":"2024-09-12T01:38:35.065108+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078159+0000","last_change":"2024-09-12T01:38:35.077288+0000","last_active":"2024-09-12T01:38:35.078159+0000","last_peered":"2024-09-12T01:38:35.078159+0000","last_clean":"2024-09-12T01:38:35.078159+0000","last_became_active":"2024-09-12T01:38:35.077000+0000","last_became_peered":"2024-09-12T01:38:35.077000+0000","last_unstale":"2024-09-12T01:38:35.078159+0000","last_undegraded":"2024-09-12T01:38:35.078159+0000","last_fullsized":"2024-09-12T01:38:35.078159+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:43.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063962+0000","last_change":"2024-09-12T01:38:35.063962+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063962+0000","last_undegraded":"2024-09-12T01:38:35.063962+0000","last_fullsized":"2024-09-12T01:38:35.063962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.075521+0000","last_change":"2024-09-12T01:38:35.073096+0000","last_active":"2024-09-12T01:38:35.075521+0000","last_peered":"2024-09-12T01:38:35.075521+0000","last_clean":"2024-09-12T01:38:35.075521+0000","last_became_active":"2024-09-12T01:38:35.072772+0000","last_became_peered":"2024-09-12T01:38:35.072772+0000","last_unstale":"2024-09-12T01:38:35.075521+0000","last_undegraded":"2024-09-12T01:38:35.075521+0000","last_fullsized":"2024-09-12T01:38:35.075521+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:21.431272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064387+0000","last_change":"2024-09-12T01:38:35.064387+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064387+0000","last_undegraded":"2024-09-12T01:38:35.064387+0000","last_fullsized":"2024-09-12T01:38:35.064387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078961+0000","last_change":"2024-09-12T01:38:35.073899+0000","last_active":"2024-09-12T01:38:35.078961+0000","last_peered":"2024-09-12T01:38:35.078961+0000","last_clean":"2024-09-12T01:38:35.078961+0000","last_became_active":"2024-09-12T01:38:35.073595+0000","last_became_peered":"2024-09-12T01:38:35.073595+0000","last_unstale":"2024-09-12T01:38:35.078961+0000","last_undegraded":"2024-09-12T01:38:35.078961+0000","last_fullsized":"2024-09-12T01:38:35.078961+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:06.183845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:38:35.052271+0000","last_change":"2024-09-12T01:38:35.052271+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.052271+0000","last_undegraded":"2024-09-12T01:38:35.052271+0000","last_fullsized":"2024-09-12T01:38:35.052271+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.073293+0000","last_change":"2024-09-12T01:38:35.068662+0000","last_active":"2024-09-12T01:38:35.073293+0000","last_peered":"2024-09-12T01:38:35.073293+0000","last_clean":"2024-09-12T01:38:35.073293+0000","last_became_active":"2024-09-12T01:38:35.068382+0000","last_became_peered":"2024-09-12T01:38:35.068382+0000","last_unstale":"2024-09-12T01:38:35.073293+0000","last_undegraded":"2024-09-12T01:38:35.073293+0000","last_fullsized":"2024-09-12T01:38:35.073293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:44.611816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061175+0000","last_change":"2024-09-12T01:38:35.061175+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061175+0000","last_undegraded":"2024-09-12T01:38:35.061175+0000","last_fullsized":"2024-09-12T01:38:35.061175+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.080766+0000","last_change":"2024-09-12T01:38:35.080231+0000","last_active":"2024-09-12T01:38:35.080766+0000","last_peered":"2024-09-12T01:38:35.080766+0000","last_clean":"2024-09-12T01:38:35.080766+0000","last_became_active":"2024-09-12T01:38:35.079916+0000","last_became_peered":"2024-09-12T01:38:35.079916+0000","last_unstale":"2024-09-12T01:38:35.080766+0000","last_undegraded":"2024-09-12T01:38:35.080766+0000","last_fullsized":"2024-09-12T01:38:35.080766+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:37.381169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061522+0000","last_change":"2024-09-12T01:38:35.061522+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061522+0000","last_undegraded":"2024-09-12T01:38:35.061522+0000","last_fullsized":"2024-09-12T01:38:35.061522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078413+0000","last_change":"2024-09-12T01:38:35.076006+0000","last_active":"2024-09-12T01:38:35.078413+0000","last_peered":"2024-09-12T01:38:35.078413+0000","last_clean":"2024-09-12T01:38:35.078413+0000","last_became_active":"2024-09-12T01:38:35.075736+0000","last_became_peered":"2024-09-12T01:38:35.075736+0000","last_unstale":"2024-09-12T01:38:35.078413+0000","last_undegraded":"2024-09-12T01:38:35.078413+0000","last_fullsized":"2024-09-12T01:38:35.078413+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:21.988687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064137+0000","last_change":"2024-09-12T01:38:35.064137+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064137+0000","last_undegraded":"2024-09-12T01:38:35.064137+0000","last_fullsized":"2024-09-12T01:38:35.064137+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:38:34.045641+0000","last_change":"2024-09-12T01:38:34.045641+0000","last_active":"2024-09-12T01:38:34.045641+0000","last_peered":"2024-09-12T01:38:34.045641+0000","last_clean":"2024-09-12T01:38:34.045641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:34.045641+0000","last_undegraded":"2024-09-12T01:38:34.045641+0000","last_fullsized":"2024-09-12T01:38:34.045641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061918+0000","last_change":"2024-09-12T01:38:35.061918+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061918+0000","last_undegraded":"2024-09-12T01:38:35.061918+0000","last_fullsized":"2024-09-12T01:38:35.061918+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:38:34.045641+0000","last_change":"2024-09-12T01:38:34.045641+0000","last_active":"2024-09-12T01:38:34.045641+0000","last_peered":"2024-09-12T01:38:34.045641+0000","last_clean":"2024-09-12T01:38:34.045641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:34.045641+0000","last_undegraded":"2024-09-12T01:38:34.045641+0000","last_fullsized":"2024-09-12T01:38:34.045641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061035+0000","last_change":"2024-09-12T01:38:35.061035+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061035+0000","last_undegraded":"2024-09-12T01:38:35.061035+0000","last_fullsized":"2024-09-12T01:38:35.061035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:38:34.045641+0000","last_change":"2024-09-12T01:38:34.045641+0000","last_active":"2024-09-12T01:38:34.045641+0000","last_peered":"2024-09-12T01:38:34.045641+0000","last_clean":"2024-09-12T01:38:34.045641+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:34.045641+0000","last_undegraded":"2024-09-12T01:38:34.045641+0000","last_fullsized":"2024-09-12T01:38:34.045641+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064537+0000","last_change":"2024-09-12T01:38:35.064537+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064537+0000","last_undegraded":"2024-09-12T01:38:35.064537+0000","last_fullsized":"2024-09-12T01:38:35.064537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.073255+0000","last_change":"2024-09-12T01:38:35.068171+0000","last_active":"2024-09-12T01:38:35.073255+0000","last_peered":"2024-09-12T01:38:35.073255+0000","last_clean":"2024-09-12T01:38:35.073255+0000","last_became_active":"2024-09-12T01:38:35.067831+0000","last_became_peered":"2024-09-12T01:38:35.067831+0000","last_unstale":"2024-09-12T01:38:35.073255+0000","last_undegraded":"2024-09-12T01:38:35.073255+0000","last_fullsized":"2024-09-12T01:38:35.073255+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:30.457568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063877+0000","last_change":"2024-09-12T01:38:35.063877+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063877+0000","last_undegraded":"2024-09-12T01:38:35.063877+0000","last_fullsized":"2024-09-12T01:38:35.063877+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078983+0000","last_change":"2024-09-12T01:38:35.075288+0000","last_active":"2024-09-12T01:38:35.078983+0000","last_peered":"2024-09-12T01:38:35.078983+0000","last_clean":"2024-09-12T01:38:35.078983+0000","last_became_active":"2024-09-12T01:38:35.074950+0000","last_became_peered":"2024-09-12T01:38:35.074950+0000","last_unstale":"2024-09-12T01:38:35.078983+0000","last_undegraded":"2024-09-12T01:38:35.078983+0000","last_fullsized":"2024-09-12T01:38:35.078983+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:45.169458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066578+0000","last_change":"2024-09-12T01:38:35.066578+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066578+0000","last_undegraded":"2024-09-12T01:38:35.066578+0000","last_fullsized":"2024-09-12T01:38:35.066578+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.073746+0000","last_change":"2024-09-12T01:38:35.071787+0000","last_active":"2024-09-12T01:38:35.073746+0000","last_peered":"2024-09-12T01:38:35.073746+0000","last_clean":"2024-09-12T01:38:35.073746+0000","last_became_active":"2024-09-12T01:38:35.071434+0000","last_became_peered":"2024-09-12T01:38:35.071434+0000","last_unstale":"2024-09-12T01:38:35.073746+0000","last_undegraded":"2024-09-12T01:38:35.073746+0000","last_fullsized":"2024-09-12T01:38:35.073746+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.044440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062214+0000","last_change":"2024-09-12T01:38:35.062214+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062214+0000","last_undegraded":"2024-09-12T01:38:35.062214+0000","last_fullsized":"2024-09-12T01:38:35.062214+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.077058+0000","last_change":"2024-09-12T01:38:35.074670+0000","last_active":"2024-09-12T01:38:35.077058+0000","last_peered":"2024-09-12T01:38:35.077058+0000","last_clean":"2024-09-12T01:38:35.077058+0000","last_became_active":"2024-09-12T01:38:35.074326+0000","last_became_peered":"2024-09-12T01:38:35.074326+0000","last_unstale":"2024-09-12T01:38:35.077058+0000","last_undegraded":"2024-09-12T01:38:35.077058+0000","last_fullsized":"2024-09-12T01:38:35.077058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:48.649110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":251,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.061582+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:38:35.061582+0000","last_peered":"2024-09-12T01:38:35.061582+0000","last_clean":"2024-09-12T01:38:35.061582+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:38:35.061582+0000","last_undegraded":"2024-09-12T01:38:35.061582+0000","last_fullsized":"2024-09-12T01:38:35.061582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":118,"acting":118,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":320000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":794624,"data_stored":326267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1376256,"data_stored":910368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":794624,"data_stored":326267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":794624,"data_stored":326267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1376256,"data_stored":910368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":782336,"data_stored":320000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31944,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":770048,"data_stored":314183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:40.059 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.197+0000 7fe9e5dd8640 1 Processor -- start 2024-09-12T01:38:40.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.197+0000 7fe9e5dd8640 1 -- start start 2024-09-12T01:38:40.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9e5dd8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9e00b74c0 0x7fe9e015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9e5dd8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9e015f030 0x7fe9e006d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9e5dd8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9e015fb10 con 0x7fe9e015c2b0 2024-09-12T01:38:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9e5dd8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe9e00b5900 con 0x7fe9e015f030 2024-09-12T01:38:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9e5dd8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e015f830 con 0x7fe9e00b74c0 2024-09-12T01:38:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9dffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9e015f030 0x7fe9e006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9dffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9e015f030 0x7fe9e006d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54030/0 (socket says 172.21.15.60:54030) 2024-09-12T01:38:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9dffff640 1 -- 172.21.15.60:0/2964937228 learned_addr learned my addr 172.21.15.60:0/2964937228 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9dffff640 1 -- 172.21.15.60:0/2964937228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9e00b74c0 msgr2=0x7fe9e015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9deffd640 1 --2- 172.21.15.60:0/2964937228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9e00b74c0 0x7fe9e015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9dffff640 1 --2- 172.21.15.60:0/2964937228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9e00b74c0 0x7fe9e015eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9dffff640 1 -- 172.21.15.60:0/2964937228 >> v1:172.21.15.105:6789/0 conn(0x7fe9e015c2b0 legacy=0x7fe9e00b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:40.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.198+0000 7fe9dffff640 1 -- 172.21.15.60:0/2964937228 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e006ce30 con 0x7fe9e015f030 2024-09-12T01:38:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.199+0000 7fe9dffff640 1 --2- 172.21.15.60:0/2964937228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9e015f030 0x7fe9e006d910 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009e50 tx=0x7fe9d802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc2ec552d4be9b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.199+0000 7fe9de7fc640 1 -- 172.21.15.60:0/2964937228 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8036070 con 0x7fe9e015f030 2024-09-12T01:38:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.199+0000 7fe9de7fc640 1 -- 172.21.15.60:0/2964937228 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d8031600 con 0x7fe9e015f030 2024-09-12T01:38:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.199+0000 7fe9de7fc640 1 -- 172.21.15.60:0/2964937228 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80319d0 con 0x7fe9e015f030 2024-09-12T01:38:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.200+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2964937228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9e015f030 msgr2=0x7fe9e006d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.200+0000 7fe9e5dd8640 1 --2- 172.21.15.60:0/2964937228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9e015f030 0x7fe9e006d910 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009e50 tx=0x7fe9d802a6c0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.200+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2964937228 shutdown_connections 2024-09-12T01:38:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.200+0000 7fe9e5dd8640 1 --2- 172.21.15.60:0/2964937228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9e015f030 0x7fe9e006d910 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.200+0000 7fe9e5dd8640 1 --2- 172.21.15.60:0/2964937228 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9e00b74c0 0x7fe9e015eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.200+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2964937228 >> 172.21.15.60:0/2964937228 conn(0x7fe9e00b4240 msgr2=0x7fe9e00b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.200+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2964937228 shutdown_connections 2024-09-12T01:38:40.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.200+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2964937228 wait complete. 2024-09-12T01:38:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.201+0000 7fe9e5dd8640 1 Processor -- start 2024-09-12T01:38:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.201+0000 7fe9e5dd8640 1 -- start start 2024-09-12T01:38:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9e5dd8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9e00b74c0 0x7fe9e014d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9e5dd8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9e015c2b0 0x7fe9e0150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9e5dd8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9e015f030 0x7fe9e00d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9e5dd8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e015f4c0 con 0x7fe9e015f030 2024-09-12T01:38:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9e5dd8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e006d3f0 con 0x7fe9e015c2b0 2024-09-12T01:38:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9e5dd8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe9e006de50 con 0x7fe9e00b74c0 2024-09-12T01:38:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9e015f030 0x7fe9e00d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9e015f030 0x7fe9e00d1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54044/0 (socket says 172.21.15.60:54044) 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9dffff640 1 -- 172.21.15.60:0/2971526438 learned_addr learned my addr 172.21.15.60:0/2971526438 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9df7fe640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9e00b74c0 0x7fe9e014d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9deffd640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9e015c2b0 0x7fe9e0150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9dffff640 1 -- 172.21.15.60:0/2971526438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9e00b74c0 msgr2=0x7fe9e014d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9dffff640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9e00b74c0 0x7fe9e014d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9dffff640 1 -- 172.21.15.60:0/2971526438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9e015c2b0 msgr2=0x7fe9e0150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9dffff640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9e015c2b0 0x7fe9e0150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9dffff640 1 -- 172.21.15.60:0/2971526438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e014d5e0 con 0x7fe9e015f030 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.202+0000 7fe9deffd640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9e015c2b0 0x7fe9e0150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.203+0000 7fe9dffff640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9e015f030 0x7fe9e00d1ea0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009e50 tx=0x7fe9d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.203+0000 7fe9d7fff640 1 -- 172.21.15.60:0/2971526438 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8036050 con 0x7fe9e015f030 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.203+0000 7fe9d7fff640 1 -- 172.21.15.60:0/2971526438 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9d8042070 con 0x7fe9e015f030 2024-09-12T01:38:40.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.203+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2971526438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e014f370 con 0x7fe9e015f030 2024-09-12T01:38:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.203+0000 7fe9d7fff640 1 -- 172.21.15.60:0/2971526438 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8009510 con 0x7fe9e015f030 2024-09-12T01:38:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.203+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2971526438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e014f930 con 0x7fe9e015f030 2024-09-12T01:38:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.204+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2971526438 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9e015eaf0 con 0x7fe9e015f030 2024-09-12T01:38:40.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.204+0000 7fe9d7fff640 1 -- 172.21.15.60:0/2971526438 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe9d8007bd0 con 0x7fe9e015f030 2024-09-12T01:38:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.205+0000 7fe9d7fff640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe9c006be60 0x7fe9c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.205+0000 7fe9d7fff640 1 -- 172.21.15.60:0/2971526438 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fe9d80abe60 con 0x7fe9e015f030 2024-09-12T01:38:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.205+0000 7fe9df7fe640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe9c006be60 0x7fe9c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.205+0000 7fe9df7fe640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe9c006be60 0x7fe9c006e320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0004ea0 tx=0x7fe9d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:40.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.209+0000 7fe9d7fff640 1 -- 172.21.15.60:0/2971526438 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9d807a790 con 0x7fe9e015f030 2024-09-12T01:38:40.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.381+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2971526438 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe9e00738d0 con 0x7fe9c006be60 2024-09-12T01:38:40.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.387+0000 7fe9d7fff640 1 -- 172.21.15.60:0/2971526438 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247180 (secure 0 0 0) 0x7fe9e00738d0 con 0x7fe9c006be60 2024-09-12T01:38:40.390 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:40.391 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:38:40.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.390+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2971526438 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe9c006be60 msgr2=0x7fe9c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.390+0000 7fe9e5dd8640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe9c006be60 0x7fe9c006e320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0004ea0 tx=0x7fe9d0009040 comp rx=0 tx=0).stop 2024-09-12T01:38:40.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.390+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2971526438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9e015f030 msgr2=0x7fe9e00d1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.390+0000 7fe9e5dd8640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9e015f030 0x7fe9e00d1ea0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009e50 tx=0x7fe9d8004a40 comp rx=0 tx=0).stop 2024-09-12T01:38:40.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.390+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2971526438 shutdown_connections 2024-09-12T01:38:40.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.390+0000 7fe9e5dd8640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9e015f030 0x7fe9e00d1ea0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.390+0000 7fe9e5dd8640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe9e015c2b0 0x7fe9e0150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.390+0000 7fe9e5dd8640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe9c006be60 0x7fe9c006e320 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.390+0000 7fe9e5dd8640 1 --2- 172.21.15.60:0/2971526438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe9e00b74c0 0x7fe9e014d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.390+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2971526438 >> 172.21.15.60:0/2971526438 conn(0x7fe9e00b4240 msgr2=0x7fe9e015b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:40.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.390+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2971526438 shutdown_connections 2024-09-12T01:38:40.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.390+0000 7fe9e5dd8640 1 -- 172.21.15.60:0/2971526438 wait complete. 2024-09-12T01:38:40.401 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-12T01:38:40.294903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252732,"kb_used_data":7356,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721988,"statfs":{"total":773094113280,"available":772835315712,"internally_reserved":0,"allocated":7532544,"data_stored":3779573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001022"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.072994+0000","last_change":"2024-09-12T01:38:35.072994+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.072994+0000","last_undegraded":"2024-09-12T01:38:35.072994+0000","last_fullsized":"2024-09-12T01:38:35.072994+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066042+0000","last_change":"2024-09-12T01:38:35.066042+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066042+0000","last_undegraded":"2024-09-12T01:38:35.066042+0000","last_fullsized":"2024-09-12T01:38:35.066042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065873+0000","last_change":"2024-09-12T01:38:35.065873+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065873+0000","last_undegraded":"2024-09-12T01:38:35.065873+0000","last_fullsized":"2024-09-12T01:38:35.065873+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065654+0000","last_change":"2024-09-12T01:38:35.065654+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065654+0000","last_undegraded":"2024-09-12T01:38:35.065654+0000","last_fullsized":"2024-09-12T01:38:35.065654+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061113+0000","last_change":"2024-09-12T01:38:35.061113+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061113+0000","last_undegraded":"2024-09-12T01:38:35.061113+0000","last_fullsized":"2024-09-12T01:38:35.061113+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.068161+0000","last_change":"2024-09-12T01:38:35.068161+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.068161+0000","last_undegraded":"2024-09-12T01:38:35.068161+0000","last_fullsized":"2024-09-12T01:38:35.068161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069805+0000","last_change":"2024-09-12T01:38:35.069805+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069805+0000","last_undegraded":"2024-09-12T01:38:35.069805+0000","last_fullsized":"2024-09-12T01:38:35.069805+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.072551+0000","last_change":"2024-09-12T01:38:35.072551+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.072551+0000","last_undegraded":"2024-09-12T01:38:35.072551+0000","last_fullsized":"2024-09-12T01:38:35.072551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065795+0000","last_change":"2024-09-12T01:38:35.065795+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065795+0000","last_undegraded":"2024-09-12T01:38:35.065795+0000","last_fullsized":"2024-09-12T01:38:35.065795+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062440+0000","last_change":"2024-09-12T01:38:35.062440+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062440+0000","last_undegraded":"2024-09-12T01:38:35.062440+0000","last_fullsized":"2024-09-12T01:38:35.062440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.075204+0000","last_change":"2024-09-12T01:38:35.075204+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.075204+0000","last_undegraded":"2024-09-12T01:38:35.075204+0000","last_fullsized":"2024-09-12T01:38:35.075204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084144+0000","last_change":"2024-09-12T01:38:36.074881+0000","last_active":"2024-09-12T01:38:37.084144+0000","last_peered":"2024-09-12T01:38:37.084144+0000","last_clean":"2024-09-12T01:38:37.084144+0000","last_became_active":"2024-09-12T01:38:36.074542+0000","last_became_peered":"2024-09-12T01:38:36.074542+0000","last_unstale":"2024-09-12T01:38:37.084144+0000","last_undegraded":"2024-09-12T01:38:37.084144+0000","last_fullsized":"2024-09-12T01:38:37.084144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:30.111060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064920+0000","last_change":"2024-09-12T01:38:35.064920+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064920+0000","last_undegraded":"2024-09-12T01:38:35.064920+0000","last_fullsized":"2024-09-12T01:38:35.064920+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084387+0000","last_change":"2024-09-12T01:38:36.082914+0000","last_active":"2024-09-12T01:38:37.084387+0000","last_peered":"2024-09-12T01:38:37.084387+0000","last_clean":"2024-09-12T01:38:37.084387+0000","last_became_active":"2024-09-12T01:38:36.082613+0000","last_became_peered":"2024-09-12T01:38:36.082613+0000","last_unstale":"2024-09-12T01:38:37.084387+0000","last_undegraded":"2024-09-12T01:38:37.084387+0000","last_fullsized":"2024-09-12T01:38:37.084387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:27.988221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083746+0000","last_change":"2024-09-12T01:38:36.075182+0000","last_active":"2024-09-12T01:38:37.083746+0000","last_peered":"2024-09-12T01:38:37.083746+0000","last_clean":"2024-09-12T01:38:37.083746+0000","last_became_active":"2024-09-12T01:38:36.074912+0000","last_became_peered":"2024-09-12T01:38:36.074912+0000","last_unstale":"2024-09-12T01:38:37.083746+0000","last_undegraded":"2024-09-12T01:38:37.083746+0000","last_fullsized":"2024-09-12T01:38:37.083746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:59.289373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.070031+0000","last_change":"2024-09-12T01:38:35.070031+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.070031+0000","last_undegraded":"2024-09-12T01:38:35.070031+0000","last_fullsized":"2024-09-12T01:38:35.070031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061032+0000","last_change":"2024-09-12T01:38:35.061032+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061032+0000","last_undegraded":"2024-09-12T01:38:35.061032+0000","last_fullsized":"2024-09-12T01:38:35.061032+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062004+0000","last_change":"2024-09-12T01:38:35.062004+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062004+0000","last_undegraded":"2024-09-12T01:38:35.062004+0000","last_fullsized":"2024-09-12T01:38:35.062004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.074726+0000","last_change":"2024-09-12T01:38:35.074726+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.074726+0000","last_undegraded":"2024-09-12T01:38:35.074726+0000","last_fullsized":"2024-09-12T01:38:35.074726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061122+0000","last_change":"2024-09-12T01:38:35.061122+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061122+0000","last_undegraded":"2024-09-12T01:38:35.061122+0000","last_fullsized":"2024-09-12T01:38:35.061122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065481+0000","last_change":"2024-09-12T01:38:35.065481+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065481+0000","last_undegraded":"2024-09-12T01:38:35.065481+0000","last_fullsized":"2024-09-12T01:38:35.065481+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.067729+0000","last_change":"2024-09-12T01:38:35.067729+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.067729+0000","last_undegraded":"2024-09-12T01:38:35.067729+0000","last_fullsized":"2024-09-12T01:38:35.067729+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069348+0000","last_change":"2024-09-12T01:38:35.069348+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069348+0000","last_undegraded":"2024-09-12T01:38:35.069348+0000","last_fullsized":"2024-09-12T01:38:35.069348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069615+0000","last_change":"2024-09-12T01:38:35.069615+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069615+0000","last_undegraded":"2024-09-12T01:38:35.069615+0000","last_fullsized":"2024-09-12T01:38:35.069615+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.068672+0000","last_change":"2024-09-12T01:38:35.068672+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.068672+0000","last_undegraded":"2024-09-12T01:38:35.068672+0000","last_fullsized":"2024-09-12T01:38:35.068672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069144+0000","last_change":"2024-09-12T01:38:35.069144+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069144+0000","last_undegraded":"2024-09-12T01:38:35.069144+0000","last_fullsized":"2024-09-12T01:38:35.069144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063084+0000","last_change":"2024-09-12T01:38:35.063084+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063084+0000","last_undegraded":"2024-09-12T01:38:35.063084+0000","last_fullsized":"2024-09-12T01:38:35.063084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064633+0000","last_change":"2024-09-12T01:38:35.064633+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064633+0000","last_undegraded":"2024-09-12T01:38:35.064633+0000","last_fullsized":"2024-09-12T01:38:35.064633+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064224+0000","last_change":"2024-09-12T01:38:35.064224+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064224+0000","last_undegraded":"2024-09-12T01:38:35.064224+0000","last_fullsized":"2024-09-12T01:38:35.064224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066229+0000","last_change":"2024-09-12T01:38:35.066229+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066229+0000","last_undegraded":"2024-09-12T01:38:35.066229+0000","last_fullsized":"2024-09-12T01:38:35.066229+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066181+0000","last_change":"2024-09-12T01:38:35.066181+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066181+0000","last_undegraded":"2024-09-12T01:38:35.066181+0000","last_fullsized":"2024-09-12T01:38:35.066181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064710+0000","last_change":"2024-09-12T01:38:35.064710+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064710+0000","last_undegraded":"2024-09-12T01:38:35.064710+0000","last_fullsized":"2024-09-12T01:38:35.064710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.067351+0000","last_change":"2024-09-12T01:38:35.067351+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.067351+0000","last_undegraded":"2024-09-12T01:38:35.067351+0000","last_fullsized":"2024-09-12T01:38:35.067351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.077725+0000","last_change":"2024-09-12T01:38:35.074236+0000","last_active":"2024-09-12T01:38:35.077725+0000","last_peered":"2024-09-12T01:38:35.077725+0000","last_clean":"2024-09-12T01:38:35.077725+0000","last_became_active":"2024-09-12T01:38:35.073953+0000","last_became_peered":"2024-09-12T01:38:35.073953+0000","last_unstale":"2024-09-12T01:38:35.077725+0000","last_undegraded":"2024-09-12T01:38:35.077725+0000","last_fullsized":"2024-09-12T01:38:35.077725+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:38.599797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065351+0000","last_change":"2024-09-12T01:38:35.065351+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065351+0000","last_undegraded":"2024-09-12T01:38:35.065351+0000","last_fullsized":"2024-09-12T01:38:35.065351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079116+0000","last_change":"2024-09-12T01:38:35.074361+0000","last_active":"2024-09-12T01:38:35.079116+0000","last_peered":"2024-09-12T01:38:35.079116+0000","last_clean":"2024-09-12T01:38:35.079116+0000","last_became_active":"2024-09-12T01:38:35.074070+0000","last_became_peered":"2024-09-12T01:38:35.074070+0000","last_unstale":"2024-09-12T01:38:35.079116+0000","last_undegraded":"2024-09-12T01:38:35.079116+0000","last_fullsized":"2024-09-12T01:38:35.079116+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:59.874513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.067267+0000","last_change":"2024-09-12T01:38:35.067267+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.067267+0000","last_undegraded":"2024-09-12T01:38:35.067267+0000","last_fullsized":"2024-09-12T01:38:35.067267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081646+0000","last_change":"2024-09-12T01:38:35.081069+0000","last_active":"2024-09-12T01:38:35.081646+0000","last_peered":"2024-09-12T01:38:35.081646+0000","last_clean":"2024-09-12T01:38:35.081646+0000","last_became_active":"2024-09-12T01:38:35.080795+0000","last_became_peered":"2024-09-12T01:38:35.080795+0000","last_unstale":"2024-09-12T01:38:35.081646+0000","last_undegraded":"2024-09-12T01:38:35.081646+0000","last_fullsized":"2024-09-12T01:38:35.081646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:14.413274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063501+0000","last_change":"2024-09-12T01:38:35.063501+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063501+0000","last_undegraded":"2024-09-12T01:38:35.063501+0000","last_fullsized":"2024-09-12T01:38:35.063501+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.075330+0000","last_change":"2024-09-12T01:38:35.073070+0000","last_active":"2024-09-12T01:38:35.075330+0000","last_peered":"2024-09-12T01:38:35.075330+0000","last_clean":"2024-09-12T01:38:35.075330+0000","last_became_active":"2024-09-12T01:38:35.072758+0000","last_became_peered":"2024-09-12T01:38:35.072758+0000","last_unstale":"2024-09-12T01:38:35.075330+0000","last_undegraded":"2024-09-12T01:38:35.075330+0000","last_fullsized":"2024-09-12T01:38:35.075330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:33.928163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065638+0000","last_change":"2024-09-12T01:38:35.065638+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065638+0000","last_undegraded":"2024-09-12T01:38:35.065638+0000","last_fullsized":"2024-09-12T01:38:35.065638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084358+0000","last_change":"2024-09-12T01:38:35.077780+0000","last_active":"2024-09-12T01:38:37.084358+0000","last_peered":"2024-09-12T01:38:37.084358+0000","last_clean":"2024-09-12T01:38:37.084358+0000","last_became_active":"2024-09-12T01:38:35.077099+0000","last_became_peered":"2024-09-12T01:38:35.077099+0000","last_unstale":"2024-09-12T01:38:37.084358+0000","last_undegraded":"2024-09-12T01:38:37.084358+0000","last_fullsized":"2024-09-12T01:38:37.084358+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:26.304192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066679+0000","last_change":"2024-09-12T01:38:35.066679+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066679+0000","last_undegraded":"2024-09-12T01:38:35.066679+0000","last_fullsized":"2024-09-12T01:38:35.066679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.072294+0000","last_change":"2024-09-12T01:38:35.070367+0000","last_active":"2024-09-12T01:38:35.072294+0000","last_peered":"2024-09-12T01:38:35.072294+0000","last_clean":"2024-09-12T01:38:35.072294+0000","last_became_active":"2024-09-12T01:38:35.069659+0000","last_became_peered":"2024-09-12T01:38:35.069659+0000","last_unstale":"2024-09-12T01:38:35.072294+0000","last_undegraded":"2024-09-12T01:38:35.072294+0000","last_fullsized":"2024-09-12T01:38:35.072294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:32.567712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064825+0000","last_change":"2024-09-12T01:38:35.064825+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064825+0000","last_undegraded":"2024-09-12T01:38:35.064825+0000","last_fullsized":"2024-09-12T01:38:35.064825+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081973+0000","last_change":"2024-09-12T01:38:35.075279+0000","last_active":"2024-09-12T01:38:35.081973+0000","last_peered":"2024-09-12T01:38:35.081973+0000","last_clean":"2024-09-12T01:38:35.081973+0000","last_became_active":"2024-09-12T01:38:35.074995+0000","last_became_peered":"2024-09-12T01:38:35.074995+0000","last_unstale":"2024-09-12T01:38:35.081973+0000","last_undegraded":"2024-09-12T01:38:35.081973+0000","last_fullsized":"2024-09-12T01:38:35.081973+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:25.323158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084513+0000","last_change":"2024-09-12T01:38:36.082189+0000","last_active":"2024-09-12T01:38:37.084513+0000","last_peered":"2024-09-12T01:38:37.084513+0000","last_clean":"2024-09-12T01:38:37.084513+0000","last_became_active":"2024-09-12T01:38:36.081883+0000","last_became_peered":"2024-09-12T01:38:36.081883+0000","last_unstale":"2024-09-12T01:38:37.084513+0000","last_undegraded":"2024-09-12T01:38:37.084513+0000","last_fullsized":"2024-09-12T01:38:37.084513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084147+0000","last_change":"2024-09-12T01:38:35.075651+0000","last_active":"2024-09-12T01:38:37.084147+0000","last_peered":"2024-09-12T01:38:37.084147+0000","last_clean":"2024-09-12T01:38:37.084147+0000","last_became_active":"2024-09-12T01:38:35.075371+0000","last_became_peered":"2024-09-12T01:38:35.075371+0000","last_unstale":"2024-09-12T01:38:37.084147+0000","last_undegraded":"2024-09-12T01:38:37.084147+0000","last_fullsized":"2024-09-12T01:38:37.084147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:59.889104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061904+0000","last_change":"2024-09-12T01:38:35.061904+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061904+0000","last_undegraded":"2024-09-12T01:38:35.061904+0000","last_fullsized":"2024-09-12T01:38:35.061904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078503+0000","last_change":"2024-09-12T01:38:35.077055+0000","last_active":"2024-09-12T01:38:35.078503+0000","last_peered":"2024-09-12T01:38:35.078503+0000","last_clean":"2024-09-12T01:38:35.078503+0000","last_became_active":"2024-09-12T01:38:35.076779+0000","last_became_peered":"2024-09-12T01:38:35.076779+0000","last_unstale":"2024-09-12T01:38:35.078503+0000","last_undegraded":"2024-09-12T01:38:35.078503+0000","last_fullsized":"2024-09-12T01:38:35.078503+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:14.530732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065512+0000","last_change":"2024-09-12T01:38:35.065512+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065512+0000","last_undegraded":"2024-09-12T01:38:35.065512+0000","last_fullsized":"2024-09-12T01:38:35.065512+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079028+0000","last_change":"2024-09-12T01:38:35.075612+0000","last_active":"2024-09-12T01:38:35.079028+0000","last_peered":"2024-09-12T01:38:35.079028+0000","last_clean":"2024-09-12T01:38:35.079028+0000","last_became_active":"2024-09-12T01:38:35.075338+0000","last_became_peered":"2024-09-12T01:38:35.075338+0000","last_unstale":"2024-09-12T01:38:35.079028+0000","last_undegraded":"2024-09-12T01:38:35.079028+0000","last_fullsized":"2024-09-12T01:38:35.079028+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:17.701250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066826+0000","last_change":"2024-09-12T01:38:35.066826+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066826+0000","last_undegraded":"2024-09-12T01:38:35.066826+0000","last_fullsized":"2024-09-12T01:38:35.066826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"67'3","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084696+0000","last_change":"2024-09-12T01:38:35.077385+0000","last_active":"2024-09-12T01:38:37.084696+0000","last_peered":"2024-09-12T01:38:37.084696+0000","last_clean":"2024-09-12T01:38:37.084696+0000","last_became_active":"2024-09-12T01:38:35.077079+0000","last_became_peered":"2024-09-12T01:38:35.077079+0000","last_unstale":"2024-09-12T01:38:37.084696+0000","last_undegraded":"2024-09-12T01:38:37.084696+0000","last_fullsized":"2024-09-12T01:38:37.084696+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:41.926908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061071+0000","last_change":"2024-09-12T01:38:35.061071+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061071+0000","last_undegraded":"2024-09-12T01:38:35.061071+0000","last_fullsized":"2024-09-12T01:38:35.061071+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081914+0000","last_change":"2024-09-12T01:38:35.075264+0000","last_active":"2024-09-12T01:38:35.081914+0000","last_peered":"2024-09-12T01:38:35.081914+0000","last_clean":"2024-09-12T01:38:35.081914+0000","last_became_active":"2024-09-12T01:38:35.074931+0000","last_became_peered":"2024-09-12T01:38:35.074931+0000","last_unstale":"2024-09-12T01:38:35.081914+0000","last_undegraded":"2024-09-12T01:38:35.081914+0000","last_fullsized":"2024-09-12T01:38:35.081914+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:32.908068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066160+0000","last_change":"2024-09-12T01:38:35.066160+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066160+0000","last_undegraded":"2024-09-12T01:38:35.066160+0000","last_fullsized":"2024-09-12T01:38:35.066160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.082216+0000","last_change":"2024-09-12T01:38:35.076687+0000","last_active":"2024-09-12T01:38:35.082216+0000","last_peered":"2024-09-12T01:38:35.082216+0000","last_clean":"2024-09-12T01:38:35.082216+0000","last_became_active":"2024-09-12T01:38:35.076422+0000","last_became_peered":"2024-09-12T01:38:35.076422+0000","last_unstale":"2024-09-12T01:38:35.082216+0000","last_undegraded":"2024-09-12T01:38:35.082216+0000","last_fullsized":"2024-09-12T01:38:35.082216+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.044440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062325+0000","last_change":"2024-09-12T01:38:35.062325+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062325+0000","last_undegraded":"2024-09-12T01:38:35.062325+0000","last_fullsized":"2024-09-12T01:38:35.062325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.080062+0000","last_change":"2024-09-12T01:38:35.078231+0000","last_active":"2024-09-12T01:38:35.080062+0000","last_peered":"2024-09-12T01:38:35.080062+0000","last_clean":"2024-09-12T01:38:35.080062+0000","last_became_active":"2024-09-12T01:38:35.077610+0000","last_became_peered":"2024-09-12T01:38:35.077610+0000","last_unstale":"2024-09-12T01:38:35.080062+0000","last_undegraded":"2024-09-12T01:38:35.080062+0000","last_fullsized":"2024-09-12T01:38:35.080062+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:37.026677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061055+0000","last_change":"2024-09-12T01:38:35.061055+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061055+0000","last_undegraded":"2024-09-12T01:38:35.061055+0000","last_fullsized":"2024-09-12T01:38:35.061055+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.080026+0000","last_change":"2024-09-12T01:38:35.078333+0000","last_active":"2024-09-12T01:38:35.080026+0000","last_peered":"2024-09-12T01:38:35.080026+0000","last_clean":"2024-09-12T01:38:35.080026+0000","last_became_active":"2024-09-12T01:38:35.078039+0000","last_became_peered":"2024-09-12T01:38:35.078039+0000","last_unstale":"2024-09-12T01:38:35.080026+0000","last_undegraded":"2024-09-12T01:38:35.080026+0000","last_fullsized":"2024-09-12T01:38:35.080026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:46.609912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064823+0000","last_change":"2024-09-12T01:38:35.064823+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064823+0000","last_undegraded":"2024-09-12T01:38:35.064823+0000","last_fullsized":"2024-09-12T01:38:35.064823+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.072357+0000","last_change":"2024-09-12T01:38:35.070809+0000","last_active":"2024-09-12T01:38:35.072357+0000","last_peered":"2024-09-12T01:38:35.072357+0000","last_clean":"2024-09-12T01:38:35.072357+0000","last_became_active":"2024-09-12T01:38:35.070528+0000","last_became_peered":"2024-09-12T01:38:35.070528+0000","last_unstale":"2024-09-12T01:38:35.072357+0000","last_undegraded":"2024-09-12T01:38:35.072357+0000","last_fullsized":"2024-09-12T01:38:35.072357+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:31.440746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065588+0000","last_change":"2024-09-12T01:38:35.065588+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065588+0000","last_undegraded":"2024-09-12T01:38:35.065588+0000","last_fullsized":"2024-09-12T01:38:35.065588+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081087+0000","last_change":"2024-09-12T01:38:35.080550+0000","last_active":"2024-09-12T01:38:35.081087+0000","last_peered":"2024-09-12T01:38:35.081087+0000","last_clean":"2024-09-12T01:38:35.081087+0000","last_became_active":"2024-09-12T01:38:35.080117+0000","last_became_peered":"2024-09-12T01:38:35.080117+0000","last_unstale":"2024-09-12T01:38:35.081087+0000","last_undegraded":"2024-09-12T01:38:35.081087+0000","last_fullsized":"2024-09-12T01:38:35.081087+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:11.987486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065086+0000","last_change":"2024-09-12T01:38:35.065086+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065086+0000","last_undegraded":"2024-09-12T01:38:35.065086+0000","last_fullsized":"2024-09-12T01:38:35.065086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079010+0000","last_change":"2024-09-12T01:38:35.074670+0000","last_active":"2024-09-12T01:38:35.079010+0000","last_peered":"2024-09-12T01:38:35.079010+0000","last_clean":"2024-09-12T01:38:35.079010+0000","last_became_active":"2024-09-12T01:38:35.074402+0000","last_became_peered":"2024-09-12T01:38:35.074402+0000","last_unstale":"2024-09-12T01:38:35.079010+0000","last_undegraded":"2024-09-12T01:38:35.079010+0000","last_fullsized":"2024-09-12T01:38:35.079010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:30.611884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065164+0000","last_change":"2024-09-12T01:38:35.065164+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065164+0000","last_undegraded":"2024-09-12T01:38:35.065164+0000","last_fullsized":"2024-09-12T01:38:35.065164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079738+0000","last_change":"2024-09-12T01:38:35.078432+0000","last_active":"2024-09-12T01:38:35.079738+0000","last_peered":"2024-09-12T01:38:35.079738+0000","last_clean":"2024-09-12T01:38:35.079738+0000","last_became_active":"2024-09-12T01:38:35.078189+0000","last_became_peered":"2024-09-12T01:38:35.078189+0000","last_unstale":"2024-09-12T01:38:35.079738+0000","last_undegraded":"2024-09-12T01:38:35.079738+0000","last_fullsized":"2024-09-12T01:38:35.079738+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:45.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065108+0000","last_change":"2024-09-12T01:38:35.065108+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065108+0000","last_undegraded":"2024-09-12T01:38:35.065108+0000","last_fullsized":"2024-09-12T01:38:35.065108+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078159+0000","last_change":"2024-09-12T01:38:35.077288+0000","last_active":"2024-09-12T01:38:35.078159+0000","last_peered":"2024-09-12T01:38:35.078159+0000","last_clean":"2024-09-12T01:38:35.078159+0000","last_became_active":"2024-09-12T01:38:35.077000+0000","last_became_peered":"2024-09-12T01:38:35.077000+0000","last_unstale":"2024-09-12T01:38:35.078159+0000","last_undegraded":"2024-09-12T01:38:35.078159+0000","last_fullsized":"2024-09-12T01:38:35.078159+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:43.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063962+0000","last_change":"2024-09-12T01:38:35.063962+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063962+0000","last_undegraded":"2024-09-12T01:38:35.063962+0000","last_fullsized":"2024-09-12T01:38:35.063962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.075521+0000","last_change":"2024-09-12T01:38:35.073096+0000","last_active":"2024-09-12T01:38:35.075521+0000","last_peered":"2024-09-12T01:38:35.075521+0000","last_clean":"2024-09-12T01:38:35.075521+0000","last_became_active":"2024-09-12T01:38:35.072772+0000","last_became_peered":"2024-09-12T01:38:35.072772+0000","last_unstale":"2024-09-12T01:38:35.075521+0000","last_undegraded":"2024-09-12T01:38:35.075521+0000","last_fullsized":"2024-09-12T01:38:35.075521+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:21.431272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064387+0000","last_change":"2024-09-12T01:38:35.064387+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064387+0000","last_undegraded":"2024-09-12T01:38:35.064387+0000","last_fullsized":"2024-09-12T01:38:35.064387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078961+0000","last_change":"2024-09-12T01:38:35.073899+0000","last_active":"2024-09-12T01:38:35.078961+0000","last_peered":"2024-09-12T01:38:35.078961+0000","last_clean":"2024-09-12T01:38:35.078961+0000","last_became_active":"2024-09-12T01:38:35.073595+0000","last_became_peered":"2024-09-12T01:38:35.073595+0000","last_unstale":"2024-09-12T01:38:35.078961+0000","last_undegraded":"2024-09-12T01:38:35.078961+0000","last_fullsized":"2024-09-12T01:38:35.078961+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:06.183845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083977+0000","last_change":"2024-09-12T01:38:36.076413+0000","last_active":"2024-09-12T01:38:37.083977+0000","last_peered":"2024-09-12T01:38:37.083977+0000","last_clean":"2024-09-12T01:38:37.083977+0000","last_became_active":"2024-09-12T01:38:36.076144+0000","last_became_peered":"2024-09-12T01:38:36.076144+0000","last_unstale":"2024-09-12T01:38:37.083977+0000","last_undegraded":"2024-09-12T01:38:37.083977+0000","last_fullsized":"2024-09-12T01:38:37.083977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:33.668164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.073293+0000","last_change":"2024-09-12T01:38:35.068662+0000","last_active":"2024-09-12T01:38:35.073293+0000","last_peered":"2024-09-12T01:38:35.073293+0000","last_clean":"2024-09-12T01:38:35.073293+0000","last_became_active":"2024-09-12T01:38:35.068382+0000","last_became_peered":"2024-09-12T01:38:35.068382+0000","last_unstale":"2024-09-12T01:38:35.073293+0000","last_undegraded":"2024-09-12T01:38:35.073293+0000","last_fullsized":"2024-09-12T01:38:35.073293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:44.611816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061175+0000","last_change":"2024-09-12T01:38:35.061175+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061175+0000","last_undegraded":"2024-09-12T01:38:35.061175+0000","last_fullsized":"2024-09-12T01:38:35.061175+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.080766+0000","last_change":"2024-09-12T01:38:35.080231+0000","last_active":"2024-09-12T01:38:35.080766+0000","last_peered":"2024-09-12T01:38:35.080766+0000","last_clean":"2024-09-12T01:38:35.080766+0000","last_became_active":"2024-09-12T01:38:35.079916+0000","last_became_peered":"2024-09-12T01:38:35.079916+0000","last_unstale":"2024-09-12T01:38:35.080766+0000","last_undegraded":"2024-09-12T01:38:35.080766+0000","last_fullsized":"2024-09-12T01:38:35.080766+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:37.381169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061522+0000","last_change":"2024-09-12T01:38:35.061522+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061522+0000","last_undegraded":"2024-09-12T01:38:35.061522+0000","last_fullsized":"2024-09-12T01:38:35.061522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078413+0000","last_change":"2024-09-12T01:38:35.076006+0000","last_active":"2024-09-12T01:38:35.078413+0000","last_peered":"2024-09-12T01:38:35.078413+0000","last_clean":"2024-09-12T01:38:35.078413+0000","last_became_active":"2024-09-12T01:38:35.075736+0000","last_became_peered":"2024-09-12T01:38:35.075736+0000","last_unstale":"2024-09-12T01:38:35.078413+0000","last_undegraded":"2024-09-12T01:38:35.078413+0000","last_fullsized":"2024-09-12T01:38:35.078413+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:21.988687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064137+0000","last_change":"2024-09-12T01:38:35.064137+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064137+0000","last_undegraded":"2024-09-12T01:38:35.064137+0000","last_fullsized":"2024-09-12T01:38:35.064137+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084757+0000","last_change":"2024-09-12T01:38:35.074634+0000","last_active":"2024-09-12T01:38:37.084757+0000","last_peered":"2024-09-12T01:38:37.084757+0000","last_clean":"2024-09-12T01:38:37.084757+0000","last_became_active":"2024-09-12T01:38:35.074336+0000","last_became_peered":"2024-09-12T01:38:35.074336+0000","last_unstale":"2024-09-12T01:38:37.084757+0000","last_undegraded":"2024-09-12T01:38:37.084757+0000","last_fullsized":"2024-09-12T01:38:37.084757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:49.502156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061918+0000","last_change":"2024-09-12T01:38:35.061918+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061918+0000","last_undegraded":"2024-09-12T01:38:35.061918+0000","last_fullsized":"2024-09-12T01:38:35.061918+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084328+0000","last_change":"2024-09-12T01:38:35.077330+0000","last_active":"2024-09-12T01:38:37.084328+0000","last_peered":"2024-09-12T01:38:37.084328+0000","last_clean":"2024-09-12T01:38:37.084328+0000","last_became_active":"2024-09-12T01:38:35.077032+0000","last_became_peered":"2024-09-12T01:38:35.077032+0000","last_unstale":"2024-09-12T01:38:37.084328+0000","last_undegraded":"2024-09-12T01:38:37.084328+0000","last_fullsized":"2024-09-12T01:38:37.084328+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:09.008913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061035+0000","last_change":"2024-09-12T01:38:35.061035+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061035+0000","last_undegraded":"2024-09-12T01:38:35.061035+0000","last_fullsized":"2024-09-12T01:38:35.061035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084452+0000","last_change":"2024-09-12T01:38:35.077389+0000","last_active":"2024-09-12T01:38:37.084452+0000","last_peered":"2024-09-12T01:38:37.084452+0000","last_clean":"2024-09-12T01:38:37.084452+0000","last_became_active":"2024-09-12T01:38:35.076794+0000","last_became_peered":"2024-09-12T01:38:35.076794+0000","last_unstale":"2024-09-12T01:38:37.084452+0000","last_undegraded":"2024-09-12T01:38:37.084452+0000","last_fullsized":"2024-09-12T01:38:37.084452+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:30.729450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064537+0000","last_change":"2024-09-12T01:38:35.064537+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064537+0000","last_undegraded":"2024-09-12T01:38:35.064537+0000","last_fullsized":"2024-09-12T01:38:35.064537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.073255+0000","last_change":"2024-09-12T01:38:35.068171+0000","last_active":"2024-09-12T01:38:35.073255+0000","last_peered":"2024-09-12T01:38:35.073255+0000","last_clean":"2024-09-12T01:38:35.073255+0000","last_became_active":"2024-09-12T01:38:35.067831+0000","last_became_peered":"2024-09-12T01:38:35.067831+0000","last_unstale":"2024-09-12T01:38:35.073255+0000","last_undegraded":"2024-09-12T01:38:35.073255+0000","last_fullsized":"2024-09-12T01:38:35.073255+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:30.457568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063877+0000","last_change":"2024-09-12T01:38:35.063877+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063877+0000","last_undegraded":"2024-09-12T01:38:35.063877+0000","last_fullsized":"2024-09-12T01:38:35.063877+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078983+0000","last_change":"2024-09-12T01:38:35.075288+0000","last_active":"2024-09-12T01:38:35.078983+0000","last_peered":"2024-09-12T01:38:35.078983+0000","last_clean":"2024-09-12T01:38:35.078983+0000","last_became_active":"2024-09-12T01:38:35.074950+0000","last_became_peered":"2024-09-12T01:38:35.074950+0000","last_unstale":"2024-09-12T01:38:35.078983+0000","last_undegraded":"2024-09-12T01:38:35.078983+0000","last_fullsized":"2024-09-12T01:38:35.078983+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:45.169458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066578+0000","last_change":"2024-09-12T01:38:35.066578+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066578+0000","last_undegraded":"2024-09-12T01:38:35.066578+0000","last_fullsized":"2024-09-12T01:38:35.066578+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.073746+0000","last_change":"2024-09-12T01:38:35.071787+0000","last_active":"2024-09-12T01:38:35.073746+0000","last_peered":"2024-09-12T01:38:35.073746+0000","last_clean":"2024-09-12T01:38:35.073746+0000","last_became_active":"2024-09-12T01:38:35.071434+0000","last_became_peered":"2024-09-12T01:38:35.071434+0000","last_unstale":"2024-09-12T01:38:35.073746+0000","last_undegraded":"2024-09-12T01:38:35.073746+0000","last_fullsized":"2024-09-12T01:38:35.073746+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.044440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062214+0000","last_change":"2024-09-12T01:38:35.062214+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062214+0000","last_undegraded":"2024-09-12T01:38:35.062214+0000","last_fullsized":"2024-09-12T01:38:35.062214+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.077058+0000","last_change":"2024-09-12T01:38:35.074670+0000","last_active":"2024-09-12T01:38:35.077058+0000","last_peered":"2024-09-12T01:38:35.077058+0000","last_clean":"2024-09-12T01:38:35.077058+0000","last_became_active":"2024-09-12T01:38:35.074326+0000","last_became_peered":"2024-09-12T01:38:35.074326+0000","last_unstale":"2024-09-12T01:38:35.077058+0000","last_undegraded":"2024-09-12T01:38:35.077058+0000","last_fullsized":"2024-09-12T01:38:35.077058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:48.649110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":251,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.061582+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:38:35.061582+0000","last_peered":"2024-09-12T01:38:35.061582+0000","last_clean":"2024-09-12T01:38:35.061582+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:38:35.061582+0000","last_undegraded":"2024-09-12T01:38:35.061582+0000","last_fullsized":"2024-09-12T01:38:35.061582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":320000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":794624,"data_stored":326267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1376256,"data_stored":910368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":794624,"data_stored":326267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":794624,"data_stored":326267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1376256,"data_stored":910368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":782336,"data_stored":320000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":831488,"data_stored":340036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:40.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:40.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.544+0000 7f3a97b5f640 1 Processor -- start 2024-09-12T01:38:40.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.545+0000 7f3a97b5f640 1 -- start start 2024-09-12T01:38:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a97b5f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a900b74c0 0x7f3a9015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a97b5f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a9015fb10 con 0x7f3a9015f030 2024-09-12T01:38:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a97b5f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a900b5900 con 0x7f3a9015c2b0 2024-09-12T01:38:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a97b5f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9015f830 con 0x7f3a900b74c0 2024-09-12T01:38:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a960fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3a9015f030 0x7f3a9006d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45410/0 (socket says 172.21.15.60:45410) 2024-09-12T01:38:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a960fc640 1 -- 172.21.15.60:0/2842503910 learned_addr learned my addr 172.21.15.60:0/2842503910 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a950fa640 1 --2- 172.21.15.60:0/2842503910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a900b74c0 0x7f3a9015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a948f9640 1 -- 172.21.15.60:0/2842503910 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009680368 0 0) 0x7f3a9015fb10 con 0x7f3a9015f030 2024-09-12T01:38:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a948f9640 1 -- 172.21.15.60:0/2842503910 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a7c003520 con 0x7f3a9015f030 2024-09-12T01:38:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a948f9640 1 -- 172.21.15.60:0/2842503910 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589071160 0 0) 0x7f3a900b5900 con 0x7f3a9015c2b0 2024-09-12T01:38:40.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a948f9640 1 -- 172.21.15.60:0/2842503910 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a9015fb10 con 0x7f3a9015c2b0 2024-09-12T01:38:40.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a950fa640 1 -- 172.21.15.60:0/2842503910 >> v1:172.21.15.105:6789/0 conn(0x7f3a9015c2b0 legacy=0x7f3a900b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a950fa640 1 -- 172.21.15.60:0/2842503910 >> v1:172.21.15.60:6789/0 conn(0x7f3a9015f030 legacy=0x7f3a9006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.546+0000 7f3a950fa640 1 -- 172.21.15.60:0/2842503910 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9006ce30 con 0x7f3a900b74c0 2024-09-12T01:38:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.547+0000 7f3a950fa640 1 --2- 172.21.15.60:0/2842503910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a900b74c0 0x7f3a9015eaf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3a800097d0 tx=0x7f3a8002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b392dad58e71479a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.547+0000 7f3a948f9640 1 -- 172.21.15.60:0/2842503910 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80037070 con 0x7f3a900b74c0 2024-09-12T01:38:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.547+0000 7f3a948f9640 1 -- 172.21.15.60:0/2842503910 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a80032440 con 0x7f3a900b74c0 2024-09-12T01:38:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.547+0000 7f3a948f9640 1 -- 172.21.15.60:0/2842503910 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a800327f0 con 0x7f3a900b74c0 2024-09-12T01:38:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.548+0000 7f3a97b5f640 1 -- 172.21.15.60:0/2842503910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a900b74c0 msgr2=0x7f3a9015eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.548+0000 7f3a97b5f640 1 --2- 172.21.15.60:0/2842503910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a900b74c0 0x7f3a9015eaf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3a800097d0 tx=0x7f3a8002a210 comp rx=0 tx=0).stop 2024-09-12T01:38:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.548+0000 7f3a97b5f640 1 -- 172.21.15.60:0/2842503910 shutdown_connections 2024-09-12T01:38:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.548+0000 7f3a97b5f640 1 --2- 172.21.15.60:0/2842503910 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a900b74c0 0x7f3a9015eaf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.548+0000 7f3a97b5f640 1 -- 172.21.15.60:0/2842503910 >> 172.21.15.60:0/2842503910 conn(0x7f3a900b4240 msgr2=0x7f3a900b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.548+0000 7f3a97b5f640 1 -- 172.21.15.60:0/2842503910 shutdown_connections 2024-09-12T01:38:40.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.548+0000 7f3a97b5f640 1 -- 172.21.15.60:0/2842503910 wait complete. 2024-09-12T01:38:40.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.549+0000 7f3a97b5f640 1 Processor -- start 2024-09-12T01:38:40.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.549+0000 7f3a97b5f640 1 -- start start 2024-09-12T01:38:40.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a97b5f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a900b74c0 0x7f3a900cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a97b5f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a9015c2b0 0x7f3a90152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a97b5f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a9015f030 0x7f3a900ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a97b5f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9015f4c0 con 0x7f3a9015f030 2024-09-12T01:38:40.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a97b5f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9006d3f0 con 0x7f3a9015c2b0 2024-09-12T01:38:40.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a97b5f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9006e020 con 0x7f3a900b74c0 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a960fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a9015f030 0x7f3a900ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a960fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a9015f030 0x7f3a900ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54054/0 (socket says 172.21.15.60:54054) 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a960fc640 1 -- 172.21.15.60:0/381644838 learned_addr learned my addr 172.21.15.60:0/381644838 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a950fa640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a9015c2b0 0x7f3a90152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a958fb640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a900b74c0 0x7f3a900cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a960fc640 1 -- 172.21.15.60:0/381644838 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a900b74c0 msgr2=0x7f3a900cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a960fc640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a900b74c0 0x7f3a900cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a960fc640 1 -- 172.21.15.60:0/381644838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a9015c2b0 msgr2=0x7f3a90152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a960fc640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a9015c2b0 0x7f3a90152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a960fc640 1 -- 172.21.15.60:0/381644838 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a900b29e0 con 0x7f3a9015f030 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a958fb640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a900b74c0 0x7f3a900cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a950fa640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a9015c2b0 0x7f3a90152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:40.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.550+0000 7f3a960fc640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a9015f030 0x7f3a900ce1c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800caf0 tx=0x7f3a8800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:40.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.551+0000 7f3a867fc640 1 -- 172.21.15.60:0/381644838 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88017070 con 0x7f3a9015f030 2024-09-12T01:38:40.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.551+0000 7f3a867fc640 1 -- 172.21.15.60:0/381644838 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8800aca0 con 0x7f3a9015f030 2024-09-12T01:38:40.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.551+0000 7f3a97b5f640 1 -- 172.21.15.60:0/381644838 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a900cd120 con 0x7f3a9015f030 2024-09-12T01:38:40.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.551+0000 7f3a867fc640 1 -- 172.21.15.60:0/381644838 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88012620 con 0x7f3a9015f030 2024-09-12T01:38:40.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.551+0000 7f3a97b5f640 1 -- 172.21.15.60:0/381644838 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a900cd6e0 con 0x7f3a9015f030 2024-09-12T01:38:40.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.552+0000 7f3a97b5f640 1 -- 172.21.15.60:0/381644838 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a90071580 con 0x7f3a9015f030 2024-09-12T01:38:40.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.552+0000 7f3a867fc640 1 -- 172.21.15.60:0/381644838 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a8801a070 con 0x7f3a9015f030 2024-09-12T01:38:40.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.553+0000 7f3a867fc640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a7406be30 0x7f3a7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.553+0000 7f3a867fc640 1 -- 172.21.15.60:0/381644838 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f3a8808ac10 con 0x7f3a9015f030 2024-09-12T01:38:40.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.553+0000 7f3a958fb640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a7406be30 0x7f3a7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.553+0000 7f3a958fb640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a7406be30 0x7f3a7406e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3a900b2ff0 tx=0x7f3a8c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:40.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.557+0000 7f3a867fc640 1 -- 172.21.15.60:0/381644838 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a90071580 con 0x7f3a9015f030 2024-09-12T01:38:40.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.729+0000 7f3a97b5f640 1 -- 172.21.15.60:0/381644838 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a9015e350 con 0x7f3a7406be30 2024-09-12T01:38:40.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.734+0000 7f3a867fc640 1 -- 172.21.15.60:0/381644838 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247180 (secure 0 0 0) 0x7f3a9015e350 con 0x7f3a7406be30 2024-09-12T01:38:40.737 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:40.738 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.737+0000 7f3a97b5f640 1 -- 172.21.15.60:0/381644838 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a7406be30 msgr2=0x7f3a7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.737+0000 7f3a97b5f640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a7406be30 0x7f3a7406e2f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3a900b2ff0 tx=0x7f3a8c009040 comp rx=0 tx=0).stop 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.737+0000 7f3a97b5f640 1 -- 172.21.15.60:0/381644838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a9015f030 msgr2=0x7f3a900ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.737+0000 7f3a97b5f640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a9015f030 0x7f3a900ce1c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800caf0 tx=0x7f3a8800a060 comp rx=0 tx=0).stop 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.737+0000 7f3a97b5f640 1 -- 172.21.15.60:0/381644838 shutdown_connections 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.737+0000 7f3a97b5f640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a9015f030 0x7f3a900ce1c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.737+0000 7f3a97b5f640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a9015c2b0 0x7f3a90152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.737+0000 7f3a97b5f640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a7406be30 0x7f3a7406e2f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.737+0000 7f3a97b5f640 1 --2- 172.21.15.60:0/381644838 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a900b74c0 0x7f3a900cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.737+0000 7f3a97b5f640 1 -- 172.21.15.60:0/381644838 >> 172.21.15.60:0/381644838 conn(0x7f3a900b4240 msgr2=0x7f3a9015c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:40.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.737+0000 7f3a97b5f640 1 -- 172.21.15.60:0/381644838 shutdown_connections 2024-09-12T01:38:40.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.737+0000 7f3a97b5f640 1 -- 172.21.15.60:0/381644838 wait complete. 2024-09-12T01:38:40.749 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-12T01:38:40.294903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252732,"kb_used_data":7356,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721988,"statfs":{"total":773094113280,"available":772835315712,"internally_reserved":0,"allocated":7532544,"data_stored":3779573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001022"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.072994+0000","last_change":"2024-09-12T01:38:35.072994+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.072994+0000","last_undegraded":"2024-09-12T01:38:35.072994+0000","last_fullsized":"2024-09-12T01:38:35.072994+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066042+0000","last_change":"2024-09-12T01:38:35.066042+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066042+0000","last_undegraded":"2024-09-12T01:38:35.066042+0000","last_fullsized":"2024-09-12T01:38:35.066042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065873+0000","last_change":"2024-09-12T01:38:35.065873+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065873+0000","last_undegraded":"2024-09-12T01:38:35.065873+0000","last_fullsized":"2024-09-12T01:38:35.065873+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065654+0000","last_change":"2024-09-12T01:38:35.065654+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065654+0000","last_undegraded":"2024-09-12T01:38:35.065654+0000","last_fullsized":"2024-09-12T01:38:35.065654+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061113+0000","last_change":"2024-09-12T01:38:35.061113+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061113+0000","last_undegraded":"2024-09-12T01:38:35.061113+0000","last_fullsized":"2024-09-12T01:38:35.061113+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.068161+0000","last_change":"2024-09-12T01:38:35.068161+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.068161+0000","last_undegraded":"2024-09-12T01:38:35.068161+0000","last_fullsized":"2024-09-12T01:38:35.068161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069805+0000","last_change":"2024-09-12T01:38:35.069805+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069805+0000","last_undegraded":"2024-09-12T01:38:35.069805+0000","last_fullsized":"2024-09-12T01:38:35.069805+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.072551+0000","last_change":"2024-09-12T01:38:35.072551+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.072551+0000","last_undegraded":"2024-09-12T01:38:35.072551+0000","last_fullsized":"2024-09-12T01:38:35.072551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065795+0000","last_change":"2024-09-12T01:38:35.065795+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065795+0000","last_undegraded":"2024-09-12T01:38:35.065795+0000","last_fullsized":"2024-09-12T01:38:35.065795+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062440+0000","last_change":"2024-09-12T01:38:35.062440+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062440+0000","last_undegraded":"2024-09-12T01:38:35.062440+0000","last_fullsized":"2024-09-12T01:38:35.062440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.075204+0000","last_change":"2024-09-12T01:38:35.075204+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.075204+0000","last_undegraded":"2024-09-12T01:38:35.075204+0000","last_fullsized":"2024-09-12T01:38:35.075204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084144+0000","last_change":"2024-09-12T01:38:36.074881+0000","last_active":"2024-09-12T01:38:37.084144+0000","last_peered":"2024-09-12T01:38:37.084144+0000","last_clean":"2024-09-12T01:38:37.084144+0000","last_became_active":"2024-09-12T01:38:36.074542+0000","last_became_peered":"2024-09-12T01:38:36.074542+0000","last_unstale":"2024-09-12T01:38:37.084144+0000","last_undegraded":"2024-09-12T01:38:37.084144+0000","last_fullsized":"2024-09-12T01:38:37.084144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:30.111060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064920+0000","last_change":"2024-09-12T01:38:35.064920+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064920+0000","last_undegraded":"2024-09-12T01:38:35.064920+0000","last_fullsized":"2024-09-12T01:38:35.064920+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084387+0000","last_change":"2024-09-12T01:38:36.082914+0000","last_active":"2024-09-12T01:38:37.084387+0000","last_peered":"2024-09-12T01:38:37.084387+0000","last_clean":"2024-09-12T01:38:37.084387+0000","last_became_active":"2024-09-12T01:38:36.082613+0000","last_became_peered":"2024-09-12T01:38:36.082613+0000","last_unstale":"2024-09-12T01:38:37.084387+0000","last_undegraded":"2024-09-12T01:38:37.084387+0000","last_fullsized":"2024-09-12T01:38:37.084387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:27.988221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083746+0000","last_change":"2024-09-12T01:38:36.075182+0000","last_active":"2024-09-12T01:38:37.083746+0000","last_peered":"2024-09-12T01:38:37.083746+0000","last_clean":"2024-09-12T01:38:37.083746+0000","last_became_active":"2024-09-12T01:38:36.074912+0000","last_became_peered":"2024-09-12T01:38:36.074912+0000","last_unstale":"2024-09-12T01:38:37.083746+0000","last_undegraded":"2024-09-12T01:38:37.083746+0000","last_fullsized":"2024-09-12T01:38:37.083746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:59.289373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.070031+0000","last_change":"2024-09-12T01:38:35.070031+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.070031+0000","last_undegraded":"2024-09-12T01:38:35.070031+0000","last_fullsized":"2024-09-12T01:38:35.070031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061032+0000","last_change":"2024-09-12T01:38:35.061032+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061032+0000","last_undegraded":"2024-09-12T01:38:35.061032+0000","last_fullsized":"2024-09-12T01:38:35.061032+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062004+0000","last_change":"2024-09-12T01:38:35.062004+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062004+0000","last_undegraded":"2024-09-12T01:38:35.062004+0000","last_fullsized":"2024-09-12T01:38:35.062004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.074726+0000","last_change":"2024-09-12T01:38:35.074726+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.074726+0000","last_undegraded":"2024-09-12T01:38:35.074726+0000","last_fullsized":"2024-09-12T01:38:35.074726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061122+0000","last_change":"2024-09-12T01:38:35.061122+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061122+0000","last_undegraded":"2024-09-12T01:38:35.061122+0000","last_fullsized":"2024-09-12T01:38:35.061122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065481+0000","last_change":"2024-09-12T01:38:35.065481+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065481+0000","last_undegraded":"2024-09-12T01:38:35.065481+0000","last_fullsized":"2024-09-12T01:38:35.065481+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.067729+0000","last_change":"2024-09-12T01:38:35.067729+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.067729+0000","last_undegraded":"2024-09-12T01:38:35.067729+0000","last_fullsized":"2024-09-12T01:38:35.067729+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069348+0000","last_change":"2024-09-12T01:38:35.069348+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069348+0000","last_undegraded":"2024-09-12T01:38:35.069348+0000","last_fullsized":"2024-09-12T01:38:35.069348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069615+0000","last_change":"2024-09-12T01:38:35.069615+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069615+0000","last_undegraded":"2024-09-12T01:38:35.069615+0000","last_fullsized":"2024-09-12T01:38:35.069615+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.068672+0000","last_change":"2024-09-12T01:38:35.068672+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.068672+0000","last_undegraded":"2024-09-12T01:38:35.068672+0000","last_fullsized":"2024-09-12T01:38:35.068672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069144+0000","last_change":"2024-09-12T01:38:35.069144+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069144+0000","last_undegraded":"2024-09-12T01:38:35.069144+0000","last_fullsized":"2024-09-12T01:38:35.069144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063084+0000","last_change":"2024-09-12T01:38:35.063084+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063084+0000","last_undegraded":"2024-09-12T01:38:35.063084+0000","last_fullsized":"2024-09-12T01:38:35.063084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064633+0000","last_change":"2024-09-12T01:38:35.064633+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064633+0000","last_undegraded":"2024-09-12T01:38:35.064633+0000","last_fullsized":"2024-09-12T01:38:35.064633+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064224+0000","last_change":"2024-09-12T01:38:35.064224+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064224+0000","last_undegraded":"2024-09-12T01:38:35.064224+0000","last_fullsized":"2024-09-12T01:38:35.064224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066229+0000","last_change":"2024-09-12T01:38:35.066229+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066229+0000","last_undegraded":"2024-09-12T01:38:35.066229+0000","last_fullsized":"2024-09-12T01:38:35.066229+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066181+0000","last_change":"2024-09-12T01:38:35.066181+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066181+0000","last_undegraded":"2024-09-12T01:38:35.066181+0000","last_fullsized":"2024-09-12T01:38:35.066181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064710+0000","last_change":"2024-09-12T01:38:35.064710+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064710+0000","last_undegraded":"2024-09-12T01:38:35.064710+0000","last_fullsized":"2024-09-12T01:38:35.064710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.067351+0000","last_change":"2024-09-12T01:38:35.067351+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.067351+0000","last_undegraded":"2024-09-12T01:38:35.067351+0000","last_fullsized":"2024-09-12T01:38:35.067351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.077725+0000","last_change":"2024-09-12T01:38:35.074236+0000","last_active":"2024-09-12T01:38:35.077725+0000","last_peered":"2024-09-12T01:38:35.077725+0000","last_clean":"2024-09-12T01:38:35.077725+0000","last_became_active":"2024-09-12T01:38:35.073953+0000","last_became_peered":"2024-09-12T01:38:35.073953+0000","last_unstale":"2024-09-12T01:38:35.077725+0000","last_undegraded":"2024-09-12T01:38:35.077725+0000","last_fullsized":"2024-09-12T01:38:35.077725+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:38.599797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065351+0000","last_change":"2024-09-12T01:38:35.065351+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065351+0000","last_undegraded":"2024-09-12T01:38:35.065351+0000","last_fullsized":"2024-09-12T01:38:35.065351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079116+0000","last_change":"2024-09-12T01:38:35.074361+0000","last_active":"2024-09-12T01:38:35.079116+0000","last_peered":"2024-09-12T01:38:35.079116+0000","last_clean":"2024-09-12T01:38:35.079116+0000","last_became_active":"2024-09-12T01:38:35.074070+0000","last_became_peered":"2024-09-12T01:38:35.074070+0000","last_unstale":"2024-09-12T01:38:35.079116+0000","last_undegraded":"2024-09-12T01:38:35.079116+0000","last_fullsized":"2024-09-12T01:38:35.079116+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:59.874513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.067267+0000","last_change":"2024-09-12T01:38:35.067267+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.067267+0000","last_undegraded":"2024-09-12T01:38:35.067267+0000","last_fullsized":"2024-09-12T01:38:35.067267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081646+0000","last_change":"2024-09-12T01:38:35.081069+0000","last_active":"2024-09-12T01:38:35.081646+0000","last_peered":"2024-09-12T01:38:35.081646+0000","last_clean":"2024-09-12T01:38:35.081646+0000","last_became_active":"2024-09-12T01:38:35.080795+0000","last_became_peered":"2024-09-12T01:38:35.080795+0000","last_unstale":"2024-09-12T01:38:35.081646+0000","last_undegraded":"2024-09-12T01:38:35.081646+0000","last_fullsized":"2024-09-12T01:38:35.081646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:14.413274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063501+0000","last_change":"2024-09-12T01:38:35.063501+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063501+0000","last_undegraded":"2024-09-12T01:38:35.063501+0000","last_fullsized":"2024-09-12T01:38:35.063501+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.075330+0000","last_change":"2024-09-12T01:38:35.073070+0000","last_active":"2024-09-12T01:38:35.075330+0000","last_peered":"2024-09-12T01:38:35.075330+0000","last_clean":"2024-09-12T01:38:35.075330+0000","last_became_active":"2024-09-12T01:38:35.072758+0000","last_became_peered":"2024-09-12T01:38:35.072758+0000","last_unstale":"2024-09-12T01:38:35.075330+0000","last_undegraded":"2024-09-12T01:38:35.075330+0000","last_fullsized":"2024-09-12T01:38:35.075330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:33.928163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065638+0000","last_change":"2024-09-12T01:38:35.065638+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065638+0000","last_undegraded":"2024-09-12T01:38:35.065638+0000","last_fullsized":"2024-09-12T01:38:35.065638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084358+0000","last_change":"2024-09-12T01:38:35.077780+0000","last_active":"2024-09-12T01:38:37.084358+0000","last_peered":"2024-09-12T01:38:37.084358+0000","last_clean":"2024-09-12T01:38:37.084358+0000","last_became_active":"2024-09-12T01:38:35.077099+0000","last_became_peered":"2024-09-12T01:38:35.077099+0000","last_unstale":"2024-09-12T01:38:37.084358+0000","last_undegraded":"2024-09-12T01:38:37.084358+0000","last_fullsized":"2024-09-12T01:38:37.084358+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:26.304192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066679+0000","last_change":"2024-09-12T01:38:35.066679+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066679+0000","last_undegraded":"2024-09-12T01:38:35.066679+0000","last_fullsized":"2024-09-12T01:38:35.066679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.072294+0000","last_change":"2024-09-12T01:38:35.070367+0000","last_active":"2024-09-12T01:38:35.072294+0000","last_peered":"2024-09-12T01:38:35.072294+0000","last_clean":"2024-09-12T01:38:35.072294+0000","last_became_active":"2024-09-12T01:38:35.069659+0000","last_became_peered":"2024-09-12T01:38:35.069659+0000","last_unstale":"2024-09-12T01:38:35.072294+0000","last_undegraded":"2024-09-12T01:38:35.072294+0000","last_fullsized":"2024-09-12T01:38:35.072294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:32.567712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064825+0000","last_change":"2024-09-12T01:38:35.064825+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064825+0000","last_undegraded":"2024-09-12T01:38:35.064825+0000","last_fullsized":"2024-09-12T01:38:35.064825+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081973+0000","last_change":"2024-09-12T01:38:35.075279+0000","last_active":"2024-09-12T01:38:35.081973+0000","last_peered":"2024-09-12T01:38:35.081973+0000","last_clean":"2024-09-12T01:38:35.081973+0000","last_became_active":"2024-09-12T01:38:35.074995+0000","last_became_peered":"2024-09-12T01:38:35.074995+0000","last_unstale":"2024-09-12T01:38:35.081973+0000","last_undegraded":"2024-09-12T01:38:35.081973+0000","last_fullsized":"2024-09-12T01:38:35.081973+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:25.323158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084513+0000","last_change":"2024-09-12T01:38:36.082189+0000","last_active":"2024-09-12T01:38:37.084513+0000","last_peered":"2024-09-12T01:38:37.084513+0000","last_clean":"2024-09-12T01:38:37.084513+0000","last_became_active":"2024-09-12T01:38:36.081883+0000","last_became_peered":"2024-09-12T01:38:36.081883+0000","last_unstale":"2024-09-12T01:38:37.084513+0000","last_undegraded":"2024-09-12T01:38:37.084513+0000","last_fullsized":"2024-09-12T01:38:37.084513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084147+0000","last_change":"2024-09-12T01:38:35.075651+0000","last_active":"2024-09-12T01:38:37.084147+0000","last_peered":"2024-09-12T01:38:37.084147+0000","last_clean":"2024-09-12T01:38:37.084147+0000","last_became_active":"2024-09-12T01:38:35.075371+0000","last_became_peered":"2024-09-12T01:38:35.075371+0000","last_unstale":"2024-09-12T01:38:37.084147+0000","last_undegraded":"2024-09-12T01:38:37.084147+0000","last_fullsized":"2024-09-12T01:38:37.084147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:59.889104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061904+0000","last_change":"2024-09-12T01:38:35.061904+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061904+0000","last_undegraded":"2024-09-12T01:38:35.061904+0000","last_fullsized":"2024-09-12T01:38:35.061904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078503+0000","last_change":"2024-09-12T01:38:35.077055+0000","last_active":"2024-09-12T01:38:35.078503+0000","last_peered":"2024-09-12T01:38:35.078503+0000","last_clean":"2024-09-12T01:38:35.078503+0000","last_became_active":"2024-09-12T01:38:35.076779+0000","last_became_peered":"2024-09-12T01:38:35.076779+0000","last_unstale":"2024-09-12T01:38:35.078503+0000","last_undegraded":"2024-09-12T01:38:35.078503+0000","last_fullsized":"2024-09-12T01:38:35.078503+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:14.530732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065512+0000","last_change":"2024-09-12T01:38:35.065512+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065512+0000","last_undegraded":"2024-09-12T01:38:35.065512+0000","last_fullsized":"2024-09-12T01:38:35.065512+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079028+0000","last_change":"2024-09-12T01:38:35.075612+0000","last_active":"2024-09-12T01:38:35.079028+0000","last_peered":"2024-09-12T01:38:35.079028+0000","last_clean":"2024-09-12T01:38:35.079028+0000","last_became_active":"2024-09-12T01:38:35.075338+0000","last_became_peered":"2024-09-12T01:38:35.075338+0000","last_unstale":"2024-09-12T01:38:35.079028+0000","last_undegraded":"2024-09-12T01:38:35.079028+0000","last_fullsized":"2024-09-12T01:38:35.079028+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:17.701250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066826+0000","last_change":"2024-09-12T01:38:35.066826+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066826+0000","last_undegraded":"2024-09-12T01:38:35.066826+0000","last_fullsized":"2024-09-12T01:38:35.066826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"67'3","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084696+0000","last_change":"2024-09-12T01:38:35.077385+0000","last_active":"2024-09-12T01:38:37.084696+0000","last_peered":"2024-09-12T01:38:37.084696+0000","last_clean":"2024-09-12T01:38:37.084696+0000","last_became_active":"2024-09-12T01:38:35.077079+0000","last_became_peered":"2024-09-12T01:38:35.077079+0000","last_unstale":"2024-09-12T01:38:37.084696+0000","last_undegraded":"2024-09-12T01:38:37.084696+0000","last_fullsized":"2024-09-12T01:38:37.084696+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:41.926908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061071+0000","last_change":"2024-09-12T01:38:35.061071+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061071+0000","last_undegraded":"2024-09-12T01:38:35.061071+0000","last_fullsized":"2024-09-12T01:38:35.061071+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081914+0000","last_change":"2024-09-12T01:38:35.075264+0000","last_active":"2024-09-12T01:38:35.081914+0000","last_peered":"2024-09-12T01:38:35.081914+0000","last_clean":"2024-09-12T01:38:35.081914+0000","last_became_active":"2024-09-12T01:38:35.074931+0000","last_became_peered":"2024-09-12T01:38:35.074931+0000","last_unstale":"2024-09-12T01:38:35.081914+0000","last_undegraded":"2024-09-12T01:38:35.081914+0000","last_fullsized":"2024-09-12T01:38:35.081914+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:32.908068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066160+0000","last_change":"2024-09-12T01:38:35.066160+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066160+0000","last_undegraded":"2024-09-12T01:38:35.066160+0000","last_fullsized":"2024-09-12T01:38:35.066160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.082216+0000","last_change":"2024-09-12T01:38:35.076687+0000","last_active":"2024-09-12T01:38:35.082216+0000","last_peered":"2024-09-12T01:38:35.082216+0000","last_clean":"2024-09-12T01:38:35.082216+0000","last_became_active":"2024-09-12T01:38:35.076422+0000","last_became_peered":"2024-09-12T01:38:35.076422+0000","last_unstale":"2024-09-12T01:38:35.082216+0000","last_undegraded":"2024-09-12T01:38:35.082216+0000","last_fullsized":"2024-09-12T01:38:35.082216+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.044440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062325+0000","last_change":"2024-09-12T01:38:35.062325+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062325+0000","last_undegraded":"2024-09-12T01:38:35.062325+0000","last_fullsized":"2024-09-12T01:38:35.062325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.080062+0000","last_change":"2024-09-12T01:38:35.078231+0000","last_active":"2024-09-12T01:38:35.080062+0000","last_peered":"2024-09-12T01:38:35.080062+0000","last_clean":"2024-09-12T01:38:35.080062+0000","last_became_active":"2024-09-12T01:38:35.077610+0000","last_became_peered":"2024-09-12T01:38:35.077610+0000","last_unstale":"2024-09-12T01:38:35.080062+0000","last_undegraded":"2024-09-12T01:38:35.080062+0000","last_fullsized":"2024-09-12T01:38:35.080062+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:37.026677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061055+0000","last_change":"2024-09-12T01:38:35.061055+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061055+0000","last_undegraded":"2024-09-12T01:38:35.061055+0000","last_fullsized":"2024-09-12T01:38:35.061055+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.080026+0000","last_change":"2024-09-12T01:38:35.078333+0000","last_active":"2024-09-12T01:38:35.080026+0000","last_peered":"2024-09-12T01:38:35.080026+0000","last_clean":"2024-09-12T01:38:35.080026+0000","last_became_active":"2024-09-12T01:38:35.078039+0000","last_became_peered":"2024-09-12T01:38:35.078039+0000","last_unstale":"2024-09-12T01:38:35.080026+0000","last_undegraded":"2024-09-12T01:38:35.080026+0000","last_fullsized":"2024-09-12T01:38:35.080026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:46.609912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064823+0000","last_change":"2024-09-12T01:38:35.064823+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064823+0000","last_undegraded":"2024-09-12T01:38:35.064823+0000","last_fullsized":"2024-09-12T01:38:35.064823+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.072357+0000","last_change":"2024-09-12T01:38:35.070809+0000","last_active":"2024-09-12T01:38:35.072357+0000","last_peered":"2024-09-12T01:38:35.072357+0000","last_clean":"2024-09-12T01:38:35.072357+0000","last_became_active":"2024-09-12T01:38:35.070528+0000","last_became_peered":"2024-09-12T01:38:35.070528+0000","last_unstale":"2024-09-12T01:38:35.072357+0000","last_undegraded":"2024-09-12T01:38:35.072357+0000","last_fullsized":"2024-09-12T01:38:35.072357+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:31.440746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065588+0000","last_change":"2024-09-12T01:38:35.065588+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065588+0000","last_undegraded":"2024-09-12T01:38:35.065588+0000","last_fullsized":"2024-09-12T01:38:35.065588+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081087+0000","last_change":"2024-09-12T01:38:35.080550+0000","last_active":"2024-09-12T01:38:35.081087+0000","last_peered":"2024-09-12T01:38:35.081087+0000","last_clean":"2024-09-12T01:38:35.081087+0000","last_became_active":"2024-09-12T01:38:35.080117+0000","last_became_peered":"2024-09-12T01:38:35.080117+0000","last_unstale":"2024-09-12T01:38:35.081087+0000","last_undegraded":"2024-09-12T01:38:35.081087+0000","last_fullsized":"2024-09-12T01:38:35.081087+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:11.987486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065086+0000","last_change":"2024-09-12T01:38:35.065086+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065086+0000","last_undegraded":"2024-09-12T01:38:35.065086+0000","last_fullsized":"2024-09-12T01:38:35.065086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079010+0000","last_change":"2024-09-12T01:38:35.074670+0000","last_active":"2024-09-12T01:38:35.079010+0000","last_peered":"2024-09-12T01:38:35.079010+0000","last_clean":"2024-09-12T01:38:35.079010+0000","last_became_active":"2024-09-12T01:38:35.074402+0000","last_became_peered":"2024-09-12T01:38:35.074402+0000","last_unstale":"2024-09-12T01:38:35.079010+0000","last_undegraded":"2024-09-12T01:38:35.079010+0000","last_fullsized":"2024-09-12T01:38:35.079010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:30.611884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065164+0000","last_change":"2024-09-12T01:38:35.065164+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065164+0000","last_undegraded":"2024-09-12T01:38:35.065164+0000","last_fullsized":"2024-09-12T01:38:35.065164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079738+0000","last_change":"2024-09-12T01:38:35.078432+0000","last_active":"2024-09-12T01:38:35.079738+0000","last_peered":"2024-09-12T01:38:35.079738+0000","last_clean":"2024-09-12T01:38:35.079738+0000","last_became_active":"2024-09-12T01:38:35.078189+0000","last_became_peered":"2024-09-12T01:38:35.078189+0000","last_unstale":"2024-09-12T01:38:35.079738+0000","last_undegraded":"2024-09-12T01:38:35.079738+0000","last_fullsized":"2024-09-12T01:38:35.079738+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:45.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065108+0000","last_change":"2024-09-12T01:38:35.065108+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065108+0000","last_undegraded":"2024-09-12T01:38:35.065108+0000","last_fullsized":"2024-09-12T01:38:35.065108+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078159+0000","last_change":"2024-09-12T01:38:35.077288+0000","last_active":"2024-09-12T01:38:35.078159+0000","last_peered":"2024-09-12T01:38:35.078159+0000","last_clean":"2024-09-12T01:38:35.078159+0000","last_became_active":"2024-09-12T01:38:35.077000+0000","last_became_peered":"2024-09-12T01:38:35.077000+0000","last_unstale":"2024-09-12T01:38:35.078159+0000","last_undegraded":"2024-09-12T01:38:35.078159+0000","last_fullsized":"2024-09-12T01:38:35.078159+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:43.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063962+0000","last_change":"2024-09-12T01:38:35.063962+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063962+0000","last_undegraded":"2024-09-12T01:38:35.063962+0000","last_fullsized":"2024-09-12T01:38:35.063962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.075521+0000","last_change":"2024-09-12T01:38:35.073096+0000","last_active":"2024-09-12T01:38:35.075521+0000","last_peered":"2024-09-12T01:38:35.075521+0000","last_clean":"2024-09-12T01:38:35.075521+0000","last_became_active":"2024-09-12T01:38:35.072772+0000","last_became_peered":"2024-09-12T01:38:35.072772+0000","last_unstale":"2024-09-12T01:38:35.075521+0000","last_undegraded":"2024-09-12T01:38:35.075521+0000","last_fullsized":"2024-09-12T01:38:35.075521+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:21.431272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064387+0000","last_change":"2024-09-12T01:38:35.064387+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064387+0000","last_undegraded":"2024-09-12T01:38:35.064387+0000","last_fullsized":"2024-09-12T01:38:35.064387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078961+0000","last_change":"2024-09-12T01:38:35.073899+0000","last_active":"2024-09-12T01:38:35.078961+0000","last_peered":"2024-09-12T01:38:35.078961+0000","last_clean":"2024-09-12T01:38:35.078961+0000","last_became_active":"2024-09-12T01:38:35.073595+0000","last_became_peered":"2024-09-12T01:38:35.073595+0000","last_unstale":"2024-09-12T01:38:35.078961+0000","last_undegraded":"2024-09-12T01:38:35.078961+0000","last_fullsized":"2024-09-12T01:38:35.078961+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:06.183845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083977+0000","last_change":"2024-09-12T01:38:36.076413+0000","last_active":"2024-09-12T01:38:37.083977+0000","last_peered":"2024-09-12T01:38:37.083977+0000","last_clean":"2024-09-12T01:38:37.083977+0000","last_became_active":"2024-09-12T01:38:36.076144+0000","last_became_peered":"2024-09-12T01:38:36.076144+0000","last_unstale":"2024-09-12T01:38:37.083977+0000","last_undegraded":"2024-09-12T01:38:37.083977+0000","last_fullsized":"2024-09-12T01:38:37.083977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:33.668164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.073293+0000","last_change":"2024-09-12T01:38:35.068662+0000","last_active":"2024-09-12T01:38:35.073293+0000","last_peered":"2024-09-12T01:38:35.073293+0000","last_clean":"2024-09-12T01:38:35.073293+0000","last_became_active":"2024-09-12T01:38:35.068382+0000","last_became_peered":"2024-09-12T01:38:35.068382+0000","last_unstale":"2024-09-12T01:38:35.073293+0000","last_undegraded":"2024-09-12T01:38:35.073293+0000","last_fullsized":"2024-09-12T01:38:35.073293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:44.611816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061175+0000","last_change":"2024-09-12T01:38:35.061175+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061175+0000","last_undegraded":"2024-09-12T01:38:35.061175+0000","last_fullsized":"2024-09-12T01:38:35.061175+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.080766+0000","last_change":"2024-09-12T01:38:35.080231+0000","last_active":"2024-09-12T01:38:35.080766+0000","last_peered":"2024-09-12T01:38:35.080766+0000","last_clean":"2024-09-12T01:38:35.080766+0000","last_became_active":"2024-09-12T01:38:35.079916+0000","last_became_peered":"2024-09-12T01:38:35.079916+0000","last_unstale":"2024-09-12T01:38:35.080766+0000","last_undegraded":"2024-09-12T01:38:35.080766+0000","last_fullsized":"2024-09-12T01:38:35.080766+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:37.381169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061522+0000","last_change":"2024-09-12T01:38:35.061522+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061522+0000","last_undegraded":"2024-09-12T01:38:35.061522+0000","last_fullsized":"2024-09-12T01:38:35.061522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078413+0000","last_change":"2024-09-12T01:38:35.076006+0000","last_active":"2024-09-12T01:38:35.078413+0000","last_peered":"2024-09-12T01:38:35.078413+0000","last_clean":"2024-09-12T01:38:35.078413+0000","last_became_active":"2024-09-12T01:38:35.075736+0000","last_became_peered":"2024-09-12T01:38:35.075736+0000","last_unstale":"2024-09-12T01:38:35.078413+0000","last_undegraded":"2024-09-12T01:38:35.078413+0000","last_fullsized":"2024-09-12T01:38:35.078413+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:21.988687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064137+0000","last_change":"2024-09-12T01:38:35.064137+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064137+0000","last_undegraded":"2024-09-12T01:38:35.064137+0000","last_fullsized":"2024-09-12T01:38:35.064137+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084757+0000","last_change":"2024-09-12T01:38:35.074634+0000","last_active":"2024-09-12T01:38:37.084757+0000","last_peered":"2024-09-12T01:38:37.084757+0000","last_clean":"2024-09-12T01:38:37.084757+0000","last_became_active":"2024-09-12T01:38:35.074336+0000","last_became_peered":"2024-09-12T01:38:35.074336+0000","last_unstale":"2024-09-12T01:38:37.084757+0000","last_undegraded":"2024-09-12T01:38:37.084757+0000","last_fullsized":"2024-09-12T01:38:37.084757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:49.502156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061918+0000","last_change":"2024-09-12T01:38:35.061918+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061918+0000","last_undegraded":"2024-09-12T01:38:35.061918+0000","last_fullsized":"2024-09-12T01:38:35.061918+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084328+0000","last_change":"2024-09-12T01:38:35.077330+0000","last_active":"2024-09-12T01:38:37.084328+0000","last_peered":"2024-09-12T01:38:37.084328+0000","last_clean":"2024-09-12T01:38:37.084328+0000","last_became_active":"2024-09-12T01:38:35.077032+0000","last_became_peered":"2024-09-12T01:38:35.077032+0000","last_unstale":"2024-09-12T01:38:37.084328+0000","last_undegraded":"2024-09-12T01:38:37.084328+0000","last_fullsized":"2024-09-12T01:38:37.084328+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:09.008913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061035+0000","last_change":"2024-09-12T01:38:35.061035+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061035+0000","last_undegraded":"2024-09-12T01:38:35.061035+0000","last_fullsized":"2024-09-12T01:38:35.061035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084452+0000","last_change":"2024-09-12T01:38:35.077389+0000","last_active":"2024-09-12T01:38:37.084452+0000","last_peered":"2024-09-12T01:38:37.084452+0000","last_clean":"2024-09-12T01:38:37.084452+0000","last_became_active":"2024-09-12T01:38:35.076794+0000","last_became_peered":"2024-09-12T01:38:35.076794+0000","last_unstale":"2024-09-12T01:38:37.084452+0000","last_undegraded":"2024-09-12T01:38:37.084452+0000","last_fullsized":"2024-09-12T01:38:37.084452+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:30.729450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064537+0000","last_change":"2024-09-12T01:38:35.064537+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064537+0000","last_undegraded":"2024-09-12T01:38:35.064537+0000","last_fullsized":"2024-09-12T01:38:35.064537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.073255+0000","last_change":"2024-09-12T01:38:35.068171+0000","last_active":"2024-09-12T01:38:35.073255+0000","last_peered":"2024-09-12T01:38:35.073255+0000","last_clean":"2024-09-12T01:38:35.073255+0000","last_became_active":"2024-09-12T01:38:35.067831+0000","last_became_peered":"2024-09-12T01:38:35.067831+0000","last_unstale":"2024-09-12T01:38:35.073255+0000","last_undegraded":"2024-09-12T01:38:35.073255+0000","last_fullsized":"2024-09-12T01:38:35.073255+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:30.457568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063877+0000","last_change":"2024-09-12T01:38:35.063877+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063877+0000","last_undegraded":"2024-09-12T01:38:35.063877+0000","last_fullsized":"2024-09-12T01:38:35.063877+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078983+0000","last_change":"2024-09-12T01:38:35.075288+0000","last_active":"2024-09-12T01:38:35.078983+0000","last_peered":"2024-09-12T01:38:35.078983+0000","last_clean":"2024-09-12T01:38:35.078983+0000","last_became_active":"2024-09-12T01:38:35.074950+0000","last_became_peered":"2024-09-12T01:38:35.074950+0000","last_unstale":"2024-09-12T01:38:35.078983+0000","last_undegraded":"2024-09-12T01:38:35.078983+0000","last_fullsized":"2024-09-12T01:38:35.078983+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:45.169458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066578+0000","last_change":"2024-09-12T01:38:35.066578+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066578+0000","last_undegraded":"2024-09-12T01:38:35.066578+0000","last_fullsized":"2024-09-12T01:38:35.066578+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.073746+0000","last_change":"2024-09-12T01:38:35.071787+0000","last_active":"2024-09-12T01:38:35.073746+0000","last_peered":"2024-09-12T01:38:35.073746+0000","last_clean":"2024-09-12T01:38:35.073746+0000","last_became_active":"2024-09-12T01:38:35.071434+0000","last_became_peered":"2024-09-12T01:38:35.071434+0000","last_unstale":"2024-09-12T01:38:35.073746+0000","last_undegraded":"2024-09-12T01:38:35.073746+0000","last_fullsized":"2024-09-12T01:38:35.073746+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.044440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062214+0000","last_change":"2024-09-12T01:38:35.062214+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062214+0000","last_undegraded":"2024-09-12T01:38:35.062214+0000","last_fullsized":"2024-09-12T01:38:35.062214+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.077058+0000","last_change":"2024-09-12T01:38:35.074670+0000","last_active":"2024-09-12T01:38:35.077058+0000","last_peered":"2024-09-12T01:38:35.077058+0000","last_clean":"2024-09-12T01:38:35.077058+0000","last_became_active":"2024-09-12T01:38:35.074326+0000","last_became_peered":"2024-09-12T01:38:35.074326+0000","last_unstale":"2024-09-12T01:38:35.077058+0000","last_undegraded":"2024-09-12T01:38:35.077058+0000","last_fullsized":"2024-09-12T01:38:35.077058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:48.649110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":251,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.061582+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:38:35.061582+0000","last_peered":"2024-09-12T01:38:35.061582+0000","last_clean":"2024-09-12T01:38:35.061582+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:38:35.061582+0000","last_undegraded":"2024-09-12T01:38:35.061582+0000","last_fullsized":"2024-09-12T01:38:35.061582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":320000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":794624,"data_stored":326267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1376256,"data_stored":910368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":794624,"data_stored":326267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":794624,"data_stored":326267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1376256,"data_stored":910368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":782336,"data_stored":320000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":831488,"data_stored":340036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:40.753 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3f is not active+clean 2024-09-12T01:38:40.753 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.072994+0000', 'last_change': '2024-09-12T01:38:35.072994+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.072994+0000', 'last_undegraded': '2024-09-12T01:38:35.072994+0000', 'last_fullsized': '2024-09-12T01:38:35.072994+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:38:40.753 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3e is not active+clean 2024-09-12T01:38:40.753 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.066042+0000', 'last_change': '2024-09-12T01:38:35.066042+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.066042+0000', 'last_undegraded': '2024-09-12T01:38:35.066042+0000', 'last_fullsized': '2024-09-12T01:38:35.066042+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:38:40.753 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3d is not active+clean 2024-09-12T01:38:40.753 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.065873+0000', 'last_change': '2024-09-12T01:38:35.065873+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.065873+0000', 'last_undegraded': '2024-09-12T01:38:35.065873+0000', 'last_fullsized': '2024-09-12T01:38:35.065873+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:38:40.753 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3c is not active+clean 2024-09-12T01:38:40.753 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.065654+0000', 'last_change': '2024-09-12T01:38:35.065654+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.065654+0000', 'last_undegraded': '2024-09-12T01:38:35.065654+0000', 'last_fullsized': '2024-09-12T01:38:35.065654+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:38:40.754 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3b is not active+clean 2024-09-12T01:38:40.754 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.061113+0000', 'last_change': '2024-09-12T01:38:35.061113+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.061113+0000', 'last_undegraded': '2024-09-12T01:38:35.061113+0000', 'last_fullsized': '2024-09-12T01:38:35.061113+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:38:40.754 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3a is not active+clean 2024-09-12T01:38:40.754 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.068161+0000', 'last_change': '2024-09-12T01:38:35.068161+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.068161+0000', 'last_undegraded': '2024-09-12T01:38:35.068161+0000', 'last_fullsized': '2024-09-12T01:38:35.068161+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:38:40.754 INFO:tasks.ceph.ceph_manager.ceph:PG 11.39 is not active+clean 2024-09-12T01:38:40.754 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.069805+0000', 'last_change': '2024-09-12T01:38:35.069805+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.069805+0000', 'last_undegraded': '2024-09-12T01:38:35.069805+0000', 'last_fullsized': '2024-09-12T01:38:35.069805+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:38:40.754 INFO:tasks.ceph.ceph_manager.ceph:PG 11.38 is not active+clean 2024-09-12T01:38:40.754 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.072551+0000', 'last_change': '2024-09-12T01:38:35.072551+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.072551+0000', 'last_undegraded': '2024-09-12T01:38:35.072551+0000', 'last_fullsized': '2024-09-12T01:38:35.072551+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:38:40.754 INFO:tasks.ceph.ceph_manager.ceph:PG 11.37 is not active+clean 2024-09-12T01:38:40.754 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.065795+0000', 'last_change': '2024-09-12T01:38:35.065795+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.065795+0000', 'last_undegraded': '2024-09-12T01:38:35.065795+0000', 'last_fullsized': '2024-09-12T01:38:35.065795+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:38:40.754 INFO:tasks.ceph.ceph_manager.ceph:PG 11.36 is not active+clean 2024-09-12T01:38:40.754 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.062440+0000', 'last_change': '2024-09-12T01:38:35.062440+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.062440+0000', 'last_undegraded': '2024-09-12T01:38:35.062440+0000', 'last_fullsized': '2024-09-12T01:38:35.062440+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:38:40.755 INFO:tasks.ceph.ceph_manager.ceph:PG 11.35 is not active+clean 2024-09-12T01:38:40.755 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.075204+0000', 'last_change': '2024-09-12T01:38:35.075204+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.075204+0000', 'last_undegraded': '2024-09-12T01:38:35.075204+0000', 'last_fullsized': '2024-09-12T01:38:35.075204+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:38:40.755 INFO:tasks.ceph.ceph_manager.ceph:PG 11.33 is not active+clean 2024-09-12T01:38:40.755 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.064920+0000', 'last_change': '2024-09-12T01:38:35.064920+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.064920+0000', 'last_undegraded': '2024-09-12T01:38:35.064920+0000', 'last_fullsized': '2024-09-12T01:38:35.064920+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:38:40.755 INFO:tasks.ceph.ceph_manager.ceph:PG 11.30 is not active+clean 2024-09-12T01:38:40.755 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.070031+0000', 'last_change': '2024-09-12T01:38:35.070031+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.070031+0000', 'last_undegraded': '2024-09-12T01:38:35.070031+0000', 'last_fullsized': '2024-09-12T01:38:35.070031+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:38:40.756 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2f is not active+clean 2024-09-12T01:38:40.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.061032+0000', 'last_change': '2024-09-12T01:38:35.061032+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.061032+0000', 'last_undegraded': '2024-09-12T01:38:35.061032+0000', 'last_fullsized': '2024-09-12T01:38:35.061032+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:38:40.756 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2e is not active+clean 2024-09-12T01:38:40.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.062004+0000', 'last_change': '2024-09-12T01:38:35.062004+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.062004+0000', 'last_undegraded': '2024-09-12T01:38:35.062004+0000', 'last_fullsized': '2024-09-12T01:38:35.062004+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:38:40.756 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2d is not active+clean 2024-09-12T01:38:40.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.074726+0000', 'last_change': '2024-09-12T01:38:35.074726+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.074726+0000', 'last_undegraded': '2024-09-12T01:38:35.074726+0000', 'last_fullsized': '2024-09-12T01:38:35.074726+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:38:40.756 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2c is not active+clean 2024-09-12T01:38:40.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.061122+0000', 'last_change': '2024-09-12T01:38:35.061122+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.061122+0000', 'last_undegraded': '2024-09-12T01:38:35.061122+0000', 'last_fullsized': '2024-09-12T01:38:35.061122+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:38:40.756 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2b is not active+clean 2024-09-12T01:38:40.756 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.065481+0000', 'last_change': '2024-09-12T01:38:35.065481+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.065481+0000', 'last_undegraded': '2024-09-12T01:38:35.065481+0000', 'last_fullsized': '2024-09-12T01:38:35.065481+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:38:40.756 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2a is not active+clean 2024-09-12T01:38:40.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.067729+0000', 'last_change': '2024-09-12T01:38:35.067729+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.067729+0000', 'last_undegraded': '2024-09-12T01:38:35.067729+0000', 'last_fullsized': '2024-09-12T01:38:35.067729+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:38:40.757 INFO:tasks.ceph.ceph_manager.ceph:PG 11.29 is not active+clean 2024-09-12T01:38:40.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.069348+0000', 'last_change': '2024-09-12T01:38:35.069348+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.069348+0000', 'last_undegraded': '2024-09-12T01:38:35.069348+0000', 'last_fullsized': '2024-09-12T01:38:35.069348+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:38:40.757 INFO:tasks.ceph.ceph_manager.ceph:PG 11.28 is not active+clean 2024-09-12T01:38:40.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.069615+0000', 'last_change': '2024-09-12T01:38:35.069615+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.069615+0000', 'last_undegraded': '2024-09-12T01:38:35.069615+0000', 'last_fullsized': '2024-09-12T01:38:35.069615+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:38:40.757 INFO:tasks.ceph.ceph_manager.ceph:PG 11.27 is not active+clean 2024-09-12T01:38:40.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.068672+0000', 'last_change': '2024-09-12T01:38:35.068672+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.068672+0000', 'last_undegraded': '2024-09-12T01:38:35.068672+0000', 'last_fullsized': '2024-09-12T01:38:35.068672+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:38:40.757 INFO:tasks.ceph.ceph_manager.ceph:PG 11.26 is not active+clean 2024-09-12T01:38:40.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.069144+0000', 'last_change': '2024-09-12T01:38:35.069144+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.069144+0000', 'last_undegraded': '2024-09-12T01:38:35.069144+0000', 'last_fullsized': '2024-09-12T01:38:35.069144+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:38:40.757 INFO:tasks.ceph.ceph_manager.ceph:PG 11.25 is not active+clean 2024-09-12T01:38:40.757 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.063084+0000', 'last_change': '2024-09-12T01:38:35.063084+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.063084+0000', 'last_undegraded': '2024-09-12T01:38:35.063084+0000', 'last_fullsized': '2024-09-12T01:38:35.063084+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:38:40.758 INFO:tasks.ceph.ceph_manager.ceph:PG 11.24 is not active+clean 2024-09-12T01:38:40.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.064633+0000', 'last_change': '2024-09-12T01:38:35.064633+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.064633+0000', 'last_undegraded': '2024-09-12T01:38:35.064633+0000', 'last_fullsized': '2024-09-12T01:38:35.064633+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:38:40.758 INFO:tasks.ceph.ceph_manager.ceph:PG 11.23 is not active+clean 2024-09-12T01:38:40.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.064224+0000', 'last_change': '2024-09-12T01:38:35.064224+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.064224+0000', 'last_undegraded': '2024-09-12T01:38:35.064224+0000', 'last_fullsized': '2024-09-12T01:38:35.064224+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:38:40.758 INFO:tasks.ceph.ceph_manager.ceph:PG 11.22 is not active+clean 2024-09-12T01:38:40.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.066229+0000', 'last_change': '2024-09-12T01:38:35.066229+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.066229+0000', 'last_undegraded': '2024-09-12T01:38:35.066229+0000', 'last_fullsized': '2024-09-12T01:38:35.066229+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:38:40.758 INFO:tasks.ceph.ceph_manager.ceph:PG 11.21 is not active+clean 2024-09-12T01:38:40.758 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.066181+0000', 'last_change': '2024-09-12T01:38:35.066181+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.066181+0000', 'last_undegraded': '2024-09-12T01:38:35.066181+0000', 'last_fullsized': '2024-09-12T01:38:35.066181+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:38:40.758 INFO:tasks.ceph.ceph_manager.ceph:PG 11.20 is not active+clean 2024-09-12T01:38:40.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.064710+0000', 'last_change': '2024-09-12T01:38:35.064710+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.064710+0000', 'last_undegraded': '2024-09-12T01:38:35.064710+0000', 'last_fullsized': '2024-09-12T01:38:35.064710+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:38:40.759 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-09-12T01:38:40.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.067351+0000', 'last_change': '2024-09-12T01:38:35.067351+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.067351+0000', 'last_undegraded': '2024-09-12T01:38:35.067351+0000', 'last_fullsized': '2024-09-12T01:38:35.067351+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:38:40.759 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1f is not active+clean 2024-09-12T01:38:40.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.065351+0000', 'last_change': '2024-09-12T01:38:35.065351+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.065351+0000', 'last_undegraded': '2024-09-12T01:38:35.065351+0000', 'last_fullsized': '2024-09-12T01:38:35.065351+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:38:40.759 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1c is not active+clean 2024-09-12T01:38:40.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.067267+0000', 'last_change': '2024-09-12T01:38:35.067267+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.067267+0000', 'last_undegraded': '2024-09-12T01:38:35.067267+0000', 'last_fullsized': '2024-09-12T01:38:35.067267+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:38:40.759 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1d is not active+clean 2024-09-12T01:38:40.759 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.063501+0000', 'last_change': '2024-09-12T01:38:35.063501+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.063501+0000', 'last_undegraded': '2024-09-12T01:38:35.063501+0000', 'last_fullsized': '2024-09-12T01:38:35.063501+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:38:40.759 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-09-12T01:38:40.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.065638+0000', 'last_change': '2024-09-12T01:38:35.065638+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.065638+0000', 'last_undegraded': '2024-09-12T01:38:35.065638+0000', 'last_fullsized': '2024-09-12T01:38:35.065638+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:38:40.760 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1b is not active+clean 2024-09-12T01:38:40.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.066679+0000', 'last_change': '2024-09-12T01:38:35.066679+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.066679+0000', 'last_undegraded': '2024-09-12T01:38:35.066679+0000', 'last_fullsized': '2024-09-12T01:38:35.066679+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:38:40.760 INFO:tasks.ceph.ceph_manager.ceph:PG 11.18 is not active+clean 2024-09-12T01:38:40.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.064825+0000', 'last_change': '2024-09-12T01:38:35.064825+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.064825+0000', 'last_undegraded': '2024-09-12T01:38:35.064825+0000', 'last_fullsized': '2024-09-12T01:38:35.064825+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:38:40.760 INFO:tasks.ceph.ceph_manager.ceph:PG 11.16 is not active+clean 2024-09-12T01:38:40.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.061904+0000', 'last_change': '2024-09-12T01:38:35.061904+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.061904+0000', 'last_undegraded': '2024-09-12T01:38:35.061904+0000', 'last_fullsized': '2024-09-12T01:38:35.061904+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:38:40.760 INFO:tasks.ceph.ceph_manager.ceph:PG 11.17 is not active+clean 2024-09-12T01:38:40.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.065512+0000', 'last_change': '2024-09-12T01:38:35.065512+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.065512+0000', 'last_undegraded': '2024-09-12T01:38:35.065512+0000', 'last_fullsized': '2024-09-12T01:38:35.065512+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:38:40.760 INFO:tasks.ceph.ceph_manager.ceph:PG 11.14 is not active+clean 2024-09-12T01:38:40.760 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.066826+0000', 'last_change': '2024-09-12T01:38:35.066826+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.066826+0000', 'last_undegraded': '2024-09-12T01:38:35.066826+0000', 'last_fullsized': '2024-09-12T01:38:35.066826+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:38:40.761 INFO:tasks.ceph.ceph_manager.ceph:PG 11.15 is not active+clean 2024-09-12T01:38:40.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.061071+0000', 'last_change': '2024-09-12T01:38:35.061071+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.061071+0000', 'last_undegraded': '2024-09-12T01:38:35.061071+0000', 'last_fullsized': '2024-09-12T01:38:35.061071+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:38:40.761 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-09-12T01:38:40.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.066160+0000', 'last_change': '2024-09-12T01:38:35.066160+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.066160+0000', 'last_undegraded': '2024-09-12T01:38:35.066160+0000', 'last_fullsized': '2024-09-12T01:38:35.066160+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:38:40.761 INFO:tasks.ceph.ceph_manager.ceph:PG 11.13 is not active+clean 2024-09-12T01:38:40.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.062325+0000', 'last_change': '2024-09-12T01:38:35.062325+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.062325+0000', 'last_undegraded': '2024-09-12T01:38:35.062325+0000', 'last_fullsized': '2024-09-12T01:38:35.062325+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:38:40.761 INFO:tasks.ceph.ceph_manager.ceph:PG 11.10 is not active+clean 2024-09-12T01:38:40.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.061055+0000', 'last_change': '2024-09-12T01:38:35.061055+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.061055+0000', 'last_undegraded': '2024-09-12T01:38:35.061055+0000', 'last_fullsized': '2024-09-12T01:38:35.061055+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:38:40.761 INFO:tasks.ceph.ceph_manager.ceph:PG 11.11 is not active+clean 2024-09-12T01:38:40.761 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.064823+0000', 'last_change': '2024-09-12T01:38:35.064823+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.064823+0000', 'last_undegraded': '2024-09-12T01:38:35.064823+0000', 'last_fullsized': '2024-09-12T01:38:35.064823+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:38:40.761 INFO:tasks.ceph.ceph_manager.ceph:PG 11.e is not active+clean 2024-09-12T01:38:40.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.065588+0000', 'last_change': '2024-09-12T01:38:35.065588+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.065588+0000', 'last_undegraded': '2024-09-12T01:38:35.065588+0000', 'last_fullsized': '2024-09-12T01:38:35.065588+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:38:40.762 INFO:tasks.ceph.ceph_manager.ceph:PG 11.f is not active+clean 2024-09-12T01:38:40.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.065086+0000', 'last_change': '2024-09-12T01:38:35.065086+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.065086+0000', 'last_undegraded': '2024-09-12T01:38:35.065086+0000', 'last_fullsized': '2024-09-12T01:38:35.065086+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:38:40.762 INFO:tasks.ceph.ceph_manager.ceph:PG 11.c is not active+clean 2024-09-12T01:38:40.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.065164+0000', 'last_change': '2024-09-12T01:38:35.065164+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.065164+0000', 'last_undegraded': '2024-09-12T01:38:35.065164+0000', 'last_fullsized': '2024-09-12T01:38:35.065164+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:38:40.762 INFO:tasks.ceph.ceph_manager.ceph:PG 11.d is not active+clean 2024-09-12T01:38:40.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.065108+0000', 'last_change': '2024-09-12T01:38:35.065108+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.065108+0000', 'last_undegraded': '2024-09-12T01:38:35.065108+0000', 'last_fullsized': '2024-09-12T01:38:35.065108+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:38:40.762 INFO:tasks.ceph.ceph_manager.ceph:PG 11.b is not active+clean 2024-09-12T01:38:40.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.063962+0000', 'last_change': '2024-09-12T01:38:35.063962+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.063962+0000', 'last_undegraded': '2024-09-12T01:38:35.063962+0000', 'last_fullsized': '2024-09-12T01:38:35.063962+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:38:40.762 INFO:tasks.ceph.ceph_manager.ceph:PG 11.8 is not active+clean 2024-09-12T01:38:40.762 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.064387+0000', 'last_change': '2024-09-12T01:38:35.064387+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.064387+0000', 'last_undegraded': '2024-09-12T01:38:35.064387+0000', 'last_fullsized': '2024-09-12T01:38:35.064387+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:38:40.763 INFO:tasks.ceph.ceph_manager.ceph:PG 11.6 is not active+clean 2024-09-12T01:38:40.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.061175+0000', 'last_change': '2024-09-12T01:38:35.061175+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.061175+0000', 'last_undegraded': '2024-09-12T01:38:35.061175+0000', 'last_fullsized': '2024-09-12T01:38:35.061175+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:38:40.763 INFO:tasks.ceph.ceph_manager.ceph:PG 11.7 is not active+clean 2024-09-12T01:38:40.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.061522+0000', 'last_change': '2024-09-12T01:38:35.061522+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.061522+0000', 'last_undegraded': '2024-09-12T01:38:35.061522+0000', 'last_fullsized': '2024-09-12T01:38:35.061522+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:38:40.763 INFO:tasks.ceph.ceph_manager.ceph:PG 11.4 is not active+clean 2024-09-12T01:38:40.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.064137+0000', 'last_change': '2024-09-12T01:38:35.064137+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.064137+0000', 'last_undegraded': '2024-09-12T01:38:35.064137+0000', 'last_fullsized': '2024-09-12T01:38:35.064137+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:38:40.763 INFO:tasks.ceph.ceph_manager.ceph:PG 11.5 is not active+clean 2024-09-12T01:38:40.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.061918+0000', 'last_change': '2024-09-12T01:38:35.061918+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.061918+0000', 'last_undegraded': '2024-09-12T01:38:35.061918+0000', 'last_fullsized': '2024-09-12T01:38:35.061918+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:38:40.763 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2 is not active+clean 2024-09-12T01:38:40.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.061035+0000', 'last_change': '2024-09-12T01:38:35.061035+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.061035+0000', 'last_undegraded': '2024-09-12T01:38:35.061035+0000', 'last_fullsized': '2024-09-12T01:38:35.061035+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:38:40.763 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3 is not active+clean 2024-09-12T01:38:40.763 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.064537+0000', 'last_change': '2024-09-12T01:38:35.064537+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.064537+0000', 'last_undegraded': '2024-09-12T01:38:35.064537+0000', 'last_fullsized': '2024-09-12T01:38:35.064537+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:38:40.764 INFO:tasks.ceph.ceph_manager.ceph:PG 11.0 is not active+clean 2024-09-12T01:38:40.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.063877+0000', 'last_change': '2024-09-12T01:38:35.063877+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.063877+0000', 'last_undegraded': '2024-09-12T01:38:35.063877+0000', 'last_fullsized': '2024-09-12T01:38:35.063877+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:38:40.764 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1 is not active+clean 2024-09-12T01:38:40.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.066578+0000', 'last_change': '2024-09-12T01:38:35.066578+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.066578+0000', 'last_undegraded': '2024-09-12T01:38:35.066578+0000', 'last_fullsized': '2024-09-12T01:38:35.066578+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:38:40.764 INFO:tasks.ceph.ceph_manager.ceph:PG 11.a is not active+clean 2024-09-12T01:38:40.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:38:35.062214+0000', 'last_change': '2024-09-12T01:38:35.062214+0000', 'last_active': '2024-09-12T01:38:35.052271+0000', 'last_peered': '2024-09-12T01:38:35.052271+0000', 'last_clean': '2024-09-12T01:38:35.052271+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:38:35.062214+0000', 'last_undegraded': '2024-09-12T01:38:35.062214+0000', 'last_fullsized': '2024-09-12T01:38:35.062214+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'last_clean_scrub_stamp': '2024-09-12T01:38:35.052271+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:38:40.765 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:38:40.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.890+0000 7ff0d1e42640 1 Processor -- start 2024-09-12T01:38:40.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.890+0000 7ff0d1e42640 1 -- start start 2024-09-12T01:38:40.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.891+0000 7ff0d1e42640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff0cc0ba240 0x7ff0cc0d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.891+0000 7ff0d1e42640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0cc0d2f40 con 0x7ff0cc0cf2f0 2024-09-12T01:38:40.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.891+0000 7ff0d1e42640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0cc0d3220 con 0x7ff0cc15e7a0 2024-09-12T01:38:40.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.891+0000 7ff0d1e42640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff0cc0ba690 con 0x7ff0cc0ba240 2024-09-12T01:38:40.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.891+0000 7ff0cbfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff0cc0cf2f0 0x7ff0cc0b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45416/0 (socket says 172.21.15.60:45416) 2024-09-12T01:38:40.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.891+0000 7ff0cbfff640 1 -- 172.21.15.60:0/2539027287 learned_addr learned my addr 172.21.15.60:0/2539027287 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:40.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.891+0000 7ff0caffd640 1 --2- 172.21.15.60:0/2539027287 >> v2:172.21.15.105:3300/0 conn(0x7ff0cc0ba240 0x7ff0cc0d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.892+0000 7ff0ca7fc640 1 -- 172.21.15.60:0/2539027287 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3094428680 0 0) 0x7ff0cc0d2f40 con 0x7ff0cc0cf2f0 2024-09-12T01:38:40.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.892+0000 7ff0ca7fc640 1 -- 172.21.15.60:0/2539027287 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0b4003520 con 0x7ff0cc0cf2f0 2024-09-12T01:38:40.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.892+0000 7ff0ca7fc640 1 -- 172.21.15.60:0/2539027287 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 23913219 0 0) 0x7ff0cc0d3220 con 0x7ff0cc15e7a0 2024-09-12T01:38:40.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.892+0000 7ff0ca7fc640 1 -- 172.21.15.60:0/2539027287 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0cc0d2f40 con 0x7ff0cc15e7a0 2024-09-12T01:38:40.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.892+0000 7ff0caffd640 1 -- 172.21.15.60:0/2539027287 >> v1:172.21.15.105:6789/0 conn(0x7ff0cc15e7a0 legacy=0x7ff0cc0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.892+0000 7ff0caffd640 1 -- 172.21.15.60:0/2539027287 >> v1:172.21.15.60:6789/0 conn(0x7ff0cc0cf2f0 legacy=0x7ff0cc0b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.892+0000 7ff0caffd640 1 -- 172.21.15.60:0/2539027287 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc0d3500 con 0x7ff0cc0ba240 2024-09-12T01:38:40.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.893+0000 7ff0caffd640 1 --2- 172.21.15.60:0/2539027287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0cc0ba240 0x7ff0cc0d3fe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00097a0 tx=0x7ff0c002a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40574d4fc5cd5013 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:40.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.893+0000 7ff0ca7fc640 1 -- 172.21.15.60:0/2539027287 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0037070 con 0x7ff0cc0ba240 2024-09-12T01:38:40.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.893+0000 7ff0ca7fc640 1 -- 172.21.15.60:0/2539027287 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0c0032640 con 0x7ff0cc0ba240 2024-09-12T01:38:40.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.893+0000 7ff0ca7fc640 1 -- 172.21.15.60:0/2539027287 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0032a10 con 0x7ff0cc0ba240 2024-09-12T01:38:40.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.893+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2539027287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0cc0ba240 msgr2=0x7ff0cc0d3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.893+0000 7ff0d1e42640 1 --2- 172.21.15.60:0/2539027287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0cc0ba240 0x7ff0cc0d3fe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00097a0 tx=0x7ff0c002a2c0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.894+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2539027287 shutdown_connections 2024-09-12T01:38:40.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.894+0000 7ff0d1e42640 1 --2- 172.21.15.60:0/2539027287 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0cc0ba240 0x7ff0cc0d3fe0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.894+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2539027287 >> 172.21.15.60:0/2539027287 conn(0x7ff0cc0d1550 msgr2=0x7ff0cc0d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:40.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.894+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2539027287 shutdown_connections 2024-09-12T01:38:40.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.894+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2539027287 wait complete. 2024-09-12T01:38:40.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.895+0000 7ff0d1e42640 1 Processor -- start 2024-09-12T01:38:40.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.895+0000 7ff0d1e42640 1 -- start start 2024-09-12T01:38:40.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0d1e42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc0ba240 0x7ff0cc159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0d1e42640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0cc0cf2f0 0x7ff0cc1612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0d1e42640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0cc15e7a0 0x7ff0cc158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0d1e42640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc15eb80 con 0x7ff0cc0ba240 2024-09-12T01:38:40.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0d1e42640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff0cc0d3ac0 con 0x7ff0cc15e7a0 2024-09-12T01:38:40.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0d1e42640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff0cc15ed00 con 0x7ff0cc0cf2f0 2024-09-12T01:38:40.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0cb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc0ba240 0x7ff0cc159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0cb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc0ba240 0x7ff0cc159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54056/0 (socket says 172.21.15.60:54056) 2024-09-12T01:38:40.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0cb7fe640 1 -- 172.21.15.60:0/2027133416 learned_addr learned my addr 172.21.15.60:0/2027133416 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:40.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0cb7fe640 1 -- 172.21.15.60:0/2027133416 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0cc0cf2f0 msgr2=0x7ff0cc1612c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0cb7fe640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0cc0cf2f0 0x7ff0cc1612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0cb7fe640 1 -- 172.21.15.60:0/2027133416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0cc15e7a0 msgr2=0x7ff0cc158530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:40.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0cbfff640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0cc15e7a0 0x7ff0cc158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0cb7fe640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0cc15e7a0 0x7ff0cc158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:40.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0cb7fe640 1 -- 172.21.15.60:0/2027133416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0cc158ef0 con 0x7ff0cc0ba240 2024-09-12T01:38:40.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0cb7fe640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc0ba240 0x7ff0cc159f90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00c460 tx=0x7ff0bc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:40.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0b3fff640 1 -- 172.21.15.60:0/2027133416 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0052d0 con 0x7ff0cc0ba240 2024-09-12T01:38:40.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.896+0000 7ff0b3fff640 1 -- 172.21.15.60:0/2027133416 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0bc005490 con 0x7ff0cc0ba240 2024-09-12T01:38:40.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.897+0000 7ff0b3fff640 1 -- 172.21.15.60:0/2027133416 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc012870 con 0x7ff0cc0ba240 2024-09-12T01:38:40.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.897+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2027133416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0cc1591d0 con 0x7ff0cc0ba240 2024-09-12T01:38:40.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.897+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2027133416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0cc159790 con 0x7ff0cc0ba240 2024-09-12T01:38:40.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.898+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2027133416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0cc0d3fe0 con 0x7ff0cc0ba240 2024-09-12T01:38:40.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.898+0000 7ff0b3fff640 1 -- 172.21.15.60:0/2027133416 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff0bc012a10 con 0x7ff0cc0ba240 2024-09-12T01:38:40.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.898+0000 7ff0b3fff640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff0b806be30 0x7ff0b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:40.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.898+0000 7ff0b3fff640 1 -- 172.21.15.60:0/2027133416 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7ff0bc08aa50 con 0x7ff0cc0ba240 2024-09-12T01:38:40.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.899+0000 7ff0caffd640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff0b806be30 0x7ff0b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:40.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.899+0000 7ff0caffd640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff0b806be30 0x7ff0b806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0034000 tx=0x7ff0c002c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:40.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:40.903+0000 7ff0b3fff640 1 -- 172.21.15.60:0/2027133416 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff0bc059490 con 0x7ff0cc0ba240 2024-09-12T01:38:41.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.144+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2027133416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff0cc0b5cf0 con 0x7ff0cc0ba240 2024-09-12T01:38:41.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.145+0000 7ff0b3fff640 1 -- 172.21.15.60:0/2027133416 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1559 (secure 0 0 0) 0x7ff0bc058d90 con 0x7ff0cc0ba240 2024-09-12T01:38:41.145 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:41.145 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":188,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":68,"num_osds":8,"num_up_osds":8,"osd_up_since":1726104944,"num_in_osds":8,"osd_in_since":1726104934,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":59},{"state_name":"active+clean","count":38}],"num_pgs":97,"num_pools":3,"num_objects":4,"data_bytes":590458,"bytes_used":258797568,"bytes_avail":772835315712,"bytes_total":773094113280,"inactive_pgs_ratio":0.60824739933013916,"write_bytes_sec":170,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":38,"btime":"2024-09-12T01:38:39:078790+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"d","status":"up:active","gid":35168}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-12T01:38:02.288441+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T01:38:41.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.146+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2027133416 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff0b806be30 msgr2=0x7ff0b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:41.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.146+0000 7ff0d1e42640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff0b806be30 0x7ff0b806e2f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0034000 tx=0x7ff0c002c000 comp rx=0 tx=0).stop 2024-09-12T01:38:41.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.146+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2027133416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc0ba240 msgr2=0x7ff0cc159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:41.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.146+0000 7ff0d1e42640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc0ba240 0x7ff0cc159f90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc00c460 tx=0x7ff0bc00c920 comp rx=0 tx=0).stop 2024-09-12T01:38:41.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.147+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2027133416 shutdown_connections 2024-09-12T01:38:41.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.147+0000 7ff0d1e42640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0cc15e7a0 0x7ff0cc158530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.147+0000 7ff0d1e42640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff0b806be30 0x7ff0b806e2f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.147+0000 7ff0d1e42640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0cc0cf2f0 0x7ff0cc1612c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.147+0000 7ff0d1e42640 1 --2- 172.21.15.60:0/2027133416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0cc0ba240 0x7ff0cc159f90 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.147+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2027133416 >> 172.21.15.60:0/2027133416 conn(0x7ff0cc0d1550 msgr2=0x7ff0cc06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:41.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.147+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2027133416 shutdown_connections 2024-09-12T01:38:41.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.147+0000 7ff0d1e42640 1 -- 172.21.15.60:0/2027133416 wait complete. 2024-09-12T01:38:41.158 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:38:41.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:41.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.260+0000 7fcaf82a6640 1 Processor -- start 2024-09-12T01:38:41.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.261+0000 7fcaf82a6640 1 -- start start 2024-09-12T01:38:41.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.261+0000 7fcaf82a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf00d3310 0x7fcaf00d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:41.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.261+0000 7fcaf82a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcaf00d1650 0x7fcaf00b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:41.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.262+0000 7fcaf82a6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf015ea40 con 0x7fcaf015e660 2024-09-12T01:38:41.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.262+0000 7fcaf82a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf00d1ac0 con 0x7fcaf00d1650 2024-09-12T01:38:41.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.262+0000 7fcaf82a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf00d3870 con 0x7fcaf00d3310 2024-09-12T01:38:41.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.262+0000 7fcaf6843640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcaf00d1650 0x7fcaf00b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:41.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.262+0000 7fcaf6843640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcaf00d1650 0x7fcaf00b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54058/0 (socket says 172.21.15.60:54058) 2024-09-12T01:38:41.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.262+0000 7fcaf6843640 1 -- 172.21.15.60:0/3418867488 learned_addr learned my addr 172.21.15.60:0/3418867488 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:41.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.262+0000 7fcaf5841640 1 --2- 172.21.15.60:0/3418867488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf00d3310 0x7fcaf00d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:41.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.262+0000 7fcaf6843640 1 -- 172.21.15.60:0/3418867488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf00d3310 msgr2=0x7fcaf00d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:41.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.262+0000 7fcaf6843640 1 --2- 172.21.15.60:0/3418867488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf00d3310 0x7fcaf00d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.262+0000 7fcaf6843640 1 -- 172.21.15.60:0/3418867488 >> v1:172.21.15.105:6789/0 conn(0x7fcaf015e660 legacy=0x7fcaf00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:41.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.262+0000 7fcaf6843640 1 -- 172.21.15.60:0/3418867488 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf00d3b50 con 0x7fcaf00d1650 2024-09-12T01:38:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.263+0000 7fcaf6843640 1 --2- 172.21.15.60:0/3418867488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00d1650 0x7fcaf00b7b70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009870 tx=0x7fcae802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1ad572faff5090 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.263+0000 7fcaf5040640 1 -- 172.21.15.60:0/3418867488 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8037070 con 0x7fcaf00d1650 2024-09-12T01:38:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.263+0000 7fcaf5040640 1 -- 172.21.15.60:0/3418867488 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae8032440 con 0x7fcaf00d1650 2024-09-12T01:38:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.263+0000 7fcaf5040640 1 -- 172.21.15.60:0/3418867488 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae8032810 con 0x7fcaf00d1650 2024-09-12T01:38:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.263+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3418867488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00d1650 msgr2=0x7fcaf00b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.263+0000 7fcaf82a6640 1 --2- 172.21.15.60:0/3418867488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00d1650 0x7fcaf00b7b70 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009870 tx=0x7fcae802a270 comp rx=0 tx=0).stop 2024-09-12T01:38:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.264+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3418867488 shutdown_connections 2024-09-12T01:38:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.264+0000 7fcaf82a6640 1 --2- 172.21.15.60:0/3418867488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00d1650 0x7fcaf00b7b70 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.264+0000 7fcaf82a6640 1 --2- 172.21.15.60:0/3418867488 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf00d3310 0x7fcaf00d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.264+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3418867488 >> 172.21.15.60:0/3418867488 conn(0x7fcaf00b6410 msgr2=0x7fcaf00b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.264+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3418867488 shutdown_connections 2024-09-12T01:38:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.264+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3418867488 wait complete. 2024-09-12T01:38:41.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.265+0000 7fcaf82a6640 1 Processor -- start 2024-09-12T01:38:41.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.265+0000 7fcaf82a6640 1 -- start start 2024-09-12T01:38:41.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf82a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00d1650 0x7fcaf01f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:41.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf82a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcaf00d3310 0x7fcaf015bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:41.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf82a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf015e660 0x7fcaf014f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:41.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf82a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf00d43f0 con 0x7fcaf00d1650 2024-09-12T01:38:41.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf82a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf00d4110 con 0x7fcaf00d3310 2024-09-12T01:38:41.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf82a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf00b80b0 con 0x7fcaf015e660 2024-09-12T01:38:41.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf6042640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00d1650 0x7fcaf01f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:41.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf6042640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00d1650 0x7fcaf01f49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:54060/0 (socket says 172.21.15.60:54060) 2024-09-12T01:38:41.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf6042640 1 -- 172.21.15.60:0/3270889568 learned_addr learned my addr 172.21.15.60:0/3270889568 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:41.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf5841640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcaf00d3310 0x7fcaf015bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:41.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf6843640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf015e660 0x7fcaf014f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:41.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf6042640 1 -- 172.21.15.60:0/3270889568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf015e660 msgr2=0x7fcaf014f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:41.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf6042640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf015e660 0x7fcaf014f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf6042640 1 -- 172.21.15.60:0/3270889568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcaf00d3310 msgr2=0x7fcaf015bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:41.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf6042640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcaf00d3310 0x7fcaf015bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf6042640 1 -- 172.21.15.60:0/3270889568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf00cdcd0 con 0x7fcaf00d1650 2024-09-12T01:38:41.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf5841640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcaf00d3310 0x7fcaf015bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:41.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf6843640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf015e660 0x7fcaf014f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:41.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf6042640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00d1650 0x7fcaf01f49b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcae000c730 tx=0x7fcae000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:41.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaeeffd640 1 -- 172.21.15.60:0/3270889568 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0016020 con 0x7fcaf00d1650 2024-09-12T01:38:41.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaeeffd640 1 -- 172.21.15.60:0/3270889568 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae0006d50 con 0x7fcaf00d1650 2024-09-12T01:38:41.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3270889568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf01f7950 con 0x7fcaf00d1650 2024-09-12T01:38:41.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaeeffd640 1 -- 172.21.15.60:0/3270889568 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0003bb0 con 0x7fcaf00d1650 2024-09-12T01:38:41.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.266+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3270889568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf01f7f10 con 0x7fcaf00d1650 2024-09-12T01:38:41.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.268+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3270889568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf00b7b70 con 0x7fcaf00d1650 2024-09-12T01:38:41.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.268+0000 7fcaeeffd640 1 -- 172.21.15.60:0/3270889568 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcae000a850 con 0x7fcaf00d1650 2024-09-12T01:38:41.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.268+0000 7fcaeeffd640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcadc06be30 0x7fcadc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:41.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.269+0000 7fcaeeffd640 1 -- 172.21.15.60:0/3270889568 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fcae008aaa0 con 0x7fcaf00d1650 2024-09-12T01:38:41.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.269+0000 7fcaf5841640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcadc06be30 0x7fcadc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:41.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.269+0000 7fcaf5841640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcadc06be30 0x7fcadc06e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00b9d40 tx=0x7fcae4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:41.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.273+0000 7fcaeeffd640 1 -- 172.21.15.60:0/3270889568 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcae0020020 con 0x7fcaf00d1650 2024-09-12T01:38:41.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.447+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3270889568 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcaf00cdeb0 con 0x7fcadc06be30 2024-09-12T01:38:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.453+0000 7fcaeeffd640 1 -- 172.21.15.60:0/3270889568 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247180 (secure 0 0 0) 0x7fcaf00cdeb0 con 0x7fcadc06be30 2024-09-12T01:38:41.457 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:38:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.457+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3270889568 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcadc06be30 msgr2=0x7fcadc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.457+0000 7fcaf82a6640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcadc06be30 0x7fcadc06e2f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00b9d40 tx=0x7fcae4008040 comp rx=0 tx=0).stop 2024-09-12T01:38:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.457+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3270889568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00d1650 msgr2=0x7fcaf01f49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.457+0000 7fcaf82a6640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00d1650 0x7fcaf01f49b0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcae000c730 tx=0x7fcae000cbf0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.457+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3270889568 shutdown_connections 2024-09-12T01:38:41.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.457+0000 7fcaf82a6640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcadc06be30 0x7fcadc06e2f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.457+0000 7fcaf82a6640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcaf015e660 0x7fcaf014f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.457+0000 7fcaf82a6640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcaf00d3310 0x7fcaf015bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.457+0000 7fcaf82a6640 1 --2- 172.21.15.60:0/3270889568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcaf00d1650 0x7fcaf01f49b0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.457+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3270889568 >> 172.21.15.60:0/3270889568 conn(0x7fcaf00b6410 msgr2=0x7fcaf015cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.457+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3270889568 shutdown_connections 2024-09-12T01:38:41.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:41.457+0000 7fcaf82a6640 1 -- 172.21.15.60:0/3270889568 wait complete. 2024-09-12T01:38:41.468 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-12T01:38:40.294903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":163,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":30,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252732,"kb_used_data":7356,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721988,"statfs":{"total":773094113280,"available":772835315712,"internally_reserved":0,"allocated":7532544,"data_stored":3779573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001022"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.072994+0000","last_change":"2024-09-12T01:38:35.072994+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.072994+0000","last_undegraded":"2024-09-12T01:38:35.072994+0000","last_fullsized":"2024-09-12T01:38:35.072994+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066042+0000","last_change":"2024-09-12T01:38:35.066042+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066042+0000","last_undegraded":"2024-09-12T01:38:35.066042+0000","last_fullsized":"2024-09-12T01:38:35.066042+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065873+0000","last_change":"2024-09-12T01:38:35.065873+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065873+0000","last_undegraded":"2024-09-12T01:38:35.065873+0000","last_fullsized":"2024-09-12T01:38:35.065873+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065654+0000","last_change":"2024-09-12T01:38:35.065654+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065654+0000","last_undegraded":"2024-09-12T01:38:35.065654+0000","last_fullsized":"2024-09-12T01:38:35.065654+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061113+0000","last_change":"2024-09-12T01:38:35.061113+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061113+0000","last_undegraded":"2024-09-12T01:38:35.061113+0000","last_fullsized":"2024-09-12T01:38:35.061113+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.068161+0000","last_change":"2024-09-12T01:38:35.068161+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.068161+0000","last_undegraded":"2024-09-12T01:38:35.068161+0000","last_fullsized":"2024-09-12T01:38:35.068161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069805+0000","last_change":"2024-09-12T01:38:35.069805+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069805+0000","last_undegraded":"2024-09-12T01:38:35.069805+0000","last_fullsized":"2024-09-12T01:38:35.069805+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.072551+0000","last_change":"2024-09-12T01:38:35.072551+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.072551+0000","last_undegraded":"2024-09-12T01:38:35.072551+0000","last_fullsized":"2024-09-12T01:38:35.072551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065795+0000","last_change":"2024-09-12T01:38:35.065795+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065795+0000","last_undegraded":"2024-09-12T01:38:35.065795+0000","last_fullsized":"2024-09-12T01:38:35.065795+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062440+0000","last_change":"2024-09-12T01:38:35.062440+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062440+0000","last_undegraded":"2024-09-12T01:38:35.062440+0000","last_fullsized":"2024-09-12T01:38:35.062440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.075204+0000","last_change":"2024-09-12T01:38:35.075204+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.075204+0000","last_undegraded":"2024-09-12T01:38:35.075204+0000","last_fullsized":"2024-09-12T01:38:35.075204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084144+0000","last_change":"2024-09-12T01:38:36.074881+0000","last_active":"2024-09-12T01:38:37.084144+0000","last_peered":"2024-09-12T01:38:37.084144+0000","last_clean":"2024-09-12T01:38:37.084144+0000","last_became_active":"2024-09-12T01:38:36.074542+0000","last_became_peered":"2024-09-12T01:38:36.074542+0000","last_unstale":"2024-09-12T01:38:37.084144+0000","last_undegraded":"2024-09-12T01:38:37.084144+0000","last_fullsized":"2024-09-12T01:38:37.084144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:30.111060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064920+0000","last_change":"2024-09-12T01:38:35.064920+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064920+0000","last_undegraded":"2024-09-12T01:38:35.064920+0000","last_fullsized":"2024-09-12T01:38:35.064920+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084387+0000","last_change":"2024-09-12T01:38:36.082914+0000","last_active":"2024-09-12T01:38:37.084387+0000","last_peered":"2024-09-12T01:38:37.084387+0000","last_clean":"2024-09-12T01:38:37.084387+0000","last_became_active":"2024-09-12T01:38:36.082613+0000","last_became_peered":"2024-09-12T01:38:36.082613+0000","last_unstale":"2024-09-12T01:38:37.084387+0000","last_undegraded":"2024-09-12T01:38:37.084387+0000","last_fullsized":"2024-09-12T01:38:37.084387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:27.988221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083746+0000","last_change":"2024-09-12T01:38:36.075182+0000","last_active":"2024-09-12T01:38:37.083746+0000","last_peered":"2024-09-12T01:38:37.083746+0000","last_clean":"2024-09-12T01:38:37.083746+0000","last_became_active":"2024-09-12T01:38:36.074912+0000","last_became_peered":"2024-09-12T01:38:36.074912+0000","last_unstale":"2024-09-12T01:38:37.083746+0000","last_undegraded":"2024-09-12T01:38:37.083746+0000","last_fullsized":"2024-09-12T01:38:37.083746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:59.289373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.070031+0000","last_change":"2024-09-12T01:38:35.070031+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.070031+0000","last_undegraded":"2024-09-12T01:38:35.070031+0000","last_fullsized":"2024-09-12T01:38:35.070031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061032+0000","last_change":"2024-09-12T01:38:35.061032+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061032+0000","last_undegraded":"2024-09-12T01:38:35.061032+0000","last_fullsized":"2024-09-12T01:38:35.061032+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062004+0000","last_change":"2024-09-12T01:38:35.062004+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062004+0000","last_undegraded":"2024-09-12T01:38:35.062004+0000","last_fullsized":"2024-09-12T01:38:35.062004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.074726+0000","last_change":"2024-09-12T01:38:35.074726+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.074726+0000","last_undegraded":"2024-09-12T01:38:35.074726+0000","last_fullsized":"2024-09-12T01:38:35.074726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061122+0000","last_change":"2024-09-12T01:38:35.061122+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061122+0000","last_undegraded":"2024-09-12T01:38:35.061122+0000","last_fullsized":"2024-09-12T01:38:35.061122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065481+0000","last_change":"2024-09-12T01:38:35.065481+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065481+0000","last_undegraded":"2024-09-12T01:38:35.065481+0000","last_fullsized":"2024-09-12T01:38:35.065481+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.067729+0000","last_change":"2024-09-12T01:38:35.067729+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.067729+0000","last_undegraded":"2024-09-12T01:38:35.067729+0000","last_fullsized":"2024-09-12T01:38:35.067729+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069348+0000","last_change":"2024-09-12T01:38:35.069348+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069348+0000","last_undegraded":"2024-09-12T01:38:35.069348+0000","last_fullsized":"2024-09-12T01:38:35.069348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069615+0000","last_change":"2024-09-12T01:38:35.069615+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069615+0000","last_undegraded":"2024-09-12T01:38:35.069615+0000","last_fullsized":"2024-09-12T01:38:35.069615+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.068672+0000","last_change":"2024-09-12T01:38:35.068672+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.068672+0000","last_undegraded":"2024-09-12T01:38:35.068672+0000","last_fullsized":"2024-09-12T01:38:35.068672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.069144+0000","last_change":"2024-09-12T01:38:35.069144+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.069144+0000","last_undegraded":"2024-09-12T01:38:35.069144+0000","last_fullsized":"2024-09-12T01:38:35.069144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063084+0000","last_change":"2024-09-12T01:38:35.063084+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063084+0000","last_undegraded":"2024-09-12T01:38:35.063084+0000","last_fullsized":"2024-09-12T01:38:35.063084+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064633+0000","last_change":"2024-09-12T01:38:35.064633+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064633+0000","last_undegraded":"2024-09-12T01:38:35.064633+0000","last_fullsized":"2024-09-12T01:38:35.064633+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064224+0000","last_change":"2024-09-12T01:38:35.064224+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064224+0000","last_undegraded":"2024-09-12T01:38:35.064224+0000","last_fullsized":"2024-09-12T01:38:35.064224+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066229+0000","last_change":"2024-09-12T01:38:35.066229+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066229+0000","last_undegraded":"2024-09-12T01:38:35.066229+0000","last_fullsized":"2024-09-12T01:38:35.066229+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066181+0000","last_change":"2024-09-12T01:38:35.066181+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066181+0000","last_undegraded":"2024-09-12T01:38:35.066181+0000","last_fullsized":"2024-09-12T01:38:35.066181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064710+0000","last_change":"2024-09-12T01:38:35.064710+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064710+0000","last_undegraded":"2024-09-12T01:38:35.064710+0000","last_fullsized":"2024-09-12T01:38:35.064710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.067351+0000","last_change":"2024-09-12T01:38:35.067351+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.067351+0000","last_undegraded":"2024-09-12T01:38:35.067351+0000","last_fullsized":"2024-09-12T01:38:35.067351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.077725+0000","last_change":"2024-09-12T01:38:35.074236+0000","last_active":"2024-09-12T01:38:35.077725+0000","last_peered":"2024-09-12T01:38:35.077725+0000","last_clean":"2024-09-12T01:38:35.077725+0000","last_became_active":"2024-09-12T01:38:35.073953+0000","last_became_peered":"2024-09-12T01:38:35.073953+0000","last_unstale":"2024-09-12T01:38:35.077725+0000","last_undegraded":"2024-09-12T01:38:35.077725+0000","last_fullsized":"2024-09-12T01:38:35.077725+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:38.599797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065351+0000","last_change":"2024-09-12T01:38:35.065351+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065351+0000","last_undegraded":"2024-09-12T01:38:35.065351+0000","last_fullsized":"2024-09-12T01:38:35.065351+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079116+0000","last_change":"2024-09-12T01:38:35.074361+0000","last_active":"2024-09-12T01:38:35.079116+0000","last_peered":"2024-09-12T01:38:35.079116+0000","last_clean":"2024-09-12T01:38:35.079116+0000","last_became_active":"2024-09-12T01:38:35.074070+0000","last_became_peered":"2024-09-12T01:38:35.074070+0000","last_unstale":"2024-09-12T01:38:35.079116+0000","last_undegraded":"2024-09-12T01:38:35.079116+0000","last_fullsized":"2024-09-12T01:38:35.079116+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:59.874513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.067267+0000","last_change":"2024-09-12T01:38:35.067267+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.067267+0000","last_undegraded":"2024-09-12T01:38:35.067267+0000","last_fullsized":"2024-09-12T01:38:35.067267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081646+0000","last_change":"2024-09-12T01:38:35.081069+0000","last_active":"2024-09-12T01:38:35.081646+0000","last_peered":"2024-09-12T01:38:35.081646+0000","last_clean":"2024-09-12T01:38:35.081646+0000","last_became_active":"2024-09-12T01:38:35.080795+0000","last_became_peered":"2024-09-12T01:38:35.080795+0000","last_unstale":"2024-09-12T01:38:35.081646+0000","last_undegraded":"2024-09-12T01:38:35.081646+0000","last_fullsized":"2024-09-12T01:38:35.081646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:14.413274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063501+0000","last_change":"2024-09-12T01:38:35.063501+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063501+0000","last_undegraded":"2024-09-12T01:38:35.063501+0000","last_fullsized":"2024-09-12T01:38:35.063501+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.075330+0000","last_change":"2024-09-12T01:38:35.073070+0000","last_active":"2024-09-12T01:38:35.075330+0000","last_peered":"2024-09-12T01:38:35.075330+0000","last_clean":"2024-09-12T01:38:35.075330+0000","last_became_active":"2024-09-12T01:38:35.072758+0000","last_became_peered":"2024-09-12T01:38:35.072758+0000","last_unstale":"2024-09-12T01:38:35.075330+0000","last_undegraded":"2024-09-12T01:38:35.075330+0000","last_fullsized":"2024-09-12T01:38:35.075330+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:33.928163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065638+0000","last_change":"2024-09-12T01:38:35.065638+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065638+0000","last_undegraded":"2024-09-12T01:38:35.065638+0000","last_fullsized":"2024-09-12T01:38:35.065638+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084358+0000","last_change":"2024-09-12T01:38:35.077780+0000","last_active":"2024-09-12T01:38:37.084358+0000","last_peered":"2024-09-12T01:38:37.084358+0000","last_clean":"2024-09-12T01:38:37.084358+0000","last_became_active":"2024-09-12T01:38:35.077099+0000","last_became_peered":"2024-09-12T01:38:35.077099+0000","last_unstale":"2024-09-12T01:38:37.084358+0000","last_undegraded":"2024-09-12T01:38:37.084358+0000","last_fullsized":"2024-09-12T01:38:37.084358+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:26.304192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066679+0000","last_change":"2024-09-12T01:38:35.066679+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066679+0000","last_undegraded":"2024-09-12T01:38:35.066679+0000","last_fullsized":"2024-09-12T01:38:35.066679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.072294+0000","last_change":"2024-09-12T01:38:35.070367+0000","last_active":"2024-09-12T01:38:35.072294+0000","last_peered":"2024-09-12T01:38:35.072294+0000","last_clean":"2024-09-12T01:38:35.072294+0000","last_became_active":"2024-09-12T01:38:35.069659+0000","last_became_peered":"2024-09-12T01:38:35.069659+0000","last_unstale":"2024-09-12T01:38:35.072294+0000","last_undegraded":"2024-09-12T01:38:35.072294+0000","last_fullsized":"2024-09-12T01:38:35.072294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:32.567712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064825+0000","last_change":"2024-09-12T01:38:35.064825+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064825+0000","last_undegraded":"2024-09-12T01:38:35.064825+0000","last_fullsized":"2024-09-12T01:38:35.064825+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081973+0000","last_change":"2024-09-12T01:38:35.075279+0000","last_active":"2024-09-12T01:38:35.081973+0000","last_peered":"2024-09-12T01:38:35.081973+0000","last_clean":"2024-09-12T01:38:35.081973+0000","last_became_active":"2024-09-12T01:38:35.074995+0000","last_became_peered":"2024-09-12T01:38:35.074995+0000","last_unstale":"2024-09-12T01:38:35.081973+0000","last_undegraded":"2024-09-12T01:38:35.081973+0000","last_fullsized":"2024-09-12T01:38:35.081973+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:25.323158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084513+0000","last_change":"2024-09-12T01:38:36.082189+0000","last_active":"2024-09-12T01:38:37.084513+0000","last_peered":"2024-09-12T01:38:37.084513+0000","last_clean":"2024-09-12T01:38:37.084513+0000","last_became_active":"2024-09-12T01:38:36.081883+0000","last_became_peered":"2024-09-12T01:38:36.081883+0000","last_unstale":"2024-09-12T01:38:37.084513+0000","last_undegraded":"2024-09-12T01:38:37.084513+0000","last_fullsized":"2024-09-12T01:38:37.084513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084147+0000","last_change":"2024-09-12T01:38:35.075651+0000","last_active":"2024-09-12T01:38:37.084147+0000","last_peered":"2024-09-12T01:38:37.084147+0000","last_clean":"2024-09-12T01:38:37.084147+0000","last_became_active":"2024-09-12T01:38:35.075371+0000","last_became_peered":"2024-09-12T01:38:35.075371+0000","last_unstale":"2024-09-12T01:38:37.084147+0000","last_undegraded":"2024-09-12T01:38:37.084147+0000","last_fullsized":"2024-09-12T01:38:37.084147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:59.889104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061904+0000","last_change":"2024-09-12T01:38:35.061904+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061904+0000","last_undegraded":"2024-09-12T01:38:35.061904+0000","last_fullsized":"2024-09-12T01:38:35.061904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078503+0000","last_change":"2024-09-12T01:38:35.077055+0000","last_active":"2024-09-12T01:38:35.078503+0000","last_peered":"2024-09-12T01:38:35.078503+0000","last_clean":"2024-09-12T01:38:35.078503+0000","last_became_active":"2024-09-12T01:38:35.076779+0000","last_became_peered":"2024-09-12T01:38:35.076779+0000","last_unstale":"2024-09-12T01:38:35.078503+0000","last_undegraded":"2024-09-12T01:38:35.078503+0000","last_fullsized":"2024-09-12T01:38:35.078503+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:14.530732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065512+0000","last_change":"2024-09-12T01:38:35.065512+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065512+0000","last_undegraded":"2024-09-12T01:38:35.065512+0000","last_fullsized":"2024-09-12T01:38:35.065512+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079028+0000","last_change":"2024-09-12T01:38:35.075612+0000","last_active":"2024-09-12T01:38:35.079028+0000","last_peered":"2024-09-12T01:38:35.079028+0000","last_clean":"2024-09-12T01:38:35.079028+0000","last_became_active":"2024-09-12T01:38:35.075338+0000","last_became_peered":"2024-09-12T01:38:35.075338+0000","last_unstale":"2024-09-12T01:38:35.079028+0000","last_undegraded":"2024-09-12T01:38:35.079028+0000","last_fullsized":"2024-09-12T01:38:35.079028+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:17.701250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066826+0000","last_change":"2024-09-12T01:38:35.066826+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066826+0000","last_undegraded":"2024-09-12T01:38:35.066826+0000","last_fullsized":"2024-09-12T01:38:35.066826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"67'3","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084696+0000","last_change":"2024-09-12T01:38:35.077385+0000","last_active":"2024-09-12T01:38:37.084696+0000","last_peered":"2024-09-12T01:38:37.084696+0000","last_clean":"2024-09-12T01:38:37.084696+0000","last_became_active":"2024-09-12T01:38:35.077079+0000","last_became_peered":"2024-09-12T01:38:35.077079+0000","last_unstale":"2024-09-12T01:38:37.084696+0000","last_undegraded":"2024-09-12T01:38:37.084696+0000","last_fullsized":"2024-09-12T01:38:37.084696+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:41.926908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061071+0000","last_change":"2024-09-12T01:38:35.061071+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061071+0000","last_undegraded":"2024-09-12T01:38:35.061071+0000","last_fullsized":"2024-09-12T01:38:35.061071+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081914+0000","last_change":"2024-09-12T01:38:35.075264+0000","last_active":"2024-09-12T01:38:35.081914+0000","last_peered":"2024-09-12T01:38:35.081914+0000","last_clean":"2024-09-12T01:38:35.081914+0000","last_became_active":"2024-09-12T01:38:35.074931+0000","last_became_peered":"2024-09-12T01:38:35.074931+0000","last_unstale":"2024-09-12T01:38:35.081914+0000","last_undegraded":"2024-09-12T01:38:35.081914+0000","last_fullsized":"2024-09-12T01:38:35.081914+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:32.908068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066160+0000","last_change":"2024-09-12T01:38:35.066160+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066160+0000","last_undegraded":"2024-09-12T01:38:35.066160+0000","last_fullsized":"2024-09-12T01:38:35.066160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.082216+0000","last_change":"2024-09-12T01:38:35.076687+0000","last_active":"2024-09-12T01:38:35.082216+0000","last_peered":"2024-09-12T01:38:35.082216+0000","last_clean":"2024-09-12T01:38:35.082216+0000","last_became_active":"2024-09-12T01:38:35.076422+0000","last_became_peered":"2024-09-12T01:38:35.076422+0000","last_unstale":"2024-09-12T01:38:35.082216+0000","last_undegraded":"2024-09-12T01:38:35.082216+0000","last_fullsized":"2024-09-12T01:38:35.082216+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.044440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062325+0000","last_change":"2024-09-12T01:38:35.062325+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062325+0000","last_undegraded":"2024-09-12T01:38:35.062325+0000","last_fullsized":"2024-09-12T01:38:35.062325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.080062+0000","last_change":"2024-09-12T01:38:35.078231+0000","last_active":"2024-09-12T01:38:35.080062+0000","last_peered":"2024-09-12T01:38:35.080062+0000","last_clean":"2024-09-12T01:38:35.080062+0000","last_became_active":"2024-09-12T01:38:35.077610+0000","last_became_peered":"2024-09-12T01:38:35.077610+0000","last_unstale":"2024-09-12T01:38:35.080062+0000","last_undegraded":"2024-09-12T01:38:35.080062+0000","last_fullsized":"2024-09-12T01:38:35.080062+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:37.026677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061055+0000","last_change":"2024-09-12T01:38:35.061055+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061055+0000","last_undegraded":"2024-09-12T01:38:35.061055+0000","last_fullsized":"2024-09-12T01:38:35.061055+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.080026+0000","last_change":"2024-09-12T01:38:35.078333+0000","last_active":"2024-09-12T01:38:35.080026+0000","last_peered":"2024-09-12T01:38:35.080026+0000","last_clean":"2024-09-12T01:38:35.080026+0000","last_became_active":"2024-09-12T01:38:35.078039+0000","last_became_peered":"2024-09-12T01:38:35.078039+0000","last_unstale":"2024-09-12T01:38:35.080026+0000","last_undegraded":"2024-09-12T01:38:35.080026+0000","last_fullsized":"2024-09-12T01:38:35.080026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:46.609912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064823+0000","last_change":"2024-09-12T01:38:35.064823+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064823+0000","last_undegraded":"2024-09-12T01:38:35.064823+0000","last_fullsized":"2024-09-12T01:38:35.064823+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.072357+0000","last_change":"2024-09-12T01:38:35.070809+0000","last_active":"2024-09-12T01:38:35.072357+0000","last_peered":"2024-09-12T01:38:35.072357+0000","last_clean":"2024-09-12T01:38:35.072357+0000","last_became_active":"2024-09-12T01:38:35.070528+0000","last_became_peered":"2024-09-12T01:38:35.070528+0000","last_unstale":"2024-09-12T01:38:35.072357+0000","last_undegraded":"2024-09-12T01:38:35.072357+0000","last_fullsized":"2024-09-12T01:38:35.072357+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:31.440746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065588+0000","last_change":"2024-09-12T01:38:35.065588+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065588+0000","last_undegraded":"2024-09-12T01:38:35.065588+0000","last_fullsized":"2024-09-12T01:38:35.065588+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.081087+0000","last_change":"2024-09-12T01:38:35.080550+0000","last_active":"2024-09-12T01:38:35.081087+0000","last_peered":"2024-09-12T01:38:35.081087+0000","last_clean":"2024-09-12T01:38:35.081087+0000","last_became_active":"2024-09-12T01:38:35.080117+0000","last_became_peered":"2024-09-12T01:38:35.080117+0000","last_unstale":"2024-09-12T01:38:35.081087+0000","last_undegraded":"2024-09-12T01:38:35.081087+0000","last_fullsized":"2024-09-12T01:38:35.081087+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:11.987486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065086+0000","last_change":"2024-09-12T01:38:35.065086+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065086+0000","last_undegraded":"2024-09-12T01:38:35.065086+0000","last_fullsized":"2024-09-12T01:38:35.065086+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079010+0000","last_change":"2024-09-12T01:38:35.074670+0000","last_active":"2024-09-12T01:38:35.079010+0000","last_peered":"2024-09-12T01:38:35.079010+0000","last_clean":"2024-09-12T01:38:35.079010+0000","last_became_active":"2024-09-12T01:38:35.074402+0000","last_became_peered":"2024-09-12T01:38:35.074402+0000","last_unstale":"2024-09-12T01:38:35.079010+0000","last_undegraded":"2024-09-12T01:38:35.079010+0000","last_fullsized":"2024-09-12T01:38:35.079010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:30.611884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065164+0000","last_change":"2024-09-12T01:38:35.065164+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065164+0000","last_undegraded":"2024-09-12T01:38:35.065164+0000","last_fullsized":"2024-09-12T01:38:35.065164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.079738+0000","last_change":"2024-09-12T01:38:35.078432+0000","last_active":"2024-09-12T01:38:35.079738+0000","last_peered":"2024-09-12T01:38:35.079738+0000","last_clean":"2024-09-12T01:38:35.079738+0000","last_became_active":"2024-09-12T01:38:35.078189+0000","last_became_peered":"2024-09-12T01:38:35.078189+0000","last_unstale":"2024-09-12T01:38:35.079738+0000","last_undegraded":"2024-09-12T01:38:35.079738+0000","last_fullsized":"2024-09-12T01:38:35.079738+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:45.079322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.065108+0000","last_change":"2024-09-12T01:38:35.065108+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.065108+0000","last_undegraded":"2024-09-12T01:38:35.065108+0000","last_fullsized":"2024-09-12T01:38:35.065108+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078159+0000","last_change":"2024-09-12T01:38:35.077288+0000","last_active":"2024-09-12T01:38:35.078159+0000","last_peered":"2024-09-12T01:38:35.078159+0000","last_clean":"2024-09-12T01:38:35.078159+0000","last_became_active":"2024-09-12T01:38:35.077000+0000","last_became_peered":"2024-09-12T01:38:35.077000+0000","last_unstale":"2024-09-12T01:38:35.078159+0000","last_undegraded":"2024-09-12T01:38:35.078159+0000","last_fullsized":"2024-09-12T01:38:35.078159+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:43.274597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063962+0000","last_change":"2024-09-12T01:38:35.063962+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063962+0000","last_undegraded":"2024-09-12T01:38:35.063962+0000","last_fullsized":"2024-09-12T01:38:35.063962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.075521+0000","last_change":"2024-09-12T01:38:35.073096+0000","last_active":"2024-09-12T01:38:35.075521+0000","last_peered":"2024-09-12T01:38:35.075521+0000","last_clean":"2024-09-12T01:38:35.075521+0000","last_became_active":"2024-09-12T01:38:35.072772+0000","last_became_peered":"2024-09-12T01:38:35.072772+0000","last_unstale":"2024-09-12T01:38:35.075521+0000","last_undegraded":"2024-09-12T01:38:35.075521+0000","last_fullsized":"2024-09-12T01:38:35.075521+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:21.431272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064387+0000","last_change":"2024-09-12T01:38:35.064387+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064387+0000","last_undegraded":"2024-09-12T01:38:35.064387+0000","last_fullsized":"2024-09-12T01:38:35.064387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078961+0000","last_change":"2024-09-12T01:38:35.073899+0000","last_active":"2024-09-12T01:38:35.078961+0000","last_peered":"2024-09-12T01:38:35.078961+0000","last_clean":"2024-09-12T01:38:35.078961+0000","last_became_active":"2024-09-12T01:38:35.073595+0000","last_became_peered":"2024-09-12T01:38:35.073595+0000","last_unstale":"2024-09-12T01:38:35.078961+0000","last_undegraded":"2024-09-12T01:38:35.078961+0000","last_fullsized":"2024-09-12T01:38:35.078961+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:06.183845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083977+0000","last_change":"2024-09-12T01:38:36.076413+0000","last_active":"2024-09-12T01:38:37.083977+0000","last_peered":"2024-09-12T01:38:37.083977+0000","last_clean":"2024-09-12T01:38:37.083977+0000","last_became_active":"2024-09-12T01:38:36.076144+0000","last_became_peered":"2024-09-12T01:38:36.076144+0000","last_unstale":"2024-09-12T01:38:37.083977+0000","last_undegraded":"2024-09-12T01:38:37.083977+0000","last_fullsized":"2024-09-12T01:38:37.083977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:33.668164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.073293+0000","last_change":"2024-09-12T01:38:35.068662+0000","last_active":"2024-09-12T01:38:35.073293+0000","last_peered":"2024-09-12T01:38:35.073293+0000","last_clean":"2024-09-12T01:38:35.073293+0000","last_became_active":"2024-09-12T01:38:35.068382+0000","last_became_peered":"2024-09-12T01:38:35.068382+0000","last_unstale":"2024-09-12T01:38:35.073293+0000","last_undegraded":"2024-09-12T01:38:35.073293+0000","last_fullsized":"2024-09-12T01:38:35.073293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:44.611816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061175+0000","last_change":"2024-09-12T01:38:35.061175+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061175+0000","last_undegraded":"2024-09-12T01:38:35.061175+0000","last_fullsized":"2024-09-12T01:38:35.061175+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.080766+0000","last_change":"2024-09-12T01:38:35.080231+0000","last_active":"2024-09-12T01:38:35.080766+0000","last_peered":"2024-09-12T01:38:35.080766+0000","last_clean":"2024-09-12T01:38:35.080766+0000","last_became_active":"2024-09-12T01:38:35.079916+0000","last_became_peered":"2024-09-12T01:38:35.079916+0000","last_unstale":"2024-09-12T01:38:35.080766+0000","last_undegraded":"2024-09-12T01:38:35.080766+0000","last_fullsized":"2024-09-12T01:38:35.080766+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:37.381169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061522+0000","last_change":"2024-09-12T01:38:35.061522+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061522+0000","last_undegraded":"2024-09-12T01:38:35.061522+0000","last_fullsized":"2024-09-12T01:38:35.061522+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078413+0000","last_change":"2024-09-12T01:38:35.076006+0000","last_active":"2024-09-12T01:38:35.078413+0000","last_peered":"2024-09-12T01:38:35.078413+0000","last_clean":"2024-09-12T01:38:35.078413+0000","last_became_active":"2024-09-12T01:38:35.075736+0000","last_became_peered":"2024-09-12T01:38:35.075736+0000","last_unstale":"2024-09-12T01:38:35.078413+0000","last_undegraded":"2024-09-12T01:38:35.078413+0000","last_fullsized":"2024-09-12T01:38:35.078413+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:21.988687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064137+0000","last_change":"2024-09-12T01:38:35.064137+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064137+0000","last_undegraded":"2024-09-12T01:38:35.064137+0000","last_fullsized":"2024-09-12T01:38:35.064137+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084757+0000","last_change":"2024-09-12T01:38:35.074634+0000","last_active":"2024-09-12T01:38:37.084757+0000","last_peered":"2024-09-12T01:38:37.084757+0000","last_clean":"2024-09-12T01:38:37.084757+0000","last_became_active":"2024-09-12T01:38:35.074336+0000","last_became_peered":"2024-09-12T01:38:35.074336+0000","last_unstale":"2024-09-12T01:38:37.084757+0000","last_undegraded":"2024-09-12T01:38:37.084757+0000","last_fullsized":"2024-09-12T01:38:37.084757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:49.502156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061918+0000","last_change":"2024-09-12T01:38:35.061918+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061918+0000","last_undegraded":"2024-09-12T01:38:35.061918+0000","last_fullsized":"2024-09-12T01:38:35.061918+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084328+0000","last_change":"2024-09-12T01:38:35.077330+0000","last_active":"2024-09-12T01:38:37.084328+0000","last_peered":"2024-09-12T01:38:37.084328+0000","last_clean":"2024-09-12T01:38:37.084328+0000","last_became_active":"2024-09-12T01:38:35.077032+0000","last_became_peered":"2024-09-12T01:38:35.077032+0000","last_unstale":"2024-09-12T01:38:37.084328+0000","last_undegraded":"2024-09-12T01:38:37.084328+0000","last_fullsized":"2024-09-12T01:38:37.084328+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:09.008913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.061035+0000","last_change":"2024-09-12T01:38:35.061035+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.061035+0000","last_undegraded":"2024-09-12T01:38:35.061035+0000","last_fullsized":"2024-09-12T01:38:35.061035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084452+0000","last_change":"2024-09-12T01:38:35.077389+0000","last_active":"2024-09-12T01:38:37.084452+0000","last_peered":"2024-09-12T01:38:37.084452+0000","last_clean":"2024-09-12T01:38:37.084452+0000","last_became_active":"2024-09-12T01:38:35.076794+0000","last_became_peered":"2024-09-12T01:38:35.076794+0000","last_unstale":"2024-09-12T01:38:37.084452+0000","last_undegraded":"2024-09-12T01:38:37.084452+0000","last_fullsized":"2024-09-12T01:38:37.084452+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:30.729450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.064537+0000","last_change":"2024-09-12T01:38:35.064537+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.064537+0000","last_undegraded":"2024-09-12T01:38:35.064537+0000","last_fullsized":"2024-09-12T01:38:35.064537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.073255+0000","last_change":"2024-09-12T01:38:35.068171+0000","last_active":"2024-09-12T01:38:35.073255+0000","last_peered":"2024-09-12T01:38:35.073255+0000","last_clean":"2024-09-12T01:38:35.073255+0000","last_became_active":"2024-09-12T01:38:35.067831+0000","last_became_peered":"2024-09-12T01:38:35.067831+0000","last_unstale":"2024-09-12T01:38:35.073255+0000","last_undegraded":"2024-09-12T01:38:35.073255+0000","last_fullsized":"2024-09-12T01:38:35.073255+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:30.457568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.063877+0000","last_change":"2024-09-12T01:38:35.063877+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.063877+0000","last_undegraded":"2024-09-12T01:38:35.063877+0000","last_fullsized":"2024-09-12T01:38:35.063877+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.078983+0000","last_change":"2024-09-12T01:38:35.075288+0000","last_active":"2024-09-12T01:38:35.078983+0000","last_peered":"2024-09-12T01:38:35.078983+0000","last_clean":"2024-09-12T01:38:35.078983+0000","last_became_active":"2024-09-12T01:38:35.074950+0000","last_became_peered":"2024-09-12T01:38:35.074950+0000","last_unstale":"2024-09-12T01:38:35.078983+0000","last_undegraded":"2024-09-12T01:38:35.078983+0000","last_fullsized":"2024-09-12T01:38:35.078983+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:45.169458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.066578+0000","last_change":"2024-09-12T01:38:35.066578+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.066578+0000","last_undegraded":"2024-09-12T01:38:35.066578+0000","last_fullsized":"2024-09-12T01:38:35.066578+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.073746+0000","last_change":"2024-09-12T01:38:35.071787+0000","last_active":"2024-09-12T01:38:35.073746+0000","last_peered":"2024-09-12T01:38:35.073746+0000","last_clean":"2024-09-12T01:38:35.073746+0000","last_became_active":"2024-09-12T01:38:35.071434+0000","last_became_peered":"2024-09-12T01:38:35.071434+0000","last_unstale":"2024-09-12T01:38:35.073746+0000","last_undegraded":"2024-09-12T01:38:35.073746+0000","last_fullsized":"2024-09-12T01:38:35.073746+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.044440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2024-09-12T01:38:35.062214+0000","last_change":"2024-09-12T01:38:35.062214+0000","last_active":"2024-09-12T01:38:35.052271+0000","last_peered":"2024-09-12T01:38:35.052271+0000","last_clean":"2024-09-12T01:38:35.052271+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:38:35.062214+0000","last_undegraded":"2024-09-12T01:38:35.062214+0000","last_fullsized":"2024-09-12T01:38:35.062214+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.077058+0000","last_change":"2024-09-12T01:38:35.074670+0000","last_active":"2024-09-12T01:38:35.077058+0000","last_peered":"2024-09-12T01:38:35.077058+0000","last_clean":"2024-09-12T01:38:35.077058+0000","last_became_active":"2024-09-12T01:38:35.074326+0000","last_became_peered":"2024-09-12T01:38:35.074326+0000","last_unstale":"2024-09-12T01:38:35.077058+0000","last_undegraded":"2024-09-12T01:38:35.077058+0000","last_fullsized":"2024-09-12T01:38:35.077058+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:48.649110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":251,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.061582+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:38:35.061582+0000","last_peered":"2024-09-12T01:38:35.061582+0000","last_clean":"2024-09-12T01:38:35.061582+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:38:35.061582+0000","last_undegraded":"2024-09-12T01:38:35.061582+0000","last_fullsized":"2024-09-12T01:38:35.061582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509479,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":782336,"data_stored":320000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":794624,"data_stored":326267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509477,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1376256,"data_stored":910368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509477,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36124,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335716,"statfs":{"total":96636764160,"available":96599773184,"internally_reserved":0,"allocated":794624,"data_stored":326267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509477,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":794624,"data_stored":326267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509477,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1376256,"data_stored":910368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509478,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":782336,"data_stored":320000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":831488,"data_stored":340036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:44.473 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:45.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.133+0000 7f78b2749640 1 Processor -- start 2024-09-12T01:38:45.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.133+0000 7f78b2749640 1 -- start start 2024-09-12T01:38:45.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78b2749640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f78ac15c2b0 0x7f78ac0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78b2749640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78ac0b72f0 0x7f78ac15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78b2749640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78ac15fb10 con 0x7f78ac15f030 2024-09-12T01:38:45.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78b2749640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f78ac0b5900 con 0x7f78ac0b72f0 2024-09-12T01:38:45.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78b2749640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f78ac15f830 con 0x7f78ac15c2b0 2024-09-12T01:38:45.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78ab7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78ac0b72f0 0x7f78ac15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78ab7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78ac0b72f0 0x7f78ac15eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51384/0 (socket says 172.21.15.60:51384) 2024-09-12T01:38:45.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78ab7fe640 1 -- 172.21.15.60:0/903529287 learned_addr learned my addr 172.21.15.60:0/903529287 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:45.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78b0ce6640 1 --1- 172.21.15.60:0/903529287 >> v1:172.21.15.60:6789/0 conn(0x7f78ac15f030 0x7f78ac06f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:32860/0 (socket says 172.21.15.60:32860) 2024-09-12T01:38:45.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78abfff640 1 --2- 172.21.15.60:0/903529287 >> v2:172.21.15.105:3300/0 conn(0x7f78ac15c2b0 0x7f78ac0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78ab7fe640 1 -- 172.21.15.60:0/903529287 >> v2:172.21.15.105:3300/0 conn(0x7f78ac15c2b0 msgr2=0x7f78ac0b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:45.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78ab7fe640 1 --2- 172.21.15.60:0/903529287 >> v2:172.21.15.105:3300/0 conn(0x7f78ac15c2b0 0x7f78ac0b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78ab7fe640 1 -- 172.21.15.60:0/903529287 >> v1:172.21.15.60:6789/0 conn(0x7f78ac15f030 legacy=0x7f78ac06f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78ab7fe640 1 -- 172.21.15.60:0/903529287 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac06ce30 con 0x7f78ac0b72f0 2024-09-12T01:38:45.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.134+0000 7f78abfff640 1 --2- 172.21.15.60:0/903529287 >> v2:172.21.15.105:3300/0 conn(0x7f78ac15c2b0 0x7f78ac0b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:45.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.135+0000 7f78ab7fe640 1 --2- 172.21.15.60:0/903529287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac0b72f0 0x7f78ac15eaf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f78ac06f040 tx=0x7f78a002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c903bc9d04b6e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:45.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.135+0000 7f78aaffd640 1 -- 172.21.15.60:0/903529287 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0037070 con 0x7f78ac0b72f0 2024-09-12T01:38:45.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.135+0000 7f78aaffd640 1 -- 172.21.15.60:0/903529287 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78a0032440 con 0x7f78ac0b72f0 2024-09-12T01:38:45.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.135+0000 7f78aaffd640 1 -- 172.21.15.60:0/903529287 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0032810 con 0x7f78ac0b72f0 2024-09-12T01:38:45.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.136+0000 7f78b2749640 1 -- 172.21.15.60:0/903529287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac0b72f0 msgr2=0x7f78ac15eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.136+0000 7f78b2749640 1 --2- 172.21.15.60:0/903529287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac0b72f0 0x7f78ac15eaf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f78ac06f040 tx=0x7f78a002a270 comp rx=0 tx=0).stop 2024-09-12T01:38:45.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.136+0000 7f78b2749640 1 -- 172.21.15.60:0/903529287 shutdown_connections 2024-09-12T01:38:45.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.136+0000 7f78b2749640 1 --2- 172.21.15.60:0/903529287 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac0b72f0 0x7f78ac15eaf0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.136+0000 7f78b2749640 1 --2- 172.21.15.60:0/903529287 >> v2:172.21.15.105:3300/0 conn(0x7f78ac15c2b0 0x7f78ac0b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.136+0000 7f78b2749640 1 -- 172.21.15.60:0/903529287 >> 172.21.15.60:0/903529287 conn(0x7f78ac0b4240 msgr2=0x7f78ac0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:45.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.136+0000 7f78b2749640 1 -- 172.21.15.60:0/903529287 shutdown_connections 2024-09-12T01:38:45.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.136+0000 7f78b2749640 1 -- 172.21.15.60:0/903529287 wait complete. 2024-09-12T01:38:45.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.137+0000 7f78b2749640 1 Processor -- start 2024-09-12T01:38:45.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.137+0000 7f78b2749640 1 -- start start 2024-09-12T01:38:45.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78b2749640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac0b72f0 0x7f78ac14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78b2749640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78ac15c2b0 0x7f78ac149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78b2749640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78ac15f030 0x7f78ac0cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78b2749640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac0b7760 con 0x7f78ac0b72f0 2024-09-12T01:38:45.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78b2749640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f78ac06d3f0 con 0x7f78ac15f030 2024-09-12T01:38:45.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78b2749640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f78ac15f480 con 0x7f78ac15c2b0 2024-09-12T01:38:45.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78abfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac0b72f0 0x7f78ac14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78abfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac0b72f0 0x7f78ac14d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51396/0 (socket says 172.21.15.60:51396) 2024-09-12T01:38:45.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78abfff640 1 -- 172.21.15.60:0/1036486668 learned_addr learned my addr 172.21.15.60:0/1036486668 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:45.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78b0ce6640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78ac15f030 0x7f78ac0cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78ab7fe640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78ac15c2b0 0x7f78ac149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78abfff640 1 -- 172.21.15.60:0/1036486668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78ac15c2b0 msgr2=0x7f78ac149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78abfff640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78ac15c2b0 0x7f78ac149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78abfff640 1 -- 172.21.15.60:0/1036486668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78ac15f030 msgr2=0x7f78ac0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78abfff640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78ac15f030 0x7f78ac0cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.138+0000 7f78abfff640 1 -- 172.21.15.60:0/1036486668 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ac14d5e0 con 0x7f78ac0b72f0 2024-09-12T01:38:45.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.139+0000 7f78abfff640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac0b72f0 0x7f78ac14d0a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f789c00c820 tx=0x7f789c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:45.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.139+0000 7f78a8ff9640 1 -- 172.21.15.60:0/1036486668 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c015070 con 0x7f78ac0b72f0 2024-09-12T01:38:45.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.139+0000 7f78a8ff9640 1 -- 172.21.15.60:0/1036486668 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f789c0079d0 con 0x7f78ac0b72f0 2024-09-12T01:38:45.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.139+0000 7f78b2749640 1 -- 172.21.15.60:0/1036486668 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ac14a310 con 0x7f78ac0b72f0 2024-09-12T01:38:45.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.139+0000 7f78a8ff9640 1 -- 172.21.15.60:0/1036486668 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f789c007da0 con 0x7f78ac0b72f0 2024-09-12T01:38:45.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.139+0000 7f78b2749640 1 -- 172.21.15.60:0/1036486668 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ac14ada0 con 0x7f78ac0b72f0 2024-09-12T01:38:45.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.140+0000 7f78b2749640 1 -- 172.21.15.60:0/1036486668 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78ac0d2520 con 0x7f78ac0b72f0 2024-09-12T01:38:45.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.141+0000 7f78a8ff9640 1 -- 172.21.15.60:0/1036486668 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f789c018070 con 0x7f78ac0b72f0 2024-09-12T01:38:45.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.141+0000 7f78a8ff9640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f789806be30 0x7f789806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.141+0000 7f78ab7fe640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f789806be30 0x7f789806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.141+0000 7f78a8ff9640 1 -- 172.21.15.60:0/1036486668 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f789c08ad90 con 0x7f78ac0b72f0 2024-09-12T01:38:45.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.142+0000 7f78ab7fe640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f789806be30 0x7f789806e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f78a0034000 tx=0x7f78a002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:45.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.146+0000 7f78a8ff9640 1 -- 172.21.15.60:0/1036486668 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78ac14d5e0 con 0x7f78ac0b72f0 2024-09-12T01:38:45.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.316+0000 7f78b2749640 1 -- 172.21.15.60:0/1036486668 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78ac15eaf0 con 0x7f789806be30 2024-09-12T01:38:45.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.322+0000 7f78a8ff9640 1 -- 172.21.15.60:0/1036486668 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252060 (secure 0 0 0) 0x7f78ac15eaf0 con 0x7f789806be30 2024-09-12T01:38:45.326 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:45.327 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:38:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.325+0000 7f78b2749640 1 -- 172.21.15.60:0/1036486668 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f789806be30 msgr2=0x7f789806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.325+0000 7f78b2749640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f789806be30 0x7f789806e2f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f78a0034000 tx=0x7f78a002e000 comp rx=0 tx=0).stop 2024-09-12T01:38:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.325+0000 7f78b2749640 1 -- 172.21.15.60:0/1036486668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac0b72f0 msgr2=0x7f78ac14d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.325+0000 7f78b2749640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac0b72f0 0x7f78ac14d0a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f789c00c820 tx=0x7f789c00cc20 comp rx=0 tx=0).stop 2024-09-12T01:38:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.325+0000 7f78b2749640 1 -- 172.21.15.60:0/1036486668 shutdown_connections 2024-09-12T01:38:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.325+0000 7f78b2749640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78ac15f030 0x7f78ac0cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.325+0000 7f78b2749640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f789806be30 0x7f789806e2f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.325+0000 7f78b2749640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78ac15c2b0 0x7f78ac149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.325+0000 7f78b2749640 1 --2- 172.21.15.60:0/1036486668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78ac0b72f0 0x7f78ac14d0a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.325+0000 7f78b2749640 1 -- 172.21.15.60:0/1036486668 >> 172.21.15.60:0/1036486668 conn(0x7f78ac0b4240 msgr2=0x7f78ac15ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:45.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.326+0000 7f78b2749640 1 -- 172.21.15.60:0/1036486668 shutdown_connections 2024-09-12T01:38:45.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.326+0000 7f78b2749640 1 -- 172.21.15.60:0/1036486668 wait complete. 2024-09-12T01:38:45.337 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-12T01:38:44.296077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252984,"kb_used_data":7624,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721736,"statfs":{"total":773094113280,"available":772835057664,"internally_reserved":0,"allocated":7806976,"data_stored":3900292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.235727"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023811+0000","last_change":"2024-09-12T01:38:36.090651+0000","last_active":"2024-09-12T01:38:38.023811+0000","last_peered":"2024-09-12T01:38:38.023811+0000","last_clean":"2024-09-12T01:38:38.023811+0000","last_became_active":"2024-09-12T01:38:36.090088+0000","last_became_peered":"2024-09-12T01:38:36.090088+0000","last_unstale":"2024-09-12T01:38:38.023811+0000","last_undegraded":"2024-09-12T01:38:38.023811+0000","last_fullsized":"2024-09-12T01:38:38.023811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:33.690229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046992+0000","last_change":"2024-09-12T01:38:36.082304+0000","last_active":"2024-09-12T01:38:38.046992+0000","last_peered":"2024-09-12T01:38:38.046992+0000","last_clean":"2024-09-12T01:38:38.046992+0000","last_became_active":"2024-09-12T01:38:36.080970+0000","last_became_peered":"2024-09-12T01:38:36.080970+0000","last_unstale":"2024-09-12T01:38:38.046992+0000","last_undegraded":"2024-09-12T01:38:38.046992+0000","last_fullsized":"2024-09-12T01:38:38.046992+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:45.618446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046604+0000","last_change":"2024-09-12T01:38:36.078769+0000","last_active":"2024-09-12T01:38:38.046604+0000","last_peered":"2024-09-12T01:38:38.046604+0000","last_clean":"2024-09-12T01:38:38.046604+0000","last_became_active":"2024-09-12T01:38:36.078511+0000","last_became_peered":"2024-09-12T01:38:36.078511+0000","last_unstale":"2024-09-12T01:38:38.046604+0000","last_undegraded":"2024-09-12T01:38:38.046604+0000","last_fullsized":"2024-09-12T01:38:38.046604+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:04.412174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046653+0000","last_change":"2024-09-12T01:38:36.077354+0000","last_active":"2024-09-12T01:38:38.046653+0000","last_peered":"2024-09-12T01:38:38.046653+0000","last_clean":"2024-09-12T01:38:38.046653+0000","last_became_active":"2024-09-12T01:38:36.077083+0000","last_became_peered":"2024-09-12T01:38:36.077083+0000","last_unstale":"2024-09-12T01:38:38.046653+0000","last_undegraded":"2024-09-12T01:38:38.046653+0000","last_fullsized":"2024-09-12T01:38:38.046653+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:13.480834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046871+0000","last_change":"2024-09-12T01:38:36.082571+0000","last_active":"2024-09-12T01:38:38.046871+0000","last_peered":"2024-09-12T01:38:38.046871+0000","last_clean":"2024-09-12T01:38:38.046871+0000","last_became_active":"2024-09-12T01:38:36.082304+0000","last_became_peered":"2024-09-12T01:38:36.082304+0000","last_unstale":"2024-09-12T01:38:38.046871+0000","last_undegraded":"2024-09-12T01:38:38.046871+0000","last_fullsized":"2024-09-12T01:38:38.046871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:24.648839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.078761+0000","last_change":"2024-09-12T01:38:36.074552+0000","last_active":"2024-09-12T01:38:37.078761+0000","last_peered":"2024-09-12T01:38:37.078761+0000","last_clean":"2024-09-12T01:38:37.078761+0000","last_became_active":"2024-09-12T01:38:36.074269+0000","last_became_peered":"2024-09-12T01:38:36.074269+0000","last_unstale":"2024-09-12T01:38:37.078761+0000","last_undegraded":"2024-09-12T01:38:37.078761+0000","last_fullsized":"2024-09-12T01:38:37.078761+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:41.445813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046049+0000","last_change":"2024-09-12T01:38:36.088899+0000","last_active":"2024-09-12T01:38:38.046049+0000","last_peered":"2024-09-12T01:38:38.046049+0000","last_clean":"2024-09-12T01:38:38.046049+0000","last_became_active":"2024-09-12T01:38:36.088578+0000","last_became_peered":"2024-09-12T01:38:36.088578+0000","last_unstale":"2024-09-12T01:38:38.046049+0000","last_undegraded":"2024-09-12T01:38:38.046049+0000","last_fullsized":"2024-09-12T01:38:38.046049+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:22.920235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023254+0000","last_change":"2024-09-12T01:38:36.084485+0000","last_active":"2024-09-12T01:38:38.023254+0000","last_peered":"2024-09-12T01:38:38.023254+0000","last_clean":"2024-09-12T01:38:38.023254+0000","last_became_active":"2024-09-12T01:38:36.084189+0000","last_became_peered":"2024-09-12T01:38:36.084189+0000","last_unstale":"2024-09-12T01:38:38.023254+0000","last_undegraded":"2024-09-12T01:38:38.023254+0000","last_fullsized":"2024-09-12T01:38:38.023254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:17.272343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046870+0000","last_change":"2024-09-12T01:38:36.076191+0000","last_active":"2024-09-12T01:38:38.046870+0000","last_peered":"2024-09-12T01:38:38.046870+0000","last_clean":"2024-09-12T01:38:38.046870+0000","last_became_active":"2024-09-12T01:38:36.075904+0000","last_became_peered":"2024-09-12T01:38:36.075904+0000","last_unstale":"2024-09-12T01:38:38.046870+0000","last_undegraded":"2024-09-12T01:38:38.046870+0000","last_fullsized":"2024-09-12T01:38:38.046870+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:15.960067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046565+0000","last_change":"2024-09-12T01:38:36.088742+0000","last_active":"2024-09-12T01:38:38.046565+0000","last_peered":"2024-09-12T01:38:38.046565+0000","last_clean":"2024-09-12T01:38:38.046565+0000","last_became_active":"2024-09-12T01:38:36.088425+0000","last_became_peered":"2024-09-12T01:38:36.088425+0000","last_unstale":"2024-09-12T01:38:38.046565+0000","last_undegraded":"2024-09-12T01:38:38.046565+0000","last_fullsized":"2024-09-12T01:38:38.046565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:44.281227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023764+0000","last_change":"2024-09-12T01:38:36.084139+0000","last_active":"2024-09-12T01:38:38.023764+0000","last_peered":"2024-09-12T01:38:38.023764+0000","last_clean":"2024-09-12T01:38:38.023764+0000","last_became_active":"2024-09-12T01:38:36.083878+0000","last_became_peered":"2024-09-12T01:38:36.083878+0000","last_unstale":"2024-09-12T01:38:38.023764+0000","last_undegraded":"2024-09-12T01:38:38.023764+0000","last_fullsized":"2024-09-12T01:38:38.023764+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:47.539120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084144+0000","last_change":"2024-09-12T01:38:36.074881+0000","last_active":"2024-09-12T01:38:37.084144+0000","last_peered":"2024-09-12T01:38:37.084144+0000","last_clean":"2024-09-12T01:38:37.084144+0000","last_became_active":"2024-09-12T01:38:36.074542+0000","last_became_peered":"2024-09-12T01:38:36.074542+0000","last_unstale":"2024-09-12T01:38:37.084144+0000","last_undegraded":"2024-09-12T01:38:37.084144+0000","last_fullsized":"2024-09-12T01:38:37.084144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:30.111060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046932+0000","last_change":"2024-09-12T01:38:36.078945+0000","last_active":"2024-09-12T01:38:38.046932+0000","last_peered":"2024-09-12T01:38:38.046932+0000","last_clean":"2024-09-12T01:38:38.046932+0000","last_became_active":"2024-09-12T01:38:36.078191+0000","last_became_peered":"2024-09-12T01:38:36.078191+0000","last_unstale":"2024-09-12T01:38:38.046932+0000","last_undegraded":"2024-09-12T01:38:38.046932+0000","last_fullsized":"2024-09-12T01:38:38.046932+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:13.437382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084387+0000","last_change":"2024-09-12T01:38:36.082914+0000","last_active":"2024-09-12T01:38:37.084387+0000","last_peered":"2024-09-12T01:38:37.084387+0000","last_clean":"2024-09-12T01:38:37.084387+0000","last_became_active":"2024-09-12T01:38:36.082613+0000","last_became_peered":"2024-09-12T01:38:36.082613+0000","last_unstale":"2024-09-12T01:38:37.084387+0000","last_undegraded":"2024-09-12T01:38:37.084387+0000","last_fullsized":"2024-09-12T01:38:37.084387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:27.988221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083746+0000","last_change":"2024-09-12T01:38:36.075182+0000","last_active":"2024-09-12T01:38:37.083746+0000","last_peered":"2024-09-12T01:38:37.083746+0000","last_clean":"2024-09-12T01:38:37.083746+0000","last_became_active":"2024-09-12T01:38:36.074912+0000","last_became_peered":"2024-09-12T01:38:36.074912+0000","last_unstale":"2024-09-12T01:38:37.083746+0000","last_undegraded":"2024-09-12T01:38:37.083746+0000","last_fullsized":"2024-09-12T01:38:37.083746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:59.289373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023253+0000","last_change":"2024-09-12T01:38:36.078785+0000","last_active":"2024-09-12T01:38:38.023253+0000","last_peered":"2024-09-12T01:38:38.023253+0000","last_clean":"2024-09-12T01:38:38.023253+0000","last_became_active":"2024-09-12T01:38:36.078516+0000","last_became_peered":"2024-09-12T01:38:36.078516+0000","last_unstale":"2024-09-12T01:38:38.023253+0000","last_undegraded":"2024-09-12T01:38:38.023253+0000","last_fullsized":"2024-09-12T01:38:38.023253+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:27.464270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047302+0000","last_change":"2024-09-12T01:38:36.080121+0000","last_active":"2024-09-12T01:38:38.047302+0000","last_peered":"2024-09-12T01:38:38.047302+0000","last_clean":"2024-09-12T01:38:38.047302+0000","last_became_active":"2024-09-12T01:38:36.079829+0000","last_became_peered":"2024-09-12T01:38:36.079829+0000","last_unstale":"2024-09-12T01:38:38.047302+0000","last_undegraded":"2024-09-12T01:38:38.047302+0000","last_fullsized":"2024-09-12T01:38:38.047302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:53.428600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047080+0000","last_change":"2024-09-12T01:38:36.081031+0000","last_active":"2024-09-12T01:38:38.047080+0000","last_peered":"2024-09-12T01:38:38.047080+0000","last_clean":"2024-09-12T01:38:38.047080+0000","last_became_active":"2024-09-12T01:38:36.080691+0000","last_became_peered":"2024-09-12T01:38:36.080691+0000","last_unstale":"2024-09-12T01:38:38.047080+0000","last_undegraded":"2024-09-12T01:38:38.047080+0000","last_fullsized":"2024-09-12T01:38:38.047080+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:34.187848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023620+0000","last_change":"2024-09-12T01:38:36.086662+0000","last_active":"2024-09-12T01:38:38.023620+0000","last_peered":"2024-09-12T01:38:38.023620+0000","last_clean":"2024-09-12T01:38:38.023620+0000","last_became_active":"2024-09-12T01:38:36.086362+0000","last_became_peered":"2024-09-12T01:38:36.086362+0000","last_unstale":"2024-09-12T01:38:38.023620+0000","last_undegraded":"2024-09-12T01:38:38.023620+0000","last_fullsized":"2024-09-12T01:38:38.023620+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:30.354702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047147+0000","last_change":"2024-09-12T01:38:36.072177+0000","last_active":"2024-09-12T01:38:38.047147+0000","last_peered":"2024-09-12T01:38:38.047147+0000","last_clean":"2024-09-12T01:38:38.047147+0000","last_became_active":"2024-09-12T01:38:36.071912+0000","last_became_peered":"2024-09-12T01:38:36.071912+0000","last_unstale":"2024-09-12T01:38:38.047147+0000","last_undegraded":"2024-09-12T01:38:38.047147+0000","last_fullsized":"2024-09-12T01:38:38.047147+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:10.341177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046447+0000","last_change":"2024-09-12T01:38:36.075323+0000","last_active":"2024-09-12T01:38:38.046447+0000","last_peered":"2024-09-12T01:38:38.046447+0000","last_clean":"2024-09-12T01:38:38.046447+0000","last_became_active":"2024-09-12T01:38:36.075031+0000","last_became_peered":"2024-09-12T01:38:36.075031+0000","last_unstale":"2024-09-12T01:38:38.046447+0000","last_undegraded":"2024-09-12T01:38:38.046447+0000","last_fullsized":"2024-09-12T01:38:38.046447+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:53.035636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.078790+0000","last_change":"2024-09-12T01:38:36.080267+0000","last_active":"2024-09-12T01:38:37.078790+0000","last_peered":"2024-09-12T01:38:37.078790+0000","last_clean":"2024-09-12T01:38:37.078790+0000","last_became_active":"2024-09-12T01:38:36.079968+0000","last_became_peered":"2024-09-12T01:38:36.079968+0000","last_unstale":"2024-09-12T01:38:37.078790+0000","last_undegraded":"2024-09-12T01:38:37.078790+0000","last_fullsized":"2024-09-12T01:38:37.078790+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:19.973347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046323+0000","last_change":"2024-09-12T01:38:36.085233+0000","last_active":"2024-09-12T01:38:38.046323+0000","last_peered":"2024-09-12T01:38:38.046323+0000","last_clean":"2024-09-12T01:38:38.046323+0000","last_became_active":"2024-09-12T01:38:36.084962+0000","last_became_peered":"2024-09-12T01:38:36.084962+0000","last_unstale":"2024-09-12T01:38:38.046323+0000","last_undegraded":"2024-09-12T01:38:38.046323+0000","last_fullsized":"2024-09-12T01:38:38.046323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:22.437903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023465+0000","last_change":"2024-09-12T01:38:36.076218+0000","last_active":"2024-09-12T01:38:38.023465+0000","last_peered":"2024-09-12T01:38:38.023465+0000","last_clean":"2024-09-12T01:38:38.023465+0000","last_became_active":"2024-09-12T01:38:36.075914+0000","last_became_peered":"2024-09-12T01:38:36.075914+0000","last_unstale":"2024-09-12T01:38:38.023465+0000","last_undegraded":"2024-09-12T01:38:38.023465+0000","last_fullsized":"2024-09-12T01:38:38.023465+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:55.066356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046175+0000","last_change":"2024-09-12T01:38:36.077827+0000","last_active":"2024-09-12T01:38:38.046175+0000","last_peered":"2024-09-12T01:38:38.046175+0000","last_clean":"2024-09-12T01:38:38.046175+0000","last_became_active":"2024-09-12T01:38:36.077510+0000","last_became_peered":"2024-09-12T01:38:36.077510+0000","last_unstale":"2024-09-12T01:38:38.046175+0000","last_undegraded":"2024-09-12T01:38:38.046175+0000","last_fullsized":"2024-09-12T01:38:38.046175+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:26.329789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023734+0000","last_change":"2024-09-12T01:38:36.082950+0000","last_active":"2024-09-12T01:38:38.023734+0000","last_peered":"2024-09-12T01:38:38.023734+0000","last_clean":"2024-09-12T01:38:38.023734+0000","last_became_active":"2024-09-12T01:38:36.082692+0000","last_became_peered":"2024-09-12T01:38:36.082692+0000","last_unstale":"2024-09-12T01:38:38.023734+0000","last_undegraded":"2024-09-12T01:38:38.023734+0000","last_fullsized":"2024-09-12T01:38:38.023734+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:43.009402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047432+0000","last_change":"2024-09-12T01:38:36.076756+0000","last_active":"2024-09-12T01:38:38.047432+0000","last_peered":"2024-09-12T01:38:38.047432+0000","last_clean":"2024-09-12T01:38:38.047432+0000","last_became_active":"2024-09-12T01:38:36.076481+0000","last_became_peered":"2024-09-12T01:38:36.076481+0000","last_unstale":"2024-09-12T01:38:38.047432+0000","last_undegraded":"2024-09-12T01:38:38.047432+0000","last_fullsized":"2024-09-12T01:38:38.047432+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:01.153170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046329+0000","last_change":"2024-09-12T01:38:36.079994+0000","last_active":"2024-09-12T01:38:38.046329+0000","last_peered":"2024-09-12T01:38:38.046329+0000","last_clean":"2024-09-12T01:38:38.046329+0000","last_became_active":"2024-09-12T01:38:36.077301+0000","last_became_peered":"2024-09-12T01:38:36.077301+0000","last_unstale":"2024-09-12T01:38:38.046329+0000","last_undegraded":"2024-09-12T01:38:38.046329+0000","last_fullsized":"2024-09-12T01:38:38.046329+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:09:50.613445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046899+0000","last_change":"2024-09-12T01:38:36.083571+0000","last_active":"2024-09-12T01:38:38.046899+0000","last_peered":"2024-09-12T01:38:38.046899+0000","last_clean":"2024-09-12T01:38:38.046899+0000","last_became_active":"2024-09-12T01:38:36.083052+0000","last_became_peered":"2024-09-12T01:38:36.083052+0000","last_unstale":"2024-09-12T01:38:38.046899+0000","last_undegraded":"2024-09-12T01:38:38.046899+0000","last_fullsized":"2024-09-12T01:38:38.046899+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:43.098450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023288+0000","last_change":"2024-09-12T01:38:36.082026+0000","last_active":"2024-09-12T01:38:38.023288+0000","last_peered":"2024-09-12T01:38:38.023288+0000","last_clean":"2024-09-12T01:38:38.023288+0000","last_became_active":"2024-09-12T01:38:36.081762+0000","last_became_peered":"2024-09-12T01:38:36.081762+0000","last_unstale":"2024-09-12T01:38:38.023288+0000","last_undegraded":"2024-09-12T01:38:38.023288+0000","last_fullsized":"2024-09-12T01:38:38.023288+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:54.991254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046616+0000","last_change":"2024-09-12T01:38:36.080852+0000","last_active":"2024-09-12T01:38:38.046616+0000","last_peered":"2024-09-12T01:38:38.046616+0000","last_clean":"2024-09-12T01:38:38.046616+0000","last_became_active":"2024-09-12T01:38:36.079680+0000","last_became_peered":"2024-09-12T01:38:36.079680+0000","last_unstale":"2024-09-12T01:38:38.046616+0000","last_undegraded":"2024-09-12T01:38:38.046616+0000","last_fullsized":"2024-09-12T01:38:38.046616+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:41.445813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046226+0000","last_change":"2024-09-12T01:38:36.078984+0000","last_active":"2024-09-12T01:38:38.046226+0000","last_peered":"2024-09-12T01:38:38.046226+0000","last_clean":"2024-09-12T01:38:38.046226+0000","last_became_active":"2024-09-12T01:38:36.078349+0000","last_became_peered":"2024-09-12T01:38:36.078349+0000","last_unstale":"2024-09-12T01:38:38.046226+0000","last_undegraded":"2024-09-12T01:38:38.046226+0000","last_fullsized":"2024-09-12T01:38:38.046226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:30.703964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023862+0000","last_change":"2024-09-12T01:38:36.090670+0000","last_active":"2024-09-12T01:38:38.023862+0000","last_peered":"2024-09-12T01:38:38.023862+0000","last_clean":"2024-09-12T01:38:38.023862+0000","last_became_active":"2024-09-12T01:38:36.090374+0000","last_became_peered":"2024-09-12T01:38:36.090374+0000","last_unstale":"2024-09-12T01:38:38.023862+0000","last_undegraded":"2024-09-12T01:38:38.023862+0000","last_fullsized":"2024-09-12T01:38:38.023862+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:20.951227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"67'4","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.079128+0000","last_change":"2024-09-12T01:38:35.074236+0000","last_active":"2024-09-12T01:38:37.079128+0000","last_peered":"2024-09-12T01:38:37.079128+0000","last_clean":"2024-09-12T01:38:37.079128+0000","last_became_active":"2024-09-12T01:38:35.073953+0000","last_became_peered":"2024-09-12T01:38:35.073953+0000","last_unstale":"2024-09-12T01:38:37.079128+0000","last_undegraded":"2024-09-12T01:38:37.079128+0000","last_fullsized":"2024-09-12T01:38:37.079128+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:42.460059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047029+0000","last_change":"2024-09-12T01:38:36.082482+0000","last_active":"2024-09-12T01:38:38.047029+0000","last_peered":"2024-09-12T01:38:38.047029+0000","last_clean":"2024-09-12T01:38:38.047029+0000","last_became_active":"2024-09-12T01:38:36.082170+0000","last_became_peered":"2024-09-12T01:38:36.082170+0000","last_unstale":"2024-09-12T01:38:38.047029+0000","last_undegraded":"2024-09-12T01:38:38.047029+0000","last_fullsized":"2024-09-12T01:38:38.047029+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:07.190475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047196+0000","last_change":"2024-09-12T01:38:35.074361+0000","last_active":"2024-09-12T01:38:38.047196+0000","last_peered":"2024-09-12T01:38:38.047196+0000","last_clean":"2024-09-12T01:38:38.047196+0000","last_became_active":"2024-09-12T01:38:35.074070+0000","last_became_peered":"2024-09-12T01:38:35.074070+0000","last_unstale":"2024-09-12T01:38:38.047196+0000","last_undegraded":"2024-09-12T01:38:38.047196+0000","last_fullsized":"2024-09-12T01:38:38.047196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:22.996926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.079044+0000","last_change":"2024-09-12T01:38:36.084344+0000","last_active":"2024-09-12T01:38:37.079044+0000","last_peered":"2024-09-12T01:38:37.079044+0000","last_clean":"2024-09-12T01:38:37.079044+0000","last_became_active":"2024-09-12T01:38:36.084079+0000","last_became_peered":"2024-09-12T01:38:36.084079+0000","last_unstale":"2024-09-12T01:38:37.079044+0000","last_undegraded":"2024-09-12T01:38:37.079044+0000","last_fullsized":"2024-09-12T01:38:37.079044+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:00.881143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023738+0000","last_change":"2024-09-12T01:38:35.081069+0000","last_active":"2024-09-12T01:38:38.023738+0000","last_peered":"2024-09-12T01:38:38.023738+0000","last_clean":"2024-09-12T01:38:38.023738+0000","last_became_active":"2024-09-12T01:38:35.080795+0000","last_became_peered":"2024-09-12T01:38:35.080795+0000","last_unstale":"2024-09-12T01:38:38.023738+0000","last_undegraded":"2024-09-12T01:38:38.023738+0000","last_fullsized":"2024-09-12T01:38:38.023738+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:23.642209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046290+0000","last_change":"2024-09-12T01:38:36.077322+0000","last_active":"2024-09-12T01:38:38.046290+0000","last_peered":"2024-09-12T01:38:38.046290+0000","last_clean":"2024-09-12T01:38:38.046290+0000","last_became_active":"2024-09-12T01:38:36.076917+0000","last_became_peered":"2024-09-12T01:38:36.076917+0000","last_unstale":"2024-09-12T01:38:38.046290+0000","last_undegraded":"2024-09-12T01:38:38.046290+0000","last_fullsized":"2024-09-12T01:38:38.046290+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:25.051071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.079029+0000","last_change":"2024-09-12T01:38:35.073070+0000","last_active":"2024-09-12T01:38:37.079029+0000","last_peered":"2024-09-12T01:38:37.079029+0000","last_clean":"2024-09-12T01:38:37.079029+0000","last_became_active":"2024-09-12T01:38:35.072758+0000","last_became_peered":"2024-09-12T01:38:35.072758+0000","last_unstale":"2024-09-12T01:38:37.079029+0000","last_undegraded":"2024-09-12T01:38:37.079029+0000","last_fullsized":"2024-09-12T01:38:37.079029+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:19.737959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023363+0000","last_change":"2024-09-12T01:38:36.083412+0000","last_active":"2024-09-12T01:38:38.023363+0000","last_peered":"2024-09-12T01:38:38.023363+0000","last_clean":"2024-09-12T01:38:38.023363+0000","last_became_active":"2024-09-12T01:38:36.083119+0000","last_became_peered":"2024-09-12T01:38:36.083119+0000","last_unstale":"2024-09-12T01:38:38.023363+0000","last_undegraded":"2024-09-12T01:38:38.023363+0000","last_fullsized":"2024-09-12T01:38:38.023363+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:25.431345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084358+0000","last_change":"2024-09-12T01:38:35.077780+0000","last_active":"2024-09-12T01:38:37.084358+0000","last_peered":"2024-09-12T01:38:37.084358+0000","last_clean":"2024-09-12T01:38:37.084358+0000","last_became_active":"2024-09-12T01:38:35.077099+0000","last_became_peered":"2024-09-12T01:38:35.077099+0000","last_unstale":"2024-09-12T01:38:37.084358+0000","last_undegraded":"2024-09-12T01:38:37.084358+0000","last_fullsized":"2024-09-12T01:38:37.084358+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:26.304192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.078894+0000","last_change":"2024-09-12T01:38:36.085228+0000","last_active":"2024-09-12T01:38:37.078894+0000","last_peered":"2024-09-12T01:38:37.078894+0000","last_clean":"2024-09-12T01:38:37.078894+0000","last_became_active":"2024-09-12T01:38:36.084743+0000","last_became_peered":"2024-09-12T01:38:36.084743+0000","last_unstale":"2024-09-12T01:38:37.078894+0000","last_undegraded":"2024-09-12T01:38:37.078894+0000","last_fullsized":"2024-09-12T01:38:37.078894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:31.464198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.045952+0000","last_change":"2024-09-12T01:38:35.070367+0000","last_active":"2024-09-12T01:38:38.045952+0000","last_peered":"2024-09-12T01:38:38.045952+0000","last_clean":"2024-09-12T01:38:38.045952+0000","last_became_active":"2024-09-12T01:38:35.069659+0000","last_became_peered":"2024-09-12T01:38:35.069659+0000","last_unstale":"2024-09-12T01:38:38.045952+0000","last_undegraded":"2024-09-12T01:38:38.045952+0000","last_fullsized":"2024-09-12T01:38:38.045952+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:16.910747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083753+0000","last_change":"2024-09-12T01:38:36.081549+0000","last_active":"2024-09-12T01:38:37.083753+0000","last_peered":"2024-09-12T01:38:37.083753+0000","last_clean":"2024-09-12T01:38:37.083753+0000","last_became_active":"2024-09-12T01:38:36.081274+0000","last_became_peered":"2024-09-12T01:38:36.081274+0000","last_unstale":"2024-09-12T01:38:37.083753+0000","last_undegraded":"2024-09-12T01:38:37.083753+0000","last_fullsized":"2024-09-12T01:38:37.083753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:41.233208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084024+0000","last_change":"2024-09-12T01:38:35.075279+0000","last_active":"2024-09-12T01:38:37.084024+0000","last_peered":"2024-09-12T01:38:37.084024+0000","last_clean":"2024-09-12T01:38:37.084024+0000","last_became_active":"2024-09-12T01:38:35.074995+0000","last_became_peered":"2024-09-12T01:38:35.074995+0000","last_unstale":"2024-09-12T01:38:37.084024+0000","last_undegraded":"2024-09-12T01:38:37.084024+0000","last_fullsized":"2024-09-12T01:38:37.084024+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:33.928163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084513+0000","last_change":"2024-09-12T01:38:36.082189+0000","last_active":"2024-09-12T01:38:37.084513+0000","last_peered":"2024-09-12T01:38:37.084513+0000","last_clean":"2024-09-12T01:38:37.084513+0000","last_became_active":"2024-09-12T01:38:36.081883+0000","last_became_peered":"2024-09-12T01:38:36.081883+0000","last_unstale":"2024-09-12T01:38:37.084513+0000","last_undegraded":"2024-09-12T01:38:37.084513+0000","last_fullsized":"2024-09-12T01:38:37.084513+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:47.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084147+0000","last_change":"2024-09-12T01:38:35.075651+0000","last_active":"2024-09-12T01:38:37.084147+0000","last_peered":"2024-09-12T01:38:37.084147+0000","last_clean":"2024-09-12T01:38:37.084147+0000","last_became_active":"2024-09-12T01:38:35.075371+0000","last_became_peered":"2024-09-12T01:38:35.075371+0000","last_unstale":"2024-09-12T01:38:37.084147+0000","last_undegraded":"2024-09-12T01:38:37.084147+0000","last_fullsized":"2024-09-12T01:38:37.084147+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:35:59.889104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046619+0000","last_change":"2024-09-12T01:38:36.086195+0000","last_active":"2024-09-12T01:38:38.046619+0000","last_peered":"2024-09-12T01:38:38.046619+0000","last_clean":"2024-09-12T01:38:38.046619+0000","last_became_active":"2024-09-12T01:38:36.085849+0000","last_became_peered":"2024-09-12T01:38:36.085849+0000","last_unstale":"2024-09-12T01:38:38.046619+0000","last_undegraded":"2024-09-12T01:38:38.046619+0000","last_fullsized":"2024-09-12T01:38:38.046619+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:43.466689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023644+0000","last_change":"2024-09-12T01:38:35.077055+0000","last_active":"2024-09-12T01:38:38.023644+0000","last_peered":"2024-09-12T01:38:38.023644+0000","last_clean":"2024-09-12T01:38:38.023644+0000","last_became_active":"2024-09-12T01:38:35.076779+0000","last_became_peered":"2024-09-12T01:38:35.076779+0000","last_unstale":"2024-09-12T01:38:38.023644+0000","last_undegraded":"2024-09-12T01:38:38.023644+0000","last_fullsized":"2024-09-12T01:38:38.023644+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:16.541643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047003+0000","last_change":"2024-09-12T01:38:36.080412+0000","last_active":"2024-09-12T01:38:38.047003+0000","last_peered":"2024-09-12T01:38:38.047003+0000","last_clean":"2024-09-12T01:38:38.047003+0000","last_became_active":"2024-09-12T01:38:36.080097+0000","last_became_peered":"2024-09-12T01:38:36.080097+0000","last_unstale":"2024-09-12T01:38:38.047003+0000","last_undegraded":"2024-09-12T01:38:38.047003+0000","last_fullsized":"2024-09-12T01:38:38.047003+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:00.881143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047084+0000","last_change":"2024-09-12T01:38:35.075612+0000","last_active":"2024-09-12T01:38:38.047084+0000","last_peered":"2024-09-12T01:38:38.047084+0000","last_clean":"2024-09-12T01:38:38.047084+0000","last_became_active":"2024-09-12T01:38:35.075338+0000","last_became_peered":"2024-09-12T01:38:35.075338+0000","last_unstale":"2024-09-12T01:38:38.047084+0000","last_undegraded":"2024-09-12T01:38:38.047084+0000","last_fullsized":"2024-09-12T01:38:38.047084+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:25.323158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023404+0000","last_change":"2024-09-12T01:38:36.083212+0000","last_active":"2024-09-12T01:38:38.023404+0000","last_peered":"2024-09-12T01:38:38.023404+0000","last_clean":"2024-09-12T01:38:38.023404+0000","last_became_active":"2024-09-12T01:38:36.082910+0000","last_became_peered":"2024-09-12T01:38:36.082910+0000","last_unstale":"2024-09-12T01:38:38.023404+0000","last_undegraded":"2024-09-12T01:38:38.023404+0000","last_fullsized":"2024-09-12T01:38:38.023404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:18.296692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"67'3","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084696+0000","last_change":"2024-09-12T01:38:35.077385+0000","last_active":"2024-09-12T01:38:37.084696+0000","last_peered":"2024-09-12T01:38:37.084696+0000","last_clean":"2024-09-12T01:38:37.084696+0000","last_became_active":"2024-09-12T01:38:35.077079+0000","last_became_peered":"2024-09-12T01:38:35.077079+0000","last_unstale":"2024-09-12T01:38:37.084696+0000","last_undegraded":"2024-09-12T01:38:37.084696+0000","last_fullsized":"2024-09-12T01:38:37.084696+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:41.926908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047561+0000","last_change":"2024-09-12T01:38:36.076723+0000","last_active":"2024-09-12T01:38:38.047561+0000","last_peered":"2024-09-12T01:38:38.047561+0000","last_clean":"2024-09-12T01:38:38.047561+0000","last_became_active":"2024-09-12T01:38:36.076424+0000","last_became_peered":"2024-09-12T01:38:36.076424+0000","last_unstale":"2024-09-12T01:38:38.047561+0000","last_undegraded":"2024-09-12T01:38:38.047561+0000","last_fullsized":"2024-09-12T01:38:38.047561+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:58.418965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"67'6","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084607+0000","last_change":"2024-09-12T01:38:35.075264+0000","last_active":"2024-09-12T01:38:37.084607+0000","last_peered":"2024-09-12T01:38:37.084607+0000","last_clean":"2024-09-12T01:38:37.084607+0000","last_became_active":"2024-09-12T01:38:35.074931+0000","last_became_peered":"2024-09-12T01:38:35.074931+0000","last_unstale":"2024-09-12T01:38:37.084607+0000","last_undegraded":"2024-09-12T01:38:37.084607+0000","last_fullsized":"2024-09-12T01:38:37.084607+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:21.431272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.078962+0000","last_change":"2024-09-12T01:38:36.073506+0000","last_active":"2024-09-12T01:38:37.078962+0000","last_peered":"2024-09-12T01:38:37.078962+0000","last_clean":"2024-09-12T01:38:37.078962+0000","last_became_active":"2024-09-12T01:38:36.073157+0000","last_became_peered":"2024-09-12T01:38:36.073157+0000","last_unstale":"2024-09-12T01:38:37.078962+0000","last_undegraded":"2024-09-12T01:38:37.078962+0000","last_fullsized":"2024-09-12T01:38:37.078962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:45.618446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084037+0000","last_change":"2024-09-12T01:38:35.076687+0000","last_active":"2024-09-12T01:38:37.084037+0000","last_peered":"2024-09-12T01:38:37.084037+0000","last_clean":"2024-09-12T01:38:37.084037+0000","last_became_active":"2024-09-12T01:38:35.076422+0000","last_became_peered":"2024-09-12T01:38:35.076422+0000","last_unstale":"2024-09-12T01:38:37.084037+0000","last_undegraded":"2024-09-12T01:38:37.084037+0000","last_fullsized":"2024-09-12T01:38:37.084037+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:38.599797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046164+0000","last_change":"2024-09-12T01:38:36.083730+0000","last_active":"2024-09-12T01:38:38.046164+0000","last_peered":"2024-09-12T01:38:38.046164+0000","last_clean":"2024-09-12T01:38:38.046164+0000","last_became_active":"2024-09-12T01:38:36.083464+0000","last_became_peered":"2024-09-12T01:38:36.083464+0000","last_unstale":"2024-09-12T01:38:38.046164+0000","last_undegraded":"2024-09-12T01:38:38.046164+0000","last_fullsized":"2024-09-12T01:38:38.046164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:33.914698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046083+0000","last_change":"2024-09-12T01:38:35.078231+0000","last_active":"2024-09-12T01:38:38.046083+0000","last_peered":"2024-09-12T01:38:38.046083+0000","last_clean":"2024-09-12T01:38:38.046083+0000","last_became_active":"2024-09-12T01:38:35.077610+0000","last_became_peered":"2024-09-12T01:38:35.077610+0000","last_unstale":"2024-09-12T01:38:38.046083+0000","last_undegraded":"2024-09-12T01:38:38.046083+0000","last_fullsized":"2024-09-12T01:38:38.046083+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:12.474204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046700+0000","last_change":"2024-09-12T01:38:36.071730+0000","last_active":"2024-09-12T01:38:38.046700+0000","last_peered":"2024-09-12T01:38:38.046700+0000","last_clean":"2024-09-12T01:38:38.046700+0000","last_became_active":"2024-09-12T01:38:36.071303+0000","last_became_peered":"2024-09-12T01:38:36.071303+0000","last_unstale":"2024-09-12T01:38:38.046700+0000","last_undegraded":"2024-09-12T01:38:38.046700+0000","last_fullsized":"2024-09-12T01:38:38.046700+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:17.548273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046396+0000","last_change":"2024-09-12T01:38:35.078333+0000","last_active":"2024-09-12T01:38:38.046396+0000","last_peered":"2024-09-12T01:38:38.046396+0000","last_clean":"2024-09-12T01:38:38.046396+0000","last_became_active":"2024-09-12T01:38:35.078039+0000","last_became_peered":"2024-09-12T01:38:35.078039+0000","last_unstale":"2024-09-12T01:38:38.046396+0000","last_undegraded":"2024-09-12T01:38:38.046396+0000","last_fullsized":"2024-09-12T01:38:38.046396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:28.822429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047327+0000","last_change":"2024-09-12T01:38:36.084632+0000","last_active":"2024-09-12T01:38:38.047327+0000","last_peered":"2024-09-12T01:38:38.047327+0000","last_clean":"2024-09-12T01:38:38.047327+0000","last_became_active":"2024-09-12T01:38:36.084324+0000","last_became_peered":"2024-09-12T01:38:36.084324+0000","last_unstale":"2024-09-12T01:38:38.047327+0000","last_undegraded":"2024-09-12T01:38:38.047327+0000","last_fullsized":"2024-09-12T01:38:38.047327+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:46.176089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"67'8","reported_seq":22,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.045806+0000","last_change":"2024-09-12T01:38:35.070809+0000","last_active":"2024-09-12T01:38:38.045806+0000","last_peered":"2024-09-12T01:38:38.045806+0000","last_clean":"2024-09-12T01:38:38.045806+0000","last_became_active":"2024-09-12T01:38:35.070528+0000","last_became_peered":"2024-09-12T01:38:35.070528+0000","last_unstale":"2024-09-12T01:38:38.045806+0000","last_undegraded":"2024-09-12T01:38:38.045806+0000","last_fullsized":"2024-09-12T01:38:38.045806+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:44.787490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047046+0000","last_change":"2024-09-12T01:38:36.076285+0000","last_active":"2024-09-12T01:38:38.047046+0000","last_peered":"2024-09-12T01:38:38.047046+0000","last_clean":"2024-09-12T01:38:38.047046+0000","last_became_active":"2024-09-12T01:38:36.074850+0000","last_became_peered":"2024-09-12T01:38:36.074850+0000","last_unstale":"2024-09-12T01:38:38.047046+0000","last_undegraded":"2024-09-12T01:38:38.047046+0000","last_fullsized":"2024-09-12T01:38:38.047046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:24.003557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023680+0000","last_change":"2024-09-12T01:38:35.080550+0000","last_active":"2024-09-12T01:38:38.023680+0000","last_peered":"2024-09-12T01:38:38.023680+0000","last_clean":"2024-09-12T01:38:38.023680+0000","last_became_active":"2024-09-12T01:38:35.080117+0000","last_became_peered":"2024-09-12T01:38:35.080117+0000","last_unstale":"2024-09-12T01:38:38.023680+0000","last_undegraded":"2024-09-12T01:38:38.023680+0000","last_fullsized":"2024-09-12T01:38:38.023680+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:33.181218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047030+0000","last_change":"2024-09-12T01:38:36.076234+0000","last_active":"2024-09-12T01:38:38.047030+0000","last_peered":"2024-09-12T01:38:38.047030+0000","last_clean":"2024-09-12T01:38:38.047030+0000","last_became_active":"2024-09-12T01:38:36.075939+0000","last_became_peered":"2024-09-12T01:38:36.075939+0000","last_unstale":"2024-09-12T01:38:38.047030+0000","last_undegraded":"2024-09-12T01:38:38.047030+0000","last_fullsized":"2024-09-12T01:38:38.047030+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:39.510377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047131+0000","last_change":"2024-09-12T01:38:35.074670+0000","last_active":"2024-09-12T01:38:38.047131+0000","last_peered":"2024-09-12T01:38:38.047131+0000","last_clean":"2024-09-12T01:38:38.047131+0000","last_became_active":"2024-09-12T01:38:35.074402+0000","last_became_peered":"2024-09-12T01:38:35.074402+0000","last_unstale":"2024-09-12T01:38:38.047131+0000","last_undegraded":"2024-09-12T01:38:38.047131+0000","last_fullsized":"2024-09-12T01:38:38.047131+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:33.928163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046707+0000","last_change":"2024-09-12T01:38:36.076170+0000","last_active":"2024-09-12T01:38:38.046707+0000","last_peered":"2024-09-12T01:38:38.046707+0000","last_clean":"2024-09-12T01:38:38.046707+0000","last_became_active":"2024-09-12T01:38:36.075887+0000","last_became_peered":"2024-09-12T01:38:36.075887+0000","last_unstale":"2024-09-12T01:38:38.046707+0000","last_undegraded":"2024-09-12T01:38:38.046707+0000","last_fullsized":"2024-09-12T01:38:38.046707+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:39.224884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046775+0000","last_change":"2024-09-12T01:38:35.078432+0000","last_active":"2024-09-12T01:38:38.046775+0000","last_peered":"2024-09-12T01:38:38.046775+0000","last_clean":"2024-09-12T01:38:38.046775+0000","last_became_active":"2024-09-12T01:38:35.078189+0000","last_became_peered":"2024-09-12T01:38:35.078189+0000","last_unstale":"2024-09-12T01:38:38.046775+0000","last_undegraded":"2024-09-12T01:38:38.046775+0000","last_fullsized":"2024-09-12T01:38:38.046775+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:21.913605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047164+0000","last_change":"2024-09-12T01:38:36.083683+0000","last_active":"2024-09-12T01:38:38.047164+0000","last_peered":"2024-09-12T01:38:38.047164+0000","last_clean":"2024-09-12T01:38:38.047164+0000","last_became_active":"2024-09-12T01:38:36.083392+0000","last_became_peered":"2024-09-12T01:38:36.083392+0000","last_unstale":"2024-09-12T01:38:38.047164+0000","last_undegraded":"2024-09-12T01:38:38.047164+0000","last_fullsized":"2024-09-12T01:38:38.047164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:31.618514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.079132+0000","last_change":"2024-09-12T01:38:35.077288+0000","last_active":"2024-09-12T01:38:37.079132+0000","last_peered":"2024-09-12T01:38:37.079132+0000","last_clean":"2024-09-12T01:38:37.079132+0000","last_became_active":"2024-09-12T01:38:35.077000+0000","last_became_peered":"2024-09-12T01:38:35.077000+0000","last_unstale":"2024-09-12T01:38:37.079132+0000","last_undegraded":"2024-09-12T01:38:37.079132+0000","last_fullsized":"2024-09-12T01:38:37.079132+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:40.226578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083933+0000","last_change":"2024-09-12T01:38:36.077370+0000","last_active":"2024-09-12T01:38:37.083933+0000","last_peered":"2024-09-12T01:38:37.083933+0000","last_clean":"2024-09-12T01:38:37.083933+0000","last_became_active":"2024-09-12T01:38:36.077102+0000","last_became_peered":"2024-09-12T01:38:36.077102+0000","last_unstale":"2024-09-12T01:38:37.083933+0000","last_undegraded":"2024-09-12T01:38:37.083933+0000","last_fullsized":"2024-09-12T01:38:37.083933+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:18.139694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.078998+0000","last_change":"2024-09-12T01:38:35.073096+0000","last_active":"2024-09-12T01:38:37.078998+0000","last_peered":"2024-09-12T01:38:37.078998+0000","last_clean":"2024-09-12T01:38:37.078998+0000","last_became_active":"2024-09-12T01:38:35.072772+0000","last_became_peered":"2024-09-12T01:38:35.072772+0000","last_unstale":"2024-09-12T01:38:37.078998+0000","last_undegraded":"2024-09-12T01:38:37.078998+0000","last_fullsized":"2024-09-12T01:38:37.078998+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:06.182904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083928+0000","last_change":"2024-09-12T01:38:36.075929+0000","last_active":"2024-09-12T01:38:37.083928+0000","last_peered":"2024-09-12T01:38:37.083928+0000","last_clean":"2024-09-12T01:38:37.083928+0000","last_became_active":"2024-09-12T01:38:36.075655+0000","last_became_peered":"2024-09-12T01:38:36.075655+0000","last_unstale":"2024-09-12T01:38:37.083928+0000","last_undegraded":"2024-09-12T01:38:37.083928+0000","last_fullsized":"2024-09-12T01:38:37.083928+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:07.189534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046677+0000","last_change":"2024-09-12T01:38:35.073899+0000","last_active":"2024-09-12T01:38:38.046677+0000","last_peered":"2024-09-12T01:38:38.046677+0000","last_clean":"2024-09-12T01:38:38.046677+0000","last_became_active":"2024-09-12T01:38:35.073595+0000","last_became_peered":"2024-09-12T01:38:35.073595+0000","last_unstale":"2024-09-12T01:38:38.046677+0000","last_undegraded":"2024-09-12T01:38:38.046677+0000","last_fullsized":"2024-09-12T01:38:38.046677+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:32.908068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.083977+0000","last_change":"2024-09-12T01:38:36.076413+0000","last_active":"2024-09-12T01:38:37.083977+0000","last_peered":"2024-09-12T01:38:37.083977+0000","last_clean":"2024-09-12T01:38:37.083977+0000","last_became_active":"2024-09-12T01:38:36.076144+0000","last_became_peered":"2024-09-12T01:38:36.076144+0000","last_unstale":"2024-09-12T01:38:37.083977+0000","last_undegraded":"2024-09-12T01:38:37.083977+0000","last_fullsized":"2024-09-12T01:38:37.083977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:33.668164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046462+0000","last_change":"2024-09-12T01:38:35.068662+0000","last_active":"2024-09-12T01:38:38.046462+0000","last_peered":"2024-09-12T01:38:38.046462+0000","last_clean":"2024-09-12T01:38:38.046462+0000","last_became_active":"2024-09-12T01:38:35.068382+0000","last_became_peered":"2024-09-12T01:38:35.068382+0000","last_unstale":"2024-09-12T01:38:38.046462+0000","last_undegraded":"2024-09-12T01:38:38.046462+0000","last_fullsized":"2024-09-12T01:38:38.046462+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:38.503747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047131+0000","last_change":"2024-09-12T01:38:36.076012+0000","last_active":"2024-09-12T01:38:38.047131+0000","last_peered":"2024-09-12T01:38:38.047131+0000","last_clean":"2024-09-12T01:38:38.047131+0000","last_became_active":"2024-09-12T01:38:36.075737+0000","last_became_peered":"2024-09-12T01:38:36.075737+0000","last_unstale":"2024-09-12T01:38:38.047131+0000","last_undegraded":"2024-09-12T01:38:38.047131+0000","last_fullsized":"2024-09-12T01:38:38.047131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:51.163444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023758+0000","last_change":"2024-09-12T01:38:35.080231+0000","last_active":"2024-09-12T01:38:38.023758+0000","last_peered":"2024-09-12T01:38:38.023758+0000","last_clean":"2024-09-12T01:38:38.023758+0000","last_became_active":"2024-09-12T01:38:35.079916+0000","last_became_peered":"2024-09-12T01:38:35.079916+0000","last_unstale":"2024-09-12T01:38:38.023758+0000","last_undegraded":"2024-09-12T01:38:38.023758+0000","last_fullsized":"2024-09-12T01:38:38.023758+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:50.156814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046322+0000","last_change":"2024-09-12T01:38:36.087159+0000","last_active":"2024-09-12T01:38:38.046322+0000","last_peered":"2024-09-12T01:38:38.046322+0000","last_clean":"2024-09-12T01:38:38.046322+0000","last_became_active":"2024-09-12T01:38:36.086664+0000","last_became_peered":"2024-09-12T01:38:36.086664+0000","last_unstale":"2024-09-12T01:38:38.046322+0000","last_undegraded":"2024-09-12T01:38:38.046322+0000","last_fullsized":"2024-09-12T01:38:38.046322+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:34.934793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"67'1","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023831+0000","last_change":"2024-09-12T01:38:35.076006+0000","last_active":"2024-09-12T01:38:38.023831+0000","last_peered":"2024-09-12T01:38:38.023831+0000","last_clean":"2024-09-12T01:38:38.023831+0000","last_became_active":"2024-09-12T01:38:35.075736+0000","last_became_peered":"2024-09-12T01:38:35.075736+0000","last_unstale":"2024-09-12T01:38:38.023831+0000","last_undegraded":"2024-09-12T01:38:38.023831+0000","last_fullsized":"2024-09-12T01:38:38.023831+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:24.766780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046814+0000","last_change":"2024-09-12T01:38:36.075471+0000","last_active":"2024-09-12T01:38:38.046814+0000","last_peered":"2024-09-12T01:38:38.046814+0000","last_clean":"2024-09-12T01:38:38.046814+0000","last_became_active":"2024-09-12T01:38:36.074649+0000","last_became_peered":"2024-09-12T01:38:36.074649+0000","last_unstale":"2024-09-12T01:38:38.046814+0000","last_undegraded":"2024-09-12T01:38:38.046814+0000","last_fullsized":"2024-09-12T01:38:38.046814+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:31.464198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084757+0000","last_change":"2024-09-12T01:38:35.074634+0000","last_active":"2024-09-12T01:38:37.084757+0000","last_peered":"2024-09-12T01:38:37.084757+0000","last_clean":"2024-09-12T01:38:37.084757+0000","last_became_active":"2024-09-12T01:38:35.074336+0000","last_became_peered":"2024-09-12T01:38:35.074336+0000","last_unstale":"2024-09-12T01:38:37.084757+0000","last_undegraded":"2024-09-12T01:38:37.084757+0000","last_fullsized":"2024-09-12T01:38:37.084757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:49.502156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046460+0000","last_change":"2024-09-12T01:38:36.080788+0000","last_active":"2024-09-12T01:38:38.046460+0000","last_peered":"2024-09-12T01:38:38.046460+0000","last_clean":"2024-09-12T01:38:38.046460+0000","last_became_active":"2024-09-12T01:38:36.080492+0000","last_became_peered":"2024-09-12T01:38:36.080492+0000","last_unstale":"2024-09-12T01:38:38.046460+0000","last_undegraded":"2024-09-12T01:38:38.046460+0000","last_fullsized":"2024-09-12T01:38:38.046460+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:39.606428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084328+0000","last_change":"2024-09-12T01:38:35.077330+0000","last_active":"2024-09-12T01:38:37.084328+0000","last_peered":"2024-09-12T01:38:37.084328+0000","last_clean":"2024-09-12T01:38:37.084328+0000","last_became_active":"2024-09-12T01:38:35.077032+0000","last_became_peered":"2024-09-12T01:38:35.077032+0000","last_unstale":"2024-09-12T01:38:37.084328+0000","last_undegraded":"2024-09-12T01:38:37.084328+0000","last_fullsized":"2024-09-12T01:38:37.084328+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:09.008913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047194+0000","last_change":"2024-09-12T01:38:36.079443+0000","last_active":"2024-09-12T01:38:38.047194+0000","last_peered":"2024-09-12T01:38:38.047194+0000","last_clean":"2024-09-12T01:38:38.047194+0000","last_became_active":"2024-09-12T01:38:36.079131+0000","last_became_peered":"2024-09-12T01:38:36.079131+0000","last_unstale":"2024-09-12T01:38:38.047194+0000","last_undegraded":"2024-09-12T01:38:38.047194+0000","last_fullsized":"2024-09-12T01:38:38.047194+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:23.300687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084452+0000","last_change":"2024-09-12T01:38:35.077389+0000","last_active":"2024-09-12T01:38:37.084452+0000","last_peered":"2024-09-12T01:38:37.084452+0000","last_clean":"2024-09-12T01:38:37.084452+0000","last_became_active":"2024-09-12T01:38:35.076794+0000","last_became_peered":"2024-09-12T01:38:35.076794+0000","last_unstale":"2024-09-12T01:38:37.084452+0000","last_undegraded":"2024-09-12T01:38:37.084452+0000","last_fullsized":"2024-09-12T01:38:37.084452+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:30.729450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.023531+0000","last_change":"2024-09-12T01:38:36.078792+0000","last_active":"2024-09-12T01:38:38.023531+0000","last_peered":"2024-09-12T01:38:38.023531+0000","last_clean":"2024-09-12T01:38:38.023531+0000","last_became_active":"2024-09-12T01:38:36.078530+0000","last_became_peered":"2024-09-12T01:38:36.078530+0000","last_unstale":"2024-09-12T01:38:38.023531+0000","last_undegraded":"2024-09-12T01:38:38.023531+0000","last_fullsized":"2024-09-12T01:38:38.023531+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:07.054030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047263+0000","last_change":"2024-09-12T01:38:35.068171+0000","last_active":"2024-09-12T01:38:38.047263+0000","last_peered":"2024-09-12T01:38:38.047263+0000","last_clean":"2024-09-12T01:38:38.047263+0000","last_became_active":"2024-09-12T01:38:35.067831+0000","last_became_peered":"2024-09-12T01:38:35.067831+0000","last_unstale":"2024-09-12T01:38:38.047263+0000","last_undegraded":"2024-09-12T01:38:38.047263+0000","last_fullsized":"2024-09-12T01:38:38.047263+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:32.012736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.084111+0000","last_change":"2024-09-12T01:38:36.085383+0000","last_active":"2024-09-12T01:38:37.084111+0000","last_peered":"2024-09-12T01:38:37.084111+0000","last_clean":"2024-09-12T01:38:37.084111+0000","last_became_active":"2024-09-12T01:38:36.085062+0000","last_became_peered":"2024-09-12T01:38:36.085062+0000","last_unstale":"2024-09-12T01:38:37.084111+0000","last_undegraded":"2024-09-12T01:38:37.084111+0000","last_fullsized":"2024-09-12T01:38:37.084111+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:55.836657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046731+0000","last_change":"2024-09-12T01:38:35.075288+0000","last_active":"2024-09-12T01:38:38.046731+0000","last_peered":"2024-09-12T01:38:38.046731+0000","last_clean":"2024-09-12T01:38:38.046731+0000","last_became_active":"2024-09-12T01:38:35.074950+0000","last_became_peered":"2024-09-12T01:38:35.074950+0000","last_unstale":"2024-09-12T01:38:38.046731+0000","last_undegraded":"2024-09-12T01:38:38.046731+0000","last_fullsized":"2024-09-12T01:38:38.046731+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:24.044440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046637+0000","last_change":"2024-09-12T01:38:36.081520+0000","last_active":"2024-09-12T01:38:38.046637+0000","last_peered":"2024-09-12T01:38:38.046637+0000","last_clean":"2024-09-12T01:38:38.046637+0000","last_became_active":"2024-09-12T01:38:36.081189+0000","last_became_peered":"2024-09-12T01:38:36.081189+0000","last_unstale":"2024-09-12T01:38:38.046637+0000","last_undegraded":"2024-09-12T01:38:38.046637+0000","last_fullsized":"2024-09-12T01:38:38.046637+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:19.973347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.078741+0000","last_change":"2024-09-12T01:38:35.071787+0000","last_active":"2024-09-12T01:38:37.078741+0000","last_peered":"2024-09-12T01:38:37.078741+0000","last_clean":"2024-09-12T01:38:37.078741+0000","last_became_active":"2024-09-12T01:38:35.071434+0000","last_became_peered":"2024-09-12T01:38:35.071434+0000","last_unstale":"2024-09-12T01:38:37.078741+0000","last_undegraded":"2024-09-12T01:38:37.078741+0000","last_fullsized":"2024-09-12T01:38:37.078741+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:07.660833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.047145+0000","last_change":"2024-09-12T01:38:36.073477+0000","last_active":"2024-09-12T01:38:38.047145+0000","last_peered":"2024-09-12T01:38:38.047145+0000","last_clean":"2024-09-12T01:38:38.047145+0000","last_became_active":"2024-09-12T01:38:36.073206+0000","last_became_peered":"2024-09-12T01:38:36.073206+0000","last_unstale":"2024-09-12T01:38:38.047145+0000","last_undegraded":"2024-09-12T01:38:38.047145+0000","last_fullsized":"2024-09-12T01:38:38.047145+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.052271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.052271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:40.368764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"67'2","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046194+0000","last_change":"2024-09-12T01:38:35.074670+0000","last_active":"2024-09-12T01:38:38.046194+0000","last_peered":"2024-09-12T01:38:38.046194+0000","last_clean":"2024-09-12T01:38:38.046194+0000","last_became_active":"2024-09-12T01:38:35.074326+0000","last_became_peered":"2024-09-12T01:38:35.074326+0000","last_unstale":"2024-09-12T01:38:38.046194+0000","last_undegraded":"2024-09-12T01:38:38.046194+0000","last_fullsized":"2024-09-12T01:38:38.046194+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.045641+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.045641+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:03.405543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":255,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.046095+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:38:38.046095+0000","last_peered":"2024-09-12T01:38:38.046095+0000","last_clean":"2024-09-12T01:38:38.046095+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:38:38.046095+0000","last_undegraded":"2024-09-12T01:38:38.046095+0000","last_fullsized":"2024-09-12T01:38:38.046095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":340954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509478,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":835584,"data_stored":340988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509478,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1417216,"data_stored":929800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509478,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36160,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335680,"statfs":{"total":96636764160,"available":96599736320,"internally_reserved":0,"allocated":831488,"data_stored":339468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509478,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":823296,"data_stored":339924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509478,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1413120,"data_stored":929710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509479,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":823296,"data_stored":339412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":831488,"data_stored":340036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:45.410 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:38:45.411 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:38:45.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.520+0000 7f6709eed640 1 Processor -- start 2024-09-12T01:38:45.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.520+0000 7f6709eed640 1 -- start start 2024-09-12T01:38:45.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.520+0000 7f6709eed640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f67040d1c10 0x7f67040cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.520+0000 7f6709eed640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67040cf2f0 0x7f67040d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.520+0000 7f6709eed640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67040b7ad0 con 0x7f670415e600 2024-09-12T01:38:45.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.520+0000 7f6709eed640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f67040d2ee0 con 0x7f67040cf2f0 2024-09-12T01:38:45.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.520+0000 7f6709eed640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f67040cf760 con 0x7f67040d1c10 2024-09-12T01:38:45.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.521+0000 7f6703fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67040cf2f0 0x7f67040d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.521+0000 7f6703fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67040cf2f0 0x7f67040d3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51408/0 (socket says 172.21.15.60:51408) 2024-09-12T01:38:45.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.521+0000 7f6703fff640 1 -- 172.21.15.60:0/4032276660 learned_addr learned my addr 172.21.15.60:0/4032276660 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:45.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.521+0000 7f6702ffd640 1 --2- 172.21.15.60:0/4032276660 >> v2:172.21.15.105:3300/0 conn(0x7f67040d1c10 0x7f67040cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.521+0000 7f6703fff640 1 -- 172.21.15.60:0/4032276660 >> v2:172.21.15.105:3300/0 conn(0x7f67040d1c10 msgr2=0x7f67040cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:45.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.521+0000 7f6703fff640 1 --2- 172.21.15.60:0/4032276660 >> v2:172.21.15.105:3300/0 conn(0x7f67040d1c10 0x7f67040cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.521+0000 7f6703fff640 1 -- 172.21.15.60:0/4032276660 >> v1:172.21.15.105:6789/0 conn(0x7f670415e600 legacy=0x7f67040d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:45.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.521+0000 7f6703fff640 1 -- 172.21.15.60:0/4032276660 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67040cf9e0 con 0x7f67040cf2f0 2024-09-12T01:38:45.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.522+0000 7f6703fff640 1 --2- 172.21.15.60:0/4032276660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67040cf2f0 0x7f67040d3370 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f67041621b0 tx=0x7f66fc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e007f5ced5197120 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:45.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.522+0000 7f67027fc640 1 -- 172.21.15.60:0/4032276660 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc036070 con 0x7f67040cf2f0 2024-09-12T01:38:45.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.522+0000 7f67027fc640 1 -- 172.21.15.60:0/4032276660 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc031600 con 0x7f67040cf2f0 2024-09-12T01:38:45.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.522+0000 7f67027fc640 1 -- 172.21.15.60:0/4032276660 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc0319d0 con 0x7f67040cf2f0 2024-09-12T01:38:45.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.522+0000 7f6709eed640 1 -- 172.21.15.60:0/4032276660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67040cf2f0 msgr2=0x7f67040d3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.522+0000 7f6709eed640 1 --2- 172.21.15.60:0/4032276660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67040cf2f0 0x7f67040d3370 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f67041621b0 tx=0x7f66fc02a6f0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.522+0000 7f6709eed640 1 -- 172.21.15.60:0/4032276660 shutdown_connections 2024-09-12T01:38:45.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.522+0000 7f6709eed640 1 --2- 172.21.15.60:0/4032276660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67040cf2f0 0x7f67040d3370 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.522+0000 7f6709eed640 1 --2- 172.21.15.60:0/4032276660 >> v2:172.21.15.105:3300/0 conn(0x7f67040d1c10 0x7f67040cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.522+0000 7f6709eed640 1 -- 172.21.15.60:0/4032276660 >> 172.21.15.60:0/4032276660 conn(0x7f670406c2c0 msgr2=0x7f670406c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:45.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.522+0000 7f6709eed640 1 -- 172.21.15.60:0/4032276660 shutdown_connections 2024-09-12T01:38:45.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.522+0000 7f6709eed640 1 -- 172.21.15.60:0/4032276660 wait complete. 2024-09-12T01:38:45.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.524+0000 7f6709eed640 1 Processor -- start 2024-09-12T01:38:45.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.524+0000 7f6709eed640 1 -- start start 2024-09-12T01:38:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.524+0000 7f6709eed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67040cf2f0 0x7f6704146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.524+0000 7f6709eed640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67040d1c10 0x7f67041f4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.524+0000 7f6709eed640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670415e600 0x7f670415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.524+0000 7f6709eed640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67040d2b70 con 0x7f67040cf2f0 2024-09-12T01:38:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.524+0000 7f6709eed640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f67040cffa0 con 0x7f67040d1c10 2024-09-12T01:38:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f6709eed640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f670415e9e0 con 0x7f670415e600 2024-09-12T01:38:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f67037fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67040cf2f0 0x7f6704146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f67037fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67040cf2f0 0x7f6704146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51410/0 (socket says 172.21.15.60:51410) 2024-09-12T01:38:45.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f67037fe640 1 -- 172.21.15.60:0/508012815 learned_addr learned my addr 172.21.15.60:0/508012815 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:45.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f6702ffd640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67040d1c10 0x7f67041f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f6703fff640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670415e600 0x7f670415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f67037fe640 1 -- 172.21.15.60:0/508012815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670415e600 msgr2=0x7f670415bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f67037fe640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670415e600 0x7f670415bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f67037fe640 1 -- 172.21.15.60:0/508012815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67040d1c10 msgr2=0x7f67041f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f67037fe640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67040d1c10 0x7f67041f4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f67037fe640 1 -- 172.21.15.60:0/508012815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6704155ff0 con 0x7f67040cf2f0 2024-09-12T01:38:45.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f67037fe640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67040cf2f0 0x7f6704146c20 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f66f400b3e0 tx=0x7f66f400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:45.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f66ebfff640 1 -- 172.21.15.60:0/508012815 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4015020 con 0x7f67040cf2f0 2024-09-12T01:38:45.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f66ebfff640 1 -- 172.21.15.60:0/508012815 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f4011850 con 0x7f67040cf2f0 2024-09-12T01:38:45.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f66ebfff640 1 -- 172.21.15.60:0/508012815 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4011c40 con 0x7f67040cf2f0 2024-09-12T01:38:45.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f6709eed640 1 -- 172.21.15.60:0/508012815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67041562d0 con 0x7f67040cf2f0 2024-09-12T01:38:45.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.525+0000 7f6709eed640 1 -- 172.21.15.60:0/508012815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6704156890 con 0x7f67040cf2f0 2024-09-12T01:38:45.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.527+0000 7f6709eed640 1 -- 172.21.15.60:0/508012815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67040cedb0 con 0x7f67040cf2f0 2024-09-12T01:38:45.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.527+0000 7f66ebfff640 1 -- 172.21.15.60:0/508012815 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66f4018020 con 0x7f67040cf2f0 2024-09-12T01:38:45.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.528+0000 7f66ebfff640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66f006be30 0x7f66f006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.528+0000 7f6702ffd640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66f006be30 0x7f66f006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.528+0000 7f66ebfff640 1 -- 172.21.15.60:0/508012815 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f66f408ac30 con 0x7f67040cf2f0 2024-09-12T01:38:45.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.528+0000 7f6702ffd640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66f006be30 0x7f66f006e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6704155c10 tx=0x7f66f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:45.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.532+0000 7f66ebfff640 1 -- 172.21.15.60:0/508012815 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66f401f020 con 0x7f67040cf2f0 2024-09-12T01:38:45.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.778+0000 7f6709eed640 1 -- 172.21.15.60:0/508012815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f67040d25f0 con 0x7f67040cf2f0 2024-09-12T01:38:45.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.780+0000 7f66ebfff640 1 -- 172.21.15.60:0/508012815 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f66f4059020 con 0x7f67040cf2f0 2024-09-12T01:38:45.780 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-12T01:38:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ== 2024-09-12T01:38:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: caps mds = "allow" 2024-09-12T01:38:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: caps mon = "allow r" 2024-09-12T01:38:45.781 INFO:teuthology.orchestra.run.smithi060.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:38:45.781 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2024-09-12T01:38:45.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.782+0000 7f6709eed640 1 -- 172.21.15.60:0/508012815 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66f006be30 msgr2=0x7f66f006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.782+0000 7f6709eed640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66f006be30 0x7f66f006e2f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6704155c10 tx=0x7f66f8008040 comp rx=0 tx=0).stop 2024-09-12T01:38:45.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.782+0000 7f6709eed640 1 -- 172.21.15.60:0/508012815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67040cf2f0 msgr2=0x7f6704146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.782+0000 7f6709eed640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67040cf2f0 0x7f6704146c20 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f66f400b3e0 tx=0x7f66f400b8a0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.782+0000 7f6709eed640 1 -- 172.21.15.60:0/508012815 shutdown_connections 2024-09-12T01:38:45.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.782+0000 7f6709eed640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66f006be30 0x7f66f006e2f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.782+0000 7f6709eed640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f670415e600 0x7f670415bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.782+0000 7f6709eed640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f67040d1c10 0x7f67041f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.782+0000 7f6709eed640 1 --2- 172.21.15.60:0/508012815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67040cf2f0 0x7f6704146c20 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.782+0000 7f6709eed640 1 -- 172.21.15.60:0/508012815 >> 172.21.15.60:0/508012815 conn(0x7f670406c2c0 msgr2=0x7f670415d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:45.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.783+0000 7f6709eed640 1 -- 172.21.15.60:0/508012815 shutdown_connections 2024-09-12T01:38:45.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.783+0000 7f6709eed640 1 -- 172.21.15.60:0/508012815 wait complete. 2024-09-12T01:38:45.794 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:45.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.896+0000 7f2707bf1640 1 Processor -- start 2024-09-12T01:38:45.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.896+0000 7f2707bf1640 1 -- start start 2024-09-12T01:38:45.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.897+0000 7f2707bf1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f270015c2b0 0x7f27000b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.897+0000 7f2707bf1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f270015f200 0x7f270006d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.897+0000 7f2707bf1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f270015fb10 con 0x7f27000b72f0 2024-09-12T01:38:45.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.897+0000 7f2707bf1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f27000b5900 con 0x7f270015f200 2024-09-12T01:38:45.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.897+0000 7f2707bf1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f270015f830 con 0x7f270015c2b0 2024-09-12T01:38:45.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.897+0000 7f270618e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f270015f200 0x7f270006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.897+0000 7f270618e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f270015f200 0x7f270006d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51416/0 (socket says 172.21.15.60:51416) 2024-09-12T01:38:45.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.897+0000 7f270618e640 1 -- 172.21.15.60:0/497574904 learned_addr learned my addr 172.21.15.60:0/497574904 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:45.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.897+0000 7f270598d640 1 --2- 172.21.15.60:0/497574904 >> v2:172.21.15.105:3300/0 conn(0x7f270015c2b0 0x7f27000b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.898+0000 7f270618e640 1 -- 172.21.15.60:0/497574904 >> v2:172.21.15.105:3300/0 conn(0x7f270015c2b0 msgr2=0x7f27000b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:45.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.898+0000 7f270618e640 1 --2- 172.21.15.60:0/497574904 >> v2:172.21.15.105:3300/0 conn(0x7f270015c2b0 0x7f27000b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.898+0000 7f270618e640 1 -- 172.21.15.60:0/497574904 >> v1:172.21.15.105:6789/0 conn(0x7f27000b72f0 legacy=0x7f270015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.898+0000 7f270618e640 1 -- 172.21.15.60:0/497574904 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f270006ce30 con 0x7f270015f200 2024-09-12T01:38:45.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.898+0000 7f270618e640 1 --2- 172.21.15.60:0/497574904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f270015f200 0x7f270006d910 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f270006f040 tx=0x7f26f002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366f8685ce142fdf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:45.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.899+0000 7f270498b640 1 -- 172.21.15.60:0/497574904 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0036070 con 0x7f270015f200 2024-09-12T01:38:45.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.899+0000 7f270498b640 1 -- 172.21.15.60:0/497574904 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f0031600 con 0x7f270015f200 2024-09-12T01:38:45.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.899+0000 7f270498b640 1 -- 172.21.15.60:0/497574904 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f00319d0 con 0x7f270015f200 2024-09-12T01:38:45.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.899+0000 7f2707bf1640 1 -- 172.21.15.60:0/497574904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f270015f200 msgr2=0x7f270006d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.899+0000 7f2707bf1640 1 --2- 172.21.15.60:0/497574904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f270015f200 0x7f270006d910 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f270006f040 tx=0x7f26f002a730 comp rx=0 tx=0).stop 2024-09-12T01:38:45.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.899+0000 7f2707bf1640 1 -- 172.21.15.60:0/497574904 shutdown_connections 2024-09-12T01:38:45.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.899+0000 7f2707bf1640 1 --2- 172.21.15.60:0/497574904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f270015f200 0x7f270006d910 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.899+0000 7f2707bf1640 1 --2- 172.21.15.60:0/497574904 >> v2:172.21.15.105:3300/0 conn(0x7f270015c2b0 0x7f27000b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.899+0000 7f2707bf1640 1 -- 172.21.15.60:0/497574904 >> 172.21.15.60:0/497574904 conn(0x7f27000b4240 msgr2=0x7f27000b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:45.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.899+0000 7f2707bf1640 1 -- 172.21.15.60:0/497574904 shutdown_connections 2024-09-12T01:38:45.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.899+0000 7f2707bf1640 1 -- 172.21.15.60:0/497574904 wait complete. 2024-09-12T01:38:45.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.900+0000 7f2707bf1640 1 Processor -- start 2024-09-12T01:38:45.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.900+0000 7f2707bf1640 1 -- start start 2024-09-12T01:38:45.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.901+0000 7f2707bf1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27000b72f0 0x7f270015d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.901+0000 7f2707bf1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f270015c2b0 0x7f27000cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.901+0000 7f2707bf1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f270015f200 0x7f2700159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.901+0000 7f2707bf1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27000b7760 con 0x7f270015c2b0 2024-09-12T01:38:45.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.901+0000 7f2707bf1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f270006d3f0 con 0x7f27000b72f0 2024-09-12T01:38:45.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.901+0000 7f2707bf1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f270006de50 con 0x7f270015f200 2024-09-12T01:38:45.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.901+0000 7f270518c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f270015c2b0 0x7f27000cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.901+0000 7f270518c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f270015c2b0 0x7f27000cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51422/0 (socket says 172.21.15.60:51422) 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.901+0000 7f270518c640 1 -- 172.21.15.60:0/781352206 learned_addr learned my addr 172.21.15.60:0/781352206 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.901+0000 7f270598d640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27000b72f0 0x7f270015d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.901+0000 7f270618e640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f270015f200 0x7f2700159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.902+0000 7f270518c640 1 -- 172.21.15.60:0/781352206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f270015f200 msgr2=0x7f2700159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.902+0000 7f270518c640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f270015f200 0x7f2700159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.902+0000 7f270518c640 1 -- 172.21.15.60:0/781352206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27000b72f0 msgr2=0x7f270015d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.902+0000 7f270518c640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27000b72f0 0x7f270015d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.902+0000 7f270518c640 1 -- 172.21.15.60:0/781352206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27000cfcc0 con 0x7f270015c2b0 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.902+0000 7f270518c640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f270015c2b0 0x7f27000cecb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f26f400c400 tx=0x7f26f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.902+0000 7f26fe7fc640 1 -- 172.21.15.60:0/781352206 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f40052d0 con 0x7f270015c2b0 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.902+0000 7f26fe7fc640 1 -- 172.21.15.60:0/781352206 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f4005490 con 0x7f270015c2b0 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.902+0000 7f2707bf1640 1 -- 172.21.15.60:0/781352206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27000cf420 con 0x7f270015c2b0 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.902+0000 7f26fe7fc640 1 -- 172.21.15.60:0/781352206 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4007260 con 0x7f270015c2b0 2024-09-12T01:38:45.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.902+0000 7f2707bf1640 1 -- 172.21.15.60:0/781352206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27000cf9e0 con 0x7f270015c2b0 2024-09-12T01:38:45.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.903+0000 7f2707bf1640 1 -- 172.21.15.60:0/781352206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27000b6db0 con 0x7f270015c2b0 2024-09-12T01:38:45.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.903+0000 7f26fe7fc640 1 -- 172.21.15.60:0/781352206 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f26f4007400 con 0x7f270015c2b0 2024-09-12T01:38:45.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.904+0000 7f26fe7fc640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f26ec06be30 0x7f26ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:45.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.904+0000 7f26fe7fc640 1 -- 172.21.15.60:0/781352206 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f26f408a240 con 0x7f270015c2b0 2024-09-12T01:38:45.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.904+0000 7f270598d640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f26ec06be30 0x7f26ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:45.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.904+0000 7f270598d640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f26ec06be30 0x7f26ec06e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f26f8006fd0 tx=0x7f26f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:45.908+0000 7f26fe7fc640 1 -- 172.21.15.60:0/781352206 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f26f4058630 con 0x7f270015c2b0 2024-09-12T01:38:46.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.117+0000 7f2707bf1640 1 -- 172.21.15.60:0/781352206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f270015e050 con 0x7f270015c2b0 2024-09-12T01:38:46.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.118+0000 7f26fe7fc640 1 -- 172.21.15.60:0/781352206 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f26f405c930 con 0x7f270015c2b0 2024-09-12T01:38:46.119 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:46.119 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":38,"btime":"2024-09-12T01:38:39:078790+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/672507371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":672507371},{"type":"v1","addr":"172.21.15.60:6836","nonce":672507371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/2426056287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2426056287},{"type":"v1","addr":"172.21.15.105:6833","nonce":2426056287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/183879558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":183879558},{"type":"v1","addr":"172.21.15.60:6837","nonce":183879558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:35.419604+0000","modified":"2024-09-12T01:38:38.117150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35168":{"gid":35168,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1216783001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1216783001},{"type":"v1","addr":"172.21.15.105:6835","nonce":1216783001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35168,"qdb_cluster":[35168]},"id":5}]} 2024-09-12T01:38:46.119 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 38 2024-09-12T01:38:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.120+0000 7f2707bf1640 1 -- 172.21.15.60:0/781352206 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f26ec06be30 msgr2=0x7f26ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.120+0000 7f2707bf1640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f26ec06be30 0x7f26ec06e2f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f26f8006fd0 tx=0x7f26f8008040 comp rx=0 tx=0).stop 2024-09-12T01:38:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.120+0000 7f2707bf1640 1 -- 172.21.15.60:0/781352206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f270015c2b0 msgr2=0x7f27000cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.120+0000 7f2707bf1640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f270015c2b0 0x7f27000cecb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f26f400c400 tx=0x7f26f400c8c0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.120+0000 7f2707bf1640 1 -- 172.21.15.60:0/781352206 shutdown_connections 2024-09-12T01:38:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.120+0000 7f2707bf1640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f26ec06be30 0x7f26ec06e2f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.120+0000 7f2707bf1640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f270015f200 0x7f2700159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.120+0000 7f2707bf1640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f270015c2b0 0x7f27000cecb0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.120+0000 7f2707bf1640 1 --2- 172.21.15.60:0/781352206 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27000b72f0 0x7f270015d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.120+0000 7f2707bf1640 1 -- 172.21.15.60:0/781352206 >> 172.21.15.60:0/781352206 conn(0x7f27000b4240 msgr2=0x7f27000b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.120+0000 7f2707bf1640 1 -- 172.21.15.60:0/781352206 shutdown_connections 2024-09-12T01:38:46.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.120+0000 7f2707bf1640 1 -- 172.21.15.60:0/781352206 wait complete. 2024-09-12T01:38:46.534 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:38:35.419604+0000', 'modified': '2024-09-12T01:38:38.117150+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35168}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35168': {'gid': 35168, 'name': 'd', 'rank': 0, 'incarnation': 35, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/1216783001', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6834', 'nonce': 1216783001}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 1216783001}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 35168, 'qdb_cluster': [35168]} 2024-09-12T01:38:46.534 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:38:46.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T01:38:46.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.640+0000 7f5b7222e640 1 Processor -- start 2024-09-12T01:38:46.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.640+0000 7f5b7222e640 1 -- start start 2024-09-12T01:38:46.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b7222e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5b6c0b6290 0x7f5b6c071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b7222e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b6c0ccff0 con 0x7f5b6c15b480 2024-09-12T01:38:46.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b7222e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b6c0cd2d0 con 0x7f5b6c072530 2024-09-12T01:38:46.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b7222e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5b6c0cd5b0 con 0x7f5b6c0b6290 2024-09-12T01:38:46.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b6b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5b6c15b480 0x7f5b6c0b5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:32874/0 (socket says 172.21.15.60:32874) 2024-09-12T01:38:46.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b6b7fe640 1 -- 172.21.15.60:0/1303698953 learned_addr learned my addr 172.21.15.60:0/1303698953 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2309614207 0 0) 0x7f5b6c0ccff0 con 0x7f5b6c15b480 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b54003520 con 0x7f5b6c15b480 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b6affd640 1 --2- 172.21.15.60:0/1303698953 >> v2:172.21.15.105:3300/0 conn(0x7f5b6c0b6290 0x7f5b6c071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2655480018 0 0) 0x7f5b54003520 con 0x7f5b6c15b480 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 >> v2:172.21.15.105:3300/0 conn(0x7f5b6c0b6290 msgr2=0x7f5b6c071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b6a7fc640 1 --2- 172.21.15.60:0/1303698953 >> v2:172.21.15.105:3300/0 conn(0x7f5b6c0b6290 0x7f5b6c071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 >> v1:172.21.15.105:6789/0 conn(0x7f5b6c072530 legacy=0x7f5b6c15bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.641+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6c0cd890 con 0x7f5b6c15b480 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f5b5c001670 con 0x7f5b6c15b480 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 >> v1:172.21.15.60:6789/0 conn(0x7f5b6c15b480 legacy=0x7f5b6c0b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6a7fc640 1 --2- 172.21.15.60:0/1303698953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b540039b0 0x7f5b54003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6a7fc640 1 --2- 172.21.15.60:0/1303698953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b54004800 0x7f5b54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6a7fc640 1 --2- 172.21.15.60:0/1303698953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 0x7f5b5400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c0cd5b0 con 0x7f5b540052e0 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5b5400e3a0 con 0x7f5b540039b0 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5b5400e5a0 con 0x7f5b54004800 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/1303698953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b540039b0 0x7f5b54003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/1303698953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 0x7f5b5400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6affd640 1 --2- 172.21.15.60:0/1303698953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b54004800 0x7f5b54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6bfff640 1 -- 172.21.15.60:0/1303698953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b54004800 msgr2=0x7f5b54004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/1303698953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b54004800 0x7f5b54004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6bfff640 1 -- 172.21.15.60:0/1303698953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b540039b0 msgr2=0x7f5b54003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/1303698953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b540039b0 0x7f5b54003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.642+0000 7f5b6bfff640 1 -- 172.21.15.60:0/1303698953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b54003520 con 0x7f5b540052e0 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.643+0000 7f5b6bfff640 1 -- 172.21.15.60:0/1303698953 reap_dead start 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.643+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/1303698953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 0x7f5b5400dbd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5b64004480 tx=0x7f5b54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a826c62a72bc387 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:46.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.643+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64004080 con 0x7f5b540052e0 2024-09-12T01:38:46.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.643+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6402ad80 con 0x7f5b540052e0 2024-09-12T01:38:46.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.643+0000 7f5b6a7fc640 1 -- 172.21.15.60:0/1303698953 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64006d90 con 0x7f5b540052e0 2024-09-12T01:38:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.643+0000 7f5b7222e640 1 -- 172.21.15.60:0/1303698953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 msgr2=0x7f5b5400dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.643+0000 7f5b7222e640 1 --2- 172.21.15.60:0/1303698953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 0x7f5b5400dbd0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5b64004480 tx=0x7f5b54005830 comp rx=0 tx=0).stop 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.644+0000 7f5b7222e640 1 -- 172.21.15.60:0/1303698953 shutdown_connections 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.644+0000 7f5b7222e640 1 --2- 172.21.15.60:0/1303698953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 0x7f5b5400dbd0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.644+0000 7f5b7222e640 1 -- 172.21.15.60:0/1303698953 >> 172.21.15.60:0/1303698953 conn(0x7f5b6c06d0f0 msgr2=0x7f5b6c06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.644+0000 7f5b7222e640 1 -- 172.21.15.60:0/1303698953 shutdown_connections 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.644+0000 7f5b7222e640 1 -- 172.21.15.60:0/1303698953 wait complete. 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.645+0000 7f5b7222e640 1 Processor -- start 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.645+0000 7f5b7222e640 1 -- start start 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b7222e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 0x7f5b6c0cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b7222e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b6c0cac70 0x7f5b6c14ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b7222e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b6c0cfec0 0x7f5b6c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b7222e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c15b9e0 con 0x7f5b540052e0 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b7222e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c15b860 con 0x7f5b6c0cfec0 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b7222e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6c071ff0 con 0x7f5b6c0cac70 2024-09-12T01:38:46.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b6b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 0x7f5b6c0cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b6b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 0x7f5b6c0cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51434/0 (socket says 172.21.15.60:51434) 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b6b7fe640 1 -- 172.21.15.60:0/4172799652 learned_addr learned my addr 172.21.15.60:0/4172799652 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b6affd640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b6c0cac70 0x7f5b6c14ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b6c0cfec0 0x7f5b6c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b6b7fe640 1 -- 172.21.15.60:0/4172799652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b6c0cac70 msgr2=0x7f5b6c14ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b6c0cac70 0x7f5b6c14ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b6b7fe640 1 -- 172.21.15.60:0/4172799652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b6c0cfec0 msgr2=0x7f5b6c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b6c0cfec0 0x7f5b6c0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b6b7fe640 1 -- 172.21.15.60:0/4172799652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6c0cb230 con 0x7f5b540052e0 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.646+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 0x7f5b6c0cc2d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0072f0 tx=0x7f5b5c0077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.647+0000 7f5b53fff640 1 -- 172.21.15.60:0/4172799652 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c01a070 con 0x7f5b540052e0 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.647+0000 7f5b53fff640 1 -- 172.21.15.60:0/4172799652 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b5c00f8e0 con 0x7f5b540052e0 2024-09-12T01:38:46.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.647+0000 7f5b7222e640 1 -- 172.21.15.60:0/4172799652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6c0cb510 con 0x7f5b540052e0 2024-09-12T01:38:46.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.647+0000 7f5b53fff640 1 -- 172.21.15.60:0/4172799652 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00fcb0 con 0x7f5b540052e0 2024-09-12T01:38:46.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.647+0000 7f5b7222e640 1 -- 172.21.15.60:0/4172799652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b6c0cbad0 con 0x7f5b540052e0 2024-09-12T01:38:46.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.648+0000 7f5b53fff640 1 -- 172.21.15.60:0/4172799652 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5b5c01d070 con 0x7f5b540052e0 2024-09-12T01:38:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.649+0000 7f5b53fff640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5b5806be30 0x7f5b5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.649+0000 7f5b53fff640 1 -- 172.21.15.60:0/4172799652 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f5b5c08a930 con 0x7f5b540052e0 2024-09-12T01:38:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.649+0000 7f5b6affd640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5b5806be30 0x7f5b5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.649+0000 7f5b6affd640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5b5806be30 0x7f5b5806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c1e5890 tx=0x7f5b60008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.650+0000 7f5b74fca740 1 Processor -- start 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.650+0000 7f5b74fca740 1 -- start start 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b74fca740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f010247a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b74fca740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0101ffa80 0x55f0102026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b74fca740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010203a50 0x55f0101fc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b74fca740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f010164520 con 0x55f0101ffa80 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b74fca740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f01010c3e0 con 0x55f010203a50 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b74fca740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55f0101604e0 con 0x55f0102022c0 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b6affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0101ffa80 0x55f0102026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b6affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0101ffa80 0x55f0102026a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51446/0 (socket says 172.21.15.60:51446) 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b6affd640 1 -- 172.21.15.60:0/3682605735 learned_addr learned my addr 172.21.15.60:0/3682605735 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/3682605735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f010247a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/3682605735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010203a50 0x55f0101fc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b6affd640 1 -- 172.21.15.60:0/3682605735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 msgr2=0x55f010247a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b6affd640 1 --2- 172.21.15.60:0/3682605735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f010247a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b6affd640 1 -- 172.21.15.60:0/3682605735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010203a50 msgr2=0x55f0101fc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b6affd640 1 --2- 172.21.15.60:0/3682605735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010203a50 0x55f0101fc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b6affd640 1 -- 172.21.15.60:0/3682605735 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0101272f0 con 0x55f0101ffa80 2024-09-12T01:38:46.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/3682605735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f010247a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:46.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b6affd640 1 --2- 172.21.15.60:0/3682605735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0101ffa80 0x55f0102026a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5b60012b10 tx=0x7f5b60015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6ca0eaa1c19573 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:46.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b517fa640 1 -- 172.21.15.60:0/3682605735 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60015a90 con 0x55f0101ffa80 2024-09-12T01:38:46.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b517fa640 1 -- 172.21.15.60:0/3682605735 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b60027070 con 0x55f0101ffa80 2024-09-12T01:38:46.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.651+0000 7f5b517fa640 1 -- 172.21.15.60:0/3682605735 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60015e50 con 0x55f0101ffa80 2024-09-12T01:38:46.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.652+0000 7f5b74fca740 1 -- 172.21.15.60:0/3682605735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0101ffa80 msgr2=0x55f0102026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.652+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3682605735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0101ffa80 0x55f0102026a0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5b60012b10 tx=0x7f5b60015000 comp rx=0 tx=0).stop 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.652+0000 7f5b74fca740 1 -- 172.21.15.60:0/3682605735 shutdown_connections 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.652+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3682605735 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010203a50 0x55f0101fc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.652+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3682605735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f0101ffa80 0x55f0102026a0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.652+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3682605735 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f010247a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.652+0000 7f5b74fca740 1 -- 172.21.15.60:0/3682605735 >> 172.21.15.60:0/3682605735 conn(0x55f0101fea80 msgr2=0x55f010246f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.652+0000 7f5b74fca740 1 -- 172.21.15.60:0/3682605735 shutdown_connections 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.652+0000 7f5b74fca740 1 -- 172.21.15.60:0/3682605735 wait complete. 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.653+0000 7f5b74fca740 1 -- start start 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.653+0000 7f5b74fca740 1 Processor -- start 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b74fca740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f01022bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b74fca740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010203a50 0x55f010221730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b74fca740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 0x55f0101fca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b74fca740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f0101fdf20 con 0x55f010229dc0 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b74fca740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f0100ed450 con 0x55f010203a50 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b74fca740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55f010248290 con 0x55f0102022c0 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b74fca740 10 client.0 _ll_register_callbacks cb 0x55f00fe76ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b6bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 0x55f0101fca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b6bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 0x55f0101fca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51450/0 (socket says 172.21.15.60:51450) 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b6bfff640 1 -- 172.21.15.60:0/3532903067 learned_addr learned my addr 172.21.15.60:0/3532903067 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b6affd640 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010203a50 0x55f010221730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f01022bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b6bfff640 1 -- 172.21.15.60:0/3532903067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 msgr2=0x55f01022bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f01022bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b6bfff640 1 -- 172.21.15.60:0/3532903067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010203a50 msgr2=0x55f010221730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010203a50 0x55f010221730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b6bfff640 1 -- 172.21.15.60:0/3532903067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f00fe772d0 con 0x55f010229dc0 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 0x55f0101fca50 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5b64007f60 tx=0x7f5b64003ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c567357ee0388d0a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b4a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.654+0000 7f5b4a7fc640 1 -- 172.21.15.60:0/3532903067 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64032640 con 0x55f010229dc0 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b74fca740 1 -- 172.21.15.60:0/3532903067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b60027070 con 0x55f010229dc0 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b4a7fc640 1 -- 172.21.15.60:0/3532903067 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f5b640327e0 con 0x55f010229dc0 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b4a7fc640 1 -- 172.21.15.60:0/3532903067 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5b6404d050 con 0x55f010229dc0 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b74fca740 10 client.6003 fetch_fsmap learned FSMap version 38 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b74fca740 1 -- 172.21.15.60:0/3532903067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55f00ff416b0 con 0x55f010229dc0 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b4a7fc640 1 -- 172.21.15.60:0/3532903067 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b60027070 con 0x55f010229dc0 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b4a7fc640 1 -- 172.21.15.60:0/3532903067 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7f5b64050020 con 0x55f010229dc0 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b74fca740 10 client.6003 fetch_fsmap finished waiting for FSMap version 38 2024-09-12T01:38:46.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b74fca740 10 client.6003 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:38:46.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b74fca740 20 client.6003 populate_metadata read hostname 'smithi060' 2024-09-12T01:38:46.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.105:6834/1216783001,v1:172.21.15.105:6835/1216783001] conn(0x55f01025a140 0x55f01025a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b74fca740 4 client.6003 mds_command: new command op to 35168 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:38:46.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b74fca740 1 -- 172.21.15.60:0/3532903067 --> [v2:172.21.15.105:6834/1216783001,v1:172.21.15.105:6835/1216783001] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f010171c50 con 0x55f01025a140 2024-09-12T01:38:46.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.655+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.105:6834/1216783001,v1:172.21.15.105:6835/1216783001] conn(0x55f01025a140 0x55f01025a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.656+0000 7f5b4a7fc640 10 client.6003 ms_handle_connect on v2:172.21.15.105:6834/1216783001 2024-09-12T01:38:46.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.656+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.105:6834/1216783001,v1:172.21.15.105:6835/1216783001] conn(0x55f01025a140 0x55f01025a520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3938f7bcb13e11a1 server_cookie=2c75d8fa2819572b in_seq=0 out_seq=0 2024-09-12T01:38:46.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.656+0000 7f5b4a7fc640 1 -- 172.21.15.60:0/3532903067 <== mds.0 v2:172.21.15.105:6834/1216783001 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f010171c50 con 0x55f01025a140 2024-09-12T01:38:46.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.656+0000 7f5b4a7fc640 10 client.6003 handle_command_reply: tid=0 2024-09-12T01:38:46.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.656+0000 7f5b74fca740 1 client.6003 shutdown 2024-09-12T01:38:46.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.657+0000 7f5b74fca740 1 -- 172.21.15.60:0/3532903067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 msgr2=0x55f0101fca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.657+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 0x55f0101fca50 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5b64007f60 tx=0x7f5b64003ae0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.657+0000 7f5b74fca740 1 -- 172.21.15.60:0/3532903067 shutdown_connections 2024-09-12T01:38:46.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.657+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.105:6834/1216783001,v1:172.21.15.105:6835/1216783001] conn(0x55f01025a140 0x55f01025a520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.657+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 0x55f0101fca50 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.657+0000 7f5b4a7fc640 0 client.6003 ms_handle_reset on v2:172.21.15.105:6834/1216783001 2024-09-12T01:38:46.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.657+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010203a50 0x55f010221730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.657+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3532903067 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f01022bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.657+0000 7f5b74fca740 1 -- 172.21.15.60:0/3532903067 >> 172.21.15.60:0/3532903067 conn(0x55f0101ffa80 msgr2=0x55f010244ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:46.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.657+0000 7f5b74fca740 1 -- 172.21.15.60:0/3532903067 shutdown_connections 2024-09-12T01:38:46.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.657+0000 7f5b74fca740 1 -- 172.21.15.60:0/3532903067 wait complete. 2024-09-12T01:38:46.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.657+0000 7f5b74fca740 20 client.6003 trim_cache size 0 max 16384 2024-09-12T01:38:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.675+0000 7f5b74fca740 1 Processor -- start 2024-09-12T01:38:46.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.675+0000 7f5b74fca740 1 -- start start 2024-09-12T01:38:46.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b74fca740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f0102022c0 0x55f010244720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b74fca740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f010203a50 0x55f010260a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b74fca740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 0x55f01022c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b74fca740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c200100 con 0x55f010229dc0 2024-09-12T01:38:46.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b74fca740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c0cf3d0 con 0x55f0102022c0 2024-09-12T01:38:46.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b74fca740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6c1ffae0 con 0x55f010203a50 2024-09-12T01:38:46.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 0x55f01022c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 0x55f01022c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51456/0 (socket says 172.21.15.60:51456) 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6bfff640 1 -- 172.21.15.60:0/1387020068 learned_addr learned my addr 172.21.15.60:0/1387020068 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6affd640 1 --2- 172.21.15.60:0/1387020068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f010203a50 0x55f010260a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/1387020068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f0102022c0 0x55f010244720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6bfff640 1 -- 172.21.15.60:0/1387020068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f010203a50 msgr2=0x55f010260a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/1387020068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f010203a50 0x55f010260a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6bfff640 1 -- 172.21.15.60:0/1387020068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f0102022c0 msgr2=0x55f010244720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/1387020068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f0102022c0 0x55f010244720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6bfff640 1 -- 172.21.15.60:0/1387020068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0101f86c0 con 0x55f010229dc0 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6affd640 1 --2- 172.21.15.60:0/1387020068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f010203a50 0x55f010260a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/1387020068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f0102022c0 0x55f010244720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.676+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/1387020068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 0x55f01022c330 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5b6402a740 tx=0x7f5b6403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa81efaac73642df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.677+0000 7f5b50ff9640 1 -- 172.21.15.60:0/1387020068 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64059070 con 0x55f010229dc0 2024-09-12T01:38:46.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.677+0000 7f5b50ff9640 1 -- 172.21.15.60:0/1387020068 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b64032440 con 0x55f010229dc0 2024-09-12T01:38:46.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.677+0000 7f5b50ff9640 1 -- 172.21.15.60:0/1387020068 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64032850 con 0x55f010229dc0 2024-09-12T01:38:46.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.677+0000 7f5b74fca740 1 -- 172.21.15.60:0/1387020068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 msgr2=0x55f01022c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.677+0000 7f5b74fca740 1 --2- 172.21.15.60:0/1387020068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 0x55f01022c330 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5b6402a740 tx=0x7f5b6403d000 comp rx=0 tx=0).stop 2024-09-12T01:38:46.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.677+0000 7f5b74fca740 1 -- 172.21.15.60:0/1387020068 shutdown_connections 2024-09-12T01:38:46.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.677+0000 7f5b74fca740 1 --2- 172.21.15.60:0/1387020068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010229dc0 0x55f01022c330 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.677+0000 7f5b74fca740 1 --2- 172.21.15.60:0/1387020068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f010203a50 0x55f010260a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.677+0000 7f5b74fca740 1 --2- 172.21.15.60:0/1387020068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f0102022c0 0x55f010244720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.677+0000 7f5b74fca740 1 -- 172.21.15.60:0/1387020068 >> 172.21.15.60:0/1387020068 conn(0x55f0101ffa80 msgr2=0x55f0102453a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:46.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.677+0000 7f5b74fca740 1 -- 172.21.15.60:0/1387020068 shutdown_connections 2024-09-12T01:38:46.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.677+0000 7f5b74fca740 1 -- 172.21.15.60:0/1387020068 wait complete. 2024-09-12T01:38:46.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.678+0000 7f5b74fca740 1 -- start start 2024-09-12T01:38:46.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.678+0000 7f5b74fca740 1 Processor -- start 2024-09-12T01:38:46.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b74fca740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f0102c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b74fca740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010203a50 0x55f010225cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b74fca740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010229dc0 0x55f0102261f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b74fca740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f010221c70 con 0x55f010203a50 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b74fca740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55f01022a940 con 0x55f010229dc0 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b74fca740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55f010222890 con 0x55f0102022c0 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b74fca740 10 client.0 _ll_register_callbacks cb 0x7f5b540051c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b6affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010203a50 0x55f010225cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b6affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010203a50 0x55f010225cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51462/0 (socket says 172.21.15.60:51462) 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b6affd640 1 -- 172.21.15.60:0/3996265750 learned_addr learned my addr 172.21.15.60:0/3996265750 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f0102c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b6bfff640 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010229dc0 0x55f0102261f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b6affd640 1 -- 172.21.15.60:0/3996265750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 msgr2=0x55f0102c46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b6affd640 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f0102c46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b6affd640 1 -- 172.21.15.60:0/3996265750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010229dc0 msgr2=0x55f0102261f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b6affd640 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010229dc0 0x55f0102261f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b6affd640 1 -- 172.21.15.60:0/3996265750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f010203470 con 0x55f010203a50 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b6affd640 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010203a50 0x55f010225cb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5b60013010 tx=0x7f5b600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1631c436e1cb3551 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b4a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b4a7fc640 1 -- 172.21.15.60:0/3996265750 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b60022c80 con 0x55f010203a50 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b4a7fc640 1 -- 172.21.15.60:0/3996265750 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f5b60036450 con 0x55f010203a50 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.679+0000 7f5b74fca740 1 -- 172.21.15.60:0/3996265750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b64032440 con 0x55f010203a50 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.680+0000 7f5b4a7fc640 1 -- 172.21.15.60:0/3996265750 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5b6003e050 con 0x55f010203a50 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.680+0000 7f5b74fca740 10 client.6009 fetch_fsmap learned FSMap version 38 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.680+0000 7f5b74fca740 1 -- 172.21.15.60:0/3996265750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55f0102475a0 con 0x55f010203a50 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.680+0000 7f5b4a7fc640 1 -- 172.21.15.60:0/3996265750 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b64032440 con 0x55f010203a50 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.680+0000 7f5b4a7fc640 1 -- 172.21.15.60:0/3996265750 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 38) ==== 3502+0+0 (secure 0 0 0) 0x7f5b60041020 con 0x55f010203a50 2024-09-12T01:38:46.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.680+0000 7f5b74fca740 10 client.6009 fetch_fsmap finished waiting for FSMap version 38 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.680+0000 7f5b74fca740 10 client.6009 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.680+0000 7f5b74fca740 20 client.6009 populate_metadata read hostname 'smithi060' 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.680+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.105:6834/1216783001,v1:172.21.15.105:6835/1216783001] conn(0x55f010255e20 0x55f010220220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.680+0000 7f5b74fca740 4 client.6009 mds_command: new command op to 35168 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.680+0000 7f5b74fca740 1 -- 172.21.15.60:0/3996265750 --> [v2:172.21.15.105:6834/1216783001,v1:172.21.15.105:6835/1216783001] -- command(tid 0: {"prefix": "status"}) -- 0x55f0102226e0 con 0x55f010255e20 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.680+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.105:6834/1216783001,v1:172.21.15.105:6835/1216783001] conn(0x55f010255e20 0x55f010220220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b6b7fe640 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.105:6834/1216783001,v1:172.21.15.105:6835/1216783001] conn(0x55f010255e20 0x55f010220220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcc7e940de2a089 server_cookie=bab2bfffefee4cb2 in_seq=0 out_seq=0 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b4a7fc640 10 client.6009 ms_handle_connect on v2:172.21.15.105:6834/1216783001 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b4a7fc640 1 -- 172.21.15.60:0/3996265750 <== mds.0 v2:172.21.15.105:6834/1216783001 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f0102226e0 con 0x55f010255e20 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b4a7fc640 10 client.6009 handle_command_reply: tid=0 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b74fca740 1 client.6009 shutdown 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b74fca740 1 -- 172.21.15.60:0/3996265750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010203a50 msgr2=0x55f010225cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010203a50 0x55f010225cb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5b60013010 tx=0x7f5b600046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b74fca740 1 -- 172.21.15.60:0/3996265750 shutdown_connections 2024-09-12T01:38:46.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.105:6834/1216783001,v1:172.21.15.105:6835/1216783001] conn(0x55f010255e20 0x55f010220220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55f010229dc0 0x55f0102261f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f010203a50 0x55f010225cb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b4a7fc640 0 client.6009 ms_handle_reset on v2:172.21.15.105:6834/1216783001 2024-09-12T01:38:46.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b74fca740 1 --2- 172.21.15.60:0/3996265750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55f0102022c0 0x55f0102c46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b74fca740 1 -- 172.21.15.60:0/3996265750 >> 172.21.15.60:0/3996265750 conn(0x55f0101ffa80 msgr2=0x55f010259430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:46.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b74fca740 1 -- 172.21.15.60:0/3996265750 shutdown_connections 2024-09-12T01:38:46.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b74fca740 1 -- 172.21.15.60:0/3996265750 wait complete. 2024-09-12T01:38:46.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b74fca740 20 client.6009 trim_cache size 0 max 16384 2024-09-12T01:38:46.687 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:38:46.688 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "5401bd8a-3492-4b21-b6c0-d6616ff39793", 2024-09-12T01:38:46.688 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T01:38:46.688 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 35168, 2024-09-12T01:38:46.688 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T01:38:46.688 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T01:38:46.688 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-12T01:38:46.688 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 10.621981527999999, 2024-09-12T01:38:46.688 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 38, 2024-09-12T01:38:46.688 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 68, 2024-09-12T01:38:46.688 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 68, 2024-09-12T01:38:46.688 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 15.643471437000001 2024-09-12T01:38:46.688 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:38:46.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b7222e640 1 -- 172.21.15.60:0/4172799652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5b5806be30 msgr2=0x7f5b5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b7222e640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5b5806be30 0x7f5b5806e2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c1e5890 tx=0x7f5b60008040 comp rx=0 tx=0).stop 2024-09-12T01:38:46.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b7222e640 1 -- 172.21.15.60:0/4172799652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 msgr2=0x7f5b6c0cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.681+0000 7f5b7222e640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 0x7f5b6c0cc2d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0072f0 tx=0x7f5b5c0077b0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.682+0000 7f5b7222e640 1 -- 172.21.15.60:0/4172799652 shutdown_connections 2024-09-12T01:38:46.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.682+0000 7f5b7222e640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5b6c0cfec0 0x7f5b6c0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.682+0000 7f5b7222e640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5b5806be30 0x7f5b5806e2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.682+0000 7f5b7222e640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5b6c0cac70 0x7f5b6c14ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.682+0000 7f5b7222e640 1 --2- 172.21.15.60:0/4172799652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b540052e0 0x7f5b6c0cc2d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.682+0000 7f5b7222e640 1 -- 172.21.15.60:0/4172799652 >> 172.21.15.60:0/4172799652 conn(0x7f5b6c06d0f0 msgr2=0x7f5b6c0b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:46.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.682+0000 7f5b7222e640 1 -- 172.21.15.60:0/4172799652 shutdown_connections 2024-09-12T01:38:46.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.682+0000 7f5b7222e640 1 -- 172.21.15.60:0/4172799652 wait complete. 2024-09-12T01:38:46.693 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:38:46.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.796+0000 7f84e97d8640 1 Processor -- start 2024-09-12T01:38:46.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.796+0000 7f84e97d8640 1 -- start start 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e97d8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e415c550 0x7f84e40b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e97d8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f84e40b6310 0x7f84e40b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e97d8640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84e40b4cf0 con 0x7f84e415c170 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e97d8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f84e40b4fd0 con 0x7f84e40b6310 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e97d8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f84e40b52b0 con 0x7f84e415c550 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e2ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f84e415c170 0x7f84e40cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:32884/0 (socket says 172.21.15.60:32884) 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e2ffd640 1 -- 172.21.15.60:0/2997716587 learned_addr learned my addr 172.21.15.60:0/2997716587 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e37fe640 1 --2- 172.21.15.60:0/2997716587 >> v2:172.21.15.60:3300/0 conn(0x7f84e40b6310 0x7f84e40b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e27fc640 1 --2- 172.21.15.60:0/2997716587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e415c550 0x7f84e40b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e37fe640 1 -- 172.21.15.60:0/2997716587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e415c550 msgr2=0x7f84e40b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e37fe640 1 --2- 172.21.15.60:0/2997716587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e415c550 0x7f84e40b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e37fe640 1 -- 172.21.15.60:0/2997716587 >> v1:172.21.15.60:6789/0 conn(0x7f84e415c170 legacy=0x7f84e40cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e37fe640 1 -- 172.21.15.60:0/2997716587 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e40b5590 con 0x7f84e40b6310 2024-09-12T01:38:46.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.797+0000 7f84e27fc640 1 --2- 172.21.15.60:0/2997716587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e415c550 0x7f84e40b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.798+0000 7f84e37fe640 1 --2- 172.21.15.60:0/2997716587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e40b6310 0x7f84e40b39b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0097a0 tx=0x7f84dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ffe04693bafa577 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.798+0000 7f84e1ffb640 1 -- 172.21.15.60:0/2997716587 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc037070 con 0x7f84e40b6310 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.798+0000 7f84e1ffb640 1 -- 172.21.15.60:0/2997716587 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84dc032440 con 0x7f84e40b6310 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.798+0000 7f84e1ffb640 1 -- 172.21.15.60:0/2997716587 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84dc032810 con 0x7f84e40b6310 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.799+0000 7f84e97d8640 1 -- 172.21.15.60:0/2997716587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e40b6310 msgr2=0x7f84e40b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.799+0000 7f84e97d8640 1 --2- 172.21.15.60:0/2997716587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e40b6310 0x7f84e40b39b0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0097a0 tx=0x7f84dc02a180 comp rx=0 tx=0).stop 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.799+0000 7f84e97d8640 1 -- 172.21.15.60:0/2997716587 shutdown_connections 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.799+0000 7f84e97d8640 1 --2- 172.21.15.60:0/2997716587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e40b6310 0x7f84e40b39b0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.799+0000 7f84e97d8640 1 --2- 172.21.15.60:0/2997716587 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e415c550 0x7f84e40b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.799+0000 7f84e97d8640 1 -- 172.21.15.60:0/2997716587 >> 172.21.15.60:0/2997716587 conn(0x7f84e406bc10 msgr2=0x7f84e406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.799+0000 7f84e97d8640 1 -- 172.21.15.60:0/2997716587 shutdown_connections 2024-09-12T01:38:46.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.799+0000 7f84e97d8640 1 -- 172.21.15.60:0/2997716587 wait complete. 2024-09-12T01:38:46.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.800+0000 7f84e97d8640 1 Processor -- start 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.800+0000 7f84e97d8640 1 -- start start 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e97d8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e40b6310 0x7f84e4155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e97d8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e415c170 0x7f84e414adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e97d8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e415c550 0x7f84e41e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e97d8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f84e415c990 con 0x7f84e40b6310 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e97d8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f84e40b5b50 con 0x7f84e415c550 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e97d8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f84e40cfdd0 con 0x7f84e415c170 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e40b6310 0x7f84e4155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e2ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e40b6310 0x7f84e4155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51486/0 (socket says 172.21.15.60:51486) 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e2ffd640 1 -- 172.21.15.60:0/4275759871 learned_addr learned my addr 172.21.15.60:0/4275759871 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e37fe640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e415c550 0x7f84e41e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e27fc640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e415c170 0x7f84e414adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e2ffd640 1 -- 172.21.15.60:0/4275759871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e415c170 msgr2=0x7f84e414adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e2ffd640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e415c170 0x7f84e414adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e2ffd640 1 -- 172.21.15.60:0/4275759871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e415c550 msgr2=0x7f84e41e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e2ffd640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e415c550 0x7f84e41e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e2ffd640 1 -- 172.21.15.60:0/4275759871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84e41e6340 con 0x7f84e40b6310 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.801+0000 7f84e27fc640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e415c170 0x7f84e414adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.802+0000 7f84e2ffd640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e40b6310 0x7f84e4155510 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f84d400cb10 tx=0x7f84d400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.802+0000 7f84db7fe640 1 -- 172.21.15.60:0/4275759871 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4017070 con 0x7f84e40b6310 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.802+0000 7f84db7fe640 1 -- 172.21.15.60:0/4275759871 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84d400ac70 con 0x7f84e40b6310 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.802+0000 7f84e97d8640 1 -- 172.21.15.60:0/4275759871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84e41e6620 con 0x7f84e40b6310 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.802+0000 7f84db7fe640 1 -- 172.21.15.60:0/4275759871 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4012620 con 0x7f84e40b6310 2024-09-12T01:38:46.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.802+0000 7f84e97d8640 1 -- 172.21.15.60:0/4275759871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84e41e6be0 con 0x7f84e40b6310 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.803+0000 7f84e97d8640 1 -- 172.21.15.60:0/4275759871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84e40cf950 con 0x7f84e40b6310 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.803+0000 7f84db7fe640 1 -- 172.21.15.60:0/4275759871 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f84d401a070 con 0x7f84e40b6310 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.804+0000 7f84db7fe640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f84c406be30 0x7f84c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.804+0000 7f84db7fe640 1 -- 172.21.15.60:0/4275759871 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f84d408ab60 con 0x7f84e40b6310 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.804+0000 7f84e27fc640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f84c406be30 0x7f84c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:46.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.804+0000 7f84e27fc640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f84c406be30 0x7f84c406e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f84e406d640 tx=0x7f84cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:46.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:46.808+0000 7f84db7fe640 1 -- 172.21.15.60:0/4275759871 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f84d4058eb0 con 0x7f84e40b6310 2024-09-12T01:38:47.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.021+0000 7f84e97d8640 1 -- 172.21.15.60:0/4275759871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f84e40b5db0 con 0x7f84e40b6310 2024-09-12T01:38:47.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.021+0000 7f84db7fe640 1 -- 172.21.15.60:0/4275759871 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) ==== 53+0+73 (secure 0 0 0) 0x7f84d405d1b0 con 0x7f84e40b6310 2024-09-12T01:38:47.022 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:38:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.023+0000 7f84e97d8640 1 -- 172.21.15.60:0/4275759871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f84c406be30 msgr2=0x7f84c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.023+0000 7f84e97d8640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f84c406be30 0x7f84c406e2f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f84e406d640 tx=0x7f84cc008040 comp rx=0 tx=0).stop 2024-09-12T01:38:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.024+0000 7f84e97d8640 1 -- 172.21.15.60:0/4275759871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e40b6310 msgr2=0x7f84e4155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.024+0000 7f84e97d8640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e40b6310 0x7f84e4155510 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f84d400cb10 tx=0x7f84d400a060 comp rx=0 tx=0).stop 2024-09-12T01:38:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.024+0000 7f84e97d8640 1 -- 172.21.15.60:0/4275759871 shutdown_connections 2024-09-12T01:38:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.024+0000 7f84e97d8640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f84e415c550 0x7f84e41e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.024+0000 7f84e97d8640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f84c406be30 0x7f84c406e2f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.024+0000 7f84e97d8640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f84e415c170 0x7f84e414adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.024+0000 7f84e97d8640 1 --2- 172.21.15.60:0/4275759871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84e40b6310 0x7f84e4155510 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.024+0000 7f84e97d8640 1 -- 172.21.15.60:0/4275759871 >> 172.21.15.60:0/4275759871 conn(0x7f84e406bc10 msgr2=0x7f84e406d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.024+0000 7f84e97d8640 1 -- 172.21.15.60:0/4275759871 shutdown_connections 2024-09-12T01:38:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.024+0000 7f84e97d8640 1 -- 172.21.15.60:0/4275759871 wait complete. 2024-09-12T01:38:47.035 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:38:47.035 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:38:47.036 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T01:38:47.036 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:38:47.036 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:38:47.036 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:38:47.036 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:38:47.036 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:38:47.036 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:38:47.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:47.036 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T01:38:47.053 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:38:47.053 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:38:47.053 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:38:47.053 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:47.053 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:38:47.053 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:47.053 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:38:47.053 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:47.053 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T01:38:47.053 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42593sec preferred_lft 42593sec 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:38:47.054 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:47.055 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:38:47.055 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:47.055 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e8cb:28ff:fea3:34fb/64 scope link 2024-09-12T01:38:47.055 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:47.055 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:38:47.055 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 72:47:53:4d:4f:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:38:47.055 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7047:53ff:fe4d:4fc7/64 scope link 2024-09-12T01:38:47.055 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:47.055 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:38:47.055 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:38:47.055 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::183c:47ff:fec1:173/64 scope link 2024-09-12T01:38:47.055 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:47.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:47.056 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:38:47.118 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T01:38:47.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:47.119 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T01:38:47.176 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T01:38:47.176 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:38:47.176 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:38:47.176 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:38:47.176 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:38:47.177 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:38:47.177 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:38:47.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:38:47.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:38:47.177 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:38:47.177 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:38:47.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:38:47.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:38:47.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:47.306 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:38:47.321 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:38:47.322 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:38:47.322 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:38:47.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:47.322 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-12T01:38:47.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:38:47.388 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:38:47.444 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:38:47.444 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:38:47.444 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:38:47.499 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T01:38:47.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:47.500 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:38:47.585 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:38:47.585 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:38:47.592 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:38:47.593 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:38:47.593 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:38:47.593 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:38:47.593 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:38:47.593 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:38:47.593 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:38:47.594 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:38:47.594 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:38:47.594 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:38:47.595 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:38:47.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:47.596 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:38:47.622 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:38:47.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:38:47.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:38:47.727 INFO:teuthology.orchestra.run.smithi060.stdout:client35255 2024-09-12T01:38:47.728 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:47.728 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:47.745 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:38:47.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.887+0000 7f048ae50640 1 Processor -- start 2024-09-12T01:38:47.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.887+0000 7f048ae50640 1 -- start start 2024-09-12T01:38:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f048ae50640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f04840d1c80 0x7f04840b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:47.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f048ae50640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04840cfc20 con 0x7f04840cf6b0 2024-09-12T01:38:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f048ae50640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04840d2ed0 con 0x7f04840b63d0 2024-09-12T01:38:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f048ae50640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f04840d40c0 con 0x7f04840d1c80 2024-09-12T01:38:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f0483fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f04840cf6b0 0x7f04841629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:32890/0 (socket says 172.21.15.60:32890) 2024-09-12T01:38:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f0483fff640 1 -- 172.21.15.60:0/302887284 learned_addr learned my addr 172.21.15.60:0/302887284 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387039482 0 0) 0x7f04840cfc20 con 0x7f04840cf6b0 2024-09-12T01:38:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0474003520 con 0x7f04840cf6b0 2024-09-12T01:38:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f04893ed640 1 --2- 172.21.15.60:0/302887284 >> v2:172.21.15.105:3300/0 conn(0x7f04840d1c80 0x7f04840b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 897745514 0 0) 0x7f0474003520 con 0x7f04840cf6b0 2024-09-12T01:38:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 >> v2:172.21.15.105:3300/0 conn(0x7f04840d1c80 msgr2=0x7f04840b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f04837fe640 1 --2- 172.21.15.60:0/302887284 >> v2:172.21.15.105:3300/0 conn(0x7f04840d1c80 0x7f04840b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 >> v1:172.21.15.105:6789/0 conn(0x7f04840b63d0 legacy=0x7f04840d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:47.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.888+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04840d31b0 con 0x7f04840cf6b0 2024-09-12T01:38:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f0470001670 con 0x7f04840cf6b0 2024-09-12T01:38:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 >> v1:172.21.15.60:6789/0 conn(0x7f04840cf6b0 legacy=0x7f04841629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04837fe640 1 --2- 172.21.15.60:0/302887284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0474003a00 0x7f0474003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04837fe640 1 --2- 172.21.15.60:0/302887284 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0474004800 0x7f0474004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04837fe640 1 --2- 172.21.15.60:0/302887284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0474005210 0x7f047400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f04840d40c0 con 0x7f0474005210 2024-09-12T01:38:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f047400c160 con 0x7f0474003a00 2024-09-12T01:38:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f047400c360 con 0x7f0474004800 2024-09-12T01:38:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04893ed640 1 --2- 172.21.15.60:0/302887284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0474005210 0x7f047400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f0483fff640 1 --2- 172.21.15.60:0/302887284 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0474004800 0x7f0474004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:47.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f0488bec640 1 --2- 172.21.15.60:0/302887284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0474003a00 0x7f0474003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04893ed640 1 -- 172.21.15.60:0/302887284 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0474004800 msgr2=0x7f0474004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04893ed640 1 --2- 172.21.15.60:0/302887284 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0474004800 0x7f0474004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04893ed640 1 -- 172.21.15.60:0/302887284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0474003a00 msgr2=0x7f0474003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04893ed640 1 --2- 172.21.15.60:0/302887284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0474003a00 0x7f0474003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f04893ed640 1 -- 172.21.15.60:0/302887284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0474003520 con 0x7f0474005210 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.889+0000 7f0483fff640 1 --2- 172.21.15.60:0/302887284 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0474004800 0x7f0474004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.890+0000 7f04893ed640 1 -- 172.21.15.60:0/302887284 reap_dead start 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.890+0000 7f04893ed640 1 --2- 172.21.15.60:0/302887284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0474005210 0x7f047400b9c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f047c009f90 tx=0x7f0474005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d281b9a93b8bbc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.890+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c035020 con 0x7f0474005210 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.890+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047c003b90 con 0x7f0474005210 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.890+0000 7f04837fe640 1 -- 172.21.15.60:0/302887284 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c009c10 con 0x7f0474005210 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.890+0000 7f048ae50640 1 -- 172.21.15.60:0/302887284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0474005210 msgr2=0x7f047400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:47.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.890+0000 7f048ae50640 1 --2- 172.21.15.60:0/302887284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0474005210 0x7f047400b9c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f047c009f90 tx=0x7f0474005830 comp rx=0 tx=0).stop 2024-09-12T01:38:47.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.891+0000 7f048ae50640 1 -- 172.21.15.60:0/302887284 shutdown_connections 2024-09-12T01:38:47.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.891+0000 7f048ae50640 1 --2- 172.21.15.60:0/302887284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0474005210 0x7f047400b9c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:47.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.891+0000 7f048ae50640 1 -- 172.21.15.60:0/302887284 >> 172.21.15.60:0/302887284 conn(0x7f04840d1160 msgr2=0x7f04840d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:47.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.891+0000 7f048ae50640 1 -- 172.21.15.60:0/302887284 shutdown_connections 2024-09-12T01:38:47.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.891+0000 7f048ae50640 1 -- 172.21.15.60:0/302887284 wait complete. 2024-09-12T01:38:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.892+0000 7f048ae50640 1 Processor -- start 2024-09-12T01:38:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.892+0000 7f048ae50640 1 -- start start 2024-09-12T01:38:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f048ae50640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0474005210 0x7f04840c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f048ae50640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04840caa70 0x7f048414f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f048ae50640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0484160ae0 0x7f048415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:47.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f048ae50640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f04840cb5c0 con 0x7f04840caa70 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f048ae50640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f04840cb440 con 0x7f0474005210 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f048ae50640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f04840b67b0 con 0x7f0484160ae0 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f0483fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04840caa70 0x7f048414f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f0483fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04840caa70 0x7f048414f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51496/0 (socket says 172.21.15.60:51496) 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f0483fff640 1 -- 172.21.15.60:0/2753002319 learned_addr learned my addr 172.21.15.60:0/2753002319 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f04893ed640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0484160ae0 0x7f048415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f0488bec640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0474005210 0x7f04840c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f0483fff640 1 -- 172.21.15.60:0/2753002319 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0484160ae0 msgr2=0x7f048415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f0483fff640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0484160ae0 0x7f048415c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f0483fff640 1 -- 172.21.15.60:0/2753002319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0474005210 msgr2=0x7f04840c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f0483fff640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0474005210 0x7f04840c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f0483fff640 1 -- 172.21.15.60:0/2753002319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048414fed0 con 0x7f04840caa70 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f0483fff640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04840caa70 0x7f048414f990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f047000e730 tx=0x7f047000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:47.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f04817fa640 1 -- 172.21.15.60:0/2753002319 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047000c660 con 0x7f04840caa70 2024-09-12T01:38:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f04817fa640 1 -- 172.21.15.60:0/2753002319 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0470018070 con 0x7f04840caa70 2024-09-12T01:38:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f048ae50640 1 -- 172.21.15.60:0/2753002319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04840c99d0 con 0x7f04840caa70 2024-09-12T01:38:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.893+0000 7f04817fa640 1 -- 172.21.15.60:0/2753002319 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047000ca20 con 0x7f04840caa70 2024-09-12T01:38:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.894+0000 7f048ae50640 1 -- 172.21.15.60:0/2753002319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04840c9f90 con 0x7f04840caa70 2024-09-12T01:38:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.894+0000 7f048ae50640 1 -- 172.21.15.60:0/2753002319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04840d39b0 con 0x7f04840caa70 2024-09-12T01:38:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.895+0000 7f04817fa640 1 -- 172.21.15.60:0/2753002319 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f047000cbc0 con 0x7f04840caa70 2024-09-12T01:38:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.896+0000 7f04817fa640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f046806be60 0x7f046806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.896+0000 7f0488bec640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f046806be60 0x7f046806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.896+0000 7f04817fa640 1 -- 172.21.15.60:0/2753002319 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f047008ac70 con 0x7f04840caa70 2024-09-12T01:38:47.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.896+0000 7f0488bec640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f046806be60 0x7f046806e320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0478000c00 tx=0x7f0478009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:47.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:47.900+0000 7f04817fa640 1 -- 172.21.15.60:0/2753002319 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0470059580 con 0x7f04840caa70 2024-09-12T01:38:48.076 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:38:48.078 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:38:48.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.112+0000 7f048ae50640 1 -- 172.21.15.60:0/2753002319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f04840cf280 con 0x7f04840caa70 2024-09-12T01:38:48.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.113+0000 7f04817fa640 1 -- 172.21.15.60:0/2753002319 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) ==== 53+0+73 (secure 0 0 0) 0x7f0470058e80 con 0x7f04840caa70 2024-09-12T01:38:48.113 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:38:48.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.115+0000 7f048ae50640 1 -- 172.21.15.60:0/2753002319 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f046806be60 msgr2=0x7f046806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:48.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.115+0000 7f048ae50640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f046806be60 0x7f046806e320 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0478000c00 tx=0x7f0478009040 comp rx=0 tx=0).stop 2024-09-12T01:38:48.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.115+0000 7f048ae50640 1 -- 172.21.15.60:0/2753002319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04840caa70 msgr2=0x7f048414f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:48.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.115+0000 7f048ae50640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04840caa70 0x7f048414f990 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f047000e730 tx=0x7f047000ebf0 comp rx=0 tx=0).stop 2024-09-12T01:38:48.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.115+0000 7f048ae50640 1 -- 172.21.15.60:0/2753002319 shutdown_connections 2024-09-12T01:38:48.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.115+0000 7f048ae50640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f046806be60 0x7f046806e320 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:48.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.115+0000 7f048ae50640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0484160ae0 0x7f048415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:48.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.115+0000 7f048ae50640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04840caa70 0x7f048414f990 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:48.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.115+0000 7f048ae50640 1 --2- 172.21.15.60:0/2753002319 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0474005210 0x7f04840c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:48.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.115+0000 7f048ae50640 1 -- 172.21.15.60:0/2753002319 >> 172.21.15.60:0/2753002319 conn(0x7f04840d1160 msgr2=0x7f04840b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:48.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.115+0000 7f048ae50640 1 -- 172.21.15.60:0/2753002319 shutdown_connections 2024-09-12T01:38:48.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.115+0000 7f048ae50640 1 -- 172.21.15.60:0/2753002319 wait complete. 2024-09-12T01:38:48.126 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:38:48.126 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:38:48.126 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T01:38:48.126 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:38:48.126 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:38:48.126 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:38:48.126 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:38:48.126 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:38:48.126 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:38:48.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:48.127 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T01:38:48.145 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:38:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:38:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:38:48.145 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:38:48.146 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42595sec preferred_lft 42595sec 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::c46c:baff:feeb:1f5e/64 scope link 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 56:66:28:3d:b2:45 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::5466:28ff:fe3d:b245/64 scope link 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:38:48.147 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:38:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::2036:4aff:fe87:b9cb/64 scope link 2024-09-12T01:38:48.148 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:38:48.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:48.148 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:38:48.212 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:38:48.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:48.213 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T01:38:48.272 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T01:38:48.272 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:38:48.272 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:38:48.272 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:38:48.273 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:38:48.273 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:38:48.273 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:38:48.273 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:38:48.273 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:38:48.273 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:38:48.273 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:38:48.364 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:38:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:38:48.397 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:38:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:38:48.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:48.403 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:38:48.419 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T01:38:48.419 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:38:48.419 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:38:48.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:48.420 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-12T01:38:48.485 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:38:48.485 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:38:48.541 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:38:48.541 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:38:48.541 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:38:48.596 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T01:38:48.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:48.597 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:38:48.679 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:38:48.679 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:38:48.686 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:38:48.686 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:38:48.686 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:38:48.687 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 1@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:38:48.687 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:38:48.687 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:38:48.687 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:38:48.687 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:38:48.687 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:38:48.687 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:38:48.689 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:38:48.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:48.689 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:38:48.754 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:38:48.843 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:38:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:38:48.844 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:38:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:38:48.853 INFO:teuthology.orchestra.run.smithi105.stdout:client35258 2024-09-12T01:38:48.854 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:38:48.854 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:48.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-12T01:38:48.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.990+0000 7fbe066b7640 1 Processor -- start 2024-09-12T01:38:48.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.990+0000 7fbe066b7640 1 -- start start 2024-09-12T01:38:48.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbe066b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe0015e7a0 0x7fbe0006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:48.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbe066b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbe000b68f0 0x7fbe000d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:48.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbe066b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe000cf860 con 0x7fbe000cf1f0 2024-09-12T01:38:48.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbe066b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbe000d2ca0 con 0x7fbe000b68f0 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbe066b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbe000cfb40 con 0x7fbe0015e7a0 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdff7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbe000cf1f0 0x7fbe000b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:32904/0 (socket says 172.21.15.60:32904) 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdff7fe640 1 -- 172.21.15.60:0/137159409 learned_addr learned my addr 172.21.15.60:0/137159409 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfffff640 1 --2- 172.21.15.60:0/137159409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe0015e7a0 0x7fbe0006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264707140 0 0) 0x7fbe000cf860 con 0x7fbe000cf1f0 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbe04c54640 1 --2- 172.21.15.60:0/137159409 >> v2:172.21.15.105:3300/0 conn(0x7fbe000b68f0 0x7fbe000d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbde8003520 con 0x7fbe000cf1f0 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 910696610 0 0) 0x7fbde8003520 con 0x7fbe000cf1f0 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe0015e7a0 msgr2=0x7fbe0006caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 --2- 172.21.15.60:0/137159409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe0015e7a0 0x7fbe0006caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 >> v2:172.21.15.105:3300/0 conn(0x7fbe000b68f0 msgr2=0x7fbe000d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 --2- 172.21.15.60:0/137159409 >> v2:172.21.15.105:3300/0 conn(0x7fbe000b68f0 0x7fbe000d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:48.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe000cfe20 con 0x7fbe000cf1f0 2024-09-12T01:38:48.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fbdf4001670 con 0x7fbe000cf1f0 2024-09-12T01:38:48.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 >> v1:172.21.15.60:6789/0 conn(0x7fbe000cf1f0 legacy=0x7fbe000b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:48.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 --2- 172.21.15.60:0/137159409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe0015e7a0 0x7fbde80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:48.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 --2- 172.21.15.60:0/137159409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbde8003f30 0x7fbde8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:48.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 --2- 172.21.15.60:0/137159409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde8004d40 0x7fbde80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:48.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbe000d2ca0 con 0x7fbde8004d40 2024-09-12T01:38:48.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe000cfb40 con 0x7fbde8003f30 2024-09-12T01:38:48.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.991+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbde800ba10 con 0x7fbe0015e7a0 2024-09-12T01:38:48.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.992+0000 7fbdfffff640 1 --2- 172.21.15.60:0/137159409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe0015e7a0 0x7fbde80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:48.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.992+0000 7fbe04c54640 1 --2- 172.21.15.60:0/137159409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde8004d40 0x7fbde80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:48.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.992+0000 7fbdff7fe640 1 --2- 172.21.15.60:0/137159409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbde8003f30 0x7fbde8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.992+0000 7fbdfffff640 1 -- 172.21.15.60:0/137159409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbde8003f30 msgr2=0x7fbde8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.992+0000 7fbdfffff640 1 --2- 172.21.15.60:0/137159409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbde8003f30 0x7fbde8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.992+0000 7fbdfffff640 1 -- 172.21.15.60:0/137159409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde8004d40 msgr2=0x7fbde80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.992+0000 7fbdfffff640 1 --2- 172.21.15.60:0/137159409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde8004d40 0x7fbde80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.992+0000 7fbdfffff640 1 -- 172.21.15.60:0/137159409 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde8003520 con 0x7fbe0015e7a0 2024-09-12T01:38:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.993+0000 7fbdfffff640 1 --2- 172.21.15.60:0/137159409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe0015e7a0 0x7fbde80039b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009af0 tx=0x7fbde8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74fc0a0849ff0033 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.993+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0036070 con 0x7fbe0015e7a0 2024-09-12T01:38:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.993+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf0031400 con 0x7fbe0015e7a0 2024-09-12T01:38:48.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.993+0000 7fbdfeffd640 1 -- 172.21.15.60:0/137159409 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0009690 con 0x7fbe0015e7a0 2024-09-12T01:38:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.993+0000 7fbe066b7640 1 -- 172.21.15.60:0/137159409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe0015e7a0 msgr2=0x7fbde80039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.993+0000 7fbe066b7640 1 --2- 172.21.15.60:0/137159409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe0015e7a0 0x7fbde80039b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009af0 tx=0x7fbde8005830 comp rx=0 tx=0).stop 2024-09-12T01:38:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.993+0000 7fbe04c54640 1 -- 172.21.15.60:0/137159409 reap_dead start 2024-09-12T01:38:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.993+0000 7fbe066b7640 1 -- 172.21.15.60:0/137159409 shutdown_connections 2024-09-12T01:38:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.993+0000 7fbe066b7640 1 -- 172.21.15.60:0/137159409 >> 172.21.15.60:0/137159409 conn(0x7fbe000d11e0 msgr2=0x7fbe000d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.993+0000 7fbe066b7640 1 -- 172.21.15.60:0/137159409 shutdown_connections 2024-09-12T01:38:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.993+0000 7fbe066b7640 1 -- 172.21.15.60:0/137159409 wait complete. 2024-09-12T01:38:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.995+0000 7fbe066b7640 1 Processor -- start 2024-09-12T01:38:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.995+0000 7fbe066b7640 1 -- start start 2024-09-12T01:38:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbe066b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0015e7a0 0x7fbe0014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbe066b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe000cded0 0x7fbe0015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbe066b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe00150360 0x7fbe001507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbe066b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0015eb80 con 0x7fbe0015e7a0 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbe066b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe000b7a00 con 0x7fbe00150360 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbe066b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0015ed00 con 0x7fbe000cded0 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbdfffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0015e7a0 0x7fbe0014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbdfffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0015e7a0 0x7fbe0014fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51518/0 (socket says 172.21.15.60:51518) 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbdfffff640 1 -- 172.21.15.60:0/1875767097 learned_addr learned my addr 172.21.15.60:0/1875767097 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbe04c54640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe00150360 0x7fbe001507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbdff7fe640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe000cded0 0x7fbe0015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbdfffff640 1 -- 172.21.15.60:0/1875767097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe000cded0 msgr2=0x7fbe0015ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbdfffff640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe000cded0 0x7fbe0015ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbdfffff640 1 -- 172.21.15.60:0/1875767097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe00150360 msgr2=0x7fbe001507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbdfffff640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe00150360 0x7fbe001507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbdfffff640 1 -- 172.21.15.60:0/1875767097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0015f780 con 0x7fbe0015e7a0 2024-09-12T01:38:49.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.996+0000 7fbdfffff640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0015e7a0 0x7fbe0014fcb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0000c00 tx=0x7fbdf0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.997+0000 7fbdfcff9640 1 -- 172.21.15.60:0/1875767097 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0040020 con 0x7fbe0015e7a0 2024-09-12T01:38:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.997+0000 7fbdfcff9640 1 -- 172.21.15.60:0/1875767097 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf0003810 con 0x7fbe0015e7a0 2024-09-12T01:38:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.997+0000 7fbe066b7640 1 -- 172.21.15.60:0/1875767097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0015fa60 con 0x7fbe0015e7a0 2024-09-12T01:38:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.997+0000 7fbdfcff9640 1 -- 172.21.15.60:0/1875767097 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0036040 con 0x7fbe0015e7a0 2024-09-12T01:38:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.997+0000 7fbe066b7640 1 -- 172.21.15.60:0/1875767097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe00160020 con 0x7fbe0015e7a0 2024-09-12T01:38:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.998+0000 7fbe066b7640 1 -- 172.21.15.60:0/1875767097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe000b61e0 con 0x7fbe0015e7a0 2024-09-12T01:38:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.998+0000 7fbdfcff9640 1 -- 172.21.15.60:0/1875767097 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbdf0043020 con 0x7fbe0015e7a0 2024-09-12T01:38:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.999+0000 7fbdfcff9640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbdec06be30 0x7fbdec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.999+0000 7fbdfcff9640 1 -- 172.21.15.60:0/1875767097 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fbdf00aac80 con 0x7fbe0015e7a0 2024-09-12T01:38:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.999+0000 7fbdff7fe640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbdec06be30 0x7fbdec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:48.999+0000 7fbdff7fe640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbdec06be30 0x7fbdec06e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbe000cc930 tx=0x7fbdf40078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:49.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.003+0000 7fbdfcff9640 1 -- 172.21.15.60:0/1875767097 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbdf004a070 con 0x7fbe0015e7a0 2024-09-12T01:38:49.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.181+0000 7fbe066b7640 1 -- 172.21.15.60:0/1875767097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7fbe000d2a80 con 0x7fbe0015e7a0 2024-09-12T01:38:49.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.181+0000 7fbdfcff9640 1 -- 172.21.15.60:0/1875767097 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v20) ==== 106+0+4 (secure 0 0 0) 0x7fbdf0078f40 con 0x7fbe0015e7a0 2024-09-12T01:38:49.181 INFO:teuthology.orchestra.run.smithi060.stdout:100 2024-09-12T01:38:49.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.183+0000 7fbe066b7640 1 -- 172.21.15.60:0/1875767097 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbdec06be30 msgr2=0x7fbdec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.183+0000 7fbe066b7640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbdec06be30 0x7fbdec06e2f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbe000cc930 tx=0x7fbdf40078f0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.183+0000 7fbe066b7640 1 -- 172.21.15.60:0/1875767097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0015e7a0 msgr2=0x7fbe0014fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.183+0000 7fbe066b7640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0015e7a0 0x7fbe0014fcb0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0000c00 tx=0x7fbdf0004730 comp rx=0 tx=0).stop 2024-09-12T01:38:49.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.183+0000 7fbe066b7640 1 -- 172.21.15.60:0/1875767097 shutdown_connections 2024-09-12T01:38:49.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.183+0000 7fbe066b7640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe00150360 0x7fbe001507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.183+0000 7fbe066b7640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbdec06be30 0x7fbdec06e2f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.183+0000 7fbe066b7640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe000cded0 0x7fbe0015ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.183+0000 7fbe066b7640 1 --2- 172.21.15.60:0/1875767097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe0015e7a0 0x7fbe0014fcb0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.183+0000 7fbe066b7640 1 -- 172.21.15.60:0/1875767097 >> 172.21.15.60:0/1875767097 conn(0x7fbe000d11e0 msgr2=0x7fbe000d4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:49.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.183+0000 7fbe066b7640 1 -- 172.21.15.60:0/1875767097 shutdown_connections 2024-09-12T01:38:49.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.183+0000 7fbe066b7640 1 -- 172.21.15.60:0/1875767097 wait complete. 2024-09-12T01:38:49.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_max_caps_per_client 200 2024-09-12T01:38:49.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.299+0000 7fdd35118640 1 Processor -- start 2024-09-12T01:38:49.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.299+0000 7fdd35118640 1 -- start start 2024-09-12T01:38:49.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd35118640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdd3015e600 0x7fdd300d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd35118640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdd300d1a40 0x7fdd300cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd35118640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd300b7ad0 con 0x7fdd300cf2f0 2024-09-12T01:38:49.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd35118640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdd300d1e90 con 0x7fdd300d1a40 2024-09-12T01:38:49.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd35118640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdd300d2ee0 con 0x7fdd3015e600 2024-09-12T01:38:49.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd2e59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdd300d1a40 0x7fdd300cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd2f59e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdd300cf2f0 0x7fdd300b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:32906/0 (socket says 172.21.15.60:32906) 2024-09-12T01:38:49.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd2e59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdd300d1a40 0x7fdd300cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51522/0 (socket says 172.21.15.60:51522) 2024-09-12T01:38:49.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd2f59e640 1 -- 172.21.15.60:0/1762939087 learned_addr learned my addr 172.21.15.60:0/1762939087 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:49.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd2ed9d640 1 --2- 172.21.15.60:0/1762939087 >> v2:172.21.15.105:3300/0 conn(0x7fdd3015e600 0x7fdd300d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd2e59c640 1 -- 172.21.15.60:0/1762939087 >> v2:172.21.15.105:3300/0 conn(0x7fdd3015e600 msgr2=0x7fdd300d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:49.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd2e59c640 1 --2- 172.21.15.60:0/1762939087 >> v2:172.21.15.105:3300/0 conn(0x7fdd3015e600 0x7fdd300d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd2e59c640 1 -- 172.21.15.60:0/1762939087 >> v1:172.21.15.60:6789/0 conn(0x7fdd300cf2f0 legacy=0x7fdd300b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd2e59c640 1 -- 172.21.15.60:0/1762939087 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd300cf9e0 con 0x7fdd300d1a40 2024-09-12T01:38:49.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.300+0000 7fdd2dd9b640 1 -- 172.21.15.60:0/1762939087 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192128711 0 0) 0x7fdd28001490 con 0x7fdd300cf2f0 2024-09-12T01:38:49.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.301+0000 7fdd2e59c640 1 --2- 172.21.15.60:0/1762939087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd300d1a40 0x7fdd300cedb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fdd3008d1e0 tx=0x7fdd2402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931c0db3e1217479 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:49.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.301+0000 7fdd2dd9b640 1 -- 172.21.15.60:0/1762939087 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24037070 con 0x7fdd300d1a40 2024-09-12T01:38:49.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.301+0000 7fdd2dd9b640 1 -- 172.21.15.60:0/1762939087 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd24032440 con 0x7fdd300d1a40 2024-09-12T01:38:49.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.301+0000 7fdd2dd9b640 1 -- 172.21.15.60:0/1762939087 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd24032810 con 0x7fdd300d1a40 2024-09-12T01:38:49.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.302+0000 7fdd35118640 1 -- 172.21.15.60:0/1762939087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd300d1a40 msgr2=0x7fdd300cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.302+0000 7fdd35118640 1 --2- 172.21.15.60:0/1762939087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd300d1a40 0x7fdd300cedb0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fdd3008d1e0 tx=0x7fdd2402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.302+0000 7fdd35118640 1 -- 172.21.15.60:0/1762939087 shutdown_connections 2024-09-12T01:38:49.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.302+0000 7fdd35118640 1 --2- 172.21.15.60:0/1762939087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd300d1a40 0x7fdd300cedb0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.302+0000 7fdd35118640 1 --2- 172.21.15.60:0/1762939087 >> v2:172.21.15.105:3300/0 conn(0x7fdd3015e600 0x7fdd300d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.302+0000 7fdd35118640 1 -- 172.21.15.60:0/1762939087 >> 172.21.15.60:0/1762939087 conn(0x7fdd3006c2c0 msgr2=0x7fdd3006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:49.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.302+0000 7fdd35118640 1 -- 172.21.15.60:0/1762939087 shutdown_connections 2024-09-12T01:38:49.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.302+0000 7fdd35118640 1 -- 172.21.15.60:0/1762939087 wait complete. 2024-09-12T01:38:49.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.303+0000 7fdd35118640 1 Processor -- start 2024-09-12T01:38:49.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.303+0000 7fdd35118640 1 -- start start 2024-09-12T01:38:49.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd35118640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd300cf2f0 0x7fdd30153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd35118640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd300d1a40 0x7fdd301617d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd35118640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd3015e600 0x7fdd3015fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd35118640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdd300cffa0 con 0x7fdd3015e600 2024-09-12T01:38:49.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd35118640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdd300cf780 con 0x7fdd300cf2f0 2024-09-12T01:38:49.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd35118640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdd300d2b70 con 0x7fdd300d1a40 2024-09-12T01:38:49.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd2f59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd3015e600 0x7fdd3015fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd2f59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd3015e600 0x7fdd3015fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51536/0 (socket says 172.21.15.60:51536) 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd2f59e640 1 -- 172.21.15.60:0/2662752570 learned_addr learned my addr 172.21.15.60:0/2662752570 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd2ed9d640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd300cf2f0 0x7fdd30153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd2e59c640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd300d1a40 0x7fdd301617d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd2f59e640 1 -- 172.21.15.60:0/2662752570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd300d1a40 msgr2=0x7fdd301617d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.304+0000 7fdd2f59e640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd300d1a40 0x7fdd301617d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.305+0000 7fdd2f59e640 1 -- 172.21.15.60:0/2662752570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd300cf2f0 msgr2=0x7fdd30153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.305+0000 7fdd2f59e640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd300cf2f0 0x7fdd30153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.305+0000 7fdd2f59e640 1 -- 172.21.15.60:0/2662752570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3015ee40 con 0x7fdd3015e600 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.305+0000 7fdd2f59e640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd3015e600 0x7fdd3015fee0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800c7f0 tx=0x7fdd2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.305+0000 7fdd177fe640 1 -- 172.21.15.60:0/2662752570 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd28018070 con 0x7fdd3015e600 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.305+0000 7fdd177fe640 1 -- 172.21.15.60:0/2662752570 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd2800a5e0 con 0x7fdd3015e600 2024-09-12T01:38:49.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.305+0000 7fdd35118640 1 -- 172.21.15.60:0/2662752570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3015f120 con 0x7fdd3015e600 2024-09-12T01:38:49.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.305+0000 7fdd177fe640 1 -- 172.21.15.60:0/2662752570 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2800a9d0 con 0x7fdd3015e600 2024-09-12T01:38:49.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.305+0000 7fdd35118640 1 -- 172.21.15.60:0/2662752570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd3015f6e0 con 0x7fdd3015e600 2024-09-12T01:38:49.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.306+0000 7fdd35118640 1 -- 172.21.15.60:0/2662752570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd300d25f0 con 0x7fdd3015e600 2024-09-12T01:38:49.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.306+0000 7fdd177fe640 1 -- 172.21.15.60:0/2662752570 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdd2801b070 con 0x7fdd3015e600 2024-09-12T01:38:49.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.307+0000 7fdd177fe640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdd1c06be30 0x7fdd1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:49.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.307+0000 7fdd2ed9d640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdd1c06be30 0x7fdd1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:49.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.307+0000 7fdd177fe640 1 -- 172.21.15.60:0/2662752570 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fdd2808a480 con 0x7fdd3015e600 2024-09-12T01:38:49.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.307+0000 7fdd2ed9d640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdd1c06be30 0x7fdd1c06e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009a30 tx=0x7fdd20008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:49.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.311+0000 7fdd177fe640 1 -- 172.21.15.60:0/2662752570 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdd300b7ad0 con 0x7fdd3015e600 2024-09-12T01:38:49.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.488+0000 7fdd35118640 1 -- 172.21.15.60:0/2662752570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_max_caps_per_client}] v 0) -- 0x7fdd300d47f0 con 0x7fdd3015e600 2024-09-12T01:38:49.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.491+0000 7fdd177fe640 1 -- 172.21.15.60:0/2662752570 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_max_caps_per_client}]=0 v21)=0 v21) ==== 123+0+0 (secure 0 0 0) 0x7fdd28058e30 con 0x7fdd3015e600 2024-09-12T01:38:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.493+0000 7fdd35118640 1 -- 172.21.15.60:0/2662752570 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdd1c06be30 msgr2=0x7fdd1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.493+0000 7fdd35118640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdd1c06be30 0x7fdd1c06e2f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fdd20009a30 tx=0x7fdd20008040 comp rx=0 tx=0).stop 2024-09-12T01:38:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.493+0000 7fdd35118640 1 -- 172.21.15.60:0/2662752570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd3015e600 msgr2=0x7fdd3015fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.493+0000 7fdd35118640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd3015e600 0x7fdd3015fee0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fdd2800c7f0 tx=0x7fdd2800ccb0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.493+0000 7fdd35118640 1 -- 172.21.15.60:0/2662752570 shutdown_connections 2024-09-12T01:38:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.493+0000 7fdd35118640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdd3015e600 0x7fdd3015fee0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.493+0000 7fdd35118640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdd1c06be30 0x7fdd1c06e2f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.493+0000 7fdd35118640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd300d1a40 0x7fdd301617d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.493+0000 7fdd35118640 1 --2- 172.21.15.60:0/2662752570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdd300cf2f0 0x7fdd30153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:49.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.493+0000 7fdd35118640 1 -- 172.21.15.60:0/2662752570 >> 172.21.15.60:0/2662752570 conn(0x7fdd3006c2c0 msgr2=0x7fdd300d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:49.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.494+0000 7fdd35118640 1 -- 172.21.15.60:0/2662752570 shutdown_connections 2024-09-12T01:38:49.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:49.494+0000 7fdd35118640 1 -- 172.21.15.60:0/2662752570 wait complete. 2024-09-12T01:38:49.505 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:49.505 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:49.521 DEBUG:teuthology.orchestra.run.smithi060:> stdin-killer -- python3 -c ' 2024-09-12T01:38:49.521 DEBUG:teuthology.orchestra.run.smithi060:> import os 2024-09-12T01:38:49.521 DEBUG:teuthology.orchestra.run.smithi060:> import uuid 2024-09-12T01:38:49.521 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:38:49.521 DEBUG:teuthology.orchestra.run.smithi060:> n = 600 2024-09-12T01:38:49.521 DEBUG:teuthology.orchestra.run.smithi060:> create_hard_links = False 2024-09-12T01:38:49.521 DEBUG:teuthology.orchestra.run.smithi060:> if 0 > 0: 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> create_hard_links = True 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> path = "/home/ubuntu/cephtest/mnt.0/foo/" 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> dpath = os.path.dirname(path) 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> fnameprefix = os.path.basename(path) 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> os.makedirs(dpath, exist_ok=True) 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> try: 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> dirfd = os.open(dpath, os.O_DIRECTORY) 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> for i in range(n): 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> with open(fpath, '"'"'w'"'"') as f: 2024-09-12T01:38:49.522 DEBUG:teuthology.orchestra.run.smithi060:> f.write(f"{i}") 2024-09-12T01:38:49.523 DEBUG:teuthology.orchestra.run.smithi060:> if True: 2024-09-12T01:38:49.523 DEBUG:teuthology.orchestra.run.smithi060:> f.flush() 2024-09-12T01:38:49.523 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(f.fileno()) 2024-09-12T01:38:49.523 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:38:49.523 DEBUG:teuthology.orchestra.run.smithi060:> os.unlink(fpath) 2024-09-12T01:38:49.524 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:38:49.524 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(dirfd) 2024-09-12T01:38:49.524 DEBUG:teuthology.orchestra.run.smithi060:> if create_hard_links: 2024-09-12T01:38:49.525 DEBUG:teuthology.orchestra.run.smithi060:> for j in range(0): 2024-09-12T01:38:49.525 DEBUG:teuthology.orchestra.run.smithi060:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2024-09-12T01:38:49.525 DEBUG:teuthology.orchestra.run.smithi060:> if False: 2024-09-12T01:38:49.525 DEBUG:teuthology.orchestra.run.smithi060:> os.fsync(dirfd) 2024-09-12T01:38:49.525 DEBUG:teuthology.orchestra.run.smithi060:> finally: 2024-09-12T01:38:49.525 DEBUG:teuthology.orchestra.run.smithi060:> os.close(dirfd) 2024-09-12T01:38:49.525 DEBUG:teuthology.orchestra.run.smithi060:> ' 2024-09-12T01:38:52.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:38:52.193 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:52.193 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:52.250 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:38:52.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:38:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:38:52.349 INFO:teuthology.orchestra.run.smithi060.stdout:client35255 2024-09-12T01:38:52.349 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:52.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.451+0000 7fb4a4f98640 1 Processor -- start 2024-09-12T01:38:52.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.451+0000 7fb4a4f98640 1 -- start start 2024-09-12T01:38:52.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb4a4f98640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4a015e660 0x7fb4a00cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:52.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb4a4f98640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a015ea40 con 0x7fb4a00d1820 2024-09-12T01:38:52.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb4a4f98640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a00d3870 con 0x7fb4a00d3310 2024-09-12T01:38:52.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb4a4f98640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a00d3b50 con 0x7fb4a015e660 2024-09-12T01:38:52.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb49ed9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb4a00d1820 0x7fb4a00b7b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:32922/0 (socket says 172.21.15.60:32922) 2024-09-12T01:38:52.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb49ed9d640 1 -- 172.21.15.60:0/2208602124 learned_addr learned my addr 172.21.15.60:0/2208602124 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:52.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb49e59c640 1 --2- 172.21.15.60:0/2208602124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4a015e660 0x7fb4a00cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:52.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb49d59a640 1 -- 172.21.15.60:0/2208602124 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045362562 0 0) 0x7fb4a015ea40 con 0x7fb4a00d1820 2024-09-12T01:38:52.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb49d59a640 1 -- 172.21.15.60:0/2208602124 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb48c003520 con 0x7fb4a00d1820 2024-09-12T01:38:52.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb49d59a640 1 -- 172.21.15.60:0/2208602124 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2728791054 0 0) 0x7fb4a00d3870 con 0x7fb4a00d3310 2024-09-12T01:38:52.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb49d59a640 1 -- 172.21.15.60:0/2208602124 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4a015ea40 con 0x7fb4a00d3310 2024-09-12T01:38:52.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb49e59c640 1 -- 172.21.15.60:0/2208602124 >> v1:172.21.15.105:6789/0 conn(0x7fb4a00d3310 legacy=0x7fb4a00d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:52.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb49e59c640 1 -- 172.21.15.60:0/2208602124 >> v1:172.21.15.60:6789/0 conn(0x7fb4a00d1820 legacy=0x7fb4a00b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:52.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.452+0000 7fb49e59c640 1 -- 172.21.15.60:0/2208602124 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a00d3e30 con 0x7fb4a015e660 2024-09-12T01:38:52.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.453+0000 7fb49e59c640 1 --2- 172.21.15.60:0/2208602124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4a015e660 0x7fb4a00cf730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb490009dc0 tx=0x7fb49002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8a1be5c232e2d69 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:52.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.453+0000 7fb49d59a640 1 -- 172.21.15.60:0/2208602124 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490007740 con 0x7fb4a015e660 2024-09-12T01:38:52.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.453+0000 7fb49d59a640 1 -- 172.21.15.60:0/2208602124 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4900078e0 con 0x7fb4a015e660 2024-09-12T01:38:52.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.453+0000 7fb49d59a640 1 -- 172.21.15.60:0/2208602124 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490007c90 con 0x7fb4a015e660 2024-09-12T01:38:52.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.454+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2208602124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4a015e660 msgr2=0x7fb4a00cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:52.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.454+0000 7fb4a4f98640 1 --2- 172.21.15.60:0/2208602124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4a015e660 0x7fb4a00cf730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb490009dc0 tx=0x7fb49002a6d0 comp rx=0 tx=0).stop 2024-09-12T01:38:52.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.454+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2208602124 shutdown_connections 2024-09-12T01:38:52.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.454+0000 7fb4a4f98640 1 --2- 172.21.15.60:0/2208602124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4a015e660 0x7fb4a00cf730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:52.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.454+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2208602124 >> 172.21.15.60:0/2208602124 conn(0x7fb4a00b6410 msgr2=0x7fb4a00b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:52.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.454+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2208602124 shutdown_connections 2024-09-12T01:38:52.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.454+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2208602124 wait complete. 2024-09-12T01:38:52.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.455+0000 7fb4a4f98640 1 Processor -- start 2024-09-12T01:38:52.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.455+0000 7fb4a4f98640 1 -- start start 2024-09-12T01:38:52.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb4a4f98640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a00d1820 0x7fb4a0151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:52.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb4a4f98640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4a00d3310 0x7fb4a00c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb4a4f98640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a015e660 0x7fb4a00b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb4a4f98640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a00cfc70 con 0x7fb4a00d1820 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb4a4f98640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a00d43f0 con 0x7fb4a015e660 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb4a4f98640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a00b8280 con 0x7fb4a00d3310 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a00d1820 0x7fb4a0151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb49e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a00d1820 0x7fb4a0151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:51542/0 (socket says 172.21.15.60:51542) 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb49e59c640 1 -- 172.21.15.60:0/2660385995 learned_addr learned my addr 172.21.15.60:0/2660385995 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb49dd9b640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4a00d3310 0x7fb4a00c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb49ed9d640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a015e660 0x7fb4a00b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb49e59c640 1 -- 172.21.15.60:0/2660385995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4a00d3310 msgr2=0x7fb4a00c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb49e59c640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4a00d3310 0x7fb4a00c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb49e59c640 1 -- 172.21.15.60:0/2660385995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a015e660 msgr2=0x7fb4a00b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:52.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb49e59c640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a015e660 0x7fb4a00b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb49e59c640 1 -- 172.21.15.60:0/2660385995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a00cdc90 con 0x7fb4a00d1820 2024-09-12T01:38:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb49dd9b640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4a00d3310 0x7fb4a00c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.456+0000 7fb49ed9d640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a015e660 0x7fb4a00b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.457+0000 7fb49e59c640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a00d1820 0x7fb4a0151c70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb49002acc0 tx=0x7fb490004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.457+0000 7fb496ffd640 1 -- 172.21.15.60:0/2660385995 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490009450 con 0x7fb4a00d1820 2024-09-12T01:38:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.457+0000 7fb496ffd640 1 -- 172.21.15.60:0/2660385995 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb490004240 con 0x7fb4a00d1820 2024-09-12T01:38:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.457+0000 7fb496ffd640 1 -- 172.21.15.60:0/2660385995 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4900045f0 con 0x7fb4a00d1820 2024-09-12T01:38:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.457+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2660385995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a00ccbf0 con 0x7fb4a00d1820 2024-09-12T01:38:52.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.457+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2660385995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a00cd1b0 con 0x7fb4a00d1820 2024-09-12T01:38:52.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.458+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2660385995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4a00cf730 con 0x7fb4a00d1820 2024-09-12T01:38:52.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.458+0000 7fb496ffd640 1 -- 172.21.15.60:0/2660385995 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb49003b410 con 0x7fb4a00d1820 2024-09-12T01:38:52.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.459+0000 7fb496ffd640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb48006be30 0x7fb48006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:52.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.459+0000 7fb496ffd640 1 -- 172.21.15.60:0/2660385995 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fb4900ac080 con 0x7fb4a00d1820 2024-09-12T01:38:52.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.459+0000 7fb49dd9b640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb48006be30 0x7fb48006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:52.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.459+0000 7fb49dd9b640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb48006be30 0x7fb48006e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00b8750 tx=0x7fb488009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:52.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.463+0000 7fb496ffd640 1 -- 172.21.15.60:0/2660385995 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb4a00cdc90 con 0x7fb4a00d1820 2024-09-12T01:38:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.672+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2660385995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4a00b8780 con 0x7fb4a00d1820 2024-09-12T01:38:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.672+0000 7fb496ffd640 1 -- 172.21.15.60:0/2660385995 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7fb49003f030 con 0x7fb4a00d1820 2024-09-12T01:38:52.673 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:52.673 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":38,"btime":"2024-09-12T01:38:39:078790+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/672507371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":672507371},{"type":"v1","addr":"172.21.15.60:6836","nonce":672507371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/2426056287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2426056287},{"type":"v1","addr":"172.21.15.105:6833","nonce":2426056287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/183879558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":183879558},{"type":"v1","addr":"172.21.15.60:6837","nonce":183879558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:35.419604+0000","modified":"2024-09-12T01:38:38.117150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35168":{"gid":35168,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1216783001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1216783001},{"type":"v1","addr":"172.21.15.105:6835","nonce":1216783001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35168,"qdb_cluster":[35168]},"id":5}]} 2024-09-12T01:38:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 38 2024-09-12T01:38:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.674+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2660385995 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb48006be30 msgr2=0x7fb48006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.674+0000 7fb4a4f98640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb48006be30 0x7fb48006e2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00b8750 tx=0x7fb488009040 comp rx=0 tx=0).stop 2024-09-12T01:38:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.674+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2660385995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a00d1820 msgr2=0x7fb4a0151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.674+0000 7fb4a4f98640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a00d1820 0x7fb4a0151c70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb49002acc0 tx=0x7fb490004a40 comp rx=0 tx=0).stop 2024-09-12T01:38:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.674+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2660385995 shutdown_connections 2024-09-12T01:38:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.674+0000 7fb4a4f98640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4a015e660 0x7fb4a00b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.674+0000 7fb4a4f98640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb48006be30 0x7fb48006e2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.674+0000 7fb4a4f98640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb4a00d3310 0x7fb4a00c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.674+0000 7fb4a4f98640 1 --2- 172.21.15.60:0/2660385995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4a00d1820 0x7fb4a0151c70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.674+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2660385995 >> 172.21.15.60:0/2660385995 conn(0x7fb4a00b6410 msgr2=0x7fb4a015d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.674+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2660385995 shutdown_connections 2024-09-12T01:38:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:52.674+0000 7fb4a4f98640 1 -- 172.21.15.60:0/2660385995 wait complete. 2024-09-12T01:38:52.687 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-12T01:38:52.808 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":35258,"entity":{"name":{"type":"client","num":35258},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2704495628}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":4.1149166199999998,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9759749755650455,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.35258 192.168.0.1:0/2704495628","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi105","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":35255,"entity":{"name":{"type":"client","num":35255},"addr":{"type":"any","addr":"172.21.15.60:0","nonce":3306230185}},"state":"open","num_leases":1,"num_caps":602,"request_load_avg":615,"uptime":5.2088944550000003,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":697.46187989438795,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":443.41874765045293,"halflife":1.5},"recall_caps_throttle2o":{"value":194.43337412065122,"halflife":0.5},"session_cache_liveness":{"value":1199.8007937783955,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":630,"last_trim_completed_flushes_tid":601,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.35255 172.21.15.60:0/3306230185","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000044d","length":903}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi060","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-12T01:38:52.809 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi105", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2704495628, "type": "any" }, "name": { "num": 35258, "type": "client" } }, "id": 35258, "inst": "client.35258 192.168.0.1:0/2704495628", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9759749755650455 }, "state": "open", "uptime": 4.11491662 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi060", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.60:0", "nonce": 3306230185, "type": "any" }, "name": { "num": 35255, "type": "client" } }, "id": 35255, "inst": "client.35255 172.21.15.60:0/3306230185", "last_trim_completed_flushes_tid": 601, "last_trim_completed_requests_tid": 630, "num_caps": 602, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 903, "start": "0x1000000044d" } ], "recall_caps": { "halflife": 60, "value": 697.461879894388 }, "recall_caps_throttle": { "halflife": 1.5, "value": 443.41874765045293 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 194.43337412065122 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 615, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1199.8007937783955 }, "state": "open", "uptime": 5.208894455 } ] 2024-09-12T01:38:52.809 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=60 retry_count=0)... 2024-09-12T01:38:57.811 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:57.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.924+0000 7f73467d8640 1 Processor -- start 2024-09-12T01:38:57.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.924+0000 7f73467d8640 1 -- start start 2024-09-12T01:38:57.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.925+0000 7f73467d8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f734015c550 0x7f73400715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.925+0000 7f73467d8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73400b6e10 0x7f73400b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.925+0000 7f73467d8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73400d0270 con 0x7f7340073160 2024-09-12T01:38:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.925+0000 7f73467d8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f734015c930 con 0x7f734015c550 2024-09-12T01:38:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.925+0000 7f73467d8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f73400d04f0 con 0x7f73400b6e10 2024-09-12T01:38:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.925+0000 7f733f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73400b6e10 0x7f73400b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.926+0000 7f733ffff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f734015c550 0x7f73400715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.926+0000 7f733f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73400b6e10 0x7f73400b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:55266/0 (socket says 172.21.15.60:55266) 2024-09-12T01:38:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.926+0000 7f733f7fe640 1 -- 172.21.15.60:0/1699588929 learned_addr learned my addr 172.21.15.60:0/1699588929 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.926+0000 7f733ffff640 1 -- 172.21.15.60:0/1699588929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73400b6e10 msgr2=0x7f73400b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.926+0000 7f733ffff640 1 --2- 172.21.15.60:0/1699588929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73400b6e10 0x7f73400b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.926+0000 7f733ffff640 1 -- 172.21.15.60:0/1699588929 >> v1:172.21.15.105:6789/0 conn(0x7f7340073160 legacy=0x7f73400d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:57.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.926+0000 7f733ffff640 1 -- 172.21.15.60:0/1699588929 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73400b7580 con 0x7f734015c550 2024-09-12T01:38:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.926+0000 7f733effd640 1 -- 172.21.15.60:0/1699588929 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3034680630 0 0) 0x7f7338001490 con 0x7f7340073160 2024-09-12T01:38:57.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.926+0000 7f733f7fe640 1 --2- 172.21.15.60:0/1699588929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73400b6e10 0x7f73400b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:57.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.927+0000 7f733ffff640 1 --2- 172.21.15.60:0/1699588929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734015c550 0x7f73400715e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f73300097a0 tx=0x7f733002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a81a4fb60e6afa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:57.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.927+0000 7f733effd640 1 -- 172.21.15.60:0/1699588929 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330037070 con 0x7f734015c550 2024-09-12T01:38:57.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.927+0000 7f733effd640 1 -- 172.21.15.60:0/1699588929 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7330032440 con 0x7f734015c550 2024-09-12T01:38:57.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.927+0000 7f733effd640 1 -- 172.21.15.60:0/1699588929 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7330032810 con 0x7f734015c550 2024-09-12T01:38:57.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.928+0000 7f73467d8640 1 -- 172.21.15.60:0/1699588929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734015c550 msgr2=0x7f73400715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:57.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.928+0000 7f73467d8640 1 --2- 172.21.15.60:0/1699588929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734015c550 0x7f73400715e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f73300097a0 tx=0x7f733002a180 comp rx=0 tx=0).stop 2024-09-12T01:38:57.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.928+0000 7f73467d8640 1 -- 172.21.15.60:0/1699588929 shutdown_connections 2024-09-12T01:38:57.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.928+0000 7f73467d8640 1 --2- 172.21.15.60:0/1699588929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73400b6e10 0x7f73400b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:57.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.928+0000 7f73467d8640 1 --2- 172.21.15.60:0/1699588929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734015c550 0x7f73400715e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.928+0000 7f73467d8640 1 -- 172.21.15.60:0/1699588929 >> 172.21.15.60:0/1699588929 conn(0x7f73400b4240 msgr2=0x7f73400b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.928+0000 7f73467d8640 1 -- 172.21.15.60:0/1699588929 shutdown_connections 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.928+0000 7f73467d8640 1 -- 172.21.15.60:0/1699588929 wait complete. 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.929+0000 7f73467d8640 1 Processor -- start 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.929+0000 7f73467d8640 1 -- start start 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f73467d8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7340073160 0x7f734014a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f73467d8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73400b6e10 0x7f734014d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f73467d8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734015c550 0x7f7340158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f73467d8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f73400b7250 con 0x7f73400b6e10 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f73467d8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73400d07b0 con 0x7f734015c550 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f73467d8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f73400b5a80 con 0x7f7340073160 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f733f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73400b6e10 0x7f734014d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f733f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73400b6e10 0x7f734014d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48474/0 (socket says 172.21.15.60:48474) 2024-09-12T01:38:57.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f733f7fe640 1 -- 172.21.15.60:0/1637508945 learned_addr learned my addr 172.21.15.60:0/1637508945 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f733ffff640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7340073160 0x7f734014a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f7344d75640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734015c550 0x7f7340158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f733f7fe640 1 -- 172.21.15.60:0/1637508945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7340073160 msgr2=0x7f734014a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f733f7fe640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7340073160 0x7f734014a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f733f7fe640 1 -- 172.21.15.60:0/1637508945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734015c550 msgr2=0x7f7340158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f733f7fe640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734015c550 0x7f7340158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.930+0000 7f733f7fe640 1 -- 172.21.15.60:0/1637508945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f734014dbf0 con 0x7f73400b6e10 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.931+0000 7f733f7fe640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73400b6e10 0x7f734014d150 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f733400e9d0 tx=0x7f733400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.931+0000 7f733cff9640 1 -- 172.21.15.60:0/1637508945 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7334017070 con 0x7f73400b6e10 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.931+0000 7f733cff9640 1 -- 172.21.15.60:0/1637508945 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f733400ca60 con 0x7f73400b6e10 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.931+0000 7f73467d8640 1 -- 172.21.15.60:0/1637508945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f734014bf60 con 0x7f73400b6e10 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.931+0000 7f733cff9640 1 -- 172.21.15.60:0/1637508945 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f733400ce10 con 0x7f73400b6e10 2024-09-12T01:38:57.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.931+0000 7f73467d8640 1 -- 172.21.15.60:0/1637508945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73401f52f0 con 0x7f73400b6e10 2024-09-12T01:38:57.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.932+0000 7f73467d8640 1 -- 172.21.15.60:0/1637508945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734014bd50 con 0x7f73400b6e10 2024-09-12T01:38:57.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.932+0000 7f733cff9640 1 -- 172.21.15.60:0/1637508945 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f733401a070 con 0x7f73400b6e10 2024-09-12T01:38:57.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.933+0000 7f733cff9640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f732c06be30 0x7f732c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:57.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.933+0000 7f733cff9640 1 -- 172.21.15.60:0/1637508945 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f733408b030 con 0x7f73400b6e10 2024-09-12T01:38:57.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.933+0000 7f733ffff640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f732c06be30 0x7f732c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:57.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.933+0000 7f733ffff640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f732c06be30 0x7f732c06e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7330034000 tx=0x7f733002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:57.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:57.937+0000 7f733cff9640 1 -- 172.21.15.60:0/1637508945 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7334059420 con 0x7f73400b6e10 2024-09-12T01:38:58.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.148+0000 7f73467d8640 1 -- 172.21.15.60:0/1637508945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73400b5540 con 0x7f73400b6e10 2024-09-12T01:38:58.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.149+0000 7f733cff9640 1 -- 172.21.15.60:0/1637508945 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f733405d720 con 0x7f73400b6e10 2024-09-12T01:38:58.149 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:58.149 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":38,"btime":"2024-09-12T01:38:39:078790+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/672507371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":672507371},{"type":"v1","addr":"172.21.15.60:6836","nonce":672507371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/2426056287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2426056287},{"type":"v1","addr":"172.21.15.105:6833","nonce":2426056287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/183879558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":183879558},{"type":"v1","addr":"172.21.15.60:6837","nonce":183879558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:35.419604+0000","modified":"2024-09-12T01:38:38.117150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35168":{"gid":35168,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1216783001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1216783001},{"type":"v1","addr":"172.21.15.105:6835","nonce":1216783001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35168,"qdb_cluster":[35168]},"id":5}]} 2024-09-12T01:38:58.150 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 38 2024-09-12T01:38:58.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.151+0000 7f73467d8640 1 -- 172.21.15.60:0/1637508945 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f732c06be30 msgr2=0x7f732c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:58.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.151+0000 7f73467d8640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f732c06be30 0x7f732c06e2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7330034000 tx=0x7f733002e000 comp rx=0 tx=0).stop 2024-09-12T01:38:58.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.151+0000 7f73467d8640 1 -- 172.21.15.60:0/1637508945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73400b6e10 msgr2=0x7f734014d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:58.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.151+0000 7f73467d8640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73400b6e10 0x7f734014d150 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f733400e9d0 tx=0x7f733400ee90 comp rx=0 tx=0).stop 2024-09-12T01:38:58.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.151+0000 7f73467d8640 1 -- 172.21.15.60:0/1637508945 shutdown_connections 2024-09-12T01:38:58.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.151+0000 7f73467d8640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f734015c550 0x7f7340158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.151+0000 7f73467d8640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73400b6e10 0x7f734014d150 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.151+0000 7f73467d8640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f732c06be30 0x7f732c06e2f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.151+0000 7f73467d8640 1 --2- 172.21.15.60:0/1637508945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7340073160 0x7f734014a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.151+0000 7f73467d8640 1 -- 172.21.15.60:0/1637508945 >> 172.21.15.60:0/1637508945 conn(0x7f73400b4240 msgr2=0x7f73400735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:58.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.151+0000 7f73467d8640 1 -- 172.21.15.60:0/1637508945 shutdown_connections 2024-09-12T01:38:58.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.151+0000 7f73467d8640 1 -- 172.21.15.60:0/1637508945 wait complete. 2024-09-12T01:38:58.163 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-12T01:38:58.291 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":35258,"entity":{"name":{"type":"client","num":35258},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2704495628}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":9.5978055209999997,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9385126292293338,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.35258 192.168.0.1:0/2704495628","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi105","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":35255,"entity":{"name":{"type":"client","num":35255},"addr":{"type":"any","addr":"172.21.15.60:0","nonce":3306230185}},"state":"open","num_leases":1,"num_caps":100,"request_load_avg":577,"uptime":10.691783356,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":2164.0843301998843,"halflife":60},"release_caps":{"value":490.54462336355652,"halflife":60},"recall_caps_throttle":{"value":510.9128249483104,"halflife":1.5},"recall_caps_throttle2o":{"value":59.052139872297666,"halflife":0.5},"session_cache_liveness":{"value":1184.6973896034817,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":630,"last_trim_completed_flushes_tid":601,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.35255 172.21.15.60:0/3306230185","completed_requests":[],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x1000000044d","length":903}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi060","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-12T01:38:58.291 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi105", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2704495628, "type": "any" }, "name": { "num": 35258, "type": "client" } }, "id": 35258, "inst": "client.35258 192.168.0.1:0/2704495628", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9385126292293338 }, "state": "open", "uptime": 9.597805521 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi060", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.60:0", "nonce": 3306230185, "type": "any" }, "name": { "num": 35255, "type": "client" } }, "id": 35255, "inst": "client.35255 172.21.15.60:0/3306230185", "last_trim_completed_flushes_tid": 601, "last_trim_completed_requests_tid": 630, "num_caps": 100, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 903, "start": "0x1000000044d" } ], "recall_caps": { "halflife": 60, "value": 2164.0843301998843 }, "recall_caps_throttle": { "halflife": 1.5, "value": 510.9128249483104 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 59.052139872297666 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 490.5446233635565 }, "request_load_avg": 577, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1184.6973896034817 }, "state": "open", "uptime": 10.691783356 } ] 2024-09-12T01:38:58.292 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T01:38:58.292 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:38:58.292 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:38:58.338 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:38:58.376 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:38:58.376 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:38:58.376 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:58.376 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:58.393 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:58.393 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:58.449 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:38:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.592+0000 7fc3065af640 1 Processor -- start 2024-09-12T01:38:58.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.592+0000 7fc3065af640 1 -- start start 2024-09-12T01:38:58.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc3065af640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc30015e6f0 0x7fc30006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc3065af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3000b54d0 0x7fc30015f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc3065af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc30006e990 con 0x7fc3000b6d40 2024-09-12T01:38:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc3065af640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc30006ec70 con 0x7fc30015e6f0 2024-09-12T01:38:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc3065af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc30015ec70 con 0x7fc3000b54d0 2024-09-12T01:38:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc2fffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc30015e6f0 0x7fc30006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc304b4c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc3000b6d40 0x7fc3000b71f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41574/0 (socket says 172.21.15.60:41574) 2024-09-12T01:38:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc2fffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc30015e6f0 0x7fc30006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48484/0 (socket says 172.21.15.60:48484) 2024-09-12T01:38:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc304b4c640 1 -- 172.21.15.60:0/3963976041 learned_addr learned my addr 172.21.15.60:0/3963976041 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:38:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc2ff7fe640 1 --2- 172.21.15.60:0/3963976041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3000b54d0 0x7fc30015f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc2fffff640 1 -- 172.21.15.60:0/3963976041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3000b54d0 msgr2=0x7fc30015f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc2fffff640 1 --2- 172.21.15.60:0/3963976041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3000b54d0 0x7fc30015f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc2fffff640 1 -- 172.21.15.60:0/3963976041 >> v1:172.21.15.60:6789/0 conn(0x7fc3000b6d40 legacy=0x7fc3000b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:58.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc2fffff640 1 -- 172.21.15.60:0/3963976041 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30015ef50 con 0x7fc30015e6f0 2024-09-12T01:38:58.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc2feffd640 1 -- 172.21.15.60:0/3963976041 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1410791453 0 0) 0x7fc30006e990 con 0x7fc3000b6d40 2024-09-12T01:38:58.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.593+0000 7fc2ff7fe640 1 --2- 172.21.15.60:0/3963976041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3000b54d0 0x7fc30015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:38:58.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.594+0000 7fc2fffff640 1 --2- 172.21.15.60:0/3963976041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc30015e6f0 0x7fc30006fd00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00097a0 tx=0x7fc2f002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a921cd0bafb4e280 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:58.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.594+0000 7fc2feffd640 1 -- 172.21.15.60:0/3963976041 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0037070 con 0x7fc30015e6f0 2024-09-12T01:38:58.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.594+0000 7fc2feffd640 1 -- 172.21.15.60:0/3963976041 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f0032440 con 0x7fc30015e6f0 2024-09-12T01:38:58.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.594+0000 7fc2feffd640 1 -- 172.21.15.60:0/3963976041 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f0032810 con 0x7fc30015e6f0 2024-09-12T01:38:58.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.595+0000 7fc3065af640 1 -- 172.21.15.60:0/3963976041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc30015e6f0 msgr2=0x7fc30006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:58.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.595+0000 7fc3065af640 1 --2- 172.21.15.60:0/3963976041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc30015e6f0 0x7fc30006fd00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc2f00097a0 tx=0x7fc2f002a180 comp rx=0 tx=0).stop 2024-09-12T01:38:58.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.595+0000 7fc3065af640 1 -- 172.21.15.60:0/3963976041 shutdown_connections 2024-09-12T01:38:58.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.595+0000 7fc3065af640 1 --2- 172.21.15.60:0/3963976041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3000b54d0 0x7fc30015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.595+0000 7fc3065af640 1 --2- 172.21.15.60:0/3963976041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc30015e6f0 0x7fc30006fd00 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.595+0000 7fc3065af640 1 -- 172.21.15.60:0/3963976041 >> 172.21.15.60:0/3963976041 conn(0x7fc3000d2430 msgr2=0x7fc3000d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:58.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.595+0000 7fc3065af640 1 -- 172.21.15.60:0/3963976041 shutdown_connections 2024-09-12T01:38:58.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.595+0000 7fc3065af640 1 -- 172.21.15.60:0/3963976041 wait complete. 2024-09-12T01:38:58.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.596+0000 7fc3065af640 1 Processor -- start 2024-09-12T01:38:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.596+0000 7fc3065af640 1 -- start start 2024-09-12T01:38:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc3065af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3000b54d0 0x7fc300153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc3065af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3000b6d40 0x7fc3001552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc3065af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc30015e6f0 0x7fc300155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc3065af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc30006e730 con 0x7fc30015e6f0 2024-09-12T01:38:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc3065af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc30006e5b0 con 0x7fc3000b6d40 2024-09-12T01:38:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc3065af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc300070830 con 0x7fc3000b54d0 2024-09-12T01:38:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc304b4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc30015e6f0 0x7fc300155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc304b4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc30015e6f0 0x7fc300155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48498/0 (socket says 172.21.15.60:48498) 2024-09-12T01:38:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc304b4c640 1 -- 172.21.15.60:0/738648449 learned_addr learned my addr 172.21.15.60:0/738648449 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:58.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc2fffff640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3000b54d0 0x7fc300153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc2ff7fe640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3000b6d40 0x7fc3001552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc304b4c640 1 -- 172.21.15.60:0/738648449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3000b54d0 msgr2=0x7fc300153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc304b4c640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3000b54d0 0x7fc300153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc304b4c640 1 -- 172.21.15.60:0/738648449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3000b6d40 msgr2=0x7fc3001552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc304b4c640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3000b6d40 0x7fc3001552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc304b4c640 1 -- 172.21.15.60:0/738648449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc300154960 con 0x7fc30015e6f0 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc2fffff640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3000b54d0 0x7fc300153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc2ff7fe640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3000b6d40 0x7fc3001552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc304b4c640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc30015e6f0 0x7fc300155810 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c7a0 tx=0x7fc2f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.597+0000 7fc2fcff9640 1 -- 172.21.15.60:0/738648449 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8018070 con 0x7fc30015e6f0 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.598+0000 7fc2fcff9640 1 -- 172.21.15.60:0/738648449 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f800a640 con 0x7fc30015e6f0 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.598+0000 7fc3065af640 1 -- 172.21.15.60:0/738648449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc300155e90 con 0x7fc30015e6f0 2024-09-12T01:38:58.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.598+0000 7fc2fcff9640 1 -- 172.21.15.60:0/738648449 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f800aab0 con 0x7fc30015e6f0 2024-09-12T01:38:58.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.598+0000 7fc3065af640 1 -- 172.21.15.60:0/738648449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc30015fc40 con 0x7fc30015e6f0 2024-09-12T01:38:58.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.598+0000 7fc3065af640 1 -- 172.21.15.60:0/738648449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc30006c6c0 con 0x7fc30015e6f0 2024-09-12T01:38:58.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.599+0000 7fc2fcff9640 1 -- 172.21.15.60:0/738648449 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2f801b070 con 0x7fc30015e6f0 2024-09-12T01:38:58.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.599+0000 7fc2fcff9640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc2ec06be30 0x7fc2ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:58.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.600+0000 7fc2fcff9640 1 -- 172.21.15.60:0/738648449 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fc2f808a460 con 0x7fc30015e6f0 2024-09-12T01:38:58.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.600+0000 7fc2fffff640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc2ec06be30 0x7fc2ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:58.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.600+0000 7fc2fffff640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc2ec06be30 0x7fc2ec06e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0034000 tx=0x7fc2f002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:58.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.604+0000 7fc2fcff9640 1 -- 172.21.15.60:0/738648449 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2f8058e10 con 0x7fc30015e6f0 2024-09-12T01:38:58.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.795+0000 7fc3065af640 1 -- 172.21.15.60:0/738648449 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc30006d660 con 0x7fc30015e6f0 2024-09-12T01:38:58.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.795+0000 7fc2fcff9640 1 -- 172.21.15.60:0/738648449 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v68) ==== 80+0+0 (secure 0 0 0) 0x7fc2f8058710 con 0x7fc30015e6f0 2024-09-12T01:38:58.796 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:38:58.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.798+0000 7fc3065af640 1 -- 172.21.15.60:0/738648449 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc2ec06be30 msgr2=0x7fc2ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:58.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.798+0000 7fc3065af640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc2ec06be30 0x7fc2ec06e2f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0034000 tx=0x7fc2f002e000 comp rx=0 tx=0).stop 2024-09-12T01:38:58.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.798+0000 7fc3065af640 1 -- 172.21.15.60:0/738648449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc30015e6f0 msgr2=0x7fc300155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:58.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.798+0000 7fc3065af640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc30015e6f0 0x7fc300155810 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c7a0 tx=0x7fc2f800cc60 comp rx=0 tx=0).stop 2024-09-12T01:38:58.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.798+0000 7fc3065af640 1 -- 172.21.15.60:0/738648449 shutdown_connections 2024-09-12T01:38:58.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.798+0000 7fc3065af640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc30015e6f0 0x7fc300155810 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.798+0000 7fc3065af640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc3000b6d40 0x7fc3001552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.798+0000 7fc3065af640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc2ec06be30 0x7fc2ec06e2f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.798+0000 7fc3065af640 1 --2- 172.21.15.60:0/738648449 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc3000b54d0 0x7fc300153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:58.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.798+0000 7fc3065af640 1 -- 172.21.15.60:0/738648449 >> 172.21.15.60:0/738648449 conn(0x7fc3000d2430 msgr2=0x7fc30006db80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:58.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.798+0000 7fc3065af640 1 -- 172.21.15.60:0/738648449 shutdown_connections 2024-09-12T01:38:58.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:58.798+0000 7fc3065af640 1 -- 172.21.15.60:0/738648449 wait complete. 2024-09-12T01:38:58.809 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:38:58.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:58.809 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:38:58.944 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:38:58.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:58.944 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:38:58.960 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:38:58.960 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:38:58.961 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:58.976 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:38:58.976 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:59.031 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:38:59.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.136+0000 7fe4c598d640 1 Processor -- start 2024-09-12T01:38:59.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.136+0000 7fe4c598d640 1 -- start start 2024-09-12T01:38:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4c598d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c0158a00 0x7fe4c0071f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4c598d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe4c0072470 0x7fe4c00b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4c598d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe4c0158de0 0x7fe4c00b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4c598d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c00728f0 con 0x7fe4c0072470 2024-09-12T01:38:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4c598d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c0072bd0 con 0x7fe4c0158de0 2024-09-12T01:38:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4c598d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c0072eb0 con 0x7fe4c0158a00 2024-09-12T01:38:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4be7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe4c0072470 0x7fe4c00b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4be7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe4c0072470 0x7fe4c00b4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48504/0 (socket says 172.21.15.60:48504) 2024-09-12T01:38:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4be7fc640 1 -- 172.21.15.60:0/1976876713 learned_addr learned my addr 172.21.15.60:0/1976876713 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4bf7fe640 1 --2- 172.21.15.60:0/1976876713 >> v2:172.21.15.105:3300/0 conn(0x7fe4c0158de0 0x7fe4c00b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4beffd640 1 --2- 172.21.15.60:0/1976876713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c0158a00 0x7fe4c0071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4be7fc640 1 -- 172.21.15.60:0/1976876713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c0158a00 msgr2=0x7fe4c0071f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:59.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4be7fc640 1 --2- 172.21.15.60:0/1976876713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c0158a00 0x7fe4c0071f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4be7fc640 1 -- 172.21.15.60:0/1976876713 >> v2:172.21.15.105:3300/0 conn(0x7fe4c0158de0 msgr2=0x7fe4c00b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:59.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4be7fc640 1 --2- 172.21.15.60:0/1976876713 >> v2:172.21.15.105:3300/0 conn(0x7fe4c0158de0 0x7fe4c00b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4be7fc640 1 -- 172.21.15.60:0/1976876713 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c0073190 con 0x7fe4c0072470 2024-09-12T01:38:59.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.137+0000 7fe4bf7fe640 1 --2- 172.21.15.60:0/1976876713 >> v2:172.21.15.105:3300/0 conn(0x7fe4c0158de0 0x7fe4c00b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:59.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.138+0000 7fe4be7fc640 1 --2- 172.21.15.60:0/1976876713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c0072470 0x7fe4c00b4e60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00b6260 tx=0x7fe4a802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1927e0192d342f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:59.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.138+0000 7fe4bdffb640 1 -- 172.21.15.60:0/1976876713 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8037070 con 0x7fe4c0072470 2024-09-12T01:38:59.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.138+0000 7fe4bdffb640 1 -- 172.21.15.60:0/1976876713 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a8032440 con 0x7fe4c0072470 2024-09-12T01:38:59.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.138+0000 7fe4bdffb640 1 -- 172.21.15.60:0/1976876713 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8032810 con 0x7fe4c0072470 2024-09-12T01:38:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.139+0000 7fe4c598d640 1 -- 172.21.15.60:0/1976876713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c0072470 msgr2=0x7fe4c00b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.139+0000 7fe4c598d640 1 --2- 172.21.15.60:0/1976876713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c0072470 0x7fe4c00b4e60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00b6260 tx=0x7fe4a802a1e0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.139+0000 7fe4c598d640 1 -- 172.21.15.60:0/1976876713 shutdown_connections 2024-09-12T01:38:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.139+0000 7fe4c598d640 1 --2- 172.21.15.60:0/1976876713 >> v2:172.21.15.105:3300/0 conn(0x7fe4c0158de0 0x7fe4c00b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.139+0000 7fe4c598d640 1 --2- 172.21.15.60:0/1976876713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c0072470 0x7fe4c00b4e60 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.139+0000 7fe4c598d640 1 --2- 172.21.15.60:0/1976876713 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c0158a00 0x7fe4c0071f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.139+0000 7fe4c598d640 1 -- 172.21.15.60:0/1976876713 >> 172.21.15.60:0/1976876713 conn(0x7fe4c006cb50 msgr2=0x7fe4c006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.139+0000 7fe4c598d640 1 -- 172.21.15.60:0/1976876713 shutdown_connections 2024-09-12T01:38:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.139+0000 7fe4c598d640 1 -- 172.21.15.60:0/1976876713 wait complete. 2024-09-12T01:38:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.140+0000 7fe4c598d640 1 Processor -- start 2024-09-12T01:38:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.140+0000 7fe4c598d640 1 -- start start 2024-09-12T01:38:59.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4c598d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c0072470 0x7fe4c014b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4c598d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c0158a00 0x7fe4c0154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4c598d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c0158de0 0x7fe4c01f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4c598d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00b5ca0 con 0x7fe4c0158de0 2024-09-12T01:38:59.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4c598d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00b5b20 con 0x7fe4c0072470 2024-09-12T01:38:59.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4c598d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c0162110 con 0x7fe4c0158a00 2024-09-12T01:38:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c0158de0 0x7fe4c01f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4be7fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c0158a00 0x7fe4c0154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4beffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c0072470 0x7fe4c014b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c0158de0 0x7fe4c01f4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48516/0 (socket says 172.21.15.60:48516) 2024-09-12T01:38:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4bf7fe640 1 -- 172.21.15.60:0/2335922599 learned_addr learned my addr 172.21.15.60:0/2335922599 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4bf7fe640 1 -- 172.21.15.60:0/2335922599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c0158a00 msgr2=0x7fe4c0154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4bf7fe640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c0158a00 0x7fe4c0154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4bf7fe640 1 -- 172.21.15.60:0/2335922599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c0072470 msgr2=0x7fe4c014b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4bf7fe640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c0072470 0x7fe4c014b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.141+0000 7fe4bf7fe640 1 -- 172.21.15.60:0/2335922599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c0155c40 con 0x7fe4c0158de0 2024-09-12T01:38:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.142+0000 7fe4beffd640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c0072470 0x7fe4c014b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.142+0000 7fe4be7fc640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c0158a00 0x7fe4c0154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:38:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.142+0000 7fe4bf7fe640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c0158de0 0x7fe4c01f4600 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c5e0 tx=0x7fe4b800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.142+0000 7fe4b7fff640 1 -- 172.21.15.60:0/2335922599 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8015070 con 0x7fe4c0158de0 2024-09-12T01:38:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.142+0000 7fe4b7fff640 1 -- 172.21.15.60:0/2335922599 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b8004240 con 0x7fe4c0158de0 2024-09-12T01:38:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.142+0000 7fe4b7fff640 1 -- 172.21.15.60:0/2335922599 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8003610 con 0x7fe4c0158de0 2024-09-12T01:38:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.142+0000 7fe4c598d640 1 -- 172.21.15.60:0/2335922599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c0155f20 con 0x7fe4c0158de0 2024-09-12T01:38:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.142+0000 7fe4c598d640 1 -- 172.21.15.60:0/2335922599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c01f40e0 con 0x7fe4c0158de0 2024-09-12T01:38:59.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.143+0000 7fe4c598d640 1 -- 172.21.15.60:0/2335922599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c0071f30 con 0x7fe4c0158de0 2024-09-12T01:38:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.143+0000 7fe4b7fff640 1 -- 172.21.15.60:0/2335922599 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe4b80037b0 con 0x7fe4c0158de0 2024-09-12T01:38:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.144+0000 7fe4b7fff640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe4a006be30 0x7fe4a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.144+0000 7fe4b7fff640 1 -- 172.21.15.60:0/2335922599 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fe4b808ae90 con 0x7fe4c0158de0 2024-09-12T01:38:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.144+0000 7fe4beffd640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe4a006be30 0x7fe4a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.144+0000 7fe4beffd640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe4a006be30 0x7fe4a006e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe4c015dcc0 tx=0x7fe4b00077b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:59.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.148+0000 7fe4b7fff640 1 -- 172.21.15.60:0/2335922599 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe4b8059280 con 0x7fe4c0158de0 2024-09-12T01:38:59.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.337+0000 7fe4c598d640 1 -- 172.21.15.60:0/2335922599 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe4c00b4090 con 0x7fe4c0158de0 2024-09-12T01:38:59.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.337+0000 7fe4b7fff640 1 -- 172.21.15.60:0/2335922599 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v68) ==== 80+0+0 (secure 0 0 0) 0x7fe4b805d580 con 0x7fe4c0158de0 2024-09-12T01:38:59.337 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:38:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.339+0000 7fe4c598d640 1 -- 172.21.15.60:0/2335922599 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe4a006be30 msgr2=0x7fe4a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.339+0000 7fe4c598d640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe4a006be30 0x7fe4a006e2f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe4c015dcc0 tx=0x7fe4b00077b0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.339+0000 7fe4c598d640 1 -- 172.21.15.60:0/2335922599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c0158de0 msgr2=0x7fe4c01f4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.339+0000 7fe4c598d640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c0158de0 0x7fe4c01f4600 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800c5e0 tx=0x7fe4b800caa0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.339+0000 7fe4c598d640 1 -- 172.21.15.60:0/2335922599 shutdown_connections 2024-09-12T01:38:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.339+0000 7fe4c598d640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4c0158de0 0x7fe4c01f4600 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.339+0000 7fe4c598d640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe4a006be30 0x7fe4a006e2f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.339+0000 7fe4c598d640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe4c0158a00 0x7fe4c0154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.339+0000 7fe4c598d640 1 --2- 172.21.15.60:0/2335922599 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe4c0072470 0x7fe4c014b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.339+0000 7fe4c598d640 1 -- 172.21.15.60:0/2335922599 >> 172.21.15.60:0/2335922599 conn(0x7fe4c006cb50 msgr2=0x7fe4c00ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.339+0000 7fe4c598d640 1 -- 172.21.15.60:0/2335922599 shutdown_connections 2024-09-12T01:38:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.339+0000 7fe4c598d640 1 -- 172.21.15.60:0/2335922599 wait complete. 2024-09-12T01:38:59.350 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:38:59.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:59.351 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T01:38:59.378 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:38:59.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:38:59.379 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:38:59.434 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:38:59.434 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:38:59.434 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:59.451 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:38:59.451 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:38:59.451 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:38:59.451 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:38:59.490 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:38:59.491 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:59.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.592+0000 7fced04d0640 1 Processor -- start 2024-09-12T01:38:59.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.592+0000 7fced04d0640 1 -- start start 2024-09-12T01:38:59.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fced04d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec815a9c0 0x7fcec815e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fced04d0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcec80b5be0 0x7fcec815eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fced04d0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcec80b29a0 0x7fcec80b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fced04d0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcec815f410 con 0x7fcec80b5be0 2024-09-12T01:38:59.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fced04d0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcec80b6830 con 0x7fcec80b29a0 2024-09-12T01:38:59.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fced04d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcec80cd0b0 con 0x7fcec815a9c0 2024-09-12T01:38:59.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fcecda6b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcec80b5be0 0x7fcec815eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fcecda6b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcec80b5be0 0x7fcec815eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48524/0 (socket says 172.21.15.60:48524) 2024-09-12T01:38:59.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fcecda6b640 1 -- 172.21.15.60:0/1531599201 learned_addr learned my addr 172.21.15.60:0/1531599201 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:59.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fcecea6d640 1 --2- 172.21.15.60:0/1531599201 >> v2:172.21.15.105:3300/0 conn(0x7fcec80b29a0 0x7fcec80b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fcece26c640 1 --2- 172.21.15.60:0/1531599201 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec815a9c0 0x7fcec815e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fcecda6b640 1 -- 172.21.15.60:0/1531599201 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec815a9c0 msgr2=0x7fcec815e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:59.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fcecda6b640 1 --2- 172.21.15.60:0/1531599201 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec815a9c0 0x7fcec815e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fcecda6b640 1 -- 172.21.15.60:0/1531599201 >> v2:172.21.15.105:3300/0 conn(0x7fcec80b29a0 msgr2=0x7fcec80b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:59.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fcecda6b640 1 --2- 172.21.15.60:0/1531599201 >> v2:172.21.15.105:3300/0 conn(0x7fcec80b29a0 0x7fcec80b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.593+0000 7fcecda6b640 1 -- 172.21.15.60:0/1531599201 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec80cd390 con 0x7fcec80b5be0 2024-09-12T01:38:59.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.594+0000 7fcecda6b640 1 --2- 172.21.15.60:0/1531599201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80b5be0 0x7fcec815eb40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcec80b3430 tx=0x7fcebc02c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9dc9dd6fe8d6093 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:59.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.594+0000 7fcecd26a640 1 -- 172.21.15.60:0/1531599201 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00b040 con 0x7fcec80b5be0 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.594+0000 7fcecd26a640 1 -- 172.21.15.60:0/1531599201 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc031710 con 0x7fcec80b5be0 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.594+0000 7fcecd26a640 1 -- 172.21.15.60:0/1531599201 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc031ae0 con 0x7fcec80b5be0 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.595+0000 7fced04d0640 1 -- 172.21.15.60:0/1531599201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80b5be0 msgr2=0x7fcec815eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.595+0000 7fced04d0640 1 --2- 172.21.15.60:0/1531599201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80b5be0 0x7fcec815eb40 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fcec80b3430 tx=0x7fcebc02c690 comp rx=0 tx=0).stop 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.595+0000 7fced04d0640 1 -- 172.21.15.60:0/1531599201 shutdown_connections 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.595+0000 7fced04d0640 1 --2- 172.21.15.60:0/1531599201 >> v2:172.21.15.105:3300/0 conn(0x7fcec80b29a0 0x7fcec80b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.595+0000 7fced04d0640 1 --2- 172.21.15.60:0/1531599201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80b5be0 0x7fcec815eb40 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.595+0000 7fced04d0640 1 --2- 172.21.15.60:0/1531599201 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec815a9c0 0x7fcec815e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.595+0000 7fced04d0640 1 -- 172.21.15.60:0/1531599201 >> 172.21.15.60:0/1531599201 conn(0x7fcec806bc10 msgr2=0x7fcec806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.595+0000 7fced04d0640 1 -- 172.21.15.60:0/1531599201 shutdown_connections 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.595+0000 7fced04d0640 1 -- 172.21.15.60:0/1531599201 wait complete. 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.596+0000 7fced04d0640 1 Processor -- start 2024-09-12T01:38:59.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.596+0000 7fced04d0640 1 -- start start 2024-09-12T01:38:59.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fced04d0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcec80b29a0 0x7fcec81552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fced04d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80b5be0 0x7fcec80cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fced04d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec815a9c0 0x7fcec80ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fced04d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcec815ada0 con 0x7fcec80b5be0 2024-09-12T01:38:59.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fced04d0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcec80cd950 con 0x7fcec80b29a0 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fced04d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcec815f080 con 0x7fcec815a9c0 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fcecda6b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80b5be0 0x7fcec80cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fcecda6b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80b5be0 0x7fcec80cde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48534/0 (socket says 172.21.15.60:48534) 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fcece26c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcec80b29a0 0x7fcec81552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fcecda6b640 1 -- 172.21.15.60:0/358170097 learned_addr learned my addr 172.21.15.60:0/358170097 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fcecea6d640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec815a9c0 0x7fcec80ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fcecda6b640 1 -- 172.21.15.60:0/358170097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec815a9c0 msgr2=0x7fcec80ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fcecda6b640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec815a9c0 0x7fcec80ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fcecda6b640 1 -- 172.21.15.60:0/358170097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcec80b29a0 msgr2=0x7fcec81552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fcecda6b640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcec80b29a0 0x7fcec81552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.597+0000 7fcecda6b640 1 -- 172.21.15.60:0/358170097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec80cbd90 con 0x7fcec80b5be0 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.598+0000 7fcecda6b640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80b5be0 0x7fcec80cde70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcebc000c00 tx=0x7fcebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:59.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.598+0000 7fcec6ffd640 1 -- 172.21.15.60:0/358170097 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc041020 con 0x7fcec80b5be0 2024-09-12T01:38:59.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.598+0000 7fcec6ffd640 1 -- 172.21.15.60:0/358170097 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc031e30 con 0x7fcec80b5be0 2024-09-12T01:38:59.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.598+0000 7fcec6ffd640 1 -- 172.21.15.60:0/358170097 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc03d440 con 0x7fcec80b5be0 2024-09-12T01:38:59.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.598+0000 7fced04d0640 1 -- 172.21.15.60:0/358170097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec81591c0 con 0x7fcec80b5be0 2024-09-12T01:38:59.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.598+0000 7fced04d0640 1 -- 172.21.15.60:0/358170097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec8159780 con 0x7fcec80b5be0 2024-09-12T01:38:59.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.599+0000 7fced04d0640 1 -- 172.21.15.60:0/358170097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec806de40 con 0x7fcec80b5be0 2024-09-12T01:38:59.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.600+0000 7fcec6ffd640 1 -- 172.21.15.60:0/358170097 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcebc044020 con 0x7fcec80b5be0 2024-09-12T01:38:59.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.600+0000 7fcec6ffd640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fceb406be30 0x7fceb406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.600+0000 7fcec6ffd640 1 -- 172.21.15.60:0/358170097 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fcebc0ad9a0 con 0x7fcec80b5be0 2024-09-12T01:38:59.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.600+0000 7fcece26c640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fceb406be30 0x7fceb406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.601+0000 7fcece26c640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fceb406be30 0x7fceb406e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcec81f3510 tx=0x7fceb80098d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:59.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.604+0000 7fcec6ffd640 1 -- 172.21.15.60:0/358170097 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcebc04b030 con 0x7fcec80b5be0 2024-09-12T01:38:59.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.815+0000 7fced04d0640 1 -- 172.21.15.60:0/358170097 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcec815e330 con 0x7fcec80b5be0 2024-09-12T01:38:59.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.816+0000 7fcec6ffd640 1 -- 172.21.15.60:0/358170097 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7fcec80cbd90 con 0x7fcec80b5be0 2024-09-12T01:38:59.817 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:38:59.817 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":38,"btime":"2024-09-12T01:38:39:078790+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/672507371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":672507371},{"type":"v1","addr":"172.21.15.60:6836","nonce":672507371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/2426056287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2426056287},{"type":"v1","addr":"172.21.15.105:6833","nonce":2426056287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/183879558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":183879558},{"type":"v1","addr":"172.21.15.60:6837","nonce":183879558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:35.419604+0000","modified":"2024-09-12T01:38:38.117150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35168":{"gid":35168,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1216783001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1216783001},{"type":"v1","addr":"172.21.15.105:6835","nonce":1216783001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35168,"qdb_cluster":[35168]},"id":5}]} 2024-09-12T01:38:59.818 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 38 2024-09-12T01:38:59.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.818+0000 7fced04d0640 1 -- 172.21.15.60:0/358170097 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fceb406be30 msgr2=0x7fceb406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.818+0000 7fced04d0640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fceb406be30 0x7fceb406e2f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcec81f3510 tx=0x7fceb80098d0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.818+0000 7fced04d0640 1 -- 172.21.15.60:0/358170097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80b5be0 msgr2=0x7fcec80cde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.818+0000 7fced04d0640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80b5be0 0x7fcec80cde70 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcebc000c00 tx=0x7fcebc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.818+0000 7fced04d0640 1 -- 172.21.15.60:0/358170097 shutdown_connections 2024-09-12T01:38:59.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.818+0000 7fced04d0640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fceb406be30 0x7fceb406e2f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.818+0000 7fced04d0640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcec815a9c0 0x7fcec80ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.818+0000 7fced04d0640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcec80b5be0 0x7fcec80cde70 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.818+0000 7fced04d0640 1 --2- 172.21.15.60:0/358170097 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcec80b29a0 0x7fcec81552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.818+0000 7fced04d0640 1 -- 172.21.15.60:0/358170097 >> 172.21.15.60:0/358170097 conn(0x7fcec806bc10 msgr2=0x7fcec815cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:59.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.818+0000 7fced04d0640 1 -- 172.21.15.60:0/358170097 shutdown_connections 2024-09-12T01:38:59.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.818+0000 7fced04d0640 1 -- 172.21.15.60:0/358170097 wait complete. 2024-09-12T01:38:59.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:38:59.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.932+0000 7f44d9a5c640 1 Processor -- start 2024-09-12T01:38:59.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.932+0000 7f44d9a5c640 1 -- start start 2024-09-12T01:38:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d9a5c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f44d415c2b0 0x7f44d40b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d9a5c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f44d40b72f0 0x7f44d415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d9a5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44d415f030 0x7f44d406f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d9a5c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f44d415fb10 con 0x7f44d415c2b0 2024-09-12T01:38:59.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d9a5c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f44d40b5900 con 0x7f44d40b72f0 2024-09-12T01:38:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d9a5c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f44d415f830 con 0x7f44d415f030 2024-09-12T01:38:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d2ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f44d415c2b0 0x7f44d40b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d2ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f44d415c2b0 0x7f44d40b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48542/0 (socket says 172.21.15.60:48542) 2024-09-12T01:38:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d2ffd640 1 -- 172.21.15.60:0/3122068588 learned_addr learned my addr 172.21.15.60:0/3122068588 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d27fc640 1 --2- 172.21.15.60:0/3122068588 >> v2:172.21.15.105:3300/0 conn(0x7f44d40b72f0 0x7f44d415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d37fe640 1 --2- 172.21.15.60:0/3122068588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44d415f030 0x7f44d406f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d2ffd640 1 -- 172.21.15.60:0/3122068588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44d415f030 msgr2=0x7f44d406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d2ffd640 1 --2- 172.21.15.60:0/3122068588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44d415f030 0x7f44d406f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d2ffd640 1 -- 172.21.15.60:0/3122068588 >> v2:172.21.15.105:3300/0 conn(0x7f44d40b72f0 msgr2=0x7f44d415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:38:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d2ffd640 1 --2- 172.21.15.60:0/3122068588 >> v2:172.21.15.105:3300/0 conn(0x7f44d40b72f0 0x7f44d415eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.933+0000 7f44d2ffd640 1 -- 172.21.15.60:0/3122068588 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d406ce30 con 0x7f44d415c2b0 2024-09-12T01:38:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.934+0000 7f44d37fe640 1 --2- 172.21.15.60:0/3122068588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44d415f030 0x7f44d406f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:38:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.934+0000 7f44d2ffd640 1 --2- 172.21.15.60:0/3122068588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44d415c2b0 0x7f44d40b6db0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f44d4071d10 tx=0x7f44c402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbea33ac4a27555f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.934+0000 7f44d1ffb640 1 -- 172.21.15.60:0/3122068588 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4037070 con 0x7f44d415c2b0 2024-09-12T01:38:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.934+0000 7f44d1ffb640 1 -- 172.21.15.60:0/3122068588 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c4032440 con 0x7f44d415c2b0 2024-09-12T01:38:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.934+0000 7f44d1ffb640 1 -- 172.21.15.60:0/3122068588 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c4032810 con 0x7f44d415c2b0 2024-09-12T01:38:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.935+0000 7f44d9a5c640 1 -- 172.21.15.60:0/3122068588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44d415c2b0 msgr2=0x7f44d40b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.935+0000 7f44d9a5c640 1 --2- 172.21.15.60:0/3122068588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44d415c2b0 0x7f44d40b6db0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f44d4071d10 tx=0x7f44c402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.935+0000 7f44d9a5c640 1 -- 172.21.15.60:0/3122068588 shutdown_connections 2024-09-12T01:38:59.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.935+0000 7f44d9a5c640 1 --2- 172.21.15.60:0/3122068588 >> v2:172.21.15.105:3300/0 conn(0x7f44d40b72f0 0x7f44d415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.935+0000 7f44d9a5c640 1 --2- 172.21.15.60:0/3122068588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44d415f030 0x7f44d406f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.935+0000 7f44d9a5c640 1 --2- 172.21.15.60:0/3122068588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44d415c2b0 0x7f44d40b6db0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.935+0000 7f44d9a5c640 1 -- 172.21.15.60:0/3122068588 >> 172.21.15.60:0/3122068588 conn(0x7f44d40b4240 msgr2=0x7f44d40b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:38:59.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.935+0000 7f44d9a5c640 1 -- 172.21.15.60:0/3122068588 shutdown_connections 2024-09-12T01:38:59.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.935+0000 7f44d9a5c640 1 -- 172.21.15.60:0/3122068588 wait complete. 2024-09-12T01:38:59.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.936+0000 7f44d9a5c640 1 Processor -- start 2024-09-12T01:38:59.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.936+0000 7f44d9a5c640 1 -- start start 2024-09-12T01:38:59.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d9a5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44d40b72f0 0x7f44d41f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d9a5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44d415c2b0 0x7f44d4157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d9a5c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44d415f030 0x7f44d41e8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d9a5c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f44d40b7760 con 0x7f44d415c2b0 2024-09-12T01:38:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d9a5c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f44d406d3f0 con 0x7f44d415f030 2024-09-12T01:38:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d9a5c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f44d415f4c0 con 0x7f44d40b72f0 2024-09-12T01:38:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d27fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44d415c2b0 0x7f44d4157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d27fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44d415c2b0 0x7f44d4157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48550/0 (socket says 172.21.15.60:48550) 2024-09-12T01:38:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d27fc640 1 -- 172.21.15.60:0/608744145 learned_addr learned my addr 172.21.15.60:0/608744145 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:38:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d2ffd640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44d40b72f0 0x7f44d41f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d37fe640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44d415f030 0x7f44d41e8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d27fc640 1 -- 172.21.15.60:0/608744145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44d40b72f0 msgr2=0x7f44d41f4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d27fc640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44d40b72f0 0x7f44d41f4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d27fc640 1 -- 172.21.15.60:0/608744145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44d415f030 msgr2=0x7f44d41e8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:38:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.937+0000 7f44d27fc640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44d415f030 0x7f44d41e8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:38:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.938+0000 7f44d27fc640 1 -- 172.21.15.60:0/608744145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d41e7260 con 0x7f44d415c2b0 2024-09-12T01:38:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.938+0000 7f44d27fc640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44d415c2b0 0x7f44d4157bb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f44c800d800 tx=0x7f44c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.938+0000 7f44bbfff640 1 -- 172.21.15.60:0/608744145 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c800b660 con 0x7f44d415c2b0 2024-09-12T01:38:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.938+0000 7f44bbfff640 1 -- 172.21.15.60:0/608744145 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c8019070 con 0x7f44d415c2b0 2024-09-12T01:38:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.938+0000 7f44d9a5c640 1 -- 172.21.15.60:0/608744145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44d41e7540 con 0x7f44d415c2b0 2024-09-12T01:38:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.938+0000 7f44bbfff640 1 -- 172.21.15.60:0/608744145 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44c800ba20 con 0x7f44d415c2b0 2024-09-12T01:38:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.938+0000 7f44d9a5c640 1 -- 172.21.15.60:0/608744145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44d41e7b00 con 0x7f44d415c2b0 2024-09-12T01:38:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.939+0000 7f44d9a5c640 1 -- 172.21.15.60:0/608744145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44d415eaf0 con 0x7f44d415c2b0 2024-09-12T01:38:59.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.939+0000 7f44bbfff640 1 -- 172.21.15.60:0/608744145 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f44c800bbc0 con 0x7f44d415c2b0 2024-09-12T01:38:59.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.940+0000 7f44bbfff640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f44c006be60 0x7f44c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:38:59.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.940+0000 7f44bbfff640 1 -- 172.21.15.60:0/608744145 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f44c808b130 con 0x7f44d415c2b0 2024-09-12T01:38:59.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.940+0000 7f44d2ffd640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f44c006be60 0x7f44c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:38:59.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.940+0000 7f44d2ffd640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f44c006be60 0x7f44c006e320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f44c4034000 tx=0x7f44c402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:38:59.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:38:59.944+0000 7f44bbfff640 1 -- 172.21.15.60:0/608744145 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f44c8059490 con 0x7f44d415c2b0 2024-09-12T01:39:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.157+0000 7f44d9a5c640 1 -- 172.21.15.60:0/608744145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44d41f4660 con 0x7f44d415c2b0 2024-09-12T01:39:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.157+0000 7f44bbfff640 1 -- 172.21.15.60:0/608744145 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f44c805d790 con 0x7f44d415c2b0 2024-09-12T01:39:00.158 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:00.158 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":38,"btime":"2024-09-12T01:38:39:078790+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/672507371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":672507371},{"type":"v1","addr":"172.21.15.60:6836","nonce":672507371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/2426056287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2426056287},{"type":"v1","addr":"172.21.15.105:6833","nonce":2426056287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/183879558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":183879558},{"type":"v1","addr":"172.21.15.60:6837","nonce":183879558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:35.419604+0000","modified":"2024-09-12T01:38:38.117150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35168":{"gid":35168,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1216783001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1216783001},{"type":"v1","addr":"172.21.15.105:6835","nonce":1216783001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35168,"qdb_cluster":[35168]},"id":5}]} 2024-09-12T01:39:00.158 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 38 2024-09-12T01:39:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.159+0000 7f44d9a5c640 1 -- 172.21.15.60:0/608744145 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f44c006be60 msgr2=0x7f44c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.159+0000 7f44d9a5c640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f44c006be60 0x7f44c006e320 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f44c4034000 tx=0x7f44c402e000 comp rx=0 tx=0).stop 2024-09-12T01:39:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.159+0000 7f44d9a5c640 1 -- 172.21.15.60:0/608744145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44d415c2b0 msgr2=0x7f44d4157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.159+0000 7f44d9a5c640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44d415c2b0 0x7f44d4157bb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f44c800d800 tx=0x7f44c800dcc0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.159+0000 7f44d9a5c640 1 -- 172.21.15.60:0/608744145 shutdown_connections 2024-09-12T01:39:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.159+0000 7f44d9a5c640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44d415f030 0x7f44d41e8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.159+0000 7f44d9a5c640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44d415c2b0 0x7f44d4157bb0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.159+0000 7f44d9a5c640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f44c006be60 0x7f44c006e320 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.159+0000 7f44d9a5c640 1 --2- 172.21.15.60:0/608744145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44d40b72f0 0x7f44d41f4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.159+0000 7f44d9a5c640 1 -- 172.21.15.60:0/608744145 >> 172.21.15.60:0/608744145 conn(0x7f44d40b4240 msgr2=0x7f44d4160070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.160+0000 7f44d9a5c640 1 -- 172.21.15.60:0/608744145 shutdown_connections 2024-09-12T01:39:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.160+0000 7f44d9a5c640 1 -- 172.21.15.60:0/608744145 wait complete. 2024-09-12T01:39:00.171 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:39:00.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.273+0000 7f07ae877640 1 Processor -- start 2024-09-12T01:39:00.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.273+0000 7f07ae877640 1 -- start start 2024-09-12T01:39:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.274+0000 7f07ae877640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f07a815c170 0x7f07a815c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.274+0000 7f07ae877640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a80cf6c0 0x7f07a80cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.274+0000 7f07ae877640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07a80b49c0 con 0x7f07a80b5dd0 2024-09-12T01:39:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.274+0000 7f07ae877640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f07a815ca90 con 0x7f07a815c170 2024-09-12T01:39:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.274+0000 7f07ae877640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f07a80b4cf0 con 0x7f07a80cf6c0 2024-09-12T01:39:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.274+0000 7f07ace14640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f07a80b5dd0 0x7f07a815ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41588/0 (socket says 172.21.15.60:41588) 2024-09-12T01:39:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.274+0000 7f07ace14640 1 -- 172.21.15.60:0/3852278851 learned_addr learned my addr 172.21.15.60:0/3852278851 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.274+0000 7f07a77fe640 1 --2- 172.21.15.60:0/3852278851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a80cf6c0 0x7f07a80cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.274+0000 7f07a7fff640 1 --2- 172.21.15.60:0/3852278851 >> v2:172.21.15.105:3300/0 conn(0x7f07a815c170 0x7f07a815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.274+0000 7f07a6ffd640 1 -- 172.21.15.60:0/3852278851 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4271298007 0 0) 0x7f07a80b49c0 con 0x7f07a80b5dd0 2024-09-12T01:39:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.274+0000 7f07a6ffd640 1 -- 172.21.15.60:0/3852278851 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0790003520 con 0x7f07a80b5dd0 2024-09-12T01:39:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.275+0000 7f07a7fff640 1 -- 172.21.15.60:0/3852278851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a80cf6c0 msgr2=0x7f07a80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.275+0000 7f07a7fff640 1 --2- 172.21.15.60:0/3852278851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a80cf6c0 0x7f07a80cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.275+0000 7f07a7fff640 1 -- 172.21.15.60:0/3852278851 >> v1:172.21.15.60:6789/0 conn(0x7f07a80b5dd0 legacy=0x7f07a815ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.275+0000 7f07a6ffd640 1 -- 172.21.15.60:0/3852278851 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2727049423 0 0) 0x7f0790003520 con 0x7f07a80b5dd0 2024-09-12T01:39:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.275+0000 7f07a7fff640 1 -- 172.21.15.60:0/3852278851 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a80b4fd0 con 0x7f07a815c170 2024-09-12T01:39:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.275+0000 7f07a77fe640 1 --2- 172.21.15.60:0/3852278851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a80cf6c0 0x7f07a80cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:39:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.275+0000 7f07a7fff640 1 --2- 172.21.15.60:0/3852278851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a815c170 0x7f07a815c550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f07980097a0 tx=0x7f079802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4c1f45c201f10e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.276+0000 7f07a6ffd640 1 -- 172.21.15.60:0/3852278851 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798037070 con 0x7f07a815c170 2024-09-12T01:39:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.276+0000 7f07a6ffd640 1 -- 172.21.15.60:0/3852278851 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079802aba0 con 0x7f07a815c170 2024-09-12T01:39:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.276+0000 7f07a6ffd640 1 -- 172.21.15.60:0/3852278851 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07a00019f0 con 0x7f07a815c170 2024-09-12T01:39:00.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.276+0000 7f07ae877640 1 -- 172.21.15.60:0/3852278851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a815c170 msgr2=0x7f07a815c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.276+0000 7f07ae877640 1 --2- 172.21.15.60:0/3852278851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a815c170 0x7f07a815c550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f07980097a0 tx=0x7f079802a110 comp rx=0 tx=0).stop 2024-09-12T01:39:00.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.276+0000 7f07ae877640 1 -- 172.21.15.60:0/3852278851 shutdown_connections 2024-09-12T01:39:00.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.276+0000 7f07ae877640 1 --2- 172.21.15.60:0/3852278851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a80cf6c0 0x7f07a80cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.276+0000 7f07ae877640 1 --2- 172.21.15.60:0/3852278851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a815c170 0x7f07a815c550 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.276+0000 7f07ae877640 1 -- 172.21.15.60:0/3852278851 >> 172.21.15.60:0/3852278851 conn(0x7f07a806bc10 msgr2=0x7f07a806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:00.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.276+0000 7f07ae877640 1 -- 172.21.15.60:0/3852278851 shutdown_connections 2024-09-12T01:39:00.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.276+0000 7f07ae877640 1 -- 172.21.15.60:0/3852278851 wait complete. 2024-09-12T01:39:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.277+0000 7f07ae877640 1 Processor -- start 2024-09-12T01:39:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.278+0000 7f07ae877640 1 -- start start 2024-09-12T01:39:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.278+0000 7f07ae877640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a80b5dd0 0x7f07a81f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.278+0000 7f07ae877640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a80cf6c0 0x7f07a80cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.278+0000 7f07ae877640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a815c170 0x7f07a80aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.278+0000 7f07ae877640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07a80b5870 con 0x7f07a80cf6c0 2024-09-12T01:39:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.278+0000 7f07ae877640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f07a80b5590 con 0x7f07a80b5dd0 2024-09-12T01:39:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.278+0000 7f07ae877640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f07a80b5b50 con 0x7f07a815c170 2024-09-12T01:39:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a80cf6c0 0x7f07a80cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a80cf6c0 0x7f07a80cb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48560/0 (socket says 172.21.15.60:48560) 2024-09-12T01:39:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a77fe640 1 -- 172.21.15.60:0/2422686758 learned_addr learned my addr 172.21.15.60:0/2422686758 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07ace14640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a815c170 0x7f07a80aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a7fff640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a80b5dd0 0x7f07a81f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a77fe640 1 -- 172.21.15.60:0/2422686758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a815c170 msgr2=0x7f07a80aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a77fe640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a815c170 0x7f07a80aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a77fe640 1 -- 172.21.15.60:0/2422686758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a80b5dd0 msgr2=0x7f07a81f28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a77fe640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a80b5dd0 0x7f07a81f28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a77fe640 1 -- 172.21.15.60:0/2422686758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a80ca080 con 0x7f07a80cf6c0 2024-09-12T01:39:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a77fe640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a80cf6c0 0x7f07a80cb120 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f079c00ec10 tx=0x7f079c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a4ff9640 1 -- 172.21.15.60:0/2422686758 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c017070 con 0x7f07a80cf6c0 2024-09-12T01:39:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a4ff9640 1 -- 172.21.15.60:0/2422686758 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079c00cc30 con 0x7f07a80cf6c0 2024-09-12T01:39:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07ae877640 1 -- 172.21.15.60:0/2422686758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a80ca360 con 0x7f07a80cf6c0 2024-09-12T01:39:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07a4ff9640 1 -- 172.21.15.60:0/2422686758 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c013470 con 0x7f07a80cf6c0 2024-09-12T01:39:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.279+0000 7f07ae877640 1 -- 172.21.15.60:0/2422686758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a80ca920 con 0x7f07a80cf6c0 2024-09-12T01:39:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.280+0000 7f07ae877640 1 -- 172.21.15.60:0/2422686758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a80cfb00 con 0x7f07a80cf6c0 2024-09-12T01:39:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.281+0000 7f07a4ff9640 1 -- 172.21.15.60:0/2422686758 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f079c01a070 con 0x7f07a80cf6c0 2024-09-12T01:39:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.281+0000 7f07a4ff9640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f079406be60 0x7f079406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.281+0000 7f07a4ff9640 1 -- 172.21.15.60:0/2422686758 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f079c08b0a0 con 0x7f07a80cf6c0 2024-09-12T01:39:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.281+0000 7f07a7fff640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f079406be60 0x7f079406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.282+0000 7f07a7fff640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f079406be60 0x7f079406e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0798034000 tx=0x7f079802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.285+0000 7f07a4ff9640 1 -- 172.21.15.60:0/2422686758 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f079c059ae0 con 0x7f07a80cf6c0 2024-09-12T01:39:00.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.462+0000 7f07ae877640 1 -- 172.21.15.60:0/2422686758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f07a80cc6e0 con 0x7f07a80cf6c0 2024-09-12T01:39:00.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.463+0000 7f07a4ff9640 1 -- 172.21.15.60:0/2422686758 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16632 (secure 0 0 0) 0x7f079c0593e0 con 0x7f07a80cf6c0 2024-09-12T01:39:00.464 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:00.464 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:38:37.067956+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:38:33.077570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T01:38:34.408910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:39:00.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.465+0000 7f07ae877640 1 -- 172.21.15.60:0/2422686758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f079406be60 msgr2=0x7f079406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.465+0000 7f07ae877640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f079406be60 0x7f079406e320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0798034000 tx=0x7f079802e000 comp rx=0 tx=0).stop 2024-09-12T01:39:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.465+0000 7f07ae877640 1 -- 172.21.15.60:0/2422686758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a80cf6c0 msgr2=0x7f07a80cb120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.465+0000 7f07ae877640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a80cf6c0 0x7f07a80cb120 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f079c00ec10 tx=0x7f079c00c520 comp rx=0 tx=0).stop 2024-09-12T01:39:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.465+0000 7f07ae877640 1 -- 172.21.15.60:0/2422686758 shutdown_connections 2024-09-12T01:39:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.465+0000 7f07ae877640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f079406be60 0x7f079406e320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.465+0000 7f07ae877640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f07a815c170 0x7f07a80aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.465+0000 7f07ae877640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a80cf6c0 0x7f07a80cb120 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.465+0000 7f07ae877640 1 --2- 172.21.15.60:0/2422686758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f07a80b5dd0 0x7f07a81f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.465+0000 7f07ae877640 1 -- 172.21.15.60:0/2422686758 >> 172.21.15.60:0/2422686758 conn(0x7f07a806bc10 msgr2=0x7f07a8071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.465+0000 7f07ae877640 1 -- 172.21.15.60:0/2422686758 shutdown_connections 2024-09-12T01:39:00.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.465+0000 7f07ae877640 1 -- 172.21.15.60:0/2422686758 wait complete. 2024-09-12T01:39:00.480 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:39:00.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:39:00.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.614+0000 7f7f3a303640 1 Processor -- start 2024-09-12T01:39:00.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.614+0000 7f7f3a303640 1 -- start start 2024-09-12T01:39:00.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f3a303640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f34155800 0x7f7f340b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f3a303640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7f340cfc80 0x7f7f340b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f3a303640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3415c770 con 0x7f7f3415c330 2024-09-12T01:39:00.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f3a303640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7f340b4e60 con 0x7f7f340cfc80 2024-09-12T01:39:00.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f3a303640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7f340b50a0 con 0x7f7f34155800 2024-09-12T01:39:00.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f337fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7f3415c330 0x7f7f340cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41592/0 (socket says 172.21.15.60:41592) 2024-09-12T01:39:00.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f337fe640 1 -- 172.21.15.60:0/1970248958 learned_addr learned my addr 172.21.15.60:0/1970248958 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:00.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f33fff640 1 --2- 172.21.15.60:0/1970248958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f34155800 0x7f7f340b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f388a0640 1 --2- 172.21.15.60:0/1970248958 >> v2:172.21.15.105:3300/0 conn(0x7f7f340cfc80 0x7f7f340b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f32ffd640 1 -- 172.21.15.60:0/1970248958 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4234497199 0 0) 0x7f7f28001110 con 0x7f7f3415c330 2024-09-12T01:39:00.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f32ffd640 1 -- 172.21.15.60:0/1970248958 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f1c003520 con 0x7f7f3415c330 2024-09-12T01:39:00.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f33fff640 1 -- 172.21.15.60:0/1970248958 >> v2:172.21.15.105:3300/0 conn(0x7f7f340cfc80 msgr2=0x7f7f340b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:00.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f33fff640 1 --2- 172.21.15.60:0/1970248958 >> v2:172.21.15.105:3300/0 conn(0x7f7f340cfc80 0x7f7f340b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f33fff640 1 -- 172.21.15.60:0/1970248958 >> v1:172.21.15.60:6789/0 conn(0x7f7f3415c330 legacy=0x7f7f340cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f32ffd640 1 -- 172.21.15.60:0/1970248958 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2267605195 0 0) 0x7f7f1c003520 con 0x7f7f3415c330 2024-09-12T01:39:00.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f33fff640 1 -- 172.21.15.60:0/1970248958 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f340b5380 con 0x7f7f34155800 2024-09-12T01:39:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.616+0000 7f7f33fff640 1 --2- 172.21.15.60:0/1970248958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f34155800 0x7f7f340b6140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f240097a0 tx=0x7f7f2402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71f3414a6abbbc2a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.617+0000 7f7f32ffd640 1 -- 172.21.15.60:0/1970248958 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24037070 con 0x7f7f34155800 2024-09-12T01:39:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.617+0000 7f7f32ffd640 1 -- 172.21.15.60:0/1970248958 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f2402aba0 con 0x7f7f34155800 2024-09-12T01:39:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.617+0000 7f7f32ffd640 1 -- 172.21.15.60:0/1970248958 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f28001840 con 0x7f7f34155800 2024-09-12T01:39:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.617+0000 7f7f3a303640 1 -- 172.21.15.60:0/1970248958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f34155800 msgr2=0x7f7f340b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.617+0000 7f7f3a303640 1 --2- 172.21.15.60:0/1970248958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f34155800 0x7f7f340b6140 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7f240097a0 tx=0x7f7f2402a110 comp rx=0 tx=0).stop 2024-09-12T01:39:00.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.617+0000 7f7f3a303640 1 -- 172.21.15.60:0/1970248958 shutdown_connections 2024-09-12T01:39:00.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.617+0000 7f7f3a303640 1 --2- 172.21.15.60:0/1970248958 >> v2:172.21.15.105:3300/0 conn(0x7f7f340cfc80 0x7f7f340b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.617+0000 7f7f3a303640 1 --2- 172.21.15.60:0/1970248958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f34155800 0x7f7f340b6140 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.617+0000 7f7f3a303640 1 -- 172.21.15.60:0/1970248958 >> 172.21.15.60:0/1970248958 conn(0x7f7f3406bc10 msgr2=0x7f7f3406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:00.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.617+0000 7f7f3a303640 1 -- 172.21.15.60:0/1970248958 shutdown_connections 2024-09-12T01:39:00.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.617+0000 7f7f3a303640 1 -- 172.21.15.60:0/1970248958 wait complete. 2024-09-12T01:39:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.618+0000 7f7f3a303640 1 Processor -- start 2024-09-12T01:39:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.619+0000 7f7f3a303640 1 -- start start 2024-09-12T01:39:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.619+0000 7f7f3a303640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f340cfc80 0x7f7f3414a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.619+0000 7f7f3a303640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f34155800 0x7f7f3414aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.619+0000 7f7f3a303640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f3415c330 0x7f7f341efce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.619+0000 7f7f3a303640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7f340b5c20 con 0x7f7f340cfc80 2024-09-12T01:39:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.619+0000 7f7f3a303640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7f340b5940 con 0x7f7f3415c330 2024-09-12T01:39:00.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.619+0000 7f7f3a303640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7f34155be0 con 0x7f7f34155800 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.619+0000 7f7f33fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f340cfc80 0x7f7f3414a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.619+0000 7f7f33fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f340cfc80 0x7f7f3414a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48566/0 (socket says 172.21.15.60:48566) 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.619+0000 7f7f33fff640 1 -- 172.21.15.60:0/2963395707 learned_addr learned my addr 172.21.15.60:0/2963395707 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f388a0640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f3415c330 0x7f7f341efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f337fe640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f34155800 0x7f7f3414aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f33fff640 1 -- 172.21.15.60:0/2963395707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f34155800 msgr2=0x7f7f3414aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f33fff640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f34155800 0x7f7f3414aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f33fff640 1 -- 172.21.15.60:0/2963395707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f3415c330 msgr2=0x7f7f341efce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f33fff640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f3415c330 0x7f7f341efce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f33fff640 1 -- 172.21.15.60:0/2963395707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f34152710 con 0x7f7f340cfc80 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f337fe640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f34155800 0x7f7f3414aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f33fff640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f340cfc80 0x7f7f3414a990 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7f24035040 tx=0x7f7f240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f30ff9640 1 -- 172.21.15.60:0/2963395707 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24037050 con 0x7f7f340cfc80 2024-09-12T01:39:00.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f30ff9640 1 -- 172.21.15.60:0/2963395707 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f24043070 con 0x7f7f340cfc80 2024-09-12T01:39:00.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f3a303640 1 -- 172.21.15.60:0/2963395707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f3414ce90 con 0x7f7f340cfc80 2024-09-12T01:39:00.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f30ff9640 1 -- 172.21.15.60:0/2963395707 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f24006e10 con 0x7f7f340cfc80 2024-09-12T01:39:00.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.620+0000 7f7f3a303640 1 -- 172.21.15.60:0/2963395707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f3414d450 con 0x7f7f340cfc80 2024-09-12T01:39:00.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.621+0000 7f7f3a303640 1 -- 172.21.15.60:0/2963395707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f340b6140 con 0x7f7f340cfc80 2024-09-12T01:39:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.622+0000 7f7f30ff9640 1 -- 172.21.15.60:0/2963395707 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f2403ca10 con 0x7f7f340cfc80 2024-09-12T01:39:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.622+0000 7f7f30ff9640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7f2006be60 0x7f7f2006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.622+0000 7f7f30ff9640 1 -- 172.21.15.60:0/2963395707 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f7f240abbd0 con 0x7f7f340cfc80 2024-09-12T01:39:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.622+0000 7f7f337fe640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7f2006be60 0x7f7f2006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.623+0000 7f7f337fe640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7f2006be60 0x7f7f2006e320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7f340cf670 tx=0x7f7f28009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.626+0000 7f7f30ff9640 1 -- 172.21.15.60:0/2963395707 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f2407a600 con 0x7f7f340cfc80 2024-09-12T01:39:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.841+0000 7f7f3a303640 1 -- 172.21.15.60:0/2963395707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f3414db00 con 0x7f7f340cfc80 2024-09-12T01:39:00.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.842+0000 7f7f30ff9640 1 -- 172.21.15.60:0/2963395707 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7f7f24079f00 con 0x7f7f340cfc80 2024-09-12T01:39:00.842 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:00.843 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":38,"btime":"2024-09-12T01:38:39:078790+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/672507371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":672507371},{"type":"v1","addr":"172.21.15.60:6836","nonce":672507371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/2426056287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2426056287},{"type":"v1","addr":"172.21.15.105:6833","nonce":2426056287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/183879558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":183879558},{"type":"v1","addr":"172.21.15.60:6837","nonce":183879558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:35.419604+0000","modified":"2024-09-12T01:38:38.117150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35168":{"gid":35168,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1216783001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1216783001},{"type":"v1","addr":"172.21.15.105:6835","nonce":1216783001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35168,"qdb_cluster":[35168]},"id":5}]} 2024-09-12T01:39:00.843 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 38 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.844+0000 7f7f3a303640 1 -- 172.21.15.60:0/2963395707 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7f2006be60 msgr2=0x7f7f2006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.844+0000 7f7f3a303640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7f2006be60 0x7f7f2006e320 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7f340cf670 tx=0x7f7f28009040 comp rx=0 tx=0).stop 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.844+0000 7f7f3a303640 1 -- 172.21.15.60:0/2963395707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f340cfc80 msgr2=0x7f7f3414a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.844+0000 7f7f3a303640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f340cfc80 0x7f7f3414a990 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7f24035040 tx=0x7f7f240046c0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.844+0000 7f7f3a303640 1 -- 172.21.15.60:0/2963395707 shutdown_connections 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.844+0000 7f7f3a303640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f3415c330 0x7f7f341efce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.844+0000 7f7f3a303640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7f2006be60 0x7f7f2006e320 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.844+0000 7f7f3a303640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f34155800 0x7f7f3414aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.844+0000 7f7f3a303640 1 --2- 172.21.15.60:0/2963395707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f340cfc80 0x7f7f3414a990 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.844+0000 7f7f3a303640 1 -- 172.21.15.60:0/2963395707 >> 172.21.15.60:0/2963395707 conn(0x7f7f3406bc10 msgr2=0x7f7f340ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:00.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.844+0000 7f7f3a303640 1 -- 172.21.15.60:0/2963395707 shutdown_connections 2024-09-12T01:39:00.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.844+0000 7f7f3a303640 1 -- 172.21.15.60:0/2963395707 wait complete. 2024-09-12T01:39:00.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:39:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa2a2e8d640 1 Processor -- start 2024-09-12T01:39:00.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa2a2e8d640 1 -- start start 2024-09-12T01:39:00.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa2a2e8d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa29c0cfc80 0x7fa29c0b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa2a2e8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa29c15c330 0x7fa29c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa2a2e8d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa29c15c740 con 0x7fa29c155800 2024-09-12T01:39:00.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa2a2e8d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa29c0b4e60 con 0x7fa29c0cfc80 2024-09-12T01:39:00.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa2a2e8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa29c0b50a0 con 0x7fa29c15c330 2024-09-12T01:39:00.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa29bfff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa29c0cfc80 0x7fa29c0b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa2a142a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa29c15c330 0x7fa29c0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa29bfff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa29c0cfc80 0x7fa29c0b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:43544/0 (socket says 172.21.15.60:43544) 2024-09-12T01:39:00.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa29bfff640 1 -- 172.21.15.60:0/680419561 learned_addr learned my addr 172.21.15.60:0/680419561 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:00.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa2a0c29640 1 --1- 172.21.15.60:0/680419561 >> v1:172.21.15.105:6789/0 conn(0x7fa29c155800 0x7fa29c0cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:33502/0 (socket says 172.21.15.60:33502) 2024-09-12T01:39:00.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa2a142a640 1 --2- 172.21.15.60:0/680419561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa29c15c330 0x7fa29c0b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:55402/0 (socket says 172.21.15.60:55402) 2024-09-12T01:39:00.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa29bfff640 1 -- 172.21.15.60:0/680419561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa29c15c330 msgr2=0x7fa29c0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:00.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa29bfff640 1 --2- 172.21.15.60:0/680419561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa29c15c330 0x7fa29c0b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa29bfff640 1 -- 172.21.15.60:0/680419561 >> v1:172.21.15.105:6789/0 conn(0x7fa29c155800 legacy=0x7fa29c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.959+0000 7fa29bfff640 1 -- 172.21.15.60:0/680419561 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29c0b5380 con 0x7fa29c0cfc80 2024-09-12T01:39:00.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.960+0000 7fa29bfff640 1 --2- 172.21.15.60:0/680419561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa29c0cfc80 0x7fa29c0b6140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa288009870 tx=0x7fa28802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9229faf3bb8fc801 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.960+0000 7fa29b7fe640 1 -- 172.21.15.60:0/680419561 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288037070 con 0x7fa29c0cfc80 2024-09-12T01:39:00.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.960+0000 7fa29b7fe640 1 -- 172.21.15.60:0/680419561 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa288032440 con 0x7fa29c0cfc80 2024-09-12T01:39:00.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.960+0000 7fa29b7fe640 1 -- 172.21.15.60:0/680419561 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288032810 con 0x7fa29c0cfc80 2024-09-12T01:39:00.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.961+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/680419561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa29c0cfc80 msgr2=0x7fa29c0b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.961+0000 7fa2a2e8d640 1 --2- 172.21.15.60:0/680419561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa29c0cfc80 0x7fa29c0b6140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa288009870 tx=0x7fa28802a270 comp rx=0 tx=0).stop 2024-09-12T01:39:00.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.961+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/680419561 shutdown_connections 2024-09-12T01:39:00.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.961+0000 7fa2a2e8d640 1 --2- 172.21.15.60:0/680419561 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa29c15c330 0x7fa29c0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.961+0000 7fa2a2e8d640 1 --2- 172.21.15.60:0/680419561 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa29c0cfc80 0x7fa29c0b6140 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.961+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/680419561 >> 172.21.15.60:0/680419561 conn(0x7fa29c06bc10 msgr2=0x7fa29c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:00.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.961+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/680419561 shutdown_connections 2024-09-12T01:39:00.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.961+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/680419561 wait complete. 2024-09-12T01:39:00.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.962+0000 7fa2a2e8d640 1 Processor -- start 2024-09-12T01:39:00.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.962+0000 7fa2a2e8d640 1 -- start start 2024-09-12T01:39:00.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a2e8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa29c0cfc80 0x7fa29c1506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a2e8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa29c155800 0x7fa29c14e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a2e8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa29c15c330 0x7fa29c154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a2e8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c0b5c20 con 0x7fa29c15c330 2024-09-12T01:39:00.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a2e8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c0b5940 con 0x7fa29c0cfc80 2024-09-12T01:39:00.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a2e8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa29c155be0 con 0x7fa29c155800 2024-09-12T01:39:00.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a142a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa29c15c330 0x7fa29c154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a142a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa29c15c330 0x7fa29c154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48576/0 (socket says 172.21.15.60:48576) 2024-09-12T01:39:00.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a142a640 1 -- 172.21.15.60:0/563507698 learned_addr learned my addr 172.21.15.60:0/563507698 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:00.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa29bfff640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa29c155800 0x7fa29c14e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a0c29640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa29c0cfc80 0x7fa29c1506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a142a640 1 -- 172.21.15.60:0/563507698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa29c155800 msgr2=0x7fa29c14e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a142a640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa29c155800 0x7fa29c14e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a142a640 1 -- 172.21.15.60:0/563507698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa29c0cfc80 msgr2=0x7fa29c1506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:00.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a142a640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa29c0cfc80 0x7fa29c1506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:00.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.963+0000 7fa2a142a640 1 -- 172.21.15.60:0/563507698 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29c14e810 con 0x7fa29c15c330 2024-09-12T01:39:00.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.964+0000 7fa2a142a640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa29c15c330 0x7fa29c154110 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa29400ec10 tx=0x7fa29400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.964+0000 7fa2997fa640 1 -- 172.21.15.60:0/563507698 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294018020 con 0x7fa29c15c330 2024-09-12T01:39:00.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.964+0000 7fa2997fa640 1 -- 172.21.15.60:0/563507698 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa29400cd20 con 0x7fa29c15c330 2024-09-12T01:39:00.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.964+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/563507698 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29c150cc0 con 0x7fa29c15c330 2024-09-12T01:39:00.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.964+0000 7fa2997fa640 1 -- 172.21.15.60:0/563507698 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2940146c0 con 0x7fa29c15c330 2024-09-12T01:39:00.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.964+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/563507698 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29c151280 con 0x7fa29c15c330 2024-09-12T01:39:00.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.965+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/563507698 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa29c0b6140 con 0x7fa29c15c330 2024-09-12T01:39:00.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.965+0000 7fa2997fa640 1 -- 172.21.15.60:0/563507698 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa294005d10 con 0x7fa29c15c330 2024-09-12T01:39:00.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.966+0000 7fa2997fa640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa28006be60 0x7fa28006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:00.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.966+0000 7fa2997fa640 1 -- 172.21.15.60:0/563507698 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fa29408b850 con 0x7fa29c15c330 2024-09-12T01:39:00.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.966+0000 7fa2a0c29640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa28006be60 0x7fa28006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:00.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.966+0000 7fa2a0c29640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa28006be60 0x7fa28006e320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa290007fd0 tx=0x7fa290007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:00.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:00.971+0000 7fa2997fa640 1 -- 172.21.15.60:0/563507698 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa294022070 con 0x7fa29c15c330 2024-09-12T01:39:01.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.182+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/563507698 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa29c0ce7d0 con 0x7fa29c15c330 2024-09-12T01:39:01.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.182+0000 7fa2997fa640 1 -- 172.21.15.60:0/563507698 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5230 (secure 0 0 0) 0x7fa294010040 con 0x7fa29c15c330 2024-09-12T01:39:01.183 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:01.183 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":38,"btime":"2024-09-12T01:38:39:078790+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/672507371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":672507371},{"type":"v1","addr":"172.21.15.60:6836","nonce":672507371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/2426056287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2426056287},{"type":"v1","addr":"172.21.15.105:6833","nonce":2426056287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/183879558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":183879558},{"type":"v1","addr":"172.21.15.60:6837","nonce":183879558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:38:35.419604+0000","modified":"2024-09-12T01:38:38.117150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35168},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35168":{"gid":35168,"name":"d","rank":0,"incarnation":35,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/1216783001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1216783001},{"type":"v1","addr":"172.21.15.105:6835","nonce":1216783001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35168,"qdb_cluster":[35168]},"id":5}]} 2024-09-12T01:39:01.183 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 38 2024-09-12T01:39:01.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.185+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/563507698 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa28006be60 msgr2=0x7fa28006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.185+0000 7fa2a2e8d640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa28006be60 0x7fa28006e320 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa290007fd0 tx=0x7fa290007e80 comp rx=0 tx=0).stop 2024-09-12T01:39:01.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.185+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/563507698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa29c15c330 msgr2=0x7fa29c154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.185+0000 7fa2a2e8d640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa29c15c330 0x7fa29c154110 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa29400ec10 tx=0x7fa29400c490 comp rx=0 tx=0).stop 2024-09-12T01:39:01.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.185+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/563507698 shutdown_connections 2024-09-12T01:39:01.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.185+0000 7fa2a2e8d640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa29c15c330 0x7fa29c154110 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.185+0000 7fa2a2e8d640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa28006be60 0x7fa28006e320 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.185+0000 7fa2a2e8d640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa29c155800 0x7fa29c14e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.185+0000 7fa2a2e8d640 1 --2- 172.21.15.60:0/563507698 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa29c0cfc80 0x7fa29c1506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.185+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/563507698 >> 172.21.15.60:0/563507698 conn(0x7fa29c06bc10 msgr2=0x7fa29c0cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:01.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.185+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/563507698 shutdown_connections 2024-09-12T01:39:01.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.185+0000 7fa2a2e8d640 1 -- 172.21.15.60:0/563507698 wait complete. 2024-09-12T01:39:01.195 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:39:01.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.297+0000 7ff4e0ced640 1 Processor -- start 2024-09-12T01:39:01.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.297+0000 7ff4e0ced640 1 -- start start 2024-09-12T01:39:01.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.298+0000 7ff4e0ced640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0d3310 0x7ff4dc0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.298+0000 7ff4e0ced640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff4dc0d1650 0x7ff4dc0b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.298+0000 7ff4e0ced640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4dc15ea40 con 0x7ff4dc15e660 2024-09-12T01:39:01.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.298+0000 7ff4e0ced640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff4dc0d1ac0 con 0x7ff4dc0d1650 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.298+0000 7ff4e0ced640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff4dc0d3870 con 0x7ff4dc0d3310 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.298+0000 7ff4da59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff4dc15e660 0x7ff4dc0cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41596/0 (socket says 172.21.15.60:41596) 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.298+0000 7ff4da59c640 1 -- 172.21.15.60:0/184926028 learned_addr learned my addr 172.21.15.60:0/184926028 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d9d9b640 1 --2- 172.21.15.60:0/184926028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0d3310 0x7ff4dc0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3218245209 0 0) 0x7ff4dc15ea40 con 0x7ff4dc15e660 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4dad9d640 1 --2- 172.21.15.60:0/184926028 >> v2:172.21.15.105:3300/0 conn(0x7ff4dc0d1650 0x7ff4dc0b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4c8003520 con 0x7ff4dc15e660 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3828186245 0 0) 0x7ff4c8003520 con 0x7ff4dc15e660 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0d3310 msgr2=0x7ff4dc0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 --2- 172.21.15.60:0/184926028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0d3310 0x7ff4dc0d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 >> v2:172.21.15.105:3300/0 conn(0x7ff4dc0d1650 msgr2=0x7ff4dc0b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 --2- 172.21.15.60:0/184926028 >> v2:172.21.15.105:3300/0 conn(0x7ff4dc0d1650 0x7ff4dc0b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4dc0d3b50 con 0x7ff4dc15e660 2024-09-12T01:39:01.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7ff4cc0019f0 con 0x7ff4dc15e660 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 >> v1:172.21.15.60:6789/0 conn(0x7ff4dc15e660 legacy=0x7ff4dc0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 --2- 172.21.15.60:0/184926028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80039b0 0x7ff4c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 --2- 172.21.15.60:0/184926028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c8004800 0x7ff4c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 --2- 172.21.15.60:0/184926028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0d3310 0x7ff4c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc0d1ac0 con 0x7ff4c80039b0 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc0d3870 con 0x7ff4c8004800 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c800b9c0 con 0x7ff4dc0d3310 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4da59c640 1 --2- 172.21.15.60:0/184926028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80039b0 0x7ff4c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4d9d9b640 1 --2- 172.21.15.60:0/184926028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c8004800 0x7ff4c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4dad9d640 1 --2- 172.21.15.60:0/184926028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0d3310 0x7ff4c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4da59c640 1 -- 172.21.15.60:0/184926028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0d3310 msgr2=0x7ff4c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4da59c640 1 --2- 172.21.15.60:0/184926028 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0d3310 0x7ff4c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4da59c640 1 -- 172.21.15.60:0/184926028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c8004800 msgr2=0x7ff4c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4da59c640 1 --2- 172.21.15.60:0/184926028 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4c8004800 0x7ff4c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.299+0000 7ff4da59c640 1 -- 172.21.15.60:0/184926028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c8003520 con 0x7ff4c80039b0 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.300+0000 7ff4da59c640 1 --2- 172.21.15.60:0/184926028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80039b0 0x7ff4c8003dd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00a880 tx=0x7ff4c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16580dd504885724 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.300+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc00a4a0 con 0x7ff4c80039b0 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.300+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4cc02f070 con 0x7ff4c80039b0 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.300+0000 7ff4d959a640 1 -- 172.21.15.60:0/184926028 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc02bd00 con 0x7ff4c80039b0 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.301+0000 7ff4e0ced640 1 -- 172.21.15.60:0/184926028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80039b0 msgr2=0x7ff4c8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.301+0000 7ff4e0ced640 1 --2- 172.21.15.60:0/184926028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80039b0 0x7ff4c8003dd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00a880 tx=0x7ff4c8005830 comp rx=0 tx=0).stop 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.301+0000 7ff4dad9d640 1 -- 172.21.15.60:0/184926028 reap_dead start 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.301+0000 7ff4e0ced640 1 -- 172.21.15.60:0/184926028 shutdown_connections 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.301+0000 7ff4e0ced640 1 -- 172.21.15.60:0/184926028 >> 172.21.15.60:0/184926028 conn(0x7ff4dc0b6410 msgr2=0x7ff4dc0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.301+0000 7ff4e0ced640 1 -- 172.21.15.60:0/184926028 shutdown_connections 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.301+0000 7ff4e0ced640 1 -- 172.21.15.60:0/184926028 wait complete. 2024-09-12T01:39:01.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.302+0000 7ff4e0ced640 1 Processor -- start 2024-09-12T01:39:01.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.302+0000 7ff4e0ced640 1 -- start start 2024-09-12T01:39:01.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4e0ced640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80039b0 0x7ff4dc0b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4e0ced640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0b85e0 0x7ff4dc0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4e0ced640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4dc0cbd10 0x7ff4dc152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4e0ced640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc0d43f0 con 0x7ff4c80039b0 2024-09-12T01:39:01.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4e0ced640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff4dc0d4110 con 0x7ff4dc0cbd10 2024-09-12T01:39:01.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4e0ced640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff4dc0d1110 con 0x7ff4dc0b85e0 2024-09-12T01:39:01.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4da59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80039b0 0x7ff4dc0b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4da59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80039b0 0x7ff4dc0b80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48594/0 (socket says 172.21.15.60:48594) 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4da59c640 1 -- 172.21.15.60:0/3005036729 learned_addr learned my addr 172.21.15.60:0/3005036729 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4dad9d640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4dc0cbd10 0x7ff4dc152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4d9d9b640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0b85e0 0x7ff4dc0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4da59c640 1 -- 172.21.15.60:0/3005036729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0b85e0 msgr2=0x7ff4dc0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4da59c640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0b85e0 0x7ff4dc0cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4da59c640 1 -- 172.21.15.60:0/3005036729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4dc0cbd10 msgr2=0x7ff4dc152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.303+0000 7ff4da59c640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4dc0cbd10 0x7ff4dc152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.304+0000 7ff4da59c640 1 -- 172.21.15.60:0/3005036729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4dc0b8c10 con 0x7ff4c80039b0 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.304+0000 7ff4da59c640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80039b0 0x7ff4dc0b80a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00a9a0 tx=0x7ff4dc0d3d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.304+0000 7ff4d2ffd640 1 -- 172.21.15.60:0/3005036729 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc02b8a0 con 0x7ff4c80039b0 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.304+0000 7ff4d2ffd640 1 -- 172.21.15.60:0/3005036729 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4cc02ba40 con 0x7ff4c80039b0 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.304+0000 7ff4e0ced640 1 -- 172.21.15.60:0/3005036729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4dc0b8ef0 con 0x7ff4c80039b0 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.304+0000 7ff4d2ffd640 1 -- 172.21.15.60:0/3005036729 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc02bdf0 con 0x7ff4c80039b0 2024-09-12T01:39:01.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.304+0000 7ff4e0ced640 1 -- 172.21.15.60:0/3005036729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4dc0b94b0 con 0x7ff4c80039b0 2024-09-12T01:39:01.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.305+0000 7ff4e0ced640 1 -- 172.21.15.60:0/3005036729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4dc0cf730 con 0x7ff4c80039b0 2024-09-12T01:39:01.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.305+0000 7ff4d2ffd640 1 -- 172.21.15.60:0/3005036729 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff4cc034470 con 0x7ff4c80039b0 2024-09-12T01:39:01.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.306+0000 7ff4d2ffd640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff4bc06be60 0x7ff4bc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.306+0000 7ff4d2ffd640 1 -- 172.21.15.60:0/3005036729 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7ff4cc0ab6d0 con 0x7ff4c80039b0 2024-09-12T01:39:01.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.306+0000 7ff4d9d9b640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff4bc06be60 0x7ff4bc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.306+0000 7ff4d9d9b640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff4bc06be60 0x7ff4bc06e320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0d03d0 tx=0x7ff4c4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:01.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.310+0000 7ff4d2ffd640 1 -- 172.21.15.60:0/3005036729 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff4cc07a140 con 0x7ff4c80039b0 2024-09-12T01:39:01.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.488+0000 7ff4e0ced640 1 -- 172.21.15.60:0/3005036729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4dc0d5200 con 0x7ff4c80039b0 2024-09-12T01:39:01.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.489+0000 7ff4d2ffd640 1 -- 172.21.15.60:0/3005036729 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16632 (secure 0 0 0) 0x7ff4cc079a40 con 0x7ff4c80039b0 2024-09-12T01:39:01.490 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:01.490 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":68,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:38:37.067956+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:38:33.077570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-12T01:38:34.408910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:39:01.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.491+0000 7ff4e0ced640 1 -- 172.21.15.60:0/3005036729 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff4bc06be60 msgr2=0x7ff4bc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.491+0000 7ff4e0ced640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff4bc06be60 0x7ff4bc06e320 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc0d03d0 tx=0x7ff4c4009190 comp rx=0 tx=0).stop 2024-09-12T01:39:01.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.491+0000 7ff4e0ced640 1 -- 172.21.15.60:0/3005036729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80039b0 msgr2=0x7ff4dc0b80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.491+0000 7ff4e0ced640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80039b0 0x7ff4dc0b80a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00a9a0 tx=0x7ff4dc0d3d20 comp rx=0 tx=0).stop 2024-09-12T01:39:01.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.491+0000 7ff4e0ced640 1 -- 172.21.15.60:0/3005036729 shutdown_connections 2024-09-12T01:39:01.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.491+0000 7ff4e0ced640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff4dc0cbd10 0x7ff4dc152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.491+0000 7ff4e0ced640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff4bc06be60 0x7ff4bc06e320 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.491+0000 7ff4e0ced640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff4dc0b85e0 0x7ff4dc0cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.491+0000 7ff4e0ced640 1 --2- 172.21.15.60:0/3005036729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4c80039b0 0x7ff4dc0b80a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.491+0000 7ff4e0ced640 1 -- 172.21.15.60:0/3005036729 >> 172.21.15.60:0/3005036729 conn(0x7ff4dc0b6410 msgr2=0x7ff4dc15d020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:01.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.491+0000 7ff4e0ced640 1 -- 172.21.15.60:0/3005036729 shutdown_connections 2024-09-12T01:39:01.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.491+0000 7ff4e0ced640 1 -- 172.21.15.60:0/3005036729 wait complete. 2024-09-12T01:39:01.503 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:39:01.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.606+0000 7fc648991640 1 Processor -- start 2024-09-12T01:39:01.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.606+0000 7fc648991640 1 -- start start 2024-09-12T01:39:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.607+0000 7fc648991640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc64415e7a0 0x7fc64406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.607+0000 7fc648991640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6440cf1f0 0x7fc6440b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.607+0000 7fc648991640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6440cf860 con 0x7fc6440b6720 2024-09-12T01:39:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.607+0000 7fc648991640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc6440d2ca0 con 0x7fc64415e7a0 2024-09-12T01:39:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.607+0000 7fc648991640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc6440cfb40 con 0x7fc6440cf1f0 2024-09-12T01:39:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.607+0000 7fc64259c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc64415e7a0 0x7fc64406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.607+0000 7fc642d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc6440b6720 0x7fc6441623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41608/0 (socket says 172.21.15.60:41608) 2024-09-12T01:39:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.607+0000 7fc642d9d640 1 -- 172.21.15.60:0/4080630034 learned_addr learned my addr 172.21.15.60:0/4080630034 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.607+0000 7fc641d9b640 1 --2- 172.21.15.60:0/4080630034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6440cf1f0 0x7fc6440b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.608+0000 7fc64259c640 1 -- 172.21.15.60:0/4080630034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6440cf1f0 msgr2=0x7fc6440b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.608+0000 7fc64259c640 1 --2- 172.21.15.60:0/4080630034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6440cf1f0 0x7fc6440b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.608+0000 7fc64259c640 1 -- 172.21.15.60:0/4080630034 >> v1:172.21.15.60:6789/0 conn(0x7fc6440b6720 legacy=0x7fc6441623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.608+0000 7fc64259c640 1 -- 172.21.15.60:0/4080630034 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6440cfe20 con 0x7fc64415e7a0 2024-09-12T01:39:01.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.608+0000 7fc641d9b640 1 --2- 172.21.15.60:0/4080630034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6440cf1f0 0x7fc6440b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.608+0000 7fc64259c640 1 --2- 172.21.15.60:0/4080630034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc64415e7a0 0x7fc64406caa0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc6340097a0 tx=0x7fc63402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f34fe4843854ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.608+0000 7fc64159a640 1 -- 172.21.15.60:0/4080630034 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634037070 con 0x7fc64415e7a0 2024-09-12T01:39:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.608+0000 7fc64159a640 1 -- 172.21.15.60:0/4080630034 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63402ae50 con 0x7fc64415e7a0 2024-09-12T01:39:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.608+0000 7fc64159a640 1 -- 172.21.15.60:0/4080630034 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634032660 con 0x7fc64415e7a0 2024-09-12T01:39:01.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.609+0000 7fc648991640 1 -- 172.21.15.60:0/4080630034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc64415e7a0 msgr2=0x7fc64406caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.609+0000 7fc648991640 1 --2- 172.21.15.60:0/4080630034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc64415e7a0 0x7fc64406caa0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc6340097a0 tx=0x7fc63402a100 comp rx=0 tx=0).stop 2024-09-12T01:39:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.609+0000 7fc648991640 1 -- 172.21.15.60:0/4080630034 shutdown_connections 2024-09-12T01:39:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.609+0000 7fc648991640 1 --2- 172.21.15.60:0/4080630034 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc6440cf1f0 0x7fc6440b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.609+0000 7fc648991640 1 --2- 172.21.15.60:0/4080630034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc64415e7a0 0x7fc64406caa0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.609+0000 7fc648991640 1 -- 172.21.15.60:0/4080630034 >> 172.21.15.60:0/4080630034 conn(0x7fc6440d11e0 msgr2=0x7fc6440d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.609+0000 7fc648991640 1 -- 172.21.15.60:0/4080630034 shutdown_connections 2024-09-12T01:39:01.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.609+0000 7fc648991640 1 -- 172.21.15.60:0/4080630034 wait complete. 2024-09-12T01:39:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.610+0000 7fc648991640 1 Processor -- start 2024-09-12T01:39:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.610+0000 7fc648991640 1 -- start start 2024-09-12T01:39:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.611+0000 7fc648991640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6440b6720 0x7fc6441617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.611+0000 7fc648991640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6440cf1f0 0x7fc644158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.611+0000 7fc648991640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc64415e7a0 0x7fc64415fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.611+0000 7fc648991640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc64406cfe0 con 0x7fc6440b6720 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.611+0000 7fc648991640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc6440b7a00 con 0x7fc6440cf1f0 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.611+0000 7fc648991640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc6440d4420 con 0x7fc64415e7a0 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.611+0000 7fc64259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6440b6720 0x7fc6441617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.611+0000 7fc64259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6440b6720 0x7fc6441617b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48612/0 (socket says 172.21.15.60:48612) 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.611+0000 7fc64259c640 1 -- 172.21.15.60:0/2765187679 learned_addr learned my addr 172.21.15.60:0/2765187679 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc641d9b640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6440cf1f0 0x7fc644158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc642d9d640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc64415e7a0 0x7fc64415fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc64259c640 1 -- 172.21.15.60:0/2765187679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc64415e7a0 msgr2=0x7fc64415fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc64259c640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc64415e7a0 0x7fc64415fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc64259c640 1 -- 172.21.15.60:0/2765187679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6440cf1f0 msgr2=0x7fc644158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc64259c640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6440cf1f0 0x7fc644158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc64259c640 1 -- 172.21.15.60:0/2765187679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc644160710 con 0x7fc6440b6720 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc641d9b640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6440cf1f0 0x7fc644158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc642d9d640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc64415e7a0 0x7fc64415fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc64259c640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6440b6720 0x7fc6441617b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc6340097a0 tx=0x7fc6340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc632ffd640 1 -- 172.21.15.60:0/2765187679 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634042070 con 0x7fc6440b6720 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc632ffd640 1 -- 172.21.15.60:0/2765187679 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63403e670 con 0x7fc6440b6720 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc632ffd640 1 -- 172.21.15.60:0/2765187679 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc634037040 con 0x7fc6440b6720 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc648991640 1 -- 172.21.15.60:0/2765187679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6441609f0 con 0x7fc6440b6720 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.612+0000 7fc648991640 1 -- 172.21.15.60:0/2765187679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc644160fb0 con 0x7fc6440b6720 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.613+0000 7fc648991640 1 -- 172.21.15.60:0/2765187679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc64415eb80 con 0x7fc6440b6720 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.613+0000 7fc632ffd640 1 -- 172.21.15.60:0/2765187679 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc634045070 con 0x7fc6440b6720 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.614+0000 7fc632ffd640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc62406be60 0x7fc62406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.614+0000 7fc632ffd640 1 -- 172.21.15.60:0/2765187679 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fc6340ab6c0 con 0x7fc6440b6720 2024-09-12T01:39:01.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.614+0000 7fc641d9b640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc62406be60 0x7fc62406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.614+0000 7fc641d9b640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc62406be60 0x7fc62406e320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6441f7e40 tx=0x7fc638008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:01.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.619+0000 7fc632ffd640 1 -- 172.21.15.60:0/2765187679 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc63407a220 con 0x7fc6440b6720 2024-09-12T01:39:01.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.835+0000 7fc648991640 1 -- 172.21.15.60:0/2765187679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc6440cefd0 con 0x7fc6440b6720 2024-09-12T01:39:01.835 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-12T01:39:01.836+0000 7f58b98dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:39:01.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.837+0000 7fc632ffd640 1 -- 172.21.15.60:0/2765187679 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) ==== 161+0+0 (secure 0 0 0) 0x7fc634079b20 con 0x7fc6440b6720 2024-09-12T01:39:01.836 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:39:01.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.840+0000 7fc648991640 1 -- 172.21.15.60:0/2765187679 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc62406be60 msgr2=0x7fc62406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.840+0000 7fc648991640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc62406be60 0x7fc62406e320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6441f7e40 tx=0x7fc638008040 comp rx=0 tx=0).stop 2024-09-12T01:39:01.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.840+0000 7fc648991640 1 -- 172.21.15.60:0/2765187679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6440b6720 msgr2=0x7fc6441617b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.840+0000 7fc648991640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6440b6720 0x7fc6441617b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc6340097a0 tx=0x7fc6340046c0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.840+0000 7fc648991640 1 -- 172.21.15.60:0/2765187679 shutdown_connections 2024-09-12T01:39:01.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.840+0000 7fc648991640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc62406be60 0x7fc62406e320 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.840+0000 7fc648991640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc64415e7a0 0x7fc64415fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.840+0000 7fc648991640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc6440cf1f0 0x7fc644158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.840+0000 7fc648991640 1 --2- 172.21.15.60:0/2765187679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6440b6720 0x7fc6441617b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.840+0000 7fc648991640 1 -- 172.21.15.60:0/2765187679 >> 172.21.15.60:0/2765187679 conn(0x7fc6440d11e0 msgr2=0x7fc64415d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:01.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.841+0000 7fc648991640 1 -- 172.21.15.60:0/2765187679 shutdown_connections 2024-09-12T01:39:01.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.841+0000 7fc648991640 1 -- 172.21.15.60:0/2765187679 wait complete. 2024-09-12T01:39:01.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:39:01.879 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:39:01.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.957+0000 7f0b52b0a640 1 Processor -- start 2024-09-12T01:39:01.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.957+0000 7f0b52b0a640 1 -- start start 2024-09-12T01:39:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.958+0000 7f0b52b0a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0b4c15e6f0 0x7f0b4c06fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.958+0000 7f0b52b0a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b4c0b54d0 0x7f0b4c15f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.958+0000 7f0b52b0a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4c06e990 con 0x7f0b4c0b6d40 2024-09-12T01:39:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.958+0000 7f0b52b0a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0b4c06ec70 con 0x7f0b4c15e6f0 2024-09-12T01:39:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.958+0000 7f0b52b0a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c15ec70 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.958+0000 7f0b510a7640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0b4c0b6d40 0x7f0b4c0b71f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41614/0 (socket says 172.21.15.60:41614) 2024-09-12T01:39:01.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.958+0000 7f0b510a7640 1 -- 172.21.15.60:0/1255440590 learned_addr learned my addr 172.21.15.60:0/1255440590 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.958+0000 7f0b508a6640 1 --2- 172.21.15.60:0/1255440590 >> v2:172.21.15.105:3300/0 conn(0x7f0b4c15e6f0 0x7f0b4c06fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.958+0000 7f0b4bfff640 1 --2- 172.21.15.60:0/1255440590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b4c0b54d0 0x7f0b4c15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.958+0000 7f0b4b7fe640 1 -- 172.21.15.60:0/1255440590 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067336303 0 0) 0x7f0b4c06e990 con 0x7f0b4c0b6d40 2024-09-12T01:39:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.958+0000 7f0b4b7fe640 1 -- 172.21.15.60:0/1255440590 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b3c003520 con 0x7f0b4c0b6d40 2024-09-12T01:39:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.959+0000 7f0b4bfff640 1 -- 172.21.15.60:0/1255440590 >> v2:172.21.15.105:3300/0 conn(0x7f0b4c15e6f0 msgr2=0x7f0b4c06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.959+0000 7f0b4bfff640 1 --2- 172.21.15.60:0/1255440590 >> v2:172.21.15.105:3300/0 conn(0x7f0b4c15e6f0 0x7f0b4c06fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.959+0000 7f0b4bfff640 1 -- 172.21.15.60:0/1255440590 >> v1:172.21.15.60:6789/0 conn(0x7f0b4c0b6d40 legacy=0x7f0b4c0b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.959+0000 7f0b4b7fe640 1 -- 172.21.15.60:0/1255440590 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2521496736 0 0) 0x7f0b3c003520 con 0x7f0b4c0b6d40 2024-09-12T01:39:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.959+0000 7f0b4bfff640 1 -- 172.21.15.60:0/1255440590 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c15ef50 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.959+0000 7f0b508a6640 1 --2- 172.21.15.60:0/1255440590 >> v2:172.21.15.105:3300/0 conn(0x7f0b4c15e6f0 0x7f0b4c06fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:39:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.959+0000 7f0b4bfff640 1 --2- 172.21.15.60:0/1255440590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b4c0b54d0 0x7f0b4c15f750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b380097a0 tx=0x7f0b3802a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7256cd54782b5574 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:01.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.959+0000 7f0b4b7fe640 1 -- 172.21.15.60:0/1255440590 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b38037070 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.960+0000 7f0b4b7fe640 1 -- 172.21.15.60:0/1255440590 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b3802aba0 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.960+0000 7f0b4b7fe640 1 -- 172.21.15.60:0/1255440590 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b440019f0 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.960+0000 7f0b52b0a640 1 -- 172.21.15.60:0/1255440590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b4c0b54d0 msgr2=0x7f0b4c15f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.960+0000 7f0b52b0a640 1 --2- 172.21.15.60:0/1255440590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b4c0b54d0 0x7f0b4c15f750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0b380097a0 tx=0x7f0b3802a110 comp rx=0 tx=0).stop 2024-09-12T01:39:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.960+0000 7f0b52b0a640 1 -- 172.21.15.60:0/1255440590 shutdown_connections 2024-09-12T01:39:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.960+0000 7f0b52b0a640 1 --2- 172.21.15.60:0/1255440590 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b4c0b54d0 0x7f0b4c15f750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.960+0000 7f0b52b0a640 1 --2- 172.21.15.60:0/1255440590 >> v2:172.21.15.105:3300/0 conn(0x7f0b4c15e6f0 0x7f0b4c06fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.960+0000 7f0b52b0a640 1 -- 172.21.15.60:0/1255440590 >> 172.21.15.60:0/1255440590 conn(0x7f0b4c0d2430 msgr2=0x7f0b4c0d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.960+0000 7f0b52b0a640 1 -- 172.21.15.60:0/1255440590 shutdown_connections 2024-09-12T01:39:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.960+0000 7f0b52b0a640 1 -- 172.21.15.60:0/1255440590 wait complete. 2024-09-12T01:39:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.961+0000 7f0b52b0a640 1 Processor -- start 2024-09-12T01:39:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.961+0000 7f0b52b0a640 1 -- start start 2024-09-12T01:39:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.962+0000 7f0b52b0a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b4c0b54d0 0x7f0b4c1596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.962+0000 7f0b52b0a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b4c0b6d40 0x7f0b4c154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.962+0000 7f0b52b0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b4c15e6f0 0x7f0b4c0b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.962+0000 7f0b52b0a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c06e730 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.962+0000 7f0b52b0a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c06e5b0 con 0x7f0b4c15e6f0 2024-09-12T01:39:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.962+0000 7f0b52b0a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c070830 con 0x7f0b4c0b6d40 2024-09-12T01:39:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.962+0000 7f0b508a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b4c0b54d0 0x7f0b4c1596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.962+0000 7f0b508a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b4c0b54d0 0x7f0b4c1596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48618/0 (socket says 172.21.15.60:48618) 2024-09-12T01:39:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.962+0000 7f0b508a6640 1 -- 172.21.15.60:0/2607980075 learned_addr learned my addr 172.21.15.60:0/2607980075 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b4bfff640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b4c0b6d40 0x7f0b4c154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b510a7640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b4c15e6f0 0x7f0b4c0b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b508a6640 1 -- 172.21.15.60:0/2607980075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b4c0b6d40 msgr2=0x7f0b4c154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b508a6640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b4c0b6d40 0x7f0b4c154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b508a6640 1 -- 172.21.15.60:0/2607980075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b4c15e6f0 msgr2=0x7f0b4c0b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:01.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b508a6640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b4c15e6f0 0x7f0b4c0b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:01.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b508a6640 1 -- 172.21.15.60:0/2607980075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c15aad0 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b508a6640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b4c0b54d0 0x7f0b4c1596c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000e990 tx=0x7f0b4000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:01.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b497fa640 1 -- 172.21.15.60:0/2607980075 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40017070 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b497fa640 1 -- 172.21.15.60:0/2607980075 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4000c9e0 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b52b0a640 1 -- 172.21.15.60:0/2607980075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4c158900 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b497fa640 1 -- 172.21.15.60:0/2607980075 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4000cdb0 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.963+0000 7f0b52b0a640 1 -- 172.21.15.60:0/2607980075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4c158ec0 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.964+0000 7f0b52b0a640 1 -- 172.21.15.60:0/2607980075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b4c15f750 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.965+0000 7f0b497fa640 1 -- 172.21.15.60:0/2607980075 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0b4001a070 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.965+0000 7f0b497fa640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0b3006be30 0x7f0b3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:01.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.965+0000 7f0b497fa640 1 -- 172.21.15.60:0/2607980075 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5795+0+0 (secure 0 0 0) 0x7f0b4008b060 con 0x7f0b4c0b54d0 2024-09-12T01:39:01.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.965+0000 7f0b4bfff640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0b3006be30 0x7f0b3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:01.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.966+0000 7f0b4bfff640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0b3006be30 0x7f0b3006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0b38034000 tx=0x7f0b3802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:01.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:01.970+0000 7f0b497fa640 1 -- 172.21.15.60:0/2607980075 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0b40059360 con 0x7f0b4c0b54d0 2024-09-12T01:39:02.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.182+0000 7f0b52b0a640 1 -- 172.21.15.60:0/2607980075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0b4c157110 con 0x7f0b4c0b54d0 2024-09-12T01:39:02.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.846+0000 7f0b497fa640 1 -- 172.21.15.60:0/2607980075 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) ==== 104+0+0 (secure 0 0 0) 0x7f0b4005d660 con 0x7f0b4c0b54d0 2024-09-12T01:39:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.849+0000 7f0b52b0a640 1 -- 172.21.15.60:0/2607980075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0b3006be30 msgr2=0x7f0b3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.849+0000 7f0b52b0a640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0b3006be30 0x7f0b3006e2f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0b38034000 tx=0x7f0b3802e000 comp rx=0 tx=0).stop 2024-09-12T01:39:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.849+0000 7f0b52b0a640 1 -- 172.21.15.60:0/2607980075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b4c0b54d0 msgr2=0x7f0b4c1596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.849+0000 7f0b52b0a640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b4c0b54d0 0x7f0b4c1596c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000e990 tx=0x7f0b4000ee50 comp rx=0 tx=0).stop 2024-09-12T01:39:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.849+0000 7f0b52b0a640 1 -- 172.21.15.60:0/2607980075 shutdown_connections 2024-09-12T01:39:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.849+0000 7f0b52b0a640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0b4c15e6f0 0x7f0b4c0b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.849+0000 7f0b52b0a640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0b3006be30 0x7f0b3006e2f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.849+0000 7f0b52b0a640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0b4c0b6d40 0x7f0b4c154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.849+0000 7f0b52b0a640 1 --2- 172.21.15.60:0/2607980075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0b4c0b54d0 0x7f0b4c1596c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.849+0000 7f0b52b0a640 1 -- 172.21.15.60:0/2607980075 >> 172.21.15.60:0/2607980075 conn(0x7f0b4c0d2430 msgr2=0x7f0b4c0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.849+0000 7f0b52b0a640 1 -- 172.21.15.60:0/2607980075 shutdown_connections 2024-09-12T01:39:02.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.850+0000 7f0b52b0a640 1 -- 172.21.15.60:0/2607980075 wait complete. 2024-09-12T01:39:02.862 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:39:02.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.975+0000 7f6d19477640 1 Processor -- start 2024-09-12T01:39:02.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.976+0000 7f6d19477640 1 -- start start 2024-09-12T01:39:02.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.976+0000 7f6d19477640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d140714a0 0x7f6d140b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:02.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.976+0000 7f6d19477640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d1415f020 con 0x7f6d1406fb10 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.976+0000 7f6d19477640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d1415f300 con 0x7f6d1415e570 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.976+0000 7f6d19477640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1415fc30 con 0x7f6d140714a0 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d127fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6d1406fb10 0x7f6d1406cf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34890/0 (socket says 172.21.15.60:34890) 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d127fc640 1 -- 172.21.15.60:0/2586208040 learned_addr learned my addr 172.21.15.60:0/2586208040 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d137fe640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d140714a0 0x7f6d140b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3642774565 0 0) 0x7f6d1415f020 con 0x7f6d1406fb10 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d00003520 con 0x7f6d1406fb10 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215844690 0 0) 0x7f6d1415f300 con 0x7f6d1415e570 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d1415f020 con 0x7f6d1415e570 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1931719161 0 0) 0x7f6d00003520 con 0x7f6d1406fb10 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d140714a0 msgr2=0x7f6d140b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d140714a0 0x7f6d140b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 >> v1:172.21.15.105:6789/0 conn(0x7f6d1415e570 legacy=0x7f6d1406f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1415f5e0 con 0x7f6d1406fb10 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f6cfc001670 con 0x7f6d1406fb10 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d137fe640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d140714a0 0x7f6d140b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 >> v1:172.21.15.60:6789/0 conn(0x7f6d1406fb10 legacy=0x7f6d1406cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d00003b70 0x7f6d00003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d00004800 0x7f6d00004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d140714a0 0x7f6d000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1415fc30 con 0x7f6d00003b70 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0000b9f0 con 0x7f6d00004800 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0000bbf0 con 0x7f6d140714a0 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d12ffd640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d00003b70 0x7f6d00003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d127fc640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d00004800 0x7f6d00004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:02.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.977+0000 7f6d137fe640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d140714a0 0x7f6d000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:02.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.978+0000 7f6d12ffd640 1 -- 172.21.15.60:0/2586208040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d140714a0 msgr2=0x7f6d000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:02.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.978+0000 7f6d12ffd640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d140714a0 0x7f6d000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.978+0000 7f6d12ffd640 1 -- 172.21.15.60:0/2586208040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d00004800 msgr2=0x7f6d00004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:02.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.978+0000 7f6d12ffd640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d00004800 0x7f6d00004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.978+0000 7f6d12ffd640 1 -- 172.21.15.60:0/2586208040 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d00003520 con 0x7f6d00003b70 2024-09-12T01:39:02.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.978+0000 7f6d12ffd640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d00003b70 0x7f6d00003f70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6d04001fa0 tx=0x7f6d00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b012e3fc90df5a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:02.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.978+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04001bf0 con 0x7f6d00003b70 2024-09-12T01:39:02.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.979+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d04003b70 con 0x7f6d00003b70 2024-09-12T01:39:02.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.979+0000 7f6d11ffb640 1 -- 172.21.15.60:0/2586208040 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d040050d0 con 0x7f6d00003b70 2024-09-12T01:39:02.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.979+0000 7f6d19477640 1 -- 172.21.15.60:0/2586208040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d00003b70 msgr2=0x7f6d00003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.979+0000 7f6d19477640 1 --2- 172.21.15.60:0/2586208040 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d00003b70 0x7f6d00003f70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f6d04001fa0 tx=0x7f6d00005830 comp rx=0 tx=0).stop 2024-09-12T01:39:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.979+0000 7f6d137fe640 1 -- 172.21.15.60:0/2586208040 reap_dead start 2024-09-12T01:39:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.979+0000 7f6d19477640 1 -- 172.21.15.60:0/2586208040 shutdown_connections 2024-09-12T01:39:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.979+0000 7f6d19477640 1 -- 172.21.15.60:0/2586208040 >> 172.21.15.60:0/2586208040 conn(0x7f6d140b4240 msgr2=0x7f6d140b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.979+0000 7f6d19477640 1 -- 172.21.15.60:0/2586208040 shutdown_connections 2024-09-12T01:39:02.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.979+0000 7f6d19477640 1 -- 172.21.15.60:0/2586208040 wait complete. 2024-09-12T01:39:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.980+0000 7f6d19477640 1 Processor -- start 2024-09-12T01:39:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.981+0000 7f6d19477640 1 -- start start 2024-09-12T01:39:02.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.981+0000 7f6d19477640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d00003b70 0x7f6d14156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:02.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.981+0000 7f6d19477640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d14155ae0 0x7f6d14155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:02.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.981+0000 7f6d19477640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1415c620 0x7f6d1415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:02.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.981+0000 7f6d19477640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6d140b56c0 con 0x7f6d00003b70 2024-09-12T01:39:02.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.981+0000 7f6d19477640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6d140b5540 con 0x7f6d14155ae0 2024-09-12T01:39:02.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.981+0000 7f6d19477640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6d140b5840 con 0x7f6d1415c620 2024-09-12T01:39:02.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.981+0000 7f6d12ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d00003b70 0x7f6d14156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:02.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.981+0000 7f6d12ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d00003b70 0x7f6d14156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46954/0 (socket says 172.21.15.60:46954) 2024-09-12T01:39:02.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.981+0000 7f6d12ffd640 1 -- 172.21.15.60:0/1608703345 learned_addr learned my addr 172.21.15.60:0/1608703345 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d127fc640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d14155ae0 0x7f6d14155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d137fe640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1415c620 0x7f6d1415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d12ffd640 1 -- 172.21.15.60:0/1608703345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1415c620 msgr2=0x7f6d1415cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d12ffd640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1415c620 0x7f6d1415cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d12ffd640 1 -- 172.21.15.60:0/1608703345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d14155ae0 msgr2=0x7f6d14155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d12ffd640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d14155ae0 0x7f6d14155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d12ffd640 1 -- 172.21.15.60:0/1608703345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d140d20f0 con 0x7f6d00003b70 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d12ffd640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d00003b70 0x7f6d14156480 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6d04005040 tx=0x7f6d04001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d0b7fe640 1 -- 172.21.15.60:0/1608703345 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04040070 con 0x7f6d00003b70 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d0b7fe640 1 -- 172.21.15.60:0/1608703345 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d04003970 con 0x7f6d00003b70 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d19477640 1 -- 172.21.15.60:0/1608703345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d14156af0 con 0x7f6d00003b70 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d0b7fe640 1 -- 172.21.15.60:0/1608703345 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04001bf0 con 0x7f6d00003b70 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.982+0000 7f6d19477640 1 -- 172.21.15.60:0/1608703345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d140cbad0 con 0x7f6d00003b70 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.983+0000 7f6d19477640 1 -- 172.21.15.60:0/1608703345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d14157010 con 0x7f6d00003b70 2024-09-12T01:39:02.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.984+0000 7f6d0b7fe640 1 -- 172.21.15.60:0/1608703345 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6d04043070 con 0x7f6d00003b70 2024-09-12T01:39:02.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.984+0000 7f6d0b7fe640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6cf406be30 0x7f6cf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:02.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.984+0000 7f6d0b7fe640 1 -- 172.21.15.60:0/1608703345 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5795+0+0 (secure 0 0 0) 0x7f6d040ab900 con 0x7f6d00003b70 2024-09-12T01:39:02.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.984+0000 7f6d127fc640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6cf406be30 0x7f6cf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:02.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.985+0000 7f6d127fc640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6cf406be30 0x7f6cf406e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc000fb0 tx=0x7f6cfc001e20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:02.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:02.989+0000 7f6d0b7fe640 1 -- 172.21.15.60:0/1608703345 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d04003b40 con 0x7f6d00003b70 2024-09-12T01:39:03.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.165+0000 7f6d19477640 1 -- 172.21.15.60:0/1608703345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6d140cb8c0 con 0x7f6d00003b70 2024-09-12T01:39:03.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.848+0000 7f6d0b7fe640 1 -- 172.21.15.60:0/1608703345 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v70) ==== 181+0+0 (secure 0 0 0) 0x7f6d04079db0 con 0x7f6d00003b70 2024-09-12T01:39:03.848 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:39:03.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.852+0000 7f6d19477640 1 -- 172.21.15.60:0/1608703345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6cf406be30 msgr2=0x7f6cf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:03.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.852+0000 7f6d19477640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6cf406be30 0x7f6cf406e2f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc000fb0 tx=0x7f6cfc001e20 comp rx=0 tx=0).stop 2024-09-12T01:39:03.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.852+0000 7f6d19477640 1 -- 172.21.15.60:0/1608703345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d00003b70 msgr2=0x7f6d14156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:03.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.852+0000 7f6d19477640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d00003b70 0x7f6d14156480 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f6d04005040 tx=0x7f6d04001650 comp rx=0 tx=0).stop 2024-09-12T01:39:03.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.853+0000 7f6d19477640 1 -- 172.21.15.60:0/1608703345 shutdown_connections 2024-09-12T01:39:03.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.853+0000 7f6d19477640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6cf406be30 0x7f6cf406e2f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:03.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.853+0000 7f6d19477640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d1415c620 0x7f6d1415cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:03.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.853+0000 7f6d19477640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d14155ae0 0x7f6d14155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:03.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.853+0000 7f6d19477640 1 --2- 172.21.15.60:0/1608703345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d00003b70 0x7f6d14156480 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:03.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.853+0000 7f6d19477640 1 -- 172.21.15.60:0/1608703345 >> 172.21.15.60:0/1608703345 conn(0x7f6d140b4240 msgr2=0x7f6d1415fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:03.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.853+0000 7f6d19477640 1 -- 172.21.15.60:0/1608703345 shutdown_connections 2024-09-12T01:39:03.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.853+0000 7f6d19477640 1 -- 172.21.15.60:0/1608703345 wait complete. 2024-09-12T01:39:03.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:39:03.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.982+0000 7f6c1c911640 1 Processor -- start 2024-09-12T01:39:03.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.982+0000 7f6c1c911640 1 -- start start 2024-09-12T01:39:03.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.983+0000 7f6c1c911640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c1815e990 0x7f6c180b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:03.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.983+0000 7f6c1c911640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c18162450 0x7f6c18162890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:03.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.983+0000 7f6c1c911640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1815ed70 con 0x7f6c18162dd0 2024-09-12T01:39:03.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.983+0000 7f6c1c911640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6c180cff20 con 0x7f6c1815e990 2024-09-12T01:39:03.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.983+0000 7f6c1c911640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6c18163280 con 0x7f6c18162450 2024-09-12T01:39:03.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.983+0000 7f6c1659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c1815e990 0x7f6c180b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.983+0000 7f6c1659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c1815e990 0x7f6c180b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46958/0 (socket says 172.21.15.60:46958) 2024-09-12T01:39:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.983+0000 7f6c16d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6c18162dd0 0x7f6c180b6200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34900/0 (socket says 172.21.15.60:34900) 2024-09-12T01:39:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.983+0000 7f6c1659c640 1 -- 172.21.15.60:0/2952631236 learned_addr learned my addr 172.21.15.60:0/2952631236 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.984+0000 7f6c15d9b640 1 --2- 172.21.15.60:0/2952631236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c18162450 0x7f6c18162890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.984+0000 7f6c1659c640 1 -- 172.21.15.60:0/2952631236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c18162450 msgr2=0x7f6c18162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.984+0000 7f6c1659c640 1 --2- 172.21.15.60:0/2952631236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c18162450 0x7f6c18162890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.984+0000 7f6c1659c640 1 -- 172.21.15.60:0/2952631236 >> v1:172.21.15.60:6789/0 conn(0x7f6c18162dd0 legacy=0x7f6c180b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.984+0000 7f6c1659c640 1 -- 172.21.15.60:0/2952631236 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180d1fa0 con 0x7f6c1815e990 2024-09-12T01:39:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.984+0000 7f6c1559a640 1 -- 172.21.15.60:0/2952631236 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4064583434 0 0) 0x7f6c08001490 con 0x7f6c18162dd0 2024-09-12T01:39:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.984+0000 7f6c15d9b640 1 --2- 172.21.15.60:0/2952631236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c18162450 0x7f6c18162890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:03.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.984+0000 7f6c1659c640 1 --2- 172.21.15.60:0/2952631236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c1815e990 0x7f6c180b3920 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009870 tx=0x7f6c1002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72615d73e2f91d1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:03.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.985+0000 7f6c1559a640 1 -- 172.21.15.60:0/2952631236 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10037070 con 0x7f6c1815e990 2024-09-12T01:39:03.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.985+0000 7f6c1559a640 1 -- 172.21.15.60:0/2952631236 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c10032440 con 0x7f6c1815e990 2024-09-12T01:39:03.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.985+0000 7f6c1559a640 1 -- 172.21.15.60:0/2952631236 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c10032810 con 0x7f6c1815e990 2024-09-12T01:39:03.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.985+0000 7f6c1c911640 1 -- 172.21.15.60:0/2952631236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c1815e990 msgr2=0x7f6c180b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:03.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.985+0000 7f6c1c911640 1 --2- 172.21.15.60:0/2952631236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c1815e990 0x7f6c180b3920 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6c10009870 tx=0x7f6c1002a1c0 comp rx=0 tx=0).stop 2024-09-12T01:39:03.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.985+0000 7f6c1c911640 1 -- 172.21.15.60:0/2952631236 shutdown_connections 2024-09-12T01:39:03.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.985+0000 7f6c1c911640 1 --2- 172.21.15.60:0/2952631236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c18162450 0x7f6c18162890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:03.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.985+0000 7f6c1c911640 1 --2- 172.21.15.60:0/2952631236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c1815e990 0x7f6c180b3920 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:03.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.985+0000 7f6c1c911640 1 -- 172.21.15.60:0/2952631236 >> 172.21.15.60:0/2952631236 conn(0x7f6c180d1200 msgr2=0x7f6c180d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:03.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.985+0000 7f6c1c911640 1 -- 172.21.15.60:0/2952631236 shutdown_connections 2024-09-12T01:39:03.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.985+0000 7f6c1c911640 1 -- 172.21.15.60:0/2952631236 wait complete. 2024-09-12T01:39:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.987+0000 7f6c1c911640 1 Processor -- start 2024-09-12T01:39:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.987+0000 7f6c1c911640 1 -- start start 2024-09-12T01:39:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.987+0000 7f6c1c911640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c1815e990 0x7f6c180ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.987+0000 7f6c1c911640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c18162450 0x7f6c18157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:03.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.987+0000 7f6c1c911640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c18162dd0 0x7f6c180c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.987+0000 7f6c1c911640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180d39b0 con 0x7f6c18162450 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.987+0000 7f6c1c911640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6c180cfc40 con 0x7f6c18162dd0 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.987+0000 7f6c1c911640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6c180d3b30 con 0x7f6c1815e990 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c15d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c18162450 0x7f6c18157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c15d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c18162450 0x7f6c18157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46968/0 (socket says 172.21.15.60:46968) 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c15d9b640 1 -- 172.21.15.60:0/812775118 learned_addr learned my addr 172.21.15.60:0/812775118 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c1659c640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c1815e990 0x7f6c180ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c16d9d640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c18162dd0 0x7f6c180c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c15d9b640 1 -- 172.21.15.60:0/812775118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c1815e990 msgr2=0x7f6c180ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c15d9b640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c1815e990 0x7f6c180ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c15d9b640 1 -- 172.21.15.60:0/812775118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c18162dd0 msgr2=0x7f6c180c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c15d9b640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c18162dd0 0x7f6c180c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:03.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c15d9b640 1 -- 172.21.15.60:0/812775118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c180caec0 con 0x7f6c18162450 2024-09-12T01:39:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c16d9d640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c18162dd0 0x7f6c180c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c15d9b640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c18162450 0x7f6c18157ee0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000c7f0 tx=0x7f6c0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c0effd640 1 -- 172.21.15.60:0/812775118 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00015070 con 0x7f6c18162450 2024-09-12T01:39:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c0effd640 1 -- 172.21.15.60:0/812775118 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c00007820 con 0x7f6c18162450 2024-09-12T01:39:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c1c911640 1 -- 172.21.15.60:0/812775118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c180cb1a0 con 0x7f6c18162450 2024-09-12T01:39:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c0effd640 1 -- 172.21.15.60:0/812775118 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c00007c10 con 0x7f6c18162450 2024-09-12T01:39:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.988+0000 7f6c1c911640 1 -- 172.21.15.60:0/812775118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c180b5210 con 0x7f6c18162450 2024-09-12T01:39:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.989+0000 7f6c1c911640 1 -- 172.21.15.60:0/812775118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c180b3920 con 0x7f6c18162450 2024-09-12T01:39:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.990+0000 7f6c0effd640 1 -- 172.21.15.60:0/812775118 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c00018070 con 0x7f6c18162450 2024-09-12T01:39:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.990+0000 7f6c0effd640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bf806be30 0x7f6bf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.990+0000 7f6c0effd640 1 -- 172.21.15.60:0/812775118 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5357+0+0 (secure 0 0 0) 0x7f6c0008ad60 con 0x7f6c18162450 2024-09-12T01:39:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.990+0000 7f6c1659c640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bf806be30 0x7f6bf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.991+0000 7f6c1659c640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bf806be30 0x7f6bf806e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6c10034000 tx=0x7f6c1002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:03.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:03.994+0000 7f6c0effd640 1 -- 172.21.15.60:0/812775118 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c00059220 con 0x7f6c18162450 2024-09-12T01:39:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.171+0000 7f6c1c911640 1 -- 172.21.15.60:0/812775118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6c180ba700 con 0x7f6c18162450 2024-09-12T01:39:04.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.854+0000 7f6c0effd640 1 -- 172.21.15.60:0/812775118 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v71) ==== 169+0+0 (secure 0 0 0) 0x7f6c0005d520 con 0x7f6c18162450 2024-09-12T01:39:04.853 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-12T01:39:04.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.860+0000 7f6c1c911640 1 -- 172.21.15.60:0/812775118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bf806be30 msgr2=0x7f6bf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:04.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.860+0000 7f6c1c911640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bf806be30 0x7f6bf806e2f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6c10034000 tx=0x7f6c1002e000 comp rx=0 tx=0).stop 2024-09-12T01:39:04.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.860+0000 7f6c1c911640 1 -- 172.21.15.60:0/812775118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c18162450 msgr2=0x7f6c18157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:04.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.860+0000 7f6c1c911640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c18162450 0x7f6c18157ee0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000c7f0 tx=0x7f6c0000ccb0 comp rx=0 tx=0).stop 2024-09-12T01:39:04.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.861+0000 7f6c1c911640 1 -- 172.21.15.60:0/812775118 shutdown_connections 2024-09-12T01:39:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.861+0000 7f6c1c911640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c18162dd0 0x7f6c180c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.861+0000 7f6c1c911640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c18162450 0x7f6c18157ee0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.861+0000 7f6c1c911640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bf806be30 0x7f6bf806e2f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.861+0000 7f6c1c911640 1 --2- 172.21.15.60:0/812775118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c1815e990 0x7f6c180ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:04.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.861+0000 7f6c1c911640 1 -- 172.21.15.60:0/812775118 >> 172.21.15.60:0/812775118 conn(0x7f6c180d1200 msgr2=0x7f6c1815ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.862+0000 7f6c1c911640 1 -- 172.21.15.60:0/812775118 shutdown_connections 2024-09-12T01:39:04.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.862+0000 7f6c1c911640 1 -- 172.21.15.60:0/812775118 wait complete. 2024-09-12T01:39:04.879 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_max_caps_per_client 2024-09-12T01:39:04.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.989+0000 7f21dd7b7640 1 Processor -- start 2024-09-12T01:39:04.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.989+0000 7f21dd7b7640 1 -- start start 2024-09-12T01:39:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.990+0000 7f21dd7b7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21d80cf1f0 0x7f21d80b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.990+0000 7f21dd7b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21d80b6720 0x7f21d80d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.990+0000 7f21dd7b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21d80cf860 con 0x7f21d815e7a0 2024-09-12T01:39:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.990+0000 7f21dd7b7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f21d80b6b90 con 0x7f21d80cf1f0 2024-09-12T01:39:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.990+0000 7f21dd7b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f21d80d2ca0 con 0x7f21d80b6720 2024-09-12T01:39:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.990+0000 7f21d6ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f21d815e7a0 0x7f21d806caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34908/0 (socket says 172.21.15.60:34908) 2024-09-12T01:39:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.990+0000 7f21d6ffd640 1 -- 172.21.15.60:0/3208659207 learned_addr learned my addr 172.21.15.60:0/3208659207 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.990+0000 7f21d67fc640 1 --2- 172.21.15.60:0/3208659207 >> v2:172.21.15.60:3300/0 conn(0x7f21d80cf1f0 0x7f21d80b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.990+0000 7f21d77fe640 1 --2- 172.21.15.60:0/3208659207 >> v2:172.21.15.105:3300/0 conn(0x7f21d80b6720 0x7f21d80d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.990+0000 7f21d5ffb640 1 -- 172.21.15.60:0/3208659207 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217171080 0 0) 0x7f21d80cf860 con 0x7f21d815e7a0 2024-09-12T01:39:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.991+0000 7f21d5ffb640 1 -- 172.21.15.60:0/3208659207 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21c4003520 con 0x7f21d815e7a0 2024-09-12T01:39:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.991+0000 7f21d67fc640 1 -- 172.21.15.60:0/3208659207 >> v2:172.21.15.105:3300/0 conn(0x7f21d80b6720 msgr2=0x7f21d80d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.991+0000 7f21d67fc640 1 --2- 172.21.15.60:0/3208659207 >> v2:172.21.15.105:3300/0 conn(0x7f21d80b6720 0x7f21d80d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.991+0000 7f21d67fc640 1 -- 172.21.15.60:0/3208659207 >> v1:172.21.15.60:6789/0 conn(0x7f21d815e7a0 legacy=0x7f21d806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.991+0000 7f21d67fc640 1 -- 172.21.15.60:0/3208659207 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d80cfb40 con 0x7f21d80cf1f0 2024-09-12T01:39:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.991+0000 7f21d67fc640 1 --2- 172.21.15.60:0/3208659207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d80cf1f0 0x7f21d80b61e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f21d808d930 tx=0x7f21c002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18045075a66bfe66 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.991+0000 7f21d5ffb640 1 -- 172.21.15.60:0/3208659207 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c0037070 con 0x7f21d80cf1f0 2024-09-12T01:39:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.991+0000 7f21d5ffb640 1 -- 172.21.15.60:0/3208659207 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21c0032440 con 0x7f21d80cf1f0 2024-09-12T01:39:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.992+0000 7f21d5ffb640 1 -- 172.21.15.60:0/3208659207 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c002ae60 con 0x7f21d80cf1f0 2024-09-12T01:39:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.992+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3208659207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d80cf1f0 msgr2=0x7f21d80b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.992+0000 7f21dd7b7640 1 --2- 172.21.15.60:0/3208659207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d80cf1f0 0x7f21d80b61e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f21d808d930 tx=0x7f21c002a110 comp rx=0 tx=0).stop 2024-09-12T01:39:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.992+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3208659207 shutdown_connections 2024-09-12T01:39:04.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.992+0000 7f21dd7b7640 1 --2- 172.21.15.60:0/3208659207 >> v2:172.21.15.105:3300/0 conn(0x7f21d80b6720 0x7f21d80d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:04.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.992+0000 7f21dd7b7640 1 --2- 172.21.15.60:0/3208659207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d80cf1f0 0x7f21d80b61e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:04.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.992+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3208659207 >> 172.21.15.60:0/3208659207 conn(0x7f21d80d11e0 msgr2=0x7f21d80d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:04.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.992+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3208659207 shutdown_connections 2024-09-12T01:39:04.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.992+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3208659207 wait complete. 2024-09-12T01:39:04.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.993+0000 7f21dd7b7640 1 Processor -- start 2024-09-12T01:39:04.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.993+0000 7f21dd7b7640 1 -- start start 2024-09-12T01:39:04.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.994+0000 7f21dd7b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d80b6720 0x7f21d8155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.994+0000 7f21dd7b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21d80cf1f0 0x7f21d81564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.994+0000 7f21dd7b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d815e7a0 0x7f21d80c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.994+0000 7f21dd7b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f21d80b7a00 con 0x7f21d815e7a0 2024-09-12T01:39:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.994+0000 7f21dd7b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21d80d2ef0 con 0x7f21d80cf1f0 2024-09-12T01:39:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.994+0000 7f21dd7b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21d815eb80 con 0x7f21d80b6720 2024-09-12T01:39:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.994+0000 7f21d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d815e7a0 0x7f21d80c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.994+0000 7f21d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d815e7a0 0x7f21d80c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46986/0 (socket says 172.21.15.60:46986) 2024-09-12T01:39:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.994+0000 7f21d77fe640 1 -- 172.21.15.60:0/3977206185 learned_addr learned my addr 172.21.15.60:0/3977206185 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.994+0000 7f21d6ffd640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d80b6720 0x7f21d8155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21d67fc640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21d80cf1f0 0x7f21d81564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21d77fe640 1 -- 172.21.15.60:0/3977206185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d80b6720 msgr2=0x7f21d8155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:04.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21d77fe640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d80b6720 0x7f21d8155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:04.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21d77fe640 1 -- 172.21.15.60:0/3977206185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21d80cf1f0 msgr2=0x7f21d81564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:04.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21d77fe640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21d80cf1f0 0x7f21d81564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:04.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21d77fe640 1 -- 172.21.15.60:0/3977206185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d80c9330 con 0x7f21d815e7a0 2024-09-12T01:39:04.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21d67fc640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21d80cf1f0 0x7f21d81564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:04.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21d77fe640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d815e7a0 0x7f21d80c96f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f21d000d5d0 tx=0x7f21d000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:04.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21cf7fe640 1 -- 172.21.15.60:0/3977206185 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d00125f0 con 0x7f21d815e7a0 2024-09-12T01:39:04.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21cf7fe640 1 -- 172.21.15.60:0/3977206185 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d0019070 con 0x7f21d815e7a0 2024-09-12T01:39:04.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3977206185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d80c8290 con 0x7f21d815e7a0 2024-09-12T01:39:04.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21cf7fe640 1 -- 172.21.15.60:0/3977206185 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d00129f0 con 0x7f21d815e7a0 2024-09-12T01:39:04.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.995+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3977206185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d80c8850 con 0x7f21d815e7a0 2024-09-12T01:39:04.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.996+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3977206185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d80b61e0 con 0x7f21d815e7a0 2024-09-12T01:39:04.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.997+0000 7f21cf7fe640 1 -- 172.21.15.60:0/3977206185 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21d0012b90 con 0x7f21d815e7a0 2024-09-12T01:39:04.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.997+0000 7f21cf7fe640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21b806be30 0x7f21b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:04.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.997+0000 7f21cf7fe640 1 -- 172.21.15.60:0/3977206185 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4943+0+0 (secure 0 0 0) 0x7f21d008aed0 con 0x7f21d815e7a0 2024-09-12T01:39:04.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.997+0000 7f21d6ffd640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21b806be30 0x7f21b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:04.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:04.997+0000 7f21d6ffd640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21b806be30 0x7f21b806e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f21c80012e0 tx=0x7f21c8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:05.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.001+0000 7f21cf7fe640 1 -- 172.21.15.60:0/3977206185 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21d0059b90 con 0x7f21d815e7a0 2024-09-12T01:39:05.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.178+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3977206185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"} v 0) -- 0x7f21d80d2a80 con 0x7f21d815e7a0 2024-09-12T01:39:05.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.181+0000 7f21cf7fe640 1 -- 172.21.15.60:0/3977206185 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_max_caps_per_client"}]=0 v22) ==== 106+0+0 (secure 0 0 0) 0x7f21d0059490 con 0x7f21d815e7a0 2024-09-12T01:39:05.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.184+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3977206185 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21b806be30 msgr2=0x7f21b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:05.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.184+0000 7f21dd7b7640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21b806be30 0x7f21b806e2f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f21c80012e0 tx=0x7f21c8009040 comp rx=0 tx=0).stop 2024-09-12T01:39:05.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.184+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3977206185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d815e7a0 msgr2=0x7f21d80c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:05.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.184+0000 7f21dd7b7640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d815e7a0 0x7f21d80c96f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f21d000d5d0 tx=0x7f21d000da90 comp rx=0 tx=0).stop 2024-09-12T01:39:05.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.184+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3977206185 shutdown_connections 2024-09-12T01:39:05.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.184+0000 7f21dd7b7640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21d815e7a0 0x7f21d80c96f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.184+0000 7f21dd7b7640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21d80cf1f0 0x7f21d81564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.184+0000 7f21dd7b7640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21b806be30 0x7f21b806e2f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.184+0000 7f21dd7b7640 1 --2- 172.21.15.60:0/3977206185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21d80b6720 0x7f21d8155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.184+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3977206185 >> 172.21.15.60:0/3977206185 conn(0x7f21d80d11e0 msgr2=0x7f21d815cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:05.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.184+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3977206185 shutdown_connections 2024-09-12T01:39:05.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.184+0000 7f21dd7b7640 1 -- 172.21.15.60:0/3977206185 wait complete. 2024-09-12T01:39:05.194 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T01:39:05.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.298+0000 7f23abbb9640 1 Processor -- start 2024-09-12T01:39:05.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.299+0000 7f23abbb9640 1 -- start start 2024-09-12T01:39:05.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.299+0000 7f23abbb9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a406bc10 0x7f23a406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.299+0000 7f23abbb9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a415c4d0 con 0x7f23a406f630 2024-09-12T01:39:05.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.299+0000 7f23abbb9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a40740e0 con 0x7f23a415c0f0 2024-09-12T01:39:05.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.299+0000 7f23abbb9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f23a406c5b0 con 0x7f23a406bc10 2024-09-12T01:39:05.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23aa156640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f23a406f630 0x7f23a406fac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34922/0 (socket says 172.21.15.60:34922) 2024-09-12T01:39:05.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23aa156640 1 -- 172.21.15.60:0/280491130 learned_addr learned my addr 172.21.15.60:0/280491130 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:05.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a9154640 1 --2- 172.21.15.60:0/280491130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a406bc10 0x7f23a406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456653354 0 0) 0x7f23a415c4d0 con 0x7f23a406f630 2024-09-12T01:39:05.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2390003520 con 0x7f23a406f630 2024-09-12T01:39:05.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 572673408 0 0) 0x7f2390003520 con 0x7f23a406f630 2024-09-12T01:39:05.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a406bc10 msgr2=0x7f23a406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:05.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 --2- 172.21.15.60:0/280491130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a406bc10 0x7f23a406c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 >> v1:172.21.15.105:6789/0 conn(0x7f23a415c0f0 legacy=0x7f23a40739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:05.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a415ee60 con 0x7f23a406f630 2024-09-12T01:39:05.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f239c001670 con 0x7f23a406f630 2024-09-12T01:39:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 >> v1:172.21.15.60:6789/0 conn(0x7f23a406f630 legacy=0x7f23a406fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 --2- 172.21.15.60:0/280491130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a406bc10 0x7f23900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 --2- 172.21.15.60:0/280491130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390003f20 0x7f2390004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 --2- 172.21.15.60:0/280491130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2390004d40 0x7f23900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f239000baa0 con 0x7f2390003f20 2024-09-12T01:39:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f239000bc50 con 0x7f2390004d40 2024-09-12T01:39:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f239000be50 con 0x7f23a406bc10 2024-09-12T01:39:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a9154640 1 --2- 172.21.15.60:0/280491130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390003f20 0x7f2390004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23a9955640 1 --2- 172.21.15.60:0/280491130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a406bc10 0x7f23900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.300+0000 7f23aa156640 1 --2- 172.21.15.60:0/280491130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2390004d40 0x7f23900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.301+0000 7f23a9154640 1 -- 172.21.15.60:0/280491130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a406bc10 msgr2=0x7f23900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.301+0000 7f23a9154640 1 --2- 172.21.15.60:0/280491130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a406bc10 0x7f23900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.301+0000 7f23a9154640 1 -- 172.21.15.60:0/280491130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2390004d40 msgr2=0x7f23900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.301+0000 7f23a9154640 1 --2- 172.21.15.60:0/280491130 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2390004d40 0x7f23900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.301+0000 7f23a9154640 1 -- 172.21.15.60:0/280491130 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2390003520 con 0x7f2390003f20 2024-09-12T01:39:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.301+0000 7f23a9154640 1 --2- 172.21.15.60:0/280491130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390003f20 0x7f2390004800 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2394009ac0 tx=0x7f2390005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c48b5b522336c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.301+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394036070 con 0x7f2390003f20 2024-09-12T01:39:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.301+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2394031400 con 0x7f2390003f20 2024-09-12T01:39:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.301+0000 7f23a8953640 1 -- 172.21.15.60:0/280491130 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2394009690 con 0x7f2390003f20 2024-09-12T01:39:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.302+0000 7f23abbb9640 1 -- 172.21.15.60:0/280491130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390003f20 msgr2=0x7f2390004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.302+0000 7f23abbb9640 1 --2- 172.21.15.60:0/280491130 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390003f20 0x7f2390004800 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f2394009ac0 tx=0x7f2390005830 comp rx=0 tx=0).stop 2024-09-12T01:39:05.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.302+0000 7f23aa156640 1 -- 172.21.15.60:0/280491130 reap_dead start 2024-09-12T01:39:05.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.302+0000 7f23abbb9640 1 -- 172.21.15.60:0/280491130 shutdown_connections 2024-09-12T01:39:05.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.302+0000 7f23abbb9640 1 -- 172.21.15.60:0/280491130 >> 172.21.15.60:0/280491130 conn(0x7f23a40d1390 msgr2=0x7f23a40d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:05.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.302+0000 7f23abbb9640 1 -- 172.21.15.60:0/280491130 shutdown_connections 2024-09-12T01:39:05.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.302+0000 7f23abbb9640 1 -- 172.21.15.60:0/280491130 wait complete. 2024-09-12T01:39:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.303+0000 7f23abbb9640 1 Processor -- start 2024-09-12T01:39:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.303+0000 7f23abbb9640 1 -- start start 2024-09-12T01:39:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23abbb9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390003f20 0x7f23a41f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23abbb9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a4157600 0x7f23a41558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23abbb9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23a406e600 0x7f23a4156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23abbb9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f23a415eb50 con 0x7f2390003f20 2024-09-12T01:39:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23abbb9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f23a415f420 con 0x7f23a406e600 2024-09-12T01:39:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23abbb9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f23a4071ef0 con 0x7f23a4157600 2024-09-12T01:39:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23a9955640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390003f20 0x7f23a41f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23a9955640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390003f20 0x7f23a41f3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46996/0 (socket says 172.21.15.60:46996) 2024-09-12T01:39:05.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23a9955640 1 -- 172.21.15.60:0/2850128399 learned_addr learned my addr 172.21.15.60:0/2850128399 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:05.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23a9154640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a4157600 0x7f23a41558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23aa156640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23a406e600 0x7f23a4156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23a9955640 1 -- 172.21.15.60:0/2850128399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a4157600 msgr2=0x7f23a41558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:05.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23a9955640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a4157600 0x7f23a41558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23a9955640 1 -- 172.21.15.60:0/2850128399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23a406e600 msgr2=0x7f23a4156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:05.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23a9955640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23a406e600 0x7f23a4156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.304+0000 7f23a9955640 1 -- 172.21.15.60:0/2850128399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a41f4460 con 0x7f2390003f20 2024-09-12T01:39:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.305+0000 7f23a9955640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390003f20 0x7f23a41f3e80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f23a000fb90 tx=0x7f23a000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.305+0000 7f239a7fc640 1 -- 172.21.15.60:0/2850128399 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a000dc30 con 0x7f2390003f20 2024-09-12T01:39:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.305+0000 7f239a7fc640 1 -- 172.21.15.60:0/2850128399 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a0018070 con 0x7f2390003f20 2024-09-12T01:39:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.305+0000 7f23abbb9640 1 -- 172.21.15.60:0/2850128399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a41f4740 con 0x7f2390003f20 2024-09-12T01:39:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.305+0000 7f239a7fc640 1 -- 172.21.15.60:0/2850128399 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0003970 con 0x7f2390003f20 2024-09-12T01:39:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.305+0000 7f23abbb9640 1 -- 172.21.15.60:0/2850128399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a41f4d00 con 0x7f2390003f20 2024-09-12T01:39:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.306+0000 7f23abbb9640 1 -- 172.21.15.60:0/2850128399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a4072f20 con 0x7f2390003f20 2024-09-12T01:39:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.306+0000 7f239a7fc640 1 -- 172.21.15.60:0/2850128399 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23a0003b30 con 0x7f2390003f20 2024-09-12T01:39:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.307+0000 7f239a7fc640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f238806be30 0x7f238806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.307+0000 7f23a9154640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f238806be30 0x7f238806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.307+0000 7f239a7fc640 1 -- 172.21.15.60:0/2850128399 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4943+0+0 (secure 0 0 0) 0x7f23a008ad30 con 0x7f2390003f20 2024-09-12T01:39:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.308+0000 7f23a9154640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f238806be30 0x7f238806e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2394033000 tx=0x7f2394008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:05.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.311+0000 7f239a7fc640 1 -- 172.21.15.60:0/2850128399 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23a0003e20 con 0x7f2390003f20 2024-09-12T01:39:05.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.495+0000 7f23abbb9640 1 -- 172.21.15.60:0/2850128399 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f23a4072c40 con 0x7f2390003f20 2024-09-12T01:39:05.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.498+0000 7f239a7fc640 1 -- 172.21.15.60:0/2850128399 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f23a0059390 con 0x7f2390003f20 2024-09-12T01:39:05.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.500+0000 7f23abbb9640 1 -- 172.21.15.60:0/2850128399 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f238806be30 msgr2=0x7f238806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:05.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.500+0000 7f23abbb9640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f238806be30 0x7f238806e2f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2394033000 tx=0x7f2394008030 comp rx=0 tx=0).stop 2024-09-12T01:39:05.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.500+0000 7f23abbb9640 1 -- 172.21.15.60:0/2850128399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390003f20 msgr2=0x7f23a41f3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:05.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.500+0000 7f23abbb9640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390003f20 0x7f23a41f3e80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f23a000fb90 tx=0x7f23a000d520 comp rx=0 tx=0).stop 2024-09-12T01:39:05.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.500+0000 7f23abbb9640 1 -- 172.21.15.60:0/2850128399 shutdown_connections 2024-09-12T01:39:05.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.500+0000 7f23abbb9640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23a406e600 0x7f23a4156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.500+0000 7f23abbb9640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f238806be30 0x7f238806e2f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.500+0000 7f23abbb9640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a4157600 0x7f23a41558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.500+0000 7f23abbb9640 1 --2- 172.21.15.60:0/2850128399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2390003f20 0x7f23a41f3e80 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.500+0000 7f23abbb9640 1 -- 172.21.15.60:0/2850128399 >> 172.21.15.60:0/2850128399 conn(0x7f23a40d1390 msgr2=0x7f23a415e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:05.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.500+0000 7f23abbb9640 1 -- 172.21.15.60:0/2850128399 shutdown_connections 2024-09-12T01:39:05.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.500+0000 7f23abbb9640 1 -- 172.21.15.60:0/2850128399 wait complete. 2024-09-12T01:39:05.510 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps' 2024-09-12T01:39:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.613+0000 7fbe53de8640 1 Processor -- start 2024-09-12T01:39:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.613+0000 7fbe53de8640 1 -- start start 2024-09-12T01:39:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.614+0000 7fbe53de8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe4c155800 0x7fbe4c0b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.614+0000 7fbe53de8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbe4c15c330 0x7fbe4c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.614+0000 7fbe53de8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe4c0b50a0 con 0x7fbe4c0cf570 2024-09-12T01:39:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.614+0000 7fbe53de8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbe4c0b4e60 con 0x7fbe4c155800 2024-09-12T01:39:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.614+0000 7fbe53de8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbe4c15c7a0 con 0x7fbe4c15c330 2024-09-12T01:39:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.614+0000 7fbe51b84640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe4c155800 0x7fbe4c0b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.614+0000 7fbe51b84640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe4c155800 0x7fbe4c0b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46998/0 (socket says 172.21.15.60:46998) 2024-09-12T01:39:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.614+0000 7fbe51b84640 1 -- 172.21.15.60:0/727931763 learned_addr learned my addr 172.21.15.60:0/727931763 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.615+0000 7fbe51b84640 1 -- 172.21.15.60:0/727931763 >> v2:172.21.15.105:3300/0 conn(0x7fbe4c15c330 msgr2=0x7fbe4c0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.615+0000 7fbe51383640 1 --2- 172.21.15.60:0/727931763 >> v2:172.21.15.105:3300/0 conn(0x7fbe4c15c330 0x7fbe4c0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.615+0000 7fbe51b84640 1 --2- 172.21.15.60:0/727931763 >> v2:172.21.15.105:3300/0 conn(0x7fbe4c15c330 0x7fbe4c0b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.615+0000 7fbe51b84640 1 -- 172.21.15.60:0/727931763 >> v1:172.21.15.105:6789/0 conn(0x7fbe4c0cf570 legacy=0x7fbe4c0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.615+0000 7fbe51b84640 1 -- 172.21.15.60:0/727931763 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4c0b5380 con 0x7fbe4c155800 2024-09-12T01:39:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.615+0000 7fbe51383640 1 --2- 172.21.15.60:0/727931763 >> v2:172.21.15.105:3300/0 conn(0x7fbe4c15c330 0x7fbe4c0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.616+0000 7fbe51b84640 1 --2- 172.21.15.60:0/727931763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe4c155800 0x7fbe4c0b6140 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c06e210 tx=0x7fbe4402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3864b9ffd84c8125 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.616+0000 7fbe50b82640 1 -- 172.21.15.60:0/727931763 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe44037070 con 0x7fbe4c155800 2024-09-12T01:39:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.616+0000 7fbe50b82640 1 -- 172.21.15.60:0/727931763 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe44032440 con 0x7fbe4c155800 2024-09-12T01:39:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.616+0000 7fbe50b82640 1 -- 172.21.15.60:0/727931763 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe44032810 con 0x7fbe4c155800 2024-09-12T01:39:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.616+0000 7fbe53de8640 1 -- 172.21.15.60:0/727931763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe4c155800 msgr2=0x7fbe4c0b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.616+0000 7fbe53de8640 1 --2- 172.21.15.60:0/727931763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe4c155800 0x7fbe4c0b6140 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c06e210 tx=0x7fbe4402a230 comp rx=0 tx=0).stop 2024-09-12T01:39:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.616+0000 7fbe53de8640 1 -- 172.21.15.60:0/727931763 shutdown_connections 2024-09-12T01:39:05.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.616+0000 7fbe53de8640 1 --2- 172.21.15.60:0/727931763 >> v2:172.21.15.105:3300/0 conn(0x7fbe4c15c330 0x7fbe4c0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.616+0000 7fbe53de8640 1 --2- 172.21.15.60:0/727931763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe4c155800 0x7fbe4c0b6140 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.616+0000 7fbe53de8640 1 -- 172.21.15.60:0/727931763 >> 172.21.15.60:0/727931763 conn(0x7fbe4c06bc10 msgr2=0x7fbe4c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.616+0000 7fbe53de8640 1 -- 172.21.15.60:0/727931763 shutdown_connections 2024-09-12T01:39:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.616+0000 7fbe53de8640 1 -- 172.21.15.60:0/727931763 wait complete. 2024-09-12T01:39:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.617+0000 7fbe53de8640 1 Processor -- start 2024-09-12T01:39:05.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.618+0000 7fbe53de8640 1 -- start start 2024-09-12T01:39:05.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.618+0000 7fbe53de8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe4c0cf570 0x7fbe4c140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.618+0000 7fbe53de8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe4c155800 0x7fbe4c153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.618+0000 7fbe53de8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe4c15c330 0x7fbe4c15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.618+0000 7fbe53de8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c0b5c20 con 0x7fbe4c15c330 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.618+0000 7fbe53de8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4c0b5940 con 0x7fbe4c0cf570 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.618+0000 7fbe53de8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbe4c155be0 con 0x7fbe4c155800 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.618+0000 7fbe52385640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe4c15c330 0x7fbe4c15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.618+0000 7fbe52385640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe4c15c330 0x7fbe4c15ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47004/0 (socket says 172.21.15.60:47004) 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.618+0000 7fbe52385640 1 -- 172.21.15.60:0/2017214239 learned_addr learned my addr 172.21.15.60:0/2017214239 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.618+0000 7fbe51b84640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe4c0cf570 0x7fbe4c140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.618+0000 7fbe51383640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe4c155800 0x7fbe4c153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.619+0000 7fbe52385640 1 -- 172.21.15.60:0/2017214239 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe4c155800 msgr2=0x7fbe4c153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.619+0000 7fbe52385640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe4c155800 0x7fbe4c153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.619+0000 7fbe52385640 1 -- 172.21.15.60:0/2017214239 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe4c0cf570 msgr2=0x7fbe4c140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:05.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.619+0000 7fbe52385640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe4c0cf570 0x7fbe4c140fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:05.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.619+0000 7fbe52385640 1 -- 172.21.15.60:0/2017214239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe4c155070 con 0x7fbe4c15c330 2024-09-12T01:39:05.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.619+0000 7fbe52385640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe4c15c330 0x7fbe4c15ce70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00c780 tx=0x7fbe3c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:05.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.619+0000 7fbe4a7fc640 1 -- 172.21.15.60:0/2017214239 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c004b10 con 0x7fbe4c15c330 2024-09-12T01:39:05.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.619+0000 7fbe4a7fc640 1 -- 172.21.15.60:0/2017214239 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe3c004cb0 con 0x7fbe4c15c330 2024-09-12T01:39:05.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.619+0000 7fbe4a7fc640 1 -- 172.21.15.60:0/2017214239 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00aa90 con 0x7fbe4c15c330 2024-09-12T01:39:05.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.619+0000 7fbe53de8640 1 -- 172.21.15.60:0/2017214239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe4c153fd0 con 0x7fbe4c15c330 2024-09-12T01:39:05.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.619+0000 7fbe53de8640 1 -- 172.21.15.60:0/2017214239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe4c154590 con 0x7fbe4c15c330 2024-09-12T01:39:05.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.620+0000 7fbe53de8640 1 -- 172.21.15.60:0/2017214239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe4c076170 con 0x7fbe4c15c330 2024-09-12T01:39:05.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.621+0000 7fbe4a7fc640 1 -- 172.21.15.60:0/2017214239 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe3c00ac30 con 0x7fbe4c15c330 2024-09-12T01:39:05.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.621+0000 7fbe4a7fc640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe3806be30 0x7fbe3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:05.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.621+0000 7fbe4a7fc640 1 -- 172.21.15.60:0/2017214239 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4943+0+0 (secure 0 0 0) 0x7fbe3c08ac10 con 0x7fbe4c15c330 2024-09-12T01:39:05.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.621+0000 7fbe51b84640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe3806be30 0x7fbe3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:05.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.622+0000 7fbe51b84640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe3806be30 0x7fbe3806e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbe44034000 tx=0x7fbe4402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:05.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.625+0000 7fbe4a7fc640 1 -- 172.21.15.60:0/2017214239 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe4c076170 con 0x7fbe4c15c330 2024-09-12T01:39:05.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:05.868+0000 7fbe53de8640 1 -- 172.21.15.60:0/2017214239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]} v 0) -- 0x7fbe4c0b6140 con 0x7fbe4c15c330 2024-09-12T01:39:06.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.860+0000 7fbe4a7fc640 1 -- 172.21.15.60:0/2017214239 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_max_caps"]}]=0 v184) ==== 148+0+0 (secure 0 0 0) 0x7fbe3c020070 con 0x7fbe4c15c330 2024-09-12T01:39:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.863+0000 7fbe53de8640 1 -- 172.21.15.60:0/2017214239 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe3806be30 msgr2=0x7fbe3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.863+0000 7fbe53de8640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe3806be30 0x7fbe3806e2f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fbe44034000 tx=0x7fbe4402e000 comp rx=0 tx=0).stop 2024-09-12T01:39:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.863+0000 7fbe53de8640 1 -- 172.21.15.60:0/2017214239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe4c15c330 msgr2=0x7fbe4c15ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.863+0000 7fbe53de8640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe4c15c330 0x7fbe4c15ce70 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00c780 tx=0x7fbe3c00cc40 comp rx=0 tx=0).stop 2024-09-12T01:39:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.863+0000 7fbe53de8640 1 -- 172.21.15.60:0/2017214239 shutdown_connections 2024-09-12T01:39:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.863+0000 7fbe53de8640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe4c15c330 0x7fbe4c15ce70 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.863+0000 7fbe53de8640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe3806be30 0x7fbe3806e2f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.863+0000 7fbe53de8640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe4c155800 0x7fbe4c153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.863+0000 7fbe53de8640 1 --2- 172.21.15.60:0/2017214239 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe4c0cf570 0x7fbe4c140fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.863+0000 7fbe53de8640 1 -- 172.21.15.60:0/2017214239 >> 172.21.15.60:0/2017214239 conn(0x7fbe4c06bc10 msgr2=0x7fbe4c0cd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.863+0000 7fbe53de8640 1 -- 172.21.15.60:0/2017214239 shutdown_connections 2024-09-12T01:39:06.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.863+0000 7fbe53de8640 1 -- 172.21.15.60:0/2017214239 wait complete. 2024-09-12T01:39:06.876 INFO:tasks.cephfs_test_runner:That the MDS will not let a client sit above mds_max_caps_per_client caps. ... ok 2024-09-12T01:39:06.877 INFO:tasks.cephfs_test_runner:Starting test: test_client_min_caps_working_set (tasks.cephfs.test_client_limits.TestClientLimits) When a client has inodes pinned in its cache (open files), that the MDS 2024-09-12T01:39:06.877 INFO:tasks.cephfs_test_runner:test_client_min_caps_working_set (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-12T01:39:06.877 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:39:06.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.987+0000 7fbeff423640 1 Processor -- start 2024-09-12T01:39:06.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.987+0000 7fbeff423640 1 -- start start 2024-09-12T01:39:06.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.988+0000 7fbeff423640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbef80b4d30 0x7fbef8073ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:06.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.988+0000 7fbeff423640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef806e960 con 0x7fbef80cef20 2024-09-12T01:39:06.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.988+0000 7fbeff423640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef806ec40 con 0x7fbef8161bd0 2024-09-12T01:39:06.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.988+0000 7fbeff423640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbef806ef20 con 0x7fbef80b4d30 2024-09-12T01:39:06.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.988+0000 7fbefd9c0640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbef80cef20 0x7fbef8073160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34930/0 (socket says 172.21.15.60:34930) 2024-09-12T01:39:06.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.988+0000 7fbefd9c0640 1 -- 172.21.15.60:0/1634262926 learned_addr learned my addr 172.21.15.60:0/1634262926 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:06.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.988+0000 7fbefc9be640 1 --2- 172.21.15.60:0/1634262926 >> v2:172.21.15.105:3300/0 conn(0x7fbef80b4d30 0x7fbef8073ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:06.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.988+0000 7fbeeffff640 1 -- 172.21.15.60:0/1634262926 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4288766759 0 0) 0x7fbef806e960 con 0x7fbef80cef20 2024-09-12T01:39:06.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.988+0000 7fbeeffff640 1 -- 172.21.15.60:0/1634262926 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbee4003520 con 0x7fbef80cef20 2024-09-12T01:39:06.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.988+0000 7fbeeffff640 1 -- 172.21.15.60:0/1634262926 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2320256554 0 0) 0x7fbef806ec40 con 0x7fbef8161bd0 2024-09-12T01:39:06.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.989+0000 7fbeeffff640 1 -- 172.21.15.60:0/1634262926 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbef806e960 con 0x7fbef8161bd0 2024-09-12T01:39:06.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.989+0000 7fbefc9be640 1 -- 172.21.15.60:0/1634262926 >> v1:172.21.15.105:6789/0 conn(0x7fbef8161bd0 legacy=0x7fbef806d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:06.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.989+0000 7fbefc9be640 1 -- 172.21.15.60:0/1634262926 >> v1:172.21.15.60:6789/0 conn(0x7fbef80cef20 legacy=0x7fbef8073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:06.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.989+0000 7fbeeffff640 1 -- 172.21.15.60:0/1634262926 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 539015135 0 0) 0x7fbee4003520 con 0x7fbef80cef20 2024-09-12T01:39:06.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.989+0000 7fbefc9be640 1 -- 172.21.15.60:0/1634262926 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef806ce70 con 0x7fbef80b4d30 2024-09-12T01:39:06.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.989+0000 7fbefc9be640 1 --2- 172.21.15.60:0/1634262926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbef80b4d30 0x7fbef8073ea0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbee80097a0 tx=0x7fbee802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d1fcd35f134b59b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:06.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.990+0000 7fbeeffff640 1 -- 172.21.15.60:0/1634262926 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8037070 con 0x7fbef80b4d30 2024-09-12T01:39:06.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.990+0000 7fbeeffff640 1 -- 172.21.15.60:0/1634262926 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee802ac50 con 0x7fbef80b4d30 2024-09-12T01:39:06.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.990+0000 7fbeeffff640 1 -- 172.21.15.60:0/1634262926 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0001670 con 0x7fbef80b4d30 2024-09-12T01:39:06.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.990+0000 7fbeff423640 1 -- 172.21.15.60:0/1634262926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbef80b4d30 msgr2=0x7fbef8073ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:06.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.990+0000 7fbeff423640 1 --2- 172.21.15.60:0/1634262926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbef80b4d30 0x7fbef8073ea0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbee80097a0 tx=0x7fbee802a1c0 comp rx=0 tx=0).stop 2024-09-12T01:39:06.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.990+0000 7fbeff423640 1 -- 172.21.15.60:0/1634262926 shutdown_connections 2024-09-12T01:39:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.990+0000 7fbeff423640 1 --2- 172.21.15.60:0/1634262926 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbef80b4d30 0x7fbef8073ea0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.990+0000 7fbeff423640 1 -- 172.21.15.60:0/1634262926 >> 172.21.15.60:0/1634262926 conn(0x7fbef80b4240 msgr2=0x7fbef80b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.990+0000 7fbeff423640 1 -- 172.21.15.60:0/1634262926 shutdown_connections 2024-09-12T01:39:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.990+0000 7fbeff423640 1 -- 172.21.15.60:0/1634262926 wait complete. 2024-09-12T01:39:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.991+0000 7fbeff423640 1 Processor -- start 2024-09-12T01:39:06.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.992+0000 7fbeff423640 1 -- start start 2024-09-12T01:39:06.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.992+0000 7fbeff423640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbef80cef20 0x7fbef80ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:06.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.992+0000 7fbeff423640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef8161bd0 0x7fbef81f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:06.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.992+0000 7fbeff423640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbef815f650 0x7fbef815fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:06.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.992+0000 7fbeff423640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbef80d1f20 con 0x7fbef8161bd0 2024-09-12T01:39:06.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.992+0000 7fbeff423640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbef80d1da0 con 0x7fbef80cef20 2024-09-12T01:39:06.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.992+0000 7fbeff423640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbef8073870 con 0x7fbef815f650 2024-09-12T01:39:06.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.992+0000 7fbefc9be640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef8161bd0 0x7fbef81f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.992+0000 7fbefc9be640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef8161bd0 0x7fbef81f3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47008/0 (socket says 172.21.15.60:47008) 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.992+0000 7fbefc9be640 1 -- 172.21.15.60:0/419993103 learned_addr learned my addr 172.21.15.60:0/419993103 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbefd1bf640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbef80cef20 0x7fbef80ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbefc9be640 1 -- 172.21.15.60:0/419993103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbef815f650 msgr2=0x7fbef815fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbefc9be640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbef815f650 0x7fbef815fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbefc9be640 1 -- 172.21.15.60:0/419993103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbef80cef20 msgr2=0x7fbef80ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbefc9be640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbef80cef20 0x7fbef80ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbefc9be640 1 -- 172.21.15.60:0/419993103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef815d5b0 con 0x7fbef8161bd0 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbefd1bf640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbef80cef20 0x7fbef80ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbefc9be640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef8161bd0 0x7fbef81f3f40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbee8035040 tx=0x7fbee80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbeedffb640 1 -- 172.21.15.60:0/419993103 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8037050 con 0x7fbef8161bd0 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbeedffb640 1 -- 172.21.15.60:0/419993103 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbee8043070 con 0x7fbef8161bd0 2024-09-12T01:39:06.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbeff423640 1 -- 172.21.15.60:0/419993103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef815d890 con 0x7fbef8161bd0 2024-09-12T01:39:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbeedffb640 1 -- 172.21.15.60:0/419993103 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8006e10 con 0x7fbef8161bd0 2024-09-12T01:39:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.993+0000 7fbeff423640 1 -- 172.21.15.60:0/419993103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef815de50 con 0x7fbef8161bd0 2024-09-12T01:39:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.994+0000 7fbeff423640 1 -- 172.21.15.60:0/419993103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef8073ea0 con 0x7fbef8161bd0 2024-09-12T01:39:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.995+0000 7fbeedffb640 1 -- 172.21.15.60:0/419993103 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbee803c810 con 0x7fbef8161bd0 2024-09-12T01:39:06.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.995+0000 7fbeedffb640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbedc06be60 0x7fbedc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:06.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.995+0000 7fbeedffb640 1 -- 172.21.15.60:0/419993103 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4943+0+0 (secure 0 0 0) 0x7fbee80ab320 con 0x7fbef8161bd0 2024-09-12T01:39:06.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.995+0000 7fbefd1bf640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbedc06be60 0x7fbedc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:06.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:06.996+0000 7fbefd1bf640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbedc06be60 0x7fbedc06e320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbef4007fd0 tx=0x7fbef4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:06.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.000+0000 7fbeedffb640 1 -- 172.21.15.60:0/419993103 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbee807a060 con 0x7fbef8161bd0 2024-09-12T01:39:07.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.178+0000 7fbeff423640 1 -- 172.21.15.60:0/419993103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbef8160300 con 0x7fbef8161bd0 2024-09-12T01:39:07.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.179+0000 7fbeedffb640 1 -- 172.21.15.60:0/419993103 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+12999 (secure 0 0 0) 0x7fbee8079960 con 0x7fbef8161bd0 2024-09-12T01:39:07.178 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:07.178 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":71,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:39:04.849547+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/1216783001":"2024-09-13T01:39:01.836403+0000","172.21.15.105:6834/1216783001":"2024-09-13T01:39:01.836403+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:39:07.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.181+0000 7fbeff423640 1 -- 172.21.15.60:0/419993103 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbedc06be60 msgr2=0x7fbedc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.181+0000 7fbeff423640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbedc06be60 0x7fbedc06e320 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbef4007fd0 tx=0x7fbef4009040 comp rx=0 tx=0).stop 2024-09-12T01:39:07.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.181+0000 7fbeff423640 1 -- 172.21.15.60:0/419993103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef8161bd0 msgr2=0x7fbef81f3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.181+0000 7fbeff423640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef8161bd0 0x7fbef81f3f40 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fbee8035040 tx=0x7fbee80046c0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.181+0000 7fbeff423640 1 -- 172.21.15.60:0/419993103 shutdown_connections 2024-09-12T01:39:07.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.181+0000 7fbeff423640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbedc06be60 0x7fbedc06e320 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.181+0000 7fbeff423640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbef815f650 0x7fbef815fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.181+0000 7fbeff423640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbef8161bd0 0x7fbef81f3f40 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.181+0000 7fbeff423640 1 --2- 172.21.15.60:0/419993103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbef80cef20 0x7fbef80ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.181+0000 7fbeff423640 1 -- 172.21.15.60:0/419993103 >> 172.21.15.60:0/419993103 conn(0x7fbef80b4240 msgr2=0x7fbef806d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:07.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.181+0000 7fbeff423640 1 -- 172.21.15.60:0/419993103 shutdown_connections 2024-09-12T01:39:07.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.181+0000 7fbeff423640 1 -- 172.21.15.60:0/419993103 wait complete. 2024-09-12T01:39:07.191 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:35:46.304939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:39:07.192 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:39:07.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.298+0000 7f6a180a6640 1 Processor -- start 2024-09-12T01:39:07.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.298+0000 7f6a180a6640 1 -- start start 2024-09-12T01:39:07.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a180a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a100b4a50 0x7f6a100b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a180a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a1015e840 0x7f6a10071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a180a6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a100b0090 con 0x7f6a1015e460 2024-09-12T01:39:07.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a180a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6a100af480 con 0x7f6a1015e840 2024-09-12T01:39:07.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a180a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6a100af760 con 0x7f6a100b4a50 2024-09-12T01:39:07.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a15e42640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6a1015e460 0x7f6a100b4340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34940/0 (socket says 172.21.15.60:34940) 2024-09-12T01:39:07.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a15e42640 1 -- 172.21.15.60:0/1091530632 learned_addr learned my addr 172.21.15.60:0/1091530632 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:07.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a16643640 1 --2- 172.21.15.60:0/1091530632 >> v2:172.21.15.60:3300/0 conn(0x7f6a1015e840 0x7f6a10071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a14e40640 1 -- 172.21.15.60:0/1091530632 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058023335 0 0) 0x7f6a100b0090 con 0x7f6a1015e460 2024-09-12T01:39:07.299 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a15641640 1 --2- 172.21.15.60:0/1091530632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a100b4a50 0x7f6a100b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a14e40640 1 -- 172.21.15.60:0/1091530632 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69fc003520 con 0x7f6a1015e460 2024-09-12T01:39:07.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a16643640 1 -- 172.21.15.60:0/1091530632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a100b4a50 msgr2=0x7f6a100b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:07.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a16643640 1 --2- 172.21.15.60:0/1091530632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a100b4a50 0x7f6a100b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a16643640 1 -- 172.21.15.60:0/1091530632 >> v1:172.21.15.60:6789/0 conn(0x7f6a1015e460 legacy=0x7f6a100b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.299+0000 7f6a16643640 1 -- 172.21.15.60:0/1091530632 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a100717d0 con 0x7f6a1015e840 2024-09-12T01:39:07.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.300+0000 7f6a16643640 1 --2- 172.21.15.60:0/1091530632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a1015e840 0x7f6a10071d60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009d90 tx=0x7f6a0c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccc745552a339f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:07.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.300+0000 7f6a14e40640 1 -- 172.21.15.60:0/1091530632 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c007740 con 0x7f6a1015e840 2024-09-12T01:39:07.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.300+0000 7f6a14e40640 1 -- 172.21.15.60:0/1091530632 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c0078e0 con 0x7f6a1015e840 2024-09-12T01:39:07.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.300+0000 7f6a14e40640 1 -- 172.21.15.60:0/1091530632 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c007c90 con 0x7f6a1015e840 2024-09-12T01:39:07.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.301+0000 7f6a180a6640 1 -- 172.21.15.60:0/1091530632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a1015e840 msgr2=0x7f6a10071d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.301+0000 7f6a180a6640 1 --2- 172.21.15.60:0/1091530632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a1015e840 0x7f6a10071d60 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009d90 tx=0x7f6a0c02a660 comp rx=0 tx=0).stop 2024-09-12T01:39:07.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.301+0000 7f6a180a6640 1 -- 172.21.15.60:0/1091530632 shutdown_connections 2024-09-12T01:39:07.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.301+0000 7f6a180a6640 1 --2- 172.21.15.60:0/1091530632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a1015e840 0x7f6a10071d60 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.301+0000 7f6a180a6640 1 --2- 172.21.15.60:0/1091530632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a100b4a50 0x7f6a100b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.301+0000 7f6a180a6640 1 -- 172.21.15.60:0/1091530632 >> 172.21.15.60:0/1091530632 conn(0x7f6a1006bc10 msgr2=0x7f6a1006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:07.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.301+0000 7f6a180a6640 1 -- 172.21.15.60:0/1091530632 shutdown_connections 2024-09-12T01:39:07.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.301+0000 7f6a180a6640 1 -- 172.21.15.60:0/1091530632 wait complete. 2024-09-12T01:39:07.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.302+0000 7f6a180a6640 1 Processor -- start 2024-09-12T01:39:07.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.302+0000 7f6a180a6640 1 -- start start 2024-09-12T01:39:07.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a180a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a100b4a50 0x7f6a10147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a180a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a1015e460 0x7f6a1014a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a180a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a1015e840 0x7f6a1014acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a180a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a100afe50 con 0x7f6a1015e840 2024-09-12T01:39:07.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a180a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a100afcd0 con 0x7f6a1015e460 2024-09-12T01:39:07.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a180a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6a100ce680 con 0x7f6a100b4a50 2024-09-12T01:39:07.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a16643640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a1015e840 0x7f6a1014acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a16643640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a1015e840 0x7f6a1014acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47016/0 (socket says 172.21.15.60:47016) 2024-09-12T01:39:07.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a16643640 1 -- 172.21.15.60:0/4085926498 learned_addr learned my addr 172.21.15.60:0/4085926498 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:07.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a15e42640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a100b4a50 0x7f6a10147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a15641640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a1015e460 0x7f6a1014a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a16643640 1 -- 172.21.15.60:0/4085926498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a100b4a50 msgr2=0x7f6a10147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a16643640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a100b4a50 0x7f6a10147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a16643640 1 -- 172.21.15.60:0/4085926498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a1015e460 msgr2=0x7f6a1014a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a16643640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a1015e460 0x7f6a1014a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.303+0000 7f6a16643640 1 -- 172.21.15.60:0/4085926498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a10148460 con 0x7f6a1015e840 2024-09-12T01:39:07.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.304+0000 7f6a16643640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a1015e840 0x7f6a1014acc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009eb0 tx=0x7f6a0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:07.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.304+0000 7f6a067fc640 1 -- 172.21.15.60:0/4085926498 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c009450 con 0x7f6a1015e840 2024-09-12T01:39:07.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.304+0000 7f6a067fc640 1 -- 172.21.15.60:0/4085926498 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c004240 con 0x7f6a1015e840 2024-09-12T01:39:07.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.304+0000 7f6a067fc640 1 -- 172.21.15.60:0/4085926498 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c004630 con 0x7f6a1015e840 2024-09-12T01:39:07.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.304+0000 7f6a180a6640 1 -- 172.21.15.60:0/4085926498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a100c6e70 con 0x7f6a1015e840 2024-09-12T01:39:07.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.304+0000 7f6a180a6640 1 -- 172.21.15.60:0/4085926498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a10148880 con 0x7f6a1015e840 2024-09-12T01:39:07.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.305+0000 7f6a180a6640 1 -- 172.21.15.60:0/4085926498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a100b3830 con 0x7f6a1015e840 2024-09-12T01:39:07.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.305+0000 7f6a067fc640 1 -- 172.21.15.60:0/4085926498 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a0c03b410 con 0x7f6a1015e840 2024-09-12T01:39:07.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.306+0000 7f6a067fc640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f69f406be30 0x7f69f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.306+0000 7f6a067fc640 1 -- 172.21.15.60:0/4085926498 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4943+0+0 (secure 0 0 0) 0x7f6a0c0ab9d0 con 0x7f6a1015e840 2024-09-12T01:39:07.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.306+0000 7f6a15e42640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f69f406be30 0x7f69f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.307+0000 7f6a15e42640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f69f406be30 0x7f69f406e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6a08005880 tx=0x7f6a08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:07.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.311+0000 7f6a067fc640 1 -- 172.21.15.60:0/4085926498 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a0c03f030 con 0x7f6a1015e840 2024-09-12T01:39:07.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.488+0000 7f6a180a6640 1 -- 172.21.15.60:0/4085926498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6a100c7390 con 0x7f6a1015e840 2024-09-12T01:39:07.487 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.488+0000 7f6a067fc640 1 -- 172.21.15.60:0/4085926498 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) ==== 93+0+10 (secure 0 0 0) 0x7f6a0c07a180 con 0x7f6a1015e840 2024-09-12T01:39:07.487 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-12T01:39:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.490+0000 7f6a180a6640 1 -- 172.21.15.60:0/4085926498 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f69f406be30 msgr2=0x7f69f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.490+0000 7f6a180a6640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f69f406be30 0x7f69f406e2f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6a08005880 tx=0x7f6a08009040 comp rx=0 tx=0).stop 2024-09-12T01:39:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.490+0000 7f6a180a6640 1 -- 172.21.15.60:0/4085926498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a1015e840 msgr2=0x7f6a1014acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.490+0000 7f6a180a6640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a1015e840 0x7f6a1014acc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009eb0 tx=0x7f6a0c004a40 comp rx=0 tx=0).stop 2024-09-12T01:39:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.490+0000 7f6a180a6640 1 -- 172.21.15.60:0/4085926498 shutdown_connections 2024-09-12T01:39:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.490+0000 7f6a180a6640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a1015e840 0x7f6a1014acc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.490+0000 7f6a180a6640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a1015e460 0x7f6a1014a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.490+0000 7f6a180a6640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f69f406be30 0x7f69f406e2f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.490+0000 7f6a180a6640 1 --2- 172.21.15.60:0/4085926498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a100b4a50 0x7f6a10147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.490+0000 7f6a180a6640 1 -- 172.21.15.60:0/4085926498 >> 172.21.15.60:0/4085926498 conn(0x7f6a1006bc10 msgr2=0x7f6a1015c150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:07.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.490+0000 7f6a180a6640 1 -- 172.21.15.60:0/4085926498 shutdown_connections 2024-09-12T01:39:07.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.490+0000 7f6a180a6640 1 -- 172.21.15.60:0/4085926498 wait complete. 2024-09-12T01:39:07.501 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set' 2024-09-12T01:39:07.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.604+0000 7ff52d5a2640 1 Processor -- start 2024-09-12T01:39:07.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.604+0000 7ff52d5a2640 1 -- start start 2024-09-12T01:39:07.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52d5a2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff52815e650 0x7ff5280cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52d5a2640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff52815ea30 0x7ff5280d2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52d5a2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5280d0c40 0x7ff5280d1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52d5a2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff5280d3150 con 0x7ff5280d0c40 2024-09-12T01:39:07.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52d5a2640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff5280d3c50 con 0x7ff52815ea30 2024-09-12T01:39:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52d5a2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff5280d33b0 con 0x7ff52815e650 2024-09-12T01:39:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52cda1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5280d0c40 0x7ff5280d1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52cda1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5280d0c40 0x7ff5280d1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47028/0 (socket says 172.21.15.60:47028) 2024-09-12T01:39:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52cda1640 1 -- 172.21.15.60:0/3554480640 learned_addr learned my addr 172.21.15.60:0/3554480640 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff527fff640 1 --2- 172.21.15.60:0/3554480640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff52815e650 0x7ff5280cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52cda1640 1 -- 172.21.15.60:0/3554480640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff52815e650 msgr2=0x7ff5280cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:07.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52cda1640 1 --2- 172.21.15.60:0/3554480640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff52815e650 0x7ff5280cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52cda1640 1 -- 172.21.15.60:0/3554480640 >> v2:172.21.15.105:3300/0 conn(0x7ff52815ea30 msgr2=0x7ff5280d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:07.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff5277fe640 1 --2- 172.21.15.60:0/3554480640 >> v2:172.21.15.105:3300/0 conn(0x7ff52815ea30 0x7ff5280d2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.605+0000 7ff52cda1640 1 --2- 172.21.15.60:0/3554480640 >> v2:172.21.15.105:3300/0 conn(0x7ff52815ea30 0x7ff5280d2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.606+0000 7ff52cda1640 1 -- 172.21.15.60:0/3554480640 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5280d3690 con 0x7ff5280d0c40 2024-09-12T01:39:07.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.606+0000 7ff52cda1640 1 --2- 172.21.15.60:0/3554480640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5280d0c40 0x7ff5280d1050 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff528069930 tx=0x7ff52002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf6f627955d2218 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:07.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.606+0000 7ff526ffd640 1 -- 172.21.15.60:0/3554480640 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff520036070 con 0x7ff5280d0c40 2024-09-12T01:39:07.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.606+0000 7ff526ffd640 1 -- 172.21.15.60:0/3554480640 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff520031600 con 0x7ff5280d0c40 2024-09-12T01:39:07.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.606+0000 7ff526ffd640 1 -- 172.21.15.60:0/3554480640 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5200319d0 con 0x7ff5280d0c40 2024-09-12T01:39:07.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.607+0000 7ff52d5a2640 1 -- 172.21.15.60:0/3554480640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5280d0c40 msgr2=0x7ff5280d1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.607+0000 7ff52d5a2640 1 --2- 172.21.15.60:0/3554480640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5280d0c40 0x7ff5280d1050 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff528069930 tx=0x7ff52002a6a0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.607+0000 7ff52d5a2640 1 -- 172.21.15.60:0/3554480640 shutdown_connections 2024-09-12T01:39:07.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.607+0000 7ff52d5a2640 1 --2- 172.21.15.60:0/3554480640 >> v2:172.21.15.105:3300/0 conn(0x7ff52815ea30 0x7ff5280d2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.607+0000 7ff52d5a2640 1 --2- 172.21.15.60:0/3554480640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5280d0c40 0x7ff5280d1050 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.607+0000 7ff52d5a2640 1 --2- 172.21.15.60:0/3554480640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff52815e650 0x7ff5280cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.607+0000 7ff52d5a2640 1 -- 172.21.15.60:0/3554480640 >> 172.21.15.60:0/3554480640 conn(0x7ff528062630 msgr2=0x7ff528062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:07.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.607+0000 7ff52d5a2640 1 -- 172.21.15.60:0/3554480640 shutdown_connections 2024-09-12T01:39:07.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.607+0000 7ff52d5a2640 1 -- 172.21.15.60:0/3554480640 wait complete. 2024-09-12T01:39:07.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.608+0000 7ff52d5a2640 1 Processor -- start 2024-09-12T01:39:07.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.608+0000 7ff52d5a2640 1 -- start start 2024-09-12T01:39:07.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.609+0000 7ff52d5a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5280d0c40 0x7ff5281527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.609+0000 7ff52d5a2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff52815e650 0x7ff5280c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.609+0000 7ff52d5a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815ea30 0x7ff5281459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.609+0000 7ff52d5a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff5280d1590 con 0x7ff52815ea30 2024-09-12T01:39:07.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.609+0000 7ff52d5a2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff5280b7ac0 con 0x7ff5280d0c40 2024-09-12T01:39:07.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.609+0000 7ff52d5a2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff5280b6000 con 0x7ff52815e650 2024-09-12T01:39:07.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.609+0000 7ff52cda1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815ea30 0x7ff5281459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.609+0000 7ff52cda1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815ea30 0x7ff5281459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47038/0 (socket says 172.21.15.60:47038) 2024-09-12T01:39:07.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.609+0000 7ff5277fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff52815e650 0x7ff5280c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.609+0000 7ff52cda1640 1 -- 172.21.15.60:0/1480853145 learned_addr learned my addr 172.21.15.60:0/1480853145 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:07.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.609+0000 7ff527fff640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5280d0c40 0x7ff5281527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.610+0000 7ff52cda1640 1 -- 172.21.15.60:0/1480853145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff52815e650 msgr2=0x7ff5280c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.610+0000 7ff52cda1640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff52815e650 0x7ff5280c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.610+0000 7ff52cda1640 1 -- 172.21.15.60:0/1480853145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5280d0c40 msgr2=0x7ff5281527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.610+0000 7ff52cda1640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5280d0c40 0x7ff5281527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.610+0000 7ff52cda1640 1 -- 172.21.15.60:0/1480853145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5281f43f0 con 0x7ff52815ea30 2024-09-12T01:39:07.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.610+0000 7ff5277fe640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff52815e650 0x7ff5280c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:39:07.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.610+0000 7ff52cda1640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815ea30 0x7ff5281459c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff52002ac90 tx=0x7ff520004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:07.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.610+0000 7ff524ff9640 1 -- 172.21.15.60:0/1480853145 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52003f020 con 0x7ff52815ea30 2024-09-12T01:39:07.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.610+0000 7ff524ff9640 1 -- 172.21.15.60:0/1480853145 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff520037040 con 0x7ff52815ea30 2024-09-12T01:39:07.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.610+0000 7ff52d5a2640 1 -- 172.21.15.60:0/1480853145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5280cd1e0 con 0x7ff52815ea30 2024-09-12T01:39:07.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.610+0000 7ff524ff9640 1 -- 172.21.15.60:0/1480853145 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff520036070 con 0x7ff52815ea30 2024-09-12T01:39:07.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.610+0000 7ff52d5a2640 1 -- 172.21.15.60:0/1480853145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5280cd7a0 con 0x7ff52815ea30 2024-09-12T01:39:07.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.611+0000 7ff52d5a2640 1 -- 172.21.15.60:0/1480853145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff528068cb0 con 0x7ff52815ea30 2024-09-12T01:39:07.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.612+0000 7ff524ff9640 1 -- 172.21.15.60:0/1480853145 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff520042020 con 0x7ff52815ea30 2024-09-12T01:39:07.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.612+0000 7ff524ff9640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff51406be60 0x7ff51406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.612+0000 7ff527fff640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff51406be60 0x7ff51406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.612+0000 7ff524ff9640 1 -- 172.21.15.60:0/1480853145 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4943+0+0 (secure 0 0 0) 0x7ff5200ab310 con 0x7ff52815ea30 2024-09-12T01:39:07.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.613+0000 7ff527fff640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff51406be60 0x7ff51406e320 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff51800aaf0 tx=0x7ff518008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:07.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.617+0000 7ff524ff9640 1 -- 172.21.15.60:0/1480853145 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff528068cb0 con 0x7ff52815ea30 2024-09-12T01:39:07.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.858+0000 7ff52d5a2640 1 -- 172.21.15.60:0/1480853145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]} v 0) -- 0x7ff5280d1050 con 0x7ff52815ea30 2024-09-12T01:39:07.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.861+0000 7ff524ff9640 1 -- 172.21.15.60:0/1480853145 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]}]=0 v185) ==== 163+0+0 (secure 0 0 0) 0x7ff520049020 con 0x7ff52815ea30 2024-09-12T01:39:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.863+0000 7ff52d5a2640 1 -- 172.21.15.60:0/1480853145 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff51406be60 msgr2=0x7ff51406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.863+0000 7ff52d5a2640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff51406be60 0x7ff51406e320 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff51800aaf0 tx=0x7ff518008040 comp rx=0 tx=0).stop 2024-09-12T01:39:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.863+0000 7ff52d5a2640 1 -- 172.21.15.60:0/1480853145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815ea30 msgr2=0x7ff5281459c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.863+0000 7ff52d5a2640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815ea30 0x7ff5281459c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff52002ac90 tx=0x7ff520004a40 comp rx=0 tx=0).stop 2024-09-12T01:39:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.863+0000 7ff52d5a2640 1 -- 172.21.15.60:0/1480853145 shutdown_connections 2024-09-12T01:39:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.863+0000 7ff52d5a2640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff52815ea30 0x7ff5281459c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.863+0000 7ff52d5a2640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff51406be60 0x7ff51406e320 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.863+0000 7ff52d5a2640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff52815e650 0x7ff5280c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.863+0000 7ff52d5a2640 1 --2- 172.21.15.60:0/1480853145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5280d0c40 0x7ff5281527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.863+0000 7ff52d5a2640 1 -- 172.21.15.60:0/1480853145 >> 172.21.15.60:0/1480853145 conn(0x7ff528062630 msgr2=0x7ff5280d26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.864+0000 7ff52d5a2640 1 -- 172.21.15.60:0/1480853145 shutdown_connections 2024-09-12T01:39:07.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.864+0000 7ff52d5a2640 1 -- 172.21.15.60:0/1480853145 wait complete. 2024-09-12T01:39:07.874 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:39:07.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.979+0000 7f255a81e640 1 Processor -- start 2024-09-12T01:39:07.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.979+0000 7f255a81e640 1 -- start start 2024-09-12T01:39:07.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.980+0000 7f255a81e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f25540cf1f0 0x7f25540b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.980+0000 7f255a81e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25540cf860 con 0x7f25540b6720 2024-09-12T01:39:07.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.980+0000 7f255a81e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25540cfb40 con 0x7f255415e7a0 2024-09-12T01:39:07.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.980+0000 7f255a81e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f25540b6b90 con 0x7f25540cf1f0 2024-09-12T01:39:07.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2558dbb640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f25540b6720 0x7f25540d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34954/0 (socket says 172.21.15.60:34954) 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2558dbb640 1 -- 172.21.15.60:0/3731269489 learned_addr learned my addr 172.21.15.60:0/3731269489 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f25537fe640 1 --2- 172.21.15.60:0/3731269489 >> v2:172.21.15.105:3300/0 conn(0x7f25540cf1f0 0x7f25540b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154036764 0 0) 0x7f25540cf860 con 0x7f25540b6720 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f253c003520 con 0x7f25540b6720 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 753413461 0 0) 0x7f253c003520 con 0x7f25540b6720 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 >> v2:172.21.15.105:3300/0 conn(0x7f25540cf1f0 msgr2=0x7f25540b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 --2- 172.21.15.60:0/3731269489 >> v2:172.21.15.105:3300/0 conn(0x7f25540cf1f0 0x7f25540b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 >> v1:172.21.15.105:6789/0 conn(0x7f255415e7a0 legacy=0x7f255406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25540cfe20 con 0x7f25540b6720 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f254c0019f0 con 0x7f25540b6720 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 >> v1:172.21.15.60:6789/0 conn(0x7f25540b6720 legacy=0x7f25540d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f253c0039b0 0x7f253c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f253c004800 0x7f253c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f253c0051c0 0x7f253c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f25540b6b90 con 0x7f253c0051c0 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f253c00c160 con 0x7f253c0039b0 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f253c00c360 con 0x7f253c004800 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2558dbb640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f253c0051c0 0x7f253c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f2553fff640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f253c0039b0 0x7f253c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.981+0000 7f25537fe640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f253c004800 0x7f253c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.982+0000 7f2558dbb640 1 -- 172.21.15.60:0/3731269489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f253c004800 msgr2=0x7f253c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.982+0000 7f2558dbb640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f253c004800 0x7f253c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.982+0000 7f2558dbb640 1 -- 172.21.15.60:0/3731269489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f253c0039b0 msgr2=0x7f253c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.982+0000 7f2558dbb640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f253c0039b0 0x7f253c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.982+0000 7f2558dbb640 1 -- 172.21.15.60:0/3731269489 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c003520 con 0x7f253c0051c0 2024-09-12T01:39:07.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.982+0000 7f25537fe640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f253c004800 0x7f253c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:07.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.982+0000 7f2553fff640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f253c0039b0 0x7f253c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:07.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.982+0000 7f2558dbb640 1 -- 172.21.15.60:0/3731269489 reap_dead start 2024-09-12T01:39:07.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.982+0000 7f2558dbb640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f253c0051c0 0x7f253c00b9c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f254c00a850 tx=0x7f253c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8429ce759c2270 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:07.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.982+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c00a4a0 con 0x7f253c0051c0 2024-09-12T01:39:07.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.982+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f254c02f070 con 0x7f253c0051c0 2024-09-12T01:39:07.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.982+0000 7f2552ffd640 1 -- 172.21.15.60:0/3731269489 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f254c02bce0 con 0x7f253c0051c0 2024-09-12T01:39:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.983+0000 7f255a81e640 1 -- 172.21.15.60:0/3731269489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f253c0051c0 msgr2=0x7f253c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.983+0000 7f255a81e640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f253c0051c0 0x7f253c00b9c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f254c00a850 tx=0x7f253c005830 comp rx=0 tx=0).stop 2024-09-12T01:39:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.983+0000 7f255a81e640 1 -- 172.21.15.60:0/3731269489 shutdown_connections 2024-09-12T01:39:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.983+0000 7f255a81e640 1 --2- 172.21.15.60:0/3731269489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f253c0051c0 0x7f253c00b9c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.983+0000 7f255a81e640 1 -- 172.21.15.60:0/3731269489 >> 172.21.15.60:0/3731269489 conn(0x7f25540d11e0 msgr2=0x7f25540d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.983+0000 7f255a81e640 1 -- 172.21.15.60:0/3731269489 shutdown_connections 2024-09-12T01:39:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.983+0000 7f255a81e640 1 -- 172.21.15.60:0/3731269489 wait complete. 2024-09-12T01:39:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.984+0000 7f255a81e640 1 Processor -- start 2024-09-12T01:39:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.985+0000 7f255a81e640 1 -- start start 2024-09-12T01:39:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.985+0000 7f255a81e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f253c0051c0 0x7f25540d4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.985+0000 7f255a81e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2554152d00 0x7f25541f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.985+0000 7f255a81e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25540c88f0 0x7f25540c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.985+0000 7f255a81e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f25540b7a00 con 0x7f2554152d00 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.985+0000 7f255a81e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f25540d2ca0 con 0x7f25540c88f0 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.985+0000 7f255a81e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f255415eb80 con 0x7f253c0051c0 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.985+0000 7f25537fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2554152d00 0x7f25541f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.985+0000 7f25537fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2554152d00 0x7f25541f39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47046/0 (socket says 172.21.15.60:47046) 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.985+0000 7f25537fe640 1 -- 172.21.15.60:0/4220826871 learned_addr learned my addr 172.21.15.60:0/4220826871 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.985+0000 7f2558dbb640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25540c88f0 0x7f25540c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.985+0000 7f2553fff640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f253c0051c0 0x7f25540d4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.986+0000 7f25537fe640 1 -- 172.21.15.60:0/4220826871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f253c0051c0 msgr2=0x7f25540d4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.986+0000 7f25537fe640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f253c0051c0 0x7f25540d4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.986+0000 7f25537fe640 1 -- 172.21.15.60:0/4220826871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25540c88f0 msgr2=0x7f25540c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:07.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.986+0000 7f25537fe640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25540c88f0 0x7f25540c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.986+0000 7f25537fe640 1 -- 172.21.15.60:0/4220826871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25541533f0 con 0x7f2554152d00 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.986+0000 7f25537fe640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2554152d00 0x7f25541f39c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f25480115a0 tx=0x7f2548011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.986+0000 7f2550ff9640 1 -- 172.21.15.60:0/4220826871 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2548015870 con 0x7f2554152d00 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.986+0000 7f2550ff9640 1 -- 172.21.15.60:0/4220826871 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2548015a10 con 0x7f2554152d00 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.986+0000 7f255a81e640 1 -- 172.21.15.60:0/4220826871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2554153690 con 0x7f2554152d00 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.986+0000 7f2550ff9640 1 -- 172.21.15.60:0/4220826871 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2548015dc0 con 0x7f2554152d00 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.986+0000 7f255a81e640 1 -- 172.21.15.60:0/4220826871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25540c9be0 con 0x7f2554152d00 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.987+0000 7f255a81e640 1 -- 172.21.15.60:0/4220826871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25540c8250 con 0x7f2554152d00 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.988+0000 7f2550ff9640 1 -- 172.21.15.60:0/4220826871 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f254801d400 con 0x7f2554152d00 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.988+0000 7f2550ff9640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f254006be60 0x7f254006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.988+0000 7f2550ff9640 1 -- 172.21.15.60:0/4220826871 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4943+0+0 (secure 0 0 0) 0x7f254808b130 con 0x7f2554152d00 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.988+0000 7f2553fff640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f254006be60 0x7f254006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:07.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.989+0000 7f2553fff640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f254006be60 0x7f254006e320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2544000c00 tx=0x7f2544009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:07.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:07.992+0000 7f2550ff9640 1 -- 172.21.15.60:0/4220826871 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2548019030 con 0x7f2554152d00 2024-09-12T01:39:08.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.169+0000 7f255a81e640 1 -- 172.21.15.60:0/4220826871 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f25540b61e0 con 0x7f2554152d00 2024-09-12T01:39:08.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.172+0000 7f2550ff9640 1 -- 172.21.15.60:0/4220826871 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f2548059820 con 0x7f2554152d00 2024-09-12T01:39:08.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.174+0000 7f255a81e640 1 -- 172.21.15.60:0/4220826871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f254006be60 msgr2=0x7f254006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:08.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.174+0000 7f255a81e640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f254006be60 0x7f254006e320 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2544000c00 tx=0x7f2544009040 comp rx=0 tx=0).stop 2024-09-12T01:39:08.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.174+0000 7f255a81e640 1 -- 172.21.15.60:0/4220826871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2554152d00 msgr2=0x7f25541f39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:08.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.174+0000 7f255a81e640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2554152d00 0x7f25541f39c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f25480115a0 tx=0x7f2548011a60 comp rx=0 tx=0).stop 2024-09-12T01:39:08.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.174+0000 7f255a81e640 1 -- 172.21.15.60:0/4220826871 shutdown_connections 2024-09-12T01:39:08.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.174+0000 7f255a81e640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f25540c88f0 0x7f25540c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.174+0000 7f255a81e640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2554152d00 0x7f25541f39c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.174+0000 7f255a81e640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f254006be60 0x7f254006e320 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.174+0000 7f255a81e640 1 --2- 172.21.15.60:0/4220826871 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f253c0051c0 0x7f25540d4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.174+0000 7f255a81e640 1 -- 172.21.15.60:0/4220826871 >> 172.21.15.60:0/4220826871 conn(0x7f25540d11e0 msgr2=0x7f25540b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:08.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.174+0000 7f255a81e640 1 -- 172.21.15.60:0/4220826871 shutdown_connections 2024-09-12T01:39:08.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.174+0000 7f255a81e640 1 -- 172.21.15.60:0/4220826871 wait complete. 2024-09-12T01:39:08.185 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:39:08.185 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:39:08.229 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:39:08.269 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:39:08.270 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:39:08.270 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:39:08.286 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:39:08.286 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:39:08.286 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:39:08.328 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:39:08.329 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:39:08.329 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:39:08.345 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:39:08.345 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:39:08.345 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:39:08.386 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:39:08.387 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:39:08.387 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:39:08.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.489+0000 7f85f49c4640 1 Processor -- start 2024-09-12T01:39:08.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.489+0000 7f85f49c4640 1 -- start start 2024-09-12T01:39:08.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.490+0000 7f85f49c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f015c2b0 0x7f85f00b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:08.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.490+0000 7f85f49c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f85f00b72f0 0x7f85f015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:08.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.490+0000 7f85f49c4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f015fb10 con 0x7f85f015f030 2024-09-12T01:39:08.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.490+0000 7f85f49c4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f85f00b5900 con 0x7f85f00b72f0 2024-09-12T01:39:08.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.490+0000 7f85f49c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f85f015f830 con 0x7f85f015c2b0 2024-09-12T01:39:08.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.490+0000 7f85e7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f85f00b72f0 0x7f85f015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:08.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.490+0000 7f85e7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f85f00b72f0 0x7f85f015eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47054/0 (socket says 172.21.15.60:47054) 2024-09-12T01:39:08.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.490+0000 7f85e7fff640 1 -- 172.21.15.60:0/2091219647 learned_addr learned my addr 172.21.15.60:0/2091219647 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:08.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.491+0000 7f85e7fff640 1 -- 172.21.15.60:0/2091219647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f015c2b0 msgr2=0x7f85f00b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:08.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.491+0000 7f85e7fff640 1 --2- 172.21.15.60:0/2091219647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f015c2b0 0x7f85f00b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.491+0000 7f85e7fff640 1 -- 172.21.15.60:0/2091219647 >> v1:172.21.15.105:6789/0 conn(0x7f85f015f030 legacy=0x7f85f006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:08.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.491+0000 7f85e7fff640 1 -- 172.21.15.60:0/2091219647 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f006ce30 con 0x7f85f00b72f0 2024-09-12T01:39:08.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.491+0000 7f85e7fff640 1 --2- 172.21.15.60:0/2091219647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f00b72f0 0x7f85f015eaf0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009870 tx=0x7f85d802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=238a3d5b835c36b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:08.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.491+0000 7f85edd9b640 1 -- 172.21.15.60:0/2091219647 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8037070 con 0x7f85f00b72f0 2024-09-12T01:39:08.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.492+0000 7f85edd9b640 1 -- 172.21.15.60:0/2091219647 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d8032440 con 0x7f85f00b72f0 2024-09-12T01:39:08.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.492+0000 7f85edd9b640 1 -- 172.21.15.60:0/2091219647 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8032810 con 0x7f85f00b72f0 2024-09-12T01:39:08.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.492+0000 7f85f49c4640 1 -- 172.21.15.60:0/2091219647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f00b72f0 msgr2=0x7f85f015eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:08.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.492+0000 7f85f49c4640 1 --2- 172.21.15.60:0/2091219647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f00b72f0 0x7f85f015eaf0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009870 tx=0x7f85d802a210 comp rx=0 tx=0).stop 2024-09-12T01:39:08.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.492+0000 7f85f49c4640 1 -- 172.21.15.60:0/2091219647 shutdown_connections 2024-09-12T01:39:08.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.492+0000 7f85f49c4640 1 --2- 172.21.15.60:0/2091219647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f00b72f0 0x7f85f015eaf0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.492+0000 7f85f49c4640 1 --2- 172.21.15.60:0/2091219647 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f015c2b0 0x7f85f00b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.492+0000 7f85f49c4640 1 -- 172.21.15.60:0/2091219647 >> 172.21.15.60:0/2091219647 conn(0x7f85f00b4240 msgr2=0x7f85f00b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:08.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.492+0000 7f85f49c4640 1 -- 172.21.15.60:0/2091219647 shutdown_connections 2024-09-12T01:39:08.493 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.492+0000 7f85f49c4640 1 -- 172.21.15.60:0/2091219647 wait complete. 2024-09-12T01:39:08.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.493+0000 7f85f49c4640 1 Processor -- start 2024-09-12T01:39:08.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.494+0000 7f85f49c4640 1 -- start start 2024-09-12T01:39:08.495 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.494+0000 7f85f49c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f00b72f0 0x7f85f01578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.494+0000 7f85f49c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f015c2b0 0x7f85f00d2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.494+0000 7f85f49c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f015f030 0x7f85f00d2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.494+0000 7f85f49c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f85f00b7730 con 0x7f85f00b72f0 2024-09-12T01:39:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.494+0000 7f85f49c4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f85f006d3f0 con 0x7f85f015f030 2024-09-12T01:39:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.494+0000 7f85f49c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f85f015f4e0 con 0x7f85f015c2b0 2024-09-12T01:39:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.494+0000 7f85ee59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f00b72f0 0x7f85f01578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.494+0000 7f85ee59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f00b72f0 0x7f85f01578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47064/0 (socket says 172.21.15.60:47064) 2024-09-12T01:39:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.494+0000 7f85ee59c640 1 -- 172.21.15.60:0/1852808939 learned_addr learned my addr 172.21.15.60:0/1852808939 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85e7fff640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f015c2b0 0x7f85f00d2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85eed9d640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f015f030 0x7f85f00d2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85ee59c640 1 -- 172.21.15.60:0/1852808939 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f015c2b0 msgr2=0x7f85f00d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85ee59c640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f015c2b0 0x7f85f00d2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85ee59c640 1 -- 172.21.15.60:0/1852808939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f015f030 msgr2=0x7f85f00d2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85ee59c640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f015f030 0x7f85f00d2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85ee59c640 1 -- 172.21.15.60:0/1852808939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f00cdbb0 con 0x7f85f00b72f0 2024-09-12T01:39:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85eed9d640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f015f030 0x7f85f00d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85ee59c640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f00b72f0 0x7f85f01578b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f85e000b4a0 tx=0x7f85e000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85e6ffd640 1 -- 172.21.15.60:0/1852808939 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0014070 con 0x7f85f00b72f0 2024-09-12T01:39:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85e6ffd640 1 -- 172.21.15.60:0/1852808939 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e0010610 con 0x7f85f00b72f0 2024-09-12T01:39:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85f49c4640 1 -- 172.21.15.60:0/1852808939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f00cde50 con 0x7f85f00b72f0 2024-09-12T01:39:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85e6ffd640 1 -- 172.21.15.60:0/1852808939 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0010a00 con 0x7f85f00b72f0 2024-09-12T01:39:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.495+0000 7f85f49c4640 1 -- 172.21.15.60:0/1852808939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f00ce410 con 0x7f85f00b72f0 2024-09-12T01:39:08.497 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.496+0000 7f85f49c4640 1 -- 172.21.15.60:0/1852808939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f015eaf0 con 0x7f85f00b72f0 2024-09-12T01:39:08.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.497+0000 7f85e6ffd640 1 -- 172.21.15.60:0/1852808939 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85e0017070 con 0x7f85f00b72f0 2024-09-12T01:39:08.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.497+0000 7f85e6ffd640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f85d006be30 0x7f85d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:08.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.497+0000 7f85e6ffd640 1 -- 172.21.15.60:0/1852808939 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4943+0+0 (secure 0 0 0) 0x7f85e008a540 con 0x7f85f00b72f0 2024-09-12T01:39:08.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.497+0000 7f85e7fff640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f85d006be30 0x7f85d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:08.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.498+0000 7f85e7fff640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f85d006be30 0x7f85d006e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f85d8034000 tx=0x7f85d802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:08.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.501+0000 7f85e6ffd640 1 -- 172.21.15.60:0/1852808939 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85e0059280 con 0x7f85f00b72f0 2024-09-12T01:39:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.713+0000 7f85f49c4640 1 -- 172.21.15.60:0/1852808939 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85f00717a0 con 0x7f85f00b72f0 2024-09-12T01:39:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.714+0000 7f85e6ffd640 1 -- 172.21.15.60:0/1852808939 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3911 (secure 0 0 0) 0x7f85e0058b80 con 0x7f85f00b72f0 2024-09-12T01:39:08.754 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:08.754 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":40,"btime":"2024-09-12T01:39:02:837964+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5551,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/672507371","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":672507371},{"type":"v1","addr":"172.21.15.60:6836","nonce":672507371}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5557,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6833/2426056287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2426056287},{"type":"v1","addr":"172.21.15.105:6833","nonce":2426056287}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5752,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1746906011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":1746906011},{"type":"v1","addr":"172.21.15.105:6835","nonce":1746906011}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5856,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/183879558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":183879558},{"type":"v1","addr":"172.21.15.60:6837","nonce":183879558}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[]} 2024-09-12T01:39:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 40 2024-09-12T01:39:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.716+0000 7f85f49c4640 1 -- 172.21.15.60:0/1852808939 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f85d006be30 msgr2=0x7f85d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.716+0000 7f85f49c4640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f85d006be30 0x7f85d006e2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f85d8034000 tx=0x7f85d802e000 comp rx=0 tx=0).stop 2024-09-12T01:39:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.716+0000 7f85f49c4640 1 -- 172.21.15.60:0/1852808939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f00b72f0 msgr2=0x7f85f01578b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.716+0000 7f85f49c4640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f00b72f0 0x7f85f01578b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f85e000b4a0 tx=0x7f85e000b960 comp rx=0 tx=0).stop 2024-09-12T01:39:08.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.716+0000 7f85f49c4640 1 -- 172.21.15.60:0/1852808939 shutdown_connections 2024-09-12T01:39:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.716+0000 7f85f49c4640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f015f030 0x7f85f00d2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.716+0000 7f85f49c4640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f85d006be30 0x7f85d006e2f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.716+0000 7f85f49c4640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f015c2b0 0x7f85f00d2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.716+0000 7f85f49c4640 1 --2- 172.21.15.60:0/1852808939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f00b72f0 0x7f85f01578b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.716+0000 7f85f49c4640 1 -- 172.21.15.60:0/1852808939 >> 172.21.15.60:0/1852808939 conn(0x7f85f00b4240 msgr2=0x7f85f00b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.716+0000 7f85f49c4640 1 -- 172.21.15.60:0/1852808939 shutdown_connections 2024-09-12T01:39:08.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.716+0000 7f85f49c4640 1 -- 172.21.15.60:0/1852808939 wait complete. 2024-09-12T01:39:08.757 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:39:08.757 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:39:08.757 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:39:08.757 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:08.757 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:39:08.757 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:39:08.757 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:39:08.757 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:08.758 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:39:08.758 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:39:08.758 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:39:08.758 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:08.758 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:39:08.758 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:39:08.758 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:39:08.758 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:08.767 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:39:08.767 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:39:08.768 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:39:08.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:39:08.770 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:39:08.770 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:39:08.772 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:39:08.772 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:39:08.811 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:39:08.811 DEBUG:teuthology.parallel:result is None 2024-09-12T01:39:08.813 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:39:08.813 DEBUG:teuthology.parallel:result is None 2024-09-12T01:39:08.816 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:39:08.816 DEBUG:teuthology.parallel:result is None 2024-09-12T01:39:08.818 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:39:08.818 DEBUG:teuthology.parallel:result is None 2024-09-12T01:39:08.819 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:39:08.889 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2024-09-12T01:39:08.890 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2024-09-12T01:39:08.897 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:39:08.897 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:39:08.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.929+0000 7f214af18640 1 Processor -- start 2024-09-12T01:39:08.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.930+0000 7f214af18640 1 -- start start 2024-09-12T01:39:08.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.930+0000 7f214af18640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f214415e7a0 0x7f214406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:08.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.930+0000 7f214af18640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21440b68f0 0x7f21440d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:08.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.930+0000 7f214af18640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21440cf860 con 0x7f21440cf1f0 2024-09-12T01:39:08.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.930+0000 7f214af18640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f21440d2ca0 con 0x7f21440b68f0 2024-09-12T01:39:08.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.930+0000 7f214af18640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f21440cfb40 con 0x7f214415e7a0 2024-09-12T01:39:08.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.930+0000 7f21494b5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21440b68f0 0x7f21440d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:08.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.931+0000 7f2143fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f21440cf1f0 0x7f21440b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34974/0 (socket says 172.21.15.60:34974) 2024-09-12T01:39:08.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.931+0000 7f21494b5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21440b68f0 0x7f21440d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47086/0 (socket says 172.21.15.60:47086) 2024-09-12T01:39:08.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.931+0000 7f2143fff640 1 -- 172.21.15.60:0/1391837375 learned_addr learned my addr 172.21.15.60:0/1391837375 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:08.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.931+0000 7f2148cb4640 1 --2- 172.21.15.60:0/1391837375 >> v2:172.21.15.105:3300/0 conn(0x7f214415e7a0 0x7f214406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:08.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.931+0000 7f21494b5640 1 -- 172.21.15.60:0/1391837375 >> v2:172.21.15.105:3300/0 conn(0x7f214415e7a0 msgr2=0x7f214406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:08.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.931+0000 7f21494b5640 1 --2- 172.21.15.60:0/1391837375 >> v2:172.21.15.105:3300/0 conn(0x7f214415e7a0 0x7f214406caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.931+0000 7f21494b5640 1 -- 172.21.15.60:0/1391837375 >> v1:172.21.15.60:6789/0 conn(0x7f21440cf1f0 legacy=0x7f21440b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:08.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.931+0000 7f21437fe640 1 -- 172.21.15.60:0/1391837375 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949291477 0 0) 0x7f21440cf860 con 0x7f21440cf1f0 2024-09-12T01:39:08.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.931+0000 7f21494b5640 1 -- 172.21.15.60:0/1391837375 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21440cfe20 con 0x7f21440b68f0 2024-09-12T01:39:08.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.932+0000 7f21494b5640 1 --2- 172.21.15.60:0/1391837375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440b68f0 0x7f21440d3410 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f21440d5820 tx=0x7f213c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b57f473c9b79c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:08.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.932+0000 7f21437fe640 1 -- 172.21.15.60:0/1391837375 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c007740 con 0x7f21440b68f0 2024-09-12T01:39:08.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.932+0000 7f21437fe640 1 -- 172.21.15.60:0/1391837375 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f213c0078e0 con 0x7f21440b68f0 2024-09-12T01:39:08.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.932+0000 7f21437fe640 1 -- 172.21.15.60:0/1391837375 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213c007cb0 con 0x7f21440b68f0 2024-09-12T01:39:08.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.932+0000 7f214af18640 1 -- 172.21.15.60:0/1391837375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440b68f0 msgr2=0x7f21440d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.932+0000 7f214af18640 1 --2- 172.21.15.60:0/1391837375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440b68f0 0x7f21440d3410 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f21440d5820 tx=0x7f213c02a5f0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.932+0000 7f214af18640 1 -- 172.21.15.60:0/1391837375 shutdown_connections 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.932+0000 7f214af18640 1 --2- 172.21.15.60:0/1391837375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440b68f0 0x7f21440d3410 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.932+0000 7f214af18640 1 --2- 172.21.15.60:0/1391837375 >> v2:172.21.15.105:3300/0 conn(0x7f214415e7a0 0x7f214406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.932+0000 7f214af18640 1 -- 172.21.15.60:0/1391837375 >> 172.21.15.60:0/1391837375 conn(0x7f21440d11e0 msgr2=0x7f21440d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.932+0000 7f214af18640 1 -- 172.21.15.60:0/1391837375 shutdown_connections 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.932+0000 7f214af18640 1 -- 172.21.15.60:0/1391837375 wait complete. 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.934+0000 7f214af18640 1 Processor -- start 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.934+0000 7f214af18640 1 -- start start 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.934+0000 7f214af18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440b68f0 0x7f21440ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.934+0000 7f214af18640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21440cf1f0 0x7f21441f7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.934+0000 7f214af18640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214415e7a0 0x7f21441f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:08.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.934+0000 7f214af18640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f214406cfe0 con 0x7f21440b68f0 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.934+0000 7f214af18640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21440b7a00 con 0x7f214415e7a0 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.934+0000 7f214af18640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f214415eb80 con 0x7f21440cf1f0 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f2148cb4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440b68f0 0x7f21440ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f2148cb4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440b68f0 0x7f21440ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47098/0 (socket says 172.21.15.60:47098) 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f2148cb4640 1 -- 172.21.15.60:0/3451980518 learned_addr learned my addr 172.21.15.60:0/3451980518 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f2148cb4640 1 -- 172.21.15.60:0/3451980518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21440cf1f0 msgr2=0x7f21441f7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f2148cb4640 1 --2- 172.21.15.60:0/3451980518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21440cf1f0 0x7f21441f7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f2148cb4640 1 -- 172.21.15.60:0/3451980518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214415e7a0 msgr2=0x7f21441f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f2148cb4640 1 --2- 172.21.15.60:0/3451980518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214415e7a0 0x7f21441f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f2148cb4640 1 -- 172.21.15.60:0/3451980518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21441f50c0 con 0x7f21440b68f0 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f2148cb4640 1 --2- 172.21.15.60:0/3451980518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440b68f0 0x7f21440ccb50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f213400d830 tx=0x7f213400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f21417fa640 1 -- 172.21.15.60:0/3451980518 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213400b6c0 con 0x7f21440b68f0 2024-09-12T01:39:08.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f21417fa640 1 -- 172.21.15.60:0/3451980518 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2134019070 con 0x7f21440b68f0 2024-09-12T01:39:08.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f214af18640 1 -- 172.21.15.60:0/3451980518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21440cd160 con 0x7f21440b68f0 2024-09-12T01:39:08.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f21417fa640 1 -- 172.21.15.60:0/3451980518 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f213400ba80 con 0x7f21440b68f0 2024-09-12T01:39:08.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.935+0000 7f214af18640 1 -- 172.21.15.60:0/3451980518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21440cd720 con 0x7f21440b68f0 2024-09-12T01:39:08.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.936+0000 7f214af18640 1 -- 172.21.15.60:0/3451980518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f214406caa0 con 0x7f21440b68f0 2024-09-12T01:39:08.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.937+0000 7f21417fa640 1 -- 172.21.15.60:0/3451980518 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f213400bc20 con 0x7f21440b68f0 2024-09-12T01:39:08.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.937+0000 7f21417fa640 1 --2- 172.21.15.60:0/3451980518 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f213006be30 0x7f213006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:08.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.937+0000 7f21417fa640 1 -- 172.21.15.60:0/3451980518 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 4943+0+0 (secure 0 0 0) 0x7f213408b070 con 0x7f21440b68f0 2024-09-12T01:39:08.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.938+0000 7f2143fff640 1 --2- 172.21.15.60:0/3451980518 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f213006be30 0x7f213006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:08.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.938+0000 7f2143fff640 1 --2- 172.21.15.60:0/3451980518 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f213006be30 0x7f213006e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2138007fd0 tx=0x7f2138007920 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:08.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:08.942+0000 7f21417fa640 1 -- 172.21.15.60:0/3451980518 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2134059d20 con 0x7f21440b68f0 2024-09-12T01:39:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:09.133+0000 7f214af18640 1 -- 172.21.15.60:0/3451980518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f21440d54c0 con 0x7f21440b68f0 2024-09-12T01:39:10.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.198+0000 7f21417fa640 1 -- 172.21.15.60:0/3451980518 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v76) ==== 97+0+0 (secure 0 0 0) 0x7f2134059620 con 0x7f21440b68f0 2024-09-12T01:39:10.198 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2024-09-12T01:39:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.202+0000 7f214af18640 1 -- 172.21.15.60:0/3451980518 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f213006be30 msgr2=0x7f213006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.202+0000 7f214af18640 1 --2- 172.21.15.60:0/3451980518 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f213006be30 0x7f213006e2f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2138007fd0 tx=0x7f2138007920 comp rx=0 tx=0).stop 2024-09-12T01:39:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.202+0000 7f214af18640 1 -- 172.21.15.60:0/3451980518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440b68f0 msgr2=0x7f21440ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.202+0000 7f214af18640 1 --2- 172.21.15.60:0/3451980518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440b68f0 0x7f21440ccb50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f213400d830 tx=0x7f213400dcf0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.202+0000 7f214af18640 1 -- 172.21.15.60:0/3451980518 shutdown_connections 2024-09-12T01:39:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.202+0000 7f214af18640 1 --2- 172.21.15.60:0/3451980518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214415e7a0 0x7f21441f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.202+0000 7f214af18640 1 --2- 172.21.15.60:0/3451980518 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f213006be30 0x7f213006e2f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.202+0000 7f214af18640 1 --2- 172.21.15.60:0/3451980518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21440cf1f0 0x7f21441f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.202+0000 7f214af18640 1 --2- 172.21.15.60:0/3451980518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440b68f0 0x7f21440ccb50 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.202+0000 7f214af18640 1 -- 172.21.15.60:0/3451980518 >> 172.21.15.60:0/3451980518 conn(0x7f21440d11e0 msgr2=0x7f21440b7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.202+0000 7f214af18640 1 -- 172.21.15.60:0/3451980518 shutdown_connections 2024-09-12T01:39:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.203+0000 7f214af18640 1 -- 172.21.15.60:0/3451980518 wait complete. 2024-09-12T01:39:10.215 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:39:10.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.325+0000 7f824660e640 1 Processor -- start 2024-09-12T01:39:10.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.325+0000 7f824660e640 1 -- start start 2024-09-12T01:39:10.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f824660e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f82400b63d0 0x7f82400d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f824660e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f82400cf6b0 0x7f82400b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f824660e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82400d1c80 0x7f82400b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f824660e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f82400b8300 con 0x7f82400cf6b0 2024-09-12T01:39:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f824660e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f82400cfc20 con 0x7f82400b63d0 2024-09-12T01:39:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f824660e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f82400d2ed0 con 0x7f82400d1c80 2024-09-12T01:39:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f823f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f82400cf6b0 0x7f82400b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f823f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f82400cf6b0 0x7f82400b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47108/0 (socket says 172.21.15.60:47108) 2024-09-12T01:39:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f823f7fe640 1 -- 172.21.15.60:0/3235817974 learned_addr learned my addr 172.21.15.60:0/3235817974 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f823ffff640 1 --2- 172.21.15.60:0/3235817974 >> v2:172.21.15.105:3300/0 conn(0x7f82400b63d0 0x7f82400d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f8244bab640 1 --2- 172.21.15.60:0/3235817974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82400d1c80 0x7f82400b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f823f7fe640 1 -- 172.21.15.60:0/3235817974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82400d1c80 msgr2=0x7f82400b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f823f7fe640 1 --2- 172.21.15.60:0/3235817974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82400d1c80 0x7f82400b7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f823f7fe640 1 -- 172.21.15.60:0/3235817974 >> v2:172.21.15.105:3300/0 conn(0x7f82400b63d0 msgr2=0x7f82400d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f823f7fe640 1 --2- 172.21.15.60:0/3235817974 >> v2:172.21.15.105:3300/0 conn(0x7f82400b63d0 0x7f82400d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f823f7fe640 1 -- 172.21.15.60:0/3235817974 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82400d31b0 con 0x7f82400cf6b0 2024-09-12T01:39:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f823ffff640 1 --2- 172.21.15.60:0/3235817974 >> v2:172.21.15.105:3300/0 conn(0x7f82400b63d0 0x7f82400d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:10.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.326+0000 7f8244bab640 1 --2- 172.21.15.60:0/3235817974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82400d1c80 0x7f82400b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.327+0000 7f823f7fe640 1 --2- 172.21.15.60:0/3235817974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82400cf6b0 0x7f82400b7880 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8240050260 tx=0x7f823402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e754d74c48b5df64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.327+0000 7f823effd640 1 -- 172.21.15.60:0/3235817974 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234037070 con 0x7f82400cf6b0 2024-09-12T01:39:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.327+0000 7f823effd640 1 -- 172.21.15.60:0/3235817974 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8234032440 con 0x7f82400cf6b0 2024-09-12T01:39:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.327+0000 7f823effd640 1 -- 172.21.15.60:0/3235817974 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234032810 con 0x7f82400cf6b0 2024-09-12T01:39:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.327+0000 7f824660e640 1 -- 172.21.15.60:0/3235817974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82400cf6b0 msgr2=0x7f82400b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.327+0000 7f824660e640 1 --2- 172.21.15.60:0/3235817974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82400cf6b0 0x7f82400b7880 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8240050260 tx=0x7f823402a140 comp rx=0 tx=0).stop 2024-09-12T01:39:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.328+0000 7f824660e640 1 -- 172.21.15.60:0/3235817974 shutdown_connections 2024-09-12T01:39:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.328+0000 7f824660e640 1 --2- 172.21.15.60:0/3235817974 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82400d1c80 0x7f82400b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.328+0000 7f824660e640 1 --2- 172.21.15.60:0/3235817974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82400cf6b0 0x7f82400b7880 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.328+0000 7f824660e640 1 --2- 172.21.15.60:0/3235817974 >> v2:172.21.15.105:3300/0 conn(0x7f82400b63d0 0x7f82400d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.328+0000 7f824660e640 1 -- 172.21.15.60:0/3235817974 >> 172.21.15.60:0/3235817974 conn(0x7f82400d1160 msgr2=0x7f82400d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.328+0000 7f824660e640 1 -- 172.21.15.60:0/3235817974 shutdown_connections 2024-09-12T01:39:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.328+0000 7f824660e640 1 -- 172.21.15.60:0/3235817974 wait complete. 2024-09-12T01:39:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.329+0000 7f824660e640 1 Processor -- start 2024-09-12T01:39:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.329+0000 7f824660e640 1 -- start start 2024-09-12T01:39:10.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f824660e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82400b63d0 0x7f82401e8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f824660e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82400cf6b0 0x7f8240152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f824660e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82400d1c80 0x7f82401ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f824660e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f82400cb5c0 con 0x7f82400b63d0 2024-09-12T01:39:10.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f824660e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f82400cb440 con 0x7f82400cf6b0 2024-09-12T01:39:10.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f824660e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f82400d3ef0 con 0x7f82400d1c80 2024-09-12T01:39:10.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f823ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82400b63d0 0x7f82401e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f823ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82400b63d0 0x7f82401e8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47124/0 (socket says 172.21.15.60:47124) 2024-09-12T01:39:10.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f823ffff640 1 -- 172.21.15.60:0/1019345679 learned_addr learned my addr 172.21.15.60:0/1019345679 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:10.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f8244bab640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82400d1c80 0x7f82401ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f823f7fe640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82400cf6b0 0x7f8240152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f823ffff640 1 -- 172.21.15.60:0/1019345679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82400d1c80 msgr2=0x7f82401ea2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f823ffff640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82400d1c80 0x7f82401ea2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f823ffff640 1 -- 172.21.15.60:0/1019345679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82400cf6b0 msgr2=0x7f8240152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f823ffff640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82400cf6b0 0x7f8240152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f823ffff640 1 -- 172.21.15.60:0/1019345679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82401e8680 con 0x7f82400b63d0 2024-09-12T01:39:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.330+0000 7f823ffff640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82400b63d0 0x7f82401e8140 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f823000c820 tx=0x7f823000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.331+0000 7f823cff9640 1 -- 172.21.15.60:0/1019345679 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230015070 con 0x7f82400b63d0 2024-09-12T01:39:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.331+0000 7f823cff9640 1 -- 172.21.15.60:0/1019345679 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8230007a30 con 0x7f82400b63d0 2024-09-12T01:39:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.331+0000 7f823cff9640 1 -- 172.21.15.60:0/1019345679 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8230007e20 con 0x7f82400b63d0 2024-09-12T01:39:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.331+0000 7f824660e640 1 -- 172.21.15.60:0/1019345679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8240152f70 con 0x7f82400b63d0 2024-09-12T01:39:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.331+0000 7f824660e640 1 -- 172.21.15.60:0/1019345679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82401e8c00 con 0x7f82400b63d0 2024-09-12T01:39:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.332+0000 7f824660e640 1 -- 172.21.15.60:0/1019345679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82400d06c0 con 0x7f82400b63d0 2024-09-12T01:39:10.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.332+0000 7f823cff9640 1 -- 172.21.15.60:0/1019345679 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8230018070 con 0x7f82400b63d0 2024-09-12T01:39:10.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.332+0000 7f823cff9640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f822c06be30 0x7f822c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.333+0000 7f823cff9640 1 -- 172.21.15.60:0/1019345679 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 4857+0+0 (secure 0 0 0) 0x7f823008a970 con 0x7f82400b63d0 2024-09-12T01:39:10.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.333+0000 7f823f7fe640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f822c06be30 0x7f822c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.333+0000 7f823f7fe640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f822c06be30 0x7f822c06e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8234034000 tx=0x7f823402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:10.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.337+0000 7f823cff9640 1 -- 172.21.15.60:0/1019345679 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f82400d06c0 con 0x7f82400b63d0 2024-09-12T01:39:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.576+0000 7f824660e640 1 -- 172.21.15.60:0/1019345679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f82400cf280 con 0x7f82400b63d0 2024-09-12T01:39:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.577+0000 7f823cff9640 1 -- 172.21.15.60:0/1019345679 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f8230058fa0 con 0x7f82400b63d0 2024-09-12T01:39:10.576 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmIK3fKxAAM9RkghDZwJZWuKouIbObDw==", 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmzqHZNxAAnhCo4gGwLgYDVzzYnoiDFA==", 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmksMWMxAAp3xMDD09rfphgPZwQcEABA==", 2024-09-12T01:39:10.578 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmvLw/AxAApd4hl5LRD1QddnPPjRw2Kg==", 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:39:10.579 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA7ReJmc3D/JxAAXiw6n1Q3n9sCXln6YSiCBA==", 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2024-09-12T01:39:10.580 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA/ReJmEOu3CxAA4uu1neLh0mpeG9nia+/VqQ==", 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBCReJm3HHtDhAAoAdKVsjuXmpcf5R5zTtFKg==", 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.581 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBFReJmtRLuIBAA/BBibpGfpXsFXqVjVrmXWA==", 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2024-09-12T01:39:10.582 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBMReJmdDNXKhAAeh5aCvMw+70z3tnwjb9Hjg==", 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBQReJm/tsIHRAAmgx+5WifY/VITGHAbUV2CQ==", 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBUReJmQFaBHhAA1vH01tePCoJQFXlHB5gcVg==", 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBYReJmTHqLAhAAtUB94Pa3eihlVdaupZ8Ggg==", 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.584 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ==", 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.585 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmTopGEBAAY0K3iZm2PotQc8a489uO/Q==", 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmqUgQDRAAAp5SAwNM9aSxZ1VVRwroNA==", 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:39:10.586 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmGfzeFRAAE2xCnzeyX/KBo3NBrkixYQ==", 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2024-09-12T01:39:10.587 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmOfXYDxAA0hydSyRvFmmNvFcRwPaXqg==", 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmjpyMKBAAMSGgYJddHs7TtCV0NszZAQ==", 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:39:10.588 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJm3Ei+JBAAhwgXWq0baTlDtaLedcaHmg==", 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T01:39:10.589 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:39:10.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.579+0000 7f824660e640 1 -- 172.21.15.60:0/1019345679 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f822c06be30 msgr2=0x7f822c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.579+0000 7f824660e640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f822c06be30 0x7f822c06e2f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8234034000 tx=0x7f823402e000 comp rx=0 tx=0).stop 2024-09-12T01:39:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.579+0000 7f824660e640 1 -- 172.21.15.60:0/1019345679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82400b63d0 msgr2=0x7f82401e8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.579+0000 7f824660e640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82400b63d0 0x7f82401e8140 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f823000c820 tx=0x7f823000cce0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.579+0000 7f824660e640 1 -- 172.21.15.60:0/1019345679 shutdown_connections 2024-09-12T01:39:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.579+0000 7f824660e640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f822c06be30 0x7f822c06e2f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.579+0000 7f824660e640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82400d1c80 0x7f82401ea2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.579+0000 7f824660e640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82400cf6b0 0x7f8240152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.579+0000 7f824660e640 1 --2- 172.21.15.60:0/1019345679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82400b63d0 0x7f82401e8140 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.579+0000 7f824660e640 1 -- 172.21.15.60:0/1019345679 >> 172.21.15.60:0/1019345679 conn(0x7f82400d1160 msgr2=0x7f82400d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.579+0000 7f824660e640 1 -- 172.21.15.60:0/1019345679 shutdown_connections 2024-09-12T01:39:10.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.579+0000 7f824660e640 1 -- 172.21.15.60:0/1019345679 wait complete. 2024-09-12T01:39:10.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:39:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.696+0000 7f856d653640 1 Processor -- start 2024-09-12T01:39:10.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.696+0000 7f856d653640 1 -- start start 2024-09-12T01:39:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.696+0000 7f856d653640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f856815c550 0x7f85680715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.696+0000 7f856d653640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f85680b6e10 0x7f85680b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.696+0000 7f856d653640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85680d0270 con 0x7f8568073160 2024-09-12T01:39:10.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.696+0000 7f856d653640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f856815c930 con 0x7f856815c550 2024-09-12T01:39:10.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.696+0000 7f856d653640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f85680d04f0 con 0x7f85680b6e10 2024-09-12T01:39:10.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.697+0000 7f8566ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f856815c550 0x7f85680715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.697+0000 7f8566ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f856815c550 0x7f85680715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47128/0 (socket says 172.21.15.60:47128) 2024-09-12T01:39:10.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.697+0000 7f8566ffd640 1 -- 172.21.15.60:0/3054608765 learned_addr learned my addr 172.21.15.60:0/3054608765 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:10.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.697+0000 7f85667fc640 1 --2- 172.21.15.60:0/3054608765 >> v2:172.21.15.105:3300/0 conn(0x7f85680b6e10 0x7f85680b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.697+0000 7f8566ffd640 1 -- 172.21.15.60:0/3054608765 >> v2:172.21.15.105:3300/0 conn(0x7f85680b6e10 msgr2=0x7f85680b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:10.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.697+0000 7f8566ffd640 1 --2- 172.21.15.60:0/3054608765 >> v2:172.21.15.105:3300/0 conn(0x7f85680b6e10 0x7f85680b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.697+0000 7f8566ffd640 1 -- 172.21.15.60:0/3054608765 >> v1:172.21.15.105:6789/0 conn(0x7f8568073160 legacy=0x7f85680d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:10.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.697+0000 7f8566ffd640 1 -- 172.21.15.60:0/3054608765 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85680b7580 con 0x7f856815c550 2024-09-12T01:39:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.698+0000 7f8566ffd640 1 --2- 172.21.15.60:0/3054608765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f856815c550 0x7f85680715e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f85680b2160 tx=0x7f855802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b23c35c255138eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:10.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.698+0000 7f8565ffb640 1 -- 172.21.15.60:0/3054608765 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558037070 con 0x7f856815c550 2024-09-12T01:39:10.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.698+0000 7f8565ffb640 1 -- 172.21.15.60:0/3054608765 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8558032440 con 0x7f856815c550 2024-09-12T01:39:10.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.698+0000 7f8565ffb640 1 -- 172.21.15.60:0/3054608765 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8558032810 con 0x7f856815c550 2024-09-12T01:39:10.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.698+0000 7f856d653640 1 -- 172.21.15.60:0/3054608765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f856815c550 msgr2=0x7f85680715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:10.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.698+0000 7f856d653640 1 --2- 172.21.15.60:0/3054608765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f856815c550 0x7f85680715e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f85680b2160 tx=0x7f855802a230 comp rx=0 tx=0).stop 2024-09-12T01:39:10.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.698+0000 7f856d653640 1 -- 172.21.15.60:0/3054608765 shutdown_connections 2024-09-12T01:39:10.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.698+0000 7f856d653640 1 --2- 172.21.15.60:0/3054608765 >> v2:172.21.15.105:3300/0 conn(0x7f85680b6e10 0x7f85680b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.698+0000 7f856d653640 1 --2- 172.21.15.60:0/3054608765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f856815c550 0x7f85680715e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.698+0000 7f856d653640 1 -- 172.21.15.60:0/3054608765 >> 172.21.15.60:0/3054608765 conn(0x7f85680b4240 msgr2=0x7f85680b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:10.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.698+0000 7f856d653640 1 -- 172.21.15.60:0/3054608765 shutdown_connections 2024-09-12T01:39:10.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.698+0000 7f856d653640 1 -- 172.21.15.60:0/3054608765 wait complete. 2024-09-12T01:39:10.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.700+0000 7f856d653640 1 Processor -- start 2024-09-12T01:39:10.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.700+0000 7f856d653640 1 -- start start 2024-09-12T01:39:10.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.700+0000 7f856d653640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8568073160 0x7f8568149ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.700+0000 7f856d653640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85680b6e10 0x7f85681498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.700+0000 7f856d653640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f856815c550 0x7f856814bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.700+0000 7f856d653640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f85680b7280 con 0x7f85680b6e10 2024-09-12T01:39:10.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.700+0000 7f856d653640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f85680d07b0 con 0x7f856815c550 2024-09-12T01:39:10.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.700+0000 7f856d653640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f85680b5a80 con 0x7f8568073160 2024-09-12T01:39:10.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f85667fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85680b6e10 0x7f85681498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f8566ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8568073160 0x7f8568149ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f85667fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85680b6e10 0x7f85681498f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47130/0 (socket says 172.21.15.60:47130) 2024-09-12T01:39:10.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f8566ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8568073160 0x7f8568149ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:60206/0 (socket says 172.21.15.60:60206) 2024-09-12T01:39:10.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f85667fc640 1 -- 172.21.15.60:0/3749375435 learned_addr learned my addr 172.21.15.60:0/3749375435 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:10.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f85677fe640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f856815c550 0x7f856814bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f85667fc640 1 -- 172.21.15.60:0/3749375435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8568073160 msgr2=0x7f8568149ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:10.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f85667fc640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8568073160 0x7f8568149ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f85667fc640 1 -- 172.21.15.60:0/3749375435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f856815c550 msgr2=0x7f856814bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:10.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f85667fc640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f856815c550 0x7f856814bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f85667fc640 1 -- 172.21.15.60:0/3749375435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f856814ac10 con 0x7f85680b6e10 2024-09-12T01:39:10.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f85667fc640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85680b6e10 0x7f85681498f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f855c00d800 tx=0x7f855c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:10.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f854f7fe640 1 -- 172.21.15.60:0/3749375435 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c00b6c0 con 0x7f85680b6e10 2024-09-12T01:39:10.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f854f7fe640 1 -- 172.21.15.60:0/3749375435 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f855c019070 con 0x7f85680b6e10 2024-09-12T01:39:10.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f856d653640 1 -- 172.21.15.60:0/3749375435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f856814aef0 con 0x7f85680b6e10 2024-09-12T01:39:10.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.701+0000 7f854f7fe640 1 -- 172.21.15.60:0/3749375435 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c00ba80 con 0x7f85680b6e10 2024-09-12T01:39:10.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.702+0000 7f856d653640 1 -- 172.21.15.60:0/3749375435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f856814b4b0 con 0x7f85680b6e10 2024-09-12T01:39:10.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.702+0000 7f856d653640 1 -- 172.21.15.60:0/3749375435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85680b5540 con 0x7f85680b6e10 2024-09-12T01:39:10.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.703+0000 7f854f7fe640 1 -- 172.21.15.60:0/3749375435 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f855c00bc20 con 0x7f85680b6e10 2024-09-12T01:39:10.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.704+0000 7f854f7fe640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f855406be30 0x7f855406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:10.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.704+0000 7f854f7fe640 1 -- 172.21.15.60:0/3749375435 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 4857+0+0 (secure 0 0 0) 0x7f855c08add0 con 0x7f85680b6e10 2024-09-12T01:39:10.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.704+0000 7f8566ffd640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f855406be30 0x7f855406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:10.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.704+0000 7f8566ffd640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f855406be30 0x7f855406e2f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8558034000 tx=0x7f855802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:10.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.708+0000 7f854f7fe640 1 -- 172.21.15.60:0/3749375435 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f855c059510 con 0x7f85680b6e10 2024-09-12T01:39:10.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.886+0000 7f856d653640 1 -- 172.21.15.60:0/3749375435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f85680d19d0 con 0x7f85680b6e10 2024-09-12T01:39:10.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.886+0000 7f854f7fe640 1 -- 172.21.15.60:0/3749375435 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7f855c08c090 con 0x7f85680b6e10 2024-09-12T01:39:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:10.886 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T01:39:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:39:10.886 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T01:39:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T01:39:10.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:39:10.887 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T01:39:10.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.888+0000 7f856d653640 1 -- 172.21.15.60:0/3749375435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f855406be30 msgr2=0x7f855406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:10.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.888+0000 7f856d653640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f855406be30 0x7f855406e2f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8558034000 tx=0x7f855802e000 comp rx=0 tx=0).stop 2024-09-12T01:39:10.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.888+0000 7f856d653640 1 -- 172.21.15.60:0/3749375435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85680b6e10 msgr2=0x7f85681498f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:10.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.888+0000 7f856d653640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85680b6e10 0x7f85681498f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f855c00d800 tx=0x7f855c00dcc0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.888+0000 7f856d653640 1 -- 172.21.15.60:0/3749375435 shutdown_connections 2024-09-12T01:39:10.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.888+0000 7f856d653640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f856815c550 0x7f856814bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.888+0000 7f856d653640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85680b6e10 0x7f85681498f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.888+0000 7f856d653640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f855406be30 0x7f855406e2f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.888+0000 7f856d653640 1 --2- 172.21.15.60:0/3749375435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8568073160 0x7f8568149ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:10.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.888+0000 7f856d653640 1 -- 172.21.15.60:0/3749375435 >> 172.21.15.60:0/3749375435 conn(0x7f85680b4240 msgr2=0x7f85680d2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:10.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.888+0000 7f856d653640 1 -- 172.21.15.60:0/3749375435 shutdown_connections 2024-09-12T01:39:10.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:10.888+0000 7f856d653640 1 -- 172.21.15.60:0/3749375435 wait complete. 2024-09-12T01:39:10.898 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:39:10.899 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:39:11.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.005+0000 7f9bee08c640 1 Processor -- start 2024-09-12T01:39:11.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.005+0000 7f9bee08c640 1 -- start start 2024-09-12T01:39:11.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.006+0000 7f9bee08c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9be8161be0 0x7f9be8162d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:11.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.006+0000 7f9bee08c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9be80b3360 0x7f9be80d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:11.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.006+0000 7f9bee08c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be80cfe70 con 0x7f9be80d1ab0 2024-09-12T01:39:11.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.006+0000 7f9bee08c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9be81632d0 con 0x7f9be8161be0 2024-09-12T01:39:11.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.006+0000 7f9bee08c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9be80cedd0 con 0x7f9be80b3360 2024-09-12T01:39:11.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.006+0000 7f9be77fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9be8161be0 0x7f9be8162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:11.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.006+0000 7f9be6ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9be80b3360 0x7f9be80d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:11.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.006+0000 7f9be77fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9be8161be0 0x7f9be8162d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:55074/0 (socket says 172.21.15.60:55074) 2024-09-12T01:39:11.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.006+0000 7f9be77fe640 1 -- 172.21.15.60:0/348749079 learned_addr learned my addr 172.21.15.60:0/348749079 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:11.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.006+0000 7f9be7fff640 1 --1- 172.21.15.60:0/348749079 >> v1:172.21.15.105:6789/0 conn(0x7f9be80d1ab0 0x7f9be80b6160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:52004/0 (socket says 172.21.15.60:52004) 2024-09-12T01:39:11.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.007+0000 7f9be77fe640 1 -- 172.21.15.60:0/348749079 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9be80b3360 msgr2=0x7f9be80d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:11.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.007+0000 7f9be77fe640 1 --2- 172.21.15.60:0/348749079 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9be80b3360 0x7f9be80d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:11.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.007+0000 7f9be77fe640 1 -- 172.21.15.60:0/348749079 >> v1:172.21.15.105:6789/0 conn(0x7f9be80d1ab0 legacy=0x7f9be80b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:11.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.007+0000 7f9be77fe640 1 -- 172.21.15.60:0/348749079 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be80cf0b0 con 0x7f9be8161be0 2024-09-12T01:39:11.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.007+0000 7f9be6ffd640 1 --2- 172.21.15.60:0/348749079 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9be80b3360 0x7f9be80d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:39:11.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.007+0000 7f9be77fe640 1 --2- 172.21.15.60:0/348749079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be8161be0 0x7f9be8162d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009870 tx=0x7f9bd802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2698f0d1eb71bd98 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:11.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.008+0000 7f9be67fc640 1 -- 172.21.15.60:0/348749079 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8037070 con 0x7f9be8161be0 2024-09-12T01:39:11.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.008+0000 7f9be67fc640 1 -- 172.21.15.60:0/348749079 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd8032440 con 0x7f9be8161be0 2024-09-12T01:39:11.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.008+0000 7f9be67fc640 1 -- 172.21.15.60:0/348749079 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8032810 con 0x7f9be8161be0 2024-09-12T01:39:11.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.008+0000 7f9bee08c640 1 -- 172.21.15.60:0/348749079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be8161be0 msgr2=0x7f9be8162d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:11.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.008+0000 7f9bee08c640 1 --2- 172.21.15.60:0/348749079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be8161be0 0x7f9be8162d90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009870 tx=0x7f9bd802a1c0 comp rx=0 tx=0).stop 2024-09-12T01:39:11.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.008+0000 7f9bee08c640 1 -- 172.21.15.60:0/348749079 shutdown_connections 2024-09-12T01:39:11.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.008+0000 7f9bee08c640 1 --2- 172.21.15.60:0/348749079 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9be80b3360 0x7f9be80d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:11.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.008+0000 7f9bee08c640 1 --2- 172.21.15.60:0/348749079 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be8161be0 0x7f9be8162d90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:11.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.008+0000 7f9bee08c640 1 -- 172.21.15.60:0/348749079 >> 172.21.15.60:0/348749079 conn(0x7f9be806c2c0 msgr2=0x7f9be806c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:11.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.008+0000 7f9bee08c640 1 -- 172.21.15.60:0/348749079 shutdown_connections 2024-09-12T01:39:11.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.008+0000 7f9bee08c640 1 -- 172.21.15.60:0/348749079 wait complete. 2024-09-12T01:39:11.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.009+0000 7f9bee08c640 1 Processor -- start 2024-09-12T01:39:11.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.010+0000 7f9bee08c640 1 -- start start 2024-09-12T01:39:11.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.010+0000 7f9bee08c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9be80b3360 0x7f9be8150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:11.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.010+0000 7f9bee08c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be80d1ab0 0x7f9be80cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:11.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.010+0000 7f9bee08c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be8161be0 0x7f9be80ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:11.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.010+0000 7f9bee08c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9be80cf950 con 0x7f9be80d1ab0 2024-09-12T01:39:11.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.010+0000 7f9bee08c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9be80cf670 con 0x7f9be8161be0 2024-09-12T01:39:11.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.010+0000 7f9bee08c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9be80d3a70 con 0x7f9be80b3360 2024-09-12T01:39:11.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.010+0000 7f9be6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be80d1ab0 0x7f9be80cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:11.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.010+0000 7f9be6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be80d1ab0 0x7f9be80cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47140/0 (socket says 172.21.15.60:47140) 2024-09-12T01:39:11.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.010+0000 7f9be6ffd640 1 -- 172.21.15.60:0/912657976 learned_addr learned my addr 172.21.15.60:0/912657976 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:11.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9be7fff640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be8161be0 0x7f9be80ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:11.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9be77fe640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9be80b3360 0x7f9be8150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:11.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9be6ffd640 1 -- 172.21.15.60:0/912657976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9be80b3360 msgr2=0x7f9be8150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:11.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9be6ffd640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9be80b3360 0x7f9be8150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:11.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9be6ffd640 1 -- 172.21.15.60:0/912657976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be8161be0 msgr2=0x7f9be80ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9be6ffd640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be8161be0 0x7f9be80ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9be6ffd640 1 -- 172.21.15.60:0/912657976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be80c82b0 con 0x7f9be80d1ab0 2024-09-12T01:39:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9be6ffd640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be80d1ab0 0x7f9be80cd5d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00e960 tx=0x7f9bdc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9bcffff640 1 -- 172.21.15.60:0/912657976 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc017070 con 0x7f9be80d1ab0 2024-09-12T01:39:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9bee08c640 1 -- 172.21.15.60:0/912657976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be80c8550 con 0x7f9be80d1ab0 2024-09-12T01:39:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9bcffff640 1 -- 172.21.15.60:0/912657976 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bdc00ca00 con 0x7f9be80d1ab0 2024-09-12T01:39:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9bcffff640 1 -- 172.21.15.60:0/912657976 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00cdd0 con 0x7f9be80d1ab0 2024-09-12T01:39:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.011+0000 7f9bee08c640 1 -- 172.21.15.60:0/912657976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be80c8b10 con 0x7f9be80d1ab0 2024-09-12T01:39:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.012+0000 7f9bee08c640 1 -- 172.21.15.60:0/912657976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9be8161fc0 con 0x7f9be80d1ab0 2024-09-12T01:39:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.013+0000 7f9bcffff640 1 -- 172.21.15.60:0/912657976 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9bdc01a070 con 0x7f9be80d1ab0 2024-09-12T01:39:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.013+0000 7f9bcffff640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9bd406be60 0x7f9bd406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:11.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.013+0000 7f9bcffff640 1 -- 172.21.15.60:0/912657976 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 4857+0+0 (secure 0 0 0) 0x7f9bdc08aa00 con 0x7f9be80d1ab0 2024-09-12T01:39:11.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.013+0000 7f9be77fe640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9bd406be60 0x7f9bd406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:11.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.014+0000 7f9be77fe640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9bd406be60 0x7f9bd406e320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8034000 tx=0x7f9bd802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:11.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.018+0000 7f9bcffff640 1 -- 172.21.15.60:0/912657976 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9bdc058fa0 con 0x7f9be80d1ab0 2024-09-12T01:39:11.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.195+0000 7f9bee08c640 1 -- 172.21.15.60:0/912657976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9be80ba3f0 con 0x7f9be80d1ab0 2024-09-12T01:39:11.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.876+0000 7f9bcffff640 1 -- 172.21.15.60:0/912657976 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7f9bdc05d2a0 con 0x7f9be80d1ab0 2024-09-12T01:39:11.876 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-12T01:39:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.879+0000 7f9bee08c640 1 -- 172.21.15.60:0/912657976 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9bd406be60 msgr2=0x7f9bd406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.879+0000 7f9bee08c640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9bd406be60 0x7f9bd406e320 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8034000 tx=0x7f9bd802e000 comp rx=0 tx=0).stop 2024-09-12T01:39:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.879+0000 7f9bee08c640 1 -- 172.21.15.60:0/912657976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be80d1ab0 msgr2=0x7f9be80cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.879+0000 7f9bee08c640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be80d1ab0 0x7f9be80cd5d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00e960 tx=0x7f9bdc00ee20 comp rx=0 tx=0).stop 2024-09-12T01:39:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.880+0000 7f9bee08c640 1 -- 172.21.15.60:0/912657976 shutdown_connections 2024-09-12T01:39:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.880+0000 7f9bee08c640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9be8161be0 0x7f9be80ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.880+0000 7f9bee08c640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be80d1ab0 0x7f9be80cd5d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.880+0000 7f9bee08c640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9bd406be60 0x7f9bd406e320 secure :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8034000 tx=0x7f9bd802e000 comp rx=0 tx=0).stop 2024-09-12T01:39:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.880+0000 7f9bee08c640 1 --2- 172.21.15.60:0/912657976 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9be80b3360 0x7f9be8150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.880+0000 7f9bee08c640 1 -- 172.21.15.60:0/912657976 >> 172.21.15.60:0/912657976 conn(0x7f9be806c2c0 msgr2=0x7f9be815f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.880+0000 7f9bee08c640 1 -- 172.21.15.60:0/912657976 shutdown_connections 2024-09-12T01:39:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:11.880+0000 7f9bee08c640 1 -- 172.21.15.60:0/912657976 wait complete. 2024-09-12T01:39:11.896 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:39:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.011+0000 7fd6e3728640 1 Processor -- start 2024-09-12T01:39:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.011+0000 7fd6e3728640 1 -- start start 2024-09-12T01:39:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.012+0000 7fd6e3728640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd6dc15e750 0x7fd6dc0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.012+0000 7fd6e3728640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6dc0cfb70 0x7fd6dc0b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.012+0000 7fd6e3728640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6dc0b7790 con 0x7fd6dc0b69e0 2024-09-12T01:39:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.012+0000 7fd6e3728640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd6dc0d43c0 con 0x7fd6dc15e750 2024-09-12T01:39:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.012+0000 7fd6e3728640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd6dc0d33b0 con 0x7fd6dc0cfb70 2024-09-12T01:39:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.012+0000 7fd6e1cc5640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd6dc0b69e0 0x7fd6dc06bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34980/0 (socket says 172.21.15.60:34980) 2024-09-12T01:39:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.012+0000 7fd6e1cc5640 1 -- 172.21.15.60:0/3962408202 learned_addr learned my addr 172.21.15.60:0/3962408202 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:12.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.012+0000 7fd6e0cc3640 1 --2- 172.21.15.60:0/3962408202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6dc0cfb70 0x7fd6dc0b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.012+0000 7fd6e14c4640 1 --2- 172.21.15.60:0/3962408202 >> v2:172.21.15.105:3300/0 conn(0x7fd6dc15e750 0x7fd6dc0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.012+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1992491923 0 0) 0x7fd6dc0b7790 con 0x7fd6dc0b69e0 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.012+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6c4003520 con 0x7fd6dc0b69e0 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 956704368 0 0) 0x7fd6c4003520 con 0x7fd6dc0b69e0 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6dc0cfb70 msgr2=0x7fd6dc0b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 --2- 172.21.15.60:0/3962408202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6dc0cfb70 0x7fd6dc0b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 >> v2:172.21.15.105:3300/0 conn(0x7fd6dc15e750 msgr2=0x7fd6dc0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 --2- 172.21.15.60:0/3962408202 >> v2:172.21.15.105:3300/0 conn(0x7fd6dc15e750 0x7fd6dc0cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6dc0d3600 con 0x7fd6dc0b69e0 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fd6d4001690 con 0x7fd6dc0b69e0 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6e14c4640 1 --2- 172.21.15.60:0/3962408202 >> v2:172.21.15.105:3300/0 conn(0x7fd6dc15e750 0x7fd6dc0cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 >> v1:172.21.15.60:6789/0 conn(0x7fd6dc0b69e0 legacy=0x7fd6dc06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:12.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 --2- 172.21.15.60:0/3962408202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6c40039b0 0x7fd6c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 --2- 172.21.15.60:0/3962408202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6c4004800 0x7fd6c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 --2- 172.21.15.60:0/3962408202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6dc0cfb70 0x7fd6c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc0d43c0 con 0x7fd6c4004800 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc0d33b0 con 0x7fd6c40039b0 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd6c400b9f0 con 0x7fd6dc0cfb70 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6e0cc3640 1 --2- 172.21.15.60:0/3962408202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6c4004800 0x7fd6c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6e1cc5640 1 --2- 172.21.15.60:0/3962408202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6dc0cfb70 0x7fd6c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6e14c4640 1 --2- 172.21.15.60:0/3962408202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6c40039b0 0x7fd6c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6e0cc3640 1 -- 172.21.15.60:0/3962408202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6dc0cfb70 msgr2=0x7fd6c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6e0cc3640 1 --2- 172.21.15.60:0/3962408202 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6dc0cfb70 0x7fd6c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6e0cc3640 1 -- 172.21.15.60:0/3962408202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6c40039b0 msgr2=0x7fd6c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6e0cc3640 1 --2- 172.21.15.60:0/3962408202 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6c40039b0 0x7fd6c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.013+0000 7fd6e0cc3640 1 -- 172.21.15.60:0/3962408202 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c4003520 con 0x7fd6c4004800 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.014+0000 7fd6e0cc3640 1 --2- 172.21.15.60:0/3962408202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6c4004800 0x7fd6c4004c80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009a90 tx=0x7fd6c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e22501024eeed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:12.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.014+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0036070 con 0x7fd6c4004800 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.014+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d0031400 con 0x7fd6c4004800 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.014+0000 7fd6dbfff640 1 -- 172.21.15.60:0/3962408202 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0009690 con 0x7fd6c4004800 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.015+0000 7fd6e3728640 1 -- 172.21.15.60:0/3962408202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6c4004800 msgr2=0x7fd6c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.015+0000 7fd6e3728640 1 --2- 172.21.15.60:0/3962408202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6c4004800 0x7fd6c4004c80 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009a90 tx=0x7fd6c4005830 comp rx=0 tx=0).stop 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.015+0000 7fd6e1cc5640 1 -- 172.21.15.60:0/3962408202 reap_dead start 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.015+0000 7fd6e3728640 1 -- 172.21.15.60:0/3962408202 shutdown_connections 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.015+0000 7fd6e3728640 1 -- 172.21.15.60:0/3962408202 >> 172.21.15.60:0/3962408202 conn(0x7fd6dc0d1500 msgr2=0x7fd6dc0d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.015+0000 7fd6e3728640 1 -- 172.21.15.60:0/3962408202 shutdown_connections 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.015+0000 7fd6e3728640 1 -- 172.21.15.60:0/3962408202 wait complete. 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.016+0000 7fd6e3728640 1 Processor -- start 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.016+0000 7fd6e3728640 1 -- start start 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e3728640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6c4004800 0x7fd6dc1f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e3728640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6dc157c30 0x7fd6dc160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:12.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e3728640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6dc1614b0 0x7fd6dc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e3728640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc0d3bc0 con 0x7fd6dc1614b0 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e3728640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc0b7ac0 con 0x7fd6dc157c30 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e3728640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd6dc15eb30 con 0x7fd6c4004800 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e1cc5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6dc1614b0 0x7fd6dc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e1cc5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6dc1614b0 0x7fd6dc0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47154/0 (socket says 172.21.15.60:47154) 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e1cc5640 1 -- 172.21.15.60:0/1206838120 learned_addr learned my addr 172.21.15.60:0/1206838120 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e14c4640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6c4004800 0x7fd6dc1f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e0cc3640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6dc157c30 0x7fd6dc160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e1cc5640 1 -- 172.21.15.60:0/1206838120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6c4004800 msgr2=0x7fd6dc1f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e1cc5640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6c4004800 0x7fd6dc1f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e1cc5640 1 -- 172.21.15.60:0/1206838120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6dc157c30 msgr2=0x7fd6dc160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e1cc5640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6dc157c30 0x7fd6dc160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e1cc5640 1 -- 172.21.15.60:0/1206838120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6dc159a30 con 0x7fd6dc1614b0 2024-09-12T01:39:12.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e0cc3640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6dc157c30 0x7fd6dc160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.017+0000 7fd6e1cc5640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6dc1614b0 0x7fd6dc0ce2f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0b7960 tx=0x7fd6d4007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.018+0000 7fd6d9ffb640 1 -- 172.21.15.60:0/1206838120 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d401a070 con 0x7fd6dc1614b0 2024-09-12T01:39:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.018+0000 7fd6d9ffb640 1 -- 172.21.15.60:0/1206838120 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d400f8b0 con 0x7fd6dc1614b0 2024-09-12T01:39:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.018+0000 7fd6d9ffb640 1 -- 172.21.15.60:0/1206838120 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400fc80 con 0x7fd6dc1614b0 2024-09-12T01:39:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.018+0000 7fd6e3728640 1 -- 172.21.15.60:0/1206838120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6dc159d10 con 0x7fd6dc1614b0 2024-09-12T01:39:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.018+0000 7fd6e3728640 1 -- 172.21.15.60:0/1206838120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6dc15a2d0 con 0x7fd6dc1614b0 2024-09-12T01:39:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.019+0000 7fd6e3728640 1 -- 172.21.15.60:0/1206838120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6dc0cf630 con 0x7fd6dc1614b0 2024-09-12T01:39:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.019+0000 7fd6d9ffb640 1 -- 172.21.15.60:0/1206838120 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6d401e3f0 con 0x7fd6dc1614b0 2024-09-12T01:39:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.020+0000 7fd6d9ffb640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd6c806be60 0x7fd6c806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.020+0000 7fd6d9ffb640 1 -- 172.21.15.60:0/1206838120 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 5227+0+0 (secure 0 0 0) 0x7fd6d408a2a0 con 0x7fd6dc1614b0 2024-09-12T01:39:12.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.020+0000 7fd6e14c4640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd6c806be60 0x7fd6c806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:12.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.020+0000 7fd6e14c4640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd6c806be60 0x7fd6c806e320 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009a40 tx=0x7fd6cc00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:12.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.025+0000 7fd6d9ffb640 1 -- 172.21.15.60:0/1206838120 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd6d40587d0 con 0x7fd6dc1614b0 2024-09-12T01:39:12.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.201+0000 7fd6e3728640 1 -- 172.21.15.60:0/1206838120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd6dc0d1d00 con 0x7fd6dc1614b0 2024-09-12T01:39:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.881+0000 7fd6d9ffb640 1 -- 172.21.15.60:0/1206838120 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7fd6d405cad0 con 0x7fd6dc1614b0 2024-09-12T01:39:12.881 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-12T01:39:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.889+0000 7fd6e3728640 1 -- 172.21.15.60:0/1206838120 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd6c806be60 msgr2=0x7fd6c806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.889+0000 7fd6e3728640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd6c806be60 0x7fd6c806e320 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009a40 tx=0x7fd6cc00b040 comp rx=0 tx=0).stop 2024-09-12T01:39:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.889+0000 7fd6e3728640 1 -- 172.21.15.60:0/1206838120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6dc1614b0 msgr2=0x7fd6dc0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.889+0000 7fd6e3728640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6dc1614b0 0x7fd6dc0ce2f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc0b7960 tx=0x7fd6d4007720 comp rx=0 tx=0).stop 2024-09-12T01:39:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.892+0000 7fd6e3728640 1 -- 172.21.15.60:0/1206838120 shutdown_connections 2024-09-12T01:39:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.892+0000 7fd6e3728640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6dc1614b0 0x7fd6dc0ce2f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.892+0000 7fd6e3728640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6dc157c30 0x7fd6dc160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.892+0000 7fd6e3728640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd6c806be60 0x7fd6c806e320 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.892+0000 7fd6e3728640 1 --2- 172.21.15.60:0/1206838120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6c4004800 0x7fd6dc1f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.892+0000 7fd6e3728640 1 -- 172.21.15.60:0/1206838120 >> 172.21.15.60:0/1206838120 conn(0x7fd6dc0d1500 msgr2=0x7fd6dc0cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:12.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.893+0000 7fd6e3728640 1 -- 172.21.15.60:0/1206838120 shutdown_connections 2024-09-12T01:39:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:12.894+0000 7fd6e3728640 1 -- 172.21.15.60:0/1206838120 wait complete. 2024-09-12T01:39:12.915 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:39:13.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.027+0000 7fadb732c640 1 Processor -- start 2024-09-12T01:39:13.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.027+0000 7fadb732c640 1 -- start start 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.028+0000 7fadb732c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fadb015e7a0 0x7fadb006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.028+0000 7fadb732c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadb00cf860 con 0x7fadb00cf1f0 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.028+0000 7fadb732c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadb00cfb40 con 0x7fadb00b68f0 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.028+0000 7fadb732c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fadb00d2ca0 con 0x7fadb015e7a0 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.028+0000 7fadb48c7640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fadb00cf1f0 0x7fadb00b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41822/0 (socket says 172.21.15.60:41822) 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.028+0000 7fadb48c7640 1 -- 172.21.15.60:0/2575441387 learned_addr learned my addr 172.21.15.60:0/2575441387 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.028+0000 7fadb50c8640 1 --2- 172.21.15.60:0/2575441387 >> v2:172.21.15.105:3300/0 conn(0x7fadb015e7a0 0x7fadb006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.028+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3359216017 0 0) 0x7fadb00cf860 con 0x7fadb00cf1f0 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.028+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad9c003520 con 0x7fadb00cf1f0 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1764455161 0 0) 0x7fad9c003520 con 0x7fadb00cf1f0 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 >> v2:172.21.15.105:3300/0 conn(0x7fadb015e7a0 msgr2=0x7fadb006caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 --2- 172.21.15.60:0/2575441387 >> v2:172.21.15.105:3300/0 conn(0x7fadb015e7a0 0x7fadb006caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:13.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 >> v1:172.21.15.105:6789/0 conn(0x7fadb00b68f0 legacy=0x7fadb00d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:13.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb00cfe20 con 0x7fadb00cf1f0 2024-09-12T01:39:13.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fada0001670 con 0x7fadb00cf1f0 2024-09-12T01:39:13.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 >> v1:172.21.15.60:6789/0 conn(0x7fadb00cf1f0 legacy=0x7fadb00b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:13.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 --2- 172.21.15.60:0/2575441387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 0x7fad9c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:13.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 --2- 172.21.15.60:0/2575441387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9c004800 0x7fad9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:13.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 --2- 172.21.15.60:0/2575441387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9c0051c0 0x7fad9c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:13.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fadb00d2ca0 con 0x7fad9c0039b0 2024-09-12T01:39:13.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad9c00c160 con 0x7fad9c0051c0 2024-09-12T01:39:13.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad9c00c360 con 0x7fad9c004800 2024-09-12T01:39:13.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fadb50c8640 1 --2- 172.21.15.60:0/2575441387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 0x7fad9c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:13.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fadb58c9640 1 --2- 172.21.15.60:0/2575441387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9c0051c0 0x7fad9c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:13.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fadb48c7640 1 --2- 172.21.15.60:0/2575441387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9c004800 0x7fad9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fadb50c8640 1 -- 172.21.15.60:0/2575441387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9c004800 msgr2=0x7fad9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fadb50c8640 1 --2- 172.21.15.60:0/2575441387 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9c004800 0x7fad9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fadb50c8640 1 -- 172.21.15.60:0/2575441387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9c0051c0 msgr2=0x7fad9c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fadb50c8640 1 --2- 172.21.15.60:0/2575441387 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad9c0051c0 0x7fad9c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fadb50c8640 1 -- 172.21.15.60:0/2575441387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9c003520 con 0x7fad9c0039b0 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.029+0000 7fadb58c9640 1 -- 172.21.15.60:0/2575441387 reap_dead start 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.030+0000 7fadb50c8640 1 --2- 172.21.15.60:0/2575441387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 0x7fad9c003dd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fadac009ac0 tx=0x7fad9c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f97d364f31184e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.030+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac036070 con 0x7fad9c0039b0 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.030+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac031400 con 0x7fad9c0039b0 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.030+0000 7fada7fff640 1 -- 172.21.15.60:0/2575441387 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac009690 con 0x7fad9c0039b0 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.031+0000 7fadb732c640 1 -- 172.21.15.60:0/2575441387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 msgr2=0x7fad9c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.031+0000 7fadb732c640 1 --2- 172.21.15.60:0/2575441387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 0x7fad9c003dd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fadac009ac0 tx=0x7fad9c005830 comp rx=0 tx=0).stop 2024-09-12T01:39:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.031+0000 7fadb732c640 1 -- 172.21.15.60:0/2575441387 shutdown_connections 2024-09-12T01:39:13.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.031+0000 7fadb732c640 1 --2- 172.21.15.60:0/2575441387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 0x7fad9c003dd0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:13.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.031+0000 7fadb732c640 1 -- 172.21.15.60:0/2575441387 >> 172.21.15.60:0/2575441387 conn(0x7fadb00d11e0 msgr2=0x7fadb00d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:13.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.031+0000 7fadb732c640 1 -- 172.21.15.60:0/2575441387 shutdown_connections 2024-09-12T01:39:13.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.031+0000 7fadb732c640 1 -- 172.21.15.60:0/2575441387 wait complete. 2024-09-12T01:39:13.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.032+0000 7fadb732c640 1 Processor -- start 2024-09-12T01:39:13.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.032+0000 7fadb732c640 1 -- start start 2024-09-12T01:39:13.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb732c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 0x7fadb01f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:13.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb732c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadb00c8290 0x7fadb01f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:13.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb732c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadb00ca520 0x7fadb00ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:13.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb732c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fadb015eb80 con 0x7fad9c0039b0 2024-09-12T01:39:13.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb732c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fadb00b7a00 con 0x7fadb00ca520 2024-09-12T01:39:13.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb732c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fadb015ed00 con 0x7fadb00c8290 2024-09-12T01:39:13.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb50c8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 0x7fadb01f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:13.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb50c8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 0x7fadb01f3df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41546/0 (socket says 172.21.15.60:41546) 2024-09-12T01:39:13.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb50c8640 1 -- 172.21.15.60:0/4286671509 learned_addr learned my addr 172.21.15.60:0/4286671509 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:13.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb58c9640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadb00ca520 0x7fadb00ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:13.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb48c7640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadb00c8290 0x7fadb01f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:13.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb50c8640 1 -- 172.21.15.60:0/4286671509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadb00c8290 msgr2=0x7fadb01f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:13.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb50c8640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadb00c8290 0x7fadb01f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:13.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb50c8640 1 -- 172.21.15.60:0/4286671509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadb00ca520 msgr2=0x7fadb00ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:13.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb50c8640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadb00ca520 0x7fadb00ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:13.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb50c8640 1 -- 172.21.15.60:0/4286671509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb0154630 con 0x7fad9c0039b0 2024-09-12T01:39:13.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb58c9640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadb00ca520 0x7fadb00ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:13.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.033+0000 7fadb50c8640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 0x7fadb01f3df0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fadac02abb0 tx=0x7fadac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:13.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.034+0000 7fada5ffb640 1 -- 172.21.15.60:0/4286671509 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac03f020 con 0x7fad9c0039b0 2024-09-12T01:39:13.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.034+0000 7fada5ffb640 1 -- 172.21.15.60:0/4286671509 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadac037040 con 0x7fad9c0039b0 2024-09-12T01:39:13.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.034+0000 7fada5ffb640 1 -- 172.21.15.60:0/4286671509 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac036070 con 0x7fad9c0039b0 2024-09-12T01:39:13.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.034+0000 7fadb732c640 1 -- 172.21.15.60:0/4286671509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb01f4aa0 con 0x7fad9c0039b0 2024-09-12T01:39:13.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.034+0000 7fadb732c640 1 -- 172.21.15.60:0/4286671509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb01f5060 con 0x7fad9c0039b0 2024-09-12T01:39:13.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.035+0000 7fadb732c640 1 -- 172.21.15.60:0/4286671509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb00b61e0 con 0x7fad9c0039b0 2024-09-12T01:39:13.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.035+0000 7fada5ffb640 1 -- 172.21.15.60:0/4286671509 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fadac042020 con 0x7fad9c0039b0 2024-09-12T01:39:13.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.036+0000 7fada5ffb640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad9406be60 0x7fad9406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:13.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.036+0000 7fada5ffb640 1 -- 172.21.15.60:0/4286671509 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5609+0+0 (secure 0 0 0) 0x7fadac0aab50 con 0x7fad9c0039b0 2024-09-12T01:39:13.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.036+0000 7fadb48c7640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad9406be60 0x7fad9406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:13.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.036+0000 7fadb48c7640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad9406be60 0x7fad9406e320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fada0001eb0 tx=0x7fada0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:13.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.040+0000 7fada5ffb640 1 -- 172.21.15.60:0/4286671509 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fadac049070 con 0x7fad9c0039b0 2024-09-12T01:39:13.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.253+0000 7fadb732c640 1 -- 172.21.15.60:0/4286671509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fadb00d2a80 con 0x7fad9c0039b0 2024-09-12T01:39:13.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.883+0000 7fada5ffb640 1 -- 172.21.15.60:0/4286671509 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v42) ==== 174+0+0 (secure 0 0 0) 0x7fadac079570 con 0x7fad9c0039b0 2024-09-12T01:39:13.882 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 12 and data pool 13 2024-09-12T01:39:13.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.887+0000 7fadb732c640 1 -- 172.21.15.60:0/4286671509 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad9406be60 msgr2=0x7fad9406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:13.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.887+0000 7fadb732c640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad9406be60 0x7fad9406e320 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fada0001eb0 tx=0x7fada0009040 comp rx=0 tx=0).stop 2024-09-12T01:39:13.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.887+0000 7fadb732c640 1 -- 172.21.15.60:0/4286671509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 msgr2=0x7fadb01f3df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:13.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.887+0000 7fadb732c640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 0x7fadb01f3df0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fadac02abb0 tx=0x7fadac004730 comp rx=0 tx=0).stop 2024-09-12T01:39:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.888+0000 7fadb732c640 1 -- 172.21.15.60:0/4286671509 shutdown_connections 2024-09-12T01:39:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.888+0000 7fadb732c640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadb00ca520 0x7fadb00ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.888+0000 7fadb732c640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad9406be60 0x7fad9406e320 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.888+0000 7fadb732c640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fadb00c8290 0x7fadb01f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:13.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.888+0000 7fadb732c640 1 --2- 172.21.15.60:0/4286671509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad9c0039b0 0x7fadb01f3df0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:13.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.888+0000 7fadb732c640 1 -- 172.21.15.60:0/4286671509 >> 172.21.15.60:0/4286671509 conn(0x7fadb00d11e0 msgr2=0x7fadb015cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:13.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.888+0000 7fadb732c640 1 -- 172.21.15.60:0/4286671509 shutdown_connections 2024-09-12T01:39:13.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:13.888+0000 7fadb732c640 1 -- 172.21.15.60:0/4286671509 wait complete. 2024-09-12T01:39:13.915 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:39:14.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.022+0000 7f6a8ab1a640 1 Processor -- start 2024-09-12T01:39:14.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.022+0000 7f6a8ab1a640 1 -- start start 2024-09-12T01:39:14.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.023+0000 7f6a8ab1a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6a840b63d0 0x7f6a840d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.023+0000 7f6a8ab1a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a840cfc20 con 0x7f6a840cf6b0 2024-09-12T01:39:14.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.023+0000 7f6a8ab1a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a840d2ed0 con 0x7f6a840d1c80 2024-09-12T01:39:14.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.023+0000 7f6a8ab1a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6a840d31b0 con 0x7f6a840b63d0 2024-09-12T01:39:14.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.023+0000 7f6a83fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6a840cf6b0 0x7f6a840b7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41828/0 (socket says 172.21.15.60:41828) 2024-09-12T01:39:14.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.023+0000 7f6a83fff640 1 -- 172.21.15.60:0/2884636229 learned_addr learned my addr 172.21.15.60:0/2884636229 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:14.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.023+0000 7f6a888b6640 1 --2- 172.21.15.60:0/2884636229 >> v2:172.21.15.105:3300/0 conn(0x7f6a840b63d0 0x7f6a840d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.023+0000 7f6a837fe640 1 -- 172.21.15.60:0/2884636229 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2922199703 0 0) 0x7f6a840cfc20 con 0x7f6a840cf6b0 2024-09-12T01:39:14.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.024+0000 7f6a837fe640 1 -- 172.21.15.60:0/2884636229 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a6c003520 con 0x7f6a840cf6b0 2024-09-12T01:39:14.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.024+0000 7f6a888b6640 1 -- 172.21.15.60:0/2884636229 >> v1:172.21.15.105:6789/0 conn(0x7f6a840d1c80 legacy=0x7f6a841629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.024+0000 7f6a888b6640 1 -- 172.21.15.60:0/2884636229 >> v1:172.21.15.60:6789/0 conn(0x7f6a840cf6b0 legacy=0x7f6a840b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.024+0000 7f6a888b6640 1 -- 172.21.15.60:0/2884636229 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a840d3490 con 0x7f6a840b63d0 2024-09-12T01:39:14.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.024+0000 7f6a888b6640 1 --2- 172.21.15.60:0/2884636229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a840b63d0 0x7f6a840d39b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6a740097a0 tx=0x7f6a7402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=327f6feb4f1c93ac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:14.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.025+0000 7f6a837fe640 1 -- 172.21.15.60:0/2884636229 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74037070 con 0x7f6a840b63d0 2024-09-12T01:39:14.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.025+0000 7f6a837fe640 1 -- 172.21.15.60:0/2884636229 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a74032440 con 0x7f6a840b63d0 2024-09-12T01:39:14.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.025+0000 7f6a837fe640 1 -- 172.21.15.60:0/2884636229 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a740327f0 con 0x7f6a840b63d0 2024-09-12T01:39:14.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.025+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/2884636229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a840b63d0 msgr2=0x7f6a840d39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.025+0000 7f6a8ab1a640 1 --2- 172.21.15.60:0/2884636229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a840b63d0 0x7f6a840d39b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6a740097a0 tx=0x7f6a7402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.025+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/2884636229 shutdown_connections 2024-09-12T01:39:14.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.025+0000 7f6a8ab1a640 1 --2- 172.21.15.60:0/2884636229 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a840b63d0 0x7f6a840d39b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.025+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/2884636229 >> 172.21.15.60:0/2884636229 conn(0x7f6a840d1160 msgr2=0x7f6a840d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:14.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.025+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/2884636229 shutdown_connections 2024-09-12T01:39:14.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.025+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/2884636229 wait complete. 2024-09-12T01:39:14.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.026+0000 7f6a8ab1a640 1 Processor -- start 2024-09-12T01:39:14.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.026+0000 7f6a8ab1a640 1 -- start start 2024-09-12T01:39:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.027+0000 7f6a8ab1a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a840b63d0 0x7f6a84159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.027+0000 7f6a8ab1a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a840cf6b0 0x7f6a840ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.027+0000 7f6a8ab1a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a840d1c80 0x7f6a840cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.027+0000 7f6a8ab1a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a840cb5c0 con 0x7f6a840b63d0 2024-09-12T01:39:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.027+0000 7f6a8ab1a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a840cb440 con 0x7f6a840d1c80 2024-09-12T01:39:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.027+0000 7f6a8ab1a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6a840d3ef0 con 0x7f6a840cf6b0 2024-09-12T01:39:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.027+0000 7f6a888b6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a840b63d0 0x7f6a84159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.027+0000 7f6a888b6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a840b63d0 0x7f6a84159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41552/0 (socket says 172.21.15.60:41552) 2024-09-12T01:39:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.027+0000 7f6a888b6640 1 -- 172.21.15.60:0/1397015725 learned_addr learned my addr 172.21.15.60:0/1397015725 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a83fff640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a840cf6b0 0x7f6a840ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a890b7640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a840d1c80 0x7f6a840cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a888b6640 1 -- 172.21.15.60:0/1397015725 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a840cf6b0 msgr2=0x7f6a840ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a888b6640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a840cf6b0 0x7f6a840ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a888b6640 1 -- 172.21.15.60:0/1397015725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a840d1c80 msgr2=0x7f6a840cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a888b6640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a840d1c80 0x7f6a840cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a888b6640 1 -- 172.21.15.60:0/1397015725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a840c9100 con 0x7f6a840b63d0 2024-09-12T01:39:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a888b6640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a840b63d0 0x7f6a84159c60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6a740097a0 tx=0x7f6a740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a817fa640 1 -- 172.21.15.60:0/1397015725 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74037050 con 0x7f6a840b63d0 2024-09-12T01:39:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a817fa640 1 -- 172.21.15.60:0/1397015725 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a74038040 con 0x7f6a840b63d0 2024-09-12T01:39:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a817fa640 1 -- 172.21.15.60:0/1397015725 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74004470 con 0x7f6a840b63d0 2024-09-12T01:39:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/1397015725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a840c93e0 con 0x7f6a840b63d0 2024-09-12T01:39:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.028+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/1397015725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a840c99a0 con 0x7f6a840b63d0 2024-09-12T01:39:14.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.029+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/1397015725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a840cf280 con 0x7f6a840b63d0 2024-09-12T01:39:14.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.030+0000 7f6a817fa640 1 -- 172.21.15.60:0/1397015725 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a7403c6d0 con 0x7f6a840b63d0 2024-09-12T01:39:14.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.030+0000 7f6a817fa640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7006be30 0x7f6a7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.030+0000 7f6a83fff640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7006be30 0x7f6a7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.030+0000 7f6a817fa640 1 -- 172.21.15.60:0/1397015725 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5709+0+0 (secure 0 0 0) 0x7f6a740ab950 con 0x7f6a840b63d0 2024-09-12T01:39:14.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.031+0000 7f6a83fff640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7006be30 0x7f6a7006e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6a840ce8b0 tx=0x7f6a78009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:14.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.035+0000 7f6a817fa640 1 -- 172.21.15.60:0/1397015725 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a7407a270 con 0x7f6a840b63d0 2024-09-12T01:39:14.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.212+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/1397015725 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a84162860 con 0x7f6a840b63d0 2024-09-12T01:39:14.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.213+0000 7f6a817fa640 1 -- 172.21.15.60:0/1397015725 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+16709 (secure 0 0 0) 0x7f6a74079b70 con 0x7f6a840b63d0 2024-09-12T01:39:14.213 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:14.213 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":79,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:39:13.253947+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:39:11.226441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T01:39:12.232247+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:39:14.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.215+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/1397015725 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7006be30 msgr2=0x7f6a7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.215+0000 7f6a8ab1a640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7006be30 0x7f6a7006e2f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6a840ce8b0 tx=0x7f6a78009040 comp rx=0 tx=0).stop 2024-09-12T01:39:14.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.215+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/1397015725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a840b63d0 msgr2=0x7f6a84159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.215+0000 7f6a8ab1a640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a840b63d0 0x7f6a84159c60 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6a740097a0 tx=0x7f6a740046c0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.216+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/1397015725 shutdown_connections 2024-09-12T01:39:14.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.216+0000 7f6a8ab1a640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a840d1c80 0x7f6a840cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.216+0000 7f6a8ab1a640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7006be30 0x7f6a7006e2f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.216+0000 7f6a8ab1a640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a840cf6b0 0x7f6a840ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.216+0000 7f6a8ab1a640 1 --2- 172.21.15.60:0/1397015725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a840b63d0 0x7f6a84159c60 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.216+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/1397015725 >> 172.21.15.60:0/1397015725 conn(0x7f6a840d1160 msgr2=0x7f6a840b7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:14.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.216+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/1397015725 shutdown_connections 2024-09-12T01:39:14.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.216+0000 7f6a8ab1a640 1 -- 172.21.15.60:0/1397015725 wait complete. 2024-09-12T01:39:14.226 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:39:14.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.329+0000 7eff2f2c9640 1 Processor -- start 2024-09-12T01:39:14.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.329+0000 7eff2f2c9640 1 -- start start 2024-09-12T01:39:14.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff2f2c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff2815c2b0 0x7eff280b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff2f2c9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7eff280b72f0 0x7eff2815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff2f2c9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2815fb10 con 0x7eff2815f030 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff2f2c9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7eff280b5900 con 0x7eff280b72f0 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff2f2c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7eff2815f830 con 0x7eff2815c2b0 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff2d866640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7eff2815f030 0x7eff2806f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41830/0 (socket says 172.21.15.60:41830) 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff2d866640 1 -- 172.21.15.60:0/2493251661 learned_addr learned my addr 172.21.15.60:0/2493251661 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff2c864640 1 --2- 172.21.15.60:0/2493251661 >> v2:172.21.15.105:3300/0 conn(0x7eff280b72f0 0x7eff2815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff2d065640 1 --2- 172.21.15.60:0/2493251661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff2815c2b0 0x7eff280b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159036973 0 0) 0x7eff2815fb10 con 0x7eff2815f030 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff14003520 con 0x7eff2815f030 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2508293193 0 0) 0x7eff14003520 con 0x7eff2815f030 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff2815c2b0 msgr2=0x7eff280b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff1ffff640 1 --2- 172.21.15.60:0/2493251661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff2815c2b0 0x7eff280b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 >> v2:172.21.15.105:3300/0 conn(0x7eff280b72f0 msgr2=0x7eff2815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:14.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff1ffff640 1 --2- 172.21.15.60:0/2493251661 >> v2:172.21.15.105:3300/0 conn(0x7eff280b72f0 0x7eff2815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2806ce30 con 0x7eff2815f030 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7eff200019f0 con 0x7eff2815f030 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.330+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 >> v1:172.21.15.60:6789/0 conn(0x7eff2815f030 legacy=0x7eff2806f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff1ffff640 1 --2- 172.21.15.60:0/2493251661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff2815c2b0 0x7eff140039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff1ffff640 1 --2- 172.21.15.60:0/2493251661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff14003f30 0x7eff14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff1ffff640 1 --2- 172.21.15.60:0/2493251661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff14004d40 0x7eff140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7eff280b5900 con 0x7eff14003f30 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff2815f830 con 0x7eff14004d40 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7eff1400b9c0 con 0x7eff2815c2b0 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff2c864640 1 --2- 172.21.15.60:0/2493251661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff14003f30 0x7eff14004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff2d866640 1 --2- 172.21.15.60:0/2493251661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff14004d40 0x7eff140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff2d065640 1 --2- 172.21.15.60:0/2493251661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff2815c2b0 0x7eff140039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff2c864640 1 -- 172.21.15.60:0/2493251661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff2815c2b0 msgr2=0x7eff140039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:14.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff2c864640 1 --2- 172.21.15.60:0/2493251661 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff2815c2b0 0x7eff140039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff2c864640 1 -- 172.21.15.60:0/2493251661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff14004d40 msgr2=0x7eff140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:14.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff2c864640 1 --2- 172.21.15.60:0/2493251661 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff14004d40 0x7eff140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.331+0000 7eff2c864640 1 -- 172.21.15.60:0/2493251661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff14003520 con 0x7eff14003f30 2024-09-12T01:39:14.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.332+0000 7eff2c864640 1 --2- 172.21.15.60:0/2493251661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff14003f30 0x7eff14004800 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7eff18009a90 tx=0x7eff14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d03b916cacaa510 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:14.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.332+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18036070 con 0x7eff14003f30 2024-09-12T01:39:14.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.332+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff18031400 con 0x7eff14003f30 2024-09-12T01:39:14.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.332+0000 7eff1ffff640 1 -- 172.21.15.60:0/2493251661 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18009690 con 0x7eff14003f30 2024-09-12T01:39:14.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.332+0000 7eff2f2c9640 1 -- 172.21.15.60:0/2493251661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff14003f30 msgr2=0x7eff14004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.332+0000 7eff2f2c9640 1 --2- 172.21.15.60:0/2493251661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff14003f30 0x7eff14004800 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7eff18009a90 tx=0x7eff14005830 comp rx=0 tx=0).stop 2024-09-12T01:39:14.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.332+0000 7eff2d866640 1 -- 172.21.15.60:0/2493251661 reap_dead start 2024-09-12T01:39:14.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.332+0000 7eff2f2c9640 1 -- 172.21.15.60:0/2493251661 shutdown_connections 2024-09-12T01:39:14.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.332+0000 7eff2f2c9640 1 -- 172.21.15.60:0/2493251661 >> 172.21.15.60:0/2493251661 conn(0x7eff280b4240 msgr2=0x7eff280b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:14.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.332+0000 7eff2f2c9640 1 -- 172.21.15.60:0/2493251661 shutdown_connections 2024-09-12T01:39:14.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.332+0000 7eff2f2c9640 1 -- 172.21.15.60:0/2493251661 wait complete. 2024-09-12T01:39:14.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.333+0000 7eff2f2c9640 1 Processor -- start 2024-09-12T01:39:14.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.334+0000 7eff2f2c9640 1 -- start start 2024-09-12T01:39:14.336 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.334+0000 7eff2f2c9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff14003f30 0x7eff28145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.334+0000 7eff2f2c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff281e6e80 0x7eff28156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.334+0000 7eff2f2c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff281e8680 0x7eff281e8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.334+0000 7eff2f2c9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7eff280b7730 con 0x7eff281e6e80 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.334+0000 7eff2f2c9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff2806d3f0 con 0x7eff14003f30 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.334+0000 7eff2f2c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7eff2815f4e0 con 0x7eff281e8680 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.334+0000 7eff2c864640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff281e6e80 0x7eff28156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.334+0000 7eff2c864640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff281e6e80 0x7eff28156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41566/0 (socket says 172.21.15.60:41566) 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.334+0000 7eff2c864640 1 -- 172.21.15.60:0/3744852091 learned_addr learned my addr 172.21.15.60:0/3744852091 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.334+0000 7eff2d065640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff14003f30 0x7eff28145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff2d866640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff281e8680 0x7eff281e8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff2c864640 1 -- 172.21.15.60:0/3744852091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff281e8680 msgr2=0x7eff281e8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff2c864640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff281e8680 0x7eff281e8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff2c864640 1 -- 172.21.15.60:0/3744852091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff14003f30 msgr2=0x7eff28145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff2c864640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff14003f30 0x7eff28145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff2c864640 1 -- 172.21.15.60:0/3744852091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff28157510 con 0x7eff281e6e80 2024-09-12T01:39:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff2d065640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff14003f30 0x7eff28145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff2c864640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff281e6e80 0x7eff28156ba0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7eff18009a90 tx=0x7eff18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff1dffb640 1 -- 172.21.15.60:0/3744852091 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18040020 con 0x7eff281e6e80 2024-09-12T01:39:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff1dffb640 1 -- 172.21.15.60:0/3744852091 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff1803b660 con 0x7eff281e6e80 2024-09-12T01:39:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff2f2c9640 1 -- 172.21.15.60:0/3744852091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff281577f0 con 0x7eff281e6e80 2024-09-12T01:39:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff1dffb640 1 -- 172.21.15.60:0/3744852091 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18036040 con 0x7eff281e6e80 2024-09-12T01:39:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.335+0000 7eff2f2c9640 1 -- 172.21.15.60:0/3744852091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff28157db0 con 0x7eff281e6e80 2024-09-12T01:39:14.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.336+0000 7eff2f2c9640 1 -- 172.21.15.60:0/3744852091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff2815eaf0 con 0x7eff281e6e80 2024-09-12T01:39:14.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.337+0000 7eff1dffb640 1 -- 172.21.15.60:0/3744852091 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff18043020 con 0x7eff281e6e80 2024-09-12T01:39:14.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.337+0000 7eff1dffb640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff0c06be30 0x7eff0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.337+0000 7eff1dffb640 1 -- 172.21.15.60:0/3744852091 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5709+0+0 (secure 0 0 0) 0x7eff180ab600 con 0x7eff281e6e80 2024-09-12T01:39:14.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.337+0000 7eff2d065640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff0c06be30 0x7eff0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.338+0000 7eff2d065640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff0c06be30 0x7eff0c06e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7eff240099f0 tx=0x7eff24008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:14.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.342+0000 7eff1dffb640 1 -- 172.21.15.60:0/3744852091 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff1804a030 con 0x7eff281e6e80 2024-09-12T01:39:14.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.518+0000 7eff2f2c9640 1 -- 172.21.15.60:0/3744852091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff280b47c0 con 0x7eff281e6e80 2024-09-12T01:39:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.519+0000 7eff1dffb640 1 -- 172.21.15.60:0/3744852091 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) ==== 74+0+16709 (secure 0 0 0) 0x7eff18079fb0 con 0x7eff281e6e80 2024-09-12T01:39:14.519 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:14.519 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":79,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:39:13.253947+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:39:11.226441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T01:39:12.232247+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:39:14.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.522+0000 7eff2f2c9640 1 -- 172.21.15.60:0/3744852091 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff0c06be30 msgr2=0x7eff0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.522+0000 7eff2f2c9640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff0c06be30 0x7eff0c06e2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7eff240099f0 tx=0x7eff24008040 comp rx=0 tx=0).stop 2024-09-12T01:39:14.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.522+0000 7eff2f2c9640 1 -- 172.21.15.60:0/3744852091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff281e6e80 msgr2=0x7eff28156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.522+0000 7eff2f2c9640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff281e6e80 0x7eff28156ba0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7eff18009a90 tx=0x7eff18004730 comp rx=0 tx=0).stop 2024-09-12T01:39:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.522+0000 7eff2f2c9640 1 -- 172.21.15.60:0/3744852091 shutdown_connections 2024-09-12T01:39:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.522+0000 7eff2f2c9640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff0c06be30 0x7eff0c06e2f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.522+0000 7eff2f2c9640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff281e8680 0x7eff281e8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.522+0000 7eff2f2c9640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff281e6e80 0x7eff28156ba0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.522+0000 7eff2f2c9640 1 --2- 172.21.15.60:0/3744852091 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff14003f30 0x7eff28145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.522+0000 7eff2f2c9640 1 -- 172.21.15.60:0/3744852091 >> 172.21.15.60:0/3744852091 conn(0x7eff280b4240 msgr2=0x7eff281602d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.522+0000 7eff2f2c9640 1 -- 172.21.15.60:0/3744852091 shutdown_connections 2024-09-12T01:39:14.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.522+0000 7eff2f2c9640 1 -- 172.21.15.60:0/3744852091 wait complete. 2024-09-12T01:39:14.532 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:39:14.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.637+0000 7f486b90a640 1 Processor -- start 2024-09-12T01:39:14.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.638+0000 7f486b90a640 1 -- start start 2024-09-12T01:39:14.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.638+0000 7f486b90a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f486415ad10 0x7f48640719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.638+0000 7f486b90a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f48640cca40 0x7f4864071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.638+0000 7f486b90a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48640cc360 0x7f486415e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.638+0000 7f486b90a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4864070fb0 con 0x7f48640cca40 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.638+0000 7f486b90a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4864071720 con 0x7f486415ad10 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.638+0000 7f486b90a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4864073920 con 0x7f48640cc360 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.639+0000 7f4868ea5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f48640cca40 0x7f4864071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.639+0000 7f4868ea5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f48640cca40 0x7f4864071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41578/0 (socket says 172.21.15.60:41578) 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.639+0000 7f4868ea5640 1 -- 172.21.15.60:0/1942021356 learned_addr learned my addr 172.21.15.60:0/1942021356 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.639+0000 7f48696a6640 1 --2- 172.21.15.60:0/1942021356 >> v2:172.21.15.105:3300/0 conn(0x7f486415ad10 0x7f48640719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.639+0000 7f4869ea7640 1 --2- 172.21.15.60:0/1942021356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48640cc360 0x7f486415e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.639+0000 7f4868ea5640 1 -- 172.21.15.60:0/1942021356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48640cc360 msgr2=0x7f486415e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.639+0000 7f4868ea5640 1 --2- 172.21.15.60:0/1942021356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48640cc360 0x7f486415e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.639+0000 7f4868ea5640 1 -- 172.21.15.60:0/1942021356 >> v2:172.21.15.105:3300/0 conn(0x7f486415ad10 msgr2=0x7f48640719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.639+0000 7f4868ea5640 1 --2- 172.21.15.60:0/1942021356 >> v2:172.21.15.105:3300/0 conn(0x7f486415ad10 0x7f48640719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.639+0000 7f4868ea5640 1 -- 172.21.15.60:0/1942021356 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4864073c00 con 0x7f48640cca40 2024-09-12T01:39:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.640+0000 7f4868ea5640 1 --2- 172.21.15.60:0/1942021356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48640cca40 0x7f4864071f00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f4864069530 tx=0x7f485802b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6be0a39725a7d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.640+0000 7f4863fff640 1 -- 172.21.15.60:0/1942021356 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485800b040 con 0x7f48640cca40 2024-09-12T01:39:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.640+0000 7f4863fff640 1 -- 172.21.15.60:0/1942021356 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4858030710 con 0x7f48640cca40 2024-09-12T01:39:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.640+0000 7f4863fff640 1 -- 172.21.15.60:0/1942021356 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858030ae0 con 0x7f48640cca40 2024-09-12T01:39:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.640+0000 7f486b90a640 1 -- 172.21.15.60:0/1942021356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48640cca40 msgr2=0x7f4864071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.640+0000 7f486b90a640 1 --2- 172.21.15.60:0/1942021356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48640cca40 0x7f4864071f00 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f4864069530 tx=0x7f485802b510 comp rx=0 tx=0).stop 2024-09-12T01:39:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.640+0000 7f486b90a640 1 -- 172.21.15.60:0/1942021356 shutdown_connections 2024-09-12T01:39:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.640+0000 7f486b90a640 1 --2- 172.21.15.60:0/1942021356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48640cc360 0x7f486415e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.640+0000 7f486b90a640 1 --2- 172.21.15.60:0/1942021356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48640cca40 0x7f4864071f00 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.640+0000 7f486b90a640 1 --2- 172.21.15.60:0/1942021356 >> v2:172.21.15.105:3300/0 conn(0x7f486415ad10 0x7f48640719c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.640+0000 7f486b90a640 1 -- 172.21.15.60:0/1942021356 >> 172.21.15.60:0/1942021356 conn(0x7f486406d0f0 msgr2=0x7f486406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.641+0000 7f486b90a640 1 -- 172.21.15.60:0/1942021356 shutdown_connections 2024-09-12T01:39:14.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.641+0000 7f486b90a640 1 -- 172.21.15.60:0/1942021356 wait complete. 2024-09-12T01:39:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.642+0000 7f486b90a640 1 Processor -- start 2024-09-12T01:39:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.642+0000 7f486b90a640 1 -- start start 2024-09-12T01:39:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.642+0000 7f486b90a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48640cc360 0x7f486414bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.642+0000 7f486b90a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48640cca40 0x7f4864156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.642+0000 7f486b90a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f486415ad10 0x7f4864156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.642+0000 7f486b90a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f486415ec50 con 0x7f48640cc360 2024-09-12T01:39:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.642+0000 7f486b90a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4864071200 con 0x7f486415ad10 2024-09-12T01:39:14.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f486b90a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f486415edd0 con 0x7f48640cca40 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f48696a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48640cc360 0x7f486414bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f48696a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48640cc360 0x7f486414bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41590/0 (socket says 172.21.15.60:41590) 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f48696a6640 1 -- 172.21.15.60:0/259368941 learned_addr learned my addr 172.21.15.60:0/259368941 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f4868ea5640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48640cca40 0x7f4864156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f4869ea7640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f486415ad10 0x7f4864156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f48696a6640 1 -- 172.21.15.60:0/259368941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48640cca40 msgr2=0x7f4864156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f48696a6640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48640cca40 0x7f4864156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f48696a6640 1 -- 172.21.15.60:0/259368941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f486415ad10 msgr2=0x7f4864156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f48696a6640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f486415ad10 0x7f4864156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f48696a6640 1 -- 172.21.15.60:0/259368941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486414c410 con 0x7f48640cc360 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f4868ea5640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48640cca40 0x7f4864156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f48696a6640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48640cc360 0x7f486414bed0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4854007e40 tx=0x7f485400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:14.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f4861ffb640 1 -- 172.21.15.60:0/259368941 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854014620 con 0x7f48640cc360 2024-09-12T01:39:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f4861ffb640 1 -- 172.21.15.60:0/259368941 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4854019070 con 0x7f48640cc360 2024-09-12T01:39:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f4861ffb640 1 -- 172.21.15.60:0/259368941 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854014a00 con 0x7f48640cc360 2024-09-12T01:39:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f486b90a640 1 -- 172.21.15.60:0/259368941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48640c54a0 con 0x7f48640cc360 2024-09-12T01:39:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.643+0000 7f486b90a640 1 -- 172.21.15.60:0/259368941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48640c5a60 con 0x7f48640cc360 2024-09-12T01:39:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.644+0000 7f486b90a640 1 -- 172.21.15.60:0/259368941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48640cd090 con 0x7f48640cc360 2024-09-12T01:39:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.645+0000 7f4861ffb640 1 -- 172.21.15.60:0/259368941 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4854014ba0 con 0x7f48640cc360 2024-09-12T01:39:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.645+0000 7f4861ffb640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f485006be60 0x7f485006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.645+0000 7f4861ffb640 1 -- 172.21.15.60:0/259368941 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5709+0+0 (secure 0 0 0) 0x7f485408b6e0 con 0x7f48640cc360 2024-09-12T01:39:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.645+0000 7f4868ea5640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f485006be60 0x7f485006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:14.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.646+0000 7f4868ea5640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f485006be60 0x7f485006e320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4858035000 tx=0x7f485800c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:14.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.649+0000 7f4861ffb640 1 -- 172.21.15.60:0/259368941 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f485405a090 con 0x7f48640cc360 2024-09-12T01:39:14.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.860+0000 7f486b90a640 1 -- 172.21.15.60:0/259368941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f486415dc90 con 0x7f48640cc360 2024-09-12T01:39:14.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.900+0000 7f4861ffb640 1 -- 172.21.15.60:0/259368941 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) ==== 118+0+0 (secure 0 0 0) 0x7f4854059990 con 0x7f48640cc360 2024-09-12T01:39:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.902+0000 7f486b90a640 1 -- 172.21.15.60:0/259368941 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f485006be60 msgr2=0x7f485006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.902+0000 7f486b90a640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f485006be60 0x7f485006e320 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4858035000 tx=0x7f485800c040 comp rx=0 tx=0).stop 2024-09-12T01:39:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.902+0000 7f486b90a640 1 -- 172.21.15.60:0/259368941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48640cc360 msgr2=0x7f486414bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.902+0000 7f486b90a640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48640cc360 0x7f486414bed0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4854007e40 tx=0x7f485400e4b0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.902+0000 7f486b90a640 1 -- 172.21.15.60:0/259368941 shutdown_connections 2024-09-12T01:39:14.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.902+0000 7f486b90a640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f486415ad10 0x7f4864156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.902+0000 7f486b90a640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f485006be60 0x7f485006e320 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.902+0000 7f486b90a640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f48640cca40 0x7f4864156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.902+0000 7f486b90a640 1 --2- 172.21.15.60:0/259368941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48640cc360 0x7f486414bed0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.902+0000 7f486b90a640 1 -- 172.21.15.60:0/259368941 >> 172.21.15.60:0/259368941 conn(0x7f486406d0f0 msgr2=0x7f486406d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.903+0000 7f486b90a640 1 -- 172.21.15.60:0/259368941 shutdown_connections 2024-09-12T01:39:14.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:14.903+0000 7f486b90a640 1 -- 172.21.15.60:0/259368941 wait complete. 2024-09-12T01:39:14.913 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:39:14.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:39:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.019+0000 7efcc6cac640 1 Processor -- start 2024-09-12T01:39:15.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.019+0000 7efcc6cac640 1 -- start start 2024-09-12T01:39:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.020+0000 7efcc6cac640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efcc015e6f0 0x7efcc006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.020+0000 7efcc6cac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc00b7450 0x7efcc015f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.020+0000 7efcc6cac640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc006e990 con 0x7efcc00b54d0 2024-09-12T01:39:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.020+0000 7efcc6cac640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7efcc006ec70 con 0x7efcc015e6f0 2024-09-12T01:39:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.020+0000 7efcc6cac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efcc015ec70 con 0x7efcc00b7450 2024-09-12T01:39:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.020+0000 7efcc4a48640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efcc015e6f0 0x7efcc006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.020+0000 7efcc4a48640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efcc015e6f0 0x7efcc006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41602/0 (socket says 172.21.15.60:41602) 2024-09-12T01:39:15.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.020+0000 7efcc4a48640 1 -- 172.21.15.60:0/1506898738 learned_addr learned my addr 172.21.15.60:0/1506898738 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.020+0000 7efcc5249640 1 --2- 172.21.15.60:0/1506898738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc00b7450 0x7efcc015f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.021+0000 7efcc4a48640 1 -- 172.21.15.60:0/1506898738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc00b7450 msgr2=0x7efcc015f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.021+0000 7efcc4a48640 1 --2- 172.21.15.60:0/1506898738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc00b7450 0x7efcc015f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.021+0000 7efcc4a48640 1 -- 172.21.15.60:0/1506898738 >> v1:172.21.15.105:6789/0 conn(0x7efcc00b54d0 legacy=0x7efcc00b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.021+0000 7efcc4a48640 1 -- 172.21.15.60:0/1506898738 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc015ef50 con 0x7efcc015e6f0 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.021+0000 7efcc4a48640 1 --2- 172.21.15.60:0/1506898738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc015e6f0 0x7efcc006fd00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009870 tx=0x7efcb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb7b9cfa533f6f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.021+0000 7efcbf7fe640 1 -- 172.21.15.60:0/1506898738 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0037070 con 0x7efcc015e6f0 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.022+0000 7efcbf7fe640 1 -- 172.21.15.60:0/1506898738 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb0032440 con 0x7efcc015e6f0 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.022+0000 7efcbf7fe640 1 -- 172.21.15.60:0/1506898738 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0032810 con 0x7efcc015e6f0 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.022+0000 7efcc6cac640 1 -- 172.21.15.60:0/1506898738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc015e6f0 msgr2=0x7efcc006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.022+0000 7efcc6cac640 1 --2- 172.21.15.60:0/1506898738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc015e6f0 0x7efcc006fd00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009870 tx=0x7efcb002a270 comp rx=0 tx=0).stop 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.022+0000 7efcc6cac640 1 -- 172.21.15.60:0/1506898738 shutdown_connections 2024-09-12T01:39:15.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.022+0000 7efcc6cac640 1 --2- 172.21.15.60:0/1506898738 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc00b7450 0x7efcc015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:15.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.022+0000 7efcc6cac640 1 --2- 172.21.15.60:0/1506898738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc015e6f0 0x7efcc006fd00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:15.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.022+0000 7efcc6cac640 1 -- 172.21.15.60:0/1506898738 >> 172.21.15.60:0/1506898738 conn(0x7efcc00d2430 msgr2=0x7efcc00d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:15.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.022+0000 7efcc6cac640 1 -- 172.21.15.60:0/1506898738 shutdown_connections 2024-09-12T01:39:15.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.022+0000 7efcc6cac640 1 -- 172.21.15.60:0/1506898738 wait complete. 2024-09-12T01:39:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.023+0000 7efcc6cac640 1 Processor -- start 2024-09-12T01:39:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.023+0000 7efcc6cac640 1 -- start start 2024-09-12T01:39:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.024+0000 7efcc6cac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00b54d0 0x7efcc0150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.024+0000 7efcc6cac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc00b7450 0x7efcc015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.024+0000 7efcc6cac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc015e6f0 0x7efcc015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.024+0000 7efcc6cac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efcc006e730 con 0x7efcc00b54d0 2024-09-12T01:39:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.024+0000 7efcc6cac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efcc006e5b0 con 0x7efcc015e6f0 2024-09-12T01:39:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.024+0000 7efcc6cac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efcc0070830 con 0x7efcc00b7450 2024-09-12T01:39:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.024+0000 7efcc4a48640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00b54d0 0x7efcc0150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.024+0000 7efcc4a48640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00b54d0 0x7efcc0150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41618/0 (socket says 172.21.15.60:41618) 2024-09-12T01:39:15.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.024+0000 7efcc4a48640 1 -- 172.21.15.60:0/327580830 learned_addr learned my addr 172.21.15.60:0/327580830 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcc4a48640 1 -- 172.21.15.60:0/327580830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc00b7450 msgr2=0x7efcc015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcbffff640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc00b7450 0x7efcc015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcc5249640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc015e6f0 0x7efcc015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcc4a48640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc00b7450 0x7efcc015d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcc4a48640 1 -- 172.21.15.60:0/327580830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc015e6f0 msgr2=0x7efcc015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcc4a48640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc015e6f0 0x7efcc015d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcc4a48640 1 -- 172.21.15.60:0/327580830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc0154240 con 0x7efcc00b54d0 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcc5249640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc015e6f0 0x7efcc015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcc4a48640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00b54d0 0x7efcc0150e10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efcb0000c00 tx=0x7efcb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcbd7fa640 1 -- 172.21.15.60:0/327580830 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0041020 con 0x7efcc00b54d0 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcbd7fa640 1 -- 172.21.15.60:0/327580830 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb00306c0 con 0x7efcc00b54d0 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcc6cac640 1 -- 172.21.15.60:0/327580830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc0151350 con 0x7efcc00b54d0 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcbd7fa640 1 -- 172.21.15.60:0/327580830 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0037040 con 0x7efcc00b54d0 2024-09-12T01:39:15.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.025+0000 7efcc6cac640 1 -- 172.21.15.60:0/327580830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc0151ad0 con 0x7efcc00b54d0 2024-09-12T01:39:15.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.026+0000 7efcc6cac640 1 -- 172.21.15.60:0/327580830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc006c6c0 con 0x7efcc00b54d0 2024-09-12T01:39:15.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.027+0000 7efcbd7fa640 1 -- 172.21.15.60:0/327580830 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efcb0044020 con 0x7efcc00b54d0 2024-09-12T01:39:15.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.027+0000 7efcbd7fa640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efcac06be30 0x7efcac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:15.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.027+0000 7efcbffff640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efcac06be30 0x7efcac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:15.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.027+0000 7efcbd7fa640 1 -- 172.21.15.60:0/327580830 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7efcb00ab320 con 0x7efcc00b54d0 2024-09-12T01:39:15.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.028+0000 7efcbffff640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efcac06be30 0x7efcac06e2f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efcc01f7dd0 tx=0x7efcb4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:15.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.032+0000 7efcbd7fa640 1 -- 172.21.15.60:0/327580830 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efcb004b070 con 0x7efcc00b54d0 2024-09-12T01:39:15.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.247+0000 7efcc6cac640 1 -- 172.21.15.60:0/327580830 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7efcc006ad30 con 0x7efcc00b54d0 2024-09-12T01:39:15.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.901+0000 7efcbd7fa640 1 -- 172.21.15.60:0/327580830 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7efcc0154240 con 0x7efcc00b54d0 2024-09-12T01:39:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.905+0000 7efcc6cac640 1 -- 172.21.15.60:0/327580830 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efcac06be30 msgr2=0x7efcac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.905+0000 7efcc6cac640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efcac06be30 0x7efcac06e2f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efcc01f7dd0 tx=0x7efcb4009040 comp rx=0 tx=0).stop 2024-09-12T01:39:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.905+0000 7efcc6cac640 1 -- 172.21.15.60:0/327580830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00b54d0 msgr2=0x7efcc0150e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.905+0000 7efcc6cac640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00b54d0 0x7efcc0150e10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7efcb0000c00 tx=0x7efcb00046c0 comp rx=0 tx=0).stop 2024-09-12T01:39:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.905+0000 7efcc6cac640 1 -- 172.21.15.60:0/327580830 shutdown_connections 2024-09-12T01:39:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.905+0000 7efcc6cac640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efcc015e6f0 0x7efcc015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.905+0000 7efcc6cac640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efcac06be30 0x7efcac06e2f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.905+0000 7efcc6cac640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efcc00b7450 0x7efcc015d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.905+0000 7efcc6cac640 1 --2- 172.21.15.60:0/327580830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efcc00b54d0 0x7efcc0150e10 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:15.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.905+0000 7efcc6cac640 1 -- 172.21.15.60:0/327580830 >> 172.21.15.60:0/327580830 conn(0x7efcc00d2430 msgr2=0x7efcc00b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:15.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.906+0000 7efcc6cac640 1 -- 172.21.15.60:0/327580830 shutdown_connections 2024-09-12T01:39:15.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:15.906+0000 7efcc6cac640 1 -- 172.21.15.60:0/327580830 wait complete. 2024-09-12T01:39:15.918 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:39:15.919 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:39:16.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.028+0000 7f1243677640 1 Processor -- start 2024-09-12T01:39:16.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.028+0000 7f1243677640 1 -- start start 2024-09-12T01:39:16.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.029+0000 7f1243677640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f123c15e860 0x7f123c0d2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.029+0000 7f1243677640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f123c0b6870 0x7f123c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.029+0000 7f1243677640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f123c0d34c0 con 0x7f123c0d2ff0 2024-09-12T01:39:16.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.029+0000 7f1243677640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f123c0d40d0 con 0x7f123c15e860 2024-09-12T01:39:16.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.029+0000 7f1243677640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f123c0d37a0 con 0x7f123c0b6870 2024-09-12T01:39:16.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.029+0000 7f1241413640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f123c15e860 0x7f123c0d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.029+0000 7f1241413640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f123c15e860 0x7f123c0d2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41624/0 (socket says 172.21.15.60:41624) 2024-09-12T01:39:16.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.029+0000 7f1241413640 1 -- 172.21.15.60:0/3099592532 learned_addr learned my addr 172.21.15.60:0/3099592532 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:16.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.030+0000 7f1241c14640 1 --2- 172.21.15.60:0/3099592532 >> v2:172.21.15.105:3300/0 conn(0x7f123c0b6870 0x7f123c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.030+0000 7f1241413640 1 -- 172.21.15.60:0/3099592532 >> v2:172.21.15.105:3300/0 conn(0x7f123c0b6870 msgr2=0x7f123c0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:16.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.030+0000 7f1241413640 1 --2- 172.21.15.60:0/3099592532 >> v2:172.21.15.105:3300/0 conn(0x7f123c0b6870 0x7f123c0b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.030+0000 7f1241413640 1 -- 172.21.15.60:0/3099592532 >> v1:172.21.15.105:6789/0 conn(0x7f123c0d2ff0 legacy=0x7f123c0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:16.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.030+0000 7f1241413640 1 -- 172.21.15.60:0/3099592532 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123c0d3a80 con 0x7f123c15e860 2024-09-12T01:39:16.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.030+0000 7f1241413640 1 --2- 172.21.15.60:0/3099592532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f123c15e860 0x7f123c0d2ab0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f123c0b3660 tx=0x7f122c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96572b6a109eb53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:16.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.031+0000 7f123bfff640 1 -- 172.21.15.60:0/3099592532 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c036070 con 0x7f123c15e860 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.031+0000 7f123bfff640 1 -- 172.21.15.60:0/3099592532 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f122c031600 con 0x7f123c15e860 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.031+0000 7f123bfff640 1 -- 172.21.15.60:0/3099592532 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c0319d0 con 0x7f123c15e860 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.031+0000 7f1243677640 1 -- 172.21.15.60:0/3099592532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f123c15e860 msgr2=0x7f123c0d2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.031+0000 7f1243677640 1 --2- 172.21.15.60:0/3099592532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f123c15e860 0x7f123c0d2ab0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f123c0b3660 tx=0x7f122c02a6f0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.031+0000 7f1243677640 1 -- 172.21.15.60:0/3099592532 shutdown_connections 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.031+0000 7f1243677640 1 --2- 172.21.15.60:0/3099592532 >> v2:172.21.15.105:3300/0 conn(0x7f123c0b6870 0x7f123c0b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.031+0000 7f1243677640 1 --2- 172.21.15.60:0/3099592532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f123c15e860 0x7f123c0d2ab0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.031+0000 7f1243677640 1 -- 172.21.15.60:0/3099592532 >> 172.21.15.60:0/3099592532 conn(0x7f123c062c60 msgr2=0x7f123c0d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.031+0000 7f1243677640 1 -- 172.21.15.60:0/3099592532 shutdown_connections 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.031+0000 7f1243677640 1 -- 172.21.15.60:0/3099592532 wait complete. 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.033+0000 7f1243677640 1 Processor -- start 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.033+0000 7f1243677640 1 -- start start 2024-09-12T01:39:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.033+0000 7f1243677640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f123c0b6870 0x7f123c1520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.033+0000 7f1243677640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f123c0d2ff0 0x7f123c0c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.033+0000 7f1243677640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c15e860 0x7f123c15d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.033+0000 7f1243677640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f123c0b3a10 con 0x7f123c0d2ff0 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.033+0000 7f1243677640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f123c0b3890 con 0x7f123c15e860 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.033+0000 7f1243677640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f123c0b7dc0 con 0x7f123c0b6870 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.033+0000 7f1240c12640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f123c0d2ff0 0x7f123c0c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.033+0000 7f1240c12640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f123c0d2ff0 0x7f123c0c9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41638/0 (socket says 172.21.15.60:41638) 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.033+0000 7f1240c12640 1 -- 172.21.15.60:0/3325083958 learned_addr learned my addr 172.21.15.60:0/3325083958 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1241c14640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c15e860 0x7f123c15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1241413640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f123c0b6870 0x7f123c1520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1240c12640 1 -- 172.21.15.60:0/3325083958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f123c0b6870 msgr2=0x7f123c1520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1240c12640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f123c0b6870 0x7f123c1520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1240c12640 1 -- 172.21.15.60:0/3325083958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c15e860 msgr2=0x7f123c15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1240c12640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c15e860 0x7f123c15d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1240c12640 1 -- 172.21.15.60:0/3325083958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123c0ca420 con 0x7f123c0d2ff0 2024-09-12T01:39:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1241c14640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c15e860 0x7f123c15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1241413640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f123c0b6870 0x7f123c1520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1240c12640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f123c0d2ff0 0x7f123c0c9980 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f123000c400 tx=0x7f123000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1239ffb640 1 -- 172.21.15.60:0/3325083958 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230017070 con 0x7f123c0d2ff0 2024-09-12T01:39:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1239ffb640 1 -- 172.21.15.60:0/3325083958 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12300035f0 con 0x7f123c0d2ff0 2024-09-12T01:39:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1239ffb640 1 -- 172.21.15.60:0/3325083958 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230003a20 con 0x7f123c0d2ff0 2024-09-12T01:39:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1243677640 1 -- 172.21.15.60:0/3325083958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123c0cb850 con 0x7f123c0d2ff0 2024-09-12T01:39:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.034+0000 7f1243677640 1 -- 172.21.15.60:0/3325083958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123c0cbe10 con 0x7f123c0d2ff0 2024-09-12T01:39:16.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.035+0000 7f1243677640 1 -- 172.21.15.60:0/3325083958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f123c0b7880 con 0x7f123c0d2ff0 2024-09-12T01:39:16.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.036+0000 7f1239ffb640 1 -- 172.21.15.60:0/3325083958 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1230003bc0 con 0x7f123c0d2ff0 2024-09-12T01:39:16.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.036+0000 7f1239ffb640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f122806be30 0x7f122806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.036+0000 7f1239ffb640 1 -- 172.21.15.60:0/3325083958 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f123008a100 con 0x7f123c0d2ff0 2024-09-12T01:39:16.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.036+0000 7f1241413640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f122806be30 0x7f122806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.037+0000 7f1241413640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f122806be30 0x7f122806e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f122c033000 tx=0x7f122c009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:16.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.041+0000 7f1239ffb640 1 -- 172.21.15.60:0/3325083958 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12300010c0 con 0x7f123c0d2ff0 2024-09-12T01:39:16.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.251+0000 7f1243677640 1 -- 172.21.15.60:0/3325083958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f123c0cbfe0 con 0x7f123c0d2ff0 2024-09-12T01:39:16.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.252+0000 7f1239ffb640 1 -- 172.21.15.60:0/3325083958 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5230 (secure 0 0 0) 0x7f1230058460 con 0x7f123c0d2ff0 2024-09-12T01:39:16.252 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:16.253 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":44,"btime":"2024-09-12T01:39:15:900799+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5824,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4036885582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4036885582},{"type":"v1","addr":"172.21.15.105:6835","nonce":4036885582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2254947663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2254947663},{"type":"v1","addr":"172.21.15.60:6835","nonce":2254947663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3019966407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3019966407},{"type":"v1","addr":"172.21.15.60:6837","nonce":3019966407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:39:13.254252+0000","modified":"2024-09-12T01:39:15.248119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35375":{"gid":35375,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/95793246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":95793246},{"type":"v1","addr":"172.21.15.105:6834","nonce":95793246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35375,"qdb_cluster":[35375]},"id":6}]} 2024-09-12T01:39:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 44 2024-09-12T01:39:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.254+0000 7f1243677640 1 -- 172.21.15.60:0/3325083958 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f122806be30 msgr2=0x7f122806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.254+0000 7f1243677640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f122806be30 0x7f122806e2f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f122c033000 tx=0x7f122c009000 comp rx=0 tx=0).stop 2024-09-12T01:39:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.254+0000 7f1243677640 1 -- 172.21.15.60:0/3325083958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f123c0d2ff0 msgr2=0x7f123c0c9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.254+0000 7f1243677640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f123c0d2ff0 0x7f123c0c9980 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f123000c400 tx=0x7f123000c8c0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.254+0000 7f1243677640 1 -- 172.21.15.60:0/3325083958 shutdown_connections 2024-09-12T01:39:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.254+0000 7f1243677640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f123c15e860 0x7f123c15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.254+0000 7f1243677640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f123c0d2ff0 0x7f123c0c9980 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.254+0000 7f1243677640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f122806be30 0x7f122806e2f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.254+0000 7f1243677640 1 --2- 172.21.15.60:0/3325083958 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f123c0b6870 0x7f123c1520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.254+0000 7f1243677640 1 -- 172.21.15.60:0/3325083958 >> 172.21.15.60:0/3325083958 conn(0x7f123c062c60 msgr2=0x7f123c0b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:16.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.254+0000 7f1243677640 1 -- 172.21.15.60:0/3325083958 shutdown_connections 2024-09-12T01:39:16.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.254+0000 7f1243677640 1 -- 172.21.15.60:0/3325083958 wait complete. 2024-09-12T01:39:16.265 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:39:16.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.368+0000 7f90b3786640 1 Processor -- start 2024-09-12T01:39:16.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.368+0000 7f90b3786640 1 -- start start 2024-09-12T01:39:16.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.369+0000 7f90b3786640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f90ac0d1c80 0x7f90ac0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.369+0000 7f90b3786640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90ac0cfc20 con 0x7f90ac0b63d0 2024-09-12T01:39:16.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.369+0000 7f90b3786640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90ac0d2ed0 con 0x7f90ac0cf6b0 2024-09-12T01:39:16.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.369+0000 7f90b3786640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f90ac0d40c0 con 0x7f90ac0d1c80 2024-09-12T01:39:16.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.369+0000 7f90b1522640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f90ac0b63d0 0x7f90ac0d39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41838/0 (socket says 172.21.15.60:41838) 2024-09-12T01:39:16.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.369+0000 7f90b1522640 1 -- 172.21.15.60:0/153388685 learned_addr learned my addr 172.21.15.60:0/153388685 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:16.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90b1d23640 1 --2- 172.21.15.60:0/153388685 >> v2:172.21.15.105:3300/0 conn(0x7f90ac0d1c80 0x7f90ac0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652740389 0 0) 0x7f90ac0cfc20 con 0x7f90ac0b63d0 2024-09-12T01:39:16.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9094003520 con 0x7f90ac0b63d0 2024-09-12T01:39:16.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 224350520 0 0) 0x7f9094003520 con 0x7f90ac0b63d0 2024-09-12T01:39:16.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 >> v2:172.21.15.105:3300/0 conn(0x7f90ac0d1c80 msgr2=0x7f90ac0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:16.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 --2- 172.21.15.60:0/153388685 >> v2:172.21.15.105:3300/0 conn(0x7f90ac0d1c80 0x7f90ac0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 >> v1:172.21.15.105:6789/0 conn(0x7f90ac0cf6b0 legacy=0x7f90ac1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac0d31b0 con 0x7f90ac0b63d0 2024-09-12T01:39:16.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f90a4001670 con 0x7f90ac0b63d0 2024-09-12T01:39:16.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 >> v1:172.21.15.60:6789/0 conn(0x7f90ac0b63d0 legacy=0x7f90ac0d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 --2- 172.21.15.60:0/153388685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90940039b0 0x7f9094003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 --2- 172.21.15.60:0/153388685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9094004800 0x7f9094004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 --2- 172.21.15.60:0/153388685 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90940051c0 0x7f909400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac0d40c0 con 0x7f9094004800 2024-09-12T01:39:16.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f909400c160 con 0x7f90940039b0 2024-09-12T01:39:16.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f909400c360 con 0x7f90940051c0 2024-09-12T01:39:16.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90b0d21640 1 --2- 172.21.15.60:0/153388685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9094004800 0x7f9094004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90b1522640 1 --2- 172.21.15.60:0/153388685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90940039b0 0x7f9094003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90b1d23640 1 --2- 172.21.15.60:0/153388685 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90940051c0 0x7f909400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90b0d21640 1 -- 172.21.15.60:0/153388685 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90940051c0 msgr2=0x7f909400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:16.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90b0d21640 1 --2- 172.21.15.60:0/153388685 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90940051c0 0x7f909400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90b0d21640 1 -- 172.21.15.60:0/153388685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90940039b0 msgr2=0x7f9094003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:16.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90b0d21640 1 --2- 172.21.15.60:0/153388685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90940039b0 0x7f9094003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90b0d21640 1 -- 172.21.15.60:0/153388685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9094003520 con 0x7f9094004800 2024-09-12T01:39:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90b1d23640 1 -- 172.21.15.60:0/153388685 reap_dead start 2024-09-12T01:39:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.370+0000 7f90b1522640 1 --2- 172.21.15.60:0/153388685 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90940039b0 0x7f9094003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:39:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.371+0000 7f90b0d21640 1 --2- 172.21.15.60:0/153388685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9094004800 0x7f9094004c80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f90a0001750 tx=0x7f9094005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceddf214df0c1dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.371+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0001370 con 0x7f9094004800 2024-09-12T01:39:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.371+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a00052d0 con 0x7f9094004800 2024-09-12T01:39:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.371+0000 7f90abfff640 1 -- 172.21.15.60:0/153388685 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a002abc0 con 0x7f9094004800 2024-09-12T01:39:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.372+0000 7f90b3786640 1 -- 172.21.15.60:0/153388685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9094004800 msgr2=0x7f9094004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.372+0000 7f90b3786640 1 --2- 172.21.15.60:0/153388685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9094004800 0x7f9094004c80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f90a0001750 tx=0x7f9094005830 comp rx=0 tx=0).stop 2024-09-12T01:39:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.372+0000 7f90b3786640 1 -- 172.21.15.60:0/153388685 shutdown_connections 2024-09-12T01:39:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.372+0000 7f90b3786640 1 --2- 172.21.15.60:0/153388685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9094004800 0x7f9094004c80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.372+0000 7f90b3786640 1 -- 172.21.15.60:0/153388685 >> 172.21.15.60:0/153388685 conn(0x7f90ac0d1160 msgr2=0x7f90ac0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:16.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.372+0000 7f90b3786640 1 -- 172.21.15.60:0/153388685 shutdown_connections 2024-09-12T01:39:16.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.372+0000 7f90b3786640 1 -- 172.21.15.60:0/153388685 wait complete. 2024-09-12T01:39:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.373+0000 7f90b3786640 1 Processor -- start 2024-09-12T01:39:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.373+0000 7f90b3786640 1 -- start start 2024-09-12T01:39:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b3786640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9094004800 0x7f90ac0c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b3786640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90ac159310 0x7f90ac1e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b3786640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90ac0c9640 0x7f90ac1e9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b3786640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac0cb5c0 con 0x7f90ac0c9640 2024-09-12T01:39:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b3786640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac0cb440 con 0x7f9094004800 2024-09-12T01:39:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b3786640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f90ac0b67b0 con 0x7f90ac159310 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b1d23640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90ac0c9640 0x7f90ac1e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b1d23640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90ac0c9640 0x7f90ac1e9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41652/0 (socket says 172.21.15.60:41652) 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b1d23640 1 -- 172.21.15.60:0/2778627501 learned_addr learned my addr 172.21.15.60:0/2778627501 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b0d21640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90ac159310 0x7f90ac1e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b1522640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9094004800 0x7f90ac0c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b1d23640 1 -- 172.21.15.60:0/2778627501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90ac159310 msgr2=0x7f90ac1e92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b1d23640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90ac159310 0x7f90ac1e92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b1d23640 1 -- 172.21.15.60:0/2778627501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9094004800 msgr2=0x7f90ac0c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b1d23640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9094004800 0x7f90ac0c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.374+0000 7f90b1d23640 1 -- 172.21.15.60:0/2778627501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac0c9bf0 con 0x7f90ac0c9640 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.375+0000 7f90b1d23640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90ac0c9640 0x7f90ac1e9800 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f90ac08d870 tx=0x7f909c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.375+0000 7f90a9ffb640 1 -- 172.21.15.60:0/2778627501 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c00fc80 con 0x7f90ac0c9640 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.375+0000 7f90a9ffb640 1 -- 172.21.15.60:0/2778627501 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f909c01d070 con 0x7f90ac0c9640 2024-09-12T01:39:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.375+0000 7f90b3786640 1 -- 172.21.15.60:0/2778627501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac0c9ed0 con 0x7f90ac0c9640 2024-09-12T01:39:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.375+0000 7f90a9ffb640 1 -- 172.21.15.60:0/2778627501 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c015430 con 0x7f90ac0c9640 2024-09-12T01:39:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.375+0000 7f90b3786640 1 -- 172.21.15.60:0/2778627501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac0ca490 con 0x7f90ac0c9640 2024-09-12T01:39:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.376+0000 7f90b3786640 1 -- 172.21.15.60:0/2778627501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ac0ca690 con 0x7f90ac0c9640 2024-09-12T01:39:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.376+0000 7f90a9ffb640 1 -- 172.21.15.60:0/2778627501 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f909c0155d0 con 0x7f90ac0c9640 2024-09-12T01:39:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.377+0000 7f90a9ffb640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f909806be60 0x7f909806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.377+0000 7f90a9ffb640 1 -- 172.21.15.60:0/2778627501 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f909c08b6d0 con 0x7f90ac0c9640 2024-09-12T01:39:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.377+0000 7f90b1522640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f909806be60 0x7f909806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.378+0000 7f90b1522640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f909806be60 0x7f909806e320 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0ba3a0 tx=0x7f90a4007ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.381+0000 7f90a9ffb640 1 -- 172.21.15.60:0/2778627501 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90ac0ca690 con 0x7f90ac0c9640 2024-09-12T01:39:16.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.559+0000 7f90b3786640 1 -- 172.21.15.60:0/2778627501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f90ac0cf280 con 0x7f90ac0c9640 2024-09-12T01:39:16.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.560+0000 7f90a9ffb640 1 -- 172.21.15.60:0/2778627501 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+16696 (secure 0 0 0) 0x7f909c010040 con 0x7f90ac0c9640 2024-09-12T01:39:16.559 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:16.560 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":80,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:39:14.896332+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:39:11.226441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T01:39:12.232247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:39:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.562+0000 7f90b3786640 1 -- 172.21.15.60:0/2778627501 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f909806be60 msgr2=0x7f909806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.562+0000 7f90b3786640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f909806be60 0x7f909806e320 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f90ac0ba3a0 tx=0x7f90a4007ed0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.562+0000 7f90b3786640 1 -- 172.21.15.60:0/2778627501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90ac0c9640 msgr2=0x7f90ac1e9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.562+0000 7f90b3786640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90ac0c9640 0x7f90ac1e9800 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f90ac08d870 tx=0x7f909c00f1b0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.562+0000 7f90b3786640 1 -- 172.21.15.60:0/2778627501 shutdown_connections 2024-09-12T01:39:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.562+0000 7f90b3786640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90ac0c9640 0x7f90ac1e9800 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.562+0000 7f90b3786640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f909806be60 0x7f909806e320 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.562+0000 7f90b3786640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90ac159310 0x7f90ac1e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.562+0000 7f90b3786640 1 --2- 172.21.15.60:0/2778627501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9094004800 0x7f90ac0c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.562+0000 7f90b3786640 1 -- 172.21.15.60:0/2778627501 >> 172.21.15.60:0/2778627501 conn(0x7f90ac0d1160 msgr2=0x7f90ac1617b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:16.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.562+0000 7f90b3786640 1 -- 172.21.15.60:0/2778627501 shutdown_connections 2024-09-12T01:39:16.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.562+0000 7f90b3786640 1 -- 172.21.15.60:0/2778627501 wait complete. 2024-09-12T01:39:16.572 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:39:16.573 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:39:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.676+0000 7f3163077640 1 Processor -- start 2024-09-12T01:39:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.676+0000 7f3163077640 1 -- start start 2024-09-12T01:39:16.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.676+0000 7f3163077640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315c0d3310 0x7f315c0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.676+0000 7f3163077640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f315c0d1650 0x7f315c0b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.676+0000 7f3163077640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f315c15ea40 con 0x7f315c15e660 2024-09-12T01:39:16.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.676+0000 7f3163077640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f315c0d1ac0 con 0x7f315c0d1650 2024-09-12T01:39:16.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.676+0000 7f3163077640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f315c0d3870 con 0x7f315c0d3310 2024-09-12T01:39:16.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.677+0000 7f3161614640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f315c0d1650 0x7f315c0b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.677+0000 7f3161614640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f315c0d1650 0x7f315c0b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41666/0 (socket says 172.21.15.60:41666) 2024-09-12T01:39:16.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.677+0000 7f3161614640 1 -- 172.21.15.60:0/3170215867 learned_addr learned my addr 172.21.15.60:0/3170215867 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:16.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.677+0000 7f315bfff640 1 --2- 172.21.15.60:0/3170215867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315c0d3310 0x7f315c0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.677+0000 7f3161614640 1 -- 172.21.15.60:0/3170215867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315c0d3310 msgr2=0x7f315c0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:16.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.677+0000 7f3161614640 1 --2- 172.21.15.60:0/3170215867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315c0d3310 0x7f315c0d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.677+0000 7f3161614640 1 -- 172.21.15.60:0/3170215867 >> v1:172.21.15.105:6789/0 conn(0x7f315c15e660 legacy=0x7f315c0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.677+0000 7f3161614640 1 -- 172.21.15.60:0/3170215867 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c0d3b50 con 0x7f315c0d1650 2024-09-12T01:39:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.678+0000 7f3161614640 1 --2- 172.21.15.60:0/3170215867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f315c0d1650 0x7f315c0b7b70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f314c009870 tx=0x7f314c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574fd9e699975049 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.678+0000 7f315b7fe640 1 -- 172.21.15.60:0/3170215867 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c037070 con 0x7f315c0d1650 2024-09-12T01:39:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.678+0000 7f315b7fe640 1 -- 172.21.15.60:0/3170215867 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f314c032440 con 0x7f315c0d1650 2024-09-12T01:39:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.678+0000 7f315b7fe640 1 -- 172.21.15.60:0/3170215867 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314c032810 con 0x7f315c0d1650 2024-09-12T01:39:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.678+0000 7f3163077640 1 -- 172.21.15.60:0/3170215867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f315c0d1650 msgr2=0x7f315c0b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.678+0000 7f3163077640 1 --2- 172.21.15.60:0/3170215867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f315c0d1650 0x7f315c0b7b70 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f314c009870 tx=0x7f314c02a270 comp rx=0 tx=0).stop 2024-09-12T01:39:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.678+0000 7f3163077640 1 -- 172.21.15.60:0/3170215867 shutdown_connections 2024-09-12T01:39:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.678+0000 7f3163077640 1 --2- 172.21.15.60:0/3170215867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f315c0d1650 0x7f315c0b7b70 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.678+0000 7f3163077640 1 --2- 172.21.15.60:0/3170215867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315c0d3310 0x7f315c0d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.678+0000 7f3163077640 1 -- 172.21.15.60:0/3170215867 >> 172.21.15.60:0/3170215867 conn(0x7f315c0b6410 msgr2=0x7f315c0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:16.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.678+0000 7f3163077640 1 -- 172.21.15.60:0/3170215867 shutdown_connections 2024-09-12T01:39:16.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.678+0000 7f3163077640 1 -- 172.21.15.60:0/3170215867 wait complete. 2024-09-12T01:39:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.679+0000 7f3163077640 1 Processor -- start 2024-09-12T01:39:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.680+0000 7f3163077640 1 -- start start 2024-09-12T01:39:16.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.680+0000 7f3163077640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f315c0d1650 0x7f315c1f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.680+0000 7f3163077640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315c0d3310 0x7f315c15bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.680+0000 7f3163077640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f315c15e660 0x7f315c14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.680+0000 7f3163077640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0d43f0 con 0x7f315c0d1650 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.680+0000 7f3163077640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f315c0d4110 con 0x7f315c15e660 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.680+0000 7f3163077640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f315c0b80b0 con 0x7f315c0d3310 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.680+0000 7f3160e13640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f315c0d1650 0x7f315c1f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f3160e13640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f315c0d1650 0x7f315c1f49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41674/0 (socket says 172.21.15.60:41674) 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f3160e13640 1 -- 172.21.15.60:0/3157458787 learned_addr learned my addr 172.21.15.60:0/3157458787 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f315bfff640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315c0d3310 0x7f315c15bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f3161614640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f315c15e660 0x7f315c14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f3160e13640 1 -- 172.21.15.60:0/3157458787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315c0d3310 msgr2=0x7f315c15bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f3160e13640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315c0d3310 0x7f315c15bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f3160e13640 1 -- 172.21.15.60:0/3157458787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f315c15e660 msgr2=0x7f315c14f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f3160e13640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f315c15e660 0x7f315c14f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f3160e13640 1 -- 172.21.15.60:0/3157458787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f315c0cdcd0 con 0x7f315c0d1650 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f3160e13640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f315c0d1650 0x7f315c1f49b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f315400c730 tx=0x7f315400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f31597fa640 1 -- 172.21.15.60:0/3157458787 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154016020 con 0x7f315c0d1650 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f31597fa640 1 -- 172.21.15.60:0/3157458787 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3154006d50 con 0x7f315c0d1650 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f3163077640 1 -- 172.21.15.60:0/3157458787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f315c1f7950 con 0x7f315c0d1650 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f31597fa640 1 -- 172.21.15.60:0/3157458787 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3154003bb0 con 0x7f315c0d1650 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.681+0000 7f3163077640 1 -- 172.21.15.60:0/3157458787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315c1f7f10 con 0x7f315c0d1650 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.682+0000 7f3163077640 1 -- 172.21.15.60:0/3157458787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315c0b7b70 con 0x7f315c0d1650 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.683+0000 7f31597fa640 1 -- 172.21.15.60:0/3157458787 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f315400a850 con 0x7f315c0d1650 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.683+0000 7f31597fa640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f313c06be30 0x7f313c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.683+0000 7f31597fa640 1 -- 172.21.15.60:0/3157458787 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f315408a900 con 0x7f315c0d1650 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.683+0000 7f315bfff640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f313c06be30 0x7f313c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.684+0000 7f315bfff640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f313c06be30 0x7f313c06e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f315c0b9d40 tx=0x7f3144008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:16.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.688+0000 7f31597fa640 1 -- 172.21.15.60:0/3157458787 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3154020020 con 0x7f315c0d1650 2024-09-12T01:39:16.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.860+0000 7f3163077640 1 -- 172.21.15.60:0/3157458787 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f315c0cdeb0 con 0x7f313c06be30 2024-09-12T01:39:16.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.866+0000 7f31597fa640 1 -- 172.21.15.60:0/3157458787 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251752 (secure 0 0 0) 0x7f315c0cdeb0 con 0x7f313c06be30 2024-09-12T01:39:16.868 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:16.870 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:39:16.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.869+0000 7f3163077640 1 -- 172.21.15.60:0/3157458787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f313c06be30 msgr2=0x7f313c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.869+0000 7f3163077640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f313c06be30 0x7f313c06e2f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f315c0b9d40 tx=0x7f3144008040 comp rx=0 tx=0).stop 2024-09-12T01:39:16.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.869+0000 7f3163077640 1 -- 172.21.15.60:0/3157458787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f315c0d1650 msgr2=0x7f315c1f49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:16.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.869+0000 7f3163077640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f315c0d1650 0x7f315c1f49b0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f315400c730 tx=0x7f315400cbf0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.869+0000 7f3163077640 1 -- 172.21.15.60:0/3157458787 shutdown_connections 2024-09-12T01:39:16.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.869+0000 7f3163077640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f315c15e660 0x7f315c14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.869+0000 7f3163077640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f313c06be30 0x7f313c06e2f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.869+0000 7f3163077640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f315c0d3310 0x7f315c15bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.869+0000 7f3163077640 1 --2- 172.21.15.60:0/3157458787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f315c0d1650 0x7f315c1f49b0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:16.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.869+0000 7f3163077640 1 -- 172.21.15.60:0/3157458787 >> 172.21.15.60:0/3157458787 conn(0x7f315c0b6410 msgr2=0x7f315c15cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:16.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.869+0000 7f3163077640 1 -- 172.21.15.60:0/3157458787 shutdown_connections 2024-09-12T01:39:16.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:16.869+0000 7f3163077640 1 -- 172.21.15.60:0/3157458787 wait complete. 2024-09-12T01:39:16.879 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-12T01:39:16.302391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266616,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754708104,"statfs":{"total":773094113280,"available":772821098496,"internally_reserved":0,"allocated":8986624,"data_stored":4416403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.425526"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187288+0000","last_change":"2024-09-12T01:39:13.904548+0000","last_active":"2024-09-12T01:39:15.187288+0000","last_peered":"2024-09-12T01:39:15.187288+0000","last_clean":"2024-09-12T01:39:15.187288+0000","last_became_active":"2024-09-12T01:39:13.904009+0000","last_became_peered":"2024-09-12T01:39:13.904009+0000","last_unstale":"2024-09-12T01:39:15.187288+0000","last_undegraded":"2024-09-12T01:39:15.187288+0000","last_fullsized":"2024-09-12T01:39:15.187288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:02.473545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.888137+0000","last_change":"2024-09-12T01:39:12.888137+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.888137+0000","last_undegraded":"2024-09-12T01:39:12.888137+0000","last_fullsized":"2024-09-12T01:39:12.888137+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903174+0000","last_change":"2024-09-12T01:39:13.904153+0000","last_active":"2024-09-12T01:39:14.903174+0000","last_peered":"2024-09-12T01:39:14.903174+0000","last_clean":"2024-09-12T01:39:14.903174+0000","last_became_active":"2024-09-12T01:39:13.903587+0000","last_became_peered":"2024-09-12T01:39:13.903587+0000","last_unstale":"2024-09-12T01:39:14.903174+0000","last_undegraded":"2024-09-12T01:39:14.903174+0000","last_fullsized":"2024-09-12T01:39:14.903174+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:08.179408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908266+0000","last_change":"2024-09-12T01:39:13.898785+0000","last_active":"2024-09-12T01:39:14.908266+0000","last_peered":"2024-09-12T01:39:14.908266+0000","last_clean":"2024-09-12T01:39:14.908266+0000","last_became_active":"2024-09-12T01:39:13.898498+0000","last_became_peered":"2024-09-12T01:39:13.898498+0000","last_unstale":"2024-09-12T01:39:14.908266+0000","last_undegraded":"2024-09-12T01:39:14.908266+0000","last_fullsized":"2024-09-12T01:39:14.908266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:55.328047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128776+0000","last_change":"2024-09-12T01:39:13.900646+0000","last_active":"2024-09-12T01:39:15.128776+0000","last_peered":"2024-09-12T01:39:15.128776+0000","last_clean":"2024-09-12T01:39:15.128776+0000","last_became_active":"2024-09-12T01:39:13.899584+0000","last_became_peered":"2024-09-12T01:39:13.899584+0000","last_unstale":"2024-09-12T01:39:15.128776+0000","last_undegraded":"2024-09-12T01:39:15.128776+0000","last_fullsized":"2024-09-12T01:39:15.128776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:08.313862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902900+0000","last_change":"2024-09-12T01:39:13.897523+0000","last_active":"2024-09-12T01:39:14.902900+0000","last_peered":"2024-09-12T01:39:14.902900+0000","last_clean":"2024-09-12T01:39:14.902900+0000","last_became_active":"2024-09-12T01:39:13.897250+0000","last_became_peered":"2024-09-12T01:39:13.897250+0000","last_unstale":"2024-09-12T01:39:14.902900+0000","last_undegraded":"2024-09-12T01:39:14.902900+0000","last_fullsized":"2024-09-12T01:39:14.902900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:03.256051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.888049+0000","last_change":"2024-09-12T01:39:12.888049+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.888049+0000","last_undegraded":"2024-09-12T01:39:12.888049+0000","last_fullsized":"2024-09-12T01:39:12.888049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187991+0000","last_change":"2024-09-12T01:39:13.910043+0000","last_active":"2024-09-12T01:39:15.187991+0000","last_peered":"2024-09-12T01:39:15.187991+0000","last_clean":"2024-09-12T01:39:15.187991+0000","last_became_active":"2024-09-12T01:39:13.909698+0000","last_became_peered":"2024-09-12T01:39:13.909698+0000","last_unstale":"2024-09-12T01:39:15.187991+0000","last_undegraded":"2024-09-12T01:39:15.187991+0000","last_fullsized":"2024-09-12T01:39:15.187991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:08.179408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187332+0000","last_change":"2024-09-12T01:39:13.903280+0000","last_active":"2024-09-12T01:39:15.187332+0000","last_peered":"2024-09-12T01:39:15.187332+0000","last_clean":"2024-09-12T01:39:15.187332+0000","last_became_active":"2024-09-12T01:39:13.902331+0000","last_became_peered":"2024-09-12T01:39:13.902331+0000","last_unstale":"2024-09-12T01:39:15.187332+0000","last_undegraded":"2024-09-12T01:39:15.187332+0000","last_fullsized":"2024-09-12T01:39:15.187332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:28.988150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903142+0000","last_change":"2024-09-12T01:39:13.895633+0000","last_active":"2024-09-12T01:39:14.903142+0000","last_peered":"2024-09-12T01:39:14.903142+0000","last_clean":"2024-09-12T01:39:14.903142+0000","last_became_active":"2024-09-12T01:39:13.895342+0000","last_became_peered":"2024-09-12T01:39:13.895342+0000","last_unstale":"2024-09-12T01:39:14.903142+0000","last_undegraded":"2024-09-12T01:39:14.903142+0000","last_fullsized":"2024-09-12T01:39:14.903142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:44.878735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188188+0000","last_change":"2024-09-12T01:39:13.908537+0000","last_active":"2024-09-12T01:39:15.188188+0000","last_peered":"2024-09-12T01:39:15.188188+0000","last_clean":"2024-09-12T01:39:15.188188+0000","last_became_active":"2024-09-12T01:39:13.908193+0000","last_became_peered":"2024-09-12T01:39:13.908193+0000","last_unstale":"2024-09-12T01:39:15.188188+0000","last_undegraded":"2024-09-12T01:39:15.188188+0000","last_fullsized":"2024-09-12T01:39:15.188188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:50.638963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188087+0000","last_change":"2024-09-12T01:39:13.911076+0000","last_active":"2024-09-12T01:39:15.188087+0000","last_peered":"2024-09-12T01:39:15.188087+0000","last_clean":"2024-09-12T01:39:15.188087+0000","last_became_active":"2024-09-12T01:39:13.910824+0000","last_became_peered":"2024-09-12T01:39:13.910824+0000","last_unstale":"2024-09-12T01:39:15.188087+0000","last_undegraded":"2024-09-12T01:39:15.188087+0000","last_fullsized":"2024-09-12T01:39:15.188087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:25.363826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128818+0000","last_change":"2024-09-12T01:39:13.904087+0000","last_active":"2024-09-12T01:39:15.128818+0000","last_peered":"2024-09-12T01:39:15.128818+0000","last_clean":"2024-09-12T01:39:15.128818+0000","last_became_active":"2024-09-12T01:39:13.903799+0000","last_became_peered":"2024-09-12T01:39:13.903799+0000","last_unstale":"2024-09-12T01:39:15.128818+0000","last_undegraded":"2024-09-12T01:39:15.128818+0000","last_fullsized":"2024-09-12T01:39:15.128818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:47.515101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187275+0000","last_change":"2024-09-12T01:39:13.897466+0000","last_active":"2024-09-12T01:39:15.187275+0000","last_peered":"2024-09-12T01:39:15.187275+0000","last_clean":"2024-09-12T01:39:15.187275+0000","last_became_active":"2024-09-12T01:39:13.897050+0000","last_became_peered":"2024-09-12T01:39:13.897050+0000","last_unstale":"2024-09-12T01:39:15.187275+0000","last_undegraded":"2024-09-12T01:39:15.187275+0000","last_fullsized":"2024-09-12T01:39:15.187275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:00.820023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.887593+0000","last_change":"2024-09-12T01:39:12.887593+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.887593+0000","last_undegraded":"2024-09-12T01:39:12.887593+0000","last_fullsized":"2024-09-12T01:39:12.887593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902706+0000","last_change":"2024-09-12T01:39:13.895475+0000","last_active":"2024-09-12T01:39:14.902706+0000","last_peered":"2024-09-12T01:39:14.902706+0000","last_clean":"2024-09-12T01:39:14.902706+0000","last_became_active":"2024-09-12T01:39:13.894932+0000","last_became_peered":"2024-09-12T01:39:13.894932+0000","last_unstale":"2024-09-12T01:39:14.902706+0000","last_undegraded":"2024-09-12T01:39:14.902706+0000","last_fullsized":"2024-09-12T01:39:14.902706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.815960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187867+0000","last_change":"2024-09-12T01:39:13.911725+0000","last_active":"2024-09-12T01:39:15.187867+0000","last_peered":"2024-09-12T01:39:15.187867+0000","last_clean":"2024-09-12T01:39:15.187867+0000","last_became_active":"2024-09-12T01:39:13.911467+0000","last_became_peered":"2024-09-12T01:39:13.911467+0000","last_unstale":"2024-09-12T01:39:15.187867+0000","last_undegraded":"2024-09-12T01:39:15.187867+0000","last_fullsized":"2024-09-12T01:39:15.187867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.891062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188053+0000","last_change":"2024-09-12T01:39:13.909003+0000","last_active":"2024-09-12T01:39:15.188053+0000","last_peered":"2024-09-12T01:39:15.188053+0000","last_clean":"2024-09-12T01:39:15.188053+0000","last_became_active":"2024-09-12T01:39:13.908524+0000","last_became_peered":"2024-09-12T01:39:13.908524+0000","last_unstale":"2024-09-12T01:39:15.188053+0000","last_undegraded":"2024-09-12T01:39:15.188053+0000","last_fullsized":"2024-09-12T01:39:15.188053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:33.298540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187966+0000","last_change":"2024-09-12T01:39:13.905486+0000","last_active":"2024-09-12T01:39:15.187966+0000","last_peered":"2024-09-12T01:39:15.187966+0000","last_clean":"2024-09-12T01:39:15.187966+0000","last_became_active":"2024-09-12T01:39:13.905182+0000","last_became_peered":"2024-09-12T01:39:13.905182+0000","last_unstale":"2024-09-12T01:39:15.187966+0000","last_undegraded":"2024-09-12T01:39:15.187966+0000","last_fullsized":"2024-09-12T01:39:15.187966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:55.372979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187642+0000","last_change":"2024-09-12T01:39:13.897112+0000","last_active":"2024-09-12T01:39:15.187642+0000","last_peered":"2024-09-12T01:39:15.187642+0000","last_clean":"2024-09-12T01:39:15.187642+0000","last_became_active":"2024-09-12T01:39:13.896837+0000","last_became_peered":"2024-09-12T01:39:13.896837+0000","last_unstale":"2024-09-12T01:39:15.187642+0000","last_undegraded":"2024-09-12T01:39:15.187642+0000","last_fullsized":"2024-09-12T01:39:15.187642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:03.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907959+0000","last_change":"2024-09-12T01:39:13.904696+0000","last_active":"2024-09-12T01:39:14.907959+0000","last_peered":"2024-09-12T01:39:14.907959+0000","last_clean":"2024-09-12T01:39:14.907959+0000","last_became_active":"2024-09-12T01:39:13.904425+0000","last_became_peered":"2024-09-12T01:39:13.904425+0000","last_unstale":"2024-09-12T01:39:14.907959+0000","last_undegraded":"2024-09-12T01:39:14.907959+0000","last_fullsized":"2024-09-12T01:39:14.907959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:05.731459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187483+0000","last_change":"2024-09-12T01:39:13.901168+0000","last_active":"2024-09-12T01:39:15.187483+0000","last_peered":"2024-09-12T01:39:15.187483+0000","last_clean":"2024-09-12T01:39:15.187483+0000","last_became_active":"2024-09-12T01:39:13.900885+0000","last_became_peered":"2024-09-12T01:39:13.900885+0000","last_unstale":"2024-09-12T01:39:15.187483+0000","last_undegraded":"2024-09-12T01:39:15.187483+0000","last_fullsized":"2024-09-12T01:39:15.187483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:53.244610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187508+0000","last_change":"2024-09-12T01:39:13.910971+0000","last_active":"2024-09-12T01:39:15.187508+0000","last_peered":"2024-09-12T01:39:15.187508+0000","last_clean":"2024-09-12T01:39:15.187508+0000","last_became_active":"2024-09-12T01:39:13.910683+0000","last_became_peered":"2024-09-12T01:39:13.910683+0000","last_unstale":"2024-09-12T01:39:15.187508+0000","last_undegraded":"2024-09-12T01:39:15.187508+0000","last_fullsized":"2024-09-12T01:39:15.187508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:55.097048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187458+0000","last_change":"2024-09-12T01:39:13.903528+0000","last_active":"2024-09-12T01:39:15.187458+0000","last_peered":"2024-09-12T01:39:15.187458+0000","last_clean":"2024-09-12T01:39:15.187458+0000","last_became_active":"2024-09-12T01:39:13.902574+0000","last_became_peered":"2024-09-12T01:39:13.902574+0000","last_unstale":"2024-09-12T01:39:15.187458+0000","last_undegraded":"2024-09-12T01:39:15.187458+0000","last_fullsized":"2024-09-12T01:39:15.187458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.253305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188136+0000","last_change":"2024-09-12T01:39:13.914204+0000","last_active":"2024-09-12T01:39:15.188136+0000","last_peered":"2024-09-12T01:39:15.188136+0000","last_clean":"2024-09-12T01:39:15.188136+0000","last_became_active":"2024-09-12T01:39:13.913793+0000","last_became_peered":"2024-09-12T01:39:13.913793+0000","last_unstale":"2024-09-12T01:39:15.188136+0000","last_undegraded":"2024-09-12T01:39:15.188136+0000","last_fullsized":"2024-09-12T01:39:15.188136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:39.460105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129102+0000","last_change":"2024-09-12T01:39:13.904244+0000","last_active":"2024-09-12T01:39:15.129102+0000","last_peered":"2024-09-12T01:39:15.129102+0000","last_clean":"2024-09-12T01:39:15.129102+0000","last_became_active":"2024-09-12T01:39:13.903977+0000","last_became_peered":"2024-09-12T01:39:13.903977+0000","last_unstale":"2024-09-12T01:39:15.129102+0000","last_undegraded":"2024-09-12T01:39:15.129102+0000","last_fullsized":"2024-09-12T01:39:15.129102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:25.368830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129071+0000","last_change":"2024-09-12T01:39:13.898284+0000","last_active":"2024-09-12T01:39:15.129071+0000","last_peered":"2024-09-12T01:39:15.129071+0000","last_clean":"2024-09-12T01:39:15.129071+0000","last_became_active":"2024-09-12T01:39:13.898019+0000","last_became_peered":"2024-09-12T01:39:13.898019+0000","last_unstale":"2024-09-12T01:39:15.129071+0000","last_undegraded":"2024-09-12T01:39:15.129071+0000","last_fullsized":"2024-09-12T01:39:15.129071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:56.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187418+0000","last_change":"2024-09-12T01:39:13.905161+0000","last_active":"2024-09-12T01:39:15.187418+0000","last_peered":"2024-09-12T01:39:15.187418+0000","last_clean":"2024-09-12T01:39:15.187418+0000","last_became_active":"2024-09-12T01:39:13.902828+0000","last_became_peered":"2024-09-12T01:39:13.902828+0000","last_unstale":"2024-09-12T01:39:15.187418+0000","last_undegraded":"2024-09-12T01:39:15.187418+0000","last_fullsized":"2024-09-12T01:39:15.187418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:48.165883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908214+0000","last_change":"2024-09-12T01:39:13.903914+0000","last_active":"2024-09-12T01:39:14.908214+0000","last_peered":"2024-09-12T01:39:14.908214+0000","last_clean":"2024-09-12T01:39:14.908214+0000","last_became_active":"2024-09-12T01:39:13.903632+0000","last_became_peered":"2024-09-12T01:39:13.903632+0000","last_unstale":"2024-09-12T01:39:14.908214+0000","last_undegraded":"2024-09-12T01:39:14.908214+0000","last_fullsized":"2024-09-12T01:39:14.908214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:41.271935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187447+0000","last_change":"2024-09-12T01:39:13.900164+0000","last_active":"2024-09-12T01:39:15.187447+0000","last_peered":"2024-09-12T01:39:15.187447+0000","last_clean":"2024-09-12T01:39:15.187447+0000","last_became_active":"2024-09-12T01:39:13.899484+0000","last_became_peered":"2024-09-12T01:39:13.899484+0000","last_unstale":"2024-09-12T01:39:15.187447+0000","last_undegraded":"2024-09-12T01:39:15.187447+0000","last_fullsized":"2024-09-12T01:39:15.187447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:50.818822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902704+0000","last_change":"2024-09-12T01:39:13.894221+0000","last_active":"2024-09-12T01:39:14.902704+0000","last_peered":"2024-09-12T01:39:14.902704+0000","last_clean":"2024-09-12T01:39:14.902704+0000","last_became_active":"2024-09-12T01:39:13.893930+0000","last_became_peered":"2024-09-12T01:39:13.893930+0000","last_unstale":"2024-09-12T01:39:14.902704+0000","last_undegraded":"2024-09-12T01:39:14.902704+0000","last_fullsized":"2024-09-12T01:39:14.902704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:55.097048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902909+0000","last_change":"2024-09-12T01:39:13.894931+0000","last_active":"2024-09-12T01:39:14.902909+0000","last_peered":"2024-09-12T01:39:14.902909+0000","last_clean":"2024-09-12T01:39:14.902909+0000","last_became_active":"2024-09-12T01:39:13.894587+0000","last_became_peered":"2024-09-12T01:39:13.894587+0000","last_unstale":"2024-09-12T01:39:14.902909+0000","last_undegraded":"2024-09-12T01:39:14.902909+0000","last_fullsized":"2024-09-12T01:39:14.902909+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:56.121397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187568+0000","last_change":"2024-09-12T01:39:13.915079+0000","last_active":"2024-09-12T01:39:15.187568+0000","last_peered":"2024-09-12T01:39:15.187568+0000","last_clean":"2024-09-12T01:39:15.187568+0000","last_became_active":"2024-09-12T01:39:13.914761+0000","last_became_peered":"2024-09-12T01:39:13.914761+0000","last_unstale":"2024-09-12T01:39:15.187568+0000","last_undegraded":"2024-09-12T01:39:15.187568+0000","last_fullsized":"2024-09-12T01:39:15.187568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.815960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129105+0000","last_change":"2024-09-12T01:39:12.896630+0000","last_active":"2024-09-12T01:39:15.129105+0000","last_peered":"2024-09-12T01:39:15.129105+0000","last_clean":"2024-09-12T01:39:15.129105+0000","last_became_active":"2024-09-12T01:39:12.896343+0000","last_became_peered":"2024-09-12T01:39:12.896343+0000","last_unstale":"2024-09-12T01:39:15.129105+0000","last_undegraded":"2024-09-12T01:39:15.129105+0000","last_fullsized":"2024-09-12T01:39:15.129105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:40.029147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187440+0000","last_change":"2024-09-12T01:39:13.904295+0000","last_active":"2024-09-12T01:39:15.187440+0000","last_peered":"2024-09-12T01:39:15.187440+0000","last_clean":"2024-09-12T01:39:15.187440+0000","last_became_active":"2024-09-12T01:39:13.903604+0000","last_became_peered":"2024-09-12T01:39:13.903604+0000","last_unstale":"2024-09-12T01:39:15.187440+0000","last_undegraded":"2024-09-12T01:39:15.187440+0000","last_fullsized":"2024-09-12T01:39:15.187440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:18.193470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903131+0000","last_change":"2024-09-12T01:39:12.896766+0000","last_active":"2024-09-12T01:39:14.903131+0000","last_peered":"2024-09-12T01:39:14.903131+0000","last_clean":"2024-09-12T01:39:14.903131+0000","last_became_active":"2024-09-12T01:39:12.896143+0000","last_became_peered":"2024-09-12T01:39:12.896143+0000","last_unstale":"2024-09-12T01:39:14.903131+0000","last_undegraded":"2024-09-12T01:39:14.903131+0000","last_fullsized":"2024-09-12T01:39:14.903131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:00.120318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188090+0000","last_change":"2024-09-12T01:39:13.914121+0000","last_active":"2024-09-12T01:39:15.188090+0000","last_peered":"2024-09-12T01:39:15.188090+0000","last_clean":"2024-09-12T01:39:15.188090+0000","last_became_active":"2024-09-12T01:39:13.913818+0000","last_became_peered":"2024-09-12T01:39:13.913818+0000","last_unstale":"2024-09-12T01:39:15.188090+0000","last_undegraded":"2024-09-12T01:39:15.188090+0000","last_fullsized":"2024-09-12T01:39:15.188090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:20.834108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188191+0000","last_change":"2024-09-12T01:39:12.898592+0000","last_active":"2024-09-12T01:39:15.188191+0000","last_peered":"2024-09-12T01:39:15.188191+0000","last_clean":"2024-09-12T01:39:15.188191+0000","last_became_active":"2024-09-12T01:39:12.898312+0000","last_became_peered":"2024-09-12T01:39:12.898312+0000","last_unstale":"2024-09-12T01:39:15.188191+0000","last_undegraded":"2024-09-12T01:39:15.188191+0000","last_fullsized":"2024-09-12T01:39:15.188191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:52.356993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187617+0000","last_change":"2024-09-12T01:39:13.912780+0000","last_active":"2024-09-12T01:39:15.187617+0000","last_peered":"2024-09-12T01:39:15.187617+0000","last_clean":"2024-09-12T01:39:15.187617+0000","last_became_active":"2024-09-12T01:39:13.912419+0000","last_became_peered":"2024-09-12T01:39:13.912419+0000","last_unstale":"2024-09-12T01:39:15.187617+0000","last_undegraded":"2024-09-12T01:39:15.187617+0000","last_fullsized":"2024-09-12T01:39:15.187617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:38.977876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908254+0000","last_change":"2024-09-12T01:39:12.897577+0000","last_active":"2024-09-12T01:39:14.908254+0000","last_peered":"2024-09-12T01:39:14.908254+0000","last_clean":"2024-09-12T01:39:14.908254+0000","last_became_active":"2024-09-12T01:39:12.897230+0000","last_became_peered":"2024-09-12T01:39:12.897230+0000","last_unstale":"2024-09-12T01:39:14.908254+0000","last_undegraded":"2024-09-12T01:39:14.908254+0000","last_fullsized":"2024-09-12T01:39:14.908254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.116323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908050+0000","last_change":"2024-09-12T01:39:13.908787+0000","last_active":"2024-09-12T01:39:14.908050+0000","last_peered":"2024-09-12T01:39:14.908050+0000","last_clean":"2024-09-12T01:39:14.908050+0000","last_became_active":"2024-09-12T01:39:13.908549+0000","last_became_peered":"2024-09-12T01:39:13.908549+0000","last_unstale":"2024-09-12T01:39:14.908050+0000","last_undegraded":"2024-09-12T01:39:14.908050+0000","last_fullsized":"2024-09-12T01:39:14.908050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:02.236054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187564+0000","last_change":"2024-09-12T01:39:12.899469+0000","last_active":"2024-09-12T01:39:15.187564+0000","last_peered":"2024-09-12T01:39:15.187564+0000","last_clean":"2024-09-12T01:39:15.187564+0000","last_became_active":"2024-09-12T01:39:12.899173+0000","last_became_peered":"2024-09-12T01:39:12.899173+0000","last_unstale":"2024-09-12T01:39:15.187564+0000","last_undegraded":"2024-09-12T01:39:15.187564+0000","last_fullsized":"2024-09-12T01:39:15.187564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:17.188396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902965+0000","last_change":"2024-09-12T01:39:13.900761+0000","last_active":"2024-09-12T01:39:14.902965+0000","last_peered":"2024-09-12T01:39:14.902965+0000","last_clean":"2024-09-12T01:39:14.902965+0000","last_became_active":"2024-09-12T01:39:13.900441+0000","last_became_peered":"2024-09-12T01:39:13.900441+0000","last_unstale":"2024-09-12T01:39:14.902965+0000","last_undegraded":"2024-09-12T01:39:14.902965+0000","last_fullsized":"2024-09-12T01:39:14.902965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.891062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902865+0000","last_change":"2024-09-12T01:39:12.901743+0000","last_active":"2024-09-12T01:39:14.902865+0000","last_peered":"2024-09-12T01:39:14.902865+0000","last_clean":"2024-09-12T01:39:14.902865+0000","last_became_active":"2024-09-12T01:39:12.901418+0000","last_became_peered":"2024-09-12T01:39:12.901418+0000","last_unstale":"2024-09-12T01:39:14.902865+0000","last_undegraded":"2024-09-12T01:39:14.902865+0000","last_fullsized":"2024-09-12T01:39:14.902865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:27.983076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187162+0000","last_change":"2024-09-12T01:39:13.898011+0000","last_active":"2024-09-12T01:39:15.187162+0000","last_peered":"2024-09-12T01:39:15.187162+0000","last_clean":"2024-09-12T01:39:15.187162+0000","last_became_active":"2024-09-12T01:39:13.897644+0000","last_became_peered":"2024-09-12T01:39:13.897644+0000","last_unstale":"2024-09-12T01:39:15.187162+0000","last_undegraded":"2024-09-12T01:39:15.187162+0000","last_fullsized":"2024-09-12T01:39:15.187162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:03.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187381+0000","last_change":"2024-09-12T01:39:12.901437+0000","last_active":"2024-09-12T01:39:15.187381+0000","last_peered":"2024-09-12T01:39:15.187381+0000","last_clean":"2024-09-12T01:39:15.187381+0000","last_became_active":"2024-09-12T01:39:12.901120+0000","last_became_peered":"2024-09-12T01:39:12.901120+0000","last_unstale":"2024-09-12T01:39:15.187381+0000","last_undegraded":"2024-09-12T01:39:15.187381+0000","last_fullsized":"2024-09-12T01:39:15.187381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:18.265444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187431+0000","last_change":"2024-09-12T01:39:13.896873+0000","last_active":"2024-09-12T01:39:15.187431+0000","last_peered":"2024-09-12T01:39:15.187431+0000","last_clean":"2024-09-12T01:39:15.187431+0000","last_became_active":"2024-09-12T01:39:13.896578+0000","last_became_peered":"2024-09-12T01:39:13.896578+0000","last_unstale":"2024-09-12T01:39:15.187431+0000","last_undegraded":"2024-09-12T01:39:15.187431+0000","last_fullsized":"2024-09-12T01:39:15.187431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:53.362068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187132+0000","last_change":"2024-09-12T01:39:12.903658+0000","last_active":"2024-09-12T01:39:15.187132+0000","last_peered":"2024-09-12T01:39:15.187132+0000","last_clean":"2024-09-12T01:39:15.187132+0000","last_became_active":"2024-09-12T01:39:12.903455+0000","last_became_peered":"2024-09-12T01:39:12.903455+0000","last_unstale":"2024-09-12T01:39:15.187132+0000","last_undegraded":"2024-09-12T01:39:15.187132+0000","last_fullsized":"2024-09-12T01:39:15.187132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:07.523595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187442+0000","last_change":"2024-09-12T01:39:13.906892+0000","last_active":"2024-09-12T01:39:15.187442+0000","last_peered":"2024-09-12T01:39:15.187442+0000","last_clean":"2024-09-12T01:39:15.187442+0000","last_became_active":"2024-09-12T01:39:13.906624+0000","last_became_peered":"2024-09-12T01:39:13.906624+0000","last_unstale":"2024-09-12T01:39:15.187442+0000","last_undegraded":"2024-09-12T01:39:15.187442+0000","last_fullsized":"2024-09-12T01:39:15.187442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:16.212505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187700+0000","last_change":"2024-09-12T01:39:12.898372+0000","last_active":"2024-09-12T01:39:15.187700+0000","last_peered":"2024-09-12T01:39:15.187700+0000","last_clean":"2024-09-12T01:39:15.187700+0000","last_became_active":"2024-09-12T01:39:12.898048+0000","last_became_peered":"2024-09-12T01:39:12.898048+0000","last_unstale":"2024-09-12T01:39:15.187700+0000","last_undegraded":"2024-09-12T01:39:15.187700+0000","last_fullsized":"2024-09-12T01:39:15.187700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:37.700774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187604+0000","last_change":"2024-09-12T01:39:13.913892+0000","last_active":"2024-09-12T01:39:15.187604+0000","last_peered":"2024-09-12T01:39:15.187604+0000","last_clean":"2024-09-12T01:39:15.187604+0000","last_became_active":"2024-09-12T01:39:13.913473+0000","last_became_peered":"2024-09-12T01:39:13.913473+0000","last_unstale":"2024-09-12T01:39:15.187604+0000","last_undegraded":"2024-09-12T01:39:15.187604+0000","last_fullsized":"2024-09-12T01:39:15.187604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.253305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903236+0000","last_change":"2024-09-12T01:39:12.897002+0000","last_active":"2024-09-12T01:39:14.903236+0000","last_peered":"2024-09-12T01:39:14.903236+0000","last_clean":"2024-09-12T01:39:14.903236+0000","last_became_active":"2024-09-12T01:39:12.896502+0000","last_became_peered":"2024-09-12T01:39:12.896502+0000","last_unstale":"2024-09-12T01:39:14.903236+0000","last_undegraded":"2024-09-12T01:39:14.903236+0000","last_fullsized":"2024-09-12T01:39:14.903236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:37.972801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187824+0000","last_change":"2024-09-12T01:39:13.914328+0000","last_active":"2024-09-12T01:39:15.187824+0000","last_peered":"2024-09-12T01:39:15.187824+0000","last_clean":"2024-09-12T01:39:15.187824+0000","last_became_active":"2024-09-12T01:39:13.914055+0000","last_became_peered":"2024-09-12T01:39:13.914055+0000","last_unstale":"2024-09-12T01:39:15.187824+0000","last_undegraded":"2024-09-12T01:39:15.187824+0000","last_fullsized":"2024-09-12T01:39:15.187824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:54.539029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187798+0000","last_change":"2024-09-12T01:39:12.895761+0000","last_active":"2024-09-12T01:39:15.187798+0000","last_peered":"2024-09-12T01:39:15.187798+0000","last_clean":"2024-09-12T01:39:15.187798+0000","last_became_active":"2024-09-12T01:39:12.895469+0000","last_became_peered":"2024-09-12T01:39:12.895469+0000","last_unstale":"2024-09-12T01:39:15.187798+0000","last_undegraded":"2024-09-12T01:39:15.187798+0000","last_fullsized":"2024-09-12T01:39:15.187798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:22.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129042+0000","last_change":"2024-09-12T01:39:13.912400+0000","last_active":"2024-09-12T01:39:15.129042+0000","last_peered":"2024-09-12T01:39:15.129042+0000","last_clean":"2024-09-12T01:39:15.129042+0000","last_became_active":"2024-09-12T01:39:13.912154+0000","last_became_peered":"2024-09-12T01:39:13.912154+0000","last_unstale":"2024-09-12T01:39:15.129042+0000","last_undegraded":"2024-09-12T01:39:15.129042+0000","last_fullsized":"2024-09-12T01:39:15.129042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:36.874197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"79'6","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188153+0000","last_change":"2024-09-12T01:39:12.898516+0000","last_active":"2024-09-12T01:39:15.188153+0000","last_peered":"2024-09-12T01:39:15.188153+0000","last_clean":"2024-09-12T01:39:15.188153+0000","last_became_active":"2024-09-12T01:39:12.898169+0000","last_became_peered":"2024-09-12T01:39:12.898169+0000","last_unstale":"2024-09-12T01:39:15.188153+0000","last_undegraded":"2024-09-12T01:39:15.188153+0000","last_fullsized":"2024-09-12T01:39:15.188153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:00.120318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187751+0000","last_change":"2024-09-12T01:39:13.907928+0000","last_active":"2024-09-12T01:39:15.187751+0000","last_peered":"2024-09-12T01:39:15.187751+0000","last_clean":"2024-09-12T01:39:15.187751+0000","last_became_active":"2024-09-12T01:39:13.907637+0000","last_became_peered":"2024-09-12T01:39:13.907637+0000","last_unstale":"2024-09-12T01:39:15.187751+0000","last_undegraded":"2024-09-12T01:39:15.187751+0000","last_fullsized":"2024-09-12T01:39:15.187751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:36.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908265+0000","last_change":"2024-09-12T01:39:12.896500+0000","last_active":"2024-09-12T01:39:14.908265+0000","last_peered":"2024-09-12T01:39:14.908265+0000","last_clean":"2024-09-12T01:39:14.908265+0000","last_became_active":"2024-09-12T01:39:12.896204+0000","last_became_peered":"2024-09-12T01:39:12.896204+0000","last_unstale":"2024-09-12T01:39:14.908265+0000","last_undegraded":"2024-09-12T01:39:14.908265+0000","last_fullsized":"2024-09-12T01:39:14.908265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:31.885987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187726+0000","last_change":"2024-09-12T01:39:13.911848+0000","last_active":"2024-09-12T01:39:15.187726+0000","last_peered":"2024-09-12T01:39:15.187726+0000","last_clean":"2024-09-12T01:39:15.187726+0000","last_became_active":"2024-09-12T01:39:13.911578+0000","last_became_peered":"2024-09-12T01:39:13.911578+0000","last_unstale":"2024-09-12T01:39:15.187726+0000","last_undegraded":"2024-09-12T01:39:15.187726+0000","last_fullsized":"2024-09-12T01:39:15.187726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:36.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T01:39:12.898209+0000","last_change":"2024-09-12T01:39:12.894877+0000","last_active":"2024-09-12T01:39:12.898209+0000","last_peered":"2024-09-12T01:39:12.898209+0000","last_clean":"2024-09-12T01:39:12.898209+0000","last_became_active":"2024-09-12T01:39:12.894584+0000","last_became_peered":"2024-09-12T01:39:12.894584+0000","last_unstale":"2024-09-12T01:39:12.898209+0000","last_undegraded":"2024-09-12T01:39:12.898209+0000","last_fullsized":"2024-09-12T01:39:12.898209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:21.828714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187238+0000","last_change":"2024-09-12T01:39:13.898011+0000","last_active":"2024-09-12T01:39:15.187238+0000","last_peered":"2024-09-12T01:39:15.187238+0000","last_clean":"2024-09-12T01:39:15.187238+0000","last_became_active":"2024-09-12T01:39:13.897749+0000","last_became_peered":"2024-09-12T01:39:13.897749+0000","last_unstale":"2024-09-12T01:39:15.187238+0000","last_undegraded":"2024-09-12T01:39:15.187238+0000","last_fullsized":"2024-09-12T01:39:15.187238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:24.935008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902705+0000","last_change":"2024-09-12T01:39:12.895196+0000","last_active":"2024-09-12T01:39:14.902705+0000","last_peered":"2024-09-12T01:39:14.902705+0000","last_clean":"2024-09-12T01:39:14.902705+0000","last_became_active":"2024-09-12T01:39:12.894890+0000","last_became_peered":"2024-09-12T01:39:12.894890+0000","last_unstale":"2024-09-12T01:39:14.902705+0000","last_undegraded":"2024-09-12T01:39:14.902705+0000","last_fullsized":"2024-09-12T01:39:14.902705+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:47.160808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187452+0000","last_change":"2024-09-12T01:39:13.906691+0000","last_active":"2024-09-12T01:39:15.187452+0000","last_peered":"2024-09-12T01:39:15.187452+0000","last_clean":"2024-09-12T01:39:15.187452+0000","last_became_active":"2024-09-12T01:39:13.906346+0000","last_became_peered":"2024-09-12T01:39:13.906346+0000","last_unstale":"2024-09-12T01:39:15.187452+0000","last_undegraded":"2024-09-12T01:39:15.187452+0000","last_fullsized":"2024-09-12T01:39:15.187452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:38.977876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"79'8","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187582+0000","last_change":"2024-09-12T01:39:12.892882+0000","last_active":"2024-09-12T01:39:15.187582+0000","last_peered":"2024-09-12T01:39:15.187582+0000","last_clean":"2024-09-12T01:39:15.187582+0000","last_became_active":"2024-09-12T01:39:12.892533+0000","last_became_peered":"2024-09-12T01:39:12.892533+0000","last_unstale":"2024-09-12T01:39:15.187582+0000","last_undegraded":"2024-09-12T01:39:15.187582+0000","last_fullsized":"2024-09-12T01:39:15.187582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:59.814949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187723+0000","last_change":"2024-09-12T01:39:13.916960+0000","last_active":"2024-09-12T01:39:15.187723+0000","last_peered":"2024-09-12T01:39:15.187723+0000","last_clean":"2024-09-12T01:39:15.187723+0000","last_became_active":"2024-09-12T01:39:13.916569+0000","last_became_peered":"2024-09-12T01:39:13.916569+0000","last_unstale":"2024-09-12T01:39:15.187723+0000","last_undegraded":"2024-09-12T01:39:15.187723+0000","last_fullsized":"2024-09-12T01:39:15.187723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:56.121397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129266+0000","last_change":"2024-09-12T01:39:12.895948+0000","last_active":"2024-09-12T01:39:15.129266+0000","last_peered":"2024-09-12T01:39:15.129266+0000","last_clean":"2024-09-12T01:39:15.129266+0000","last_became_active":"2024-09-12T01:39:12.895645+0000","last_became_peered":"2024-09-12T01:39:12.895645+0000","last_unstale":"2024-09-12T01:39:15.129266+0000","last_undegraded":"2024-09-12T01:39:15.129266+0000","last_fullsized":"2024-09-12T01:39:15.129266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:27.105186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903397+0000","last_change":"2024-09-12T01:39:13.895212+0000","last_active":"2024-09-12T01:39:14.903397+0000","last_peered":"2024-09-12T01:39:14.903397+0000","last_clean":"2024-09-12T01:39:14.903397+0000","last_became_active":"2024-09-12T01:39:13.894887+0000","last_became_peered":"2024-09-12T01:39:13.894887+0000","last_unstale":"2024-09-12T01:39:14.903397+0000","last_undegraded":"2024-09-12T01:39:14.903397+0000","last_fullsized":"2024-09-12T01:39:14.903397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:25.363826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187893+0000","last_change":"2024-09-12T01:39:12.900345+0000","last_active":"2024-09-12T01:39:15.187893+0000","last_peered":"2024-09-12T01:39:15.187893+0000","last_clean":"2024-09-12T01:39:15.187893+0000","last_became_active":"2024-09-12T01:39:12.900043+0000","last_became_peered":"2024-09-12T01:39:12.900043+0000","last_unstale":"2024-09-12T01:39:15.187893+0000","last_undegraded":"2024-09-12T01:39:15.187893+0000","last_fullsized":"2024-09-12T01:39:15.187893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:46.990181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187995+0000","last_change":"2024-09-12T01:39:13.915910+0000","last_active":"2024-09-12T01:39:15.187995+0000","last_peered":"2024-09-12T01:39:15.187995+0000","last_clean":"2024-09-12T01:39:15.187995+0000","last_became_active":"2024-09-12T01:39:13.915569+0000","last_became_peered":"2024-09-12T01:39:13.915569+0000","last_unstale":"2024-09-12T01:39:15.187995+0000","last_undegraded":"2024-09-12T01:39:15.187995+0000","last_fullsized":"2024-09-12T01:39:15.187995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:44.878735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187677+0000","last_change":"2024-09-12T01:39:12.900655+0000","last_active":"2024-09-12T01:39:15.187677+0000","last_peered":"2024-09-12T01:39:15.187677+0000","last_clean":"2024-09-12T01:39:15.187677+0000","last_became_active":"2024-09-12T01:39:12.900298+0000","last_became_peered":"2024-09-12T01:39:12.900298+0000","last_unstale":"2024-09-12T01:39:15.187677+0000","last_undegraded":"2024-09-12T01:39:15.187677+0000","last_fullsized":"2024-09-12T01:39:15.187677+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:56.792978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.888244+0000","last_change":"2024-09-12T01:39:12.888244+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.888244+0000","last_undegraded":"2024-09-12T01:39:12.888244+0000","last_fullsized":"2024-09-12T01:39:12.888244+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187593+0000","last_change":"2024-09-12T01:39:12.899244+0000","last_active":"2024-09-12T01:39:15.187593+0000","last_peered":"2024-09-12T01:39:15.187593+0000","last_clean":"2024-09-12T01:39:15.187593+0000","last_became_active":"2024-09-12T01:39:12.898773+0000","last_became_peered":"2024-09-12T01:39:12.898773+0000","last_unstale":"2024-09-12T01:39:15.187593+0000","last_undegraded":"2024-09-12T01:39:15.187593+0000","last_fullsized":"2024-09-12T01:39:15.187593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:32.656288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128927+0000","last_change":"2024-09-12T01:39:13.908672+0000","last_active":"2024-09-12T01:39:15.128927+0000","last_peered":"2024-09-12T01:39:15.128927+0000","last_clean":"2024-09-12T01:39:15.128927+0000","last_became_active":"2024-09-12T01:39:13.908365+0000","last_became_peered":"2024-09-12T01:39:13.908365+0000","last_unstale":"2024-09-12T01:39:15.128927+0000","last_undegraded":"2024-09-12T01:39:15.128927+0000","last_fullsized":"2024-09-12T01:39:15.128927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:28.239676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T01:39:12.899940+0000","last_change":"2024-09-12T01:39:12.897940+0000","last_active":"2024-09-12T01:39:12.899940+0000","last_peered":"2024-09-12T01:39:12.899940+0000","last_clean":"2024-09-12T01:39:12.899940+0000","last_became_active":"2024-09-12T01:39:12.897617+0000","last_became_peered":"2024-09-12T01:39:12.897617+0000","last_unstale":"2024-09-12T01:39:12.899940+0000","last_undegraded":"2024-09-12T01:39:12.899940+0000","last_fullsized":"2024-09-12T01:39:12.899940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:38.210811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907757+0000","last_change":"2024-09-12T01:39:13.908088+0000","last_active":"2024-09-12T01:39:14.907757+0000","last_peered":"2024-09-12T01:39:14.907757+0000","last_clean":"2024-09-12T01:39:14.907757+0000","last_became_active":"2024-09-12T01:39:13.907807+0000","last_became_peered":"2024-09-12T01:39:13.907807+0000","last_unstale":"2024-09-12T01:39:14.907757+0000","last_undegraded":"2024-09-12T01:39:14.907757+0000","last_fullsized":"2024-09-12T01:39:14.907757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:58.775933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187702+0000","last_change":"2024-09-12T01:39:12.892007+0000","last_active":"2024-09-12T01:39:15.187702+0000","last_peered":"2024-09-12T01:39:15.187702+0000","last_clean":"2024-09-12T01:39:15.187702+0000","last_became_active":"2024-09-12T01:39:12.891744+0000","last_became_peered":"2024-09-12T01:39:12.891744+0000","last_unstale":"2024-09-12T01:39:15.187702+0000","last_undegraded":"2024-09-12T01:39:15.187702+0000","last_fullsized":"2024-09-12T01:39:15.187702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.207430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187658+0000","last_change":"2024-09-12T01:39:13.913157+0000","last_active":"2024-09-12T01:39:15.187658+0000","last_peered":"2024-09-12T01:39:15.187658+0000","last_clean":"2024-09-12T01:39:15.187658+0000","last_became_active":"2024-09-12T01:39:13.912881+0000","last_became_peered":"2024-09-12T01:39:13.912881+0000","last_unstale":"2024-09-12T01:39:15.187658+0000","last_undegraded":"2024-09-12T01:39:15.187658+0000","last_fullsized":"2024-09-12T01:39:15.187658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:03.256051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187393+0000","last_change":"2024-09-12T01:39:12.897776+0000","last_active":"2024-09-12T01:39:15.187393+0000","last_peered":"2024-09-12T01:39:15.187393+0000","last_clean":"2024-09-12T01:39:15.187393+0000","last_became_active":"2024-09-12T01:39:12.897527+0000","last_became_peered":"2024-09-12T01:39:12.897527+0000","last_unstale":"2024-09-12T01:39:15.187393+0000","last_undegraded":"2024-09-12T01:39:15.187393+0000","last_fullsized":"2024-09-12T01:39:15.187393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:29.855267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129181+0000","last_change":"2024-09-12T01:39:13.900476+0000","last_active":"2024-09-12T01:39:15.129181+0000","last_peered":"2024-09-12T01:39:15.129181+0000","last_clean":"2024-09-12T01:39:15.129181+0000","last_became_active":"2024-09-12T01:39:13.900204+0000","last_became_peered":"2024-09-12T01:39:13.900204+0000","last_unstale":"2024-09-12T01:39:15.129181+0000","last_undegraded":"2024-09-12T01:39:15.129181+0000","last_fullsized":"2024-09-12T01:39:15.129181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:41.140743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187678+0000","last_change":"2024-09-12T01:39:12.904275+0000","last_active":"2024-09-12T01:39:15.187678+0000","last_peered":"2024-09-12T01:39:15.187678+0000","last_clean":"2024-09-12T01:39:15.187678+0000","last_became_active":"2024-09-12T01:39:12.904028+0000","last_became_peered":"2024-09-12T01:39:12.904028+0000","last_unstale":"2024-09-12T01:39:15.187678+0000","last_undegraded":"2024-09-12T01:39:15.187678+0000","last_fullsized":"2024-09-12T01:39:15.187678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:27.433076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129064+0000","last_change":"2024-09-12T01:39:13.912165+0000","last_active":"2024-09-12T01:39:15.129064+0000","last_peered":"2024-09-12T01:39:15.129064+0000","last_clean":"2024-09-12T01:39:15.129064+0000","last_became_active":"2024-09-12T01:39:13.911869+0000","last_became_peered":"2024-09-12T01:39:13.911869+0000","last_unstale":"2024-09-12T01:39:15.129064+0000","last_undegraded":"2024-09-12T01:39:15.129064+0000","last_fullsized":"2024-09-12T01:39:15.129064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:43.619413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187997+0000","last_change":"2024-09-12T01:39:12.890030+0000","last_active":"2024-09-12T01:39:15.187997+0000","last_peered":"2024-09-12T01:39:15.187997+0000","last_clean":"2024-09-12T01:39:15.187997+0000","last_became_active":"2024-09-12T01:39:12.889687+0000","last_became_peered":"2024-09-12T01:39:12.889687+0000","last_unstale":"2024-09-12T01:39:15.187997+0000","last_undegraded":"2024-09-12T01:39:15.187997+0000","last_fullsized":"2024-09-12T01:39:15.187997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:49.813748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128984+0000","last_change":"2024-09-12T01:39:13.902776+0000","last_active":"2024-09-12T01:39:15.128984+0000","last_peered":"2024-09-12T01:39:15.128984+0000","last_clean":"2024-09-12T01:39:15.128984+0000","last_became_active":"2024-09-12T01:39:13.902502+0000","last_became_peered":"2024-09-12T01:39:13.902502+0000","last_unstale":"2024-09-12T01:39:15.128984+0000","last_undegraded":"2024-09-12T01:39:15.128984+0000","last_fullsized":"2024-09-12T01:39:15.128984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:01.168363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188042+0000","last_change":"2024-09-12T01:39:12.900224+0000","last_active":"2024-09-12T01:39:15.188042+0000","last_peered":"2024-09-12T01:39:15.188042+0000","last_clean":"2024-09-12T01:39:15.188042+0000","last_became_active":"2024-09-12T01:39:12.899905+0000","last_became_peered":"2024-09-12T01:39:12.899905+0000","last_unstale":"2024-09-12T01:39:15.188042+0000","last_undegraded":"2024-09-12T01:39:15.188042+0000","last_fullsized":"2024-09-12T01:39:15.188042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:30.248231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903170+0000","last_change":"2024-09-12T01:39:13.903873+0000","last_active":"2024-09-12T01:39:14.903170+0000","last_peered":"2024-09-12T01:39:14.903170+0000","last_clean":"2024-09-12T01:39:14.903170+0000","last_became_active":"2024-09-12T01:39:13.902665+0000","last_became_peered":"2024-09-12T01:39:13.902665+0000","last_unstale":"2024-09-12T01:39:14.903170+0000","last_undegraded":"2024-09-12T01:39:14.903170+0000","last_fullsized":"2024-09-12T01:39:14.903170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:20.834108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902828+0000","last_change":"2024-09-12T01:39:12.900941+0000","last_active":"2024-09-12T01:39:14.902828+0000","last_peered":"2024-09-12T01:39:14.902828+0000","last_clean":"2024-09-12T01:39:14.902828+0000","last_became_active":"2024-09-12T01:39:12.900582+0000","last_became_peered":"2024-09-12T01:39:12.900582+0000","last_unstale":"2024-09-12T01:39:14.902828+0000","last_undegraded":"2024-09-12T01:39:14.902828+0000","last_fullsized":"2024-09-12T01:39:14.902828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:17.188396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187305+0000","last_change":"2024-09-12T01:39:13.906501+0000","last_active":"2024-09-12T01:39:15.187305+0000","last_peered":"2024-09-12T01:39:15.187305+0000","last_clean":"2024-09-12T01:39:15.187305+0000","last_became_active":"2024-09-12T01:39:13.905251+0000","last_became_peered":"2024-09-12T01:39:13.905251+0000","last_unstale":"2024-09-12T01:39:15.187305+0000","last_undegraded":"2024-09-12T01:39:15.187305+0000","last_fullsized":"2024-09-12T01:39:15.187305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:12.012554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T01:39:12.899668+0000","last_change":"2024-09-12T01:39:12.896423+0000","last_active":"2024-09-12T01:39:12.899668+0000","last_peered":"2024-09-12T01:39:12.899668+0000","last_clean":"2024-09-12T01:39:12.899668+0000","last_became_active":"2024-09-12T01:39:12.896163+0000","last_became_peered":"2024-09-12T01:39:12.896163+0000","last_unstale":"2024-09-12T01:39:12.899668+0000","last_undegraded":"2024-09-12T01:39:12.899668+0000","last_fullsized":"2024-09-12T01:39:12.899668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:18.895862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187808+0000","last_change":"2024-09-12T01:39:13.906963+0000","last_active":"2024-09-12T01:39:15.187808+0000","last_peered":"2024-09-12T01:39:15.187808+0000","last_clean":"2024-09-12T01:39:15.187808+0000","last_became_active":"2024-09-12T01:39:13.906272+0000","last_became_peered":"2024-09-12T01:39:13.906272+0000","last_unstale":"2024-09-12T01:39:15.187808+0000","last_undegraded":"2024-09-12T01:39:15.187808+0000","last_fullsized":"2024-09-12T01:39:15.187808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:26.904998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902944+0000","last_change":"2024-09-12T01:39:12.902567+0000","last_active":"2024-09-12T01:39:14.902944+0000","last_peered":"2024-09-12T01:39:14.902944+0000","last_clean":"2024-09-12T01:39:14.902944+0000","last_became_active":"2024-09-12T01:39:12.902261+0000","last_became_peered":"2024-09-12T01:39:12.902261+0000","last_unstale":"2024-09-12T01:39:14.902944+0000","last_undegraded":"2024-09-12T01:39:14.902944+0000","last_fullsized":"2024-09-12T01:39:14.902944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:30.248231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187175+0000","last_change":"2024-09-12T01:39:13.903016+0000","last_active":"2024-09-12T01:39:15.187175+0000","last_peered":"2024-09-12T01:39:15.187175+0000","last_clean":"2024-09-12T01:39:15.187175+0000","last_became_active":"2024-09-12T01:39:13.902740+0000","last_became_peered":"2024-09-12T01:39:13.902740+0000","last_unstale":"2024-09-12T01:39:15.187175+0000","last_undegraded":"2024-09-12T01:39:15.187175+0000","last_fullsized":"2024-09-12T01:39:15.187175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:55.372979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187123+0000","last_change":"2024-09-12T01:39:12.896200+0000","last_active":"2024-09-12T01:39:15.187123+0000","last_peered":"2024-09-12T01:39:15.187123+0000","last_clean":"2024-09-12T01:39:15.187123+0000","last_became_active":"2024-09-12T01:39:12.895937+0000","last_became_peered":"2024-09-12T01:39:12.895937+0000","last_unstale":"2024-09-12T01:39:15.187123+0000","last_undegraded":"2024-09-12T01:39:15.187123+0000","last_fullsized":"2024-09-12T01:39:15.187123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:16.330008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187586+0000","last_change":"2024-09-12T01:39:13.905333+0000","last_active":"2024-09-12T01:39:15.187586+0000","last_peered":"2024-09-12T01:39:15.187586+0000","last_clean":"2024-09-12T01:39:15.187586+0000","last_became_active":"2024-09-12T01:39:13.904982+0000","last_became_peered":"2024-09-12T01:39:13.904982+0000","last_unstale":"2024-09-12T01:39:15.187586+0000","last_undegraded":"2024-09-12T01:39:15.187586+0000","last_fullsized":"2024-09-12T01:39:15.187586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:01.125393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187933+0000","last_change":"2024-09-12T01:39:12.897786+0000","last_active":"2024-09-12T01:39:15.187933+0000","last_peered":"2024-09-12T01:39:15.187933+0000","last_clean":"2024-09-12T01:39:15.187933+0000","last_became_active":"2024-09-12T01:39:12.897384+0000","last_became_peered":"2024-09-12T01:39:12.897384+0000","last_unstale":"2024-09-12T01:39:15.187933+0000","last_undegraded":"2024-09-12T01:39:15.187933+0000","last_fullsized":"2024-09-12T01:39:15.187933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:37.972801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187951+0000","last_change":"2024-09-12T01:39:13.915042+0000","last_active":"2024-09-12T01:39:15.187951+0000","last_peered":"2024-09-12T01:39:15.187951+0000","last_clean":"2024-09-12T01:39:15.187951+0000","last_became_active":"2024-09-12T01:39:13.914403+0000","last_became_peered":"2024-09-12T01:39:13.914403+0000","last_unstale":"2024-09-12T01:39:15.187951+0000","last_undegraded":"2024-09-12T01:39:15.187951+0000","last_fullsized":"2024-09-12T01:39:15.187951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:54.227036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129155+0000","last_change":"2024-09-12T01:39:12.897053+0000","last_active":"2024-09-12T01:39:15.129155+0000","last_peered":"2024-09-12T01:39:15.129155+0000","last_clean":"2024-09-12T01:39:15.129155+0000","last_became_active":"2024-09-12T01:39:12.896613+0000","last_became_peered":"2024-09-12T01:39:12.896613+0000","last_unstale":"2024-09-12T01:39:15.129155+0000","last_undegraded":"2024-09-12T01:39:15.129155+0000","last_fullsized":"2024-09-12T01:39:15.129155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:22.437750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":278,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187214+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:39:15.187214+0000","last_peered":"2024-09-12T01:39:15.187214+0000","last_clean":"2024-09-12T01:39:15.187214+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:39:15.187214+0000","last_undegraded":"2024-09-12T01:39:15.187214+0000","last_fullsized":"2024-09-12T01:39:15.187214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":401627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":408529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":999871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":408531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":407857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1560576,"data_stored":992015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":978944,"data_stored":403191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":950272,"data_stored":394782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:39:16.884 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:39:17.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.022+0000 7f1035e53640 1 Processor -- start 2024-09-12T01:39:17.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.022+0000 7f1035e53640 1 -- start start 2024-09-12T01:39:17.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.023+0000 7f1035e53640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f103015c2b0 0x7f10300b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.023+0000 7f1035e53640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300b72f0 0x7f103015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.023+0000 7f1035e53640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f103015fb10 con 0x7f103015f030 2024-09-12T01:39:17.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.023+0000 7f1035e53640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f10300b5900 con 0x7f103015c2b0 2024-09-12T01:39:17.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.023+0000 7f1035e53640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f103015f830 con 0x7f10300b72f0 2024-09-12T01:39:17.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.023+0000 7f102ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f103015f030 0x7f103006f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41852/0 (socket says 172.21.15.60:41852) 2024-09-12T01:39:17.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.023+0000 7f102ffff640 1 -- 172.21.15.60:0/2703408512 learned_addr learned my addr 172.21.15.60:0/2703408512 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102effd640 1 --2- 172.21.15.60:0/2703408512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300b72f0 0x7f103015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102f7fe640 1 --2- 172.21.15.60:0/2703408512 >> v2:172.21.15.105:3300/0 conn(0x7f103015c2b0 0x7f10300b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2355930924 0 0) 0x7f103015fb10 con 0x7f103015f030 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1018003520 con 0x7f103015f030 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1074934815 0 0) 0x7f1018003520 con 0x7f103015f030 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300b72f0 msgr2=0x7f103015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 --2- 172.21.15.60:0/2703408512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300b72f0 0x7f103015eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 >> v2:172.21.15.105:3300/0 conn(0x7f103015c2b0 msgr2=0x7f10300b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 --2- 172.21.15.60:0/2703408512 >> v2:172.21.15.105:3300/0 conn(0x7f103015c2b0 0x7f10300b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103006ce30 con 0x7f103015f030 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f10280019f0 con 0x7f103015f030 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 >> v1:172.21.15.60:6789/0 conn(0x7f103015f030 legacy=0x7f103006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 --2- 172.21.15.60:0/2703408512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300b72f0 0x7f10180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 --2- 172.21.15.60:0/2703408512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1018003f30 0x7f1018004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 --2- 172.21.15.60:0/2703408512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018004d40 0x7f10180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f10300b5900 con 0x7f1018004d40 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f103015f830 con 0x7f1018003f30 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f101800b9c0 con 0x7f10300b72f0 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102ffff640 1 --2- 172.21.15.60:0/2703408512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018004d40 0x7f10180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102effd640 1 --2- 172.21.15.60:0/2703408512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1018003f30 0x7f1018004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102f7fe640 1 --2- 172.21.15.60:0/2703408512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300b72f0 0x7f10180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102ffff640 1 -- 172.21.15.60:0/2703408512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300b72f0 msgr2=0x7f10180039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102ffff640 1 --2- 172.21.15.60:0/2703408512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300b72f0 0x7f10180039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102ffff640 1 -- 172.21.15.60:0/2703408512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1018003f30 msgr2=0x7f1018004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102ffff640 1 --2- 172.21.15.60:0/2703408512 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1018003f30 0x7f1018004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.024+0000 7f102ffff640 1 -- 172.21.15.60:0/2703408512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1018003520 con 0x7f1018004d40 2024-09-12T01:39:17.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.025+0000 7f102ffff640 1 --2- 172.21.15.60:0/2703408512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018004d40 0x7f10180051c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f102800a870 tx=0x7f1018005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d34d068f7ec6626 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.025+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102800a4c0 con 0x7f1018004d40 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.025+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102802f070 con 0x7f1018004d40 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.025+0000 7f102e7fc640 1 -- 172.21.15.60:0/2703408512 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102802bcb0 con 0x7f1018004d40 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.026+0000 7f1035e53640 1 -- 172.21.15.60:0/2703408512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018004d40 msgr2=0x7f10180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.026+0000 7f1035e53640 1 --2- 172.21.15.60:0/2703408512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018004d40 0x7f10180051c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f102800a870 tx=0x7f1018005830 comp rx=0 tx=0).stop 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.026+0000 7f102ffff640 1 -- 172.21.15.60:0/2703408512 reap_dead start 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.026+0000 7f1035e53640 1 -- 172.21.15.60:0/2703408512 shutdown_connections 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.026+0000 7f1035e53640 1 -- 172.21.15.60:0/2703408512 >> 172.21.15.60:0/2703408512 conn(0x7f10300b4240 msgr2=0x7f10300b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.026+0000 7f1035e53640 1 -- 172.21.15.60:0/2703408512 shutdown_connections 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.026+0000 7f1035e53640 1 -- 172.21.15.60:0/2703408512 wait complete. 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.027+0000 7f1035e53640 1 Processor -- start 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.027+0000 7f1035e53640 1 -- start start 2024-09-12T01:39:17.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.028+0000 7f1035e53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018004d40 0x7f103015ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.028+0000 7f1035e53640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10301f3250 0x7f10301f36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.028+0000 7f1035e53640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300d1d50 0x7f10300d21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.028+0000 7f1035e53640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f10300b7730 con 0x7f1018004d40 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.028+0000 7f1035e53640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f103006d3f0 con 0x7f10301f3250 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.028+0000 7f1035e53640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f103015f4c0 con 0x7f10300d1d50 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.028+0000 7f102f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018004d40 0x7f103015ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.028+0000 7f102f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018004d40 0x7f103015ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41690/0 (socket says 172.21.15.60:41690) 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.028+0000 7f102f7fe640 1 -- 172.21.15.60:0/1729610100 learned_addr learned my addr 172.21.15.60:0/1729610100 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.028+0000 7f102effd640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10301f3250 0x7f10301f36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.028+0000 7f102ffff640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300d1d50 0x7f10300d21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.029+0000 7f102f7fe640 1 -- 172.21.15.60:0/1729610100 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300d1d50 msgr2=0x7f10300d21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.029+0000 7f102f7fe640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300d1d50 0x7f10300d21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.031 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.029+0000 7f102f7fe640 1 -- 172.21.15.60:0/1729610100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10301f3250 msgr2=0x7f10301f36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.029+0000 7f102f7fe640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10301f3250 0x7f10301f36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.029+0000 7f102f7fe640 1 -- 172.21.15.60:0/1729610100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10301f3bf0 con 0x7f1018004d40 2024-09-12T01:39:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.029+0000 7f102f7fe640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018004d40 0x7f103015ff10 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1020011a70 tx=0x7f1020011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.029+0000 7f1017fff640 1 -- 172.21.15.60:0/1729610100 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102000fa90 con 0x7f1018004d40 2024-09-12T01:39:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.029+0000 7f1017fff640 1 -- 172.21.15.60:0/1729610100 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f102000fc30 con 0x7f1018004d40 2024-09-12T01:39:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.029+0000 7f1017fff640 1 -- 172.21.15.60:0/1729610100 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1020014440 con 0x7f1018004d40 2024-09-12T01:39:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.029+0000 7f1035e53640 1 -- 172.21.15.60:0/1729610100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10300aa600 con 0x7f1018004d40 2024-09-12T01:39:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.029+0000 7f1035e53640 1 -- 172.21.15.60:0/1729610100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10300aabc0 con 0x7f1018004d40 2024-09-12T01:39:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.030+0000 7f1035e53640 1 -- 172.21.15.60:0/1729610100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10300b6db0 con 0x7f1018004d40 2024-09-12T01:39:17.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.030+0000 7f1017fff640 1 -- 172.21.15.60:0/1729610100 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1020012040 con 0x7f1018004d40 2024-09-12T01:39:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.031+0000 7f1017fff640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f101c06be30 0x7f101c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.031+0000 7f1017fff640 1 -- 172.21.15.60:0/1729610100 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f102008b4d0 con 0x7f1018004d40 2024-09-12T01:39:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.031+0000 7f102effd640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f101c06be30 0x7f101c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.032+0000 7f102effd640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f101c06be30 0x7f101c06e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f103006dc40 tx=0x7f1024009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:17.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.036+0000 7f1017fff640 1 -- 172.21.15.60:0/1729610100 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1020019030 con 0x7f1018004d40 2024-09-12T01:39:17.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.208+0000 7f1035e53640 1 -- 172.21.15.60:0/1729610100 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1030161d20 con 0x7f101c06be30 2024-09-12T01:39:17.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.214+0000 7f1017fff640 1 -- 172.21.15.60:0/1729610100 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251752 (secure 0 0 0) 0x7f1030161d20 con 0x7f101c06be30 2024-09-12T01:39:17.216 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:17.217 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:39:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.217+0000 7f1035e53640 1 -- 172.21.15.60:0/1729610100 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f101c06be30 msgr2=0x7f101c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.217+0000 7f1035e53640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f101c06be30 0x7f101c06e2f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f103006dc40 tx=0x7f1024009190 comp rx=0 tx=0).stop 2024-09-12T01:39:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.217+0000 7f1035e53640 1 -- 172.21.15.60:0/1729610100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018004d40 msgr2=0x7f103015ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.217+0000 7f1035e53640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018004d40 0x7f103015ff10 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1020011a70 tx=0x7f1020011e70 comp rx=0 tx=0).stop 2024-09-12T01:39:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.217+0000 7f1035e53640 1 -- 172.21.15.60:0/1729610100 shutdown_connections 2024-09-12T01:39:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.217+0000 7f1035e53640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f101c06be30 0x7f101c06e2f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.217+0000 7f1035e53640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f10300d1d50 0x7f10300d21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.217+0000 7f1035e53640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f10301f3250 0x7f10301f36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.217+0000 7f1035e53640 1 --2- 172.21.15.60:0/1729610100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1018004d40 0x7f103015ff10 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.218+0000 7f1035e53640 1 -- 172.21.15.60:0/1729610100 >> 172.21.15.60:0/1729610100 conn(0x7f10300b4240 msgr2=0x7f10301612d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.218+0000 7f1035e53640 1 -- 172.21.15.60:0/1729610100 shutdown_connections 2024-09-12T01:39:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.218+0000 7f1035e53640 1 -- 172.21.15.60:0/1729610100 wait complete. 2024-09-12T01:39:17.228 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-12T01:39:16.302391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266616,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754708104,"statfs":{"total":773094113280,"available":772821098496,"internally_reserved":0,"allocated":8986624,"data_stored":4416403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.425526"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187288+0000","last_change":"2024-09-12T01:39:13.904548+0000","last_active":"2024-09-12T01:39:15.187288+0000","last_peered":"2024-09-12T01:39:15.187288+0000","last_clean":"2024-09-12T01:39:15.187288+0000","last_became_active":"2024-09-12T01:39:13.904009+0000","last_became_peered":"2024-09-12T01:39:13.904009+0000","last_unstale":"2024-09-12T01:39:15.187288+0000","last_undegraded":"2024-09-12T01:39:15.187288+0000","last_fullsized":"2024-09-12T01:39:15.187288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:02.473545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.888137+0000","last_change":"2024-09-12T01:39:12.888137+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.888137+0000","last_undegraded":"2024-09-12T01:39:12.888137+0000","last_fullsized":"2024-09-12T01:39:12.888137+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903174+0000","last_change":"2024-09-12T01:39:13.904153+0000","last_active":"2024-09-12T01:39:14.903174+0000","last_peered":"2024-09-12T01:39:14.903174+0000","last_clean":"2024-09-12T01:39:14.903174+0000","last_became_active":"2024-09-12T01:39:13.903587+0000","last_became_peered":"2024-09-12T01:39:13.903587+0000","last_unstale":"2024-09-12T01:39:14.903174+0000","last_undegraded":"2024-09-12T01:39:14.903174+0000","last_fullsized":"2024-09-12T01:39:14.903174+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:08.179408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908266+0000","last_change":"2024-09-12T01:39:13.898785+0000","last_active":"2024-09-12T01:39:14.908266+0000","last_peered":"2024-09-12T01:39:14.908266+0000","last_clean":"2024-09-12T01:39:14.908266+0000","last_became_active":"2024-09-12T01:39:13.898498+0000","last_became_peered":"2024-09-12T01:39:13.898498+0000","last_unstale":"2024-09-12T01:39:14.908266+0000","last_undegraded":"2024-09-12T01:39:14.908266+0000","last_fullsized":"2024-09-12T01:39:14.908266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:55.328047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128776+0000","last_change":"2024-09-12T01:39:13.900646+0000","last_active":"2024-09-12T01:39:15.128776+0000","last_peered":"2024-09-12T01:39:15.128776+0000","last_clean":"2024-09-12T01:39:15.128776+0000","last_became_active":"2024-09-12T01:39:13.899584+0000","last_became_peered":"2024-09-12T01:39:13.899584+0000","last_unstale":"2024-09-12T01:39:15.128776+0000","last_undegraded":"2024-09-12T01:39:15.128776+0000","last_fullsized":"2024-09-12T01:39:15.128776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:08.313862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902900+0000","last_change":"2024-09-12T01:39:13.897523+0000","last_active":"2024-09-12T01:39:14.902900+0000","last_peered":"2024-09-12T01:39:14.902900+0000","last_clean":"2024-09-12T01:39:14.902900+0000","last_became_active":"2024-09-12T01:39:13.897250+0000","last_became_peered":"2024-09-12T01:39:13.897250+0000","last_unstale":"2024-09-12T01:39:14.902900+0000","last_undegraded":"2024-09-12T01:39:14.902900+0000","last_fullsized":"2024-09-12T01:39:14.902900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:03.256051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.888049+0000","last_change":"2024-09-12T01:39:12.888049+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.888049+0000","last_undegraded":"2024-09-12T01:39:12.888049+0000","last_fullsized":"2024-09-12T01:39:12.888049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187991+0000","last_change":"2024-09-12T01:39:13.910043+0000","last_active":"2024-09-12T01:39:15.187991+0000","last_peered":"2024-09-12T01:39:15.187991+0000","last_clean":"2024-09-12T01:39:15.187991+0000","last_became_active":"2024-09-12T01:39:13.909698+0000","last_became_peered":"2024-09-12T01:39:13.909698+0000","last_unstale":"2024-09-12T01:39:15.187991+0000","last_undegraded":"2024-09-12T01:39:15.187991+0000","last_fullsized":"2024-09-12T01:39:15.187991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:08.179408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187332+0000","last_change":"2024-09-12T01:39:13.903280+0000","last_active":"2024-09-12T01:39:15.187332+0000","last_peered":"2024-09-12T01:39:15.187332+0000","last_clean":"2024-09-12T01:39:15.187332+0000","last_became_active":"2024-09-12T01:39:13.902331+0000","last_became_peered":"2024-09-12T01:39:13.902331+0000","last_unstale":"2024-09-12T01:39:15.187332+0000","last_undegraded":"2024-09-12T01:39:15.187332+0000","last_fullsized":"2024-09-12T01:39:15.187332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:28.988150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903142+0000","last_change":"2024-09-12T01:39:13.895633+0000","last_active":"2024-09-12T01:39:14.903142+0000","last_peered":"2024-09-12T01:39:14.903142+0000","last_clean":"2024-09-12T01:39:14.903142+0000","last_became_active":"2024-09-12T01:39:13.895342+0000","last_became_peered":"2024-09-12T01:39:13.895342+0000","last_unstale":"2024-09-12T01:39:14.903142+0000","last_undegraded":"2024-09-12T01:39:14.903142+0000","last_fullsized":"2024-09-12T01:39:14.903142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:44.878735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188188+0000","last_change":"2024-09-12T01:39:13.908537+0000","last_active":"2024-09-12T01:39:15.188188+0000","last_peered":"2024-09-12T01:39:15.188188+0000","last_clean":"2024-09-12T01:39:15.188188+0000","last_became_active":"2024-09-12T01:39:13.908193+0000","last_became_peered":"2024-09-12T01:39:13.908193+0000","last_unstale":"2024-09-12T01:39:15.188188+0000","last_undegraded":"2024-09-12T01:39:15.188188+0000","last_fullsized":"2024-09-12T01:39:15.188188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:50.638963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188087+0000","last_change":"2024-09-12T01:39:13.911076+0000","last_active":"2024-09-12T01:39:15.188087+0000","last_peered":"2024-09-12T01:39:15.188087+0000","last_clean":"2024-09-12T01:39:15.188087+0000","last_became_active":"2024-09-12T01:39:13.910824+0000","last_became_peered":"2024-09-12T01:39:13.910824+0000","last_unstale":"2024-09-12T01:39:15.188087+0000","last_undegraded":"2024-09-12T01:39:15.188087+0000","last_fullsized":"2024-09-12T01:39:15.188087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:25.363826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128818+0000","last_change":"2024-09-12T01:39:13.904087+0000","last_active":"2024-09-12T01:39:15.128818+0000","last_peered":"2024-09-12T01:39:15.128818+0000","last_clean":"2024-09-12T01:39:15.128818+0000","last_became_active":"2024-09-12T01:39:13.903799+0000","last_became_peered":"2024-09-12T01:39:13.903799+0000","last_unstale":"2024-09-12T01:39:15.128818+0000","last_undegraded":"2024-09-12T01:39:15.128818+0000","last_fullsized":"2024-09-12T01:39:15.128818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:47.515101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187275+0000","last_change":"2024-09-12T01:39:13.897466+0000","last_active":"2024-09-12T01:39:15.187275+0000","last_peered":"2024-09-12T01:39:15.187275+0000","last_clean":"2024-09-12T01:39:15.187275+0000","last_became_active":"2024-09-12T01:39:13.897050+0000","last_became_peered":"2024-09-12T01:39:13.897050+0000","last_unstale":"2024-09-12T01:39:15.187275+0000","last_undegraded":"2024-09-12T01:39:15.187275+0000","last_fullsized":"2024-09-12T01:39:15.187275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:00.820023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.887593+0000","last_change":"2024-09-12T01:39:12.887593+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.887593+0000","last_undegraded":"2024-09-12T01:39:12.887593+0000","last_fullsized":"2024-09-12T01:39:12.887593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902706+0000","last_change":"2024-09-12T01:39:13.895475+0000","last_active":"2024-09-12T01:39:14.902706+0000","last_peered":"2024-09-12T01:39:14.902706+0000","last_clean":"2024-09-12T01:39:14.902706+0000","last_became_active":"2024-09-12T01:39:13.894932+0000","last_became_peered":"2024-09-12T01:39:13.894932+0000","last_unstale":"2024-09-12T01:39:14.902706+0000","last_undegraded":"2024-09-12T01:39:14.902706+0000","last_fullsized":"2024-09-12T01:39:14.902706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.815960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187867+0000","last_change":"2024-09-12T01:39:13.911725+0000","last_active":"2024-09-12T01:39:15.187867+0000","last_peered":"2024-09-12T01:39:15.187867+0000","last_clean":"2024-09-12T01:39:15.187867+0000","last_became_active":"2024-09-12T01:39:13.911467+0000","last_became_peered":"2024-09-12T01:39:13.911467+0000","last_unstale":"2024-09-12T01:39:15.187867+0000","last_undegraded":"2024-09-12T01:39:15.187867+0000","last_fullsized":"2024-09-12T01:39:15.187867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.891062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188053+0000","last_change":"2024-09-12T01:39:13.909003+0000","last_active":"2024-09-12T01:39:15.188053+0000","last_peered":"2024-09-12T01:39:15.188053+0000","last_clean":"2024-09-12T01:39:15.188053+0000","last_became_active":"2024-09-12T01:39:13.908524+0000","last_became_peered":"2024-09-12T01:39:13.908524+0000","last_unstale":"2024-09-12T01:39:15.188053+0000","last_undegraded":"2024-09-12T01:39:15.188053+0000","last_fullsized":"2024-09-12T01:39:15.188053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:33.298540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187966+0000","last_change":"2024-09-12T01:39:13.905486+0000","last_active":"2024-09-12T01:39:15.187966+0000","last_peered":"2024-09-12T01:39:15.187966+0000","last_clean":"2024-09-12T01:39:15.187966+0000","last_became_active":"2024-09-12T01:39:13.905182+0000","last_became_peered":"2024-09-12T01:39:13.905182+0000","last_unstale":"2024-09-12T01:39:15.187966+0000","last_undegraded":"2024-09-12T01:39:15.187966+0000","last_fullsized":"2024-09-12T01:39:15.187966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:55.372979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187642+0000","last_change":"2024-09-12T01:39:13.897112+0000","last_active":"2024-09-12T01:39:15.187642+0000","last_peered":"2024-09-12T01:39:15.187642+0000","last_clean":"2024-09-12T01:39:15.187642+0000","last_became_active":"2024-09-12T01:39:13.896837+0000","last_became_peered":"2024-09-12T01:39:13.896837+0000","last_unstale":"2024-09-12T01:39:15.187642+0000","last_undegraded":"2024-09-12T01:39:15.187642+0000","last_fullsized":"2024-09-12T01:39:15.187642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:03.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907959+0000","last_change":"2024-09-12T01:39:13.904696+0000","last_active":"2024-09-12T01:39:14.907959+0000","last_peered":"2024-09-12T01:39:14.907959+0000","last_clean":"2024-09-12T01:39:14.907959+0000","last_became_active":"2024-09-12T01:39:13.904425+0000","last_became_peered":"2024-09-12T01:39:13.904425+0000","last_unstale":"2024-09-12T01:39:14.907959+0000","last_undegraded":"2024-09-12T01:39:14.907959+0000","last_fullsized":"2024-09-12T01:39:14.907959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:05.731459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187483+0000","last_change":"2024-09-12T01:39:13.901168+0000","last_active":"2024-09-12T01:39:15.187483+0000","last_peered":"2024-09-12T01:39:15.187483+0000","last_clean":"2024-09-12T01:39:15.187483+0000","last_became_active":"2024-09-12T01:39:13.900885+0000","last_became_peered":"2024-09-12T01:39:13.900885+0000","last_unstale":"2024-09-12T01:39:15.187483+0000","last_undegraded":"2024-09-12T01:39:15.187483+0000","last_fullsized":"2024-09-12T01:39:15.187483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:53.244610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187508+0000","last_change":"2024-09-12T01:39:13.910971+0000","last_active":"2024-09-12T01:39:15.187508+0000","last_peered":"2024-09-12T01:39:15.187508+0000","last_clean":"2024-09-12T01:39:15.187508+0000","last_became_active":"2024-09-12T01:39:13.910683+0000","last_became_peered":"2024-09-12T01:39:13.910683+0000","last_unstale":"2024-09-12T01:39:15.187508+0000","last_undegraded":"2024-09-12T01:39:15.187508+0000","last_fullsized":"2024-09-12T01:39:15.187508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:55.097048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187458+0000","last_change":"2024-09-12T01:39:13.903528+0000","last_active":"2024-09-12T01:39:15.187458+0000","last_peered":"2024-09-12T01:39:15.187458+0000","last_clean":"2024-09-12T01:39:15.187458+0000","last_became_active":"2024-09-12T01:39:13.902574+0000","last_became_peered":"2024-09-12T01:39:13.902574+0000","last_unstale":"2024-09-12T01:39:15.187458+0000","last_undegraded":"2024-09-12T01:39:15.187458+0000","last_fullsized":"2024-09-12T01:39:15.187458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.253305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188136+0000","last_change":"2024-09-12T01:39:13.914204+0000","last_active":"2024-09-12T01:39:15.188136+0000","last_peered":"2024-09-12T01:39:15.188136+0000","last_clean":"2024-09-12T01:39:15.188136+0000","last_became_active":"2024-09-12T01:39:13.913793+0000","last_became_peered":"2024-09-12T01:39:13.913793+0000","last_unstale":"2024-09-12T01:39:15.188136+0000","last_undegraded":"2024-09-12T01:39:15.188136+0000","last_fullsized":"2024-09-12T01:39:15.188136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:39.460105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129102+0000","last_change":"2024-09-12T01:39:13.904244+0000","last_active":"2024-09-12T01:39:15.129102+0000","last_peered":"2024-09-12T01:39:15.129102+0000","last_clean":"2024-09-12T01:39:15.129102+0000","last_became_active":"2024-09-12T01:39:13.903977+0000","last_became_peered":"2024-09-12T01:39:13.903977+0000","last_unstale":"2024-09-12T01:39:15.129102+0000","last_undegraded":"2024-09-12T01:39:15.129102+0000","last_fullsized":"2024-09-12T01:39:15.129102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:25.368830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129071+0000","last_change":"2024-09-12T01:39:13.898284+0000","last_active":"2024-09-12T01:39:15.129071+0000","last_peered":"2024-09-12T01:39:15.129071+0000","last_clean":"2024-09-12T01:39:15.129071+0000","last_became_active":"2024-09-12T01:39:13.898019+0000","last_became_peered":"2024-09-12T01:39:13.898019+0000","last_unstale":"2024-09-12T01:39:15.129071+0000","last_undegraded":"2024-09-12T01:39:15.129071+0000","last_fullsized":"2024-09-12T01:39:15.129071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:56.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187418+0000","last_change":"2024-09-12T01:39:13.905161+0000","last_active":"2024-09-12T01:39:15.187418+0000","last_peered":"2024-09-12T01:39:15.187418+0000","last_clean":"2024-09-12T01:39:15.187418+0000","last_became_active":"2024-09-12T01:39:13.902828+0000","last_became_peered":"2024-09-12T01:39:13.902828+0000","last_unstale":"2024-09-12T01:39:15.187418+0000","last_undegraded":"2024-09-12T01:39:15.187418+0000","last_fullsized":"2024-09-12T01:39:15.187418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:48.165883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908214+0000","last_change":"2024-09-12T01:39:13.903914+0000","last_active":"2024-09-12T01:39:14.908214+0000","last_peered":"2024-09-12T01:39:14.908214+0000","last_clean":"2024-09-12T01:39:14.908214+0000","last_became_active":"2024-09-12T01:39:13.903632+0000","last_became_peered":"2024-09-12T01:39:13.903632+0000","last_unstale":"2024-09-12T01:39:14.908214+0000","last_undegraded":"2024-09-12T01:39:14.908214+0000","last_fullsized":"2024-09-12T01:39:14.908214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:41.271935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187447+0000","last_change":"2024-09-12T01:39:13.900164+0000","last_active":"2024-09-12T01:39:15.187447+0000","last_peered":"2024-09-12T01:39:15.187447+0000","last_clean":"2024-09-12T01:39:15.187447+0000","last_became_active":"2024-09-12T01:39:13.899484+0000","last_became_peered":"2024-09-12T01:39:13.899484+0000","last_unstale":"2024-09-12T01:39:15.187447+0000","last_undegraded":"2024-09-12T01:39:15.187447+0000","last_fullsized":"2024-09-12T01:39:15.187447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:50.818822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902704+0000","last_change":"2024-09-12T01:39:13.894221+0000","last_active":"2024-09-12T01:39:14.902704+0000","last_peered":"2024-09-12T01:39:14.902704+0000","last_clean":"2024-09-12T01:39:14.902704+0000","last_became_active":"2024-09-12T01:39:13.893930+0000","last_became_peered":"2024-09-12T01:39:13.893930+0000","last_unstale":"2024-09-12T01:39:14.902704+0000","last_undegraded":"2024-09-12T01:39:14.902704+0000","last_fullsized":"2024-09-12T01:39:14.902704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:55.097048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902909+0000","last_change":"2024-09-12T01:39:13.894931+0000","last_active":"2024-09-12T01:39:14.902909+0000","last_peered":"2024-09-12T01:39:14.902909+0000","last_clean":"2024-09-12T01:39:14.902909+0000","last_became_active":"2024-09-12T01:39:13.894587+0000","last_became_peered":"2024-09-12T01:39:13.894587+0000","last_unstale":"2024-09-12T01:39:14.902909+0000","last_undegraded":"2024-09-12T01:39:14.902909+0000","last_fullsized":"2024-09-12T01:39:14.902909+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:56.121397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187568+0000","last_change":"2024-09-12T01:39:13.915079+0000","last_active":"2024-09-12T01:39:15.187568+0000","last_peered":"2024-09-12T01:39:15.187568+0000","last_clean":"2024-09-12T01:39:15.187568+0000","last_became_active":"2024-09-12T01:39:13.914761+0000","last_became_peered":"2024-09-12T01:39:13.914761+0000","last_unstale":"2024-09-12T01:39:15.187568+0000","last_undegraded":"2024-09-12T01:39:15.187568+0000","last_fullsized":"2024-09-12T01:39:15.187568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.815960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129105+0000","last_change":"2024-09-12T01:39:12.896630+0000","last_active":"2024-09-12T01:39:15.129105+0000","last_peered":"2024-09-12T01:39:15.129105+0000","last_clean":"2024-09-12T01:39:15.129105+0000","last_became_active":"2024-09-12T01:39:12.896343+0000","last_became_peered":"2024-09-12T01:39:12.896343+0000","last_unstale":"2024-09-12T01:39:15.129105+0000","last_undegraded":"2024-09-12T01:39:15.129105+0000","last_fullsized":"2024-09-12T01:39:15.129105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:40.029147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187440+0000","last_change":"2024-09-12T01:39:13.904295+0000","last_active":"2024-09-12T01:39:15.187440+0000","last_peered":"2024-09-12T01:39:15.187440+0000","last_clean":"2024-09-12T01:39:15.187440+0000","last_became_active":"2024-09-12T01:39:13.903604+0000","last_became_peered":"2024-09-12T01:39:13.903604+0000","last_unstale":"2024-09-12T01:39:15.187440+0000","last_undegraded":"2024-09-12T01:39:15.187440+0000","last_fullsized":"2024-09-12T01:39:15.187440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:18.193470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903131+0000","last_change":"2024-09-12T01:39:12.896766+0000","last_active":"2024-09-12T01:39:14.903131+0000","last_peered":"2024-09-12T01:39:14.903131+0000","last_clean":"2024-09-12T01:39:14.903131+0000","last_became_active":"2024-09-12T01:39:12.896143+0000","last_became_peered":"2024-09-12T01:39:12.896143+0000","last_unstale":"2024-09-12T01:39:14.903131+0000","last_undegraded":"2024-09-12T01:39:14.903131+0000","last_fullsized":"2024-09-12T01:39:14.903131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:00.120318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188090+0000","last_change":"2024-09-12T01:39:13.914121+0000","last_active":"2024-09-12T01:39:15.188090+0000","last_peered":"2024-09-12T01:39:15.188090+0000","last_clean":"2024-09-12T01:39:15.188090+0000","last_became_active":"2024-09-12T01:39:13.913818+0000","last_became_peered":"2024-09-12T01:39:13.913818+0000","last_unstale":"2024-09-12T01:39:15.188090+0000","last_undegraded":"2024-09-12T01:39:15.188090+0000","last_fullsized":"2024-09-12T01:39:15.188090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:20.834108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188191+0000","last_change":"2024-09-12T01:39:12.898592+0000","last_active":"2024-09-12T01:39:15.188191+0000","last_peered":"2024-09-12T01:39:15.188191+0000","last_clean":"2024-09-12T01:39:15.188191+0000","last_became_active":"2024-09-12T01:39:12.898312+0000","last_became_peered":"2024-09-12T01:39:12.898312+0000","last_unstale":"2024-09-12T01:39:15.188191+0000","last_undegraded":"2024-09-12T01:39:15.188191+0000","last_fullsized":"2024-09-12T01:39:15.188191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:52.356993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187617+0000","last_change":"2024-09-12T01:39:13.912780+0000","last_active":"2024-09-12T01:39:15.187617+0000","last_peered":"2024-09-12T01:39:15.187617+0000","last_clean":"2024-09-12T01:39:15.187617+0000","last_became_active":"2024-09-12T01:39:13.912419+0000","last_became_peered":"2024-09-12T01:39:13.912419+0000","last_unstale":"2024-09-12T01:39:15.187617+0000","last_undegraded":"2024-09-12T01:39:15.187617+0000","last_fullsized":"2024-09-12T01:39:15.187617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:38.977876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908254+0000","last_change":"2024-09-12T01:39:12.897577+0000","last_active":"2024-09-12T01:39:14.908254+0000","last_peered":"2024-09-12T01:39:14.908254+0000","last_clean":"2024-09-12T01:39:14.908254+0000","last_became_active":"2024-09-12T01:39:12.897230+0000","last_became_peered":"2024-09-12T01:39:12.897230+0000","last_unstale":"2024-09-12T01:39:14.908254+0000","last_undegraded":"2024-09-12T01:39:14.908254+0000","last_fullsized":"2024-09-12T01:39:14.908254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.116323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908050+0000","last_change":"2024-09-12T01:39:13.908787+0000","last_active":"2024-09-12T01:39:14.908050+0000","last_peered":"2024-09-12T01:39:14.908050+0000","last_clean":"2024-09-12T01:39:14.908050+0000","last_became_active":"2024-09-12T01:39:13.908549+0000","last_became_peered":"2024-09-12T01:39:13.908549+0000","last_unstale":"2024-09-12T01:39:14.908050+0000","last_undegraded":"2024-09-12T01:39:14.908050+0000","last_fullsized":"2024-09-12T01:39:14.908050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:02.236054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187564+0000","last_change":"2024-09-12T01:39:12.899469+0000","last_active":"2024-09-12T01:39:15.187564+0000","last_peered":"2024-09-12T01:39:15.187564+0000","last_clean":"2024-09-12T01:39:15.187564+0000","last_became_active":"2024-09-12T01:39:12.899173+0000","last_became_peered":"2024-09-12T01:39:12.899173+0000","last_unstale":"2024-09-12T01:39:15.187564+0000","last_undegraded":"2024-09-12T01:39:15.187564+0000","last_fullsized":"2024-09-12T01:39:15.187564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:17.188396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902965+0000","last_change":"2024-09-12T01:39:13.900761+0000","last_active":"2024-09-12T01:39:14.902965+0000","last_peered":"2024-09-12T01:39:14.902965+0000","last_clean":"2024-09-12T01:39:14.902965+0000","last_became_active":"2024-09-12T01:39:13.900441+0000","last_became_peered":"2024-09-12T01:39:13.900441+0000","last_unstale":"2024-09-12T01:39:14.902965+0000","last_undegraded":"2024-09-12T01:39:14.902965+0000","last_fullsized":"2024-09-12T01:39:14.902965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.891062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902865+0000","last_change":"2024-09-12T01:39:12.901743+0000","last_active":"2024-09-12T01:39:14.902865+0000","last_peered":"2024-09-12T01:39:14.902865+0000","last_clean":"2024-09-12T01:39:14.902865+0000","last_became_active":"2024-09-12T01:39:12.901418+0000","last_became_peered":"2024-09-12T01:39:12.901418+0000","last_unstale":"2024-09-12T01:39:14.902865+0000","last_undegraded":"2024-09-12T01:39:14.902865+0000","last_fullsized":"2024-09-12T01:39:14.902865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:27.983076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187162+0000","last_change":"2024-09-12T01:39:13.898011+0000","last_active":"2024-09-12T01:39:15.187162+0000","last_peered":"2024-09-12T01:39:15.187162+0000","last_clean":"2024-09-12T01:39:15.187162+0000","last_became_active":"2024-09-12T01:39:13.897644+0000","last_became_peered":"2024-09-12T01:39:13.897644+0000","last_unstale":"2024-09-12T01:39:15.187162+0000","last_undegraded":"2024-09-12T01:39:15.187162+0000","last_fullsized":"2024-09-12T01:39:15.187162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:03.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187381+0000","last_change":"2024-09-12T01:39:12.901437+0000","last_active":"2024-09-12T01:39:15.187381+0000","last_peered":"2024-09-12T01:39:15.187381+0000","last_clean":"2024-09-12T01:39:15.187381+0000","last_became_active":"2024-09-12T01:39:12.901120+0000","last_became_peered":"2024-09-12T01:39:12.901120+0000","last_unstale":"2024-09-12T01:39:15.187381+0000","last_undegraded":"2024-09-12T01:39:15.187381+0000","last_fullsized":"2024-09-12T01:39:15.187381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:18.265444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187431+0000","last_change":"2024-09-12T01:39:13.896873+0000","last_active":"2024-09-12T01:39:15.187431+0000","last_peered":"2024-09-12T01:39:15.187431+0000","last_clean":"2024-09-12T01:39:15.187431+0000","last_became_active":"2024-09-12T01:39:13.896578+0000","last_became_peered":"2024-09-12T01:39:13.896578+0000","last_unstale":"2024-09-12T01:39:15.187431+0000","last_undegraded":"2024-09-12T01:39:15.187431+0000","last_fullsized":"2024-09-12T01:39:15.187431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:53.362068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187132+0000","last_change":"2024-09-12T01:39:12.903658+0000","last_active":"2024-09-12T01:39:15.187132+0000","last_peered":"2024-09-12T01:39:15.187132+0000","last_clean":"2024-09-12T01:39:15.187132+0000","last_became_active":"2024-09-12T01:39:12.903455+0000","last_became_peered":"2024-09-12T01:39:12.903455+0000","last_unstale":"2024-09-12T01:39:15.187132+0000","last_undegraded":"2024-09-12T01:39:15.187132+0000","last_fullsized":"2024-09-12T01:39:15.187132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:07.523595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187442+0000","last_change":"2024-09-12T01:39:13.906892+0000","last_active":"2024-09-12T01:39:15.187442+0000","last_peered":"2024-09-12T01:39:15.187442+0000","last_clean":"2024-09-12T01:39:15.187442+0000","last_became_active":"2024-09-12T01:39:13.906624+0000","last_became_peered":"2024-09-12T01:39:13.906624+0000","last_unstale":"2024-09-12T01:39:15.187442+0000","last_undegraded":"2024-09-12T01:39:15.187442+0000","last_fullsized":"2024-09-12T01:39:15.187442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:16.212505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187700+0000","last_change":"2024-09-12T01:39:12.898372+0000","last_active":"2024-09-12T01:39:15.187700+0000","last_peered":"2024-09-12T01:39:15.187700+0000","last_clean":"2024-09-12T01:39:15.187700+0000","last_became_active":"2024-09-12T01:39:12.898048+0000","last_became_peered":"2024-09-12T01:39:12.898048+0000","last_unstale":"2024-09-12T01:39:15.187700+0000","last_undegraded":"2024-09-12T01:39:15.187700+0000","last_fullsized":"2024-09-12T01:39:15.187700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:37.700774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187604+0000","last_change":"2024-09-12T01:39:13.913892+0000","last_active":"2024-09-12T01:39:15.187604+0000","last_peered":"2024-09-12T01:39:15.187604+0000","last_clean":"2024-09-12T01:39:15.187604+0000","last_became_active":"2024-09-12T01:39:13.913473+0000","last_became_peered":"2024-09-12T01:39:13.913473+0000","last_unstale":"2024-09-12T01:39:15.187604+0000","last_undegraded":"2024-09-12T01:39:15.187604+0000","last_fullsized":"2024-09-12T01:39:15.187604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.253305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903236+0000","last_change":"2024-09-12T01:39:12.897002+0000","last_active":"2024-09-12T01:39:14.903236+0000","last_peered":"2024-09-12T01:39:14.903236+0000","last_clean":"2024-09-12T01:39:14.903236+0000","last_became_active":"2024-09-12T01:39:12.896502+0000","last_became_peered":"2024-09-12T01:39:12.896502+0000","last_unstale":"2024-09-12T01:39:14.903236+0000","last_undegraded":"2024-09-12T01:39:14.903236+0000","last_fullsized":"2024-09-12T01:39:14.903236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:37.972801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187824+0000","last_change":"2024-09-12T01:39:13.914328+0000","last_active":"2024-09-12T01:39:15.187824+0000","last_peered":"2024-09-12T01:39:15.187824+0000","last_clean":"2024-09-12T01:39:15.187824+0000","last_became_active":"2024-09-12T01:39:13.914055+0000","last_became_peered":"2024-09-12T01:39:13.914055+0000","last_unstale":"2024-09-12T01:39:15.187824+0000","last_undegraded":"2024-09-12T01:39:15.187824+0000","last_fullsized":"2024-09-12T01:39:15.187824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:54.539029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187798+0000","last_change":"2024-09-12T01:39:12.895761+0000","last_active":"2024-09-12T01:39:15.187798+0000","last_peered":"2024-09-12T01:39:15.187798+0000","last_clean":"2024-09-12T01:39:15.187798+0000","last_became_active":"2024-09-12T01:39:12.895469+0000","last_became_peered":"2024-09-12T01:39:12.895469+0000","last_unstale":"2024-09-12T01:39:15.187798+0000","last_undegraded":"2024-09-12T01:39:15.187798+0000","last_fullsized":"2024-09-12T01:39:15.187798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:22.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129042+0000","last_change":"2024-09-12T01:39:13.912400+0000","last_active":"2024-09-12T01:39:15.129042+0000","last_peered":"2024-09-12T01:39:15.129042+0000","last_clean":"2024-09-12T01:39:15.129042+0000","last_became_active":"2024-09-12T01:39:13.912154+0000","last_became_peered":"2024-09-12T01:39:13.912154+0000","last_unstale":"2024-09-12T01:39:15.129042+0000","last_undegraded":"2024-09-12T01:39:15.129042+0000","last_fullsized":"2024-09-12T01:39:15.129042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:36.874197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"79'6","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188153+0000","last_change":"2024-09-12T01:39:12.898516+0000","last_active":"2024-09-12T01:39:15.188153+0000","last_peered":"2024-09-12T01:39:15.188153+0000","last_clean":"2024-09-12T01:39:15.188153+0000","last_became_active":"2024-09-12T01:39:12.898169+0000","last_became_peered":"2024-09-12T01:39:12.898169+0000","last_unstale":"2024-09-12T01:39:15.188153+0000","last_undegraded":"2024-09-12T01:39:15.188153+0000","last_fullsized":"2024-09-12T01:39:15.188153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:00.120318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187751+0000","last_change":"2024-09-12T01:39:13.907928+0000","last_active":"2024-09-12T01:39:15.187751+0000","last_peered":"2024-09-12T01:39:15.187751+0000","last_clean":"2024-09-12T01:39:15.187751+0000","last_became_active":"2024-09-12T01:39:13.907637+0000","last_became_peered":"2024-09-12T01:39:13.907637+0000","last_unstale":"2024-09-12T01:39:15.187751+0000","last_undegraded":"2024-09-12T01:39:15.187751+0000","last_fullsized":"2024-09-12T01:39:15.187751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:36.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908265+0000","last_change":"2024-09-12T01:39:12.896500+0000","last_active":"2024-09-12T01:39:14.908265+0000","last_peered":"2024-09-12T01:39:14.908265+0000","last_clean":"2024-09-12T01:39:14.908265+0000","last_became_active":"2024-09-12T01:39:12.896204+0000","last_became_peered":"2024-09-12T01:39:12.896204+0000","last_unstale":"2024-09-12T01:39:14.908265+0000","last_undegraded":"2024-09-12T01:39:14.908265+0000","last_fullsized":"2024-09-12T01:39:14.908265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:31.885987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187726+0000","last_change":"2024-09-12T01:39:13.911848+0000","last_active":"2024-09-12T01:39:15.187726+0000","last_peered":"2024-09-12T01:39:15.187726+0000","last_clean":"2024-09-12T01:39:15.187726+0000","last_became_active":"2024-09-12T01:39:13.911578+0000","last_became_peered":"2024-09-12T01:39:13.911578+0000","last_unstale":"2024-09-12T01:39:15.187726+0000","last_undegraded":"2024-09-12T01:39:15.187726+0000","last_fullsized":"2024-09-12T01:39:15.187726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:36.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T01:39:12.898209+0000","last_change":"2024-09-12T01:39:12.894877+0000","last_active":"2024-09-12T01:39:12.898209+0000","last_peered":"2024-09-12T01:39:12.898209+0000","last_clean":"2024-09-12T01:39:12.898209+0000","last_became_active":"2024-09-12T01:39:12.894584+0000","last_became_peered":"2024-09-12T01:39:12.894584+0000","last_unstale":"2024-09-12T01:39:12.898209+0000","last_undegraded":"2024-09-12T01:39:12.898209+0000","last_fullsized":"2024-09-12T01:39:12.898209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:21.828714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187238+0000","last_change":"2024-09-12T01:39:13.898011+0000","last_active":"2024-09-12T01:39:15.187238+0000","last_peered":"2024-09-12T01:39:15.187238+0000","last_clean":"2024-09-12T01:39:15.187238+0000","last_became_active":"2024-09-12T01:39:13.897749+0000","last_became_peered":"2024-09-12T01:39:13.897749+0000","last_unstale":"2024-09-12T01:39:15.187238+0000","last_undegraded":"2024-09-12T01:39:15.187238+0000","last_fullsized":"2024-09-12T01:39:15.187238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:24.935008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902705+0000","last_change":"2024-09-12T01:39:12.895196+0000","last_active":"2024-09-12T01:39:14.902705+0000","last_peered":"2024-09-12T01:39:14.902705+0000","last_clean":"2024-09-12T01:39:14.902705+0000","last_became_active":"2024-09-12T01:39:12.894890+0000","last_became_peered":"2024-09-12T01:39:12.894890+0000","last_unstale":"2024-09-12T01:39:14.902705+0000","last_undegraded":"2024-09-12T01:39:14.902705+0000","last_fullsized":"2024-09-12T01:39:14.902705+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:47.160808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187452+0000","last_change":"2024-09-12T01:39:13.906691+0000","last_active":"2024-09-12T01:39:15.187452+0000","last_peered":"2024-09-12T01:39:15.187452+0000","last_clean":"2024-09-12T01:39:15.187452+0000","last_became_active":"2024-09-12T01:39:13.906346+0000","last_became_peered":"2024-09-12T01:39:13.906346+0000","last_unstale":"2024-09-12T01:39:15.187452+0000","last_undegraded":"2024-09-12T01:39:15.187452+0000","last_fullsized":"2024-09-12T01:39:15.187452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:38.977876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"79'8","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187582+0000","last_change":"2024-09-12T01:39:12.892882+0000","last_active":"2024-09-12T01:39:15.187582+0000","last_peered":"2024-09-12T01:39:15.187582+0000","last_clean":"2024-09-12T01:39:15.187582+0000","last_became_active":"2024-09-12T01:39:12.892533+0000","last_became_peered":"2024-09-12T01:39:12.892533+0000","last_unstale":"2024-09-12T01:39:15.187582+0000","last_undegraded":"2024-09-12T01:39:15.187582+0000","last_fullsized":"2024-09-12T01:39:15.187582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:59.814949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187723+0000","last_change":"2024-09-12T01:39:13.916960+0000","last_active":"2024-09-12T01:39:15.187723+0000","last_peered":"2024-09-12T01:39:15.187723+0000","last_clean":"2024-09-12T01:39:15.187723+0000","last_became_active":"2024-09-12T01:39:13.916569+0000","last_became_peered":"2024-09-12T01:39:13.916569+0000","last_unstale":"2024-09-12T01:39:15.187723+0000","last_undegraded":"2024-09-12T01:39:15.187723+0000","last_fullsized":"2024-09-12T01:39:15.187723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:56.121397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129266+0000","last_change":"2024-09-12T01:39:12.895948+0000","last_active":"2024-09-12T01:39:15.129266+0000","last_peered":"2024-09-12T01:39:15.129266+0000","last_clean":"2024-09-12T01:39:15.129266+0000","last_became_active":"2024-09-12T01:39:12.895645+0000","last_became_peered":"2024-09-12T01:39:12.895645+0000","last_unstale":"2024-09-12T01:39:15.129266+0000","last_undegraded":"2024-09-12T01:39:15.129266+0000","last_fullsized":"2024-09-12T01:39:15.129266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:27.105186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903397+0000","last_change":"2024-09-12T01:39:13.895212+0000","last_active":"2024-09-12T01:39:14.903397+0000","last_peered":"2024-09-12T01:39:14.903397+0000","last_clean":"2024-09-12T01:39:14.903397+0000","last_became_active":"2024-09-12T01:39:13.894887+0000","last_became_peered":"2024-09-12T01:39:13.894887+0000","last_unstale":"2024-09-12T01:39:14.903397+0000","last_undegraded":"2024-09-12T01:39:14.903397+0000","last_fullsized":"2024-09-12T01:39:14.903397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:25.363826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187893+0000","last_change":"2024-09-12T01:39:12.900345+0000","last_active":"2024-09-12T01:39:15.187893+0000","last_peered":"2024-09-12T01:39:15.187893+0000","last_clean":"2024-09-12T01:39:15.187893+0000","last_became_active":"2024-09-12T01:39:12.900043+0000","last_became_peered":"2024-09-12T01:39:12.900043+0000","last_unstale":"2024-09-12T01:39:15.187893+0000","last_undegraded":"2024-09-12T01:39:15.187893+0000","last_fullsized":"2024-09-12T01:39:15.187893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:46.990181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187995+0000","last_change":"2024-09-12T01:39:13.915910+0000","last_active":"2024-09-12T01:39:15.187995+0000","last_peered":"2024-09-12T01:39:15.187995+0000","last_clean":"2024-09-12T01:39:15.187995+0000","last_became_active":"2024-09-12T01:39:13.915569+0000","last_became_peered":"2024-09-12T01:39:13.915569+0000","last_unstale":"2024-09-12T01:39:15.187995+0000","last_undegraded":"2024-09-12T01:39:15.187995+0000","last_fullsized":"2024-09-12T01:39:15.187995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:44.878735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187677+0000","last_change":"2024-09-12T01:39:12.900655+0000","last_active":"2024-09-12T01:39:15.187677+0000","last_peered":"2024-09-12T01:39:15.187677+0000","last_clean":"2024-09-12T01:39:15.187677+0000","last_became_active":"2024-09-12T01:39:12.900298+0000","last_became_peered":"2024-09-12T01:39:12.900298+0000","last_unstale":"2024-09-12T01:39:15.187677+0000","last_undegraded":"2024-09-12T01:39:15.187677+0000","last_fullsized":"2024-09-12T01:39:15.187677+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:56.792978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.888244+0000","last_change":"2024-09-12T01:39:12.888244+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.888244+0000","last_undegraded":"2024-09-12T01:39:12.888244+0000","last_fullsized":"2024-09-12T01:39:12.888244+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187593+0000","last_change":"2024-09-12T01:39:12.899244+0000","last_active":"2024-09-12T01:39:15.187593+0000","last_peered":"2024-09-12T01:39:15.187593+0000","last_clean":"2024-09-12T01:39:15.187593+0000","last_became_active":"2024-09-12T01:39:12.898773+0000","last_became_peered":"2024-09-12T01:39:12.898773+0000","last_unstale":"2024-09-12T01:39:15.187593+0000","last_undegraded":"2024-09-12T01:39:15.187593+0000","last_fullsized":"2024-09-12T01:39:15.187593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:32.656288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128927+0000","last_change":"2024-09-12T01:39:13.908672+0000","last_active":"2024-09-12T01:39:15.128927+0000","last_peered":"2024-09-12T01:39:15.128927+0000","last_clean":"2024-09-12T01:39:15.128927+0000","last_became_active":"2024-09-12T01:39:13.908365+0000","last_became_peered":"2024-09-12T01:39:13.908365+0000","last_unstale":"2024-09-12T01:39:15.128927+0000","last_undegraded":"2024-09-12T01:39:15.128927+0000","last_fullsized":"2024-09-12T01:39:15.128927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:28.239676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T01:39:12.899940+0000","last_change":"2024-09-12T01:39:12.897940+0000","last_active":"2024-09-12T01:39:12.899940+0000","last_peered":"2024-09-12T01:39:12.899940+0000","last_clean":"2024-09-12T01:39:12.899940+0000","last_became_active":"2024-09-12T01:39:12.897617+0000","last_became_peered":"2024-09-12T01:39:12.897617+0000","last_unstale":"2024-09-12T01:39:12.899940+0000","last_undegraded":"2024-09-12T01:39:12.899940+0000","last_fullsized":"2024-09-12T01:39:12.899940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:38.210811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907757+0000","last_change":"2024-09-12T01:39:13.908088+0000","last_active":"2024-09-12T01:39:14.907757+0000","last_peered":"2024-09-12T01:39:14.907757+0000","last_clean":"2024-09-12T01:39:14.907757+0000","last_became_active":"2024-09-12T01:39:13.907807+0000","last_became_peered":"2024-09-12T01:39:13.907807+0000","last_unstale":"2024-09-12T01:39:14.907757+0000","last_undegraded":"2024-09-12T01:39:14.907757+0000","last_fullsized":"2024-09-12T01:39:14.907757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:58.775933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187702+0000","last_change":"2024-09-12T01:39:12.892007+0000","last_active":"2024-09-12T01:39:15.187702+0000","last_peered":"2024-09-12T01:39:15.187702+0000","last_clean":"2024-09-12T01:39:15.187702+0000","last_became_active":"2024-09-12T01:39:12.891744+0000","last_became_peered":"2024-09-12T01:39:12.891744+0000","last_unstale":"2024-09-12T01:39:15.187702+0000","last_undegraded":"2024-09-12T01:39:15.187702+0000","last_fullsized":"2024-09-12T01:39:15.187702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.207430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187658+0000","last_change":"2024-09-12T01:39:13.913157+0000","last_active":"2024-09-12T01:39:15.187658+0000","last_peered":"2024-09-12T01:39:15.187658+0000","last_clean":"2024-09-12T01:39:15.187658+0000","last_became_active":"2024-09-12T01:39:13.912881+0000","last_became_peered":"2024-09-12T01:39:13.912881+0000","last_unstale":"2024-09-12T01:39:15.187658+0000","last_undegraded":"2024-09-12T01:39:15.187658+0000","last_fullsized":"2024-09-12T01:39:15.187658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:03.256051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187393+0000","last_change":"2024-09-12T01:39:12.897776+0000","last_active":"2024-09-12T01:39:15.187393+0000","last_peered":"2024-09-12T01:39:15.187393+0000","last_clean":"2024-09-12T01:39:15.187393+0000","last_became_active":"2024-09-12T01:39:12.897527+0000","last_became_peered":"2024-09-12T01:39:12.897527+0000","last_unstale":"2024-09-12T01:39:15.187393+0000","last_undegraded":"2024-09-12T01:39:15.187393+0000","last_fullsized":"2024-09-12T01:39:15.187393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:29.855267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129181+0000","last_change":"2024-09-12T01:39:13.900476+0000","last_active":"2024-09-12T01:39:15.129181+0000","last_peered":"2024-09-12T01:39:15.129181+0000","last_clean":"2024-09-12T01:39:15.129181+0000","last_became_active":"2024-09-12T01:39:13.900204+0000","last_became_peered":"2024-09-12T01:39:13.900204+0000","last_unstale":"2024-09-12T01:39:15.129181+0000","last_undegraded":"2024-09-12T01:39:15.129181+0000","last_fullsized":"2024-09-12T01:39:15.129181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:41.140743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187678+0000","last_change":"2024-09-12T01:39:12.904275+0000","last_active":"2024-09-12T01:39:15.187678+0000","last_peered":"2024-09-12T01:39:15.187678+0000","last_clean":"2024-09-12T01:39:15.187678+0000","last_became_active":"2024-09-12T01:39:12.904028+0000","last_became_peered":"2024-09-12T01:39:12.904028+0000","last_unstale":"2024-09-12T01:39:15.187678+0000","last_undegraded":"2024-09-12T01:39:15.187678+0000","last_fullsized":"2024-09-12T01:39:15.187678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:27.433076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129064+0000","last_change":"2024-09-12T01:39:13.912165+0000","last_active":"2024-09-12T01:39:15.129064+0000","last_peered":"2024-09-12T01:39:15.129064+0000","last_clean":"2024-09-12T01:39:15.129064+0000","last_became_active":"2024-09-12T01:39:13.911869+0000","last_became_peered":"2024-09-12T01:39:13.911869+0000","last_unstale":"2024-09-12T01:39:15.129064+0000","last_undegraded":"2024-09-12T01:39:15.129064+0000","last_fullsized":"2024-09-12T01:39:15.129064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:43.619413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187997+0000","last_change":"2024-09-12T01:39:12.890030+0000","last_active":"2024-09-12T01:39:15.187997+0000","last_peered":"2024-09-12T01:39:15.187997+0000","last_clean":"2024-09-12T01:39:15.187997+0000","last_became_active":"2024-09-12T01:39:12.889687+0000","last_became_peered":"2024-09-12T01:39:12.889687+0000","last_unstale":"2024-09-12T01:39:15.187997+0000","last_undegraded":"2024-09-12T01:39:15.187997+0000","last_fullsized":"2024-09-12T01:39:15.187997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:49.813748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128984+0000","last_change":"2024-09-12T01:39:13.902776+0000","last_active":"2024-09-12T01:39:15.128984+0000","last_peered":"2024-09-12T01:39:15.128984+0000","last_clean":"2024-09-12T01:39:15.128984+0000","last_became_active":"2024-09-12T01:39:13.902502+0000","last_became_peered":"2024-09-12T01:39:13.902502+0000","last_unstale":"2024-09-12T01:39:15.128984+0000","last_undegraded":"2024-09-12T01:39:15.128984+0000","last_fullsized":"2024-09-12T01:39:15.128984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:01.168363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188042+0000","last_change":"2024-09-12T01:39:12.900224+0000","last_active":"2024-09-12T01:39:15.188042+0000","last_peered":"2024-09-12T01:39:15.188042+0000","last_clean":"2024-09-12T01:39:15.188042+0000","last_became_active":"2024-09-12T01:39:12.899905+0000","last_became_peered":"2024-09-12T01:39:12.899905+0000","last_unstale":"2024-09-12T01:39:15.188042+0000","last_undegraded":"2024-09-12T01:39:15.188042+0000","last_fullsized":"2024-09-12T01:39:15.188042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:30.248231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903170+0000","last_change":"2024-09-12T01:39:13.903873+0000","last_active":"2024-09-12T01:39:14.903170+0000","last_peered":"2024-09-12T01:39:14.903170+0000","last_clean":"2024-09-12T01:39:14.903170+0000","last_became_active":"2024-09-12T01:39:13.902665+0000","last_became_peered":"2024-09-12T01:39:13.902665+0000","last_unstale":"2024-09-12T01:39:14.903170+0000","last_undegraded":"2024-09-12T01:39:14.903170+0000","last_fullsized":"2024-09-12T01:39:14.903170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:20.834108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902828+0000","last_change":"2024-09-12T01:39:12.900941+0000","last_active":"2024-09-12T01:39:14.902828+0000","last_peered":"2024-09-12T01:39:14.902828+0000","last_clean":"2024-09-12T01:39:14.902828+0000","last_became_active":"2024-09-12T01:39:12.900582+0000","last_became_peered":"2024-09-12T01:39:12.900582+0000","last_unstale":"2024-09-12T01:39:14.902828+0000","last_undegraded":"2024-09-12T01:39:14.902828+0000","last_fullsized":"2024-09-12T01:39:14.902828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:17.188396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187305+0000","last_change":"2024-09-12T01:39:13.906501+0000","last_active":"2024-09-12T01:39:15.187305+0000","last_peered":"2024-09-12T01:39:15.187305+0000","last_clean":"2024-09-12T01:39:15.187305+0000","last_became_active":"2024-09-12T01:39:13.905251+0000","last_became_peered":"2024-09-12T01:39:13.905251+0000","last_unstale":"2024-09-12T01:39:15.187305+0000","last_undegraded":"2024-09-12T01:39:15.187305+0000","last_fullsized":"2024-09-12T01:39:15.187305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:12.012554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T01:39:12.899668+0000","last_change":"2024-09-12T01:39:12.896423+0000","last_active":"2024-09-12T01:39:12.899668+0000","last_peered":"2024-09-12T01:39:12.899668+0000","last_clean":"2024-09-12T01:39:12.899668+0000","last_became_active":"2024-09-12T01:39:12.896163+0000","last_became_peered":"2024-09-12T01:39:12.896163+0000","last_unstale":"2024-09-12T01:39:12.899668+0000","last_undegraded":"2024-09-12T01:39:12.899668+0000","last_fullsized":"2024-09-12T01:39:12.899668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:18.895862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187808+0000","last_change":"2024-09-12T01:39:13.906963+0000","last_active":"2024-09-12T01:39:15.187808+0000","last_peered":"2024-09-12T01:39:15.187808+0000","last_clean":"2024-09-12T01:39:15.187808+0000","last_became_active":"2024-09-12T01:39:13.906272+0000","last_became_peered":"2024-09-12T01:39:13.906272+0000","last_unstale":"2024-09-12T01:39:15.187808+0000","last_undegraded":"2024-09-12T01:39:15.187808+0000","last_fullsized":"2024-09-12T01:39:15.187808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:26.904998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902944+0000","last_change":"2024-09-12T01:39:12.902567+0000","last_active":"2024-09-12T01:39:14.902944+0000","last_peered":"2024-09-12T01:39:14.902944+0000","last_clean":"2024-09-12T01:39:14.902944+0000","last_became_active":"2024-09-12T01:39:12.902261+0000","last_became_peered":"2024-09-12T01:39:12.902261+0000","last_unstale":"2024-09-12T01:39:14.902944+0000","last_undegraded":"2024-09-12T01:39:14.902944+0000","last_fullsized":"2024-09-12T01:39:14.902944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:30.248231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187175+0000","last_change":"2024-09-12T01:39:13.903016+0000","last_active":"2024-09-12T01:39:15.187175+0000","last_peered":"2024-09-12T01:39:15.187175+0000","last_clean":"2024-09-12T01:39:15.187175+0000","last_became_active":"2024-09-12T01:39:13.902740+0000","last_became_peered":"2024-09-12T01:39:13.902740+0000","last_unstale":"2024-09-12T01:39:15.187175+0000","last_undegraded":"2024-09-12T01:39:15.187175+0000","last_fullsized":"2024-09-12T01:39:15.187175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:55.372979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187123+0000","last_change":"2024-09-12T01:39:12.896200+0000","last_active":"2024-09-12T01:39:15.187123+0000","last_peered":"2024-09-12T01:39:15.187123+0000","last_clean":"2024-09-12T01:39:15.187123+0000","last_became_active":"2024-09-12T01:39:12.895937+0000","last_became_peered":"2024-09-12T01:39:12.895937+0000","last_unstale":"2024-09-12T01:39:15.187123+0000","last_undegraded":"2024-09-12T01:39:15.187123+0000","last_fullsized":"2024-09-12T01:39:15.187123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:16.330008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187586+0000","last_change":"2024-09-12T01:39:13.905333+0000","last_active":"2024-09-12T01:39:15.187586+0000","last_peered":"2024-09-12T01:39:15.187586+0000","last_clean":"2024-09-12T01:39:15.187586+0000","last_became_active":"2024-09-12T01:39:13.904982+0000","last_became_peered":"2024-09-12T01:39:13.904982+0000","last_unstale":"2024-09-12T01:39:15.187586+0000","last_undegraded":"2024-09-12T01:39:15.187586+0000","last_fullsized":"2024-09-12T01:39:15.187586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:01.125393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187933+0000","last_change":"2024-09-12T01:39:12.897786+0000","last_active":"2024-09-12T01:39:15.187933+0000","last_peered":"2024-09-12T01:39:15.187933+0000","last_clean":"2024-09-12T01:39:15.187933+0000","last_became_active":"2024-09-12T01:39:12.897384+0000","last_became_peered":"2024-09-12T01:39:12.897384+0000","last_unstale":"2024-09-12T01:39:15.187933+0000","last_undegraded":"2024-09-12T01:39:15.187933+0000","last_fullsized":"2024-09-12T01:39:15.187933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:37.972801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187951+0000","last_change":"2024-09-12T01:39:13.915042+0000","last_active":"2024-09-12T01:39:15.187951+0000","last_peered":"2024-09-12T01:39:15.187951+0000","last_clean":"2024-09-12T01:39:15.187951+0000","last_became_active":"2024-09-12T01:39:13.914403+0000","last_became_peered":"2024-09-12T01:39:13.914403+0000","last_unstale":"2024-09-12T01:39:15.187951+0000","last_undegraded":"2024-09-12T01:39:15.187951+0000","last_fullsized":"2024-09-12T01:39:15.187951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:54.227036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129155+0000","last_change":"2024-09-12T01:39:12.897053+0000","last_active":"2024-09-12T01:39:15.129155+0000","last_peered":"2024-09-12T01:39:15.129155+0000","last_clean":"2024-09-12T01:39:15.129155+0000","last_became_active":"2024-09-12T01:39:12.896613+0000","last_became_peered":"2024-09-12T01:39:12.896613+0000","last_unstale":"2024-09-12T01:39:15.129155+0000","last_undegraded":"2024-09-12T01:39:15.129155+0000","last_fullsized":"2024-09-12T01:39:15.129155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:22.437750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":278,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187214+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:39:15.187214+0000","last_peered":"2024-09-12T01:39:15.187214+0000","last_clean":"2024-09-12T01:39:15.187214+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:39:15.187214+0000","last_undegraded":"2024-09-12T01:39:15.187214+0000","last_fullsized":"2024-09-12T01:39:15.187214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":401627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":408529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":999871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":408531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":407857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1560576,"data_stored":992015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":978944,"data_stored":403191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":950272,"data_stored":394782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:39:17.232 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:39:17.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.371+0000 7f7a7732a640 1 Processor -- start 2024-09-12T01:39:17.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.372+0000 7f7a7732a640 1 -- start start 2024-09-12T01:39:17.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.372+0000 7f7a7732a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a7015e660 0x7f7a700cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.372+0000 7f7a7732a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a7015ea40 con 0x7f7a700d1820 2024-09-12T01:39:17.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.372+0000 7f7a7732a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a700d3870 con 0x7f7a700d3310 2024-09-12T01:39:17.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.372+0000 7f7a7732a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a700d3b50 con 0x7f7a7015e660 2024-09-12T01:39:17.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a758c7640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7a700d1820 0x7f7a700b7b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41856/0 (socket says 172.21.15.60:41856) 2024-09-12T01:39:17.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a758c7640 1 -- 172.21.15.60:0/1595563280 learned_addr learned my addr 172.21.15.60:0/1595563280 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:17.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a750c6640 1 --2- 172.21.15.60:0/1595563280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a7015e660 0x7f7a700cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915306088 0 0) 0x7f7a7015ea40 con 0x7f7a700d1820 2024-09-12T01:39:17.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a5c003520 con 0x7f7a700d1820 2024-09-12T01:39:17.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2286097876 0 0) 0x7f7a5c003520 con 0x7f7a700d1820 2024-09-12T01:39:17.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a7015e660 msgr2=0x7f7a700cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:17.374 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 --2- 172.21.15.60:0/1595563280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a7015e660 0x7f7a700cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 >> v1:172.21.15.105:6789/0 conn(0x7f7a700d3310 legacy=0x7f7a700d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a700d3e30 con 0x7f7a700d1820 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f7a680019f0 con 0x7f7a700d1820 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 >> v1:172.21.15.60:6789/0 conn(0x7f7a700d1820 legacy=0x7f7a700b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 --2- 172.21.15.60:0/1595563280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a7015e660 0x7f7a5c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 --2- 172.21.15.60:0/1595563280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5c003f60 0x7f7a5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 --2- 172.21.15.60:0/1595563280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a5c004d40 0x7f7a5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7a700d3b50 con 0x7f7a5c004d40 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5c00baa0 con 0x7f7a5c003f60 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5c00bca0 con 0x7f7a7015e660 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a758c7640 1 --2- 172.21.15.60:0/1595563280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a5c004d40 0x7f7a5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a750c6640 1 --2- 172.21.15.60:0/1595563280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a7015e660 0x7f7a5c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.373+0000 7f7a748c5640 1 --2- 172.21.15.60:0/1595563280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5c003f60 0x7f7a5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.374+0000 7f7a758c7640 1 -- 172.21.15.60:0/1595563280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a7015e660 msgr2=0x7f7a5c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:17.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.374+0000 7f7a758c7640 1 --2- 172.21.15.60:0/1595563280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a7015e660 0x7f7a5c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.374+0000 7f7a758c7640 1 -- 172.21.15.60:0/1595563280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5c003f60 msgr2=0x7f7a5c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:17.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.374+0000 7f7a758c7640 1 --2- 172.21.15.60:0/1595563280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5c003f60 0x7f7a5c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.374+0000 7f7a758c7640 1 -- 172.21.15.60:0/1595563280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5c003520 con 0x7f7a5c004d40 2024-09-12T01:39:17.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.374+0000 7f7a758c7640 1 --2- 172.21.15.60:0/1595563280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a5c004d40 0x7f7a5c0051c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800a840 tx=0x7f7a5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31f095e88c7cbec server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:17.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.375+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800a460 con 0x7f7a5c004d40 2024-09-12T01:39:17.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.375+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a6802f070 con 0x7f7a5c004d40 2024-09-12T01:39:17.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.375+0000 7f7a67fff640 1 -- 172.21.15.60:0/1595563280 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6802bcf0 con 0x7f7a5c004d40 2024-09-12T01:39:17.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.375+0000 7f7a7732a640 1 -- 172.21.15.60:0/1595563280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a5c004d40 msgr2=0x7f7a5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.375+0000 7f7a7732a640 1 --2- 172.21.15.60:0/1595563280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a5c004d40 0x7f7a5c0051c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800a840 tx=0x7f7a5c005830 comp rx=0 tx=0).stop 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.375+0000 7f7a758c7640 1 -- 172.21.15.60:0/1595563280 reap_dead start 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.375+0000 7f7a7732a640 1 -- 172.21.15.60:0/1595563280 shutdown_connections 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.375+0000 7f7a7732a640 1 -- 172.21.15.60:0/1595563280 >> 172.21.15.60:0/1595563280 conn(0x7f7a700b6410 msgr2=0x7f7a700b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.375+0000 7f7a7732a640 1 -- 172.21.15.60:0/1595563280 shutdown_connections 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.375+0000 7f7a7732a640 1 -- 172.21.15.60:0/1595563280 wait complete. 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.376+0000 7f7a7732a640 1 Processor -- start 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.376+0000 7f7a7732a640 1 -- start start 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a7732a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5c004d40 0x7f7a700cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a7732a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a70155080 0x7f7a70155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a7732a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a70153210 0x7f7a701536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a7732a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7a700cf730 con 0x7f7a70153210 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a7732a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7a700d43f0 con 0x7f7a5c004d40 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a7732a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7a700cf8b0 con 0x7f7a70155080 2024-09-12T01:39:17.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a758c7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a70153210 0x7f7a701536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a758c7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a70153210 0x7f7a701536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41720/0 (socket says 172.21.15.60:41720) 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a758c7640 1 -- 172.21.15.60:0/3674152954 learned_addr learned my addr 172.21.15.60:0/3674152954 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a750c6640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5c004d40 0x7f7a700cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a748c5640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a70155080 0x7f7a70155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a758c7640 1 -- 172.21.15.60:0/3674152954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a70155080 msgr2=0x7f7a70155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a758c7640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a70155080 0x7f7a70155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a758c7640 1 -- 172.21.15.60:0/3674152954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5c004d40 msgr2=0x7f7a700cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.377+0000 7f7a758c7640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5c004d40 0x7f7a700cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.378+0000 7f7a758c7640 1 -- 172.21.15.60:0/3674152954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a70155b20 con 0x7f7a70153210 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.378+0000 7f7a748c5640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a70155080 0x7f7a70155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.378+0000 7f7a750c6640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5c004d40 0x7f7a700cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.378+0000 7f7a758c7640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a70153210 0x7f7a701536c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800a840 tx=0x7f7a700d4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.378+0000 7f7a65ffb640 1 -- 172.21.15.60:0/3674152954 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a68044070 con 0x7f7a70153210 2024-09-12T01:39:17.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.378+0000 7f7a65ffb640 1 -- 172.21.15.60:0/3674152954 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a68034470 con 0x7f7a70153210 2024-09-12T01:39:17.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.378+0000 7f7a7732a640 1 -- 172.21.15.60:0/3674152954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a701f58e0 con 0x7f7a70153210 2024-09-12T01:39:17.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.378+0000 7f7a65ffb640 1 -- 172.21.15.60:0/3674152954 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800a460 con 0x7f7a70153210 2024-09-12T01:39:17.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.378+0000 7f7a7732a640 1 -- 172.21.15.60:0/3674152954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a701f5ea0 con 0x7f7a70153210 2024-09-12T01:39:17.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.379+0000 7f7a7732a640 1 -- 172.21.15.60:0/3674152954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a700cfce0 con 0x7f7a70153210 2024-09-12T01:39:17.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.380+0000 7f7a65ffb640 1 -- 172.21.15.60:0/3674152954 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7a68047070 con 0x7f7a70153210 2024-09-12T01:39:17.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.380+0000 7f7a65ffb640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a5406be60 0x7f7a5406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.380+0000 7f7a65ffb640 1 -- 172.21.15.60:0/3674152954 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f7a680aad90 con 0x7f7a70153210 2024-09-12T01:39:17.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.380+0000 7f7a750c6640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a5406be60 0x7f7a5406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.381+0000 7f7a750c6640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a5406be60 0x7f7a5406e320 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009bc0 tx=0x7f7a6c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:17.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.385+0000 7f7a65ffb640 1 -- 172.21.15.60:0/3674152954 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7a68079740 con 0x7f7a70153210 2024-09-12T01:39:17.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.559+0000 7f7a7732a640 1 -- 172.21.15.60:0/3674152954 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7a700d0340 con 0x7f7a5406be60 2024-09-12T01:39:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.565+0000 7f7a65ffb640 1 -- 172.21.15.60:0/3674152954 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251752 (secure 0 0 0) 0x7f7a700d0340 con 0x7f7a5406be60 2024-09-12T01:39:17.567 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:17.568 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:39:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.568+0000 7f7a7732a640 1 -- 172.21.15.60:0/3674152954 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a5406be60 msgr2=0x7f7a5406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.568+0000 7f7a7732a640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a5406be60 0x7f7a5406e320 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009bc0 tx=0x7f7a6c008040 comp rx=0 tx=0).stop 2024-09-12T01:39:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.568+0000 7f7a7732a640 1 -- 172.21.15.60:0/3674152954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a70153210 msgr2=0x7f7a701536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.568+0000 7f7a7732a640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a70153210 0x7f7a701536c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800a840 tx=0x7f7a700d4000 comp rx=0 tx=0).stop 2024-09-12T01:39:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.568+0000 7f7a7732a640 1 -- 172.21.15.60:0/3674152954 shutdown_connections 2024-09-12T01:39:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.568+0000 7f7a7732a640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a70153210 0x7f7a701536c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.568+0000 7f7a7732a640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7a5406be60 0x7f7a5406e320 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.568+0000 7f7a7732a640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7a70155080 0x7f7a70155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.568+0000 7f7a7732a640 1 --2- 172.21.15.60:0/3674152954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7a5c004d40 0x7f7a700cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.568+0000 7f7a7732a640 1 -- 172.21.15.60:0/3674152954 >> 172.21.15.60:0/3674152954 conn(0x7f7a700b6410 msgr2=0x7f7a7015cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.568+0000 7f7a7732a640 1 -- 172.21.15.60:0/3674152954 shutdown_connections 2024-09-12T01:39:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.568+0000 7f7a7732a640 1 -- 172.21.15.60:0/3674152954 wait complete. 2024-09-12T01:39:17.578 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-12T01:39:16.302391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266616,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754708104,"statfs":{"total":773094113280,"available":772821098496,"internally_reserved":0,"allocated":8986624,"data_stored":4416403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.425526"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187288+0000","last_change":"2024-09-12T01:39:13.904548+0000","last_active":"2024-09-12T01:39:15.187288+0000","last_peered":"2024-09-12T01:39:15.187288+0000","last_clean":"2024-09-12T01:39:15.187288+0000","last_became_active":"2024-09-12T01:39:13.904009+0000","last_became_peered":"2024-09-12T01:39:13.904009+0000","last_unstale":"2024-09-12T01:39:15.187288+0000","last_undegraded":"2024-09-12T01:39:15.187288+0000","last_fullsized":"2024-09-12T01:39:15.187288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:02.473545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.888137+0000","last_change":"2024-09-12T01:39:12.888137+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.888137+0000","last_undegraded":"2024-09-12T01:39:12.888137+0000","last_fullsized":"2024-09-12T01:39:12.888137+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903174+0000","last_change":"2024-09-12T01:39:13.904153+0000","last_active":"2024-09-12T01:39:14.903174+0000","last_peered":"2024-09-12T01:39:14.903174+0000","last_clean":"2024-09-12T01:39:14.903174+0000","last_became_active":"2024-09-12T01:39:13.903587+0000","last_became_peered":"2024-09-12T01:39:13.903587+0000","last_unstale":"2024-09-12T01:39:14.903174+0000","last_undegraded":"2024-09-12T01:39:14.903174+0000","last_fullsized":"2024-09-12T01:39:14.903174+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:08.179408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908266+0000","last_change":"2024-09-12T01:39:13.898785+0000","last_active":"2024-09-12T01:39:14.908266+0000","last_peered":"2024-09-12T01:39:14.908266+0000","last_clean":"2024-09-12T01:39:14.908266+0000","last_became_active":"2024-09-12T01:39:13.898498+0000","last_became_peered":"2024-09-12T01:39:13.898498+0000","last_unstale":"2024-09-12T01:39:14.908266+0000","last_undegraded":"2024-09-12T01:39:14.908266+0000","last_fullsized":"2024-09-12T01:39:14.908266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:55.328047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128776+0000","last_change":"2024-09-12T01:39:13.900646+0000","last_active":"2024-09-12T01:39:15.128776+0000","last_peered":"2024-09-12T01:39:15.128776+0000","last_clean":"2024-09-12T01:39:15.128776+0000","last_became_active":"2024-09-12T01:39:13.899584+0000","last_became_peered":"2024-09-12T01:39:13.899584+0000","last_unstale":"2024-09-12T01:39:15.128776+0000","last_undegraded":"2024-09-12T01:39:15.128776+0000","last_fullsized":"2024-09-12T01:39:15.128776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:08.313862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902900+0000","last_change":"2024-09-12T01:39:13.897523+0000","last_active":"2024-09-12T01:39:14.902900+0000","last_peered":"2024-09-12T01:39:14.902900+0000","last_clean":"2024-09-12T01:39:14.902900+0000","last_became_active":"2024-09-12T01:39:13.897250+0000","last_became_peered":"2024-09-12T01:39:13.897250+0000","last_unstale":"2024-09-12T01:39:14.902900+0000","last_undegraded":"2024-09-12T01:39:14.902900+0000","last_fullsized":"2024-09-12T01:39:14.902900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:03.256051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.888049+0000","last_change":"2024-09-12T01:39:12.888049+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.888049+0000","last_undegraded":"2024-09-12T01:39:12.888049+0000","last_fullsized":"2024-09-12T01:39:12.888049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187991+0000","last_change":"2024-09-12T01:39:13.910043+0000","last_active":"2024-09-12T01:39:15.187991+0000","last_peered":"2024-09-12T01:39:15.187991+0000","last_clean":"2024-09-12T01:39:15.187991+0000","last_became_active":"2024-09-12T01:39:13.909698+0000","last_became_peered":"2024-09-12T01:39:13.909698+0000","last_unstale":"2024-09-12T01:39:15.187991+0000","last_undegraded":"2024-09-12T01:39:15.187991+0000","last_fullsized":"2024-09-12T01:39:15.187991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:08.179408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187332+0000","last_change":"2024-09-12T01:39:13.903280+0000","last_active":"2024-09-12T01:39:15.187332+0000","last_peered":"2024-09-12T01:39:15.187332+0000","last_clean":"2024-09-12T01:39:15.187332+0000","last_became_active":"2024-09-12T01:39:13.902331+0000","last_became_peered":"2024-09-12T01:39:13.902331+0000","last_unstale":"2024-09-12T01:39:15.187332+0000","last_undegraded":"2024-09-12T01:39:15.187332+0000","last_fullsized":"2024-09-12T01:39:15.187332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:28.988150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903142+0000","last_change":"2024-09-12T01:39:13.895633+0000","last_active":"2024-09-12T01:39:14.903142+0000","last_peered":"2024-09-12T01:39:14.903142+0000","last_clean":"2024-09-12T01:39:14.903142+0000","last_became_active":"2024-09-12T01:39:13.895342+0000","last_became_peered":"2024-09-12T01:39:13.895342+0000","last_unstale":"2024-09-12T01:39:14.903142+0000","last_undegraded":"2024-09-12T01:39:14.903142+0000","last_fullsized":"2024-09-12T01:39:14.903142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:44.878735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188188+0000","last_change":"2024-09-12T01:39:13.908537+0000","last_active":"2024-09-12T01:39:15.188188+0000","last_peered":"2024-09-12T01:39:15.188188+0000","last_clean":"2024-09-12T01:39:15.188188+0000","last_became_active":"2024-09-12T01:39:13.908193+0000","last_became_peered":"2024-09-12T01:39:13.908193+0000","last_unstale":"2024-09-12T01:39:15.188188+0000","last_undegraded":"2024-09-12T01:39:15.188188+0000","last_fullsized":"2024-09-12T01:39:15.188188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:50.638963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188087+0000","last_change":"2024-09-12T01:39:13.911076+0000","last_active":"2024-09-12T01:39:15.188087+0000","last_peered":"2024-09-12T01:39:15.188087+0000","last_clean":"2024-09-12T01:39:15.188087+0000","last_became_active":"2024-09-12T01:39:13.910824+0000","last_became_peered":"2024-09-12T01:39:13.910824+0000","last_unstale":"2024-09-12T01:39:15.188087+0000","last_undegraded":"2024-09-12T01:39:15.188087+0000","last_fullsized":"2024-09-12T01:39:15.188087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:25.363826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128818+0000","last_change":"2024-09-12T01:39:13.904087+0000","last_active":"2024-09-12T01:39:15.128818+0000","last_peered":"2024-09-12T01:39:15.128818+0000","last_clean":"2024-09-12T01:39:15.128818+0000","last_became_active":"2024-09-12T01:39:13.903799+0000","last_became_peered":"2024-09-12T01:39:13.903799+0000","last_unstale":"2024-09-12T01:39:15.128818+0000","last_undegraded":"2024-09-12T01:39:15.128818+0000","last_fullsized":"2024-09-12T01:39:15.128818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:47.515101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187275+0000","last_change":"2024-09-12T01:39:13.897466+0000","last_active":"2024-09-12T01:39:15.187275+0000","last_peered":"2024-09-12T01:39:15.187275+0000","last_clean":"2024-09-12T01:39:15.187275+0000","last_became_active":"2024-09-12T01:39:13.897050+0000","last_became_peered":"2024-09-12T01:39:13.897050+0000","last_unstale":"2024-09-12T01:39:15.187275+0000","last_undegraded":"2024-09-12T01:39:15.187275+0000","last_fullsized":"2024-09-12T01:39:15.187275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:00.820023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.887593+0000","last_change":"2024-09-12T01:39:12.887593+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.887593+0000","last_undegraded":"2024-09-12T01:39:12.887593+0000","last_fullsized":"2024-09-12T01:39:12.887593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902706+0000","last_change":"2024-09-12T01:39:13.895475+0000","last_active":"2024-09-12T01:39:14.902706+0000","last_peered":"2024-09-12T01:39:14.902706+0000","last_clean":"2024-09-12T01:39:14.902706+0000","last_became_active":"2024-09-12T01:39:13.894932+0000","last_became_peered":"2024-09-12T01:39:13.894932+0000","last_unstale":"2024-09-12T01:39:14.902706+0000","last_undegraded":"2024-09-12T01:39:14.902706+0000","last_fullsized":"2024-09-12T01:39:14.902706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.815960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187867+0000","last_change":"2024-09-12T01:39:13.911725+0000","last_active":"2024-09-12T01:39:15.187867+0000","last_peered":"2024-09-12T01:39:15.187867+0000","last_clean":"2024-09-12T01:39:15.187867+0000","last_became_active":"2024-09-12T01:39:13.911467+0000","last_became_peered":"2024-09-12T01:39:13.911467+0000","last_unstale":"2024-09-12T01:39:15.187867+0000","last_undegraded":"2024-09-12T01:39:15.187867+0000","last_fullsized":"2024-09-12T01:39:15.187867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.891062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188053+0000","last_change":"2024-09-12T01:39:13.909003+0000","last_active":"2024-09-12T01:39:15.188053+0000","last_peered":"2024-09-12T01:39:15.188053+0000","last_clean":"2024-09-12T01:39:15.188053+0000","last_became_active":"2024-09-12T01:39:13.908524+0000","last_became_peered":"2024-09-12T01:39:13.908524+0000","last_unstale":"2024-09-12T01:39:15.188053+0000","last_undegraded":"2024-09-12T01:39:15.188053+0000","last_fullsized":"2024-09-12T01:39:15.188053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:33.298540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187966+0000","last_change":"2024-09-12T01:39:13.905486+0000","last_active":"2024-09-12T01:39:15.187966+0000","last_peered":"2024-09-12T01:39:15.187966+0000","last_clean":"2024-09-12T01:39:15.187966+0000","last_became_active":"2024-09-12T01:39:13.905182+0000","last_became_peered":"2024-09-12T01:39:13.905182+0000","last_unstale":"2024-09-12T01:39:15.187966+0000","last_undegraded":"2024-09-12T01:39:15.187966+0000","last_fullsized":"2024-09-12T01:39:15.187966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:55.372979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187642+0000","last_change":"2024-09-12T01:39:13.897112+0000","last_active":"2024-09-12T01:39:15.187642+0000","last_peered":"2024-09-12T01:39:15.187642+0000","last_clean":"2024-09-12T01:39:15.187642+0000","last_became_active":"2024-09-12T01:39:13.896837+0000","last_became_peered":"2024-09-12T01:39:13.896837+0000","last_unstale":"2024-09-12T01:39:15.187642+0000","last_undegraded":"2024-09-12T01:39:15.187642+0000","last_fullsized":"2024-09-12T01:39:15.187642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:03.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907959+0000","last_change":"2024-09-12T01:39:13.904696+0000","last_active":"2024-09-12T01:39:14.907959+0000","last_peered":"2024-09-12T01:39:14.907959+0000","last_clean":"2024-09-12T01:39:14.907959+0000","last_became_active":"2024-09-12T01:39:13.904425+0000","last_became_peered":"2024-09-12T01:39:13.904425+0000","last_unstale":"2024-09-12T01:39:14.907959+0000","last_undegraded":"2024-09-12T01:39:14.907959+0000","last_fullsized":"2024-09-12T01:39:14.907959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:05.731459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187483+0000","last_change":"2024-09-12T01:39:13.901168+0000","last_active":"2024-09-12T01:39:15.187483+0000","last_peered":"2024-09-12T01:39:15.187483+0000","last_clean":"2024-09-12T01:39:15.187483+0000","last_became_active":"2024-09-12T01:39:13.900885+0000","last_became_peered":"2024-09-12T01:39:13.900885+0000","last_unstale":"2024-09-12T01:39:15.187483+0000","last_undegraded":"2024-09-12T01:39:15.187483+0000","last_fullsized":"2024-09-12T01:39:15.187483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:53.244610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187508+0000","last_change":"2024-09-12T01:39:13.910971+0000","last_active":"2024-09-12T01:39:15.187508+0000","last_peered":"2024-09-12T01:39:15.187508+0000","last_clean":"2024-09-12T01:39:15.187508+0000","last_became_active":"2024-09-12T01:39:13.910683+0000","last_became_peered":"2024-09-12T01:39:13.910683+0000","last_unstale":"2024-09-12T01:39:15.187508+0000","last_undegraded":"2024-09-12T01:39:15.187508+0000","last_fullsized":"2024-09-12T01:39:15.187508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:55.097048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187458+0000","last_change":"2024-09-12T01:39:13.903528+0000","last_active":"2024-09-12T01:39:15.187458+0000","last_peered":"2024-09-12T01:39:15.187458+0000","last_clean":"2024-09-12T01:39:15.187458+0000","last_became_active":"2024-09-12T01:39:13.902574+0000","last_became_peered":"2024-09-12T01:39:13.902574+0000","last_unstale":"2024-09-12T01:39:15.187458+0000","last_undegraded":"2024-09-12T01:39:15.187458+0000","last_fullsized":"2024-09-12T01:39:15.187458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.253305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188136+0000","last_change":"2024-09-12T01:39:13.914204+0000","last_active":"2024-09-12T01:39:15.188136+0000","last_peered":"2024-09-12T01:39:15.188136+0000","last_clean":"2024-09-12T01:39:15.188136+0000","last_became_active":"2024-09-12T01:39:13.913793+0000","last_became_peered":"2024-09-12T01:39:13.913793+0000","last_unstale":"2024-09-12T01:39:15.188136+0000","last_undegraded":"2024-09-12T01:39:15.188136+0000","last_fullsized":"2024-09-12T01:39:15.188136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:39.460105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129102+0000","last_change":"2024-09-12T01:39:13.904244+0000","last_active":"2024-09-12T01:39:15.129102+0000","last_peered":"2024-09-12T01:39:15.129102+0000","last_clean":"2024-09-12T01:39:15.129102+0000","last_became_active":"2024-09-12T01:39:13.903977+0000","last_became_peered":"2024-09-12T01:39:13.903977+0000","last_unstale":"2024-09-12T01:39:15.129102+0000","last_undegraded":"2024-09-12T01:39:15.129102+0000","last_fullsized":"2024-09-12T01:39:15.129102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:25.368830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129071+0000","last_change":"2024-09-12T01:39:13.898284+0000","last_active":"2024-09-12T01:39:15.129071+0000","last_peered":"2024-09-12T01:39:15.129071+0000","last_clean":"2024-09-12T01:39:15.129071+0000","last_became_active":"2024-09-12T01:39:13.898019+0000","last_became_peered":"2024-09-12T01:39:13.898019+0000","last_unstale":"2024-09-12T01:39:15.129071+0000","last_undegraded":"2024-09-12T01:39:15.129071+0000","last_fullsized":"2024-09-12T01:39:15.129071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:56.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187418+0000","last_change":"2024-09-12T01:39:13.905161+0000","last_active":"2024-09-12T01:39:15.187418+0000","last_peered":"2024-09-12T01:39:15.187418+0000","last_clean":"2024-09-12T01:39:15.187418+0000","last_became_active":"2024-09-12T01:39:13.902828+0000","last_became_peered":"2024-09-12T01:39:13.902828+0000","last_unstale":"2024-09-12T01:39:15.187418+0000","last_undegraded":"2024-09-12T01:39:15.187418+0000","last_fullsized":"2024-09-12T01:39:15.187418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:48.165883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908214+0000","last_change":"2024-09-12T01:39:13.903914+0000","last_active":"2024-09-12T01:39:14.908214+0000","last_peered":"2024-09-12T01:39:14.908214+0000","last_clean":"2024-09-12T01:39:14.908214+0000","last_became_active":"2024-09-12T01:39:13.903632+0000","last_became_peered":"2024-09-12T01:39:13.903632+0000","last_unstale":"2024-09-12T01:39:14.908214+0000","last_undegraded":"2024-09-12T01:39:14.908214+0000","last_fullsized":"2024-09-12T01:39:14.908214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:41.271935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187447+0000","last_change":"2024-09-12T01:39:13.900164+0000","last_active":"2024-09-12T01:39:15.187447+0000","last_peered":"2024-09-12T01:39:15.187447+0000","last_clean":"2024-09-12T01:39:15.187447+0000","last_became_active":"2024-09-12T01:39:13.899484+0000","last_became_peered":"2024-09-12T01:39:13.899484+0000","last_unstale":"2024-09-12T01:39:15.187447+0000","last_undegraded":"2024-09-12T01:39:15.187447+0000","last_fullsized":"2024-09-12T01:39:15.187447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:50.818822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902704+0000","last_change":"2024-09-12T01:39:13.894221+0000","last_active":"2024-09-12T01:39:14.902704+0000","last_peered":"2024-09-12T01:39:14.902704+0000","last_clean":"2024-09-12T01:39:14.902704+0000","last_became_active":"2024-09-12T01:39:13.893930+0000","last_became_peered":"2024-09-12T01:39:13.893930+0000","last_unstale":"2024-09-12T01:39:14.902704+0000","last_undegraded":"2024-09-12T01:39:14.902704+0000","last_fullsized":"2024-09-12T01:39:14.902704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:55.097048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902909+0000","last_change":"2024-09-12T01:39:13.894931+0000","last_active":"2024-09-12T01:39:14.902909+0000","last_peered":"2024-09-12T01:39:14.902909+0000","last_clean":"2024-09-12T01:39:14.902909+0000","last_became_active":"2024-09-12T01:39:13.894587+0000","last_became_peered":"2024-09-12T01:39:13.894587+0000","last_unstale":"2024-09-12T01:39:14.902909+0000","last_undegraded":"2024-09-12T01:39:14.902909+0000","last_fullsized":"2024-09-12T01:39:14.902909+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:56.121397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187568+0000","last_change":"2024-09-12T01:39:13.915079+0000","last_active":"2024-09-12T01:39:15.187568+0000","last_peered":"2024-09-12T01:39:15.187568+0000","last_clean":"2024-09-12T01:39:15.187568+0000","last_became_active":"2024-09-12T01:39:13.914761+0000","last_became_peered":"2024-09-12T01:39:13.914761+0000","last_unstale":"2024-09-12T01:39:15.187568+0000","last_undegraded":"2024-09-12T01:39:15.187568+0000","last_fullsized":"2024-09-12T01:39:15.187568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.815960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129105+0000","last_change":"2024-09-12T01:39:12.896630+0000","last_active":"2024-09-12T01:39:15.129105+0000","last_peered":"2024-09-12T01:39:15.129105+0000","last_clean":"2024-09-12T01:39:15.129105+0000","last_became_active":"2024-09-12T01:39:12.896343+0000","last_became_peered":"2024-09-12T01:39:12.896343+0000","last_unstale":"2024-09-12T01:39:15.129105+0000","last_undegraded":"2024-09-12T01:39:15.129105+0000","last_fullsized":"2024-09-12T01:39:15.129105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:40.029147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187440+0000","last_change":"2024-09-12T01:39:13.904295+0000","last_active":"2024-09-12T01:39:15.187440+0000","last_peered":"2024-09-12T01:39:15.187440+0000","last_clean":"2024-09-12T01:39:15.187440+0000","last_became_active":"2024-09-12T01:39:13.903604+0000","last_became_peered":"2024-09-12T01:39:13.903604+0000","last_unstale":"2024-09-12T01:39:15.187440+0000","last_undegraded":"2024-09-12T01:39:15.187440+0000","last_fullsized":"2024-09-12T01:39:15.187440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:18.193470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903131+0000","last_change":"2024-09-12T01:39:12.896766+0000","last_active":"2024-09-12T01:39:14.903131+0000","last_peered":"2024-09-12T01:39:14.903131+0000","last_clean":"2024-09-12T01:39:14.903131+0000","last_became_active":"2024-09-12T01:39:12.896143+0000","last_became_peered":"2024-09-12T01:39:12.896143+0000","last_unstale":"2024-09-12T01:39:14.903131+0000","last_undegraded":"2024-09-12T01:39:14.903131+0000","last_fullsized":"2024-09-12T01:39:14.903131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:00.120318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188090+0000","last_change":"2024-09-12T01:39:13.914121+0000","last_active":"2024-09-12T01:39:15.188090+0000","last_peered":"2024-09-12T01:39:15.188090+0000","last_clean":"2024-09-12T01:39:15.188090+0000","last_became_active":"2024-09-12T01:39:13.913818+0000","last_became_peered":"2024-09-12T01:39:13.913818+0000","last_unstale":"2024-09-12T01:39:15.188090+0000","last_undegraded":"2024-09-12T01:39:15.188090+0000","last_fullsized":"2024-09-12T01:39:15.188090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:20.834108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188191+0000","last_change":"2024-09-12T01:39:12.898592+0000","last_active":"2024-09-12T01:39:15.188191+0000","last_peered":"2024-09-12T01:39:15.188191+0000","last_clean":"2024-09-12T01:39:15.188191+0000","last_became_active":"2024-09-12T01:39:12.898312+0000","last_became_peered":"2024-09-12T01:39:12.898312+0000","last_unstale":"2024-09-12T01:39:15.188191+0000","last_undegraded":"2024-09-12T01:39:15.188191+0000","last_fullsized":"2024-09-12T01:39:15.188191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:52.356993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187617+0000","last_change":"2024-09-12T01:39:13.912780+0000","last_active":"2024-09-12T01:39:15.187617+0000","last_peered":"2024-09-12T01:39:15.187617+0000","last_clean":"2024-09-12T01:39:15.187617+0000","last_became_active":"2024-09-12T01:39:13.912419+0000","last_became_peered":"2024-09-12T01:39:13.912419+0000","last_unstale":"2024-09-12T01:39:15.187617+0000","last_undegraded":"2024-09-12T01:39:15.187617+0000","last_fullsized":"2024-09-12T01:39:15.187617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:38.977876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908254+0000","last_change":"2024-09-12T01:39:12.897577+0000","last_active":"2024-09-12T01:39:14.908254+0000","last_peered":"2024-09-12T01:39:14.908254+0000","last_clean":"2024-09-12T01:39:14.908254+0000","last_became_active":"2024-09-12T01:39:12.897230+0000","last_became_peered":"2024-09-12T01:39:12.897230+0000","last_unstale":"2024-09-12T01:39:14.908254+0000","last_undegraded":"2024-09-12T01:39:14.908254+0000","last_fullsized":"2024-09-12T01:39:14.908254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.116323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908050+0000","last_change":"2024-09-12T01:39:13.908787+0000","last_active":"2024-09-12T01:39:14.908050+0000","last_peered":"2024-09-12T01:39:14.908050+0000","last_clean":"2024-09-12T01:39:14.908050+0000","last_became_active":"2024-09-12T01:39:13.908549+0000","last_became_peered":"2024-09-12T01:39:13.908549+0000","last_unstale":"2024-09-12T01:39:14.908050+0000","last_undegraded":"2024-09-12T01:39:14.908050+0000","last_fullsized":"2024-09-12T01:39:14.908050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:02.236054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187564+0000","last_change":"2024-09-12T01:39:12.899469+0000","last_active":"2024-09-12T01:39:15.187564+0000","last_peered":"2024-09-12T01:39:15.187564+0000","last_clean":"2024-09-12T01:39:15.187564+0000","last_became_active":"2024-09-12T01:39:12.899173+0000","last_became_peered":"2024-09-12T01:39:12.899173+0000","last_unstale":"2024-09-12T01:39:15.187564+0000","last_undegraded":"2024-09-12T01:39:15.187564+0000","last_fullsized":"2024-09-12T01:39:15.187564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:17.188396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902965+0000","last_change":"2024-09-12T01:39:13.900761+0000","last_active":"2024-09-12T01:39:14.902965+0000","last_peered":"2024-09-12T01:39:14.902965+0000","last_clean":"2024-09-12T01:39:14.902965+0000","last_became_active":"2024-09-12T01:39:13.900441+0000","last_became_peered":"2024-09-12T01:39:13.900441+0000","last_unstale":"2024-09-12T01:39:14.902965+0000","last_undegraded":"2024-09-12T01:39:14.902965+0000","last_fullsized":"2024-09-12T01:39:14.902965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.891062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902865+0000","last_change":"2024-09-12T01:39:12.901743+0000","last_active":"2024-09-12T01:39:14.902865+0000","last_peered":"2024-09-12T01:39:14.902865+0000","last_clean":"2024-09-12T01:39:14.902865+0000","last_became_active":"2024-09-12T01:39:12.901418+0000","last_became_peered":"2024-09-12T01:39:12.901418+0000","last_unstale":"2024-09-12T01:39:14.902865+0000","last_undegraded":"2024-09-12T01:39:14.902865+0000","last_fullsized":"2024-09-12T01:39:14.902865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:27.983076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187162+0000","last_change":"2024-09-12T01:39:13.898011+0000","last_active":"2024-09-12T01:39:15.187162+0000","last_peered":"2024-09-12T01:39:15.187162+0000","last_clean":"2024-09-12T01:39:15.187162+0000","last_became_active":"2024-09-12T01:39:13.897644+0000","last_became_peered":"2024-09-12T01:39:13.897644+0000","last_unstale":"2024-09-12T01:39:15.187162+0000","last_undegraded":"2024-09-12T01:39:15.187162+0000","last_fullsized":"2024-09-12T01:39:15.187162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:03.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187381+0000","last_change":"2024-09-12T01:39:12.901437+0000","last_active":"2024-09-12T01:39:15.187381+0000","last_peered":"2024-09-12T01:39:15.187381+0000","last_clean":"2024-09-12T01:39:15.187381+0000","last_became_active":"2024-09-12T01:39:12.901120+0000","last_became_peered":"2024-09-12T01:39:12.901120+0000","last_unstale":"2024-09-12T01:39:15.187381+0000","last_undegraded":"2024-09-12T01:39:15.187381+0000","last_fullsized":"2024-09-12T01:39:15.187381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:18.265444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187431+0000","last_change":"2024-09-12T01:39:13.896873+0000","last_active":"2024-09-12T01:39:15.187431+0000","last_peered":"2024-09-12T01:39:15.187431+0000","last_clean":"2024-09-12T01:39:15.187431+0000","last_became_active":"2024-09-12T01:39:13.896578+0000","last_became_peered":"2024-09-12T01:39:13.896578+0000","last_unstale":"2024-09-12T01:39:15.187431+0000","last_undegraded":"2024-09-12T01:39:15.187431+0000","last_fullsized":"2024-09-12T01:39:15.187431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:53.362068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187132+0000","last_change":"2024-09-12T01:39:12.903658+0000","last_active":"2024-09-12T01:39:15.187132+0000","last_peered":"2024-09-12T01:39:15.187132+0000","last_clean":"2024-09-12T01:39:15.187132+0000","last_became_active":"2024-09-12T01:39:12.903455+0000","last_became_peered":"2024-09-12T01:39:12.903455+0000","last_unstale":"2024-09-12T01:39:15.187132+0000","last_undegraded":"2024-09-12T01:39:15.187132+0000","last_fullsized":"2024-09-12T01:39:15.187132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:07.523595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187442+0000","last_change":"2024-09-12T01:39:13.906892+0000","last_active":"2024-09-12T01:39:15.187442+0000","last_peered":"2024-09-12T01:39:15.187442+0000","last_clean":"2024-09-12T01:39:15.187442+0000","last_became_active":"2024-09-12T01:39:13.906624+0000","last_became_peered":"2024-09-12T01:39:13.906624+0000","last_unstale":"2024-09-12T01:39:15.187442+0000","last_undegraded":"2024-09-12T01:39:15.187442+0000","last_fullsized":"2024-09-12T01:39:15.187442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:16.212505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187700+0000","last_change":"2024-09-12T01:39:12.898372+0000","last_active":"2024-09-12T01:39:15.187700+0000","last_peered":"2024-09-12T01:39:15.187700+0000","last_clean":"2024-09-12T01:39:15.187700+0000","last_became_active":"2024-09-12T01:39:12.898048+0000","last_became_peered":"2024-09-12T01:39:12.898048+0000","last_unstale":"2024-09-12T01:39:15.187700+0000","last_undegraded":"2024-09-12T01:39:15.187700+0000","last_fullsized":"2024-09-12T01:39:15.187700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:37.700774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187604+0000","last_change":"2024-09-12T01:39:13.913892+0000","last_active":"2024-09-12T01:39:15.187604+0000","last_peered":"2024-09-12T01:39:15.187604+0000","last_clean":"2024-09-12T01:39:15.187604+0000","last_became_active":"2024-09-12T01:39:13.913473+0000","last_became_peered":"2024-09-12T01:39:13.913473+0000","last_unstale":"2024-09-12T01:39:15.187604+0000","last_undegraded":"2024-09-12T01:39:15.187604+0000","last_fullsized":"2024-09-12T01:39:15.187604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.253305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903236+0000","last_change":"2024-09-12T01:39:12.897002+0000","last_active":"2024-09-12T01:39:14.903236+0000","last_peered":"2024-09-12T01:39:14.903236+0000","last_clean":"2024-09-12T01:39:14.903236+0000","last_became_active":"2024-09-12T01:39:12.896502+0000","last_became_peered":"2024-09-12T01:39:12.896502+0000","last_unstale":"2024-09-12T01:39:14.903236+0000","last_undegraded":"2024-09-12T01:39:14.903236+0000","last_fullsized":"2024-09-12T01:39:14.903236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:37.972801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187824+0000","last_change":"2024-09-12T01:39:13.914328+0000","last_active":"2024-09-12T01:39:15.187824+0000","last_peered":"2024-09-12T01:39:15.187824+0000","last_clean":"2024-09-12T01:39:15.187824+0000","last_became_active":"2024-09-12T01:39:13.914055+0000","last_became_peered":"2024-09-12T01:39:13.914055+0000","last_unstale":"2024-09-12T01:39:15.187824+0000","last_undegraded":"2024-09-12T01:39:15.187824+0000","last_fullsized":"2024-09-12T01:39:15.187824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:54.539029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187798+0000","last_change":"2024-09-12T01:39:12.895761+0000","last_active":"2024-09-12T01:39:15.187798+0000","last_peered":"2024-09-12T01:39:15.187798+0000","last_clean":"2024-09-12T01:39:15.187798+0000","last_became_active":"2024-09-12T01:39:12.895469+0000","last_became_peered":"2024-09-12T01:39:12.895469+0000","last_unstale":"2024-09-12T01:39:15.187798+0000","last_undegraded":"2024-09-12T01:39:15.187798+0000","last_fullsized":"2024-09-12T01:39:15.187798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:22.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129042+0000","last_change":"2024-09-12T01:39:13.912400+0000","last_active":"2024-09-12T01:39:15.129042+0000","last_peered":"2024-09-12T01:39:15.129042+0000","last_clean":"2024-09-12T01:39:15.129042+0000","last_became_active":"2024-09-12T01:39:13.912154+0000","last_became_peered":"2024-09-12T01:39:13.912154+0000","last_unstale":"2024-09-12T01:39:15.129042+0000","last_undegraded":"2024-09-12T01:39:15.129042+0000","last_fullsized":"2024-09-12T01:39:15.129042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:36.874197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"79'6","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188153+0000","last_change":"2024-09-12T01:39:12.898516+0000","last_active":"2024-09-12T01:39:15.188153+0000","last_peered":"2024-09-12T01:39:15.188153+0000","last_clean":"2024-09-12T01:39:15.188153+0000","last_became_active":"2024-09-12T01:39:12.898169+0000","last_became_peered":"2024-09-12T01:39:12.898169+0000","last_unstale":"2024-09-12T01:39:15.188153+0000","last_undegraded":"2024-09-12T01:39:15.188153+0000","last_fullsized":"2024-09-12T01:39:15.188153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:00.120318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187751+0000","last_change":"2024-09-12T01:39:13.907928+0000","last_active":"2024-09-12T01:39:15.187751+0000","last_peered":"2024-09-12T01:39:15.187751+0000","last_clean":"2024-09-12T01:39:15.187751+0000","last_became_active":"2024-09-12T01:39:13.907637+0000","last_became_peered":"2024-09-12T01:39:13.907637+0000","last_unstale":"2024-09-12T01:39:15.187751+0000","last_undegraded":"2024-09-12T01:39:15.187751+0000","last_fullsized":"2024-09-12T01:39:15.187751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:36.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908265+0000","last_change":"2024-09-12T01:39:12.896500+0000","last_active":"2024-09-12T01:39:14.908265+0000","last_peered":"2024-09-12T01:39:14.908265+0000","last_clean":"2024-09-12T01:39:14.908265+0000","last_became_active":"2024-09-12T01:39:12.896204+0000","last_became_peered":"2024-09-12T01:39:12.896204+0000","last_unstale":"2024-09-12T01:39:14.908265+0000","last_undegraded":"2024-09-12T01:39:14.908265+0000","last_fullsized":"2024-09-12T01:39:14.908265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:31.885987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187726+0000","last_change":"2024-09-12T01:39:13.911848+0000","last_active":"2024-09-12T01:39:15.187726+0000","last_peered":"2024-09-12T01:39:15.187726+0000","last_clean":"2024-09-12T01:39:15.187726+0000","last_became_active":"2024-09-12T01:39:13.911578+0000","last_became_peered":"2024-09-12T01:39:13.911578+0000","last_unstale":"2024-09-12T01:39:15.187726+0000","last_undegraded":"2024-09-12T01:39:15.187726+0000","last_fullsized":"2024-09-12T01:39:15.187726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:36.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T01:39:12.898209+0000","last_change":"2024-09-12T01:39:12.894877+0000","last_active":"2024-09-12T01:39:12.898209+0000","last_peered":"2024-09-12T01:39:12.898209+0000","last_clean":"2024-09-12T01:39:12.898209+0000","last_became_active":"2024-09-12T01:39:12.894584+0000","last_became_peered":"2024-09-12T01:39:12.894584+0000","last_unstale":"2024-09-12T01:39:12.898209+0000","last_undegraded":"2024-09-12T01:39:12.898209+0000","last_fullsized":"2024-09-12T01:39:12.898209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:21.828714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187238+0000","last_change":"2024-09-12T01:39:13.898011+0000","last_active":"2024-09-12T01:39:15.187238+0000","last_peered":"2024-09-12T01:39:15.187238+0000","last_clean":"2024-09-12T01:39:15.187238+0000","last_became_active":"2024-09-12T01:39:13.897749+0000","last_became_peered":"2024-09-12T01:39:13.897749+0000","last_unstale":"2024-09-12T01:39:15.187238+0000","last_undegraded":"2024-09-12T01:39:15.187238+0000","last_fullsized":"2024-09-12T01:39:15.187238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:24.935008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902705+0000","last_change":"2024-09-12T01:39:12.895196+0000","last_active":"2024-09-12T01:39:14.902705+0000","last_peered":"2024-09-12T01:39:14.902705+0000","last_clean":"2024-09-12T01:39:14.902705+0000","last_became_active":"2024-09-12T01:39:12.894890+0000","last_became_peered":"2024-09-12T01:39:12.894890+0000","last_unstale":"2024-09-12T01:39:14.902705+0000","last_undegraded":"2024-09-12T01:39:14.902705+0000","last_fullsized":"2024-09-12T01:39:14.902705+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:47.160808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187452+0000","last_change":"2024-09-12T01:39:13.906691+0000","last_active":"2024-09-12T01:39:15.187452+0000","last_peered":"2024-09-12T01:39:15.187452+0000","last_clean":"2024-09-12T01:39:15.187452+0000","last_became_active":"2024-09-12T01:39:13.906346+0000","last_became_peered":"2024-09-12T01:39:13.906346+0000","last_unstale":"2024-09-12T01:39:15.187452+0000","last_undegraded":"2024-09-12T01:39:15.187452+0000","last_fullsized":"2024-09-12T01:39:15.187452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:38.977876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"79'8","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187582+0000","last_change":"2024-09-12T01:39:12.892882+0000","last_active":"2024-09-12T01:39:15.187582+0000","last_peered":"2024-09-12T01:39:15.187582+0000","last_clean":"2024-09-12T01:39:15.187582+0000","last_became_active":"2024-09-12T01:39:12.892533+0000","last_became_peered":"2024-09-12T01:39:12.892533+0000","last_unstale":"2024-09-12T01:39:15.187582+0000","last_undegraded":"2024-09-12T01:39:15.187582+0000","last_fullsized":"2024-09-12T01:39:15.187582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:59.814949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187723+0000","last_change":"2024-09-12T01:39:13.916960+0000","last_active":"2024-09-12T01:39:15.187723+0000","last_peered":"2024-09-12T01:39:15.187723+0000","last_clean":"2024-09-12T01:39:15.187723+0000","last_became_active":"2024-09-12T01:39:13.916569+0000","last_became_peered":"2024-09-12T01:39:13.916569+0000","last_unstale":"2024-09-12T01:39:15.187723+0000","last_undegraded":"2024-09-12T01:39:15.187723+0000","last_fullsized":"2024-09-12T01:39:15.187723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:56.121397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129266+0000","last_change":"2024-09-12T01:39:12.895948+0000","last_active":"2024-09-12T01:39:15.129266+0000","last_peered":"2024-09-12T01:39:15.129266+0000","last_clean":"2024-09-12T01:39:15.129266+0000","last_became_active":"2024-09-12T01:39:12.895645+0000","last_became_peered":"2024-09-12T01:39:12.895645+0000","last_unstale":"2024-09-12T01:39:15.129266+0000","last_undegraded":"2024-09-12T01:39:15.129266+0000","last_fullsized":"2024-09-12T01:39:15.129266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:27.105186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903397+0000","last_change":"2024-09-12T01:39:13.895212+0000","last_active":"2024-09-12T01:39:14.903397+0000","last_peered":"2024-09-12T01:39:14.903397+0000","last_clean":"2024-09-12T01:39:14.903397+0000","last_became_active":"2024-09-12T01:39:13.894887+0000","last_became_peered":"2024-09-12T01:39:13.894887+0000","last_unstale":"2024-09-12T01:39:14.903397+0000","last_undegraded":"2024-09-12T01:39:14.903397+0000","last_fullsized":"2024-09-12T01:39:14.903397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:25.363826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187893+0000","last_change":"2024-09-12T01:39:12.900345+0000","last_active":"2024-09-12T01:39:15.187893+0000","last_peered":"2024-09-12T01:39:15.187893+0000","last_clean":"2024-09-12T01:39:15.187893+0000","last_became_active":"2024-09-12T01:39:12.900043+0000","last_became_peered":"2024-09-12T01:39:12.900043+0000","last_unstale":"2024-09-12T01:39:15.187893+0000","last_undegraded":"2024-09-12T01:39:15.187893+0000","last_fullsized":"2024-09-12T01:39:15.187893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:46.990181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187995+0000","last_change":"2024-09-12T01:39:13.915910+0000","last_active":"2024-09-12T01:39:15.187995+0000","last_peered":"2024-09-12T01:39:15.187995+0000","last_clean":"2024-09-12T01:39:15.187995+0000","last_became_active":"2024-09-12T01:39:13.915569+0000","last_became_peered":"2024-09-12T01:39:13.915569+0000","last_unstale":"2024-09-12T01:39:15.187995+0000","last_undegraded":"2024-09-12T01:39:15.187995+0000","last_fullsized":"2024-09-12T01:39:15.187995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:44.878735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187677+0000","last_change":"2024-09-12T01:39:12.900655+0000","last_active":"2024-09-12T01:39:15.187677+0000","last_peered":"2024-09-12T01:39:15.187677+0000","last_clean":"2024-09-12T01:39:15.187677+0000","last_became_active":"2024-09-12T01:39:12.900298+0000","last_became_peered":"2024-09-12T01:39:12.900298+0000","last_unstale":"2024-09-12T01:39:15.187677+0000","last_undegraded":"2024-09-12T01:39:15.187677+0000","last_fullsized":"2024-09-12T01:39:15.187677+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:56.792978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.888244+0000","last_change":"2024-09-12T01:39:12.888244+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.888244+0000","last_undegraded":"2024-09-12T01:39:12.888244+0000","last_fullsized":"2024-09-12T01:39:12.888244+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187593+0000","last_change":"2024-09-12T01:39:12.899244+0000","last_active":"2024-09-12T01:39:15.187593+0000","last_peered":"2024-09-12T01:39:15.187593+0000","last_clean":"2024-09-12T01:39:15.187593+0000","last_became_active":"2024-09-12T01:39:12.898773+0000","last_became_peered":"2024-09-12T01:39:12.898773+0000","last_unstale":"2024-09-12T01:39:15.187593+0000","last_undegraded":"2024-09-12T01:39:15.187593+0000","last_fullsized":"2024-09-12T01:39:15.187593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:32.656288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128927+0000","last_change":"2024-09-12T01:39:13.908672+0000","last_active":"2024-09-12T01:39:15.128927+0000","last_peered":"2024-09-12T01:39:15.128927+0000","last_clean":"2024-09-12T01:39:15.128927+0000","last_became_active":"2024-09-12T01:39:13.908365+0000","last_became_peered":"2024-09-12T01:39:13.908365+0000","last_unstale":"2024-09-12T01:39:15.128927+0000","last_undegraded":"2024-09-12T01:39:15.128927+0000","last_fullsized":"2024-09-12T01:39:15.128927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:28.239676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T01:39:12.899940+0000","last_change":"2024-09-12T01:39:12.897940+0000","last_active":"2024-09-12T01:39:12.899940+0000","last_peered":"2024-09-12T01:39:12.899940+0000","last_clean":"2024-09-12T01:39:12.899940+0000","last_became_active":"2024-09-12T01:39:12.897617+0000","last_became_peered":"2024-09-12T01:39:12.897617+0000","last_unstale":"2024-09-12T01:39:12.899940+0000","last_undegraded":"2024-09-12T01:39:12.899940+0000","last_fullsized":"2024-09-12T01:39:12.899940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:38.210811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907757+0000","last_change":"2024-09-12T01:39:13.908088+0000","last_active":"2024-09-12T01:39:14.907757+0000","last_peered":"2024-09-12T01:39:14.907757+0000","last_clean":"2024-09-12T01:39:14.907757+0000","last_became_active":"2024-09-12T01:39:13.907807+0000","last_became_peered":"2024-09-12T01:39:13.907807+0000","last_unstale":"2024-09-12T01:39:14.907757+0000","last_undegraded":"2024-09-12T01:39:14.907757+0000","last_fullsized":"2024-09-12T01:39:14.907757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:58.775933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187702+0000","last_change":"2024-09-12T01:39:12.892007+0000","last_active":"2024-09-12T01:39:15.187702+0000","last_peered":"2024-09-12T01:39:15.187702+0000","last_clean":"2024-09-12T01:39:15.187702+0000","last_became_active":"2024-09-12T01:39:12.891744+0000","last_became_peered":"2024-09-12T01:39:12.891744+0000","last_unstale":"2024-09-12T01:39:15.187702+0000","last_undegraded":"2024-09-12T01:39:15.187702+0000","last_fullsized":"2024-09-12T01:39:15.187702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.207430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187658+0000","last_change":"2024-09-12T01:39:13.913157+0000","last_active":"2024-09-12T01:39:15.187658+0000","last_peered":"2024-09-12T01:39:15.187658+0000","last_clean":"2024-09-12T01:39:15.187658+0000","last_became_active":"2024-09-12T01:39:13.912881+0000","last_became_peered":"2024-09-12T01:39:13.912881+0000","last_unstale":"2024-09-12T01:39:15.187658+0000","last_undegraded":"2024-09-12T01:39:15.187658+0000","last_fullsized":"2024-09-12T01:39:15.187658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:03.256051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187393+0000","last_change":"2024-09-12T01:39:12.897776+0000","last_active":"2024-09-12T01:39:15.187393+0000","last_peered":"2024-09-12T01:39:15.187393+0000","last_clean":"2024-09-12T01:39:15.187393+0000","last_became_active":"2024-09-12T01:39:12.897527+0000","last_became_peered":"2024-09-12T01:39:12.897527+0000","last_unstale":"2024-09-12T01:39:15.187393+0000","last_undegraded":"2024-09-12T01:39:15.187393+0000","last_fullsized":"2024-09-12T01:39:15.187393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:29.855267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129181+0000","last_change":"2024-09-12T01:39:13.900476+0000","last_active":"2024-09-12T01:39:15.129181+0000","last_peered":"2024-09-12T01:39:15.129181+0000","last_clean":"2024-09-12T01:39:15.129181+0000","last_became_active":"2024-09-12T01:39:13.900204+0000","last_became_peered":"2024-09-12T01:39:13.900204+0000","last_unstale":"2024-09-12T01:39:15.129181+0000","last_undegraded":"2024-09-12T01:39:15.129181+0000","last_fullsized":"2024-09-12T01:39:15.129181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:41.140743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187678+0000","last_change":"2024-09-12T01:39:12.904275+0000","last_active":"2024-09-12T01:39:15.187678+0000","last_peered":"2024-09-12T01:39:15.187678+0000","last_clean":"2024-09-12T01:39:15.187678+0000","last_became_active":"2024-09-12T01:39:12.904028+0000","last_became_peered":"2024-09-12T01:39:12.904028+0000","last_unstale":"2024-09-12T01:39:15.187678+0000","last_undegraded":"2024-09-12T01:39:15.187678+0000","last_fullsized":"2024-09-12T01:39:15.187678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:27.433076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129064+0000","last_change":"2024-09-12T01:39:13.912165+0000","last_active":"2024-09-12T01:39:15.129064+0000","last_peered":"2024-09-12T01:39:15.129064+0000","last_clean":"2024-09-12T01:39:15.129064+0000","last_became_active":"2024-09-12T01:39:13.911869+0000","last_became_peered":"2024-09-12T01:39:13.911869+0000","last_unstale":"2024-09-12T01:39:15.129064+0000","last_undegraded":"2024-09-12T01:39:15.129064+0000","last_fullsized":"2024-09-12T01:39:15.129064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:43.619413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187997+0000","last_change":"2024-09-12T01:39:12.890030+0000","last_active":"2024-09-12T01:39:15.187997+0000","last_peered":"2024-09-12T01:39:15.187997+0000","last_clean":"2024-09-12T01:39:15.187997+0000","last_became_active":"2024-09-12T01:39:12.889687+0000","last_became_peered":"2024-09-12T01:39:12.889687+0000","last_unstale":"2024-09-12T01:39:15.187997+0000","last_undegraded":"2024-09-12T01:39:15.187997+0000","last_fullsized":"2024-09-12T01:39:15.187997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:49.813748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128984+0000","last_change":"2024-09-12T01:39:13.902776+0000","last_active":"2024-09-12T01:39:15.128984+0000","last_peered":"2024-09-12T01:39:15.128984+0000","last_clean":"2024-09-12T01:39:15.128984+0000","last_became_active":"2024-09-12T01:39:13.902502+0000","last_became_peered":"2024-09-12T01:39:13.902502+0000","last_unstale":"2024-09-12T01:39:15.128984+0000","last_undegraded":"2024-09-12T01:39:15.128984+0000","last_fullsized":"2024-09-12T01:39:15.128984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:01.168363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188042+0000","last_change":"2024-09-12T01:39:12.900224+0000","last_active":"2024-09-12T01:39:15.188042+0000","last_peered":"2024-09-12T01:39:15.188042+0000","last_clean":"2024-09-12T01:39:15.188042+0000","last_became_active":"2024-09-12T01:39:12.899905+0000","last_became_peered":"2024-09-12T01:39:12.899905+0000","last_unstale":"2024-09-12T01:39:15.188042+0000","last_undegraded":"2024-09-12T01:39:15.188042+0000","last_fullsized":"2024-09-12T01:39:15.188042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:30.248231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903170+0000","last_change":"2024-09-12T01:39:13.903873+0000","last_active":"2024-09-12T01:39:14.903170+0000","last_peered":"2024-09-12T01:39:14.903170+0000","last_clean":"2024-09-12T01:39:14.903170+0000","last_became_active":"2024-09-12T01:39:13.902665+0000","last_became_peered":"2024-09-12T01:39:13.902665+0000","last_unstale":"2024-09-12T01:39:14.903170+0000","last_undegraded":"2024-09-12T01:39:14.903170+0000","last_fullsized":"2024-09-12T01:39:14.903170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:20.834108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902828+0000","last_change":"2024-09-12T01:39:12.900941+0000","last_active":"2024-09-12T01:39:14.902828+0000","last_peered":"2024-09-12T01:39:14.902828+0000","last_clean":"2024-09-12T01:39:14.902828+0000","last_became_active":"2024-09-12T01:39:12.900582+0000","last_became_peered":"2024-09-12T01:39:12.900582+0000","last_unstale":"2024-09-12T01:39:14.902828+0000","last_undegraded":"2024-09-12T01:39:14.902828+0000","last_fullsized":"2024-09-12T01:39:14.902828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:17.188396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187305+0000","last_change":"2024-09-12T01:39:13.906501+0000","last_active":"2024-09-12T01:39:15.187305+0000","last_peered":"2024-09-12T01:39:15.187305+0000","last_clean":"2024-09-12T01:39:15.187305+0000","last_became_active":"2024-09-12T01:39:13.905251+0000","last_became_peered":"2024-09-12T01:39:13.905251+0000","last_unstale":"2024-09-12T01:39:15.187305+0000","last_undegraded":"2024-09-12T01:39:15.187305+0000","last_fullsized":"2024-09-12T01:39:15.187305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:12.012554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T01:39:12.899668+0000","last_change":"2024-09-12T01:39:12.896423+0000","last_active":"2024-09-12T01:39:12.899668+0000","last_peered":"2024-09-12T01:39:12.899668+0000","last_clean":"2024-09-12T01:39:12.899668+0000","last_became_active":"2024-09-12T01:39:12.896163+0000","last_became_peered":"2024-09-12T01:39:12.896163+0000","last_unstale":"2024-09-12T01:39:12.899668+0000","last_undegraded":"2024-09-12T01:39:12.899668+0000","last_fullsized":"2024-09-12T01:39:12.899668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:18.895862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187808+0000","last_change":"2024-09-12T01:39:13.906963+0000","last_active":"2024-09-12T01:39:15.187808+0000","last_peered":"2024-09-12T01:39:15.187808+0000","last_clean":"2024-09-12T01:39:15.187808+0000","last_became_active":"2024-09-12T01:39:13.906272+0000","last_became_peered":"2024-09-12T01:39:13.906272+0000","last_unstale":"2024-09-12T01:39:15.187808+0000","last_undegraded":"2024-09-12T01:39:15.187808+0000","last_fullsized":"2024-09-12T01:39:15.187808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:26.904998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902944+0000","last_change":"2024-09-12T01:39:12.902567+0000","last_active":"2024-09-12T01:39:14.902944+0000","last_peered":"2024-09-12T01:39:14.902944+0000","last_clean":"2024-09-12T01:39:14.902944+0000","last_became_active":"2024-09-12T01:39:12.902261+0000","last_became_peered":"2024-09-12T01:39:12.902261+0000","last_unstale":"2024-09-12T01:39:14.902944+0000","last_undegraded":"2024-09-12T01:39:14.902944+0000","last_fullsized":"2024-09-12T01:39:14.902944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:30.248231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187175+0000","last_change":"2024-09-12T01:39:13.903016+0000","last_active":"2024-09-12T01:39:15.187175+0000","last_peered":"2024-09-12T01:39:15.187175+0000","last_clean":"2024-09-12T01:39:15.187175+0000","last_became_active":"2024-09-12T01:39:13.902740+0000","last_became_peered":"2024-09-12T01:39:13.902740+0000","last_unstale":"2024-09-12T01:39:15.187175+0000","last_undegraded":"2024-09-12T01:39:15.187175+0000","last_fullsized":"2024-09-12T01:39:15.187175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:55.372979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187123+0000","last_change":"2024-09-12T01:39:12.896200+0000","last_active":"2024-09-12T01:39:15.187123+0000","last_peered":"2024-09-12T01:39:15.187123+0000","last_clean":"2024-09-12T01:39:15.187123+0000","last_became_active":"2024-09-12T01:39:12.895937+0000","last_became_peered":"2024-09-12T01:39:12.895937+0000","last_unstale":"2024-09-12T01:39:15.187123+0000","last_undegraded":"2024-09-12T01:39:15.187123+0000","last_fullsized":"2024-09-12T01:39:15.187123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:16.330008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187586+0000","last_change":"2024-09-12T01:39:13.905333+0000","last_active":"2024-09-12T01:39:15.187586+0000","last_peered":"2024-09-12T01:39:15.187586+0000","last_clean":"2024-09-12T01:39:15.187586+0000","last_became_active":"2024-09-12T01:39:13.904982+0000","last_became_peered":"2024-09-12T01:39:13.904982+0000","last_unstale":"2024-09-12T01:39:15.187586+0000","last_undegraded":"2024-09-12T01:39:15.187586+0000","last_fullsized":"2024-09-12T01:39:15.187586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:01.125393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187933+0000","last_change":"2024-09-12T01:39:12.897786+0000","last_active":"2024-09-12T01:39:15.187933+0000","last_peered":"2024-09-12T01:39:15.187933+0000","last_clean":"2024-09-12T01:39:15.187933+0000","last_became_active":"2024-09-12T01:39:12.897384+0000","last_became_peered":"2024-09-12T01:39:12.897384+0000","last_unstale":"2024-09-12T01:39:15.187933+0000","last_undegraded":"2024-09-12T01:39:15.187933+0000","last_fullsized":"2024-09-12T01:39:15.187933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:37.972801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187951+0000","last_change":"2024-09-12T01:39:13.915042+0000","last_active":"2024-09-12T01:39:15.187951+0000","last_peered":"2024-09-12T01:39:15.187951+0000","last_clean":"2024-09-12T01:39:15.187951+0000","last_became_active":"2024-09-12T01:39:13.914403+0000","last_became_peered":"2024-09-12T01:39:13.914403+0000","last_unstale":"2024-09-12T01:39:15.187951+0000","last_undegraded":"2024-09-12T01:39:15.187951+0000","last_fullsized":"2024-09-12T01:39:15.187951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:54.227036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129155+0000","last_change":"2024-09-12T01:39:12.897053+0000","last_active":"2024-09-12T01:39:15.129155+0000","last_peered":"2024-09-12T01:39:15.129155+0000","last_clean":"2024-09-12T01:39:15.129155+0000","last_became_active":"2024-09-12T01:39:12.896613+0000","last_became_peered":"2024-09-12T01:39:12.896613+0000","last_unstale":"2024-09-12T01:39:15.129155+0000","last_undegraded":"2024-09-12T01:39:15.129155+0000","last_fullsized":"2024-09-12T01:39:15.129155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:22.437750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":278,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187214+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:39:15.187214+0000","last_peered":"2024-09-12T01:39:15.187214+0000","last_clean":"2024-09-12T01:39:15.187214+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:39:15.187214+0000","last_undegraded":"2024-09-12T01:39:15.187214+0000","last_fullsized":"2024-09-12T01:39:15.187214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":401627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":408529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":999871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":408531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":407857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1560576,"data_stored":992015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":978944,"data_stored":403191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":950272,"data_stored":394782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:39:17.582 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3e is not active+clean 2024-09-12T01:39:17.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:39:12.888137+0000', 'last_change': '2024-09-12T01:39:12.888137+0000', 'last_active': '2024-09-12T01:39:12.876977+0000', 'last_peered': '2024-09-12T01:39:12.876977+0000', 'last_clean': '2024-09-12T01:39:12.876977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:39:12.888137+0000', 'last_undegraded': '2024-09-12T01:39:12.888137+0000', 'last_fullsized': '2024-09-12T01:39:12.888137+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:39:12.876977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:39:12.876977+0000', 'last_clean_scrub_stamp': '2024-09-12T01:39:12.876977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:39:17.582 INFO:tasks.ceph.ceph_manager.ceph:PG 13.39 is not active+clean 2024-09-12T01:39:17.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:39:12.888049+0000', 'last_change': '2024-09-12T01:39:12.888049+0000', 'last_active': '2024-09-12T01:39:12.876977+0000', 'last_peered': '2024-09-12T01:39:12.876977+0000', 'last_clean': '2024-09-12T01:39:12.876977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:39:12.888049+0000', 'last_undegraded': '2024-09-12T01:39:12.888049+0000', 'last_fullsized': '2024-09-12T01:39:12.888049+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:39:12.876977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:39:12.876977+0000', 'last_clean_scrub_stamp': '2024-09-12T01:39:12.876977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:39:17.582 INFO:tasks.ceph.ceph_manager.ceph:PG 13.31 is not active+clean 2024-09-12T01:39:17.582 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:39:12.887593+0000', 'last_change': '2024-09-12T01:39:12.887593+0000', 'last_active': '2024-09-12T01:39:12.876977+0000', 'last_peered': '2024-09-12T01:39:12.876977+0000', 'last_clean': '2024-09-12T01:39:12.876977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:39:12.887593+0000', 'last_undegraded': '2024-09-12T01:39:12.887593+0000', 'last_fullsized': '2024-09-12T01:39:12.887593+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:39:12.876977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:39:12.876977+0000', 'last_clean_scrub_stamp': '2024-09-12T01:39:12.876977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:39:17.583 INFO:tasks.ceph.ceph_manager.ceph:PG 13.a is not active+clean 2024-09-12T01:39:17.583 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:39:12.888244+0000', 'last_change': '2024-09-12T01:39:12.888244+0000', 'last_active': '2024-09-12T01:39:12.876977+0000', 'last_peered': '2024-09-12T01:39:12.876977+0000', 'last_clean': '2024-09-12T01:39:12.876977+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:39:12.888244+0000', 'last_undegraded': '2024-09-12T01:39:12.888244+0000', 'last_fullsized': '2024-09-12T01:39:12.888244+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:39:12.876977+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:39:12.876977+0000', 'last_clean_scrub_stamp': '2024-09-12T01:39:12.876977+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:39:17.583 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:39:17.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.721+0000 7fbf819fd640 1 Processor -- start 2024-09-12T01:39:17.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.721+0000 7fbf819fd640 1 -- start start 2024-09-12T01:39:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.722+0000 7fbf819fd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbf7c06d540 0x7fbf7c0cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.722+0000 7fbf819fd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7c06faf0 con 0x7fbf7c15e950 2024-09-12T01:39:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.722+0000 7fbf819fd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf7c06fdd0 con 0x7fbf7c0735b0 2024-09-12T01:39:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.722+0000 7fbf819fd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbf7c0700b0 con 0x7fbf7c06d540 2024-09-12T01:39:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.722+0000 7fbf7affd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbf7c15e950 0x7fbf7c06ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41860/0 (socket says 172.21.15.60:41860) 2024-09-12T01:39:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.722+0000 7fbf7affd640 1 -- 172.21.15.60:0/2862634869 learned_addr learned my addr 172.21.15.60:0/2862634869 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.722+0000 7fbf7a7fc640 1 --2- 172.21.15.60:0/2862634869 >> v2:172.21.15.105:3300/0 conn(0x7fbf7c06d540 0x7fbf7c0cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.722+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265576029 0 0) 0x7fbf7c06faf0 con 0x7fbf7c15e950 2024-09-12T01:39:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf68003520 con 0x7fbf7c15e950 2024-09-12T01:39:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1846967740 0 0) 0x7fbf68003520 con 0x7fbf7c15e950 2024-09-12T01:39:17.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 >> v2:172.21.15.105:3300/0 conn(0x7fbf7c06d540 msgr2=0x7fbf7c0cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 --2- 172.21.15.60:0/2862634869 >> v2:172.21.15.105:3300/0 conn(0x7fbf7c06d540 0x7fbf7c0cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 >> v1:172.21.15.105:6789/0 conn(0x7fbf7c0735b0 legacy=0x7fbf7c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7c070390 con 0x7fbf7c15e950 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fbf74001670 con 0x7fbf7c15e950 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 >> v1:172.21.15.60:6789/0 conn(0x7fbf7c15e950 legacy=0x7fbf7c06ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 --2- 172.21.15.60:0/2862634869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf680039b0 0x7fbf68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 --2- 172.21.15.60:0/2862634869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf68004800 0x7fbf68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 --2- 172.21.15.60:0/2862634869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf680051c0 0x7fbf6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c0700b0 con 0x7fbf680051c0 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbf6800c060 con 0x7fbf68004800 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbf6800c260 con 0x7fbf680039b0 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf7b7fe640 1 --2- 172.21.15.60:0/2862634869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf680051c0 0x7fbf6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.724 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf7a7fc640 1 --2- 172.21.15.60:0/2862634869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf68004800 0x7fbf68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf7affd640 1 --2- 172.21.15.60:0/2862634869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf680039b0 0x7fbf68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf7b7fe640 1 -- 172.21.15.60:0/2862634869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf680039b0 msgr2=0x7fbf68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:17.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf7b7fe640 1 --2- 172.21.15.60:0/2862634869 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf680039b0 0x7fbf68003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf7b7fe640 1 -- 172.21.15.60:0/2862634869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf68004800 msgr2=0x7fbf68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:17.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf7b7fe640 1 --2- 172.21.15.60:0/2862634869 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf68004800 0x7fbf68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.723+0000 7fbf7b7fe640 1 -- 172.21.15.60:0/2862634869 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf68003520 con 0x7fbf680051c0 2024-09-12T01:39:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.724+0000 7fbf7b7fe640 1 -- 172.21.15.60:0/2862634869 reap_dead start 2024-09-12T01:39:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.724+0000 7fbf7b7fe640 1 --2- 172.21.15.60:0/2862634869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf680051c0 0x7fbf6800b9c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c072000 tx=0x7fbf68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a2d078e9be81b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.724+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c001a70 con 0x7fbf680051c0 2024-09-12T01:39:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.724+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6c02ae10 con 0x7fbf680051c0 2024-09-12T01:39:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.724+0000 7fbf79ffb640 1 -- 172.21.15.60:0/2862634869 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c003bb0 con 0x7fbf680051c0 2024-09-12T01:39:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.725+0000 7fbf819fd640 1 -- 172.21.15.60:0/2862634869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf680051c0 msgr2=0x7fbf6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.725+0000 7fbf819fd640 1 --2- 172.21.15.60:0/2862634869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf680051c0 0x7fbf6800b9c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c072000 tx=0x7fbf68005830 comp rx=0 tx=0).stop 2024-09-12T01:39:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.725+0000 7fbf819fd640 1 -- 172.21.15.60:0/2862634869 shutdown_connections 2024-09-12T01:39:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.725+0000 7fbf819fd640 1 --2- 172.21.15.60:0/2862634869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf680051c0 0x7fbf6800b9c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.725+0000 7fbf819fd640 1 -- 172.21.15.60:0/2862634869 >> 172.21.15.60:0/2862634869 conn(0x7fbf7c0d14d0 msgr2=0x7fbf7c0d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:17.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.725+0000 7fbf819fd640 1 -- 172.21.15.60:0/2862634869 shutdown_connections 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.725+0000 7fbf819fd640 1 -- 172.21.15.60:0/2862634869 wait complete. 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.726+0000 7fbf819fd640 1 Processor -- start 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.726+0000 7fbf819fd640 1 -- start start 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf819fd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf680051c0 0x7fbf7c159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf819fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf7c1f7630 0x7fbf7c1f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf819fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf7c1f4650 0x7fbf7c1f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf819fd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c0721d0 con 0x7fbf7c1f4650 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf819fd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c072050 con 0x7fbf680051c0 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf819fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbf7c072350 con 0x7fbf7c1f7630 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf7b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf7c1f4650 0x7fbf7c1f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf7b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf7c1f4650 0x7fbf7c1f4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41742/0 (socket says 172.21.15.60:41742) 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf7b7fe640 1 -- 172.21.15.60:0/2160950717 learned_addr learned my addr 172.21.15.60:0/2160950717 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:17.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf7affd640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf680051c0 0x7fbf7c159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf7a7fc640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf7c1f7630 0x7fbf7c1f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf7b7fe640 1 -- 172.21.15.60:0/2160950717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf7c1f7630 msgr2=0x7fbf7c1f7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf7b7fe640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf7c1f7630 0x7fbf7c1f7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf7b7fe640 1 -- 172.21.15.60:0/2160950717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf680051c0 msgr2=0x7fbf7c159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf7b7fe640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf680051c0 0x7fbf7c159d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf7b7fe640 1 -- 172.21.15.60:0/2160950717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7c1f5010 con 0x7fbf7c1f4650 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.727+0000 7fbf7b7fe640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf7c1f4650 0x7fbf7c1f4ad0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c02a8c0 tx=0x7fbf6c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.728+0000 7fbf73fff640 1 -- 172.21.15.60:0/2160950717 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c007db0 con 0x7fbf7c1f4650 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.728+0000 7fbf73fff640 1 -- 172.21.15.60:0/2160950717 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf6c02ac10 con 0x7fbf7c1f4650 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.728+0000 7fbf819fd640 1 -- 172.21.15.60:0/2160950717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7c15a370 con 0x7fbf7c1f4650 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.728+0000 7fbf73fff640 1 -- 172.21.15.60:0/2160950717 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c005380 con 0x7fbf7c1f4650 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.728+0000 7fbf819fd640 1 -- 172.21.15.60:0/2160950717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf7c15a930 con 0x7fbf7c1f4650 2024-09-12T01:39:17.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.729+0000 7fbf819fd640 1 -- 172.21.15.60:0/2160950717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7c06ce30 con 0x7fbf7c1f4650 2024-09-12T01:39:17.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.729+0000 7fbf73fff640 1 -- 172.21.15.60:0/2160950717 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf6c005520 con 0x7fbf7c1f4650 2024-09-12T01:39:17.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.730+0000 7fbf73fff640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf5c06be60 0x7fbf5c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:17.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.730+0000 7fbf73fff640 1 -- 172.21.15.60:0/2160950717 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fbf6c0aa170 con 0x7fbf7c1f4650 2024-09-12T01:39:17.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.730+0000 7fbf7affd640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf5c06be60 0x7fbf5c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:17.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.730+0000 7fbf7affd640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf5c06be60 0x7fbf5c06e320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbf740017b0 tx=0x7fbf74009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:17.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.734+0000 7fbf73fff640 1 -- 172.21.15.60:0/2160950717 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf6c0783b0 con 0x7fbf7c1f4650 2024-09-12T01:39:17.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.975+0000 7fbf819fd640 1 -- 172.21.15.60:0/2160950717 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fbf7c0d0cd0 con 0x7fbf7c1f4650 2024-09-12T01:39:17.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.975+0000 7fbf73fff640 1 -- 172.21.15.60:0/2160950717 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1561 (secure 0 0 0) 0x7fbf6c07c6b0 con 0x7fbf7c1f4650 2024-09-12T01:39:17.975 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:17.975 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":225,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":80,"num_osds":8,"num_up_osds":8,"osd_up_since":1726104944,"num_in_osds":8,"osd_in_since":1726104934,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":93},{"state_name":"creating+peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":273014784,"bytes_avail":772821098496,"bytes_total":773094113280,"inactive_pgs_ratio":0.041237112134695053,"write_bytes_sec":3239,"read_op_per_sec":0,"write_op_per_sec":9},"fsmap":{"epoch":44,"btime":"2024-09-12T01:39:15:900799+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":35375}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-09-12T01:39:02.299827+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T01:39:17.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.977+0000 7fbf819fd640 1 -- 172.21.15.60:0/2160950717 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf5c06be60 msgr2=0x7fbf5c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.977+0000 7fbf819fd640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf5c06be60 0x7fbf5c06e320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbf740017b0 tx=0x7fbf74009040 comp rx=0 tx=0).stop 2024-09-12T01:39:17.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.977+0000 7fbf819fd640 1 -- 172.21.15.60:0/2160950717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf7c1f4650 msgr2=0x7fbf7c1f4ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:17.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.977+0000 7fbf819fd640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf7c1f4650 0x7fbf7c1f4ad0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c02a8c0 tx=0x7fbf6c0014a0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.977+0000 7fbf819fd640 1 -- 172.21.15.60:0/2160950717 shutdown_connections 2024-09-12T01:39:17.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.977+0000 7fbf819fd640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf7c1f4650 0x7fbf7c1f4ad0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.977+0000 7fbf819fd640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf5c06be60 0x7fbf5c06e320 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.977+0000 7fbf819fd640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf7c1f7630 0x7fbf7c1f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.977+0000 7fbf819fd640 1 --2- 172.21.15.60:0/2160950717 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf680051c0 0x7fbf7c159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:17.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.977+0000 7fbf819fd640 1 -- 172.21.15.60:0/2160950717 >> 172.21.15.60:0/2160950717 conn(0x7fbf7c0d14d0 msgr2=0x7fbf7c0b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:17.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.978+0000 7fbf819fd640 1 -- 172.21.15.60:0/2160950717 shutdown_connections 2024-09-12T01:39:17.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:17.978+0000 7fbf819fd640 1 -- 172.21.15.60:0/2160950717 wait complete. 2024-09-12T01:39:17.988 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:39:17.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:39:18.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.091+0000 7f6361227640 1 Processor -- start 2024-09-12T01:39:18.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.091+0000 7f6361227640 1 -- start start 2024-09-12T01:39:18.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f6361227640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f635c0b74c0 0x7f635c15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:18.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f6361227640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f635c15f030 0x7f635c06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:18.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f6361227640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c15fb10 con 0x7f635c15c2b0 2024-09-12T01:39:18.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f6361227640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f635c0b5900 con 0x7f635c15f030 2024-09-12T01:39:18.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f6361227640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f635c15f830 con 0x7f635c0b74c0 2024-09-12T01:39:18.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f635ad9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f635c15c2b0 0x7f635c0b6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41866/0 (socket says 172.21.15.60:41866) 2024-09-12T01:39:18.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f635ad9d640 1 -- 172.21.15.60:0/39988349 learned_addr learned my addr 172.21.15.60:0/39988349 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:18.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f635b59e640 1 --2- 172.21.15.60:0/39988349 >> v2:172.21.15.60:3300/0 conn(0x7f635c15f030 0x7f635c06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:18.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f6353fff640 1 --2- 172.21.15.60:0/39988349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f635c0b74c0 0x7f635c15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:18.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f635b59e640 1 -- 172.21.15.60:0/39988349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f635c0b74c0 msgr2=0x7f635c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:18.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f635b59e640 1 --2- 172.21.15.60:0/39988349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f635c0b74c0 0x7f635c15eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:18.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f635b59e640 1 -- 172.21.15.60:0/39988349 >> v1:172.21.15.60:6789/0 conn(0x7f635c15c2b0 legacy=0x7f635c0b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:18.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f635a59c640 1 -- 172.21.15.60:0/39988349 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199918750 0 0) 0x7f635c15fb10 con 0x7f635c15c2b0 2024-09-12T01:39:18.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f635b59e640 1 -- 172.21.15.60:0/39988349 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c06ce30 con 0x7f635c15f030 2024-09-12T01:39:18.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.092+0000 7f6353fff640 1 --2- 172.21.15.60:0/39988349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f635c0b74c0 0x7f635c15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:18.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.093+0000 7f635b59e640 1 --2- 172.21.15.60:0/39988349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f635c15f030 0x7f635c06d910 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6354009d90 tx=0x7f635402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152a7abd5b16caa4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:18.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.093+0000 7f635a59c640 1 -- 172.21.15.60:0/39988349 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354007740 con 0x7f635c15f030 2024-09-12T01:39:18.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.093+0000 7f635a59c640 1 -- 172.21.15.60:0/39988349 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63540078e0 con 0x7f635c15f030 2024-09-12T01:39:18.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.093+0000 7f635a59c640 1 -- 172.21.15.60:0/39988349 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6354007cb0 con 0x7f635c15f030 2024-09-12T01:39:18.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.094+0000 7f6361227640 1 -- 172.21.15.60:0/39988349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f635c15f030 msgr2=0x7f635c06d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:18.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.094+0000 7f6361227640 1 --2- 172.21.15.60:0/39988349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f635c15f030 0x7f635c06d910 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6354009d90 tx=0x7f635402a660 comp rx=0 tx=0).stop 2024-09-12T01:39:18.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.094+0000 7f6361227640 1 -- 172.21.15.60:0/39988349 shutdown_connections 2024-09-12T01:39:18.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.094+0000 7f6361227640 1 --2- 172.21.15.60:0/39988349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f635c15f030 0x7f635c06d910 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:18.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.094+0000 7f6361227640 1 --2- 172.21.15.60:0/39988349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f635c0b74c0 0x7f635c15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:18.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.094+0000 7f6361227640 1 -- 172.21.15.60:0/39988349 >> 172.21.15.60:0/39988349 conn(0x7f635c0b4240 msgr2=0x7f635c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:18.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.094+0000 7f6361227640 1 -- 172.21.15.60:0/39988349 shutdown_connections 2024-09-12T01:39:18.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.094+0000 7f6361227640 1 -- 172.21.15.60:0/39988349 wait complete. 2024-09-12T01:39:18.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.095+0000 7f6361227640 1 Processor -- start 2024-09-12T01:39:18.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.095+0000 7f6361227640 1 -- start start 2024-09-12T01:39:18.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f6361227640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f635c0b74c0 0x7f635c0d2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:18.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f6361227640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f635c15c2b0 0x7f635c0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:18.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f6361227640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f635c15f030 0x7f635c0cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:18.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f6361227640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f635c15f4c0 con 0x7f635c0b74c0 2024-09-12T01:39:18.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f6361227640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f635c06d3f0 con 0x7f635c15c2b0 2024-09-12T01:39:18.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f6361227640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f635c06de50 con 0x7f635c15f030 2024-09-12T01:39:18.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f635ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f635c0b74c0 0x7f635c0d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:18.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f635ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f635c0b74c0 0x7f635c0d2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41754/0 (socket says 172.21.15.60:41754) 2024-09-12T01:39:18.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f635ad9d640 1 -- 172.21.15.60:0/1662451305 learned_addr learned my addr 172.21.15.60:0/1662451305 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:18.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f635b59e640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f635c15f030 0x7f635c0cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:18.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f6353fff640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f635c15c2b0 0x7f635c0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:18.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f635ad9d640 1 -- 172.21.15.60:0/1662451305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f635c15f030 msgr2=0x7f635c0cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:18.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f635ad9d640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f635c15f030 0x7f635c0cce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:18.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f635ad9d640 1 -- 172.21.15.60:0/1662451305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f635c15c2b0 msgr2=0x7f635c0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:18.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f635ad9d640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f635c15c2b0 0x7f635c0cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.096+0000 7f635ad9d640 1 -- 172.21.15.60:0/1662451305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c0cd4f0 con 0x7f635c0b74c0 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.097+0000 7f635ad9d640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f635c0b74c0 0x7f635c0d2190 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f634c00c4d0 tx=0x7f634c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.097+0000 7f63537fe640 1 -- 172.21.15.60:0/1662451305 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c018070 con 0x7f635c0b74c0 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.097+0000 7f63537fe640 1 -- 172.21.15.60:0/1662451305 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c007500 con 0x7f635c0b74c0 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.097+0000 7f6361227640 1 -- 172.21.15.60:0/1662451305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635c0cd7d0 con 0x7f635c0b74c0 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.097+0000 7f63537fe640 1 -- 172.21.15.60:0/1662451305 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c004a20 con 0x7f635c0b74c0 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.097+0000 7f6361227640 1 -- 172.21.15.60:0/1662451305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f635c0cdd90 con 0x7f635c0b74c0 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.098+0000 7f6361227640 1 -- 172.21.15.60:0/1662451305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635c15eaf0 con 0x7f635c0b74c0 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.098+0000 7f63537fe640 1 -- 172.21.15.60:0/1662451305 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f634c01b070 con 0x7f635c0b74c0 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.099+0000 7f63537fe640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f633c06be30 0x7f633c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.099+0000 7f63537fe640 1 -- 172.21.15.60:0/1662451305 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f634c08a1b0 con 0x7f635c0b74c0 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.099+0000 7f6353fff640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f633c06be30 0x7f633c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:18.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.099+0000 7f6353fff640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f633c06be30 0x7f633c06e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f635c0b3a00 tx=0x7f6344008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:18.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.103+0000 7f63537fe640 1 -- 172.21.15.60:0/1662451305 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f634c058b60 con 0x7f635c0b74c0 2024-09-12T01:39:18.141 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:39:18.143 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:39:18.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.275+0000 7f6361227640 1 -- 172.21.15.60:0/1662451305 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f635c071ad0 con 0x7f633c06be30 2024-09-12T01:39:18.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.281+0000 7f63537fe640 1 -- 172.21.15.60:0/1662451305 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251752 (secure 0 0 0) 0x7f635c071ad0 con 0x7f633c06be30 2024-09-12T01:39:18.283 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:18.284 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:39:18.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.284+0000 7f6361227640 1 -- 172.21.15.60:0/1662451305 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f633c06be30 msgr2=0x7f633c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:18.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.284+0000 7f6361227640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f633c06be30 0x7f633c06e2f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f635c0b3a00 tx=0x7f6344008040 comp rx=0 tx=0).stop 2024-09-12T01:39:18.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.284+0000 7f6361227640 1 -- 172.21.15.60:0/1662451305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f635c0b74c0 msgr2=0x7f635c0d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:18.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.284+0000 7f6361227640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f635c0b74c0 0x7f635c0d2190 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f634c00c4d0 tx=0x7f634c00c990 comp rx=0 tx=0).stop 2024-09-12T01:39:18.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.284+0000 7f6361227640 1 -- 172.21.15.60:0/1662451305 shutdown_connections 2024-09-12T01:39:18.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.284+0000 7f6361227640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f633c06be30 0x7f633c06e2f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:18.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.284+0000 7f6361227640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f635c15f030 0x7f635c0cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:18.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.284+0000 7f6361227640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f635c15c2b0 0x7f635c0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:18.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.284+0000 7f6361227640 1 --2- 172.21.15.60:0/1662451305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f635c0b74c0 0x7f635c0d2190 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:18.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.284+0000 7f6361227640 1 -- 172.21.15.60:0/1662451305 >> 172.21.15.60:0/1662451305 conn(0x7f635c0b4240 msgr2=0x7f635c15c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:18.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.284+0000 7f6361227640 1 -- 172.21.15.60:0/1662451305 shutdown_connections 2024-09-12T01:39:18.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:18.284+0000 7f6361227640 1 -- 172.21.15.60:0/1662451305 wait complete. 2024-09-12T01:39:18.294 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2024-09-12T01:39:16.302391+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266616,"kb_used_data":8776,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754708104,"statfs":{"total":773094113280,"available":772821098496,"internally_reserved":0,"allocated":8986624,"data_stored":4416403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.425526"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187288+0000","last_change":"2024-09-12T01:39:13.904548+0000","last_active":"2024-09-12T01:39:15.187288+0000","last_peered":"2024-09-12T01:39:15.187288+0000","last_clean":"2024-09-12T01:39:15.187288+0000","last_became_active":"2024-09-12T01:39:13.904009+0000","last_became_peered":"2024-09-12T01:39:13.904009+0000","last_unstale":"2024-09-12T01:39:15.187288+0000","last_undegraded":"2024-09-12T01:39:15.187288+0000","last_fullsized":"2024-09-12T01:39:15.187288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:02.473545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.888137+0000","last_change":"2024-09-12T01:39:12.888137+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.888137+0000","last_undegraded":"2024-09-12T01:39:12.888137+0000","last_fullsized":"2024-09-12T01:39:12.888137+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903174+0000","last_change":"2024-09-12T01:39:13.904153+0000","last_active":"2024-09-12T01:39:14.903174+0000","last_peered":"2024-09-12T01:39:14.903174+0000","last_clean":"2024-09-12T01:39:14.903174+0000","last_became_active":"2024-09-12T01:39:13.903587+0000","last_became_peered":"2024-09-12T01:39:13.903587+0000","last_unstale":"2024-09-12T01:39:14.903174+0000","last_undegraded":"2024-09-12T01:39:14.903174+0000","last_fullsized":"2024-09-12T01:39:14.903174+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:08.179408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908266+0000","last_change":"2024-09-12T01:39:13.898785+0000","last_active":"2024-09-12T01:39:14.908266+0000","last_peered":"2024-09-12T01:39:14.908266+0000","last_clean":"2024-09-12T01:39:14.908266+0000","last_became_active":"2024-09-12T01:39:13.898498+0000","last_became_peered":"2024-09-12T01:39:13.898498+0000","last_unstale":"2024-09-12T01:39:14.908266+0000","last_undegraded":"2024-09-12T01:39:14.908266+0000","last_fullsized":"2024-09-12T01:39:14.908266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:55.328047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128776+0000","last_change":"2024-09-12T01:39:13.900646+0000","last_active":"2024-09-12T01:39:15.128776+0000","last_peered":"2024-09-12T01:39:15.128776+0000","last_clean":"2024-09-12T01:39:15.128776+0000","last_became_active":"2024-09-12T01:39:13.899584+0000","last_became_peered":"2024-09-12T01:39:13.899584+0000","last_unstale":"2024-09-12T01:39:15.128776+0000","last_undegraded":"2024-09-12T01:39:15.128776+0000","last_fullsized":"2024-09-12T01:39:15.128776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:08.313862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902900+0000","last_change":"2024-09-12T01:39:13.897523+0000","last_active":"2024-09-12T01:39:14.902900+0000","last_peered":"2024-09-12T01:39:14.902900+0000","last_clean":"2024-09-12T01:39:14.902900+0000","last_became_active":"2024-09-12T01:39:13.897250+0000","last_became_peered":"2024-09-12T01:39:13.897250+0000","last_unstale":"2024-09-12T01:39:14.902900+0000","last_undegraded":"2024-09-12T01:39:14.902900+0000","last_fullsized":"2024-09-12T01:39:14.902900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:03.256051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.888049+0000","last_change":"2024-09-12T01:39:12.888049+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.888049+0000","last_undegraded":"2024-09-12T01:39:12.888049+0000","last_fullsized":"2024-09-12T01:39:12.888049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187991+0000","last_change":"2024-09-12T01:39:13.910043+0000","last_active":"2024-09-12T01:39:15.187991+0000","last_peered":"2024-09-12T01:39:15.187991+0000","last_clean":"2024-09-12T01:39:15.187991+0000","last_became_active":"2024-09-12T01:39:13.909698+0000","last_became_peered":"2024-09-12T01:39:13.909698+0000","last_unstale":"2024-09-12T01:39:15.187991+0000","last_undegraded":"2024-09-12T01:39:15.187991+0000","last_fullsized":"2024-09-12T01:39:15.187991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:08.179408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187332+0000","last_change":"2024-09-12T01:39:13.903280+0000","last_active":"2024-09-12T01:39:15.187332+0000","last_peered":"2024-09-12T01:39:15.187332+0000","last_clean":"2024-09-12T01:39:15.187332+0000","last_became_active":"2024-09-12T01:39:13.902331+0000","last_became_peered":"2024-09-12T01:39:13.902331+0000","last_unstale":"2024-09-12T01:39:15.187332+0000","last_undegraded":"2024-09-12T01:39:15.187332+0000","last_fullsized":"2024-09-12T01:39:15.187332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:28.988150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903142+0000","last_change":"2024-09-12T01:39:13.895633+0000","last_active":"2024-09-12T01:39:14.903142+0000","last_peered":"2024-09-12T01:39:14.903142+0000","last_clean":"2024-09-12T01:39:14.903142+0000","last_became_active":"2024-09-12T01:39:13.895342+0000","last_became_peered":"2024-09-12T01:39:13.895342+0000","last_unstale":"2024-09-12T01:39:14.903142+0000","last_undegraded":"2024-09-12T01:39:14.903142+0000","last_fullsized":"2024-09-12T01:39:14.903142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:44.878735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188188+0000","last_change":"2024-09-12T01:39:13.908537+0000","last_active":"2024-09-12T01:39:15.188188+0000","last_peered":"2024-09-12T01:39:15.188188+0000","last_clean":"2024-09-12T01:39:15.188188+0000","last_became_active":"2024-09-12T01:39:13.908193+0000","last_became_peered":"2024-09-12T01:39:13.908193+0000","last_unstale":"2024-09-12T01:39:15.188188+0000","last_undegraded":"2024-09-12T01:39:15.188188+0000","last_fullsized":"2024-09-12T01:39:15.188188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:50.638963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188087+0000","last_change":"2024-09-12T01:39:13.911076+0000","last_active":"2024-09-12T01:39:15.188087+0000","last_peered":"2024-09-12T01:39:15.188087+0000","last_clean":"2024-09-12T01:39:15.188087+0000","last_became_active":"2024-09-12T01:39:13.910824+0000","last_became_peered":"2024-09-12T01:39:13.910824+0000","last_unstale":"2024-09-12T01:39:15.188087+0000","last_undegraded":"2024-09-12T01:39:15.188087+0000","last_fullsized":"2024-09-12T01:39:15.188087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:25.363826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128818+0000","last_change":"2024-09-12T01:39:13.904087+0000","last_active":"2024-09-12T01:39:15.128818+0000","last_peered":"2024-09-12T01:39:15.128818+0000","last_clean":"2024-09-12T01:39:15.128818+0000","last_became_active":"2024-09-12T01:39:13.903799+0000","last_became_peered":"2024-09-12T01:39:13.903799+0000","last_unstale":"2024-09-12T01:39:15.128818+0000","last_undegraded":"2024-09-12T01:39:15.128818+0000","last_fullsized":"2024-09-12T01:39:15.128818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:47.515101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187275+0000","last_change":"2024-09-12T01:39:13.897466+0000","last_active":"2024-09-12T01:39:15.187275+0000","last_peered":"2024-09-12T01:39:15.187275+0000","last_clean":"2024-09-12T01:39:15.187275+0000","last_became_active":"2024-09-12T01:39:13.897050+0000","last_became_peered":"2024-09-12T01:39:13.897050+0000","last_unstale":"2024-09-12T01:39:15.187275+0000","last_undegraded":"2024-09-12T01:39:15.187275+0000","last_fullsized":"2024-09-12T01:39:15.187275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:00.820023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.887593+0000","last_change":"2024-09-12T01:39:12.887593+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.887593+0000","last_undegraded":"2024-09-12T01:39:12.887593+0000","last_fullsized":"2024-09-12T01:39:12.887593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902706+0000","last_change":"2024-09-12T01:39:13.895475+0000","last_active":"2024-09-12T01:39:14.902706+0000","last_peered":"2024-09-12T01:39:14.902706+0000","last_clean":"2024-09-12T01:39:14.902706+0000","last_became_active":"2024-09-12T01:39:13.894932+0000","last_became_peered":"2024-09-12T01:39:13.894932+0000","last_unstale":"2024-09-12T01:39:14.902706+0000","last_undegraded":"2024-09-12T01:39:14.902706+0000","last_fullsized":"2024-09-12T01:39:14.902706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.815960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187867+0000","last_change":"2024-09-12T01:39:13.911725+0000","last_active":"2024-09-12T01:39:15.187867+0000","last_peered":"2024-09-12T01:39:15.187867+0000","last_clean":"2024-09-12T01:39:15.187867+0000","last_became_active":"2024-09-12T01:39:13.911467+0000","last_became_peered":"2024-09-12T01:39:13.911467+0000","last_unstale":"2024-09-12T01:39:15.187867+0000","last_undegraded":"2024-09-12T01:39:15.187867+0000","last_fullsized":"2024-09-12T01:39:15.187867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.891062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188053+0000","last_change":"2024-09-12T01:39:13.909003+0000","last_active":"2024-09-12T01:39:15.188053+0000","last_peered":"2024-09-12T01:39:15.188053+0000","last_clean":"2024-09-12T01:39:15.188053+0000","last_became_active":"2024-09-12T01:39:13.908524+0000","last_became_peered":"2024-09-12T01:39:13.908524+0000","last_unstale":"2024-09-12T01:39:15.188053+0000","last_undegraded":"2024-09-12T01:39:15.188053+0000","last_fullsized":"2024-09-12T01:39:15.188053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:33.298540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187966+0000","last_change":"2024-09-12T01:39:13.905486+0000","last_active":"2024-09-12T01:39:15.187966+0000","last_peered":"2024-09-12T01:39:15.187966+0000","last_clean":"2024-09-12T01:39:15.187966+0000","last_became_active":"2024-09-12T01:39:13.905182+0000","last_became_peered":"2024-09-12T01:39:13.905182+0000","last_unstale":"2024-09-12T01:39:15.187966+0000","last_undegraded":"2024-09-12T01:39:15.187966+0000","last_fullsized":"2024-09-12T01:39:15.187966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:55.372979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187642+0000","last_change":"2024-09-12T01:39:13.897112+0000","last_active":"2024-09-12T01:39:15.187642+0000","last_peered":"2024-09-12T01:39:15.187642+0000","last_clean":"2024-09-12T01:39:15.187642+0000","last_became_active":"2024-09-12T01:39:13.896837+0000","last_became_peered":"2024-09-12T01:39:13.896837+0000","last_unstale":"2024-09-12T01:39:15.187642+0000","last_undegraded":"2024-09-12T01:39:15.187642+0000","last_fullsized":"2024-09-12T01:39:15.187642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:03.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907959+0000","last_change":"2024-09-12T01:39:13.904696+0000","last_active":"2024-09-12T01:39:14.907959+0000","last_peered":"2024-09-12T01:39:14.907959+0000","last_clean":"2024-09-12T01:39:14.907959+0000","last_became_active":"2024-09-12T01:39:13.904425+0000","last_became_peered":"2024-09-12T01:39:13.904425+0000","last_unstale":"2024-09-12T01:39:14.907959+0000","last_undegraded":"2024-09-12T01:39:14.907959+0000","last_fullsized":"2024-09-12T01:39:14.907959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:05.731459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187483+0000","last_change":"2024-09-12T01:39:13.901168+0000","last_active":"2024-09-12T01:39:15.187483+0000","last_peered":"2024-09-12T01:39:15.187483+0000","last_clean":"2024-09-12T01:39:15.187483+0000","last_became_active":"2024-09-12T01:39:13.900885+0000","last_became_peered":"2024-09-12T01:39:13.900885+0000","last_unstale":"2024-09-12T01:39:15.187483+0000","last_undegraded":"2024-09-12T01:39:15.187483+0000","last_fullsized":"2024-09-12T01:39:15.187483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:53.244610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187508+0000","last_change":"2024-09-12T01:39:13.910971+0000","last_active":"2024-09-12T01:39:15.187508+0000","last_peered":"2024-09-12T01:39:15.187508+0000","last_clean":"2024-09-12T01:39:15.187508+0000","last_became_active":"2024-09-12T01:39:13.910683+0000","last_became_peered":"2024-09-12T01:39:13.910683+0000","last_unstale":"2024-09-12T01:39:15.187508+0000","last_undegraded":"2024-09-12T01:39:15.187508+0000","last_fullsized":"2024-09-12T01:39:15.187508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:55.097048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187458+0000","last_change":"2024-09-12T01:39:13.903528+0000","last_active":"2024-09-12T01:39:15.187458+0000","last_peered":"2024-09-12T01:39:15.187458+0000","last_clean":"2024-09-12T01:39:15.187458+0000","last_became_active":"2024-09-12T01:39:13.902574+0000","last_became_peered":"2024-09-12T01:39:13.902574+0000","last_unstale":"2024-09-12T01:39:15.187458+0000","last_undegraded":"2024-09-12T01:39:15.187458+0000","last_fullsized":"2024-09-12T01:39:15.187458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.253305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188136+0000","last_change":"2024-09-12T01:39:13.914204+0000","last_active":"2024-09-12T01:39:15.188136+0000","last_peered":"2024-09-12T01:39:15.188136+0000","last_clean":"2024-09-12T01:39:15.188136+0000","last_became_active":"2024-09-12T01:39:13.913793+0000","last_became_peered":"2024-09-12T01:39:13.913793+0000","last_unstale":"2024-09-12T01:39:15.188136+0000","last_undegraded":"2024-09-12T01:39:15.188136+0000","last_fullsized":"2024-09-12T01:39:15.188136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:39.460105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129102+0000","last_change":"2024-09-12T01:39:13.904244+0000","last_active":"2024-09-12T01:39:15.129102+0000","last_peered":"2024-09-12T01:39:15.129102+0000","last_clean":"2024-09-12T01:39:15.129102+0000","last_became_active":"2024-09-12T01:39:13.903977+0000","last_became_peered":"2024-09-12T01:39:13.903977+0000","last_unstale":"2024-09-12T01:39:15.129102+0000","last_undegraded":"2024-09-12T01:39:15.129102+0000","last_fullsized":"2024-09-12T01:39:15.129102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:25.368830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129071+0000","last_change":"2024-09-12T01:39:13.898284+0000","last_active":"2024-09-12T01:39:15.129071+0000","last_peered":"2024-09-12T01:39:15.129071+0000","last_clean":"2024-09-12T01:39:15.129071+0000","last_became_active":"2024-09-12T01:39:13.898019+0000","last_became_peered":"2024-09-12T01:39:13.898019+0000","last_unstale":"2024-09-12T01:39:15.129071+0000","last_undegraded":"2024-09-12T01:39:15.129071+0000","last_fullsized":"2024-09-12T01:39:15.129071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:56.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187418+0000","last_change":"2024-09-12T01:39:13.905161+0000","last_active":"2024-09-12T01:39:15.187418+0000","last_peered":"2024-09-12T01:39:15.187418+0000","last_clean":"2024-09-12T01:39:15.187418+0000","last_became_active":"2024-09-12T01:39:13.902828+0000","last_became_peered":"2024-09-12T01:39:13.902828+0000","last_unstale":"2024-09-12T01:39:15.187418+0000","last_undegraded":"2024-09-12T01:39:15.187418+0000","last_fullsized":"2024-09-12T01:39:15.187418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:48.165883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908214+0000","last_change":"2024-09-12T01:39:13.903914+0000","last_active":"2024-09-12T01:39:14.908214+0000","last_peered":"2024-09-12T01:39:14.908214+0000","last_clean":"2024-09-12T01:39:14.908214+0000","last_became_active":"2024-09-12T01:39:13.903632+0000","last_became_peered":"2024-09-12T01:39:13.903632+0000","last_unstale":"2024-09-12T01:39:14.908214+0000","last_undegraded":"2024-09-12T01:39:14.908214+0000","last_fullsized":"2024-09-12T01:39:14.908214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:41.271935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187447+0000","last_change":"2024-09-12T01:39:13.900164+0000","last_active":"2024-09-12T01:39:15.187447+0000","last_peered":"2024-09-12T01:39:15.187447+0000","last_clean":"2024-09-12T01:39:15.187447+0000","last_became_active":"2024-09-12T01:39:13.899484+0000","last_became_peered":"2024-09-12T01:39:13.899484+0000","last_unstale":"2024-09-12T01:39:15.187447+0000","last_undegraded":"2024-09-12T01:39:15.187447+0000","last_fullsized":"2024-09-12T01:39:15.187447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:50.818822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902704+0000","last_change":"2024-09-12T01:39:13.894221+0000","last_active":"2024-09-12T01:39:14.902704+0000","last_peered":"2024-09-12T01:39:14.902704+0000","last_clean":"2024-09-12T01:39:14.902704+0000","last_became_active":"2024-09-12T01:39:13.893930+0000","last_became_peered":"2024-09-12T01:39:13.893930+0000","last_unstale":"2024-09-12T01:39:14.902704+0000","last_undegraded":"2024-09-12T01:39:14.902704+0000","last_fullsized":"2024-09-12T01:39:14.902704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:55.097048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902909+0000","last_change":"2024-09-12T01:39:13.894931+0000","last_active":"2024-09-12T01:39:14.902909+0000","last_peered":"2024-09-12T01:39:14.902909+0000","last_clean":"2024-09-12T01:39:14.902909+0000","last_became_active":"2024-09-12T01:39:13.894587+0000","last_became_peered":"2024-09-12T01:39:13.894587+0000","last_unstale":"2024-09-12T01:39:14.902909+0000","last_undegraded":"2024-09-12T01:39:14.902909+0000","last_fullsized":"2024-09-12T01:39:14.902909+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:56.121397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187568+0000","last_change":"2024-09-12T01:39:13.915079+0000","last_active":"2024-09-12T01:39:15.187568+0000","last_peered":"2024-09-12T01:39:15.187568+0000","last_clean":"2024-09-12T01:39:15.187568+0000","last_became_active":"2024-09-12T01:39:13.914761+0000","last_became_peered":"2024-09-12T01:39:13.914761+0000","last_unstale":"2024-09-12T01:39:15.187568+0000","last_undegraded":"2024-09-12T01:39:15.187568+0000","last_fullsized":"2024-09-12T01:39:15.187568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.815960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129105+0000","last_change":"2024-09-12T01:39:12.896630+0000","last_active":"2024-09-12T01:39:15.129105+0000","last_peered":"2024-09-12T01:39:15.129105+0000","last_clean":"2024-09-12T01:39:15.129105+0000","last_became_active":"2024-09-12T01:39:12.896343+0000","last_became_peered":"2024-09-12T01:39:12.896343+0000","last_unstale":"2024-09-12T01:39:15.129105+0000","last_undegraded":"2024-09-12T01:39:15.129105+0000","last_fullsized":"2024-09-12T01:39:15.129105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:40.029147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187440+0000","last_change":"2024-09-12T01:39:13.904295+0000","last_active":"2024-09-12T01:39:15.187440+0000","last_peered":"2024-09-12T01:39:15.187440+0000","last_clean":"2024-09-12T01:39:15.187440+0000","last_became_active":"2024-09-12T01:39:13.903604+0000","last_became_peered":"2024-09-12T01:39:13.903604+0000","last_unstale":"2024-09-12T01:39:15.187440+0000","last_undegraded":"2024-09-12T01:39:15.187440+0000","last_fullsized":"2024-09-12T01:39:15.187440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:18.193470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903131+0000","last_change":"2024-09-12T01:39:12.896766+0000","last_active":"2024-09-12T01:39:14.903131+0000","last_peered":"2024-09-12T01:39:14.903131+0000","last_clean":"2024-09-12T01:39:14.903131+0000","last_became_active":"2024-09-12T01:39:12.896143+0000","last_became_peered":"2024-09-12T01:39:12.896143+0000","last_unstale":"2024-09-12T01:39:14.903131+0000","last_undegraded":"2024-09-12T01:39:14.903131+0000","last_fullsized":"2024-09-12T01:39:14.903131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:00.120318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188090+0000","last_change":"2024-09-12T01:39:13.914121+0000","last_active":"2024-09-12T01:39:15.188090+0000","last_peered":"2024-09-12T01:39:15.188090+0000","last_clean":"2024-09-12T01:39:15.188090+0000","last_became_active":"2024-09-12T01:39:13.913818+0000","last_became_peered":"2024-09-12T01:39:13.913818+0000","last_unstale":"2024-09-12T01:39:15.188090+0000","last_undegraded":"2024-09-12T01:39:15.188090+0000","last_fullsized":"2024-09-12T01:39:15.188090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:20.834108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188191+0000","last_change":"2024-09-12T01:39:12.898592+0000","last_active":"2024-09-12T01:39:15.188191+0000","last_peered":"2024-09-12T01:39:15.188191+0000","last_clean":"2024-09-12T01:39:15.188191+0000","last_became_active":"2024-09-12T01:39:12.898312+0000","last_became_peered":"2024-09-12T01:39:12.898312+0000","last_unstale":"2024-09-12T01:39:15.188191+0000","last_undegraded":"2024-09-12T01:39:15.188191+0000","last_fullsized":"2024-09-12T01:39:15.188191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:52.356993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187617+0000","last_change":"2024-09-12T01:39:13.912780+0000","last_active":"2024-09-12T01:39:15.187617+0000","last_peered":"2024-09-12T01:39:15.187617+0000","last_clean":"2024-09-12T01:39:15.187617+0000","last_became_active":"2024-09-12T01:39:13.912419+0000","last_became_peered":"2024-09-12T01:39:13.912419+0000","last_unstale":"2024-09-12T01:39:15.187617+0000","last_undegraded":"2024-09-12T01:39:15.187617+0000","last_fullsized":"2024-09-12T01:39:15.187617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:38.977876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908254+0000","last_change":"2024-09-12T01:39:12.897577+0000","last_active":"2024-09-12T01:39:14.908254+0000","last_peered":"2024-09-12T01:39:14.908254+0000","last_clean":"2024-09-12T01:39:14.908254+0000","last_became_active":"2024-09-12T01:39:12.897230+0000","last_became_peered":"2024-09-12T01:39:12.897230+0000","last_unstale":"2024-09-12T01:39:14.908254+0000","last_undegraded":"2024-09-12T01:39:14.908254+0000","last_fullsized":"2024-09-12T01:39:14.908254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.116323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908050+0000","last_change":"2024-09-12T01:39:13.908787+0000","last_active":"2024-09-12T01:39:14.908050+0000","last_peered":"2024-09-12T01:39:14.908050+0000","last_clean":"2024-09-12T01:39:14.908050+0000","last_became_active":"2024-09-12T01:39:13.908549+0000","last_became_peered":"2024-09-12T01:39:13.908549+0000","last_unstale":"2024-09-12T01:39:14.908050+0000","last_undegraded":"2024-09-12T01:39:14.908050+0000","last_fullsized":"2024-09-12T01:39:14.908050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:02.236054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187564+0000","last_change":"2024-09-12T01:39:12.899469+0000","last_active":"2024-09-12T01:39:15.187564+0000","last_peered":"2024-09-12T01:39:15.187564+0000","last_clean":"2024-09-12T01:39:15.187564+0000","last_became_active":"2024-09-12T01:39:12.899173+0000","last_became_peered":"2024-09-12T01:39:12.899173+0000","last_unstale":"2024-09-12T01:39:15.187564+0000","last_undegraded":"2024-09-12T01:39:15.187564+0000","last_fullsized":"2024-09-12T01:39:15.187564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:17.188396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902965+0000","last_change":"2024-09-12T01:39:13.900761+0000","last_active":"2024-09-12T01:39:14.902965+0000","last_peered":"2024-09-12T01:39:14.902965+0000","last_clean":"2024-09-12T01:39:14.902965+0000","last_became_active":"2024-09-12T01:39:13.900441+0000","last_became_peered":"2024-09-12T01:39:13.900441+0000","last_unstale":"2024-09-12T01:39:14.902965+0000","last_undegraded":"2024-09-12T01:39:14.902965+0000","last_fullsized":"2024-09-12T01:39:14.902965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.891062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902865+0000","last_change":"2024-09-12T01:39:12.901743+0000","last_active":"2024-09-12T01:39:14.902865+0000","last_peered":"2024-09-12T01:39:14.902865+0000","last_clean":"2024-09-12T01:39:14.902865+0000","last_became_active":"2024-09-12T01:39:12.901418+0000","last_became_peered":"2024-09-12T01:39:12.901418+0000","last_unstale":"2024-09-12T01:39:14.902865+0000","last_undegraded":"2024-09-12T01:39:14.902865+0000","last_fullsized":"2024-09-12T01:39:14.902865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:27.983076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187162+0000","last_change":"2024-09-12T01:39:13.898011+0000","last_active":"2024-09-12T01:39:15.187162+0000","last_peered":"2024-09-12T01:39:15.187162+0000","last_clean":"2024-09-12T01:39:15.187162+0000","last_became_active":"2024-09-12T01:39:13.897644+0000","last_became_peered":"2024-09-12T01:39:13.897644+0000","last_unstale":"2024-09-12T01:39:15.187162+0000","last_undegraded":"2024-09-12T01:39:15.187162+0000","last_fullsized":"2024-09-12T01:39:15.187162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:03.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187381+0000","last_change":"2024-09-12T01:39:12.901437+0000","last_active":"2024-09-12T01:39:15.187381+0000","last_peered":"2024-09-12T01:39:15.187381+0000","last_clean":"2024-09-12T01:39:15.187381+0000","last_became_active":"2024-09-12T01:39:12.901120+0000","last_became_peered":"2024-09-12T01:39:12.901120+0000","last_unstale":"2024-09-12T01:39:15.187381+0000","last_undegraded":"2024-09-12T01:39:15.187381+0000","last_fullsized":"2024-09-12T01:39:15.187381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:18.265444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187431+0000","last_change":"2024-09-12T01:39:13.896873+0000","last_active":"2024-09-12T01:39:15.187431+0000","last_peered":"2024-09-12T01:39:15.187431+0000","last_clean":"2024-09-12T01:39:15.187431+0000","last_became_active":"2024-09-12T01:39:13.896578+0000","last_became_peered":"2024-09-12T01:39:13.896578+0000","last_unstale":"2024-09-12T01:39:15.187431+0000","last_undegraded":"2024-09-12T01:39:15.187431+0000","last_fullsized":"2024-09-12T01:39:15.187431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:53.362068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187132+0000","last_change":"2024-09-12T01:39:12.903658+0000","last_active":"2024-09-12T01:39:15.187132+0000","last_peered":"2024-09-12T01:39:15.187132+0000","last_clean":"2024-09-12T01:39:15.187132+0000","last_became_active":"2024-09-12T01:39:12.903455+0000","last_became_peered":"2024-09-12T01:39:12.903455+0000","last_unstale":"2024-09-12T01:39:15.187132+0000","last_undegraded":"2024-09-12T01:39:15.187132+0000","last_fullsized":"2024-09-12T01:39:15.187132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:07.523595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187442+0000","last_change":"2024-09-12T01:39:13.906892+0000","last_active":"2024-09-12T01:39:15.187442+0000","last_peered":"2024-09-12T01:39:15.187442+0000","last_clean":"2024-09-12T01:39:15.187442+0000","last_became_active":"2024-09-12T01:39:13.906624+0000","last_became_peered":"2024-09-12T01:39:13.906624+0000","last_unstale":"2024-09-12T01:39:15.187442+0000","last_undegraded":"2024-09-12T01:39:15.187442+0000","last_fullsized":"2024-09-12T01:39:15.187442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:16.212505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187700+0000","last_change":"2024-09-12T01:39:12.898372+0000","last_active":"2024-09-12T01:39:15.187700+0000","last_peered":"2024-09-12T01:39:15.187700+0000","last_clean":"2024-09-12T01:39:15.187700+0000","last_became_active":"2024-09-12T01:39:12.898048+0000","last_became_peered":"2024-09-12T01:39:12.898048+0000","last_unstale":"2024-09-12T01:39:15.187700+0000","last_undegraded":"2024-09-12T01:39:15.187700+0000","last_fullsized":"2024-09-12T01:39:15.187700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:37.700774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187604+0000","last_change":"2024-09-12T01:39:13.913892+0000","last_active":"2024-09-12T01:39:15.187604+0000","last_peered":"2024-09-12T01:39:15.187604+0000","last_clean":"2024-09-12T01:39:15.187604+0000","last_became_active":"2024-09-12T01:39:13.913473+0000","last_became_peered":"2024-09-12T01:39:13.913473+0000","last_unstale":"2024-09-12T01:39:15.187604+0000","last_undegraded":"2024-09-12T01:39:15.187604+0000","last_fullsized":"2024-09-12T01:39:15.187604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.253305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903236+0000","last_change":"2024-09-12T01:39:12.897002+0000","last_active":"2024-09-12T01:39:14.903236+0000","last_peered":"2024-09-12T01:39:14.903236+0000","last_clean":"2024-09-12T01:39:14.903236+0000","last_became_active":"2024-09-12T01:39:12.896502+0000","last_became_peered":"2024-09-12T01:39:12.896502+0000","last_unstale":"2024-09-12T01:39:14.903236+0000","last_undegraded":"2024-09-12T01:39:14.903236+0000","last_fullsized":"2024-09-12T01:39:14.903236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:37.972801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187824+0000","last_change":"2024-09-12T01:39:13.914328+0000","last_active":"2024-09-12T01:39:15.187824+0000","last_peered":"2024-09-12T01:39:15.187824+0000","last_clean":"2024-09-12T01:39:15.187824+0000","last_became_active":"2024-09-12T01:39:13.914055+0000","last_became_peered":"2024-09-12T01:39:13.914055+0000","last_unstale":"2024-09-12T01:39:15.187824+0000","last_undegraded":"2024-09-12T01:39:15.187824+0000","last_fullsized":"2024-09-12T01:39:15.187824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:54.539029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187798+0000","last_change":"2024-09-12T01:39:12.895761+0000","last_active":"2024-09-12T01:39:15.187798+0000","last_peered":"2024-09-12T01:39:15.187798+0000","last_clean":"2024-09-12T01:39:15.187798+0000","last_became_active":"2024-09-12T01:39:12.895469+0000","last_became_peered":"2024-09-12T01:39:12.895469+0000","last_unstale":"2024-09-12T01:39:15.187798+0000","last_undegraded":"2024-09-12T01:39:15.187798+0000","last_fullsized":"2024-09-12T01:39:15.187798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:22.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129042+0000","last_change":"2024-09-12T01:39:13.912400+0000","last_active":"2024-09-12T01:39:15.129042+0000","last_peered":"2024-09-12T01:39:15.129042+0000","last_clean":"2024-09-12T01:39:15.129042+0000","last_became_active":"2024-09-12T01:39:13.912154+0000","last_became_peered":"2024-09-12T01:39:13.912154+0000","last_unstale":"2024-09-12T01:39:15.129042+0000","last_undegraded":"2024-09-12T01:39:15.129042+0000","last_fullsized":"2024-09-12T01:39:15.129042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:36.874197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"79'6","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188153+0000","last_change":"2024-09-12T01:39:12.898516+0000","last_active":"2024-09-12T01:39:15.188153+0000","last_peered":"2024-09-12T01:39:15.188153+0000","last_clean":"2024-09-12T01:39:15.188153+0000","last_became_active":"2024-09-12T01:39:12.898169+0000","last_became_peered":"2024-09-12T01:39:12.898169+0000","last_unstale":"2024-09-12T01:39:15.188153+0000","last_undegraded":"2024-09-12T01:39:15.188153+0000","last_fullsized":"2024-09-12T01:39:15.188153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:00.120318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187751+0000","last_change":"2024-09-12T01:39:13.907928+0000","last_active":"2024-09-12T01:39:15.187751+0000","last_peered":"2024-09-12T01:39:15.187751+0000","last_clean":"2024-09-12T01:39:15.187751+0000","last_became_active":"2024-09-12T01:39:13.907637+0000","last_became_peered":"2024-09-12T01:39:13.907637+0000","last_unstale":"2024-09-12T01:39:15.187751+0000","last_undegraded":"2024-09-12T01:39:15.187751+0000","last_fullsized":"2024-09-12T01:39:15.187751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:36.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908265+0000","last_change":"2024-09-12T01:39:12.896500+0000","last_active":"2024-09-12T01:39:14.908265+0000","last_peered":"2024-09-12T01:39:14.908265+0000","last_clean":"2024-09-12T01:39:14.908265+0000","last_became_active":"2024-09-12T01:39:12.896204+0000","last_became_peered":"2024-09-12T01:39:12.896204+0000","last_unstale":"2024-09-12T01:39:14.908265+0000","last_undegraded":"2024-09-12T01:39:14.908265+0000","last_fullsized":"2024-09-12T01:39:14.908265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:31.885987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187726+0000","last_change":"2024-09-12T01:39:13.911848+0000","last_active":"2024-09-12T01:39:15.187726+0000","last_peered":"2024-09-12T01:39:15.187726+0000","last_clean":"2024-09-12T01:39:15.187726+0000","last_became_active":"2024-09-12T01:39:13.911578+0000","last_became_peered":"2024-09-12T01:39:13.911578+0000","last_unstale":"2024-09-12T01:39:15.187726+0000","last_undegraded":"2024-09-12T01:39:15.187726+0000","last_fullsized":"2024-09-12T01:39:15.187726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:36.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T01:39:12.898209+0000","last_change":"2024-09-12T01:39:12.894877+0000","last_active":"2024-09-12T01:39:12.898209+0000","last_peered":"2024-09-12T01:39:12.898209+0000","last_clean":"2024-09-12T01:39:12.898209+0000","last_became_active":"2024-09-12T01:39:12.894584+0000","last_became_peered":"2024-09-12T01:39:12.894584+0000","last_unstale":"2024-09-12T01:39:12.898209+0000","last_undegraded":"2024-09-12T01:39:12.898209+0000","last_fullsized":"2024-09-12T01:39:12.898209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:21.828714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187238+0000","last_change":"2024-09-12T01:39:13.898011+0000","last_active":"2024-09-12T01:39:15.187238+0000","last_peered":"2024-09-12T01:39:15.187238+0000","last_clean":"2024-09-12T01:39:15.187238+0000","last_became_active":"2024-09-12T01:39:13.897749+0000","last_became_peered":"2024-09-12T01:39:13.897749+0000","last_unstale":"2024-09-12T01:39:15.187238+0000","last_undegraded":"2024-09-12T01:39:15.187238+0000","last_fullsized":"2024-09-12T01:39:15.187238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:24.935008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902705+0000","last_change":"2024-09-12T01:39:12.895196+0000","last_active":"2024-09-12T01:39:14.902705+0000","last_peered":"2024-09-12T01:39:14.902705+0000","last_clean":"2024-09-12T01:39:14.902705+0000","last_became_active":"2024-09-12T01:39:12.894890+0000","last_became_peered":"2024-09-12T01:39:12.894890+0000","last_unstale":"2024-09-12T01:39:14.902705+0000","last_undegraded":"2024-09-12T01:39:14.902705+0000","last_fullsized":"2024-09-12T01:39:14.902705+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:47.160808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187452+0000","last_change":"2024-09-12T01:39:13.906691+0000","last_active":"2024-09-12T01:39:15.187452+0000","last_peered":"2024-09-12T01:39:15.187452+0000","last_clean":"2024-09-12T01:39:15.187452+0000","last_became_active":"2024-09-12T01:39:13.906346+0000","last_became_peered":"2024-09-12T01:39:13.906346+0000","last_unstale":"2024-09-12T01:39:15.187452+0000","last_undegraded":"2024-09-12T01:39:15.187452+0000","last_fullsized":"2024-09-12T01:39:15.187452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:38.977876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"79'8","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187582+0000","last_change":"2024-09-12T01:39:12.892882+0000","last_active":"2024-09-12T01:39:15.187582+0000","last_peered":"2024-09-12T01:39:15.187582+0000","last_clean":"2024-09-12T01:39:15.187582+0000","last_became_active":"2024-09-12T01:39:12.892533+0000","last_became_peered":"2024-09-12T01:39:12.892533+0000","last_unstale":"2024-09-12T01:39:15.187582+0000","last_undegraded":"2024-09-12T01:39:15.187582+0000","last_fullsized":"2024-09-12T01:39:15.187582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:59.814949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187723+0000","last_change":"2024-09-12T01:39:13.916960+0000","last_active":"2024-09-12T01:39:15.187723+0000","last_peered":"2024-09-12T01:39:15.187723+0000","last_clean":"2024-09-12T01:39:15.187723+0000","last_became_active":"2024-09-12T01:39:13.916569+0000","last_became_peered":"2024-09-12T01:39:13.916569+0000","last_unstale":"2024-09-12T01:39:15.187723+0000","last_undegraded":"2024-09-12T01:39:15.187723+0000","last_fullsized":"2024-09-12T01:39:15.187723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:56.121397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129266+0000","last_change":"2024-09-12T01:39:12.895948+0000","last_active":"2024-09-12T01:39:15.129266+0000","last_peered":"2024-09-12T01:39:15.129266+0000","last_clean":"2024-09-12T01:39:15.129266+0000","last_became_active":"2024-09-12T01:39:12.895645+0000","last_became_peered":"2024-09-12T01:39:12.895645+0000","last_unstale":"2024-09-12T01:39:15.129266+0000","last_undegraded":"2024-09-12T01:39:15.129266+0000","last_fullsized":"2024-09-12T01:39:15.129266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:27.105186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903397+0000","last_change":"2024-09-12T01:39:13.895212+0000","last_active":"2024-09-12T01:39:14.903397+0000","last_peered":"2024-09-12T01:39:14.903397+0000","last_clean":"2024-09-12T01:39:14.903397+0000","last_became_active":"2024-09-12T01:39:13.894887+0000","last_became_peered":"2024-09-12T01:39:13.894887+0000","last_unstale":"2024-09-12T01:39:14.903397+0000","last_undegraded":"2024-09-12T01:39:14.903397+0000","last_fullsized":"2024-09-12T01:39:14.903397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:25.363826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187893+0000","last_change":"2024-09-12T01:39:12.900345+0000","last_active":"2024-09-12T01:39:15.187893+0000","last_peered":"2024-09-12T01:39:15.187893+0000","last_clean":"2024-09-12T01:39:15.187893+0000","last_became_active":"2024-09-12T01:39:12.900043+0000","last_became_peered":"2024-09-12T01:39:12.900043+0000","last_unstale":"2024-09-12T01:39:15.187893+0000","last_undegraded":"2024-09-12T01:39:15.187893+0000","last_fullsized":"2024-09-12T01:39:15.187893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:46.990181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187995+0000","last_change":"2024-09-12T01:39:13.915910+0000","last_active":"2024-09-12T01:39:15.187995+0000","last_peered":"2024-09-12T01:39:15.187995+0000","last_clean":"2024-09-12T01:39:15.187995+0000","last_became_active":"2024-09-12T01:39:13.915569+0000","last_became_peered":"2024-09-12T01:39:13.915569+0000","last_unstale":"2024-09-12T01:39:15.187995+0000","last_undegraded":"2024-09-12T01:39:15.187995+0000","last_fullsized":"2024-09-12T01:39:15.187995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:44.878735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187677+0000","last_change":"2024-09-12T01:39:12.900655+0000","last_active":"2024-09-12T01:39:15.187677+0000","last_peered":"2024-09-12T01:39:15.187677+0000","last_clean":"2024-09-12T01:39:15.187677+0000","last_became_active":"2024-09-12T01:39:12.900298+0000","last_became_peered":"2024-09-12T01:39:12.900298+0000","last_unstale":"2024-09-12T01:39:15.187677+0000","last_undegraded":"2024-09-12T01:39:15.187677+0000","last_fullsized":"2024-09-12T01:39:15.187677+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:56.792978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-09-12T01:39:12.888244+0000","last_change":"2024-09-12T01:39:12.888244+0000","last_active":"2024-09-12T01:39:12.876977+0000","last_peered":"2024-09-12T01:39:12.876977+0000","last_clean":"2024-09-12T01:39:12.876977+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:39:12.888244+0000","last_undegraded":"2024-09-12T01:39:12.888244+0000","last_fullsized":"2024-09-12T01:39:12.888244+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187593+0000","last_change":"2024-09-12T01:39:12.899244+0000","last_active":"2024-09-12T01:39:15.187593+0000","last_peered":"2024-09-12T01:39:15.187593+0000","last_clean":"2024-09-12T01:39:15.187593+0000","last_became_active":"2024-09-12T01:39:12.898773+0000","last_became_peered":"2024-09-12T01:39:12.898773+0000","last_unstale":"2024-09-12T01:39:15.187593+0000","last_undegraded":"2024-09-12T01:39:15.187593+0000","last_fullsized":"2024-09-12T01:39:15.187593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:32.656288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128927+0000","last_change":"2024-09-12T01:39:13.908672+0000","last_active":"2024-09-12T01:39:15.128927+0000","last_peered":"2024-09-12T01:39:15.128927+0000","last_clean":"2024-09-12T01:39:15.128927+0000","last_became_active":"2024-09-12T01:39:13.908365+0000","last_became_peered":"2024-09-12T01:39:13.908365+0000","last_unstale":"2024-09-12T01:39:15.128927+0000","last_undegraded":"2024-09-12T01:39:15.128927+0000","last_fullsized":"2024-09-12T01:39:15.128927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:28.239676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T01:39:12.899940+0000","last_change":"2024-09-12T01:39:12.897940+0000","last_active":"2024-09-12T01:39:12.899940+0000","last_peered":"2024-09-12T01:39:12.899940+0000","last_clean":"2024-09-12T01:39:12.899940+0000","last_became_active":"2024-09-12T01:39:12.897617+0000","last_became_peered":"2024-09-12T01:39:12.897617+0000","last_unstale":"2024-09-12T01:39:12.899940+0000","last_undegraded":"2024-09-12T01:39:12.899940+0000","last_fullsized":"2024-09-12T01:39:12.899940+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:38.210811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907757+0000","last_change":"2024-09-12T01:39:13.908088+0000","last_active":"2024-09-12T01:39:14.907757+0000","last_peered":"2024-09-12T01:39:14.907757+0000","last_clean":"2024-09-12T01:39:14.907757+0000","last_became_active":"2024-09-12T01:39:13.907807+0000","last_became_peered":"2024-09-12T01:39:13.907807+0000","last_unstale":"2024-09-12T01:39:14.907757+0000","last_undegraded":"2024-09-12T01:39:14.907757+0000","last_fullsized":"2024-09-12T01:39:14.907757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:58.775933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187702+0000","last_change":"2024-09-12T01:39:12.892007+0000","last_active":"2024-09-12T01:39:15.187702+0000","last_peered":"2024-09-12T01:39:15.187702+0000","last_clean":"2024-09-12T01:39:15.187702+0000","last_became_active":"2024-09-12T01:39:12.891744+0000","last_became_peered":"2024-09-12T01:39:12.891744+0000","last_unstale":"2024-09-12T01:39:15.187702+0000","last_undegraded":"2024-09-12T01:39:15.187702+0000","last_fullsized":"2024-09-12T01:39:15.187702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.207430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187658+0000","last_change":"2024-09-12T01:39:13.913157+0000","last_active":"2024-09-12T01:39:15.187658+0000","last_peered":"2024-09-12T01:39:15.187658+0000","last_clean":"2024-09-12T01:39:15.187658+0000","last_became_active":"2024-09-12T01:39:13.912881+0000","last_became_peered":"2024-09-12T01:39:13.912881+0000","last_unstale":"2024-09-12T01:39:15.187658+0000","last_undegraded":"2024-09-12T01:39:15.187658+0000","last_fullsized":"2024-09-12T01:39:15.187658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:03.256051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187393+0000","last_change":"2024-09-12T01:39:12.897776+0000","last_active":"2024-09-12T01:39:15.187393+0000","last_peered":"2024-09-12T01:39:15.187393+0000","last_clean":"2024-09-12T01:39:15.187393+0000","last_became_active":"2024-09-12T01:39:12.897527+0000","last_became_peered":"2024-09-12T01:39:12.897527+0000","last_unstale":"2024-09-12T01:39:15.187393+0000","last_undegraded":"2024-09-12T01:39:15.187393+0000","last_fullsized":"2024-09-12T01:39:15.187393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:29.855267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129181+0000","last_change":"2024-09-12T01:39:13.900476+0000","last_active":"2024-09-12T01:39:15.129181+0000","last_peered":"2024-09-12T01:39:15.129181+0000","last_clean":"2024-09-12T01:39:15.129181+0000","last_became_active":"2024-09-12T01:39:13.900204+0000","last_became_peered":"2024-09-12T01:39:13.900204+0000","last_unstale":"2024-09-12T01:39:15.129181+0000","last_undegraded":"2024-09-12T01:39:15.129181+0000","last_fullsized":"2024-09-12T01:39:15.129181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:41.140743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187678+0000","last_change":"2024-09-12T01:39:12.904275+0000","last_active":"2024-09-12T01:39:15.187678+0000","last_peered":"2024-09-12T01:39:15.187678+0000","last_clean":"2024-09-12T01:39:15.187678+0000","last_became_active":"2024-09-12T01:39:12.904028+0000","last_became_peered":"2024-09-12T01:39:12.904028+0000","last_unstale":"2024-09-12T01:39:15.187678+0000","last_undegraded":"2024-09-12T01:39:15.187678+0000","last_fullsized":"2024-09-12T01:39:15.187678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:27.433076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129064+0000","last_change":"2024-09-12T01:39:13.912165+0000","last_active":"2024-09-12T01:39:15.129064+0000","last_peered":"2024-09-12T01:39:15.129064+0000","last_clean":"2024-09-12T01:39:15.129064+0000","last_became_active":"2024-09-12T01:39:13.911869+0000","last_became_peered":"2024-09-12T01:39:13.911869+0000","last_unstale":"2024-09-12T01:39:15.129064+0000","last_undegraded":"2024-09-12T01:39:15.129064+0000","last_fullsized":"2024-09-12T01:39:15.129064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:43.619413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187997+0000","last_change":"2024-09-12T01:39:12.890030+0000","last_active":"2024-09-12T01:39:15.187997+0000","last_peered":"2024-09-12T01:39:15.187997+0000","last_clean":"2024-09-12T01:39:15.187997+0000","last_became_active":"2024-09-12T01:39:12.889687+0000","last_became_peered":"2024-09-12T01:39:12.889687+0000","last_unstale":"2024-09-12T01:39:15.187997+0000","last_undegraded":"2024-09-12T01:39:15.187997+0000","last_fullsized":"2024-09-12T01:39:15.187997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:49.813748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128984+0000","last_change":"2024-09-12T01:39:13.902776+0000","last_active":"2024-09-12T01:39:15.128984+0000","last_peered":"2024-09-12T01:39:15.128984+0000","last_clean":"2024-09-12T01:39:15.128984+0000","last_became_active":"2024-09-12T01:39:13.902502+0000","last_became_peered":"2024-09-12T01:39:13.902502+0000","last_unstale":"2024-09-12T01:39:15.128984+0000","last_undegraded":"2024-09-12T01:39:15.128984+0000","last_fullsized":"2024-09-12T01:39:15.128984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:01.168363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188042+0000","last_change":"2024-09-12T01:39:12.900224+0000","last_active":"2024-09-12T01:39:15.188042+0000","last_peered":"2024-09-12T01:39:15.188042+0000","last_clean":"2024-09-12T01:39:15.188042+0000","last_became_active":"2024-09-12T01:39:12.899905+0000","last_became_peered":"2024-09-12T01:39:12.899905+0000","last_unstale":"2024-09-12T01:39:15.188042+0000","last_undegraded":"2024-09-12T01:39:15.188042+0000","last_fullsized":"2024-09-12T01:39:15.188042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:30.248231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903170+0000","last_change":"2024-09-12T01:39:13.903873+0000","last_active":"2024-09-12T01:39:14.903170+0000","last_peered":"2024-09-12T01:39:14.903170+0000","last_clean":"2024-09-12T01:39:14.903170+0000","last_became_active":"2024-09-12T01:39:13.902665+0000","last_became_peered":"2024-09-12T01:39:13.902665+0000","last_unstale":"2024-09-12T01:39:14.903170+0000","last_undegraded":"2024-09-12T01:39:14.903170+0000","last_fullsized":"2024-09-12T01:39:14.903170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:20.834108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902828+0000","last_change":"2024-09-12T01:39:12.900941+0000","last_active":"2024-09-12T01:39:14.902828+0000","last_peered":"2024-09-12T01:39:14.902828+0000","last_clean":"2024-09-12T01:39:14.902828+0000","last_became_active":"2024-09-12T01:39:12.900582+0000","last_became_peered":"2024-09-12T01:39:12.900582+0000","last_unstale":"2024-09-12T01:39:14.902828+0000","last_undegraded":"2024-09-12T01:39:14.902828+0000","last_fullsized":"2024-09-12T01:39:14.902828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:17.188396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187305+0000","last_change":"2024-09-12T01:39:13.906501+0000","last_active":"2024-09-12T01:39:15.187305+0000","last_peered":"2024-09-12T01:39:15.187305+0000","last_clean":"2024-09-12T01:39:15.187305+0000","last_became_active":"2024-09-12T01:39:13.905251+0000","last_became_peered":"2024-09-12T01:39:13.905251+0000","last_unstale":"2024-09-12T01:39:15.187305+0000","last_undegraded":"2024-09-12T01:39:15.187305+0000","last_fullsized":"2024-09-12T01:39:15.187305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:12.012554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T01:39:12.899668+0000","last_change":"2024-09-12T01:39:12.896423+0000","last_active":"2024-09-12T01:39:12.899668+0000","last_peered":"2024-09-12T01:39:12.899668+0000","last_clean":"2024-09-12T01:39:12.899668+0000","last_became_active":"2024-09-12T01:39:12.896163+0000","last_became_peered":"2024-09-12T01:39:12.896163+0000","last_unstale":"2024-09-12T01:39:12.899668+0000","last_undegraded":"2024-09-12T01:39:12.899668+0000","last_fullsized":"2024-09-12T01:39:12.899668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:18.895862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187808+0000","last_change":"2024-09-12T01:39:13.906963+0000","last_active":"2024-09-12T01:39:15.187808+0000","last_peered":"2024-09-12T01:39:15.187808+0000","last_clean":"2024-09-12T01:39:15.187808+0000","last_became_active":"2024-09-12T01:39:13.906272+0000","last_became_peered":"2024-09-12T01:39:13.906272+0000","last_unstale":"2024-09-12T01:39:15.187808+0000","last_undegraded":"2024-09-12T01:39:15.187808+0000","last_fullsized":"2024-09-12T01:39:15.187808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:26.904998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902944+0000","last_change":"2024-09-12T01:39:12.902567+0000","last_active":"2024-09-12T01:39:14.902944+0000","last_peered":"2024-09-12T01:39:14.902944+0000","last_clean":"2024-09-12T01:39:14.902944+0000","last_became_active":"2024-09-12T01:39:12.902261+0000","last_became_peered":"2024-09-12T01:39:12.902261+0000","last_unstale":"2024-09-12T01:39:14.902944+0000","last_undegraded":"2024-09-12T01:39:14.902944+0000","last_fullsized":"2024-09-12T01:39:14.902944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:30.248231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187175+0000","last_change":"2024-09-12T01:39:13.903016+0000","last_active":"2024-09-12T01:39:15.187175+0000","last_peered":"2024-09-12T01:39:15.187175+0000","last_clean":"2024-09-12T01:39:15.187175+0000","last_became_active":"2024-09-12T01:39:13.902740+0000","last_became_peered":"2024-09-12T01:39:13.902740+0000","last_unstale":"2024-09-12T01:39:15.187175+0000","last_undegraded":"2024-09-12T01:39:15.187175+0000","last_fullsized":"2024-09-12T01:39:15.187175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:55.372979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187123+0000","last_change":"2024-09-12T01:39:12.896200+0000","last_active":"2024-09-12T01:39:15.187123+0000","last_peered":"2024-09-12T01:39:15.187123+0000","last_clean":"2024-09-12T01:39:15.187123+0000","last_became_active":"2024-09-12T01:39:12.895937+0000","last_became_peered":"2024-09-12T01:39:12.895937+0000","last_unstale":"2024-09-12T01:39:15.187123+0000","last_undegraded":"2024-09-12T01:39:15.187123+0000","last_fullsized":"2024-09-12T01:39:15.187123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:16.330008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187586+0000","last_change":"2024-09-12T01:39:13.905333+0000","last_active":"2024-09-12T01:39:15.187586+0000","last_peered":"2024-09-12T01:39:15.187586+0000","last_clean":"2024-09-12T01:39:15.187586+0000","last_became_active":"2024-09-12T01:39:13.904982+0000","last_became_peered":"2024-09-12T01:39:13.904982+0000","last_unstale":"2024-09-12T01:39:15.187586+0000","last_undegraded":"2024-09-12T01:39:15.187586+0000","last_fullsized":"2024-09-12T01:39:15.187586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:01.125393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187933+0000","last_change":"2024-09-12T01:39:12.897786+0000","last_active":"2024-09-12T01:39:15.187933+0000","last_peered":"2024-09-12T01:39:15.187933+0000","last_clean":"2024-09-12T01:39:15.187933+0000","last_became_active":"2024-09-12T01:39:12.897384+0000","last_became_peered":"2024-09-12T01:39:12.897384+0000","last_unstale":"2024-09-12T01:39:15.187933+0000","last_undegraded":"2024-09-12T01:39:15.187933+0000","last_fullsized":"2024-09-12T01:39:15.187933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:37.972801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187951+0000","last_change":"2024-09-12T01:39:13.915042+0000","last_active":"2024-09-12T01:39:15.187951+0000","last_peered":"2024-09-12T01:39:15.187951+0000","last_clean":"2024-09-12T01:39:15.187951+0000","last_became_active":"2024-09-12T01:39:13.914403+0000","last_became_peered":"2024-09-12T01:39:13.914403+0000","last_unstale":"2024-09-12T01:39:15.187951+0000","last_undegraded":"2024-09-12T01:39:15.187951+0000","last_fullsized":"2024-09-12T01:39:15.187951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:54.227036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129155+0000","last_change":"2024-09-12T01:39:12.897053+0000","last_active":"2024-09-12T01:39:15.129155+0000","last_peered":"2024-09-12T01:39:15.129155+0000","last_clean":"2024-09-12T01:39:15.129155+0000","last_became_active":"2024-09-12T01:39:12.896613+0000","last_became_peered":"2024-09-12T01:39:12.896613+0000","last_unstale":"2024-09-12T01:39:15.129155+0000","last_undegraded":"2024-09-12T01:39:15.129155+0000","last_fullsized":"2024-09-12T01:39:15.129155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:22.437750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":278,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187214+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:39:15.187214+0000","last_peered":"2024-09-12T01:39:15.187214+0000","last_clean":"2024-09-12T01:39:15.187214+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:39:15.187214+0000","last_undegraded":"2024-09-12T01:39:15.187214+0000","last_fullsized":"2024-09-12T01:39:15.187214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":401627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":408529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":999871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":408531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":407857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1560576,"data_stored":992015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":978944,"data_stored":403191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":950272,"data_stored":394782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:39:19.877 INFO:tasks.ceph.mds.d.smithi105.stderr:2024-09-12T01:39:19.877+0000 7fa410361640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:39:21.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:39:21.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.416+0000 7f0336647640 1 Processor -- start 2024-09-12T01:39:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.416+0000 7f0336647640 1 -- start start 2024-09-12T01:39:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.417+0000 7f0336647640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f033006d540 0x7f03300cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.417+0000 7f0336647640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033006faf0 con 0x7f033015e950 2024-09-12T01:39:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.417+0000 7f0336647640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033006fdd0 con 0x7f03300735b0 2024-09-12T01:39:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.417+0000 7f0336647640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f03300700b0 con 0x7f033006d540 2024-09-12T01:39:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.417+0000 7f032f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f033006d540 0x7f03300cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.417+0000 7f032ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f033015e950 0x7f033006ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41882/0 (socket says 172.21.15.60:41882) 2024-09-12T01:39:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.417+0000 7f032ffff640 1 -- 172.21.15.60:0/1113777656 learned_addr learned my addr 172.21.15.60:0/1113777656 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.417+0000 7f032f7fe640 1 -- 172.21.15.60:0/1113777656 >> v1:172.21.15.105:6789/0 conn(0x7f03300735b0 legacy=0x7f03300cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.417+0000 7f032f7fe640 1 -- 172.21.15.60:0/1113777656 >> v1:172.21.15.60:6789/0 conn(0x7f033015e950 legacy=0x7f033006ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.418+0000 7f032f7fe640 1 -- 172.21.15.60:0/1113777656 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0330070390 con 0x7f033006d540 2024-09-12T01:39:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.418+0000 7f032f7fe640 1 --2- 172.21.15.60:0/1113777656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033006d540 0x7f03300cf0a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f03240097a0 tx=0x7f032402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d731589076ef3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.418+0000 7f032effd640 1 -- 172.21.15.60:0/1113777656 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0324037070 con 0x7f033006d540 2024-09-12T01:39:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.418+0000 7f032effd640 1 -- 172.21.15.60:0/1113777656 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0324032440 con 0x7f033006d540 2024-09-12T01:39:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.418+0000 7f032effd640 1 -- 172.21.15.60:0/1113777656 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0324032810 con 0x7f033006d540 2024-09-12T01:39:21.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.419+0000 7f0336647640 1 -- 172.21.15.60:0/1113777656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033006d540 msgr2=0x7f03300cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.419+0000 7f0336647640 1 --2- 172.21.15.60:0/1113777656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033006d540 0x7f03300cf0a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f03240097a0 tx=0x7f032402a230 comp rx=0 tx=0).stop 2024-09-12T01:39:21.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.419+0000 7f0336647640 1 -- 172.21.15.60:0/1113777656 shutdown_connections 2024-09-12T01:39:21.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.419+0000 7f0336647640 1 --2- 172.21.15.60:0/1113777656 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033006d540 0x7f03300cf0a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.419+0000 7f0336647640 1 -- 172.21.15.60:0/1113777656 >> 172.21.15.60:0/1113777656 conn(0x7f03300d14d0 msgr2=0x7f03300d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:21.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.419+0000 7f0336647640 1 -- 172.21.15.60:0/1113777656 shutdown_connections 2024-09-12T01:39:21.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.419+0000 7f0336647640 1 -- 172.21.15.60:0/1113777656 wait complete. 2024-09-12T01:39:21.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.420+0000 7f0336647640 1 Processor -- start 2024-09-12T01:39:21.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.421+0000 7f0336647640 1 -- start start 2024-09-12T01:39:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.421+0000 7f0336647640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f033006d540 0x7f0330147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.421+0000 7f0336647640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03300735b0 0x7f033015ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.421+0000 7f0336647640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033015e950 0x7f033015a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.421+0000 7f0336647640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f03300721d0 con 0x7f033015e950 2024-09-12T01:39:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.421+0000 7f0336647640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0330072050 con 0x7f03300735b0 2024-09-12T01:39:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.421+0000 7f0336647640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0330072350 con 0x7f033006d540 2024-09-12T01:39:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f0334be4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033015e950 0x7f033015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f0334be4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033015e950 0x7f033015a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41762/0 (socket says 172.21.15.60:41762) 2024-09-12T01:39:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f0334be4640 1 -- 172.21.15.60:0/1846628843 learned_addr learned my addr 172.21.15.60:0/1846628843 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f032ffff640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f033006d540 0x7f0330147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f032f7fe640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03300735b0 0x7f033015ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f0334be4640 1 -- 172.21.15.60:0/1846628843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f033006d540 msgr2=0x7f0330147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f0334be4640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f033006d540 0x7f0330147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f0334be4640 1 -- 172.21.15.60:0/1846628843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03300735b0 msgr2=0x7f033015ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f0334be4640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03300735b0 0x7f033015ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f0334be4640 1 -- 172.21.15.60:0/1846628843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033015f760 con 0x7f033015e950 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f0334be4640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033015e950 0x7f033015a290 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f032800c730 tx=0x7f032800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f032cff9640 1 -- 172.21.15.60:0/1846628843 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0328003b70 con 0x7f033015e950 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f032cff9640 1 -- 172.21.15.60:0/1846628843 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0328003d10 con 0x7f033015e950 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f032cff9640 1 -- 172.21.15.60:0/1846628843 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032800aa90 con 0x7f033015e950 2024-09-12T01:39:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f0336647640 1 -- 172.21.15.60:0/1846628843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033015fa40 con 0x7f033015e950 2024-09-12T01:39:21.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.422+0000 7f0336647640 1 -- 172.21.15.60:0/1846628843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0330160000 con 0x7f033015e950 2024-09-12T01:39:21.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.423+0000 7f0336647640 1 -- 172.21.15.60:0/1846628843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f033006ce30 con 0x7f033015e950 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.424+0000 7f032cff9640 1 -- 172.21.15.60:0/1846628843 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f032800ac30 con 0x7f033015e950 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.424+0000 7f032cff9640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f031c06be30 0x7f031c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.424+0000 7f032cff9640 1 -- 172.21.15.60:0/1846628843 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f032808ac50 con 0x7f033015e950 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.425+0000 7f032ffff640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f031c06be30 0x7f031c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.425+0000 7f032ffff640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f031c06be30 0x7f031c06e2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0320005880 tx=0x7f0320009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:21.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.429+0000 7f032cff9640 1 -- 172.21.15.60:0/1846628843 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0328090020 con 0x7f033015e950 2024-09-12T01:39:21.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.601+0000 7f0336647640 1 -- 172.21.15.60:0/1846628843 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03300d0ec0 con 0x7f031c06be30 2024-09-12T01:39:21.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.607+0000 7f032cff9640 1 -- 172.21.15.60:0/1846628843 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252084 (secure 0 0 0) 0x7f03300d0ec0 con 0x7f031c06be30 2024-09-12T01:39:21.608 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:39:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.610+0000 7f0336647640 1 -- 172.21.15.60:0/1846628843 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f031c06be30 msgr2=0x7f031c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.610+0000 7f0336647640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f031c06be30 0x7f031c06e2f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0320005880 tx=0x7f0320009040 comp rx=0 tx=0).stop 2024-09-12T01:39:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.610+0000 7f0336647640 1 -- 172.21.15.60:0/1846628843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033015e950 msgr2=0x7f033015a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.610+0000 7f0336647640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033015e950 0x7f033015a290 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f032800c730 tx=0x7f032800cbf0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.610+0000 7f0336647640 1 -- 172.21.15.60:0/1846628843 shutdown_connections 2024-09-12T01:39:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.610+0000 7f0336647640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f033015e950 0x7f033015a290 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.610+0000 7f0336647640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03300735b0 0x7f033015ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.610+0000 7f0336647640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f031c06be30 0x7f031c06e2f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.610+0000 7f0336647640 1 --2- 172.21.15.60:0/1846628843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f033006d540 0x7f0330147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.610+0000 7f0336647640 1 -- 172.21.15.60:0/1846628843 >> 172.21.15.60:0/1846628843 conn(0x7f03300d14d0 msgr2=0x7f03300b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.610+0000 7f0336647640 1 -- 172.21.15.60:0/1846628843 shutdown_connections 2024-09-12T01:39:21.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.610+0000 7f0336647640 1 -- 172.21.15.60:0/1846628843 wait complete. 2024-09-12T01:39:21.620 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-09-12T01:39:20.303204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":150,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":266652,"kb_used_data":8804,"kb_used_omap":12,"kb_used_meta":257651,"kb_avail":754708068,"statfs":{"total":773094113280,"available":772821061632,"internally_reserved":0,"allocated":9015296,"data_stored":4429512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":263835184},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.420896"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187288+0000","last_change":"2024-09-12T01:39:13.904548+0000","last_active":"2024-09-12T01:39:15.187288+0000","last_peered":"2024-09-12T01:39:15.187288+0000","last_clean":"2024-09-12T01:39:15.187288+0000","last_became_active":"2024-09-12T01:39:13.904009+0000","last_became_peered":"2024-09-12T01:39:13.904009+0000","last_unstale":"2024-09-12T01:39:15.187288+0000","last_undegraded":"2024-09-12T01:39:15.187288+0000","last_fullsized":"2024-09-12T01:39:15.187288+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:02.473545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907042+0000","last_change":"2024-09-12T01:39:13.892412+0000","last_active":"2024-09-12T01:39:14.907042+0000","last_peered":"2024-09-12T01:39:14.907042+0000","last_clean":"2024-09-12T01:39:14.907042+0000","last_became_active":"2024-09-12T01:39:13.892005+0000","last_became_peered":"2024-09-12T01:39:13.892005+0000","last_unstale":"2024-09-12T01:39:14.907042+0000","last_undegraded":"2024-09-12T01:39:14.907042+0000","last_fullsized":"2024-09-12T01:39:14.907042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:48.427091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903174+0000","last_change":"2024-09-12T01:39:13.904153+0000","last_active":"2024-09-12T01:39:14.903174+0000","last_peered":"2024-09-12T01:39:14.903174+0000","last_clean":"2024-09-12T01:39:14.903174+0000","last_became_active":"2024-09-12T01:39:13.903587+0000","last_became_peered":"2024-09-12T01:39:13.903587+0000","last_unstale":"2024-09-12T01:39:14.903174+0000","last_undegraded":"2024-09-12T01:39:14.903174+0000","last_fullsized":"2024-09-12T01:39:14.903174+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:08.179408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908266+0000","last_change":"2024-09-12T01:39:13.898785+0000","last_active":"2024-09-12T01:39:14.908266+0000","last_peered":"2024-09-12T01:39:14.908266+0000","last_clean":"2024-09-12T01:39:14.908266+0000","last_became_active":"2024-09-12T01:39:13.898498+0000","last_became_peered":"2024-09-12T01:39:13.898498+0000","last_unstale":"2024-09-12T01:39:14.908266+0000","last_undegraded":"2024-09-12T01:39:14.908266+0000","last_fullsized":"2024-09-12T01:39:14.908266+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:55.328047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128776+0000","last_change":"2024-09-12T01:39:13.900646+0000","last_active":"2024-09-12T01:39:15.128776+0000","last_peered":"2024-09-12T01:39:15.128776+0000","last_clean":"2024-09-12T01:39:15.128776+0000","last_became_active":"2024-09-12T01:39:13.899584+0000","last_became_peered":"2024-09-12T01:39:13.899584+0000","last_unstale":"2024-09-12T01:39:15.128776+0000","last_undegraded":"2024-09-12T01:39:15.128776+0000","last_fullsized":"2024-09-12T01:39:15.128776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:08.313862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902900+0000","last_change":"2024-09-12T01:39:13.897523+0000","last_active":"2024-09-12T01:39:14.902900+0000","last_peered":"2024-09-12T01:39:14.902900+0000","last_clean":"2024-09-12T01:39:14.902900+0000","last_became_active":"2024-09-12T01:39:13.897250+0000","last_became_peered":"2024-09-12T01:39:13.897250+0000","last_unstale":"2024-09-12T01:39:14.902900+0000","last_undegraded":"2024-09-12T01:39:14.902900+0000","last_fullsized":"2024-09-12T01:39:14.902900+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:03.256051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.906931+0000","last_change":"2024-09-12T01:39:13.894705+0000","last_active":"2024-09-12T01:39:14.906931+0000","last_peered":"2024-09-12T01:39:14.906931+0000","last_clean":"2024-09-12T01:39:14.906931+0000","last_became_active":"2024-09-12T01:39:13.893752+0000","last_became_peered":"2024-09-12T01:39:13.893752+0000","last_unstale":"2024-09-12T01:39:14.906931+0000","last_undegraded":"2024-09-12T01:39:14.906931+0000","last_fullsized":"2024-09-12T01:39:14.906931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:31.747276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187991+0000","last_change":"2024-09-12T01:39:13.910043+0000","last_active":"2024-09-12T01:39:15.187991+0000","last_peered":"2024-09-12T01:39:15.187991+0000","last_clean":"2024-09-12T01:39:15.187991+0000","last_became_active":"2024-09-12T01:39:13.909698+0000","last_became_peered":"2024-09-12T01:39:13.909698+0000","last_unstale":"2024-09-12T01:39:15.187991+0000","last_undegraded":"2024-09-12T01:39:15.187991+0000","last_fullsized":"2024-09-12T01:39:15.187991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:08.179408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187332+0000","last_change":"2024-09-12T01:39:13.903280+0000","last_active":"2024-09-12T01:39:15.187332+0000","last_peered":"2024-09-12T01:39:15.187332+0000","last_clean":"2024-09-12T01:39:15.187332+0000","last_became_active":"2024-09-12T01:39:13.902331+0000","last_became_peered":"2024-09-12T01:39:13.902331+0000","last_unstale":"2024-09-12T01:39:15.187332+0000","last_undegraded":"2024-09-12T01:39:15.187332+0000","last_fullsized":"2024-09-12T01:39:15.187332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:28.988150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903142+0000","last_change":"2024-09-12T01:39:13.895633+0000","last_active":"2024-09-12T01:39:14.903142+0000","last_peered":"2024-09-12T01:39:14.903142+0000","last_clean":"2024-09-12T01:39:14.903142+0000","last_became_active":"2024-09-12T01:39:13.895342+0000","last_became_peered":"2024-09-12T01:39:13.895342+0000","last_unstale":"2024-09-12T01:39:14.903142+0000","last_undegraded":"2024-09-12T01:39:14.903142+0000","last_fullsized":"2024-09-12T01:39:14.903142+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:44.878735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188188+0000","last_change":"2024-09-12T01:39:13.908537+0000","last_active":"2024-09-12T01:39:15.188188+0000","last_peered":"2024-09-12T01:39:15.188188+0000","last_clean":"2024-09-12T01:39:15.188188+0000","last_became_active":"2024-09-12T01:39:13.908193+0000","last_became_peered":"2024-09-12T01:39:13.908193+0000","last_unstale":"2024-09-12T01:39:15.188188+0000","last_undegraded":"2024-09-12T01:39:15.188188+0000","last_fullsized":"2024-09-12T01:39:15.188188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:50.638963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188087+0000","last_change":"2024-09-12T01:39:13.911076+0000","last_active":"2024-09-12T01:39:15.188087+0000","last_peered":"2024-09-12T01:39:15.188087+0000","last_clean":"2024-09-12T01:39:15.188087+0000","last_became_active":"2024-09-12T01:39:13.910824+0000","last_became_peered":"2024-09-12T01:39:13.910824+0000","last_unstale":"2024-09-12T01:39:15.188087+0000","last_undegraded":"2024-09-12T01:39:15.188087+0000","last_fullsized":"2024-09-12T01:39:15.188087+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:25.363826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128818+0000","last_change":"2024-09-12T01:39:13.904087+0000","last_active":"2024-09-12T01:39:15.128818+0000","last_peered":"2024-09-12T01:39:15.128818+0000","last_clean":"2024-09-12T01:39:15.128818+0000","last_became_active":"2024-09-12T01:39:13.903799+0000","last_became_peered":"2024-09-12T01:39:13.903799+0000","last_unstale":"2024-09-12T01:39:15.128818+0000","last_undegraded":"2024-09-12T01:39:15.128818+0000","last_fullsized":"2024-09-12T01:39:15.128818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:47.515101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187275+0000","last_change":"2024-09-12T01:39:13.897466+0000","last_active":"2024-09-12T01:39:15.187275+0000","last_peered":"2024-09-12T01:39:15.187275+0000","last_clean":"2024-09-12T01:39:15.187275+0000","last_became_active":"2024-09-12T01:39:13.897050+0000","last_became_peered":"2024-09-12T01:39:13.897050+0000","last_unstale":"2024-09-12T01:39:15.187275+0000","last_undegraded":"2024-09-12T01:39:15.187275+0000","last_fullsized":"2024-09-12T01:39:15.187275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:00.820023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.906878+0000","last_change":"2024-09-12T01:39:13.895667+0000","last_active":"2024-09-12T01:39:14.906878+0000","last_peered":"2024-09-12T01:39:14.906878+0000","last_clean":"2024-09-12T01:39:14.906878+0000","last_became_active":"2024-09-12T01:39:13.895398+0000","last_became_peered":"2024-09-12T01:39:13.895398+0000","last_unstale":"2024-09-12T01:39:14.906878+0000","last_undegraded":"2024-09-12T01:39:14.906878+0000","last_fullsized":"2024-09-12T01:39:14.906878+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:23.589648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902706+0000","last_change":"2024-09-12T01:39:13.895475+0000","last_active":"2024-09-12T01:39:14.902706+0000","last_peered":"2024-09-12T01:39:14.902706+0000","last_clean":"2024-09-12T01:39:14.902706+0000","last_became_active":"2024-09-12T01:39:13.894932+0000","last_became_peered":"2024-09-12T01:39:13.894932+0000","last_unstale":"2024-09-12T01:39:14.902706+0000","last_undegraded":"2024-09-12T01:39:14.902706+0000","last_fullsized":"2024-09-12T01:39:14.902706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.815960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187867+0000","last_change":"2024-09-12T01:39:13.911725+0000","last_active":"2024-09-12T01:39:15.187867+0000","last_peered":"2024-09-12T01:39:15.187867+0000","last_clean":"2024-09-12T01:39:15.187867+0000","last_became_active":"2024-09-12T01:39:13.911467+0000","last_became_peered":"2024-09-12T01:39:13.911467+0000","last_unstale":"2024-09-12T01:39:15.187867+0000","last_undegraded":"2024-09-12T01:39:15.187867+0000","last_fullsized":"2024-09-12T01:39:15.187867+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.891062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188053+0000","last_change":"2024-09-12T01:39:13.909003+0000","last_active":"2024-09-12T01:39:15.188053+0000","last_peered":"2024-09-12T01:39:15.188053+0000","last_clean":"2024-09-12T01:39:15.188053+0000","last_became_active":"2024-09-12T01:39:13.908524+0000","last_became_peered":"2024-09-12T01:39:13.908524+0000","last_unstale":"2024-09-12T01:39:15.188053+0000","last_undegraded":"2024-09-12T01:39:15.188053+0000","last_fullsized":"2024-09-12T01:39:15.188053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:33.298540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187966+0000","last_change":"2024-09-12T01:39:13.905486+0000","last_active":"2024-09-12T01:39:15.187966+0000","last_peered":"2024-09-12T01:39:15.187966+0000","last_clean":"2024-09-12T01:39:15.187966+0000","last_became_active":"2024-09-12T01:39:13.905182+0000","last_became_peered":"2024-09-12T01:39:13.905182+0000","last_unstale":"2024-09-12T01:39:15.187966+0000","last_undegraded":"2024-09-12T01:39:15.187966+0000","last_fullsized":"2024-09-12T01:39:15.187966+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:55.372979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187642+0000","last_change":"2024-09-12T01:39:13.897112+0000","last_active":"2024-09-12T01:39:15.187642+0000","last_peered":"2024-09-12T01:39:15.187642+0000","last_clean":"2024-09-12T01:39:15.187642+0000","last_became_active":"2024-09-12T01:39:13.896837+0000","last_became_peered":"2024-09-12T01:39:13.896837+0000","last_unstale":"2024-09-12T01:39:15.187642+0000","last_undegraded":"2024-09-12T01:39:15.187642+0000","last_fullsized":"2024-09-12T01:39:15.187642+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:03.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907959+0000","last_change":"2024-09-12T01:39:13.904696+0000","last_active":"2024-09-12T01:39:14.907959+0000","last_peered":"2024-09-12T01:39:14.907959+0000","last_clean":"2024-09-12T01:39:14.907959+0000","last_became_active":"2024-09-12T01:39:13.904425+0000","last_became_peered":"2024-09-12T01:39:13.904425+0000","last_unstale":"2024-09-12T01:39:14.907959+0000","last_undegraded":"2024-09-12T01:39:14.907959+0000","last_fullsized":"2024-09-12T01:39:14.907959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:05.731459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187483+0000","last_change":"2024-09-12T01:39:13.901168+0000","last_active":"2024-09-12T01:39:15.187483+0000","last_peered":"2024-09-12T01:39:15.187483+0000","last_clean":"2024-09-12T01:39:15.187483+0000","last_became_active":"2024-09-12T01:39:13.900885+0000","last_became_peered":"2024-09-12T01:39:13.900885+0000","last_unstale":"2024-09-12T01:39:15.187483+0000","last_undegraded":"2024-09-12T01:39:15.187483+0000","last_fullsized":"2024-09-12T01:39:15.187483+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:53.244610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187508+0000","last_change":"2024-09-12T01:39:13.910971+0000","last_active":"2024-09-12T01:39:15.187508+0000","last_peered":"2024-09-12T01:39:15.187508+0000","last_clean":"2024-09-12T01:39:15.187508+0000","last_became_active":"2024-09-12T01:39:13.910683+0000","last_became_peered":"2024-09-12T01:39:13.910683+0000","last_unstale":"2024-09-12T01:39:15.187508+0000","last_undegraded":"2024-09-12T01:39:15.187508+0000","last_fullsized":"2024-09-12T01:39:15.187508+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:55.097048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187458+0000","last_change":"2024-09-12T01:39:13.903528+0000","last_active":"2024-09-12T01:39:15.187458+0000","last_peered":"2024-09-12T01:39:15.187458+0000","last_clean":"2024-09-12T01:39:15.187458+0000","last_became_active":"2024-09-12T01:39:13.902574+0000","last_became_peered":"2024-09-12T01:39:13.902574+0000","last_unstale":"2024-09-12T01:39:15.187458+0000","last_undegraded":"2024-09-12T01:39:15.187458+0000","last_fullsized":"2024-09-12T01:39:15.187458+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.253305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188136+0000","last_change":"2024-09-12T01:39:13.914204+0000","last_active":"2024-09-12T01:39:15.188136+0000","last_peered":"2024-09-12T01:39:15.188136+0000","last_clean":"2024-09-12T01:39:15.188136+0000","last_became_active":"2024-09-12T01:39:13.913793+0000","last_became_peered":"2024-09-12T01:39:13.913793+0000","last_unstale":"2024-09-12T01:39:15.188136+0000","last_undegraded":"2024-09-12T01:39:15.188136+0000","last_fullsized":"2024-09-12T01:39:15.188136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:39.460105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129102+0000","last_change":"2024-09-12T01:39:13.904244+0000","last_active":"2024-09-12T01:39:15.129102+0000","last_peered":"2024-09-12T01:39:15.129102+0000","last_clean":"2024-09-12T01:39:15.129102+0000","last_became_active":"2024-09-12T01:39:13.903977+0000","last_became_peered":"2024-09-12T01:39:13.903977+0000","last_unstale":"2024-09-12T01:39:15.129102+0000","last_undegraded":"2024-09-12T01:39:15.129102+0000","last_fullsized":"2024-09-12T01:39:15.129102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:25.368830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129071+0000","last_change":"2024-09-12T01:39:13.898284+0000","last_active":"2024-09-12T01:39:15.129071+0000","last_peered":"2024-09-12T01:39:15.129071+0000","last_clean":"2024-09-12T01:39:15.129071+0000","last_became_active":"2024-09-12T01:39:13.898019+0000","last_became_peered":"2024-09-12T01:39:13.898019+0000","last_unstale":"2024-09-12T01:39:15.129071+0000","last_undegraded":"2024-09-12T01:39:15.129071+0000","last_fullsized":"2024-09-12T01:39:15.129071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:56.634633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187418+0000","last_change":"2024-09-12T01:39:13.905161+0000","last_active":"2024-09-12T01:39:15.187418+0000","last_peered":"2024-09-12T01:39:15.187418+0000","last_clean":"2024-09-12T01:39:15.187418+0000","last_became_active":"2024-09-12T01:39:13.902828+0000","last_became_peered":"2024-09-12T01:39:13.902828+0000","last_unstale":"2024-09-12T01:39:15.187418+0000","last_undegraded":"2024-09-12T01:39:15.187418+0000","last_fullsized":"2024-09-12T01:39:15.187418+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:48.165883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908214+0000","last_change":"2024-09-12T01:39:13.903914+0000","last_active":"2024-09-12T01:39:14.908214+0000","last_peered":"2024-09-12T01:39:14.908214+0000","last_clean":"2024-09-12T01:39:14.908214+0000","last_became_active":"2024-09-12T01:39:13.903632+0000","last_became_peered":"2024-09-12T01:39:13.903632+0000","last_unstale":"2024-09-12T01:39:14.908214+0000","last_undegraded":"2024-09-12T01:39:14.908214+0000","last_fullsized":"2024-09-12T01:39:14.908214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:41.271935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187447+0000","last_change":"2024-09-12T01:39:13.900164+0000","last_active":"2024-09-12T01:39:15.187447+0000","last_peered":"2024-09-12T01:39:15.187447+0000","last_clean":"2024-09-12T01:39:15.187447+0000","last_became_active":"2024-09-12T01:39:13.899484+0000","last_became_peered":"2024-09-12T01:39:13.899484+0000","last_unstale":"2024-09-12T01:39:15.187447+0000","last_undegraded":"2024-09-12T01:39:15.187447+0000","last_fullsized":"2024-09-12T01:39:15.187447+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:50.818822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902704+0000","last_change":"2024-09-12T01:39:13.894221+0000","last_active":"2024-09-12T01:39:14.902704+0000","last_peered":"2024-09-12T01:39:14.902704+0000","last_clean":"2024-09-12T01:39:14.902704+0000","last_became_active":"2024-09-12T01:39:13.893930+0000","last_became_peered":"2024-09-12T01:39:13.893930+0000","last_unstale":"2024-09-12T01:39:14.902704+0000","last_undegraded":"2024-09-12T01:39:14.902704+0000","last_fullsized":"2024-09-12T01:39:14.902704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:55.097048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902909+0000","last_change":"2024-09-12T01:39:13.894931+0000","last_active":"2024-09-12T01:39:14.902909+0000","last_peered":"2024-09-12T01:39:14.902909+0000","last_clean":"2024-09-12T01:39:14.902909+0000","last_became_active":"2024-09-12T01:39:13.894587+0000","last_became_peered":"2024-09-12T01:39:13.894587+0000","last_unstale":"2024-09-12T01:39:14.902909+0000","last_undegraded":"2024-09-12T01:39:14.902909+0000","last_fullsized":"2024-09-12T01:39:14.902909+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:56.121397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187568+0000","last_change":"2024-09-12T01:39:13.915079+0000","last_active":"2024-09-12T01:39:15.187568+0000","last_peered":"2024-09-12T01:39:15.187568+0000","last_clean":"2024-09-12T01:39:15.187568+0000","last_became_active":"2024-09-12T01:39:13.914761+0000","last_became_peered":"2024-09-12T01:39:13.914761+0000","last_unstale":"2024-09-12T01:39:15.187568+0000","last_undegraded":"2024-09-12T01:39:15.187568+0000","last_fullsized":"2024-09-12T01:39:15.187568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:32.815960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129105+0000","last_change":"2024-09-12T01:39:12.896630+0000","last_active":"2024-09-12T01:39:15.129105+0000","last_peered":"2024-09-12T01:39:15.129105+0000","last_clean":"2024-09-12T01:39:15.129105+0000","last_became_active":"2024-09-12T01:39:12.896343+0000","last_became_peered":"2024-09-12T01:39:12.896343+0000","last_unstale":"2024-09-12T01:39:15.129105+0000","last_undegraded":"2024-09-12T01:39:15.129105+0000","last_fullsized":"2024-09-12T01:39:15.129105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:40.029147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187440+0000","last_change":"2024-09-12T01:39:13.904295+0000","last_active":"2024-09-12T01:39:15.187440+0000","last_peered":"2024-09-12T01:39:15.187440+0000","last_clean":"2024-09-12T01:39:15.187440+0000","last_became_active":"2024-09-12T01:39:13.903604+0000","last_became_peered":"2024-09-12T01:39:13.903604+0000","last_unstale":"2024-09-12T01:39:15.187440+0000","last_undegraded":"2024-09-12T01:39:15.187440+0000","last_fullsized":"2024-09-12T01:39:15.187440+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:18.193470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903131+0000","last_change":"2024-09-12T01:39:12.896766+0000","last_active":"2024-09-12T01:39:14.903131+0000","last_peered":"2024-09-12T01:39:14.903131+0000","last_clean":"2024-09-12T01:39:14.903131+0000","last_became_active":"2024-09-12T01:39:12.896143+0000","last_became_peered":"2024-09-12T01:39:12.896143+0000","last_unstale":"2024-09-12T01:39:14.903131+0000","last_undegraded":"2024-09-12T01:39:14.903131+0000","last_fullsized":"2024-09-12T01:39:14.903131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:00.120318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188090+0000","last_change":"2024-09-12T01:39:13.914121+0000","last_active":"2024-09-12T01:39:15.188090+0000","last_peered":"2024-09-12T01:39:15.188090+0000","last_clean":"2024-09-12T01:39:15.188090+0000","last_became_active":"2024-09-12T01:39:13.913818+0000","last_became_peered":"2024-09-12T01:39:13.913818+0000","last_unstale":"2024-09-12T01:39:15.188090+0000","last_undegraded":"2024-09-12T01:39:15.188090+0000","last_fullsized":"2024-09-12T01:39:15.188090+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:20.834108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188191+0000","last_change":"2024-09-12T01:39:12.898592+0000","last_active":"2024-09-12T01:39:15.188191+0000","last_peered":"2024-09-12T01:39:15.188191+0000","last_clean":"2024-09-12T01:39:15.188191+0000","last_became_active":"2024-09-12T01:39:12.898312+0000","last_became_peered":"2024-09-12T01:39:12.898312+0000","last_unstale":"2024-09-12T01:39:15.188191+0000","last_undegraded":"2024-09-12T01:39:15.188191+0000","last_fullsized":"2024-09-12T01:39:15.188191+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:52.356993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187617+0000","last_change":"2024-09-12T01:39:13.912780+0000","last_active":"2024-09-12T01:39:15.187617+0000","last_peered":"2024-09-12T01:39:15.187617+0000","last_clean":"2024-09-12T01:39:15.187617+0000","last_became_active":"2024-09-12T01:39:13.912419+0000","last_became_peered":"2024-09-12T01:39:13.912419+0000","last_unstale":"2024-09-12T01:39:15.187617+0000","last_undegraded":"2024-09-12T01:39:15.187617+0000","last_fullsized":"2024-09-12T01:39:15.187617+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:38.977876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908254+0000","last_change":"2024-09-12T01:39:12.897577+0000","last_active":"2024-09-12T01:39:14.908254+0000","last_peered":"2024-09-12T01:39:14.908254+0000","last_clean":"2024-09-12T01:39:14.908254+0000","last_became_active":"2024-09-12T01:39:12.897230+0000","last_became_peered":"2024-09-12T01:39:12.897230+0000","last_unstale":"2024-09-12T01:39:14.908254+0000","last_undegraded":"2024-09-12T01:39:14.908254+0000","last_fullsized":"2024-09-12T01:39:14.908254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:55.116323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908050+0000","last_change":"2024-09-12T01:39:13.908787+0000","last_active":"2024-09-12T01:39:14.908050+0000","last_peered":"2024-09-12T01:39:14.908050+0000","last_clean":"2024-09-12T01:39:14.908050+0000","last_became_active":"2024-09-12T01:39:13.908549+0000","last_became_peered":"2024-09-12T01:39:13.908549+0000","last_unstale":"2024-09-12T01:39:14.908050+0000","last_undegraded":"2024-09-12T01:39:14.908050+0000","last_fullsized":"2024-09-12T01:39:14.908050+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:02.236054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187564+0000","last_change":"2024-09-12T01:39:12.899469+0000","last_active":"2024-09-12T01:39:15.187564+0000","last_peered":"2024-09-12T01:39:15.187564+0000","last_clean":"2024-09-12T01:39:15.187564+0000","last_became_active":"2024-09-12T01:39:12.899173+0000","last_became_peered":"2024-09-12T01:39:12.899173+0000","last_unstale":"2024-09-12T01:39:15.187564+0000","last_undegraded":"2024-09-12T01:39:15.187564+0000","last_fullsized":"2024-09-12T01:39:15.187564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:17.188396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902965+0000","last_change":"2024-09-12T01:39:13.900761+0000","last_active":"2024-09-12T01:39:14.902965+0000","last_peered":"2024-09-12T01:39:14.902965+0000","last_clean":"2024-09-12T01:39:14.902965+0000","last_became_active":"2024-09-12T01:39:13.900441+0000","last_became_peered":"2024-09-12T01:39:13.900441+0000","last_unstale":"2024-09-12T01:39:14.902965+0000","last_undegraded":"2024-09-12T01:39:14.902965+0000","last_fullsized":"2024-09-12T01:39:14.902965+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:32.891062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902865+0000","last_change":"2024-09-12T01:39:12.901743+0000","last_active":"2024-09-12T01:39:14.902865+0000","last_peered":"2024-09-12T01:39:14.902865+0000","last_clean":"2024-09-12T01:39:14.902865+0000","last_became_active":"2024-09-12T01:39:12.901418+0000","last_became_peered":"2024-09-12T01:39:12.901418+0000","last_unstale":"2024-09-12T01:39:14.902865+0000","last_undegraded":"2024-09-12T01:39:14.902865+0000","last_fullsized":"2024-09-12T01:39:14.902865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:27.983076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187162+0000","last_change":"2024-09-12T01:39:13.898011+0000","last_active":"2024-09-12T01:39:15.187162+0000","last_peered":"2024-09-12T01:39:15.187162+0000","last_clean":"2024-09-12T01:39:15.187162+0000","last_became_active":"2024-09-12T01:39:13.897644+0000","last_became_peered":"2024-09-12T01:39:13.897644+0000","last_unstale":"2024-09-12T01:39:15.187162+0000","last_undegraded":"2024-09-12T01:39:15.187162+0000","last_fullsized":"2024-09-12T01:39:15.187162+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:03.598116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187381+0000","last_change":"2024-09-12T01:39:12.901437+0000","last_active":"2024-09-12T01:39:15.187381+0000","last_peered":"2024-09-12T01:39:15.187381+0000","last_clean":"2024-09-12T01:39:15.187381+0000","last_became_active":"2024-09-12T01:39:12.901120+0000","last_became_peered":"2024-09-12T01:39:12.901120+0000","last_unstale":"2024-09-12T01:39:15.187381+0000","last_undegraded":"2024-09-12T01:39:15.187381+0000","last_fullsized":"2024-09-12T01:39:15.187381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:18.265444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187431+0000","last_change":"2024-09-12T01:39:13.896873+0000","last_active":"2024-09-12T01:39:15.187431+0000","last_peered":"2024-09-12T01:39:15.187431+0000","last_clean":"2024-09-12T01:39:15.187431+0000","last_became_active":"2024-09-12T01:39:13.896578+0000","last_became_peered":"2024-09-12T01:39:13.896578+0000","last_unstale":"2024-09-12T01:39:15.187431+0000","last_undegraded":"2024-09-12T01:39:15.187431+0000","last_fullsized":"2024-09-12T01:39:15.187431+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:53.362068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187132+0000","last_change":"2024-09-12T01:39:12.903658+0000","last_active":"2024-09-12T01:39:15.187132+0000","last_peered":"2024-09-12T01:39:15.187132+0000","last_clean":"2024-09-12T01:39:15.187132+0000","last_became_active":"2024-09-12T01:39:12.903455+0000","last_became_peered":"2024-09-12T01:39:12.903455+0000","last_unstale":"2024-09-12T01:39:15.187132+0000","last_undegraded":"2024-09-12T01:39:15.187132+0000","last_fullsized":"2024-09-12T01:39:15.187132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:07.523595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187442+0000","last_change":"2024-09-12T01:39:13.906892+0000","last_active":"2024-09-12T01:39:15.187442+0000","last_peered":"2024-09-12T01:39:15.187442+0000","last_clean":"2024-09-12T01:39:15.187442+0000","last_became_active":"2024-09-12T01:39:13.906624+0000","last_became_peered":"2024-09-12T01:39:13.906624+0000","last_unstale":"2024-09-12T01:39:15.187442+0000","last_undegraded":"2024-09-12T01:39:15.187442+0000","last_fullsized":"2024-09-12T01:39:15.187442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:16.212505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187700+0000","last_change":"2024-09-12T01:39:12.898372+0000","last_active":"2024-09-12T01:39:15.187700+0000","last_peered":"2024-09-12T01:39:15.187700+0000","last_clean":"2024-09-12T01:39:15.187700+0000","last_became_active":"2024-09-12T01:39:12.898048+0000","last_became_peered":"2024-09-12T01:39:12.898048+0000","last_unstale":"2024-09-12T01:39:15.187700+0000","last_undegraded":"2024-09-12T01:39:15.187700+0000","last_fullsized":"2024-09-12T01:39:15.187700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:37.700774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187604+0000","last_change":"2024-09-12T01:39:13.913892+0000","last_active":"2024-09-12T01:39:15.187604+0000","last_peered":"2024-09-12T01:39:15.187604+0000","last_clean":"2024-09-12T01:39:15.187604+0000","last_became_active":"2024-09-12T01:39:13.913473+0000","last_became_peered":"2024-09-12T01:39:13.913473+0000","last_unstale":"2024-09-12T01:39:15.187604+0000","last_undegraded":"2024-09-12T01:39:15.187604+0000","last_fullsized":"2024-09-12T01:39:15.187604+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:31.253305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903236+0000","last_change":"2024-09-12T01:39:12.897002+0000","last_active":"2024-09-12T01:39:14.903236+0000","last_peered":"2024-09-12T01:39:14.903236+0000","last_clean":"2024-09-12T01:39:14.903236+0000","last_became_active":"2024-09-12T01:39:12.896502+0000","last_became_peered":"2024-09-12T01:39:12.896502+0000","last_unstale":"2024-09-12T01:39:14.903236+0000","last_undegraded":"2024-09-12T01:39:14.903236+0000","last_fullsized":"2024-09-12T01:39:14.903236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:37.972801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187824+0000","last_change":"2024-09-12T01:39:13.914328+0000","last_active":"2024-09-12T01:39:15.187824+0000","last_peered":"2024-09-12T01:39:15.187824+0000","last_clean":"2024-09-12T01:39:15.187824+0000","last_became_active":"2024-09-12T01:39:13.914055+0000","last_became_peered":"2024-09-12T01:39:13.914055+0000","last_unstale":"2024-09-12T01:39:15.187824+0000","last_undegraded":"2024-09-12T01:39:15.187824+0000","last_fullsized":"2024-09-12T01:39:15.187824+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:54.539029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187798+0000","last_change":"2024-09-12T01:39:12.895761+0000","last_active":"2024-09-12T01:39:15.187798+0000","last_peered":"2024-09-12T01:39:15.187798+0000","last_clean":"2024-09-12T01:39:15.187798+0000","last_became_active":"2024-09-12T01:39:12.895469+0000","last_became_peered":"2024-09-12T01:39:12.895469+0000","last_unstale":"2024-09-12T01:39:15.187798+0000","last_undegraded":"2024-09-12T01:39:15.187798+0000","last_fullsized":"2024-09-12T01:39:15.187798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:22.438077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129042+0000","last_change":"2024-09-12T01:39:13.912400+0000","last_active":"2024-09-12T01:39:15.129042+0000","last_peered":"2024-09-12T01:39:15.129042+0000","last_clean":"2024-09-12T01:39:15.129042+0000","last_became_active":"2024-09-12T01:39:13.912154+0000","last_became_peered":"2024-09-12T01:39:13.912154+0000","last_unstale":"2024-09-12T01:39:15.129042+0000","last_undegraded":"2024-09-12T01:39:15.129042+0000","last_fullsized":"2024-09-12T01:39:15.129042+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:36.874197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"79'6","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188153+0000","last_change":"2024-09-12T01:39:12.898516+0000","last_active":"2024-09-12T01:39:15.188153+0000","last_peered":"2024-09-12T01:39:15.188153+0000","last_clean":"2024-09-12T01:39:15.188153+0000","last_became_active":"2024-09-12T01:39:12.898169+0000","last_became_peered":"2024-09-12T01:39:12.898169+0000","last_unstale":"2024-09-12T01:39:15.188153+0000","last_undegraded":"2024-09-12T01:39:15.188153+0000","last_fullsized":"2024-09-12T01:39:15.188153+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:00.120318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187751+0000","last_change":"2024-09-12T01:39:13.907928+0000","last_active":"2024-09-12T01:39:15.187751+0000","last_peered":"2024-09-12T01:39:15.187751+0000","last_clean":"2024-09-12T01:39:15.187751+0000","last_became_active":"2024-09-12T01:39:13.907637+0000","last_became_peered":"2024-09-12T01:39:13.907637+0000","last_unstale":"2024-09-12T01:39:15.187751+0000","last_undegraded":"2024-09-12T01:39:15.187751+0000","last_fullsized":"2024-09-12T01:39:15.187751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:36.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.908265+0000","last_change":"2024-09-12T01:39:12.896500+0000","last_active":"2024-09-12T01:39:14.908265+0000","last_peered":"2024-09-12T01:39:14.908265+0000","last_clean":"2024-09-12T01:39:14.908265+0000","last_became_active":"2024-09-12T01:39:12.896204+0000","last_became_peered":"2024-09-12T01:39:12.896204+0000","last_unstale":"2024-09-12T01:39:14.908265+0000","last_undegraded":"2024-09-12T01:39:14.908265+0000","last_fullsized":"2024-09-12T01:39:14.908265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:31.885987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187726+0000","last_change":"2024-09-12T01:39:13.911848+0000","last_active":"2024-09-12T01:39:15.187726+0000","last_peered":"2024-09-12T01:39:15.187726+0000","last_clean":"2024-09-12T01:39:15.187726+0000","last_became_active":"2024-09-12T01:39:13.911578+0000","last_became_peered":"2024-09-12T01:39:13.911578+0000","last_unstale":"2024-09-12T01:39:15.187726+0000","last_undegraded":"2024-09-12T01:39:15.187726+0000","last_fullsized":"2024-09-12T01:39:15.187726+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:36.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.906857+0000","last_change":"2024-09-12T01:39:12.894877+0000","last_active":"2024-09-12T01:39:14.906857+0000","last_peered":"2024-09-12T01:39:14.906857+0000","last_clean":"2024-09-12T01:39:14.906857+0000","last_became_active":"2024-09-12T01:39:12.894584+0000","last_became_peered":"2024-09-12T01:39:12.894584+0000","last_unstale":"2024-09-12T01:39:14.906857+0000","last_undegraded":"2024-09-12T01:39:14.906857+0000","last_fullsized":"2024-09-12T01:39:14.906857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:46.092057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187238+0000","last_change":"2024-09-12T01:39:13.898011+0000","last_active":"2024-09-12T01:39:15.187238+0000","last_peered":"2024-09-12T01:39:15.187238+0000","last_clean":"2024-09-12T01:39:15.187238+0000","last_became_active":"2024-09-12T01:39:13.897749+0000","last_became_peered":"2024-09-12T01:39:13.897749+0000","last_unstale":"2024-09-12T01:39:15.187238+0000","last_undegraded":"2024-09-12T01:39:15.187238+0000","last_fullsized":"2024-09-12T01:39:15.187238+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:24.935008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902705+0000","last_change":"2024-09-12T01:39:12.895196+0000","last_active":"2024-09-12T01:39:14.902705+0000","last_peered":"2024-09-12T01:39:14.902705+0000","last_clean":"2024-09-12T01:39:14.902705+0000","last_became_active":"2024-09-12T01:39:12.894890+0000","last_became_peered":"2024-09-12T01:39:12.894890+0000","last_unstale":"2024-09-12T01:39:14.902705+0000","last_undegraded":"2024-09-12T01:39:14.902705+0000","last_fullsized":"2024-09-12T01:39:14.902705+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:47.160808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187452+0000","last_change":"2024-09-12T01:39:13.906691+0000","last_active":"2024-09-12T01:39:15.187452+0000","last_peered":"2024-09-12T01:39:15.187452+0000","last_clean":"2024-09-12T01:39:15.187452+0000","last_became_active":"2024-09-12T01:39:13.906346+0000","last_became_peered":"2024-09-12T01:39:13.906346+0000","last_unstale":"2024-09-12T01:39:15.187452+0000","last_undegraded":"2024-09-12T01:39:15.187452+0000","last_fullsized":"2024-09-12T01:39:15.187452+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:38.977876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"79'8","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187582+0000","last_change":"2024-09-12T01:39:12.892882+0000","last_active":"2024-09-12T01:39:15.187582+0000","last_peered":"2024-09-12T01:39:15.187582+0000","last_clean":"2024-09-12T01:39:15.187582+0000","last_became_active":"2024-09-12T01:39:12.892533+0000","last_became_peered":"2024-09-12T01:39:12.892533+0000","last_unstale":"2024-09-12T01:39:15.187582+0000","last_undegraded":"2024-09-12T01:39:15.187582+0000","last_fullsized":"2024-09-12T01:39:15.187582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:59.814949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187723+0000","last_change":"2024-09-12T01:39:13.916960+0000","last_active":"2024-09-12T01:39:15.187723+0000","last_peered":"2024-09-12T01:39:15.187723+0000","last_clean":"2024-09-12T01:39:15.187723+0000","last_became_active":"2024-09-12T01:39:13.916569+0000","last_became_peered":"2024-09-12T01:39:13.916569+0000","last_unstale":"2024-09-12T01:39:15.187723+0000","last_undegraded":"2024-09-12T01:39:15.187723+0000","last_fullsized":"2024-09-12T01:39:15.187723+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:56.121397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129266+0000","last_change":"2024-09-12T01:39:12.895948+0000","last_active":"2024-09-12T01:39:15.129266+0000","last_peered":"2024-09-12T01:39:15.129266+0000","last_clean":"2024-09-12T01:39:15.129266+0000","last_became_active":"2024-09-12T01:39:12.895645+0000","last_became_peered":"2024-09-12T01:39:12.895645+0000","last_unstale":"2024-09-12T01:39:15.129266+0000","last_undegraded":"2024-09-12T01:39:15.129266+0000","last_fullsized":"2024-09-12T01:39:15.129266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:27.105186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903397+0000","last_change":"2024-09-12T01:39:13.895212+0000","last_active":"2024-09-12T01:39:14.903397+0000","last_peered":"2024-09-12T01:39:14.903397+0000","last_clean":"2024-09-12T01:39:14.903397+0000","last_became_active":"2024-09-12T01:39:13.894887+0000","last_became_peered":"2024-09-12T01:39:13.894887+0000","last_unstale":"2024-09-12T01:39:14.903397+0000","last_undegraded":"2024-09-12T01:39:14.903397+0000","last_fullsized":"2024-09-12T01:39:14.903397+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:25.363826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187893+0000","last_change":"2024-09-12T01:39:12.900345+0000","last_active":"2024-09-12T01:39:15.187893+0000","last_peered":"2024-09-12T01:39:15.187893+0000","last_clean":"2024-09-12T01:39:15.187893+0000","last_became_active":"2024-09-12T01:39:12.900043+0000","last_became_peered":"2024-09-12T01:39:12.900043+0000","last_unstale":"2024-09-12T01:39:15.187893+0000","last_undegraded":"2024-09-12T01:39:15.187893+0000","last_fullsized":"2024-09-12T01:39:15.187893+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:46.990181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187995+0000","last_change":"2024-09-12T01:39:13.915910+0000","last_active":"2024-09-12T01:39:15.187995+0000","last_peered":"2024-09-12T01:39:15.187995+0000","last_clean":"2024-09-12T01:39:15.187995+0000","last_became_active":"2024-09-12T01:39:13.915569+0000","last_became_peered":"2024-09-12T01:39:13.915569+0000","last_unstale":"2024-09-12T01:39:15.187995+0000","last_undegraded":"2024-09-12T01:39:15.187995+0000","last_fullsized":"2024-09-12T01:39:15.187995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:44.878735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187677+0000","last_change":"2024-09-12T01:39:12.900655+0000","last_active":"2024-09-12T01:39:15.187677+0000","last_peered":"2024-09-12T01:39:15.187677+0000","last_clean":"2024-09-12T01:39:15.187677+0000","last_became_active":"2024-09-12T01:39:12.900298+0000","last_became_peered":"2024-09-12T01:39:12.900298+0000","last_unstale":"2024-09-12T01:39:15.187677+0000","last_undegraded":"2024-09-12T01:39:15.187677+0000","last_fullsized":"2024-09-12T01:39:15.187677+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:56.792978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.906912+0000","last_change":"2024-09-12T01:39:13.903300+0000","last_active":"2024-09-12T01:39:14.906912+0000","last_peered":"2024-09-12T01:39:14.906912+0000","last_clean":"2024-09-12T01:39:14.906912+0000","last_became_active":"2024-09-12T01:39:13.903007+0000","last_became_peered":"2024-09-12T01:39:13.903007+0000","last_unstale":"2024-09-12T01:39:14.906912+0000","last_undegraded":"2024-09-12T01:39:14.906912+0000","last_fullsized":"2024-09-12T01:39:14.906912+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:23.882976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187593+0000","last_change":"2024-09-12T01:39:12.899244+0000","last_active":"2024-09-12T01:39:15.187593+0000","last_peered":"2024-09-12T01:39:15.187593+0000","last_clean":"2024-09-12T01:39:15.187593+0000","last_became_active":"2024-09-12T01:39:12.898773+0000","last_became_peered":"2024-09-12T01:39:12.898773+0000","last_unstale":"2024-09-12T01:39:15.187593+0000","last_undegraded":"2024-09-12T01:39:15.187593+0000","last_fullsized":"2024-09-12T01:39:15.187593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:32.656288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128927+0000","last_change":"2024-09-12T01:39:13.908672+0000","last_active":"2024-09-12T01:39:15.128927+0000","last_peered":"2024-09-12T01:39:15.128927+0000","last_clean":"2024-09-12T01:39:15.128927+0000","last_became_active":"2024-09-12T01:39:13.908365+0000","last_became_peered":"2024-09-12T01:39:13.908365+0000","last_unstale":"2024-09-12T01:39:15.128927+0000","last_undegraded":"2024-09-12T01:39:15.128927+0000","last_fullsized":"2024-09-12T01:39:15.128927+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:00:28.239676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907032+0000","last_change":"2024-09-12T01:39:12.897940+0000","last_active":"2024-09-12T01:39:14.907032+0000","last_peered":"2024-09-12T01:39:14.907032+0000","last_clean":"2024-09-12T01:39:14.907032+0000","last_became_active":"2024-09-12T01:39:12.897617+0000","last_became_peered":"2024-09-12T01:39:12.897617+0000","last_unstale":"2024-09-12T01:39:14.907032+0000","last_undegraded":"2024-09-12T01:39:14.907032+0000","last_fullsized":"2024-09-12T01:39:14.907032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:44.739305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907757+0000","last_change":"2024-09-12T01:39:13.908088+0000","last_active":"2024-09-12T01:39:14.907757+0000","last_peered":"2024-09-12T01:39:14.907757+0000","last_clean":"2024-09-12T01:39:14.907757+0000","last_became_active":"2024-09-12T01:39:13.907807+0000","last_became_peered":"2024-09-12T01:39:13.907807+0000","last_unstale":"2024-09-12T01:39:14.907757+0000","last_undegraded":"2024-09-12T01:39:14.907757+0000","last_fullsized":"2024-09-12T01:39:14.907757+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:58.775933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187702+0000","last_change":"2024-09-12T01:39:12.892007+0000","last_active":"2024-09-12T01:39:15.187702+0000","last_peered":"2024-09-12T01:39:15.187702+0000","last_clean":"2024-09-12T01:39:15.187702+0000","last_became_active":"2024-09-12T01:39:12.891744+0000","last_became_peered":"2024-09-12T01:39:12.891744+0000","last_unstale":"2024-09-12T01:39:15.187702+0000","last_undegraded":"2024-09-12T01:39:15.187702+0000","last_fullsized":"2024-09-12T01:39:15.187702+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:15.207430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187658+0000","last_change":"2024-09-12T01:39:13.913157+0000","last_active":"2024-09-12T01:39:15.187658+0000","last_peered":"2024-09-12T01:39:15.187658+0000","last_clean":"2024-09-12T01:39:15.187658+0000","last_became_active":"2024-09-12T01:39:13.912881+0000","last_became_peered":"2024-09-12T01:39:13.912881+0000","last_unstale":"2024-09-12T01:39:15.187658+0000","last_undegraded":"2024-09-12T01:39:15.187658+0000","last_fullsized":"2024-09-12T01:39:15.187658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:03.256051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187393+0000","last_change":"2024-09-12T01:39:12.897776+0000","last_active":"2024-09-12T01:39:15.187393+0000","last_peered":"2024-09-12T01:39:15.187393+0000","last_clean":"2024-09-12T01:39:15.187393+0000","last_became_active":"2024-09-12T01:39:12.897527+0000","last_became_peered":"2024-09-12T01:39:12.897527+0000","last_unstale":"2024-09-12T01:39:15.187393+0000","last_undegraded":"2024-09-12T01:39:15.187393+0000","last_fullsized":"2024-09-12T01:39:15.187393+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:29.855267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129181+0000","last_change":"2024-09-12T01:39:13.900476+0000","last_active":"2024-09-12T01:39:15.129181+0000","last_peered":"2024-09-12T01:39:15.129181+0000","last_clean":"2024-09-12T01:39:15.129181+0000","last_became_active":"2024-09-12T01:39:13.900204+0000","last_became_peered":"2024-09-12T01:39:13.900204+0000","last_unstale":"2024-09-12T01:39:15.129181+0000","last_undegraded":"2024-09-12T01:39:15.129181+0000","last_fullsized":"2024-09-12T01:39:15.129181+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:41.140743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187678+0000","last_change":"2024-09-12T01:39:12.904275+0000","last_active":"2024-09-12T01:39:15.187678+0000","last_peered":"2024-09-12T01:39:15.187678+0000","last_clean":"2024-09-12T01:39:15.187678+0000","last_became_active":"2024-09-12T01:39:12.904028+0000","last_became_peered":"2024-09-12T01:39:12.904028+0000","last_unstale":"2024-09-12T01:39:15.187678+0000","last_undegraded":"2024-09-12T01:39:15.187678+0000","last_fullsized":"2024-09-12T01:39:15.187678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:27.433076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129064+0000","last_change":"2024-09-12T01:39:13.912165+0000","last_active":"2024-09-12T01:39:15.129064+0000","last_peered":"2024-09-12T01:39:15.129064+0000","last_clean":"2024-09-12T01:39:15.129064+0000","last_became_active":"2024-09-12T01:39:13.911869+0000","last_became_peered":"2024-09-12T01:39:13.911869+0000","last_unstale":"2024-09-12T01:39:15.129064+0000","last_undegraded":"2024-09-12T01:39:15.129064+0000","last_fullsized":"2024-09-12T01:39:15.129064+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:43.619413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187997+0000","last_change":"2024-09-12T01:39:12.890030+0000","last_active":"2024-09-12T01:39:15.187997+0000","last_peered":"2024-09-12T01:39:15.187997+0000","last_clean":"2024-09-12T01:39:15.187997+0000","last_became_active":"2024-09-12T01:39:12.889687+0000","last_became_peered":"2024-09-12T01:39:12.889687+0000","last_unstale":"2024-09-12T01:39:15.187997+0000","last_undegraded":"2024-09-12T01:39:15.187997+0000","last_fullsized":"2024-09-12T01:39:15.187997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:49.813748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.128984+0000","last_change":"2024-09-12T01:39:13.902776+0000","last_active":"2024-09-12T01:39:15.128984+0000","last_peered":"2024-09-12T01:39:15.128984+0000","last_clean":"2024-09-12T01:39:15.128984+0000","last_became_active":"2024-09-12T01:39:13.902502+0000","last_became_peered":"2024-09-12T01:39:13.902502+0000","last_unstale":"2024-09-12T01:39:15.128984+0000","last_undegraded":"2024-09-12T01:39:15.128984+0000","last_fullsized":"2024-09-12T01:39:15.128984+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:01.168363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.188042+0000","last_change":"2024-09-12T01:39:12.900224+0000","last_active":"2024-09-12T01:39:15.188042+0000","last_peered":"2024-09-12T01:39:15.188042+0000","last_clean":"2024-09-12T01:39:15.188042+0000","last_became_active":"2024-09-12T01:39:12.899905+0000","last_became_peered":"2024-09-12T01:39:12.899905+0000","last_unstale":"2024-09-12T01:39:15.188042+0000","last_undegraded":"2024-09-12T01:39:15.188042+0000","last_fullsized":"2024-09-12T01:39:15.188042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:30.248231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.903170+0000","last_change":"2024-09-12T01:39:13.903873+0000","last_active":"2024-09-12T01:39:14.903170+0000","last_peered":"2024-09-12T01:39:14.903170+0000","last_clean":"2024-09-12T01:39:14.903170+0000","last_became_active":"2024-09-12T01:39:13.902665+0000","last_became_peered":"2024-09-12T01:39:13.902665+0000","last_unstale":"2024-09-12T01:39:14.903170+0000","last_undegraded":"2024-09-12T01:39:14.903170+0000","last_fullsized":"2024-09-12T01:39:14.903170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:10:20.834108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902828+0000","last_change":"2024-09-12T01:39:12.900941+0000","last_active":"2024-09-12T01:39:14.902828+0000","last_peered":"2024-09-12T01:39:14.902828+0000","last_clean":"2024-09-12T01:39:14.902828+0000","last_became_active":"2024-09-12T01:39:12.900582+0000","last_became_peered":"2024-09-12T01:39:12.900582+0000","last_unstale":"2024-09-12T01:39:14.902828+0000","last_undegraded":"2024-09-12T01:39:14.902828+0000","last_fullsized":"2024-09-12T01:39:14.902828+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:17.188396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187305+0000","last_change":"2024-09-12T01:39:13.906501+0000","last_active":"2024-09-12T01:39:15.187305+0000","last_peered":"2024-09-12T01:39:15.187305+0000","last_clean":"2024-09-12T01:39:15.187305+0000","last_became_active":"2024-09-12T01:39:13.905251+0000","last_became_peered":"2024-09-12T01:39:13.905251+0000","last_unstale":"2024-09-12T01:39:15.187305+0000","last_undegraded":"2024-09-12T01:39:15.187305+0000","last_fullsized":"2024-09-12T01:39:15.187305+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:12.012554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.907062+0000","last_change":"2024-09-12T01:39:12.896423+0000","last_active":"2024-09-12T01:39:14.907062+0000","last_peered":"2024-09-12T01:39:14.907062+0000","last_clean":"2024-09-12T01:39:14.907062+0000","last_became_active":"2024-09-12T01:39:12.896163+0000","last_became_peered":"2024-09-12T01:39:12.896163+0000","last_unstale":"2024-09-12T01:39:14.907062+0000","last_undegraded":"2024-09-12T01:39:14.907062+0000","last_fullsized":"2024-09-12T01:39:14.907062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:37.792116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187808+0000","last_change":"2024-09-12T01:39:13.906963+0000","last_active":"2024-09-12T01:39:15.187808+0000","last_peered":"2024-09-12T01:39:15.187808+0000","last_clean":"2024-09-12T01:39:15.187808+0000","last_became_active":"2024-09-12T01:39:13.906272+0000","last_became_peered":"2024-09-12T01:39:13.906272+0000","last_unstale":"2024-09-12T01:39:15.187808+0000","last_undegraded":"2024-09-12T01:39:15.187808+0000","last_fullsized":"2024-09-12T01:39:15.187808+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:26.904998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:14.902944+0000","last_change":"2024-09-12T01:39:12.902567+0000","last_active":"2024-09-12T01:39:14.902944+0000","last_peered":"2024-09-12T01:39:14.902944+0000","last_clean":"2024-09-12T01:39:14.902944+0000","last_became_active":"2024-09-12T01:39:12.902261+0000","last_became_peered":"2024-09-12T01:39:12.902261+0000","last_unstale":"2024-09-12T01:39:14.902944+0000","last_undegraded":"2024-09-12T01:39:14.902944+0000","last_fullsized":"2024-09-12T01:39:14.902944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:30.248231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187175+0000","last_change":"2024-09-12T01:39:13.903016+0000","last_active":"2024-09-12T01:39:15.187175+0000","last_peered":"2024-09-12T01:39:15.187175+0000","last_clean":"2024-09-12T01:39:15.187175+0000","last_became_active":"2024-09-12T01:39:13.902740+0000","last_became_peered":"2024-09-12T01:39:13.902740+0000","last_unstale":"2024-09-12T01:39:15.187175+0000","last_undegraded":"2024-09-12T01:39:15.187175+0000","last_fullsized":"2024-09-12T01:39:15.187175+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:55.372979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187123+0000","last_change":"2024-09-12T01:39:12.896200+0000","last_active":"2024-09-12T01:39:15.187123+0000","last_peered":"2024-09-12T01:39:15.187123+0000","last_clean":"2024-09-12T01:39:15.187123+0000","last_became_active":"2024-09-12T01:39:12.895937+0000","last_became_peered":"2024-09-12T01:39:12.895937+0000","last_unstale":"2024-09-12T01:39:15.187123+0000","last_undegraded":"2024-09-12T01:39:15.187123+0000","last_fullsized":"2024-09-12T01:39:15.187123+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:16.330008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187586+0000","last_change":"2024-09-12T01:39:13.905333+0000","last_active":"2024-09-12T01:39:15.187586+0000","last_peered":"2024-09-12T01:39:15.187586+0000","last_clean":"2024-09-12T01:39:15.187586+0000","last_became_active":"2024-09-12T01:39:13.904982+0000","last_became_peered":"2024-09-12T01:39:13.904982+0000","last_unstale":"2024-09-12T01:39:15.187586+0000","last_undegraded":"2024-09-12T01:39:15.187586+0000","last_fullsized":"2024-09-12T01:39:15.187586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:01.125393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187933+0000","last_change":"2024-09-12T01:39:12.897786+0000","last_active":"2024-09-12T01:39:15.187933+0000","last_peered":"2024-09-12T01:39:15.187933+0000","last_clean":"2024-09-12T01:39:15.187933+0000","last_became_active":"2024-09-12T01:39:12.897384+0000","last_became_peered":"2024-09-12T01:39:12.897384+0000","last_unstale":"2024-09-12T01:39:15.187933+0000","last_undegraded":"2024-09-12T01:39:15.187933+0000","last_fullsized":"2024-09-12T01:39:15.187933+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:37.972801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187951+0000","last_change":"2024-09-12T01:39:13.915042+0000","last_active":"2024-09-12T01:39:15.187951+0000","last_peered":"2024-09-12T01:39:15.187951+0000","last_clean":"2024-09-12T01:39:15.187951+0000","last_became_active":"2024-09-12T01:39:13.914403+0000","last_became_peered":"2024-09-12T01:39:13.914403+0000","last_unstale":"2024-09-12T01:39:15.187951+0000","last_undegraded":"2024-09-12T01:39:15.187951+0000","last_fullsized":"2024-09-12T01:39:15.187951+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:12.876977+0000","last_clean_scrub_stamp":"2024-09-12T01:39:12.876977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:54.227036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.129155+0000","last_change":"2024-09-12T01:39:12.897053+0000","last_active":"2024-09-12T01:39:15.129155+0000","last_peered":"2024-09-12T01:39:15.129155+0000","last_clean":"2024-09-12T01:39:15.129155+0000","last_became_active":"2024-09-12T01:39:12.896613+0000","last_became_peered":"2024-09-12T01:39:12.896613+0000","last_unstale":"2024-09-12T01:39:15.129155+0000","last_undegraded":"2024-09-12T01:39:15.129155+0000","last_fullsized":"2024-09-12T01:39:15.129155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:39:11.871903+0000","last_clean_scrub_stamp":"2024-09-12T01:39:11.871903+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:22.437750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":278,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-12T01:39:15.187214+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:39:15.187214+0000","last_peered":"2024-09-12T01:39:15.187214+0000","last_clean":"2024-09-12T01:39:15.187214+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:39:15.187214+0000","last_undegraded":"2024-09-12T01:39:15.187214+0000","last_fullsized":"2024-09-12T01:39:15.187214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509487,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":401627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":983040,"data_stored":408529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509485,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32736,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1585152,"data_stored":999871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509485,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36316,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335524,"statfs":{"total":96636764160,"available":96599576576,"internally_reserved":0,"allocated":987136,"data_stored":408531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":407857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509485,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1560576,"data_stored":992015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509486,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":978944,"data_stored":403191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":978944,"data_stored":407891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:39:21.624 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:39:21.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:39:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.770+0000 7f035dd66640 1 Processor -- start 2024-09-12T01:39:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.770+0000 7f035dd66640 1 -- start start 2024-09-12T01:39:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.771+0000 7f035dd66640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f035806fba0 0x7f035806c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.771+0000 7f035dd66640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0358070010 con 0x7f035815c2a0 2024-09-12T01:39:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.771+0000 7f035dd66640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0358074120 con 0x7f035806f710 2024-09-12T01:39:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.771+0000 7f035dd66640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f035815c680 con 0x7f035806fba0 2024-09-12T01:39:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.771+0000 7f0357fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f035806fba0 0x7f035806c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.771+0000 7f0357fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f035806fba0 0x7f035806c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41776/0 (socket says 172.21.15.60:41776) 2024-09-12T01:39:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.771+0000 7f0357fff640 1 -- 172.21.15.60:0/240552818 learned_addr learned my addr 172.21.15.60:0/240552818 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:21.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.771+0000 7f03577fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f035815c2a0 0x7f03580735d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:41890/0 (socket says 172.21.15.60:41890) 2024-09-12T01:39:21.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.771+0000 7f0357fff640 1 -- 172.21.15.60:0/240552818 >> v1:172.21.15.105:6789/0 conn(0x7f035806f710 legacy=0x7f035806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:21.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.771+0000 7f0357fff640 1 -- 172.21.15.60:0/240552818 >> v1:172.21.15.60:6789/0 conn(0x7f035815c2a0 legacy=0x7f03580735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.771+0000 7f0357fff640 1 -- 172.21.15.60:0/240552818 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035815ef00 con 0x7f035806fba0 2024-09-12T01:39:21.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.771+0000 7f03567fc640 1 -- 172.21.15.60:0/240552818 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3648019949 0 0) 0x7f0358070010 con 0x7f035815c2a0 2024-09-12T01:39:21.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.772+0000 7f0357fff640 1 --2- 172.21.15.60:0/240552818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035806fba0 0x7f035806c320 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0350009e50 tx=0x7f035002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dec75c1e6bc5d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:21.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.772+0000 7f03567fc640 1 -- 172.21.15.60:0/240552818 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350036070 con 0x7f035806fba0 2024-09-12T01:39:21.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.772+0000 7f03567fc640 1 -- 172.21.15.60:0/240552818 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0350031600 con 0x7f035806fba0 2024-09-12T01:39:21.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.772+0000 7f03567fc640 1 -- 172.21.15.60:0/240552818 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03500319d0 con 0x7f035806fba0 2024-09-12T01:39:21.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.773+0000 7f035dd66640 1 -- 172.21.15.60:0/240552818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035806fba0 msgr2=0x7f035806c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.773+0000 7f035dd66640 1 --2- 172.21.15.60:0/240552818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035806fba0 0x7f035806c320 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0350009e50 tx=0x7f035002a760 comp rx=0 tx=0).stop 2024-09-12T01:39:21.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.773+0000 7f035dd66640 1 -- 172.21.15.60:0/240552818 shutdown_connections 2024-09-12T01:39:21.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.773+0000 7f035dd66640 1 --2- 172.21.15.60:0/240552818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035806fba0 0x7f035806c320 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.773+0000 7f035dd66640 1 -- 172.21.15.60:0/240552818 >> 172.21.15.60:0/240552818 conn(0x7f03580b3070 msgr2=0x7f03580b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:21.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.773+0000 7f035dd66640 1 -- 172.21.15.60:0/240552818 shutdown_connections 2024-09-12T01:39:21.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.773+0000 7f035dd66640 1 -- 172.21.15.60:0/240552818 wait complete. 2024-09-12T01:39:21.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.774+0000 7f035dd66640 1 Processor -- start 2024-09-12T01:39:21.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.774+0000 7f035dd66640 1 -- start start 2024-09-12T01:39:21.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f035dd66640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035806f710 0x7f035815fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f035dd66640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f035806fba0 0x7f0358161a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f035dd66640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f035815c2a0 0x7f0358149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f035dd66640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f035815ebf0 con 0x7f035806f710 2024-09-12T01:39:21.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f035dd66640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f035815f4c0 con 0x7f035806fba0 2024-09-12T01:39:21.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f035dd66640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f03580b5f20 con 0x7f035815c2a0 2024-09-12T01:39:21.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f03577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035806f710 0x7f035815fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f03577fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035806f710 0x7f035815fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41782/0 (socket says 172.21.15.60:41782) 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f03577fe640 1 -- 172.21.15.60:0/2085933932 learned_addr learned my addr 172.21.15.60:0/2085933932 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f0357fff640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f035815c2a0 0x7f0358149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f0356ffd640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f035806fba0 0x7f0358161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f03577fe640 1 -- 172.21.15.60:0/2085933932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f035815c2a0 msgr2=0x7f0358149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f03577fe640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f035815c2a0 0x7f0358149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f03577fe640 1 -- 172.21.15.60:0/2085933932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f035806fba0 msgr2=0x7f0358161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f03577fe640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f035806fba0 0x7f0358161a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f03577fe640 1 -- 172.21.15.60:0/2085933932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0358160290 con 0x7f035806f710 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f0356ffd640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f035806fba0 0x7f0358161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.775+0000 7f0357fff640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f035815c2a0 0x7f0358149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.776+0000 7f03577fe640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035806f710 0x7f035815fbf0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f034800c460 tx=0x7f034800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.776+0000 7f034ffff640 1 -- 172.21.15.60:0/2085933932 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348018070 con 0x7f035806f710 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.776+0000 7f034ffff640 1 -- 172.21.15.60:0/2085933932 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0348007500 con 0x7f035806f710 2024-09-12T01:39:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.776+0000 7f034ffff640 1 -- 172.21.15.60:0/2085933932 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348004a20 con 0x7f035806f710 2024-09-12T01:39:21.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.776+0000 7f035dd66640 1 -- 172.21.15.60:0/2085933932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0358160570 con 0x7f035806f710 2024-09-12T01:39:21.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.776+0000 7f035dd66640 1 -- 172.21.15.60:0/2085933932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0358160b30 con 0x7f035806f710 2024-09-12T01:39:21.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.777+0000 7f035dd66640 1 -- 172.21.15.60:0/2085933932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f035815f9e0 con 0x7f035806f710 2024-09-12T01:39:21.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.778+0000 7f034ffff640 1 -- 172.21.15.60:0/2085933932 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f034801b070 con 0x7f035806f710 2024-09-12T01:39:21.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.778+0000 7f034ffff640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f033806be30 0x7f033806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:21.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.778+0000 7f034ffff640 1 -- 172.21.15.60:0/2085933932 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f034808a110 con 0x7f035806f710 2024-09-12T01:39:21.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.778+0000 7f0356ffd640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f033806be30 0x7f033806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:21.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.778+0000 7f0356ffd640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f033806be30 0x7f033806e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f03581614c0 tx=0x7f0340009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:21.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:21.782+0000 7f034ffff640 1 -- 172.21.15.60:0/2085933932 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0348058ac0 con 0x7f035806f710 2024-09-12T01:39:22.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.031+0000 7f035dd66640 1 -- 172.21.15.60:0/2085933932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f03580b3730 con 0x7f035806f710 2024-09-12T01:39:22.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.033+0000 7f034ffff640 1 -- 172.21.15.60:0/2085933932 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f03480583c0 con 0x7f035806f710 2024-09-12T01:39:22.033 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-12T01:39:22.033 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ== 2024-09-12T01:39:22.033 INFO:teuthology.orchestra.run.smithi060.stdout: caps mds = "allow" 2024-09-12T01:39:22.033 INFO:teuthology.orchestra.run.smithi060.stdout: caps mon = "allow r" 2024-09-12T01:39:22.033 INFO:teuthology.orchestra.run.smithi060.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:39:22.034 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2024-09-12T01:39:22.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.036+0000 7f035dd66640 1 -- 172.21.15.60:0/2085933932 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f033806be30 msgr2=0x7f033806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.036+0000 7f035dd66640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f033806be30 0x7f033806e2f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f03581614c0 tx=0x7f0340009040 comp rx=0 tx=0).stop 2024-09-12T01:39:22.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.036+0000 7f035dd66640 1 -- 172.21.15.60:0/2085933932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035806f710 msgr2=0x7f035815fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.036+0000 7f035dd66640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035806f710 0x7f035815fbf0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f034800c460 tx=0x7f034800c920 comp rx=0 tx=0).stop 2024-09-12T01:39:22.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.036+0000 7f035dd66640 1 -- 172.21.15.60:0/2085933932 shutdown_connections 2024-09-12T01:39:22.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.036+0000 7f035dd66640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f033806be30 0x7f033806e2f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.036+0000 7f035dd66640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f035815c2a0 0x7f0358149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.036+0000 7f035dd66640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f035806fba0 0x7f0358161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.036+0000 7f035dd66640 1 --2- 172.21.15.60:0/2085933932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f035806f710 0x7f035815fbf0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.036+0000 7f035dd66640 1 -- 172.21.15.60:0/2085933932 >> 172.21.15.60:0/2085933932 conn(0x7f03580b3070 msgr2=0x7f03580af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:22.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.036+0000 7f035dd66640 1 -- 172.21.15.60:0/2085933932 shutdown_connections 2024-09-12T01:39:22.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.036+0000 7f035dd66640 1 -- 172.21.15.60:0/2085933932 wait complete. 2024-09-12T01:39:22.046 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:39:22.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.149+0000 7f45402e6640 1 Processor -- start 2024-09-12T01:39:22.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.149+0000 7f45402e6640 1 -- start start 2024-09-12T01:39:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f45402e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f45380b74c0 0x7f453815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f45402e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f453815f030 0x7f453806d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f45402e6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f453815fb10 con 0x7f453815c2b0 2024-09-12T01:39:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f45402e6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f45380b5900 con 0x7f45380b74c0 2024-09-12T01:39:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f45402e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f453815f830 con 0x7f453815f030 2024-09-12T01:39:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f453d881640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f45380b74c0 0x7f453815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f453d881640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f45380b74c0 0x7f453815eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41784/0 (socket says 172.21.15.60:41784) 2024-09-12T01:39:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f453d881640 1 -- 172.21.15.60:0/1617303370 learned_addr learned my addr 172.21.15.60:0/1617303370 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f453e883640 1 --2- 172.21.15.60:0/1617303370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f453815f030 0x7f453806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f453d881640 1 -- 172.21.15.60:0/1617303370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f453815f030 msgr2=0x7f453806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f453d881640 1 --2- 172.21.15.60:0/1617303370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f453815f030 0x7f453806d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f453d881640 1 -- 172.21.15.60:0/1617303370 >> v1:172.21.15.105:6789/0 conn(0x7f453815c2b0 legacy=0x7f45380b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.150+0000 7f453d881640 1 -- 172.21.15.60:0/1617303370 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453806ce30 con 0x7f45380b74c0 2024-09-12T01:39:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.151+0000 7f453d881640 1 --2- 172.21.15.60:0/1617303370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45380b74c0 0x7f453815eaf0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4528009870 tx=0x7f452802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed5e6059e8b5a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.151+0000 7f453d080640 1 -- 172.21.15.60:0/1617303370 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528037070 con 0x7f45380b74c0 2024-09-12T01:39:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.151+0000 7f453d080640 1 -- 172.21.15.60:0/1617303370 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4528032440 con 0x7f45380b74c0 2024-09-12T01:39:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.151+0000 7f453d080640 1 -- 172.21.15.60:0/1617303370 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528032810 con 0x7f45380b74c0 2024-09-12T01:39:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.152+0000 7f45402e6640 1 -- 172.21.15.60:0/1617303370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45380b74c0 msgr2=0x7f453815eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.152+0000 7f45402e6640 1 --2- 172.21.15.60:0/1617303370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45380b74c0 0x7f453815eaf0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4528009870 tx=0x7f452802a270 comp rx=0 tx=0).stop 2024-09-12T01:39:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.152+0000 7f45402e6640 1 -- 172.21.15.60:0/1617303370 shutdown_connections 2024-09-12T01:39:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.152+0000 7f45402e6640 1 --2- 172.21.15.60:0/1617303370 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f453815f030 0x7f453806d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.152+0000 7f45402e6640 1 --2- 172.21.15.60:0/1617303370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45380b74c0 0x7f453815eaf0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.152+0000 7f45402e6640 1 -- 172.21.15.60:0/1617303370 >> 172.21.15.60:0/1617303370 conn(0x7f45380b4240 msgr2=0x7f45380b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.152+0000 7f45402e6640 1 -- 172.21.15.60:0/1617303370 shutdown_connections 2024-09-12T01:39:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.152+0000 7f45402e6640 1 -- 172.21.15.60:0/1617303370 wait complete. 2024-09-12T01:39:22.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.153+0000 7f45402e6640 1 Processor -- start 2024-09-12T01:39:22.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.153+0000 7f45402e6640 1 -- start start 2024-09-12T01:39:22.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f45402e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45380b74c0 0x7f4538158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f45402e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453815c2b0 0x7f4538147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f45402e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f453815f030 0x7f453815cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f45402e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f453815f4c0 con 0x7f453815c2b0 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f45402e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f453806d3f0 con 0x7f45380b74c0 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f45402e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f453806de50 con 0x7f453815f030 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453d881640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453815c2b0 0x7f4538147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453d881640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453815c2b0 0x7f4538147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41792/0 (socket says 172.21.15.60:41792) 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453d881640 1 -- 172.21.15.60:0/3145531819 learned_addr learned my addr 172.21.15.60:0/3145531819 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453e883640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f453815f030 0x7f453815cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453e082640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45380b74c0 0x7f4538158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453d881640 1 -- 172.21.15.60:0/3145531819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f453815f030 msgr2=0x7f453815cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453d881640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f453815f030 0x7f453815cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453d881640 1 -- 172.21.15.60:0/3145531819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45380b74c0 msgr2=0x7f4538158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453d881640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45380b74c0 0x7f4538158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453d881640 1 -- 172.21.15.60:0/3145531819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45381576b0 con 0x7f453815c2b0 2024-09-12T01:39:22.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453e883640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f453815f030 0x7f453815cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:22.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453e082640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45380b74c0 0x7f4538158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:22.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f453d881640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453815c2b0 0x7f4538147d20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4528000c00 tx=0x7f45280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:22.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.154+0000 7f452effd640 1 -- 172.21.15.60:0/3145531819 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528041020 con 0x7f453815c2b0 2024-09-12T01:39:22.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.155+0000 7f452effd640 1 -- 172.21.15.60:0/3145531819 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45280306c0 con 0x7f453815c2b0 2024-09-12T01:39:22.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.155+0000 7f452effd640 1 -- 172.21.15.60:0/3145531819 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528037040 con 0x7f453815c2b0 2024-09-12T01:39:22.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.155+0000 7f45402e6640 1 -- 172.21.15.60:0/3145531819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4538157990 con 0x7f453815c2b0 2024-09-12T01:39:22.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.155+0000 7f45402e6640 1 -- 172.21.15.60:0/3145531819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4538157f50 con 0x7f453815c2b0 2024-09-12T01:39:22.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.155+0000 7f45402e6640 1 -- 172.21.15.60:0/3145531819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f453815eaf0 con 0x7f453815c2b0 2024-09-12T01:39:22.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.156+0000 7f452effd640 1 -- 172.21.15.60:0/3145531819 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4528044020 con 0x7f453815c2b0 2024-09-12T01:39:22.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.157+0000 7f452effd640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f451c06be30 0x7f451c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.157+0000 7f452effd640 1 -- 172.21.15.60:0/3145531819 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f45280ab610 con 0x7f453815c2b0 2024-09-12T01:39:22.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.157+0000 7f453e082640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f451c06be30 0x7f451c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.157+0000 7f453e082640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f451c06be30 0x7f451c06e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4534001700 tx=0x7f4534009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:22.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.161+0000 7f452effd640 1 -- 172.21.15.60:0/3145531819 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f452804b030 con 0x7f453815c2b0 2024-09-12T01:39:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.373+0000 7f45402e6640 1 -- 172.21.15.60:0/3145531819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45380b3630 con 0x7f453815c2b0 2024-09-12T01:39:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.373+0000 7f452effd640 1 -- 172.21.15.60:0/3145531819 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5230 (secure 0 0 0) 0x7f452807a050 con 0x7f453815c2b0 2024-09-12T01:39:22.373 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:22.373 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":44,"btime":"2024-09-12T01:39:15:900799+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5824,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4036885582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4036885582},{"type":"v1","addr":"172.21.15.105:6835","nonce":4036885582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2254947663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2254947663},{"type":"v1","addr":"172.21.15.60:6835","nonce":2254947663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3019966407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3019966407},{"type":"v1","addr":"172.21.15.60:6837","nonce":3019966407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:39:13.254252+0000","modified":"2024-09-12T01:39:15.248119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35375":{"gid":35375,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/95793246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":95793246},{"type":"v1","addr":"172.21.15.105:6834","nonce":95793246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35375,"qdb_cluster":[35375]},"id":6}]} 2024-09-12T01:39:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 44 2024-09-12T01:39:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.375+0000 7f45402e6640 1 -- 172.21.15.60:0/3145531819 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f451c06be30 msgr2=0x7f451c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.375+0000 7f45402e6640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f451c06be30 0x7f451c06e2f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4534001700 tx=0x7f4534009040 comp rx=0 tx=0).stop 2024-09-12T01:39:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.375+0000 7f45402e6640 1 -- 172.21.15.60:0/3145531819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453815c2b0 msgr2=0x7f4538147d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.375+0000 7f45402e6640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453815c2b0 0x7f4538147d20 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4528000c00 tx=0x7f45280046c0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.375+0000 7f45402e6640 1 -- 172.21.15.60:0/3145531819 shutdown_connections 2024-09-12T01:39:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.375+0000 7f45402e6640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f451c06be30 0x7f451c06e2f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.375+0000 7f45402e6640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f453815f030 0x7f453815cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.375+0000 7f45402e6640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453815c2b0 0x7f4538147d20 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.375+0000 7f45402e6640 1 --2- 172.21.15.60:0/3145531819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f45380b74c0 0x7f4538158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.375+0000 7f45402e6640 1 -- 172.21.15.60:0/3145531819 >> 172.21.15.60:0/3145531819 conn(0x7f45380b4240 msgr2=0x7f45380b6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:22.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.375+0000 7f45402e6640 1 -- 172.21.15.60:0/3145531819 shutdown_connections 2024-09-12T01:39:22.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.375+0000 7f45402e6640 1 -- 172.21.15.60:0/3145531819 wait complete. 2024-09-12T01:39:22.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:39:13.254252+0000', 'modified': '2024-09-12T01:39:15.248119+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35375}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35375': {'gid': 35375, 'name': 'd', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6834/95793246', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 95793246}, {'type': 'v1', 'addr': '172.21.15.105:6834', 'nonce': 95793246}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 35375, 'qdb_cluster': [35375]} 2024-09-12T01:39:22.788 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:39:22.788 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T01:39:22.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.898+0000 7f78e6b86640 1 Processor -- start 2024-09-12T01:39:22.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.898+0000 7f78e6b86640 1 -- start start 2024-09-12T01:39:22.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.898+0000 7f78e6b86640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78e00b6290 0x7f78e0071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.898+0000 7f78e6b86640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f78e0072530 0x7f78e015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.898+0000 7f78e6b86640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e00ccff0 con 0x7f78e015b480 2024-09-12T01:39:22.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.898+0000 7f78e6b86640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f78e00cd2d0 con 0x7f78e00b6290 2024-09-12T01:39:22.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.898+0000 7f78e6b86640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f78e00cd5b0 con 0x7f78e0072530 2024-09-12T01:39:22.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.899+0000 7f78dffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78e00b6290 0x7f78e0071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.899+0000 7f78dffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f78e00b6290 0x7f78e0071ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35512/0 (socket says 172.21.15.60:35512) 2024-09-12T01:39:22.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.899+0000 7f78dffff640 1 -- 172.21.15.60:0/3466651346 learned_addr learned my addr 172.21.15.60:0/3466651346 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:22.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.899+0000 7f78e5123640 1 --2- 172.21.15.60:0/3466651346 >> v2:172.21.15.105:3300/0 conn(0x7f78e0072530 0x7f78e015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.899+0000 7f78dffff640 1 -- 172.21.15.60:0/3466651346 >> v2:172.21.15.105:3300/0 conn(0x7f78e0072530 msgr2=0x7f78e015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:22.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.899+0000 7f78dffff640 1 --2- 172.21.15.60:0/3466651346 >> v2:172.21.15.105:3300/0 conn(0x7f78e0072530 0x7f78e015bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.899+0000 7f78dffff640 1 -- 172.21.15.60:0/3466651346 >> v1:172.21.15.105:6789/0 conn(0x7f78e015b480 legacy=0x7f78e00b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:22.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.899+0000 7f78dffff640 1 -- 172.21.15.60:0/3466651346 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e00cd890 con 0x7f78e00b6290 2024-09-12T01:39:22.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.900+0000 7f78dffff640 1 --2- 172.21.15.60:0/3466651346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78e00b6290 0x7f78e0071ff0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f78e00733f0 tx=0x7f78cc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77626322db2d53d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:22.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.900+0000 7f78df7fe640 1 -- 172.21.15.60:0/3466651346 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc037070 con 0x7f78e00b6290 2024-09-12T01:39:22.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.900+0000 7f78df7fe640 1 -- 172.21.15.60:0/3466651346 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78cc032440 con 0x7f78e00b6290 2024-09-12T01:39:22.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.900+0000 7f78df7fe640 1 -- 172.21.15.60:0/3466651346 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc032810 con 0x7f78e00b6290 2024-09-12T01:39:22.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.900+0000 7f78e6b86640 1 -- 172.21.15.60:0/3466651346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78e00b6290 msgr2=0x7f78e0071ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.900+0000 7f78e6b86640 1 --2- 172.21.15.60:0/3466651346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78e00b6290 0x7f78e0071ff0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f78e00733f0 tx=0x7f78cc02a1a0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.900+0000 7f78e6b86640 1 -- 172.21.15.60:0/3466651346 shutdown_connections 2024-09-12T01:39:22.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.900+0000 7f78e6b86640 1 --2- 172.21.15.60:0/3466651346 >> v2:172.21.15.105:3300/0 conn(0x7f78e0072530 0x7f78e015bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.900+0000 7f78e6b86640 1 --2- 172.21.15.60:0/3466651346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78e00b6290 0x7f78e0071ff0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.900+0000 7f78e6b86640 1 -- 172.21.15.60:0/3466651346 >> 172.21.15.60:0/3466651346 conn(0x7f78e006d0f0 msgr2=0x7f78e006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:22.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.900+0000 7f78e6b86640 1 -- 172.21.15.60:0/3466651346 shutdown_connections 2024-09-12T01:39:22.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.900+0000 7f78e6b86640 1 -- 172.21.15.60:0/3466651346 wait complete. 2024-09-12T01:39:22.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.902+0000 7f78e6b86640 1 Processor -- start 2024-09-12T01:39:22.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.902+0000 7f78e6b86640 1 -- start start 2024-09-12T01:39:22.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.902+0000 7f78e6b86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78e0072530 0x7f78e00ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78e6b86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78e015b480 0x7f78e0156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78e6b86640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78e0150350 0x7f78e0146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78e6b86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f78e015b9e0 con 0x7f78e015b480 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78e6b86640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f78e015b860 con 0x7f78e0150350 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78e6b86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f78e015c1a0 con 0x7f78e0072530 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78e015b480 0x7f78e0156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78e015b480 0x7f78e0156870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35526/0 (socket says 172.21.15.60:35526) 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78dffff640 1 -- 172.21.15.60:0/1500111129 learned_addr learned my addr 172.21.15.60:0/1500111129 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78e5123640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78e0150350 0x7f78e0146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78e4922640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78e0072530 0x7f78e00ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78dffff640 1 -- 172.21.15.60:0/1500111129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78e0072530 msgr2=0x7f78e00ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78dffff640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78e0072530 0x7f78e00ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78dffff640 1 -- 172.21.15.60:0/1500111129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78e0150350 msgr2=0x7f78e0146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78dffff640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78e0150350 0x7f78e0146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78dffff640 1 -- 172.21.15.60:0/1500111129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e00cad60 con 0x7f78e015b480 2024-09-12T01:39:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78e4922640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78e0072530 0x7f78e00ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:22.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78dffff640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78e015b480 0x7f78e0156870 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f78cc000c00 tx=0x7f78cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:22.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78dd7fa640 1 -- 172.21.15.60:0/1500111129 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc041020 con 0x7f78e015b480 2024-09-12T01:39:22.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78dd7fa640 1 -- 172.21.15.60:0/1500111129 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78cc030970 con 0x7f78e015b480 2024-09-12T01:39:22.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78e6b86640 1 -- 172.21.15.60:0/1500111129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e00c9a60 con 0x7f78e015b480 2024-09-12T01:39:22.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78dd7fa640 1 -- 172.21.15.60:0/1500111129 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc037040 con 0x7f78e015b480 2024-09-12T01:39:22.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.903+0000 7f78e6b86640 1 -- 172.21.15.60:0/1500111129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e00ca020 con 0x7f78e015b480 2024-09-12T01:39:22.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.905+0000 7f78dd7fa640 1 -- 172.21.15.60:0/1500111129 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78cc044020 con 0x7f78e015b480 2024-09-12T01:39:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.906+0000 7f78dd7fa640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f78c406be60 0x7f78c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.906+0000 7f78e4922640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f78c406be60 0x7f78c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.906+0000 7f78dd7fa640 1 -- 172.21.15.60:0/1500111129 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f78cc0ab830 con 0x7f78e015b480 2024-09-12T01:39:22.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.906+0000 7f78e4922640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f78c406be60 0x7f78c406e320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f78d4006fd0 tx=0x7f78d4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.907+0000 7f78e99fc740 1 Processor -- start 2024-09-12T01:39:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.907+0000 7f78e99fc740 1 -- start start 2024-09-12T01:39:22.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.907+0000 7f78e99fc740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e9382c0 0x560a2e97da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.907+0000 7f78e99fc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e935a80 0x560a2e9386a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.907+0000 7f78e99fc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e939a50 0x560a2e9328b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.907+0000 7f78e99fc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560a2e89a520 con 0x560a2e935a80 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.907+0000 7f78e99fc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560a2e8423e0 con 0x560a2e939a50 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.907+0000 7f78e99fc740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x560a2e8964e0 con 0x560a2e9382c0 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.908+0000 7f78dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e935a80 0x560a2e9386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.908+0000 7f78dffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e935a80 0x560a2e9386a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35542/0 (socket says 172.21.15.60:35542) 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.908+0000 7f78dffff640 1 -- 172.21.15.60:0/3374328755 learned_addr learned my addr 172.21.15.60:0/3374328755 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.908+0000 7f78dffff640 1 -- 172.21.15.60:0/3374328755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e9382c0 msgr2=0x560a2e97da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.908+0000 7f78dffff640 1 --2- 172.21.15.60:0/3374328755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e9382c0 0x560a2e97da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.908+0000 7f78dffff640 1 -- 172.21.15.60:0/3374328755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e939a50 msgr2=0x560a2e9328b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.908+0000 7f78dffff640 1 --2- 172.21.15.60:0/3374328755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e939a50 0x560a2e9328b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.908+0000 7f78dffff640 1 -- 172.21.15.60:0/3374328755 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a2e85d2f0 con 0x560a2e935a80 2024-09-12T01:39:22.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.908+0000 7f78dffff640 1 --2- 172.21.15.60:0/3374328755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e935a80 0x560a2e9386a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f78cc035040 tx=0x7f78cc075e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcadf710cfd2287 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:22.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.908+0000 7f78ca7fc640 1 -- 172.21.15.60:0/3374328755 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc079a40 con 0x560a2e935a80 2024-09-12T01:39:22.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.908+0000 7f78ca7fc640 1 -- 172.21.15.60:0/3374328755 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78cc07ddf0 con 0x560a2e935a80 2024-09-12T01:39:22.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.908+0000 7f78ca7fc640 1 -- 172.21.15.60:0/3374328755 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc082620 con 0x560a2e935a80 2024-09-12T01:39:22.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.909+0000 7f78e99fc740 1 -- 172.21.15.60:0/3374328755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e935a80 msgr2=0x560a2e9386a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.909+0000 7f78e99fc740 1 --2- 172.21.15.60:0/3374328755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e935a80 0x560a2e9386a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f78cc035040 tx=0x7f78cc075e10 comp rx=0 tx=0).stop 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.909+0000 7f78e99fc740 1 -- 172.21.15.60:0/3374328755 shutdown_connections 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.909+0000 7f78e99fc740 1 --2- 172.21.15.60:0/3374328755 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e939a50 0x560a2e9328b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.909+0000 7f78e99fc740 1 --2- 172.21.15.60:0/3374328755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e935a80 0x560a2e9386a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.909+0000 7f78e99fc740 1 --2- 172.21.15.60:0/3374328755 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e9382c0 0x560a2e97da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.909+0000 7f78e99fc740 1 -- 172.21.15.60:0/3374328755 >> 172.21.15.60:0/3374328755 conn(0x560a2e934a80 msgr2=0x560a2e97cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.909+0000 7f78e99fc740 1 -- 172.21.15.60:0/3374328755 shutdown_connections 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.909+0000 7f78e99fc740 1 -- 172.21.15.60:0/3374328755 wait complete. 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.909+0000 7f78e99fc740 1 -- start start 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.910+0000 7f78e99fc740 1 Processor -- start 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.910+0000 7f78e99fc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e9382c0 0x560a2e9623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.910+0000 7f78e99fc740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e939a50 0x560a2e958a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.910+0000 7f78e99fc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 0x560a2e95bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.910+0000 7f78e99fc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560a2e89a520 con 0x560a2e962900 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.910+0000 7f78e99fc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560a2e823450 con 0x560a2e9382c0 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.910+0000 7f78e99fc740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x560a2e933f20 con 0x560a2e939a50 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.910+0000 7f78e99fc740 10 client.0 _ll_register_callbacks cb 0x560a2e5acac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.910+0000 7f78e5123640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 0x560a2e95bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.910+0000 7f78e5123640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 0x560a2e95bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35548/0 (socket says 172.21.15.60:35548) 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78e5123640 1 -- 172.21.15.60:0/51658122 learned_addr learned my addr 172.21.15.60:0/51658122 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78e4922640 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e9382c0 0x560a2e9623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78dffff640 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e939a50 0x560a2e958a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78e5123640 1 -- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e939a50 msgr2=0x560a2e958a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78e5123640 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e939a50 0x560a2e958a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78e5123640 1 -- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e9382c0 msgr2=0x560a2e9623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78e5123640 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e9382c0 0x560a2e9623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78e5123640 1 -- 172.21.15.60:0/51658122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a2e5ad2d0 con 0x560a2e962900 2024-09-12T01:39:22.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78dffff640 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e939a50 0x560a2e958a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78e5123640 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 0x560a2e95bb10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f78d800fb70 tx=0x7f78d800d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55964b2a25e99687 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78bf7fe640 1 -- 172.21.15.60:0/51658122 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d800dea0 con 0x560a2e962900 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78bf7fe640 1 -- 172.21.15.60:0/51658122 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f78d8003b90 con 0x560a2e962900 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78e99fc740 1 -- 172.21.15.60:0/51658122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78cc07ddf0 con 0x560a2e962900 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78bf7fe640 1 -- 172.21.15.60:0/51658122 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f78d8003d90 con 0x560a2e962900 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78e99fc740 10 client.6351 fetch_fsmap learned FSMap version 44 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78e99fc740 1 -- 172.21.15.60:0/51658122 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x560a2e6776b0 con 0x560a2e962900 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.911+0000 7f78bf7fe640 1 -- 172.21.15.60:0/51658122 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78cc07ddf0 con 0x560a2e962900 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.912+0000 7f78bf7fe640 1 -- 172.21.15.60:0/51658122 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7f78d801f050 con 0x560a2e962900 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.912+0000 7f78e99fc740 10 client.6351 fetch_fsmap finished waiting for FSMap version 44 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.912+0000 7f78e99fc740 10 client.6351 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.912+0000 7f78e99fc740 20 client.6351 populate_metadata read hostname 'smithi060' 2024-09-12T01:39:22.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.912+0000 7f78e99fc740 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:6832/95793246,v1:172.21.15.105:6834/95793246] conn(0x560a2e954360 0x560a2e954740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.912+0000 7f78e99fc740 4 client.6351 mds_command: new command op to 35375 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:39:22.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.912+0000 7f78e99fc740 1 -- 172.21.15.60:0/51658122 --> [v2:172.21.15.105:6832/95793246,v1:172.21.15.105:6834/95793246] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a2e8a7c50 con 0x560a2e954360 2024-09-12T01:39:22.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.912+0000 7f78e4922640 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:6832/95793246,v1:172.21.15.105:6834/95793246] conn(0x560a2e954360 0x560a2e954740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.912+0000 7f78e4922640 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:6832/95793246,v1:172.21.15.105:6834/95793246] conn(0x560a2e954360 0x560a2e954740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79c3ab75534e759c server_cookie=a157296ebd683820 in_seq=0 out_seq=0 2024-09-12T01:39:22.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.912+0000 7f78bf7fe640 10 client.6351 ms_handle_connect on v2:172.21.15.105:6832/95793246 2024-09-12T01:39:22.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.913+0000 7f78bf7fe640 1 -- 172.21.15.60:0/51658122 <== mds.0 v2:172.21.15.105:6832/95793246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a2e8a7c50 con 0x560a2e954360 2024-09-12T01:39:22.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.913+0000 7f78bf7fe640 10 client.6351 handle_command_reply: tid=0 2024-09-12T01:39:22.916 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.913+0000 7f78e99fc740 1 client.6351 shutdown 2024-09-12T01:39:22.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.914+0000 7f78e99fc740 1 -- 172.21.15.60:0/51658122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 msgr2=0x560a2e95bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.914+0000 7f78e99fc740 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 0x560a2e95bb10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f78d800fb70 tx=0x7f78d800d750 comp rx=0 tx=0).stop 2024-09-12T01:39:22.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.914+0000 7f78e99fc740 1 -- 172.21.15.60:0/51658122 shutdown_connections 2024-09-12T01:39:22.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.914+0000 7f78e99fc740 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:6832/95793246,v1:172.21.15.105:6834/95793246] conn(0x560a2e954360 0x560a2e954740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.914+0000 7f78e99fc740 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 0x560a2e95bb10 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.914+0000 7f78e99fc740 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e939a50 0x560a2e958a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.914+0000 7f78bf7fe640 0 client.6351 ms_handle_reset on v2:172.21.15.105:6832/95793246 2024-09-12T01:39:22.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.914+0000 7f78e99fc740 1 --2- 172.21.15.60:0/51658122 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e9382c0 0x560a2e9623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.914+0000 7f78e99fc740 1 -- 172.21.15.60:0/51658122 >> 172.21.15.60:0/51658122 conn(0x560a2e935a80 msgr2=0x560a2e97afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:22.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.914+0000 7f78e99fc740 1 -- 172.21.15.60:0/51658122 shutdown_connections 2024-09-12T01:39:22.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.914+0000 7f78e99fc740 1 -- 172.21.15.60:0/51658122 wait complete. 2024-09-12T01:39:22.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.914+0000 7f78e99fc740 20 client.6351 trim_cache size 0 max 16384 2024-09-12T01:39:22.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.932+0000 7f78e99fc740 1 Processor -- start 2024-09-12T01:39:22.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.932+0000 7f78e99fc740 1 -- start start 2024-09-12T01:39:22.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78e99fc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e9382c0 0x560a2e961dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78e99fc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e939a50 0x560a2e962300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78e99fc740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e962900 0x560a2e95c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78e99fc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f78e01ffd20 con 0x560a2e9382c0 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78e99fc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f78e00b38e0 con 0x560a2e939a50 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78e99fc740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f78e00b3f30 con 0x560a2e962900 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78e4922640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e9382c0 0x560a2e961dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78e4922640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e9382c0 0x560a2e961dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35556/0 (socket says 172.21.15.60:35556) 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78e4922640 1 -- 172.21.15.60:0/2194442072 learned_addr learned my addr 172.21.15.60:0/2194442072 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78e5123640 1 --2- 172.21.15.60:0/2194442072 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e962900 0x560a2e95c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78dffff640 1 --2- 172.21.15.60:0/2194442072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e939a50 0x560a2e962300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78e4922640 1 -- 172.21.15.60:0/2194442072 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e962900 msgr2=0x560a2e95c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.933+0000 7f78e4922640 1 --2- 172.21.15.60:0/2194442072 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e962900 0x560a2e95c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.934+0000 7f78e4922640 1 -- 172.21.15.60:0/2194442072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e939a50 msgr2=0x560a2e962300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.934+0000 7f78e4922640 1 --2- 172.21.15.60:0/2194442072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e939a50 0x560a2e962300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.934+0000 7f78e4922640 1 -- 172.21.15.60:0/2194442072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a2e958dd0 con 0x560a2e9382c0 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.934+0000 7f78dffff640 1 --2- 172.21.15.60:0/2194442072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e939a50 0x560a2e962300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:22.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.934+0000 7f78e4922640 1 --2- 172.21.15.60:0/2194442072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e9382c0 0x560a2e961dc0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x560a2e95c7c0 tx=0x7f78d4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05b7887e9218377 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:22.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.934+0000 7f78c9ffb640 1 -- 172.21.15.60:0/2194442072 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d40144f0 con 0x560a2e9382c0 2024-09-12T01:39:22.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.934+0000 7f78c9ffb640 1 -- 172.21.15.60:0/2194442072 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d4014690 con 0x560a2e9382c0 2024-09-12T01:39:22.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.934+0000 7f78c9ffb640 1 -- 172.21.15.60:0/2194442072 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d4014840 con 0x560a2e9382c0 2024-09-12T01:39:22.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.934+0000 7f78e99fc740 1 -- 172.21.15.60:0/2194442072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e9382c0 msgr2=0x560a2e961dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.934+0000 7f78e99fc740 1 --2- 172.21.15.60:0/2194442072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e9382c0 0x560a2e961dc0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x560a2e95c7c0 tx=0x7f78d4010000 comp rx=0 tx=0).stop 2024-09-12T01:39:22.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.935+0000 7f78e99fc740 1 -- 172.21.15.60:0/2194442072 shutdown_connections 2024-09-12T01:39:22.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.935+0000 7f78e99fc740 1 --2- 172.21.15.60:0/2194442072 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e962900 0x560a2e95c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.935+0000 7f78e99fc740 1 --2- 172.21.15.60:0/2194442072 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e939a50 0x560a2e962300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.935+0000 7f78e99fc740 1 --2- 172.21.15.60:0/2194442072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e9382c0 0x560a2e961dc0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.935+0000 7f78e99fc740 1 -- 172.21.15.60:0/2194442072 >> 172.21.15.60:0/2194442072 conn(0x560a2e935a80 msgr2=0x560a2e9978b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:22.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.935+0000 7f78e99fc740 1 -- 172.21.15.60:0/2194442072 shutdown_connections 2024-09-12T01:39:22.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.935+0000 7f78e99fc740 1 -- 172.21.15.60:0/2194442072 wait complete. 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.935+0000 7f78e99fc740 1 -- start start 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.935+0000 7f78e99fc740 1 Processor -- start 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.936+0000 7f78e99fc740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e9382c0 0x560a2e9ff710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.936+0000 7f78e99fc740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e939a50 0x560a2e9e1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.936+0000 7f78e99fc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 0x560a2e961dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.936+0000 7f78e99fc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560a2e95c550 con 0x560a2e962900 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.936+0000 7f78e99fc740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x560a2e95c050 con 0x560a2e9382c0 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.936+0000 7f78e99fc740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x560a2e960e50 con 0x560a2e939a50 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.936+0000 7f78e99fc740 10 client.0 _ll_register_callbacks cb 0x7f78d800f750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.936+0000 7f78e5123640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 0x560a2e961dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.936+0000 7f78e5123640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 0x560a2e961dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35558/0 (socket says 172.21.15.60:35558) 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.936+0000 7f78e5123640 1 -- 172.21.15.60:0/1160151759 learned_addr learned my addr 172.21.15.60:0/1160151759 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.936+0000 7f78e4922640 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e9382c0 0x560a2e9ff710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.936+0000 7f78dffff640 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e939a50 0x560a2e9e1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e5123640 1 -- 172.21.15.60:0/1160151759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e939a50 msgr2=0x560a2e9e1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e5123640 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e939a50 0x560a2e9e1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e5123640 1 -- 172.21.15.60:0/1160151759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e9382c0 msgr2=0x560a2e9ff710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e5123640 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e9382c0 0x560a2e9ff710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e5123640 1 -- 172.21.15.60:0/1160151759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a2e97f0b0 con 0x560a2e962900 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e5123640 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 0x560a2e961dc0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f78d8011010 tx=0x7f78d80076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=107966c362ae1190 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78bf7fe640 1 -- 172.21.15.60:0/1160151759 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8027070 con 0x560a2e962900 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78bf7fe640 1 -- 172.21.15.60:0/1160151759 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f78d802cab0 con 0x560a2e962900 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e99fc740 1 -- 172.21.15.60:0/1160151759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78d4014690 con 0x560a2e962900 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78bf7fe640 1 -- 172.21.15.60:0/1160151759 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f78d802ccb0 con 0x560a2e962900 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e99fc740 10 client.6357 fetch_fsmap learned FSMap version 44 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e99fc740 1 -- 172.21.15.60:0/1160151759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) -- 0x560a2e979be0 con 0x560a2e962900 2024-09-12T01:39:22.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78bf7fe640 1 -- 172.21.15.60:0/1160151759 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d4014690 con 0x560a2e962900 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78bf7fe640 1 -- 172.21.15.60:0/1160151759 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 44) ==== 3502+0+0 (secure 0 0 0) 0x7f78d801f050 con 0x560a2e962900 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e99fc740 10 client.6357 fetch_fsmap finished waiting for FSMap version 44 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e99fc740 10 client.6357 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e99fc740 20 client.6357 populate_metadata read hostname 'smithi060' 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e99fc740 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.105:6832/95793246,v1:172.21.15.105:6834/95793246] conn(0x560a2e979570 0x560a2e956750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e99fc740 4 client.6357 mds_command: new command op to 35375 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.937+0000 7f78e99fc740 1 -- 172.21.15.60:0/1160151759 --> [v2:172.21.15.105:6832/95793246,v1:172.21.15.105:6834/95793246] -- command(tid 0: {"prefix": "status"}) -- 0x560a2e8a1fa0 con 0x560a2e979570 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.938+0000 7f78e4922640 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.105:6832/95793246,v1:172.21.15.105:6834/95793246] conn(0x560a2e979570 0x560a2e956750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.938+0000 7f78e4922640 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.105:6832/95793246,v1:172.21.15.105:6834/95793246] conn(0x560a2e979570 0x560a2e956750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b2f9ff05aa093c server_cookie=1d7d73a0386eedcc in_seq=0 out_seq=0 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.938+0000 7f78bf7fe640 10 client.6357 ms_handle_connect on v2:172.21.15.105:6832/95793246 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.938+0000 7f78bf7fe640 1 -- 172.21.15.60:0/1160151759 <== mds.0 v2:172.21.15.105:6832/95793246 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560a2e8a1fa0 con 0x560a2e979570 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.938+0000 7f78bf7fe640 10 client.6357 handle_command_reply: tid=0 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.938+0000 7f78e99fc740 1 client.6357 shutdown 2024-09-12T01:39:22.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.938+0000 7f78e99fc740 1 -- 172.21.15.60:0/1160151759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 msgr2=0x560a2e961dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.938+0000 7f78e99fc740 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 0x560a2e961dc0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f78d8011010 tx=0x7f78d80076f0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e99fc740 1 -- 172.21.15.60:0/1160151759 shutdown_connections 2024-09-12T01:39:22.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e99fc740 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.105:6832/95793246,v1:172.21.15.105:6834/95793246] conn(0x560a2e979570 0x560a2e956750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e99fc740 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560a2e962900 0x560a2e961dc0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e99fc740 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x560a2e939a50 0x560a2e9e1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e99fc740 1 --2- 172.21.15.60:0/1160151759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x560a2e9382c0 0x560a2e9ff710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e99fc740 1 -- 172.21.15.60:0/1160151759 >> 172.21.15.60:0/1160151759 conn(0x560a2e935a80 msgr2=0x560a2e9978b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:22.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78bf7fe640 0 client.6357 ms_handle_reset on v2:172.21.15.105:6832/95793246 2024-09-12T01:39:22.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e99fc740 1 -- 172.21.15.60:0/1160151759 shutdown_connections 2024-09-12T01:39:22.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e99fc740 1 -- 172.21.15.60:0/1160151759 wait complete. 2024-09-12T01:39:22.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e99fc740 20 client.6357 trim_cache size 0 max 16384 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "5401bd8a-3492-4b21-b6c0-d6616ff39793", 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 35375, 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 9.0545884099999991, 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 44, 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 80, 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 80, 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 14.038967060999999 2024-09-12T01:39:22.944 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:39:22.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e6b86640 1 -- 172.21.15.60:0/1500111129 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f78c406be60 msgr2=0x7f78c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e6b86640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f78c406be60 0x7f78c406e320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f78d4006fd0 tx=0x7f78d4008040 comp rx=0 tx=0).stop 2024-09-12T01:39:22.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e6b86640 1 -- 172.21.15.60:0/1500111129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78e015b480 msgr2=0x7f78e0156870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:22.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e6b86640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78e015b480 0x7f78e0156870 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f78cc000c00 tx=0x7f78cc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e6b86640 1 -- 172.21.15.60:0/1500111129 shutdown_connections 2024-09-12T01:39:22.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e6b86640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78e0150350 0x7f78e0146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e6b86640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78e015b480 0x7f78e0156870 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e6b86640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f78c406be60 0x7f78c406e320 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e6b86640 1 --2- 172.21.15.60:0/1500111129 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78e0072530 0x7f78e00ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:22.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e6b86640 1 -- 172.21.15.60:0/1500111129 >> 172.21.15.60:0/1500111129 conn(0x7f78e006d0f0 msgr2=0x7f78e006d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:22.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e6b86640 1 -- 172.21.15.60:0/1500111129 shutdown_connections 2024-09-12T01:39:22.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:22.939+0000 7f78e6b86640 1 -- 172.21.15.60:0/1500111129 wait complete. 2024-09-12T01:39:22.950 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:39:23.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.053+0000 7fb801386640 1 Processor -- start 2024-09-12T01:39:23.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.053+0000 7fb801386640 1 -- start start 2024-09-12T01:39:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.054+0000 7fb801386640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb7fc0b74c0 0x7fb7fc15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.054+0000 7fb801386640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15f030 0x7fb7fc06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.054+0000 7fb801386640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7fc15fb10 con 0x7fb7fc15c2b0 2024-09-12T01:39:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.054+0000 7fb801386640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb7fc0b5900 con 0x7fb7fc0b74c0 2024-09-12T01:39:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.054+0000 7fb801386640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb7fc15f830 con 0x7fb7fc15f030 2024-09-12T01:39:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.054+0000 7fb7faffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb7fc15c2b0 0x7fb7fc0b6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39566/0 (socket says 172.21.15.60:39566) 2024-09-12T01:39:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.054+0000 7fb7faffd640 1 -- 172.21.15.60:0/609673267 learned_addr learned my addr 172.21.15.60:0/609673267 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.054+0000 7fb7fb7fe640 1 --2- 172.21.15.60:0/609673267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15f030 0x7fb7fc06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:23.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.054+0000 7fb7fa7fc640 1 --2- 172.21.15.60:0/609673267 >> v2:172.21.15.105:3300/0 conn(0x7fb7fc0b74c0 0x7fb7fc15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2028494751 0 0) 0x7fb7fc15fb10 con 0x7fb7fc15c2b0 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7e4003520 con 0x7fb7fc15c2b0 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 768388429 0 0) 0x7fb7e4003520 con 0x7fb7fc15c2b0 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15f030 msgr2=0x7fb7fc06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 --2- 172.21.15.60:0/609673267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15f030 0x7fb7fc06d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 >> v2:172.21.15.105:3300/0 conn(0x7fb7fc0b74c0 msgr2=0x7fb7fc15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 --2- 172.21.15.60:0/609673267 >> v2:172.21.15.105:3300/0 conn(0x7fb7fc0b74c0 0x7fb7fc15eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc06ce30 con 0x7fb7fc15c2b0 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fb7ec001670 con 0x7fb7fc15c2b0 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 >> v1:172.21.15.60:6789/0 conn(0x7fb7fc15c2b0 legacy=0x7fb7fc0b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 --2- 172.21.15.60:0/609673267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e40039b0 0x7fb7e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 --2- 172.21.15.60:0/609673267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15f030 0x7fb7e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:23.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 --2- 172.21.15.60:0/609673267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7e4004d40 0x7fb7e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:23.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc0b5900 con 0x7fb7e40039b0 2024-09-12T01:39:23.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc15f830 con 0x7fb7e4004d40 2024-09-12T01:39:23.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb7e400b9c0 con 0x7fb7fc15f030 2024-09-12T01:39:23.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7faffd640 1 --2- 172.21.15.60:0/609673267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e40039b0 0x7fb7e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:23.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7fa7fc640 1 --2- 172.21.15.60:0/609673267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15f030 0x7fb7e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:23.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7fb7fe640 1 --2- 172.21.15.60:0/609673267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7e4004d40 0x7fb7e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:23.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7faffd640 1 -- 172.21.15.60:0/609673267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15f030 msgr2=0x7fb7e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:23.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7faffd640 1 --2- 172.21.15.60:0/609673267 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15f030 0x7fb7e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:23.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7faffd640 1 -- 172.21.15.60:0/609673267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7e4004d40 msgr2=0x7fb7e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:23.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7faffd640 1 --2- 172.21.15.60:0/609673267 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7e4004d40 0x7fb7e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:23.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.055+0000 7fb7faffd640 1 -- 172.21.15.60:0/609673267 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e4003520 con 0x7fb7e40039b0 2024-09-12T01:39:23.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.056+0000 7fb7faffd640 1 --2- 172.21.15.60:0/609673267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e40039b0 0x7fb7e4003dd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec001050 tx=0x7fb7e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101fd7fa74b9f01a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:23.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.056+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec02e070 con 0x7fb7e40039b0 2024-09-12T01:39:23.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.056+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec005af0 con 0x7fb7e40039b0 2024-09-12T01:39:23.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.056+0000 7fb7f9ffb640 1 -- 172.21.15.60:0/609673267 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec007d70 con 0x7fb7e40039b0 2024-09-12T01:39:23.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.057+0000 7fb801386640 1 -- 172.21.15.60:0/609673267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e40039b0 msgr2=0x7fb7e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:23.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.057+0000 7fb801386640 1 --2- 172.21.15.60:0/609673267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7e40039b0 0x7fb7e4003dd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec001050 tx=0x7fb7e4005830 comp rx=0 tx=0).stop 2024-09-12T01:39:23.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.057+0000 7fb7fb7fe640 1 -- 172.21.15.60:0/609673267 reap_dead start 2024-09-12T01:39:23.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.057+0000 7fb801386640 1 -- 172.21.15.60:0/609673267 shutdown_connections 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.057+0000 7fb801386640 1 -- 172.21.15.60:0/609673267 >> 172.21.15.60:0/609673267 conn(0x7fb7fc0b4240 msgr2=0x7fb7fc0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.057+0000 7fb801386640 1 -- 172.21.15.60:0/609673267 shutdown_connections 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.057+0000 7fb801386640 1 -- 172.21.15.60:0/609673267 wait complete. 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.058+0000 7fb801386640 1 Processor -- start 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.058+0000 7fb801386640 1 -- start start 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.059+0000 7fb801386640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7e40039b0 0x7fb7fc0d2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.059+0000 7fb801386640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15aca0 0x7fb7fc1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.059+0000 7fb801386640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7fc1e8ce0 0x7fb7fc1e9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.059+0000 7fb801386640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc15f4c0 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.059+0000 7fb801386640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb7fc06d3f0 con 0x7fb7e40039b0 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.059+0000 7fb801386640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb7fc06d910 con 0x7fb7fc15aca0 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.059+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7fc1e8ce0 0x7fb7fc1e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.059+0000 7fb7fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7fc1e8ce0 0x7fb7fc1e9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35576/0 (socket says 172.21.15.60:35576) 2024-09-12T01:39:23.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.059+0000 7fb7fb7fe640 1 -- 172.21.15.60:0/2119648847 learned_addr learned my addr 172.21.15.60:0/2119648847 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.059+0000 7fb7fa7fc640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15aca0 0x7fb7fc1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.059+0000 7fb7faffd640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7e40039b0 0x7fb7fc0d2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.060+0000 7fb7fb7fe640 1 -- 172.21.15.60:0/2119648847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15aca0 msgr2=0x7fb7fc1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.060+0000 7fb7fb7fe640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15aca0 0x7fb7fc1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.060+0000 7fb7fb7fe640 1 -- 172.21.15.60:0/2119648847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7e40039b0 msgr2=0x7fb7fc0d2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.060+0000 7fb7fb7fe640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7e40039b0 0x7fb7fc0d2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.060+0000 7fb7fb7fe640 1 -- 172.21.15.60:0/2119648847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7fc0d1600 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.060+0000 7fb7fb7fe640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7fc1e8ce0 0x7fb7fc1e9160 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc072f40 tx=0x7fb7f400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.060+0000 7fb7e37fe640 1 -- 172.21.15.60:0/2119648847 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f400fce0 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.060+0000 7fb7e37fe640 1 -- 172.21.15.60:0/2119648847 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f401d070 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.060+0000 7fb801386640 1 -- 172.21.15.60:0/2119648847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7fc0d0840 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.060+0000 7fb7e37fe640 1 -- 172.21.15.60:0/2119648847 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4015670 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.060+0000 7fb801386640 1 -- 172.21.15.60:0/2119648847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7fc0d0e00 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.061+0000 7fb801386640 1 -- 172.21.15.60:0/2119648847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7fc15eaf0 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.061+0000 7fb7e37fe640 1 -- 172.21.15.60:0/2119648847 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7f4015810 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.062+0000 7fb7e37fe640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb7e806be30 0x7fb7e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:23.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.062+0000 7fb7e37fe640 1 -- 172.21.15.60:0/2119648847 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fb7f408b720 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.062+0000 7fb7faffd640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb7e806be30 0x7fb7e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:23.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.062+0000 7fb7faffd640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb7e806be30 0x7fb7e806e2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec033000 tx=0x7fb7ec009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:23.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.066+0000 7fb7e37fe640 1 -- 172.21.15.60:0/2119648847 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7f4010040 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.277+0000 7fb801386640 1 -- 172.21.15.60:0/2119648847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb7fc0b3fb0 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.278+0000 7fb7e37fe640 1 -- 172.21.15.60:0/2119648847 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) ==== 53+0+73 (secure 0 0 0) 0x7fb7f405a040 con 0x7fb7fc1e8ce0 2024-09-12T01:39:23.277 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:39:23.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.280+0000 7fb801386640 1 -- 172.21.15.60:0/2119648847 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb7e806be30 msgr2=0x7fb7e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:23.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.280+0000 7fb801386640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb7e806be30 0x7fb7e806e2f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec033000 tx=0x7fb7ec009030 comp rx=0 tx=0).stop 2024-09-12T01:39:23.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.280+0000 7fb801386640 1 -- 172.21.15.60:0/2119648847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7fc1e8ce0 msgr2=0x7fb7fc1e9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:23.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.280+0000 7fb801386640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7fc1e8ce0 0x7fb7fc1e9160 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc072f40 tx=0x7fb7f400f1b0 comp rx=0 tx=0).stop 2024-09-12T01:39:23.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.280+0000 7fb801386640 1 -- 172.21.15.60:0/2119648847 shutdown_connections 2024-09-12T01:39:23.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.280+0000 7fb801386640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7fc1e8ce0 0x7fb7fc1e9160 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:23.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.280+0000 7fb801386640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb7e806be30 0x7fb7e806e2f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:23.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.280+0000 7fb801386640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7fc15aca0 0x7fb7fc1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:23.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.280+0000 7fb801386640 1 --2- 172.21.15.60:0/2119648847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7e40039b0 0x7fb7fc0d2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:23.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.280+0000 7fb801386640 1 -- 172.21.15.60:0/2119648847 >> 172.21.15.60:0/2119648847 conn(0x7fb7fc0b4240 msgr2=0x7fb7fc0cd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:23.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.280+0000 7fb801386640 1 -- 172.21.15.60:0/2119648847 shutdown_connections 2024-09-12T01:39:23.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23.280+0000 7fb801386640 1 -- 172.21.15.60:0/2119648847 wait complete. 2024-09-12T01:39:23.290 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:39:23.290 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:39:23.290 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T01:39:23.290 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:39:23.290 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:39:23.290 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:39:23.290 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:39:23.290 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:39:23.291 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:39:23.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:23.291 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T01:39:23.307 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:39:23.307 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:39:23.307 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:39:23.307 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:23.307 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42557sec preferred_lft 42557sec 2024-09-12T01:39:23.308 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e8cb:28ff:fea3:34fb/64 scope link 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 72:47:53:4d:4f:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:39:23.309 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7047:53ff:fe4d:4fc7/64 scope link 2024-09-12T01:39:23.310 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:23.310 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:39:23.310 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:39:23.310 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::183c:47ff:fec1:173/64 scope link 2024-09-12T01:39:23.310 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:23.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:23.310 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:39:23.371 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T01:39:23.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:23.373 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T01:39:23.430 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T01:39:23.430 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:39:23.430 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:39:23.430 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:39:23.430 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:39:23.431 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:39:23.431 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:39:23.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:39:23.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:39:23.431 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:39:23.431 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:39:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:39:23.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:39:23.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:23.559 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:39:23.575 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:39:23.575 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:39:23.576 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:39:23.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:23.576 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-12T01:39:23.642 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:39:23.642 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:39:23.698 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:39:23.699 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:39:23.699 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:39:23.754 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T01:39:23.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:23.755 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:39:23.841 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:39:23.841 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:39:23.849 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:39:23.850 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:39:23.850 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:39:23.850 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:39:23.850 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:39:23.850 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:39:23.850 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:39:23.850 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:39:23.850 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:39:23.850 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:39:23.852 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:39:23.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:23.852 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:39:23.919 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:39:24.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:39:24.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:39:24.024 INFO:teuthology.orchestra.run.smithi060.stdout:client5956 2024-09-12T01:39:24.024 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:39:24.024 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:39:24.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:39:24.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.184+0000 7f6c115fd640 1 Processor -- start 2024-09-12T01:39:24.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.184+0000 7f6c115fd640 1 -- start start 2024-09-12T01:39:24.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.185+0000 7f6c115fd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6c0c0d1c80 0x7f6c0c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:24.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.185+0000 7f6c115fd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c0c0cfc20 con 0x7f6c0c0cf6b0 2024-09-12T01:39:24.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.185+0000 7f6c115fd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c0c0d2ed0 con 0x7f6c0c0b63d0 2024-09-12T01:39:24.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.185+0000 7f6c115fd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6c0c0d40c0 con 0x7f6c0c0d1c80 2024-09-12T01:39:24.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.185+0000 7f6c0a7fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6c0c0cf6b0 0x7f6c0c1629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39580/0 (socket says 172.21.15.60:39580) 2024-09-12T01:39:24.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.185+0000 7f6c0a7fc640 1 -- 172.21.15.60:0/1777037004 learned_addr learned my addr 172.21.15.60:0/1777037004 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:24.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.185+0000 7f6c0b7fe640 1 --2- 172.21.15.60:0/1777037004 >> v2:172.21.15.105:3300/0 conn(0x7f6c0c0d1c80 0x7f6c0c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:24.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.185+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1862970172 0 0) 0x7f6c0c0cfc20 con 0x7f6c0c0cf6b0 2024-09-12T01:39:24.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bf8003520 con 0x7f6c0c0cf6b0 2024-09-12T01:39:24.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 867316995 0 0) 0x7f6bf8003520 con 0x7f6c0c0cf6b0 2024-09-12T01:39:24.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 >> v2:172.21.15.105:3300/0 conn(0x7f6c0c0d1c80 msgr2=0x7f6c0c0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 --2- 172.21.15.60:0/1777037004 >> v2:172.21.15.105:3300/0 conn(0x7f6c0c0d1c80 0x7f6c0c0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 >> v1:172.21.15.105:6789/0 conn(0x7f6c0c0b63d0 legacy=0x7f6c0c0d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0c0d31b0 con 0x7f6c0c0cf6b0 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f6bf4001670 con 0x7f6c0c0cf6b0 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 >> v1:172.21.15.60:6789/0 conn(0x7f6c0c0cf6b0 legacy=0x7f6c0c1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 --2- 172.21.15.60:0/1777037004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bf80039b0 0x7f6bf8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 --2- 172.21.15.60:0/1777037004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 0x7f6bf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 --2- 172.21.15.60:0/1777037004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bf80051c0 0x7f6bf800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c0d40c0 con 0x7f6bf8004800 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf800c160 con 0x7f6bf80051c0 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf800c360 con 0x7f6bf80039b0 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c0a7fc640 1 --2- 172.21.15.60:0/1777037004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 0x7f6bf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:24.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c0b7fe640 1 --2- 172.21.15.60:0/1777037004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bf80051c0 0x7f6bf800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c0affd640 1 --2- 172.21.15.60:0/1777037004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bf80039b0 0x7f6bf8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c0a7fc640 1 -- 172.21.15.60:0/1777037004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bf80039b0 msgr2=0x7f6bf8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c0a7fc640 1 --2- 172.21.15.60:0/1777037004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bf80039b0 0x7f6bf8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c0a7fc640 1 -- 172.21.15.60:0/1777037004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bf80051c0 msgr2=0x7f6bf800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c0a7fc640 1 --2- 172.21.15.60:0/1777037004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bf80051c0 0x7f6bf800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c0a7fc640 1 -- 172.21.15.60:0/1777037004 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf8003520 con 0x7f6bf8004800 2024-09-12T01:39:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c0b7fe640 1 -- 172.21.15.60:0/1777037004 reap_dead start 2024-09-12T01:39:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.186+0000 7f6c0affd640 1 --2- 172.21.15.60:0/1777037004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bf80039b0 0x7f6bf8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.187+0000 7f6c0a7fc640 1 --2- 172.21.15.60:0/1777037004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 0x7f6bf8004c80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400c210 tx=0x7f6bf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ee1eac9e897328 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.187+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4007d30 con 0x7f6bf8004800 2024-09-12T01:39:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.187+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf4005ad0 con 0x7f6bf8004800 2024-09-12T01:39:24.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.187+0000 7f6c09ffb640 1 -- 172.21.15.60:0/1777037004 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf4007070 con 0x7f6bf8004800 2024-09-12T01:39:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.188+0000 7f6c115fd640 1 -- 172.21.15.60:0/1777037004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 msgr2=0x7f6bf8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:24.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.188+0000 7f6c115fd640 1 --2- 172.21.15.60:0/1777037004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 0x7f6bf8004c80 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f6bf400c210 tx=0x7f6bf8005830 comp rx=0 tx=0).stop 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.188+0000 7f6c115fd640 1 -- 172.21.15.60:0/1777037004 shutdown_connections 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.188+0000 7f6c115fd640 1 --2- 172.21.15.60:0/1777037004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 0x7f6bf8004c80 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.188+0000 7f6c115fd640 1 -- 172.21.15.60:0/1777037004 >> 172.21.15.60:0/1777037004 conn(0x7f6c0c0d1160 msgr2=0x7f6c0c0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.188+0000 7f6c115fd640 1 -- 172.21.15.60:0/1777037004 shutdown_connections 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.188+0000 7f6c115fd640 1 -- 172.21.15.60:0/1777037004 wait complete. 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.189+0000 7f6c115fd640 1 Processor -- start 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.189+0000 7f6c115fd640 1 -- start start 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c115fd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 0x7f6c0c14a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c115fd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c0c15ae10 0x7f6c0c14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c115fd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c0c14ac20 0x7f6c0c162430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c115fd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c0cb5c0 con 0x7f6bf8004800 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c115fd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c0cb440 con 0x7f6c0c15ae10 2024-09-12T01:39:24.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c115fd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6c0c0b67b0 con 0x7f6c0c14ac20 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c0affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 0x7f6c0c14a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c0affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 0x7f6c0c14a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35590/0 (socket says 172.21.15.60:35590) 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c0affd640 1 -- 172.21.15.60:0/3588245987 learned_addr learned my addr 172.21.15.60:0/3588245987 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c0a7fc640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c0c15ae10 0x7f6c0c14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c0b7fe640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c0c14ac20 0x7f6c0c162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c0affd640 1 -- 172.21.15.60:0/3588245987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c0c14ac20 msgr2=0x7f6c0c162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c0affd640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c0c14ac20 0x7f6c0c162430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c0affd640 1 -- 172.21.15.60:0/3588245987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c0c15ae10 msgr2=0x7f6c0c14d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c0affd640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c0c15ae10 0x7f6c0c14d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c0affd640 1 -- 172.21.15.60:0/3588245987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0c0cb7b0 con 0x7f6bf8004800 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.190+0000 7f6c0affd640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 0x7f6c0c14a420 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00e800 tx=0x7f6bfc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.191+0000 7f6c037fe640 1 -- 172.21.15.60:0/3588245987 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc003b80 con 0x7f6bf8004800 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.191+0000 7f6c037fe640 1 -- 172.21.15.60:0/3588245987 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bfc018070 con 0x7f6bf8004800 2024-09-12T01:39:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.191+0000 7f6c037fe640 1 -- 172.21.15.60:0/3588245987 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc0050d0 con 0x7f6bf8004800 2024-09-12T01:39:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.191+0000 7f6c115fd640 1 -- 172.21.15.60:0/3588245987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c0c0cd490 con 0x7f6bf8004800 2024-09-12T01:39:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.191+0000 7f6c115fd640 1 -- 172.21.15.60:0/3588245987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c0c14dbc0 con 0x7f6bf8004800 2024-09-12T01:39:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.192+0000 7f6c115fd640 1 -- 172.21.15.60:0/3588245987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c0c0d39b0 con 0x7f6bf8004800 2024-09-12T01:39:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.192+0000 7f6c037fe640 1 -- 172.21.15.60:0/3588245987 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bfc005270 con 0x7f6bf8004800 2024-09-12T01:39:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.193+0000 7f6c037fe640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bec06be30 0x7f6bec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.193+0000 7f6c037fe640 1 -- 172.21.15.60:0/3588245987 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f6bfc08adb0 con 0x7f6bf8004800 2024-09-12T01:39:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.193+0000 7f6c0a7fc640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bec06be30 0x7f6bec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:24.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.193+0000 7f6c0a7fc640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bec06be30 0x7f6bec06e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4032000 tx=0x7f6bf402d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:24.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.197+0000 7f6c037fe640 1 -- 172.21.15.60:0/3588245987 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6bfc059760 con 0x7f6bf8004800 2024-09-12T01:39:24.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.407+0000 7f6c115fd640 1 -- 172.21.15.60:0/3588245987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6c0c0b6d00 con 0x7f6bf8004800 2024-09-12T01:39:24.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.408+0000 7f6c037fe640 1 -- 172.21.15.60:0/3588245987 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) ==== 53+0+73 (secure 0 0 0) 0x7f6bfc059060 con 0x7f6bf8004800 2024-09-12T01:39:24.407 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:39:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.410+0000 7f6c115fd640 1 -- 172.21.15.60:0/3588245987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bec06be30 msgr2=0x7f6bec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.410+0000 7f6c115fd640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bec06be30 0x7f6bec06e2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6bf4032000 tx=0x7f6bf402d000 comp rx=0 tx=0).stop 2024-09-12T01:39:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.410+0000 7f6c115fd640 1 -- 172.21.15.60:0/3588245987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 msgr2=0x7f6c0c14a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.410+0000 7f6c115fd640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 0x7f6c0c14a420 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00e800 tx=0x7f6bfc00ecc0 comp rx=0 tx=0).stop 2024-09-12T01:39:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.410+0000 7f6c115fd640 1 -- 172.21.15.60:0/3588245987 shutdown_connections 2024-09-12T01:39:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.410+0000 7f6c115fd640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bec06be30 0x7f6bec06e2f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.410+0000 7f6c115fd640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c0c14ac20 0x7f6c0c162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.410+0000 7f6c115fd640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c0c15ae10 0x7f6c0c14d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.410+0000 7f6c115fd640 1 --2- 172.21.15.60:0/3588245987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf8004800 0x7f6c0c14a420 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.410+0000 7f6c115fd640 1 -- 172.21.15.60:0/3588245987 >> 172.21.15.60:0/3588245987 conn(0x7f6c0c0d1160 msgr2=0x7f6c0c0b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.410+0000 7f6c115fd640 1 -- 172.21.15.60:0/3588245987 shutdown_connections 2024-09-12T01:39:24.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:24.410+0000 7f6c115fd640 1 -- 172.21.15.60:0/3588245987 wait complete. 2024-09-12T01:39:24.420 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:39:24.420 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:39:24.420 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T01:39:24.420 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:39:24.421 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:39:24.421 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:39:24.421 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:39:24.421 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:39:24.421 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:39:24.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:24.421 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T01:39:24.442 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:39:24.442 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:39:24.442 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:39:24.442 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:24.443 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:39:24.443 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:24.443 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:39:24.443 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:39:24.443 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T01:39:24.443 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:39:24.443 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:39:24.443 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T01:39:24.444 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:39:24.444 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:39:24.444 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:39:24.444 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:39:24.444 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:39:24.444 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42558sec preferred_lft 42558sec 2024-09-12T01:39:24.444 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T01:39:24.444 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:24.445 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:39:24.445 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff 2024-09-12T01:39:24.445 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:39:24.445 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:24.445 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::c46c:baff:feeb:1f5e/64 scope link 2024-09-12T01:39:24.445 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:24.445 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:39:24.445 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 56:66:28:3d:b2:45 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:39:24.446 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::5466:28ff:fe3d:b245/64 scope link 2024-09-12T01:39:24.446 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:24.446 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:39:24.446 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:39:24.446 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::2036:4aff:fe87:b9cb/64 scope link 2024-09-12T01:39:24.446 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:39:24.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:24.447 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:39:24.511 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:39:24.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:24.512 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T01:39:24.571 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T01:39:24.571 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:39:24.571 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:39:24.571 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:39:24.572 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:39:24.572 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:39:24.572 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:39:24.572 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:39:24.572 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:39:24.572 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:39:24.572 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:39:24.663 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:39:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:39:24.697 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:39:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:39:24.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:24.703 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:39:24.719 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T01:39:24.719 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:39:24.719 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:39:24.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:24.719 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-12T01:39:24.784 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:39:24.785 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:39:24.840 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:39:24.840 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:39:24.840 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:39:24.895 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T01:39:24.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:24.896 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:39:24.979 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:39:24.979 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:39:24.987 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:39:24.987 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:39:24.987 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:39:24.987 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 1@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:39:24.987 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:39:24.988 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:39:24.988 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:39:24.988 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:39:24.988 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:39:24.988 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:39:24.990 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:39:24.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:39:24.990 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:39:25.055 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:39:25.144 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:39:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:39:25.146 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:39:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:39:25.151 INFO:teuthology.orchestra.run.smithi105.stdout:client6372 2024-09-12T01:39:25.152 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:39:25.152 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:39:25.168 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-09-12T01:39:25.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.287+0000 7f7d0f21e640 1 Processor -- start 2024-09-12T01:39:25.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.288+0000 7f7d0f21e640 1 -- start start 2024-09-12T01:39:25.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.288+0000 7f7d0f21e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7d0815e7a0 0x7f7d0806caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.288+0000 7f7d0f21e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d080cf1f0 0x7f7d080b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.288+0000 7f7d0f21e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d080b6720 0x7f7d081623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.288+0000 7f7d0f21e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7d080d2ca0 con 0x7f7d080b6720 2024-09-12T01:39:25.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.288+0000 7f7d0f21e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7d080cf860 con 0x7f7d0815e7a0 2024-09-12T01:39:25.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.288+0000 7f7d0f21e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7d080cfb40 con 0x7f7d080cf1f0 2024-09-12T01:39:25.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.289+0000 7f7d0d7bb640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d080b6720 0x7f7d081623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.289+0000 7f7d0d7bb640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d080b6720 0x7f7d081623c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35600/0 (socket says 172.21.15.60:35600) 2024-09-12T01:39:25.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.289+0000 7f7d0d7bb640 1 -- 172.21.15.60:0/739119143 learned_addr learned my addr 172.21.15.60:0/739119143 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:25.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.289+0000 7f7d0cfba640 1 --2- 172.21.15.60:0/739119143 >> v2:172.21.15.105:3300/0 conn(0x7f7d0815e7a0 0x7f7d0806caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.289+0000 7f7d07fff640 1 --2- 172.21.15.60:0/739119143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d080cf1f0 0x7f7d080b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.289+0000 7f7d0d7bb640 1 -- 172.21.15.60:0/739119143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d080cf1f0 msgr2=0x7f7d080b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:25.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.289+0000 7f7d0d7bb640 1 --2- 172.21.15.60:0/739119143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d080cf1f0 0x7f7d080b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.289+0000 7f7d0d7bb640 1 -- 172.21.15.60:0/739119143 >> v2:172.21.15.105:3300/0 conn(0x7f7d0815e7a0 msgr2=0x7f7d0806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:25.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.289+0000 7f7d0d7bb640 1 --2- 172.21.15.60:0/739119143 >> v2:172.21.15.105:3300/0 conn(0x7f7d0815e7a0 0x7f7d0806caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.289+0000 7f7d0d7bb640 1 -- 172.21.15.60:0/739119143 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d080cfe20 con 0x7f7d080b6720 2024-09-12T01:39:25.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.290+0000 7f7d0d7bb640 1 --2- 172.21.15.60:0/739119143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d080b6720 0x7f7d081623c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7d080d5820 tx=0x7f7d0002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11aa9e8aea7348f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:25.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.290+0000 7f7d077fe640 1 -- 172.21.15.60:0/739119143 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d00036070 con 0x7f7d080b6720 2024-09-12T01:39:25.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.290+0000 7f7d077fe640 1 -- 172.21.15.60:0/739119143 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d00031600 con 0x7f7d080b6720 2024-09-12T01:39:25.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.290+0000 7f7d077fe640 1 -- 172.21.15.60:0/739119143 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d000319d0 con 0x7f7d080b6720 2024-09-12T01:39:25.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.291+0000 7f7d0f21e640 1 -- 172.21.15.60:0/739119143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d080b6720 msgr2=0x7f7d081623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.291+0000 7f7d0f21e640 1 --2- 172.21.15.60:0/739119143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d080b6720 0x7f7d081623c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7d080d5820 tx=0x7f7d0002a610 comp rx=0 tx=0).stop 2024-09-12T01:39:25.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.291+0000 7f7d0f21e640 1 -- 172.21.15.60:0/739119143 shutdown_connections 2024-09-12T01:39:25.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.291+0000 7f7d0f21e640 1 --2- 172.21.15.60:0/739119143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d080b6720 0x7f7d081623c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.291+0000 7f7d0f21e640 1 --2- 172.21.15.60:0/739119143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d080cf1f0 0x7f7d080b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.291+0000 7f7d0f21e640 1 --2- 172.21.15.60:0/739119143 >> v2:172.21.15.105:3300/0 conn(0x7f7d0815e7a0 0x7f7d0806caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.291+0000 7f7d0f21e640 1 -- 172.21.15.60:0/739119143 >> 172.21.15.60:0/739119143 conn(0x7f7d080d11e0 msgr2=0x7f7d080d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:25.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.291+0000 7f7d0f21e640 1 -- 172.21.15.60:0/739119143 shutdown_connections 2024-09-12T01:39:25.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.291+0000 7f7d0f21e640 1 -- 172.21.15.60:0/739119143 wait complete. 2024-09-12T01:39:25.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.292+0000 7f7d0f21e640 1 Processor -- start 2024-09-12T01:39:25.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.292+0000 7f7d0f21e640 1 -- start start 2024-09-12T01:39:25.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.293+0000 7f7d0f21e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d080b6720 0x7f7d080c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.293+0000 7f7d0f21e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d080cf1f0 0x7f7d08152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.293+0000 7f7d0f21e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d0815e7a0 0x7f7d081e8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.293+0000 7f7d0f21e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7d0806cfe0 con 0x7f7d0815e7a0 2024-09-12T01:39:25.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.293+0000 7f7d0f21e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d080b7a00 con 0x7f7d080cf1f0 2024-09-12T01:39:25.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.293+0000 7f7d0f21e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7d0815eb80 con 0x7f7d080b6720 2024-09-12T01:39:25.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.293+0000 7f7d0cfba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d080b6720 0x7f7d080c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.293+0000 7f7d0cfba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d080b6720 0x7f7d080c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:55308/0 (socket says 172.21.15.60:55308) 2024-09-12T01:39:25.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.293+0000 7f7d0d7bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d0815e7a0 0x7f7d081e8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.293+0000 7f7d0cfba640 1 -- 172.21.15.60:0/878332041 learned_addr learned my addr 172.21.15.60:0/878332041 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:25.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.293+0000 7f7d07fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d080cf1f0 0x7f7d08152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.294+0000 7f7d0cfba640 1 -- 172.21.15.60:0/878332041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d080cf1f0 msgr2=0x7f7d08152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.294+0000 7f7d0cfba640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d080cf1f0 0x7f7d08152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.294+0000 7f7d0cfba640 1 -- 172.21.15.60:0/878332041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d0815e7a0 msgr2=0x7f7d081e8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.294+0000 7f7d0cfba640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d0815e7a0 0x7f7d081e8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.294+0000 7f7d0cfba640 1 -- 172.21.15.60:0/878332041 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d081e90f0 con 0x7f7d080b6720 2024-09-12T01:39:25.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.294+0000 7f7d07fff640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d080cf1f0 0x7f7d08152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:39:25.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.294+0000 7f7d0cfba640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d080b6720 0x7f7d080c83d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800e9b0 tx=0x7f7cf800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:25.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.294+0000 7f7d057fa640 1 -- 172.21.15.60:0/878332041 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8017070 con 0x7f7d080b6720 2024-09-12T01:39:25.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.294+0000 7f7d057fa640 1 -- 172.21.15.60:0/878332041 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cf800c9a0 con 0x7f7d080b6720 2024-09-12T01:39:25.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.294+0000 7f7d0f21e640 1 -- 172.21.15.60:0/878332041 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d080c89b0 con 0x7f7d080b6720 2024-09-12T01:39:25.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.294+0000 7f7d057fa640 1 -- 172.21.15.60:0/878332041 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800cd90 con 0x7f7d080b6720 2024-09-12T01:39:25.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.294+0000 7f7d0f21e640 1 -- 172.21.15.60:0/878332041 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d080c8f70 con 0x7f7d080b6720 2024-09-12T01:39:25.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.295+0000 7f7d0f21e640 1 -- 172.21.15.60:0/878332041 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d080b61e0 con 0x7f7d080b6720 2024-09-12T01:39:25.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.296+0000 7f7d057fa640 1 -- 172.21.15.60:0/878332041 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7cf801a070 con 0x7f7d080b6720 2024-09-12T01:39:25.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.296+0000 7f7d057fa640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7cf406be30 0x7f7cf406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.296+0000 7f7d057fa640 1 -- 172.21.15.60:0/878332041 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f7cf808b1c0 con 0x7f7d080b6720 2024-09-12T01:39:25.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.296+0000 7f7d07fff640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7cf406be30 0x7f7cf406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.297+0000 7f7d07fff640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7cf406be30 0x7f7cf406e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7d080cb3f0 tx=0x7f7cfc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:25.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.301+0000 7f7d057fa640 1 -- 172.21.15.60:0/878332041 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7cf8059510 con 0x7f7d080b6720 2024-09-12T01:39:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.475+0000 7f7d0f21e640 1 -- 172.21.15.60:0/878332041 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7f7d080cefb0 con 0x7f7d080b6720 2024-09-12T01:39:25.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.480+0000 7f7d057fa640 1 -- 172.21.15.60:0/878332041 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f7cf805d810 con 0x7f7d080b6720 2024-09-12T01:39:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.482+0000 7f7d0f21e640 1 -- 172.21.15.60:0/878332041 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7cf406be30 msgr2=0x7f7cf406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.482+0000 7f7d0f21e640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7cf406be30 0x7f7cf406e2f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7d080cb3f0 tx=0x7f7cfc009190 comp rx=0 tx=0).stop 2024-09-12T01:39:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.482+0000 7f7d0f21e640 1 -- 172.21.15.60:0/878332041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d080b6720 msgr2=0x7f7d080c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.482+0000 7f7d0f21e640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d080b6720 0x7f7d080c83d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800e9b0 tx=0x7f7cf800ee70 comp rx=0 tx=0).stop 2024-09-12T01:39:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.482+0000 7f7d0f21e640 1 -- 172.21.15.60:0/878332041 shutdown_connections 2024-09-12T01:39:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.482+0000 7f7d0f21e640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d0815e7a0 0x7f7d081e8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.482+0000 7f7d0f21e640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d080cf1f0 0x7f7d08152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.482+0000 7f7d0f21e640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7cf406be30 0x7f7cf406e2f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.482+0000 7f7d0f21e640 1 --2- 172.21.15.60:0/878332041 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d080b6720 0x7f7d080c83d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.482+0000 7f7d0f21e640 1 -- 172.21.15.60:0/878332041 >> 172.21.15.60:0/878332041 conn(0x7f7d080d11e0 msgr2=0x7f7d080d15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:25.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.482+0000 7f7d0f21e640 1 -- 172.21.15.60:0/878332041 shutdown_connections 2024-09-12T01:39:25.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.482+0000 7f7d0f21e640 1 -- 172.21.15.60:0/878332041 wait complete. 2024-09-12T01:39:25.493 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 200 2024-09-12T01:39:25.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.599+0000 7f8c9ec82640 1 Processor -- start 2024-09-12T01:39:25.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.599+0000 7f8c9ec82640 1 -- start start 2024-09-12T01:39:25.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.600+0000 7f8c9ec82640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8c980d1c10 0x7f8c980cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.600+0000 7f8c9ec82640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c980b7ad0 con 0x7f8c980cf2f0 2024-09-12T01:39:25.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.600+0000 7f8c9ec82640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c980cf760 con 0x7f8c9815e600 2024-09-12T01:39:25.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.600+0000 7f8c9ec82640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8c980d2ee0 con 0x7f8c980d1c10 2024-09-12T01:39:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.600+0000 7f8c9d21f640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8c980cf2f0 0x7f8c980d3370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39588/0 (socket says 172.21.15.60:39588) 2024-09-12T01:39:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.600+0000 7f8c9d21f640 1 -- 172.21.15.60:0/1982646092 learned_addr learned my addr 172.21.15.60:0/1982646092 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.600+0000 7f8c97fff640 1 --2- 172.21.15.60:0/1982646092 >> v2:172.21.15.105:3300/0 conn(0x7f8c980d1c10 0x7f8c980cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.600+0000 7f8c977fe640 1 -- 172.21.15.60:0/1982646092 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893701451 0 0) 0x7f8c90001490 con 0x7f8c980cf2f0 2024-09-12T01:39:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.601+0000 7f8c977fe640 1 -- 172.21.15.60:0/1982646092 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c88003520 con 0x7f8c980cf2f0 2024-09-12T01:39:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.601+0000 7f8c97fff640 1 -- 172.21.15.60:0/1982646092 >> v1:172.21.15.105:6789/0 conn(0x7f8c9815e600 legacy=0x7f8c980d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.601+0000 7f8c97fff640 1 -- 172.21.15.60:0/1982646092 >> v1:172.21.15.60:6789/0 conn(0x7f8c980cf2f0 legacy=0x7f8c980d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.601+0000 7f8c97fff640 1 -- 172.21.15.60:0/1982646092 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c980cf9e0 con 0x7f8c980d1c10 2024-09-12T01:39:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.601+0000 7f8c97fff640 1 --2- 172.21.15.60:0/1982646092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c980d1c10 0x7f8c980cedb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8c980d3060 tx=0x7f8c8402a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39297b09bff46cd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.601+0000 7f8c977fe640 1 -- 172.21.15.60:0/1982646092 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84037070 con 0x7f8c980d1c10 2024-09-12T01:39:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.602+0000 7f8c977fe640 1 -- 172.21.15.60:0/1982646092 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c84032440 con 0x7f8c980d1c10 2024-09-12T01:39:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.602+0000 7f8c977fe640 1 -- 172.21.15.60:0/1982646092 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c840327f0 con 0x7f8c980d1c10 2024-09-12T01:39:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.602+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1982646092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c980d1c10 msgr2=0x7f8c980cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.602+0000 7f8c9ec82640 1 --2- 172.21.15.60:0/1982646092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c980d1c10 0x7f8c980cedb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8c980d3060 tx=0x7f8c8402a210 comp rx=0 tx=0).stop 2024-09-12T01:39:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.602+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1982646092 shutdown_connections 2024-09-12T01:39:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.602+0000 7f8c9ec82640 1 --2- 172.21.15.60:0/1982646092 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c980d1c10 0x7f8c980cedb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.602+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1982646092 >> 172.21.15.60:0/1982646092 conn(0x7f8c9806c2c0 msgr2=0x7f8c9806c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.602+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1982646092 shutdown_connections 2024-09-12T01:39:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.602+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1982646092 wait complete. 2024-09-12T01:39:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.603+0000 7f8c9ec82640 1 Processor -- start 2024-09-12T01:39:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.603+0000 7f8c9ec82640 1 -- start start 2024-09-12T01:39:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.604+0000 7f8c9ec82640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c980cf2f0 0x7f8c9814e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.604+0000 7f8c9ec82640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c980d1c10 0x7f8c98158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.604+0000 7f8c9ec82640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9815e600 0x7f8c98158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.604+0000 7f8c9ec82640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8c980d2b70 con 0x7f8c980cf2f0 2024-09-12T01:39:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.604+0000 7f8c9ec82640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8c980cffa0 con 0x7f8c9815e600 2024-09-12T01:39:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.604+0000 7f8c9ec82640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8c9815e9e0 con 0x7f8c980d1c10 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.604+0000 7f8c9ca1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c980cf2f0 0x7f8c9814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.604+0000 7f8c9ca1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c980cf2f0 0x7f8c9814e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35616/0 (socket says 172.21.15.60:35616) 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.604+0000 7f8c9ca1e640 1 -- 172.21.15.60:0/1215280284 learned_addr learned my addr 172.21.15.60:0/1215280284 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c9d21f640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9815e600 0x7f8c98158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c9ca1e640 1 -- 172.21.15.60:0/1215280284 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c980d1c10 msgr2=0x7f8c98158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c9ca1e640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c980d1c10 0x7f8c98158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c9ca1e640 1 -- 172.21.15.60:0/1215280284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9815e600 msgr2=0x7f8c98158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c9ca1e640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9815e600 0x7f8c98158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c9ca1e640 1 -- 172.21.15.60:0/1215280284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c981560c0 con 0x7f8c980cf2f0 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c9d21f640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9815e600 0x7f8c98158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c9ca1e640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c980cf2f0 0x7f8c9814e500 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c3c0 tx=0x7f8c8c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c957fa640 1 -- 172.21.15.60:0/1215280284 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0052d0 con 0x7f8c980cf2f0 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c957fa640 1 -- 172.21.15.60:0/1215280284 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8c005470 con 0x7f8c980cf2f0 2024-09-12T01:39:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1215280284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c981563a0 con 0x7f8c980cf2f0 2024-09-12T01:39:25.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c957fa640 1 -- 172.21.15.60:0/1215280284 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c007260 con 0x7f8c980cf2f0 2024-09-12T01:39:25.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.605+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1215280284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c98156960 con 0x7f8c980cf2f0 2024-09-12T01:39:25.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.606+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1215280284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c980cedb0 con 0x7f8c980cf2f0 2024-09-12T01:39:25.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.607+0000 7f8c957fa640 1 -- 172.21.15.60:0/1215280284 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8c8c007400 con 0x7f8c980cf2f0 2024-09-12T01:39:25.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.607+0000 7f8c957fa640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8c7c06be30 0x7f8c7c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.607+0000 7f8c957fa640 1 -- 172.21.15.60:0/1215280284 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f8c8c08a2e0 con 0x7f8c980cf2f0 2024-09-12T01:39:25.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.607+0000 7f8c97fff640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8c7c06be30 0x7f8c7c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.607+0000 7f8c97fff640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8c7c06be30 0x7f8c7c06e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8c84034000 tx=0x7f8c8402c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:25.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.611+0000 7f8c957fa640 1 -- 172.21.15.60:0/1215280284 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8c980cf760 con 0x7f8c980cf2f0 2024-09-12T01:39:25.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.787+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1215280284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7f8c980d25f0 con 0x7f8c980cf2f0 2024-09-12T01:39:25.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.790+0000 7f8c957fa640 1 -- 172.21.15.60:0/1215280284 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v26)=0 v26) ==== 119+0+0 (secure 0 0 0) 0x7f8c8c058d20 con 0x7f8c980cf2f0 2024-09-12T01:39:25.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.792+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1215280284 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8c7c06be30 msgr2=0x7f8c7c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.792+0000 7f8c9ec82640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8c7c06be30 0x7f8c7c06e2f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8c84034000 tx=0x7f8c8402c000 comp rx=0 tx=0).stop 2024-09-12T01:39:25.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.792+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1215280284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c980cf2f0 msgr2=0x7f8c9814e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.792+0000 7f8c9ec82640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c980cf2f0 0x7f8c9814e500 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c00c3c0 tx=0x7f8c8c00c880 comp rx=0 tx=0).stop 2024-09-12T01:39:25.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.792+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1215280284 shutdown_connections 2024-09-12T01:39:25.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.792+0000 7f8c9ec82640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8c9815e600 0x7f8c98158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.792+0000 7f8c9ec82640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8c7c06be30 0x7f8c7c06e2f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.792+0000 7f8c9ec82640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8c980d1c10 0x7f8c98158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.792+0000 7f8c9ec82640 1 --2- 172.21.15.60:0/1215280284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c980cf2f0 0x7f8c9814e500 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.792+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1215280284 >> 172.21.15.60:0/1215280284 conn(0x7f8c9806c2c0 msgr2=0x7f8c980d3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:25.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.793+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1215280284 shutdown_connections 2024-09-12T01:39:25.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.793+0000 7f8c9ec82640 1 -- 172.21.15.60:0/1215280284 wait complete. 2024-09-12T01:39:25.803 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 400 2024-09-12T01:39:25.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.909+0000 7f78d80ae640 1 Processor -- start 2024-09-12T01:39:25.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.909+0000 7f78d80ae640 1 -- start start 2024-09-12T01:39:25.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.910+0000 7f78d80ae640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d006fe20 0x7f78d0073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.910+0000 7f78d80ae640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f78d015e730 0x7f78d0073d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.910+0000 7f78d80ae640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78d006bd40 con 0x7f78d015e350 2024-09-12T01:39:25.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.910+0000 7f78d80ae640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f78d006c020 con 0x7f78d015e730 2024-09-12T01:39:25.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.910+0000 7f78d80ae640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f78d006c300 con 0x7f78d006fe20 2024-09-12T01:39:25.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.910+0000 7f78d5e4a640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f78d015e350 0x7f78d006f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39602/0 (socket says 172.21.15.60:39602) 2024-09-12T01:39:25.911 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.910+0000 7f78d5e4a640 1 -- 172.21.15.60:0/350050015 learned_addr learned my addr 172.21.15.60:0/350050015 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.910+0000 7f78d5649640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d006fe20 0x7f78d0073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.910+0000 7f78d664b640 1 --2- 172.21.15.60:0/350050015 >> v2:172.21.15.105:3300/0 conn(0x7f78d015e730 0x7f78d0073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.910+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2633677102 0 0) 0x7f78d006bd40 con 0x7f78d015e350 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.910+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78bc003520 con 0x7f78d015e350 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2017045505 0 0) 0x7f78bc003520 con 0x7f78d015e350 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d006fe20 msgr2=0x7f78d0073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d006fe20 0x7f78d0073820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 >> v2:172.21.15.105:3300/0 conn(0x7f78d015e730 msgr2=0x7f78d0073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 --2- 172.21.15.60:0/350050015 >> v2:172.21.15.105:3300/0 conn(0x7f78d015e730 0x7f78d0073d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d006c5e0 con 0x7f78d015e350 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f78cc001670 con 0x7f78d015e350 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 >> v1:172.21.15.60:6789/0 conn(0x7f78d015e350 legacy=0x7f78d006f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc0039b0 0x7f78bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78bc004800 0x7f78bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d006fe20 0x7f78bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f78d006c020 con 0x7f78bc0039b0 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f78d006c300 con 0x7f78bc004800 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f78bc00ba10 con 0x7f78d006fe20 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d5e4a640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc0039b0 0x7f78bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d664b640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d006fe20 0x7f78bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d5649640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78bc004800 0x7f78bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d5e4a640 1 -- 172.21.15.60:0/350050015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d006fe20 msgr2=0x7f78bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d5e4a640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d006fe20 0x7f78bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d5e4a640 1 -- 172.21.15.60:0/350050015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78bc004800 msgr2=0x7f78bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d5e4a640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78bc004800 0x7f78bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d5e4a640 1 -- 172.21.15.60:0/350050015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78bc003520 con 0x7f78bc0039b0 2024-09-12T01:39:25.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.911+0000 7f78d5649640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78bc004800 0x7f78bc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:25.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.912+0000 7f78d5e4a640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc0039b0 0x7f78bc003dd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00c2c0 tx=0x7f78bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d841c4fdaad459bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:25.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.912+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc007d50 con 0x7f78bc0039b0 2024-09-12T01:39:25.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.912+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78cc02e070 con 0x7f78bc0039b0 2024-09-12T01:39:25.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.912+0000 7f78d4e48640 1 -- 172.21.15.60:0/350050015 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc005d30 con 0x7f78bc0039b0 2024-09-12T01:39:25.917 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.912+0000 7f78d80ae640 1 -- 172.21.15.60:0/350050015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc0039b0 msgr2=0x7f78bc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.912+0000 7f78d80ae640 1 --2- 172.21.15.60:0/350050015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc0039b0 0x7f78bc003dd0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00c2c0 tx=0x7f78bc005830 comp rx=0 tx=0).stop 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.912+0000 7f78d664b640 1 -- 172.21.15.60:0/350050015 reap_dead start 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.912+0000 7f78d80ae640 1 -- 172.21.15.60:0/350050015 shutdown_connections 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.912+0000 7f78d80ae640 1 -- 172.21.15.60:0/350050015 >> 172.21.15.60:0/350050015 conn(0x7f78d00b3070 msgr2=0x7f78d00b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.913+0000 7f78d80ae640 1 -- 172.21.15.60:0/350050015 shutdown_connections 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.913+0000 7f78d80ae640 1 -- 172.21.15.60:0/350050015 wait complete. 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.914+0000 7f78d80ae640 1 Processor -- start 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.914+0000 7f78d80ae640 1 -- start start 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.914+0000 7f78d80ae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc0039b0 0x7f78d0145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.914+0000 7f78d80ae640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d01464a0 0x7f78d01528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.914+0000 7f78d80ae640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78d0152de0 0x7f78d0160f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d80ae640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f78d00739a0 con 0x7f78bc0039b0 2024-09-12T01:39:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d80ae640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f78d0073820 con 0x7f78d0152de0 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d80ae640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f78d0073b20 con 0x7f78d01464a0 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d5e4a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc0039b0 0x7f78d0145f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d5e4a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc0039b0 0x7f78d0145f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35642/0 (socket says 172.21.15.60:35642) 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d5e4a640 1 -- 172.21.15.60:0/3940244408 learned_addr learned my addr 172.21.15.60:0/3940244408 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d5649640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d01464a0 0x7f78d01528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d664b640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78d0152de0 0x7f78d0160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d5e4a640 1 -- 172.21.15.60:0/3940244408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d01464a0 msgr2=0x7f78d01528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d5e4a640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d01464a0 0x7f78d01528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d5e4a640 1 -- 172.21.15.60:0/3940244408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78d0152de0 msgr2=0x7f78d0160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d5e4a640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78d0152de0 0x7f78d0160f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d5e4a640 1 -- 172.21.15.60:0/3940244408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d0157970 con 0x7f78bc0039b0 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d5e4a640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc0039b0 0x7f78d0145f60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00c2c0 tx=0x7f78d006c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78c67fc640 1 -- 172.21.15.60:0/3940244408 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc042020 con 0x7f78bc0039b0 2024-09-12T01:39:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78c67fc640 1 -- 172.21.15.60:0/3940244408 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78cc007270 con 0x7f78bc0039b0 2024-09-12T01:39:25.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78c67fc640 1 -- 172.21.15.60:0/3940244408 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78cc001c80 con 0x7f78bc0039b0 2024-09-12T01:39:25.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d80ae640 1 -- 172.21.15.60:0/3940244408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d0157c50 con 0x7f78bc0039b0 2024-09-12T01:39:25.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.915+0000 7f78d80ae640 1 -- 172.21.15.60:0/3940244408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d0158210 con 0x7f78bc0039b0 2024-09-12T01:39:25.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.916+0000 7f78d80ae640 1 -- 172.21.15.60:0/3940244408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d0073d00 con 0x7f78bc0039b0 2024-09-12T01:39:25.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.917+0000 7f78c67fc640 1 -- 172.21.15.60:0/3940244408 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f78cc045020 con 0x7f78bc0039b0 2024-09-12T01:39:25.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.917+0000 7f78c67fc640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f78b406be60 0x7f78b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:25.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.917+0000 7f78c67fc640 1 -- 172.21.15.60:0/3940244408 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f78cc0aaf40 con 0x7f78bc0039b0 2024-09-12T01:39:25.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.917+0000 7f78d5649640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f78b406be60 0x7f78b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:25.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.918+0000 7f78d5649640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f78b406be60 0x7f78b406e320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f78d00b2a00 tx=0x7f78c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:25.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:25.921+0000 7f78c67fc640 1 -- 172.21.15.60:0/3940244408 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f78cc04d060 con 0x7f78bc0039b0 2024-09-12T01:39:26.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.096+0000 7f78d80ae640 1 -- 172.21.15.60:0/3940244408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7f78d006ad30 con 0x7f78bc0039b0 2024-09-12T01:39:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.099+0000 7f78c67fc640 1 -- 172.21.15.60:0/3940244408 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v27)=0 v27) ==== 128+0+0 (secure 0 0 0) 0x7f78cc03b2d0 con 0x7f78bc0039b0 2024-09-12T01:39:26.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.101+0000 7f78d80ae640 1 -- 172.21.15.60:0/3940244408 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f78b406be60 msgr2=0x7f78b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.101+0000 7f78d80ae640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f78b406be60 0x7f78b406e320 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f78d00b2a00 tx=0x7f78c0008040 comp rx=0 tx=0).stop 2024-09-12T01:39:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.101+0000 7f78d80ae640 1 -- 172.21.15.60:0/3940244408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc0039b0 msgr2=0x7f78d0145f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.101+0000 7f78d80ae640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc0039b0 0x7f78d0145f60 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00c2c0 tx=0x7f78d006c7b0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.101+0000 7f78d80ae640 1 -- 172.21.15.60:0/3940244408 shutdown_connections 2024-09-12T01:39:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.101+0000 7f78d80ae640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f78d0152de0 0x7f78d0160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.101+0000 7f78d80ae640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f78b406be60 0x7f78b406e320 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.101+0000 7f78d80ae640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f78d01464a0 0x7f78d01528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.101+0000 7f78d80ae640 1 --2- 172.21.15.60:0/3940244408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f78bc0039b0 0x7f78d0145f60 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.101+0000 7f78d80ae640 1 -- 172.21.15.60:0/3940244408 >> 172.21.15.60:0/3940244408 conn(0x7f78d00b3070 msgr2=0x7f78d00b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.101+0000 7f78d80ae640 1 -- 172.21.15.60:0/3940244408 shutdown_connections 2024-09-12T01:39:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.101+0000 7f78d80ae640 1 -- 172.21.15.60:0/3940244408 wait complete. 2024-09-12T01:39:26.112 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 800 2024-09-12T01:39:26.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.218+0000 7f82147af640 1 Processor -- start 2024-09-12T01:39:26.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.218+0000 7f82147af640 1 -- start start 2024-09-12T01:39:26.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.219+0000 7f82147af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f820c0ba440 0x7f820c0b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.219+0000 7f82147af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f820c15ed20 con 0x7f820c15e940 2024-09-12T01:39:26.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.219+0000 7f82147af640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f820c0d32e0 con 0x7f820c0b6850 2024-09-12T01:39:26.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.219+0000 7f82147af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f820c0d3ef0 con 0x7f820c0ba440 2024-09-12T01:39:26.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.219+0000 7f821254b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f820c15e940 0x7f820c0b6140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39608/0 (socket says 172.21.15.60:39608) 2024-09-12T01:39:26.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.219+0000 7f821254b640 1 -- 172.21.15.60:0/1297244339 learned_addr learned my addr 172.21.15.60:0/1297244339 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:26.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.219+0000 7f8212d4c640 1 --2- 172.21.15.60:0/1297244339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f820c0ba440 0x7f820c0b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.219+0000 7f8211549640 1 -- 172.21.15.60:0/1297244339 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 405472236 0 0) 0x7f820c15ed20 con 0x7f820c15e940 2024-09-12T01:39:26.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.219+0000 7f8211549640 1 -- 172.21.15.60:0/1297244339 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81f8003520 con 0x7f820c15e940 2024-09-12T01:39:26.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.220+0000 7f8211549640 1 -- 172.21.15.60:0/1297244339 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091531975 0 0) 0x7f820c0d32e0 con 0x7f820c0b6850 2024-09-12T01:39:26.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.220+0000 7f8211549640 1 -- 172.21.15.60:0/1297244339 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f820c15ed20 con 0x7f820c0b6850 2024-09-12T01:39:26.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.220+0000 7f8212d4c640 1 -- 172.21.15.60:0/1297244339 >> v1:172.21.15.105:6789/0 conn(0x7f820c0b6850 legacy=0x7f820c0b7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.220+0000 7f8212d4c640 1 -- 172.21.15.60:0/1297244339 >> v1:172.21.15.60:6789/0 conn(0x7f820c15e940 legacy=0x7f820c0b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.221 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.220+0000 7f8212d4c640 1 -- 172.21.15.60:0/1297244339 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c0d35c0 con 0x7f820c0ba440 2024-09-12T01:39:26.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.220+0000 7f8212d4c640 1 --2- 172.21.15.60:0/1297244339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f820c0ba440 0x7f820c0b82b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8204009dc0 tx=0x7f820402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef0c9e468ea79b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:26.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.221+0000 7f8211549640 1 -- 172.21.15.60:0/1297244339 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820402ae60 con 0x7f820c0ba440 2024-09-12T01:39:26.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.221+0000 7f8211549640 1 -- 172.21.15.60:0/1297244339 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8204007740 con 0x7f820c0ba440 2024-09-12T01:39:26.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.221+0000 7f8211549640 1 -- 172.21.15.60:0/1297244339 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204007af0 con 0x7f820c0ba440 2024-09-12T01:39:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.221+0000 7f82147af640 1 -- 172.21.15.60:0/1297244339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f820c0ba440 msgr2=0x7f820c0b82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.221+0000 7f82147af640 1 --2- 172.21.15.60:0/1297244339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f820c0ba440 0x7f820c0b82b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8204009dc0 tx=0x7f820402a640 comp rx=0 tx=0).stop 2024-09-12T01:39:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.221+0000 7f82147af640 1 -- 172.21.15.60:0/1297244339 shutdown_connections 2024-09-12T01:39:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.221+0000 7f82147af640 1 --2- 172.21.15.60:0/1297244339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f820c0ba440 0x7f820c0b82b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.221+0000 7f82147af640 1 -- 172.21.15.60:0/1297244339 >> 172.21.15.60:0/1297244339 conn(0x7f820c0d1140 msgr2=0x7f820c0d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.221+0000 7f82147af640 1 -- 172.21.15.60:0/1297244339 shutdown_connections 2024-09-12T01:39:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.221+0000 7f82147af640 1 -- 172.21.15.60:0/1297244339 wait complete. 2024-09-12T01:39:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.222+0000 7f82147af640 1 Processor -- start 2024-09-12T01:39:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.222+0000 7f82147af640 1 -- start start 2024-09-12T01:39:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.223+0000 7f82147af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f820c0b6850 0x7f820c15dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.223+0000 7f82147af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f820c0ba440 0x7f820c0cd960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.223+0000 7f82147af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f820c15e940 0x7f820c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.223+0000 7f82147af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f820c0b7510 con 0x7f820c0ba440 2024-09-12T01:39:26.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.223+0000 7f82147af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f820c0d3b80 con 0x7f820c0b6850 2024-09-12T01:39:26.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.223+0000 7f82147af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f820c0d2290 con 0x7f820c15e940 2024-09-12T01:39:26.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.223+0000 7f8211d4a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f820c0ba440 0x7f820c0cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.223+0000 7f8211d4a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f820c0ba440 0x7f820c0cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35650/0 (socket says 172.21.15.60:35650) 2024-09-12T01:39:26.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.223+0000 7f8211d4a640 1 -- 172.21.15.60:0/958938758 learned_addr learned my addr 172.21.15.60:0/958938758 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:26.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.223+0000 7f821254b640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f820c0b6850 0x7f820c15dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.226 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.223+0000 7f8212d4c640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f820c15e940 0x7f820c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.224+0000 7f8211d4a640 1 -- 172.21.15.60:0/958938758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f820c15e940 msgr2=0x7f820c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.224+0000 7f8211d4a640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f820c15e940 0x7f820c0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.224+0000 7f8211d4a640 1 -- 172.21.15.60:0/958938758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f820c0b6850 msgr2=0x7f820c15dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.224+0000 7f8211d4a640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f820c0b6850 0x7f820c15dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.224+0000 7f8211d4a640 1 -- 172.21.15.60:0/958938758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c15e180 con 0x7f820c0ba440 2024-09-12T01:39:26.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.224+0000 7f8211d4a640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f820c0ba440 0x7f820c0cd960 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00c500 tx=0x7f81fc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:26.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.224+0000 7f8202ffd640 1 -- 172.21.15.60:0/958938758 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc0052d0 con 0x7f820c0ba440 2024-09-12T01:39:26.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.224+0000 7f8202ffd640 1 -- 172.21.15.60:0/958938758 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc005490 con 0x7f820c0ba440 2024-09-12T01:39:26.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.224+0000 7f82147af640 1 -- 172.21.15.60:0/958938758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820c0ad1e0 con 0x7f820c0ba440 2024-09-12T01:39:26.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.224+0000 7f8202ffd640 1 -- 172.21.15.60:0/958938758 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc012870 con 0x7f820c0ba440 2024-09-12T01:39:26.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.224+0000 7f82147af640 1 -- 172.21.15.60:0/958938758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820c0ad7a0 con 0x7f820c0ba440 2024-09-12T01:39:26.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.225+0000 7f82147af640 1 -- 172.21.15.60:0/958938758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f820c0b6140 con 0x7f820c0ba440 2024-09-12T01:39:26.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.226+0000 7f8202ffd640 1 -- 172.21.15.60:0/958938758 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81fc012a10 con 0x7f820c0ba440 2024-09-12T01:39:26.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.226+0000 7f8202ffd640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81f006be60 0x7f81f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.226+0000 7f8202ffd640 1 -- 172.21.15.60:0/958938758 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f81fc08a990 con 0x7f820c0ba440 2024-09-12T01:39:26.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.226+0000 7f821254b640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81f006be60 0x7f81f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.227+0000 7f821254b640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81f006be60 0x7f81f006e320 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f82080011e0 tx=0x7f8208007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:26.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.231+0000 7f8202ffd640 1 -- 172.21.15.60:0/958938758 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f81fc058d00 con 0x7f820c0ba440 2024-09-12T01:39:26.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.407+0000 7f82147af640 1 -- 172.21.15.60:0/958938758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7f820c0b5cc0 con 0x7f820c0ba440 2024-09-12T01:39:26.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.410+0000 7f8202ffd640 1 -- 172.21.15.60:0/958938758 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v28)=0 v28) ==== 124+0+0 (secure 0 0 0) 0x7f81fc05d000 con 0x7f820c0ba440 2024-09-12T01:39:26.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.412+0000 7f82147af640 1 -- 172.21.15.60:0/958938758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81f006be60 msgr2=0x7f81f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.412+0000 7f82147af640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81f006be60 0x7f81f006e320 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f82080011e0 tx=0x7f8208007d30 comp rx=0 tx=0).stop 2024-09-12T01:39:26.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.412+0000 7f82147af640 1 -- 172.21.15.60:0/958938758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f820c0ba440 msgr2=0x7f820c0cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.412+0000 7f82147af640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f820c0ba440 0x7f820c0cd960 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00c500 tx=0x7f81fc00c9c0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.413+0000 7f82147af640 1 -- 172.21.15.60:0/958938758 shutdown_connections 2024-09-12T01:39:26.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.413+0000 7f82147af640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81f006be60 0x7f81f006e320 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.413+0000 7f82147af640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f820c15e940 0x7f820c0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.413+0000 7f82147af640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f820c0ba440 0x7f820c0cd960 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.413+0000 7f82147af640 1 --2- 172.21.15.60:0/958938758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f820c0b6850 0x7f820c15dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.413+0000 7f82147af640 1 -- 172.21.15.60:0/958938758 >> 172.21.15.60:0/958938758 conn(0x7f820c0d1140 msgr2=0x7f820c0b81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:26.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.413+0000 7f82147af640 1 -- 172.21.15.60:0/958938758 shutdown_connections 2024-09-12T01:39:26.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.413+0000 7f82147af640 1 -- 172.21.15.60:0/958938758 wait complete. 2024-09-12T01:39:26.423 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-12T01:39:26.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.528+0000 7f5102b2a640 1 Processor -- start 2024-09-12T01:39:26.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.528+0000 7f5102b2a640 1 -- start start 2024-09-12T01:39:26.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f5102b2a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50fc0720d0 0x7f50fc0b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f5102b2a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f50fc0cca40 0x7f50fc0b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f5102b2a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50fc071720 con 0x7f50fc15ad10 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f5102b2a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f50fc070fb0 con 0x7f50fc0cca40 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f5102b2a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f50fc073920 con 0x7f50fc0720d0 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f50fbfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50fc0720d0 0x7f50fc0b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f51010c7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f50fc0cca40 0x7f50fc0b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f50fbfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50fc0720d0 0x7f50fc0b3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:55382/0 (socket says 172.21.15.60:55382) 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f51010c7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f50fc0cca40 0x7f50fc0b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:44386/0 (socket says 172.21.15.60:44386) 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f50fbfff640 1 -- 172.21.15.60:0/4198318762 learned_addr learned my addr 172.21.15.60:0/4198318762 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f51008c6640 1 --1- 172.21.15.60:0/4198318762 >> v1:172.21.15.105:6789/0 conn(0x7f50fc15ad10 0x7f50fc0719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:38858/0 (socket says 172.21.15.60:38858) 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f50fbfff640 1 -- 172.21.15.60:0/4198318762 >> v2:172.21.15.105:3300/0 conn(0x7f50fc0cca40 msgr2=0x7f50fc0b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f50fbfff640 1 --2- 172.21.15.60:0/4198318762 >> v2:172.21.15.105:3300/0 conn(0x7f50fc0cca40 0x7f50fc0b43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f50fbfff640 1 -- 172.21.15.60:0/4198318762 >> v1:172.21.15.105:6789/0 conn(0x7f50fc15ad10 legacy=0x7f50fc0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.529+0000 7f50fbfff640 1 -- 172.21.15.60:0/4198318762 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50fc073c00 con 0x7f50fc0720d0 2024-09-12T01:39:26.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.530+0000 7f50fbfff640 1 --2- 172.21.15.60:0/4198318762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50fc0720d0 0x7f50fc0b3ea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009870 tx=0x7f50e402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bead69145ae8ae34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:26.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.530+0000 7f50fb7fe640 1 -- 172.21.15.60:0/4198318762 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4037070 con 0x7f50fc0720d0 2024-09-12T01:39:26.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.530+0000 7f50fb7fe640 1 -- 172.21.15.60:0/4198318762 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e4032440 con 0x7f50fc0720d0 2024-09-12T01:39:26.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.530+0000 7f50fb7fe640 1 -- 172.21.15.60:0/4198318762 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4032810 con 0x7f50fc0720d0 2024-09-12T01:39:26.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.531+0000 7f5102b2a640 1 -- 172.21.15.60:0/4198318762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50fc0720d0 msgr2=0x7f50fc0b3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.531+0000 7f5102b2a640 1 --2- 172.21.15.60:0/4198318762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50fc0720d0 0x7f50fc0b3ea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009870 tx=0x7f50e402a1c0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.531+0000 7f5102b2a640 1 -- 172.21.15.60:0/4198318762 shutdown_connections 2024-09-12T01:39:26.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.531+0000 7f5102b2a640 1 --2- 172.21.15.60:0/4198318762 >> v2:172.21.15.105:3300/0 conn(0x7f50fc0cca40 0x7f50fc0b43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.531+0000 7f5102b2a640 1 --2- 172.21.15.60:0/4198318762 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50fc0720d0 0x7f50fc0b3ea0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.531+0000 7f5102b2a640 1 -- 172.21.15.60:0/4198318762 >> 172.21.15.60:0/4198318762 conn(0x7f50fc06d0f0 msgr2=0x7f50fc06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:26.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.531+0000 7f5102b2a640 1 -- 172.21.15.60:0/4198318762 shutdown_connections 2024-09-12T01:39:26.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.531+0000 7f5102b2a640 1 -- 172.21.15.60:0/4198318762 wait complete. 2024-09-12T01:39:26.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.532+0000 7f5102b2a640 1 Processor -- start 2024-09-12T01:39:26.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.532+0000 7f5102b2a640 1 -- start start 2024-09-12T01:39:26.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.533+0000 7f5102b2a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50fc0720d0 0x7f50fc153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.533+0000 7f5102b2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0cca40 0x7f50fc153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.533+0000 7f5102b2a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50fc15ad10 0x7f50fc1f0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.533+0000 7f5102b2a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc0cc360 con 0x7f50fc0cca40 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.533+0000 7f5102b2a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f50fc071200 con 0x7f50fc15ad10 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.533+0000 7f5102b2a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f50fc0cc4e0 con 0x7f50fc0720d0 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.533+0000 7f50fbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0cca40 0x7f50fc153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.533+0000 7f50fbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0cca40 0x7f50fc153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35654/0 (socket says 172.21.15.60:35654) 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.533+0000 7f50fbfff640 1 -- 172.21.15.60:0/2164914042 learned_addr learned my addr 172.21.15.60:0/2164914042 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.533+0000 7f51008c6640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50fc0720d0 0x7f50fc153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.533+0000 7f51010c7640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50fc15ad10 0x7f50fc1f0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.534+0000 7f50fbfff640 1 -- 172.21.15.60:0/2164914042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50fc0720d0 msgr2=0x7f50fc153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.534+0000 7f50fbfff640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50fc0720d0 0x7f50fc153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.534+0000 7f50fbfff640 1 -- 172.21.15.60:0/2164914042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50fc15ad10 msgr2=0x7f50fc1f0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.534+0000 7f50fbfff640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50fc15ad10 0x7f50fc1f0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.534+0000 7f50fbfff640 1 -- 172.21.15.60:0/2164914042 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50fc152b40 con 0x7f50fc0cca40 2024-09-12T01:39:26.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.534+0000 7f50fbfff640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0cca40 0x7f50fc153860 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009870 tx=0x7f50e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:26.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.534+0000 7f50f97fa640 1 -- 172.21.15.60:0/2164914042 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4041020 con 0x7f50fc0cca40 2024-09-12T01:39:26.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.534+0000 7f50f97fa640 1 -- 172.21.15.60:0/2164914042 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e4030640 con 0x7f50fc0cca40 2024-09-12T01:39:26.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.534+0000 7f5102b2a640 1 -- 172.21.15.60:0/2164914042 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50fc1512e0 con 0x7f50fc0cca40 2024-09-12T01:39:26.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.534+0000 7f50f97fa640 1 -- 172.21.15.60:0/2164914042 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e4037040 con 0x7f50fc0cca40 2024-09-12T01:39:26.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.534+0000 7f5102b2a640 1 -- 172.21.15.60:0/2164914042 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50fc151d80 con 0x7f50fc0cca40 2024-09-12T01:39:26.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.535+0000 7f5102b2a640 1 -- 172.21.15.60:0/2164914042 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50fc06ad30 con 0x7f50fc0cca40 2024-09-12T01:39:26.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.535+0000 7f50f97fa640 1 -- 172.21.15.60:0/2164914042 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f50e4044020 con 0x7f50fc0cca40 2024-09-12T01:39:26.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.536+0000 7f50f97fa640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f50dc06be30 0x7f50dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.536+0000 7f50f97fa640 1 -- 172.21.15.60:0/2164914042 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f50e40ab520 con 0x7f50fc0cca40 2024-09-12T01:39:26.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.536+0000 7f51008c6640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f50dc06be30 0x7f50dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.536+0000 7f51008c6640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f50dc06be30 0x7f50dc06e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f50fc156950 tx=0x7f50f4001630 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:26.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.540+0000 7f50f97fa640 1 -- 172.21.15.60:0/2164914042 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50e404b030 con 0x7f50fc0cca40 2024-09-12T01:39:26.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.717+0000 7f5102b2a640 1 -- 172.21.15.60:0/2164914042 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7f50fc0b4820 con 0x7f50fc0cca40 2024-09-12T01:39:26.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.717+0000 7f50f97fa640 1 -- 172.21.15.60:0/2164914042 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v28) ==== 106+0+4 (secure 0 0 0) 0x7f50e4079880 con 0x7f50fc0cca40 2024-09-12T01:39:26.717 INFO:teuthology.orchestra.run.smithi060.stdout:100 2024-09-12T01:39:26.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.719+0000 7f5102b2a640 1 -- 172.21.15.60:0/2164914042 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f50dc06be30 msgr2=0x7f50dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.719+0000 7f5102b2a640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f50dc06be30 0x7f50dc06e2f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f50fc156950 tx=0x7f50f4001630 comp rx=0 tx=0).stop 2024-09-12T01:39:26.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.719+0000 7f5102b2a640 1 -- 172.21.15.60:0/2164914042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0cca40 msgr2=0x7f50fc153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.719+0000 7f5102b2a640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0cca40 0x7f50fc153860 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f50e4009870 tx=0x7f50e40046c0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.719+0000 7f5102b2a640 1 -- 172.21.15.60:0/2164914042 shutdown_connections 2024-09-12T01:39:26.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.719+0000 7f5102b2a640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50fc15ad10 0x7f50fc1f0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.719+0000 7f5102b2a640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50fc0cca40 0x7f50fc153860 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.719+0000 7f5102b2a640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f50dc06be30 0x7f50dc06e2f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.719+0000 7f5102b2a640 1 --2- 172.21.15.60:0/2164914042 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50fc0720d0 0x7f50fc153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.719+0000 7f5102b2a640 1 -- 172.21.15.60:0/2164914042 >> 172.21.15.60:0/2164914042 conn(0x7f50fc06d0f0 msgr2=0x7f50fc15a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:26.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.719+0000 7f5102b2a640 1 -- 172.21.15.60:0/2164914042 shutdown_connections 2024-09-12T01:39:26.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.719+0000 7f5102b2a640 1 -- 172.21.15.60:0/2164914042 wait complete. 2024-09-12T01:39:26.729 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-09-12T01:39:26.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.835+0000 7f380163c640 1 Processor -- start 2024-09-12T01:39:26.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.835+0000 7f380163c640 1 -- start start 2024-09-12T01:39:26.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f380163c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f37fc15e6f0 0x7f37fc06fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f380163c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f37fc0b7450 0x7f37fc15f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f380163c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37fc06e990 con 0x7f37fc0b54d0 2024-09-12T01:39:26.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f380163c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f37fc06ec70 con 0x7f37fc0b7450 2024-09-12T01:39:26.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f380163c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f37fc15ec70 con 0x7f37fc15e6f0 2024-09-12T01:39:26.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f37fb7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f37fc0b7450 0x7f37fc15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f37fb7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f37fc0b7450 0x7f37fc15f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35670/0 (socket says 172.21.15.60:35670) 2024-09-12T01:39:26.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f37fb7fe640 1 -- 172.21.15.60:0/4057801206 learned_addr learned my addr 172.21.15.60:0/4057801206 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:26.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f37faffd640 1 --2- 172.21.15.60:0/4057801206 >> v2:172.21.15.105:3300/0 conn(0x7f37fc15e6f0 0x7f37fc06fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f37fb7fe640 1 -- 172.21.15.60:0/4057801206 >> v2:172.21.15.105:3300/0 conn(0x7f37fc15e6f0 msgr2=0x7f37fc06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:26.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f37fb7fe640 1 --2- 172.21.15.60:0/4057801206 >> v2:172.21.15.105:3300/0 conn(0x7f37fc15e6f0 0x7f37fc06fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f37fb7fe640 1 -- 172.21.15.60:0/4057801206 >> v1:172.21.15.105:6789/0 conn(0x7f37fc0b54d0 legacy=0x7f37fc0b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:26.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f37fb7fe640 1 -- 172.21.15.60:0/4057801206 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc15ef50 con 0x7f37fc0b7450 2024-09-12T01:39:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.836+0000 7f37faffd640 1 --2- 172.21.15.60:0/4057801206 >> v2:172.21.15.105:3300/0 conn(0x7f37fc15e6f0 0x7f37fc06fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.837+0000 7f37fb7fe640 1 --2- 172.21.15.60:0/4057801206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37fc0b7450 0x7f37fc15f750 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f37fc069920 tx=0x7f37f402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4b88c84ad7f75c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.837+0000 7f37fa7fc640 1 -- 172.21.15.60:0/4057801206 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4036070 con 0x7f37fc0b7450 2024-09-12T01:39:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.837+0000 7f37fa7fc640 1 -- 172.21.15.60:0/4057801206 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4031600 con 0x7f37fc0b7450 2024-09-12T01:39:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.837+0000 7f37fa7fc640 1 -- 172.21.15.60:0/4057801206 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f40319d0 con 0x7f37fc0b7450 2024-09-12T01:39:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.838+0000 7f380163c640 1 -- 172.21.15.60:0/4057801206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37fc0b7450 msgr2=0x7f37fc15f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.838+0000 7f380163c640 1 --2- 172.21.15.60:0/4057801206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37fc0b7450 0x7f37fc15f750 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f37fc069920 tx=0x7f37f402a6f0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.838+0000 7f380163c640 1 -- 172.21.15.60:0/4057801206 shutdown_connections 2024-09-12T01:39:26.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.838+0000 7f380163c640 1 --2- 172.21.15.60:0/4057801206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37fc0b7450 0x7f37fc15f750 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.838+0000 7f380163c640 1 --2- 172.21.15.60:0/4057801206 >> v2:172.21.15.105:3300/0 conn(0x7f37fc15e6f0 0x7f37fc06fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.838+0000 7f380163c640 1 -- 172.21.15.60:0/4057801206 >> 172.21.15.60:0/4057801206 conn(0x7f37fc0d2430 msgr2=0x7f37fc0d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:26.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.838+0000 7f380163c640 1 -- 172.21.15.60:0/4057801206 shutdown_connections 2024-09-12T01:39:26.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.838+0000 7f380163c640 1 -- 172.21.15.60:0/4057801206 wait complete. 2024-09-12T01:39:26.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.839+0000 7f380163c640 1 Processor -- start 2024-09-12T01:39:26.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.839+0000 7f380163c640 1 -- start start 2024-09-12T01:39:26.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f380163c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37fc0b54d0 0x7f37fc147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f380163c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37fc0b7450 0x7f37fc1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f380163c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37fc15e6f0 0x7f37fc15ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f380163c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc06e730 con 0x7f37fc15e6f0 2024-09-12T01:39:26.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f380163c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f37fc06e5b0 con 0x7f37fc0b54d0 2024-09-12T01:39:26.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f380163c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f37fc070830 con 0x7f37fc0b7450 2024-09-12T01:39:26.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f37fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37fc15e6f0 0x7f37fc15ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f37fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37fc15e6f0 0x7f37fc15ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35672/0 (socket says 172.21.15.60:35672) 2024-09-12T01:39:26.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f37fb7fe640 1 -- 172.21.15.60:0/3523168352 learned_addr learned my addr 172.21.15.60:0/3523168352 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f37faffd640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37fc0b54d0 0x7f37fc147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f37f3fff640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37fc0b7450 0x7f37fc1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f37fb7fe640 1 -- 172.21.15.60:0/3523168352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37fc0b7450 msgr2=0x7f37fc1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f37fb7fe640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37fc0b7450 0x7f37fc1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f37fb7fe640 1 -- 172.21.15.60:0/3523168352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37fc0b54d0 msgr2=0x7f37fc147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f37fb7fe640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37fc0b54d0 0x7f37fc147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.840+0000 7f37fb7fe640 1 -- 172.21.15.60:0/3523168352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37fc151ff0 con 0x7f37fc15e6f0 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.841+0000 7f37fb7fe640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37fc15e6f0 0x7f37fc15ce60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009f40 tx=0x7f37f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.841+0000 7f37f37fe640 1 -- 172.21.15.60:0/3523168352 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4036050 con 0x7f37fc15e6f0 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.841+0000 7f37f37fe640 1 -- 172.21.15.60:0/3523168352 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f4042070 con 0x7f37fc15e6f0 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.841+0000 7f380163c640 1 -- 172.21.15.60:0/3523168352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37fc1522d0 con 0x7f37fc15e6f0 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.841+0000 7f37f37fe640 1 -- 172.21.15.60:0/3523168352 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4009510 con 0x7f37fc15e6f0 2024-09-12T01:39:26.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.841+0000 7f380163c640 1 -- 172.21.15.60:0/3523168352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37fc152890 con 0x7f37fc15e6f0 2024-09-12T01:39:26.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.842+0000 7f380163c640 1 -- 172.21.15.60:0/3523168352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37fc06c6c0 con 0x7f37fc15e6f0 2024-09-12T01:39:26.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.842+0000 7f37f37fe640 1 -- 172.21.15.60:0/3523168352 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f37f4007bb0 con 0x7f37fc15e6f0 2024-09-12T01:39:26.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.843+0000 7f37f37fe640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f37dc06be30 0x7f37dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:26.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.843+0000 7f37f37fe640 1 -- 172.21.15.60:0/3523168352 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f37f40abbb0 con 0x7f37fc15e6f0 2024-09-12T01:39:26.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.843+0000 7f37faffd640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f37dc06be30 0x7f37dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:26.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.843+0000 7f37faffd640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f37dc06be30 0x7f37dc06e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f37fc157610 tx=0x7f37ec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:26.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:26.847+0000 7f37f37fe640 1 -- 172.21.15.60:0/3523168352 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f37f4079f10 con 0x7f37fc15e6f0 2024-09-12T01:39:27.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.023+0000 7f380163c640 1 -- 172.21.15.60:0/3523168352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7f37fc157640 con 0x7f37fc15e6f0 2024-09-12T01:39:27.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.024+0000 7f37f37fe640 1 -- 172.21.15.60:0/3523168352 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v28) ==== 112+0+10 (secure 0 0 0) 0x7f37f407e210 con 0x7f37fc15e6f0 2024-09-12T01:39:27.023 INFO:teuthology.orchestra.run.smithi060.stdout:60.000000 2024-09-12T01:39:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.025+0000 7f380163c640 1 -- 172.21.15.60:0/3523168352 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f37dc06be30 msgr2=0x7f37dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.025+0000 7f380163c640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f37dc06be30 0x7f37dc06e2f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f37fc157610 tx=0x7f37ec008040 comp rx=0 tx=0).stop 2024-09-12T01:39:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.025+0000 7f380163c640 1 -- 172.21.15.60:0/3523168352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37fc15e6f0 msgr2=0x7f37fc15ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.025+0000 7f380163c640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37fc15e6f0 0x7f37fc15ce60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f37f4009f40 tx=0x7f37f4004a40 comp rx=0 tx=0).stop 2024-09-12T01:39:27.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.026+0000 7f380163c640 1 -- 172.21.15.60:0/3523168352 shutdown_connections 2024-09-12T01:39:27.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.026+0000 7f380163c640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f37fc15e6f0 0x7f37fc15ce60 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.026+0000 7f380163c640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f37dc06be30 0x7f37dc06e2f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.026+0000 7f380163c640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37fc0b7450 0x7f37fc1518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.026+0000 7f380163c640 1 --2- 172.21.15.60:0/3523168352 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f37fc0b54d0 0x7f37fc147030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.026+0000 7f380163c640 1 -- 172.21.15.60:0/3523168352 >> 172.21.15.60:0/3523168352 conn(0x7f37fc0d2430 msgr2=0x7f37fc157b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:27.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.026+0000 7f380163c640 1 -- 172.21.15.60:0/3523168352 shutdown_connections 2024-09-12T01:39:27.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.026+0000 7f380163c640 1 -- 172.21.15.60:0/3523168352 wait complete. 2024-09-12T01:39:27.036 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:39:27.036 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:39:27.052 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:39:27.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:39:27.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:39:27.150 INFO:teuthology.orchestra.run.smithi060.stdout:client5956 2024-09-12T01:39:27.151 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:39:27.151 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:39:27.167 DEBUG:teuthology.orchestra.run.smithi060:> stdin-killer -- python3 -c ' 2024-09-12T01:39:27.167 DEBUG:teuthology.orchestra.run.smithi060:> import fcntl 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> import sys 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> import time 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> import os 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> n = 400 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> abs_path = "/home/ubuntu/cephtest/mnt.0/subdir" 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> if not os.path.exists(abs_path): 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> os.makedirs(abs_path) 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:39:27.168 DEBUG:teuthology.orchestra.run.smithi060:> handles = [] 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> for i in range(0, n): 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> fname = "file_"+str(i) 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> path = os.path.join(abs_path, fname) 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> handles.append(open(path, '"'"'w'"'"')) 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> print("waiting with handles open", file=sys.stderr) 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> while True: 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> print("open_n_background: keeping files open", file=sys.stderr) 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> try: 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> if os.read(0, 4096) == b"": 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> break 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> except BlockingIOError: 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> pass 2024-09-12T01:39:27.169 DEBUG:teuthology.orchestra.run.smithi060:> time.sleep(2) 2024-09-12T01:39:27.170 DEBUG:teuthology.orchestra.run.smithi060:> print("stdin closed, goodbye!", file=sys.stderr) 2024-09-12T01:39:27.170 DEBUG:teuthology.orchestra.run.smithi060:> ' 2024-09-12T01:39:27.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:39:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.313+0000 7fc9ab40e640 1 Processor -- start 2024-09-12T01:39:27.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.314+0000 7fc9ab40e640 1 -- start start 2024-09-12T01:39:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.314+0000 7fc9ab40e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc9a415e800 0x7fc9a40b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.314+0000 7fc9ab40e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc9a415ebe0 0x7fc9a415f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.314+0000 7fc9ab40e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9a40b6e50 0x7fc9a40b7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.314+0000 7fc9ab40e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a406ed40 con 0x7fc9a415e800 2024-09-12T01:39:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.314+0000 7fc9ab40e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a406ea60 con 0x7fc9a415ebe0 2024-09-12T01:39:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.314+0000 7fc9ab40e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a406cde0 con 0x7fc9a40b6e50 2024-09-12T01:39:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.315+0000 7fc9a91aa640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc9a415e800 0x7fc9a40b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.315+0000 7fc9a91aa640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc9a415e800 0x7fc9a40b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35674/0 (socket says 172.21.15.60:35674) 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.315+0000 7fc9a91aa640 1 -- 172.21.15.60:0/3526836473 learned_addr learned my addr 172.21.15.60:0/3526836473 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.315+0000 7fc9a89a9640 1 --2- 172.21.15.60:0/3526836473 >> v2:172.21.15.105:3300/0 conn(0x7fc9a415ebe0 0x7fc9a415f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.315+0000 7fc9a99ab640 1 --2- 172.21.15.60:0/3526836473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9a40b6e50 0x7fc9a40b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.315+0000 7fc9a91aa640 1 -- 172.21.15.60:0/3526836473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9a40b6e50 msgr2=0x7fc9a40b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.315+0000 7fc9a91aa640 1 --2- 172.21.15.60:0/3526836473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9a40b6e50 0x7fc9a40b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.315+0000 7fc9a91aa640 1 -- 172.21.15.60:0/3526836473 >> v2:172.21.15.105:3300/0 conn(0x7fc9a415ebe0 msgr2=0x7fc9a415f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.315+0000 7fc9a91aa640 1 --2- 172.21.15.60:0/3526836473 >> v2:172.21.15.105:3300/0 conn(0x7fc9a415ebe0 0x7fc9a415f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.315+0000 7fc9a91aa640 1 -- 172.21.15.60:0/3526836473 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a406d0c0 con 0x7fc9a415e800 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.315+0000 7fc9a89a9640 1 --2- 172.21.15.60:0/3526836473 >> v2:172.21.15.105:3300/0 conn(0x7fc9a415ebe0 0x7fc9a415f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.316+0000 7fc9a91aa640 1 --2- 172.21.15.60:0/3526836473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a415e800 0x7fc9a40b5460 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40704a0 tx=0x7fc9a002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77809fdbdcfd8c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.316+0000 7fc99bfff640 1 -- 172.21.15.60:0/3526836473 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0037070 con 0x7fc9a415e800 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.316+0000 7fc99bfff640 1 -- 172.21.15.60:0/3526836473 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a0032440 con 0x7fc9a415e800 2024-09-12T01:39:27.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.316+0000 7fc99bfff640 1 -- 172.21.15.60:0/3526836473 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0032810 con 0x7fc9a415e800 2024-09-12T01:39:27.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.316+0000 7fc9ab40e640 1 -- 172.21.15.60:0/3526836473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a415e800 msgr2=0x7fc9a40b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.316+0000 7fc9ab40e640 1 --2- 172.21.15.60:0/3526836473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a415e800 0x7fc9a40b5460 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40704a0 tx=0x7fc9a002a1e0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.316+0000 7fc9ab40e640 1 -- 172.21.15.60:0/3526836473 shutdown_connections 2024-09-12T01:39:27.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.317+0000 7fc9ab40e640 1 --2- 172.21.15.60:0/3526836473 >> v2:172.21.15.105:3300/0 conn(0x7fc9a415ebe0 0x7fc9a415f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.317+0000 7fc9ab40e640 1 --2- 172.21.15.60:0/3526836473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9a40b6e50 0x7fc9a40b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.317+0000 7fc9ab40e640 1 --2- 172.21.15.60:0/3526836473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a415e800 0x7fc9a40b5460 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.317+0000 7fc9ab40e640 1 -- 172.21.15.60:0/3526836473 >> 172.21.15.60:0/3526836473 conn(0x7fc9a40d24d0 msgr2=0x7fc9a40d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:27.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.317+0000 7fc9ab40e640 1 -- 172.21.15.60:0/3526836473 shutdown_connections 2024-09-12T01:39:27.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.317+0000 7fc9ab40e640 1 -- 172.21.15.60:0/3526836473 wait complete. 2024-09-12T01:39:27.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.318+0000 7fc9ab40e640 1 Processor -- start 2024-09-12T01:39:27.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.318+0000 7fc9ab40e640 1 -- start start 2024-09-12T01:39:27.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9ab40e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9a40b6e50 0x7fc9a4152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9ab40e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9a415e800 0x7fc9a41573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9ab40e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a415ebe0 0x7fc9a4157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9ab40e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a40d31e0 con 0x7fc9a415ebe0 2024-09-12T01:39:27.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9ab40e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a40b77c0 con 0x7fc9a40b6e50 2024-09-12T01:39:27.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9ab40e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a406e680 con 0x7fc9a415e800 2024-09-12T01:39:27.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9a99ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a415ebe0 0x7fc9a4157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9a99ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a415ebe0 0x7fc9a4157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35690/0 (socket says 172.21.15.60:35690) 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9a99ab640 1 -- 172.21.15.60:0/523005983 learned_addr learned my addr 172.21.15.60:0/523005983 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9a91aa640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9a40b6e50 0x7fc9a4152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9a89a9640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9a415e800 0x7fc9a41573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9a99ab640 1 -- 172.21.15.60:0/523005983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9a415e800 msgr2=0x7fc9a41573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9a99ab640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9a415e800 0x7fc9a41573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9a99ab640 1 -- 172.21.15.60:0/523005983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9a40b6e50 msgr2=0x7fc9a4152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9a99ab640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9a40b6e50 0x7fc9a4152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9a99ab640 1 -- 172.21.15.60:0/523005983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a41f5500 con 0x7fc9a415ebe0 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9a89a9640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9a415e800 0x7fc9a41573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9a99ab640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a415ebe0 0x7fc9a4157910 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc99c007d50 tx=0x7fc99c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc999ffb640 1 -- 172.21.15.60:0/523005983 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c014420 con 0x7fc9a415ebe0 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc999ffb640 1 -- 172.21.15.60:0/523005983 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc99c019070 con 0x7fc9a415ebe0 2024-09-12T01:39:27.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc9ab40e640 1 -- 172.21.15.60:0/523005983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a41f57e0 con 0x7fc9a415ebe0 2024-09-12T01:39:27.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.319+0000 7fc999ffb640 1 -- 172.21.15.60:0/523005983 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c014820 con 0x7fc9a415ebe0 2024-09-12T01:39:27.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.320+0000 7fc9ab40e640 1 -- 172.21.15.60:0/523005983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a41f5da0 con 0x7fc9a415ebe0 2024-09-12T01:39:27.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.320+0000 7fc9ab40e640 1 -- 172.21.15.60:0/523005983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a40b7280 con 0x7fc9a415ebe0 2024-09-12T01:39:27.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.321+0000 7fc999ffb640 1 -- 172.21.15.60:0/523005983 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc99c0149c0 con 0x7fc9a415ebe0 2024-09-12T01:39:27.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.322+0000 7fc999ffb640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc98806be30 0x7fc98806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.322+0000 7fc999ffb640 1 -- 172.21.15.60:0/523005983 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fc99c08b680 con 0x7fc9a415ebe0 2024-09-12T01:39:27.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.322+0000 7fc9a91aa640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc98806be30 0x7fc98806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.322+0000 7fc9a91aa640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc98806be30 0x7fc98806e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0034000 tx=0x7fc9a002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:27.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.326+0000 7fc999ffb640 1 -- 172.21.15.60:0/523005983 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc99c059f90 con 0x7fc9a415ebe0 2024-09-12T01:39:27.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.566+0000 7fc9ab40e640 1 -- 172.21.15.60:0/523005983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc9a40d1f50 con 0x7fc9a415ebe0 2024-09-12T01:39:27.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.567+0000 7fc999ffb640 1 -- 172.21.15.60:0/523005983 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+5230 (secure 0 0 0) 0x7fc99c059890 con 0x7fc9a415ebe0 2024-09-12T01:39:27.566 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:27.566 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":44,"btime":"2024-09-12T01:39:15:900799+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5824,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4036885582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4036885582},{"type":"v1","addr":"172.21.15.105:6835","nonce":4036885582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2254947663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2254947663},{"type":"v1","addr":"172.21.15.60:6835","nonce":2254947663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3019966407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3019966407},{"type":"v1","addr":"172.21.15.60:6837","nonce":3019966407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:39:13.254252+0000","modified":"2024-09-12T01:39:15.248119+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35375":{"gid":35375,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/95793246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":95793246},{"type":"v1","addr":"172.21.15.105:6834","nonce":95793246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35375,"qdb_cluster":[35375]},"id":6}]} 2024-09-12T01:39:27.567 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 44 2024-09-12T01:39:27.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.569+0000 7fc9ab40e640 1 -- 172.21.15.60:0/523005983 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc98806be30 msgr2=0x7fc98806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.569+0000 7fc9ab40e640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc98806be30 0x7fc98806e2f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0034000 tx=0x7fc9a002e000 comp rx=0 tx=0).stop 2024-09-12T01:39:27.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.569+0000 7fc9ab40e640 1 -- 172.21.15.60:0/523005983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a415ebe0 msgr2=0x7fc9a4157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.569+0000 7fc9ab40e640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a415ebe0 0x7fc9a4157910 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc99c007d50 tx=0x7fc99c00e4b0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.569+0000 7fc9ab40e640 1 -- 172.21.15.60:0/523005983 shutdown_connections 2024-09-12T01:39:27.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.569+0000 7fc9ab40e640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9a415ebe0 0x7fc9a4157910 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.569+0000 7fc9ab40e640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc98806be30 0x7fc98806e2f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.569+0000 7fc9ab40e640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9a415e800 0x7fc9a41573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.569+0000 7fc9ab40e640 1 --2- 172.21.15.60:0/523005983 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc9a40b6e50 0x7fc9a4152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.569+0000 7fc9ab40e640 1 -- 172.21.15.60:0/523005983 >> 172.21.15.60:0/523005983 conn(0x7fc9a40d24d0 msgr2=0x7fc9a40b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:27.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.569+0000 7fc9ab40e640 1 -- 172.21.15.60:0/523005983 shutdown_connections 2024-09-12T01:39:27.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.569+0000 7fc9ab40e640 1 -- 172.21.15.60:0/523005983 wait complete. 2024-09-12T01:39:27.580 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-12T01:39:27.584 INFO:teuthology.orchestra.run.smithi060.stderr:waiting with handles open 2024-09-12T01:39:27.584 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:27.698 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":6372,"entity":{"name":{"type":"client","num":6372},"addr":{"type":"any","addr":"172.21.15.105:0","nonce":4240671810}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":2.7029452310000002,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9918852560226048,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6372 172.21.15.105:0/4240671810","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi105","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":5956,"entity":{"name":{"type":"client","num":5956},"addr":{"type":"any","addr":"172.21.15.60:0","nonce":180903834}},"state":"open","num_leases":1,"num_caps":402,"request_load_avg":425,"uptime":3.840922172,"requests_in_flight":400,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":804.53922238845678,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.5956 172.21.15.60:0/180903834","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi060","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-12T01:39:27.699 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi105", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 4240671810, "type": "any" }, "name": { "num": 6372, "type": "client" } }, "id": 6372, "inst": "client.6372 172.21.15.105:0/4240671810", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.991885256022605 }, "state": "open", "uptime": 2.702945231 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi060", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.60:0", "nonce": 180903834, "type": "any" }, "name": { "num": 5956, "type": "client" } }, "id": 5956, "inst": "client.5956 172.21.15.60:0/180903834", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 402, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 425, "requests_in_flight": 400, "session_cache_liveness": { "halflife": 300, "value": 804.5392223884568 }, "state": "open", "uptime": 3.840922172 } ] 2024-09-12T01:39:27.699 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-09-12T01:39:27.699 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:39:27.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.801+0000 7f7f37152640 1 Processor -- start 2024-09-12T01:39:27.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.801+0000 7f7f37152640 1 -- start start 2024-09-12T01:39:27.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.802+0000 7f7f37152640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7f3015e660 0x7f7f300cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.802+0000 7f7f37152640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f300d3310 0x7f7f300d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.802+0000 7f7f37152640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3015ea40 con 0x7f7f300d1650 2024-09-12T01:39:27.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.802+0000 7f7f37152640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7f300d1ac0 con 0x7f7f3015e660 2024-09-12T01:39:27.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.802+0000 7f7f37152640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7f300d3870 con 0x7f7f300d3310 2024-09-12T01:39:27.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.803+0000 7f7f34eee640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7f3015e660 0x7f7f300cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.803+0000 7f7f2ffff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f300d3310 0x7f7f300d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.803+0000 7f7f356ef640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f7f300d1650 0x7f7f3006bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:38868/0 (socket says 172.21.15.60:38868) 2024-09-12T01:39:27.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.803+0000 7f7f356ef640 1 -- 172.21.15.60:0/3993973560 learned_addr learned my addr 172.21.15.60:0/3993973560 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:27.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.803+0000 7f7f34eee640 1 -- 172.21.15.60:0/3993973560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f300d3310 msgr2=0x7f7f300d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:27.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.803+0000 7f7f34eee640 1 --2- 172.21.15.60:0/3993973560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f300d3310 0x7f7f300d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.803+0000 7f7f34eee640 1 -- 172.21.15.60:0/3993973560 >> v1:172.21.15.105:6789/0 conn(0x7f7f300d1650 legacy=0x7f7f3006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.803+0000 7f7f2f7fe640 1 -- 172.21.15.60:0/3993973560 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1296420978 0 0) 0x7f7f3015ea40 con 0x7f7f300d1650 2024-09-12T01:39:27.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.803+0000 7f7f34eee640 1 -- 172.21.15.60:0/3993973560 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f300d3b50 con 0x7f7f3015e660 2024-09-12T01:39:27.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.803+0000 7f7f2ffff640 1 --2- 172.21.15.60:0/3993973560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f300d3310 0x7f7f300d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:39:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.804+0000 7f7f34eee640 1 --2- 172.21.15.60:0/3993973560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f3015e660 0x7f7f300cf730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7f200097a0 tx=0x7f7f2002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae866af6bb99cef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.804+0000 7f7f2f7fe640 1 -- 172.21.15.60:0/3993973560 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20037070 con 0x7f7f3015e660 2024-09-12T01:39:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.804+0000 7f7f2f7fe640 1 -- 172.21.15.60:0/3993973560 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f20032440 con 0x7f7f3015e660 2024-09-12T01:39:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.804+0000 7f7f2f7fe640 1 -- 172.21.15.60:0/3993973560 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20032810 con 0x7f7f3015e660 2024-09-12T01:39:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.804+0000 7f7f37152640 1 -- 172.21.15.60:0/3993973560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f3015e660 msgr2=0x7f7f300cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.804+0000 7f7f37152640 1 --2- 172.21.15.60:0/3993973560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f3015e660 0x7f7f300cf730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7f200097a0 tx=0x7f7f2002a180 comp rx=0 tx=0).stop 2024-09-12T01:39:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.804+0000 7f7f37152640 1 -- 172.21.15.60:0/3993973560 shutdown_connections 2024-09-12T01:39:27.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.804+0000 7f7f37152640 1 --2- 172.21.15.60:0/3993973560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f300d3310 0x7f7f300d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.804+0000 7f7f37152640 1 --2- 172.21.15.60:0/3993973560 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f3015e660 0x7f7f300cf730 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.804+0000 7f7f37152640 1 -- 172.21.15.60:0/3993973560 >> 172.21.15.60:0/3993973560 conn(0x7f7f300b6410 msgr2=0x7f7f300b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:27.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.805+0000 7f7f37152640 1 -- 172.21.15.60:0/3993973560 shutdown_connections 2024-09-12T01:39:27.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.805+0000 7f7f37152640 1 -- 172.21.15.60:0/3993973560 wait complete. 2024-09-12T01:39:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.806+0000 7f7f37152640 1 Processor -- start 2024-09-12T01:39:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.806+0000 7f7f37152640 1 -- start start 2024-09-12T01:39:27.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f37152640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f300d1650 0x7f7f30161640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f37152640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f300d3310 0x7f7f30151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f37152640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f3015e660 0x7f7f3015ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f37152640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7f300d43f0 con 0x7f7f300d3310 2024-09-12T01:39:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f37152640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7f300d4110 con 0x7f7f300d1650 2024-09-12T01:39:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f37152640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7f300cfc70 con 0x7f7f3015e660 2024-09-12T01:39:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f2ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f300d3310 0x7f7f30151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f2ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f300d3310 0x7f7f30151b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35698/0 (socket says 172.21.15.60:35698) 2024-09-12T01:39:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f2ffff640 1 -- 172.21.15.60:0/1282909523 learned_addr learned my addr 172.21.15.60:0/1282909523 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f34eee640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f300d1650 0x7f7f30161640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f356ef640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f3015e660 0x7f7f3015ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f2ffff640 1 -- 172.21.15.60:0/1282909523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f3015e660 msgr2=0x7f7f3015ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f2ffff640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f3015e660 0x7f7f3015ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f2ffff640 1 -- 172.21.15.60:0/1282909523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f300d1650 msgr2=0x7f7f30161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:27.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f2ffff640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f300d1650 0x7f7f30161640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f2ffff640 1 -- 172.21.15.60:0/1282909523 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f300cabe0 con 0x7f7f300d3310 2024-09-12T01:39:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f356ef640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f3015e660 0x7f7f3015ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f2ffff640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f300d3310 0x7f7f30151b50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800ebe0 tx=0x7f7f1800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f2d7fa640 1 -- 172.21.15.60:0/1282909523 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f18017070 con 0x7f7f300d3310 2024-09-12T01:39:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.807+0000 7f7f2d7fa640 1 -- 172.21.15.60:0/1282909523 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f1800cc30 con 0x7f7f300d3310 2024-09-12T01:39:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.808+0000 7f7f37152640 1 -- 172.21.15.60:0/1282909523 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f3015fab0 con 0x7f7f300d3310 2024-09-12T01:39:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.808+0000 7f7f2d7fa640 1 -- 172.21.15.60:0/1282909523 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f18013470 con 0x7f7f300d3310 2024-09-12T01:39:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.808+0000 7f7f37152640 1 -- 172.21.15.60:0/1282909523 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f300c84d0 con 0x7f7f300d3310 2024-09-12T01:39:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.809+0000 7f7f37152640 1 -- 172.21.15.60:0/1282909523 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f300d1110 con 0x7f7f300d3310 2024-09-12T01:39:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.809+0000 7f7f2d7fa640 1 -- 172.21.15.60:0/1282909523 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7f1801a070 con 0x7f7f300d3310 2024-09-12T01:39:27.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.809+0000 7f7f2d7fa640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7f1006be30 0x7f7f1006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.810+0000 7f7f2d7fa640 1 -- 172.21.15.60:0/1282909523 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f7f1808acf0 con 0x7f7f300d3310 2024-09-12T01:39:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.810+0000 7f7f34eee640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7f1006be30 0x7f7f1006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:27.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.810+0000 7f7f34eee640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7f1006be30 0x7f7f1006e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7f20034000 tx=0x7f7f2002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:27.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:27.814+0000 7f7f2d7fa640 1 -- 172.21.15.60:0/1282909523 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7f1808f070 con 0x7f7f300d3310 2024-09-12T01:39:28.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.026+0000 7f7f37152640 1 -- 172.21.15.60:0/1282909523 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7f300cb0c0 con 0x7f7f300d3310 2024-09-12T01:39:28.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.026+0000 7f7f2d7fa640 1 -- 172.21.15.60:0/1282909523 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7f180590e0 con 0x7f7f300d3310 2024-09-12T01:39:28.026 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:28.026 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T01:39:28.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.029+0000 7f7f37152640 1 -- 172.21.15.60:0/1282909523 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7f1006be30 msgr2=0x7f7f1006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:28.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.029+0000 7f7f37152640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7f1006be30 0x7f7f1006e2f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7f20034000 tx=0x7f7f2002e000 comp rx=0 tx=0).stop 2024-09-12T01:39:28.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.029+0000 7f7f37152640 1 -- 172.21.15.60:0/1282909523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f300d3310 msgr2=0x7f7f30151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:28.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.029+0000 7f7f37152640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f300d3310 0x7f7f30151b50 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800ebe0 tx=0x7f7f1800c520 comp rx=0 tx=0).stop 2024-09-12T01:39:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.029+0000 7f7f37152640 1 -- 172.21.15.60:0/1282909523 shutdown_connections 2024-09-12T01:39:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.029+0000 7f7f37152640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7f1006be30 0x7f7f1006e2f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.029+0000 7f7f37152640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7f3015e660 0x7f7f3015ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.029+0000 7f7f37152640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f300d3310 0x7f7f30151b50 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.029+0000 7f7f37152640 1 --2- 172.21.15.60:0/1282909523 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7f300d1650 0x7f7f30161640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.029+0000 7f7f37152640 1 -- 172.21.15.60:0/1282909523 >> 172.21.15.60:0/1282909523 conn(0x7f7f300b6410 msgr2=0x7f7f3015d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.029+0000 7f7f37152640 1 -- 172.21.15.60:0/1282909523 shutdown_connections 2024-09-12T01:39:28.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:28.029+0000 7f7f37152640 1 -- 172.21.15.60:0/1282909523 wait complete. 2024-09-12T01:39:28.039 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2024-09-12T01:39:28.039 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:39:29.587 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:31.589 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:33.040 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:39:33.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.157+0000 7f35a2e8b640 1 Processor -- start 2024-09-12T01:39:33.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.157+0000 7f35a2e8b640 1 -- start start 2024-09-12T01:39:33.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f35a2e8b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f359c06e920 0x7f359c15f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f35a2e8b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f359c15fb10 con 0x7f359c0b74c0 2024-09-12T01:39:33.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f35a2e8b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f359c0b5900 con 0x7f359c15c2b0 2024-09-12T01:39:33.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f35a2e8b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f359c15f830 con 0x7f359c06e920 2024-09-12T01:39:33.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f359bfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f359c0b74c0 0x7f359c15eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60412/0 (socket says 172.21.15.60:60412) 2024-09-12T01:39:33.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f359bfff640 1 -- 172.21.15.60:0/3268396353 learned_addr learned my addr 172.21.15.60:0/3268396353 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:33.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f35a1428640 1 --2- 172.21.15.60:0/3268396353 >> v2:172.21.15.105:3300/0 conn(0x7f359c06e920 0x7f359c15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f359b7fe640 1 -- 172.21.15.60:0/3268396353 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744170699 0 0) 0x7f359c15fb10 con 0x7f359c0b74c0 2024-09-12T01:39:33.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f359b7fe640 1 -- 172.21.15.60:0/3268396353 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3588003520 con 0x7f359c0b74c0 2024-09-12T01:39:33.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f359b7fe640 1 -- 172.21.15.60:0/3268396353 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 369303119 0 0) 0x7f359c0b5900 con 0x7f359c15c2b0 2024-09-12T01:39:33.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f359b7fe640 1 -- 172.21.15.60:0/3268396353 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f359c15fb10 con 0x7f359c15c2b0 2024-09-12T01:39:33.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f359b7fe640 1 -- 172.21.15.60:0/3268396353 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2116865696 0 0) 0x7f3588003520 con 0x7f359c0b74c0 2024-09-12T01:39:33.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f35a1428640 1 -- 172.21.15.60:0/3268396353 >> v1:172.21.15.105:6789/0 conn(0x7f359c15c2b0 legacy=0x7f359c0b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f35a1428640 1 -- 172.21.15.60:0/3268396353 >> v1:172.21.15.60:6789/0 conn(0x7f359c0b74c0 legacy=0x7f359c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.158+0000 7f35a1428640 1 -- 172.21.15.60:0/3268396353 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c06ce30 con 0x7f359c06e920 2024-09-12T01:39:33.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.159+0000 7f35a1428640 1 --2- 172.21.15.60:0/3268396353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359c06e920 0x7f359c15f200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f35840097a0 tx=0x7f358402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94b6cbe7073089dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:33.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.159+0000 7f359b7fe640 1 -- 172.21.15.60:0/3268396353 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584037070 con 0x7f359c06e920 2024-09-12T01:39:33.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.159+0000 7f359b7fe640 1 -- 172.21.15.60:0/3268396353 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f358402ac50 con 0x7f359c06e920 2024-09-12T01:39:33.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.159+0000 7f359b7fe640 1 -- 172.21.15.60:0/3268396353 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358c0019f0 con 0x7f359c06e920 2024-09-12T01:39:33.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.160+0000 7f35a2e8b640 1 -- 172.21.15.60:0/3268396353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359c06e920 msgr2=0x7f359c15f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.160+0000 7f35a2e8b640 1 --2- 172.21.15.60:0/3268396353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359c06e920 0x7f359c15f200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f35840097a0 tx=0x7f358402a1c0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.160+0000 7f35a2e8b640 1 -- 172.21.15.60:0/3268396353 shutdown_connections 2024-09-12T01:39:33.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.160+0000 7f35a2e8b640 1 --2- 172.21.15.60:0/3268396353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359c06e920 0x7f359c15f200 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.160+0000 7f35a2e8b640 1 -- 172.21.15.60:0/3268396353 >> 172.21.15.60:0/3268396353 conn(0x7f359c0b4240 msgr2=0x7f359c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:33.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.160+0000 7f35a2e8b640 1 -- 172.21.15.60:0/3268396353 shutdown_connections 2024-09-12T01:39:33.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.160+0000 7f35a2e8b640 1 -- 172.21.15.60:0/3268396353 wait complete. 2024-09-12T01:39:33.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.161+0000 7f35a2e8b640 1 Processor -- start 2024-09-12T01:39:33.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.161+0000 7f35a2e8b640 1 -- start start 2024-09-12T01:39:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.162+0000 7f35a2e8b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c06e920 0x7f359c0d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.162+0000 7f35a2e8b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359c0b74c0 0x7f359c157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.162+0000 7f35a2e8b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359c15c2b0 0x7f359c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.162+0000 7f35a2e8b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f359c169170 con 0x7f359c06e920 2024-09-12T01:39:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.162+0000 7f35a2e8b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f359c06d3f0 con 0x7f359c15c2b0 2024-09-12T01:39:33.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.162+0000 7f35a2e8b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f359c1692f0 con 0x7f359c0b74c0 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.162+0000 7f35a0c27640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c06e920 0x7f359c0d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.162+0000 7f35a0c27640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c06e920 0x7f359c0d13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55840/0 (socket says 172.21.15.60:55840) 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.162+0000 7f35a0c27640 1 -- 172.21.15.60:0/124506839 learned_addr learned my addr 172.21.15.60:0/124506839 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f359bfff640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359c0b74c0 0x7f359c157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f35a1428640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359c15c2b0 0x7f359c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f35a0c27640 1 -- 172.21.15.60:0/124506839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359c0b74c0 msgr2=0x7f359c157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f35a0c27640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359c0b74c0 0x7f359c157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f35a0c27640 1 -- 172.21.15.60:0/124506839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359c15c2b0 msgr2=0x7f359c0cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f35a0c27640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359c15c2b0 0x7f359c0cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f35a0c27640 1 -- 172.21.15.60:0/124506839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c157ab0 con 0x7f359c06e920 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f35a0c27640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c06e920 0x7f359c0d13f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f359400c430 tx=0x7f359400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f35997fa640 1 -- 172.21.15.60:0/124506839 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594017070 con 0x7f359c06e920 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f35997fa640 1 -- 172.21.15.60:0/124506839 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35940052f0 con 0x7f359c06e920 2024-09-12T01:39:33.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f35a2e8b640 1 -- 172.21.15.60:0/124506839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359c0d0350 con 0x7f359c06e920 2024-09-12T01:39:33.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f35997fa640 1 -- 172.21.15.60:0/124506839 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594003830 con 0x7f359c06e920 2024-09-12T01:39:33.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.163+0000 7f35a2e8b640 1 -- 172.21.15.60:0/124506839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359c0d0910 con 0x7f359c06e920 2024-09-12T01:39:33.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.164+0000 7f35a2e8b640 1 -- 172.21.15.60:0/124506839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359c0b6db0 con 0x7f359c06e920 2024-09-12T01:39:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.165+0000 7f35997fa640 1 -- 172.21.15.60:0/124506839 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f359401a070 con 0x7f359c06e920 2024-09-12T01:39:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.165+0000 7f35997fa640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f357c06be30 0x7f357c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.165+0000 7f35997fa640 1 -- 172.21.15.60:0/124506839 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f359408a240 con 0x7f359c06e920 2024-09-12T01:39:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.165+0000 7f359bfff640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f357c06be30 0x7f357c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.166+0000 7f359bfff640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f357c06be30 0x7f357c06e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f358c001560 tx=0x7f358c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:33.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.170+0000 7f35997fa640 1 -- 172.21.15.60:0/124506839 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f359c157ab0 con 0x7f359c06e920 2024-09-12T01:39:33.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.381+0000 7f35a2e8b640 1 -- 172.21.15.60:0/124506839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f359c15dfb0 con 0x7f359c06e920 2024-09-12T01:39:33.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.382+0000 7f35997fa640 1 -- 172.21.15.60:0/124506839 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f3594058bf0 con 0x7f359c06e920 2024-09-12T01:39:33.381 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:33.381 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:39:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.384+0000 7f35a2e8b640 1 -- 172.21.15.60:0/124506839 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f357c06be30 msgr2=0x7f357c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.384+0000 7f35a2e8b640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f357c06be30 0x7f357c06e2f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f358c001560 tx=0x7f358c009040 comp rx=0 tx=0).stop 2024-09-12T01:39:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.384+0000 7f35a2e8b640 1 -- 172.21.15.60:0/124506839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c06e920 msgr2=0x7f359c0d13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.384+0000 7f35a2e8b640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c06e920 0x7f359c0d13f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f359400c430 tx=0x7f359400c8f0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.384+0000 7f35a2e8b640 1 -- 172.21.15.60:0/124506839 shutdown_connections 2024-09-12T01:39:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.384+0000 7f35a2e8b640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f359c15c2b0 0x7f359c0cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.384+0000 7f35a2e8b640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f357c06be30 0x7f357c06e2f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.384+0000 7f35a2e8b640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f359c0b74c0 0x7f359c157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.384+0000 7f35a2e8b640 1 --2- 172.21.15.60:0/124506839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f359c06e920 0x7f359c0d13f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.384+0000 7f35a2e8b640 1 -- 172.21.15.60:0/124506839 >> 172.21.15.60:0/124506839 conn(0x7f359c0b4240 msgr2=0x7f359c0b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.384+0000 7f35a2e8b640 1 -- 172.21.15.60:0/124506839 shutdown_connections 2024-09-12T01:39:33.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.384+0000 7f35a2e8b640 1 -- 172.21.15.60:0/124506839 wait complete. 2024-09-12T01:39:33.395 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T01:39:33.395 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-09-12T01:39:33.395 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:39:33.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.496+0000 7f5079aeb640 1 Processor -- start 2024-09-12T01:39:33.496 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.496+0000 7f5079aeb640 1 -- start start 2024-09-12T01:39:33.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.497+0000 7f5079aeb640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f507415e660 0x7f50740cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.497+0000 7f5079aeb640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50740d1820 0x7f50740b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.497+0000 7f5079aeb640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f507415ea40 con 0x7f50740d3310 2024-09-12T01:39:33.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.497+0000 7f5079aeb640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f50740d3870 con 0x7f507415e660 2024-09-12T01:39:33.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.497+0000 7f5079aeb640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f50740d3b50 con 0x7f50740d1820 2024-09-12T01:39:33.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.497+0000 7f50737fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f507415e660 0x7f50740cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.497+0000 7f50737fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f507415e660 0x7f50740cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55852/0 (socket says 172.21.15.60:55852) 2024-09-12T01:39:33.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.497+0000 7f50737fe640 1 -- 172.21.15.60:0/38176821 learned_addr learned my addr 172.21.15.60:0/38176821 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:33.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.498+0000 7f5073fff640 1 --2- 172.21.15.60:0/38176821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50740d1820 0x7f50740b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.498+0000 7f50737fe640 1 -- 172.21.15.60:0/38176821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50740d1820 msgr2=0x7f50740b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:33.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.498+0000 7f50737fe640 1 --2- 172.21.15.60:0/38176821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50740d1820 0x7f50740b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.498+0000 7f50737fe640 1 -- 172.21.15.60:0/38176821 >> v1:172.21.15.105:6789/0 conn(0x7f50740d3310 legacy=0x7f50740d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:33.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.498+0000 7f50737fe640 1 -- 172.21.15.60:0/38176821 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50740d3e30 con 0x7f507415e660 2024-09-12T01:39:33.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.499+0000 7f50737fe640 1 --2- 172.21.15.60:0/38176821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f507415e660 0x7f50740cf730 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5064009870 tx=0x7f506402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd13b3143c7e049 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:33.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.499+0000 7f50727fc640 1 -- 172.21.15.60:0/38176821 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064037070 con 0x7f507415e660 2024-09-12T01:39:33.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.499+0000 7f50727fc640 1 -- 172.21.15.60:0/38176821 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5064032440 con 0x7f507415e660 2024-09-12T01:39:33.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.499+0000 7f50727fc640 1 -- 172.21.15.60:0/38176821 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064032810 con 0x7f507415e660 2024-09-12T01:39:33.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.499+0000 7f5079aeb640 1 -- 172.21.15.60:0/38176821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f507415e660 msgr2=0x7f50740cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.499+0000 7f5079aeb640 1 --2- 172.21.15.60:0/38176821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f507415e660 0x7f50740cf730 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5064009870 tx=0x7f506402a270 comp rx=0 tx=0).stop 2024-09-12T01:39:33.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.499+0000 7f5079aeb640 1 -- 172.21.15.60:0/38176821 shutdown_connections 2024-09-12T01:39:33.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.499+0000 7f5079aeb640 1 --2- 172.21.15.60:0/38176821 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f50740d1820 0x7f50740b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.499+0000 7f5079aeb640 1 --2- 172.21.15.60:0/38176821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f507415e660 0x7f50740cf730 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.499+0000 7f5079aeb640 1 -- 172.21.15.60:0/38176821 >> 172.21.15.60:0/38176821 conn(0x7f50740b6410 msgr2=0x7f50740b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:33.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.499+0000 7f5079aeb640 1 -- 172.21.15.60:0/38176821 shutdown_connections 2024-09-12T01:39:33.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.499+0000 7f5079aeb640 1 -- 172.21.15.60:0/38176821 wait complete. 2024-09-12T01:39:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.500+0000 7f5079aeb640 1 Processor -- start 2024-09-12T01:39:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.501+0000 7f5079aeb640 1 -- start start 2024-09-12T01:39:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.501+0000 7f5079aeb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50740d1820 0x7f5074152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.501+0000 7f5079aeb640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50740d3310 0x7f50740caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.501+0000 7f5079aeb640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f507415e660 0x7f50740ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.501+0000 7f5079aeb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50740cfc70 con 0x7f50740d1820 2024-09-12T01:39:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.501+0000 7f5079aeb640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f50740d43f0 con 0x7f50740d3310 2024-09-12T01:39:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.501+0000 7f5079aeb640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f50740b80b0 con 0x7f507415e660 2024-09-12T01:39:33.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f50737fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50740d1820 0x7f5074152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f50737fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50740d1820 0x7f5074152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55866/0 (socket says 172.21.15.60:55866) 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f50737fe640 1 -- 172.21.15.60:0/1237023358 learned_addr learned my addr 172.21.15.60:0/1237023358 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f5072ffd640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50740d3310 0x7f50740caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f5073fff640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f507415e660 0x7f50740ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f50737fe640 1 -- 172.21.15.60:0/1237023358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f507415e660 msgr2=0x7f50740ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f50737fe640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f507415e660 0x7f50740ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f50737fe640 1 -- 172.21.15.60:0/1237023358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50740d3310 msgr2=0x7f50740caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f50737fe640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50740d3310 0x7f50740caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f50737fe640 1 -- 172.21.15.60:0/1237023358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5074153200 con 0x7f50740d1820 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f50737fe640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50740d1820 0x7f5074152960 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5064000c00 tx=0x7f50640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f505bfff640 1 -- 172.21.15.60:0/1237023358 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064041020 con 0x7f50740d1820 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f505bfff640 1 -- 172.21.15.60:0/1237023358 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50640306c0 con 0x7f50740d1820 2024-09-12T01:39:33.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f505bfff640 1 -- 172.21.15.60:0/1237023358 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5064037040 con 0x7f50740d1820 2024-09-12T01:39:33.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f5079aeb640 1 -- 172.21.15.60:0/1237023358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50741534e0 con 0x7f50740d1820 2024-09-12T01:39:33.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.502+0000 7f5079aeb640 1 -- 172.21.15.60:0/1237023358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50740c9390 con 0x7f50740d1820 2024-09-12T01:39:33.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.503+0000 7f5079aeb640 1 -- 172.21.15.60:0/1237023358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50740c95d0 con 0x7f50740d1820 2024-09-12T01:39:33.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.504+0000 7f505bfff640 1 -- 172.21.15.60:0/1237023358 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5064044020 con 0x7f50740d1820 2024-09-12T01:39:33.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.504+0000 7f505bfff640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f506006be30 0x7f506006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:33.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.504+0000 7f505bfff640 1 -- 172.21.15.60:0/1237023358 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f50640ab560 con 0x7f50740d1820 2024-09-12T01:39:33.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.504+0000 7f5072ffd640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f506006be30 0x7f506006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:33.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.505+0000 7f5072ffd640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f506006be30 0x7f506006e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f50740c87a0 tx=0x7f5068009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:33.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.508+0000 7f505bfff640 1 -- 172.21.15.60:0/1237023358 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f50740c95d0 con 0x7f50740d1820 2024-09-12T01:39:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:33.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.717+0000 7f5079aeb640 1 -- 172.21.15.60:0/1237023358 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f50740b7b70 con 0x7f50740d1820 2024-09-12T01:39:33.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.717+0000 7f505bfff640 1 -- 172.21.15.60:0/1237023358 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f506404b030 con 0x7f50740d1820 2024-09-12T01:39:33.717 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:33.718 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:39:33.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.719+0000 7f5079aeb640 1 -- 172.21.15.60:0/1237023358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f506006be30 msgr2=0x7f506006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.719+0000 7f5079aeb640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f506006be30 0x7f506006e2f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f50740c87a0 tx=0x7f5068009040 comp rx=0 tx=0).stop 2024-09-12T01:39:33.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.719+0000 7f5079aeb640 1 -- 172.21.15.60:0/1237023358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50740d1820 msgr2=0x7f5074152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:33.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.719+0000 7f5079aeb640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50740d1820 0x7f5074152960 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5064000c00 tx=0x7f50640046c0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.719+0000 7f5079aeb640 1 -- 172.21.15.60:0/1237023358 shutdown_connections 2024-09-12T01:39:33.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.719+0000 7f5079aeb640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f506006be30 0x7f506006e2f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.719+0000 7f5079aeb640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f507415e660 0x7f50740ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.719+0000 7f5079aeb640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f50740d3310 0x7f50740caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.719+0000 7f5079aeb640 1 --2- 172.21.15.60:0/1237023358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50740d1820 0x7f5074152960 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:33.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.719+0000 7f5079aeb640 1 -- 172.21.15.60:0/1237023358 >> 172.21.15.60:0/1237023358 conn(0x7f50740b6410 msgr2=0x7f50740b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:33.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.719+0000 7f5079aeb640 1 -- 172.21.15.60:0/1237023358 shutdown_connections 2024-09-12T01:39:33.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:33.719+0000 7f5079aeb640 1 -- 172.21.15.60:0/1237023358 wait complete. 2024-09-12T01:39:33.730 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:39:33.731 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:39:35.593 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:37.595 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:38.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:39:38.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.847+0000 7fe249ddf640 1 Processor -- start 2024-09-12T01:39:38.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.847+0000 7fe249ddf640 1 -- start start 2024-09-12T01:39:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.847+0000 7fe249ddf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 0x7fe2440cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe249ddf640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24415ea40 con 0x7fe2440d1820 2024-09-12T01:39:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe249ddf640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2440d3870 con 0x7fe2440d3310 2024-09-12T01:39:38.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe249ddf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2440d3b50 con 0x7fe24415e660 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe243fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe2440d1820 0x7fe2440b7b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60414/0 (socket says 172.21.15.60:60414) 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe243fff640 1 -- 172.21.15.60:0/978456495 learned_addr learned my addr 172.21.15.60:0/978456495 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe2437fe640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 0x7fe2440cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865151416 0 0) 0x7fe24415ea40 con 0x7fe2440d1820 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe230003520 con 0x7fe2440d1820 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093958362 0 0) 0x7fe2440d3870 con 0x7fe2440d3310 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe24415ea40 con 0x7fe2440d3310 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4242735837 0 0) 0x7fe230003520 con 0x7fe2440d1820 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 msgr2=0x7fe2440cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 0x7fe2440cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 >> v1:172.21.15.105:6789/0 conn(0x7fe2440d3310 legacy=0x7fe2440d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2440d3e30 con 0x7fe2440d1820 2024-09-12T01:39:38.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fe23c0019f0 con 0x7fe2440d1820 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 >> v1:172.21.15.60:6789/0 conn(0x7fe2440d1820 legacy=0x7fe2440b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 0x7fe230003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe230004120 0x7fe230004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe230004d40 0x7fe2300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440d3b50 con 0x7fe230004d40 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe23000bb00 con 0x7fe230004120 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.848+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe23000bd00 con 0x7fe24415e660 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.849+0000 7fe2437fe640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 0x7fe230003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.849+0000 7fe23affd640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe230004120 0x7fe230004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.849+0000 7fe243fff640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe230004d40 0x7fe2300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.849+0000 7fe2437fe640 1 -- 172.21.15.60:0/978456495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe230004120 msgr2=0x7fe230004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.849+0000 7fe2437fe640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe230004120 0x7fe230004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.849+0000 7fe2437fe640 1 -- 172.21.15.60:0/978456495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe230004d40 msgr2=0x7fe2300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:38.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.849+0000 7fe2437fe640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe230004d40 0x7fe2300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:38.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.849+0000 7fe2437fe640 1 -- 172.21.15.60:0/978456495 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe230003520 con 0x7fe24415e660 2024-09-12T01:39:38.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.849+0000 7fe243fff640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe230004d40 0x7fe2300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:39:38.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.850+0000 7fe2437fe640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 0x7fe230003b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe234009ac0 tx=0x7fe230005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c13c4ef3b7dda2f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:38.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.850+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234036070 con 0x7fe24415e660 2024-09-12T01:39:38.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.850+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe234031400 con 0x7fe24415e660 2024-09-12T01:39:38.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.850+0000 7fe242ffd640 1 -- 172.21.15.60:0/978456495 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234009690 con 0x7fe24415e660 2024-09-12T01:39:38.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.850+0000 7fe249ddf640 1 -- 172.21.15.60:0/978456495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 msgr2=0x7fe230003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.850+0000 7fe249ddf640 1 --2- 172.21.15.60:0/978456495 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 0x7fe230003b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe234009ac0 tx=0x7fe230005830 comp rx=0 tx=0).stop 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.851+0000 7fe243fff640 1 -- 172.21.15.60:0/978456495 reap_dead start 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.851+0000 7fe249ddf640 1 -- 172.21.15.60:0/978456495 shutdown_connections 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.851+0000 7fe249ddf640 1 -- 172.21.15.60:0/978456495 >> 172.21.15.60:0/978456495 conn(0x7fe2440b6410 msgr2=0x7fe2440b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.851+0000 7fe249ddf640 1 -- 172.21.15.60:0/978456495 shutdown_connections 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.851+0000 7fe249ddf640 1 -- 172.21.15.60:0/978456495 wait complete. 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.852+0000 7fe249ddf640 1 Processor -- start 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.852+0000 7fe249ddf640 1 -- start start 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe249ddf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 0x7fe24414ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe249ddf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2440c9ec0 0x7fe2440ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe249ddf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2440c80f0 0x7fe2440c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe249ddf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440cf730 con 0x7fe2440c80f0 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe249ddf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440d43f0 con 0x7fe2440c9ec0 2024-09-12T01:39:38.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe249ddf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2440cf8b0 con 0x7fe24415e660 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe243fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2440c80f0 0x7fe2440c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe243fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2440c80f0 0x7fe2440c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55890/0 (socket says 172.21.15.60:55890) 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe243fff640 1 -- 172.21.15.60:0/2092161969 learned_addr learned my addr 172.21.15.60:0/2092161969 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe23affd640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2440c9ec0 0x7fe2440ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe2437fe640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 0x7fe24414ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe243fff640 1 -- 172.21.15.60:0/2092161969 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 msgr2=0x7fe24414ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe243fff640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 0x7fe24414ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe243fff640 1 -- 172.21.15.60:0/2092161969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2440c9ec0 msgr2=0x7fe2440ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe243fff640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2440c9ec0 0x7fe2440ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.853+0000 7fe243fff640 1 -- 172.21.15.60:0/2092161969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2440c8e70 con 0x7fe2440c80f0 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.854+0000 7fe243fff640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2440c80f0 0x7fe2440c85a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe244074050 tx=0x7fe23c00af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.854+0000 7fe240ff9640 1 -- 172.21.15.60:0/2092161969 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c017020 con 0x7fe2440c80f0 2024-09-12T01:39:38.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.854+0000 7fe240ff9640 1 -- 172.21.15.60:0/2092161969 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c0078c0 con 0x7fe2440c80f0 2024-09-12T01:39:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.854+0000 7fe249ddf640 1 -- 172.21.15.60:0/2092161969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2440c9150 con 0x7fe2440c80f0 2024-09-12T01:39:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.854+0000 7fe240ff9640 1 -- 172.21.15.60:0/2092161969 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00a330 con 0x7fe2440c80f0 2024-09-12T01:39:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.854+0000 7fe249ddf640 1 -- 172.21.15.60:0/2092161969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2440c9710 con 0x7fe2440c80f0 2024-09-12T01:39:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.855+0000 7fe249ddf640 1 -- 172.21.15.60:0/2092161969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe244068d50 con 0x7fe2440c80f0 2024-09-12T01:39:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.855+0000 7fe240ff9640 1 -- 172.21.15.60:0/2092161969 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe23c01a020 con 0x7fe2440c80f0 2024-09-12T01:39:38.857 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.856+0000 7fe240ff9640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe22406be60 0x7fe22406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:38.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.856+0000 7fe240ff9640 1 -- 172.21.15.60:0/2092161969 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fe23c08b2d0 con 0x7fe2440c80f0 2024-09-12T01:39:38.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.856+0000 7fe2437fe640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe22406be60 0x7fe22406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:38.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.856+0000 7fe2437fe640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe22406be60 0x7fe22406e320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe234033000 tx=0x7fe234008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:38.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:38.860+0000 7fe240ff9640 1 -- 172.21.15.60:0/2092161969 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe244068d50 con 0x7fe2440c80f0 2024-09-12T01:39:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.073+0000 7fe249ddf640 1 -- 172.21.15.60:0/2092161969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe2440cfc40 con 0x7fe2440c80f0 2024-09-12T01:39:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.074+0000 7fe240ff9640 1 -- 172.21.15.60:0/2092161969 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fe23c021020 con 0x7fe2440c80f0 2024-09-12T01:39:39.073 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:39.073 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:39:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.076+0000 7fe249ddf640 1 -- 172.21.15.60:0/2092161969 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe22406be60 msgr2=0x7fe22406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.076+0000 7fe249ddf640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe22406be60 0x7fe22406e320 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe234033000 tx=0x7fe234008030 comp rx=0 tx=0).stop 2024-09-12T01:39:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.076+0000 7fe249ddf640 1 -- 172.21.15.60:0/2092161969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2440c80f0 msgr2=0x7fe2440c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.076+0000 7fe249ddf640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2440c80f0 0x7fe2440c85a0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe244074050 tx=0x7fe23c00af00 comp rx=0 tx=0).stop 2024-09-12T01:39:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.076+0000 7fe249ddf640 1 -- 172.21.15.60:0/2092161969 shutdown_connections 2024-09-12T01:39:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.076+0000 7fe249ddf640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2440c80f0 0x7fe2440c85a0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.076+0000 7fe249ddf640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2440c9ec0 0x7fe2440ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.076+0000 7fe249ddf640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe22406be60 0x7fe22406e320 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.076+0000 7fe249ddf640 1 --2- 172.21.15.60:0/2092161969 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe24415e660 0x7fe24414ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.076+0000 7fe249ddf640 1 -- 172.21.15.60:0/2092161969 >> 172.21.15.60:0/2092161969 conn(0x7fe2440b6410 msgr2=0x7fe24415cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.076+0000 7fe249ddf640 1 -- 172.21.15.60:0/2092161969 shutdown_connections 2024-09-12T01:39:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:39.076+0000 7fe249ddf640 1 -- 172.21.15.60:0/2092161969 wait complete. 2024-09-12T01:39:39.086 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:39:39.086 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:39:39.597 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:41.600 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:43.603 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:44.087 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:39:44.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.201+0000 7f98bd6fa640 1 Processor -- start 2024-09-12T01:39:44.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.201+0000 7f98bd6fa640 1 -- start start 2024-09-12T01:39:44.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.202+0000 7f98bd6fa640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98b80b74c0 0x7f98b815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:44.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.202+0000 7f98bd6fa640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815f030 0x7f98b806d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:44.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.202+0000 7f98bd6fa640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98b815fb10 con 0x7f98b815c2b0 2024-09-12T01:39:44.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.202+0000 7f98bd6fa640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f98b80b5900 con 0x7f98b80b74c0 2024-09-12T01:39:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.202+0000 7f98bd6fa640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f98b815f830 con 0x7f98b815f030 2024-09-12T01:39:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.202+0000 7f98b67fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98b80b74c0 0x7f98b815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.202+0000 7f98b6ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f98b815c2b0 0x7f98b80b6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56342/0 (socket says 172.21.15.60:56342) 2024-09-12T01:39:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.202+0000 7f98b67fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98b80b74c0 0x7f98b815eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35858/0 (socket says 172.21.15.60:35858) 2024-09-12T01:39:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.202+0000 7f98b6ffd640 1 -- 172.21.15.60:0/481816342 learned_addr learned my addr 172.21.15.60:0/481816342 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.202+0000 7f98b77fe640 1 --2- 172.21.15.60:0/481816342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815f030 0x7f98b806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.203+0000 7f98b67fc640 1 -- 172.21.15.60:0/481816342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815f030 msgr2=0x7f98b806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.203+0000 7f98b67fc640 1 --2- 172.21.15.60:0/481816342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815f030 0x7f98b806d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.203+0000 7f98b67fc640 1 -- 172.21.15.60:0/481816342 >> v1:172.21.15.60:6789/0 conn(0x7f98b815c2b0 legacy=0x7f98b80b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.203+0000 7f98b67fc640 1 -- 172.21.15.60:0/481816342 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b806ce30 con 0x7f98b80b74c0 2024-09-12T01:39:44.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.203+0000 7f98b5ffb640 1 -- 172.21.15.60:0/481816342 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2887227517 0 0) 0x7f98b815fb10 con 0x7f98b815c2b0 2024-09-12T01:39:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.203+0000 7f98b67fc640 1 --2- 172.21.15.60:0/481816342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b80b74c0 0x7f98b815eaf0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f98a80097a0 tx=0x7f98a802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466e6086574dc793 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.204+0000 7f98b5ffb640 1 -- 172.21.15.60:0/481816342 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8037070 con 0x7f98b80b74c0 2024-09-12T01:39:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.204+0000 7f98b5ffb640 1 -- 172.21.15.60:0/481816342 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a8032440 con 0x7f98b80b74c0 2024-09-12T01:39:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.204+0000 7f98b5ffb640 1 -- 172.21.15.60:0/481816342 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8032810 con 0x7f98b80b74c0 2024-09-12T01:39:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.204+0000 7f98bd6fa640 1 -- 172.21.15.60:0/481816342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b80b74c0 msgr2=0x7f98b815eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.204+0000 7f98bd6fa640 1 --2- 172.21.15.60:0/481816342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b80b74c0 0x7f98b815eaf0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f98a80097a0 tx=0x7f98a802a180 comp rx=0 tx=0).stop 2024-09-12T01:39:44.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.204+0000 7f98bd6fa640 1 -- 172.21.15.60:0/481816342 shutdown_connections 2024-09-12T01:39:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.204+0000 7f98bd6fa640 1 --2- 172.21.15.60:0/481816342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815f030 0x7f98b806d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.204+0000 7f98bd6fa640 1 --2- 172.21.15.60:0/481816342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b80b74c0 0x7f98b815eaf0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.204+0000 7f98bd6fa640 1 -- 172.21.15.60:0/481816342 >> 172.21.15.60:0/481816342 conn(0x7f98b80b4240 msgr2=0x7f98b80b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.204+0000 7f98bd6fa640 1 -- 172.21.15.60:0/481816342 shutdown_connections 2024-09-12T01:39:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.204+0000 7f98bd6fa640 1 -- 172.21.15.60:0/481816342 wait complete. 2024-09-12T01:39:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.206+0000 7f98bd6fa640 1 Processor -- start 2024-09-12T01:39:44.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.206+0000 7f98bd6fa640 1 -- start start 2024-09-12T01:39:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.206+0000 7f98bd6fa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b80b74c0 0x7f98b8147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98bd6fa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b815c2b0 0x7f98b80d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98bd6fa640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815f030 0x7f98b80d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98bd6fa640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f98b815f4c0 con 0x7f98b815c2b0 2024-09-12T01:39:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98bd6fa640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f98b806d3f0 con 0x7f98b80b74c0 2024-09-12T01:39:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98bd6fa640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f98b806de50 con 0x7f98b815f030 2024-09-12T01:39:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98b67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b815c2b0 0x7f98b80d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98b67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b815c2b0 0x7f98b80d14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35870/0 (socket says 172.21.15.60:35870) 2024-09-12T01:39:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98b67fc640 1 -- 172.21.15.60:0/2247352519 learned_addr learned my addr 172.21.15.60:0/2247352519 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98b6ffd640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b80b74c0 0x7f98b8147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98b77fe640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815f030 0x7f98b80d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98b67fc640 1 -- 172.21.15.60:0/2247352519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815f030 msgr2=0x7f98b80d1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98b67fc640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815f030 0x7f98b80d1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98b67fc640 1 -- 172.21.15.60:0/2247352519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b80b74c0 msgr2=0x7f98b8147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98b67fc640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b80b74c0 0x7f98b8147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98b67fc640 1 -- 172.21.15.60:0/2247352519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b8148690 con 0x7f98b815c2b0 2024-09-12T01:39:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98b6ffd640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b80b74c0 0x7f98b8147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:39:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98b67fc640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b815c2b0 0x7f98b80d14d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f98a8035040 tx=0x7f98a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f989f7fe640 1 -- 172.21.15.60:0/2247352519 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8037040 con 0x7f98b815c2b0 2024-09-12T01:39:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f989f7fe640 1 -- 172.21.15.60:0/2247352519 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a8030500 con 0x7f98b815c2b0 2024-09-12T01:39:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f989f7fe640 1 -- 172.21.15.60:0/2247352519 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a8030910 con 0x7f98b815c2b0 2024-09-12T01:39:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.207+0000 7f98bd6fa640 1 -- 172.21.15.60:0/2247352519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b80ce740 con 0x7f98b815c2b0 2024-09-12T01:39:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.208+0000 7f98bd6fa640 1 -- 172.21.15.60:0/2247352519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b8148c10 con 0x7f98b815c2b0 2024-09-12T01:39:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.208+0000 7f98bd6fa640 1 -- 172.21.15.60:0/2247352519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b815eaf0 con 0x7f98b815c2b0 2024-09-12T01:39:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.209+0000 7f989f7fe640 1 -- 172.21.15.60:0/2247352519 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f98a8044020 con 0x7f98b815c2b0 2024-09-12T01:39:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.209+0000 7f989f7fe640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f98a406be30 0x7f98a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.210+0000 7f989f7fe640 1 -- 172.21.15.60:0/2247352519 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f98a80ab080 con 0x7f98b815c2b0 2024-09-12T01:39:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.210+0000 7f98b6ffd640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f98a406be30 0x7f98a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.210+0000 7f98b6ffd640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f98a406be30 0x7f98a406e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f98ac000f60 tx=0x7f98ac007c30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:44.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.214+0000 7f989f7fe640 1 -- 172.21.15.60:0/2247352519 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f98a8079a30 con 0x7f98b815c2b0 2024-09-12T01:39:44.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.431+0000 7f98bd6fa640 1 -- 172.21.15.60:0/2247352519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f98b80cecb0 con 0x7f98b815c2b0 2024-09-12T01:39:44.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.431+0000 7f989f7fe640 1 -- 172.21.15.60:0/2247352519 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f98a8079330 con 0x7f98b815c2b0 2024-09-12T01:39:44.432 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:44.432 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:39:44.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.434+0000 7f98bd6fa640 1 -- 172.21.15.60:0/2247352519 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f98a406be30 msgr2=0x7f98a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:44.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.434+0000 7f98bd6fa640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f98a406be30 0x7f98a406e2f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f98ac000f60 tx=0x7f98ac007c30 comp rx=0 tx=0).stop 2024-09-12T01:39:44.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.434+0000 7f98bd6fa640 1 -- 172.21.15.60:0/2247352519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b815c2b0 msgr2=0x7f98b80d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:44.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.434+0000 7f98bd6fa640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b815c2b0 0x7f98b80d14d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f98a8035040 tx=0x7f98a80046c0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.434+0000 7f98bd6fa640 1 -- 172.21.15.60:0/2247352519 shutdown_connections 2024-09-12T01:39:44.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.434+0000 7f98bd6fa640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f98a406be30 0x7f98a406e2f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.434+0000 7f98bd6fa640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f98b815f030 0x7f98b80d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.434+0000 7f98bd6fa640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98b815c2b0 0x7f98b80d14d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.434+0000 7f98bd6fa640 1 --2- 172.21.15.60:0/2247352519 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f98b80b74c0 0x7f98b8147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:44.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.434+0000 7f98bd6fa640 1 -- 172.21.15.60:0/2247352519 >> 172.21.15.60:0/2247352519 conn(0x7f98b80b4240 msgr2=0x7f98b80b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:44.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.434+0000 7f98bd6fa640 1 -- 172.21.15.60:0/2247352519 shutdown_connections 2024-09-12T01:39:44.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:44.434+0000 7f98bd6fa640 1 -- 172.21.15.60:0/2247352519 wait complete. 2024-09-12T01:39:44.445 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:39:44.446 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:39:45.604 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:47.606 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:48.283 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:39:48.286 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:39:49.446 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:39:49.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.561+0000 7ff5ada82640 1 Processor -- start 2024-09-12T01:39:49.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.561+0000 7ff5ada82640 1 -- start start 2024-09-12T01:39:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.562+0000 7ff5ada82640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5a815c2b0 0x7ff5a80b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.562+0000 7ff5ada82640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5a80b72f0 0x7ff5a815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.562+0000 7ff5ada82640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff5a815f030 0x7ff5a806f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.562+0000 7ff5ada82640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff5a815fb10 con 0x7ff5a80b72f0 2024-09-12T01:39:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.562+0000 7ff5ada82640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff5a80b5900 con 0x7ff5a815f030 2024-09-12T01:39:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.562+0000 7ff5ada82640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a815f830 con 0x7ff5a815c2b0 2024-09-12T01:39:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.562+0000 7ff5a6ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5a80b72f0 0x7ff5a815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.562+0000 7ff5a6ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5a80b72f0 0x7ff5a815eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35878/0 (socket says 172.21.15.60:35878) 2024-09-12T01:39:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.562+0000 7ff5a6ffd640 1 -- 172.21.15.60:0/1836702156 learned_addr learned my addr 172.21.15.60:0/1836702156 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.563+0000 7ff5a7fff640 1 --2- 172.21.15.60:0/1836702156 >> v2:172.21.15.105:3300/0 conn(0x7ff5a815f030 0x7ff5a806f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.563+0000 7ff5a77fe640 1 --2- 172.21.15.60:0/1836702156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5a815c2b0 0x7ff5a80b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.563+0000 7ff5a6ffd640 1 -- 172.21.15.60:0/1836702156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5a815c2b0 msgr2=0x7ff5a80b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.563+0000 7ff5a6ffd640 1 --2- 172.21.15.60:0/1836702156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5a815c2b0 0x7ff5a80b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.563+0000 7ff5a6ffd640 1 -- 172.21.15.60:0/1836702156 >> v2:172.21.15.105:3300/0 conn(0x7ff5a815f030 msgr2=0x7ff5a806f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.563+0000 7ff5a6ffd640 1 --2- 172.21.15.60:0/1836702156 >> v2:172.21.15.105:3300/0 conn(0x7ff5a815f030 0x7ff5a806f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.563+0000 7ff5a6ffd640 1 -- 172.21.15.60:0/1836702156 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a806ce30 con 0x7ff5a80b72f0 2024-09-12T01:39:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.563+0000 7ff5a7fff640 1 --2- 172.21.15.60:0/1836702156 >> v2:172.21.15.105:3300/0 conn(0x7ff5a815f030 0x7ff5a806f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.563+0000 7ff5a77fe640 1 --2- 172.21.15.60:0/1836702156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5a815c2b0 0x7ff5a80b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.563+0000 7ff5a6ffd640 1 --2- 172.21.15.60:0/1836702156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a80b72f0 0x7ff5a815eaf0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8070ff0 tx=0x7ff59c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70156cbb5cd71bea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.564+0000 7ff5a67fc640 1 -- 172.21.15.60:0/1836702156 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c037070 con 0x7ff5a80b72f0 2024-09-12T01:39:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.564+0000 7ff5a67fc640 1 -- 172.21.15.60:0/1836702156 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff59c032440 con 0x7ff5a80b72f0 2024-09-12T01:39:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.564+0000 7ff5a67fc640 1 -- 172.21.15.60:0/1836702156 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59c032810 con 0x7ff5a80b72f0 2024-09-12T01:39:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.564+0000 7ff5ada82640 1 -- 172.21.15.60:0/1836702156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a80b72f0 msgr2=0x7ff5a815eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.564+0000 7ff5ada82640 1 --2- 172.21.15.60:0/1836702156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a80b72f0 0x7ff5a815eaf0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8070ff0 tx=0x7ff59c02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.564+0000 7ff5ada82640 1 -- 172.21.15.60:0/1836702156 shutdown_connections 2024-09-12T01:39:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.564+0000 7ff5ada82640 1 --2- 172.21.15.60:0/1836702156 >> v2:172.21.15.105:3300/0 conn(0x7ff5a815f030 0x7ff5a806f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.564+0000 7ff5ada82640 1 --2- 172.21.15.60:0/1836702156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a80b72f0 0x7ff5a815eaf0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.564+0000 7ff5ada82640 1 --2- 172.21.15.60:0/1836702156 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5a815c2b0 0x7ff5a80b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.564+0000 7ff5ada82640 1 -- 172.21.15.60:0/1836702156 >> 172.21.15.60:0/1836702156 conn(0x7ff5a80b4240 msgr2=0x7ff5a80b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.564+0000 7ff5ada82640 1 -- 172.21.15.60:0/1836702156 shutdown_connections 2024-09-12T01:39:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.564+0000 7ff5ada82640 1 -- 172.21.15.60:0/1836702156 wait complete. 2024-09-12T01:39:49.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.565+0000 7ff5ada82640 1 Processor -- start 2024-09-12T01:39:49.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.566+0000 7ff5ada82640 1 -- start start 2024-09-12T01:39:49.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.566+0000 7ff5ada82640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a80b72f0 0x7ff5a8155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:49.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.566+0000 7ff5ada82640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5a815c2b0 0x7ff5a815a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:49.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.566+0000 7ff5ada82640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5a815f030 0x7ff5a815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:49.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.566+0000 7ff5ada82640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a80b7730 con 0x7ff5a80b72f0 2024-09-12T01:39:49.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.566+0000 7ff5ada82640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a806d3f0 con 0x7ff5a815f030 2024-09-12T01:39:49.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.566+0000 7ff5ada82640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a815f4e0 con 0x7ff5a815c2b0 2024-09-12T01:39:49.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5a77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a80b72f0 0x7ff5a8155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:49.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5a77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a80b72f0 0x7ff5a8155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:35890/0 (socket says 172.21.15.60:35890) 2024-09-12T01:39:49.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5a77fe640 1 -- 172.21.15.60:0/1727949008 learned_addr learned my addr 172.21.15.60:0/1727949008 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:49.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5a7fff640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5a815f030 0x7ff5a815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:49.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5a6ffd640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5a815c2b0 0x7ff5a815a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:49.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5a77fe640 1 -- 172.21.15.60:0/1727949008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5a815c2b0 msgr2=0x7ff5a815a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:49.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5a77fe640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5a815c2b0 0x7ff5a815a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5a77fe640 1 -- 172.21.15.60:0/1727949008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5a815f030 msgr2=0x7ff5a815adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:49.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5a77fe640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5a815f030 0x7ff5a815adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5a77fe640 1 -- 172.21.15.60:0/1727949008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a8155640 con 0x7ff5a80b72f0 2024-09-12T01:39:49.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5a77fe640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a80b72f0 0x7ff5a8155100 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff59800c820 tx=0x7ff59800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:49.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff58ffff640 1 -- 172.21.15.60:0/1727949008 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598015070 con 0x7ff5a80b72f0 2024-09-12T01:39:49.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff58ffff640 1 -- 172.21.15.60:0/1727949008 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff598007a30 con 0x7ff5a80b72f0 2024-09-12T01:39:49.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5ada82640 1 -- 172.21.15.60:0/1727949008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a8155900 con 0x7ff5a80b72f0 2024-09-12T01:39:49.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff58ffff640 1 -- 172.21.15.60:0/1727949008 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598007e00 con 0x7ff5a80b72f0 2024-09-12T01:39:49.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.567+0000 7ff5ada82640 1 -- 172.21.15.60:0/1727949008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a8155ec0 con 0x7ff5a80b72f0 2024-09-12T01:39:49.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.568+0000 7ff5ada82640 1 -- 172.21.15.60:0/1727949008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a815eaf0 con 0x7ff5a80b72f0 2024-09-12T01:39:49.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.569+0000 7ff58ffff640 1 -- 172.21.15.60:0/1727949008 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff598018070 con 0x7ff5a80b72f0 2024-09-12T01:39:49.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.569+0000 7ff58ffff640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff59406be30 0x7ff59406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:49.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.569+0000 7ff58ffff640 1 -- 172.21.15.60:0/1727949008 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7ff59808ad40 con 0x7ff5a80b72f0 2024-09-12T01:39:49.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.569+0000 7ff5a6ffd640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff59406be30 0x7ff59406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:49.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.570+0000 7ff5a6ffd640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff59406be30 0x7ff59406e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff59c034000 tx=0x7ff59c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:49.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.574+0000 7ff58ffff640 1 -- 172.21.15.60:0/1727949008 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff5a8155640 con 0x7ff5a80b72f0 2024-09-12T01:39:49.608 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:49.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.786+0000 7ff5ada82640 1 -- 172.21.15.60:0/1727949008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff5a815d0e0 con 0x7ff5a80b72f0 2024-09-12T01:39:49.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.786+0000 7ff58ffff640 1 -- 172.21.15.60:0/1727949008 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7ff598059780 con 0x7ff5a80b72f0 2024-09-12T01:39:49.787 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:49.787 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:39:49.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.788+0000 7ff5ada82640 1 -- 172.21.15.60:0/1727949008 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff59406be30 msgr2=0x7ff59406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:49.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.788+0000 7ff5ada82640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff59406be30 0x7ff59406e2f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff59c034000 tx=0x7ff59c02e000 comp rx=0 tx=0).stop 2024-09-12T01:39:49.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.788+0000 7ff5ada82640 1 -- 172.21.15.60:0/1727949008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a80b72f0 msgr2=0x7ff5a8155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:49.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.788+0000 7ff5ada82640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a80b72f0 0x7ff5a8155100 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff59800c820 tx=0x7ff59800cc20 comp rx=0 tx=0).stop 2024-09-12T01:39:49.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.788+0000 7ff5ada82640 1 -- 172.21.15.60:0/1727949008 shutdown_connections 2024-09-12T01:39:49.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.788+0000 7ff5ada82640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5a815f030 0x7ff5a815adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.788+0000 7ff5ada82640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff59406be30 0x7ff59406e2f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.788+0000 7ff5ada82640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5a815c2b0 0x7ff5a815a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.788+0000 7ff5ada82640 1 --2- 172.21.15.60:0/1727949008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5a80b72f0 0x7ff5a8155100 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:49.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.788+0000 7ff5ada82640 1 -- 172.21.15.60:0/1727949008 >> 172.21.15.60:0/1727949008 conn(0x7ff5a80b4240 msgr2=0x7ff5a815db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:49.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.788+0000 7ff5ada82640 1 -- 172.21.15.60:0/1727949008 shutdown_connections 2024-09-12T01:39:49.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:49.788+0000 7ff5ada82640 1 -- 172.21.15.60:0/1727949008 wait complete. 2024-09-12T01:39:49.802 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:39:49.802 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:39:51.617 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:53.612 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:54.803 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:39:54.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.918+0000 7fce8a69b640 1 Processor -- start 2024-09-12T01:39:54.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.918+0000 7fce8a69b640 1 -- start start 2024-09-12T01:39:54.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.919+0000 7fce8a69b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce840d1820 0x7fce841691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:54.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.919+0000 7fce8a69b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce8415ea40 con 0x7fce840d3310 2024-09-12T01:39:54.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.919+0000 7fce8a69b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce840d3870 con 0x7fce8415e660 2024-09-12T01:39:54.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.919+0000 7fce8a69b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fce840d3b50 con 0x7fce840d1820 2024-09-12T01:39:54.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.919+0000 7fce7bfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fce840d3310 0x7fce840d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53594/0 (socket says 172.21.15.60:53594) 2024-09-12T01:39:54.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.919+0000 7fce7bfff640 1 -- 172.21.15.60:0/895204603 learned_addr learned my addr 172.21.15.60:0/895204603 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:39:54.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653702902 0 0) 0x7fce8415ea40 con 0x7fce840d3310 2024-09-12T01:39:54.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce88c38640 1 --2- 172.21.15.60:0/895204603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce840d1820 0x7fce841691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:54.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce70003520 con 0x7fce840d3310 2024-09-12T01:39:54.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1867357512 0 0) 0x7fce70003520 con 0x7fce840d3310 2024-09-12T01:39:54.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce840d1820 msgr2=0x7fce841691c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:54.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 --2- 172.21.15.60:0/895204603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce840d1820 0x7fce841691c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:54.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 >> v1:172.21.15.105:6789/0 conn(0x7fce8415e660 legacy=0x7fce840cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:54.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce840d3e30 con 0x7fce840d3310 2024-09-12T01:39:54.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fce6c001670 con 0x7fce840d3310 2024-09-12T01:39:54.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 >> v1:172.21.15.60:6789/0 conn(0x7fce840d3310 legacy=0x7fce840d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 --2- 172.21.15.60:0/895204603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce700039e0 0x7fce70003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 --2- 172.21.15.60:0/895204603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce70004390 0x7fce70004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 --2- 172.21.15.60:0/895204603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce840d1820 0x7fce700050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fce840d3b50 con 0x7fce700039e0 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce7000b9c0 con 0x7fce70004390 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fce7000bbc0 con 0x7fce840d1820 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce83fff640 1 --2- 172.21.15.60:0/895204603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce700039e0 0x7fce70003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce7bfff640 1 --2- 172.21.15.60:0/895204603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce70004390 0x7fce70004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.920+0000 7fce88c38640 1 --2- 172.21.15.60:0/895204603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce840d1820 0x7fce700050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.921+0000 7fce83fff640 1 -- 172.21.15.60:0/895204603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce840d1820 msgr2=0x7fce700050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.921+0000 7fce83fff640 1 --2- 172.21.15.60:0/895204603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce840d1820 0x7fce700050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.921+0000 7fce83fff640 1 -- 172.21.15.60:0/895204603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce70004390 msgr2=0x7fce70004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:39:54.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.921+0000 7fce83fff640 1 --2- 172.21.15.60:0/895204603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce70004390 0x7fce70004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:54.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.921+0000 7fce83fff640 1 -- 172.21.15.60:0/895204603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce70003520 con 0x7fce700039e0 2024-09-12T01:39:54.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.921+0000 7fce83fff640 1 --2- 172.21.15.60:0/895204603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce700039e0 0x7fce70003dc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fce74001860 tx=0x7fce70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f713dae594c4866a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:54.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.922+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74037070 con 0x7fce700039e0 2024-09-12T01:39:54.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.922+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce7402ac30 con 0x7fce700039e0 2024-09-12T01:39:54.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.922+0000 7fce837fe640 1 -- 172.21.15.60:0/895204603 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74001430 con 0x7fce700039e0 2024-09-12T01:39:54.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.922+0000 7fce8a69b640 1 -- 172.21.15.60:0/895204603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce700039e0 msgr2=0x7fce70003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:54.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.922+0000 7fce8a69b640 1 --2- 172.21.15.60:0/895204603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce700039e0 0x7fce70003dc0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fce74001860 tx=0x7fce70005830 comp rx=0 tx=0).stop 2024-09-12T01:39:54.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.922+0000 7fce88c38640 1 -- 172.21.15.60:0/895204603 reap_dead start 2024-09-12T01:39:54.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.922+0000 7fce8a69b640 1 -- 172.21.15.60:0/895204603 shutdown_connections 2024-09-12T01:39:54.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.922+0000 7fce8a69b640 1 -- 172.21.15.60:0/895204603 >> 172.21.15.60:0/895204603 conn(0x7fce840b6410 msgr2=0x7fce840b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:54.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.922+0000 7fce8a69b640 1 -- 172.21.15.60:0/895204603 shutdown_connections 2024-09-12T01:39:54.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.922+0000 7fce8a69b640 1 -- 172.21.15.60:0/895204603 wait complete. 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.923+0000 7fce8a69b640 1 Processor -- start 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.923+0000 7fce8a69b640 1 -- start start 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.924+0000 7fce8a69b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce700039e0 0x7fce840ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.924+0000 7fce8a69b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce84154910 0x7fce840cf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.924+0000 7fce8a69b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce84154150 0x7fce841565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.924+0000 7fce8a69b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fce840b8b80 con 0x7fce84154150 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.924+0000 7fce8a69b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fce840d43f0 con 0x7fce84154910 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.924+0000 7fce8a69b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fce840b8d00 con 0x7fce700039e0 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.924+0000 7fce88c38640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce84154150 0x7fce841565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.924+0000 7fce88c38640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce84154150 0x7fce841565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40564/0 (socket says 172.21.15.60:40564) 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.924+0000 7fce88c38640 1 -- 172.21.15.60:0/3655586682 learned_addr learned my addr 172.21.15.60:0/3655586682 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce7bfff640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce84154910 0x7fce840cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce83fff640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce700039e0 0x7fce840ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:54.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce88c38640 1 -- 172.21.15.60:0/3655586682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce700039e0 msgr2=0x7fce840ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce88c38640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce700039e0 0x7fce840ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce88c38640 1 -- 172.21.15.60:0/3655586682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce84154910 msgr2=0x7fce840cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce88c38640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce84154910 0x7fce840cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce88c38640 1 -- 172.21.15.60:0/3655586682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce84155140 con 0x7fce84154150 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce7bfff640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce84154910 0x7fce840cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce88c38640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce84154150 0x7fce841565c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fce840cb760 tx=0x7fce7c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce817fa640 1 -- 172.21.15.60:0/3655586682 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c015430 con 0x7fce84154150 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce817fa640 1 -- 172.21.15.60:0/3655586682 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce7c0155d0 con 0x7fce84154150 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce8a69b640 1 -- 172.21.15.60:0/3655586682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce840ce760 con 0x7fce84154150 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce817fa640 1 -- 172.21.15.60:0/3655586682 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c0159c0 con 0x7fce84154150 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.925+0000 7fce8a69b640 1 -- 172.21.15.60:0/3655586682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce840ced20 con 0x7fce84154150 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.926+0000 7fce8a69b640 1 -- 172.21.15.60:0/3655586682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce8406d2a0 con 0x7fce84154150 2024-09-12T01:39:54.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.927+0000 7fce817fa640 1 -- 172.21.15.60:0/3655586682 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fce7c015b60 con 0x7fce84154150 2024-09-12T01:39:54.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.927+0000 7fce817fa640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce6406be30 0x7fce6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:39:54.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.927+0000 7fce817fa640 1 -- 172.21.15.60:0/3655586682 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fce7c08bb80 con 0x7fce84154150 2024-09-12T01:39:54.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.928+0000 7fce83fff640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce6406be30 0x7fce6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:39:54.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.928+0000 7fce83fff640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce6406be30 0x7fce6406e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fce74001860 tx=0x7fce74009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:39:54.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:54.932+0000 7fce817fa640 1 -- 172.21.15.60:0/3655586682 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fce8406d2a0 con 0x7fce84154150 2024-09-12T01:39:55.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.144+0000 7fce8a69b640 1 -- 172.21.15.60:0/3655586682 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fce840d1110 con 0x7fce84154150 2024-09-12T01:39:55.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.145+0000 7fce817fa640 1 -- 172.21.15.60:0/3655586682 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fce7c019030 con 0x7fce84154150 2024-09-12T01:39:55.146 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:39:55.146 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:39:55.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.147+0000 7fce8a69b640 1 -- 172.21.15.60:0/3655586682 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce6406be30 msgr2=0x7fce6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:55.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.147+0000 7fce8a69b640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce6406be30 0x7fce6406e2f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fce74001860 tx=0x7fce74009030 comp rx=0 tx=0).stop 2024-09-12T01:39:55.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.147+0000 7fce8a69b640 1 -- 172.21.15.60:0/3655586682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce84154150 msgr2=0x7fce841565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:39:55.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.147+0000 7fce8a69b640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce84154150 0x7fce841565c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fce840cb760 tx=0x7fce7c00f580 comp rx=0 tx=0).stop 2024-09-12T01:39:55.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.147+0000 7fce8a69b640 1 -- 172.21.15.60:0/3655586682 shutdown_connections 2024-09-12T01:39:55.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.147+0000 7fce8a69b640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce84154150 0x7fce841565c0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.147+0000 7fce8a69b640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fce84154910 0x7fce840cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.147+0000 7fce8a69b640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fce6406be30 0x7fce6406e2f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.147+0000 7fce8a69b640 1 --2- 172.21.15.60:0/3655586682 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fce700039e0 0x7fce840ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:39:55.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.147+0000 7fce8a69b640 1 -- 172.21.15.60:0/3655586682 >> 172.21.15.60:0/3655586682 conn(0x7fce840b6410 msgr2=0x7fce8406bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:39:55.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.147+0000 7fce8a69b640 1 -- 172.21.15.60:0/3655586682 shutdown_connections 2024-09-12T01:39:55.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:39:55.147+0000 7fce8a69b640 1 -- 172.21.15.60:0/3655586682 wait complete. 2024-09-12T01:39:55.158 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:39:55.158 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:39:55.614 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:57.617 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:39:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:00.160 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:40:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.275+0000 7f2224c8d640 1 Processor -- start 2024-09-12T01:40:00.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.275+0000 7f2224c8d640 1 -- start start 2024-09-12T01:40:00.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f2224c8d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f22200cfa00 0x7f22200d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f2224c8d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22200d2f40 con 0x7f22200ba240 2024-09-12T01:40:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f2224c8d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22200d3220 con 0x7f222015e7a0 2024-09-12T01:40:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f2224c8d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f22200ba690 con 0x7f22200cfa00 2024-09-12T01:40:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f221dd9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f22200ba240 0x7f22200cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53608/0 (socket says 172.21.15.60:53608) 2024-09-12T01:40:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f221dd9b640 1 -- 172.21.15.60:0/2200402594 learned_addr learned my addr 172.21.15.60:0/2200402594 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:40:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f221ed9d640 1 --2- 172.21.15.60:0/2200402594 >> v2:172.21.15.105:3300/0 conn(0x7f22200cfa00 0x7f22200d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f221d59a640 1 -- 172.21.15.60:0/2200402594 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3104035732 0 0) 0x7f22200d2f40 con 0x7f22200ba240 2024-09-12T01:40:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f221d59a640 1 -- 172.21.15.60:0/2200402594 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f220c003520 con 0x7f22200ba240 2024-09-12T01:40:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f221ed9d640 1 -- 172.21.15.60:0/2200402594 >> v1:172.21.15.105:6789/0 conn(0x7f222015e7a0 legacy=0x7f22200d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f221d59a640 1 -- 172.21.15.60:0/2200402594 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1040745465 0 0) 0x7f220c003520 con 0x7f22200ba240 2024-09-12T01:40:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f221ed9d640 1 -- 172.21.15.60:0/2200402594 >> v1:172.21.15.60:6789/0 conn(0x7f22200ba240 legacy=0x7f22200cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:00.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.276+0000 7f221ed9d640 1 -- 172.21.15.60:0/2200402594 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22200d3500 con 0x7f22200cfa00 2024-09-12T01:40:00.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.277+0000 7f221ed9d640 1 --2- 172.21.15.60:0/2200402594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22200cfa00 0x7f22200d3fe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f22180097a0 tx=0x7f221802a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b539590b3b2766e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.277+0000 7f221d59a640 1 -- 172.21.15.60:0/2200402594 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2218037070 con 0x7f22200cfa00 2024-09-12T01:40:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.277+0000 7f221d59a640 1 -- 172.21.15.60:0/2200402594 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221802abf0 con 0x7f22200cfa00 2024-09-12T01:40:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.277+0000 7f221d59a640 1 -- 172.21.15.60:0/2200402594 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2208001670 con 0x7f22200cfa00 2024-09-12T01:40:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.278+0000 7f2224c8d640 1 -- 172.21.15.60:0/2200402594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22200cfa00 msgr2=0x7f22200d3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.278+0000 7f2224c8d640 1 --2- 172.21.15.60:0/2200402594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22200cfa00 0x7f22200d3fe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f22180097a0 tx=0x7f221802a160 comp rx=0 tx=0).stop 2024-09-12T01:40:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.278+0000 7f2224c8d640 1 -- 172.21.15.60:0/2200402594 shutdown_connections 2024-09-12T01:40:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.278+0000 7f2224c8d640 1 --2- 172.21.15.60:0/2200402594 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22200cfa00 0x7f22200d3fe0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.278+0000 7f2224c8d640 1 -- 172.21.15.60:0/2200402594 >> 172.21.15.60:0/2200402594 conn(0x7f22200d1550 msgr2=0x7f22200d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.278+0000 7f2224c8d640 1 -- 172.21.15.60:0/2200402594 shutdown_connections 2024-09-12T01:40:00.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.278+0000 7f2224c8d640 1 -- 172.21.15.60:0/2200402594 wait complete. 2024-09-12T01:40:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.280+0000 7f2224c8d640 1 Processor -- start 2024-09-12T01:40:00.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.280+0000 7f2224c8d640 1 -- start start 2024-09-12T01:40:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.280+0000 7f2224c8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22200ba240 0x7f22201f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.280+0000 7f2224c8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22200cfa00 0x7f22200cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.280+0000 7f2224c8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222015e7a0 0x7f22200ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.280+0000 7f2224c8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f222015eb80 con 0x7f222015e7a0 2024-09-12T01:40:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.280+0000 7f2224c8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22200d3ac0 con 0x7f22200ba240 2024-09-12T01:40:00.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.280+0000 7f2224c8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f222015ed00 con 0x7f22200cfa00 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222015e7a0 0x7f22200ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222015e7a0 0x7f22200ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40574/0 (socket says 172.21.15.60:40574) 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221ed9d640 1 -- 172.21.15.60:0/1474243968 learned_addr learned my addr 172.21.15.60:0/1474243968 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221dd9b640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22200cfa00 0x7f22200cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221e59c640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22200ba240 0x7f22201f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221ed9d640 1 -- 172.21.15.60:0/1474243968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22200cfa00 msgr2=0x7f22200cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221ed9d640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22200cfa00 0x7f22200cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221ed9d640 1 -- 172.21.15.60:0/1474243968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22200ba240 msgr2=0x7f22201f7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221ed9d640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22200ba240 0x7f22201f7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221ed9d640 1 -- 172.21.15.60:0/1474243968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22200cd490 con 0x7f222015e7a0 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221dd9b640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22200cfa00 0x7f22200cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221e59c640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22200ba240 0x7f22201f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:40:00.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f221ed9d640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222015e7a0 0x7f22200ccc70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f22180097a0 tx=0x7f22180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:00.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f2216ffd640 1 -- 172.21.15.60:0/1474243968 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2218042070 con 0x7f222015e7a0 2024-09-12T01:40:00.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f2216ffd640 1 -- 172.21.15.60:0/1474243968 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f221803e460 con 0x7f222015e7a0 2024-09-12T01:40:00.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f2216ffd640 1 -- 172.21.15.60:0/1474243968 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2218037040 con 0x7f222015e7a0 2024-09-12T01:40:00.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f2224c8d640 1 -- 172.21.15.60:0/1474243968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22200cd770 con 0x7f222015e7a0 2024-09-12T01:40:00.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.281+0000 7f2224c8d640 1 -- 172.21.15.60:0/1474243968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22200cdd30 con 0x7f222015e7a0 2024-09-12T01:40:00.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.283+0000 7f2224c8d640 1 -- 172.21.15.60:0/1474243968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22200d3fe0 con 0x7f222015e7a0 2024-09-12T01:40:00.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.283+0000 7f2216ffd640 1 -- 172.21.15.60:0/1474243968 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2218045070 con 0x7f222015e7a0 2024-09-12T01:40:00.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.283+0000 7f2216ffd640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f220006be30 0x7f220006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:00.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.284+0000 7f2216ffd640 1 -- 172.21.15.60:0/1474243968 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f22180ab410 con 0x7f222015e7a0 2024-09-12T01:40:00.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.284+0000 7f221e59c640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f220006be30 0x7f220006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:00.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.284+0000 7f221e59c640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f220006be30 0x7f220006e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2210007fd0 tx=0x7f2210009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:00.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.288+0000 7f2216ffd640 1 -- 172.21.15.60:0/1474243968 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2218079e30 con 0x7f222015e7a0 2024-09-12T01:40:00.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.501+0000 7f2224c8d640 1 -- 172.21.15.60:0/1474243968 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f22200cd1b0 con 0x7f222015e7a0 2024-09-12T01:40:00.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.502+0000 7f2216ffd640 1 -- 172.21.15.60:0/1474243968 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f2218079730 con 0x7f222015e7a0 2024-09-12T01:40:00.502 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:40:00.502 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:40:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.504+0000 7f2224c8d640 1 -- 172.21.15.60:0/1474243968 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f220006be30 msgr2=0x7f220006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.504+0000 7f2224c8d640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f220006be30 0x7f220006e2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2210007fd0 tx=0x7f2210009040 comp rx=0 tx=0).stop 2024-09-12T01:40:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.504+0000 7f2224c8d640 1 -- 172.21.15.60:0/1474243968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222015e7a0 msgr2=0x7f22200ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.504+0000 7f2224c8d640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222015e7a0 0x7f22200ccc70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f22180097a0 tx=0x7f22180046c0 comp rx=0 tx=0).stop 2024-09-12T01:40:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.504+0000 7f2224c8d640 1 -- 172.21.15.60:0/1474243968 shutdown_connections 2024-09-12T01:40:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.504+0000 7f2224c8d640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f222015e7a0 0x7f22200ccc70 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.504+0000 7f2224c8d640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f220006be30 0x7f220006e2f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.504+0000 7f2224c8d640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f22200cfa00 0x7f22200cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.504+0000 7f2224c8d640 1 --2- 172.21.15.60:0/1474243968 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f22200ba240 0x7f22201f7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.504+0000 7f2224c8d640 1 -- 172.21.15.60:0/1474243968 >> 172.21.15.60:0/1474243968 conn(0x7f22200d1550 msgr2=0x7f222006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.504+0000 7f2224c8d640 1 -- 172.21.15.60:0/1474243968 shutdown_connections 2024-09-12T01:40:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:00.504+0000 7f2224c8d640 1 -- 172.21.15.60:0/1474243968 wait complete. 2024-09-12T01:40:00.515 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:40:00.516 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:40:01.621 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:03.623 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:05.517 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:40:05.625 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:05.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.632+0000 7fe031a53640 1 Processor -- start 2024-09-12T01:40:05.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.632+0000 7fe031a53640 1 -- start start 2024-09-12T01:40:05.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe031a53640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe02c0cfc80 0x7fe02c0b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:05.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe031a53640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe02c15c330 0x7fe02c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:05.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe031a53640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe02c15c740 con 0x7fe02c155800 2024-09-12T01:40:05.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe031a53640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe02c0b4e60 con 0x7fe02c0cfc80 2024-09-12T01:40:05.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe031a53640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe02c0b50a0 con 0x7fe02c15c330 2024-09-12T01:40:05.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe02a7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe02c0cfc80 0x7fe02c0b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:05.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe02a7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe02c0cfc80 0x7fe02c0b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37768/0 (socket says 172.21.15.60:37768) 2024-09-12T01:40:05.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe02a7fc640 1 -- 172.21.15.60:0/765267827 learned_addr learned my addr 172.21.15.60:0/765267827 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:05.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe02a7fc640 1 -- 172.21.15.60:0/765267827 >> v2:172.21.15.105:3300/0 conn(0x7fe02c15c330 msgr2=0x7fe02c0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:05.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe02b7fe640 1 --2- 172.21.15.60:0/765267827 >> v2:172.21.15.105:3300/0 conn(0x7fe02c15c330 0x7fe02c0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:05.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe02a7fc640 1 --2- 172.21.15.60:0/765267827 >> v2:172.21.15.105:3300/0 conn(0x7fe02c15c330 0x7fe02c0b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:05.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe02a7fc640 1 -- 172.21.15.60:0/765267827 >> v1:172.21.15.105:6789/0 conn(0x7fe02c155800 legacy=0x7fe02c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:05.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.633+0000 7fe02a7fc640 1 -- 172.21.15.60:0/765267827 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c0b5380 con 0x7fe02c0cfc80 2024-09-12T01:40:05.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.634+0000 7fe02a7fc640 1 --2- 172.21.15.60:0/765267827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe02c0cfc80 0x7fe02c0b6140 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe020009870 tx=0x7fe02002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcba3a6359b9a0a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:05.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.634+0000 7fe029ffb640 1 -- 172.21.15.60:0/765267827 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020037070 con 0x7fe02c0cfc80 2024-09-12T01:40:05.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.634+0000 7fe029ffb640 1 -- 172.21.15.60:0/765267827 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe020032440 con 0x7fe02c0cfc80 2024-09-12T01:40:05.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.634+0000 7fe029ffb640 1 -- 172.21.15.60:0/765267827 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe020032810 con 0x7fe02c0cfc80 2024-09-12T01:40:05.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.635+0000 7fe031a53640 1 -- 172.21.15.60:0/765267827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe02c0cfc80 msgr2=0x7fe02c0b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:05.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.635+0000 7fe031a53640 1 --2- 172.21.15.60:0/765267827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe02c0cfc80 0x7fe02c0b6140 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fe020009870 tx=0x7fe02002a270 comp rx=0 tx=0).stop 2024-09-12T01:40:05.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.635+0000 7fe031a53640 1 -- 172.21.15.60:0/765267827 shutdown_connections 2024-09-12T01:40:05.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.635+0000 7fe031a53640 1 --2- 172.21.15.60:0/765267827 >> v2:172.21.15.105:3300/0 conn(0x7fe02c15c330 0x7fe02c0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:05.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.635+0000 7fe031a53640 1 --2- 172.21.15.60:0/765267827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe02c0cfc80 0x7fe02c0b6140 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:05.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.635+0000 7fe031a53640 1 -- 172.21.15.60:0/765267827 >> 172.21.15.60:0/765267827 conn(0x7fe02c06bc10 msgr2=0x7fe02c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:05.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.635+0000 7fe031a53640 1 -- 172.21.15.60:0/765267827 shutdown_connections 2024-09-12T01:40:05.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.635+0000 7fe031a53640 1 -- 172.21.15.60:0/765267827 wait complete. 2024-09-12T01:40:05.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.636+0000 7fe031a53640 1 Processor -- start 2024-09-12T01:40:05.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.636+0000 7fe031a53640 1 -- start start 2024-09-12T01:40:05.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.637+0000 7fe031a53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe02c0cfc80 0x7fe02c140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:05.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.637+0000 7fe031a53640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe02c155800 0x7fe02c154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:05.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.637+0000 7fe031a53640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe02c15c330 0x7fe02c143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:05.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.637+0000 7fe031a53640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c0b5c20 con 0x7fe02c0cfc80 2024-09-12T01:40:05.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.637+0000 7fe031a53640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c0b5940 con 0x7fe02c15c330 2024-09-12T01:40:05.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.637+0000 7fe031a53640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe02c155be0 con 0x7fe02c155800 2024-09-12T01:40:05.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.637+0000 7fe02affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe02c0cfc80 0x7fe02c140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:05.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.637+0000 7fe02affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe02c0cfc80 0x7fe02c140b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37776/0 (socket says 172.21.15.60:37776) 2024-09-12T01:40:05.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.637+0000 7fe02affd640 1 -- 172.21.15.60:0/2497434924 learned_addr learned my addr 172.21.15.60:0/2497434924 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:05.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.637+0000 7fe02b7fe640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe02c15c330 0x7fe02c143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.637+0000 7fe02a7fc640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe02c155800 0x7fe02c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.638+0000 7fe02affd640 1 -- 172.21.15.60:0/2497434924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe02c155800 msgr2=0x7fe02c154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.638+0000 7fe02affd640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe02c155800 0x7fe02c154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.638+0000 7fe02affd640 1 -- 172.21.15.60:0/2497434924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe02c15c330 msgr2=0x7fe02c143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.638+0000 7fe02affd640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe02c15c330 0x7fe02c143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.638+0000 7fe02affd640 1 -- 172.21.15.60:0/2497434924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c15a500 con 0x7fe02c0cfc80 2024-09-12T01:40:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.638+0000 7fe02a7fc640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe02c155800 0x7fe02c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:40:05.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.638+0000 7fe02affd640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe02c0cfc80 0x7fe02c140b00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00c7c0 tx=0x7fe01c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.638+0000 7fe013fff640 1 -- 172.21.15.60:0/2497434924 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c016020 con 0x7fe02c0cfc80 2024-09-12T01:40:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.638+0000 7fe013fff640 1 -- 172.21.15.60:0/2497434924 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01c00a9f0 con 0x7fe02c0cfc80 2024-09-12T01:40:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.638+0000 7fe031a53640 1 -- 172.21.15.60:0/2497434924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02c15a7e0 con 0x7fe02c0cfc80 2024-09-12T01:40:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.638+0000 7fe013fff640 1 -- 172.21.15.60:0/2497434924 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c00ae20 con 0x7fe02c0cfc80 2024-09-12T01:40:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.638+0000 7fe031a53640 1 -- 172.21.15.60:0/2497434924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02c15ada0 con 0x7fe02c0cfc80 2024-09-12T01:40:05.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.639+0000 7fe031a53640 1 -- 172.21.15.60:0/2497434924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02c0b6140 con 0x7fe02c0cfc80 2024-09-12T01:40:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.640+0000 7fe013fff640 1 -- 172.21.15.60:0/2497434924 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe01c019020 con 0x7fe02c0cfc80 2024-09-12T01:40:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.640+0000 7fe013fff640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe01806be30 0x7fe01806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.640+0000 7fe013fff640 1 -- 172.21.15.60:0/2497434924 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fe01c08ae00 con 0x7fe02c0cfc80 2024-09-12T01:40:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.640+0000 7fe02a7fc640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe01806be30 0x7fe01806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:05.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.641+0000 7fe02a7fc640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe01806be30 0x7fe01806e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe020034000 tx=0x7fe02002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:05.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.645+0000 7fe013fff640 1 -- 172.21.15.60:0/2497434924 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe01c020030 con 0x7fe02c0cfc80 2024-09-12T01:40:05.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.855+0000 7fe031a53640 1 -- 172.21.15.60:0/2497434924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe02c0cf6a0 con 0x7fe02c0cfc80 2024-09-12T01:40:05.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.855+0000 7fe013fff640 1 -- 172.21.15.60:0/2497434924 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fe01c0597b0 con 0x7fe02c0cfc80 2024-09-12T01:40:05.856 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:40:05.856 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:40:05.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.857+0000 7fe031a53640 1 -- 172.21.15.60:0/2497434924 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe01806be30 msgr2=0x7fe01806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:05.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.857+0000 7fe031a53640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe01806be30 0x7fe01806e2f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe020034000 tx=0x7fe02002e000 comp rx=0 tx=0).stop 2024-09-12T01:40:05.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.857+0000 7fe031a53640 1 -- 172.21.15.60:0/2497434924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe02c0cfc80 msgr2=0x7fe02c140b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:05.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.857+0000 7fe031a53640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe02c0cfc80 0x7fe02c140b00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00c7c0 tx=0x7fe01c00cc80 comp rx=0 tx=0).stop 2024-09-12T01:40:05.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.857+0000 7fe031a53640 1 -- 172.21.15.60:0/2497434924 shutdown_connections 2024-09-12T01:40:05.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.857+0000 7fe031a53640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe02c15c330 0x7fe02c143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:05.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.857+0000 7fe031a53640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe01806be30 0x7fe01806e2f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:05.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.857+0000 7fe031a53640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe02c155800 0x7fe02c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:05.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.857+0000 7fe031a53640 1 --2- 172.21.15.60:0/2497434924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe02c0cfc80 0x7fe02c140b00 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:05.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.857+0000 7fe031a53640 1 -- 172.21.15.60:0/2497434924 >> 172.21.15.60:0/2497434924 conn(0x7fe02c06bc10 msgr2=0x7fe02c0b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.857+0000 7fe031a53640 1 -- 172.21.15.60:0/2497434924 shutdown_connections 2024-09-12T01:40:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:05.857+0000 7fe031a53640 1 -- 172.21.15.60:0/2497434924 wait complete. 2024-09-12T01:40:05.869 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:40:05.869 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:40:07.627 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:09.629 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:10.872 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:40:10.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.987+0000 7f6c916af640 1 Processor -- start 2024-09-12T01:40:10.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.987+0000 7f6c916af640 1 -- start start 2024-09-12T01:40:10.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c916af640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c8c0cf6b0 0x7f6c8c1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:10.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c916af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c8c162f30 0x7f6c8c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:10.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c916af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c8c0cfc20 con 0x7f6c8c0b63d0 2024-09-12T01:40:10.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c916af640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6c8c0d40c0 con 0x7f6c8c0cf6b0 2024-09-12T01:40:10.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c916af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c0d2ed0 con 0x7f6c8c162f30 2024-09-12T01:40:10.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c8a7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c8c0cf6b0 0x7f6c8c1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:10.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c8affd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6c8c0b63d0 0x7f6c8c0d39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60750/0 (socket says 172.21.15.60:60750) 2024-09-12T01:40:10.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c8affd640 1 -- 172.21.15.60:0/654500861 learned_addr learned my addr 172.21.15.60:0/654500861 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:40:10.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c8a7fc640 1 -- 172.21.15.60:0/654500861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c8c162f30 msgr2=0x7f6c8c0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:10.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c8b7fe640 1 --2- 172.21.15.60:0/654500861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c8c162f30 0x7f6c8c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:10.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c89ffb640 1 -- 172.21.15.60:0/654500861 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 445552427 0 0) 0x7f6c8c0cfc20 con 0x7f6c8c0b63d0 2024-09-12T01:40:10.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c8a7fc640 1 --2- 172.21.15.60:0/654500861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c8c162f30 0x7f6c8c0b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:10.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c8a7fc640 1 -- 172.21.15.60:0/654500861 >> v1:172.21.15.60:6789/0 conn(0x7f6c8c0b63d0 legacy=0x7f6c8c0d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:10.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.988+0000 7f6c8a7fc640 1 -- 172.21.15.60:0/654500861 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c0d31b0 con 0x7f6c8c0cf6b0 2024-09-12T01:40:10.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.989+0000 7f6c8a7fc640 1 --2- 172.21.15.60:0/654500861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c8c0cf6b0 0x7f6c8c1629f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6c800097a0 tx=0x7f6c8002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee20594d632a677 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:10.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.989+0000 7f6c89ffb640 1 -- 172.21.15.60:0/654500861 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c80037070 con 0x7f6c8c0cf6b0 2024-09-12T01:40:10.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.989+0000 7f6c89ffb640 1 -- 172.21.15.60:0/654500861 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c80032440 con 0x7f6c8c0cf6b0 2024-09-12T01:40:10.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.989+0000 7f6c89ffb640 1 -- 172.21.15.60:0/654500861 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c80032810 con 0x7f6c8c0cf6b0 2024-09-12T01:40:10.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.990+0000 7f6c916af640 1 -- 172.21.15.60:0/654500861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c8c0cf6b0 msgr2=0x7f6c8c1629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:10.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.990+0000 7f6c916af640 1 --2- 172.21.15.60:0/654500861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c8c0cf6b0 0x7f6c8c1629f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6c800097a0 tx=0x7f6c8002a180 comp rx=0 tx=0).stop 2024-09-12T01:40:10.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.990+0000 7f6c916af640 1 -- 172.21.15.60:0/654500861 shutdown_connections 2024-09-12T01:40:10.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.990+0000 7f6c916af640 1 --2- 172.21.15.60:0/654500861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c8c162f30 0x7f6c8c0b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:10.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.990+0000 7f6c916af640 1 --2- 172.21.15.60:0/654500861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c8c0cf6b0 0x7f6c8c1629f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:10.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.990+0000 7f6c916af640 1 -- 172.21.15.60:0/654500861 >> 172.21.15.60:0/654500861 conn(0x7f6c8c0d1160 msgr2=0x7f6c8c0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:10.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.990+0000 7f6c916af640 1 -- 172.21.15.60:0/654500861 shutdown_connections 2024-09-12T01:40:10.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.990+0000 7f6c916af640 1 -- 172.21.15.60:0/654500861 wait complete. 2024-09-12T01:40:10.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.991+0000 7f6c916af640 1 Processor -- start 2024-09-12T01:40:10.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.991+0000 7f6c916af640 1 -- start start 2024-09-12T01:40:10.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.992+0000 7f6c916af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c8c0b63d0 0x7f6c8c14edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:10.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.992+0000 7f6c916af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c8c0cf6b0 0x7f6c8c0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:10.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.992+0000 7f6c916af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c8c162f30 0x7f6c8c0b9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:10.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.992+0000 7f6c916af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c0cb5c0 con 0x7f6c8c162f30 2024-09-12T01:40:10.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.992+0000 7f6c916af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6c8c0cb440 con 0x7f6c8c0cf6b0 2024-09-12T01:40:10.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.992+0000 7f6c916af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6c8c0d1c80 con 0x7f6c8c0b63d0 2024-09-12T01:40:10.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.992+0000 7f6c8b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c8c162f30 0x7f6c8c0b9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:10.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.992+0000 7f6c8b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c8c162f30 0x7f6c8c0b9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37790/0 (socket says 172.21.15.60:37790) 2024-09-12T01:40:10.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.992+0000 7f6c8b7fe640 1 -- 172.21.15.60:0/2474725289 learned_addr learned my addr 172.21.15.60:0/2474725289 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:10.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.992+0000 7f6c8affd640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c8c0b63d0 0x7f6c8c14edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:10.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.992+0000 7f6c8a7fc640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c8c0cf6b0 0x7f6c8c0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:10.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.993+0000 7f6c8b7fe640 1 -- 172.21.15.60:0/2474725289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c8c0b63d0 msgr2=0x7f6c8c14edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:10.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.993+0000 7f6c8b7fe640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c8c0b63d0 0x7f6c8c14edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:10.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.993+0000 7f6c8b7fe640 1 -- 172.21.15.60:0/2474725289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c8c0cf6b0 msgr2=0x7f6c8c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:10.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.993+0000 7f6c8b7fe640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c8c0cf6b0 0x7f6c8c0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:10.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.993+0000 7f6c8b7fe640 1 -- 172.21.15.60:0/2474725289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8c15a440 con 0x7f6c8c162f30 2024-09-12T01:40:10.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.993+0000 7f6c8b7fe640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c8c162f30 0x7f6c8c0b9780 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400cc30 tx=0x7f6c8400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:10.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.993+0000 7f6c737fe640 1 -- 172.21.15.60:0/2474725289 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400ce40 con 0x7f6c8c162f30 2024-09-12T01:40:10.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.993+0000 7f6c737fe640 1 -- 172.21.15.60:0/2474725289 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c84003990 con 0x7f6c8c162f30 2024-09-12T01:40:10.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.993+0000 7f6c916af640 1 -- 172.21.15.60:0/2474725289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c8c15a720 con 0x7f6c8c162f30 2024-09-12T01:40:10.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.993+0000 7f6c737fe640 1 -- 172.21.15.60:0/2474725289 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84003d40 con 0x7f6c8c162f30 2024-09-12T01:40:10.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.993+0000 7f6c916af640 1 -- 172.21.15.60:0/2474725289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c8c15ace0 con 0x7f6c8c162f30 2024-09-12T01:40:10.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.994+0000 7f6c916af640 1 -- 172.21.15.60:0/2474725289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c8c0b67b0 con 0x7f6c8c162f30 2024-09-12T01:40:10.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.995+0000 7f6c737fe640 1 -- 172.21.15.60:0/2474725289 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c84003fa0 con 0x7f6c8c162f30 2024-09-12T01:40:10.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.995+0000 7f6c737fe640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6c7806be30 0x7f6c7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:10.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.995+0000 7f6c737fe640 1 -- 172.21.15.60:0/2474725289 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f6c8408b1c0 con 0x7f6c8c162f30 2024-09-12T01:40:10.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.995+0000 7f6c8affd640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6c7806be30 0x7f6c7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:10.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:10.996+0000 7f6c8affd640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6c7806be30 0x7f6c7806e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c000f60 tx=0x7f6c7c007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:11.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.000+0000 7f6c737fe640 1 -- 172.21.15.60:0/2474725289 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c84014030 con 0x7f6c8c162f30 2024-09-12T01:40:11.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.212+0000 7f6c916af640 1 -- 172.21.15.60:0/2474725289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6c8c0cf280 con 0x7f6c8c162f30 2024-09-12T01:40:11.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.213+0000 7f6c737fe640 1 -- 172.21.15.60:0/2474725289 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f6c840595b0 con 0x7f6c8c162f30 2024-09-12T01:40:11.214 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:40:11.214 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:40:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.215+0000 7f6c916af640 1 -- 172.21.15.60:0/2474725289 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6c7806be30 msgr2=0x7f6c7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.215+0000 7f6c916af640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6c7806be30 0x7f6c7806e2f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c000f60 tx=0x7f6c7c007d50 comp rx=0 tx=0).stop 2024-09-12T01:40:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.215+0000 7f6c916af640 1 -- 172.21.15.60:0/2474725289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c8c162f30 msgr2=0x7f6c8c0b9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.215+0000 7f6c916af640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c8c162f30 0x7f6c8c0b9780 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400cc30 tx=0x7f6c8400a5c0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.215+0000 7f6c916af640 1 -- 172.21.15.60:0/2474725289 shutdown_connections 2024-09-12T01:40:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.215+0000 7f6c916af640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c8c162f30 0x7f6c8c0b9780 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.215+0000 7f6c916af640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c8c0cf6b0 0x7f6c8c0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.215+0000 7f6c916af640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6c7806be30 0x7f6c7806e2f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.215+0000 7f6c916af640 1 --2- 172.21.15.60:0/2474725289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c8c0b63d0 0x7f6c8c14edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.215+0000 7f6c916af640 1 -- 172.21.15.60:0/2474725289 >> 172.21.15.60:0/2474725289 conn(0x7f6c8c0d1160 msgr2=0x7f6c8c1617b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.215+0000 7f6c916af640 1 -- 172.21.15.60:0/2474725289 shutdown_connections 2024-09-12T01:40:11.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:11.215+0000 7f6c916af640 1 -- 172.21.15.60:0/2474725289 wait complete. 2024-09-12T01:40:11.226 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:40:11.226 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:40:11.631 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:13.633 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:15.636 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:16.227 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:40:16.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.341+0000 7f5292d6d640 1 Processor -- start 2024-09-12T01:40:16.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.342+0000 7f5292d6d640 1 -- start start 2024-09-12T01:40:16.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.342+0000 7f5292d6d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f528c15a9c0 0x7f528c15e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:16.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.343+0000 7f5292d6d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c0b29a0 0x7f528c0cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:16.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.343+0000 7f5292d6d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528c0b6830 con 0x7f528c0b5be0 2024-09-12T01:40:16.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.343+0000 7f5292d6d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f528c15f410 con 0x7f528c15a9c0 2024-09-12T01:40:16.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.343+0000 7f5292d6d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f528c0cd0b0 con 0x7f528c0b29a0 2024-09-12T01:40:16.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.343+0000 7f5290b09640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f528c15a9c0 0x7f528c15e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:16.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.343+0000 7f5290b09640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f528c15a9c0 0x7f528c15e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55874/0 (socket says 172.21.15.60:55874) 2024-09-12T01:40:16.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.343+0000 7f5290b09640 1 -- 172.21.15.60:0/2651060878 learned_addr learned my addr 172.21.15.60:0/2651060878 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:16.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.343+0000 7f529130a640 1 --2- 172.21.15.60:0/2651060878 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c0b29a0 0x7f528c0cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:16.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.343+0000 7f5290b09640 1 -- 172.21.15.60:0/2651060878 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c0b29a0 msgr2=0x7f528c0cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:16.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.343+0000 7f5290b09640 1 --2- 172.21.15.60:0/2651060878 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c0b29a0 0x7f528c0cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:16.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.343+0000 7f5290b09640 1 -- 172.21.15.60:0/2651060878 >> v1:172.21.15.105:6789/0 conn(0x7f528c0b5be0 legacy=0x7f528c15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:16.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.343+0000 7f5290b09640 1 -- 172.21.15.60:0/2651060878 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c0cd390 con 0x7f528c15a9c0 2024-09-12T01:40:16.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.344+0000 7f5290b09640 1 --2- 172.21.15.60:0/2651060878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f528c15a9c0 0x7f528c15e600 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f527c009870 tx=0x7f527c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe21f392d5b4bbb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:16.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.344+0000 7f528b7fe640 1 -- 172.21.15.60:0/2651060878 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c037070 con 0x7f528c15a9c0 2024-09-12T01:40:16.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.344+0000 7f528b7fe640 1 -- 172.21.15.60:0/2651060878 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527c032440 con 0x7f528c15a9c0 2024-09-12T01:40:16.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.344+0000 7f528b7fe640 1 -- 172.21.15.60:0/2651060878 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c032810 con 0x7f528c15a9c0 2024-09-12T01:40:16.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.345+0000 7f5292d6d640 1 -- 172.21.15.60:0/2651060878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f528c15a9c0 msgr2=0x7f528c15e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:16.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.345+0000 7f5292d6d640 1 --2- 172.21.15.60:0/2651060878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f528c15a9c0 0x7f528c15e600 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f527c009870 tx=0x7f527c02a270 comp rx=0 tx=0).stop 2024-09-12T01:40:16.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.345+0000 7f5292d6d640 1 -- 172.21.15.60:0/2651060878 shutdown_connections 2024-09-12T01:40:16.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.345+0000 7f5292d6d640 1 --2- 172.21.15.60:0/2651060878 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c0b29a0 0x7f528c0cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:16.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.345+0000 7f5292d6d640 1 --2- 172.21.15.60:0/2651060878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f528c15a9c0 0x7f528c15e600 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:16.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.345+0000 7f5292d6d640 1 -- 172.21.15.60:0/2651060878 >> 172.21.15.60:0/2651060878 conn(0x7f528c06bc10 msgr2=0x7f528c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:16.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.345+0000 7f5292d6d640 1 -- 172.21.15.60:0/2651060878 shutdown_connections 2024-09-12T01:40:16.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.345+0000 7f5292d6d640 1 -- 172.21.15.60:0/2651060878 wait complete. 2024-09-12T01:40:16.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.346+0000 7f5292d6d640 1 Processor -- start 2024-09-12T01:40:16.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.346+0000 7f5292d6d640 1 -- start start 2024-09-12T01:40:16.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5292d6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f528c0b29a0 0x7f528c1f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:16.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5292d6d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c0b5be0 0x7f528c14a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:16.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5292d6d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c15a9c0 0x7f528c15d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:16.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5292d6d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f528c15ada0 con 0x7f528c0b29a0 2024-09-12T01:40:16.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5292d6d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f528c0cd950 con 0x7f528c0b5be0 2024-09-12T01:40:16.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5292d6d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f528c06de40 con 0x7f528c15a9c0 2024-09-12T01:40:16.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5290b09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f528c0b29a0 0x7f528c1f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:16.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5290b09640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f528c0b29a0 0x7f528c1f4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55892/0 (socket says 172.21.15.60:55892) 2024-09-12T01:40:16.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5290b09640 1 -- 172.21.15.60:0/1316454107 learned_addr learned my addr 172.21.15.60:0/1316454107 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:16.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f529130a640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c15a9c0 0x7f528c15d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:16.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f528bfff640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c0b5be0 0x7f528c14a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:16.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5290b09640 1 -- 172.21.15.60:0/1316454107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c15a9c0 msgr2=0x7f528c15d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:16.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5290b09640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c15a9c0 0x7f528c15d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:16.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5290b09640 1 -- 172.21.15.60:0/1316454107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c0b5be0 msgr2=0x7f528c14a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:16.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5290b09640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c0b5be0 0x7f528c14a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:16.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.347+0000 7f5290b09640 1 -- 172.21.15.60:0/1316454107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c14b510 con 0x7f528c0b29a0 2024-09-12T01:40:16.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.348+0000 7f5290b09640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f528c0b29a0 0x7f528c1f4920 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f527c000c00 tx=0x7f527c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:16.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.348+0000 7f52897fa640 1 -- 172.21.15.60:0/1316454107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c037040 con 0x7f528c0b29a0 2024-09-12T01:40:16.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.348+0000 7f52897fa640 1 -- 172.21.15.60:0/1316454107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f527c042070 con 0x7f528c0b29a0 2024-09-12T01:40:16.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.348+0000 7f5292d6d640 1 -- 172.21.15.60:0/1316454107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528c14aa70 con 0x7f528c0b29a0 2024-09-12T01:40:16.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.348+0000 7f52897fa640 1 -- 172.21.15.60:0/1316454107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527c030880 con 0x7f528c0b29a0 2024-09-12T01:40:16.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.348+0000 7f5292d6d640 1 -- 172.21.15.60:0/1316454107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528c150500 con 0x7f528c0b29a0 2024-09-12T01:40:16.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.349+0000 7f5292d6d640 1 -- 172.21.15.60:0/1316454107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528c06e230 con 0x7f528c0b29a0 2024-09-12T01:40:16.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.349+0000 7f52897fa640 1 -- 172.21.15.60:0/1316454107 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f527c030a20 con 0x7f528c0b29a0 2024-09-12T01:40:16.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.350+0000 7f52897fa640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f526c06be30 0x7f526c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:16.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.350+0000 7f52897fa640 1 -- 172.21.15.60:0/1316454107 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f527c0ab530 con 0x7f528c0b29a0 2024-09-12T01:40:16.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.350+0000 7f528bfff640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f526c06be30 0x7f526c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:16.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.351+0000 7f528bfff640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f526c06be30 0x7f526c06e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f528c0b49d0 tx=0x7f5274009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:16.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.355+0000 7f52897fa640 1 -- 172.21.15.60:0/1316454107 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f527c079f70 con 0x7f528c0b29a0 2024-09-12T01:40:16.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.569+0000 7f5292d6d640 1 -- 172.21.15.60:0/1316454107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f528c152500 con 0x7f528c0b29a0 2024-09-12T01:40:16.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.570+0000 7f52897fa640 1 -- 172.21.15.60:0/1316454107 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f527c079870 con 0x7f528c0b29a0 2024-09-12T01:40:16.570 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:40:16.571 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:40:16.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.572+0000 7f5292d6d640 1 -- 172.21.15.60:0/1316454107 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f526c06be30 msgr2=0x7f526c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:16.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.572+0000 7f5292d6d640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f526c06be30 0x7f526c06e2f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f528c0b49d0 tx=0x7f5274009040 comp rx=0 tx=0).stop 2024-09-12T01:40:16.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.572+0000 7f5292d6d640 1 -- 172.21.15.60:0/1316454107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f528c0b29a0 msgr2=0x7f528c1f4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:16.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.572+0000 7f5292d6d640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f528c0b29a0 0x7f528c1f4920 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f527c000c00 tx=0x7f527c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:40:16.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.572+0000 7f5292d6d640 1 -- 172.21.15.60:0/1316454107 shutdown_connections 2024-09-12T01:40:16.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.572+0000 7f5292d6d640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f526c06be30 0x7f526c06e2f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:16.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.572+0000 7f5292d6d640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f528c15a9c0 0x7f528c15d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:16.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.572+0000 7f5292d6d640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f528c0b5be0 0x7f528c14a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:16.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.572+0000 7f5292d6d640 1 --2- 172.21.15.60:0/1316454107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f528c0b29a0 0x7f528c1f4920 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:16.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.572+0000 7f5292d6d640 1 -- 172.21.15.60:0/1316454107 >> 172.21.15.60:0/1316454107 conn(0x7f528c06bc10 msgr2=0x7f528c14e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:16.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.572+0000 7f5292d6d640 1 -- 172.21.15.60:0/1316454107 shutdown_connections 2024-09-12T01:40:16.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:16.572+0000 7f5292d6d640 1 -- 172.21.15.60:0/1316454107 wait complete. 2024-09-12T01:40:16.584 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:40:16.584 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:40:17.638 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:18.430 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:40:18.433 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:40:19.640 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:21.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:40:21.642 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.699+0000 7f7d88e0a640 1 Processor -- start 2024-09-12T01:40:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.699+0000 7f7d88e0a640 1 -- start start 2024-09-12T01:40:21.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.700+0000 7f7d88e0a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d8406d540 0x7f7d840cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:21.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.700+0000 7f7d88e0a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8406faf0 con 0x7f7d840735b0 2024-09-12T01:40:21.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.700+0000 7f7d88e0a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8406fdd0 con 0x7f7d8415e950 2024-09-12T01:40:21.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.700+0000 7f7d88e0a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7d840700b0 con 0x7f7d8406d540 2024-09-12T01:40:21.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.700+0000 7f7d7bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d8406d540 0x7f7d840cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:21.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.700+0000 7f7d82d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7d840735b0 0x7f7d840cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:40022/0 (socket says 172.21.15.60:40022) 2024-09-12T01:40:21.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.700+0000 7f7d82d9d640 1 -- 172.21.15.60:0/815815908 learned_addr learned my addr 172.21.15.60:0/815815908 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:40:21.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.700+0000 7f7d7bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d8406d540 0x7f7d840cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55902/0 (socket says 172.21.15.60:55902) 2024-09-12T01:40:21.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.700+0000 7f7d7bfff640 1 -- 172.21.15.60:0/815815908 >> v1:172.21.15.105:6789/0 conn(0x7f7d8415e950 legacy=0x7f7d8406ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:21.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.700+0000 7f7d7bfff640 1 -- 172.21.15.60:0/815815908 >> v1:172.21.15.60:6789/0 conn(0x7f7d840735b0 legacy=0x7f7d840cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:21.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.700+0000 7f7d7bfff640 1 -- 172.21.15.60:0/815815908 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d84070390 con 0x7f7d8406d540 2024-09-12T01:40:21.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.701+0000 7f7d7bfff640 1 --2- 172.21.15.60:0/815815908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d8406d540 0x7f7d840cf0a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c0097a0 tx=0x7f7d6c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c38e7a726fec00e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:21.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.701+0000 7f7d81d9b640 1 -- 172.21.15.60:0/815815908 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c037070 con 0x7f7d8406d540 2024-09-12T01:40:21.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.701+0000 7f7d81d9b640 1 -- 172.21.15.60:0/815815908 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d6c032440 con 0x7f7d8406d540 2024-09-12T01:40:21.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.701+0000 7f7d81d9b640 1 -- 172.21.15.60:0/815815908 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c032810 con 0x7f7d8406d540 2024-09-12T01:40:21.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.702+0000 7f7d88e0a640 1 -- 172.21.15.60:0/815815908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d8406d540 msgr2=0x7f7d840cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:21.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.702+0000 7f7d88e0a640 1 --2- 172.21.15.60:0/815815908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d8406d540 0x7f7d840cf0a0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c0097a0 tx=0x7f7d6c02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:40:21.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.702+0000 7f7d88e0a640 1 -- 172.21.15.60:0/815815908 shutdown_connections 2024-09-12T01:40:21.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.702+0000 7f7d88e0a640 1 --2- 172.21.15.60:0/815815908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d8406d540 0x7f7d840cf0a0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:21.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.702+0000 7f7d88e0a640 1 -- 172.21.15.60:0/815815908 >> 172.21.15.60:0/815815908 conn(0x7f7d840d14d0 msgr2=0x7f7d840d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:21.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.702+0000 7f7d88e0a640 1 -- 172.21.15.60:0/815815908 shutdown_connections 2024-09-12T01:40:21.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.702+0000 7f7d88e0a640 1 -- 172.21.15.60:0/815815908 wait complete. 2024-09-12T01:40:21.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.703+0000 7f7d88e0a640 1 Processor -- start 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.703+0000 7f7d88e0a640 1 -- start start 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.704+0000 7f7d88e0a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d8406d540 0x7f7d841459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.704+0000 7f7d88e0a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d840735b0 0x7f7d840cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.704+0000 7f7d88e0a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d8415e950 0x7f7d840cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.704+0000 7f7d88e0a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7d840721d0 con 0x7f7d8406d540 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.704+0000 7f7d88e0a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d84072050 con 0x7f7d840735b0 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.704+0000 7f7d88e0a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7d84072350 con 0x7f7d8415e950 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.704+0000 7f7d8259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d8406d540 0x7f7d841459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.704+0000 7f7d8259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d8406d540 0x7f7d841459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55912/0 (socket says 172.21.15.60:55912) 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.704+0000 7f7d8259c640 1 -- 172.21.15.60:0/1036250314 learned_addr learned my addr 172.21.15.60:0/1036250314 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.704+0000 7f7d7bfff640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d840735b0 0x7f7d840cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.704+0000 7f7d82d9d640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d8415e950 0x7f7d840cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:21.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.705+0000 7f7d8259c640 1 -- 172.21.15.60:0/1036250314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d8415e950 msgr2=0x7f7d840cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.705+0000 7f7d8259c640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d8415e950 0x7f7d840cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.705+0000 7f7d8259c640 1 -- 172.21.15.60:0/1036250314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d840735b0 msgr2=0x7f7d840cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.705+0000 7f7d8259c640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d840735b0 0x7f7d840cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.705+0000 7f7d8259c640 1 -- 172.21.15.60:0/1036250314 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d841560b0 con 0x7f7d8406d540 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.705+0000 7f7d7bfff640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d840735b0 0x7f7d840cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.705+0000 7f7d8259c640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d8406d540 0x7f7d841459e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400c430 tx=0x7f7d7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.705+0000 7f7d7affd640 1 -- 172.21.15.60:0/1036250314 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d74011790 con 0x7f7d8406d540 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.705+0000 7f7d7affd640 1 -- 172.21.15.60:0/1036250314 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d74017070 con 0x7f7d8406d540 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.705+0000 7f7d88e0a640 1 -- 172.21.15.60:0/1036250314 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d84156390 con 0x7f7d8406d540 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.705+0000 7f7d7affd640 1 -- 172.21.15.60:0/1036250314 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d74011bb0 con 0x7f7d8406d540 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.705+0000 7f7d88e0a640 1 -- 172.21.15.60:0/1036250314 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d84156950 con 0x7f7d8406d540 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.706+0000 7f7d88e0a640 1 -- 172.21.15.60:0/1036250314 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8406ce30 con 0x7f7d8406d540 2024-09-12T01:40:21.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.706+0000 7f7d7affd640 1 -- 172.21.15.60:0/1036250314 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d7401c460 con 0x7f7d8406d540 2024-09-12T01:40:21.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.707+0000 7f7d7affd640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d6406be30 0x7f7d6406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:21.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.707+0000 7f7d7affd640 1 -- 172.21.15.60:0/1036250314 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f7d7408add0 con 0x7f7d8406d540 2024-09-12T01:40:21.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.707+0000 7f7d7bfff640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d6406be30 0x7f7d6406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:21.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.707+0000 7f7d7bfff640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d6406be30 0x7f7d6406e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c034000 tx=0x7f7d6c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:21.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.711+0000 7f7d7affd640 1 -- 172.21.15.60:0/1036250314 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d74059780 con 0x7f7d8406d540 2024-09-12T01:40:21.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.922+0000 7f7d88e0a640 1 -- 172.21.15.60:0/1036250314 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7d840ce6c0 con 0x7f7d8406d540 2024-09-12T01:40:21.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.922+0000 7f7d7affd640 1 -- 172.21.15.60:0/1036250314 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f7d7408c020 con 0x7f7d8406d540 2024-09-12T01:40:21.922 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:40:21.923 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:40:21.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.924+0000 7f7d88e0a640 1 -- 172.21.15.60:0/1036250314 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d6406be30 msgr2=0x7f7d6406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.924+0000 7f7d88e0a640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d6406be30 0x7f7d6406e2f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c034000 tx=0x7f7d6c02e000 comp rx=0 tx=0).stop 2024-09-12T01:40:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.924+0000 7f7d88e0a640 1 -- 172.21.15.60:0/1036250314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d8406d540 msgr2=0x7f7d841459e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.924+0000 7f7d88e0a640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d8406d540 0x7f7d841459e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400c430 tx=0x7f7d7400c8f0 comp rx=0 tx=0).stop 2024-09-12T01:40:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.924+0000 7f7d88e0a640 1 -- 172.21.15.60:0/1036250314 shutdown_connections 2024-09-12T01:40:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.924+0000 7f7d88e0a640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d6406be30 0x7f7d6406e2f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.924+0000 7f7d88e0a640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d8415e950 0x7f7d840cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.924+0000 7f7d88e0a640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d840735b0 0x7f7d840cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.924+0000 7f7d88e0a640 1 --2- 172.21.15.60:0/1036250314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d8406d540 0x7f7d841459e0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.924+0000 7f7d88e0a640 1 -- 172.21.15.60:0/1036250314 >> 172.21.15.60:0/1036250314 conn(0x7f7d840d14d0 msgr2=0x7f7d840b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.924+0000 7f7d88e0a640 1 -- 172.21.15.60:0/1036250314 shutdown_connections 2024-09-12T01:40:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:21.924+0000 7f7d88e0a640 1 -- 172.21.15.60:0/1036250314 wait complete. 2024-09-12T01:40:21.936 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:40:21.936 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:40:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:25.646 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:26.937 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:40:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.051+0000 7ff711e4c640 1 Processor -- start 2024-09-12T01:40:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.052+0000 7ff711e4c640 1 -- start start 2024-09-12T01:40:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.052+0000 7ff711e4c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0d3310 0x7ff70c0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.052+0000 7ff711e4c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff70c15ea40 con 0x7ff70c15e660 2024-09-12T01:40:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.052+0000 7ff711e4c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff70c0d3870 con 0x7ff70c0d1650 2024-09-12T01:40:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.052+0000 7ff711e4c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff70c0d1ac0 con 0x7ff70c0d3310 2024-09-12T01:40:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff70c15e660 0x7ff70c0cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:34288/0 (socket says 172.21.15.60:34288) 2024-09-12T01:40:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70b7fe640 1 -- 172.21.15.60:0/967413184 learned_addr learned my addr 172.21.15.60:0/967413184 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:40:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70affd640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0d3310 0x7ff70c0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066287463 0 0) 0x7ff70c15ea40 con 0x7ff70c15e660 2024-09-12T01:40:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6f4003520 con 0x7ff70c15e660 2024-09-12T01:40:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270846169 0 0) 0x7ff70c0d3870 con 0x7ff70c0d1650 2024-09-12T01:40:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff70c15ea40 con 0x7ff70c0d1650 2024-09-12T01:40:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1920848895 0 0) 0x7ff6f4003520 con 0x7ff70c15e660 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0d3310 msgr2=0x7ff70c0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0d3310 0x7ff70c0d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 >> v1:172.21.15.105:6789/0 conn(0x7ff70c0d1650 legacy=0x7ff70c0b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70c0d3b50 con 0x7ff70c15e660 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7ff6fc001670 con 0x7ff70c15e660 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 >> v1:172.21.15.60:6789/0 conn(0x7ff70c15e660 legacy=0x7ff70c0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f4003b70 0x7ff6f4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0d3310 0x7ff6f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6f4004d40 0x7ff6f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c0d1ac0 con 0x7ff6f4003b70 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f400ba70 con 0x7ff6f4004d40 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff6f400bc70 con 0x7ff70c0d3310 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.053+0000 7ff70b7fe640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f4003b70 0x7ff6f4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.054+0000 7ff70affd640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0d3310 0x7ff6f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.054+0000 7ff70bfff640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6f4004d40 0x7ff6f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.054+0000 7ff70b7fe640 1 -- 172.21.15.60:0/967413184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0d3310 msgr2=0x7ff6f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.054+0000 7ff70b7fe640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0d3310 0x7ff6f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.054+0000 7ff70b7fe640 1 -- 172.21.15.60:0/967413184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6f4004d40 msgr2=0x7ff6f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.054+0000 7ff70b7fe640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6f4004d40 0x7ff6f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.054+0000 7ff70b7fe640 1 -- 172.21.15.60:0/967413184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f4003520 con 0x7ff6f4003b70 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.054+0000 7ff70bfff640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6f4004d40 0x7ff6f40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.055+0000 7ff70b7fe640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f4003b70 0x7ff6f4003f70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00c210 tx=0x7ff6f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f1034a805bd64f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.055+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc007ce0 con 0x7ff6f4003b70 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.055+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc005ad0 con 0x7ff6f4003b70 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.055+0000 7ff70a7fc640 1 -- 172.21.15.60:0/967413184 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc007070 con 0x7ff6f4003b70 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.055+0000 7ff711e4c640 1 -- 172.21.15.60:0/967413184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f4003b70 msgr2=0x7ff6f4003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.055+0000 7ff711e4c640 1 --2- 172.21.15.60:0/967413184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f4003b70 0x7ff6f4003f70 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc00c210 tx=0x7ff6f4005830 comp rx=0 tx=0).stop 2024-09-12T01:40:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.055+0000 7ff70bfff640 1 -- 172.21.15.60:0/967413184 reap_dead start 2024-09-12T01:40:27.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.055+0000 7ff711e4c640 1 -- 172.21.15.60:0/967413184 shutdown_connections 2024-09-12T01:40:27.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.055+0000 7ff711e4c640 1 -- 172.21.15.60:0/967413184 >> 172.21.15.60:0/967413184 conn(0x7ff70c0b6410 msgr2=0x7ff70c0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:27.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.055+0000 7ff711e4c640 1 -- 172.21.15.60:0/967413184 shutdown_connections 2024-09-12T01:40:27.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.055+0000 7ff711e4c640 1 -- 172.21.15.60:0/967413184 wait complete. 2024-09-12T01:40:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.057+0000 7ff711e4c640 1 Processor -- start 2024-09-12T01:40:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.057+0000 7ff711e4c640 1 -- start start 2024-09-12T01:40:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.057+0000 7ff711e4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f4003b70 0x7ff70c158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.057+0000 7ff711e4c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0ceec0 0x7ff70c1f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.057+0000 7ff711e4c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff70c155010 0x7ff70c155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.057+0000 7ff711e4c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c0d43f0 con 0x7ff6f4003b70 2024-09-12T01:40:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.057+0000 7ff711e4c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff70c0d4110 con 0x7ff70c155010 2024-09-12T01:40:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.057+0000 7ff711e4c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff70c0d1110 con 0x7ff70c0ceec0 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff70b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f4003b70 0x7ff70c158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff70b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f4003b70 0x7ff70c158d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56718/0 (socket says 172.21.15.60:56718) 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff70b7fe640 1 -- 172.21.15.60:0/2701455257 learned_addr learned my addr 172.21.15.60:0/2701455257 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff70affd640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0ceec0 0x7ff70c1f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff70bfff640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff70c155010 0x7ff70c155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff70b7fe640 1 -- 172.21.15.60:0/2701455257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0ceec0 msgr2=0x7ff70c1f4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff70b7fe640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0ceec0 0x7ff70c1f4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff70b7fe640 1 -- 172.21.15.60:0/2701455257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff70c155010 msgr2=0x7ff70c155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff70b7fe640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff70c155010 0x7ff70c155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff70b7fe640 1 -- 172.21.15.60:0/2701455257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff70c15fd40 con 0x7ff6f4003b70 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff70b7fe640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f4003b70 0x7ff70c158d70 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0018f0 tx=0x7ff70c0d3a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff6f3fff640 1 -- 172.21.15.60:0/2701455257 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc041030 con 0x7ff6f4003b70 2024-09-12T01:40:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff6f3fff640 1 -- 172.21.15.60:0/2701455257 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6fc038040 con 0x7ff6f4003b70 2024-09-12T01:40:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff6f3fff640 1 -- 172.21.15.60:0/2701455257 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc001bf0 con 0x7ff6f4003b70 2024-09-12T01:40:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.058+0000 7ff711e4c640 1 -- 172.21.15.60:0/2701455257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff70c1f4ec0 con 0x7ff6f4003b70 2024-09-12T01:40:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.059+0000 7ff711e4c640 1 -- 172.21.15.60:0/2701455257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff70c1f5480 con 0x7ff6f4003b70 2024-09-12T01:40:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.059+0000 7ff711e4c640 1 -- 172.21.15.60:0/2701455257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff70c0cf730 con 0x7ff6f4003b70 2024-09-12T01:40:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.060+0000 7ff6f3fff640 1 -- 172.21.15.60:0/2701455257 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6fc044070 con 0x7ff6f4003b70 2024-09-12T01:40:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.060+0000 7ff6f3fff640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6f806be60 0x7ff6f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.061+0000 7ff6f3fff640 1 -- 172.21.15.60:0/2701455257 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7ff6fc0aa850 con 0x7ff6f4003b70 2024-09-12T01:40:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.061+0000 7ff70affd640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6f806be60 0x7ff6f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.061+0000 7ff70affd640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6f806be60 0x7ff6f806e320 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff70c161a30 tx=0x7ff700009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:27.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.065+0000 7ff6f3fff640 1 -- 172.21.15.60:0/2701455257 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6fc005aa0 con 0x7ff6f4003b70 2024-09-12T01:40:27.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.278+0000 7ff711e4c640 1 -- 172.21.15.60:0/2701455257 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff70c15d110 con 0x7ff6f4003b70 2024-09-12T01:40:27.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.278+0000 7ff6f3fff640 1 -- 172.21.15.60:0/2701455257 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7ff6fc079290 con 0x7ff6f4003b70 2024-09-12T01:40:27.279 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:40:27.279 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:40:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.280+0000 7ff711e4c640 1 -- 172.21.15.60:0/2701455257 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6f806be60 msgr2=0x7ff6f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.280+0000 7ff711e4c640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6f806be60 0x7ff6f806e320 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff70c161a30 tx=0x7ff700009190 comp rx=0 tx=0).stop 2024-09-12T01:40:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.280+0000 7ff711e4c640 1 -- 172.21.15.60:0/2701455257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f4003b70 msgr2=0x7ff70c158d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.280+0000 7ff711e4c640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f4003b70 0x7ff70c158d70 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0018f0 tx=0x7ff70c0d3a40 comp rx=0 tx=0).stop 2024-09-12T01:40:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.280+0000 7ff711e4c640 1 -- 172.21.15.60:0/2701455257 shutdown_connections 2024-09-12T01:40:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.280+0000 7ff711e4c640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff70c155010 0x7ff70c155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.280+0000 7ff711e4c640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6f806be60 0x7ff6f806e320 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.280+0000 7ff711e4c640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff70c0ceec0 0x7ff70c1f4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.280+0000 7ff711e4c640 1 --2- 172.21.15.60:0/2701455257 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6f4003b70 0x7ff70c158d70 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.280+0000 7ff711e4c640 1 -- 172.21.15.60:0/2701455257 >> 172.21.15.60:0/2701455257 conn(0x7ff70c0b6410 msgr2=0x7ff70c15d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:27.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.280+0000 7ff711e4c640 1 -- 172.21.15.60:0/2701455257 shutdown_connections 2024-09-12T01:40:27.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:27.280+0000 7ff711e4c640 1 -- 172.21.15.60:0/2701455257 wait complete. 2024-09-12T01:40:27.292 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:40:27.292 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:40:27.648 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:29.651 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:31.653 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:32.293 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:40:32.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.409+0000 7ffb62f49640 1 Processor -- start 2024-09-12T01:40:32.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.409+0000 7ffb62f49640 1 -- start start 2024-09-12T01:40:32.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.410+0000 7ffb62f49640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffb5c15c2b0 0x7ffb5c0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:32.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.410+0000 7ffb62f49640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb5c0b72f0 0x7ffb5c15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:32.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.410+0000 7ffb62f49640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb5c15f030 0x7ffb5c06f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:32.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.410+0000 7ffb62f49640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ffb5c15fb10 con 0x7ffb5c0b72f0 2024-09-12T01:40:32.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.410+0000 7ffb62f49640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffb5c0b5900 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.410+0000 7ffb62f49640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffb5c15f830 con 0x7ffb5c15f030 2024-09-12T01:40:32.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.410+0000 7ffb5bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb5c0b72f0 0x7ffb5c15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:32.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.410+0000 7ffb5bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb5c0b72f0 0x7ffb5c15eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56722/0 (socket says 172.21.15.60:56722) 2024-09-12T01:40:32.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.410+0000 7ffb5bfff640 1 -- 172.21.15.60:0/409466227 learned_addr learned my addr 172.21.15.60:0/409466227 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:32.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.410+0000 7ffb614e6640 1 --2- 172.21.15.60:0/409466227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb5c15f030 0x7ffb5c06f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:32.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.410+0000 7ffb60ce5640 1 --2- 172.21.15.60:0/409466227 >> v2:172.21.15.105:3300/0 conn(0x7ffb5c15c2b0 0x7ffb5c0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:32.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.411+0000 7ffb5bfff640 1 -- 172.21.15.60:0/409466227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb5c15f030 msgr2=0x7ffb5c06f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:32.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.411+0000 7ffb5bfff640 1 --2- 172.21.15.60:0/409466227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb5c15f030 0x7ffb5c06f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.411+0000 7ffb5bfff640 1 -- 172.21.15.60:0/409466227 >> v2:172.21.15.105:3300/0 conn(0x7ffb5c15c2b0 msgr2=0x7ffb5c0b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:32.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.411+0000 7ffb5bfff640 1 --2- 172.21.15.60:0/409466227 >> v2:172.21.15.105:3300/0 conn(0x7ffb5c15c2b0 0x7ffb5c0b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.411+0000 7ffb5bfff640 1 -- 172.21.15.60:0/409466227 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c06ce30 con 0x7ffb5c0b72f0 2024-09-12T01:40:32.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.411+0000 7ffb60ce5640 1 --2- 172.21.15.60:0/409466227 >> v2:172.21.15.105:3300/0 conn(0x7ffb5c15c2b0 0x7ffb5c0b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:40:32.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.411+0000 7ffb5bfff640 1 --2- 172.21.15.60:0/409466227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb5c0b72f0 0x7ffb5c15eaf0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c06f040 tx=0x7ffb4402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e5f9a9173d069c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:32.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.412+0000 7ffb5b7fe640 1 -- 172.21.15.60:0/409466227 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44037070 con 0x7ffb5c0b72f0 2024-09-12T01:40:32.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.412+0000 7ffb5b7fe640 1 -- 172.21.15.60:0/409466227 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb44032440 con 0x7ffb5c0b72f0 2024-09-12T01:40:32.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.412+0000 7ffb5b7fe640 1 -- 172.21.15.60:0/409466227 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44032810 con 0x7ffb5c0b72f0 2024-09-12T01:40:32.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.412+0000 7ffb62f49640 1 -- 172.21.15.60:0/409466227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb5c0b72f0 msgr2=0x7ffb5c15eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:32.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.412+0000 7ffb62f49640 1 --2- 172.21.15.60:0/409466227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb5c0b72f0 0x7ffb5c15eaf0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c06f040 tx=0x7ffb4402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.412+0000 7ffb62f49640 1 -- 172.21.15.60:0/409466227 shutdown_connections 2024-09-12T01:40:32.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.412+0000 7ffb62f49640 1 --2- 172.21.15.60:0/409466227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb5c15f030 0x7ffb5c06f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.412+0000 7ffb62f49640 1 --2- 172.21.15.60:0/409466227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb5c0b72f0 0x7ffb5c15eaf0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.412+0000 7ffb62f49640 1 --2- 172.21.15.60:0/409466227 >> v2:172.21.15.105:3300/0 conn(0x7ffb5c15c2b0 0x7ffb5c0b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.412+0000 7ffb62f49640 1 -- 172.21.15.60:0/409466227 >> 172.21.15.60:0/409466227 conn(0x7ffb5c0b4240 msgr2=0x7ffb5c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.412+0000 7ffb62f49640 1 -- 172.21.15.60:0/409466227 shutdown_connections 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.412+0000 7ffb62f49640 1 -- 172.21.15.60:0/409466227 wait complete. 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.413+0000 7ffb62f49640 1 Processor -- start 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.413+0000 7ffb62f49640 1 -- start start 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.414+0000 7ffb62f49640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb5c0b72f0 0x7ffb5c1518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.414+0000 7ffb62f49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb5c15c2b0 0x7ffb5c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.414+0000 7ffb62f49640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb5c15f030 0x7ffb5c153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.414+0000 7ffb62f49640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c0b7760 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.414+0000 7ffb62f49640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c06d3f0 con 0x7ffb5c0b72f0 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.414+0000 7ffb62f49640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffb5c15f4c0 con 0x7ffb5c15f030 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb5bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb5c15c2b0 0x7ffb5c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb5bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb5c15c2b0 0x7ffb5c0ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56726/0 (socket says 172.21.15.60:56726) 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb5bfff640 1 -- 172.21.15.60:0/525493120 learned_addr learned my addr 172.21.15.60:0/525493120 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:32.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb614e6640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb5c15f030 0x7ffb5c153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:32.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb60ce5640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb5c0b72f0 0x7ffb5c1518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:32.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb5bfff640 1 -- 172.21.15.60:0/525493120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb5c15f030 msgr2=0x7ffb5c153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:32.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb5bfff640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb5c15f030 0x7ffb5c153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb5bfff640 1 -- 172.21.15.60:0/525493120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb5c0b72f0 msgr2=0x7ffb5c1518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:32.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb5bfff640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb5c0b72f0 0x7ffb5c1518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb5bfff640 1 -- 172.21.15.60:0/525493120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c0cccf0 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb614e6640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb5c15f030 0x7ffb5c153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:40:32.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb60ce5640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb5c0b72f0 0x7ffb5c1518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:40:32.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb5bfff640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb5c15c2b0 0x7ffb5c0ce3f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ffb4402a220 tx=0x7ffb440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:32.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb597fa640 1 -- 172.21.15.60:0/525493120 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44037040 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb597fa640 1 -- 172.21.15.60:0/525493120 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb44042070 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb62f49640 1 -- 172.21.15.60:0/525493120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5c0ccfd0 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb597fa640 1 -- 172.21.15.60:0/525493120 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb44030880 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.415+0000 7ffb62f49640 1 -- 172.21.15.60:0/525493120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5c0cd590 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.416+0000 7ffb62f49640 1 -- 172.21.15.60:0/525493120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5c0b5540 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.417+0000 7ffb597fa640 1 -- 172.21.15.60:0/525493120 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb44030a20 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.417+0000 7ffb597fa640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb3c06be30 0x7ffb3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:32.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.417+0000 7ffb597fa640 1 -- 172.21.15.60:0/525493120 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7ffb440ab630 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.417+0000 7ffb60ce5640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb3c06be30 0x7ffb3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:32.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.418+0000 7ffb60ce5640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb3c06be30 0x7ffb3c06e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c006fd0 tx=0x7ffb4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:32.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.422+0000 7ffb597fa640 1 -- 172.21.15.60:0/525493120 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb5c0b5540 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.632+0000 7ffb62f49640 1 -- 172.21.15.60:0/525493120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ffb5c15eaf0 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.632+0000 7ffb597fa640 1 -- 172.21.15.60:0/525493120 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7ffb4407a070 con 0x7ffb5c15c2b0 2024-09-12T01:40:32.632 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:40:32.632 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:40:32.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.634+0000 7ffb62f49640 1 -- 172.21.15.60:0/525493120 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb3c06be30 msgr2=0x7ffb3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:32.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.634+0000 7ffb62f49640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb3c06be30 0x7ffb3c06e2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c006fd0 tx=0x7ffb4c008040 comp rx=0 tx=0).stop 2024-09-12T01:40:32.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.634+0000 7ffb62f49640 1 -- 172.21.15.60:0/525493120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb5c15c2b0 msgr2=0x7ffb5c0ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:32.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.634+0000 7ffb62f49640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb5c15c2b0 0x7ffb5c0ce3f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ffb4402a220 tx=0x7ffb440046c0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.634+0000 7ffb62f49640 1 -- 172.21.15.60:0/525493120 shutdown_connections 2024-09-12T01:40:32.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.634+0000 7ffb62f49640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb3c06be30 0x7ffb3c06e2f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.634+0000 7ffb62f49640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb5c15f030 0x7ffb5c153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.634+0000 7ffb62f49640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb5c15c2b0 0x7ffb5c0ce3f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.634+0000 7ffb62f49640 1 --2- 172.21.15.60:0/525493120 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb5c0b72f0 0x7ffb5c1518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:32.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.634+0000 7ffb62f49640 1 -- 172.21.15.60:0/525493120 >> 172.21.15.60:0/525493120 conn(0x7ffb5c0b4240 msgr2=0x7ffb5c06d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:32.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.635+0000 7ffb62f49640 1 -- 172.21.15.60:0/525493120 shutdown_connections 2024-09-12T01:40:32.635 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:32.635+0000 7ffb62f49640 1 -- 172.21.15.60:0/525493120 wait complete. 2024-09-12T01:40:32.645 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:40:32.645 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:40:33.655 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:35.657 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:37.646 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:40:37.659 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.762+0000 7f3e4d453640 1 Processor -- start 2024-09-12T01:40:37.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.762+0000 7f3e4d453640 1 -- start start 2024-09-12T01:40:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e4d453640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3e4815c2b0 0x7f3e480b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e4d453640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e4815f200 0x7f3e4806d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:37.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e4d453640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e4815fb10 con 0x7f3e480b72f0 2024-09-12T01:40:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e4d453640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3e480b5900 con 0x7f3e4815c2b0 2024-09-12T01:40:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e4d453640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4815f830 con 0x7f3e4815f200 2024-09-12T01:40:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e477fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e4815f200 0x7f3e4806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e46ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3e4815c2b0 0x7f3e480b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e477fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e4815f200 0x7f3e4806d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:56994/0 (socket says 172.21.15.60:56994) 2024-09-12T01:40:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e477fe640 1 -- 172.21.15.60:0/1130101392 learned_addr learned my addr 172.21.15.60:0/1130101392 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:37.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e46ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3e4815c2b0 0x7f3e480b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:33652/0 (socket says 172.21.15.60:33652) 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e477fe640 1 -- 172.21.15.60:0/1130101392 >> v2:172.21.15.105:3300/0 conn(0x7f3e4815c2b0 msgr2=0x7f3e480b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e477fe640 1 --2- 172.21.15.60:0/1130101392 >> v2:172.21.15.105:3300/0 conn(0x7f3e4815c2b0 0x7f3e480b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e477fe640 1 -- 172.21.15.60:0/1130101392 >> v1:172.21.15.105:6789/0 conn(0x7f3e480b72f0 legacy=0x7f3e4815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e477fe640 1 -- 172.21.15.60:0/1130101392 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4806ce30 con 0x7f3e4815f200 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.763+0000 7f3e46ffd640 1 --2- 172.21.15.60:0/1130101392 >> v2:172.21.15.105:3300/0 conn(0x7f3e4815c2b0 0x7f3e480b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.764+0000 7f3e477fe640 1 --2- 172.21.15.60:0/1130101392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e4815f200 0x7f3e4806d910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009e50 tx=0x7f3e4002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eaa7e6c1bfc7f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.764+0000 7f3e467fc640 1 -- 172.21.15.60:0/1130101392 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e40036070 con 0x7f3e4815f200 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.764+0000 7f3e467fc640 1 -- 172.21.15.60:0/1130101392 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e40031600 con 0x7f3e4815f200 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.764+0000 7f3e467fc640 1 -- 172.21.15.60:0/1130101392 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e400319d0 con 0x7f3e4815f200 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.765+0000 7f3e4d453640 1 -- 172.21.15.60:0/1130101392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e4815f200 msgr2=0x7f3e4806d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.765+0000 7f3e4d453640 1 --2- 172.21.15.60:0/1130101392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e4815f200 0x7f3e4806d910 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009e50 tx=0x7f3e4002a710 comp rx=0 tx=0).stop 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.765+0000 7f3e4d453640 1 -- 172.21.15.60:0/1130101392 shutdown_connections 2024-09-12T01:40:37.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.765+0000 7f3e4d453640 1 --2- 172.21.15.60:0/1130101392 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e4815f200 0x7f3e4806d910 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.765+0000 7f3e4d453640 1 --2- 172.21.15.60:0/1130101392 >> v2:172.21.15.105:3300/0 conn(0x7f3e4815c2b0 0x7f3e480b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.765+0000 7f3e4d453640 1 -- 172.21.15.60:0/1130101392 >> 172.21.15.60:0/1130101392 conn(0x7f3e480b4240 msgr2=0x7f3e480b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.765+0000 7f3e4d453640 1 -- 172.21.15.60:0/1130101392 shutdown_connections 2024-09-12T01:40:37.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.765+0000 7f3e4d453640 1 -- 172.21.15.60:0/1130101392 wait complete. 2024-09-12T01:40:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.766+0000 7f3e4d453640 1 Processor -- start 2024-09-12T01:40:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.767+0000 7f3e4d453640 1 -- start start 2024-09-12T01:40:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.767+0000 7f3e4d453640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e480b72f0 0x7f3e48147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.767+0000 7f3e4d453640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e4815c2b0 0x7f3e48143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.767+0000 7f3e4d453640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e4815f200 0x7f3e481440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.767+0000 7f3e4d453640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3e480b7760 con 0x7f3e480b72f0 2024-09-12T01:40:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.767+0000 7f3e4d453640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4806d3f0 con 0x7f3e4815c2b0 2024-09-12T01:40:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.767+0000 7f3e4d453640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4806de50 con 0x7f3e4815f200 2024-09-12T01:40:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.767+0000 7f3e46ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e480b72f0 0x7f3e48147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.767+0000 7f3e46ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e480b72f0 0x7f3e48147410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55182/0 (socket says 172.21.15.60:55182) 2024-09-12T01:40:37.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.767+0000 7f3e46ffd640 1 -- 172.21.15.60:0/609487096 learned_addr learned my addr 172.21.15.60:0/609487096 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e477fe640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e4815f200 0x7f3e481440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e3e7fc640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e4815c2b0 0x7f3e48143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e46ffd640 1 -- 172.21.15.60:0/609487096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e4815f200 msgr2=0x7f3e481440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e46ffd640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e4815f200 0x7f3e481440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e46ffd640 1 -- 172.21.15.60:0/609487096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e4815c2b0 msgr2=0x7f3e48143b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e46ffd640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e4815c2b0 0x7f3e48143b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e46ffd640 1 -- 172.21.15.60:0/609487096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e48147950 con 0x7f3e480b72f0 2024-09-12T01:40:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e46ffd640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e480b72f0 0x7f3e48147410 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800ec10 tx=0x7f3e3800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e3ffff640 1 -- 172.21.15.60:0/609487096 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38017070 con 0x7f3e480b72f0 2024-09-12T01:40:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e3ffff640 1 -- 172.21.15.60:0/609487096 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e3800cc30 con 0x7f3e480b72f0 2024-09-12T01:40:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e4d453640 1 -- 172.21.15.60:0/609487096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e481417c0 con 0x7f3e480b72f0 2024-09-12T01:40:37.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e3ffff640 1 -- 172.21.15.60:0/609487096 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e38013470 con 0x7f3e480b72f0 2024-09-12T01:40:37.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.768+0000 7f3e4d453640 1 -- 172.21.15.60:0/609487096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e48158210 con 0x7f3e480b72f0 2024-09-12T01:40:37.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.769+0000 7f3e4d453640 1 -- 172.21.15.60:0/609487096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e480b3a80 con 0x7f3e480b72f0 2024-09-12T01:40:37.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.770+0000 7f3e3ffff640 1 -- 172.21.15.60:0/609487096 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3e3801a070 con 0x7f3e480b72f0 2024-09-12T01:40:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.770+0000 7f3e3ffff640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3e2806be30 0x7f3e2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.770+0000 7f3e3ffff640 1 -- 172.21.15.60:0/609487096 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f3e3808add0 con 0x7f3e480b72f0 2024-09-12T01:40:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.770+0000 7f3e3e7fc640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3e2806be30 0x7f3e2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:37.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.771+0000 7f3e3e7fc640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3e2806be30 0x7f3e2806e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3e48161c00 tx=0x7f3e30009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:37.774 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.775+0000 7f3e3ffff640 1 -- 172.21.15.60:0/609487096 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3e480b3a80 con 0x7f3e480b72f0 2024-09-12T01:40:37.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.986+0000 7f3e4d453640 1 -- 172.21.15.60:0/609487096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3e4815d420 con 0x7f3e480b72f0 2024-09-12T01:40:37.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.987+0000 7f3e3ffff640 1 -- 172.21.15.60:0/609487096 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f3e48147950 con 0x7f3e480b72f0 2024-09-12T01:40:37.986 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:40:37.986 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:40:37.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.988+0000 7f3e4d453640 1 -- 172.21.15.60:0/609487096 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3e2806be30 msgr2=0x7f3e2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:37.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.988+0000 7f3e4d453640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3e2806be30 0x7f3e2806e2f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3e48161c00 tx=0x7f3e30009040 comp rx=0 tx=0).stop 2024-09-12T01:40:37.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.988+0000 7f3e4d453640 1 -- 172.21.15.60:0/609487096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e480b72f0 msgr2=0x7f3e48147410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:37.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.988+0000 7f3e4d453640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e480b72f0 0x7f3e48147410 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800ec10 tx=0x7f3e3800c520 comp rx=0 tx=0).stop 2024-09-12T01:40:37.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.988+0000 7f3e4d453640 1 -- 172.21.15.60:0/609487096 shutdown_connections 2024-09-12T01:40:37.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.988+0000 7f3e4d453640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3e2806be30 0x7f3e2806e2f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:37.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.988+0000 7f3e4d453640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3e4815f200 0x7f3e481440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:37.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.988+0000 7f3e4d453640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3e4815c2b0 0x7f3e48143b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:37.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.988+0000 7f3e4d453640 1 --2- 172.21.15.60:0/609487096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e480b72f0 0x7f3e48147410 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:37.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.988+0000 7f3e4d453640 1 -- 172.21.15.60:0/609487096 >> 172.21.15.60:0/609487096 conn(0x7f3e480b4240 msgr2=0x7f3e4806e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:37.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.989+0000 7f3e4d453640 1 -- 172.21.15.60:0/609487096 shutdown_connections 2024-09-12T01:40:37.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:37.989+0000 7f3e4d453640 1 -- 172.21.15.60:0/609487096 wait complete. 2024-09-12T01:40:37.999 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:40:37.999 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:40:39.661 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:43.001 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:40:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.117+0000 7fd6f903c640 1 Processor -- start 2024-09-12T01:40:43.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.117+0000 7fd6f903c640 1 -- start start 2024-09-12T01:40:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.118+0000 7fd6f903c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd6f415e660 0x7fd6f40cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.118+0000 7fd6f903c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6f40d1820 0x7fd6f40b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.118+0000 7fd6f903c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f415ea40 con 0x7fd6f40d3310 2024-09-12T01:40:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.118+0000 7fd6f903c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f40d3870 con 0x7fd6f415e660 2024-09-12T01:40:43.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.118+0000 7fd6f903c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f40d3b50 con 0x7fd6f40d1820 2024-09-12T01:40:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.118+0000 7fd6f359e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6f40d1820 0x7fd6f40b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.118+0000 7fd6f2d9d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd6f415e660 0x7fd6f40cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.118+0000 7fd6ebfff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fd6f40d3310 0x7fd6f40d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:52616/0 (socket says 172.21.15.60:52616) 2024-09-12T01:40:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.118+0000 7fd6ebfff640 1 -- 172.21.15.60:0/2301463700 learned_addr learned my addr 172.21.15.60:0/2301463700 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:40:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.118+0000 7fd6f259c640 1 -- 172.21.15.60:0/2301463700 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201943098 0 0) 0x7fd6f415ea40 con 0x7fd6f40d3310 2024-09-12T01:40:43.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.118+0000 7fd6f259c640 1 -- 172.21.15.60:0/2301463700 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6e0003520 con 0x7fd6f40d3310 2024-09-12T01:40:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.118+0000 7fd6f2d9d640 1 -- 172.21.15.60:0/2301463700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6f40d1820 msgr2=0x7fd6f40b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.119+0000 7fd6f2d9d640 1 --2- 172.21.15.60:0/2301463700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6f40d1820 0x7fd6f40b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.119+0000 7fd6f2d9d640 1 -- 172.21.15.60:0/2301463700 >> v1:172.21.15.105:6789/0 conn(0x7fd6f40d3310 legacy=0x7fd6f40d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.119+0000 7fd6f2d9d640 1 -- 172.21.15.60:0/2301463700 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f40d3e30 con 0x7fd6f415e660 2024-09-12T01:40:43.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.119+0000 7fd6f359e640 1 --2- 172.21.15.60:0/2301463700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6f40d1820 0x7fd6f40b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:40:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.119+0000 7fd6f2d9d640 1 --2- 172.21.15.60:0/2301463700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6f415e660 0x7fd6f40cf730 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40097a0 tx=0x7fd6e402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10f68f53129d3a0b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.120+0000 7fd6f259c640 1 -- 172.21.15.60:0/2301463700 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4037070 con 0x7fd6f415e660 2024-09-12T01:40:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.120+0000 7fd6f259c640 1 -- 172.21.15.60:0/2301463700 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e4032440 con 0x7fd6f415e660 2024-09-12T01:40:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.120+0000 7fd6f259c640 1 -- 172.21.15.60:0/2301463700 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4032810 con 0x7fd6f415e660 2024-09-12T01:40:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.120+0000 7fd6f903c640 1 -- 172.21.15.60:0/2301463700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6f415e660 msgr2=0x7fd6f40cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.120+0000 7fd6f903c640 1 --2- 172.21.15.60:0/2301463700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6f415e660 0x7fd6f40cf730 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40097a0 tx=0x7fd6e402a180 comp rx=0 tx=0).stop 2024-09-12T01:40:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.120+0000 7fd6f903c640 1 -- 172.21.15.60:0/2301463700 shutdown_connections 2024-09-12T01:40:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.120+0000 7fd6f903c640 1 --2- 172.21.15.60:0/2301463700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6f40d1820 0x7fd6f40b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:43.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.120+0000 7fd6f903c640 1 --2- 172.21.15.60:0/2301463700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6f415e660 0x7fd6f40cf730 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:43.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.120+0000 7fd6f903c640 1 -- 172.21.15.60:0/2301463700 >> 172.21.15.60:0/2301463700 conn(0x7fd6f40b6410 msgr2=0x7fd6f40b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:43.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.120+0000 7fd6f903c640 1 -- 172.21.15.60:0/2301463700 shutdown_connections 2024-09-12T01:40:43.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.120+0000 7fd6f903c640 1 -- 172.21.15.60:0/2301463700 wait complete. 2024-09-12T01:40:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.122+0000 7fd6f903c640 1 Processor -- start 2024-09-12T01:40:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.122+0000 7fd6f903c640 1 -- start start 2024-09-12T01:40:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.122+0000 7fd6f903c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f40d1820 0x7fd6f414ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.122+0000 7fd6f903c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6f40d3310 0x7fd6f4153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.122+0000 7fd6f903c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6f415e660 0x7fd6f415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.122+0000 7fd6f903c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f40cfc70 con 0x7fd6f40d1820 2024-09-12T01:40:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.122+0000 7fd6f903c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f40d43f0 con 0x7fd6f415e660 2024-09-12T01:40:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.122+0000 7fd6f903c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f40b80b0 con 0x7fd6f40d3310 2024-09-12T01:40:43.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.122+0000 7fd6f2d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f40d1820 0x7fd6f414ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6f2d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f40d1820 0x7fd6f414ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57730/0 (socket says 172.21.15.60:57730) 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6f2d9d640 1 -- 172.21.15.60:0/2629794445 learned_addr learned my addr 172.21.15.60:0/2629794445 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6ebfff640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6f40d3310 0x7fd6f4153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6f359e640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6f415e660 0x7fd6f415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6f2d9d640 1 -- 172.21.15.60:0/2629794445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6f40d3310 msgr2=0x7fd6f4153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6f2d9d640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6f40d3310 0x7fd6f4153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6f2d9d640 1 -- 172.21.15.60:0/2629794445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6f415e660 msgr2=0x7fd6f415a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6f2d9d640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6f415e660 0x7fd6f415a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6f2d9d640 1 -- 172.21.15.60:0/2629794445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f4154500 con 0x7fd6f40d1820 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6f359e640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6f415e660 0x7fd6f415a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6f2d9d640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f40d1820 0x7fd6f414ced0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4035040 tx=0x7fd6e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6eb7fe640 1 -- 172.21.15.60:0/2629794445 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4041030 con 0x7fd6f40d1820 2024-09-12T01:40:43.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6eb7fe640 1 -- 172.21.15.60:0/2629794445 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e403d4e0 con 0x7fd6f40d1820 2024-09-12T01:40:43.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6f903c640 1 -- 172.21.15.60:0/2629794445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f41547e0 con 0x7fd6f40d1820 2024-09-12T01:40:43.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6eb7fe640 1 -- 172.21.15.60:0/2629794445 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e4037040 con 0x7fd6f40d1820 2024-09-12T01:40:43.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.123+0000 7fd6f903c640 1 -- 172.21.15.60:0/2629794445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f4154da0 con 0x7fd6f40d1820 2024-09-12T01:40:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.124+0000 7fd6f903c640 1 -- 172.21.15.60:0/2629794445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f40b7b70 con 0x7fd6f40d1820 2024-09-12T01:40:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.125+0000 7fd6eb7fe640 1 -- 172.21.15.60:0/2629794445 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd6e4044070 con 0x7fd6f40d1820 2024-09-12T01:40:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.125+0000 7fd6eb7fe640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd6d406be30 0x7fd6d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.126+0000 7fd6eb7fe640 1 -- 172.21.15.60:0/2629794445 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fd6e40ab3d0 con 0x7fd6f40d1820 2024-09-12T01:40:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.126+0000 7fd6ebfff640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd6d406be30 0x7fd6d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:43.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.126+0000 7fd6ebfff640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd6d406be30 0x7fd6d406e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4151ef0 tx=0x7fd6dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:43.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.130+0000 7fd6eb7fe640 1 -- 172.21.15.60:0/2629794445 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd6e4079d90 con 0x7fd6f40d1820 2024-09-12T01:40:43.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.341+0000 7fd6f903c640 1 -- 172.21.15.60:0/2629794445 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd6f406aea0 con 0x7fd6f40d1820 2024-09-12T01:40:43.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.341+0000 7fd6eb7fe640 1 -- 172.21.15.60:0/2629794445 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fd6e4079690 con 0x7fd6f40d1820 2024-09-12T01:40:43.341 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:40:43.341 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:40:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.343+0000 7fd6f903c640 1 -- 172.21.15.60:0/2629794445 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd6d406be30 msgr2=0x7fd6d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.343+0000 7fd6f903c640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd6d406be30 0x7fd6d406e2f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4151ef0 tx=0x7fd6dc009040 comp rx=0 tx=0).stop 2024-09-12T01:40:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.343+0000 7fd6f903c640 1 -- 172.21.15.60:0/2629794445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f40d1820 msgr2=0x7fd6f414ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.343+0000 7fd6f903c640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f40d1820 0x7fd6f414ced0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4035040 tx=0x7fd6e40046c0 comp rx=0 tx=0).stop 2024-09-12T01:40:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.343+0000 7fd6f903c640 1 -- 172.21.15.60:0/2629794445 shutdown_connections 2024-09-12T01:40:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.343+0000 7fd6f903c640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd6f415e660 0x7fd6f415a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.343+0000 7fd6f903c640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd6d406be30 0x7fd6d406e2f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.343+0000 7fd6f903c640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd6f40d3310 0x7fd6f4153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.343+0000 7fd6f903c640 1 --2- 172.21.15.60:0/2629794445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6f40d1820 0x7fd6f414ced0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.343+0000 7fd6f903c640 1 -- 172.21.15.60:0/2629794445 >> 172.21.15.60:0/2629794445 conn(0x7fd6f40b6410 msgr2=0x7fd6f40b85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.343+0000 7fd6f903c640 1 -- 172.21.15.60:0/2629794445 shutdown_connections 2024-09-12T01:40:43.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:43.343+0000 7fd6f903c640 1 -- 172.21.15.60:0/2629794445 wait complete. 2024-09-12T01:40:43.354 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:40:43.354 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:40:43.665 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:45.668 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:47.670 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:48.355 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:40:48.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.471+0000 7f1f5dc5e640 1 Processor -- start 2024-09-12T01:40:48.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.471+0000 7f1f5dc5e640 1 -- start start 2024-09-12T01:40:48.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.472+0000 7f1f5dc5e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f5815e560 0x7f1f5806e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:48.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.472+0000 7f1f5dc5e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f58072220 0x7f1f580ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:48.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.472+0000 7f1f5dc5e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f580b5220 con 0x7f1f58073130 2024-09-12T01:40:48.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.472+0000 7f1f5dc5e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f1f580b54c0 con 0x7f1f5815e560 2024-09-12T01:40:48.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.472+0000 7f1f5dc5e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1f580b57a0 con 0x7f1f58072220 2024-09-12T01:40:48.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.472+0000 7f1f577fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f5815e560 0x7f1f5806e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:48.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.472+0000 7f1f57fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1f58073130 0x7f1f580b6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45462/0 (socket says 172.21.15.60:45462) 2024-09-12T01:40:48.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.472+0000 7f1f57fff640 1 -- 172.21.15.60:0/1972453565 learned_addr learned my addr 172.21.15.60:0/1972453565 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:40:48.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.473+0000 7f1f56ffd640 1 --2- 172.21.15.60:0/1972453565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f58072220 0x7f1f580ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:48.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.473+0000 7f1f577fe640 1 -- 172.21.15.60:0/1972453565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f58072220 msgr2=0x7f1f580ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:48.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.473+0000 7f1f577fe640 1 --2- 172.21.15.60:0/1972453565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f58072220 0x7f1f580ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:48.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.473+0000 7f1f577fe640 1 -- 172.21.15.60:0/1972453565 >> v1:172.21.15.60:6789/0 conn(0x7f1f58073130 legacy=0x7f1f580b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:48.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.473+0000 7f1f567fc640 1 -- 172.21.15.60:0/1972453565 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2616889677 0 0) 0x7f1f580b5220 con 0x7f1f58073130 2024-09-12T01:40:48.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.473+0000 7f1f577fe640 1 -- 172.21.15.60:0/1972453565 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f580b5a80 con 0x7f1f5815e560 2024-09-12T01:40:48.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.473+0000 7f1f56ffd640 1 --2- 172.21.15.60:0/1972453565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f58072220 0x7f1f580ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:40:48.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.474+0000 7f1f577fe640 1 --2- 172.21.15.60:0/1972453565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5815e560 0x7f1f5806e780 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1f480097a0 tx=0x7f1f4802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d91e4e6346179 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:48.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.474+0000 7f1f567fc640 1 -- 172.21.15.60:0/1972453565 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48037070 con 0x7f1f5815e560 2024-09-12T01:40:48.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.474+0000 7f1f567fc640 1 -- 172.21.15.60:0/1972453565 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f48032440 con 0x7f1f5815e560 2024-09-12T01:40:48.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.474+0000 7f1f567fc640 1 -- 172.21.15.60:0/1972453565 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f48032810 con 0x7f1f5815e560 2024-09-12T01:40:48.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.474+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/1972453565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5815e560 msgr2=0x7f1f5806e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:48.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.474+0000 7f1f5dc5e640 1 --2- 172.21.15.60:0/1972453565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5815e560 0x7f1f5806e780 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1f480097a0 tx=0x7f1f4802a180 comp rx=0 tx=0).stop 2024-09-12T01:40:48.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.474+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/1972453565 shutdown_connections 2024-09-12T01:40:48.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.474+0000 7f1f5dc5e640 1 --2- 172.21.15.60:0/1972453565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f58072220 0x7f1f580ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:48.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.474+0000 7f1f5dc5e640 1 --2- 172.21.15.60:0/1972453565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5815e560 0x7f1f5806e780 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:48.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.474+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/1972453565 >> 172.21.15.60:0/1972453565 conn(0x7f1f5806bc10 msgr2=0x7f1f5806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:48.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.474+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/1972453565 shutdown_connections 2024-09-12T01:40:48.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.474+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/1972453565 wait complete. 2024-09-12T01:40:48.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.476+0000 7f1f5dc5e640 1 Processor -- start 2024-09-12T01:40:48.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.476+0000 7f1f5dc5e640 1 -- start start 2024-09-12T01:40:48.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f5dc5e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f58072220 0x7f1f581f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:48.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f5dc5e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f58073130 0x7f1f580c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f5dc5e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5815e560 0x7f1f5815fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f5dc5e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5815e940 con 0x7f1f5815e560 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f5dc5e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1f58072660 con 0x7f1f58073130 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f5dc5e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5815eac0 con 0x7f1f58072220 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5815e560 0x7f1f5815fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f57fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5815e560 0x7f1f5815fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:57748/0 (socket says 172.21.15.60:57748) 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f57fff640 1 -- 172.21.15.60:0/2640870061 learned_addr learned my addr 172.21.15.60:0/2640870061 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f577fe640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f58072220 0x7f1f581f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f56ffd640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f58073130 0x7f1f580c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f57fff640 1 -- 172.21.15.60:0/2640870061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f58072220 msgr2=0x7f1f581f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f57fff640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f58072220 0x7f1f581f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f57fff640 1 -- 172.21.15.60:0/2640870061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f58073130 msgr2=0x7f1f580c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f57fff640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f58073130 0x7f1f580c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:48.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f57fff640 1 -- 172.21.15.60:0/2640870061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f581f80d0 con 0x7f1f5815e560 2024-09-12T01:40:48.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f577fe640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f58072220 0x7f1f581f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:40:48.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.477+0000 7f1f57fff640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5815e560 0x7f1f5815fed0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000caf0 tx=0x7f1f5000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:48.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.478+0000 7f1f3ffff640 1 -- 172.21.15.60:0/2640870061 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5000aca0 con 0x7f1f5815e560 2024-09-12T01:40:48.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.478+0000 7f1f3ffff640 1 -- 172.21.15.60:0/2640870061 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5000ae40 con 0x7f1f5815e560 2024-09-12T01:40:48.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.478+0000 7f1f3ffff640 1 -- 172.21.15.60:0/2640870061 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50012620 con 0x7f1f5815e560 2024-09-12T01:40:48.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.478+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/2640870061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f580c9ea0 con 0x7f1f5815e560 2024-09-12T01:40:48.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.478+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/2640870061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f581f3fe0 con 0x7f1f5815e560 2024-09-12T01:40:48.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.479+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/2640870061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f5806e780 con 0x7f1f5815e560 2024-09-12T01:40:48.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.479+0000 7f1f3ffff640 1 -- 172.21.15.60:0/2640870061 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1f50012880 con 0x7f1f5815e560 2024-09-12T01:40:48.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.480+0000 7f1f3ffff640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1f4406be30 0x7f1f4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:48.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.480+0000 7f1f3ffff640 1 -- 172.21.15.60:0/2640870061 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f1f5008b4c0 con 0x7f1f5815e560 2024-09-12T01:40:48.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.480+0000 7f1f577fe640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1f4406be30 0x7f1f4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:48.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.480+0000 7f1f577fe640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1f4406be30 0x7f1f4406e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1f48034000 tx=0x7f1f4802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:48.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.484+0000 7f1f3ffff640 1 -- 172.21.15.60:0/2640870061 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1f50059e70 con 0x7f1f5815e560 2024-09-12T01:40:48.553 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:40:48.556 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:40:48.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.701+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/2640870061 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1f580c70a0 con 0x7f1f5815e560 2024-09-12T01:40:48.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.702+0000 7f1f3ffff640 1 -- 172.21.15.60:0/2640870061 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f1f50059770 con 0x7f1f5815e560 2024-09-12T01:40:48.701 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:40:48.702 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:40:48.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.704+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/2640870061 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1f4406be30 msgr2=0x7f1f4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:48.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.704+0000 7f1f5dc5e640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1f4406be30 0x7f1f4406e2f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1f48034000 tx=0x7f1f4802e000 comp rx=0 tx=0).stop 2024-09-12T01:40:48.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.704+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/2640870061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5815e560 msgr2=0x7f1f5815fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:48.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.704+0000 7f1f5dc5e640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5815e560 0x7f1f5815fed0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000caf0 tx=0x7f1f5000a060 comp rx=0 tx=0).stop 2024-09-12T01:40:48.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.704+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/2640870061 shutdown_connections 2024-09-12T01:40:48.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.704+0000 7f1f5dc5e640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f5815e560 0x7f1f5815fed0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:48.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.704+0000 7f1f5dc5e640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1f58073130 0x7f1f580c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:48.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.704+0000 7f1f5dc5e640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1f4406be30 0x7f1f4406e2f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:48.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.704+0000 7f1f5dc5e640 1 --2- 172.21.15.60:0/2640870061 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1f58072220 0x7f1f581f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:48.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.704+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/2640870061 >> 172.21.15.60:0/2640870061 conn(0x7f1f5806bc10 msgr2=0x7f1f58160c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:48.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.704+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/2640870061 shutdown_connections 2024-09-12T01:40:48.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:48.704+0000 7f1f5dc5e640 1 -- 172.21.15.60:0/2640870061 wait complete. 2024-09-12T01:40:48.715 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:40:48.715 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:40:49.672 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:51.674 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:53.676 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:53.715 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:40:53.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.831+0000 7f196afb9640 1 Processor -- start 2024-09-12T01:40:53.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.831+0000 7f196afb9640 1 -- start start 2024-09-12T01:40:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f196afb9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f196415c170 0x7f196415c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f196afb9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19640b64e0 0x7f19640cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f196afb9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19640b4cf0 con 0x7f19640cf6c0 2024-09-12T01:40:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f196afb9640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f196415ca90 con 0x7f196415c170 2024-09-12T01:40:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f196afb9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f19640b49c0 con 0x7f19640b64e0 2024-09-12T01:40:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f1968d55640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f196415c170 0x7f196415c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f195bfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f19640cf6c0 0x7f19640b5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36912/0 (socket says 172.21.15.60:36912) 2024-09-12T01:40:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f195bfff640 1 -- 172.21.15.60:0/2180261928 learned_addr learned my addr 172.21.15.60:0/2180261928 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:40:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f1969556640 1 --2- 172.21.15.60:0/2180261928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19640b64e0 0x7f19640cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f1968d55640 1 -- 172.21.15.60:0/2180261928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19640b64e0 msgr2=0x7f19640cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:53.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f1968d55640 1 --2- 172.21.15.60:0/2180261928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19640b64e0 0x7f19640cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:53.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f1968d55640 1 -- 172.21.15.60:0/2180261928 >> v1:172.21.15.60:6789/0 conn(0x7f19640cf6c0 legacy=0x7f19640b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:53.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f1968d55640 1 -- 172.21.15.60:0/2180261928 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19640b4fd0 con 0x7f196415c170 2024-09-12T01:40:53.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.832+0000 7f195b7fe640 1 -- 172.21.15.60:0/2180261928 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 924482587 0 0) 0x7f19640b4cf0 con 0x7f19640cf6c0 2024-09-12T01:40:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.833+0000 7f1968d55640 1 --2- 172.21.15.60:0/2180261928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196415c170 0x7f196415c550 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1960009dc0 tx=0x7f196002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb17da7f4a056c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.833+0000 7f195b7fe640 1 -- 172.21.15.60:0/2180261928 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196002ae60 con 0x7f196415c170 2024-09-12T01:40:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.833+0000 7f195b7fe640 1 -- 172.21.15.60:0/2180261928 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1960007740 con 0x7f196415c170 2024-09-12T01:40:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.833+0000 7f195b7fe640 1 -- 172.21.15.60:0/2180261928 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960007b10 con 0x7f196415c170 2024-09-12T01:40:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.834+0000 7f196afb9640 1 -- 172.21.15.60:0/2180261928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196415c170 msgr2=0x7f196415c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.834+0000 7f196afb9640 1 --2- 172.21.15.60:0/2180261928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196415c170 0x7f196415c550 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f1960009dc0 tx=0x7f196002a680 comp rx=0 tx=0).stop 2024-09-12T01:40:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.834+0000 7f196afb9640 1 -- 172.21.15.60:0/2180261928 shutdown_connections 2024-09-12T01:40:53.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.834+0000 7f196afb9640 1 --2- 172.21.15.60:0/2180261928 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19640b64e0 0x7f19640cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.834+0000 7f196afb9640 1 --2- 172.21.15.60:0/2180261928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196415c170 0x7f196415c550 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.834+0000 7f196afb9640 1 -- 172.21.15.60:0/2180261928 >> 172.21.15.60:0/2180261928 conn(0x7f196406bc10 msgr2=0x7f196406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.834+0000 7f196afb9640 1 -- 172.21.15.60:0/2180261928 shutdown_connections 2024-09-12T01:40:53.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.834+0000 7f196afb9640 1 -- 172.21.15.60:0/2180261928 wait complete. 2024-09-12T01:40:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.835+0000 7f196afb9640 1 Processor -- start 2024-09-12T01:40:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.835+0000 7f196afb9640 1 -- start start 2024-09-12T01:40:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.836+0000 7f196afb9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19640b64e0 0x7f19640afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.836+0000 7f196afb9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19640cf6c0 0x7f19640cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.836+0000 7f196afb9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196415c170 0x7f19640cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.836+0000 7f196afb9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f19640b5870 con 0x7f196415c170 2024-09-12T01:40:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.836+0000 7f196afb9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19640b5590 con 0x7f19640b64e0 2024-09-12T01:40:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.836+0000 7f196afb9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f19640b5b50 con 0x7f19640cf6c0 2024-09-12T01:40:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.836+0000 7f1969556640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196415c170 0x7f19640cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:53.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.836+0000 7f1969556640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196415c170 0x7f19640cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37306/0 (socket says 172.21.15.60:37306) 2024-09-12T01:40:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.836+0000 7f1969556640 1 -- 172.21.15.60:0/2238477700 learned_addr learned my addr 172.21.15.60:0/2238477700 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f1968d55640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19640b64e0 0x7f19640afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f1969556640 1 -- 172.21.15.60:0/2238477700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19640cf6c0 msgr2=0x7f19640cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f195bfff640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19640cf6c0 0x7f19640cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f1969556640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19640cf6c0 0x7f19640cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f1969556640 1 -- 172.21.15.60:0/2238477700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19640b64e0 msgr2=0x7f19640afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f1969556640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19640b64e0 0x7f19640afab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f1969556640 1 -- 172.21.15.60:0/2238477700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19641525b0 con 0x7f196415c170 2024-09-12T01:40:53.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f1968d55640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19640b64e0 0x7f19640afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:40:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f1969556640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196415c170 0x7f19640cd160 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f195c00d580 tx=0x7f195c00da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f19597fa640 1 -- 172.21.15.60:0/2238477700 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c0125f0 con 0x7f196415c170 2024-09-12T01:40:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f19597fa640 1 -- 172.21.15.60:0/2238477700 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f195c019070 con 0x7f196415c170 2024-09-12T01:40:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f196afb9640 1 -- 172.21.15.60:0/2238477700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19640aea10 con 0x7f196415c170 2024-09-12T01:40:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f19597fa640 1 -- 172.21.15.60:0/2238477700 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c0129f0 con 0x7f196415c170 2024-09-12T01:40:53.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.837+0000 7f196afb9640 1 -- 172.21.15.60:0/2238477700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19640aefd0 con 0x7f196415c170 2024-09-12T01:40:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.838+0000 7f196afb9640 1 -- 172.21.15.60:0/2238477700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19640cfb30 con 0x7f196415c170 2024-09-12T01:40:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.839+0000 7f19597fa640 1 -- 172.21.15.60:0/2238477700 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f195c012b90 con 0x7f196415c170 2024-09-12T01:40:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.839+0000 7f19597fa640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f195006be30 0x7f195006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.839+0000 7f19597fa640 1 -- 172.21.15.60:0/2238477700 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f195c08b200 con 0x7f196415c170 2024-09-12T01:40:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.839+0000 7f1968d55640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f195006be30 0x7f195006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:53.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.840+0000 7f1968d55640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f195006be30 0x7f195006e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1960034000 tx=0x7f1960033040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:53.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:53.844+0000 7f19597fa640 1 -- 172.21.15.60:0/2238477700 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f195c059bc0 con 0x7f196415c170 2024-09-12T01:40:54.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.056+0000 7f196afb9640 1 -- 172.21.15.60:0/2238477700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f19640b32e0 con 0x7f196415c170 2024-09-12T01:40:54.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.056+0000 7f19597fa640 1 -- 172.21.15.60:0/2238477700 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f195c0594c0 con 0x7f196415c170 2024-09-12T01:40:54.056 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:40:54.056 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:40:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.058+0000 7f196afb9640 1 -- 172.21.15.60:0/2238477700 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f195006be30 msgr2=0x7f195006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.058+0000 7f196afb9640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f195006be30 0x7f195006e2f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1960034000 tx=0x7f1960033040 comp rx=0 tx=0).stop 2024-09-12T01:40:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.058+0000 7f196afb9640 1 -- 172.21.15.60:0/2238477700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196415c170 msgr2=0x7f19640cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.058+0000 7f196afb9640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196415c170 0x7f19640cd160 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f195c00d580 tx=0x7f195c00da40 comp rx=0 tx=0).stop 2024-09-12T01:40:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.058+0000 7f196afb9640 1 -- 172.21.15.60:0/2238477700 shutdown_connections 2024-09-12T01:40:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.058+0000 7f196afb9640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f196415c170 0x7f19640cd160 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.058+0000 7f196afb9640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f195006be30 0x7f195006e2f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.058+0000 7f196afb9640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19640cf6c0 0x7f19640cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.058+0000 7f196afb9640 1 --2- 172.21.15.60:0/2238477700 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19640b64e0 0x7f19640afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.058+0000 7f196afb9640 1 -- 172.21.15.60:0/2238477700 >> 172.21.15.60:0/2238477700 conn(0x7f196406bc10 msgr2=0x7f196415f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:54.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.058+0000 7f196afb9640 1 -- 172.21.15.60:0/2238477700 shutdown_connections 2024-09-12T01:40:54.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:54.058+0000 7f196afb9640 1 -- 172.21.15.60:0/2238477700 wait complete. 2024-09-12T01:40:54.069 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:40:54.069 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:40:55.678 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:57.680 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:40:59.070 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:40:59.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.185+0000 7f5ddc01e640 1 Processor -- start 2024-09-12T01:40:59.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.186+0000 7f5ddc01e640 1 -- start start 2024-09-12T01:40:59.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.186+0000 7f5ddc01e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dd40ceb10 0x7f5dd415ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:59.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.186+0000 7f5ddc01e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd406f9e0 con 0x7f5dd406c320 2024-09-12T01:40:59.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.186+0000 7f5ddc01e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd406fcc0 con 0x7f5dd40b0ed0 2024-09-12T01:40:59.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.186+0000 7f5ddc01e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd4153910 con 0x7f5dd40ceb10 2024-09-12T01:40:59.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd95b9640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5dd406c320 0x7f5dd40ce400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36922/0 (socket says 172.21.15.60:36922) 2024-09-12T01:40:59.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd95b9640 1 -- 172.21.15.60:0/2546352170 learned_addr learned my addr 172.21.15.60:0/2546352170 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dda5bb640 1 --2- 172.21.15.60:0/2546352170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dd40ceb10 0x7f5dd415ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1463627996 0 0) 0x7f5dd406f9e0 con 0x7f5dd406c320 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dc0003520 con 0x7f5dd406c320 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3977239029 0 0) 0x7f5dd406fcc0 con 0x7f5dd40b0ed0 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dd406f9e0 con 0x7f5dd40b0ed0 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3592903638 0 0) 0x7f5dc0003520 con 0x7f5dd406c320 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dd40ceb10 msgr2=0x7f5dd415ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 --2- 172.21.15.60:0/2546352170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dd40ceb10 0x7f5dd415ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 >> v1:172.21.15.105:6789/0 conn(0x7f5dd40b0ed0 legacy=0x7f5dd406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd406ffa0 con 0x7f5dd406c320 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f5dc4001670 con 0x7f5dd406c320 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 >> v1:172.21.15.60:6789/0 conn(0x7f5dd406c320 legacy=0x7f5dd40ce400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:59.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 --2- 172.21.15.60:0/2546352170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dc0003b70 0x7f5dc0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 --2- 172.21.15.60:0/2546352170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dd40ceb10 0x7f5dc0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 --2- 172.21.15.60:0/2546352170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc0004d40 0x7f5dc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd4153910 con 0x7f5dc0004d40 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc000bac0 con 0x7f5dc0003b70 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.187+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc000bcc0 con 0x7f5dd40ceb10 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.188+0000 7f5dda5bb640 1 --2- 172.21.15.60:0/2546352170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc0004d40 0x7f5dc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.188+0000 7f5dd9dba640 1 --2- 172.21.15.60:0/2546352170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dc0003b70 0x7f5dc0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.188+0000 7f5dd95b9640 1 --2- 172.21.15.60:0/2546352170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dd40ceb10 0x7f5dc0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.188+0000 7f5dda5bb640 1 -- 172.21.15.60:0/2546352170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dd40ceb10 msgr2=0x7f5dc0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.188+0000 7f5dda5bb640 1 --2- 172.21.15.60:0/2546352170 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dd40ceb10 0x7f5dc0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.188+0000 7f5dda5bb640 1 -- 172.21.15.60:0/2546352170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dc0003b70 msgr2=0x7f5dc0003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.188+0000 7f5dda5bb640 1 --2- 172.21.15.60:0/2546352170 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dc0003b70 0x7f5dc0003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.188+0000 7f5dda5bb640 1 -- 172.21.15.60:0/2546352170 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc0003520 con 0x7f5dc0004d40 2024-09-12T01:40:59.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.189+0000 7f5dda5bb640 1 --2- 172.21.15.60:0/2546352170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc0004d40 0x7f5dc00051c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009f70 tx=0x7f5dc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174209b5840f0879 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:59.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.189+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc009bf0 con 0x7f5dc0004d40 2024-09-12T01:40:59.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.189+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dcc036070 con 0x7f5dc0004d40 2024-09-12T01:40:59.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.189+0000 7f5dd8db8640 1 -- 172.21.15.60:0/2546352170 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc030830 con 0x7f5dc0004d40 2024-09-12T01:40:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.189+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2546352170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc0004d40 msgr2=0x7f5dc00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.189+0000 7f5ddc01e640 1 --2- 172.21.15.60:0/2546352170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc0004d40 0x7f5dc00051c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009f70 tx=0x7f5dc0005830 comp rx=0 tx=0).stop 2024-09-12T01:40:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.189+0000 7f5dda5bb640 1 -- 172.21.15.60:0/2546352170 reap_dead start 2024-09-12T01:40:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.189+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2546352170 shutdown_connections 2024-09-12T01:40:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.189+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2546352170 >> 172.21.15.60:0/2546352170 conn(0x7f5dd406e170 msgr2=0x7f5dd406e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.189+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2546352170 shutdown_connections 2024-09-12T01:40:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.189+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2546352170 wait complete. 2024-09-12T01:40:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.191+0000 7f5ddc01e640 1 Processor -- start 2024-09-12T01:40:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.191+0000 7f5ddc01e640 1 -- start start 2024-09-12T01:40:59.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.191+0000 7f5ddc01e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dc0004d40 0x7f5dd40b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.191+0000 7f5ddc01e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dd41f4e80 0x7f5dd40aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.191+0000 7f5ddc01e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dd40aa9c0 0x7f5dd41526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.191+0000 7f5ddc01e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd415c970 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.191+0000 7f5ddc01e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd40cf050 con 0x7f5dd41f4e80 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.191+0000 7f5ddc01e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd415caf0 con 0x7f5dc0004d40 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dda5bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dd40aa9c0 0x7f5dd41526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dda5bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dd40aa9c0 0x7f5dd41526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37318/0 (socket says 172.21.15.60:37318) 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dda5bb640 1 -- 172.21.15.60:0/2746242466 learned_addr learned my addr 172.21.15.60:0/2746242466 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dd95b9640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dd41f4e80 0x7f5dd40aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dd9dba640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dc0004d40 0x7f5dd40b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dda5bb640 1 -- 172.21.15.60:0/2746242466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dc0004d40 msgr2=0x7f5dd40b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dda5bb640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dc0004d40 0x7f5dd40b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dda5bb640 1 -- 172.21.15.60:0/2746242466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dd41f4e80 msgr2=0x7f5dd40aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:59.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dda5bb640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dd41f4e80 0x7f5dd40aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dda5bb640 1 -- 172.21.15.60:0/2746242466 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd40b4fd0 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dda5bb640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dd40aa9c0 0x7f5dd41526e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc02ae90 tx=0x7f5dcc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:59.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dca7fc640 1 -- 172.21.15.60:0/2746242466 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc009bf0 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dca7fc640 1 -- 172.21.15.60:0/2746242466 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dcc045430 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2746242466 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd40b52b0 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.192+0000 7f5dca7fc640 1 -- 172.21.15.60:0/2746242466 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc045820 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.193+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2746242466 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd40ac330 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.193+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2746242466 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd40ac530 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.194+0000 7f5dca7fc640 1 -- 172.21.15.60:0/2746242466 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5dcc005d10 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.194+0000 7f5dca7fc640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5db806be30 0x7f5db806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:40:59.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.195+0000 7f5dca7fc640 1 -- 172.21.15.60:0/2746242466 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f5dcc0abbf0 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.195+0000 7f5dd9dba640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5db806be30 0x7f5db806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:40:59.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.195+0000 7f5dd9dba640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5db806be30 0x7f5db806e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00018d0 tx=0x7f5dd0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:40:59.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.199+0000 7f5dca7fc640 1 -- 172.21.15.60:0/2746242466 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5dd40ac530 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.410+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2746242466 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5dd40ce400 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.410+0000 7f5dca7fc640 1 -- 172.21.15.60:0/2746242466 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f5dcc079f50 con 0x7f5dd40aa9c0 2024-09-12T01:40:59.410 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:40:59.410 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:40:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.412+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2746242466 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5db806be30 msgr2=0x7f5db806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.412+0000 7f5ddc01e640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5db806be30 0x7f5db806e2f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00018d0 tx=0x7f5dd0009040 comp rx=0 tx=0).stop 2024-09-12T01:40:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.412+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2746242466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dd40aa9c0 msgr2=0x7f5dd41526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:40:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.412+0000 7f5ddc01e640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dd40aa9c0 0x7f5dd41526e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc02ae90 tx=0x7f5dcc009750 comp rx=0 tx=0).stop 2024-09-12T01:40:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.412+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2746242466 shutdown_connections 2024-09-12T01:40:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.412+0000 7f5ddc01e640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dd40aa9c0 0x7f5dd41526e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.412+0000 7f5ddc01e640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5dd41f4e80 0x7f5dd40aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.412+0000 7f5ddc01e640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5db806be30 0x7f5db806e2f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.412+0000 7f5ddc01e640 1 --2- 172.21.15.60:0/2746242466 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5dc0004d40 0x7f5dd40b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:40:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.412+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2746242466 >> 172.21.15.60:0/2746242466 conn(0x7f5dd406e170 msgr2=0x7f5dd406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:40:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.412+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2746242466 shutdown_connections 2024-09-12T01:40:59.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:40:59.412+0000 7f5ddc01e640 1 -- 172.21.15.60:0/2746242466 wait complete. 2024-09-12T01:40:59.422 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:40:59.422 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:40:59.682 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:01.685 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:03.687 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:04.424 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:41:04.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.538+0000 7f2f6f32c640 1 Processor -- start 2024-09-12T01:41:04.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.539+0000 7f2f6f32c640 1 -- start start 2024-09-12T01:41:04.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.539+0000 7f2f6f32c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f6815e660 0x7f2f680cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.539+0000 7f2f6f32c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f680d3310 0x7f2f680d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.540+0000 7f2f6f32c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f6815ea40 con 0x7f2f680d1650 2024-09-12T01:41:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.540+0000 7f2f6f32c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2f680d3870 con 0x7f2f680d3310 2024-09-12T01:41:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.540+0000 7f2f6f32c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2f680d3b50 con 0x7f2f6815e660 2024-09-12T01:41:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.540+0000 7f2f6c8c7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f680d3310 0x7f2f680d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.540+0000 7f2f6c8c7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f680d3310 0x7f2f680d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59662/0 (socket says 172.21.15.60:59662) 2024-09-12T01:41:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.540+0000 7f2f6c8c7640 1 -- 172.21.15.60:0/190662577 learned_addr learned my addr 172.21.15.60:0/190662577 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.540+0000 7f2f6d0c8640 1 --2- 172.21.15.60:0/190662577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f6815e660 0x7f2f680cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.540+0000 7f2f6c8c7640 1 -- 172.21.15.60:0/190662577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f6815e660 msgr2=0x7f2f680cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.540+0000 7f2f6c8c7640 1 --2- 172.21.15.60:0/190662577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f6815e660 0x7f2f680cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:04.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.540+0000 7f2f6c8c7640 1 -- 172.21.15.60:0/190662577 >> v1:172.21.15.105:6789/0 conn(0x7f2f680d1650 legacy=0x7f2f6806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:04.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.540+0000 7f2f6c8c7640 1 -- 172.21.15.60:0/190662577 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f680d3e30 con 0x7f2f680d3310 2024-09-12T01:41:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.541+0000 7f2f6c8c7640 1 --2- 172.21.15.60:0/190662577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f680d3310 0x7f2f680d1110 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009870 tx=0x7f2f5802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adef119f9d2aeca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.541+0000 7f2f5ffff640 1 -- 172.21.15.60:0/190662577 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f58037070 con 0x7f2f680d3310 2024-09-12T01:41:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.541+0000 7f2f5ffff640 1 -- 172.21.15.60:0/190662577 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f58032440 con 0x7f2f680d3310 2024-09-12T01:41:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.541+0000 7f2f5ffff640 1 -- 172.21.15.60:0/190662577 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f58032810 con 0x7f2f680d3310 2024-09-12T01:41:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.541+0000 7f2f6f32c640 1 -- 172.21.15.60:0/190662577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f680d3310 msgr2=0x7f2f680d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.541+0000 7f2f6f32c640 1 --2- 172.21.15.60:0/190662577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f680d3310 0x7f2f680d1110 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2f58009870 tx=0x7f2f5802a270 comp rx=0 tx=0).stop 2024-09-12T01:41:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.542+0000 7f2f6f32c640 1 -- 172.21.15.60:0/190662577 shutdown_connections 2024-09-12T01:41:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.542+0000 7f2f6f32c640 1 --2- 172.21.15.60:0/190662577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f680d3310 0x7f2f680d1110 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.542+0000 7f2f6f32c640 1 --2- 172.21.15.60:0/190662577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f6815e660 0x7f2f680cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:04.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.542+0000 7f2f6f32c640 1 -- 172.21.15.60:0/190662577 >> 172.21.15.60:0/190662577 conn(0x7f2f680b6410 msgr2=0x7f2f680b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.542+0000 7f2f6f32c640 1 -- 172.21.15.60:0/190662577 shutdown_connections 2024-09-12T01:41:04.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.542+0000 7f2f6f32c640 1 -- 172.21.15.60:0/190662577 wait complete. 2024-09-12T01:41:04.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.543+0000 7f2f6f32c640 1 Processor -- start 2024-09-12T01:41:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.543+0000 7f2f6f32c640 1 -- start start 2024-09-12T01:41:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6f32c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f680d1650 0x7f2f681f7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6f32c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f680d3310 0x7f2f681f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6f32c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6815e660 0x7f2f681f8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:04.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6f32c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2f680cfc70 con 0x7f2f680d1650 2024-09-12T01:41:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6f32c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2f680d43f0 con 0x7f2f6815e660 2024-09-12T01:41:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6f32c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2f680b8b80 con 0x7f2f680d3310 2024-09-12T01:41:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6d0c8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f680d1650 0x7f2f681f7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6d0c8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f680d1650 0x7f2f681f7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59664/0 (socket says 172.21.15.60:59664) 2024-09-12T01:41:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6d0c8640 1 -- 172.21.15.60:0/887790548 learned_addr learned my addr 172.21.15.60:0/887790548 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:04.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6c8c7640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f680d3310 0x7f2f681f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6d8c9640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6815e660 0x7f2f681f8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6d0c8640 1 -- 172.21.15.60:0/887790548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f680d3310 msgr2=0x7f2f681f8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6d0c8640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f680d3310 0x7f2f681f8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6d0c8640 1 -- 172.21.15.60:0/887790548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6815e660 msgr2=0x7f2f681f8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6d0c8640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6815e660 0x7f2f681f8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6d0c8640 1 -- 172.21.15.60:0/887790548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f68152fe0 con 0x7f2f680d1650 2024-09-12T01:41:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6d8c9640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6815e660 0x7f2f681f8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:41:04.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f6d0c8640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f680d1650 0x7f2f681f7870 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400e870 tx=0x7f2f6400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f5dffb640 1 -- 172.21.15.60:0/887790548 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64017070 con 0x7f2f680d1650 2024-09-12T01:41:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.544+0000 7f2f5dffb640 1 -- 172.21.15.60:0/887790548 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f6400c8e0 con 0x7f2f680d1650 2024-09-12T01:41:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.545+0000 7f2f5dffb640 1 -- 172.21.15.60:0/887790548 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400ccd0 con 0x7f2f680d1650 2024-09-12T01:41:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.545+0000 7f2f6f32c640 1 -- 172.21.15.60:0/887790548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f681f7db0 con 0x7f2f680d1650 2024-09-12T01:41:04.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.545+0000 7f2f6f32c640 1 -- 172.21.15.60:0/887790548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f68160350 con 0x7f2f680d1650 2024-09-12T01:41:04.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.546+0000 7f2f6f32c640 1 -- 172.21.15.60:0/887790548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f6815fe00 con 0x7f2f680d1650 2024-09-12T01:41:04.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.546+0000 7f2f5dffb640 1 -- 172.21.15.60:0/887790548 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f6401a070 con 0x7f2f680d1650 2024-09-12T01:41:04.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.547+0000 7f2f5dffb640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f4c06be30 0x7f2f4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:04.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.547+0000 7f2f5dffb640 1 -- 172.21.15.60:0/887790548 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f2f6408b060 con 0x7f2f680d1650 2024-09-12T01:41:04.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.547+0000 7f2f6c8c7640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f4c06be30 0x7f2f4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:04.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.547+0000 7f2f6c8c7640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f4c06be30 0x7f2f4c06e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2f58034000 tx=0x7f2f5802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:04.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.551+0000 7f2f5dffb640 1 -- 172.21.15.60:0/887790548 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f64059a00 con 0x7f2f680d1650 2024-09-12T01:41:04.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.766+0000 7f2f6f32c640 1 -- 172.21.15.60:0/887790548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2f680d1110 con 0x7f2f680d1650 2024-09-12T01:41:04.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.766+0000 7f2f5dffb640 1 -- 172.21.15.60:0/887790548 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f2f64059300 con 0x7f2f680d1650 2024-09-12T01:41:04.766 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:04.766 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:41:04.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.768+0000 7f2f6f32c640 1 -- 172.21.15.60:0/887790548 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f4c06be30 msgr2=0x7f2f4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:04.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.768+0000 7f2f6f32c640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f4c06be30 0x7f2f4c06e2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2f58034000 tx=0x7f2f5802e000 comp rx=0 tx=0).stop 2024-09-12T01:41:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.768+0000 7f2f6f32c640 1 -- 172.21.15.60:0/887790548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f680d1650 msgr2=0x7f2f681f7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.768+0000 7f2f6f32c640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f680d1650 0x7f2f681f7870 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400e870 tx=0x7f2f6400ed30 comp rx=0 tx=0).stop 2024-09-12T01:41:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.768+0000 7f2f6f32c640 1 -- 172.21.15.60:0/887790548 shutdown_connections 2024-09-12T01:41:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.768+0000 7f2f6f32c640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f6815e660 0x7f2f681f8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.768+0000 7f2f6f32c640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f4c06be30 0x7f2f4c06e2f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.768+0000 7f2f6f32c640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f680d3310 0x7f2f681f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.768+0000 7f2f6f32c640 1 --2- 172.21.15.60:0/887790548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f680d1650 0x7f2f681f7870 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.768+0000 7f2f6f32c640 1 -- 172.21.15.60:0/887790548 >> 172.21.15.60:0/887790548 conn(0x7f2f680b6410 msgr2=0x7f2f680cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.769+0000 7f2f6f32c640 1 -- 172.21.15.60:0/887790548 shutdown_connections 2024-09-12T01:41:04.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:04.769+0000 7f2f6f32c640 1 -- 172.21.15.60:0/887790548 wait complete. 2024-09-12T01:41:04.779 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:41:04.779 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:41:05.689 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:07.691 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:09.780 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:41:09.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.896+0000 7f80854c9640 1 Processor -- start 2024-09-12T01:41:09.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.896+0000 7f80854c9640 1 -- start start 2024-09-12T01:41:09.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.897+0000 7f80854c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80800b63d0 0x7f80800d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:09.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.897+0000 7f80854c9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f80800cf6b0 0x7f80800b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:09.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.897+0000 7f80854c9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80800cfc20 con 0x7f80800d1c80 2024-09-12T01:41:09.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.897+0000 7f80854c9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f80800d2ed0 con 0x7f80800cf6b0 2024-09-12T01:41:09.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.897+0000 7f80854c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f80800d31b0 con 0x7f80800b63d0 2024-09-12T01:41:09.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.897+0000 7f807e7fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f80800cf6b0 0x7f80800b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:09.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.897+0000 7f807effd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80800b63d0 0x7f80800d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:09.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.898+0000 7f807e7fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f80800cf6b0 0x7f80800b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:58034/0 (socket says 172.21.15.60:58034) 2024-09-12T01:41:09.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.898+0000 7f807e7fc640 1 -- 172.21.15.60:0/2574603805 learned_addr learned my addr 172.21.15.60:0/2574603805 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.898+0000 7f807f7fe640 1 --1- 172.21.15.60:0/2574603805 >> v1:172.21.15.105:6789/0 conn(0x7f80800d1c80 0x7f80800b7dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:59518/0 (socket says 172.21.15.60:59518) 2024-09-12T01:41:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.898+0000 7f807effd640 1 -- 172.21.15.60:0/2574603805 >> v2:172.21.15.105:3300/0 conn(0x7f80800cf6b0 msgr2=0x7f80800b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.898+0000 7f807effd640 1 --2- 172.21.15.60:0/2574603805 >> v2:172.21.15.105:3300/0 conn(0x7f80800cf6b0 0x7f80800b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.898+0000 7f807effd640 1 -- 172.21.15.60:0/2574603805 >> v1:172.21.15.105:6789/0 conn(0x7f80800d1c80 legacy=0x7f80800b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.898+0000 7f807dffb640 1 -- 172.21.15.60:0/2574603805 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1230284749 0 0) 0x7f80800cfc20 con 0x7f80800d1c80 2024-09-12T01:41:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.898+0000 7f807effd640 1 -- 172.21.15.60:0/2574603805 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80800d3490 con 0x7f80800b63d0 2024-09-12T01:41:09.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.898+0000 7f807e7fc640 1 --2- 172.21.15.60:0/2574603805 >> v2:172.21.15.105:3300/0 conn(0x7f80800cf6b0 0x7f80800b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:41:09.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.899+0000 7f807effd640 1 --2- 172.21.15.60:0/2574603805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80800b63d0 0x7f80800d39b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f80700097a0 tx=0x7f807002a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d7a7ec6344aa5f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:09.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.899+0000 7f807dffb640 1 -- 172.21.15.60:0/2574603805 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070037070 con 0x7f80800b63d0 2024-09-12T01:41:09.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.899+0000 7f807dffb640 1 -- 172.21.15.60:0/2574603805 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807002adb0 con 0x7f80800b63d0 2024-09-12T01:41:09.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.899+0000 7f807dffb640 1 -- 172.21.15.60:0/2574603805 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8070032660 con 0x7f80800b63d0 2024-09-12T01:41:09.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.900+0000 7f80854c9640 1 -- 172.21.15.60:0/2574603805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80800b63d0 msgr2=0x7f80800d39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:09.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.900+0000 7f80854c9640 1 --2- 172.21.15.60:0/2574603805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80800b63d0 0x7f80800d39b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f80700097a0 tx=0x7f807002a060 comp rx=0 tx=0).stop 2024-09-12T01:41:09.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.900+0000 7f80854c9640 1 -- 172.21.15.60:0/2574603805 shutdown_connections 2024-09-12T01:41:09.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.900+0000 7f80854c9640 1 --2- 172.21.15.60:0/2574603805 >> v2:172.21.15.105:3300/0 conn(0x7f80800cf6b0 0x7f80800b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:09.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.900+0000 7f80854c9640 1 --2- 172.21.15.60:0/2574603805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80800b63d0 0x7f80800d39b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:09.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.900+0000 7f80854c9640 1 -- 172.21.15.60:0/2574603805 >> 172.21.15.60:0/2574603805 conn(0x7f80800d1160 msgr2=0x7f80800d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:09.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.900+0000 7f80854c9640 1 -- 172.21.15.60:0/2574603805 shutdown_connections 2024-09-12T01:41:09.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.900+0000 7f80854c9640 1 -- 172.21.15.60:0/2574603805 wait complete. 2024-09-12T01:41:09.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.901+0000 7f80854c9640 1 Processor -- start 2024-09-12T01:41:09.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.901+0000 7f80854c9640 1 -- start start 2024-09-12T01:41:09.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f80854c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80800b63d0 0x7f8080160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:09.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f80854c9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80800cf6b0 0x7f80801e8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f80854c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80800d1c80 0x7f80800cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f80854c9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f80800d4070 con 0x7f80800d1c80 2024-09-12T01:41:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f80854c9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f80800d3ef0 con 0x7f80800cf6b0 2024-09-12T01:41:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f80854c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f80800b67b0 con 0x7f80800b63d0 2024-09-12T01:41:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f807f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80800d1c80 0x7f80800cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f807f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80800d1c80 0x7f80800cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:59676/0 (socket says 172.21.15.60:59676) 2024-09-12T01:41:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f807f7fe640 1 -- 172.21.15.60:0/2776775502 learned_addr learned my addr 172.21.15.60:0/2776775502 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f807effd640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80800b63d0 0x7f8080160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f807e7fc640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80800cf6b0 0x7f80801e8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f807f7fe640 1 -- 172.21.15.60:0/2776775502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80800b63d0 msgr2=0x7f8080160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f807f7fe640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80800b63d0 0x7f8080160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:09.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f807f7fe640 1 -- 172.21.15.60:0/2776775502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80800cf6b0 msgr2=0x7f80801e8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:09.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f807f7fe640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80800cf6b0 0x7f80801e8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:09.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f807f7fe640 1 -- 172.21.15.60:0/2776775502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80801e8c40 con 0x7f80800d1c80 2024-09-12T01:41:09.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.902+0000 7f807effd640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80800b63d0 0x7f8080160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:41:09.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.903+0000 7f807f7fe640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80800d1c80 0x7f80800cdec0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f807800c700 tx=0x7f807800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:09.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.903+0000 7f80777fe640 1 -- 172.21.15.60:0/2776775502 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8078018070 con 0x7f80800d1c80 2024-09-12T01:41:09.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.903+0000 7f80777fe640 1 -- 172.21.15.60:0/2776775502 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f807800ce10 con 0x7f80800d1c80 2024-09-12T01:41:09.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.903+0000 7f80854c9640 1 -- 172.21.15.60:0/2776775502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80801e8f20 con 0x7f80800d1c80 2024-09-12T01:41:09.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.903+0000 7f80777fe640 1 -- 172.21.15.60:0/2776775502 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807800a820 con 0x7f80800d1c80 2024-09-12T01:41:09.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.903+0000 7f80854c9640 1 -- 172.21.15.60:0/2776775502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80801e97c0 con 0x7f80800d1c80 2024-09-12T01:41:09.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.904+0000 7f80854c9640 1 -- 172.21.15.60:0/2776775502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80801e99c0 con 0x7f80800d1c80 2024-09-12T01:41:09.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.905+0000 7f80777fe640 1 -- 172.21.15.60:0/2776775502 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f807801b070 con 0x7f80800d1c80 2024-09-12T01:41:09.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.905+0000 7f80777fe640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f806006be30 0x7f806006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:09.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.905+0000 7f80777fe640 1 -- 172.21.15.60:0/2776775502 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f807808a310 con 0x7f80800d1c80 2024-09-12T01:41:09.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.905+0000 7f807effd640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f806006be30 0x7f806006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:09.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.906+0000 7f807effd640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f806006be30 0x7f806006e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8070034000 tx=0x7f807002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:09.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:09.910+0000 7f80777fe640 1 -- 172.21.15.60:0/2776775502 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8078058670 con 0x7f80800d1c80 2024-09-12T01:41:10.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.119+0000 7f80854c9640 1 -- 172.21.15.60:0/2776775502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f80800d39b0 con 0x7f80800d1c80 2024-09-12T01:41:10.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.119+0000 7f80777fe640 1 -- 172.21.15.60:0/2776775502 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f807805c970 con 0x7f80800d1c80 2024-09-12T01:41:10.119 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:10.119 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:41:10.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.122+0000 7f80854c9640 1 -- 172.21.15.60:0/2776775502 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f806006be30 msgr2=0x7f806006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:10.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.122+0000 7f80854c9640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f806006be30 0x7f806006e2f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8070034000 tx=0x7f807002e000 comp rx=0 tx=0).stop 2024-09-12T01:41:10.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.122+0000 7f80854c9640 1 -- 172.21.15.60:0/2776775502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80800d1c80 msgr2=0x7f80800cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:10.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.122+0000 7f80854c9640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80800d1c80 0x7f80800cdec0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f807800c700 tx=0x7f807800cbc0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.122+0000 7f80854c9640 1 -- 172.21.15.60:0/2776775502 shutdown_connections 2024-09-12T01:41:10.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.122+0000 7f80854c9640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f80800d1c80 0x7f80800cdec0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.122+0000 7f80854c9640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f80800cf6b0 0x7f80801e8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.122+0000 7f80854c9640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f806006be30 0x7f806006e2f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.122+0000 7f80854c9640 1 --2- 172.21.15.60:0/2776775502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f80800b63d0 0x7f8080160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:10.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.122+0000 7f80854c9640 1 -- 172.21.15.60:0/2776775502 >> 172.21.15.60:0/2776775502 conn(0x7f80800d1160 msgr2=0x7f80800b43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:10.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.122+0000 7f80854c9640 1 -- 172.21.15.60:0/2776775502 shutdown_connections 2024-09-12T01:41:10.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:10.122+0000 7f80854c9640 1 -- 172.21.15.60:0/2776775502 wait complete. 2024-09-12T01:41:10.132 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:41:10.132 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:41:11.695 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:13.697 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:15.134 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:41:15.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.248+0000 7fc05e49b640 1 Processor -- start 2024-09-12T01:41:15.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.248+0000 7fc05e49b640 1 -- start start 2024-09-12T01:41:15.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.249+0000 7fc05e49b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc0580b63d0 0x7fc0580d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:15.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.249+0000 7fc05e49b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0580d1c80 0x7fc0580b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:15.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.249+0000 7fc05e49b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0580cfc20 con 0x7fc0580cf6b0 2024-09-12T01:41:15.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.249+0000 7fc05e49b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc0580d2ed0 con 0x7fc0580d1c80 2024-09-12T01:41:15.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.249+0000 7fc05e49b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc0580d31b0 con 0x7fc0580b63d0 2024-09-12T01:41:15.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.249+0000 7fc0577fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc0580cf6b0 0x7fc0580b7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47752/0 (socket says 172.21.15.60:47752) 2024-09-12T01:41:15.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.249+0000 7fc0577fe640 1 -- 172.21.15.60:0/2092503042 learned_addr learned my addr 172.21.15.60:0/2092503042 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:15.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.249+0000 7fc05ca38640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0580d1c80 0x7fc0580b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:15.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.250+0000 7fc057fff640 1 --2- 172.21.15.60:0/2092503042 >> v2:172.21.15.105:3300/0 conn(0x7fc0580b63d0 0x7fc0580d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:15.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.250+0000 7fc05ca38640 1 -- 172.21.15.60:0/2092503042 >> v2:172.21.15.105:3300/0 conn(0x7fc0580b63d0 msgr2=0x7fc0580d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:15.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.250+0000 7fc05ca38640 1 --2- 172.21.15.60:0/2092503042 >> v2:172.21.15.105:3300/0 conn(0x7fc0580b63d0 0x7fc0580d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:15.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.250+0000 7fc05ca38640 1 -- 172.21.15.60:0/2092503042 >> v1:172.21.15.60:6789/0 conn(0x7fc0580cf6b0 legacy=0x7fc0580b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:15.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.250+0000 7fc05ca38640 1 -- 172.21.15.60:0/2092503042 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0580d3490 con 0x7fc0580d1c80 2024-09-12T01:41:15.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.251+0000 7fc05ca38640 1 --2- 172.21.15.60:0/2092503042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580d1c80 0x7fc0580b7f90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc058050260 tx=0x7fc05002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b77c7b67bd3e525 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:15.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.251+0000 7fc056ffd640 1 -- 172.21.15.60:0/2092503042 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050007740 con 0x7fc0580d1c80 2024-09-12T01:41:15.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.251+0000 7fc056ffd640 1 -- 172.21.15.60:0/2092503042 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0500078e0 con 0x7fc0580d1c80 2024-09-12T01:41:15.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.251+0000 7fc056ffd640 1 -- 172.21.15.60:0/2092503042 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050007cb0 con 0x7fc0580d1c80 2024-09-12T01:41:15.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.251+0000 7fc05e49b640 1 -- 172.21.15.60:0/2092503042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580d1c80 msgr2=0x7fc0580b7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:15.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.251+0000 7fc05e49b640 1 --2- 172.21.15.60:0/2092503042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580d1c80 0x7fc0580b7f90 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc058050260 tx=0x7fc05002a5f0 comp rx=0 tx=0).stop 2024-09-12T01:41:15.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.251+0000 7fc05e49b640 1 -- 172.21.15.60:0/2092503042 shutdown_connections 2024-09-12T01:41:15.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.251+0000 7fc05e49b640 1 --2- 172.21.15.60:0/2092503042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580d1c80 0x7fc0580b7f90 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:15.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.251+0000 7fc05e49b640 1 --2- 172.21.15.60:0/2092503042 >> v2:172.21.15.105:3300/0 conn(0x7fc0580b63d0 0x7fc0580d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:15.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.251+0000 7fc05e49b640 1 -- 172.21.15.60:0/2092503042 >> 172.21.15.60:0/2092503042 conn(0x7fc0580d1160 msgr2=0x7fc0580d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:15.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.251+0000 7fc05e49b640 1 -- 172.21.15.60:0/2092503042 shutdown_connections 2024-09-12T01:41:15.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.251+0000 7fc05e49b640 1 -- 172.21.15.60:0/2092503042 wait complete. 2024-09-12T01:41:15.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.253+0000 7fc05e49b640 1 Processor -- start 2024-09-12T01:41:15.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.253+0000 7fc05e49b640 1 -- start start 2024-09-12T01:41:15.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05e49b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0580b63d0 0x7fc0580b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:15.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05e49b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580cf6b0 0x7fc0580ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:15.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05e49b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580d1c80 0x7fc0581f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:15.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05e49b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc0580d4070 con 0x7fc0580d1c80 2024-09-12T01:41:15.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05e49b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc0580d3ef0 con 0x7fc0580b63d0 2024-09-12T01:41:15.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05e49b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc0580b67b0 con 0x7fc0580cf6b0 2024-09-12T01:41:15.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05ca38640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580d1c80 0x7fc0581f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:15.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05ca38640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580d1c80 0x7fc0581f7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45646/0 (socket says 172.21.15.60:45646) 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05ca38640 1 -- 172.21.15.60:0/3577756365 learned_addr learned my addr 172.21.15.60:0/3577756365 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc057fff640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0580b63d0 0x7fc0580b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc0577fe640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580cf6b0 0x7fc0580ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05ca38640 1 -- 172.21.15.60:0/3577756365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580cf6b0 msgr2=0x7fc0580ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05ca38640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580cf6b0 0x7fc0580ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05ca38640 1 -- 172.21.15.60:0/3577756365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0580b63d0 msgr2=0x7fc0580b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05ca38640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0580b63d0 0x7fc0580b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05ca38640 1 -- 172.21.15.60:0/3577756365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0580cbff0 con 0x7fc0580d1c80 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc0577fe640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580cf6b0 0x7fc0580ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.254+0000 7fc05ca38640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580d1c80 0x7fc0581f7e90 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc05002abe0 tx=0x7fc050004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.255+0000 7fc054ff9640 1 -- 172.21.15.60:0/3577756365 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05003f070 con 0x7fc0580d1c80 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.255+0000 7fc054ff9640 1 -- 172.21.15.60:0/3577756365 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc050031bc0 con 0x7fc0580d1c80 2024-09-12T01:41:15.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.255+0000 7fc05e49b640 1 -- 172.21.15.60:0/3577756365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0580cc2d0 con 0x7fc0580d1c80 2024-09-12T01:41:15.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.255+0000 7fc054ff9640 1 -- 172.21.15.60:0/3577756365 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc050044460 con 0x7fc0580d1c80 2024-09-12T01:41:15.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.255+0000 7fc05e49b640 1 -- 172.21.15.60:0/3577756365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0580cc890 con 0x7fc0580d1c80 2024-09-12T01:41:15.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.256+0000 7fc05e49b640 1 -- 172.21.15.60:0/3577756365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0580d39b0 con 0x7fc0580d1c80 2024-09-12T01:41:15.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.256+0000 7fc054ff9640 1 -- 172.21.15.60:0/3577756365 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc050007790 con 0x7fc0580d1c80 2024-09-12T01:41:15.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.257+0000 7fc054ff9640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc04406be60 0x7fc04406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:15.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.257+0000 7fc054ff9640 1 -- 172.21.15.60:0/3577756365 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fc0500ac640 con 0x7fc0580d1c80 2024-09-12T01:41:15.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.257+0000 7fc057fff640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc04406be60 0x7fc04406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:15.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.257+0000 7fc057fff640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc04406be60 0x7fc04406e320 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc048006fd0 tx=0x7fc048008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:15.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.261+0000 7fc054ff9640 1 -- 172.21.15.60:0/3577756365 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc05007aff0 con 0x7fc0580d1c80 2024-09-12T01:41:15.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.475+0000 7fc05e49b640 1 -- 172.21.15.60:0/3577756365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc0580b6d00 con 0x7fc0580d1c80 2024-09-12T01:41:15.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.475+0000 7fc054ff9640 1 -- 172.21.15.60:0/3577756365 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fc05007a8f0 con 0x7fc0580d1c80 2024-09-12T01:41:15.476 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:15.476 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:41:15.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.477+0000 7fc05e49b640 1 -- 172.21.15.60:0/3577756365 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc04406be60 msgr2=0x7fc04406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:15.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.477+0000 7fc05e49b640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc04406be60 0x7fc04406e320 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc048006fd0 tx=0x7fc048008040 comp rx=0 tx=0).stop 2024-09-12T01:41:15.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.477+0000 7fc05e49b640 1 -- 172.21.15.60:0/3577756365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580d1c80 msgr2=0x7fc0581f7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:15.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.477+0000 7fc05e49b640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580d1c80 0x7fc0581f7e90 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc05002abe0 tx=0x7fc050004a40 comp rx=0 tx=0).stop 2024-09-12T01:41:15.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.477+0000 7fc05e49b640 1 -- 172.21.15.60:0/3577756365 shutdown_connections 2024-09-12T01:41:15.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.477+0000 7fc05e49b640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0580d1c80 0x7fc0581f7e90 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:15.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.477+0000 7fc05e49b640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc04406be60 0x7fc04406e320 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:15.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.477+0000 7fc05e49b640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0580cf6b0 0x7fc0580ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:15.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.477+0000 7fc05e49b640 1 --2- 172.21.15.60:0/3577756365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0580b63d0 0x7fc0580b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:15.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.477+0000 7fc05e49b640 1 -- 172.21.15.60:0/3577756365 >> 172.21.15.60:0/3577756365 conn(0x7fc0580d1160 msgr2=0x7fc0580b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:15.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.477+0000 7fc05e49b640 1 -- 172.21.15.60:0/3577756365 shutdown_connections 2024-09-12T01:41:15.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:15.477+0000 7fc05e49b640 1 -- 172.21.15.60:0/3577756365 wait complete. 2024-09-12T01:41:15.489 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:41:15.489 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:41:15.699 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:17.702 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:18.631 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:41:18.634 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:41:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:20.490 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:41:20.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.604+0000 7f7f02ed0640 1 Processor -- start 2024-09-12T01:41:20.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.604+0000 7f7f02ed0640 1 -- start start 2024-09-12T01:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.605+0000 7f7f02ed0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7efc15c2b0 0x7f7efc0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.605+0000 7f7f02ed0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7efc15f200 0x7f7efc06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.605+0000 7f7f02ed0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7efc15fb10 con 0x7f7efc0b72f0 2024-09-12T01:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.605+0000 7f7f02ed0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7efc0b5900 con 0x7f7efc15f200 2024-09-12T01:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.605+0000 7f7f02ed0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7efc15f830 con 0x7f7efc15c2b0 2024-09-12T01:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.605+0000 7f7f0146d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7efc15f200 0x7f7efc06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.605+0000 7f7f0146d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7efc15f200 0x7f7efc06d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45652/0 (socket says 172.21.15.60:45652) 2024-09-12T01:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.605+0000 7f7f0146d640 1 -- 172.21.15.60:0/591996700 learned_addr learned my addr 172.21.15.60:0/591996700 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.605+0000 7f7f00c6c640 1 --2- 172.21.15.60:0/591996700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7efc15c2b0 0x7f7efc0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.606+0000 7f7f0146d640 1 -- 172.21.15.60:0/591996700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7efc15c2b0 msgr2=0x7f7efc0b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.606+0000 7f7f0146d640 1 --2- 172.21.15.60:0/591996700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7efc15c2b0 0x7f7efc0b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.606+0000 7f7f0146d640 1 -- 172.21.15.60:0/591996700 >> v1:172.21.15.105:6789/0 conn(0x7f7efc0b72f0 legacy=0x7f7efc15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.606+0000 7f7f0146d640 1 -- 172.21.15.60:0/591996700 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc06ce30 con 0x7f7efc15f200 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.606+0000 7f7f0146d640 1 --2- 172.21.15.60:0/591996700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc15f200 0x7f7efc06d910 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009e50 tx=0x7f7ef402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b10e06e15ba5ca server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.607+0000 7f7efb7fe640 1 -- 172.21.15.60:0/591996700 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4036070 con 0x7f7efc15f200 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.607+0000 7f7efb7fe640 1 -- 172.21.15.60:0/591996700 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef4031600 con 0x7f7efc15f200 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.607+0000 7f7efb7fe640 1 -- 172.21.15.60:0/591996700 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40319d0 con 0x7f7efc15f200 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.607+0000 7f7f02ed0640 1 -- 172.21.15.60:0/591996700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc15f200 msgr2=0x7f7efc06d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.607+0000 7f7f02ed0640 1 --2- 172.21.15.60:0/591996700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc15f200 0x7f7efc06d910 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009e50 tx=0x7f7ef402a710 comp rx=0 tx=0).stop 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.607+0000 7f7f02ed0640 1 -- 172.21.15.60:0/591996700 shutdown_connections 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.607+0000 7f7f02ed0640 1 --2- 172.21.15.60:0/591996700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc15f200 0x7f7efc06d910 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.607+0000 7f7f02ed0640 1 --2- 172.21.15.60:0/591996700 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7efc15c2b0 0x7f7efc0b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:20.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.607+0000 7f7f02ed0640 1 -- 172.21.15.60:0/591996700 >> 172.21.15.60:0/591996700 conn(0x7f7efc0b4240 msgr2=0x7f7efc0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:20.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.607+0000 7f7f02ed0640 1 -- 172.21.15.60:0/591996700 shutdown_connections 2024-09-12T01:41:20.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.607+0000 7f7f02ed0640 1 -- 172.21.15.60:0/591996700 wait complete. 2024-09-12T01:41:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.609+0000 7f7f02ed0640 1 Processor -- start 2024-09-12T01:41:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.609+0000 7f7f02ed0640 1 -- start start 2024-09-12T01:41:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f02ed0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7efc0b72f0 0x7f7efc1490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f02ed0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7efc15c2b0 0x7f7efc153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f02ed0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc15f200 0x7f7efc15a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f02ed0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc0b7730 con 0x7f7efc15f200 2024-09-12T01:41:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f02ed0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc06d3f0 con 0x7f7efc15c2b0 2024-09-12T01:41:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f02ed0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7efc06de50 con 0x7f7efc0b72f0 2024-09-12T01:41:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f0146d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc15f200 0x7f7efc15a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f0146d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc15f200 0x7f7efc15a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45658/0 (socket says 172.21.15.60:45658) 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f0146d640 1 -- 172.21.15.60:0/3668470080 learned_addr learned my addr 172.21.15.60:0/3668470080 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f00c6c640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7efc0b72f0 0x7f7efc1490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7efbfff640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7efc15c2b0 0x7f7efc153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f0146d640 1 -- 172.21.15.60:0/3668470080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7efc0b72f0 msgr2=0x7f7efc1490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f0146d640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7efc0b72f0 0x7f7efc1490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f0146d640 1 -- 172.21.15.60:0/3668470080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7efc15c2b0 msgr2=0x7f7efc153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f0146d640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7efc15c2b0 0x7f7efc153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f0146d640 1 -- 172.21.15.60:0/3668470080 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc15a530 con 0x7f7efc15f200 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7efbfff640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7efc15c2b0 0x7f7efc153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f0146d640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc15f200 0x7f7efc15a8b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4034040 tx=0x7f7ef4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3668470080 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4036050 con 0x7f7efc15f200 2024-09-12T01:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3668470080 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ef4042070 con 0x7f7efc15f200 2024-09-12T01:41:20.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7f02ed0640 1 -- 172.21.15.60:0/3668470080 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc1546a0 con 0x7f7efc15f200 2024-09-12T01:41:20.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.610+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3668470080 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4009510 con 0x7f7efc15f200 2024-09-12T01:41:20.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.611+0000 7f7f02ed0640 1 -- 172.21.15.60:0/3668470080 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc154c60 con 0x7f7efc15f200 2024-09-12T01:41:20.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.611+0000 7f7f02ed0640 1 -- 172.21.15.60:0/3668470080 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7efc0b6db0 con 0x7f7efc15f200 2024-09-12T01:41:20.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.612+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3668470080 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ef4007bf0 con 0x7f7efc15f200 2024-09-12T01:41:20.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.612+0000 7f7ef97fa640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ee006be30 0x7f7ee006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:20.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.613+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3668470080 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f7ef40abbe0 con 0x7f7efc15f200 2024-09-12T01:41:20.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.613+0000 7f7f00c6c640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ee006be30 0x7f7ee006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:20.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.613+0000 7f7f00c6c640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ee006be30 0x7f7ee006e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009b40 tx=0x7f7ef0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:20.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.617+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3668470080 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ef407a740 con 0x7f7efc15f200 2024-09-12T01:41:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.830+0000 7f7f02ed0640 1 -- 172.21.15.60:0/3668470080 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7efc071140 con 0x7f7efc15f200 2024-09-12T01:41:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.830+0000 7f7ef97fa640 1 -- 172.21.15.60:0/3668470080 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f7ef407a040 con 0x7f7efc15f200 2024-09-12T01:41:20.831 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:20.831 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:41:20.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.832+0000 7f7f02ed0640 1 -- 172.21.15.60:0/3668470080 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ee006be30 msgr2=0x7f7ee006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:20.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.832+0000 7f7f02ed0640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ee006be30 0x7f7ee006e2f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009b40 tx=0x7f7ef0009190 comp rx=0 tx=0).stop 2024-09-12T01:41:20.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.832+0000 7f7f02ed0640 1 -- 172.21.15.60:0/3668470080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc15f200 msgr2=0x7f7efc15a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:20.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.832+0000 7f7f02ed0640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc15f200 0x7f7efc15a8b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4034040 tx=0x7f7ef4004a40 comp rx=0 tx=0).stop 2024-09-12T01:41:20.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.832+0000 7f7f02ed0640 1 -- 172.21.15.60:0/3668470080 shutdown_connections 2024-09-12T01:41:20.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.832+0000 7f7f02ed0640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7efc15f200 0x7f7efc15a8b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:20.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.832+0000 7f7f02ed0640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7efc15c2b0 0x7f7efc153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:20.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.832+0000 7f7f02ed0640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ee006be30 0x7f7ee006e2f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:20.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.832+0000 7f7f02ed0640 1 --2- 172.21.15.60:0/3668470080 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7efc0b72f0 0x7f7efc1490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:20.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.832+0000 7f7f02ed0640 1 -- 172.21.15.60:0/3668470080 >> 172.21.15.60:0/3668470080 conn(0x7f7efc0b4240 msgr2=0x7f7efc0b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:20.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.832+0000 7f7f02ed0640 1 -- 172.21.15.60:0/3668470080 shutdown_connections 2024-09-12T01:41:20.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:20.832+0000 7f7f02ed0640 1 -- 172.21.15.60:0/3668470080 wait complete. 2024-09-12T01:41:20.844 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:41:20.844 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:41:21.706 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:23.708 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:25.710 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:25.844 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:41:25.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.958+0000 7f91ccc1e640 1 Processor -- start 2024-09-12T01:41:25.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.959+0000 7f91ccc1e640 1 -- start start 2024-09-12T01:41:25.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91ccc1e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f91c815e660 0x7f91c80cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:25.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91ccc1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91c80d1820 0x7f91c80b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:25.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91ccc1e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c815ea40 con 0x7f91c80d3310 2024-09-12T01:41:25.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91ccc1e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f91c80d3870 con 0x7f91c815e660 2024-09-12T01:41:25.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91ccc1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f91c80d3b50 con 0x7f91c80d1820 2024-09-12T01:41:25.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91c659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f91c815e660 0x7f91c80cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:25.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91c659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f91c815e660 0x7f91c80cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42098/0 (socket says 172.21.15.60:42098) 2024-09-12T01:41:25.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91c659c640 1 -- 172.21.15.60:0/1270003970 learned_addr learned my addr 172.21.15.60:0/1270003970 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:25.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91c5d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f91c80d3310 0x7f91c80d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50984/0 (socket says 172.21.15.60:50984) 2024-09-12T01:41:25.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91c6d9d640 1 --2- 172.21.15.60:0/1270003970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91c80d1820 0x7f91c80b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:25.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91c659c640 1 -- 172.21.15.60:0/1270003970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91c80d1820 msgr2=0x7f91c80b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:25.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91c659c640 1 --2- 172.21.15.60:0/1270003970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91c80d1820 0x7f91c80b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:25.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91c659c640 1 -- 172.21.15.60:0/1270003970 >> v1:172.21.15.60:6789/0 conn(0x7f91c80d3310 legacy=0x7f91c80d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:25.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91c559a640 1 -- 172.21.15.60:0/1270003970 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3754717731 0 0) 0x7f91c815ea40 con 0x7f91c80d3310 2024-09-12T01:41:25.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.960+0000 7f91c659c640 1 -- 172.21.15.60:0/1270003970 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c80d3e30 con 0x7f91c815e660 2024-09-12T01:41:26.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.961+0000 7f91c659c640 1 --2- 172.21.15.60:0/1270003970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c815e660 0x7f91c80cf730 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009870 tx=0x7f91b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fcb961f5ed77e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:26.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.961+0000 7f91c559a640 1 -- 172.21.15.60:0/1270003970 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8037070 con 0x7f91c815e660 2024-09-12T01:41:26.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.961+0000 7f91c559a640 1 -- 172.21.15.60:0/1270003970 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b8032440 con 0x7f91c815e660 2024-09-12T01:41:26.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.961+0000 7f91c559a640 1 -- 172.21.15.60:0/1270003970 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8032810 con 0x7f91c815e660 2024-09-12T01:41:26.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.962+0000 7f91ccc1e640 1 -- 172.21.15.60:0/1270003970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c815e660 msgr2=0x7f91c80cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:26.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.962+0000 7f91ccc1e640 1 --2- 172.21.15.60:0/1270003970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c815e660 0x7f91c80cf730 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009870 tx=0x7f91b802a270 comp rx=0 tx=0).stop 2024-09-12T01:41:26.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.962+0000 7f91ccc1e640 1 -- 172.21.15.60:0/1270003970 shutdown_connections 2024-09-12T01:41:26.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.962+0000 7f91ccc1e640 1 --2- 172.21.15.60:0/1270003970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91c80d1820 0x7f91c80b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.962+0000 7f91ccc1e640 1 --2- 172.21.15.60:0/1270003970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c815e660 0x7f91c80cf730 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.962+0000 7f91ccc1e640 1 -- 172.21.15.60:0/1270003970 >> 172.21.15.60:0/1270003970 conn(0x7f91c80b6410 msgr2=0x7f91c80b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.962+0000 7f91ccc1e640 1 -- 172.21.15.60:0/1270003970 shutdown_connections 2024-09-12T01:41:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.962+0000 7f91ccc1e640 1 -- 172.21.15.60:0/1270003970 wait complete. 2024-09-12T01:41:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.963+0000 7f91ccc1e640 1 Processor -- start 2024-09-12T01:41:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.963+0000 7f91ccc1e640 1 -- start start 2024-09-12T01:41:26.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91ccc1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c80d1820 0x7f91c81f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91ccc1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91c80d3310 0x7f91c8160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91ccc1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91c815e660 0x7f91c80cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91ccc1e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f91c80cfc70 con 0x7f91c80d1820 2024-09-12T01:41:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91ccc1e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f91c80d43f0 con 0x7f91c80d3310 2024-09-12T01:41:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91ccc1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f91c80b80b0 con 0x7f91c815e660 2024-09-12T01:41:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91c659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c80d1820 0x7f91c81f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91c659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c80d1820 0x7f91c81f4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42114/0 (socket says 172.21.15.60:42114) 2024-09-12T01:41:26.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91c659c640 1 -- 172.21.15.60:0/3070065539 learned_addr learned my addr 172.21.15.60:0/3070065539 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91c6d9d640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91c815e660 0x7f91c80cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91c5d9b640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91c80d3310 0x7f91c8160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91c659c640 1 -- 172.21.15.60:0/3070065539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91c815e660 msgr2=0x7f91c80cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91c659c640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91c815e660 0x7f91c80cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91c659c640 1 -- 172.21.15.60:0/3070065539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91c80d3310 msgr2=0x7f91c8160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91c659c640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91c80d3310 0x7f91c8160cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:26.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91c659c640 1 -- 172.21.15.60:0/3070065539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c815fc30 con 0x7f91c80d1820 2024-09-12T01:41:26.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.964+0000 7f91c6d9d640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91c815e660 0x7f91c80cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:41:26.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.965+0000 7f91c659c640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c80d1820 0x7f91c81f4030 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f91b8000c00 tx=0x7f91b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:26.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.965+0000 7f91b6ffd640 1 -- 172.21.15.60:0/3070065539 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8037040 con 0x7f91c80d1820 2024-09-12T01:41:26.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.965+0000 7f91b6ffd640 1 -- 172.21.15.60:0/3070065539 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b8042070 con 0x7f91c80d1820 2024-09-12T01:41:26.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.965+0000 7f91ccc1e640 1 -- 172.21.15.60:0/3070065539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c815ff10 con 0x7f91c80d1820 2024-09-12T01:41:26.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.965+0000 7f91b6ffd640 1 -- 172.21.15.60:0/3070065539 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8030880 con 0x7f91c80d1820 2024-09-12T01:41:26.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.965+0000 7f91ccc1e640 1 -- 172.21.15.60:0/3070065539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c81604d0 con 0x7f91c80d1820 2024-09-12T01:41:26.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.966+0000 7f91ccc1e640 1 -- 172.21.15.60:0/3070065539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c80b7b70 con 0x7f91c80d1820 2024-09-12T01:41:26.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.966+0000 7f91b6ffd640 1 -- 172.21.15.60:0/3070065539 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91b8030a20 con 0x7f91c80d1820 2024-09-12T01:41:26.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.967+0000 7f91b6ffd640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91a806be30 0x7f91a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:26.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.967+0000 7f91b6ffd640 1 -- 172.21.15.60:0/3070065539 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f91b80ab630 con 0x7f91c80d1820 2024-09-12T01:41:26.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.967+0000 7f91c5d9b640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91a806be30 0x7f91a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:26.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.968+0000 7f91c5d9b640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91a806be30 0x7f91a806e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f91bc007fd0 tx=0x7f91bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:26.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:25.972+0000 7f91b6ffd640 1 -- 172.21.15.60:0/3070065539 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91b8079fe0 con 0x7f91c80d1820 2024-09-12T01:41:26.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.185+0000 7f91ccc1e640 1 -- 172.21.15.60:0/3070065539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f91c80b8d00 con 0x7f91c80d1820 2024-09-12T01:41:26.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.186+0000 7f91b6ffd640 1 -- 172.21.15.60:0/3070065539 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f91b807ee20 con 0x7f91c80d1820 2024-09-12T01:41:26.186 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:26.186 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:41:26.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.187+0000 7f91ccc1e640 1 -- 172.21.15.60:0/3070065539 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91a806be30 msgr2=0x7f91a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:26.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.187+0000 7f91ccc1e640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91a806be30 0x7f91a806e2f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f91bc007fd0 tx=0x7f91bc009040 comp rx=0 tx=0).stop 2024-09-12T01:41:26.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.187+0000 7f91ccc1e640 1 -- 172.21.15.60:0/3070065539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c80d1820 msgr2=0x7f91c81f4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:26.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.187+0000 7f91ccc1e640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c80d1820 0x7f91c81f4030 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f91b8000c00 tx=0x7f91b80046c0 comp rx=0 tx=0).stop 2024-09-12T01:41:26.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.187+0000 7f91ccc1e640 1 -- 172.21.15.60:0/3070065539 shutdown_connections 2024-09-12T01:41:26.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.187+0000 7f91ccc1e640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91a806be30 0x7f91a806e2f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:26.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.187+0000 7f91ccc1e640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91c815e660 0x7f91c80cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:26.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.187+0000 7f91ccc1e640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91c80d3310 0x7f91c8160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:26.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.187+0000 7f91ccc1e640 1 --2- 172.21.15.60:0/3070065539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91c80d1820 0x7f91c81f4030 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:26.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.187+0000 7f91ccc1e640 1 -- 172.21.15.60:0/3070065539 >> 172.21.15.60:0/3070065539 conn(0x7f91c80b6410 msgr2=0x7f91c80b8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:26.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.187+0000 7f91ccc1e640 1 -- 172.21.15.60:0/3070065539 shutdown_connections 2024-09-12T01:41:26.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:26.187+0000 7f91ccc1e640 1 -- 172.21.15.60:0/3070065539 wait complete. 2024-09-12T01:41:26.199 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:41:26.199 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:41:27.712 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:29.714 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:31.200 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:41:31.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.315+0000 7fa164465640 1 Processor -- start 2024-09-12T01:41:31.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.315+0000 7fa164465640 1 -- start start 2024-09-12T01:41:31.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.316+0000 7fa164465640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa15c0cfc80 0x7fa15c0b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:31.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.316+0000 7fa164465640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa15c15c330 0x7fa15c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:31.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.316+0000 7fa164465640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15c15c740 con 0x7fa15c155800 2024-09-12T01:41:31.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.316+0000 7fa164465640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa15c0b4e60 con 0x7fa15c0cfc80 2024-09-12T01:41:31.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.316+0000 7fa164465640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa15c0b50a0 con 0x7fa15c15c330 2024-09-12T01:41:31.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.317+0000 7fa161a00640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa15c0cfc80 0x7fa15c0b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:31.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.317+0000 7fa161a00640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa15c0cfc80 0x7fa15c0b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42122/0 (socket says 172.21.15.60:42122) 2024-09-12T01:41:31.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.317+0000 7fa161a00640 1 -- 172.21.15.60:0/2109574512 learned_addr learned my addr 172.21.15.60:0/2109574512 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:31.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.317+0000 7fa162a02640 1 --2- 172.21.15.60:0/2109574512 >> v2:172.21.15.105:3300/0 conn(0x7fa15c15c330 0x7fa15c0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:31.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.317+0000 7fa161a00640 1 -- 172.21.15.60:0/2109574512 >> v2:172.21.15.105:3300/0 conn(0x7fa15c15c330 msgr2=0x7fa15c0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:31.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.317+0000 7fa161a00640 1 --2- 172.21.15.60:0/2109574512 >> v2:172.21.15.105:3300/0 conn(0x7fa15c15c330 0x7fa15c0b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:31.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.317+0000 7fa161a00640 1 -- 172.21.15.60:0/2109574512 >> v1:172.21.15.105:6789/0 conn(0x7fa15c155800 legacy=0x7fa15c0cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:31.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.317+0000 7fa161a00640 1 -- 172.21.15.60:0/2109574512 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c0b5380 con 0x7fa15c0cfc80 2024-09-12T01:41:31.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.318+0000 7fa161a00640 1 --2- 172.21.15.60:0/2109574512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa15c0cfc80 0x7fa15c0b6140 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa150009870 tx=0x7fa15002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef94ea8e7549ca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:31.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.318+0000 7fa1611ff640 1 -- 172.21.15.60:0/2109574512 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150037070 con 0x7fa15c0cfc80 2024-09-12T01:41:31.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.318+0000 7fa1611ff640 1 -- 172.21.15.60:0/2109574512 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa150032440 con 0x7fa15c0cfc80 2024-09-12T01:41:31.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.318+0000 7fa1611ff640 1 -- 172.21.15.60:0/2109574512 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150032810 con 0x7fa15c0cfc80 2024-09-12T01:41:31.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.319+0000 7fa164465640 1 -- 172.21.15.60:0/2109574512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa15c0cfc80 msgr2=0x7fa15c0b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:31.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.319+0000 7fa164465640 1 --2- 172.21.15.60:0/2109574512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa15c0cfc80 0x7fa15c0b6140 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fa150009870 tx=0x7fa15002a2a0 comp rx=0 tx=0).stop 2024-09-12T01:41:31.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.319+0000 7fa164465640 1 -- 172.21.15.60:0/2109574512 shutdown_connections 2024-09-12T01:41:31.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.319+0000 7fa164465640 1 --2- 172.21.15.60:0/2109574512 >> v2:172.21.15.105:3300/0 conn(0x7fa15c15c330 0x7fa15c0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:31.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.319+0000 7fa164465640 1 --2- 172.21.15.60:0/2109574512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa15c0cfc80 0x7fa15c0b6140 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:31.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.319+0000 7fa164465640 1 -- 172.21.15.60:0/2109574512 >> 172.21.15.60:0/2109574512 conn(0x7fa15c06bc10 msgr2=0x7fa15c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:31.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.319+0000 7fa164465640 1 -- 172.21.15.60:0/2109574512 shutdown_connections 2024-09-12T01:41:31.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.319+0000 7fa164465640 1 -- 172.21.15.60:0/2109574512 wait complete. 2024-09-12T01:41:31.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.320+0000 7fa164465640 1 Processor -- start 2024-09-12T01:41:31.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.320+0000 7fa164465640 1 -- start start 2024-09-12T01:41:31.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa164465640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa15c0cfc80 0x7fa15c15a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:31.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa164465640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa15c155800 0x7fa15c14aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa164465640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa15c15c330 0x7fa15c0cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa164465640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c0b5c20 con 0x7fa15c155800 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa164465640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c0b5940 con 0x7fa15c0cfc80 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa164465640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa15c155be0 con 0x7fa15c15c330 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa161a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa15c155800 0x7fa15c14aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa161a00640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa15c155800 0x7fa15c14aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42138/0 (socket says 172.21.15.60:42138) 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa161a00640 1 -- 172.21.15.60:0/1171866050 learned_addr learned my addr 172.21.15.60:0/1171866050 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa162a02640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa15c15c330 0x7fa15c0cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa162201640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa15c0cfc80 0x7fa15c15a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa161a00640 1 -- 172.21.15.60:0/1171866050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa15c15c330 msgr2=0x7fa15c0cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa161a00640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa15c15c330 0x7fa15c0cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa161a00640 1 -- 172.21.15.60:0/1171866050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa15c0cfc80 msgr2=0x7fa15c15a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa161a00640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa15c0cfc80 0x7fa15c15a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:31.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.321+0000 7fa161a00640 1 -- 172.21.15.60:0/1171866050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c15dd40 con 0x7fa15c155800 2024-09-12T01:41:31.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.322+0000 7fa161a00640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa15c155800 0x7fa15c14aca0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa150000c00 tx=0x7fa1500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:31.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.322+0000 7fa15affd640 1 -- 172.21.15.60:0/1171866050 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150041020 con 0x7fa15c155800 2024-09-12T01:41:31.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.322+0000 7fa15affd640 1 -- 172.21.15.60:0/1171866050 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1500306c0 con 0x7fa15c155800 2024-09-12T01:41:31.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.322+0000 7fa164465640 1 -- 172.21.15.60:0/1171866050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15c15e020 con 0x7fa15c155800 2024-09-12T01:41:31.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.322+0000 7fa15affd640 1 -- 172.21.15.60:0/1171866050 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150037040 con 0x7fa15c155800 2024-09-12T01:41:31.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.322+0000 7fa164465640 1 -- 172.21.15.60:0/1171866050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa15c15e5e0 con 0x7fa15c155800 2024-09-12T01:41:31.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.323+0000 7fa164465640 1 -- 172.21.15.60:0/1171866050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15c0b6140 con 0x7fa15c155800 2024-09-12T01:41:31.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.324+0000 7fa15affd640 1 -- 172.21.15.60:0/1171866050 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa150044020 con 0x7fa15c155800 2024-09-12T01:41:31.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.324+0000 7fa15affd640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa14806be30 0x7fa14806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:31.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.324+0000 7fa15affd640 1 -- 172.21.15.60:0/1171866050 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fa1500ab4d0 con 0x7fa15c155800 2024-09-12T01:41:31.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.324+0000 7fa162201640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa14806be30 0x7fa14806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:31.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.325+0000 7fa162201640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa14806be30 0x7fa14806e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa154001780 tx=0x7fa154009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:31.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.329+0000 7fa15affd640 1 -- 172.21.15.60:0/1171866050 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa15004b030 con 0x7fa15c155800 2024-09-12T01:41:31.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.543+0000 7fa164465640 1 -- 172.21.15.60:0/1171866050 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa15c15bc30 con 0x7fa15c155800 2024-09-12T01:41:31.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.544+0000 7fa15affd640 1 -- 172.21.15.60:0/1171866050 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7fa1500a9e20 con 0x7fa15c155800 2024-09-12T01:41:31.544 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:31.545 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:41:31.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.546+0000 7fa164465640 1 -- 172.21.15.60:0/1171866050 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa14806be30 msgr2=0x7fa14806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:31.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.546+0000 7fa164465640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa14806be30 0x7fa14806e2f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa154001780 tx=0x7fa154009040 comp rx=0 tx=0).stop 2024-09-12T01:41:31.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.546+0000 7fa164465640 1 -- 172.21.15.60:0/1171866050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa15c155800 msgr2=0x7fa15c14aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:31.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.546+0000 7fa164465640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa15c155800 0x7fa15c14aca0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa150000c00 tx=0x7fa1500046c0 comp rx=0 tx=0).stop 2024-09-12T01:41:31.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.546+0000 7fa164465640 1 -- 172.21.15.60:0/1171866050 shutdown_connections 2024-09-12T01:41:31.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.546+0000 7fa164465640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa14806be30 0x7fa14806e2f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:31.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.546+0000 7fa164465640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa15c15c330 0x7fa15c0cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:31.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.546+0000 7fa164465640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa15c155800 0x7fa15c14aca0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:31.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.546+0000 7fa164465640 1 --2- 172.21.15.60:0/1171866050 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa15c0cfc80 0x7fa15c15a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:31.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.546+0000 7fa164465640 1 -- 172.21.15.60:0/1171866050 >> 172.21.15.60:0/1171866050 conn(0x7fa15c06bc10 msgr2=0x7fa15c0cd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:31.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.546+0000 7fa164465640 1 -- 172.21.15.60:0/1171866050 shutdown_connections 2024-09-12T01:41:31.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:31.546+0000 7fa164465640 1 -- 172.21.15.60:0/1171866050 wait complete. 2024-09-12T01:41:31.557 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:41:31.558 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:41:31.717 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:33.719 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:35.721 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:36.558 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:41:36.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.673+0000 7f603c6f1640 1 Processor -- start 2024-09-12T01:41:36.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.673+0000 7f603c6f1640 1 -- start start 2024-09-12T01:41:36.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.674+0000 7f603c6f1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f60340735b0 0x7f60340cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:36.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.674+0000 7f603c6f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f603406faf0 con 0x7f603406d540 2024-09-12T01:41:36.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.674+0000 7f603c6f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f603406fdd0 con 0x7f603415e950 2024-09-12T01:41:36.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.674+0000 7f603c6f1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f60340700b0 con 0x7f60340735b0 2024-09-12T01:41:36.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.674+0000 7f6039c8c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f603406d540 0x7f60340cf0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44984/0 (socket says 172.21.15.60:44984) 2024-09-12T01:41:36.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.674+0000 7f6039c8c640 1 -- 172.21.15.60:0/3080833379 learned_addr learned my addr 172.21.15.60:0/3080833379 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:36.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.674+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1117457683 0 0) 0x7f603406faf0 con 0x7f603406d540 2024-09-12T01:41:36.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.674+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6020003520 con 0x7f603406d540 2024-09-12T01:41:36.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.674+0000 7f603ac8e640 1 --2- 172.21.15.60:0/3080833379 >> v2:172.21.15.105:3300/0 conn(0x7f60340735b0 0x7f60340cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:36.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3121338 0 0) 0x7f6020003520 con 0x7f603406d540 2024-09-12T01:41:36.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 >> v2:172.21.15.105:3300/0 conn(0x7f60340735b0 msgr2=0x7f60340cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:36.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 --2- 172.21.15.60:0/3080833379 >> v2:172.21.15.105:3300/0 conn(0x7f60340735b0 0x7f60340cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:36.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 >> v1:172.21.15.105:6789/0 conn(0x7f603415e950 legacy=0x7f603406ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:36.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6034070390 con 0x7f603406d540 2024-09-12T01:41:36.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f6024001670 con 0x7f603406d540 2024-09-12T01:41:36.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 >> v1:172.21.15.60:6789/0 conn(0x7f603406d540 legacy=0x7f60340cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:36.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 --2- 172.21.15.60:0/3080833379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 0x7f6020003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 --2- 172.21.15.60:0/3080833379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6020004800 0x7f6020004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 --2- 172.21.15.60:0/3080833379 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60200051c0 0x7f602000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f60340700b0 con 0x7f60200039b0 2024-09-12T01:41:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f602000c060 con 0x7f6020004800 2024-09-12T01:41:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f602000c260 con 0x7f60200051c0 2024-09-12T01:41:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603a48d640 1 --2- 172.21.15.60:0/3080833379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 0x7f6020003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f6039c8c640 1 --2- 172.21.15.60:0/3080833379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6020004800 0x7f6020004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603ac8e640 1 --2- 172.21.15.60:0/3080833379 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60200051c0 0x7f602000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603a48d640 1 -- 172.21.15.60:0/3080833379 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60200051c0 msgr2=0x7f602000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:36.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603a48d640 1 --2- 172.21.15.60:0/3080833379 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60200051c0 0x7f602000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603a48d640 1 -- 172.21.15.60:0/3080833379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6020004800 msgr2=0x7f6020004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603a48d640 1 --2- 172.21.15.60:0/3080833379 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6020004800 0x7f6020004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603a48d640 1 -- 172.21.15.60:0/3080833379 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6020003520 con 0x7f60200039b0 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.675+0000 7f603ac8e640 1 -- 172.21.15.60:0/3080833379 reap_dead start 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.676+0000 7f603a48d640 1 --2- 172.21.15.60:0/3080833379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 0x7f6020003dd0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6030001750 tx=0x7f6020005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286d147381017c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.676+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6030001370 con 0x7f60200039b0 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.676+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60300052d0 con 0x7f60200039b0 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.676+0000 7f603948b640 1 -- 172.21.15.60:0/3080833379 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603002abe0 con 0x7f60200039b0 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.677+0000 7f603c6f1640 1 -- 172.21.15.60:0/3080833379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 msgr2=0x7f6020003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.677+0000 7f603c6f1640 1 --2- 172.21.15.60:0/3080833379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 0x7f6020003dd0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6030001750 tx=0x7f6020005830 comp rx=0 tx=0).stop 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.677+0000 7f603c6f1640 1 -- 172.21.15.60:0/3080833379 shutdown_connections 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.677+0000 7f603c6f1640 1 --2- 172.21.15.60:0/3080833379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 0x7f6020003dd0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.677+0000 7f603c6f1640 1 -- 172.21.15.60:0/3080833379 >> 172.21.15.60:0/3080833379 conn(0x7f60340d14d0 msgr2=0x7f60340d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:36.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.677+0000 7f603c6f1640 1 -- 172.21.15.60:0/3080833379 shutdown_connections 2024-09-12T01:41:36.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.677+0000 7f603c6f1640 1 -- 172.21.15.60:0/3080833379 wait complete. 2024-09-12T01:41:36.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.678+0000 7f603c6f1640 1 Processor -- start 2024-09-12T01:41:36.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.678+0000 7f603c6f1640 1 -- start start 2024-09-12T01:41:36.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603c6f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 0x7f60341f4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:36.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603c6f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6034157940 0x7f60340cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603c6f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6034159fc0 0x7f603415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603c6f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f60340721d0 con 0x7f60200039b0 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603c6f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6034072050 con 0x7f6034157940 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603c6f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6034072350 con 0x7f6034159fc0 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603a48d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 0x7f60341f4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603a48d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 0x7f60341f4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50116/0 (socket says 172.21.15.60:50116) 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603a48d640 1 -- 172.21.15.60:0/1887257514 learned_addr learned my addr 172.21.15.60:0/1887257514 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603ac8e640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6034159fc0 0x7f603415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f6039c8c640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6034157940 0x7f60340cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603a48d640 1 -- 172.21.15.60:0/1887257514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6034159fc0 msgr2=0x7f603415a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603a48d640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6034159fc0 0x7f603415a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603a48d640 1 -- 172.21.15.60:0/1887257514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6034157940 msgr2=0x7f60340cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:36.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603a48d640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6034157940 0x7f60340cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603a48d640 1 -- 172.21.15.60:0/1887257514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60341f52c0 con 0x7f60200039b0 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.679+0000 7f603a48d640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 0x7f60341f4d80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6030000c00 tx=0x7f6030001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.680+0000 7f602affd640 1 -- 172.21.15.60:0/1887257514 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603003f020 con 0x7f60200039b0 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.680+0000 7f602affd640 1 -- 172.21.15.60:0/1887257514 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6030005480 con 0x7f60200039b0 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.680+0000 7f602affd640 1 -- 172.21.15.60:0/1887257514 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6030001370 con 0x7f60200039b0 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.680+0000 7f603c6f1640 1 -- 172.21.15.60:0/1887257514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60340cdde0 con 0x7f60200039b0 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.680+0000 7f603c6f1640 1 -- 172.21.15.60:0/1887257514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6034158680 con 0x7f60200039b0 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.681+0000 7f603c6f1640 1 -- 172.21.15.60:0/1887257514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f603406ce30 con 0x7f60200039b0 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.681+0000 7f602affd640 1 -- 172.21.15.60:0/1887257514 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6030042020 con 0x7f60200039b0 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.682+0000 7f602affd640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f601806be30 0x7f601806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.682+0000 7f602affd640 1 -- 172.21.15.60:0/1887257514 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f60300aa830 con 0x7f60200039b0 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.682+0000 7f6039c8c640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f601806be30 0x7f601806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.682+0000 7f6039c8c640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f601806be30 0x7f601806e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6034156990 tx=0x7f6024000ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:36.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.686+0000 7f602affd640 1 -- 172.21.15.60:0/1887257514 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6030049030 con 0x7f60200039b0 2024-09-12T01:41:36.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.899+0000 7f603c6f1640 1 -- 172.21.15.60:0/1887257514 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f60340d0fb0 con 0x7f60200039b0 2024-09-12T01:41:36.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.900+0000 7f602affd640 1 -- 172.21.15.60:0/1887257514 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f60341f52c0 con 0x7f60200039b0 2024-09-12T01:41:36.900 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:36.900 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:41:36.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.902+0000 7f603c6f1640 1 -- 172.21.15.60:0/1887257514 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f601806be30 msgr2=0x7f601806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:36.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.902+0000 7f603c6f1640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f601806be30 0x7f601806e2f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6034156990 tx=0x7f6024000ed0 comp rx=0 tx=0).stop 2024-09-12T01:41:36.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.902+0000 7f603c6f1640 1 -- 172.21.15.60:0/1887257514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 msgr2=0x7f60341f4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:36.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.902+0000 7f603c6f1640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 0x7f60341f4d80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6030000c00 tx=0x7f6030001120 comp rx=0 tx=0).stop 2024-09-12T01:41:36.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.902+0000 7f603c6f1640 1 -- 172.21.15.60:0/1887257514 shutdown_connections 2024-09-12T01:41:36.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.902+0000 7f603c6f1640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f601806be30 0x7f601806e2f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:36.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.902+0000 7f603c6f1640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6034159fc0 0x7f603415a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:36.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.902+0000 7f603c6f1640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6034157940 0x7f60340cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:36.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.902+0000 7f603c6f1640 1 --2- 172.21.15.60:0/1887257514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60200039b0 0x7f60341f4d80 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:36.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.902+0000 7f603c6f1640 1 -- 172.21.15.60:0/1887257514 >> 172.21.15.60:0/1887257514 conn(0x7f60340d14d0 msgr2=0x7f60340b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:36.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.902+0000 7f603c6f1640 1 -- 172.21.15.60:0/1887257514 shutdown_connections 2024-09-12T01:41:36.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:36.902+0000 7f603c6f1640 1 -- 172.21.15.60:0/1887257514 wait complete. 2024-09-12T01:41:36.913 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:41:36.913 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:41:37.723 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:39.725 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:41.727 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:41.914 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:41:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.029+0000 7f77a1be4640 1 Processor -- start 2024-09-12T01:41:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.029+0000 7f77a1be4640 1 -- start start 2024-09-12T01:41:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f77a1be4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f779c0d3310 0x7f779c0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f77a1be4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f779c0d1650 0x7f779c0b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f77a1be4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779c15ea40 con 0x7f779c15e660 2024-09-12T01:41:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f77a1be4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f779c0d1a90 con 0x7f779c0d3310 2024-09-12T01:41:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f77a1be4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f779c0d3870 con 0x7f779c0d1650 2024-09-12T01:41:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f779bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f779c0d1650 0x7f779c0b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f7793fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f779c0d3310 0x7f779c0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f779bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f779c0d1650 0x7f779c0b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:57246/0 (socket says 172.21.15.60:57246) 2024-09-12T01:41:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f779bfff640 1 -- 172.21.15.60:0/3683828498 learned_addr learned my addr 172.21.15.60:0/3683828498 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f779b7fe640 1 --1- 172.21.15.60:0/3683828498 >> v1:172.21.15.105:6789/0 conn(0x7f779c15e660 0x7f779c0cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:53828/0 (socket says 172.21.15.60:53828) 2024-09-12T01:41:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f7793fff640 1 -- 172.21.15.60:0/3683828498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f779c0d1650 msgr2=0x7f779c0b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f7793fff640 1 --2- 172.21.15.60:0/3683828498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f779c0d1650 0x7f779c0b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f7793fff640 1 -- 172.21.15.60:0/3683828498 >> v1:172.21.15.105:6789/0 conn(0x7f779c15e660 legacy=0x7f779c0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f7793fff640 1 -- 172.21.15.60:0/3683828498 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c0d3b50 con 0x7f779c0d3310 2024-09-12T01:41:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.030+0000 7f779bfff640 1 --2- 172.21.15.60:0/3683828498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f779c0d1650 0x7f779c0b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:41:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.031+0000 7f7793fff640 1 --2- 172.21.15.60:0/3683828498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f779c0d3310 0x7f779c0d1110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f77840097a0 tx=0x7f778402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a93687735115bb00 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.031+0000 7f779affd640 1 -- 172.21.15.60:0/3683828498 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784037070 con 0x7f779c0d3310 2024-09-12T01:41:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.031+0000 7f779affd640 1 -- 172.21.15.60:0/3683828498 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7784032440 con 0x7f779c0d3310 2024-09-12T01:41:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.031+0000 7f779affd640 1 -- 172.21.15.60:0/3683828498 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784032810 con 0x7f779c0d3310 2024-09-12T01:41:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.032+0000 7f77a1be4640 1 -- 172.21.15.60:0/3683828498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f779c0d3310 msgr2=0x7f779c0d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.032+0000 7f77a1be4640 1 --2- 172.21.15.60:0/3683828498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f779c0d3310 0x7f779c0d1110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f77840097a0 tx=0x7f778402a180 comp rx=0 tx=0).stop 2024-09-12T01:41:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.032+0000 7f77a1be4640 1 -- 172.21.15.60:0/3683828498 shutdown_connections 2024-09-12T01:41:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.032+0000 7f77a1be4640 1 --2- 172.21.15.60:0/3683828498 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f779c0d1650 0x7f779c0b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.032+0000 7f77a1be4640 1 --2- 172.21.15.60:0/3683828498 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f779c0d3310 0x7f779c0d1110 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.032+0000 7f77a1be4640 1 -- 172.21.15.60:0/3683828498 >> 172.21.15.60:0/3683828498 conn(0x7f779c0b6410 msgr2=0x7f779c0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.032+0000 7f77a1be4640 1 -- 172.21.15.60:0/3683828498 shutdown_connections 2024-09-12T01:41:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.032+0000 7f77a1be4640 1 -- 172.21.15.60:0/3683828498 wait complete. 2024-09-12T01:41:42.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.033+0000 7f77a1be4640 1 Processor -- start 2024-09-12T01:41:42.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.033+0000 7f77a1be4640 1 -- start start 2024-09-12T01:41:42.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.034+0000 7f77a1be4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f779c0d1650 0x7f779c15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:42.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.034+0000 7f77a1be4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f779c0d3310 0x7f779c153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:42.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.034+0000 7f77a1be4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779c15e660 0x7f779c15d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:42.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.034+0000 7f77a1be4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f779c0d43f0 con 0x7f779c15e660 2024-09-12T01:41:42.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.034+0000 7f77a1be4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f779c0d4110 con 0x7f779c0d1650 2024-09-12T01:41:42.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.034+0000 7f77a1be4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f779c0b80b0 con 0x7f779c0d3310 2024-09-12T01:41:42.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.034+0000 7f779bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779c15e660 0x7f779c15d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:42.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.034+0000 7f779bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779c15e660 0x7f779c15d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50124/0 (socket says 172.21.15.60:50124) 2024-09-12T01:41:42.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.034+0000 7f779bfff640 1 -- 172.21.15.60:0/3503243071 learned_addr learned my addr 172.21.15.60:0/3503243071 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:42.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.034+0000 7f7793fff640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f779c0d3310 0x7f779c153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:42.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.034+0000 7f779b7fe640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f779c0d1650 0x7f779c15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:42.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.035+0000 7f779bfff640 1 -- 172.21.15.60:0/3503243071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f779c0d3310 msgr2=0x7f779c153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:42.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.035+0000 7f779bfff640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f779c0d3310 0x7f779c153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:42.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.035+0000 7f779bfff640 1 -- 172.21.15.60:0/3503243071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f779c0d1650 msgr2=0x7f779c15b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:42.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.035+0000 7f779bfff640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f779c0d1650 0x7f779c15b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:42.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.035+0000 7f779bfff640 1 -- 172.21.15.60:0/3503243071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779c153df0 con 0x7f779c15e660 2024-09-12T01:41:42.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.035+0000 7f779b7fe640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f779c0d1650 0x7f779c15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:42.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.035+0000 7f779bfff640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779c15e660 0x7f779c15d7a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7794009f10 tx=0x7f779400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.035+0000 7f7798ff9640 1 -- 172.21.15.60:0/3503243071 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f779400cc40 con 0x7f779c15e660 2024-09-12T01:41:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.035+0000 7f7798ff9640 1 -- 172.21.15.60:0/3503243071 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f779400cde0 con 0x7f779c15e660 2024-09-12T01:41:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.035+0000 7f77a1be4640 1 -- 172.21.15.60:0/3503243071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779c1540d0 con 0x7f779c15e660 2024-09-12T01:41:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.035+0000 7f7798ff9640 1 -- 172.21.15.60:0/3503243071 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7794003bb0 con 0x7f779c15e660 2024-09-12T01:41:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.035+0000 7f77a1be4640 1 -- 172.21.15.60:0/3503243071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f779c15f140 con 0x7f779c15e660 2024-09-12T01:41:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.036+0000 7f77a1be4640 1 -- 172.21.15.60:0/3503243071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f779c15ec70 con 0x7f779c15e660 2024-09-12T01:41:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.037+0000 7f7798ff9640 1 -- 172.21.15.60:0/3503243071 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f779401b030 con 0x7f779c15e660 2024-09-12T01:41:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.037+0000 7f7798ff9640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f777c06be30 0x7f777c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:42.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.037+0000 7f7798ff9640 1 -- 172.21.15.60:0/3503243071 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f779408b240 con 0x7f779c15e660 2024-09-12T01:41:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.037+0000 7f779b7fe640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f777c06be30 0x7f777c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.038+0000 7f779b7fe640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f777c06be30 0x7f777c06e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f778c007fd0 tx=0x7f778c007d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:42.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.042+0000 7f7798ff9640 1 -- 172.21.15.60:0/3503243071 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7794022020 con 0x7f779c15e660 2024-09-12T01:41:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.257+0000 7f77a1be4640 1 -- 172.21.15.60:0/3503243071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f779c0b7b70 con 0x7f779c15e660 2024-09-12T01:41:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.257+0000 7f7798ff9640 1 -- 172.21.15.60:0/3503243071 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f7794010040 con 0x7f779c15e660 2024-09-12T01:41:42.258 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:42.258 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:41:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.259+0000 7f77a1be4640 1 -- 172.21.15.60:0/3503243071 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f777c06be30 msgr2=0x7f777c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.259+0000 7f77a1be4640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f777c06be30 0x7f777c06e2f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f778c007fd0 tx=0x7f778c007d60 comp rx=0 tx=0).stop 2024-09-12T01:41:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.259+0000 7f77a1be4640 1 -- 172.21.15.60:0/3503243071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779c15e660 msgr2=0x7f779c15d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.259+0000 7f77a1be4640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779c15e660 0x7f779c15d7a0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7794009f10 tx=0x7f779400c490 comp rx=0 tx=0).stop 2024-09-12T01:41:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.259+0000 7f77a1be4640 1 -- 172.21.15.60:0/3503243071 shutdown_connections 2024-09-12T01:41:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.259+0000 7f77a1be4640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f779c15e660 0x7f779c15d7a0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.259+0000 7f77a1be4640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f777c06be30 0x7f777c06e2f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.259+0000 7f77a1be4640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f779c0d3310 0x7f779c153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.259+0000 7f77a1be4640 1 --2- 172.21.15.60:0/3503243071 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f779c0d1650 0x7f779c15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.259+0000 7f77a1be4640 1 -- 172.21.15.60:0/3503243071 >> 172.21.15.60:0/3503243071 conn(0x7f779c0b6410 msgr2=0x7f779c156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:42.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.259+0000 7f77a1be4640 1 -- 172.21.15.60:0/3503243071 shutdown_connections 2024-09-12T01:41:42.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42.259+0000 7f77a1be4640 1 -- 172.21.15.60:0/3503243071 wait complete. 2024-09-12T01:41:42.270 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:41:42.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:42 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-12T01:41:43.729 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:41:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:stdin closed, goodbye! 2024-09-12T01:41:43.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:41:43.749 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:41:43.749 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:41:43.832 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:41:43.881 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:41:43.881 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:41:43.882 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 400\nabs_path = "/home/ubuntu/cephtest/mnt.0/subdir"\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi060') 2024-09-12T01:41:43.882 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:41:43.882 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:41:43.902 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:41:43.902 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:41:43.961 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:41:44.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.113+0000 7fad6e065640 1 Processor -- start 2024-09-12T01:41:44.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.113+0000 7fad6e065640 1 -- start start 2024-09-12T01:41:44.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.113+0000 7fad6e065640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad6815e7a0 0x7fad6806caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:44.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.114+0000 7fad6e065640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad680b68f0 0x7fad680d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.114+0000 7fad6e065640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad680cf860 con 0x7fad680cf1f0 2024-09-12T01:41:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.114+0000 7fad6e065640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fad680d2ca0 con 0x7fad6815e7a0 2024-09-12T01:41:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.114+0000 7fad6e065640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad680cfb40 con 0x7fad680b68f0 2024-09-12T01:41:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.114+0000 7fad677fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad6815e7a0 0x7fad6806caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.114+0000 7fad677fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad6815e7a0 0x7fad6806caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36918/0 (socket says 172.21.15.60:36918) 2024-09-12T01:41:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.114+0000 7fad677fe640 1 -- 172.21.15.60:0/150704988 learned_addr learned my addr 172.21.15.60:0/150704988 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.114+0000 7fad67fff640 1 --2- 172.21.15.60:0/150704988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad680b68f0 0x7fad680d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.114+0000 7fad677fe640 1 -- 172.21.15.60:0/150704988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad680b68f0 msgr2=0x7fad680d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.114+0000 7fad677fe640 1 --2- 172.21.15.60:0/150704988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad680b68f0 0x7fad680d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.114+0000 7fad677fe640 1 -- 172.21.15.60:0/150704988 >> v1:172.21.15.105:6789/0 conn(0x7fad680cf1f0 legacy=0x7fad680b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.114+0000 7fad677fe640 1 -- 172.21.15.60:0/150704988 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad680cfe20 con 0x7fad6815e7a0 2024-09-12T01:41:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.115+0000 7fad677fe640 1 --2- 172.21.15.60:0/150704988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad6815e7a0 0x7fad6806caa0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fad58009870 tx=0x7fad5802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972b9dc284588854 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.115+0000 7fad667fc640 1 -- 172.21.15.60:0/150704988 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58037070 con 0x7fad6815e7a0 2024-09-12T01:41:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.115+0000 7fad667fc640 1 -- 172.21.15.60:0/150704988 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad58032440 con 0x7fad6815e7a0 2024-09-12T01:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.115+0000 7fad667fc640 1 -- 172.21.15.60:0/150704988 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad58032810 con 0x7fad6815e7a0 2024-09-12T01:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.115+0000 7fad6e065640 1 -- 172.21.15.60:0/150704988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad6815e7a0 msgr2=0x7fad6806caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.115+0000 7fad6e065640 1 --2- 172.21.15.60:0/150704988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad6815e7a0 0x7fad6806caa0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fad58009870 tx=0x7fad5802a180 comp rx=0 tx=0).stop 2024-09-12T01:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.116+0000 7fad6e065640 1 -- 172.21.15.60:0/150704988 shutdown_connections 2024-09-12T01:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.116+0000 7fad6e065640 1 --2- 172.21.15.60:0/150704988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad680b68f0 0x7fad680d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.116+0000 7fad6e065640 1 --2- 172.21.15.60:0/150704988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad6815e7a0 0x7fad6806caa0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.116+0000 7fad6e065640 1 -- 172.21.15.60:0/150704988 >> 172.21.15.60:0/150704988 conn(0x7fad680d11e0 msgr2=0x7fad680d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.116+0000 7fad6e065640 1 -- 172.21.15.60:0/150704988 shutdown_connections 2024-09-12T01:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.116+0000 7fad6e065640 1 -- 172.21.15.60:0/150704988 wait complete. 2024-09-12T01:41:44.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.117+0000 7fad6e065640 1 Processor -- start 2024-09-12T01:41:44.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.117+0000 7fad6e065640 1 -- start start 2024-09-12T01:41:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad6e065640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad680b68f0 0x7fad68158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad6e065640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad680cf1f0 0x7fad680cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad6e065640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad6815e7a0 0x7fad681f81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad6e065640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fad6806cfe0 con 0x7fad6815e7a0 2024-09-12T01:41:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad6e065640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fad680b7a00 con 0x7fad680b68f0 2024-09-12T01:41:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad6e065640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fad6815eb80 con 0x7fad680cf1f0 2024-09-12T01:41:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad67fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad6815e7a0 0x7fad681f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad67fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad6815e7a0 0x7fad681f81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36924/0 (socket says 172.21.15.60:36924) 2024-09-12T01:41:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad67fff640 1 -- 172.21.15.60:0/935581543 learned_addr learned my addr 172.21.15.60:0/935581543 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad677fe640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad680b68f0 0x7fad68158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad66ffd640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad680cf1f0 0x7fad680cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad67fff640 1 -- 172.21.15.60:0/935581543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad680cf1f0 msgr2=0x7fad680cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad67fff640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad680cf1f0 0x7fad680cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad67fff640 1 -- 172.21.15.60:0/935581543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad680b68f0 msgr2=0x7fad68158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad67fff640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad680b68f0 0x7fad68158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad67fff640 1 -- 172.21.15.60:0/935581543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad680cbbf0 con 0x7fad6815e7a0 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad677fe640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad680b68f0 0x7fad68158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.118+0000 7fad67fff640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad6815e7a0 0x7fad681f81a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fad6000cc30 tx=0x7fad6000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.119+0000 7fad4ffff640 1 -- 172.21.15.60:0/935581543 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6000ce40 con 0x7fad6815e7a0 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.119+0000 7fad4ffff640 1 -- 172.21.15.60:0/935581543 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad60003990 con 0x7fad6815e7a0 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.119+0000 7fad6e065640 1 -- 172.21.15.60:0/935581543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad680cbed0 con 0x7fad6815e7a0 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.119+0000 7fad4ffff640 1 -- 172.21.15.60:0/935581543 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60003d40 con 0x7fad6815e7a0 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.119+0000 7fad6e065640 1 -- 172.21.15.60:0/935581543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad680cc490 con 0x7fad6815e7a0 2024-09-12T01:41:44.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.120+0000 7fad6e065640 1 -- 172.21.15.60:0/935581543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad6806caa0 con 0x7fad6815e7a0 2024-09-12T01:41:44.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.120+0000 7fad4ffff640 1 -- 172.21.15.60:0/935581543 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fad60003ee0 con 0x7fad6815e7a0 2024-09-12T01:41:44.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.121+0000 7fad4ffff640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad5406be30 0x7fad5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:44.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.121+0000 7fad4ffff640 1 -- 172.21.15.60:0/935581543 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fad6008b300 con 0x7fad6815e7a0 2024-09-12T01:41:44.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.121+0000 7fad677fe640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad5406be30 0x7fad5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:44.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.121+0000 7fad677fe640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad5406be30 0x7fad5406e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fad58034000 tx=0x7fad5802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:44.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.125+0000 7fad4ffff640 1 -- 172.21.15.60:0/935581543 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fad60014030 con 0x7fad6815e7a0 2024-09-12T01:41:44.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.311+0000 7fad6e065640 1 -- 172.21.15.60:0/935581543 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fad6815bda0 con 0x7fad6815e7a0 2024-09-12T01:41:44.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.311+0000 7fad4ffff640 1 -- 172.21.15.60:0/935581543 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v80) ==== 80+0+0 (secure 0 0 0) 0x7fad60059cb0 con 0x7fad6815e7a0 2024-09-12T01:41:44.312 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:41:44.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.313+0000 7fad6e065640 1 -- 172.21.15.60:0/935581543 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad5406be30 msgr2=0x7fad5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:44.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.313+0000 7fad6e065640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad5406be30 0x7fad5406e2f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fad58034000 tx=0x7fad5802e000 comp rx=0 tx=0).stop 2024-09-12T01:41:44.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.313+0000 7fad6e065640 1 -- 172.21.15.60:0/935581543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad6815e7a0 msgr2=0x7fad681f81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:44.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.313+0000 7fad6e065640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad6815e7a0 0x7fad681f81a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fad6000cc30 tx=0x7fad6000a5c0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.313+0000 7fad6e065640 1 -- 172.21.15.60:0/935581543 shutdown_connections 2024-09-12T01:41:44.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.313+0000 7fad6e065640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad6815e7a0 0x7fad681f81a0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.313+0000 7fad6e065640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fad5406be30 0x7fad5406e2f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.313+0000 7fad6e065640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad680cf1f0 0x7fad680cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.313+0000 7fad6e065640 1 --2- 172.21.15.60:0/935581543 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad680b68f0 0x7fad68158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.313+0000 7fad6e065640 1 -- 172.21.15.60:0/935581543 >> 172.21.15.60:0/935581543 conn(0x7fad680d11e0 msgr2=0x7fad680d3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:44.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.313+0000 7fad6e065640 1 -- 172.21.15.60:0/935581543 shutdown_connections 2024-09-12T01:41:44.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.313+0000 7fad6e065640 1 -- 172.21.15.60:0/935581543 wait complete. 2024-09-12T01:41:44.325 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:41:44.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:44.326 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:41:44.385 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:41:44.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:44.386 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:41:44.406 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:41:44.406 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:41:44.407 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:41:44.424 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:41:44.424 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:41:44.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:41:44.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.583+0000 7fe93b166640 1 Processor -- start 2024-09-12T01:41:44.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.583+0000 7fe93b166640 1 -- start start 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe93b166640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe93415b480 0x7fe9340b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe93b166640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe934072700 0x7fe93415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe93b166640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9340ccff0 con 0x7fe9340b60c0 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe93b166640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe9340b6500 con 0x7fe934072700 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe93b166640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe9340cd2d0 con 0x7fe93415b480 2024-09-12T01:41:44.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe933fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe9340b60c0 0x7fe934071ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47794/0 (socket says 172.21.15.60:47794) 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe933fff640 1 -- 172.21.15.60:0/3797630266 learned_addr learned my addr 172.21.15.60:0/3797630266 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe939703640 1 --2- 172.21.15.60:0/3797630266 >> v2:172.21.15.105:3300/0 conn(0x7fe934072700 0x7fe93415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe938f02640 1 --2- 172.21.15.60:0/3797630266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe93415b480 0x7fe9340b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe9337fe640 1 -- 172.21.15.60:0/3797630266 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2511957290 0 0) 0x7fe9340ccff0 con 0x7fe9340b60c0 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe9337fe640 1 -- 172.21.15.60:0/3797630266 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe924003520 con 0x7fe9340b60c0 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe938f02640 1 -- 172.21.15.60:0/3797630266 >> v2:172.21.15.105:3300/0 conn(0x7fe934072700 msgr2=0x7fe93415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe938f02640 1 --2- 172.21.15.60:0/3797630266 >> v2:172.21.15.105:3300/0 conn(0x7fe934072700 0x7fe93415bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.584+0000 7fe938f02640 1 -- 172.21.15.60:0/3797630266 >> v1:172.21.15.60:6789/0 conn(0x7fe9340b60c0 legacy=0x7fe934071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.585+0000 7fe9337fe640 1 -- 172.21.15.60:0/3797630266 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 975656228 0 0) 0x7fe924003520 con 0x7fe9340b60c0 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.585+0000 7fe938f02640 1 -- 172.21.15.60:0/3797630266 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9340cd5b0 con 0x7fe93415b480 2024-09-12T01:41:44.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.585+0000 7fe939703640 1 --2- 172.21.15.60:0/3797630266 >> v2:172.21.15.105:3300/0 conn(0x7fe934072700 0x7fe93415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.585+0000 7fe938f02640 1 --2- 172.21.15.60:0/3797630266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe93415b480 0x7fe9340b5b80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe9280097a0 tx=0x7fe92802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf13d8ab039f8754 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.585+0000 7fe9337fe640 1 -- 172.21.15.60:0/3797630266 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928037070 con 0x7fe93415b480 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.586+0000 7fe9337fe640 1 -- 172.21.15.60:0/3797630266 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe92802ab10 con 0x7fe93415b480 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.586+0000 7fe9337fe640 1 -- 172.21.15.60:0/3797630266 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920001670 con 0x7fe93415b480 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.586+0000 7fe93b166640 1 -- 172.21.15.60:0/3797630266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe93415b480 msgr2=0x7fe9340b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.586+0000 7fe93b166640 1 --2- 172.21.15.60:0/3797630266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe93415b480 0x7fe9340b5b80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe9280097a0 tx=0x7fe92802a080 comp rx=0 tx=0).stop 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.586+0000 7fe93b166640 1 -- 172.21.15.60:0/3797630266 shutdown_connections 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.586+0000 7fe93b166640 1 --2- 172.21.15.60:0/3797630266 >> v2:172.21.15.105:3300/0 conn(0x7fe934072700 0x7fe93415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.586+0000 7fe93b166640 1 --2- 172.21.15.60:0/3797630266 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe93415b480 0x7fe9340b5b80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.586+0000 7fe93b166640 1 -- 172.21.15.60:0/3797630266 >> 172.21.15.60:0/3797630266 conn(0x7fe93406d0f0 msgr2=0x7fe93406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.586+0000 7fe93b166640 1 -- 172.21.15.60:0/3797630266 shutdown_connections 2024-09-12T01:41:44.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.586+0000 7fe93b166640 1 -- 172.21.15.60:0/3797630266 wait complete. 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.587+0000 7fe93b166640 1 Processor -- start 2024-09-12T01:41:44.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.587+0000 7fe93b166640 1 -- start start 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.588+0000 7fe93b166640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe934072700 0x7fe934140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.588+0000 7fe93b166640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340b60c0 0x7fe9340c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.588+0000 7fe93b166640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe93415b480 0x7fe934141430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.588+0000 7fe93b166640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe93415b860 con 0x7fe9340b60c0 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.588+0000 7fe93b166640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe9340cdb70 con 0x7fe93415b480 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.588+0000 7fe93b166640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe93415b9e0 con 0x7fe934072700 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.588+0000 7fe933fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340b60c0 0x7fe9340c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.588+0000 7fe933fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340b60c0 0x7fe9340c5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36938/0 (socket says 172.21.15.60:36938) 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.588+0000 7fe933fff640 1 -- 172.21.15.60:0/2973105022 learned_addr learned my addr 172.21.15.60:0/2973105022 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.588+0000 7fe939703640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe93415b480 0x7fe934141430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.588+0000 7fe938f02640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe934072700 0x7fe934140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:44.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.589+0000 7fe933fff640 1 -- 172.21.15.60:0/2973105022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe934072700 msgr2=0x7fe934140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.589+0000 7fe933fff640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe934072700 0x7fe934140d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.589+0000 7fe933fff640 1 -- 172.21.15.60:0/2973105022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe93415b480 msgr2=0x7fe934141430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.589+0000 7fe933fff640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe93415b480 0x7fe934141430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.589+0000 7fe933fff640 1 -- 172.21.15.60:0/2973105022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9341512a0 con 0x7fe9340b60c0 2024-09-12T01:41:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.589+0000 7fe933fff640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340b60c0 0x7fe9340c5520 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe92000c780 tx=0x7fe92000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.589+0000 7fe9317fa640 1 -- 172.21.15.60:0/2973105022 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920017070 con 0x7fe9340b60c0 2024-09-12T01:41:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.589+0000 7fe9317fa640 1 -- 172.21.15.60:0/2973105022 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe920005ad0 con 0x7fe9340b60c0 2024-09-12T01:41:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.589+0000 7fe93b166640 1 -- 172.21.15.60:0/2973105022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe934151580 con 0x7fe9340b60c0 2024-09-12T01:41:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.589+0000 7fe9317fa640 1 -- 172.21.15.60:0/2973105022 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe920007070 con 0x7fe9340b60c0 2024-09-12T01:41:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.589+0000 7fe93b166640 1 -- 172.21.15.60:0/2973105022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe934151b40 con 0x7fe9340b60c0 2024-09-12T01:41:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.590+0000 7fe93b166640 1 -- 172.21.15.60:0/2973105022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9340b5b80 con 0x7fe9340b60c0 2024-09-12T01:41:44.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.591+0000 7fe9317fa640 1 -- 172.21.15.60:0/2973105022 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe92001a070 con 0x7fe9340b60c0 2024-09-12T01:41:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.591+0000 7fe9317fa640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe91806be30 0x7fe91806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.591+0000 7fe9317fa640 1 -- 172.21.15.60:0/2973105022 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fe92008a130 con 0x7fe9340b60c0 2024-09-12T01:41:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.591+0000 7fe938f02640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe91806be30 0x7fe91806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:44.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.591+0000 7fe938f02640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe91806be30 0x7fe91806e2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe928034000 tx=0x7fe92802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:44.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.595+0000 7fe9317fa640 1 -- 172.21.15.60:0/2973105022 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe9200584a0 con 0x7fe9340b60c0 2024-09-12T01:41:44.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.782+0000 7fe93b166640 1 -- 172.21.15.60:0/2973105022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe934071230 con 0x7fe9340b60c0 2024-09-12T01:41:44.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.782+0000 7fe9317fa640 1 -- 172.21.15.60:0/2973105022 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v80) ==== 80+0+0 (secure 0 0 0) 0x7fe92005c7a0 con 0x7fe9340b60c0 2024-09-12T01:41:44.784 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:41:44.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.784+0000 7fe93b166640 1 -- 172.21.15.60:0/2973105022 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe91806be30 msgr2=0x7fe91806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:44.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.784+0000 7fe93b166640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe91806be30 0x7fe91806e2f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe928034000 tx=0x7fe92802e000 comp rx=0 tx=0).stop 2024-09-12T01:41:44.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.784+0000 7fe93b166640 1 -- 172.21.15.60:0/2973105022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340b60c0 msgr2=0x7fe9340c5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:44.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.784+0000 7fe93b166640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340b60c0 0x7fe9340c5520 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe92000c780 tx=0x7fe92000cb80 comp rx=0 tx=0).stop 2024-09-12T01:41:44.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.784+0000 7fe93b166640 1 -- 172.21.15.60:0/2973105022 shutdown_connections 2024-09-12T01:41:44.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.784+0000 7fe93b166640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe93415b480 0x7fe934141430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.784+0000 7fe93b166640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9340b60c0 0x7fe9340c5520 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.784+0000 7fe93b166640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe91806be30 0x7fe91806e2f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.784+0000 7fe93b166640 1 --2- 172.21.15.60:0/2973105022 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe934072700 0x7fe934140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:44.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.784+0000 7fe93b166640 1 -- 172.21.15.60:0/2973105022 >> 172.21.15.60:0/2973105022 conn(0x7fe93406d0f0 msgr2=0x7fe934157660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:44.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.784+0000 7fe93b166640 1 -- 172.21.15.60:0/2973105022 shutdown_connections 2024-09-12T01:41:44.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:44.784+0000 7fe93b166640 1 -- 172.21.15.60:0/2973105022 wait complete. 2024-09-12T01:41:44.795 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:41:44.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:44.795 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T01:41:44.826 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:41:44.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:41:44.826 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:41:44.884 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:41:44.884 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:41:44.884 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:41:44.901 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:41:44.901 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:41:44.901 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:41:44.901 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:41:44.940 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:41:44.941 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:41:45.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.043+0000 7f61ba8f1640 1 Processor -- start 2024-09-12T01:41:45.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.043+0000 7f61ba8f1640 1 -- start start 2024-09-12T01:41:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.044+0000 7f61ba8f1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f61b415c2b0 0x7f61b40b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.044+0000 7f61ba8f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b415fb10 con 0x7f61b40b72f0 2024-09-12T01:41:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.044+0000 7f61ba8f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b40b5900 con 0x7f61b415f200 2024-09-12T01:41:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.044+0000 7f61ba8f1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f61b415f830 con 0x7f61b415c2b0 2024-09-12T01:41:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.044+0000 7f61b3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f61b415c2b0 0x7f61b40b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.044+0000 7f61b3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f61b415c2b0 0x7f61b40b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36948/0 (socket says 172.21.15.60:36948) 2024-09-12T01:41:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.044+0000 7f61b3fff640 1 -- 172.21.15.60:0/2862536068 learned_addr learned my addr 172.21.15.60:0/2862536068 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.044+0000 7f61b37fe640 1 --1- 172.21.15.60:0/2862536068 >> v1:172.21.15.60:6789/0 conn(0x7f61b40b72f0 0x7f61b415eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47802/0 (socket says 172.21.15.60:47802) 2024-09-12T01:41:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.044+0000 7f61b3fff640 1 -- 172.21.15.60:0/2862536068 >> v1:172.21.15.105:6789/0 conn(0x7f61b415f200 legacy=0x7f61b406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.044+0000 7f61b3fff640 1 -- 172.21.15.60:0/2862536068 >> v1:172.21.15.60:6789/0 conn(0x7f61b40b72f0 legacy=0x7f61b415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.044+0000 7f61b3fff640 1 -- 172.21.15.60:0/2862536068 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b406ce30 con 0x7f61b415c2b0 2024-09-12T01:41:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.045+0000 7f61b3fff640 1 --2- 172.21.15.60:0/2862536068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b415c2b0 0x7f61b40b6db0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009870 tx=0x7f61a402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ba9bf005c0b191 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.045+0000 7f61b2ffd640 1 -- 172.21.15.60:0/2862536068 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4037070 con 0x7f61b415c2b0 2024-09-12T01:41:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.045+0000 7f61b2ffd640 1 -- 172.21.15.60:0/2862536068 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a4032440 con 0x7f61b415c2b0 2024-09-12T01:41:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.045+0000 7f61b2ffd640 1 -- 172.21.15.60:0/2862536068 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4032810 con 0x7f61b415c2b0 2024-09-12T01:41:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.045+0000 7f61ba8f1640 1 -- 172.21.15.60:0/2862536068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b415c2b0 msgr2=0x7f61b40b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.045+0000 7f61ba8f1640 1 --2- 172.21.15.60:0/2862536068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b415c2b0 0x7f61b40b6db0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009870 tx=0x7f61a402a2a0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.045+0000 7f61ba8f1640 1 -- 172.21.15.60:0/2862536068 shutdown_connections 2024-09-12T01:41:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.045+0000 7f61ba8f1640 1 --2- 172.21.15.60:0/2862536068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b415c2b0 0x7f61b40b6db0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.045+0000 7f61ba8f1640 1 -- 172.21.15.60:0/2862536068 >> 172.21.15.60:0/2862536068 conn(0x7f61b40b4240 msgr2=0x7f61b40b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.046+0000 7f61ba8f1640 1 -- 172.21.15.60:0/2862536068 shutdown_connections 2024-09-12T01:41:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.046+0000 7f61ba8f1640 1 -- 172.21.15.60:0/2862536068 wait complete. 2024-09-12T01:41:45.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.047+0000 7f61ba8f1640 1 Processor -- start 2024-09-12T01:41:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.047+0000 7f61ba8f1640 1 -- start start 2024-09-12T01:41:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61ba8f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b40b72f0 0x7f61b41f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61ba8f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61b415c2b0 0x7f61b41f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61ba8f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b415f200 0x7f61b40cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61ba8f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f61b40b7760 con 0x7f61b40b72f0 2024-09-12T01:41:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61ba8f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f61b406d3f0 con 0x7f61b415c2b0 2024-09-12T01:41:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61ba8f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f61b406e020 con 0x7f61b415f200 2024-09-12T01:41:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b40b72f0 0x7f61b41f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b40b72f0 0x7f61b41f9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36964/0 (socket says 172.21.15.60:36964) 2024-09-12T01:41:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b3fff640 1 -- 172.21.15.60:0/955271381 learned_addr learned my addr 172.21.15.60:0/955271381 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b37fe640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61b415c2b0 0x7f61b41f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b8e8e640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b415f200 0x7f61b40cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b3fff640 1 -- 172.21.15.60:0/955271381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b415f200 msgr2=0x7f61b40cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b3fff640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b415f200 0x7f61b40cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b3fff640 1 -- 172.21.15.60:0/955271381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61b415c2b0 msgr2=0x7f61b41f99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b3fff640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61b415c2b0 0x7f61b41f99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b3fff640 1 -- 172.21.15.60:0/955271381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b4153c70 con 0x7f61b40b72f0 2024-09-12T01:41:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b3fff640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b40b72f0 0x7f61b41f9fc0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009870 tx=0x7f61a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b0ff9640 1 -- 172.21.15.60:0/955271381 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4041070 con 0x7f61b40b72f0 2024-09-12T01:41:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b0ff9640 1 -- 172.21.15.60:0/955271381 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61a403c870 con 0x7f61b40b72f0 2024-09-12T01:41:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61ba8f1640 1 -- 172.21.15.60:0/955271381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b40cd090 con 0x7f61b40b72f0 2024-09-12T01:41:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.048+0000 7f61b0ff9640 1 -- 172.21.15.60:0/955271381 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4037040 con 0x7f61b40b72f0 2024-09-12T01:41:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.049+0000 7f61ba8f1640 1 -- 172.21.15.60:0/955271381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b40cd650 con 0x7f61b40b72f0 2024-09-12T01:41:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.049+0000 7f61ba8f1640 1 -- 172.21.15.60:0/955271381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b4153e40 con 0x7f61b40b72f0 2024-09-12T01:41:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.050+0000 7f61b0ff9640 1 -- 172.21.15.60:0/955271381 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61a4044070 con 0x7f61b40b72f0 2024-09-12T01:41:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.050+0000 7f61b0ff9640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f61a006be30 0x7f61a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.051+0000 7f61b0ff9640 1 -- 172.21.15.60:0/955271381 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f61a40abb40 con 0x7f61b40b72f0 2024-09-12T01:41:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.051+0000 7f61b37fe640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f61a006be30 0x7f61a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.051+0000 7f61b37fe640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f61a006be30 0x7f61a006e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f61b4155310 tx=0x7f61a8007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:45.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.055+0000 7f61b0ff9640 1 -- 172.21.15.60:0/955271381 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61a407a050 con 0x7f61b40b72f0 2024-09-12T01:41:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.266+0000 7f61ba8f1640 1 -- 172.21.15.60:0/955271381 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61b40b6db0 con 0x7f61b40b72f0 2024-09-12T01:41:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.266+0000 7f61b0ff9640 1 -- 172.21.15.60:0/955271381 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5231 (secure 0 0 0) 0x7f61a407e350 con 0x7f61b40b72f0 2024-09-12T01:41:45.267 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:45.267 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":47,"btime":"2024-09-12T01:40:42:484201+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5824,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4036885582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4036885582},{"type":"v1","addr":"172.21.15.105:6835","nonce":4036885582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2254947663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2254947663},{"type":"v1","addr":"172.21.15.60:6835","nonce":2254947663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3019966407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3019966407},{"type":"v1","addr":"172.21.15.60:6837","nonce":3019966407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:39:13.254252+0000","modified":"2024-09-12T01:40:41.926406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35375":{"gid":35375,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.105:6834/95793246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":95793246},{"type":"v1","addr":"172.21.15.105:6834","nonce":95793246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35375,"qdb_cluster":[35375]},"id":6}]} 2024-09-12T01:41:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 47 2024-09-12T01:41:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.269+0000 7f61ba8f1640 1 -- 172.21.15.60:0/955271381 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f61a006be30 msgr2=0x7f61a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.269+0000 7f61ba8f1640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f61a006be30 0x7f61a006e2f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f61b4155310 tx=0x7f61a8007e80 comp rx=0 tx=0).stop 2024-09-12T01:41:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.269+0000 7f61ba8f1640 1 -- 172.21.15.60:0/955271381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b40b72f0 msgr2=0x7f61b41f9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.269+0000 7f61ba8f1640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b40b72f0 0x7f61b41f9fc0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f61a4009870 tx=0x7f61a40046c0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.269+0000 7f61ba8f1640 1 -- 172.21.15.60:0/955271381 shutdown_connections 2024-09-12T01:41:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.269+0000 7f61ba8f1640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f61a006be30 0x7f61a006e2f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.269+0000 7f61ba8f1640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b415f200 0x7f61b40cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.269+0000 7f61ba8f1640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61b415c2b0 0x7f61b41f99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.269+0000 7f61ba8f1640 1 --2- 172.21.15.60:0/955271381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b40b72f0 0x7f61b41f9fc0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.269+0000 7f61ba8f1640 1 -- 172.21.15.60:0/955271381 >> 172.21.15.60:0/955271381 conn(0x7f61b40b4240 msgr2=0x7f61b41607d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.269+0000 7f61ba8f1640 1 -- 172.21.15.60:0/955271381 shutdown_connections 2024-09-12T01:41:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.269+0000 7f61ba8f1640 1 -- 172.21.15.60:0/955271381 wait complete. 2024-09-12T01:41:45.280 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:41:45.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.382+0000 7f333daf8640 1 Processor -- start 2024-09-12T01:41:45.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.382+0000 7f333daf8640 1 -- start start 2024-09-12T01:41:45.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.383+0000 7f333daf8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f333815e660 0x7f33380cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.383+0000 7f333daf8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33380d3310 0x7f33380d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.383+0000 7f333daf8640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f333815ea40 con 0x7f33380d1650 2024-09-12T01:41:45.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.383+0000 7f333daf8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f33380d1ac0 con 0x7f33380d3310 2024-09-12T01:41:45.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.383+0000 7f333daf8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f33380d3870 con 0x7f333815e660 2024-09-12T01:41:45.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.383+0000 7f3336ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33380d3310 0x7f33380d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.383+0000 7f3337fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f33380d1650 0x7f333806bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47816/0 (socket says 172.21.15.60:47816) 2024-09-12T01:41:45.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.383+0000 7f3337fff640 1 -- 172.21.15.60:0/2429424737 learned_addr learned my addr 172.21.15.60:0/2429424737 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:45.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.384+0000 7f33377fe640 1 --2- 172.21.15.60:0/2429424737 >> v2:172.21.15.105:3300/0 conn(0x7f333815e660 0x7f33380cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.384+0000 7f3336ffd640 1 -- 172.21.15.60:0/2429424737 >> v2:172.21.15.105:3300/0 conn(0x7f333815e660 msgr2=0x7f33380cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:45.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.384+0000 7f3336ffd640 1 --2- 172.21.15.60:0/2429424737 >> v2:172.21.15.105:3300/0 conn(0x7f333815e660 0x7f33380cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.384+0000 7f3336ffd640 1 -- 172.21.15.60:0/2429424737 >> v1:172.21.15.60:6789/0 conn(0x7f33380d1650 legacy=0x7f333806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.384+0000 7f3336ffd640 1 -- 172.21.15.60:0/2429424737 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33380d3b50 con 0x7f33380d3310 2024-09-12T01:41:45.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.384+0000 7f33367fc640 1 -- 172.21.15.60:0/2429424737 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364766983 0 0) 0x7f333815ea40 con 0x7f33380d1650 2024-09-12T01:41:45.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.385+0000 7f3336ffd640 1 --2- 172.21.15.60:0/2429424737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33380d3310 0x7f33380d1110 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f33380d10e0 tx=0x7f332c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293533cca2e34c2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:45.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.385+0000 7f33367fc640 1 -- 172.21.15.60:0/2429424737 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c037070 con 0x7f33380d3310 2024-09-12T01:41:45.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.385+0000 7f33367fc640 1 -- 172.21.15.60:0/2429424737 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f332c032440 con 0x7f33380d3310 2024-09-12T01:41:45.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.385+0000 7f33367fc640 1 -- 172.21.15.60:0/2429424737 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c032810 con 0x7f33380d3310 2024-09-12T01:41:45.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.385+0000 7f333daf8640 1 -- 172.21.15.60:0/2429424737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33380d3310 msgr2=0x7f33380d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.385+0000 7f333daf8640 1 --2- 172.21.15.60:0/2429424737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33380d3310 0x7f33380d1110 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f33380d10e0 tx=0x7f332c02a1a0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.385+0000 7f333daf8640 1 -- 172.21.15.60:0/2429424737 shutdown_connections 2024-09-12T01:41:45.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.385+0000 7f333daf8640 1 --2- 172.21.15.60:0/2429424737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33380d3310 0x7f33380d1110 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.385+0000 7f333daf8640 1 --2- 172.21.15.60:0/2429424737 >> v2:172.21.15.105:3300/0 conn(0x7f333815e660 0x7f33380cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.385+0000 7f333daf8640 1 -- 172.21.15.60:0/2429424737 >> 172.21.15.60:0/2429424737 conn(0x7f33380b6410 msgr2=0x7f33380b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:45.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.385+0000 7f333daf8640 1 -- 172.21.15.60:0/2429424737 shutdown_connections 2024-09-12T01:41:45.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.385+0000 7f333daf8640 1 -- 172.21.15.60:0/2429424737 wait complete. 2024-09-12T01:41:45.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.386+0000 7f333daf8640 1 Processor -- start 2024-09-12T01:41:45.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.387+0000 7f333daf8640 1 -- start start 2024-09-12T01:41:45.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.387+0000 7f333daf8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33380d1650 0x7f3338160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.387+0000 7f333daf8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33380d3310 0x7f33380b9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.387+0000 7f333daf8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f333815e660 0x7f33380b9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.387+0000 7f333daf8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f33380d43f0 con 0x7f333815e660 2024-09-12T01:41:45.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.387+0000 7f333daf8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f33380d4110 con 0x7f33380d3310 2024-09-12T01:41:45.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.387+0000 7f333daf8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f33380cfc70 con 0x7f33380d1650 2024-09-12T01:41:45.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f3337fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f333815e660 0x7f33380b9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f3337fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f333815e660 0x7f33380b9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36994/0 (socket says 172.21.15.60:36994) 2024-09-12T01:41:45.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f3337fff640 1 -- 172.21.15.60:0/1895482662 learned_addr learned my addr 172.21.15.60:0/1895482662 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:45.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f33377fe640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33380d1650 0x7f3338160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f3336ffd640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33380d3310 0x7f33380b9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f3337fff640 1 -- 172.21.15.60:0/1895482662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33380d1650 msgr2=0x7f3338160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f3337fff640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33380d1650 0x7f3338160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f3337fff640 1 -- 172.21.15.60:0/1895482662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33380d3310 msgr2=0x7f33380b9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f3337fff640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33380d3310 0x7f33380b9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f3337fff640 1 -- 172.21.15.60:0/1895482662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33381614b0 con 0x7f333815e660 2024-09-12T01:41:45.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f3337fff640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f333815e660 0x7f33380b9f80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f333000c780 tx=0x7f333000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:45.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f331ffff640 1 -- 172.21.15.60:0/1895482662 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3330018070 con 0x7f333815e660 2024-09-12T01:41:45.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f331ffff640 1 -- 172.21.15.60:0/1895482662 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333000a640 con 0x7f333815e660 2024-09-12T01:41:45.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f333daf8640 1 -- 172.21.15.60:0/1895482662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3338154a30 con 0x7f333815e660 2024-09-12T01:41:45.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f331ffff640 1 -- 172.21.15.60:0/1895482662 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333000aa30 con 0x7f333815e660 2024-09-12T01:41:45.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.388+0000 7f333daf8640 1 -- 172.21.15.60:0/1895482662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3338154ff0 con 0x7f333815e660 2024-09-12T01:41:45.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.389+0000 7f333daf8640 1 -- 172.21.15.60:0/1895482662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33380d1110 con 0x7f333815e660 2024-09-12T01:41:45.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.390+0000 7f331ffff640 1 -- 172.21.15.60:0/1895482662 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f333001b070 con 0x7f333815e660 2024-09-12T01:41:45.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.390+0000 7f331ffff640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f332406be30 0x7f332406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.390+0000 7f331ffff640 1 -- 172.21.15.60:0/1895482662 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f333008a400 con 0x7f333815e660 2024-09-12T01:41:45.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.390+0000 7f33377fe640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f332406be30 0x7f332406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.391+0000 7f33377fe640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f332406be30 0x7f332406e2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3328006fd0 tx=0x7f3328008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:45.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.395+0000 7f331ffff640 1 -- 172.21.15.60:0/1895482662 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f33381614b0 con 0x7f333815e660 2024-09-12T01:41:45.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.607+0000 7f333daf8640 1 -- 172.21.15.60:0/1895482662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33381616e0 con 0x7f333815e660 2024-09-12T01:41:45.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.608+0000 7f331ffff640 1 -- 172.21.15.60:0/1895482662 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5231 (secure 0 0 0) 0x7f3330058db0 con 0x7f333815e660 2024-09-12T01:41:45.608 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:45.609 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":47,"btime":"2024-09-12T01:40:42:484201+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5824,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4036885582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4036885582},{"type":"v1","addr":"172.21.15.105:6835","nonce":4036885582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2254947663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2254947663},{"type":"v1","addr":"172.21.15.60:6835","nonce":2254947663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3019966407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3019966407},{"type":"v1","addr":"172.21.15.60:6837","nonce":3019966407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:39:13.254252+0000","modified":"2024-09-12T01:40:41.926406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35375":{"gid":35375,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.105:6834/95793246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":95793246},{"type":"v1","addr":"172.21.15.105:6834","nonce":95793246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35375,"qdb_cluster":[35375]},"id":6}]} 2024-09-12T01:41:45.609 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 47 2024-09-12T01:41:45.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.610+0000 7f333daf8640 1 -- 172.21.15.60:0/1895482662 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f332406be30 msgr2=0x7f332406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.610+0000 7f333daf8640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f332406be30 0x7f332406e2f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3328006fd0 tx=0x7f3328008040 comp rx=0 tx=0).stop 2024-09-12T01:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.610+0000 7f333daf8640 1 -- 172.21.15.60:0/1895482662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f333815e660 msgr2=0x7f33380b9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.610+0000 7f333daf8640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f333815e660 0x7f33380b9f80 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f333000c780 tx=0x7f333000cc40 comp rx=0 tx=0).stop 2024-09-12T01:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.610+0000 7f333daf8640 1 -- 172.21.15.60:0/1895482662 shutdown_connections 2024-09-12T01:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.610+0000 7f333daf8640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f333815e660 0x7f33380b9f80 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.610+0000 7f333daf8640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33380d3310 0x7f33380b9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.610+0000 7f333daf8640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f332406be30 0x7f332406e2f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.610+0000 7f333daf8640 1 --2- 172.21.15.60:0/1895482662 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33380d1650 0x7f3338160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.610+0000 7f333daf8640 1 -- 172.21.15.60:0/1895482662 >> 172.21.15.60:0/1895482662 conn(0x7f33380b6410 msgr2=0x7f33380cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.610+0000 7f333daf8640 1 -- 172.21.15.60:0/1895482662 shutdown_connections 2024-09-12T01:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.610+0000 7f333daf8640 1 -- 172.21.15.60:0/1895482662 wait complete. 2024-09-12T01:41:45.622 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:41:45.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.724+0000 7fe879768640 1 Processor -- start 2024-09-12T01:41:45.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.725+0000 7fe879768640 1 -- start start 2024-09-12T01:41:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.725+0000 7fe879768640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8740d0fe0 0x7fe87406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.725+0000 7fe879768640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87415f130 con 0x7fe87415b460 2024-09-12T01:41:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.725+0000 7fe879768640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87415f410 con 0x7fe87406d260 2024-09-12T01:41:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.725+0000 7fe879768640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe87406d6b0 con 0x7fe8740d0fe0 2024-09-12T01:41:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.726+0000 7fe872ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe87415b460 0x7fe8740b44b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47824/0 (socket says 172.21.15.60:47824) 2024-09-12T01:41:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.726+0000 7fe872ffd640 1 -- 172.21.15.60:0/4166458304 learned_addr learned my addr 172.21.15.60:0/4166458304 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.726+0000 7fe86bfff640 1 --2- 172.21.15.60:0/4166458304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8740d0fe0 0x7fe87406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.726+0000 7fe8727fc640 1 -- 172.21.15.60:0/4166458304 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803044033 0 0) 0x7fe87415f130 con 0x7fe87415b460 2024-09-12T01:41:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.726+0000 7fe8727fc640 1 -- 172.21.15.60:0/4166458304 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe860003520 con 0x7fe87415b460 2024-09-12T01:41:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.726+0000 7fe8727fc640 1 -- 172.21.15.60:0/4166458304 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654889827 0 0) 0x7fe87415f410 con 0x7fe87406d260 2024-09-12T01:41:45.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.726+0000 7fe8727fc640 1 -- 172.21.15.60:0/4166458304 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe87415f130 con 0x7fe87406d260 2024-09-12T01:41:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.726+0000 7fe8727fc640 1 -- 172.21.15.60:0/4166458304 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3040952973 0 0) 0x7fe860003520 con 0x7fe87415b460 2024-09-12T01:41:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.726+0000 7fe86bfff640 1 -- 172.21.15.60:0/4166458304 >> v1:172.21.15.105:6789/0 conn(0x7fe87406d260 legacy=0x7fe8740b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.726+0000 7fe86bfff640 1 -- 172.21.15.60:0/4166458304 >> v1:172.21.15.60:6789/0 conn(0x7fe87415b460 legacy=0x7fe8740b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.726+0000 7fe86bfff640 1 -- 172.21.15.60:0/4166458304 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87415f6f0 con 0x7fe8740d0fe0 2024-09-12T01:41:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.727+0000 7fe86bfff640 1 --2- 172.21.15.60:0/4166458304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8740d0fe0 0x7fe87406cd20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0097d0 tx=0x7fe85c02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30c2b8e7bce89ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.727+0000 7fe8727fc640 1 -- 172.21.15.60:0/4166458304 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c037070 con 0x7fe8740d0fe0 2024-09-12T01:41:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.727+0000 7fe8727fc640 1 -- 172.21.15.60:0/4166458304 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85c02ac30 con 0x7fe8740d0fe0 2024-09-12T01:41:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.727+0000 7fe8727fc640 1 -- 172.21.15.60:0/4166458304 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe864001670 con 0x7fe8740d0fe0 2024-09-12T01:41:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.728+0000 7fe879768640 1 -- 172.21.15.60:0/4166458304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8740d0fe0 msgr2=0x7fe87406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.728+0000 7fe879768640 1 --2- 172.21.15.60:0/4166458304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8740d0fe0 0x7fe87406cd20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe85c0097d0 tx=0x7fe85c02a1a0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.728+0000 7fe879768640 1 -- 172.21.15.60:0/4166458304 shutdown_connections 2024-09-12T01:41:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.728+0000 7fe879768640 1 --2- 172.21.15.60:0/4166458304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8740d0fe0 0x7fe87406cd20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.728+0000 7fe879768640 1 -- 172.21.15.60:0/4166458304 >> 172.21.15.60:0/4166458304 conn(0x7fe8740b6ec0 msgr2=0x7fe8740b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.728+0000 7fe879768640 1 -- 172.21.15.60:0/4166458304 shutdown_connections 2024-09-12T01:41:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.728+0000 7fe879768640 1 -- 172.21.15.60:0/4166458304 wait complete. 2024-09-12T01:41:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.729+0000 7fe879768640 1 Processor -- start 2024-09-12T01:41:45.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.729+0000 7fe879768640 1 -- start start 2024-09-12T01:41:45.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe879768640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406d260 0x7fe8740c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe879768640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8740d0fe0 0x7fe874147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe879768640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe87415b460 0x7fe874157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe879768640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe8740b5790 con 0x7fe8740d0fe0 2024-09-12T01:41:45.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe879768640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe87415eee0 con 0x7fe87415b460 2024-09-12T01:41:45.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe879768640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe8740b5910 con 0x7fe87406d260 2024-09-12T01:41:45.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe86bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8740d0fe0 0x7fe874147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe86bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8740d0fe0 0x7fe874147de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37000/0 (socket says 172.21.15.60:37000) 2024-09-12T01:41:45.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe86bfff640 1 -- 172.21.15.60:0/4116413582 learned_addr learned my addr 172.21.15.60:0/4116413582 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:45.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe872ffd640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406d260 0x7fe8740c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe8737fe640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe87415b460 0x7fe874157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe86bfff640 1 -- 172.21.15.60:0/4116413582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406d260 msgr2=0x7fe8740c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe86bfff640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406d260 0x7fe8740c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe86bfff640 1 -- 172.21.15.60:0/4116413582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe87415b460 msgr2=0x7fe874157b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe86bfff640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe87415b460 0x7fe874157b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe86bfff640 1 -- 172.21.15.60:0/4116413582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe874156a60 con 0x7fe8740d0fe0 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe8737fe640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe87415b460 0x7fe874157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe86bfff640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8740d0fe0 0x7fe874147de0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe85c035040 tx=0x7fe85c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.730+0000 7fe86b7fe640 1 -- 172.21.15.60:0/4116413582 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c037050 con 0x7fe8740d0fe0 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.731+0000 7fe879768640 1 -- 172.21.15.60:0/4116413582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe874156d40 con 0x7fe8740d0fe0 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.731+0000 7fe86b7fe640 1 -- 172.21.15.60:0/4116413582 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85c038040 con 0x7fe8740d0fe0 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.731+0000 7fe86b7fe640 1 -- 172.21.15.60:0/4116413582 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c0044e0 con 0x7fe8740d0fe0 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.731+0000 7fe879768640 1 -- 172.21.15.60:0/4116413582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe874157300 con 0x7fe8740d0fe0 2024-09-12T01:41:45.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.731+0000 7fe879768640 1 -- 172.21.15.60:0/4116413582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87406cd20 con 0x7fe8740d0fe0 2024-09-12T01:41:45.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.732+0000 7fe86b7fe640 1 -- 172.21.15.60:0/4116413582 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe85c045020 con 0x7fe8740d0fe0 2024-09-12T01:41:45.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.732+0000 7fe86b7fe640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe85406be30 0x7fe85406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:45.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.733+0000 7fe86b7fe640 1 -- 172.21.15.60:0/4116413582 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fe85c0aad80 con 0x7fe8740d0fe0 2024-09-12T01:41:45.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.733+0000 7fe872ffd640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe85406be30 0x7fe85406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:45.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.733+0000 7fe872ffd640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe85406be30 0x7fe85406e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe8640011e0 tx=0x7fe864001710 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:45.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.737+0000 7fe86b7fe640 1 -- 172.21.15.60:0/4116413582 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe85c04c020 con 0x7fe8740d0fe0 2024-09-12T01:41:45.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.918+0000 7fe879768640 1 -- 172.21.15.60:0/4116413582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe87415d4a0 con 0x7fe8740d0fe0 2024-09-12T01:41:45.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.919+0000 7fe86b7fe640 1 -- 172.21.15.60:0/4116413582 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+16696 (secure 0 0 0) 0x7fe85c079620 con 0x7fe8740d0fe0 2024-09-12T01:41:45.920 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:45.920 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":80,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:39:14.896332+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:39:11.226441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T01:39:12.232247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:41:45.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.921+0000 7fe879768640 1 -- 172.21.15.60:0/4116413582 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe85406be30 msgr2=0x7fe85406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.921+0000 7fe879768640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe85406be30 0x7fe85406e2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe8640011e0 tx=0x7fe864001710 comp rx=0 tx=0).stop 2024-09-12T01:41:45.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.921+0000 7fe879768640 1 -- 172.21.15.60:0/4116413582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8740d0fe0 msgr2=0x7fe874147de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:45.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.921+0000 7fe879768640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8740d0fe0 0x7fe874147de0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe85c035040 tx=0x7fe85c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.921+0000 7fe879768640 1 -- 172.21.15.60:0/4116413582 shutdown_connections 2024-09-12T01:41:45.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.921+0000 7fe879768640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe87415b460 0x7fe874157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.921+0000 7fe879768640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8740d0fe0 0x7fe874147de0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.921+0000 7fe879768640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe85406be30 0x7fe85406e2f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.921+0000 7fe879768640 1 --2- 172.21.15.60:0/4116413582 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe87406d260 0x7fe8740c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:45.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.921+0000 7fe879768640 1 -- 172.21.15.60:0/4116413582 >> 172.21.15.60:0/4116413582 conn(0x7fe8740b6ec0 msgr2=0x7fe87415dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:45.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.921+0000 7fe879768640 1 -- 172.21.15.60:0/4116413582 shutdown_connections 2024-09-12T01:41:45.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:45.921+0000 7fe879768640 1 -- 172.21.15.60:0/4116413582 wait complete. 2024-09-12T01:41:45.933 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:41:45.933 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:41:46.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.035+0000 7f446d752640 1 Processor -- start 2024-09-12T01:41:46.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.035+0000 7f446d752640 1 -- start start 2024-09-12T01:41:46.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f446d752640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f44680b63d0 0x7f44680d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f446d752640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f44680d1c80 0x7f44680b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f446d752640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44680cfc20 con 0x7f44680cf6b0 2024-09-12T01:41:46.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f446d752640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f44680d2ed0 con 0x7f44680b63d0 2024-09-12T01:41:46.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f446d752640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f44680d31b0 con 0x7f44680d1c80 2024-09-12T01:41:46.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f4466ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f44680b63d0 0x7f44680d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f44667fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f44680cf6b0 0x7f44680b7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47840/0 (socket says 172.21.15.60:47840) 2024-09-12T01:41:46.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f44667fc640 1 -- 172.21.15.60:0/2557680027 learned_addr learned my addr 172.21.15.60:0/2557680027 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:46.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f4466ffd640 1 --2- 172.21.15.60:0/2557680027 >> v2:172.21.15.60:3300/0 conn(0x7f44680b63d0 0x7f44680d39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37002/0 (socket says 172.21.15.60:37002) 2024-09-12T01:41:46.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f44677fe640 1 --2- 172.21.15.60:0/2557680027 >> v2:172.21.15.105:3300/0 conn(0x7f44680d1c80 0x7f44680b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f4466ffd640 1 -- 172.21.15.60:0/2557680027 >> v2:172.21.15.105:3300/0 conn(0x7f44680d1c80 msgr2=0x7f44680b7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:46.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f4466ffd640 1 --2- 172.21.15.60:0/2557680027 >> v2:172.21.15.105:3300/0 conn(0x7f44680d1c80 0x7f44680b7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f4466ffd640 1 -- 172.21.15.60:0/2557680027 >> v1:172.21.15.60:6789/0 conn(0x7f44680cf6b0 legacy=0x7f44680b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f4466ffd640 1 -- 172.21.15.60:0/2557680027 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44680d3490 con 0x7f44680b63d0 2024-09-12T01:41:46.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f4465ffb640 1 -- 172.21.15.60:0/2557680027 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1427847982 0 0) 0x7f44680cfc20 con 0x7f44680cf6b0 2024-09-12T01:41:46.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.036+0000 7f44677fe640 1 --2- 172.21.15.60:0/2557680027 >> v2:172.21.15.105:3300/0 conn(0x7f44680d1c80 0x7f44680b7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:41:46.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.037+0000 7f4466ffd640 1 --2- 172.21.15.60:0/2557680027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44680b63d0 0x7f44680d39b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f44680cfb50 tx=0x7f445802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209ecd11b0d7e051 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:46.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.037+0000 7f4465ffb640 1 -- 172.21.15.60:0/2557680027 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4458037070 con 0x7f44680b63d0 2024-09-12T01:41:46.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.037+0000 7f4465ffb640 1 -- 172.21.15.60:0/2557680027 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4458032440 con 0x7f44680b63d0 2024-09-12T01:41:46.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.037+0000 7f4465ffb640 1 -- 172.21.15.60:0/2557680027 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445802ae60 con 0x7f44680b63d0 2024-09-12T01:41:46.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.038+0000 7f446d752640 1 -- 172.21.15.60:0/2557680027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44680b63d0 msgr2=0x7f44680d39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.038+0000 7f446d752640 1 --2- 172.21.15.60:0/2557680027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44680b63d0 0x7f44680d39b0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f44680cfb50 tx=0x7f445802a110 comp rx=0 tx=0).stop 2024-09-12T01:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.038+0000 7f446d752640 1 -- 172.21.15.60:0/2557680027 shutdown_connections 2024-09-12T01:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.038+0000 7f446d752640 1 --2- 172.21.15.60:0/2557680027 >> v2:172.21.15.105:3300/0 conn(0x7f44680d1c80 0x7f44680b7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.038+0000 7f446d752640 1 --2- 172.21.15.60:0/2557680027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44680b63d0 0x7f44680d39b0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.038+0000 7f446d752640 1 -- 172.21.15.60:0/2557680027 >> 172.21.15.60:0/2557680027 conn(0x7f44680d1160 msgr2=0x7f44680d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.038+0000 7f446d752640 1 -- 172.21.15.60:0/2557680027 shutdown_connections 2024-09-12T01:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.038+0000 7f446d752640 1 -- 172.21.15.60:0/2557680027 wait complete. 2024-09-12T01:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.039+0000 7f446d752640 1 Processor -- start 2024-09-12T01:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.039+0000 7f446d752640 1 -- start start 2024-09-12T01:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.040+0000 7f446d752640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44680b63d0 0x7f44680b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.040+0000 7f446d752640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44680cf6b0 0x7f44680ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.040+0000 7f446d752640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44680d1c80 0x7f4468150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.040+0000 7f446d752640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f44680d4070 con 0x7f44680cf6b0 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.040+0000 7f446d752640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f44680d3ef0 con 0x7f44680b63d0 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.040+0000 7f446d752640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f44680b67b0 con 0x7f44680d1c80 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.040+0000 7f44667fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44680cf6b0 0x7f44680ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.040+0000 7f44667fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44680cf6b0 0x7f44680ce200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37008/0 (socket says 172.21.15.60:37008) 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.040+0000 7f44667fc640 1 -- 172.21.15.60:0/3401397273 learned_addr learned my addr 172.21.15.60:0/3401397273 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.040+0000 7f4466ffd640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44680b63d0 0x7f44680b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f44677fe640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44680d1c80 0x7f4468150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f44667fc640 1 -- 172.21.15.60:0/3401397273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44680d1c80 msgr2=0x7f4468150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f44667fc640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44680d1c80 0x7f4468150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f44667fc640 1 -- 172.21.15.60:0/3401397273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44680b63d0 msgr2=0x7f44680b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f44667fc640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44680b63d0 0x7f44680b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f44667fc640 1 -- 172.21.15.60:0/3401397273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44680b2d70 con 0x7f44680cf6b0 2024-09-12T01:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f4466ffd640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44680b63d0 0x7f44680b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f44677fe640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44680d1c80 0x7f4468150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f44667fc640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44680cf6b0 0x7f44680ce200 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c4a0 tx=0x7f445c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f444f7fe640 1 -- 172.21.15.60:0/3401397273 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c018070 con 0x7f44680cf6b0 2024-09-12T01:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f444f7fe640 1 -- 172.21.15.60:0/3401397273 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f445c0074e0 con 0x7f44680cf6b0 2024-09-12T01:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f446d752640 1 -- 172.21.15.60:0/3401397273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44680cd160 con 0x7f44680cf6b0 2024-09-12T01:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f444f7fe640 1 -- 172.21.15.60:0/3401397273 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445c004a20 con 0x7f44680cf6b0 2024-09-12T01:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.041+0000 7f446d752640 1 -- 172.21.15.60:0/3401397273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44680cd720 con 0x7f44680cf6b0 2024-09-12T01:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.042+0000 7f446d752640 1 -- 172.21.15.60:0/3401397273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44680d39b0 con 0x7f44680cf6b0 2024-09-12T01:41:46.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.043+0000 7f444f7fe640 1 -- 172.21.15.60:0/3401397273 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f445c01b070 con 0x7f44680cf6b0 2024-09-12T01:41:46.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.043+0000 7f444f7fe640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f445406be30 0x7f445406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.043+0000 7f444f7fe640 1 -- 172.21.15.60:0/3401397273 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f445c08a130 con 0x7f44680cf6b0 2024-09-12T01:41:46.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.043+0000 7f4466ffd640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f445406be30 0x7f445406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.044+0000 7f4466ffd640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f445406be30 0x7f445406e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4458034000 tx=0x7f445802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:46.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.048+0000 7f444f7fe640 1 -- 172.21.15.60:0/3401397273 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f445c058b70 con 0x7f44680cf6b0 2024-09-12T01:41:46.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.259+0000 7f446d752640 1 -- 172.21.15.60:0/3401397273 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44680b6d00 con 0x7f44680cf6b0 2024-09-12T01:41:46.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.259+0000 7f444f7fe640 1 -- 172.21.15.60:0/3401397273 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5231 (secure 0 0 0) 0x7f445c058470 con 0x7f44680cf6b0 2024-09-12T01:41:46.260 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:46.260 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":47,"btime":"2024-09-12T01:40:42:484201+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5824,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4036885582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4036885582},{"type":"v1","addr":"172.21.15.105:6835","nonce":4036885582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2254947663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2254947663},{"type":"v1","addr":"172.21.15.60:6835","nonce":2254947663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3019966407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3019966407},{"type":"v1","addr":"172.21.15.60:6837","nonce":3019966407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:39:13.254252+0000","modified":"2024-09-12T01:40:41.926406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35375":{"gid":35375,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.105:6834/95793246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":95793246},{"type":"v1","addr":"172.21.15.105:6834","nonce":95793246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35375,"qdb_cluster":[35375]},"id":6}]} 2024-09-12T01:41:46.260 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 47 2024-09-12T01:41:46.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.261+0000 7f446d752640 1 -- 172.21.15.60:0/3401397273 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f445406be30 msgr2=0x7f445406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.261+0000 7f446d752640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f445406be30 0x7f445406e2f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4458034000 tx=0x7f445802e000 comp rx=0 tx=0).stop 2024-09-12T01:41:46.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.261+0000 7f446d752640 1 -- 172.21.15.60:0/3401397273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44680cf6b0 msgr2=0x7f44680ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.261+0000 7f446d752640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44680cf6b0 0x7f44680ce200 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f445c00c4a0 tx=0x7f445c00c960 comp rx=0 tx=0).stop 2024-09-12T01:41:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.262+0000 7f446d752640 1 -- 172.21.15.60:0/3401397273 shutdown_connections 2024-09-12T01:41:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.262+0000 7f446d752640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f445406be30 0x7f445406e2f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.262+0000 7f446d752640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f44680d1c80 0x7f4468150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.262+0000 7f446d752640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f44680cf6b0 0x7f44680ce200 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.262+0000 7f446d752640 1 --2- 172.21.15.60:0/3401397273 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f44680b63d0 0x7f44680b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.262+0000 7f446d752640 1 -- 172.21.15.60:0/3401397273 >> 172.21.15.60:0/3401397273 conn(0x7f44680d1160 msgr2=0x7f44680b77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.262+0000 7f446d752640 1 -- 172.21.15.60:0/3401397273 shutdown_connections 2024-09-12T01:41:46.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.262+0000 7f446d752640 1 -- 172.21.15.60:0/3401397273 wait complete. 2024-09-12T01:41:46.273 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:41:46.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.375+0000 7fe5ddf33640 1 Processor -- start 2024-09-12T01:41:46.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.375+0000 7fe5ddf33640 1 -- start start 2024-09-12T01:41:46.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.375+0000 7fe5ddf33640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5d815e800 0x7fe5d80b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.375+0000 7fe5ddf33640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5d815ebe0 0x7fe5d815f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.375+0000 7fe5ddf33640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5d806ea60 con 0x7fe5d80b6e50 2024-09-12T01:41:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.375+0000 7fe5ddf33640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe5d806ed40 con 0x7fe5d815ebe0 2024-09-12T01:41:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.375+0000 7fe5ddf33640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d806cde0 con 0x7fe5d815e800 2024-09-12T01:41:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.376+0000 7fe5d6ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5d815ebe0 0x7fe5d815f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.376+0000 7fe5d6ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5d815ebe0 0x7fe5d815f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37024/0 (socket says 172.21.15.60:37024) 2024-09-12T01:41:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.376+0000 7fe5d6ffd640 1 -- 172.21.15.60:0/4288608978 learned_addr learned my addr 172.21.15.60:0/4288608978 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.376+0000 7fe5d77fe640 1 --2- 172.21.15.60:0/4288608978 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5d815e800 0x7fe5d80b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.376+0000 7fe5d6ffd640 1 -- 172.21.15.60:0/4288608978 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5d815e800 msgr2=0x7fe5d80b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.376+0000 7fe5d6ffd640 1 --2- 172.21.15.60:0/4288608978 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5d815e800 0x7fe5d80b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.376+0000 7fe5d6ffd640 1 -- 172.21.15.60:0/4288608978 >> v1:172.21.15.105:6789/0 conn(0x7fe5d80b6e50 legacy=0x7fe5d80b7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.376+0000 7fe5d6ffd640 1 -- 172.21.15.60:0/4288608978 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d806d0c0 con 0x7fe5d815ebe0 2024-09-12T01:41:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.377+0000 7fe5d6ffd640 1 --2- 172.21.15.60:0/4288608978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5d815ebe0 0x7fe5d815f040 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009870 tx=0x7fe5cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c03069b8543d69c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.377+0000 7fe5d67fc640 1 -- 172.21.15.60:0/4288608978 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc037070 con 0x7fe5d815ebe0 2024-09-12T01:41:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.377+0000 7fe5d67fc640 1 -- 172.21.15.60:0/4288608978 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc032440 con 0x7fe5d815ebe0 2024-09-12T01:41:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.377+0000 7fe5d67fc640 1 -- 172.21.15.60:0/4288608978 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc032810 con 0x7fe5d815ebe0 2024-09-12T01:41:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.377+0000 7fe5ddf33640 1 -- 172.21.15.60:0/4288608978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5d815ebe0 msgr2=0x7fe5d815f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.377+0000 7fe5ddf33640 1 --2- 172.21.15.60:0/4288608978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5d815ebe0 0x7fe5d815f040 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc009870 tx=0x7fe5cc02a270 comp rx=0 tx=0).stop 2024-09-12T01:41:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.377+0000 7fe5ddf33640 1 -- 172.21.15.60:0/4288608978 shutdown_connections 2024-09-12T01:41:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.377+0000 7fe5ddf33640 1 --2- 172.21.15.60:0/4288608978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5d815ebe0 0x7fe5d815f040 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.377+0000 7fe5ddf33640 1 --2- 172.21.15.60:0/4288608978 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5d815e800 0x7fe5d80b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.377+0000 7fe5ddf33640 1 -- 172.21.15.60:0/4288608978 >> 172.21.15.60:0/4288608978 conn(0x7fe5d80d24d0 msgr2=0x7fe5d80d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:46.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.378+0000 7fe5ddf33640 1 -- 172.21.15.60:0/4288608978 shutdown_connections 2024-09-12T01:41:46.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.378+0000 7fe5ddf33640 1 -- 172.21.15.60:0/4288608978 wait complete. 2024-09-12T01:41:46.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.379+0000 7fe5ddf33640 1 Processor -- start 2024-09-12T01:41:46.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.379+0000 7fe5ddf33640 1 -- start start 2024-09-12T01:41:46.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5ddf33640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5d80b6e50 0x7fe5d8153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5ddf33640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5d815e800 0x7fe5d81555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5ddf33640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5d815ebe0 0x7fe5d81590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5ddf33640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d806e680 con 0x7fe5d80b6e50 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5ddf33640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d80d31e0 con 0x7fe5d815ebe0 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5ddf33640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe5d806e800 con 0x7fe5d815e800 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5d80b6e50 0x7fe5d8153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5d80b6e50 0x7fe5d8153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37026/0 (socket says 172.21.15.60:37026) 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5d77fe640 1 -- 172.21.15.60:0/550018522 learned_addr learned my addr 172.21.15.60:0/550018522 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5d7fff640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5d815ebe0 0x7fe5d81590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5d6ffd640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5d815e800 0x7fe5d81555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5d77fe640 1 -- 172.21.15.60:0/550018522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5d815e800 msgr2=0x7fe5d81555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5d77fe640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5d815e800 0x7fe5d81555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5d77fe640 1 -- 172.21.15.60:0/550018522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5d815ebe0 msgr2=0x7fe5d81590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5d77fe640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5d815ebe0 0x7fe5d81590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5d77fe640 1 -- 172.21.15.60:0/550018522 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d8159630 con 0x7fe5d80b6e50 2024-09-12T01:41:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5d7fff640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5d815ebe0 0x7fe5d81590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5d77fe640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5d80b6e50 0x7fe5d8153eb0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800d800 tx=0x7fe5c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5bffff640 1 -- 172.21.15.60:0/550018522 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800b6c0 con 0x7fe5d80b6e50 2024-09-12T01:41:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5bffff640 1 -- 172.21.15.60:0/550018522 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5c8019070 con 0x7fe5d80b6e50 2024-09-12T01:41:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5bffff640 1 -- 172.21.15.60:0/550018522 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5c800bac0 con 0x7fe5d80b6e50 2024-09-12T01:41:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.380+0000 7fe5ddf33640 1 -- 172.21.15.60:0/550018522 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d8154540 con 0x7fe5d80b6e50 2024-09-12T01:41:46.383 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.381+0000 7fe5ddf33640 1 -- 172.21.15.60:0/550018522 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d8154b00 con 0x7fe5d80b6e50 2024-09-12T01:41:46.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.382+0000 7fe5ddf33640 1 -- 172.21.15.60:0/550018522 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d815f040 con 0x7fe5d80b6e50 2024-09-12T01:41:46.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.382+0000 7fe5bffff640 1 -- 172.21.15.60:0/550018522 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe5c800bc60 con 0x7fe5d80b6e50 2024-09-12T01:41:46.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.382+0000 7fe5bffff640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe5c406be30 0x7fe5c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.383+0000 7fe5bffff640 1 -- 172.21.15.60:0/550018522 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fe5c808b2e0 con 0x7fe5d80b6e50 2024-09-12T01:41:46.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.383+0000 7fe5d6ffd640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe5c406be30 0x7fe5c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.383+0000 7fe5d6ffd640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe5c406be30 0x7fe5c406e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc034000 tx=0x7fe5cc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:46.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.387+0000 7fe5bffff640 1 -- 172.21.15.60:0/550018522 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe5c8059d20 con 0x7fe5d80b6e50 2024-09-12T01:41:46.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.596+0000 7fe5ddf33640 1 -- 172.21.15.60:0/550018522 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5d815ca60 con 0x7fe5d80b6e50 2024-09-12T01:41:46.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.597+0000 7fe5bffff640 1 -- 172.21.15.60:0/550018522 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5231 (secure 0 0 0) 0x7fe5c8059620 con 0x7fe5d80b6e50 2024-09-12T01:41:46.597 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:46.597 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":47,"btime":"2024-09-12T01:40:42:484201+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5824,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4036885582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4036885582},{"type":"v1","addr":"172.21.15.105:6835","nonce":4036885582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2254947663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2254947663},{"type":"v1","addr":"172.21.15.60:6835","nonce":2254947663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3019966407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3019966407},{"type":"v1","addr":"172.21.15.60:6837","nonce":3019966407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:39:13.254252+0000","modified":"2024-09-12T01:40:41.926406+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35375},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35375":{"gid":35375,"name":"d","rank":0,"incarnation":42,"state":"up:active","state_seq":25,"addr":"172.21.15.105:6834/95793246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":95793246},{"type":"v1","addr":"172.21.15.105:6834","nonce":95793246}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35375,"qdb_cluster":[35375]},"id":6}]} 2024-09-12T01:41:46.598 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 47 2024-09-12T01:41:46.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.599+0000 7fe5ddf33640 1 -- 172.21.15.60:0/550018522 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe5c406be30 msgr2=0x7fe5c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.599+0000 7fe5ddf33640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe5c406be30 0x7fe5c406e2f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc034000 tx=0x7fe5cc02e000 comp rx=0 tx=0).stop 2024-09-12T01:41:46.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.599+0000 7fe5ddf33640 1 -- 172.21.15.60:0/550018522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5d80b6e50 msgr2=0x7fe5d8153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.599+0000 7fe5ddf33640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5d80b6e50 0x7fe5d8153eb0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800d800 tx=0x7fe5c800dcc0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.599+0000 7fe5ddf33640 1 -- 172.21.15.60:0/550018522 shutdown_connections 2024-09-12T01:41:46.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.599+0000 7fe5ddf33640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5d815ebe0 0x7fe5d81590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.599+0000 7fe5ddf33640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe5c406be30 0x7fe5c406e2f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.599+0000 7fe5ddf33640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5d815e800 0x7fe5d81555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.599+0000 7fe5ddf33640 1 --2- 172.21.15.60:0/550018522 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5d80b6e50 0x7fe5d8153eb0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.599+0000 7fe5ddf33640 1 -- 172.21.15.60:0/550018522 >> 172.21.15.60:0/550018522 conn(0x7fe5d80d24d0 msgr2=0x7fe5d806d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:46.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.599+0000 7fe5ddf33640 1 -- 172.21.15.60:0/550018522 shutdown_connections 2024-09-12T01:41:46.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.599+0000 7fe5ddf33640 1 -- 172.21.15.60:0/550018522 wait complete. 2024-09-12T01:41:46.611 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:41:46.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.713+0000 7f4783528640 1 Processor -- start 2024-09-12T01:41:46.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.713+0000 7f4783528640 1 -- start start 2024-09-12T01:41:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f4783528640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f477c15c170 0x7f477c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f4783528640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f477c0b64e0 0x7f477c0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f4783528640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477c0b4cf0 con 0x7f477c0cf6c0 2024-09-12T01:41:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f4783528640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f477c15ca90 con 0x7f477c15c170 2024-09-12T01:41:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f4783528640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f477c0b49c0 con 0x7f477c0b64e0 2024-09-12T01:41:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f47812c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f477c15c170 0x7f477c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f47812c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f477c15c170 0x7f477c15c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37036/0 (socket says 172.21.15.60:37036) 2024-09-12T01:41:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f47812c4640 1 -- 172.21.15.60:0/3829613832 learned_addr learned my addr 172.21.15.60:0/3829613832 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f4781ac5640 1 --2- 172.21.15.60:0/3829613832 >> v2:172.21.15.105:3300/0 conn(0x7f477c0b64e0 0x7f477c0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f47812c4640 1 -- 172.21.15.60:0/3829613832 >> v2:172.21.15.105:3300/0 conn(0x7f477c0b64e0 msgr2=0x7f477c0cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:46.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f47812c4640 1 --2- 172.21.15.60:0/3829613832 >> v2:172.21.15.105:3300/0 conn(0x7f477c0b64e0 0x7f477c0cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f47812c4640 1 -- 172.21.15.60:0/3829613832 >> v1:172.21.15.105:6789/0 conn(0x7f477c0cf6c0 legacy=0x7f477c0b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:46.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.714+0000 7f47812c4640 1 -- 172.21.15.60:0/3829613832 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c0b4fd0 con 0x7f477c15c170 2024-09-12T01:41:46.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.715+0000 7f47812c4640 1 --2- 172.21.15.60:0/3829613832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477c15c170 0x7f477c15c550 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4778009870 tx=0x7f477802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224dd2a9bd4c47fb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:46.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.715+0000 7f4773fff640 1 -- 172.21.15.60:0/3829613832 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778037070 con 0x7f477c15c170 2024-09-12T01:41:46.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.715+0000 7f4773fff640 1 -- 172.21.15.60:0/3829613832 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4778032440 con 0x7f477c15c170 2024-09-12T01:41:46.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.715+0000 7f4773fff640 1 -- 172.21.15.60:0/3829613832 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778032810 con 0x7f477c15c170 2024-09-12T01:41:46.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.716+0000 7f4783528640 1 -- 172.21.15.60:0/3829613832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477c15c170 msgr2=0x7f477c15c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.716+0000 7f4783528640 1 --2- 172.21.15.60:0/3829613832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477c15c170 0x7f477c15c550 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f4778009870 tx=0x7f477802a1c0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.716+0000 7f4783528640 1 -- 172.21.15.60:0/3829613832 shutdown_connections 2024-09-12T01:41:46.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.716+0000 7f4783528640 1 --2- 172.21.15.60:0/3829613832 >> v2:172.21.15.105:3300/0 conn(0x7f477c0b64e0 0x7f477c0cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.716+0000 7f4783528640 1 --2- 172.21.15.60:0/3829613832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477c15c170 0x7f477c15c550 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.716+0000 7f4783528640 1 -- 172.21.15.60:0/3829613832 >> 172.21.15.60:0/3829613832 conn(0x7f477c06bc10 msgr2=0x7f477c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:46.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.716+0000 7f4783528640 1 -- 172.21.15.60:0/3829613832 shutdown_connections 2024-09-12T01:41:46.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.716+0000 7f4783528640 1 -- 172.21.15.60:0/3829613832 wait complete. 2024-09-12T01:41:46.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.717+0000 7f4783528640 1 Processor -- start 2024-09-12T01:41:46.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.717+0000 7f4783528640 1 -- start start 2024-09-12T01:41:46.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f4783528640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477c0b64e0 0x7f477c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f4783528640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f477c0cf6c0 0x7f477c0ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f4783528640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f477c15c170 0x7f477c15e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f4783528640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f477c0b5870 con 0x7f477c0b64e0 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f4783528640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f477c0b5590 con 0x7f477c15c170 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f4783528640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f477c0b5b50 con 0x7f477c0cf6c0 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f47812c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477c0b64e0 0x7f477c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f47812c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477c0b64e0 0x7f477c0cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37046/0 (socket says 172.21.15.60:37046) 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f47812c4640 1 -- 172.21.15.60:0/261302794 learned_addr learned my addr 172.21.15.60:0/261302794 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f4781ac5640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f477c15c170 0x7f477c15e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f4780ac3640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f477c0cf6c0 0x7f477c0ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f47812c4640 1 -- 172.21.15.60:0/261302794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f477c0cf6c0 msgr2=0x7f477c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f47812c4640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f477c0cf6c0 0x7f477c0ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f47812c4640 1 -- 172.21.15.60:0/261302794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f477c15c170 msgr2=0x7f477c15e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f47812c4640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f477c15c170 0x7f477c15e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f47812c4640 1 -- 172.21.15.60:0/261302794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c1e5e70 con 0x7f477c0b64e0 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f47812c4640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477c0b64e0 0x7f477c0cdba0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4778009870 tx=0x7f47780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f4771ffb640 1 -- 172.21.15.60:0/261302794 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778037040 con 0x7f477c0b64e0 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f4771ffb640 1 -- 172.21.15.60:0/261302794 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4778004230 con 0x7f477c0b64e0 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f4783528640 1 -- 172.21.15.60:0/261302794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477c1e6110 con 0x7f477c0b64e0 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.718+0000 7f4771ffb640 1 -- 172.21.15.60:0/261302794 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778003610 con 0x7f477c0b64e0 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.719+0000 7f4783528640 1 -- 172.21.15.60:0/261302794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f477c0ce2f0 con 0x7f477c0b64e0 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.719+0000 7f4783528640 1 -- 172.21.15.60:0/261302794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f477c0cfb10 con 0x7f477c0b64e0 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.720+0000 7f4771ffb640 1 -- 172.21.15.60:0/261302794 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47780037b0 con 0x7f477c0b64e0 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.720+0000 7f4771ffb640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f476006be30 0x7f476006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.720+0000 7f4771ffb640 1 -- 172.21.15.60:0/261302794 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f47780abb40 con 0x7f477c0b64e0 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.721+0000 7f4780ac3640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f476006be30 0x7f476006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:46.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.721+0000 7f4780ac3640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f476006be30 0x7f476006e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f477c0cf340 tx=0x7f476c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:46.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.725+0000 7f4771ffb640 1 -- 172.21.15.60:0/261302794 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f477807a4f0 con 0x7f477c0b64e0 2024-09-12T01:41:46.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.900+0000 7f4783528640 1 -- 172.21.15.60:0/261302794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f477c06db20 con 0x7f477c0b64e0 2024-09-12T01:41:46.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.901+0000 7f4771ffb640 1 -- 172.21.15.60:0/261302794 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+16696 (secure 0 0 0) 0x7f4778079df0 con 0x7f477c0b64e0 2024-09-12T01:41:46.902 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:46.902 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":80,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:39:14.896332+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:39:11.226441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-12T01:39:12.232247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:41:46.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.903+0000 7f4783528640 1 -- 172.21.15.60:0/261302794 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f476006be30 msgr2=0x7f476006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.903+0000 7f4783528640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f476006be30 0x7f476006e2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f477c0cf340 tx=0x7f476c009040 comp rx=0 tx=0).stop 2024-09-12T01:41:46.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.903+0000 7f4783528640 1 -- 172.21.15.60:0/261302794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477c0b64e0 msgr2=0x7f477c0cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:46.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.903+0000 7f4783528640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477c0b64e0 0x7f477c0cdba0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f4778009870 tx=0x7f47780046c0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.903+0000 7f4783528640 1 -- 172.21.15.60:0/261302794 shutdown_connections 2024-09-12T01:41:46.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.903+0000 7f4783528640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f477c15c170 0x7f477c15e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.903+0000 7f4783528640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f476006be30 0x7f476006e2f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.903+0000 7f4783528640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f477c0cf6c0 0x7f477c0ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.903+0000 7f4783528640 1 --2- 172.21.15.60:0/261302794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f477c0b64e0 0x7f477c0cdba0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:46.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.903+0000 7f4783528640 1 -- 172.21.15.60:0/261302794 >> 172.21.15.60:0/261302794 conn(0x7f477c06bc10 msgr2=0x7f477c072280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:46.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.903+0000 7f4783528640 1 -- 172.21.15.60:0/261302794 shutdown_connections 2024-09-12T01:41:46.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:46.904+0000 7f4783528640 1 -- 172.21.15.60:0/261302794 wait complete. 2024-09-12T01:41:46.915 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:41:47.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.017+0000 7feae7b9f640 1 Processor -- start 2024-09-12T01:41:47.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.017+0000 7feae7b9f640 1 -- start start 2024-09-12T01:41:47.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.018+0000 7feae7b9f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feae015e940 0x7feae00b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.018+0000 7feae7b9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feae00ba440 0x7feae00b6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.018+0000 7feae7b9f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feae015ed20 con 0x7feae00d2290 2024-09-12T01:41:47.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.018+0000 7feae7b9f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7feae00d3ef0 con 0x7feae015e940 2024-09-12T01:41:47.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.018+0000 7feae7b9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feae00d32e0 con 0x7feae00ba440 2024-09-12T01:41:47.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.018+0000 7feae613c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7feae00d2290 0x7feae00cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47844/0 (socket says 172.21.15.60:47844) 2024-09-12T01:41:47.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.018+0000 7feae613c640 1 -- 172.21.15.60:0/3728597831 learned_addr learned my addr 172.21.15.60:0/3728597831 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:47.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.019+0000 7feae593b640 1 --2- 172.21.15.60:0/3728597831 >> v2:172.21.15.105:3300/0 conn(0x7feae015e940 0x7feae00b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.019+0000 7feae513a640 1 --2- 172.21.15.60:0/3728597831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feae00ba440 0x7feae00b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.019+0000 7feae4939640 1 -- 172.21.15.60:0/3728597831 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2886518341 0 0) 0x7feae015ed20 con 0x7feae00d2290 2024-09-12T01:41:47.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.019+0000 7feae4939640 1 -- 172.21.15.60:0/3728597831 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feac8003520 con 0x7feae00d2290 2024-09-12T01:41:47.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.019+0000 7feae593b640 1 -- 172.21.15.60:0/3728597831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feae00ba440 msgr2=0x7feae00b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:47.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.019+0000 7feae593b640 1 --2- 172.21.15.60:0/3728597831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feae00ba440 0x7feae00b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.019+0000 7feae593b640 1 -- 172.21.15.60:0/3728597831 >> v1:172.21.15.60:6789/0 conn(0x7feae00d2290 legacy=0x7feae00cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.019+0000 7feae593b640 1 -- 172.21.15.60:0/3728597831 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae00d35c0 con 0x7feae015e940 2024-09-12T01:41:47.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.020+0000 7feae593b640 1 --2- 172.21.15.60:0/3728597831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae015e940 0x7feae00b6140 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fead0009d90 tx=0x7fead002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=316451919cbdbe85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:47.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.020+0000 7feae4939640 1 -- 172.21.15.60:0/3728597831 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead0031600 con 0x7feae015e940 2024-09-12T01:41:47.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.020+0000 7feae4939640 1 -- 172.21.15.60:0/3728597831 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead00317a0 con 0x7feae015e940 2024-09-12T01:41:47.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.020+0000 7feae4939640 1 -- 172.21.15.60:0/3728597831 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead0031b50 con 0x7feae015e940 2024-09-12T01:41:47.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.021+0000 7feae7b9f640 1 -- 172.21.15.60:0/3728597831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae015e940 msgr2=0x7feae00b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.021+0000 7feae7b9f640 1 --2- 172.21.15.60:0/3728597831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae015e940 0x7feae00b6140 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fead0009d90 tx=0x7fead002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.021+0000 7feae7b9f640 1 -- 172.21.15.60:0/3728597831 shutdown_connections 2024-09-12T01:41:47.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.021+0000 7feae7b9f640 1 --2- 172.21.15.60:0/3728597831 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feae00ba440 0x7feae00b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.021+0000 7feae7b9f640 1 --2- 172.21.15.60:0/3728597831 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae015e940 0x7feae00b6140 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.021+0000 7feae7b9f640 1 -- 172.21.15.60:0/3728597831 >> 172.21.15.60:0/3728597831 conn(0x7feae00d1140 msgr2=0x7feae00d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:47.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.021+0000 7feae7b9f640 1 -- 172.21.15.60:0/3728597831 shutdown_connections 2024-09-12T01:41:47.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.021+0000 7feae7b9f640 1 -- 172.21.15.60:0/3728597831 wait complete. 2024-09-12T01:41:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.022+0000 7feae7b9f640 1 Processor -- start 2024-09-12T01:41:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.022+0000 7feae7b9f640 1 -- start start 2024-09-12T01:41:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae7b9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feae00ba440 0x7feae0151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae7b9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feae00d2290 0x7feae00cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae7b9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae015e940 0x7feae00cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae7b9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7feae00b7510 con 0x7feae00d2290 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae7b9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7feae00d3b80 con 0x7feae015e940 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae7b9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7feae00b8bb0 con 0x7feae00ba440 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae513a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feae00d2290 0x7feae00cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae513a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feae00d2290 0x7feae00cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37060/0 (socket says 172.21.15.60:37060) 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae513a640 1 -- 172.21.15.60:0/347121584 learned_addr learned my addr 172.21.15.60:0/347121584 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae593b640 1 --2- 172.21.15.60:0/347121584 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feae00ba440 0x7feae0151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae613c640 1 --2- 172.21.15.60:0/347121584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae015e940 0x7feae00cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae513a640 1 -- 172.21.15.60:0/347121584 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feae00ba440 msgr2=0x7feae0151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae513a640 1 --2- 172.21.15.60:0/347121584 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feae00ba440 0x7feae0151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae513a640 1 -- 172.21.15.60:0/347121584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae015e940 msgr2=0x7feae00cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae513a640 1 --2- 172.21.15.60:0/347121584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7feae015e940 0x7feae00cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae513a640 1 -- 172.21.15.60:0/347121584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae00cc350 con 0x7feae00d2290 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae513a640 1 --2- 172.21.15.60:0/347121584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feae00d2290 0x7feae00cb790 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fead400e8b0 tx=0x7fead400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:47.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feade7fc640 1 -- 172.21.15.60:0/347121584 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4017070 con 0x7feae00d2290 2024-09-12T01:41:47.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feade7fc640 1 -- 172.21.15.60:0/347121584 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fead400c940 con 0x7feae00d2290 2024-09-12T01:41:47.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feae7b9f640 1 -- 172.21.15.60:0/347121584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae00cc630 con 0x7feae00d2290 2024-09-12T01:41:47.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.023+0000 7feade7fc640 1 -- 172.21.15.60:0/347121584 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead400cd30 con 0x7feae00d2290 2024-09-12T01:41:47.026 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.024+0000 7feae7b9f640 1 -- 172.21.15.60:0/347121584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae00c8270 con 0x7feae00d2290 2024-09-12T01:41:47.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.024+0000 7feae7b9f640 1 -- 172.21.15.60:0/347121584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae00b6140 con 0x7feae00d2290 2024-09-12T01:41:47.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.025+0000 7feade7fc640 1 -- 172.21.15.60:0/347121584 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fead401a070 con 0x7feae00d2290 2024-09-12T01:41:47.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.026+0000 7feade7fc640 1 --2- 172.21.15.60:0/347121584 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feacc06be30 0x7feacc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.026+0000 7feae593b640 1 --2- 172.21.15.60:0/347121584 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feacc06be30 0x7feacc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.026+0000 7feade7fc640 1 -- 172.21.15.60:0/347121584 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7fead408b150 con 0x7feae00d2290 2024-09-12T01:41:47.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.026+0000 7feae593b640 1 --2- 172.21.15.60:0/347121584 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7feacc06be30 0x7feacc06e2f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fead0034000 tx=0x7fead002f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:47.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.030+0000 7feade7fc640 1 -- 172.21.15.60:0/347121584 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fead40594b0 con 0x7feae00d2290 2024-09-12T01:41:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.245+0000 7feae7b9f640 1 -- 172.21.15.60:0/347121584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7feae0073740 con 0x7feae00d2290 2024-09-12T01:41:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.245+0000 7feade7fc640 1 -- 172.21.15.60:0/347121584 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=-1 MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it v47) ==== 316+0+0 (secure 0 0 0) 0x7fead405d7b0 con 0x7feae00d2290 2024-09-12T01:41:47.245 INFO:teuthology.orchestra.run.smithi060.stderr:Error EPERM: MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it 2024-09-12T01:41:47.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:41:47.251 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs --yes-i-really-mean-it 2024-09-12T01:41:47.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.356+0000 7f31db991640 1 Processor -- start 2024-09-12T01:41:47.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.356+0000 7f31db991640 1 -- start start 2024-09-12T01:41:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31db991640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f31d415b480 0x7f31d40b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31db991640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f31d40b60c0 0x7f31d4071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31db991640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31d40ccff0 con 0x7f31d4072530 2024-09-12T01:41:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31db991640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f31d4072980 con 0x7f31d415b480 2024-09-12T01:41:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31db991640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f31d40cd2d0 con 0x7f31d40b60c0 2024-09-12T01:41:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31d972d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f31d415b480 0x7f31d40b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31d972d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f31d415b480 0x7f31d40b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37068/0 (socket says 172.21.15.60:37068) 2024-09-12T01:41:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31d972d640 1 -- 172.21.15.60:0/4269234554 learned_addr learned my addr 172.21.15.60:0/4269234554 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31d8f2c640 1 --2- 172.21.15.60:0/4269234554 >> v2:172.21.15.105:3300/0 conn(0x7f31d40b60c0 0x7f31d4071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31d972d640 1 -- 172.21.15.60:0/4269234554 >> v2:172.21.15.105:3300/0 conn(0x7f31d40b60c0 msgr2=0x7f31d4071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31d972d640 1 --2- 172.21.15.60:0/4269234554 >> v2:172.21.15.105:3300/0 conn(0x7f31d40b60c0 0x7f31d4071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31d972d640 1 -- 172.21.15.60:0/4269234554 >> v1:172.21.15.105:6789/0 conn(0x7f31d4072530 legacy=0x7f31d4070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.357+0000 7f31d972d640 1 -- 172.21.15.60:0/4269234554 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d40cd5b0 con 0x7f31d415b480 2024-09-12T01:41:47.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.358+0000 7f31d972d640 1 --2- 172.21.15.60:0/4269234554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31d415b480 0x7f31d40b5b80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f31d40b2ee0 tx=0x7f31d002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d627cb164484632 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:47.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.358+0000 7f31cbfff640 1 -- 172.21.15.60:0/4269234554 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0036020 con 0x7f31d415b480 2024-09-12T01:41:47.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.358+0000 7f31cbfff640 1 -- 172.21.15.60:0/4269234554 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d0032640 con 0x7f31d415b480 2024-09-12T01:41:47.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.358+0000 7f31cbfff640 1 -- 172.21.15.60:0/4269234554 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0032a10 con 0x7f31d415b480 2024-09-12T01:41:47.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.359+0000 7f31db991640 1 -- 172.21.15.60:0/4269234554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31d415b480 msgr2=0x7f31d40b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.359+0000 7f31db991640 1 --2- 172.21.15.60:0/4269234554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31d415b480 0x7f31d40b5b80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f31d40b2ee0 tx=0x7f31d002c940 comp rx=0 tx=0).stop 2024-09-12T01:41:47.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.359+0000 7f31db991640 1 -- 172.21.15.60:0/4269234554 shutdown_connections 2024-09-12T01:41:47.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.359+0000 7f31db991640 1 --2- 172.21.15.60:0/4269234554 >> v2:172.21.15.105:3300/0 conn(0x7f31d40b60c0 0x7f31d4071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.359+0000 7f31db991640 1 --2- 172.21.15.60:0/4269234554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31d415b480 0x7f31d40b5b80 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.359+0000 7f31db991640 1 -- 172.21.15.60:0/4269234554 >> 172.21.15.60:0/4269234554 conn(0x7f31d406d0f0 msgr2=0x7f31d406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:47.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.359+0000 7f31db991640 1 -- 172.21.15.60:0/4269234554 shutdown_connections 2024-09-12T01:41:47.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.359+0000 7f31db991640 1 -- 172.21.15.60:0/4269234554 wait complete. 2024-09-12T01:41:47.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.360+0000 7f31db991640 1 Processor -- start 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.360+0000 7f31db991640 1 -- start start 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31db991640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31d4072530 0x7f31d4140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31db991640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31d40b60c0 0x7f31d4158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31db991640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31d415b480 0x7f31d40c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31db991640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31d415b860 con 0x7f31d4072530 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31db991640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31d40cdb70 con 0x7f31d415b480 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31db991640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31d415b9e0 con 0x7f31d40b60c0 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31d972d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31d4072530 0x7f31d4140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31d972d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31d4072530 0x7f31d4140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37078/0 (socket says 172.21.15.60:37078) 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31d972d640 1 -- 172.21.15.60:0/1703471082 learned_addr learned my addr 172.21.15.60:0/1703471082 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31d8f2c640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31d40b60c0 0x7f31d4158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31d9f2e640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31d415b480 0x7f31d40c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31d972d640 1 -- 172.21.15.60:0/1703471082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31d40b60c0 msgr2=0x7f31d4158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31d972d640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31d40b60c0 0x7f31d4158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31d972d640 1 -- 172.21.15.60:0/1703471082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31d415b480 msgr2=0x7f31d40c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31d972d640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31d415b480 0x7f31d40c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.361+0000 7f31d972d640 1 -- 172.21.15.60:0/1703471082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d4141130 con 0x7f31d4072530 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.362+0000 7f31d972d640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31d4072530 0x7f31d4140940 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f31d000b2c0 tx=0x7f31d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.362+0000 7f31c9ffb640 1 -- 172.21.15.60:0/1703471082 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0036040 con 0x7f31d4072530 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.362+0000 7f31c9ffb640 1 -- 172.21.15.60:0/1703471082 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d003bc80 con 0x7f31d4072530 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.362+0000 7f31db991640 1 -- 172.21.15.60:0/1703471082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d4141410 con 0x7f31d4072530 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.362+0000 7f31c9ffb640 1 -- 172.21.15.60:0/1703471082 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d0045630 con 0x7f31d4072530 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.362+0000 7f31db991640 1 -- 172.21.15.60:0/1703471082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d41419d0 con 0x7f31d4072530 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.363+0000 7f31db991640 1 -- 172.21.15.60:0/1703471082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d406ad30 con 0x7f31d4072530 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.364+0000 7f31c9ffb640 1 -- 172.21.15.60:0/1703471082 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31d004c060 con 0x7f31d4072530 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.364+0000 7f31c9ffb640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31b806be30 0x7f31b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.364+0000 7f31c9ffb640 1 -- 172.21.15.60:0/1703471082 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5709+0+0 (secure 0 0 0) 0x7f31d00adb80 con 0x7f31d4072530 2024-09-12T01:41:47.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.364+0000 7f31d8f2c640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31b806be30 0x7f31b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.365+0000 7f31d8f2c640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31b806be30 0x7f31b806e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f31d4156dc0 tx=0x7f31c4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:47.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.368+0000 7f31c9ffb640 1 -- 172.21.15.60:0/1703471082 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31d406ad30 con 0x7f31d4072530 2024-09-12T01:41:47.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.579+0000 7f31db991640 1 -- 172.21.15.60:0/1703471082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f31d40cf220 con 0x7f31d4072530 2024-09-12T01:41:47.580 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-12T01:41:47.580+0000 7f58b98dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:41:47.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.581+0000 7f31c9ffb640 1 -- 172.21.15.60:0/1703471082 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) ==== 191+0+0 (secure 0 0 0) 0x7f31d0040070 con 0x7f31d4072530 2024-09-12T01:41:47.582 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:41:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.584+0000 7f31db991640 1 -- 172.21.15.60:0/1703471082 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31b806be30 msgr2=0x7f31b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.584+0000 7f31db991640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31b806be30 0x7f31b806e2f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f31d4156dc0 tx=0x7f31c4009190 comp rx=0 tx=0).stop 2024-09-12T01:41:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.584+0000 7f31db991640 1 -- 172.21.15.60:0/1703471082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31d4072530 msgr2=0x7f31d4140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.584+0000 7f31db991640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31d4072530 0x7f31d4140940 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f31d000b2c0 tx=0x7f31d00046c0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.584+0000 7f31db991640 1 -- 172.21.15.60:0/1703471082 shutdown_connections 2024-09-12T01:41:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.584+0000 7f31db991640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31d415b480 0x7f31d40c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.584+0000 7f31db991640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31b806be30 0x7f31b806e2f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.584+0000 7f31db991640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31d40b60c0 0x7f31d4158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.584+0000 7f31db991640 1 --2- 172.21.15.60:0/1703471082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31d4072530 0x7f31d4140940 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.584+0000 7f31db991640 1 -- 172.21.15.60:0/1703471082 >> 172.21.15.60:0/1703471082 conn(0x7f31d406d0f0 msgr2=0x7f31d4074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.584+0000 7f31db991640 1 -- 172.21.15.60:0/1703471082 shutdown_connections 2024-09-12T01:41:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.585+0000 7f31db991640 1 -- 172.21.15.60:0/1703471082 wait complete. 2024-09-12T01:41:47.596 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:41:47.624 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:41:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.701+0000 7f6e2121e640 1 Processor -- start 2024-09-12T01:41:47.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.701+0000 7f6e2121e640 1 -- start start 2024-09-12T01:41:47.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.701+0000 7f6e2121e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e1c15e4f0 0x7f6e1c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e2121e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e1c15e8d0 0x7f6e1c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e2121e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e1c0af340 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e2121e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6e1c0717d0 con 0x7f6e1c15e8d0 2024-09-12T01:41:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e2121e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1c0af8c0 con 0x7f6e1c15e4f0 2024-09-12T01:41:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e1a59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e1c15e8d0 0x7f6e1c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e1b59e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6e1c0afcd0 0x7f6e1c0b4340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47858/0 (socket says 172.21.15.60:47858) 2024-09-12T01:41:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e1b59e640 1 -- 172.21.15.60:0/1972149532 learned_addr learned my addr 172.21.15.60:0/1972149532 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e1ad9d640 1 --2- 172.21.15.60:0/1972149532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e1c15e4f0 0x7f6e1c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e1a59c640 1 -- 172.21.15.60:0/1972149532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e1c15e4f0 msgr2=0x7f6e1c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e1a59c640 1 --2- 172.21.15.60:0/1972149532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e1c15e4f0 0x7f6e1c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e1a59c640 1 -- 172.21.15.60:0/1972149532 >> v1:172.21.15.60:6789/0 conn(0x7f6e1c0afcd0 legacy=0x7f6e1c0b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e1a59c640 1 -- 172.21.15.60:0/1972149532 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1c0af5e0 con 0x7f6e1c15e8d0 2024-09-12T01:41:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e19d9b640 1 -- 172.21.15.60:0/1972149532 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3832788993 0 0) 0x7f6e1c0af340 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.702+0000 7f6e1ad9d640 1 --2- 172.21.15.60:0/1972149532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e1c15e4f0 0x7f6e1c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:47.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.703+0000 7f6e1a59c640 1 --2- 172.21.15.60:0/1972149532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1c15e8d0 0x7f6e1c0b3830 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6e100097a0 tx=0x7f6e1002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38bff1a8a051285 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:47.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.703+0000 7f6e19d9b640 1 -- 172.21.15.60:0/1972149532 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10037070 con 0x7f6e1c15e8d0 2024-09-12T01:41:47.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.703+0000 7f6e19d9b640 1 -- 172.21.15.60:0/1972149532 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e10032440 con 0x7f6e1c15e8d0 2024-09-12T01:41:47.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.703+0000 7f6e19d9b640 1 -- 172.21.15.60:0/1972149532 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e10032810 con 0x7f6e1c15e8d0 2024-09-12T01:41:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.703+0000 7f6e2121e640 1 -- 172.21.15.60:0/1972149532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1c15e8d0 msgr2=0x7f6e1c0b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.703+0000 7f6e2121e640 1 --2- 172.21.15.60:0/1972149532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1c15e8d0 0x7f6e1c0b3830 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f6e100097a0 tx=0x7f6e1002a180 comp rx=0 tx=0).stop 2024-09-12T01:41:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.703+0000 7f6e2121e640 1 -- 172.21.15.60:0/1972149532 shutdown_connections 2024-09-12T01:41:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.704+0000 7f6e2121e640 1 --2- 172.21.15.60:0/1972149532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1c15e8d0 0x7f6e1c0b3830 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.704+0000 7f6e2121e640 1 --2- 172.21.15.60:0/1972149532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e1c15e4f0 0x7f6e1c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.704+0000 7f6e2121e640 1 -- 172.21.15.60:0/1972149532 >> 172.21.15.60:0/1972149532 conn(0x7f6e1c06bc10 msgr2=0x7f6e1c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.704+0000 7f6e2121e640 1 -- 172.21.15.60:0/1972149532 shutdown_connections 2024-09-12T01:41:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.704+0000 7f6e2121e640 1 -- 172.21.15.60:0/1972149532 wait complete. 2024-09-12T01:41:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.705+0000 7f6e2121e640 1 Processor -- start 2024-09-12T01:41:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.705+0000 7f6e2121e640 1 -- start start 2024-09-12T01:41:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e2121e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1c0afcd0 0x7f6e1c14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e2121e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e1c15e4f0 0x7f6e1c152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e2121e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e1c15e8d0 0x7f6e1c15bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e2121e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c0b4a50 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e2121e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6e1c071a90 con 0x7f6e1c15e4f0 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e2121e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6e1c0b4bd0 con 0x7f6e1c15e8d0 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e1ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1c0afcd0 0x7f6e1c14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e1ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1c0afcd0 0x7f6e1c14fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37082/0 (socket says 172.21.15.60:37082) 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e1ad9d640 1 -- 172.21.15.60:0/2291156339 learned_addr learned my addr 172.21.15.60:0/2291156339 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e1a59c640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e1c15e4f0 0x7f6e1c152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e1b59e640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e1c15e8d0 0x7f6e1c15bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e1ad9d640 1 -- 172.21.15.60:0/2291156339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e1c15e8d0 msgr2=0x7f6e1c15bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e1ad9d640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e1c15e8d0 0x7f6e1c15bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e1ad9d640 1 -- 172.21.15.60:0/2291156339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e1c15e4f0 msgr2=0x7f6e1c152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e1ad9d640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e1c15e4f0 0x7f6e1c152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:47.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e1ad9d640 1 -- 172.21.15.60:0/2291156339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e1c15aa00 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.706+0000 7f6e1ad9d640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1c0afcd0 0x7f6e1c14fb80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00e730 tx=0x7f6e0c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:47.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.707+0000 7f6e037fe640 1 -- 172.21.15.60:0/2291156339 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c00f040 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.707+0000 7f6e037fe640 1 -- 172.21.15.60:0/2291156339 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0c004230 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.707+0000 7f6e2121e640 1 -- 172.21.15.60:0/2291156339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e1c15ace0 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.707+0000 7f6e037fe640 1 -- 172.21.15.60:0/2291156339 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c00ee40 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.707+0000 7f6e2121e640 1 -- 172.21.15.60:0/2291156339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e1c15b2a0 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.708+0000 7f6e2121e640 1 -- 172.21.15.60:0/2291156339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e1c0ce680 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.708+0000 7f6e037fe640 1 -- 172.21.15.60:0/2291156339 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e0c00c6d0 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.709+0000 7f6e037fe640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e0806be30 0x7f6e0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:47.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.709+0000 7f6e037fe640 1 -- 172.21.15.60:0/2291156339 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5795+0+0 (secure 0 0 0) 0x7f6e0c08ab60 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.709+0000 7f6e1a59c640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e0806be30 0x7f6e0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:47.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.709+0000 7f6e1a59c640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e0806be30 0x7f6e0806e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6e10034000 tx=0x7f6e1002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:47.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.713+0000 7f6e037fe640 1 -- 172.21.15.60:0/2291156339 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e0c017020 con 0x7f6e1c0afcd0 2024-09-12T01:41:47.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:47.928+0000 7f6e2121e640 1 -- 172.21.15.60:0/2291156339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6e1c0cf6b0 con 0x7f6e1c0afcd0 2024-09-12T01:41:48.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.613+0000 7f6e037fe640 1 -- 172.21.15.60:0/2291156339 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) ==== 104+0+0 (secure 0 0 0) 0x7f6e0c058e60 con 0x7f6e1c0afcd0 2024-09-12T01:41:48.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.615+0000 7f6e2121e640 1 -- 172.21.15.60:0/2291156339 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e0806be30 msgr2=0x7f6e0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:48.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.615+0000 7f6e2121e640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e0806be30 0x7f6e0806e2f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6e10034000 tx=0x7f6e1002e000 comp rx=0 tx=0).stop 2024-09-12T01:41:48.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.615+0000 7f6e2121e640 1 -- 172.21.15.60:0/2291156339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1c0afcd0 msgr2=0x7f6e1c14fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:48.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.615+0000 7f6e2121e640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1c0afcd0 0x7f6e1c14fb80 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c00e730 tx=0x7f6e0c00ebf0 comp rx=0 tx=0).stop 2024-09-12T01:41:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.616+0000 7f6e2121e640 1 -- 172.21.15.60:0/2291156339 shutdown_connections 2024-09-12T01:41:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.616+0000 7f6e2121e640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e0806be30 0x7f6e0806e2f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.616+0000 7f6e2121e640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e1c15e8d0 0x7f6e1c15bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.616+0000 7f6e2121e640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e1c15e4f0 0x7f6e1c152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.616+0000 7f6e2121e640 1 --2- 172.21.15.60:0/2291156339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e1c0afcd0 0x7f6e1c14fb80 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.616+0000 7f6e2121e640 1 -- 172.21.15.60:0/2291156339 >> 172.21.15.60:0/2291156339 conn(0x7f6e1c06bc10 msgr2=0x7f6e1c0b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.616+0000 7f6e2121e640 1 -- 172.21.15.60:0/2291156339 shutdown_connections 2024-09-12T01:41:48.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.616+0000 7f6e2121e640 1 -- 172.21.15.60:0/2291156339 wait complete. 2024-09-12T01:41:48.629 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:41:48.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.739+0000 7f4396931640 1 Processor -- start 2024-09-12T01:41:48.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.740+0000 7f4396931640 1 -- start start 2024-09-12T01:41:48.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.740+0000 7f4396931640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f43900b3920 0x7f4390162b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:48.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.740+0000 7f4396931640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f439015ed70 con 0x7f43900d29a0 2024-09-12T01:41:48.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.740+0000 7f4396931640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43900d1fa0 con 0x7f439015e990 2024-09-12T01:41:48.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.740+0000 7f4396931640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f43900cff20 con 0x7f43900b3920 2024-09-12T01:41:48.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f4394ece640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f43900d29a0 0x7f43900d2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47870/0 (socket says 172.21.15.60:47870) 2024-09-12T01:41:48.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f4394ece640 1 -- 172.21.15.60:0/1692075000 learned_addr learned my addr 172.21.15.60:0/1692075000 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:48.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f4387fff640 1 --2- 172.21.15.60:0/1692075000 >> v2:172.21.15.105:3300/0 conn(0x7f43900b3920 0x7f4390162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:48.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 714865499 0 0) 0x7f4388001490 con 0x7f43900d29a0 2024-09-12T01:41:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f437c003520 con 0x7f43900d29a0 2024-09-12T01:41:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1303460832 0 0) 0x7f437c003520 con 0x7f43900d29a0 2024-09-12T01:41:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 >> v2:172.21.15.105:3300/0 conn(0x7f43900b3920 msgr2=0x7f4390162b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 --2- 172.21.15.60:0/1692075000 >> v2:172.21.15.105:3300/0 conn(0x7f43900b3920 0x7f4390162b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 >> v1:172.21.15.105:6789/0 conn(0x7f439015e990 legacy=0x7f4390162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43900cf960 con 0x7f43900d29a0 2024-09-12T01:41:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f4388001bc0 con 0x7f43900d29a0 2024-09-12T01:41:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 >> v1:172.21.15.60:6789/0 conn(0x7f43900d29a0 legacy=0x7f43900d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 --2- 172.21.15.60:0/1692075000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f437c0039b0 0x7f437c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 --2- 172.21.15.60:0/1692075000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f437c004800 0x7f437c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 --2- 172.21.15.60:0/1692075000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c0051c0 0x7f437c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:48.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f43900cff20 con 0x7f437c004800 2024-09-12T01:41:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f437c00c160 con 0x7f437c0039b0 2024-09-12T01:41:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f437c00c360 con 0x7f437c0051c0 2024-09-12T01:41:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f4387fff640 1 --2- 172.21.15.60:0/1692075000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f437c004800 0x7f437c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f438ffff640 1 --2- 172.21.15.60:0/1692075000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f437c0039b0 0x7f437c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.741+0000 7f4394ece640 1 --2- 172.21.15.60:0/1692075000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c0051c0 0x7f437c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.742+0000 7f4387fff640 1 -- 172.21.15.60:0/1692075000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c0051c0 msgr2=0x7f437c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.742+0000 7f4387fff640 1 --2- 172.21.15.60:0/1692075000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c0051c0 0x7f437c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.742+0000 7f4387fff640 1 -- 172.21.15.60:0/1692075000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f437c0039b0 msgr2=0x7f437c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.742+0000 7f4387fff640 1 --2- 172.21.15.60:0/1692075000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f437c0039b0 0x7f437c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.742+0000 7f4387fff640 1 -- 172.21.15.60:0/1692075000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f437c003520 con 0x7f437c004800 2024-09-12T01:41:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.742+0000 7f4394ece640 1 -- 172.21.15.60:0/1692075000 reap_dead start 2024-09-12T01:41:48.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.742+0000 7f4387fff640 1 --2- 172.21.15.60:0/1692075000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f437c004800 0x7f437c004c80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4378009ac0 tx=0x7f437c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff0f842cab2d141 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:48.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.743+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378036070 con 0x7f437c004800 2024-09-12T01:41:48.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.743+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4378031400 con 0x7f437c004800 2024-09-12T01:41:48.746 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.743+0000 7f438f7fe640 1 -- 172.21.15.60:0/1692075000 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378009690 con 0x7f437c004800 2024-09-12T01:41:48.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.743+0000 7f4396931640 1 -- 172.21.15.60:0/1692075000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f437c004800 msgr2=0x7f437c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:48.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.743+0000 7f4396931640 1 --2- 172.21.15.60:0/1692075000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f437c004800 0x7f437c004c80 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4378009ac0 tx=0x7f437c005830 comp rx=0 tx=0).stop 2024-09-12T01:41:48.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.743+0000 7f4396931640 1 -- 172.21.15.60:0/1692075000 shutdown_connections 2024-09-12T01:41:48.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.743+0000 7f4396931640 1 --2- 172.21.15.60:0/1692075000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f437c004800 0x7f437c004c80 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:48.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.743+0000 7f4396931640 1 -- 172.21.15.60:0/1692075000 >> 172.21.15.60:0/1692075000 conn(0x7f43900d1200 msgr2=0x7f43900d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:48.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.743+0000 7f4396931640 1 -- 172.21.15.60:0/1692075000 shutdown_connections 2024-09-12T01:41:48.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.743+0000 7f4396931640 1 -- 172.21.15.60:0/1692075000 wait complete. 2024-09-12T01:41:48.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.744+0000 7f4396931640 1 Processor -- start 2024-09-12T01:41:48.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.745+0000 7f4396931640 1 -- start start 2024-09-12T01:41:48.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.745+0000 7f4396931640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c004800 0x7f43900c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:48.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.745+0000 7f4396931640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43900cb160 0x7f43901f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:48.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.745+0000 7f4396931640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43901f4c50 0x7f43901f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:48.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.745+0000 7f4396931640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4390162450 con 0x7f43900cb160 2024-09-12T01:41:48.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.745+0000 7f4396931640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f43900b3d60 con 0x7f43901f4c50 2024-09-12T01:41:48.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.745+0000 7f4396931640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f43901625d0 con 0x7f437c004800 2024-09-12T01:41:48.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.745+0000 7f4387fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43900cb160 0x7f43901f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:48.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.745+0000 7f4387fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43900cb160 0x7f43901f4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37096/0 (socket says 172.21.15.60:37096) 2024-09-12T01:41:48.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.745+0000 7f4387fff640 1 -- 172.21.15.60:0/2690126302 learned_addr learned my addr 172.21.15.60:0/2690126302 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:48.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f438ffff640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c004800 0x7f43900c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:48.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f4394ece640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43901f4c50 0x7f43901f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:48.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f4387fff640 1 -- 172.21.15.60:0/2690126302 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c004800 msgr2=0x7f43900c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:48.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f4387fff640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c004800 0x7f43900c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:48.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f4387fff640 1 -- 172.21.15.60:0/2690126302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43901f4c50 msgr2=0x7f43901f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:48.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f4387fff640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43901f4c50 0x7f43901f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:48.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f4387fff640 1 -- 172.21.15.60:0/2690126302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43900cb5e0 con 0x7f43900cb160 2024-09-12T01:41:48.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f4394ece640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43901f4c50 0x7f43901f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:41:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f4387fff640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43900cb160 0x7f43901f4710 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4378009be0 tx=0x7f4378004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f438d7fa640 1 -- 172.21.15.60:0/2690126302 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437803f020 con 0x7f43900cb160 2024-09-12T01:41:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f438d7fa640 1 -- 172.21.15.60:0/2690126302 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4378037040 con 0x7f43900cb160 2024-09-12T01:41:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f438d7fa640 1 -- 172.21.15.60:0/2690126302 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378036070 con 0x7f43900cb160 2024-09-12T01:41:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f4396931640 1 -- 172.21.15.60:0/2690126302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43900c9550 con 0x7f43900cb160 2024-09-12T01:41:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.746+0000 7f4396931640 1 -- 172.21.15.60:0/2690126302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43900c9b10 con 0x7f43900cb160 2024-09-12T01:41:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.747+0000 7f4396931640 1 -- 172.21.15.60:0/2690126302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4390162960 con 0x7f43900cb160 2024-09-12T01:41:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.748+0000 7f438d7fa640 1 -- 172.21.15.60:0/2690126302 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4378042020 con 0x7f43900cb160 2024-09-12T01:41:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.748+0000 7f438d7fa640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f437006be60 0x7f437006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.748+0000 7f438d7fa640 1 -- 172.21.15.60:0/2690126302 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5795+0+0 (secure 0 0 0) 0x7f43780aaf40 con 0x7f43900cb160 2024-09-12T01:41:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.748+0000 7f438ffff640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f437006be60 0x7f437006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.748+0000 7f438ffff640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f437006be60 0x7f437006e320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4380000c00 tx=0x7f4380009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.752+0000 7f438d7fa640 1 -- 172.21.15.60:0/2690126302 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4378049030 con 0x7f43900cb160 2024-09-12T01:41:48.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:41:48.901 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:41:48.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:48.927+0000 7f4396931640 1 -- 172.21.15.60:0/2690126302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f43900ba700 con 0x7f43900cb160 2024-09-12T01:41:49.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.620+0000 7f438d7fa640 1 -- 172.21.15.60:0/2690126302 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v82) ==== 181+0+0 (secure 0 0 0) 0x7f4378079950 con 0x7f43900cb160 2024-09-12T01:41:49.621 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:41:49.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.624+0000 7f4396931640 1 -- 172.21.15.60:0/2690126302 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f437006be60 msgr2=0x7f437006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:49.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.624+0000 7f4396931640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f437006be60 0x7f437006e320 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4380000c00 tx=0x7f4380009040 comp rx=0 tx=0).stop 2024-09-12T01:41:49.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.624+0000 7f4396931640 1 -- 172.21.15.60:0/2690126302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43900cb160 msgr2=0x7f43901f4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:49.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.624+0000 7f4396931640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43900cb160 0x7f43901f4710 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4378009be0 tx=0x7f4378004730 comp rx=0 tx=0).stop 2024-09-12T01:41:49.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.624+0000 7f4396931640 1 -- 172.21.15.60:0/2690126302 shutdown_connections 2024-09-12T01:41:49.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.624+0000 7f4396931640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f43901f4c50 0x7f43901f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:49.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.624+0000 7f4396931640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43900cb160 0x7f43901f4710 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:49.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.624+0000 7f4396931640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f437006be60 0x7f437006e320 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:49.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.624+0000 7f4396931640 1 --2- 172.21.15.60:0/2690126302 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f437c004800 0x7f43900c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:49.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.624+0000 7f4396931640 1 -- 172.21.15.60:0/2690126302 >> 172.21.15.60:0/2690126302 conn(0x7f43900d1200 msgr2=0x7f4390160790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:49.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.624+0000 7f4396931640 1 -- 172.21.15.60:0/2690126302 shutdown_connections 2024-09-12T01:41:49.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.624+0000 7f4396931640 1 -- 172.21.15.60:0/2690126302 wait complete. 2024-09-12T01:41:49.638 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:41:49.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.748+0000 7f94f4a5c640 1 Processor -- start 2024-09-12T01:41:49.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.748+0000 7f94f4a5c640 1 -- start start 2024-09-12T01:41:49.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.749+0000 7f94f4a5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f0071450 0x7f94f00b7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:49.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.749+0000 7f94f4a5c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f00719c0 con 0x7f94f015c490 2024-09-12T01:41:49.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.749+0000 7f94f4a5c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f00b6ab0 con 0x7f94f006fb10 2024-09-12T01:41:49.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.749+0000 7f94f4a5c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94f00b6860 con 0x7f94f0071450 2024-09-12T01:41:49.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.749+0000 7f94ee59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f94f015c490 0x7f94f006f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47884/0 (socket says 172.21.15.60:47884) 2024-09-12T01:41:49.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.749+0000 7f94ee59c640 1 -- 172.21.15.60:0/2997478988 learned_addr learned my addr 172.21.15.60:0/2997478988 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.749+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2172911139 0 0) 0x7f94f00719c0 con 0x7f94f015c490 2024-09-12T01:41:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.749+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94dc003520 con 0x7f94f015c490 2024-09-12T01:41:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.749+0000 7f94eed9d640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f0071450 0x7f94f00b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2712445954 0 0) 0x7f94dc003520 con 0x7f94f015c490 2024-09-12T01:41:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f0071450 msgr2=0x7f94f00b7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f0071450 0x7f94f00b7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 >> v1:172.21.15.105:6789/0 conn(0x7f94f006fb10 legacy=0x7f94f00d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f00b6d90 con 0x7f94f015c490 2024-09-12T01:41:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f94e0001670 con 0x7f94f015c490 2024-09-12T01:41:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 >> v1:172.21.15.60:6789/0 conn(0x7f94f015c490 legacy=0x7f94f006f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:49.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94dc0039e0 0x7f94dc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc004800 0x7f94dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f0071450 0x7f94dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f94f00b6860 con 0x7f94dc004800 2024-09-12T01:41:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94dc00ba70 con 0x7f94dc0039e0 2024-09-12T01:41:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94dc00bc70 con 0x7f94f0071450 2024-09-12T01:41:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94e7fff640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc004800 0x7f94dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94ee59c640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94dc0039e0 0x7f94dc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94eed9d640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f0071450 0x7f94dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94e7fff640 1 -- 172.21.15.60:0/2997478988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f0071450 msgr2=0x7f94dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94e7fff640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f0071450 0x7f94dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:49.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94e7fff640 1 -- 172.21.15.60:0/2997478988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94dc0039e0 msgr2=0x7f94dc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94e7fff640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94dc0039e0 0x7f94dc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94e7fff640 1 -- 172.21.15.60:0/2997478988 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94dc003520 con 0x7f94dc004800 2024-09-12T01:41:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.750+0000 7f94eed9d640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f0071450 0x7f94dc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.751+0000 7f94e7fff640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc004800 0x7f94dc004c80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f94d8001720 tx=0x7f94dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c08c20f95d8b439 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.751+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d8001370 con 0x7f94dc004800 2024-09-12T01:41:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.751+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d80052d0 con 0x7f94dc004800 2024-09-12T01:41:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.751+0000 7f94edd9b640 1 -- 172.21.15.60:0/2997478988 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d802ab90 con 0x7f94dc004800 2024-09-12T01:41:49.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.751+0000 7f94f4a5c640 1 -- 172.21.15.60:0/2997478988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc004800 msgr2=0x7f94dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.751+0000 7f94f4a5c640 1 --2- 172.21.15.60:0/2997478988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc004800 0x7f94dc004c80 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f94d8001720 tx=0x7f94dc005830 comp rx=0 tx=0).stop 2024-09-12T01:41:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.751+0000 7f94eed9d640 1 -- 172.21.15.60:0/2997478988 reap_dead start 2024-09-12T01:41:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.752+0000 7f94f4a5c640 1 -- 172.21.15.60:0/2997478988 shutdown_connections 2024-09-12T01:41:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.752+0000 7f94f4a5c640 1 -- 172.21.15.60:0/2997478988 >> 172.21.15.60:0/2997478988 conn(0x7f94f00b4240 msgr2=0x7f94f00b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.752+0000 7f94f4a5c640 1 -- 172.21.15.60:0/2997478988 shutdown_connections 2024-09-12T01:41:49.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.752+0000 7f94f4a5c640 1 -- 172.21.15.60:0/2997478988 wait complete. 2024-09-12T01:41:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.753+0000 7f94f4a5c640 1 Processor -- start 2024-09-12T01:41:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.753+0000 7f94f4a5c640 1 -- start start 2024-09-12T01:41:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94f4a5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc004800 0x7f94f015da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94f4a5c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94f015f170 0x7f94f0152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94f4a5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f01530f0 0x7f94f0142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:49.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94f4a5c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f94f00b7590 con 0x7f94dc004800 2024-09-12T01:41:49.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94f4a5c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f94f015c870 con 0x7f94f015f170 2024-09-12T01:41:49.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94f4a5c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94f00b7710 con 0x7f94f01530f0 2024-09-12T01:41:49.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94ee59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc004800 0x7f94f015da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:49.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94ee59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc004800 0x7f94f015da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37118/0 (socket says 172.21.15.60:37118) 2024-09-12T01:41:49.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94ee59c640 1 -- 172.21.15.60:0/978693251 learned_addr learned my addr 172.21.15.60:0/978693251 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:49.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94e7fff640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94f015f170 0x7f94f0152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:49.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94eed9d640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f01530f0 0x7f94f0142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:49.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94ee59c640 1 -- 172.21.15.60:0/978693251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f01530f0 msgr2=0x7f94f0142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:49.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94ee59c640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f01530f0 0x7f94f0142ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:49.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94ee59c640 1 -- 172.21.15.60:0/978693251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94f015f170 msgr2=0x7f94f0152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:49.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94ee59c640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94f015f170 0x7f94f0152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:49.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94ee59c640 1 -- 172.21.15.60:0/978693251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f015e0d0 con 0x7f94dc004800 2024-09-12T01:41:49.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94ee59c640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc004800 0x7f94f015da40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f94e0007340 tx=0x7f94e0007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:49.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94e6ffd640 1 -- 172.21.15.60:0/978693251 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e000f8c0 con 0x7f94dc004800 2024-09-12T01:41:49.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94e6ffd640 1 -- 172.21.15.60:0/978693251 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e0018070 con 0x7f94dc004800 2024-09-12T01:41:49.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94f4a5c640 1 -- 172.21.15.60:0/978693251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f015e3b0 con 0x7f94dc004800 2024-09-12T01:41:49.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.754+0000 7f94e6ffd640 1 -- 172.21.15.60:0/978693251 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e000fca0 con 0x7f94dc004800 2024-09-12T01:41:49.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.755+0000 7f94f4a5c640 1 -- 172.21.15.60:0/978693251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f015e970 con 0x7f94dc004800 2024-09-12T01:41:49.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.755+0000 7f94f4a5c640 1 -- 172.21.15.60:0/978693251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f00b5f50 con 0x7f94dc004800 2024-09-12T01:41:49.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.756+0000 7f94e6ffd640 1 -- 172.21.15.60:0/978693251 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f94e001d460 con 0x7f94dc004800 2024-09-12T01:41:49.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.756+0000 7f94e6ffd640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f94d006be30 0x7f94d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:49.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.757+0000 7f94e6ffd640 1 -- 172.21.15.60:0/978693251 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5357+0+0 (secure 0 0 0) 0x7f94e008ac80 con 0x7f94dc004800 2024-09-12T01:41:49.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.757+0000 7f94e7fff640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f94d006be30 0x7f94d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:49.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.757+0000 7f94e7fff640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f94d006be30 0x7f94d006e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f94d8032000 tx=0x7f94d802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:49.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.761+0000 7f94e6ffd640 1 -- 172.21.15.60:0/978693251 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f94e0059130 con 0x7f94dc004800 2024-09-12T01:41:49.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:49.935+0000 7f94f4a5c640 1 -- 172.21.15.60:0/978693251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f94f015a280 con 0x7f94dc004800 2024-09-12T01:41:50.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.625+0000 7f94e6ffd640 1 -- 172.21.15.60:0/978693251 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v83) ==== 169+0+0 (secure 0 0 0) 0x7f94e005d430 con 0x7f94dc004800 2024-09-12T01:41:50.625 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-12T01:41:50.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.628+0000 7f94f4a5c640 1 -- 172.21.15.60:0/978693251 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f94d006be30 msgr2=0x7f94d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:50.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.628+0000 7f94f4a5c640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f94d006be30 0x7f94d006e2f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f94d8032000 tx=0x7f94d802e000 comp rx=0 tx=0).stop 2024-09-12T01:41:50.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.628+0000 7f94f4a5c640 1 -- 172.21.15.60:0/978693251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc004800 msgr2=0x7f94f015da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:50.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.628+0000 7f94f4a5c640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc004800 0x7f94f015da40 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f94e0007340 tx=0x7f94e0007800 comp rx=0 tx=0).stop 2024-09-12T01:41:50.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.628+0000 7f94f4a5c640 1 -- 172.21.15.60:0/978693251 shutdown_connections 2024-09-12T01:41:50.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.628+0000 7f94f4a5c640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f94d006be30 0x7f94d006e2f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.628+0000 7f94f4a5c640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f94f01530f0 0x7f94f0142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.628+0000 7f94f4a5c640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94f015f170 0x7f94f0152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.628+0000 7f94f4a5c640 1 --2- 172.21.15.60:0/978693251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94dc004800 0x7f94f015da40 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.628+0000 7f94f4a5c640 1 -- 172.21.15.60:0/978693251 >> 172.21.15.60:0/978693251 conn(0x7f94f00b4240 msgr2=0x7f94f00b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:50.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.628+0000 7f94f4a5c640 1 -- 172.21.15.60:0/978693251 shutdown_connections 2024-09-12T01:41:50.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.628+0000 7f94f4a5c640 1 -- 172.21.15.60:0/978693251 wait complete. 2024-09-12T01:41:50.649 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_min_caps_working_set 2024-09-12T01:41:50.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.759+0000 7f0a494ac640 1 Processor -- start 2024-09-12T01:41:50.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.759+0000 7f0a494ac640 1 -- start start 2024-09-12T01:41:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.760+0000 7f0a494ac640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0a440b5c50 0x7f0a44167400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.760+0000 7f0a494ac640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a440d0370 con 0x7f0a4415c550 2024-09-12T01:41:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.760+0000 7f0a494ac640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a4415c930 con 0x7f0a440d3060 2024-09-12T01:41:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.760+0000 7f0a494ac640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0a44071530 con 0x7f0a440b5c50 2024-09-12T01:41:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.760+0000 7f0a42ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0a4415c550 0x7f0a440b7270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47888/0 (socket says 172.21.15.60:47888) 2024-09-12T01:41:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.760+0000 7f0a42ffd640 1 -- 172.21.15.60:0/1620953066 learned_addr learned my addr 172.21.15.60:0/1620953066 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a437fe640 1 --2- 172.21.15.60:0/1620953066 >> v2:172.21.15.105:3300/0 conn(0x7f0a440b5c50 0x7f0a44167400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2443984033 0 0) 0x7f0a3c001110 con 0x7f0a4415c550 2024-09-12T01:41:50.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a30003520 con 0x7f0a4415c550 2024-09-12T01:41:50.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1947036601 0 0) 0x7f0a30003520 con 0x7f0a4415c550 2024-09-12T01:41:50.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 >> v2:172.21.15.105:3300/0 conn(0x7f0a440b5c50 msgr2=0x7f0a44167400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:50.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 --2- 172.21.15.60:0/1620953066 >> v2:172.21.15.105:3300/0 conn(0x7f0a440b5c50 0x7f0a44167400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 >> v1:172.21.15.105:6789/0 conn(0x7f0a440d3060 legacy=0x7f0a440b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:50.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a44070920 con 0x7f0a4415c550 2024-09-12T01:41:50.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f0a3c001840 con 0x7f0a4415c550 2024-09-12T01:41:50.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 >> v1:172.21.15.60:6789/0 conn(0x7f0a4415c550 legacy=0x7f0a440b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:50.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 --2- 172.21.15.60:0/1620953066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a300039b0 0x7f0a30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:50.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 --2- 172.21.15.60:0/1620953066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 0x7f0a30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:50.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 --2- 172.21.15.60:0/1620953066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a300051c0 0x7f0a3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:50.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44071530 con 0x7f0a30004800 2024-09-12T01:41:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3000c070 con 0x7f0a300051c0 2024-09-12T01:41:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3000c270 con 0x7f0a300039b0 2024-09-12T01:41:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a427fc640 1 --2- 172.21.15.60:0/1620953066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 0x7f0a30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a42ffd640 1 --2- 172.21.15.60:0/1620953066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a300039b0 0x7f0a30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.761+0000 7f0a437fe640 1 --2- 172.21.15.60:0/1620953066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a300051c0 0x7f0a3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.762+0000 7f0a427fc640 1 -- 172.21.15.60:0/1620953066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a300039b0 msgr2=0x7f0a30003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.762+0000 7f0a427fc640 1 --2- 172.21.15.60:0/1620953066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a300039b0 0x7f0a30003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.762+0000 7f0a427fc640 1 -- 172.21.15.60:0/1620953066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a300051c0 msgr2=0x7f0a3000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.762+0000 7f0a427fc640 1 --2- 172.21.15.60:0/1620953066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a300051c0 0x7f0a3000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.762+0000 7f0a427fc640 1 -- 172.21.15.60:0/1620953066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a30003520 con 0x7f0a30004800 2024-09-12T01:41:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.762+0000 7f0a437fe640 1 -- 172.21.15.60:0/1620953066 reap_dead start 2024-09-12T01:41:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.762+0000 7f0a427fc640 1 --2- 172.21.15.60:0/1620953066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 0x7f0a30004c80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c001750 tx=0x7f0a30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16aea013ea64dab3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.762+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c001370 con 0x7f0a30004800 2024-09-12T01:41:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.762+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c0052d0 con 0x7f0a30004800 2024-09-12T01:41:50.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.762+0000 7f0a41ffb640 1 -- 172.21.15.60:0/1620953066 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c02abc0 con 0x7f0a30004800 2024-09-12T01:41:50.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.763+0000 7f0a494ac640 1 -- 172.21.15.60:0/1620953066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 msgr2=0x7f0a30004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:50.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.763+0000 7f0a494ac640 1 --2- 172.21.15.60:0/1620953066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 0x7f0a30004c80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c001750 tx=0x7f0a30005830 comp rx=0 tx=0).stop 2024-09-12T01:41:50.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.763+0000 7f0a494ac640 1 -- 172.21.15.60:0/1620953066 shutdown_connections 2024-09-12T01:41:50.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.763+0000 7f0a494ac640 1 --2- 172.21.15.60:0/1620953066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 0x7f0a30004c80 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.763+0000 7f0a494ac640 1 -- 172.21.15.60:0/1620953066 >> 172.21.15.60:0/1620953066 conn(0x7f0a440d24d0 msgr2=0x7f0a440d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.763+0000 7f0a494ac640 1 -- 172.21.15.60:0/1620953066 shutdown_connections 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.763+0000 7f0a494ac640 1 -- 172.21.15.60:0/1620953066 wait complete. 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.764+0000 7f0a494ac640 1 Processor -- start 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.765+0000 7f0a494ac640 1 -- start start 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.765+0000 7f0a494ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 0x7f0a4414cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.765+0000 7f0a494ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a4415b970 0x7f0a4406e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.765+0000 7f0a494ac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a4414d7c0 0x7f0a441e7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.765+0000 7f0a494ac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0a440711c0 con 0x7f0a30004800 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.765+0000 7f0a494ac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0a44070ee0 con 0x7f0a4414d7c0 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.765+0000 7f0a494ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0a440b5540 con 0x7f0a4415b970 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.765+0000 7f0a42ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 0x7f0a4414cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:50.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.765+0000 7f0a42ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 0x7f0a4414cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37140/0 (socket says 172.21.15.60:37140) 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.765+0000 7f0a42ffd640 1 -- 172.21.15.60:0/3025202531 learned_addr learned my addr 172.21.15.60:0/3025202531 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a437fe640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a4414d7c0 0x7f0a441e7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a427fc640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a4415b970 0x7f0a4406e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a42ffd640 1 -- 172.21.15.60:0/3025202531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a4415b970 msgr2=0x7f0a4406e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a42ffd640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a4415b970 0x7f0a4406e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a42ffd640 1 -- 172.21.15.60:0/3025202531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a4414d7c0 msgr2=0x7f0a441e7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a42ffd640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a4414d7c0 0x7f0a441e7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a42ffd640 1 -- 172.21.15.60:0/3025202531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a440cba40 con 0x7f0a30004800 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a42ffd640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 0x7f0a4414cf10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c007290 tx=0x7f0a3c007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a3b7fe640 1 -- 172.21.15.60:0/3025202531 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c001230 con 0x7f0a30004800 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a3b7fe640 1 -- 172.21.15.60:0/3025202531 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a3c018070 con 0x7f0a30004800 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a494ac640 1 -- 172.21.15.60:0/3025202531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a440cbd20 con 0x7f0a30004800 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a3b7fe640 1 -- 172.21.15.60:0/3025202531 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00fc00 con 0x7f0a30004800 2024-09-12T01:41:50.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.766+0000 7f0a494ac640 1 -- 172.21.15.60:0/3025202531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a440cc2e0 con 0x7f0a30004800 2024-09-12T01:41:50.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.767+0000 7f0a494ac640 1 -- 172.21.15.60:0/3025202531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a440b58d0 con 0x7f0a30004800 2024-09-12T01:41:50.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.767+0000 7f0a3b7fe640 1 -- 172.21.15.60:0/3025202531 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0a3c01d460 con 0x7f0a30004800 2024-09-12T01:41:50.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.768+0000 7f0a3b7fe640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0a2406be60 0x7f0a2406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:50.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.768+0000 7f0a427fc640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0a2406be60 0x7f0a2406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:50.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.768+0000 7f0a3b7fe640 1 -- 172.21.15.60:0/3025202531 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4943+0+0 (secure 0 0 0) 0x7f0a3c08aae0 con 0x7f0a30004800 2024-09-12T01:41:50.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.769+0000 7f0a427fc640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0a2406be60 0x7f0a2406e320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c032000 tx=0x7f0a2c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:50.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.772+0000 7f0a3b7fe640 1 -- 172.21.15.60:0/3025202531 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0a440d0370 con 0x7f0a30004800 2024-09-12T01:41:50.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.948+0000 7f0a494ac640 1 -- 172.21.15.60:0/3025202531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"} v 0) -- 0x7f0a44071ad0 con 0x7f0a30004800 2024-09-12T01:41:50.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.951+0000 7f0a3b7fe640 1 -- 172.21.15.60:0/3025202531 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"}]=0 v29) ==== 107+0+0 (secure 0 0 0) 0x7f0a3c059790 con 0x7f0a30004800 2024-09-12T01:41:50.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.954+0000 7f0a494ac640 1 -- 172.21.15.60:0/3025202531 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0a2406be60 msgr2=0x7f0a2406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:50.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.954+0000 7f0a494ac640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0a2406be60 0x7f0a2406e320 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c032000 tx=0x7f0a2c02e000 comp rx=0 tx=0).stop 2024-09-12T01:41:50.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.954+0000 7f0a494ac640 1 -- 172.21.15.60:0/3025202531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 msgr2=0x7f0a4414cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:50.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.954+0000 7f0a494ac640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 0x7f0a4414cf10 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c007290 tx=0x7f0a3c007750 comp rx=0 tx=0).stop 2024-09-12T01:41:50.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.954+0000 7f0a494ac640 1 -- 172.21.15.60:0/3025202531 shutdown_connections 2024-09-12T01:41:50.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.954+0000 7f0a494ac640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0a4414d7c0 0x7f0a441e7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.954+0000 7f0a494ac640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0a2406be60 0x7f0a2406e320 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.954+0000 7f0a494ac640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0a4415b970 0x7f0a4406e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.954+0000 7f0a494ac640 1 --2- 172.21.15.60:0/3025202531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a30004800 0x7f0a4414cf10 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:50.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.954+0000 7f0a494ac640 1 -- 172.21.15.60:0/3025202531 >> 172.21.15.60:0/3025202531 conn(0x7f0a440d24d0 msgr2=0x7f0a440b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:50.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.954+0000 7f0a494ac640 1 -- 172.21.15.60:0/3025202531 shutdown_connections 2024-09-12T01:41:50.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:50.954+0000 7f0a494ac640 1 -- 172.21.15.60:0/3025202531 wait complete. 2024-09-12T01:41:50.965 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_memory_limit 2024-09-12T01:41:51.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.074+0000 7efd7cb33640 1 Processor -- start 2024-09-12T01:41:51.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.074+0000 7efd7cb33640 1 -- start start 2024-09-12T01:41:51.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.075+0000 7efd7cb33640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd7815e6f0 0x7efd7806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.075+0000 7efd7cb33640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd7806e990 con 0x7efd780b54d0 2024-09-12T01:41:51.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.075+0000 7efd7cb33640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd7806ec70 con 0x7efd780b7450 2024-09-12T01:41:51.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.075+0000 7efd7cb33640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7efd7815ec70 con 0x7efd7815e6f0 2024-09-12T01:41:51.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.075+0000 7efd7659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd7815e6f0 0x7efd7806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.075+0000 7efd7659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efd7815e6f0 0x7efd7806fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37142/0 (socket says 172.21.15.60:37142) 2024-09-12T01:41:51.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.075+0000 7efd75d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efd780b54d0 0x7efd780b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47894/0 (socket says 172.21.15.60:47894) 2024-09-12T01:41:51.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.075+0000 7efd7659c640 1 -- 172.21.15.60:0/349569945 learned_addr learned my addr 172.21.15.60:0/349569945 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:51.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.075+0000 7efd7659c640 1 -- 172.21.15.60:0/349569945 >> v1:172.21.15.105:6789/0 conn(0x7efd780b7450 legacy=0x7efd78070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:51.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.075+0000 7efd7659c640 1 -- 172.21.15.60:0/349569945 >> v1:172.21.15.60:6789/0 conn(0x7efd780b54d0 legacy=0x7efd780b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.076+0000 7efd7659c640 1 -- 172.21.15.60:0/349569945 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7815ef50 con 0x7efd7815e6f0 2024-09-12T01:41:51.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.075+0000 7efd7559a640 1 -- 172.21.15.60:0/349569945 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938549216 0 0) 0x7efd7806e990 con 0x7efd780b54d0 2024-09-12T01:41:51.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.076+0000 7efd7659c640 1 --2- 172.21.15.60:0/349569945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd7815e6f0 0x7efd7806fd00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7efd68009e50 tx=0x7efd6802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd04a436836b65b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:51.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.076+0000 7efd7559a640 1 -- 172.21.15.60:0/349569945 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd68036070 con 0x7efd7815e6f0 2024-09-12T01:41:51.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.076+0000 7efd7559a640 1 -- 172.21.15.60:0/349569945 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd68031600 con 0x7efd7815e6f0 2024-09-12T01:41:51.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.076+0000 7efd7559a640 1 -- 172.21.15.60:0/349569945 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd680319d0 con 0x7efd7815e6f0 2024-09-12T01:41:51.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.077+0000 7efd7cb33640 1 -- 172.21.15.60:0/349569945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd7815e6f0 msgr2=0x7efd7806fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.077+0000 7efd7cb33640 1 --2- 172.21.15.60:0/349569945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd7815e6f0 0x7efd7806fd00 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7efd68009e50 tx=0x7efd6802a760 comp rx=0 tx=0).stop 2024-09-12T01:41:51.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.077+0000 7efd7cb33640 1 -- 172.21.15.60:0/349569945 shutdown_connections 2024-09-12T01:41:51.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.077+0000 7efd7cb33640 1 --2- 172.21.15.60:0/349569945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd7815e6f0 0x7efd7806fd00 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.077+0000 7efd7cb33640 1 -- 172.21.15.60:0/349569945 >> 172.21.15.60:0/349569945 conn(0x7efd780d2430 msgr2=0x7efd780d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:51.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.077+0000 7efd7cb33640 1 -- 172.21.15.60:0/349569945 shutdown_connections 2024-09-12T01:41:51.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.077+0000 7efd7cb33640 1 -- 172.21.15.60:0/349569945 wait complete. 2024-09-12T01:41:51.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.078+0000 7efd7cb33640 1 Processor -- start 2024-09-12T01:41:51.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.079+0000 7efd7cb33640 1 -- start start 2024-09-12T01:41:51.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.079+0000 7efd7cb33640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd780b54d0 0x7efd78158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.079+0000 7efd7cb33640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd780b7450 0x7efd78159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.079+0000 7efd7cb33640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd7815e6f0 0x7efd78145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.079+0000 7efd7cb33640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efd7806e730 con 0x7efd780b7450 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.079+0000 7efd7cb33640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efd7806e5b0 con 0x7efd780b54d0 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.079+0000 7efd7cb33640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efd7815f750 con 0x7efd7815e6f0 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.079+0000 7efd75d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd780b7450 0x7efd78159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.079+0000 7efd75d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd780b7450 0x7efd78159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37154/0 (socket says 172.21.15.60:37154) 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.079+0000 7efd75d9b640 1 -- 172.21.15.60:0/3616356490 learned_addr learned my addr 172.21.15.60:0/3616356490 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd7659c640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd780b54d0 0x7efd78158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd76d9d640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd7815e6f0 0x7efd78145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd75d9b640 1 -- 172.21.15.60:0/3616356490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd7815e6f0 msgr2=0x7efd78145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd75d9b640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd7815e6f0 0x7efd78145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd75d9b640 1 -- 172.21.15.60:0/3616356490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd780b54d0 msgr2=0x7efd78158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd75d9b640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd780b54d0 0x7efd78158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd75d9b640 1 -- 172.21.15.60:0/3616356490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd781575c0 con 0x7efd780b7450 2024-09-12T01:41:51.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd75d9b640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd780b7450 0x7efd78159d90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00c4b0 tx=0x7efd6c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:51.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd66ffd640 1 -- 172.21.15.60:0/3616356490 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c018070 con 0x7efd780b7450 2024-09-12T01:41:51.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd66ffd640 1 -- 172.21.15.60:0/3616356490 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd6c007500 con 0x7efd780b7450 2024-09-12T01:41:51.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd66ffd640 1 -- 172.21.15.60:0/3616356490 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c004a20 con 0x7efd780b7450 2024-09-12T01:41:51.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd7cb33640 1 -- 172.21.15.60:0/3616356490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd781578a0 con 0x7efd780b7450 2024-09-12T01:41:51.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.080+0000 7efd7cb33640 1 -- 172.21.15.60:0/3616356490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd78157e60 con 0x7efd780b7450 2024-09-12T01:41:51.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.081+0000 7efd7cb33640 1 -- 172.21.15.60:0/3616356490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd78068e10 con 0x7efd780b7450 2024-09-12T01:41:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.082+0000 7efd66ffd640 1 -- 172.21.15.60:0/3616356490 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efd6c01b070 con 0x7efd780b7450 2024-09-12T01:41:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.082+0000 7efd66ffd640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efd5806be60 0x7efd5806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.082+0000 7efd7659c640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efd5806be60 0x7efd5806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.082+0000 7efd66ffd640 1 -- 172.21.15.60:0/3616356490 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4943+0+0 (secure 0 0 0) 0x7efd6c089d80 con 0x7efd780b7450 2024-09-12T01:41:51.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.083+0000 7efd7659c640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efd5806be60 0x7efd5806e320 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efd68033000 tx=0x7efd68009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:51.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.087+0000 7efd66ffd640 1 -- 172.21.15.60:0/3616356490 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efd6c058530 con 0x7efd780b7450 2024-09-12T01:41:51.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.261+0000 7efd7cb33640 1 -- 172.21.15.60:0/3616356490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"} v 0) -- 0x7efd7815bdd0 con 0x7efd780b7450 2024-09-12T01:41:51.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.265+0000 7efd66ffd640 1 -- 172.21.15.60:0/3616356490 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"}]=0 v30) ==== 105+0+0 (secure 0 0 0) 0x7efd6c05c830 con 0x7efd780b7450 2024-09-12T01:41:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.267+0000 7efd7cb33640 1 -- 172.21.15.60:0/3616356490 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efd5806be60 msgr2=0x7efd5806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.267+0000 7efd7cb33640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efd5806be60 0x7efd5806e320 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efd68033000 tx=0x7efd68009000 comp rx=0 tx=0).stop 2024-09-12T01:41:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.267+0000 7efd7cb33640 1 -- 172.21.15.60:0/3616356490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd780b7450 msgr2=0x7efd78159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.267+0000 7efd7cb33640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd780b7450 0x7efd78159d90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7efd6c00c4b0 tx=0x7efd6c00c970 comp rx=0 tx=0).stop 2024-09-12T01:41:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.267+0000 7efd7cb33640 1 -- 172.21.15.60:0/3616356490 shutdown_connections 2024-09-12T01:41:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.267+0000 7efd7cb33640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efd5806be60 0x7efd5806e320 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.267+0000 7efd7cb33640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efd7815e6f0 0x7efd78145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.267+0000 7efd7cb33640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efd780b7450 0x7efd78159d90 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.267+0000 7efd7cb33640 1 --2- 172.21.15.60:0/3616356490 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efd780b54d0 0x7efd78158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.267+0000 7efd7cb33640 1 -- 172.21.15.60:0/3616356490 >> 172.21.15.60:0/3616356490 conn(0x7efd780d2430 msgr2=0x7efd780b2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.267+0000 7efd7cb33640 1 -- 172.21.15.60:0/3616356490 shutdown_connections 2024-09-12T01:41:51.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.267+0000 7efd7cb33640 1 -- 172.21.15.60:0/3616356490 wait complete. 2024-09-12T01:41:51.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T01:41:51.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.382+0000 7f9a4cce6640 1 Processor -- start 2024-09-12T01:41:51.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.382+0000 7f9a4cce6640 1 -- start start 2024-09-12T01:41:51.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a4cce6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9a4815e6f0 0x7f9a4806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a4cce6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9a480b54d0 0x7f9a4815f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a4cce6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a480b6d40 0x7f9a480b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a4cce6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9a4806e990 con 0x7f9a480b54d0 2024-09-12T01:41:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a4cce6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9a4806ec70 con 0x7f9a4815e6f0 2024-09-12T01:41:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a4cce6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9a4815ec70 con 0x7f9a480b6d40 2024-09-12T01:41:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a45d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9a480b54d0 0x7f9a4815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a45d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9a480b54d0 0x7f9a4815f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37158/0 (socket says 172.21.15.60:37158) 2024-09-12T01:41:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a45d9b640 1 -- 172.21.15.60:0/3409121726 learned_addr learned my addr 172.21.15.60:0/3409121726 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a46d9d640 1 --2- 172.21.15.60:0/3409121726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a480b6d40 0x7f9a480b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a4659c640 1 --2- 172.21.15.60:0/3409121726 >> v2:172.21.15.105:3300/0 conn(0x7f9a4815e6f0 0x7f9a4806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a45d9b640 1 -- 172.21.15.60:0/3409121726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a480b6d40 msgr2=0x7f9a480b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a45d9b640 1 --2- 172.21.15.60:0/3409121726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a480b6d40 0x7f9a480b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a45d9b640 1 -- 172.21.15.60:0/3409121726 >> v2:172.21.15.105:3300/0 conn(0x7f9a4815e6f0 msgr2=0x7f9a4806fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a45d9b640 1 --2- 172.21.15.60:0/3409121726 >> v2:172.21.15.105:3300/0 conn(0x7f9a4815e6f0 0x7f9a4806fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.385 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a45d9b640 1 -- 172.21.15.60:0/3409121726 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4815ef50 con 0x7f9a480b54d0 2024-09-12T01:41:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a46d9d640 1 --2- 172.21.15.60:0/3409121726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a480b6d40 0x7f9a480b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.383+0000 7f9a4659c640 1 --2- 172.21.15.60:0/3409121726 >> v2:172.21.15.105:3300/0 conn(0x7f9a4815e6f0 0x7f9a4806fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.384+0000 7f9a45d9b640 1 --2- 172.21.15.60:0/3409121726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a480b54d0 0x7f9a4815f750 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9a48069920 tx=0x7f9a3c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53302345adf81e84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.384+0000 7f9a4559a640 1 -- 172.21.15.60:0/3409121726 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c037070 con 0x7f9a480b54d0 2024-09-12T01:41:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.384+0000 7f9a4559a640 1 -- 172.21.15.60:0/3409121726 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3c032440 con 0x7f9a480b54d0 2024-09-12T01:41:51.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.384+0000 7f9a4559a640 1 -- 172.21.15.60:0/3409121726 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c032810 con 0x7f9a480b54d0 2024-09-12T01:41:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.384+0000 7f9a4cce6640 1 -- 172.21.15.60:0/3409121726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a480b54d0 msgr2=0x7f9a4815f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.384+0000 7f9a4cce6640 1 --2- 172.21.15.60:0/3409121726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a480b54d0 0x7f9a4815f750 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9a48069920 tx=0x7f9a3c02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.385+0000 7f9a4cce6640 1 -- 172.21.15.60:0/3409121726 shutdown_connections 2024-09-12T01:41:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.385+0000 7f9a4cce6640 1 --2- 172.21.15.60:0/3409121726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a480b6d40 0x7f9a480b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.385+0000 7f9a4cce6640 1 --2- 172.21.15.60:0/3409121726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a480b54d0 0x7f9a4815f750 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.385+0000 7f9a4cce6640 1 --2- 172.21.15.60:0/3409121726 >> v2:172.21.15.105:3300/0 conn(0x7f9a4815e6f0 0x7f9a4806fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.385+0000 7f9a4cce6640 1 -- 172.21.15.60:0/3409121726 >> 172.21.15.60:0/3409121726 conn(0x7f9a480d2430 msgr2=0x7f9a480d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.385+0000 7f9a4cce6640 1 -- 172.21.15.60:0/3409121726 shutdown_connections 2024-09-12T01:41:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.385+0000 7f9a4cce6640 1 -- 172.21.15.60:0/3409121726 wait complete. 2024-09-12T01:41:51.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.386+0000 7f9a4cce6640 1 Processor -- start 2024-09-12T01:41:51.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.386+0000 7f9a4cce6640 1 -- start start 2024-09-12T01:41:51.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4cce6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a480b54d0 0x7f9a481f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4cce6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a480b6d40 0x7f9a480d1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4cce6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a4815e6f0 0x7f9a481622c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4cce6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4806e5b0 con 0x7f9a480b54d0 2024-09-12T01:41:51.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4cce6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9a480b7730 con 0x7f9a4815e6f0 2024-09-12T01:41:51.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4cce6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9a4806e730 con 0x7f9a480b6d40 2024-09-12T01:41:51.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a480b54d0 0x7f9a481f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a480b54d0 0x7f9a481f50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37162/0 (socket says 172.21.15.60:37162) 2024-09-12T01:41:51.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4659c640 1 -- 172.21.15.60:0/186042168 learned_addr learned my addr 172.21.15.60:0/186042168 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:51.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a45d9b640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a480b6d40 0x7f9a480d1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a46d9d640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a4815e6f0 0x7f9a481622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4659c640 1 -- 172.21.15.60:0/186042168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a480b6d40 msgr2=0x7f9a480d1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4659c640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a480b6d40 0x7f9a480d1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4659c640 1 -- 172.21.15.60:0/186042168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a4815e6f0 msgr2=0x7f9a481622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4659c640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a4815e6f0 0x7f9a481622c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4659c640 1 -- 172.21.15.60:0/186042168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a481f55e0 con 0x7f9a480b54d0 2024-09-12T01:41:51.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a4659c640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a480b54d0 0x7f9a481f50a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800d800 tx=0x7f9a3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:51.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.387+0000 7f9a36ffd640 1 -- 172.21.15.60:0/186042168 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38004030 con 0x7f9a480b54d0 2024-09-12T01:41:51.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.388+0000 7f9a36ffd640 1 -- 172.21.15.60:0/186042168 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a380041d0 con 0x7f9a480b54d0 2024-09-12T01:41:51.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.388+0000 7f9a4cce6640 1 -- 172.21.15.60:0/186042168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a480d1780 con 0x7f9a480b54d0 2024-09-12T01:41:51.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.388+0000 7f9a36ffd640 1 -- 172.21.15.60:0/186042168 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a380096a0 con 0x7f9a480b54d0 2024-09-12T01:41:51.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.388+0000 7f9a4cce6640 1 -- 172.21.15.60:0/186042168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a48161500 con 0x7f9a480b54d0 2024-09-12T01:41:51.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.389+0000 7f9a4cce6640 1 -- 172.21.15.60:0/186042168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a4806c6c0 con 0x7f9a480b54d0 2024-09-12T01:41:51.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.389+0000 7f9a36ffd640 1 -- 172.21.15.60:0/186042168 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9a38009840 con 0x7f9a480b54d0 2024-09-12T01:41:51.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.390+0000 7f9a36ffd640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9a2806be60 0x7f9a2806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.390+0000 7f9a36ffd640 1 -- 172.21.15.60:0/186042168 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4943+0+0 (secure 0 0 0) 0x7f9a3808ae60 con 0x7f9a480b54d0 2024-09-12T01:41:51.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.390+0000 7f9a45d9b640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9a2806be60 0x7f9a2806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.390+0000 7f9a45d9b640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9a2806be60 0x7f9a2806e320 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c034000 tx=0x7f9a3c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:51.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.394+0000 7f9a36ffd640 1 -- 172.21.15.60:0/186042168 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9a480d1780 con 0x7f9a480b54d0 2024-09-12T01:41:51.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.571+0000 7f9a4cce6640 1 -- 172.21.15.60:0/186042168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f9a48156b80 con 0x7f9a480b54d0 2024-09-12T01:41:51.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.575+0000 7f9a36ffd640 1 -- 172.21.15.60:0/186042168 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) ==== 104+0+0 (secure 0 0 0) 0x7f9a481f55e0 con 0x7f9a480b54d0 2024-09-12T01:41:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.577+0000 7f9a4cce6640 1 -- 172.21.15.60:0/186042168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9a2806be60 msgr2=0x7f9a2806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.577+0000 7f9a4cce6640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9a2806be60 0x7f9a2806e320 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c034000 tx=0x7f9a3c02e000 comp rx=0 tx=0).stop 2024-09-12T01:41:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.577+0000 7f9a4cce6640 1 -- 172.21.15.60:0/186042168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a480b54d0 msgr2=0x7f9a481f50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.577+0000 7f9a4cce6640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a480b54d0 0x7f9a481f50a0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800d800 tx=0x7f9a3800dcc0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.577+0000 7f9a4cce6640 1 -- 172.21.15.60:0/186042168 shutdown_connections 2024-09-12T01:41:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.577+0000 7f9a4cce6640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9a4815e6f0 0x7f9a481622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.577+0000 7f9a4cce6640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9a2806be60 0x7f9a2806e320 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.577+0000 7f9a4cce6640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9a480b6d40 0x7f9a480d1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.577+0000 7f9a4cce6640 1 --2- 172.21.15.60:0/186042168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a480b54d0 0x7f9a481f50a0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.577+0000 7f9a4cce6640 1 -- 172.21.15.60:0/186042168 >> 172.21.15.60:0/186042168 conn(0x7f9a480d2430 msgr2=0x7f9a481579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.577+0000 7f9a4cce6640 1 -- 172.21.15.60:0/186042168 shutdown_connections 2024-09-12T01:41:51.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.577+0000 7f9a4cce6640 1 -- 172.21.15.60:0/186042168 wait complete. 2024-09-12T01:41:51.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_max_caps 2024-09-12T01:41:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.693+0000 7fa3187e8640 1 Processor -- start 2024-09-12T01:41:51.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.693+0000 7fa3187e8640 1 -- start start 2024-09-12T01:41:51.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa3187e8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa31015e750 0x7fa3100cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa3187e8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa3100b6bb0 0x7fa3100b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa3187e8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3100b7790 con 0x7fa3100cfb70 2024-09-12T01:41:51.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa3187e8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa3100d43c0 con 0x7fa3100b6bb0 2024-09-12T01:41:51.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa3187e8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa3100d33b0 con 0x7fa31015e750 2024-09-12T01:41:51.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa316d85640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa3100b6bb0 0x7fa3100b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa316d85640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa3100b6bb0 0x7fa3100b7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37168/0 (socket says 172.21.15.60:37168) 2024-09-12T01:41:51.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa316d85640 1 -- 172.21.15.60:0/4257971774 learned_addr learned my addr 172.21.15.60:0/4257971774 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:51.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa316584640 1 --2- 172.21.15.60:0/4257971774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa31015e750 0x7fa3100cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa316d85640 1 -- 172.21.15.60:0/4257971774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa31015e750 msgr2=0x7fa3100cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:51.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa316d85640 1 --2- 172.21.15.60:0/4257971774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa31015e750 0x7fa3100cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa316d85640 1 -- 172.21.15.60:0/4257971774 >> v1:172.21.15.105:6789/0 conn(0x7fa3100cfb70 legacy=0x7fa3100b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:51.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.694+0000 7fa316d85640 1 -- 172.21.15.60:0/4257971774 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3100d3600 con 0x7fa3100b6bb0 2024-09-12T01:41:51.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.695+0000 7fa316d85640 1 --2- 172.21.15.60:0/4257971774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3100b6bb0 0x7fa3100b7f50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa310069950 tx=0x7fa30802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac5cb3f34310ba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:51.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.695+0000 7fa315582640 1 -- 172.21.15.60:0/4257971774 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308036070 con 0x7fa3100b6bb0 2024-09-12T01:41:51.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.695+0000 7fa315582640 1 -- 172.21.15.60:0/4257971774 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa308031600 con 0x7fa3100b6bb0 2024-09-12T01:41:51.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.695+0000 7fa315582640 1 -- 172.21.15.60:0/4257971774 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3080319d0 con 0x7fa3100b6bb0 2024-09-12T01:41:51.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.696+0000 7fa3187e8640 1 -- 172.21.15.60:0/4257971774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3100b6bb0 msgr2=0x7fa3100b7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.696+0000 7fa3187e8640 1 --2- 172.21.15.60:0/4257971774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3100b6bb0 0x7fa3100b7f50 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fa310069950 tx=0x7fa30802a630 comp rx=0 tx=0).stop 2024-09-12T01:41:51.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.696+0000 7fa3187e8640 1 -- 172.21.15.60:0/4257971774 shutdown_connections 2024-09-12T01:41:51.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.696+0000 7fa3187e8640 1 --2- 172.21.15.60:0/4257971774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3100b6bb0 0x7fa3100b7f50 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.696+0000 7fa3187e8640 1 --2- 172.21.15.60:0/4257971774 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa31015e750 0x7fa3100cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.696+0000 7fa3187e8640 1 -- 172.21.15.60:0/4257971774 >> 172.21.15.60:0/4257971774 conn(0x7fa3100d1500 msgr2=0x7fa3100d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:51.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.696+0000 7fa3187e8640 1 -- 172.21.15.60:0/4257971774 shutdown_connections 2024-09-12T01:41:51.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.696+0000 7fa3187e8640 1 -- 172.21.15.60:0/4257971774 wait complete. 2024-09-12T01:41:51.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.697+0000 7fa3187e8640 1 Processor -- start 2024-09-12T01:41:51.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.697+0000 7fa3187e8640 1 -- start start 2024-09-12T01:41:51.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa3187e8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3100b6bb0 0x7fa3101f7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa3187e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3100cfb70 0x7fa310160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa3187e8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa31015e750 0x7fa3101614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa3187e8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa3100d3bc0 con 0x7fa3100cfb70 2024-09-12T01:41:51.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa3187e8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa3100b7ac0 con 0x7fa31015e750 2024-09-12T01:41:51.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa3187e8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa31015eb30 con 0x7fa3100b6bb0 2024-09-12T01:41:51.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa315d83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3100cfb70 0x7fa310160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa315d83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3100cfb70 0x7fa310160f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37176/0 (socket says 172.21.15.60:37176) 2024-09-12T01:41:51.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa315d83640 1 -- 172.21.15.60:0/1983869532 learned_addr learned my addr 172.21.15.60:0/1983869532 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:51.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa316584640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3100b6bb0 0x7fa3101f7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa316d85640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa31015e750 0x7fa3101614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa315d83640 1 -- 172.21.15.60:0/1983869532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3100b6bb0 msgr2=0x7fa3101f7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa315d83640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3100b6bb0 0x7fa3101f7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa315d83640 1 -- 172.21.15.60:0/1983869532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa31015e750 msgr2=0x7fa3101614b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa315d83640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa31015e750 0x7fa3101614b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa315d83640 1 -- 172.21.15.60:0/1983869532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa310159540 con 0x7fa3100cfb70 2024-09-12T01:41:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.698+0000 7fa315d83640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3100cfb70 0x7fa310160f70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c400 tx=0x7fa30000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.699+0000 7fa306ffd640 1 -- 172.21.15.60:0/1983869532 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300011790 con 0x7fa3100cfb70 2024-09-12T01:41:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.699+0000 7fa306ffd640 1 -- 172.21.15.60:0/1983869532 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa300017070 con 0x7fa3100cfb70 2024-09-12T01:41:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.699+0000 7fa3187e8640 1 -- 172.21.15.60:0/1983869532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa310159820 con 0x7fa3100cfb70 2024-09-12T01:41:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.699+0000 7fa306ffd640 1 -- 172.21.15.60:0/1983869532 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300011bb0 con 0x7fa3100cfb70 2024-09-12T01:41:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.699+0000 7fa3187e8640 1 -- 172.21.15.60:0/1983869532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa310159de0 con 0x7fa3100cfb70 2024-09-12T01:41:51.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.700+0000 7fa3187e8640 1 -- 172.21.15.60:0/1983869532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3100cf630 con 0x7fa3100cfb70 2024-09-12T01:41:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.700+0000 7fa306ffd640 1 -- 172.21.15.60:0/1983869532 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa30001c460 con 0x7fa3100cfb70 2024-09-12T01:41:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.701+0000 7fa306ffd640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa2f406be30 0x7fa2f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.701+0000 7fa306ffd640 1 -- 172.21.15.60:0/1983869532 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4943+0+0 (secure 0 0 0) 0x7fa30008a8c0 con 0x7fa3100cfb70 2024-09-12T01:41:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.701+0000 7fa316584640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa2f406be30 0x7fa2f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:51.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.701+0000 7fa316584640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa2f406be30 0x7fa2f406e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa3100b5d10 tx=0x7fa30c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:51.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.705+0000 7fa306ffd640 1 -- 172.21.15.60:0/1983869532 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa300058f20 con 0x7fa3100cfb70 2024-09-12T01:41:51.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.883+0000 7fa3187e8640 1 -- 172.21.15.60:0/1983869532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"} v 0) -- 0x7fa310162000 con 0x7fa3100cfb70 2024-09-12T01:41:51.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.886+0000 7fa306ffd640 1 -- 172.21.15.60:0/1983869532 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"}]=0 v32) ==== 102+0+0 (secure 0 0 0) 0x7fa30005d220 con 0x7fa3100cfb70 2024-09-12T01:41:51.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.888+0000 7fa3187e8640 1 -- 172.21.15.60:0/1983869532 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa2f406be30 msgr2=0x7fa2f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.888+0000 7fa3187e8640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa2f406be30 0x7fa2f406e2f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa3100b5d10 tx=0x7fa30c008040 comp rx=0 tx=0).stop 2024-09-12T01:41:51.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.888+0000 7fa3187e8640 1 -- 172.21.15.60:0/1983869532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3100cfb70 msgr2=0x7fa310160f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:51.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.888+0000 7fa3187e8640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3100cfb70 0x7fa310160f70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c400 tx=0x7fa30000c8c0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.888+0000 7fa3187e8640 1 -- 172.21.15.60:0/1983869532 shutdown_connections 2024-09-12T01:41:51.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.888+0000 7fa3187e8640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa31015e750 0x7fa3101614b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.888+0000 7fa3187e8640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3100cfb70 0x7fa310160f70 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.888+0000 7fa3187e8640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa2f406be30 0x7fa2f406e2f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.888+0000 7fa3187e8640 1 --2- 172.21.15.60:0/1983869532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa3100b6bb0 0x7fa3101f7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:51.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.888+0000 7fa3187e8640 1 -- 172.21.15.60:0/1983869532 >> 172.21.15.60:0/1983869532 conn(0x7fa3100d1500 msgr2=0x7fa31006bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:51.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.888+0000 7fa3187e8640 1 -- 172.21.15.60:0/1983869532 shutdown_connections 2024-09-12T01:41:51.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:51.888+0000 7fa3187e8640 1 -- 172.21.15.60:0/1983869532 wait complete. 2024-09-12T01:41:51.899 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_warning_threshold 2024-09-12T01:41:52.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.004+0000 7fe872a8d640 1 Processor -- start 2024-09-12T01:41:52.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.004+0000 7fe872a8d640 1 -- start start 2024-09-12T01:41:52.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe872a8d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe86c0b64a0 0x7fe86c0b6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe872a8d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe86c0b7f50 0x7fe86c0b8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe872a8d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe86c0b7790 con 0x7fe86c15e750 2024-09-12T01:41:52.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe872a8d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe86c0b6e50 con 0x7fe86c0b7f50 2024-09-12T01:41:52.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe872a8d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe86c0d43c0 con 0x7fe86c0b64a0 2024-09-12T01:41:52.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe87102a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe86c0b7f50 0x7fe86c0b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe870829640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe86c15e750 0x7fe86c0cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47900/0 (socket says 172.21.15.60:47900) 2024-09-12T01:41:52.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe870829640 1 -- 172.21.15.60:0/77418708 learned_addr learned my addr 172.21.15.60:0/77418708 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:52.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe86bfff640 1 --2- 172.21.15.60:0/77418708 >> v2:172.21.15.105:3300/0 conn(0x7fe86c0b64a0 0x7fe86c0b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe87102a640 1 -- 172.21.15.60:0/77418708 >> v2:172.21.15.105:3300/0 conn(0x7fe86c0b64a0 msgr2=0x7fe86c0b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:52.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe87102a640 1 --2- 172.21.15.60:0/77418708 >> v2:172.21.15.105:3300/0 conn(0x7fe86c0b64a0 0x7fe86c0b6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe87102a640 1 -- 172.21.15.60:0/77418708 >> v1:172.21.15.60:6789/0 conn(0x7fe86c15e750 legacy=0x7fe86c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe87102a640 1 -- 172.21.15.60:0/77418708 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c0d3600 con 0x7fe86c0b7f50 2024-09-12T01:41:52.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.005+0000 7fe86b7fe640 1 -- 172.21.15.60:0/77418708 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354918809 0 0) 0x7fe86c0b7790 con 0x7fe86c15e750 2024-09-12T01:41:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.006+0000 7fe87102a640 1 --2- 172.21.15.60:0/77418708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe86c0b7f50 0x7fe86c0b8370 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0d4540 tx=0x7fe86402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe24d90cd1bc3b95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.006+0000 7fe86b7fe640 1 -- 172.21.15.60:0/77418708 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe864007740 con 0x7fe86c0b7f50 2024-09-12T01:41:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.006+0000 7fe86b7fe640 1 -- 172.21.15.60:0/77418708 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8640078e0 con 0x7fe86c0b7f50 2024-09-12T01:41:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.006+0000 7fe86b7fe640 1 -- 172.21.15.60:0/77418708 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe864007cb0 con 0x7fe86c0b7f50 2024-09-12T01:41:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.006+0000 7fe872a8d640 1 -- 172.21.15.60:0/77418708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe86c0b7f50 msgr2=0x7fe86c0b8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.006+0000 7fe872a8d640 1 --2- 172.21.15.60:0/77418708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe86c0b7f50 0x7fe86c0b8370 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0d4540 tx=0x7fe86402a660 comp rx=0 tx=0).stop 2024-09-12T01:41:52.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.007+0000 7fe872a8d640 1 -- 172.21.15.60:0/77418708 shutdown_connections 2024-09-12T01:41:52.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.007+0000 7fe872a8d640 1 --2- 172.21.15.60:0/77418708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe86c0b7f50 0x7fe86c0b8370 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.007+0000 7fe872a8d640 1 --2- 172.21.15.60:0/77418708 >> v2:172.21.15.105:3300/0 conn(0x7fe86c0b64a0 0x7fe86c0b6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.007+0000 7fe872a8d640 1 -- 172.21.15.60:0/77418708 >> 172.21.15.60:0/77418708 conn(0x7fe86c0d1500 msgr2=0x7fe86c0d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:52.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.007+0000 7fe872a8d640 1 -- 172.21.15.60:0/77418708 shutdown_connections 2024-09-12T01:41:52.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.007+0000 7fe872a8d640 1 -- 172.21.15.60:0/77418708 wait complete. 2024-09-12T01:41:52.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.008+0000 7fe872a8d640 1 Processor -- start 2024-09-12T01:41:52.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.008+0000 7fe872a8d640 1 -- start start 2024-09-12T01:41:52.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe872a8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe86c0b64a0 0x7fe86c1f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe872a8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c0b7f50 0x7fe86c159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe872a8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe86c15e750 0x7fe86c160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe872a8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c0b7ac0 con 0x7fe86c0b64a0 2024-09-12T01:41:52.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe872a8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe86c0d33b0 con 0x7fe86c0b7f50 2024-09-12T01:41:52.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe872a8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe86c0d3bc0 con 0x7fe86c15e750 2024-09-12T01:41:52.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe870829640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe86c0b64a0 0x7fe86c1f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe870829640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe86c0b64a0 0x7fe86c1f3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37184/0 (socket says 172.21.15.60:37184) 2024-09-12T01:41:52.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe870829640 1 -- 172.21.15.60:0/625030606 learned_addr learned my addr 172.21.15.60:0/625030606 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:52.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe86bfff640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c0b7f50 0x7fe86c159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe87102a640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe86c15e750 0x7fe86c160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe870829640 1 -- 172.21.15.60:0/625030606 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe86c15e750 msgr2=0x7fe86c160eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe870829640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe86c15e750 0x7fe86c160eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe870829640 1 -- 172.21.15.60:0/625030606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c0b7f50 msgr2=0x7fe86c159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe870829640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c0b7f50 0x7fe86c159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe870829640 1 -- 172.21.15.60:0/625030606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe86c1596d0 con 0x7fe86c0b64a0 2024-09-12T01:41:52.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.009+0000 7fe870829640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe86c0b64a0 0x7fe86c1f3c50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c430 tx=0x7fe85400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:52.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.010+0000 7fe8697fa640 1 -- 172.21.15.60:0/625030606 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8540074e0 con 0x7fe86c0b64a0 2024-09-12T01:41:52.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.010+0000 7fe8697fa640 1 -- 172.21.15.60:0/625030606 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8540047e0 con 0x7fe86c0b64a0 2024-09-12T01:41:52.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.010+0000 7fe8697fa640 1 -- 172.21.15.60:0/625030606 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854004bd0 con 0x7fe86c0b64a0 2024-09-12T01:41:52.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.010+0000 7fe872a8d640 1 -- 172.21.15.60:0/625030606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe86c15ecf0 con 0x7fe86c0b64a0 2024-09-12T01:41:52.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.010+0000 7fe872a8d640 1 -- 172.21.15.60:0/625030606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe86c15f2b0 con 0x7fe86c0b64a0 2024-09-12T01:41:52.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.011+0000 7fe872a8d640 1 -- 172.21.15.60:0/625030606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86c0b6910 con 0x7fe86c0b64a0 2024-09-12T01:41:52.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.011+0000 7fe8697fa640 1 -- 172.21.15.60:0/625030606 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe854011070 con 0x7fe86c0b64a0 2024-09-12T01:41:52.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.012+0000 7fe8697fa640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84c06be30 0x7fe84c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.012+0000 7fe8697fa640 1 -- 172.21.15.60:0/625030606 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4943+0+0 (secure 0 0 0) 0x7fe85408a580 con 0x7fe86c0b64a0 2024-09-12T01:41:52.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.012+0000 7fe86bfff640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84c06be30 0x7fe84c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.012+0000 7fe86bfff640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84c06be30 0x7fe84c06e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe86c1f71e0 tx=0x7fe85c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:52.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.016+0000 7fe8697fa640 1 -- 172.21.15.60:0/625030606 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe854058c70 con 0x7fe86c0b64a0 2024-09-12T01:41:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.194+0000 7fe872a8d640 1 -- 172.21.15.60:0/625030606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"} v 0) -- 0x7fe86c0b40d0 con 0x7fe86c0b64a0 2024-09-12T01:41:52.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.197+0000 7fe8697fa640 1 -- 172.21.15.60:0/625030606 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"}]=0 v33) ==== 111+0+0 (secure 0 0 0) 0x7fe85405cf70 con 0x7fe86c0b64a0 2024-09-12T01:41:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.199+0000 7fe872a8d640 1 -- 172.21.15.60:0/625030606 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84c06be30 msgr2=0x7fe84c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.199+0000 7fe872a8d640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84c06be30 0x7fe84c06e2f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe86c1f71e0 tx=0x7fe85c008040 comp rx=0 tx=0).stop 2024-09-12T01:41:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.199+0000 7fe872a8d640 1 -- 172.21.15.60:0/625030606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe86c0b64a0 msgr2=0x7fe86c1f3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.199+0000 7fe872a8d640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe86c0b64a0 0x7fe86c1f3c50 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c430 tx=0x7fe85400c8f0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.200+0000 7fe872a8d640 1 -- 172.21.15.60:0/625030606 shutdown_connections 2024-09-12T01:41:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.200+0000 7fe872a8d640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84c06be30 0x7fe84c06e2f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.200+0000 7fe872a8d640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe86c15e750 0x7fe86c160eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.200+0000 7fe872a8d640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86c0b7f50 0x7fe86c159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.200+0000 7fe872a8d640 1 --2- 172.21.15.60:0/625030606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe86c0b64a0 0x7fe86c1f3c50 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.200+0000 7fe872a8d640 1 -- 172.21.15.60:0/625030606 >> 172.21.15.60:0/625030606 conn(0x7fe86c0d1500 msgr2=0x7fe86c0d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.200+0000 7fe872a8d640 1 -- 172.21.15.60:0/625030606 shutdown_connections 2024-09-12T01:41:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.200+0000 7fe872a8d640 1 -- 172.21.15.60:0/625030606 wait complete. 2024-09-12T01:41:52.211 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set' 2024-09-12T01:41:52.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.334+0000 7f0247fe4640 1 Processor -- start 2024-09-12T01:41:52.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.334+0000 7f0247fe4640 1 -- start start 2024-09-12T01:41:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.335+0000 7f0247fe4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02400cfa00 0x7f02400d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.335+0000 7f0247fe4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02400d2f40 con 0x7f024015e7a0 2024-09-12T01:41:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.335+0000 7f0247fe4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02400d3220 con 0x7f02400ba240 2024-09-12T01:41:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.335+0000 7f0247fe4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02400ba690 con 0x7f02400cfa00 2024-09-12T01:41:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.335+0000 7f0245d80640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f024015e7a0 0x7f02400d2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47914/0 (socket says 172.21.15.60:47914) 2024-09-12T01:41:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.335+0000 7f0245d80640 1 -- 172.21.15.60:0/4014060643 learned_addr learned my addr 172.21.15.60:0/4014060643 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.335+0000 7f0246581640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02400cfa00 0x7f02400d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.335+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810870424 0 0) 0x7f02400d2f40 con 0x7f024015e7a0 2024-09-12T01:41:52.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.335+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f022c003520 con 0x7f024015e7a0 2024-09-12T01:41:52.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.335+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2835164968 0 0) 0x7f02400d3220 con 0x7f02400ba240 2024-09-12T01:41:52.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.335+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02400d2f40 con 0x7f02400ba240 2024-09-12T01:41:52.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.335+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 478091325 0 0) 0x7f022c003520 con 0x7f024015e7a0 2024-09-12T01:41:52.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02400cfa00 msgr2=0x7f02400d3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:52.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0244d7e640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02400cfa00 0x7f02400d3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 >> v1:172.21.15.105:6789/0 conn(0x7f02400ba240 legacy=0x7f02400cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02400d3500 con 0x7f024015e7a0 2024-09-12T01:41:52.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f023c001670 con 0x7f024015e7a0 2024-09-12T01:41:52.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0246581640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02400cfa00 0x7f02400d3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:41:52.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 >> v1:172.21.15.60:6789/0 conn(0x7f024015e7a0 legacy=0x7f02400d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0244d7e640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f022c003b70 0x7f022c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0244d7e640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02400cfa00 0x7f022c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0244d7e640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f022c004d40 0x7f022c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f02400ba690 con 0x7f022c004d40 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f022c00ba70 con 0x7f022c003b70 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f022c00bc20 con 0x7f02400cfa00 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0246581640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f022c004d40 0x7f022c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0245d80640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f022c003b70 0x7f022c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f024557f640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02400cfa00 0x7f022c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0246581640 1 -- 172.21.15.60:0/4014060643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02400cfa00 msgr2=0x7f022c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0246581640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02400cfa00 0x7f022c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0246581640 1 -- 172.21.15.60:0/4014060643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f022c003b70 msgr2=0x7f022c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0246581640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f022c003b70 0x7f022c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.336+0000 7f0246581640 1 -- 172.21.15.60:0/4014060643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022c003520 con 0x7f022c004d40 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.337+0000 7f0246581640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f022c004d40 0x7f022c0051c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f023800e320 tx=0x7f022c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36743d82b9148c06 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.337+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238033070 con 0x7f022c004d40 2024-09-12T01:41:52.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.337+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023802f650 con 0x7f022c004d40 2024-09-12T01:41:52.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.337+0000 7f0244d7e640 1 -- 172.21.15.60:0/4014060643 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238009de0 con 0x7f022c004d40 2024-09-12T01:41:52.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.337+0000 7f0247fe4640 1 -- 172.21.15.60:0/4014060643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f022c004d40 msgr2=0x7f022c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.337+0000 7f0247fe4640 1 --2- 172.21.15.60:0/4014060643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f022c004d40 0x7f022c0051c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f023800e320 tx=0x7f022c005830 comp rx=0 tx=0).stop 2024-09-12T01:41:52.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.337+0000 7f0246581640 1 -- 172.21.15.60:0/4014060643 reap_dead start 2024-09-12T01:41:52.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.338+0000 7f0247fe4640 1 -- 172.21.15.60:0/4014060643 shutdown_connections 2024-09-12T01:41:52.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.338+0000 7f0247fe4640 1 -- 172.21.15.60:0/4014060643 >> 172.21.15.60:0/4014060643 conn(0x7f02400d1550 msgr2=0x7f02400d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:52.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.338+0000 7f0247fe4640 1 -- 172.21.15.60:0/4014060643 shutdown_connections 2024-09-12T01:41:52.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.338+0000 7f0247fe4640 1 -- 172.21.15.60:0/4014060643 wait complete. 2024-09-12T01:41:52.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.339+0000 7f0247fe4640 1 Processor -- start 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.339+0000 7f0247fe4640 1 -- start start 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0247fe4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02401514a0 0x7f024015fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0247fe4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02400ca4f0 0x7f0240160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0247fe4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0240161cb0 0x7f02401f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0247fe4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f024015eb80 con 0x7f0240161cb0 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0247fe4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02400d3ac0 con 0x7f02400ca4f0 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0247fe4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f024015ed00 con 0x7f02401514a0 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0246581640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0240161cb0 0x7f02401f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0246581640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0240161cb0 0x7f02401f3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37194/0 (socket says 172.21.15.60:37194) 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0246581640 1 -- 172.21.15.60:0/2952214697 learned_addr learned my addr 172.21.15.60:0/2952214697 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f024557f640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02400ca4f0 0x7f0240160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0245d80640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02401514a0 0x7f024015fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0246581640 1 -- 172.21.15.60:0/2952214697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02401514a0 msgr2=0x7f024015fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0246581640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02401514a0 0x7f024015fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0246581640 1 -- 172.21.15.60:0/2952214697 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02400ca4f0 msgr2=0x7f0240160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0246581640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02400ca4f0 0x7f0240160100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0246581640 1 -- 172.21.15.60:0/2952214697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02401f5290 con 0x7f0240161cb0 2024-09-12T01:41:52.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.340+0000 7f0246581640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0240161cb0 0x7f02401f3ed0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f023800e440 tx=0x7f0238009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:52.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.341+0000 7f02367fc640 1 -- 172.21.15.60:0/2952214697 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238033040 con 0x7f0240161cb0 2024-09-12T01:41:52.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.341+0000 7f02367fc640 1 -- 172.21.15.60:0/2952214697 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0238009a50 con 0x7f0240161cb0 2024-09-12T01:41:52.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.341+0000 7f0247fe4640 1 -- 172.21.15.60:0/2952214697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02401f8210 con 0x7f0240161cb0 2024-09-12T01:41:52.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.341+0000 7f02367fc640 1 -- 172.21.15.60:0/2952214697 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238009de0 con 0x7f0240161cb0 2024-09-12T01:41:52.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.341+0000 7f0247fe4640 1 -- 172.21.15.60:0/2952214697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02401f84f0 con 0x7f0240161cb0 2024-09-12T01:41:52.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.342+0000 7f0247fe4640 1 -- 172.21.15.60:0/2952214697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02400d4140 con 0x7f0240161cb0 2024-09-12T01:41:52.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.342+0000 7f02367fc640 1 -- 172.21.15.60:0/2952214697 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0238036070 con 0x7f0240161cb0 2024-09-12T01:41:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.343+0000 7f02367fc640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f022406be60 0x7f022406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.343+0000 7f02367fc640 1 -- 172.21.15.60:0/2952214697 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4943+0+0 (secure 0 0 0) 0x7f02380ab4f0 con 0x7f0240161cb0 2024-09-12T01:41:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.343+0000 7f0245d80640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f022406be60 0x7f022406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.343+0000 7f0245d80640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f022406be60 0x7f022406e320 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f023c007de0 tx=0x7f023c001590 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.347+0000 7f02367fc640 1 -- 172.21.15.60:0/2952214697 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0238048060 con 0x7f0240161cb0 2024-09-12T01:41:52.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.588+0000 7f0247fe4640 1 -- 172.21.15.60:0/2952214697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]} v 0) -- 0x7f02400693c0 con 0x7f0240161cb0 2024-09-12T01:41:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.627+0000 7f02367fc640 1 -- 172.21.15.60:0/2952214697 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_min_caps_working_set"]}]=0 v292) ==== 160+0+0 (secure 0 0 0) 0x7f023807a260 con 0x7f0240161cb0 2024-09-12T01:41:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.629+0000 7f0247fe4640 1 -- 172.21.15.60:0/2952214697 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f022406be60 msgr2=0x7f022406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.629+0000 7f0247fe4640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f022406be60 0x7f022406e320 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f023c007de0 tx=0x7f023c001590 comp rx=0 tx=0).stop 2024-09-12T01:41:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.629+0000 7f0247fe4640 1 -- 172.21.15.60:0/2952214697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0240161cb0 msgr2=0x7f02401f3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.629+0000 7f0247fe4640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0240161cb0 0x7f02401f3ed0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f023800e440 tx=0x7f0238009750 comp rx=0 tx=0).stop 2024-09-12T01:41:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.629+0000 7f0247fe4640 1 -- 172.21.15.60:0/2952214697 shutdown_connections 2024-09-12T01:41:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.629+0000 7f0247fe4640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0240161cb0 0x7f02401f3ed0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.629+0000 7f0247fe4640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f02400ca4f0 0x7f0240160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.629+0000 7f0247fe4640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f022406be60 0x7f022406e320 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.629+0000 7f0247fe4640 1 --2- 172.21.15.60:0/2952214697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02401514a0 0x7f024015fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.629+0000 7f0247fe4640 1 -- 172.21.15.60:0/2952214697 >> 172.21.15.60:0/2952214697 conn(0x7f02400d1550 msgr2=0x7f02400b7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:52.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.629+0000 7f0247fe4640 1 -- 172.21.15.60:0/2952214697 shutdown_connections 2024-09-12T01:41:52.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.629+0000 7f0247fe4640 1 -- 172.21.15.60:0/2952214697 wait complete. 2024-09-12T01:41:52.641 INFO:tasks.cephfs_test_runner:When a client has inodes pinned in its cache (open files), that the MDS ... ok 2024-09-12T01:41:52.641 INFO:tasks.cephfs_test_runner:Starting test: test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) When a client does not advance its oldest tid, the MDS should notice that 2024-09-12T01:41:52.641 INFO:tasks.cephfs_test_runner:test_client_oldest_tid (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-12T01:41:52.642 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:41:52.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.747+0000 7fcdbf81e640 1 Processor -- start 2024-09-12T01:41:52.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.748+0000 7fcdbf81e640 1 -- start start 2024-09-12T01:41:52.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.748+0000 7fcdbf81e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdb80d3310 0x7fcdb80d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.748+0000 7fcdbf81e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcdb80d1650 0x7fcdb80b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.748+0000 7fcdbf81e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdb815ea40 con 0x7fcdb815e660 2024-09-12T01:41:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.748+0000 7fcdbf81e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcdb80d1ac0 con 0x7fcdb80d1650 2024-09-12T01:41:52.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdbf81e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb80d3870 con 0x7fcdb80d3310 2024-09-12T01:41:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdbcdb9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdb80d3310 0x7fcdb80d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdbddbb640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcdb80d1650 0x7fcdb80b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdbcdb9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdb80d3310 0x7fcdb80d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:37708/0 (socket says 172.21.15.60:37708) 2024-09-12T01:41:52.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdbddbb640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcdb80d1650 0x7fcdb80b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39664/0 (socket says 172.21.15.60:39664) 2024-09-12T01:41:52.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdbcdb9640 1 -- 172.21.15.60:0/2866569236 learned_addr learned my addr 172.21.15.60:0/2866569236 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:52.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdbd5ba640 1 --1- 172.21.15.60:0/2866569236 >> v1:172.21.15.105:6789/0 conn(0x7fcdb815e660 0x7fcdb80cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:42586/0 (socket says 172.21.15.60:42586) 2024-09-12T01:41:52.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdb7fff640 1 -- 172.21.15.60:0/2866569236 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3611124984 0 0) 0x7fcdb815ea40 con 0x7fcdb815e660 2024-09-12T01:41:52.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdb7fff640 1 -- 172.21.15.60:0/2866569236 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcda0003520 con 0x7fcdb815e660 2024-09-12T01:41:52.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdbcdb9640 1 -- 172.21.15.60:0/2866569236 >> v2:172.21.15.105:3300/0 conn(0x7fcdb80d1650 msgr2=0x7fcdb80b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:52.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdbcdb9640 1 --2- 172.21.15.60:0/2866569236 >> v2:172.21.15.105:3300/0 conn(0x7fcdb80d1650 0x7fcdb80b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdbcdb9640 1 -- 172.21.15.60:0/2866569236 >> v1:172.21.15.105:6789/0 conn(0x7fcdb815e660 legacy=0x7fcdb80cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdbcdb9640 1 -- 172.21.15.60:0/2866569236 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb80d3b50 con 0x7fcdb80d3310 2024-09-12T01:41:52.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.749+0000 7fcdbddbb640 1 --2- 172.21.15.60:0/2866569236 >> v2:172.21.15.105:3300/0 conn(0x7fcdb80d1650 0x7fcdb80b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:41:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.750+0000 7fcdbcdb9640 1 --2- 172.21.15.60:0/2866569236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdb80d3310 0x7fcdb80d1110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009870 tx=0x7fcdac02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=900ade9eb311d49c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.750+0000 7fcdb7fff640 1 -- 172.21.15.60:0/2866569236 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac037070 con 0x7fcdb80d3310 2024-09-12T01:41:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.750+0000 7fcdb7fff640 1 -- 172.21.15.60:0/2866569236 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdac032440 con 0x7fcdb80d3310 2024-09-12T01:41:52.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.750+0000 7fcdb7fff640 1 -- 172.21.15.60:0/2866569236 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac0327f0 con 0x7fcdb80d3310 2024-09-12T01:41:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.751+0000 7fcdbf81e640 1 -- 172.21.15.60:0/2866569236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdb80d3310 msgr2=0x7fcdb80d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.751+0000 7fcdbf81e640 1 --2- 172.21.15.60:0/2866569236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdb80d3310 0x7fcdb80d1110 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009870 tx=0x7fcdac02a270 comp rx=0 tx=0).stop 2024-09-12T01:41:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.751+0000 7fcdbf81e640 1 -- 172.21.15.60:0/2866569236 shutdown_connections 2024-09-12T01:41:52.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.751+0000 7fcdbf81e640 1 --2- 172.21.15.60:0/2866569236 >> v2:172.21.15.105:3300/0 conn(0x7fcdb80d1650 0x7fcdb80b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.751+0000 7fcdbf81e640 1 --2- 172.21.15.60:0/2866569236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdb80d3310 0x7fcdb80d1110 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.751+0000 7fcdbf81e640 1 -- 172.21.15.60:0/2866569236 >> 172.21.15.60:0/2866569236 conn(0x7fcdb80b6410 msgr2=0x7fcdb80b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:52.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.751+0000 7fcdbf81e640 1 -- 172.21.15.60:0/2866569236 shutdown_connections 2024-09-12T01:41:52.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.751+0000 7fcdbf81e640 1 -- 172.21.15.60:0/2866569236 wait complete. 2024-09-12T01:41:52.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.752+0000 7fcdbf81e640 1 Processor -- start 2024-09-12T01:41:52.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.752+0000 7fcdbf81e640 1 -- start start 2024-09-12T01:41:52.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.753+0000 7fcdbf81e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdb80d1650 0x7fcdb80c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.753+0000 7fcdbf81e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb80d3310 0x7fcdb815fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.753+0000 7fcdbf81e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdb815e660 0x7fcdb814b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.753+0000 7fcdbf81e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb80d43f0 con 0x7fcdb80d3310 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.753+0000 7fcdbf81e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcdb80d4110 con 0x7fcdb815e660 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.753+0000 7fcdbf81e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb80b80b0 con 0x7fcdb80d1650 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.753+0000 7fcdbcdb9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb80d3310 0x7fcdb815fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.753+0000 7fcdbcdb9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb80d3310 0x7fcdb815fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60178/0 (socket says 172.21.15.60:60178) 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.753+0000 7fcdbcdb9640 1 -- 172.21.15.60:0/1874566376 learned_addr learned my addr 172.21.15.60:0/1874566376 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.753+0000 7fcdbddbb640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdb815e660 0x7fcdb814b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.753+0000 7fcdbd5ba640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdb80d1650 0x7fcdb80c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.754+0000 7fcdbcdb9640 1 -- 172.21.15.60:0/1874566376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdb80d1650 msgr2=0x7fcdb80c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.754+0000 7fcdbcdb9640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdb80d1650 0x7fcdb80c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.754+0000 7fcdbcdb9640 1 -- 172.21.15.60:0/1874566376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdb815e660 msgr2=0x7fcdb814b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.754+0000 7fcdbcdb9640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdb815e660 0x7fcdb814b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.754+0000 7fcdbcdb9640 1 -- 172.21.15.60:0/1874566376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb8160700 con 0x7fcdb80d3310 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.754+0000 7fcdbddbb640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdb815e660 0x7fcdb814b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.754+0000 7fcdbcdb9640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb80d3310 0x7fcdb815fc40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0090b0 tx=0x7fcdac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.754+0000 7fcdb5ffb640 1 -- 172.21.15.60:0/1874566376 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac037040 con 0x7fcdb80d3310 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.754+0000 7fcdb5ffb640 1 -- 172.21.15.60:0/1874566376 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdac004230 con 0x7fcdb80d3310 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.754+0000 7fcdbf81e640 1 -- 172.21.15.60:0/1874566376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdb81609e0 con 0x7fcdb80d3310 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.754+0000 7fcdb5ffb640 1 -- 172.21.15.60:0/1874566376 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac003610 con 0x7fcdb80d3310 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.754+0000 7fcdbf81e640 1 -- 172.21.15.60:0/1874566376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdb8160fa0 con 0x7fcdb80d3310 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.755+0000 7fcdbf81e640 1 -- 172.21.15.60:0/1874566376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdb80b7b70 con 0x7fcdb80d3310 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.756+0000 7fcdb5ffb640 1 -- 172.21.15.60:0/1874566376 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcdac0037b0 con 0x7fcdb80d3310 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.756+0000 7fcdb5ffb640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcda406be30 0x7fcda406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:52.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.756+0000 7fcdb5ffb640 1 -- 172.21.15.60:0/1874566376 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4943+0+0 (secure 0 0 0) 0x7fcdac0ab7c0 con 0x7fcdb80d3310 2024-09-12T01:41:52.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.756+0000 7fcdbd5ba640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcda406be30 0x7fcda406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:52.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.757+0000 7fcdbd5ba640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcda406be30 0x7fcda406e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcda80012e0 tx=0x7fcda8001630 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:52.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.760+0000 7fcdb5ffb640 1 -- 172.21.15.60:0/1874566376 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcdac07a590 con 0x7fcdb80d3310 2024-09-12T01:41:52.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.938+0000 7fcdbf81e640 1 -- 172.21.15.60:0/1874566376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcdb80d22b0 con 0x7fcdb80d3310 2024-09-12T01:41:52.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.939+0000 7fcdb5ffb640 1 -- 172.21.15.60:0/1874566376 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+12995 (secure 0 0 0) 0x7fcdac079e90 con 0x7fcdb80d3310 2024-09-12T01:41:52.940 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:52.940 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":83,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:41:50.622364+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6834/95793246":"2024-09-13T01:41:47.581249+0000","172.21.15.105:6832/95793246":"2024-09-13T01:41:47.581249+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:41:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.941+0000 7fcdbf81e640 1 -- 172.21.15.60:0/1874566376 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcda406be30 msgr2=0x7fcda406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.941+0000 7fcdbf81e640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcda406be30 0x7fcda406e2f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fcda80012e0 tx=0x7fcda8001630 comp rx=0 tx=0).stop 2024-09-12T01:41:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.941+0000 7fcdbf81e640 1 -- 172.21.15.60:0/1874566376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb80d3310 msgr2=0x7fcdb815fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.941+0000 7fcdbf81e640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb80d3310 0x7fcdb815fc40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0090b0 tx=0x7fcdac0046c0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.941+0000 7fcdbf81e640 1 -- 172.21.15.60:0/1874566376 shutdown_connections 2024-09-12T01:41:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.941+0000 7fcdbf81e640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcdb815e660 0x7fcdb814b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.941+0000 7fcdbf81e640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcdb80d3310 0x7fcdb815fc40 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.941+0000 7fcdbf81e640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcda406be30 0x7fcda406e2f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.941+0000 7fcdbf81e640 1 --2- 172.21.15.60:0/1874566376 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcdb80d1650 0x7fcdb80c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:52.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.941+0000 7fcdbf81e640 1 -- 172.21.15.60:0/1874566376 >> 172.21.15.60:0/1874566376 conn(0x7fcdb80b6410 msgr2=0x7fcdb815d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:52.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.941+0000 7fcdbf81e640 1 -- 172.21.15.60:0/1874566376 shutdown_connections 2024-09-12T01:41:52.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:52.941+0000 7fcdbf81e640 1 -- 172.21.15.60:0/1874566376 wait complete. 2024-09-12T01:41:52.952 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:35:46.304939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:41:52.953 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:41:53.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.058+0000 7fe8651d6640 1 Processor -- start 2024-09-12T01:41:53.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.058+0000 7fe8651d6640 1 -- start start 2024-09-12T01:41:53.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.059+0000 7fe8651d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe86015e750 0x7fe8600cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.059+0000 7fe8651d6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8600b7790 con 0x7fe8600b6bb0 2024-09-12T01:41:53.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.059+0000 7fe8651d6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8600d3600 con 0x7fe8600cfb70 2024-09-12T01:41:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.059+0000 7fe8651d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe8600d43c0 con 0x7fe86015e750 2024-09-12T01:41:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.059+0000 7fe85f59e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe8600b6bb0 0x7fe8600b7f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33372/0 (socket says 172.21.15.60:33372) 2024-09-12T01:41:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.059+0000 7fe85f59e640 1 -- 172.21.15.60:0/1118889706 learned_addr learned my addr 172.21.15.60:0/1118889706 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.059+0000 7fe85ed9d640 1 --2- 172.21.15.60:0/1118889706 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe86015e750 0x7fe8600cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.059+0000 7fe85dd9b640 1 -- 172.21.15.60:0/1118889706 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415093685 0 0) 0x7fe8600b7790 con 0x7fe8600b6bb0 2024-09-12T01:41:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.059+0000 7fe85dd9b640 1 -- 172.21.15.60:0/1118889706 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe848003520 con 0x7fe8600b6bb0 2024-09-12T01:41:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.060+0000 7fe85dd9b640 1 -- 172.21.15.60:0/1118889706 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1630906961 0 0) 0x7fe848003520 con 0x7fe8600b6bb0 2024-09-12T01:41:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.060+0000 7fe85ed9d640 1 -- 172.21.15.60:0/1118889706 >> v1:172.21.15.105:6789/0 conn(0x7fe8600cfb70 legacy=0x7fe8600b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.060+0000 7fe85ed9d640 1 -- 172.21.15.60:0/1118889706 >> v1:172.21.15.60:6789/0 conn(0x7fe8600b6bb0 legacy=0x7fe8600b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.060+0000 7fe85ed9d640 1 -- 172.21.15.60:0/1118889706 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8600d38e0 con 0x7fe86015e750 2024-09-12T01:41:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.060+0000 7fe85ed9d640 1 --2- 172.21.15.60:0/1118889706 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe86015e750 0x7fe8600cf630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe8500097d0 tx=0x7fe85002a030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71ee112dc19cfcd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.061+0000 7fe85dd9b640 1 -- 172.21.15.60:0/1118889706 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe850037070 con 0x7fe86015e750 2024-09-12T01:41:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.061+0000 7fe85dd9b640 1 -- 172.21.15.60:0/1118889706 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85002aac0 con 0x7fe86015e750 2024-09-12T01:41:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.061+0000 7fe85dd9b640 1 -- 172.21.15.60:0/1118889706 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858001a10 con 0x7fe86015e750 2024-09-12T01:41:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.061+0000 7fe8651d6640 1 -- 172.21.15.60:0/1118889706 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe86015e750 msgr2=0x7fe8600cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.061+0000 7fe8651d6640 1 --2- 172.21.15.60:0/1118889706 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe86015e750 0x7fe8600cf630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe8500097d0 tx=0x7fe85002a030 comp rx=0 tx=0).stop 2024-09-12T01:41:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.061+0000 7fe8651d6640 1 -- 172.21.15.60:0/1118889706 shutdown_connections 2024-09-12T01:41:53.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.061+0000 7fe8651d6640 1 --2- 172.21.15.60:0/1118889706 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe86015e750 0x7fe8600cf630 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.061+0000 7fe8651d6640 1 -- 172.21.15.60:0/1118889706 >> 172.21.15.60:0/1118889706 conn(0x7fe8600d1500 msgr2=0x7fe8600d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:53.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.061+0000 7fe8651d6640 1 -- 172.21.15.60:0/1118889706 shutdown_connections 2024-09-12T01:41:53.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.061+0000 7fe8651d6640 1 -- 172.21.15.60:0/1118889706 wait complete. 2024-09-12T01:41:53.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.063+0000 7fe8651d6640 1 Processor -- start 2024-09-12T01:41:53.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.063+0000 7fe8651d6640 1 -- start start 2024-09-12T01:41:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.063+0000 7fe8651d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8600b6bb0 0x7fe8601611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.063+0000 7fe8651d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8600cfb70 0x7fe86015c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.063+0000 7fe8651d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86015e750 0x7fe86015cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.063+0000 7fe8651d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe8600b7ac0 con 0x7fe8600cfb70 2024-09-12T01:41:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.063+0000 7fe8651d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe8600d33b0 con 0x7fe86015e750 2024-09-12T01:41:53.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.063+0000 7fe8651d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe86015eb30 con 0x7fe8600b6bb0 2024-09-12T01:41:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe85e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8600cfb70 0x7fe86015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe85e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8600cfb70 0x7fe86015c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60180/0 (socket says 172.21.15.60:60180) 2024-09-12T01:41:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe85e59c640 1 -- 172.21.15.60:0/578111342 learned_addr learned my addr 172.21.15.60:0/578111342 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe85ed9d640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8600b6bb0 0x7fe8601611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe85f59e640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86015e750 0x7fe86015cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe85e59c640 1 -- 172.21.15.60:0/578111342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8600b6bb0 msgr2=0x7fe8601611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe85e59c640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8600b6bb0 0x7fe8601611e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe85e59c640 1 -- 172.21.15.60:0/578111342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86015e750 msgr2=0x7fe86015cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe85e59c640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86015e750 0x7fe86015cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe85e59c640 1 -- 172.21.15.60:0/578111342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8600cda90 con 0x7fe8600cfb70 2024-09-12T01:41:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe85e59c640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8600cfb70 0x7fe86015c980 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c570 tx=0x7fe85400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:53.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe8477fe640 1 -- 172.21.15.60:0/578111342 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854018070 con 0x7fe8600cfb70 2024-09-12T01:41:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe8477fe640 1 -- 172.21.15.60:0/578111342 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe854005480 con 0x7fe8600cfb70 2024-09-12T01:41:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe8651d6640 1 -- 172.21.15.60:0/578111342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8600cdd70 con 0x7fe8600cfb70 2024-09-12T01:41:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe8477fe640 1 -- 172.21.15.60:0/578111342 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854007250 con 0x7fe8600cfb70 2024-09-12T01:41:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.064+0000 7fe8651d6640 1 -- 172.21.15.60:0/578111342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8600ce330 con 0x7fe8600cfb70 2024-09-12T01:41:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.065+0000 7fe8651d6640 1 -- 172.21.15.60:0/578111342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8600d0bc0 con 0x7fe8600cfb70 2024-09-12T01:41:53.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.066+0000 7fe8477fe640 1 -- 172.21.15.60:0/578111342 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe85401b070 con 0x7fe8600cfb70 2024-09-12T01:41:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.066+0000 7fe8477fe640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84c06be30 0x7fe84c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.066+0000 7fe8477fe640 1 -- 172.21.15.60:0/578111342 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4943+0+0 (secure 0 0 0) 0x7fe854089ff0 con 0x7fe8600cfb70 2024-09-12T01:41:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.066+0000 7fe85ed9d640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84c06be30 0x7fe84c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.067+0000 7fe85ed9d640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84c06be30 0x7fe84c06e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe850034000 tx=0x7fe85002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:53.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.071+0000 7fe8477fe640 1 -- 172.21.15.60:0/578111342 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8600d0bc0 con 0x7fe8600cfb70 2024-09-12T01:41:53.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.246+0000 7fe8651d6640 1 -- 172.21.15.60:0/578111342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe8600cf630 con 0x7fe8600cfb70 2024-09-12T01:41:53.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.247+0000 7fe8477fe640 1 -- 172.21.15.60:0/578111342 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) ==== 93+0+10 (secure 0 0 0) 0x7fe854058b70 con 0x7fe8600cfb70 2024-09-12T01:41:53.247 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-12T01:41:53.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.249+0000 7fe8651d6640 1 -- 172.21.15.60:0/578111342 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84c06be30 msgr2=0x7fe84c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.249+0000 7fe8651d6640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84c06be30 0x7fe84c06e2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe850034000 tx=0x7fe85002e000 comp rx=0 tx=0).stop 2024-09-12T01:41:53.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.249+0000 7fe8651d6640 1 -- 172.21.15.60:0/578111342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8600cfb70 msgr2=0x7fe86015c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.249+0000 7fe8651d6640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8600cfb70 0x7fe86015c980 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c570 tx=0x7fe85400ca30 comp rx=0 tx=0).stop 2024-09-12T01:41:53.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.249+0000 7fe8651d6640 1 -- 172.21.15.60:0/578111342 shutdown_connections 2024-09-12T01:41:53.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.249+0000 7fe8651d6640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe86015e750 0x7fe86015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.249+0000 7fe8651d6640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8600cfb70 0x7fe86015c980 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.249+0000 7fe8651d6640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe84c06be30 0x7fe84c06e2f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.249+0000 7fe8651d6640 1 --2- 172.21.15.60:0/578111342 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8600b6bb0 0x7fe8601611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.249+0000 7fe8651d6640 1 -- 172.21.15.60:0/578111342 >> 172.21.15.60:0/578111342 conn(0x7fe8600d1500 msgr2=0x7fe8600b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:53.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.249+0000 7fe8651d6640 1 -- 172.21.15.60:0/578111342 shutdown_connections 2024-09-12T01:41:53.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.249+0000 7fe8651d6640 1 -- 172.21.15.60:0/578111342 wait complete. 2024-09-12T01:41:53.260 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid' 2024-09-12T01:41:53.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.362+0000 7fbea62e6640 1 Processor -- start 2024-09-12T01:41:53.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.362+0000 7fbea62e6640 1 -- start start 2024-09-12T01:41:53.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.363+0000 7fbea62e6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbea0155800 0x7fbea00b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.363+0000 7fbea62e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbea00cfc80 0x7fbea00b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.363+0000 7fbea62e6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbea00b50a0 con 0x7fbea015c330 2024-09-12T01:41:53.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.363+0000 7fbea62e6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbea00b4e60 con 0x7fbea00cfc80 2024-09-12T01:41:53.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.363+0000 7fbea62e6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbea015c7a0 con 0x7fbea0155800 2024-09-12T01:41:53.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.363+0000 7fbea4883640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbea00cfc80 0x7fbea00b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.363+0000 7fbea4883640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbea00cfc80 0x7fbea00b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60192/0 (socket says 172.21.15.60:60192) 2024-09-12T01:41:53.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.363+0000 7fbea4883640 1 -- 172.21.15.60:0/1578211603 learned_addr learned my addr 172.21.15.60:0/1578211603 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:53.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.363+0000 7fbe9ffff640 1 --2- 172.21.15.60:0/1578211603 >> v2:172.21.15.105:3300/0 conn(0x7fbea0155800 0x7fbea00b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.364+0000 7fbea4883640 1 -- 172.21.15.60:0/1578211603 >> v2:172.21.15.105:3300/0 conn(0x7fbea0155800 msgr2=0x7fbea00b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:53.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.364+0000 7fbea4883640 1 --2- 172.21.15.60:0/1578211603 >> v2:172.21.15.105:3300/0 conn(0x7fbea0155800 0x7fbea00b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.364+0000 7fbea4883640 1 -- 172.21.15.60:0/1578211603 >> v1:172.21.15.60:6789/0 conn(0x7fbea015c330 legacy=0x7fbea00cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.364+0000 7fbea4883640 1 -- 172.21.15.60:0/1578211603 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea00b5380 con 0x7fbea00cfc80 2024-09-12T01:41:53.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.364+0000 7fbea4883640 1 --2- 172.21.15.60:0/1578211603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea00cfc80 0x7fbea00b4920 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fbea006c7f0 tx=0x7fbe9802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a84433858a3c1df server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:53.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.364+0000 7fbe9effd640 1 -- 172.21.15.60:0/1578211603 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98036070 con 0x7fbea00cfc80 2024-09-12T01:41:53.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.364+0000 7fbe9effd640 1 -- 172.21.15.60:0/1578211603 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe98031600 con 0x7fbea00cfc80 2024-09-12T01:41:53.366 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.364+0000 7fbe9effd640 1 -- 172.21.15.60:0/1578211603 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe980319d0 con 0x7fbea00cfc80 2024-09-12T01:41:53.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.365+0000 7fbea62e6640 1 -- 172.21.15.60:0/1578211603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea00cfc80 msgr2=0x7fbea00b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.365+0000 7fbea62e6640 1 --2- 172.21.15.60:0/1578211603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea00cfc80 0x7fbea00b4920 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fbea006c7f0 tx=0x7fbe9802a730 comp rx=0 tx=0).stop 2024-09-12T01:41:53.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.365+0000 7fbea62e6640 1 -- 172.21.15.60:0/1578211603 shutdown_connections 2024-09-12T01:41:53.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.365+0000 7fbea62e6640 1 --2- 172.21.15.60:0/1578211603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea00cfc80 0x7fbea00b4920 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.365+0000 7fbea62e6640 1 --2- 172.21.15.60:0/1578211603 >> v2:172.21.15.105:3300/0 conn(0x7fbea0155800 0x7fbea00b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.365+0000 7fbea62e6640 1 -- 172.21.15.60:0/1578211603 >> 172.21.15.60:0/1578211603 conn(0x7fbea006bc10 msgr2=0x7fbea006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:53.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.365+0000 7fbea62e6640 1 -- 172.21.15.60:0/1578211603 shutdown_connections 2024-09-12T01:41:53.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.365+0000 7fbea62e6640 1 -- 172.21.15.60:0/1578211603 wait complete. 2024-09-12T01:41:53.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.366+0000 7fbea62e6640 1 Processor -- start 2024-09-12T01:41:53.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.366+0000 7fbea62e6640 1 -- start start 2024-09-12T01:41:53.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.367+0000 7fbea62e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea00cfc80 0x7fbea015a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.367+0000 7fbea62e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea0155800 0x7fbea015a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.367+0000 7fbea62e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea015c330 0x7fbea01473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.367+0000 7fbea62e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbea00b5c20 con 0x7fbea0155800 2024-09-12T01:41:53.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.367+0000 7fbea62e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbea00b5940 con 0x7fbea015c330 2024-09-12T01:41:53.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.367+0000 7fbea62e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbea0155be0 con 0x7fbea00cfc80 2024-09-12T01:41:53.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.367+0000 7fbe9f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea0155800 0x7fbea015a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.367+0000 7fbe9f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea0155800 0x7fbea015a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60204/0 (socket says 172.21.15.60:60204) 2024-09-12T01:41:53.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.367+0000 7fbe9f7fe640 1 -- 172.21.15.60:0/3810869087 learned_addr learned my addr 172.21.15.60:0/3810869087 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:53.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.367+0000 7fbea4883640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea015c330 0x7fbea01473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.367+0000 7fbe9ffff640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea00cfc80 0x7fbea015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.368+0000 7fbe9f7fe640 1 -- 172.21.15.60:0/3810869087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea00cfc80 msgr2=0x7fbea015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.368+0000 7fbe9f7fe640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea00cfc80 0x7fbea015a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.368+0000 7fbe9f7fe640 1 -- 172.21.15.60:0/3810869087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea015c330 msgr2=0x7fbea01473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.368+0000 7fbe9f7fe640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea015c330 0x7fbea01473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.368+0000 7fbe9f7fe640 1 -- 172.21.15.60:0/3810869087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbea0148910 con 0x7fbea0155800 2024-09-12T01:41:53.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.368+0000 7fbe9f7fe640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea0155800 0x7fbea015a7d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400c3c0 tx=0x7fbe9400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:53.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.368+0000 7fbe9cff9640 1 -- 172.21.15.60:0/3810869087 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe940052d0 con 0x7fbea0155800 2024-09-12T01:41:53.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.368+0000 7fbe9cff9640 1 -- 172.21.15.60:0/3810869087 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe94005490 con 0x7fbea0155800 2024-09-12T01:41:53.371 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.368+0000 7fbea62e6640 1 -- 172.21.15.60:0/3810869087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbea0148bf0 con 0x7fbea0155800 2024-09-12T01:41:53.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.368+0000 7fbe9cff9640 1 -- 172.21.15.60:0/3810869087 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe94007240 con 0x7fbea0155800 2024-09-12T01:41:53.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.368+0000 7fbea62e6640 1 -- 172.21.15.60:0/3810869087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbea01491b0 con 0x7fbea0155800 2024-09-12T01:41:53.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.369+0000 7fbea62e6640 1 -- 172.21.15.60:0/3810869087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbea00b6140 con 0x7fbea0155800 2024-09-12T01:41:53.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.369+0000 7fbe9cff9640 1 -- 172.21.15.60:0/3810869087 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe940073e0 con 0x7fbea0155800 2024-09-12T01:41:53.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.370+0000 7fbe9cff9640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe8c06be30 0x7fbe8c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.370+0000 7fbe9cff9640 1 -- 172.21.15.60:0/3810869087 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4943+0+0 (secure 0 0 0) 0x7fbe94089f70 con 0x7fbea0155800 2024-09-12T01:41:53.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.370+0000 7fbe9ffff640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe8c06be30 0x7fbe8c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.371+0000 7fbe9ffff640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe8c06be30 0x7fbe8c06e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006fd0 tx=0x7fbe90008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:53.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.375+0000 7fbe9cff9640 1 -- 172.21.15.60:0/3810869087 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe940585d0 con 0x7fbea0155800 2024-09-12T01:41:53.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.616+0000 7fbea62e6640 1 -- 172.21.15.60:0/3810869087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]} v 0) -- 0x7fbea0166940 con 0x7fbea0155800 2024-09-12T01:41:53.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.628+0000 7fbe9cff9640 1 -- 172.21.15.60:0/3810869087 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]}]=0 v293) ==== 153+0+0 (secure 0 0 0) 0x7fbe9405c8d0 con 0x7fbea0155800 2024-09-12T01:41:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.630+0000 7fbea62e6640 1 -- 172.21.15.60:0/3810869087 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe8c06be30 msgr2=0x7fbe8c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.630+0000 7fbea62e6640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe8c06be30 0x7fbe8c06e2f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006fd0 tx=0x7fbe90008040 comp rx=0 tx=0).stop 2024-09-12T01:41:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.630+0000 7fbea62e6640 1 -- 172.21.15.60:0/3810869087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea0155800 msgr2=0x7fbea015a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.630+0000 7fbea62e6640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea0155800 0x7fbea015a7d0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fbe9400c3c0 tx=0x7fbe9400c880 comp rx=0 tx=0).stop 2024-09-12T01:41:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.630+0000 7fbea62e6640 1 -- 172.21.15.60:0/3810869087 shutdown_connections 2024-09-12T01:41:53.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.630+0000 7fbea62e6640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbea015c330 0x7fbea01473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.630+0000 7fbea62e6640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbea0155800 0x7fbea015a7d0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.630+0000 7fbea62e6640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe8c06be30 0x7fbe8c06e2f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.630+0000 7fbea62e6640 1 --2- 172.21.15.60:0/3810869087 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbea00cfc80 0x7fbea015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.631+0000 7fbea62e6640 1 -- 172.21.15.60:0/3810869087 >> 172.21.15.60:0/3810869087 conn(0x7fbea006bc10 msgr2=0x7fbea00ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.631+0000 7fbea62e6640 1 -- 172.21.15.60:0/3810869087 shutdown_connections 2024-09-12T01:41:53.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.631+0000 7fbea62e6640 1 -- 172.21.15.60:0/3810869087 wait complete. 2024-09-12T01:41:53.642 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:41:53.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.747+0000 7f4b66c8d640 1 Processor -- start 2024-09-12T01:41:53.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.747+0000 7f4b66c8d640 1 -- start start 2024-09-12T01:41:53.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.748+0000 7f4b66c8d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4b6006fa00 0x7f4b600d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.748+0000 7f4b66c8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b6015d3d0 0x7f4b600d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.748+0000 7f4b66c8d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b60071770 con 0x7f4b6015a060 2024-09-12T01:41:53.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.748+0000 7f4b66c8d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4b600712e0 con 0x7f4b6006fa00 2024-09-12T01:41:53.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.748+0000 7f4b66c8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4b600709b0 con 0x7f4b6015d3d0 2024-09-12T01:41:53.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.748+0000 7f4b5ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4b6006fa00 0x7f4b600d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.748+0000 7f4b5ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4b6006fa00 0x7f4b600d02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60206/0 (socket says 172.21.15.60:60206) 2024-09-12T01:41:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.748+0000 7f4b5ffff640 1 -- 172.21.15.60:0/3195008503 learned_addr learned my addr 172.21.15.60:0/3195008503 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.749+0000 7f4b6522a640 1 --2- 172.21.15.60:0/3195008503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b6015d3d0 0x7f4b600d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.749+0000 7f4b5ffff640 1 -- 172.21.15.60:0/3195008503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b6015d3d0 msgr2=0x7f4b600d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.749+0000 7f4b5ffff640 1 --2- 172.21.15.60:0/3195008503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b6015d3d0 0x7f4b600d0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.749+0000 7f4b5ffff640 1 -- 172.21.15.60:0/3195008503 >> v1:172.21.15.105:6789/0 conn(0x7f4b6015a060 legacy=0x7f4b6006f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:53.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.749+0000 7f4b5ffff640 1 -- 172.21.15.60:0/3195008503 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b60070c90 con 0x7f4b6006fa00 2024-09-12T01:41:53.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.749+0000 7f4b5ffff640 1 --2- 172.21.15.60:0/3195008503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b6006fa00 0x7f4b600d02d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009e50 tx=0x7f4b4802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab29649b28752290 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:53.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.749+0000 7f4b5f7fe640 1 -- 172.21.15.60:0/3195008503 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b48036070 con 0x7f4b6006fa00 2024-09-12T01:41:53.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.750+0000 7f4b5f7fe640 1 -- 172.21.15.60:0/3195008503 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b48031600 con 0x7f4b6006fa00 2024-09-12T01:41:53.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.750+0000 7f4b5f7fe640 1 -- 172.21.15.60:0/3195008503 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b480319d0 con 0x7f4b6006fa00 2024-09-12T01:41:53.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.750+0000 7f4b66c8d640 1 -- 172.21.15.60:0/3195008503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b6006fa00 msgr2=0x7f4b600d02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.750+0000 7f4b66c8d640 1 --2- 172.21.15.60:0/3195008503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b6006fa00 0x7f4b600d02d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f4b48009e50 tx=0x7f4b4802a6c0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.750+0000 7f4b66c8d640 1 -- 172.21.15.60:0/3195008503 shutdown_connections 2024-09-12T01:41:53.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.750+0000 7f4b66c8d640 1 --2- 172.21.15.60:0/3195008503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b6015d3d0 0x7f4b600d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.750+0000 7f4b66c8d640 1 --2- 172.21.15.60:0/3195008503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b6006fa00 0x7f4b600d02d0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.750+0000 7f4b66c8d640 1 -- 172.21.15.60:0/3195008503 >> 172.21.15.60:0/3195008503 conn(0x7f4b600d2430 msgr2=0x7f4b600d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:53.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.750+0000 7f4b66c8d640 1 -- 172.21.15.60:0/3195008503 shutdown_connections 2024-09-12T01:41:53.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.750+0000 7f4b66c8d640 1 -- 172.21.15.60:0/3195008503 wait complete. 2024-09-12T01:41:53.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.751+0000 7f4b66c8d640 1 Processor -- start 2024-09-12T01:41:53.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.751+0000 7f4b66c8d640 1 -- start start 2024-09-12T01:41:53.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.752+0000 7f4b66c8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b6006fa00 0x7f4b60152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.752+0000 7f4b66c8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b6015a060 0x7f4b601f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.752+0000 7f4b66c8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b6015d3d0 0x7f4b601534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.752+0000 7f4b66c8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60070030 con 0x7f4b6015d3d0 2024-09-12T01:41:53.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.752+0000 7f4b66c8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6006feb0 con 0x7f4b6015a060 2024-09-12T01:41:53.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.752+0000 7f4b66c8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4b600b1990 con 0x7f4b6006fa00 2024-09-12T01:41:53.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.752+0000 7f4b6522a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b6015d3d0 0x7f4b601534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.752+0000 7f4b6522a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b6015d3d0 0x7f4b601534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60220/0 (socket says 172.21.15.60:60220) 2024-09-12T01:41:53.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.752+0000 7f4b6522a640 1 -- 172.21.15.60:0/1603550252 learned_addr learned my addr 172.21.15.60:0/1603550252 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:53.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.753+0000 7f4b6522a640 1 -- 172.21.15.60:0/1603550252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b6006fa00 msgr2=0x7f4b60152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.753+0000 7f4b6522a640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b6006fa00 0x7f4b60152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.753+0000 7f4b6522a640 1 -- 172.21.15.60:0/1603550252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b6015a060 msgr2=0x7f4b601f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.753+0000 7f4b5ffff640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b6015a060 0x7f4b601f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.753+0000 7f4b6522a640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b6015a060 0x7f4b601f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.753+0000 7f4b6522a640 1 -- 172.21.15.60:0/1603550252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b60153c40 con 0x7f4b6015d3d0 2024-09-12T01:41:53.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.753+0000 7f4b6522a640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b6015d3d0 0x7f4b601534d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800c550 tx=0x7f4b5800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:53.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.753+0000 7f4b5d7fa640 1 -- 172.21.15.60:0/1603550252 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58015070 con 0x7f4b6015d3d0 2024-09-12T01:41:53.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.753+0000 7f4b5d7fa640 1 -- 172.21.15.60:0/1603550252 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b58004220 con 0x7f4b6015d3d0 2024-09-12T01:41:53.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.753+0000 7f4b66c8d640 1 -- 172.21.15.60:0/1603550252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b60153f20 con 0x7f4b6015d3d0 2024-09-12T01:41:53.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.753+0000 7f4b5d7fa640 1 -- 172.21.15.60:0/1603550252 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58003610 con 0x7f4b6015d3d0 2024-09-12T01:41:53.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.753+0000 7f4b66c8d640 1 -- 172.21.15.60:0/1603550252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b601544e0 con 0x7f4b6015d3d0 2024-09-12T01:41:53.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.754+0000 7f4b66c8d640 1 -- 172.21.15.60:0/1603550252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6006c6c0 con 0x7f4b6015d3d0 2024-09-12T01:41:53.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.754+0000 7f4b5d7fa640 1 -- 172.21.15.60:0/1603550252 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4b580037b0 con 0x7f4b6015d3d0 2024-09-12T01:41:53.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.755+0000 7f4b5d7fa640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4b4006be30 0x7f4b4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:53.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.755+0000 7f4b5d7fa640 1 -- 172.21.15.60:0/1603550252 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4943+0+0 (secure 0 0 0) 0x7f4b5808a8f0 con 0x7f4b6015d3d0 2024-09-12T01:41:53.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.755+0000 7f4b64a29640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4b4006be30 0x7f4b4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:53.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.755+0000 7f4b64a29640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4b4006be30 0x7f4b4006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4b60157360 tx=0x7f4b500079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:53.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.759+0000 7f4b5d7fa640 1 -- 172.21.15.60:0/1603550252 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4b58059590 con 0x7f4b6015d3d0 2024-09-12T01:41:53.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.934+0000 7f4b66c8d640 1 -- 172.21.15.60:0/1603550252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f4b6006f2f0 con 0x7f4b6015d3d0 2024-09-12T01:41:53.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.937+0000 7f4b5d7fa640 1 -- 172.21.15.60:0/1603550252 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f4b58058e90 con 0x7f4b6015d3d0 2024-09-12T01:41:53.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.939+0000 7f4b66c8d640 1 -- 172.21.15.60:0/1603550252 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4b4006be30 msgr2=0x7f4b4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.939+0000 7f4b66c8d640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4b4006be30 0x7f4b4006e2f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4b60157360 tx=0x7f4b500079b0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.939+0000 7f4b66c8d640 1 -- 172.21.15.60:0/1603550252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b6015d3d0 msgr2=0x7f4b601534d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:53.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.939+0000 7f4b66c8d640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b6015d3d0 0x7f4b601534d0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800c550 tx=0x7f4b5800ca10 comp rx=0 tx=0).stop 2024-09-12T01:41:53.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.940+0000 7f4b66c8d640 1 -- 172.21.15.60:0/1603550252 shutdown_connections 2024-09-12T01:41:53.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.940+0000 7f4b66c8d640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b6015d3d0 0x7f4b601534d0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.940+0000 7f4b66c8d640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4b6015a060 0x7f4b601f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.940+0000 7f4b66c8d640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4b4006be30 0x7f4b4006e2f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.940+0000 7f4b66c8d640 1 --2- 172.21.15.60:0/1603550252 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4b6006fa00 0x7f4b60152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:53.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.940+0000 7f4b66c8d640 1 -- 172.21.15.60:0/1603550252 >> 172.21.15.60:0/1603550252 conn(0x7f4b600d2430 msgr2=0x7f4b601578b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:53.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.940+0000 7f4b66c8d640 1 -- 172.21.15.60:0/1603550252 shutdown_connections 2024-09-12T01:41:53.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:53.940+0000 7f4b66c8d640 1 -- 172.21.15.60:0/1603550252 wait complete. 2024-09-12T01:41:53.951 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:41:53.952 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:41:54.006 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:41:54.064 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:41:54.065 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:41:54.065 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:41:54.081 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:41:54.081 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:41:54.081 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:41:54.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:41:54.100 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:41:54.100 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:41:54.137 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:41:54.137 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:41:54.137 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:41:54.159 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:41:54.160 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:41:54.160 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:41:54.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.279+0000 7fc04b9c4640 1 Processor -- start 2024-09-12T01:41:54.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.279+0000 7fc04b9c4640 1 -- start start 2024-09-12T01:41:54.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.280+0000 7fc04b9c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc04406d540 0x7fc0440cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.280+0000 7fc04b9c4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc0440735b0 0x7fc0440cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.280+0000 7fc04b9c4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc04406faf0 con 0x7fc04415e950 2024-09-12T01:41:54.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.280+0000 7fc04b9c4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc04406fdd0 con 0x7fc0440735b0 2024-09-12T01:41:54.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.280+0000 7fc04b9c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc0440700b0 con 0x7fc04406d540 2024-09-12T01:41:54.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.280+0000 7fc049760640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc04415e950 0x7fc04406ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33402/0 (socket says 172.21.15.60:33402) 2024-09-12T01:41:54.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.280+0000 7fc049760640 1 -- 172.21.15.60:0/1174510145 learned_addr learned my addr 172.21.15.60:0/1174510145 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:54.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.280+0000 7fc049f61640 1 --2- 172.21.15.60:0/1174510145 >> v2:172.21.15.105:3300/0 conn(0x7fc0440735b0 0x7fc0440cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.280+0000 7fc048f5f640 1 --2- 172.21.15.60:0/1174510145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc04406d540 0x7fc0440cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.280+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204009338 0 0) 0x7fc04406faf0 con 0x7fc04415e950 2024-09-12T01:41:54.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.280+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc02c003520 con 0x7fc04415e950 2024-09-12T01:41:54.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1480258851 0 0) 0x7fc02c003520 con 0x7fc04415e950 2024-09-12T01:41:54.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc04406d540 msgr2=0x7fc0440cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:54.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 --2- 172.21.15.60:0/1174510145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc04406d540 0x7fc0440cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 >> v2:172.21.15.105:3300/0 conn(0x7fc0440735b0 msgr2=0x7fc0440cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:54.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 --2- 172.21.15.60:0/1174510145 >> v2:172.21.15.105:3300/0 conn(0x7fc0440735b0 0x7fc0440cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc044070390 con 0x7fc04415e950 2024-09-12T01:41:54.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fc03c001670 con 0x7fc04415e950 2024-09-12T01:41:54.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 >> v1:172.21.15.60:6789/0 conn(0x7fc04415e950 legacy=0x7fc04406ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:54.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 --2- 172.21.15.60:0/1174510145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c0039b0 0x7fc02c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 --2- 172.21.15.60:0/1174510145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc02c004800 0x7fc02c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 --2- 172.21.15.60:0/1174510145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc04406d540 0x7fc02c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc04406fdd0 con 0x7fc02c0039b0 2024-09-12T01:41:54.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc0440700b0 con 0x7fc02c004800 2024-09-12T01:41:54.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc02c00b9c0 con 0x7fc04406d540 2024-09-12T01:41:54.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc049760640 1 --2- 172.21.15.60:0/1174510145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c0039b0 0x7fc02c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc048f5f640 1 --2- 172.21.15.60:0/1174510145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc02c004800 0x7fc02c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc049f61640 1 --2- 172.21.15.60:0/1174510145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc04406d540 0x7fc02c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc049760640 1 -- 172.21.15.60:0/1174510145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc04406d540 msgr2=0x7fc02c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:54.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc049760640 1 --2- 172.21.15.60:0/1174510145 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc04406d540 0x7fc02c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc049760640 1 -- 172.21.15.60:0/1174510145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc02c004800 msgr2=0x7fc02c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc049760640 1 --2- 172.21.15.60:0/1174510145 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc02c004800 0x7fc02c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.281+0000 7fc049760640 1 -- 172.21.15.60:0/1174510145 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c003520 con 0x7fc02c0039b0 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.282+0000 7fc049760640 1 --2- 172.21.15.60:0/1174510145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c0039b0 0x7fc02c003dd0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc03c007fd0 tx=0x7fc02c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80e55aeaa006da3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.282+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c007d50 con 0x7fc02c0039b0 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.282+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc03c005ad0 con 0x7fc02c0039b0 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.282+0000 7fc043fff640 1 -- 172.21.15.60:0/1174510145 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c007070 con 0x7fc02c0039b0 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.282+0000 7fc04b9c4640 1 -- 172.21.15.60:0/1174510145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c0039b0 msgr2=0x7fc02c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.283+0000 7fc04b9c4640 1 --2- 172.21.15.60:0/1174510145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c0039b0 0x7fc02c003dd0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fc03c007fd0 tx=0x7fc02c005830 comp rx=0 tx=0).stop 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.283+0000 7fc049f61640 1 -- 172.21.15.60:0/1174510145 reap_dead start 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.283+0000 7fc04b9c4640 1 -- 172.21.15.60:0/1174510145 shutdown_connections 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.283+0000 7fc04b9c4640 1 -- 172.21.15.60:0/1174510145 >> 172.21.15.60:0/1174510145 conn(0x7fc0440d14d0 msgr2=0x7fc0440d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.283+0000 7fc04b9c4640 1 -- 172.21.15.60:0/1174510145 shutdown_connections 2024-09-12T01:41:54.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.283+0000 7fc04b9c4640 1 -- 172.21.15.60:0/1174510145 wait complete. 2024-09-12T01:41:54.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.284+0000 7fc04b9c4640 1 Processor -- start 2024-09-12T01:41:54.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.284+0000 7fc04b9c4640 1 -- start start 2024-09-12T01:41:54.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc04b9c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c0039b0 0x7fc044156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc04b9c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc044154e00 0x7fc04414b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc04b9c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0441594e0 0x7fc04415a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc04b9c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc0440721d0 con 0x7fc02c0039b0 2024-09-12T01:41:54.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc04b9c4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc044072050 con 0x7fc044154e00 2024-09-12T01:41:54.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc04b9c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc044072350 con 0x7fc0441594e0 2024-09-12T01:41:54.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc049760640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c0039b0 0x7fc044156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc049760640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c0039b0 0x7fc044156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60236/0 (socket says 172.21.15.60:60236) 2024-09-12T01:41:54.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc049760640 1 -- 172.21.15.60:0/2196552684 learned_addr learned my addr 172.21.15.60:0/2196552684 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:54.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc049f61640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0441594e0 0x7fc04415a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc048f5f640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc044154e00 0x7fc04414b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc049760640 1 -- 172.21.15.60:0/2196552684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0441594e0 msgr2=0x7fc04415a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:54.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc049760640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0441594e0 0x7fc04415a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc049760640 1 -- 172.21.15.60:0/2196552684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc044154e00 msgr2=0x7fc04414b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:54.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc049760640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc044154e00 0x7fc04414b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc049760640 1 -- 172.21.15.60:0/2196552684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0441552e0 con 0x7fc02c0039b0 2024-09-12T01:41:54.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc049760640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c0039b0 0x7fc044156380 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc03c02ae20 tx=0x7fc044070670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:54.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc041ffb640 1 -- 172.21.15.60:0/2196552684 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c001cb0 con 0x7fc02c0039b0 2024-09-12T01:41:54.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc041ffb640 1 -- 172.21.15.60:0/2196552684 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc03c043070 con 0x7fc02c0039b0 2024-09-12T01:41:54.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc04b9c4640 1 -- 172.21.15.60:0/2196552684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0441555c0 con 0x7fc02c0039b0 2024-09-12T01:41:54.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.285+0000 7fc041ffb640 1 -- 172.21.15.60:0/2196552684 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc03c004e30 con 0x7fc02c0039b0 2024-09-12T01:41:54.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.286+0000 7fc04b9c4640 1 -- 172.21.15.60:0/2196552684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc044155b80 con 0x7fc02c0039b0 2024-09-12T01:41:54.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.287+0000 7fc04b9c4640 1 -- 172.21.15.60:0/2196552684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc04406ce30 con 0x7fc02c0039b0 2024-09-12T01:41:54.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.287+0000 7fc041ffb640 1 -- 172.21.15.60:0/2196552684 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc03c007070 con 0x7fc02c0039b0 2024-09-12T01:41:54.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.288+0000 7fc041ffb640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc03006be60 0x7fc03006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.288+0000 7fc048f5f640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc03006be60 0x7fc03006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.288+0000 7fc041ffb640 1 -- 172.21.15.60:0/2196552684 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4943+0+0 (secure 0 0 0) 0x7fc03c0aae90 con 0x7fc02c0039b0 2024-09-12T01:41:54.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.288+0000 7fc048f5f640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc03006be60 0x7fc03006e320 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc0440d0d10 tx=0x7fc038009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:54.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.292+0000 7fc041ffb640 1 -- 172.21.15.60:0/2196552684 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc03c079b40 con 0x7fc02c0039b0 2024-09-12T01:41:54.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.501+0000 7fc04b9c4640 1 -- 172.21.15.60:0/2196552684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc0440d03c0 con 0x7fc02c0039b0 2024-09-12T01:41:54.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.502+0000 7fc041ffb640 1 -- 172.21.15.60:0/2196552684 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+3917 (secure 0 0 0) 0x7fc03c079440 con 0x7fc02c0039b0 2024-09-12T01:41:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:54.503 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":49,"btime":"2024-09-12T01:41:48:607965+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5824,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/4036885582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":4036885582},{"type":"v1","addr":"172.21.15.105:6835","nonce":4036885582}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2254947663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2254947663},{"type":"v1","addr":"172.21.15.60:6835","nonce":2254947663}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6201,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3019966407","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3019966407},{"type":"v1","addr":"172.21.15.60:6837","nonce":3019966407}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":41},{"gid":6205,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1384591232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1384591232},{"type":"v1","addr":"172.21.15.105:6834","nonce":1384591232}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":49}],"filesystems":[]} 2024-09-12T01:41:54.503 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 49 2024-09-12T01:41:54.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.504+0000 7fc04b9c4640 1 -- 172.21.15.60:0/2196552684 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc03006be60 msgr2=0x7fc03006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:54.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.504+0000 7fc04b9c4640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc03006be60 0x7fc03006e320 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc0440d0d10 tx=0x7fc038009190 comp rx=0 tx=0).stop 2024-09-12T01:41:54.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.504+0000 7fc04b9c4640 1 -- 172.21.15.60:0/2196552684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c0039b0 msgr2=0x7fc044156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:54.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.504+0000 7fc04b9c4640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c0039b0 0x7fc044156380 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fc03c02ae20 tx=0x7fc044070670 comp rx=0 tx=0).stop 2024-09-12T01:41:54.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.504+0000 7fc04b9c4640 1 -- 172.21.15.60:0/2196552684 shutdown_connections 2024-09-12T01:41:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.504+0000 7fc04b9c4640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc03006be60 0x7fc03006e320 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.504+0000 7fc04b9c4640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0441594e0 0x7fc04415a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.504+0000 7fc04b9c4640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc044154e00 0x7fc04414b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.504+0000 7fc04b9c4640 1 --2- 172.21.15.60:0/2196552684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c0039b0 0x7fc044156380 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.504+0000 7fc04b9c4640 1 -- 172.21.15.60:0/2196552684 >> 172.21.15.60:0/2196552684 conn(0x7fc0440d14d0 msgr2=0x7fc0440cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.504+0000 7fc04b9c4640 1 -- 172.21.15.60:0/2196552684 shutdown_connections 2024-09-12T01:41:54.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.504+0000 7fc04b9c4640 1 -- 172.21.15.60:0/2196552684 wait complete. 2024-09-12T01:41:54.516 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:41:54.517 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:41:54.517 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:41:54.517 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:41:54.517 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:41:54.517 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:41:54.517 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:41:54.517 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:41:54.518 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:41:54.518 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:41:54.518 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:41:54.518 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:41:54.518 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:41:54.518 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:41:54.519 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:41:54.519 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:41:54.526 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:41:54.527 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:41:54.527 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:41:54.528 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:41:54.530 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:41:54.530 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:41:54.531 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:41:54.531 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:41:54.570 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:41:54.570 DEBUG:teuthology.parallel:result is None 2024-09-12T01:41:54.570 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:41:54.571 DEBUG:teuthology.parallel:result is None 2024-09-12T01:41:54.573 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:41:54.573 DEBUG:teuthology.parallel:result is None 2024-09-12T01:41:54.574 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:41:54.574 DEBUG:teuthology.parallel:result is None 2024-09-12T01:41:54.574 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:41:54.648 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2024-09-12T01:41:54.648 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2024-09-12T01:41:54.655 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:41:54.655 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:41:54.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.682+0000 7ffa714e6640 1 Processor -- start 2024-09-12T01:41:54.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.682+0000 7ffa714e6640 1 -- start start 2024-09-12T01:41:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.683+0000 7ffa714e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffa6c15e7a0 0x7ffa6c06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.683+0000 7ffa714e6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffa6c0cf1f0 0x7ffa6c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.683+0000 7ffa714e6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa6c0cf860 con 0x7ffa6c0b6720 2024-09-12T01:41:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.683+0000 7ffa714e6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ffa6c0b6b90 con 0x7ffa6c15e7a0 2024-09-12T01:41:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.683+0000 7ffa714e6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffa6c0d2ca0 con 0x7ffa6c0cf1f0 2024-09-12T01:41:54.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.683+0000 7ffa6b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ffa6c0b6720 0x7ffa6c1623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33406/0 (socket says 172.21.15.60:33406) 2024-09-12T01:41:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.683+0000 7ffa6b7fe640 1 -- 172.21.15.60:0/729876974 learned_addr learned my addr 172.21.15.60:0/729876974 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.683+0000 7ffa6affd640 1 --2- 172.21.15.60:0/729876974 >> v2:172.21.15.60:3300/0 conn(0x7ffa6c15e7a0 0x7ffa6c06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.683+0000 7ffa63fff640 1 --2- 172.21.15.60:0/729876974 >> v2:172.21.15.105:3300/0 conn(0x7ffa6c0cf1f0 0x7ffa6c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.684+0000 7ffa6a7fc640 1 -- 172.21.15.60:0/729876974 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3308922074 0 0) 0x7ffa6c0cf860 con 0x7ffa6c0b6720 2024-09-12T01:41:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.684+0000 7ffa6affd640 1 -- 172.21.15.60:0/729876974 >> v2:172.21.15.105:3300/0 conn(0x7ffa6c0cf1f0 msgr2=0x7ffa6c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.684+0000 7ffa6affd640 1 --2- 172.21.15.60:0/729876974 >> v2:172.21.15.105:3300/0 conn(0x7ffa6c0cf1f0 0x7ffa6c0b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.684+0000 7ffa6affd640 1 -- 172.21.15.60:0/729876974 >> v1:172.21.15.60:6789/0 conn(0x7ffa6c0b6720 legacy=0x7ffa6c1623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.684+0000 7ffa6affd640 1 -- 172.21.15.60:0/729876974 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c0cfb40 con 0x7ffa6c15e7a0 2024-09-12T01:41:54.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.684+0000 7ffa63fff640 1 --2- 172.21.15.60:0/729876974 >> v2:172.21.15.105:3300/0 conn(0x7ffa6c0cf1f0 0x7ffa6c0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:41:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.684+0000 7ffa6affd640 1 --2- 172.21.15.60:0/729876974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa6c15e7a0 0x7ffa6c06caa0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0d2110 tx=0x7ffa5c02a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e3e0c2a5e3dd65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:54.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.684+0000 7ffa6a7fc640 1 -- 172.21.15.60:0/729876974 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c037070 con 0x7ffa6c15e7a0 2024-09-12T01:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.684+0000 7ffa6a7fc640 1 -- 172.21.15.60:0/729876974 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c032440 con 0x7ffa6c15e7a0 2024-09-12T01:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.684+0000 7ffa6a7fc640 1 -- 172.21.15.60:0/729876974 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c032810 con 0x7ffa6c15e7a0 2024-09-12T01:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.685+0000 7ffa714e6640 1 -- 172.21.15.60:0/729876974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa6c15e7a0 msgr2=0x7ffa6c06caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.685+0000 7ffa714e6640 1 --2- 172.21.15.60:0/729876974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa6c15e7a0 0x7ffa6c06caa0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0d2110 tx=0x7ffa5c02a370 comp rx=0 tx=0).stop 2024-09-12T01:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.685+0000 7ffa714e6640 1 -- 172.21.15.60:0/729876974 shutdown_connections 2024-09-12T01:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.685+0000 7ffa714e6640 1 --2- 172.21.15.60:0/729876974 >> v2:172.21.15.105:3300/0 conn(0x7ffa6c0cf1f0 0x7ffa6c0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.685+0000 7ffa714e6640 1 --2- 172.21.15.60:0/729876974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa6c15e7a0 0x7ffa6c06caa0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.685+0000 7ffa714e6640 1 -- 172.21.15.60:0/729876974 >> 172.21.15.60:0/729876974 conn(0x7ffa6c0d11e0 msgr2=0x7ffa6c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.685+0000 7ffa714e6640 1 -- 172.21.15.60:0/729876974 shutdown_connections 2024-09-12T01:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.685+0000 7ffa714e6640 1 -- 172.21.15.60:0/729876974 wait complete. 2024-09-12T01:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.686+0000 7ffa714e6640 1 Processor -- start 2024-09-12T01:41:54.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.686+0000 7ffa714e6640 1 -- start start 2024-09-12T01:41:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa714e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa6c0b6720 0x7ffa6c1494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa714e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa6c0cf1f0 0x7ffa6c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa714e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa6c15e7a0 0x7ffa6c0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa714e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c0b7a00 con 0x7ffa6c0b6720 2024-09-12T01:41:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa714e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c0d2ef0 con 0x7ffa6c0cf1f0 2024-09-12T01:41:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa6affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa6c0b6720 0x7ffa6c1494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa714e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6c06cfe0 con 0x7ffa6c15e7a0 2024-09-12T01:41:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa6affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa6c0b6720 0x7ffa6c1494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60304/0 (socket says 172.21.15.60:60304) 2024-09-12T01:41:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa6affd640 1 -- 172.21.15.60:0/1172424436 learned_addr learned my addr 172.21.15.60:0/1172424436 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa63fff640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa6c0cf1f0 0x7ffa6c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa6b7fe640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa6c15e7a0 0x7ffa6c0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa6affd640 1 -- 172.21.15.60:0/1172424436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa6c15e7a0 msgr2=0x7ffa6c0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa6affd640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa6c15e7a0 0x7ffa6c0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa6affd640 1 -- 172.21.15.60:0/1172424436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa6c0cf1f0 msgr2=0x7ffa6c0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa6affd640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa6c0cf1f0 0x7ffa6c0cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa6affd640 1 -- 172.21.15.60:0/1172424436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6c0ce1c0 con 0x7ffa6c0b6720 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa6b7fe640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa6c15e7a0 0x7ffa6c0cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.687+0000 7ffa63fff640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa6c0cf1f0 0x7ffa6c0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.688+0000 7ffa6affd640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa6c0b6720 0x7ffa6c1494d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009af0 tx=0x7ffa5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.688+0000 7ffa637fe640 1 -- 172.21.15.60:0/1172424436 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c037050 con 0x7ffa6c0b6720 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.688+0000 7ffa637fe640 1 -- 172.21.15.60:0/1172424436 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5c043070 con 0x7ffa6c0b6720 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.688+0000 7ffa714e6640 1 -- 172.21.15.60:0/1172424436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c0ce4a0 con 0x7ffa6c0b6720 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.688+0000 7ffa637fe640 1 -- 172.21.15.60:0/1172424436 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c032a30 con 0x7ffa6c0b6720 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.688+0000 7ffa714e6640 1 -- 172.21.15.60:0/1172424436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c0cea60 con 0x7ffa6c0b6720 2024-09-12T01:41:54.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.689+0000 7ffa714e6640 1 -- 172.21.15.60:0/1172424436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6c15eb80 con 0x7ffa6c0b6720 2024-09-12T01:41:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.689+0000 7ffa637fe640 1 -- 172.21.15.60:0/1172424436 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffa5c032bd0 con 0x7ffa6c0b6720 2024-09-12T01:41:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.690+0000 7ffa637fe640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa4c06be30 0x7ffa4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.690+0000 7ffa637fe640 1 -- 172.21.15.60:0/1172424436 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 4943+0+0 (secure 0 0 0) 0x7ffa5c0ab7c0 con 0x7ffa6c0b6720 2024-09-12T01:41:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.690+0000 7ffa63fff640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa4c06be30 0x7ffa4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:54.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.690+0000 7ffa63fff640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa4c06be30 0x7ffa4c06e2f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0cb3c0 tx=0x7ffa54008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:54.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.694+0000 7ffa637fe640 1 -- 172.21.15.60:0/1172424436 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffa5c030340 con 0x7ffa6c0b6720 2024-09-12T01:41:54.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:54.883+0000 7ffa714e6640 1 -- 172.21.15.60:0/1172424436 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7ffa6c0d2a80 con 0x7ffa6c0b6720 2024-09-12T01:41:55.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.966+0000 7ffa637fe640 1 -- 172.21.15.60:0/1172424436 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v88) ==== 97+0+0 (secure 0 0 0) 0x7ffa5c07a500 con 0x7ffa6c0b6720 2024-09-12T01:41:55.967 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2024-09-12T01:41:55.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.969+0000 7ffa714e6640 1 -- 172.21.15.60:0/1172424436 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa4c06be30 msgr2=0x7ffa4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:55.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.969+0000 7ffa714e6640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa4c06be30 0x7ffa4c06e2f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c0cb3c0 tx=0x7ffa54008040 comp rx=0 tx=0).stop 2024-09-12T01:41:55.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.969+0000 7ffa714e6640 1 -- 172.21.15.60:0/1172424436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa6c0b6720 msgr2=0x7ffa6c1494d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:55.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.969+0000 7ffa714e6640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa6c0b6720 0x7ffa6c1494d0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009af0 tx=0x7ffa5c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:41:55.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.969+0000 7ffa714e6640 1 -- 172.21.15.60:0/1172424436 shutdown_connections 2024-09-12T01:41:55.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.969+0000 7ffa714e6640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa4c06be30 0x7ffa4c06e2f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:55.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.969+0000 7ffa714e6640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffa6c15e7a0 0x7ffa6c0cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:55.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.969+0000 7ffa714e6640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffa6c0cf1f0 0x7ffa6c0cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:55.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.969+0000 7ffa714e6640 1 --2- 172.21.15.60:0/1172424436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa6c0b6720 0x7ffa6c1494d0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:55.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.969+0000 7ffa714e6640 1 -- 172.21.15.60:0/1172424436 >> 172.21.15.60:0/1172424436 conn(0x7ffa6c0d11e0 msgr2=0x7ffa6c0b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:55.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.969+0000 7ffa714e6640 1 -- 172.21.15.60:0/1172424436 shutdown_connections 2024-09-12T01:41:55.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:55.969+0000 7ffa714e6640 1 -- 172.21.15.60:0/1172424436 wait complete. 2024-09-12T01:41:55.983 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:41:56.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.093+0000 7ff6ad5a1640 1 Processor -- start 2024-09-12T01:41:56.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.093+0000 7ff6ad5a1640 1 -- start start 2024-09-12T01:41:56.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6ad5a1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a815c2b0 0x7ff6a80b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6ad5a1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a815fb10 con 0x7ff6a815f200 2024-09-12T01:41:56.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6ad5a1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6a80b5900 con 0x7ff6a80b72f0 2024-09-12T01:41:56.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6ad5a1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a815f830 con 0x7ff6a815c2b0 2024-09-12T01:41:56.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a77fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff6a815f200 0x7ff6a806d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33416/0 (socket says 172.21.15.60:33416) 2024-09-12T01:41:56.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a77fe640 1 -- 172.21.15.60:0/3572807959 learned_addr learned my addr 172.21.15.60:0/3572807959 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:56.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 829325803 0 0) 0x7ff6a815fb10 con 0x7ff6a815f200 2024-09-12T01:41:56.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff690003520 con 0x7ff6a815f200 2024-09-12T01:41:56.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a6ffd640 1 --2- 172.21.15.60:0/3572807959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a815c2b0 0x7ff6a80b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1198304418 0 0) 0x7ff690003520 con 0x7ff6a815f200 2024-09-12T01:41:56.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a815c2b0 msgr2=0x7ff6a80b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:56.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a5ffb640 1 --2- 172.21.15.60:0/3572807959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a815c2b0 0x7ff6a80b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 >> v1:172.21.15.105:6789/0 conn(0x7ff6a80b72f0 legacy=0x7ff6a815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a806ce30 con 0x7ff6a815f200 2024-09-12T01:41:56.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7ff6a00019f0 con 0x7ff6a815f200 2024-09-12T01:41:56.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 >> v1:172.21.15.60:6789/0 conn(0x7ff6a815f200 legacy=0x7ff6a806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.094+0000 7ff6a5ffb640 1 --2- 172.21.15.60:0/3572807959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a815c2b0 0x7ff6900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a5ffb640 1 --2- 172.21.15.60:0/3572807959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff690003f60 0x7ff690004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a5ffb640 1 --2- 172.21.15.60:0/3572807959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff690004d40 0x7ff6900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a815f830 con 0x7ff690004d40 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff69000baa0 con 0x7ff690003f60 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff69000bca0 con 0x7ff6a815c2b0 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a77fe640 1 --2- 172.21.15.60:0/3572807959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff690004d40 0x7ff6900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a67fc640 1 --2- 172.21.15.60:0/3572807959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff690003f60 0x7ff690004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a6ffd640 1 --2- 172.21.15.60:0/3572807959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a815c2b0 0x7ff6900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a77fe640 1 -- 172.21.15.60:0/3572807959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a815c2b0 msgr2=0x7ff6900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a77fe640 1 --2- 172.21.15.60:0/3572807959 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a815c2b0 0x7ff6900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a77fe640 1 -- 172.21.15.60:0/3572807959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff690003f60 msgr2=0x7ff690004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a77fe640 1 --2- 172.21.15.60:0/3572807959 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff690003f60 0x7ff690004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.095+0000 7ff6a77fe640 1 -- 172.21.15.60:0/3572807959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff690003520 con 0x7ff690004d40 2024-09-12T01:41:56.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.096+0000 7ff6a77fe640 1 --2- 172.21.15.60:0/3572807959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff690004d40 0x7ff6900051c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000a860 tx=0x7ff690005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce29d9e902f4c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:56.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.096+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a000a480 con 0x7ff690004d40 2024-09-12T01:41:56.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.096+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a002f070 con 0x7ff690004d40 2024-09-12T01:41:56.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.096+0000 7ff6a5ffb640 1 -- 172.21.15.60:0/3572807959 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a002bd40 con 0x7ff690004d40 2024-09-12T01:41:56.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.096+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/3572807959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff690004d40 msgr2=0x7ff6900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.096+0000 7ff6ad5a1640 1 --2- 172.21.15.60:0/3572807959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff690004d40 0x7ff6900051c0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff6a000a860 tx=0x7ff690005830 comp rx=0 tx=0).stop 2024-09-12T01:41:56.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.096+0000 7ff6a77fe640 1 -- 172.21.15.60:0/3572807959 reap_dead start 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.096+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/3572807959 shutdown_connections 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.096+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/3572807959 >> 172.21.15.60:0/3572807959 conn(0x7ff6a80b4240 msgr2=0x7ff6a80b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.096+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/3572807959 shutdown_connections 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.096+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/3572807959 wait complete. 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.098+0000 7ff6ad5a1640 1 Processor -- start 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.098+0000 7ff6ad5a1640 1 -- start start 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6ad5a1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff690004d40 0x7ff6a8156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6ad5a1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6a81561d0 0x7ff6a8149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6ad5a1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a81f4250 0x7ff6a81f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6ad5a1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a80b7730 con 0x7ff690004d40 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6ad5a1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a806d3f0 con 0x7ff6a81561d0 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6ad5a1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff6a80b6db0 con 0x7ff6a81f4250 2024-09-12T01:41:56.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6a6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff690004d40 0x7ff6a8156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6a6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff690004d40 0x7ff6a8156720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60312/0 (socket says 172.21.15.60:60312) 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6a6ffd640 1 -- 172.21.15.60:0/2005556880 learned_addr learned my addr 172.21.15.60:0/2005556880 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6a67fc640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6a81561d0 0x7ff6a8149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6a77fe640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a81f4250 0x7ff6a81f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6a6ffd640 1 -- 172.21.15.60:0/2005556880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a81f4250 msgr2=0x7ff6a81f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6a6ffd640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a81f4250 0x7ff6a81f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6a6ffd640 1 -- 172.21.15.60:0/2005556880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6a81561d0 msgr2=0x7ff6a8149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6a6ffd640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6a81561d0 0x7ff6a8149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6a6ffd640 1 -- 172.21.15.60:0/2005556880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a8156ef0 con 0x7ff690004d40 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6a6ffd640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff690004d40 0x7ff6a8156720 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff6980119d0 tx=0x7ff698011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff68f7fe640 1 -- 172.21.15.60:0/2005556880 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69800faf0 con 0x7ff690004d40 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff68f7fe640 1 -- 172.21.15.60:0/2005556880 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff69800fc90 con 0x7ff690004d40 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/2005556880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a81571d0 con 0x7ff690004d40 2024-09-12T01:41:56.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff68f7fe640 1 -- 172.21.15.60:0/2005556880 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698014440 con 0x7ff690004d40 2024-09-12T01:41:56.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.099+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/2005556880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a8157790 con 0x7ff690004d40 2024-09-12T01:41:56.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.101+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/2005556880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6a815eaf0 con 0x7ff690004d40 2024-09-12T01:41:56.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.101+0000 7ff68f7fe640 1 -- 172.21.15.60:0/2005556880 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff698012040 con 0x7ff690004d40 2024-09-12T01:41:56.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.101+0000 7ff68f7fe640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff69406be30 0x7ff69406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.102+0000 7ff68f7fe640 1 -- 172.21.15.60:0/2005556880 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 4857+0+0 (secure 0 0 0) 0x7ff69808b200 con 0x7ff690004d40 2024-09-12T01:41:56.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.102+0000 7ff6a67fc640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff69406be30 0x7ff69406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.102+0000 7ff6a67fc640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff69406be30 0x7ff69406e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8156180 tx=0x7ff69c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:56.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.106+0000 7ff68f7fe640 1 -- 172.21.15.60:0/2005556880 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff698019030 con 0x7ff690004d40 2024-09-12T01:41:56.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.351+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/2005556880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ff6a8071940 con 0x7ff690004d40 2024-09-12T01:41:56.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.352+0000 7ff68f7fe640 1 -- 172.21.15.60:0/2005556880 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7ff698059e70 con 0x7ff690004d40 2024-09-12T01:41:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:56.353 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:41:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2024-09-12T01:41:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2024-09-12T01:41:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmIK3fKxAAM9RkghDZwJZWuKouIbObDw==", 2024-09-12T01:41:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:41:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:41:56.353 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmzqHZNxAAnhCo4gGwLgYDVzzYnoiDFA==", 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.354 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmksMWMxAAp3xMDD09rfphgPZwQcEABA==", 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2024-09-12T01:41:56.355 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmvLw/AxAApd4hl5LRD1QddnPPjRw2Kg==", 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA7ReJmc3D/JxAAXiw6n1Q3n9sCXln6YSiCBA==", 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:41:56.356 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA/ReJmEOu3CxAA4uu1neLh0mpeG9nia+/VqQ==", 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.357 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2024-09-12T01:41:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBCReJm3HHtDhAAoAdKVsjuXmpcf5R5zTtFKg==", 2024-09-12T01:41:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:41:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:41:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2024-09-12T01:41:56.358 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBFReJmtRLuIBAA/BBibpGfpXsFXqVjVrmXWA==", 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBMReJmdDNXKhAAeh5aCvMw+70z3tnwjb9Hjg==", 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.359 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBQReJm/tsIHRAAmgx+5WifY/VITGHAbUV2CQ==", 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2024-09-12T01:41:56.360 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBUReJmQFaBHhAA1vH01tePCoJQFXlHB5gcVg==", 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBYReJmTHqLAhAAtUB94Pa3eihlVdaupZ8Ggg==", 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:41:56.361 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ==", 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2024-09-12T01:41:56.362 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmTopGEBAAY0K3iZm2PotQc8a489uO/Q==", 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmqUgQDRAAAp5SAwNM9aSxZ1VVRwroNA==", 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:41:56.363 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmGfzeFRAAE2xCnzeyX/KBo3NBrkixYQ==", 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:41:56.364 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmOfXYDxAA0hydSyRvFmmNvFcRwPaXqg==", 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.365 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmjpyMKBAAMSGgYJddHs7TtCV0NszZAQ==", 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJm3Ei+JBAAhwgXWq0baTlDtaLedcaHmg==", 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.366 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.367 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T01:41:56.367 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:41:56.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.354+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/2005556880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff69406be30 msgr2=0x7ff69406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.354+0000 7ff6ad5a1640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff69406be30 0x7ff69406e2f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8156180 tx=0x7ff69c009040 comp rx=0 tx=0).stop 2024-09-12T01:41:56.368 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.354+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/2005556880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff690004d40 msgr2=0x7ff6a8156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.354+0000 7ff6ad5a1640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff690004d40 0x7ff6a8156720 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff6980119d0 tx=0x7ff698011e90 comp rx=0 tx=0).stop 2024-09-12T01:41:56.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.354+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/2005556880 shutdown_connections 2024-09-12T01:41:56.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.354+0000 7ff6ad5a1640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff69406be30 0x7ff69406e2f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.354+0000 7ff6ad5a1640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6a81f4250 0x7ff6a81f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.354+0000 7ff6ad5a1640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6a81561d0 0x7ff6a8149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.354+0000 7ff6ad5a1640 1 --2- 172.21.15.60:0/2005556880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff690004d40 0x7ff6a8156720 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.354+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/2005556880 >> 172.21.15.60:0/2005556880 conn(0x7ff6a80b4240 msgr2=0x7ff6a8160390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:56.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.354+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/2005556880 shutdown_connections 2024-09-12T01:41:56.369 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.354+0000 7ff6ad5a1640 1 -- 172.21.15.60:0/2005556880 wait complete. 2024-09-12T01:41:56.370 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:41:56.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.471+0000 7fe1863c4640 1 Processor -- start 2024-09-12T01:41:56.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.471+0000 7fe1863c4640 1 -- start start 2024-09-12T01:41:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe1863c4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe1800b6eb0 0x7fe18006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe1863c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1800d1b40 0x7fe18006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe1863c4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1800708d0 con 0x7fe1800b7290 2024-09-12T01:41:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe1863c4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe180070bb0 con 0x7fe1800d1b40 2024-09-12T01:41:56.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe1863c4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe180070e90 con 0x7fe1800b6eb0 2024-09-12T01:41:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe17f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1800d1b40 0x7fe18006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe184961640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe1800b7290 0x7fe18006d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33420/0 (socket says 172.21.15.60:33420) 2024-09-12T01:41:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe17f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1800d1b40 0x7fe18006cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60322/0 (socket says 172.21.15.60:60322) 2024-09-12T01:41:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe184961640 1 -- 172.21.15.60:0/895275346 learned_addr learned my addr 172.21.15.60:0/895275346 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe17ffff640 1 --2- 172.21.15.60:0/895275346 >> v2:172.21.15.105:3300/0 conn(0x7fe1800b6eb0 0x7fe18006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe17f7fe640 1 -- 172.21.15.60:0/895275346 >> v2:172.21.15.105:3300/0 conn(0x7fe1800b6eb0 msgr2=0x7fe18006fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe17f7fe640 1 --2- 172.21.15.60:0/895275346 >> v2:172.21.15.105:3300/0 conn(0x7fe1800b6eb0 0x7fe18006fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe17f7fe640 1 -- 172.21.15.60:0/895275346 >> v1:172.21.15.60:6789/0 conn(0x7fe1800b7290 legacy=0x7fe18006d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe17f7fe640 1 -- 172.21.15.60:0/895275346 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe180071170 con 0x7fe1800d1b40 2024-09-12T01:41:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.472+0000 7fe17ffff640 1 --2- 172.21.15.60:0/895275346 >> v2:172.21.15.105:3300/0 conn(0x7fe1800b6eb0 0x7fe18006fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:41:56.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.473+0000 7fe17f7fe640 1 --2- 172.21.15.60:0/895275346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1800d1b40 0x7fe18006cd20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe1800509d0 tx=0x7fe17402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74264c0f2bff68b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:56.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.473+0000 7fe17effd640 1 -- 172.21.15.60:0/895275346 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174037070 con 0x7fe1800d1b40 2024-09-12T01:41:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.473+0000 7fe17effd640 1 -- 172.21.15.60:0/895275346 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe174032440 con 0x7fe1800d1b40 2024-09-12T01:41:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.473+0000 7fe17effd640 1 -- 172.21.15.60:0/895275346 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe17402ae60 con 0x7fe1800d1b40 2024-09-12T01:41:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.474+0000 7fe1863c4640 1 -- 172.21.15.60:0/895275346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1800d1b40 msgr2=0x7fe18006cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.474+0000 7fe1863c4640 1 --2- 172.21.15.60:0/895275346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1800d1b40 0x7fe18006cd20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe1800509d0 tx=0x7fe17402a110 comp rx=0 tx=0).stop 2024-09-12T01:41:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.474+0000 7fe1863c4640 1 -- 172.21.15.60:0/895275346 shutdown_connections 2024-09-12T01:41:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.474+0000 7fe1863c4640 1 --2- 172.21.15.60:0/895275346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1800d1b40 0x7fe18006cd20 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.474+0000 7fe1863c4640 1 --2- 172.21.15.60:0/895275346 >> v2:172.21.15.105:3300/0 conn(0x7fe1800b6eb0 0x7fe18006fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.474+0000 7fe1863c4640 1 -- 172.21.15.60:0/895275346 >> 172.21.15.60:0/895275346 conn(0x7fe1800d2450 msgr2=0x7fe1800d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.474+0000 7fe1863c4640 1 -- 172.21.15.60:0/895275346 shutdown_connections 2024-09-12T01:41:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.474+0000 7fe1863c4640 1 -- 172.21.15.60:0/895275346 wait complete. 2024-09-12T01:41:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.475+0000 7fe1863c4640 1 Processor -- start 2024-09-12T01:41:56.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.475+0000 7fe1863c4640 1 -- start start 2024-09-12T01:41:56.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe1863c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1800b6eb0 0x7fe180150cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe1863c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1800b7290 0x7fe1801569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe1863c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1800d1b40 0x7fe180154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe1863c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe180071970 con 0x7fe1800b7290 2024-09-12T01:41:56.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe1863c4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe180070240 con 0x7fe1800d1b40 2024-09-12T01:41:56.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe1863c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe180071af0 con 0x7fe1800b6eb0 2024-09-12T01:41:56.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe17f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1800b7290 0x7fe1801569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe17f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1800b7290 0x7fe1801569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60334/0 (socket says 172.21.15.60:60334) 2024-09-12T01:41:56.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe17f7fe640 1 -- 172.21.15.60:0/2183429967 learned_addr learned my addr 172.21.15.60:0/2183429967 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:56.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe184961640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1800d1b40 0x7fe180154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe17ffff640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1800b6eb0 0x7fe180150cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe17f7fe640 1 -- 172.21.15.60:0/2183429967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1800b6eb0 msgr2=0x7fe180150cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe17f7fe640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1800b6eb0 0x7fe180150cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe17f7fe640 1 -- 172.21.15.60:0/2183429967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1800d1b40 msgr2=0x7fe180154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe17f7fe640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1800d1b40 0x7fe180154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe17f7fe640 1 -- 172.21.15.60:0/2183429967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe180153ea0 con 0x7fe1800b7290 2024-09-12T01:41:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe184961640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1800d1b40 0x7fe180154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.476+0000 7fe17ffff640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1800b6eb0 0x7fe180150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.477+0000 7fe17f7fe640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1800b7290 0x7fe1801569a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe174009890 tx=0x7fe1740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.477+0000 7fe17cff9640 1 -- 172.21.15.60:0/2183429967 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174037040 con 0x7fe1800b7290 2024-09-12T01:41:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.477+0000 7fe17cff9640 1 -- 172.21.15.60:0/2183429967 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe174042070 con 0x7fe1800b7290 2024-09-12T01:41:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.477+0000 7fe1863c4640 1 -- 172.21.15.60:0/2183429967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe180154180 con 0x7fe1800b7290 2024-09-12T01:41:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.477+0000 7fe17cff9640 1 -- 172.21.15.60:0/2183429967 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe174030a50 con 0x7fe1800b7290 2024-09-12T01:41:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.477+0000 7fe1863c4640 1 -- 172.21.15.60:0/2183429967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1801588e0 con 0x7fe1800b7290 2024-09-12T01:41:56.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.478+0000 7fe1863c4640 1 -- 172.21.15.60:0/2183429967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe18006fd00 con 0x7fe1800b7290 2024-09-12T01:41:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.478+0000 7fe17cff9640 1 -- 172.21.15.60:0/2183429967 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe174030bf0 con 0x7fe1800b7290 2024-09-12T01:41:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.479+0000 7fe17cff9640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe16c06be30 0x7fe16c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.479+0000 7fe17cff9640 1 -- 172.21.15.60:0/2183429967 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 4857+0+0 (secure 0 0 0) 0x7fe1740ab560 con 0x7fe1800b7290 2024-09-12T01:41:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.479+0000 7fe17ffff640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe16c06be30 0x7fe16c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.479+0000 7fe17ffff640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe16c06be30 0x7fe16c06e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe17000a990 tx=0x7fe170008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:56.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.483+0000 7fe17cff9640 1 -- 172.21.15.60:0/2183429967 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe174045360 con 0x7fe1800b7290 2024-09-12T01:41:56.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.662+0000 7fe1863c4640 1 -- 172.21.15.60:0/2183429967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe1800b3680 con 0x7fe1800b7290 2024-09-12T01:41:56.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.662+0000 7fe17cff9640 1 -- 172.21.15.60:0/2183429967 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v88) ==== 84+0+65 (secure 0 0 0) 0x7fe17407a2f0 con 0x7fe1800b7290 2024-09-12T01:41:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:41:56.663 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T01:41:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:41:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T01:41:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T01:41:56.663 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:41:56.663 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T01:41:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.664+0000 7fe1863c4640 1 -- 172.21.15.60:0/2183429967 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe16c06be30 msgr2=0x7fe16c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.664+0000 7fe1863c4640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe16c06be30 0x7fe16c06e2f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe17000a990 tx=0x7fe170008040 comp rx=0 tx=0).stop 2024-09-12T01:41:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.664+0000 7fe1863c4640 1 -- 172.21.15.60:0/2183429967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1800b7290 msgr2=0x7fe1801569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.664+0000 7fe1863c4640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1800b7290 0x7fe1801569a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fe174009890 tx=0x7fe1740046c0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.664+0000 7fe1863c4640 1 -- 172.21.15.60:0/2183429967 shutdown_connections 2024-09-12T01:41:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.664+0000 7fe1863c4640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe1800d1b40 0x7fe180154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.664+0000 7fe1863c4640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1800b7290 0x7fe1801569a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.664+0000 7fe1863c4640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe16c06be30 0x7fe16c06e2f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.664+0000 7fe1863c4640 1 --2- 172.21.15.60:0/2183429967 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe1800b6eb0 0x7fe180150cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.664+0000 7fe1863c4640 1 -- 172.21.15.60:0/2183429967 >> 172.21.15.60:0/2183429967 conn(0x7fe1800d2450 msgr2=0x7fe18006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.664+0000 7fe1863c4640 1 -- 172.21.15.60:0/2183429967 shutdown_connections 2024-09-12T01:41:56.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.664+0000 7fe1863c4640 1 -- 172.21.15.60:0/2183429967 wait complete. 2024-09-12T01:41:56.675 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:41:56.675 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:41:56.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.781+0000 7f919e827640 1 Processor -- start 2024-09-12T01:41:56.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.781+0000 7f919e827640 1 -- start start 2024-09-12T01:41:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.782+0000 7f919e827640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f919815c2a0 0x7f91980735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.782+0000 7f919e827640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f919806fe20 0x7f919806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.782+0000 7f919e827640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9198074120 con 0x7f9198073b10 2024-09-12T01:41:56.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.782+0000 7f919e827640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f919815c680 con 0x7f919806fe20 2024-09-12T01:41:56.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.782+0000 7f919e827640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f919815ef00 con 0x7f919815c2a0 2024-09-12T01:41:56.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.782+0000 7f919cdc4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f919806fe20 0x7f919806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.782+0000 7f919cdc4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f919806fe20 0x7f919806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60336/0 (socket says 172.21.15.60:60336) 2024-09-12T01:41:56.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.782+0000 7f919cdc4640 1 -- 172.21.15.60:0/708808899 learned_addr learned my addr 172.21.15.60:0/708808899 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:56.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.783+0000 7f9197fff640 1 --2- 172.21.15.60:0/708808899 >> v2:172.21.15.105:3300/0 conn(0x7f919815c2a0 0x7f91980735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.783+0000 7f919cdc4640 1 -- 172.21.15.60:0/708808899 >> v2:172.21.15.105:3300/0 conn(0x7f919815c2a0 msgr2=0x7f91980735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:56.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.783+0000 7f919cdc4640 1 --2- 172.21.15.60:0/708808899 >> v2:172.21.15.105:3300/0 conn(0x7f919815c2a0 0x7f91980735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.783+0000 7f919cdc4640 1 -- 172.21.15.60:0/708808899 >> v1:172.21.15.105:6789/0 conn(0x7f9198073b10 legacy=0x7f919806f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.783+0000 7f919cdc4640 1 -- 172.21.15.60:0/708808899 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919815f1e0 con 0x7f919806fe20 2024-09-12T01:41:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.783+0000 7f919cdc4640 1 --2- 172.21.15.60:0/708808899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919806fe20 0x7f919806bc10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f91980b4030 tx=0x7f919002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ed22cf9d5f94dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.784+0000 7f9196ffd640 1 -- 172.21.15.60:0/708808899 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9190036070 con 0x7f919806fe20 2024-09-12T01:41:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.784+0000 7f9196ffd640 1 -- 172.21.15.60:0/708808899 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9190031600 con 0x7f919806fe20 2024-09-12T01:41:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.784+0000 7f9196ffd640 1 -- 172.21.15.60:0/708808899 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91900319d0 con 0x7f919806fe20 2024-09-12T01:41:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.784+0000 7f919e827640 1 -- 172.21.15.60:0/708808899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919806fe20 msgr2=0x7f919806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.784+0000 7f919e827640 1 --2- 172.21.15.60:0/708808899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919806fe20 0x7f919806bc10 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f91980b4030 tx=0x7f919002a730 comp rx=0 tx=0).stop 2024-09-12T01:41:56.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.784+0000 7f919e827640 1 -- 172.21.15.60:0/708808899 shutdown_connections 2024-09-12T01:41:56.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.784+0000 7f919e827640 1 --2- 172.21.15.60:0/708808899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919806fe20 0x7f919806bc10 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.784+0000 7f919e827640 1 --2- 172.21.15.60:0/708808899 >> v2:172.21.15.105:3300/0 conn(0x7f919815c2a0 0x7f91980735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.784+0000 7f919e827640 1 -- 172.21.15.60:0/708808899 >> 172.21.15.60:0/708808899 conn(0x7f91980b3070 msgr2=0x7f91980b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:56.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.784+0000 7f919e827640 1 -- 172.21.15.60:0/708808899 shutdown_connections 2024-09-12T01:41:56.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.784+0000 7f919e827640 1 -- 172.21.15.60:0/708808899 wait complete. 2024-09-12T01:41:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.785+0000 7f919e827640 1 Processor -- start 2024-09-12T01:41:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.786+0000 7f919e827640 1 -- start start 2024-09-12T01:41:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.786+0000 7f919e827640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919806fe20 0x7f91980cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.786+0000 7f919e827640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9198073b10 0x7f91981618e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.786+0000 7f919e827640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f919815c2a0 0x7f9198149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.786+0000 7f919e827640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f91980b5f20 con 0x7f919806fe20 2024-09-12T01:41:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.786+0000 7f919e827640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f919815ebf0 con 0x7f919815c2a0 2024-09-12T01:41:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.786+0000 7f919e827640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f91980b60a0 con 0x7f9198073b10 2024-09-12T01:41:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.786+0000 7f9197fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919806fe20 0x7f91980cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.786+0000 7f9197fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919806fe20 0x7f91980cf640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60348/0 (socket says 172.21.15.60:60348) 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.786+0000 7f9197fff640 1 -- 172.21.15.60:0/4256060729 learned_addr learned my addr 172.21.15.60:0/4256060729 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f91977fe640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9198073b10 0x7f91981618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f919cdc4640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f919815c2a0 0x7f9198149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f9197fff640 1 -- 172.21.15.60:0/4256060729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9198073b10 msgr2=0x7f91981618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f9197fff640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9198073b10 0x7f91981618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f9197fff640 1 -- 172.21.15.60:0/4256060729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f919815c2a0 msgr2=0x7f9198149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f9197fff640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f919815c2a0 0x7f9198149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f9197fff640 1 -- 172.21.15.60:0/4256060729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91981f7c60 con 0x7f919806fe20 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f919cdc4640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f919815c2a0 0x7f9198149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f9197fff640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919806fe20 0x7f91980cf640 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f918800d5f0 tx=0x7f918800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f9194ff9640 1 -- 172.21.15.60:0/4256060729 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91880125f0 con 0x7f919806fe20 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f9194ff9640 1 -- 172.21.15.60:0/4256060729 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9188019070 con 0x7f919806fe20 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f919e827640 1 -- 172.21.15.60:0/4256060729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91981f7f40 con 0x7f919806fe20 2024-09-12T01:41:56.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f9194ff9640 1 -- 172.21.15.60:0/4256060729 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91880129d0 con 0x7f919806fe20 2024-09-12T01:41:56.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.787+0000 7f919e827640 1 -- 172.21.15.60:0/4256060729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91981f8500 con 0x7f919806fe20 2024-09-12T01:41:56.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.788+0000 7f919e827640 1 -- 172.21.15.60:0/4256060729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91980b4370 con 0x7f919806fe20 2024-09-12T01:41:56.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.789+0000 7f9194ff9640 1 -- 172.21.15.60:0/4256060729 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9188012b70 con 0x7f919806fe20 2024-09-12T01:41:56.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.789+0000 7f9194ff9640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f918406be30 0x7f918406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:56.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.789+0000 7f91977fe640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f918406be30 0x7f918406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:56.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.789+0000 7f9194ff9640 1 -- 172.21.15.60:0/4256060729 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 4857+0+0 (secure 0 0 0) 0x7f918808af20 con 0x7f919806fe20 2024-09-12T01:41:56.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.790+0000 7f91977fe640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f918406be30 0x7f918406e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f919815e2a0 tx=0x7f918c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:56.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.794+0000 7f9194ff9640 1 -- 172.21.15.60:0/4256060729 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9188059c20 con 0x7f919806fe20 2024-09-12T01:41:56.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:56.974+0000 7f919e827640 1 -- 172.21.15.60:0/4256060729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f91980d2180 con 0x7f919806fe20 2024-09-12T01:41:57.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.969+0000 7f9194ff9640 1 -- 172.21.15.60:0/4256060729 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v89) ==== 138+0+0 (secure 0 0 0) 0x7f9188059520 con 0x7f919806fe20 2024-09-12T01:41:57.970 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-12T01:41:57.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.973+0000 7f919e827640 1 -- 172.21.15.60:0/4256060729 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f918406be30 msgr2=0x7f918406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:57.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.973+0000 7f919e827640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f918406be30 0x7f918406e2f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f919815e2a0 tx=0x7f918c009040 comp rx=0 tx=0).stop 2024-09-12T01:41:57.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.973+0000 7f919e827640 1 -- 172.21.15.60:0/4256060729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919806fe20 msgr2=0x7f91980cf640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:57.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.973+0000 7f919e827640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919806fe20 0x7f91980cf640 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f918800d5f0 tx=0x7f918800dab0 comp rx=0 tx=0).stop 2024-09-12T01:41:57.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.973+0000 7f919e827640 1 -- 172.21.15.60:0/4256060729 shutdown_connections 2024-09-12T01:41:57.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.973+0000 7f919e827640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f919815c2a0 0x7f9198149d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:57.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.973+0000 7f919e827640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f918406be30 0x7f918406e2f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:57.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.973+0000 7f919e827640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9198073b10 0x7f91981618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:57.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.973+0000 7f919e827640 1 --2- 172.21.15.60:0/4256060729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919806fe20 0x7f91980cf640 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:57.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.973+0000 7f919e827640 1 -- 172.21.15.60:0/4256060729 >> 172.21.15.60:0/4256060729 conn(0x7f91980b3070 msgr2=0x7f91980b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:57.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.974+0000 7f919e827640 1 -- 172.21.15.60:0/4256060729 shutdown_connections 2024-09-12T01:41:57.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:57.974+0000 7f919e827640 1 -- 172.21.15.60:0/4256060729 wait complete. 2024-09-12T01:41:57.990 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:41:58.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.106+0000 7fd5a079f640 1 Processor -- start 2024-09-12T01:41:58.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.107+0000 7fd5a079f640 1 -- start start 2024-09-12T01:41:58.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.108+0000 7fd5a079f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd5980731c0 0x7fd598073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:58.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.108+0000 7fd5a079f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59815a430 con 0x7fd59815de80 2024-09-12T01:41:58.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.108+0000 7fd5a079f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5980cd0a0 con 0x7fd59815a050 2024-09-12T01:41:58.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.108+0000 7fd5a079f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd598073b40 con 0x7fd5980731c0 2024-09-12T01:41:58.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.108+0000 7fd59dd3a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd5980731c0 0x7fd598073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:58.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.108+0000 7fd59ed3c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd59815de80 0x7fd59815e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33434/0 (socket says 172.21.15.60:33434) 2024-09-12T01:41:58.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.108+0000 7fd59ed3c640 1 -- 172.21.15.60:0/1073999577 learned_addr learned my addr 172.21.15.60:0/1073999577 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:41:58.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.108+0000 7fd59dd3a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd5980731c0 0x7fd598073600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60352/0 (socket says 172.21.15.60:60352) 2024-09-12T01:41:58.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.108+0000 7fd59dd3a640 1 -- 172.21.15.60:0/1073999577 >> v1:172.21.15.105:6789/0 conn(0x7fd59815a050 legacy=0x7fd59815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:58.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.108+0000 7fd59dd3a640 1 -- 172.21.15.60:0/1073999577 >> v1:172.21.15.60:6789/0 conn(0x7fd59815de80 legacy=0x7fd59815e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:58.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.108+0000 7fd59dd3a640 1 -- 172.21.15.60:0/1073999577 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5980cd380 con 0x7fd5980731c0 2024-09-12T01:41:58.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.108+0000 7fd59d539640 1 -- 172.21.15.60:0/1073999577 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892767292 0 0) 0x7fd59815a430 con 0x7fd59815de80 2024-09-12T01:41:58.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.109+0000 7fd59dd3a640 1 --2- 172.21.15.60:0/1073999577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5980731c0 0x7fd598073600 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd5880097a0 tx=0x7fd58802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d70705fac03129b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:58.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.109+0000 7fd59d539640 1 -- 172.21.15.60:0/1073999577 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588037070 con 0x7fd5980731c0 2024-09-12T01:41:58.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.109+0000 7fd59d539640 1 -- 172.21.15.60:0/1073999577 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd588032440 con 0x7fd5980731c0 2024-09-12T01:41:58.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.109+0000 7fd59d539640 1 -- 172.21.15.60:0/1073999577 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588032810 con 0x7fd5980731c0 2024-09-12T01:41:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.110+0000 7fd5a079f640 1 -- 172.21.15.60:0/1073999577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5980731c0 msgr2=0x7fd598073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.110+0000 7fd5a079f640 1 --2- 172.21.15.60:0/1073999577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5980731c0 0x7fd598073600 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd5880097a0 tx=0x7fd58802a1a0 comp rx=0 tx=0).stop 2024-09-12T01:41:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.110+0000 7fd5a079f640 1 -- 172.21.15.60:0/1073999577 shutdown_connections 2024-09-12T01:41:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.110+0000 7fd5a079f640 1 --2- 172.21.15.60:0/1073999577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5980731c0 0x7fd598073600 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.110+0000 7fd5a079f640 1 -- 172.21.15.60:0/1073999577 >> 172.21.15.60:0/1073999577 conn(0x7fd59806d0f0 msgr2=0x7fd59806d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.110+0000 7fd5a079f640 1 -- 172.21.15.60:0/1073999577 shutdown_connections 2024-09-12T01:41:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.110+0000 7fd5a079f640 1 -- 172.21.15.60:0/1073999577 wait complete. 2024-09-12T01:41:58.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.111+0000 7fd5a079f640 1 Processor -- start 2024-09-12T01:41:58.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.111+0000 7fd5a079f640 1 -- start start 2024-09-12T01:41:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd5a079f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5980731c0 0x7fd59813eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd5a079f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd59815a050 0x7fd598151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd5a079f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd59815de80 0x7fd59815e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd5a079f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd5980cdc20 con 0x7fd59815a050 2024-09-12T01:41:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd5a079f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd5980cd940 con 0x7fd59815de80 2024-09-12T01:41:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd5a079f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd5980b36e0 con 0x7fd5980731c0 2024-09-12T01:41:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd59dd3a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd59815a050 0x7fd598151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd59dd3a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd59815a050 0x7fd598151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60358/0 (socket says 172.21.15.60:60358) 2024-09-12T01:41:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd59dd3a640 1 -- 172.21.15.60:0/4091393919 learned_addr learned my addr 172.21.15.60:0/4091393919 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd59ed3c640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd59815de80 0x7fd59815e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd59e53b640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5980731c0 0x7fd59813eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd59dd3a640 1 -- 172.21.15.60:0/4091393919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5980731c0 msgr2=0x7fd59813eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd59dd3a640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5980731c0 0x7fd59813eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd59dd3a640 1 -- 172.21.15.60:0/4091393919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd59815de80 msgr2=0x7fd59815e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd59dd3a640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd59815de80 0x7fd59815e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd59dd3a640 1 -- 172.21.15.60:0/4091393919 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd598141fe0 con 0x7fd59815a050 2024-09-12T01:41:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd59e53b640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5980731c0 0x7fd59813eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:41:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd59dd3a640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd59815a050 0x7fd598151880 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd5880097a0 tx=0x7fd5880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd58effd640 1 -- 172.21.15.60:0/4091393919 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588037050 con 0x7fd59815a050 2024-09-12T01:41:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd58effd640 1 -- 172.21.15.60:0/4091393919 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd588038040 con 0x7fd59815a050 2024-09-12T01:41:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd58effd640 1 -- 172.21.15.60:0/4091393919 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd588004490 con 0x7fd59815a050 2024-09-12T01:41:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd5a079f640 1 -- 172.21.15.60:0/4091393919 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd598150da0 con 0x7fd59815a050 2024-09-12T01:41:58.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.113+0000 7fd5a079f640 1 -- 172.21.15.60:0/4091393919 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd598151dc0 con 0x7fd59815a050 2024-09-12T01:41:58.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.114+0000 7fd5a079f640 1 -- 172.21.15.60:0/4091393919 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5980ccd00 con 0x7fd59815a050 2024-09-12T01:41:58.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.114+0000 7fd58effd640 1 -- 172.21.15.60:0/4091393919 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd588030900 con 0x7fd59815a050 2024-09-12T01:41:58.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.115+0000 7fd58effd640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd57c06be30 0x7fd57c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:58.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.115+0000 7fd59e53b640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd57c06be30 0x7fd57c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:58.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.115+0000 7fd58effd640 1 -- 172.21.15.60:0/4091393919 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5227+0+0 (secure 0 0 0) 0x7fd5880ab830 con 0x7fd59815a050 2024-09-12T01:41:58.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.116+0000 7fd59e53b640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd57c06be30 0x7fd57c06e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd594007fd0 tx=0x7fd594009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:58.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.120+0000 7fd58effd640 1 -- 172.21.15.60:0/4091393919 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd58807a570 con 0x7fd59815a050 2024-09-12T01:41:58.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.295+0000 7fd5a079f640 1 -- 172.21.15.60:0/4091393919 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd598151520 con 0x7fd59815a050 2024-09-12T01:41:58.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.976+0000 7fd58effd640 1 -- 172.21.15.60:0/4091393919 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v90) ==== 170+0+0 (secure 0 0 0) 0x7fd588079e70 con 0x7fd59815a050 2024-09-12T01:41:58.975 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-12T01:41:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.979+0000 7fd5a079f640 1 -- 172.21.15.60:0/4091393919 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd57c06be30 msgr2=0x7fd57c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.979+0000 7fd5a079f640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd57c06be30 0x7fd57c06e2f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd594007fd0 tx=0x7fd594009040 comp rx=0 tx=0).stop 2024-09-12T01:41:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.979+0000 7fd5a079f640 1 -- 172.21.15.60:0/4091393919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd59815a050 msgr2=0x7fd598151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.979+0000 7fd5a079f640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd59815a050 0x7fd598151880 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd5880097a0 tx=0x7fd5880046c0 comp rx=0 tx=0).stop 2024-09-12T01:41:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.979+0000 7fd5a079f640 1 -- 172.21.15.60:0/4091393919 shutdown_connections 2024-09-12T01:41:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.979+0000 7fd5a079f640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd59815de80 0x7fd59815e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.979+0000 7fd5a079f640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd59815a050 0x7fd598151880 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.979+0000 7fd5a079f640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd57c06be30 0x7fd57c06e2f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.979+0000 7fd5a079f640 1 --2- 172.21.15.60:0/4091393919 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5980731c0 0x7fd59813eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.979+0000 7fd5a079f640 1 -- 172.21.15.60:0/4091393919 >> 172.21.15.60:0/4091393919 conn(0x7fd59806d0f0 msgr2=0x7fd5980ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.979+0000 7fd5a079f640 1 -- 172.21.15.60:0/4091393919 shutdown_connections 2024-09-12T01:41:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:58.979+0000 7fd5a079f640 1 -- 172.21.15.60:0/4091393919 wait complete. 2024-09-12T01:41:59.003 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:41:59.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.115+0000 7f31d048d640 1 Processor -- start 2024-09-12T01:41:59.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.115+0000 7f31d048d640 1 -- start start 2024-09-12T01:41:59.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.116+0000 7f31d048d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f31c80b7450 0x7f31c806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:59.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.116+0000 7f31d048d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c806e990 con 0x7f31c815e6f0 2024-09-12T01:41:59.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.116+0000 7f31d048d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c806ec70 con 0x7f31c80b54d0 2024-09-12T01:41:59.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.116+0000 7f31d048d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f31c815ec70 con 0x7f31c80b7450 2024-09-12T01:41:59.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.116+0000 7f31cea2a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f31c80b7450 0x7f31c806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:59.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.116+0000 7f31cea2a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f31c80b7450 0x7f31c806fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60362/0 (socket says 172.21.15.60:60362) 2024-09-12T01:41:59.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.116+0000 7f31cea2a640 1 -- 172.21.15.60:0/464387530 learned_addr learned my addr 172.21.15.60:0/464387530 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:59.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.116+0000 7f31ce229640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f31c815e6f0 0x7f31c80b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33440/0 (socket says 172.21.15.60:33440) 2024-09-12T01:41:59.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.116+0000 7f31cea2a640 1 -- 172.21.15.60:0/464387530 >> v1:172.21.15.105:6789/0 conn(0x7f31c80b54d0 legacy=0x7f31c8070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:41:59.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.116+0000 7f31cea2a640 1 -- 172.21.15.60:0/464387530 >> v1:172.21.15.60:6789/0 conn(0x7f31c815e6f0 legacy=0x7f31c80b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:59.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.116+0000 7f31cea2a640 1 -- 172.21.15.60:0/464387530 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c815ef50 con 0x7f31c80b7450 2024-09-12T01:41:59.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.116+0000 7f31cd227640 1 -- 172.21.15.60:0/464387530 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4123786485 0 0) 0x7f31c806e990 con 0x7f31c815e6f0 2024-09-12T01:41:59.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.117+0000 7f31cea2a640 1 --2- 172.21.15.60:0/464387530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b7450 0x7f31c806fd00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009e50 tx=0x7f31c002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303eb50188c0cbb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:59.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.117+0000 7f31cd227640 1 -- 172.21.15.60:0/464387530 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0036070 con 0x7f31c80b7450 2024-09-12T01:41:59.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.117+0000 7f31cd227640 1 -- 172.21.15.60:0/464387530 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c0031600 con 0x7f31c80b7450 2024-09-12T01:41:59.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.117+0000 7f31cd227640 1 -- 172.21.15.60:0/464387530 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c00319d0 con 0x7f31c80b7450 2024-09-12T01:41:59.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.118+0000 7f31d048d640 1 -- 172.21.15.60:0/464387530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b7450 msgr2=0x7f31c806fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:59.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.118+0000 7f31d048d640 1 --2- 172.21.15.60:0/464387530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b7450 0x7f31c806fd00 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009e50 tx=0x7f31c002a760 comp rx=0 tx=0).stop 2024-09-12T01:41:59.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.118+0000 7f31d048d640 1 -- 172.21.15.60:0/464387530 shutdown_connections 2024-09-12T01:41:59.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.118+0000 7f31d048d640 1 --2- 172.21.15.60:0/464387530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b7450 0x7f31c806fd00 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:59.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.118+0000 7f31d048d640 1 -- 172.21.15.60:0/464387530 >> 172.21.15.60:0/464387530 conn(0x7f31c80d2430 msgr2=0x7f31c80d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:59.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.118+0000 7f31d048d640 1 -- 172.21.15.60:0/464387530 shutdown_connections 2024-09-12T01:41:59.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.118+0000 7f31d048d640 1 -- 172.21.15.60:0/464387530 wait complete. 2024-09-12T01:41:59.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.119+0000 7f31d048d640 1 Processor -- start 2024-09-12T01:41:59.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.119+0000 7f31d048d640 1 -- start start 2024-09-12T01:41:59.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31d048d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b54d0 0x7f31c8162580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:59.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31d048d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31c80b7450 0x7f31c81530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:59.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31d048d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31c815e6f0 0x7f31c81f4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:59.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31d048d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31c806e730 con 0x7f31c80b54d0 2024-09-12T01:41:59.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31d048d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31c806e5b0 con 0x7f31c80b7450 2024-09-12T01:41:59.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31d048d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31c815f750 con 0x7f31c815e6f0 2024-09-12T01:41:59.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31ce229640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b54d0 0x7f31c8162580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:59.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31ce229640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b54d0 0x7f31c8162580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60370/0 (socket says 172.21.15.60:60370) 2024-09-12T01:41:59.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31ce229640 1 -- 172.21.15.60:0/1962786353 learned_addr learned my addr 172.21.15.60:0/1962786353 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31cea2a640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31c815e6f0 0x7f31c81f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31cda28640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31c80b7450 0x7f31c81530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31ce229640 1 -- 172.21.15.60:0/1962786353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31c815e6f0 msgr2=0x7f31c81f4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31ce229640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31c815e6f0 0x7f31c81f4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31ce229640 1 -- 172.21.15.60:0/1962786353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31c80b7450 msgr2=0x7f31c81530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31ce229640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31c80b7450 0x7f31c81530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31ce229640 1 -- 172.21.15.60:0/1962786353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c8153630 con 0x7f31c80b54d0 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31cea2a640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31c815e6f0 0x7f31c81f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.120+0000 7f31ce229640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b54d0 0x7f31c8162580 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f31c400c430 tx=0x7f31c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.121+0000 7f31beffd640 1 -- 172.21.15.60:0/1962786353 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c40074e0 con 0x7f31c80b54d0 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.121+0000 7f31d048d640 1 -- 172.21.15.60:0/1962786353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c8153f40 con 0x7f31c80b54d0 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.121+0000 7f31beffd640 1 -- 172.21.15.60:0/1962786353 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c40047e0 con 0x7f31c80b54d0 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.121+0000 7f31beffd640 1 -- 172.21.15.60:0/1962786353 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4004bd0 con 0x7f31c80b54d0 2024-09-12T01:41:59.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.121+0000 7f31d048d640 1 -- 172.21.15.60:0/1962786353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c8154500 con 0x7f31c80b54d0 2024-09-12T01:41:59.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.122+0000 7f31d048d640 1 -- 172.21.15.60:0/1962786353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31c806c6c0 con 0x7f31c80b54d0 2024-09-12T01:41:59.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.122+0000 7f31beffd640 1 -- 172.21.15.60:0/1962786353 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31c4011070 con 0x7f31c80b54d0 2024-09-12T01:41:59.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.123+0000 7f31beffd640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31ac06be30 0x7f31ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:41:59.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.123+0000 7f31beffd640 1 -- 172.21.15.60:0/1962786353 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5609+0+0 (secure 0 0 0) 0x7f31c408aae0 con 0x7f31c80b54d0 2024-09-12T01:41:59.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.123+0000 7f31cda28640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31ac06be30 0x7f31ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:41:59.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.123+0000 7f31cda28640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31ac06be30 0x7f31ac06e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f31c8157050 tx=0x7f31b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:41:59.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.127+0000 7f31beffd640 1 -- 172.21.15.60:0/1962786353 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31c8153630 con 0x7f31c80b54d0 2024-09-12T01:41:59.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.339+0000 7f31d048d640 1 -- 172.21.15.60:0/1962786353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f31c81590f0 con 0x7f31c80b54d0 2024-09-12T01:41:59.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.977+0000 7f31beffd640 1 -- 172.21.15.60:0/1962786353 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v51) ==== 174+0+0 (secure 0 0 0) 0x7f31c4059460 con 0x7f31c80b54d0 2024-09-12T01:41:59.977 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 14 and data pool 15 2024-09-12T01:41:59.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.982+0000 7f31d048d640 1 -- 172.21.15.60:0/1962786353 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31ac06be30 msgr2=0x7f31ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:59.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.982+0000 7f31d048d640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31ac06be30 0x7f31ac06e2f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f31c8157050 tx=0x7f31b8009040 comp rx=0 tx=0).stop 2024-09-12T01:41:59.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.982+0000 7f31d048d640 1 -- 172.21.15.60:0/1962786353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b54d0 msgr2=0x7f31c8162580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:41:59.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.982+0000 7f31d048d640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b54d0 0x7f31c8162580 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f31c400c430 tx=0x7f31c400c8f0 comp rx=0 tx=0).stop 2024-09-12T01:41:59.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.983+0000 7f31d048d640 1 -- 172.21.15.60:0/1962786353 shutdown_connections 2024-09-12T01:41:59.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.983+0000 7f31d048d640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31ac06be30 0x7f31ac06e2f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:59.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.983+0000 7f31d048d640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31c815e6f0 0x7f31c81f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:59.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.983+0000 7f31d048d640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31c80b7450 0x7f31c81530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:59.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.983+0000 7f31d048d640 1 --2- 172.21.15.60:0/1962786353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31c80b54d0 0x7f31c8162580 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:41:59.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.983+0000 7f31d048d640 1 -- 172.21.15.60:0/1962786353 >> 172.21.15.60:0/1962786353 conn(0x7f31c80d2430 msgr2=0x7f31c8159ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:41:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.985+0000 7f31d048d640 1 -- 172.21.15.60:0/1962786353 shutdown_connections 2024-09-12T01:41:59.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:41:59.985+0000 7f31d048d640 1 -- 172.21.15.60:0/1962786353 wait complete. 2024-09-12T01:42:00.016 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:42:00.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.123+0000 7f8e132a6640 1 Processor -- start 2024-09-12T01:42:00.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.124+0000 7f8e132a6640 1 -- start start 2024-09-12T01:42:00.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e132a6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8e0c0b74c0 0x7f8e0c15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e132a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c15f030 0x7f8e0c06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e132a6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e0c15fb10 con 0x7f8e0c15c2b0 2024-09-12T01:42:00.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e132a6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8e0c0b5900 con 0x7f8e0c0b74c0 2024-09-12T01:42:00.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e132a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0c15f830 con 0x7f8e0c15f030 2024-09-12T01:42:00.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e11042640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8e0c15c2b0 0x7f8e0c0b6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:33442/0 (socket says 172.21.15.60:33442) 2024-09-12T01:42:00.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e11042640 1 -- 172.21.15.60:0/3677112017 learned_addr learned my addr 172.21.15.60:0/3677112017 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:00.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412729526 0 0) 0x7f8e0c15fb10 con 0x7f8e0c15c2b0 2024-09-12T01:42:00.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e10841640 1 --2- 172.21.15.60:0/3677112017 >> v2:172.21.15.105:3300/0 conn(0x7f8e0c0b74c0 0x7f8e0c15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e11843640 1 --2- 172.21.15.60:0/3677112017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c15f030 0x7f8e0c06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8df4003520 con 0x7f8e0c15c2b0 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2801426316 0 0) 0x7f8df4003520 con 0x7f8e0c15c2b0 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c15f030 msgr2=0x7f8e0c06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 --2- 172.21.15.60:0/3677112017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c15f030 0x7f8e0c06d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 >> v2:172.21.15.105:3300/0 conn(0x7f8e0c0b74c0 msgr2=0x7f8e0c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 --2- 172.21.15.60:0/3677112017 >> v2:172.21.15.105:3300/0 conn(0x7f8e0c0b74c0 0x7f8e0c15eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0c06ce30 con 0x7f8e0c15c2b0 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f8e04001670 con 0x7f8e0c15c2b0 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 >> v1:172.21.15.60:6789/0 conn(0x7f8e0c15c2b0 legacy=0x7f8e0c0b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 --2- 172.21.15.60:0/3677112017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c15f030 0x7f8df40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 --2- 172.21.15.60:0/3677112017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8df4003f30 0x7f8df4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 --2- 172.21.15.60:0/3677112017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8df4004d40 0x7f8df40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c0b5900 con 0x7f8df4004d40 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c15f830 con 0x7f8df4003f30 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.125+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8df400b9c0 con 0x7f8e0c15f030 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.126+0000 7f8e11843640 1 --2- 172.21.15.60:0/3677112017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8df4004d40 0x7f8df40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.126+0000 7f8e11042640 1 --2- 172.21.15.60:0/3677112017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c15f030 0x7f8df40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.126+0000 7f8e10841640 1 --2- 172.21.15.60:0/3677112017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8df4003f30 0x7f8df4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.126+0000 7f8e11843640 1 -- 172.21.15.60:0/3677112017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c15f030 msgr2=0x7f8df40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.126+0000 7f8e11843640 1 --2- 172.21.15.60:0/3677112017 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c15f030 0x7f8df40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.126+0000 7f8e11843640 1 -- 172.21.15.60:0/3677112017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8df4003f30 msgr2=0x7f8df4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.126+0000 7f8e11843640 1 --2- 172.21.15.60:0/3677112017 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8df4003f30 0x7f8df4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.126+0000 7f8e11843640 1 -- 172.21.15.60:0/3677112017 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df4003520 con 0x7f8df4004d40 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.126+0000 7f8e11843640 1 --2- 172.21.15.60:0/3677112017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8df4004d40 0x7f8df40051c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc009fc0 tx=0x7f8df4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f5cc21b88424f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.127+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc009c10 con 0x7f8df4004d40 2024-09-12T01:42:00.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.127+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dfc036070 con 0x7f8df4004d40 2024-09-12T01:42:00.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.127+0000 7f8e0bfff640 1 -- 172.21.15.60:0/3677112017 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc031670 con 0x7f8df4004d40 2024-09-12T01:42:00.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.127+0000 7f8e132a6640 1 -- 172.21.15.60:0/3677112017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8df4004d40 msgr2=0x7f8df40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.127+0000 7f8e132a6640 1 --2- 172.21.15.60:0/3677112017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8df4004d40 0x7f8df40051c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc009fc0 tx=0x7f8df4005830 comp rx=0 tx=0).stop 2024-09-12T01:42:00.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.127+0000 7f8e11843640 1 -- 172.21.15.60:0/3677112017 reap_dead start 2024-09-12T01:42:00.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.127+0000 7f8e132a6640 1 -- 172.21.15.60:0/3677112017 shutdown_connections 2024-09-12T01:42:00.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.127+0000 7f8e132a6640 1 -- 172.21.15.60:0/3677112017 >> 172.21.15.60:0/3677112017 conn(0x7f8e0c0b4240 msgr2=0x7f8e0c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:00.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.127+0000 7f8e132a6640 1 -- 172.21.15.60:0/3677112017 shutdown_connections 2024-09-12T01:42:00.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.127+0000 7f8e132a6640 1 -- 172.21.15.60:0/3677112017 wait complete. 2024-09-12T01:42:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.128+0000 7f8e132a6640 1 Processor -- start 2024-09-12T01:42:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.129+0000 7f8e132a6640 1 -- start start 2024-09-12T01:42:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.129+0000 7f8e132a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8df4004d40 0x7f8e0c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.129+0000 7f8e132a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c1e7700 0x7f8e0c157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.129+0000 7f8e132a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e0c1580c0 0x7f8e0c15d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.129+0000 7f8e132a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c15f4c0 con 0x7f8df4004d40 2024-09-12T01:42:00.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.129+0000 7f8e132a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8e0c06d3f0 con 0x7f8e0c1580c0 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.129+0000 7f8e132a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0c06d910 con 0x7f8e0c1e7700 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.129+0000 7f8e11042640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8df4004d40 0x7f8e0c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.129+0000 7f8e11042640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8df4004d40 0x7f8e0c1563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60390/0 (socket says 172.21.15.60:60390) 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.129+0000 7f8e11042640 1 -- 172.21.15.60:0/708867626 learned_addr learned my addr 172.21.15.60:0/708867626 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.129+0000 7f8e11843640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e0c1580c0 0x7f8e0c15d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.130+0000 7f8e10841640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c1e7700 0x7f8e0c157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.130+0000 7f8e11042640 1 -- 172.21.15.60:0/708867626 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c1e7700 msgr2=0x7f8e0c157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.130+0000 7f8e11042640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c1e7700 0x7f8e0c157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.130+0000 7f8e11042640 1 -- 172.21.15.60:0/708867626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e0c1580c0 msgr2=0x7f8e0c15d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.130+0000 7f8e11042640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e0c1580c0 0x7f8e0c15d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.130+0000 7f8e11042640 1 -- 172.21.15.60:0/708867626 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0c156920 con 0x7f8df4004d40 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.130+0000 7f8e11042640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8df4004d40 0x7f8e0c1563e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8e040017e0 tx=0x7f8e040076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:00.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.130+0000 7f8e09ffb640 1 -- 172.21.15.60:0/708867626 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400f9c0 con 0x7f8df4004d40 2024-09-12T01:42:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.130+0000 7f8e09ffb640 1 -- 172.21.15.60:0/708867626 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e04018070 con 0x7f8df4004d40 2024-09-12T01:42:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.130+0000 7f8e09ffb640 1 -- 172.21.15.60:0/708867626 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400fde0 con 0x7f8df4004d40 2024-09-12T01:42:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.130+0000 7f8e132a6640 1 -- 172.21.15.60:0/708867626 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0c158540 con 0x7f8df4004d40 2024-09-12T01:42:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.130+0000 7f8e132a6640 1 -- 172.21.15.60:0/708867626 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e0c1e6f00 con 0x7f8df4004d40 2024-09-12T01:42:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.131+0000 7f8e132a6640 1 -- 172.21.15.60:0/708867626 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e0c15eaf0 con 0x7f8df4004d40 2024-09-12T01:42:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.132+0000 7f8e09ffb640 1 -- 172.21.15.60:0/708867626 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e0401d460 con 0x7f8df4004d40 2024-09-12T01:42:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.132+0000 7f8e09ffb640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8df806be60 0x7f8df806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.132+0000 7f8e09ffb640 1 -- 172.21.15.60:0/708867626 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5709+0+0 (secure 0 0 0) 0x7f8e0408ae30 con 0x7f8df4004d40 2024-09-12T01:42:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.132+0000 7f8e10841640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8df806be60 0x7f8df806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.133+0000 7f8e10841640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8df806be60 0x7f8df806e320 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0ce8b0 tx=0x7f8e00009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:00.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.136+0000 7f8e09ffb640 1 -- 172.21.15.60:0/708867626 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e04059870 con 0x7f8df4004d40 2024-09-12T01:42:00.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.315+0000 7f8e132a6640 1 -- 172.21.15.60:0/708867626 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e0c159b40 con 0x7f8df4004d40 2024-09-12T01:42:00.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.316+0000 7f8e09ffb640 1 -- 172.21.15.60:0/708867626 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+16645 (secure 0 0 0) 0x7f8e04059170 con 0x7f8df4004d40 2024-09-12T01:42:00.316 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:00.316 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":91,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:41:59.340132+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:41:57.005706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-12T01:41:58.327183+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:42:00.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.318+0000 7f8e132a6640 1 -- 172.21.15.60:0/708867626 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8df806be60 msgr2=0x7f8df806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.318+0000 7f8e132a6640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8df806be60 0x7f8df806e320 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0ce8b0 tx=0x7f8e00009190 comp rx=0 tx=0).stop 2024-09-12T01:42:00.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.318+0000 7f8e132a6640 1 -- 172.21.15.60:0/708867626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8df4004d40 msgr2=0x7f8e0c1563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.318+0000 7f8e132a6640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8df4004d40 0x7f8e0c1563e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f8e040017e0 tx=0x7f8e040076e0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.318+0000 7f8e132a6640 1 -- 172.21.15.60:0/708867626 shutdown_connections 2024-09-12T01:42:00.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.318+0000 7f8e132a6640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e0c1580c0 0x7f8e0c15d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.318+0000 7f8e132a6640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8df806be60 0x7f8df806e320 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.318+0000 7f8e132a6640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e0c1e7700 0x7f8e0c157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.318+0000 7f8e132a6640 1 --2- 172.21.15.60:0/708867626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8df4004d40 0x7f8e0c1563e0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.318+0000 7f8e132a6640 1 -- 172.21.15.60:0/708867626 >> 172.21.15.60:0/708867626 conn(0x7f8e0c0b4240 msgr2=0x7f8e0c15df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:00.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.318+0000 7f8e132a6640 1 -- 172.21.15.60:0/708867626 shutdown_connections 2024-09-12T01:42:00.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.318+0000 7f8e132a6640 1 -- 172.21.15.60:0/708867626 wait complete. 2024-09-12T01:42:00.329 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:42:00.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.432+0000 7f28300f1640 1 Processor -- start 2024-09-12T01:42:00.431 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.432+0000 7f28300f1640 1 -- start start 2024-09-12T01:42:00.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.433+0000 7f28300f1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28280b6140 0x7f282815c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.433+0000 7f28300f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28280b50a0 con 0x7f2828155800 2024-09-12T01:42:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.433+0000 7f28300f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28280b5380 con 0x7f28280cfc80 2024-09-12T01:42:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.433+0000 7f28300f1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f28280b6550 con 0x7f28280b6140 2024-09-12T01:42:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.433+0000 7f282e68e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28280b6140 0x7f282815c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.433+0000 7f282e68e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f28280b6140 0x7f282815c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60396/0 (socket says 172.21.15.60:60396) 2024-09-12T01:42:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.433+0000 7f282e68e640 1 -- 172.21.15.60:0/3632715283 learned_addr learned my addr 172.21.15.60:0/3632715283 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.433+0000 7f282e68e640 1 -- 172.21.15.60:0/3632715283 >> v1:172.21.15.105:6789/0 conn(0x7f28280cfc80 legacy=0x7f282815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.433+0000 7f282e68e640 1 -- 172.21.15.60:0/3632715283 >> v1:172.21.15.60:6789/0 conn(0x7f2828155800 legacy=0x7f28280cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.433+0000 7f282e68e640 1 -- 172.21.15.60:0/3632715283 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28280b5660 con 0x7f28280b6140 2024-09-12T01:42:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.433+0000 7f282ce8b640 1 -- 172.21.15.60:0/3632715283 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3329253163 0 0) 0x7f28280b50a0 con 0x7f2828155800 2024-09-12T01:42:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.434+0000 7f282e68e640 1 --2- 172.21.15.60:0/3632715283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28280b6140 0x7f282815c330 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f2820009e50 tx=0x7f282002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5b94932d844535 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.434+0000 7f282ce8b640 1 -- 172.21.15.60:0/3632715283 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820036070 con 0x7f28280b6140 2024-09-12T01:42:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.434+0000 7f282ce8b640 1 -- 172.21.15.60:0/3632715283 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2820031600 con 0x7f28280b6140 2024-09-12T01:42:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.434+0000 7f282ce8b640 1 -- 172.21.15.60:0/3632715283 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28200319d0 con 0x7f28280b6140 2024-09-12T01:42:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.435+0000 7f28300f1640 1 -- 172.21.15.60:0/3632715283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28280b6140 msgr2=0x7f282815c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.435+0000 7f28300f1640 1 --2- 172.21.15.60:0/3632715283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28280b6140 0x7f282815c330 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f2820009e50 tx=0x7f282002a760 comp rx=0 tx=0).stop 2024-09-12T01:42:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.435+0000 7f28300f1640 1 -- 172.21.15.60:0/3632715283 shutdown_connections 2024-09-12T01:42:00.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.435+0000 7f28300f1640 1 --2- 172.21.15.60:0/3632715283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28280b6140 0x7f282815c330 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.435+0000 7f28300f1640 1 -- 172.21.15.60:0/3632715283 >> 172.21.15.60:0/3632715283 conn(0x7f282806bc10 msgr2=0x7f282806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:00.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.435+0000 7f28300f1640 1 -- 172.21.15.60:0/3632715283 shutdown_connections 2024-09-12T01:42:00.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.435+0000 7f28300f1640 1 -- 172.21.15.60:0/3632715283 wait complete. 2024-09-12T01:42:00.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.436+0000 7f28300f1640 1 Processor -- start 2024-09-12T01:42:00.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.436+0000 7f28300f1640 1 -- start start 2024-09-12T01:42:00.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f28300f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28280b6140 0x7f282813efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f28300f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28280cfc80 0x7f282814d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f28300f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2828155800 0x7f282814d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f28300f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2828155be0 con 0x7f28280cfc80 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f28300f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28280b5c20 con 0x7f2828155800 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f28300f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f282815d080 con 0x7f28280b6140 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f282d68c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28280cfc80 0x7f282814d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f282d68c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28280cfc80 0x7f282814d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60406/0 (socket says 172.21.15.60:60406) 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f282d68c640 1 -- 172.21.15.60:0/2787397472 learned_addr learned my addr 172.21.15.60:0/2787397472 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f282de8d640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28280b6140 0x7f282813efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f282e68e640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2828155800 0x7f282814d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f282d68c640 1 -- 172.21.15.60:0/2787397472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28280b6140 msgr2=0x7f282813efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f282d68c640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28280b6140 0x7f282813efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f282d68c640 1 -- 172.21.15.60:0/2787397472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2828155800 msgr2=0x7f282814d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f282d68c640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2828155800 0x7f282814d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f282d68c640 1 -- 172.21.15.60:0/2787397472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282814e0d0 con 0x7f28280cfc80 2024-09-12T01:42:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.437+0000 7f282d68c640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28280cfc80 0x7f282814d240 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f281800c430 tx=0x7f281800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.438+0000 7f281e7fc640 1 -- 172.21.15.60:0/2787397472 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818011790 con 0x7f28280cfc80 2024-09-12T01:42:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.438+0000 7f281e7fc640 1 -- 172.21.15.60:0/2787397472 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2818017070 con 0x7f28280cfc80 2024-09-12T01:42:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.438+0000 7f28300f1640 1 -- 172.21.15.60:0/2787397472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282814dd90 con 0x7f28280cfc80 2024-09-12T01:42:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.438+0000 7f281e7fc640 1 -- 172.21.15.60:0/2787397472 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818011b70 con 0x7f28280cfc80 2024-09-12T01:42:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.438+0000 7f28300f1640 1 -- 172.21.15.60:0/2787397472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282814e650 con 0x7f28280cfc80 2024-09-12T01:42:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.439+0000 7f28300f1640 1 -- 172.21.15.60:0/2787397472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282815d3b0 con 0x7f28280cfc80 2024-09-12T01:42:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.439+0000 7f281e7fc640 1 -- 172.21.15.60:0/2787397472 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2818011d10 con 0x7f28280cfc80 2024-09-12T01:42:00.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.440+0000 7f281e7fc640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f280c06be30 0x7f280c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.440+0000 7f282de8d640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f280c06be30 0x7f280c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.440+0000 7f281e7fc640 1 -- 172.21.15.60:0/2787397472 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5709+0+0 (secure 0 0 0) 0x7f281808aab0 con 0x7f28280cfc80 2024-09-12T01:42:00.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.440+0000 7f282de8d640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f280c06be30 0x7f280c06e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2824000f60 tx=0x7f2824009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.444+0000 7f281e7fc640 1 -- 172.21.15.60:0/2787397472 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2818058ea0 con 0x7f28280cfc80 2024-09-12T01:42:00.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.619+0000 7f28300f1640 1 -- 172.21.15.60:0/2787397472 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f282815e090 con 0x7f28280cfc80 2024-09-12T01:42:00.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.621+0000 7f281e7fc640 1 -- 172.21.15.60:0/2787397472 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+16645 (secure 0 0 0) 0x7f281805d1a0 con 0x7f28280cfc80 2024-09-12T01:42:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:00.620 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":91,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:41:59.340132+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:41:57.005706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-12T01:41:58.327183+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:42:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.622+0000 7f28300f1640 1 -- 172.21.15.60:0/2787397472 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f280c06be30 msgr2=0x7f280c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.622+0000 7f28300f1640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f280c06be30 0x7f280c06e2f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2824000f60 tx=0x7f2824009040 comp rx=0 tx=0).stop 2024-09-12T01:42:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.622+0000 7f28300f1640 1 -- 172.21.15.60:0/2787397472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28280cfc80 msgr2=0x7f282814d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.622+0000 7f28300f1640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28280cfc80 0x7f282814d240 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f281800c430 tx=0x7f281800c8f0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.623+0000 7f28300f1640 1 -- 172.21.15.60:0/2787397472 shutdown_connections 2024-09-12T01:42:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.623+0000 7f28300f1640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2828155800 0x7f282814d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.623+0000 7f28300f1640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28280cfc80 0x7f282814d240 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.623+0000 7f28300f1640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f280c06be30 0x7f280c06e2f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.623+0000 7f28300f1640 1 --2- 172.21.15.60:0/2787397472 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28280b6140 0x7f282813efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.623+0000 7f28300f1640 1 -- 172.21.15.60:0/2787397472 >> 172.21.15.60:0/2787397472 conn(0x7f282806bc10 msgr2=0x7f282815d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.623+0000 7f28300f1640 1 -- 172.21.15.60:0/2787397472 shutdown_connections 2024-09-12T01:42:00.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.623+0000 7f28300f1640 1 -- 172.21.15.60:0/2787397472 wait complete. 2024-09-12T01:42:00.633 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:42:00.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.740+0000 7f3a27042640 1 Processor -- start 2024-09-12T01:42:00.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.740+0000 7f3a27042640 1 -- start start 2024-09-12T01:42:00.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a27042640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3a2015e6f0 0x7f3a2006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a27042640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a200b54d0 0x7f3a2015f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a27042640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2006e990 con 0x7f3a200b6d40 2024-09-12T01:42:00.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a27042640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2006ec70 con 0x7f3a200b54d0 2024-09-12T01:42:00.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a27042640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2015ec70 con 0x7f3a2015e6f0 2024-09-12T01:42:00.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a1ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a200b54d0 0x7f3a2015f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a1ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a200b54d0 0x7f3a2015f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60418/0 (socket says 172.21.15.60:60418) 2024-09-12T01:42:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a1ffff640 1 -- 172.21.15.60:0/431039041 learned_addr learned my addr 172.21.15.60:0/431039041 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a24dde640 1 --2- 172.21.15.60:0/431039041 >> v2:172.21.15.105:3300/0 conn(0x7f3a2015e6f0 0x7f3a2006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a1ffff640 1 -- 172.21.15.60:0/431039041 >> v2:172.21.15.105:3300/0 conn(0x7f3a2015e6f0 msgr2=0x7f3a2006fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a1ffff640 1 --2- 172.21.15.60:0/431039041 >> v2:172.21.15.105:3300/0 conn(0x7f3a2015e6f0 0x7f3a2006fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a1ffff640 1 -- 172.21.15.60:0/431039041 >> v1:172.21.15.105:6789/0 conn(0x7f3a200b6d40 legacy=0x7f3a200b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.744 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.741+0000 7f3a1ffff640 1 -- 172.21.15.60:0/431039041 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2015ef50 con 0x7f3a200b54d0 2024-09-12T01:42:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.742+0000 7f3a1ffff640 1 --2- 172.21.15.60:0/431039041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a200b54d0 0x7f3a2015f750 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f3a20069920 tx=0x7f3a1002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df66774602ab0386 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.742+0000 7f3a1f7fe640 1 -- 172.21.15.60:0/431039041 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10037070 con 0x7f3a200b54d0 2024-09-12T01:42:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.742+0000 7f3a1f7fe640 1 -- 172.21.15.60:0/431039041 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a10032440 con 0x7f3a200b54d0 2024-09-12T01:42:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.742+0000 7f3a1f7fe640 1 -- 172.21.15.60:0/431039041 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a10032810 con 0x7f3a200b54d0 2024-09-12T01:42:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.743+0000 7f3a27042640 1 -- 172.21.15.60:0/431039041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a200b54d0 msgr2=0x7f3a2015f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.743+0000 7f3a27042640 1 --2- 172.21.15.60:0/431039041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a200b54d0 0x7f3a2015f750 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f3a20069920 tx=0x7f3a1002a270 comp rx=0 tx=0).stop 2024-09-12T01:42:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.743+0000 7f3a27042640 1 -- 172.21.15.60:0/431039041 shutdown_connections 2024-09-12T01:42:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.743+0000 7f3a27042640 1 --2- 172.21.15.60:0/431039041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a200b54d0 0x7f3a2015f750 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.743+0000 7f3a27042640 1 --2- 172.21.15.60:0/431039041 >> v2:172.21.15.105:3300/0 conn(0x7f3a2015e6f0 0x7f3a2006fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.743+0000 7f3a27042640 1 -- 172.21.15.60:0/431039041 >> 172.21.15.60:0/431039041 conn(0x7f3a200d2430 msgr2=0x7f3a200d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:00.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.743+0000 7f3a27042640 1 -- 172.21.15.60:0/431039041 shutdown_connections 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.743+0000 7f3a27042640 1 -- 172.21.15.60:0/431039041 wait complete. 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.744+0000 7f3a27042640 1 Processor -- start 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.744+0000 7f3a27042640 1 -- start start 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a27042640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a200b54d0 0x7f3a20149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a27042640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a200b6d40 0x7f3a2015a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a27042640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a2015e6f0 0x7f3a2015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a27042640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2006e730 con 0x7f3a200b54d0 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a27042640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2006e5b0 con 0x7f3a2015e6f0 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a27042640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3a20070830 con 0x7f3a200b6d40 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a24dde640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a200b54d0 0x7f3a20149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a24dde640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a200b54d0 0x7f3a20149ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60428/0 (socket says 172.21.15.60:60428) 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a24dde640 1 -- 172.21.15.60:0/2451963753 learned_addr learned my addr 172.21.15.60:0/2451963753 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:00.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a1ffff640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a200b6d40 0x7f3a2015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a255df640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a2015e6f0 0x7f3a2015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a24dde640 1 -- 172.21.15.60:0/2451963753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a200b6d40 msgr2=0x7f3a2015a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a24dde640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a200b6d40 0x7f3a2015a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a24dde640 1 -- 172.21.15.60:0/2451963753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a2015e6f0 msgr2=0x7f3a2015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a24dde640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a2015e6f0 0x7f3a2015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a24dde640 1 -- 172.21.15.60:0/2451963753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a20160510 con 0x7f3a200b54d0 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a255df640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a2015e6f0 0x7f3a2015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a1ffff640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a200b6d40 0x7f3a2015a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a24dde640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a200b54d0 0x7f3a20149ff0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800d5f0 tx=0x7f3a0800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.745+0000 7f3a1d7fa640 1 -- 172.21.15.60:0/2451963753 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a080125f0 con 0x7f3a200b54d0 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.746+0000 7f3a1d7fa640 1 -- 172.21.15.60:0/2451963753 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a08019070 con 0x7f3a200b54d0 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.746+0000 7f3a27042640 1 -- 172.21.15.60:0/2451963753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a201607b0 con 0x7f3a200b54d0 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.746+0000 7f3a1d7fa640 1 -- 172.21.15.60:0/2451963753 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a080129d0 con 0x7f3a200b54d0 2024-09-12T01:42:00.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.746+0000 7f3a27042640 1 -- 172.21.15.60:0/2451963753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2014a530 con 0x7f3a200b54d0 2024-09-12T01:42:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.747+0000 7f3a27042640 1 -- 172.21.15.60:0/2451963753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2006c6c0 con 0x7f3a200b54d0 2024-09-12T01:42:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.747+0000 7f3a1d7fa640 1 -- 172.21.15.60:0/2451963753 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3a08012b70 con 0x7f3a200b54d0 2024-09-12T01:42:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.748+0000 7f3a1d7fa640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a0006be30 0x7f3a0006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.748+0000 7f3a1d7fa640 1 -- 172.21.15.60:0/2451963753 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5709+0+0 (secure 0 0 0) 0x7f3a0808b1d0 con 0x7f3a200b54d0 2024-09-12T01:42:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.748+0000 7f3a1ffff640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a0006be30 0x7f3a0006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.748+0000 7f3a1ffff640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a0006be30 0x7f3a0006e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3a10034000 tx=0x7f3a1002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:00.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.752+0000 7f3a1d7fa640 1 -- 172.21.15.60:0/2451963753 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3a08059c10 con 0x7f3a200b54d0 2024-09-12T01:42:00.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.964+0000 7f3a27042640 1 -- 172.21.15.60:0/2451963753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3a2015f750 con 0x7f3a200b54d0 2024-09-12T01:42:00.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.992+0000 7f3a1d7fa640 1 -- 172.21.15.60:0/2451963753 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v52) ==== 118+0+0 (secure 0 0 0) 0x7f3a08059510 con 0x7f3a200b54d0 2024-09-12T01:42:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.995+0000 7f3a27042640 1 -- 172.21.15.60:0/2451963753 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a0006be30 msgr2=0x7f3a0006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.995+0000 7f3a27042640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a0006be30 0x7f3a0006e2f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3a10034000 tx=0x7f3a1002e000 comp rx=0 tx=0).stop 2024-09-12T01:42:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.995+0000 7f3a27042640 1 -- 172.21.15.60:0/2451963753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a200b54d0 msgr2=0x7f3a20149ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.995+0000 7f3a27042640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a200b54d0 0x7f3a20149ff0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f3a0800d5f0 tx=0x7f3a0800dab0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.995+0000 7f3a27042640 1 -- 172.21.15.60:0/2451963753 shutdown_connections 2024-09-12T01:42:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.995+0000 7f3a27042640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a2015e6f0 0x7f3a2015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.995+0000 7f3a27042640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3a0006be30 0x7f3a0006e2f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.995+0000 7f3a27042640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a200b6d40 0x7f3a2015a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.995+0000 7f3a27042640 1 --2- 172.21.15.60:0/2451963753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a200b54d0 0x7f3a20149ff0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.995+0000 7f3a27042640 1 -- 172.21.15.60:0/2451963753 >> 172.21.15.60:0/2451963753 conn(0x7f3a200d2430 msgr2=0x7f3a200d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.995+0000 7f3a27042640 1 -- 172.21.15.60:0/2451963753 shutdown_connections 2024-09-12T01:42:00.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:00.995+0000 7f3a27042640 1 -- 172.21.15.60:0/2451963753 wait complete. 2024-09-12T01:42:01.006 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:42:01.006 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:42:01.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.112+0000 7f0d6f6a6640 1 Processor -- start 2024-09-12T01:42:01.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.112+0000 7f0d6f6a6640 1 -- start start 2024-09-12T01:42:01.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6f6a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d6815b480 0x7f0d680b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:01.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6f6a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0d68072700 0x7f0d6815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:01.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6f6a6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d680ccff0 con 0x7f0d680b60c0 2024-09-12T01:42:01.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6f6a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0d680b6500 con 0x7f0d68072700 2024-09-12T01:42:01.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6f6a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0d680cd2d0 con 0x7f0d6815b480 2024-09-12T01:42:01.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6dc43640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0d68072700 0x7f0d6815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:01.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6dc43640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0d68072700 0x7f0d6815bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60434/0 (socket says 172.21.15.60:60434) 2024-09-12T01:42:01.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6dc43640 1 -- 172.21.15.60:0/2111501044 learned_addr learned my addr 172.21.15.60:0/2111501044 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:01.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6d442640 1 --2- 172.21.15.60:0/2111501044 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d6815b480 0x7f0d680b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:01.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6dc43640 1 -- 172.21.15.60:0/2111501044 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d6815b480 msgr2=0x7f0d680b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:01.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6dc43640 1 --2- 172.21.15.60:0/2111501044 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d6815b480 0x7f0d680b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:01.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6dc43640 1 -- 172.21.15.60:0/2111501044 >> v1:172.21.15.105:6789/0 conn(0x7f0d680b60c0 legacy=0x7f0d68071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:01.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.113+0000 7f0d6dc43640 1 -- 172.21.15.60:0/2111501044 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d680cd5b0 con 0x7f0d68072700 2024-09-12T01:42:01.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.114+0000 7f0d6dc43640 1 --2- 172.21.15.60:0/2111501044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68072700 0x7f0d6815bc60 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000d150 tx=0x7f0d6002c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39afadc112b2bb42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:01.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.114+0000 7f0d5ffff640 1 -- 172.21.15.60:0/2111501044 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d60039070 con 0x7f0d68072700 2024-09-12T01:42:01.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.114+0000 7f0d5ffff640 1 -- 172.21.15.60:0/2111501044 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d60009600 con 0x7f0d68072700 2024-09-12T01:42:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.114+0000 7f0d5ffff640 1 -- 172.21.15.60:0/2111501044 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d600099d0 con 0x7f0d68072700 2024-09-12T01:42:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.115+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2111501044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68072700 msgr2=0x7f0d6815bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.115+0000 7f0d6f6a6640 1 --2- 172.21.15.60:0/2111501044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68072700 0x7f0d6815bc60 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000d150 tx=0x7f0d6002c840 comp rx=0 tx=0).stop 2024-09-12T01:42:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.115+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2111501044 shutdown_connections 2024-09-12T01:42:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.115+0000 7f0d6f6a6640 1 --2- 172.21.15.60:0/2111501044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68072700 0x7f0d6815bc60 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.115+0000 7f0d6f6a6640 1 --2- 172.21.15.60:0/2111501044 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d6815b480 0x7f0d680b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.115+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2111501044 >> 172.21.15.60:0/2111501044 conn(0x7f0d6806d0f0 msgr2=0x7f0d6806d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.115+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2111501044 shutdown_connections 2024-09-12T01:42:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.115+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2111501044 wait complete. 2024-09-12T01:42:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.116+0000 7f0d6f6a6640 1 Processor -- start 2024-09-12T01:42:01.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.116+0000 7f0d6f6a6640 1 -- start start 2024-09-12T01:42:01.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6f6a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68072700 0x7f0d6814f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:01.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6f6a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d680b60c0 0x7f0d680ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6f6a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d6815b480 0x7f0d680cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6f6a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6815b860 con 0x7f0d68072700 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6f6a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0d680cdb70 con 0x7f0d6815b480 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6f6a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6815b9e0 con 0x7f0d680b60c0 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6d442640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68072700 0x7f0d6814f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6d442640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68072700 0x7f0d6814f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60448/0 (socket says 172.21.15.60:60448) 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6d442640 1 -- 172.21.15.60:0/2481542745 learned_addr learned my addr 172.21.15.60:0/2481542745 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6d442640 1 -- 172.21.15.60:0/2481542745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d680b60c0 msgr2=0x7f0d680ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6d442640 1 --2- 172.21.15.60:0/2481542745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d680b60c0 0x7f0d680ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6d442640 1 -- 172.21.15.60:0/2481542745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d6815b480 msgr2=0x7f0d680cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6d442640 1 --2- 172.21.15.60:0/2481542745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d6815b480 0x7f0d680cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6d442640 1 -- 172.21.15.60:0/2481542745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d680ca900 con 0x7f0d68072700 2024-09-12T01:42:01.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.117+0000 7f0d6d442640 1 --2- 172.21.15.60:0/2481542745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68072700 0x7f0d6814f640 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400c820 tx=0x7f0d6400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:01.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.118+0000 7f0d5dffb640 1 -- 172.21.15.60:0/2481542745 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d64015070 con 0x7f0d68072700 2024-09-12T01:42:01.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.118+0000 7f0d5dffb640 1 -- 172.21.15.60:0/2481542745 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d64004020 con 0x7f0d68072700 2024-09-12T01:42:01.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.118+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2481542745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d680ce380 con 0x7f0d68072700 2024-09-12T01:42:01.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.118+0000 7f0d5dffb640 1 -- 172.21.15.60:0/2481542745 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d640043f0 con 0x7f0d68072700 2024-09-12T01:42:01.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.118+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2481542745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d680ce940 con 0x7f0d68072700 2024-09-12T01:42:01.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.119+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2481542745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d680b5b80 con 0x7f0d68072700 2024-09-12T01:42:01.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.119+0000 7f0d5dffb640 1 -- 172.21.15.60:0/2481542745 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0d64007830 con 0x7f0d68072700 2024-09-12T01:42:01.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.120+0000 7f0d5dffb640 1 --2- 172.21.15.60:0/2481542745 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0d4c06be30 0x7f0d4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:01.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.120+0000 7f0d5dffb640 1 -- 172.21.15.60:0/2481542745 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f0d6408acb0 con 0x7f0d68072700 2024-09-12T01:42:01.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.120+0000 7f0d6cc41640 1 --2- 172.21.15.60:0/2481542745 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0d4c06be30 0x7f0d4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:01.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.120+0000 7f0d6cc41640 1 --2- 172.21.15.60:0/2481542745 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0d4c06be30 0x7f0d4c06e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0d681f7e10 tx=0x7f0d580079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:01.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.124+0000 7f0d5dffb640 1 -- 172.21.15.60:0/2481542745 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0d64059640 con 0x7f0d68072700 2024-09-12T01:42:01.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:01.334+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2481542745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f0d6806e4a0 con 0x7f0d68072700 2024-09-12T01:42:01.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.000+0000 7f0d5dffb640 1 -- 172.21.15.60:0/2481542745 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v53) ==== 122+0+0 (secure 0 0 0) 0x7f0d64058f40 con 0x7f0d68072700 2024-09-12T01:42:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.002+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2481542745 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0d4c06be30 msgr2=0x7f0d4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.002+0000 7f0d6f6a6640 1 --2- 172.21.15.60:0/2481542745 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0d4c06be30 0x7f0d4c06e2f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0d681f7e10 tx=0x7f0d580079b0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.002+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2481542745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68072700 msgr2=0x7f0d6814f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.002+0000 7f0d6f6a6640 1 --2- 172.21.15.60:0/2481542745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68072700 0x7f0d6814f640 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400c820 tx=0x7f0d6400cce0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.003+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2481542745 shutdown_connections 2024-09-12T01:42:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.003+0000 7f0d6f6a6640 1 --2- 172.21.15.60:0/2481542745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0d6815b480 0x7f0d680cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.003+0000 7f0d6f6a6640 1 --2- 172.21.15.60:0/2481542745 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0d4c06be30 0x7f0d4c06e2f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.003+0000 7f0d6f6a6640 1 --2- 172.21.15.60:0/2481542745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0d680b60c0 0x7f0d680ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.003+0000 7f0d6f6a6640 1 --2- 172.21.15.60:0/2481542745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d68072700 0x7f0d6814f640 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.003+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2481542745 >> 172.21.15.60:0/2481542745 conn(0x7f0d6806d0f0 msgr2=0x7f0d68158810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.003+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2481542745 shutdown_connections 2024-09-12T01:42:02.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.003+0000 7f0d6f6a6640 1 -- 172.21.15.60:0/2481542745 wait complete. 2024-09-12T01:42:02.015 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:42:02.015 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:02.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.124+0000 7fbf4854b640 1 Processor -- start 2024-09-12T01:42:02.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.124+0000 7fbf4854b640 1 -- start start 2024-09-12T01:42:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.124+0000 7fbf4854b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf400b63d0 0x7fbf400d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf4854b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf400cf6b0 0x7fbf400b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf4854b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbf400d1c80 0x7fbf400b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf4854b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbf400b8300 con 0x7fbf400b63d0 2024-09-12T01:42:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf4854b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbf400cfc20 con 0x7fbf400d1c80 2024-09-12T01:42:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf4854b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbf400d2ed0 con 0x7fbf400cf6b0 2024-09-12T01:42:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf462e7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf400b63d0 0x7fbf400d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf462e7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf400b63d0 0x7fbf400d39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60452/0 (socket says 172.21.15.60:60452) 2024-09-12T01:42:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf462e7640 1 -- 172.21.15.60:0/2241282600 learned_addr learned my addr 172.21.15.60:0/2241282600 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf462e7640 1 -- 172.21.15.60:0/2241282600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf400cf6b0 msgr2=0x7fbf400b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf46ae8640 1 --2- 172.21.15.60:0/2241282600 >> v2:172.21.15.105:3300/0 conn(0x7fbf400d1c80 0x7fbf400b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf45ae6640 1 --2- 172.21.15.60:0/2241282600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf400cf6b0 0x7fbf400b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf462e7640 1 --2- 172.21.15.60:0/2241282600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf400cf6b0 0x7fbf400b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf462e7640 1 -- 172.21.15.60:0/2241282600 >> v2:172.21.15.105:3300/0 conn(0x7fbf400d1c80 msgr2=0x7fbf400b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf462e7640 1 --2- 172.21.15.60:0/2241282600 >> v2:172.21.15.105:3300/0 conn(0x7fbf400d1c80 0x7fbf400b7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf462e7640 1 -- 172.21.15.60:0/2241282600 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf400d31b0 con 0x7fbf400b63d0 2024-09-12T01:42:02.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf46ae8640 1 --2- 172.21.15.60:0/2241282600 >> v2:172.21.15.105:3300/0 conn(0x7fbf400d1c80 0x7fbf400b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:02.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.125+0000 7fbf45ae6640 1 --2- 172.21.15.60:0/2241282600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf400cf6b0 0x7fbf400b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:02.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.126+0000 7fbf462e7640 1 --2- 172.21.15.60:0/2241282600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf400b63d0 0x7fbf400d39b0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fbf400ceec0 tx=0x7fbf3c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6defee078e65dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:02.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.126+0000 7fbf452e5640 1 -- 172.21.15.60:0/2241282600 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c036070 con 0x7fbf400b63d0 2024-09-12T01:42:02.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.126+0000 7fbf452e5640 1 -- 172.21.15.60:0/2241282600 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf3c031600 con 0x7fbf400b63d0 2024-09-12T01:42:02.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.126+0000 7fbf452e5640 1 -- 172.21.15.60:0/2241282600 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0319d0 con 0x7fbf400b63d0 2024-09-12T01:42:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.126+0000 7fbf4854b640 1 -- 172.21.15.60:0/2241282600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf400b63d0 msgr2=0x7fbf400d39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.126+0000 7fbf4854b640 1 --2- 172.21.15.60:0/2241282600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf400b63d0 0x7fbf400d39b0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fbf400ceec0 tx=0x7fbf3c02a6a0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.127+0000 7fbf4854b640 1 -- 172.21.15.60:0/2241282600 shutdown_connections 2024-09-12T01:42:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.127+0000 7fbf4854b640 1 --2- 172.21.15.60:0/2241282600 >> v2:172.21.15.105:3300/0 conn(0x7fbf400d1c80 0x7fbf400b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.127+0000 7fbf4854b640 1 --2- 172.21.15.60:0/2241282600 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf400cf6b0 0x7fbf400b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.127+0000 7fbf4854b640 1 --2- 172.21.15.60:0/2241282600 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf400b63d0 0x7fbf400d39b0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.127+0000 7fbf4854b640 1 -- 172.21.15.60:0/2241282600 >> 172.21.15.60:0/2241282600 conn(0x7fbf400d1160 msgr2=0x7fbf400d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.127+0000 7fbf4854b640 1 -- 172.21.15.60:0/2241282600 shutdown_connections 2024-09-12T01:42:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.127+0000 7fbf4854b640 1 -- 172.21.15.60:0/2241282600 wait complete. 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.128+0000 7fbf4854b640 1 Processor -- start 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.128+0000 7fbf4854b640 1 -- start start 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf4854b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf400b63d0 0x7fbf400cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf4854b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf400cf6b0 0x7fbf400b88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf4854b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf400d1c80 0x7fbf400b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf4854b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbf400cb5c0 con 0x7fbf400cf6b0 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf4854b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbf400cb440 con 0x7fbf400d1c80 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf4854b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbf400d3ef0 con 0x7fbf400b63d0 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf45ae6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf400cf6b0 0x7fbf400b88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf45ae6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf400cf6b0 0x7fbf400b88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60456/0 (socket says 172.21.15.60:60456) 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf45ae6640 1 -- 172.21.15.60:0/1222970144 learned_addr learned my addr 172.21.15.60:0/1222970144 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf46ae8640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf400d1c80 0x7fbf400b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf462e7640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf400b63d0 0x7fbf400cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf45ae6640 1 -- 172.21.15.60:0/1222970144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf400b63d0 msgr2=0x7fbf400cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf45ae6640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf400b63d0 0x7fbf400cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf45ae6640 1 -- 172.21.15.60:0/1222970144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf400d1c80 msgr2=0x7fbf400b8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf45ae6640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf400d1c80 0x7fbf400b8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf45ae6640 1 -- 172.21.15.60:0/1222970144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf400cd630 con 0x7fbf400cf6b0 2024-09-12T01:42:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf45ae6640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf400cf6b0 0x7fbf400b88c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c7c0 tx=0x7fbf3000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf36ffd640 1 -- 172.21.15.60:0/1222970144 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30015070 con 0x7fbf400cf6b0 2024-09-12T01:42:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf36ffd640 1 -- 172.21.15.60:0/1222970144 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf30007a30 con 0x7fbf400cf6b0 2024-09-12T01:42:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf4854b640 1 -- 172.21.15.60:0/1222970144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf400cd910 con 0x7fbf400cf6b0 2024-09-12T01:42:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.129+0000 7fbf36ffd640 1 -- 172.21.15.60:0/1222970144 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf30007e00 con 0x7fbf400cf6b0 2024-09-12T01:42:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.130+0000 7fbf4854b640 1 -- 172.21.15.60:0/1222970144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf400ce1b0 con 0x7fbf400cf6b0 2024-09-12T01:42:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.130+0000 7fbf4854b640 1 -- 172.21.15.60:0/1222970144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf400cdae0 con 0x7fbf400cf6b0 2024-09-12T01:42:02.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.131+0000 7fbf36ffd640 1 -- 172.21.15.60:0/1222970144 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf30018070 con 0x7fbf400cf6b0 2024-09-12T01:42:02.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.131+0000 7fbf36ffd640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf2406be30 0x7fbf2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.132+0000 7fbf36ffd640 1 -- 172.21.15.60:0/1222970144 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fbf3008ade0 con 0x7fbf400cf6b0 2024-09-12T01:42:02.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.132+0000 7fbf462e7640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf2406be30 0x7fbf2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.132+0000 7fbf462e7640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf2406be30 0x7fbf2406e2f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c033000 tx=0x7fbf3c009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:02.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.136+0000 7fbf36ffd640 1 -- 172.21.15.60:0/1222970144 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbf30059780 con 0x7fbf400cf6b0 2024-09-12T01:42:02.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.348+0000 7fbf4854b640 1 -- 172.21.15.60:0/1222970144 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf400cf280 con 0x7fbf400cf6b0 2024-09-12T01:42:02.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.349+0000 7fbf36ffd640 1 -- 172.21.15.60:0/1222970144 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5224 (secure 0 0 0) 0x7fbf30059080 con 0x7fbf400cf6b0 2024-09-12T01:42:02.348 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:02.348 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"btime":"2024-09-12T01:42:01:993818+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1757090077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1757090077},{"type":"v1","addr":"172.21.15.105:6834","nonce":1757090077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/131981610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":131981610},{"type":"v1","addr":"172.21.15.60:6836","nonce":131981610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6762,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/18288436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":18288436},{"type":"v1","addr":"172.21.15.60:6837","nonce":18288436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:41:59.340440+0000","modified":"2024-09-12T01:42:01.335289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35732},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35732":{"gid":35732,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/829908705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":829908705},{"type":"v1","addr":"172.21.15.105:6835","nonce":829908705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35732,"qdb_cluster":[35732]},"id":7}]} 2024-09-12T01:42:02.349 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 53 2024-09-12T01:42:02.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.351+0000 7fbf4854b640 1 -- 172.21.15.60:0/1222970144 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf2406be30 msgr2=0x7fbf2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.351+0000 7fbf4854b640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf2406be30 0x7fbf2406e2f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c033000 tx=0x7fbf3c009000 comp rx=0 tx=0).stop 2024-09-12T01:42:02.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.351+0000 7fbf4854b640 1 -- 172.21.15.60:0/1222970144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf400cf6b0 msgr2=0x7fbf400b88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.351+0000 7fbf4854b640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf400cf6b0 0x7fbf400b88c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c7c0 tx=0x7fbf3000cc80 comp rx=0 tx=0).stop 2024-09-12T01:42:02.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.351+0000 7fbf4854b640 1 -- 172.21.15.60:0/1222970144 shutdown_connections 2024-09-12T01:42:02.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.351+0000 7fbf4854b640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf400d1c80 0x7fbf400b8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.351+0000 7fbf4854b640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf400cf6b0 0x7fbf400b88c0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.351+0000 7fbf4854b640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf2406be30 0x7fbf2406e2f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.351+0000 7fbf4854b640 1 --2- 172.21.15.60:0/1222970144 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf400b63d0 0x7fbf400cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.351+0000 7fbf4854b640 1 -- 172.21.15.60:0/1222970144 >> 172.21.15.60:0/1222970144 conn(0x7fbf400d1160 msgr2=0x7fbf400b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:02.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.351+0000 7fbf4854b640 1 -- 172.21.15.60:0/1222970144 shutdown_connections 2024-09-12T01:42:02.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.351+0000 7fbf4854b640 1 -- 172.21.15.60:0/1222970144 wait complete. 2024-09-12T01:42:02.362 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:42:02.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.466+0000 7f05187cf640 1 Processor -- start 2024-09-12T01:42:02.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.466+0000 7f05187cf640 1 -- start start 2024-09-12T01:42:02.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f05187cf640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f05100b01f0 0x7f05101620e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f05187cf640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0510073180 0x7f05100735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f05187cf640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f051015e920 con 0x7f051015e540 2024-09-12T01:42:02.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f05187cf640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0510073b10 con 0x7f0510073180 2024-09-12T01:42:02.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f05187cf640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0510163010 con 0x7f05100b01f0 2024-09-12T01:42:02.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f0516d6c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0510073180 0x7f05100735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f0516d6c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0510073180 0x7f05100735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60460/0 (socket says 172.21.15.60:60460) 2024-09-12T01:42:02.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f0516d6c640 1 -- 172.21.15.60:0/523145672 learned_addr learned my addr 172.21.15.60:0/523145672 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f0516d6c640 1 -- 172.21.15.60:0/523145672 >> v2:172.21.15.105:3300/0 conn(0x7f05100b01f0 msgr2=0x7f05101620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f0515d6a640 1 --2- 172.21.15.60:0/523145672 >> v2:172.21.15.105:3300/0 conn(0x7f05100b01f0 0x7f05101620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f0516d6c640 1 --2- 172.21.15.60:0/523145672 >> v2:172.21.15.105:3300/0 conn(0x7f05100b01f0 0x7f05101620e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f0516d6c640 1 -- 172.21.15.60:0/523145672 >> v1:172.21.15.105:6789/0 conn(0x7f051015e540 legacy=0x7f05100b52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f0516d6c640 1 -- 172.21.15.60:0/523145672 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0510162a50 con 0x7f0510073180 2024-09-12T01:42:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.467+0000 7f0515d6a640 1 --2- 172.21.15.60:0/523145672 >> v2:172.21.15.105:3300/0 conn(0x7f05100b01f0 0x7f05101620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.468+0000 7f0516d6c640 1 --2- 172.21.15.60:0/523145672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0510073180 0x7f05100735d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f05100b59d0 tx=0x7f050802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c8c0976e95f0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.468+0000 7f0515569640 1 -- 172.21.15.60:0/523145672 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508036070 con 0x7f0510073180 2024-09-12T01:42:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.468+0000 7f0515569640 1 -- 172.21.15.60:0/523145672 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0508031600 con 0x7f0510073180 2024-09-12T01:42:02.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.468+0000 7f0515569640 1 -- 172.21.15.60:0/523145672 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05080319d0 con 0x7f0510073180 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.469+0000 7f05187cf640 1 -- 172.21.15.60:0/523145672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0510073180 msgr2=0x7f05100735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.469+0000 7f05187cf640 1 --2- 172.21.15.60:0/523145672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0510073180 0x7f05100735d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f05100b59d0 tx=0x7f050802a5d0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.469+0000 7f05187cf640 1 -- 172.21.15.60:0/523145672 shutdown_connections 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.469+0000 7f05187cf640 1 --2- 172.21.15.60:0/523145672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0510073180 0x7f05100735d0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.469+0000 7f05187cf640 1 --2- 172.21.15.60:0/523145672 >> v2:172.21.15.105:3300/0 conn(0x7f05100b01f0 0x7f05101620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.469+0000 7f05187cf640 1 -- 172.21.15.60:0/523145672 >> 172.21.15.60:0/523145672 conn(0x7f051006bc10 msgr2=0x7f051006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.469+0000 7f05187cf640 1 -- 172.21.15.60:0/523145672 shutdown_connections 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.469+0000 7f05187cf640 1 -- 172.21.15.60:0/523145672 wait complete. 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.470+0000 7f05187cf640 1 Processor -- start 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.470+0000 7f05187cf640 1 -- start start 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f05187cf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0510073180 0x7f051015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f05187cf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05100b01f0 0x7f05101569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f05187cf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f051015e540 0x7f051014cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f05187cf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f05100aeca0 con 0x7f051015e540 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f05187cf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f05100ae9c0 con 0x7f05100b01f0 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f05187cf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0510162620 con 0x7f0510073180 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f0516d6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f051015e540 0x7f051014cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f0516d6c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f051015e540 0x7f051014cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:60470/0 (socket says 172.21.15.60:60470) 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f0516d6c640 1 -- 172.21.15.60:0/528386792 learned_addr learned my addr 172.21.15.60:0/528386792 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f0515d6a640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05100b01f0 0x7f05101569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f051656b640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0510073180 0x7f051015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f0516d6c640 1 -- 172.21.15.60:0/528386792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0510073180 msgr2=0x7f051015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f0516d6c640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0510073180 0x7f051015d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f0516d6c640 1 -- 172.21.15.60:0/528386792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05100b01f0 msgr2=0x7f05101569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f0516d6c640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05100b01f0 0x7f05101569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f0516d6c640 1 -- 172.21.15.60:0/528386792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0510157130 con 0x7f051015e540 2024-09-12T01:42:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.471+0000 7f0516d6c640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f051015e540 0x7f051014cf70 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0508009f40 tx=0x7f0508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.472+0000 7f0506ffd640 1 -- 172.21.15.60:0/528386792 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508036050 con 0x7f051015e540 2024-09-12T01:42:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.472+0000 7f0506ffd640 1 -- 172.21.15.60:0/528386792 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0508042070 con 0x7f051015e540 2024-09-12T01:42:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.472+0000 7f05187cf640 1 -- 172.21.15.60:0/528386792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0510157410 con 0x7f051015e540 2024-09-12T01:42:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.472+0000 7f0506ffd640 1 -- 172.21.15.60:0/528386792 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508007bd0 con 0x7f051015e540 2024-09-12T01:42:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.472+0000 7f05187cf640 1 -- 172.21.15.60:0/528386792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0510155310 con 0x7f051015e540 2024-09-12T01:42:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.473+0000 7f05187cf640 1 -- 172.21.15.60:0/528386792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05100735d0 con 0x7f051015e540 2024-09-12T01:42:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.473+0000 7f0506ffd640 1 -- 172.21.15.60:0/528386792 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0508047460 con 0x7f051015e540 2024-09-12T01:42:02.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.474+0000 7f0506ffd640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f04f406be30 0x7f04f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.474+0000 7f051656b640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f04f406be30 0x7f04f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.474+0000 7f0506ffd640 1 -- 172.21.15.60:0/528386792 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f05080abe70 con 0x7f051015e540 2024-09-12T01:42:02.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.474+0000 7f051656b640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f04f406be30 0x7f04f406e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f05100d0680 tx=0x7f050c009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:02.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.478+0000 7f0506ffd640 1 -- 172.21.15.60:0/528386792 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f050807a130 con 0x7f051015e540 2024-09-12T01:42:02.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.653+0000 7f05187cf640 1 -- 172.21.15.60:0/528386792 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05101575e0 con 0x7f051015e540 2024-09-12T01:42:02.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.654+0000 7f0506ffd640 1 -- 172.21.15.60:0/528386792 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16632 (secure 0 0 0) 0x7f050807e430 con 0x7f051015e540 2024-09-12T01:42:02.654 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:02.654 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:42:00.988416+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:41:57.005706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-12T01:41:58.327183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:42:02.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.656+0000 7f05187cf640 1 -- 172.21.15.60:0/528386792 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f04f406be30 msgr2=0x7f04f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.656+0000 7f05187cf640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f04f406be30 0x7f04f406e2f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f05100d0680 tx=0x7f050c009060 comp rx=0 tx=0).stop 2024-09-12T01:42:02.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.656+0000 7f05187cf640 1 -- 172.21.15.60:0/528386792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f051015e540 msgr2=0x7f051014cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.656+0000 7f05187cf640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f051015e540 0x7f051014cf70 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0508009f40 tx=0x7f0508004a40 comp rx=0 tx=0).stop 2024-09-12T01:42:02.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.656+0000 7f05187cf640 1 -- 172.21.15.60:0/528386792 shutdown_connections 2024-09-12T01:42:02.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.656+0000 7f05187cf640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f051015e540 0x7f051014cf70 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.656+0000 7f05187cf640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05100b01f0 0x7f05101569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.656+0000 7f05187cf640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f04f406be30 0x7f04f406e2f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.656+0000 7f05187cf640 1 --2- 172.21.15.60:0/528386792 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0510073180 0x7f051015d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.656+0000 7f05187cf640 1 -- 172.21.15.60:0/528386792 >> 172.21.15.60:0/528386792 conn(0x7f051006bc10 msgr2=0x7f0510072a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:02.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.656+0000 7f05187cf640 1 -- 172.21.15.60:0/528386792 shutdown_connections 2024-09-12T01:42:02.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.656+0000 7f05187cf640 1 -- 172.21.15.60:0/528386792 wait complete. 2024-09-12T01:42:02.667 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:42:02.667 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:42:02.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.776+0000 7f42eaad7640 1 Processor -- start 2024-09-12T01:42:02.776 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.776+0000 7f42eaad7640 1 -- start start 2024-09-12T01:42:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42eaad7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42e40b74c0 0x7f42e415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42eaad7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42e415f030 0x7f42e406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42eaad7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e415fb10 con 0x7f42e415c2b0 2024-09-12T01:42:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42eaad7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f42e40b5900 con 0x7f42e415f030 2024-09-12T01:42:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42eaad7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f42e415f830 con 0x7f42e40b74c0 2024-09-12T01:42:02.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42e9074640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42e415f030 0x7f42e406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42e9074640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42e415f030 0x7f42e406d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36394/0 (socket says 172.21.15.60:36394) 2024-09-12T01:42:02.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42e9074640 1 -- 172.21.15.60:0/1418878873 learned_addr learned my addr 172.21.15.60:0/1418878873 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:02.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42e3fff640 1 --2- 172.21.15.60:0/1418878873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42e40b74c0 0x7f42e415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42e9074640 1 -- 172.21.15.60:0/1418878873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42e40b74c0 msgr2=0x7f42e415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:02.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42e9074640 1 --2- 172.21.15.60:0/1418878873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42e40b74c0 0x7f42e415eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42e9074640 1 -- 172.21.15.60:0/1418878873 >> v1:172.21.15.105:6789/0 conn(0x7f42e415c2b0 legacy=0x7f42e40b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:02.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.777+0000 7f42e9074640 1 -- 172.21.15.60:0/1418878873 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e406ce30 con 0x7f42e415f030 2024-09-12T01:42:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.778+0000 7f42e9074640 1 --2- 172.21.15.60:0/1418878873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e415f030 0x7f42e406d910 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009870 tx=0x7f42d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc9da0b3aefbbbe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.778+0000 7f42e37fe640 1 -- 172.21.15.60:0/1418878873 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4037070 con 0x7f42e415f030 2024-09-12T01:42:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.778+0000 7f42e37fe640 1 -- 172.21.15.60:0/1418878873 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d4032440 con 0x7f42e415f030 2024-09-12T01:42:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.778+0000 7f42e37fe640 1 -- 172.21.15.60:0/1418878873 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4032810 con 0x7f42e415f030 2024-09-12T01:42:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.779+0000 7f42eaad7640 1 -- 172.21.15.60:0/1418878873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e415f030 msgr2=0x7f42e406d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.779+0000 7f42eaad7640 1 --2- 172.21.15.60:0/1418878873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e415f030 0x7f42e406d910 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009870 tx=0x7f42d402a270 comp rx=0 tx=0).stop 2024-09-12T01:42:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.779+0000 7f42eaad7640 1 -- 172.21.15.60:0/1418878873 shutdown_connections 2024-09-12T01:42:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.779+0000 7f42eaad7640 1 --2- 172.21.15.60:0/1418878873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e415f030 0x7f42e406d910 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.779+0000 7f42eaad7640 1 --2- 172.21.15.60:0/1418878873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42e40b74c0 0x7f42e415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.779+0000 7f42eaad7640 1 -- 172.21.15.60:0/1418878873 >> 172.21.15.60:0/1418878873 conn(0x7f42e40b4240 msgr2=0x7f42e40b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.779+0000 7f42eaad7640 1 -- 172.21.15.60:0/1418878873 shutdown_connections 2024-09-12T01:42:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.779+0000 7f42eaad7640 1 -- 172.21.15.60:0/1418878873 wait complete. 2024-09-12T01:42:02.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.780+0000 7f42eaad7640 1 Processor -- start 2024-09-12T01:42:02.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.780+0000 7f42eaad7640 1 -- start start 2024-09-12T01:42:02.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.781+0000 7f42eaad7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42e40b74c0 0x7f42e41e82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.781+0000 7f42eaad7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42e415c2b0 0x7f42e4146760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.781+0000 7f42eaad7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e415f030 0x7f42e4146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.781+0000 7f42eaad7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f42e415f4c0 con 0x7f42e415f030 2024-09-12T01:42:02.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.781+0000 7f42eaad7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42e406d3f0 con 0x7f42e415c2b0 2024-09-12T01:42:02.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.781+0000 7f42eaad7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f42e406de50 con 0x7f42e40b74c0 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.781+0000 7f42e9074640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e415f030 0x7f42e4146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.781+0000 7f42e9074640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e415f030 0x7f42e4146ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36408/0 (socket says 172.21.15.60:36408) 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.781+0000 7f42e9074640 1 -- 172.21.15.60:0/356528345 learned_addr learned my addr 172.21.15.60:0/356528345 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.781+0000 7f42e3fff640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42e415c2b0 0x7f42e4146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.781+0000 7f42e8873640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42e40b74c0 0x7f42e41e82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.782+0000 7f42e9074640 1 -- 172.21.15.60:0/356528345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42e40b74c0 msgr2=0x7f42e41e82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.782+0000 7f42e9074640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42e40b74c0 0x7f42e41e82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.782+0000 7f42e9074640 1 -- 172.21.15.60:0/356528345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42e415c2b0 msgr2=0x7f42e4146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.782+0000 7f42e9074640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42e415c2b0 0x7f42e4146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.782+0000 7f42e9074640 1 -- 172.21.15.60:0/356528345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e41e7880 con 0x7f42e415f030 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.782+0000 7f42e9074640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e415f030 0x7f42e4146ca0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009870 tx=0x7f42d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.782+0000 7f42e17fa640 1 -- 172.21.15.60:0/356528345 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4037040 con 0x7f42e415f030 2024-09-12T01:42:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.782+0000 7f42e17fa640 1 -- 172.21.15.60:0/356528345 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d4042070 con 0x7f42e415f030 2024-09-12T01:42:02.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.782+0000 7f42eaad7640 1 -- 172.21.15.60:0/356528345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e41e9c40 con 0x7f42e415f030 2024-09-12T01:42:02.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.782+0000 7f42e17fa640 1 -- 172.21.15.60:0/356528345 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4030920 con 0x7f42e415f030 2024-09-12T01:42:02.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.782+0000 7f42eaad7640 1 -- 172.21.15.60:0/356528345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e41e9f20 con 0x7f42e415f030 2024-09-12T01:42:02.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.783+0000 7f42eaad7640 1 -- 172.21.15.60:0/356528345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e415eaf0 con 0x7f42e415f030 2024-09-12T01:42:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.783+0000 7f42e17fa640 1 -- 172.21.15.60:0/356528345 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42d4030ac0 con 0x7f42e415f030 2024-09-12T01:42:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.784+0000 7f42e17fa640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f42d006be30 0x7f42d006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.784+0000 7f42e17fa640 1 -- 172.21.15.60:0/356528345 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f42d40ab610 con 0x7f42e415f030 2024-09-12T01:42:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.784+0000 7f42e8873640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f42d006be30 0x7f42d006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.784+0000 7f42e8873640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f42d006be30 0x7f42d006e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f42dc001f10 tx=0x7f42dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:02.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.788+0000 7f42e17fa640 1 -- 172.21.15.60:0/356528345 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42d4079970 con 0x7f42e415f030 2024-09-12T01:42:02.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.959+0000 7f42eaad7640 1 -- 172.21.15.60:0/356528345 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42e40b6f50 con 0x7f42d006be30 2024-09-12T01:42:02.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.965+0000 7f42e17fa640 1 -- 172.21.15.60:0/356528345 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250266 (secure 0 0 0) 0x7f42e40b6f50 con 0x7f42d006be30 2024-09-12T01:42:02.967 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:02.969 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:42:02.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.968+0000 7f42eaad7640 1 -- 172.21.15.60:0/356528345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f42d006be30 msgr2=0x7f42d006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.968+0000 7f42eaad7640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f42d006be30 0x7f42d006e2f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f42dc001f10 tx=0x7f42dc009040 comp rx=0 tx=0).stop 2024-09-12T01:42:02.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.968+0000 7f42eaad7640 1 -- 172.21.15.60:0/356528345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e415f030 msgr2=0x7f42e4146ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:02.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.968+0000 7f42eaad7640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e415f030 0x7f42e4146ca0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f42d4009870 tx=0x7f42d40046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.968+0000 7f42eaad7640 1 -- 172.21.15.60:0/356528345 shutdown_connections 2024-09-12T01:42:02.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.968+0000 7f42eaad7640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42e415f030 0x7f42e4146ca0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.968+0000 7f42eaad7640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42e415c2b0 0x7f42e4146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.968+0000 7f42eaad7640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f42d006be30 0x7f42d006e2f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.968+0000 7f42eaad7640 1 --2- 172.21.15.60:0/356528345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42e40b74c0 0x7f42e41e82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:02.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.968+0000 7f42eaad7640 1 -- 172.21.15.60:0/356528345 >> 172.21.15.60:0/356528345 conn(0x7f42e40b4240 msgr2=0x7f42e40b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:02.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.968+0000 7f42eaad7640 1 -- 172.21.15.60:0/356528345 shutdown_connections 2024-09-12T01:42:02.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:02.969+0000 7f42eaad7640 1 -- 172.21.15.60:0/356528345 wait complete. 2024-09-12T01:42:02.979 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-09-12T01:42:02.343719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276036,"kb_used_data":9884,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754698684,"statfs":{"total":773094113280,"available":772811452416,"internally_reserved":0,"allocated":10121216,"data_stored":4917156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.372071"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.006765+0000","last_change":"2024-09-12T01:41:59.998387+0000","last_active":"2024-09-12T01:42:00.006765+0000","last_peered":"2024-09-12T01:42:00.006765+0000","last_clean":"2024-09-12T01:42:00.006765+0000","last_became_active":"2024-09-12T01:41:59.998107+0000","last_became_peered":"2024-09-12T01:41:59.998107+0000","last_unstale":"2024-09-12T01:42:00.006765+0000","last_undegraded":"2024-09-12T01:42:00.006765+0000","last_fullsized":"2024-09-12T01:42:00.006765+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:26.966614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005999+0000","last_change":"2024-09-12T01:41:59.997097+0000","last_active":"2024-09-12T01:42:00.005999+0000","last_peered":"2024-09-12T01:42:00.005999+0000","last_clean":"2024-09-12T01:42:00.005999+0000","last_became_active":"2024-09-12T01:41:59.996791+0000","last_became_peered":"2024-09-12T01:41:59.996791+0000","last_unstale":"2024-09-12T01:42:00.005999+0000","last_undegraded":"2024-09-12T01:42:00.005999+0000","last_fullsized":"2024-09-12T01:42:00.005999+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:26.435357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015520+0000","last_change":"2024-09-12T01:42:00.010982+0000","last_active":"2024-09-12T01:42:00.015520+0000","last_peered":"2024-09-12T01:42:00.015520+0000","last_clean":"2024-09-12T01:42:00.015520+0000","last_became_active":"2024-09-12T01:42:00.010488+0000","last_became_peered":"2024-09-12T01:42:00.010488+0000","last_unstale":"2024-09-12T01:42:00.015520+0000","last_undegraded":"2024-09-12T01:42:00.015520+0000","last_fullsized":"2024-09-12T01:42:00.015520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:57.416935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.998922+0000","last_change":"2024-09-12T01:41:59.994841+0000","last_active":"2024-09-12T01:41:59.998922+0000","last_peered":"2024-09-12T01:41:59.998922+0000","last_clean":"2024-09-12T01:41:59.998922+0000","last_became_active":"2024-09-12T01:41:59.994425+0000","last_became_peered":"2024-09-12T01:41:59.994425+0000","last_unstale":"2024-09-12T01:41:59.998922+0000","last_undegraded":"2024-09-12T01:41:59.998922+0000","last_fullsized":"2024-09-12T01:41:59.998922+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:48.845335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003010+0000","last_change":"2024-09-12T01:42:00.002035+0000","last_active":"2024-09-12T01:42:00.003010+0000","last_peered":"2024-09-12T01:42:00.003010+0000","last_clean":"2024-09-12T01:42:00.003010+0000","last_became_active":"2024-09-12T01:42:00.001739+0000","last_became_peered":"2024-09-12T01:42:00.001739+0000","last_unstale":"2024-09-12T01:42:00.003010+0000","last_undegraded":"2024-09-12T01:42:00.003010+0000","last_fullsized":"2024-09-12T01:42:00.003010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:25.393366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.999763+0000","last_change":"2024-09-12T01:41:59.997500+0000","last_active":"2024-09-12T01:41:59.999763+0000","last_peered":"2024-09-12T01:41:59.999763+0000","last_clean":"2024-09-12T01:41:59.999763+0000","last_became_active":"2024-09-12T01:41:59.997216+0000","last_became_peered":"2024-09-12T01:41:59.997216+0000","last_unstale":"2024-09-12T01:41:59.999763+0000","last_undegraded":"2024-09-12T01:41:59.999763+0000","last_fullsized":"2024-09-12T01:41:59.999763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:03.967861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000870+0000","last_change":"2024-09-12T01:41:59.999881+0000","last_active":"2024-09-12T01:42:00.000870+0000","last_peered":"2024-09-12T01:42:00.000870+0000","last_clean":"2024-09-12T01:42:00.000870+0000","last_became_active":"2024-09-12T01:41:59.999548+0000","last_became_peered":"2024-09-12T01:41:59.999548+0000","last_unstale":"2024-09-12T01:42:00.000870+0000","last_undegraded":"2024-09-12T01:42:00.000870+0000","last_fullsized":"2024-09-12T01:42:00.000870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:42.985592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.012054+0000","last_change":"2024-09-12T01:42:00.011595+0000","last_active":"2024-09-12T01:42:00.012054+0000","last_peered":"2024-09-12T01:42:00.012054+0000","last_clean":"2024-09-12T01:42:00.012054+0000","last_became_active":"2024-09-12T01:42:00.011120+0000","last_became_peered":"2024-09-12T01:42:00.011120+0000","last_unstale":"2024-09-12T01:42:00.012054+0000","last_undegraded":"2024-09-12T01:42:00.012054+0000","last_fullsized":"2024-09-12T01:42:00.012054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.966780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003005+0000","last_change":"2024-09-12T01:42:00.002071+0000","last_active":"2024-09-12T01:42:00.003005+0000","last_peered":"2024-09-12T01:42:00.003005+0000","last_clean":"2024-09-12T01:42:00.003005+0000","last_became_active":"2024-09-12T01:42:00.001769+0000","last_became_peered":"2024-09-12T01:42:00.001769+0000","last_unstale":"2024-09-12T01:42:00.003005+0000","last_undegraded":"2024-09-12T01:42:00.003005+0000","last_fullsized":"2024-09-12T01:42:00.003005+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:08.962516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004120+0000","last_change":"2024-09-12T01:41:59.999861+0000","last_active":"2024-09-12T01:42:00.004120+0000","last_peered":"2024-09-12T01:42:00.004120+0000","last_clean":"2024-09-12T01:42:00.004120+0000","last_became_active":"2024-09-12T01:41:59.999585+0000","last_became_peered":"2024-09-12T01:41:59.999585+0000","last_unstale":"2024-09-12T01:42:00.004120+0000","last_undegraded":"2024-09-12T01:42:00.004120+0000","last_fullsized":"2024-09-12T01:42:00.004120+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:48.815524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005291+0000","last_change":"2024-09-12T01:42:00.003453+0000","last_active":"2024-09-12T01:42:00.005291+0000","last_peered":"2024-09-12T01:42:00.005291+0000","last_clean":"2024-09-12T01:42:00.005291+0000","last_became_active":"2024-09-12T01:42:00.003168+0000","last_became_peered":"2024-09-12T01:42:00.003168+0000","last_unstale":"2024-09-12T01:42:00.005291+0000","last_undegraded":"2024-09-12T01:42:00.005291+0000","last_fullsized":"2024-09-12T01:42:00.005291+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:54.408335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008225+0000","last_change":"2024-09-12T01:41:59.999888+0000","last_active":"2024-09-12T01:42:00.008225+0000","last_peered":"2024-09-12T01:42:00.008225+0000","last_clean":"2024-09-12T01:42:00.008225+0000","last_became_active":"2024-09-12T01:41:59.999191+0000","last_became_peered":"2024-09-12T01:41:59.999191+0000","last_unstale":"2024-09-12T01:42:00.008225+0000","last_undegraded":"2024-09-12T01:42:00.008225+0000","last_fullsized":"2024-09-12T01:42:00.008225+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:09.385413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008783+0000","last_change":"2024-09-12T01:42:00.000266+0000","last_active":"2024-09-12T01:42:00.008783+0000","last_peered":"2024-09-12T01:42:00.008783+0000","last_clean":"2024-09-12T01:42:00.008783+0000","last_became_active":"2024-09-12T01:42:00.000010+0000","last_became_peered":"2024-09-12T01:42:00.000010+0000","last_unstale":"2024-09-12T01:42:00.008783+0000","last_undegraded":"2024-09-12T01:42:00.008783+0000","last_fullsized":"2024-09-12T01:42:00.008783+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:58.296601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.999088+0000","last_change":"2024-09-12T01:41:59.996542+0000","last_active":"2024-09-12T01:41:59.999088+0000","last_peered":"2024-09-12T01:41:59.999088+0000","last_clean":"2024-09-12T01:41:59.999088+0000","last_became_active":"2024-09-12T01:41:59.996199+0000","last_became_peered":"2024-09-12T01:41:59.996199+0000","last_unstale":"2024-09-12T01:41:59.999088+0000","last_undegraded":"2024-09-12T01:41:59.999088+0000","last_fullsized":"2024-09-12T01:41:59.999088+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:29.618613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008916+0000","last_change":"2024-09-12T01:42:00.006742+0000","last_active":"2024-09-12T01:42:00.008916+0000","last_peered":"2024-09-12T01:42:00.008916+0000","last_clean":"2024-09-12T01:42:00.008916+0000","last_became_active":"2024-09-12T01:42:00.006366+0000","last_became_peered":"2024-09-12T01:42:00.006366+0000","last_unstale":"2024-09-12T01:42:00.008916+0000","last_undegraded":"2024-09-12T01:42:00.008916+0000","last_fullsized":"2024-09-12T01:42:00.008916+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:51.680001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008682+0000","last_change":"2024-09-12T01:42:00.000351+0000","last_active":"2024-09-12T01:42:00.008682+0000","last_peered":"2024-09-12T01:42:00.008682+0000","last_clean":"2024-09-12T01:42:00.008682+0000","last_became_active":"2024-09-12T01:41:59.999753+0000","last_became_peered":"2024-09-12T01:41:59.999753+0000","last_unstale":"2024-09-12T01:42:00.008682+0000","last_undegraded":"2024-09-12T01:42:00.008682+0000","last_fullsized":"2024-09-12T01:42:00.008682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:04.822297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.017795+0000","last_change":"2024-09-12T01:42:00.013386+0000","last_active":"2024-09-12T01:42:00.017795+0000","last_peered":"2024-09-12T01:42:00.017795+0000","last_clean":"2024-09-12T01:42:00.017795+0000","last_became_active":"2024-09-12T01:42:00.013088+0000","last_became_peered":"2024-09-12T01:42:00.013088+0000","last_unstale":"2024-09-12T01:42:00.017795+0000","last_undegraded":"2024-09-12T01:42:00.017795+0000","last_fullsized":"2024-09-12T01:42:00.017795+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:58.449274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000474+0000","last_change":"2024-09-12T01:41:59.994130+0000","last_active":"2024-09-12T01:42:00.000474+0000","last_peered":"2024-09-12T01:42:00.000474+0000","last_clean":"2024-09-12T01:42:00.000474+0000","last_became_active":"2024-09-12T01:41:59.993627+0000","last_became_peered":"2024-09-12T01:41:59.993627+0000","last_unstale":"2024-09-12T01:42:00.000474+0000","last_undegraded":"2024-09-12T01:42:00.000474+0000","last_fullsized":"2024-09-12T01:42:00.000474+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.582260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007599+0000","last_change":"2024-09-12T01:41:59.998620+0000","last_active":"2024-09-12T01:42:00.007599+0000","last_peered":"2024-09-12T01:42:00.007599+0000","last_clean":"2024-09-12T01:42:00.007599+0000","last_became_active":"2024-09-12T01:41:59.998314+0000","last_became_peered":"2024-09-12T01:41:59.998314+0000","last_unstale":"2024-09-12T01:42:00.007599+0000","last_undegraded":"2024-09-12T01:42:00.007599+0000","last_fullsized":"2024-09-12T01:42:00.007599+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:28.832878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.011785+0000","last_change":"2024-09-12T01:42:00.010724+0000","last_active":"2024-09-12T01:42:00.011785+0000","last_peered":"2024-09-12T01:42:00.011785+0000","last_clean":"2024-09-12T01:42:00.011785+0000","last_became_active":"2024-09-12T01:42:00.010364+0000","last_became_peered":"2024-09-12T01:42:00.010364+0000","last_unstale":"2024-09-12T01:42:00.011785+0000","last_undegraded":"2024-09-12T01:42:00.011785+0000","last_fullsized":"2024-09-12T01:42:00.011785+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:14.093956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004638+0000","last_change":"2024-09-12T01:42:00.003822+0000","last_active":"2024-09-12T01:42:00.004638+0000","last_peered":"2024-09-12T01:42:00.004638+0000","last_clean":"2024-09-12T01:42:00.004638+0000","last_became_active":"2024-09-12T01:42:00.003374+0000","last_became_peered":"2024-09-12T01:42:00.003374+0000","last_unstale":"2024-09-12T01:42:00.004638+0000","last_undegraded":"2024-09-12T01:42:00.004638+0000","last_fullsized":"2024-09-12T01:42:00.004638+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:28.832878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.996779+0000","last_change":"2024-09-12T01:41:59.995775+0000","last_active":"2024-09-12T01:41:59.996779+0000","last_peered":"2024-09-12T01:41:59.996779+0000","last_clean":"2024-09-12T01:41:59.996779+0000","last_became_active":"2024-09-12T01:41:59.995503+0000","last_became_peered":"2024-09-12T01:41:59.995503+0000","last_unstale":"2024-09-12T01:41:59.996779+0000","last_undegraded":"2024-09-12T01:41:59.996779+0000","last_fullsized":"2024-09-12T01:41:59.996779+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:34.971636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004779+0000","last_change":"2024-09-12T01:42:00.003066+0000","last_active":"2024-09-12T01:42:00.004779+0000","last_peered":"2024-09-12T01:42:00.004779+0000","last_clean":"2024-09-12T01:42:00.004779+0000","last_became_active":"2024-09-12T01:42:00.002796+0000","last_became_peered":"2024-09-12T01:42:00.002796+0000","last_unstale":"2024-09-12T01:42:00.004779+0000","last_undegraded":"2024-09-12T01:42:00.004779+0000","last_fullsized":"2024-09-12T01:42:00.004779+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:23.856078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004651+0000","last_change":"2024-09-12T01:41:59.995567+0000","last_active":"2024-09-12T01:42:00.004651+0000","last_peered":"2024-09-12T01:42:00.004651+0000","last_clean":"2024-09-12T01:42:00.004651+0000","last_became_active":"2024-09-12T01:41:59.995275+0000","last_became_peered":"2024-09-12T01:41:59.995275+0000","last_unstale":"2024-09-12T01:42:00.004651+0000","last_undegraded":"2024-09-12T01:42:00.004651+0000","last_fullsized":"2024-09-12T01:42:00.004651+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:13.659299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007006+0000","last_change":"2024-09-12T01:42:00.004709+0000","last_active":"2024-09-12T01:42:00.007006+0000","last_peered":"2024-09-12T01:42:00.007006+0000","last_clean":"2024-09-12T01:42:00.007006+0000","last_became_active":"2024-09-12T01:42:00.004413+0000","last_became_peered":"2024-09-12T01:42:00.004413+0000","last_unstale":"2024-09-12T01:42:00.007006+0000","last_undegraded":"2024-09-12T01:42:00.007006+0000","last_fullsized":"2024-09-12T01:42:00.007006+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:14.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003886+0000","last_change":"2024-09-12T01:42:00.001460+0000","last_active":"2024-09-12T01:42:00.003886+0000","last_peered":"2024-09-12T01:42:00.003886+0000","last_clean":"2024-09-12T01:42:00.003886+0000","last_became_active":"2024-09-12T01:42:00.001111+0000","last_became_peered":"2024-09-12T01:42:00.001111+0000","last_unstale":"2024-09-12T01:42:00.003886+0000","last_undegraded":"2024-09-12T01:42:00.003886+0000","last_fullsized":"2024-09-12T01:42:00.003886+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:28.435193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015473+0000","last_change":"2024-09-12T01:42:00.010691+0000","last_active":"2024-09-12T01:42:00.015473+0000","last_peered":"2024-09-12T01:42:00.015473+0000","last_clean":"2024-09-12T01:42:00.015473+0000","last_became_active":"2024-09-12T01:42:00.010426+0000","last_became_peered":"2024-09-12T01:42:00.010426+0000","last_unstale":"2024-09-12T01:42:00.015473+0000","last_undegraded":"2024-09-12T01:42:00.015473+0000","last_fullsized":"2024-09-12T01:42:00.015473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:53.113663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007551+0000","last_change":"2024-09-12T01:42:00.002800+0000","last_active":"2024-09-12T01:42:00.007551+0000","last_peered":"2024-09-12T01:42:00.007551+0000","last_clean":"2024-09-12T01:42:00.007551+0000","last_became_active":"2024-09-12T01:42:00.002533+0000","last_became_peered":"2024-09-12T01:42:00.002533+0000","last_unstale":"2024-09-12T01:42:00.007551+0000","last_undegraded":"2024-09-12T01:42:00.007551+0000","last_fullsized":"2024-09-12T01:42:00.007551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:46.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"91'4","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.001313+0000","last_change":"2024-09-12T01:41:58.988426+0000","last_active":"2024-09-12T01:42:00.001313+0000","last_peered":"2024-09-12T01:42:00.001313+0000","last_clean":"2024-09-12T01:42:00.001313+0000","last_became_active":"2024-09-12T01:41:58.988130+0000","last_became_peered":"2024-09-12T01:41:58.988130+0000","last_unstale":"2024-09-12T01:42:00.001313+0000","last_undegraded":"2024-09-12T01:42:00.001313+0000","last_fullsized":"2024-09-12T01:42:00.001313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:19.475865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005320+0000","last_change":"2024-09-12T01:42:00.004520+0000","last_active":"2024-09-12T01:42:00.005320+0000","last_peered":"2024-09-12T01:42:00.005320+0000","last_clean":"2024-09-12T01:42:00.005320+0000","last_became_active":"2024-09-12T01:42:00.004193+0000","last_became_peered":"2024-09-12T01:42:00.004193+0000","last_unstale":"2024-09-12T01:42:00.005320+0000","last_undegraded":"2024-09-12T01:42:00.005320+0000","last_fullsized":"2024-09-12T01:42:00.005320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:33.609574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.998645+0000","last_change":"2024-09-12T01:41:58.992984+0000","last_active":"2024-09-12T01:41:59.998645+0000","last_peered":"2024-09-12T01:41:59.998645+0000","last_clean":"2024-09-12T01:41:59.998645+0000","last_became_active":"2024-09-12T01:41:58.992669+0000","last_became_peered":"2024-09-12T01:41:58.992669+0000","last_unstale":"2024-09-12T01:41:59.998645+0000","last_undegraded":"2024-09-12T01:41:59.998645+0000","last_fullsized":"2024-09-12T01:41:59.998645+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.589596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.010165+0000","last_change":"2024-09-12T01:42:00.008281+0000","last_active":"2024-09-12T01:42:00.010165+0000","last_peered":"2024-09-12T01:42:00.010165+0000","last_clean":"2024-09-12T01:42:00.010165+0000","last_became_active":"2024-09-12T01:42:00.007920+0000","last_became_peered":"2024-09-12T01:42:00.007920+0000","last_unstale":"2024-09-12T01:42:00.010165+0000","last_undegraded":"2024-09-12T01:42:00.010165+0000","last_fullsized":"2024-09-12T01:42:00.010165+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:13.659299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980490+0000","last_change":"2024-09-12T01:41:57.980490+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980490+0000","last_undegraded":"2024-09-12T01:41:57.980490+0000","last_fullsized":"2024-09-12T01:41:57.980490+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008227+0000","last_change":"2024-09-12T01:42:00.007543+0000","last_active":"2024-09-12T01:42:00.008227+0000","last_peered":"2024-09-12T01:42:00.008227+0000","last_clean":"2024-09-12T01:42:00.008227+0000","last_became_active":"2024-09-12T01:42:00.006466+0000","last_became_peered":"2024-09-12T01:42:00.006466+0000","last_unstale":"2024-09-12T01:42:00.008227+0000","last_undegraded":"2024-09-12T01:42:00.008227+0000","last_fullsized":"2024-09-12T01:42:00.008227+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:09.385413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.009099+0000","last_change":"2024-09-12T01:41:58.997786+0000","last_active":"2024-09-12T01:42:00.009099+0000","last_peered":"2024-09-12T01:42:00.009099+0000","last_clean":"2024-09-12T01:42:00.009099+0000","last_became_active":"2024-09-12T01:41:58.997540+0000","last_became_peered":"2024-09-12T01:41:58.997540+0000","last_unstale":"2024-09-12T01:42:00.009099+0000","last_undegraded":"2024-09-12T01:42:00.009099+0000","last_fullsized":"2024-09-12T01:42:00.009099+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:14.484863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000498+0000","last_change":"2024-09-12T01:41:59.993413+0000","last_active":"2024-09-12T01:42:00.000498+0000","last_peered":"2024-09-12T01:42:00.000498+0000","last_clean":"2024-09-12T01:42:00.000498+0000","last_became_active":"2024-09-12T01:41:59.992374+0000","last_became_peered":"2024-09-12T01:41:59.992374+0000","last_unstale":"2024-09-12T01:42:00.000498+0000","last_undegraded":"2024-09-12T01:42:00.000498+0000","last_fullsized":"2024-09-12T01:42:00.000498+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:26.760592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.011460+0000","last_change":"2024-09-12T01:41:58.996374+0000","last_active":"2024-09-12T01:42:00.011460+0000","last_peered":"2024-09-12T01:42:00.011460+0000","last_clean":"2024-09-12T01:42:00.011460+0000","last_became_active":"2024-09-12T01:41:58.996057+0000","last_became_peered":"2024-09-12T01:41:58.996057+0000","last_unstale":"2024-09-12T01:42:00.011460+0000","last_undegraded":"2024-09-12T01:42:00.011460+0000","last_fullsized":"2024-09-12T01:42:00.011460+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:53.915640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.999122+0000","last_change":"2024-09-12T01:41:59.995738+0000","last_active":"2024-09-12T01:41:59.999122+0000","last_peered":"2024-09-12T01:41:59.999122+0000","last_clean":"2024-09-12T01:41:59.999122+0000","last_became_active":"2024-09-12T01:41:59.995444+0000","last_became_peered":"2024-09-12T01:41:59.995444+0000","last_unstale":"2024-09-12T01:41:59.999122+0000","last_undegraded":"2024-09-12T01:41:59.999122+0000","last_fullsized":"2024-09-12T01:41:59.999122+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:14.525743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980754+0000","last_change":"2024-09-12T01:41:57.980754+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980754+0000","last_undegraded":"2024-09-12T01:41:57.980754+0000","last_fullsized":"2024-09-12T01:41:57.980754+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.006976+0000","last_change":"2024-09-12T01:42:00.005090+0000","last_active":"2024-09-12T01:42:00.006976+0000","last_peered":"2024-09-12T01:42:00.006976+0000","last_clean":"2024-09-12T01:42:00.006976+0000","last_became_active":"2024-09-12T01:42:00.004601+0000","last_became_peered":"2024-09-12T01:42:00.004601+0000","last_unstale":"2024-09-12T01:42:00.006976+0000","last_undegraded":"2024-09-12T01:42:00.006976+0000","last_fullsized":"2024-09-12T01:42:00.006976+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:47.262836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.990294+0000","last_change":"2024-09-12T01:41:58.989687+0000","last_active":"2024-09-12T01:41:59.990294+0000","last_peered":"2024-09-12T01:41:59.990294+0000","last_clean":"2024-09-12T01:41:59.990294+0000","last_became_active":"2024-09-12T01:41:58.989372+0000","last_became_peered":"2024-09-12T01:41:58.989372+0000","last_unstale":"2024-09-12T01:41:59.990294+0000","last_undegraded":"2024-09-12T01:41:59.990294+0000","last_fullsized":"2024-09-12T01:41:59.990294+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:00.390233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000300+0000","last_change":"2024-09-12T01:41:59.991854+0000","last_active":"2024-09-12T01:42:00.000300+0000","last_peered":"2024-09-12T01:42:00.000300+0000","last_clean":"2024-09-12T01:42:00.000300+0000","last_became_active":"2024-09-12T01:41:59.991577+0000","last_became_peered":"2024-09-12T01:41:59.991577+0000","last_unstale":"2024-09-12T01:42:00.000300+0000","last_undegraded":"2024-09-12T01:42:00.000300+0000","last_fullsized":"2024-09-12T01:42:00.000300+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:13.714369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.994992+0000","last_change":"2024-09-12T01:41:58.997889+0000","last_active":"2024-09-12T01:41:59.994992+0000","last_peered":"2024-09-12T01:41:59.994992+0000","last_clean":"2024-09-12T01:41:59.994992+0000","last_became_active":"2024-09-12T01:41:58.997469+0000","last_became_peered":"2024-09-12T01:41:58.997469+0000","last_unstale":"2024-09-12T01:41:59.994992+0000","last_undegraded":"2024-09-12T01:41:59.994992+0000","last_fullsized":"2024-09-12T01:41:59.994992+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:22.853882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015512+0000","last_change":"2024-09-12T01:42:00.010808+0000","last_active":"2024-09-12T01:42:00.015512+0000","last_peered":"2024-09-12T01:42:00.015512+0000","last_clean":"2024-09-12T01:42:00.015512+0000","last_became_active":"2024-09-12T01:42:00.010535+0000","last_became_peered":"2024-09-12T01:42:00.010535+0000","last_unstale":"2024-09-12T01:42:00.015512+0000","last_undegraded":"2024-09-12T01:42:00.015512+0000","last_fullsized":"2024-09-12T01:42:00.015512+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:01.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980744+0000","last_change":"2024-09-12T01:41:57.980744+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980744+0000","last_undegraded":"2024-09-12T01:41:57.980744+0000","last_fullsized":"2024-09-12T01:41:57.980744+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.002425+0000","last_change":"2024-09-12T01:41:59.996189+0000","last_active":"2024-09-12T01:42:00.002425+0000","last_peered":"2024-09-12T01:42:00.002425+0000","last_clean":"2024-09-12T01:42:00.002425+0000","last_became_active":"2024-09-12T01:41:59.995894+0000","last_became_peered":"2024-09-12T01:41:59.995894+0000","last_unstale":"2024-09-12T01:42:00.002425+0000","last_undegraded":"2024-09-12T01:42:00.002425+0000","last_fullsized":"2024-09-12T01:42:00.002425+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:53.113663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.985390+0000","last_change":"2024-09-12T01:41:58.996582+0000","last_active":"2024-09-12T01:41:59.985390+0000","last_peered":"2024-09-12T01:41:59.985390+0000","last_clean":"2024-09-12T01:41:59.985390+0000","last_became_active":"2024-09-12T01:41:58.996289+0000","last_became_peered":"2024-09-12T01:41:58.996289+0000","last_unstale":"2024-09-12T01:41:59.985390+0000","last_undegraded":"2024-09-12T01:41:59.985390+0000","last_fullsized":"2024-09-12T01:41:59.985390+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:45.266662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.009813+0000","last_change":"2024-09-12T01:42:00.009375+0000","last_active":"2024-09-12T01:42:00.009813+0000","last_peered":"2024-09-12T01:42:00.009813+0000","last_clean":"2024-09-12T01:42:00.009813+0000","last_became_active":"2024-09-12T01:42:00.009071+0000","last_became_peered":"2024-09-12T01:42:00.009071+0000","last_unstale":"2024-09-12T01:42:00.009813+0000","last_undegraded":"2024-09-12T01:42:00.009813+0000","last_fullsized":"2024-09-12T01:42:00.009813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:13.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"91'3","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005079+0000","last_change":"2024-09-12T01:41:58.992505+0000","last_active":"2024-09-12T01:42:00.005079+0000","last_peered":"2024-09-12T01:42:00.005079+0000","last_clean":"2024-09-12T01:42:00.005079+0000","last_became_active":"2024-09-12T01:41:58.992076+0000","last_became_peered":"2024-09-12T01:41:58.992076+0000","last_unstale":"2024-09-12T01:42:00.005079+0000","last_undegraded":"2024-09-12T01:42:00.005079+0000","last_fullsized":"2024-09-12T01:42:00.005079+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:15.078082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004528+0000","last_change":"2024-09-12T01:42:00.002167+0000","last_active":"2024-09-12T01:42:00.004528+0000","last_peered":"2024-09-12T01:42:00.004528+0000","last_clean":"2024-09-12T01:42:00.004528+0000","last_became_active":"2024-09-12T01:42:00.001838+0000","last_became_peered":"2024-09-12T01:42:00.001838+0000","last_unstale":"2024-09-12T01:42:00.004528+0000","last_undegraded":"2024-09-12T01:42:00.004528+0000","last_fullsized":"2024-09-12T01:42:00.004528+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:57.416935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"91'6","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015524+0000","last_change":"2024-09-12T01:41:58.996508+0000","last_active":"2024-09-12T01:42:00.015524+0000","last_peered":"2024-09-12T01:42:00.015524+0000","last_clean":"2024-09-12T01:42:00.015524+0000","last_became_active":"2024-09-12T01:41:58.995956+0000","last_became_peered":"2024-09-12T01:41:58.995956+0000","last_unstale":"2024-09-12T01:42:00.015524+0000","last_undegraded":"2024-09-12T01:42:00.015524+0000","last_fullsized":"2024-09-12T01:42:00.015524+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:55.108765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008246+0000","last_change":"2024-09-12T01:41:59.999914+0000","last_active":"2024-09-12T01:42:00.008246+0000","last_peered":"2024-09-12T01:42:00.008246+0000","last_clean":"2024-09-12T01:42:00.008246+0000","last_became_active":"2024-09-12T01:41:59.999540+0000","last_became_peered":"2024-09-12T01:41:59.999540+0000","last_unstale":"2024-09-12T01:42:00.008246+0000","last_undegraded":"2024-09-12T01:42:00.008246+0000","last_fullsized":"2024-09-12T01:42:00.008246+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.966780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007201+0000","last_change":"2024-09-12T01:41:58.991672+0000","last_active":"2024-09-12T01:42:00.007201+0000","last_peered":"2024-09-12T01:42:00.007201+0000","last_clean":"2024-09-12T01:42:00.007201+0000","last_became_active":"2024-09-12T01:41:58.991363+0000","last_became_peered":"2024-09-12T01:41:58.991363+0000","last_unstale":"2024-09-12T01:42:00.007201+0000","last_undegraded":"2024-09-12T01:42:00.007201+0000","last_fullsized":"2024-09-12T01:42:00.007201+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:24.678504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.985648+0000","last_change":"2024-09-12T01:41:58.996856+0000","last_active":"2024-09-12T01:41:59.985648+0000","last_peered":"2024-09-12T01:41:59.985648+0000","last_clean":"2024-09-12T01:41:59.985648+0000","last_became_active":"2024-09-12T01:41:58.995624+0000","last_became_peered":"2024-09-12T01:41:58.995624+0000","last_unstale":"2024-09-12T01:41:59.985648+0000","last_undegraded":"2024-09-12T01:41:59.985648+0000","last_fullsized":"2024-09-12T01:41:59.985648+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:06.324090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.998809+0000","last_change":"2024-09-12T01:41:59.993089+0000","last_active":"2024-09-12T01:41:59.998809+0000","last_peered":"2024-09-12T01:41:59.998809+0000","last_clean":"2024-09-12T01:41:59.998809+0000","last_became_active":"2024-09-12T01:41:59.992817+0000","last_became_peered":"2024-09-12T01:41:59.992817+0000","last_unstale":"2024-09-12T01:41:59.998809+0000","last_undegraded":"2024-09-12T01:41:59.998809+0000","last_fullsized":"2024-09-12T01:41:59.998809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:46.214683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.984192+0000","last_change":"2024-09-12T01:41:58.993719+0000","last_active":"2024-09-12T01:41:59.984192+0000","last_peered":"2024-09-12T01:41:59.984192+0000","last_clean":"2024-09-12T01:41:59.984192+0000","last_became_active":"2024-09-12T01:41:58.993224+0000","last_became_peered":"2024-09-12T01:41:58.993224+0000","last_unstale":"2024-09-12T01:41:59.984192+0000","last_undegraded":"2024-09-12T01:41:59.984192+0000","last_fullsized":"2024-09-12T01:41:59.984192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:58.987546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"91'8","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.011250+0000","last_change":"2024-09-12T01:41:58.991776+0000","last_active":"2024-09-12T01:42:00.011250+0000","last_peered":"2024-09-12T01:42:00.011250+0000","last_clean":"2024-09-12T01:42:00.011250+0000","last_became_active":"2024-09-12T01:41:58.991511+0000","last_became_peered":"2024-09-12T01:41:58.991511+0000","last_unstale":"2024-09-12T01:42:00.011250+0000","last_undegraded":"2024-09-12T01:42:00.011250+0000","last_fullsized":"2024-09-12T01:42:00.011250+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.831543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.991264+0000","last_change":"2024-09-12T01:41:59.987898+0000","last_active":"2024-09-12T01:41:59.991264+0000","last_peered":"2024-09-12T01:41:59.991264+0000","last_clean":"2024-09-12T01:41:59.991264+0000","last_became_active":"2024-09-12T01:41:59.987625+0000","last_became_peered":"2024-09-12T01:41:59.987625+0000","last_unstale":"2024-09-12T01:41:59.991264+0000","last_undegraded":"2024-09-12T01:41:59.991264+0000","last_fullsized":"2024-09-12T01:41:59.991264+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:04.822297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.001058+0000","last_change":"2024-09-12T01:41:58.996161+0000","last_active":"2024-09-12T01:42:00.001058+0000","last_peered":"2024-09-12T01:42:00.001058+0000","last_clean":"2024-09-12T01:42:00.001058+0000","last_became_active":"2024-09-12T01:41:58.995854+0000","last_became_peered":"2024-09-12T01:41:58.995854+0000","last_unstale":"2024-09-12T01:42:00.001058+0000","last_undegraded":"2024-09-12T01:42:00.001058+0000","last_fullsized":"2024-09-12T01:42:00.001058+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:04.272253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.996013+0000","last_change":"2024-09-12T01:41:59.992362+0000","last_active":"2024-09-12T01:41:59.996013+0000","last_peered":"2024-09-12T01:41:59.996013+0000","last_clean":"2024-09-12T01:41:59.996013+0000","last_became_active":"2024-09-12T01:41:59.992048+0000","last_became_peered":"2024-09-12T01:41:59.992048+0000","last_unstale":"2024-09-12T01:41:59.996013+0000","last_undegraded":"2024-09-12T01:41:59.996013+0000","last_fullsized":"2024-09-12T01:41:59.996013+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:37.604923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003203+0000","last_change":"2024-09-12T01:41:58.990373+0000","last_active":"2024-09-12T01:42:00.003203+0000","last_peered":"2024-09-12T01:42:00.003203+0000","last_clean":"2024-09-12T01:42:00.003203+0000","last_became_active":"2024-09-12T01:41:58.990079+0000","last_became_peered":"2024-09-12T01:41:58.990079+0000","last_unstale":"2024-09-12T01:42:00.003203+0000","last_undegraded":"2024-09-12T01:42:00.003203+0000","last_fullsized":"2024-09-12T01:42:00.003203+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:03.731788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003934+0000","last_change":"2024-09-12T01:41:59.999108+0000","last_active":"2024-09-12T01:42:00.003934+0000","last_peered":"2024-09-12T01:42:00.003934+0000","last_clean":"2024-09-12T01:42:00.003934+0000","last_became_active":"2024-09-12T01:41:59.998824+0000","last_became_peered":"2024-09-12T01:41:59.998824+0000","last_unstale":"2024-09-12T01:42:00.003934+0000","last_undegraded":"2024-09-12T01:42:00.003934+0000","last_fullsized":"2024-09-12T01:42:00.003934+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:54.917836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.994358+0000","last_change":"2024-09-12T01:41:58.997460+0000","last_active":"2024-09-12T01:41:59.994358+0000","last_peered":"2024-09-12T01:41:59.994358+0000","last_clean":"2024-09-12T01:41:59.994358+0000","last_became_active":"2024-09-12T01:41:58.996445+0000","last_became_peered":"2024-09-12T01:41:58.996445+0000","last_unstale":"2024-09-12T01:41:59.994358+0000","last_undegraded":"2024-09-12T01:41:59.994358+0000","last_fullsized":"2024-09-12T01:41:59.994358+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:56.414738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005924+0000","last_change":"2024-09-12T01:41:59.999188+0000","last_active":"2024-09-12T01:42:00.005924+0000","last_peered":"2024-09-12T01:42:00.005924+0000","last_clean":"2024-09-12T01:42:00.005924+0000","last_became_active":"2024-09-12T01:41:59.998893+0000","last_became_peered":"2024-09-12T01:41:59.998893+0000","last_unstale":"2024-09-12T01:42:00.005924+0000","last_undegraded":"2024-09-12T01:42:00.005924+0000","last_fullsized":"2024-09-12T01:42:00.005924+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:20.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.012686+0000","last_change":"2024-09-12T01:41:58.997143+0000","last_active":"2024-09-12T01:42:00.012686+0000","last_peered":"2024-09-12T01:42:00.012686+0000","last_clean":"2024-09-12T01:42:00.012686+0000","last_became_active":"2024-09-12T01:41:58.996881+0000","last_became_peered":"2024-09-12T01:41:58.996881+0000","last_unstale":"2024-09-12T01:42:00.012686+0000","last_undegraded":"2024-09-12T01:42:00.012686+0000","last_fullsized":"2024-09-12T01:42:00.012686+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:47.813327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.006138+0000","last_change":"2024-09-12T01:42:00.001287+0000","last_active":"2024-09-12T01:42:00.006138+0000","last_peered":"2024-09-12T01:42:00.006138+0000","last_clean":"2024-09-12T01:42:00.006138+0000","last_became_active":"2024-09-12T01:42:00.001027+0000","last_became_peered":"2024-09-12T01:42:00.001027+0000","last_unstale":"2024-09-12T01:42:00.006138+0000","last_undegraded":"2024-09-12T01:42:00.006138+0000","last_fullsized":"2024-09-12T01:42:00.006138+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:36.937083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.981356+0000","last_change":"2024-09-12T01:41:58.992864+0000","last_active":"2024-09-12T01:41:59.981356+0000","last_peered":"2024-09-12T01:41:59.981356+0000","last_clean":"2024-09-12T01:41:59.981356+0000","last_became_active":"2024-09-12T01:41:58.992587+0000","last_became_peered":"2024-09-12T01:41:58.992587+0000","last_unstale":"2024-09-12T01:41:59.981356+0000","last_undegraded":"2024-09-12T01:41:59.981356+0000","last_fullsized":"2024-09-12T01:41:59.981356+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:08.383216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008733+0000","last_change":"2024-09-12T01:42:00.002542+0000","last_active":"2024-09-12T01:42:00.008733+0000","last_peered":"2024-09-12T01:42:00.008733+0000","last_clean":"2024-09-12T01:42:00.008733+0000","last_became_active":"2024-09-12T01:42:00.002208+0000","last_became_peered":"2024-09-12T01:42:00.002208+0000","last_unstale":"2024-09-12T01:42:00.008733+0000","last_undegraded":"2024-09-12T01:42:00.008733+0000","last_fullsized":"2024-09-12T01:42:00.008733+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:37.604923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.990699+0000","last_change":"2024-09-12T01:41:58.993285+0000","last_active":"2024-09-12T01:41:59.990699+0000","last_peered":"2024-09-12T01:41:59.990699+0000","last_clean":"2024-09-12T01:41:59.990699+0000","last_became_active":"2024-09-12T01:41:58.992941+0000","last_became_peered":"2024-09-12T01:41:58.992941+0000","last_unstale":"2024-09-12T01:41:59.990699+0000","last_undegraded":"2024-09-12T01:41:59.990699+0000","last_fullsized":"2024-09-12T01:41:59.990699+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.964417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004722+0000","last_change":"2024-09-12T01:41:59.998894+0000","last_active":"2024-09-12T01:42:00.004722+0000","last_peered":"2024-09-12T01:42:00.004722+0000","last_clean":"2024-09-12T01:42:00.004722+0000","last_became_active":"2024-09-12T01:41:59.998534+0000","last_became_peered":"2024-09-12T01:41:59.998534+0000","last_unstale":"2024-09-12T01:42:00.004722+0000","last_undegraded":"2024-09-12T01:42:00.004722+0000","last_fullsized":"2024-09-12T01:42:00.004722+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:01.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.982273+0000","last_change":"2024-09-12T01:41:57.982273+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.982273+0000","last_undegraded":"2024-09-12T01:41:57.982273+0000","last_fullsized":"2024-09-12T01:41:57.982273+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008881+0000","last_change":"2024-09-12T01:42:00.007206+0000","last_active":"2024-09-12T01:42:00.008881+0000","last_peered":"2024-09-12T01:42:00.008881+0000","last_clean":"2024-09-12T01:42:00.008881+0000","last_became_active":"2024-09-12T01:42:00.006901+0000","last_became_peered":"2024-09-12T01:42:00.006901+0000","last_unstale":"2024-09-12T01:42:00.008881+0000","last_undegraded":"2024-09-12T01:42:00.008881+0000","last_fullsized":"2024-09-12T01:42:00.008881+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:14.401142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003602+0000","last_change":"2024-09-12T01:41:58.996435+0000","last_active":"2024-09-12T01:42:00.003602+0000","last_peered":"2024-09-12T01:42:00.003602+0000","last_clean":"2024-09-12T01:42:00.003602+0000","last_became_active":"2024-09-12T01:41:58.995490+0000","last_became_peered":"2024-09-12T01:41:58.995490+0000","last_unstale":"2024-09-12T01:42:00.003602+0000","last_undegraded":"2024-09-12T01:42:00.003602+0000","last_fullsized":"2024-09-12T01:42:00.003602+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:24.184298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.018020+0000","last_change":"2024-09-12T01:42:00.016030+0000","last_active":"2024-09-12T01:42:00.018020+0000","last_peered":"2024-09-12T01:42:00.018020+0000","last_clean":"2024-09-12T01:42:00.018020+0000","last_became_active":"2024-09-12T01:42:00.015719+0000","last_became_peered":"2024-09-12T01:42:00.015719+0000","last_unstale":"2024-09-12T01:42:00.018020+0000","last_undegraded":"2024-09-12T01:42:00.018020+0000","last_fullsized":"2024-09-12T01:42:00.018020+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.988766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.995667+0000","last_change":"2024-09-12T01:41:58.993546+0000","last_active":"2024-09-12T01:41:59.995667+0000","last_peered":"2024-09-12T01:41:59.995667+0000","last_clean":"2024-09-12T01:41:59.995667+0000","last_became_active":"2024-09-12T01:41:58.992168+0000","last_became_peered":"2024-09-12T01:41:58.992168+0000","last_unstale":"2024-09-12T01:41:59.995667+0000","last_undegraded":"2024-09-12T01:41:59.995667+0000","last_fullsized":"2024-09-12T01:41:59.995667+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:11.336252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.995016+0000","last_change":"2024-09-12T01:41:58.994382+0000","last_active":"2024-09-12T01:41:59.995016+0000","last_peered":"2024-09-12T01:41:59.995016+0000","last_clean":"2024-09-12T01:41:59.995016+0000","last_became_active":"2024-09-12T01:41:58.994094+0000","last_became_peered":"2024-09-12T01:41:58.994094+0000","last_unstale":"2024-09-12T01:41:59.995016+0000","last_undegraded":"2024-09-12T01:41:59.995016+0000","last_fullsized":"2024-09-12T01:41:59.995016+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:13.091759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005149+0000","last_change":"2024-09-12T01:42:00.004296+0000","last_active":"2024-09-12T01:42:00.005149+0000","last_peered":"2024-09-12T01:42:00.005149+0000","last_clean":"2024-09-12T01:42:00.005149+0000","last_became_active":"2024-09-12T01:42:00.004039+0000","last_became_peered":"2024-09-12T01:42:00.004039+0000","last_unstale":"2024-09-12T01:42:00.005149+0000","last_undegraded":"2024-09-12T01:42:00.005149+0000","last_fullsized":"2024-09-12T01:42:00.005149+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:20.951224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.982305+0000","last_change":"2024-09-12T01:41:58.992765+0000","last_active":"2024-09-12T01:41:59.982305+0000","last_peered":"2024-09-12T01:41:59.982305+0000","last_clean":"2024-09-12T01:41:59.982305+0000","last_became_active":"2024-09-12T01:41:58.992493+0000","last_became_peered":"2024-09-12T01:41:58.992493+0000","last_unstale":"2024-09-12T01:41:59.982305+0000","last_undegraded":"2024-09-12T01:41:59.982305+0000","last_fullsized":"2024-09-12T01:41:59.982305+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:57.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005979+0000","last_change":"2024-09-12T01:42:00.000490+0000","last_active":"2024-09-12T01:42:00.005979+0000","last_peered":"2024-09-12T01:42:00.005979+0000","last_clean":"2024-09-12T01:42:00.005979+0000","last_became_active":"2024-09-12T01:41:59.996026+0000","last_became_peered":"2024-09-12T01:41:59.996026+0000","last_unstale":"2024-09-12T01:42:00.005979+0000","last_undegraded":"2024-09-12T01:42:00.005979+0000","last_fullsized":"2024-09-12T01:42:00.005979+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:26.698973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980607+0000","last_change":"2024-09-12T01:41:57.980607+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980607+0000","last_undegraded":"2024-09-12T01:41:57.980607+0000","last_fullsized":"2024-09-12T01:41:57.980607+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000900+0000","last_change":"2024-09-12T01:41:59.999997+0000","last_active":"2024-09-12T01:42:00.000900+0000","last_peered":"2024-09-12T01:42:00.000900+0000","last_clean":"2024-09-12T01:42:00.000900+0000","last_became_active":"2024-09-12T01:41:59.999544+0000","last_became_peered":"2024-09-12T01:41:59.999544+0000","last_unstale":"2024-09-12T01:42:00.000900+0000","last_undegraded":"2024-09-12T01:42:00.000900+0000","last_fullsized":"2024-09-12T01:42:00.000900+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:41.234974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.981931+0000","last_change":"2024-09-12T01:41:58.994797+0000","last_active":"2024-09-12T01:41:59.981931+0000","last_peered":"2024-09-12T01:41:59.981931+0000","last_clean":"2024-09-12T01:41:59.981931+0000","last_became_active":"2024-09-12T01:41:58.994442+0000","last_became_peered":"2024-09-12T01:41:58.994442+0000","last_unstale":"2024-09-12T01:41:59.981931+0000","last_undegraded":"2024-09-12T01:41:59.981931+0000","last_fullsized":"2024-09-12T01:41:59.981931+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:01.964583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007888+0000","last_change":"2024-09-12T01:42:00.006100+0000","last_active":"2024-09-12T01:42:00.007888+0000","last_peered":"2024-09-12T01:42:00.007888+0000","last_clean":"2024-09-12T01:42:00.007888+0000","last_became_active":"2024-09-12T01:42:00.005681+0000","last_became_peered":"2024-09-12T01:42:00.005681+0000","last_unstale":"2024-09-12T01:42:00.007888+0000","last_undegraded":"2024-09-12T01:42:00.007888+0000","last_fullsized":"2024-09-12T01:42:00.007888+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:23.838485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.991151+0000","last_change":"2024-09-12T01:41:58.996497+0000","last_active":"2024-09-12T01:41:59.991151+0000","last_peered":"2024-09-12T01:41:59.991151+0000","last_clean":"2024-09-12T01:41:59.991151+0000","last_became_active":"2024-09-12T01:41:58.996200+0000","last_became_peered":"2024-09-12T01:41:58.996200+0000","last_unstale":"2024-09-12T01:41:59.991151+0000","last_undegraded":"2024-09-12T01:41:59.991151+0000","last_fullsized":"2024-09-12T01:41:59.991151+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:40.919309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003931+0000","last_change":"2024-09-12T01:41:59.997655+0000","last_active":"2024-09-12T01:42:00.003931+0000","last_peered":"2024-09-12T01:42:00.003931+0000","last_clean":"2024-09-12T01:42:00.003931+0000","last_became_active":"2024-09-12T01:41:59.997190+0000","last_became_peered":"2024-09-12T01:41:59.997190+0000","last_unstale":"2024-09-12T01:42:00.003931+0000","last_undegraded":"2024-09-12T01:42:00.003931+0000","last_fullsized":"2024-09-12T01:42:00.003931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:24.280195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980479+0000","last_change":"2024-09-12T01:41:57.980479+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980479+0000","last_undegraded":"2024-09-12T01:41:57.980479+0000","last_fullsized":"2024-09-12T01:41:57.980479+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007123+0000","last_change":"2024-09-12T01:41:58.996923+0000","last_active":"2024-09-12T01:42:00.007123+0000","last_peered":"2024-09-12T01:42:00.007123+0000","last_clean":"2024-09-12T01:42:00.007123+0000","last_became_active":"2024-09-12T01:41:58.996587+0000","last_became_peered":"2024-09-12T01:41:58.996587+0000","last_unstale":"2024-09-12T01:42:00.007123+0000","last_undegraded":"2024-09-12T01:42:00.007123+0000","last_fullsized":"2024-09-12T01:42:00.007123+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:22.567888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":300,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.984018+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:41:59.984018+0000","last_peered":"2024-09-12T01:41:59.984018+0000","last_clean":"2024-09-12T01:41:59.984018+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:41:59.984018+0000","last_undegraded":"2024-09-12T01:41:59.984018+0000","last_fullsized":"2024-09-12T01:41:59.984018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":7},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509520,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1122304,"data_stored":470654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509518,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":470072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509518,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1732608,"data_stored":1062108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1130496,"data_stored":470266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36432,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335408,"statfs":{"total":96636764160,"available":96599457792,"internally_reserved":0,"allocated":1105920,"data_stored":463297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37012,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334828,"statfs":{"total":96636764160,"available":96598863872,"internally_reserved":0,"allocated":1699840,"data_stored":1053665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36440,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335400,"statfs":{"total":96636764160,"available":96599449600,"internally_reserved":0,"allocated":1118208,"data_stored":470072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1093632,"data_stored":457022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:42:02.983 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:42:03.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.123+0000 7fde865e4640 1 Processor -- start 2024-09-12T01:42:03.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.123+0000 7fde865e4640 1 -- start start 2024-09-12T01:42:03.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.124+0000 7fde865e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde8015a9c0 0x7fde8015e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.124+0000 7fde865e4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde800b6830 con 0x7fde800b29a0 2024-09-12T01:42:03.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.124+0000 7fde865e4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde800cd0b0 con 0x7fde800b5be0 2024-09-12T01:42:03.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.124+0000 7fde865e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fde8015f410 con 0x7fde8015a9c0 2024-09-12T01:42:03.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.124+0000 7fde84b81640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fde800b29a0 0x7fde800cde70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52974/0 (socket says 172.21.15.60:52974) 2024-09-12T01:42:03.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.124+0000 7fde84b81640 1 -- 172.21.15.60:0/2743164001 learned_addr learned my addr 172.21.15.60:0/2743164001 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:03.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.124+0000 7fde7ffff640 1 --2- 172.21.15.60:0/2743164001 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde8015a9c0 0x7fde8015e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.124+0000 7fde7effd640 1 -- 172.21.15.60:0/2743164001 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224143120 0 0) 0x7fde800b6830 con 0x7fde800b29a0 2024-09-12T01:42:03.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.124+0000 7fde7effd640 1 -- 172.21.15.60:0/2743164001 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde68003520 con 0x7fde800b29a0 2024-09-12T01:42:03.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.125+0000 7fde7effd640 1 -- 172.21.15.60:0/2743164001 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1854727634 0 0) 0x7fde800cd0b0 con 0x7fde800b5be0 2024-09-12T01:42:03.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.125+0000 7fde7effd640 1 -- 172.21.15.60:0/2743164001 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde800b6830 con 0x7fde800b5be0 2024-09-12T01:42:03.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.125+0000 7fde7ffff640 1 -- 172.21.15.60:0/2743164001 >> v1:172.21.15.105:6789/0 conn(0x7fde800b5be0 legacy=0x7fde8015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.125+0000 7fde7ffff640 1 -- 172.21.15.60:0/2743164001 >> v1:172.21.15.60:6789/0 conn(0x7fde800b29a0 legacy=0x7fde800cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.125+0000 7fde7ffff640 1 -- 172.21.15.60:0/2743164001 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde800cd390 con 0x7fde8015a9c0 2024-09-12T01:42:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.125+0000 7fde7ffff640 1 --2- 172.21.15.60:0/2743164001 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde8015a9c0 0x7fde8015e600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde7000a970 tx=0x7fde7002b5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1577df0f0bcb7f02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.126+0000 7fde7effd640 1 -- 172.21.15.60:0/2743164001 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7000b040 con 0x7fde8015a9c0 2024-09-12T01:42:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.126+0000 7fde7effd640 1 -- 172.21.15.60:0/2743164001 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde70032600 con 0x7fde8015a9c0 2024-09-12T01:42:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.126+0000 7fde7effd640 1 -- 172.21.15.60:0/2743164001 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde700329b0 con 0x7fde8015a9c0 2024-09-12T01:42:03.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.126+0000 7fde865e4640 1 -- 172.21.15.60:0/2743164001 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde8015a9c0 msgr2=0x7fde8015e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.126+0000 7fde865e4640 1 --2- 172.21.15.60:0/2743164001 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde8015a9c0 0x7fde8015e600 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde7000a970 tx=0x7fde7002b5d0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.126+0000 7fde865e4640 1 -- 172.21.15.60:0/2743164001 shutdown_connections 2024-09-12T01:42:03.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.126+0000 7fde865e4640 1 --2- 172.21.15.60:0/2743164001 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde8015a9c0 0x7fde8015e600 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.126+0000 7fde865e4640 1 -- 172.21.15.60:0/2743164001 >> 172.21.15.60:0/2743164001 conn(0x7fde8006bc10 msgr2=0x7fde8006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:03.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.126+0000 7fde865e4640 1 -- 172.21.15.60:0/2743164001 shutdown_connections 2024-09-12T01:42:03.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.126+0000 7fde865e4640 1 -- 172.21.15.60:0/2743164001 wait complete. 2024-09-12T01:42:03.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.127+0000 7fde865e4640 1 Processor -- start 2024-09-12T01:42:03.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.128+0000 7fde865e4640 1 -- start start 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.128+0000 7fde865e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde800b29a0 0x7fde80150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.128+0000 7fde865e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde800b5be0 0x7fde80153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.128+0000 7fde865e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde8015a9c0 0x7fde80154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.128+0000 7fde865e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fde8015ada0 con 0x7fde8015a9c0 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.128+0000 7fde865e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fde800cd950 con 0x7fde800b29a0 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.128+0000 7fde865e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fde8006de40 con 0x7fde800b5be0 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.128+0000 7fde84b81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde8015a9c0 0x7fde80154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde84b81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde8015a9c0 0x7fde80154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36422/0 (socket says 172.21.15.60:36422) 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde84b81640 1 -- 172.21.15.60:0/3789404275 learned_addr learned my addr 172.21.15.60:0/3789404275 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde7ffff640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde800b29a0 0x7fde80150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde7f7fe640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde800b5be0 0x7fde80153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde84b81640 1 -- 172.21.15.60:0/3789404275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde800b5be0 msgr2=0x7fde80153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde84b81640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde800b5be0 0x7fde80153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde84b81640 1 -- 172.21.15.60:0/3789404275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde800b29a0 msgr2=0x7fde80150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde84b81640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde800b29a0 0x7fde80150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde84b81640 1 -- 172.21.15.60:0/3789404275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8015af20 con 0x7fde8015a9c0 2024-09-12T01:42:03.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde84b81640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde8015a9c0 0x7fde80154110 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fde7800cb20 tx=0x7fde7800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:03.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde7cff9640 1 -- 172.21.15.60:0/3789404275 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78017070 con 0x7fde8015a9c0 2024-09-12T01:42:03.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde7cff9640 1 -- 172.21.15.60:0/3789404275 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7800ac40 con 0x7fde8015a9c0 2024-09-12T01:42:03.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde865e4640 1 -- 172.21.15.60:0/3789404275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde801533c0 con 0x7fde8015a9c0 2024-09-12T01:42:03.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde7cff9640 1 -- 172.21.15.60:0/3789404275 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78012400 con 0x7fde8015a9c0 2024-09-12T01:42:03.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.129+0000 7fde865e4640 1 -- 172.21.15.60:0/3789404275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde8015b1c0 con 0x7fde8015a9c0 2024-09-12T01:42:03.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.130+0000 7fde865e4640 1 -- 172.21.15.60:0/3789404275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde8006e270 con 0x7fde8015a9c0 2024-09-12T01:42:03.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.131+0000 7fde7cff9640 1 -- 172.21.15.60:0/3789404275 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde7801a070 con 0x7fde8015a9c0 2024-09-12T01:42:03.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.131+0000 7fde7cff9640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde6c06be30 0x7fde6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.131+0000 7fde7cff9640 1 -- 172.21.15.60:0/3789404275 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fde7808a9e0 con 0x7fde8015a9c0 2024-09-12T01:42:03.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.131+0000 7fde7ffff640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde6c06be30 0x7fde6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.132+0000 7fde7ffff640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde6c06be30 0x7fde6c06e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fde70035000 tx=0x7fde7000c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:03.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.136+0000 7fde7cff9640 1 -- 172.21.15.60:0/3789404275 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde78058dd0 con 0x7fde8015a9c0 2024-09-12T01:42:03.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.307+0000 7fde865e4640 1 -- 172.21.15.60:0/3789404275 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde801e7390 con 0x7fde6c06be30 2024-09-12T01:42:03.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.313+0000 7fde7cff9640 1 -- 172.21.15.60:0/3789404275 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250266 (secure 0 0 0) 0x7fde801e7390 con 0x7fde6c06be30 2024-09-12T01:42:03.315 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:03.316 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:42:03.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.317+0000 7fde865e4640 1 -- 172.21.15.60:0/3789404275 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde6c06be30 msgr2=0x7fde6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.317+0000 7fde865e4640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde6c06be30 0x7fde6c06e2f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fde70035000 tx=0x7fde7000c040 comp rx=0 tx=0).stop 2024-09-12T01:42:03.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.317+0000 7fde865e4640 1 -- 172.21.15.60:0/3789404275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde8015a9c0 msgr2=0x7fde80154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.317+0000 7fde865e4640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde8015a9c0 0x7fde80154110 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fde7800cb20 tx=0x7fde7800a060 comp rx=0 tx=0).stop 2024-09-12T01:42:03.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.317+0000 7fde865e4640 1 -- 172.21.15.60:0/3789404275 shutdown_connections 2024-09-12T01:42:03.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.317+0000 7fde865e4640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde8015a9c0 0x7fde80154110 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.317+0000 7fde865e4640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde6c06be30 0x7fde6c06e2f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.317+0000 7fde865e4640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fde800b5be0 0x7fde80153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.317+0000 7fde865e4640 1 --2- 172.21.15.60:0/3789404275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fde800b29a0 0x7fde80150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.317+0000 7fde865e4640 1 -- 172.21.15.60:0/3789404275 >> 172.21.15.60:0/3789404275 conn(0x7fde8006bc10 msgr2=0x7fde801e76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:03.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.317+0000 7fde865e4640 1 -- 172.21.15.60:0/3789404275 shutdown_connections 2024-09-12T01:42:03.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.317+0000 7fde865e4640 1 -- 172.21.15.60:0/3789404275 wait complete. 2024-09-12T01:42:03.327 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-09-12T01:42:02.343719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276036,"kb_used_data":9884,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754698684,"statfs":{"total":773094113280,"available":772811452416,"internally_reserved":0,"allocated":10121216,"data_stored":4917156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.372071"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.006765+0000","last_change":"2024-09-12T01:41:59.998387+0000","last_active":"2024-09-12T01:42:00.006765+0000","last_peered":"2024-09-12T01:42:00.006765+0000","last_clean":"2024-09-12T01:42:00.006765+0000","last_became_active":"2024-09-12T01:41:59.998107+0000","last_became_peered":"2024-09-12T01:41:59.998107+0000","last_unstale":"2024-09-12T01:42:00.006765+0000","last_undegraded":"2024-09-12T01:42:00.006765+0000","last_fullsized":"2024-09-12T01:42:00.006765+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:26.966614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005999+0000","last_change":"2024-09-12T01:41:59.997097+0000","last_active":"2024-09-12T01:42:00.005999+0000","last_peered":"2024-09-12T01:42:00.005999+0000","last_clean":"2024-09-12T01:42:00.005999+0000","last_became_active":"2024-09-12T01:41:59.996791+0000","last_became_peered":"2024-09-12T01:41:59.996791+0000","last_unstale":"2024-09-12T01:42:00.005999+0000","last_undegraded":"2024-09-12T01:42:00.005999+0000","last_fullsized":"2024-09-12T01:42:00.005999+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:26.435357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015520+0000","last_change":"2024-09-12T01:42:00.010982+0000","last_active":"2024-09-12T01:42:00.015520+0000","last_peered":"2024-09-12T01:42:00.015520+0000","last_clean":"2024-09-12T01:42:00.015520+0000","last_became_active":"2024-09-12T01:42:00.010488+0000","last_became_peered":"2024-09-12T01:42:00.010488+0000","last_unstale":"2024-09-12T01:42:00.015520+0000","last_undegraded":"2024-09-12T01:42:00.015520+0000","last_fullsized":"2024-09-12T01:42:00.015520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:57.416935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.998922+0000","last_change":"2024-09-12T01:41:59.994841+0000","last_active":"2024-09-12T01:41:59.998922+0000","last_peered":"2024-09-12T01:41:59.998922+0000","last_clean":"2024-09-12T01:41:59.998922+0000","last_became_active":"2024-09-12T01:41:59.994425+0000","last_became_peered":"2024-09-12T01:41:59.994425+0000","last_unstale":"2024-09-12T01:41:59.998922+0000","last_undegraded":"2024-09-12T01:41:59.998922+0000","last_fullsized":"2024-09-12T01:41:59.998922+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:48.845335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003010+0000","last_change":"2024-09-12T01:42:00.002035+0000","last_active":"2024-09-12T01:42:00.003010+0000","last_peered":"2024-09-12T01:42:00.003010+0000","last_clean":"2024-09-12T01:42:00.003010+0000","last_became_active":"2024-09-12T01:42:00.001739+0000","last_became_peered":"2024-09-12T01:42:00.001739+0000","last_unstale":"2024-09-12T01:42:00.003010+0000","last_undegraded":"2024-09-12T01:42:00.003010+0000","last_fullsized":"2024-09-12T01:42:00.003010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:25.393366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.999763+0000","last_change":"2024-09-12T01:41:59.997500+0000","last_active":"2024-09-12T01:41:59.999763+0000","last_peered":"2024-09-12T01:41:59.999763+0000","last_clean":"2024-09-12T01:41:59.999763+0000","last_became_active":"2024-09-12T01:41:59.997216+0000","last_became_peered":"2024-09-12T01:41:59.997216+0000","last_unstale":"2024-09-12T01:41:59.999763+0000","last_undegraded":"2024-09-12T01:41:59.999763+0000","last_fullsized":"2024-09-12T01:41:59.999763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:03.967861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000870+0000","last_change":"2024-09-12T01:41:59.999881+0000","last_active":"2024-09-12T01:42:00.000870+0000","last_peered":"2024-09-12T01:42:00.000870+0000","last_clean":"2024-09-12T01:42:00.000870+0000","last_became_active":"2024-09-12T01:41:59.999548+0000","last_became_peered":"2024-09-12T01:41:59.999548+0000","last_unstale":"2024-09-12T01:42:00.000870+0000","last_undegraded":"2024-09-12T01:42:00.000870+0000","last_fullsized":"2024-09-12T01:42:00.000870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:42.985592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.012054+0000","last_change":"2024-09-12T01:42:00.011595+0000","last_active":"2024-09-12T01:42:00.012054+0000","last_peered":"2024-09-12T01:42:00.012054+0000","last_clean":"2024-09-12T01:42:00.012054+0000","last_became_active":"2024-09-12T01:42:00.011120+0000","last_became_peered":"2024-09-12T01:42:00.011120+0000","last_unstale":"2024-09-12T01:42:00.012054+0000","last_undegraded":"2024-09-12T01:42:00.012054+0000","last_fullsized":"2024-09-12T01:42:00.012054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.966780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003005+0000","last_change":"2024-09-12T01:42:00.002071+0000","last_active":"2024-09-12T01:42:00.003005+0000","last_peered":"2024-09-12T01:42:00.003005+0000","last_clean":"2024-09-12T01:42:00.003005+0000","last_became_active":"2024-09-12T01:42:00.001769+0000","last_became_peered":"2024-09-12T01:42:00.001769+0000","last_unstale":"2024-09-12T01:42:00.003005+0000","last_undegraded":"2024-09-12T01:42:00.003005+0000","last_fullsized":"2024-09-12T01:42:00.003005+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:08.962516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004120+0000","last_change":"2024-09-12T01:41:59.999861+0000","last_active":"2024-09-12T01:42:00.004120+0000","last_peered":"2024-09-12T01:42:00.004120+0000","last_clean":"2024-09-12T01:42:00.004120+0000","last_became_active":"2024-09-12T01:41:59.999585+0000","last_became_peered":"2024-09-12T01:41:59.999585+0000","last_unstale":"2024-09-12T01:42:00.004120+0000","last_undegraded":"2024-09-12T01:42:00.004120+0000","last_fullsized":"2024-09-12T01:42:00.004120+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:48.815524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005291+0000","last_change":"2024-09-12T01:42:00.003453+0000","last_active":"2024-09-12T01:42:00.005291+0000","last_peered":"2024-09-12T01:42:00.005291+0000","last_clean":"2024-09-12T01:42:00.005291+0000","last_became_active":"2024-09-12T01:42:00.003168+0000","last_became_peered":"2024-09-12T01:42:00.003168+0000","last_unstale":"2024-09-12T01:42:00.005291+0000","last_undegraded":"2024-09-12T01:42:00.005291+0000","last_fullsized":"2024-09-12T01:42:00.005291+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:54.408335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008225+0000","last_change":"2024-09-12T01:41:59.999888+0000","last_active":"2024-09-12T01:42:00.008225+0000","last_peered":"2024-09-12T01:42:00.008225+0000","last_clean":"2024-09-12T01:42:00.008225+0000","last_became_active":"2024-09-12T01:41:59.999191+0000","last_became_peered":"2024-09-12T01:41:59.999191+0000","last_unstale":"2024-09-12T01:42:00.008225+0000","last_undegraded":"2024-09-12T01:42:00.008225+0000","last_fullsized":"2024-09-12T01:42:00.008225+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:09.385413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008783+0000","last_change":"2024-09-12T01:42:00.000266+0000","last_active":"2024-09-12T01:42:00.008783+0000","last_peered":"2024-09-12T01:42:00.008783+0000","last_clean":"2024-09-12T01:42:00.008783+0000","last_became_active":"2024-09-12T01:42:00.000010+0000","last_became_peered":"2024-09-12T01:42:00.000010+0000","last_unstale":"2024-09-12T01:42:00.008783+0000","last_undegraded":"2024-09-12T01:42:00.008783+0000","last_fullsized":"2024-09-12T01:42:00.008783+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:58.296601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.999088+0000","last_change":"2024-09-12T01:41:59.996542+0000","last_active":"2024-09-12T01:41:59.999088+0000","last_peered":"2024-09-12T01:41:59.999088+0000","last_clean":"2024-09-12T01:41:59.999088+0000","last_became_active":"2024-09-12T01:41:59.996199+0000","last_became_peered":"2024-09-12T01:41:59.996199+0000","last_unstale":"2024-09-12T01:41:59.999088+0000","last_undegraded":"2024-09-12T01:41:59.999088+0000","last_fullsized":"2024-09-12T01:41:59.999088+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:29.618613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008916+0000","last_change":"2024-09-12T01:42:00.006742+0000","last_active":"2024-09-12T01:42:00.008916+0000","last_peered":"2024-09-12T01:42:00.008916+0000","last_clean":"2024-09-12T01:42:00.008916+0000","last_became_active":"2024-09-12T01:42:00.006366+0000","last_became_peered":"2024-09-12T01:42:00.006366+0000","last_unstale":"2024-09-12T01:42:00.008916+0000","last_undegraded":"2024-09-12T01:42:00.008916+0000","last_fullsized":"2024-09-12T01:42:00.008916+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:51.680001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008682+0000","last_change":"2024-09-12T01:42:00.000351+0000","last_active":"2024-09-12T01:42:00.008682+0000","last_peered":"2024-09-12T01:42:00.008682+0000","last_clean":"2024-09-12T01:42:00.008682+0000","last_became_active":"2024-09-12T01:41:59.999753+0000","last_became_peered":"2024-09-12T01:41:59.999753+0000","last_unstale":"2024-09-12T01:42:00.008682+0000","last_undegraded":"2024-09-12T01:42:00.008682+0000","last_fullsized":"2024-09-12T01:42:00.008682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:04.822297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.017795+0000","last_change":"2024-09-12T01:42:00.013386+0000","last_active":"2024-09-12T01:42:00.017795+0000","last_peered":"2024-09-12T01:42:00.017795+0000","last_clean":"2024-09-12T01:42:00.017795+0000","last_became_active":"2024-09-12T01:42:00.013088+0000","last_became_peered":"2024-09-12T01:42:00.013088+0000","last_unstale":"2024-09-12T01:42:00.017795+0000","last_undegraded":"2024-09-12T01:42:00.017795+0000","last_fullsized":"2024-09-12T01:42:00.017795+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:58.449274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000474+0000","last_change":"2024-09-12T01:41:59.994130+0000","last_active":"2024-09-12T01:42:00.000474+0000","last_peered":"2024-09-12T01:42:00.000474+0000","last_clean":"2024-09-12T01:42:00.000474+0000","last_became_active":"2024-09-12T01:41:59.993627+0000","last_became_peered":"2024-09-12T01:41:59.993627+0000","last_unstale":"2024-09-12T01:42:00.000474+0000","last_undegraded":"2024-09-12T01:42:00.000474+0000","last_fullsized":"2024-09-12T01:42:00.000474+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.582260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007599+0000","last_change":"2024-09-12T01:41:59.998620+0000","last_active":"2024-09-12T01:42:00.007599+0000","last_peered":"2024-09-12T01:42:00.007599+0000","last_clean":"2024-09-12T01:42:00.007599+0000","last_became_active":"2024-09-12T01:41:59.998314+0000","last_became_peered":"2024-09-12T01:41:59.998314+0000","last_unstale":"2024-09-12T01:42:00.007599+0000","last_undegraded":"2024-09-12T01:42:00.007599+0000","last_fullsized":"2024-09-12T01:42:00.007599+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:28.832878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.011785+0000","last_change":"2024-09-12T01:42:00.010724+0000","last_active":"2024-09-12T01:42:00.011785+0000","last_peered":"2024-09-12T01:42:00.011785+0000","last_clean":"2024-09-12T01:42:00.011785+0000","last_became_active":"2024-09-12T01:42:00.010364+0000","last_became_peered":"2024-09-12T01:42:00.010364+0000","last_unstale":"2024-09-12T01:42:00.011785+0000","last_undegraded":"2024-09-12T01:42:00.011785+0000","last_fullsized":"2024-09-12T01:42:00.011785+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:14.093956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004638+0000","last_change":"2024-09-12T01:42:00.003822+0000","last_active":"2024-09-12T01:42:00.004638+0000","last_peered":"2024-09-12T01:42:00.004638+0000","last_clean":"2024-09-12T01:42:00.004638+0000","last_became_active":"2024-09-12T01:42:00.003374+0000","last_became_peered":"2024-09-12T01:42:00.003374+0000","last_unstale":"2024-09-12T01:42:00.004638+0000","last_undegraded":"2024-09-12T01:42:00.004638+0000","last_fullsized":"2024-09-12T01:42:00.004638+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:28.832878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.996779+0000","last_change":"2024-09-12T01:41:59.995775+0000","last_active":"2024-09-12T01:41:59.996779+0000","last_peered":"2024-09-12T01:41:59.996779+0000","last_clean":"2024-09-12T01:41:59.996779+0000","last_became_active":"2024-09-12T01:41:59.995503+0000","last_became_peered":"2024-09-12T01:41:59.995503+0000","last_unstale":"2024-09-12T01:41:59.996779+0000","last_undegraded":"2024-09-12T01:41:59.996779+0000","last_fullsized":"2024-09-12T01:41:59.996779+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:34.971636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004779+0000","last_change":"2024-09-12T01:42:00.003066+0000","last_active":"2024-09-12T01:42:00.004779+0000","last_peered":"2024-09-12T01:42:00.004779+0000","last_clean":"2024-09-12T01:42:00.004779+0000","last_became_active":"2024-09-12T01:42:00.002796+0000","last_became_peered":"2024-09-12T01:42:00.002796+0000","last_unstale":"2024-09-12T01:42:00.004779+0000","last_undegraded":"2024-09-12T01:42:00.004779+0000","last_fullsized":"2024-09-12T01:42:00.004779+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:23.856078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004651+0000","last_change":"2024-09-12T01:41:59.995567+0000","last_active":"2024-09-12T01:42:00.004651+0000","last_peered":"2024-09-12T01:42:00.004651+0000","last_clean":"2024-09-12T01:42:00.004651+0000","last_became_active":"2024-09-12T01:41:59.995275+0000","last_became_peered":"2024-09-12T01:41:59.995275+0000","last_unstale":"2024-09-12T01:42:00.004651+0000","last_undegraded":"2024-09-12T01:42:00.004651+0000","last_fullsized":"2024-09-12T01:42:00.004651+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:13.659299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007006+0000","last_change":"2024-09-12T01:42:00.004709+0000","last_active":"2024-09-12T01:42:00.007006+0000","last_peered":"2024-09-12T01:42:00.007006+0000","last_clean":"2024-09-12T01:42:00.007006+0000","last_became_active":"2024-09-12T01:42:00.004413+0000","last_became_peered":"2024-09-12T01:42:00.004413+0000","last_unstale":"2024-09-12T01:42:00.007006+0000","last_undegraded":"2024-09-12T01:42:00.007006+0000","last_fullsized":"2024-09-12T01:42:00.007006+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:14.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003886+0000","last_change":"2024-09-12T01:42:00.001460+0000","last_active":"2024-09-12T01:42:00.003886+0000","last_peered":"2024-09-12T01:42:00.003886+0000","last_clean":"2024-09-12T01:42:00.003886+0000","last_became_active":"2024-09-12T01:42:00.001111+0000","last_became_peered":"2024-09-12T01:42:00.001111+0000","last_unstale":"2024-09-12T01:42:00.003886+0000","last_undegraded":"2024-09-12T01:42:00.003886+0000","last_fullsized":"2024-09-12T01:42:00.003886+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:28.435193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015473+0000","last_change":"2024-09-12T01:42:00.010691+0000","last_active":"2024-09-12T01:42:00.015473+0000","last_peered":"2024-09-12T01:42:00.015473+0000","last_clean":"2024-09-12T01:42:00.015473+0000","last_became_active":"2024-09-12T01:42:00.010426+0000","last_became_peered":"2024-09-12T01:42:00.010426+0000","last_unstale":"2024-09-12T01:42:00.015473+0000","last_undegraded":"2024-09-12T01:42:00.015473+0000","last_fullsized":"2024-09-12T01:42:00.015473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:53.113663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007551+0000","last_change":"2024-09-12T01:42:00.002800+0000","last_active":"2024-09-12T01:42:00.007551+0000","last_peered":"2024-09-12T01:42:00.007551+0000","last_clean":"2024-09-12T01:42:00.007551+0000","last_became_active":"2024-09-12T01:42:00.002533+0000","last_became_peered":"2024-09-12T01:42:00.002533+0000","last_unstale":"2024-09-12T01:42:00.007551+0000","last_undegraded":"2024-09-12T01:42:00.007551+0000","last_fullsized":"2024-09-12T01:42:00.007551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:46.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"91'4","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.001313+0000","last_change":"2024-09-12T01:41:58.988426+0000","last_active":"2024-09-12T01:42:00.001313+0000","last_peered":"2024-09-12T01:42:00.001313+0000","last_clean":"2024-09-12T01:42:00.001313+0000","last_became_active":"2024-09-12T01:41:58.988130+0000","last_became_peered":"2024-09-12T01:41:58.988130+0000","last_unstale":"2024-09-12T01:42:00.001313+0000","last_undegraded":"2024-09-12T01:42:00.001313+0000","last_fullsized":"2024-09-12T01:42:00.001313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:19.475865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005320+0000","last_change":"2024-09-12T01:42:00.004520+0000","last_active":"2024-09-12T01:42:00.005320+0000","last_peered":"2024-09-12T01:42:00.005320+0000","last_clean":"2024-09-12T01:42:00.005320+0000","last_became_active":"2024-09-12T01:42:00.004193+0000","last_became_peered":"2024-09-12T01:42:00.004193+0000","last_unstale":"2024-09-12T01:42:00.005320+0000","last_undegraded":"2024-09-12T01:42:00.005320+0000","last_fullsized":"2024-09-12T01:42:00.005320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:33.609574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.998645+0000","last_change":"2024-09-12T01:41:58.992984+0000","last_active":"2024-09-12T01:41:59.998645+0000","last_peered":"2024-09-12T01:41:59.998645+0000","last_clean":"2024-09-12T01:41:59.998645+0000","last_became_active":"2024-09-12T01:41:58.992669+0000","last_became_peered":"2024-09-12T01:41:58.992669+0000","last_unstale":"2024-09-12T01:41:59.998645+0000","last_undegraded":"2024-09-12T01:41:59.998645+0000","last_fullsized":"2024-09-12T01:41:59.998645+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.589596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.010165+0000","last_change":"2024-09-12T01:42:00.008281+0000","last_active":"2024-09-12T01:42:00.010165+0000","last_peered":"2024-09-12T01:42:00.010165+0000","last_clean":"2024-09-12T01:42:00.010165+0000","last_became_active":"2024-09-12T01:42:00.007920+0000","last_became_peered":"2024-09-12T01:42:00.007920+0000","last_unstale":"2024-09-12T01:42:00.010165+0000","last_undegraded":"2024-09-12T01:42:00.010165+0000","last_fullsized":"2024-09-12T01:42:00.010165+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:13.659299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980490+0000","last_change":"2024-09-12T01:41:57.980490+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980490+0000","last_undegraded":"2024-09-12T01:41:57.980490+0000","last_fullsized":"2024-09-12T01:41:57.980490+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008227+0000","last_change":"2024-09-12T01:42:00.007543+0000","last_active":"2024-09-12T01:42:00.008227+0000","last_peered":"2024-09-12T01:42:00.008227+0000","last_clean":"2024-09-12T01:42:00.008227+0000","last_became_active":"2024-09-12T01:42:00.006466+0000","last_became_peered":"2024-09-12T01:42:00.006466+0000","last_unstale":"2024-09-12T01:42:00.008227+0000","last_undegraded":"2024-09-12T01:42:00.008227+0000","last_fullsized":"2024-09-12T01:42:00.008227+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:09.385413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.009099+0000","last_change":"2024-09-12T01:41:58.997786+0000","last_active":"2024-09-12T01:42:00.009099+0000","last_peered":"2024-09-12T01:42:00.009099+0000","last_clean":"2024-09-12T01:42:00.009099+0000","last_became_active":"2024-09-12T01:41:58.997540+0000","last_became_peered":"2024-09-12T01:41:58.997540+0000","last_unstale":"2024-09-12T01:42:00.009099+0000","last_undegraded":"2024-09-12T01:42:00.009099+0000","last_fullsized":"2024-09-12T01:42:00.009099+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:14.484863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000498+0000","last_change":"2024-09-12T01:41:59.993413+0000","last_active":"2024-09-12T01:42:00.000498+0000","last_peered":"2024-09-12T01:42:00.000498+0000","last_clean":"2024-09-12T01:42:00.000498+0000","last_became_active":"2024-09-12T01:41:59.992374+0000","last_became_peered":"2024-09-12T01:41:59.992374+0000","last_unstale":"2024-09-12T01:42:00.000498+0000","last_undegraded":"2024-09-12T01:42:00.000498+0000","last_fullsized":"2024-09-12T01:42:00.000498+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:26.760592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.011460+0000","last_change":"2024-09-12T01:41:58.996374+0000","last_active":"2024-09-12T01:42:00.011460+0000","last_peered":"2024-09-12T01:42:00.011460+0000","last_clean":"2024-09-12T01:42:00.011460+0000","last_became_active":"2024-09-12T01:41:58.996057+0000","last_became_peered":"2024-09-12T01:41:58.996057+0000","last_unstale":"2024-09-12T01:42:00.011460+0000","last_undegraded":"2024-09-12T01:42:00.011460+0000","last_fullsized":"2024-09-12T01:42:00.011460+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:53.915640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.999122+0000","last_change":"2024-09-12T01:41:59.995738+0000","last_active":"2024-09-12T01:41:59.999122+0000","last_peered":"2024-09-12T01:41:59.999122+0000","last_clean":"2024-09-12T01:41:59.999122+0000","last_became_active":"2024-09-12T01:41:59.995444+0000","last_became_peered":"2024-09-12T01:41:59.995444+0000","last_unstale":"2024-09-12T01:41:59.999122+0000","last_undegraded":"2024-09-12T01:41:59.999122+0000","last_fullsized":"2024-09-12T01:41:59.999122+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:14.525743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980754+0000","last_change":"2024-09-12T01:41:57.980754+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980754+0000","last_undegraded":"2024-09-12T01:41:57.980754+0000","last_fullsized":"2024-09-12T01:41:57.980754+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.006976+0000","last_change":"2024-09-12T01:42:00.005090+0000","last_active":"2024-09-12T01:42:00.006976+0000","last_peered":"2024-09-12T01:42:00.006976+0000","last_clean":"2024-09-12T01:42:00.006976+0000","last_became_active":"2024-09-12T01:42:00.004601+0000","last_became_peered":"2024-09-12T01:42:00.004601+0000","last_unstale":"2024-09-12T01:42:00.006976+0000","last_undegraded":"2024-09-12T01:42:00.006976+0000","last_fullsized":"2024-09-12T01:42:00.006976+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:47.262836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.990294+0000","last_change":"2024-09-12T01:41:58.989687+0000","last_active":"2024-09-12T01:41:59.990294+0000","last_peered":"2024-09-12T01:41:59.990294+0000","last_clean":"2024-09-12T01:41:59.990294+0000","last_became_active":"2024-09-12T01:41:58.989372+0000","last_became_peered":"2024-09-12T01:41:58.989372+0000","last_unstale":"2024-09-12T01:41:59.990294+0000","last_undegraded":"2024-09-12T01:41:59.990294+0000","last_fullsized":"2024-09-12T01:41:59.990294+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:00.390233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000300+0000","last_change":"2024-09-12T01:41:59.991854+0000","last_active":"2024-09-12T01:42:00.000300+0000","last_peered":"2024-09-12T01:42:00.000300+0000","last_clean":"2024-09-12T01:42:00.000300+0000","last_became_active":"2024-09-12T01:41:59.991577+0000","last_became_peered":"2024-09-12T01:41:59.991577+0000","last_unstale":"2024-09-12T01:42:00.000300+0000","last_undegraded":"2024-09-12T01:42:00.000300+0000","last_fullsized":"2024-09-12T01:42:00.000300+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:13.714369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.994992+0000","last_change":"2024-09-12T01:41:58.997889+0000","last_active":"2024-09-12T01:41:59.994992+0000","last_peered":"2024-09-12T01:41:59.994992+0000","last_clean":"2024-09-12T01:41:59.994992+0000","last_became_active":"2024-09-12T01:41:58.997469+0000","last_became_peered":"2024-09-12T01:41:58.997469+0000","last_unstale":"2024-09-12T01:41:59.994992+0000","last_undegraded":"2024-09-12T01:41:59.994992+0000","last_fullsized":"2024-09-12T01:41:59.994992+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:22.853882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015512+0000","last_change":"2024-09-12T01:42:00.010808+0000","last_active":"2024-09-12T01:42:00.015512+0000","last_peered":"2024-09-12T01:42:00.015512+0000","last_clean":"2024-09-12T01:42:00.015512+0000","last_became_active":"2024-09-12T01:42:00.010535+0000","last_became_peered":"2024-09-12T01:42:00.010535+0000","last_unstale":"2024-09-12T01:42:00.015512+0000","last_undegraded":"2024-09-12T01:42:00.015512+0000","last_fullsized":"2024-09-12T01:42:00.015512+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:01.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980744+0000","last_change":"2024-09-12T01:41:57.980744+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980744+0000","last_undegraded":"2024-09-12T01:41:57.980744+0000","last_fullsized":"2024-09-12T01:41:57.980744+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.002425+0000","last_change":"2024-09-12T01:41:59.996189+0000","last_active":"2024-09-12T01:42:00.002425+0000","last_peered":"2024-09-12T01:42:00.002425+0000","last_clean":"2024-09-12T01:42:00.002425+0000","last_became_active":"2024-09-12T01:41:59.995894+0000","last_became_peered":"2024-09-12T01:41:59.995894+0000","last_unstale":"2024-09-12T01:42:00.002425+0000","last_undegraded":"2024-09-12T01:42:00.002425+0000","last_fullsized":"2024-09-12T01:42:00.002425+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:53.113663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.985390+0000","last_change":"2024-09-12T01:41:58.996582+0000","last_active":"2024-09-12T01:41:59.985390+0000","last_peered":"2024-09-12T01:41:59.985390+0000","last_clean":"2024-09-12T01:41:59.985390+0000","last_became_active":"2024-09-12T01:41:58.996289+0000","last_became_peered":"2024-09-12T01:41:58.996289+0000","last_unstale":"2024-09-12T01:41:59.985390+0000","last_undegraded":"2024-09-12T01:41:59.985390+0000","last_fullsized":"2024-09-12T01:41:59.985390+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:45.266662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.009813+0000","last_change":"2024-09-12T01:42:00.009375+0000","last_active":"2024-09-12T01:42:00.009813+0000","last_peered":"2024-09-12T01:42:00.009813+0000","last_clean":"2024-09-12T01:42:00.009813+0000","last_became_active":"2024-09-12T01:42:00.009071+0000","last_became_peered":"2024-09-12T01:42:00.009071+0000","last_unstale":"2024-09-12T01:42:00.009813+0000","last_undegraded":"2024-09-12T01:42:00.009813+0000","last_fullsized":"2024-09-12T01:42:00.009813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:13.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"91'3","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005079+0000","last_change":"2024-09-12T01:41:58.992505+0000","last_active":"2024-09-12T01:42:00.005079+0000","last_peered":"2024-09-12T01:42:00.005079+0000","last_clean":"2024-09-12T01:42:00.005079+0000","last_became_active":"2024-09-12T01:41:58.992076+0000","last_became_peered":"2024-09-12T01:41:58.992076+0000","last_unstale":"2024-09-12T01:42:00.005079+0000","last_undegraded":"2024-09-12T01:42:00.005079+0000","last_fullsized":"2024-09-12T01:42:00.005079+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:15.078082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004528+0000","last_change":"2024-09-12T01:42:00.002167+0000","last_active":"2024-09-12T01:42:00.004528+0000","last_peered":"2024-09-12T01:42:00.004528+0000","last_clean":"2024-09-12T01:42:00.004528+0000","last_became_active":"2024-09-12T01:42:00.001838+0000","last_became_peered":"2024-09-12T01:42:00.001838+0000","last_unstale":"2024-09-12T01:42:00.004528+0000","last_undegraded":"2024-09-12T01:42:00.004528+0000","last_fullsized":"2024-09-12T01:42:00.004528+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:57.416935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"91'6","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015524+0000","last_change":"2024-09-12T01:41:58.996508+0000","last_active":"2024-09-12T01:42:00.015524+0000","last_peered":"2024-09-12T01:42:00.015524+0000","last_clean":"2024-09-12T01:42:00.015524+0000","last_became_active":"2024-09-12T01:41:58.995956+0000","last_became_peered":"2024-09-12T01:41:58.995956+0000","last_unstale":"2024-09-12T01:42:00.015524+0000","last_undegraded":"2024-09-12T01:42:00.015524+0000","last_fullsized":"2024-09-12T01:42:00.015524+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:55.108765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008246+0000","last_change":"2024-09-12T01:41:59.999914+0000","last_active":"2024-09-12T01:42:00.008246+0000","last_peered":"2024-09-12T01:42:00.008246+0000","last_clean":"2024-09-12T01:42:00.008246+0000","last_became_active":"2024-09-12T01:41:59.999540+0000","last_became_peered":"2024-09-12T01:41:59.999540+0000","last_unstale":"2024-09-12T01:42:00.008246+0000","last_undegraded":"2024-09-12T01:42:00.008246+0000","last_fullsized":"2024-09-12T01:42:00.008246+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.966780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007201+0000","last_change":"2024-09-12T01:41:58.991672+0000","last_active":"2024-09-12T01:42:00.007201+0000","last_peered":"2024-09-12T01:42:00.007201+0000","last_clean":"2024-09-12T01:42:00.007201+0000","last_became_active":"2024-09-12T01:41:58.991363+0000","last_became_peered":"2024-09-12T01:41:58.991363+0000","last_unstale":"2024-09-12T01:42:00.007201+0000","last_undegraded":"2024-09-12T01:42:00.007201+0000","last_fullsized":"2024-09-12T01:42:00.007201+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:24.678504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.985648+0000","last_change":"2024-09-12T01:41:58.996856+0000","last_active":"2024-09-12T01:41:59.985648+0000","last_peered":"2024-09-12T01:41:59.985648+0000","last_clean":"2024-09-12T01:41:59.985648+0000","last_became_active":"2024-09-12T01:41:58.995624+0000","last_became_peered":"2024-09-12T01:41:58.995624+0000","last_unstale":"2024-09-12T01:41:59.985648+0000","last_undegraded":"2024-09-12T01:41:59.985648+0000","last_fullsized":"2024-09-12T01:41:59.985648+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:06.324090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.998809+0000","last_change":"2024-09-12T01:41:59.993089+0000","last_active":"2024-09-12T01:41:59.998809+0000","last_peered":"2024-09-12T01:41:59.998809+0000","last_clean":"2024-09-12T01:41:59.998809+0000","last_became_active":"2024-09-12T01:41:59.992817+0000","last_became_peered":"2024-09-12T01:41:59.992817+0000","last_unstale":"2024-09-12T01:41:59.998809+0000","last_undegraded":"2024-09-12T01:41:59.998809+0000","last_fullsized":"2024-09-12T01:41:59.998809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:46.214683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.984192+0000","last_change":"2024-09-12T01:41:58.993719+0000","last_active":"2024-09-12T01:41:59.984192+0000","last_peered":"2024-09-12T01:41:59.984192+0000","last_clean":"2024-09-12T01:41:59.984192+0000","last_became_active":"2024-09-12T01:41:58.993224+0000","last_became_peered":"2024-09-12T01:41:58.993224+0000","last_unstale":"2024-09-12T01:41:59.984192+0000","last_undegraded":"2024-09-12T01:41:59.984192+0000","last_fullsized":"2024-09-12T01:41:59.984192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:58.987546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"91'8","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.011250+0000","last_change":"2024-09-12T01:41:58.991776+0000","last_active":"2024-09-12T01:42:00.011250+0000","last_peered":"2024-09-12T01:42:00.011250+0000","last_clean":"2024-09-12T01:42:00.011250+0000","last_became_active":"2024-09-12T01:41:58.991511+0000","last_became_peered":"2024-09-12T01:41:58.991511+0000","last_unstale":"2024-09-12T01:42:00.011250+0000","last_undegraded":"2024-09-12T01:42:00.011250+0000","last_fullsized":"2024-09-12T01:42:00.011250+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.831543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.991264+0000","last_change":"2024-09-12T01:41:59.987898+0000","last_active":"2024-09-12T01:41:59.991264+0000","last_peered":"2024-09-12T01:41:59.991264+0000","last_clean":"2024-09-12T01:41:59.991264+0000","last_became_active":"2024-09-12T01:41:59.987625+0000","last_became_peered":"2024-09-12T01:41:59.987625+0000","last_unstale":"2024-09-12T01:41:59.991264+0000","last_undegraded":"2024-09-12T01:41:59.991264+0000","last_fullsized":"2024-09-12T01:41:59.991264+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:04.822297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.001058+0000","last_change":"2024-09-12T01:41:58.996161+0000","last_active":"2024-09-12T01:42:00.001058+0000","last_peered":"2024-09-12T01:42:00.001058+0000","last_clean":"2024-09-12T01:42:00.001058+0000","last_became_active":"2024-09-12T01:41:58.995854+0000","last_became_peered":"2024-09-12T01:41:58.995854+0000","last_unstale":"2024-09-12T01:42:00.001058+0000","last_undegraded":"2024-09-12T01:42:00.001058+0000","last_fullsized":"2024-09-12T01:42:00.001058+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:04.272253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.996013+0000","last_change":"2024-09-12T01:41:59.992362+0000","last_active":"2024-09-12T01:41:59.996013+0000","last_peered":"2024-09-12T01:41:59.996013+0000","last_clean":"2024-09-12T01:41:59.996013+0000","last_became_active":"2024-09-12T01:41:59.992048+0000","last_became_peered":"2024-09-12T01:41:59.992048+0000","last_unstale":"2024-09-12T01:41:59.996013+0000","last_undegraded":"2024-09-12T01:41:59.996013+0000","last_fullsized":"2024-09-12T01:41:59.996013+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:37.604923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003203+0000","last_change":"2024-09-12T01:41:58.990373+0000","last_active":"2024-09-12T01:42:00.003203+0000","last_peered":"2024-09-12T01:42:00.003203+0000","last_clean":"2024-09-12T01:42:00.003203+0000","last_became_active":"2024-09-12T01:41:58.990079+0000","last_became_peered":"2024-09-12T01:41:58.990079+0000","last_unstale":"2024-09-12T01:42:00.003203+0000","last_undegraded":"2024-09-12T01:42:00.003203+0000","last_fullsized":"2024-09-12T01:42:00.003203+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:03.731788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003934+0000","last_change":"2024-09-12T01:41:59.999108+0000","last_active":"2024-09-12T01:42:00.003934+0000","last_peered":"2024-09-12T01:42:00.003934+0000","last_clean":"2024-09-12T01:42:00.003934+0000","last_became_active":"2024-09-12T01:41:59.998824+0000","last_became_peered":"2024-09-12T01:41:59.998824+0000","last_unstale":"2024-09-12T01:42:00.003934+0000","last_undegraded":"2024-09-12T01:42:00.003934+0000","last_fullsized":"2024-09-12T01:42:00.003934+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:54.917836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.994358+0000","last_change":"2024-09-12T01:41:58.997460+0000","last_active":"2024-09-12T01:41:59.994358+0000","last_peered":"2024-09-12T01:41:59.994358+0000","last_clean":"2024-09-12T01:41:59.994358+0000","last_became_active":"2024-09-12T01:41:58.996445+0000","last_became_peered":"2024-09-12T01:41:58.996445+0000","last_unstale":"2024-09-12T01:41:59.994358+0000","last_undegraded":"2024-09-12T01:41:59.994358+0000","last_fullsized":"2024-09-12T01:41:59.994358+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:56.414738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005924+0000","last_change":"2024-09-12T01:41:59.999188+0000","last_active":"2024-09-12T01:42:00.005924+0000","last_peered":"2024-09-12T01:42:00.005924+0000","last_clean":"2024-09-12T01:42:00.005924+0000","last_became_active":"2024-09-12T01:41:59.998893+0000","last_became_peered":"2024-09-12T01:41:59.998893+0000","last_unstale":"2024-09-12T01:42:00.005924+0000","last_undegraded":"2024-09-12T01:42:00.005924+0000","last_fullsized":"2024-09-12T01:42:00.005924+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:20.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.012686+0000","last_change":"2024-09-12T01:41:58.997143+0000","last_active":"2024-09-12T01:42:00.012686+0000","last_peered":"2024-09-12T01:42:00.012686+0000","last_clean":"2024-09-12T01:42:00.012686+0000","last_became_active":"2024-09-12T01:41:58.996881+0000","last_became_peered":"2024-09-12T01:41:58.996881+0000","last_unstale":"2024-09-12T01:42:00.012686+0000","last_undegraded":"2024-09-12T01:42:00.012686+0000","last_fullsized":"2024-09-12T01:42:00.012686+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:47.813327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.006138+0000","last_change":"2024-09-12T01:42:00.001287+0000","last_active":"2024-09-12T01:42:00.006138+0000","last_peered":"2024-09-12T01:42:00.006138+0000","last_clean":"2024-09-12T01:42:00.006138+0000","last_became_active":"2024-09-12T01:42:00.001027+0000","last_became_peered":"2024-09-12T01:42:00.001027+0000","last_unstale":"2024-09-12T01:42:00.006138+0000","last_undegraded":"2024-09-12T01:42:00.006138+0000","last_fullsized":"2024-09-12T01:42:00.006138+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:36.937083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.981356+0000","last_change":"2024-09-12T01:41:58.992864+0000","last_active":"2024-09-12T01:41:59.981356+0000","last_peered":"2024-09-12T01:41:59.981356+0000","last_clean":"2024-09-12T01:41:59.981356+0000","last_became_active":"2024-09-12T01:41:58.992587+0000","last_became_peered":"2024-09-12T01:41:58.992587+0000","last_unstale":"2024-09-12T01:41:59.981356+0000","last_undegraded":"2024-09-12T01:41:59.981356+0000","last_fullsized":"2024-09-12T01:41:59.981356+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:08.383216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008733+0000","last_change":"2024-09-12T01:42:00.002542+0000","last_active":"2024-09-12T01:42:00.008733+0000","last_peered":"2024-09-12T01:42:00.008733+0000","last_clean":"2024-09-12T01:42:00.008733+0000","last_became_active":"2024-09-12T01:42:00.002208+0000","last_became_peered":"2024-09-12T01:42:00.002208+0000","last_unstale":"2024-09-12T01:42:00.008733+0000","last_undegraded":"2024-09-12T01:42:00.008733+0000","last_fullsized":"2024-09-12T01:42:00.008733+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:37.604923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.990699+0000","last_change":"2024-09-12T01:41:58.993285+0000","last_active":"2024-09-12T01:41:59.990699+0000","last_peered":"2024-09-12T01:41:59.990699+0000","last_clean":"2024-09-12T01:41:59.990699+0000","last_became_active":"2024-09-12T01:41:58.992941+0000","last_became_peered":"2024-09-12T01:41:58.992941+0000","last_unstale":"2024-09-12T01:41:59.990699+0000","last_undegraded":"2024-09-12T01:41:59.990699+0000","last_fullsized":"2024-09-12T01:41:59.990699+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.964417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004722+0000","last_change":"2024-09-12T01:41:59.998894+0000","last_active":"2024-09-12T01:42:00.004722+0000","last_peered":"2024-09-12T01:42:00.004722+0000","last_clean":"2024-09-12T01:42:00.004722+0000","last_became_active":"2024-09-12T01:41:59.998534+0000","last_became_peered":"2024-09-12T01:41:59.998534+0000","last_unstale":"2024-09-12T01:42:00.004722+0000","last_undegraded":"2024-09-12T01:42:00.004722+0000","last_fullsized":"2024-09-12T01:42:00.004722+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:01.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.982273+0000","last_change":"2024-09-12T01:41:57.982273+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.982273+0000","last_undegraded":"2024-09-12T01:41:57.982273+0000","last_fullsized":"2024-09-12T01:41:57.982273+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008881+0000","last_change":"2024-09-12T01:42:00.007206+0000","last_active":"2024-09-12T01:42:00.008881+0000","last_peered":"2024-09-12T01:42:00.008881+0000","last_clean":"2024-09-12T01:42:00.008881+0000","last_became_active":"2024-09-12T01:42:00.006901+0000","last_became_peered":"2024-09-12T01:42:00.006901+0000","last_unstale":"2024-09-12T01:42:00.008881+0000","last_undegraded":"2024-09-12T01:42:00.008881+0000","last_fullsized":"2024-09-12T01:42:00.008881+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:14.401142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003602+0000","last_change":"2024-09-12T01:41:58.996435+0000","last_active":"2024-09-12T01:42:00.003602+0000","last_peered":"2024-09-12T01:42:00.003602+0000","last_clean":"2024-09-12T01:42:00.003602+0000","last_became_active":"2024-09-12T01:41:58.995490+0000","last_became_peered":"2024-09-12T01:41:58.995490+0000","last_unstale":"2024-09-12T01:42:00.003602+0000","last_undegraded":"2024-09-12T01:42:00.003602+0000","last_fullsized":"2024-09-12T01:42:00.003602+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:24.184298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.018020+0000","last_change":"2024-09-12T01:42:00.016030+0000","last_active":"2024-09-12T01:42:00.018020+0000","last_peered":"2024-09-12T01:42:00.018020+0000","last_clean":"2024-09-12T01:42:00.018020+0000","last_became_active":"2024-09-12T01:42:00.015719+0000","last_became_peered":"2024-09-12T01:42:00.015719+0000","last_unstale":"2024-09-12T01:42:00.018020+0000","last_undegraded":"2024-09-12T01:42:00.018020+0000","last_fullsized":"2024-09-12T01:42:00.018020+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.988766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.995667+0000","last_change":"2024-09-12T01:41:58.993546+0000","last_active":"2024-09-12T01:41:59.995667+0000","last_peered":"2024-09-12T01:41:59.995667+0000","last_clean":"2024-09-12T01:41:59.995667+0000","last_became_active":"2024-09-12T01:41:58.992168+0000","last_became_peered":"2024-09-12T01:41:58.992168+0000","last_unstale":"2024-09-12T01:41:59.995667+0000","last_undegraded":"2024-09-12T01:41:59.995667+0000","last_fullsized":"2024-09-12T01:41:59.995667+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:11.336252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.995016+0000","last_change":"2024-09-12T01:41:58.994382+0000","last_active":"2024-09-12T01:41:59.995016+0000","last_peered":"2024-09-12T01:41:59.995016+0000","last_clean":"2024-09-12T01:41:59.995016+0000","last_became_active":"2024-09-12T01:41:58.994094+0000","last_became_peered":"2024-09-12T01:41:58.994094+0000","last_unstale":"2024-09-12T01:41:59.995016+0000","last_undegraded":"2024-09-12T01:41:59.995016+0000","last_fullsized":"2024-09-12T01:41:59.995016+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:13.091759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005149+0000","last_change":"2024-09-12T01:42:00.004296+0000","last_active":"2024-09-12T01:42:00.005149+0000","last_peered":"2024-09-12T01:42:00.005149+0000","last_clean":"2024-09-12T01:42:00.005149+0000","last_became_active":"2024-09-12T01:42:00.004039+0000","last_became_peered":"2024-09-12T01:42:00.004039+0000","last_unstale":"2024-09-12T01:42:00.005149+0000","last_undegraded":"2024-09-12T01:42:00.005149+0000","last_fullsized":"2024-09-12T01:42:00.005149+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:20.951224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.982305+0000","last_change":"2024-09-12T01:41:58.992765+0000","last_active":"2024-09-12T01:41:59.982305+0000","last_peered":"2024-09-12T01:41:59.982305+0000","last_clean":"2024-09-12T01:41:59.982305+0000","last_became_active":"2024-09-12T01:41:58.992493+0000","last_became_peered":"2024-09-12T01:41:58.992493+0000","last_unstale":"2024-09-12T01:41:59.982305+0000","last_undegraded":"2024-09-12T01:41:59.982305+0000","last_fullsized":"2024-09-12T01:41:59.982305+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:57.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005979+0000","last_change":"2024-09-12T01:42:00.000490+0000","last_active":"2024-09-12T01:42:00.005979+0000","last_peered":"2024-09-12T01:42:00.005979+0000","last_clean":"2024-09-12T01:42:00.005979+0000","last_became_active":"2024-09-12T01:41:59.996026+0000","last_became_peered":"2024-09-12T01:41:59.996026+0000","last_unstale":"2024-09-12T01:42:00.005979+0000","last_undegraded":"2024-09-12T01:42:00.005979+0000","last_fullsized":"2024-09-12T01:42:00.005979+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:26.698973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980607+0000","last_change":"2024-09-12T01:41:57.980607+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980607+0000","last_undegraded":"2024-09-12T01:41:57.980607+0000","last_fullsized":"2024-09-12T01:41:57.980607+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000900+0000","last_change":"2024-09-12T01:41:59.999997+0000","last_active":"2024-09-12T01:42:00.000900+0000","last_peered":"2024-09-12T01:42:00.000900+0000","last_clean":"2024-09-12T01:42:00.000900+0000","last_became_active":"2024-09-12T01:41:59.999544+0000","last_became_peered":"2024-09-12T01:41:59.999544+0000","last_unstale":"2024-09-12T01:42:00.000900+0000","last_undegraded":"2024-09-12T01:42:00.000900+0000","last_fullsized":"2024-09-12T01:42:00.000900+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:41.234974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.981931+0000","last_change":"2024-09-12T01:41:58.994797+0000","last_active":"2024-09-12T01:41:59.981931+0000","last_peered":"2024-09-12T01:41:59.981931+0000","last_clean":"2024-09-12T01:41:59.981931+0000","last_became_active":"2024-09-12T01:41:58.994442+0000","last_became_peered":"2024-09-12T01:41:58.994442+0000","last_unstale":"2024-09-12T01:41:59.981931+0000","last_undegraded":"2024-09-12T01:41:59.981931+0000","last_fullsized":"2024-09-12T01:41:59.981931+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:01.964583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007888+0000","last_change":"2024-09-12T01:42:00.006100+0000","last_active":"2024-09-12T01:42:00.007888+0000","last_peered":"2024-09-12T01:42:00.007888+0000","last_clean":"2024-09-12T01:42:00.007888+0000","last_became_active":"2024-09-12T01:42:00.005681+0000","last_became_peered":"2024-09-12T01:42:00.005681+0000","last_unstale":"2024-09-12T01:42:00.007888+0000","last_undegraded":"2024-09-12T01:42:00.007888+0000","last_fullsized":"2024-09-12T01:42:00.007888+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:23.838485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.991151+0000","last_change":"2024-09-12T01:41:58.996497+0000","last_active":"2024-09-12T01:41:59.991151+0000","last_peered":"2024-09-12T01:41:59.991151+0000","last_clean":"2024-09-12T01:41:59.991151+0000","last_became_active":"2024-09-12T01:41:58.996200+0000","last_became_peered":"2024-09-12T01:41:58.996200+0000","last_unstale":"2024-09-12T01:41:59.991151+0000","last_undegraded":"2024-09-12T01:41:59.991151+0000","last_fullsized":"2024-09-12T01:41:59.991151+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:40.919309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003931+0000","last_change":"2024-09-12T01:41:59.997655+0000","last_active":"2024-09-12T01:42:00.003931+0000","last_peered":"2024-09-12T01:42:00.003931+0000","last_clean":"2024-09-12T01:42:00.003931+0000","last_became_active":"2024-09-12T01:41:59.997190+0000","last_became_peered":"2024-09-12T01:41:59.997190+0000","last_unstale":"2024-09-12T01:42:00.003931+0000","last_undegraded":"2024-09-12T01:42:00.003931+0000","last_fullsized":"2024-09-12T01:42:00.003931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:24.280195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980479+0000","last_change":"2024-09-12T01:41:57.980479+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980479+0000","last_undegraded":"2024-09-12T01:41:57.980479+0000","last_fullsized":"2024-09-12T01:41:57.980479+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007123+0000","last_change":"2024-09-12T01:41:58.996923+0000","last_active":"2024-09-12T01:42:00.007123+0000","last_peered":"2024-09-12T01:42:00.007123+0000","last_clean":"2024-09-12T01:42:00.007123+0000","last_became_active":"2024-09-12T01:41:58.996587+0000","last_became_peered":"2024-09-12T01:41:58.996587+0000","last_unstale":"2024-09-12T01:42:00.007123+0000","last_undegraded":"2024-09-12T01:42:00.007123+0000","last_fullsized":"2024-09-12T01:42:00.007123+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:22.567888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":300,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.984018+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:41:59.984018+0000","last_peered":"2024-09-12T01:41:59.984018+0000","last_clean":"2024-09-12T01:41:59.984018+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:41:59.984018+0000","last_undegraded":"2024-09-12T01:41:59.984018+0000","last_fullsized":"2024-09-12T01:41:59.984018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":7},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509520,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1122304,"data_stored":470654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509518,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":470072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509518,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1732608,"data_stored":1062108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1130496,"data_stored":470266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36432,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335408,"statfs":{"total":96636764160,"available":96599457792,"internally_reserved":0,"allocated":1105920,"data_stored":463297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37012,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334828,"statfs":{"total":96636764160,"available":96598863872,"internally_reserved":0,"allocated":1699840,"data_stored":1053665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36440,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335400,"statfs":{"total":96636764160,"available":96599449600,"internally_reserved":0,"allocated":1118208,"data_stored":470072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1093632,"data_stored":457022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:42:03.331 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:42:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.470+0000 7f3a07b11640 1 Processor -- start 2024-09-12T01:42:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.470+0000 7f3a07b11640 1 -- start start 2024-09-12T01:42:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a07b11640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3a000b63d0 0x7f3a000d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a07b11640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a000cf6b0 0x7f3a000b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a07b11640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a000cfc20 con 0x7f3a000d1c80 2024-09-12T01:42:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a07b11640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3a000d2ed0 con 0x7f3a000cf6b0 2024-09-12T01:42:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a07b11640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3a000d31b0 con 0x7f3a000b63d0 2024-09-12T01:42:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a050ac640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a000cf6b0 0x7f3a000b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a050ac640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3a000cf6b0 0x7f3a000b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36430/0 (socket says 172.21.15.60:36430) 2024-09-12T01:42:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a050ac640 1 -- 172.21.15.60:0/2413470634 learned_addr learned my addr 172.21.15.60:0/2413470634 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a058ad640 1 --2- 172.21.15.60:0/2413470634 >> v2:172.21.15.105:3300/0 conn(0x7f3a000b63d0 0x7f3a000d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a050ac640 1 -- 172.21.15.60:0/2413470634 >> v2:172.21.15.105:3300/0 conn(0x7f3a000b63d0 msgr2=0x7f3a000d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a050ac640 1 --2- 172.21.15.60:0/2413470634 >> v2:172.21.15.105:3300/0 conn(0x7f3a000b63d0 0x7f3a000d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a050ac640 1 -- 172.21.15.60:0/2413470634 >> v1:172.21.15.105:6789/0 conn(0x7f3a000d1c80 legacy=0x7f3a000b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:03.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a050ac640 1 -- 172.21.15.60:0/2413470634 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a000d3490 con 0x7f3a000cf6b0 2024-09-12T01:42:03.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.471+0000 7f3a058ad640 1 --2- 172.21.15.60:0/2413470634 >> v2:172.21.15.105:3300/0 conn(0x7f3a000b63d0 0x7f3a000d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:03.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.472+0000 7f3a050ac640 1 --2- 172.21.15.60:0/2413470634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a000cf6b0 0x7f3a000b7880 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3a00050260 tx=0x7f39f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f590d9f79b6c7611 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:03.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.472+0000 7f3a048ab640 1 -- 172.21.15.60:0/2413470634 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0037070 con 0x7f3a000cf6b0 2024-09-12T01:42:03.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.472+0000 7f3a048ab640 1 -- 172.21.15.60:0/2413470634 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f0032440 con 0x7f3a000cf6b0 2024-09-12T01:42:03.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.472+0000 7f3a048ab640 1 -- 172.21.15.60:0/2413470634 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0032810 con 0x7f3a000cf6b0 2024-09-12T01:42:03.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.473+0000 7f3a07b11640 1 -- 172.21.15.60:0/2413470634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a000cf6b0 msgr2=0x7f3a000b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.473+0000 7f3a07b11640 1 --2- 172.21.15.60:0/2413470634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a000cf6b0 0x7f3a000b7880 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3a00050260 tx=0x7f39f002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.473+0000 7f3a07b11640 1 -- 172.21.15.60:0/2413470634 shutdown_connections 2024-09-12T01:42:03.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.473+0000 7f3a07b11640 1 --2- 172.21.15.60:0/2413470634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a000cf6b0 0x7f3a000b7880 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.473+0000 7f3a07b11640 1 --2- 172.21.15.60:0/2413470634 >> v2:172.21.15.105:3300/0 conn(0x7f3a000b63d0 0x7f3a000d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.473+0000 7f3a07b11640 1 -- 172.21.15.60:0/2413470634 >> 172.21.15.60:0/2413470634 conn(0x7f3a000d1160 msgr2=0x7f3a000d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:03.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.473+0000 7f3a07b11640 1 -- 172.21.15.60:0/2413470634 shutdown_connections 2024-09-12T01:42:03.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.473+0000 7f3a07b11640 1 -- 172.21.15.60:0/2413470634 wait complete. 2024-09-12T01:42:03.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.474+0000 7f3a07b11640 1 Processor -- start 2024-09-12T01:42:03.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.474+0000 7f3a07b11640 1 -- start start 2024-09-12T01:42:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a07b11640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a000b63d0 0x7f3a00155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a07b11640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a000cf6b0 0x7f3a00162800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a07b11640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a000d1c80 0x7f3a00162d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a07b11640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3a000d4070 con 0x7f3a000cf6b0 2024-09-12T01:42:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a07b11640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3a000d3ef0 con 0x7f3a000b63d0 2024-09-12T01:42:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a07b11640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3a000b67b0 con 0x7f3a000d1c80 2024-09-12T01:42:03.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a050ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a000cf6b0 0x7f3a00162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a050ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a000cf6b0 0x7f3a00162800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36444/0 (socket says 172.21.15.60:36444) 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a050ac640 1 -- 172.21.15.60:0/4131552806 learned_addr learned my addr 172.21.15.60:0/4131552806 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a058ad640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a000b63d0 0x7f3a00155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a060ae640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a000d1c80 0x7f3a00162d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a050ac640 1 -- 172.21.15.60:0/4131552806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a000d1c80 msgr2=0x7f3a00162d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a050ac640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a000d1c80 0x7f3a00162d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a050ac640 1 -- 172.21.15.60:0/4131552806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a000b63d0 msgr2=0x7f3a00155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a050ac640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a000b63d0 0x7f3a00155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a050ac640 1 -- 172.21.15.60:0/4131552806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a000cba00 con 0x7f3a000cf6b0 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f3a050ac640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a000cf6b0 0x7f3a00162800 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f39f0000c00 tx=0x7f39f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f39f67fc640 1 -- 172.21.15.60:0/4131552806 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0041020 con 0x7f3a000cf6b0 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.475+0000 7f39f67fc640 1 -- 172.21.15.60:0/4131552806 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39f0030970 con 0x7f3a000cf6b0 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.476+0000 7f39f67fc640 1 -- 172.21.15.60:0/4131552806 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f0037040 con 0x7f3a000cf6b0 2024-09-12T01:42:03.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.476+0000 7f3a07b11640 1 -- 172.21.15.60:0/4131552806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a000cbce0 con 0x7f3a000cf6b0 2024-09-12T01:42:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.476+0000 7f3a07b11640 1 -- 172.21.15.60:0/4131552806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a001558c0 con 0x7f3a000cf6b0 2024-09-12T01:42:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.477+0000 7f3a07b11640 1 -- 172.21.15.60:0/4131552806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a000cb790 con 0x7f3a000cf6b0 2024-09-12T01:42:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.477+0000 7f39f67fc640 1 -- 172.21.15.60:0/4131552806 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39f0044020 con 0x7f3a000cf6b0 2024-09-12T01:42:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.478+0000 7f39f67fc640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39e406be30 0x7f39e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.478+0000 7f3a058ad640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39e406be30 0x7f39e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.478+0000 7f39f67fc640 1 -- 172.21.15.60:0/4131552806 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f39f00ab730 con 0x7f3a000cf6b0 2024-09-12T01:42:03.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.478+0000 7f3a058ad640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39e406be30 0x7f39e406e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00ab60 tx=0x7f39fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:03.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.482+0000 7f39f67fc640 1 -- 172.21.15.60:0/4131552806 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39f004b030 con 0x7f3a000cf6b0 2024-09-12T01:42:03.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.657+0000 7f3a07b11640 1 -- 172.21.15.60:0/4131552806 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a000d39b0 con 0x7f39e406be30 2024-09-12T01:42:03.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.663+0000 7f39f67fc640 1 -- 172.21.15.60:0/4131552806 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250266 (secure 0 0 0) 0x7f3a000d39b0 con 0x7f39e406be30 2024-09-12T01:42:03.665 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:03.666 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:42:03.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.666+0000 7f3a07b11640 1 -- 172.21.15.60:0/4131552806 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39e406be30 msgr2=0x7f39e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.666+0000 7f3a07b11640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39e406be30 0x7f39e406e2f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00ab60 tx=0x7f39fc008040 comp rx=0 tx=0).stop 2024-09-12T01:42:03.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.666+0000 7f3a07b11640 1 -- 172.21.15.60:0/4131552806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a000cf6b0 msgr2=0x7f3a00162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.666+0000 7f3a07b11640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a000cf6b0 0x7f3a00162800 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f39f0000c00 tx=0x7f39f00046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.666+0000 7f3a07b11640 1 -- 172.21.15.60:0/4131552806 shutdown_connections 2024-09-12T01:42:03.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.666+0000 7f3a07b11640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39e406be30 0x7f39e406e2f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.666+0000 7f3a07b11640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a000d1c80 0x7f3a00162d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.666+0000 7f3a07b11640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a000cf6b0 0x7f3a00162800 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.666+0000 7f3a07b11640 1 --2- 172.21.15.60:0/4131552806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3a000b63d0 0x7f3a00155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.666+0000 7f3a07b11640 1 -- 172.21.15.60:0/4131552806 >> 172.21.15.60:0/4131552806 conn(0x7f3a000d1160 msgr2=0x7f3a000d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:03.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.667+0000 7f3a07b11640 1 -- 172.21.15.60:0/4131552806 shutdown_connections 2024-09-12T01:42:03.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.667+0000 7f3a07b11640 1 -- 172.21.15.60:0/4131552806 wait complete. 2024-09-12T01:42:03.677 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":275,"stamp":"2024-09-12T01:42:02.343719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276036,"kb_used_data":9884,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754698684,"statfs":{"total":773094113280,"available":772811452416,"internally_reserved":0,"allocated":10121216,"data_stored":4917156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.372071"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.006765+0000","last_change":"2024-09-12T01:41:59.998387+0000","last_active":"2024-09-12T01:42:00.006765+0000","last_peered":"2024-09-12T01:42:00.006765+0000","last_clean":"2024-09-12T01:42:00.006765+0000","last_became_active":"2024-09-12T01:41:59.998107+0000","last_became_peered":"2024-09-12T01:41:59.998107+0000","last_unstale":"2024-09-12T01:42:00.006765+0000","last_undegraded":"2024-09-12T01:42:00.006765+0000","last_fullsized":"2024-09-12T01:42:00.006765+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:26.966614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005999+0000","last_change":"2024-09-12T01:41:59.997097+0000","last_active":"2024-09-12T01:42:00.005999+0000","last_peered":"2024-09-12T01:42:00.005999+0000","last_clean":"2024-09-12T01:42:00.005999+0000","last_became_active":"2024-09-12T01:41:59.996791+0000","last_became_peered":"2024-09-12T01:41:59.996791+0000","last_unstale":"2024-09-12T01:42:00.005999+0000","last_undegraded":"2024-09-12T01:42:00.005999+0000","last_fullsized":"2024-09-12T01:42:00.005999+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:26.435357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015520+0000","last_change":"2024-09-12T01:42:00.010982+0000","last_active":"2024-09-12T01:42:00.015520+0000","last_peered":"2024-09-12T01:42:00.015520+0000","last_clean":"2024-09-12T01:42:00.015520+0000","last_became_active":"2024-09-12T01:42:00.010488+0000","last_became_peered":"2024-09-12T01:42:00.010488+0000","last_unstale":"2024-09-12T01:42:00.015520+0000","last_undegraded":"2024-09-12T01:42:00.015520+0000","last_fullsized":"2024-09-12T01:42:00.015520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:57.416935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.998922+0000","last_change":"2024-09-12T01:41:59.994841+0000","last_active":"2024-09-12T01:41:59.998922+0000","last_peered":"2024-09-12T01:41:59.998922+0000","last_clean":"2024-09-12T01:41:59.998922+0000","last_became_active":"2024-09-12T01:41:59.994425+0000","last_became_peered":"2024-09-12T01:41:59.994425+0000","last_unstale":"2024-09-12T01:41:59.998922+0000","last_undegraded":"2024-09-12T01:41:59.998922+0000","last_fullsized":"2024-09-12T01:41:59.998922+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:48.845335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003010+0000","last_change":"2024-09-12T01:42:00.002035+0000","last_active":"2024-09-12T01:42:00.003010+0000","last_peered":"2024-09-12T01:42:00.003010+0000","last_clean":"2024-09-12T01:42:00.003010+0000","last_became_active":"2024-09-12T01:42:00.001739+0000","last_became_peered":"2024-09-12T01:42:00.001739+0000","last_unstale":"2024-09-12T01:42:00.003010+0000","last_undegraded":"2024-09-12T01:42:00.003010+0000","last_fullsized":"2024-09-12T01:42:00.003010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:25.393366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.999763+0000","last_change":"2024-09-12T01:41:59.997500+0000","last_active":"2024-09-12T01:41:59.999763+0000","last_peered":"2024-09-12T01:41:59.999763+0000","last_clean":"2024-09-12T01:41:59.999763+0000","last_became_active":"2024-09-12T01:41:59.997216+0000","last_became_peered":"2024-09-12T01:41:59.997216+0000","last_unstale":"2024-09-12T01:41:59.999763+0000","last_undegraded":"2024-09-12T01:41:59.999763+0000","last_fullsized":"2024-09-12T01:41:59.999763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:03.967861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000870+0000","last_change":"2024-09-12T01:41:59.999881+0000","last_active":"2024-09-12T01:42:00.000870+0000","last_peered":"2024-09-12T01:42:00.000870+0000","last_clean":"2024-09-12T01:42:00.000870+0000","last_became_active":"2024-09-12T01:41:59.999548+0000","last_became_peered":"2024-09-12T01:41:59.999548+0000","last_unstale":"2024-09-12T01:42:00.000870+0000","last_undegraded":"2024-09-12T01:42:00.000870+0000","last_fullsized":"2024-09-12T01:42:00.000870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:42.985592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.012054+0000","last_change":"2024-09-12T01:42:00.011595+0000","last_active":"2024-09-12T01:42:00.012054+0000","last_peered":"2024-09-12T01:42:00.012054+0000","last_clean":"2024-09-12T01:42:00.012054+0000","last_became_active":"2024-09-12T01:42:00.011120+0000","last_became_peered":"2024-09-12T01:42:00.011120+0000","last_unstale":"2024-09-12T01:42:00.012054+0000","last_undegraded":"2024-09-12T01:42:00.012054+0000","last_fullsized":"2024-09-12T01:42:00.012054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.966780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003005+0000","last_change":"2024-09-12T01:42:00.002071+0000","last_active":"2024-09-12T01:42:00.003005+0000","last_peered":"2024-09-12T01:42:00.003005+0000","last_clean":"2024-09-12T01:42:00.003005+0000","last_became_active":"2024-09-12T01:42:00.001769+0000","last_became_peered":"2024-09-12T01:42:00.001769+0000","last_unstale":"2024-09-12T01:42:00.003005+0000","last_undegraded":"2024-09-12T01:42:00.003005+0000","last_fullsized":"2024-09-12T01:42:00.003005+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:08.962516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004120+0000","last_change":"2024-09-12T01:41:59.999861+0000","last_active":"2024-09-12T01:42:00.004120+0000","last_peered":"2024-09-12T01:42:00.004120+0000","last_clean":"2024-09-12T01:42:00.004120+0000","last_became_active":"2024-09-12T01:41:59.999585+0000","last_became_peered":"2024-09-12T01:41:59.999585+0000","last_unstale":"2024-09-12T01:42:00.004120+0000","last_undegraded":"2024-09-12T01:42:00.004120+0000","last_fullsized":"2024-09-12T01:42:00.004120+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:48.815524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005291+0000","last_change":"2024-09-12T01:42:00.003453+0000","last_active":"2024-09-12T01:42:00.005291+0000","last_peered":"2024-09-12T01:42:00.005291+0000","last_clean":"2024-09-12T01:42:00.005291+0000","last_became_active":"2024-09-12T01:42:00.003168+0000","last_became_peered":"2024-09-12T01:42:00.003168+0000","last_unstale":"2024-09-12T01:42:00.005291+0000","last_undegraded":"2024-09-12T01:42:00.005291+0000","last_fullsized":"2024-09-12T01:42:00.005291+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:54.408335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008225+0000","last_change":"2024-09-12T01:41:59.999888+0000","last_active":"2024-09-12T01:42:00.008225+0000","last_peered":"2024-09-12T01:42:00.008225+0000","last_clean":"2024-09-12T01:42:00.008225+0000","last_became_active":"2024-09-12T01:41:59.999191+0000","last_became_peered":"2024-09-12T01:41:59.999191+0000","last_unstale":"2024-09-12T01:42:00.008225+0000","last_undegraded":"2024-09-12T01:42:00.008225+0000","last_fullsized":"2024-09-12T01:42:00.008225+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:09.385413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008783+0000","last_change":"2024-09-12T01:42:00.000266+0000","last_active":"2024-09-12T01:42:00.008783+0000","last_peered":"2024-09-12T01:42:00.008783+0000","last_clean":"2024-09-12T01:42:00.008783+0000","last_became_active":"2024-09-12T01:42:00.000010+0000","last_became_peered":"2024-09-12T01:42:00.000010+0000","last_unstale":"2024-09-12T01:42:00.008783+0000","last_undegraded":"2024-09-12T01:42:00.008783+0000","last_fullsized":"2024-09-12T01:42:00.008783+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:58.296601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.999088+0000","last_change":"2024-09-12T01:41:59.996542+0000","last_active":"2024-09-12T01:41:59.999088+0000","last_peered":"2024-09-12T01:41:59.999088+0000","last_clean":"2024-09-12T01:41:59.999088+0000","last_became_active":"2024-09-12T01:41:59.996199+0000","last_became_peered":"2024-09-12T01:41:59.996199+0000","last_unstale":"2024-09-12T01:41:59.999088+0000","last_undegraded":"2024-09-12T01:41:59.999088+0000","last_fullsized":"2024-09-12T01:41:59.999088+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:29.618613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008916+0000","last_change":"2024-09-12T01:42:00.006742+0000","last_active":"2024-09-12T01:42:00.008916+0000","last_peered":"2024-09-12T01:42:00.008916+0000","last_clean":"2024-09-12T01:42:00.008916+0000","last_became_active":"2024-09-12T01:42:00.006366+0000","last_became_peered":"2024-09-12T01:42:00.006366+0000","last_unstale":"2024-09-12T01:42:00.008916+0000","last_undegraded":"2024-09-12T01:42:00.008916+0000","last_fullsized":"2024-09-12T01:42:00.008916+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:51.680001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008682+0000","last_change":"2024-09-12T01:42:00.000351+0000","last_active":"2024-09-12T01:42:00.008682+0000","last_peered":"2024-09-12T01:42:00.008682+0000","last_clean":"2024-09-12T01:42:00.008682+0000","last_became_active":"2024-09-12T01:41:59.999753+0000","last_became_peered":"2024-09-12T01:41:59.999753+0000","last_unstale":"2024-09-12T01:42:00.008682+0000","last_undegraded":"2024-09-12T01:42:00.008682+0000","last_fullsized":"2024-09-12T01:42:00.008682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:04.822297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.017795+0000","last_change":"2024-09-12T01:42:00.013386+0000","last_active":"2024-09-12T01:42:00.017795+0000","last_peered":"2024-09-12T01:42:00.017795+0000","last_clean":"2024-09-12T01:42:00.017795+0000","last_became_active":"2024-09-12T01:42:00.013088+0000","last_became_peered":"2024-09-12T01:42:00.013088+0000","last_unstale":"2024-09-12T01:42:00.017795+0000","last_undegraded":"2024-09-12T01:42:00.017795+0000","last_fullsized":"2024-09-12T01:42:00.017795+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:58.449274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000474+0000","last_change":"2024-09-12T01:41:59.994130+0000","last_active":"2024-09-12T01:42:00.000474+0000","last_peered":"2024-09-12T01:42:00.000474+0000","last_clean":"2024-09-12T01:42:00.000474+0000","last_became_active":"2024-09-12T01:41:59.993627+0000","last_became_peered":"2024-09-12T01:41:59.993627+0000","last_unstale":"2024-09-12T01:42:00.000474+0000","last_undegraded":"2024-09-12T01:42:00.000474+0000","last_fullsized":"2024-09-12T01:42:00.000474+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.582260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007599+0000","last_change":"2024-09-12T01:41:59.998620+0000","last_active":"2024-09-12T01:42:00.007599+0000","last_peered":"2024-09-12T01:42:00.007599+0000","last_clean":"2024-09-12T01:42:00.007599+0000","last_became_active":"2024-09-12T01:41:59.998314+0000","last_became_peered":"2024-09-12T01:41:59.998314+0000","last_unstale":"2024-09-12T01:42:00.007599+0000","last_undegraded":"2024-09-12T01:42:00.007599+0000","last_fullsized":"2024-09-12T01:42:00.007599+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:28.832878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.011785+0000","last_change":"2024-09-12T01:42:00.010724+0000","last_active":"2024-09-12T01:42:00.011785+0000","last_peered":"2024-09-12T01:42:00.011785+0000","last_clean":"2024-09-12T01:42:00.011785+0000","last_became_active":"2024-09-12T01:42:00.010364+0000","last_became_peered":"2024-09-12T01:42:00.010364+0000","last_unstale":"2024-09-12T01:42:00.011785+0000","last_undegraded":"2024-09-12T01:42:00.011785+0000","last_fullsized":"2024-09-12T01:42:00.011785+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:14.093956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004638+0000","last_change":"2024-09-12T01:42:00.003822+0000","last_active":"2024-09-12T01:42:00.004638+0000","last_peered":"2024-09-12T01:42:00.004638+0000","last_clean":"2024-09-12T01:42:00.004638+0000","last_became_active":"2024-09-12T01:42:00.003374+0000","last_became_peered":"2024-09-12T01:42:00.003374+0000","last_unstale":"2024-09-12T01:42:00.004638+0000","last_undegraded":"2024-09-12T01:42:00.004638+0000","last_fullsized":"2024-09-12T01:42:00.004638+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:28.832878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.996779+0000","last_change":"2024-09-12T01:41:59.995775+0000","last_active":"2024-09-12T01:41:59.996779+0000","last_peered":"2024-09-12T01:41:59.996779+0000","last_clean":"2024-09-12T01:41:59.996779+0000","last_became_active":"2024-09-12T01:41:59.995503+0000","last_became_peered":"2024-09-12T01:41:59.995503+0000","last_unstale":"2024-09-12T01:41:59.996779+0000","last_undegraded":"2024-09-12T01:41:59.996779+0000","last_fullsized":"2024-09-12T01:41:59.996779+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:34.971636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004779+0000","last_change":"2024-09-12T01:42:00.003066+0000","last_active":"2024-09-12T01:42:00.004779+0000","last_peered":"2024-09-12T01:42:00.004779+0000","last_clean":"2024-09-12T01:42:00.004779+0000","last_became_active":"2024-09-12T01:42:00.002796+0000","last_became_peered":"2024-09-12T01:42:00.002796+0000","last_unstale":"2024-09-12T01:42:00.004779+0000","last_undegraded":"2024-09-12T01:42:00.004779+0000","last_fullsized":"2024-09-12T01:42:00.004779+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:23.856078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004651+0000","last_change":"2024-09-12T01:41:59.995567+0000","last_active":"2024-09-12T01:42:00.004651+0000","last_peered":"2024-09-12T01:42:00.004651+0000","last_clean":"2024-09-12T01:42:00.004651+0000","last_became_active":"2024-09-12T01:41:59.995275+0000","last_became_peered":"2024-09-12T01:41:59.995275+0000","last_unstale":"2024-09-12T01:42:00.004651+0000","last_undegraded":"2024-09-12T01:42:00.004651+0000","last_fullsized":"2024-09-12T01:42:00.004651+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:13.659299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007006+0000","last_change":"2024-09-12T01:42:00.004709+0000","last_active":"2024-09-12T01:42:00.007006+0000","last_peered":"2024-09-12T01:42:00.007006+0000","last_clean":"2024-09-12T01:42:00.007006+0000","last_became_active":"2024-09-12T01:42:00.004413+0000","last_became_peered":"2024-09-12T01:42:00.004413+0000","last_unstale":"2024-09-12T01:42:00.007006+0000","last_undegraded":"2024-09-12T01:42:00.007006+0000","last_fullsized":"2024-09-12T01:42:00.007006+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:14.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003886+0000","last_change":"2024-09-12T01:42:00.001460+0000","last_active":"2024-09-12T01:42:00.003886+0000","last_peered":"2024-09-12T01:42:00.003886+0000","last_clean":"2024-09-12T01:42:00.003886+0000","last_became_active":"2024-09-12T01:42:00.001111+0000","last_became_peered":"2024-09-12T01:42:00.001111+0000","last_unstale":"2024-09-12T01:42:00.003886+0000","last_undegraded":"2024-09-12T01:42:00.003886+0000","last_fullsized":"2024-09-12T01:42:00.003886+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:28.435193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015473+0000","last_change":"2024-09-12T01:42:00.010691+0000","last_active":"2024-09-12T01:42:00.015473+0000","last_peered":"2024-09-12T01:42:00.015473+0000","last_clean":"2024-09-12T01:42:00.015473+0000","last_became_active":"2024-09-12T01:42:00.010426+0000","last_became_peered":"2024-09-12T01:42:00.010426+0000","last_unstale":"2024-09-12T01:42:00.015473+0000","last_undegraded":"2024-09-12T01:42:00.015473+0000","last_fullsized":"2024-09-12T01:42:00.015473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:53.113663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007551+0000","last_change":"2024-09-12T01:42:00.002800+0000","last_active":"2024-09-12T01:42:00.007551+0000","last_peered":"2024-09-12T01:42:00.007551+0000","last_clean":"2024-09-12T01:42:00.007551+0000","last_became_active":"2024-09-12T01:42:00.002533+0000","last_became_peered":"2024-09-12T01:42:00.002533+0000","last_unstale":"2024-09-12T01:42:00.007551+0000","last_undegraded":"2024-09-12T01:42:00.007551+0000","last_fullsized":"2024-09-12T01:42:00.007551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:46.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"91'4","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.001313+0000","last_change":"2024-09-12T01:41:58.988426+0000","last_active":"2024-09-12T01:42:00.001313+0000","last_peered":"2024-09-12T01:42:00.001313+0000","last_clean":"2024-09-12T01:42:00.001313+0000","last_became_active":"2024-09-12T01:41:58.988130+0000","last_became_peered":"2024-09-12T01:41:58.988130+0000","last_unstale":"2024-09-12T01:42:00.001313+0000","last_undegraded":"2024-09-12T01:42:00.001313+0000","last_fullsized":"2024-09-12T01:42:00.001313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:19.475865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005320+0000","last_change":"2024-09-12T01:42:00.004520+0000","last_active":"2024-09-12T01:42:00.005320+0000","last_peered":"2024-09-12T01:42:00.005320+0000","last_clean":"2024-09-12T01:42:00.005320+0000","last_became_active":"2024-09-12T01:42:00.004193+0000","last_became_peered":"2024-09-12T01:42:00.004193+0000","last_unstale":"2024-09-12T01:42:00.005320+0000","last_undegraded":"2024-09-12T01:42:00.005320+0000","last_fullsized":"2024-09-12T01:42:00.005320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:33.609574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.998645+0000","last_change":"2024-09-12T01:41:58.992984+0000","last_active":"2024-09-12T01:41:59.998645+0000","last_peered":"2024-09-12T01:41:59.998645+0000","last_clean":"2024-09-12T01:41:59.998645+0000","last_became_active":"2024-09-12T01:41:58.992669+0000","last_became_peered":"2024-09-12T01:41:58.992669+0000","last_unstale":"2024-09-12T01:41:59.998645+0000","last_undegraded":"2024-09-12T01:41:59.998645+0000","last_fullsized":"2024-09-12T01:41:59.998645+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.589596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.010165+0000","last_change":"2024-09-12T01:42:00.008281+0000","last_active":"2024-09-12T01:42:00.010165+0000","last_peered":"2024-09-12T01:42:00.010165+0000","last_clean":"2024-09-12T01:42:00.010165+0000","last_became_active":"2024-09-12T01:42:00.007920+0000","last_became_peered":"2024-09-12T01:42:00.007920+0000","last_unstale":"2024-09-12T01:42:00.010165+0000","last_undegraded":"2024-09-12T01:42:00.010165+0000","last_fullsized":"2024-09-12T01:42:00.010165+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:13.659299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980490+0000","last_change":"2024-09-12T01:41:57.980490+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980490+0000","last_undegraded":"2024-09-12T01:41:57.980490+0000","last_fullsized":"2024-09-12T01:41:57.980490+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008227+0000","last_change":"2024-09-12T01:42:00.007543+0000","last_active":"2024-09-12T01:42:00.008227+0000","last_peered":"2024-09-12T01:42:00.008227+0000","last_clean":"2024-09-12T01:42:00.008227+0000","last_became_active":"2024-09-12T01:42:00.006466+0000","last_became_peered":"2024-09-12T01:42:00.006466+0000","last_unstale":"2024-09-12T01:42:00.008227+0000","last_undegraded":"2024-09-12T01:42:00.008227+0000","last_fullsized":"2024-09-12T01:42:00.008227+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:09.385413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.009099+0000","last_change":"2024-09-12T01:41:58.997786+0000","last_active":"2024-09-12T01:42:00.009099+0000","last_peered":"2024-09-12T01:42:00.009099+0000","last_clean":"2024-09-12T01:42:00.009099+0000","last_became_active":"2024-09-12T01:41:58.997540+0000","last_became_peered":"2024-09-12T01:41:58.997540+0000","last_unstale":"2024-09-12T01:42:00.009099+0000","last_undegraded":"2024-09-12T01:42:00.009099+0000","last_fullsized":"2024-09-12T01:42:00.009099+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:14.484863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000498+0000","last_change":"2024-09-12T01:41:59.993413+0000","last_active":"2024-09-12T01:42:00.000498+0000","last_peered":"2024-09-12T01:42:00.000498+0000","last_clean":"2024-09-12T01:42:00.000498+0000","last_became_active":"2024-09-12T01:41:59.992374+0000","last_became_peered":"2024-09-12T01:41:59.992374+0000","last_unstale":"2024-09-12T01:42:00.000498+0000","last_undegraded":"2024-09-12T01:42:00.000498+0000","last_fullsized":"2024-09-12T01:42:00.000498+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:26.760592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.011460+0000","last_change":"2024-09-12T01:41:58.996374+0000","last_active":"2024-09-12T01:42:00.011460+0000","last_peered":"2024-09-12T01:42:00.011460+0000","last_clean":"2024-09-12T01:42:00.011460+0000","last_became_active":"2024-09-12T01:41:58.996057+0000","last_became_peered":"2024-09-12T01:41:58.996057+0000","last_unstale":"2024-09-12T01:42:00.011460+0000","last_undegraded":"2024-09-12T01:42:00.011460+0000","last_fullsized":"2024-09-12T01:42:00.011460+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:53.915640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.999122+0000","last_change":"2024-09-12T01:41:59.995738+0000","last_active":"2024-09-12T01:41:59.999122+0000","last_peered":"2024-09-12T01:41:59.999122+0000","last_clean":"2024-09-12T01:41:59.999122+0000","last_became_active":"2024-09-12T01:41:59.995444+0000","last_became_peered":"2024-09-12T01:41:59.995444+0000","last_unstale":"2024-09-12T01:41:59.999122+0000","last_undegraded":"2024-09-12T01:41:59.999122+0000","last_fullsized":"2024-09-12T01:41:59.999122+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:14.525743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980754+0000","last_change":"2024-09-12T01:41:57.980754+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980754+0000","last_undegraded":"2024-09-12T01:41:57.980754+0000","last_fullsized":"2024-09-12T01:41:57.980754+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.006976+0000","last_change":"2024-09-12T01:42:00.005090+0000","last_active":"2024-09-12T01:42:00.006976+0000","last_peered":"2024-09-12T01:42:00.006976+0000","last_clean":"2024-09-12T01:42:00.006976+0000","last_became_active":"2024-09-12T01:42:00.004601+0000","last_became_peered":"2024-09-12T01:42:00.004601+0000","last_unstale":"2024-09-12T01:42:00.006976+0000","last_undegraded":"2024-09-12T01:42:00.006976+0000","last_fullsized":"2024-09-12T01:42:00.006976+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:47.262836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.990294+0000","last_change":"2024-09-12T01:41:58.989687+0000","last_active":"2024-09-12T01:41:59.990294+0000","last_peered":"2024-09-12T01:41:59.990294+0000","last_clean":"2024-09-12T01:41:59.990294+0000","last_became_active":"2024-09-12T01:41:58.989372+0000","last_became_peered":"2024-09-12T01:41:58.989372+0000","last_unstale":"2024-09-12T01:41:59.990294+0000","last_undegraded":"2024-09-12T01:41:59.990294+0000","last_fullsized":"2024-09-12T01:41:59.990294+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:00.390233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000300+0000","last_change":"2024-09-12T01:41:59.991854+0000","last_active":"2024-09-12T01:42:00.000300+0000","last_peered":"2024-09-12T01:42:00.000300+0000","last_clean":"2024-09-12T01:42:00.000300+0000","last_became_active":"2024-09-12T01:41:59.991577+0000","last_became_peered":"2024-09-12T01:41:59.991577+0000","last_unstale":"2024-09-12T01:42:00.000300+0000","last_undegraded":"2024-09-12T01:42:00.000300+0000","last_fullsized":"2024-09-12T01:42:00.000300+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:13.714369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.994992+0000","last_change":"2024-09-12T01:41:58.997889+0000","last_active":"2024-09-12T01:41:59.994992+0000","last_peered":"2024-09-12T01:41:59.994992+0000","last_clean":"2024-09-12T01:41:59.994992+0000","last_became_active":"2024-09-12T01:41:58.997469+0000","last_became_peered":"2024-09-12T01:41:58.997469+0000","last_unstale":"2024-09-12T01:41:59.994992+0000","last_undegraded":"2024-09-12T01:41:59.994992+0000","last_fullsized":"2024-09-12T01:41:59.994992+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:22.853882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015512+0000","last_change":"2024-09-12T01:42:00.010808+0000","last_active":"2024-09-12T01:42:00.015512+0000","last_peered":"2024-09-12T01:42:00.015512+0000","last_clean":"2024-09-12T01:42:00.015512+0000","last_became_active":"2024-09-12T01:42:00.010535+0000","last_became_peered":"2024-09-12T01:42:00.010535+0000","last_unstale":"2024-09-12T01:42:00.015512+0000","last_undegraded":"2024-09-12T01:42:00.015512+0000","last_fullsized":"2024-09-12T01:42:00.015512+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:01.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980744+0000","last_change":"2024-09-12T01:41:57.980744+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980744+0000","last_undegraded":"2024-09-12T01:41:57.980744+0000","last_fullsized":"2024-09-12T01:41:57.980744+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.002425+0000","last_change":"2024-09-12T01:41:59.996189+0000","last_active":"2024-09-12T01:42:00.002425+0000","last_peered":"2024-09-12T01:42:00.002425+0000","last_clean":"2024-09-12T01:42:00.002425+0000","last_became_active":"2024-09-12T01:41:59.995894+0000","last_became_peered":"2024-09-12T01:41:59.995894+0000","last_unstale":"2024-09-12T01:42:00.002425+0000","last_undegraded":"2024-09-12T01:42:00.002425+0000","last_fullsized":"2024-09-12T01:42:00.002425+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:53.113663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.985390+0000","last_change":"2024-09-12T01:41:58.996582+0000","last_active":"2024-09-12T01:41:59.985390+0000","last_peered":"2024-09-12T01:41:59.985390+0000","last_clean":"2024-09-12T01:41:59.985390+0000","last_became_active":"2024-09-12T01:41:58.996289+0000","last_became_peered":"2024-09-12T01:41:58.996289+0000","last_unstale":"2024-09-12T01:41:59.985390+0000","last_undegraded":"2024-09-12T01:41:59.985390+0000","last_fullsized":"2024-09-12T01:41:59.985390+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:45.266662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.009813+0000","last_change":"2024-09-12T01:42:00.009375+0000","last_active":"2024-09-12T01:42:00.009813+0000","last_peered":"2024-09-12T01:42:00.009813+0000","last_clean":"2024-09-12T01:42:00.009813+0000","last_became_active":"2024-09-12T01:42:00.009071+0000","last_became_peered":"2024-09-12T01:42:00.009071+0000","last_unstale":"2024-09-12T01:42:00.009813+0000","last_undegraded":"2024-09-12T01:42:00.009813+0000","last_fullsized":"2024-09-12T01:42:00.009813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:13.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"91'3","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005079+0000","last_change":"2024-09-12T01:41:58.992505+0000","last_active":"2024-09-12T01:42:00.005079+0000","last_peered":"2024-09-12T01:42:00.005079+0000","last_clean":"2024-09-12T01:42:00.005079+0000","last_became_active":"2024-09-12T01:41:58.992076+0000","last_became_peered":"2024-09-12T01:41:58.992076+0000","last_unstale":"2024-09-12T01:42:00.005079+0000","last_undegraded":"2024-09-12T01:42:00.005079+0000","last_fullsized":"2024-09-12T01:42:00.005079+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:15.078082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004528+0000","last_change":"2024-09-12T01:42:00.002167+0000","last_active":"2024-09-12T01:42:00.004528+0000","last_peered":"2024-09-12T01:42:00.004528+0000","last_clean":"2024-09-12T01:42:00.004528+0000","last_became_active":"2024-09-12T01:42:00.001838+0000","last_became_peered":"2024-09-12T01:42:00.001838+0000","last_unstale":"2024-09-12T01:42:00.004528+0000","last_undegraded":"2024-09-12T01:42:00.004528+0000","last_fullsized":"2024-09-12T01:42:00.004528+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:57.416935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"91'6","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015524+0000","last_change":"2024-09-12T01:41:58.996508+0000","last_active":"2024-09-12T01:42:00.015524+0000","last_peered":"2024-09-12T01:42:00.015524+0000","last_clean":"2024-09-12T01:42:00.015524+0000","last_became_active":"2024-09-12T01:41:58.995956+0000","last_became_peered":"2024-09-12T01:41:58.995956+0000","last_unstale":"2024-09-12T01:42:00.015524+0000","last_undegraded":"2024-09-12T01:42:00.015524+0000","last_fullsized":"2024-09-12T01:42:00.015524+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:55.108765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008246+0000","last_change":"2024-09-12T01:41:59.999914+0000","last_active":"2024-09-12T01:42:00.008246+0000","last_peered":"2024-09-12T01:42:00.008246+0000","last_clean":"2024-09-12T01:42:00.008246+0000","last_became_active":"2024-09-12T01:41:59.999540+0000","last_became_peered":"2024-09-12T01:41:59.999540+0000","last_unstale":"2024-09-12T01:42:00.008246+0000","last_undegraded":"2024-09-12T01:42:00.008246+0000","last_fullsized":"2024-09-12T01:42:00.008246+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.966780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007201+0000","last_change":"2024-09-12T01:41:58.991672+0000","last_active":"2024-09-12T01:42:00.007201+0000","last_peered":"2024-09-12T01:42:00.007201+0000","last_clean":"2024-09-12T01:42:00.007201+0000","last_became_active":"2024-09-12T01:41:58.991363+0000","last_became_peered":"2024-09-12T01:41:58.991363+0000","last_unstale":"2024-09-12T01:42:00.007201+0000","last_undegraded":"2024-09-12T01:42:00.007201+0000","last_fullsized":"2024-09-12T01:42:00.007201+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:24.678504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.985648+0000","last_change":"2024-09-12T01:41:58.996856+0000","last_active":"2024-09-12T01:41:59.985648+0000","last_peered":"2024-09-12T01:41:59.985648+0000","last_clean":"2024-09-12T01:41:59.985648+0000","last_became_active":"2024-09-12T01:41:58.995624+0000","last_became_peered":"2024-09-12T01:41:58.995624+0000","last_unstale":"2024-09-12T01:41:59.985648+0000","last_undegraded":"2024-09-12T01:41:59.985648+0000","last_fullsized":"2024-09-12T01:41:59.985648+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:06.324090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.998809+0000","last_change":"2024-09-12T01:41:59.993089+0000","last_active":"2024-09-12T01:41:59.998809+0000","last_peered":"2024-09-12T01:41:59.998809+0000","last_clean":"2024-09-12T01:41:59.998809+0000","last_became_active":"2024-09-12T01:41:59.992817+0000","last_became_peered":"2024-09-12T01:41:59.992817+0000","last_unstale":"2024-09-12T01:41:59.998809+0000","last_undegraded":"2024-09-12T01:41:59.998809+0000","last_fullsized":"2024-09-12T01:41:59.998809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:46.214683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.984192+0000","last_change":"2024-09-12T01:41:58.993719+0000","last_active":"2024-09-12T01:41:59.984192+0000","last_peered":"2024-09-12T01:41:59.984192+0000","last_clean":"2024-09-12T01:41:59.984192+0000","last_became_active":"2024-09-12T01:41:58.993224+0000","last_became_peered":"2024-09-12T01:41:58.993224+0000","last_unstale":"2024-09-12T01:41:59.984192+0000","last_undegraded":"2024-09-12T01:41:59.984192+0000","last_fullsized":"2024-09-12T01:41:59.984192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:58.987546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.10","version":"91'8","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.011250+0000","last_change":"2024-09-12T01:41:58.991776+0000","last_active":"2024-09-12T01:42:00.011250+0000","last_peered":"2024-09-12T01:42:00.011250+0000","last_clean":"2024-09-12T01:42:00.011250+0000","last_became_active":"2024-09-12T01:41:58.991511+0000","last_became_peered":"2024-09-12T01:41:58.991511+0000","last_unstale":"2024-09-12T01:42:00.011250+0000","last_undegraded":"2024-09-12T01:42:00.011250+0000","last_fullsized":"2024-09-12T01:42:00.011250+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.831543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.991264+0000","last_change":"2024-09-12T01:41:59.987898+0000","last_active":"2024-09-12T01:41:59.991264+0000","last_peered":"2024-09-12T01:41:59.991264+0000","last_clean":"2024-09-12T01:41:59.991264+0000","last_became_active":"2024-09-12T01:41:59.987625+0000","last_became_peered":"2024-09-12T01:41:59.987625+0000","last_unstale":"2024-09-12T01:41:59.991264+0000","last_undegraded":"2024-09-12T01:41:59.991264+0000","last_fullsized":"2024-09-12T01:41:59.991264+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:04.822297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.001058+0000","last_change":"2024-09-12T01:41:58.996161+0000","last_active":"2024-09-12T01:42:00.001058+0000","last_peered":"2024-09-12T01:42:00.001058+0000","last_clean":"2024-09-12T01:42:00.001058+0000","last_became_active":"2024-09-12T01:41:58.995854+0000","last_became_peered":"2024-09-12T01:41:58.995854+0000","last_unstale":"2024-09-12T01:42:00.001058+0000","last_undegraded":"2024-09-12T01:42:00.001058+0000","last_fullsized":"2024-09-12T01:42:00.001058+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:04.272253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.996013+0000","last_change":"2024-09-12T01:41:59.992362+0000","last_active":"2024-09-12T01:41:59.996013+0000","last_peered":"2024-09-12T01:41:59.996013+0000","last_clean":"2024-09-12T01:41:59.996013+0000","last_became_active":"2024-09-12T01:41:59.992048+0000","last_became_peered":"2024-09-12T01:41:59.992048+0000","last_unstale":"2024-09-12T01:41:59.996013+0000","last_undegraded":"2024-09-12T01:41:59.996013+0000","last_fullsized":"2024-09-12T01:41:59.996013+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:37.604923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003203+0000","last_change":"2024-09-12T01:41:58.990373+0000","last_active":"2024-09-12T01:42:00.003203+0000","last_peered":"2024-09-12T01:42:00.003203+0000","last_clean":"2024-09-12T01:42:00.003203+0000","last_became_active":"2024-09-12T01:41:58.990079+0000","last_became_peered":"2024-09-12T01:41:58.990079+0000","last_unstale":"2024-09-12T01:42:00.003203+0000","last_undegraded":"2024-09-12T01:42:00.003203+0000","last_fullsized":"2024-09-12T01:42:00.003203+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:03.731788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003934+0000","last_change":"2024-09-12T01:41:59.999108+0000","last_active":"2024-09-12T01:42:00.003934+0000","last_peered":"2024-09-12T01:42:00.003934+0000","last_clean":"2024-09-12T01:42:00.003934+0000","last_became_active":"2024-09-12T01:41:59.998824+0000","last_became_peered":"2024-09-12T01:41:59.998824+0000","last_unstale":"2024-09-12T01:42:00.003934+0000","last_undegraded":"2024-09-12T01:42:00.003934+0000","last_fullsized":"2024-09-12T01:42:00.003934+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:54.917836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.994358+0000","last_change":"2024-09-12T01:41:58.997460+0000","last_active":"2024-09-12T01:41:59.994358+0000","last_peered":"2024-09-12T01:41:59.994358+0000","last_clean":"2024-09-12T01:41:59.994358+0000","last_became_active":"2024-09-12T01:41:58.996445+0000","last_became_peered":"2024-09-12T01:41:58.996445+0000","last_unstale":"2024-09-12T01:41:59.994358+0000","last_undegraded":"2024-09-12T01:41:59.994358+0000","last_fullsized":"2024-09-12T01:41:59.994358+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:56.414738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005924+0000","last_change":"2024-09-12T01:41:59.999188+0000","last_active":"2024-09-12T01:42:00.005924+0000","last_peered":"2024-09-12T01:42:00.005924+0000","last_clean":"2024-09-12T01:42:00.005924+0000","last_became_active":"2024-09-12T01:41:59.998893+0000","last_became_peered":"2024-09-12T01:41:59.998893+0000","last_unstale":"2024-09-12T01:42:00.005924+0000","last_undegraded":"2024-09-12T01:42:00.005924+0000","last_fullsized":"2024-09-12T01:42:00.005924+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:20.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.012686+0000","last_change":"2024-09-12T01:41:58.997143+0000","last_active":"2024-09-12T01:42:00.012686+0000","last_peered":"2024-09-12T01:42:00.012686+0000","last_clean":"2024-09-12T01:42:00.012686+0000","last_became_active":"2024-09-12T01:41:58.996881+0000","last_became_peered":"2024-09-12T01:41:58.996881+0000","last_unstale":"2024-09-12T01:42:00.012686+0000","last_undegraded":"2024-09-12T01:42:00.012686+0000","last_fullsized":"2024-09-12T01:42:00.012686+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:47.813327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.006138+0000","last_change":"2024-09-12T01:42:00.001287+0000","last_active":"2024-09-12T01:42:00.006138+0000","last_peered":"2024-09-12T01:42:00.006138+0000","last_clean":"2024-09-12T01:42:00.006138+0000","last_became_active":"2024-09-12T01:42:00.001027+0000","last_became_peered":"2024-09-12T01:42:00.001027+0000","last_unstale":"2024-09-12T01:42:00.006138+0000","last_undegraded":"2024-09-12T01:42:00.006138+0000","last_fullsized":"2024-09-12T01:42:00.006138+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:36.937083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.981356+0000","last_change":"2024-09-12T01:41:58.992864+0000","last_active":"2024-09-12T01:41:59.981356+0000","last_peered":"2024-09-12T01:41:59.981356+0000","last_clean":"2024-09-12T01:41:59.981356+0000","last_became_active":"2024-09-12T01:41:58.992587+0000","last_became_peered":"2024-09-12T01:41:58.992587+0000","last_unstale":"2024-09-12T01:41:59.981356+0000","last_undegraded":"2024-09-12T01:41:59.981356+0000","last_fullsized":"2024-09-12T01:41:59.981356+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:08.383216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008733+0000","last_change":"2024-09-12T01:42:00.002542+0000","last_active":"2024-09-12T01:42:00.008733+0000","last_peered":"2024-09-12T01:42:00.008733+0000","last_clean":"2024-09-12T01:42:00.008733+0000","last_became_active":"2024-09-12T01:42:00.002208+0000","last_became_peered":"2024-09-12T01:42:00.002208+0000","last_unstale":"2024-09-12T01:42:00.008733+0000","last_undegraded":"2024-09-12T01:42:00.008733+0000","last_fullsized":"2024-09-12T01:42:00.008733+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:37.604923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.990699+0000","last_change":"2024-09-12T01:41:58.993285+0000","last_active":"2024-09-12T01:41:59.990699+0000","last_peered":"2024-09-12T01:41:59.990699+0000","last_clean":"2024-09-12T01:41:59.990699+0000","last_became_active":"2024-09-12T01:41:58.992941+0000","last_became_peered":"2024-09-12T01:41:58.992941+0000","last_unstale":"2024-09-12T01:41:59.990699+0000","last_undegraded":"2024-09-12T01:41:59.990699+0000","last_fullsized":"2024-09-12T01:41:59.990699+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.964417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004722+0000","last_change":"2024-09-12T01:41:59.998894+0000","last_active":"2024-09-12T01:42:00.004722+0000","last_peered":"2024-09-12T01:42:00.004722+0000","last_clean":"2024-09-12T01:42:00.004722+0000","last_became_active":"2024-09-12T01:41:59.998534+0000","last_became_peered":"2024-09-12T01:41:59.998534+0000","last_unstale":"2024-09-12T01:42:00.004722+0000","last_undegraded":"2024-09-12T01:42:00.004722+0000","last_fullsized":"2024-09-12T01:42:00.004722+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:01.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.982273+0000","last_change":"2024-09-12T01:41:57.982273+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.982273+0000","last_undegraded":"2024-09-12T01:41:57.982273+0000","last_fullsized":"2024-09-12T01:41:57.982273+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008881+0000","last_change":"2024-09-12T01:42:00.007206+0000","last_active":"2024-09-12T01:42:00.008881+0000","last_peered":"2024-09-12T01:42:00.008881+0000","last_clean":"2024-09-12T01:42:00.008881+0000","last_became_active":"2024-09-12T01:42:00.006901+0000","last_became_peered":"2024-09-12T01:42:00.006901+0000","last_unstale":"2024-09-12T01:42:00.008881+0000","last_undegraded":"2024-09-12T01:42:00.008881+0000","last_fullsized":"2024-09-12T01:42:00.008881+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:14.401142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003602+0000","last_change":"2024-09-12T01:41:58.996435+0000","last_active":"2024-09-12T01:42:00.003602+0000","last_peered":"2024-09-12T01:42:00.003602+0000","last_clean":"2024-09-12T01:42:00.003602+0000","last_became_active":"2024-09-12T01:41:58.995490+0000","last_became_peered":"2024-09-12T01:41:58.995490+0000","last_unstale":"2024-09-12T01:42:00.003602+0000","last_undegraded":"2024-09-12T01:42:00.003602+0000","last_fullsized":"2024-09-12T01:42:00.003602+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:24.184298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.018020+0000","last_change":"2024-09-12T01:42:00.016030+0000","last_active":"2024-09-12T01:42:00.018020+0000","last_peered":"2024-09-12T01:42:00.018020+0000","last_clean":"2024-09-12T01:42:00.018020+0000","last_became_active":"2024-09-12T01:42:00.015719+0000","last_became_peered":"2024-09-12T01:42:00.015719+0000","last_unstale":"2024-09-12T01:42:00.018020+0000","last_undegraded":"2024-09-12T01:42:00.018020+0000","last_fullsized":"2024-09-12T01:42:00.018020+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.988766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.995667+0000","last_change":"2024-09-12T01:41:58.993546+0000","last_active":"2024-09-12T01:41:59.995667+0000","last_peered":"2024-09-12T01:41:59.995667+0000","last_clean":"2024-09-12T01:41:59.995667+0000","last_became_active":"2024-09-12T01:41:58.992168+0000","last_became_peered":"2024-09-12T01:41:58.992168+0000","last_unstale":"2024-09-12T01:41:59.995667+0000","last_undegraded":"2024-09-12T01:41:59.995667+0000","last_fullsized":"2024-09-12T01:41:59.995667+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:11.336252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.995016+0000","last_change":"2024-09-12T01:41:58.994382+0000","last_active":"2024-09-12T01:41:59.995016+0000","last_peered":"2024-09-12T01:41:59.995016+0000","last_clean":"2024-09-12T01:41:59.995016+0000","last_became_active":"2024-09-12T01:41:58.994094+0000","last_became_peered":"2024-09-12T01:41:58.994094+0000","last_unstale":"2024-09-12T01:41:59.995016+0000","last_undegraded":"2024-09-12T01:41:59.995016+0000","last_fullsized":"2024-09-12T01:41:59.995016+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:13.091759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005149+0000","last_change":"2024-09-12T01:42:00.004296+0000","last_active":"2024-09-12T01:42:00.005149+0000","last_peered":"2024-09-12T01:42:00.005149+0000","last_clean":"2024-09-12T01:42:00.005149+0000","last_became_active":"2024-09-12T01:42:00.004039+0000","last_became_peered":"2024-09-12T01:42:00.004039+0000","last_unstale":"2024-09-12T01:42:00.005149+0000","last_undegraded":"2024-09-12T01:42:00.005149+0000","last_fullsized":"2024-09-12T01:42:00.005149+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:20.951224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.982305+0000","last_change":"2024-09-12T01:41:58.992765+0000","last_active":"2024-09-12T01:41:59.982305+0000","last_peered":"2024-09-12T01:41:59.982305+0000","last_clean":"2024-09-12T01:41:59.982305+0000","last_became_active":"2024-09-12T01:41:58.992493+0000","last_became_peered":"2024-09-12T01:41:58.992493+0000","last_unstale":"2024-09-12T01:41:59.982305+0000","last_undegraded":"2024-09-12T01:41:59.982305+0000","last_fullsized":"2024-09-12T01:41:59.982305+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:57.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005979+0000","last_change":"2024-09-12T01:42:00.000490+0000","last_active":"2024-09-12T01:42:00.005979+0000","last_peered":"2024-09-12T01:42:00.005979+0000","last_clean":"2024-09-12T01:42:00.005979+0000","last_became_active":"2024-09-12T01:41:59.996026+0000","last_became_peered":"2024-09-12T01:41:59.996026+0000","last_unstale":"2024-09-12T01:42:00.005979+0000","last_undegraded":"2024-09-12T01:42:00.005979+0000","last_fullsized":"2024-09-12T01:42:00.005979+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:26.698973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980607+0000","last_change":"2024-09-12T01:41:57.980607+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980607+0000","last_undegraded":"2024-09-12T01:41:57.980607+0000","last_fullsized":"2024-09-12T01:41:57.980607+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000900+0000","last_change":"2024-09-12T01:41:59.999997+0000","last_active":"2024-09-12T01:42:00.000900+0000","last_peered":"2024-09-12T01:42:00.000900+0000","last_clean":"2024-09-12T01:42:00.000900+0000","last_became_active":"2024-09-12T01:41:59.999544+0000","last_became_peered":"2024-09-12T01:41:59.999544+0000","last_unstale":"2024-09-12T01:42:00.000900+0000","last_undegraded":"2024-09-12T01:42:00.000900+0000","last_fullsized":"2024-09-12T01:42:00.000900+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:41.234974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.981931+0000","last_change":"2024-09-12T01:41:58.994797+0000","last_active":"2024-09-12T01:41:59.981931+0000","last_peered":"2024-09-12T01:41:59.981931+0000","last_clean":"2024-09-12T01:41:59.981931+0000","last_became_active":"2024-09-12T01:41:58.994442+0000","last_became_peered":"2024-09-12T01:41:58.994442+0000","last_unstale":"2024-09-12T01:41:59.981931+0000","last_undegraded":"2024-09-12T01:41:59.981931+0000","last_fullsized":"2024-09-12T01:41:59.981931+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:01.964583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007888+0000","last_change":"2024-09-12T01:42:00.006100+0000","last_active":"2024-09-12T01:42:00.007888+0000","last_peered":"2024-09-12T01:42:00.007888+0000","last_clean":"2024-09-12T01:42:00.007888+0000","last_became_active":"2024-09-12T01:42:00.005681+0000","last_became_peered":"2024-09-12T01:42:00.005681+0000","last_unstale":"2024-09-12T01:42:00.007888+0000","last_undegraded":"2024-09-12T01:42:00.007888+0000","last_fullsized":"2024-09-12T01:42:00.007888+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:23.838485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.991151+0000","last_change":"2024-09-12T01:41:58.996497+0000","last_active":"2024-09-12T01:41:59.991151+0000","last_peered":"2024-09-12T01:41:59.991151+0000","last_clean":"2024-09-12T01:41:59.991151+0000","last_became_active":"2024-09-12T01:41:58.996200+0000","last_became_peered":"2024-09-12T01:41:58.996200+0000","last_unstale":"2024-09-12T01:41:59.991151+0000","last_undegraded":"2024-09-12T01:41:59.991151+0000","last_fullsized":"2024-09-12T01:41:59.991151+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:40.919309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003931+0000","last_change":"2024-09-12T01:41:59.997655+0000","last_active":"2024-09-12T01:42:00.003931+0000","last_peered":"2024-09-12T01:42:00.003931+0000","last_clean":"2024-09-12T01:42:00.003931+0000","last_became_active":"2024-09-12T01:41:59.997190+0000","last_became_peered":"2024-09-12T01:41:59.997190+0000","last_unstale":"2024-09-12T01:42:00.003931+0000","last_undegraded":"2024-09-12T01:42:00.003931+0000","last_fullsized":"2024-09-12T01:42:00.003931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:24.280195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":89,"state":"creating+peering","last_fresh":"2024-09-12T01:41:57.980479+0000","last_change":"2024-09-12T01:41:57.980479+0000","last_active":"2024-09-12T01:41:57.969254+0000","last_peered":"2024-09-12T01:41:57.969254+0000","last_clean":"2024-09-12T01:41:57.969254+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:57.980479+0000","last_undegraded":"2024-09-12T01:41:57.980479+0000","last_fullsized":"2024-09-12T01:41:57.980479+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:41:58.971450+0000","last_change":"2024-09-12T01:41:58.971450+0000","last_active":"2024-09-12T01:41:58.971450+0000","last_peered":"2024-09-12T01:41:58.971450+0000","last_clean":"2024-09-12T01:41:58.971450+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:41:58.971450+0000","last_undegraded":"2024-09-12T01:41:58.971450+0000","last_fullsized":"2024-09-12T01:41:58.971450+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"14.f","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007123+0000","last_change":"2024-09-12T01:41:58.996923+0000","last_active":"2024-09-12T01:42:00.007123+0000","last_peered":"2024-09-12T01:42:00.007123+0000","last_clean":"2024-09-12T01:42:00.007123+0000","last_became_active":"2024-09-12T01:41:58.996587+0000","last_became_peered":"2024-09-12T01:41:58.996587+0000","last_unstale":"2024-09-12T01:42:00.007123+0000","last_undegraded":"2024-09-12T01:42:00.007123+0000","last_fullsized":"2024-09-12T01:42:00.007123+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:22.567888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":300,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.984018+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:41:59.984018+0000","last_peered":"2024-09-12T01:41:59.984018+0000","last_clean":"2024-09-12T01:41:59.984018+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:41:59.984018+0000","last_undegraded":"2024-09-12T01:41:59.984018+0000","last_fullsized":"2024-09-12T01:41:59.984018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":7},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509520,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1122304,"data_stored":470654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509518,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":470072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509518,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1732608,"data_stored":1062108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1130496,"data_stored":470266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36432,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335408,"statfs":{"total":96636764160,"available":96599457792,"internally_reserved":0,"allocated":1105920,"data_stored":463297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37012,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334828,"statfs":{"total":96636764160,"available":96598863872,"internally_reserved":0,"allocated":1699840,"data_stored":1053665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36440,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335400,"statfs":{"total":96636764160,"available":96599449600,"internally_reserved":0,"allocated":1118208,"data_stored":470072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574926,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32256,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339584,"statfs":{"total":96636764160,"available":96603734016,"internally_reserved":0,"allocated":1093632,"data_stored":457022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:42:03.680 INFO:tasks.ceph.ceph_manager.ceph:PG 15.3d is not active+clean 2024-09-12T01:42:03.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:41:58.971450+0000', 'last_change': '2024-09-12T01:41:58.971450+0000', 'last_active': '2024-09-12T01:41:58.971450+0000', 'last_peered': '2024-09-12T01:41:58.971450+0000', 'last_clean': '2024-09-12T01:41:58.971450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:58.971450+0000', 'last_undegraded': '2024-09-12T01:41:58.971450+0000', 'last_fullsized': '2024-09-12T01:41:58.971450+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:03.681 INFO:tasks.ceph.ceph_manager.ceph:PG 15.38 is not active+clean 2024-09-12T01:42:03.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:41:58.971450+0000', 'last_change': '2024-09-12T01:41:58.971450+0000', 'last_active': '2024-09-12T01:41:58.971450+0000', 'last_peered': '2024-09-12T01:41:58.971450+0000', 'last_clean': '2024-09-12T01:41:58.971450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:58.971450+0000', 'last_undegraded': '2024-09-12T01:41:58.971450+0000', 'last_fullsized': '2024-09-12T01:41:58.971450+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:03.681 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2b is not active+clean 2024-09-12T01:42:03.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:41:58.971450+0000', 'last_change': '2024-09-12T01:41:58.971450+0000', 'last_active': '2024-09-12T01:41:58.971450+0000', 'last_peered': '2024-09-12T01:41:58.971450+0000', 'last_clean': '2024-09-12T01:41:58.971450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:58.971450+0000', 'last_undegraded': '2024-09-12T01:41:58.971450+0000', 'last_fullsized': '2024-09-12T01:41:58.971450+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:03.681 INFO:tasks.ceph.ceph_manager.ceph:PG 15.2a is not active+clean 2024-09-12T01:42:03.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:41:58.971450+0000', 'last_change': '2024-09-12T01:41:58.971450+0000', 'last_active': '2024-09-12T01:41:58.971450+0000', 'last_peered': '2024-09-12T01:41:58.971450+0000', 'last_clean': '2024-09-12T01:41:58.971450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:58.971450+0000', 'last_undegraded': '2024-09-12T01:41:58.971450+0000', 'last_fullsized': '2024-09-12T01:41:58.971450+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:03.681 INFO:tasks.ceph.ceph_manager.ceph:PG 15.21 is not active+clean 2024-09-12T01:42:03.681 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:41:58.971450+0000', 'last_change': '2024-09-12T01:41:58.971450+0000', 'last_active': '2024-09-12T01:41:58.971450+0000', 'last_peered': '2024-09-12T01:41:58.971450+0000', 'last_clean': '2024-09-12T01:41:58.971450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:58.971450+0000', 'last_undegraded': '2024-09-12T01:41:58.971450+0000', 'last_fullsized': '2024-09-12T01:41:58.971450+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:03.681 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1d is not active+clean 2024-09-12T01:42:03.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:41:57.980490+0000', 'last_change': '2024-09-12T01:41:57.980490+0000', 'last_active': '2024-09-12T01:41:57.969254+0000', 'last_peered': '2024-09-12T01:41:57.969254+0000', 'last_clean': '2024-09-12T01:41:57.969254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:57.980490+0000', 'last_undegraded': '2024-09-12T01:41:57.980490+0000', 'last_fullsized': '2024-09-12T01:41:57.980490+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:42:03.682 INFO:tasks.ceph.ceph_manager.ceph:PG 14.1a is not active+clean 2024-09-12T01:42:03.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:41:57.980754+0000', 'last_change': '2024-09-12T01:41:57.980754+0000', 'last_active': '2024-09-12T01:41:57.969254+0000', 'last_peered': '2024-09-12T01:41:57.969254+0000', 'last_clean': '2024-09-12T01:41:57.969254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:57.980754+0000', 'last_undegraded': '2024-09-12T01:41:57.980754+0000', 'last_fullsized': '2024-09-12T01:41:57.980754+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:42:03.682 INFO:tasks.ceph.ceph_manager.ceph:PG 14.17 is not active+clean 2024-09-12T01:42:03.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:41:57.980744+0000', 'last_change': '2024-09-12T01:41:57.980744+0000', 'last_active': '2024-09-12T01:41:57.969254+0000', 'last_peered': '2024-09-12T01:41:57.969254+0000', 'last_clean': '2024-09-12T01:41:57.969254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:57.980744+0000', 'last_undegraded': '2024-09-12T01:41:57.980744+0000', 'last_fullsized': '2024-09-12T01:41:57.980744+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:42:03.682 INFO:tasks.ceph.ceph_manager.ceph:PG 15.13 is not active+clean 2024-09-12T01:42:03.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:41:58.971450+0000', 'last_change': '2024-09-12T01:41:58.971450+0000', 'last_active': '2024-09-12T01:41:58.971450+0000', 'last_peered': '2024-09-12T01:41:58.971450+0000', 'last_clean': '2024-09-12T01:41:58.971450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:58.971450+0000', 'last_undegraded': '2024-09-12T01:41:58.971450+0000', 'last_fullsized': '2024-09-12T01:41:58.971450+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:03.682 INFO:tasks.ceph.ceph_manager.ceph:PG 15.11 is not active+clean 2024-09-12T01:42:03.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:41:58.971450+0000', 'last_change': '2024-09-12T01:41:58.971450+0000', 'last_active': '2024-09-12T01:41:58.971450+0000', 'last_peered': '2024-09-12T01:41:58.971450+0000', 'last_clean': '2024-09-12T01:41:58.971450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:58.971450+0000', 'last_undegraded': '2024-09-12T01:41:58.971450+0000', 'last_fullsized': '2024-09-12T01:41:58.971450+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:03.682 INFO:tasks.ceph.ceph_manager.ceph:PG 14.8 is not active+clean 2024-09-12T01:42:03.682 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:41:57.982273+0000', 'last_change': '2024-09-12T01:41:57.982273+0000', 'last_active': '2024-09-12T01:41:57.969254+0000', 'last_peered': '2024-09-12T01:41:57.969254+0000', 'last_clean': '2024-09-12T01:41:57.969254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:57.982273+0000', 'last_undegraded': '2024-09-12T01:41:57.982273+0000', 'last_fullsized': '2024-09-12T01:41:57.982273+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:42:03.682 INFO:tasks.ceph.ceph_manager.ceph:PG 15.4 is not active+clean 2024-09-12T01:42:03.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:41:58.971450+0000', 'last_change': '2024-09-12T01:41:58.971450+0000', 'last_active': '2024-09-12T01:41:58.971450+0000', 'last_peered': '2024-09-12T01:41:58.971450+0000', 'last_clean': '2024-09-12T01:41:58.971450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:58.971450+0000', 'last_undegraded': '2024-09-12T01:41:58.971450+0000', 'last_fullsized': '2024-09-12T01:41:58.971450+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:03.683 INFO:tasks.ceph.ceph_manager.ceph:PG 14.3 is not active+clean 2024-09-12T01:42:03.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:41:57.980607+0000', 'last_change': '2024-09-12T01:41:57.980607+0000', 'last_active': '2024-09-12T01:41:57.969254+0000', 'last_peered': '2024-09-12T01:41:57.969254+0000', 'last_clean': '2024-09-12T01:41:57.969254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:57.980607+0000', 'last_undegraded': '2024-09-12T01:41:57.980607+0000', 'last_fullsized': '2024-09-12T01:41:57.980607+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:42:03.683 INFO:tasks.ceph.ceph_manager.ceph:PG 14.0 is not active+clean 2024-09-12T01:42:03.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 89, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:41:57.980479+0000', 'last_change': '2024-09-12T01:41:57.980479+0000', 'last_active': '2024-09-12T01:41:57.969254+0000', 'last_peered': '2024-09-12T01:41:57.969254+0000', 'last_clean': '2024-09-12T01:41:57.969254+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:57.980479+0000', 'last_undegraded': '2024-09-12T01:41:57.980479+0000', 'last_fullsized': '2024-09-12T01:41:57.980479+0000', 'mapping_epoch': 89, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 89, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:57.969254+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:42:03.683 INFO:tasks.ceph.ceph_manager.ceph:PG 15.e is not active+clean 2024-09-12T01:42:03.683 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:41:58.971450+0000', 'last_change': '2024-09-12T01:41:58.971450+0000', 'last_active': '2024-09-12T01:41:58.971450+0000', 'last_peered': '2024-09-12T01:41:58.971450+0000', 'last_clean': '2024-09-12T01:41:58.971450+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:41:58.971450+0000', 'last_undegraded': '2024-09-12T01:41:58.971450+0000', 'last_fullsized': '2024-09-12T01:41:58.971450+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'last_clean_scrub_stamp': '2024-09-12T01:41:58.971450+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:03.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:42:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.820+0000 7f3ff6645640 1 Processor -- start 2024-09-12T01:42:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.820+0000 7f3ff6645640 1 -- start start 2024-09-12T01:42:03.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3ff6645640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3ff00b74c0 0x7f3ff015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3ff6645640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ff015f030 0x7f3ff006d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3ff6645640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ff015fb10 con 0x7f3ff015c2b0 2024-09-12T01:42:03.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3ff6645640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3ff00b5900 con 0x7f3ff015f030 2024-09-12T01:42:03.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3ff6645640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3ff015f830 con 0x7f3ff00b74c0 2024-09-12T01:42:03.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3ff4be2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ff015f030 0x7f3ff006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3ff4be2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ff015f030 0x7f3ff006d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36454/0 (socket says 172.21.15.60:36454) 2024-09-12T01:42:03.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3ff4be2640 1 -- 172.21.15.60:0/1980395305 learned_addr learned my addr 172.21.15.60:0/1980395305 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:03.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3fef7fe640 1 --2- 172.21.15.60:0/1980395305 >> v2:172.21.15.105:3300/0 conn(0x7f3ff00b74c0 0x7f3ff015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3ff4be2640 1 -- 172.21.15.60:0/1980395305 >> v2:172.21.15.105:3300/0 conn(0x7f3ff00b74c0 msgr2=0x7f3ff015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:03.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3ff4be2640 1 --2- 172.21.15.60:0/1980395305 >> v2:172.21.15.105:3300/0 conn(0x7f3ff00b74c0 0x7f3ff015eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3ff4be2640 1 -- 172.21.15.60:0/1980395305 >> v1:172.21.15.105:6789/0 conn(0x7f3ff015c2b0 legacy=0x7f3ff00b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.821+0000 7f3ff4be2640 1 -- 172.21.15.60:0/1980395305 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff006ce30 con 0x7f3ff015f030 2024-09-12T01:42:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.822+0000 7f3ff4be2640 1 --2- 172.21.15.60:0/1980395305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff015f030 0x7f3ff006d910 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0071d10 tx=0x7f3fe802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947ea13a391dee46 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.822+0000 7f3feeffd640 1 -- 172.21.15.60:0/1980395305 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8036070 con 0x7f3ff015f030 2024-09-12T01:42:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.822+0000 7f3feeffd640 1 -- 172.21.15.60:0/1980395305 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe8031600 con 0x7f3ff015f030 2024-09-12T01:42:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.822+0000 7f3feeffd640 1 -- 172.21.15.60:0/1980395305 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe80319d0 con 0x7f3ff015f030 2024-09-12T01:42:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.823+0000 7f3ff6645640 1 -- 172.21.15.60:0/1980395305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff015f030 msgr2=0x7f3ff006d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.823+0000 7f3ff6645640 1 --2- 172.21.15.60:0/1980395305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff015f030 0x7f3ff006d910 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0071d10 tx=0x7f3fe802a730 comp rx=0 tx=0).stop 2024-09-12T01:42:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.823+0000 7f3ff6645640 1 -- 172.21.15.60:0/1980395305 shutdown_connections 2024-09-12T01:42:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.823+0000 7f3ff6645640 1 --2- 172.21.15.60:0/1980395305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff015f030 0x7f3ff006d910 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.823+0000 7f3ff6645640 1 --2- 172.21.15.60:0/1980395305 >> v2:172.21.15.105:3300/0 conn(0x7f3ff00b74c0 0x7f3ff015eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.823+0000 7f3ff6645640 1 -- 172.21.15.60:0/1980395305 >> 172.21.15.60:0/1980395305 conn(0x7f3ff00b4240 msgr2=0x7f3ff00b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.823+0000 7f3ff6645640 1 -- 172.21.15.60:0/1980395305 shutdown_connections 2024-09-12T01:42:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.823+0000 7f3ff6645640 1 -- 172.21.15.60:0/1980395305 wait complete. 2024-09-12T01:42:03.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.824+0000 7f3ff6645640 1 Processor -- start 2024-09-12T01:42:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.824+0000 7f3ff6645640 1 -- start start 2024-09-12T01:42:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3ff6645640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff00b74c0 0x7f3ff00cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3ff6645640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ff015c2b0 0x7f3ff0143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3ff6645640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ff015f030 0x7f3ff0143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3ff6645640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff015f480 con 0x7f3ff00b74c0 2024-09-12T01:42:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3ff6645640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff006d3f0 con 0x7f3ff015f030 2024-09-12T01:42:03.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3ff6645640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff01437b0 con 0x7f3ff015c2b0 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3feffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff00b74c0 0x7f3ff00cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3feffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff00b74c0 0x7f3ff00cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36464/0 (socket says 172.21.15.60:36464) 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3feffff640 1 -- 172.21.15.60:0/2092559973 learned_addr learned my addr 172.21.15.60:0/2092559973 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3ff4be2640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ff015f030 0x7f3ff0143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3fef7fe640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ff015c2b0 0x7f3ff0143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3feffff640 1 -- 172.21.15.60:0/2092559973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ff015c2b0 msgr2=0x7f3ff0143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3feffff640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ff015c2b0 0x7f3ff0143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3feffff640 1 -- 172.21.15.60:0/2092559973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ff015f030 msgr2=0x7f3ff0143fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3feffff640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ff015f030 0x7f3ff0143fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3feffff640 1 -- 172.21.15.60:0/2092559973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff00cc9b0 con 0x7f3ff00b74c0 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.825+0000 7f3fef7fe640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ff015c2b0 0x7f3ff0143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.826+0000 7f3feffff640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff00b74c0 0x7f3ff00cda50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000c400 tx=0x7f3fe000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:03.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.826+0000 7f3fecff9640 1 -- 172.21.15.60:0/2092559973 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00052d0 con 0x7f3ff00b74c0 2024-09-12T01:42:03.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.826+0000 7f3fecff9640 1 -- 172.21.15.60:0/2092559973 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe0005490 con 0x7f3ff00b74c0 2024-09-12T01:42:03.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.826+0000 7f3ff6645640 1 -- 172.21.15.60:0/2092559973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff00ccc90 con 0x7f3ff00b74c0 2024-09-12T01:42:03.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.826+0000 7f3fecff9640 1 -- 172.21.15.60:0/2092559973 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0007260 con 0x7f3ff00b74c0 2024-09-12T01:42:03.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.826+0000 7f3ff6645640 1 -- 172.21.15.60:0/2092559973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff00cd250 con 0x7f3ff00b74c0 2024-09-12T01:42:03.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.827+0000 7f3ff6645640 1 -- 172.21.15.60:0/2092559973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff015eaf0 con 0x7f3ff00b74c0 2024-09-12T01:42:03.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.827+0000 7f3fecff9640 1 -- 172.21.15.60:0/2092559973 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3fe0007400 con 0x7f3ff00b74c0 2024-09-12T01:42:03.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.828+0000 7f3fecff9640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3fdc06be30 0x7f3fdc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:03.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.828+0000 7f3fecff9640 1 -- 172.21.15.60:0/2092559973 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f3fe008a360 con 0x7f3ff00b74c0 2024-09-12T01:42:03.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.828+0000 7f3fef7fe640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3fdc06be30 0x7f3fdc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:03.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.828+0000 7f3fef7fe640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3fdc06be30 0x7f3fdc06e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00b3c60 tx=0x7f3fe4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:03.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:03.832+0000 7f3fecff9640 1 -- 172.21.15.60:0/2092559973 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3fe0058da0 con 0x7f3ff00b74c0 2024-09-12T01:42:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.076+0000 7f3ff6645640 1 -- 172.21.15.60:0/2092559973 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3ff015c7c0 con 0x7f3ff00b74c0 2024-09-12T01:42:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.077+0000 7f3fecff9640 1 -- 172.21.15.60:0/2092559973 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1219 (secure 0 0 0) 0x7f3fe00586a0 con 0x7f3ff00b74c0 2024-09-12T01:42:04.076 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:04.077 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":391,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":92,"num_osds":8,"num_up_osds":8,"osd_up_since":1726104944,"num_in_osds":8,"osd_in_since":1726104934,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":82},{"state_name":"unknown","count":9},{"state_name":"creating+peering","count":6}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592778,"bytes_used":282660864,"bytes_avail":772811452416,"bytes_total":773094113280,"unknown_pgs_ratio":0.092783503234386444,"inactive_pgs_ratio":0.061855670064687729,"write_bytes_sec":3278,"read_op_per_sec":0,"write_op_per_sec":9},"fsmap":{"epoch":53,"btime":"2024-09-12T01:42:01:993818+0000","id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"d","status":"up:active","gid":35732}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-12T01:40:20.318583+0000","services":{}},"progress_events":{}} 2024-09-12T01:42:04.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.079+0000 7f3ff6645640 1 -- 172.21.15.60:0/2092559973 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3fdc06be30 msgr2=0x7f3fdc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.079+0000 7f3ff6645640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3fdc06be30 0x7f3fdc06e2f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3ff00b3c60 tx=0x7f3fe4008040 comp rx=0 tx=0).stop 2024-09-12T01:42:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.079+0000 7f3ff6645640 1 -- 172.21.15.60:0/2092559973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff00b74c0 msgr2=0x7f3ff00cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.079+0000 7f3ff6645640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff00b74c0 0x7f3ff00cda50 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000c400 tx=0x7f3fe000c8c0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.079+0000 7f3ff6645640 1 -- 172.21.15.60:0/2092559973 shutdown_connections 2024-09-12T01:42:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.079+0000 7f3ff6645640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3ff015f030 0x7f3ff0143fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.079+0000 7f3ff6645640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3fdc06be30 0x7f3fdc06e2f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.079+0000 7f3ff6645640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ff015c2b0 0x7f3ff0143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.079+0000 7f3ff6645640 1 --2- 172.21.15.60:0/2092559973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ff00b74c0 0x7f3ff00cda50 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.079+0000 7f3ff6645640 1 -- 172.21.15.60:0/2092559973 >> 172.21.15.60:0/2092559973 conn(0x7f3ff00b4240 msgr2=0x7f3ff0071050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.079+0000 7f3ff6645640 1 -- 172.21.15.60:0/2092559973 shutdown_connections 2024-09-12T01:42:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.079+0000 7f3ff6645640 1 -- 172.21.15.60:0/2092559973 wait complete. 2024-09-12T01:42:04.089 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:42:04.089 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:42:04.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.192+0000 7fb04c01e640 1 Processor -- start 2024-09-12T01:42:04.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.192+0000 7fb04c01e640 1 -- start start 2024-09-12T01:42:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb04c01e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0440cfc80 0x7fb0440b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb04c01e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb04415c780 con 0x7fb044155800 2024-09-12T01:42:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb04c01e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0440b50a0 con 0x7fb04415c330 2024-09-12T01:42:04.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb04c01e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb0440b5380 con 0x7fb0440cfc80 2024-09-12T01:42:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb049dba640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb044155800 0x7fb0440cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52978/0 (socket says 172.21.15.60:52978) 2024-09-12T01:42:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb049dba640 1 -- 172.21.15.60:0/2608102525 learned_addr learned my addr 172.21.15.60:0/2608102525 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb0495b9640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0440cfc80 0x7fb0440b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996743777 0 0) 0x7fb04415c780 con 0x7fb044155800 2024-09-12T01:42:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb030003520 con 0x7fb044155800 2024-09-12T01:42:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345549584 0 0) 0x7fb0440b50a0 con 0x7fb04415c330 2024-09-12T01:42:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb04415c780 con 0x7fb04415c330 2024-09-12T01:42:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1067484751 0 0) 0x7fb030003520 con 0x7fb044155800 2024-09-12T01:42:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0440cfc80 msgr2=0x7fb0440b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb048db8640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0440cfc80 0x7fb0440b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 >> v1:172.21.15.105:6789/0 conn(0x7fb04415c330 legacy=0x7fb04415c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.193+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0440b5660 con 0x7fb044155800 2024-09-12T01:42:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fb040001670 con 0x7fb044155800 2024-09-12T01:42:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 >> v1:172.21.15.60:6789/0 conn(0x7fb044155800 legacy=0x7fb0440cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb048db8640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030003b70 0x7fb030003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb048db8640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0440cfc80 0x7fb030004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb048db8640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb030004d40 0x7fb0300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb0440b5380 con 0x7fb030003b70 2024-09-12T01:42:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb03000baa0 con 0x7fb030004d40 2024-09-12T01:42:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb03000bca0 con 0x7fb0440cfc80 2024-09-12T01:42:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb049dba640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030003b70 0x7fb030003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb0495b9640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0440cfc80 0x7fb030004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb04a5bb640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb030004d40 0x7fb0300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb049dba640 1 -- 172.21.15.60:0/2608102525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0440cfc80 msgr2=0x7fb030004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb049dba640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb0440cfc80 0x7fb030004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb049dba640 1 -- 172.21.15.60:0/2608102525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb030004d40 msgr2=0x7fb0300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb049dba640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb030004d40 0x7fb0300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb049dba640 1 -- 172.21.15.60:0/2608102525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb030003520 con 0x7fb030003b70 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.194+0000 7fb04a5bb640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb030004d40 0x7fb0300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.195+0000 7fb049dba640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030003b70 0x7fb030003f70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb04000c210 tx=0x7fb030005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44f5c383b2457fa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.195+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040007ce0 con 0x7fb030003b70 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.195+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb040005ad0 con 0x7fb030003b70 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.195+0000 7fb048db8640 1 -- 172.21.15.60:0/2608102525 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040007070 con 0x7fb030003b70 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.195+0000 7fb04c01e640 1 -- 172.21.15.60:0/2608102525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030003b70 msgr2=0x7fb030003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.195+0000 7fb04c01e640 1 --2- 172.21.15.60:0/2608102525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb030003b70 0x7fb030003f70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fb04000c210 tx=0x7fb030005830 comp rx=0 tx=0).stop 2024-09-12T01:42:04.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.195+0000 7fb04a5bb640 1 -- 172.21.15.60:0/2608102525 reap_dead start 2024-09-12T01:42:04.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.195+0000 7fb04c01e640 1 -- 172.21.15.60:0/2608102525 shutdown_connections 2024-09-12T01:42:04.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.195+0000 7fb04c01e640 1 -- 172.21.15.60:0/2608102525 >> 172.21.15.60:0/2608102525 conn(0x7fb04406bc10 msgr2=0x7fb04406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:04.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.195+0000 7fb04c01e640 1 -- 172.21.15.60:0/2608102525 shutdown_connections 2024-09-12T01:42:04.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.196+0000 7fb04c01e640 1 -- 172.21.15.60:0/2608102525 wait complete. 2024-09-12T01:42:04.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.197+0000 7fb04c01e640 1 Processor -- start 2024-09-12T01:42:04.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.197+0000 7fb04c01e640 1 -- start start 2024-09-12T01:42:04.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.197+0000 7fb04c01e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb030003b70 0x7fb044151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.197+0000 7fb04c01e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb044159830 0x7fb044159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.197+0000 7fb04c01e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0440c6fe0 0x7fb0440c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.197+0000 7fb04c01e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb044155be0 con 0x7fb0440c6fe0 2024-09-12T01:42:04.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.197+0000 7fb04c01e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb0440b5c20 con 0x7fb044159830 2024-09-12T01:42:04.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.197+0000 7fb04c01e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb0440b6140 con 0x7fb030003b70 2024-09-12T01:42:04.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb04a5bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0440c6fe0 0x7fb0440c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb04a5bb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0440c6fe0 0x7fb0440c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36472/0 (socket says 172.21.15.60:36472) 2024-09-12T01:42:04.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb04a5bb640 1 -- 172.21.15.60:0/2264284232 learned_addr learned my addr 172.21.15.60:0/2264284232 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:04.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb049dba640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb030003b70 0x7fb044151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb0495b9640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb044159830 0x7fb044159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb04a5bb640 1 -- 172.21.15.60:0/2264284232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb030003b70 msgr2=0x7fb044151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb04a5bb640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb030003b70 0x7fb044151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb04a5bb640 1 -- 172.21.15.60:0/2264284232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb044159830 msgr2=0x7fb044159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb04a5bb640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb044159830 0x7fb044159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb04a5bb640 1 -- 172.21.15.60:0/2264284232 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0441f1f90 con 0x7fb0440c6fe0 2024-09-12T01:42:04.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb049dba640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb030003b70 0x7fb044151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:04.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb0495b9640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb044159830 0x7fb044159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:04.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb04a5bb640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0440c6fe0 0x7fb0440c7460 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fb04415c710 tx=0x7fb03c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:04.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb03a7fc640 1 -- 172.21.15.60:0/2264284232 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c006b50 con 0x7fb0440c6fe0 2024-09-12T01:42:04.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb03a7fc640 1 -- 172.21.15.60:0/2264284232 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb03c006d10 con 0x7fb0440c6fe0 2024-09-12T01:42:04.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb04c01e640 1 -- 172.21.15.60:0/2264284232 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0441f2ff0 con 0x7fb0440c6fe0 2024-09-12T01:42:04.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb03a7fc640 1 -- 172.21.15.60:0/2264284232 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c003970 con 0x7fb0440c6fe0 2024-09-12T01:42:04.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.198+0000 7fb04c01e640 1 -- 172.21.15.60:0/2264284232 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0441f2230 con 0x7fb0440c6fe0 2024-09-12T01:42:04.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.199+0000 7fb04c01e640 1 -- 172.21.15.60:0/2264284232 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0440b4920 con 0x7fb0440c6fe0 2024-09-12T01:42:04.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.200+0000 7fb03a7fc640 1 -- 172.21.15.60:0/2264284232 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb03c01a020 con 0x7fb0440c6fe0 2024-09-12T01:42:04.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.200+0000 7fb03a7fc640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb02806be30 0x7fb02806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:04.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.200+0000 7fb03a7fc640 1 -- 172.21.15.60:0/2264284232 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fb03c08a4d0 con 0x7fb0440c6fe0 2024-09-12T01:42:04.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.200+0000 7fb049dba640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb02806be30 0x7fb02806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:04.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.201+0000 7fb049dba640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb02806be30 0x7fb02806e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb040001eb0 tx=0x7fb040009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:04.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.205+0000 7fb03a7fc640 1 -- 172.21.15.60:0/2264284232 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb03c058e80 con 0x7fb0440c6fe0 2024-09-12T01:42:04.375 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.376+0000 7fb04c01e640 1 -- 172.21.15.60:0/2264284232 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0440cdce0 con 0x7fb02806be30 2024-09-12T01:42:04.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.382+0000 7fb03a7fc640 1 -- 172.21.15.60:0/2264284232 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252024 (secure 0 0 0) 0x7fb0440cdce0 con 0x7fb02806be30 2024-09-12T01:42:04.384 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:04.385 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:42:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.385+0000 7fb04c01e640 1 -- 172.21.15.60:0/2264284232 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb02806be30 msgr2=0x7fb02806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.385+0000 7fb04c01e640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb02806be30 0x7fb02806e2f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb040001eb0 tx=0x7fb040009030 comp rx=0 tx=0).stop 2024-09-12T01:42:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.385+0000 7fb04c01e640 1 -- 172.21.15.60:0/2264284232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0440c6fe0 msgr2=0x7fb0440c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.385+0000 7fb04c01e640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0440c6fe0 0x7fb0440c7460 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fb04415c710 tx=0x7fb03c00eb90 comp rx=0 tx=0).stop 2024-09-12T01:42:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.385+0000 7fb04c01e640 1 -- 172.21.15.60:0/2264284232 shutdown_connections 2024-09-12T01:42:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.385+0000 7fb04c01e640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0440c6fe0 0x7fb0440c7460 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.385+0000 7fb04c01e640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb044159830 0x7fb044159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.385+0000 7fb04c01e640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb02806be30 0x7fb02806e2f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.385+0000 7fb04c01e640 1 --2- 172.21.15.60:0/2264284232 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb030003b70 0x7fb044151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.385+0000 7fb04c01e640 1 -- 172.21.15.60:0/2264284232 >> 172.21.15.60:0/2264284232 conn(0x7fb04406bc10 msgr2=0x7fb0440cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:04.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.385+0000 7fb04c01e640 1 -- 172.21.15.60:0/2264284232 shutdown_connections 2024-09-12T01:42:04.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:04.385+0000 7fb04c01e640 1 -- 172.21.15.60:0/2264284232 wait complete. 2024-09-12T01:42:04.395 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":276,"stamp":"2024-09-12T01:42:04.344012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276076,"kb_used_data":9924,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754698644,"statfs":{"total":773094113280,"available":772811411456,"internally_reserved":0,"allocated":10162176,"data_stored":4937088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001057"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.006765+0000","last_change":"2024-09-12T01:41:59.998387+0000","last_active":"2024-09-12T01:42:00.006765+0000","last_peered":"2024-09-12T01:42:00.006765+0000","last_clean":"2024-09-12T01:42:00.006765+0000","last_became_active":"2024-09-12T01:41:59.998107+0000","last_became_peered":"2024-09-12T01:41:59.998107+0000","last_unstale":"2024-09-12T01:42:00.006765+0000","last_undegraded":"2024-09-12T01:42:00.006765+0000","last_fullsized":"2024-09-12T01:42:00.006765+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:26.966614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005999+0000","last_change":"2024-09-12T01:41:59.997097+0000","last_active":"2024-09-12T01:42:00.005999+0000","last_peered":"2024-09-12T01:42:00.005999+0000","last_clean":"2024-09-12T01:42:00.005999+0000","last_became_active":"2024-09-12T01:41:59.996791+0000","last_became_peered":"2024-09-12T01:41:59.996791+0000","last_unstale":"2024-09-12T01:42:00.005999+0000","last_undegraded":"2024-09-12T01:42:00.005999+0000","last_fullsized":"2024-09-12T01:42:00.005999+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:26.435357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001349+0000","last_change":"2024-09-12T01:42:00.001779+0000","last_active":"2024-09-12T01:42:01.001349+0000","last_peered":"2024-09-12T01:42:01.001349+0000","last_clean":"2024-09-12T01:42:01.001349+0000","last_became_active":"2024-09-12T01:42:00.001499+0000","last_became_peered":"2024-09-12T01:42:00.001499+0000","last_unstale":"2024-09-12T01:42:01.001349+0000","last_undegraded":"2024-09-12T01:42:01.001349+0000","last_fullsized":"2024-09-12T01:42:01.001349+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:34.151737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015520+0000","last_change":"2024-09-12T01:42:00.010982+0000","last_active":"2024-09-12T01:42:00.015520+0000","last_peered":"2024-09-12T01:42:00.015520+0000","last_clean":"2024-09-12T01:42:00.015520+0000","last_became_active":"2024-09-12T01:42:00.010488+0000","last_became_peered":"2024-09-12T01:42:00.010488+0000","last_unstale":"2024-09-12T01:42:00.015520+0000","last_undegraded":"2024-09-12T01:42:00.015520+0000","last_fullsized":"2024-09-12T01:42:00.015520+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:57.416935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.998922+0000","last_change":"2024-09-12T01:41:59.994841+0000","last_active":"2024-09-12T01:41:59.998922+0000","last_peered":"2024-09-12T01:41:59.998922+0000","last_clean":"2024-09-12T01:41:59.998922+0000","last_became_active":"2024-09-12T01:41:59.994425+0000","last_became_peered":"2024-09-12T01:41:59.994425+0000","last_unstale":"2024-09-12T01:41:59.998922+0000","last_undegraded":"2024-09-12T01:41:59.998922+0000","last_fullsized":"2024-09-12T01:41:59.998922+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:48.845335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003010+0000","last_change":"2024-09-12T01:42:00.002035+0000","last_active":"2024-09-12T01:42:00.003010+0000","last_peered":"2024-09-12T01:42:00.003010+0000","last_clean":"2024-09-12T01:42:00.003010+0000","last_became_active":"2024-09-12T01:42:00.001739+0000","last_became_peered":"2024-09-12T01:42:00.001739+0000","last_unstale":"2024-09-12T01:42:00.003010+0000","last_undegraded":"2024-09-12T01:42:00.003010+0000","last_fullsized":"2024-09-12T01:42:00.003010+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:25.393366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.999763+0000","last_change":"2024-09-12T01:41:59.997500+0000","last_active":"2024-09-12T01:41:59.999763+0000","last_peered":"2024-09-12T01:41:59.999763+0000","last_clean":"2024-09-12T01:41:59.999763+0000","last_became_active":"2024-09-12T01:41:59.997216+0000","last_became_peered":"2024-09-12T01:41:59.997216+0000","last_unstale":"2024-09-12T01:41:59.999763+0000","last_undegraded":"2024-09-12T01:41:59.999763+0000","last_fullsized":"2024-09-12T01:41:59.999763+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:03.967861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.002693+0000","last_change":"2024-09-12T01:42:00.008368+0000","last_active":"2024-09-12T01:42:01.002693+0000","last_peered":"2024-09-12T01:42:01.002693+0000","last_clean":"2024-09-12T01:42:01.002693+0000","last_became_active":"2024-09-12T01:42:00.007998+0000","last_became_peered":"2024-09-12T01:42:00.007998+0000","last_unstale":"2024-09-12T01:42:01.002693+0000","last_undegraded":"2024-09-12T01:42:01.002693+0000","last_fullsized":"2024-09-12T01:42:01.002693+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:18.925863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000870+0000","last_change":"2024-09-12T01:41:59.999881+0000","last_active":"2024-09-12T01:42:00.000870+0000","last_peered":"2024-09-12T01:42:00.000870+0000","last_clean":"2024-09-12T01:42:00.000870+0000","last_became_active":"2024-09-12T01:41:59.999548+0000","last_became_peered":"2024-09-12T01:41:59.999548+0000","last_unstale":"2024-09-12T01:42:00.000870+0000","last_undegraded":"2024-09-12T01:42:00.000870+0000","last_fullsized":"2024-09-12T01:42:00.000870+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:42.985592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.012054+0000","last_change":"2024-09-12T01:42:00.011595+0000","last_active":"2024-09-12T01:42:00.012054+0000","last_peered":"2024-09-12T01:42:00.012054+0000","last_clean":"2024-09-12T01:42:00.012054+0000","last_became_active":"2024-09-12T01:42:00.011120+0000","last_became_peered":"2024-09-12T01:42:00.011120+0000","last_unstale":"2024-09-12T01:42:00.012054+0000","last_undegraded":"2024-09-12T01:42:00.012054+0000","last_fullsized":"2024-09-12T01:42:00.012054+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.966780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003005+0000","last_change":"2024-09-12T01:42:00.002071+0000","last_active":"2024-09-12T01:42:00.003005+0000","last_peered":"2024-09-12T01:42:00.003005+0000","last_clean":"2024-09-12T01:42:00.003005+0000","last_became_active":"2024-09-12T01:42:00.001769+0000","last_became_peered":"2024-09-12T01:42:00.001769+0000","last_unstale":"2024-09-12T01:42:00.003005+0000","last_undegraded":"2024-09-12T01:42:00.003005+0000","last_fullsized":"2024-09-12T01:42:00.003005+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:08.962516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004120+0000","last_change":"2024-09-12T01:41:59.999861+0000","last_active":"2024-09-12T01:42:00.004120+0000","last_peered":"2024-09-12T01:42:00.004120+0000","last_clean":"2024-09-12T01:42:00.004120+0000","last_became_active":"2024-09-12T01:41:59.999585+0000","last_became_peered":"2024-09-12T01:41:59.999585+0000","last_unstale":"2024-09-12T01:42:00.004120+0000","last_undegraded":"2024-09-12T01:42:00.004120+0000","last_fullsized":"2024-09-12T01:42:00.004120+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:48.815524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005291+0000","last_change":"2024-09-12T01:42:00.003453+0000","last_active":"2024-09-12T01:42:00.005291+0000","last_peered":"2024-09-12T01:42:00.005291+0000","last_clean":"2024-09-12T01:42:00.005291+0000","last_became_active":"2024-09-12T01:42:00.003168+0000","last_became_peered":"2024-09-12T01:42:00.003168+0000","last_unstale":"2024-09-12T01:42:00.005291+0000","last_undegraded":"2024-09-12T01:42:00.005291+0000","last_fullsized":"2024-09-12T01:42:00.005291+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:54.408335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008225+0000","last_change":"2024-09-12T01:41:59.999888+0000","last_active":"2024-09-12T01:42:00.008225+0000","last_peered":"2024-09-12T01:42:00.008225+0000","last_clean":"2024-09-12T01:42:00.008225+0000","last_became_active":"2024-09-12T01:41:59.999191+0000","last_became_peered":"2024-09-12T01:41:59.999191+0000","last_unstale":"2024-09-12T01:42:00.008225+0000","last_undegraded":"2024-09-12T01:42:00.008225+0000","last_fullsized":"2024-09-12T01:42:00.008225+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:09.385413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008783+0000","last_change":"2024-09-12T01:42:00.000266+0000","last_active":"2024-09-12T01:42:00.008783+0000","last_peered":"2024-09-12T01:42:00.008783+0000","last_clean":"2024-09-12T01:42:00.008783+0000","last_became_active":"2024-09-12T01:42:00.000010+0000","last_became_peered":"2024-09-12T01:42:00.000010+0000","last_unstale":"2024-09-12T01:42:00.008783+0000","last_undegraded":"2024-09-12T01:42:00.008783+0000","last_fullsized":"2024-09-12T01:42:00.008783+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:58.296601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.999088+0000","last_change":"2024-09-12T01:41:59.996542+0000","last_active":"2024-09-12T01:41:59.999088+0000","last_peered":"2024-09-12T01:41:59.999088+0000","last_clean":"2024-09-12T01:41:59.999088+0000","last_became_active":"2024-09-12T01:41:59.996199+0000","last_became_peered":"2024-09-12T01:41:59.996199+0000","last_unstale":"2024-09-12T01:41:59.999088+0000","last_undegraded":"2024-09-12T01:41:59.999088+0000","last_fullsized":"2024-09-12T01:41:59.999088+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:29.618613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008916+0000","last_change":"2024-09-12T01:42:00.006742+0000","last_active":"2024-09-12T01:42:00.008916+0000","last_peered":"2024-09-12T01:42:00.008916+0000","last_clean":"2024-09-12T01:42:00.008916+0000","last_became_active":"2024-09-12T01:42:00.006366+0000","last_became_peered":"2024-09-12T01:42:00.006366+0000","last_unstale":"2024-09-12T01:42:00.008916+0000","last_undegraded":"2024-09-12T01:42:00.008916+0000","last_fullsized":"2024-09-12T01:42:00.008916+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:51.680001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008682+0000","last_change":"2024-09-12T01:42:00.000351+0000","last_active":"2024-09-12T01:42:00.008682+0000","last_peered":"2024-09-12T01:42:00.008682+0000","last_clean":"2024-09-12T01:42:00.008682+0000","last_became_active":"2024-09-12T01:41:59.999753+0000","last_became_peered":"2024-09-12T01:41:59.999753+0000","last_unstale":"2024-09-12T01:42:00.008682+0000","last_undegraded":"2024-09-12T01:42:00.008682+0000","last_fullsized":"2024-09-12T01:42:00.008682+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:04.822297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.017795+0000","last_change":"2024-09-12T01:42:00.013386+0000","last_active":"2024-09-12T01:42:00.017795+0000","last_peered":"2024-09-12T01:42:00.017795+0000","last_clean":"2024-09-12T01:42:00.017795+0000","last_became_active":"2024-09-12T01:42:00.013088+0000","last_became_peered":"2024-09-12T01:42:00.013088+0000","last_unstale":"2024-09-12T01:42:00.017795+0000","last_undegraded":"2024-09-12T01:42:00.017795+0000","last_fullsized":"2024-09-12T01:42:00.017795+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:58.449274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000474+0000","last_change":"2024-09-12T01:41:59.994130+0000","last_active":"2024-09-12T01:42:00.000474+0000","last_peered":"2024-09-12T01:42:00.000474+0000","last_clean":"2024-09-12T01:42:00.000474+0000","last_became_active":"2024-09-12T01:41:59.993627+0000","last_became_peered":"2024-09-12T01:41:59.993627+0000","last_unstale":"2024-09-12T01:42:00.000474+0000","last_undegraded":"2024-09-12T01:42:00.000474+0000","last_fullsized":"2024-09-12T01:42:00.000474+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:33.582260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001716+0000","last_change":"2024-09-12T01:42:00.002717+0000","last_active":"2024-09-12T01:42:01.001716+0000","last_peered":"2024-09-12T01:42:01.001716+0000","last_clean":"2024-09-12T01:42:01.001716+0000","last_became_active":"2024-09-12T01:42:00.002464+0000","last_became_peered":"2024-09-12T01:42:00.002464+0000","last_unstale":"2024-09-12T01:42:01.001716+0000","last_undegraded":"2024-09-12T01:42:01.001716+0000","last_fullsized":"2024-09-12T01:42:01.001716+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:43.583357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001374+0000","last_change":"2024-09-12T01:42:00.000856+0000","last_active":"2024-09-12T01:42:01.001374+0000","last_peered":"2024-09-12T01:42:01.001374+0000","last_clean":"2024-09-12T01:42:01.001374+0000","last_became_active":"2024-09-12T01:42:00.000592+0000","last_became_peered":"2024-09-12T01:42:00.000592+0000","last_unstale":"2024-09-12T01:42:01.001374+0000","last_undegraded":"2024-09-12T01:42:01.001374+0000","last_fullsized":"2024-09-12T01:42:01.001374+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:34.217087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007599+0000","last_change":"2024-09-12T01:41:59.998620+0000","last_active":"2024-09-12T01:42:00.007599+0000","last_peered":"2024-09-12T01:42:00.007599+0000","last_clean":"2024-09-12T01:42:00.007599+0000","last_became_active":"2024-09-12T01:41:59.998314+0000","last_became_peered":"2024-09-12T01:41:59.998314+0000","last_unstale":"2024-09-12T01:42:00.007599+0000","last_undegraded":"2024-09-12T01:42:00.007599+0000","last_fullsized":"2024-09-12T01:42:00.007599+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:28.832878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.011785+0000","last_change":"2024-09-12T01:42:00.010724+0000","last_active":"2024-09-12T01:42:00.011785+0000","last_peered":"2024-09-12T01:42:00.011785+0000","last_clean":"2024-09-12T01:42:00.011785+0000","last_became_active":"2024-09-12T01:42:00.010364+0000","last_became_peered":"2024-09-12T01:42:00.010364+0000","last_unstale":"2024-09-12T01:42:00.011785+0000","last_undegraded":"2024-09-12T01:42:00.011785+0000","last_fullsized":"2024-09-12T01:42:00.011785+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:14.093956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004638+0000","last_change":"2024-09-12T01:42:00.003822+0000","last_active":"2024-09-12T01:42:00.004638+0000","last_peered":"2024-09-12T01:42:00.004638+0000","last_clean":"2024-09-12T01:42:00.004638+0000","last_became_active":"2024-09-12T01:42:00.003374+0000","last_became_peered":"2024-09-12T01:42:00.003374+0000","last_unstale":"2024-09-12T01:42:00.004638+0000","last_undegraded":"2024-09-12T01:42:00.004638+0000","last_fullsized":"2024-09-12T01:42:00.004638+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:28.832878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.996779+0000","last_change":"2024-09-12T01:41:59.995775+0000","last_active":"2024-09-12T01:41:59.996779+0000","last_peered":"2024-09-12T01:41:59.996779+0000","last_clean":"2024-09-12T01:41:59.996779+0000","last_became_active":"2024-09-12T01:41:59.995503+0000","last_became_peered":"2024-09-12T01:41:59.995503+0000","last_unstale":"2024-09-12T01:41:59.996779+0000","last_undegraded":"2024-09-12T01:41:59.996779+0000","last_fullsized":"2024-09-12T01:41:59.996779+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:34.971636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004779+0000","last_change":"2024-09-12T01:42:00.003066+0000","last_active":"2024-09-12T01:42:00.004779+0000","last_peered":"2024-09-12T01:42:00.004779+0000","last_clean":"2024-09-12T01:42:00.004779+0000","last_became_active":"2024-09-12T01:42:00.002796+0000","last_became_peered":"2024-09-12T01:42:00.002796+0000","last_unstale":"2024-09-12T01:42:00.004779+0000","last_undegraded":"2024-09-12T01:42:00.004779+0000","last_fullsized":"2024-09-12T01:42:00.004779+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:23.856078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004651+0000","last_change":"2024-09-12T01:41:59.995567+0000","last_active":"2024-09-12T01:42:00.004651+0000","last_peered":"2024-09-12T01:42:00.004651+0000","last_clean":"2024-09-12T01:42:00.004651+0000","last_became_active":"2024-09-12T01:41:59.995275+0000","last_became_peered":"2024-09-12T01:41:59.995275+0000","last_unstale":"2024-09-12T01:42:00.004651+0000","last_undegraded":"2024-09-12T01:42:00.004651+0000","last_fullsized":"2024-09-12T01:42:00.004651+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:13.659299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007006+0000","last_change":"2024-09-12T01:42:00.004709+0000","last_active":"2024-09-12T01:42:00.007006+0000","last_peered":"2024-09-12T01:42:00.007006+0000","last_clean":"2024-09-12T01:42:00.007006+0000","last_became_active":"2024-09-12T01:42:00.004413+0000","last_became_peered":"2024-09-12T01:42:00.004413+0000","last_unstale":"2024-09-12T01:42:00.007006+0000","last_undegraded":"2024-09-12T01:42:00.007006+0000","last_fullsized":"2024-09-12T01:42:00.007006+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:14.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003886+0000","last_change":"2024-09-12T01:42:00.001460+0000","last_active":"2024-09-12T01:42:00.003886+0000","last_peered":"2024-09-12T01:42:00.003886+0000","last_clean":"2024-09-12T01:42:00.003886+0000","last_became_active":"2024-09-12T01:42:00.001111+0000","last_became_peered":"2024-09-12T01:42:00.001111+0000","last_unstale":"2024-09-12T01:42:00.003886+0000","last_undegraded":"2024-09-12T01:42:00.003886+0000","last_fullsized":"2024-09-12T01:42:00.003886+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:28.435193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001327+0000","last_change":"2024-09-12T01:42:00.003646+0000","last_active":"2024-09-12T01:42:01.001327+0000","last_peered":"2024-09-12T01:42:01.001327+0000","last_clean":"2024-09-12T01:42:01.001327+0000","last_became_active":"2024-09-12T01:42:00.003395+0000","last_became_peered":"2024-09-12T01:42:00.003395+0000","last_unstale":"2024-09-12T01:42:01.001327+0000","last_undegraded":"2024-09-12T01:42:01.001327+0000","last_fullsized":"2024-09-12T01:42:01.001327+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:56.051271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015473+0000","last_change":"2024-09-12T01:42:00.010691+0000","last_active":"2024-09-12T01:42:00.015473+0000","last_peered":"2024-09-12T01:42:00.015473+0000","last_clean":"2024-09-12T01:42:00.015473+0000","last_became_active":"2024-09-12T01:42:00.010426+0000","last_became_peered":"2024-09-12T01:42:00.010426+0000","last_unstale":"2024-09-12T01:42:00.015473+0000","last_undegraded":"2024-09-12T01:42:00.015473+0000","last_fullsized":"2024-09-12T01:42:00.015473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:53.113663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007551+0000","last_change":"2024-09-12T01:42:00.002800+0000","last_active":"2024-09-12T01:42:00.007551+0000","last_peered":"2024-09-12T01:42:00.007551+0000","last_clean":"2024-09-12T01:42:00.007551+0000","last_became_active":"2024-09-12T01:42:00.002533+0000","last_became_peered":"2024-09-12T01:42:00.002533+0000","last_unstale":"2024-09-12T01:42:00.007551+0000","last_undegraded":"2024-09-12T01:42:00.007551+0000","last_fullsized":"2024-09-12T01:42:00.007551+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:46.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"91'4","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.001313+0000","last_change":"2024-09-12T01:41:58.988426+0000","last_active":"2024-09-12T01:42:00.001313+0000","last_peered":"2024-09-12T01:42:00.001313+0000","last_clean":"2024-09-12T01:42:00.001313+0000","last_became_active":"2024-09-12T01:41:58.988130+0000","last_became_peered":"2024-09-12T01:41:58.988130+0000","last_unstale":"2024-09-12T01:42:00.001313+0000","last_undegraded":"2024-09-12T01:42:00.001313+0000","last_fullsized":"2024-09-12T01:42:00.001313+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:19.475865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005320+0000","last_change":"2024-09-12T01:42:00.004520+0000","last_active":"2024-09-12T01:42:00.005320+0000","last_peered":"2024-09-12T01:42:00.005320+0000","last_clean":"2024-09-12T01:42:00.005320+0000","last_became_active":"2024-09-12T01:42:00.004193+0000","last_became_peered":"2024-09-12T01:42:00.004193+0000","last_unstale":"2024-09-12T01:42:00.005320+0000","last_undegraded":"2024-09-12T01:42:00.005320+0000","last_fullsized":"2024-09-12T01:42:00.005320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:33.609574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.998645+0000","last_change":"2024-09-12T01:41:58.992984+0000","last_active":"2024-09-12T01:41:59.998645+0000","last_peered":"2024-09-12T01:41:59.998645+0000","last_clean":"2024-09-12T01:41:59.998645+0000","last_became_active":"2024-09-12T01:41:58.992669+0000","last_became_peered":"2024-09-12T01:41:58.992669+0000","last_unstale":"2024-09-12T01:41:59.998645+0000","last_undegraded":"2024-09-12T01:41:59.998645+0000","last_fullsized":"2024-09-12T01:41:59.998645+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.589596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.010165+0000","last_change":"2024-09-12T01:42:00.008281+0000","last_active":"2024-09-12T01:42:00.010165+0000","last_peered":"2024-09-12T01:42:00.010165+0000","last_clean":"2024-09-12T01:42:00.010165+0000","last_became_active":"2024-09-12T01:42:00.007920+0000","last_became_peered":"2024-09-12T01:42:00.007920+0000","last_unstale":"2024-09-12T01:42:00.010165+0000","last_undegraded":"2024-09-12T01:42:00.010165+0000","last_fullsized":"2024-09-12T01:42:00.010165+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:13.659299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"91'2","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001409+0000","last_change":"2024-09-12T01:41:58.990722+0000","last_active":"2024-09-12T01:42:01.001409+0000","last_peered":"2024-09-12T01:42:01.001409+0000","last_clean":"2024-09-12T01:42:01.001409+0000","last_became_active":"2024-09-12T01:41:58.990360+0000","last_became_peered":"2024-09-12T01:41:58.990360+0000","last_unstale":"2024-09-12T01:42:01.001409+0000","last_undegraded":"2024-09-12T01:42:01.001409+0000","last_fullsized":"2024-09-12T01:42:01.001409+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:59.328158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008227+0000","last_change":"2024-09-12T01:42:00.007543+0000","last_active":"2024-09-12T01:42:00.008227+0000","last_peered":"2024-09-12T01:42:00.008227+0000","last_clean":"2024-09-12T01:42:00.008227+0000","last_became_active":"2024-09-12T01:42:00.006466+0000","last_became_peered":"2024-09-12T01:42:00.006466+0000","last_unstale":"2024-09-12T01:42:00.008227+0000","last_undegraded":"2024-09-12T01:42:00.008227+0000","last_fullsized":"2024-09-12T01:42:00.008227+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:09.385413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.009099+0000","last_change":"2024-09-12T01:41:58.997786+0000","last_active":"2024-09-12T01:42:00.009099+0000","last_peered":"2024-09-12T01:42:00.009099+0000","last_clean":"2024-09-12T01:42:00.009099+0000","last_became_active":"2024-09-12T01:41:58.997540+0000","last_became_peered":"2024-09-12T01:41:58.997540+0000","last_unstale":"2024-09-12T01:42:00.009099+0000","last_undegraded":"2024-09-12T01:42:00.009099+0000","last_fullsized":"2024-09-12T01:42:00.009099+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:14.484863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000498+0000","last_change":"2024-09-12T01:41:59.993413+0000","last_active":"2024-09-12T01:42:00.000498+0000","last_peered":"2024-09-12T01:42:00.000498+0000","last_clean":"2024-09-12T01:42:00.000498+0000","last_became_active":"2024-09-12T01:41:59.992374+0000","last_became_peered":"2024-09-12T01:41:59.992374+0000","last_unstale":"2024-09-12T01:42:00.000498+0000","last_undegraded":"2024-09-12T01:42:00.000498+0000","last_fullsized":"2024-09-12T01:42:00.000498+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:26.760592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.011460+0000","last_change":"2024-09-12T01:41:58.996374+0000","last_active":"2024-09-12T01:42:00.011460+0000","last_peered":"2024-09-12T01:42:00.011460+0000","last_clean":"2024-09-12T01:42:00.011460+0000","last_became_active":"2024-09-12T01:41:58.996057+0000","last_became_peered":"2024-09-12T01:41:58.996057+0000","last_unstale":"2024-09-12T01:42:00.011460+0000","last_undegraded":"2024-09-12T01:42:00.011460+0000","last_fullsized":"2024-09-12T01:42:00.011460+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:53.915640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.999122+0000","last_change":"2024-09-12T01:41:59.995738+0000","last_active":"2024-09-12T01:41:59.999122+0000","last_peered":"2024-09-12T01:41:59.999122+0000","last_clean":"2024-09-12T01:41:59.999122+0000","last_became_active":"2024-09-12T01:41:59.995444+0000","last_became_peered":"2024-09-12T01:41:59.995444+0000","last_unstale":"2024-09-12T01:41:59.999122+0000","last_undegraded":"2024-09-12T01:41:59.999122+0000","last_fullsized":"2024-09-12T01:41:59.999122+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:14.525743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"91'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001327+0000","last_change":"2024-09-12T01:41:58.990641+0000","last_active":"2024-09-12T01:42:01.001327+0000","last_peered":"2024-09-12T01:42:01.001327+0000","last_clean":"2024-09-12T01:42:01.001327+0000","last_became_active":"2024-09-12T01:41:58.989695+0000","last_became_peered":"2024-09-12T01:41:58.989695+0000","last_unstale":"2024-09-12T01:42:01.001327+0000","last_undegraded":"2024-09-12T01:42:01.001327+0000","last_fullsized":"2024-09-12T01:42:01.001327+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:13.876725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.006976+0000","last_change":"2024-09-12T01:42:00.005090+0000","last_active":"2024-09-12T01:42:00.006976+0000","last_peered":"2024-09-12T01:42:00.006976+0000","last_clean":"2024-09-12T01:42:00.006976+0000","last_became_active":"2024-09-12T01:42:00.004601+0000","last_became_peered":"2024-09-12T01:42:00.004601+0000","last_unstale":"2024-09-12T01:42:00.006976+0000","last_undegraded":"2024-09-12T01:42:00.006976+0000","last_fullsized":"2024-09-12T01:42:00.006976+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:47.262836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.990294+0000","last_change":"2024-09-12T01:41:58.989687+0000","last_active":"2024-09-12T01:41:59.990294+0000","last_peered":"2024-09-12T01:41:59.990294+0000","last_clean":"2024-09-12T01:41:59.990294+0000","last_became_active":"2024-09-12T01:41:58.989372+0000","last_became_peered":"2024-09-12T01:41:58.989372+0000","last_unstale":"2024-09-12T01:41:59.990294+0000","last_undegraded":"2024-09-12T01:41:59.990294+0000","last_fullsized":"2024-09-12T01:41:59.990294+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:00.390233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000300+0000","last_change":"2024-09-12T01:41:59.991854+0000","last_active":"2024-09-12T01:42:00.000300+0000","last_peered":"2024-09-12T01:42:00.000300+0000","last_clean":"2024-09-12T01:42:00.000300+0000","last_became_active":"2024-09-12T01:41:59.991577+0000","last_became_peered":"2024-09-12T01:41:59.991577+0000","last_unstale":"2024-09-12T01:42:00.000300+0000","last_undegraded":"2024-09-12T01:42:00.000300+0000","last_fullsized":"2024-09-12T01:42:00.000300+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:13.714369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.994992+0000","last_change":"2024-09-12T01:41:58.997889+0000","last_active":"2024-09-12T01:41:59.994992+0000","last_peered":"2024-09-12T01:41:59.994992+0000","last_clean":"2024-09-12T01:41:59.994992+0000","last_became_active":"2024-09-12T01:41:58.997469+0000","last_became_peered":"2024-09-12T01:41:58.997469+0000","last_unstale":"2024-09-12T01:41:59.994992+0000","last_undegraded":"2024-09-12T01:41:59.994992+0000","last_fullsized":"2024-09-12T01:41:59.994992+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:22.853882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015512+0000","last_change":"2024-09-12T01:42:00.010808+0000","last_active":"2024-09-12T01:42:00.015512+0000","last_peered":"2024-09-12T01:42:00.015512+0000","last_clean":"2024-09-12T01:42:00.015512+0000","last_became_active":"2024-09-12T01:42:00.010535+0000","last_became_peered":"2024-09-12T01:42:00.010535+0000","last_unstale":"2024-09-12T01:42:00.015512+0000","last_undegraded":"2024-09-12T01:42:00.015512+0000","last_fullsized":"2024-09-12T01:42:00.015512+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:01.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001022+0000","last_change":"2024-09-12T01:41:58.985309+0000","last_active":"2024-09-12T01:42:01.001022+0000","last_peered":"2024-09-12T01:42:01.001022+0000","last_clean":"2024-09-12T01:42:01.001022+0000","last_became_active":"2024-09-12T01:41:58.985006+0000","last_became_peered":"2024-09-12T01:41:58.985006+0000","last_unstale":"2024-09-12T01:42:01.001022+0000","last_undegraded":"2024-09-12T01:42:01.001022+0000","last_fullsized":"2024-09-12T01:42:01.001022+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:02.928877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.002425+0000","last_change":"2024-09-12T01:41:59.996189+0000","last_active":"2024-09-12T01:42:00.002425+0000","last_peered":"2024-09-12T01:42:00.002425+0000","last_clean":"2024-09-12T01:42:00.002425+0000","last_became_active":"2024-09-12T01:41:59.995894+0000","last_became_peered":"2024-09-12T01:41:59.995894+0000","last_unstale":"2024-09-12T01:42:00.002425+0000","last_undegraded":"2024-09-12T01:42:00.002425+0000","last_fullsized":"2024-09-12T01:42:00.002425+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:53.113663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.985390+0000","last_change":"2024-09-12T01:41:58.996582+0000","last_active":"2024-09-12T01:41:59.985390+0000","last_peered":"2024-09-12T01:41:59.985390+0000","last_clean":"2024-09-12T01:41:59.985390+0000","last_became_active":"2024-09-12T01:41:58.996289+0000","last_became_peered":"2024-09-12T01:41:58.996289+0000","last_unstale":"2024-09-12T01:41:59.985390+0000","last_undegraded":"2024-09-12T01:41:59.985390+0000","last_fullsized":"2024-09-12T01:41:59.985390+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:45.266662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.009813+0000","last_change":"2024-09-12T01:42:00.009375+0000","last_active":"2024-09-12T01:42:00.009813+0000","last_peered":"2024-09-12T01:42:00.009813+0000","last_clean":"2024-09-12T01:42:00.009813+0000","last_became_active":"2024-09-12T01:42:00.009071+0000","last_became_peered":"2024-09-12T01:42:00.009071+0000","last_unstale":"2024-09-12T01:42:00.009813+0000","last_undegraded":"2024-09-12T01:42:00.009813+0000","last_fullsized":"2024-09-12T01:42:00.009813+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:13.033896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"91'3","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005079+0000","last_change":"2024-09-12T01:41:58.992505+0000","last_active":"2024-09-12T01:42:00.005079+0000","last_peered":"2024-09-12T01:42:00.005079+0000","last_clean":"2024-09-12T01:42:00.005079+0000","last_became_active":"2024-09-12T01:41:58.992076+0000","last_became_peered":"2024-09-12T01:41:58.992076+0000","last_unstale":"2024-09-12T01:42:00.005079+0000","last_undegraded":"2024-09-12T01:42:00.005079+0000","last_fullsized":"2024-09-12T01:42:00.005079+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:15.078082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004528+0000","last_change":"2024-09-12T01:42:00.002167+0000","last_active":"2024-09-12T01:42:00.004528+0000","last_peered":"2024-09-12T01:42:00.004528+0000","last_clean":"2024-09-12T01:42:00.004528+0000","last_became_active":"2024-09-12T01:42:00.001838+0000","last_became_peered":"2024-09-12T01:42:00.001838+0000","last_unstale":"2024-09-12T01:42:00.004528+0000","last_undegraded":"2024-09-12T01:42:00.004528+0000","last_fullsized":"2024-09-12T01:42:00.004528+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:57.416935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"91'6","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.015524+0000","last_change":"2024-09-12T01:41:58.996508+0000","last_active":"2024-09-12T01:42:00.015524+0000","last_peered":"2024-09-12T01:42:00.015524+0000","last_clean":"2024-09-12T01:42:00.015524+0000","last_became_active":"2024-09-12T01:41:58.995956+0000","last_became_peered":"2024-09-12T01:41:58.995956+0000","last_unstale":"2024-09-12T01:42:00.015524+0000","last_undegraded":"2024-09-12T01:42:00.015524+0000","last_fullsized":"2024-09-12T01:42:00.015524+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:55.108765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008246+0000","last_change":"2024-09-12T01:41:59.999914+0000","last_active":"2024-09-12T01:42:00.008246+0000","last_peered":"2024-09-12T01:42:00.008246+0000","last_clean":"2024-09-12T01:42:00.008246+0000","last_became_active":"2024-09-12T01:41:59.999540+0000","last_became_peered":"2024-09-12T01:41:59.999540+0000","last_unstale":"2024-09-12T01:42:00.008246+0000","last_undegraded":"2024-09-12T01:42:00.008246+0000","last_fullsized":"2024-09-12T01:42:00.008246+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:02.966780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007201+0000","last_change":"2024-09-12T01:41:58.991672+0000","last_active":"2024-09-12T01:42:00.007201+0000","last_peered":"2024-09-12T01:42:00.007201+0000","last_clean":"2024-09-12T01:42:00.007201+0000","last_became_active":"2024-09-12T01:41:58.991363+0000","last_became_peered":"2024-09-12T01:41:58.991363+0000","last_unstale":"2024-09-12T01:42:00.007201+0000","last_undegraded":"2024-09-12T01:42:00.007201+0000","last_fullsized":"2024-09-12T01:42:00.007201+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:24.678504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001860+0000","last_change":"2024-09-12T01:42:00.008596+0000","last_active":"2024-09-12T01:42:01.001860+0000","last_peered":"2024-09-12T01:42:01.001860+0000","last_clean":"2024-09-12T01:42:01.001860+0000","last_became_active":"2024-09-12T01:42:00.008348+0000","last_became_peered":"2024-09-12T01:42:00.008348+0000","last_unstale":"2024-09-12T01:42:01.001860+0000","last_undegraded":"2024-09-12T01:42:01.001860+0000","last_fullsized":"2024-09-12T01:42:01.001860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:47.796921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.985648+0000","last_change":"2024-09-12T01:41:58.996856+0000","last_active":"2024-09-12T01:41:59.985648+0000","last_peered":"2024-09-12T01:41:59.985648+0000","last_clean":"2024-09-12T01:41:59.985648+0000","last_became_active":"2024-09-12T01:41:58.995624+0000","last_became_peered":"2024-09-12T01:41:58.995624+0000","last_unstale":"2024-09-12T01:41:59.985648+0000","last_undegraded":"2024-09-12T01:41:59.985648+0000","last_fullsized":"2024-09-12T01:41:59.985648+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:06.324090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.998809+0000","last_change":"2024-09-12T01:41:59.993089+0000","last_active":"2024-09-12T01:41:59.998809+0000","last_peered":"2024-09-12T01:41:59.998809+0000","last_clean":"2024-09-12T01:41:59.998809+0000","last_became_active":"2024-09-12T01:41:59.992817+0000","last_became_peered":"2024-09-12T01:41:59.992817+0000","last_unstale":"2024-09-12T01:41:59.998809+0000","last_undegraded":"2024-09-12T01:41:59.998809+0000","last_fullsized":"2024-09-12T01:41:59.998809+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:46.214683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.984192+0000","last_change":"2024-09-12T01:41:58.993719+0000","last_active":"2024-09-12T01:41:59.984192+0000","last_peered":"2024-09-12T01:41:59.984192+0000","last_clean":"2024-09-12T01:41:59.984192+0000","last_became_active":"2024-09-12T01:41:58.993224+0000","last_became_peered":"2024-09-12T01:41:58.993224+0000","last_unstale":"2024-09-12T01:41:59.984192+0000","last_undegraded":"2024-09-12T01:41:59.984192+0000","last_fullsized":"2024-09-12T01:41:59.984192+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:58.987546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001322+0000","last_change":"2024-09-12T01:41:59.997694+0000","last_active":"2024-09-12T01:42:01.001322+0000","last_peered":"2024-09-12T01:42:01.001322+0000","last_clean":"2024-09-12T01:42:01.001322+0000","last_became_active":"2024-09-12T01:41:59.997374+0000","last_became_peered":"2024-09-12T01:41:59.997374+0000","last_unstale":"2024-09-12T01:42:01.001322+0000","last_undegraded":"2024-09-12T01:42:01.001322+0000","last_fullsized":"2024-09-12T01:42:01.001322+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:54.512197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"91'8","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.011250+0000","last_change":"2024-09-12T01:41:58.991776+0000","last_active":"2024-09-12T01:42:00.011250+0000","last_peered":"2024-09-12T01:42:00.011250+0000","last_clean":"2024-09-12T01:42:00.011250+0000","last_became_active":"2024-09-12T01:41:58.991511+0000","last_became_peered":"2024-09-12T01:41:58.991511+0000","last_unstale":"2024-09-12T01:42:00.011250+0000","last_undegraded":"2024-09-12T01:42:00.011250+0000","last_fullsized":"2024-09-12T01:42:00.011250+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.831543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.991264+0000","last_change":"2024-09-12T01:41:59.987898+0000","last_active":"2024-09-12T01:41:59.991264+0000","last_peered":"2024-09-12T01:41:59.991264+0000","last_clean":"2024-09-12T01:41:59.991264+0000","last_became_active":"2024-09-12T01:41:59.987625+0000","last_became_peered":"2024-09-12T01:41:59.987625+0000","last_unstale":"2024-09-12T01:41:59.991264+0000","last_undegraded":"2024-09-12T01:41:59.991264+0000","last_fullsized":"2024-09-12T01:41:59.991264+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:04.822297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.001058+0000","last_change":"2024-09-12T01:41:58.996161+0000","last_active":"2024-09-12T01:42:00.001058+0000","last_peered":"2024-09-12T01:42:00.001058+0000","last_clean":"2024-09-12T01:42:00.001058+0000","last_became_active":"2024-09-12T01:41:58.995854+0000","last_became_peered":"2024-09-12T01:41:58.995854+0000","last_unstale":"2024-09-12T01:42:00.001058+0000","last_undegraded":"2024-09-12T01:42:00.001058+0000","last_fullsized":"2024-09-12T01:42:00.001058+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:04.272253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.996013+0000","last_change":"2024-09-12T01:41:59.992362+0000","last_active":"2024-09-12T01:41:59.996013+0000","last_peered":"2024-09-12T01:41:59.996013+0000","last_clean":"2024-09-12T01:41:59.996013+0000","last_became_active":"2024-09-12T01:41:59.992048+0000","last_became_peered":"2024-09-12T01:41:59.992048+0000","last_unstale":"2024-09-12T01:41:59.996013+0000","last_undegraded":"2024-09-12T01:41:59.996013+0000","last_fullsized":"2024-09-12T01:41:59.996013+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:37.604923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003203+0000","last_change":"2024-09-12T01:41:58.990373+0000","last_active":"2024-09-12T01:42:00.003203+0000","last_peered":"2024-09-12T01:42:00.003203+0000","last_clean":"2024-09-12T01:42:00.003203+0000","last_became_active":"2024-09-12T01:41:58.990079+0000","last_became_peered":"2024-09-12T01:41:58.990079+0000","last_unstale":"2024-09-12T01:42:00.003203+0000","last_undegraded":"2024-09-12T01:42:00.003203+0000","last_fullsized":"2024-09-12T01:42:00.003203+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:03.731788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003934+0000","last_change":"2024-09-12T01:41:59.999108+0000","last_active":"2024-09-12T01:42:00.003934+0000","last_peered":"2024-09-12T01:42:00.003934+0000","last_clean":"2024-09-12T01:42:00.003934+0000","last_became_active":"2024-09-12T01:41:59.998824+0000","last_became_peered":"2024-09-12T01:41:59.998824+0000","last_unstale":"2024-09-12T01:42:00.003934+0000","last_undegraded":"2024-09-12T01:42:00.003934+0000","last_fullsized":"2024-09-12T01:42:00.003934+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:54.917836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.994358+0000","last_change":"2024-09-12T01:41:58.997460+0000","last_active":"2024-09-12T01:41:59.994358+0000","last_peered":"2024-09-12T01:41:59.994358+0000","last_clean":"2024-09-12T01:41:59.994358+0000","last_became_active":"2024-09-12T01:41:58.996445+0000","last_became_peered":"2024-09-12T01:41:58.996445+0000","last_unstale":"2024-09-12T01:41:59.994358+0000","last_undegraded":"2024-09-12T01:41:59.994358+0000","last_fullsized":"2024-09-12T01:41:59.994358+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:56.414738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005924+0000","last_change":"2024-09-12T01:41:59.999188+0000","last_active":"2024-09-12T01:42:00.005924+0000","last_peered":"2024-09-12T01:42:00.005924+0000","last_clean":"2024-09-12T01:42:00.005924+0000","last_became_active":"2024-09-12T01:41:59.998893+0000","last_became_peered":"2024-09-12T01:41:59.998893+0000","last_unstale":"2024-09-12T01:42:00.005924+0000","last_undegraded":"2024-09-12T01:42:00.005924+0000","last_fullsized":"2024-09-12T01:42:00.005924+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:20.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.012686+0000","last_change":"2024-09-12T01:41:58.997143+0000","last_active":"2024-09-12T01:42:00.012686+0000","last_peered":"2024-09-12T01:42:00.012686+0000","last_clean":"2024-09-12T01:42:00.012686+0000","last_became_active":"2024-09-12T01:41:58.996881+0000","last_became_peered":"2024-09-12T01:41:58.996881+0000","last_unstale":"2024-09-12T01:42:00.012686+0000","last_undegraded":"2024-09-12T01:42:00.012686+0000","last_fullsized":"2024-09-12T01:42:00.012686+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:47.813327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.006138+0000","last_change":"2024-09-12T01:42:00.001287+0000","last_active":"2024-09-12T01:42:00.006138+0000","last_peered":"2024-09-12T01:42:00.006138+0000","last_clean":"2024-09-12T01:42:00.006138+0000","last_became_active":"2024-09-12T01:42:00.001027+0000","last_became_peered":"2024-09-12T01:42:00.001027+0000","last_unstale":"2024-09-12T01:42:00.006138+0000","last_undegraded":"2024-09-12T01:42:00.006138+0000","last_fullsized":"2024-09-12T01:42:00.006138+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:36.937083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.981356+0000","last_change":"2024-09-12T01:41:58.992864+0000","last_active":"2024-09-12T01:41:59.981356+0000","last_peered":"2024-09-12T01:41:59.981356+0000","last_clean":"2024-09-12T01:41:59.981356+0000","last_became_active":"2024-09-12T01:41:58.992587+0000","last_became_peered":"2024-09-12T01:41:58.992587+0000","last_unstale":"2024-09-12T01:41:59.981356+0000","last_undegraded":"2024-09-12T01:41:59.981356+0000","last_fullsized":"2024-09-12T01:41:59.981356+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:08.383216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008733+0000","last_change":"2024-09-12T01:42:00.002542+0000","last_active":"2024-09-12T01:42:00.008733+0000","last_peered":"2024-09-12T01:42:00.008733+0000","last_clean":"2024-09-12T01:42:00.008733+0000","last_became_active":"2024-09-12T01:42:00.002208+0000","last_became_peered":"2024-09-12T01:42:00.002208+0000","last_unstale":"2024-09-12T01:42:00.008733+0000","last_undegraded":"2024-09-12T01:42:00.008733+0000","last_fullsized":"2024-09-12T01:42:00.008733+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:37.604923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.990699+0000","last_change":"2024-09-12T01:41:58.993285+0000","last_active":"2024-09-12T01:41:59.990699+0000","last_peered":"2024-09-12T01:41:59.990699+0000","last_clean":"2024-09-12T01:41:59.990699+0000","last_became_active":"2024-09-12T01:41:58.992941+0000","last_became_peered":"2024-09-12T01:41:58.992941+0000","last_unstale":"2024-09-12T01:41:59.990699+0000","last_undegraded":"2024-09-12T01:41:59.990699+0000","last_fullsized":"2024-09-12T01:41:59.990699+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.964417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.004722+0000","last_change":"2024-09-12T01:41:59.998894+0000","last_active":"2024-09-12T01:42:00.004722+0000","last_peered":"2024-09-12T01:42:00.004722+0000","last_clean":"2024-09-12T01:42:00.004722+0000","last_became_active":"2024-09-12T01:41:59.998534+0000","last_became_peered":"2024-09-12T01:41:59.998534+0000","last_unstale":"2024-09-12T01:42:00.004722+0000","last_undegraded":"2024-09-12T01:42:00.004722+0000","last_fullsized":"2024-09-12T01:42:00.004722+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:01.602123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.002706+0000","last_change":"2024-09-12T01:41:58.993775+0000","last_active":"2024-09-12T01:42:01.002706+0000","last_peered":"2024-09-12T01:42:01.002706+0000","last_clean":"2024-09-12T01:42:01.002706+0000","last_became_active":"2024-09-12T01:41:58.993509+0000","last_became_peered":"2024-09-12T01:41:58.993509+0000","last_unstale":"2024-09-12T01:42:01.002706+0000","last_undegraded":"2024-09-12T01:42:01.002706+0000","last_fullsized":"2024-09-12T01:42:01.002706+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:44.676864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.008881+0000","last_change":"2024-09-12T01:42:00.007206+0000","last_active":"2024-09-12T01:42:00.008881+0000","last_peered":"2024-09-12T01:42:00.008881+0000","last_clean":"2024-09-12T01:42:00.008881+0000","last_became_active":"2024-09-12T01:42:00.006901+0000","last_became_peered":"2024-09-12T01:42:00.006901+0000","last_unstale":"2024-09-12T01:42:00.008881+0000","last_undegraded":"2024-09-12T01:42:00.008881+0000","last_fullsized":"2024-09-12T01:42:00.008881+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:14.401142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003602+0000","last_change":"2024-09-12T01:41:58.996435+0000","last_active":"2024-09-12T01:42:00.003602+0000","last_peered":"2024-09-12T01:42:00.003602+0000","last_clean":"2024-09-12T01:42:00.003602+0000","last_became_active":"2024-09-12T01:41:58.995490+0000","last_became_peered":"2024-09-12T01:41:58.995490+0000","last_unstale":"2024-09-12T01:42:00.003602+0000","last_undegraded":"2024-09-12T01:42:00.003602+0000","last_fullsized":"2024-09-12T01:42:00.003602+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:24.184298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.018020+0000","last_change":"2024-09-12T01:42:00.016030+0000","last_active":"2024-09-12T01:42:00.018020+0000","last_peered":"2024-09-12T01:42:00.018020+0000","last_clean":"2024-09-12T01:42:00.018020+0000","last_became_active":"2024-09-12T01:42:00.015719+0000","last_became_peered":"2024-09-12T01:42:00.015719+0000","last_unstale":"2024-09-12T01:42:00.018020+0000","last_undegraded":"2024-09-12T01:42:00.018020+0000","last_fullsized":"2024-09-12T01:42:00.018020+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.988766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.995667+0000","last_change":"2024-09-12T01:41:58.993546+0000","last_active":"2024-09-12T01:41:59.995667+0000","last_peered":"2024-09-12T01:41:59.995667+0000","last_clean":"2024-09-12T01:41:59.995667+0000","last_became_active":"2024-09-12T01:41:58.992168+0000","last_became_peered":"2024-09-12T01:41:58.992168+0000","last_unstale":"2024-09-12T01:41:59.995667+0000","last_undegraded":"2024-09-12T01:41:59.995667+0000","last_fullsized":"2024-09-12T01:41:59.995667+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:11.336252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.002241+0000","last_change":"2024-09-12T01:42:00.001750+0000","last_active":"2024-09-12T01:42:01.002241+0000","last_peered":"2024-09-12T01:42:01.002241+0000","last_clean":"2024-09-12T01:42:01.002241+0000","last_became_active":"2024-09-12T01:42:00.001476+0000","last_became_peered":"2024-09-12T01:42:00.001476+0000","last_unstale":"2024-09-12T01:42:01.002241+0000","last_undegraded":"2024-09-12T01:42:01.002241+0000","last_fullsized":"2024-09-12T01:42:01.002241+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:50.950140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.995016+0000","last_change":"2024-09-12T01:41:58.994382+0000","last_active":"2024-09-12T01:41:59.995016+0000","last_peered":"2024-09-12T01:41:59.995016+0000","last_clean":"2024-09-12T01:41:59.995016+0000","last_became_active":"2024-09-12T01:41:58.994094+0000","last_became_peered":"2024-09-12T01:41:58.994094+0000","last_unstale":"2024-09-12T01:41:59.995016+0000","last_undegraded":"2024-09-12T01:41:59.995016+0000","last_fullsized":"2024-09-12T01:41:59.995016+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:13.091759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005149+0000","last_change":"2024-09-12T01:42:00.004296+0000","last_active":"2024-09-12T01:42:00.005149+0000","last_peered":"2024-09-12T01:42:00.005149+0000","last_clean":"2024-09-12T01:42:00.005149+0000","last_became_active":"2024-09-12T01:42:00.004039+0000","last_became_peered":"2024-09-12T01:42:00.004039+0000","last_unstale":"2024-09-12T01:42:00.005149+0000","last_undegraded":"2024-09-12T01:42:00.005149+0000","last_fullsized":"2024-09-12T01:42:00.005149+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:20.951224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.982305+0000","last_change":"2024-09-12T01:41:58.992765+0000","last_active":"2024-09-12T01:41:59.982305+0000","last_peered":"2024-09-12T01:41:59.982305+0000","last_clean":"2024-09-12T01:41:59.982305+0000","last_became_active":"2024-09-12T01:41:58.992493+0000","last_became_peered":"2024-09-12T01:41:58.992493+0000","last_unstale":"2024-09-12T01:41:59.982305+0000","last_undegraded":"2024-09-12T01:41:59.982305+0000","last_fullsized":"2024-09-12T01:41:59.982305+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:57.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.005979+0000","last_change":"2024-09-12T01:42:00.000490+0000","last_active":"2024-09-12T01:42:00.005979+0000","last_peered":"2024-09-12T01:42:00.005979+0000","last_clean":"2024-09-12T01:42:00.005979+0000","last_became_active":"2024-09-12T01:41:59.996026+0000","last_became_peered":"2024-09-12T01:41:59.996026+0000","last_unstale":"2024-09-12T01:42:00.005979+0000","last_undegraded":"2024-09-12T01:42:00.005979+0000","last_fullsized":"2024-09-12T01:42:00.005979+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:26.698973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001909+0000","last_change":"2024-09-12T01:41:58.993411+0000","last_active":"2024-09-12T01:42:01.001909+0000","last_peered":"2024-09-12T01:42:01.001909+0000","last_clean":"2024-09-12T01:42:01.001909+0000","last_became_active":"2024-09-12T01:41:58.993122+0000","last_became_peered":"2024-09-12T01:41:58.993122+0000","last_unstale":"2024-09-12T01:42:01.001909+0000","last_undegraded":"2024-09-12T01:42:01.001909+0000","last_fullsized":"2024-09-12T01:42:01.001909+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:50.627366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.000900+0000","last_change":"2024-09-12T01:41:59.999997+0000","last_active":"2024-09-12T01:42:00.000900+0000","last_peered":"2024-09-12T01:42:00.000900+0000","last_clean":"2024-09-12T01:42:00.000900+0000","last_became_active":"2024-09-12T01:41:59.999544+0000","last_became_peered":"2024-09-12T01:41:59.999544+0000","last_unstale":"2024-09-12T01:42:00.000900+0000","last_undegraded":"2024-09-12T01:42:00.000900+0000","last_fullsized":"2024-09-12T01:42:00.000900+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:41.234974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.981931+0000","last_change":"2024-09-12T01:41:58.994797+0000","last_active":"2024-09-12T01:41:59.981931+0000","last_peered":"2024-09-12T01:41:59.981931+0000","last_clean":"2024-09-12T01:41:59.981931+0000","last_became_active":"2024-09-12T01:41:58.994442+0000","last_became_peered":"2024-09-12T01:41:58.994442+0000","last_unstale":"2024-09-12T01:41:59.981931+0000","last_undegraded":"2024-09-12T01:41:59.981931+0000","last_fullsized":"2024-09-12T01:41:59.981931+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:01.964583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007888+0000","last_change":"2024-09-12T01:42:00.006100+0000","last_active":"2024-09-12T01:42:00.007888+0000","last_peered":"2024-09-12T01:42:00.007888+0000","last_clean":"2024-09-12T01:42:00.007888+0000","last_became_active":"2024-09-12T01:42:00.005681+0000","last_became_peered":"2024-09-12T01:42:00.005681+0000","last_unstale":"2024-09-12T01:42:00.007888+0000","last_undegraded":"2024-09-12T01:42:00.007888+0000","last_fullsized":"2024-09-12T01:42:00.007888+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:23.838485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.991151+0000","last_change":"2024-09-12T01:41:58.996497+0000","last_active":"2024-09-12T01:41:59.991151+0000","last_peered":"2024-09-12T01:41:59.991151+0000","last_clean":"2024-09-12T01:41:59.991151+0000","last_became_active":"2024-09-12T01:41:58.996200+0000","last_became_peered":"2024-09-12T01:41:58.996200+0000","last_unstale":"2024-09-12T01:41:59.991151+0000","last_undegraded":"2024-09-12T01:41:59.991151+0000","last_fullsized":"2024-09-12T01:41:59.991151+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:40.919309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.003931+0000","last_change":"2024-09-12T01:41:59.997655+0000","last_active":"2024-09-12T01:42:00.003931+0000","last_peered":"2024-09-12T01:42:00.003931+0000","last_clean":"2024-09-12T01:42:00.003931+0000","last_became_active":"2024-09-12T01:41:59.997190+0000","last_became_peered":"2024-09-12T01:41:59.997190+0000","last_unstale":"2024-09-12T01:42:00.003931+0000","last_undegraded":"2024-09-12T01:42:00.003931+0000","last_fullsized":"2024-09-12T01:42:00.003931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:24.280195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.002732+0000","last_change":"2024-09-12T01:41:58.992877+0000","last_active":"2024-09-12T01:42:01.002732+0000","last_peered":"2024-09-12T01:42:01.002732+0000","last_clean":"2024-09-12T01:42:01.002732+0000","last_became_active":"2024-09-12T01:41:58.992561+0000","last_became_peered":"2024-09-12T01:41:58.992561+0000","last_unstale":"2024-09-12T01:42:01.002732+0000","last_undegraded":"2024-09-12T01:42:01.002732+0000","last_fullsized":"2024-09-12T01:42:01.002732+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:32.061680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.002715+0000","last_change":"2024-09-12T01:42:00.009385+0000","last_active":"2024-09-12T01:42:01.002715+0000","last_peered":"2024-09-12T01:42:01.002715+0000","last_clean":"2024-09-12T01:42:01.002715+0000","last_became_active":"2024-09-12T01:42:00.009073+0000","last_became_peered":"2024-09-12T01:42:00.009073+0000","last_unstale":"2024-09-12T01:42:01.002715+0000","last_undegraded":"2024-09-12T01:42:01.002715+0000","last_fullsized":"2024-09-12T01:42:01.002715+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:59.380251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.007123+0000","last_change":"2024-09-12T01:41:58.996923+0000","last_active":"2024-09-12T01:42:00.007123+0000","last_peered":"2024-09-12T01:42:00.007123+0000","last_clean":"2024-09-12T01:42:00.007123+0000","last_became_active":"2024-09-12T01:41:58.996587+0000","last_became_peered":"2024-09-12T01:41:58.996587+0000","last_unstale":"2024-09-12T01:42:00.007123+0000","last_undegraded":"2024-09-12T01:42:00.007123+0000","last_fullsized":"2024-09-12T01:42:00.007123+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:22.567888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":300,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-12T01:41:59.984018+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:41:59.984018+0000","last_peered":"2024-09-12T01:41:59.984018+0000","last_clean":"2024-09-12T01:41:59.984018+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:41:59.984018+0000","last_undegraded":"2024-09-12T01:41:59.984018+0000","last_fullsized":"2024-09-12T01:41:59.984018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509520,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1122304,"data_stored":470654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509518,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32280,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339560,"statfs":{"total":96636764160,"available":96603709440,"internally_reserved":0,"allocated":1118208,"data_stored":470072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509518,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1732608,"data_stored":1062108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1130496,"data_stored":470266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36432,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335408,"statfs":{"total":96636764160,"available":96599457792,"internally_reserved":0,"allocated":1105920,"data_stored":463297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37012,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334828,"statfs":{"total":96636764160,"available":96598863872,"internally_reserved":0,"allocated":1699840,"data_stored":1053665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509519,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36440,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335400,"statfs":{"total":96636764160,"available":96599449600,"internally_reserved":0,"allocated":1118208,"data_stored":470072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1134592,"data_stored":476954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:42:05.642 INFO:tasks.ceph.mds.d.smithi105.stderr:2024-09-12T01:42:05.642+0000 7f95a3509640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:42:07.400 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:42:07.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.518+0000 7fcdaadc4640 1 Processor -- start 2024-09-12T01:42:07.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.518+0000 7fcdaadc4640 1 -- start start 2024-09-12T01:42:07.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.519+0000 7fcdaadc4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcda415c550 0x7fcda40715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:07.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.519+0000 7fcdaadc4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcda4073160 0x7fcda4073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:07.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.519+0000 7fcdaadc4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda40d0270 con 0x7fcda40b6e10 2024-09-12T01:42:07.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.519+0000 7fcdaadc4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcda415c930 con 0x7fcda415c550 2024-09-12T01:42:07.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.519+0000 7fcdaadc4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcda4073ad0 con 0x7fcda4073160 2024-09-12T01:42:07.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.519+0000 7fcda8b60640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcda415c550 0x7fcda40715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:07.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.519+0000 7fcda8b60640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcda415c550 0x7fcda40715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36486/0 (socket says 172.21.15.60:36486) 2024-09-12T01:42:07.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.519+0000 7fcda3fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcda40b6e10 0x7fcda40b5540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52994/0 (socket says 172.21.15.60:52994) 2024-09-12T01:42:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.519+0000 7fcda8b60640 1 -- 172.21.15.60:0/698901592 learned_addr learned my addr 172.21.15.60:0/698901592 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.520+0000 7fcda9361640 1 --2- 172.21.15.60:0/698901592 >> v2:172.21.15.105:3300/0 conn(0x7fcda4073160 0x7fcda4073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.520+0000 7fcda8b60640 1 -- 172.21.15.60:0/698901592 >> v2:172.21.15.105:3300/0 conn(0x7fcda4073160 msgr2=0x7fcda4073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.520+0000 7fcda8b60640 1 --2- 172.21.15.60:0/698901592 >> v2:172.21.15.105:3300/0 conn(0x7fcda4073160 0x7fcda4073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.520+0000 7fcda8b60640 1 -- 172.21.15.60:0/698901592 >> v1:172.21.15.60:6789/0 conn(0x7fcda40b6e10 legacy=0x7fcda40b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.520+0000 7fcda8b60640 1 -- 172.21.15.60:0/698901592 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda40d04f0 con 0x7fcda415c550 2024-09-12T01:42:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.520+0000 7fcda37fe640 1 -- 172.21.15.60:0/698901592 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159009001 0 0) 0x7fcd98001110 con 0x7fcda40b6e10 2024-09-12T01:42:07.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.520+0000 7fcda8b60640 1 --2- 172.21.15.60:0/698901592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcda415c550 0x7fcda40715e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fcda4072d90 tx=0x7fcd9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1509225fc4d14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:07.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.521+0000 7fcda37fe640 1 -- 172.21.15.60:0/698901592 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94037070 con 0x7fcda415c550 2024-09-12T01:42:07.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.521+0000 7fcda37fe640 1 -- 172.21.15.60:0/698901592 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd94032440 con 0x7fcda415c550 2024-09-12T01:42:07.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.521+0000 7fcda37fe640 1 -- 172.21.15.60:0/698901592 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94032810 con 0x7fcda415c550 2024-09-12T01:42:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.521+0000 7fcdaadc4640 1 -- 172.21.15.60:0/698901592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcda415c550 msgr2=0x7fcda40715e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.521+0000 7fcdaadc4640 1 --2- 172.21.15.60:0/698901592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcda415c550 0x7fcda40715e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fcda4072d90 tx=0x7fcd9402a270 comp rx=0 tx=0).stop 2024-09-12T01:42:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.521+0000 7fcdaadc4640 1 -- 172.21.15.60:0/698901592 shutdown_connections 2024-09-12T01:42:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.521+0000 7fcdaadc4640 1 --2- 172.21.15.60:0/698901592 >> v2:172.21.15.105:3300/0 conn(0x7fcda4073160 0x7fcda4073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.521+0000 7fcdaadc4640 1 --2- 172.21.15.60:0/698901592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcda415c550 0x7fcda40715e0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.521+0000 7fcdaadc4640 1 -- 172.21.15.60:0/698901592 >> 172.21.15.60:0/698901592 conn(0x7fcda40b4240 msgr2=0x7fcda40b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.521+0000 7fcdaadc4640 1 -- 172.21.15.60:0/698901592 shutdown_connections 2024-09-12T01:42:07.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.521+0000 7fcdaadc4640 1 -- 172.21.15.60:0/698901592 wait complete. 2024-09-12T01:42:07.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.523+0000 7fcdaadc4640 1 Processor -- start 2024-09-12T01:42:07.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.523+0000 7fcdaadc4640 1 -- start start 2024-09-12T01:42:07.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.523+0000 7fcdaadc4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcda4073160 0x7fcda414a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:07.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.523+0000 7fcdaadc4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcda40b6e10 0x7fcda414bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:07.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcdaadc4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcda415c550 0x7fcda414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:07.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcdaadc4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcda40d07b0 con 0x7fcda4073160 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcdaadc4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcda40b7860 con 0x7fcda40b6e10 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcdaadc4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcda40b7280 con 0x7fcda415c550 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda8b60640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcda4073160 0x7fcda414a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda8b60640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcda4073160 0x7fcda414a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36490/0 (socket says 172.21.15.60:36490) 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda8b60640 1 -- 172.21.15.60:0/2350573357 learned_addr learned my addr 172.21.15.60:0/2350573357 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda9361640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcda415c550 0x7fcda414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda3fff640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcda40b6e10 0x7fcda414bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda8b60640 1 -- 172.21.15.60:0/2350573357 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcda415c550 msgr2=0x7fcda414d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda8b60640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcda415c550 0x7fcda414d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda8b60640 1 -- 172.21.15.60:0/2350573357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcda40b6e10 msgr2=0x7fcda414bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda8b60640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcda40b6e10 0x7fcda414bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda8b60640 1 -- 172.21.15.60:0/2350573357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda414aec0 con 0x7fcda4073160 2024-09-12T01:42:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda8b60640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcda4073160 0x7fcda414a000 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fcd94000c00 tx=0x7fcd940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:07.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda17fa640 1 -- 172.21.15.60:0/2350573357 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94041020 con 0x7fcda4073160 2024-09-12T01:42:07.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcda17fa640 1 -- 172.21.15.60:0/2350573357 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd940306c0 con 0x7fcda4073160 2024-09-12T01:42:07.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.524+0000 7fcdaadc4640 1 -- 172.21.15.60:0/2350573357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda414b1a0 con 0x7fcda4073160 2024-09-12T01:42:07.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.525+0000 7fcda17fa640 1 -- 172.21.15.60:0/2350573357 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94037040 con 0x7fcda4073160 2024-09-12T01:42:07.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.525+0000 7fcdaadc4640 1 -- 172.21.15.60:0/2350573357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda414b760 con 0x7fcda4073160 2024-09-12T01:42:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.526+0000 7fcdaadc4640 1 -- 172.21.15.60:0/2350573357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda4073590 con 0x7fcda4073160 2024-09-12T01:42:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.526+0000 7fcda17fa640 1 -- 172.21.15.60:0/2350573357 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd94044020 con 0x7fcda4073160 2024-09-12T01:42:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.526+0000 7fcda17fa640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcd9006be30 0x7fcd9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.527+0000 7fcda17fa640 1 -- 172.21.15.60:0/2350573357 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fcd940ab740 con 0x7fcda4073160 2024-09-12T01:42:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.527+0000 7fcda3fff640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcd9006be30 0x7fcd9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.527+0000 7fcda3fff640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcd9006be30 0x7fcd9006e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcda415bf60 tx=0x7fcd98007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:07.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.531+0000 7fcda17fa640 1 -- 172.21.15.60:0/2350573357 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd9404b030 con 0x7fcda4073160 2024-09-12T01:42:07.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.707+0000 7fcdaadc4640 1 -- 172.21.15.60:0/2350573357 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcda414a540 con 0x7fcd9006be30 2024-09-12T01:42:07.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.713+0000 7fcda17fa640 1 -- 172.21.15.60:0/2350573357 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252007 (secure 0 0 0) 0x7fcd98007b00 con 0x7fcd9006be30 2024-09-12T01:42:07.715 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:07.716 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:42:07.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.715+0000 7fcdaadc4640 1 -- 172.21.15.60:0/2350573357 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcd9006be30 msgr2=0x7fcd9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.715+0000 7fcdaadc4640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcd9006be30 0x7fcd9006e2f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcda415bf60 tx=0x7fcd98007970 comp rx=0 tx=0).stop 2024-09-12T01:42:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.716+0000 7fcdaadc4640 1 -- 172.21.15.60:0/2350573357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcda4073160 msgr2=0x7fcda414a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.716+0000 7fcdaadc4640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcda4073160 0x7fcda414a000 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fcd94000c00 tx=0x7fcd940046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.716+0000 7fcdaadc4640 1 -- 172.21.15.60:0/2350573357 shutdown_connections 2024-09-12T01:42:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.716+0000 7fcdaadc4640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcd9006be30 0x7fcd9006e2f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.716+0000 7fcdaadc4640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcda415c550 0x7fcda414d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.716+0000 7fcdaadc4640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcda40b6e10 0x7fcda414bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.716+0000 7fcdaadc4640 1 --2- 172.21.15.60:0/2350573357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcda4073160 0x7fcda414a000 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.716+0000 7fcdaadc4640 1 -- 172.21.15.60:0/2350573357 >> 172.21.15.60:0/2350573357 conn(0x7fcda40b4240 msgr2=0x7fcda40b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.716+0000 7fcdaadc4640 1 -- 172.21.15.60:0/2350573357 shutdown_connections 2024-09-12T01:42:07.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.716+0000 7fcdaadc4640 1 -- 172.21.15.60:0/2350573357 wait complete. 2024-09-12T01:42:07.726 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":277,"stamp":"2024-09-12T01:42:06.344481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":276224,"kb_used_data":10056,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754698496,"statfs":{"total":773094113280,"available":772811259904,"internally_reserved":0,"allocated":10297344,"data_stored":4996532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.367499"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452475+0000","last_change":"2024-09-12T01:41:59.998387+0000","last_active":"2024-09-12T01:42:02.452475+0000","last_peered":"2024-09-12T01:42:02.452475+0000","last_clean":"2024-09-12T01:42:02.452475+0000","last_became_active":"2024-09-12T01:41:59.998107+0000","last_became_peered":"2024-09-12T01:41:59.998107+0000","last_unstale":"2024-09-12T01:42:02.452475+0000","last_undegraded":"2024-09-12T01:42:02.452475+0000","last_fullsized":"2024-09-12T01:42:02.452475+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:51.680001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452473+0000","last_change":"2024-09-12T01:41:59.997097+0000","last_active":"2024-09-12T01:42:02.452473+0000","last_peered":"2024-09-12T01:42:02.452473+0000","last_clean":"2024-09-12T01:42:02.452473+0000","last_became_active":"2024-09-12T01:41:59.996791+0000","last_became_peered":"2024-09-12T01:41:59.996791+0000","last_unstale":"2024-09-12T01:42:02.452473+0000","last_undegraded":"2024-09-12T01:42:02.452473+0000","last_fullsized":"2024-09-12T01:42:02.452473+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:14.401142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001349+0000","last_change":"2024-09-12T01:42:00.001779+0000","last_active":"2024-09-12T01:42:01.001349+0000","last_peered":"2024-09-12T01:42:01.001349+0000","last_clean":"2024-09-12T01:42:01.001349+0000","last_became_active":"2024-09-12T01:42:00.001499+0000","last_became_peered":"2024-09-12T01:42:00.001499+0000","last_unstale":"2024-09-12T01:42:01.001349+0000","last_undegraded":"2024-09-12T01:42:01.001349+0000","last_fullsized":"2024-09-12T01:42:01.001349+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:34.151737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452320+0000","last_change":"2024-09-12T01:42:00.010982+0000","last_active":"2024-09-12T01:42:02.452320+0000","last_peered":"2024-09-12T01:42:02.452320+0000","last_clean":"2024-09-12T01:42:02.452320+0000","last_became_active":"2024-09-12T01:42:00.010488+0000","last_became_peered":"2024-09-12T01:42:00.010488+0000","last_unstale":"2024-09-12T01:42:02.452320+0000","last_undegraded":"2024-09-12T01:42:02.452320+0000","last_fullsized":"2024-09-12T01:42:02.452320+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:46.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995406+0000","last_change":"2024-09-12T01:41:59.994841+0000","last_active":"2024-09-12T01:42:00.995406+0000","last_peered":"2024-09-12T01:42:00.995406+0000","last_clean":"2024-09-12T01:42:00.995406+0000","last_became_active":"2024-09-12T01:41:59.994425+0000","last_became_peered":"2024-09-12T01:41:59.994425+0000","last_unstale":"2024-09-12T01:42:00.995406+0000","last_undegraded":"2024-09-12T01:42:00.995406+0000","last_fullsized":"2024-09-12T01:42:00.995406+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:33.307374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995442+0000","last_change":"2024-09-12T01:42:00.002035+0000","last_active":"2024-09-12T01:42:00.995442+0000","last_peered":"2024-09-12T01:42:00.995442+0000","last_clean":"2024-09-12T01:42:00.995442+0000","last_became_active":"2024-09-12T01:42:00.001739+0000","last_became_peered":"2024-09-12T01:42:00.001739+0000","last_unstale":"2024-09-12T01:42:00.995442+0000","last_undegraded":"2024-09-12T01:42:00.995442+0000","last_fullsized":"2024-09-12T01:42:00.995442+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:31.677091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995218+0000","last_change":"2024-09-12T01:41:59.997500+0000","last_active":"2024-09-12T01:42:00.995218+0000","last_peered":"2024-09-12T01:42:00.995218+0000","last_clean":"2024-09-12T01:42:00.995218+0000","last_became_active":"2024-09-12T01:41:59.997216+0000","last_became_peered":"2024-09-12T01:41:59.997216+0000","last_unstale":"2024-09-12T01:42:00.995218+0000","last_undegraded":"2024-09-12T01:42:00.995218+0000","last_fullsized":"2024-09-12T01:42:00.995218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:13.659795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.002693+0000","last_change":"2024-09-12T01:42:00.008368+0000","last_active":"2024-09-12T01:42:01.002693+0000","last_peered":"2024-09-12T01:42:01.002693+0000","last_clean":"2024-09-12T01:42:01.002693+0000","last_became_active":"2024-09-12T01:42:00.007998+0000","last_became_peered":"2024-09-12T01:42:00.007998+0000","last_unstale":"2024-09-12T01:42:01.002693+0000","last_undegraded":"2024-09-12T01:42:01.002693+0000","last_fullsized":"2024-09-12T01:42:01.002693+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:18.925863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995587+0000","last_change":"2024-09-12T01:41:59.999881+0000","last_active":"2024-09-12T01:42:00.995587+0000","last_peered":"2024-09-12T01:42:00.995587+0000","last_clean":"2024-09-12T01:42:00.995587+0000","last_became_active":"2024-09-12T01:41:59.999548+0000","last_became_peered":"2024-09-12T01:41:59.999548+0000","last_unstale":"2024-09-12T01:42:00.995587+0000","last_undegraded":"2024-09-12T01:42:00.995587+0000","last_fullsized":"2024-09-12T01:42:00.995587+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:56.556676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.510203+0000","last_change":"2024-09-12T01:42:00.011595+0000","last_active":"2024-09-12T01:42:01.510203+0000","last_peered":"2024-09-12T01:42:01.510203+0000","last_clean":"2024-09-12T01:42:01.510203+0000","last_became_active":"2024-09-12T01:42:00.011120+0000","last_became_peered":"2024-09-12T01:42:00.011120+0000","last_unstale":"2024-09-12T01:42:01.510203+0000","last_undegraded":"2024-09-12T01:42:01.510203+0000","last_fullsized":"2024-09-12T01:42:01.510203+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:23:37.604923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995772+0000","last_change":"2024-09-12T01:42:00.002071+0000","last_active":"2024-09-12T01:42:00.995772+0000","last_peered":"2024-09-12T01:42:00.995772+0000","last_clean":"2024-09-12T01:42:00.995772+0000","last_became_active":"2024-09-12T01:42:00.001769+0000","last_became_peered":"2024-09-12T01:42:00.001769+0000","last_unstale":"2024-09-12T01:42:00.995772+0000","last_undegraded":"2024-09-12T01:42:00.995772+0000","last_fullsized":"2024-09-12T01:42:00.995772+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:38:59.248538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451843+0000","last_change":"2024-09-12T01:41:59.999861+0000","last_active":"2024-09-12T01:42:02.451843+0000","last_peered":"2024-09-12T01:42:02.451843+0000","last_clean":"2024-09-12T01:42:02.451843+0000","last_became_active":"2024-09-12T01:41:59.999585+0000","last_became_peered":"2024-09-12T01:41:59.999585+0000","last_unstale":"2024-09-12T01:42:02.451843+0000","last_undegraded":"2024-09-12T01:42:02.451843+0000","last_fullsized":"2024-09-12T01:42:02.451843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:07.326287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.000988+0000","last_change":"2024-09-12T01:42:00.003453+0000","last_active":"2024-09-12T01:42:01.000988+0000","last_peered":"2024-09-12T01:42:01.000988+0000","last_clean":"2024-09-12T01:42:01.000988+0000","last_became_active":"2024-09-12T01:42:00.003168+0000","last_became_peered":"2024-09-12T01:42:00.003168+0000","last_unstale":"2024-09-12T01:42:01.000988+0000","last_undegraded":"2024-09-12T01:42:01.000988+0000","last_fullsized":"2024-09-12T01:42:01.000988+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:27.235217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452075+0000","last_change":"2024-09-12T01:41:59.999888+0000","last_active":"2024-09-12T01:42:02.452075+0000","last_peered":"2024-09-12T01:42:02.452075+0000","last_clean":"2024-09-12T01:42:02.452075+0000","last_became_active":"2024-09-12T01:41:59.999191+0000","last_became_peered":"2024-09-12T01:41:59.999191+0000","last_unstale":"2024-09-12T01:42:02.452075+0000","last_undegraded":"2024-09-12T01:42:02.452075+0000","last_fullsized":"2024-09-12T01:42:02.452075+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:36.937083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452053+0000","last_change":"2024-09-12T01:42:00.000266+0000","last_active":"2024-09-12T01:42:02.452053+0000","last_peered":"2024-09-12T01:42:02.452053+0000","last_clean":"2024-09-12T01:42:02.452053+0000","last_became_active":"2024-09-12T01:42:00.000010+0000","last_became_peered":"2024-09-12T01:42:00.000010+0000","last_unstale":"2024-09-12T01:42:02.452053+0000","last_undegraded":"2024-09-12T01:42:02.452053+0000","last_fullsized":"2024-09-12T01:42:02.452053+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:20.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995179+0000","last_change":"2024-09-12T01:41:59.996542+0000","last_active":"2024-09-12T01:42:00.995179+0000","last_peered":"2024-09-12T01:42:00.995179+0000","last_clean":"2024-09-12T01:42:00.995179+0000","last_became_active":"2024-09-12T01:41:59.996199+0000","last_became_peered":"2024-09-12T01:41:59.996199+0000","last_unstale":"2024-09-12T01:42:00.995179+0000","last_undegraded":"2024-09-12T01:42:00.995179+0000","last_fullsized":"2024-09-12T01:42:00.995179+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:33.829530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.986416+0000","last_change":"2024-09-12T01:42:00.006742+0000","last_active":"2024-09-12T01:42:01.986416+0000","last_peered":"2024-09-12T01:42:01.986416+0000","last_clean":"2024-09-12T01:42:01.986416+0000","last_became_active":"2024-09-12T01:42:00.006366+0000","last_became_peered":"2024-09-12T01:42:00.006366+0000","last_unstale":"2024-09-12T01:42:01.986416+0000","last_undegraded":"2024-09-12T01:42:01.986416+0000","last_fullsized":"2024-09-12T01:42:01.986416+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:02.067300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452479+0000","last_change":"2024-09-12T01:42:00.000351+0000","last_active":"2024-09-12T01:42:02.452479+0000","last_peered":"2024-09-12T01:42:02.452479+0000","last_clean":"2024-09-12T01:42:02.452479+0000","last_became_active":"2024-09-12T01:41:59.999753+0000","last_became_peered":"2024-09-12T01:41:59.999753+0000","last_unstale":"2024-09-12T01:42:02.452479+0000","last_undegraded":"2024-09-12T01:42:02.452479+0000","last_fullsized":"2024-09-12T01:42:02.452479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:58.449274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.986024+0000","last_change":"2024-09-12T01:42:00.013386+0000","last_active":"2024-09-12T01:42:01.986024+0000","last_peered":"2024-09-12T01:42:01.986024+0000","last_clean":"2024-09-12T01:42:01.986024+0000","last_became_active":"2024-09-12T01:42:00.013088+0000","last_became_peered":"2024-09-12T01:42:00.013088+0000","last_unstale":"2024-09-12T01:42:01.986024+0000","last_undegraded":"2024-09-12T01:42:01.986024+0000","last_fullsized":"2024-09-12T01:42:01.986024+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:32.205872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451854+0000","last_change":"2024-09-12T01:41:59.994130+0000","last_active":"2024-09-12T01:42:02.451854+0000","last_peered":"2024-09-12T01:42:02.451854+0000","last_clean":"2024-09-12T01:42:02.451854+0000","last_became_active":"2024-09-12T01:41:59.993627+0000","last_became_peered":"2024-09-12T01:41:59.993627+0000","last_unstale":"2024-09-12T01:42:02.451854+0000","last_undegraded":"2024-09-12T01:42:02.451854+0000","last_fullsized":"2024-09-12T01:42:02.451854+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:26.435357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001716+0000","last_change":"2024-09-12T01:42:00.002717+0000","last_active":"2024-09-12T01:42:01.001716+0000","last_peered":"2024-09-12T01:42:01.001716+0000","last_clean":"2024-09-12T01:42:01.001716+0000","last_became_active":"2024-09-12T01:42:00.002464+0000","last_became_peered":"2024-09-12T01:42:00.002464+0000","last_unstale":"2024-09-12T01:42:01.001716+0000","last_undegraded":"2024-09-12T01:42:01.001716+0000","last_fullsized":"2024-09-12T01:42:01.001716+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:43.583357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001374+0000","last_change":"2024-09-12T01:42:00.000856+0000","last_active":"2024-09-12T01:42:01.001374+0000","last_peered":"2024-09-12T01:42:01.001374+0000","last_clean":"2024-09-12T01:42:01.001374+0000","last_became_active":"2024-09-12T01:42:00.000592+0000","last_became_peered":"2024-09-12T01:42:00.000592+0000","last_unstale":"2024-09-12T01:42:01.001374+0000","last_undegraded":"2024-09-12T01:42:01.001374+0000","last_fullsized":"2024-09-12T01:42:01.001374+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:34.217087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451999+0000","last_change":"2024-09-12T01:41:59.998620+0000","last_active":"2024-09-12T01:42:02.451999+0000","last_peered":"2024-09-12T01:42:02.451999+0000","last_clean":"2024-09-12T01:42:02.451999+0000","last_became_active":"2024-09-12T01:41:59.998314+0000","last_became_peered":"2024-09-12T01:41:59.998314+0000","last_unstale":"2024-09-12T01:42:02.451999+0000","last_undegraded":"2024-09-12T01:42:02.451999+0000","last_fullsized":"2024-09-12T01:42:02.451999+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:12.338449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451371+0000","last_change":"2024-09-12T01:42:00.010724+0000","last_active":"2024-09-12T01:42:02.451371+0000","last_peered":"2024-09-12T01:42:02.451371+0000","last_clean":"2024-09-12T01:42:02.451371+0000","last_became_active":"2024-09-12T01:42:00.010364+0000","last_became_peered":"2024-09-12T01:42:00.010364+0000","last_unstale":"2024-09-12T01:42:02.451371+0000","last_undegraded":"2024-09-12T01:42:02.451371+0000","last_fullsized":"2024-09-12T01:42:02.451371+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:25.680701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.510301+0000","last_change":"2024-09-12T01:42:00.003822+0000","last_active":"2024-09-12T01:42:01.510301+0000","last_peered":"2024-09-12T01:42:01.510301+0000","last_clean":"2024-09-12T01:42:01.510301+0000","last_became_active":"2024-09-12T01:42:00.003374+0000","last_became_peered":"2024-09-12T01:42:00.003374+0000","last_unstale":"2024-09-12T01:42:01.510301+0000","last_undegraded":"2024-09-12T01:42:01.510301+0000","last_fullsized":"2024-09-12T01:42:01.510301+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:13.659299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.000665+0000","last_change":"2024-09-12T01:41:59.995775+0000","last_active":"2024-09-12T01:42:01.000665+0000","last_peered":"2024-09-12T01:42:01.000665+0000","last_clean":"2024-09-12T01:42:01.000665+0000","last_became_active":"2024-09-12T01:41:59.995503+0000","last_became_peered":"2024-09-12T01:41:59.995503+0000","last_unstale":"2024-09-12T01:42:01.000665+0000","last_undegraded":"2024-09-12T01:42:01.000665+0000","last_fullsized":"2024-09-12T01:42:01.000665+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:42.729106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452080+0000","last_change":"2024-09-12T01:42:00.003066+0000","last_active":"2024-09-12T01:42:02.452080+0000","last_peered":"2024-09-12T01:42:02.452080+0000","last_clean":"2024-09-12T01:42:02.452080+0000","last_became_active":"2024-09-12T01:42:00.002796+0000","last_became_peered":"2024-09-12T01:42:00.002796+0000","last_unstale":"2024-09-12T01:42:02.452080+0000","last_undegraded":"2024-09-12T01:42:02.452080+0000","last_fullsized":"2024-09-12T01:42:02.452080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:46.612000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451889+0000","last_change":"2024-09-12T01:41:59.995567+0000","last_active":"2024-09-12T01:42:02.451889+0000","last_peered":"2024-09-12T01:42:02.451889+0000","last_clean":"2024-09-12T01:42:02.451889+0000","last_became_active":"2024-09-12T01:41:59.995275+0000","last_became_peered":"2024-09-12T01:41:59.995275+0000","last_unstale":"2024-09-12T01:42:02.451889+0000","last_undegraded":"2024-09-12T01:42:02.451889+0000","last_fullsized":"2024-09-12T01:42:02.451889+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:20.396976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001004+0000","last_change":"2024-09-12T01:42:00.004709+0000","last_active":"2024-09-12T01:42:01.001004+0000","last_peered":"2024-09-12T01:42:01.001004+0000","last_clean":"2024-09-12T01:42:01.001004+0000","last_became_active":"2024-09-12T01:42:00.004413+0000","last_became_peered":"2024-09-12T01:42:00.004413+0000","last_unstale":"2024-09-12T01:42:01.001004+0000","last_undegraded":"2024-09-12T01:42:01.001004+0000","last_fullsized":"2024-09-12T01:42:01.001004+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:47.453821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.000939+0000","last_change":"2024-09-12T01:42:00.001460+0000","last_active":"2024-09-12T01:42:01.000939+0000","last_peered":"2024-09-12T01:42:01.000939+0000","last_clean":"2024-09-12T01:42:01.000939+0000","last_became_active":"2024-09-12T01:42:00.001111+0000","last_became_peered":"2024-09-12T01:42:00.001111+0000","last_unstale":"2024-09-12T01:42:01.000939+0000","last_undegraded":"2024-09-12T01:42:01.000939+0000","last_fullsized":"2024-09-12T01:42:01.000939+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:11.463304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001327+0000","last_change":"2024-09-12T01:42:00.003646+0000","last_active":"2024-09-12T01:42:01.001327+0000","last_peered":"2024-09-12T01:42:01.001327+0000","last_clean":"2024-09-12T01:42:01.001327+0000","last_became_active":"2024-09-12T01:42:00.003395+0000","last_became_peered":"2024-09-12T01:42:00.003395+0000","last_unstale":"2024-09-12T01:42:01.001327+0000","last_undegraded":"2024-09-12T01:42:01.001327+0000","last_fullsized":"2024-09-12T01:42:01.001327+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:56.051271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451984+0000","last_change":"2024-09-12T01:42:00.010691+0000","last_active":"2024-09-12T01:42:02.451984+0000","last_peered":"2024-09-12T01:42:02.451984+0000","last_clean":"2024-09-12T01:42:02.451984+0000","last_became_active":"2024-09-12T01:42:00.010426+0000","last_became_peered":"2024-09-12T01:42:00.010426+0000","last_unstale":"2024-09-12T01:42:02.451984+0000","last_undegraded":"2024-09-12T01:42:02.451984+0000","last_fullsized":"2024-09-12T01:42:02.451984+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:25.680701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.986198+0000","last_change":"2024-09-12T01:42:00.002800+0000","last_active":"2024-09-12T01:42:01.986198+0000","last_peered":"2024-09-12T01:42:01.986198+0000","last_clean":"2024-09-12T01:42:01.986198+0000","last_became_active":"2024-09-12T01:42:00.002533+0000","last_became_peered":"2024-09-12T01:42:00.002533+0000","last_unstale":"2024-09-12T01:42:01.986198+0000","last_undegraded":"2024-09-12T01:42:01.986198+0000","last_fullsized":"2024-09-12T01:42:01.986198+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:54.326983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"91'4","reported_seq":18,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001055+0000","last_change":"2024-09-12T01:41:58.988426+0000","last_active":"2024-09-12T01:42:01.001055+0000","last_peered":"2024-09-12T01:42:01.001055+0000","last_clean":"2024-09-12T01:42:01.001055+0000","last_became_active":"2024-09-12T01:41:58.988130+0000","last_became_peered":"2024-09-12T01:41:58.988130+0000","last_unstale":"2024-09-12T01:42:01.001055+0000","last_undegraded":"2024-09-12T01:42:01.001055+0000","last_fullsized":"2024-09-12T01:42:01.001055+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:19.475865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.000740+0000","last_change":"2024-09-12T01:42:00.004520+0000","last_active":"2024-09-12T01:42:01.000740+0000","last_peered":"2024-09-12T01:42:01.000740+0000","last_clean":"2024-09-12T01:42:01.000740+0000","last_became_active":"2024-09-12T01:42:00.004193+0000","last_became_peered":"2024-09-12T01:42:00.004193+0000","last_unstale":"2024-09-12T01:42:01.000740+0000","last_undegraded":"2024-09-12T01:42:01.000740+0000","last_fullsized":"2024-09-12T01:42:01.000740+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:29.713886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"91'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995362+0000","last_change":"2024-09-12T01:41:58.992984+0000","last_active":"2024-09-12T01:42:00.995362+0000","last_peered":"2024-09-12T01:42:00.995362+0000","last_clean":"2024-09-12T01:42:00.995362+0000","last_became_active":"2024-09-12T01:41:58.992669+0000","last_became_peered":"2024-09-12T01:41:58.992669+0000","last_unstale":"2024-09-12T01:42:00.995362+0000","last_undegraded":"2024-09-12T01:42:00.995362+0000","last_fullsized":"2024-09-12T01:42:00.995362+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:09.589596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452360+0000","last_change":"2024-09-12T01:42:00.008281+0000","last_active":"2024-09-12T01:42:02.452360+0000","last_peered":"2024-09-12T01:42:02.452360+0000","last_clean":"2024-09-12T01:42:02.452360+0000","last_became_active":"2024-09-12T01:42:00.007920+0000","last_became_peered":"2024-09-12T01:42:00.007920+0000","last_unstale":"2024-09-12T01:42:02.452360+0000","last_undegraded":"2024-09-12T01:42:02.452360+0000","last_fullsized":"2024-09-12T01:42:02.452360+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:23.838485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"91'2","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001409+0000","last_change":"2024-09-12T01:41:58.990722+0000","last_active":"2024-09-12T01:42:01.001409+0000","last_peered":"2024-09-12T01:42:01.001409+0000","last_clean":"2024-09-12T01:42:01.001409+0000","last_became_active":"2024-09-12T01:41:58.990360+0000","last_became_peered":"2024-09-12T01:41:58.990360+0000","last_unstale":"2024-09-12T01:42:01.001409+0000","last_undegraded":"2024-09-12T01:42:01.001409+0000","last_fullsized":"2024-09-12T01:42:01.001409+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:59.328158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.510200+0000","last_change":"2024-09-12T01:42:00.007543+0000","last_active":"2024-09-12T01:42:01.510200+0000","last_peered":"2024-09-12T01:42:01.510200+0000","last_clean":"2024-09-12T01:42:01.510200+0000","last_became_active":"2024-09-12T01:42:00.006466+0000","last_became_peered":"2024-09-12T01:42:00.006466+0000","last_unstale":"2024-09-12T01:42:01.510200+0000","last_undegraded":"2024-09-12T01:42:01.510200+0000","last_fullsized":"2024-09-12T01:42:01.510200+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:04.822297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"91'2","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452444+0000","last_change":"2024-09-12T01:41:58.997786+0000","last_active":"2024-09-12T01:42:02.452444+0000","last_peered":"2024-09-12T01:42:02.452444+0000","last_clean":"2024-09-12T01:42:02.452444+0000","last_became_active":"2024-09-12T01:41:58.997540+0000","last_became_peered":"2024-09-12T01:41:58.997540+0000","last_unstale":"2024-09-12T01:42:02.452444+0000","last_undegraded":"2024-09-12T01:42:02.452444+0000","last_fullsized":"2024-09-12T01:42:02.452444+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:14.484863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451675+0000","last_change":"2024-09-12T01:41:59.993413+0000","last_active":"2024-09-12T01:42:02.451675+0000","last_peered":"2024-09-12T01:42:02.451675+0000","last_clean":"2024-09-12T01:42:02.451675+0000","last_became_active":"2024-09-12T01:41:59.992374+0000","last_became_peered":"2024-09-12T01:41:59.992374+0000","last_unstale":"2024-09-12T01:42:02.451675+0000","last_undegraded":"2024-09-12T01:42:02.451675+0000","last_fullsized":"2024-09-12T01:42:02.451675+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:46.268859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"91'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451979+0000","last_change":"2024-09-12T01:41:58.996374+0000","last_active":"2024-09-12T01:42:02.451979+0000","last_peered":"2024-09-12T01:42:02.451979+0000","last_clean":"2024-09-12T01:42:02.451979+0000","last_became_active":"2024-09-12T01:41:58.996057+0000","last_became_peered":"2024-09-12T01:41:58.996057+0000","last_unstale":"2024-09-12T01:42:02.451979+0000","last_undegraded":"2024-09-12T01:42:02.451979+0000","last_fullsized":"2024-09-12T01:42:02.451979+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:53.915640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995545+0000","last_change":"2024-09-12T01:41:59.995738+0000","last_active":"2024-09-12T01:42:00.995545+0000","last_peered":"2024-09-12T01:42:00.995545+0000","last_clean":"2024-09-12T01:42:00.995545+0000","last_became_active":"2024-09-12T01:41:59.995444+0000","last_became_peered":"2024-09-12T01:41:59.995444+0000","last_unstale":"2024-09-12T01:42:00.995545+0000","last_undegraded":"2024-09-12T01:42:00.995545+0000","last_fullsized":"2024-09-12T01:42:00.995545+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:39.839625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"91'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001327+0000","last_change":"2024-09-12T01:41:58.990641+0000","last_active":"2024-09-12T01:42:01.001327+0000","last_peered":"2024-09-12T01:42:01.001327+0000","last_clean":"2024-09-12T01:42:01.001327+0000","last_became_active":"2024-09-12T01:41:58.989695+0000","last_became_peered":"2024-09-12T01:41:58.989695+0000","last_unstale":"2024-09-12T01:42:01.001327+0000","last_undegraded":"2024-09-12T01:42:01.001327+0000","last_fullsized":"2024-09-12T01:42:01.001327+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:13.876725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.000545+0000","last_change":"2024-09-12T01:42:00.005090+0000","last_active":"2024-09-12T01:42:01.000545+0000","last_peered":"2024-09-12T01:42:01.000545+0000","last_clean":"2024-09-12T01:42:01.000545+0000","last_became_active":"2024-09-12T01:42:00.004601+0000","last_became_peered":"2024-09-12T01:42:00.004601+0000","last_unstale":"2024-09-12T01:42:01.000545+0000","last_undegraded":"2024-09-12T01:42:01.000545+0000","last_fullsized":"2024-09-12T01:42:01.000545+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:22.968670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995244+0000","last_change":"2024-09-12T01:41:58.989687+0000","last_active":"2024-09-12T01:42:00.995244+0000","last_peered":"2024-09-12T01:42:00.995244+0000","last_clean":"2024-09-12T01:42:00.995244+0000","last_became_active":"2024-09-12T01:41:58.989372+0000","last_became_peered":"2024-09-12T01:41:58.989372+0000","last_unstale":"2024-09-12T01:42:00.995244+0000","last_undegraded":"2024-09-12T01:42:00.995244+0000","last_fullsized":"2024-09-12T01:42:00.995244+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:00.390233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451519+0000","last_change":"2024-09-12T01:41:59.991854+0000","last_active":"2024-09-12T01:42:02.451519+0000","last_peered":"2024-09-12T01:42:02.451519+0000","last_clean":"2024-09-12T01:42:02.451519+0000","last_became_active":"2024-09-12T01:41:59.991577+0000","last_became_peered":"2024-09-12T01:41:59.991577+0000","last_unstale":"2024-09-12T01:42:02.451519+0000","last_undegraded":"2024-09-12T01:42:02.451519+0000","last_fullsized":"2024-09-12T01:42:02.451519+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:05.833740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.985778+0000","last_change":"2024-09-12T01:41:58.997889+0000","last_active":"2024-09-12T01:42:01.985778+0000","last_peered":"2024-09-12T01:42:01.985778+0000","last_clean":"2024-09-12T01:42:01.985778+0000","last_became_active":"2024-09-12T01:41:58.997469+0000","last_became_peered":"2024-09-12T01:41:58.997469+0000","last_unstale":"2024-09-12T01:42:01.985778+0000","last_undegraded":"2024-09-12T01:42:01.985778+0000","last_fullsized":"2024-09-12T01:42:01.985778+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:22.853882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452647+0000","last_change":"2024-09-12T01:42:00.010808+0000","last_active":"2024-09-12T01:42:02.452647+0000","last_peered":"2024-09-12T01:42:02.452647+0000","last_clean":"2024-09-12T01:42:02.452647+0000","last_became_active":"2024-09-12T01:42:00.010535+0000","last_became_peered":"2024-09-12T01:42:00.010535+0000","last_unstale":"2024-09-12T01:42:02.452647+0000","last_undegraded":"2024-09-12T01:42:02.452647+0000","last_fullsized":"2024-09-12T01:42:02.452647+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.988766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001022+0000","last_change":"2024-09-12T01:41:58.985309+0000","last_active":"2024-09-12T01:42:01.001022+0000","last_peered":"2024-09-12T01:42:01.001022+0000","last_clean":"2024-09-12T01:42:01.001022+0000","last_became_active":"2024-09-12T01:41:58.985006+0000","last_became_peered":"2024-09-12T01:41:58.985006+0000","last_unstale":"2024-09-12T01:42:01.001022+0000","last_undegraded":"2024-09-12T01:42:01.001022+0000","last_fullsized":"2024-09-12T01:42:01.001022+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:02.928877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452220+0000","last_change":"2024-09-12T01:41:59.996189+0000","last_active":"2024-09-12T01:42:02.452220+0000","last_peered":"2024-09-12T01:42:02.452220+0000","last_clean":"2024-09-12T01:42:02.452220+0000","last_became_active":"2024-09-12T01:41:59.995894+0000","last_became_peered":"2024-09-12T01:41:59.995894+0000","last_unstale":"2024-09-12T01:42:02.452220+0000","last_undegraded":"2024-09-12T01:42:02.452220+0000","last_fullsized":"2024-09-12T01:42:02.452220+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:23.838485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452597+0000","last_change":"2024-09-12T01:41:58.996582+0000","last_active":"2024-09-12T01:42:02.452597+0000","last_peered":"2024-09-12T01:42:02.452597+0000","last_clean":"2024-09-12T01:42:02.452597+0000","last_became_active":"2024-09-12T01:41:58.996289+0000","last_became_peered":"2024-09-12T01:41:58.996289+0000","last_unstale":"2024-09-12T01:42:02.452597+0000","last_undegraded":"2024-09-12T01:42:02.452597+0000","last_fullsized":"2024-09-12T01:42:02.452597+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:45.266662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995672+0000","last_change":"2024-09-12T01:42:00.009375+0000","last_active":"2024-09-12T01:42:00.995672+0000","last_peered":"2024-09-12T01:42:00.995672+0000","last_clean":"2024-09-12T01:42:00.995672+0000","last_became_active":"2024-09-12T01:42:00.009071+0000","last_became_peered":"2024-09-12T01:42:00.009071+0000","last_unstale":"2024-09-12T01:42:00.995672+0000","last_undegraded":"2024-09-12T01:42:00.995672+0000","last_fullsized":"2024-09-12T01:42:00.995672+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:07.731291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"91'3","reported_seq":17,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995857+0000","last_change":"2024-09-12T01:41:58.992505+0000","last_active":"2024-09-12T01:42:00.995857+0000","last_peered":"2024-09-12T01:42:00.995857+0000","last_clean":"2024-09-12T01:42:00.995857+0000","last_became_active":"2024-09-12T01:41:58.992076+0000","last_became_peered":"2024-09-12T01:41:58.992076+0000","last_unstale":"2024-09-12T01:42:00.995857+0000","last_undegraded":"2024-09-12T01:42:00.995857+0000","last_fullsized":"2024-09-12T01:42:00.995857+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:15.078082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452034+0000","last_change":"2024-09-12T01:42:00.002167+0000","last_active":"2024-09-12T01:42:02.452034+0000","last_peered":"2024-09-12T01:42:02.452034+0000","last_clean":"2024-09-12T01:42:02.452034+0000","last_became_active":"2024-09-12T01:42:00.001838+0000","last_became_peered":"2024-09-12T01:42:00.001838+0000","last_unstale":"2024-09-12T01:42:02.452034+0000","last_undegraded":"2024-09-12T01:42:02.452034+0000","last_fullsized":"2024-09-12T01:42:02.452034+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:26.698973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"91'6","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451942+0000","last_change":"2024-09-12T01:41:58.996508+0000","last_active":"2024-09-12T01:42:02.451942+0000","last_peered":"2024-09-12T01:42:02.451942+0000","last_clean":"2024-09-12T01:42:02.451942+0000","last_became_active":"2024-09-12T01:41:58.995956+0000","last_became_peered":"2024-09-12T01:41:58.995956+0000","last_unstale":"2024-09-12T01:42:02.451942+0000","last_undegraded":"2024-09-12T01:42:02.451942+0000","last_fullsized":"2024-09-12T01:42:02.451942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:55.108765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451970+0000","last_change":"2024-09-12T01:41:59.999914+0000","last_active":"2024-09-12T01:42:02.451970+0000","last_peered":"2024-09-12T01:42:02.451970+0000","last_clean":"2024-09-12T01:42:02.451970+0000","last_became_active":"2024-09-12T01:41:59.999540+0000","last_became_peered":"2024-09-12T01:41:59.999540+0000","last_unstale":"2024-09-12T01:42:02.451970+0000","last_undegraded":"2024-09-12T01:42:02.451970+0000","last_fullsized":"2024-09-12T01:42:02.451970+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:14.093956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"91'2","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.985859+0000","last_change":"2024-09-12T01:41:58.991672+0000","last_active":"2024-09-12T01:42:01.985859+0000","last_peered":"2024-09-12T01:42:01.985859+0000","last_clean":"2024-09-12T01:42:01.985859+0000","last_became_active":"2024-09-12T01:41:58.991363+0000","last_became_peered":"2024-09-12T01:41:58.991363+0000","last_unstale":"2024-09-12T01:42:01.985859+0000","last_undegraded":"2024-09-12T01:42:01.985859+0000","last_fullsized":"2024-09-12T01:42:01.985859+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:24.678504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001860+0000","last_change":"2024-09-12T01:42:00.008596+0000","last_active":"2024-09-12T01:42:01.001860+0000","last_peered":"2024-09-12T01:42:01.001860+0000","last_clean":"2024-09-12T01:42:01.001860+0000","last_became_active":"2024-09-12T01:42:00.008348+0000","last_became_peered":"2024-09-12T01:42:00.008348+0000","last_unstale":"2024-09-12T01:42:01.001860+0000","last_undegraded":"2024-09-12T01:42:01.001860+0000","last_fullsized":"2024-09-12T01:42:01.001860+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:47.796921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452169+0000","last_change":"2024-09-12T01:41:58.996856+0000","last_active":"2024-09-12T01:42:02.452169+0000","last_peered":"2024-09-12T01:42:02.452169+0000","last_clean":"2024-09-12T01:42:02.452169+0000","last_became_active":"2024-09-12T01:41:58.995624+0000","last_became_peered":"2024-09-12T01:41:58.995624+0000","last_unstale":"2024-09-12T01:42:02.452169+0000","last_undegraded":"2024-09-12T01:42:02.452169+0000","last_fullsized":"2024-09-12T01:42:02.452169+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:06.324090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995242+0000","last_change":"2024-09-12T01:41:59.993089+0000","last_active":"2024-09-12T01:42:00.995242+0000","last_peered":"2024-09-12T01:42:00.995242+0000","last_clean":"2024-09-12T01:42:00.995242+0000","last_became_active":"2024-09-12T01:41:59.992817+0000","last_became_peered":"2024-09-12T01:41:59.992817+0000","last_unstale":"2024-09-12T01:42:00.995242+0000","last_undegraded":"2024-09-12T01:42:00.995242+0000","last_fullsized":"2024-09-12T01:42:00.995242+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:28.463587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451623+0000","last_change":"2024-09-12T01:41:58.993719+0000","last_active":"2024-09-12T01:42:02.451623+0000","last_peered":"2024-09-12T01:42:02.451623+0000","last_clean":"2024-09-12T01:42:02.451623+0000","last_became_active":"2024-09-12T01:41:58.993224+0000","last_became_peered":"2024-09-12T01:41:58.993224+0000","last_unstale":"2024-09-12T01:42:02.451623+0000","last_undegraded":"2024-09-12T01:42:02.451623+0000","last_fullsized":"2024-09-12T01:42:02.451623+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:58.987546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001322+0000","last_change":"2024-09-12T01:41:59.997694+0000","last_active":"2024-09-12T01:42:01.001322+0000","last_peered":"2024-09-12T01:42:01.001322+0000","last_clean":"2024-09-12T01:42:01.001322+0000","last_became_active":"2024-09-12T01:41:59.997374+0000","last_became_peered":"2024-09-12T01:41:59.997374+0000","last_unstale":"2024-09-12T01:42:01.001322+0000","last_undegraded":"2024-09-12T01:42:01.001322+0000","last_fullsized":"2024-09-12T01:42:01.001322+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:54.512197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"91'8","reported_seq":22,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452176+0000","last_change":"2024-09-12T01:41:58.991776+0000","last_active":"2024-09-12T01:42:02.452176+0000","last_peered":"2024-09-12T01:42:02.452176+0000","last_clean":"2024-09-12T01:42:02.452176+0000","last_became_active":"2024-09-12T01:41:58.991511+0000","last_became_peered":"2024-09-12T01:41:58.991511+0000","last_unstale":"2024-09-12T01:42:02.452176+0000","last_undegraded":"2024-09-12T01:42:02.452176+0000","last_fullsized":"2024-09-12T01:42:02.452176+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:04.831543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452369+0000","last_change":"2024-09-12T01:41:59.987898+0000","last_active":"2024-09-12T01:42:02.452369+0000","last_peered":"2024-09-12T01:42:02.452369+0000","last_clean":"2024-09-12T01:42:02.452369+0000","last_became_active":"2024-09-12T01:41:59.987625+0000","last_became_peered":"2024-09-12T01:41:59.987625+0000","last_unstale":"2024-09-12T01:42:02.452369+0000","last_undegraded":"2024-09-12T01:42:02.452369+0000","last_fullsized":"2024-09-12T01:42:02.452369+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:51.680001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"91'2","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452221+0000","last_change":"2024-09-12T01:41:58.996161+0000","last_active":"2024-09-12T01:42:02.452221+0000","last_peered":"2024-09-12T01:42:02.452221+0000","last_clean":"2024-09-12T01:42:02.452221+0000","last_became_active":"2024-09-12T01:41:58.995854+0000","last_became_peered":"2024-09-12T01:41:58.995854+0000","last_unstale":"2024-09-12T01:42:02.452221+0000","last_undegraded":"2024-09-12T01:42:02.452221+0000","last_fullsized":"2024-09-12T01:42:02.452221+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:04.272253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452034+0000","last_change":"2024-09-12T01:41:59.992362+0000","last_active":"2024-09-12T01:42:02.452034+0000","last_peered":"2024-09-12T01:42:02.452034+0000","last_clean":"2024-09-12T01:42:02.452034+0000","last_became_active":"2024-09-12T01:41:59.992048+0000","last_became_peered":"2024-09-12T01:41:59.992048+0000","last_unstale":"2024-09-12T01:42:02.452034+0000","last_undegraded":"2024-09-12T01:42:02.452034+0000","last_fullsized":"2024-09-12T01:42:02.452034+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:36.937083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"91'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995902+0000","last_change":"2024-09-12T01:41:58.990373+0000","last_active":"2024-09-12T01:42:00.995902+0000","last_peered":"2024-09-12T01:42:00.995902+0000","last_clean":"2024-09-12T01:42:00.995902+0000","last_became_active":"2024-09-12T01:41:58.990079+0000","last_became_peered":"2024-09-12T01:41:58.990079+0000","last_unstale":"2024-09-12T01:42:00.995902+0000","last_undegraded":"2024-09-12T01:42:00.995902+0000","last_fullsized":"2024-09-12T01:42:00.995902+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:03.731788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452223+0000","last_change":"2024-09-12T01:41:59.999108+0000","last_active":"2024-09-12T01:42:02.452223+0000","last_peered":"2024-09-12T01:42:02.452223+0000","last_clean":"2024-09-12T01:42:02.452223+0000","last_became_active":"2024-09-12T01:41:59.998824+0000","last_became_peered":"2024-09-12T01:41:59.998824+0000","last_unstale":"2024-09-12T01:42:02.452223+0000","last_undegraded":"2024-09-12T01:42:02.452223+0000","last_fullsized":"2024-09-12T01:42:02.452223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:26.966614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.986055+0000","last_change":"2024-09-12T01:41:58.997460+0000","last_active":"2024-09-12T01:42:01.986055+0000","last_peered":"2024-09-12T01:42:01.986055+0000","last_clean":"2024-09-12T01:42:01.986055+0000","last_became_active":"2024-09-12T01:41:58.996445+0000","last_became_peered":"2024-09-12T01:41:58.996445+0000","last_unstale":"2024-09-12T01:42:01.986055+0000","last_undegraded":"2024-09-12T01:42:01.986055+0000","last_fullsized":"2024-09-12T01:42:01.986055+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:56.414738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.985952+0000","last_change":"2024-09-12T01:41:59.999188+0000","last_active":"2024-09-12T01:42:01.985952+0000","last_peered":"2024-09-12T01:42:01.985952+0000","last_clean":"2024-09-12T01:42:01.985952+0000","last_became_active":"2024-09-12T01:41:59.998893+0000","last_became_peered":"2024-09-12T01:41:59.998893+0000","last_unstale":"2024-09-12T01:42:01.985952+0000","last_undegraded":"2024-09-12T01:42:01.985952+0000","last_fullsized":"2024-09-12T01:42:01.985952+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.863097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"91'2","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452087+0000","last_change":"2024-09-12T01:41:58.997143+0000","last_active":"2024-09-12T01:42:02.452087+0000","last_peered":"2024-09-12T01:42:02.452087+0000","last_clean":"2024-09-12T01:42:02.452087+0000","last_became_active":"2024-09-12T01:41:58.996881+0000","last_became_peered":"2024-09-12T01:41:58.996881+0000","last_unstale":"2024-09-12T01:42:02.452087+0000","last_undegraded":"2024-09-12T01:42:02.452087+0000","last_fullsized":"2024-09-12T01:42:02.452087+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:47.813327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.985993+0000","last_change":"2024-09-12T01:42:00.001287+0000","last_active":"2024-09-12T01:42:01.985993+0000","last_peered":"2024-09-12T01:42:01.985993+0000","last_clean":"2024-09-12T01:42:01.985993+0000","last_became_active":"2024-09-12T01:42:00.001027+0000","last_became_peered":"2024-09-12T01:42:00.001027+0000","last_unstale":"2024-09-12T01:42:01.985993+0000","last_undegraded":"2024-09-12T01:42:01.985993+0000","last_fullsized":"2024-09-12T01:42:01.985993+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:35.590737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451685+0000","last_change":"2024-09-12T01:41:58.992864+0000","last_active":"2024-09-12T01:42:02.451685+0000","last_peered":"2024-09-12T01:42:02.451685+0000","last_clean":"2024-09-12T01:42:02.451685+0000","last_became_active":"2024-09-12T01:41:58.992587+0000","last_became_peered":"2024-09-12T01:41:58.992587+0000","last_unstale":"2024-09-12T01:42:02.451685+0000","last_undegraded":"2024-09-12T01:42:02.451685+0000","last_fullsized":"2024-09-12T01:42:02.451685+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:08.383216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452114+0000","last_change":"2024-09-12T01:42:00.002542+0000","last_active":"2024-09-12T01:42:02.452114+0000","last_peered":"2024-09-12T01:42:02.452114+0000","last_clean":"2024-09-12T01:42:02.452114+0000","last_became_active":"2024-09-12T01:42:00.002208+0000","last_became_peered":"2024-09-12T01:42:00.002208+0000","last_unstale":"2024-09-12T01:42:02.452114+0000","last_undegraded":"2024-09-12T01:42:02.452114+0000","last_fullsized":"2024-09-12T01:42:02.452114+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:26.698973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.510141+0000","last_change":"2024-09-12T01:41:58.993285+0000","last_active":"2024-09-12T01:42:01.510141+0000","last_peered":"2024-09-12T01:42:01.510141+0000","last_clean":"2024-09-12T01:42:01.510141+0000","last_became_active":"2024-09-12T01:41:58.992941+0000","last_became_peered":"2024-09-12T01:41:58.992941+0000","last_unstale":"2024-09-12T01:42:01.510141+0000","last_undegraded":"2024-09-12T01:42:01.510141+0000","last_fullsized":"2024-09-12T01:42:01.510141+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:25.964417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451516+0000","last_change":"2024-09-12T01:41:59.998894+0000","last_active":"2024-09-12T01:42:02.451516+0000","last_peered":"2024-09-12T01:42:02.451516+0000","last_clean":"2024-09-12T01:42:02.451516+0000","last_became_active":"2024-09-12T01:41:59.998534+0000","last_became_peered":"2024-09-12T01:41:59.998534+0000","last_unstale":"2024-09-12T01:42:02.451516+0000","last_undegraded":"2024-09-12T01:42:02.451516+0000","last_fullsized":"2024-09-12T01:42:02.451516+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:12.338449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.002706+0000","last_change":"2024-09-12T01:41:58.993775+0000","last_active":"2024-09-12T01:42:01.002706+0000","last_peered":"2024-09-12T01:42:01.002706+0000","last_clean":"2024-09-12T01:42:01.002706+0000","last_became_active":"2024-09-12T01:41:58.993509+0000","last_became_peered":"2024-09-12T01:41:58.993509+0000","last_unstale":"2024-09-12T01:42:01.002706+0000","last_undegraded":"2024-09-12T01:42:01.002706+0000","last_fullsized":"2024-09-12T01:42:01.002706+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:44.676864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.986294+0000","last_change":"2024-09-12T01:42:00.007206+0000","last_active":"2024-09-12T01:42:01.986294+0000","last_peered":"2024-09-12T01:42:01.986294+0000","last_clean":"2024-09-12T01:42:01.986294+0000","last_became_active":"2024-09-12T01:42:00.006901+0000","last_became_peered":"2024-09-12T01:42:00.006901+0000","last_unstale":"2024-09-12T01:42:01.986294+0000","last_undegraded":"2024-09-12T01:42:01.986294+0000","last_fullsized":"2024-09-12T01:42:01.986294+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:03.585901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"91'2","reported_seq":16,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452314+0000","last_change":"2024-09-12T01:41:58.996435+0000","last_active":"2024-09-12T01:42:02.452314+0000","last_peered":"2024-09-12T01:42:02.452314+0000","last_clean":"2024-09-12T01:42:02.452314+0000","last_became_active":"2024-09-12T01:41:58.995490+0000","last_became_peered":"2024-09-12T01:41:58.995490+0000","last_unstale":"2024-09-12T01:42:02.452314+0000","last_undegraded":"2024-09-12T01:42:02.452314+0000","last_fullsized":"2024-09-12T01:42:02.452314+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:24.184298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.986417+0000","last_change":"2024-09-12T01:42:00.016030+0000","last_active":"2024-09-12T01:42:01.986417+0000","last_peered":"2024-09-12T01:42:01.986417+0000","last_clean":"2024-09-12T01:42:01.986417+0000","last_became_active":"2024-09-12T01:42:00.015719+0000","last_became_peered":"2024-09-12T01:42:00.015719+0000","last_unstale":"2024-09-12T01:42:01.986417+0000","last_undegraded":"2024-09-12T01:42:01.986417+0000","last_fullsized":"2024-09-12T01:42:01.986417+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:04.740946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"92'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.986353+0000","last_change":"2024-09-12T01:41:58.993546+0000","last_active":"2024-09-12T01:42:01.986353+0000","last_peered":"2024-09-12T01:42:01.986353+0000","last_clean":"2024-09-12T01:42:01.986353+0000","last_became_active":"2024-09-12T01:41:58.992168+0000","last_became_peered":"2024-09-12T01:41:58.992168+0000","last_unstale":"2024-09-12T01:42:01.986353+0000","last_undegraded":"2024-09-12T01:42:01.986353+0000","last_fullsized":"2024-09-12T01:42:01.986353+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:11.336252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.002241+0000","last_change":"2024-09-12T01:42:00.001750+0000","last_active":"2024-09-12T01:42:01.002241+0000","last_peered":"2024-09-12T01:42:01.002241+0000","last_clean":"2024-09-12T01:42:01.002241+0000","last_became_active":"2024-09-12T01:42:00.001476+0000","last_became_peered":"2024-09-12T01:42:00.001476+0000","last_unstale":"2024-09-12T01:42:01.002241+0000","last_undegraded":"2024-09-12T01:42:01.002241+0000","last_fullsized":"2024-09-12T01:42:01.002241+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:50.950140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.986106+0000","last_change":"2024-09-12T01:41:58.994382+0000","last_active":"2024-09-12T01:42:01.986106+0000","last_peered":"2024-09-12T01:42:01.986106+0000","last_clean":"2024-09-12T01:42:01.986106+0000","last_became_active":"2024-09-12T01:41:58.994094+0000","last_became_peered":"2024-09-12T01:41:58.994094+0000","last_unstale":"2024-09-12T01:42:01.986106+0000","last_undegraded":"2024-09-12T01:42:01.986106+0000","last_fullsized":"2024-09-12T01:42:01.986106+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:13.091759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995820+0000","last_change":"2024-09-12T01:42:00.004296+0000","last_active":"2024-09-12T01:42:00.995820+0000","last_peered":"2024-09-12T01:42:00.995820+0000","last_clean":"2024-09-12T01:42:00.995820+0000","last_became_active":"2024-09-12T01:42:00.004039+0000","last_became_peered":"2024-09-12T01:42:00.004039+0000","last_unstale":"2024-09-12T01:42:00.995820+0000","last_undegraded":"2024-09-12T01:42:00.995820+0000","last_fullsized":"2024-09-12T01:42:00.995820+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:29.791098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452179+0000","last_change":"2024-09-12T01:41:58.992765+0000","last_active":"2024-09-12T01:42:02.452179+0000","last_peered":"2024-09-12T01:42:02.452179+0000","last_clean":"2024-09-12T01:42:02.452179+0000","last_became_active":"2024-09-12T01:41:58.992493+0000","last_became_peered":"2024-09-12T01:41:58.992493+0000","last_unstale":"2024-09-12T01:42:02.452179+0000","last_undegraded":"2024-09-12T01:42:02.452179+0000","last_fullsized":"2024-09-12T01:42:02.452179+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:57.294404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.985865+0000","last_change":"2024-09-12T01:42:00.000490+0000","last_active":"2024-09-12T01:42:01.985865+0000","last_peered":"2024-09-12T01:42:01.985865+0000","last_clean":"2024-09-12T01:42:01.985865+0000","last_became_active":"2024-09-12T01:41:59.996026+0000","last_became_peered":"2024-09-12T01:41:59.996026+0000","last_unstale":"2024-09-12T01:42:01.985865+0000","last_undegraded":"2024-09-12T01:42:01.985865+0000","last_fullsized":"2024-09-12T01:42:01.985865+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:23.851056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.001909+0000","last_change":"2024-09-12T01:41:58.993411+0000","last_active":"2024-09-12T01:42:01.001909+0000","last_peered":"2024-09-12T01:42:01.001909+0000","last_clean":"2024-09-12T01:42:01.001909+0000","last_became_active":"2024-09-12T01:41:58.993122+0000","last_became_peered":"2024-09-12T01:41:58.993122+0000","last_unstale":"2024-09-12T01:42:01.001909+0000","last_undegraded":"2024-09-12T01:42:01.001909+0000","last_fullsized":"2024-09-12T01:42:01.001909+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:50.627366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:00.995561+0000","last_change":"2024-09-12T01:41:59.999997+0000","last_active":"2024-09-12T01:42:00.995561+0000","last_peered":"2024-09-12T01:42:00.995561+0000","last_clean":"2024-09-12T01:42:00.995561+0000","last_became_active":"2024-09-12T01:41:59.999544+0000","last_became_peered":"2024-09-12T01:41:59.999544+0000","last_unstale":"2024-09-12T01:42:00.995561+0000","last_undegraded":"2024-09-12T01:42:00.995561+0000","last_fullsized":"2024-09-12T01:42:00.995561+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:22.629252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451783+0000","last_change":"2024-09-12T01:41:58.994797+0000","last_active":"2024-09-12T01:42:02.451783+0000","last_peered":"2024-09-12T01:42:02.451783+0000","last_clean":"2024-09-12T01:42:02.451783+0000","last_became_active":"2024-09-12T01:41:58.994442+0000","last_became_peered":"2024-09-12T01:41:58.994442+0000","last_unstale":"2024-09-12T01:42:02.451783+0000","last_undegraded":"2024-09-12T01:42:02.451783+0000","last_fullsized":"2024-09-12T01:42:02.451783+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:01.964583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.985805+0000","last_change":"2024-09-12T01:42:00.006100+0000","last_active":"2024-09-12T01:42:01.985805+0000","last_peered":"2024-09-12T01:42:01.985805+0000","last_clean":"2024-09-12T01:42:01.985805+0000","last_became_active":"2024-09-12T01:42:00.005681+0000","last_became_peered":"2024-09-12T01:42:00.005681+0000","last_unstale":"2024-09-12T01:42:01.985805+0000","last_undegraded":"2024-09-12T01:42:01.985805+0000","last_fullsized":"2024-09-12T01:42:01.985805+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:48.293328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.000780+0000","last_change":"2024-09-12T01:41:58.996497+0000","last_active":"2024-09-12T01:42:01.000780+0000","last_peered":"2024-09-12T01:42:01.000780+0000","last_clean":"2024-09-12T01:42:01.000780+0000","last_became_active":"2024-09-12T01:41:58.996200+0000","last_became_peered":"2024-09-12T01:41:58.996200+0000","last_unstale":"2024-09-12T01:42:01.000780+0000","last_undegraded":"2024-09-12T01:42:01.000780+0000","last_fullsized":"2024-09-12T01:42:01.000780+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:40.919309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451556+0000","last_change":"2024-09-12T01:41:59.997655+0000","last_active":"2024-09-12T01:42:02.451556+0000","last_peered":"2024-09-12T01:42:02.451556+0000","last_clean":"2024-09-12T01:42:02.451556+0000","last_became_active":"2024-09-12T01:41:59.997190+0000","last_became_peered":"2024-09-12T01:41:59.997190+0000","last_unstale":"2024-09-12T01:42:02.451556+0000","last_undegraded":"2024-09-12T01:42:02.451556+0000","last_fullsized":"2024-09-12T01:42:02.451556+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:15.487060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.002732+0000","last_change":"2024-09-12T01:41:58.992877+0000","last_active":"2024-09-12T01:42:01.002732+0000","last_peered":"2024-09-12T01:42:01.002732+0000","last_clean":"2024-09-12T01:42:01.002732+0000","last_became_active":"2024-09-12T01:41:58.992561+0000","last_became_peered":"2024-09-12T01:41:58.992561+0000","last_unstale":"2024-09-12T01:42:01.002732+0000","last_undegraded":"2024-09-12T01:42:01.002732+0000","last_fullsized":"2024-09-12T01:42:01.002732+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:32.061680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:01.002715+0000","last_change":"2024-09-12T01:42:00.009385+0000","last_active":"2024-09-12T01:42:01.002715+0000","last_peered":"2024-09-12T01:42:01.002715+0000","last_clean":"2024-09-12T01:42:01.002715+0000","last_became_active":"2024-09-12T01:42:00.009073+0000","last_became_peered":"2024-09-12T01:42:00.009073+0000","last_unstale":"2024-09-12T01:42:01.002715+0000","last_undegraded":"2024-09-12T01:42:01.002715+0000","last_fullsized":"2024-09-12T01:42:01.002715+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:58.971450+0000","last_clean_scrub_stamp":"2024-09-12T01:41:58.971450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:59.380251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"91'1","reported_seq":15,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.452312+0000","last_change":"2024-09-12T01:41:58.996923+0000","last_active":"2024-09-12T01:42:02.452312+0000","last_peered":"2024-09-12T01:42:02.452312+0000","last_clean":"2024-09-12T01:42:02.452312+0000","last_became_active":"2024-09-12T01:41:58.996587+0000","last_became_peered":"2024-09-12T01:41:58.996587+0000","last_unstale":"2024-09-12T01:42:02.452312+0000","last_undegraded":"2024-09-12T01:42:02.452312+0000","last_fullsized":"2024-09-12T01:42:02.452312+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:41:57.969254+0000","last_clean_scrub_stamp":"2024-09-12T01:41:57.969254+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:22.567888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":302,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-09-12T01:42:02.451423+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:42:02.451423+0000","last_peered":"2024-09-12T01:42:02.451423+0000","last_clean":"2024-09-12T01:42:02.451423+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:42:02.451423+0000","last_undegraded":"2024-09-12T01:42:02.451423+0000","last_fullsized":"2024-09-12T01:42:02.451423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509521,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1134592,"data_stored":476954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509519,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1130496,"data_stored":476372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509519,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1744896,"data_stored":1068408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509519,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36468,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335372,"statfs":{"total":96636764160,"available":96599420928,"internally_reserved":0,"allocated":1142784,"data_stored":476566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509519,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36460,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335380,"statfs":{"total":96636764160,"available":96599429120,"internally_reserved":0,"allocated":1134592,"data_stored":476442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509519,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1744896,"data_stored":1068464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509520,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36456,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335384,"statfs":{"total":96636764160,"available":96599433216,"internally_reserved":0,"allocated":1130496,"data_stored":476372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1134592,"data_stored":476954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:42:07.730 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:42:07.730 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:42:07.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.877+0000 7fafda398640 1 Processor -- start 2024-09-12T01:42:07.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.877+0000 7fafda398640 1 -- start start 2024-09-12T01:42:07.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.877+0000 7fafda398640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fafd415e7a0 0x7fafd406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.877+0000 7fafda398640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fafd40b68f0 0x7fafd40d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.877+0000 7fafda398640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd40cf860 con 0x7fafd40cf1f0 2024-09-12T01:42:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.877+0000 7fafda398640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fafd40d2ca0 con 0x7fafd415e7a0 2024-09-12T01:42:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.877+0000 7fafda398640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fafd40cfb40 con 0x7fafd40b68f0 2024-09-12T01:42:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.878+0000 7fafd3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fafd415e7a0 0x7fafd406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.878+0000 7fafd3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fafd415e7a0 0x7fafd406caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36504/0 (socket says 172.21.15.60:36504) 2024-09-12T01:42:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.878+0000 7fafd3fff640 1 -- 172.21.15.60:0/3182198179 learned_addr learned my addr 172.21.15.60:0/3182198179 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.878+0000 7fafd8935640 1 --2- 172.21.15.60:0/3182198179 >> v2:172.21.15.105:3300/0 conn(0x7fafd40b68f0 0x7fafd40d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.878+0000 7fafd3fff640 1 -- 172.21.15.60:0/3182198179 >> v2:172.21.15.105:3300/0 conn(0x7fafd40b68f0 msgr2=0x7fafd40d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.878+0000 7fafd3fff640 1 --2- 172.21.15.60:0/3182198179 >> v2:172.21.15.105:3300/0 conn(0x7fafd40b68f0 0x7fafd40d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.878+0000 7fafd3fff640 1 -- 172.21.15.60:0/3182198179 >> v1:172.21.15.105:6789/0 conn(0x7fafd40cf1f0 legacy=0x7fafd40b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:07.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.878+0000 7fafd3fff640 1 -- 172.21.15.60:0/3182198179 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd40cfe20 con 0x7fafd415e7a0 2024-09-12T01:42:07.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.879+0000 7fafd3fff640 1 --2- 172.21.15.60:0/3182198179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd415e7a0 0x7fafd406caa0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fafd408d930 tx=0x7fafc402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389b6455e143c039 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:07.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.879+0000 7fafd2ffd640 1 -- 172.21.15.60:0/3182198179 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc4037070 con 0x7fafd415e7a0 2024-09-12T01:42:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.879+0000 7fafd2ffd640 1 -- 172.21.15.60:0/3182198179 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc4032440 con 0x7fafd415e7a0 2024-09-12T01:42:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.879+0000 7fafd2ffd640 1 -- 172.21.15.60:0/3182198179 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc4032810 con 0x7fafd415e7a0 2024-09-12T01:42:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.879+0000 7fafda398640 1 -- 172.21.15.60:0/3182198179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd415e7a0 msgr2=0x7fafd406caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.879+0000 7fafda398640 1 --2- 172.21.15.60:0/3182198179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd415e7a0 0x7fafd406caa0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fafd408d930 tx=0x7fafc402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.879+0000 7fafda398640 1 -- 172.21.15.60:0/3182198179 shutdown_connections 2024-09-12T01:42:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.879+0000 7fafda398640 1 --2- 172.21.15.60:0/3182198179 >> v2:172.21.15.105:3300/0 conn(0x7fafd40b68f0 0x7fafd40d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.879+0000 7fafda398640 1 --2- 172.21.15.60:0/3182198179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd415e7a0 0x7fafd406caa0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.879+0000 7fafda398640 1 -- 172.21.15.60:0/3182198179 >> 172.21.15.60:0/3182198179 conn(0x7fafd40d11e0 msgr2=0x7fafd40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.879+0000 7fafda398640 1 -- 172.21.15.60:0/3182198179 shutdown_connections 2024-09-12T01:42:07.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.879+0000 7fafda398640 1 -- 172.21.15.60:0/3182198179 wait complete. 2024-09-12T01:42:07.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.881+0000 7fafda398640 1 Processor -- start 2024-09-12T01:42:07.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.881+0000 7fafda398640 1 -- start start 2024-09-12T01:42:07.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafda398640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd40b68f0 0x7fafd415f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:07.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafda398640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd40cf1f0 0x7fafd414bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:07.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafda398640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd415e7a0 0x7fafd40d4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafda398640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fafd406cfe0 con 0x7fafd40b68f0 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafda398640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fafd40b7a00 con 0x7fafd40cf1f0 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafda398640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fafd415eb80 con 0x7fafd415e7a0 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd40b68f0 0x7fafd415f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd40b68f0 0x7fafd415f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36518/0 (socket says 172.21.15.60:36518) 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd3fff640 1 -- 172.21.15.60:0/43131085 learned_addr learned my addr 172.21.15.60:0/43131085 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd37fe640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd40cf1f0 0x7fafd414bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd8935640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd415e7a0 0x7fafd40d4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd3fff640 1 -- 172.21.15.60:0/43131085 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd415e7a0 msgr2=0x7fafd40d4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd3fff640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd415e7a0 0x7fafd40d4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd3fff640 1 -- 172.21.15.60:0/43131085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd40cf1f0 msgr2=0x7fafd414bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd3fff640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd40cf1f0 0x7fafd414bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd3fff640 1 -- 172.21.15.60:0/43131085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd4159110 con 0x7fafd40b68f0 2024-09-12T01:42:07.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd37fe640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd40cf1f0 0x7fafd414bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:07.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd3fff640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd40b68f0 0x7fafd415f900 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fafc4000c00 tx=0x7fafc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:07.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd0ff9640 1 -- 172.21.15.60:0/43131085 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc4041030 con 0x7fafd40b68f0 2024-09-12T01:42:07.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd0ff9640 1 -- 172.21.15.60:0/43131085 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc4030440 con 0x7fafd40b68f0 2024-09-12T01:42:07.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafda398640 1 -- 172.21.15.60:0/43131085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd415fe40 con 0x7fafd40b68f0 2024-09-12T01:42:07.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafd0ff9640 1 -- 172.21.15.60:0/43131085 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc4037040 con 0x7fafd40b68f0 2024-09-12T01:42:07.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.882+0000 7fafda398640 1 -- 172.21.15.60:0/43131085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd415ee20 con 0x7fafd40b68f0 2024-09-12T01:42:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.883+0000 7fafda398640 1 -- 172.21.15.60:0/43131085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd406caa0 con 0x7fafd40b68f0 2024-09-12T01:42:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.884+0000 7fafd0ff9640 1 -- 172.21.15.60:0/43131085 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fafc4044070 con 0x7fafd40b68f0 2024-09-12T01:42:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.884+0000 7fafd0ff9640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fafc006be30 0x7fafc006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.884+0000 7fafd0ff9640 1 -- 172.21.15.60:0/43131085 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fafc40ab4d0 con 0x7fafd40b68f0 2024-09-12T01:42:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.884+0000 7fafd37fe640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fafc006be30 0x7fafc006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:07.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.885+0000 7fafd37fe640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fafc006be30 0x7fafc006e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fafd4160280 tx=0x7fafc8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:07.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:07.889+0000 7fafd0ff9640 1 -- 172.21.15.60:0/43131085 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fafd4159110 con 0x7fafd40b68f0 2024-09-12T01:42:08.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.134+0000 7fafda398640 1 -- 172.21.15.60:0/43131085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fafd40d2a80 con 0x7fafd40b68f0 2024-09-12T01:42:08.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.136+0000 7fafd0ff9640 1 -- 172.21.15.60:0/43131085 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7fafc40a9e20 con 0x7fafd40b68f0 2024-09-12T01:42:08.135 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-12T01:42:08.135 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ== 2024-09-12T01:42:08.135 INFO:teuthology.orchestra.run.smithi060.stdout: caps mds = "allow" 2024-09-12T01:42:08.135 INFO:teuthology.orchestra.run.smithi060.stdout: caps mon = "allow r" 2024-09-12T01:42:08.136 INFO:teuthology.orchestra.run.smithi060.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:42:08.136 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2024-09-12T01:42:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.138+0000 7fafda398640 1 -- 172.21.15.60:0/43131085 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fafc006be30 msgr2=0x7fafc006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.138+0000 7fafda398640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fafc006be30 0x7fafc006e2f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fafd4160280 tx=0x7fafc8009040 comp rx=0 tx=0).stop 2024-09-12T01:42:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.138+0000 7fafda398640 1 -- 172.21.15.60:0/43131085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd40b68f0 msgr2=0x7fafd415f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.138+0000 7fafda398640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd40b68f0 0x7fafd415f900 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fafc4000c00 tx=0x7fafc40046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.138+0000 7fafda398640 1 -- 172.21.15.60:0/43131085 shutdown_connections 2024-09-12T01:42:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.138+0000 7fafda398640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fafc006be30 0x7fafc006e2f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.138+0000 7fafda398640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fafd415e7a0 0x7fafd40d4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.138+0000 7fafda398640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fafd40cf1f0 0x7fafd414bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.138+0000 7fafda398640 1 --2- 172.21.15.60:0/43131085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafd40b68f0 0x7fafd415f900 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.138+0000 7fafda398640 1 -- 172.21.15.60:0/43131085 >> 172.21.15.60:0/43131085 conn(0x7fafd40d11e0 msgr2=0x7fafd40b83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.138+0000 7fafda398640 1 -- 172.21.15.60:0/43131085 shutdown_connections 2024-09-12T01:42:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.138+0000 7fafda398640 1 -- 172.21.15.60:0/43131085 wait complete. 2024-09-12T01:42:08.148 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:08.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.252+0000 7f8b5b0e4640 1 Processor -- start 2024-09-12T01:42:08.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.252+0000 7f8b5b0e4640 1 -- start start 2024-09-12T01:42:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.253+0000 7f8b5b0e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b540b74c0 0x7f8b5415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.253+0000 7f8b5b0e4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8b5415f030 0x7f8b5406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.253+0000 7f8b5b0e4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b5415fb10 con 0x7f8b5415c2b0 2024-09-12T01:42:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.253+0000 7f8b5b0e4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8b540b5900 con 0x7f8b5415f030 2024-09-12T01:42:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.253+0000 7f8b5b0e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5415f830 con 0x7f8b540b74c0 2024-09-12T01:42:08.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.254+0000 7f8b53fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b540b74c0 0x7f8b5415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.254+0000 7f8b59681640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8b5415f030 0x7f8b5406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.254+0000 7f8b53fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b540b74c0 0x7f8b5415eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:52778/0 (socket says 172.21.15.60:52778) 2024-09-12T01:42:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.254+0000 7f8b53fff640 1 -- 172.21.15.60:0/990295326 learned_addr learned my addr 172.21.15.60:0/990295326 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.254+0000 7f8b58e80640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f8b5415c2b0 0x7f8b540b6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:36324/0 (socket says 172.21.15.60:36324) 2024-09-12T01:42:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.254+0000 7f8b53fff640 1 -- 172.21.15.60:0/990295326 >> v2:172.21.15.105:3300/0 conn(0x7f8b5415f030 msgr2=0x7f8b5406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.254+0000 7f8b53fff640 1 --2- 172.21.15.60:0/990295326 >> v2:172.21.15.105:3300/0 conn(0x7f8b5415f030 0x7f8b5406d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.254+0000 7f8b53fff640 1 -- 172.21.15.60:0/990295326 >> v1:172.21.15.105:6789/0 conn(0x7f8b5415c2b0 legacy=0x7f8b540b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:08.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.254+0000 7f8b53fff640 1 -- 172.21.15.60:0/990295326 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b5406ce30 con 0x7f8b540b74c0 2024-09-12T01:42:08.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.255+0000 7f8b53fff640 1 --2- 172.21.15.60:0/990295326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b540b74c0 0x7f8b5415eaf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009870 tx=0x7f8b3c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd52fd12b18174e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.255+0000 7f8b537fe640 1 -- 172.21.15.60:0/990295326 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c037070 con 0x7f8b540b74c0 2024-09-12T01:42:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.255+0000 7f8b537fe640 1 -- 172.21.15.60:0/990295326 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b3c032440 con 0x7f8b540b74c0 2024-09-12T01:42:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.255+0000 7f8b537fe640 1 -- 172.21.15.60:0/990295326 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c032810 con 0x7f8b540b74c0 2024-09-12T01:42:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.255+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/990295326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b540b74c0 msgr2=0x7f8b5415eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.255+0000 7f8b5b0e4640 1 --2- 172.21.15.60:0/990295326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b540b74c0 0x7f8b5415eaf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009870 tx=0x7f8b3c02a270 comp rx=0 tx=0).stop 2024-09-12T01:42:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.255+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/990295326 shutdown_connections 2024-09-12T01:42:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.255+0000 7f8b5b0e4640 1 --2- 172.21.15.60:0/990295326 >> v2:172.21.15.105:3300/0 conn(0x7f8b5415f030 0x7f8b5406d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.255+0000 7f8b5b0e4640 1 --2- 172.21.15.60:0/990295326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b540b74c0 0x7f8b5415eaf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.255+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/990295326 >> 172.21.15.60:0/990295326 conn(0x7f8b540b4240 msgr2=0x7f8b540b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.255+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/990295326 shutdown_connections 2024-09-12T01:42:08.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.255+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/990295326 wait complete. 2024-09-12T01:42:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.257+0000 7f8b5b0e4640 1 Processor -- start 2024-09-12T01:42:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.257+0000 7f8b5b0e4640 1 -- start start 2024-09-12T01:42:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.257+0000 7f8b5b0e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b540b74c0 0x7f8b54152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.257+0000 7f8b5b0e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b5415c2b0 0x7f8b54148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.257+0000 7f8b5b0e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b5415f030 0x7f8b54154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b5b0e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5415f4c0 con 0x7f8b540b74c0 2024-09-12T01:42:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b5b0e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5406d3f0 con 0x7f8b5415c2b0 2024-09-12T01:42:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b5b0e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5406de50 con 0x7f8b5415f030 2024-09-12T01:42:08.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b58e80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b540b74c0 0x7f8b54152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b58e80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b540b74c0 0x7f8b54152a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36528/0 (socket says 172.21.15.60:36528) 2024-09-12T01:42:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b58e80640 1 -- 172.21.15.60:0/2297845235 learned_addr learned my addr 172.21.15.60:0/2297845235 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b59681640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b5415f030 0x7f8b54154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b53fff640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b5415c2b0 0x7f8b54148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b58e80640 1 -- 172.21.15.60:0/2297845235 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b5415f030 msgr2=0x7f8b54154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b58e80640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b5415f030 0x7f8b54154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b58e80640 1 -- 172.21.15.60:0/2297845235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b5415c2b0 msgr2=0x7f8b54148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b58e80640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b5415c2b0 0x7f8b54148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b58e80640 1 -- 172.21.15.60:0/2297845235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b541531a0 con 0x7f8b540b74c0 2024-09-12T01:42:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b58e80640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b540b74c0 0x7f8b54152a30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c430 tx=0x7f8b4c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:08.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b517fa640 1 -- 172.21.15.60:0/2297845235 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c0074e0 con 0x7f8b540b74c0 2024-09-12T01:42:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b517fa640 1 -- 172.21.15.60:0/2297845235 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b4c007680 con 0x7f8b540b74c0 2024-09-12T01:42:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/2297845235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b54153480 con 0x7f8b540b74c0 2024-09-12T01:42:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b517fa640 1 -- 172.21.15.60:0/2297845235 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c004a00 con 0x7f8b540b74c0 2024-09-12T01:42:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.258+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/2297845235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b54153a40 con 0x7f8b540b74c0 2024-09-12T01:42:08.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.259+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/2297845235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5415eaf0 con 0x7f8b540b74c0 2024-09-12T01:42:08.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.260+0000 7f8b517fa640 1 -- 172.21.15.60:0/2297845235 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b4c01a020 con 0x7f8b540b74c0 2024-09-12T01:42:08.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.260+0000 7f8b517fa640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8b3406be60 0x7f8b3406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:08.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.260+0000 7f8b517fa640 1 -- 172.21.15.60:0/2297845235 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f8b4c08a820 con 0x7f8b540b74c0 2024-09-12T01:42:08.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.260+0000 7f8b53fff640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8b3406be60 0x7f8b3406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:08.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.261+0000 7f8b53fff640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8b3406be60 0x7f8b3406e320 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c034000 tx=0x7f8b3c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:08.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.265+0000 7f8b517fa640 1 -- 172.21.15.60:0/2297845235 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b4c010300 con 0x7f8b540b74c0 2024-09-12T01:42:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.475+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/2297845235 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b54073750 con 0x7f8b540b74c0 2024-09-12T01:42:08.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.475+0000 7f8b517fa640 1 -- 172.21.15.60:0/2297845235 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5224 (secure 0 0 0) 0x7f8b4c0590a0 con 0x7f8b540b74c0 2024-09-12T01:42:08.475 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:08.475 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"btime":"2024-09-12T01:42:01:993818+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1757090077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1757090077},{"type":"v1","addr":"172.21.15.105:6834","nonce":1757090077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/131981610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":131981610},{"type":"v1","addr":"172.21.15.60:6836","nonce":131981610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6762,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/18288436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":18288436},{"type":"v1","addr":"172.21.15.60:6837","nonce":18288436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:41:59.340440+0000","modified":"2024-09-12T01:42:01.335289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35732},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35732":{"gid":35732,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/829908705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":829908705},{"type":"v1","addr":"172.21.15.105:6835","nonce":829908705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35732,"qdb_cluster":[35732]},"id":7}]} 2024-09-12T01:42:08.475 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 53 2024-09-12T01:42:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.477+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/2297845235 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8b3406be60 msgr2=0x7f8b3406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.477+0000 7f8b5b0e4640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8b3406be60 0x7f8b3406e320 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c034000 tx=0x7f8b3c02e000 comp rx=0 tx=0).stop 2024-09-12T01:42:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.477+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/2297845235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b540b74c0 msgr2=0x7f8b54152a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.477+0000 7f8b5b0e4640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b540b74c0 0x7f8b54152a30 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00c430 tx=0x7f8b4c00c8f0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.477+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/2297845235 shutdown_connections 2024-09-12T01:42:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.477+0000 7f8b5b0e4640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8b3406be60 0x7f8b3406e320 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.477+0000 7f8b5b0e4640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b5415f030 0x7f8b54154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.477+0000 7f8b5b0e4640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b5415c2b0 0x7f8b54148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.477+0000 7f8b5b0e4640 1 --2- 172.21.15.60:0/2297845235 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b540b74c0 0x7f8b54152a30 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:08.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.477+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/2297845235 >> 172.21.15.60:0/2297845235 conn(0x7f8b540b4240 msgr2=0x7f8b5415df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:08.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.478+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/2297845235 shutdown_connections 2024-09-12T01:42:08.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:08.478+0000 7f8b5b0e4640 1 -- 172.21.15.60:0/2297845235 wait complete. 2024-09-12T01:42:08.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:41:59.340440+0000', 'modified': '2024-09-12T01:42:01.335289+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35732}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35732': {'gid': 35732, 'name': 'd', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/829908705', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 829908705}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 829908705}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 35732, 'qdb_cluster': [35732]} 2024-09-12T01:42:08.891 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:42:08.891 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T01:42:08.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.000+0000 7f735f6e6640 1 Processor -- start 2024-09-12T01:42:08.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.000+0000 7f735f6e6640 1 -- start start 2024-09-12T01:42:09.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735f6e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f735815e940 0x7f73580b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735f6e6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f73580ba440 0x7f73580b6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735f6e6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f735815ed20 con 0x7f73580d2290 2024-09-12T01:42:09.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735f6e6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f73580d3ef0 con 0x7f735815e940 2024-09-12T01:42:09.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735f6e6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f73580d32e0 con 0x7f73580ba440 2024-09-12T01:42:09.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735d482640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f735815e940 0x7f73580b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735d482640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f735815e940 0x7f73580b6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36536/0 (socket says 172.21.15.60:36536) 2024-09-12T01:42:09.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735d482640 1 -- 172.21.15.60:0/2549375886 learned_addr learned my addr 172.21.15.60:0/2549375886 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:09.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735cc81640 1 --2- 172.21.15.60:0/2549375886 >> v2:172.21.15.105:3300/0 conn(0x7f73580ba440 0x7f73580b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735d482640 1 -- 172.21.15.60:0/2549375886 >> v2:172.21.15.105:3300/0 conn(0x7f73580ba440 msgr2=0x7f73580b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:09.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735d482640 1 --2- 172.21.15.60:0/2549375886 >> v2:172.21.15.105:3300/0 conn(0x7f73580ba440 0x7f73580b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735d482640 1 -- 172.21.15.60:0/2549375886 >> v1:172.21.15.105:6789/0 conn(0x7f73580d2290 legacy=0x7f73580cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.001+0000 7f735d482640 1 -- 172.21.15.60:0/2549375886 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73580d35c0 con 0x7f735815e940 2024-09-12T01:42:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.002+0000 7f735d482640 1 --2- 172.21.15.60:0/2549375886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f735815e940 0x7f73580b6140 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f735808d440 tx=0x7f735402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b5f4e8b0ee8728 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.002+0000 7f734ffff640 1 -- 172.21.15.60:0/2549375886 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7354037070 con 0x7f735815e940 2024-09-12T01:42:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.002+0000 7f734ffff640 1 -- 172.21.15.60:0/2549375886 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7354032440 con 0x7f735815e940 2024-09-12T01:42:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.002+0000 7f734ffff640 1 -- 172.21.15.60:0/2549375886 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7354032810 con 0x7f735815e940 2024-09-12T01:42:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.003+0000 7f735f6e6640 1 -- 172.21.15.60:0/2549375886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f735815e940 msgr2=0x7f73580b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.003+0000 7f735f6e6640 1 --2- 172.21.15.60:0/2549375886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f735815e940 0x7f73580b6140 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f735808d440 tx=0x7f735402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.003+0000 7f735f6e6640 1 -- 172.21.15.60:0/2549375886 shutdown_connections 2024-09-12T01:42:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.003+0000 7f735f6e6640 1 --2- 172.21.15.60:0/2549375886 >> v2:172.21.15.105:3300/0 conn(0x7f73580ba440 0x7f73580b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.003+0000 7f735f6e6640 1 --2- 172.21.15.60:0/2549375886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f735815e940 0x7f73580b6140 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.003+0000 7f735f6e6640 1 -- 172.21.15.60:0/2549375886 >> 172.21.15.60:0/2549375886 conn(0x7f73580d1140 msgr2=0x7f73580d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.003+0000 7f735f6e6640 1 -- 172.21.15.60:0/2549375886 shutdown_connections 2024-09-12T01:42:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.003+0000 7f735f6e6640 1 -- 172.21.15.60:0/2549375886 wait complete. 2024-09-12T01:42:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.004+0000 7f735f6e6640 1 Processor -- start 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.004+0000 7f735f6e6640 1 -- start start 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735f6e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73580ba440 0x7f73580cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735f6e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73580d2290 0x7f735815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735f6e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f735815e940 0x7f73581f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735f6e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f73580b7510 con 0x7f73580d2290 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735f6e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73580d3b80 con 0x7f73580ba440 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735f6e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f73580b8bb0 con 0x7f735815e940 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735cc81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73580d2290 0x7f735815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735cc81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73580d2290 0x7f735815d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36546/0 (socket says 172.21.15.60:36546) 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735cc81640 1 -- 172.21.15.60:0/3634478049 learned_addr learned my addr 172.21.15.60:0/3634478049 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735d482640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73580ba440 0x7f73580cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735cc81640 1 -- 172.21.15.60:0/3634478049 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f735815e940 msgr2=0x7f73581f4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735cc81640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f735815e940 0x7f73581f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735cc81640 1 -- 172.21.15.60:0/3634478049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73580ba440 msgr2=0x7f73580cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735cc81640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73580ba440 0x7f73580cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735cc81640 1 -- 172.21.15.60:0/3634478049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73580ccf30 con 0x7f73580d2290 2024-09-12T01:42:09.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735d482640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73580ba440 0x7f73580cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:09.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f735cc81640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73580d2290 0x7f735815d3c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f734800d800 tx=0x7f734800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:09.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.005+0000 7f734dffb640 1 -- 172.21.15.60:0/3634478049 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734800b6c0 con 0x7f73580d2290 2024-09-12T01:42:09.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.006+0000 7f734dffb640 1 -- 172.21.15.60:0/3634478049 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7348019070 con 0x7f73580d2290 2024-09-12T01:42:09.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.006+0000 7f735f6e6640 1 -- 172.21.15.60:0/3634478049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73580cd210 con 0x7f73580d2290 2024-09-12T01:42:09.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.006+0000 7f734dffb640 1 -- 172.21.15.60:0/3634478049 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f734800ba80 con 0x7f73580d2290 2024-09-12T01:42:09.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.006+0000 7f735f6e6640 1 -- 172.21.15.60:0/3634478049 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73580cd7d0 con 0x7f73580d2290 2024-09-12T01:42:09.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.008+0000 7f734dffb640 1 -- 172.21.15.60:0/3634478049 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f734800bc20 con 0x7f73580d2290 2024-09-12T01:42:09.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.008+0000 7f734dffb640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f733c06be30 0x7f733c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.008+0000 7f734dffb640 1 -- 172.21.15.60:0/3634478049 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f734808b320 con 0x7f73580d2290 2024-09-12T01:42:09.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.008+0000 7f735d482640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f733c06be30 0x7f733c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.009+0000 7f735d482640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f733c06be30 0x7f733c06e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7354034000 tx=0x7f735402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:09.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.009+0000 7f736247d740 1 Processor -- start 2024-09-12T01:42:09.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.009+0000 7f736247d740 1 -- start start 2024-09-12T01:42:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f736247d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d7592c0 0x55fe2d79ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f736247d740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d756a80 0x55fe2d7596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f736247d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d7538b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f736247d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55fe2d6bb520 con 0x55fe2d75aa50 2024-09-12T01:42:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f736247d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55fe2d6633e0 con 0x55fe2d7592c0 2024-09-12T01:42:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f736247d740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55fe2d6b74e0 con 0x55fe2d756a80 2024-09-12T01:42:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f735dc83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d7538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f735dc83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d7538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36560/0 (socket says 172.21.15.60:36560) 2024-09-12T01:42:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f735dc83640 1 -- 172.21.15.60:0/99452797 learned_addr learned my addr 172.21.15.60:0/99452797 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f735d482640 1 --2- 172.21.15.60:0/99452797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d7592c0 0x55fe2d79ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f735cc81640 1 --2- 172.21.15.60:0/99452797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d756a80 0x55fe2d7596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f735dc83640 1 -- 172.21.15.60:0/99452797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d756a80 msgr2=0x55fe2d7596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f735dc83640 1 --2- 172.21.15.60:0/99452797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d756a80 0x55fe2d7596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f735dc83640 1 -- 172.21.15.60:0/99452797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d7592c0 msgr2=0x55fe2d79ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f735dc83640 1 --2- 172.21.15.60:0/99452797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d7592c0 0x55fe2d79ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f735dc83640 1 -- 172.21.15.60:0/99452797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2d67e2f0 con 0x55fe2d75aa50 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.010+0000 7f735dc83640 1 --2- 172.21.15.60:0/99452797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d7538b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7350001d50 tx=0x7f735000c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3179344cd2cd3b4e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.011+0000 7f7342ffd640 1 -- 172.21.15.60:0/99452797 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350017070 con 0x55fe2d75aa50 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.011+0000 7f7342ffd640 1 -- 172.21.15.60:0/99452797 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f735000cd40 con 0x55fe2d75aa50 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.011+0000 7f7342ffd640 1 -- 172.21.15.60:0/99452797 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350003bd0 con 0x55fe2d75aa50 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.011+0000 7f736247d740 1 -- 172.21.15.60:0/99452797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 msgr2=0x55fe2d7538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.011+0000 7f736247d740 1 --2- 172.21.15.60:0/99452797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d7538b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f7350001d50 tx=0x7f735000c0e0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.011+0000 7f736247d740 1 -- 172.21.15.60:0/99452797 shutdown_connections 2024-09-12T01:42:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.011+0000 7f736247d740 1 --2- 172.21.15.60:0/99452797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d7538b0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.011+0000 7f736247d740 1 --2- 172.21.15.60:0/99452797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d756a80 0x55fe2d7596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.011+0000 7f736247d740 1 --2- 172.21.15.60:0/99452797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d7592c0 0x55fe2d79ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.011+0000 7f736247d740 1 -- 172.21.15.60:0/99452797 >> 172.21.15.60:0/99452797 conn(0x55fe2d755a80 msgr2=0x55fe2d79df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:09.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.011+0000 7f736247d740 1 -- 172.21.15.60:0/99452797 shutdown_connections 2024-09-12T01:42:09.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.011+0000 7f736247d740 1 -- 172.21.15.60:0/99452797 wait complete. 2024-09-12T01:42:09.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.012+0000 7f736247d740 1 -- start start 2024-09-12T01:42:09.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.012+0000 7f736247d740 1 Processor -- start 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f736247d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d7592c0 0x55fe2d754300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f736247d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d779db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f736247d740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d77c5f0 0x55fe2d77ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f736247d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55fe2d754f20 con 0x55fe2d75aa50 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f736247d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55fe2d644450 con 0x55fe2d7592c0 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f736247d740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55fe2d79f290 con 0x55fe2d77c5f0 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f736247d740 10 client.0 _ll_register_callbacks cb 0x55fe2d3cdac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f735cc81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d779db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f735cc81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d779db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36564/0 (socket says 172.21.15.60:36564) 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f735cc81640 1 -- 172.21.15.60:0/4074878238 learned_addr learned my addr 172.21.15.60:0/4074878238 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f735d482640 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d7592c0 0x55fe2d754300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f735dc83640 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d77c5f0 0x55fe2d77ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f735cc81640 1 -- 172.21.15.60:0/4074878238 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d77c5f0 msgr2=0x55fe2d77ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f735cc81640 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d77c5f0 0x55fe2d77ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f735cc81640 1 -- 172.21.15.60:0/4074878238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d7592c0 msgr2=0x55fe2d754300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f735cc81640 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d7592c0 0x55fe2d754300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f735cc81640 1 -- 172.21.15.60:0/4074878238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe2d3ce2d0 con 0x55fe2d75aa50 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f735cc81640 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d779db0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f73480897f0 tx=0x7f7348059d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711ce3647ab7e4d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.013+0000 7f7337fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f7337fff640 1 -- 172.21.15.60:0/4074878238 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480621b0 con 0x55fe2d75aa50 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f7337fff640 1 -- 172.21.15.60:0/4074878238 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f7348055c40 con 0x55fe2d75aa50 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f736247d740 1 -- 172.21.15.60:0/4074878238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f735000cd40 con 0x55fe2d75aa50 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f7337fff640 1 -- 172.21.15.60:0/4074878238 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f7348058a20 con 0x55fe2d75aa50 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f736247d740 10 client.6924 fetch_fsmap learned FSMap version 53 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f736247d740 1 -- 172.21.15.60:0/4074878238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55fe2d4986b0 con 0x55fe2d75aa50 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f7337fff640 1 -- 172.21.15.60:0/4074878238 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f735000cd40 con 0x55fe2d75aa50 2024-09-12T01:42:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f7337fff640 1 -- 172.21.15.60:0/4074878238 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f7348013070 con 0x55fe2d75aa50 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f736247d740 10 client.6924 fetch_fsmap finished waiting for FSMap version 53 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f736247d740 10 client.6924 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f736247d740 20 client.6924 populate_metadata read hostname 'smithi060' 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f736247d740 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.105:6833/829908705,v1:172.21.15.105:6835/829908705] conn(0x55fe2d7528c0 0x55fe2d752ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f736247d740 4 client.6924 mds_command: new command op to 35732 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f736247d740 1 -- 172.21.15.60:0/4074878238 --> [v2:172.21.15.105:6833/829908705,v1:172.21.15.105:6835/829908705] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe2d6c8c50 con 0x55fe2d7528c0 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.014+0000 7f735d482640 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.105:6833/829908705,v1:172.21.15.105:6835/829908705] conn(0x55fe2d7528c0 0x55fe2d752ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.015+0000 7f735d482640 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.105:6833/829908705,v1:172.21.15.105:6835/829908705] conn(0x55fe2d7528c0 0x55fe2d752ca0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=287c3ef8c8240a28 server_cookie=7aa564e316715a50 in_seq=0 out_seq=0 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.015+0000 7f7337fff640 10 client.6924 ms_handle_connect on v2:172.21.15.105:6833/829908705 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f7337fff640 1 -- 172.21.15.60:0/4074878238 <== mds.0 v2:172.21.15.105:6833/829908705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fe2d6c8c50 con 0x55fe2d7528c0 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f7337fff640 10 client.6924 handle_command_reply: tid=0 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f736247d740 1 client.6924 shutdown 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f736247d740 1 -- 172.21.15.60:0/4074878238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 msgr2=0x55fe2d779db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f736247d740 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d779db0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f73480897f0 tx=0x7f7348059d90 comp rx=0 tx=0).stop 2024-09-12T01:42:09.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f736247d740 1 -- 172.21.15.60:0/4074878238 shutdown_connections 2024-09-12T01:42:09.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f736247d740 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.105:6833/829908705,v1:172.21.15.105:6835/829908705] conn(0x55fe2d7528c0 0x55fe2d752ca0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f736247d740 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d77c5f0 0x55fe2d77ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f736247d740 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d779db0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f736247d740 1 --2- 172.21.15.60:0/4074878238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d7592c0 0x55fe2d754300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f7337fff640 0 client.6924 ms_handle_reset on v2:172.21.15.105:6833/829908705 2024-09-12T01:42:09.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f736247d740 1 -- 172.21.15.60:0/4074878238 >> 172.21.15.60:0/4074878238 conn(0x55fe2d756a80 msgr2=0x55fe2d79d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:09.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f736247d740 1 -- 172.21.15.60:0/4074878238 shutdown_connections 2024-09-12T01:42:09.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f736247d740 1 -- 172.21.15.60:0/4074878238 wait complete. 2024-09-12T01:42:09.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.016+0000 7f736247d740 20 client.6924 trim_cache size 0 max 16384 2024-09-12T01:42:09.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.034+0000 7f736247d740 1 Processor -- start 2024-09-12T01:42:09.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.034+0000 7f736247d740 1 -- start start 2024-09-12T01:42:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.035+0000 7f736247d740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d7592c0 0x55fe2d7c2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.035+0000 7f736247d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d75aa50 0x55fe2d79bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.035+0000 7f736247d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d77c5f0 0x55fe2d79c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.035+0000 7f736247d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f73581ffc10 con 0x55fe2d77c5f0 2024-09-12T01:42:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.035+0000 7f736247d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f73580c96f0 con 0x55fe2d75aa50 2024-09-12T01:42:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.035+0000 7f736247d740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f73580ce620 con 0x55fe2d7592c0 2024-09-12T01:42:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.035+0000 7f735dc83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d77c5f0 0x55fe2d79c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.035+0000 7f735dc83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d77c5f0 0x55fe2d79c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36580/0 (socket says 172.21.15.60:36580) 2024-09-12T01:42:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.035+0000 7f735dc83640 1 -- 172.21.15.60:0/1423144562 learned_addr learned my addr 172.21.15.60:0/1423144562 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.035+0000 7f735d482640 1 --2- 172.21.15.60:0/1423144562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d7592c0 0x55fe2d7c2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.035+0000 7f735cc81640 1 --2- 172.21.15.60:0/1423144562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d75aa50 0x55fe2d79bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.036+0000 7f735dc83640 1 -- 172.21.15.60:0/1423144562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d7592c0 msgr2=0x55fe2d7c2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.036+0000 7f735dc83640 1 --2- 172.21.15.60:0/1423144562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d7592c0 0x55fe2d7c2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.036+0000 7f735dc83640 1 -- 172.21.15.60:0/1423144562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d75aa50 msgr2=0x55fe2d79bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.036+0000 7f735dc83640 1 --2- 172.21.15.60:0/1423144562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d75aa50 0x55fe2d79bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.036+0000 7f735dc83640 1 -- 172.21.15.60:0/1423144562 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe2d784810 con 0x55fe2d77c5f0 2024-09-12T01:42:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.036+0000 7f735cc81640 1 --2- 172.21.15.60:0/1423144562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d75aa50 0x55fe2d79bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.036+0000 7f735d482640 1 --2- 172.21.15.60:0/1423144562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d7592c0 0x55fe2d7c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.036+0000 7f735dc83640 1 --2- 172.21.15.60:0/1423144562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d77c5f0 0x55fe2d79c4f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7350004000 tx=0x7f7350011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89686f2fa917cab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.036+0000 7f73427fc640 1 -- 172.21.15.60:0/1423144562 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7350017040 con 0x55fe2d77c5f0 2024-09-12T01:42:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.036+0000 7f73427fc640 1 -- 172.21.15.60:0/1423144562 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7350023070 con 0x55fe2d77c5f0 2024-09-12T01:42:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.036+0000 7f73427fc640 1 -- 172.21.15.60:0/1423144562 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f735000cd60 con 0x55fe2d77c5f0 2024-09-12T01:42:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.037+0000 7f736247d740 1 -- 172.21.15.60:0/1423144562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d77c5f0 msgr2=0x55fe2d79c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.037+0000 7f736247d740 1 --2- 172.21.15.60:0/1423144562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d77c5f0 0x55fe2d79c4f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7350004000 tx=0x7f7350011000 comp rx=0 tx=0).stop 2024-09-12T01:42:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.037+0000 7f736247d740 1 -- 172.21.15.60:0/1423144562 shutdown_connections 2024-09-12T01:42:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.037+0000 7f736247d740 1 --2- 172.21.15.60:0/1423144562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d77c5f0 0x55fe2d79c4f0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.037+0000 7f736247d740 1 --2- 172.21.15.60:0/1423144562 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d75aa50 0x55fe2d79bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.037+0000 7f736247d740 1 --2- 172.21.15.60:0/1423144562 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d7592c0 0x55fe2d7c2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.037+0000 7f736247d740 1 -- 172.21.15.60:0/1423144562 >> 172.21.15.60:0/1423144562 conn(0x55fe2d756a80 msgr2=0x55fe2d77ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.037+0000 7f736247d740 1 -- 172.21.15.60:0/1423144562 shutdown_connections 2024-09-12T01:42:09.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.037+0000 7f736247d740 1 -- 172.21.15.60:0/1423144562 wait complete. 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.037+0000 7f736247d740 1 -- start start 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.037+0000 7f736247d740 1 Processor -- start 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.038+0000 7f736247d740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d7592c0 0x55fe2d8162b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.038+0000 7f736247d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d79bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.038+0000 7f736247d740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d77c5f0 0x55fe2d79c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.038+0000 7f736247d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55fe2d77a850 con 0x55fe2d75aa50 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.038+0000 7f736247d740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55fe2d781a20 con 0x55fe2d77c5f0 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.038+0000 7f736247d740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55fe2d77a3c0 con 0x55fe2d7592c0 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.038+0000 7f736247d740 10 client.0 _ll_register_callbacks cb 0x7f7348011340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.038+0000 7f735cc81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d79bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.038+0000 7f735cc81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d79bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36582/0 (socket says 172.21.15.60:36582) 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.038+0000 7f735cc81640 1 -- 172.21.15.60:0/1549720695 learned_addr learned my addr 172.21.15.60:0/1549720695 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.038+0000 7f735d482640 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d7592c0 0x55fe2d8162b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.038+0000 7f735dc83640 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d77c5f0 0x55fe2d79c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f735cc81640 1 -- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d7592c0 msgr2=0x55fe2d8162b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f735cc81640 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d7592c0 0x55fe2d8162b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f735cc81640 1 -- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d77c5f0 msgr2=0x55fe2d79c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f735cc81640 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d77c5f0 0x55fe2d79c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f735cc81640 1 -- 172.21.15.60:0/1549720695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe2d7a11d0 con 0x55fe2d75aa50 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f735dc83640 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d77c5f0 0x55fe2d79c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f735cc81640 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d79bfb0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7348007fd0 tx=0x7f734800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50950e7c91813ebe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f7337fff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f7337fff640 1 -- 172.21.15.60:0/1549720695 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73480621b0 con 0x55fe2d75aa50 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f7337fff640 1 -- 172.21.15.60:0/1549720695 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f7348058bc0 con 0x55fe2d75aa50 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f736247d740 1 -- 172.21.15.60:0/1549720695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7350023070 con 0x55fe2d75aa50 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f7337fff640 1 -- 172.21.15.60:0/1549720695 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7f734805eb10 con 0x55fe2d75aa50 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f736247d740 10 client.6930 fetch_fsmap learned FSMap version 53 2024-09-12T01:42:09.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f736247d740 1 -- 172.21.15.60:0/1549720695 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) -- 0x55fe2d7acfb0 con 0x55fe2d75aa50 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f7337fff640 1 -- 172.21.15.60:0/1549720695 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7350023070 con 0x55fe2d75aa50 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f7337fff640 1 -- 172.21.15.60:0/1549720695 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 53) ==== 3502+0+0 (secure 0 0 0) 0x7f734805ecb0 con 0x55fe2d75aa50 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f736247d740 10 client.6930 fetch_fsmap finished waiting for FSMap version 53 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f736247d740 10 client.6930 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f736247d740 20 client.6930 populate_metadata read hostname 'smithi060' 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f736247d740 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:6833/829908705,v1:172.21.15.105:6835/829908705] conn(0x55fe2d81cd30 0x55fe2d79d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f736247d740 4 client.6930 mds_command: new command op to 35732 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.039+0000 7f736247d740 1 -- 172.21.15.60:0/1549720695 --> [v2:172.21.15.105:6833/829908705,v1:172.21.15.105:6835/829908705] -- command(tid 0: {"prefix": "status"}) -- 0x55fe2d6c2fa0 con 0x55fe2d81cd30 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f735d482640 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:6833/829908705,v1:172.21.15.105:6835/829908705] conn(0x55fe2d81cd30 0x55fe2d79d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f7337fff640 10 client.6930 ms_handle_connect on v2:172.21.15.105:6833/829908705 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f735d482640 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:6833/829908705,v1:172.21.15.105:6835/829908705] conn(0x55fe2d81cd30 0x55fe2d79d3d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e92cb04b45301ee server_cookie=2c7b278ae0d6401b in_seq=0 out_seq=0 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f7337fff640 1 -- 172.21.15.60:0/1549720695 <== mds.0 v2:172.21.15.105:6833/829908705 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55fe2d6c2fa0 con 0x55fe2d81cd30 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f7337fff640 10 client.6930 handle_command_reply: tid=0 2024-09-12T01:42:09.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f736247d740 1 client.6930 shutdown 2024-09-12T01:42:09.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f736247d740 1 -- 172.21.15.60:0/1549720695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 msgr2=0x55fe2d79bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f736247d740 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d79bfb0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f7348007fd0 tx=0x7f734800bf90 comp rx=0 tx=0).stop 2024-09-12T01:42:09.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f736247d740 1 -- 172.21.15.60:0/1549720695 shutdown_connections 2024-09-12T01:42:09.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f736247d740 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:6833/829908705,v1:172.21.15.105:6835/829908705] conn(0x55fe2d81cd30 0x55fe2d79d3d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f736247d740 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55fe2d77c5f0 0x55fe2d79c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f736247d740 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55fe2d75aa50 0x55fe2d79bfb0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f7337fff640 0 client.6930 ms_handle_reset on v2:172.21.15.105:6833/829908705 2024-09-12T01:42:09.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f736247d740 1 --2- 172.21.15.60:0/1549720695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55fe2d7592c0 0x55fe2d8162b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f736247d740 1 -- 172.21.15.60:0/1549720695 >> 172.21.15.60:0/1549720695 conn(0x55fe2d756a80 msgr2=0x55fe2d779c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:09.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f736247d740 1 -- 172.21.15.60:0/1549720695 shutdown_connections 2024-09-12T01:42:09.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.040+0000 7f736247d740 1 -- 172.21.15.60:0/1549720695 wait complete. 2024-09-12T01:42:09.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f736247d740 20 client.6930 trim_cache size 0 max 16384 2024-09-12T01:42:09.047 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:42:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "5401bd8a-3492-4b21-b6c0-d6616ff39793", 2024-09-12T01:42:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T01:42:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 35732, 2024-09-12T01:42:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T01:42:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T01:42:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-12T01:42:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 9.0617906660000003, 2024-09-12T01:42:09.047 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 53, 2024-09-12T01:42:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 92, 2024-09-12T01:42:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 92, 2024-09-12T01:42:09.048 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 14.382887111000001 2024-09-12T01:42:09.048 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:42:09.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f735f6e6640 1 -- 172.21.15.60:0/3634478049 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f733c06be30 msgr2=0x7f733c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f735f6e6640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f733c06be30 0x7f733c06e2f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7354034000 tx=0x7f735402e000 comp rx=0 tx=0).stop 2024-09-12T01:42:09.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f735f6e6640 1 -- 172.21.15.60:0/3634478049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73580d2290 msgr2=0x7f735815d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f735f6e6640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73580d2290 0x7f735815d3c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f734800d800 tx=0x7f734800dcc0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f735f6e6640 1 -- 172.21.15.60:0/3634478049 shutdown_connections 2024-09-12T01:42:09.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f735f6e6640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f733c06be30 0x7f733c06e2f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f735f6e6640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f735815e940 0x7f73581f4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f735f6e6640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f73580d2290 0x7f735815d3c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f735f6e6640 1 --2- 172.21.15.60:0/3634478049 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73580ba440 0x7f73580cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f735f6e6640 1 -- 172.21.15.60:0/3634478049 >> 172.21.15.60:0/3634478049 conn(0x7f73580d1140 msgr2=0x7f73581e9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:09.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f735f6e6640 1 -- 172.21.15.60:0/3634478049 shutdown_connections 2024-09-12T01:42:09.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.041+0000 7f735f6e6640 1 -- 172.21.15.60:0/3634478049 wait complete. 2024-09-12T01:42:09.051 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:42:09.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.154+0000 7fb2b999f640 1 Processor -- start 2024-09-12T01:42:09.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.154+0000 7fb2b999f640 1 -- start start 2024-09-12T01:42:09.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.155+0000 7fb2b999f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2b415e380 0x7fb2b40ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.155+0000 7fb2b999f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb2b406bc10 0x7fb2b406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.155+0000 7fb2b999f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b40ae8a0 con 0x7fb2b40b0450 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.155+0000 7fb2b999f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb2b40cd300 con 0x7fb2b406bc10 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.155+0000 7fb2b999f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b40cd5e0 con 0x7fb2b415e380 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.155+0000 7fb2b3fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb2b40b0450 0x7fb2b40af060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53008/0 (socket says 172.21.15.60:53008) 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.155+0000 7fb2b3fff640 1 -- 172.21.15.60:0/260462633 learned_addr learned my addr 172.21.15.60:0/260462633 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.156+0000 7fb2b919e640 1 --2- 172.21.15.60:0/260462633 >> v2:172.21.15.105:3300/0 conn(0x7fb2b406bc10 0x7fb2b406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.156+0000 7fb2b899d640 1 --2- 172.21.15.60:0/260462633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2b415e380 0x7fb2b40ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.156+0000 7fb2b37fe640 1 -- 172.21.15.60:0/260462633 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469192598 0 0) 0x7fb2b40ae8a0 con 0x7fb2b40b0450 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.156+0000 7fb2b37fe640 1 -- 172.21.15.60:0/260462633 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a0003520 con 0x7fb2b40b0450 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.156+0000 7fb2b37fe640 1 -- 172.21.15.60:0/260462633 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1634369371 0 0) 0x7fb2a0003520 con 0x7fb2b40b0450 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.156+0000 7fb2b919e640 1 -- 172.21.15.60:0/260462633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2b415e380 msgr2=0x7fb2b40ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.156+0000 7fb2b919e640 1 --2- 172.21.15.60:0/260462633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2b415e380 0x7fb2b40ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.156+0000 7fb2b919e640 1 -- 172.21.15.60:0/260462633 >> v1:172.21.15.60:6789/0 conn(0x7fb2b40b0450 legacy=0x7fb2b40af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.156+0000 7fb2b919e640 1 -- 172.21.15.60:0/260462633 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b40cd8c0 con 0x7fb2b406bc10 2024-09-12T01:42:09.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.157+0000 7fb2b919e640 1 --2- 172.21.15.60:0/260462633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2b406bc10 0x7fb2b406c0a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40097a0 tx=0x7fb2a402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c450448ed24c168c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:09.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.157+0000 7fb2b37fe640 1 -- 172.21.15.60:0/260462633 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4037070 con 0x7fb2b406bc10 2024-09-12T01:42:09.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.157+0000 7fb2b37fe640 1 -- 172.21.15.60:0/260462633 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a402aba0 con 0x7fb2b406bc10 2024-09-12T01:42:09.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.157+0000 7fb2b37fe640 1 -- 172.21.15.60:0/260462633 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c001690 con 0x7fb2b406bc10 2024-09-12T01:42:09.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.157+0000 7fb2b999f640 1 -- 172.21.15.60:0/260462633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2b406bc10 msgr2=0x7fb2b406c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.157+0000 7fb2b999f640 1 --2- 172.21.15.60:0/260462633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2b406bc10 0x7fb2b406c0a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40097a0 tx=0x7fb2a402a110 comp rx=0 tx=0).stop 2024-09-12T01:42:09.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.158+0000 7fb2b999f640 1 -- 172.21.15.60:0/260462633 shutdown_connections 2024-09-12T01:42:09.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.158+0000 7fb2b999f640 1 --2- 172.21.15.60:0/260462633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2b406bc10 0x7fb2b406c0a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.158+0000 7fb2b999f640 1 --2- 172.21.15.60:0/260462633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2b415e380 0x7fb2b40ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.158+0000 7fb2b999f640 1 -- 172.21.15.60:0/260462633 >> 172.21.15.60:0/260462633 conn(0x7fb2b40d1160 msgr2=0x7fb2b40d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:09.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.158+0000 7fb2b999f640 1 -- 172.21.15.60:0/260462633 shutdown_connections 2024-09-12T01:42:09.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.158+0000 7fb2b999f640 1 -- 172.21.15.60:0/260462633 wait complete. 2024-09-12T01:42:09.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.159+0000 7fb2b999f640 1 Processor -- start 2024-09-12T01:42:09.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.159+0000 7fb2b999f640 1 -- start start 2024-09-12T01:42:09.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b999f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2b406bc10 0x7fb2b4160bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b999f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2b40b0450 0x7fb2b4152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b999f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b415e380 0x7fb2b4152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b999f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b40b09f0 con 0x7fb2b415e380 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b999f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b40b0870 con 0x7fb2b406bc10 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b999f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b415e760 con 0x7fb2b40b0450 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b919e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b415e380 0x7fb2b4152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b919e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b415e380 0x7fb2b4152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36584/0 (socket says 172.21.15.60:36584) 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b919e640 1 -- 172.21.15.60:0/1991326787 learned_addr learned my addr 172.21.15.60:0/1991326787 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b899d640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2b406bc10 0x7fb2b4160bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b3fff640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2b40b0450 0x7fb2b4152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b919e640 1 -- 172.21.15.60:0/1991326787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2b40b0450 msgr2=0x7fb2b4152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b919e640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2b40b0450 0x7fb2b4152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b919e640 1 -- 172.21.15.60:0/1991326787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2b406bc10 msgr2=0x7fb2b4160bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b919e640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2b406bc10 0x7fb2b4160bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b919e640 1 -- 172.21.15.60:0/1991326787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b40b6c20 con 0x7fb2b415e380 2024-09-12T01:42:09.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b919e640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b415e380 0x7fb2b4152640 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40097a0 tx=0x7fb2a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:09.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b17fa640 1 -- 172.21.15.60:0/1991326787 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4037050 con 0x7fb2b415e380 2024-09-12T01:42:09.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b17fa640 1 -- 172.21.15.60:0/1991326787 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a4038040 con 0x7fb2b415e380 2024-09-12T01:42:09.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b999f640 1 -- 172.21.15.60:0/1991326787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b40b4b30 con 0x7fb2b415e380 2024-09-12T01:42:09.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.160+0000 7fb2b17fa640 1 -- 172.21.15.60:0/1991326787 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4006e10 con 0x7fb2b415e380 2024-09-12T01:42:09.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.161+0000 7fb2b999f640 1 -- 172.21.15.60:0/1991326787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b40b4dd0 con 0x7fb2b415e380 2024-09-12T01:42:09.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.162+0000 7fb2b999f640 1 -- 172.21.15.60:0/1991326787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b40ccc90 con 0x7fb2b415e380 2024-09-12T01:42:09.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.162+0000 7fb2b17fa640 1 -- 172.21.15.60:0/1991326787 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb2a4003610 con 0x7fb2b415e380 2024-09-12T01:42:09.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.162+0000 7fb2b17fa640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb29406be30 0x7fb29406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:09.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.163+0000 7fb2b17fa640 1 -- 172.21.15.60:0/1991326787 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fb2a40ab4f0 con 0x7fb2b415e380 2024-09-12T01:42:09.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.163+0000 7fb2b899d640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb29406be30 0x7fb29406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:09.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.163+0000 7fb2b899d640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb29406be30 0x7fb29406e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac007380 tx=0x7fb2ac00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:09.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.167+0000 7fb2b17fa640 1 -- 172.21.15.60:0/1991326787 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb2a4079f30 con 0x7fb2b415e380 2024-09-12T01:42:09.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.377+0000 7fb2b999f640 1 -- 172.21.15.60:0/1991326787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb2b40afb50 con 0x7fb2b415e380 2024-09-12T01:42:09.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.377+0000 7fb2b17fa640 1 -- 172.21.15.60:0/1991326787 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) ==== 53+0+73 (secure 0 0 0) 0x7fb2a4079830 con 0x7fb2b415e380 2024-09-12T01:42:09.377 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:42:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.379+0000 7fb2b999f640 1 -- 172.21.15.60:0/1991326787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb29406be30 msgr2=0x7fb29406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.379+0000 7fb2b999f640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb29406be30 0x7fb29406e2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac007380 tx=0x7fb2ac00b040 comp rx=0 tx=0).stop 2024-09-12T01:42:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.379+0000 7fb2b999f640 1 -- 172.21.15.60:0/1991326787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b415e380 msgr2=0x7fb2b4152640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.379+0000 7fb2b999f640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b415e380 0x7fb2b4152640 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40097a0 tx=0x7fb2a40046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.379+0000 7fb2b999f640 1 -- 172.21.15.60:0/1991326787 shutdown_connections 2024-09-12T01:42:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.379+0000 7fb2b999f640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2b415e380 0x7fb2b4152640 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.379+0000 7fb2b999f640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb29406be30 0x7fb29406e2f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.379+0000 7fb2b999f640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb2b40b0450 0x7fb2b4152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.379+0000 7fb2b999f640 1 --2- 172.21.15.60:0/1991326787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb2b406bc10 0x7fb2b4160bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:09.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.379+0000 7fb2b999f640 1 -- 172.21.15.60:0/1991326787 >> 172.21.15.60:0/1991326787 conn(0x7fb2b40d1160 msgr2=0x7fb2b4073310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.379+0000 7fb2b999f640 1 -- 172.21.15.60:0/1991326787 shutdown_connections 2024-09-12T01:42:09.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09.379+0000 7fb2b999f640 1 -- 172.21.15.60:0/1991326787 wait complete. 2024-09-12T01:42:09.389 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:42:09.390 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:42:09.390 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T01:42:09.390 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:42:09.390 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:42:09.390 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:42:09.390 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:42:09.390 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:42:09.390 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:42:09.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:09.390 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T01:42:09.407 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:42:09.407 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:42:09.407 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:42:09.407 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:09.407 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:42:09.407 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:09.407 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:42:09.407 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:09.407 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T01:42:09.407 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:42:09.407 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:09.407 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T01:42:09.408 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:42:09.408 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:09.408 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T01:42:09.408 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:42:09.408 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42391sec preferred_lft 42391sec 2024-09-12T01:42:09.408 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T01:42:09.408 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:09.408 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:42:09.408 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:09.408 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T01:42:09.409 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:42:09.409 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:09.409 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:42:09.409 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:09.409 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e8cb:28ff:fea3:34fb/64 scope link 2024-09-12T01:42:09.409 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:09.409 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:42:09.409 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 72:47:53:4d:4f:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:42:09.409 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7047:53ff:fe4d:4fc7/64 scope link 2024-09-12T01:42:09.409 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:09.409 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:42:09.410 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:42:09.410 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::183c:47ff:fec1:173/64 scope link 2024-09-12T01:42:09.410 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:09.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:09.410 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:42:09.471 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T01:42:09.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:09.473 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T01:42:09.529 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T01:42:09.530 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:42:09.530 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:42:09.530 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:42:09.530 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:42:09.530 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:42:09.530 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:42:09.530 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:42:09.531 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:42:09.531 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:42:09.531 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:42:09.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:42:09.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:42:09.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:09.660 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:42:09.677 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:42:09.677 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:42:09.678 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:42:09.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:09.678 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-12T01:42:09.743 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:42:09.743 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:42:09.800 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:42:09.800 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:42:09.800 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:42:09.855 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T01:42:09.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:09.856 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:42:09.940 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:42:09.940 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:42:09.949 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:42:09.949 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:42:09.949 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:42:09.950 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:42:09.950 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:42:09.950 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:42:09.950 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:42:09.950 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:42:09.950 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:42:09.950 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:42:09.953 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:42:09.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:09.953 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:42:09.980 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:42:10.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:42:10.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:42:10.084 INFO:teuthology.orchestra.run.smithi060.stdout:client35810 2024-09-12T01:42:10.084 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:42:10.084 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:10.103 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:42:10.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.246+0000 7f28a9152640 1 Processor -- start 2024-09-12T01:42:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.246+0000 7f28a9152640 1 -- start start 2024-09-12T01:42:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a9152640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f28a415e860 0x7f28a40d2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a9152640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40b6870 0x7f28a40b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a9152640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a40d34c0 con 0x7f28a40d2ff0 2024-09-12T01:42:10.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a9152640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f28a40d40d0 con 0x7f28a415e860 2024-09-12T01:42:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a9152640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f28a40d37a0 con 0x7f28a40b6870 2024-09-12T01:42:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a259c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f28a40d2ff0 0x7f28a40b6160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53014/0 (socket says 172.21.15.60:53014) 2024-09-12T01:42:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a259c640 1 -- 172.21.15.60:0/3342273304 learned_addr learned my addr 172.21.15.60:0/3342273304 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a2d9d640 1 --2- 172.21.15.60:0/3342273304 >> v2:172.21.15.105:3300/0 conn(0x7f28a415e860 0x7f28a40d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a359e640 1 --2- 172.21.15.60:0/3342273304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40b6870 0x7f28a40b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:10.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a1d9b640 1 -- 172.21.15.60:0/3342273304 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297959332 0 0) 0x7f28a40d34c0 con 0x7f28a40d2ff0 2024-09-12T01:42:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a1d9b640 1 -- 172.21.15.60:0/3342273304 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f288c003520 con 0x7f28a40d2ff0 2024-09-12T01:42:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a2d9d640 1 -- 172.21.15.60:0/3342273304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40b6870 msgr2=0x7f28a40b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a1d9b640 1 -- 172.21.15.60:0/3342273304 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 187904159 0 0) 0x7f288c003520 con 0x7f28a40d2ff0 2024-09-12T01:42:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a2d9d640 1 --2- 172.21.15.60:0/3342273304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40b6870 0x7f28a40b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.247+0000 7f28a2d9d640 1 -- 172.21.15.60:0/3342273304 >> v1:172.21.15.60:6789/0 conn(0x7f28a40d2ff0 legacy=0x7f28a40b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:10.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.248+0000 7f28a2d9d640 1 -- 172.21.15.60:0/3342273304 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a40d3a80 con 0x7f28a415e860 2024-09-12T01:42:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.248+0000 7f28a359e640 1 --2- 172.21.15.60:0/3342273304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40b6870 0x7f28a40b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.248+0000 7f28a2d9d640 1 --2- 172.21.15.60:0/3342273304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a415e860 0x7f28a40d2ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f28940097a0 tx=0x7f289402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79b4800b0bb46943 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.248+0000 7f28a1d9b640 1 -- 172.21.15.60:0/3342273304 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2894037070 con 0x7f28a415e860 2024-09-12T01:42:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.248+0000 7f28a1d9b640 1 -- 172.21.15.60:0/3342273304 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289402aba0 con 0x7f28a415e860 2024-09-12T01:42:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.248+0000 7f28a1d9b640 1 -- 172.21.15.60:0/3342273304 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2898001670 con 0x7f28a415e860 2024-09-12T01:42:10.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.249+0000 7f28a9152640 1 -- 172.21.15.60:0/3342273304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a415e860 msgr2=0x7f28a40d2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:10.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.249+0000 7f28a9152640 1 --2- 172.21.15.60:0/3342273304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a415e860 0x7f28a40d2ab0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f28940097a0 tx=0x7f289402a110 comp rx=0 tx=0).stop 2024-09-12T01:42:10.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.249+0000 7f28a9152640 1 -- 172.21.15.60:0/3342273304 shutdown_connections 2024-09-12T01:42:10.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.249+0000 7f28a9152640 1 --2- 172.21.15.60:0/3342273304 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40b6870 0x7f28a40b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:10.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.249+0000 7f28a9152640 1 --2- 172.21.15.60:0/3342273304 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a415e860 0x7f28a40d2ab0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:10.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.249+0000 7f28a9152640 1 -- 172.21.15.60:0/3342273304 >> 172.21.15.60:0/3342273304 conn(0x7f28a4062c60 msgr2=0x7f28a40d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:10.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.249+0000 7f28a9152640 1 -- 172.21.15.60:0/3342273304 shutdown_connections 2024-09-12T01:42:10.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.249+0000 7f28a9152640 1 -- 172.21.15.60:0/3342273304 wait complete. 2024-09-12T01:42:10.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.251+0000 7f28a9152640 1 Processor -- start 2024-09-12T01:42:10.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.251+0000 7f28a9152640 1 -- start start 2024-09-12T01:42:10.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.251+0000 7f28a9152640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a40b6870 0x7f28a414a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:10.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.251+0000 7f28a9152640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40d2ff0 0x7f28a41582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:10.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.251+0000 7f28a9152640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a415e860 0x7f28a41587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:10.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.251+0000 7f28a9152640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40b3a10 con 0x7f28a415e860 2024-09-12T01:42:10.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.251+0000 7f28a9152640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40b3890 con 0x7f28a40b6870 2024-09-12T01:42:10.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.251+0000 7f28a9152640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f28a40b7dc0 con 0x7f28a40d2ff0 2024-09-12T01:42:10.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a415e860 0x7f28a41587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:10.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a415e860 0x7f28a41587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36598/0 (socket says 172.21.15.60:36598) 2024-09-12T01:42:10.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a359e640 1 -- 172.21.15.60:0/1851380374 learned_addr learned my addr 172.21.15.60:0/1851380374 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:10.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a2d9d640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a40b6870 0x7f28a414a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:10.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a259c640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40d2ff0 0x7f28a41582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:10.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a359e640 1 -- 172.21.15.60:0/1851380374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40d2ff0 msgr2=0x7f28a41582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:10.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a359e640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40d2ff0 0x7f28a41582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:10.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a359e640 1 -- 172.21.15.60:0/1851380374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a40b6870 msgr2=0x7f28a414a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:10.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a359e640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a40b6870 0x7f28a414a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:10.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a359e640 1 -- 172.21.15.60:0/1851380374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a4161200 con 0x7f28a415e860 2024-09-12T01:42:10.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a359e640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a415e860 0x7f28a41587f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f289c00efc0 tx=0x7f289c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:10.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f288b7fe640 1 -- 172.21.15.60:0/1851380374 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c018020 con 0x7f28a415e860 2024-09-12T01:42:10.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f288b7fe640 1 -- 172.21.15.60:0/1851380374 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c014480 con 0x7f28a415e860 2024-09-12T01:42:10.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a9152640 1 -- 172.21.15.60:0/1851380374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a41614e0 con 0x7f28a415e860 2024-09-12T01:42:10.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f288b7fe640 1 -- 172.21.15.60:0/1851380374 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c014850 con 0x7f28a415e860 2024-09-12T01:42:10.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.252+0000 7f28a9152640 1 -- 172.21.15.60:0/1851380374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a4161aa0 con 0x7f28a415e860 2024-09-12T01:42:10.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.254+0000 7f28a9152640 1 -- 172.21.15.60:0/1851380374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a40b7880 con 0x7f28a415e860 2024-09-12T01:42:10.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.254+0000 7f288b7fe640 1 -- 172.21.15.60:0/1851380374 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f289c005d10 con 0x7f28a415e860 2024-09-12T01:42:10.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.255+0000 7f288b7fe640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f289006be30 0x7f289006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:10.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.255+0000 7f288b7fe640 1 -- 172.21.15.60:0/1851380374 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f289c08bb20 con 0x7f28a415e860 2024-09-12T01:42:10.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.255+0000 7f28a2d9d640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f289006be30 0x7f289006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:10.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.255+0000 7f28a2d9d640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f289006be30 0x7f289006e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2894034000 tx=0x7f289402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:10.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.259+0000 7f288b7fe640 1 -- 172.21.15.60:0/1851380374 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f289c022030 con 0x7f28a415e860 2024-09-12T01:42:10.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.469+0000 7f28a9152640 1 -- 172.21.15.60:0/1851380374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f28a40b8660 con 0x7f28a415e860 2024-09-12T01:42:10.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.470+0000 7f288b7fe640 1 -- 172.21.15.60:0/1851380374 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) ==== 53+0+73 (secure 0 0 0) 0x7f289c010040 con 0x7f28a415e860 2024-09-12T01:42:10.470 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:42:10.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.472+0000 7f28a9152640 1 -- 172.21.15.60:0/1851380374 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f289006be30 msgr2=0x7f289006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:10.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.472+0000 7f28a9152640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f289006be30 0x7f289006e2f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2894034000 tx=0x7f289402e000 comp rx=0 tx=0).stop 2024-09-12T01:42:10.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.472+0000 7f28a9152640 1 -- 172.21.15.60:0/1851380374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a415e860 msgr2=0x7f28a41587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:10.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.472+0000 7f28a9152640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a415e860 0x7f28a41587f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f289c00efc0 tx=0x7f289c00c490 comp rx=0 tx=0).stop 2024-09-12T01:42:10.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.472+0000 7f28a9152640 1 -- 172.21.15.60:0/1851380374 shutdown_connections 2024-09-12T01:42:10.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.472+0000 7f28a9152640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a415e860 0x7f28a41587f0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:10.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.472+0000 7f28a9152640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f289006be30 0x7f289006e2f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:10.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.472+0000 7f28a9152640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28a40d2ff0 0x7f28a41582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:10.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.472+0000 7f28a9152640 1 --2- 172.21.15.60:0/1851380374 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f28a40b6870 0x7f28a414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:10.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.472+0000 7f28a9152640 1 -- 172.21.15.60:0/1851380374 >> 172.21.15.60:0/1851380374 conn(0x7f28a4062c60 msgr2=0x7f28a40ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:10.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.472+0000 7f28a9152640 1 -- 172.21.15.60:0/1851380374 shutdown_connections 2024-09-12T01:42:10.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:10.472+0000 7f28a9152640 1 -- 172.21.15.60:0/1851380374 wait complete. 2024-09-12T01:42:10.482 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:42:10.482 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:42:10.482 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T01:42:10.482 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:42:10.483 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:42:10.483 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:42:10.483 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:42:10.483 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:42:10.483 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:42:10.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:10.484 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T01:42:10.504 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:42:10.505 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:42:10.505 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:42:10.505 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:10.505 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:42:10.505 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:10.505 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:42:10.505 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:10.505 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T01:42:10.505 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:42:10.505 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:10.506 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T01:42:10.506 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:42:10.506 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:10.506 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:42:10.506 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:10.506 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:42:10.506 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42392sec preferred_lft 42392sec 2024-09-12T01:42:10.506 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T01:42:10.506 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:10.506 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:42:10.506 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:10.506 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:42:10.507 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:10.507 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::c46c:baff:feeb:1f5e/64 scope link 2024-09-12T01:42:10.507 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:10.507 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:42:10.507 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 56:66:28:3d:b2:45 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:42:10.507 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::5466:28ff:fe3d:b245/64 scope link 2024-09-12T01:42:10.507 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:10.507 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:42:10.507 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:42:10.507 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::2036:4aff:fe87:b9cb/64 scope link 2024-09-12T01:42:10.507 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:10.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:10.508 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:42:10.573 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:42:10.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:10.575 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T01:42:10.634 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T01:42:10.634 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:42:10.634 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:42:10.634 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:42:10.634 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:42:10.635 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:42:10.635 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:42:10.635 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:42:10.635 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:42:10.635 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:42:10.635 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:42:10.728 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:42:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:42:10.761 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:42:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:42:10.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:10.769 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:42:10.785 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T01:42:10.785 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:42:10.786 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:42:10.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:10.786 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-12T01:42:10.851 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:42:10.851 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:42:10.906 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:42:10.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:42:10.907 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:42:10.962 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T01:42:10.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:10.962 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:42:11.047 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:42:11.047 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:42:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:42:11.054 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:42:11.055 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:42:11.055 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 1@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:42:11.055 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:42:11.055 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:42:11.055 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:42:11.056 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:42:11.056 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:42:11.056 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:42:11.057 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:42:11.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:11.057 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:42:11.081 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:42:11.169 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:42:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:42:11.171 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:42:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:42:11.177 INFO:teuthology.orchestra.run.smithi105.stdout:client35819 2024-09-12T01:42:11.177 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:42:11.177 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:11.193 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:42:11.193 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:42:11.240 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:42:11.292 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:42:11.292 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:42:11.292 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:42:11.293 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:11.312 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:42:11.312 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:11.371 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:42:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.526+0000 7f4c030e4640 1 Processor -- start 2024-09-12T01:42:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.526+0000 7f4c030e4640 1 -- start start 2024-09-12T01:42:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.527+0000 7f4c030e4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4bfc15e7a0 0x7f4bfc06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:11.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.527+0000 7f4c030e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4bfc0b68f0 0x7f4bfc0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.527+0000 7f4c030e4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bfc0cf860 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.527+0000 7f4c030e4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4bfc0d2ca0 con 0x7f4bfc0b68f0 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.527+0000 7f4c030e4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4bfc0cfb40 con 0x7f4bfc15e7a0 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.527+0000 7f4c01681640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4bfc0b68f0 0x7f4bfc0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.528+0000 7f4c01681640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4bfc0b68f0 0x7f4bfc0d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36608/0 (socket says 172.21.15.60:36608) 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.528+0000 7f4bfbfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4bfc0cf1f0 0x7f4bfc0b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53016/0 (socket says 172.21.15.60:53016) 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.528+0000 7f4c01681640 1 -- 172.21.15.60:0/1267974008 learned_addr learned my addr 172.21.15.60:0/1267974008 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.528+0000 7f4c00e80640 1 --2- 172.21.15.60:0/1267974008 >> v2:172.21.15.105:3300/0 conn(0x7f4bfc15e7a0 0x7f4bfc06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.528+0000 7f4c01681640 1 -- 172.21.15.60:0/1267974008 >> v2:172.21.15.105:3300/0 conn(0x7f4bfc15e7a0 msgr2=0x7f4bfc06caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.528+0000 7f4c01681640 1 --2- 172.21.15.60:0/1267974008 >> v2:172.21.15.105:3300/0 conn(0x7f4bfc15e7a0 0x7f4bfc06caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.528+0000 7f4c01681640 1 -- 172.21.15.60:0/1267974008 >> v1:172.21.15.60:6789/0 conn(0x7f4bfc0cf1f0 legacy=0x7f4bfc0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.528+0000 7f4c01681640 1 -- 172.21.15.60:0/1267974008 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc0cfe20 con 0x7f4bfc0b68f0 2024-09-12T01:42:11.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.528+0000 7f4bfb7fe640 1 -- 172.21.15.60:0/1267974008 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3522552130 0 0) 0x7f4bfc0cf860 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.529+0000 7f4c01681640 1 --2- 172.21.15.60:0/1267974008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bfc0b68f0 0x7f4bfc0d3410 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0d5820 tx=0x7f4bf402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8b1339750dd154 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:11.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.529+0000 7f4bfb7fe640 1 -- 172.21.15.60:0/1267974008 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4036070 con 0x7f4bfc0b68f0 2024-09-12T01:42:11.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.529+0000 7f4bfb7fe640 1 -- 172.21.15.60:0/1267974008 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf4031600 con 0x7f4bfc0b68f0 2024-09-12T01:42:11.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.529+0000 7f4bfb7fe640 1 -- 172.21.15.60:0/1267974008 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40319d0 con 0x7f4bfc0b68f0 2024-09-12T01:42:11.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.529+0000 7f4c030e4640 1 -- 172.21.15.60:0/1267974008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bfc0b68f0 msgr2=0x7f4bfc0d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:11.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.529+0000 7f4c030e4640 1 --2- 172.21.15.60:0/1267974008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bfc0b68f0 0x7f4bfc0d3410 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0d5820 tx=0x7f4bf402a6a0 comp rx=0 tx=0).stop 2024-09-12T01:42:11.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.529+0000 7f4c030e4640 1 -- 172.21.15.60:0/1267974008 shutdown_connections 2024-09-12T01:42:11.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.529+0000 7f4c030e4640 1 --2- 172.21.15.60:0/1267974008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bfc0b68f0 0x7f4bfc0d3410 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.529+0000 7f4c030e4640 1 --2- 172.21.15.60:0/1267974008 >> v2:172.21.15.105:3300/0 conn(0x7f4bfc15e7a0 0x7f4bfc06caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.529+0000 7f4c030e4640 1 -- 172.21.15.60:0/1267974008 >> 172.21.15.60:0/1267974008 conn(0x7f4bfc0d11e0 msgr2=0x7f4bfc0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.529+0000 7f4c030e4640 1 -- 172.21.15.60:0/1267974008 shutdown_connections 2024-09-12T01:42:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.529+0000 7f4c030e4640 1 -- 172.21.15.60:0/1267974008 wait complete. 2024-09-12T01:42:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.531+0000 7f4c030e4640 1 Processor -- start 2024-09-12T01:42:11.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.531+0000 7f4c030e4640 1 -- start start 2024-09-12T01:42:11.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4c030e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc0b68f0 0x7f4bfc161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:11.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4c030e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bfc0cf1f0 0x7f4bfc160260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:11.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4c030e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e7a0 0x7f4bfc0d45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:11.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4c030e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc06cfe0 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4c030e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc0b7a00 con 0x7f4bfc0b68f0 2024-09-12T01:42:11.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4c030e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4bfc15eb80 con 0x7f4bfc15e7a0 2024-09-12T01:42:11.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4bfbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bfc0cf1f0 0x7f4bfc160260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4bfbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bfc0cf1f0 0x7f4bfc160260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36610/0 (socket says 172.21.15.60:36610) 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4bfbfff640 1 -- 172.21.15.60:0/3303064143 learned_addr learned my addr 172.21.15.60:0/3303064143 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4c00e80640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc0b68f0 0x7f4bfc161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4c01681640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e7a0 0x7f4bfc0d45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4bfbfff640 1 -- 172.21.15.60:0/3303064143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e7a0 msgr2=0x7f4bfc0d45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4bfbfff640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e7a0 0x7f4bfc0d45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4bfbfff640 1 -- 172.21.15.60:0/3303064143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc0b68f0 msgr2=0x7f4bfc161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4bfbfff640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc0b68f0 0x7f4bfc161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4bfbfff640 1 -- 172.21.15.60:0/3303064143 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc0d3520 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4c01681640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e7a0 0x7f4bfc0d45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4c00e80640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc0b68f0 0x7f4bfc161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.532+0000 7f4bfbfff640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bfc0cf1f0 0x7f4bfc160260 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000c500 tx=0x7f4bf000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.533+0000 7f4bf97fa640 1 -- 172.21.15.60:0/3303064143 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0018070 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.533+0000 7f4bf97fa640 1 -- 172.21.15.60:0/3303064143 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf0007580 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.533+0000 7f4c030e4640 1 -- 172.21.15.60:0/3303064143 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc0d3800 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.533+0000 7f4bf97fa640 1 -- 172.21.15.60:0/3303064143 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0004a20 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.533+0000 7f4c030e4640 1 -- 172.21.15.60:0/3303064143 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc0d3dc0 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.534+0000 7f4c030e4640 1 -- 172.21.15.60:0/3303064143 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bfc06caa0 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.534+0000 7f4bf97fa640 1 -- 172.21.15.60:0/3303064143 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4bf001b070 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.535+0000 7f4bf97fa640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4be806be30 0x7f4be806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:11.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.535+0000 7f4c00e80640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4be806be30 0x7f4be806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:11.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.535+0000 7f4bf97fa640 1 -- 172.21.15.60:0/3303064143 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f4bf008a1e0 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.536+0000 7f4c00e80640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4be806be30 0x7f4be806e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009b90 tx=0x7f4bec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:11.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.539+0000 7f4bf97fa640 1 -- 172.21.15.60:0/3303064143 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4bf0058b80 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.725+0000 7f4c030e4640 1 -- 172.21.15.60:0/3303064143 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4bfc0b6490 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.726+0000 7f4bf97fa640 1 -- 172.21.15.60:0/3303064143 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v92) ==== 80+0+0 (secure 0 0 0) 0x7f4bf0058480 con 0x7f4bfc0cf1f0 2024-09-12T01:42:11.725 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:42:11.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.728+0000 7f4c030e4640 1 -- 172.21.15.60:0/3303064143 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4be806be30 msgr2=0x7f4be806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:11.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.728+0000 7f4c030e4640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4be806be30 0x7f4be806e2f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009b90 tx=0x7f4bec008040 comp rx=0 tx=0).stop 2024-09-12T01:42:11.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.728+0000 7f4c030e4640 1 -- 172.21.15.60:0/3303064143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bfc0cf1f0 msgr2=0x7f4bfc160260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:11.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.728+0000 7f4c030e4640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bfc0cf1f0 0x7f4bfc160260 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000c500 tx=0x7f4bf000c9c0 comp rx=0 tx=0).stop 2024-09-12T01:42:11.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.728+0000 7f4c030e4640 1 -- 172.21.15.60:0/3303064143 shutdown_connections 2024-09-12T01:42:11.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.728+0000 7f4c030e4640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4be806be30 0x7f4be806e2f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:11.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.728+0000 7f4c030e4640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4bfc15e7a0 0x7f4bfc0d45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:11.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.728+0000 7f4c030e4640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bfc0cf1f0 0x7f4bfc160260 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:11.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.728+0000 7f4c030e4640 1 --2- 172.21.15.60:0/3303064143 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4bfc0b68f0 0x7f4bfc161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:11.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.728+0000 7f4c030e4640 1 -- 172.21.15.60:0/3303064143 >> 172.21.15.60:0/3303064143 conn(0x7f4bfc0d11e0 msgr2=0x7f4bfc0b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:11.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.728+0000 7f4c030e4640 1 -- 172.21.15.60:0/3303064143 shutdown_connections 2024-09-12T01:42:11.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:11.728+0000 7f4c030e4640 1 -- 172.21.15.60:0/3303064143 wait complete. 2024-09-12T01:42:11.738 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:42:11.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:11.739 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:42:11.767 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:42:11.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:11.767 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:42:11.823 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:42:11.823 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:42:11.823 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:11.841 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:42:11.841 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:11.900 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:42:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.003+0000 7fa53079f640 1 Processor -- start 2024-09-12T01:42:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.003+0000 7fa53079f640 1 -- start start 2024-09-12T01:42:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.004+0000 7fa53079f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa52815e940 0x7fa5280b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.004+0000 7fa53079f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa5280ba440 0x7fa5280b6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.004+0000 7fa53079f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5280d2290 0x7fa5280cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.004+0000 7fa53079f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa5280d3ef0 con 0x7fa5280ba440 2024-09-12T01:42:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.004+0000 7fa53079f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa52815ed20 con 0x7fa52815e940 2024-09-12T01:42:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.004+0000 7fa53079f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa5280d32e0 con 0x7fa5280d2290 2024-09-12T01:42:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.004+0000 7fa52dd3a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa5280ba440 0x7fa5280b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.004+0000 7fa52dd3a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa5280ba440 0x7fa5280b6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36620/0 (socket says 172.21.15.60:36620) 2024-09-12T01:42:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.004+0000 7fa52dd3a640 1 -- 172.21.15.60:0/1526221799 learned_addr learned my addr 172.21.15.60:0/1526221799 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.005+0000 7fa52e53b640 1 --2- 172.21.15.60:0/1526221799 >> v2:172.21.15.105:3300/0 conn(0x7fa52815e940 0x7fa5280b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.005+0000 7fa52ed3c640 1 --2- 172.21.15.60:0/1526221799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5280d2290 0x7fa5280cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.005+0000 7fa52dd3a640 1 -- 172.21.15.60:0/1526221799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5280d2290 msgr2=0x7fa5280cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:12.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.005+0000 7fa52dd3a640 1 --2- 172.21.15.60:0/1526221799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5280d2290 0x7fa5280cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.005+0000 7fa52dd3a640 1 -- 172.21.15.60:0/1526221799 >> v2:172.21.15.105:3300/0 conn(0x7fa52815e940 msgr2=0x7fa5280b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.005+0000 7fa52dd3a640 1 --2- 172.21.15.60:0/1526221799 >> v2:172.21.15.105:3300/0 conn(0x7fa52815e940 0x7fa5280b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.005+0000 7fa52dd3a640 1 -- 172.21.15.60:0/1526221799 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5280d35c0 con 0x7fa5280ba440 2024-09-12T01:42:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.005+0000 7fa52ed3c640 1 --2- 172.21.15.60:0/1526221799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5280d2290 0x7fa5280cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.005+0000 7fa52e53b640 1 --2- 172.21.15.60:0/1526221799 >> v2:172.21.15.105:3300/0 conn(0x7fa52815e940 0x7fa5280b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.005+0000 7fa52dd3a640 1 --2- 172.21.15.60:0/1526221799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280ba440 0x7fa5280b6680 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fa5280cecc0 tx=0x7fa51c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4788ada7a0a616 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:12.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.006+0000 7fa52d539640 1 -- 172.21.15.60:0/1526221799 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c037070 con 0x7fa5280ba440 2024-09-12T01:42:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.006+0000 7fa52d539640 1 -- 172.21.15.60:0/1526221799 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51c032440 con 0x7fa5280ba440 2024-09-12T01:42:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.006+0000 7fa52d539640 1 -- 172.21.15.60:0/1526221799 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c032810 con 0x7fa5280ba440 2024-09-12T01:42:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.006+0000 7fa53079f640 1 -- 172.21.15.60:0/1526221799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280ba440 msgr2=0x7fa5280b6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.006+0000 7fa53079f640 1 --2- 172.21.15.60:0/1526221799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280ba440 0x7fa5280b6680 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fa5280cecc0 tx=0x7fa51c02a140 comp rx=0 tx=0).stop 2024-09-12T01:42:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.006+0000 7fa53079f640 1 -- 172.21.15.60:0/1526221799 shutdown_connections 2024-09-12T01:42:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.006+0000 7fa53079f640 1 --2- 172.21.15.60:0/1526221799 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5280d2290 0x7fa5280cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.006+0000 7fa53079f640 1 --2- 172.21.15.60:0/1526221799 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280ba440 0x7fa5280b6680 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.006+0000 7fa53079f640 1 --2- 172.21.15.60:0/1526221799 >> v2:172.21.15.105:3300/0 conn(0x7fa52815e940 0x7fa5280b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.006+0000 7fa53079f640 1 -- 172.21.15.60:0/1526221799 >> 172.21.15.60:0/1526221799 conn(0x7fa5280d1140 msgr2=0x7fa5280d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.006+0000 7fa53079f640 1 -- 172.21.15.60:0/1526221799 shutdown_connections 2024-09-12T01:42:12.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.006+0000 7fa53079f640 1 -- 172.21.15.60:0/1526221799 wait complete. 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.008+0000 7fa53079f640 1 Processor -- start 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.008+0000 7fa53079f640 1 -- start start 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.008+0000 7fa53079f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5280ba440 0x7fa52815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.008+0000 7fa53079f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280d2290 0x7fa5280ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.008+0000 7fa53079f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa52815e940 0x7fa5281f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.008+0000 7fa53079f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa5280b7510 con 0x7fa5280d2290 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.008+0000 7fa53079f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa5280d3b80 con 0x7fa52815e940 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.008+0000 7fa53079f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa5280cf460 con 0x7fa5280ba440 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa52dd3a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280d2290 0x7fa5280ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa52dd3a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280d2290 0x7fa5280ce080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36636/0 (socket says 172.21.15.60:36636) 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa52dd3a640 1 -- 172.21.15.60:0/3571839975 learned_addr learned my addr 172.21.15.60:0/3571839975 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa52e53b640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5280ba440 0x7fa52815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa52ed3c640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa52815e940 0x7fa5281f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa52dd3a640 1 -- 172.21.15.60:0/3571839975 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5280ba440 msgr2=0x7fa52815ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa52dd3a640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5280ba440 0x7fa52815ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa52dd3a640 1 -- 172.21.15.60:0/3571839975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa52815e940 msgr2=0x7fa5281f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa52dd3a640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa52815e940 0x7fa5281f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa52dd3a640 1 -- 172.21.15.60:0/3571839975 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5280cea10 con 0x7fa5280d2290 2024-09-12T01:42:12.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa52dd3a640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280d2290 0x7fa5280ce080 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa51c02a180 tx=0x7fa51c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:12.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa526ffd640 1 -- 172.21.15.60:0/3571839975 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c041020 con 0x7fa5280d2290 2024-09-12T01:42:12.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa526ffd640 1 -- 172.21.15.60:0/3571839975 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa51c0306c0 con 0x7fa5280d2290 2024-09-12T01:42:12.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa53079f640 1 -- 172.21.15.60:0/3571839975 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa528160220 con 0x7fa5280d2290 2024-09-12T01:42:12.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa526ffd640 1 -- 172.21.15.60:0/3571839975 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51c037040 con 0x7fa5280d2290 2024-09-12T01:42:12.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.009+0000 7fa53079f640 1 -- 172.21.15.60:0/3571839975 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5281607e0 con 0x7fa5280d2290 2024-09-12T01:42:12.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.010+0000 7fa53079f640 1 -- 172.21.15.60:0/3571839975 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5280cef20 con 0x7fa5280d2290 2024-09-12T01:42:12.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.011+0000 7fa526ffd640 1 -- 172.21.15.60:0/3571839975 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa51c044020 con 0x7fa5280d2290 2024-09-12T01:42:12.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.011+0000 7fa526ffd640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa51406be30 0x7fa51406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.012+0000 7fa526ffd640 1 -- 172.21.15.60:0/3571839975 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fa51c0ab4b0 con 0x7fa5280d2290 2024-09-12T01:42:12.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.012+0000 7fa52e53b640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa51406be30 0x7fa51406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.012+0000 7fa52e53b640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa51406be30 0x7fa51406e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa518006fd0 tx=0x7fa518008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:12.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.016+0000 7fa526ffd640 1 -- 172.21.15.60:0/3571839975 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa51c04b030 con 0x7fa5280d2290 2024-09-12T01:42:12.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.204+0000 7fa53079f640 1 -- 172.21.15.60:0/3571839975 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa5280b6340 con 0x7fa5280d2290 2024-09-12T01:42:12.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.205+0000 7fa526ffd640 1 -- 172.21.15.60:0/3571839975 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v92) ==== 80+0+0 (secure 0 0 0) 0x7fa51c0798a0 con 0x7fa5280d2290 2024-09-12T01:42:12.204 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:42:12.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.207+0000 7fa53079f640 1 -- 172.21.15.60:0/3571839975 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa51406be30 msgr2=0x7fa51406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.207+0000 7fa53079f640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa51406be30 0x7fa51406e2f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa518006fd0 tx=0x7fa518008040 comp rx=0 tx=0).stop 2024-09-12T01:42:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.207+0000 7fa53079f640 1 -- 172.21.15.60:0/3571839975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280d2290 msgr2=0x7fa5280ce080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.207+0000 7fa53079f640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280d2290 0x7fa5280ce080 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa51c02a180 tx=0x7fa51c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.207+0000 7fa53079f640 1 -- 172.21.15.60:0/3571839975 shutdown_connections 2024-09-12T01:42:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.207+0000 7fa53079f640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa52815e940 0x7fa5281f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.207+0000 7fa53079f640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5280d2290 0x7fa5280ce080 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.207+0000 7fa53079f640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa51406be30 0x7fa51406e2f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.207+0000 7fa53079f640 1 --2- 172.21.15.60:0/3571839975 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5280ba440 0x7fa52815ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.207+0000 7fa53079f640 1 -- 172.21.15.60:0/3571839975 >> 172.21.15.60:0/3571839975 conn(0x7fa5280d1140 msgr2=0x7fa5280b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.207+0000 7fa53079f640 1 -- 172.21.15.60:0/3571839975 shutdown_connections 2024-09-12T01:42:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.207+0000 7fa53079f640 1 -- 172.21.15.60:0/3571839975 wait complete. 2024-09-12T01:42:12.217 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:42:12.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:12.218 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T01:42:12.250 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:42:12.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:12.251 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:42:12.309 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:42:12.310 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:42:12.310 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:12.326 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:42:12.326 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:42:12.327 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:42:12.327 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:12.367 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:42:12.368 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.470+0000 7f173cc47640 1 Processor -- start 2024-09-12T01:42:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.471+0000 7f173cc47640 1 -- start start 2024-09-12T01:42:12.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.471+0000 7f173cc47640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f173815c470 0x7f17380b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.472+0000 7f173cc47640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17380cfa80 0x7f17380b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.472+0000 7f173cc47640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f173815c850 con 0x7f17380b3c50 2024-09-12T01:42:12.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.472+0000 7f173cc47640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f17380b4160 con 0x7f17380cfa80 2024-09-12T01:42:12.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.472+0000 7f173cc47640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f17380b4440 con 0x7f173815c470 2024-09-12T01:42:12.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.472+0000 7f1736d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17380cfa80 0x7f17380b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.472+0000 7f1736d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17380cfa80 0x7f17380b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36642/0 (socket says 172.21.15.60:36642) 2024-09-12T01:42:12.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.472+0000 7f1736d9d640 1 -- 172.21.15.60:0/3456954984 learned_addr learned my addr 172.21.15.60:0/3456954984 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.472+0000 7f173659c640 1 --2- 172.21.15.60:0/3456954984 >> v2:172.21.15.105:3300/0 conn(0x7f173815c470 0x7f17380b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.472+0000 7f1736d9d640 1 -- 172.21.15.60:0/3456954984 >> v2:172.21.15.105:3300/0 conn(0x7f173815c470 msgr2=0x7f17380b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.472+0000 7f1736d9d640 1 --2- 172.21.15.60:0/3456954984 >> v2:172.21.15.105:3300/0 conn(0x7f173815c470 0x7f17380b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.472+0000 7f1736d9d640 1 -- 172.21.15.60:0/3456954984 >> v1:172.21.15.105:6789/0 conn(0x7f17380b3c50 legacy=0x7f17380cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.472+0000 7f1736d9d640 1 -- 172.21.15.60:0/3456954984 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17380b4720 con 0x7f17380cfa80 2024-09-12T01:42:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.473+0000 7f1736d9d640 1 --2- 172.21.15.60:0/3456954984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17380cfa80 0x7f17380b52b0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1728009e50 tx=0x7f172802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a56a7cbb50821b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.473+0000 7f173559a640 1 -- 172.21.15.60:0/3456954984 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1728036070 con 0x7f17380cfa80 2024-09-12T01:42:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.473+0000 7f173559a640 1 -- 172.21.15.60:0/3456954984 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1728031600 con 0x7f17380cfa80 2024-09-12T01:42:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.473+0000 7f173559a640 1 -- 172.21.15.60:0/3456954984 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17280319d0 con 0x7f17380cfa80 2024-09-12T01:42:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.473+0000 7f173cc47640 1 -- 172.21.15.60:0/3456954984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17380cfa80 msgr2=0x7f17380b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.473+0000 7f173cc47640 1 --2- 172.21.15.60:0/3456954984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17380cfa80 0x7f17380b52b0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f1728009e50 tx=0x7f172802a760 comp rx=0 tx=0).stop 2024-09-12T01:42:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.474+0000 7f173cc47640 1 -- 172.21.15.60:0/3456954984 shutdown_connections 2024-09-12T01:42:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.474+0000 7f173cc47640 1 --2- 172.21.15.60:0/3456954984 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17380cfa80 0x7f17380b52b0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.474+0000 7f173cc47640 1 --2- 172.21.15.60:0/3456954984 >> v2:172.21.15.105:3300/0 conn(0x7f173815c470 0x7f17380b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.474+0000 7f173cc47640 1 -- 172.21.15.60:0/3456954984 >> 172.21.15.60:0/3456954984 conn(0x7f173806bc10 msgr2=0x7f173806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.474+0000 7f173cc47640 1 -- 172.21.15.60:0/3456954984 shutdown_connections 2024-09-12T01:42:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.474+0000 7f173cc47640 1 -- 172.21.15.60:0/3456954984 wait complete. 2024-09-12T01:42:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.475+0000 7f173cc47640 1 Processor -- start 2024-09-12T01:42:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.475+0000 7f173cc47640 1 -- start start 2024-09-12T01:42:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173cc47640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17380b3c50 0x7f1738147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173cc47640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17380cfa80 0x7f17381534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173cc47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f173815c470 0x7f1738155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173cc47640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f173806e1b0 con 0x7f17380b3c50 2024-09-12T01:42:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173cc47640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f17380b4d90 con 0x7f17380cfa80 2024-09-12T01:42:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173cc47640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f17380b57f0 con 0x7f173815c470 2024-09-12T01:42:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17380b3c50 0x7f1738147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17380b3c50 0x7f1738147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:36656/0 (socket says 172.21.15.60:36656) 2024-09-12T01:42:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173659c640 1 -- 172.21.15.60:0/2073210787 learned_addr learned my addr 172.21.15.60:0/2073210787 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f1736d9d640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f173815c470 0x7f1738155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f1735d9b640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17380cfa80 0x7f17381534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173659c640 1 -- 172.21.15.60:0/2073210787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f173815c470 msgr2=0x7f1738155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173659c640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f173815c470 0x7f1738155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173659c640 1 -- 172.21.15.60:0/2073210787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17380cfa80 msgr2=0x7f17381534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173659c640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17380cfa80 0x7f17381534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173659c640 1 -- 172.21.15.60:0/2073210787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17381f7dc0 con 0x7f17380b3c50 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f173659c640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17380b3c50 0x7f1738147d60 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f173000d5d0 tx=0x7f173000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.476+0000 7f172effd640 1 -- 172.21.15.60:0/2073210787 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300125f0 con 0x7f17380b3c50 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.477+0000 7f172effd640 1 -- 172.21.15.60:0/2073210787 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1730019070 con 0x7f17380b3c50 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.477+0000 7f173cc47640 1 -- 172.21.15.60:0/2073210787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17381f80a0 con 0x7f17380b3c50 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.477+0000 7f172effd640 1 -- 172.21.15.60:0/2073210787 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300129f0 con 0x7f17380b3c50 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.477+0000 7f173cc47640 1 -- 172.21.15.60:0/2073210787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17381f8660 con 0x7f17380b3c50 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.478+0000 7f173cc47640 1 -- 172.21.15.60:0/2073210787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17380b52b0 con 0x7f17380b3c50 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.478+0000 7f172effd640 1 -- 172.21.15.60:0/2073210787 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1730012b90 con 0x7f17380b3c50 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.478+0000 7f172effd640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f171806be30 0x7f171806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.479 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.478+0000 7f172effd640 1 -- 172.21.15.60:0/2073210787 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f173008b1b0 con 0x7f17380b3c50 2024-09-12T01:42:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.479+0000 7f1735d9b640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f171806be30 0x7f171806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.479+0000 7f1735d9b640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f171806be30 0x7f171806e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1738158820 tx=0x7f1720009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:12.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.483+0000 7f172effd640 1 -- 172.21.15.60:0/2073210787 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1730059510 con 0x7f17380b3c50 2024-09-12T01:42:12.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.692+0000 7f173cc47640 1 -- 172.21.15.60:0/2073210787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1738071e60 con 0x7f17380b3c50 2024-09-12T01:42:12.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.693+0000 7f172effd640 1 -- 172.21.15.60:0/2073210787 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5224 (secure 0 0 0) 0x7f173005d810 con 0x7f17380b3c50 2024-09-12T01:42:12.692 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:12.693 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"btime":"2024-09-12T01:42:01:993818+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1757090077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1757090077},{"type":"v1","addr":"172.21.15.105:6834","nonce":1757090077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/131981610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":131981610},{"type":"v1","addr":"172.21.15.60:6836","nonce":131981610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6762,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/18288436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":18288436},{"type":"v1","addr":"172.21.15.60:6837","nonce":18288436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:41:59.340440+0000","modified":"2024-09-12T01:42:01.335289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35732},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35732":{"gid":35732,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/829908705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":829908705},{"type":"v1","addr":"172.21.15.105:6835","nonce":829908705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35732,"qdb_cluster":[35732]},"id":7}]} 2024-09-12T01:42:12.693 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 53 2024-09-12T01:42:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.695+0000 7f173cc47640 1 -- 172.21.15.60:0/2073210787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f171806be30 msgr2=0x7f171806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.695+0000 7f173cc47640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f171806be30 0x7f171806e2f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1738158820 tx=0x7f1720009040 comp rx=0 tx=0).stop 2024-09-12T01:42:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.695+0000 7f173cc47640 1 -- 172.21.15.60:0/2073210787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17380b3c50 msgr2=0x7f1738147d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.695+0000 7f173cc47640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17380b3c50 0x7f1738147d60 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f173000d5d0 tx=0x7f173000da90 comp rx=0 tx=0).stop 2024-09-12T01:42:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.695+0000 7f173cc47640 1 -- 172.21.15.60:0/2073210787 shutdown_connections 2024-09-12T01:42:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.695+0000 7f173cc47640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f171806be30 0x7f171806e2f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.695+0000 7f173cc47640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f173815c470 0x7f1738155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.695+0000 7f173cc47640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17380cfa80 0x7f17381534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.695+0000 7f173cc47640 1 --2- 172.21.15.60:0/2073210787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17380b3c50 0x7f1738147d60 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.695+0000 7f173cc47640 1 -- 172.21.15.60:0/2073210787 >> 172.21.15.60:0/2073210787 conn(0x7f173806bc10 msgr2=0x7f173815b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.695+0000 7f173cc47640 1 -- 172.21.15.60:0/2073210787 shutdown_connections 2024-09-12T01:42:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.695+0000 7f173cc47640 1 -- 172.21.15.60:0/2073210787 wait complete. 2024-09-12T01:42:12.706 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:12.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.808+0000 7f03bd6e6640 1 Processor -- start 2024-09-12T01:42:12.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.808+0000 7f03bd6e6640 1 -- start start 2024-09-12T01:42:12.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.809+0000 7f03bd6e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b80d3310 0x7f03b80d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.809+0000 7f03bd6e6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b815ea40 con 0x7f03b80d1650 2024-09-12T01:42:12.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.809+0000 7f03bd6e6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03b80d3870 con 0x7f03b815e660 2024-09-12T01:42:12.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.809+0000 7f03bd6e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f03b80d1ac0 con 0x7f03b80d3310 2024-09-12T01:42:12.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.809+0000 7f03b77fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f03b80d1650 0x7f03b80b7b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49720/0 (socket says 172.21.15.60:49720) 2024-09-12T01:42:12.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.809+0000 7f03b77fe640 1 -- 172.21.15.60:0/871039570 learned_addr learned my addr 172.21.15.60:0/871039570 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.809+0000 7f03ae7fc640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b80d3310 0x7f03b80d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178816706 0 0) 0x7f03b815ea40 con 0x7f03b80d1650 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0398003520 con 0x7f03b80d1650 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1778567172 0 0) 0x7f0398003520 con 0x7f03b80d1650 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b80d3310 msgr2=0x7f03b80d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b80d3310 0x7f03b80d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 >> v1:172.21.15.105:6789/0 conn(0x7f03b815e660 legacy=0x7f03b80cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b80d3b50 con 0x7f03b80d1650 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f03b00019f0 con 0x7f03b80d1650 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 >> v1:172.21.15.60:6789/0 conn(0x7f03b80d1650 legacy=0x7f03b80b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03980039e0 0x7f0398003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0398004390 0x7f0398004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b80d3310 0x7f03980050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f03b80d1ac0 con 0x7f03980039e0 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f039800b9f0 con 0x7f0398004390 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f039800bbf0 con 0x7f03b80d3310 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b6ffd640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03980039e0 0x7f0398003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03ae7fc640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0398004390 0x7f0398004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b77fe640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b80d3310 0x7f03980050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b6ffd640 1 -- 172.21.15.60:0/871039570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b80d3310 msgr2=0x7f03980050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b6ffd640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b80d3310 0x7f03980050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b6ffd640 1 -- 172.21.15.60:0/871039570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0398004390 msgr2=0x7f0398004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b6ffd640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0398004390 0x7f0398004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03b6ffd640 1 -- 172.21.15.60:0/871039570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0398003520 con 0x7f03980039e0 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.810+0000 7f03ae7fc640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0398004390 0x7f0398004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.811+0000 7f03b6ffd640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03980039e0 0x7f0398003dc0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f03a8001910 tx=0x7f0398005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ba53024857a8dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.811+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a8037070 con 0x7f03980039e0 2024-09-12T01:42:12.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.811+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a802ac60 con 0x7f03980039e0 2024-09-12T01:42:12.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.811+0000 7f03b67fc640 1 -- 172.21.15.60:0/871039570 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a80014e0 con 0x7f03980039e0 2024-09-12T01:42:12.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.812+0000 7f03bd6e6640 1 -- 172.21.15.60:0/871039570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03980039e0 msgr2=0x7f0398003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.812+0000 7f03bd6e6640 1 --2- 172.21.15.60:0/871039570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03980039e0 0x7f0398003dc0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f03a8001910 tx=0x7f0398005830 comp rx=0 tx=0).stop 2024-09-12T01:42:12.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.812+0000 7f03b77fe640 1 -- 172.21.15.60:0/871039570 reap_dead start 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.812+0000 7f03bd6e6640 1 -- 172.21.15.60:0/871039570 shutdown_connections 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.812+0000 7f03bd6e6640 1 -- 172.21.15.60:0/871039570 >> 172.21.15.60:0/871039570 conn(0x7f03b80b6410 msgr2=0x7f03b80b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.812+0000 7f03bd6e6640 1 -- 172.21.15.60:0/871039570 shutdown_connections 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.812+0000 7f03bd6e6640 1 -- 172.21.15.60:0/871039570 wait complete. 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.813+0000 7f03bd6e6640 1 Processor -- start 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.813+0000 7f03bd6e6640 1 -- start start 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03bd6e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03980039e0 0x7f03b8155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03bd6e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b8155a30 0x7f03b81481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03bd6e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b8148730 0x7f03b8148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03bd6e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f03b80d43f0 con 0x7f03b8155a30 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03bd6e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f03b80d4110 con 0x7f03980039e0 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03bd6e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f03b80d1110 con 0x7f03b8148730 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03ae7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b8155a30 0x7f03b81481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03ae7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b8155a30 0x7f03b81481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53362/0 (socket says 172.21.15.60:53362) 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03ae7fc640 1 -- 172.21.15.60:0/1268472756 learned_addr learned my addr 172.21.15.60:0/1268472756 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03b77fe640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b8148730 0x7f03b8148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03b6ffd640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03980039e0 0x7f03b8155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03ae7fc640 1 -- 172.21.15.60:0/1268472756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b8148730 msgr2=0x7f03b8148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03ae7fc640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b8148730 0x7f03b8148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03ae7fc640 1 -- 172.21.15.60:0/1268472756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03980039e0 msgr2=0x7f03b8155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03ae7fc640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03980039e0 0x7f03b8155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03ae7fc640 1 -- 172.21.15.60:0/1268472756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03b8158940 con 0x7f03b8155a30 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.814+0000 7f03ae7fc640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b8155a30 0x7f03b81481f0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f03a0011730 tx=0x7f03a0011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.815+0000 7f03affff640 1 -- 172.21.15.60:0/1268472756 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a000f9c0 con 0x7f03b8155a30 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.815+0000 7f03affff640 1 -- 172.21.15.60:0/1268472756 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03a000fb60 con 0x7f03b8155a30 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.815+0000 7f03bd6e6640 1 -- 172.21.15.60:0/1268472756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03b8158c20 con 0x7f03b8155a30 2024-09-12T01:42:12.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.815+0000 7f03affff640 1 -- 172.21.15.60:0/1268472756 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03a0015460 con 0x7f03b8155a30 2024-09-12T01:42:12.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.815+0000 7f03bd6e6640 1 -- 172.21.15.60:0/1268472756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03b81531b0 con 0x7f03b8155a30 2024-09-12T01:42:12.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.816+0000 7f03bd6e6640 1 -- 172.21.15.60:0/1268472756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b80cf730 con 0x7f03b8155a30 2024-09-12T01:42:12.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.816+0000 7f03affff640 1 -- 172.21.15.60:0/1268472756 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03a0015600 con 0x7f03b8155a30 2024-09-12T01:42:12.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.817+0000 7f03affff640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f039c06be60 0x7f039c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:12.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.817+0000 7f03affff640 1 -- 172.21.15.60:0/1268472756 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f03a008b570 con 0x7f03b8155a30 2024-09-12T01:42:12.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.817+0000 7f03b6ffd640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f039c06be60 0x7f039c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:12.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.817+0000 7f03b6ffd640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f039c06be60 0x7f039c06e320 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f03a8034000 tx=0x7f03a802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:12.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:12.821+0000 7f03affff640 1 -- 172.21.15.60:0/1268472756 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03a0019030 con 0x7f03b8155a30 2024-09-12T01:42:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.033+0000 7f03bd6e6640 1 -- 172.21.15.60:0/1268472756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03b8159330 con 0x7f03b8155a30 2024-09-12T01:42:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.034+0000 7f03affff640 1 -- 172.21.15.60:0/1268472756 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5224 (secure 0 0 0) 0x7f03a0059960 con 0x7f03b8155a30 2024-09-12T01:42:13.034 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:13.034 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"btime":"2024-09-12T01:42:01:993818+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1757090077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1757090077},{"type":"v1","addr":"172.21.15.105:6834","nonce":1757090077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/131981610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":131981610},{"type":"v1","addr":"172.21.15.60:6836","nonce":131981610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6762,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/18288436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":18288436},{"type":"v1","addr":"172.21.15.60:6837","nonce":18288436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:41:59.340440+0000","modified":"2024-09-12T01:42:01.335289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35732},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35732":{"gid":35732,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/829908705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":829908705},{"type":"v1","addr":"172.21.15.105:6835","nonce":829908705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35732,"qdb_cluster":[35732]},"id":7}]} 2024-09-12T01:42:13.034 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 53 2024-09-12T01:42:13.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.036+0000 7f03bd6e6640 1 -- 172.21.15.60:0/1268472756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f039c06be60 msgr2=0x7f039c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.036+0000 7f03bd6e6640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f039c06be60 0x7f039c06e320 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f03a8034000 tx=0x7f03a802e000 comp rx=0 tx=0).stop 2024-09-12T01:42:13.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.036+0000 7f03bd6e6640 1 -- 172.21.15.60:0/1268472756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b8155a30 msgr2=0x7f03b81481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.036+0000 7f03bd6e6640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b8155a30 0x7f03b81481f0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f03a0011730 tx=0x7f03a0011bf0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.036+0000 7f03bd6e6640 1 -- 172.21.15.60:0/1268472756 shutdown_connections 2024-09-12T01:42:13.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.036+0000 7f03bd6e6640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f039c06be60 0x7f039c06e320 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.036+0000 7f03bd6e6640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03b8148730 0x7f03b8148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.036+0000 7f03bd6e6640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03b8155a30 0x7f03b81481f0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.036+0000 7f03bd6e6640 1 --2- 172.21.15.60:0/1268472756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03980039e0 0x7f03b8155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.036+0000 7f03bd6e6640 1 -- 172.21.15.60:0/1268472756 >> 172.21.15.60:0/1268472756 conn(0x7f03b80b6410 msgr2=0x7f03b815cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:13.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.036+0000 7f03bd6e6640 1 -- 172.21.15.60:0/1268472756 shutdown_connections 2024-09-12T01:42:13.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.036+0000 7f03bd6e6640 1 -- 172.21.15.60:0/1268472756 wait complete. 2024-09-12T01:42:13.047 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:42:13.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.150+0000 7ff3eecd0640 1 Processor -- start 2024-09-12T01:42:13.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.150+0000 7ff3eecd0640 1 -- start start 2024-09-12T01:42:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.150+0000 7ff3eecd0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff3e815e660 0x7ff3e80cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.150+0000 7ff3eecd0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff3e80d3310 0x7ff3e80d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.151+0000 7ff3eecd0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3e815ea40 con 0x7ff3e80d1650 2024-09-12T01:42:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.151+0000 7ff3eecd0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e80d1ac0 con 0x7ff3e80d3310 2024-09-12T01:42:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.151+0000 7ff3eecd0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff3e80d3870 con 0x7ff3e815e660 2024-09-12T01:42:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.151+0000 7ff3e7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff3e80d3310 0x7ff3e80d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.151+0000 7ff3e7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff3e80d3310 0x7ff3e80d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53364/0 (socket says 172.21.15.60:53364) 2024-09-12T01:42:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.151+0000 7ff3e7fff640 1 -- 172.21.15.60:0/2945542515 learned_addr learned my addr 172.21.15.60:0/2945542515 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.151+0000 7ff3eca6c640 1 --2- 172.21.15.60:0/2945542515 >> v2:172.21.15.105:3300/0 conn(0x7ff3e815e660 0x7ff3e80cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.151+0000 7ff3e7fff640 1 -- 172.21.15.60:0/2945542515 >> v2:172.21.15.105:3300/0 conn(0x7ff3e815e660 msgr2=0x7ff3e80cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:13.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.151+0000 7ff3e7fff640 1 --2- 172.21.15.60:0/2945542515 >> v2:172.21.15.105:3300/0 conn(0x7ff3e815e660 0x7ff3e80cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.151+0000 7ff3e7fff640 1 -- 172.21.15.60:0/2945542515 >> v1:172.21.15.105:6789/0 conn(0x7ff3e80d1650 legacy=0x7ff3e806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:13.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.151+0000 7ff3e7fff640 1 -- 172.21.15.60:0/2945542515 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e80d3b50 con 0x7ff3e80d3310 2024-09-12T01:42:13.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.151+0000 7ff3eca6c640 1 --2- 172.21.15.60:0/2945542515 >> v2:172.21.15.105:3300/0 conn(0x7ff3e815e660 0x7ff3e80cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:13.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.152+0000 7ff3e7fff640 1 --2- 172.21.15.60:0/2945542515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e80d3310 0x7ff3e80d1110 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80d10e0 tx=0x7ff3d402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8f3a88965dd63c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:13.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.152+0000 7ff3e77fe640 1 -- 172.21.15.60:0/2945542515 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4037070 con 0x7ff3e80d3310 2024-09-12T01:42:13.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.152+0000 7ff3e77fe640 1 -- 172.21.15.60:0/2945542515 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3d4032440 con 0x7ff3e80d3310 2024-09-12T01:42:13.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.152+0000 7ff3e77fe640 1 -- 172.21.15.60:0/2945542515 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4032810 con 0x7ff3e80d3310 2024-09-12T01:42:13.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.152+0000 7ff3eecd0640 1 -- 172.21.15.60:0/2945542515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e80d3310 msgr2=0x7ff3e80d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.152+0000 7ff3eecd0640 1 --2- 172.21.15.60:0/2945542515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e80d3310 0x7ff3e80d1110 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80d10e0 tx=0x7ff3d402a230 comp rx=0 tx=0).stop 2024-09-12T01:42:13.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.153+0000 7ff3eecd0640 1 -- 172.21.15.60:0/2945542515 shutdown_connections 2024-09-12T01:42:13.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.153+0000 7ff3eecd0640 1 --2- 172.21.15.60:0/2945542515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e80d3310 0x7ff3e80d1110 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.153+0000 7ff3eecd0640 1 --2- 172.21.15.60:0/2945542515 >> v2:172.21.15.105:3300/0 conn(0x7ff3e815e660 0x7ff3e80cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.153+0000 7ff3eecd0640 1 -- 172.21.15.60:0/2945542515 >> 172.21.15.60:0/2945542515 conn(0x7ff3e80b6410 msgr2=0x7ff3e80b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:13.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.153+0000 7ff3eecd0640 1 -- 172.21.15.60:0/2945542515 shutdown_connections 2024-09-12T01:42:13.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.153+0000 7ff3eecd0640 1 -- 172.21.15.60:0/2945542515 wait complete. 2024-09-12T01:42:13.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.154+0000 7ff3eecd0640 1 Processor -- start 2024-09-12T01:42:13.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.154+0000 7ff3eecd0640 1 -- start start 2024-09-12T01:42:13.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3eecd0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80d1650 0x7ff3e80c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3eecd0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e80d3310 0x7ff3e814ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3eecd0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e815e660 0x7ff3e8150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3eecd0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80d43f0 con 0x7ff3e815e660 2024-09-12T01:42:13.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3eecd0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80d4110 con 0x7ff3e80d1650 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3eecd0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e80cfc70 con 0x7ff3e80d3310 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3ed26d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e815e660 0x7ff3e8150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3ed26d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e815e660 0x7ff3e8150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53374/0 (socket says 172.21.15.60:53374) 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3ed26d640 1 -- 172.21.15.60:0/3809818427 learned_addr learned my addr 172.21.15.60:0/3809818427 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3eca6c640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80d1650 0x7ff3e80c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3e7fff640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e80d3310 0x7ff3e814ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3ed26d640 1 -- 172.21.15.60:0/3809818427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e80d3310 msgr2=0x7ff3e814ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3ed26d640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e80d3310 0x7ff3e814ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3ed26d640 1 -- 172.21.15.60:0/3809818427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80d1650 msgr2=0x7ff3e80c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3ed26d640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80d1650 0x7ff3e80c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3ed26d640 1 -- 172.21.15.60:0/3809818427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e80c8f00 con 0x7ff3e815e660 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.155+0000 7ff3ed26d640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e815e660 0x7ff3e8150470 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000b9a0 tx=0x7ff3e000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.156+0000 7ff3e57fa640 1 -- 172.21.15.60:0/3809818427 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0019070 con 0x7ff3e815e660 2024-09-12T01:42:13.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.156+0000 7ff3e57fa640 1 -- 172.21.15.60:0/3809818427 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e000cba0 con 0x7ff3e815e660 2024-09-12T01:42:13.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.156+0000 7ff3eecd0640 1 -- 172.21.15.60:0/3809818427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e80c91e0 con 0x7ff3e815e660 2024-09-12T01:42:13.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.156+0000 7ff3e57fa640 1 -- 172.21.15.60:0/3809818427 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0014440 con 0x7ff3e815e660 2024-09-12T01:42:13.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.156+0000 7ff3eecd0640 1 -- 172.21.15.60:0/3809818427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e8160c70 con 0x7ff3e815e660 2024-09-12T01:42:13.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.157+0000 7ff3eecd0640 1 -- 172.21.15.60:0/3809818427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e80d1110 con 0x7ff3e815e660 2024-09-12T01:42:13.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.157+0000 7ff3e57fa640 1 -- 172.21.15.60:0/3809818427 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff3e001c070 con 0x7ff3e815e660 2024-09-12T01:42:13.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.158+0000 7ff3e57fa640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff3cc06be30 0x7ff3cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.158+0000 7ff3e57fa640 1 -- 172.21.15.60:0/3809818427 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7ff3e008aa40 con 0x7ff3e815e660 2024-09-12T01:42:13.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.158+0000 7ff3eca6c640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff3cc06be30 0x7ff3cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.158+0000 7ff3eca6c640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff3cc06be30 0x7ff3cc06e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00ab60 tx=0x7ff3dc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:13.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.162+0000 7ff3e57fa640 1 -- 172.21.15.60:0/3809818427 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff3e0058d00 con 0x7ff3e815e660 2024-09-12T01:42:13.338 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.338+0000 7ff3eecd0640 1 -- 172.21.15.60:0/3809818427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff3e815a940 con 0x7ff3e815e660 2024-09-12T01:42:13.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.339+0000 7ff3e57fa640 1 -- 172.21.15.60:0/3809818427 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16632 (secure 0 0 0) 0x7ff3e005d000 con 0x7ff3e815e660 2024-09-12T01:42:13.339 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:13.339 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:42:00.988416+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:41:57.005706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-12T01:41:58.327183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:42:13.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.341+0000 7ff3eecd0640 1 -- 172.21.15.60:0/3809818427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff3cc06be30 msgr2=0x7ff3cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.341+0000 7ff3eecd0640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff3cc06be30 0x7ff3cc06e2f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc00ab60 tx=0x7ff3dc008040 comp rx=0 tx=0).stop 2024-09-12T01:42:13.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.341+0000 7ff3eecd0640 1 -- 172.21.15.60:0/3809818427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e815e660 msgr2=0x7ff3e8150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.341 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.341+0000 7ff3eecd0640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e815e660 0x7ff3e8150470 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000b9a0 tx=0x7ff3e000be60 comp rx=0 tx=0).stop 2024-09-12T01:42:13.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.342+0000 7ff3eecd0640 1 -- 172.21.15.60:0/3809818427 shutdown_connections 2024-09-12T01:42:13.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.342+0000 7ff3eecd0640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e815e660 0x7ff3e8150470 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.342+0000 7ff3eecd0640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff3cc06be30 0x7ff3cc06e2f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.342+0000 7ff3eecd0640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff3e80d3310 0x7ff3e814ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.342+0000 7ff3eecd0640 1 --2- 172.21.15.60:0/3809818427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff3e80d1650 0x7ff3e80c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.342+0000 7ff3eecd0640 1 -- 172.21.15.60:0/3809818427 >> 172.21.15.60:0/3809818427 conn(0x7ff3e80b6410 msgr2=0x7ff3e8159930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:13.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.342+0000 7ff3eecd0640 1 -- 172.21.15.60:0/3809818427 shutdown_connections 2024-09-12T01:42:13.342 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.342+0000 7ff3eecd0640 1 -- 172.21.15.60:0/3809818427 wait complete. 2024-09-12T01:42:13.352 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:42:13.353 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.455+0000 7fab3738d640 1 Processor -- start 2024-09-12T01:42:13.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.455+0000 7fab3738d640 1 -- start start 2024-09-12T01:42:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.456+0000 7fab3738d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fab300cfc80 0x7fab300b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.456+0000 7fab3738d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab3015c740 con 0x7fab3015c330 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.456+0000 7fab3738d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab300b50a0 con 0x7fab30155800 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.456+0000 7fab3738d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fab300b5380 con 0x7fab300cfc80 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.456+0000 7fab3592a640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fab3015c330 0x7fab3015c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49722/0 (socket says 172.21.15.60:49722) 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.456+0000 7fab3592a640 1 -- 172.21.15.60:0/2267801953 learned_addr learned my addr 172.21.15.60:0/2267801953 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab34928640 1 --2- 172.21.15.60:0/2267801953 >> v2:172.21.15.105:3300/0 conn(0x7fab300cfc80 0x7fab300b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2681411324 0 0) 0x7fab3015c740 con 0x7fab3015c330 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab18003520 con 0x7fab3015c330 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3598818517 0 0) 0x7fab18003520 con 0x7fab3015c330 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 >> v2:172.21.15.105:3300/0 conn(0x7fab300cfc80 msgr2=0x7fab300b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 --2- 172.21.15.60:0/2267801953 >> v2:172.21.15.105:3300/0 conn(0x7fab300cfc80 0x7fab300b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 >> v1:172.21.15.105:6789/0 conn(0x7fab30155800 legacy=0x7fab300cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab300b5660 con 0x7fab3015c330 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fab28001670 con 0x7fab3015c330 2024-09-12T01:42:13.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 >> v1:172.21.15.60:6789/0 conn(0x7fab3015c330 legacy=0x7fab3015c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 --2- 172.21.15.60:0/2267801953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab180039b0 0x7fab18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 --2- 172.21.15.60:0/2267801953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab18004800 0x7fab18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 --2- 172.21.15.60:0/2267801953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab180051c0 0x7fab1800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fab300b5380 con 0x7fab18004800 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fab1800c060 con 0x7fab180039b0 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fab1800c260 con 0x7fab180051c0 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab34928640 1 --2- 172.21.15.60:0/2267801953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab18004800 0x7fab18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab35129640 1 --2- 172.21.15.60:0/2267801953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab180039b0 0x7fab18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab3592a640 1 --2- 172.21.15.60:0/2267801953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab180051c0 0x7fab1800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab34928640 1 -- 172.21.15.60:0/2267801953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab180051c0 msgr2=0x7fab1800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab34928640 1 --2- 172.21.15.60:0/2267801953 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab180051c0 0x7fab1800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab34928640 1 -- 172.21.15.60:0/2267801953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab180039b0 msgr2=0x7fab18003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:13.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab34928640 1 --2- 172.21.15.60:0/2267801953 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab180039b0 0x7fab18003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab34928640 1 -- 172.21.15.60:0/2267801953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab18003520 con 0x7fab18004800 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.457+0000 7fab3592a640 1 -- 172.21.15.60:0/2267801953 reap_dead start 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.458+0000 7fab34928640 1 --2- 172.21.15.60:0/2267801953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab18004800 0x7fab18004c80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fab24009a90 tx=0x7fab18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11eec2785cc4362 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.458+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24036070 con 0x7fab18004800 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.458+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab24031400 con 0x7fab18004800 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.458+0000 7fab2ffff640 1 -- 172.21.15.60:0/2267801953 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24009690 con 0x7fab18004800 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.459+0000 7fab3738d640 1 -- 172.21.15.60:0/2267801953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab18004800 msgr2=0x7fab18004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.459+0000 7fab3738d640 1 --2- 172.21.15.60:0/2267801953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab18004800 0x7fab18004c80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fab24009a90 tx=0x7fab18005830 comp rx=0 tx=0).stop 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.459+0000 7fab3738d640 1 -- 172.21.15.60:0/2267801953 shutdown_connections 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.459+0000 7fab3738d640 1 --2- 172.21.15.60:0/2267801953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab18004800 0x7fab18004c80 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.459+0000 7fab3738d640 1 -- 172.21.15.60:0/2267801953 >> 172.21.15.60:0/2267801953 conn(0x7fab3006bc10 msgr2=0x7fab3006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.459+0000 7fab3738d640 1 -- 172.21.15.60:0/2267801953 shutdown_connections 2024-09-12T01:42:13.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.459+0000 7fab3738d640 1 -- 172.21.15.60:0/2267801953 wait complete. 2024-09-12T01:42:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.460+0000 7fab3738d640 1 Processor -- start 2024-09-12T01:42:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.460+0000 7fab3738d640 1 -- start start 2024-09-12T01:42:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab3738d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab18004800 0x7fab300cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab3738d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab301549e0 0x7fab3013e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab3738d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab30151a10 0x7fab30151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab3738d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fab30155be0 con 0x7fab301549e0 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab3738d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fab300b5c20 con 0x7fab18004800 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab3738d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fab300b6140 con 0x7fab30151a10 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab34928640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab301549e0 0x7fab3013e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab34928640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab301549e0 0x7fab3013e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53396/0 (socket says 172.21.15.60:53396) 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab34928640 1 -- 172.21.15.60:0/2275113020 learned_addr learned my addr 172.21.15.60:0/2275113020 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab35129640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab18004800 0x7fab300cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab3592a640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab30151a10 0x7fab30151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab34928640 1 -- 172.21.15.60:0/2275113020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab30151a10 msgr2=0x7fab30151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab34928640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab30151a10 0x7fab30151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab34928640 1 -- 172.21.15.60:0/2275113020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab18004800 msgr2=0x7fab300cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab34928640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab18004800 0x7fab300cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab34928640 1 -- 172.21.15.60:0/2275113020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab300cc780 con 0x7fab301549e0 2024-09-12T01:42:13.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.461+0000 7fab3592a640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab30151a10 0x7fab30151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.462+0000 7fab34928640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab301549e0 0x7fab3013e8b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fab24009a90 tx=0x7fab24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.462+0000 7fab2dffb640 1 -- 172.21.15.60:0/2275113020 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24040020 con 0x7fab301549e0 2024-09-12T01:42:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.462+0000 7fab2dffb640 1 -- 172.21.15.60:0/2275113020 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab2403b680 con 0x7fab301549e0 2024-09-12T01:42:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.462+0000 7fab3738d640 1 -- 172.21.15.60:0/2275113020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab300cb1a0 con 0x7fab301549e0 2024-09-12T01:42:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.462+0000 7fab2dffb640 1 -- 172.21.15.60:0/2275113020 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab24036040 con 0x7fab301549e0 2024-09-12T01:42:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.462+0000 7fab3738d640 1 -- 172.21.15.60:0/2275113020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab300cb760 con 0x7fab301549e0 2024-09-12T01:42:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.463+0000 7fab3738d640 1 -- 172.21.15.60:0/2275113020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab30153dd0 con 0x7fab301549e0 2024-09-12T01:42:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.463+0000 7fab2dffb640 1 -- 172.21.15.60:0/2275113020 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fab24043020 con 0x7fab301549e0 2024-09-12T01:42:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.464+0000 7fab2dffb640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fab1c06be30 0x7fab1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.464+0000 7fab2dffb640 1 -- 172.21.15.60:0/2275113020 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fab240ab4c0 con 0x7fab301549e0 2024-09-12T01:42:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.464+0000 7fab35129640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fab1c06be30 0x7fab1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.464+0000 7fab35129640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fab1c06be30 0x7fab1c06e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fab20000f80 tx=0x7fab20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:13.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.468+0000 7fab2dffb640 1 -- 172.21.15.60:0/2275113020 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fab2404a030 con 0x7fab301549e0 2024-09-12T01:42:13.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.679+0000 7fab3738d640 1 -- 172.21.15.60:0/2275113020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab300b6470 con 0x7fab301549e0 2024-09-12T01:42:13.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.679+0000 7fab2dffb640 1 -- 172.21.15.60:0/2275113020 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5224 (secure 0 0 0) 0x7fab240798b0 con 0x7fab301549e0 2024-09-12T01:42:13.679 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:13.679 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"btime":"2024-09-12T01:42:01:993818+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1757090077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1757090077},{"type":"v1","addr":"172.21.15.105:6834","nonce":1757090077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/131981610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":131981610},{"type":"v1","addr":"172.21.15.60:6836","nonce":131981610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6762,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/18288436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":18288436},{"type":"v1","addr":"172.21.15.60:6837","nonce":18288436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:41:59.340440+0000","modified":"2024-09-12T01:42:01.335289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35732},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35732":{"gid":35732,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/829908705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":829908705},{"type":"v1","addr":"172.21.15.105:6835","nonce":829908705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35732,"qdb_cluster":[35732]},"id":7}]} 2024-09-12T01:42:13.680 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 53 2024-09-12T01:42:13.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.681+0000 7fab3738d640 1 -- 172.21.15.60:0/2275113020 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fab1c06be30 msgr2=0x7fab1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.681+0000 7fab3738d640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fab1c06be30 0x7fab1c06e2f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fab20000f80 tx=0x7fab20009040 comp rx=0 tx=0).stop 2024-09-12T01:42:13.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.681+0000 7fab3738d640 1 -- 172.21.15.60:0/2275113020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab301549e0 msgr2=0x7fab3013e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.681+0000 7fab3738d640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab301549e0 0x7fab3013e8b0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fab24009a90 tx=0x7fab24004730 comp rx=0 tx=0).stop 2024-09-12T01:42:13.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.681+0000 7fab3738d640 1 -- 172.21.15.60:0/2275113020 shutdown_connections 2024-09-12T01:42:13.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.681+0000 7fab3738d640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fab1c06be30 0x7fab1c06e2f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.681+0000 7fab3738d640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fab30151a10 0x7fab30151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.681+0000 7fab3738d640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab301549e0 0x7fab3013e8b0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.681+0000 7fab3738d640 1 --2- 172.21.15.60:0/2275113020 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fab18004800 0x7fab300cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.681+0000 7fab3738d640 1 -- 172.21.15.60:0/2275113020 >> 172.21.15.60:0/2275113020 conn(0x7fab3006bc10 msgr2=0x7fab300ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:13.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.682+0000 7fab3738d640 1 -- 172.21.15.60:0/2275113020 shutdown_connections 2024-09-12T01:42:13.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.682+0000 7fab3738d640 1 -- 172.21.15.60:0/2275113020 wait complete. 2024-09-12T01:42:13.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:13.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.795+0000 7f5e15a80640 1 Processor -- start 2024-09-12T01:42:13.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.795+0000 7f5e15a80640 1 -- start start 2024-09-12T01:42:13.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e15a80640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e1015c2b0 0x7f5e100b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e15a80640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5e100b72f0 0x7f5e1015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e15a80640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e1015fb10 con 0x7f5e1015f030 2024-09-12T01:42:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e15a80640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f5e100b5900 con 0x7f5e100b72f0 2024-09-12T01:42:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e15a80640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5e1015f830 con 0x7f5e1015c2b0 2024-09-12T01:42:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e0effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5e100b72f0 0x7f5e1015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e0effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5e100b72f0 0x7f5e1015eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53404/0 (socket says 172.21.15.60:53404) 2024-09-12T01:42:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e0effd640 1 -- 172.21.15.60:0/960513703 learned_addr learned my addr 172.21.15.60:0/960513703 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e0f7fe640 1 --2- 172.21.15.60:0/960513703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e1015c2b0 0x7f5e100b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e0effd640 1 -- 172.21.15.60:0/960513703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e1015c2b0 msgr2=0x7f5e100b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e0effd640 1 --2- 172.21.15.60:0/960513703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e1015c2b0 0x7f5e100b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e0effd640 1 -- 172.21.15.60:0/960513703 >> v1:172.21.15.60:6789/0 conn(0x7f5e1015f030 legacy=0x7f5e1006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e0effd640 1 -- 172.21.15.60:0/960513703 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1006ce30 con 0x7f5e100b72f0 2024-09-12T01:42:13.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.796+0000 7f5e0e7fc640 1 -- 172.21.15.60:0/960513703 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975335691 0 0) 0x7f5e1015fb10 con 0x7f5e1015f030 2024-09-12T01:42:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.797+0000 7f5e0effd640 1 --2- 172.21.15.60:0/960513703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100b72f0 0x7f5e1015eaf0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009870 tx=0x7f5e0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d812bda40d0a51 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.797+0000 7f5e0e7fc640 1 -- 172.21.15.60:0/960513703 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04037070 con 0x7f5e100b72f0 2024-09-12T01:42:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.797+0000 7f5e0e7fc640 1 -- 172.21.15.60:0/960513703 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e04032440 con 0x7f5e100b72f0 2024-09-12T01:42:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.797+0000 7f5e0e7fc640 1 -- 172.21.15.60:0/960513703 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04032810 con 0x7f5e100b72f0 2024-09-12T01:42:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.798+0000 7f5e15a80640 1 -- 172.21.15.60:0/960513703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100b72f0 msgr2=0x7f5e1015eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.798+0000 7f5e15a80640 1 --2- 172.21.15.60:0/960513703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100b72f0 0x7f5e1015eaf0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009870 tx=0x7f5e0402a270 comp rx=0 tx=0).stop 2024-09-12T01:42:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.798+0000 7f5e15a80640 1 -- 172.21.15.60:0/960513703 shutdown_connections 2024-09-12T01:42:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.798+0000 7f5e15a80640 1 --2- 172.21.15.60:0/960513703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100b72f0 0x7f5e1015eaf0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.798+0000 7f5e15a80640 1 --2- 172.21.15.60:0/960513703 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e1015c2b0 0x7f5e100b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.798+0000 7f5e15a80640 1 -- 172.21.15.60:0/960513703 >> 172.21.15.60:0/960513703 conn(0x7f5e100b4240 msgr2=0x7f5e100b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:13.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.798+0000 7f5e15a80640 1 -- 172.21.15.60:0/960513703 shutdown_connections 2024-09-12T01:42:13.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.798+0000 7f5e15a80640 1 -- 172.21.15.60:0/960513703 wait complete. 2024-09-12T01:42:13.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.799+0000 7f5e15a80640 1 Processor -- start 2024-09-12T01:42:13.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.799+0000 7f5e15a80640 1 -- start start 2024-09-12T01:42:13.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e15a80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100b72f0 0x7f5e1014bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e15a80640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e1015c2b0 0x7f5e10149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e15a80640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e1015f030 0x7f5e1014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e15a80640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5e100b7730 con 0x7f5e100b72f0 2024-09-12T01:42:13.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e15a80640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5e1006d3f0 con 0x7f5e1015c2b0 2024-09-12T01:42:13.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e15a80640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5e1015f4e0 con 0x7f5e1015f030 2024-09-12T01:42:13.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e0f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100b72f0 0x7f5e1014bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e0f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100b72f0 0x7f5e1014bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53412/0 (socket says 172.21.15.60:53412) 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e0f7fe640 1 -- 172.21.15.60:0/3209258676 learned_addr learned my addr 172.21.15.60:0/3209258676 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e0ffff640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e1015f030 0x7f5e1014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e0effd640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e1015c2b0 0x7f5e10149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e0f7fe640 1 -- 172.21.15.60:0/3209258676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e1015f030 msgr2=0x7f5e1014a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e0f7fe640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e1015f030 0x7f5e1014a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e0f7fe640 1 -- 172.21.15.60:0/3209258676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e1015c2b0 msgr2=0x7f5e10149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e0f7fe640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e1015c2b0 0x7f5e10149b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e0f7fe640 1 -- 172.21.15.60:0/3209258676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e1014a060 con 0x7f5e100b72f0 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.800+0000 7f5e0f7fe640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100b72f0 0x7f5e1014bd00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000e9b0 tx=0x7f5e0000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.801+0000 7f5df7fff640 1 -- 172.21.15.60:0/3209258676 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e00017070 con 0x7f5e100b72f0 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.801+0000 7f5df7fff640 1 -- 172.21.15.60:0/3209258676 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e0000c9a0 con 0x7f5e100b72f0 2024-09-12T01:42:13.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.801+0000 7f5e15a80640 1 -- 172.21.15.60:0/3209258676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e1014ac60 con 0x7f5e100b72f0 2024-09-12T01:42:13.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.801+0000 7f5df7fff640 1 -- 172.21.15.60:0/3209258676 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0000cd90 con 0x7f5e100b72f0 2024-09-12T01:42:13.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.801+0000 7f5e15a80640 1 -- 172.21.15.60:0/3209258676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e1014b220 con 0x7f5e100b72f0 2024-09-12T01:42:13.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.802+0000 7f5e15a80640 1 -- 172.21.15.60:0/3209258676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e1015eaf0 con 0x7f5e100b72f0 2024-09-12T01:42:13.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.802+0000 7f5df7fff640 1 -- 172.21.15.60:0/3209258676 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5e0001a070 con 0x7f5e100b72f0 2024-09-12T01:42:13.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.803+0000 7f5df7fff640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5dfc06be60 0x7f5dfc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:13.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.803+0000 7f5df7fff640 1 -- 172.21.15.60:0/3209258676 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f5e0008ae50 con 0x7f5e100b72f0 2024-09-12T01:42:13.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.803+0000 7f5e0effd640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5dfc06be60 0x7f5dfc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:13.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.803+0000 7f5e0effd640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5dfc06be60 0x7f5dfc06e320 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5e04034000 tx=0x7f5e0402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:13.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:13.807+0000 7f5df7fff640 1 -- 172.21.15.60:0/3209258676 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5e00059800 con 0x7f5e100b72f0 2024-09-12T01:42:14.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.017+0000 7f5e15a80640 1 -- 172.21.15.60:0/3209258676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e10071230 con 0x7f5e100b72f0 2024-09-12T01:42:14.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.017+0000 7f5df7fff640 1 -- 172.21.15.60:0/3209258676 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5224 (secure 0 0 0) 0x7f5e00059100 con 0x7f5e100b72f0 2024-09-12T01:42:14.017 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:14.017 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"btime":"2024-09-12T01:42:01:993818+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1757090077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1757090077},{"type":"v1","addr":"172.21.15.105:6834","nonce":1757090077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/131981610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":131981610},{"type":"v1","addr":"172.21.15.60:6836","nonce":131981610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6762,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/18288436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":18288436},{"type":"v1","addr":"172.21.15.60:6837","nonce":18288436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:41:59.340440+0000","modified":"2024-09-12T01:42:01.335289+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":35732},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35732":{"gid":35732,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/829908705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":829908705},{"type":"v1","addr":"172.21.15.105:6835","nonce":829908705}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":35732,"qdb_cluster":[35732]},"id":7}]} 2024-09-12T01:42:14.018 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 53 2024-09-12T01:42:14.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.020+0000 7f5e15a80640 1 -- 172.21.15.60:0/3209258676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5dfc06be60 msgr2=0x7f5dfc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.020+0000 7f5e15a80640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5dfc06be60 0x7f5dfc06e320 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5e04034000 tx=0x7f5e0402e000 comp rx=0 tx=0).stop 2024-09-12T01:42:14.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.020+0000 7f5e15a80640 1 -- 172.21.15.60:0/3209258676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100b72f0 msgr2=0x7f5e1014bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.020+0000 7f5e15a80640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100b72f0 0x7f5e1014bd00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f5e0000e9b0 tx=0x7f5e0000ee70 comp rx=0 tx=0).stop 2024-09-12T01:42:14.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.020+0000 7f5e15a80640 1 -- 172.21.15.60:0/3209258676 shutdown_connections 2024-09-12T01:42:14.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.020+0000 7f5e15a80640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5dfc06be60 0x7f5dfc06e320 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.020+0000 7f5e15a80640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5e1015f030 0x7f5e1014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.020+0000 7f5e15a80640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5e1015c2b0 0x7f5e10149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.020+0000 7f5e15a80640 1 --2- 172.21.15.60:0/3209258676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5e100b72f0 0x7f5e1014bd00 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.020+0000 7f5e15a80640 1 -- 172.21.15.60:0/3209258676 >> 172.21.15.60:0/3209258676 conn(0x7f5e100b4240 msgr2=0x7f5e1015a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:14.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.020+0000 7f5e15a80640 1 -- 172.21.15.60:0/3209258676 shutdown_connections 2024-09-12T01:42:14.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.020+0000 7f5e15a80640 1 -- 172.21.15.60:0/3209258676 wait complete. 2024-09-12T01:42:14.030 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:42:14.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.133+0000 7f940961e640 1 Processor -- start 2024-09-12T01:42:14.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.133+0000 7f940961e640 1 -- start start 2024-09-12T01:42:14.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.134+0000 7f940961e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94040cfb90 0x7f94040d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.134+0000 7f940961e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f940406fa50 0x7f9404073350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.134+0000 7f940961e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94040d1870 con 0x7f94040d2090 2024-09-12T01:42:14.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.134+0000 7f940961e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f940415d810 con 0x7f94040cfb90 2024-09-12T01:42:14.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.134+0000 7f940961e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f940415cc00 con 0x7f940406fa50 2024-09-12T01:42:14.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.134+0000 7f94037fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f940406fa50 0x7f9404073350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.134+0000 7f9402ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94040cfb90 0x7f94040d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.134+0000 7f94027fc640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f94040d2090 0x7f940406f340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:57816/0 (socket says 172.21.15.60:57816) 2024-09-12T01:42:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.134+0000 7f9402ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94040cfb90 0x7f94040d1b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39860/0 (socket says 172.21.15.60:39860) 2024-09-12T01:42:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.134+0000 7f94037fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f940406fa50 0x7f9404073350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:35076/0 (socket says 172.21.15.60:35076) 2024-09-12T01:42:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.134+0000 7f94027fc640 1 -- 172.21.15.60:0/3068113892 learned_addr learned my addr 172.21.15.60:0/3068113892 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.135+0000 7f94037fe640 1 -- 172.21.15.60:0/3068113892 >> v2:172.21.15.105:3300/0 conn(0x7f94040cfb90 msgr2=0x7f94040d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.135+0000 7f94037fe640 1 --2- 172.21.15.60:0/3068113892 >> v2:172.21.15.105:3300/0 conn(0x7f94040cfb90 0x7f94040d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.135+0000 7f94037fe640 1 -- 172.21.15.60:0/3068113892 >> v1:172.21.15.105:6789/0 conn(0x7f94040d2090 legacy=0x7f940406f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.135+0000 7f94037fe640 1 -- 172.21.15.60:0/3068113892 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940415cee0 con 0x7f940406fa50 2024-09-12T01:42:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.135+0000 7f9402ffd640 1 --2- 172.21.15.60:0/3068113892 >> v2:172.21.15.105:3300/0 conn(0x7f94040cfb90 0x7f94040d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:14.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.135+0000 7f9401ffb640 1 -- 172.21.15.60:0/3068113892 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3732716624 0 0) 0x7f94040d1870 con 0x7f94040d2090 2024-09-12T01:42:14.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.136+0000 7f94037fe640 1 --2- 172.21.15.60:0/3068113892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f940406fa50 0x7f9404073350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0097a0 tx=0x7f93fc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd6a395e5c13646c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:14.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.136+0000 7f9401ffb640 1 -- 172.21.15.60:0/3068113892 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc037070 con 0x7f940406fa50 2024-09-12T01:42:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.136+0000 7f9401ffb640 1 -- 172.21.15.60:0/3068113892 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93fc032440 con 0x7f940406fa50 2024-09-12T01:42:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.136+0000 7f9401ffb640 1 -- 172.21.15.60:0/3068113892 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc032810 con 0x7f940406fa50 2024-09-12T01:42:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.136+0000 7f940961e640 1 -- 172.21.15.60:0/3068113892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f940406fa50 msgr2=0x7f9404073350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.136+0000 7f940961e640 1 --2- 172.21.15.60:0/3068113892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f940406fa50 0x7f9404073350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0097a0 tx=0x7f93fc02a180 comp rx=0 tx=0).stop 2024-09-12T01:42:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.136+0000 7f940961e640 1 -- 172.21.15.60:0/3068113892 shutdown_connections 2024-09-12T01:42:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.136+0000 7f940961e640 1 --2- 172.21.15.60:0/3068113892 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f940406fa50 0x7f9404073350 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.136+0000 7f940961e640 1 --2- 172.21.15.60:0/3068113892 >> v2:172.21.15.105:3300/0 conn(0x7f94040cfb90 0x7f94040d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.136+0000 7f940961e640 1 -- 172.21.15.60:0/3068113892 >> 172.21.15.60:0/3068113892 conn(0x7f9404062630 msgr2=0x7f9404062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.136+0000 7f940961e640 1 -- 172.21.15.60:0/3068113892 shutdown_connections 2024-09-12T01:42:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.136+0000 7f940961e640 1 -- 172.21.15.60:0/3068113892 wait complete. 2024-09-12T01:42:14.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.138+0000 7f940961e640 1 Processor -- start 2024-09-12T01:42:14.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.138+0000 7f940961e640 1 -- start start 2024-09-12T01:42:14.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.138+0000 7f940961e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f940406fa50 0x7f940414ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.138+0000 7f940961e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94040cfb90 0x7f9404152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.138+0000 7f940961e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94040d2090 0x7f94041527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.138+0000 7f940961e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f94040cff70 con 0x7f94040d2090 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.138+0000 7f940961e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f940415d4a0 con 0x7f94040cfb90 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.138+0000 7f940961e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f94040b55b0 con 0x7f940406fa50 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f94037fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94040d2090 0x7f94041527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f94037fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94040d2090 0x7f94041527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53428/0 (socket says 172.21.15.60:53428) 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f94037fe640 1 -- 172.21.15.60:0/2876906873 learned_addr learned my addr 172.21.15.60:0/2876906873 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f94027fc640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94040cfb90 0x7f9404152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f9402ffd640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f940406fa50 0x7f940414ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f94037fe640 1 -- 172.21.15.60:0/2876906873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f940406fa50 msgr2=0x7f940414ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f94037fe640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f940406fa50 0x7f940414ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f94037fe640 1 -- 172.21.15.60:0/2876906873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94040cfb90 msgr2=0x7f9404152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f94037fe640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94040cfb90 0x7f9404152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f94037fe640 1 -- 172.21.15.60:0/2876906873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940414f2c0 con 0x7f94040d2090 2024-09-12T01:42:14.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f94037fe640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94040d2090 0x7f94041527a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0097a0 tx=0x7f93fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:14.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f93fb7fe640 1 -- 172.21.15.60:0/2876906873 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc037050 con 0x7f94040d2090 2024-09-12T01:42:14.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f93fb7fe640 1 -- 172.21.15.60:0/2876906873 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93fc038040 con 0x7f94040d2090 2024-09-12T01:42:14.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f940961e640 1 -- 172.21.15.60:0/2876906873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940406d2a0 con 0x7f94040d2090 2024-09-12T01:42:14.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.139+0000 7f93fb7fe640 1 -- 172.21.15.60:0/2876906873 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc004450 con 0x7f94040d2090 2024-09-12T01:42:14.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.140+0000 7f940961e640 1 -- 172.21.15.60:0/2876906873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940406d860 con 0x7f94040d2090 2024-09-12T01:42:14.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.141+0000 7f940961e640 1 -- 172.21.15.60:0/2876906873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94040d1b50 con 0x7f94040d2090 2024-09-12T01:42:14.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.141+0000 7f93fb7fe640 1 -- 172.21.15.60:0/2876906873 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93fc03c6d0 con 0x7f94040d2090 2024-09-12T01:42:14.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.141+0000 7f93fb7fe640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f93e406be30 0x7f93e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.142+0000 7f93fb7fe640 1 -- 172.21.15.60:0/2876906873 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f93fc0ab770 con 0x7f94040d2090 2024-09-12T01:42:14.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.142+0000 7f9402ffd640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f93e406be30 0x7f93e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.142+0000 7f9402ffd640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f93e406be30 0x7f93e406e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009bd0 tx=0x7f93f400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:14.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.146+0000 7f93fb7fe640 1 -- 172.21.15.60:0/2876906873 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93fc079ad0 con 0x7f94040d2090 2024-09-12T01:42:14.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.322+0000 7f940961e640 1 -- 172.21.15.60:0/2876906873 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94040693c0 con 0x7f94040d2090 2024-09-12T01:42:14.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.323+0000 7f93fb7fe640 1 -- 172.21.15.60:0/2876906873 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16632 (secure 0 0 0) 0x7f93fc07ddd0 con 0x7f94040d2090 2024-09-12T01:42:14.322 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:14.322 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":92,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:42:00.988416+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:41:57.005706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-12T01:41:58.327183+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:42:14.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.325+0000 7f940961e640 1 -- 172.21.15.60:0/2876906873 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f93e406be30 msgr2=0x7f93e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.325+0000 7f940961e640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f93e406be30 0x7f93e406e2f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009bd0 tx=0x7f93f400b040 comp rx=0 tx=0).stop 2024-09-12T01:42:14.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.325+0000 7f940961e640 1 -- 172.21.15.60:0/2876906873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94040d2090 msgr2=0x7f94041527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.325+0000 7f940961e640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94040d2090 0x7f94041527a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0097a0 tx=0x7f93fc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.325+0000 7f940961e640 1 -- 172.21.15.60:0/2876906873 shutdown_connections 2024-09-12T01:42:14.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.325+0000 7f940961e640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94040d2090 0x7f94041527a0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.325+0000 7f940961e640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f94040cfb90 0x7f9404152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.325+0000 7f940961e640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f93e406be30 0x7f93e406e2f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.325+0000 7f940961e640 1 --2- 172.21.15.60:0/2876906873 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f940406fa50 0x7f940414ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.325+0000 7f940961e640 1 -- 172.21.15.60:0/2876906873 >> 172.21.15.60:0/2876906873 conn(0x7f9404062630 msgr2=0x7f940415ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:14.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.325+0000 7f940961e640 1 -- 172.21.15.60:0/2876906873 shutdown_connections 2024-09-12T01:42:14.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.325+0000 7f940961e640 1 -- 172.21.15.60:0/2876906873 wait complete. 2024-09-12T01:42:14.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:42:14.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.440+0000 7fb3c2a27640 1 Processor -- start 2024-09-12T01:42:14.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.440+0000 7fb3c2a27640 1 -- start start 2024-09-12T01:42:14.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3c2a27640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb3bc15e750 0x7fb3bc0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3c2a27640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb3bc0b6bb0 0x7fb3bc0b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3c2a27640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3bc0b7790 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3c2a27640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb3bc0d43c0 con 0x7fb3bc15e750 2024-09-12T01:42:14.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3c2a27640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb3bc0d33b0 con 0x7fb3bc0b6bb0 2024-09-12T01:42:14.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3bbfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb3bc15e750 0x7fb3bc0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3bbfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb3bc15e750 0x7fb3bc0cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53436/0 (socket says 172.21.15.60:53436) 2024-09-12T01:42:14.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3bbfff640 1 -- 172.21.15.60:0/283742188 learned_addr learned my addr 172.21.15.60:0/283742188 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:14.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3bb7fe640 1 --1- 172.21.15.60:0/283742188 >> v1:172.21.15.60:6789/0 conn(0x7fb3bc0cfb70 0x7fb3bc0b64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49740/0 (socket says 172.21.15.60:49740) 2024-09-12T01:42:14.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3c0fc4640 1 --2- 172.21.15.60:0/283742188 >> v2:172.21.15.105:3300/0 conn(0x7fb3bc0b6bb0 0x7fb3bc0b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3bbfff640 1 -- 172.21.15.60:0/283742188 >> v2:172.21.15.105:3300/0 conn(0x7fb3bc0b6bb0 msgr2=0x7fb3bc0b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:14.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3bbfff640 1 --2- 172.21.15.60:0/283742188 >> v2:172.21.15.105:3300/0 conn(0x7fb3bc0b6bb0 0x7fb3bc0b7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3bbfff640 1 -- 172.21.15.60:0/283742188 >> v1:172.21.15.60:6789/0 conn(0x7fb3bc0cfb70 legacy=0x7fb3bc0b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.441+0000 7fb3bbfff640 1 -- 172.21.15.60:0/283742188 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc0d3600 con 0x7fb3bc15e750 2024-09-12T01:42:14.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.442+0000 7fb3bbfff640 1 --2- 172.21.15.60:0/283742188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3bc15e750 0x7fb3bc0cf630 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc06d270 tx=0x7fb3ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd17d4d2dacf53bd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:14.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.442+0000 7fb3baffd640 1 -- 172.21.15.60:0/283742188 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac037070 con 0x7fb3bc15e750 2024-09-12T01:42:14.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.442+0000 7fb3baffd640 1 -- 172.21.15.60:0/283742188 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3ac032440 con 0x7fb3bc15e750 2024-09-12T01:42:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.442+0000 7fb3baffd640 1 -- 172.21.15.60:0/283742188 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac032810 con 0x7fb3bc15e750 2024-09-12T01:42:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.443+0000 7fb3c2a27640 1 -- 172.21.15.60:0/283742188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3bc15e750 msgr2=0x7fb3bc0cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.443+0000 7fb3c2a27640 1 --2- 172.21.15.60:0/283742188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3bc15e750 0x7fb3bc0cf630 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc06d270 tx=0x7fb3ac02a270 comp rx=0 tx=0).stop 2024-09-12T01:42:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.443+0000 7fb3c2a27640 1 -- 172.21.15.60:0/283742188 shutdown_connections 2024-09-12T01:42:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.443+0000 7fb3c2a27640 1 --2- 172.21.15.60:0/283742188 >> v2:172.21.15.105:3300/0 conn(0x7fb3bc0b6bb0 0x7fb3bc0b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.443+0000 7fb3c2a27640 1 --2- 172.21.15.60:0/283742188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3bc15e750 0x7fb3bc0cf630 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.443+0000 7fb3c2a27640 1 -- 172.21.15.60:0/283742188 >> 172.21.15.60:0/283742188 conn(0x7fb3bc0d1500 msgr2=0x7fb3bc0d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.443+0000 7fb3c2a27640 1 -- 172.21.15.60:0/283742188 shutdown_connections 2024-09-12T01:42:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.443+0000 7fb3c2a27640 1 -- 172.21.15.60:0/283742188 wait complete. 2024-09-12T01:42:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.444+0000 7fb3c2a27640 1 Processor -- start 2024-09-12T01:42:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.444+0000 7fb3c2a27640 1 -- start start 2024-09-12T01:42:14.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3c2a27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3bc0b6bb0 0x7fb3bc15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3c2a27640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3bc0cfb70 0x7fb3bc0b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3c2a27640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3bc15e750 0x7fb3bc0b8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3c2a27640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc0d3bc0 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3c2a27640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc0b7ac0 con 0x7fb3bc0b6bb0 2024-09-12T01:42:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3c2a27640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc15eb30 con 0x7fb3bc15e750 2024-09-12T01:42:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3bb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3bc0cfb70 0x7fb3bc0b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3bb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3bc0cfb70 0x7fb3bc0b7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53442/0 (socket says 172.21.15.60:53442) 2024-09-12T01:42:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3bb7fe640 1 -- 172.21.15.60:0/1205156027 learned_addr learned my addr 172.21.15.60:0/1205156027 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3bbfff640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3bc0b6bb0 0x7fb3bc15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3c0fc4640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3bc15e750 0x7fb3bc0b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3bb7fe640 1 -- 172.21.15.60:0/1205156027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3bc15e750 msgr2=0x7fb3bc0b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3bb7fe640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3bc15e750 0x7fb3bc0b8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3bb7fe640 1 -- 172.21.15.60:0/1205156027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3bc0b6bb0 msgr2=0x7fb3bc15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3bb7fe640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3bc0b6bb0 0x7fb3bc15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3bb7fe640 1 -- 172.21.15.60:0/1205156027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc15fa40 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.445+0000 7fb3bb7fe640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3bc0cfb70 0x7fb3bc0b7f50 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000c430 tx=0x7fb3b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.446+0000 7fb3b8ff9640 1 -- 172.21.15.60:0/1205156027 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00074e0 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.446+0000 7fb3b8ff9640 1 -- 172.21.15.60:0/1205156027 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b0007680 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.446+0000 7fb3b8ff9640 1 -- 172.21.15.60:0/1205156027 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0004a00 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.446+0000 7fb3c2a27640 1 -- 172.21.15.60:0/1205156027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3bc15fd20 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.446+0000 7fb3c2a27640 1 -- 172.21.15.60:0/1205156027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3bc1602e0 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.447+0000 7fb3c2a27640 1 -- 172.21.15.60:0/1205156027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3bc0b5850 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.447+0000 7fb3b8ff9640 1 -- 172.21.15.60:0/1205156027 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3b001a020 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.448+0000 7fb3b8ff9640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb3a806be30 0x7fb3a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.448+0000 7fb3b8ff9640 1 -- 172.21.15.60:0/1205156027 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fb3b008a640 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.448+0000 7fb3bbfff640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb3a806be30 0x7fb3a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.448+0000 7fb3bbfff640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb3a806be30 0x7fb3a806e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac034000 tx=0x7fb3ac02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:14.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.452+0000 7fb3b8ff9640 1 -- 172.21.15.60:0/1205156027 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb3b0058ff0 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.665+0000 7fb3c2a27640 1 -- 172.21.15.60:0/1205156027 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb3bc0b5570 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.665 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-12T01:42:14.666+0000 7f58b98dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:42:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.667+0000 7fb3b8ff9640 1 -- 172.21.15.60:0/1205156027 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) ==== 161+0+0 (secure 0 0 0) 0x7fb3b00588f0 con 0x7fb3bc0cfb70 2024-09-12T01:42:14.667 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:42:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.670+0000 7fb3c2a27640 1 -- 172.21.15.60:0/1205156027 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb3a806be30 msgr2=0x7fb3a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.670+0000 7fb3c2a27640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb3a806be30 0x7fb3a806e2f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac034000 tx=0x7fb3ac02e000 comp rx=0 tx=0).stop 2024-09-12T01:42:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.670+0000 7fb3c2a27640 1 -- 172.21.15.60:0/1205156027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3bc0cfb70 msgr2=0x7fb3bc0b7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.670+0000 7fb3c2a27640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3bc0cfb70 0x7fb3bc0b7f50 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000c430 tx=0x7fb3b000c8f0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.670+0000 7fb3c2a27640 1 -- 172.21.15.60:0/1205156027 shutdown_connections 2024-09-12T01:42:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.670+0000 7fb3c2a27640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb3a806be30 0x7fb3a806e2f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.670+0000 7fb3c2a27640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3bc15e750 0x7fb3bc0b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.670+0000 7fb3c2a27640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3bc0cfb70 0x7fb3bc0b7f50 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.670+0000 7fb3c2a27640 1 --2- 172.21.15.60:0/1205156027 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3bc0b6bb0 0x7fb3bc15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.670+0000 7fb3c2a27640 1 -- 172.21.15.60:0/1205156027 >> 172.21.15.60:0/1205156027 conn(0x7fb3bc0d1500 msgr2=0x7fb3bc0b64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.670+0000 7fb3c2a27640 1 -- 172.21.15.60:0/1205156027 shutdown_connections 2024-09-12T01:42:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.670+0000 7fb3c2a27640 1 -- 172.21.15.60:0/1205156027 wait complete. 2024-09-12T01:42:14.672 INFO:tasks.ceph.mds.d.smithi105.stderr: -1993> 2024-09-12T01:42:05.642+0000 7f95a3509640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:42:14.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:42:14.701 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:42:14.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.787+0000 7fdee774b640 1 Processor -- start 2024-09-12T01:42:14.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.787+0000 7fdee774b640 1 -- start start 2024-09-12T01:42:14.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.788+0000 7fdee774b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdee015c230 0x7fdee015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.788+0000 7fdee774b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdee006e4b0 0x7fdee0162b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.788+0000 7fdee774b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdee00b6a80 0x7fdee00b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.788+0000 7fdee774b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdee015c610 con 0x7fdee015c230 2024-09-12T01:42:14.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.788+0000 7fdee774b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdee01630b0 con 0x7fdee00b6a80 2024-09-12T01:42:14.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.788+0000 7fdee774b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdee006e930 con 0x7fdee006e4b0 2024-09-12T01:42:14.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.788+0000 7fdee54e7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdee015c230 0x7fdee015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.789+0000 7fdee54e7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdee015c230 0x7fdee015f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53444/0 (socket says 172.21.15.60:53444) 2024-09-12T01:42:14.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.789+0000 7fdee54e7640 1 -- 172.21.15.60:0/1489399541 learned_addr learned my addr 172.21.15.60:0/1489399541 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:14.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.789+0000 7fdee4ce6640 1 --2- 172.21.15.60:0/1489399541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdee006e4b0 0x7fdee0162b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.789+0000 7fdee5ce8640 1 --2- 172.21.15.60:0/1489399541 >> v2:172.21.15.105:3300/0 conn(0x7fdee00b6a80 0x7fdee00b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.789+0000 7fdee54e7640 1 -- 172.21.15.60:0/1489399541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdee006e4b0 msgr2=0x7fdee0162b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:14.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.789+0000 7fdee54e7640 1 --2- 172.21.15.60:0/1489399541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdee006e4b0 0x7fdee0162b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.789+0000 7fdee54e7640 1 -- 172.21.15.60:0/1489399541 >> v2:172.21.15.105:3300/0 conn(0x7fdee00b6a80 msgr2=0x7fdee00b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:14.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.789+0000 7fdee54e7640 1 --2- 172.21.15.60:0/1489399541 >> v2:172.21.15.105:3300/0 conn(0x7fdee00b6a80 0x7fdee00b6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.789+0000 7fdee54e7640 1 -- 172.21.15.60:0/1489399541 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee006ec10 con 0x7fdee015c230 2024-09-12T01:42:14.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.789+0000 7fdee4ce6640 1 --2- 172.21.15.60:0/1489399541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdee006e4b0 0x7fdee0162b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:14.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.789+0000 7fdee54e7640 1 --2- 172.21.15.60:0/1489399541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee015c230 0x7fdee015f680 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fdee00d2380 tx=0x7fded002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1160da9d96061eb server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:14.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.790+0000 7fdedffff640 1 -- 172.21.15.60:0/1489399541 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0037070 con 0x7fdee015c230 2024-09-12T01:42:14.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.790+0000 7fdedffff640 1 -- 172.21.15.60:0/1489399541 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded0032440 con 0x7fdee015c230 2024-09-12T01:42:14.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.790+0000 7fdedffff640 1 -- 172.21.15.60:0/1489399541 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0032810 con 0x7fdee015c230 2024-09-12T01:42:14.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.790+0000 7fdee774b640 1 -- 172.21.15.60:0/1489399541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee015c230 msgr2=0x7fdee015f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.790+0000 7fdee774b640 1 --2- 172.21.15.60:0/1489399541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee015c230 0x7fdee015f680 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fdee00d2380 tx=0x7fded002a1e0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.790+0000 7fdee774b640 1 -- 172.21.15.60:0/1489399541 shutdown_connections 2024-09-12T01:42:14.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.790+0000 7fdee774b640 1 --2- 172.21.15.60:0/1489399541 >> v2:172.21.15.105:3300/0 conn(0x7fdee00b6a80 0x7fdee00b6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.790+0000 7fdee774b640 1 --2- 172.21.15.60:0/1489399541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdee006e4b0 0x7fdee0162b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.790+0000 7fdee774b640 1 --2- 172.21.15.60:0/1489399541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee015c230 0x7fdee015f680 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.790+0000 7fdee774b640 1 -- 172.21.15.60:0/1489399541 >> 172.21.15.60:0/1489399541 conn(0x7fdee00d2450 msgr2=0x7fdee00d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:14.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.790+0000 7fdee774b640 1 -- 172.21.15.60:0/1489399541 shutdown_connections 2024-09-12T01:42:14.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.790+0000 7fdee774b640 1 -- 172.21.15.60:0/1489399541 wait complete. 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.792+0000 7fdee774b640 1 Processor -- start 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.792+0000 7fdee774b640 1 -- start start 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.792+0000 7fdee774b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee006e4b0 0x7fdee00d11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.792+0000 7fdee774b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdee00b6a80 0x7fdee014c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.792+0000 7fdee774b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdee015c230 0x7fdee00b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.792+0000 7fdee774b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdee00b55b0 con 0x7fdee006e4b0 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.792+0000 7fdee774b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdee015f160 con 0x7fdee00b6a80 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.792+0000 7fdee774b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdee015eb70 con 0x7fdee015c230 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.792+0000 7fdee54e7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee006e4b0 0x7fdee00d11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdee54e7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee006e4b0 0x7fdee00d11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53448/0 (socket says 172.21.15.60:53448) 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdee54e7640 1 -- 172.21.15.60:0/3694444485 learned_addr learned my addr 172.21.15.60:0/3694444485 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdee4ce6640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdee00b6a80 0x7fdee014c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdee5ce8640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdee015c230 0x7fdee00b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdee54e7640 1 -- 172.21.15.60:0/3694444485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdee015c230 msgr2=0x7fdee00b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdee54e7640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdee015c230 0x7fdee00b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdee54e7640 1 -- 172.21.15.60:0/3694444485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdee00b6a80 msgr2=0x7fdee014c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:14.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdee54e7640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdee00b6a80 0x7fdee014c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:14.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdee54e7640 1 -- 172.21.15.60:0/3694444485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee01492b0 con 0x7fdee006e4b0 2024-09-12T01:42:14.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdee4ce6640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdee00b6a80 0x7fdee014c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:14.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdee54e7640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee006e4b0 0x7fdee00d11c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fded002a220 tx=0x7fded00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:14.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdeddffb640 1 -- 172.21.15.60:0/3694444485 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0041020 con 0x7fdee006e4b0 2024-09-12T01:42:14.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdeddffb640 1 -- 172.21.15.60:0/3694444485 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded00306c0 con 0x7fdee006e4b0 2024-09-12T01:42:14.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdee774b640 1 -- 172.21.15.60:0/3694444485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee0149590 con 0x7fdee006e4b0 2024-09-12T01:42:14.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.793+0000 7fdeddffb640 1 -- 172.21.15.60:0/3694444485 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0037040 con 0x7fdee006e4b0 2024-09-12T01:42:14.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.794+0000 7fdee774b640 1 -- 172.21.15.60:0/3694444485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee0149b50 con 0x7fdee006e4b0 2024-09-12T01:42:14.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.794+0000 7fdee774b640 1 -- 172.21.15.60:0/3694444485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee0162b70 con 0x7fdee006e4b0 2024-09-12T01:42:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.795+0000 7fdeddffb640 1 -- 172.21.15.60:0/3694444485 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fded0044020 con 0x7fdee006e4b0 2024-09-12T01:42:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.795+0000 7fdeddffb640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdecc06be60 0x7fdecc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.795+0000 7fdeddffb640 1 -- 172.21.15.60:0/3694444485 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5795+0+0 (secure 0 0 0) 0x7fded00ab6c0 con 0x7fdee006e4b0 2024-09-12T01:42:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.796+0000 7fdee4ce6640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdecc06be60 0x7fdecc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:14.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.796+0000 7fdee4ce6640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdecc06be60 0x7fdecc06e320 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fded4006fd0 tx=0x7fded4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:14.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:14.800+0000 7fdeddffb640 1 -- 172.21.15.60:0/3694444485 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fded004b030 con 0x7fdee006e4b0 2024-09-12T01:42:15.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.012+0000 7fdee774b640 1 -- 172.21.15.60:0/3694444485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdee0071ae0 con 0x7fdee006e4b0 2024-09-12T01:42:15.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.669+0000 7fdeddffb640 1 -- 172.21.15.60:0/3694444485 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) ==== 104+0+0 (secure 0 0 0) 0x7fded007a010 con 0x7fdee006e4b0 2024-09-12T01:42:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.671+0000 7fdee774b640 1 -- 172.21.15.60:0/3694444485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdecc06be60 msgr2=0x7fdecc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.671+0000 7fdee774b640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdecc06be60 0x7fdecc06e320 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fded4006fd0 tx=0x7fded4008040 comp rx=0 tx=0).stop 2024-09-12T01:42:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.671+0000 7fdee774b640 1 -- 172.21.15.60:0/3694444485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee006e4b0 msgr2=0x7fdee00d11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.671+0000 7fdee774b640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee006e4b0 0x7fdee00d11c0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fded002a220 tx=0x7fded00046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.671+0000 7fdee774b640 1 -- 172.21.15.60:0/3694444485 shutdown_connections 2024-09-12T01:42:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.671+0000 7fdee774b640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdecc06be60 0x7fdecc06e320 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.671+0000 7fdee774b640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdee015c230 0x7fdee00b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.671+0000 7fdee774b640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdee00b6a80 0x7fdee014c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.671+0000 7fdee774b640 1 --2- 172.21.15.60:0/3694444485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdee006e4b0 0x7fdee00d11c0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.671+0000 7fdee774b640 1 -- 172.21.15.60:0/3694444485 >> 172.21.15.60:0/3694444485 conn(0x7fdee00d2450 msgr2=0x7fdee006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.671+0000 7fdee774b640 1 -- 172.21.15.60:0/3694444485 shutdown_connections 2024-09-12T01:42:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.671+0000 7fdee774b640 1 -- 172.21.15.60:0/3694444485 wait complete. 2024-09-12T01:42:15.684 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:42:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.796+0000 7fe8bcd5f640 1 Processor -- start 2024-09-12T01:42:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.796+0000 7fe8bcd5f640 1 -- start start 2024-09-12T01:42:15.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.797+0000 7fe8bcd5f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8b815e570 0x7fe8b80b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:15.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.797+0000 7fe8bcd5f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8b815f020 con 0x7fe8b806fb10 2024-09-12T01:42:15.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.797+0000 7fe8bcd5f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8b815f300 con 0x7fe8b80714a0 2024-09-12T01:42:15.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.797+0000 7fe8bcd5f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe8b815fc30 con 0x7fe8b815e570 2024-09-12T01:42:15.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.797+0000 7fe8b659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8b815e570 0x7fe8b80b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:15.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.797+0000 7fe8b6d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe8b806fb10 0x7fe8b806cf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49756/0 (socket says 172.21.15.60:49756) 2024-09-12T01:42:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.797+0000 7fe8b6d9d640 1 -- 172.21.15.60:0/1672822284 learned_addr learned my addr 172.21.15.60:0/1672822284 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.798+0000 7fe8b659c640 1 -- 172.21.15.60:0/1672822284 >> v1:172.21.15.105:6789/0 conn(0x7fe8b80714a0 legacy=0x7fe8b806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.798+0000 7fe8b659c640 1 -- 172.21.15.60:0/1672822284 >> v1:172.21.15.60:6789/0 conn(0x7fe8b806fb10 legacy=0x7fe8b806cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.798+0000 7fe8b659c640 1 -- 172.21.15.60:0/1672822284 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b815f5e0 con 0x7fe8b815e570 2024-09-12T01:42:15.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.798+0000 7fe8b559a640 1 -- 172.21.15.60:0/1672822284 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098694777 0 0) 0x7fe8b815f020 con 0x7fe8b806fb10 2024-09-12T01:42:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.798+0000 7fe8b659c640 1 --2- 172.21.15.60:0/1672822284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b815e570 0x7fe8b80b5540 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009d90 tx=0x7fe8a802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85397e47ee3fad03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.799+0000 7fe8b559a640 1 -- 172.21.15.60:0/1672822284 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8031600 con 0x7fe8b815e570 2024-09-12T01:42:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.799+0000 7fe8b559a640 1 -- 172.21.15.60:0/1672822284 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8a80317a0 con 0x7fe8b815e570 2024-09-12T01:42:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.799+0000 7fe8b559a640 1 -- 172.21.15.60:0/1672822284 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8031b70 con 0x7fe8b815e570 2024-09-12T01:42:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.799+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/1672822284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b815e570 msgr2=0x7fe8b80b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.799+0000 7fe8bcd5f640 1 --2- 172.21.15.60:0/1672822284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b815e570 0x7fe8b80b5540 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8009d90 tx=0x7fe8a802a610 comp rx=0 tx=0).stop 2024-09-12T01:42:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.799+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/1672822284 shutdown_connections 2024-09-12T01:42:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.799+0000 7fe8bcd5f640 1 --2- 172.21.15.60:0/1672822284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b815e570 0x7fe8b80b5540 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.799+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/1672822284 >> 172.21.15.60:0/1672822284 conn(0x7fe8b80b4240 msgr2=0x7fe8b80b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.799+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/1672822284 shutdown_connections 2024-09-12T01:42:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.799+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/1672822284 wait complete. 2024-09-12T01:42:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.801+0000 7fe8bcd5f640 1 Processor -- start 2024-09-12T01:42:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.801+0000 7fe8bcd5f640 1 -- start start 2024-09-12T01:42:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.801+0000 7fe8bcd5f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8b806fb10 0x7fe8b80cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.801+0000 7fe8bcd5f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b80714a0 0x7fe8b80d1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.801+0000 7fe8bcd5f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8b815e570 0x7fe8b8154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.801+0000 7fe8bcd5f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b815ead0 con 0x7fe8b80714a0 2024-09-12T01:42:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.801+0000 7fe8bcd5f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b815e950 con 0x7fe8b815e570 2024-09-12T01:42:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.801+0000 7fe8bcd5f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe8b815ec50 con 0x7fe8b806fb10 2024-09-12T01:42:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.801+0000 7fe8b5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b80714a0 0x7fe8b80d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.801+0000 7fe8b5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b80714a0 0x7fe8b80d1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53464/0 (socket says 172.21.15.60:53464) 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8b5d9b640 1 -- 172.21.15.60:0/2836392440 learned_addr learned my addr 172.21.15.60:0/2836392440 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8b6d9d640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8b815e570 0x7fe8b8154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8b659c640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8b806fb10 0x7fe8b80cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8b5d9b640 1 -- 172.21.15.60:0/2836392440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8b806fb10 msgr2=0x7fe8b80cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8b5d9b640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8b806fb10 0x7fe8b80cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8b5d9b640 1 -- 172.21.15.60:0/2836392440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8b815e570 msgr2=0x7fe8b8154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8b5d9b640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8b815e570 0x7fe8b8154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8b5d9b640 1 -- 172.21.15.60:0/2836392440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b80cbea0 con 0x7fe8b80714a0 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8b659c640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8b806fb10 0x7fe8b80cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8b6d9d640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8b815e570 0x7fe8b8154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8b5d9b640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b80714a0 0x7fe8b80d1540 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000c410 tx=0x7fe8a000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8aeffd640 1 -- 172.21.15.60:0/2836392440 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0017070 con 0x7fe8b80714a0 2024-09-12T01:42:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8aeffd640 1 -- 172.21.15.60:0/2836392440 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8a00035f0 con 0x7fe8b80714a0 2024-09-12T01:42:15.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/2836392440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8b80cc180 con 0x7fe8b80714a0 2024-09-12T01:42:15.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8aeffd640 1 -- 172.21.15.60:0/2836392440 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0003a20 con 0x7fe8b80714a0 2024-09-12T01:42:15.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.802+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/2836392440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8b80ccad0 con 0x7fe8b80714a0 2024-09-12T01:42:15.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.803+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/2836392440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8b80cccd0 con 0x7fe8b80714a0 2024-09-12T01:42:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.804+0000 7fe8aeffd640 1 -- 172.21.15.60:0/2836392440 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe8a001a070 con 0x7fe8b80714a0 2024-09-12T01:42:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.804+0000 7fe8aeffd640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe89806be60 0x7fe89806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.804+0000 7fe8aeffd640 1 -- 172.21.15.60:0/2836392440 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5795+0+0 (secure 0 0 0) 0x7fe8a008a260 con 0x7fe8b80714a0 2024-09-12T01:42:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.804+0000 7fe8b659c640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe89806be60 0x7fe89806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:15.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.805+0000 7fe8b659c640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe89806be60 0x7fe89806e320 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8034000 tx=0x7fe8a802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:15.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.808+0000 7fe8aeffd640 1 -- 172.21.15.60:0/2836392440 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe8b80cccd0 con 0x7fe8b80714a0 2024-09-12T01:42:15.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:15.984+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/2836392440 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe8b80d2d40 con 0x7fe8b80714a0 2024-09-12T01:42:16.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.670+0000 7fe8aeffd640 1 -- 172.21.15.60:0/2836392440 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v94) ==== 181+0+0 (secure 0 0 0) 0x7fe8a0058c40 con 0x7fe8b80714a0 2024-09-12T01:42:16.670 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:42:16.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.674+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/2836392440 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe89806be60 msgr2=0x7fe89806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.674+0000 7fe8bcd5f640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe89806be60 0x7fe89806e320 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe8a8034000 tx=0x7fe8a802f000 comp rx=0 tx=0).stop 2024-09-12T01:42:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.674+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/2836392440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b80714a0 msgr2=0x7fe8b80d1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:16.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.674+0000 7fe8bcd5f640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b80714a0 0x7fe8b80d1540 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000c410 tx=0x7fe8a000c8d0 comp rx=0 tx=0).stop 2024-09-12T01:42:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.675+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/2836392440 shutdown_connections 2024-09-12T01:42:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.675+0000 7fe8bcd5f640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe8b815e570 0x7fe8b8154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.676+0000 7fe8bcd5f640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8b80714a0 0x7fe8b80d1540 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.676+0000 7fe8bcd5f640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe89806be60 0x7fe89806e320 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.676+0000 7fe8bcd5f640 1 --2- 172.21.15.60:0/2836392440 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe8b806fb10 0x7fe8b80cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:16.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.676+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/2836392440 >> 172.21.15.60:0/2836392440 conn(0x7fe8b80b4240 msgr2=0x7fe8b806e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:16.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.677+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/2836392440 shutdown_connections 2024-09-12T01:42:16.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.677+0000 7fe8bcd5f640 1 -- 172.21.15.60:0/2836392440 wait complete. 2024-09-12T01:42:16.692 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:42:16.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.804+0000 7fec0655f640 1 Processor -- start 2024-09-12T01:42:16.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.804+0000 7fec0655f640 1 -- start start 2024-09-12T01:42:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7fec0655f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fec0015e990 0x7fec000b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7fec0655f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fec00162450 0x7fec00162890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7fec0655f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec0015ed70 con 0x7fec00162dd0 2024-09-12T01:42:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7fec0655f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fec000cff20 con 0x7fec00162450 2024-09-12T01:42:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7fec0655f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fec00163260 con 0x7fec0015e990 2024-09-12T01:42:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7febff7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fec00162450 0x7fec00162890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7febff7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fec00162450 0x7fec00162890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53466/0 (socket says 172.21.15.60:53466) 2024-09-12T01:42:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7febff7fe640 1 -- 172.21.15.60:0/1222995895 learned_addr learned my addr 172.21.15.60:0/1222995895 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7febff7fe640 1 -- 172.21.15.60:0/1222995895 >> v2:172.21.15.105:3300/0 conn(0x7fec0015e990 msgr2=0x7fec000b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7febfffff640 1 --2- 172.21.15.60:0/1222995895 >> v2:172.21.15.105:3300/0 conn(0x7fec0015e990 0x7fec000b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7febff7fe640 1 --2- 172.21.15.60:0/1222995895 >> v2:172.21.15.105:3300/0 conn(0x7fec0015e990 0x7fec000b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:16.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7febff7fe640 1 -- 172.21.15.60:0/1222995895 >> v1:172.21.15.105:6789/0 conn(0x7fec00162dd0 legacy=0x7fec000b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.805+0000 7febff7fe640 1 -- 172.21.15.60:0/1222995895 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec000d1fa0 con 0x7fec00162450 2024-09-12T01:42:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.806+0000 7febff7fe640 1 --2- 172.21.15.60:0/1222995895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec00162450 0x7fec00162890 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fec00074330 tx=0x7febf402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0248fcd002b304f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.806+0000 7febfeffd640 1 -- 172.21.15.60:0/1222995895 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4037070 con 0x7fec00162450 2024-09-12T01:42:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.806+0000 7febfeffd640 1 -- 172.21.15.60:0/1222995895 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf4032440 con 0x7fec00162450 2024-09-12T01:42:16.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.806+0000 7febfeffd640 1 -- 172.21.15.60:0/1222995895 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf4032810 con 0x7fec00162450 2024-09-12T01:42:16.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.807+0000 7fec0655f640 1 -- 172.21.15.60:0/1222995895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec00162450 msgr2=0x7fec00162890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:16.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.807+0000 7fec0655f640 1 --2- 172.21.15.60:0/1222995895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec00162450 0x7fec00162890 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fec00074330 tx=0x7febf402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:42:16.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.807+0000 7fec0655f640 1 -- 172.21.15.60:0/1222995895 shutdown_connections 2024-09-12T01:42:16.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.807+0000 7fec0655f640 1 --2- 172.21.15.60:0/1222995895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec00162450 0x7fec00162890 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:16.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.807+0000 7fec0655f640 1 --2- 172.21.15.60:0/1222995895 >> v2:172.21.15.105:3300/0 conn(0x7fec0015e990 0x7fec000b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:16.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.807+0000 7fec0655f640 1 -- 172.21.15.60:0/1222995895 >> 172.21.15.60:0/1222995895 conn(0x7fec000d1200 msgr2=0x7fec000d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:16.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.807+0000 7fec0655f640 1 -- 172.21.15.60:0/1222995895 shutdown_connections 2024-09-12T01:42:16.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.807+0000 7fec0655f640 1 -- 172.21.15.60:0/1222995895 wait complete. 2024-09-12T01:42:16.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.808+0000 7fec0655f640 1 Processor -- start 2024-09-12T01:42:16.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.808+0000 7fec0655f640 1 -- start start 2024-09-12T01:42:16.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.809+0000 7fec0655f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec0015e990 0x7fec001f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:16.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.809+0000 7fec0655f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec00162450 0x7fec000cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:16.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.809+0000 7fec0655f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec00162dd0 0x7fec0015dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:16.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.809+0000 7fec0655f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fec000d39b0 con 0x7fec00162dd0 2024-09-12T01:42:16.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.809+0000 7fec0655f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec000cfc40 con 0x7fec00162450 2024-09-12T01:42:16.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.809+0000 7fec0655f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fec000d3b30 con 0x7fec0015e990 2024-09-12T01:42:16.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.809+0000 7fec04afc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec00162dd0 0x7fec0015dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:16.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.809+0000 7fec04afc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec00162dd0 0x7fec0015dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53468/0 (socket says 172.21.15.60:53468) 2024-09-12T01:42:16.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.809+0000 7fec04afc640 1 -- 172.21.15.60:0/2137692779 learned_addr learned my addr 172.21.15.60:0/2137692779 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:16.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.809+0000 7febfffff640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec0015e990 0x7fec001f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.809+0000 7febff7fe640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec00162450 0x7fec000cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.810+0000 7fec04afc640 1 -- 172.21.15.60:0/2137692779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec0015e990 msgr2=0x7fec001f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.810+0000 7fec04afc640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec0015e990 0x7fec001f4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.810+0000 7fec04afc640 1 -- 172.21.15.60:0/2137692779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec00162450 msgr2=0x7fec000cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.810+0000 7fec04afc640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec00162450 0x7fec000cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.810+0000 7fec04afc640 1 -- 172.21.15.60:0/2137692779 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec000ccde0 con 0x7fec00162dd0 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.810+0000 7febff7fe640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec00162450 0x7fec000cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.810+0000 7fec04afc640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec00162dd0 0x7fec0015dcb0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7febf800c780 tx=0x7febf800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.810+0000 7febfcff9640 1 -- 172.21.15.60:0/2137692779 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8017070 con 0x7fec00162dd0 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.810+0000 7febfcff9640 1 -- 172.21.15.60:0/2137692779 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febf8003da0 con 0x7fec00162dd0 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.810+0000 7fec0655f640 1 -- 172.21.15.60:0/2137692779 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0015e1f0 con 0x7fec00162dd0 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.810+0000 7febfcff9640 1 -- 172.21.15.60:0/2137692779 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf80052b0 con 0x7fec00162dd0 2024-09-12T01:42:16.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.810+0000 7fec0655f640 1 -- 172.21.15.60:0/2137692779 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec000cd340 con 0x7fec00162dd0 2024-09-12T01:42:16.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.811+0000 7fec0655f640 1 -- 172.21.15.60:0/2137692779 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec00162890 con 0x7fec00162dd0 2024-09-12T01:42:16.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.812+0000 7febfcff9640 1 -- 172.21.15.60:0/2137692779 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7febf801a070 con 0x7fec00162dd0 2024-09-12T01:42:16.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.812+0000 7febfcff9640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7febec06be30 0x7febec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:16.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.812+0000 7febfcff9640 1 -- 172.21.15.60:0/2137692779 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5357+0+0 (secure 0 0 0) 0x7febf808a2c0 con 0x7fec00162dd0 2024-09-12T01:42:16.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.812+0000 7febfffff640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7febec06be30 0x7febec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:16.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.813+0000 7febfffff640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7febec06be30 0x7febec06e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7febf000aa20 tx=0x7febf0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:16.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.816+0000 7febfcff9640 1 -- 172.21.15.60:0/2137692779 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec0015e1f0 con 0x7fec00162dd0 2024-09-12T01:42:16.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:16.990+0000 7fec0655f640 1 -- 172.21.15.60:0/2137692779 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fec000d5370 con 0x7fec00162dd0 2024-09-12T01:42:17.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.675+0000 7febfcff9640 1 -- 172.21.15.60:0/2137692779 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v95) ==== 169+0+0 (secure 0 0 0) 0x7fec000ccde0 con 0x7fec00162dd0 2024-09-12T01:42:17.675 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-12T01:42:17.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.679+0000 7fec0655f640 1 -- 172.21.15.60:0/2137692779 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7febec06be30 msgr2=0x7febec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:17.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.679+0000 7fec0655f640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7febec06be30 0x7febec06e2f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7febf000aa20 tx=0x7febf0008040 comp rx=0 tx=0).stop 2024-09-12T01:42:17.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.679+0000 7fec0655f640 1 -- 172.21.15.60:0/2137692779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec00162dd0 msgr2=0x7fec0015dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:17.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.679+0000 7fec0655f640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec00162dd0 0x7fec0015dcb0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7febf800c780 tx=0x7febf800cc40 comp rx=0 tx=0).stop 2024-09-12T01:42:17.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.679+0000 7fec0655f640 1 -- 172.21.15.60:0/2137692779 shutdown_connections 2024-09-12T01:42:17.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.679+0000 7fec0655f640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec00162dd0 0x7fec0015dcb0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:17.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.679+0000 7fec0655f640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec00162450 0x7fec000cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:17.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.679+0000 7fec0655f640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7febec06be30 0x7febec06e2f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:17.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.679+0000 7fec0655f640 1 --2- 172.21.15.60:0/2137692779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec0015e990 0x7fec001f4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:17.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.679+0000 7fec0655f640 1 -- 172.21.15.60:0/2137692779 >> 172.21.15.60:0/2137692779 conn(0x7fec000d1200 msgr2=0x7fec000b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:17.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.679+0000 7fec0655f640 1 -- 172.21.15.60:0/2137692779 shutdown_connections 2024-09-12T01:42:17.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.680+0000 7fec0655f640 1 -- 172.21.15.60:0/2137692779 wait complete. 2024-09-12T01:42:17.694 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T01:42:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.810+0000 7effbda5c640 1 Processor -- start 2024-09-12T01:42:17.810 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.810+0000 7effbda5c640 1 -- start start 2024-09-12T01:42:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.811+0000 7effbda5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb80b7450 0x7effb806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.811+0000 7effbda5c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb806e990 con 0x7effb815e6f0 2024-09-12T01:42:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.811+0000 7effbda5c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb806ec70 con 0x7effb80b54d0 2024-09-12T01:42:17.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.811+0000 7effbda5c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7effb815ec70 con 0x7effb80b7450 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.811+0000 7effb6ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7effb815e6f0 0x7effb80b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49768/0 (socket says 172.21.15.60:49768) 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.811+0000 7effb6ffd640 1 -- 172.21.15.60:0/2030724171 learned_addr learned my addr 172.21.15.60:0/2030724171 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.811+0000 7effb77fe640 1 --2- 172.21.15.60:0/2030724171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb80b7450 0x7effb806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231260553 0 0) 0x7effb806e990 con 0x7effb815e6f0 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effa4003520 con 0x7effb815e6f0 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2526268083 0 0) 0x7effb806ec70 con 0x7effb80b54d0 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb806e990 con 0x7effb80b54d0 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3502882262 0 0) 0x7effa4003520 con 0x7effb815e6f0 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb80b7450 msgr2=0x7effb806fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 --2- 172.21.15.60:0/2030724171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb80b7450 0x7effb806fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 >> v1:172.21.15.105:6789/0 conn(0x7effb80b54d0 legacy=0x7effb8070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb815ef50 con 0x7effb815e6f0 2024-09-12T01:42:17.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7effa80019f0 con 0x7effb815e6f0 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 >> v1:172.21.15.60:6789/0 conn(0x7effb815e6f0 legacy=0x7effb80b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 --2- 172.21.15.60:0/2030724171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb80b7450 0x7effa4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 --2- 172.21.15.60:0/2030724171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa40040d0 0x7effa4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 --2- 172.21.15.60:0/2030724171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effa4004d40 0x7effa40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7effb815ec70 con 0x7effa40040d0 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7effa400baa0 con 0x7effa4004d40 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7effa400bca0 con 0x7effb80b7450 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb67fc640 1 --2- 172.21.15.60:0/2030724171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa40040d0 0x7effa4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb6ffd640 1 --2- 172.21.15.60:0/2030724171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb80b7450 0x7effa4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb77fe640 1 --2- 172.21.15.60:0/2030724171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effa4004d40 0x7effa40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb67fc640 1 -- 172.21.15.60:0/2030724171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb80b7450 msgr2=0x7effa4003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb67fc640 1 --2- 172.21.15.60:0/2030724171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb80b7450 0x7effa4003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:17.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb67fc640 1 -- 172.21.15.60:0/2030724171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effa4004d40 msgr2=0x7effa40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:17.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb67fc640 1 --2- 172.21.15.60:0/2030724171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effa4004d40 0x7effa40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:17.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.812+0000 7effb67fc640 1 -- 172.21.15.60:0/2030724171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa4003520 con 0x7effa40040d0 2024-09-12T01:42:17.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.813+0000 7effb67fc640 1 --2- 172.21.15.60:0/2030724171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa40040d0 0x7effa4004800 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7effa00018a0 tx=0x7effa4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3659df353333a104 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.813+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa00014f0 con 0x7effa40040d0 2024-09-12T01:42:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.813+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa00052d0 con 0x7effa40040d0 2024-09-12T01:42:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.813+0000 7effb5ffb640 1 -- 172.21.15.60:0/2030724171 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa002ac60 con 0x7effa40040d0 2024-09-12T01:42:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.814+0000 7effbda5c640 1 -- 172.21.15.60:0/2030724171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa40040d0 msgr2=0x7effa4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.814+0000 7effbda5c640 1 --2- 172.21.15.60:0/2030724171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa40040d0 0x7effa4004800 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7effa00018a0 tx=0x7effa4005830 comp rx=0 tx=0).stop 2024-09-12T01:42:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.814+0000 7effb77fe640 1 -- 172.21.15.60:0/2030724171 reap_dead start 2024-09-12T01:42:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.814+0000 7effbda5c640 1 -- 172.21.15.60:0/2030724171 shutdown_connections 2024-09-12T01:42:17.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.814+0000 7effbda5c640 1 -- 172.21.15.60:0/2030724171 >> 172.21.15.60:0/2030724171 conn(0x7effb80d2430 msgr2=0x7effb80d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.814+0000 7effbda5c640 1 -- 172.21.15.60:0/2030724171 shutdown_connections 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.814+0000 7effbda5c640 1 -- 172.21.15.60:0/2030724171 wait complete. 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.815+0000 7effbda5c640 1 Processor -- start 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.815+0000 7effbda5c640 1 -- start start 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.816+0000 7effbda5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa40040d0 0x7effb814cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.816+0000 7effbda5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb8155860 0x7effb8155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.816+0000 7effbda5c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effb814ef00 0x7effb814f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.816+0000 7effbda5c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7effb806e730 con 0x7effa40040d0 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.816+0000 7effbda5c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7effb806e5b0 con 0x7effb814ef00 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.816+0000 7effbda5c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7effb806fd00 con 0x7effb8155860 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.816+0000 7effb6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa40040d0 0x7effb814cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.816+0000 7effb6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa40040d0 0x7effb814cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53482/0 (socket says 172.21.15.60:53482) 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.816+0000 7effb6ffd640 1 -- 172.21.15.60:0/2686246031 learned_addr learned my addr 172.21.15.60:0/2686246031 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.816+0000 7effb67fc640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb8155860 0x7effb8155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:17.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.816+0000 7effb77fe640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effb814ef00 0x7effb814f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:17.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.817+0000 7effb6ffd640 1 -- 172.21.15.60:0/2686246031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb8155860 msgr2=0x7effb8155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:17.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.817+0000 7effb6ffd640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb8155860 0x7effb8155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:17.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.817+0000 7effb6ffd640 1 -- 172.21.15.60:0/2686246031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effb814ef00 msgr2=0x7effb814f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:17.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.817+0000 7effb6ffd640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effb814ef00 0x7effb814f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:17.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.817+0000 7effb6ffd640 1 -- 172.21.15.60:0/2686246031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb8156630 con 0x7effa40040d0 2024-09-12T01:42:17.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.817+0000 7effb67fc640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb8155860 0x7effb8155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:17.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.817+0000 7effb6ffd640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa40040d0 0x7effb814cee0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7effa8007a50 tx=0x7effa800a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:17.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.817+0000 7effaffff640 1 -- 172.21.15.60:0/2686246031 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa8017020 con 0x7effa40040d0 2024-09-12T01:42:17.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.817+0000 7effaffff640 1 -- 172.21.15.60:0/2686246031 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa80133f0 con 0x7effa40040d0 2024-09-12T01:42:17.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.817+0000 7effaffff640 1 -- 172.21.15.60:0/2686246031 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effa80137c0 con 0x7effa40040d0 2024-09-12T01:42:17.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.817+0000 7effbda5c640 1 -- 172.21.15.60:0/2686246031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb8156910 con 0x7effa40040d0 2024-09-12T01:42:17.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.817+0000 7effbda5c640 1 -- 172.21.15.60:0/2686246031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb814e4e0 con 0x7effa40040d0 2024-09-12T01:42:17.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.818+0000 7effbda5c640 1 -- 172.21.15.60:0/2686246031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb806c6c0 con 0x7effa40040d0 2024-09-12T01:42:17.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.818+0000 7effaffff640 1 -- 172.21.15.60:0/2686246031 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7effa801a020 con 0x7effa40040d0 2024-09-12T01:42:17.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.819+0000 7effaffff640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff9806be30 0x7eff9806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:17.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.819+0000 7effaffff640 1 -- 172.21.15.60:0/2686246031 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7effa808b730 con 0x7effa40040d0 2024-09-12T01:42:17.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.819+0000 7effb67fc640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff9806be30 0x7eff9806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:17.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.819+0000 7effb67fc640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff9806be30 0x7eff9806e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7effa0032000 tx=0x7effa0009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:17.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.823+0000 7effaffff640 1 -- 172.21.15.60:0/2686246031 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7effa8021020 con 0x7effa40040d0 2024-09-12T01:42:17.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:17.999+0000 7effbda5c640 1 -- 172.21.15.60:0/2686246031 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7effb815f750 con 0x7effa40040d0 2024-09-12T01:42:18.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.002+0000 7effaffff640 1 -- 172.21.15.60:0/2686246031 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v35) ==== 104+0+0 (secure 0 0 0) 0x7effa805a3e0 con 0x7effa40040d0 2024-09-12T01:42:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.004+0000 7effbda5c640 1 -- 172.21.15.60:0/2686246031 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff9806be30 msgr2=0x7eff9806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.004+0000 7effbda5c640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff9806be30 0x7eff9806e2f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7effa0032000 tx=0x7effa0009030 comp rx=0 tx=0).stop 2024-09-12T01:42:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.004+0000 7effbda5c640 1 -- 172.21.15.60:0/2686246031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa40040d0 msgr2=0x7effb814cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.004+0000 7effbda5c640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa40040d0 0x7effb814cee0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7effa8007a50 tx=0x7effa800a6a0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.004+0000 7effbda5c640 1 -- 172.21.15.60:0/2686246031 shutdown_connections 2024-09-12T01:42:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.004+0000 7effbda5c640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7effb814ef00 0x7effb814f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.004+0000 7effbda5c640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff9806be30 0x7eff9806e2f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.004+0000 7effbda5c640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7effb8155860 0x7effb8155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.004+0000 7effbda5c640 1 --2- 172.21.15.60:0/2686246031 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effa40040d0 0x7effb814cee0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.004+0000 7effbda5c640 1 -- 172.21.15.60:0/2686246031 >> 172.21.15.60:0/2686246031 conn(0x7effb80d2430 msgr2=0x7effb815ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.004+0000 7effbda5c640 1 -- 172.21.15.60:0/2686246031 shutdown_connections 2024-09-12T01:42:18.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.005+0000 7effbda5c640 1 -- 172.21.15.60:0/2686246031 wait complete. 2024-09-12T01:42:18.015 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid' 2024-09-12T01:42:18.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.119+0000 7ff2162e6640 1 Processor -- start 2024-09-12T01:42:18.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.119+0000 7ff2162e6640 1 -- start start 2024-09-12T01:42:18.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.120+0000 7ff2162e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2100d3310 0x7ff2100d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:18.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.120+0000 7ff2162e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff2100d1650 0x7ff2100b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:18.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.120+0000 7ff2162e6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff21015ea40 con 0x7ff21015e660 2024-09-12T01:42:18.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.120+0000 7ff2162e6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff2100d1ac0 con 0x7ff2100d1650 2024-09-12T01:42:18.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.120+0000 7ff2162e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff2100d3870 con 0x7ff2100d3310 2024-09-12T01:42:18.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.121+0000 7ff214883640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff2100d1650 0x7ff2100b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:18.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.121+0000 7ff20ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff21015e660 0x7ff2100cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49778/0 (socket says 172.21.15.60:49778) 2024-09-12T01:42:18.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.121+0000 7ff20ffff640 1 -- 172.21.15.60:0/517782208 learned_addr learned my addr 172.21.15.60:0/517782208 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:18.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.121+0000 7ff20f7fe640 1 --2- 172.21.15.60:0/517782208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2100d3310 0x7ff2100d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:18.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.121+0000 7ff214883640 1 -- 172.21.15.60:0/517782208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2100d3310 msgr2=0x7ff2100d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:18.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.121+0000 7ff214883640 1 --2- 172.21.15.60:0/517782208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2100d3310 0x7ff2100d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.121+0000 7ff214883640 1 -- 172.21.15.60:0/517782208 >> v1:172.21.15.60:6789/0 conn(0x7ff21015e660 legacy=0x7ff2100cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.121+0000 7ff214883640 1 -- 172.21.15.60:0/517782208 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2100d3b50 con 0x7ff2100d1650 2024-09-12T01:42:18.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.121+0000 7ff20effd640 1 -- 172.21.15.60:0/517782208 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2570269316 0 0) 0x7ff21015ea40 con 0x7ff21015e660 2024-09-12T01:42:18.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.122+0000 7ff214883640 1 --2- 172.21.15.60:0/517782208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2100d1650 0x7ff2100b7b70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff208009d90 tx=0x7ff20802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a332fda8c48d40cc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:18.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.122+0000 7ff20effd640 1 -- 172.21.15.60:0/517782208 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208007740 con 0x7ff2100d1650 2024-09-12T01:42:18.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.122+0000 7ff20effd640 1 -- 172.21.15.60:0/517782208 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2080078e0 con 0x7ff2100d1650 2024-09-12T01:42:18.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.122+0000 7ff20effd640 1 -- 172.21.15.60:0/517782208 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208007cb0 con 0x7ff2100d1650 2024-09-12T01:42:18.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.122+0000 7ff2162e6640 1 -- 172.21.15.60:0/517782208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2100d1650 msgr2=0x7ff2100b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.122+0000 7ff2162e6640 1 --2- 172.21.15.60:0/517782208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2100d1650 0x7ff2100b7b70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff208009d90 tx=0x7ff20802a660 comp rx=0 tx=0).stop 2024-09-12T01:42:18.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.122+0000 7ff2162e6640 1 -- 172.21.15.60:0/517782208 shutdown_connections 2024-09-12T01:42:18.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.122+0000 7ff2162e6640 1 --2- 172.21.15.60:0/517782208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2100d1650 0x7ff2100b7b70 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.122+0000 7ff2162e6640 1 --2- 172.21.15.60:0/517782208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff2100d3310 0x7ff2100d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.122+0000 7ff2162e6640 1 -- 172.21.15.60:0/517782208 >> 172.21.15.60:0/517782208 conn(0x7ff2100b6410 msgr2=0x7ff2100b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:18.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.122+0000 7ff2162e6640 1 -- 172.21.15.60:0/517782208 shutdown_connections 2024-09-12T01:42:18.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.122+0000 7ff2162e6640 1 -- 172.21.15.60:0/517782208 wait complete. 2024-09-12T01:42:18.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.123+0000 7ff2162e6640 1 Processor -- start 2024-09-12T01:42:18.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.124+0000 7ff2162e6640 1 -- start start 2024-09-12T01:42:18.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.124+0000 7ff2162e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2100d1650 0x7ff21015edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:18.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.124+0000 7ff2162e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2100d3310 0x7ff21015f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:18.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.124+0000 7ff2162e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff21015e660 0x7ff2100c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.124+0000 7ff2162e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff2100d43f0 con 0x7ff2100d3310 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.124+0000 7ff2162e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff2100d4110 con 0x7ff2100d1650 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.124+0000 7ff2162e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff2100b80b0 con 0x7ff21015e660 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2100d3310 0x7ff21015f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2100d3310 0x7ff21015f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53500/0 (socket says 172.21.15.60:53500) 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20f7fe640 1 -- 172.21.15.60:0/2892854588 learned_addr learned my addr 172.21.15.60:0/2892854588 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20f7fe640 1 -- 172.21.15.60:0/2892854588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff21015e660 msgr2=0x7ff2100c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff214883640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff21015e660 0x7ff2100c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20ffff640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2100d1650 0x7ff21015edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20f7fe640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff21015e660 0x7ff2100c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20f7fe640 1 -- 172.21.15.60:0/2892854588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2100d1650 msgr2=0x7ff21015edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20f7fe640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2100d1650 0x7ff21015edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20f7fe640 1 -- 172.21.15.60:0/2892854588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21015f830 con 0x7ff2100d3310 2024-09-12T01:42:18.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20f7fe640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2100d3310 0x7ff21015f2f0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff20400e9b0 tx=0x7ff20400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:18.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20cff9640 1 -- 172.21.15.60:0/2892854588 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff204017070 con 0x7ff2100d3310 2024-09-12T01:42:18.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20cff9640 1 -- 172.21.15.60:0/2892854588 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20400c9a0 con 0x7ff2100d3310 2024-09-12T01:42:18.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff20cff9640 1 -- 172.21.15.60:0/2892854588 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20400cd90 con 0x7ff2100d3310 2024-09-12T01:42:18.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff2162e6640 1 -- 172.21.15.60:0/2892854588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff21015fb40 con 0x7ff2100d3310 2024-09-12T01:42:18.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.125+0000 7ff2162e6640 1 -- 172.21.15.60:0/2892854588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff210160380 con 0x7ff2100d3310 2024-09-12T01:42:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.126+0000 7ff2162e6640 1 -- 172.21.15.60:0/2892854588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2100b7b70 con 0x7ff2100d3310 2024-09-12T01:42:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.127+0000 7ff20cff9640 1 -- 172.21.15.60:0/2892854588 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff20401a070 con 0x7ff2100d3310 2024-09-12T01:42:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.127+0000 7ff20cff9640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1fc06be30 0x7ff1fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.127+0000 7ff20cff9640 1 -- 172.21.15.60:0/2892854588 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7ff20408ab90 con 0x7ff2100d3310 2024-09-12T01:42:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.127+0000 7ff20ffff640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1fc06be30 0x7ff1fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.128+0000 7ff20ffff640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1fc06be30 0x7ff1fc06e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff200000f60 tx=0x7ff200009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:18.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.132+0000 7ff20cff9640 1 -- 172.21.15.60:0/2892854588 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff21015fb40 con 0x7ff2100d3310 2024-09-12T01:42:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.377+0000 7ff2162e6640 1 -- 172.21.15.60:0/2892854588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]} v 0) -- 0x7ff2100d4f80 con 0x7ff2100d3310 2024-09-12T01:42:18.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.677+0000 7ff20cff9640 1 -- 172.21.15.60:0/2892854588 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_oldest_tid"]}]=0 v316) ==== 150+0+0 (secure 0 0 0) 0x7ff204059840 con 0x7ff2100d3310 2024-09-12T01:42:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.679+0000 7ff2162e6640 1 -- 172.21.15.60:0/2892854588 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1fc06be30 msgr2=0x7ff1fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.679+0000 7ff2162e6640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1fc06be30 0x7ff1fc06e2f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff200000f60 tx=0x7ff200009040 comp rx=0 tx=0).stop 2024-09-12T01:42:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.679+0000 7ff2162e6640 1 -- 172.21.15.60:0/2892854588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2100d3310 msgr2=0x7ff21015f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.679+0000 7ff2162e6640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2100d3310 0x7ff21015f2f0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff20400e9b0 tx=0x7ff20400ee70 comp rx=0 tx=0).stop 2024-09-12T01:42:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.679+0000 7ff2162e6640 1 -- 172.21.15.60:0/2892854588 shutdown_connections 2024-09-12T01:42:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.679+0000 7ff2162e6640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff1fc06be30 0x7ff1fc06e2f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.679+0000 7ff2162e6640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff21015e660 0x7ff2100c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.679+0000 7ff2162e6640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2100d3310 0x7ff21015f2f0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.679+0000 7ff2162e6640 1 --2- 172.21.15.60:0/2892854588 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff2100d1650 0x7ff21015edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.679+0000 7ff2162e6640 1 -- 172.21.15.60:0/2892854588 >> 172.21.15.60:0/2892854588 conn(0x7ff2100b6410 msgr2=0x7ff2100b52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:18.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.679+0000 7ff2162e6640 1 -- 172.21.15.60:0/2892854588 shutdown_connections 2024-09-12T01:42:18.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.679+0000 7ff2162e6640 1 -- 172.21.15.60:0/2892854588 wait complete. 2024-09-12T01:42:18.690 INFO:tasks.cephfs_test_runner:When a client does not advance its oldest tid, the MDS should notice that ... skipped 'Require FUSE client to inject client release failure' 2024-09-12T01:42:18.690 INFO:tasks.cephfs_test_runner:Starting test: test_client_pin (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-12T01:42:18.691 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:42:18.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.794+0000 7f7160c42640 1 Processor -- start 2024-09-12T01:42:18.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.794+0000 7f7160c42640 1 -- start start 2024-09-12T01:42:18.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.795+0000 7f7160c42640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f715c15c4d0 0x7f715c15fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:18.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.795+0000 7f7160c42640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f715c071240 0x7f715c160430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:18.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.795+0000 7f7160c42640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715c0716d0 con 0x7f715c0b1a90 2024-09-12T01:42:18.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.795+0000 7f7160c42640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f715c0719b0 con 0x7f715c071240 2024-09-12T01:42:18.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.795+0000 7f7160c42640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f715c0d0590 con 0x7f715c15c4d0 2024-09-12T01:42:18.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.795+0000 7f7159d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f715c071240 0x7f715c160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:18.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.795+0000 7f7159d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f715c071240 0x7f715c160430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53516/0 (socket says 172.21.15.60:53516) 2024-09-12T01:42:18.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.795+0000 7f7159d9b640 1 -- 172.21.15.60:0/4115399289 learned_addr learned my addr 172.21.15.60:0/4115399289 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.796+0000 7f715a59c640 1 --2- 172.21.15.60:0/4115399289 >> v2:172.21.15.105:3300/0 conn(0x7f715c15c4d0 0x7f715c15fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.796+0000 7f7159d9b640 1 -- 172.21.15.60:0/4115399289 >> v2:172.21.15.105:3300/0 conn(0x7f715c15c4d0 msgr2=0x7f715c15fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.796+0000 7f7159d9b640 1 --2- 172.21.15.60:0/4115399289 >> v2:172.21.15.105:3300/0 conn(0x7f715c15c4d0 0x7f715c15fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.796+0000 7f7159d9b640 1 -- 172.21.15.60:0/4115399289 >> v1:172.21.15.105:6789/0 conn(0x7f715c0b1a90 legacy=0x7f715c06f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.796+0000 7f7159d9b640 1 -- 172.21.15.60:0/4115399289 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c0d0870 con 0x7f715c071240 2024-09-12T01:42:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.796+0000 7f7159d9b640 1 --2- 172.21.15.60:0/4115399289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f715c071240 0x7f715c160430 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f715c0509d0 tx=0x7f714402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb46f8c1f3fa3f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.797+0000 7f715959a640 1 -- 172.21.15.60:0/4115399289 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144037070 con 0x7f715c071240 2024-09-12T01:42:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.797+0000 7f715959a640 1 -- 172.21.15.60:0/4115399289 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7144032440 con 0x7f715c071240 2024-09-12T01:42:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.797+0000 7f715959a640 1 -- 172.21.15.60:0/4115399289 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144032810 con 0x7f715c071240 2024-09-12T01:42:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.797+0000 7f7160c42640 1 -- 172.21.15.60:0/4115399289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f715c071240 msgr2=0x7f715c160430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.797+0000 7f7160c42640 1 --2- 172.21.15.60:0/4115399289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f715c071240 0x7f715c160430 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f715c0509d0 tx=0x7f714402a270 comp rx=0 tx=0).stop 2024-09-12T01:42:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.797+0000 7f7160c42640 1 -- 172.21.15.60:0/4115399289 shutdown_connections 2024-09-12T01:42:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.797+0000 7f7160c42640 1 --2- 172.21.15.60:0/4115399289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f715c071240 0x7f715c160430 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.797+0000 7f7160c42640 1 --2- 172.21.15.60:0/4115399289 >> v2:172.21.15.105:3300/0 conn(0x7f715c15c4d0 0x7f715c15fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.797+0000 7f7160c42640 1 -- 172.21.15.60:0/4115399289 >> 172.21.15.60:0/4115399289 conn(0x7f715c0d2450 msgr2=0x7f715c0d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.797+0000 7f7160c42640 1 -- 172.21.15.60:0/4115399289 shutdown_connections 2024-09-12T01:42:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.797+0000 7f7160c42640 1 -- 172.21.15.60:0/4115399289 wait complete. 2024-09-12T01:42:18.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.799+0000 7f7160c42640 1 Processor -- start 2024-09-12T01:42:18.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.799+0000 7f7160c42640 1 -- start start 2024-09-12T01:42:18.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.799+0000 7f7160c42640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f715c0b1a90 0x7f715c150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:18.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.799+0000 7f7160c42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f715c15c4d0 0x7f715c1549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:18.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.799+0000 7f7160c42640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f715c154f20 0x7f715c15a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:18.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.799+0000 7f7160c42640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f715c0b55e0 con 0x7f715c15c4d0 2024-09-12T01:42:18.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.799+0000 7f7160c42640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f715c0b5460 con 0x7f715c0b1a90 2024-09-12T01:42:18.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.799+0000 7f7160c42640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f715c160970 con 0x7f715c154f20 2024-09-12T01:42:18.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.799+0000 7f7159d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f715c15c4d0 0x7f715c1549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:18.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.799+0000 7f715a59c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f715c0b1a90 0x7f715c150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:18.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7159d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f715c15c4d0 0x7f715c1549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53528/0 (socket says 172.21.15.60:53528) 2024-09-12T01:42:18.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7159d9b640 1 -- 172.21.15.60:0/3273322593 learned_addr learned my addr 172.21.15.60:0/3273322593 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:18.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f715ad9d640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f715c154f20 0x7f715c15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:18.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7159d9b640 1 -- 172.21.15.60:0/3273322593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f715c154f20 msgr2=0x7f715c15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7159d9b640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f715c154f20 0x7f715c15a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7159d9b640 1 -- 172.21.15.60:0/3273322593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f715c0b1a90 msgr2=0x7f715c150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7159d9b640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f715c0b1a90 0x7f715c150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7159d9b640 1 -- 172.21.15.60:0/3273322593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c150c60 con 0x7f715c15c4d0 2024-09-12T01:42:18.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7159d9b640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f715c15c4d0 0x7f715c1549e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f714402a2b0 tx=0x7f71440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:18.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7152ffd640 1 -- 172.21.15.60:0/3273322593 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144041020 con 0x7f715c15c4d0 2024-09-12T01:42:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7152ffd640 1 -- 172.21.15.60:0/3273322593 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71440306c0 con 0x7f715c15c4d0 2024-09-12T01:42:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7160c42640 1 -- 172.21.15.60:0/3273322593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715c150f40 con 0x7f715c15c4d0 2024-09-12T01:42:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7152ffd640 1 -- 172.21.15.60:0/3273322593 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144037040 con 0x7f715c15c4d0 2024-09-12T01:42:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.800+0000 7f7160c42640 1 -- 172.21.15.60:0/3273322593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715c153210 con 0x7f715c15c4d0 2024-09-12T01:42:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.801+0000 7f7160c42640 1 -- 172.21.15.60:0/3273322593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f715c0d10e0 con 0x7f715c15c4d0 2024-09-12T01:42:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.802+0000 7f7152ffd640 1 -- 172.21.15.60:0/3273322593 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7144044020 con 0x7f715c15c4d0 2024-09-12T01:42:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.802+0000 7f7152ffd640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f713c06be30 0x7f713c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.802+0000 7f7152ffd640 1 -- 172.21.15.60:0/3273322593 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7f71440ab1e0 con 0x7f715c15c4d0 2024-09-12T01:42:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.802+0000 7f715a59c640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f713c06be30 0x7f713c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:18.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.803+0000 7f715a59c640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f713c06be30 0x7f713c06e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f715c14fc60 tx=0x7f7154008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:18.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.807+0000 7f7152ffd640 1 -- 172.21.15.60:0/3273322593 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f714404b030 con 0x7f715c15c4d0 2024-09-12T01:42:18.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.982+0000 7f7160c42640 1 -- 172.21.15.60:0/3273322593 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f715c153450 con 0x7f715c15c4d0 2024-09-12T01:42:18.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.983+0000 7f7152ffd640 1 -- 172.21.15.60:0/3273322593 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+12997 (secure 0 0 0) 0x7f71440798d0 con 0x7f715c15c4d0 2024-09-12T01:42:18.983 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:18.983 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":95,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:42:17.671283+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/829908705":"2024-09-13T01:42:14.666397+0000","172.21.15.105:6833/829908705":"2024-09-13T01:42:14.666397+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:42:18.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.985+0000 7f7160c42640 1 -- 172.21.15.60:0/3273322593 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f713c06be30 msgr2=0x7f713c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.985+0000 7f7160c42640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f713c06be30 0x7f713c06e2f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f715c14fc60 tx=0x7f7154008040 comp rx=0 tx=0).stop 2024-09-12T01:42:18.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.985+0000 7f7160c42640 1 -- 172.21.15.60:0/3273322593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f715c15c4d0 msgr2=0x7f715c1549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:18.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.985+0000 7f7160c42640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f715c15c4d0 0x7f715c1549e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f714402a2b0 tx=0x7f71440046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.985+0000 7f7160c42640 1 -- 172.21.15.60:0/3273322593 shutdown_connections 2024-09-12T01:42:18.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.985+0000 7f7160c42640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f713c06be30 0x7f713c06e2f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.985+0000 7f7160c42640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f715c154f20 0x7f715c15a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.985+0000 7f7160c42640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f715c15c4d0 0x7f715c1549e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.985+0000 7f7160c42640 1 --2- 172.21.15.60:0/3273322593 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f715c0b1a90 0x7f715c150410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:18.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.985+0000 7f7160c42640 1 -- 172.21.15.60:0/3273322593 >> 172.21.15.60:0/3273322593 conn(0x7f715c0d2450 msgr2=0x7f715c0b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:18.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.985+0000 7f7160c42640 1 -- 172.21.15.60:0/3273322593 shutdown_connections 2024-09-12T01:42:18.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:18.985+0000 7f7160c42640 1 -- 172.21.15.60:0/3273322593 wait complete. 2024-09-12T01:42:18.996 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:35:46.304939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:42:18.996 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:42:19.014 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:42:19.042 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:42:19.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.103+0000 7fcd60d8d640 1 Processor -- start 2024-09-12T01:42:19.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.103+0000 7fcd60d8d640 1 -- start start 2024-09-12T01:42:19.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.104+0000 7fcd60d8d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcd5c0730d0 0x7fcd5c06fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.104+0000 7fcd60d8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c0ae890 0x7fcd5c0aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.104+0000 7fcd60d8d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd5c0717c0 con 0x7fcd5c15f780 2024-09-12T01:42:19.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.104+0000 7fcd60d8d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcd5c071aa0 con 0x7fcd5c0730d0 2024-09-12T01:42:19.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.104+0000 7fcd60d8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcd5c071d80 con 0x7fcd5c0ae890 2024-09-12T01:42:19.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd59d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcd5c15f780 0x7fcd5c0734b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49788/0 (socket says 172.21.15.60:49788) 2024-09-12T01:42:19.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd59d9b640 1 -- 172.21.15.60:0/2878629971 learned_addr learned my addr 172.21.15.60:0/2878629971 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:19.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5a59c640 1 --2- 172.21.15.60:0/2878629971 >> v2:172.21.15.105:3300/0 conn(0x7fcd5c0730d0 0x7fcd5c06fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1527064567 0 0) 0x7fcd5c0717c0 con 0x7fcd5c15f780 2024-09-12T01:42:19.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5ad9d640 1 --2- 172.21.15.60:0/2878629971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c0ae890 0x7fcd5c0aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd48003520 con 0x7fcd5c15f780 2024-09-12T01:42:19.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1278443843 0 0) 0x7fcd48003520 con 0x7fcd5c15f780 2024-09-12T01:42:19.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c0ae890 msgr2=0x7fcd5c0aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:19.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 --2- 172.21.15.60:0/2878629971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c0ae890 0x7fcd5c0aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 >> v2:172.21.15.105:3300/0 conn(0x7fcd5c0730d0 msgr2=0x7fcd5c06fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:19.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 --2- 172.21.15.60:0/2878629971 >> v2:172.21.15.105:3300/0 conn(0x7fcd5c0730d0 0x7fcd5c06fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5c072060 con 0x7fcd5c15f780 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fcd44001690 con 0x7fcd5c15f780 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 >> v1:172.21.15.60:6789/0 conn(0x7fcd5c15f780 legacy=0x7fcd5c0734b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 --2- 172.21.15.60:0/2878629971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd480039b0 0x7fcd48003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 --2- 172.21.15.60:0/2878629971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd48004800 0x7fcd48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 --2- 172.21.15.60:0/2878629971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c0ae890 0x7fcd480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c071aa0 con 0x7fcd480039b0 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c071d80 con 0x7fcd48004800 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4800b9c0 con 0x7fcd5c0ae890 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5a59c640 1 --2- 172.21.15.60:0/2878629971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd480039b0 0x7fcd48003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd59d9b640 1 --2- 172.21.15.60:0/2878629971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd48004800 0x7fcd48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.105+0000 7fcd5ad9d640 1 --2- 172.21.15.60:0/2878629971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c0ae890 0x7fcd480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.109 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.106+0000 7fcd5a59c640 1 -- 172.21.15.60:0/2878629971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c0ae890 msgr2=0x7fcd480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.106+0000 7fcd5a59c640 1 --2- 172.21.15.60:0/2878629971 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c0ae890 0x7fcd480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.106+0000 7fcd5a59c640 1 -- 172.21.15.60:0/2878629971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd48004800 msgr2=0x7fcd48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.106+0000 7fcd5a59c640 1 --2- 172.21.15.60:0/2878629971 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd48004800 0x7fcd48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.106+0000 7fcd5a59c640 1 -- 172.21.15.60:0/2878629971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd48003520 con 0x7fcd480039b0 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.106+0000 7fcd5a59c640 1 --2- 172.21.15.60:0/2878629971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd480039b0 0x7fcd48003dd0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009ac0 tx=0x7fcd48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6f5e17bf5a4a71 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.107+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54036070 con 0x7fcd480039b0 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.107+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd54031400 con 0x7fcd480039b0 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.107+0000 7fcd5959a640 1 -- 172.21.15.60:0/2878629971 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54009690 con 0x7fcd480039b0 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.107+0000 7fcd60d8d640 1 -- 172.21.15.60:0/2878629971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd480039b0 msgr2=0x7fcd48003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.107+0000 7fcd60d8d640 1 --2- 172.21.15.60:0/2878629971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd480039b0 0x7fcd48003dd0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009ac0 tx=0x7fcd48005830 comp rx=0 tx=0).stop 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.107+0000 7fcd5ad9d640 1 -- 172.21.15.60:0/2878629971 reap_dead start 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.107+0000 7fcd60d8d640 1 -- 172.21.15.60:0/2878629971 shutdown_connections 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.107+0000 7fcd60d8d640 1 -- 172.21.15.60:0/2878629971 >> 172.21.15.60:0/2878629971 conn(0x7fcd5c0b0aa0 msgr2=0x7fcd5c0b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:19.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.107+0000 7fcd60d8d640 1 -- 172.21.15.60:0/2878629971 shutdown_connections 2024-09-12T01:42:19.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.107+0000 7fcd60d8d640 1 -- 172.21.15.60:0/2878629971 wait complete. 2024-09-12T01:42:19.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.108+0000 7fcd60d8d640 1 Processor -- start 2024-09-12T01:42:19.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.109+0000 7fcd60d8d640 1 -- start start 2024-09-12T01:42:19.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.109+0000 7fcd60d8d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd480039b0 0x7fcd5c14d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.109+0000 7fcd60d8d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c14e3f0 0x7fcd5c06efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.109+0000 7fcd60d8d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd5c14dea0 0x7fcd5c06f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.109+0000 7fcd60d8d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c15fc10 con 0x7fcd480039b0 2024-09-12T01:42:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.109+0000 7fcd60d8d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcd5c159170 con 0x7fcd5c14dea0 2024-09-12T01:42:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.109+0000 7fcd60d8d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcd5c072860 con 0x7fcd5c14e3f0 2024-09-12T01:42:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.109+0000 7fcd5a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd480039b0 0x7fcd5c14d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.109+0000 7fcd5a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd480039b0 0x7fcd5c14d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53532/0 (socket says 172.21.15.60:53532) 2024-09-12T01:42:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.109+0000 7fcd5a59c640 1 -- 172.21.15.60:0/3067673747 learned_addr learned my addr 172.21.15.60:0/3067673747 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.109+0000 7fcd59d9b640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c14e3f0 0x7fcd5c06efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.109+0000 7fcd5ad9d640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd5c14dea0 0x7fcd5c06f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.110+0000 7fcd5a59c640 1 -- 172.21.15.60:0/3067673747 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c14e3f0 msgr2=0x7fcd5c06efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.110+0000 7fcd5a59c640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c14e3f0 0x7fcd5c06efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.110+0000 7fcd5a59c640 1 -- 172.21.15.60:0/3067673747 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd5c14dea0 msgr2=0x7fcd5c06f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:19.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.110+0000 7fcd5a59c640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd5c14dea0 0x7fcd5c06f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.110+0000 7fcd5a59c640 1 -- 172.21.15.60:0/3067673747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd5c0cfc20 con 0x7fcd480039b0 2024-09-12T01:42:19.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.110+0000 7fcd5ad9d640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd5c14dea0 0x7fcd5c06f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:19.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.110+0000 7fcd5a59c640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd480039b0 0x7fcd5c14d6a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fcd54034040 tx=0x7fcd54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.110+0000 7fcd52ffd640 1 -- 172.21.15.60:0/3067673747 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54040020 con 0x7fcd480039b0 2024-09-12T01:42:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.110+0000 7fcd52ffd640 1 -- 172.21.15.60:0/3067673747 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd54003ac0 con 0x7fcd480039b0 2024-09-12T01:42:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.110+0000 7fcd60d8d640 1 -- 172.21.15.60:0/3067673747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd5c0cd9b0 con 0x7fcd480039b0 2024-09-12T01:42:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.110+0000 7fcd52ffd640 1 -- 172.21.15.60:0/3067673747 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54036040 con 0x7fcd480039b0 2024-09-12T01:42:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.110+0000 7fcd60d8d640 1 -- 172.21.15.60:0/3067673747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd5c0cdf70 con 0x7fcd480039b0 2024-09-12T01:42:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.111+0000 7fcd60d8d640 1 -- 172.21.15.60:0/3067673747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd5c06fc30 con 0x7fcd480039b0 2024-09-12T01:42:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.112+0000 7fcd52ffd640 1 -- 172.21.15.60:0/3067673747 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcd54043020 con 0x7fcd480039b0 2024-09-12T01:42:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.112+0000 7fcd52ffd640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcd3c06be30 0x7fcd3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.112+0000 7fcd52ffd640 1 -- 172.21.15.60:0/3067673747 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7fcd540aab90 con 0x7fcd480039b0 2024-09-12T01:42:19.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.112+0000 7fcd59d9b640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcd3c06be30 0x7fcd3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.113+0000 7fcd59d9b640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcd3c06be30 0x7fcd3c06e2f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c14ea80 tx=0x7fcd44007970 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:19.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.116+0000 7fcd52ffd640 1 -- 172.21.15.60:0/3067673747 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcd5404a070 con 0x7fcd480039b0 2024-09-12T01:42:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.290+0000 7fcd60d8d640 1 -- 172.21.15.60:0/3067673747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcd5c0d0af0 con 0x7fcd480039b0 2024-09-12T01:42:19.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.290+0000 7fcd52ffd640 1 -- 172.21.15.60:0/3067673747 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) ==== 93+0+10 (secure 0 0 0) 0x7fcd540044e0 con 0x7fcd480039b0 2024-09-12T01:42:19.289 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-12T01:42:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.292+0000 7fcd60d8d640 1 -- 172.21.15.60:0/3067673747 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcd3c06be30 msgr2=0x7fcd3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.292+0000 7fcd60d8d640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcd3c06be30 0x7fcd3c06e2f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c14ea80 tx=0x7fcd44007970 comp rx=0 tx=0).stop 2024-09-12T01:42:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.292+0000 7fcd60d8d640 1 -- 172.21.15.60:0/3067673747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd480039b0 msgr2=0x7fcd5c14d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.292+0000 7fcd60d8d640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd480039b0 0x7fcd5c14d6a0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fcd54034040 tx=0x7fcd54004730 comp rx=0 tx=0).stop 2024-09-12T01:42:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.292+0000 7fcd60d8d640 1 -- 172.21.15.60:0/3067673747 shutdown_connections 2024-09-12T01:42:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.292+0000 7fcd60d8d640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcd5c14dea0 0x7fcd5c06f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.292+0000 7fcd60d8d640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcd3c06be30 0x7fcd3c06e2f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.292+0000 7fcd60d8d640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcd5c14e3f0 0x7fcd5c06efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.292+0000 7fcd60d8d640 1 --2- 172.21.15.60:0/3067673747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd480039b0 0x7fcd5c14d6a0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.292+0000 7fcd60d8d640 1 -- 172.21.15.60:0/3067673747 >> 172.21.15.60:0/3067673747 conn(0x7fcd5c0b0aa0 msgr2=0x7fcd5c0b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.292+0000 7fcd60d8d640 1 -- 172.21.15.60:0/3067673747 shutdown_connections 2024-09-12T01:42:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.292+0000 7fcd60d8d640 1 -- 172.21.15.60:0/3067673747 wait complete. 2024-09-12T01:42:19.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin' 2024-09-12T01:42:19.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.446+0000 7ff53e842640 1 Processor -- start 2024-09-12T01:42:19.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.446+0000 7ff53e842640 1 -- start start 2024-09-12T01:42:19.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.446+0000 7ff53e842640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff5380b63d0 0x7ff5380d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff53e842640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5380d1c80 0x7ff5380b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff53e842640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5380cfc20 con 0x7ff5380cf6b0 2024-09-12T01:42:19.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff53e842640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff5380d2ed0 con 0x7ff5380b63d0 2024-09-12T01:42:19.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff53e842640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff5380d31b0 con 0x7ff5380d1c80 2024-09-12T01:42:19.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff5377fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff5380cf6b0 0x7ff5380b7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49802/0 (socket says 172.21.15.60:49802) 2024-09-12T01:42:19.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff5377fe640 1 -- 172.21.15.60:0/658420652 learned_addr learned my addr 172.21.15.60:0/658420652 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:19.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff53cddf640 1 --2- 172.21.15.60:0/658420652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5380d1c80 0x7ff5380b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff537fff640 1 --2- 172.21.15.60:0/658420652 >> v2:172.21.15.105:3300/0 conn(0x7ff5380b63d0 0x7ff5380d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff536ffd640 1 -- 172.21.15.60:0/658420652 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2253710146 0 0) 0x7ff5380cfc20 con 0x7ff5380cf6b0 2024-09-12T01:42:19.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff536ffd640 1 -- 172.21.15.60:0/658420652 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff520003520 con 0x7ff5380cf6b0 2024-09-12T01:42:19.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff53cddf640 1 -- 172.21.15.60:0/658420652 >> v2:172.21.15.105:3300/0 conn(0x7ff5380b63d0 msgr2=0x7ff5380d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:19.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff53cddf640 1 --2- 172.21.15.60:0/658420652 >> v2:172.21.15.105:3300/0 conn(0x7ff5380b63d0 0x7ff5380d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff53cddf640 1 -- 172.21.15.60:0/658420652 >> v1:172.21.15.60:6789/0 conn(0x7ff5380cf6b0 legacy=0x7ff5380b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:19.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.447+0000 7ff53cddf640 1 -- 172.21.15.60:0/658420652 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5380d3490 con 0x7ff5380d1c80 2024-09-12T01:42:19.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.448+0000 7ff53cddf640 1 --2- 172.21.15.60:0/658420652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5380d1c80 0x7ff5380b7f90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff530009d90 tx=0x7ff53002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ada7fef92a1ed85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:19.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.448+0000 7ff536ffd640 1 -- 172.21.15.60:0/658420652 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530031600 con 0x7ff5380d1c80 2024-09-12T01:42:19.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.448+0000 7ff536ffd640 1 -- 172.21.15.60:0/658420652 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5300317a0 con 0x7ff5380d1c80 2024-09-12T01:42:19.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.448+0000 7ff536ffd640 1 -- 172.21.15.60:0/658420652 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530031b50 con 0x7ff5380d1c80 2024-09-12T01:42:19.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.449+0000 7ff53e842640 1 -- 172.21.15.60:0/658420652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5380d1c80 msgr2=0x7ff5380b7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:19.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.449+0000 7ff53e842640 1 --2- 172.21.15.60:0/658420652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5380d1c80 0x7ff5380b7f90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff530009d90 tx=0x7ff53002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.449+0000 7ff53e842640 1 -- 172.21.15.60:0/658420652 shutdown_connections 2024-09-12T01:42:19.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.449+0000 7ff53e842640 1 --2- 172.21.15.60:0/658420652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5380d1c80 0x7ff5380b7f90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.449+0000 7ff53e842640 1 --2- 172.21.15.60:0/658420652 >> v2:172.21.15.105:3300/0 conn(0x7ff5380b63d0 0x7ff5380d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.449+0000 7ff53e842640 1 -- 172.21.15.60:0/658420652 >> 172.21.15.60:0/658420652 conn(0x7ff5380d1160 msgr2=0x7ff5380d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:19.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.449+0000 7ff53e842640 1 -- 172.21.15.60:0/658420652 shutdown_connections 2024-09-12T01:42:19.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.449+0000 7ff53e842640 1 -- 172.21.15.60:0/658420652 wait complete. 2024-09-12T01:42:19.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.450+0000 7ff53e842640 1 Processor -- start 2024-09-12T01:42:19.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.450+0000 7ff53e842640 1 -- start start 2024-09-12T01:42:19.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff53e842640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5380b63d0 0x7ff5381f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff53e842640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380cf6b0 0x7ff5380cea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff53e842640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5380d1c80 0x7ff5380cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff53e842640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff5380d4070 con 0x7ff5380cf6b0 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff53e842640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff5380d3ef0 con 0x7ff5380b63d0 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff53e842640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff5380b67b0 con 0x7ff5380d1c80 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff5377fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380cf6b0 0x7ff5380cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff5377fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380cf6b0 0x7ff5380cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53540/0 (socket says 172.21.15.60:53540) 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff5377fe640 1 -- 172.21.15.60:0/3446897219 learned_addr learned my addr 172.21.15.60:0/3446897219 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff53cddf640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5380d1c80 0x7ff5380cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff537fff640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5380b63d0 0x7ff5381f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff5377fe640 1 -- 172.21.15.60:0/3446897219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5380d1c80 msgr2=0x7ff5380cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff5377fe640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5380d1c80 0x7ff5380cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff5377fe640 1 -- 172.21.15.60:0/3446897219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5380b63d0 msgr2=0x7ff5381f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.451+0000 7ff5377fe640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5380b63d0 0x7ff5381f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.452+0000 7ff5377fe640 1 -- 172.21.15.60:0/3446897219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5380cb7b0 con 0x7ff5380cf6b0 2024-09-12T01:42:19.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.452+0000 7ff5377fe640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380cf6b0 0x7ff5380cea40 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0010e0 tx=0x7ff52c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.452+0000 7ff534ff9640 1 -- 172.21.15.60:0/3446897219 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c017070 con 0x7ff5380cf6b0 2024-09-12T01:42:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.452+0000 7ff534ff9640 1 -- 172.21.15.60:0/3446897219 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff52c005d00 con 0x7ff5380cf6b0 2024-09-12T01:42:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.452+0000 7ff53e842640 1 -- 172.21.15.60:0/3446897219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5381f4b40 con 0x7ff5380cf6b0 2024-09-12T01:42:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.452+0000 7ff534ff9640 1 -- 172.21.15.60:0/3446897219 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0072b0 con 0x7ff5380cf6b0 2024-09-12T01:42:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.452+0000 7ff53e842640 1 -- 172.21.15.60:0/3446897219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5381f5100 con 0x7ff5380cf6b0 2024-09-12T01:42:19.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.453+0000 7ff53e842640 1 -- 172.21.15.60:0/3446897219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5380d39b0 con 0x7ff5380cf6b0 2024-09-12T01:42:19.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.453+0000 7ff534ff9640 1 -- 172.21.15.60:0/3446897219 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff52c01a070 con 0x7ff5380cf6b0 2024-09-12T01:42:19.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.454+0000 7ff534ff9640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff52406be30 0x7ff52406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:19.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.454+0000 7ff534ff9640 1 -- 172.21.15.60:0/3446897219 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7ff52c089f10 con 0x7ff5380cf6b0 2024-09-12T01:42:19.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.454+0000 7ff537fff640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff52406be30 0x7ff52406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:19.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.454+0000 7ff537fff640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff52406be30 0x7ff52406e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff528009b40 tx=0x7ff528009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:19.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.458+0000 7ff534ff9640 1 -- 172.21.15.60:0/3446897219 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff52c058580 con 0x7ff5380cf6b0 2024-09-12T01:42:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:19.701+0000 7ff53e842640 1 -- 172.21.15.60:0/3446897219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]} v 0) -- 0x7ff5380b6d00 con 0x7ff5380cf6b0 2024-09-12T01:42:20.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.685+0000 7ff534ff9640 1 -- 172.21.15.60:0/3446897219 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]}]=0 v318) ==== 146+0+0 (secure 0 0 0) 0x7ff52c05c880 con 0x7ff5380cf6b0 2024-09-12T01:42:20.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.688+0000 7ff53e842640 1 -- 172.21.15.60:0/3446897219 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff52406be30 msgr2=0x7ff52406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:20.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.688+0000 7ff53e842640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff52406be30 0x7ff52406e2f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff528009b40 tx=0x7ff528009190 comp rx=0 tx=0).stop 2024-09-12T01:42:20.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.688+0000 7ff53e842640 1 -- 172.21.15.60:0/3446897219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380cf6b0 msgr2=0x7ff5380cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:20.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.688+0000 7ff53e842640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380cf6b0 0x7ff5380cea40 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0010e0 tx=0x7ff52c00c960 comp rx=0 tx=0).stop 2024-09-12T01:42:20.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.688+0000 7ff53e842640 1 -- 172.21.15.60:0/3446897219 shutdown_connections 2024-09-12T01:42:20.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.688+0000 7ff53e842640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff52406be30 0x7ff52406e2f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:20.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.688+0000 7ff53e842640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff5380d1c80 0x7ff5380cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:20.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.688+0000 7ff53e842640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380cf6b0 0x7ff5380cea40 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:20.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.688+0000 7ff53e842640 1 --2- 172.21.15.60:0/3446897219 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff5380b63d0 0x7ff5381f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:20.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.688+0000 7ff53e842640 1 -- 172.21.15.60:0/3446897219 >> 172.21.15.60:0/3446897219 conn(0x7ff5380d1160 msgr2=0x7ff5380b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:20.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.688+0000 7ff53e842640 1 -- 172.21.15.60:0/3446897219 shutdown_connections 2024-09-12T01:42:20.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.688+0000 7ff53e842640 1 -- 172.21.15.60:0/3446897219 wait complete. 2024-09-12T01:42:20.701 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:42:20.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.815+0000 7f165456d640 1 Processor -- start 2024-09-12T01:42:20.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.815+0000 7f165456d640 1 -- start start 2024-09-12T01:42:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f165456d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f164c15e600 0x7f164c0d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f165456d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f164c0cf4c0 0x7f164c0d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f165456d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f164c0b7ad0 con 0x7f164c0d1a40 2024-09-12T01:42:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f165456d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f164c0d1e90 con 0x7f164c0cf4c0 2024-09-12T01:42:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f165456d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f164c0d2ee0 con 0x7f164c15e600 2024-09-12T01:42:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f1652b0a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f164c0cf4c0 0x7f164c0d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f1652b0a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f164c0cf4c0 0x7f164c0d3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53544/0 (socket says 172.21.15.60:53544) 2024-09-12T01:42:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f1651b08640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f164c0d1a40 0x7f164c0cedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49812/0 (socket says 172.21.15.60:49812) 2024-09-12T01:42:20.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f1652b0a640 1 -- 172.21.15.60:0/3749175195 learned_addr learned my addr 172.21.15.60:0/3749175195 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:20.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f1652309640 1 --2- 172.21.15.60:0/3749175195 >> v2:172.21.15.105:3300/0 conn(0x7f164c15e600 0x7f164c0d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:20.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f1652b0a640 1 -- 172.21.15.60:0/3749175195 >> v2:172.21.15.105:3300/0 conn(0x7f164c15e600 msgr2=0x7f164c0d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:20.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f1652b0a640 1 --2- 172.21.15.60:0/3749175195 >> v2:172.21.15.105:3300/0 conn(0x7f164c15e600 0x7f164c0d1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:20.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f1652b0a640 1 -- 172.21.15.60:0/3749175195 >> v1:172.21.15.60:6789/0 conn(0x7f164c0d1a40 legacy=0x7f164c0cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:20.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f1651307640 1 -- 172.21.15.60:0/3749175195 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 641266385 0 0) 0x7f163c001110 con 0x7f164c0d1a40 2024-09-12T01:42:20.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.816+0000 7f1652b0a640 1 -- 172.21.15.60:0/3749175195 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c0cf9e0 con 0x7f164c0cf4c0 2024-09-12T01:42:20.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.817+0000 7f1652b0a640 1 --2- 172.21.15.60:0/3749175195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0cf4c0 0x7f164c0d3370 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1644009e50 tx=0x7f164402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f4929e17baf8ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:20.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.817+0000 7f1651307640 1 -- 172.21.15.60:0/3749175195 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644036070 con 0x7f164c0cf4c0 2024-09-12T01:42:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.817+0000 7f1651307640 1 -- 172.21.15.60:0/3749175195 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1644031600 con 0x7f164c0cf4c0 2024-09-12T01:42:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.817+0000 7f1651307640 1 -- 172.21.15.60:0/3749175195 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16440319d0 con 0x7f164c0cf4c0 2024-09-12T01:42:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.818+0000 7f165456d640 1 -- 172.21.15.60:0/3749175195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0cf4c0 msgr2=0x7f164c0d3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.818+0000 7f165456d640 1 --2- 172.21.15.60:0/3749175195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0cf4c0 0x7f164c0d3370 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f1644009e50 tx=0x7f164402a760 comp rx=0 tx=0).stop 2024-09-12T01:42:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.818+0000 7f165456d640 1 -- 172.21.15.60:0/3749175195 shutdown_connections 2024-09-12T01:42:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.818+0000 7f165456d640 1 --2- 172.21.15.60:0/3749175195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0cf4c0 0x7f164c0d3370 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.818+0000 7f165456d640 1 --2- 172.21.15.60:0/3749175195 >> v2:172.21.15.105:3300/0 conn(0x7f164c15e600 0x7f164c0d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.818+0000 7f165456d640 1 -- 172.21.15.60:0/3749175195 >> 172.21.15.60:0/3749175195 conn(0x7f164c06c2c0 msgr2=0x7f164c06c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.818+0000 7f165456d640 1 -- 172.21.15.60:0/3749175195 shutdown_connections 2024-09-12T01:42:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.818+0000 7f165456d640 1 -- 172.21.15.60:0/3749175195 wait complete. 2024-09-12T01:42:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.819+0000 7f165456d640 1 Processor -- start 2024-09-12T01:42:20.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.819+0000 7f165456d640 1 -- start start 2024-09-12T01:42:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f165456d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f164c0cf4c0 0x7f164c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f165456d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0d1a40 0x7f164c15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f165456d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f164c15e600 0x7f164c15ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f165456d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f164c0d2b70 con 0x7f164c0d1a40 2024-09-12T01:42:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f165456d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f164c0cffa0 con 0x7f164c15e600 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f165456d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f164c15e9e0 con 0x7f164c0cf4c0 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f1651b08640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0d1a40 0x7f164c15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f1651b08640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0d1a40 0x7f164c15b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53556/0 (socket says 172.21.15.60:53556) 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f1651b08640 1 -- 172.21.15.60:0/201683884 learned_addr learned my addr 172.21.15.60:0/201683884 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f1652b0a640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f164c15e600 0x7f164c15ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f1651b08640 1 -- 172.21.15.60:0/201683884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f164c0cf4c0 msgr2=0x7f164c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f1651b08640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f164c0cf4c0 0x7f164c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f1651b08640 1 -- 172.21.15.60:0/201683884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f164c15e600 msgr2=0x7f164c15ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f1651b08640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f164c15e600 0x7f164c15ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f1651b08640 1 -- 172.21.15.60:0/201683884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164c0cd140 con 0x7f164c0d1a40 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f1651b08640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0d1a40 0x7f164c15b630 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f163c00c780 tx=0x7f163c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.820+0000 7f1642ffd640 1 -- 172.21.15.60:0/201683884 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c018070 con 0x7f164c0d1a40 2024-09-12T01:42:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.821+0000 7f1642ffd640 1 -- 172.21.15.60:0/201683884 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163c0072d0 con 0x7f164c0d1a40 2024-09-12T01:42:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.821+0000 7f165456d640 1 -- 172.21.15.60:0/201683884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164c15d880 con 0x7f164c0d1a40 2024-09-12T01:42:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.821+0000 7f1642ffd640 1 -- 172.21.15.60:0/201683884 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c0047e0 con 0x7f164c0d1a40 2024-09-12T01:42:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.821+0000 7f165456d640 1 -- 172.21.15.60:0/201683884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164c0cd9c0 con 0x7f164c0d1a40 2024-09-12T01:42:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.821+0000 7f165456d640 1 -- 172.21.15.60:0/201683884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f164c0d1500 con 0x7f164c0d1a40 2024-09-12T01:42:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.822+0000 7f1642ffd640 1 -- 172.21.15.60:0/201683884 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f163c01b070 con 0x7f164c0d1a40 2024-09-12T01:42:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.822+0000 7f1642ffd640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f163006be30 0x7f163006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.823+0000 7f1642ffd640 1 -- 172.21.15.60:0/201683884 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7f163c089e60 con 0x7f164c0d1a40 2024-09-12T01:42:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.823+0000 7f1652309640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f163006be30 0x7f163006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.823+0000 7f1652309640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f163006be30 0x7f163006e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f164c160bc0 tx=0x7f1648008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:20.827+0000 7f1642ffd640 1 -- 172.21.15.60:0/201683884 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f164c0b7ad0 con 0x7f164c0d1a40 2024-09-12T01:42:21.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.004+0000 7f165456d640 1 -- 172.21.15.60:0/201683884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f164c0b4e80 con 0x7f164c0d1a40 2024-09-12T01:42:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.008+0000 7f1642ffd640 1 -- 172.21.15.60:0/201683884 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f163c058b10 con 0x7f164c0d1a40 2024-09-12T01:42:21.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.010+0000 7f165456d640 1 -- 172.21.15.60:0/201683884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f163006be30 msgr2=0x7f163006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.010+0000 7f165456d640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f163006be30 0x7f163006e2f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f164c160bc0 tx=0x7f1648008040 comp rx=0 tx=0).stop 2024-09-12T01:42:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.010+0000 7f165456d640 1 -- 172.21.15.60:0/201683884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0d1a40 msgr2=0x7f164c15b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.010+0000 7f165456d640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0d1a40 0x7f164c15b630 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f163c00c780 tx=0x7f163c00cc40 comp rx=0 tx=0).stop 2024-09-12T01:42:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.010+0000 7f165456d640 1 -- 172.21.15.60:0/201683884 shutdown_connections 2024-09-12T01:42:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.010+0000 7f165456d640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f164c15e600 0x7f164c15ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.010+0000 7f165456d640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0d1a40 0x7f164c15b630 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.010+0000 7f165456d640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f163006be30 0x7f163006e2f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.010+0000 7f165456d640 1 --2- 172.21.15.60:0/201683884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f164c0cf4c0 0x7f164c15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.010+0000 7f165456d640 1 -- 172.21.15.60:0/201683884 >> 172.21.15.60:0/201683884 conn(0x7f164c06c2c0 msgr2=0x7f164c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.010+0000 7f165456d640 1 -- 172.21.15.60:0/201683884 shutdown_connections 2024-09-12T01:42:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.010+0000 7f165456d640 1 -- 172.21.15.60:0/201683884 wait complete. 2024-09-12T01:42:21.020 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:42:21.021 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:42:21.058 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:42:21.105 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:42:21.105 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:42:21.106 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:21.122 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:42:21.122 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:42:21.122 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:21.141 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:42:21.141 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:42:21.141 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:21.178 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:42:21.178 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:42:21.179 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:21.199 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:42:21.199 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:42:21.199 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:21.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.321+0000 7fbc55d86640 1 Processor -- start 2024-09-12T01:42:21.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.321+0000 7fbc55d86640 1 -- start start 2024-09-12T01:42:21.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.322+0000 7fbc55d86640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc500715e0 0x7fbc500b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:21.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.322+0000 7fbc55d86640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc500d0270 con 0x7fbc5015c550 2024-09-12T01:42:21.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.322+0000 7fbc55d86640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc50071a50 con 0x7fbc50073160 2024-09-12T01:42:21.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.322+0000 7fbc55d86640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbc500b7350 con 0x7fbc500715e0 2024-09-12T01:42:21.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.322+0000 7fbc4effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc500715e0 0x7fbc500b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:21.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.322+0000 7fbc4f7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbc5015c550 0x7fbc500b5540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49814/0 (socket says 172.21.15.60:49814) 2024-09-12T01:42:21.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.322+0000 7fbc4effd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc500715e0 0x7fbc500b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53572/0 (socket says 172.21.15.60:53572) 2024-09-12T01:42:21.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.322+0000 7fbc4f7fe640 1 -- 172.21.15.60:0/3039715311 learned_addr learned my addr 172.21.15.60:0/3039715311 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:21.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.322+0000 7fbc4effd640 1 -- 172.21.15.60:0/3039715311 >> v1:172.21.15.105:6789/0 conn(0x7fbc50073160 legacy=0x7fbc500d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:21.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.322+0000 7fbc4effd640 1 -- 172.21.15.60:0/3039715311 >> v1:172.21.15.60:6789/0 conn(0x7fbc5015c550 legacy=0x7fbc500b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:21.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.323+0000 7fbc4effd640 1 -- 172.21.15.60:0/3039715311 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc500d04f0 con 0x7fbc500715e0 2024-09-12T01:42:21.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.322+0000 7fbc4e7fc640 1 -- 172.21.15.60:0/3039715311 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 762119898 0 0) 0x7fbc40001110 con 0x7fbc5015c550 2024-09-12T01:42:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.323+0000 7fbc4effd640 1 --2- 172.21.15.60:0/3039715311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500715e0 0x7fbc500b6e10 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fbc440097a0 tx=0x7fbc4402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c856ff0aedabb82b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.323+0000 7fbc4e7fc640 1 -- 172.21.15.60:0/3039715311 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44037070 con 0x7fbc500715e0 2024-09-12T01:42:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.323+0000 7fbc4e7fc640 1 -- 172.21.15.60:0/3039715311 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc44032440 con 0x7fbc500715e0 2024-09-12T01:42:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.323+0000 7fbc4e7fc640 1 -- 172.21.15.60:0/3039715311 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc44032810 con 0x7fbc500715e0 2024-09-12T01:42:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.324+0000 7fbc55d86640 1 -- 172.21.15.60:0/3039715311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500715e0 msgr2=0x7fbc500b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.324+0000 7fbc55d86640 1 --2- 172.21.15.60:0/3039715311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500715e0 0x7fbc500b6e10 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fbc440097a0 tx=0x7fbc4402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.324+0000 7fbc55d86640 1 -- 172.21.15.60:0/3039715311 shutdown_connections 2024-09-12T01:42:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.324+0000 7fbc55d86640 1 --2- 172.21.15.60:0/3039715311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc500715e0 0x7fbc500b6e10 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.324+0000 7fbc55d86640 1 -- 172.21.15.60:0/3039715311 >> 172.21.15.60:0/3039715311 conn(0x7fbc500b4240 msgr2=0x7fbc500b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.324+0000 7fbc55d86640 1 -- 172.21.15.60:0/3039715311 shutdown_connections 2024-09-12T01:42:21.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.324+0000 7fbc55d86640 1 -- 172.21.15.60:0/3039715311 wait complete. 2024-09-12T01:42:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.325+0000 7fbc55d86640 1 Processor -- start 2024-09-12T01:42:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.325+0000 7fbc55d86640 1 -- start start 2024-09-12T01:42:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.326+0000 7fbc55d86640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500715e0 0x7fbc500af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.326+0000 7fbc55d86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc50073160 0x7fbc5006e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.326+0000 7fbc55d86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc5015c550 0x7fbc50158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.326+0000 7fbc55d86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbc500b7860 con 0x7fbc5015c550 2024-09-12T01:42:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.326+0000 7fbc55d86640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbc5015c930 con 0x7fbc500715e0 2024-09-12T01:42:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.326+0000 7fbc55d86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbc500d07b0 con 0x7fbc50073160 2024-09-12T01:42:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.326+0000 7fbc4ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc5015c550 0x7fbc50158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.326+0000 7fbc4ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc5015c550 0x7fbc50158620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53576/0 (socket says 172.21.15.60:53576) 2024-09-12T01:42:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.326+0000 7fbc4ffff640 1 -- 172.21.15.60:0/3468724681 learned_addr learned my addr 172.21.15.60:0/3468724681 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.326+0000 7fbc4f7fe640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500715e0 0x7fbc500af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.326+0000 7fbc4effd640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc50073160 0x7fbc5006e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc4ffff640 1 -- 172.21.15.60:0/3468724681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc50073160 msgr2=0x7fbc5006e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc4ffff640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc50073160 0x7fbc5006e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc4ffff640 1 -- 172.21.15.60:0/3468724681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500715e0 msgr2=0x7fbc500af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc4ffff640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500715e0 0x7fbc500af510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc4ffff640 1 -- 172.21.15.60:0/3468724681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc5006eb00 con 0x7fbc5015c550 2024-09-12T01:42:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc4f7fe640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500715e0 0x7fbc500af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc4effd640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc50073160 0x7fbc5006e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc4ffff640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc5015c550 0x7fbc50158620 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fbc4800c780 tx=0x7fbc4800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc37fff640 1 -- 172.21.15.60:0/3468724681 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48004b60 con 0x7fbc5015c550 2024-09-12T01:42:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc37fff640 1 -- 172.21.15.60:0/3468724681 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc48004d00 con 0x7fbc5015c550 2024-09-12T01:42:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc55d86640 1 -- 172.21.15.60:0/3468724681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc500aea30 con 0x7fbc5015c550 2024-09-12T01:42:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc37fff640 1 -- 172.21.15.60:0/3468724681 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4800aa90 con 0x7fbc5015c550 2024-09-12T01:42:21.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.327+0000 7fbc55d86640 1 -- 172.21.15.60:0/3468724681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc500aeff0 con 0x7fbc5015c550 2024-09-12T01:42:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.328+0000 7fbc55d86640 1 -- 172.21.15.60:0/3468724681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc500b6e10 con 0x7fbc5015c550 2024-09-12T01:42:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.328+0000 7fbc37fff640 1 -- 172.21.15.60:0/3468724681 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc4800ac30 con 0x7fbc5015c550 2024-09-12T01:42:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.329+0000 7fbc37fff640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc3c06be30 0x7fbc3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.329+0000 7fbc37fff640 1 -- 172.21.15.60:0/3468724681 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7fbc4808aec0 con 0x7fbc5015c550 2024-09-12T01:42:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.329+0000 7fbc4f7fe640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc3c06be30 0x7fbc3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:21.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.329+0000 7fbc4f7fe640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc3c06be30 0x7fbc3c06e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbc40000f60 tx=0x7fbc40007a30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:21.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.333+0000 7fbc37fff640 1 -- 172.21.15.60:0/3468724681 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc48020070 con 0x7fbc5015c550 2024-09-12T01:42:21.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.544+0000 7fbc55d86640 1 -- 172.21.15.60:0/3468724681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc500b0240 con 0x7fbc5015c550 2024-09-12T01:42:21.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.545+0000 7fbc37fff640 1 -- 172.21.15.60:0/3468724681 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+3908 (secure 0 0 0) 0x7fbc48059ad0 con 0x7fbc5015c550 2024-09-12T01:42:21.544 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:21.545 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":55,"btime":"2024-09-12T01:42:15:668004+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6292,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1757090077","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1757090077},{"type":"v1","addr":"172.21.15.105:6834","nonce":1757090077}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6481,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3772134366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3772134366},{"type":"v1","addr":"172.21.15.105:6835","nonce":3772134366}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6759,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/131981610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":131981610},{"type":"v1","addr":"172.21.15.60:6836","nonce":131981610}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50},{"gid":6762,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/18288436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":18288436},{"type":"v1","addr":"172.21.15.60:6837","nonce":18288436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[]} 2024-09-12T01:42:21.545 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 55 2024-09-12T01:42:21.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.546+0000 7fbc55d86640 1 -- 172.21.15.60:0/3468724681 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc3c06be30 msgr2=0x7fbc3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:21.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.546+0000 7fbc55d86640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc3c06be30 0x7fbc3c06e2f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbc40000f60 tx=0x7fbc40007a30 comp rx=0 tx=0).stop 2024-09-12T01:42:21.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.546+0000 7fbc55d86640 1 -- 172.21.15.60:0/3468724681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc5015c550 msgr2=0x7fbc50158620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.546+0000 7fbc55d86640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc5015c550 0x7fbc50158620 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fbc4800c780 tx=0x7fbc4800cc40 comp rx=0 tx=0).stop 2024-09-12T01:42:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.546+0000 7fbc55d86640 1 -- 172.21.15.60:0/3468724681 shutdown_connections 2024-09-12T01:42:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.546+0000 7fbc55d86640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc5015c550 0x7fbc50158620 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.546+0000 7fbc55d86640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc3c06be30 0x7fbc3c06e2f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.546+0000 7fbc55d86640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc50073160 0x7fbc5006e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.546+0000 7fbc55d86640 1 --2- 172.21.15.60:0/3468724681 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc500715e0 0x7fbc500af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.547+0000 7fbc55d86640 1 -- 172.21.15.60:0/3468724681 >> 172.21.15.60:0/3468724681 conn(0x7fbc500b4240 msgr2=0x7fbc500d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.547+0000 7fbc55d86640 1 -- 172.21.15.60:0/3468724681 shutdown_connections 2024-09-12T01:42:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.547+0000 7fbc55d86640 1 -- 172.21.15.60:0/3468724681 wait complete. 2024-09-12T01:42:21.557 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:42:21.557 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:42:21.558 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:42:21.558 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:42:21.558 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:42:21.558 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:42:21.558 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:42:21.558 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:42:21.558 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:42:21.559 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:42:21.559 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:42:21.559 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:42:21.559 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:42:21.559 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:42:21.559 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:42:21.559 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:42:21.569 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:42:21.570 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:42:21.570 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:42:21.571 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:42:21.574 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:42:21.574 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:42:21.575 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:42:21.575 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:42:21.613 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:42:21.613 DEBUG:teuthology.parallel:result is None 2024-09-12T01:42:21.614 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:42:21.614 DEBUG:teuthology.parallel:result is None 2024-09-12T01:42:21.617 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:42:21.617 DEBUG:teuthology.parallel:result is None 2024-09-12T01:42:21.618 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:42:21.618 DEBUG:teuthology.parallel:result is None 2024-09-12T01:42:21.618 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:42:21.691 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2024-09-12T01:42:21.691 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2024-09-12T01:42:21.692 INFO:tasks.ceph.mds.c.smithi060.stderr:2024-09-12T01:42:21.693+0000 7f30da016640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-12T01:42:21.701 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:42:21.701 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:42:21.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.728+0000 7f69cc366640 1 Processor -- start 2024-09-12T01:42:21.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.728+0000 7f69cc366640 1 -- start start 2024-09-12T01:42:21.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69cc366640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69c415b480 0x7f69c40b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69cc366640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f69c4072700 0x7f69c415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69cc366640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69c40ccff0 con 0x7f69c40b60c0 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69cc366640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f69c40b6500 con 0x7f69c4072700 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69cc366640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f69c40cd2d0 con 0x7f69c415b480 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69c9901640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f69c40b60c0 0x7f69c4071ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49834/0 (socket says 172.21.15.60:49834) 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69c9901640 1 -- 172.21.15.60:0/1595253029 learned_addr learned my addr 172.21.15.60:0/1595253029 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69ca903640 1 --2- 172.21.15.60:0/1595253029 >> v2:172.21.15.105:3300/0 conn(0x7f69c4072700 0x7f69c415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69ca102640 1 --2- 172.21.15.60:0/1595253029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69c415b480 0x7f69c40b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69c9100640 1 -- 172.21.15.60:0/1595253029 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1988573730 0 0) 0x7f69c40ccff0 con 0x7f69c40b60c0 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69c9100640 1 -- 172.21.15.60:0/1595253029 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69b0005730 con 0x7f69c40b60c0 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69ca903640 1 -- 172.21.15.60:0/1595253029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69c415b480 msgr2=0x7f69c40b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69ca903640 1 --2- 172.21.15.60:0/1595253029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69c415b480 0x7f69c40b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69ca903640 1 -- 172.21.15.60:0/1595253029 >> v1:172.21.15.60:6789/0 conn(0x7f69c40b60c0 legacy=0x7f69c4071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:21.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69ca903640 1 -- 172.21.15.60:0/1595253029 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c40cd5b0 con 0x7f69c4072700 2024-09-12T01:42:21.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.729+0000 7f69ca102640 1 --2- 172.21.15.60:0/1595253029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69c415b480 0x7f69c40b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:21.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.730+0000 7f69ca903640 1 --2- 172.21.15.60:0/1595253029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c4072700 0x7f69c415bc60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0097a0 tx=0x7f69bc02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7473e5f2782d4f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:21.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.730+0000 7f69c9100640 1 -- 172.21.15.60:0/1595253029 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc037070 con 0x7f69c4072700 2024-09-12T01:42:21.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.730+0000 7f69c9100640 1 -- 172.21.15.60:0/1595253029 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69bc02ae50 con 0x7f69c4072700 2024-09-12T01:42:21.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.730+0000 7f69c9100640 1 -- 172.21.15.60:0/1595253029 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc032640 con 0x7f69c4072700 2024-09-12T01:42:21.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.731+0000 7f69cc366640 1 -- 172.21.15.60:0/1595253029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c4072700 msgr2=0x7f69c415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:21.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.731+0000 7f69cc366640 1 --2- 172.21.15.60:0/1595253029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c4072700 0x7f69c415bc60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0097a0 tx=0x7f69bc02a100 comp rx=0 tx=0).stop 2024-09-12T01:42:21.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.731+0000 7f69cc366640 1 -- 172.21.15.60:0/1595253029 shutdown_connections 2024-09-12T01:42:21.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.731+0000 7f69cc366640 1 --2- 172.21.15.60:0/1595253029 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c4072700 0x7f69c415bc60 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.731+0000 7f69cc366640 1 --2- 172.21.15.60:0/1595253029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69c415b480 0x7f69c40b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.731+0000 7f69cc366640 1 -- 172.21.15.60:0/1595253029 >> 172.21.15.60:0/1595253029 conn(0x7f69c406d0f0 msgr2=0x7f69c406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:21.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.731+0000 7f69cc366640 1 -- 172.21.15.60:0/1595253029 shutdown_connections 2024-09-12T01:42:21.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.731+0000 7f69cc366640 1 -- 172.21.15.60:0/1595253029 wait complete. 2024-09-12T01:42:21.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.732+0000 7f69cc366640 1 Processor -- start 2024-09-12T01:42:21.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.732+0000 7f69cc366640 1 -- start start 2024-09-12T01:42:21.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69cc366640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c4072700 0x7f69c4142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:21.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69cc366640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c40b60c0 0x7f69c4150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:21.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69cc366640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69c415b480 0x7f69c40b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:21.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69cc366640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f69c415b860 con 0x7f69c40b60c0 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69cc366640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f69c40cdb70 con 0x7f69c4072700 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69cc366640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f69c415b9e0 con 0x7f69c415b480 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69c9901640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c40b60c0 0x7f69c4150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69c9901640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c40b60c0 0x7f69c4150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53636/0 (socket says 172.21.15.60:53636) 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69c9901640 1 -- 172.21.15.60:0/819636901 learned_addr learned my addr 172.21.15.60:0/819636901 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69ca903640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69c415b480 0x7f69c40b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69ca102640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c4072700 0x7f69c4142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69c9901640 1 -- 172.21.15.60:0/819636901 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69c415b480 msgr2=0x7f69c40b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69c9901640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69c415b480 0x7f69c40b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69c9901640 1 -- 172.21.15.60:0/819636901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c4072700 msgr2=0x7f69c4142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69c9901640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c4072700 0x7f69c4142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69c9901640 1 -- 172.21.15.60:0/819636901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c414e590 con 0x7f69c40b60c0 2024-09-12T01:42:21.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69c9901640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c40b60c0 0x7f69c4150110 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f69b400c400 tx=0x7f69b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:21.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.733+0000 7f69baffd640 1 -- 172.21.15.60:0/819636901 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4017070 con 0x7f69c40b60c0 2024-09-12T01:42:21.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.734+0000 7f69baffd640 1 -- 172.21.15.60:0/819636901 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69b4005d00 con 0x7f69c40b60c0 2024-09-12T01:42:21.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.734+0000 7f69baffd640 1 -- 172.21.15.60:0/819636901 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b4007310 con 0x7f69c40b60c0 2024-09-12T01:42:21.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.734+0000 7f69cc366640 1 -- 172.21.15.60:0/819636901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69c414e870 con 0x7f69c40b60c0 2024-09-12T01:42:21.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.734+0000 7f69cc366640 1 -- 172.21.15.60:0/819636901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69c414ee30 con 0x7f69c40b60c0 2024-09-12T01:42:21.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.735+0000 7f69cc366640 1 -- 172.21.15.60:0/819636901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69c40b5b80 con 0x7f69c40b60c0 2024-09-12T01:42:21.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.735+0000 7f69baffd640 1 -- 172.21.15.60:0/819636901 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f69b401a070 con 0x7f69c40b60c0 2024-09-12T01:42:21.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.736+0000 7f69baffd640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f69a806be30 0x7f69a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:21.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.736+0000 7f69baffd640 1 -- 172.21.15.60:0/819636901 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 4943+0+0 (secure 0 0 0) 0x7f69b4089f80 con 0x7f69c40b60c0 2024-09-12T01:42:21.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.736+0000 7f69ca102640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f69a806be30 0x7f69a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:21.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.736+0000 7f69ca102640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f69a806be30 0x7f69a806e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f69c0007440 tx=0x7f69c000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:21.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.740+0000 7f69baffd640 1 -- 172.21.15.60:0/819636901 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f69b4058c40 con 0x7f69c40b60c0 2024-09-12T01:42:21.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:21.928+0000 7f69cc366640 1 -- 172.21.15.60:0/819636901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f69c4158bb0 con 0x7f69c40b60c0 2024-09-12T01:42:22.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.697+0000 7f69baffd640 1 -- 172.21.15.60:0/819636901 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v97) ==== 97+0+0 (secure 0 0 0) 0x7f69b4058540 con 0x7f69c40b60c0 2024-09-12T01:42:22.697 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2024-09-12T01:42:22.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.701+0000 7f69cc366640 1 -- 172.21.15.60:0/819636901 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f69a806be30 msgr2=0x7f69a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:22.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.701+0000 7f69cc366640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f69a806be30 0x7f69a806e2f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f69c0007440 tx=0x7f69c000b040 comp rx=0 tx=0).stop 2024-09-12T01:42:22.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.701+0000 7f69cc366640 1 -- 172.21.15.60:0/819636901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c40b60c0 msgr2=0x7f69c4150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:22.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.701+0000 7f69cc366640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c40b60c0 0x7f69c4150110 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f69b400c400 tx=0x7f69b400c8c0 comp rx=0 tx=0).stop 2024-09-12T01:42:22.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.701+0000 7f69cc366640 1 -- 172.21.15.60:0/819636901 shutdown_connections 2024-09-12T01:42:22.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.701+0000 7f69cc366640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f69a806be30 0x7f69a806e2f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:22.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.701+0000 7f69cc366640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f69c415b480 0x7f69c40b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:22.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.701+0000 7f69cc366640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69c40b60c0 0x7f69c4150110 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:22.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.701+0000 7f69cc366640 1 --2- 172.21.15.60:0/819636901 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f69c4072700 0x7f69c4142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:22.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.701+0000 7f69cc366640 1 -- 172.21.15.60:0/819636901 >> 172.21.15.60:0/819636901 conn(0x7f69c406d0f0 msgr2=0x7f69c40b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:22.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.702+0000 7f69cc366640 1 -- 172.21.15.60:0/819636901 shutdown_connections 2024-09-12T01:42:22.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.702+0000 7f69cc366640 1 -- 172.21.15.60:0/819636901 wait complete. 2024-09-12T01:42:22.716 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:42:22.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.825+0000 7f278740e640 1 Processor -- start 2024-09-12T01:42:22.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.825+0000 7f278740e640 1 -- start start 2024-09-12T01:42:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.826+0000 7f278740e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f27800b74c0 0x7f278015eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.826+0000 7f278740e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f278015fb10 con 0x7f278015f030 2024-09-12T01:42:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.826+0000 7f278740e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27800b5900 con 0x7f278015c2b0 2024-09-12T01:42:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.826+0000 7f278740e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f278015f830 con 0x7f27800b74c0 2024-09-12T01:42:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.826+0000 7f27859ab640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f278015f030 0x7f278006d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44440/0 (socket says 172.21.15.60:44440) 2024-09-12T01:42:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.826+0000 7f27859ab640 1 -- 172.21.15.60:0/1347210847 learned_addr learned my addr 172.21.15.60:0/1347210847 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f27849a9640 1 --2- 172.21.15.60:0/1347210847 >> v2:172.21.15.105:3300/0 conn(0x7f27800b74c0 0x7f278015eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1962245389 0 0) 0x7f278015fb10 con 0x7f278015f030 2024-09-12T01:42:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2768003520 con 0x7f278015f030 2024-09-12T01:42:22.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3683057685 0 0) 0x7f2768003520 con 0x7f278015f030 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 >> v2:172.21.15.105:3300/0 conn(0x7f27800b74c0 msgr2=0x7f278015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 --2- 172.21.15.60:0/1347210847 >> v2:172.21.15.105:3300/0 conn(0x7f27800b74c0 0x7f278015eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 >> v1:172.21.15.105:6789/0 conn(0x7f278015c2b0 legacy=0x7f27800b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f278006ce30 con 0x7f278015f030 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f2778001670 con 0x7f278015f030 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 >> v1:172.21.15.60:6789/0 conn(0x7f278015f030 legacy=0x7f278006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 --2- 172.21.15.60:0/1347210847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27680039b0 0x7f2768003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 --2- 172.21.15.60:0/1347210847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2768004800 0x7f2768004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 --2- 172.21.15.60:0/1347210847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27680051c0 0x7f276800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f278015f830 con 0x7f27680051c0 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f276800c060 con 0x7f2768004800 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f276800c260 con 0x7f27680039b0 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f27859ab640 1 --2- 172.21.15.60:0/1347210847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27680051c0 0x7f276800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:22.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f27851aa640 1 --2- 172.21.15.60:0/1347210847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27680039b0 0x7f2768003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.827+0000 7f27849a9640 1 --2- 172.21.15.60:0/1347210847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2768004800 0x7f2768004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.828+0000 7f27859ab640 1 -- 172.21.15.60:0/1347210847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27680039b0 msgr2=0x7f2768003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.828+0000 7f27859ab640 1 --2- 172.21.15.60:0/1347210847 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27680039b0 0x7f2768003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.828+0000 7f27859ab640 1 -- 172.21.15.60:0/1347210847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2768004800 msgr2=0x7f2768004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.828+0000 7f27859ab640 1 --2- 172.21.15.60:0/1347210847 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2768004800 0x7f2768004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.828+0000 7f27859ab640 1 -- 172.21.15.60:0/1347210847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2768003520 con 0x7f27680051c0 2024-09-12T01:42:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.828+0000 7f27859ab640 1 -- 172.21.15.60:0/1347210847 reap_dead start 2024-09-12T01:42:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.828+0000 7f27859ab640 1 --2- 172.21.15.60:0/1347210847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27680051c0 0x7f276800b9c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f277800c210 tx=0x7f2768005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59db50e933f78c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.828+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778007d30 con 0x7f27680051c0 2024-09-12T01:42:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.828+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2778005ad0 con 0x7f27680051c0 2024-09-12T01:42:22.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.828+0000 7f277ffff640 1 -- 172.21.15.60:0/1347210847 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2778007070 con 0x7f27680051c0 2024-09-12T01:42:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.829+0000 7f278740e640 1 -- 172.21.15.60:0/1347210847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27680051c0 msgr2=0x7f276800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.829+0000 7f278740e640 1 --2- 172.21.15.60:0/1347210847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27680051c0 0x7f276800b9c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f277800c210 tx=0x7f2768005830 comp rx=0 tx=0).stop 2024-09-12T01:42:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.829+0000 7f278740e640 1 -- 172.21.15.60:0/1347210847 shutdown_connections 2024-09-12T01:42:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.829+0000 7f278740e640 1 --2- 172.21.15.60:0/1347210847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27680051c0 0x7f276800b9c0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.829+0000 7f278740e640 1 -- 172.21.15.60:0/1347210847 >> 172.21.15.60:0/1347210847 conn(0x7f27800b4240 msgr2=0x7f27800b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.829+0000 7f278740e640 1 -- 172.21.15.60:0/1347210847 shutdown_connections 2024-09-12T01:42:22.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.829+0000 7f278740e640 1 -- 172.21.15.60:0/1347210847 wait complete. 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.830+0000 7f278740e640 1 Processor -- start 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.830+0000 7f278740e640 1 -- start start 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.831+0000 7f278740e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27680051c0 0x7f278015a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.831+0000 7f278740e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27800ceea0 0x7f27800cf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.831+0000 7f278740e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27800d16e0 0x7f27800d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.831+0000 7f278740e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f278015f480 con 0x7f27800ceea0 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.831+0000 7f278740e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f278006d3f0 con 0x7f27680051c0 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.831+0000 7f278740e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f27800cf940 con 0x7f27800d16e0 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.831+0000 7f27849a9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27800ceea0 0x7f27800cf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.831+0000 7f27849a9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27800ceea0 0x7f27800cf320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56168/0 (socket says 172.21.15.60:56168) 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.831+0000 7f27849a9640 1 -- 172.21.15.60:0/2864854874 learned_addr learned my addr 172.21.15.60:0/2864854874 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.831+0000 7f27851aa640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27680051c0 0x7f278015a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:22.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f27859ab640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27800d16e0 0x7f27800d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f27849a9640 1 -- 172.21.15.60:0/2864854874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27800d16e0 msgr2=0x7f27800d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f27849a9640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27800d16e0 0x7f27800d1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f27849a9640 1 -- 172.21.15.60:0/2864854874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27680051c0 msgr2=0x7f278015a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f27849a9640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27680051c0 0x7f278015a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f27849a9640 1 -- 172.21.15.60:0/2864854874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27800cfc20 con 0x7f27800ceea0 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f27851aa640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27680051c0 0x7f278015a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f27849a9640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27800ceea0 0x7f27800cf320 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f27740118e0 tx=0x7f2774011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f277dffb640 1 -- 172.21.15.60:0/2864854874 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f277400fa90 con 0x7f27800ceea0 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f277dffb640 1 -- 172.21.15.60:0/2864854874 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f277400fc30 con 0x7f27800ceea0 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f277dffb640 1 -- 172.21.15.60:0/2864854874 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2774014440 con 0x7f27800ceea0 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f278740e640 1 -- 172.21.15.60:0/2864854874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27800cff00 con 0x7f27800ceea0 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.832+0000 7f278740e640 1 -- 172.21.15.60:0/2864854874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27800d04c0 con 0x7f27800ceea0 2024-09-12T01:42:22.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.833+0000 7f278740e640 1 -- 172.21.15.60:0/2864854874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f278015eaf0 con 0x7f27800ceea0 2024-09-12T01:42:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.834+0000 7f277dffb640 1 -- 172.21.15.60:0/2864854874 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2774012040 con 0x7f27800ceea0 2024-09-12T01:42:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.834+0000 7f277dffb640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f276c06be60 0x7f276c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.834+0000 7f277dffb640 1 -- 172.21.15.60:0/2864854874 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 4857+0+0 (secure 0 0 0) 0x7f277408b260 con 0x7f27800ceea0 2024-09-12T01:42:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.834+0000 7f27851aa640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f276c06be60 0x7f276c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.835+0000 7f27851aa640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f276c06be60 0x7f276c06e320 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f278006ed60 tx=0x7f2770009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:22.839+0000 7f277dffb640 1 -- 172.21.15.60:0/2864854874 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2774019030 con 0x7f27800ceea0 2024-09-12T01:42:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.079+0000 7f278740e640 1 -- 172.21.15.60:0/2864854874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f27800b47c0 con 0x7f27800ceea0 2024-09-12T01:42:23.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.080+0000 7f277dffb640 1 -- 172.21.15.60:0/2864854874 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f2774059ec0 con 0x7f27800ceea0 2024-09-12T01:42:23.080 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:23.080 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:42:23.080 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2024-09-12T01:42:23.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.080 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2024-09-12T01:42:23.080 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmIK3fKxAAM9RkghDZwJZWuKouIbObDw==", 2024-09-12T01:42:23.080 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.080 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:42:23.080 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:42:23.080 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:42:23.080 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.080 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmzqHZNxAAnhCo4gGwLgYDVzzYnoiDFA==", 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2024-09-12T01:42:23.081 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmksMWMxAAp3xMDD09rfphgPZwQcEABA==", 2024-09-12T01:42:23.082 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.082 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:42:23.082 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:42:23.082 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:42:23.082 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.082 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.082 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.082 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.082 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2024-09-12T01:42:23.082 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmvLw/AxAApd4hl5LRD1QddnPPjRw2Kg==", 2024-09-12T01:42:23.082 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.082 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:42:23.083 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:42:23.083 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:42:23.083 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.083 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.083 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.084 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.084 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2024-09-12T01:42:23.084 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA7ReJmc3D/JxAAXiw6n1Q3n9sCXln6YSiCBA==", 2024-09-12T01:42:23.084 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.084 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:42:23.084 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:42:23.084 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2024-09-12T01:42:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA/ReJmEOu3CxAA4uu1neLh0mpeG9nia+/VqQ==", 2024-09-12T01:42:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:42:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:42:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.085 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2024-09-12T01:42:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBCReJm3HHtDhAAoAdKVsjuXmpcf5R5zTtFKg==", 2024-09-12T01:42:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:42:23.086 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBFReJmtRLuIBAA/BBibpGfpXsFXqVjVrmXWA==", 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.087 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2024-09-12T01:42:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBMReJmdDNXKhAAeh5aCvMw+70z3tnwjb9Hjg==", 2024-09-12T01:42:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:42:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:42:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2024-09-12T01:42:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBQReJm/tsIHRAAmgx+5WifY/VITGHAbUV2CQ==", 2024-09-12T01:42:23.088 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:42:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:42:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.089 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBUReJmQFaBHhAA1vH01tePCoJQFXlHB5gcVg==", 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBYReJmTHqLAhAAtUB94Pa3eihlVdaupZ8Ggg==", 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.090 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:42:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:42:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2024-09-12T01:42:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ==", 2024-09-12T01:42:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.091 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmTopGEBAAY0K3iZm2PotQc8a489uO/Q==", 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:42:23.092 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2024-09-12T01:42:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmqUgQDRAAAp5SAwNM9aSxZ1VVRwroNA==", 2024-09-12T01:42:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:42:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:42:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:42:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:42:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.093 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmGfzeFRAAE2xCnzeyX/KBo3NBrkixYQ==", 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmOfXYDxAA0hydSyRvFmmNvFcRwPaXqg==", 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.094 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmjpyMKBAAMSGgYJddHs7TtCV0NszZAQ==", 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.095 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:42:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2024-09-12T01:42:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJm3Ei+JBAAhwgXWq0baTlDtaLedcaHmg==", 2024-09-12T01:42:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:42:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:42:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:42:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:42:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.096 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T01:42:23.096 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:42:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.082+0000 7f278740e640 1 -- 172.21.15.60:0/2864854874 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f276c06be60 msgr2=0x7f276c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.082+0000 7f278740e640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f276c06be60 0x7f276c06e320 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f278006ed60 tx=0x7f2770009040 comp rx=0 tx=0).stop 2024-09-12T01:42:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.082+0000 7f278740e640 1 -- 172.21.15.60:0/2864854874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27800ceea0 msgr2=0x7f27800cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.082+0000 7f278740e640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27800ceea0 0x7f27800cf320 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f27740118e0 tx=0x7f2774011da0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.082+0000 7f278740e640 1 -- 172.21.15.60:0/2864854874 shutdown_connections 2024-09-12T01:42:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.082+0000 7f278740e640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f276c06be60 0x7f276c06e320 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.082+0000 7f278740e640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27800d16e0 0x7f27800d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.082+0000 7f278740e640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27800ceea0 0x7f27800cf320 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.082+0000 7f278740e640 1 --2- 172.21.15.60:0/2864854874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27680051c0 0x7f278015a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.082+0000 7f278740e640 1 -- 172.21.15.60:0/2864854874 >> 172.21.15.60:0/2864854874 conn(0x7f27800b4240 msgr2=0x7f27800b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.082+0000 7f278740e640 1 -- 172.21.15.60:0/2864854874 shutdown_connections 2024-09-12T01:42:23.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.082+0000 7f278740e640 1 -- 172.21.15.60:0/2864854874 wait complete. 2024-09-12T01:42:23.099 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:42:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.202+0000 7f75f9e35640 1 Processor -- start 2024-09-12T01:42:23.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.202+0000 7f75f9e35640 1 -- start start 2024-09-12T01:42:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.203+0000 7f75f9e35640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f75f40b6eb0 0x7f75f406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.203+0000 7f75f9e35640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f75f40d1b40 0x7f75f406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.203+0000 7f75f9e35640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75f40708d0 con 0x7f75f40b7290 2024-09-12T01:42:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.203+0000 7f75f9e35640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f75f4070bb0 con 0x7f75f40b6eb0 2024-09-12T01:42:23.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.203+0000 7f75f9e35640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f75f4070e90 con 0x7f75f40d1b40 2024-09-12T01:42:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.203+0000 7f75f37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f75f40b6eb0 0x7f75f406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.203+0000 7f75f37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f75f40b6eb0 0x7f75f406fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56178/0 (socket says 172.21.15.60:56178) 2024-09-12T01:42:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.203+0000 7f75f37fe640 1 -- 172.21.15.60:0/1044614982 learned_addr learned my addr 172.21.15.60:0/1044614982 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.204+0000 7f75f37fe640 1 -- 172.21.15.60:0/1044614982 >> v2:172.21.15.105:3300/0 conn(0x7f75f40d1b40 msgr2=0x7f75f406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.204+0000 7f75f37fe640 1 --2- 172.21.15.60:0/1044614982 >> v2:172.21.15.105:3300/0 conn(0x7f75f40d1b40 0x7f75f406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.204+0000 7f75f37fe640 1 -- 172.21.15.60:0/1044614982 >> v1:172.21.15.105:6789/0 conn(0x7f75f40b7290 legacy=0x7f75f406d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:23.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.204+0000 7f75f37fe640 1 -- 172.21.15.60:0/1044614982 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f4071170 con 0x7f75f40b6eb0 2024-09-12T01:42:23.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.204+0000 7f75f37fe640 1 --2- 172.21.15.60:0/1044614982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40b6eb0 0x7f75f406fd00 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f75f40509d0 tx=0x7f75e402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32146f6e6eee781c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:23.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.204+0000 7f75f27fc640 1 -- 172.21.15.60:0/1044614982 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4037070 con 0x7f75f40b6eb0 2024-09-12T01:42:23.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.205+0000 7f75f27fc640 1 -- 172.21.15.60:0/1044614982 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e4032440 con 0x7f75f40b6eb0 2024-09-12T01:42:23.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.205+0000 7f75f27fc640 1 -- 172.21.15.60:0/1044614982 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4032810 con 0x7f75f40b6eb0 2024-09-12T01:42:23.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.205+0000 7f75f9e35640 1 -- 172.21.15.60:0/1044614982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40b6eb0 msgr2=0x7f75f406fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:23.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.205+0000 7f75f9e35640 1 --2- 172.21.15.60:0/1044614982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40b6eb0 0x7f75f406fd00 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f75f40509d0 tx=0x7f75e402a180 comp rx=0 tx=0).stop 2024-09-12T01:42:23.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.205+0000 7f75f9e35640 1 -- 172.21.15.60:0/1044614982 shutdown_connections 2024-09-12T01:42:23.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.205+0000 7f75f9e35640 1 --2- 172.21.15.60:0/1044614982 >> v2:172.21.15.105:3300/0 conn(0x7f75f40d1b40 0x7f75f406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.205+0000 7f75f9e35640 1 --2- 172.21.15.60:0/1044614982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40b6eb0 0x7f75f406fd00 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.205+0000 7f75f9e35640 1 -- 172.21.15.60:0/1044614982 >> 172.21.15.60:0/1044614982 conn(0x7f75f40d2450 msgr2=0x7f75f40d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:23.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.205+0000 7f75f9e35640 1 -- 172.21.15.60:0/1044614982 shutdown_connections 2024-09-12T01:42:23.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.205+0000 7f75f9e35640 1 -- 172.21.15.60:0/1044614982 wait complete. 2024-09-12T01:42:23.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.206+0000 7f75f9e35640 1 Processor -- start 2024-09-12T01:42:23.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.207+0000 7f75f9e35640 1 -- start start 2024-09-12T01:42:23.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.207+0000 7f75f9e35640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40b6eb0 0x7f75f40b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.207+0000 7f75f9e35640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75f40b7290 0x7f75f4162510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.207+0000 7f75f9e35640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75f40d1b40 0x7f75f4162a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.207+0000 7f75f9e35640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f75f4071970 con 0x7f75f40b6eb0 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.207+0000 7f75f9e35640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75f4070240 con 0x7f75f40d1b40 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.207+0000 7f75f9e35640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f75f4071af0 con 0x7f75f40b7290 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.207+0000 7f75f37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40b6eb0 0x7f75f40b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.207+0000 7f75f37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40b6eb0 0x7f75f40b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56180/0 (socket says 172.21.15.60:56180) 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.207+0000 7f75f37fe640 1 -- 172.21.15.60:0/3820284268 learned_addr learned my addr 172.21.15.60:0/3820284268 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75f3fff640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75f40d1b40 0x7f75f4162a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75f2ffd640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75f40b7290 0x7f75f4162510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75f37fe640 1 -- 172.21.15.60:0/3820284268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75f40b7290 msgr2=0x7f75f4162510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75f37fe640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75f40b7290 0x7f75f4162510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75f37fe640 1 -- 172.21.15.60:0/3820284268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75f40d1b40 msgr2=0x7f75f4162a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:23.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75f37fe640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75f40d1b40 0x7f75f4162a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75f37fe640 1 -- 172.21.15.60:0/3820284268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f40cbb50 con 0x7f75f40b6eb0 2024-09-12T01:42:23.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75f37fe640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40b6eb0 0x7f75f40b3880 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f75e4000c00 tx=0x7f75e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:23.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75dbfff640 1 -- 172.21.15.60:0/3820284268 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4041070 con 0x7f75f40b6eb0 2024-09-12T01:42:23.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75dbfff640 1 -- 172.21.15.60:0/3820284268 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75e403c870 con 0x7f75f40b6eb0 2024-09-12T01:42:23.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75f9e35640 1 -- 172.21.15.60:0/3820284268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f40cbe30 con 0x7f75f40b6eb0 2024-09-12T01:42:23.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75dbfff640 1 -- 172.21.15.60:0/3820284268 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4037040 con 0x7f75f40b6eb0 2024-09-12T01:42:23.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.208+0000 7f75f9e35640 1 -- 172.21.15.60:0/3820284268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f40cc3f0 con 0x7f75f40b6eb0 2024-09-12T01:42:23.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.209+0000 7f75f9e35640 1 -- 172.21.15.60:0/3820284268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f406fd00 con 0x7f75f40b6eb0 2024-09-12T01:42:23.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.210+0000 7f75dbfff640 1 -- 172.21.15.60:0/3820284268 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f75e4044070 con 0x7f75f40b6eb0 2024-09-12T01:42:23.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.210+0000 7f75dbfff640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f75e006be30 0x7f75e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:23.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.210+0000 7f75dbfff640 1 -- 172.21.15.60:0/3820284268 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 4857+0+0 (secure 0 0 0) 0x7f75e40ab5f0 con 0x7f75f40b6eb0 2024-09-12T01:42:23.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.210+0000 7f75f2ffd640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f75e006be30 0x7f75e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:23.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.211+0000 7f75f2ffd640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f75e006be30 0x7f75e006e2f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f75e800b810 tx=0x7f75e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:23.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.215+0000 7f75dbfff640 1 -- 172.21.15.60:0/3820284268 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75e407a380 con 0x7f75f40b6eb0 2024-09-12T01:42:23.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.392+0000 7f75f9e35640 1 -- 172.21.15.60:0/3820284268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f75f40b19b0 con 0x7f75f40b6eb0 2024-09-12T01:42:23.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.392+0000 7f75dbfff640 1 -- 172.21.15.60:0/3820284268 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v99) ==== 84+0+65 (secure 0 0 0) 0x7f75e4079c80 con 0x7f75f40b6eb0 2024-09-12T01:42:23.392 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:23.392 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T01:42:23.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:42:23.392 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T01:42:23.392 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T01:42:23.392 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:42:23.392 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T01:42:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.394+0000 7f75f9e35640 1 -- 172.21.15.60:0/3820284268 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f75e006be30 msgr2=0x7f75e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.394+0000 7f75f9e35640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f75e006be30 0x7f75e006e2f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f75e800b810 tx=0x7f75e8008040 comp rx=0 tx=0).stop 2024-09-12T01:42:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.394+0000 7f75f9e35640 1 -- 172.21.15.60:0/3820284268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40b6eb0 msgr2=0x7f75f40b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.394+0000 7f75f9e35640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40b6eb0 0x7f75f40b3880 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f75e4000c00 tx=0x7f75e40046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.394+0000 7f75f9e35640 1 -- 172.21.15.60:0/3820284268 shutdown_connections 2024-09-12T01:42:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.394+0000 7f75f9e35640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75f40d1b40 0x7f75f4162a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.394+0000 7f75f9e35640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f75e006be30 0x7f75e006e2f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.394+0000 7f75f9e35640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75f40b7290 0x7f75f4162510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.394+0000 7f75f9e35640 1 --2- 172.21.15.60:0/3820284268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75f40b6eb0 0x7f75f40b3880 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.394+0000 7f75f9e35640 1 -- 172.21.15.60:0/3820284268 >> 172.21.15.60:0/3820284268 conn(0x7f75f40d2450 msgr2=0x7f75f40b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.394+0000 7f75f9e35640 1 -- 172.21.15.60:0/3820284268 shutdown_connections 2024-09-12T01:42:23.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.394+0000 7f75f9e35640 1 -- 172.21.15.60:0/3820284268 wait complete. 2024-09-12T01:42:23.404 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:42:23.404 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:42:23.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.511+0000 7fb7b614b640 1 Processor -- start 2024-09-12T01:42:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.511+0000 7fb7b614b640 1 -- start start 2024-09-12T01:42:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.512+0000 7fb7b614b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb7b00d0f80 0x7fb7b00b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.512+0000 7fb7b614b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7b00b5680 con 0x7fb7b015c470 2024-09-12T01:42:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.512+0000 7fb7b614b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7b00d1560 con 0x7fb7b00b46d0 2024-09-12T01:42:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.512+0000 7fb7b614b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb7b00b4b10 con 0x7fb7b00d0f80 2024-09-12T01:42:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.512+0000 7fb7af7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb7b015c470 0x7fb7b0073c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44442/0 (socket says 172.21.15.60:44442) 2024-09-12T01:42:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.512+0000 7fb7af7fe640 1 -- 172.21.15.60:0/451028930 learned_addr learned my addr 172.21.15.60:0/451028930 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.513+0000 7fb7aeffd640 1 --2- 172.21.15.60:0/451028930 >> v2:172.21.15.60:3300/0 conn(0x7fb7b00d0f80 0x7fb7b00b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.513+0000 7fb7ae7fc640 1 -- 172.21.15.60:0/451028930 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 549547096 0 0) 0x7fb7b00b5680 con 0x7fb7b015c470 2024-09-12T01:42:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.513+0000 7fb7ae7fc640 1 -- 172.21.15.60:0/451028930 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb798003520 con 0x7fb7b015c470 2024-09-12T01:42:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.513+0000 7fb7aeffd640 1 -- 172.21.15.60:0/451028930 >> v1:172.21.15.105:6789/0 conn(0x7fb7b00b46d0 legacy=0x7fb7b00b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:23.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.513+0000 7fb7aeffd640 1 -- 172.21.15.60:0/451028930 >> v1:172.21.15.60:6789/0 conn(0x7fb7b015c470 legacy=0x7fb7b0073c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:23.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.513+0000 7fb7aeffd640 1 -- 172.21.15.60:0/451028930 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b00d1840 con 0x7fb7b00d0f80 2024-09-12T01:42:23.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.514+0000 7fb7aeffd640 1 --2- 172.21.15.60:0/451028930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b00d0f80 0x7fb7b00b4190 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40097a0 tx=0x7fb7a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd7c900603e2d9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:23.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.514+0000 7fb7ae7fc640 1 -- 172.21.15.60:0/451028930 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4037070 con 0x7fb7b00d0f80 2024-09-12T01:42:23.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.514+0000 7fb7ae7fc640 1 -- 172.21.15.60:0/451028930 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a4032440 con 0x7fb7b00d0f80 2024-09-12T01:42:23.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.514+0000 7fb7ae7fc640 1 -- 172.21.15.60:0/451028930 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4032810 con 0x7fb7b00d0f80 2024-09-12T01:42:23.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.514+0000 7fb7b614b640 1 -- 172.21.15.60:0/451028930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b00d0f80 msgr2=0x7fb7b00b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:23.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.514+0000 7fb7b614b640 1 --2- 172.21.15.60:0/451028930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b00d0f80 0x7fb7b00b4190 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40097a0 tx=0x7fb7a402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.514+0000 7fb7b614b640 1 -- 172.21.15.60:0/451028930 shutdown_connections 2024-09-12T01:42:23.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.514+0000 7fb7b614b640 1 --2- 172.21.15.60:0/451028930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b00d0f80 0x7fb7b00b4190 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.514+0000 7fb7b614b640 1 -- 172.21.15.60:0/451028930 >> 172.21.15.60:0/451028930 conn(0x7fb7b0062630 msgr2=0x7fb7b0062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:23.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.514+0000 7fb7b614b640 1 -- 172.21.15.60:0/451028930 shutdown_connections 2024-09-12T01:42:23.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.514+0000 7fb7b614b640 1 -- 172.21.15.60:0/451028930 wait complete. 2024-09-12T01:42:23.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.515+0000 7fb7b614b640 1 Processor -- start 2024-09-12T01:42:23.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.516+0000 7fb7b614b640 1 -- start start 2024-09-12T01:42:23.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.516+0000 7fb7b614b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7b00b46d0 0x7fb7b0156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:23.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.516+0000 7fb7b614b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b00d0f80 0x7fb7b00ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:23.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.516+0000 7fb7b614b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7b015c470 0x7fb7b015f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:23.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.516+0000 7fb7b614b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b00b6290 con 0x7fb7b00d0f80 2024-09-12T01:42:23.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.516+0000 7fb7b614b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b015c850 con 0x7fb7b015c470 2024-09-12T01:42:23.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.516+0000 7fb7b614b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb7b00b6410 con 0x7fb7b00b46d0 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b00d0f80 0x7fb7b00ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7aeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b00d0f80 0x7fb7b00ae890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56192/0 (socket says 172.21.15.60:56192) 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7aeffd640 1 -- 172.21.15.60:0/3040574574 learned_addr learned my addr 172.21.15.60:0/3040574574 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7aeffd640 1 -- 172.21.15.60:0/3040574574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7b00b46d0 msgr2=0x7fb7b0156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7af7fe640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7b00b46d0 0x7fb7b0156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7affff640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7b015c470 0x7fb7b015f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7aeffd640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7b00b46d0 0x7fb7b0156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7aeffd640 1 -- 172.21.15.60:0/3040574574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7b015c470 msgr2=0x7fb7b015f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7aeffd640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7b015c470 0x7fb7b015f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7aeffd640 1 -- 172.21.15.60:0/3040574574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b015fe00 con 0x7fb7b00d0f80 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7aeffd640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b00d0f80 0x7fb7b00ae890 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4000c00 tx=0x7fb7a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb797fff640 1 -- 172.21.15.60:0/3040574574 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4037040 con 0x7fb7b00d0f80 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb797fff640 1 -- 172.21.15.60:0/3040574574 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7a4042070 con 0x7fb7b00d0f80 2024-09-12T01:42:23.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7b614b640 1 -- 172.21.15.60:0/3040574574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b014f870 con 0x7fb7b00d0f80 2024-09-12T01:42:23.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb797fff640 1 -- 172.21.15.60:0/3040574574 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4030940 con 0x7fb7b00d0f80 2024-09-12T01:42:23.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.517+0000 7fb7b614b640 1 -- 172.21.15.60:0/3040574574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b006dc60 con 0x7fb7b00d0f80 2024-09-12T01:42:23.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.518+0000 7fb7b614b640 1 -- 172.21.15.60:0/3040574574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b00b4190 con 0x7fb7b00d0f80 2024-09-12T01:42:23.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.519+0000 7fb797fff640 1 -- 172.21.15.60:0/3040574574 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb7a4030ae0 con 0x7fb7b00d0f80 2024-09-12T01:42:23.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.519+0000 7fb797fff640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb79c06be30 0x7fb79c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:23.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.519+0000 7fb797fff640 1 -- 172.21.15.60:0/3040574574 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 4857+0+0 (secure 0 0 0) 0x7fb7a40ab3a0 con 0x7fb7b00d0f80 2024-09-12T01:42:23.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.519+0000 7fb7af7fe640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb79c06be30 0x7fb79c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:23.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.520+0000 7fb7af7fe640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb79c06be30 0x7fb79c06e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0000f60 tx=0x7fb7a0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:23.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.523+0000 7fb797fff640 1 -- 172.21.15.60:0/3040574574 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb7a4045360 con 0x7fb7b00d0f80 2024-09-12T01:42:23.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:23.702+0000 7fb7b614b640 1 -- 172.21.15.60:0/3040574574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb7b01596b0 con 0x7fb7b00d0f80 2024-09-12T01:42:24.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.701+0000 7fb797fff640 1 -- 172.21.15.60:0/3040574574 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v100) ==== 138+0+0 (secure 0 0 0) 0x7fb7a407a130 con 0x7fb7b00d0f80 2024-09-12T01:42:24.701 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-12T01:42:24.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.704+0000 7fb7b614b640 1 -- 172.21.15.60:0/3040574574 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb79c06be30 msgr2=0x7fb79c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:24.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.704+0000 7fb7b614b640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb79c06be30 0x7fb79c06e2f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0000f60 tx=0x7fb7a0009040 comp rx=0 tx=0).stop 2024-09-12T01:42:24.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.704+0000 7fb7b614b640 1 -- 172.21.15.60:0/3040574574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b00d0f80 msgr2=0x7fb7b00ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:24.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.704+0000 7fb7b614b640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b00d0f80 0x7fb7b00ae890 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4000c00 tx=0x7fb7a40046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:24.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.704+0000 7fb7b614b640 1 -- 172.21.15.60:0/3040574574 shutdown_connections 2024-09-12T01:42:24.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.704+0000 7fb7b614b640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb7b015c470 0x7fb7b015f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:24.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.704+0000 7fb7b614b640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7b00d0f80 0x7fb7b00ae890 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:24.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.704+0000 7fb7b614b640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb79c06be30 0x7fb79c06e2f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:24.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.704+0000 7fb7b614b640 1 --2- 172.21.15.60:0/3040574574 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb7b00b46d0 0x7fb7b0156550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:24.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.704+0000 7fb7b614b640 1 -- 172.21.15.60:0/3040574574 >> 172.21.15.60:0/3040574574 conn(0x7fb7b0062630 msgr2=0x7fb7b00d1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:24.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.704+0000 7fb7b614b640 1 -- 172.21.15.60:0/3040574574 shutdown_connections 2024-09-12T01:42:24.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.705+0000 7fb7b614b640 1 -- 172.21.15.60:0/3040574574 wait complete. 2024-09-12T01:42:24.719 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:42:24.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.838+0000 7fa20cf9f640 1 Processor -- start 2024-09-12T01:42:24.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.838+0000 7fa20cf9f640 1 -- start start 2024-09-12T01:42:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.839+0000 7fa20cf9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080cf1f0 0x7fa2080b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.839+0000 7fa20cf9f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2080cf860 con 0x7fa20815e7a0 2024-09-12T01:42:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.839+0000 7fa20cf9f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2080cfb40 con 0x7fa2080b6720 2024-09-12T01:42:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.839+0000 7fa20cf9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa2080d2ca0 con 0x7fa2080cf1f0 2024-09-12T01:42:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.839+0000 7fa20659c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa20815e7a0 0x7fa20806caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44458/0 (socket says 172.21.15.60:44458) 2024-09-12T01:42:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.839+0000 7fa20659c640 1 -- 172.21.15.60:0/931428382 learned_addr learned my addr 172.21.15.60:0/931428382 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:24.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.839+0000 7fa205d9b640 1 --2- 172.21.15.60:0/931428382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080cf1f0 0x7fa2080b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.839+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3285991093 0 0) 0x7fa2080cf860 con 0x7fa20815e7a0 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.839+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f0003520 con 0x7fa20815e7a0 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 641717484 0 0) 0x7fa1f0003520 con 0x7fa20815e7a0 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080cf1f0 msgr2=0x7fa2080b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 --2- 172.21.15.60:0/931428382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080cf1f0 0x7fa2080b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 >> v1:172.21.15.105:6789/0 conn(0x7fa2080b6720 legacy=0x7fa2080d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2080cfe20 con 0x7fa20815e7a0 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fa1f80019f0 con 0x7fa20815e7a0 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 >> v1:172.21.15.60:6789/0 conn(0x7fa20815e7a0 legacy=0x7fa20806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 --2- 172.21.15.60:0/931428382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f00039e0 0x7fa1f0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 --2- 172.21.15.60:0/931428382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1f0004390 0x7fa1f0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 --2- 172.21.15.60:0/931428382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080cf1f0 0x7fa1f0005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:24.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa2080d2ca0 con 0x7fa1f0004390 2024-09-12T01:42:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f000ba70 con 0x7fa1f00039e0 2024-09-12T01:42:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f000bc70 con 0x7fa2080cf1f0 2024-09-12T01:42:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa205d9b640 1 --2- 172.21.15.60:0/931428382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1f0004390 0x7fa1f0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa20659c640 1 --2- 172.21.15.60:0/931428382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f00039e0 0x7fa1f0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa206d9d640 1 --2- 172.21.15.60:0/931428382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080cf1f0 0x7fa1f0005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa205d9b640 1 -- 172.21.15.60:0/931428382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080cf1f0 msgr2=0x7fa1f0005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa205d9b640 1 --2- 172.21.15.60:0/931428382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa2080cf1f0 0x7fa1f0005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa205d9b640 1 -- 172.21.15.60:0/931428382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f00039e0 msgr2=0x7fa1f0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa205d9b640 1 --2- 172.21.15.60:0/931428382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa1f00039e0 0x7fa1f0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:24.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.840+0000 7fa205d9b640 1 -- 172.21.15.60:0/931428382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f0003520 con 0x7fa1f0004390 2024-09-12T01:42:24.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.841+0000 7fa205d9b640 1 --2- 172.21.15.60:0/931428382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1f0004390 0x7fa1f0004860 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009a90 tx=0x7fa1f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a5fff227f6220b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.841+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc036070 con 0x7fa1f0004390 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.841+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc031400 con 0x7fa1f0004390 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.841+0000 7fa20559a640 1 -- 172.21.15.60:0/931428382 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc009690 con 0x7fa1f0004390 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.842+0000 7fa20cf9f640 1 -- 172.21.15.60:0/931428382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1f0004390 msgr2=0x7fa1f0004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.842+0000 7fa20cf9f640 1 --2- 172.21.15.60:0/931428382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1f0004390 0x7fa1f0004860 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc009a90 tx=0x7fa1f0005830 comp rx=0 tx=0).stop 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.842+0000 7fa206d9d640 1 -- 172.21.15.60:0/931428382 reap_dead start 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.842+0000 7fa20cf9f640 1 -- 172.21.15.60:0/931428382 shutdown_connections 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.842+0000 7fa20cf9f640 1 -- 172.21.15.60:0/931428382 >> 172.21.15.60:0/931428382 conn(0x7fa2080d11e0 msgr2=0x7fa2080d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.842+0000 7fa20cf9f640 1 -- 172.21.15.60:0/931428382 shutdown_connections 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.842+0000 7fa20cf9f640 1 -- 172.21.15.60:0/931428382 wait complete. 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.843+0000 7fa20cf9f640 1 Processor -- start 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.843+0000 7fa20cf9f640 1 -- start start 2024-09-12T01:42:24.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa20cf9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f0004390 0x7fa208157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa20cf9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa208157fb0 0x7fa2081608c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa20cf9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa208160e00 0x7fa2081612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa20cf9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa20815eb80 con 0x7fa208157fb0 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa20cf9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa2080b7a00 con 0x7fa208160e00 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa20cf9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa20815ed00 con 0x7fa1f0004390 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa205d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa208157fb0 0x7fa2081608c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa205d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa208157fb0 0x7fa2081608c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56202/0 (socket says 172.21.15.60:56202) 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa205d9b640 1 -- 172.21.15.60:0/320139464 learned_addr learned my addr 172.21.15.60:0/320139464 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa20659c640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f0004390 0x7fa208157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa206d9d640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa208160e00 0x7fa2081612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa205d9b640 1 -- 172.21.15.60:0/320139464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f0004390 msgr2=0x7fa208157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa205d9b640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f0004390 0x7fa208157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa205d9b640 1 -- 172.21.15.60:0/320139464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa208160e00 msgr2=0x7fa2081612b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:24.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa205d9b640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa208160e00 0x7fa2081612b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa205d9b640 1 -- 172.21.15.60:0/320139464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa208158530 con 0x7fa208157fb0 2024-09-12T01:42:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa206d9d640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa208160e00 0x7fa2081612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.844+0000 7fa20659c640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f0004390 0x7fa208157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.845+0000 7fa205d9b640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa208157fb0 0x7fa2081608c0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc000c00 tx=0x7fa1fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.845+0000 7fa1f6ffd640 1 -- 172.21.15.60:0/320139464 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc040020 con 0x7fa208157fb0 2024-09-12T01:42:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.845+0000 7fa1f6ffd640 1 -- 172.21.15.60:0/320139464 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc03b660 con 0x7fa208157fb0 2024-09-12T01:42:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.845+0000 7fa20cf9f640 1 -- 172.21.15.60:0/320139464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa208158810 con 0x7fa208157fb0 2024-09-12T01:42:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.845+0000 7fa1f6ffd640 1 -- 172.21.15.60:0/320139464 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc036040 con 0x7fa208157fb0 2024-09-12T01:42:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.845+0000 7fa20cf9f640 1 -- 172.21.15.60:0/320139464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2081f5b70 con 0x7fa208157fb0 2024-09-12T01:42:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.846+0000 7fa20cf9f640 1 -- 172.21.15.60:0/320139464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2080b61e0 con 0x7fa208157fb0 2024-09-12T01:42:24.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.846+0000 7fa1f6ffd640 1 -- 172.21.15.60:0/320139464 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa1fc043020 con 0x7fa208157fb0 2024-09-12T01:42:24.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.847+0000 7fa1f6ffd640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa1e806be60 0x7fa1e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:24.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.847+0000 7fa1f6ffd640 1 -- 172.21.15.60:0/320139464 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5227+0+0 (secure 0 0 0) 0x7fa1fc0ab3b0 con 0x7fa208157fb0 2024-09-12T01:42:24.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.847+0000 7fa20659c640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa1e806be60 0x7fa1e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:24.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.847+0000 7fa20659c640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa1e806be60 0x7fa1e806e320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8001580 tx=0x7fa1f8006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:24.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:24.851+0000 7fa1f6ffd640 1 -- 172.21.15.60:0/320139464 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa1fc04a030 con 0x7fa208157fb0 2024-09-12T01:42:25.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.026+0000 7fa20cf9f640 1 -- 172.21.15.60:0/320139464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fa2080b4eb0 con 0x7fa208157fb0 2024-09-12T01:42:25.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.703+0000 7fa1f6ffd640 1 -- 172.21.15.60:0/320139464 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v101) ==== 170+0+0 (secure 0 0 0) 0x7fa1fc079f30 con 0x7fa208157fb0 2024-09-12T01:42:25.703 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-12T01:42:25.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.706+0000 7fa20cf9f640 1 -- 172.21.15.60:0/320139464 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa1e806be60 msgr2=0x7fa1e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:25.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.706+0000 7fa20cf9f640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa1e806be60 0x7fa1e806e320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8001580 tx=0x7fa1f8006040 comp rx=0 tx=0).stop 2024-09-12T01:42:25.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.706+0000 7fa20cf9f640 1 -- 172.21.15.60:0/320139464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa208157fb0 msgr2=0x7fa2081608c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:25.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.706+0000 7fa20cf9f640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa208157fb0 0x7fa2081608c0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc000c00 tx=0x7fa1fc004730 comp rx=0 tx=0).stop 2024-09-12T01:42:25.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.706+0000 7fa20cf9f640 1 -- 172.21.15.60:0/320139464 shutdown_connections 2024-09-12T01:42:25.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.706+0000 7fa20cf9f640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa208160e00 0x7fa2081612b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:25.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.706+0000 7fa20cf9f640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa208157fb0 0x7fa2081608c0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:25.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.706+0000 7fa20cf9f640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa1e806be60 0x7fa1e806e320 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:25.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.706+0000 7fa20cf9f640 1 --2- 172.21.15.60:0/320139464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa1f0004390 0x7fa208157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:25.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.706+0000 7fa20cf9f640 1 -- 172.21.15.60:0/320139464 >> 172.21.15.60:0/320139464 conn(0x7fa2080d11e0 msgr2=0x7fa2080b4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:25.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.706+0000 7fa20cf9f640 1 -- 172.21.15.60:0/320139464 shutdown_connections 2024-09-12T01:42:25.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.706+0000 7fa20cf9f640 1 -- 172.21.15.60:0/320139464 wait complete. 2024-09-12T01:42:25.729 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:42:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.838+0000 7f6b0d27b640 1 Processor -- start 2024-09-12T01:42:25.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.838+0000 7f6b0d27b640 1 -- start start 2024-09-12T01:42:25.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.839+0000 7f6b0d27b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b080d1130 0x7f6b080d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:25.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.839+0000 7f6b0d27b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b080d4530 con 0x7f6b080d0060 2024-09-12T01:42:25.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.839+0000 7f6b0d27b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b080d3490 con 0x7f6b080d1a50 2024-09-12T01:42:25.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.839+0000 7f6b0d27b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6b080d40a0 con 0x7f6b080d1130 2024-09-12T01:42:25.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.839+0000 7f6b077fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6b080d0060 0x7f6b080b8330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44464/0 (socket says 172.21.15.60:44464) 2024-09-12T01:42:25.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.839+0000 7f6b077fe640 1 -- 172.21.15.60:0/140207750 learned_addr learned my addr 172.21.15.60:0/140207750 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:25.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.839+0000 7f6b06ffd640 1 --2- 172.21.15.60:0/140207750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b080d1130 0x7f6b080d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:25.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.840+0000 7f6b05ffb640 1 -- 172.21.15.60:0/140207750 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299357291 0 0) 0x7f6b080d4530 con 0x7f6b080d0060 2024-09-12T01:42:25.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.840+0000 7f6b05ffb640 1 -- 172.21.15.60:0/140207750 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6af4003520 con 0x7f6b080d0060 2024-09-12T01:42:25.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.840+0000 7f6b05ffb640 1 -- 172.21.15.60:0/140207750 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 77566537 0 0) 0x7f6b080d3490 con 0x7f6b080d1a50 2024-09-12T01:42:25.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.840+0000 7f6b05ffb640 1 -- 172.21.15.60:0/140207750 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b080d4530 con 0x7f6b080d1a50 2024-09-12T01:42:25.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.840+0000 7f6b06ffd640 1 -- 172.21.15.60:0/140207750 >> v1:172.21.15.105:6789/0 conn(0x7f6b080d1a50 legacy=0x7f6b080b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:25.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.840+0000 7f6b06ffd640 1 -- 172.21.15.60:0/140207750 >> v1:172.21.15.60:6789/0 conn(0x7f6b080d0060 legacy=0x7f6b080b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:25.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.840+0000 7f6b05ffb640 1 -- 172.21.15.60:0/140207750 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3407349496 0 0) 0x7f6af4003520 con 0x7f6b080d0060 2024-09-12T01:42:25.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.840+0000 7f6b06ffd640 1 -- 172.21.15.60:0/140207750 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b080d3770 con 0x7f6b080d1130 2024-09-12T01:42:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.841+0000 7f6b06ffd640 1 --2- 172.21.15.60:0/140207750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b080d1130 0x7f6b080d1510 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009dc0 tx=0x7f6af802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed3c3504e28ca7ed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.841+0000 7f6b05ffb640 1 -- 172.21.15.60:0/140207750 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00001670 con 0x7f6b080d1130 2024-09-12T01:42:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.841+0000 7f6b05ffb640 1 -- 172.21.15.60:0/140207750 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af8007540 con 0x7f6b080d1130 2024-09-12T01:42:25.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.841+0000 7f6b05ffb640 1 -- 172.21.15.60:0/140207750 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af80078f0 con 0x7f6b080d1130 2024-09-12T01:42:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.841+0000 7f6b0d27b640 1 -- 172.21.15.60:0/140207750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b080d1130 msgr2=0x7f6b080d1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.841+0000 7f6b0d27b640 1 --2- 172.21.15.60:0/140207750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b080d1130 0x7f6b080d1510 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6af8009dc0 tx=0x7f6af802a660 comp rx=0 tx=0).stop 2024-09-12T01:42:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.841+0000 7f6b0d27b640 1 -- 172.21.15.60:0/140207750 shutdown_connections 2024-09-12T01:42:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.841+0000 7f6b0d27b640 1 --2- 172.21.15.60:0/140207750 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b080d1130 0x7f6b080d1510 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.841+0000 7f6b0d27b640 1 -- 172.21.15.60:0/140207750 >> 172.21.15.60:0/140207750 conn(0x7f6b0806c020 msgr2=0x7f6b0806c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.841+0000 7f6b0d27b640 1 -- 172.21.15.60:0/140207750 shutdown_connections 2024-09-12T01:42:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.841+0000 7f6b0d27b640 1 -- 172.21.15.60:0/140207750 wait complete. 2024-09-12T01:42:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.843+0000 7f6b0d27b640 1 Processor -- start 2024-09-12T01:42:25.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.843+0000 7f6b0d27b640 1 -- start start 2024-09-12T01:42:25.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.843+0000 7f6b0d27b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b080d1130 0x7f6b0815a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:25.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b0d27b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b080d1a50 0x7f6b08159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:25.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b0d27b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b081e8200 0x7f6b081e9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:25.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b0d27b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b080d1e90 con 0x7f6b081e8200 2024-09-12T01:42:25.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b0d27b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b080d3d30 con 0x7f6b080d1a50 2024-09-12T01:42:25.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b0d27b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6b080d3070 con 0x7f6b080d1130 2024-09-12T01:42:25.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b077fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b081e8200 0x7f6b081e9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:25.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b077fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b081e8200 0x7f6b081e9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56214/0 (socket says 172.21.15.60:56214) 2024-09-12T01:42:25.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b077fe640 1 -- 172.21.15.60:0/671180502 learned_addr learned my addr 172.21.15.60:0/671180502 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:25.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b06ffd640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b080d1130 0x7f6b0815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:25.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b067fc640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b080d1a50 0x7f6b08159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:25.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b077fe640 1 -- 172.21.15.60:0/671180502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b080d1130 msgr2=0x7f6b0815a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:25.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b077fe640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b080d1130 0x7f6b0815a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:25.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b077fe640 1 -- 172.21.15.60:0/671180502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b080d1a50 msgr2=0x7f6b08159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:25.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b077fe640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b080d1a50 0x7f6b08159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:25.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b077fe640 1 -- 172.21.15.60:0/671180502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b081e99b0 con 0x7f6b081e8200 2024-09-12T01:42:25.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b077fe640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b081e8200 0x7f6b081e9080 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c700 tx=0x7f6b0000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:25.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6aff7fe640 1 -- 172.21.15.60:0/671180502 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00017070 con 0x7f6b081e8200 2024-09-12T01:42:25.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b0d27b640 1 -- 172.21.15.60:0/671180502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b081e5d90 con 0x7f6b081e8200 2024-09-12T01:42:25.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6aff7fe640 1 -- 172.21.15.60:0/671180502 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b00005ad0 con 0x7f6b081e8200 2024-09-12T01:42:25.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6aff7fe640 1 -- 172.21.15.60:0/671180502 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00007070 con 0x7f6b081e8200 2024-09-12T01:42:25.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.844+0000 7f6b0d27b640 1 -- 172.21.15.60:0/671180502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b081e6350 con 0x7f6b081e8200 2024-09-12T01:42:25.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.845+0000 7f6b0d27b640 1 -- 172.21.15.60:0/671180502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b080d1510 con 0x7f6b081e8200 2024-09-12T01:42:25.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.846+0000 7f6aff7fe640 1 -- 172.21.15.60:0/671180502 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b0001a070 con 0x7f6b081e8200 2024-09-12T01:42:25.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.846+0000 7f6aff7fe640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ae806be30 0x7f6ae806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:25.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.847+0000 7f6aff7fe640 1 -- 172.21.15.60:0/671180502 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5609+0+0 (secure 0 0 0) 0x7f6b0008a370 con 0x7f6b081e8200 2024-09-12T01:42:25.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.847+0000 7f6b06ffd640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ae806be30 0x7f6ae806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:25.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.847+0000 7f6b06ffd640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ae806be30 0x7f6ae806e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6af8034000 tx=0x7f6af802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:25.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:25.851+0000 7f6aff7fe640 1 -- 172.21.15.60:0/671180502 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b00058610 con 0x7f6b081e8200 2024-09-12T01:42:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.062+0000 7f6b0d27b640 1 -- 172.21.15.60:0/671180502 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6b080cf960 con 0x7f6b081e8200 2024-09-12T01:42:26.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.724+0000 7f6aff7fe640 1 -- 172.21.15.60:0/671180502 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v58) ==== 174+0+0 (secure 0 0 0) 0x7f6b0005c910 con 0x7f6b081e8200 2024-09-12T01:42:26.725 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 16 and data pool 17 2024-09-12T01:42:26.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.732+0000 7f6b0d27b640 1 -- 172.21.15.60:0/671180502 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ae806be30 msgr2=0x7f6ae806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:26.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.732+0000 7f6b0d27b640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ae806be30 0x7f6ae806e2f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6af8034000 tx=0x7f6af802f000 comp rx=0 tx=0).stop 2024-09-12T01:42:26.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.732+0000 7f6b0d27b640 1 -- 172.21.15.60:0/671180502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b081e8200 msgr2=0x7f6b081e9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:26.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.732+0000 7f6b0d27b640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b081e8200 0x7f6b081e9080 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f6b0000c700 tx=0x7f6b0000cbc0 comp rx=0 tx=0).stop 2024-09-12T01:42:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.736+0000 7f6b0d27b640 1 -- 172.21.15.60:0/671180502 shutdown_connections 2024-09-12T01:42:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.736+0000 7f6b0d27b640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b081e8200 0x7f6b081e9080 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.736+0000 7f6b0d27b640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b080d1a50 0x7f6b08159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.736+0000 7f6b0d27b640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ae806be30 0x7f6ae806e2f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.736+0000 7f6b0d27b640 1 --2- 172.21.15.60:0/671180502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b080d1130 0x7f6b0815a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:26.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.736+0000 7f6b0d27b640 1 -- 172.21.15.60:0/671180502 >> 172.21.15.60:0/671180502 conn(0x7f6b0806c020 msgr2=0x7f6b080ce530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:26.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.739+0000 7f6b0d27b640 1 -- 172.21.15.60:0/671180502 shutdown_connections 2024-09-12T01:42:26.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.740+0000 7f6b0d27b640 1 -- 172.21.15.60:0/671180502 wait complete. 2024-09-12T01:42:26.757 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:42:26.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.866+0000 7f8de195f640 1 Processor -- start 2024-09-12T01:42:26.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.866+0000 7f8de195f640 1 -- start start 2024-09-12T01:42:26.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8de195f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8ddc0b6eb0 0x7f8ddc06fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:26.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8de195f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ddc0d1b40 0x7f8ddc06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:26.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8de195f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ddc0708d0 con 0x7f8ddc0b7290 2024-09-12T01:42:26.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8de195f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f8ddc070bb0 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8de195f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8ddc070e90 con 0x7f8ddc0b6eb0 2024-09-12T01:42:26.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8dda7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ddc0d1b40 0x7f8ddc06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:26.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8dda7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ddc0d1b40 0x7f8ddc06cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56218/0 (socket says 172.21.15.60:56218) 2024-09-12T01:42:26.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8dda7fc640 1 -- 172.21.15.60:0/934919006 learned_addr learned my addr 172.21.15.60:0/934919006 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:26.867 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8ddaffd640 1 --2- 172.21.15.60:0/934919006 >> v2:172.21.15.105:3300/0 conn(0x7f8ddc0b6eb0 0x7f8ddc06fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:26.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8dda7fc640 1 -- 172.21.15.60:0/934919006 >> v2:172.21.15.105:3300/0 conn(0x7f8ddc0b6eb0 msgr2=0x7f8ddc06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:26.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8dda7fc640 1 --2- 172.21.15.60:0/934919006 >> v2:172.21.15.105:3300/0 conn(0x7f8ddc0b6eb0 0x7f8ddc06fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:26.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8dda7fc640 1 -- 172.21.15.60:0/934919006 >> v1:172.21.15.105:6789/0 conn(0x7f8ddc0b7290 legacy=0x7f8ddc06d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:26.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8dda7fc640 1 -- 172.21.15.60:0/934919006 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc071170 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.867+0000 7f8ddaffd640 1 --2- 172.21.15.60:0/934919006 >> v2:172.21.15.105:3300/0 conn(0x7f8ddc0b6eb0 0x7f8ddc06fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:26.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.868+0000 7f8dda7fc640 1 --2- 172.21.15.60:0/934919006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ddc0d1b40 0x7f8ddc06cd20 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc072d60 tx=0x7f8dc402a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c2b942c516cef18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:26.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.868+0000 7f8dd9ffb640 1 -- 172.21.15.60:0/934919006 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4037070 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.868+0000 7f8dd9ffb640 1 -- 172.21.15.60:0/934919006 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc4032440 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.868+0000 7f8dd9ffb640 1 -- 172.21.15.60:0/934919006 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4032810 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.869+0000 7f8de195f640 1 -- 172.21.15.60:0/934919006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ddc0d1b40 msgr2=0x7f8ddc06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:26.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.869+0000 7f8de195f640 1 --2- 172.21.15.60:0/934919006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ddc0d1b40 0x7f8ddc06cd20 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc072d60 tx=0x7f8dc402a160 comp rx=0 tx=0).stop 2024-09-12T01:42:26.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.869+0000 7f8de195f640 1 -- 172.21.15.60:0/934919006 shutdown_connections 2024-09-12T01:42:26.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.869+0000 7f8de195f640 1 --2- 172.21.15.60:0/934919006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ddc0d1b40 0x7f8ddc06cd20 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:26.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.869+0000 7f8de195f640 1 --2- 172.21.15.60:0/934919006 >> v2:172.21.15.105:3300/0 conn(0x7f8ddc0b6eb0 0x7f8ddc06fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:26.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.869+0000 7f8de195f640 1 -- 172.21.15.60:0/934919006 >> 172.21.15.60:0/934919006 conn(0x7f8ddc0d2450 msgr2=0x7f8ddc0d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:26.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.869+0000 7f8de195f640 1 -- 172.21.15.60:0/934919006 shutdown_connections 2024-09-12T01:42:26.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.869+0000 7f8de195f640 1 -- 172.21.15.60:0/934919006 wait complete. 2024-09-12T01:42:26.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.870+0000 7f8de195f640 1 Processor -- start 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.870+0000 7f8de195f640 1 -- start start 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8de195f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ddc0b6eb0 0x7f8ddc1550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8de195f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ddc0b7290 0x7f8ddc15e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8de195f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ddc0d1b40 0x7f8ddc1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8de195f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc071970 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8de195f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8ddc070240 con 0x7f8ddc0b6eb0 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8de195f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8ddc071af0 con 0x7f8ddc0b7290 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8ddb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ddc0d1b40 0x7f8ddc1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8ddb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ddc0d1b40 0x7f8ddc1587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56232/0 (socket says 172.21.15.60:56232) 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8ddb7fe640 1 -- 172.21.15.60:0/365741485 learned_addr learned my addr 172.21.15.60:0/365741485 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8ddaffd640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ddc0b6eb0 0x7f8ddc1550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8dda7fc640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ddc0b7290 0x7f8ddc15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:26.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8ddb7fe640 1 -- 172.21.15.60:0/365741485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ddc0b7290 msgr2=0x7f8ddc15e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:26.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.871+0000 7f8ddb7fe640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ddc0b7290 0x7f8ddc15e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:26.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.872+0000 7f8ddb7fe640 1 -- 172.21.15.60:0/365741485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ddc0b6eb0 msgr2=0x7f8ddc1550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:26.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.872+0000 7f8ddb7fe640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ddc0b6eb0 0x7f8ddc1550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:26.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.872+0000 7f8ddb7fe640 1 -- 172.21.15.60:0/365741485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ddc15eac0 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.872+0000 7f8ddb7fe640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ddc0d1b40 0x7f8ddc1587c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400b440 tx=0x7f8dd400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:26.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.872+0000 7f8dd3fff640 1 -- 172.21.15.60:0/365741485 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4015020 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.872+0000 7f8dd3fff640 1 -- 172.21.15.60:0/365741485 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dd4011830 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.872+0000 7f8de195f640 1 -- 172.21.15.60:0/365741485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ddc15eda0 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.872+0000 7f8dd3fff640 1 -- 172.21.15.60:0/365741485 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4011c20 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.872+0000 7f8de195f640 1 -- 172.21.15.60:0/365741485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ddc15f360 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.873+0000 7f8de195f640 1 -- 172.21.15.60:0/365741485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ddc06fd00 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.873+0000 7f8dd3fff640 1 -- 172.21.15.60:0/365741485 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8dd4018020 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.874+0000 7f8dd3fff640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8dbc06be60 0x7f8dbc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:26.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.874+0000 7f8dd3fff640 1 -- 172.21.15.60:0/365741485 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f8dd408ab30 con 0x7f8ddc0d1b40 2024-09-12T01:42:26.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.874+0000 7f8ddaffd640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8dbc06be60 0x7f8dbc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:26.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.874+0000 7f8ddaffd640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8dbc06be60 0x7f8dbc06e320 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00f500 tx=0x7f8dcc007770 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:26.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:26.878+0000 7f8dd3fff640 1 -- 172.21.15.60:0/365741485 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8dd401f020 con 0x7f8ddc0d1b40 2024-09-12T01:42:27.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.054+0000 7f8de195f640 1 -- 172.21.15.60:0/365741485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ddc06c740 con 0x7f8ddc0d1b40 2024-09-12T01:42:27.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.055+0000 7f8dd3fff640 1 -- 172.21.15.60:0/365741485 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16720 (secure 0 0 0) 0x7f8dd4058f20 con 0x7f8ddc0d1b40 2024-09-12T01:42:27.055 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:27.055 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":102,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:42:26.062776+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:42:23.733621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-12T01:42:25.056873+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:42:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.057+0000 7f8de195f640 1 -- 172.21.15.60:0/365741485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8dbc06be60 msgr2=0x7f8dbc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.057+0000 7f8de195f640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8dbc06be60 0x7f8dbc06e320 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00f500 tx=0x7f8dcc007770 comp rx=0 tx=0).stop 2024-09-12T01:42:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.057+0000 7f8de195f640 1 -- 172.21.15.60:0/365741485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ddc0d1b40 msgr2=0x7f8ddc1587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.057+0000 7f8de195f640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ddc0d1b40 0x7f8ddc1587c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400b440 tx=0x7f8dd400b900 comp rx=0 tx=0).stop 2024-09-12T01:42:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.057+0000 7f8de195f640 1 -- 172.21.15.60:0/365741485 shutdown_connections 2024-09-12T01:42:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.057+0000 7f8de195f640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ddc0d1b40 0x7f8ddc1587c0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.057+0000 7f8de195f640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8dbc06be60 0x7f8dbc06e320 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.057+0000 7f8de195f640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8ddc0b7290 0x7f8ddc15e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.057+0000 7f8de195f640 1 --2- 172.21.15.60:0/365741485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8ddc0b6eb0 0x7f8ddc1550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.057+0000 7f8de195f640 1 -- 172.21.15.60:0/365741485 >> 172.21.15.60:0/365741485 conn(0x7f8ddc0d2450 msgr2=0x7f8ddc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.058+0000 7f8de195f640 1 -- 172.21.15.60:0/365741485 shutdown_connections 2024-09-12T01:42:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.058+0000 7f8de195f640 1 -- 172.21.15.60:0/365741485 wait complete. 2024-09-12T01:42:27.068 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:42:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.171+0000 7f610f0a5640 1 Processor -- start 2024-09-12T01:42:27.171 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.172+0000 7f610f0a5640 1 -- start start 2024-09-12T01:42:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.172+0000 7f610f0a5640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f61080d3310 0x7f61080d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.172+0000 7f610f0a5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61080d1650 0x7f61080b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.172+0000 7f610f0a5640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610815ea40 con 0x7f610815e660 2024-09-12T01:42:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.172+0000 7f610f0a5640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f61080d1a90 con 0x7f61080d3310 2024-09-12T01:42:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.172+0000 7f610f0a5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f61080d3870 con 0x7f61080d1650 2024-09-12T01:42:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.172+0000 7f610ce41640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f610815e660 0x7f61080cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44478/0 (socket says 172.21.15.60:44478) 2024-09-12T01:42:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.172+0000 7f610ce41640 1 -- 172.21.15.60:0/403503464 learned_addr learned my addr 172.21.15.60:0/403503464 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f610d642640 1 --2- 172.21.15.60:0/403503464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61080d1650 0x7f61080b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f6107fff640 1 --2- 172.21.15.60:0/403503464 >> v2:172.21.15.105:3300/0 conn(0x7f61080d3310 0x7f61080d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1682486710 0 0) 0x7f610815ea40 con 0x7f610815e660 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60f4003520 con 0x7f610815e660 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2221670858 0 0) 0x7f60f4003520 con 0x7f610815e660 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61080d1650 msgr2=0x7f61080b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 --2- 172.21.15.60:0/403503464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61080d1650 0x7f61080b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 >> v2:172.21.15.105:3300/0 conn(0x7f61080d3310 msgr2=0x7f61080d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 --2- 172.21.15.60:0/403503464 >> v2:172.21.15.105:3300/0 conn(0x7f61080d3310 0x7f61080d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61080d3b50 con 0x7f610815e660 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f60f80019f0 con 0x7f610815e660 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f6107fff640 1 --2- 172.21.15.60:0/403503464 >> v2:172.21.15.105:3300/0 conn(0x7f61080d3310 0x7f61080d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 >> v1:172.21.15.60:6789/0 conn(0x7f610815e660 legacy=0x7f61080cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 --2- 172.21.15.60:0/403503464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60f40039b0 0x7f60f4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 --2- 172.21.15.60:0/403503464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4004800 0x7f60f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 --2- 172.21.15.60:0/403503464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61080d1650 0x7f60f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f61080d1a90 con 0x7f60f40039b0 2024-09-12T01:42:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f61080d3870 con 0x7f60f4004800 2024-09-12T01:42:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f60f400b9c0 con 0x7f61080d1650 2024-09-12T01:42:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f610ce41640 1 --2- 172.21.15.60:0/403503464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60f40039b0 0x7f60f4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f6107fff640 1 --2- 172.21.15.60:0/403503464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4004800 0x7f60f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.173+0000 7f610d642640 1 --2- 172.21.15.60:0/403503464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61080d1650 0x7f60f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.174+0000 7f610ce41640 1 -- 172.21.15.60:0/403503464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61080d1650 msgr2=0x7f60f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.174+0000 7f610ce41640 1 --2- 172.21.15.60:0/403503464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61080d1650 0x7f60f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.174+0000 7f610ce41640 1 -- 172.21.15.60:0/403503464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4004800 msgr2=0x7f60f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.174+0000 7f610ce41640 1 --2- 172.21.15.60:0/403503464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f60f4004800 0x7f60f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.174+0000 7f610ce41640 1 -- 172.21.15.60:0/403503464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f4003520 con 0x7f60f40039b0 2024-09-12T01:42:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.174+0000 7f610ce41640 1 --2- 172.21.15.60:0/403503464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60f40039b0 0x7f60f4003dd0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f60f800a880 tx=0x7f60f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a0475e10db0723 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.174+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f800a4a0 con 0x7f60f40039b0 2024-09-12T01:42:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.174+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60f802f070 con 0x7f60f40039b0 2024-09-12T01:42:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.174+0000 7f61077fe640 1 -- 172.21.15.60:0/403503464 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f802bd00 con 0x7f60f40039b0 2024-09-12T01:42:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.175+0000 7f610f0a5640 1 -- 172.21.15.60:0/403503464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60f40039b0 msgr2=0x7f60f4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.175+0000 7f610f0a5640 1 --2- 172.21.15.60:0/403503464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60f40039b0 0x7f60f4003dd0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f60f800a880 tx=0x7f60f4005830 comp rx=0 tx=0).stop 2024-09-12T01:42:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.175+0000 7f610d642640 1 -- 172.21.15.60:0/403503464 reap_dead start 2024-09-12T01:42:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.175+0000 7f610f0a5640 1 -- 172.21.15.60:0/403503464 shutdown_connections 2024-09-12T01:42:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.175+0000 7f610f0a5640 1 -- 172.21.15.60:0/403503464 >> 172.21.15.60:0/403503464 conn(0x7f61080b6410 msgr2=0x7f61080b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.175+0000 7f610f0a5640 1 -- 172.21.15.60:0/403503464 shutdown_connections 2024-09-12T01:42:27.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.175+0000 7f610f0a5640 1 -- 172.21.15.60:0/403503464 wait complete. 2024-09-12T01:42:27.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.176+0000 7f610f0a5640 1 Processor -- start 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.176+0000 7f610f0a5640 1 -- start start 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.177+0000 7f610f0a5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f40039b0 0x7f61081f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.177+0000 7f610f0a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61080cd6e0 0x7f61080ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.177+0000 7f610f0a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61080cc0f0 0x7f61080cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.177+0000 7f610f0a5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f61080d43f0 con 0x7f61080cc0f0 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.177+0000 7f610f0a5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f61080d4110 con 0x7f61080cd6e0 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.177+0000 7f610f0a5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f61080b7b70 con 0x7f60f40039b0 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.177+0000 7f610d642640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61080cc0f0 0x7f61080cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.177+0000 7f610d642640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61080cc0f0 0x7f61080cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56244/0 (socket says 172.21.15.60:56244) 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.177+0000 7f610d642640 1 -- 172.21.15.60:0/738857826 learned_addr learned my addr 172.21.15.60:0/738857826 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.177+0000 7f6107fff640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61080cd6e0 0x7f61080ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.177+0000 7f610ce41640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f40039b0 0x7f61081f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.178+0000 7f610d642640 1 -- 172.21.15.60:0/738857826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f40039b0 msgr2=0x7f61081f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.178+0000 7f610d642640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f40039b0 0x7f61081f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.178+0000 7f610d642640 1 -- 172.21.15.60:0/738857826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61080cd6e0 msgr2=0x7f61080ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.178+0000 7f610d642640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61080cd6e0 0x7f61080ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.178+0000 7f610d642640 1 -- 172.21.15.60:0/738857826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61080cc640 con 0x7f61080cc0f0 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.178+0000 7f610d642640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61080cc0f0 0x7f61080cefe0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f6108069960 tx=0x7f6100011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.178+0000 7f61057fa640 1 -- 172.21.15.60:0/738857826 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6100019020 con 0x7f61080cc0f0 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.178+0000 7f61057fa640 1 -- 172.21.15.60:0/738857826 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6100004240 con 0x7f61080cc0f0 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.178+0000 7f610f0a5640 1 -- 172.21.15.60:0/738857826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61080cc920 con 0x7f61080cc0f0 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.178+0000 7f61057fa640 1 -- 172.21.15.60:0/738857826 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610000f770 con 0x7f61080cc0f0 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.178+0000 7f610f0a5640 1 -- 172.21.15.60:0/738857826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61080ccee0 con 0x7f61080cc0f0 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.179+0000 7f610f0a5640 1 -- 172.21.15.60:0/738857826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61080d1110 con 0x7f61080cc0f0 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.179+0000 7f61057fa640 1 -- 172.21.15.60:0/738857826 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f610001c020 con 0x7f61080cc0f0 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.180+0000 7f61057fa640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f60e806be30 0x7f60e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.180+0000 7f610ce41640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f60e806be30 0x7f60e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.180+0000 7f61057fa640 1 -- 172.21.15.60:0/738857826 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f610008b000 con 0x7f61080cc0f0 2024-09-12T01:42:27.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.181+0000 7f610ce41640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f60e806be30 0x7f60e806e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f60f8033000 tx=0x7f60f8007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:27.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.185+0000 7f61057fa640 1 -- 172.21.15.60:0/738857826 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6100023020 con 0x7f61080cc0f0 2024-09-12T01:42:27.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.361+0000 7f610f0a5640 1 -- 172.21.15.60:0/738857826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61080ce880 con 0x7f61080cc0f0 2024-09-12T01:42:27.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.362+0000 7f61057fa640 1 -- 172.21.15.60:0/738857826 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) ==== 74+0+16720 (secure 0 0 0) 0x7f61000593f0 con 0x7f61080cc0f0 2024-09-12T01:42:27.362 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:27.362 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":102,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:42:26.062776+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:42:23.733621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-12T01:42:25.056873+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:42:27.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.364+0000 7f610f0a5640 1 -- 172.21.15.60:0/738857826 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f60e806be30 msgr2=0x7f60e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.364+0000 7f610f0a5640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f60e806be30 0x7f60e806e2f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f60f8033000 tx=0x7f60f8007000 comp rx=0 tx=0).stop 2024-09-12T01:42:27.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.364+0000 7f610f0a5640 1 -- 172.21.15.60:0/738857826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61080cc0f0 msgr2=0x7f61080cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.364+0000 7f610f0a5640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61080cc0f0 0x7f61080cefe0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f6108069960 tx=0x7f6100011cf0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.364+0000 7f610f0a5640 1 -- 172.21.15.60:0/738857826 shutdown_connections 2024-09-12T01:42:27.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.364+0000 7f610f0a5640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61080cc0f0 0x7f61080cefe0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.364+0000 7f610f0a5640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61080cd6e0 0x7f61080ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.364+0000 7f610f0a5640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f60e806be30 0x7f60e806e2f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.364+0000 7f610f0a5640 1 --2- 172.21.15.60:0/738857826 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f60f40039b0 0x7f61081f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.364+0000 7f610f0a5640 1 -- 172.21.15.60:0/738857826 >> 172.21.15.60:0/738857826 conn(0x7f61080b6410 msgr2=0x7f610815c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:27.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.364+0000 7f610f0a5640 1 -- 172.21.15.60:0/738857826 shutdown_connections 2024-09-12T01:42:27.365 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.364+0000 7f610f0a5640 1 -- 172.21.15.60:0/738857826 wait complete. 2024-09-12T01:42:27.375 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:42:27.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.481+0000 7f629e1e8640 1 Processor -- start 2024-09-12T01:42:27.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.481+0000 7f629e1e8640 1 -- start start 2024-09-12T01:42:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f629e1e8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f629815e750 0x7f62980cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f629e1e8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62980cfb70 0x7f62980b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f629e1e8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f62980b69e0 0x7f629806bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f629e1e8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f62980d43c0 con 0x7f629815e750 2024-09-12T01:42:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f629e1e8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f62980d33b0 con 0x7f62980b69e0 2024-09-12T01:42:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f629e1e8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f62980b7ac0 con 0x7f62980cfb70 2024-09-12T01:42:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f62977fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f629815e750 0x7f62980cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f62977fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f629815e750 0x7f62980cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56252/0 (socket says 172.21.15.60:56252) 2024-09-12T01:42:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f62977fe640 1 -- 172.21.15.60:0/558989708 learned_addr learned my addr 172.21.15.60:0/558989708 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f6297fff640 1 --2- 172.21.15.60:0/558989708 >> v2:172.21.15.105:3300/0 conn(0x7f62980b69e0 0x7f629806bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f6296ffd640 1 --2- 172.21.15.60:0/558989708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62980cfb70 0x7f62980b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f62977fe640 1 -- 172.21.15.60:0/558989708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62980cfb70 msgr2=0x7f62980b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f62977fe640 1 --2- 172.21.15.60:0/558989708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62980cfb70 0x7f62980b64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f62977fe640 1 -- 172.21.15.60:0/558989708 >> v2:172.21.15.105:3300/0 conn(0x7f62980b69e0 msgr2=0x7f629806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f62977fe640 1 --2- 172.21.15.60:0/558989708 >> v2:172.21.15.105:3300/0 conn(0x7f62980b69e0 0x7f629806bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f62977fe640 1 -- 172.21.15.60:0/558989708 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62980b7790 con 0x7f629815e750 2024-09-12T01:42:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.482+0000 7f6297fff640 1 --2- 172.21.15.60:0/558989708 >> v2:172.21.15.105:3300/0 conn(0x7f62980b69e0 0x7f629806bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.483+0000 7f62977fe640 1 --2- 172.21.15.60:0/558989708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629815e750 0x7f62980cf630 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f62980b7c40 tx=0x7f628802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82aaed433d06317 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.483+0000 7f62967fc640 1 -- 172.21.15.60:0/558989708 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288037070 con 0x7f629815e750 2024-09-12T01:42:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.483+0000 7f62967fc640 1 -- 172.21.15.60:0/558989708 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6288032440 con 0x7f629815e750 2024-09-12T01:42:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.483+0000 7f62967fc640 1 -- 172.21.15.60:0/558989708 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6288032810 con 0x7f629815e750 2024-09-12T01:42:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.483+0000 7f629e1e8640 1 -- 172.21.15.60:0/558989708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629815e750 msgr2=0x7f62980cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.484+0000 7f629e1e8640 1 --2- 172.21.15.60:0/558989708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629815e750 0x7f62980cf630 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f62980b7c40 tx=0x7f628802a130 comp rx=0 tx=0).stop 2024-09-12T01:42:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.484+0000 7f629e1e8640 1 -- 172.21.15.60:0/558989708 shutdown_connections 2024-09-12T01:42:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.484+0000 7f629e1e8640 1 --2- 172.21.15.60:0/558989708 >> v2:172.21.15.105:3300/0 conn(0x7f62980b69e0 0x7f629806bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.484+0000 7f629e1e8640 1 --2- 172.21.15.60:0/558989708 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62980cfb70 0x7f62980b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.484+0000 7f629e1e8640 1 --2- 172.21.15.60:0/558989708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f629815e750 0x7f62980cf630 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.484+0000 7f629e1e8640 1 -- 172.21.15.60:0/558989708 >> 172.21.15.60:0/558989708 conn(0x7f62980d1500 msgr2=0x7f62980d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.484+0000 7f629e1e8640 1 -- 172.21.15.60:0/558989708 shutdown_connections 2024-09-12T01:42:27.486 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.484+0000 7f629e1e8640 1 -- 172.21.15.60:0/558989708 wait complete. 2024-09-12T01:42:27.488 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.485+0000 7f629e1e8640 1 Processor -- start 2024-09-12T01:42:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.485+0000 7f629e1e8640 1 -- start start 2024-09-12T01:42:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f629e1e8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62980b69e0 0x7f6298157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f629e1e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62980cfb70 0x7f6298158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f629e1e8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629815e750 0x7f6298159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f629e1e8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f62980d3bc0 con 0x7f62980cfb70 2024-09-12T01:42:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f629e1e8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f62980d38e0 con 0x7f629815e750 2024-09-12T01:42:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f629e1e8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f629815eb30 con 0x7f62980b69e0 2024-09-12T01:42:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f6296ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62980cfb70 0x7f6298158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f6296ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62980cfb70 0x7f6298158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56256/0 (socket says 172.21.15.60:56256) 2024-09-12T01:42:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f6296ffd640 1 -- 172.21.15.60:0/1945269936 learned_addr learned my addr 172.21.15.60:0/1945269936 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f62977fe640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62980b69e0 0x7f6298157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.489 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f6297fff640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629815e750 0x7f6298159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f6296ffd640 1 -- 172.21.15.60:0/1945269936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62980b69e0 msgr2=0x7f6298157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f6296ffd640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62980b69e0 0x7f6298157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f6296ffd640 1 -- 172.21.15.60:0/1945269936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629815e750 msgr2=0x7f6298159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f6296ffd640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629815e750 0x7f6298159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.486+0000 7f6296ffd640 1 -- 172.21.15.60:0/1945269936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6298158fc0 con 0x7f62980cfb70 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.487+0000 7f6296ffd640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62980cfb70 0x7f6298158570 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c7f0 tx=0x7f628c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.487+0000 7f627ffff640 1 -- 172.21.15.60:0/1945269936 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c015070 con 0x7f62980cfb70 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.487+0000 7f627ffff640 1 -- 172.21.15.60:0/1945269936 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f628c004220 con 0x7f62980cfb70 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.487+0000 7f629e1e8640 1 -- 172.21.15.60:0/1945269936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62981592a0 con 0x7f62980cfb70 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.487+0000 7f627ffff640 1 -- 172.21.15.60:0/1945269936 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628c007620 con 0x7f62980cfb70 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.487+0000 7f629e1e8640 1 -- 172.21.15.60:0/1945269936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6298159860 con 0x7f62980cfb70 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.488+0000 7f629e1e8640 1 -- 172.21.15.60:0/1945269936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62980b64a0 con 0x7f62980cfb70 2024-09-12T01:42:27.490 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.488+0000 7f627ffff640 1 -- 172.21.15.60:0/1945269936 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f628c0077c0 con 0x7f62980cfb70 2024-09-12T01:42:27.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.489+0000 7f627ffff640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f628406be30 0x7f628406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.489+0000 7f627ffff640 1 -- 172.21.15.60:0/1945269936 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5709+0+0 (secure 0 0 0) 0x7f628c08ac60 con 0x7f62980cfb70 2024-09-12T01:42:27.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.489+0000 7f62977fe640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f628406be30 0x7f628406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.491 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.489+0000 7f62977fe640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f628406be30 0x7f628406e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6288034000 tx=0x7f628802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:27.492 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.493+0000 7f627ffff640 1 -- 172.21.15.60:0/1945269936 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f628c058fc0 con 0x7f62980cfb70 2024-09-12T01:42:27.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.704+0000 7f629e1e8640 1 -- 172.21.15.60:0/1945269936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f629815bc00 con 0x7f62980cfb70 2024-09-12T01:42:27.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.802+0000 7f627ffff640 1 -- 172.21.15.60:0/1945269936 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v60) ==== 118+0+0 (secure 0 0 0) 0x7f628c05d2c0 con 0x7f62980cfb70 2024-09-12T01:42:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.804+0000 7f629e1e8640 1 -- 172.21.15.60:0/1945269936 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f628406be30 msgr2=0x7f628406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.804+0000 7f629e1e8640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f628406be30 0x7f628406e2f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6288034000 tx=0x7f628802e000 comp rx=0 tx=0).stop 2024-09-12T01:42:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.804+0000 7f629e1e8640 1 -- 172.21.15.60:0/1945269936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62980cfb70 msgr2=0x7f6298158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.804+0000 7f629e1e8640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62980cfb70 0x7f6298158570 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f628c00c7f0 tx=0x7f628c00ccb0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.804+0000 7f629e1e8640 1 -- 172.21.15.60:0/1945269936 shutdown_connections 2024-09-12T01:42:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.804+0000 7f629e1e8640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f629815e750 0x7f6298159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.804+0000 7f629e1e8640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f62980cfb70 0x7f6298158570 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.804+0000 7f629e1e8640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f628406be30 0x7f628406e2f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.804+0000 7f629e1e8640 1 --2- 172.21.15.60:0/1945269936 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f62980b69e0 0x7f6298157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.804+0000 7f629e1e8640 1 -- 172.21.15.60:0/1945269936 >> 172.21.15.60:0/1945269936 conn(0x7f62980d1500 msgr2=0x7f62980d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.804+0000 7f629e1e8640 1 -- 172.21.15.60:0/1945269936 shutdown_connections 2024-09-12T01:42:27.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.804+0000 7f629e1e8640 1 -- 172.21.15.60:0/1945269936 wait complete. 2024-09-12T01:42:27.815 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:42:27.815 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:42:27.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.920+0000 7f550745e640 1 Processor -- start 2024-09-12T01:42:27.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.921+0000 7f550745e640 1 -- start start 2024-09-12T01:42:27.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.921+0000 7f550745e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f550015e7a0 0x7f550006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.921+0000 7f550745e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55000b68f0 0x7f55000d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.921+0000 7f550745e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55000cf860 con 0x7f55000cf1f0 2024-09-12T01:42:27.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.921+0000 7f550745e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f55000d2ca0 con 0x7f550015e7a0 2024-09-12T01:42:27.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.921+0000 7f550745e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f55000cfb40 con 0x7f55000b68f0 2024-09-12T01:42:27.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.922+0000 7f55051fa640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f550015e7a0 0x7f550006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.922+0000 7f55059fb640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55000b68f0 0x7f55000d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.922+0000 7f55051fa640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f550015e7a0 0x7f550006caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:39990/0 (socket says 172.21.15.60:39990) 2024-09-12T01:42:27.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.922+0000 7f55051fa640 1 -- 172.21.15.60:0/3778763603 learned_addr learned my addr 172.21.15.60:0/3778763603 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:27.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.922+0000 7f55051fa640 1 -- 172.21.15.60:0/3778763603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55000b68f0 msgr2=0x7f55000d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:27.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.922+0000 7f55051fa640 1 --2- 172.21.15.60:0/3778763603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55000b68f0 0x7f55000d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.922+0000 7f55051fa640 1 -- 172.21.15.60:0/3778763603 >> v1:172.21.15.105:6789/0 conn(0x7f55000cf1f0 legacy=0x7f55000b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.922+0000 7f54f7fff640 1 -- 172.21.15.60:0/3778763603 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604404551 0 0) 0x7f55000cf860 con 0x7f55000cf1f0 2024-09-12T01:42:27.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.922+0000 7f55051fa640 1 -- 172.21.15.60:0/3778763603 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55000cfe20 con 0x7f550015e7a0 2024-09-12T01:42:27.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.922+0000 7f55059fb640 1 --2- 172.21.15.60:0/3778763603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55000b68f0 0x7f55000d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:27.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.923+0000 7f55051fa640 1 --2- 172.21.15.60:0/3778763603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f550015e7a0 0x7f550006caa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009870 tx=0x7f54fc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c78b2a0ce4c22bee server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:27.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.923+0000 7f54f7fff640 1 -- 172.21.15.60:0/3778763603 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc037070 con 0x7f550015e7a0 2024-09-12T01:42:27.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.923+0000 7f54f7fff640 1 -- 172.21.15.60:0/3778763603 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54fc032440 con 0x7f550015e7a0 2024-09-12T01:42:27.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.923+0000 7f54f7fff640 1 -- 172.21.15.60:0/3778763603 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54fc032810 con 0x7f550015e7a0 2024-09-12T01:42:27.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.924+0000 7f550745e640 1 -- 172.21.15.60:0/3778763603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f550015e7a0 msgr2=0x7f550006caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.924+0000 7f550745e640 1 --2- 172.21.15.60:0/3778763603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f550015e7a0 0x7f550006caa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009870 tx=0x7f54fc02a1c0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.924+0000 7f550745e640 1 -- 172.21.15.60:0/3778763603 shutdown_connections 2024-09-12T01:42:27.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.924+0000 7f550745e640 1 --2- 172.21.15.60:0/3778763603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f55000b68f0 0x7f55000d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.924+0000 7f550745e640 1 --2- 172.21.15.60:0/3778763603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f550015e7a0 0x7f550006caa0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.924+0000 7f550745e640 1 -- 172.21.15.60:0/3778763603 >> 172.21.15.60:0/3778763603 conn(0x7f55000d11e0 msgr2=0x7f55000d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:27.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.924+0000 7f550745e640 1 -- 172.21.15.60:0/3778763603 shutdown_connections 2024-09-12T01:42:27.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.924+0000 7f550745e640 1 -- 172.21.15.60:0/3778763603 wait complete. 2024-09-12T01:42:27.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.925+0000 7f550745e640 1 Processor -- start 2024-09-12T01:42:27.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.925+0000 7f550745e640 1 -- start start 2024-09-12T01:42:27.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.926+0000 7f550745e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55000b68f0 0x7f5500161c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.926+0000 7f550745e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000cf1f0 0x7f55000ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.926+0000 7f550745e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f550015e7a0 0x7f55000ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.926+0000 7f550745e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f550006cfe0 con 0x7f55000cf1f0 2024-09-12T01:42:27.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.926+0000 7f550745e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f55000b7a00 con 0x7f55000b68f0 2024-09-12T01:42:27.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.926+0000 7f550745e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f550015eb80 con 0x7f550015e7a0 2024-09-12T01:42:27.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.926+0000 7f55049f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000cf1f0 0x7f55000ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.926+0000 7f55049f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000cf1f0 0x7f55000ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56258/0 (socket says 172.21.15.60:56258) 2024-09-12T01:42:27.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.926+0000 7f55049f9640 1 -- 172.21.15.60:0/2159645382 learned_addr learned my addr 172.21.15.60:0/2159645382 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.926+0000 7f55059fb640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f550015e7a0 0x7f55000ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.926+0000 7f55051fa640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55000b68f0 0x7f5500161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.927+0000 7f55049f9640 1 -- 172.21.15.60:0/2159645382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f550015e7a0 msgr2=0x7f55000ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.927+0000 7f55049f9640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f550015e7a0 0x7f55000ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.927+0000 7f55049f9640 1 -- 172.21.15.60:0/2159645382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55000b68f0 msgr2=0x7f5500161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.927+0000 7f55049f9640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55000b68f0 0x7f5500161c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.927+0000 7f55049f9640 1 -- 172.21.15.60:0/2159645382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55000c92e0 con 0x7f55000cf1f0 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.927+0000 7f55051fa640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55000b68f0 0x7f5500161c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.927+0000 7f55049f9640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000cf1f0 0x7f55000ca620 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c4b0 tx=0x7f54f000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.927+0000 7f54f5ffb640 1 -- 172.21.15.60:0/2159645382 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f0017070 con 0x7f55000cf1f0 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.927+0000 7f54f5ffb640 1 -- 172.21.15.60:0/2159645382 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54f00035f0 con 0x7f55000cf1f0 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.927+0000 7f54f5ffb640 1 -- 172.21.15.60:0/2159645382 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f00039e0 con 0x7f55000cf1f0 2024-09-12T01:42:27.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.927+0000 7f550745e640 1 -- 172.21.15.60:0/2159645382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55000c9580 con 0x7f55000cf1f0 2024-09-12T01:42:27.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.927+0000 7f550745e640 1 -- 172.21.15.60:0/2159645382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55000c9b40 con 0x7f55000cf1f0 2024-09-12T01:42:27.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.928+0000 7f550745e640 1 -- 172.21.15.60:0/2159645382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f550006caa0 con 0x7f55000cf1f0 2024-09-12T01:42:27.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.928+0000 7f54f5ffb640 1 -- 172.21.15.60:0/2159645382 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f54f001a070 con 0x7f55000cf1f0 2024-09-12T01:42:27.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.929+0000 7f54f5ffb640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f54e406be30 0x7f54e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:27.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.929+0000 7f54f5ffb640 1 -- 172.21.15.60:0/2159645382 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f54f008a220 con 0x7f55000cf1f0 2024-09-12T01:42:27.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.929+0000 7f55051fa640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f54e406be30 0x7f54e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:27.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.929+0000 7f55051fa640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f54e406be30 0x7f54e406e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f54fc034000 tx=0x7f54fc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:27.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:27.933+0000 7f54f5ffb640 1 -- 172.21.15.60:0/2159645382 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f54f00584f0 con 0x7f55000cf1f0 2024-09-12T01:42:28.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.144+0000 7f550745e640 1 -- 172.21.15.60:0/2159645382 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f55000d2a80 con 0x7f55000cf1f0 2024-09-12T01:42:28.701 INFO:tasks.ceph.mds.b.smithi105.stderr:2024-09-12T01:42:28.702+0000 7fd846949640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:42:28.806 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.806+0000 7f54f5ffb640 1 -- 172.21.15.60:0/2159645382 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v61) ==== 122+0+0 (secure 0 0 0) 0x7f54f005c7f0 con 0x7f55000cf1f0 2024-09-12T01:42:28.808 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.809+0000 7f550745e640 1 -- 172.21.15.60:0/2159645382 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f54e406be30 msgr2=0x7f54e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:28.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.809+0000 7f550745e640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f54e406be30 0x7f54e406e2f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f54fc034000 tx=0x7f54fc02e000 comp rx=0 tx=0).stop 2024-09-12T01:42:28.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.809+0000 7f550745e640 1 -- 172.21.15.60:0/2159645382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000cf1f0 msgr2=0x7f55000ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:28.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.809+0000 7f550745e640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000cf1f0 0x7f55000ca620 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f54f000c4b0 tx=0x7f54f000c8b0 comp rx=0 tx=0).stop 2024-09-12T01:42:28.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.809+0000 7f550745e640 1 -- 172.21.15.60:0/2159645382 shutdown_connections 2024-09-12T01:42:28.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.809+0000 7f550745e640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f54e406be30 0x7f54e406e2f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:28.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.809+0000 7f550745e640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f550015e7a0 0x7f55000ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:28.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.809+0000 7f550745e640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000cf1f0 0x7f55000ca620 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:28.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.809+0000 7f550745e640 1 --2- 172.21.15.60:0/2159645382 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f55000b68f0 0x7f5500161c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:28.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.809+0000 7f550745e640 1 -- 172.21.15.60:0/2159645382 >> 172.21.15.60:0/2159645382 conn(0x7f55000d11e0 msgr2=0x7f550015da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:28.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.809+0000 7f550745e640 1 -- 172.21.15.60:0/2159645382 shutdown_connections 2024-09-12T01:42:28.809 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.809+0000 7f550745e640 1 -- 172.21.15.60:0/2159645382 wait complete. 2024-09-12T01:42:28.821 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:42:28.821 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:28.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.928+0000 7f144fc35640 1 Processor -- start 2024-09-12T01:42:28.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.928+0000 7f144fc35640 1 -- start start 2024-09-12T01:42:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.929+0000 7f144fc35640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14480cf6b0 0x7f14481629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.929+0000 7f144fc35640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1448162f30 0x7f14480b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.929+0000 7f144fc35640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14480cfc20 con 0x7f14480b63d0 2024-09-12T01:42:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.929+0000 7f144fc35640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f14480d40c0 con 0x7f1448162f30 2024-09-12T01:42:28.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.929+0000 7f144fc35640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f14480d2ed0 con 0x7f14480cf6b0 2024-09-12T01:42:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.929+0000 7f144d1d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14480cf6b0 0x7f14481629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.929+0000 7f144e1d2640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1448162f30 0x7f14480b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.929+0000 7f144d9d1640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f14480b63d0 0x7f14480d39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:34548/0 (socket says 172.21.15.60:34548) 2024-09-12T01:42:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.929+0000 7f144d9d1640 1 -- 172.21.15.60:0/3357866658 learned_addr learned my addr 172.21.15.60:0/3357866658 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.930+0000 7f144c9cf640 1 -- 172.21.15.60:0/3357866658 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440379653 0 0) 0x7f14480cfc20 con 0x7f14480b63d0 2024-09-12T01:42:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.930+0000 7f144c9cf640 1 -- 172.21.15.60:0/3357866658 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1434003520 con 0x7f14480b63d0 2024-09-12T01:42:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.930+0000 7f144d1d0640 1 -- 172.21.15.60:0/3357866658 >> v2:172.21.15.105:3300/0 conn(0x7f1448162f30 msgr2=0x7f14480b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.930+0000 7f144d1d0640 1 --2- 172.21.15.60:0/3357866658 >> v2:172.21.15.105:3300/0 conn(0x7f1448162f30 0x7f14480b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.930+0000 7f144d1d0640 1 -- 172.21.15.60:0/3357866658 >> v1:172.21.15.105:6789/0 conn(0x7f14480b63d0 legacy=0x7f14480d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.930+0000 7f144d1d0640 1 -- 172.21.15.60:0/3357866658 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14480d31b0 con 0x7f14480cf6b0 2024-09-12T01:42:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.930+0000 7f144e1d2640 1 --2- 172.21.15.60:0/3357866658 >> v2:172.21.15.105:3300/0 conn(0x7f1448162f30 0x7f14480b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:28.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.931+0000 7f144d1d0640 1 --2- 172.21.15.60:0/3357866658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14480cf6b0 0x7f14481629f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f14380097a0 tx=0x7f143802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7273102af68a6b12 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:28.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.931+0000 7f144c9cf640 1 -- 172.21.15.60:0/3357866658 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438037070 con 0x7f14480cf6b0 2024-09-12T01:42:28.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.931+0000 7f144c9cf640 1 -- 172.21.15.60:0/3357866658 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1438032440 con 0x7f14480cf6b0 2024-09-12T01:42:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.931+0000 7f144c9cf640 1 -- 172.21.15.60:0/3357866658 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14380327f0 con 0x7f14480cf6b0 2024-09-12T01:42:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.931+0000 7f144fc35640 1 -- 172.21.15.60:0/3357866658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14480cf6b0 msgr2=0x7f14481629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.931+0000 7f144fc35640 1 --2- 172.21.15.60:0/3357866658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14480cf6b0 0x7f14481629f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f14380097a0 tx=0x7f143802a180 comp rx=0 tx=0).stop 2024-09-12T01:42:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.931+0000 7f144fc35640 1 -- 172.21.15.60:0/3357866658 shutdown_connections 2024-09-12T01:42:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.931+0000 7f144fc35640 1 --2- 172.21.15.60:0/3357866658 >> v2:172.21.15.105:3300/0 conn(0x7f1448162f30 0x7f14480b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.931+0000 7f144fc35640 1 --2- 172.21.15.60:0/3357866658 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14480cf6b0 0x7f14481629f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.931+0000 7f144fc35640 1 -- 172.21.15.60:0/3357866658 >> 172.21.15.60:0/3357866658 conn(0x7f14480d1160 msgr2=0x7f14480d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.931+0000 7f144fc35640 1 -- 172.21.15.60:0/3357866658 shutdown_connections 2024-09-12T01:42:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.931+0000 7f144fc35640 1 -- 172.21.15.60:0/3357866658 wait complete. 2024-09-12T01:42:28.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.933+0000 7f144fc35640 1 Processor -- start 2024-09-12T01:42:28.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.933+0000 7f144fc35640 1 -- start start 2024-09-12T01:42:28.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.933+0000 7f144fc35640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14480b63d0 0x7f14481f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:28.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.933+0000 7f144fc35640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14480cf6b0 0x7f1448158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:28.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.933+0000 7f144fc35640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1448162f30 0x7f14480ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:28.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.933+0000 7f144fc35640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f14480cb5c0 con 0x7f1448162f30 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.933+0000 7f144fc35640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f14480cb440 con 0x7f14480cf6b0 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.933+0000 7f144fc35640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f14480d1c80 con 0x7f14480b63d0 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144e1d2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1448162f30 0x7f14480ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144e1d2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1448162f30 0x7f14480ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56274/0 (socket says 172.21.15.60:56274) 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144e1d2640 1 -- 172.21.15.60:0/1443043759 learned_addr learned my addr 172.21.15.60:0/1443043759 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144d9d1640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14480b63d0 0x7f14481f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144d1d0640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14480cf6b0 0x7f1448158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144e1d2640 1 -- 172.21.15.60:0/1443043759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14480b63d0 msgr2=0x7f14481f83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144e1d2640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14480b63d0 0x7f14481f83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144e1d2640 1 -- 172.21.15.60:0/1443043759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14480cf6b0 msgr2=0x7f1448158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144e1d2640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14480cf6b0 0x7f1448158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144e1d2640 1 -- 172.21.15.60:0/1443043759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14481f88e0 con 0x7f1448162f30 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144e1d2640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1448162f30 0x7f14480ca360 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f144000efb0 tx=0x7f144000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f143e7fc640 1 -- 172.21.15.60:0/1443043759 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1440018020 con 0x7f1448162f30 2024-09-12T01:42:28.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f143e7fc640 1 -- 172.21.15.60:0/1443043759 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1440014480 con 0x7f1448162f30 2024-09-12T01:42:28.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144fc35640 1 -- 172.21.15.60:0/1443043759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1448159520 con 0x7f1448162f30 2024-09-12T01:42:28.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f143e7fc640 1 -- 172.21.15.60:0/1443043759 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1440014850 con 0x7f1448162f30 2024-09-12T01:42:28.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.934+0000 7f144fc35640 1 -- 172.21.15.60:0/1443043759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14480cd4f0 con 0x7f1448162f30 2024-09-12T01:42:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.935+0000 7f144fc35640 1 -- 172.21.15.60:0/1443043759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14480cd730 con 0x7f1448162f30 2024-09-12T01:42:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.936+0000 7f143e7fc640 1 -- 172.21.15.60:0/1443043759 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1440005d10 con 0x7f1448162f30 2024-09-12T01:42:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.937+0000 7f143e7fc640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f142c06be30 0x7f142c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.937+0000 7f143e7fc640 1 -- 172.21.15.60:0/1443043759 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f144008bbd0 con 0x7f1448162f30 2024-09-12T01:42:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.937+0000 7f144d9d1640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f142c06be30 0x7f142c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.937+0000 7f144d9d1640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f142c06be30 0x7f142c06e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1444005880 tx=0x7f1444009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:28.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:28.941+0000 7f143e7fc640 1 -- 172.21.15.60:0/1443043759 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f14480cd730 con 0x7f1448162f30 2024-09-12T01:42:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.150+0000 7f144fc35640 1 -- 172.21.15.60:0/1443043759 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14480b67b0 con 0x7f1448162f30 2024-09-12T01:42:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.151+0000 7f143e7fc640 1 -- 172.21.15.60:0/1443043759 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7f1440022030 con 0x7f1448162f30 2024-09-12T01:42:29.151 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:29.151 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":61,"btime":"2024-09-12T01:42:28:803118+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3412598725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3412598725},{"type":"v1","addr":"172.21.15.60:6837","nonce":3412598725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2966702196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2966702196},{"type":"v1","addr":"172.21.15.60:6836","nonce":2966702196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7107,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3682228949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3682228949},{"type":"v1","addr":"172.21.15.105:6834","nonce":3682228949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:42:26.063083+0000","modified":"2024-09-12T01:42:28.145414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7110},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7110":{"gid":7110,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3881960029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3881960029},{"type":"v1","addr":"172.21.15.105:6835","nonce":3881960029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7110,"qdb_cluster":[7110]},"id":8}]} 2024-09-12T01:42:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 61 2024-09-12T01:42:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.153+0000 7f144fc35640 1 -- 172.21.15.60:0/1443043759 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f142c06be30 msgr2=0x7f142c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.153+0000 7f144fc35640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f142c06be30 0x7f142c06e2f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1444005880 tx=0x7f1444009040 comp rx=0 tx=0).stop 2024-09-12T01:42:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.153+0000 7f144fc35640 1 -- 172.21.15.60:0/1443043759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1448162f30 msgr2=0x7f14480ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.153+0000 7f144fc35640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1448162f30 0x7f14480ca360 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f144000efb0 tx=0x7f144000c490 comp rx=0 tx=0).stop 2024-09-12T01:42:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.153+0000 7f144fc35640 1 -- 172.21.15.60:0/1443043759 shutdown_connections 2024-09-12T01:42:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.153+0000 7f144fc35640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1448162f30 0x7f14480ca360 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.153+0000 7f144fc35640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14480cf6b0 0x7f1448158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.153+0000 7f144fc35640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f142c06be30 0x7f142c06e2f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.153+0000 7f144fc35640 1 --2- 172.21.15.60:0/1443043759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f14480b63d0 0x7f14481f83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.153+0000 7f144fc35640 1 -- 172.21.15.60:0/1443043759 >> 172.21.15.60:0/1443043759 conn(0x7f14480d1160 msgr2=0x7f14480d1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:29.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.153+0000 7f144fc35640 1 -- 172.21.15.60:0/1443043759 shutdown_connections 2024-09-12T01:42:29.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.153+0000 7f144fc35640 1 -- 172.21.15.60:0/1443043759 wait complete. 2024-09-12T01:42:29.163 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:42:29.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.266+0000 7f8e28128640 1 Processor -- start 2024-09-12T01:42:29.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.266+0000 7f8e28128640 1 -- start start 2024-09-12T01:42:29.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e28128640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8e200b4d00 0x7f8e200b5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e28128640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200cd780 0x7f8e200cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e28128640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e200ce4f0 con 0x7f8e200b4920 2024-09-12T01:42:29.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e28128640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8e200cf100 con 0x7f8e200b4d00 2024-09-12T01:42:29.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e28128640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8e200ce7d0 con 0x7f8e200cd780 2024-09-12T01:42:29.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e25ec4640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8e200b4920 0x7f8e2015b7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44488/0 (socket says 172.21.15.60:44488) 2024-09-12T01:42:29.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e25ec4640 1 -- 172.21.15.60:0/2820519155 learned_addr learned my addr 172.21.15.60:0/2820519155 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:29.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e266c5640 1 --2- 172.21.15.60:0/2820519155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200cd780 0x7f8e200cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e256c3640 1 --2- 172.21.15.60:0/2820519155 >> v2:172.21.15.105:3300/0 conn(0x7f8e200b4d00 0x7f8e200b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e24ec2640 1 -- 172.21.15.60:0/2820519155 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292353412 0 0) 0x7f8e200ce4f0 con 0x7f8e200b4920 2024-09-12T01:42:29.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e24ec2640 1 -- 172.21.15.60:0/2820519155 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e0c003520 con 0x7f8e200b4920 2024-09-12T01:42:29.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e24ec2640 1 -- 172.21.15.60:0/2820519155 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3910611617 0 0) 0x7f8e0c003520 con 0x7f8e200b4920 2024-09-12T01:42:29.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e266c5640 1 -- 172.21.15.60:0/2820519155 >> v2:172.21.15.105:3300/0 conn(0x7f8e200b4d00 msgr2=0x7f8e200b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:29.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e266c5640 1 --2- 172.21.15.60:0/2820519155 >> v2:172.21.15.105:3300/0 conn(0x7f8e200b4d00 0x7f8e200b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e266c5640 1 -- 172.21.15.60:0/2820519155 >> v1:172.21.15.60:6789/0 conn(0x7f8e200b4920 legacy=0x7f8e2015b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.267+0000 7f8e266c5640 1 -- 172.21.15.60:0/2820519155 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e200ceab0 con 0x7f8e200cd780 2024-09-12T01:42:29.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.268+0000 7f8e266c5640 1 --2- 172.21.15.60:0/2820519155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200cd780 0x7f8e200cdbd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009d90 tx=0x7f8e1802a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff62fc78f9d2be13 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:29.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.268+0000 7f8e24ec2640 1 -- 172.21.15.60:0/2820519155 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c001670 con 0x7f8e200cd780 2024-09-12T01:42:29.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.268+0000 7f8e24ec2640 1 -- 172.21.15.60:0/2820519155 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e18007540 con 0x7f8e200cd780 2024-09-12T01:42:29.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.268+0000 7f8e24ec2640 1 -- 172.21.15.60:0/2820519155 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e180078f0 con 0x7f8e200cd780 2024-09-12T01:42:29.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.269+0000 7f8e28128640 1 -- 172.21.15.60:0/2820519155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200cd780 msgr2=0x7f8e200cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.269+0000 7f8e28128640 1 --2- 172.21.15.60:0/2820519155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200cd780 0x7f8e200cdbd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009d90 tx=0x7f8e1802a5f0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.269+0000 7f8e28128640 1 -- 172.21.15.60:0/2820519155 shutdown_connections 2024-09-12T01:42:29.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.269+0000 7f8e28128640 1 --2- 172.21.15.60:0/2820519155 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200cd780 0x7f8e200cdbd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.269+0000 7f8e28128640 1 --2- 172.21.15.60:0/2820519155 >> v2:172.21.15.105:3300/0 conn(0x7f8e200b4d00 0x7f8e200b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.269+0000 7f8e28128640 1 -- 172.21.15.60:0/2820519155 >> 172.21.15.60:0/2820519155 conn(0x7f8e2006bc10 msgr2=0x7f8e2006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:29.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.269+0000 7f8e28128640 1 -- 172.21.15.60:0/2820519155 shutdown_connections 2024-09-12T01:42:29.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.269+0000 7f8e28128640 1 -- 172.21.15.60:0/2820519155 wait complete. 2024-09-12T01:42:29.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.270+0000 7f8e28128640 1 Processor -- start 2024-09-12T01:42:29.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.270+0000 7f8e28128640 1 -- start start 2024-09-12T01:42:29.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e28128640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e200b4920 0x7f8e20152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e28128640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e200b4d00 0x7f8e201537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e28128640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200cd780 0x7f8e20145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e28128640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8e200ce110 con 0x7f8e200b4920 2024-09-12T01:42:29.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e28128640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8e200b56b0 con 0x7f8e200b4d00 2024-09-12T01:42:29.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e28128640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8e200ce290 con 0x7f8e200cd780 2024-09-12T01:42:29.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e25ec4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e200b4920 0x7f8e20152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e25ec4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e200b4920 0x7f8e20152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56288/0 (socket says 172.21.15.60:56288) 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e25ec4640 1 -- 172.21.15.60:0/3825425825 learned_addr learned my addr 172.21.15.60:0/3825425825 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e256c3640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e200b4d00 0x7f8e201537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e266c5640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200cd780 0x7f8e20145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e25ec4640 1 -- 172.21.15.60:0/3825425825 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200cd780 msgr2=0x7f8e20145e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e25ec4640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200cd780 0x7f8e20145e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e25ec4640 1 -- 172.21.15.60:0/3825425825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e200b4d00 msgr2=0x7f8e201537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e25ec4640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e200b4d00 0x7f8e201537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e25ec4640 1 -- 172.21.15.60:0/3825425825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e201533e0 con 0x7f8e200b4920 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.271+0000 7f8e25ec4640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e200b4920 0x7f8e20152ea0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00c780 tx=0x7f8e1c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.272+0000 7f8e167fc640 1 -- 172.21.15.60:0/3825425825 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c017070 con 0x7f8e200b4920 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.272+0000 7f8e167fc640 1 -- 172.21.15.60:0/3825425825 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c005ad0 con 0x7f8e200b4920 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.272+0000 7f8e28128640 1 -- 172.21.15.60:0/3825425825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e20153cf0 con 0x7f8e200b4920 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.272+0000 7f8e167fc640 1 -- 172.21.15.60:0/3825425825 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c007070 con 0x7f8e200b4920 2024-09-12T01:42:29.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.272+0000 7f8e28128640 1 -- 172.21.15.60:0/3825425825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e201591f0 con 0x7f8e200b4920 2024-09-12T01:42:29.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.273+0000 7f8e28128640 1 -- 172.21.15.60:0/3825425825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e200b5170 con 0x7f8e200b4920 2024-09-12T01:42:29.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.273+0000 7f8e167fc640 1 -- 172.21.15.60:0/3825425825 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e1c01a070 con 0x7f8e200b4920 2024-09-12T01:42:29.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.274+0000 7f8e167fc640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8e0406be30 0x7f8e0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.274+0000 7f8e167fc640 1 -- 172.21.15.60:0/3825425825 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f8e1c08a2b0 con 0x7f8e200b4920 2024-09-12T01:42:29.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.274+0000 7f8e256c3640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8e0406be30 0x7f8e0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.274+0000 7f8e256c3640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8e0406be30 0x7f8e0406e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8e201f3620 tx=0x7f8e10009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:29.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.278+0000 7f8e167fc640 1 -- 172.21.15.60:0/3825425825 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8e201533e0 con 0x7f8e200b4920 2024-09-12T01:42:29.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.454+0000 7f8e28128640 1 -- 172.21.15.60:0/3825425825 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e200cde60 con 0x7f8e200b4920 2024-09-12T01:42:29.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.455+0000 7f8e167fc640 1 -- 172.21.15.60:0/3825425825 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16707 (secure 0 0 0) 0x7f8e1c0586a0 con 0x7f8e200b4920 2024-09-12T01:42:29.455 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:29.455 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":103,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:42:27.714380+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:42:23.733621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-12T01:42:25.056873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:42:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.457+0000 7f8e28128640 1 -- 172.21.15.60:0/3825425825 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8e0406be30 msgr2=0x7f8e0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.457+0000 7f8e28128640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8e0406be30 0x7f8e0406e2f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8e201f3620 tx=0x7f8e10009190 comp rx=0 tx=0).stop 2024-09-12T01:42:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.457+0000 7f8e28128640 1 -- 172.21.15.60:0/3825425825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e200b4920 msgr2=0x7f8e20152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.457+0000 7f8e28128640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e200b4920 0x7f8e20152ea0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00c780 tx=0x7f8e1c00cc40 comp rx=0 tx=0).stop 2024-09-12T01:42:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.458+0000 7f8e28128640 1 -- 172.21.15.60:0/3825425825 shutdown_connections 2024-09-12T01:42:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.458+0000 7f8e28128640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8e0406be30 0x7f8e0406e2f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.458+0000 7f8e28128640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200cd780 0x7f8e20145e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.458+0000 7f8e28128640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e200b4d00 0x7f8e201537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.458+0000 7f8e28128640 1 --2- 172.21.15.60:0/3825425825 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e200b4920 0x7f8e20152ea0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.458+0000 7f8e28128640 1 -- 172.21.15.60:0/3825425825 >> 172.21.15.60:0/3825425825 conn(0x7f8e2006bc10 msgr2=0x7f8e200b5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.458+0000 7f8e28128640 1 -- 172.21.15.60:0/3825425825 shutdown_connections 2024-09-12T01:42:29.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.458+0000 7f8e28128640 1 -- 172.21.15.60:0/3825425825 wait complete. 2024-09-12T01:42:29.468 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:42:29.469 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:42:29.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.572+0000 7f6a89d6f640 1 Processor -- start 2024-09-12T01:42:29.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.572+0000 7f6a89d6f640 1 -- start start 2024-09-12T01:42:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.573+0000 7f6a89d6f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a84155800 0x7f6a840b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.573+0000 7f6a89d6f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6a840cfc80 0x7f6a840b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.573+0000 7f6a89d6f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a840b50a0 con 0x7f6a8415c330 2024-09-12T01:42:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.573+0000 7f6a89d6f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6a840b4e60 con 0x7f6a84155800 2024-09-12T01:42:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.573+0000 7f6a89d6f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6a8415c7a0 con 0x7f6a840cfc80 2024-09-12T01:42:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.573+0000 7f6a837fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a84155800 0x7f6a840b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.573+0000 7f6a82ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6a8415c330 0x7f6a840cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44498/0 (socket says 172.21.15.60:44498) 2024-09-12T01:42:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.573+0000 7f6a82ffd640 1 -- 172.21.15.60:0/3537864954 learned_addr learned my addr 172.21.15.60:0/3537864954 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.573+0000 7f6a837fe640 1 -- 172.21.15.60:0/3537864954 >> v2:172.21.15.105:3300/0 conn(0x7f6a840cfc80 msgr2=0x7f6a840b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.573+0000 7f6a837fe640 1 --2- 172.21.15.60:0/3537864954 >> v2:172.21.15.105:3300/0 conn(0x7f6a840cfc80 0x7f6a840b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.573+0000 7f6a837fe640 1 -- 172.21.15.60:0/3537864954 >> v1:172.21.15.60:6789/0 conn(0x7f6a8415c330 legacy=0x7f6a840cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.573+0000 7f6a837fe640 1 -- 172.21.15.60:0/3537864954 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a840b5380 con 0x7f6a84155800 2024-09-12T01:42:29.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.574+0000 7f6a837fe640 1 --2- 172.21.15.60:0/3537864954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a84155800 0x7f6a840b6140 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6a8415b7b0 tx=0x7f6a7402c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c7b0d59139b88d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:29.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.574+0000 7f6a827fc640 1 -- 172.21.15.60:0/3537864954 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74031710 con 0x7f6a84155800 2024-09-12T01:42:29.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.574+0000 7f6a827fc640 1 -- 172.21.15.60:0/3537864954 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a740318b0 con 0x7f6a84155800 2024-09-12T01:42:29.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.574+0000 7f6a827fc640 1 -- 172.21.15.60:0/3537864954 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74031c80 con 0x7f6a84155800 2024-09-12T01:42:29.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.575+0000 7f6a89d6f640 1 -- 172.21.15.60:0/3537864954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a84155800 msgr2=0x7f6a840b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.575+0000 7f6a89d6f640 1 --2- 172.21.15.60:0/3537864954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a84155800 0x7f6a840b6140 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f6a8415b7b0 tx=0x7f6a7402c770 comp rx=0 tx=0).stop 2024-09-12T01:42:29.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.575+0000 7f6a89d6f640 1 -- 172.21.15.60:0/3537864954 shutdown_connections 2024-09-12T01:42:29.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.575+0000 7f6a89d6f640 1 --2- 172.21.15.60:0/3537864954 >> v2:172.21.15.105:3300/0 conn(0x7f6a840cfc80 0x7f6a840b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.575+0000 7f6a89d6f640 1 --2- 172.21.15.60:0/3537864954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a84155800 0x7f6a840b6140 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.575+0000 7f6a89d6f640 1 -- 172.21.15.60:0/3537864954 >> 172.21.15.60:0/3537864954 conn(0x7f6a8406bc10 msgr2=0x7f6a8406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:29.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.575+0000 7f6a89d6f640 1 -- 172.21.15.60:0/3537864954 shutdown_connections 2024-09-12T01:42:29.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.575+0000 7f6a89d6f640 1 -- 172.21.15.60:0/3537864954 wait complete. 2024-09-12T01:42:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.576+0000 7f6a89d6f640 1 Processor -- start 2024-09-12T01:42:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.576+0000 7f6a89d6f640 1 -- start start 2024-09-12T01:42:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.577+0000 7f6a89d6f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a840cfc80 0x7f6a841515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.577+0000 7f6a89d6f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a84155800 0x7f6a84143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.577+0000 7f6a89d6f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8415c330 0x7f6a84157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.577+0000 7f6a89d6f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a840b5c20 con 0x7f6a8415c330 2024-09-12T01:42:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.577+0000 7f6a89d6f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a840b5940 con 0x7f6a84155800 2024-09-12T01:42:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.577+0000 7f6a89d6f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6a84155be0 con 0x7f6a840cfc80 2024-09-12T01:42:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.577+0000 7f6a83fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8415c330 0x7f6a84157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.577+0000 7f6a83fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8415c330 0x7f6a84157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56310/0 (socket says 172.21.15.60:56310) 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.577+0000 7f6a83fff640 1 -- 172.21.15.60:0/2920580460 learned_addr learned my addr 172.21.15.60:0/2920580460 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.577+0000 7f6a82ffd640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a84155800 0x7f6a84143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.577+0000 7f6a837fe640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a840cfc80 0x7f6a841515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.578+0000 7f6a83fff640 1 -- 172.21.15.60:0/2920580460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a840cfc80 msgr2=0x7f6a841515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.578+0000 7f6a83fff640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a840cfc80 0x7f6a841515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.578+0000 7f6a83fff640 1 -- 172.21.15.60:0/2920580460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a84155800 msgr2=0x7f6a84143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.578+0000 7f6a83fff640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a84155800 0x7f6a84143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.578+0000 7f6a83fff640 1 -- 172.21.15.60:0/2920580460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a84156990 con 0x7f6a8415c330 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.578+0000 7f6a83fff640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8415c330 0x7f6a84157ea0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00b9e0 tx=0x7f6a7c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.578+0000 7f6a6bfff640 1 -- 172.21.15.60:0/2920580460 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c019070 con 0x7f6a8415c330 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.578+0000 7f6a6bfff640 1 -- 172.21.15.60:0/2920580460 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a7c00cac0 con 0x7f6a8415c330 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.578+0000 7f6a89d6f640 1 -- 172.21.15.60:0/2920580460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a84156c70 con 0x7f6a8415c330 2024-09-12T01:42:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.578+0000 7f6a6bfff640 1 -- 172.21.15.60:0/2920580460 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c014440 con 0x7f6a8415c330 2024-09-12T01:42:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.578+0000 7f6a89d6f640 1 -- 172.21.15.60:0/2920580460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a841511f0 con 0x7f6a8415c330 2024-09-12T01:42:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.579+0000 7f6a89d6f640 1 -- 172.21.15.60:0/2920580460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a840b6140 con 0x7f6a8415c330 2024-09-12T01:42:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.580+0000 7f6a6bfff640 1 -- 172.21.15.60:0/2920580460 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a7c01c070 con 0x7f6a8415c330 2024-09-12T01:42:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.580+0000 7f6a6bfff640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7006be30 0x7f6a7006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.580+0000 7f6a6bfff640 1 -- 172.21.15.60:0/2920580460 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f6a7c08a9b0 con 0x7f6a8415c330 2024-09-12T01:42:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.580+0000 7f6a837fe640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7006be30 0x7f6a7006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.581+0000 7f6a837fe640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7006be30 0x7f6a7006e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6a74036000 tx=0x7f6a74031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.584+0000 7f6a6bfff640 1 -- 172.21.15.60:0/2920580460 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a7c058da0 con 0x7f6a8415c330 2024-09-12T01:42:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.758+0000 7f6a89d6f640 1 -- 172.21.15.60:0/2920580460 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a84155040 con 0x7f6a7006be30 2024-09-12T01:42:29.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.764+0000 7f6a6bfff640 1 -- 172.21.15.60:0/2920580460 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239648 (secure 0 0 0) 0x7f6a84155040 con 0x7f6a7006be30 2024-09-12T01:42:29.766 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:29.767 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:42:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.766+0000 7f6a89d6f640 1 -- 172.21.15.60:0/2920580460 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7006be30 msgr2=0x7f6a7006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.766+0000 7f6a89d6f640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7006be30 0x7f6a7006e2f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6a74036000 tx=0x7f6a74031000 comp rx=0 tx=0).stop 2024-09-12T01:42:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.766+0000 7f6a89d6f640 1 -- 172.21.15.60:0/2920580460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8415c330 msgr2=0x7f6a84157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.766+0000 7f6a89d6f640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8415c330 0x7f6a84157ea0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00b9e0 tx=0x7f6a7c00bea0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.766+0000 7f6a89d6f640 1 -- 172.21.15.60:0/2920580460 shutdown_connections 2024-09-12T01:42:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.766+0000 7f6a89d6f640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a8415c330 0x7f6a84157ea0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.766+0000 7f6a89d6f640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a84155800 0x7f6a84143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.766+0000 7f6a89d6f640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7006be30 0x7f6a7006e2f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.766+0000 7f6a89d6f640 1 --2- 172.21.15.60:0/2920580460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a840cfc80 0x7f6a841515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.766+0000 7f6a89d6f640 1 -- 172.21.15.60:0/2920580460 >> 172.21.15.60:0/2920580460 conn(0x7f6a8406bc10 msgr2=0x7f6a840ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.767+0000 7f6a89d6f640 1 -- 172.21.15.60:0/2920580460 shutdown_connections 2024-09-12T01:42:29.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.767+0000 7f6a89d6f640 1 -- 172.21.15.60:0/2920580460 wait complete. 2024-09-12T01:42:29.776 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-09-12T01:42:28.349104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":276968,"kb_used_data":10812,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754697752,"statfs":{"total":773094113280,"available":772810498048,"internally_reserved":0,"allocated":11071488,"data_stored":5336695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000878"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728087+0000","last_change":"2024-09-12T01:42:24.728087+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728087+0000","last_undegraded":"2024-09-12T01:42:24.728087+0000","last_fullsized":"2024-09-12T01:42:24.728087+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.706034+0000","last_change":"2024-09-12T01:42:24.706034+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.706034+0000","last_undegraded":"2024-09-12T01:42:24.706034+0000","last_fullsized":"2024-09-12T01:42:24.706034+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708222+0000","last_change":"2024-09-12T01:42:24.708222+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708222+0000","last_undegraded":"2024-09-12T01:42:24.708222+0000","last_fullsized":"2024-09-12T01:42:24.708222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.711354+0000","last_change":"2024-09-12T01:42:24.711354+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.711354+0000","last_undegraded":"2024-09-12T01:42:24.711354+0000","last_fullsized":"2024-09-12T01:42:24.711354+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728018+0000","last_change":"2024-09-12T01:42:24.728018+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728018+0000","last_undegraded":"2024-09-12T01:42:24.728018+0000","last_fullsized":"2024-09-12T01:42:24.728018+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708208+0000","last_change":"2024-09-12T01:42:24.708208+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708208+0000","last_undegraded":"2024-09-12T01:42:24.708208+0000","last_fullsized":"2024-09-12T01:42:24.708208+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709861+0000","last_change":"2024-09-12T01:42:24.709861+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709861+0000","last_undegraded":"2024-09-12T01:42:24.709861+0000","last_fullsized":"2024-09-12T01:42:24.709861+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709354+0000","last_change":"2024-09-12T01:42:24.709354+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709354+0000","last_undegraded":"2024-09-12T01:42:24.709354+0000","last_fullsized":"2024-09-12T01:42:24.709354+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709368+0000","last_change":"2024-09-12T01:42:24.709368+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709368+0000","last_undegraded":"2024-09-12T01:42:24.709368+0000","last_fullsized":"2024-09-12T01:42:24.709368+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708166+0000","last_change":"2024-09-12T01:42:24.708166+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708166+0000","last_undegraded":"2024-09-12T01:42:24.708166+0000","last_fullsized":"2024-09-12T01:42:24.708166+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.710201+0000","last_change":"2024-09-12T01:42:24.710201+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.710201+0000","last_undegraded":"2024-09-12T01:42:24.710201+0000","last_fullsized":"2024-09-12T01:42:24.710201+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.705140+0000","last_change":"2024-09-12T01:42:24.705140+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.705140+0000","last_undegraded":"2024-09-12T01:42:24.705140+0000","last_fullsized":"2024-09-12T01:42:24.705140+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709360+0000","last_change":"2024-09-12T01:42:24.709360+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709360+0000","last_undegraded":"2024-09-12T01:42:24.709360+0000","last_fullsized":"2024-09-12T01:42:24.709360+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728037+0000","last_change":"2024-09-12T01:42:24.728037+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728037+0000","last_undegraded":"2024-09-12T01:42:24.728037+0000","last_fullsized":"2024-09-12T01:42:24.728037+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728233+0000","last_change":"2024-09-12T01:42:24.728233+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728233+0000","last_undegraded":"2024-09-12T01:42:24.728233+0000","last_fullsized":"2024-09-12T01:42:24.728233+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708320+0000","last_change":"2024-09-12T01:42:24.708320+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708320+0000","last_undegraded":"2024-09-12T01:42:24.708320+0000","last_fullsized":"2024-09-12T01:42:24.708320+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.710886+0000","last_change":"2024-09-12T01:42:24.710886+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.710886+0000","last_undegraded":"2024-09-12T01:42:24.710886+0000","last_fullsized":"2024-09-12T01:42:24.710886+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728018+0000","last_change":"2024-09-12T01:42:24.728018+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728018+0000","last_undegraded":"2024-09-12T01:42:24.728018+0000","last_fullsized":"2024-09-12T01:42:24.728018+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728340+0000","last_change":"2024-09-12T01:42:24.728340+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728340+0000","last_undegraded":"2024-09-12T01:42:24.728340+0000","last_fullsized":"2024-09-12T01:42:24.728340+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728041+0000","last_change":"2024-09-12T01:42:24.728041+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728041+0000","last_undegraded":"2024-09-12T01:42:24.728041+0000","last_fullsized":"2024-09-12T01:42:24.728041+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709794+0000","last_change":"2024-09-12T01:42:24.709794+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709794+0000","last_undegraded":"2024-09-12T01:42:24.709794+0000","last_fullsized":"2024-09-12T01:42:24.709794+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.705652+0000","last_change":"2024-09-12T01:42:24.705652+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.705652+0000","last_undegraded":"2024-09-12T01:42:24.705652+0000","last_fullsized":"2024-09-12T01:42:24.705652+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.706051+0000","last_change":"2024-09-12T01:42:24.706051+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.706051+0000","last_undegraded":"2024-09-12T01:42:24.706051+0000","last_fullsized":"2024-09-12T01:42:24.706051+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":315,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-12T01:42:24.708570+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:42:24.708570+0000","last_peered":"2024-09-12T01:42:24.708570+0000","last_clean":"2024-09-12T01:42:24.708570+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:42:24.708570+0000","last_undegraded":"2024-09-12T01:42:24.708570+0000","last_fullsized":"2024-09-12T01:42:24.708570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509525,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509523,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509523,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1830912,"data_stored":1110590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509523,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37136,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334704,"statfs":{"total":96636764160,"available":96598736896,"internally_reserved":0,"allocated":1830912,"data_stored":1110590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32396,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1224704,"data_stored":514405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:42:29.782 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:42:29.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.920+0000 7f8b91ff8640 1 Processor -- start 2024-09-12T01:42:29.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.920+0000 7f8b91ff8640 1 -- start start 2024-09-12T01:42:29.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b91ff8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8b8c15c2b0 0x7f8b8c0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b91ff8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b8c0b72f0 0x7f8b8c15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b91ff8640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b8c15fb10 con 0x7f8b8c15f030 2024-09-12T01:42:29.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b91ff8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f8b8c0b5900 con 0x7f8b8c0b72f0 2024-09-12T01:42:29.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b91ff8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8b8c15f830 con 0x7f8b8c15c2b0 2024-09-12T01:42:29.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b8affd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b8c0b72f0 0x7f8b8c15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b8bfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8b8c15f030 0x7f8b8c06f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44514/0 (socket says 172.21.15.60:44514) 2024-09-12T01:42:29.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b8bfff640 1 -- 172.21.15.60:0/2547794637 learned_addr learned my addr 172.21.15.60:0/2547794637 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:29.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b8affd640 1 -- 172.21.15.60:0/2547794637 >> v2:172.21.15.105:3300/0 conn(0x7f8b8c15c2b0 msgr2=0x7f8b8c0b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:29.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b8b7fe640 1 --2- 172.21.15.60:0/2547794637 >> v2:172.21.15.105:3300/0 conn(0x7f8b8c15c2b0 0x7f8b8c0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b8affd640 1 --2- 172.21.15.60:0/2547794637 >> v2:172.21.15.105:3300/0 conn(0x7f8b8c15c2b0 0x7f8b8c0b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b8a7fc640 1 -- 172.21.15.60:0/2547794637 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 386359787 0 0) 0x7f8b8c15fb10 con 0x7f8b8c15f030 2024-09-12T01:42:29.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b8affd640 1 -- 172.21.15.60:0/2547794637 >> v1:172.21.15.60:6789/0 conn(0x7f8b8c15f030 legacy=0x7f8b8c06f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b8affd640 1 -- 172.21.15.60:0/2547794637 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8c06ce30 con 0x7f8b8c0b72f0 2024-09-12T01:42:29.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.921+0000 7f8b8b7fe640 1 --2- 172.21.15.60:0/2547794637 >> v2:172.21.15.105:3300/0 conn(0x7f8b8c15c2b0 0x7f8b8c0b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:29.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.922+0000 7f8b8affd640 1 --2- 172.21.15.60:0/2547794637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b8c0b72f0 0x7f8b8c15eaf0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c06f040 tx=0x7f8b8002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eccfa2f6b475389 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:29.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.922+0000 7f8b8a7fc640 1 -- 172.21.15.60:0/2547794637 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80037070 con 0x7f8b8c0b72f0 2024-09-12T01:42:29.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.922+0000 7f8b8a7fc640 1 -- 172.21.15.60:0/2547794637 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b80032440 con 0x7f8b8c0b72f0 2024-09-12T01:42:29.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.922+0000 7f8b8a7fc640 1 -- 172.21.15.60:0/2547794637 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80032810 con 0x7f8b8c0b72f0 2024-09-12T01:42:29.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.922+0000 7f8b91ff8640 1 -- 172.21.15.60:0/2547794637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b8c0b72f0 msgr2=0x7f8b8c15eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.922+0000 7f8b91ff8640 1 --2- 172.21.15.60:0/2547794637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b8c0b72f0 0x7f8b8c15eaf0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c06f040 tx=0x7f8b8002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.923+0000 7f8b91ff8640 1 -- 172.21.15.60:0/2547794637 shutdown_connections 2024-09-12T01:42:29.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.923+0000 7f8b91ff8640 1 --2- 172.21.15.60:0/2547794637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b8c0b72f0 0x7f8b8c15eaf0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.923+0000 7f8b91ff8640 1 --2- 172.21.15.60:0/2547794637 >> v2:172.21.15.105:3300/0 conn(0x7f8b8c15c2b0 0x7f8b8c0b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.923+0000 7f8b91ff8640 1 -- 172.21.15.60:0/2547794637 >> 172.21.15.60:0/2547794637 conn(0x7f8b8c0b4240 msgr2=0x7f8b8c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:29.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.923+0000 7f8b91ff8640 1 -- 172.21.15.60:0/2547794637 shutdown_connections 2024-09-12T01:42:29.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.923+0000 7f8b91ff8640 1 -- 172.21.15.60:0/2547794637 wait complete. 2024-09-12T01:42:29.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.924+0000 7f8b91ff8640 1 Processor -- start 2024-09-12T01:42:29.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.924+0000 7f8b91ff8640 1 -- start start 2024-09-12T01:42:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b91ff8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b8c0b72f0 0x7f8b8c0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b91ff8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b8c15c2b0 0x7f8b8c14ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b91ff8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b8c15f030 0x7f8b8c0d2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b91ff8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c0b7760 con 0x7f8b8c15c2b0 2024-09-12T01:42:29.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b91ff8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b8c06d3f0 con 0x7f8b8c15f030 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b91ff8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8b8c15f480 con 0x7f8b8c0b72f0 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b8affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b8c15c2b0 0x7f8b8c14ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b8affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b8c15c2b0 0x7f8b8c14ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56322/0 (socket says 172.21.15.60:56322) 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b8affd640 1 -- 172.21.15.60:0/1094999464 learned_addr learned my addr 172.21.15.60:0/1094999464 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b8bfff640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b8c15f030 0x7f8b8c0d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b8b7fe640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b8c0b72f0 0x7f8b8c0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b8affd640 1 -- 172.21.15.60:0/1094999464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b8c0b72f0 msgr2=0x7f8b8c0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b8affd640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b8c0b72f0 0x7f8b8c0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b8affd640 1 -- 172.21.15.60:0/1094999464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b8c15f030 msgr2=0x7f8b8c0d2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b8affd640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b8c15f030 0x7f8b8c0d2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b8affd640 1 -- 172.21.15.60:0/1094999464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8c1f3fa0 con 0x7f8b8c15c2b0 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b8bfff640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b8c15f030 0x7f8b8c0d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b8affd640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b8c15c2b0 0x7f8b8c14ee20 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f8b80000c00 tx=0x7f8b800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:29.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b73fff640 1 -- 172.21.15.60:0/1094999464 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80037040 con 0x7f8b8c15c2b0 2024-09-12T01:42:29.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b73fff640 1 -- 172.21.15.60:0/1094999464 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b80042070 con 0x7f8b8c15c2b0 2024-09-12T01:42:29.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b73fff640 1 -- 172.21.15.60:0/1094999464 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b80030a50 con 0x7f8b8c15c2b0 2024-09-12T01:42:29.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.925+0000 7f8b91ff8640 1 -- 172.21.15.60:0/1094999464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8c1f42a0 con 0x7f8b8c15c2b0 2024-09-12T01:42:29.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.926+0000 7f8b91ff8640 1 -- 172.21.15.60:0/1094999464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b8c1f4ae0 con 0x7f8b8c15c2b0 2024-09-12T01:42:29.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.926+0000 7f8b91ff8640 1 -- 172.21.15.60:0/1094999464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b8c068e10 con 0x7f8b8c15c2b0 2024-09-12T01:42:29.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.927+0000 7f8b73fff640 1 -- 172.21.15.60:0/1094999464 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b80030bf0 con 0x7f8b8c15c2b0 2024-09-12T01:42:29.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.927+0000 7f8b73fff640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8b7806be30 0x7f8b7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:29.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.928+0000 7f8b8b7fe640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8b7806be30 0x7f8b7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:29.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.928+0000 7f8b73fff640 1 -- 172.21.15.60:0/1094999464 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f8b800ab8d0 con 0x7f8b8c15c2b0 2024-09-12T01:42:29.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.928+0000 7f8b8b7fe640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8b7806be30 0x7f8b7806e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c06e870 tx=0x7f8b7c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:29.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:29.932+0000 7f8b73fff640 1 -- 172.21.15.60:0/1094999464 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b8c068e10 con 0x7f8b8c15c2b0 2024-09-12T01:42:30.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.104+0000 7f8b91ff8640 1 -- 172.21.15.60:0/1094999464 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b8c15eaf0 con 0x7f8b7806be30 2024-09-12T01:42:30.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.110+0000 7f8b73fff640 1 -- 172.21.15.60:0/1094999464 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+239648 (secure 0 0 0) 0x7f8b8c15eaf0 con 0x7f8b7806be30 2024-09-12T01:42:30.112 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:30.113 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:42:30.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.113+0000 7f8b91ff8640 1 -- 172.21.15.60:0/1094999464 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8b7806be30 msgr2=0x7f8b7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.113+0000 7f8b91ff8640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8b7806be30 0x7f8b7806e2f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c06e870 tx=0x7f8b7c008040 comp rx=0 tx=0).stop 2024-09-12T01:42:30.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.113+0000 7f8b91ff8640 1 -- 172.21.15.60:0/1094999464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b8c15c2b0 msgr2=0x7f8b8c14ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.113+0000 7f8b91ff8640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b8c15c2b0 0x7f8b8c14ee20 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f8b80000c00 tx=0x7f8b800046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.113+0000 7f8b91ff8640 1 -- 172.21.15.60:0/1094999464 shutdown_connections 2024-09-12T01:42:30.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.113+0000 7f8b91ff8640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b8c15f030 0x7f8b8c0d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.113+0000 7f8b91ff8640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b8c15c2b0 0x7f8b8c14ee20 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.113+0000 7f8b91ff8640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8b7806be30 0x7f8b7806e2f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.113+0000 7f8b91ff8640 1 --2- 172.21.15.60:0/1094999464 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b8c0b72f0 0x7f8b8c0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.113+0000 7f8b91ff8640 1 -- 172.21.15.60:0/1094999464 >> 172.21.15.60:0/1094999464 conn(0x7f8b8c0b4240 msgr2=0x7f8b8c06d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:30.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.114+0000 7f8b91ff8640 1 -- 172.21.15.60:0/1094999464 shutdown_connections 2024-09-12T01:42:30.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.114+0000 7f8b91ff8640 1 -- 172.21.15.60:0/1094999464 wait complete. 2024-09-12T01:42:30.124 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-09-12T01:42:28.349104+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":48,"acting":48,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":276968,"kb_used_data":10812,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754697752,"statfs":{"total":773094113280,"available":772810498048,"internally_reserved":0,"allocated":11071488,"data_stored":5336695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000878"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728087+0000","last_change":"2024-09-12T01:42:24.728087+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728087+0000","last_undegraded":"2024-09-12T01:42:24.728087+0000","last_fullsized":"2024-09-12T01:42:24.728087+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.706034+0000","last_change":"2024-09-12T01:42:24.706034+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.706034+0000","last_undegraded":"2024-09-12T01:42:24.706034+0000","last_fullsized":"2024-09-12T01:42:24.706034+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708222+0000","last_change":"2024-09-12T01:42:24.708222+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708222+0000","last_undegraded":"2024-09-12T01:42:24.708222+0000","last_fullsized":"2024-09-12T01:42:24.708222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.711354+0000","last_change":"2024-09-12T01:42:24.711354+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.711354+0000","last_undegraded":"2024-09-12T01:42:24.711354+0000","last_fullsized":"2024-09-12T01:42:24.711354+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728018+0000","last_change":"2024-09-12T01:42:24.728018+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728018+0000","last_undegraded":"2024-09-12T01:42:24.728018+0000","last_fullsized":"2024-09-12T01:42:24.728018+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708208+0000","last_change":"2024-09-12T01:42:24.708208+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708208+0000","last_undegraded":"2024-09-12T01:42:24.708208+0000","last_fullsized":"2024-09-12T01:42:24.708208+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709861+0000","last_change":"2024-09-12T01:42:24.709861+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709861+0000","last_undegraded":"2024-09-12T01:42:24.709861+0000","last_fullsized":"2024-09-12T01:42:24.709861+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709354+0000","last_change":"2024-09-12T01:42:24.709354+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709354+0000","last_undegraded":"2024-09-12T01:42:24.709354+0000","last_fullsized":"2024-09-12T01:42:24.709354+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709368+0000","last_change":"2024-09-12T01:42:24.709368+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709368+0000","last_undegraded":"2024-09-12T01:42:24.709368+0000","last_fullsized":"2024-09-12T01:42:24.709368+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708166+0000","last_change":"2024-09-12T01:42:24.708166+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708166+0000","last_undegraded":"2024-09-12T01:42:24.708166+0000","last_fullsized":"2024-09-12T01:42:24.708166+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.710201+0000","last_change":"2024-09-12T01:42:24.710201+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.710201+0000","last_undegraded":"2024-09-12T01:42:24.710201+0000","last_fullsized":"2024-09-12T01:42:24.710201+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.705140+0000","last_change":"2024-09-12T01:42:24.705140+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.705140+0000","last_undegraded":"2024-09-12T01:42:24.705140+0000","last_fullsized":"2024-09-12T01:42:24.705140+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709360+0000","last_change":"2024-09-12T01:42:24.709360+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709360+0000","last_undegraded":"2024-09-12T01:42:24.709360+0000","last_fullsized":"2024-09-12T01:42:24.709360+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728037+0000","last_change":"2024-09-12T01:42:24.728037+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728037+0000","last_undegraded":"2024-09-12T01:42:24.728037+0000","last_fullsized":"2024-09-12T01:42:24.728037+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728233+0000","last_change":"2024-09-12T01:42:24.728233+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728233+0000","last_undegraded":"2024-09-12T01:42:24.728233+0000","last_fullsized":"2024-09-12T01:42:24.728233+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708320+0000","last_change":"2024-09-12T01:42:24.708320+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708320+0000","last_undegraded":"2024-09-12T01:42:24.708320+0000","last_fullsized":"2024-09-12T01:42:24.708320+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.710886+0000","last_change":"2024-09-12T01:42:24.710886+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.710886+0000","last_undegraded":"2024-09-12T01:42:24.710886+0000","last_fullsized":"2024-09-12T01:42:24.710886+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728018+0000","last_change":"2024-09-12T01:42:24.728018+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728018+0000","last_undegraded":"2024-09-12T01:42:24.728018+0000","last_fullsized":"2024-09-12T01:42:24.728018+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:24.695950+0000","last_change":"2024-09-12T01:42:24.695950+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.695950+0000","last_undegraded":"2024-09-12T01:42:24.695950+0000","last_fullsized":"2024-09-12T01:42:24.695950+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728340+0000","last_change":"2024-09-12T01:42:24.728340+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728340+0000","last_undegraded":"2024-09-12T01:42:24.728340+0000","last_fullsized":"2024-09-12T01:42:24.728340+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728041+0000","last_change":"2024-09-12T01:42:24.728041+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728041+0000","last_undegraded":"2024-09-12T01:42:24.728041+0000","last_fullsized":"2024-09-12T01:42:24.728041+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709794+0000","last_change":"2024-09-12T01:42:24.709794+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709794+0000","last_undegraded":"2024-09-12T01:42:24.709794+0000","last_fullsized":"2024-09-12T01:42:24.709794+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.705652+0000","last_change":"2024-09-12T01:42:24.705652+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.705652+0000","last_undegraded":"2024-09-12T01:42:24.705652+0000","last_fullsized":"2024-09-12T01:42:24.705652+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.706051+0000","last_change":"2024-09-12T01:42:24.706051+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.706051+0000","last_undegraded":"2024-09-12T01:42:24.706051+0000","last_fullsized":"2024-09-12T01:42:24.706051+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":315,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-12T01:42:24.708570+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:42:24.708570+0000","last_peered":"2024-09-12T01:42:24.708570+0000","last_clean":"2024-09-12T01:42:24.708570+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:42:24.708570+0000","last_undegraded":"2024-09-12T01:42:24.708570+0000","last_fullsized":"2024-09-12T01:42:24.708570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":46,"acting":46,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509525,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509523,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509523,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1830912,"data_stored":1110590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509523,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37136,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334704,"statfs":{"total":96636764160,"available":96598736896,"internally_reserved":0,"allocated":1830912,"data_stored":1110590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574931,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32396,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1224704,"data_stored":514405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:42:30.127 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:42:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.267+0000 7fbb52edd640 1 Processor -- start 2024-09-12T01:42:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.268+0000 7fbb52edd640 1 -- start start 2024-09-12T01:42:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.268+0000 7fbb52edd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbb4c15e660 0x7fbb4c0cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.268+0000 7fbb52edd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb4c0d3310 0x7fbb4c0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.268+0000 7fbb52edd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb4c15ea40 con 0x7fbb4c0d1650 2024-09-12T01:42:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.268+0000 7fbb52edd640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbb4c0d1ac0 con 0x7fbb4c0d3310 2024-09-12T01:42:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.268+0000 7fbb52edd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbb4c0d3870 con 0x7fbb4c15e660 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.268+0000 7fbb4bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb4c0d3310 0x7fbb4c0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.268+0000 7fbb5147a640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbb4c0d1650 0x7fbb4c06bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44524/0 (socket says 172.21.15.60:44524) 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.268+0000 7fbb5147a640 1 -- 172.21.15.60:0/1303179366 learned_addr learned my addr 172.21.15.60:0/1303179366 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.269+0000 7fbb50c79640 1 --2- 172.21.15.60:0/1303179366 >> v2:172.21.15.105:3300/0 conn(0x7fbb4c15e660 0x7fbb4c0cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.269+0000 7fbb4bfff640 1 -- 172.21.15.60:0/1303179366 >> v2:172.21.15.105:3300/0 conn(0x7fbb4c15e660 msgr2=0x7fbb4c0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.269+0000 7fbb4bfff640 1 --2- 172.21.15.60:0/1303179366 >> v2:172.21.15.105:3300/0 conn(0x7fbb4c15e660 0x7fbb4c0cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.269+0000 7fbb4bfff640 1 -- 172.21.15.60:0/1303179366 >> v1:172.21.15.60:6789/0 conn(0x7fbb4c0d1650 legacy=0x7fbb4c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.269+0000 7fbb4bfff640 1 -- 172.21.15.60:0/1303179366 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c0d3b50 con 0x7fbb4c0d3310 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.269+0000 7fbb4b7fe640 1 -- 172.21.15.60:0/1303179366 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600492600 0 0) 0x7fbb4c15ea40 con 0x7fbb4c0d1650 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.270+0000 7fbb4bfff640 1 --2- 172.21.15.60:0/1303179366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb4c0d3310 0x7fbb4c0d1110 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0d10e0 tx=0x7fbb4002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90299ba5f6af4f67 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.270+0000 7fbb4b7fe640 1 -- 172.21.15.60:0/1303179366 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40037070 con 0x7fbb4c0d3310 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.270+0000 7fbb4b7fe640 1 -- 172.21.15.60:0/1303179366 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb40032440 con 0x7fbb4c0d3310 2024-09-12T01:42:30.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.270+0000 7fbb4b7fe640 1 -- 172.21.15.60:0/1303179366 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb40032810 con 0x7fbb4c0d3310 2024-09-12T01:42:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.270+0000 7fbb52edd640 1 -- 172.21.15.60:0/1303179366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb4c0d3310 msgr2=0x7fbb4c0d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.270+0000 7fbb52edd640 1 --2- 172.21.15.60:0/1303179366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb4c0d3310 0x7fbb4c0d1110 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0d10e0 tx=0x7fbb4002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.270+0000 7fbb52edd640 1 -- 172.21.15.60:0/1303179366 shutdown_connections 2024-09-12T01:42:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.270+0000 7fbb52edd640 1 --2- 172.21.15.60:0/1303179366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb4c0d3310 0x7fbb4c0d1110 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.270+0000 7fbb52edd640 1 --2- 172.21.15.60:0/1303179366 >> v2:172.21.15.105:3300/0 conn(0x7fbb4c15e660 0x7fbb4c0cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.270+0000 7fbb52edd640 1 -- 172.21.15.60:0/1303179366 >> 172.21.15.60:0/1303179366 conn(0x7fbb4c0b6410 msgr2=0x7fbb4c0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.270+0000 7fbb52edd640 1 -- 172.21.15.60:0/1303179366 shutdown_connections 2024-09-12T01:42:30.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.270+0000 7fbb52edd640 1 -- 172.21.15.60:0/1303179366 wait complete. 2024-09-12T01:42:30.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.271+0000 7fbb52edd640 1 Processor -- start 2024-09-12T01:42:30.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.271+0000 7fbb52edd640 1 -- start start 2024-09-12T01:42:30.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.272+0000 7fbb52edd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb4c0d1650 0x7fbb4c160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.272+0000 7fbb52edd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb4c0d3310 0x7fbb4c0b9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.272+0000 7fbb52edd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb4c15e660 0x7fbb4c0b9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.272+0000 7fbb52edd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c0d43f0 con 0x7fbb4c0d1650 2024-09-12T01:42:30.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.272+0000 7fbb52edd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbb4c0d4110 con 0x7fbb4c15e660 2024-09-12T01:42:30.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.272+0000 7fbb52edd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbb4c0cfc70 con 0x7fbb4c0d3310 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.272+0000 7fbb50c79640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb4c0d1650 0x7fbb4c160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.272+0000 7fbb50c79640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb4c0d1650 0x7fbb4c160f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56346/0 (socket says 172.21.15.60:56346) 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.272+0000 7fbb50c79640 1 -- 172.21.15.60:0/1935913442 learned_addr learned my addr 172.21.15.60:0/1935913442 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb4bfff640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb4c0d3310 0x7fbb4c0b9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb5147a640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb4c15e660 0x7fbb4c0b9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb50c79640 1 -- 172.21.15.60:0/1935913442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb4c0d3310 msgr2=0x7fbb4c0b9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb50c79640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb4c0d3310 0x7fbb4c0b9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb50c79640 1 -- 172.21.15.60:0/1935913442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb4c15e660 msgr2=0x7fbb4c0b9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb50c79640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb4c15e660 0x7fbb4c0b9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb50c79640 1 -- 172.21.15.60:0/1935913442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb4c1614b0 con 0x7fbb4c0d1650 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb4bfff640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb4c0d3310 0x7fbb4c0b9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb5147a640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb4c15e660 0x7fbb4c0b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:30.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb50c79640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb4c0d1650 0x7fbb4c160f70 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00d800 tx=0x7fbb3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb497fa640 1 -- 172.21.15.60:0/1935913442 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c00b6c0 con 0x7fbb4c0d1650 2024-09-12T01:42:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb497fa640 1 -- 172.21.15.60:0/1935913442 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb3c019070 con 0x7fbb4c0d1650 2024-09-12T01:42:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb52edd640 1 -- 172.21.15.60:0/1935913442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb4c154a30 con 0x7fbb4c0d1650 2024-09-12T01:42:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb497fa640 1 -- 172.21.15.60:0/1935913442 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c00ba80 con 0x7fbb4c0d1650 2024-09-12T01:42:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.273+0000 7fbb52edd640 1 -- 172.21.15.60:0/1935913442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb4c154ff0 con 0x7fbb4c0d1650 2024-09-12T01:42:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.274+0000 7fbb52edd640 1 -- 172.21.15.60:0/1935913442 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb4c0d1110 con 0x7fbb4c0d1650 2024-09-12T01:42:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.275+0000 7fbb497fa640 1 -- 172.21.15.60:0/1935913442 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbb3c00bc20 con 0x7fbb4c0d1650 2024-09-12T01:42:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.275+0000 7fbb497fa640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbb3806be30 0x7fbb3806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.275+0000 7fbb497fa640 1 -- 172.21.15.60:0/1935913442 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fbb3c08b380 con 0x7fbb4c0d1650 2024-09-12T01:42:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.275+0000 7fbb4bfff640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbb3806be30 0x7fbb3806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.276+0000 7fbb4bfff640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbb3806be30 0x7fbb3806e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbb40034000 tx=0x7fbb4002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:30.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.280+0000 7fbb497fa640 1 -- 172.21.15.60:0/1935913442 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbb4c1614b0 con 0x7fbb4c0d1650 2024-09-12T01:42:30.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.450+0000 7fbb52edd640 1 -- 172.21.15.60:0/1935913442 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb4c1616e0 con 0x7fbb3806be30 2024-09-12T01:42:30.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.456+0000 7fbb497fa640 1 -- 172.21.15.60:0/1935913442 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242061 (secure 0 0 0) 0x7fbb4c1616e0 con 0x7fbb3806be30 2024-09-12T01:42:30.458 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:30.461 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:42:30.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.459+0000 7fbb52edd640 1 -- 172.21.15.60:0/1935913442 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbb3806be30 msgr2=0x7fbb3806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.459+0000 7fbb52edd640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbb3806be30 0x7fbb3806e2f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbb40034000 tx=0x7fbb4002e000 comp rx=0 tx=0).stop 2024-09-12T01:42:30.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.459+0000 7fbb52edd640 1 -- 172.21.15.60:0/1935913442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb4c0d1650 msgr2=0x7fbb4c160f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.459+0000 7fbb52edd640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb4c0d1650 0x7fbb4c160f70 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00d800 tx=0x7fbb3c00dcc0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.459+0000 7fbb52edd640 1 -- 172.21.15.60:0/1935913442 shutdown_connections 2024-09-12T01:42:30.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.459+0000 7fbb52edd640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb4c15e660 0x7fbb4c0b9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.459+0000 7fbb52edd640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbb3806be30 0x7fbb3806e2f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.459+0000 7fbb52edd640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb4c0d3310 0x7fbb4c0b9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.459+0000 7fbb52edd640 1 --2- 172.21.15.60:0/1935913442 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb4c0d1650 0x7fbb4c160f70 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.459+0000 7fbb52edd640 1 -- 172.21.15.60:0/1935913442 >> 172.21.15.60:0/1935913442 conn(0x7fbb4c0b6410 msgr2=0x7fbb4c0cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:30.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.459+0000 7fbb52edd640 1 -- 172.21.15.60:0/1935913442 shutdown_connections 2024-09-12T01:42:30.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.459+0000 7fbb52edd640 1 -- 172.21.15.60:0/1935913442 wait complete. 2024-09-12T01:42:30.469 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-09-12T01:42:30.349507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":80,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":277020,"kb_used_data":10876,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754697700,"statfs":{"total":773094113280,"available":772810444800,"internally_reserved":0,"allocated":11137024,"data_stored":5363564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.647413"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182233+0000","last_change":"2024-09-12T01:42:26.726792+0000","last_active":"2024-09-12T01:42:28.182233+0000","last_peered":"2024-09-12T01:42:28.182233+0000","last_clean":"2024-09-12T01:42:28.182233+0000","last_became_active":"2024-09-12T01:42:26.726516+0000","last_became_peered":"2024-09-12T01:42:26.726516+0000","last_unstale":"2024-09-12T01:42:28.182233+0000","last_undegraded":"2024-09-12T01:42:28.182233+0000","last_fullsized":"2024-09-12T01:42:28.182233+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:55.227834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181212+0000","last_change":"2024-09-12T01:42:26.728745+0000","last_active":"2024-09-12T01:42:28.181212+0000","last_peered":"2024-09-12T01:42:28.181212+0000","last_clean":"2024-09-12T01:42:28.181212+0000","last_became_active":"2024-09-12T01:42:26.728451+0000","last_became_peered":"2024-09-12T01:42:26.728451+0000","last_unstale":"2024-09-12T01:42:28.181212+0000","last_undegraded":"2024-09-12T01:42:28.181212+0000","last_fullsized":"2024-09-12T01:42:28.181212+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:04.705312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182141+0000","last_change":"2024-09-12T01:42:26.734336+0000","last_active":"2024-09-12T01:42:28.182141+0000","last_peered":"2024-09-12T01:42:28.182141+0000","last_clean":"2024-09-12T01:42:28.182141+0000","last_became_active":"2024-09-12T01:42:26.733755+0000","last_became_peered":"2024-09-12T01:42:26.733755+0000","last_unstale":"2024-09-12T01:42:28.182141+0000","last_undegraded":"2024-09-12T01:42:28.182141+0000","last_fullsized":"2024-09-12T01:42:28.182141+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:34.570169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728087+0000","last_change":"2024-09-12T01:42:24.728087+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728087+0000","last_undegraded":"2024-09-12T01:42:24.728087+0000","last_fullsized":"2024-09-12T01:42:24.728087+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.706034+0000","last_change":"2024-09-12T01:42:24.706034+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.706034+0000","last_undegraded":"2024-09-12T01:42:24.706034+0000","last_fullsized":"2024-09-12T01:42:24.706034+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181937+0000","last_change":"2024-09-12T01:42:25.715979+0000","last_active":"2024-09-12T01:42:28.181937+0000","last_peered":"2024-09-12T01:42:28.181937+0000","last_clean":"2024-09-12T01:42:28.181937+0000","last_became_active":"2024-09-12T01:42:25.715725+0000","last_became_peered":"2024-09-12T01:42:25.715725+0000","last_unstale":"2024-09-12T01:42:28.181937+0000","last_undegraded":"2024-09-12T01:42:28.181937+0000","last_fullsized":"2024-09-12T01:42:28.181937+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:52.607467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182252+0000","last_change":"2024-09-12T01:42:25.721279+0000","last_active":"2024-09-12T01:42:28.182252+0000","last_peered":"2024-09-12T01:42:28.182252+0000","last_clean":"2024-09-12T01:42:28.182252+0000","last_became_active":"2024-09-12T01:42:25.719878+0000","last_became_peered":"2024-09-12T01:42:25.719878+0000","last_unstale":"2024-09-12T01:42:28.182252+0000","last_undegraded":"2024-09-12T01:42:28.182252+0000","last_fullsized":"2024-09-12T01:42:28.182252+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:58.320261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182145+0000","last_change":"2024-09-12T01:42:26.730702+0000","last_active":"2024-09-12T01:42:28.182145+0000","last_peered":"2024-09-12T01:42:28.182145+0000","last_clean":"2024-09-12T01:42:28.182145+0000","last_became_active":"2024-09-12T01:42:26.730362+0000","last_became_peered":"2024-09-12T01:42:26.730362+0000","last_unstale":"2024-09-12T01:42:28.182145+0000","last_undegraded":"2024-09-12T01:42:28.182145+0000","last_fullsized":"2024-09-12T01:42:28.182145+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:16.269991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708222+0000","last_change":"2024-09-12T01:42:24.708222+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708222+0000","last_undegraded":"2024-09-12T01:42:24.708222+0000","last_fullsized":"2024-09-12T01:42:24.708222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.711354+0000","last_change":"2024-09-12T01:42:24.711354+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.711354+0000","last_undegraded":"2024-09-12T01:42:24.711354+0000","last_fullsized":"2024-09-12T01:42:24.711354+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728018+0000","last_change":"2024-09-12T01:42:24.728018+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728018+0000","last_undegraded":"2024-09-12T01:42:24.728018+0000","last_fullsized":"2024-09-12T01:42:24.728018+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708208+0000","last_change":"2024-09-12T01:42:24.708208+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708208+0000","last_undegraded":"2024-09-12T01:42:24.708208+0000","last_fullsized":"2024-09-12T01:42:24.708208+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182027+0000","last_change":"2024-09-12T01:42:25.719553+0000","last_active":"2024-09-12T01:42:28.182027+0000","last_peered":"2024-09-12T01:42:28.182027+0000","last_clean":"2024-09-12T01:42:28.182027+0000","last_became_active":"2024-09-12T01:42:25.719276+0000","last_became_peered":"2024-09-12T01:42:25.719276+0000","last_unstale":"2024-09-12T01:42:28.182027+0000","last_undegraded":"2024-09-12T01:42:28.182027+0000","last_fullsized":"2024-09-12T01:42:28.182027+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:39.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709861+0000","last_change":"2024-09-12T01:42:24.709861+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709861+0000","last_undegraded":"2024-09-12T01:42:24.709861+0000","last_fullsized":"2024-09-12T01:42:24.709861+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709354+0000","last_change":"2024-09-12T01:42:24.709354+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709354+0000","last_undegraded":"2024-09-12T01:42:24.709354+0000","last_fullsized":"2024-09-12T01:42:24.709354+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"102'6","reported_seq":20,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182349+0000","last_change":"2024-09-12T01:42:25.719478+0000","last_active":"2024-09-12T01:42:28.182349+0000","last_peered":"2024-09-12T01:42:28.182349+0000","last_clean":"2024-09-12T01:42:28.182349+0000","last_became_active":"2024-09-12T01:42:25.719189+0000","last_became_peered":"2024-09-12T01:42:25.719189+0000","last_unstale":"2024-09-12T01:42:28.182349+0000","last_undegraded":"2024-09-12T01:42:28.182349+0000","last_fullsized":"2024-09-12T01:42:28.182349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:30.453725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709368+0000","last_change":"2024-09-12T01:42:24.709368+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709368+0000","last_undegraded":"2024-09-12T01:42:24.709368+0000","last_fullsized":"2024-09-12T01:42:24.709368+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182075+0000","last_change":"2024-09-12T01:42:26.735572+0000","last_active":"2024-09-12T01:42:28.182075+0000","last_peered":"2024-09-12T01:42:28.182075+0000","last_clean":"2024-09-12T01:42:28.182075+0000","last_became_active":"2024-09-12T01:42:26.733518+0000","last_became_peered":"2024-09-12T01:42:26.733518+0000","last_unstale":"2024-09-12T01:42:28.182075+0000","last_undegraded":"2024-09-12T01:42:28.182075+0000","last_fullsized":"2024-09-12T01:42:28.182075+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:52.012838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708166+0000","last_change":"2024-09-12T01:42:24.708166+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708166+0000","last_undegraded":"2024-09-12T01:42:24.708166+0000","last_fullsized":"2024-09-12T01:42:24.708166+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181903+0000","last_change":"2024-09-12T01:42:26.729928+0000","last_active":"2024-09-12T01:42:28.181903+0000","last_peered":"2024-09-12T01:42:28.181903+0000","last_clean":"2024-09-12T01:42:28.181903+0000","last_became_active":"2024-09-12T01:42:26.729652+0000","last_became_peered":"2024-09-12T01:42:26.729652+0000","last_unstale":"2024-09-12T01:42:28.181903+0000","last_undegraded":"2024-09-12T01:42:28.181903+0000","last_fullsized":"2024-09-12T01:42:28.181903+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:01.625910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.710201+0000","last_change":"2024-09-12T01:42:24.710201+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.710201+0000","last_undegraded":"2024-09-12T01:42:24.710201+0000","last_fullsized":"2024-09-12T01:42:24.710201+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.705140+0000","last_change":"2024-09-12T01:42:24.705140+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.705140+0000","last_undegraded":"2024-09-12T01:42:24.705140+0000","last_fullsized":"2024-09-12T01:42:24.705140+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709360+0000","last_change":"2024-09-12T01:42:24.709360+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709360+0000","last_undegraded":"2024-09-12T01:42:24.709360+0000","last_fullsized":"2024-09-12T01:42:24.709360+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728037+0000","last_change":"2024-09-12T01:42:24.728037+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728037+0000","last_undegraded":"2024-09-12T01:42:24.728037+0000","last_fullsized":"2024-09-12T01:42:24.728037+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728233+0000","last_change":"2024-09-12T01:42:24.728233+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728233+0000","last_undegraded":"2024-09-12T01:42:24.728233+0000","last_fullsized":"2024-09-12T01:42:24.728233+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708320+0000","last_change":"2024-09-12T01:42:24.708320+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708320+0000","last_undegraded":"2024-09-12T01:42:24.708320+0000","last_fullsized":"2024-09-12T01:42:24.708320+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.710886+0000","last_change":"2024-09-12T01:42:24.710886+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.710886+0000","last_undegraded":"2024-09-12T01:42:24.710886+0000","last_fullsized":"2024-09-12T01:42:24.710886+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181824+0000","last_change":"2024-09-12T01:42:25.725757+0000","last_active":"2024-09-12T01:42:28.181824+0000","last_peered":"2024-09-12T01:42:28.181824+0000","last_clean":"2024-09-12T01:42:28.181824+0000","last_became_active":"2024-09-12T01:42:25.725336+0000","last_became_peered":"2024-09-12T01:42:25.725336+0000","last_unstale":"2024-09-12T01:42:28.181824+0000","last_undegraded":"2024-09-12T01:42:28.181824+0000","last_fullsized":"2024-09-12T01:42:28.181824+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:11.696886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182138+0000","last_change":"2024-09-12T01:42:25.721483+0000","last_active":"2024-09-12T01:42:28.182138+0000","last_peered":"2024-09-12T01:42:28.182138+0000","last_clean":"2024-09-12T01:42:28.182138+0000","last_became_active":"2024-09-12T01:42:25.720586+0000","last_became_peered":"2024-09-12T01:42:25.720586+0000","last_unstale":"2024-09-12T01:42:28.182138+0000","last_undegraded":"2024-09-12T01:42:28.182138+0000","last_fullsized":"2024-09-12T01:42:28.182138+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:55.783238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182047+0000","last_change":"2024-09-12T01:42:25.716698+0000","last_active":"2024-09-12T01:42:28.182047+0000","last_peered":"2024-09-12T01:42:28.182047+0000","last_clean":"2024-09-12T01:42:28.182047+0000","last_became_active":"2024-09-12T01:42:25.716358+0000","last_became_peered":"2024-09-12T01:42:25.716358+0000","last_unstale":"2024-09-12T01:42:28.182047+0000","last_undegraded":"2024-09-12T01:42:28.182047+0000","last_fullsized":"2024-09-12T01:42:28.182047+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:49.687287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728018+0000","last_change":"2024-09-12T01:42:24.728018+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728018+0000","last_undegraded":"2024-09-12T01:42:24.728018+0000","last_fullsized":"2024-09-12T01:42:24.728018+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182121+0000","last_change":"2024-09-12T01:42:25.721216+0000","last_active":"2024-09-12T01:42:28.182121+0000","last_peered":"2024-09-12T01:42:28.182121+0000","last_clean":"2024-09-12T01:42:28.182121+0000","last_became_active":"2024-09-12T01:42:25.720925+0000","last_became_peered":"2024-09-12T01:42:25.720925+0000","last_unstale":"2024-09-12T01:42:28.182121+0000","last_undegraded":"2024-09-12T01:42:28.182121+0000","last_fullsized":"2024-09-12T01:42:28.182121+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:30.163635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182347+0000","last_change":"2024-09-12T01:42:25.723819+0000","last_active":"2024-09-12T01:42:28.182347+0000","last_peered":"2024-09-12T01:42:28.182347+0000","last_clean":"2024-09-12T01:42:28.182347+0000","last_became_active":"2024-09-12T01:42:25.722727+0000","last_became_peered":"2024-09-12T01:42:25.722727+0000","last_unstale":"2024-09-12T01:42:28.182347+0000","last_undegraded":"2024-09-12T01:42:28.182347+0000","last_fullsized":"2024-09-12T01:42:28.182347+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:34.622889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728340+0000","last_change":"2024-09-12T01:42:24.728340+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728340+0000","last_undegraded":"2024-09-12T01:42:24.728340+0000","last_fullsized":"2024-09-12T01:42:24.728340+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728041+0000","last_change":"2024-09-12T01:42:24.728041+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728041+0000","last_undegraded":"2024-09-12T01:42:24.728041+0000","last_fullsized":"2024-09-12T01:42:24.728041+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709794+0000","last_change":"2024-09-12T01:42:24.709794+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709794+0000","last_undegraded":"2024-09-12T01:42:24.709794+0000","last_fullsized":"2024-09-12T01:42:24.709794+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.705652+0000","last_change":"2024-09-12T01:42:24.705652+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.705652+0000","last_undegraded":"2024-09-12T01:42:24.705652+0000","last_fullsized":"2024-09-12T01:42:24.705652+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181557+0000","last_change":"2024-09-12T01:42:26.725952+0000","last_active":"2024-09-12T01:42:28.181557+0000","last_peered":"2024-09-12T01:42:28.181557+0000","last_clean":"2024-09-12T01:42:28.181557+0000","last_became_active":"2024-09-12T01:42:26.725653+0000","last_became_peered":"2024-09-12T01:42:26.725653+0000","last_unstale":"2024-09-12T01:42:28.181557+0000","last_undegraded":"2024-09-12T01:42:28.181557+0000","last_fullsized":"2024-09-12T01:42:28.181557+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.240746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.706051+0000","last_change":"2024-09-12T01:42:24.706051+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.706051+0000","last_undegraded":"2024-09-12T01:42:24.706051+0000","last_fullsized":"2024-09-12T01:42:24.706051+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":315,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-12T01:42:24.708570+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:42:24.708570+0000","last_peered":"2024-09-12T01:42:24.708570+0000","last_clean":"2024-09-12T01:42:24.708570+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:42:24.708570+0000","last_undegraded":"2024-09-12T01:42:24.708570+0000","last_fullsized":"2024-09-12T01:42:24.708570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509525,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509523,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509523,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1830912,"data_stored":1110590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509523,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37136,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334704,"statfs":{"total":96636764160,"available":96598736896,"internally_reserved":0,"allocated":1830912,"data_stored":1110590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574932,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1290240,"data_stored":541274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:42:30.473 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3f is not active+clean 2024-09-12T01:42:30.473 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.474 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3e is not active+clean 2024-09-12T01:42:30.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.474 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3d is not active+clean 2024-09-12T01:42:30.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.474 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3b is not active+clean 2024-09-12T01:42:30.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.474 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3a is not active+clean 2024-09-12T01:42:30.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.474 INFO:tasks.ceph.ceph_manager.ceph:PG 17.39 is not active+clean 2024-09-12T01:42:30.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.474 INFO:tasks.ceph.ceph_manager.ceph:PG 17.38 is not active+clean 2024-09-12T01:42:30.474 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.475 INFO:tasks.ceph.ceph_manager.ceph:PG 17.37 is not active+clean 2024-09-12T01:42:30.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.475 INFO:tasks.ceph.ceph_manager.ceph:PG 17.36 is not active+clean 2024-09-12T01:42:30.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.475 INFO:tasks.ceph.ceph_manager.ceph:PG 17.35 is not active+clean 2024-09-12T01:42:30.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.475 INFO:tasks.ceph.ceph_manager.ceph:PG 17.34 is not active+clean 2024-09-12T01:42:30.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.475 INFO:tasks.ceph.ceph_manager.ceph:PG 17.33 is not active+clean 2024-09-12T01:42:30.475 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.475 INFO:tasks.ceph.ceph_manager.ceph:PG 17.32 is not active+clean 2024-09-12T01:42:30.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.476 INFO:tasks.ceph.ceph_manager.ceph:PG 17.31 is not active+clean 2024-09-12T01:42:30.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.476 INFO:tasks.ceph.ceph_manager.ceph:PG 17.30 is not active+clean 2024-09-12T01:42:30.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.476 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2f is not active+clean 2024-09-12T01:42:30.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.476 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2e is not active+clean 2024-09-12T01:42:30.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.476 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2d is not active+clean 2024-09-12T01:42:30.476 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.477 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2c is not active+clean 2024-09-12T01:42:30.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.477 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2b is not active+clean 2024-09-12T01:42:30.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.477 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2a is not active+clean 2024-09-12T01:42:30.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.477 INFO:tasks.ceph.ceph_manager.ceph:PG 17.29 is not active+clean 2024-09-12T01:42:30.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.477 INFO:tasks.ceph.ceph_manager.ceph:PG 17.27 is not active+clean 2024-09-12T01:42:30.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.477 INFO:tasks.ceph.ceph_manager.ceph:PG 17.26 is not active+clean 2024-09-12T01:42:30.477 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.478 INFO:tasks.ceph.ceph_manager.ceph:PG 17.24 is not active+clean 2024-09-12T01:42:30.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.478 INFO:tasks.ceph.ceph_manager.ceph:PG 17.23 is not active+clean 2024-09-12T01:42:30.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.478 INFO:tasks.ceph.ceph_manager.ceph:PG 17.22 is not active+clean 2024-09-12T01:42:30.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.478 INFO:tasks.ceph.ceph_manager.ceph:PG 17.21 is not active+clean 2024-09-12T01:42:30.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.478 INFO:tasks.ceph.ceph_manager.ceph:PG 17.20 is not active+clean 2024-09-12T01:42:30.478 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.478 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1e is not active+clean 2024-09-12T01:42:30.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.479 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1f is not active+clean 2024-09-12T01:42:30.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.728087+0000', 'last_change': '2024-09-12T01:42:24.728087+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.728087+0000', 'last_undegraded': '2024-09-12T01:42:24.728087+0000', 'last_fullsized': '2024-09-12T01:42:24.728087+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:42:30.479 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1f is not active+clean 2024-09-12T01:42:30.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.479 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1e is not active+clean 2024-09-12T01:42:30.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.706034+0000', 'last_change': '2024-09-12T01:42:24.706034+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.706034+0000', 'last_undegraded': '2024-09-12T01:42:24.706034+0000', 'last_fullsized': '2024-09-12T01:42:24.706034+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:42:30.479 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1c is not active+clean 2024-09-12T01:42:30.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.479 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1d is not active+clean 2024-09-12T01:42:30.479 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.480 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1b is not active+clean 2024-09-12T01:42:30.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.708222+0000', 'last_change': '2024-09-12T01:42:24.708222+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.708222+0000', 'last_undegraded': '2024-09-12T01:42:24.708222+0000', 'last_fullsized': '2024-09-12T01:42:24.708222+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:42:30.480 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1b is not active+clean 2024-09-12T01:42:30.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.480 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1a is not active+clean 2024-09-12T01:42:30.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.711354+0000', 'last_change': '2024-09-12T01:42:24.711354+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.711354+0000', 'last_undegraded': '2024-09-12T01:42:24.711354+0000', 'last_fullsized': '2024-09-12T01:42:24.711354+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:42:30.480 INFO:tasks.ceph.ceph_manager.ceph:PG 17.18 is not active+clean 2024-09-12T01:42:30.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.480 INFO:tasks.ceph.ceph_manager.ceph:PG 16.19 is not active+clean 2024-09-12T01:42:30.480 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.728018+0000', 'last_change': '2024-09-12T01:42:24.728018+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.728018+0000', 'last_undegraded': '2024-09-12T01:42:24.728018+0000', 'last_fullsized': '2024-09-12T01:42:24.728018+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:42:30.480 INFO:tasks.ceph.ceph_manager.ceph:PG 17.19 is not active+clean 2024-09-12T01:42:30.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.481 INFO:tasks.ceph.ceph_manager.ceph:PG 16.18 is not active+clean 2024-09-12T01:42:30.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.708208+0000', 'last_change': '2024-09-12T01:42:24.708208+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.708208+0000', 'last_undegraded': '2024-09-12T01:42:24.708208+0000', 'last_fullsized': '2024-09-12T01:42:24.708208+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:42:30.481 INFO:tasks.ceph.ceph_manager.ceph:PG 17.16 is not active+clean 2024-09-12T01:42:30.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.481 INFO:tasks.ceph.ceph_manager.ceph:PG 17.17 is not active+clean 2024-09-12T01:42:30.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.481 INFO:tasks.ceph.ceph_manager.ceph:PG 16.16 is not active+clean 2024-09-12T01:42:30.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.709861+0000', 'last_change': '2024-09-12T01:42:24.709861+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.709861+0000', 'last_undegraded': '2024-09-12T01:42:24.709861+0000', 'last_fullsized': '2024-09-12T01:42:24.709861+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:42:30.481 INFO:tasks.ceph.ceph_manager.ceph:PG 17.14 is not active+clean 2024-09-12T01:42:30.481 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.482 INFO:tasks.ceph.ceph_manager.ceph:PG 16.15 is not active+clean 2024-09-12T01:42:30.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.709354+0000', 'last_change': '2024-09-12T01:42:24.709354+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.709354+0000', 'last_undegraded': '2024-09-12T01:42:24.709354+0000', 'last_fullsized': '2024-09-12T01:42:24.709354+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:42:30.482 INFO:tasks.ceph.ceph_manager.ceph:PG 17.15 is not active+clean 2024-09-12T01:42:30.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.482 INFO:tasks.ceph.ceph_manager.ceph:PG 17.12 is not active+clean 2024-09-12T01:42:30.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.482 INFO:tasks.ceph.ceph_manager.ceph:PG 16.13 is not active+clean 2024-09-12T01:42:30.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.709368+0000', 'last_change': '2024-09-12T01:42:24.709368+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.709368+0000', 'last_undegraded': '2024-09-12T01:42:24.709368+0000', 'last_fullsized': '2024-09-12T01:42:24.709368+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:42:30.482 INFO:tasks.ceph.ceph_manager.ceph:PG 16.12 is not active+clean 2024-09-12T01:42:30.482 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.708166+0000', 'last_change': '2024-09-12T01:42:24.708166+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.708166+0000', 'last_undegraded': '2024-09-12T01:42:24.708166+0000', 'last_fullsized': '2024-09-12T01:42:24.708166+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:42:30.482 INFO:tasks.ceph.ceph_manager.ceph:PG 16.10 is not active+clean 2024-09-12T01:42:30.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.710201+0000', 'last_change': '2024-09-12T01:42:24.710201+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.710201+0000', 'last_undegraded': '2024-09-12T01:42:24.710201+0000', 'last_fullsized': '2024-09-12T01:42:24.710201+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:42:30.483 INFO:tasks.ceph.ceph_manager.ceph:PG 17.e is not active+clean 2024-09-12T01:42:30.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.483 INFO:tasks.ceph.ceph_manager.ceph:PG 16.f is not active+clean 2024-09-12T01:42:30.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.705140+0000', 'last_change': '2024-09-12T01:42:24.705140+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.705140+0000', 'last_undegraded': '2024-09-12T01:42:24.705140+0000', 'last_fullsized': '2024-09-12T01:42:24.705140+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:42:30.483 INFO:tasks.ceph.ceph_manager.ceph:PG 17.f is not active+clean 2024-09-12T01:42:30.483 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.484 INFO:tasks.ceph.ceph_manager.ceph:PG 16.e is not active+clean 2024-09-12T01:42:30.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.709360+0000', 'last_change': '2024-09-12T01:42:24.709360+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.709360+0000', 'last_undegraded': '2024-09-12T01:42:24.709360+0000', 'last_fullsized': '2024-09-12T01:42:24.709360+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:42:30.484 INFO:tasks.ceph.ceph_manager.ceph:PG 17.c is not active+clean 2024-09-12T01:42:30.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.484 INFO:tasks.ceph.ceph_manager.ceph:PG 16.d is not active+clean 2024-09-12T01:42:30.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.728037+0000', 'last_change': '2024-09-12T01:42:24.728037+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.728037+0000', 'last_undegraded': '2024-09-12T01:42:24.728037+0000', 'last_fullsized': '2024-09-12T01:42:24.728037+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:42:30.484 INFO:tasks.ceph.ceph_manager.ceph:PG 17.d is not active+clean 2024-09-12T01:42:30.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.484 INFO:tasks.ceph.ceph_manager.ceph:PG 16.c is not active+clean 2024-09-12T01:42:30.484 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.728233+0000', 'last_change': '2024-09-12T01:42:24.728233+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.728233+0000', 'last_undegraded': '2024-09-12T01:42:24.728233+0000', 'last_fullsized': '2024-09-12T01:42:24.728233+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:42:30.485 INFO:tasks.ceph.ceph_manager.ceph:PG 17.a is not active+clean 2024-09-12T01:42:30.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.485 INFO:tasks.ceph.ceph_manager.ceph:PG 16.b is not active+clean 2024-09-12T01:42:30.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.708320+0000', 'last_change': '2024-09-12T01:42:24.708320+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.708320+0000', 'last_undegraded': '2024-09-12T01:42:24.708320+0000', 'last_fullsized': '2024-09-12T01:42:24.708320+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:42:30.485 INFO:tasks.ceph.ceph_manager.ceph:PG 17.b is not active+clean 2024-09-12T01:42:30.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.485 INFO:tasks.ceph.ceph_manager.ceph:PG 16.a is not active+clean 2024-09-12T01:42:30.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.710886+0000', 'last_change': '2024-09-12T01:42:24.710886+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.710886+0000', 'last_undegraded': '2024-09-12T01:42:24.710886+0000', 'last_fullsized': '2024-09-12T01:42:24.710886+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:42:30.485 INFO:tasks.ceph.ceph_manager.ceph:PG 17.8 is not active+clean 2024-09-12T01:42:30.485 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.486 INFO:tasks.ceph.ceph_manager.ceph:PG 17.9 is not active+clean 2024-09-12T01:42:30.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.486 INFO:tasks.ceph.ceph_manager.ceph:PG 17.6 is not active+clean 2024-09-12T01:42:30.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.486 INFO:tasks.ceph.ceph_manager.ceph:PG 17.7 is not active+clean 2024-09-12T01:42:30.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.486 INFO:tasks.ceph.ceph_manager.ceph:PG 16.6 is not active+clean 2024-09-12T01:42:30.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.728018+0000', 'last_change': '2024-09-12T01:42:24.728018+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.728018+0000', 'last_undegraded': '2024-09-12T01:42:24.728018+0000', 'last_fullsized': '2024-09-12T01:42:24.728018+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:42:30.486 INFO:tasks.ceph.ceph_manager.ceph:PG 17.4 is not active+clean 2024-09-12T01:42:30.486 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.486 INFO:tasks.ceph.ceph_manager.ceph:PG 17.5 is not active+clean 2024-09-12T01:42:30.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.487 INFO:tasks.ceph.ceph_manager.ceph:PG 17.2 is not active+clean 2024-09-12T01:42:30.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.487 INFO:tasks.ceph.ceph_manager.ceph:PG 16.3 is not active+clean 2024-09-12T01:42:30.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.728340+0000', 'last_change': '2024-09-12T01:42:24.728340+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.728340+0000', 'last_undegraded': '2024-09-12T01:42:24.728340+0000', 'last_fullsized': '2024-09-12T01:42:24.728340+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:42:30.487 INFO:tasks.ceph.ceph_manager.ceph:PG 17.3 is not active+clean 2024-09-12T01:42:30.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.487 INFO:tasks.ceph.ceph_manager.ceph:PG 16.2 is not active+clean 2024-09-12T01:42:30.487 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.728041+0000', 'last_change': '2024-09-12T01:42:24.728041+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.728041+0000', 'last_undegraded': '2024-09-12T01:42:24.728041+0000', 'last_fullsized': '2024-09-12T01:42:24.728041+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:42:30.487 INFO:tasks.ceph.ceph_manager.ceph:PG 17.0 is not active+clean 2024-09-12T01:42:30.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.488 INFO:tasks.ceph.ceph_manager.ceph:PG 16.1 is not active+clean 2024-09-12T01:42:30.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.709794+0000', 'last_change': '2024-09-12T01:42:24.709794+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.709794+0000', 'last_undegraded': '2024-09-12T01:42:24.709794+0000', 'last_fullsized': '2024-09-12T01:42:24.709794+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:42:30.488 INFO:tasks.ceph.ceph_manager.ceph:PG 17.1 is not active+clean 2024-09-12T01:42:30.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:42:25.701448+0000', 'last_change': '2024-09-12T01:42:25.701448+0000', 'last_active': '2024-09-12T01:42:25.701448+0000', 'last_peered': '2024-09-12T01:42:25.701448+0000', 'last_clean': '2024-09-12T01:42:25.701448+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:25.701448+0000', 'last_undegraded': '2024-09-12T01:42:25.701448+0000', 'last_fullsized': '2024-09-12T01:42:25.701448+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:25.701448+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:42:30.488 INFO:tasks.ceph.ceph_manager.ceph:PG 16.0 is not active+clean 2024-09-12T01:42:30.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.705652+0000', 'last_change': '2024-09-12T01:42:24.705652+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.705652+0000', 'last_undegraded': '2024-09-12T01:42:24.705652+0000', 'last_fullsized': '2024-09-12T01:42:24.705652+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:42:30.488 INFO:tasks.ceph.ceph_manager.ceph:PG 16.11 is not active+clean 2024-09-12T01:42:30.488 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 100, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:42:24.706051+0000', 'last_change': '2024-09-12T01:42:24.706051+0000', 'last_active': '2024-09-12T01:42:24.695950+0000', 'last_peered': '2024-09-12T01:42:24.695950+0000', 'last_clean': '2024-09-12T01:42:24.695950+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:42:24.706051+0000', 'last_undegraded': '2024-09-12T01:42:24.706051+0000', 'last_fullsized': '2024-09-12T01:42:24.706051+0000', 'mapping_epoch': 100, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 100, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'last_clean_scrub_stamp': '2024-09-12T01:42:24.695950+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:42:30.489 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:42:30.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.611+0000 7fd4281d6640 1 Processor -- start 2024-09-12T01:42:30.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.611+0000 7fd4281d6640 1 -- start start 2024-09-12T01:42:30.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.612+0000 7fd4281d6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd42015c2b0 0x7fd4200b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.612+0000 7fd4281d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42015f200 0x7fd42006d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.612+0000 7fd4281d6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd42015fb10 con 0x7fd4200b72f0 2024-09-12T01:42:30.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.612+0000 7fd4281d6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd4200b5900 con 0x7fd42015c2b0 2024-09-12T01:42:30.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.612+0000 7fd4281d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd42015f830 con 0x7fd42015f200 2024-09-12T01:42:30.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.612+0000 7fd425f72640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd42015c2b0 0x7fd4200b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.612+0000 7fd425f72640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd42015c2b0 0x7fd4200b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56354/0 (socket says 172.21.15.60:56354) 2024-09-12T01:42:30.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.612+0000 7fd425f72640 1 -- 172.21.15.60:0/1039660227 learned_addr learned my addr 172.21.15.60:0/1039660227 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:30.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.612+0000 7fd426773640 1 --2- 172.21.15.60:0/1039660227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42015f200 0x7fd42006d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.613+0000 7fd425f72640 1 -- 172.21.15.60:0/1039660227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42015f200 msgr2=0x7fd42006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:30.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.613+0000 7fd425f72640 1 --2- 172.21.15.60:0/1039660227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42015f200 0x7fd42006d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.613+0000 7fd425f72640 1 -- 172.21.15.60:0/1039660227 >> v1:172.21.15.105:6789/0 conn(0x7fd4200b72f0 legacy=0x7fd42015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.613+0000 7fd425f72640 1 -- 172.21.15.60:0/1039660227 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42006ce30 con 0x7fd42015c2b0 2024-09-12T01:42:30.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.613+0000 7fd424f70640 1 -- 172.21.15.60:0/1039660227 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2398557688 0 0) 0x7fd42015fb10 con 0x7fd4200b72f0 2024-09-12T01:42:30.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.613+0000 7fd425f72640 1 --2- 172.21.15.60:0/1039660227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42015c2b0 0x7fd4200b6db0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009870 tx=0x7fd41c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35333198132dd7ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:30.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.614+0000 7fd424f70640 1 -- 172.21.15.60:0/1039660227 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c037070 con 0x7fd42015c2b0 2024-09-12T01:42:30.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.614+0000 7fd424f70640 1 -- 172.21.15.60:0/1039660227 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd41c032440 con 0x7fd42015c2b0 2024-09-12T01:42:30.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.614+0000 7fd424f70640 1 -- 172.21.15.60:0/1039660227 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c032810 con 0x7fd42015c2b0 2024-09-12T01:42:30.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.614+0000 7fd4281d6640 1 -- 172.21.15.60:0/1039660227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42015c2b0 msgr2=0x7fd4200b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.614+0000 7fd4281d6640 1 --2- 172.21.15.60:0/1039660227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42015c2b0 0x7fd4200b6db0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fd41c009870 tx=0x7fd41c02a270 comp rx=0 tx=0).stop 2024-09-12T01:42:30.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.614+0000 7fd4281d6640 1 -- 172.21.15.60:0/1039660227 shutdown_connections 2024-09-12T01:42:30.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.614+0000 7fd4281d6640 1 --2- 172.21.15.60:0/1039660227 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42015f200 0x7fd42006d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.614+0000 7fd4281d6640 1 --2- 172.21.15.60:0/1039660227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd42015c2b0 0x7fd4200b6db0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.614+0000 7fd4281d6640 1 -- 172.21.15.60:0/1039660227 >> 172.21.15.60:0/1039660227 conn(0x7fd4200b4240 msgr2=0x7fd4200b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:30.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.614+0000 7fd4281d6640 1 -- 172.21.15.60:0/1039660227 shutdown_connections 2024-09-12T01:42:30.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.614+0000 7fd4281d6640 1 -- 172.21.15.60:0/1039660227 wait complete. 2024-09-12T01:42:30.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.615+0000 7fd4281d6640 1 Processor -- start 2024-09-12T01:42:30.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.616+0000 7fd4281d6640 1 -- start start 2024-09-12T01:42:30.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.616+0000 7fd4281d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4200b72f0 0x7fd4200cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.616+0000 7fd4281d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42015c2b0 0x7fd420155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.616+0000 7fd4281d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd42015f200 0x7fd420161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.616+0000 7fd4281d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd4200b7760 con 0x7fd4200b72f0 2024-09-12T01:42:30.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.616+0000 7fd4281d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd42006d3f0 con 0x7fd42015f200 2024-09-12T01:42:30.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.616+0000 7fd4281d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd42006de50 con 0x7fd42015c2b0 2024-09-12T01:42:30.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.616+0000 7fd425f72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4200b72f0 0x7fd4200cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.616+0000 7fd425f72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4200b72f0 0x7fd4200cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56356/0 (socket says 172.21.15.60:56356) 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.616+0000 7fd425f72640 1 -- 172.21.15.60:0/3138797651 learned_addr learned my addr 172.21.15.60:0/3138797651 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd425771640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42015c2b0 0x7fd420155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd426773640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd42015f200 0x7fd420161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd425f72640 1 -- 172.21.15.60:0/3138797651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42015c2b0 msgr2=0x7fd420155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd425f72640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42015c2b0 0x7fd420155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd425f72640 1 -- 172.21.15.60:0/3138797651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd42015f200 msgr2=0x7fd420161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd425f72640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd42015f200 0x7fd420161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd425f72640 1 -- 172.21.15.60:0/3138797651 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd420159510 con 0x7fd4200b72f0 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd425f72640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4200b72f0 0x7fd4200cecb0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd41c035040 tx=0x7fd41c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd4167fc640 1 -- 172.21.15.60:0/3138797651 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c037040 con 0x7fd4200b72f0 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd4167fc640 1 -- 172.21.15.60:0/3138797651 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd41c004030 con 0x7fd4200b72f0 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd4281d6640 1 -- 172.21.15.60:0/3138797651 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4201e7910 con 0x7fd4200b72f0 2024-09-12T01:42:30.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd4167fc640 1 -- 172.21.15.60:0/3138797651 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd41c004420 con 0x7fd4200b72f0 2024-09-12T01:42:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.617+0000 7fd4281d6640 1 -- 172.21.15.60:0/3138797651 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4201e7bb0 con 0x7fd4200b72f0 2024-09-12T01:42:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.618+0000 7fd4281d6640 1 -- 172.21.15.60:0/3138797651 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4200b6db0 con 0x7fd4200b72f0 2024-09-12T01:42:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.619+0000 7fd4167fc640 1 -- 172.21.15.60:0/3138797651 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd41c03a070 con 0x7fd4200b72f0 2024-09-12T01:42:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.619+0000 7fd4167fc640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd40406be30 0x7fd40406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.619+0000 7fd4167fc640 1 -- 172.21.15.60:0/3138797651 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fd41c0ab350 con 0x7fd4200b72f0 2024-09-12T01:42:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.619+0000 7fd425771640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd40406be30 0x7fd40406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.620+0000 7fd425771640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd40406be30 0x7fd40406e2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd420161d40 tx=0x7fd410009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:30.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.624+0000 7fd4167fc640 1 -- 172.21.15.60:0/3138797651 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd41c041020 con 0x7fd4200b72f0 2024-09-12T01:42:30.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.867+0000 7fd4281d6640 1 -- 172.21.15.60:0/3138797651 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd420155780 con 0x7fd4200b72f0 2024-09-12T01:42:30.866 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.867+0000 7fd4167fc640 1 -- 172.21.15.60:0/3138797651 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1217 (secure 0 0 0) 0x7fd41c079d90 con 0x7fd4200b72f0 2024-09-12T01:42:30.867 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:30.867 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":417,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":103,"num_osds":8,"num_up_osds":8,"osd_up_since":1726104944,"num_in_osds":8,"osd_in_since":1726104934,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":57},{"state_name":"creating+peering","count":23},{"state_name":"active+clean","count":17}],"num_pgs":97,"num_pools":3,"num_objects":9,"data_bytes":591980,"bytes_used":283668480,"bytes_avail":772810444800,"bytes_total":773094113280,"unknown_pgs_ratio":0.58762884140014648,"inactive_pgs_ratio":0.23711340129375458,"write_bytes_sec":543,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":61,"btime":"2024-09-12T01:42:28:803118+0000","id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"b","status":"up:active","gid":7110}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2024-09-12T01:40:20.318583+0000","services":{}},"progress_events":{}} 2024-09-12T01:42:30.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.869+0000 7fd4281d6640 1 -- 172.21.15.60:0/3138797651 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd40406be30 msgr2=0x7fd40406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.869+0000 7fd4281d6640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd40406be30 0x7fd40406e2f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd420161d40 tx=0x7fd410009040 comp rx=0 tx=0).stop 2024-09-12T01:42:30.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.869+0000 7fd4281d6640 1 -- 172.21.15.60:0/3138797651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4200b72f0 msgr2=0x7fd4200cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.869+0000 7fd4281d6640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4200b72f0 0x7fd4200cecb0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fd41c035040 tx=0x7fd41c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.869+0000 7fd4281d6640 1 -- 172.21.15.60:0/3138797651 shutdown_connections 2024-09-12T01:42:30.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.869+0000 7fd4281d6640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd42015f200 0x7fd420161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.869+0000 7fd4281d6640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd40406be30 0x7fd40406e2f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.869+0000 7fd4281d6640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd42015c2b0 0x7fd420155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.869+0000 7fd4281d6640 1 --2- 172.21.15.60:0/3138797651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4200b72f0 0x7fd4200cecb0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.869+0000 7fd4281d6640 1 -- 172.21.15.60:0/3138797651 >> 172.21.15.60:0/3138797651 conn(0x7fd4200b4240 msgr2=0x7fd42015e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.869+0000 7fd4281d6640 1 -- 172.21.15.60:0/3138797651 shutdown_connections 2024-09-12T01:42:30.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.869+0000 7fd4281d6640 1 -- 172.21.15.60:0/3138797651 wait complete. 2024-09-12T01:42:30.880 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:42:30.880 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:42:30.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.982+0000 7f854059f640 1 Processor -- start 2024-09-12T01:42:30.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.982+0000 7f854059f640 1 -- start start 2024-09-12T01:42:30.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.983+0000 7f854059f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85380b5460 0x7f85380b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.983+0000 7f854059f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85380b58f0 con 0x7f853815e800 2024-09-12T01:42:30.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.983+0000 7f854059f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f853806ea60 con 0x7f85380b7390 2024-09-12T01:42:30.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.983+0000 7f854059f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f853806ed40 con 0x7f85380b5460 2024-09-12T01:42:30.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.983+0000 7f853e33b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f853815e800 0x7f853815ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44526/0 (socket says 172.21.15.60:44526) 2024-09-12T01:42:30.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853e33b640 1 -- 172.21.15.60:0/3012713663 learned_addr learned my addr 172.21.15.60:0/3012713663 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853db3a640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85380b5460 0x7f85380b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161871751 0 0) 0x7f85380b58f0 con 0x7f853815e800 2024-09-12T01:42:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8520003520 con 0x7f853815e800 2024-09-12T01:42:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 419338688 0 0) 0x7f8520003520 con 0x7f853815e800 2024-09-12T01:42:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85380b5460 msgr2=0x7f85380b6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85380b5460 0x7f85380b6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 >> v1:172.21.15.105:6789/0 conn(0x7f85380b7390 legacy=0x7f853806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853806cde0 con 0x7f853815e800 2024-09-12T01:42:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f85280019f0 con 0x7f853815e800 2024-09-12T01:42:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 >> v1:172.21.15.60:6789/0 conn(0x7f853815e800 legacy=0x7f853815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85200039e0 0x7f8520003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8520004800 0x7f8520004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85380b5460 0x7f85200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f853806ed40 con 0x7f85200039e0 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f852000baa0 con 0x7f8520004800 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f852000bca0 con 0x7f85380b5460 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853e33b640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85200039e0 0x7f8520003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853db3a640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8520004800 0x7f8520004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.984+0000 7f853eb3c640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85380b5460 0x7f85200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.985+0000 7f853e33b640 1 -- 172.21.15.60:0/3012713663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85380b5460 msgr2=0x7f85200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.985+0000 7f853e33b640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85380b5460 0x7f85200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.985+0000 7f853e33b640 1 -- 172.21.15.60:0/3012713663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8520004800 msgr2=0x7f8520004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.985+0000 7f853e33b640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8520004800 0x7f8520004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.985+0000 7f853e33b640 1 -- 172.21.15.60:0/3012713663 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8520003520 con 0x7f85200039e0 2024-09-12T01:42:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.985+0000 7f853eb3c640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85380b5460 0x7f85200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.985+0000 7f853e33b640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85200039e0 0x7f8520003e00 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f852800a830 tx=0x7f8520005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7831ff4f541b3f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.985+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852800a480 con 0x7f85200039e0 2024-09-12T01:42:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.985+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852802f070 con 0x7f85200039e0 2024-09-12T01:42:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.985+0000 7f853d339640 1 -- 172.21.15.60:0/3012713663 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852802bc50 con 0x7f85200039e0 2024-09-12T01:42:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.986+0000 7f854059f640 1 -- 172.21.15.60:0/3012713663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85200039e0 msgr2=0x7f8520003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.986+0000 7f854059f640 1 --2- 172.21.15.60:0/3012713663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85200039e0 0x7f8520003e00 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f852800a830 tx=0x7f8520005830 comp rx=0 tx=0).stop 2024-09-12T01:42:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.986+0000 7f853eb3c640 1 -- 172.21.15.60:0/3012713663 reap_dead start 2024-09-12T01:42:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.986+0000 7f854059f640 1 -- 172.21.15.60:0/3012713663 shutdown_connections 2024-09-12T01:42:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.986+0000 7f854059f640 1 -- 172.21.15.60:0/3012713663 >> 172.21.15.60:0/3012713663 conn(0x7f85380d24d0 msgr2=0x7f85380d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.986+0000 7f854059f640 1 -- 172.21.15.60:0/3012713663 shutdown_connections 2024-09-12T01:42:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.986+0000 7f854059f640 1 -- 172.21.15.60:0/3012713663 wait complete. 2024-09-12T01:42:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.987+0000 7f854059f640 1 Processor -- start 2024-09-12T01:42:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.987+0000 7f854059f640 1 -- start start 2024-09-12T01:42:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f854059f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85200039e0 0x7f85381f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f854059f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85381ee090 0x7f85381ee510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f854059f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85381611f0 0x7f8538161660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f854059f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f85380b77c0 con 0x7f85381ee090 2024-09-12T01:42:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f854059f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f853806d3a0 con 0x7f85381611f0 2024-09-12T01:42:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f854059f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f85380d31e0 con 0x7f85200039e0 2024-09-12T01:42:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f853db3a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85381ee090 0x7f85381ee510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f853db3a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85381ee090 0x7f85381ee510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56380/0 (socket says 172.21.15.60:56380) 2024-09-12T01:42:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f853db3a640 1 -- 172.21.15.60:0/3652515808 learned_addr learned my addr 172.21.15.60:0/3652515808 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f853eb3c640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85381611f0 0x7f8538161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f853e33b640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85200039e0 0x7f85381f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f853db3a640 1 -- 172.21.15.60:0/3652515808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85200039e0 msgr2=0x7f85381f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f853db3a640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85200039e0 0x7f85381f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f853db3a640 1 -- 172.21.15.60:0/3652515808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85381611f0 msgr2=0x7f8538161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f853db3a640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85381611f0 0x7f8538161660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f853db3a640 1 -- 172.21.15.60:0/3652515808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85381f54e0 con 0x7f85381ee090 2024-09-12T01:42:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.988+0000 7f853eb3c640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85381611f0 0x7f8538161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.989+0000 7f853db3a640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85381ee090 0x7f85381ee510 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f852c0119a0 tx=0x7f852c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.989+0000 7f8536ffd640 1 -- 172.21.15.60:0/3652515808 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c00faf0 con 0x7f85381ee090 2024-09-12T01:42:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.989+0000 7f8536ffd640 1 -- 172.21.15.60:0/3652515808 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f852c00fc90 con 0x7f85381ee090 2024-09-12T01:42:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.989+0000 7f8536ffd640 1 -- 172.21.15.60:0/3652515808 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852c014440 con 0x7f85381ee090 2024-09-12T01:42:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.989+0000 7f854059f640 1 -- 172.21.15.60:0/3652515808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f853815f840 con 0x7f85381ee090 2024-09-12T01:42:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.989+0000 7f854059f640 1 -- 172.21.15.60:0/3652515808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f853814e6a0 con 0x7f85381ee090 2024-09-12T01:42:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.990+0000 7f854059f640 1 -- 172.21.15.60:0/3652515808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8538072b60 con 0x7f85381ee090 2024-09-12T01:42:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.990+0000 7f8536ffd640 1 -- 172.21.15.60:0/3652515808 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f852c012040 con 0x7f85381ee090 2024-09-12T01:42:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.991+0000 7f8536ffd640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f852406be30 0x7f852406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.991+0000 7f8536ffd640 1 -- 172.21.15.60:0/3652515808 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f852c08b5b0 con 0x7f85381ee090 2024-09-12T01:42:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.991+0000 7f853e33b640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f852406be30 0x7f852406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:30.993 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.991+0000 7f853e33b640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f852406be30 0x7f852406e2f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8528033000 tx=0x7f8528009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:30.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:30.995+0000 7f8536ffd640 1 -- 172.21.15.60:0/3652515808 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8538072b60 con 0x7f85381ee090 2024-09-12T01:42:31.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.168+0000 7f854059f640 1 -- 172.21.15.60:0/3652515808 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85380d1bf0 con 0x7f852406be30 2024-09-12T01:42:31.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.173+0000 7f8536ffd640 1 -- 172.21.15.60:0/3652515808 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242061 (secure 0 0 0) 0x7f85380d1bf0 con 0x7f852406be30 2024-09-12T01:42:31.175 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:31.176 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:42:31.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.176+0000 7f854059f640 1 -- 172.21.15.60:0/3652515808 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f852406be30 msgr2=0x7f852406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:31.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.176+0000 7f854059f640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f852406be30 0x7f852406e2f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f8528033000 tx=0x7f8528009030 comp rx=0 tx=0).stop 2024-09-12T01:42:31.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.176+0000 7f854059f640 1 -- 172.21.15.60:0/3652515808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85381ee090 msgr2=0x7f85381ee510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:31.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.176+0000 7f854059f640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85381ee090 0x7f85381ee510 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f852c0119a0 tx=0x7f852c011e60 comp rx=0 tx=0).stop 2024-09-12T01:42:31.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.176+0000 7f854059f640 1 -- 172.21.15.60:0/3652515808 shutdown_connections 2024-09-12T01:42:31.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.176+0000 7f854059f640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85381611f0 0x7f8538161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:31.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.176+0000 7f854059f640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85381ee090 0x7f85381ee510 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:31.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.176+0000 7f854059f640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f852406be30 0x7f852406e2f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:31.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.176+0000 7f854059f640 1 --2- 172.21.15.60:0/3652515808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85200039e0 0x7f85381f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:31.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.176+0000 7f854059f640 1 -- 172.21.15.60:0/3652515808 >> 172.21.15.60:0/3652515808 conn(0x7f85380d24d0 msgr2=0x7f85380b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:31.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.177+0000 7f854059f640 1 -- 172.21.15.60:0/3652515808 shutdown_connections 2024-09-12T01:42:31.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:31.177+0000 7f854059f640 1 -- 172.21.15.60:0/3652515808 wait complete. 2024-09-12T01:42:31.186 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2024-09-12T01:42:30.349507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591980,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":129,"ondisk_log_size":129,"up":80,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":277020,"kb_used_data":10876,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754697700,"statfs":{"total":773094113280,"available":772810444800,"internally_reserved":0,"allocated":11137024,"data_stored":5363564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.647413"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182233+0000","last_change":"2024-09-12T01:42:26.726792+0000","last_active":"2024-09-12T01:42:28.182233+0000","last_peered":"2024-09-12T01:42:28.182233+0000","last_clean":"2024-09-12T01:42:28.182233+0000","last_became_active":"2024-09-12T01:42:26.726516+0000","last_became_peered":"2024-09-12T01:42:26.726516+0000","last_unstale":"2024-09-12T01:42:28.182233+0000","last_undegraded":"2024-09-12T01:42:28.182233+0000","last_fullsized":"2024-09-12T01:42:28.182233+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:55.227834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181212+0000","last_change":"2024-09-12T01:42:26.728745+0000","last_active":"2024-09-12T01:42:28.181212+0000","last_peered":"2024-09-12T01:42:28.181212+0000","last_clean":"2024-09-12T01:42:28.181212+0000","last_became_active":"2024-09-12T01:42:26.728451+0000","last_became_peered":"2024-09-12T01:42:26.728451+0000","last_unstale":"2024-09-12T01:42:28.181212+0000","last_undegraded":"2024-09-12T01:42:28.181212+0000","last_fullsized":"2024-09-12T01:42:28.181212+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:04.705312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182141+0000","last_change":"2024-09-12T01:42:26.734336+0000","last_active":"2024-09-12T01:42:28.182141+0000","last_peered":"2024-09-12T01:42:28.182141+0000","last_clean":"2024-09-12T01:42:28.182141+0000","last_became_active":"2024-09-12T01:42:26.733755+0000","last_became_peered":"2024-09-12T01:42:26.733755+0000","last_unstale":"2024-09-12T01:42:28.182141+0000","last_undegraded":"2024-09-12T01:42:28.182141+0000","last_fullsized":"2024-09-12T01:42:28.182141+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:34.570169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728087+0000","last_change":"2024-09-12T01:42:24.728087+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728087+0000","last_undegraded":"2024-09-12T01:42:24.728087+0000","last_fullsized":"2024-09-12T01:42:24.728087+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.706034+0000","last_change":"2024-09-12T01:42:24.706034+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.706034+0000","last_undegraded":"2024-09-12T01:42:24.706034+0000","last_fullsized":"2024-09-12T01:42:24.706034+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181937+0000","last_change":"2024-09-12T01:42:25.715979+0000","last_active":"2024-09-12T01:42:28.181937+0000","last_peered":"2024-09-12T01:42:28.181937+0000","last_clean":"2024-09-12T01:42:28.181937+0000","last_became_active":"2024-09-12T01:42:25.715725+0000","last_became_peered":"2024-09-12T01:42:25.715725+0000","last_unstale":"2024-09-12T01:42:28.181937+0000","last_undegraded":"2024-09-12T01:42:28.181937+0000","last_fullsized":"2024-09-12T01:42:28.181937+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:52.607467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182252+0000","last_change":"2024-09-12T01:42:25.721279+0000","last_active":"2024-09-12T01:42:28.182252+0000","last_peered":"2024-09-12T01:42:28.182252+0000","last_clean":"2024-09-12T01:42:28.182252+0000","last_became_active":"2024-09-12T01:42:25.719878+0000","last_became_peered":"2024-09-12T01:42:25.719878+0000","last_unstale":"2024-09-12T01:42:28.182252+0000","last_undegraded":"2024-09-12T01:42:28.182252+0000","last_fullsized":"2024-09-12T01:42:28.182252+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:58.320261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182145+0000","last_change":"2024-09-12T01:42:26.730702+0000","last_active":"2024-09-12T01:42:28.182145+0000","last_peered":"2024-09-12T01:42:28.182145+0000","last_clean":"2024-09-12T01:42:28.182145+0000","last_became_active":"2024-09-12T01:42:26.730362+0000","last_became_peered":"2024-09-12T01:42:26.730362+0000","last_unstale":"2024-09-12T01:42:28.182145+0000","last_undegraded":"2024-09-12T01:42:28.182145+0000","last_fullsized":"2024-09-12T01:42:28.182145+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:16.269991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708222+0000","last_change":"2024-09-12T01:42:24.708222+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708222+0000","last_undegraded":"2024-09-12T01:42:24.708222+0000","last_fullsized":"2024-09-12T01:42:24.708222+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.711354+0000","last_change":"2024-09-12T01:42:24.711354+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.711354+0000","last_undegraded":"2024-09-12T01:42:24.711354+0000","last_fullsized":"2024-09-12T01:42:24.711354+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728018+0000","last_change":"2024-09-12T01:42:24.728018+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728018+0000","last_undegraded":"2024-09-12T01:42:24.728018+0000","last_fullsized":"2024-09-12T01:42:24.728018+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708208+0000","last_change":"2024-09-12T01:42:24.708208+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708208+0000","last_undegraded":"2024-09-12T01:42:24.708208+0000","last_fullsized":"2024-09-12T01:42:24.708208+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182027+0000","last_change":"2024-09-12T01:42:25.719553+0000","last_active":"2024-09-12T01:42:28.182027+0000","last_peered":"2024-09-12T01:42:28.182027+0000","last_clean":"2024-09-12T01:42:28.182027+0000","last_became_active":"2024-09-12T01:42:25.719276+0000","last_became_peered":"2024-09-12T01:42:25.719276+0000","last_unstale":"2024-09-12T01:42:28.182027+0000","last_undegraded":"2024-09-12T01:42:28.182027+0000","last_fullsized":"2024-09-12T01:42:28.182027+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:39.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709861+0000","last_change":"2024-09-12T01:42:24.709861+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709861+0000","last_undegraded":"2024-09-12T01:42:24.709861+0000","last_fullsized":"2024-09-12T01:42:24.709861+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709354+0000","last_change":"2024-09-12T01:42:24.709354+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709354+0000","last_undegraded":"2024-09-12T01:42:24.709354+0000","last_fullsized":"2024-09-12T01:42:24.709354+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"102'6","reported_seq":20,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182349+0000","last_change":"2024-09-12T01:42:25.719478+0000","last_active":"2024-09-12T01:42:28.182349+0000","last_peered":"2024-09-12T01:42:28.182349+0000","last_clean":"2024-09-12T01:42:28.182349+0000","last_became_active":"2024-09-12T01:42:25.719189+0000","last_became_peered":"2024-09-12T01:42:25.719189+0000","last_unstale":"2024-09-12T01:42:28.182349+0000","last_undegraded":"2024-09-12T01:42:28.182349+0000","last_fullsized":"2024-09-12T01:42:28.182349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:30.453725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709368+0000","last_change":"2024-09-12T01:42:24.709368+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709368+0000","last_undegraded":"2024-09-12T01:42:24.709368+0000","last_fullsized":"2024-09-12T01:42:24.709368+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182075+0000","last_change":"2024-09-12T01:42:26.735572+0000","last_active":"2024-09-12T01:42:28.182075+0000","last_peered":"2024-09-12T01:42:28.182075+0000","last_clean":"2024-09-12T01:42:28.182075+0000","last_became_active":"2024-09-12T01:42:26.733518+0000","last_became_peered":"2024-09-12T01:42:26.733518+0000","last_unstale":"2024-09-12T01:42:28.182075+0000","last_undegraded":"2024-09-12T01:42:28.182075+0000","last_fullsized":"2024-09-12T01:42:28.182075+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:52.012838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708166+0000","last_change":"2024-09-12T01:42:24.708166+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708166+0000","last_undegraded":"2024-09-12T01:42:24.708166+0000","last_fullsized":"2024-09-12T01:42:24.708166+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181903+0000","last_change":"2024-09-12T01:42:26.729928+0000","last_active":"2024-09-12T01:42:28.181903+0000","last_peered":"2024-09-12T01:42:28.181903+0000","last_clean":"2024-09-12T01:42:28.181903+0000","last_became_active":"2024-09-12T01:42:26.729652+0000","last_became_peered":"2024-09-12T01:42:26.729652+0000","last_unstale":"2024-09-12T01:42:28.181903+0000","last_undegraded":"2024-09-12T01:42:28.181903+0000","last_fullsized":"2024-09-12T01:42:28.181903+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:01.625910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.710201+0000","last_change":"2024-09-12T01:42:24.710201+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.710201+0000","last_undegraded":"2024-09-12T01:42:24.710201+0000","last_fullsized":"2024-09-12T01:42:24.710201+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.705140+0000","last_change":"2024-09-12T01:42:24.705140+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.705140+0000","last_undegraded":"2024-09-12T01:42:24.705140+0000","last_fullsized":"2024-09-12T01:42:24.705140+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709360+0000","last_change":"2024-09-12T01:42:24.709360+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709360+0000","last_undegraded":"2024-09-12T01:42:24.709360+0000","last_fullsized":"2024-09-12T01:42:24.709360+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728037+0000","last_change":"2024-09-12T01:42:24.728037+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728037+0000","last_undegraded":"2024-09-12T01:42:24.728037+0000","last_fullsized":"2024-09-12T01:42:24.728037+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728233+0000","last_change":"2024-09-12T01:42:24.728233+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728233+0000","last_undegraded":"2024-09-12T01:42:24.728233+0000","last_fullsized":"2024-09-12T01:42:24.728233+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.708320+0000","last_change":"2024-09-12T01:42:24.708320+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.708320+0000","last_undegraded":"2024-09-12T01:42:24.708320+0000","last_fullsized":"2024-09-12T01:42:24.708320+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.710886+0000","last_change":"2024-09-12T01:42:24.710886+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.710886+0000","last_undegraded":"2024-09-12T01:42:24.710886+0000","last_fullsized":"2024-09-12T01:42:24.710886+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181824+0000","last_change":"2024-09-12T01:42:25.725757+0000","last_active":"2024-09-12T01:42:28.181824+0000","last_peered":"2024-09-12T01:42:28.181824+0000","last_clean":"2024-09-12T01:42:28.181824+0000","last_became_active":"2024-09-12T01:42:25.725336+0000","last_became_peered":"2024-09-12T01:42:25.725336+0000","last_unstale":"2024-09-12T01:42:28.181824+0000","last_undegraded":"2024-09-12T01:42:28.181824+0000","last_fullsized":"2024-09-12T01:42:28.181824+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:11.696886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182138+0000","last_change":"2024-09-12T01:42:25.721483+0000","last_active":"2024-09-12T01:42:28.182138+0000","last_peered":"2024-09-12T01:42:28.182138+0000","last_clean":"2024-09-12T01:42:28.182138+0000","last_became_active":"2024-09-12T01:42:25.720586+0000","last_became_peered":"2024-09-12T01:42:25.720586+0000","last_unstale":"2024-09-12T01:42:28.182138+0000","last_undegraded":"2024-09-12T01:42:28.182138+0000","last_fullsized":"2024-09-12T01:42:28.182138+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:55.783238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182047+0000","last_change":"2024-09-12T01:42:25.716698+0000","last_active":"2024-09-12T01:42:28.182047+0000","last_peered":"2024-09-12T01:42:28.182047+0000","last_clean":"2024-09-12T01:42:28.182047+0000","last_became_active":"2024-09-12T01:42:25.716358+0000","last_became_peered":"2024-09-12T01:42:25.716358+0000","last_unstale":"2024-09-12T01:42:28.182047+0000","last_undegraded":"2024-09-12T01:42:28.182047+0000","last_fullsized":"2024-09-12T01:42:28.182047+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:49.687287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728018+0000","last_change":"2024-09-12T01:42:24.728018+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728018+0000","last_undegraded":"2024-09-12T01:42:24.728018+0000","last_fullsized":"2024-09-12T01:42:24.728018+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182121+0000","last_change":"2024-09-12T01:42:25.721216+0000","last_active":"2024-09-12T01:42:28.182121+0000","last_peered":"2024-09-12T01:42:28.182121+0000","last_clean":"2024-09-12T01:42:28.182121+0000","last_became_active":"2024-09-12T01:42:25.720925+0000","last_became_peered":"2024-09-12T01:42:25.720925+0000","last_unstale":"2024-09-12T01:42:28.182121+0000","last_undegraded":"2024-09-12T01:42:28.182121+0000","last_fullsized":"2024-09-12T01:42:28.182121+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:30.163635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182347+0000","last_change":"2024-09-12T01:42:25.723819+0000","last_active":"2024-09-12T01:42:28.182347+0000","last_peered":"2024-09-12T01:42:28.182347+0000","last_clean":"2024-09-12T01:42:28.182347+0000","last_became_active":"2024-09-12T01:42:25.722727+0000","last_became_peered":"2024-09-12T01:42:25.722727+0000","last_unstale":"2024-09-12T01:42:28.182347+0000","last_undegraded":"2024-09-12T01:42:28.182347+0000","last_fullsized":"2024-09-12T01:42:28.182347+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:34.622889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728340+0000","last_change":"2024-09-12T01:42:24.728340+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728340+0000","last_undegraded":"2024-09-12T01:42:24.728340+0000","last_fullsized":"2024-09-12T01:42:24.728340+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.728041+0000","last_change":"2024-09-12T01:42:24.728041+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.728041+0000","last_undegraded":"2024-09-12T01:42:24.728041+0000","last_fullsized":"2024-09-12T01:42:24.728041+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.709794+0000","last_change":"2024-09-12T01:42:24.709794+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.709794+0000","last_undegraded":"2024-09-12T01:42:24.709794+0000","last_fullsized":"2024-09-12T01:42:24.709794+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:42:25.701448+0000","last_change":"2024-09-12T01:42:25.701448+0000","last_active":"2024-09-12T01:42:25.701448+0000","last_peered":"2024-09-12T01:42:25.701448+0000","last_clean":"2024-09-12T01:42:25.701448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:25.701448+0000","last_undegraded":"2024-09-12T01:42:25.701448+0000","last_fullsized":"2024-09-12T01:42:25.701448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.705652+0000","last_change":"2024-09-12T01:42:24.705652+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.705652+0000","last_undegraded":"2024-09-12T01:42:24.705652+0000","last_fullsized":"2024-09-12T01:42:24.705652+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181557+0000","last_change":"2024-09-12T01:42:26.725952+0000","last_active":"2024-09-12T01:42:28.181557+0000","last_peered":"2024-09-12T01:42:28.181557+0000","last_clean":"2024-09-12T01:42:28.181557+0000","last_became_active":"2024-09-12T01:42:26.725653+0000","last_became_peered":"2024-09-12T01:42:26.725653+0000","last_unstale":"2024-09-12T01:42:28.181557+0000","last_undegraded":"2024-09-12T01:42:28.181557+0000","last_fullsized":"2024-09-12T01:42:28.181557+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.240746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"creating+peering","last_fresh":"2024-09-12T01:42:24.706051+0000","last_change":"2024-09-12T01:42:24.706051+0000","last_active":"2024-09-12T01:42:24.695950+0000","last_peered":"2024-09-12T01:42:24.695950+0000","last_clean":"2024-09-12T01:42:24.695950+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:42:24.706051+0000","last_undegraded":"2024-09-12T01:42:24.706051+0000","last_fullsized":"2024-09-12T01:42:24.706051+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":315,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-12T01:42:24.708570+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:42:24.708570+0000","last_peered":"2024-09-12T01:42:24.708570+0000","last_clean":"2024-09-12T01:42:24.708570+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:42:24.708570+0000","last_undegraded":"2024-09-12T01:42:24.708570+0000","last_fullsized":"2024-09-12T01:42:24.708570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":1612,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509525,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509523,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509523,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1830912,"data_stored":1110590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509523,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37136,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334704,"statfs":{"total":96636764160,"available":96598736896,"internally_reserved":0,"allocated":1830912,"data_stored":1110590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1236992,"data_stored":520222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574932,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1290240,"data_stored":541274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:42:34.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:42:34.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.307+0000 7fccb68ac640 1 Processor -- start 2024-09-12T01:42:34.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.308+0000 7fccb68ac640 1 -- start start 2024-09-12T01:42:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.308+0000 7fccb68ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccb015e660 0x7fccb00cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.308+0000 7fccb68ac640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fccb00d3310 0x7fccb00d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.308+0000 7fccb68ac640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb015ea40 con 0x7fccb00d1650 2024-09-12T01:42:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.308+0000 7fccb68ac640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fccb00d3870 con 0x7fccb00d3310 2024-09-12T01:42:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.308+0000 7fccb68ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fccb00d3b50 con 0x7fccb015e660 2024-09-12T01:42:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.309+0000 7fccb4e49640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fccb00d1650 0x7fccb006bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51544/0 (socket says 172.21.15.60:51544) 2024-09-12T01:42:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.309+0000 7fccb4e49640 1 -- 172.21.15.60:0/2038604393 learned_addr learned my addr 172.21.15.60:0/2038604393 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.309+0000 7fccaffff640 1 --2- 172.21.15.60:0/2038604393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccb015e660 0x7fccb00cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.309+0000 7fccaf7fe640 1 --2- 172.21.15.60:0/2038604393 >> v2:172.21.15.105:3300/0 conn(0x7fccb00d3310 0x7fccb00d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:34.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.309+0000 7fccaeffd640 1 -- 172.21.15.60:0/2038604393 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318201712 0 0) 0x7fccb015ea40 con 0x7fccb00d1650 2024-09-12T01:42:34.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.309+0000 7fccaeffd640 1 -- 172.21.15.60:0/2038604393 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc98003520 con 0x7fccb00d1650 2024-09-12T01:42:34.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.309+0000 7fccaffff640 1 -- 172.21.15.60:0/2038604393 >> v2:172.21.15.105:3300/0 conn(0x7fccb00d3310 msgr2=0x7fccb00d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:34.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.309+0000 7fccaffff640 1 --2- 172.21.15.60:0/2038604393 >> v2:172.21.15.105:3300/0 conn(0x7fccb00d3310 0x7fccb00d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.309+0000 7fccaeffd640 1 -- 172.21.15.60:0/2038604393 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2098253277 0 0) 0x7fcc98003520 con 0x7fccb00d1650 2024-09-12T01:42:34.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.309+0000 7fccaffff640 1 -- 172.21.15.60:0/2038604393 >> v1:172.21.15.60:6789/0 conn(0x7fccb00d1650 legacy=0x7fccb006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.309+0000 7fccaffff640 1 -- 172.21.15.60:0/2038604393 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb00d3e30 con 0x7fccb015e660 2024-09-12T01:42:34.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.309+0000 7fccaf7fe640 1 --2- 172.21.15.60:0/2038604393 >> v2:172.21.15.105:3300/0 conn(0x7fccb00d3310 0x7fccb00d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:34.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.310+0000 7fccaffff640 1 --2- 172.21.15.60:0/2038604393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccb015e660 0x7fccb00cf730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcca00097a0 tx=0x7fcca002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1489b854694b612 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:34.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.310+0000 7fccaeffd640 1 -- 172.21.15.60:0/2038604393 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0037070 con 0x7fccb015e660 2024-09-12T01:42:34.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.310+0000 7fccaeffd640 1 -- 172.21.15.60:0/2038604393 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca002aba0 con 0x7fccb015e660 2024-09-12T01:42:34.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.310+0000 7fccaeffd640 1 -- 172.21.15.60:0/2038604393 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca80019f0 con 0x7fccb015e660 2024-09-12T01:42:34.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.311+0000 7fccb68ac640 1 -- 172.21.15.60:0/2038604393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccb015e660 msgr2=0x7fccb00cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.311+0000 7fccb68ac640 1 --2- 172.21.15.60:0/2038604393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccb015e660 0x7fccb00cf730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcca00097a0 tx=0x7fcca002a110 comp rx=0 tx=0).stop 2024-09-12T01:42:34.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.311+0000 7fccb68ac640 1 -- 172.21.15.60:0/2038604393 shutdown_connections 2024-09-12T01:42:34.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.311+0000 7fccb68ac640 1 --2- 172.21.15.60:0/2038604393 >> v2:172.21.15.105:3300/0 conn(0x7fccb00d3310 0x7fccb00d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.311+0000 7fccb68ac640 1 --2- 172.21.15.60:0/2038604393 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccb015e660 0x7fccb00cf730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.311+0000 7fccb68ac640 1 -- 172.21.15.60:0/2038604393 >> 172.21.15.60:0/2038604393 conn(0x7fccb00b6410 msgr2=0x7fccb00b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:34.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.311+0000 7fccb68ac640 1 -- 172.21.15.60:0/2038604393 shutdown_connections 2024-09-12T01:42:34.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.311+0000 7fccb68ac640 1 -- 172.21.15.60:0/2038604393 wait complete. 2024-09-12T01:42:34.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.312+0000 7fccb68ac640 1 Processor -- start 2024-09-12T01:42:34.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.312+0000 7fccb68ac640 1 -- start start 2024-09-12T01:42:34.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccb68ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccb00d1650 0x7fccb0151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:34.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccb68ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccb00d3310 0x7fccb00c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:34.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccb68ac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb015e660 0x7fccb0143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:34.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccb68ac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fccb00cfc70 con 0x7fccb00d1650 2024-09-12T01:42:34.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccb68ac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fccb00d43f0 con 0x7fccb015e660 2024-09-12T01:42:34.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccb68ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fccb00b8b80 con 0x7fccb00d3310 2024-09-12T01:42:34.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccaffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccb00d1650 0x7fccb0151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:34.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccaffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccb00d1650 0x7fccb0151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56022/0 (socket says 172.21.15.60:56022) 2024-09-12T01:42:34.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccaffff640 1 -- 172.21.15.60:0/4009127149 learned_addr learned my addr 172.21.15.60:0/4009127149 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:34.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccaf7fe640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccb00d3310 0x7fccb00c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:34.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccb4e49640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb015e660 0x7fccb0143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:34.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccaffff640 1 -- 172.21.15.60:0/4009127149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccb00d3310 msgr2=0x7fccb00c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccaffff640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccb00d3310 0x7fccb00c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccaffff640 1 -- 172.21.15.60:0/4009127149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb015e660 msgr2=0x7fccb0143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccaffff640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb015e660 0x7fccb0143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.313+0000 7fccaffff640 1 -- 172.21.15.60:0/4009127149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb015ed60 con 0x7fccb00d1650 2024-09-12T01:42:34.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.314+0000 7fccaffff640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccb00d1650 0x7fccb0151e30 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fcca0000c00 tx=0x7fcca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:34.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.314+0000 7fccacff9640 1 -- 172.21.15.60:0/4009127149 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca0037050 con 0x7fccb00d1650 2024-09-12T01:42:34.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.314+0000 7fccacff9640 1 -- 172.21.15.60:0/4009127149 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca0043070 con 0x7fccb00d1650 2024-09-12T01:42:34.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.314+0000 7fccacff9640 1 -- 172.21.15.60:0/4009127149 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca003ca70 con 0x7fccb00d1650 2024-09-12T01:42:34.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.314+0000 7fccb68ac640 1 -- 172.21.15.60:0/4009127149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccb00ca720 con 0x7fccb00d1650 2024-09-12T01:42:34.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.314+0000 7fccb68ac640 1 -- 172.21.15.60:0/4009127149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccb00cace0 con 0x7fccb00d1650 2024-09-12T01:42:34.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.315+0000 7fccb68ac640 1 -- 172.21.15.60:0/4009127149 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccb00d1110 con 0x7fccb00d1650 2024-09-12T01:42:34.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.315+0000 7fccacff9640 1 -- 172.21.15.60:0/4009127149 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcca003cc10 con 0x7fccb00d1650 2024-09-12T01:42:34.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.316+0000 7fccacff9640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcc9c06be30 0x7fcc9c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:34.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.316+0000 7fccacff9640 1 -- 172.21.15.60:0/4009127149 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fcca00ab870 con 0x7fccb00d1650 2024-09-12T01:42:34.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.316+0000 7fccaf7fe640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcc9c06be30 0x7fcc9c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:34.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.316+0000 7fccaf7fe640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcc9c06be30 0x7fcc9c06e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009560 tx=0x7fcca4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:34.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.320+0000 7fccacff9640 1 -- 172.21.15.60:0/4009127149 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcca0079b50 con 0x7fccb00d1650 2024-09-12T01:42:34.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.495+0000 7fccb68ac640 1 -- 172.21.15.60:0/4009127149 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fccb00cf9a0 con 0x7fcc9c06be30 2024-09-12T01:42:34.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.501+0000 7fccacff9640 1 -- 172.21.15.60:0/4009127149 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252467 (secure 0 0 0) 0x7fccb00cf9a0 con 0x7fcc9c06be30 2024-09-12T01:42:34.509 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:34.511 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:42:34.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.504+0000 7fccb68ac640 1 -- 172.21.15.60:0/4009127149 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcc9c06be30 msgr2=0x7fcc9c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.504+0000 7fccb68ac640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcc9c06be30 0x7fcc9c06e2f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fcca4009560 tx=0x7fcca4009190 comp rx=0 tx=0).stop 2024-09-12T01:42:34.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.504+0000 7fccb68ac640 1 -- 172.21.15.60:0/4009127149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccb00d1650 msgr2=0x7fccb0151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.504+0000 7fccb68ac640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccb00d1650 0x7fccb0151e30 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fcca0000c00 tx=0x7fcca00046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.504+0000 7fccb68ac640 1 -- 172.21.15.60:0/4009127149 shutdown_connections 2024-09-12T01:42:34.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.504+0000 7fccb68ac640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fccb015e660 0x7fccb0143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.504+0000 7fccb68ac640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcc9c06be30 0x7fcc9c06e2f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.504+0000 7fccb68ac640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fccb00d3310 0x7fccb00c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.504+0000 7fccb68ac640 1 --2- 172.21.15.60:0/4009127149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccb00d1650 0x7fccb0151e30 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.504+0000 7fccb68ac640 1 -- 172.21.15.60:0/4009127149 >> 172.21.15.60:0/4009127149 conn(0x7fccb00b6410 msgr2=0x7fccb00b8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:34.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.505+0000 7fccb68ac640 1 -- 172.21.15.60:0/4009127149 shutdown_connections 2024-09-12T01:42:34.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.505+0000 7fccb68ac640 1 -- 172.21.15.60:0/4009127149 wait complete. 2024-09-12T01:42:34.516 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2024-09-12T01:42:34.350534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":277340,"kb_used_data":11176,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754697380,"statfs":{"total":773094113280,"available":772810117120,"internally_reserved":0,"allocated":11444224,"data_stored":5502132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001941"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181164+0000","last_change":"2024-09-12T01:42:26.732670+0000","last_active":"2024-09-12T01:42:28.181164+0000","last_peered":"2024-09-12T01:42:28.181164+0000","last_clean":"2024-09-12T01:42:28.181164+0000","last_became_active":"2024-09-12T01:42:26.732378+0000","last_became_peered":"2024-09-12T01:42:26.732378+0000","last_unstale":"2024-09-12T01:42:28.181164+0000","last_undegraded":"2024-09-12T01:42:28.181164+0000","last_fullsized":"2024-09-12T01:42:28.181164+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:47.681223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718384+0000","last_change":"2024-09-12T01:42:26.734302+0000","last_active":"2024-09-12T01:42:27.718384+0000","last_peered":"2024-09-12T01:42:27.718384+0000","last_clean":"2024-09-12T01:42:27.718384+0000","last_became_active":"2024-09-12T01:42:26.733729+0000","last_became_peered":"2024-09-12T01:42:26.733729+0000","last_unstale":"2024-09-12T01:42:27.718384+0000","last_undegraded":"2024-09-12T01:42:27.718384+0000","last_fullsized":"2024-09-12T01:42:27.718384+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:12.944681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.719120+0000","last_change":"2024-09-12T01:42:26.737328+0000","last_active":"2024-09-12T01:42:27.719120+0000","last_peered":"2024-09-12T01:42:27.719120+0000","last_clean":"2024-09-12T01:42:27.719120+0000","last_became_active":"2024-09-12T01:42:26.737004+0000","last_became_peered":"2024-09-12T01:42:26.737004+0000","last_unstale":"2024-09-12T01:42:27.719120+0000","last_undegraded":"2024-09-12T01:42:27.719120+0000","last_fullsized":"2024-09-12T01:42:27.719120+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:37.077506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182233+0000","last_change":"2024-09-12T01:42:26.726792+0000","last_active":"2024-09-12T01:42:28.182233+0000","last_peered":"2024-09-12T01:42:28.182233+0000","last_clean":"2024-09-12T01:42:28.182233+0000","last_became_active":"2024-09-12T01:42:26.726516+0000","last_became_peered":"2024-09-12T01:42:26.726516+0000","last_unstale":"2024-09-12T01:42:28.182233+0000","last_undegraded":"2024-09-12T01:42:28.182233+0000","last_fullsized":"2024-09-12T01:42:28.182233+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:55.227834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181261+0000","last_change":"2024-09-12T01:42:26.755875+0000","last_active":"2024-09-12T01:42:28.181261+0000","last_peered":"2024-09-12T01:42:28.181261+0000","last_clean":"2024-09-12T01:42:28.181261+0000","last_became_active":"2024-09-12T01:42:26.755491+0000","last_became_peered":"2024-09-12T01:42:26.755491+0000","last_unstale":"2024-09-12T01:42:28.181261+0000","last_undegraded":"2024-09-12T01:42:28.181261+0000","last_fullsized":"2024-09-12T01:42:28.181261+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:41.131140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.721697+0000","last_change":"2024-09-12T01:42:26.733436+0000","last_active":"2024-09-12T01:42:27.721697+0000","last_peered":"2024-09-12T01:42:27.721697+0000","last_clean":"2024-09-12T01:42:27.721697+0000","last_became_active":"2024-09-12T01:42:26.733137+0000","last_became_peered":"2024-09-12T01:42:26.733137+0000","last_unstale":"2024-09-12T01:42:27.721697+0000","last_undegraded":"2024-09-12T01:42:27.721697+0000","last_fullsized":"2024-09-12T01:42:27.721697+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:06.569623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731447+0000","last_change":"2024-09-12T01:42:26.736428+0000","last_active":"2024-09-12T01:42:27.731447+0000","last_peered":"2024-09-12T01:42:27.731447+0000","last_clean":"2024-09-12T01:42:27.731447+0000","last_became_active":"2024-09-12T01:42:26.736149+0000","last_became_peered":"2024-09-12T01:42:26.736149+0000","last_unstale":"2024-09-12T01:42:27.731447+0000","last_undegraded":"2024-09-12T01:42:27.731447+0000","last_fullsized":"2024-09-12T01:42:27.731447+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:14.589424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731466+0000","last_change":"2024-09-12T01:42:26.722802+0000","last_active":"2024-09-12T01:42:27.731466+0000","last_peered":"2024-09-12T01:42:27.731466+0000","last_clean":"2024-09-12T01:42:27.731466+0000","last_became_active":"2024-09-12T01:42:26.722453+0000","last_became_peered":"2024-09-12T01:42:26.722453+0000","last_unstale":"2024-09-12T01:42:27.731466+0000","last_undegraded":"2024-09-12T01:42:27.731466+0000","last_fullsized":"2024-09-12T01:42:27.731466+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:00.084468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181372+0000","last_change":"2024-09-12T01:42:26.734956+0000","last_active":"2024-09-12T01:42:28.181372+0000","last_peered":"2024-09-12T01:42:28.181372+0000","last_clean":"2024-09-12T01:42:28.181372+0000","last_became_active":"2024-09-12T01:42:26.734420+0000","last_became_peered":"2024-09-12T01:42:26.734420+0000","last_unstale":"2024-09-12T01:42:28.181372+0000","last_undegraded":"2024-09-12T01:42:28.181372+0000","last_fullsized":"2024-09-12T01:42:28.181372+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:00.559528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180749+0000","last_change":"2024-09-12T01:42:26.754972+0000","last_active":"2024-09-12T01:42:28.180749+0000","last_peered":"2024-09-12T01:42:28.180749+0000","last_clean":"2024-09-12T01:42:28.180749+0000","last_became_active":"2024-09-12T01:42:26.753468+0000","last_became_peered":"2024-09-12T01:42:26.753468+0000","last_unstale":"2024-09-12T01:42:28.180749+0000","last_undegraded":"2024-09-12T01:42:28.180749+0000","last_fullsized":"2024-09-12T01:42:28.180749+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:03.667081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731785+0000","last_change":"2024-09-12T01:42:26.739057+0000","last_active":"2024-09-12T01:42:27.731785+0000","last_peered":"2024-09-12T01:42:27.731785+0000","last_clean":"2024-09-12T01:42:27.731785+0000","last_became_active":"2024-09-12T01:42:26.738756+0000","last_became_peered":"2024-09-12T01:42:26.738756+0000","last_unstale":"2024-09-12T01:42:27.731785+0000","last_undegraded":"2024-09-12T01:42:27.731785+0000","last_fullsized":"2024-09-12T01:42:27.731785+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:55.660984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180943+0000","last_change":"2024-09-12T01:42:26.755897+0000","last_active":"2024-09-12T01:42:28.180943+0000","last_peered":"2024-09-12T01:42:28.180943+0000","last_clean":"2024-09-12T01:42:28.180943+0000","last_became_active":"2024-09-12T01:42:26.755599+0000","last_became_peered":"2024-09-12T01:42:26.755599+0000","last_unstale":"2024-09-12T01:42:28.180943+0000","last_undegraded":"2024-09-12T01:42:28.180943+0000","last_fullsized":"2024-09-12T01:42:28.180943+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:50.568483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718560+0000","last_change":"2024-09-12T01:42:26.751183+0000","last_active":"2024-09-12T01:42:27.718560+0000","last_peered":"2024-09-12T01:42:27.718560+0000","last_clean":"2024-09-12T01:42:27.718560+0000","last_became_active":"2024-09-12T01:42:26.750842+0000","last_became_peered":"2024-09-12T01:42:26.750842+0000","last_unstale":"2024-09-12T01:42:27.718560+0000","last_undegraded":"2024-09-12T01:42:27.718560+0000","last_fullsized":"2024-09-12T01:42:27.718560+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:15.575333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.179719+0000","last_change":"2024-09-12T01:42:26.734548+0000","last_active":"2024-09-12T01:42:28.179719+0000","last_peered":"2024-09-12T01:42:28.179719+0000","last_clean":"2024-09-12T01:42:28.179719+0000","last_became_active":"2024-09-12T01:42:26.734249+0000","last_became_peered":"2024-09-12T01:42:26.734249+0000","last_unstale":"2024-09-12T01:42:28.179719+0000","last_undegraded":"2024-09-12T01:42:28.179719+0000","last_fullsized":"2024-09-12T01:42:28.179719+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:42.810277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181664+0000","last_change":"2024-09-12T01:42:26.757349+0000","last_active":"2024-09-12T01:42:28.181664+0000","last_peered":"2024-09-12T01:42:28.181664+0000","last_clean":"2024-09-12T01:42:28.181664+0000","last_became_active":"2024-09-12T01:42:26.756909+0000","last_became_peered":"2024-09-12T01:42:26.756909+0000","last_unstale":"2024-09-12T01:42:28.181664+0000","last_undegraded":"2024-09-12T01:42:28.181664+0000","last_fullsized":"2024-09-12T01:42:28.181664+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:06.569623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180333+0000","last_change":"2024-09-12T01:42:26.753599+0000","last_active":"2024-09-12T01:42:28.180333+0000","last_peered":"2024-09-12T01:42:28.180333+0000","last_clean":"2024-09-12T01:42:28.180333+0000","last_became_active":"2024-09-12T01:42:26.753281+0000","last_became_peered":"2024-09-12T01:42:26.753281+0000","last_unstale":"2024-09-12T01:42:28.180333+0000","last_undegraded":"2024-09-12T01:42:28.180333+0000","last_fullsized":"2024-09-12T01:42:28.180333+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:39.068447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718978+0000","last_change":"2024-09-12T01:42:26.733243+0000","last_active":"2024-09-12T01:42:27.718978+0000","last_peered":"2024-09-12T01:42:27.718978+0000","last_clean":"2024-09-12T01:42:27.718978+0000","last_became_active":"2024-09-12T01:42:26.732693+0000","last_became_peered":"2024-09-12T01:42:26.732693+0000","last_unstale":"2024-09-12T01:42:27.718978+0000","last_undegraded":"2024-09-12T01:42:27.718978+0000","last_fullsized":"2024-09-12T01:42:27.718978+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:25.179272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731720+0000","last_change":"2024-09-12T01:42:26.731093+0000","last_active":"2024-09-12T01:42:27.731720+0000","last_peered":"2024-09-12T01:42:27.731720+0000","last_clean":"2024-09-12T01:42:27.731720+0000","last_became_active":"2024-09-12T01:42:26.730804+0000","last_became_peered":"2024-09-12T01:42:26.730804+0000","last_unstale":"2024-09-12T01:42:27.731720+0000","last_undegraded":"2024-09-12T01:42:27.731720+0000","last_fullsized":"2024-09-12T01:42:27.731720+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:04.975985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.719264+0000","last_change":"2024-09-12T01:42:26.755974+0000","last_active":"2024-09-12T01:42:27.719264+0000","last_peered":"2024-09-12T01:42:27.719264+0000","last_clean":"2024-09-12T01:42:27.719264+0000","last_became_active":"2024-09-12T01:42:26.755699+0000","last_became_peered":"2024-09-12T01:42:26.755699+0000","last_unstale":"2024-09-12T01:42:27.719264+0000","last_undegraded":"2024-09-12T01:42:27.719264+0000","last_fullsized":"2024-09-12T01:42:27.719264+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:15.023326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718845+0000","last_change":"2024-09-12T01:42:26.733686+0000","last_active":"2024-09-12T01:42:27.718845+0000","last_peered":"2024-09-12T01:42:27.718845+0000","last_clean":"2024-09-12T01:42:27.718845+0000","last_became_active":"2024-09-12T01:42:26.733398+0000","last_became_peered":"2024-09-12T01:42:26.733398+0000","last_unstale":"2024-09-12T01:42:27.718845+0000","last_undegraded":"2024-09-12T01:42:27.718845+0000","last_fullsized":"2024-09-12T01:42:27.718845+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:41.131140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731739+0000","last_change":"2024-09-12T01:42:26.732796+0000","last_active":"2024-09-12T01:42:27.731739+0000","last_peered":"2024-09-12T01:42:27.731739+0000","last_clean":"2024-09-12T01:42:27.731739+0000","last_became_active":"2024-09-12T01:42:26.732452+0000","last_became_peered":"2024-09-12T01:42:26.732452+0000","last_unstale":"2024-09-12T01:42:27.731739+0000","last_undegraded":"2024-09-12T01:42:27.731739+0000","last_fullsized":"2024-09-12T01:42:27.731739+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:34.920969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.721723+0000","last_change":"2024-09-12T01:42:26.723059+0000","last_active":"2024-09-12T01:42:27.721723+0000","last_peered":"2024-09-12T01:42:27.721723+0000","last_clean":"2024-09-12T01:42:27.721723+0000","last_became_active":"2024-09-12T01:42:26.722740+0000","last_became_peered":"2024-09-12T01:42:26.722740+0000","last_unstale":"2024-09-12T01:42:27.721723+0000","last_undegraded":"2024-09-12T01:42:27.721723+0000","last_fullsized":"2024-09-12T01:42:27.721723+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:34.461289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180037+0000","last_change":"2024-09-12T01:42:26.741174+0000","last_active":"2024-09-12T01:42:28.180037+0000","last_peered":"2024-09-12T01:42:28.180037+0000","last_clean":"2024-09-12T01:42:28.180037+0000","last_became_active":"2024-09-12T01:42:26.740879+0000","last_became_peered":"2024-09-12T01:42:26.740879+0000","last_unstale":"2024-09-12T01:42:28.180037+0000","last_undegraded":"2024-09-12T01:42:28.180037+0000","last_fullsized":"2024-09-12T01:42:28.180037+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:09.715590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181212+0000","last_change":"2024-09-12T01:42:26.728745+0000","last_active":"2024-09-12T01:42:28.181212+0000","last_peered":"2024-09-12T01:42:28.181212+0000","last_clean":"2024-09-12T01:42:28.181212+0000","last_became_active":"2024-09-12T01:42:26.728451+0000","last_became_peered":"2024-09-12T01:42:26.728451+0000","last_unstale":"2024-09-12T01:42:28.181212+0000","last_undegraded":"2024-09-12T01:42:28.181212+0000","last_fullsized":"2024-09-12T01:42:28.181212+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:04.705312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731842+0000","last_change":"2024-09-12T01:42:26.729256+0000","last_active":"2024-09-12T01:42:27.731842+0000","last_peered":"2024-09-12T01:42:27.731842+0000","last_clean":"2024-09-12T01:42:27.731842+0000","last_became_active":"2024-09-12T01:42:26.728921+0000","last_became_peered":"2024-09-12T01:42:26.728921+0000","last_unstale":"2024-09-12T01:42:27.731842+0000","last_undegraded":"2024-09-12T01:42:27.731842+0000","last_fullsized":"2024-09-12T01:42:27.731842+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:56.426141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.721831+0000","last_change":"2024-09-12T01:42:26.733990+0000","last_active":"2024-09-12T01:42:27.721831+0000","last_peered":"2024-09-12T01:42:27.721831+0000","last_clean":"2024-09-12T01:42:27.721831+0000","last_became_active":"2024-09-12T01:42:26.733343+0000","last_became_peered":"2024-09-12T01:42:26.733343+0000","last_unstale":"2024-09-12T01:42:27.721831+0000","last_undegraded":"2024-09-12T01:42:27.721831+0000","last_fullsized":"2024-09-12T01:42:27.721831+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:25.978536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182141+0000","last_change":"2024-09-12T01:42:26.734336+0000","last_active":"2024-09-12T01:42:28.182141+0000","last_peered":"2024-09-12T01:42:28.182141+0000","last_clean":"2024-09-12T01:42:28.182141+0000","last_became_active":"2024-09-12T01:42:26.733755+0000","last_became_peered":"2024-09-12T01:42:26.733755+0000","last_unstale":"2024-09-12T01:42:28.182141+0000","last_undegraded":"2024-09-12T01:42:28.182141+0000","last_fullsized":"2024-09-12T01:42:28.182141+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:34.570169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.721704+0000","last_change":"2024-09-12T01:42:26.733520+0000","last_active":"2024-09-12T01:42:27.721704+0000","last_peered":"2024-09-12T01:42:27.721704+0000","last_clean":"2024-09-12T01:42:27.721704+0000","last_became_active":"2024-09-12T01:42:26.733208+0000","last_became_peered":"2024-09-12T01:42:26.733208+0000","last_unstale":"2024-09-12T01:42:27.721704+0000","last_undegraded":"2024-09-12T01:42:27.721704+0000","last_fullsized":"2024-09-12T01:42:27.721704+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:23.286674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.179867+0000","last_change":"2024-09-12T01:42:26.733766+0000","last_active":"2024-09-12T01:42:28.179867+0000","last_peered":"2024-09-12T01:42:28.179867+0000","last_clean":"2024-09-12T01:42:28.179867+0000","last_became_active":"2024-09-12T01:42:26.733479+0000","last_became_peered":"2024-09-12T01:42:26.733479+0000","last_unstale":"2024-09-12T01:42:28.179867+0000","last_undegraded":"2024-09-12T01:42:28.179867+0000","last_fullsized":"2024-09-12T01:42:28.179867+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:31.463983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731642+0000","last_change":"2024-09-12T01:42:26.732431+0000","last_active":"2024-09-12T01:42:27.731642+0000","last_peered":"2024-09-12T01:42:27.731642+0000","last_clean":"2024-09-12T01:42:27.731642+0000","last_became_active":"2024-09-12T01:42:26.732126+0000","last_became_peered":"2024-09-12T01:42:26.732126+0000","last_unstale":"2024-09-12T01:42:27.731642+0000","last_undegraded":"2024-09-12T01:42:27.731642+0000","last_fullsized":"2024-09-12T01:42:27.731642+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:45.409051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181524+0000","last_change":"2024-09-12T01:42:26.741434+0000","last_active":"2024-09-12T01:42:28.181524+0000","last_peered":"2024-09-12T01:42:28.181524+0000","last_clean":"2024-09-12T01:42:28.181524+0000","last_became_active":"2024-09-12T01:42:26.741020+0000","last_became_peered":"2024-09-12T01:42:26.741020+0000","last_unstale":"2024-09-12T01:42:28.181524+0000","last_undegraded":"2024-09-12T01:42:28.181524+0000","last_fullsized":"2024-09-12T01:42:28.181524+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:00.037372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181010+0000","last_change":"2024-09-12T01:42:26.754809+0000","last_active":"2024-09-12T01:42:28.181010+0000","last_peered":"2024-09-12T01:42:28.181010+0000","last_clean":"2024-09-12T01:42:28.181010+0000","last_became_active":"2024-09-12T01:42:26.754486+0000","last_became_peered":"2024-09-12T01:42:26.754486+0000","last_unstale":"2024-09-12T01:42:28.181010+0000","last_undegraded":"2024-09-12T01:42:28.181010+0000","last_fullsized":"2024-09-12T01:42:28.181010+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:18.409999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181427+0000","last_change":"2024-09-12T01:42:26.734355+0000","last_active":"2024-09-12T01:42:28.181427+0000","last_peered":"2024-09-12T01:42:28.181427+0000","last_clean":"2024-09-12T01:42:28.181427+0000","last_became_active":"2024-09-12T01:42:26.734090+0000","last_became_peered":"2024-09-12T01:42:26.734090+0000","last_unstale":"2024-09-12T01:42:28.181427+0000","last_undegraded":"2024-09-12T01:42:28.181427+0000","last_fullsized":"2024-09-12T01:42:28.181427+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:40.389793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"102'4","reported_seq":18,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.179934+0000","last_change":"2024-09-12T01:42:25.724551+0000","last_active":"2024-09-12T01:42:28.179934+0000","last_peered":"2024-09-12T01:42:28.179934+0000","last_clean":"2024-09-12T01:42:28.179934+0000","last_became_active":"2024-09-12T01:42:25.723901+0000","last_became_peered":"2024-09-12T01:42:25.723901+0000","last_unstale":"2024-09-12T01:42:28.179934+0000","last_undegraded":"2024-09-12T01:42:28.179934+0000","last_fullsized":"2024-09-12T01:42:28.179934+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:42.713266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180008+0000","last_change":"2024-09-12T01:42:26.741280+0000","last_active":"2024-09-12T01:42:28.180008+0000","last_peered":"2024-09-12T01:42:28.180008+0000","last_clean":"2024-09-12T01:42:28.180008+0000","last_became_active":"2024-09-12T01:42:26.740964+0000","last_became_peered":"2024-09-12T01:42:26.740964+0000","last_unstale":"2024-09-12T01:42:28.180008+0000","last_undegraded":"2024-09-12T01:42:28.180008+0000","last_fullsized":"2024-09-12T01:42:28.180008+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:07.964972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718441+0000","last_change":"2024-09-12T01:42:25.721496+0000","last_active":"2024-09-12T01:42:27.718441+0000","last_peered":"2024-09-12T01:42:27.718441+0000","last_clean":"2024-09-12T01:42:27.718441+0000","last_became_active":"2024-09-12T01:42:25.721178+0000","last_became_peered":"2024-09-12T01:42:25.721178+0000","last_unstale":"2024-09-12T01:42:27.718441+0000","last_undegraded":"2024-09-12T01:42:27.718441+0000","last_fullsized":"2024-09-12T01:42:27.718441+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:27.791800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.721919+0000","last_change":"2024-09-12T01:42:26.734730+0000","last_active":"2024-09-12T01:42:27.721919+0000","last_peered":"2024-09-12T01:42:27.721919+0000","last_clean":"2024-09-12T01:42:27.721919+0000","last_became_active":"2024-09-12T01:42:26.734026+0000","last_became_peered":"2024-09-12T01:42:26.734026+0000","last_unstale":"2024-09-12T01:42:27.721919+0000","last_undegraded":"2024-09-12T01:42:27.721919+0000","last_fullsized":"2024-09-12T01:42:27.721919+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:29.816822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181937+0000","last_change":"2024-09-12T01:42:25.715979+0000","last_active":"2024-09-12T01:42:28.181937+0000","last_peered":"2024-09-12T01:42:28.181937+0000","last_clean":"2024-09-12T01:42:28.181937+0000","last_became_active":"2024-09-12T01:42:25.715725+0000","last_became_peered":"2024-09-12T01:42:25.715725+0000","last_unstale":"2024-09-12T01:42:28.181937+0000","last_undegraded":"2024-09-12T01:42:28.181937+0000","last_fullsized":"2024-09-12T01:42:28.181937+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:52.607467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.719121+0000","last_change":"2024-09-12T01:42:26.756295+0000","last_active":"2024-09-12T01:42:27.719121+0000","last_peered":"2024-09-12T01:42:27.719121+0000","last_clean":"2024-09-12T01:42:27.719121+0000","last_became_active":"2024-09-12T01:42:26.756010+0000","last_became_peered":"2024-09-12T01:42:26.756010+0000","last_unstale":"2024-09-12T01:42:27.719121+0000","last_undegraded":"2024-09-12T01:42:27.719121+0000","last_fullsized":"2024-09-12T01:42:27.719121+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:43.718764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182252+0000","last_change":"2024-09-12T01:42:25.721279+0000","last_active":"2024-09-12T01:42:28.182252+0000","last_peered":"2024-09-12T01:42:28.182252+0000","last_clean":"2024-09-12T01:42:28.182252+0000","last_became_active":"2024-09-12T01:42:25.719878+0000","last_became_peered":"2024-09-12T01:42:25.719878+0000","last_unstale":"2024-09-12T01:42:28.182252+0000","last_undegraded":"2024-09-12T01:42:28.182252+0000","last_fullsized":"2024-09-12T01:42:28.182252+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:58.320261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182145+0000","last_change":"2024-09-12T01:42:26.730702+0000","last_active":"2024-09-12T01:42:28.182145+0000","last_peered":"2024-09-12T01:42:28.182145+0000","last_clean":"2024-09-12T01:42:28.182145+0000","last_became_active":"2024-09-12T01:42:26.730362+0000","last_became_peered":"2024-09-12T01:42:26.730362+0000","last_unstale":"2024-09-12T01:42:28.182145+0000","last_undegraded":"2024-09-12T01:42:28.182145+0000","last_fullsized":"2024-09-12T01:42:28.182145+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:16.269991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718781+0000","last_change":"2024-09-12T01:42:25.725142+0000","last_active":"2024-09-12T01:42:27.718781+0000","last_peered":"2024-09-12T01:42:27.718781+0000","last_clean":"2024-09-12T01:42:27.718781+0000","last_became_active":"2024-09-12T01:42:25.724844+0000","last_became_peered":"2024-09-12T01:42:25.724844+0000","last_unstale":"2024-09-12T01:42:27.718781+0000","last_undegraded":"2024-09-12T01:42:27.718781+0000","last_fullsized":"2024-09-12T01:42:27.718781+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:23.141435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731653+0000","last_change":"2024-09-12T01:42:26.752150+0000","last_active":"2024-09-12T01:42:27.731653+0000","last_peered":"2024-09-12T01:42:27.731653+0000","last_clean":"2024-09-12T01:42:27.731653+0000","last_became_active":"2024-09-12T01:42:26.751798+0000","last_became_peered":"2024-09-12T01:42:26.751798+0000","last_unstale":"2024-09-12T01:42:27.731653+0000","last_undegraded":"2024-09-12T01:42:27.731653+0000","last_fullsized":"2024-09-12T01:42:27.731653+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:25.036100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180663+0000","last_change":"2024-09-12T01:42:25.724331+0000","last_active":"2024-09-12T01:42:28.180663+0000","last_peered":"2024-09-12T01:42:28.180663+0000","last_clean":"2024-09-12T01:42:28.180663+0000","last_became_active":"2024-09-12T01:42:25.724077+0000","last_became_peered":"2024-09-12T01:42:25.724077+0000","last_unstale":"2024-09-12T01:42:28.180663+0000","last_undegraded":"2024-09-12T01:42:28.180663+0000","last_fullsized":"2024-09-12T01:42:28.180663+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:27.116930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180508+0000","last_change":"2024-09-12T01:42:26.756144+0000","last_active":"2024-09-12T01:42:28.180508+0000","last_peered":"2024-09-12T01:42:28.180508+0000","last_clean":"2024-09-12T01:42:28.180508+0000","last_became_active":"2024-09-12T01:42:26.755704+0000","last_became_peered":"2024-09-12T01:42:26.755704+0000","last_unstale":"2024-09-12T01:42:28.180508+0000","last_undegraded":"2024-09-12T01:42:28.180508+0000","last_fullsized":"2024-09-12T01:42:28.180508+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:53.428971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731512+0000","last_change":"2024-09-12T01:42:25.719490+0000","last_active":"2024-09-12T01:42:27.731512+0000","last_peered":"2024-09-12T01:42:27.731512+0000","last_clean":"2024-09-12T01:42:27.731512+0000","last_became_active":"2024-09-12T01:42:25.719145+0000","last_became_peered":"2024-09-12T01:42:25.719145+0000","last_unstale":"2024-09-12T01:42:27.731512+0000","last_undegraded":"2024-09-12T01:42:27.731512+0000","last_fullsized":"2024-09-12T01:42:27.731512+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:22.610819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731470+0000","last_change":"2024-09-12T01:42:26.727938+0000","last_active":"2024-09-12T01:42:27.731470+0000","last_peered":"2024-09-12T01:42:27.731470+0000","last_clean":"2024-09-12T01:42:27.731470+0000","last_became_active":"2024-09-12T01:42:26.727626+0000","last_became_peered":"2024-09-12T01:42:26.727626+0000","last_unstale":"2024-09-12T01:42:27.731470+0000","last_undegraded":"2024-09-12T01:42:27.731470+0000","last_fullsized":"2024-09-12T01:42:27.731470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:20.920747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180560+0000","last_change":"2024-09-12T01:42:25.724746+0000","last_active":"2024-09-12T01:42:28.180560+0000","last_peered":"2024-09-12T01:42:28.180560+0000","last_clean":"2024-09-12T01:42:28.180560+0000","last_became_active":"2024-09-12T01:42:25.724497+0000","last_became_peered":"2024-09-12T01:42:25.724497+0000","last_unstale":"2024-09-12T01:42:28.180560+0000","last_undegraded":"2024-09-12T01:42:28.180560+0000","last_fullsized":"2024-09-12T01:42:28.180560+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:35.109913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718561+0000","last_change":"2024-09-12T01:42:26.736556+0000","last_active":"2024-09-12T01:42:27.718561+0000","last_peered":"2024-09-12T01:42:27.718561+0000","last_clean":"2024-09-12T01:42:27.718561+0000","last_became_active":"2024-09-12T01:42:26.736156+0000","last_became_peered":"2024-09-12T01:42:26.736156+0000","last_unstale":"2024-09-12T01:42:27.718561+0000","last_undegraded":"2024-09-12T01:42:27.718561+0000","last_fullsized":"2024-09-12T01:42:27.718561+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:31.463983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182027+0000","last_change":"2024-09-12T01:42:25.719553+0000","last_active":"2024-09-12T01:42:28.182027+0000","last_peered":"2024-09-12T01:42:28.182027+0000","last_clean":"2024-09-12T01:42:28.182027+0000","last_became_active":"2024-09-12T01:42:25.719276+0000","last_became_peered":"2024-09-12T01:42:25.719276+0000","last_unstale":"2024-09-12T01:42:28.182027+0000","last_undegraded":"2024-09-12T01:42:28.182027+0000","last_fullsized":"2024-09-12T01:42:28.182027+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:39.970202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718547+0000","last_change":"2024-09-12T01:42:26.751187+0000","last_active":"2024-09-12T01:42:27.718547+0000","last_peered":"2024-09-12T01:42:27.718547+0000","last_clean":"2024-09-12T01:42:27.718547+0000","last_became_active":"2024-09-12T01:42:26.750850+0000","last_became_peered":"2024-09-12T01:42:26.750850+0000","last_unstale":"2024-09-12T01:42:27.718547+0000","last_undegraded":"2024-09-12T01:42:27.718547+0000","last_fullsized":"2024-09-12T01:42:27.718547+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:42.810277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180633+0000","last_change":"2024-09-12T01:42:25.719410+0000","last_active":"2024-09-12T01:42:28.180633+0000","last_peered":"2024-09-12T01:42:28.180633+0000","last_clean":"2024-09-12T01:42:28.180633+0000","last_became_active":"2024-09-12T01:42:25.719146+0000","last_became_peered":"2024-09-12T01:42:25.719146+0000","last_unstale":"2024-09-12T01:42:28.180633+0000","last_undegraded":"2024-09-12T01:42:28.180633+0000","last_fullsized":"2024-09-12T01:42:28.180633+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:30.546797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.721885+0000","last_change":"2024-09-12T01:42:26.736705+0000","last_active":"2024-09-12T01:42:27.721885+0000","last_peered":"2024-09-12T01:42:27.721885+0000","last_clean":"2024-09-12T01:42:27.721885+0000","last_became_active":"2024-09-12T01:42:26.736446+0000","last_became_peered":"2024-09-12T01:42:26.736446+0000","last_unstale":"2024-09-12T01:42:27.721885+0000","last_undegraded":"2024-09-12T01:42:27.721885+0000","last_fullsized":"2024-09-12T01:42:27.721885+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:56.521096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"102'3","reported_seq":17,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180959+0000","last_change":"2024-09-12T01:42:25.716051+0000","last_active":"2024-09-12T01:42:28.180959+0000","last_peered":"2024-09-12T01:42:28.180959+0000","last_clean":"2024-09-12T01:42:28.180959+0000","last_became_active":"2024-09-12T01:42:25.715759+0000","last_became_peered":"2024-09-12T01:42:25.715759+0000","last_unstale":"2024-09-12T01:42:28.180959+0000","last_undegraded":"2024-09-12T01:42:28.180959+0000","last_fullsized":"2024-09-12T01:42:28.180959+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:28.691280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731727+0000","last_change":"2024-09-12T01:42:26.730437+0000","last_active":"2024-09-12T01:42:27.731727+0000","last_peered":"2024-09-12T01:42:27.731727+0000","last_clean":"2024-09-12T01:42:27.731727+0000","last_became_active":"2024-09-12T01:42:26.730014+0000","last_became_peered":"2024-09-12T01:42:26.730014+0000","last_unstale":"2024-09-12T01:42:27.731727+0000","last_undegraded":"2024-09-12T01:42:27.731727+0000","last_fullsized":"2024-09-12T01:42:27.731727+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:19.324528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"102'6","reported_seq":20,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182349+0000","last_change":"2024-09-12T01:42:25.719478+0000","last_active":"2024-09-12T01:42:28.182349+0000","last_peered":"2024-09-12T01:42:28.182349+0000","last_clean":"2024-09-12T01:42:28.182349+0000","last_became_active":"2024-09-12T01:42:25.719189+0000","last_became_peered":"2024-09-12T01:42:25.719189+0000","last_unstale":"2024-09-12T01:42:28.182349+0000","last_undegraded":"2024-09-12T01:42:28.182349+0000","last_fullsized":"2024-09-12T01:42:28.182349+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:30.453725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180936+0000","last_change":"2024-09-12T01:42:26.753638+0000","last_active":"2024-09-12T01:42:28.180936+0000","last_peered":"2024-09-12T01:42:28.180936+0000","last_clean":"2024-09-12T01:42:28.180936+0000","last_became_active":"2024-09-12T01:42:26.753283+0000","last_became_peered":"2024-09-12T01:42:26.753283+0000","last_unstale":"2024-09-12T01:42:28.180936+0000","last_undegraded":"2024-09-12T01:42:28.180936+0000","last_fullsized":"2024-09-12T01:42:28.180936+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:13.341998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181317+0000","last_change":"2024-09-12T01:42:25.721158+0000","last_active":"2024-09-12T01:42:28.181317+0000","last_peered":"2024-09-12T01:42:28.181317+0000","last_clean":"2024-09-12T01:42:28.181317+0000","last_became_active":"2024-09-12T01:42:25.720887+0000","last_became_peered":"2024-09-12T01:42:25.720887+0000","last_unstale":"2024-09-12T01:42:28.181317+0000","last_undegraded":"2024-09-12T01:42:28.181317+0000","last_fullsized":"2024-09-12T01:42:28.181317+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:52.691114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182075+0000","last_change":"2024-09-12T01:42:26.735572+0000","last_active":"2024-09-12T01:42:28.182075+0000","last_peered":"2024-09-12T01:42:28.182075+0000","last_clean":"2024-09-12T01:42:28.182075+0000","last_became_active":"2024-09-12T01:42:26.733518+0000","last_became_peered":"2024-09-12T01:42:26.733518+0000","last_unstale":"2024-09-12T01:42:28.182075+0000","last_undegraded":"2024-09-12T01:42:28.182075+0000","last_fullsized":"2024-09-12T01:42:28.182075+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:52.012838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718823+0000","last_change":"2024-09-12T01:42:25.721403+0000","last_active":"2024-09-12T01:42:27.718823+0000","last_peered":"2024-09-12T01:42:27.718823+0000","last_clean":"2024-09-12T01:42:27.718823+0000","last_became_active":"2024-09-12T01:42:25.721091+0000","last_became_peered":"2024-09-12T01:42:25.721091+0000","last_unstale":"2024-09-12T01:42:27.718823+0000","last_undegraded":"2024-09-12T01:42:27.718823+0000","last_fullsized":"2024-09-12T01:42:27.718823+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:49.580578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181903+0000","last_change":"2024-09-12T01:42:26.729928+0000","last_active":"2024-09-12T01:42:28.181903+0000","last_peered":"2024-09-12T01:42:28.181903+0000","last_clean":"2024-09-12T01:42:28.181903+0000","last_became_active":"2024-09-12T01:42:26.729652+0000","last_became_peered":"2024-09-12T01:42:26.729652+0000","last_unstale":"2024-09-12T01:42:28.181903+0000","last_undegraded":"2024-09-12T01:42:28.181903+0000","last_fullsized":"2024-09-12T01:42:28.181903+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:01.625910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"102'8","reported_seq":22,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180411+0000","last_change":"2024-09-12T01:42:25.720507+0000","last_active":"2024-09-12T01:42:28.180411+0000","last_peered":"2024-09-12T01:42:28.180411+0000","last_clean":"2024-09-12T01:42:28.180411+0000","last_became_active":"2024-09-12T01:42:25.720118+0000","last_became_peered":"2024-09-12T01:42:25.720118+0000","last_unstale":"2024-09-12T01:42:28.180411+0000","last_undegraded":"2024-09-12T01:42:28.180411+0000","last_fullsized":"2024-09-12T01:42:28.180411+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:33.305730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181588+0000","last_change":"2024-09-12T01:42:26.731666+0000","last_active":"2024-09-12T01:42:28.181588+0000","last_peered":"2024-09-12T01:42:28.181588+0000","last_clean":"2024-09-12T01:42:28.181588+0000","last_became_active":"2024-09-12T01:42:26.731411+0000","last_became_peered":"2024-09-12T01:42:26.731411+0000","last_unstale":"2024-09-12T01:42:28.181588+0000","last_undegraded":"2024-09-12T01:42:28.181588+0000","last_fullsized":"2024-09-12T01:42:28.181588+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.407089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.721754+0000","last_change":"2024-09-12T01:42:25.722925+0000","last_active":"2024-09-12T01:42:27.721754+0000","last_peered":"2024-09-12T01:42:27.721754+0000","last_clean":"2024-09-12T01:42:27.721754+0000","last_became_active":"2024-09-12T01:42:25.722653+0000","last_became_peered":"2024-09-12T01:42:25.722653+0000","last_unstale":"2024-09-12T01:42:27.721754+0000","last_undegraded":"2024-09-12T01:42:27.721754+0000","last_fullsized":"2024-09-12T01:42:27.721754+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:06.959474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181491+0000","last_change":"2024-09-12T01:42:26.734696+0000","last_active":"2024-09-12T01:42:28.181491+0000","last_peered":"2024-09-12T01:42:28.181491+0000","last_clean":"2024-09-12T01:42:28.181491+0000","last_became_active":"2024-09-12T01:42:26.734051+0000","last_became_peered":"2024-09-12T01:42:26.734051+0000","last_unstale":"2024-09-12T01:42:28.181491+0000","last_undegraded":"2024-09-12T01:42:28.181491+0000","last_fullsized":"2024-09-12T01:42:28.181491+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:55.193585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180815+0000","last_change":"2024-09-12T01:42:25.723495+0000","last_active":"2024-09-12T01:42:28.180815+0000","last_peered":"2024-09-12T01:42:28.180815+0000","last_clean":"2024-09-12T01:42:28.180815+0000","last_became_active":"2024-09-12T01:42:25.723206+0000","last_became_peered":"2024-09-12T01:42:25.723206+0000","last_unstale":"2024-09-12T01:42:28.180815+0000","last_undegraded":"2024-09-12T01:42:28.180815+0000","last_fullsized":"2024-09-12T01:42:28.180815+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:24.021101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731765+0000","last_change":"2024-09-12T01:42:26.730031+0000","last_active":"2024-09-12T01:42:27.731765+0000","last_peered":"2024-09-12T01:42:27.731765+0000","last_clean":"2024-09-12T01:42:27.731765+0000","last_became_active":"2024-09-12T01:42:26.729730+0000","last_became_peered":"2024-09-12T01:42:26.729730+0000","last_unstale":"2024-09-12T01:42:27.731765+0000","last_undegraded":"2024-09-12T01:42:27.731765+0000","last_fullsized":"2024-09-12T01:42:27.731765+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:18.477283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"102'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.179965+0000","last_change":"2024-09-12T01:42:25.723739+0000","last_active":"2024-09-12T01:42:28.179965+0000","last_peered":"2024-09-12T01:42:28.179965+0000","last_clean":"2024-09-12T01:42:28.179965+0000","last_became_active":"2024-09-12T01:42:25.723448+0000","last_became_peered":"2024-09-12T01:42:25.723448+0000","last_unstale":"2024-09-12T01:42:28.179965+0000","last_undegraded":"2024-09-12T01:42:28.179965+0000","last_fullsized":"2024-09-12T01:42:28.179965+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:24.173774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.179925+0000","last_change":"2024-09-12T01:42:26.735446+0000","last_active":"2024-09-12T01:42:28.179925+0000","last_peered":"2024-09-12T01:42:28.179925+0000","last_clean":"2024-09-12T01:42:28.179925+0000","last_became_active":"2024-09-12T01:42:26.735171+0000","last_became_peered":"2024-09-12T01:42:26.735171+0000","last_unstale":"2024-09-12T01:42:28.179925+0000","last_undegraded":"2024-09-12T01:42:28.179925+0000","last_fullsized":"2024-09-12T01:42:28.179925+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:41.255741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.179726+0000","last_change":"2024-09-12T01:42:25.726162+0000","last_active":"2024-09-12T01:42:28.179726+0000","last_peered":"2024-09-12T01:42:28.179726+0000","last_clean":"2024-09-12T01:42:28.179726+0000","last_became_active":"2024-09-12T01:42:25.725866+0000","last_became_peered":"2024-09-12T01:42:25.725866+0000","last_unstale":"2024-09-12T01:42:28.179726+0000","last_undegraded":"2024-09-12T01:42:28.179726+0000","last_fullsized":"2024-09-12T01:42:28.179726+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:13:40.125642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718799+0000","last_change":"2024-09-12T01:42:26.737422+0000","last_active":"2024-09-12T01:42:27.718799+0000","last_peered":"2024-09-12T01:42:27.718799+0000","last_clean":"2024-09-12T01:42:27.718799+0000","last_became_active":"2024-09-12T01:42:26.737096+0000","last_became_peered":"2024-09-12T01:42:26.737096+0000","last_unstale":"2024-09-12T01:42:27.718799+0000","last_undegraded":"2024-09-12T01:42:27.718799+0000","last_fullsized":"2024-09-12T01:42:27.718799+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:18.409999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181419+0000","last_change":"2024-09-12T01:42:25.718191+0000","last_active":"2024-09-12T01:42:28.181419+0000","last_peered":"2024-09-12T01:42:28.181419+0000","last_clean":"2024-09-12T01:42:28.181419+0000","last_became_active":"2024-09-12T01:42:25.717900+0000","last_became_peered":"2024-09-12T01:42:25.717900+0000","last_unstale":"2024-09-12T01:42:28.181419+0000","last_undegraded":"2024-09-12T01:42:28.181419+0000","last_fullsized":"2024-09-12T01:42:28.181419+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:54.557378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181062+0000","last_change":"2024-09-12T01:42:26.736648+0000","last_active":"2024-09-12T01:42:28.181062+0000","last_peered":"2024-09-12T01:42:28.181062+0000","last_clean":"2024-09-12T01:42:28.181062+0000","last_became_active":"2024-09-12T01:42:26.736366+0000","last_became_peered":"2024-09-12T01:42:26.736366+0000","last_unstale":"2024-09-12T01:42:28.181062+0000","last_undegraded":"2024-09-12T01:42:28.181062+0000","last_fullsized":"2024-09-12T01:42:28.181062+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:35.692514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180796+0000","last_change":"2024-09-12T01:42:25.724099+0000","last_active":"2024-09-12T01:42:28.180796+0000","last_peered":"2024-09-12T01:42:28.180796+0000","last_clean":"2024-09-12T01:42:28.180796+0000","last_became_active":"2024-09-12T01:42:25.723792+0000","last_became_peered":"2024-09-12T01:42:25.723792+0000","last_unstale":"2024-09-12T01:42:28.180796+0000","last_undegraded":"2024-09-12T01:42:28.180796+0000","last_fullsized":"2024-09-12T01:42:28.180796+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:36.316293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.179667+0000","last_change":"2024-09-12T01:42:26.739863+0000","last_active":"2024-09-12T01:42:28.179667+0000","last_peered":"2024-09-12T01:42:28.179667+0000","last_clean":"2024-09-12T01:42:28.179667+0000","last_became_active":"2024-09-12T01:42:26.739531+0000","last_became_peered":"2024-09-12T01:42:26.739531+0000","last_unstale":"2024-09-12T01:42:28.179667+0000","last_undegraded":"2024-09-12T01:42:28.179667+0000","last_fullsized":"2024-09-12T01:42:28.179667+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:37.321791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181824+0000","last_change":"2024-09-12T01:42:25.725757+0000","last_active":"2024-09-12T01:42:28.181824+0000","last_peered":"2024-09-12T01:42:28.181824+0000","last_clean":"2024-09-12T01:42:28.181824+0000","last_became_active":"2024-09-12T01:42:25.725336+0000","last_became_peered":"2024-09-12T01:42:25.725336+0000","last_unstale":"2024-09-12T01:42:28.181824+0000","last_undegraded":"2024-09-12T01:42:28.181824+0000","last_fullsized":"2024-09-12T01:42:28.181824+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:42:11.696886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.180408+0000","last_change":"2024-09-12T01:42:26.753652+0000","last_active":"2024-09-12T01:42:28.180408+0000","last_peered":"2024-09-12T01:42:28.180408+0000","last_clean":"2024-09-12T01:42:28.180408+0000","last_became_active":"2024-09-12T01:42:26.753250+0000","last_became_peered":"2024-09-12T01:42:26.753250+0000","last_unstale":"2024-09-12T01:42:28.180408+0000","last_undegraded":"2024-09-12T01:42:28.180408+0000","last_fullsized":"2024-09-12T01:42:28.180408+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:47.126974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182138+0000","last_change":"2024-09-12T01:42:25.721483+0000","last_active":"2024-09-12T01:42:28.182138+0000","last_peered":"2024-09-12T01:42:28.182138+0000","last_clean":"2024-09-12T01:42:28.182138+0000","last_became_active":"2024-09-12T01:42:25.720586+0000","last_became_peered":"2024-09-12T01:42:25.720586+0000","last_unstale":"2024-09-12T01:42:28.182138+0000","last_undegraded":"2024-09-12T01:42:28.182138+0000","last_fullsized":"2024-09-12T01:42:28.182138+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:55.783238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.179925+0000","last_change":"2024-09-12T01:42:26.740361+0000","last_active":"2024-09-12T01:42:28.179925+0000","last_peered":"2024-09-12T01:42:28.179925+0000","last_clean":"2024-09-12T01:42:28.179925+0000","last_became_active":"2024-09-12T01:42:26.740033+0000","last_became_peered":"2024-09-12T01:42:26.740033+0000","last_unstale":"2024-09-12T01:42:28.179925+0000","last_undegraded":"2024-09-12T01:42:28.179925+0000","last_fullsized":"2024-09-12T01:42:28.179925+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:56.348611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"102'2","reported_seq":16,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182047+0000","last_change":"2024-09-12T01:42:25.716698+0000","last_active":"2024-09-12T01:42:28.182047+0000","last_peered":"2024-09-12T01:42:28.182047+0000","last_clean":"2024-09-12T01:42:28.182047+0000","last_became_active":"2024-09-12T01:42:25.716358+0000","last_became_peered":"2024-09-12T01:42:25.716358+0000","last_unstale":"2024-09-12T01:42:28.182047+0000","last_undegraded":"2024-09-12T01:42:28.182047+0000","last_fullsized":"2024-09-12T01:42:28.182047+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:49.687287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.721750+0000","last_change":"2024-09-12T01:42:26.737773+0000","last_active":"2024-09-12T01:42:27.721750+0000","last_peered":"2024-09-12T01:42:27.721750+0000","last_clean":"2024-09-12T01:42:27.721750+0000","last_became_active":"2024-09-12T01:42:26.737487+0000","last_became_peered":"2024-09-12T01:42:26.737487+0000","last_unstale":"2024-09-12T01:42:27.721750+0000","last_undegraded":"2024-09-12T01:42:27.721750+0000","last_fullsized":"2024-09-12T01:42:27.721750+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:49.359250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"103'1","reported_seq":15,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731731+0000","last_change":"2024-09-12T01:42:25.722952+0000","last_active":"2024-09-12T01:42:27.731731+0000","last_peered":"2024-09-12T01:42:27.731731+0000","last_clean":"2024-09-12T01:42:27.731731+0000","last_became_active":"2024-09-12T01:42:25.722673+0000","last_became_peered":"2024-09-12T01:42:25.722673+0000","last_unstale":"2024-09-12T01:42:27.731731+0000","last_undegraded":"2024-09-12T01:42:27.731731+0000","last_fullsized":"2024-09-12T01:42:27.731731+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:15.959051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181292+0000","last_change":"2024-09-12T01:42:26.758488+0000","last_active":"2024-09-12T01:42:28.181292+0000","last_peered":"2024-09-12T01:42:28.181292+0000","last_clean":"2024-09-12T01:42:28.181292+0000","last_became_active":"2024-09-12T01:42:26.758227+0000","last_became_peered":"2024-09-12T01:42:26.758227+0000","last_unstale":"2024-09-12T01:42:28.181292+0000","last_undegraded":"2024-09-12T01:42:28.181292+0000","last_fullsized":"2024-09-12T01:42:28.181292+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:39.763894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182121+0000","last_change":"2024-09-12T01:42:25.721216+0000","last_active":"2024-09-12T01:42:28.182121+0000","last_peered":"2024-09-12T01:42:28.182121+0000","last_clean":"2024-09-12T01:42:28.182121+0000","last_became_active":"2024-09-12T01:42:25.720925+0000","last_became_peered":"2024-09-12T01:42:25.720925+0000","last_unstale":"2024-09-12T01:42:28.182121+0000","last_undegraded":"2024-09-12T01:42:28.182121+0000","last_fullsized":"2024-09-12T01:42:28.182121+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:30.163635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.179913+0000","last_change":"2024-09-12T01:42:26.737786+0000","last_active":"2024-09-12T01:42:28.179913+0000","last_peered":"2024-09-12T01:42:28.179913+0000","last_clean":"2024-09-12T01:42:28.179913+0000","last_became_active":"2024-09-12T01:42:26.737518+0000","last_became_peered":"2024-09-12T01:42:26.737518+0000","last_unstale":"2024-09-12T01:42:28.179913+0000","last_undegraded":"2024-09-12T01:42:28.179913+0000","last_fullsized":"2024-09-12T01:42:28.179913+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:15.575333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.182347+0000","last_change":"2024-09-12T01:42:25.723819+0000","last_active":"2024-09-12T01:42:28.182347+0000","last_peered":"2024-09-12T01:42:28.182347+0000","last_clean":"2024-09-12T01:42:28.182347+0000","last_became_active":"2024-09-12T01:42:25.722727+0000","last_became_peered":"2024-09-12T01:42:25.722727+0000","last_unstale":"2024-09-12T01:42:28.182347+0000","last_undegraded":"2024-09-12T01:42:28.182347+0000","last_fullsized":"2024-09-12T01:42:28.182347+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:34.622889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718774+0000","last_change":"2024-09-12T01:42:26.734474+0000","last_active":"2024-09-12T01:42:27.718774+0000","last_peered":"2024-09-12T01:42:27.718774+0000","last_clean":"2024-09-12T01:42:27.718774+0000","last_became_active":"2024-09-12T01:42:26.733244+0000","last_became_peered":"2024-09-12T01:42:26.733244+0000","last_unstale":"2024-09-12T01:42:27.718774+0000","last_undegraded":"2024-09-12T01:42:27.718774+0000","last_fullsized":"2024-09-12T01:42:27.718774+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:50.568483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.731793+0000","last_change":"2024-09-12T01:42:25.720394+0000","last_active":"2024-09-12T01:42:27.731793+0000","last_peered":"2024-09-12T01:42:27.731793+0000","last_clean":"2024-09-12T01:42:27.731793+0000","last_became_active":"2024-09-12T01:42:25.720117+0000","last_became_peered":"2024-09-12T01:42:25.720117+0000","last_unstale":"2024-09-12T01:42:27.731793+0000","last_undegraded":"2024-09-12T01:42:27.731793+0000","last_fullsized":"2024-09-12T01:42:27.731793+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:20.310755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.179943+0000","last_change":"2024-09-12T01:42:26.758246+0000","last_active":"2024-09-12T01:42:28.179943+0000","last_peered":"2024-09-12T01:42:28.179943+0000","last_clean":"2024-09-12T01:42:28.179943+0000","last_became_active":"2024-09-12T01:42:26.757944+0000","last_became_peered":"2024-09-12T01:42:26.757944+0000","last_unstale":"2024-09-12T01:42:28.179943+0000","last_undegraded":"2024-09-12T01:42:28.179943+0000","last_fullsized":"2024-09-12T01:42:28.179943+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:30.697859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.179616+0000","last_change":"2024-09-12T01:42:25.726416+0000","last_active":"2024-09-12T01:42:28.179616+0000","last_peered":"2024-09-12T01:42:28.179616+0000","last_clean":"2024-09-12T01:42:28.179616+0000","last_became_active":"2024-09-12T01:42:25.726062+0000","last_became_peered":"2024-09-12T01:42:25.726062+0000","last_unstale":"2024-09-12T01:42:28.179616+0000","last_undegraded":"2024-09-12T01:42:28.179616+0000","last_fullsized":"2024-09-12T01:42:28.179616+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:17.404501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.179720+0000","last_change":"2024-09-12T01:42:26.740586+0000","last_active":"2024-09-12T01:42:28.179720+0000","last_peered":"2024-09-12T01:42:28.179720+0000","last_clean":"2024-09-12T01:42:28.179720+0000","last_became_active":"2024-09-12T01:42:26.740110+0000","last_became_peered":"2024-09-12T01:42:26.740110+0000","last_unstale":"2024-09-12T01:42:28.179720+0000","last_undegraded":"2024-09-12T01:42:28.179720+0000","last_fullsized":"2024-09-12T01:42:28.179720+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:12.944681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181580+0000","last_change":"2024-09-12T01:42:25.724700+0000","last_active":"2024-09-12T01:42:28.181580+0000","last_peered":"2024-09-12T01:42:28.181580+0000","last_clean":"2024-09-12T01:42:28.181580+0000","last_became_active":"2024-09-12T01:42:25.724402+0000","last_became_peered":"2024-09-12T01:42:25.724402+0000","last_unstale":"2024-09-12T01:42:28.181580+0000","last_undegraded":"2024-09-12T01:42:28.181580+0000","last_fullsized":"2024-09-12T01:42:28.181580+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:11.939183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.721483+0000","last_change":"2024-09-12T01:42:26.729398+0000","last_active":"2024-09-12T01:42:27.721483+0000","last_peered":"2024-09-12T01:42:27.721483+0000","last_clean":"2024-09-12T01:42:27.721483+0000","last_became_active":"2024-09-12T01:42:26.729127+0000","last_became_peered":"2024-09-12T01:42:26.729127+0000","last_unstale":"2024-09-12T01:42:27.721483+0000","last_undegraded":"2024-09-12T01:42:27.721483+0000","last_fullsized":"2024-09-12T01:42:27.721483+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:58.407089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.721358+0000","last_change":"2024-09-12T01:42:25.721143+0000","last_active":"2024-09-12T01:42:27.721358+0000","last_peered":"2024-09-12T01:42:27.721358+0000","last_clean":"2024-09-12T01:42:27.721358+0000","last_became_active":"2024-09-12T01:42:25.720840+0000","last_became_peered":"2024-09-12T01:42:25.720840+0000","last_unstale":"2024-09-12T01:42:27.721358+0000","last_undegraded":"2024-09-12T01:42:27.721358+0000","last_fullsized":"2024-09-12T01:42:27.721358+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:29.692361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":12,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:28.181557+0000","last_change":"2024-09-12T01:42:26.725952+0000","last_active":"2024-09-12T01:42:28.181557+0000","last_peered":"2024-09-12T01:42:28.181557+0000","last_clean":"2024-09-12T01:42:28.181557+0000","last_became_active":"2024-09-12T01:42:26.725653+0000","last_became_peered":"2024-09-12T01:42:26.725653+0000","last_unstale":"2024-09-12T01:42:28.181557+0000","last_undegraded":"2024-09-12T01:42:28.181557+0000","last_fullsized":"2024-09-12T01:42:28.181557+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:25.701448+0000","last_clean_scrub_stamp":"2024-09-12T01:42:25.701448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.240746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":14,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718065+0000","last_change":"2024-09-12T01:42:25.713815+0000","last_active":"2024-09-12T01:42:27.718065+0000","last_peered":"2024-09-12T01:42:27.718065+0000","last_clean":"2024-09-12T01:42:27.718065+0000","last_became_active":"2024-09-12T01:42:25.713491+0000","last_became_peered":"2024-09-12T01:42:25.713491+0000","last_unstale":"2024-09-12T01:42:27.718065+0000","last_undegraded":"2024-09-12T01:42:27.718065+0000","last_fullsized":"2024-09-12T01:42:27.718065+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:42:24.695950+0000","last_clean_scrub_stamp":"2024-09-12T01:42:24.695950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:29.310400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":321,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T01:42:27.718621+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:42:27.718621+0000","last_peered":"2024-09-12T01:42:27.718621+0000","last_clean":"2024-09-12T01:42:27.718621+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:42:27.718621+0000","last_undegraded":"2024-09-12T01:42:27.718621+0000","last_fullsized":"2024-09-12T01:42:27.718621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509526,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32456,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339384,"statfs":{"total":96636764160,"available":96603529216,"internally_reserved":0,"allocated":1294336,"data_stored":541308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509524,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1273856,"data_stored":539572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509524,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1875968,"data_stored":1130032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509524,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36596,"kb_used_data":1244,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335244,"statfs":{"total":96636764160,"available":96599289856,"internally_reserved":0,"allocated":1273856,"data_stored":539572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509524,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36604,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335236,"statfs":{"total":96636764160,"available":96599281664,"internally_reserved":0,"allocated":1286144,"data_stored":540210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509524,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37172,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334668,"statfs":{"total":96636764160,"available":96598700032,"internally_reserved":0,"allocated":1867776,"data_stored":1129940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509525,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36604,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335236,"statfs":{"total":96636764160,"available":96599281664,"internally_reserved":0,"allocated":1282048,"data_stored":540224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1290240,"data_stored":541274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:42:34.523 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:42:34.524 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:42:34.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.667+0000 7f66e3198640 1 Processor -- start 2024-09-12T01:42:34.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.667+0000 7f66e3198640 1 -- start start 2024-09-12T01:42:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.668+0000 7f66e3198640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66dc0b68f0 0x7f66dc1696f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.668+0000 7f66e3198640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66dc0cf860 con 0x7f66dc0cf1f0 2024-09-12T01:42:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.668+0000 7f66e3198640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66dc0cfb40 con 0x7f66dc15e7a0 2024-09-12T01:42:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.668+0000 7f66e3198640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f66dc0d2ca0 con 0x7f66dc0b68f0 2024-09-12T01:42:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.668+0000 7f66dbfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f66dc0cf1f0 0x7f66dc0b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51552/0 (socket says 172.21.15.60:51552) 2024-09-12T01:42:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.668+0000 7f66dbfff640 1 -- 172.21.15.60:0/1673867403 learned_addr learned my addr 172.21.15.60:0/1673867403 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.669+0000 7f66e1735640 1 --2- 172.21.15.60:0/1673867403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66dc0b68f0 0x7f66dc1696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.669+0000 7f66db7fe640 1 -- 172.21.15.60:0/1673867403 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1866886614 0 0) 0x7f66dc0cf860 con 0x7f66dc0cf1f0 2024-09-12T01:42:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.669+0000 7f66db7fe640 1 -- 172.21.15.60:0/1673867403 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66c4003520 con 0x7f66dc0cf1f0 2024-09-12T01:42:34.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.669+0000 7f66db7fe640 1 -- 172.21.15.60:0/1673867403 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766972599 0 0) 0x7f66dc0cfb40 con 0x7f66dc15e7a0 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.669+0000 7f66db7fe640 1 -- 172.21.15.60:0/1673867403 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66dc0cf860 con 0x7f66dc15e7a0 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.669+0000 7f66e1735640 1 -- 172.21.15.60:0/1673867403 >> v1:172.21.15.105:6789/0 conn(0x7f66dc15e7a0 legacy=0x7f66dc06caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.669+0000 7f66e1735640 1 -- 172.21.15.60:0/1673867403 >> v1:172.21.15.60:6789/0 conn(0x7f66dc0cf1f0 legacy=0x7f66dc0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.669+0000 7f66e1735640 1 -- 172.21.15.60:0/1673867403 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc0cfe20 con 0x7f66dc0b68f0 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.670+0000 7f66e1735640 1 --2- 172.21.15.60:0/1673867403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66dc0b68f0 0x7f66dc1696f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009dc0 tx=0x7f66d402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c93da1feb5dd967 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.670+0000 7f66db7fe640 1 -- 172.21.15.60:0/1673867403 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d402ae60 con 0x7f66dc0b68f0 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.670+0000 7f66db7fe640 1 -- 172.21.15.60:0/1673867403 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d4007740 con 0x7f66dc0b68f0 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.670+0000 7f66db7fe640 1 -- 172.21.15.60:0/1673867403 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4007af0 con 0x7f66dc0b68f0 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.670+0000 7f66e3198640 1 -- 172.21.15.60:0/1673867403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66dc0b68f0 msgr2=0x7f66dc1696f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.670+0000 7f66e3198640 1 --2- 172.21.15.60:0/1673867403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66dc0b68f0 0x7f66dc1696f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009dc0 tx=0x7f66d402a640 comp rx=0 tx=0).stop 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.670+0000 7f66e3198640 1 -- 172.21.15.60:0/1673867403 shutdown_connections 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.670+0000 7f66e3198640 1 --2- 172.21.15.60:0/1673867403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66dc0b68f0 0x7f66dc1696f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.670+0000 7f66e3198640 1 -- 172.21.15.60:0/1673867403 >> 172.21.15.60:0/1673867403 conn(0x7f66dc0d11e0 msgr2=0x7f66dc0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:34.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.671+0000 7f66e3198640 1 -- 172.21.15.60:0/1673867403 shutdown_connections 2024-09-12T01:42:34.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.671+0000 7f66e3198640 1 -- 172.21.15.60:0/1673867403 wait complete. 2024-09-12T01:42:34.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.672+0000 7f66e3198640 1 Processor -- start 2024-09-12T01:42:34.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.672+0000 7f66e3198640 1 -- start start 2024-09-12T01:42:34.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e3198640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66dc0b68f0 0x7f66dc1ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:34.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e3198640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66dc0cf1f0 0x7f66dc0ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:34.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e3198640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66dc15e7a0 0x7f66dc0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:34.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e3198640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc0d4420 con 0x7f66dc15e7a0 2024-09-12T01:42:34.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e3198640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66dc0b7a00 con 0x7f66dc0cf1f0 2024-09-12T01:42:34.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e3198640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f66dc0c8f10 con 0x7f66dc0b68f0 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e1735640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66dc15e7a0 0x7f66dc0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e1735640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66dc15e7a0 0x7f66dc0ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56026/0 (socket says 172.21.15.60:56026) 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e1735640 1 -- 172.21.15.60:0/2289950458 learned_addr learned my addr 172.21.15.60:0/2289950458 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66dbfff640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66dc0cf1f0 0x7f66dc0ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e0f34640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66dc0b68f0 0x7f66dc1ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e1735640 1 -- 172.21.15.60:0/2289950458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66dc0b68f0 msgr2=0x7f66dc1ea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e1735640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66dc0b68f0 0x7f66dc1ea4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e1735640 1 -- 172.21.15.60:0/2289950458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66dc0cf1f0 msgr2=0x7f66dc0ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e1735640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66dc0cf1f0 0x7f66dc0ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e1735640 1 -- 172.21.15.60:0/2289950458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66dc0c91f0 con 0x7f66dc15e7a0 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.673+0000 7f66e1735640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66dc15e7a0 0x7f66dc0ce9b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009eb0 tx=0x7f66d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.674+0000 7f66d97fa640 1 -- 172.21.15.60:0/2289950458 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4040070 con 0x7f66dc15e7a0 2024-09-12T01:42:34.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.674+0000 7f66d97fa640 1 -- 172.21.15.60:0/2289950458 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d4031a70 con 0x7f66dc15e7a0 2024-09-12T01:42:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.674+0000 7f66e3198640 1 -- 172.21.15.60:0/2289950458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66dc0c94d0 con 0x7f66dc15e7a0 2024-09-12T01:42:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.674+0000 7f66d97fa640 1 -- 172.21.15.60:0/2289950458 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d4009450 con 0x7f66dc15e7a0 2024-09-12T01:42:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.674+0000 7f66e3198640 1 -- 172.21.15.60:0/2289950458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66dc1eaa30 con 0x7f66dc15e7a0 2024-09-12T01:42:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.675+0000 7f66e3198640 1 -- 172.21.15.60:0/2289950458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66dc15eb80 con 0x7f66dc15e7a0 2024-09-12T01:42:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.675+0000 7f66d97fa640 1 -- 172.21.15.60:0/2289950458 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66d4039040 con 0x7f66dc15e7a0 2024-09-12T01:42:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.676+0000 7f66d97fa640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66c806be30 0x7f66c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.676+0000 7f66e0f34640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66c806be30 0x7f66c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.676+0000 7f66d97fa640 1 -- 172.21.15.60:0/2289950458 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f66d40ac2b0 con 0x7f66dc15e7a0 2024-09-12T01:42:34.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.676+0000 7f66e0f34640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66c806be30 0x7f66c806e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f66cc007fd0 tx=0x7f66cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:34.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.680+0000 7f66d97fa640 1 -- 172.21.15.60:0/2289950458 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66d407a610 con 0x7f66dc15e7a0 2024-09-12T01:42:34.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.925+0000 7f66e3198640 1 -- 172.21.15.60:0/2289950458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f66dc0d2a80 con 0x7f66dc15e7a0 2024-09-12T01:42:34.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.927+0000 7f66d97fa640 1 -- 172.21.15.60:0/2289950458 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f66d407e910 con 0x7f66dc15e7a0 2024-09-12T01:42:34.927 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-12T01:42:34.927 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ== 2024-09-12T01:42:34.927 INFO:teuthology.orchestra.run.smithi060.stdout: caps mds = "allow" 2024-09-12T01:42:34.927 INFO:teuthology.orchestra.run.smithi060.stdout: caps mon = "allow r" 2024-09-12T01:42:34.927 INFO:teuthology.orchestra.run.smithi060.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:42:34.927 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2024-09-12T01:42:34.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.930+0000 7f66e3198640 1 -- 172.21.15.60:0/2289950458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66c806be30 msgr2=0x7f66c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.930+0000 7f66e3198640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66c806be30 0x7f66c806e2f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f66cc007fd0 tx=0x7f66cc009040 comp rx=0 tx=0).stop 2024-09-12T01:42:34.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.930+0000 7f66e3198640 1 -- 172.21.15.60:0/2289950458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66dc15e7a0 msgr2=0x7f66dc0ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:34.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.930+0000 7f66e3198640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66dc15e7a0 0x7f66dc0ce9b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f66d4009eb0 tx=0x7f66d4004a40 comp rx=0 tx=0).stop 2024-09-12T01:42:34.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.930+0000 7f66e3198640 1 -- 172.21.15.60:0/2289950458 shutdown_connections 2024-09-12T01:42:34.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.930+0000 7f66e3198640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66dc15e7a0 0x7f66dc0ce9b0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.930+0000 7f66e3198640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66dc0cf1f0 0x7f66dc0ce470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.930+0000 7f66e3198640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66c806be30 0x7f66c806e2f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.930+0000 7f66e3198640 1 --2- 172.21.15.60:0/2289950458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66dc0b68f0 0x7f66dc1ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:34.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.930+0000 7f66e3198640 1 -- 172.21.15.60:0/2289950458 >> 172.21.15.60:0/2289950458 conn(0x7f66dc0d11e0 msgr2=0x7f66dc15d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:34.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.930+0000 7f66e3198640 1 -- 172.21.15.60:0/2289950458 shutdown_connections 2024-09-12T01:42:34.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:34.930+0000 7f66e3198640 1 -- 172.21.15.60:0/2289950458 wait complete. 2024-09-12T01:42:34.940 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.043+0000 7ff0a7c65640 1 Processor -- start 2024-09-12T01:42:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.043+0000 7ff0a7c65640 1 -- start start 2024-09-12T01:42:35.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.044+0000 7ff0a7c65640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0a0162f20 0x7ff0a00d0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.044+0000 7ff0a7c65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0a00cd8c0 0x7ff0a0163300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.044+0000 7ff0a7c65640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff0a0163840 0x7ff0a0164730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.044+0000 7ff0a7c65640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a00ce030 con 0x7ff0a0162f20 2024-09-12T01:42:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.044+0000 7ff0a7c65640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff0a00ce310 con 0x7ff0a0163840 2024-09-12T01:42:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.044+0000 7ff0a7c65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a00ce5f0 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.044+0000 7ff0a5a01640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0a0162f20 0x7ff0a00d0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.044+0000 7ff0a5a01640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff0a0162f20 0x7ff0a00d0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56032/0 (socket says 172.21.15.60:56032) 2024-09-12T01:42:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.044+0000 7ff0a5a01640 1 -- 172.21.15.60:0/833476734 learned_addr learned my addr 172.21.15.60:0/833476734 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.045+0000 7ff0a5200640 1 --2- 172.21.15.60:0/833476734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0a00cd8c0 0x7ff0a0163300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.045+0000 7ff0a6202640 1 --2- 172.21.15.60:0/833476734 >> v2:172.21.15.105:3300/0 conn(0x7ff0a0163840 0x7ff0a0164730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.045+0000 7ff0a5a01640 1 -- 172.21.15.60:0/833476734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0a00cd8c0 msgr2=0x7ff0a0163300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.045+0000 7ff0a5a01640 1 --2- 172.21.15.60:0/833476734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0a00cd8c0 0x7ff0a0163300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.045+0000 7ff0a5a01640 1 -- 172.21.15.60:0/833476734 >> v2:172.21.15.105:3300/0 conn(0x7ff0a0163840 msgr2=0x7ff0a0164730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.045+0000 7ff0a5a01640 1 --2- 172.21.15.60:0/833476734 >> v2:172.21.15.105:3300/0 conn(0x7ff0a0163840 0x7ff0a0164730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.045+0000 7ff0a5a01640 1 -- 172.21.15.60:0/833476734 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a0164210 con 0x7ff0a0162f20 2024-09-12T01:42:35.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.045+0000 7ff0a5200640 1 --2- 172.21.15.60:0/833476734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0a00cd8c0 0x7ff0a0163300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.045+0000 7ff0a5a01640 1 --2- 172.21.15.60:0/833476734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0a0162f20 0x7ff0a00d0010 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0160a70 tx=0x7ff09c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f582df85f039fcb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.046+0000 7ff0a49ff640 1 -- 172.21.15.60:0/833476734 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c037070 con 0x7ff0a0162f20 2024-09-12T01:42:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.046+0000 7ff0a49ff640 1 -- 172.21.15.60:0/833476734 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09c032440 con 0x7ff0a0162f20 2024-09-12T01:42:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.046+0000 7ff0a49ff640 1 -- 172.21.15.60:0/833476734 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c032810 con 0x7ff0a0162f20 2024-09-12T01:42:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.046+0000 7ff0a7c65640 1 -- 172.21.15.60:0/833476734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0a0162f20 msgr2=0x7ff0a00d0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.046+0000 7ff0a7c65640 1 --2- 172.21.15.60:0/833476734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0a0162f20 0x7ff0a00d0010 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0160a70 tx=0x7ff09c02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.046+0000 7ff0a7c65640 1 -- 172.21.15.60:0/833476734 shutdown_connections 2024-09-12T01:42:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.046+0000 7ff0a7c65640 1 --2- 172.21.15.60:0/833476734 >> v2:172.21.15.105:3300/0 conn(0x7ff0a0163840 0x7ff0a0164730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.046+0000 7ff0a7c65640 1 --2- 172.21.15.60:0/833476734 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0a00cd8c0 0x7ff0a0163300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.046+0000 7ff0a7c65640 1 --2- 172.21.15.60:0/833476734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0a0162f20 0x7ff0a00d0010 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.046+0000 7ff0a7c65640 1 -- 172.21.15.60:0/833476734 >> 172.21.15.60:0/833476734 conn(0x7ff0a006bc10 msgr2=0x7ff0a006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:35.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.046+0000 7ff0a7c65640 1 -- 172.21.15.60:0/833476734 shutdown_connections 2024-09-12T01:42:35.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.046+0000 7ff0a7c65640 1 -- 172.21.15.60:0/833476734 wait complete. 2024-09-12T01:42:35.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.048+0000 7ff0a7c65640 1 Processor -- start 2024-09-12T01:42:35.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.048+0000 7ff0a7c65640 1 -- start start 2024-09-12T01:42:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.048+0000 7ff0a7c65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0a00cd8c0 0x7ff0a013d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.048+0000 7ff0a7c65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0a0162f20 0x7ff0a01fbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.048+0000 7ff0a7c65640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a0163840 0x7ff0a01fc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.048+0000 7ff0a7c65640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a0163ca0 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.048+0000 7ff0a7c65640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a014c4c0 con 0x7ff0a0163840 2024-09-12T01:42:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.048+0000 7ff0a7c65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff0a0164c70 con 0x7ff0a0162f20 2024-09-12T01:42:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a5a01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0a00cd8c0 0x7ff0a013d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a5a01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0a00cd8c0 0x7ff0a013d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56042/0 (socket says 172.21.15.60:56042) 2024-09-12T01:42:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a5a01640 1 -- 172.21.15.60:0/2050767309 learned_addr learned my addr 172.21.15.60:0/2050767309 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a5200640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0a0162f20 0x7ff0a01fbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a6202640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a0163840 0x7ff0a01fc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a5a01640 1 -- 172.21.15.60:0/2050767309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0a0162f20 msgr2=0x7ff0a01fbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a5a01640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0a0162f20 0x7ff0a01fbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a5a01640 1 -- 172.21.15.60:0/2050767309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a0163840 msgr2=0x7ff0a01fc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a5a01640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a0163840 0x7ff0a01fc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a5a01640 1 -- 172.21.15.60:0/2050767309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a01475e0 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a5a01640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0a00cd8c0 0x7ff0a013d0a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff09c02a220 tx=0x7ff09c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0967fc640 1 -- 172.21.15.60:0/2050767309 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c041020 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0967fc640 1 -- 172.21.15.60:0/2050767309 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff09c0306c0 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0967fc640 1 -- 172.21.15.60:0/2050767309 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09c037040 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a7c65640 1 -- 172.21.15.60:0/2050767309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a0147850 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.049+0000 7ff0a7c65640 1 -- 172.21.15.60:0/2050767309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a013d850 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.050+0000 7ff0a7c65640 1 -- 172.21.15.60:0/2050767309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a013d640 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.051+0000 7ff0967fc640 1 -- 172.21.15.60:0/2050767309 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff09c044020 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.051+0000 7ff0967fc640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff08406be60 0x7ff08406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.051+0000 7ff0967fc640 1 -- 172.21.15.60:0/2050767309 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7ff09c0ab570 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.051+0000 7ff0a5200640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff08406be60 0x7ff08406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.052+0000 7ff0a5200640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff08406be60 0x7ff08406e320 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff0a01fbd60 tx=0x7ff090008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.055+0000 7ff0967fc640 1 -- 172.21.15.60:0/2050767309 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff09c04b030 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.267+0000 7ff0a7c65640 1 -- 172.21.15.60:0/2050767309 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0a0163300 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.268+0000 7ff0967fc640 1 -- 172.21.15.60:0/2050767309 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7ff09c079fb0 con 0x7ff0a00cd8c0 2024-09-12T01:42:35.268 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:35.268 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":61,"btime":"2024-09-12T01:42:28:803118+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3412598725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3412598725},{"type":"v1","addr":"172.21.15.60:6837","nonce":3412598725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2966702196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2966702196},{"type":"v1","addr":"172.21.15.60:6836","nonce":2966702196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7107,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3682228949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3682228949},{"type":"v1","addr":"172.21.15.105:6834","nonce":3682228949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:42:26.063083+0000","modified":"2024-09-12T01:42:28.145414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7110},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7110":{"gid":7110,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3881960029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3881960029},{"type":"v1","addr":"172.21.15.105:6835","nonce":3881960029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7110,"qdb_cluster":[7110]},"id":8}]} 2024-09-12T01:42:35.268 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 61 2024-09-12T01:42:35.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.270+0000 7ff0a7c65640 1 -- 172.21.15.60:0/2050767309 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff08406be60 msgr2=0x7ff08406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.270+0000 7ff0a7c65640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff08406be60 0x7ff08406e320 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff0a01fbd60 tx=0x7ff090008040 comp rx=0 tx=0).stop 2024-09-12T01:42:35.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.270+0000 7ff0a7c65640 1 -- 172.21.15.60:0/2050767309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0a00cd8c0 msgr2=0x7ff0a013d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.270+0000 7ff0a7c65640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0a00cd8c0 0x7ff0a013d0a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff09c02a220 tx=0x7ff09c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.270+0000 7ff0a7c65640 1 -- 172.21.15.60:0/2050767309 shutdown_connections 2024-09-12T01:42:35.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.270+0000 7ff0a7c65640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff0a0163840 0x7ff0a01fc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.270+0000 7ff0a7c65640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff08406be60 0x7ff08406e320 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.270+0000 7ff0a7c65640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0a0162f20 0x7ff0a01fbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.270+0000 7ff0a7c65640 1 --2- 172.21.15.60:0/2050767309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0a00cd8c0 0x7ff0a013d0a0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.270+0000 7ff0a7c65640 1 -- 172.21.15.60:0/2050767309 >> 172.21.15.60:0/2050767309 conn(0x7ff0a006bc10 msgr2=0x7ff0a0072270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:35.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.270+0000 7ff0a7c65640 1 -- 172.21.15.60:0/2050767309 shutdown_connections 2024-09-12T01:42:35.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.271+0000 7ff0a7c65640 1 -- 172.21.15.60:0/2050767309 wait complete. 2024-09-12T01:42:35.684 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:42:26.063083+0000', 'modified': '2024-09-12T01:42:28.145414+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7110}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7110': {'gid': 7110, 'name': 'b', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6835/3881960029', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6833', 'nonce': 3881960029}, {'type': 'v1', 'addr': '172.21.15.105:6835', 'nonce': 3881960029}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7110, 'qdb_cluster': [7110]} 2024-09-12T01:42:35.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:42:35.685 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T01:42:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.795+0000 7fbf1fe65640 1 Processor -- start 2024-09-12T01:42:35.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.796+0000 7fbf1fe65640 1 -- start start 2024-09-12T01:42:35.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1fe65640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbf1815c2a0 0x7fbf180735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1fe65640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf18073b10 0x7fbf1806f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1fe65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1806fc50 0x7fbf1806cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1fe65640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbf1815c680 con 0x7fbf18073b10 2024-09-12T01:42:35.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1fe65640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbf18074120 con 0x7fbf1815c2a0 2024-09-12T01:42:35.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1fe65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1815ef00 con 0x7fbf1806fc50 2024-09-12T01:42:35.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1d400640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf18073b10 0x7fbf1806f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1d400640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf18073b10 0x7fbf1806f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56050/0 (socket says 172.21.15.60:56050) 2024-09-12T01:42:35.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1d400640 1 -- 172.21.15.60:0/543025575 learned_addr learned my addr 172.21.15.60:0/543025575 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/543025575 >> v2:172.21.15.105:3300/0 conn(0x7fbf1815c2a0 0x7fbf180735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1e402640 1 --2- 172.21.15.60:0/543025575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1806fc50 0x7fbf1806cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1d400640 1 -- 172.21.15.60:0/543025575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1806fc50 msgr2=0x7fbf1806cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1d400640 1 --2- 172.21.15.60:0/543025575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1806fc50 0x7fbf1806cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1d400640 1 -- 172.21.15.60:0/543025575 >> v2:172.21.15.105:3300/0 conn(0x7fbf1815c2a0 msgr2=0x7fbf180735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1d400640 1 --2- 172.21.15.60:0/543025575 >> v2:172.21.15.105:3300/0 conn(0x7fbf1815c2a0 0x7fbf180735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.797+0000 7fbf1d400640 1 -- 172.21.15.60:0/543025575 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1815f1e0 con 0x7fbf18073b10 2024-09-12T01:42:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.798+0000 7fbf1d400640 1 --2- 172.21.15.60:0/543025575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf18073b10 0x7fbf1806f710 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fbf180b4030 tx=0x7fbf0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e713001184ac0f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.798+0000 7fbf1cbff640 1 -- 172.21.15.60:0/543025575 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c037070 con 0x7fbf18073b10 2024-09-12T01:42:35.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.798+0000 7fbf1cbff640 1 -- 172.21.15.60:0/543025575 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c032440 con 0x7fbf18073b10 2024-09-12T01:42:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.798+0000 7fbf1cbff640 1 -- 172.21.15.60:0/543025575 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c032810 con 0x7fbf18073b10 2024-09-12T01:42:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.799+0000 7fbf1fe65640 1 -- 172.21.15.60:0/543025575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf18073b10 msgr2=0x7fbf1806f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.799+0000 7fbf1fe65640 1 --2- 172.21.15.60:0/543025575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf18073b10 0x7fbf1806f710 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fbf180b4030 tx=0x7fbf0c02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.799+0000 7fbf1fe65640 1 -- 172.21.15.60:0/543025575 shutdown_connections 2024-09-12T01:42:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.799+0000 7fbf1fe65640 1 --2- 172.21.15.60:0/543025575 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1806fc50 0x7fbf1806cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.799+0000 7fbf1fe65640 1 --2- 172.21.15.60:0/543025575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf18073b10 0x7fbf1806f710 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.799+0000 7fbf1fe65640 1 --2- 172.21.15.60:0/543025575 >> v2:172.21.15.105:3300/0 conn(0x7fbf1815c2a0 0x7fbf180735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.800 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.799+0000 7fbf1fe65640 1 -- 172.21.15.60:0/543025575 >> 172.21.15.60:0/543025575 conn(0x7fbf180b3070 msgr2=0x7fbf180b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:35.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.799+0000 7fbf1fe65640 1 -- 172.21.15.60:0/543025575 shutdown_connections 2024-09-12T01:42:35.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.799+0000 7fbf1fe65640 1 -- 172.21.15.60:0/543025575 wait complete. 2024-09-12T01:42:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.800+0000 7fbf1fe65640 1 Processor -- start 2024-09-12T01:42:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.800+0000 7fbf1fe65640 1 -- start start 2024-09-12T01:42:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.801+0000 7fbf1fe65640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf1806fc50 0x7fbf18152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.801+0000 7fbf1fe65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf18073b10 0x7fbf1815e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.801+0000 7fbf1fe65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1815c2a0 0x7fbf1815d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.801+0000 7fbf1fe65640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbf180b5f20 con 0x7fbf18073b10 2024-09-12T01:42:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.801+0000 7fbf1fe65640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1815ebf0 con 0x7fbf1806fc50 2024-09-12T01:42:35.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.801+0000 7fbf1fe65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbf180b60a0 con 0x7fbf1815c2a0 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.801+0000 7fbf1d400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf18073b10 0x7fbf1815e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.801+0000 7fbf1d400640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf18073b10 0x7fbf1815e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56066/0 (socket says 172.21.15.60:56066) 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.801+0000 7fbf1d400640 1 -- 172.21.15.60:0/3822502795 learned_addr learned my addr 172.21.15.60:0/3822502795 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf1e402640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1815c2a0 0x7fbf1815d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf1806fc50 0x7fbf18152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf1d400640 1 -- 172.21.15.60:0/3822502795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1815c2a0 msgr2=0x7fbf1815d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf1d400640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1815c2a0 0x7fbf1815d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf1d400640 1 -- 172.21.15.60:0/3822502795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf1806fc50 msgr2=0x7fbf18152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf1d400640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf1806fc50 0x7fbf18152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf1d400640 1 -- 172.21.15.60:0/3822502795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1815b3b0 con 0x7fbf18073b10 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf1806fc50 0x7fbf18152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf1d400640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf18073b10 0x7fbf1815e3e0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c02a220 tx=0x7fbf0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf167fc640 1 -- 172.21.15.60:0/3822502795 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c041020 con 0x7fbf18073b10 2024-09-12T01:42:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf167fc640 1 -- 172.21.15.60:0/3822502795 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0306c0 con 0x7fbf18073b10 2024-09-12T01:42:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf1fe65640 1 -- 172.21.15.60:0/3822502795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1815b690 con 0x7fbf18073b10 2024-09-12T01:42:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf167fc640 1 -- 172.21.15.60:0/3822502795 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c037040 con 0x7fbf18073b10 2024-09-12T01:42:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.802+0000 7fbf1fe65640 1 -- 172.21.15.60:0/3822502795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1815cc90 con 0x7fbf18073b10 2024-09-12T01:42:35.805 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.804+0000 7fbf167fc640 1 -- 172.21.15.60:0/3822502795 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbf0c044020 con 0x7fbf18073b10 2024-09-12T01:42:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.804+0000 7fbf167fc640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf0406be30 0x7fbf0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.804+0000 7fbf167fc640 1 -- 172.21.15.60:0/3822502795 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fbf0c0ab590 con 0x7fbf18073b10 2024-09-12T01:42:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.804+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf0406be30 0x7fbf0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.805+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf0406be30 0x7fbf0406e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbf10006fd0 tx=0x7fbf10008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.805+0000 7fbf22c02740 1 Processor -- start 2024-09-12T01:42:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.806+0000 7fbf22c02740 1 -- start start 2024-09-12T01:42:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.806+0000 7fbf22c02740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 0x5590648a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.806+0000 7fbf22c02740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559064859a80 0x55906485c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.806+0000 7fbf22c02740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485da50 0x5590648568b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.806+0000 7fbf22c02740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5590647be520 con 0x55906485c2c0 2024-09-12T01:42:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.806+0000 7fbf22c02740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5590647663e0 con 0x55906485da50 2024-09-12T01:42:35.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.806+0000 7fbf22c02740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5590647ba4e0 con 0x559064859a80 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.806+0000 7fbf1dc01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 0x5590648a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.806+0000 7fbf1dc01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 0x5590648a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56068/0 (socket says 172.21.15.60:56068) 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.806+0000 7fbf1dc01640 1 -- 172.21.15.60:0/3577900289 learned_addr learned my addr 172.21.15.60:0/3577900289 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.807+0000 7fbf1d400640 1 --2- 172.21.15.60:0/3577900289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559064859a80 0x55906485c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.807+0000 7fbf1dc01640 1 -- 172.21.15.60:0/3577900289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559064859a80 msgr2=0x55906485c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.807+0000 7fbf1e402640 1 --2- 172.21.15.60:0/3577900289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485da50 0x5590648568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.807+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/3577900289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559064859a80 0x55906485c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.807+0000 7fbf1dc01640 1 -- 172.21.15.60:0/3577900289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485da50 msgr2=0x5590648568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.807+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/3577900289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485da50 0x5590648568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.807+0000 7fbf1dc01640 1 -- 172.21.15.60:0/3577900289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590647812f0 con 0x55906485c2c0 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.807+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/3577900289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 0x5590648a1a60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000fae0 tx=0x7fbf10012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed4edc3ff38b9fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.807+0000 7fbeff7fe640 1 -- 172.21.15.60:0/3577900289 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1001b050 con 0x55906485c2c0 2024-09-12T01:42:35.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.807+0000 7fbeff7fe640 1 -- 172.21.15.60:0/3577900289 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf10025070 con 0x55906485c2c0 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.807+0000 7fbeff7fe640 1 -- 172.21.15.60:0/3577900289 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10020440 con 0x55906485c2c0 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.808+0000 7fbf22c02740 1 -- 172.21.15.60:0/3577900289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 msgr2=0x5590648a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.808+0000 7fbf22c02740 1 --2- 172.21.15.60:0/3577900289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 0x5590648a1a60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000fae0 tx=0x7fbf10012000 comp rx=0 tx=0).stop 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.808+0000 7fbf22c02740 1 -- 172.21.15.60:0/3577900289 shutdown_connections 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.808+0000 7fbf22c02740 1 --2- 172.21.15.60:0/3577900289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485da50 0x5590648568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.808+0000 7fbf22c02740 1 --2- 172.21.15.60:0/3577900289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x559064859a80 0x55906485c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.808+0000 7fbf22c02740 1 --2- 172.21.15.60:0/3577900289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 0x5590648a1a60 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.808+0000 7fbf22c02740 1 -- 172.21.15.60:0/3577900289 >> 172.21.15.60:0/3577900289 conn(0x559064858a80 msgr2=0x5590648a0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.808+0000 7fbf22c02740 1 -- 172.21.15.60:0/3577900289 shutdown_connections 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.808+0000 7fbf22c02740 1 -- 172.21.15.60:0/3577900289 wait complete. 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.808+0000 7fbf22c02740 1 -- start start 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.808+0000 7fbf22c02740 1 Processor -- start 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.809+0000 7fbf22c02740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485c2c0 0x55906487ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.809+0000 7fbf22c02740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485da50 0x55906487cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.809+0000 7fbf22c02740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 0x559064882730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.809+0000 7fbf22c02740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559064857f20 con 0x5590648822d0 2024-09-12T01:42:35.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.809+0000 7fbf22c02740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x559064747450 con 0x55906485c2c0 2024-09-12T01:42:35.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.809+0000 7fbf22c02740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5590648a2290 con 0x55906485da50 2024-09-12T01:42:35.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.809+0000 7fbf22c02740 10 client.0 _ll_register_callbacks cb 0x5590644d0ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:42:35.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.809+0000 7fbf1e402640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 0x559064882730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.809+0000 7fbf1e402640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 0x559064882730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56070/0 (socket says 172.21.15.60:56070) 2024-09-12T01:42:35.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.809+0000 7fbf1e402640 1 -- 172.21.15.60:0/2400705409 learned_addr learned my addr 172.21.15.60:0/2400705409 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:35.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485c2c0 0x55906487ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbf1d400640 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485da50 0x55906487cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbf1e402640 1 -- 172.21.15.60:0/2400705409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485da50 msgr2=0x55906487cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:35.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbf1e402640 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485da50 0x55906487cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbf1e402640 1 -- 172.21.15.60:0/2400705409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485c2c0 msgr2=0x55906487ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbf1e402640 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485c2c0 0x55906487ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbf1e402640 1 -- 172.21.15.60:0/2400705409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590644d12d0 con 0x5590648822d0 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbf1e402640 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 0x559064882730 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fbf08004320 tx=0x7fbf080047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492aff0c26f22f1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbefcff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbefcff9640 1 -- 172.21.15.60:0/2400705409 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08019020 con 0x5590648822d0 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbefcff9640 1 -- 172.21.15.60:0/2400705409 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fbf08007ac0 con 0x5590648822d0 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbf22c02740 1 -- 172.21.15.60:0/2400705409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf10025070 con 0x5590648822d0 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbefcff9640 1 -- 172.21.15.60:0/2400705409 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fbf08023050 con 0x5590648822d0 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbf22c02740 10 client.7248 fetch_fsmap learned FSMap version 61 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbf22c02740 1 -- 172.21.15.60:0/2400705409 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55906459b6b0 con 0x5590648822d0 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.810+0000 7fbefcff9640 1 -- 172.21.15.60:0/2400705409 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf10025070 con 0x5590648822d0 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.811+0000 7fbefcff9640 1 -- 172.21.15.60:0/2400705409 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 61) ==== 3502+0+0 (secure 0 0 0) 0x7fbf08026020 con 0x5590648822d0 2024-09-12T01:42:35.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.811+0000 7fbf22c02740 10 client.7248 fetch_fsmap finished waiting for FSMap version 61 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.811+0000 7fbf22c02740 10 client.7248 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.811+0000 7fbf22c02740 20 client.7248 populate_metadata read hostname 'smithi060' 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.811+0000 7fbf22c02740 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.105:6833/3881960029,v1:172.21.15.105:6835/3881960029] conn(0x55906487bc50 0x55906487c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.811+0000 7fbf22c02740 4 client.7248 mds_command: new command op to 7110 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.811+0000 7fbf22c02740 1 -- 172.21.15.60:0/2400705409 --> [v2:172.21.15.105:6833/3881960029,v1:172.21.15.105:6835/3881960029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590647cbc50 con 0x55906487bc50 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.811+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.105:6833/3881960029,v1:172.21.15.105:6835/3881960029] conn(0x55906487bc50 0x55906487c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.812+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.105:6833/3881960029,v1:172.21.15.105:6835/3881960029] conn(0x55906487bc50 0x55906487c030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1b299eb82676829 server_cookie=3c2eee8fe9a566a8 in_seq=0 out_seq=0 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.812+0000 7fbefcff9640 10 client.7248 ms_handle_connect on v2:172.21.15.105:6833/3881960029 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.812+0000 7fbefcff9640 1 -- 172.21.15.60:0/2400705409 <== mds.0 v2:172.21.15.105:6833/3881960029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5590647cbc50 con 0x55906487bc50 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.812+0000 7fbefcff9640 10 client.7248 handle_command_reply: tid=0 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.812+0000 7fbf22c02740 1 client.7248 shutdown 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.812+0000 7fbf22c02740 1 -- 172.21.15.60:0/2400705409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 msgr2=0x559064882730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.812+0000 7fbf22c02740 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 0x559064882730 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fbf08004320 tx=0x7fbf080047e0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.812+0000 7fbf22c02740 1 -- 172.21.15.60:0/2400705409 shutdown_connections 2024-09-12T01:42:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.813+0000 7fbf22c02740 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.105:6833/3881960029,v1:172.21.15.105:6835/3881960029] conn(0x55906487bc50 0x55906487c030 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.813+0000 7fbf22c02740 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 0x559064882730 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.813+0000 7fbf22c02740 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485da50 0x55906487cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.813+0000 7fbefcff9640 0 client.7248 ms_handle_reset on v2:172.21.15.105:6833/3881960029 2024-09-12T01:42:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.813+0000 7fbf22c02740 1 --2- 172.21.15.60:0/2400705409 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485c2c0 0x55906487ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.813+0000 7fbf22c02740 1 -- 172.21.15.60:0/2400705409 >> 172.21.15.60:0/2400705409 conn(0x559064859a80 msgr2=0x55906485a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.813+0000 7fbf22c02740 1 -- 172.21.15.60:0/2400705409 shutdown_connections 2024-09-12T01:42:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.813+0000 7fbf22c02740 1 -- 172.21.15.60:0/2400705409 wait complete. 2024-09-12T01:42:35.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.813+0000 7fbf22c02740 20 client.7248 trim_cache size 0 max 16384 2024-09-12T01:42:35.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.831+0000 7fbf22c02740 1 Processor -- start 2024-09-12T01:42:35.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.831+0000 7fbf22c02740 1 -- start start 2024-09-12T01:42:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.832+0000 7fbf22c02740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 0x55906489f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.832+0000 7fbf22c02740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485da50 0x5590648c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.832+0000 7fbf22c02740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5590648822d0 0x5590648c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.832+0000 7fbf22c02740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181ffbf0 con 0x55906485c2c0 2024-09-12T01:42:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.832+0000 7fbf22c02740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181f83b0 con 0x5590648822d0 2024-09-12T01:42:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.832+0000 7fbf22c02740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbf18159b10 con 0x55906485da50 2024-09-12T01:42:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.832+0000 7fbf1dc01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 0x55906489f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.832+0000 7fbf1dc01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 0x55906489f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56082/0 (socket says 172.21.15.60:56082) 2024-09-12T01:42:35.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.832+0000 7fbf1dc01640 1 -- 172.21.15.60:0/1564923281 learned_addr learned my addr 172.21.15.60:0/1564923281 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.832+0000 7fbf1d400640 1 --2- 172.21.15.60:0/1564923281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485da50 0x5590648c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.832+0000 7fbf1e402640 1 --2- 172.21.15.60:0/1564923281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5590648822d0 0x5590648c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbf1dc01640 1 -- 172.21.15.60:0/1564923281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485da50 msgr2=0x5590648c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/1564923281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485da50 0x5590648c4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbf1dc01640 1 -- 172.21.15.60:0/1564923281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5590648822d0 msgr2=0x5590648c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/1564923281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5590648822d0 0x5590648c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbf1dc01640 1 -- 172.21.15.60:0/1564923281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5590648528b0 con 0x55906485c2c0 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbf1d400640 1 --2- 172.21.15.60:0/1564923281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485da50 0x5590648c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbf1e402640 1 --2- 172.21.15.60:0/1564923281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5590648822d0 0x5590648c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/1564923281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 0x55906489f3f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000fab0 tx=0x7fbf10014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22c5d55d49912e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbefeffd640 1 -- 172.21.15.60:0/1564923281 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1001b050 con 0x55906485c2c0 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbefeffd640 1 -- 172.21.15.60:0/1564923281 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf10025040 con 0x55906485c2c0 2024-09-12T01:42:35.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbefeffd640 1 -- 172.21.15.60:0/1564923281 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf100358a0 con 0x55906485c2c0 2024-09-12T01:42:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbf22c02740 1 -- 172.21.15.60:0/1564923281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 msgr2=0x55906489f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.833+0000 7fbf22c02740 1 --2- 172.21.15.60:0/1564923281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 0x55906489f3f0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fbf1000fab0 tx=0x7fbf10014000 comp rx=0 tx=0).stop 2024-09-12T01:42:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.834+0000 7fbf22c02740 1 -- 172.21.15.60:0/1564923281 shutdown_connections 2024-09-12T01:42:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.834+0000 7fbf22c02740 1 --2- 172.21.15.60:0/1564923281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5590648822d0 0x5590648c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.834+0000 7fbf22c02740 1 --2- 172.21.15.60:0/1564923281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485da50 0x5590648c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.834+0000 7fbf22c02740 1 --2- 172.21.15.60:0/1564923281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55906485c2c0 0x55906489f3f0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.834+0000 7fbf22c02740 1 -- 172.21.15.60:0/1564923281 >> 172.21.15.60:0/1564923281 conn(0x559064859a80 msgr2=0x559064882740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.834+0000 7fbf22c02740 1 -- 172.21.15.60:0/1564923281 shutdown_connections 2024-09-12T01:42:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.834+0000 7fbf22c02740 1 -- 172.21.15.60:0/1564923281 wait complete. 2024-09-12T01:42:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.834+0000 7fbf22c02740 1 -- start start 2024-09-12T01:42:35.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.834+0000 7fbf22c02740 1 Processor -- start 2024-09-12T01:42:35.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf22c02740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485c2c0 0x5590649192a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf22c02740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485da50 0x5590648a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf22c02740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 0x5590648a31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf22c02740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55906487d1a0 con 0x5590648822d0 2024-09-12T01:42:35.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf22c02740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5590648b1f00 con 0x55906485da50 2024-09-12T01:42:35.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf22c02740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x559064855f60 con 0x55906485c2c0 2024-09-12T01:42:35.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf22c02740 10 client.0 _ll_register_callbacks cb 0x7fbf08009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:42:35.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf1e402640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 0x5590648a31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf1e402640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 0x5590648a31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56096/0 (socket says 172.21.15.60:56096) 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf1e402640 1 -- 172.21.15.60:0/1468229326 learned_addr learned my addr 172.21.15.60:0/1468229326 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf1d400640 1 --2- 172.21.15.60:0/1468229326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485da50 0x5590648a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf1e402640 1 -- 172.21.15.60:0/1468229326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485c2c0 msgr2=0x5590649192a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf1e402640 1 --2- 172.21.15.60:0/1468229326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485c2c0 0x5590649192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf1e402640 1 -- 172.21.15.60:0/1468229326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485da50 msgr2=0x5590648a2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf1e402640 1 --2- 172.21.15.60:0/1468229326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485da50 0x5590648a2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.835+0000 7fbf1e402640 1 -- 172.21.15.60:0/1468229326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55906489e770 con 0x5590648822d0 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbf1e402640 1 --2- 172.21.15.60:0/1468229326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 0x5590648a31e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fbf08007130 tx=0x7fbf08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d25ddcf2daf9d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbefcff9640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbefcff9640 1 -- 172.21.15.60:0/1468229326 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08019040 con 0x5590648822d0 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbefcff9640 1 -- 172.21.15.60:0/1468229326 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7fbf08015600 con 0x5590648822d0 2024-09-12T01:42:35.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbf22c02740 1 -- 172.21.15.60:0/1468229326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf10025040 con 0x5590648822d0 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbefcff9640 1 -- 172.21.15.60:0/1468229326 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fbf08031050 con 0x5590648822d0 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbf22c02740 10 client.7254 fetch_fsmap learned FSMap version 61 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbf22c02740 1 -- 172.21.15.60:0/1468229326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55906491f2d0 con 0x5590648822d0 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbefcff9640 1 -- 172.21.15.60:0/1468229326 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf10025040 con 0x5590648822d0 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbefcff9640 1 -- 172.21.15.60:0/1468229326 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 61) ==== 3502+0+0 (secure 0 0 0) 0x7fbf08034020 con 0x5590648822d0 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbf22c02740 10 client.7254 fetch_fsmap finished waiting for FSMap version 61 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbf22c02740 10 client.7254 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbf22c02740 20 client.7254 populate_metadata read hostname 'smithi060' 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbf22c02740 1 --2- 172.21.15.60:0/1468229326 >> [v2:172.21.15.105:6833/3881960029,v1:172.21.15.105:6835/3881960029] conn(0x55906491ff20 0x55906487f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbf22c02740 4 client.7254 mds_command: new command op to 7110 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.836+0000 7fbf22c02740 1 -- 172.21.15.60:0/1468229326 --> [v2:172.21.15.105:6833/3881960029,v1:172.21.15.105:6835/3881960029] -- command(tid 0: {"prefix": "status"}) -- 0x5590647c5fa0 con 0x55906491ff20 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/1468229326 >> [v2:172.21.15.105:6833/3881960029,v1:172.21.15.105:6835/3881960029] conn(0x55906491ff20 0x55906487f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbefcff9640 10 client.7254 ms_handle_connect on v2:172.21.15.105:6833/3881960029 2024-09-12T01:42:35.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbf1dc01640 1 --2- 172.21.15.60:0/1468229326 >> [v2:172.21.15.105:6833/3881960029,v1:172.21.15.105:6835/3881960029] conn(0x55906491ff20 0x55906487f9a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4bd575882703f41 server_cookie=633234315d39d728 in_seq=0 out_seq=0 2024-09-12T01:42:35.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbefcff9640 1 -- 172.21.15.60:0/1468229326 <== mds.0 v2:172.21.15.105:6833/3881960029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5590647c5fa0 con 0x55906491ff20 2024-09-12T01:42:35.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbefcff9640 10 client.7254 handle_command_reply: tid=0 2024-09-12T01:42:35.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbf22c02740 1 client.7254 shutdown 2024-09-12T01:42:35.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbf22c02740 1 -- 172.21.15.60:0/1468229326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 msgr2=0x5590648a31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbf22c02740 1 --2- 172.21.15.60:0/1468229326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 0x5590648a31e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fbf08007130 tx=0x7fbf08004a40 comp rx=0 tx=0).stop 2024-09-12T01:42:35.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbf22c02740 1 -- 172.21.15.60:0/1468229326 shutdown_connections 2024-09-12T01:42:35.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbf22c02740 1 --2- 172.21.15.60:0/1468229326 >> [v2:172.21.15.105:6833/3881960029,v1:172.21.15.105:6835/3881960029] conn(0x55906491ff20 0x55906487f9a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbf22c02740 1 --2- 172.21.15.60:0/1468229326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5590648822d0 0x5590648a31e0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbefcff9640 0 client.7254 ms_handle_reset on v2:172.21.15.105:6833/3881960029 2024-09-12T01:42:35.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbf22c02740 1 --2- 172.21.15.60:0/1468229326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55906485da50 0x5590648a2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbf22c02740 1 --2- 172.21.15.60:0/1468229326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55906485c2c0 0x5590649192a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.837+0000 7fbf22c02740 1 -- 172.21.15.60:0/1468229326 >> 172.21.15.60:0/1468229326 conn(0x559064859a80 msgr2=0x55906487afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:35.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf22c02740 1 -- 172.21.15.60:0/1468229326 shutdown_connections 2024-09-12T01:42:35.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf22c02740 1 -- 172.21.15.60:0/1468229326 wait complete. 2024-09-12T01:42:35.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf22c02740 20 client.7254 trim_cache size 0 max 16384 2024-09-12T01:42:35.844 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:42:35.844 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "5401bd8a-3492-4b21-b6c0-d6616ff39793", 2024-09-12T01:42:35.844 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T01:42:35.844 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 7110, 2024-09-12T01:42:35.844 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T01:42:35.844 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T01:42:35.844 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-12T01:42:35.845 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 9.1123282539999995, 2024-09-12T01:42:35.845 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 61, 2024-09-12T01:42:35.845 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 103, 2024-09-12T01:42:35.845 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 103, 2024-09-12T01:42:35.845 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 14.134011608 2024-09-12T01:42:35.845 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:42:35.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf1fe65640 1 -- 172.21.15.60:0/3822502795 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf0406be30 msgr2=0x7fbf0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf1fe65640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf0406be30 0x7fbf0406e2f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbf10006fd0 tx=0x7fbf10008040 comp rx=0 tx=0).stop 2024-09-12T01:42:35.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf1fe65640 1 -- 172.21.15.60:0/3822502795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf18073b10 msgr2=0x7fbf1815e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf1fe65640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf18073b10 0x7fbf1815e3e0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c02a220 tx=0x7fbf0c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf1fe65640 1 -- 172.21.15.60:0/3822502795 shutdown_connections 2024-09-12T01:42:35.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf1fe65640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbf0406be30 0x7fbf0406e2f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf1fe65640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbf1815c2a0 0x7fbf1815d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf1fe65640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf18073b10 0x7fbf1815e3e0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf1fe65640 1 --2- 172.21.15.60:0/3822502795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbf1806fc50 0x7fbf18152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf1fe65640 1 -- 172.21.15.60:0/3822502795 >> 172.21.15.60:0/3822502795 conn(0x7fbf180b3070 msgr2=0x7fbf180b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:35.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf1fe65640 1 -- 172.21.15.60:0/3822502795 shutdown_connections 2024-09-12T01:42:35.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.838+0000 7fbf1fe65640 1 -- 172.21.15.60:0/3822502795 wait complete. 2024-09-12T01:42:35.849 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:42:35.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.951+0000 7f2f3404c640 1 Processor -- start 2024-09-12T01:42:35.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.951+0000 7f2f3404c640 1 -- start start 2024-09-12T01:42:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.952+0000 7f2f3404c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2f2c0cea90 0x7f2f2c1434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.952+0000 7f2f3404c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2c141d40 con 0x7f2f2c0b2da0 2024-09-12T01:42:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.952+0000 7f2f3404c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2c142020 con 0x7f2f2c15ec10 2024-09-12T01:42:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.952+0000 7f2f3404c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2f2c141af0 con 0x7f2f2c0cea90 2024-09-12T01:42:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.952+0000 7f2f31de8640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2f2c0b2da0 0x7f2f2c0ce380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51566/0 (socket says 172.21.15.60:51566) 2024-09-12T01:42:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.952+0000 7f2f31de8640 1 -- 172.21.15.60:0/1211164844 learned_addr learned my addr 172.21.15.60:0/1211164844 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.952+0000 7f2f325e9640 1 --2- 172.21.15.60:0/1211164844 >> v2:172.21.15.105:3300/0 conn(0x7f2f2c0cea90 0x7f2f2c1434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.952+0000 7f2f30de6640 1 -- 172.21.15.60:0/1211164844 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910467112 0 0) 0x7f2f2c141d40 con 0x7f2f2c0b2da0 2024-09-12T01:42:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.953+0000 7f2f30de6640 1 -- 172.21.15.60:0/1211164844 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f14003520 con 0x7f2f2c0b2da0 2024-09-12T01:42:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.953+0000 7f2f30de6640 1 -- 172.21.15.60:0/1211164844 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2775704723 0 0) 0x7f2f2c142020 con 0x7f2f2c15ec10 2024-09-12T01:42:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.953+0000 7f2f30de6640 1 -- 172.21.15.60:0/1211164844 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f2c141d40 con 0x7f2f2c15ec10 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.953+0000 7f2f30de6640 1 -- 172.21.15.60:0/1211164844 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3613627228 0 0) 0x7f2f14003520 con 0x7f2f2c0b2da0 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.953+0000 7f2f325e9640 1 -- 172.21.15.60:0/1211164844 >> v1:172.21.15.105:6789/0 conn(0x7f2f2c15ec10 legacy=0x7f2f2c142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.953+0000 7f2f325e9640 1 -- 172.21.15.60:0/1211164844 >> v1:172.21.15.60:6789/0 conn(0x7f2f2c0b2da0 legacy=0x7f2f2c0ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.953+0000 7f2f325e9640 1 -- 172.21.15.60:0/1211164844 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2c142300 con 0x7f2f2c0cea90 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.954+0000 7f2f325e9640 1 --2- 172.21.15.60:0/1211164844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f2c0cea90 0x7f2f2c1434f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c141c70 tx=0x7f2f2402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a28f42024c4a663 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.954+0000 7f2f30de6640 1 -- 172.21.15.60:0/1211164844 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24037070 con 0x7f2f2c0cea90 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.954+0000 7f2f30de6640 1 -- 172.21.15.60:0/1211164844 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f2402ac30 con 0x7f2f2c0cea90 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.954+0000 7f2f30de6640 1 -- 172.21.15.60:0/1211164844 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0019f0 con 0x7f2f2c0cea90 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.954+0000 7f2f3404c640 1 -- 172.21.15.60:0/1211164844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f2c0cea90 msgr2=0x7f2f2c1434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.954+0000 7f2f3404c640 1 --2- 172.21.15.60:0/1211164844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f2c0cea90 0x7f2f2c1434f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c141c70 tx=0x7f2f2402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.954+0000 7f2f3404c640 1 -- 172.21.15.60:0/1211164844 shutdown_connections 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.954+0000 7f2f3404c640 1 --2- 172.21.15.60:0/1211164844 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f2c0cea90 0x7f2f2c1434f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.954+0000 7f2f3404c640 1 -- 172.21.15.60:0/1211164844 >> 172.21.15.60:0/1211164844 conn(0x7f2f2c06bc10 msgr2=0x7f2f2c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:35.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.954+0000 7f2f3404c640 1 -- 172.21.15.60:0/1211164844 shutdown_connections 2024-09-12T01:42:35.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.954+0000 7f2f3404c640 1 -- 172.21.15.60:0/1211164844 wait complete. 2024-09-12T01:42:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.956+0000 7f2f3404c640 1 Processor -- start 2024-09-12T01:42:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.956+0000 7f2f3404c640 1 -- start start 2024-09-12T01:42:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.956+0000 7f2f3404c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f2c0b2da0 0x7f2f2c0b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.956+0000 7f2f3404c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f2c0cea90 0x7f2f2c0b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.956+0000 7f2f3404c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f2c15ec10 0x7f2f2c0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.956+0000 7f2f3404c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c0b3180 con 0x7f2f2c15ec10 2024-09-12T01:42:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.956+0000 7f2f3404c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c1428c0 con 0x7f2f2c0b2da0 2024-09-12T01:42:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.956+0000 7f2f3404c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2f2c0b3300 con 0x7f2f2c0cea90 2024-09-12T01:42:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f325e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f2c15ec10 0x7f2f2c0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f325e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f2c15ec10 0x7f2f2c0b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56104/0 (socket says 172.21.15.60:56104) 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f325e9640 1 -- 172.21.15.60:0/3491516214 learned_addr learned my addr 172.21.15.60:0/3491516214 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f315e7640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f2c0cea90 0x7f2f2c0b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f31de8640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f2c0b2da0 0x7f2f2c0b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f325e9640 1 -- 172.21.15.60:0/3491516214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f2c0cea90 msgr2=0x7f2f2c0b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f325e9640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f2c0cea90 0x7f2f2c0b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f325e9640 1 -- 172.21.15.60:0/3491516214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f2c0b2da0 msgr2=0x7f2f2c0b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f325e9640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f2c0b2da0 0x7f2f2c0b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f325e9640 1 -- 172.21.15.60:0/3491516214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2c0b60c0 con 0x7f2f2c15ec10 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f315e7640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f2c0cea90 0x7f2f2c0b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f31de8640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f2c0b2da0 0x7f2f2c0b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f325e9640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f2c15ec10 0x7f2f2c0b5b80 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009890 tx=0x7f2f240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f2a7fc640 1 -- 172.21.15.60:0/3491516214 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24037050 con 0x7f2f2c15ec10 2024-09-12T01:42:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f2a7fc640 1 -- 172.21.15.60:0/3491516214 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f24043070 con 0x7f2f2c15ec10 2024-09-12T01:42:35.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f3404c640 1 -- 172.21.15.60:0/3491516214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2c157230 con 0x7f2f2c15ec10 2024-09-12T01:42:35.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f2a7fc640 1 -- 172.21.15.60:0/3491516214 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24006e10 con 0x7f2f2c15ec10 2024-09-12T01:42:35.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.957+0000 7f2f3404c640 1 -- 172.21.15.60:0/3491516214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f2c0b4900 con 0x7f2f2c15ec10 2024-09-12T01:42:35.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.958+0000 7f2f3404c640 1 -- 172.21.15.60:0/3491516214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f2c0ce380 con 0x7f2f2c15ec10 2024-09-12T01:42:35.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.959+0000 7f2f2a7fc640 1 -- 172.21.15.60:0/3491516214 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f2403ca10 con 0x7f2f2c15ec10 2024-09-12T01:42:35.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.959+0000 7f2f2a7fc640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f1806be30 0x7f2f1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:35.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.959+0000 7f2f2a7fc640 1 -- 172.21.15.60:0/3491516214 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f2f240ab860 con 0x7f2f2c15ec10 2024-09-12T01:42:35.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.959+0000 7f2f31de8640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f1806be30 0x7f2f1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:35.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.960+0000 7f2f31de8640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f1806be30 0x7f2f1806e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c001560 tx=0x7f2f1c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:35.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:35.964+0000 7f2f2a7fc640 1 -- 172.21.15.60:0/3491516214 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f2c0b60c0 con 0x7f2f2c15ec10 2024-09-12T01:42:36.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.173+0000 7f2f3404c640 1 -- 172.21.15.60:0/3491516214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f2f2c0ce7b0 con 0x7f2f2c15ec10 2024-09-12T01:42:36.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.173+0000 7f2f2a7fc640 1 -- 172.21.15.60:0/3491516214 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) ==== 53+0+73 (secure 0 0 0) 0x7f2f240ab070 con 0x7f2f2c15ec10 2024-09-12T01:42:36.173 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:42:36.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.175+0000 7f2f3404c640 1 -- 172.21.15.60:0/3491516214 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f1806be30 msgr2=0x7f2f1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:36.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.175+0000 7f2f3404c640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f1806be30 0x7f2f1806e2f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c001560 tx=0x7f2f1c009040 comp rx=0 tx=0).stop 2024-09-12T01:42:36.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.175+0000 7f2f3404c640 1 -- 172.21.15.60:0/3491516214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f2c15ec10 msgr2=0x7f2f2c0b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:36.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.175+0000 7f2f3404c640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f2c15ec10 0x7f2f2c0b5b80 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009890 tx=0x7f2f240046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.175+0000 7f2f3404c640 1 -- 172.21.15.60:0/3491516214 shutdown_connections 2024-09-12T01:42:36.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.175+0000 7f2f3404c640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f2c15ec10 0x7f2f2c0b5b80 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.175+0000 7f2f3404c640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f1806be30 0x7f2f1806e2f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.175+0000 7f2f3404c640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f2c0cea90 0x7f2f2c0b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.175+0000 7f2f3404c640 1 --2- 172.21.15.60:0/3491516214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f2c0b2da0 0x7f2f2c0b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:36.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.175+0000 7f2f3404c640 1 -- 172.21.15.60:0/3491516214 >> 172.21.15.60:0/3491516214 conn(0x7f2f2c06bc10 msgr2=0x7f2f2c15f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:36.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.175+0000 7f2f3404c640 1 -- 172.21.15.60:0/3491516214 shutdown_connections 2024-09-12T01:42:36.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36.176+0000 7f2f3404c640 1 -- 172.21.15.60:0/3491516214 wait complete. 2024-09-12T01:42:36.186 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:42:36.186 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:42:36.186 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T01:42:36.186 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:42:36.186 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:42:36.186 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:42:36.186 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:42:36.186 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:42:36.186 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:42:36.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:36.187 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T01:42:36.203 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:42:36.203 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:42:36.203 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:42:36.203 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:36.203 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:42:36.203 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42364sec preferred_lft 42364sec 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T01:42:36.204 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e8cb:28ff:fea3:34fb/64 scope link 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 72:47:53:4d:4f:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7047:53ff:fe4d:4fc7/64 scope link 2024-09-12T01:42:36.205 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:36.206 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:42:36.206 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:42:36.206 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::183c:47ff:fec1:173/64 scope link 2024-09-12T01:42:36.206 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:36.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:36.206 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:42:36.268 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T01:42:36.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:36.269 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T01:42:36.326 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T01:42:36.326 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:42:36.327 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:42:36.327 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:42:36.327 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:42:36.327 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:42:36.327 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:42:36.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:42:36.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:42:36.327 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:42:36.327 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:42:36.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:42:36.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:42:36.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:36.456 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:42:36.472 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:42:36.472 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:42:36.472 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:42:36.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:36.472 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-12T01:42:36.538 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:42:36.538 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:42:36.594 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:42:36.594 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:42:36.594 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:42:36.650 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T01:42:36.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:36.650 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:42:36.735 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:42:36.735 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:42:36.743 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:42:36.743 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:42:36.743 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:42:36.743 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:42:36.743 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:42:36.743 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:42:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:42:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:42:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:42:36.744 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:42:36.746 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:42:36.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:36.746 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:42:36.772 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:42:36.864 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:42:36.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:42:36.876 INFO:teuthology.orchestra.run.smithi060.stdout:client7263 2024-09-12T01:42:36.876 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:42:36.876 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:36.893 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:42:37.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.035+0000 7f71a60af640 1 Processor -- start 2024-09-12T01:42:37.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.036+0000 7f71a60af640 1 -- start start 2024-09-12T01:42:37.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.036+0000 7f71a60af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71a015e660 0x7f71a00cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.036+0000 7f71a60af640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f71a00d1820 0x7f71a00b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.036+0000 7f71a60af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a015ea40 con 0x7f71a00d3310 2024-09-12T01:42:37.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.036+0000 7f71a60af640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f71a00d3870 con 0x7f71a00d1820 2024-09-12T01:42:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.036+0000 7f71a60af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f71a00d3b50 con 0x7f71a015e660 2024-09-12T01:42:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.036+0000 7f719ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f71a00d1820 0x7f71a00b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.036+0000 7f719ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f71a00d1820 0x7f71a00b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56118/0 (socket says 172.21.15.60:56118) 2024-09-12T01:42:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.036+0000 7f719effd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f71a00d3310 0x7f71a00d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51572/0 (socket says 172.21.15.60:51572) 2024-09-12T01:42:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.036+0000 7f719ffff640 1 -- 172.21.15.60:0/4275279109 learned_addr learned my addr 172.21.15.60:0/4275279109 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.037+0000 7f719ffff640 1 -- 172.21.15.60:0/4275279109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71a015e660 msgr2=0x7f71a00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.037+0000 7f719ffff640 1 --2- 172.21.15.60:0/4275279109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71a015e660 0x7f71a00cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.037+0000 7f719ffff640 1 -- 172.21.15.60:0/4275279109 >> v1:172.21.15.60:6789/0 conn(0x7f71a00d3310 legacy=0x7f71a00d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.037+0000 7f719e7fc640 1 -- 172.21.15.60:0/4275279109 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1572567770 0 0) 0x7f71a015ea40 con 0x7f71a00d3310 2024-09-12T01:42:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.037+0000 7f719ffff640 1 -- 172.21.15.60:0/4275279109 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a00d3e30 con 0x7f71a00d1820 2024-09-12T01:42:37.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.037+0000 7f719ffff640 1 --2- 172.21.15.60:0/4275279109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a00d1820 0x7f71a00b7b70 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f7198009e50 tx=0x7f719802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f649d1d6f7cdb10 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:37.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.038+0000 7f719e7fc640 1 -- 172.21.15.60:0/4275279109 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7198036070 con 0x7f71a00d1820 2024-09-12T01:42:37.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.038+0000 7f719e7fc640 1 -- 172.21.15.60:0/4275279109 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7198031600 con 0x7f71a00d1820 2024-09-12T01:42:37.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.038+0000 7f719e7fc640 1 -- 172.21.15.60:0/4275279109 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71980319d0 con 0x7f71a00d1820 2024-09-12T01:42:37.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.038+0000 7f71a60af640 1 -- 172.21.15.60:0/4275279109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a00d1820 msgr2=0x7f71a00b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.038+0000 7f71a60af640 1 --2- 172.21.15.60:0/4275279109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a00d1820 0x7f71a00b7b70 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f7198009e50 tx=0x7f719802a710 comp rx=0 tx=0).stop 2024-09-12T01:42:37.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.038+0000 7f71a60af640 1 -- 172.21.15.60:0/4275279109 shutdown_connections 2024-09-12T01:42:37.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.038+0000 7f71a60af640 1 --2- 172.21.15.60:0/4275279109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a00d1820 0x7f71a00b7b70 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.038+0000 7f71a60af640 1 --2- 172.21.15.60:0/4275279109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71a015e660 0x7f71a00cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.038+0000 7f71a60af640 1 -- 172.21.15.60:0/4275279109 >> 172.21.15.60:0/4275279109 conn(0x7f71a00b6410 msgr2=0x7f71a00b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:37.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.038+0000 7f71a60af640 1 -- 172.21.15.60:0/4275279109 shutdown_connections 2024-09-12T01:42:37.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.038+0000 7f71a60af640 1 -- 172.21.15.60:0/4275279109 wait complete. 2024-09-12T01:42:37.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.039+0000 7f71a60af640 1 Processor -- start 2024-09-12T01:42:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.040+0000 7f71a60af640 1 -- start start 2024-09-12T01:42:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.040+0000 7f71a60af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71a00d1820 0x7f71a0161540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.040+0000 7f71a60af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a00d3310 0x7f71a01529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.040+0000 7f71a60af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71a015e660 0x7f71a0157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.040+0000 7f71a60af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f71a00cfc70 con 0x7f71a00d3310 2024-09-12T01:42:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.040+0000 7f71a60af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f71a00d43f0 con 0x7f71a00d1820 2024-09-12T01:42:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.040+0000 7f71a60af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f71a00b80b0 con 0x7f71a015e660 2024-09-12T01:42:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.040+0000 7f719effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a00d3310 0x7f71a01529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f719effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a00d3310 0x7f71a01529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56126/0 (socket says 172.21.15.60:56126) 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f719effd640 1 -- 172.21.15.60:0/731008430 learned_addr learned my addr 172.21.15.60:0/731008430 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f719ffff640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71a015e660 0x7f71a0157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f719f7fe640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71a00d1820 0x7f71a0161540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f719effd640 1 -- 172.21.15.60:0/731008430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71a015e660 msgr2=0x7f71a0157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f719effd640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71a015e660 0x7f71a0157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f719effd640 1 -- 172.21.15.60:0/731008430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71a00d1820 msgr2=0x7f71a0161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f719effd640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71a00d1820 0x7f71a0161540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f719effd640 1 -- 172.21.15.60:0/731008430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a0161a80 con 0x7f71a00d3310 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f719effd640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a00d3310 0x7f71a01529e0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f719400c4b0 tx=0x7f719400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f7187fff640 1 -- 172.21.15.60:0/731008430 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194018070 con 0x7f71a00d3310 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f7187fff640 1 -- 172.21.15.60:0/731008430 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7194007500 con 0x7f71a00d3310 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f71a60af640 1 -- 172.21.15.60:0/731008430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a01604a0 con 0x7f71a00d3310 2024-09-12T01:42:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f7187fff640 1 -- 172.21.15.60:0/731008430 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7194004a20 con 0x7f71a00d3310 2024-09-12T01:42:37.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.041+0000 7f71a60af640 1 -- 172.21.15.60:0/731008430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a0160d40 con 0x7f71a00d3310 2024-09-12T01:42:37.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.042+0000 7f71a60af640 1 -- 172.21.15.60:0/731008430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71a00b7b70 con 0x7f71a00d3310 2024-09-12T01:42:37.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.043+0000 7f7187fff640 1 -- 172.21.15.60:0/731008430 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f719401b070 con 0x7f71a00d3310 2024-09-12T01:42:37.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.043+0000 7f7187fff640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f718c06be30 0x7f718c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:37.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.044+0000 7f7187fff640 1 -- 172.21.15.60:0/731008430 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f719408a130 con 0x7f71a00d3310 2024-09-12T01:42:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.044+0000 7f719f7fe640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f718c06be30 0x7f718c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.044+0000 7f719f7fe640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f718c06be30 0x7f718c06e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f71a0156b80 tx=0x7f7190008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.048+0000 7f7187fff640 1 -- 172.21.15.60:0/731008430 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7194058c30 con 0x7f71a00d3310 2024-09-12T01:42:37.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.261+0000 7f71a60af640 1 -- 172.21.15.60:0/731008430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f71a00b9b90 con 0x7f71a00d3310 2024-09-12T01:42:37.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.261+0000 7f7187fff640 1 -- 172.21.15.60:0/731008430 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) ==== 53+0+73 (secure 0 0 0) 0x7f7194058530 con 0x7f71a00d3310 2024-09-12T01:42:37.261 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:42:37.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.263+0000 7f71a60af640 1 -- 172.21.15.60:0/731008430 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f718c06be30 msgr2=0x7f718c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.263+0000 7f71a60af640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f718c06be30 0x7f718c06e2f0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f71a0156b80 tx=0x7f7190008040 comp rx=0 tx=0).stop 2024-09-12T01:42:37.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.263+0000 7f71a60af640 1 -- 172.21.15.60:0/731008430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a00d3310 msgr2=0x7f71a01529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:37.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.263+0000 7f71a60af640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a00d3310 0x7f71a01529e0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f719400c4b0 tx=0x7f719400c970 comp rx=0 tx=0).stop 2024-09-12T01:42:37.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.263+0000 7f71a60af640 1 -- 172.21.15.60:0/731008430 shutdown_connections 2024-09-12T01:42:37.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.263+0000 7f71a60af640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f718c06be30 0x7f718c06e2f0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.263+0000 7f71a60af640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f71a015e660 0x7f71a0157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.263+0000 7f71a60af640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71a00d3310 0x7f71a01529e0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.263+0000 7f71a60af640 1 --2- 172.21.15.60:0/731008430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f71a00d1820 0x7f71a0161540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:37.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.263+0000 7f71a60af640 1 -- 172.21.15.60:0/731008430 >> 172.21.15.60:0/731008430 conn(0x7f71a00b6410 msgr2=0x7f71a00b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:37.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.263+0000 7f71a60af640 1 -- 172.21.15.60:0/731008430 shutdown_connections 2024-09-12T01:42:37.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:37.263+0000 7f71a60af640 1 -- 172.21.15.60:0/731008430 wait complete. 2024-09-12T01:42:37.274 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:42:37.274 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:42:37.274 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T01:42:37.274 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:42:37.274 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:42:37.274 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:42:37.274 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:42:37.274 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:42:37.274 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:42:37.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:37.274 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T01:42:37.294 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:42:37.294 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:42:37.294 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:42:37.294 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:37.294 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:42:37.294 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:37.294 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:42:37.294 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:37.294 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42366sec preferred_lft 42366sec 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:42:37.295 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff 2024-09-12T01:42:37.296 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:42:37.296 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:37.296 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::c46c:baff:feeb:1f5e/64 scope link 2024-09-12T01:42:37.296 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:37.296 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:42:37.296 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 56:66:28:3d:b2:45 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:42:37.296 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::5466:28ff:fe3d:b245/64 scope link 2024-09-12T01:42:37.296 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:37.296 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:42:37.296 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:42:37.296 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::2036:4aff:fe87:b9cb/64 scope link 2024-09-12T01:42:37.296 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:42:37.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:37.297 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:42:37.363 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:42:37.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:37.365 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T01:42:37.423 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T01:42:37.424 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:42:37.424 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:42:37.424 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:42:37.424 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:42:37.424 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:42:37.424 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:42:37.424 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:42:37.424 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:42:37.424 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:42:37.425 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:42:37.518 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:42:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:42:37.552 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:42:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:42:37.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:37.559 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:42:37.575 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T01:42:37.575 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:42:37.575 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:42:37.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:37.575 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-12T01:42:37.641 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:42:37.641 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:42:37.697 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:42:37.698 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:42:37.698 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:42:37.753 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T01:42:37.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:37.753 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:42:37.840 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:42:37.840 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:42:37.849 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:42:37.849 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:42:37.849 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:42:37.849 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 1@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:42:37.849 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:42:37.849 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:42:37.849 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:42:37.849 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:42:37.850 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:42:37.850 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:42:37.851 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:42:37.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:37.851 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:42:37.875 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:42:37.964 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:42:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:42:37.965 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:42:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:42:37.971 INFO:teuthology.orchestra.run.smithi105.stdout:client7275 2024-09-12T01:42:37.971 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:42:37.971 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:37.987 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-09-12T01:42:38.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.106+0000 7fea498c9640 1 Processor -- start 2024-09-12T01:42:38.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.106+0000 7fea498c9640 1 -- start start 2024-09-12T01:42:38.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.107+0000 7fea498c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea4415e7a0 0x7fea4406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.107+0000 7fea498c9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea440cf860 con 0x7fea440b68f0 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.107+0000 7fea498c9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea440cfb40 con 0x7fea440cf1f0 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.107+0000 7fea498c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fea440d2ca0 con 0x7fea4415e7a0 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.107+0000 7fea437fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fea440b68f0 0x7fea440d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51574/0 (socket says 172.21.15.60:51574) 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.107+0000 7fea437fe640 1 -- 172.21.15.60:0/1126574741 learned_addr learned my addr 172.21.15.60:0/1126574741 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.108+0000 7fea42ffd640 1 --2- 172.21.15.60:0/1126574741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea4415e7a0 0x7fea4406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.108+0000 7fea41ffb640 1 -- 172.21.15.60:0/1126574741 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3145752665 0 0) 0x7fea440cf860 con 0x7fea440b68f0 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.108+0000 7fea41ffb640 1 -- 172.21.15.60:0/1126574741 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea2c003520 con 0x7fea440b68f0 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.108+0000 7fea41ffb640 1 -- 172.21.15.60:0/1126574741 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454043858 0 0) 0x7fea440cfb40 con 0x7fea440cf1f0 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.108+0000 7fea41ffb640 1 -- 172.21.15.60:0/1126574741 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea440cf860 con 0x7fea440cf1f0 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.108+0000 7fea42ffd640 1 -- 172.21.15.60:0/1126574741 >> v1:172.21.15.105:6789/0 conn(0x7fea440cf1f0 legacy=0x7fea440b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.108+0000 7fea42ffd640 1 -- 172.21.15.60:0/1126574741 >> v1:172.21.15.60:6789/0 conn(0x7fea440b68f0 legacy=0x7fea440d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.108+0000 7fea41ffb640 1 -- 172.21.15.60:0/1126574741 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 390506949 0 0) 0x7fea2c003520 con 0x7fea440b68f0 2024-09-12T01:42:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.108+0000 7fea42ffd640 1 -- 172.21.15.60:0/1126574741 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea440cfe20 con 0x7fea4415e7a0 2024-09-12T01:42:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.109+0000 7fea42ffd640 1 --2- 172.21.15.60:0/1126574741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea4415e7a0 0x7fea4406caa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea340097d0 tx=0x7fea3402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dce49429d1e7c536 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.109+0000 7fea41ffb640 1 -- 172.21.15.60:0/1126574741 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34037070 con 0x7fea4415e7a0 2024-09-12T01:42:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.109+0000 7fea41ffb640 1 -- 172.21.15.60:0/1126574741 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea3402ab90 con 0x7fea4415e7a0 2024-09-12T01:42:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.109+0000 7fea41ffb640 1 -- 172.21.15.60:0/1126574741 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c0019f0 con 0x7fea4415e7a0 2024-09-12T01:42:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.109+0000 7fea498c9640 1 -- 172.21.15.60:0/1126574741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea4415e7a0 msgr2=0x7fea4406caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.109+0000 7fea498c9640 1 --2- 172.21.15.60:0/1126574741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea4415e7a0 0x7fea4406caa0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea340097d0 tx=0x7fea3402a100 comp rx=0 tx=0).stop 2024-09-12T01:42:38.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.109+0000 7fea498c9640 1 -- 172.21.15.60:0/1126574741 shutdown_connections 2024-09-12T01:42:38.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.109+0000 7fea498c9640 1 --2- 172.21.15.60:0/1126574741 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea4415e7a0 0x7fea4406caa0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.110+0000 7fea498c9640 1 -- 172.21.15.60:0/1126574741 >> 172.21.15.60:0/1126574741 conn(0x7fea440d11e0 msgr2=0x7fea440d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:38.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.110+0000 7fea498c9640 1 -- 172.21.15.60:0/1126574741 shutdown_connections 2024-09-12T01:42:38.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.110+0000 7fea498c9640 1 -- 172.21.15.60:0/1126574741 wait complete. 2024-09-12T01:42:38.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.111+0000 7fea498c9640 1 Processor -- start 2024-09-12T01:42:38.111 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.111+0000 7fea498c9640 1 -- start start 2024-09-12T01:42:38.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.112+0000 7fea498c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea440b68f0 0x7fea440ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.112+0000 7fea498c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea440cf1f0 0x7fea440c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.112+0000 7fea498c9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea4415e7a0 0x7fea440c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.112+0000 7fea498c9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fea4406cfe0 con 0x7fea440b68f0 2024-09-12T01:42:38.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.112+0000 7fea498c9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fea440b7a00 con 0x7fea4415e7a0 2024-09-12T01:42:38.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.112+0000 7fea498c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fea4415eb80 con 0x7fea440cf1f0 2024-09-12T01:42:38.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.112+0000 7fea42ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea440b68f0 0x7fea440ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.112+0000 7fea42ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea440b68f0 0x7fea440ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56138/0 (socket says 172.21.15.60:56138) 2024-09-12T01:42:38.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.112+0000 7fea42ffd640 1 -- 172.21.15.60:0/847151787 learned_addr learned my addr 172.21.15.60:0/847151787 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:38.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.112+0000 7fea427fc640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea440cf1f0 0x7fea440c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.112+0000 7fea437fe640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea4415e7a0 0x7fea440c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.113+0000 7fea42ffd640 1 -- 172.21.15.60:0/847151787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea440cf1f0 msgr2=0x7fea440c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.113+0000 7fea42ffd640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea440cf1f0 0x7fea440c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.113+0000 7fea42ffd640 1 -- 172.21.15.60:0/847151787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea4415e7a0 msgr2=0x7fea440c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.113+0000 7fea42ffd640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea4415e7a0 0x7fea440c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.113+0000 7fea42ffd640 1 -- 172.21.15.60:0/847151787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea440cac40 con 0x7fea440b68f0 2024-09-12T01:42:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.113+0000 7fea42ffd640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea440b68f0 0x7fea440ca3d0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fea34035040 tx=0x7fea340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.113+0000 7fea2bfff640 1 -- 172.21.15.60:0/847151787 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34037050 con 0x7fea440b68f0 2024-09-12T01:42:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.113+0000 7fea2bfff640 1 -- 172.21.15.60:0/847151787 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea34043070 con 0x7fea440b68f0 2024-09-12T01:42:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.113+0000 7fea498c9640 1 -- 172.21.15.60:0/847151787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea440caf20 con 0x7fea440b68f0 2024-09-12T01:42:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.113+0000 7fea2bfff640 1 -- 172.21.15.60:0/847151787 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea34006e10 con 0x7fea440b68f0 2024-09-12T01:42:38.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.113+0000 7fea498c9640 1 -- 172.21.15.60:0/847151787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea440cb4e0 con 0x7fea440b68f0 2024-09-12T01:42:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.114+0000 7fea498c9640 1 -- 172.21.15.60:0/847151787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea4406caa0 con 0x7fea440b68f0 2024-09-12T01:42:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.115+0000 7fea2bfff640 1 -- 172.21.15.60:0/847151787 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea3403ca30 con 0x7fea440b68f0 2024-09-12T01:42:38.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.115+0000 7fea2bfff640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea3006be30 0x7fea3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.115+0000 7fea2bfff640 1 -- 172.21.15.60:0/847151787 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5796+0+0 (secure 0 0 0) 0x7fea340ab7d0 con 0x7fea440b68f0 2024-09-12T01:42:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.115+0000 7fea427fc640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea3006be30 0x7fea3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.116+0000 7fea427fc640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea3006be30 0x7fea3006e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fea44161850 tx=0x7fea38009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:38.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.119+0000 7fea2bfff640 1 -- 172.21.15.60:0/847151787 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea34079c80 con 0x7fea440b68f0 2024-09-12T01:42:38.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.296+0000 7fea498c9640 1 -- 172.21.15.60:0/847151787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7fea4415ba80 con 0x7fea440b68f0 2024-09-12T01:42:38.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.299+0000 7fea2bfff640 1 -- 172.21.15.60:0/847151787 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v37)=0 v37) ==== 121+0+0 (secure 0 0 0) 0x7fea3407df80 con 0x7fea440b68f0 2024-09-12T01:42:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.301+0000 7fea498c9640 1 -- 172.21.15.60:0/847151787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea3006be30 msgr2=0x7fea3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.301+0000 7fea498c9640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea3006be30 0x7fea3006e2f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fea44161850 tx=0x7fea38009040 comp rx=0 tx=0).stop 2024-09-12T01:42:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.301+0000 7fea498c9640 1 -- 172.21.15.60:0/847151787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea440b68f0 msgr2=0x7fea440ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.301+0000 7fea498c9640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea440b68f0 0x7fea440ca3d0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fea34035040 tx=0x7fea340046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.301+0000 7fea498c9640 1 -- 172.21.15.60:0/847151787 shutdown_connections 2024-09-12T01:42:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.301+0000 7fea498c9640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea4415e7a0 0x7fea440c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.301+0000 7fea498c9640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea3006be30 0x7fea3006e2f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.301+0000 7fea498c9640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea440cf1f0 0x7fea440c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.301+0000 7fea498c9640 1 --2- 172.21.15.60:0/847151787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea440b68f0 0x7fea440ca3d0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.301+0000 7fea498c9640 1 -- 172.21.15.60:0/847151787 >> 172.21.15.60:0/847151787 conn(0x7fea440d11e0 msgr2=0x7fea440d4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:38.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.301+0000 7fea498c9640 1 -- 172.21.15.60:0/847151787 shutdown_connections 2024-09-12T01:42:38.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.301+0000 7fea498c9640 1 -- 172.21.15.60:0/847151787 wait complete. 2024-09-12T01:42:38.312 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 400 2024-09-12T01:42:38.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.418+0000 7f2417d52640 1 Processor -- start 2024-09-12T01:42:38.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.418+0000 7f2417d52640 1 -- start start 2024-09-12T01:42:38.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f2417d52640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f241015e6f0 0x7f241006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f2417d52640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24100b54d0 0x7f241015f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f2417d52640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f241006e990 con 0x7f24100b6d40 2024-09-12T01:42:38.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f2417d52640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f241006ec70 con 0x7f241015e6f0 2024-09-12T01:42:38.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f2417d52640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f241015ec70 con 0x7f24100b54d0 2024-09-12T01:42:38.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f2415aee640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f241015e6f0 0x7f241006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f2415aee640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f241015e6f0 0x7f241006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56152/0 (socket says 172.21.15.60:56152) 2024-09-12T01:42:38.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f2415aee640 1 -- 172.21.15.60:0/3100108629 learned_addr learned my addr 172.21.15.60:0/3100108629 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:38.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f24152ed640 1 --2- 172.21.15.60:0/3100108629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24100b54d0 0x7f241015f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f2415aee640 1 -- 172.21.15.60:0/3100108629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24100b54d0 msgr2=0x7f241015f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:38.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f2415aee640 1 --2- 172.21.15.60:0/3100108629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24100b54d0 0x7f241015f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f2415aee640 1 -- 172.21.15.60:0/3100108629 >> v1:172.21.15.105:6789/0 conn(0x7f24100b6d40 legacy=0x7f24100b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.419+0000 7f2415aee640 1 -- 172.21.15.60:0/3100108629 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241015ef50 con 0x7f241015e6f0 2024-09-12T01:42:38.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.420+0000 7f2415aee640 1 --2- 172.21.15.60:0/3100108629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f241015e6f0 0x7f241006fd00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f240c009870 tx=0x7f240c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ada648c04adaff server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:38.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.420+0000 7f2414aec640 1 -- 172.21.15.60:0/3100108629 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c037070 con 0x7f241015e6f0 2024-09-12T01:42:38.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.420+0000 7f2414aec640 1 -- 172.21.15.60:0/3100108629 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240c032440 con 0x7f241015e6f0 2024-09-12T01:42:38.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.420+0000 7f2414aec640 1 -- 172.21.15.60:0/3100108629 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c032810 con 0x7f241015e6f0 2024-09-12T01:42:38.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.421+0000 7f2417d52640 1 -- 172.21.15.60:0/3100108629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f241015e6f0 msgr2=0x7f241006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.421+0000 7f2417d52640 1 --2- 172.21.15.60:0/3100108629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f241015e6f0 0x7f241006fd00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f240c009870 tx=0x7f240c02a270 comp rx=0 tx=0).stop 2024-09-12T01:42:38.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.421+0000 7f2417d52640 1 -- 172.21.15.60:0/3100108629 shutdown_connections 2024-09-12T01:42:38.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.421+0000 7f2417d52640 1 --2- 172.21.15.60:0/3100108629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24100b54d0 0x7f241015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.421+0000 7f2417d52640 1 --2- 172.21.15.60:0/3100108629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f241015e6f0 0x7f241006fd00 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.421+0000 7f2417d52640 1 -- 172.21.15.60:0/3100108629 >> 172.21.15.60:0/3100108629 conn(0x7f24100d2430 msgr2=0x7f24100d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:38.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.421+0000 7f2417d52640 1 -- 172.21.15.60:0/3100108629 shutdown_connections 2024-09-12T01:42:38.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.421+0000 7f2417d52640 1 -- 172.21.15.60:0/3100108629 wait complete. 2024-09-12T01:42:38.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.422+0000 7f2417d52640 1 Processor -- start 2024-09-12T01:42:38.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.422+0000 7f2417d52640 1 -- start start 2024-09-12T01:42:38.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f2417d52640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24100b54d0 0x7f24101427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f2417d52640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24100b6d40 0x7f241015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f2417d52640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f241015e6f0 0x7f241015d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f2417d52640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f241006e730 con 0x7f241015e6f0 2024-09-12T01:42:38.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f2417d52640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f241006e5b0 con 0x7f24100b6d40 2024-09-12T01:42:38.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f2417d52640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2410070830 con 0x7f24100b54d0 2024-09-12T01:42:38.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f24162ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f241015e6f0 0x7f241015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f24162ef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f241015e6f0 0x7f241015d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56166/0 (socket says 172.21.15.60:56166) 2024-09-12T01:42:38.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f24162ef640 1 -- 172.21.15.60:0/3292925459 learned_addr learned my addr 172.21.15.60:0/3292925459 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:38.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f24152ed640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24100b6d40 0x7f241015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f2415aee640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24100b54d0 0x7f24101427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f24162ef640 1 -- 172.21.15.60:0/3292925459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24100b54d0 msgr2=0x7f24101427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f24162ef640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24100b54d0 0x7f24101427c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f24162ef640 1 -- 172.21.15.60:0/3292925459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24100b6d40 msgr2=0x7f241015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f24162ef640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24100b6d40 0x7f241015cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f24162ef640 1 -- 172.21.15.60:0/3292925459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241015fbb0 con 0x7f241015e6f0 2024-09-12T01:42:38.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f24162ef640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f241015e6f0 0x7f241015d310 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f240800c7a0 tx=0x7f240800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:38.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.423+0000 7f24067fc640 1 -- 172.21.15.60:0/3292925459 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2408003b70 con 0x7f241015e6f0 2024-09-12T01:42:38.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.424+0000 7f24067fc640 1 -- 172.21.15.60:0/3292925459 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2408003d30 con 0x7f241015e6f0 2024-09-12T01:42:38.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.424+0000 7f2417d52640 1 -- 172.21.15.60:0/3292925459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f241015fe90 con 0x7f241015e6f0 2024-09-12T01:42:38.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.424+0000 7f24067fc640 1 -- 172.21.15.60:0/3292925459 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240800aa90 con 0x7f241015e6f0 2024-09-12T01:42:38.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.424+0000 7f2417d52640 1 -- 172.21.15.60:0/3292925459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2410154a20 con 0x7f241015e6f0 2024-09-12T01:42:38.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.425+0000 7f2417d52640 1 -- 172.21.15.60:0/3292925459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f241006c6c0 con 0x7f241015e6f0 2024-09-12T01:42:38.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.425+0000 7f24067fc640 1 -- 172.21.15.60:0/3292925459 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f240800ac30 con 0x7f241015e6f0 2024-09-12T01:42:38.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.426+0000 7f24067fc640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f23f406be30 0x7f23f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.426+0000 7f24067fc640 1 -- 172.21.15.60:0/3292925459 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5796+0+0 (secure 0 0 0) 0x7f240808acc0 con 0x7f241015e6f0 2024-09-12T01:42:38.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.426+0000 7f2415aee640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f23f406be30 0x7f23f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.426+0000 7f2415aee640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f23f406be30 0x7f23f406e2f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f240c034000 tx=0x7f240c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:38.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.430+0000 7f24067fc640 1 -- 172.21.15.60:0/3292925459 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2408091080 con 0x7f241015e6f0 2024-09-12T01:42:38.603 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.604+0000 7f2417d52640 1 -- 172.21.15.60:0/3292925459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7f241015a000 con 0x7f241015e6f0 2024-09-12T01:42:38.606 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.607+0000 7f24067fc640 1 -- 172.21.15.60:0/3292925459 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v38)=0 v38) ==== 119+0+0 (secure 0 0 0) 0x7f2408058fb0 con 0x7f241015e6f0 2024-09-12T01:42:38.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.609+0000 7f2417d52640 1 -- 172.21.15.60:0/3292925459 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f23f406be30 msgr2=0x7f23f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.609+0000 7f2417d52640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f23f406be30 0x7f23f406e2f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f240c034000 tx=0x7f240c02e000 comp rx=0 tx=0).stop 2024-09-12T01:42:38.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.609+0000 7f2417d52640 1 -- 172.21.15.60:0/3292925459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f241015e6f0 msgr2=0x7f241015d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.609+0000 7f2417d52640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f241015e6f0 0x7f241015d310 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f240800c7a0 tx=0x7f240800cc60 comp rx=0 tx=0).stop 2024-09-12T01:42:38.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.609+0000 7f2417d52640 1 -- 172.21.15.60:0/3292925459 shutdown_connections 2024-09-12T01:42:38.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.609+0000 7f2417d52640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f241015e6f0 0x7f241015d310 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.609+0000 7f2417d52640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f24100b6d40 0x7f241015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.609+0000 7f2417d52640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f23f406be30 0x7f23f406e2f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.609+0000 7f2417d52640 1 --2- 172.21.15.60:0/3292925459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f24100b54d0 0x7f24101427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.609+0000 7f2417d52640 1 -- 172.21.15.60:0/3292925459 >> 172.21.15.60:0/3292925459 conn(0x7f24100d2430 msgr2=0x7f241015a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:38.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.609+0000 7f2417d52640 1 -- 172.21.15.60:0/3292925459 shutdown_connections 2024-09-12T01:42:38.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.609+0000 7f2417d52640 1 -- 172.21.15.60:0/3292925459 wait complete. 2024-09-12T01:42:38.620 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 800 2024-09-12T01:42:38.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.726+0000 7fa7fbbe4640 1 Processor -- start 2024-09-12T01:42:38.725 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.726+0000 7fa7fbbe4640 1 -- start start 2024-09-12T01:42:38.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7fbbe4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7f40b6290 0x7fa7f4071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7fbbe4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7f4072530 0x7fa7f415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7fbbe4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f40ccff0 con 0x7fa7f415b480 2024-09-12T01:42:38.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7fbbe4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa7f40cd2d0 con 0x7fa7f4072530 2024-09-12T01:42:38.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7fbbe4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f40cd5b0 con 0x7fa7f40b6290 2024-09-12T01:42:38.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7fa181640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7f4072530 0x7fa7f415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7fa181640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7f4072530 0x7fa7f415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56170/0 (socket says 172.21.15.60:56170) 2024-09-12T01:42:38.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7f9980640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa7f415b480 0x7fa7f40b5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51576/0 (socket says 172.21.15.60:51576) 2024-09-12T01:42:38.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7fa181640 1 -- 172.21.15.60:0/3871101957 learned_addr learned my addr 172.21.15.60:0/3871101957 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:38.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7f917f640 1 --2- 172.21.15.60:0/3871101957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7f40b6290 0x7fa7f4071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7fa181640 1 -- 172.21.15.60:0/3871101957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7f40b6290 msgr2=0x7fa7f4071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:38.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7fa181640 1 --2- 172.21.15.60:0/3871101957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7f40b6290 0x7fa7f4071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7fa181640 1 -- 172.21.15.60:0/3871101957 >> v1:172.21.15.60:6789/0 conn(0x7fa7f415b480 legacy=0x7fa7f40b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7fa181640 1 -- 172.21.15.60:0/3871101957 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f40cd890 con 0x7fa7f4072530 2024-09-12T01:42:38.728 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.727+0000 7fa7f897e640 1 -- 172.21.15.60:0/3871101957 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2797857338 0 0) 0x7fa7f40ccff0 con 0x7fa7f415b480 2024-09-12T01:42:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.728+0000 7fa7fa181640 1 --2- 172.21.15.60:0/3871101957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f4072530 0x7fa7f415bc60 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009e50 tx=0x7fa7ec02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f688def2cdaa9a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.728+0000 7fa7f897e640 1 -- 172.21.15.60:0/3871101957 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec036070 con 0x7fa7f4072530 2024-09-12T01:42:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.728+0000 7fa7f897e640 1 -- 172.21.15.60:0/3871101957 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec031600 con 0x7fa7f4072530 2024-09-12T01:42:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.728+0000 7fa7f897e640 1 -- 172.21.15.60:0/3871101957 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec0319d0 con 0x7fa7f4072530 2024-09-12T01:42:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.729+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/3871101957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f4072530 msgr2=0x7fa7f415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.729+0000 7fa7fbbe4640 1 --2- 172.21.15.60:0/3871101957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f4072530 0x7fa7f415bc60 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009e50 tx=0x7fa7ec02a680 comp rx=0 tx=0).stop 2024-09-12T01:42:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.729+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/3871101957 shutdown_connections 2024-09-12T01:42:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.729+0000 7fa7fbbe4640 1 --2- 172.21.15.60:0/3871101957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f4072530 0x7fa7f415bc60 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.729+0000 7fa7fbbe4640 1 --2- 172.21.15.60:0/3871101957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7f40b6290 0x7fa7f4071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.729+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/3871101957 >> 172.21.15.60:0/3871101957 conn(0x7fa7f406d0f0 msgr2=0x7fa7f406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.729+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/3871101957 shutdown_connections 2024-09-12T01:42:38.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.729+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/3871101957 wait complete. 2024-09-12T01:42:38.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.730+0000 7fa7fbbe4640 1 Processor -- start 2024-09-12T01:42:38.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.730+0000 7fa7fbbe4640 1 -- start start 2024-09-12T01:42:38.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fbbe4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7f4072530 0x7fa7f40cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fbbe4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7f415b480 0x7fa7f40b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fbbe4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f415d3c0 0x7fa7f40b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fbbe4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f415b9e0 con 0x7fa7f415d3c0 2024-09-12T01:42:38.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fbbe4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f415b860 con 0x7fa7f415b480 2024-09-12T01:42:38.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fbbe4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f415c1a0 con 0x7fa7f4072530 2024-09-12T01:42:38.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fa181640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f415d3c0 0x7fa7f40b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fa181640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f415d3c0 0x7fa7f40b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56186/0 (socket says 172.21.15.60:56186) 2024-09-12T01:42:38.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fa181640 1 -- 172.21.15.60:0/289327957 learned_addr learned my addr 172.21.15.60:0/289327957 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:38.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7f9980640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7f4072530 0x7fa7f40cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7f917f640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7f415b480 0x7fa7f40b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fa181640 1 -- 172.21.15.60:0/289327957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7f4072530 msgr2=0x7fa7f40cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fa181640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7f4072530 0x7fa7f40cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fa181640 1 -- 172.21.15.60:0/289327957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7f415b480 msgr2=0x7fa7f40b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fa181640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7f415b480 0x7fa7f40b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fa181640 1 -- 172.21.15.60:0/289327957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f40cc690 con 0x7fa7f415d3c0 2024-09-12T01:42:38.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.731+0000 7fa7fa181640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f415d3c0 0x7fa7f40b3ad0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec034040 tx=0x7fa7ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:38.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.732+0000 7fa7ea7fc640 1 -- 172.21.15.60:0/289327957 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec036050 con 0x7fa7f415d3c0 2024-09-12T01:42:38.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.732+0000 7fa7ea7fc640 1 -- 172.21.15.60:0/289327957 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7ec042070 con 0x7fa7f415d3c0 2024-09-12T01:42:38.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.732+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/289327957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f40c9620 con 0x7fa7f415d3c0 2024-09-12T01:42:38.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.732+0000 7fa7ea7fc640 1 -- 172.21.15.60:0/289327957 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec009510 con 0x7fa7f415d3c0 2024-09-12T01:42:38.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.732+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/289327957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f40c9be0 con 0x7fa7f415d3c0 2024-09-12T01:42:38.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.733+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/289327957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f415bc60 con 0x7fa7f415d3c0 2024-09-12T01:42:38.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.733+0000 7fa7ea7fc640 1 -- 172.21.15.60:0/289327957 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa7ec007bf0 con 0x7fa7f415d3c0 2024-09-12T01:42:38.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.734+0000 7fa7ea7fc640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa7d806be30 0x7fa7d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:38.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.734+0000 7fa7ea7fc640 1 -- 172.21.15.60:0/289327957 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5796+0+0 (secure 0 0 0) 0x7fa7ec0abb70 con 0x7fa7f415d3c0 2024-09-12T01:42:38.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.734+0000 7fa7f9980640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa7d806be30 0x7fa7d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:38.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.734+0000 7fa7f9980640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa7d806be30 0x7fa7d806e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0007fd0 tx=0x7fa7f0007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:38.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.738+0000 7fa7ea7fc640 1 -- 172.21.15.60:0/289327957 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa7ec079e60 con 0x7fa7f415d3c0 2024-09-12T01:42:38.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.915+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/289327957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7fa7f4063360 con 0x7fa7f415d3c0 2024-09-12T01:42:38.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.918+0000 7fa7ea7fc640 1 -- 172.21.15.60:0/289327957 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v39)=0 v39) ==== 128+0+0 (secure 0 0 0) 0x7fa7ec07e160 con 0x7fa7f415d3c0 2024-09-12T01:42:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.920+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/289327957 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa7d806be30 msgr2=0x7fa7d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.920+0000 7fa7fbbe4640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa7d806be30 0x7fa7d806e2f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0007fd0 tx=0x7fa7f0007de0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.920+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/289327957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f415d3c0 msgr2=0x7fa7f40b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.920+0000 7fa7fbbe4640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f415d3c0 0x7fa7f40b3ad0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec034040 tx=0x7fa7ec004a40 comp rx=0 tx=0).stop 2024-09-12T01:42:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.920+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/289327957 shutdown_connections 2024-09-12T01:42:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.920+0000 7fa7fbbe4640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7f415d3c0 0x7fa7f40b3ad0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.920+0000 7fa7fbbe4640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa7f415b480 0x7fa7f40b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.920+0000 7fa7fbbe4640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa7d806be30 0x7fa7d806e2f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.920+0000 7fa7fbbe4640 1 --2- 172.21.15.60:0/289327957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa7f4072530 0x7fa7f40cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.920+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/289327957 >> 172.21.15.60:0/289327957 conn(0x7fa7f406d0f0 msgr2=0x7fa7f40d0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.920+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/289327957 shutdown_connections 2024-09-12T01:42:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:38.920+0000 7fa7fbbe4640 1 -- 172.21.15.60:0/289327957 wait complete. 2024-09-12T01:42:38.931 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-12T01:42:39.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.035+0000 7f3b06d91640 1 Processor -- start 2024-09-12T01:42:39.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.035+0000 7f3b06d91640 1 -- start start 2024-09-12T01:42:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b06d91640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b0015e6f0 0x7f3b0006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b06d91640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b000b7450 0x7f3b0015f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b06d91640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b0006e990 con 0x7f3b000b54d0 2024-09-12T01:42:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b06d91640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3b0006ec70 con 0x7f3b0015e6f0 2024-09-12T01:42:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b06d91640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b0015ec70 con 0x7f3b000b7450 2024-09-12T01:42:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b04b2d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b0015e6f0 0x7f3b0006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b04b2d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3b0015e6f0 0x7f3b0006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56200/0 (socket says 172.21.15.60:56200) 2024-09-12T01:42:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b04b2d640 1 -- 172.21.15.60:0/2239765979 learned_addr learned my addr 172.21.15.60:0/2239765979 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:39.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b0532e640 1 --2- 172.21.15.60:0/2239765979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b000b7450 0x7f3b0015f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b04b2d640 1 -- 172.21.15.60:0/2239765979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b000b7450 msgr2=0x7f3b0015f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:39.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b04b2d640 1 --2- 172.21.15.60:0/2239765979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b000b7450 0x7f3b0015f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b04b2d640 1 -- 172.21.15.60:0/2239765979 >> v1:172.21.15.105:6789/0 conn(0x7f3b000b54d0 legacy=0x7f3b000b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:39.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b04b2d640 1 -- 172.21.15.60:0/2239765979 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0015ef50 con 0x7f3b0015e6f0 2024-09-12T01:42:39.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.036+0000 7f3b0532e640 1 --2- 172.21.15.60:0/2239765979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b000b7450 0x7f3b0015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:39.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.037+0000 7f3b04b2d640 1 --2- 172.21.15.60:0/2239765979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b0015e6f0 0x7f3b0006fd00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009e50 tx=0x7f3af802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ea94dbedfdfbc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:39.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.037+0000 7f3aff7fe640 1 -- 172.21.15.60:0/2239765979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8036070 con 0x7f3b0015e6f0 2024-09-12T01:42:39.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.037+0000 7f3aff7fe640 1 -- 172.21.15.60:0/2239765979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af8031600 con 0x7f3b0015e6f0 2024-09-12T01:42:39.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.037+0000 7f3aff7fe640 1 -- 172.21.15.60:0/2239765979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af80319d0 con 0x7f3b0015e6f0 2024-09-12T01:42:39.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.038+0000 7f3b06d91640 1 -- 172.21.15.60:0/2239765979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b0015e6f0 msgr2=0x7f3b0006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.038+0000 7f3b06d91640 1 --2- 172.21.15.60:0/2239765979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b0015e6f0 0x7f3b0006fd00 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009e50 tx=0x7f3af802a6c0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.038+0000 7f3b06d91640 1 -- 172.21.15.60:0/2239765979 shutdown_connections 2024-09-12T01:42:39.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.038+0000 7f3b06d91640 1 --2- 172.21.15.60:0/2239765979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b000b7450 0x7f3b0015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.038+0000 7f3b06d91640 1 --2- 172.21.15.60:0/2239765979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b0015e6f0 0x7f3b0006fd00 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.038+0000 7f3b06d91640 1 -- 172.21.15.60:0/2239765979 >> 172.21.15.60:0/2239765979 conn(0x7f3b000d2430 msgr2=0x7f3b000d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:39.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.038+0000 7f3b06d91640 1 -- 172.21.15.60:0/2239765979 shutdown_connections 2024-09-12T01:42:39.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.038+0000 7f3b06d91640 1 -- 172.21.15.60:0/2239765979 wait complete. 2024-09-12T01:42:39.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.039+0000 7f3b06d91640 1 Processor -- start 2024-09-12T01:42:39.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.039+0000 7f3b06d91640 1 -- start start 2024-09-12T01:42:39.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b06d91640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b000b54d0 0x7f3b00162bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b06d91640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b000b7450 0x7f3b0014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b06d91640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b0015e6f0 0x7f3b00152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b06d91640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0006e730 con 0x7f3b000b54d0 2024-09-12T01:42:39.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b06d91640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0006e5b0 con 0x7f3b000b7450 2024-09-12T01:42:39.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b06d91640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3b00070830 con 0x7f3b0015e6f0 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b04b2d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b000b54d0 0x7f3b00162bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b04b2d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b000b54d0 0x7f3b00162bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56204/0 (socket says 172.21.15.60:56204) 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b04b2d640 1 -- 172.21.15.60:0/3538442756 learned_addr learned my addr 172.21.15.60:0/3538442756 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3afffff640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b000b7450 0x7f3b0014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b0532e640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b0015e6f0 0x7f3b00152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b04b2d640 1 -- 172.21.15.60:0/3538442756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b0015e6f0 msgr2=0x7f3b00152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b04b2d640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b0015e6f0 0x7f3b00152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b04b2d640 1 -- 172.21.15.60:0/3538442756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b000b7450 msgr2=0x7f3b0014ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b04b2d640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b000b7450 0x7f3b0014ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3b04b2d640 1 -- 172.21.15.60:0/3538442756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b0014f1a0 con 0x7f3b000b54d0 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.040+0000 7f3afffff640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b000b7450 0x7f3b0014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.041+0000 7f3b04b2d640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b000b54d0 0x7f3b00162bd0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f3af8034040 tx=0x7f3af8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.041+0000 7f3afd7fa640 1 -- 172.21.15.60:0/3538442756 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8036050 con 0x7f3b000b54d0 2024-09-12T01:42:39.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.041+0000 7f3afd7fa640 1 -- 172.21.15.60:0/3538442756 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af8042070 con 0x7f3b000b54d0 2024-09-12T01:42:39.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.041+0000 7f3b06d91640 1 -- 172.21.15.60:0/3538442756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b00152eb0 con 0x7f3b000b54d0 2024-09-12T01:42:39.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.041+0000 7f3afd7fa640 1 -- 172.21.15.60:0/3538442756 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8009510 con 0x7f3b000b54d0 2024-09-12T01:42:39.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.041+0000 7f3b06d91640 1 -- 172.21.15.60:0/3538442756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b00150920 con 0x7f3b000b54d0 2024-09-12T01:42:39.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.042+0000 7f3b06d91640 1 -- 172.21.15.60:0/3538442756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b0015f750 con 0x7f3b000b54d0 2024-09-12T01:42:39.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.042+0000 7f3afd7fa640 1 -- 172.21.15.60:0/3538442756 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3af8007c50 con 0x7f3b000b54d0 2024-09-12T01:42:39.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.043+0000 7f3afd7fa640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3aec06be30 0x7f3aec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.043+0000 7f3afd7fa640 1 -- 172.21.15.60:0/3538442756 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f3af80abfd0 con 0x7f3b000b54d0 2024-09-12T01:42:39.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.043+0000 7f3afffff640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3aec06be30 0x7f3aec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.043+0000 7f3afffff640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3aec06be30 0x7f3aec06e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3b00150570 tx=0x7f3af4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:39.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.047+0000 7f3afd7fa640 1 -- 172.21.15.60:0/3538442756 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3af8045360 con 0x7f3b000b54d0 2024-09-12T01:42:39.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.224+0000 7f3b06d91640 1 -- 172.21.15.60:0/3538442756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7f3b0006df30 con 0x7f3b000b54d0 2024-09-12T01:42:39.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.225+0000 7f3afd7fa640 1 -- 172.21.15.60:0/3538442756 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v39) ==== 106+0+4 (secure 0 0 0) 0x7f3af807a920 con 0x7f3b000b54d0 2024-09-12T01:42:39.225 INFO:teuthology.orchestra.run.smithi060.stdout:100 2024-09-12T01:42:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.227+0000 7f3b06d91640 1 -- 172.21.15.60:0/3538442756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3aec06be30 msgr2=0x7f3aec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.227+0000 7f3b06d91640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3aec06be30 0x7f3aec06e2f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3b00150570 tx=0x7f3af4009040 comp rx=0 tx=0).stop 2024-09-12T01:42:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.227+0000 7f3b06d91640 1 -- 172.21.15.60:0/3538442756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b000b54d0 msgr2=0x7f3b00162bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.227+0000 7f3b06d91640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b000b54d0 0x7f3b00162bd0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f3af8034040 tx=0x7f3af8004a40 comp rx=0 tx=0).stop 2024-09-12T01:42:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.227+0000 7f3b06d91640 1 -- 172.21.15.60:0/3538442756 shutdown_connections 2024-09-12T01:42:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.227+0000 7f3b06d91640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3aec06be30 0x7f3aec06e2f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.227+0000 7f3b06d91640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3b0015e6f0 0x7f3b00152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.227+0000 7f3b06d91640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3b000b7450 0x7f3b0014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.227+0000 7f3b06d91640 1 --2- 172.21.15.60:0/3538442756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b000b54d0 0x7f3b00162bd0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.227+0000 7f3b06d91640 1 -- 172.21.15.60:0/3538442756 >> 172.21.15.60:0/3538442756 conn(0x7f3b000d2430 msgr2=0x7f3b0006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:39.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.227+0000 7f3b06d91640 1 -- 172.21.15.60:0/3538442756 shutdown_connections 2024-09-12T01:42:39.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.227+0000 7f3b06d91640 1 -- 172.21.15.60:0/3538442756 wait complete. 2024-09-12T01:42:39.238 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 100 2024-09-12T01:42:39.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.343+0000 7f024bfb9640 1 Processor -- start 2024-09-12T01:42:39.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.343+0000 7f024bfb9640 1 -- start start 2024-09-12T01:42:39.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f024bfb9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f024415e7a0 0x7f024406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f024bfb9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02440cf1f0 0x7f02440b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f024bfb9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02440cf860 con 0x7f02440b6720 2024-09-12T01:42:39.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f024bfb9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f02440d2ca0 con 0x7f024415e7a0 2024-09-12T01:42:39.344 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f024bfb9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02440cfb40 con 0x7f02440cf1f0 2024-09-12T01:42:39.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f024a556640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f02440b6720 0x7f02441623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51584/0 (socket says 172.21.15.60:51584) 2024-09-12T01:42:39.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f024a556640 1 -- 172.21.15.60:0/4256596920 learned_addr learned my addr 172.21.15.60:0/4256596920 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:39.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f0249554640 1 --2- 172.21.15.60:0/4256596920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02440cf1f0 0x7f02440b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f0249d55640 1 --2- 172.21.15.60:0/4256596920 >> v2:172.21.15.105:3300/0 conn(0x7f024415e7a0 0x7f024406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f0248d53640 1 -- 172.21.15.60:0/4256596920 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258698723 0 0) 0x7f02440cf860 con 0x7f02440b6720 2024-09-12T01:42:39.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f0248d53640 1 -- 172.21.15.60:0/4256596920 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f022c003520 con 0x7f02440b6720 2024-09-12T01:42:39.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f0249554640 1 -- 172.21.15.60:0/4256596920 >> v2:172.21.15.105:3300/0 conn(0x7f024415e7a0 msgr2=0x7f024406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:39.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f0249554640 1 --2- 172.21.15.60:0/4256596920 >> v2:172.21.15.105:3300/0 conn(0x7f024415e7a0 0x7f024406caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f0249554640 1 -- 172.21.15.60:0/4256596920 >> v1:172.21.15.60:6789/0 conn(0x7f02440b6720 legacy=0x7f02441623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f0249554640 1 -- 172.21.15.60:0/4256596920 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02440cfe20 con 0x7f02440cf1f0 2024-09-12T01:42:39.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.344+0000 7f0249d55640 1 --2- 172.21.15.60:0/4256596920 >> v2:172.21.15.105:3300/0 conn(0x7f024415e7a0 0x7f024406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:39.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.345+0000 7f0249554640 1 --2- 172.21.15.60:0/4256596920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02440cf1f0 0x7f02440b61e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f02380097a0 tx=0x7f023802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa0fc8365c09a32 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:39.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.345+0000 7f0248d53640 1 -- 172.21.15.60:0/4256596920 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238037070 con 0x7f02440cf1f0 2024-09-12T01:42:39.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.345+0000 7f0248d53640 1 -- 172.21.15.60:0/4256596920 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023802ae50 con 0x7f02440cf1f0 2024-09-12T01:42:39.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.345+0000 7f0248d53640 1 -- 172.21.15.60:0/4256596920 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238032640 con 0x7f02440cf1f0 2024-09-12T01:42:39.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.346+0000 7f024bfb9640 1 -- 172.21.15.60:0/4256596920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02440cf1f0 msgr2=0x7f02440b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.346+0000 7f024bfb9640 1 --2- 172.21.15.60:0/4256596920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02440cf1f0 0x7f02440b61e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f02380097a0 tx=0x7f023802a100 comp rx=0 tx=0).stop 2024-09-12T01:42:39.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.346+0000 7f024bfb9640 1 -- 172.21.15.60:0/4256596920 shutdown_connections 2024-09-12T01:42:39.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.346+0000 7f024bfb9640 1 --2- 172.21.15.60:0/4256596920 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02440cf1f0 0x7f02440b61e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.346+0000 7f024bfb9640 1 --2- 172.21.15.60:0/4256596920 >> v2:172.21.15.105:3300/0 conn(0x7f024415e7a0 0x7f024406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.346+0000 7f024bfb9640 1 -- 172.21.15.60:0/4256596920 >> 172.21.15.60:0/4256596920 conn(0x7f02440d11e0 msgr2=0x7f02440d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:39.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.346+0000 7f024bfb9640 1 -- 172.21.15.60:0/4256596920 shutdown_connections 2024-09-12T01:42:39.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.346+0000 7f024bfb9640 1 -- 172.21.15.60:0/4256596920 wait complete. 2024-09-12T01:42:39.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.347+0000 7f024bfb9640 1 Processor -- start 2024-09-12T01:42:39.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.347+0000 7f024bfb9640 1 -- start start 2024-09-12T01:42:39.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f024bfb9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02440b6720 0x7f02440ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f024bfb9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02440cf1f0 0x7f02440c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f024bfb9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f024415e7a0 0x7f02440c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f024bfb9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f024406cfe0 con 0x7f02440cf1f0 2024-09-12T01:42:39.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f024bfb9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f02440b7a00 con 0x7f024415e7a0 2024-09-12T01:42:39.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f024bfb9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02440d4420 con 0x7f02440b6720 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f0249554640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02440cf1f0 0x7f02440c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f0249554640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02440cf1f0 0x7f02440c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56206/0 (socket says 172.21.15.60:56206) 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f0249554640 1 -- 172.21.15.60:0/3118879478 learned_addr learned my addr 172.21.15.60:0/3118879478 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f024a556640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f024415e7a0 0x7f02440c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f0249d55640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02440b6720 0x7f02440ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f0249554640 1 -- 172.21.15.60:0/3118879478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02440b6720 msgr2=0x7f02440ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f0249554640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02440b6720 0x7f02440ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f0249554640 1 -- 172.21.15.60:0/3118879478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f024415e7a0 msgr2=0x7f02440c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f0249554640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f024415e7a0 0x7f02440c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f0249554640 1 -- 172.21.15.60:0/3118879478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024414fb20 con 0x7f02440cf1f0 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f0249d55640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02440b6720 0x7f02440ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.348+0000 7f0249554640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02440cf1f0 0x7f02440c7fe0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f02380097a0 tx=0x7f02380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:39.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.349+0000 7f02427fc640 1 -- 172.21.15.60:0/3118879478 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238042070 con 0x7f02440cf1f0 2024-09-12T01:42:39.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.349+0000 7f02427fc640 1 -- 172.21.15.60:0/3118879478 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023803e460 con 0x7f02440cf1f0 2024-09-12T01:42:39.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.349+0000 7f02427fc640 1 -- 172.21.15.60:0/3118879478 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238037040 con 0x7f02440cf1f0 2024-09-12T01:42:39.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.349+0000 7f024bfb9640 1 -- 172.21.15.60:0/3118879478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02440cace0 con 0x7f02440cf1f0 2024-09-12T01:42:39.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.349+0000 7f024bfb9640 1 -- 172.21.15.60:0/3118879478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024415f460 con 0x7f02440cf1f0 2024-09-12T01:42:39.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.350+0000 7f024bfb9640 1 -- 172.21.15.60:0/3118879478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f024415eb80 con 0x7f02440cf1f0 2024-09-12T01:42:39.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.350+0000 7f02427fc640 1 -- 172.21.15.60:0/3118879478 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0238045070 con 0x7f02440cf1f0 2024-09-12T01:42:39.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.351+0000 7f02427fc640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f023006be30 0x7f023006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.351+0000 7f02427fc640 1 -- 172.21.15.60:0/3118879478 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f02380ab550 con 0x7f02440cf1f0 2024-09-12T01:42:39.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.351+0000 7f0249d55640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f023006be30 0x7f023006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.351+0000 7f0249d55640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f023006be30 0x7f023006e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0234007520 tx=0x7f023400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:39.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.355+0000 7f02427fc640 1 -- 172.21.15.60:0/3118879478 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f02380797b0 con 0x7f02440cf1f0 2024-09-12T01:42:39.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.528+0000 7f024bfb9640 1 -- 172.21.15.60:0/3118879478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7f02440d2a80 con 0x7f02440cf1f0 2024-09-12T01:42:39.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.532+0000 7f02427fc640 1 -- 172.21.15.60:0/3118879478 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v40)=0 v40) ==== 124+0+0 (secure 0 0 0) 0x7f023807dab0 con 0x7f02440cf1f0 2024-09-12T01:42:39.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.534+0000 7f024bfb9640 1 -- 172.21.15.60:0/3118879478 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f023006be30 msgr2=0x7f023006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.534+0000 7f024bfb9640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f023006be30 0x7f023006e2f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0234007520 tx=0x7f023400b040 comp rx=0 tx=0).stop 2024-09-12T01:42:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.534+0000 7f024bfb9640 1 -- 172.21.15.60:0/3118879478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02440cf1f0 msgr2=0x7f02440c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.534+0000 7f024bfb9640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02440cf1f0 0x7f02440c7fe0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f02380097a0 tx=0x7f02380046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.534+0000 7f024bfb9640 1 -- 172.21.15.60:0/3118879478 shutdown_connections 2024-09-12T01:42:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.534+0000 7f024bfb9640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f024415e7a0 0x7f02440c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.534+0000 7f024bfb9640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02440cf1f0 0x7f02440c7fe0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.534+0000 7f024bfb9640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f023006be30 0x7f023006e2f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.534+0000 7f024bfb9640 1 --2- 172.21.15.60:0/3118879478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f02440b6720 0x7f02440ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.534+0000 7f024bfb9640 1 -- 172.21.15.60:0/3118879478 >> 172.21.15.60:0/3118879478 conn(0x7f02440d11e0 msgr2=0x7f024415cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.534+0000 7f024bfb9640 1 -- 172.21.15.60:0/3118879478 shutdown_connections 2024-09-12T01:42:39.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.534+0000 7f024bfb9640 1 -- 172.21.15.60:0/3118879478 wait complete. 2024-09-12T01:42:39.545 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_max_caps_per_client 2024-09-12T01:42:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.650+0000 7fd90d79f640 1 Processor -- start 2024-09-12T01:42:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.650+0000 7fd90d79f640 1 -- start start 2024-09-12T01:42:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90d79f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd90815adf0 0x7fd9080b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90d79f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd90815b1d0 0x7fd9080b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90d79f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd9080b22b0 0x7fd90815ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90d79f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd9080b44f0 con 0x7fd9080b22b0 2024-09-12T01:42:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90d79f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd9080b47d0 con 0x7fd90815adf0 2024-09-12T01:42:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90d79f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9080b4ab0 con 0x7fd90815b1d0 2024-09-12T01:42:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90cf9e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd9080b22b0 0x7fd90815ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90cf9e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd9080b22b0 0x7fd90815ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56222/0 (socket says 172.21.15.60:56222) 2024-09-12T01:42:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90cf9e640 1 -- 172.21.15.60:0/3738850272 learned_addr learned my addr 172.21.15.60:0/3738850272 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd907fff640 1 --2- 172.21.15.60:0/3738850272 >> v2:172.21.15.105:3300/0 conn(0x7fd90815adf0 0x7fd9080b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd9077fe640 1 --2- 172.21.15.60:0/3738850272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd90815b1d0 0x7fd9080b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90cf9e640 1 -- 172.21.15.60:0/3738850272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd90815b1d0 msgr2=0x7fd9080b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90cf9e640 1 --2- 172.21.15.60:0/3738850272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd90815b1d0 0x7fd9080b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90cf9e640 1 -- 172.21.15.60:0/3738850272 >> v2:172.21.15.105:3300/0 conn(0x7fd90815adf0 msgr2=0x7fd9080b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90cf9e640 1 --2- 172.21.15.60:0/3738850272 >> v2:172.21.15.105:3300/0 conn(0x7fd90815adf0 0x7fd9080b3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.651+0000 7fd90cf9e640 1 -- 172.21.15.60:0/3738850272 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9080b4d90 con 0x7fd9080b22b0 2024-09-12T01:42:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.652+0000 7fd90cf9e640 1 --2- 172.21.15.60:0/3738850272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9080b22b0 0x7fd90815ec80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fd90806ef70 tx=0x7fd90002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43c6972836ed8aa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.652+0000 7fd906ffd640 1 -- 172.21.15.60:0/3738850272 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd900036070 con 0x7fd9080b22b0 2024-09-12T01:42:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.652+0000 7fd906ffd640 1 -- 172.21.15.60:0/3738850272 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd900031600 con 0x7fd9080b22b0 2024-09-12T01:42:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.652+0000 7fd906ffd640 1 -- 172.21.15.60:0/3738850272 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9000319d0 con 0x7fd9080b22b0 2024-09-12T01:42:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.653+0000 7fd90d79f640 1 -- 172.21.15.60:0/3738850272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9080b22b0 msgr2=0x7fd90815ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.653+0000 7fd90d79f640 1 --2- 172.21.15.60:0/3738850272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9080b22b0 0x7fd90815ec80 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fd90806ef70 tx=0x7fd90002a730 comp rx=0 tx=0).stop 2024-09-12T01:42:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.653+0000 7fd90d79f640 1 -- 172.21.15.60:0/3738850272 shutdown_connections 2024-09-12T01:42:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.653+0000 7fd90d79f640 1 --2- 172.21.15.60:0/3738850272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9080b22b0 0x7fd90815ec80 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.653+0000 7fd90d79f640 1 --2- 172.21.15.60:0/3738850272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd90815b1d0 0x7fd9080b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.653+0000 7fd90d79f640 1 --2- 172.21.15.60:0/3738850272 >> v2:172.21.15.105:3300/0 conn(0x7fd90815adf0 0x7fd9080b3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.653+0000 7fd90d79f640 1 -- 172.21.15.60:0/3738850272 >> 172.21.15.60:0/3738850272 conn(0x7fd908062a20 msgr2=0x7fd90806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:39.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.653+0000 7fd90d79f640 1 -- 172.21.15.60:0/3738850272 shutdown_connections 2024-09-12T01:42:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.653+0000 7fd90d79f640 1 -- 172.21.15.60:0/3738850272 wait complete. 2024-09-12T01:42:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.654+0000 7fd90d79f640 1 Processor -- start 2024-09-12T01:42:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.654+0000 7fd90d79f640 1 -- start start 2024-09-12T01:42:39.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.655+0000 7fd90d79f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9080b22b0 0x7fd9081f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.655+0000 7fd90d79f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd90815adf0 0x7fd90815b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.655+0000 7fd90d79f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd90815b1d0 0x7fd90815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.655+0000 7fd90d79f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd9080b4030 con 0x7fd90815adf0 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.655+0000 7fd90d79f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd9080b5570 con 0x7fd90815b1d0 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.655+0000 7fd90d79f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd9080ce050 con 0x7fd9080b22b0 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.655+0000 7fd9077fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd90815adf0 0x7fd90815b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.655+0000 7fd9077fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd90815adf0 0x7fd90815b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56236/0 (socket says 172.21.15.60:56236) 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.655+0000 7fd9077fe640 1 -- 172.21.15.60:0/2891122348 learned_addr learned my addr 172.21.15.60:0/2891122348 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.655+0000 7fd90cf9e640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd90815b1d0 0x7fd90815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.655+0000 7fd907fff640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9080b22b0 0x7fd9081f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.656+0000 7fd9077fe640 1 -- 172.21.15.60:0/2891122348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9080b22b0 msgr2=0x7fd9081f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.656+0000 7fd9077fe640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9080b22b0 0x7fd9081f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.656+0000 7fd9077fe640 1 -- 172.21.15.60:0/2891122348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd90815b1d0 msgr2=0x7fd90815bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.656+0000 7fd9077fe640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd90815b1d0 0x7fd90815bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.656+0000 7fd9077fe640 1 -- 172.21.15.60:0/2891122348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90815d500 con 0x7fd90815adf0 2024-09-12T01:42:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.656+0000 7fd9077fe640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd90815adf0 0x7fd90815b690 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00d5f0 tx=0x7fd8fc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.656+0000 7fd904ff9640 1 -- 172.21.15.60:0/2891122348 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0125f0 con 0x7fd90815adf0 2024-09-12T01:42:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.656+0000 7fd904ff9640 1 -- 172.21.15.60:0/2891122348 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8fc019070 con 0x7fd90815adf0 2024-09-12T01:42:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.656+0000 7fd90d79f640 1 -- 172.21.15.60:0/2891122348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90815d780 con 0x7fd90815adf0 2024-09-12T01:42:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.656+0000 7fd904ff9640 1 -- 172.21.15.60:0/2891122348 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0129d0 con 0x7fd90815adf0 2024-09-12T01:42:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.656+0000 7fd90d79f640 1 -- 172.21.15.60:0/2891122348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd90815dd40 con 0x7fd90815adf0 2024-09-12T01:42:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.657+0000 7fd90d79f640 1 -- 172.21.15.60:0/2891122348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9080b3af0 con 0x7fd90815adf0 2024-09-12T01:42:39.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.658+0000 7fd904ff9640 1 -- 172.21.15.60:0/2891122348 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8fc012b70 con 0x7fd90815adf0 2024-09-12T01:42:39.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.658+0000 7fd904ff9640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8f406be30 0x7fd8f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.658+0000 7fd904ff9640 1 -- 172.21.15.60:0/2891122348 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7fd8fc08b1c0 con 0x7fd90815adf0 2024-09-12T01:42:39.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.658+0000 7fd907fff640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8f406be30 0x7fd8f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.659+0000 7fd907fff640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8f406be30 0x7fd8f406e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8006fd0 tx=0x7fd8f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.663+0000 7fd904ff9640 1 -- 172.21.15.60:0/2891122348 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd90815d500 con 0x7fd90815adf0 2024-09-12T01:42:39.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.841+0000 7fd90d79f640 1 -- 172.21.15.60:0/2891122348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"} v 0) -- 0x7fd9080b2090 con 0x7fd90815adf0 2024-09-12T01:42:39.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.841+0000 7fd904ff9640 1 -- 172.21.15.60:0/2891122348 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"}]=0 v40) ==== 106+0+8 (secure 0 0 0) 0x7fd8fc0594c0 con 0x7fd90815adf0 2024-09-12T01:42:39.842 INFO:teuthology.orchestra.run.smithi060.stdout:1048576 2024-09-12T01:42:39.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.843+0000 7fd90d79f640 1 -- 172.21.15.60:0/2891122348 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8f406be30 msgr2=0x7fd8f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.843+0000 7fd90d79f640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8f406be30 0x7fd8f406e2f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8006fd0 tx=0x7fd8f8008040 comp rx=0 tx=0).stop 2024-09-12T01:42:39.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.843+0000 7fd90d79f640 1 -- 172.21.15.60:0/2891122348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd90815adf0 msgr2=0x7fd90815b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.843+0000 7fd90d79f640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd90815adf0 0x7fd90815b690 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00d5f0 tx=0x7fd8fc00dab0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.843+0000 7fd90d79f640 1 -- 172.21.15.60:0/2891122348 shutdown_connections 2024-09-12T01:42:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.844+0000 7fd90d79f640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd90815b1d0 0x7fd90815bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.844+0000 7fd90d79f640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd90815adf0 0x7fd90815b690 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.844+0000 7fd90d79f640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8f406be30 0x7fd8f406e2f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.844+0000 7fd90d79f640 1 --2- 172.21.15.60:0/2891122348 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd9080b22b0 0x7fd9081f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.844+0000 7fd90d79f640 1 -- 172.21.15.60:0/2891122348 >> 172.21.15.60:0/2891122348 conn(0x7fd908062a20 msgr2=0x7fd908158350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.844+0000 7fd90d79f640 1 -- 172.21.15.60:0/2891122348 shutdown_connections 2024-09-12T01:42:39.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.844+0000 7fd90d79f640 1 -- 172.21.15.60:0/2891122348 wait complete. 2024-09-12T01:42:39.855 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-09-12T01:42:39.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.960+0000 7f39e2e5a640 1 Processor -- start 2024-09-12T01:42:39.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.960+0000 7f39e2e5a640 1 -- start start 2024-09-12T01:42:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39e2e5a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39dc0b6290 0x7f39dc071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39e2e5a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39dc072530 0x7f39dc15bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39e2e5a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39dc0ccff0 con 0x7f39dc15b480 2024-09-12T01:42:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39e2e5a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f39dc0cd2d0 con 0x7f39dc072530 2024-09-12T01:42:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39e2e5a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39dc0cd5b0 con 0x7f39dc0b6290 2024-09-12T01:42:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39e13f7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39dc072530 0x7f39dc15bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39e13f7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39dc072530 0x7f39dc15bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56240/0 (socket says 172.21.15.60:56240) 2024-09-12T01:42:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39e13f7640 1 -- 172.21.15.60:0/2379804338 learned_addr learned my addr 172.21.15.60:0/2379804338 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39d3fff640 1 --2- 172.21.15.60:0/2379804338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39dc0b6290 0x7f39dc071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39e13f7640 1 -- 172.21.15.60:0/2379804338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39dc0b6290 msgr2=0x7f39dc071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39e13f7640 1 --2- 172.21.15.60:0/2379804338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39dc0b6290 0x7f39dc071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39e13f7640 1 -- 172.21.15.60:0/2379804338 >> v1:172.21.15.105:6789/0 conn(0x7f39dc15b480 legacy=0x7f39dc0b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.961+0000 7f39e13f7640 1 -- 172.21.15.60:0/2379804338 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39dc0cd890 con 0x7f39dc072530 2024-09-12T01:42:39.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.962+0000 7f39e13f7640 1 --2- 172.21.15.60:0/2379804338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc072530 0x7f39dc15bc60 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009e50 tx=0x7f39d402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a6ea81e4425e77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:39.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.962+0000 7f39d37fe640 1 -- 172.21.15.60:0/2379804338 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d4036070 con 0x7f39dc072530 2024-09-12T01:42:39.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.962+0000 7f39d37fe640 1 -- 172.21.15.60:0/2379804338 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d4031600 con 0x7f39dc072530 2024-09-12T01:42:39.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.962+0000 7f39d37fe640 1 -- 172.21.15.60:0/2379804338 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d40319d0 con 0x7f39dc072530 2024-09-12T01:42:39.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.963+0000 7f39e2e5a640 1 -- 172.21.15.60:0/2379804338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc072530 msgr2=0x7f39dc15bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.963+0000 7f39e2e5a640 1 --2- 172.21.15.60:0/2379804338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc072530 0x7f39dc15bc60 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f39d4009e50 tx=0x7f39d402a680 comp rx=0 tx=0).stop 2024-09-12T01:42:39.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.963+0000 7f39e2e5a640 1 -- 172.21.15.60:0/2379804338 shutdown_connections 2024-09-12T01:42:39.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.963+0000 7f39e2e5a640 1 --2- 172.21.15.60:0/2379804338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc072530 0x7f39dc15bc60 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.963+0000 7f39e2e5a640 1 --2- 172.21.15.60:0/2379804338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39dc0b6290 0x7f39dc071ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.963+0000 7f39e2e5a640 1 -- 172.21.15.60:0/2379804338 >> 172.21.15.60:0/2379804338 conn(0x7f39dc06d0f0 msgr2=0x7f39dc06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:39.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.963+0000 7f39e2e5a640 1 -- 172.21.15.60:0/2379804338 shutdown_connections 2024-09-12T01:42:39.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.963+0000 7f39e2e5a640 1 -- 172.21.15.60:0/2379804338 wait complete. 2024-09-12T01:42:39.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.964+0000 7f39e2e5a640 1 Processor -- start 2024-09-12T01:42:39.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.964+0000 7f39e2e5a640 1 -- start start 2024-09-12T01:42:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.965+0000 7f39e2e5a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc072530 0x7f39dc148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.965+0000 7f39e2e5a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39dc15b480 0x7f39dc159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.965+0000 7f39e2e5a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39dc1f2830 0x7f39dc15a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.965+0000 7f39e2e5a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc15b9e0 con 0x7f39dc072530 2024-09-12T01:42:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.965+0000 7f39e2e5a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39dc15b860 con 0x7f39dc1f2830 2024-09-12T01:42:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.965+0000 7f39e2e5a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39dc15c1a0 con 0x7f39dc15b480 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.965+0000 7f39e0bf6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc072530 0x7f39dc148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.965+0000 7f39e0bf6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc072530 0x7f39dc148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56246/0 (socket says 172.21.15.60:56246) 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.965+0000 7f39e0bf6640 1 -- 172.21.15.60:0/566869568 learned_addr learned my addr 172.21.15.60:0/566869568 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.965+0000 7f39d3fff640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39dc15b480 0x7f39dc159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.965+0000 7f39e13f7640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39dc1f2830 0x7f39dc15a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.966+0000 7f39e0bf6640 1 -- 172.21.15.60:0/566869568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39dc15b480 msgr2=0x7f39dc159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.966+0000 7f39e0bf6640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39dc15b480 0x7f39dc159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.966+0000 7f39e0bf6640 1 -- 172.21.15.60:0/566869568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39dc1f2830 msgr2=0x7f39dc15a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.966+0000 7f39e0bf6640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39dc1f2830 0x7f39dc15a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.966+0000 7f39e0bf6640 1 -- 172.21.15.60:0/566869568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39dc1547a0 con 0x7f39dc072530 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.966+0000 7f39e0bf6640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc072530 0x7f39dc148030 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f39d800c3c0 tx=0x7f39d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.966+0000 7f39d17fa640 1 -- 172.21.15.60:0/566869568 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d80052d0 con 0x7f39dc072530 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.966+0000 7f39d17fa640 1 -- 172.21.15.60:0/566869568 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d8005490 con 0x7f39dc072530 2024-09-12T01:42:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.966+0000 7f39d17fa640 1 -- 172.21.15.60:0/566869568 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39d8007260 con 0x7f39dc072530 2024-09-12T01:42:39.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.966+0000 7f39e2e5a640 1 -- 172.21.15.60:0/566869568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39dc155480 con 0x7f39dc072530 2024-09-12T01:42:39.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.966+0000 7f39e2e5a640 1 -- 172.21.15.60:0/566869568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39dc155a40 con 0x7f39dc072530 2024-09-12T01:42:39.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.967+0000 7f39e2e5a640 1 -- 172.21.15.60:0/566869568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39dc076170 con 0x7f39dc072530 2024-09-12T01:42:39.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.967+0000 7f39d17fa640 1 -- 172.21.15.60:0/566869568 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39d8007400 con 0x7f39dc072530 2024-09-12T01:42:39.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.968+0000 7f39d17fa640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39c806be30 0x7f39c806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:39.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.968+0000 7f39d17fa640 1 -- 172.21.15.60:0/566869568 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f39d808a260 con 0x7f39dc072530 2024-09-12T01:42:39.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.968+0000 7f39d3fff640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39c806be30 0x7f39c806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:39.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.968+0000 7f39d3fff640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39c806be30 0x7f39c806e2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f39dc150450 tx=0x7f39cc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:39.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:39.972+0000 7f39d17fa640 1 -- 172.21.15.60:0/566869568 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39dc076170 con 0x7f39dc072530 2024-09-12T01:42:40.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.151+0000 7f39e2e5a640 1 -- 172.21.15.60:0/566869568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7f39dc15bc60 con 0x7f39dc072530 2024-09-12T01:42:40.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.152+0000 7f39d17fa640 1 -- 172.21.15.60:0/566869568 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v40) ==== 112+0+10 (secure 0 0 0) 0x7f39d80585f0 con 0x7f39dc072530 2024-09-12T01:42:40.153 INFO:teuthology.orchestra.run.smithi060.stdout:60.000000 2024-09-12T01:42:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.154+0000 7f39e2e5a640 1 -- 172.21.15.60:0/566869568 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39c806be30 msgr2=0x7f39c806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.154+0000 7f39e2e5a640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39c806be30 0x7f39c806e2f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f39dc150450 tx=0x7f39cc009190 comp rx=0 tx=0).stop 2024-09-12T01:42:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.154+0000 7f39e2e5a640 1 -- 172.21.15.60:0/566869568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc072530 msgr2=0x7f39dc148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.154+0000 7f39e2e5a640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc072530 0x7f39dc148030 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f39d800c3c0 tx=0x7f39d800c880 comp rx=0 tx=0).stop 2024-09-12T01:42:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.154+0000 7f39e2e5a640 1 -- 172.21.15.60:0/566869568 shutdown_connections 2024-09-12T01:42:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.154+0000 7f39e2e5a640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39dc1f2830 0x7f39dc15a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.154+0000 7f39e2e5a640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39c806be30 0x7f39c806e2f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.154+0000 7f39e2e5a640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39dc15b480 0x7f39dc159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.154+0000 7f39e2e5a640 1 --2- 172.21.15.60:0/566869568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39dc072530 0x7f39dc148030 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.154+0000 7f39e2e5a640 1 -- 172.21.15.60:0/566869568 >> 172.21.15.60:0/566869568 conn(0x7f39dc06d0f0 msgr2=0x7f39dc0d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:40.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.154+0000 7f39e2e5a640 1 -- 172.21.15.60:0/566869568 shutdown_connections 2024-09-12T01:42:40.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.154+0000 7f39e2e5a640 1 -- 172.21.15.60:0/566869568 wait complete. 2024-09-12T01:42:40.166 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:42:40.166 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:40.182 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:42:40.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:42:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:42:40.281 INFO:teuthology.orchestra.run.smithi060.stdout:client7263 2024-09-12T01:42:40.281 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:42:40.282 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:40.299 DEBUG:teuthology.orchestra.run.smithi060:> stdin-killer -- python3 -c ' 2024-09-12T01:42:40.299 DEBUG:teuthology.orchestra.run.smithi060:> import fcntl 2024-09-12T01:42:40.299 DEBUG:teuthology.orchestra.run.smithi060:> import sys 2024-09-12T01:42:40.299 DEBUG:teuthology.orchestra.run.smithi060:> import time 2024-09-12T01:42:40.299 DEBUG:teuthology.orchestra.run.smithi060:> import os 2024-09-12T01:42:40.299 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:42:40.299 DEBUG:teuthology.orchestra.run.smithi060:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-12T01:42:40.299 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:42:40.299 DEBUG:teuthology.orchestra.run.smithi060:> n = 800 2024-09-12T01:42:40.299 DEBUG:teuthology.orchestra.run.smithi060:> abs_path = "/home/ubuntu/cephtest/mnt.0/subdir" 2024-09-12T01:42:40.299 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> if not os.path.exists(abs_path): 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> os.makedirs(abs_path) 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> handles = [] 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> for i in range(0, n): 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> fname = "file_"+str(i) 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> path = os.path.join(abs_path, fname) 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> handles.append(open(path, '"'"'w'"'"')) 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> print("waiting with handles open", file=sys.stderr) 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> while True: 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> print("open_n_background: keeping files open", file=sys.stderr) 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> try: 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> if os.read(0, 4096) == b"": 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> break 2024-09-12T01:42:40.300 DEBUG:teuthology.orchestra.run.smithi060:> except BlockingIOError: 2024-09-12T01:42:40.301 DEBUG:teuthology.orchestra.run.smithi060:> pass 2024-09-12T01:42:40.301 DEBUG:teuthology.orchestra.run.smithi060:> time.sleep(2) 2024-09-12T01:42:40.301 DEBUG:teuthology.orchestra.run.smithi060:> print("stdin closed, goodbye!", file=sys.stderr) 2024-09-12T01:42:40.301 DEBUG:teuthology.orchestra.run.smithi060:> ' 2024-09-12T01:42:40.342 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.443+0000 7f0f288a5640 1 Processor -- start 2024-09-12T01:42:40.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.443+0000 7f0f288a5640 1 -- start start 2024-09-12T01:42:40.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.444+0000 7f0f288a5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f2415b460 0x7f0f240b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:40.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.444+0000 7f0f288a5640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0f2406d430 0x7f0f240b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:40.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.444+0000 7f0f288a5640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f240b49f0 con 0x7f0f240d0fe0 2024-09-12T01:42:40.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.444+0000 7f0f288a5640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0f2415eee0 con 0x7f0f2406d430 2024-09-12T01:42:40.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.444+0000 7f0f288a5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0f2415f130 con 0x7f0f2415b460 2024-09-12T01:42:40.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.445+0000 7f0f21d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0f240d0fe0 0x7f0f2406cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51594/0 (socket says 172.21.15.60:51594) 2024-09-12T01:42:40.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.445+0000 7f0f21d9b640 1 -- 172.21.15.60:0/4286417133 learned_addr learned my addr 172.21.15.60:0/4286417133 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:40.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.445+0000 7f0f22d9d640 1 --2- 172.21.15.60:0/4286417133 >> v2:172.21.15.105:3300/0 conn(0x7f0f2406d430 0x7f0f240b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:40.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.445+0000 7f0f2259c640 1 --2- 172.21.15.60:0/4286417133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f2415b460 0x7f0f240b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:40.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.445+0000 7f0f2159a640 1 -- 172.21.15.60:0/4286417133 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440228492 0 0) 0x7f0f240b49f0 con 0x7f0f240d0fe0 2024-09-12T01:42:40.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.445+0000 7f0f2159a640 1 -- 172.21.15.60:0/4286417133 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f0c003520 con 0x7f0f240d0fe0 2024-09-12T01:42:40.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.445+0000 7f0f22d9d640 1 -- 172.21.15.60:0/4286417133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f2415b460 msgr2=0x7f0f240b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:40.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.445+0000 7f0f22d9d640 1 --2- 172.21.15.60:0/4286417133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f2415b460 0x7f0f240b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.445+0000 7f0f22d9d640 1 -- 172.21.15.60:0/4286417133 >> v1:172.21.15.60:6789/0 conn(0x7f0f240d0fe0 legacy=0x7f0f2406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:40.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.445+0000 7f0f2159a640 1 -- 172.21.15.60:0/4286417133 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3185548714 0 0) 0x7f0f0c003520 con 0x7f0f240d0fe0 2024-09-12T01:42:40.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.445+0000 7f0f22d9d640 1 -- 172.21.15.60:0/4286417133 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2415f410 con 0x7f0f2406d430 2024-09-12T01:42:40.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.445+0000 7f0f2259c640 1 --2- 172.21.15.60:0/4286417133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f2415b460 0x7f0f240b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.446+0000 7f0f22d9d640 1 --2- 172.21.15.60:0/4286417133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f2406d430 0x7f0f240b5080 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009d90 tx=0x7f0f1c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dbc91b7171572e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.446+0000 7f0f2159a640 1 -- 172.21.15.60:0/4286417133 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18001670 con 0x7f0f2406d430 2024-09-12T01:42:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.446+0000 7f0f2159a640 1 -- 172.21.15.60:0/4286417133 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1c007540 con 0x7f0f2406d430 2024-09-12T01:42:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.446+0000 7f0f2159a640 1 -- 172.21.15.60:0/4286417133 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c0078f0 con 0x7f0f2406d430 2024-09-12T01:42:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.447+0000 7f0f288a5640 1 -- 172.21.15.60:0/4286417133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f2406d430 msgr2=0x7f0f240b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.447+0000 7f0f288a5640 1 --2- 172.21.15.60:0/4286417133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f2406d430 0x7f0f240b5080 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009d90 tx=0x7f0f1c02a5f0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.447+0000 7f0f288a5640 1 -- 172.21.15.60:0/4286417133 shutdown_connections 2024-09-12T01:42:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.447+0000 7f0f288a5640 1 --2- 172.21.15.60:0/4286417133 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f2406d430 0x7f0f240b5080 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.447+0000 7f0f288a5640 1 --2- 172.21.15.60:0/4286417133 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f2415b460 0x7f0f240b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.447+0000 7f0f288a5640 1 -- 172.21.15.60:0/4286417133 >> 172.21.15.60:0/4286417133 conn(0x7f0f240b6ec0 msgr2=0x7f0f240b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.447+0000 7f0f288a5640 1 -- 172.21.15.60:0/4286417133 shutdown_connections 2024-09-12T01:42:40.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.447+0000 7f0f288a5640 1 -- 172.21.15.60:0/4286417133 wait complete. 2024-09-12T01:42:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.448+0000 7f0f288a5640 1 Processor -- start 2024-09-12T01:42:40.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.448+0000 7f0f288a5640 1 -- start start 2024-09-12T01:42:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.449+0000 7f0f288a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f2406d430 0x7f0f241f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:40.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.449+0000 7f0f288a5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f240d0fe0 0x7f0f24157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.449+0000 7f0f288a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f2415b460 0x7f0f240cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.449+0000 7f0f288a5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0f240b55c0 con 0x7f0f2415b460 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.449+0000 7f0f288a5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2415f9d0 con 0x7f0f2406d430 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.449+0000 7f0f288a5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0f240b5740 con 0x7f0f240d0fe0 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.449+0000 7f0f22d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f2415b460 0x7f0f240cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.449+0000 7f0f22d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f2415b460 0x7f0f240cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56262/0 (socket says 172.21.15.60:56262) 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.449+0000 7f0f22d9d640 1 -- 172.21.15.60:0/1617249402 learned_addr learned my addr 172.21.15.60:0/1617249402 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.449+0000 7f0f21d9b640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f240d0fe0 0x7f0f24157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.449+0000 7f0f2259c640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f2406d430 0x7f0f241f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.450+0000 7f0f22d9d640 1 -- 172.21.15.60:0/1617249402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f240d0fe0 msgr2=0x7f0f24157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.450+0000 7f0f22d9d640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f240d0fe0 0x7f0f24157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.450+0000 7f0f22d9d640 1 -- 172.21.15.60:0/1617249402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f2406d430 msgr2=0x7f0f241f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:40.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.450+0000 7f0f22d9d640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f2406d430 0x7f0f241f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.450+0000 7f0f22d9d640 1 -- 172.21.15.60:0/1617249402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f240ca900 con 0x7f0f2415b460 2024-09-12T01:42:40.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.450+0000 7f0f22d9d640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f2415b460 0x7f0f240cc270 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c02abe0 tx=0x7f0f1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:40.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.450+0000 7f0f12ffd640 1 -- 172.21.15.60:0/1617249402 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c040070 con 0x7f0f2415b460 2024-09-12T01:42:40.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.450+0000 7f0f12ffd640 1 -- 172.21.15.60:0/1617249402 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f1c031c40 con 0x7f0f2415b460 2024-09-12T01:42:40.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.450+0000 7f0f288a5640 1 -- 172.21.15.60:0/1617249402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f240cabe0 con 0x7f0f2415b460 2024-09-12T01:42:40.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.450+0000 7f0f12ffd640 1 -- 172.21.15.60:0/1617249402 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c009450 con 0x7f0f2415b460 2024-09-12T01:42:40.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.450+0000 7f0f288a5640 1 -- 172.21.15.60:0/1617249402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f240cb6c0 con 0x7f0f2415b460 2024-09-12T01:42:40.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.451+0000 7f0f288a5640 1 -- 172.21.15.60:0/1617249402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f240b5080 con 0x7f0f2415b460 2024-09-12T01:42:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.452+0000 7f0f12ffd640 1 -- 172.21.15.60:0/1617249402 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f1c039040 con 0x7f0f2415b460 2024-09-12T01:42:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.452+0000 7f0f12ffd640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0f0406be30 0x7f0f0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:40.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.452+0000 7f0f12ffd640 1 -- 172.21.15.60:0/1617249402 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f0f1c0ac0b0 con 0x7f0f2415b460 2024-09-12T01:42:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.452+0000 7f0f2259c640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0f0406be30 0x7f0f0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:40.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.453+0000 7f0f2259c640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0f0406be30 0x7f0f0406e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0f2415dcf0 tx=0x7f0f14009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:40.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.457+0000 7f0f12ffd640 1 -- 172.21.15.60:0/1617249402 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f1c07a440 con 0x7f0f2415b460 2024-09-12T01:42:40.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.672+0000 7f0f288a5640 1 -- 172.21.15.60:0/1617249402 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f240d04d0 con 0x7f0f2415b460 2024-09-12T01:42:40.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.672+0000 7f0f12ffd640 1 -- 172.21.15.60:0/1617249402 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7f0f1c07e740 con 0x7f0f2415b460 2024-09-12T01:42:40.673 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:40.673 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":61,"btime":"2024-09-12T01:42:28:803118+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3412598725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3412598725},{"type":"v1","addr":"172.21.15.60:6837","nonce":3412598725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2966702196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2966702196},{"type":"v1","addr":"172.21.15.60:6836","nonce":2966702196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7107,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3682228949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3682228949},{"type":"v1","addr":"172.21.15.105:6834","nonce":3682228949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:42:26.063083+0000","modified":"2024-09-12T01:42:28.145414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7110},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7110":{"gid":7110,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6835/3881960029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3881960029},{"type":"v1","addr":"172.21.15.105:6835","nonce":3881960029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7110,"qdb_cluster":[7110]},"id":8}]} 2024-09-12T01:42:40.673 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 61 2024-09-12T01:42:40.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.674+0000 7f0f288a5640 1 -- 172.21.15.60:0/1617249402 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0f0406be30 msgr2=0x7f0f0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:40.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.674+0000 7f0f288a5640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0f0406be30 0x7f0f0406e2f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0f2415dcf0 tx=0x7f0f14009190 comp rx=0 tx=0).stop 2024-09-12T01:42:40.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.674+0000 7f0f288a5640 1 -- 172.21.15.60:0/1617249402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f2415b460 msgr2=0x7f0f240cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:40.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.674+0000 7f0f288a5640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f2415b460 0x7f0f240cc270 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c02abe0 tx=0x7f0f1c004a40 comp rx=0 tx=0).stop 2024-09-12T01:42:40.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.674+0000 7f0f288a5640 1 -- 172.21.15.60:0/1617249402 shutdown_connections 2024-09-12T01:42:40.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.675+0000 7f0f288a5640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f2415b460 0x7f0f240cc270 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.675+0000 7f0f288a5640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0f0406be30 0x7f0f0406e2f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.675+0000 7f0f288a5640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f240d0fe0 0x7f0f24157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.675+0000 7f0f288a5640 1 --2- 172.21.15.60:0/1617249402 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f2406d430 0x7f0f241f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:40.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.675+0000 7f0f288a5640 1 -- 172.21.15.60:0/1617249402 >> 172.21.15.60:0/1617249402 conn(0x7f0f240b6ec0 msgr2=0x7f0f2406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:40.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.675+0000 7f0f288a5640 1 -- 172.21.15.60:0/1617249402 shutdown_connections 2024-09-12T01:42:40.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:40.675+0000 7f0f288a5640 1 -- 172.21.15.60:0/1617249402 wait complete. 2024-09-12T01:42:40.687 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-12T01:42:40.810 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":7275,"entity":{"name":{"type":"client","num":7275},"addr":{"type":"any","addr":"172.21.15.105:0","nonce":2038000203}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":2.954939408,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9913852990401466,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7275 172.21.15.105:0/2038000203","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi105","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":7263,"entity":{"name":{"type":"client","num":7263},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":3175978639}},"state":"open","num_leases":1,"num_caps":491,"request_load_avg":514,"uptime":4.0609167279999996,"requests_in_flight":489,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":301.76982898468577,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":292.9286800676519,"halflife":1.5},"recall_caps_throttle2o":{"value":275.59529446167988,"halflife":0.5},"session_cache_liveness":{"value":982.55282935485513,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.7263 192.168.0.1:0/3175978639","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi060","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-12T01:42:40.811 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi105", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 2038000203, "type": "any" }, "name": { "num": 7275, "type": "client" } }, "id": 7275, "inst": "client.7275 172.21.15.105:0/2038000203", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9913852990401466 }, "state": "open", "uptime": 2.954939408 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi060", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 3175978639, "type": "any" }, "name": { "num": 7263, "type": "client" } }, "id": 7263, "inst": "client.7263 192.168.0.1:0/3175978639", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 491, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 301.7698289846858 }, "recall_caps_throttle": { "halflife": 1.5, "value": 292.9286800676519 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 275.5952944616799 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 514, "requests_in_flight": 489, "session_cache_liveness": { "halflife": 300, "value": 982.5528293548551 }, "state": "open", "uptime": 4.060916728 } ] 2024-09-12T01:42:40.811 DEBUG:tasks.ceph_test_case:wait_until_equal: 491 != 802, waiting (timeout=600)... 2024-09-12T01:42:41.245 INFO:teuthology.orchestra.run.smithi060.stderr:waiting with handles open 2024-09-12T01:42:41.248 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:42:43.248 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:42:45.250 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:42:45.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:45.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.928+0000 7f8b20d31640 1 Processor -- start 2024-09-12T01:42:45.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.928+0000 7f8b20d31640 1 -- start start 2024-09-12T01:42:45.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.929+0000 7f8b20d31640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8b1c06d540 0x7f8b1c0cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:45.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.929+0000 7f8b20d31640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b1c06faf0 con 0x7f8b1c15e950 2024-09-12T01:42:45.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.929+0000 7f8b20d31640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b1c06fdd0 con 0x7f8b1c0735b0 2024-09-12T01:42:45.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.929+0000 7f8b20d31640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8b1c0700b0 con 0x7f8b1c06d540 2024-09-12T01:42:45.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.929+0000 7f8b1a59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8b1c15e950 0x7f8b1c06ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39814/0 (socket says 172.21.15.60:39814) 2024-09-12T01:42:45.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.929+0000 7f8b1a59c640 1 -- 172.21.15.60:0/3506396025 learned_addr learned my addr 172.21.15.60:0/3506396025 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:45.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.929+0000 7f8b11d9b640 1 --2- 172.21.15.60:0/3506396025 >> v2:172.21.15.105:3300/0 conn(0x7f8b1c06d540 0x7f8b1c0cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:45.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.929+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4067469809 0 0) 0x7f8b1c06faf0 con 0x7f8b1c15e950 2024-09-12T01:42:45.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.929+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b08003520 con 0x7f8b1c15e950 2024-09-12T01:42:45.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.929+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 173077824 0 0) 0x7f8b1c06fdd0 con 0x7f8b1c0735b0 2024-09-12T01:42:45.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.929+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b1c06faf0 con 0x7f8b1c0735b0 2024-09-12T01:42:45.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1951970031 0 0) 0x7f8b08003520 con 0x7f8b1c15e950 2024-09-12T01:42:45.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 >> v2:172.21.15.105:3300/0 conn(0x7f8b1c06d540 msgr2=0x7f8b1c0cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:45.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 --2- 172.21.15.60:0/3506396025 >> v2:172.21.15.105:3300/0 conn(0x7f8b1c06d540 0x7f8b1c0cf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:45.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 >> v1:172.21.15.105:6789/0 conn(0x7f8b1c0735b0 legacy=0x7f8b1c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:45.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c070390 con 0x7f8b1c15e950 2024-09-12T01:42:45.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f8b0c001670 con 0x7f8b1c15e950 2024-09-12T01:42:45.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 >> v1:172.21.15.60:6789/0 conn(0x7f8b1c15e950 legacy=0x7f8b1c06ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:45.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 --2- 172.21.15.60:0/3506396025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b08003b40 0x7f8b08003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:45.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 --2- 172.21.15.60:0/3506396025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b08004800 0x7f8b08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:45.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 --2- 172.21.15.60:0/3506396025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080051c0 0x7f8b0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:45.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c0700b0 con 0x7f8b080051c0 2024-09-12T01:42:45.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0800c040 con 0x7f8b08004800 2024-09-12T01:42:45.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0800c240 con 0x7f8b08003b40 2024-09-12T01:42:45.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b1ad9d640 1 --2- 172.21.15.60:0/3506396025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080051c0 0x7f8b0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:45.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b11d9b640 1 --2- 172.21.15.60:0/3506396025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b08004800 0x7f8b08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:45.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b1a59c640 1 --2- 172.21.15.60:0/3506396025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b08003b40 0x7f8b08003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:45.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b1ad9d640 1 -- 172.21.15.60:0/3506396025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b08003b40 msgr2=0x7f8b08003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:45.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b1ad9d640 1 --2- 172.21.15.60:0/3506396025 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b08003b40 0x7f8b08003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:45.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b1ad9d640 1 -- 172.21.15.60:0/3506396025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b08004800 msgr2=0x7f8b08004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:45.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b1ad9d640 1 --2- 172.21.15.60:0/3506396025 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b08004800 0x7f8b08004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:45.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.930+0000 7f8b1ad9d640 1 -- 172.21.15.60:0/3506396025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b08003520 con 0x7f8b080051c0 2024-09-12T01:42:45.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.931+0000 7f8b1ad9d640 1 -- 172.21.15.60:0/3506396025 reap_dead start 2024-09-12T01:42:45.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.931+0000 7f8b1ad9d640 1 --2- 172.21.15.60:0/3506396025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080051c0 0x7f8b0800b9c0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c072000 tx=0x7f8b08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ff526458f7a627 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:45.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.931+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14001bf0 con 0x7f8b080051c0 2024-09-12T01:42:45.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.931+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b14003b70 con 0x7f8b080051c0 2024-09-12T01:42:45.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.931+0000 7f8b19d9b640 1 -- 172.21.15.60:0/3506396025 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b140050d0 con 0x7f8b080051c0 2024-09-12T01:42:45.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.932+0000 7f8b20d31640 1 -- 172.21.15.60:0/3506396025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080051c0 msgr2=0x7f8b0800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:45.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.932+0000 7f8b20d31640 1 --2- 172.21.15.60:0/3506396025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080051c0 0x7f8b0800b9c0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c072000 tx=0x7f8b08005830 comp rx=0 tx=0).stop 2024-09-12T01:42:45.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.932+0000 7f8b20d31640 1 -- 172.21.15.60:0/3506396025 shutdown_connections 2024-09-12T01:42:45.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.932+0000 7f8b20d31640 1 --2- 172.21.15.60:0/3506396025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b080051c0 0x7f8b0800b9c0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:45.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.932+0000 7f8b20d31640 1 -- 172.21.15.60:0/3506396025 >> 172.21.15.60:0/3506396025 conn(0x7f8b1c0d14d0 msgr2=0x7f8b1c0d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:45.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.932+0000 7f8b20d31640 1 -- 172.21.15.60:0/3506396025 shutdown_connections 2024-09-12T01:42:45.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.932+0000 7f8b20d31640 1 -- 172.21.15.60:0/3506396025 wait complete. 2024-09-12T01:42:45.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.933+0000 7f8b20d31640 1 Processor -- start 2024-09-12T01:42:45.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.933+0000 7f8b20d31640 1 -- start start 2024-09-12T01:42:45.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.934+0000 7f8b20d31640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b080051c0 0x7f8b1c15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:45.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.934+0000 7f8b20d31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c154c80 0x7f8b1c155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:45.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.934+0000 7f8b20d31640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c158290 0x7f8b1c1586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:45.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.934+0000 7f8b20d31640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c0721d0 con 0x7f8b1c154c80 2024-09-12T01:42:45.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.934+0000 7f8b20d31640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c072050 con 0x7f8b1c158290 2024-09-12T01:42:45.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.934+0000 7f8b20d31640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1c072350 con 0x7f8b080051c0 2024-09-12T01:42:45.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.934+0000 7f8b11d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c154c80 0x7f8b1c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:45.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.934+0000 7f8b11d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c154c80 0x7f8b1c155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43104/0 (socket says 172.21.15.60:43104) 2024-09-12T01:42:45.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.934+0000 7f8b11d9b640 1 -- 172.21.15.60:0/4132341644 learned_addr learned my addr 172.21.15.60:0/4132341644 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:45.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.934+0000 7f8b1a59c640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b080051c0 0x7f8b1c15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:45.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.934+0000 7f8b1ad9d640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c158290 0x7f8b1c1586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:45.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.935+0000 7f8b11d9b640 1 -- 172.21.15.60:0/4132341644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b080051c0 msgr2=0x7f8b1c15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:45.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.935+0000 7f8b11d9b640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b080051c0 0x7f8b1c15a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:45.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.935+0000 7f8b11d9b640 1 -- 172.21.15.60:0/4132341644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c158290 msgr2=0x7f8b1c1586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:45.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.935+0000 7f8b11d9b640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c158290 0x7f8b1c1586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:45.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.935+0000 7f8b11d9b640 1 -- 172.21.15.60:0/4132341644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c155640 con 0x7f8b1c154c80 2024-09-12T01:42:45.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.935+0000 7f8b11d9b640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c154c80 0x7f8b1c155100 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f8b04011910 tx=0x7f8b04011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:45.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.935+0000 7f8b137fe640 1 -- 172.21.15.60:0/4132341644 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0400faf0 con 0x7f8b1c154c80 2024-09-12T01:42:45.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.935+0000 7f8b137fe640 1 -- 172.21.15.60:0/4132341644 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0400fc90 con 0x7f8b1c154c80 2024-09-12T01:42:45.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.935+0000 7f8b20d31640 1 -- 172.21.15.60:0/4132341644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1c1558d0 con 0x7f8b1c154c80 2024-09-12T01:42:45.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.935+0000 7f8b137fe640 1 -- 172.21.15.60:0/4132341644 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b04014440 con 0x7f8b1c154c80 2024-09-12T01:42:45.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.935+0000 7f8b20d31640 1 -- 172.21.15.60:0/4132341644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1c156170 con 0x7f8b1c154c80 2024-09-12T01:42:45.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.936+0000 7f8b20d31640 1 -- 172.21.15.60:0/4132341644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b1c06ce30 con 0x7f8b1c154c80 2024-09-12T01:42:45.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.937+0000 7f8b137fe640 1 -- 172.21.15.60:0/4132341644 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8b04012040 con 0x7f8b1c154c80 2024-09-12T01:42:45.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.937+0000 7f8b137fe640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8afc06be30 0x7f8afc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:45.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.937+0000 7f8b137fe640 1 -- 172.21.15.60:0/4132341644 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f8b0408b390 con 0x7f8b1c154c80 2024-09-12T01:42:45.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.937+0000 7f8b1a59c640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8afc06be30 0x7f8afc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:45.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.938+0000 7f8b1a59c640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8afc06be30 0x7f8afc06e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c001050 tx=0x7f8b0c001e30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:45.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:45.942+0000 7f8b137fe640 1 -- 172.21.15.60:0/4132341644 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8b04019030 con 0x7f8b1c154c80 2024-09-12T01:42:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.151+0000 7f8b20d31640 1 -- 172.21.15.60:0/4132341644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b1c0b5ca0 con 0x7f8b1c154c80 2024-09-12T01:42:46.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.152+0000 7f8b137fe640 1 -- 172.21.15.60:0/4132341644 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+5231 (secure 0 0 0) 0x7f8b04059720 con 0x7f8b1c154c80 2024-09-12T01:42:46.153 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:46.153 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":62,"btime":"2024-09-12T01:42:42:844430+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3412598725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3412598725},{"type":"v1","addr":"172.21.15.60:6837","nonce":3412598725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2966702196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2966702196},{"type":"v1","addr":"172.21.15.60:6836","nonce":2966702196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7107,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3682228949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3682228949},{"type":"v1","addr":"172.21.15.105:6834","nonce":3682228949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:42:26.063083+0000","modified":"2024-09-12T01:42:42.764506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7110},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7110":{"gid":7110,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":7,"addr":"172.21.15.105:6835/3881960029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3881960029},{"type":"v1","addr":"172.21.15.105:6835","nonce":3881960029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7110,"qdb_cluster":[7110]},"id":8}]} 2024-09-12T01:42:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 62 2024-09-12T01:42:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.154+0000 7f8b20d31640 1 -- 172.21.15.60:0/4132341644 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8afc06be30 msgr2=0x7f8afc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.154+0000 7f8b20d31640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8afc06be30 0x7f8afc06e2f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c001050 tx=0x7f8b0c001e30 comp rx=0 tx=0).stop 2024-09-12T01:42:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.154+0000 7f8b20d31640 1 -- 172.21.15.60:0/4132341644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c154c80 msgr2=0x7f8b1c155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.154+0000 7f8b20d31640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c154c80 0x7f8b1c155100 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f8b04011910 tx=0x7f8b04011dd0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.154+0000 7f8b20d31640 1 -- 172.21.15.60:0/4132341644 shutdown_connections 2024-09-12T01:42:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.154+0000 7f8b20d31640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8b1c158290 0x7f8b1c1586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.154+0000 7f8b20d31640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b1c154c80 0x7f8b1c155100 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.154+0000 7f8b20d31640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8afc06be30 0x7f8afc06e2f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.154+0000 7f8b20d31640 1 --2- 172.21.15.60:0/4132341644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8b080051c0 0x7f8b1c15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.154+0000 7f8b20d31640 1 -- 172.21.15.60:0/4132341644 >> 172.21.15.60:0/4132341644 conn(0x7f8b1c0d14d0 msgr2=0x7f8b1c0b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.154+0000 7f8b20d31640 1 -- 172.21.15.60:0/4132341644 shutdown_connections 2024-09-12T01:42:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.154+0000 7f8b20d31640 1 -- 172.21.15.60:0/4132341644 wait complete. 2024-09-12T01:42:46.166 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-12T01:42:46.296 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":7275,"entity":{"name":{"type":"client","num":7275},"addr":{"type":"any","addr":"172.21.15.105:0","nonce":2038000203}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":8.4408269130000004,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9537084994569187,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7275 172.21.15.105:0/2038000203","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi105","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":7263,"entity":{"name":{"type":"client","num":7263},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":3175978639}},"state":"open","num_leases":1,"num_caps":802,"request_load_avg":776,"uptime":9.5468042329999996,"requests_in_flight":0,"num_completed_requests":299,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":2225.4411571266496,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":778.71661087384439,"halflife":1.5},"recall_caps_throttle2o":{"value":249.28601388300876,"halflife":0.5},"session_cache_liveness":{"value":1584.7654420647534,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":530,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.7263 192.168.0.1:0/3175978639","completed_requests":[{"tid":530,"created_ino":"0x100000003e9"},{"tid":531,"created_ino":"0x100000003ea"},{"tid":532,"created_ino":"0x100000003eb"},{"tid":533,"created_ino":"0x100000003ec"},{"tid":534,"created_ino":"0x100000003ed"},{"tid":535,"created_ino":"0x100000003ee"},{"tid":536,"created_ino":"0x100000003ef"},{"tid":537,"created_ino":"0x100000003f0"},{"tid":538,"created_ino":"0x100000003f1"},{"tid":539,"created_ino":"0x100000003f2"},{"tid":540,"created_ino":"0x100000003f3"},{"tid":541,"created_ino":"0x100000003f4"},{"tid":542,"created_ino":"0x100000003f5"},{"tid":543,"created_ino":"0x100000003f6"},{"tid":544,"created_ino":"0x100000003f7"},{"tid":545,"created_ino":"0x100000003f8"},{"tid":546,"created_ino":"0x100000003f9"},{"tid":547,"created_ino":"0x100000003fa"},{"tid":548,"created_ino":"0x100000003fb"},{"tid":549,"created_ino":"0x100000003fc"},{"tid":550,"created_ino":"0x100000003fd"},{"tid":551,"created_ino":"0x100000003fe"},{"tid":552,"created_ino":"0x100000003ff"},{"tid":553,"created_ino":"0x10000000400"},{"tid":554,"created_ino":"0x10000000401"},{"tid":555,"created_ino":"0x10000000402"},{"tid":556,"created_ino":"0x10000000403"},{"tid":557,"created_ino":"0x10000000404"},{"tid":558,"created_ino":"0x10000000405"},{"tid":559,"created_ino":"0x10000000406"},{"tid":560,"created_ino":"0x10000000407"},{"tid":561,"created_ino":"0x10000000408"},{"tid":562,"created_ino":"0x10000000409"},{"tid":563,"created_ino":"0x1000000040a"},{"tid":564,"created_ino":"0x1000000040b"},{"tid":565,"created_ino":"0x1000000040c"},{"tid":566,"created_ino":"0x1000000040d"},{"tid":567,"created_ino":"0x1000000040e"},{"tid":568,"created_ino":"0x1000000040f"},{"tid":569,"created_ino":"0x10000000410"},{"tid":570,"created_ino":"0x10000000411"},{"tid":571,"created_ino":"0x10000000412"},{"tid":572,"created_ino":"0x10000000413"},{"tid":573,"created_ino":"0x10000000414"},{"tid":574,"created_ino":"0x10000000415"},{"tid":575,"created_ino":"0x10000000416"},{"tid":576,"created_ino":"0x10000000417"},{"tid":577,"created_ino":"0x10000000418"},{"tid":578,"created_ino":"0x10000000419"},{"tid":579,"created_ino":"0x1000000041a"},{"tid":580,"created_ino":"0x1000000041b"},{"tid":581,"created_ino":"0x1000000041c"},{"tid":582,"created_ino":"0x1000000041d"},{"tid":583,"created_ino":"0x1000000041e"},{"tid":584,"created_ino":"0x1000000041f"},{"tid":585,"created_ino":"0x10000000420"},{"tid":586,"created_ino":"0x10000000421"},{"tid":587,"created_ino":"0x10000000422"},{"tid":588,"created_ino":"0x10000000423"},{"tid":589,"created_ino":"0x10000000424"},{"tid":590,"created_ino":"0x10000000425"},{"tid":591,"created_ino":"0x10000000426"},{"tid":592,"created_ino":"0x10000000427"},{"tid":593,"created_ino":"0x10000000428"},{"tid":594,"created_ino":"0x10000000429"},{"tid":595,"created_ino":"0x1000000042a"},{"tid":596,"created_ino":"0x1000000042b"},{"tid":597,"created_ino":"0x1000000042c"},{"tid":598,"created_ino":"0x1000000042d"},{"tid":599,"created_ino":"0x1000000042e"},{"tid":600,"created_ino":"0x1000000042f"},{"tid":601,"created_ino":"0x10000000430"},{"tid":602,"created_ino":"0x10000000431"},{"tid":603,"created_ino":"0x10000000432"},{"tid":604,"created_ino":"0x10000000433"},{"tid":605,"created_ino":"0x10000000434"},{"tid":606,"created_ino":"0x10000000435"},{"tid":607,"created_ino":"0x10000000436"},{"tid":608,"created_ino":"0x10000000437"},{"tid":609,"created_ino":"0x10000000438"},{"tid":610,"created_ino":"0x10000000439"},{"tid":611,"created_ino":"0x1000000043a"},{"tid":612,"created_ino":"0x1000000043b"},{"tid":613,"created_ino":"0x1000000043c"},{"tid":614,"created_ino":"0x1000000043d"},{"tid":615,"created_ino":"0x1000000043e"},{"tid":616,"created_ino":"0x1000000043f"},{"tid":617,"created_ino":"0x10000000440"},{"tid":618,"created_ino":"0x10000000441"},{"tid":619,"created_ino":"0x10000000442"},{"tid":620,"created_ino":"0x10000000443"},{"tid":621,"created_ino":"0x10000000444"},{"tid":622,"created_ino":"0x10000000445"},{"tid":623,"created_ino":"0x10000000446"},{"tid":624,"created_ino":"0x10000000447"},{"tid":625,"created_ino":"0x10000000448"},{"tid":626,"created_ino":"0x10000000449"},{"tid":627,"created_ino":"0x1000000044a"},{"tid":628,"created_ino":"0x1000000044b"},{"tid":629,"created_ino":"0x1000000044c"},{"tid":630,"created_ino":"0x1000000044d"},{"tid":631,"created_ino":"0x1000000044e"},{"tid":632,"created_ino":"0x1000000044f"},{"tid":633,"created_ino":"0x10000000450"},{"tid":634,"created_ino":"0x10000000451"},{"tid":635,"created_ino":"0x10000000452"},{"tid":636,"created_ino":"0x10000000453"},{"tid":637,"created_ino":"0x10000000454"},{"tid":638,"created_ino":"0x10000000455"},{"tid":639,"created_ino":"0x10000000456"},{"tid":640,"created_ino":"0x10000000457"},{"tid":641,"created_ino":"0x10000000458"},{"tid":642,"created_ino":"0x10000000459"},{"tid":643,"created_ino":"0x1000000045a"},{"tid":644,"created_ino":"0x1000000045b"},{"tid":645,"created_ino":"0x1000000045c"},{"tid":646,"created_ino":"0x1000000045d"},{"tid":647,"created_ino":"0x1000000045e"},{"tid":648,"created_ino":"0x1000000045f"},{"tid":649,"created_ino":"0x10000000460"},{"tid":650,"created_ino":"0x10000000461"},{"tid":651,"created_ino":"0x10000000462"},{"tid":652,"created_ino":"0x10000000463"},{"tid":653,"created_ino":"0x10000000464"},{"tid":654,"created_ino":"0x10000000465"},{"tid":655,"created_ino":"0x10000000466"},{"tid":656,"created_ino":"0x10000000467"},{"tid":657,"created_ino":"0x10000000468"},{"tid":658,"created_ino":"0x10000000469"},{"tid":659,"created_ino":"0x1000000046a"},{"tid":660,"created_ino":"0x1000000046b"},{"tid":661,"created_ino":"0x1000000046c"},{"tid":662,"created_ino":"0x1000000046d"},{"tid":663,"created_ino":"0x1000000046e"},{"tid":664,"created_ino":"0x1000000046f"},{"tid":665,"created_ino":"0x10000000470"},{"tid":666,"created_ino":"0x10000000471"},{"tid":667,"created_ino":"0x10000000472"},{"tid":668,"created_ino":"0x10000000473"},{"tid":669,"created_ino":"0x10000000474"},{"tid":670,"created_ino":"0x10000000475"},{"tid":671,"created_ino":"0x10000000476"},{"tid":672,"created_ino":"0x10000000477"},{"tid":673,"created_ino":"0x10000000478"},{"tid":674,"created_ino":"0x10000000479"},{"tid":675,"created_ino":"0x1000000047a"},{"tid":676,"created_ino":"0x1000000047b"},{"tid":677,"created_ino":"0x1000000047c"},{"tid":678,"created_ino":"0x1000000047d"},{"tid":679,"created_ino":"0x1000000047e"},{"tid":680,"created_ino":"0x1000000047f"},{"tid":681,"created_ino":"0x10000000480"},{"tid":682,"created_ino":"0x10000000481"},{"tid":683,"created_ino":"0x10000000482"},{"tid":684,"created_ino":"0x10000000483"},{"tid":685,"created_ino":"0x10000000484"},{"tid":686,"created_ino":"0x10000000485"},{"tid":687,"created_ino":"0x10000000486"},{"tid":688,"created_ino":"0x10000000487"},{"tid":689,"created_ino":"0x10000000488"},{"tid":690,"created_ino":"0x10000000489"},{"tid":691,"created_ino":"0x1000000048a"},{"tid":692,"created_ino":"0x1000000048b"},{"tid":693,"created_ino":"0x1000000048c"},{"tid":694,"created_ino":"0x1000000048d"},{"tid":695,"created_ino":"0x1000000048e"},{"tid":696,"created_ino":"0x1000000048f"},{"tid":697,"created_ino":"0x10000000490"},{"tid":698,"created_ino":"0x10000000491"},{"tid":699,"created_ino":"0x10000000492"},{"tid":700,"created_ino":"0x10000000493"},{"tid":701,"created_ino":"0x10000000494"},{"tid":702,"created_ino":"0x10000000495"},{"tid":703,"created_ino":"0x10000000496"},{"tid":704,"created_ino":"0x10000000497"},{"tid":705,"created_ino":"0x10000000498"},{"tid":706,"created_ino":"0x10000000499"},{"tid":707,"created_ino":"0x1000000049a"},{"tid":708,"created_ino":"0x1000000049b"},{"tid":709,"created_ino":"0x1000000049c"},{"tid":710,"created_ino":"0x1000000049d"},{"tid":711,"created_ino":"0x1000000049e"},{"tid":712,"created_ino":"0x1000000049f"},{"tid":713,"created_ino":"0x100000004a0"},{"tid":714,"created_ino":"0x100000004a1"},{"tid":715,"created_ino":"0x100000004a2"},{"tid":716,"created_ino":"0x100000004a3"},{"tid":717,"created_ino":"0x100000004a4"},{"tid":718,"created_ino":"0x100000004a5"},{"tid":719,"created_ino":"0x100000004a6"},{"tid":720,"created_ino":"0x100000004a7"},{"tid":721,"created_ino":"0x100000004a8"},{"tid":722,"created_ino":"0x100000004a9"},{"tid":723,"created_ino":"0x100000004aa"},{"tid":724,"created_ino":"0x100000004ab"},{"tid":725,"created_ino":"0x100000004ac"},{"tid":726,"created_ino":"0x100000004ad"},{"tid":727,"created_ino":"0x100000004ae"},{"tid":728,"created_ino":"0x100000004af"},{"tid":729,"created_ino":"0x100000004b0"},{"tid":730,"created_ino":"0x100000004b1"},{"tid":731,"created_ino":"0x100000004b2"},{"tid":732,"created_ino":"0x100000004b3"},{"tid":733,"created_ino":"0x100000004b4"},{"tid":734,"created_ino":"0x100000004b5"},{"tid":735,"created_ino":"0x100000004b6"},{"tid":736,"created_ino":"0x100000004b7"},{"tid":737,"created_ino":"0x100000004b8"},{"tid":738,"created_ino":"0x100000004b9"},{"tid":739,"created_ino":"0x100000004ba"},{"tid":740,"created_ino":"0x100000004bb"},{"tid":741,"created_ino":"0x100000004bc"},{"tid":742,"created_ino":"0x100000004bd"},{"tid":743,"created_ino":"0x100000004be"},{"tid":744,"created_ino":"0x100000004bf"},{"tid":745,"created_ino":"0x100000004c0"},{"tid":746,"created_ino":"0x100000004c1"},{"tid":747,"created_ino":"0x100000004c2"},{"tid":748,"created_ino":"0x100000004c3"},{"tid":749,"created_ino":"0x100000004c4"},{"tid":750,"created_ino":"0x100000004c5"},{"tid":751,"created_ino":"0x100000004c6"},{"tid":752,"created_ino":"0x100000004c7"},{"tid":753,"created_ino":"0x100000004c8"},{"tid":754,"created_ino":"0x100000004c9"},{"tid":755,"created_ino":"0x100000004ca"},{"tid":756,"created_ino":"0x100000004cb"},{"tid":757,"created_ino":"0x100000004cc"},{"tid":758,"created_ino":"0x100000004cd"},{"tid":759,"created_ino":"0x100000004ce"},{"tid":760,"created_ino":"0x100000004cf"},{"tid":761,"created_ino":"0x100000004d0"},{"tid":762,"created_ino":"0x100000004d1"},{"tid":763,"created_ino":"0x100000004d2"},{"tid":764,"created_ino":"0x100000004d3"},{"tid":765,"created_ino":"0x100000004d4"},{"tid":766,"created_ino":"0x100000004d5"},{"tid":767,"created_ino":"0x100000004d6"},{"tid":768,"created_ino":"0x100000004d7"},{"tid":769,"created_ino":"0x100000004d8"},{"tid":770,"created_ino":"0x100000004d9"},{"tid":771,"created_ino":"0x100000004da"},{"tid":772,"created_ino":"0x100000004db"},{"tid":773,"created_ino":"0x100000004dc"},{"tid":774,"created_ino":"0x100000004dd"},{"tid":775,"created_ino":"0x100000004de"},{"tid":776,"created_ino":"0x100000004df"},{"tid":777,"created_ino":"0x100000004e0"},{"tid":778,"created_ino":"0x100000004e1"},{"tid":779,"created_ino":"0x100000004e2"},{"tid":780,"created_ino":"0x100000004e3"},{"tid":781,"created_ino":"0x100000004e4"},{"tid":782,"created_ino":"0x100000004e5"},{"tid":783,"created_ino":"0x100000004e6"},{"tid":784,"created_ino":"0x100000004e7"},{"tid":785,"created_ino":"0x100000004e8"},{"tid":786,"created_ino":"0x100000004e9"},{"tid":787,"created_ino":"0x100000004ea"},{"tid":788,"created_ino":"0x100000004eb"},{"tid":789,"created_ino":"0x100000004ec"},{"tid":790,"created_ino":"0x100000004ed"},{"tid":791,"created_ino":"0x100000004ee"},{"tid":792,"created_ino":"0x100000004ef"},{"tid":793,"created_ino":"0x100000004f0"},{"tid":794,"created_ino":"0x100000004f1"},{"tid":795,"created_ino":"0x100000004f2"},{"tid":796,"created_ino":"0x100000004f3"},{"tid":797,"created_ino":"0x100000004f4"},{"tid":798,"created_ino":"0x100000004f5"},{"tid":799,"created_ino":"0x100000004f6"},{"tid":800,"created_ino":"0x100000004f7"},{"tid":801,"created_ino":"0x100000004f8"},{"tid":802,"created_ino":"0x100000004f9"},{"tid":803,"created_ino":"0x100000004fa"},{"tid":804,"created_ino":"0x100000004fb"},{"tid":805,"created_ino":"0x100000004fc"},{"tid":806,"created_ino":"0x100000004fd"},{"tid":807,"created_ino":"0x100000004fe"},{"tid":808,"created_ino":"0x100000004ff"},{"tid":809,"created_ino":"0x10000000500"},{"tid":810,"created_ino":"0x10000000501"},{"tid":811,"created_ino":"0x10000000502"},{"tid":812,"created_ino":"0x10000000503"},{"tid":813,"created_ino":"0x10000000504"},{"tid":814,"created_ino":"0x10000000505"},{"tid":815,"created_ino":"0x10000000506"},{"tid":816,"created_ino":"0x10000000507"},{"tid":817,"created_ino":"0x10000000508"},{"tid":818,"created_ino":"0x10000000509"},{"tid":819,"created_ino":"0x1000000050a"},{"tid":820,"created_ino":"0x1000000050b"},{"tid":821,"created_ino":"0x1000000050c"},{"tid":822,"created_ino":"0x1000000050d"},{"tid":823,"created_ino":"0x1000000050e"},{"tid":824,"created_ino":"0x1000000050f"},{"tid":825,"created_ino":"0x10000000510"},{"tid":826,"created_ino":"0x10000000511"},{"tid":827,"created_ino":"0x10000000512"},{"tid":828,"created_ino":"0x10000000513"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x10000000514","length":203},{"start":"0x100000005e0","length":501}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi060","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-12T01:42:46.298 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi105", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 2038000203, "type": "any" }, "name": { "num": 7275, "type": "client" } }, "id": 7275, "inst": "client.7275 172.21.15.105:0/2038000203", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9537084994569187 }, "state": "open", "uptime": 8.440826913 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi060", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x100000003e9", "tid": 530 }, { "created_ino": "0x100000003ea", "tid": 531 }, { "created_ino": "0x100000003eb", "tid": 532 }, { "created_ino": "0x100000003ec", "tid": 533 }, { "created_ino": "0x100000003ed", "tid": 534 }, { "created_ino": "0x100000003ee", "tid": 535 }, { "created_ino": "0x100000003ef", "tid": 536 }, { "created_ino": "0x100000003f0", "tid": 537 }, { "created_ino": "0x100000003f1", "tid": 538 }, { "created_ino": "0x100000003f2", "tid": 539 }, { "created_ino": "0x100000003f3", "tid": 540 }, { "created_ino": "0x100000003f4", "tid": 541 }, { "created_ino": "0x100000003f5", "tid": 542 }, { "created_ino": "0x100000003f6", "tid": 543 }, { "created_ino": "0x100000003f7", "tid": 544 }, { "created_ino": "0x100000003f8", "tid": 545 }, { "created_ino": "0x100000003f9", "tid": 546 }, { "created_ino": "0x100000003fa", "tid": 547 }, { "created_ino": "0x100000003fb", "tid": 548 }, { "created_ino": "0x100000003fc", "tid": 549 }, { "created_ino": "0x100000003fd", "tid": 550 }, { "created_ino": "0x100000003fe", "tid": 551 }, { "created_ino": "0x100000003ff", "tid": 552 }, { "created_ino": "0x10000000400", "tid": 553 }, { "created_ino": "0x10000000401", "tid": 554 }, { "created_ino": "0x10000000402", "tid": 555 }, { "created_ino": "0x10000000403", "tid": 556 }, { "created_ino": "0x10000000404", "tid": 557 }, { "created_ino": "0x10000000405", "tid": 558 }, { "created_ino": "0x10000000406", "tid": 559 }, { "created_ino": "0x10000000407", "tid": 560 }, { "created_ino": "0x10000000408", "tid": 561 }, { "created_ino": "0x10000000409", "tid": 562 }, { "created_ino": "0x1000000040a", "tid": 563 }, { "created_ino": "0x1000000040b", "tid": 564 }, { "created_ino": "0x1000000040c", "tid": 565 }, { "created_ino": "0x1000000040d", "tid": 566 }, { "created_ino": "0x1000000040e", "tid": 567 }, { "created_ino": "0x1000000040f", "tid": 568 }, { "created_ino": "0x10000000410", "tid": 569 }, { "created_ino": "0x10000000411", "tid": 570 }, { "created_ino": "0x10000000412", "tid": 571 }, { "created_ino": "0x10000000413", "tid": 572 }, { "created_ino": "0x10000000414", "tid": 573 }, { "created_ino": "0x10000000415", "tid": 574 }, { "created_ino": "0x10000000416", "tid": 575 }, { "created_ino": "0x10000000417", "tid": 576 }, { "created_ino": "0x10000000418", "tid": 577 }, { "created_ino": "0x10000000419", "tid": 578 }, { "created_ino": "0x1000000041a", "tid": 579 }, { "created_ino": "0x1000000041b", "tid": 580 }, { "created_ino": "0x1000000041c", "tid": 581 }, { "created_ino": "0x1000000041d", "tid": 582 }, { "created_ino": "0x1000000041e", "tid": 583 }, { "created_ino": "0x1000000041f", "tid": 584 }, { "created_ino": "0x10000000420", "tid": 585 }, { "created_ino": "0x10000000421", "tid": 586 }, { "created_ino": "0x10000000422", "tid": 587 }, { "created_ino": "0x10000000423", "tid": 588 }, { "created_ino": "0x10000000424", "tid": 589 }, { "created_ino": "0x10000000425", "tid": 590 }, { "created_ino": "0x10000000426", "tid": 591 }, { "created_ino": "0x10000000427", "tid": 592 }, { "created_ino": "0x10000000428", "tid": 593 }, { "created_ino": "0x10000000429", "tid": 594 }, { "created_ino": "0x1000000042a", "tid": 595 }, { "created_ino": "0x1000000042b", "tid": 596 }, { "created_ino": "0x1000000042c", "tid": 597 }, { "created_ino": "0x1000000042d", "tid": 598 }, { "created_ino": "0x1000000042e", "tid": 599 }, { "created_ino": "0x1000000042f", "tid": 600 }, { "created_ino": "0x10000000430", "tid": 601 }, { "created_ino": "0x10000000431", "tid": 602 }, { "created_ino": "0x10000000432", "tid": 603 }, { "created_ino": "0x10000000433", "tid": 604 }, { "created_ino": "0x10000000434", "tid": 605 }, { "created_ino": "0x10000000435", "tid": 606 }, { "created_ino": "0x10000000436", "tid": 607 }, { "created_ino": "0x10000000437", "tid": 608 }, { "created_ino": "0x10000000438", "tid": 609 }, { "created_ino": "0x10000000439", "tid": 610 }, { "created_ino": "0x1000000043a", "tid": 611 }, { "created_ino": "0x1000000043b", "tid": 612 }, { "created_ino": "0x1000000043c", "tid": 613 }, { "created_ino": "0x1000000043d", "tid": 614 }, { "created_ino": "0x1000000043e", "tid": 615 }, { "created_ino": "0x1000000043f", "tid": 616 }, { "created_ino": "0x10000000440", "tid": 617 }, { "created_ino": "0x10000000441", "tid": 618 }, { "created_ino": "0x10000000442", "tid": 619 }, { "created_ino": "0x10000000443", "tid": 620 }, { "created_ino": "0x10000000444", "tid": 621 }, { "created_ino": "0x10000000445", "tid": 622 }, { "created_ino": "0x10000000446", "tid": 623 }, { "created_ino": "0x10000000447", "tid": 624 }, { "created_ino": "0x10000000448", "tid": 625 }, { "created_ino": "0x10000000449", "tid": 626 }, { "created_ino": "0x1000000044a", "tid": 627 }, { "created_ino": "0x1000000044b", "tid": 628 }, { "created_ino": "0x1000000044c", "tid": 629 }, { "created_ino": "0x1000000044d", "tid": 630 }, { "created_ino": "0x1000000044e", "tid": 631 }, { "created_ino": "0x1000000044f", "tid": 632 }, { "created_ino": "0x10000000450", "tid": 633 }, { "created_ino": "0x10000000451", "tid": 634 }, { "created_ino": "0x10000000452", "tid": 635 }, { "created_ino": "0x10000000453", "tid": 636 }, { "created_ino": "0x10000000454", "tid": 637 }, { "created_ino": "0x10000000455", "tid": 638 }, { "created_ino": "0x10000000456", "tid": 639 }, { "created_ino": "0x10000000457", "tid": 640 }, { "created_ino": "0x10000000458", "tid": 641 }, { "created_ino": "0x10000000459", "tid": 642 }, { "created_ino": "0x1000000045a", "tid": 643 }, { "created_ino": "0x1000000045b", "tid": 644 }, { "created_ino": "0x1000000045c", "tid": 645 }, { "created_ino": "0x1000000045d", "tid": 646 }, { "created_ino": "0x1000000045e", "tid": 647 }, { "created_ino": "0x1000000045f", "tid": 648 }, { "created_ino": "0x10000000460", "tid": 649 }, { "created_ino": "0x10000000461", "tid": 650 }, { "created_ino": "0x10000000462", "tid": 651 }, { "created_ino": "0x10000000463", "tid": 652 }, { "created_ino": "0x10000000464", "tid": 653 }, { "created_ino": "0x10000000465", "tid": 654 }, { "created_ino": "0x10000000466", "tid": 655 }, { "created_ino": "0x10000000467", "tid": 656 }, { "created_ino": "0x10000000468", "tid": 657 }, { "created_ino": "0x10000000469", "tid": 658 }, { "created_ino": "0x1000000046a", "tid": 659 }, { "created_ino": "0x1000000046b", "tid": 660 }, { "created_ino": "0x1000000046c", "tid": 661 }, { "created_ino": "0x1000000046d", "tid": 662 }, { "created_ino": "0x1000000046e", "tid": 663 }, { "created_ino": "0x1000000046f", "tid": 664 }, { "created_ino": "0x10000000470", "tid": 665 }, { "created_ino": "0x10000000471", "tid": 666 }, { "created_ino": "0x10000000472", "tid": 667 }, { "created_ino": "0x10000000473", "tid": 668 }, { "created_ino": "0x10000000474", "tid": 669 }, { "created_ino": "0x10000000475", "tid": 670 }, { "created_ino": "0x10000000476", "tid": 671 }, { "created_ino": "0x10000000477", "tid": 672 }, { "created_ino": "0x10000000478", "tid": 673 }, { "created_ino": "0x10000000479", "tid": 674 }, { "created_ino": "0x1000000047a", "tid": 675 }, { "created_ino": "0x1000000047b", "tid": 676 }, { "created_ino": "0x1000000047c", "tid": 677 }, { "created_ino": "0x1000000047d", "tid": 678 }, { "created_ino": "0x1000000047e", "tid": 679 }, { "created_ino": "0x1000000047f", "tid": 680 }, { "created_ino": "0x10000000480", "tid": 681 }, { "created_ino": "0x10000000481", "tid": 682 }, { "created_ino": "0x10000000482", "tid": 683 }, { "created_ino": "0x10000000483", "tid": 684 }, { "created_ino": "0x10000000484", "tid": 685 }, { "created_ino": "0x10000000485", "tid": 686 }, { "created_ino": "0x10000000486", "tid": 687 }, { "created_ino": "0x10000000487", "tid": 688 }, { "created_ino": "0x10000000488", "tid": 689 }, { "created_ino": "0x10000000489", "tid": 690 }, { "created_ino": "0x1000000048a", "tid": 691 }, { "created_ino": "0x1000000048b", "tid": 692 }, { "created_ino": "0x1000000048c", "tid": 693 }, { "created_ino": "0x1000000048d", "tid": 694 }, { "created_ino": "0x1000000048e", "tid": 695 }, { "created_ino": "0x1000000048f", "tid": 696 }, { "created_ino": "0x10000000490", "tid": 697 }, { "created_ino": "0x10000000491", "tid": 698 }, { "created_ino": "0x10000000492", "tid": 699 }, { "created_ino": "0x10000000493", "tid": 700 }, { "created_ino": "0x10000000494", "tid": 701 }, { "created_ino": "0x10000000495", "tid": 702 }, { "created_ino": "0x10000000496", "tid": 703 }, { "created_ino": "0x10000000497", "tid": 704 }, { "created_ino": "0x10000000498", "tid": 705 }, { "created_ino": "0x10000000499", "tid": 706 }, { "created_ino": "0x1000000049a", "tid": 707 }, { "created_ino": "0x1000000049b", "tid": 708 }, { "created_ino": "0x1000000049c", "tid": 709 }, { "created_ino": "0x1000000049d", "tid": 710 }, { "created_ino": "0x1000000049e", "tid": 711 }, { "created_ino": "0x1000000049f", "tid": 712 }, { "created_ino": "0x100000004a0", "tid": 713 }, { "created_ino": "0x100000004a1", "tid": 714 }, { "created_ino": "0x100000004a2", "tid": 715 }, { "created_ino": "0x100000004a3", "tid": 716 }, { "created_ino": "0x100000004a4", "tid": 717 }, { "created_ino": "0x100000004a5", "tid": 718 }, { "created_ino": "0x100000004a6", "tid": 719 }, { "created_ino": "0x100000004a7", "tid": 720 }, { "created_ino": "0x100000004a8", "tid": 721 }, { "created_ino": "0x100000004a9", "tid": 722 }, { "created_ino": "0x100000004aa", "tid": 723 }, { "created_ino": "0x100000004ab", "tid": 724 }, { "created_ino": "0x100000004ac", "tid": 725 }, { "created_ino": "0x100000004ad", "tid": 726 }, { "created_ino": "0x100000004ae", "tid": 727 }, { "created_ino": "0x100000004af", "tid": 728 }, { "created_ino": "0x100000004b0", "tid": 729 }, { "created_ino": "0x100000004b1", "tid": 730 }, { "created_ino": "0x100000004b2", "tid": 731 }, { "created_ino": "0x100000004b3", "tid": 732 }, { "created_ino": "0x100000004b4", "tid": 733 }, { "created_ino": "0x100000004b5", "tid": 734 }, { "created_ino": "0x100000004b6", "tid": 735 }, { "created_ino": "0x100000004b7", "tid": 736 }, { "created_ino": "0x100000004b8", "tid": 737 }, { "created_ino": "0x100000004b9", "tid": 738 }, { "created_ino": "0x100000004ba", "tid": 739 }, { "created_ino": "0x100000004bb", "tid": 740 }, { "created_ino": "0x100000004bc", "tid": 741 }, { "created_ino": "0x100000004bd", "tid": 742 }, { "created_ino": "0x100000004be", "tid": 743 }, { "created_ino": "0x100000004bf", "tid": 744 }, { "created_ino": "0x100000004c0", "tid": 745 }, { "created_ino": "0x100000004c1", "tid": 746 }, { "created_ino": "0x100000004c2", "tid": 747 }, { "created_ino": "0x100000004c3", "tid": 748 }, { "created_ino": "0x100000004c4", "tid": 749 }, { "created_ino": "0x100000004c5", "tid": 750 }, { "created_ino": "0x100000004c6", "tid": 751 }, { "created_ino": "0x100000004c7", "tid": 752 }, { "created_ino": "0x100000004c8", "tid": 753 }, { "created_ino": "0x100000004c9", "tid": 754 }, { "created_ino": "0x100000004ca", "tid": 755 }, { "created_ino": "0x100000004cb", "tid": 756 }, { "created_ino": "0x100000004cc", "tid": 757 }, { "created_ino": "0x100000004cd", "tid": 758 }, { "created_ino": "0x100000004ce", "tid": 759 }, { "created_ino": "0x100000004cf", "tid": 760 }, { "created_ino": "0x100000004d0", "tid": 761 }, { "created_ino": "0x100000004d1", "tid": 762 }, { "created_ino": "0x100000004d2", "tid": 763 }, { "created_ino": "0x100000004d3", "tid": 764 }, { "created_ino": "0x100000004d4", "tid": 765 }, { "created_ino": "0x100000004d5", "tid": 766 }, { "created_ino": "0x100000004d6", "tid": 767 }, { "created_ino": "0x100000004d7", "tid": 768 }, { "created_ino": "0x100000004d8", "tid": 769 }, { "created_ino": "0x100000004d9", "tid": 770 }, { "created_ino": "0x100000004da", "tid": 771 }, { "created_ino": "0x100000004db", "tid": 772 }, { "created_ino": "0x100000004dc", "tid": 773 }, { "created_ino": "0x100000004dd", "tid": 774 }, { "created_ino": "0x100000004de", "tid": 775 }, { "created_ino": "0x100000004df", "tid": 776 }, { "created_ino": "0x100000004e0", "tid": 777 }, { "created_ino": "0x100000004e1", "tid": 778 }, { "created_ino": "0x100000004e2", "tid": 779 }, { "created_ino": "0x100000004e3", "tid": 780 }, { "created_ino": "0x100000004e4", "tid": 781 }, { "created_ino": "0x100000004e5", "tid": 782 }, { "created_ino": "0x100000004e6", "tid": 783 }, { "created_ino": "0x100000004e7", "tid": 784 }, { "created_ino": "0x100000004e8", "tid": 785 }, { "created_ino": "0x100000004e9", "tid": 786 }, { "created_ino": "0x100000004ea", "tid": 787 }, { "created_ino": "0x100000004eb", "tid": 788 }, { "created_ino": "0x100000004ec", "tid": 789 }, { "created_ino": "0x100000004ed", "tid": 790 }, { "created_ino": "0x100000004ee", "tid": 791 }, { "created_ino": "0x100000004ef", "tid": 792 }, { "created_ino": "0x100000004f0", "tid": 793 }, { "created_ino": "0x100000004f1", "tid": 794 }, { "created_ino": "0x100000004f2", "tid": 795 }, { "created_ino": "0x100000004f3", "tid": 796 }, { "created_ino": "0x100000004f4", "tid": 797 }, { "created_ino": "0x100000004f5", "tid": 798 }, { "created_ino": "0x100000004f6", "tid": 799 }, { "created_ino": "0x100000004f7", "tid": 800 }, { "created_ino": "0x100000004f8", "tid": 801 }, { "created_ino": "0x100000004f9", "tid": 802 }, { "created_ino": "0x100000004fa", "tid": 803 }, { "created_ino": "0x100000004fb", "tid": 804 }, { "created_ino": "0x100000004fc", "tid": 805 }, { "created_ino": "0x100000004fd", "tid": 806 }, { "created_ino": "0x100000004fe", "tid": 807 }, { "created_ino": "0x100000004ff", "tid": 808 }, { "created_ino": "0x10000000500", "tid": 809 }, { "created_ino": "0x10000000501", "tid": 810 }, { "created_ino": "0x10000000502", "tid": 811 }, { "created_ino": "0x10000000503", "tid": 812 }, { "created_ino": "0x10000000504", "tid": 813 }, { "created_ino": "0x10000000505", "tid": 814 }, { "created_ino": "0x10000000506", "tid": 815 }, { "created_ino": "0x10000000507", "tid": 816 }, { "created_ino": "0x10000000508", "tid": 817 }, { "created_ino": "0x10000000509", "tid": 818 }, { "created_ino": "0x1000000050a", "tid": 819 }, { "created_ino": "0x1000000050b", "tid": 820 }, { "created_ino": "0x1000000050c", "tid": 821 }, { "created_ino": "0x1000000050d", "tid": 822 }, { "created_ino": "0x1000000050e", "tid": 823 }, { "created_ino": "0x1000000050f", "tid": 824 }, { "created_ino": "0x10000000510", "tid": 825 }, { "created_ino": "0x10000000511", "tid": 826 }, { "created_ino": "0x10000000512", "tid": 827 }, { "created_ino": "0x10000000513", "tid": 828 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 3175978639, "type": "any" }, "name": { "num": 7263, "type": "client" } }, "id": 7263, "inst": "client.7263 192.168.0.1:0/3175978639", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 530, "num_caps": 802, "num_completed_flushes": 0, "num_completed_requests": 299, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 203, "start": "0x10000000514" }, { "length": 501, "start": "0x100000005e0" } ], "recall_caps": { "halflife": 60, "value": 2225.4411571266496 }, "recall_caps_throttle": { "halflife": 1.5, "value": 778.7166108738444 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 249.28601388300876 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 776, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1584.7654420647534 }, "state": "open", "uptime": 9.546804233 } ] 2024-09-12T01:42:46.299 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-09-12T01:42:46.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:42:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.400+0000 7f351c33b640 1 Processor -- start 2024-09-12T01:42:46.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.400+0000 7f351c33b640 1 -- start start 2024-09-12T01:42:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.401+0000 7f351c33b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f351415e660 0x7f35140cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.401+0000 7f351c33b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f35140d3310 0x7f35140d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.401+0000 7f351c33b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35140d1650 0x7f351406bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.401+0000 7f351c33b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f351415ea40 con 0x7f35140d1650 2024-09-12T01:42:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.401+0000 7f351c33b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f35140d3870 con 0x7f35140d3310 2024-09-12T01:42:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.401+0000 7f351c33b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f35140d3b50 con 0x7f351415e660 2024-09-12T01:42:46.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.402+0000 7f351a8d8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35140d1650 0x7f351406bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:46.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.402+0000 7f351a8d8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35140d1650 0x7f351406bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43108/0 (socket says 172.21.15.60:43108) 2024-09-12T01:42:46.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.402+0000 7f351a8d8640 1 -- 172.21.15.60:0/2193369857 learned_addr learned my addr 172.21.15.60:0/2193369857 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:46.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.402+0000 7f35198d6640 1 --2- 172.21.15.60:0/2193369857 >> v2:172.21.15.105:3300/0 conn(0x7f35140d3310 0x7f35140d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:46.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.402+0000 7f351a0d7640 1 --2- 172.21.15.60:0/2193369857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f351415e660 0x7f35140cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:46.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.402+0000 7f351a8d8640 1 -- 172.21.15.60:0/2193369857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f351415e660 msgr2=0x7f35140cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:46.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.402+0000 7f351a8d8640 1 --2- 172.21.15.60:0/2193369857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f351415e660 0x7f35140cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.402+0000 7f351a8d8640 1 -- 172.21.15.60:0/2193369857 >> v2:172.21.15.105:3300/0 conn(0x7f35140d3310 msgr2=0x7f35140d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:46.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.402+0000 7f351a8d8640 1 --2- 172.21.15.60:0/2193369857 >> v2:172.21.15.105:3300/0 conn(0x7f35140d3310 0x7f35140d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.402+0000 7f351a8d8640 1 -- 172.21.15.60:0/2193369857 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35140d3e30 con 0x7f35140d1650 2024-09-12T01:42:46.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.403+0000 7f351a8d8640 1 --2- 172.21.15.60:0/2193369857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35140d1650 0x7f351406bfd0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f351408d140 tx=0x7f350c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b08b8be6715365 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.403+0000 7f35190d5640 1 -- 172.21.15.60:0/2193369857 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c036070 con 0x7f35140d1650 2024-09-12T01:42:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.403+0000 7f35190d5640 1 -- 172.21.15.60:0/2193369857 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f350c031600 con 0x7f35140d1650 2024-09-12T01:42:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.403+0000 7f35190d5640 1 -- 172.21.15.60:0/2193369857 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f350c0319d0 con 0x7f35140d1650 2024-09-12T01:42:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.403+0000 7f351c33b640 1 -- 172.21.15.60:0/2193369857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35140d1650 msgr2=0x7f351406bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.403+0000 7f351c33b640 1 --2- 172.21.15.60:0/2193369857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35140d1650 0x7f351406bfd0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f351408d140 tx=0x7f350c02a6a0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.403+0000 7f351c33b640 1 -- 172.21.15.60:0/2193369857 shutdown_connections 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.403+0000 7f351c33b640 1 --2- 172.21.15.60:0/2193369857 >> v2:172.21.15.105:3300/0 conn(0x7f35140d3310 0x7f35140d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.403+0000 7f351c33b640 1 --2- 172.21.15.60:0/2193369857 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35140d1650 0x7f351406bfd0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.403+0000 7f351c33b640 1 --2- 172.21.15.60:0/2193369857 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f351415e660 0x7f35140cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.403+0000 7f351c33b640 1 -- 172.21.15.60:0/2193369857 >> 172.21.15.60:0/2193369857 conn(0x7f35140b6410 msgr2=0x7f35140b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.404+0000 7f351c33b640 1 -- 172.21.15.60:0/2193369857 shutdown_connections 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.404+0000 7f351c33b640 1 -- 172.21.15.60:0/2193369857 wait complete. 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.405+0000 7f351c33b640 1 Processor -- start 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.405+0000 7f351c33b640 1 -- start start 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.405+0000 7f351c33b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35140d1650 0x7f3514154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.405+0000 7f351c33b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35140d3310 0x7f3514155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.405+0000 7f351c33b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f351415e660 0x7f3514155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.405+0000 7f351c33b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f35140cfc70 con 0x7f35140d3310 2024-09-12T01:42:46.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.405+0000 7f351c33b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f35140d43f0 con 0x7f35140d1650 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.405+0000 7f351c33b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f351406c510 con 0x7f351415e660 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f35198d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35140d3310 0x7f3514155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f35198d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35140d3310 0x7f3514155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43110/0 (socket says 172.21.15.60:43110) 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f35198d6640 1 -- 172.21.15.60:0/3886247485 learned_addr learned my addr 172.21.15.60:0/3886247485 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f351a0d7640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35140d1650 0x7f3514154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f351a8d8640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f351415e660 0x7f3514155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f35198d6640 1 -- 172.21.15.60:0/3886247485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f351415e660 msgr2=0x7f3514155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f35198d6640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f351415e660 0x7f3514155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f35198d6640 1 -- 172.21.15.60:0/3886247485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35140d1650 msgr2=0x7f3514154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f35198d6640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35140d1650 0x7f3514154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f35198d6640 1 -- 172.21.15.60:0/3886247485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35141f3fe0 con 0x7f35140d3310 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f35198d6640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35140d3310 0x7f3514155400 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f350400d800 tx=0x7f350400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:46.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f350affd640 1 -- 172.21.15.60:0/3886247485 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3504018030 con 0x7f35140d3310 2024-09-12T01:42:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f350affd640 1 -- 172.21.15.60:0/3886247485 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3504004020 con 0x7f35140d3310 2024-09-12T01:42:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f351c33b640 1 -- 172.21.15.60:0/3886247485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35141536d0 con 0x7f35140d3310 2024-09-12T01:42:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f350affd640 1 -- 172.21.15.60:0/3886247485 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35040041f0 con 0x7f35140d3310 2024-09-12T01:42:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.406+0000 7f351c33b640 1 -- 172.21.15.60:0/3886247485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3514153c90 con 0x7f35140d3310 2024-09-12T01:42:46.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.407+0000 7f351c33b640 1 -- 172.21.15.60:0/3886247485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35140d1110 con 0x7f35140d3310 2024-09-12T01:42:46.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.408+0000 7f350affd640 1 -- 172.21.15.60:0/3886247485 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f350401b070 con 0x7f35140d3310 2024-09-12T01:42:46.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.408+0000 7f350affd640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f34f806be30 0x7f34f806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:46.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.409+0000 7f351a0d7640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f34f806be30 0x7f34f806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:46.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.409+0000 7f350affd640 1 -- 172.21.15.60:0/3886247485 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f350408af10 con 0x7f35140d3310 2024-09-12T01:42:46.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.409+0000 7f351a0d7640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f34f806be30 0x7f34f806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f35100079a0 tx=0x7f3510008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:46.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.413+0000 7f350affd640 1 -- 172.21.15.60:0/3886247485 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3504059200 con 0x7f35140d3310 2024-09-12T01:42:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.623+0000 7f351c33b640 1 -- 172.21.15.60:0/3886247485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f351406c2d0 con 0x7f35140d3310 2024-09-12T01:42:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.624+0000 7f350affd640 1 -- 172.21.15.60:0/3886247485 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f350405d500 con 0x7f35140d3310 2024-09-12T01:42:46.624 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:46.624 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:42:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.625+0000 7f351c33b640 1 -- 172.21.15.60:0/3886247485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f34f806be30 msgr2=0x7f34f806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.625+0000 7f351c33b640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f34f806be30 0x7f34f806e2f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f35100079a0 tx=0x7f3510008040 comp rx=0 tx=0).stop 2024-09-12T01:42:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.626+0000 7f351c33b640 1 -- 172.21.15.60:0/3886247485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35140d3310 msgr2=0x7f3514155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.626+0000 7f351c33b640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35140d3310 0x7f3514155400 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f350400d800 tx=0x7f350400dcc0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.626+0000 7f351c33b640 1 -- 172.21.15.60:0/3886247485 shutdown_connections 2024-09-12T01:42:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.626+0000 7f351c33b640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f34f806be30 0x7f34f806e2f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.626+0000 7f351c33b640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f351415e660 0x7f3514155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.626+0000 7f351c33b640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35140d3310 0x7f3514155400 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.626+0000 7f351c33b640 1 --2- 172.21.15.60:0/3886247485 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f35140d1650 0x7f3514154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.626+0000 7f351c33b640 1 -- 172.21.15.60:0/3886247485 >> 172.21.15.60:0/3886247485 conn(0x7f35140b6410 msgr2=0x7f35140b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.626+0000 7f351c33b640 1 -- 172.21.15.60:0/3886247485 shutdown_connections 2024-09-12T01:42:46.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:46.626+0000 7f351c33b640 1 -- 172.21.15.60:0/3886247485 wait complete. 2024-09-12T01:42:46.637 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:42:46.637 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:42:47.252 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:42:49.105 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:42:49.108 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:42:49.254 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:42:51.256 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:42:51.638 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:42:51.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.752+0000 7f214d023640 1 Processor -- start 2024-09-12T01:42:51.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.752+0000 7f214d023640 1 -- start start 2024-09-12T01:42:51.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.753+0000 7f214d023640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21480d3310 0x7f21480d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:51.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.753+0000 7f214d023640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21480d1650 0x7f21480b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:51.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.753+0000 7f214d023640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f214815ea40 con 0x7f214815e660 2024-09-12T01:42:51.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.753+0000 7f214d023640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f21480d1ac0 con 0x7f21480d1650 2024-09-12T01:42:51.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.753+0000 7f214d023640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21480d3870 con 0x7f21480d3310 2024-09-12T01:42:51.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.753+0000 7f214759e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21480d1650 0x7f21480b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:51.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.753+0000 7f2146d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f214815e660 0x7f21480cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39818/0 (socket says 172.21.15.60:39818) 2024-09-12T01:42:51.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.754+0000 7f2146d9d640 1 -- 172.21.15.60:0/4212412251 learned_addr learned my addr 172.21.15.60:0/4212412251 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:51.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.754+0000 7f214659c640 1 --2- 172.21.15.60:0/4212412251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21480d3310 0x7f21480d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:51.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.754+0000 7f214759e640 1 -- 172.21.15.60:0/4212412251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21480d3310 msgr2=0x7f21480d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:51.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.754+0000 7f214759e640 1 --2- 172.21.15.60:0/4212412251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21480d3310 0x7f21480d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.754+0000 7f214759e640 1 -- 172.21.15.60:0/4212412251 >> v1:172.21.15.60:6789/0 conn(0x7f214815e660 legacy=0x7f21480cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:51.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.754+0000 7f214759e640 1 -- 172.21.15.60:0/4212412251 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21480d3b50 con 0x7f21480d1650 2024-09-12T01:42:51.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.754+0000 7f2145d9b640 1 -- 172.21.15.60:0/4212412251 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3463558507 0 0) 0x7f214815ea40 con 0x7f214815e660 2024-09-12T01:42:51.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.754+0000 7f214659c640 1 --2- 172.21.15.60:0/4212412251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21480d3310 0x7f21480d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.755+0000 7f214759e640 1 --2- 172.21.15.60:0/4212412251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21480d1650 0x7f21480b7b70 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f2140009d90 tx=0x7f214002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91135e54d91d675 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.755+0000 7f2145d9b640 1 -- 172.21.15.60:0/4212412251 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140007740 con 0x7f21480d1650 2024-09-12T01:42:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.755+0000 7f2145d9b640 1 -- 172.21.15.60:0/4212412251 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21400078e0 con 0x7f21480d1650 2024-09-12T01:42:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.755+0000 7f2145d9b640 1 -- 172.21.15.60:0/4212412251 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2140007cb0 con 0x7f21480d1650 2024-09-12T01:42:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.755+0000 7f214d023640 1 -- 172.21.15.60:0/4212412251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21480d1650 msgr2=0x7f21480b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.755+0000 7f214d023640 1 --2- 172.21.15.60:0/4212412251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21480d1650 0x7f21480b7b70 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f2140009d90 tx=0x7f214002a660 comp rx=0 tx=0).stop 2024-09-12T01:42:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.755+0000 7f214d023640 1 -- 172.21.15.60:0/4212412251 shutdown_connections 2024-09-12T01:42:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.755+0000 7f214d023640 1 --2- 172.21.15.60:0/4212412251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21480d1650 0x7f21480b7b70 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.755+0000 7f214d023640 1 --2- 172.21.15.60:0/4212412251 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21480d3310 0x7f21480d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.755+0000 7f214d023640 1 -- 172.21.15.60:0/4212412251 >> 172.21.15.60:0/4212412251 conn(0x7f21480b6410 msgr2=0x7f21480b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:51.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.755+0000 7f214d023640 1 -- 172.21.15.60:0/4212412251 shutdown_connections 2024-09-12T01:42:51.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.755+0000 7f214d023640 1 -- 172.21.15.60:0/4212412251 wait complete. 2024-09-12T01:42:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.757+0000 7f214d023640 1 Processor -- start 2024-09-12T01:42:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.757+0000 7f214d023640 1 -- start start 2024-09-12T01:42:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f214d023640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21480d1650 0x7f21481592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f214d023640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21480d3310 0x7f21480c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f214d023640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214815e660 0x7f2148155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:51.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f214d023640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f21480d43f0 con 0x7f21480d1650 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f214d023640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21480d4110 con 0x7f214815e660 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f214d023640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21480b80b0 con 0x7f21480d3310 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f2146d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21480d1650 0x7f21481592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f2146d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21480d1650 0x7f21481592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43138/0 (socket says 172.21.15.60:43138) 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f2146d9d640 1 -- 172.21.15.60:0/2313004176 learned_addr learned my addr 172.21.15.60:0/2313004176 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f214759e640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214815e660 0x7f2148155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f214659c640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21480d3310 0x7f21480c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f2146d9d640 1 -- 172.21.15.60:0/2313004176 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21480d3310 msgr2=0x7f21480c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f2146d9d640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21480d3310 0x7f21480c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f2146d9d640 1 -- 172.21.15.60:0/2313004176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214815e660 msgr2=0x7f2148155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f2146d9d640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214815e660 0x7f2148155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f2146d9d640 1 -- 172.21.15.60:0/2313004176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21480c9cb0 con 0x7f21480d1650 2024-09-12T01:42:51.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.758+0000 7f214759e640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214815e660 0x7f2148155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:51.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.759+0000 7f2146d9d640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21480d1650 0x7f21481592b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f213800c430 tx=0x7f213800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:51.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.759+0000 7f212f7fe640 1 -- 172.21.15.60:0/2313004176 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21380074e0 con 0x7f21480d1650 2024-09-12T01:42:51.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.759+0000 7f212f7fe640 1 -- 172.21.15.60:0/2313004176 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21380047e0 con 0x7f21480d1650 2024-09-12T01:42:51.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.759+0000 7f214d023640 1 -- 172.21.15.60:0/2313004176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21480c9f90 con 0x7f21480d1650 2024-09-12T01:42:51.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.759+0000 7f212f7fe640 1 -- 172.21.15.60:0/2313004176 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2138004bd0 con 0x7f21480d1650 2024-09-12T01:42:51.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.759+0000 7f214d023640 1 -- 172.21.15.60:0/2313004176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21480ca550 con 0x7f21480d1650 2024-09-12T01:42:51.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.760+0000 7f214d023640 1 -- 172.21.15.60:0/2313004176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21480b7b70 con 0x7f21480d1650 2024-09-12T01:42:51.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.760+0000 7f212f7fe640 1 -- 172.21.15.60:0/2313004176 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2138011070 con 0x7f21480d1650 2024-09-12T01:42:51.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.761+0000 7f212f7fe640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f213406be30 0x7f213406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:51.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.761+0000 7f212f7fe640 1 -- 172.21.15.60:0/2313004176 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f213808aa40 con 0x7f21480d1650 2024-09-12T01:42:51.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.761+0000 7f214659c640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f213406be30 0x7f213406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:51.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.761+0000 7f214659c640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f213406be30 0x7f213406e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f21480c9560 tx=0x7f213c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:51.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.765+0000 7f212f7fe640 1 -- 172.21.15.60:0/2313004176 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2138059420 con 0x7f21480d1650 2024-09-12T01:42:51.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.977+0000 7f214d023640 1 -- 172.21.15.60:0/2313004176 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f21480693c0 con 0x7f21480d1650 2024-09-12T01:42:51.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.978+0000 7f212f7fe640 1 -- 172.21.15.60:0/2313004176 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f2138058d20 con 0x7f21480d1650 2024-09-12T01:42:51.978 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:51.978 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:42:51.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.979+0000 7f214d023640 1 -- 172.21.15.60:0/2313004176 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f213406be30 msgr2=0x7f213406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:51.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.979+0000 7f214d023640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f213406be30 0x7f213406e2f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f21480c9560 tx=0x7f213c008040 comp rx=0 tx=0).stop 2024-09-12T01:42:51.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.979+0000 7f214d023640 1 -- 172.21.15.60:0/2313004176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21480d1650 msgr2=0x7f21481592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:51.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.979+0000 7f214d023640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21480d1650 0x7f21481592b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f213800c430 tx=0x7f213800c8f0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.979+0000 7f214d023640 1 -- 172.21.15.60:0/2313004176 shutdown_connections 2024-09-12T01:42:51.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.979+0000 7f214d023640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f214815e660 0x7f2148155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.979+0000 7f214d023640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f213406be30 0x7f213406e2f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.979+0000 7f214d023640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21480d3310 0x7f21480c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.980+0000 7f214d023640 1 --2- 172.21.15.60:0/2313004176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21480d1650 0x7f21481592b0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:51.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.980+0000 7f214d023640 1 -- 172.21.15.60:0/2313004176 >> 172.21.15.60:0/2313004176 conn(0x7f21480b6410 msgr2=0x7f214815b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:51.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.980+0000 7f214d023640 1 -- 172.21.15.60:0/2313004176 shutdown_connections 2024-09-12T01:42:51.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:51.980+0000 7f214d023640 1 -- 172.21.15.60:0/2313004176 wait complete. 2024-09-12T01:42:51.991 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-12T01:42:51.991 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-09-12T01:42:51.991 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:42:52.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.093+0000 7fb34baf1640 1 Processor -- start 2024-09-12T01:42:52.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.093+0000 7fb34baf1640 1 -- start start 2024-09-12T01:42:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.094+0000 7fb34baf1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb3440b4920 0x7fb34415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.094+0000 7fb34baf1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3440b4d00 0x7fb3440b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.094+0000 7fb34baf1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3440ce4f0 con 0x7fb3440cd780 2024-09-12T01:42:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.094+0000 7fb34baf1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb3440cf100 con 0x7fb3440b4920 2024-09-12T01:42:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.094+0000 7fb34baf1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb3440ce7d0 con 0x7fb3440b4d00 2024-09-12T01:42:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.094+0000 7fb34a08e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb3440cd780 0x7fb3440cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:39834/0 (socket says 172.21.15.60:39834) 2024-09-12T01:42:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.094+0000 7fb34a08e640 1 -- 172.21.15.60:0/3119374394 learned_addr learned my addr 172.21.15.60:0/3119374394 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.094+0000 7fb34988d640 1 --2- 172.21.15.60:0/3119374394 >> v2:172.21.15.105:3300/0 conn(0x7fb3440b4920 0x7fb34415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.094+0000 7fb34908c640 1 --2- 172.21.15.60:0/3119374394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3440b4d00 0x7fb3440b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.094+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4053190784 0 0) 0x7fb3440ce4f0 con 0x7fb3440cd780 2024-09-12T01:42:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.094+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb330003520 con 0x7fb3440cd780 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3154449296 0 0) 0x7fb330003520 con 0x7fb3440cd780 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3440b4d00 msgr2=0x7fb3440b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 --2- 172.21.15.60:0/3119374394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3440b4d00 0x7fb3440b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 >> v2:172.21.15.105:3300/0 conn(0x7fb3440b4920 msgr2=0x7fb34415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 --2- 172.21.15.60:0/3119374394 >> v2:172.21.15.105:3300/0 conn(0x7fb3440b4920 0x7fb34415b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3440ceab0 con 0x7fb3440cd780 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fb33c0019f0 con 0x7fb3440cd780 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 >> v1:172.21.15.60:6789/0 conn(0x7fb3440cd780 legacy=0x7fb3440cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 --2- 172.21.15.60:0/3119374394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3440b4d00 0x7fb3300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 --2- 172.21.15.60:0/3119374394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb330003f30 0x7fb330004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 --2- 172.21.15.60:0/3119374394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb330004d40 0x7fb3300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb3440cf100 con 0x7fb330003f30 2024-09-12T01:42:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb3440ce7d0 con 0x7fb330004d40 2024-09-12T01:42:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb33000b9c0 con 0x7fb3440b4d00 2024-09-12T01:42:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34908c640 1 --2- 172.21.15.60:0/3119374394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb330003f30 0x7fb330004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34988d640 1 --2- 172.21.15.60:0/3119374394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3440b4d00 0x7fb3300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34a08e640 1 --2- 172.21.15.60:0/3119374394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb330004d40 0x7fb3300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34908c640 1 -- 172.21.15.60:0/3119374394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3440b4d00 msgr2=0x7fb3300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34908c640 1 --2- 172.21.15.60:0/3119374394 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3440b4d00 0x7fb3300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34908c640 1 -- 172.21.15.60:0/3119374394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb330004d40 msgr2=0x7fb3300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34908c640 1 --2- 172.21.15.60:0/3119374394 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb330004d40 0x7fb3300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.095+0000 7fb34908c640 1 -- 172.21.15.60:0/3119374394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb330003520 con 0x7fb330003f30 2024-09-12T01:42:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.096+0000 7fb34908c640 1 --2- 172.21.15.60:0/3119374394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb330003f30 0x7fb330004800 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fb334009650 tx=0x7fb330005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879923360f4b263e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.096+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334038070 con 0x7fb330003f30 2024-09-12T01:42:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.096+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb334033400 con 0x7fb330003f30 2024-09-12T01:42:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.096+0000 7fb34888b640 1 -- 172.21.15.60:0/3119374394 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334009690 con 0x7fb330003f30 2024-09-12T01:42:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.097+0000 7fb34baf1640 1 -- 172.21.15.60:0/3119374394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb330003f30 msgr2=0x7fb330004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.097+0000 7fb34baf1640 1 --2- 172.21.15.60:0/3119374394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb330003f30 0x7fb330004800 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fb334009650 tx=0x7fb330005830 comp rx=0 tx=0).stop 2024-09-12T01:42:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.097+0000 7fb34a08e640 1 -- 172.21.15.60:0/3119374394 reap_dead start 2024-09-12T01:42:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.097+0000 7fb34baf1640 1 -- 172.21.15.60:0/3119374394 shutdown_connections 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.097+0000 7fb34baf1640 1 -- 172.21.15.60:0/3119374394 >> 172.21.15.60:0/3119374394 conn(0x7fb34406bc10 msgr2=0x7fb34406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.097+0000 7fb34baf1640 1 -- 172.21.15.60:0/3119374394 shutdown_connections 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.097+0000 7fb34baf1640 1 -- 172.21.15.60:0/3119374394 wait complete. 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.098+0000 7fb34baf1640 1 Processor -- start 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.098+0000 7fb34baf1640 1 -- start start 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34baf1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb330003f30 0x7fb3441f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34baf1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb344150a80 0x7fb344150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34baf1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb344153050 0x7fb3441534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34baf1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb3440b5140 con 0x7fb344150a80 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34baf1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb34415bd10 con 0x7fb344153050 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34baf1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb3440b52c0 con 0x7fb330003f30 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34908c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb344150a80 0x7fb344150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34908c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb344150a80 0x7fb344150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43154/0 (socket says 172.21.15.60:43154) 2024-09-12T01:42:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34908c640 1 -- 172.21.15.60:0/3155197444 learned_addr learned my addr 172.21.15.60:0/3155197444 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34988d640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb330003f30 0x7fb3441f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34a08e640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb344153050 0x7fb3441534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34908c640 1 -- 172.21.15.60:0/3155197444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb330003f30 msgr2=0x7fb3441f2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34908c640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb330003f30 0x7fb3441f2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34908c640 1 -- 172.21.15.60:0/3155197444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb344153050 msgr2=0x7fb3441534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34908c640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb344153050 0x7fb3441534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34908c640 1 -- 172.21.15.60:0/3155197444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb344158d90 con 0x7fb344150a80 2024-09-12T01:42:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34a08e640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb344153050 0x7fb3441534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb34908c640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb344150a80 0x7fb344150f00 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fb334009bb0 tx=0x7fb334004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.099+0000 7fb33a7fc640 1 -- 172.21.15.60:0/3155197444 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334042020 con 0x7fb344150a80 2024-09-12T01:42:52.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.100+0000 7fb33a7fc640 1 -- 172.21.15.60:0/3155197444 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb334003940 con 0x7fb344150a80 2024-09-12T01:42:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.100+0000 7fb34baf1640 1 -- 172.21.15.60:0/3155197444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3441515f0 con 0x7fb344150a80 2024-09-12T01:42:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.100+0000 7fb33a7fc640 1 -- 172.21.15.60:0/3155197444 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb334038040 con 0x7fb344150a80 2024-09-12T01:42:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.100+0000 7fb34baf1640 1 -- 172.21.15.60:0/3155197444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb344151bb0 con 0x7fb344150a80 2024-09-12T01:42:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.100+0000 7fb34baf1640 1 -- 172.21.15.60:0/3155197444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3440b56a0 con 0x7fb344150a80 2024-09-12T01:42:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.101+0000 7fb33a7fc640 1 -- 172.21.15.60:0/3155197444 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb334045020 con 0x7fb344150a80 2024-09-12T01:42:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.102+0000 7fb33a7fc640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb32806be60 0x7fb32806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.102+0000 7fb33a7fc640 1 -- 172.21.15.60:0/3155197444 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7fb3340ad860 con 0x7fb344150a80 2024-09-12T01:42:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.102+0000 7fb34988d640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb32806be60 0x7fb32806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.102+0000 7fb34988d640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb32806be60 0x7fb32806e320 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb3441574c0 tx=0x7fb340009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:52.106 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.106+0000 7fb33a7fc640 1 -- 172.21.15.60:0/3155197444 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb33404c070 con 0x7fb344150a80 2024-09-12T01:42:52.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.319+0000 7fb34baf1640 1 -- 172.21.15.60:0/3155197444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb34415baf0 con 0x7fb344150a80 2024-09-12T01:42:52.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.319+0000 7fb33a7fc640 1 -- 172.21.15.60:0/3155197444 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7fb33407b7e0 con 0x7fb344150a80 2024-09-12T01:42:52.320 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:52.320 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:42:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.321+0000 7fb34baf1640 1 -- 172.21.15.60:0/3155197444 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb32806be60 msgr2=0x7fb32806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.321+0000 7fb34baf1640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb32806be60 0x7fb32806e320 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb3441574c0 tx=0x7fb340009190 comp rx=0 tx=0).stop 2024-09-12T01:42:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.321+0000 7fb34baf1640 1 -- 172.21.15.60:0/3155197444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb344150a80 msgr2=0x7fb344150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.321+0000 7fb34baf1640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb344150a80 0x7fb344150f00 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fb334009bb0 tx=0x7fb334004730 comp rx=0 tx=0).stop 2024-09-12T01:42:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.321+0000 7fb34baf1640 1 -- 172.21.15.60:0/3155197444 shutdown_connections 2024-09-12T01:42:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.321+0000 7fb34baf1640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb344153050 0x7fb3441534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.321+0000 7fb34baf1640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb344150a80 0x7fb344150f00 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.321+0000 7fb34baf1640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb32806be60 0x7fb32806e320 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.321+0000 7fb34baf1640 1 --2- 172.21.15.60:0/3155197444 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb330003f30 0x7fb3441f2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:52.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.321+0000 7fb34baf1640 1 -- 172.21.15.60:0/3155197444 >> 172.21.15.60:0/3155197444 conn(0x7fb34406bc10 msgr2=0x7fb3440cdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:52.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.321+0000 7fb34baf1640 1 -- 172.21.15.60:0/3155197444 shutdown_connections 2024-09-12T01:42:52.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52.321+0000 7fb34baf1640 1 -- 172.21.15.60:0/3155197444 wait complete. 2024-09-12T01:42:52.333 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T01:42:52.333 INFO:tasks.cephfs.test_client_limits:Terminating process holding files open 2024-09-12T01:42:52.334 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:52 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-12T01:42:53.258 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:42:53.259 INFO:teuthology.orchestra.run.smithi060.stderr:stdin closed, goodbye! 2024-09-12T01:42:53.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:42:53.282 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:53.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.435+0000 7f6542cd2640 1 Processor -- start 2024-09-12T01:42:53.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.436+0000 7f6542cd2640 1 -- start start 2024-09-12T01:42:53.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.436+0000 7f6542cd2640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f653c0d3310 0x7f653c0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:53.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.436+0000 7f6542cd2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f653c0d1650 0x7f653c0b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:53.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.436+0000 7f6542cd2640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f653c15ea40 con 0x7f653c15e660 2024-09-12T01:42:53.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.436+0000 7f6542cd2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f653c0d1ac0 con 0x7f653c0d1650 2024-09-12T01:42:53.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.436+0000 7f6542cd2640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f653c0d3870 con 0x7f653c0d3310 2024-09-12T01:42:53.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.437+0000 7f654126f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f653c0d1650 0x7f653c0b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:53.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.437+0000 7f654126f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f653c0d1650 0x7f653c0b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56366/0 (socket says 172.21.15.60:56366) 2024-09-12T01:42:53.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.437+0000 7f654126f640 1 -- 172.21.15.60:0/4009651222 learned_addr learned my addr 172.21.15.60:0/4009651222 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:53.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.437+0000 7f653bfff640 1 --2- 172.21.15.60:0/4009651222 >> v2:172.21.15.105:3300/0 conn(0x7f653c0d3310 0x7f653c0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:53.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.437+0000 7f654126f640 1 -- 172.21.15.60:0/4009651222 >> v2:172.21.15.105:3300/0 conn(0x7f653c0d3310 msgr2=0x7f653c0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:53.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.437+0000 7f654126f640 1 --2- 172.21.15.60:0/4009651222 >> v2:172.21.15.105:3300/0 conn(0x7f653c0d3310 0x7f653c0d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:53.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.437+0000 7f654126f640 1 -- 172.21.15.60:0/4009651222 >> v1:172.21.15.105:6789/0 conn(0x7f653c15e660 legacy=0x7f653c0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:53.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.437+0000 7f654126f640 1 -- 172.21.15.60:0/4009651222 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c0d3b50 con 0x7f653c0d1650 2024-09-12T01:42:53.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.438+0000 7f654126f640 1 --2- 172.21.15.60:0/4009651222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f653c0d1650 0x7f653c0b7b70 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f653c0c8020 tx=0x7f653402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ad9dd493f402c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:53.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.438+0000 7f653b7fe640 1 -- 172.21.15.60:0/4009651222 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534037070 con 0x7f653c0d1650 2024-09-12T01:42:53.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.438+0000 7f653b7fe640 1 -- 172.21.15.60:0/4009651222 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6534032440 con 0x7f653c0d1650 2024-09-12T01:42:53.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.438+0000 7f653b7fe640 1 -- 172.21.15.60:0/4009651222 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534032810 con 0x7f653c0d1650 2024-09-12T01:42:53.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.438+0000 7f6542cd2640 1 -- 172.21.15.60:0/4009651222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f653c0d1650 msgr2=0x7f653c0b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:53.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.438+0000 7f6542cd2640 1 --2- 172.21.15.60:0/4009651222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f653c0d1650 0x7f653c0b7b70 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f653c0c8020 tx=0x7f653402a230 comp rx=0 tx=0).stop 2024-09-12T01:42:53.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.438+0000 7f6542cd2640 1 -- 172.21.15.60:0/4009651222 shutdown_connections 2024-09-12T01:42:53.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.438+0000 7f6542cd2640 1 --2- 172.21.15.60:0/4009651222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f653c0d1650 0x7f653c0b7b70 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:53.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.438+0000 7f6542cd2640 1 --2- 172.21.15.60:0/4009651222 >> v2:172.21.15.105:3300/0 conn(0x7f653c0d3310 0x7f653c0d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:53.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.438+0000 7f6542cd2640 1 -- 172.21.15.60:0/4009651222 >> 172.21.15.60:0/4009651222 conn(0x7f653c0b6410 msgr2=0x7f653c0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:53.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.439+0000 7f6542cd2640 1 -- 172.21.15.60:0/4009651222 shutdown_connections 2024-09-12T01:42:53.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.439+0000 7f6542cd2640 1 -- 172.21.15.60:0/4009651222 wait complete. 2024-09-12T01:42:53.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.440+0000 7f6542cd2640 1 Processor -- start 2024-09-12T01:42:53.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.440+0000 7f6542cd2640 1 -- start start 2024-09-12T01:42:53.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f6542cd2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f653c0d1650 0x7f653c0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f6542cd2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f653c0d3310 0x7f653c1544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f6542cd2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f653c15e660 0x7f653c1f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f6542cd2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f653c0d43f0 con 0x7f653c15e660 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f6542cd2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f653c0d4110 con 0x7f653c0d1650 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f6542cd2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f653c0b80b0 con 0x7f653c0d3310 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f654126f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f653c15e660 0x7f653c1f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f654126f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f653c15e660 0x7f653c1f7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56372/0 (socket says 172.21.15.60:56372) 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f654126f640 1 -- 172.21.15.60:0/3101344612 learned_addr learned my addr 172.21.15.60:0/3101344612 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f653bfff640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f653c0d3310 0x7f653c1544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f6540a6e640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f653c0d1650 0x7f653c0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f654126f640 1 -- 172.21.15.60:0/3101344612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f653c0d3310 msgr2=0x7f653c1544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f654126f640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f653c0d3310 0x7f653c1544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f654126f640 1 -- 172.21.15.60:0/3101344612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f653c0d1650 msgr2=0x7f653c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:53.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f654126f640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f653c0d1650 0x7f653c0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:53.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f654126f640 1 -- 172.21.15.60:0/3101344612 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c160a70 con 0x7f653c15e660 2024-09-12T01:42:53.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f6540a6e640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f653c0d1650 0x7f653c0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:53.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.441+0000 7f654126f640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f653c15e660 0x7f653c1f7520 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f653402a270 tx=0x7f65340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:53.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.442+0000 7f65397fa640 1 -- 172.21.15.60:0/3101344612 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534041020 con 0x7f653c15e660 2024-09-12T01:42:53.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.442+0000 7f65397fa640 1 -- 172.21.15.60:0/3101344612 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6534030990 con 0x7f653c15e660 2024-09-12T01:42:53.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.442+0000 7f65397fa640 1 -- 172.21.15.60:0/3101344612 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6534037040 con 0x7f653c15e660 2024-09-12T01:42:53.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.442+0000 7f6542cd2640 1 -- 172.21.15.60:0/3101344612 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653c160ce0 con 0x7f653c15e660 2024-09-12T01:42:53.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.442+0000 7f6542cd2640 1 -- 172.21.15.60:0/3101344612 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c1612a0 con 0x7f653c15e660 2024-09-12T01:42:53.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.443+0000 7f6542cd2640 1 -- 172.21.15.60:0/3101344612 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f653c0b7b70 con 0x7f653c15e660 2024-09-12T01:42:53.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.443+0000 7f65397fa640 1 -- 172.21.15.60:0/3101344612 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6534044020 con 0x7f653c15e660 2024-09-12T01:42:53.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.444+0000 7f65397fa640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f652806be30 0x7f652806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:53.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.444+0000 7f65397fa640 1 -- 172.21.15.60:0/3101344612 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f65340ab3f0 con 0x7f653c15e660 2024-09-12T01:42:53.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.444+0000 7f6540a6e640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f652806be30 0x7f652806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:53.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.444+0000 7f6540a6e640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f652806be30 0x7f652806e2f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f652c009fc0 tx=0x7f652c009550 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:53.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.448+0000 7f65397fa640 1 -- 172.21.15.60:0/3101344612 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f653404b070 con 0x7f653c15e660 2024-09-12T01:42:53.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.658+0000 7f6542cd2640 1 -- 172.21.15.60:0/3101344612 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f653c0b4240 con 0x7f653c15e660 2024-09-12T01:42:53.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.659+0000 7f65397fa640 1 -- 172.21.15.60:0/3101344612 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5231 (secure 0 0 0) 0x7f6534079dd0 con 0x7f653c15e660 2024-09-12T01:42:53.659 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:53.659 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":63,"btime":"2024-09-12T01:42:46:901027+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3412598725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3412598725},{"type":"v1","addr":"172.21.15.60:6837","nonce":3412598725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2966702196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2966702196},{"type":"v1","addr":"172.21.15.60:6836","nonce":2966702196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7107,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3682228949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3682228949},{"type":"v1","addr":"172.21.15.105:6834","nonce":3682228949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:42:26.063083+0000","modified":"2024-09-12T01:42:46.766209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7110},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7110":{"gid":7110,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6835/3881960029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3881960029},{"type":"v1","addr":"172.21.15.105:6835","nonce":3881960029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7110,"qdb_cluster":[7110]},"id":8}]} 2024-09-12T01:42:53.660 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 63 2024-09-12T01:42:53.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.660+0000 7f6542cd2640 1 -- 172.21.15.60:0/3101344612 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f652806be30 msgr2=0x7f652806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:53.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.660+0000 7f6542cd2640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f652806be30 0x7f652806e2f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f652c009fc0 tx=0x7f652c009550 comp rx=0 tx=0).stop 2024-09-12T01:42:53.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.661+0000 7f6542cd2640 1 -- 172.21.15.60:0/3101344612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f653c15e660 msgr2=0x7f653c1f7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:53.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.661+0000 7f6542cd2640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f653c15e660 0x7f653c1f7520 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f653402a270 tx=0x7f65340046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:53.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.661+0000 7f6542cd2640 1 -- 172.21.15.60:0/3101344612 shutdown_connections 2024-09-12T01:42:53.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.661+0000 7f6542cd2640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f653c15e660 0x7f653c1f7520 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:53.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.661+0000 7f6542cd2640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f652806be30 0x7f652806e2f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:53.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.661+0000 7f6542cd2640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f653c0d3310 0x7f653c1544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:53.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.661+0000 7f6542cd2640 1 --2- 172.21.15.60:0/3101344612 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f653c0d1650 0x7f653c0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:53.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.661+0000 7f6542cd2640 1 -- 172.21.15.60:0/3101344612 >> 172.21.15.60:0/3101344612 conn(0x7f653c0b6410 msgr2=0x7f653c15bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:53.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.661+0000 7f6542cd2640 1 -- 172.21.15.60:0/3101344612 shutdown_connections 2024-09-12T01:42:53.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:53.661+0000 7f6542cd2640 1 -- 172.21.15.60:0/3101344612 wait complete. 2024-09-12T01:42:53.673 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-12T01:42:53.845 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":7275,"entity":{"name":{"type":"client","num":7275},"addr":{"type":"any","addr":"172.21.15.105:0","nonce":2038000203}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":15.989672114999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9026379556663202,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7275 172.21.15.105:0/2038000203","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi105","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":7263,"entity":{"name":{"type":"client","num":7263},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":3175978639}},"state":"open","num_leases":1,"num_caps":462,"request_load_avg":711,"uptime":17.095649434999999,"requests_in_flight":0,"num_completed_requests":299,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":4770.5950563610995,"halflife":60},"release_caps":{"value":339.91164851194856,"halflife":60},"recall_caps_throttle":{"value":1033.359189682843,"halflife":1.5},"recall_caps_throttle2o":{"value":468.7834788350836,"halflife":0.5},"session_cache_liveness":{"value":1557.3643519024454,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":530,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.7263 192.168.0.1:0/3175978639","completed_requests":[{"tid":530,"created_ino":"0x100000003e9"},{"tid":531,"created_ino":"0x100000003ea"},{"tid":532,"created_ino":"0x100000003eb"},{"tid":533,"created_ino":"0x100000003ec"},{"tid":534,"created_ino":"0x100000003ed"},{"tid":535,"created_ino":"0x100000003ee"},{"tid":536,"created_ino":"0x100000003ef"},{"tid":537,"created_ino":"0x100000003f0"},{"tid":538,"created_ino":"0x100000003f1"},{"tid":539,"created_ino":"0x100000003f2"},{"tid":540,"created_ino":"0x100000003f3"},{"tid":541,"created_ino":"0x100000003f4"},{"tid":542,"created_ino":"0x100000003f5"},{"tid":543,"created_ino":"0x100000003f6"},{"tid":544,"created_ino":"0x100000003f7"},{"tid":545,"created_ino":"0x100000003f8"},{"tid":546,"created_ino":"0x100000003f9"},{"tid":547,"created_ino":"0x100000003fa"},{"tid":548,"created_ino":"0x100000003fb"},{"tid":549,"created_ino":"0x100000003fc"},{"tid":550,"created_ino":"0x100000003fd"},{"tid":551,"created_ino":"0x100000003fe"},{"tid":552,"created_ino":"0x100000003ff"},{"tid":553,"created_ino":"0x10000000400"},{"tid":554,"created_ino":"0x10000000401"},{"tid":555,"created_ino":"0x10000000402"},{"tid":556,"created_ino":"0x10000000403"},{"tid":557,"created_ino":"0x10000000404"},{"tid":558,"created_ino":"0x10000000405"},{"tid":559,"created_ino":"0x10000000406"},{"tid":560,"created_ino":"0x10000000407"},{"tid":561,"created_ino":"0x10000000408"},{"tid":562,"created_ino":"0x10000000409"},{"tid":563,"created_ino":"0x1000000040a"},{"tid":564,"created_ino":"0x1000000040b"},{"tid":565,"created_ino":"0x1000000040c"},{"tid":566,"created_ino":"0x1000000040d"},{"tid":567,"created_ino":"0x1000000040e"},{"tid":568,"created_ino":"0x1000000040f"},{"tid":569,"created_ino":"0x10000000410"},{"tid":570,"created_ino":"0x10000000411"},{"tid":571,"created_ino":"0x10000000412"},{"tid":572,"created_ino":"0x10000000413"},{"tid":573,"created_ino":"0x10000000414"},{"tid":574,"created_ino":"0x10000000415"},{"tid":575,"created_ino":"0x10000000416"},{"tid":576,"created_ino":"0x10000000417"},{"tid":577,"created_ino":"0x10000000418"},{"tid":578,"created_ino":"0x10000000419"},{"tid":579,"created_ino":"0x1000000041a"},{"tid":580,"created_ino":"0x1000000041b"},{"tid":581,"created_ino":"0x1000000041c"},{"tid":582,"created_ino":"0x1000000041d"},{"tid":583,"created_ino":"0x1000000041e"},{"tid":584,"created_ino":"0x1000000041f"},{"tid":585,"created_ino":"0x10000000420"},{"tid":586,"created_ino":"0x10000000421"},{"tid":587,"created_ino":"0x10000000422"},{"tid":588,"created_ino":"0x10000000423"},{"tid":589,"created_ino":"0x10000000424"},{"tid":590,"created_ino":"0x10000000425"},{"tid":591,"created_ino":"0x10000000426"},{"tid":592,"created_ino":"0x10000000427"},{"tid":593,"created_ino":"0x10000000428"},{"tid":594,"created_ino":"0x10000000429"},{"tid":595,"created_ino":"0x1000000042a"},{"tid":596,"created_ino":"0x1000000042b"},{"tid":597,"created_ino":"0x1000000042c"},{"tid":598,"created_ino":"0x1000000042d"},{"tid":599,"created_ino":"0x1000000042e"},{"tid":600,"created_ino":"0x1000000042f"},{"tid":601,"created_ino":"0x10000000430"},{"tid":602,"created_ino":"0x10000000431"},{"tid":603,"created_ino":"0x10000000432"},{"tid":604,"created_ino":"0x10000000433"},{"tid":605,"created_ino":"0x10000000434"},{"tid":606,"created_ino":"0x10000000435"},{"tid":607,"created_ino":"0x10000000436"},{"tid":608,"created_ino":"0x10000000437"},{"tid":609,"created_ino":"0x10000000438"},{"tid":610,"created_ino":"0x10000000439"},{"tid":611,"created_ino":"0x1000000043a"},{"tid":612,"created_ino":"0x1000000043b"},{"tid":613,"created_ino":"0x1000000043c"},{"tid":614,"created_ino":"0x1000000043d"},{"tid":615,"created_ino":"0x1000000043e"},{"tid":616,"created_ino":"0x1000000043f"},{"tid":617,"created_ino":"0x10000000440"},{"tid":618,"created_ino":"0x10000000441"},{"tid":619,"created_ino":"0x10000000442"},{"tid":620,"created_ino":"0x10000000443"},{"tid":621,"created_ino":"0x10000000444"},{"tid":622,"created_ino":"0x10000000445"},{"tid":623,"created_ino":"0x10000000446"},{"tid":624,"created_ino":"0x10000000447"},{"tid":625,"created_ino":"0x10000000448"},{"tid":626,"created_ino":"0x10000000449"},{"tid":627,"created_ino":"0x1000000044a"},{"tid":628,"created_ino":"0x1000000044b"},{"tid":629,"created_ino":"0x1000000044c"},{"tid":630,"created_ino":"0x1000000044d"},{"tid":631,"created_ino":"0x1000000044e"},{"tid":632,"created_ino":"0x1000000044f"},{"tid":633,"created_ino":"0x10000000450"},{"tid":634,"created_ino":"0x10000000451"},{"tid":635,"created_ino":"0x10000000452"},{"tid":636,"created_ino":"0x10000000453"},{"tid":637,"created_ino":"0x10000000454"},{"tid":638,"created_ino":"0x10000000455"},{"tid":639,"created_ino":"0x10000000456"},{"tid":640,"created_ino":"0x10000000457"},{"tid":641,"created_ino":"0x10000000458"},{"tid":642,"created_ino":"0x10000000459"},{"tid":643,"created_ino":"0x1000000045a"},{"tid":644,"created_ino":"0x1000000045b"},{"tid":645,"created_ino":"0x1000000045c"},{"tid":646,"created_ino":"0x1000000045d"},{"tid":647,"created_ino":"0x1000000045e"},{"tid":648,"created_ino":"0x1000000045f"},{"tid":649,"created_ino":"0x10000000460"},{"tid":650,"created_ino":"0x10000000461"},{"tid":651,"created_ino":"0x10000000462"},{"tid":652,"created_ino":"0x10000000463"},{"tid":653,"created_ino":"0x10000000464"},{"tid":654,"created_ino":"0x10000000465"},{"tid":655,"created_ino":"0x10000000466"},{"tid":656,"created_ino":"0x10000000467"},{"tid":657,"created_ino":"0x10000000468"},{"tid":658,"created_ino":"0x10000000469"},{"tid":659,"created_ino":"0x1000000046a"},{"tid":660,"created_ino":"0x1000000046b"},{"tid":661,"created_ino":"0x1000000046c"},{"tid":662,"created_ino":"0x1000000046d"},{"tid":663,"created_ino":"0x1000000046e"},{"tid":664,"created_ino":"0x1000000046f"},{"tid":665,"created_ino":"0x10000000470"},{"tid":666,"created_ino":"0x10000000471"},{"tid":667,"created_ino":"0x10000000472"},{"tid":668,"created_ino":"0x10000000473"},{"tid":669,"created_ino":"0x10000000474"},{"tid":670,"created_ino":"0x10000000475"},{"tid":671,"created_ino":"0x10000000476"},{"tid":672,"created_ino":"0x10000000477"},{"tid":673,"created_ino":"0x10000000478"},{"tid":674,"created_ino":"0x10000000479"},{"tid":675,"created_ino":"0x1000000047a"},{"tid":676,"created_ino":"0x1000000047b"},{"tid":677,"created_ino":"0x1000000047c"},{"tid":678,"created_ino":"0x1000000047d"},{"tid":679,"created_ino":"0x1000000047e"},{"tid":680,"created_ino":"0x1000000047f"},{"tid":681,"created_ino":"0x10000000480"},{"tid":682,"created_ino":"0x10000000481"},{"tid":683,"created_ino":"0x10000000482"},{"tid":684,"created_ino":"0x10000000483"},{"tid":685,"created_ino":"0x10000000484"},{"tid":686,"created_ino":"0x10000000485"},{"tid":687,"created_ino":"0x10000000486"},{"tid":688,"created_ino":"0x10000000487"},{"tid":689,"created_ino":"0x10000000488"},{"tid":690,"created_ino":"0x10000000489"},{"tid":691,"created_ino":"0x1000000048a"},{"tid":692,"created_ino":"0x1000000048b"},{"tid":693,"created_ino":"0x1000000048c"},{"tid":694,"created_ino":"0x1000000048d"},{"tid":695,"created_ino":"0x1000000048e"},{"tid":696,"created_ino":"0x1000000048f"},{"tid":697,"created_ino":"0x10000000490"},{"tid":698,"created_ino":"0x10000000491"},{"tid":699,"created_ino":"0x10000000492"},{"tid":700,"created_ino":"0x10000000493"},{"tid":701,"created_ino":"0x10000000494"},{"tid":702,"created_ino":"0x10000000495"},{"tid":703,"created_ino":"0x10000000496"},{"tid":704,"created_ino":"0x10000000497"},{"tid":705,"created_ino":"0x10000000498"},{"tid":706,"created_ino":"0x10000000499"},{"tid":707,"created_ino":"0x1000000049a"},{"tid":708,"created_ino":"0x1000000049b"},{"tid":709,"created_ino":"0x1000000049c"},{"tid":710,"created_ino":"0x1000000049d"},{"tid":711,"created_ino":"0x1000000049e"},{"tid":712,"created_ino":"0x1000000049f"},{"tid":713,"created_ino":"0x100000004a0"},{"tid":714,"created_ino":"0x100000004a1"},{"tid":715,"created_ino":"0x100000004a2"},{"tid":716,"created_ino":"0x100000004a3"},{"tid":717,"created_ino":"0x100000004a4"},{"tid":718,"created_ino":"0x100000004a5"},{"tid":719,"created_ino":"0x100000004a6"},{"tid":720,"created_ino":"0x100000004a7"},{"tid":721,"created_ino":"0x100000004a8"},{"tid":722,"created_ino":"0x100000004a9"},{"tid":723,"created_ino":"0x100000004aa"},{"tid":724,"created_ino":"0x100000004ab"},{"tid":725,"created_ino":"0x100000004ac"},{"tid":726,"created_ino":"0x100000004ad"},{"tid":727,"created_ino":"0x100000004ae"},{"tid":728,"created_ino":"0x100000004af"},{"tid":729,"created_ino":"0x100000004b0"},{"tid":730,"created_ino":"0x100000004b1"},{"tid":731,"created_ino":"0x100000004b2"},{"tid":732,"created_ino":"0x100000004b3"},{"tid":733,"created_ino":"0x100000004b4"},{"tid":734,"created_ino":"0x100000004b5"},{"tid":735,"created_ino":"0x100000004b6"},{"tid":736,"created_ino":"0x100000004b7"},{"tid":737,"created_ino":"0x100000004b8"},{"tid":738,"created_ino":"0x100000004b9"},{"tid":739,"created_ino":"0x100000004ba"},{"tid":740,"created_ino":"0x100000004bb"},{"tid":741,"created_ino":"0x100000004bc"},{"tid":742,"created_ino":"0x100000004bd"},{"tid":743,"created_ino":"0x100000004be"},{"tid":744,"created_ino":"0x100000004bf"},{"tid":745,"created_ino":"0x100000004c0"},{"tid":746,"created_ino":"0x100000004c1"},{"tid":747,"created_ino":"0x100000004c2"},{"tid":748,"created_ino":"0x100000004c3"},{"tid":749,"created_ino":"0x100000004c4"},{"tid":750,"created_ino":"0x100000004c5"},{"tid":751,"created_ino":"0x100000004c6"},{"tid":752,"created_ino":"0x100000004c7"},{"tid":753,"created_ino":"0x100000004c8"},{"tid":754,"created_ino":"0x100000004c9"},{"tid":755,"created_ino":"0x100000004ca"},{"tid":756,"created_ino":"0x100000004cb"},{"tid":757,"created_ino":"0x100000004cc"},{"tid":758,"created_ino":"0x100000004cd"},{"tid":759,"created_ino":"0x100000004ce"},{"tid":760,"created_ino":"0x100000004cf"},{"tid":761,"created_ino":"0x100000004d0"},{"tid":762,"created_ino":"0x100000004d1"},{"tid":763,"created_ino":"0x100000004d2"},{"tid":764,"created_ino":"0x100000004d3"},{"tid":765,"created_ino":"0x100000004d4"},{"tid":766,"created_ino":"0x100000004d5"},{"tid":767,"created_ino":"0x100000004d6"},{"tid":768,"created_ino":"0x100000004d7"},{"tid":769,"created_ino":"0x100000004d8"},{"tid":770,"created_ino":"0x100000004d9"},{"tid":771,"created_ino":"0x100000004da"},{"tid":772,"created_ino":"0x100000004db"},{"tid":773,"created_ino":"0x100000004dc"},{"tid":774,"created_ino":"0x100000004dd"},{"tid":775,"created_ino":"0x100000004de"},{"tid":776,"created_ino":"0x100000004df"},{"tid":777,"created_ino":"0x100000004e0"},{"tid":778,"created_ino":"0x100000004e1"},{"tid":779,"created_ino":"0x100000004e2"},{"tid":780,"created_ino":"0x100000004e3"},{"tid":781,"created_ino":"0x100000004e4"},{"tid":782,"created_ino":"0x100000004e5"},{"tid":783,"created_ino":"0x100000004e6"},{"tid":784,"created_ino":"0x100000004e7"},{"tid":785,"created_ino":"0x100000004e8"},{"tid":786,"created_ino":"0x100000004e9"},{"tid":787,"created_ino":"0x100000004ea"},{"tid":788,"created_ino":"0x100000004eb"},{"tid":789,"created_ino":"0x100000004ec"},{"tid":790,"created_ino":"0x100000004ed"},{"tid":791,"created_ino":"0x100000004ee"},{"tid":792,"created_ino":"0x100000004ef"},{"tid":793,"created_ino":"0x100000004f0"},{"tid":794,"created_ino":"0x100000004f1"},{"tid":795,"created_ino":"0x100000004f2"},{"tid":796,"created_ino":"0x100000004f3"},{"tid":797,"created_ino":"0x100000004f4"},{"tid":798,"created_ino":"0x100000004f5"},{"tid":799,"created_ino":"0x100000004f6"},{"tid":800,"created_ino":"0x100000004f7"},{"tid":801,"created_ino":"0x100000004f8"},{"tid":802,"created_ino":"0x100000004f9"},{"tid":803,"created_ino":"0x100000004fa"},{"tid":804,"created_ino":"0x100000004fb"},{"tid":805,"created_ino":"0x100000004fc"},{"tid":806,"created_ino":"0x100000004fd"},{"tid":807,"created_ino":"0x100000004fe"},{"tid":808,"created_ino":"0x100000004ff"},{"tid":809,"created_ino":"0x10000000500"},{"tid":810,"created_ino":"0x10000000501"},{"tid":811,"created_ino":"0x10000000502"},{"tid":812,"created_ino":"0x10000000503"},{"tid":813,"created_ino":"0x10000000504"},{"tid":814,"created_ino":"0x10000000505"},{"tid":815,"created_ino":"0x10000000506"},{"tid":816,"created_ino":"0x10000000507"},{"tid":817,"created_ino":"0x10000000508"},{"tid":818,"created_ino":"0x10000000509"},{"tid":819,"created_ino":"0x1000000050a"},{"tid":820,"created_ino":"0x1000000050b"},{"tid":821,"created_ino":"0x1000000050c"},{"tid":822,"created_ino":"0x1000000050d"},{"tid":823,"created_ino":"0x1000000050e"},{"tid":824,"created_ino":"0x1000000050f"},{"tid":825,"created_ino":"0x10000000510"},{"tid":826,"created_ino":"0x10000000511"},{"tid":827,"created_ino":"0x10000000512"},{"tid":828,"created_ino":"0x10000000513"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x10000000514","length":203},{"start":"0x100000005e0","length":501}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi060","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-12T01:42:53.847 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi105", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 2038000203, "type": "any" }, "name": { "num": 7275, "type": "client" } }, "id": 7275, "inst": "client.7275 172.21.15.105:0/2038000203", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.90263795566632 }, "state": "open", "uptime": 15.989672115 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi060", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x100000003e9", "tid": 530 }, { "created_ino": "0x100000003ea", "tid": 531 }, { "created_ino": "0x100000003eb", "tid": 532 }, { "created_ino": "0x100000003ec", "tid": 533 }, { "created_ino": "0x100000003ed", "tid": 534 }, { "created_ino": "0x100000003ee", "tid": 535 }, { "created_ino": "0x100000003ef", "tid": 536 }, { "created_ino": "0x100000003f0", "tid": 537 }, { "created_ino": "0x100000003f1", "tid": 538 }, { "created_ino": "0x100000003f2", "tid": 539 }, { "created_ino": "0x100000003f3", "tid": 540 }, { "created_ino": "0x100000003f4", "tid": 541 }, { "created_ino": "0x100000003f5", "tid": 542 }, { "created_ino": "0x100000003f6", "tid": 543 }, { "created_ino": "0x100000003f7", "tid": 544 }, { "created_ino": "0x100000003f8", "tid": 545 }, { "created_ino": "0x100000003f9", "tid": 546 }, { "created_ino": "0x100000003fa", "tid": 547 }, { "created_ino": "0x100000003fb", "tid": 548 }, { "created_ino": "0x100000003fc", "tid": 549 }, { "created_ino": "0x100000003fd", "tid": 550 }, { "created_ino": "0x100000003fe", "tid": 551 }, { "created_ino": "0x100000003ff", "tid": 552 }, { "created_ino": "0x10000000400", "tid": 553 }, { "created_ino": "0x10000000401", "tid": 554 }, { "created_ino": "0x10000000402", "tid": 555 }, { "created_ino": "0x10000000403", "tid": 556 }, { "created_ino": "0x10000000404", "tid": 557 }, { "created_ino": "0x10000000405", "tid": 558 }, { "created_ino": "0x10000000406", "tid": 559 }, { "created_ino": "0x10000000407", "tid": 560 }, { "created_ino": "0x10000000408", "tid": 561 }, { "created_ino": "0x10000000409", "tid": 562 }, { "created_ino": "0x1000000040a", "tid": 563 }, { "created_ino": "0x1000000040b", "tid": 564 }, { "created_ino": "0x1000000040c", "tid": 565 }, { "created_ino": "0x1000000040d", "tid": 566 }, { "created_ino": "0x1000000040e", "tid": 567 }, { "created_ino": "0x1000000040f", "tid": 568 }, { "created_ino": "0x10000000410", "tid": 569 }, { "created_ino": "0x10000000411", "tid": 570 }, { "created_ino": "0x10000000412", "tid": 571 }, { "created_ino": "0x10000000413", "tid": 572 }, { "created_ino": "0x10000000414", "tid": 573 }, { "created_ino": "0x10000000415", "tid": 574 }, { "created_ino": "0x10000000416", "tid": 575 }, { "created_ino": "0x10000000417", "tid": 576 }, { "created_ino": "0x10000000418", "tid": 577 }, { "created_ino": "0x10000000419", "tid": 578 }, { "created_ino": "0x1000000041a", "tid": 579 }, { "created_ino": "0x1000000041b", "tid": 580 }, { "created_ino": "0x1000000041c", "tid": 581 }, { "created_ino": "0x1000000041d", "tid": 582 }, { "created_ino": "0x1000000041e", "tid": 583 }, { "created_ino": "0x1000000041f", "tid": 584 }, { "created_ino": "0x10000000420", "tid": 585 }, { "created_ino": "0x10000000421", "tid": 586 }, { "created_ino": "0x10000000422", "tid": 587 }, { "created_ino": "0x10000000423", "tid": 588 }, { "created_ino": "0x10000000424", "tid": 589 }, { "created_ino": "0x10000000425", "tid": 590 }, { "created_ino": "0x10000000426", "tid": 591 }, { "created_ino": "0x10000000427", "tid": 592 }, { "created_ino": "0x10000000428", "tid": 593 }, { "created_ino": "0x10000000429", "tid": 594 }, { "created_ino": "0x1000000042a", "tid": 595 }, { "created_ino": "0x1000000042b", "tid": 596 }, { "created_ino": "0x1000000042c", "tid": 597 }, { "created_ino": "0x1000000042d", "tid": 598 }, { "created_ino": "0x1000000042e", "tid": 599 }, { "created_ino": "0x1000000042f", "tid": 600 }, { "created_ino": "0x10000000430", "tid": 601 }, { "created_ino": "0x10000000431", "tid": 602 }, { "created_ino": "0x10000000432", "tid": 603 }, { "created_ino": "0x10000000433", "tid": 604 }, { "created_ino": "0x10000000434", "tid": 605 }, { "created_ino": "0x10000000435", "tid": 606 }, { "created_ino": "0x10000000436", "tid": 607 }, { "created_ino": "0x10000000437", "tid": 608 }, { "created_ino": "0x10000000438", "tid": 609 }, { "created_ino": "0x10000000439", "tid": 610 }, { "created_ino": "0x1000000043a", "tid": 611 }, { "created_ino": "0x1000000043b", "tid": 612 }, { "created_ino": "0x1000000043c", "tid": 613 }, { "created_ino": "0x1000000043d", "tid": 614 }, { "created_ino": "0x1000000043e", "tid": 615 }, { "created_ino": "0x1000000043f", "tid": 616 }, { "created_ino": "0x10000000440", "tid": 617 }, { "created_ino": "0x10000000441", "tid": 618 }, { "created_ino": "0x10000000442", "tid": 619 }, { "created_ino": "0x10000000443", "tid": 620 }, { "created_ino": "0x10000000444", "tid": 621 }, { "created_ino": "0x10000000445", "tid": 622 }, { "created_ino": "0x10000000446", "tid": 623 }, { "created_ino": "0x10000000447", "tid": 624 }, { "created_ino": "0x10000000448", "tid": 625 }, { "created_ino": "0x10000000449", "tid": 626 }, { "created_ino": "0x1000000044a", "tid": 627 }, { "created_ino": "0x1000000044b", "tid": 628 }, { "created_ino": "0x1000000044c", "tid": 629 }, { "created_ino": "0x1000000044d", "tid": 630 }, { "created_ino": "0x1000000044e", "tid": 631 }, { "created_ino": "0x1000000044f", "tid": 632 }, { "created_ino": "0x10000000450", "tid": 633 }, { "created_ino": "0x10000000451", "tid": 634 }, { "created_ino": "0x10000000452", "tid": 635 }, { "created_ino": "0x10000000453", "tid": 636 }, { "created_ino": "0x10000000454", "tid": 637 }, { "created_ino": "0x10000000455", "tid": 638 }, { "created_ino": "0x10000000456", "tid": 639 }, { "created_ino": "0x10000000457", "tid": 640 }, { "created_ino": "0x10000000458", "tid": 641 }, { "created_ino": "0x10000000459", "tid": 642 }, { "created_ino": "0x1000000045a", "tid": 643 }, { "created_ino": "0x1000000045b", "tid": 644 }, { "created_ino": "0x1000000045c", "tid": 645 }, { "created_ino": "0x1000000045d", "tid": 646 }, { "created_ino": "0x1000000045e", "tid": 647 }, { "created_ino": "0x1000000045f", "tid": 648 }, { "created_ino": "0x10000000460", "tid": 649 }, { "created_ino": "0x10000000461", "tid": 650 }, { "created_ino": "0x10000000462", "tid": 651 }, { "created_ino": "0x10000000463", "tid": 652 }, { "created_ino": "0x10000000464", "tid": 653 }, { "created_ino": "0x10000000465", "tid": 654 }, { "created_ino": "0x10000000466", "tid": 655 }, { "created_ino": "0x10000000467", "tid": 656 }, { "created_ino": "0x10000000468", "tid": 657 }, { "created_ino": "0x10000000469", "tid": 658 }, { "created_ino": "0x1000000046a", "tid": 659 }, { "created_ino": "0x1000000046b", "tid": 660 }, { "created_ino": "0x1000000046c", "tid": 661 }, { "created_ino": "0x1000000046d", "tid": 662 }, { "created_ino": "0x1000000046e", "tid": 663 }, { "created_ino": "0x1000000046f", "tid": 664 }, { "created_ino": "0x10000000470", "tid": 665 }, { "created_ino": "0x10000000471", "tid": 666 }, { "created_ino": "0x10000000472", "tid": 667 }, { "created_ino": "0x10000000473", "tid": 668 }, { "created_ino": "0x10000000474", "tid": 669 }, { "created_ino": "0x10000000475", "tid": 670 }, { "created_ino": "0x10000000476", "tid": 671 }, { "created_ino": "0x10000000477", "tid": 672 }, { "created_ino": "0x10000000478", "tid": 673 }, { "created_ino": "0x10000000479", "tid": 674 }, { "created_ino": "0x1000000047a", "tid": 675 }, { "created_ino": "0x1000000047b", "tid": 676 }, { "created_ino": "0x1000000047c", "tid": 677 }, { "created_ino": "0x1000000047d", "tid": 678 }, { "created_ino": "0x1000000047e", "tid": 679 }, { "created_ino": "0x1000000047f", "tid": 680 }, { "created_ino": "0x10000000480", "tid": 681 }, { "created_ino": "0x10000000481", "tid": 682 }, { "created_ino": "0x10000000482", "tid": 683 }, { "created_ino": "0x10000000483", "tid": 684 }, { "created_ino": "0x10000000484", "tid": 685 }, { "created_ino": "0x10000000485", "tid": 686 }, { "created_ino": "0x10000000486", "tid": 687 }, { "created_ino": "0x10000000487", "tid": 688 }, { "created_ino": "0x10000000488", "tid": 689 }, { "created_ino": "0x10000000489", "tid": 690 }, { "created_ino": "0x1000000048a", "tid": 691 }, { "created_ino": "0x1000000048b", "tid": 692 }, { "created_ino": "0x1000000048c", "tid": 693 }, { "created_ino": "0x1000000048d", "tid": 694 }, { "created_ino": "0x1000000048e", "tid": 695 }, { "created_ino": "0x1000000048f", "tid": 696 }, { "created_ino": "0x10000000490", "tid": 697 }, { "created_ino": "0x10000000491", "tid": 698 }, { "created_ino": "0x10000000492", "tid": 699 }, { "created_ino": "0x10000000493", "tid": 700 }, { "created_ino": "0x10000000494", "tid": 701 }, { "created_ino": "0x10000000495", "tid": 702 }, { "created_ino": "0x10000000496", "tid": 703 }, { "created_ino": "0x10000000497", "tid": 704 }, { "created_ino": "0x10000000498", "tid": 705 }, { "created_ino": "0x10000000499", "tid": 706 }, { "created_ino": "0x1000000049a", "tid": 707 }, { "created_ino": "0x1000000049b", "tid": 708 }, { "created_ino": "0x1000000049c", "tid": 709 }, { "created_ino": "0x1000000049d", "tid": 710 }, { "created_ino": "0x1000000049e", "tid": 711 }, { "created_ino": "0x1000000049f", "tid": 712 }, { "created_ino": "0x100000004a0", "tid": 713 }, { "created_ino": "0x100000004a1", "tid": 714 }, { "created_ino": "0x100000004a2", "tid": 715 }, { "created_ino": "0x100000004a3", "tid": 716 }, { "created_ino": "0x100000004a4", "tid": 717 }, { "created_ino": "0x100000004a5", "tid": 718 }, { "created_ino": "0x100000004a6", "tid": 719 }, { "created_ino": "0x100000004a7", "tid": 720 }, { "created_ino": "0x100000004a8", "tid": 721 }, { "created_ino": "0x100000004a9", "tid": 722 }, { "created_ino": "0x100000004aa", "tid": 723 }, { "created_ino": "0x100000004ab", "tid": 724 }, { "created_ino": "0x100000004ac", "tid": 725 }, { "created_ino": "0x100000004ad", "tid": 726 }, { "created_ino": "0x100000004ae", "tid": 727 }, { "created_ino": "0x100000004af", "tid": 728 }, { "created_ino": "0x100000004b0", "tid": 729 }, { "created_ino": "0x100000004b1", "tid": 730 }, { "created_ino": "0x100000004b2", "tid": 731 }, { "created_ino": "0x100000004b3", "tid": 732 }, { "created_ino": "0x100000004b4", "tid": 733 }, { "created_ino": "0x100000004b5", "tid": 734 }, { "created_ino": "0x100000004b6", "tid": 735 }, { "created_ino": "0x100000004b7", "tid": 736 }, { "created_ino": "0x100000004b8", "tid": 737 }, { "created_ino": "0x100000004b9", "tid": 738 }, { "created_ino": "0x100000004ba", "tid": 739 }, { "created_ino": "0x100000004bb", "tid": 740 }, { "created_ino": "0x100000004bc", "tid": 741 }, { "created_ino": "0x100000004bd", "tid": 742 }, { "created_ino": "0x100000004be", "tid": 743 }, { "created_ino": "0x100000004bf", "tid": 744 }, { "created_ino": "0x100000004c0", "tid": 745 }, { "created_ino": "0x100000004c1", "tid": 746 }, { "created_ino": "0x100000004c2", "tid": 747 }, { "created_ino": "0x100000004c3", "tid": 748 }, { "created_ino": "0x100000004c4", "tid": 749 }, { "created_ino": "0x100000004c5", "tid": 750 }, { "created_ino": "0x100000004c6", "tid": 751 }, { "created_ino": "0x100000004c7", "tid": 752 }, { "created_ino": "0x100000004c8", "tid": 753 }, { "created_ino": "0x100000004c9", "tid": 754 }, { "created_ino": "0x100000004ca", "tid": 755 }, { "created_ino": "0x100000004cb", "tid": 756 }, { "created_ino": "0x100000004cc", "tid": 757 }, { "created_ino": "0x100000004cd", "tid": 758 }, { "created_ino": "0x100000004ce", "tid": 759 }, { "created_ino": "0x100000004cf", "tid": 760 }, { "created_ino": "0x100000004d0", "tid": 761 }, { "created_ino": "0x100000004d1", "tid": 762 }, { "created_ino": "0x100000004d2", "tid": 763 }, { "created_ino": "0x100000004d3", "tid": 764 }, { "created_ino": "0x100000004d4", "tid": 765 }, { "created_ino": "0x100000004d5", "tid": 766 }, { "created_ino": "0x100000004d6", "tid": 767 }, { "created_ino": "0x100000004d7", "tid": 768 }, { "created_ino": "0x100000004d8", "tid": 769 }, { "created_ino": "0x100000004d9", "tid": 770 }, { "created_ino": "0x100000004da", "tid": 771 }, { "created_ino": "0x100000004db", "tid": 772 }, { "created_ino": "0x100000004dc", "tid": 773 }, { "created_ino": "0x100000004dd", "tid": 774 }, { "created_ino": "0x100000004de", "tid": 775 }, { "created_ino": "0x100000004df", "tid": 776 }, { "created_ino": "0x100000004e0", "tid": 777 }, { "created_ino": "0x100000004e1", "tid": 778 }, { "created_ino": "0x100000004e2", "tid": 779 }, { "created_ino": "0x100000004e3", "tid": 780 }, { "created_ino": "0x100000004e4", "tid": 781 }, { "created_ino": "0x100000004e5", "tid": 782 }, { "created_ino": "0x100000004e6", "tid": 783 }, { "created_ino": "0x100000004e7", "tid": 784 }, { "created_ino": "0x100000004e8", "tid": 785 }, { "created_ino": "0x100000004e9", "tid": 786 }, { "created_ino": "0x100000004ea", "tid": 787 }, { "created_ino": "0x100000004eb", "tid": 788 }, { "created_ino": "0x100000004ec", "tid": 789 }, { "created_ino": "0x100000004ed", "tid": 790 }, { "created_ino": "0x100000004ee", "tid": 791 }, { "created_ino": "0x100000004ef", "tid": 792 }, { "created_ino": "0x100000004f0", "tid": 793 }, { "created_ino": "0x100000004f1", "tid": 794 }, { "created_ino": "0x100000004f2", "tid": 795 }, { "created_ino": "0x100000004f3", "tid": 796 }, { "created_ino": "0x100000004f4", "tid": 797 }, { "created_ino": "0x100000004f5", "tid": 798 }, { "created_ino": "0x100000004f6", "tid": 799 }, { "created_ino": "0x100000004f7", "tid": 800 }, { "created_ino": "0x100000004f8", "tid": 801 }, { "created_ino": "0x100000004f9", "tid": 802 }, { "created_ino": "0x100000004fa", "tid": 803 }, { "created_ino": "0x100000004fb", "tid": 804 }, { "created_ino": "0x100000004fc", "tid": 805 }, { "created_ino": "0x100000004fd", "tid": 806 }, { "created_ino": "0x100000004fe", "tid": 807 }, { "created_ino": "0x100000004ff", "tid": 808 }, { "created_ino": "0x10000000500", "tid": 809 }, { "created_ino": "0x10000000501", "tid": 810 }, { "created_ino": "0x10000000502", "tid": 811 }, { "created_ino": "0x10000000503", "tid": 812 }, { "created_ino": "0x10000000504", "tid": 813 }, { "created_ino": "0x10000000505", "tid": 814 }, { "created_ino": "0x10000000506", "tid": 815 }, { "created_ino": "0x10000000507", "tid": 816 }, { "created_ino": "0x10000000508", "tid": 817 }, { "created_ino": "0x10000000509", "tid": 818 }, { "created_ino": "0x1000000050a", "tid": 819 }, { "created_ino": "0x1000000050b", "tid": 820 }, { "created_ino": "0x1000000050c", "tid": 821 }, { "created_ino": "0x1000000050d", "tid": 822 }, { "created_ino": "0x1000000050e", "tid": 823 }, { "created_ino": "0x1000000050f", "tid": 824 }, { "created_ino": "0x10000000510", "tid": 825 }, { "created_ino": "0x10000000511", "tid": 826 }, { "created_ino": "0x10000000512", "tid": 827 }, { "created_ino": "0x10000000513", "tid": 828 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 3175978639, "type": "any" }, "name": { "num": 7263, "type": "client" } }, "id": 7263, "inst": "client.7263 192.168.0.1:0/3175978639", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 530, "num_caps": 462, "num_completed_flushes": 0, "num_completed_requests": 299, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 203, "start": "0x10000000514" }, { "length": 501, "start": "0x100000005e0" } ], "recall_caps": { "halflife": 60, "value": 4770.5950563610995 }, "recall_caps_throttle": { "halflife": 1.5, "value": 1033.359189682843 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 468.7834788350836 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 339.91164851194856 }, "request_load_avg": 711, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1557.3643519024454 }, "state": "open", "uptime": 17.095649435 } ] 2024-09-12T01:42:53.847 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T01:42:53.848 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:42:53.848 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:42:53.893 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:42:53.928 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:42:53.928 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:42:53.929 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 800\nabs_path = "/home/ubuntu/cephtest/mnt.0/subdir"\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi060') 2024-09-12T01:42:53.929 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:42:53.929 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:53.945 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:42:53.945 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:54.002 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:42:54.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.145+0000 7fee861bd640 1 Processor -- start 2024-09-12T01:42:54.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.145+0000 7fee861bd640 1 -- start start 2024-09-12T01:42:54.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.146+0000 7fee861bd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fee800cca40 0x7fee800b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.146+0000 7fee861bd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee80071720 con 0x7fee800720d0 2024-09-12T01:42:54.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.146+0000 7fee861bd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee80073920 con 0x7fee8015ad10 2024-09-12T01:42:54.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.146+0000 7fee861bd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fee80070fb0 con 0x7fee800cca40 2024-09-12T01:42:54.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.146+0000 7fee7effd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fee800720d0 0x7fee800b3ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44050/0 (socket says 172.21.15.60:44050) 2024-09-12T01:42:54.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.146+0000 7fee7effd640 1 -- 172.21.15.60:0/3369267058 learned_addr learned my addr 172.21.15.60:0/3369267058 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:54.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.146+0000 7fee7ffff640 1 --2- 172.21.15.60:0/3369267058 >> v2:172.21.15.105:3300/0 conn(0x7fee800cca40 0x7fee800b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.146+0000 7fee7e7fc640 1 -- 172.21.15.60:0/3369267058 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 877723929 0 0) 0x7fee80071720 con 0x7fee800720d0 2024-09-12T01:42:54.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.146+0000 7fee7e7fc640 1 -- 172.21.15.60:0/3369267058 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee68003520 con 0x7fee800720d0 2024-09-12T01:42:54.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.146+0000 7fee7e7fc640 1 -- 172.21.15.60:0/3369267058 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 262669515 0 0) 0x7fee80073920 con 0x7fee8015ad10 2024-09-12T01:42:54.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.147+0000 7fee7e7fc640 1 -- 172.21.15.60:0/3369267058 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee80071720 con 0x7fee8015ad10 2024-09-12T01:42:54.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.147+0000 7fee7ffff640 1 -- 172.21.15.60:0/3369267058 >> v1:172.21.15.105:6789/0 conn(0x7fee8015ad10 legacy=0x7fee800719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.147+0000 7fee7ffff640 1 -- 172.21.15.60:0/3369267058 >> v1:172.21.15.60:6789/0 conn(0x7fee800720d0 legacy=0x7fee800b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.147+0000 7fee7ffff640 1 -- 172.21.15.60:0/3369267058 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee80073c00 con 0x7fee800cca40 2024-09-12T01:42:54.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.147+0000 7fee7ffff640 1 --2- 172.21.15.60:0/3369267058 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800cca40 0x7fee800b45b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fee78009d90 tx=0x7fee7802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83b8e88ab2746a31 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:54.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.148+0000 7fee7e7fc640 1 -- 172.21.15.60:0/3369267058 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78007740 con 0x7fee800cca40 2024-09-12T01:42:54.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.148+0000 7fee7e7fc640 1 -- 172.21.15.60:0/3369267058 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee780078e0 con 0x7fee800cca40 2024-09-12T01:42:54.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.148+0000 7fee7e7fc640 1 -- 172.21.15.60:0/3369267058 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78007c90 con 0x7fee800cca40 2024-09-12T01:42:54.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.148+0000 7fee861bd640 1 -- 172.21.15.60:0/3369267058 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800cca40 msgr2=0x7fee800b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.148+0000 7fee861bd640 1 --2- 172.21.15.60:0/3369267058 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800cca40 0x7fee800b45b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fee78009d90 tx=0x7fee7802a660 comp rx=0 tx=0).stop 2024-09-12T01:42:54.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.148+0000 7fee861bd640 1 -- 172.21.15.60:0/3369267058 shutdown_connections 2024-09-12T01:42:54.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.148+0000 7fee861bd640 1 --2- 172.21.15.60:0/3369267058 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800cca40 0x7fee800b45b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.148+0000 7fee861bd640 1 -- 172.21.15.60:0/3369267058 >> 172.21.15.60:0/3369267058 conn(0x7fee8006d0f0 msgr2=0x7fee8006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:54.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.148+0000 7fee861bd640 1 -- 172.21.15.60:0/3369267058 shutdown_connections 2024-09-12T01:42:54.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.148+0000 7fee861bd640 1 -- 172.21.15.60:0/3369267058 wait complete. 2024-09-12T01:42:54.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.149+0000 7fee861bd640 1 Processor -- start 2024-09-12T01:42:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.150+0000 7fee861bd640 1 -- start start 2024-09-12T01:42:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.150+0000 7fee861bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800720d0 0x7fee800b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.150+0000 7fee861bd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee800cca40 0x7fee80152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.150+0000 7fee861bd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee8015ad10 0x7fee800af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.150+0000 7fee861bd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fee800cd770 con 0x7fee8015ad10 2024-09-12T01:42:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.150+0000 7fee861bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fee80071200 con 0x7fee800720d0 2024-09-12T01:42:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.150+0000 7fee861bd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fee800cd8f0 con 0x7fee800cca40 2024-09-12T01:42:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.150+0000 7fee7ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee8015ad10 0x7fee800af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.150+0000 7fee7ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee8015ad10 0x7fee800af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56382/0 (socket says 172.21.15.60:56382) 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.150+0000 7fee7ffff640 1 -- 172.21.15.60:0/1785668192 learned_addr learned my addr 172.21.15.60:0/1785668192 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee7f7fe640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800720d0 0x7fee800b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee7effd640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee800cca40 0x7fee80152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee7ffff640 1 -- 172.21.15.60:0/1785668192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee800cca40 msgr2=0x7fee80152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee7ffff640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee800cca40 0x7fee80152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee7ffff640 1 -- 172.21.15.60:0/1785668192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800720d0 msgr2=0x7fee800b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee7ffff640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800720d0 0x7fee800b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee7ffff640 1 -- 172.21.15.60:0/1785668192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee800b2320 con 0x7fee8015ad10 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee7f7fe640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800720d0 0x7fee800b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee7ffff640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee8015ad10 0x7fee800af1a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fee7802ac50 tx=0x7fee78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee67fff640 1 -- 172.21.15.60:0/1785668192 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7803f070 con 0x7fee8015ad10 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee67fff640 1 -- 172.21.15.60:0/1785668192 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee78031c40 con 0x7fee8015ad10 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee861bd640 1 -- 172.21.15.60:0/1785668192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee800b2600 con 0x7fee8015ad10 2024-09-12T01:42:54.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee67fff640 1 -- 172.21.15.60:0/1785668192 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78009450 con 0x7fee8015ad10 2024-09-12T01:42:54.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.151+0000 7fee861bd640 1 -- 172.21.15.60:0/1785668192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8015b1c0 con 0x7fee8015ad10 2024-09-12T01:42:54.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.152+0000 7fee861bd640 1 -- 172.21.15.60:0/1785668192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee80073920 con 0x7fee8015ad10 2024-09-12T01:42:54.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.152+0000 7fee67fff640 1 -- 172.21.15.60:0/1785668192 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fee78044460 con 0x7fee8015ad10 2024-09-12T01:42:54.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.153+0000 7fee67fff640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fee6c06be60 0x7fee6c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.153+0000 7fee67fff640 1 -- 172.21.15.60:0/1785668192 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7fee780ac640 con 0x7fee8015ad10 2024-09-12T01:42:54.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.153+0000 7fee7f7fe640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fee6c06be60 0x7fee6c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.153+0000 7fee7f7fe640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fee6c06be60 0x7fee6c06e320 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fee70001610 tx=0x7fee70009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:54.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.157+0000 7fee67fff640 1 -- 172.21.15.60:0/1785668192 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fee78049060 con 0x7fee8015ad10 2024-09-12T01:42:54.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.343+0000 7fee861bd640 1 -- 172.21.15.60:0/1785668192 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fee80071a60 con 0x7fee8015ad10 2024-09-12T01:42:54.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.343+0000 7fee67fff640 1 -- 172.21.15.60:0/1785668192 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v105) ==== 80+0+0 (secure 0 0 0) 0x7fee7807af90 con 0x7fee8015ad10 2024-09-12T01:42:54.344 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:42:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.345+0000 7fee861bd640 1 -- 172.21.15.60:0/1785668192 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fee6c06be60 msgr2=0x7fee6c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.345+0000 7fee861bd640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fee6c06be60 0x7fee6c06e320 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fee70001610 tx=0x7fee70009040 comp rx=0 tx=0).stop 2024-09-12T01:42:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.345+0000 7fee861bd640 1 -- 172.21.15.60:0/1785668192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee8015ad10 msgr2=0x7fee800af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.345+0000 7fee861bd640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee8015ad10 0x7fee800af1a0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fee7802ac50 tx=0x7fee78004a40 comp rx=0 tx=0).stop 2024-09-12T01:42:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.345+0000 7fee861bd640 1 -- 172.21.15.60:0/1785668192 shutdown_connections 2024-09-12T01:42:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.345+0000 7fee861bd640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee8015ad10 0x7fee800af1a0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.345+0000 7fee861bd640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fee6c06be60 0x7fee6c06e320 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.345+0000 7fee861bd640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fee800cca40 0x7fee80152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.345+0000 7fee861bd640 1 --2- 172.21.15.60:0/1785668192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fee800720d0 0x7fee800b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.345+0000 7fee861bd640 1 -- 172.21.15.60:0/1785668192 >> 172.21.15.60:0/1785668192 conn(0x7fee8006d0f0 msgr2=0x7fee800b4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.345+0000 7fee861bd640 1 -- 172.21.15.60:0/1785668192 shutdown_connections 2024-09-12T01:42:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.345+0000 7fee861bd640 1 -- 172.21.15.60:0/1785668192 wait complete. 2024-09-12T01:42:54.357 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:42:54.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:54.357 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:42:54.564 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:42:54.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:54.564 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:42:54.580 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:42:54.581 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:42:54.581 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:54.596 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:42:54.596 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:54.652 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:42:54.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.756+0000 7fa40d4af640 1 Processor -- start 2024-09-12T01:42:54.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.756+0000 7fa40d4af640 1 -- start start 2024-09-12T01:42:54.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.756+0000 7fa40d4af640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa40815e6f0 0x7fa40806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.756+0000 7fa40d4af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa40806e990 con 0x7fa4080b7450 2024-09-12T01:42:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.756+0000 7fa40d4af640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa40806ec70 con 0x7fa4080b54d0 2024-09-12T01:42:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.756+0000 7fa40d4af640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa40815ec70 con 0x7fa40815e6f0 2024-09-12T01:42:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.757+0000 7fa4077fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa4080b7450 0x7fa408070830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44060/0 (socket says 172.21.15.60:44060) 2024-09-12T01:42:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.757+0000 7fa4077fe640 1 -- 172.21.15.60:0/2762178584 learned_addr learned my addr 172.21.15.60:0/2762178584 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.757+0000 7fa406ffd640 1 --2- 172.21.15.60:0/2762178584 >> v2:172.21.15.105:3300/0 conn(0x7fa40815e6f0 0x7fa40806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.757+0000 7fa405ffb640 1 -- 172.21.15.60:0/2762178584 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1750727637 0 0) 0x7fa40806e990 con 0x7fa4080b7450 2024-09-12T01:42:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.757+0000 7fa405ffb640 1 -- 172.21.15.60:0/2762178584 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3f0003520 con 0x7fa4080b7450 2024-09-12T01:42:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.757+0000 7fa405ffb640 1 -- 172.21.15.60:0/2762178584 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255132338 0 0) 0x7fa40806ec70 con 0x7fa4080b54d0 2024-09-12T01:42:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.757+0000 7fa405ffb640 1 -- 172.21.15.60:0/2762178584 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa40806e990 con 0x7fa4080b54d0 2024-09-12T01:42:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.757+0000 7fa406ffd640 1 -- 172.21.15.60:0/2762178584 >> v1:172.21.15.105:6789/0 conn(0x7fa4080b54d0 legacy=0x7fa4080b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.757+0000 7fa406ffd640 1 -- 172.21.15.60:0/2762178584 >> v1:172.21.15.60:6789/0 conn(0x7fa4080b7450 legacy=0x7fa408070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.757+0000 7fa406ffd640 1 -- 172.21.15.60:0/2762178584 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa40815ef50 con 0x7fa40815e6f0 2024-09-12T01:42:54.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.758+0000 7fa406ffd640 1 --2- 172.21.15.60:0/2762178584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa40815e6f0 0x7fa40806fd00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80097a0 tx=0x7fa3f802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bceecadbced80695 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:54.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.758+0000 7fa405ffb640 1 -- 172.21.15.60:0/2762178584 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8037070 con 0x7fa40815e6f0 2024-09-12T01:42:54.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.758+0000 7fa405ffb640 1 -- 172.21.15.60:0/2762178584 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3f8032440 con 0x7fa40815e6f0 2024-09-12T01:42:54.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.758+0000 7fa405ffb640 1 -- 172.21.15.60:0/2762178584 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3f80327f0 con 0x7fa40815e6f0 2024-09-12T01:42:54.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.759+0000 7fa40d4af640 1 -- 172.21.15.60:0/2762178584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa40815e6f0 msgr2=0x7fa40806fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.759+0000 7fa40d4af640 1 --2- 172.21.15.60:0/2762178584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa40815e6f0 0x7fa40806fd00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80097a0 tx=0x7fa3f802a230 comp rx=0 tx=0).stop 2024-09-12T01:42:54.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.759+0000 7fa40d4af640 1 -- 172.21.15.60:0/2762178584 shutdown_connections 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.759+0000 7fa40d4af640 1 --2- 172.21.15.60:0/2762178584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa40815e6f0 0x7fa40806fd00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.759+0000 7fa40d4af640 1 -- 172.21.15.60:0/2762178584 >> 172.21.15.60:0/2762178584 conn(0x7fa4080d2430 msgr2=0x7fa4080d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.759+0000 7fa40d4af640 1 -- 172.21.15.60:0/2762178584 shutdown_connections 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.759+0000 7fa40d4af640 1 -- 172.21.15.60:0/2762178584 wait complete. 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.760+0000 7fa40d4af640 1 Processor -- start 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.760+0000 7fa40d4af640 1 -- start start 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa40d4af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4080b54d0 0x7fa40815d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa40d4af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4080b7450 0x7fa4080cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa40d4af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa40815e6f0 0x7fa4080cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa40d4af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa40806e730 con 0x7fa40815e6f0 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa40d4af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa40806e5b0 con 0x7fa4080b7450 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa40d4af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa40815f750 con 0x7fa4080b54d0 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa4077fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa40815e6f0 0x7fa4080cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa4077fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa40815e6f0 0x7fa4080cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56396/0 (socket says 172.21.15.60:56396) 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa4077fe640 1 -- 172.21.15.60:0/789173254 learned_addr learned my addr 172.21.15.60:0/789173254 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa4067fc640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4080b7450 0x7fa4080cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa406ffd640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4080b54d0 0x7fa40815d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa4077fe640 1 -- 172.21.15.60:0/789173254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4080b54d0 msgr2=0x7fa40815d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa4077fe640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4080b54d0 0x7fa40815d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa4077fe640 1 -- 172.21.15.60:0/789173254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4080b7450 msgr2=0x7fa4080cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa4077fe640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4080b7450 0x7fa4080cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa4077fe640 1 -- 172.21.15.60:0/789173254 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4080cd460 con 0x7fa40815e6f0 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.761+0000 7fa4077fe640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa40815e6f0 0x7fa4080cbd20 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fa40000cba0 tx=0x7fa40000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.762+0000 7fa3ef7fe640 1 -- 172.21.15.60:0/789173254 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa400017070 con 0x7fa40815e6f0 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.762+0000 7fa3ef7fe640 1 -- 172.21.15.60:0/789173254 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40000ace0 con 0x7fa40815e6f0 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.762+0000 7fa40d4af640 1 -- 172.21.15.60:0/789173254 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4080cc3c0 con 0x7fa40815e6f0 2024-09-12T01:42:54.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.762+0000 7fa3ef7fe640 1 -- 172.21.15.60:0/789173254 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa400012620 con 0x7fa40815e6f0 2024-09-12T01:42:54.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.762+0000 7fa40d4af640 1 -- 172.21.15.60:0/789173254 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4080cc980 con 0x7fa40815e6f0 2024-09-12T01:42:54.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.763+0000 7fa40d4af640 1 -- 172.21.15.60:0/789173254 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa408068e10 con 0x7fa40815e6f0 2024-09-12T01:42:54.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.763+0000 7fa3ef7fe640 1 -- 172.21.15.60:0/789173254 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa40001a070 con 0x7fa40815e6f0 2024-09-12T01:42:54.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.764+0000 7fa3ef7fe640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa3f406be30 0x7fa3f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:54.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.764+0000 7fa3ef7fe640 1 -- 172.21.15.60:0/789173254 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7fa40008abf0 con 0x7fa40815e6f0 2024-09-12T01:42:54.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.764+0000 7fa406ffd640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa3f406be30 0x7fa3f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:54.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.764+0000 7fa406ffd640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa3f406be30 0x7fa3f406e2f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8034000 tx=0x7fa3f802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:54.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.768+0000 7fa3ef7fe640 1 -- 172.21.15.60:0/789173254 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa400058f80 con 0x7fa40815e6f0 2024-09-12T01:42:54.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.959+0000 7fa40d4af640 1 -- 172.21.15.60:0/789173254 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa408159f70 con 0x7fa40815e6f0 2024-09-12T01:42:54.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.959+0000 7fa3ef7fe640 1 -- 172.21.15.60:0/789173254 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v105) ==== 80+0+0 (secure 0 0 0) 0x7fa40005d280 con 0x7fa40815e6f0 2024-09-12T01:42:54.959 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:42:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.961+0000 7fa40d4af640 1 -- 172.21.15.60:0/789173254 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa3f406be30 msgr2=0x7fa3f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.961+0000 7fa40d4af640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa3f406be30 0x7fa3f406e2f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8034000 tx=0x7fa3f802e000 comp rx=0 tx=0).stop 2024-09-12T01:42:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.961+0000 7fa40d4af640 1 -- 172.21.15.60:0/789173254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa40815e6f0 msgr2=0x7fa4080cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.961+0000 7fa40d4af640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa40815e6f0 0x7fa4080cbd20 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fa40000cba0 tx=0x7fa40000a430 comp rx=0 tx=0).stop 2024-09-12T01:42:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.961+0000 7fa40d4af640 1 -- 172.21.15.60:0/789173254 shutdown_connections 2024-09-12T01:42:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.961+0000 7fa40d4af640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa40815e6f0 0x7fa4080cbd20 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.961+0000 7fa40d4af640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4080b7450 0x7fa4080cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.961+0000 7fa40d4af640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa3f406be30 0x7fa3f406e2f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.961+0000 7fa40d4af640 1 --2- 172.21.15.60:0/789173254 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4080b54d0 0x7fa40815d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.961+0000 7fa40d4af640 1 -- 172.21.15.60:0/789173254 >> 172.21.15.60:0/789173254 conn(0x7fa4080d2430 msgr2=0x7fa40815a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.961+0000 7fa40d4af640 1 -- 172.21.15.60:0/789173254 shutdown_connections 2024-09-12T01:42:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:54.961+0000 7fa40d4af640 1 -- 172.21.15.60:0/789173254 wait complete. 2024-09-12T01:42:54.972 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:42:54.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:54.973 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T01:42:55.000 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:42:55.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:42:55.001 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:42:55.056 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:42:55.056 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:42:55.056 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:55.073 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:42:55.073 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:42:55.073 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:42:55.073 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:42:55.112 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:42:55.113 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:55.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.214+0000 7f9102f6f640 1 Processor -- start 2024-09-12T01:42:55.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.214+0000 7f9102f6f640 1 -- start start 2024-09-12T01:42:55.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.215+0000 7f9102f6f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f90fc15e540 0x7f90fc0ae890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.215+0000 7f9102f6f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 0x7f90fc06e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.215+0000 7f9102f6f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90fc0b52c0 con 0x7f90fc06e630 2024-09-12T01:42:55.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.215+0000 7f9102f6f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f90fc0aedd0 con 0x7f90fc15e540 2024-09-12T01:42:55.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.215+0000 7f9102f6f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f90fc0af000 con 0x7f90fc072d50 2024-09-12T01:42:55.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.216+0000 7f9100d0b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f90fc15e540 0x7f90fc0ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.216+0000 7f90fbfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 0x7f90fc06e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.216+0000 7f90fbfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 0x7f90fc06e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:41876/0 (socket says 172.21.15.60:41876) 2024-09-12T01:42:55.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.216+0000 7f90fbfff640 1 -- 172.21.15.60:0/4039108040 learned_addr learned my addr 172.21.15.60:0/4039108040 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:55.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.216+0000 7f910150c640 1 --1- 172.21.15.60:0/4039108040 >> v1:172.21.15.105:6789/0 conn(0x7f90fc06e630 0x7f90fc071810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:34328/0 (socket says 172.21.15.60:34328) 2024-09-12T01:42:55.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.216+0000 7f9100d0b640 1 -- 172.21.15.60:0/4039108040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 msgr2=0x7f90fc06e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:55.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.216+0000 7f9100d0b640 1 --2- 172.21.15.60:0/4039108040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 0x7f90fc06e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.216+0000 7f9100d0b640 1 -- 172.21.15.60:0/4039108040 >> v1:172.21.15.105:6789/0 conn(0x7f90fc06e630 legacy=0x7f90fc071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.216+0000 7f9100d0b640 1 -- 172.21.15.60:0/4039108040 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90fc0af2e0 con 0x7f90fc15e540 2024-09-12T01:42:55.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.216+0000 7f90fb7fe640 1 -- 172.21.15.60:0/4039108040 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 805429011 0 0) 0x7f90fc0b52c0 con 0x7f90fc06e630 2024-09-12T01:42:55.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.216+0000 7f90fbfff640 1 --2- 172.21.15.60:0/4039108040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 0x7f90fc06e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:55.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.217+0000 7f9100d0b640 1 --2- 172.21.15.60:0/4039108040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90fc15e540 0x7f90fc0ae890 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0097a0 tx=0x7f90ec02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f6173eab07d873e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:55.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.217+0000 7f90fb7fe640 1 -- 172.21.15.60:0/4039108040 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec037070 con 0x7f90fc15e540 2024-09-12T01:42:55.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.217+0000 7f90fb7fe640 1 -- 172.21.15.60:0/4039108040 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90ec02ae50 con 0x7f90fc15e540 2024-09-12T01:42:55.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.217+0000 7f90fb7fe640 1 -- 172.21.15.60:0/4039108040 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ec032660 con 0x7f90fc15e540 2024-09-12T01:42:55.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.217+0000 7f9102f6f640 1 -- 172.21.15.60:0/4039108040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90fc15e540 msgr2=0x7f90fc0ae890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.217+0000 7f9102f6f640 1 --2- 172.21.15.60:0/4039108040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90fc15e540 0x7f90fc0ae890 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f90ec0097a0 tx=0x7f90ec02a100 comp rx=0 tx=0).stop 2024-09-12T01:42:55.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.217+0000 7f9102f6f640 1 -- 172.21.15.60:0/4039108040 shutdown_connections 2024-09-12T01:42:55.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.217+0000 7f9102f6f640 1 --2- 172.21.15.60:0/4039108040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 0x7f90fc06e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.219 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.217+0000 7f9102f6f640 1 --2- 172.21.15.60:0/4039108040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90fc15e540 0x7f90fc0ae890 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.217+0000 7f9102f6f640 1 -- 172.21.15.60:0/4039108040 >> 172.21.15.60:0/4039108040 conn(0x7f90fc06bc10 msgr2=0x7f90fc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:55.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.217+0000 7f9102f6f640 1 -- 172.21.15.60:0/4039108040 shutdown_connections 2024-09-12T01:42:55.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.217+0000 7f9102f6f640 1 -- 172.21.15.60:0/4039108040 wait complete. 2024-09-12T01:42:55.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.219+0000 7f9102f6f640 1 Processor -- start 2024-09-12T01:42:55.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.219+0000 7f9102f6f640 1 -- start start 2024-09-12T01:42:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.219+0000 7f9102f6f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90fc06e630 0x7f90fc156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.219+0000 7f9102f6f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 0x7f90fc1e9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.219+0000 7f9102f6f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc15e540 0x7f90fc1435e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.219+0000 7f9102f6f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc15e920 con 0x7f90fc15e540 2024-09-12T01:42:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.219+0000 7f9102f6f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc0af8a0 con 0x7f90fc06e630 2024-09-12T01:42:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.219+0000 7f9102f6f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f90fc0b67b0 con 0x7f90fc072d50 2024-09-12T01:42:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f910150c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc15e540 0x7f90fc1435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f910150c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc15e540 0x7f90fc1435e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56404/0 (socket says 172.21.15.60:56404) 2024-09-12T01:42:55.222 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f910150c640 1 -- 172.21.15.60:0/1311402400 learned_addr learned my addr 172.21.15.60:0/1311402400 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f90fbfff640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 0x7f90fc1e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f9100d0b640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90fc06e630 0x7f90fc156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f910150c640 1 -- 172.21.15.60:0/1311402400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 msgr2=0x7f90fc1e9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f910150c640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 0x7f90fc1e9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f910150c640 1 -- 172.21.15.60:0/1311402400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90fc06e630 msgr2=0x7f90fc156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f910150c640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90fc06e630 0x7f90fc156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f910150c640 1 -- 172.21.15.60:0/1311402400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90fc141500 con 0x7f90fc15e540 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f90fbfff640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 0x7f90fc1e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f910150c640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc15e540 0x7f90fc1435e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f90f400c7a0 tx=0x7f90f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f90f97fa640 1 -- 172.21.15.60:0/1311402400 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f4018070 con 0x7f90fc15e540 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f90f97fa640 1 -- 172.21.15.60:0/1311402400 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90f400a640 con 0x7f90fc15e540 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f9102f6f640 1 -- 172.21.15.60:0/1311402400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90fc1440c0 con 0x7f90fc15e540 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f90f97fa640 1 -- 172.21.15.60:0/1311402400 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f400aab0 con 0x7f90fc15e540 2024-09-12T01:42:55.223 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.220+0000 7f9102f6f640 1 -- 172.21.15.60:0/1311402400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90fc143b20 con 0x7f90fc15e540 2024-09-12T01:42:55.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.222+0000 7f9102f6f640 1 -- 172.21.15.60:0/1311402400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90fc06e0f0 con 0x7f90fc15e540 2024-09-12T01:42:55.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.222+0000 7f90f97fa640 1 -- 172.21.15.60:0/1311402400 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f90f401b070 con 0x7f90fc15e540 2024-09-12T01:42:55.224 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.222+0000 7f90f97fa640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f90e806be30 0x7f90e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.223+0000 7f90f97fa640 1 -- 172.21.15.60:0/1311402400 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f90f408a510 con 0x7f90fc15e540 2024-09-12T01:42:55.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.223+0000 7f9100d0b640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f90e806be30 0x7f90e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.223+0000 7f9100d0b640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f90e806be30 0x7f90e806e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f90ec034000 tx=0x7f90ec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:55.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.227+0000 7f90f97fa640 1 -- 172.21.15.60:0/1311402400 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f90f4058e60 con 0x7f90fc15e540 2024-09-12T01:42:55.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.438+0000 7f9102f6f640 1 -- 172.21.15.60:0/1311402400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90fc072b30 con 0x7f90fc15e540 2024-09-12T01:42:55.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.439+0000 7f90f97fa640 1 -- 172.21.15.60:0/1311402400 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5231 (secure 0 0 0) 0x7f90f4058760 con 0x7f90fc15e540 2024-09-12T01:42:55.439 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:55.439 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":63,"btime":"2024-09-12T01:42:46:901027+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3412598725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3412598725},{"type":"v1","addr":"172.21.15.60:6837","nonce":3412598725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2966702196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2966702196},{"type":"v1","addr":"172.21.15.60:6836","nonce":2966702196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7107,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3682228949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3682228949},{"type":"v1","addr":"172.21.15.105:6834","nonce":3682228949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:42:26.063083+0000","modified":"2024-09-12T01:42:46.766209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7110},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7110":{"gid":7110,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6835/3881960029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3881960029},{"type":"v1","addr":"172.21.15.105:6835","nonce":3881960029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7110,"qdb_cluster":[7110]},"id":8}]} 2024-09-12T01:42:55.440 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 63 2024-09-12T01:42:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.441+0000 7f9102f6f640 1 -- 172.21.15.60:0/1311402400 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f90e806be30 msgr2=0x7f90e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.441+0000 7f9102f6f640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f90e806be30 0x7f90e806e2f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f90ec034000 tx=0x7f90ec02e000 comp rx=0 tx=0).stop 2024-09-12T01:42:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.441+0000 7f9102f6f640 1 -- 172.21.15.60:0/1311402400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc15e540 msgr2=0x7f90fc1435e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.441+0000 7f9102f6f640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc15e540 0x7f90fc1435e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f90f400c7a0 tx=0x7f90f400cc60 comp rx=0 tx=0).stop 2024-09-12T01:42:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.441+0000 7f9102f6f640 1 -- 172.21.15.60:0/1311402400 shutdown_connections 2024-09-12T01:42:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.441+0000 7f9102f6f640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90fc15e540 0x7f90fc1435e0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.441+0000 7f9102f6f640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f90e806be30 0x7f90e806e2f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.441+0000 7f9102f6f640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f90fc072d50 0x7f90fc1e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.441+0000 7f9102f6f640 1 --2- 172.21.15.60:0/1311402400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f90fc06e630 0x7f90fc156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.441+0000 7f9102f6f640 1 -- 172.21.15.60:0/1311402400 >> 172.21.15.60:0/1311402400 conn(0x7f90fc06bc10 msgr2=0x7f90fc1553e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.441+0000 7f9102f6f640 1 -- 172.21.15.60:0/1311402400 shutdown_connections 2024-09-12T01:42:55.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.441+0000 7f9102f6f640 1 -- 172.21.15.60:0/1311402400 wait complete. 2024-09-12T01:42:55.453 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:55.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.554+0000 7f4acd8ac640 1 Processor -- start 2024-09-12T01:42:55.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.554+0000 7f4acd8ac640 1 -- start start 2024-09-12T01:42:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.555+0000 7f4acd8ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ac80b6160 0x7f4ac80b6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.555+0000 7f4acd8ac640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4ac80b7880 0x7f4ac80b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.555+0000 7f4acd8ac640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac80b6ac0 con 0x7f4ac815e860 2024-09-12T01:42:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.555+0000 7f4acd8ac640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac80d40d0 con 0x7f4ac80b7880 2024-09-12T01:42:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.555+0000 7f4acd8ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac80d34c0 con 0x7f4ac80b6160 2024-09-12T01:42:55.556 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.555+0000 7f4ac77fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4ac80b7880 0x7f4ac80b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.555+0000 7f4ac67fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ac80b6160 0x7f4ac80b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.555+0000 7f4ac77fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4ac80b7880 0x7f4ac80b7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:53814/0 (socket says 172.21.15.60:53814) 2024-09-12T01:42:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.555+0000 7f4ac77fe640 1 -- 172.21.15.60:0/946780073 learned_addr learned my addr 172.21.15.60:0/946780073 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.555+0000 7f4ac6ffd640 1 --1- 172.21.15.60:0/946780073 >> v1:172.21.15.105:6789/0 conn(0x7f4ac815e860 0x7f4ac80d2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:34336/0 (socket says 172.21.15.60:34336) 2024-09-12T01:42:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.556+0000 7f4ac77fe640 1 -- 172.21.15.60:0/946780073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ac80b6160 msgr2=0x7f4ac80b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.556+0000 7f4ac77fe640 1 --2- 172.21.15.60:0/946780073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ac80b6160 0x7f4ac80b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.556+0000 7f4ac77fe640 1 -- 172.21.15.60:0/946780073 >> v1:172.21.15.105:6789/0 conn(0x7f4ac815e860 legacy=0x7f4ac80d2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.556+0000 7f4ac5ffb640 1 -- 172.21.15.60:0/946780073 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649139581 0 0) 0x7f4ac80b6ac0 con 0x7f4ac815e860 2024-09-12T01:42:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.556+0000 7f4ac77fe640 1 -- 172.21.15.60:0/946780073 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac80d37a0 con 0x7f4ac80b7880 2024-09-12T01:42:55.557 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.556+0000 7f4ac67fc640 1 --2- 172.21.15.60:0/946780073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ac80b6160 0x7f4ac80b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.556+0000 7f4ac77fe640 1 --2- 172.21.15.60:0/946780073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ac80b7880 0x7f4ac80b7d30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009e50 tx=0x7f4ac002a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecfdcc5560f09672 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.557+0000 7f4ac5ffb640 1 -- 172.21.15.60:0/946780073 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0036070 con 0x7f4ac80b7880 2024-09-12T01:42:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.557+0000 7f4ac5ffb640 1 -- 172.21.15.60:0/946780073 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ac0031600 con 0x7f4ac80b7880 2024-09-12T01:42:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.557+0000 7f4ac5ffb640 1 -- 172.21.15.60:0/946780073 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ac00319d0 con 0x7f4ac80b7880 2024-09-12T01:42:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.557+0000 7f4acd8ac640 1 -- 172.21.15.60:0/946780073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ac80b7880 msgr2=0x7f4ac80b7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.557+0000 7f4acd8ac640 1 --2- 172.21.15.60:0/946780073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ac80b7880 0x7f4ac80b7d30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009e50 tx=0x7f4ac002a730 comp rx=0 tx=0).stop 2024-09-12T01:42:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.557+0000 7f4acd8ac640 1 -- 172.21.15.60:0/946780073 shutdown_connections 2024-09-12T01:42:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.557+0000 7f4acd8ac640 1 --2- 172.21.15.60:0/946780073 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ac80b7880 0x7f4ac80b7d30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.557+0000 7f4acd8ac640 1 --2- 172.21.15.60:0/946780073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ac80b6160 0x7f4ac80b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.557+0000 7f4acd8ac640 1 -- 172.21.15.60:0/946780073 >> 172.21.15.60:0/946780073 conn(0x7f4ac8062c60 msgr2=0x7f4ac80d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:55.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.557+0000 7f4acd8ac640 1 -- 172.21.15.60:0/946780073 shutdown_connections 2024-09-12T01:42:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.557+0000 7f4acd8ac640 1 -- 172.21.15.60:0/946780073 wait complete. 2024-09-12T01:42:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.558+0000 7f4acd8ac640 1 Processor -- start 2024-09-12T01:42:55.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.559+0000 7f4acd8ac640 1 -- start start 2024-09-12T01:42:55.561 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.559+0000 7f4acd8ac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ac80b6160 0x7f4ac8150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.559+0000 7f4acd8ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ac80b7880 0x7f4ac81502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.559+0000 7f4acd8ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ac815e860 0x7f4ac8161250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.559+0000 7f4acd8ac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac80d31c0 con 0x7f4ac80b7880 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.559+0000 7f4acd8ac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac80d3d60 con 0x7f4ac80b6160 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.559+0000 7f4acd8ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac80b3890 con 0x7f4ac815e860 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4ac67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ac80b7880 0x7f4ac81502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4ac67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ac80b7880 0x7f4ac81502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56406/0 (socket says 172.21.15.60:56406) 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4ac67fc640 1 -- 172.21.15.60:0/3378786666 learned_addr learned my addr 172.21.15.60:0/3378786666 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4ac6ffd640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ac80b6160 0x7f4ac8150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4ac77fe640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ac815e860 0x7f4ac8161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4ac67fc640 1 -- 172.21.15.60:0/3378786666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ac815e860 msgr2=0x7f4ac8161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4ac67fc640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ac815e860 0x7f4ac8161250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.562 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4ac67fc640 1 -- 172.21.15.60:0/3378786666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ac80b6160 msgr2=0x7f4ac8150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4ac67fc640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ac80b6160 0x7f4ac8150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4ac67fc640 1 -- 172.21.15.60:0/3378786666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac80cb280 con 0x7f4ac80b7880 2024-09-12T01:42:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4ac6ffd640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ac80b6160 0x7f4ac8150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4ac67fc640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ac80b7880 0x7f4ac81502a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00ebb0 tx=0x7f4abc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4aaffff640 1 -- 172.21.15.60:0/3378786666 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc017070 con 0x7f4ac80b7880 2024-09-12T01:42:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4acd8ac640 1 -- 172.21.15.60:0/3378786666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac8150840 con 0x7f4ac80b7880 2024-09-12T01:42:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4aaffff640 1 -- 172.21.15.60:0/3378786666 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4abc00cc30 con 0x7f4ac80b7880 2024-09-12T01:42:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4aaffff640 1 -- 172.21.15.60:0/3378786666 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc013470 con 0x7f4ac80b7880 2024-09-12T01:42:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.560+0000 7f4acd8ac640 1 -- 172.21.15.60:0/3378786666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac80c9370 con 0x7f4ac80b7880 2024-09-12T01:42:55.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.561+0000 7f4acd8ac640 1 -- 172.21.15.60:0/3378786666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac80b6580 con 0x7f4ac80b7880 2024-09-12T01:42:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.562+0000 7f4aaffff640 1 -- 172.21.15.60:0/3378786666 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4abc01a070 con 0x7f4ac80b7880 2024-09-12T01:42:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.562+0000 7f4aaffff640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ab406be30 0x7f4ab406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.563+0000 7f4aaffff640 1 -- 172.21.15.60:0/3378786666 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f4abc08af70 con 0x7f4ac80b7880 2024-09-12T01:42:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.563+0000 7f4ac6ffd640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ab406be30 0x7f4ab406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.563+0000 7f4ac6ffd640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ab406be30 0x7f4ab406e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8000f60 tx=0x7f4ab8007cc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:55.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.567+0000 7f4aaffff640 1 -- 172.21.15.60:0/3378786666 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4abc0597a0 con 0x7f4ac80b7880 2024-09-12T01:42:55.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.779+0000 7f4acd8ac640 1 -- 172.21.15.60:0/3378786666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ac80b6a40 con 0x7f4ac80b7880 2024-09-12T01:42:55.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.780+0000 7f4aaffff640 1 -- 172.21.15.60:0/3378786666 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5231 (secure 0 0 0) 0x7f4abc0590a0 con 0x7f4ac80b7880 2024-09-12T01:42:55.781 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:55.781 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":63,"btime":"2024-09-12T01:42:46:901027+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3412598725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3412598725},{"type":"v1","addr":"172.21.15.60:6837","nonce":3412598725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2966702196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2966702196},{"type":"v1","addr":"172.21.15.60:6836","nonce":2966702196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7107,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3682228949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3682228949},{"type":"v1","addr":"172.21.15.105:6834","nonce":3682228949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:42:26.063083+0000","modified":"2024-09-12T01:42:46.766209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7110},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7110":{"gid":7110,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6835/3881960029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3881960029},{"type":"v1","addr":"172.21.15.105:6835","nonce":3881960029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7110,"qdb_cluster":[7110]},"id":8}]} 2024-09-12T01:42:55.781 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 63 2024-09-12T01:42:55.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.782+0000 7f4acd8ac640 1 -- 172.21.15.60:0/3378786666 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ab406be30 msgr2=0x7f4ab406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.782+0000 7f4acd8ac640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ab406be30 0x7f4ab406e2f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8000f60 tx=0x7f4ab8007cc0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.782+0000 7f4acd8ac640 1 -- 172.21.15.60:0/3378786666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ac80b7880 msgr2=0x7f4ac81502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.782+0000 7f4acd8ac640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ac80b7880 0x7f4ac81502a0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00ebb0 tx=0x7f4abc00c520 comp rx=0 tx=0).stop 2024-09-12T01:42:55.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.782+0000 7f4acd8ac640 1 -- 172.21.15.60:0/3378786666 shutdown_connections 2024-09-12T01:42:55.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.782+0000 7f4acd8ac640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ab406be30 0x7f4ab406e2f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.782+0000 7f4acd8ac640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ac815e860 0x7f4ac8161250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.782+0000 7f4acd8ac640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ac80b7880 0x7f4ac81502a0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.782+0000 7f4acd8ac640 1 --2- 172.21.15.60:0/3378786666 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ac80b6160 0x7f4ac8150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.782+0000 7f4acd8ac640 1 -- 172.21.15.60:0/3378786666 >> 172.21.15.60:0/3378786666 conn(0x7f4ac8062c60 msgr2=0x7f4ac80b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:55.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.782+0000 7f4acd8ac640 1 -- 172.21.15.60:0/3378786666 shutdown_connections 2024-09-12T01:42:55.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.782+0000 7f4acd8ac640 1 -- 172.21.15.60:0/3378786666 wait complete. 2024-09-12T01:42:55.794 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:42:55.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.895+0000 7f220485e640 1 Processor -- start 2024-09-12T01:42:55.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.895+0000 7f220485e640 1 -- start start 2024-09-12T01:42:55.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.896+0000 7f220485e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f220015c610 0x7f220006ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.896+0000 7f220485e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22000ceef0 con 0x7f22000ce5a0 2024-09-12T01:42:55.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.896+0000 7f220485e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22000cf1d0 con 0x7f220006c320 2024-09-12T01:42:55.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.896+0000 7f220485e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f220006e7b0 con 0x7f220015c610 2024-09-12T01:42:55.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.896+0000 7f21fe59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f220015c610 0x7f220006ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.896+0000 7f21fdd9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f22000ce5a0 0x7f220006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44062/0 (socket says 172.21.15.60:44062) 2024-09-12T01:42:55.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.896+0000 7f21fdd9b640 1 -- 172.21.15.60:0/461971622 learned_addr learned my addr 172.21.15.60:0/461971622 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:55.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.896+0000 7f21fe59c640 1 -- 172.21.15.60:0/461971622 >> v1:172.21.15.105:6789/0 conn(0x7f220006c320 legacy=0x7f22001660c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.896+0000 7f21fe59c640 1 -- 172.21.15.60:0/461971622 >> v1:172.21.15.60:6789/0 conn(0x7f22000ce5a0 legacy=0x7f220006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.896+0000 7f21fe59c640 1 -- 172.21.15.60:0/461971622 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22000cf4b0 con 0x7f220015c610 2024-09-12T01:42:55.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.896+0000 7f21fd59a640 1 -- 172.21.15.60:0/461971622 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479692073 0 0) 0x7f22000ceef0 con 0x7f22000ce5a0 2024-09-12T01:42:55.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.897+0000 7f21fe59c640 1 --2- 172.21.15.60:0/461971622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220015c610 0x7f220006ef30 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f21f80097a0 tx=0x7f21f802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6d4371951af0f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:55.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.897+0000 7f21fd59a640 1 -- 172.21.15.60:0/461971622 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8037070 con 0x7f220015c610 2024-09-12T01:42:55.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.897+0000 7f21fd59a640 1 -- 172.21.15.60:0/461971622 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f8032440 con 0x7f220015c610 2024-09-12T01:42:55.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.897+0000 7f21fd59a640 1 -- 172.21.15.60:0/461971622 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8032810 con 0x7f220015c610 2024-09-12T01:42:55.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.898+0000 7f220485e640 1 -- 172.21.15.60:0/461971622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220015c610 msgr2=0x7f220006ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.898+0000 7f220485e640 1 --2- 172.21.15.60:0/461971622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220015c610 0x7f220006ef30 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f21f80097a0 tx=0x7f21f802a230 comp rx=0 tx=0).stop 2024-09-12T01:42:55.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.898+0000 7f220485e640 1 -- 172.21.15.60:0/461971622 shutdown_connections 2024-09-12T01:42:55.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.898+0000 7f220485e640 1 --2- 172.21.15.60:0/461971622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f220015c610 0x7f220006ef30 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.898+0000 7f220485e640 1 -- 172.21.15.60:0/461971622 >> 172.21.15.60:0/461971622 conn(0x7f22000b2430 msgr2=0x7f22000b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:55.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.898+0000 7f220485e640 1 -- 172.21.15.60:0/461971622 shutdown_connections 2024-09-12T01:42:55.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.898+0000 7f220485e640 1 -- 172.21.15.60:0/461971622 wait complete. 2024-09-12T01:42:55.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.899+0000 7f220485e640 1 Processor -- start 2024-09-12T01:42:55.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.899+0000 7f220485e640 1 -- start start 2024-09-12T01:42:55.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f220485e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f220006c320 0x7f22000c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f220485e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000ce5a0 0x7f22000aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f220485e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f220015c610 0x7f22000aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f220485e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2200071540 con 0x7f22000ce5a0 2024-09-12T01:42:55.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f220485e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22000713c0 con 0x7f220006c320 2024-09-12T01:42:55.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f220485e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f22000cea10 con 0x7f220015c610 2024-09-12T01:42:55.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f21fdd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000ce5a0 0x7f22000aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f21fdd9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000ce5a0 0x7f22000aea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56420/0 (socket says 172.21.15.60:56420) 2024-09-12T01:42:55.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f21fe59c640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f220006c320 0x7f22000c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f21fdd9b640 1 -- 172.21.15.60:0/1519983756 learned_addr learned my addr 172.21.15.60:0/1519983756 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:55.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f21fed9d640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f220015c610 0x7f22000aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f21fdd9b640 1 -- 172.21.15.60:0/1519983756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f220015c610 msgr2=0x7f22000aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f21fdd9b640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f220015c610 0x7f22000aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f21fdd9b640 1 -- 172.21.15.60:0/1519983756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f220006c320 msgr2=0x7f22000c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:55.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f21fdd9b640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f220006c320 0x7f22000c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:55.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.900+0000 7f21fdd9b640 1 -- 172.21.15.60:0/1519983756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22000adb40 con 0x7f22000ce5a0 2024-09-12T01:42:55.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.901+0000 7f21fdd9b640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000ce5a0 0x7f22000aea00 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f21f400c4a0 tx=0x7f21f400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:55.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.901+0000 7f21eeffd640 1 -- 172.21.15.60:0/1519983756 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4018070 con 0x7f22000ce5a0 2024-09-12T01:42:55.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.901+0000 7f21eeffd640 1 -- 172.21.15.60:0/1519983756 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f40074e0 con 0x7f22000ce5a0 2024-09-12T01:42:55.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.901+0000 7f220485e640 1 -- 172.21.15.60:0/1519983756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22000ade20 con 0x7f22000ce5a0 2024-09-12T01:42:55.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.901+0000 7f21eeffd640 1 -- 172.21.15.60:0/1519983756 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f4004a20 con 0x7f22000ce5a0 2024-09-12T01:42:55.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.901+0000 7f220485e640 1 -- 172.21.15.60:0/1519983756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22000ae3e0 con 0x7f22000ce5a0 2024-09-12T01:42:55.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.902+0000 7f220485e640 1 -- 172.21.15.60:0/1519983756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f220006ef30 con 0x7f22000ce5a0 2024-09-12T01:42:55.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.902+0000 7f21eeffd640 1 -- 172.21.15.60:0/1519983756 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f21f401b070 con 0x7f22000ce5a0 2024-09-12T01:42:55.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.903+0000 7f21eeffd640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21e006be30 0x7f21e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:55.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.903+0000 7f21eeffd640 1 -- 172.21.15.60:0/1519983756 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f21f408a1d0 con 0x7f22000ce5a0 2024-09-12T01:42:55.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.903+0000 7f21fe59c640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21e006be30 0x7f21e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:55.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.903+0000 7f21fe59c640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21e006be30 0x7f21e006e2f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f21f8034000 tx=0x7f21f802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:55.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:55.907+0000 7f21eeffd640 1 -- 172.21.15.60:0/1519983756 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21f40584b0 con 0x7f22000ce5a0 2024-09-12T01:42:56.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.086+0000 7f220485e640 1 -- 172.21.15.60:0/1519983756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22000cfc70 con 0x7f22000ce5a0 2024-09-12T01:42:56.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.087+0000 7f21eeffd640 1 -- 172.21.15.60:0/1519983756 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+16839 (secure 0 0 0) 0x7f21f405c7b0 con 0x7f22000ce5a0 2024-09-12T01:42:56.087 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:56.088 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":105,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:42:38.833256+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:42:23.733621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-12T01:42:25.056873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.4","mappings":[{"from":4,"to":3}]},{"pgid":"17.1","mappings":[{"from":6,"to":1}]},{"pgid":"17.2e","mappings":[{"from":6,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:42:56.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.089+0000 7f220485e640 1 -- 172.21.15.60:0/1519983756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21e006be30 msgr2=0x7f21e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.089+0000 7f220485e640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21e006be30 0x7f21e006e2f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f21f8034000 tx=0x7f21f802e000 comp rx=0 tx=0).stop 2024-09-12T01:42:56.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.089+0000 7f220485e640 1 -- 172.21.15.60:0/1519983756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000ce5a0 msgr2=0x7f22000aea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.089+0000 7f220485e640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000ce5a0 0x7f22000aea00 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f21f400c4a0 tx=0x7f21f400c960 comp rx=0 tx=0).stop 2024-09-12T01:42:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.089+0000 7f220485e640 1 -- 172.21.15.60:0/1519983756 shutdown_connections 2024-09-12T01:42:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.089+0000 7f220485e640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f21e006be30 0x7f21e006e2f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.089+0000 7f220485e640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f220015c610 0x7f22000aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.089+0000 7f220485e640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22000ce5a0 0x7f22000aea00 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.089+0000 7f220485e640 1 --2- 172.21.15.60:0/1519983756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f220006c320 0x7f22000c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.089+0000 7f220485e640 1 -- 172.21.15.60:0/1519983756 >> 172.21.15.60:0/1519983756 conn(0x7f22000b2430 msgr2=0x7f220015b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.089+0000 7f220485e640 1 -- 172.21.15.60:0/1519983756 shutdown_connections 2024-09-12T01:42:56.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.089+0000 7f220485e640 1 -- 172.21.15.60:0/1519983756 wait complete. 2024-09-12T01:42:56.100 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:42:56.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:56.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.202+0000 7fec3dec0640 1 Processor -- start 2024-09-12T01:42:56.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.202+0000 7fec3dec0640 1 -- start start 2024-09-12T01:42:56.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.202+0000 7fec3dec0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fec3815e950 0x7fec3806ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.203+0000 7fec3dec0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3806ca30 con 0x7fec380735b0 2024-09-12T01:42:56.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.203+0000 7fec3dec0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec3806faf0 con 0x7fec38072050 2024-09-12T01:42:56.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.203+0000 7fec3dec0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fec3806fdd0 con 0x7fec3815e950 2024-09-12T01:42:56.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.203+0000 7fec377fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fec3815e950 0x7fec3806ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.203+0000 7fec36ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fec380735b0 0x7fec3806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44070/0 (socket says 172.21.15.60:44070) 2024-09-12T01:42:56.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.203+0000 7fec36ffd640 1 -- 172.21.15.60:0/483393909 learned_addr learned my addr 172.21.15.60:0/483393909 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:56.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.203+0000 7fec367fc640 1 -- 172.21.15.60:0/483393909 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134752944 0 0) 0x7fec3806ca30 con 0x7fec380735b0 2024-09-12T01:42:56.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.203+0000 7fec367fc640 1 -- 172.21.15.60:0/483393909 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec20003520 con 0x7fec380735b0 2024-09-12T01:42:56.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.203+0000 7fec377fe640 1 -- 172.21.15.60:0/483393909 >> v1:172.21.15.105:6789/0 conn(0x7fec38072050 legacy=0x7fec3806c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.203+0000 7fec377fe640 1 -- 172.21.15.60:0/483393909 >> v1:172.21.15.60:6789/0 conn(0x7fec380735b0 legacy=0x7fec3806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.203+0000 7fec377fe640 1 -- 172.21.15.60:0/483393909 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec380700b0 con 0x7fec3815e950 2024-09-12T01:42:56.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.204+0000 7fec377fe640 1 --2- 172.21.15.60:0/483393909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec3815e950 0x7fec3806ce30 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fec280097a0 tx=0x7fec2802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489686038217d891 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:56.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.204+0000 7fec367fc640 1 -- 172.21.15.60:0/483393909 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28037070 con 0x7fec3815e950 2024-09-12T01:42:56.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.204+0000 7fec367fc640 1 -- 172.21.15.60:0/483393909 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec28032440 con 0x7fec3815e950 2024-09-12T01:42:56.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.204+0000 7fec367fc640 1 -- 172.21.15.60:0/483393909 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28032810 con 0x7fec3815e950 2024-09-12T01:42:56.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.204+0000 7fec3dec0640 1 -- 172.21.15.60:0/483393909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec3815e950 msgr2=0x7fec3806ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.205+0000 7fec3dec0640 1 --2- 172.21.15.60:0/483393909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec3815e950 0x7fec3806ce30 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fec280097a0 tx=0x7fec2802a230 comp rx=0 tx=0).stop 2024-09-12T01:42:56.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.205+0000 7fec3dec0640 1 -- 172.21.15.60:0/483393909 shutdown_connections 2024-09-12T01:42:56.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.205+0000 7fec3dec0640 1 --2- 172.21.15.60:0/483393909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec3815e950 0x7fec3806ce30 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.205+0000 7fec3dec0640 1 -- 172.21.15.60:0/483393909 >> 172.21.15.60:0/483393909 conn(0x7fec380d14d0 msgr2=0x7fec380d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:56.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.205+0000 7fec3dec0640 1 -- 172.21.15.60:0/483393909 shutdown_connections 2024-09-12T01:42:56.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.205+0000 7fec3dec0640 1 -- 172.21.15.60:0/483393909 wait complete. 2024-09-12T01:42:56.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.206+0000 7fec3dec0640 1 Processor -- start 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.206+0000 7fec3dec0640 1 -- start start 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec3dec0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38072050 0x7fec38157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec3dec0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec380735b0 0x7fec380cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec3dec0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec3815e950 0x7fec380cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec3dec0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fec3806f8b0 con 0x7fec38072050 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec3dec0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fec3806f730 con 0x7fec3815e950 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec3dec0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fec380d00b0 con 0x7fec380735b0 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec377fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38072050 0x7fec38157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec377fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38072050 0x7fec38157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56428/0 (socket says 172.21.15.60:56428) 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec377fe640 1 -- 172.21.15.60:0/2755642645 learned_addr learned my addr 172.21.15.60:0/2755642645 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec36ffd640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec380735b0 0x7fec380cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec37fff640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec3815e950 0x7fec380cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec377fe640 1 -- 172.21.15.60:0/2755642645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec380735b0 msgr2=0x7fec380cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec377fe640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec380735b0 0x7fec380cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec377fe640 1 -- 172.21.15.60:0/2755642645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec3815e950 msgr2=0x7fec380cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec377fe640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec3815e950 0x7fec380cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec377fe640 1 -- 172.21.15.60:0/2755642645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec380cbb80 con 0x7fec38072050 2024-09-12T01:42:56.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec36ffd640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec380735b0 0x7fec380cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:56.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec37fff640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec3815e950 0x7fec380cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:42:56.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec377fe640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38072050 0x7fec38157830 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fec280098c0 tx=0x7fec280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:56.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.207+0000 7fec1ffff640 1 -- 172.21.15.60:0/2755642645 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28041070 con 0x7fec38072050 2024-09-12T01:42:56.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.208+0000 7fec1ffff640 1 -- 172.21.15.60:0/2755642645 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec2803c870 con 0x7fec38072050 2024-09-12T01:42:56.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.208+0000 7fec3dec0640 1 -- 172.21.15.60:0/2755642645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec380cbe60 con 0x7fec38072050 2024-09-12T01:42:56.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.208+0000 7fec1ffff640 1 -- 172.21.15.60:0/2755642645 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec28037040 con 0x7fec38072050 2024-09-12T01:42:56.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.208+0000 7fec3dec0640 1 -- 172.21.15.60:0/2755642645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec380cc420 con 0x7fec38072050 2024-09-12T01:42:56.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.208+0000 7fec3dec0640 1 -- 172.21.15.60:0/2755642645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec3806ce30 con 0x7fec38072050 2024-09-12T01:42:56.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.209+0000 7fec1ffff640 1 -- 172.21.15.60:0/2755642645 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fec28044070 con 0x7fec38072050 2024-09-12T01:42:56.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.209+0000 7fec1ffff640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fec2406be30 0x7fec2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.210+0000 7fec1ffff640 1 -- 172.21.15.60:0/2755642645 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7fec280abc30 con 0x7fec38072050 2024-09-12T01:42:56.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.210+0000 7fec36ffd640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fec2406be30 0x7fec2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.210+0000 7fec36ffd640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fec2406be30 0x7fec2406e2f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fec38159560 tx=0x7fec2c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:56.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.214+0000 7fec1ffff640 1 -- 172.21.15.60:0/2755642645 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fec2807a6a0 con 0x7fec38072050 2024-09-12T01:42:56.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.429+0000 7fec3dec0640 1 -- 172.21.15.60:0/2755642645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec380d1080 con 0x7fec38072050 2024-09-12T01:42:56.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.430+0000 7fec1ffff640 1 -- 172.21.15.60:0/2755642645 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5231 (secure 0 0 0) 0x7fec28079fa0 con 0x7fec38072050 2024-09-12T01:42:56.430 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:56.430 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":63,"btime":"2024-09-12T01:42:46:901027+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3412598725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3412598725},{"type":"v1","addr":"172.21.15.60:6837","nonce":3412598725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2966702196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2966702196},{"type":"v1","addr":"172.21.15.60:6836","nonce":2966702196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7107,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3682228949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3682228949},{"type":"v1","addr":"172.21.15.105:6834","nonce":3682228949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:42:26.063083+0000","modified":"2024-09-12T01:42:46.766209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7110},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7110":{"gid":7110,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6835/3881960029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3881960029},{"type":"v1","addr":"172.21.15.105:6835","nonce":3881960029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7110,"qdb_cluster":[7110]},"id":8}]} 2024-09-12T01:42:56.431 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 63 2024-09-12T01:42:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.432+0000 7fec3dec0640 1 -- 172.21.15.60:0/2755642645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fec2406be30 msgr2=0x7fec2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.432+0000 7fec3dec0640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fec2406be30 0x7fec2406e2f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fec38159560 tx=0x7fec2c009040 comp rx=0 tx=0).stop 2024-09-12T01:42:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.432+0000 7fec3dec0640 1 -- 172.21.15.60:0/2755642645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38072050 msgr2=0x7fec38157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.432+0000 7fec3dec0640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38072050 0x7fec38157830 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fec280098c0 tx=0x7fec280046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.432+0000 7fec3dec0640 1 -- 172.21.15.60:0/2755642645 shutdown_connections 2024-09-12T01:42:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.432+0000 7fec3dec0640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fec3815e950 0x7fec380cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.432+0000 7fec3dec0640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fec2406be30 0x7fec2406e2f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.432+0000 7fec3dec0640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fec380735b0 0x7fec380cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.432+0000 7fec3dec0640 1 --2- 172.21.15.60:0/2755642645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec38072050 0x7fec38157830 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.432+0000 7fec3dec0640 1 -- 172.21.15.60:0/2755642645 >> 172.21.15.60:0/2755642645 conn(0x7fec380d14d0 msgr2=0x7fec380b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.432+0000 7fec3dec0640 1 -- 172.21.15.60:0/2755642645 shutdown_connections 2024-09-12T01:42:56.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.432+0000 7fec3dec0640 1 -- 172.21.15.60:0/2755642645 wait complete. 2024-09-12T01:42:56.443 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:42:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.545+0000 7f4c64ff6640 1 Processor -- start 2024-09-12T01:42:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.545+0000 7f4c64ff6640 1 -- start start 2024-09-12T01:42:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c64ff6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c6015c170 0x7f4c6015c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c64ff6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c600b64e0 0x7f4c600cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c64ff6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c600b4cf0 con 0x7f4c600cf6c0 2024-09-12T01:42:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c64ff6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4c6015ca90 con 0x7f4c600b64e0 2024-09-12T01:42:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c64ff6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4c600b49c0 con 0x7f4c6015c170 2024-09-12T01:42:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c5ed9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c600b64e0 0x7f4c600cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c5ed9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c600b64e0 0x7f4c600cfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56444/0 (socket says 172.21.15.60:56444) 2024-09-12T01:42:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c5ed9d640 1 -- 172.21.15.60:0/4022918705 learned_addr learned my addr 172.21.15.60:0/4022918705 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c5ed9d640 1 -- 172.21.15.60:0/4022918705 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c6015c170 msgr2=0x7f4c6015c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c5e59c640 1 --2- 172.21.15.60:0/4022918705 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c6015c170 0x7f4c6015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c5ed9d640 1 --2- 172.21.15.60:0/4022918705 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c6015c170 0x7f4c6015c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c5ed9d640 1 -- 172.21.15.60:0/4022918705 >> v1:172.21.15.105:6789/0 conn(0x7f4c600cf6c0 legacy=0x7f4c600b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:56.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.546+0000 7f4c5ed9d640 1 -- 172.21.15.60:0/4022918705 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c600b4fd0 con 0x7f4c600b64e0 2024-09-12T01:42:56.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.547+0000 7f4c5ed9d640 1 --2- 172.21.15.60:0/4022918705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c600b64e0 0x7f4c600cfb00 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009e50 tx=0x7f4c5802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2499125f68a6954c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:56.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.547+0000 7f4c5dd9b640 1 -- 172.21.15.60:0/4022918705 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c58036070 con 0x7f4c600b64e0 2024-09-12T01:42:56.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.547+0000 7f4c5dd9b640 1 -- 172.21.15.60:0/4022918705 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c58031600 con 0x7f4c600b64e0 2024-09-12T01:42:56.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.547+0000 7f4c5dd9b640 1 -- 172.21.15.60:0/4022918705 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c580319d0 con 0x7f4c600b64e0 2024-09-12T01:42:56.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.548+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4022918705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c600b64e0 msgr2=0x7f4c600cfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.548+0000 7f4c64ff6640 1 --2- 172.21.15.60:0/4022918705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c600b64e0 0x7f4c600cfb00 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f4c58009e50 tx=0x7f4c5802a6c0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.548+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4022918705 shutdown_connections 2024-09-12T01:42:56.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.548+0000 7f4c64ff6640 1 --2- 172.21.15.60:0/4022918705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c600b64e0 0x7f4c600cfb00 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.548+0000 7f4c64ff6640 1 --2- 172.21.15.60:0/4022918705 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c6015c170 0x7f4c6015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.548+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4022918705 >> 172.21.15.60:0/4022918705 conn(0x7f4c6006bc10 msgr2=0x7f4c6006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:56.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.548+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4022918705 shutdown_connections 2024-09-12T01:42:56.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.548+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4022918705 wait complete. 2024-09-12T01:42:56.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.549+0000 7f4c64ff6640 1 Processor -- start 2024-09-12T01:42:56.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.549+0000 7f4c64ff6640 1 -- start start 2024-09-12T01:42:56.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c64ff6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c600b64e0 0x7f4c6014b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c64ff6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c600cf6c0 0x7f4c6015d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c64ff6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c6015c170 0x7f4c601570a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c64ff6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4c600b5870 con 0x7f4c600cf6c0 2024-09-12T01:42:56.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c64ff6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4c600b5590 con 0x7f4c600b64e0 2024-09-12T01:42:56.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c64ff6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4c600b5b50 con 0x7f4c6015c170 2024-09-12T01:42:56.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c600cf6c0 0x7f4c6015d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c57fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c600cf6c0 0x7f4c6015d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56458/0 (socket says 172.21.15.60:56458) 2024-09-12T01:42:56.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c57fff640 1 -- 172.21.15.60:0/4127186544 learned_addr learned my addr 172.21.15.60:0/4127186544 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:56.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c5e59c640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c600b64e0 0x7f4c6014b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c5ed9d640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c6015c170 0x7f4c601570a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c57fff640 1 -- 172.21.15.60:0/4127186544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c6015c170 msgr2=0x7f4c601570a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c57fff640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c6015c170 0x7f4c601570a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c57fff640 1 -- 172.21.15.60:0/4127186544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c600b64e0 msgr2=0x7f4c6014b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c57fff640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c600b64e0 0x7f4c6014b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.550+0000 7f4c57fff640 1 -- 172.21.15.60:0/4127186544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c60157b40 con 0x7f4c600cf6c0 2024-09-12T01:42:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.551+0000 7f4c57fff640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c600cf6c0 0x7f4c6015d080 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800c430 tx=0x7f4c4800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.551+0000 7f4c56ffd640 1 -- 172.21.15.60:0/4127186544 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c48011790 con 0x7f4c600cf6c0 2024-09-12T01:42:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.551+0000 7f4c56ffd640 1 -- 172.21.15.60:0/4127186544 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c48017070 con 0x7f4c600cf6c0 2024-09-12T01:42:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.551+0000 7f4c56ffd640 1 -- 172.21.15.60:0/4127186544 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c48011bb0 con 0x7f4c600cf6c0 2024-09-12T01:42:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.551+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4127186544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c6014d8f0 con 0x7f4c600cf6c0 2024-09-12T01:42:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.551+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4127186544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c6015d5c0 con 0x7f4c600cf6c0 2024-09-12T01:42:56.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.552+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4127186544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c600cfb00 con 0x7f4c600cf6c0 2024-09-12T01:42:56.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.552+0000 7f4c56ffd640 1 -- 172.21.15.60:0/4127186544 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c4801c460 con 0x7f4c600cf6c0 2024-09-12T01:42:56.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.553+0000 7f4c56ffd640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4c4006be30 0x7f4c4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.553+0000 7f4c56ffd640 1 -- 172.21.15.60:0/4127186544 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f4c4808ac60 con 0x7f4c600cf6c0 2024-09-12T01:42:56.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.553+0000 7f4c5e59c640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4c4006be30 0x7f4c4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.553+0000 7f4c5e59c640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4c4006be30 0x7f4c4006e2f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000aa20 tx=0x7f4c50008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:56.558 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.557+0000 7f4c56ffd640 1 -- 172.21.15.60:0/4127186544 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c48058f60 con 0x7f4c600cf6c0 2024-09-12T01:42:56.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.767+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4127186544 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c6006d1b0 con 0x7f4c600cf6c0 2024-09-12T01:42:56.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.767+0000 7f4c56ffd640 1 -- 172.21.15.60:0/4127186544 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5231 (secure 0 0 0) 0x7f4c4805d260 con 0x7f4c600cf6c0 2024-09-12T01:42:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:56.768 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":63,"btime":"2024-09-12T01:42:46:901027+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3412598725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3412598725},{"type":"v1","addr":"172.21.15.60:6837","nonce":3412598725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2966702196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2966702196},{"type":"v1","addr":"172.21.15.60:6836","nonce":2966702196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7107,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3682228949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3682228949},{"type":"v1","addr":"172.21.15.105:6834","nonce":3682228949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:42:26.063083+0000","modified":"2024-09-12T01:42:46.766209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7110},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7110":{"gid":7110,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6835/3881960029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3881960029},{"type":"v1","addr":"172.21.15.105:6835","nonce":3881960029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7110,"qdb_cluster":[7110]},"id":8}]} 2024-09-12T01:42:56.769 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 63 2024-09-12T01:42:56.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.769+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4127186544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4c4006be30 msgr2=0x7f4c4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.769+0000 7f4c64ff6640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4c4006be30 0x7f4c4006e2f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000aa20 tx=0x7f4c50008040 comp rx=0 tx=0).stop 2024-09-12T01:42:56.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.769+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4127186544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c600cf6c0 msgr2=0x7f4c6015d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.769+0000 7f4c64ff6640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c600cf6c0 0x7f4c6015d080 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800c430 tx=0x7f4c4800c8f0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.769+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4127186544 shutdown_connections 2024-09-12T01:42:56.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.769+0000 7f4c64ff6640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4c4006be30 0x7f4c4006e2f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.769+0000 7f4c64ff6640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c6015c170 0x7f4c601570a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.769+0000 7f4c64ff6640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c600cf6c0 0x7f4c6015d080 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.769+0000 7f4c64ff6640 1 --2- 172.21.15.60:0/4127186544 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c600b64e0 0x7f4c6014b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.769+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4127186544 >> 172.21.15.60:0/4127186544 conn(0x7f4c6006bc10 msgr2=0x7f4c6006d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:56.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.769+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4127186544 shutdown_connections 2024-09-12T01:42:56.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.770+0000 7f4c64ff6640 1 -- 172.21.15.60:0/4127186544 wait complete. 2024-09-12T01:42:56.781 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:42:56.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.883+0000 7f4c7ce1e640 1 Processor -- start 2024-09-12T01:42:56.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.883+0000 7f4c7ce1e640 1 -- start start 2024-09-12T01:42:56.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c7ce1e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4c7815e660 0x7f4c780cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c7ce1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c780d3310 0x7f4c780d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c7ce1e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c780d1650 0x7f4c7806bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c7ce1e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4c780d1ac0 con 0x7f4c780d1650 2024-09-12T01:42:56.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c7ce1e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4c7815ea40 con 0x7f4c7815e660 2024-09-12T01:42:56.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c7ce1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4c780d3870 con 0x7f4c780d3310 2024-09-12T01:42:56.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c76d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c780d1650 0x7f4c7806bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c76d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c780d1650 0x7f4c7806bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56460/0 (socket says 172.21.15.60:56460) 2024-09-12T01:42:56.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c76d9d640 1 -- 172.21.15.60:0/3166013854 learned_addr learned my addr 172.21.15.60:0/3166013854 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:56.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c6ffff640 1 --2- 172.21.15.60:0/3166013854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c780d3310 0x7f4c780d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c7659c640 1 --2- 172.21.15.60:0/3166013854 >> v2:172.21.15.105:3300/0 conn(0x7f4c7815e660 0x7f4c780cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c76d9d640 1 -- 172.21.15.60:0/3166013854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c780d3310 msgr2=0x7f4c780d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:56.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c76d9d640 1 --2- 172.21.15.60:0/3166013854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c780d3310 0x7f4c780d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c76d9d640 1 -- 172.21.15.60:0/3166013854 >> v2:172.21.15.105:3300/0 conn(0x7f4c7815e660 msgr2=0x7f4c780cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:56.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c76d9d640 1 --2- 172.21.15.60:0/3166013854 >> v2:172.21.15.105:3300/0 conn(0x7f4c7815e660 0x7f4c780cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.884+0000 7f4c76d9d640 1 -- 172.21.15.60:0/3166013854 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c780d3b50 con 0x7f4c780d1650 2024-09-12T01:42:56.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.885+0000 7f4c76d9d640 1 --2- 172.21.15.60:0/3166013854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c780d1650 0x7f4c7806bfd0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4c780d10e0 tx=0x7f4c7002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68829db40c76657a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:56.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.885+0000 7f4c75d9b640 1 -- 172.21.15.60:0/3166013854 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70036070 con 0x7f4c780d1650 2024-09-12T01:42:56.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.885+0000 7f4c75d9b640 1 -- 172.21.15.60:0/3166013854 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c70031600 con 0x7f4c780d1650 2024-09-12T01:42:56.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.885+0000 7f4c75d9b640 1 -- 172.21.15.60:0/3166013854 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c700319d0 con 0x7f4c780d1650 2024-09-12T01:42:56.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.886+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3166013854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c780d1650 msgr2=0x7f4c7806bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.886+0000 7f4c7ce1e640 1 --2- 172.21.15.60:0/3166013854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c780d1650 0x7f4c7806bfd0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4c780d10e0 tx=0x7f4c7002a6a0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.886+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3166013854 shutdown_connections 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.886+0000 7f4c7ce1e640 1 --2- 172.21.15.60:0/3166013854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c780d1650 0x7f4c7806bfd0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.886+0000 7f4c7ce1e640 1 --2- 172.21.15.60:0/3166013854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c780d3310 0x7f4c780d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.886+0000 7f4c7ce1e640 1 --2- 172.21.15.60:0/3166013854 >> v2:172.21.15.105:3300/0 conn(0x7f4c7815e660 0x7f4c780cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.886+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3166013854 >> 172.21.15.60:0/3166013854 conn(0x7f4c780b6410 msgr2=0x7f4c780b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.886+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3166013854 shutdown_connections 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.886+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3166013854 wait complete. 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.887+0000 7f4c7ce1e640 1 Processor -- start 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.887+0000 7f4c7ce1e640 1 -- start start 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7ce1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c780d1650 0x7f4c78146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7ce1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c780d3310 0x7f4c7815bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7ce1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c7815e660 0x7f4c780c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7ce1e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4c780d43f0 con 0x7f4c780d1650 2024-09-12T01:42:56.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7ce1e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4c780d4110 con 0x7f4c780d3310 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7ce1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4c780cfc70 con 0x7f4c7815e660 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c780d1650 0x7f4c78146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c780d1650 0x7f4c78146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56464/0 (socket says 172.21.15.60:56464) 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7659c640 1 -- 172.21.15.60:0/3585343497 learned_addr learned my addr 172.21.15.60:0/3585343497 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c6ffff640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c780d3310 0x7f4c7815bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c76d9d640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c7815e660 0x7f4c780c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7659c640 1 -- 172.21.15.60:0/3585343497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c7815e660 msgr2=0x7f4c780c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7659c640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c7815e660 0x7f4c780c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7659c640 1 -- 172.21.15.60:0/3585343497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c780d3310 msgr2=0x7f4c7815bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7659c640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c780d3310 0x7f4c7815bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.888+0000 7f4c7659c640 1 -- 172.21.15.60:0/3585343497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c781f3fe0 con 0x7f4c780d1650 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.889+0000 7f4c7659c640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c780d1650 0x7f4c78146b50 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800d830 tx=0x7f4c6800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:56.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.889+0000 7f4c6effd640 1 -- 172.21.15.60:0/3585343497 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800b6c0 con 0x7f4c780d1650 2024-09-12T01:42:56.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.889+0000 7f4c6effd640 1 -- 172.21.15.60:0/3585343497 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c68019070 con 0x7f4c780d1650 2024-09-12T01:42:56.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.889+0000 7f4c6effd640 1 -- 172.21.15.60:0/3585343497 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800ba80 con 0x7f4c780d1650 2024-09-12T01:42:56.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.889+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3585343497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c78160d90 con 0x7f4c780d1650 2024-09-12T01:42:56.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.889+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3585343497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c78161350 con 0x7f4c780d1650 2024-09-12T01:42:56.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.890+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3585343497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c780d1110 con 0x7f4c780d1650 2024-09-12T01:42:56.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.890+0000 7f4c6effd640 1 -- 172.21.15.60:0/3585343497 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4c6801e460 con 0x7f4c780d1650 2024-09-12T01:42:56.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.891+0000 7f4c6effd640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4c5806be30 0x7f4c5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:56.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.891+0000 7f4c6effd640 1 -- 172.21.15.60:0/3585343497 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f4c6808b500 con 0x7f4c780d1650 2024-09-12T01:42:56.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.891+0000 7f4c6ffff640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4c5806be30 0x7f4c5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:56.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.891+0000 7f4c6ffff640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4c5806be30 0x7f4c5806e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4c780d13d0 tx=0x7f4c60008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:56.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:56.895+0000 7f4c6effd640 1 -- 172.21.15.60:0/3585343497 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4c68059770 con 0x7f4c780d1650 2024-09-12T01:42:57.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.070+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3585343497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4c78157c20 con 0x7f4c780d1650 2024-09-12T01:42:57.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.071+0000 7f4c6effd640 1 -- 172.21.15.60:0/3585343497 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+16839 (secure 0 0 0) 0x7f4c6805da70 con 0x7f4c780d1650 2024-09-12T01:42:57.072 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:42:57.072 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":105,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:42:38.833256+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:42:23.733621+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-12T01:42:25.056873+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.4","mappings":[{"from":4,"to":3}]},{"pgid":"17.1","mappings":[{"from":6,"to":1}]},{"pgid":"17.2e","mappings":[{"from":6,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:42:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.073+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3585343497 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4c5806be30 msgr2=0x7f4c5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.073+0000 7f4c7ce1e640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4c5806be30 0x7f4c5806e2f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4c780d13d0 tx=0x7f4c60008040 comp rx=0 tx=0).stop 2024-09-12T01:42:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.073+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3585343497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c780d1650 msgr2=0x7f4c78146b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.073+0000 7f4c7ce1e640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c780d1650 0x7f4c78146b50 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800d830 tx=0x7f4c6800dcf0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.074+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3585343497 shutdown_connections 2024-09-12T01:42:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.074+0000 7f4c7ce1e640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4c5806be30 0x7f4c5806e2f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.074+0000 7f4c7ce1e640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4c7815e660 0x7f4c780c8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.074+0000 7f4c7ce1e640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4c780d3310 0x7f4c7815bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.074+0000 7f4c7ce1e640 1 --2- 172.21.15.60:0/3585343497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c780d1650 0x7f4c78146b50 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.074+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3585343497 >> 172.21.15.60:0/3585343497 conn(0x7f4c780b6410 msgr2=0x7f4c78159740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:57.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.074+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3585343497 shutdown_connections 2024-09-12T01:42:57.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.074+0000 7f4c7ce1e640 1 -- 172.21.15.60:0/3585343497 wait complete. 2024-09-12T01:42:57.085 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:42:57.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.188+0000 7fa994650640 1 Processor -- start 2024-09-12T01:42:57.188 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.188+0000 7fa994650640 1 -- start start 2024-09-12T01:42:57.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa994650640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa98c0b6850 0x7fa98c0b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa994650640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa98c0ba440 0x7fa98c0b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa994650640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa98c15ed20 con 0x7fa98c15e940 2024-09-12T01:42:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa994650640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa98c0d3ef0 con 0x7fa98c0b6850 2024-09-12T01:42:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa994650640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa98c0d32e0 con 0x7fa98c0ba440 2024-09-12T01:42:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa991beb640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa98c0b6850 0x7fa98c0b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa991beb640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa98c0b6850 0x7fa98c0b7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56468/0 (socket says 172.21.15.60:56468) 2024-09-12T01:42:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa991beb640 1 -- 172.21.15.60:0/920689861 learned_addr learned my addr 172.21.15.60:0/920689861 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa992bed640 1 --2- 172.21.15.60:0/920689861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa98c0ba440 0x7fa98c0b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa991beb640 1 -- 172.21.15.60:0/920689861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa98c0ba440 msgr2=0x7fa98c0b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa991beb640 1 --2- 172.21.15.60:0/920689861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa98c0ba440 0x7fa98c0b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa991beb640 1 -- 172.21.15.60:0/920689861 >> v1:172.21.15.105:6789/0 conn(0x7fa98c15e940 legacy=0x7fa98c0b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.189+0000 7fa991beb640 1 -- 172.21.15.60:0/920689861 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98c0d35c0 con 0x7fa98c0b6850 2024-09-12T01:42:57.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.190+0000 7fa991beb640 1 --2- 172.21.15.60:0/920689861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa98c0b6850 0x7fa98c0b7ba0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0d4070 tx=0x7fa97c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4826b5d6acb120 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.190+0000 7fa9913ea640 1 -- 172.21.15.60:0/920689861 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c037070 con 0x7fa98c0b6850 2024-09-12T01:42:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.190+0000 7fa9913ea640 1 -- 172.21.15.60:0/920689861 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa97c032440 con 0x7fa98c0b6850 2024-09-12T01:42:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.190+0000 7fa9913ea640 1 -- 172.21.15.60:0/920689861 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c032810 con 0x7fa98c0b6850 2024-09-12T01:42:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.191+0000 7fa994650640 1 -- 172.21.15.60:0/920689861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa98c0b6850 msgr2=0x7fa98c0b7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.191+0000 7fa994650640 1 --2- 172.21.15.60:0/920689861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa98c0b6850 0x7fa98c0b7ba0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0d4070 tx=0x7fa97c02a1c0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.191+0000 7fa994650640 1 -- 172.21.15.60:0/920689861 shutdown_connections 2024-09-12T01:42:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.191+0000 7fa994650640 1 --2- 172.21.15.60:0/920689861 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa98c0ba440 0x7fa98c0b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.191+0000 7fa994650640 1 --2- 172.21.15.60:0/920689861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa98c0b6850 0x7fa98c0b7ba0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.191+0000 7fa994650640 1 -- 172.21.15.60:0/920689861 >> 172.21.15.60:0/920689861 conn(0x7fa98c0d1140 msgr2=0x7fa98c0d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.191+0000 7fa994650640 1 -- 172.21.15.60:0/920689861 shutdown_connections 2024-09-12T01:42:57.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.191+0000 7fa994650640 1 -- 172.21.15.60:0/920689861 wait complete. 2024-09-12T01:42:57.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.192+0000 7fa994650640 1 Processor -- start 2024-09-12T01:42:57.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.192+0000 7fa994650640 1 -- start start 2024-09-12T01:42:57.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa994650640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa98c0b6850 0x7fa98c0b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa994650640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa98c0ba440 0x7fa98c0c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa994650640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa98c15e940 0x7fa98c0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa994650640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c0b7510 con 0x7fa98c15e940 2024-09-12T01:42:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa994650640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa98c0d3b80 con 0x7fa98c0b6850 2024-09-12T01:42:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa994650640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa98c0d2290 con 0x7fa98c0ba440 2024-09-12T01:42:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa992bed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa98c15e940 0x7fa98c0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa992bed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa98c15e940 0x7fa98c0ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56478/0 (socket says 172.21.15.60:56478) 2024-09-12T01:42:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa992bed640 1 -- 172.21.15.60:0/2710462513 learned_addr learned my addr 172.21.15.60:0/2710462513 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa991beb640 1 --2- 172.21.15.60:0/2710462513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa98c0ba440 0x7fa98c0c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa9923ec640 1 --2- 172.21.15.60:0/2710462513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa98c0b6850 0x7fa98c0b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa992bed640 1 -- 172.21.15.60:0/2710462513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa98c0ba440 msgr2=0x7fa98c0c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa992bed640 1 --2- 172.21.15.60:0/2710462513 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa98c0ba440 0x7fa98c0c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa992bed640 1 -- 172.21.15.60:0/2710462513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa98c0b6850 msgr2=0x7fa98c0b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa992bed640 1 --2- 172.21.15.60:0/2710462513 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa98c0b6850 0x7fa98c0b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa992bed640 1 -- 172.21.15.60:0/2710462513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa98c0ca7a0 con 0x7fa98c15e940 2024-09-12T01:42:57.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa992bed640 1 --2- 172.21.15.60:0/2710462513 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa98c15e940 0x7fa98c0ca170 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fa984007e60 tx=0x7fa98400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:57.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa982ffd640 1 -- 172.21.15.60:0/2710462513 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984014620 con 0x7fa98c15e940 2024-09-12T01:42:57.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa982ffd640 1 -- 172.21.15.60:0/2710462513 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa984019070 con 0x7fa98c15e940 2024-09-12T01:42:57.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa994650640 1 -- 172.21.15.60:0/2710462513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa98c0caa80 con 0x7fa98c15e940 2024-09-12T01:42:57.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.193+0000 7fa982ffd640 1 -- 172.21.15.60:0/2710462513 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa984014a00 con 0x7fa98c15e940 2024-09-12T01:42:57.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.194+0000 7fa994650640 1 -- 172.21.15.60:0/2710462513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa98c14a9b0 con 0x7fa98c15e940 2024-09-12T01:42:57.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.195+0000 7fa994650640 1 -- 172.21.15.60:0/2710462513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa98c0b6140 con 0x7fa98c15e940 2024-09-12T01:42:57.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.195+0000 7fa982ffd640 1 -- 172.21.15.60:0/2710462513 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa984014ba0 con 0x7fa98c15e940 2024-09-12T01:42:57.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.195+0000 7fa982ffd640 1 --2- 172.21.15.60:0/2710462513 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa97006be30 0x7fa97006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.196+0000 7fa9923ec640 1 --2- 172.21.15.60:0/2710462513 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa97006be30 0x7fa97006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.196+0000 7fa982ffd640 1 -- 172.21.15.60:0/2710462513 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7fa98408b6b0 con 0x7fa98c15e940 2024-09-12T01:42:57.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.196+0000 7fa9923ec640 1 --2- 172.21.15.60:0/2710462513 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa97006be30 0x7fa97006e2f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa9880016e0 tx=0x7fa988009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:57.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.200+0000 7fa982ffd640 1 -- 172.21.15.60:0/2710462513 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9840599b0 con 0x7fa98c15e940 2024-09-12T01:42:57.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.415+0000 7fa994650640 1 -- 172.21.15.60:0/2710462513 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa98c0d01d0 con 0x7fa98c15e940 2024-09-12T01:42:57.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.415+0000 7fa982ffd640 1 -- 172.21.15.60:0/2710462513 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=-1 MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it v63) ==== 316+0+0 (secure 0 0 0) 0x7fa98405dcb0 con 0x7fa98c15e940 2024-09-12T01:42:57.416 INFO:teuthology.orchestra.run.smithi060.stderr:Error EPERM: MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it 2024-09-12T01:42:57.421 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:42:57.421 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs --yes-i-really-mean-it 2024-09-12T01:42:57.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.525+0000 7f5240f78640 1 Processor -- start 2024-09-12T01:42:57.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.525+0000 7f5240f78640 1 -- start start 2024-09-12T01:42:57.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f5240f78640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f523c15a050 0x7f523c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f5240f78640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f523c0731c0 0x7f523c073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f5240f78640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f523c15ffd0 0x7f523c160460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f5240f78640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f523c073b40 con 0x7f523c15a050 2024-09-12T01:42:57.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f5240f78640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f523c15a430 con 0x7f523c0731c0 2024-09-12T01:42:57.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f5240f78640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f523c15d9a0 con 0x7f523c15ffd0 2024-09-12T01:42:57.527 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f523a59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f523c15a050 0x7f523c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f523a59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f523c15a050 0x7f523c15d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56486/0 (socket says 172.21.15.60:56486) 2024-09-12T01:42:57.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f523a59c640 1 -- 172.21.15.60:0/1101890163 learned_addr learned my addr 172.21.15.60:0/1101890163 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:57.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f5239d9b640 1 --2- 172.21.15.60:0/1101890163 >> v2:172.21.15.105:3300/0 conn(0x7f523c0731c0 0x7f523c073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f523ad9d640 1 --2- 172.21.15.60:0/1101890163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f523c15ffd0 0x7f523c160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f523a59c640 1 -- 172.21.15.60:0/1101890163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f523c15ffd0 msgr2=0x7f523c160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:57.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f523a59c640 1 --2- 172.21.15.60:0/1101890163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f523c15ffd0 0x7f523c160460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f523a59c640 1 -- 172.21.15.60:0/1101890163 >> v2:172.21.15.105:3300/0 conn(0x7f523c0731c0 msgr2=0x7f523c073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:57.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f523a59c640 1 --2- 172.21.15.60:0/1101890163 >> v2:172.21.15.105:3300/0 conn(0x7f523c0731c0 0x7f523c073600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f523a59c640 1 -- 172.21.15.60:0/1101890163 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523c0cd0a0 con 0x7f523c15a050 2024-09-12T01:42:57.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.526+0000 7f5239d9b640 1 --2- 172.21.15.60:0/1101890163 >> v2:172.21.15.105:3300/0 conn(0x7f523c0731c0 0x7f523c073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:42:57.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.527+0000 7f523a59c640 1 --2- 172.21.15.60:0/1101890163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f523c15a050 0x7f523c15d460 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f523c0c5c80 tx=0x7f523402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a23ea6def586a43 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.527+0000 7f523959a640 1 -- 172.21.15.60:0/1101890163 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234037070 con 0x7f523c15a050 2024-09-12T01:42:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.527+0000 7f523959a640 1 -- 172.21.15.60:0/1101890163 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5234032440 con 0x7f523c15a050 2024-09-12T01:42:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.527+0000 7f523959a640 1 -- 172.21.15.60:0/1101890163 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234032810 con 0x7f523c15a050 2024-09-12T01:42:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.528+0000 7f5240f78640 1 -- 172.21.15.60:0/1101890163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f523c15a050 msgr2=0x7f523c15d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.528+0000 7f5240f78640 1 --2- 172.21.15.60:0/1101890163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f523c15a050 0x7f523c15d460 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f523c0c5c80 tx=0x7f523402a140 comp rx=0 tx=0).stop 2024-09-12T01:42:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.528+0000 7f5240f78640 1 -- 172.21.15.60:0/1101890163 shutdown_connections 2024-09-12T01:42:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.528+0000 7f5240f78640 1 --2- 172.21.15.60:0/1101890163 >> v2:172.21.15.105:3300/0 conn(0x7f523c0731c0 0x7f523c073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.528+0000 7f5240f78640 1 --2- 172.21.15.60:0/1101890163 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f523c15ffd0 0x7f523c160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.528+0000 7f5240f78640 1 --2- 172.21.15.60:0/1101890163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f523c15a050 0x7f523c15d460 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.528+0000 7f5240f78640 1 -- 172.21.15.60:0/1101890163 >> 172.21.15.60:0/1101890163 conn(0x7f523c06d0f0 msgr2=0x7f523c06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.528+0000 7f5240f78640 1 -- 172.21.15.60:0/1101890163 shutdown_connections 2024-09-12T01:42:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.528+0000 7f5240f78640 1 -- 172.21.15.60:0/1101890163 wait complete. 2024-09-12T01:42:57.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.529+0000 7f5240f78640 1 Processor -- start 2024-09-12T01:42:57.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.529+0000 7f5240f78640 1 -- start start 2024-09-12T01:42:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.530+0000 7f5240f78640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f523c0731c0 0x7f523c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.530+0000 7f5240f78640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f523c15a050 0x7f523c14fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.530+0000 7f5240f78640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f523c15ffd0 0x7f523c0cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.530+0000 7f5240f78640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f523c0cd940 con 0x7f523c0731c0 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.530+0000 7f5240f78640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f523c0cd660 con 0x7f523c15a050 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.530+0000 7f5240f78640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f523c0cdc20 con 0x7f523c15ffd0 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.530+0000 7f523a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f523c0731c0 0x7f523c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.530+0000 7f523a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f523c0731c0 0x7f523c152ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56492/0 (socket says 172.21.15.60:56492) 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.530+0000 7f523a59c640 1 -- 172.21.15.60:0/3018183076 learned_addr learned my addr 172.21.15.60:0/3018183076 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.530+0000 7f523ad9d640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f523c15ffd0 0x7f523c0cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.530+0000 7f5239d9b640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f523c15a050 0x7f523c14fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.531+0000 7f523a59c640 1 -- 172.21.15.60:0/3018183076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f523c15ffd0 msgr2=0x7f523c0cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.531+0000 7f523a59c640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f523c15ffd0 0x7f523c0cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.531+0000 7f523a59c640 1 -- 172.21.15.60:0/3018183076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f523c15a050 msgr2=0x7f523c14fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.531+0000 7f523a59c640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f523c15a050 0x7f523c14fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.531+0000 7f523a59c640 1 -- 172.21.15.60:0/3018183076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523c0cb9b0 con 0x7f523c0731c0 2024-09-12T01:42:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.531+0000 7f523a59c640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f523c0731c0 0x7f523c152ce0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f523402a180 tx=0x7f52340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.531+0000 7f5232ffd640 1 -- 172.21.15.60:0/3018183076 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234041020 con 0x7f523c0731c0 2024-09-12T01:42:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.531+0000 7f5232ffd640 1 -- 172.21.15.60:0/3018183076 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52340306c0 con 0x7f523c0731c0 2024-09-12T01:42:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.531+0000 7f5240f78640 1 -- 172.21.15.60:0/3018183076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f523c0cbc90 con 0x7f523c0731c0 2024-09-12T01:42:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.531+0000 7f5232ffd640 1 -- 172.21.15.60:0/3018183076 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234037040 con 0x7f523c0731c0 2024-09-12T01:42:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.531+0000 7f5240f78640 1 -- 172.21.15.60:0/3018183076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f523c071540 con 0x7f523c0731c0 2024-09-12T01:42:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.532+0000 7f5240f78640 1 -- 172.21.15.60:0/3018183076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f523c0cc1b0 con 0x7f523c0731c0 2024-09-12T01:42:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.533+0000 7f5232ffd640 1 -- 172.21.15.60:0/3018183076 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5234044020 con 0x7f523c0731c0 2024-09-12T01:42:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.533+0000 7f5232ffd640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f521c06be30 0x7f521c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.533+0000 7f5239d9b640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f521c06be30 0x7f521c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.533+0000 7f5232ffd640 1 -- 172.21.15.60:0/3018183076 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5796+0+0 (secure 0 0 0) 0x7f52340ab630 con 0x7f523c0731c0 2024-09-12T01:42:57.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.533+0000 7f5239d9b640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f521c06be30 0x7f521c06e2f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f523c150c40 tx=0x7f5224008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.537+0000 7f5232ffd640 1 -- 172.21.15.60:0/3018183076 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f523c0cc1b0 con 0x7f523c0731c0 2024-09-12T01:42:57.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.748+0000 7f5240f78640 1 -- 172.21.15.60:0/3018183076 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f523c0b4820 con 0x7f523c0731c0 2024-09-12T01:42:57.749 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-12T01:42:57.749+0000 7f58b98dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:42:57.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.750+0000 7f5232ffd640 1 -- 172.21.15.60:0/3018183076 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) ==== 191+0+0 (secure 0 0 0) 0x7f523c0b4820 con 0x7f523c0731c0 2024-09-12T01:42:57.750 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:42:57.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.753+0000 7f5240f78640 1 -- 172.21.15.60:0/3018183076 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f521c06be30 msgr2=0x7f521c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.753+0000 7f5240f78640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f521c06be30 0x7f521c06e2f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f523c150c40 tx=0x7f5224008040 comp rx=0 tx=0).stop 2024-09-12T01:42:57.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.753+0000 7f5240f78640 1 -- 172.21.15.60:0/3018183076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f523c0731c0 msgr2=0x7f523c152ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.753+0000 7f5240f78640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f523c0731c0 0x7f523c152ce0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f523402a180 tx=0x7f52340046c0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.753+0000 7f5240f78640 1 -- 172.21.15.60:0/3018183076 shutdown_connections 2024-09-12T01:42:57.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.753+0000 7f5240f78640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f521c06be30 0x7f521c06e2f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.753+0000 7f5240f78640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f523c15ffd0 0x7f523c0cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.753+0000 7f5240f78640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f523c15a050 0x7f523c14fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.753+0000 7f5240f78640 1 --2- 172.21.15.60:0/3018183076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f523c0731c0 0x7f523c152ce0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.753+0000 7f5240f78640 1 -- 172.21.15.60:0/3018183076 >> 172.21.15.60:0/3018183076 conn(0x7f523c06d0f0 msgr2=0x7f523c0b56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:57.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.753+0000 7f5240f78640 1 -- 172.21.15.60:0/3018183076 shutdown_connections 2024-09-12T01:42:57.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.753+0000 7f5240f78640 1 -- 172.21.15.60:0/3018183076 wait complete. 2024-09-12T01:42:57.764 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:42:57.793 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:42:57.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.868+0000 7f9194e74640 1 Processor -- start 2024-09-12T01:42:57.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.868+0000 7f9194e74640 1 -- start start 2024-09-12T01:42:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f9194e74640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919006fa00 0x7f91900d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f9194e74640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9190071770 con 0x7f919015a060 2024-09-12T01:42:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f9194e74640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91900709b0 con 0x7f919015d3d0 2024-09-12T01:42:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f9194e74640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f91900712e0 con 0x7f919006fa00 2024-09-12T01:42:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f918e59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f919015a060 0x7f919006f2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44084/0 (socket says 172.21.15.60:44084) 2024-09-12T01:42:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f918e59c640 1 -- 172.21.15.60:0/1938225854 learned_addr learned my addr 172.21.15.60:0/1938225854 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662708047 0 0) 0x7f9190071770 con 0x7f919015a060 2024-09-12T01:42:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f917c003520 con 0x7f919015a060 2024-09-12T01:42:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f9187fff640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919006fa00 0x7f91900d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2855773868 0 0) 0x7f917c003520 con 0x7f919015a060 2024-09-12T01:42:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919006fa00 msgr2=0x7f91900d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f918dd9b640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919006fa00 0x7f91900d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 >> v1:172.21.15.105:6789/0 conn(0x7f919015d3d0 legacy=0x7f91900d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9190070c90 con 0x7f919015a060 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f9180001670 con 0x7f919015a060 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.869+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 >> v1:172.21.15.60:6789/0 conn(0x7f919015a060 legacy=0x7f919006f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918dd9b640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919006fa00 0x7f917c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918dd9b640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c003f20 0x7f917c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918dd9b640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f917c004d40 0x7f917c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f91900712e0 con 0x7f917c004d40 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f917c00ba20 con 0x7f917c003f20 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f917c00bc20 con 0x7f919006fa00 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918e59c640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919006fa00 0x7f917c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918ed9d640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f917c004d40 0x7f917c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f9187fff640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c003f20 0x7f917c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918e59c640 1 -- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c003f20 msgr2=0x7f917c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918e59c640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c003f20 0x7f917c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918e59c640 1 -- 172.21.15.60:0/1938225854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f917c004d40 msgr2=0x7f917c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918e59c640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f917c004d40 0x7f917c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f918e59c640 1 -- 172.21.15.60:0/1938225854 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f917c003520 con 0x7f919006fa00 2024-09-12T01:42:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.870+0000 7f9187fff640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f917c003f20 0x7f917c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:42:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.871+0000 7f918e59c640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919006fa00 0x7f917c0039e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f918000c240 tx=0x7f917c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18274855955f03a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.871+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180007d10 con 0x7f919006fa00 2024-09-12T01:42:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.871+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9180005ad0 con 0x7f919006fa00 2024-09-12T01:42:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.871+0000 7f918dd9b640 1 -- 172.21.15.60:0/1938225854 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180007070 con 0x7f919006fa00 2024-09-12T01:42:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.871+0000 7f9194e74640 1 -- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919006fa00 msgr2=0x7f917c0039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.871+0000 7f9194e74640 1 --2- 172.21.15.60:0/1938225854 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919006fa00 0x7f917c0039e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f918000c240 tx=0x7f917c005830 comp rx=0 tx=0).stop 2024-09-12T01:42:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.871+0000 7f918ed9d640 1 -- 172.21.15.60:0/1938225854 reap_dead start 2024-09-12T01:42:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.872+0000 7f9194e74640 1 -- 172.21.15.60:0/1938225854 shutdown_connections 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.872+0000 7f9194e74640 1 -- 172.21.15.60:0/1938225854 >> 172.21.15.60:0/1938225854 conn(0x7f91900d2430 msgr2=0x7f91900d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.872+0000 7f9194e74640 1 -- 172.21.15.60:0/1938225854 shutdown_connections 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.872+0000 7f9194e74640 1 -- 172.21.15.60:0/1938225854 wait complete. 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.873+0000 7f9194e74640 1 Processor -- start 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.873+0000 7f9194e74640 1 -- start start 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f9194e74640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919006fa00 0x7f91900b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f9194e74640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9190150650 0x7f919015f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f9194e74640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9190150ad0 0x7f919015fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f9194e74640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9190070030 con 0x7f919006fa00 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f9194e74640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f919006feb0 con 0x7f9190150ad0 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f9194e74640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f91900b1990 con 0x7f9190150650 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f918e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919006fa00 0x7f91900b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f918e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919006fa00 0x7f91900b1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56506/0 (socket says 172.21.15.60:56506) 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f918e59c640 1 -- 172.21.15.60:0/2930845956 learned_addr learned my addr 172.21.15.60:0/2930845956 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f918ed9d640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9190150ad0 0x7f919015fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f9187fff640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9190150650 0x7f919015f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f918e59c640 1 -- 172.21.15.60:0/2930845956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9190150650 msgr2=0x7f919015f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f918e59c640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9190150650 0x7f919015f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f918e59c640 1 -- 172.21.15.60:0/2930845956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9190150ad0 msgr2=0x7f919015fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f918e59c640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9190150ad0 0x7f919015fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f918e59c640 1 -- 172.21.15.60:0/2930845956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91901f89a0 con 0x7f919006fa00 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.874+0000 7f918e59c640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919006fa00 0x7f91900b1140 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f918000c240 tx=0x7f919015c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.875+0000 7f9186ffd640 1 -- 172.21.15.60:0/2930845956 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180001630 con 0x7f919006fa00 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.875+0000 7f9186ffd640 1 -- 172.21.15.60:0/2930845956 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9180038040 con 0x7f919006fa00 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.875+0000 7f9194e74640 1 -- 172.21.15.60:0/2930845956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91900b0660 con 0x7f919006fa00 2024-09-12T01:42:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.875+0000 7f9186ffd640 1 -- 172.21.15.60:0/2930845956 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9180007270 con 0x7f919006fa00 2024-09-12T01:42:57.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.875+0000 7f9194e74640 1 -- 172.21.15.60:0/2930845956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91900b0c20 con 0x7f919006fa00 2024-09-12T01:42:57.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.876+0000 7f9194e74640 1 -- 172.21.15.60:0/2930845956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f919006c6c0 con 0x7f919006fa00 2024-09-12T01:42:57.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.876+0000 7f9186ffd640 1 -- 172.21.15.60:0/2930845956 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9180007410 con 0x7f919006fa00 2024-09-12T01:42:57.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.876+0000 7f9186ffd640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f917006be30 0x7f917006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:57.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.877+0000 7f9186ffd640 1 -- 172.21.15.60:0/2930845956 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5882+0+0 (secure 0 0 0) 0x7f91800ab140 con 0x7f919006fa00 2024-09-12T01:42:57.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.877+0000 7f9187fff640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f917006be30 0x7f917006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:57.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.877+0000 7f9187fff640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f917006be30 0x7f917006e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9190160f30 tx=0x7f9178008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:57.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:57.881+0000 7f9186ffd640 1 -- 172.21.15.60:0/2930845956 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9180005aa0 con 0x7f919006fa00 2024-09-12T01:42:58.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.096+0000 7f9194e74640 1 -- 172.21.15.60:0/2930845956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f919006f2f0 con 0x7f919006fa00 2024-09-12T01:42:58.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.751+0000 7f9186ffd640 1 -- 172.21.15.60:0/2930845956 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) ==== 104+0+0 (secure 0 0 0) 0x7f9180079a50 con 0x7f919006fa00 2024-09-12T01:42:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.754+0000 7f9194e74640 1 -- 172.21.15.60:0/2930845956 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f917006be30 msgr2=0x7f917006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.754+0000 7f9194e74640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f917006be30 0x7f917006e2f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9190160f30 tx=0x7f9178008040 comp rx=0 tx=0).stop 2024-09-12T01:42:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.754+0000 7f9194e74640 1 -- 172.21.15.60:0/2930845956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919006fa00 msgr2=0x7f91900b1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.754+0000 7f9194e74640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919006fa00 0x7f91900b1140 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f918000c240 tx=0x7f919015c950 comp rx=0 tx=0).stop 2024-09-12T01:42:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.755+0000 7f9194e74640 1 -- 172.21.15.60:0/2930845956 shutdown_connections 2024-09-12T01:42:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.755+0000 7f9194e74640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9190150ad0 0x7f919015fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.755+0000 7f9194e74640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f917006be30 0x7f917006e2f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.755+0000 7f9194e74640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9190150650 0x7f919015f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.755+0000 7f9194e74640 1 --2- 172.21.15.60:0/2930845956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f919006fa00 0x7f91900b1140 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.755+0000 7f9194e74640 1 -- 172.21.15.60:0/2930845956 >> 172.21.15.60:0/2930845956 conn(0x7f91900d2430 msgr2=0x7f919015a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.755+0000 7f9194e74640 1 -- 172.21.15.60:0/2930845956 shutdown_connections 2024-09-12T01:42:58.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.755+0000 7f9194e74640 1 -- 172.21.15.60:0/2930845956 wait complete. 2024-09-12T01:42:58.768 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:42:58.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.878+0000 7eff4b4ba640 1 Processor -- start 2024-09-12T01:42:58.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.878+0000 7eff4b4ba640 1 -- start start 2024-09-12T01:42:58.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff4b4ba640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7eff44161be0 0x7eff44162d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:58.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff4b4ba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7eff440d1c80 0x7eff440d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:58.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff4b4ba640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff440cfe70 con 0x7eff440b3360 2024-09-12T01:42:58.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff4b4ba640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7eff441632d0 con 0x7eff440d1c80 2024-09-12T01:42:58.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff4b4ba640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7eff440cedd0 con 0x7eff44161be0 2024-09-12T01:42:58.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff49a57640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7eff440d1c80 0x7eff440d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:58.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff48a55640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7eff440b3360 0x7eff440d1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44086/0 (socket says 172.21.15.60:44086) 2024-09-12T01:42:58.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff48a55640 1 -- 172.21.15.60:0/1931582338 learned_addr learned my addr 172.21.15.60:0/1931582338 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:42:58.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff49256640 1 --2- 172.21.15.60:0/1931582338 >> v2:172.21.15.105:3300/0 conn(0x7eff44161be0 0x7eff44162d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:58.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff49a57640 1 -- 172.21.15.60:0/1931582338 >> v2:172.21.15.105:3300/0 conn(0x7eff44161be0 msgr2=0x7eff44162d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:42:58.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff49a57640 1 --2- 172.21.15.60:0/1931582338 >> v2:172.21.15.105:3300/0 conn(0x7eff44161be0 0x7eff44162d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:58.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff49a57640 1 -- 172.21.15.60:0/1931582338 >> v1:172.21.15.60:6789/0 conn(0x7eff440b3360 legacy=0x7eff440d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:58.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff3bfff640 1 -- 172.21.15.60:0/1931582338 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 219558359 0 0) 0x7eff440cfe70 con 0x7eff440b3360 2024-09-12T01:42:58.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.879+0000 7eff49a57640 1 -- 172.21.15.60:0/1931582338 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff440cf0b0 con 0x7eff440d1c80 2024-09-12T01:42:58.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.880+0000 7eff49a57640 1 --2- 172.21.15.60:0/1931582338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440d1c80 0x7eff440d2a60 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7eff44069810 tx=0x7eff3c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3ca18de635ce6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:58.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.880+0000 7eff3bfff640 1 -- 172.21.15.60:0/1931582338 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c007740 con 0x7eff440d1c80 2024-09-12T01:42:58.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.880+0000 7eff3bfff640 1 -- 172.21.15.60:0/1931582338 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3c0078e0 con 0x7eff440d1c80 2024-09-12T01:42:58.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.880+0000 7eff3bfff640 1 -- 172.21.15.60:0/1931582338 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c007cb0 con 0x7eff440d1c80 2024-09-12T01:42:58.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.881+0000 7eff4b4ba640 1 -- 172.21.15.60:0/1931582338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440d1c80 msgr2=0x7eff440d2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:58.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.881+0000 7eff4b4ba640 1 --2- 172.21.15.60:0/1931582338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440d1c80 0x7eff440d2a60 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7eff44069810 tx=0x7eff3c02a5f0 comp rx=0 tx=0).stop 2024-09-12T01:42:58.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.881+0000 7eff4b4ba640 1 -- 172.21.15.60:0/1931582338 shutdown_connections 2024-09-12T01:42:58.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.881+0000 7eff4b4ba640 1 --2- 172.21.15.60:0/1931582338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440d1c80 0x7eff440d2a60 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:58.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.881+0000 7eff4b4ba640 1 --2- 172.21.15.60:0/1931582338 >> v2:172.21.15.105:3300/0 conn(0x7eff44161be0 0x7eff44162d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:58.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.881+0000 7eff4b4ba640 1 -- 172.21.15.60:0/1931582338 >> 172.21.15.60:0/1931582338 conn(0x7eff4406c2c0 msgr2=0x7eff4406c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:58.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.881+0000 7eff4b4ba640 1 -- 172.21.15.60:0/1931582338 shutdown_connections 2024-09-12T01:42:58.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.881+0000 7eff4b4ba640 1 -- 172.21.15.60:0/1931582338 wait complete. 2024-09-12T01:42:58.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.882+0000 7eff4b4ba640 1 Processor -- start 2024-09-12T01:42:58.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.882+0000 7eff4b4ba640 1 -- start start 2024-09-12T01:42:58.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff4b4ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff440b3360 0x7eff440b9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:58.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff4b4ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff440d1c80 0x7eff440c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:58.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff4b4ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff44161be0 0x7eff441f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:58.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff4b4ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7eff440cf950 con 0x7eff44161be0 2024-09-12T01:42:58.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff4b4ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff440cf670 con 0x7eff440d1c80 2024-09-12T01:42:58.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff4b4ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7eff44161fc0 con 0x7eff440b3360 2024-09-12T01:42:58.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff49a57640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff44161be0 0x7eff441f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:58.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff49a57640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff44161be0 0x7eff441f7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56520/0 (socket says 172.21.15.60:56520) 2024-09-12T01:42:58.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff49a57640 1 -- 172.21.15.60:0/584654706 learned_addr learned my addr 172.21.15.60:0/584654706 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:42:58.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff48a55640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff440d1c80 0x7eff440c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:58.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff49256640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff440b3360 0x7eff440b9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:58.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff49a57640 1 -- 172.21.15.60:0/584654706 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff440b3360 msgr2=0x7eff440b9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:58.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff49a57640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff440b3360 0x7eff440b9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:58.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff49a57640 1 -- 172.21.15.60:0/584654706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff440d1c80 msgr2=0x7eff440c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:58.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff49a57640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff440d1c80 0x7eff440c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:58.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff49a57640 1 -- 172.21.15.60:0/584654706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff440c9390 con 0x7eff44161be0 2024-09-12T01:42:58.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.883+0000 7eff49a57640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff44161be0 0x7eff441f7c50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7eff3c02abe0 tx=0x7eff3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.884+0000 7eff39ffb640 1 -- 172.21.15.60:0/584654706 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c03f070 con 0x7eff44161be0 2024-09-12T01:42:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.884+0000 7eff39ffb640 1 -- 172.21.15.60:0/584654706 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3c031c40 con 0x7eff44161be0 2024-09-12T01:42:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.884+0000 7eff39ffb640 1 -- 172.21.15.60:0/584654706 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c009450 con 0x7eff44161be0 2024-09-12T01:42:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.884+0000 7eff4b4ba640 1 -- 172.21.15.60:0/584654706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff440c9670 con 0x7eff44161be0 2024-09-12T01:42:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.884+0000 7eff4b4ba640 1 -- 172.21.15.60:0/584654706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff440c9c30 con 0x7eff44161be0 2024-09-12T01:42:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.885+0000 7eff4b4ba640 1 -- 172.21.15.60:0/584654706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff44162d90 con 0x7eff44161be0 2024-09-12T01:42:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.885+0000 7eff39ffb640 1 -- 172.21.15.60:0/584654706 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff3c003990 con 0x7eff44161be0 2024-09-12T01:42:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.886+0000 7eff39ffb640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff2806be30 0x7eff2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:42:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.886+0000 7eff39ffb640 1 -- 172.21.15.60:0/584654706 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5882+0+0 (secure 0 0 0) 0x7eff3c0ac050 con 0x7eff44161be0 2024-09-12T01:42:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.886+0000 7eff49256640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff2806be30 0x7eff2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:42:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.886+0000 7eff49256640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff2806be30 0x7eff2806e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7eff40006fd0 tx=0x7eff40008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:42:58.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:58.890+0000 7eff39ffb640 1 -- 172.21.15.60:0/584654706 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff3c07a300 con 0x7eff44161be0 2024-09-12T01:42:59.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.066+0000 7eff4b4ba640 1 -- 172.21.15.60:0/584654706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7eff440ba3f0 con 0x7eff44161be0 2024-09-12T01:42:59.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.939+0000 7eff39ffb640 1 -- 172.21.15.60:0/584654706 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v107) ==== 181+0+0 (secure 0 0 0) 0x7eff3c07e600 con 0x7eff44161be0 2024-09-12T01:42:59.940 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:42:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.943+0000 7eff4b4ba640 1 -- 172.21.15.60:0/584654706 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff2806be30 msgr2=0x7eff2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.943+0000 7eff4b4ba640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff2806be30 0x7eff2806e2f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7eff40006fd0 tx=0x7eff40008040 comp rx=0 tx=0).stop 2024-09-12T01:42:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.943+0000 7eff4b4ba640 1 -- 172.21.15.60:0/584654706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff44161be0 msgr2=0x7eff441f7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:42:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.943+0000 7eff4b4ba640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff44161be0 0x7eff441f7c50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7eff3c02abe0 tx=0x7eff3c004a40 comp rx=0 tx=0).stop 2024-09-12T01:42:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.943+0000 7eff4b4ba640 1 -- 172.21.15.60:0/584654706 shutdown_connections 2024-09-12T01:42:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.943+0000 7eff4b4ba640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff44161be0 0x7eff441f7c50 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.943+0000 7eff4b4ba640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff440d1c80 0x7eff440c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.943+0000 7eff4b4ba640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff2806be30 0x7eff2806e2f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.943+0000 7eff4b4ba640 1 --2- 172.21.15.60:0/584654706 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff440b3360 0x7eff440b9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:42:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.943+0000 7eff4b4ba640 1 -- 172.21.15.60:0/584654706 >> 172.21.15.60:0/584654706 conn(0x7eff4406c2c0 msgr2=0x7eff440b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:42:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.944+0000 7eff4b4ba640 1 -- 172.21.15.60:0/584654706 shutdown_connections 2024-09-12T01:42:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:42:59.944+0000 7eff4b4ba640 1 -- 172.21.15.60:0/584654706 wait complete. 2024-09-12T01:42:59.960 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:43:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.072+0000 7f77c61be640 1 Processor -- start 2024-09-12T01:43:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.072+0000 7f77c61be640 1 -- start start 2024-09-12T01:43:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77c61be640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77c015e570 0x7f77c00b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77c61be640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f77c006fb10 0x7f77c015e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77c61be640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c015f020 con 0x7f77c00714a0 2024-09-12T01:43:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77c61be640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f77c015fc30 con 0x7f77c015e570 2024-09-12T01:43:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77c61be640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f77c015f300 con 0x7f77c006fb10 2024-09-12T01:43:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77bf7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77c015e570 0x7f77c00b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77bf7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f77c015e570 0x7f77c00b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56530/0 (socket says 172.21.15.60:56530) 2024-09-12T01:43:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77bf7fe640 1 -- 172.21.15.60:0/2808843307 learned_addr learned my addr 172.21.15.60:0/2808843307 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77bffff640 1 --2- 172.21.15.60:0/2808843307 >> v2:172.21.15.105:3300/0 conn(0x7f77c006fb10 0x7f77c015e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77bf7fe640 1 -- 172.21.15.60:0/2808843307 >> v2:172.21.15.105:3300/0 conn(0x7f77c006fb10 msgr2=0x7f77c015e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:00.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77bf7fe640 1 --2- 172.21.15.60:0/2808843307 >> v2:172.21.15.105:3300/0 conn(0x7f77c006fb10 0x7f77c015e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:00.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77bf7fe640 1 -- 172.21.15.60:0/2808843307 >> v1:172.21.15.105:6789/0 conn(0x7f77c00714a0 legacy=0x7f77c006f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:00.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77bf7fe640 1 -- 172.21.15.60:0/2808843307 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c015f5e0 con 0x7f77c015e570 2024-09-12T01:43:00.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.073+0000 7f77bffff640 1 --2- 172.21.15.60:0/2808843307 >> v2:172.21.15.105:3300/0 conn(0x7f77c006fb10 0x7f77c015e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:00.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.074+0000 7f77bf7fe640 1 --2- 172.21.15.60:0/2808843307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77c015e570 0x7f77c00b5540 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f77c0071bb0 tx=0x7f77b002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45dc849c09cdba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:00.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.074+0000 7f77be7fc640 1 -- 172.21.15.60:0/2808843307 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0037070 con 0x7f77c015e570 2024-09-12T01:43:00.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.074+0000 7f77be7fc640 1 -- 172.21.15.60:0/2808843307 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b0032440 con 0x7f77c015e570 2024-09-12T01:43:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.074+0000 7f77be7fc640 1 -- 172.21.15.60:0/2808843307 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0032810 con 0x7f77c015e570 2024-09-12T01:43:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.074+0000 7f77c61be640 1 -- 172.21.15.60:0/2808843307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77c015e570 msgr2=0x7f77c00b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.074+0000 7f77c61be640 1 --2- 172.21.15.60:0/2808843307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77c015e570 0x7f77c00b5540 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f77c0071bb0 tx=0x7f77b002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:43:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.074+0000 7f77c61be640 1 -- 172.21.15.60:0/2808843307 shutdown_connections 2024-09-12T01:43:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.074+0000 7f77c61be640 1 --2- 172.21.15.60:0/2808843307 >> v2:172.21.15.105:3300/0 conn(0x7f77c006fb10 0x7f77c015e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.074+0000 7f77c61be640 1 --2- 172.21.15.60:0/2808843307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77c015e570 0x7f77c00b5540 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.074+0000 7f77c61be640 1 -- 172.21.15.60:0/2808843307 >> 172.21.15.60:0/2808843307 conn(0x7f77c00b4240 msgr2=0x7f77c00b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.075+0000 7f77c61be640 1 -- 172.21.15.60:0/2808843307 shutdown_connections 2024-09-12T01:43:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.075+0000 7f77c61be640 1 -- 172.21.15.60:0/2808843307 wait complete. 2024-09-12T01:43:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.076+0000 7f77c61be640 1 Processor -- start 2024-09-12T01:43:00.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.076+0000 7f77c61be640 1 -- start start 2024-09-12T01:43:00.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77c61be640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77c006fb10 0x7f77c014bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:00.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77c61be640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77c00714a0 0x7f77c00cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:00.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77c61be640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77c015e570 0x7f77c01f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:00.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77c61be640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f77c006d0e0 con 0x7f77c006fb10 2024-09-12T01:43:00.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77c61be640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f77c006cf60 con 0x7f77c015e570 2024-09-12T01:43:00.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77c61be640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f77c006d260 con 0x7f77c00714a0 2024-09-12T01:43:00.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77c006fb10 0x7f77c014bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:00.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77bf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77c006fb10 0x7f77c014bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56536/0 (socket says 172.21.15.60:56536) 2024-09-12T01:43:00.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77bf7fe640 1 -- 172.21.15.60:0/960925270 learned_addr learned my addr 172.21.15.60:0/960925270 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:00.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77bffff640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77c015e570 0x7f77c01f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:00.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77beffd640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77c00714a0 0x7f77c00cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:00.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77bf7fe640 1 -- 172.21.15.60:0/960925270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77c00714a0 msgr2=0x7f77c00cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:00.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77bf7fe640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77c00714a0 0x7f77c00cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:00.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77bf7fe640 1 -- 172.21.15.60:0/960925270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77c015e570 msgr2=0x7f77c01f43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77bf7fe640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77c015e570 0x7f77c01f43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77bf7fe640 1 -- 172.21.15.60:0/960925270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c0155d10 con 0x7f77c006fb10 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77beffd640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77c00714a0 0x7f77c00cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.077+0000 7f77bf7fe640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77c006fb10 0x7f77c014bfe0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f77b0000c00 tx=0x7f77b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.078+0000 7f77b7fff640 1 -- 172.21.15.60:0/960925270 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0041020 con 0x7f77c006fb10 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.078+0000 7f77b7fff640 1 -- 172.21.15.60:0/960925270 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b0030970 con 0x7f77c006fb10 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.078+0000 7f77b7fff640 1 -- 172.21.15.60:0/960925270 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0037040 con 0x7f77c006fb10 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.078+0000 7f77c61be640 1 -- 172.21.15.60:0/960925270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c0155ff0 con 0x7f77c006fb10 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.078+0000 7f77c61be640 1 -- 172.21.15.60:0/960925270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c01565b0 con 0x7f77c006fb10 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.079+0000 7f77c61be640 1 -- 172.21.15.60:0/960925270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c00b5540 con 0x7f77c006fb10 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.079+0000 7f77b7fff640 1 -- 172.21.15.60:0/960925270 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f77b0044020 con 0x7f77c006fb10 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.079+0000 7f77b7fff640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f77a006be60 0x7f77a006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.080+0000 7f77b7fff640 1 -- 172.21.15.60:0/960925270 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5415+0+0 (secure 0 0 0) 0x7f77b00ab680 con 0x7f77c006fb10 2024-09-12T01:43:00.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.080+0000 7f77beffd640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f77a006be60 0x7f77a006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:00.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.080+0000 7f77beffd640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f77a006be60 0x7f77a006e320 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f77c014c660 tx=0x7f77a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:00.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.084+0000 7f77b7fff640 1 -- 172.21.15.60:0/960925270 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f77b004b030 con 0x7f77c006fb10 2024-09-12T01:43:00.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.263+0000 7f77c61be640 1 -- 172.21.15.60:0/960925270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f77c006e630 con 0x7f77c006fb10 2024-09-12T01:43:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.956+0000 7f77b7fff640 1 -- 172.21.15.60:0/960925270 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v108) ==== 169+0+0 (secure 0 0 0) 0x7f77b007a140 con 0x7f77c006fb10 2024-09-12T01:43:00.957 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-12T01:43:00.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.961+0000 7f77c61be640 1 -- 172.21.15.60:0/960925270 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f77a006be60 msgr2=0x7f77a006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:00.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.961+0000 7f77c61be640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f77a006be60 0x7f77a006e320 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f77c014c660 tx=0x7f77a8009040 comp rx=0 tx=0).stop 2024-09-12T01:43:00.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.961+0000 7f77c61be640 1 -- 172.21.15.60:0/960925270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77c006fb10 msgr2=0x7f77c014bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:00.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.961+0000 7f77c61be640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77c006fb10 0x7f77c014bfe0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f77b0000c00 tx=0x7f77b00046c0 comp rx=0 tx=0).stop 2024-09-12T01:43:00.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.962+0000 7f77c61be640 1 -- 172.21.15.60:0/960925270 shutdown_connections 2024-09-12T01:43:00.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.962+0000 7f77c61be640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f77c015e570 0x7f77c01f43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:00.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.962+0000 7f77c61be640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f77a006be60 0x7f77a006e320 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:00.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.962+0000 7f77c61be640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f77c00714a0 0x7f77c00cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:00.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.962+0000 7f77c61be640 1 --2- 172.21.15.60:0/960925270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77c006fb10 0x7f77c014bfe0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:00.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.962+0000 7f77c61be640 1 -- 172.21.15.60:0/960925270 >> 172.21.15.60:0/960925270 conn(0x7f77c00b4240 msgr2=0x7f77c006f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:00.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.963+0000 7f77c61be640 1 -- 172.21.15.60:0/960925270 shutdown_connections 2024-09-12T01:43:00.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:00.963+0000 7f77c61be640 1 -- 172.21.15.60:0/960925270 wait complete. 2024-09-12T01:43:00.982 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_min_caps_working_set 2024-09-12T01:43:01.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.091+0000 7f08cdffd640 1 Processor -- start 2024-09-12T01:43:01.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.091+0000 7f08cdffd640 1 -- start start 2024-09-12T01:43:01.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.092+0000 7f08cdffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08c80b6910 0x7f08c80b8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.092+0000 7f08cdffd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08c80b7790 con 0x7f08c80b64a0 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.092+0000 7f08cdffd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08c80d3600 con 0x7f08c815e750 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.092+0000 7f08cdffd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f08c80d43c0 con 0x7f08c80b6910 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.092+0000 7f08c6ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f08c80b64a0 0x7f08c80b7f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44092/0 (socket says 172.21.15.60:44092) 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.092+0000 7f08c6ffd640 1 -- 172.21.15.60:0/3257412492 learned_addr learned my addr 172.21.15.60:0/3257412492 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.093+0000 7f08c7fff640 1 --2- 172.21.15.60:0/3257412492 >> v2:172.21.15.105:3300/0 conn(0x7f08c80b6910 0x7f08c80b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.093+0000 7f08c67fc640 1 -- 172.21.15.60:0/3257412492 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 378133625 0 0) 0x7f08c80b7790 con 0x7f08c80b64a0 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.093+0000 7f08c67fc640 1 -- 172.21.15.60:0/3257412492 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08b0003520 con 0x7f08c80b64a0 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.093+0000 7f08c67fc640 1 -- 172.21.15.60:0/3257412492 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1866127558 0 0) 0x7f08c80d3600 con 0x7f08c815e750 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.093+0000 7f08c67fc640 1 -- 172.21.15.60:0/3257412492 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08c80b7790 con 0x7f08c815e750 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.093+0000 7f08c7fff640 1 -- 172.21.15.60:0/3257412492 >> v1:172.21.15.105:6789/0 conn(0x7f08c815e750 legacy=0x7f08c80cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.093+0000 7f08c67fc640 1 -- 172.21.15.60:0/3257412492 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 84966560 0 0) 0x7f08b0003520 con 0x7f08c80b64a0 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.093+0000 7f08c7fff640 1 -- 172.21.15.60:0/3257412492 >> v1:172.21.15.60:6789/0 conn(0x7f08c80b64a0 legacy=0x7f08c80b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.093+0000 7f08c7fff640 1 -- 172.21.15.60:0/3257412492 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c80d38e0 con 0x7f08c80b6910 2024-09-12T01:43:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.094+0000 7f08c7fff640 1 --2- 172.21.15.60:0/3257412492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08c80b6910 0x7f08c80b8660 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009d90 tx=0x7f08c002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4496b8d37426f497 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.094+0000 7f08c67fc640 1 -- 172.21.15.60:0/3257412492 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08bc001670 con 0x7f08c80b6910 2024-09-12T01:43:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.094+0000 7f08c67fc640 1 -- 172.21.15.60:0/3257412492 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08c0007540 con 0x7f08c80b6910 2024-09-12T01:43:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.094+0000 7f08c67fc640 1 -- 172.21.15.60:0/3257412492 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08c00078f0 con 0x7f08c80b6910 2024-09-12T01:43:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.094+0000 7f08cdffd640 1 -- 172.21.15.60:0/3257412492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08c80b6910 msgr2=0x7f08c80b8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.094+0000 7f08cdffd640 1 --2- 172.21.15.60:0/3257412492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08c80b6910 0x7f08c80b8660 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f08c0009d90 tx=0x7f08c002a680 comp rx=0 tx=0).stop 2024-09-12T01:43:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.095+0000 7f08cdffd640 1 -- 172.21.15.60:0/3257412492 shutdown_connections 2024-09-12T01:43:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.095+0000 7f08cdffd640 1 --2- 172.21.15.60:0/3257412492 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08c80b6910 0x7f08c80b8660 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.095+0000 7f08cdffd640 1 -- 172.21.15.60:0/3257412492 >> 172.21.15.60:0/3257412492 conn(0x7f08c80d1500 msgr2=0x7f08c80d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.095+0000 7f08cdffd640 1 -- 172.21.15.60:0/3257412492 shutdown_connections 2024-09-12T01:43:01.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.095+0000 7f08cdffd640 1 -- 172.21.15.60:0/3257412492 wait complete. 2024-09-12T01:43:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.096+0000 7f08cdffd640 1 Processor -- start 2024-09-12T01:43:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.096+0000 7f08cdffd640 1 -- start start 2024-09-12T01:43:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08cdffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08c80b64a0 0x7f08c8157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08cdffd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08c80b6910 0x7f08c8158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08cdffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08c815e750 0x7f08c8159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08cdffd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f08c80b7ac0 con 0x7f08c80b64a0 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08cdffd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f08c80d33b0 con 0x7f08c80b6910 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08cdffd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f08c815eb30 con 0x7f08c815e750 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08c77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08c80b64a0 0x7f08c8157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08c77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08c80b64a0 0x7f08c8157cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56544/0 (socket says 172.21.15.60:56544) 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08c77fe640 1 -- 172.21.15.60:0/61365322 learned_addr learned my addr 172.21.15.60:0/61365322 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08c6ffd640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08c80b6910 0x7f08c8158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08c7fff640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08c815e750 0x7f08c8159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08c77fe640 1 -- 172.21.15.60:0/61365322 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08c815e750 msgr2=0x7f08c8159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08c77fe640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08c815e750 0x7f08c8159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08c77fe640 1 -- 172.21.15.60:0/61365322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08c80b6910 msgr2=0x7f08c8158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08c77fe640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08c80b6910 0x7f08c8158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08c77fe640 1 -- 172.21.15.60:0/61365322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c8158e80 con 0x7f08c80b64a0 2024-09-12T01:43:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08c77fe640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08c80b64a0 0x7f08c8157cc0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f08b800c4c0 tx=0x7f08b800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.097+0000 7f08affff640 1 -- 172.21.15.60:0/61365322 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b80052d0 con 0x7f08c80b64a0 2024-09-12T01:43:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.098+0000 7f08affff640 1 -- 172.21.15.60:0/61365322 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b8005470 con 0x7f08c80b64a0 2024-09-12T01:43:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.098+0000 7f08cdffd640 1 -- 172.21.15.60:0/61365322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c8159160 con 0x7f08c80b64a0 2024-09-12T01:43:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.098+0000 7f08affff640 1 -- 172.21.15.60:0/61365322 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8012870 con 0x7f08c80b64a0 2024-09-12T01:43:01.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.098+0000 7f08cdffd640 1 -- 172.21.15.60:0/61365322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c8159720 con 0x7f08c80b64a0 2024-09-12T01:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.099+0000 7f08cdffd640 1 -- 172.21.15.60:0/61365322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c80cf630 con 0x7f08c80b64a0 2024-09-12T01:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.099+0000 7f08affff640 1 -- 172.21.15.60:0/61365322 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f08b8012a10 con 0x7f08c80b64a0 2024-09-12T01:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.100+0000 7f08affff640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f08b406be30 0x7f08b406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.100+0000 7f08affff640 1 -- 172.21.15.60:0/61365322 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7f08b808a5e0 con 0x7f08c80b64a0 2024-09-12T01:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.100+0000 7f08c6ffd640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f08b406be30 0x7f08b406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.100+0000 7f08c6ffd640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f08b406be30 0x7f08b406e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f08c8161050 tx=0x7f08bc001610 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:01.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.104+0000 7f08affff640 1 -- 172.21.15.60:0/61365322 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f08b8058cd0 con 0x7f08c80b64a0 2024-09-12T01:43:01.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.278+0000 7f08cdffd640 1 -- 172.21.15.60:0/61365322 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"} v 0) -- 0x7f08c815ed10 con 0x7f08c80b64a0 2024-09-12T01:43:01.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.282+0000 7f08affff640 1 -- 172.21.15.60:0/61365322 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"}]=0 v41) ==== 107+0+0 (secure 0 0 0) 0x7f08b805cfd0 con 0x7f08c80b64a0 2024-09-12T01:43:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.284+0000 7f08cdffd640 1 -- 172.21.15.60:0/61365322 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f08b406be30 msgr2=0x7f08b406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.284+0000 7f08cdffd640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f08b406be30 0x7f08b406e2f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f08c8161050 tx=0x7f08bc001610 comp rx=0 tx=0).stop 2024-09-12T01:43:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.284+0000 7f08cdffd640 1 -- 172.21.15.60:0/61365322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08c80b64a0 msgr2=0x7f08c8157cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.284+0000 7f08cdffd640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08c80b64a0 0x7f08c8157cc0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f08b800c4c0 tx=0x7f08b800c980 comp rx=0 tx=0).stop 2024-09-12T01:43:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.284+0000 7f08cdffd640 1 -- 172.21.15.60:0/61365322 shutdown_connections 2024-09-12T01:43:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.284+0000 7f08cdffd640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f08b406be30 0x7f08b406e2f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.284+0000 7f08cdffd640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f08c815e750 0x7f08c8159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.284+0000 7f08cdffd640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08c80b6910 0x7f08c8158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.284+0000 7f08cdffd640 1 --2- 172.21.15.60:0/61365322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08c80b64a0 0x7f08c8157cc0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.284+0000 7f08cdffd640 1 -- 172.21.15.60:0/61365322 >> 172.21.15.60:0/61365322 conn(0x7f08c80d1500 msgr2=0x7f08c80b50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.284+0000 7f08cdffd640 1 -- 172.21.15.60:0/61365322 shutdown_connections 2024-09-12T01:43:01.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.284+0000 7f08cdffd640 1 -- 172.21.15.60:0/61365322 wait complete. 2024-09-12T01:43:01.296 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_memory_limit 2024-09-12T01:43:01.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.399+0000 7f66f8053640 1 Processor -- start 2024-09-12T01:43:01.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.400+0000 7f66f8053640 1 -- start start 2024-09-12T01:43:01.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.400+0000 7f66f8053640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f66f015b480 0x7f66f00b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.400+0000 7f66f8053640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f66f0072700 0x7f66f015bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.400+0000 7f66f8053640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f00ccff0 con 0x7f66f00b60c0 2024-09-12T01:43:01.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.400+0000 7f66f8053640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f66f00cd2d0 con 0x7f66f015b480 2024-09-12T01:43:01.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.400+0000 7f66f8053640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f66f00cd5b0 con 0x7f66f0072700 2024-09-12T01:43:01.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.401+0000 7f66f5def640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f66f015b480 0x7f66f00b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.401+0000 7f66f5def640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f66f015b480 0x7f66f00b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56560/0 (socket says 172.21.15.60:56560) 2024-09-12T01:43:01.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.401+0000 7f66f5def640 1 -- 172.21.15.60:0/1045977606 learned_addr learned my addr 172.21.15.60:0/1045977606 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:01.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.401+0000 7f66f65f0640 1 --2- 172.21.15.60:0/1045977606 >> v2:172.21.15.105:3300/0 conn(0x7f66f0072700 0x7f66f015bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.401+0000 7f66f5def640 1 -- 172.21.15.60:0/1045977606 >> v2:172.21.15.105:3300/0 conn(0x7f66f0072700 msgr2=0x7f66f015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:01.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.401+0000 7f66f5def640 1 --2- 172.21.15.60:0/1045977606 >> v2:172.21.15.105:3300/0 conn(0x7f66f0072700 0x7f66f015bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.401+0000 7f66f5def640 1 -- 172.21.15.60:0/1045977606 >> v1:172.21.15.105:6789/0 conn(0x7f66f00b60c0 legacy=0x7f66f0071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.401+0000 7f66f5def640 1 -- 172.21.15.60:0/1045977606 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f00cd890 con 0x7f66f015b480 2024-09-12T01:43:01.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.402+0000 7f66f5def640 1 --2- 172.21.15.60:0/1045977606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f015b480 0x7f66f00b5b80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f66f00cdf80 tx=0x7f66e002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f1679cdfcda28b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:01.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.402+0000 7f66f4ded640 1 -- 172.21.15.60:0/1045977606 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0036070 con 0x7f66f015b480 2024-09-12T01:43:01.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.402+0000 7f66f4ded640 1 -- 172.21.15.60:0/1045977606 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e0031600 con 0x7f66f015b480 2024-09-12T01:43:01.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.402+0000 7f66f4ded640 1 -- 172.21.15.60:0/1045977606 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e00319d0 con 0x7f66f015b480 2024-09-12T01:43:01.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.402+0000 7f66f8053640 1 -- 172.21.15.60:0/1045977606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f015b480 msgr2=0x7f66f00b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.402+0000 7f66f8053640 1 --2- 172.21.15.60:0/1045977606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f015b480 0x7f66f00b5b80 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f66f00cdf80 tx=0x7f66e002a6a0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.402+0000 7f66f8053640 1 -- 172.21.15.60:0/1045977606 shutdown_connections 2024-09-12T01:43:01.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.402+0000 7f66f8053640 1 --2- 172.21.15.60:0/1045977606 >> v2:172.21.15.105:3300/0 conn(0x7f66f0072700 0x7f66f015bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.402+0000 7f66f8053640 1 --2- 172.21.15.60:0/1045977606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f015b480 0x7f66f00b5b80 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.402+0000 7f66f8053640 1 -- 172.21.15.60:0/1045977606 >> 172.21.15.60:0/1045977606 conn(0x7f66f006d0f0 msgr2=0x7f66f006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:01.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.403+0000 7f66f8053640 1 -- 172.21.15.60:0/1045977606 shutdown_connections 2024-09-12T01:43:01.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.403+0000 7f66f8053640 1 -- 172.21.15.60:0/1045977606 wait complete. 2024-09-12T01:43:01.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.404+0000 7f66f8053640 1 Processor -- start 2024-09-12T01:43:01.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.404+0000 7f66f8053640 1 -- start start 2024-09-12T01:43:01.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f8053640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f0072700 0x7f66f01578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f8053640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66f00b60c0 0x7f66f015dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f8053640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66f015b480 0x7f66f0149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f8053640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f66f015b9e0 con 0x7f66f0072700 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f8053640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66f015b860 con 0x7f66f015b480 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f8053640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f66f015c1a0 con 0x7f66f00b60c0 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f5def640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f0072700 0x7f66f01578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f5def640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f0072700 0x7f66f01578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56562/0 (socket says 172.21.15.60:56562) 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f5def640 1 -- 172.21.15.60:0/182263551 learned_addr learned my addr 172.21.15.60:0/182263551 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f65f0640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66f015b480 0x7f66f0149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f55ee640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66f00b60c0 0x7f66f015dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f5def640 1 -- 172.21.15.60:0/182263551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66f00b60c0 msgr2=0x7f66f015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f5def640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66f00b60c0 0x7f66f015dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f5def640 1 -- 172.21.15.60:0/182263551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66f015b480 msgr2=0x7f66f0149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f5def640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66f015b480 0x7f66f0149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f5def640 1 -- 172.21.15.60:0/182263551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f00c9bd0 con 0x7f66f0072700 2024-09-12T01:43:01.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f5def640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f0072700 0x7f66f01578d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f66e0034040 tx=0x7f66e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:01.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66ee7fc640 1 -- 172.21.15.60:0/182263551 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0036050 con 0x7f66f0072700 2024-09-12T01:43:01.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66ee7fc640 1 -- 172.21.15.60:0/182263551 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e0042070 con 0x7f66f0072700 2024-09-12T01:43:01.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66ee7fc640 1 -- 172.21.15.60:0/182263551 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e0009510 con 0x7f66f0072700 2024-09-12T01:43:01.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.405+0000 7f66f8053640 1 -- 172.21.15.60:0/182263551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f00c9eb0 con 0x7f66f0072700 2024-09-12T01:43:01.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.406+0000 7f66f8053640 1 -- 172.21.15.60:0/182263551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f00ca470 con 0x7f66f0072700 2024-09-12T01:43:01.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.407+0000 7f66f8053640 1 -- 172.21.15.60:0/182263551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f015bc60 con 0x7f66f0072700 2024-09-12T01:43:01.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.407+0000 7f66ee7fc640 1 -- 172.21.15.60:0/182263551 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66e0007c50 con 0x7f66f0072700 2024-09-12T01:43:01.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.408+0000 7f66ee7fc640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66dc06be30 0x7f66dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.408+0000 7f66ee7fc640 1 -- 172.21.15.60:0/182263551 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7f66e00ab9a0 con 0x7f66f0072700 2024-09-12T01:43:01.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.408+0000 7f66f55ee640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66dc06be30 0x7f66dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.408+0000 7f66f55ee640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66dc06be30 0x7f66dc06e2f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f66f0157580 tx=0x7f66e4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:01.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.412+0000 7f66ee7fc640 1 -- 172.21.15.60:0/182263551 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66e007a650 con 0x7f66f0072700 2024-09-12T01:43:01.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.586+0000 7f66f8053640 1 -- 172.21.15.60:0/182263551 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"} v 0) -- 0x7f66f0157140 con 0x7f66f0072700 2024-09-12T01:43:01.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.589+0000 7f66ee7fc640 1 -- 172.21.15.60:0/182263551 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"}]=0 v42) ==== 105+0+0 (secure 0 0 0) 0x7f66e0079f50 con 0x7f66f0072700 2024-09-12T01:43:01.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.592+0000 7f66f8053640 1 -- 172.21.15.60:0/182263551 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66dc06be30 msgr2=0x7f66dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.592+0000 7f66f8053640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66dc06be30 0x7f66dc06e2f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f66f0157580 tx=0x7f66e4009040 comp rx=0 tx=0).stop 2024-09-12T01:43:01.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.592+0000 7f66f8053640 1 -- 172.21.15.60:0/182263551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f0072700 msgr2=0x7f66f01578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.592+0000 7f66f8053640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f0072700 0x7f66f01578d0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f66e0034040 tx=0x7f66e0004a40 comp rx=0 tx=0).stop 2024-09-12T01:43:01.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.592+0000 7f66f8053640 1 -- 172.21.15.60:0/182263551 shutdown_connections 2024-09-12T01:43:01.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.592+0000 7f66f8053640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66f015b480 0x7f66f0149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.592+0000 7f66f8053640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66dc06be30 0x7f66dc06e2f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.592+0000 7f66f8053640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66f00b60c0 0x7f66f015dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.592+0000 7f66f8053640 1 --2- 172.21.15.60:0/182263551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66f0072700 0x7f66f01578d0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.592+0000 7f66f8053640 1 -- 172.21.15.60:0/182263551 >> 172.21.15.60:0/182263551 conn(0x7f66f006d0f0 msgr2=0x7f66f00cf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:01.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.592+0000 7f66f8053640 1 -- 172.21.15.60:0/182263551 shutdown_connections 2024-09-12T01:43:01.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.592+0000 7f66f8053640 1 -- 172.21.15.60:0/182263551 wait complete. 2024-09-12T01:43:01.603 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T01:43:01.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.707+0000 7f8999d9f640 1 Processor -- start 2024-09-12T01:43:01.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.707+0000 7f8999d9f640 1 -- start start 2024-09-12T01:43:01.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f8999d9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89940b6910 0x7f89940b8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f8999d9f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89940b7790 con 0x7f899415e750 2024-09-12T01:43:01.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f8999d9f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89940d3600 con 0x7f89940b64a0 2024-09-12T01:43:01.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f8999d9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f89940d43c0 con 0x7f89940b6910 2024-09-12T01:43:01.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89937fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f899415e750 0x7f89940cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44106/0 (socket says 172.21.15.60:44106) 2024-09-12T01:43:01.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89937fe640 1 -- 172.21.15.60:0/2251424078 learned_addr learned my addr 172.21.15.60:0/2251424078 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:01.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f8993fff640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89940b6910 0x7f89940b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430003759 0 0) 0x7f89940b7790 con 0x7f899415e750 2024-09-12T01:43:01.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f897c003520 con 0x7f899415e750 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3036999962 0 0) 0x7f89940d3600 con 0x7f89940b64a0 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89940b7790 con 0x7f89940b64a0 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3225582179 0 0) 0x7f897c003520 con 0x7f899415e750 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89940b6910 msgr2=0x7f89940b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89940b6910 0x7f89940b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 >> v1:172.21.15.105:6789/0 conn(0x7f89940b64a0 legacy=0x7f89940b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89940d38e0 con 0x7f899415e750 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f8984001690 con 0x7f899415e750 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 >> v1:172.21.15.60:6789/0 conn(0x7f899415e750 legacy=0x7f89940cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f897c003b70 0x7f897c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.708+0000 7f89927fc640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897c004800 0x7f897c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f89927fc640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89940b6910 0x7f897c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f89940d43c0 con 0x7f897c004800 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f897c00ba70 con 0x7f897c003b70 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f897c00bc40 con 0x7f89940b6910 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f8992ffd640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897c004800 0x7f897c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f89937fe640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f897c003b70 0x7f897c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f8993fff640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89940b6910 0x7f897c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f8992ffd640 1 -- 172.21.15.60:0/2251424078 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89940b6910 msgr2=0x7f897c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f8992ffd640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89940b6910 0x7f897c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f8992ffd640 1 -- 172.21.15.60:0/2251424078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f897c003b70 msgr2=0x7f897c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f8992ffd640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f897c003b70 0x7f897c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f8992ffd640 1 -- 172.21.15.60:0/2251424078 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c003520 con 0x7f897c004800 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.709+0000 7f8993fff640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f89940b6910 0x7f897c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.710+0000 7f8992ffd640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897c004800 0x7f897c004c80 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f89880018d0 tx=0x7f897c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923b979e43d250dc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:01.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.710+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89880014f0 con 0x7f897c004800 2024-09-12T01:43:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.710+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89880052d0 con 0x7f897c004800 2024-09-12T01:43:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.710+0000 7f89927fc640 1 -- 172.21.15.60:0/2251424078 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898802ac30 con 0x7f897c004800 2024-09-12T01:43:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.710+0000 7f8999d9f640 1 -- 172.21.15.60:0/2251424078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897c004800 msgr2=0x7f897c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.710+0000 7f8999d9f640 1 --2- 172.21.15.60:0/2251424078 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f897c004800 0x7f897c004c80 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f89880018d0 tx=0x7f897c005830 comp rx=0 tx=0).stop 2024-09-12T01:43:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.710+0000 7f8993fff640 1 -- 172.21.15.60:0/2251424078 reap_dead start 2024-09-12T01:43:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.710+0000 7f8999d9f640 1 -- 172.21.15.60:0/2251424078 shutdown_connections 2024-09-12T01:43:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.710+0000 7f8999d9f640 1 -- 172.21.15.60:0/2251424078 >> 172.21.15.60:0/2251424078 conn(0x7f89940d1500 msgr2=0x7f89940d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.710+0000 7f8999d9f640 1 -- 172.21.15.60:0/2251424078 shutdown_connections 2024-09-12T01:43:01.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.710+0000 7f8999d9f640 1 -- 172.21.15.60:0/2251424078 wait complete. 2024-09-12T01:43:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.711+0000 7f8999d9f640 1 Processor -- start 2024-09-12T01:43:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.712+0000 7f8999d9f640 1 -- start start 2024-09-12T01:43:01.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.712+0000 7f8999d9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897c004800 0x7f899415b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.712+0000 7f8999d9f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89940ac390 0x7f8994157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.712+0000 7f8999d9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89941f4340 0x7f89940acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.712+0000 7f8999d9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f89940b7ac0 con 0x7f89941f4340 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.712+0000 7f8999d9f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f89940d33b0 con 0x7f89940ac390 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.712+0000 7f8999d9f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f89940b6d80 con 0x7f897c004800 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f8993fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89941f4340 0x7f89940acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f8993fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89941f4340 0x7f89940acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56580/0 (socket says 172.21.15.60:56580) 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f89937fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897c004800 0x7f899415b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f8992ffd640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89940ac390 0x7f8994157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f8993fff640 1 -- 172.21.15.60:0/641651794 learned_addr learned my addr 172.21.15.60:0/641651794 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f8993fff640 1 -- 172.21.15.60:0/641651794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897c004800 msgr2=0x7f899415b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f8993fff640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897c004800 0x7f899415b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f8993fff640 1 -- 172.21.15.60:0/641651794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89940ac390 msgr2=0x7f8994157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f8993fff640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89940ac390 0x7f8994157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f8993fff640 1 -- 172.21.15.60:0/641651794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89940ac810 con 0x7f89941f4340 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f8993fff640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89941f4340 0x7f89940acb40 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f8994069950 tx=0x7f898c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f897bfff640 1 -- 172.21.15.60:0/641651794 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c01a030 con 0x7f89941f4340 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f897bfff640 1 -- 172.21.15.60:0/641651794 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f898c010e80 con 0x7f89941f4340 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f8999d9f640 1 -- 172.21.15.60:0/641651794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89941587c0 con 0x7f89941f4340 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f897bfff640 1 -- 172.21.15.60:0/641651794 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898c003bd0 con 0x7f89941f4340 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.713+0000 7f8999d9f640 1 -- 172.21.15.60:0/641651794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8994158d80 con 0x7f89941f4340 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.714+0000 7f8999d9f640 1 -- 172.21.15.60:0/641651794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89940cf630 con 0x7f89941f4340 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.715+0000 7f897bfff640 1 -- 172.21.15.60:0/641651794 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f898c005d10 con 0x7f89941f4340 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.715+0000 7f897bfff640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f898006be30 0x7f898006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.715+0000 7f897bfff640 1 -- 172.21.15.60:0/641651794 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7f898c08b0c0 con 0x7f89941f4340 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.716+0000 7f89937fe640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f898006be30 0x7f898006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:01.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.716+0000 7f89937fe640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f898006be30 0x7f898006e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8984001050 tx=0x7f8984001e50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:01.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.720+0000 7f897bfff640 1 -- 172.21.15.60:0/641651794 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f898c025020 con 0x7f89941f4340 2024-09-12T01:43:01.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.895+0000 7f8999d9f640 1 -- 172.21.15.60:0/641651794 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f89940b5c80 con 0x7f89941f4340 2024-09-12T01:43:01.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.898+0000 7f897bfff640 1 -- 172.21.15.60:0/641651794 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v43) ==== 104+0+0 (secure 0 0 0) 0x7f89940ac810 con 0x7f89941f4340 2024-09-12T01:43:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.900+0000 7f8999d9f640 1 -- 172.21.15.60:0/641651794 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f898006be30 msgr2=0x7f898006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.900+0000 7f8999d9f640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f898006be30 0x7f898006e2f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8984001050 tx=0x7f8984001e50 comp rx=0 tx=0).stop 2024-09-12T01:43:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.900+0000 7f8999d9f640 1 -- 172.21.15.60:0/641651794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89941f4340 msgr2=0x7f89940acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.900+0000 7f8999d9f640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89941f4340 0x7f89940acb40 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f8994069950 tx=0x7f898c009f90 comp rx=0 tx=0).stop 2024-09-12T01:43:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.900+0000 7f8999d9f640 1 -- 172.21.15.60:0/641651794 shutdown_connections 2024-09-12T01:43:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.900+0000 7f8999d9f640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89941f4340 0x7f89940acb40 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.900+0000 7f8999d9f640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f89940ac390 0x7f8994157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.900+0000 7f8999d9f640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f898006be30 0x7f898006e2f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.900+0000 7f8999d9f640 1 --2- 172.21.15.60:0/641651794 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f897c004800 0x7f899415b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.900+0000 7f8999d9f640 1 -- 172.21.15.60:0/641651794 >> 172.21.15.60:0/641651794 conn(0x7f89940d1500 msgr2=0x7f899406bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:01.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.900+0000 7f8999d9f640 1 -- 172.21.15.60:0/641651794 shutdown_connections 2024-09-12T01:43:01.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:01.900+0000 7f8999d9f640 1 -- 172.21.15.60:0/641651794 wait complete. 2024-09-12T01:43:01.911 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_max_caps 2024-09-12T01:43:02.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.015+0000 7fa6fbcac640 1 Processor -- start 2024-09-12T01:43:02.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.016+0000 7fa6fbcac640 1 -- start start 2024-09-12T01:43:02.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.016+0000 7fa6fbcac640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa6f40cf1f0 0x7fa6f40b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.016+0000 7fa6fbcac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6f40b6720 0x7fa6f40d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.016+0000 7fa6fbcac640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6f40cf860 con 0x7fa6f415e7a0 2024-09-12T01:43:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.016+0000 7fa6fbcac640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa6f40d2ca0 con 0x7fa6f40cf1f0 2024-09-12T01:43:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.016+0000 7fa6fbcac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f40cfb40 con 0x7fa6f40b6720 2024-09-12T01:43:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.016+0000 7fa6f9247640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa6f40cf1f0 0x7fa6f40b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.016+0000 7fa6f9a48640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa6f415e7a0 0x7fa6f406caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44122/0 (socket says 172.21.15.60:44122) 2024-09-12T01:43:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.016+0000 7fa6f9247640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa6f40cf1f0 0x7fa6f40b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56588/0 (socket says 172.21.15.60:56588) 2024-09-12T01:43:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.016+0000 7fa6f9a48640 1 -- 172.21.15.60:0/469510473 learned_addr learned my addr 172.21.15.60:0/469510473 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.017+0000 7fa6fa249640 1 --2- 172.21.15.60:0/469510473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6f40b6720 0x7fa6f40d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.017+0000 7fa6f9247640 1 -- 172.21.15.60:0/469510473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6f40b6720 msgr2=0x7fa6f40d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.017+0000 7fa6f9247640 1 --2- 172.21.15.60:0/469510473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6f40b6720 0x7fa6f40d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.017+0000 7fa6f9247640 1 -- 172.21.15.60:0/469510473 >> v1:172.21.15.60:6789/0 conn(0x7fa6f415e7a0 legacy=0x7fa6f406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.017+0000 7fa6f9247640 1 -- 172.21.15.60:0/469510473 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f40cfe20 con 0x7fa6f40cf1f0 2024-09-12T01:43:02.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.017+0000 7fa6f8a46640 1 -- 172.21.15.60:0/469510473 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3568931070 0 0) 0x7fa6f40cf860 con 0x7fa6f415e7a0 2024-09-12T01:43:02.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.017+0000 7fa6fa249640 1 --2- 172.21.15.60:0/469510473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6f40b6720 0x7fa6f40d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:02.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.018+0000 7fa6f9247640 1 --2- 172.21.15.60:0/469510473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6f40cf1f0 0x7fa6f40b61e0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80097a0 tx=0x7fa6e802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52ec5d6cec602c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:02.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.018+0000 7fa6f8a46640 1 -- 172.21.15.60:0/469510473 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8037070 con 0x7fa6f40cf1f0 2024-09-12T01:43:02.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.018+0000 7fa6f8a46640 1 -- 172.21.15.60:0/469510473 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6e802ae50 con 0x7fa6f40cf1f0 2024-09-12T01:43:02.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.018+0000 7fa6f8a46640 1 -- 172.21.15.60:0/469510473 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8032660 con 0x7fa6f40cf1f0 2024-09-12T01:43:02.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.018+0000 7fa6fbcac640 1 -- 172.21.15.60:0/469510473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6f40cf1f0 msgr2=0x7fa6f40b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.018+0000 7fa6fbcac640 1 --2- 172.21.15.60:0/469510473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6f40cf1f0 0x7fa6f40b61e0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fa6e80097a0 tx=0x7fa6e802a100 comp rx=0 tx=0).stop 2024-09-12T01:43:02.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.018+0000 7fa6fbcac640 1 -- 172.21.15.60:0/469510473 shutdown_connections 2024-09-12T01:43:02.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.018+0000 7fa6fbcac640 1 --2- 172.21.15.60:0/469510473 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6f40b6720 0x7fa6f40d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.018+0000 7fa6fbcac640 1 --2- 172.21.15.60:0/469510473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6f40cf1f0 0x7fa6f40b61e0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.018+0000 7fa6fbcac640 1 -- 172.21.15.60:0/469510473 >> 172.21.15.60:0/469510473 conn(0x7fa6f40d11e0 msgr2=0x7fa6f40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:02.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.018+0000 7fa6fbcac640 1 -- 172.21.15.60:0/469510473 shutdown_connections 2024-09-12T01:43:02.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.018+0000 7fa6fbcac640 1 -- 172.21.15.60:0/469510473 wait complete. 2024-09-12T01:43:02.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.019+0000 7fa6fbcac640 1 Processor -- start 2024-09-12T01:43:02.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.020+0000 7fa6fbcac640 1 -- start start 2024-09-12T01:43:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.020+0000 7fa6fbcac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6f40b6720 0x7fa6f41520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.020+0000 7fa6fbcac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6f40cf1f0 0x7fa6f40cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.020+0000 7fa6fbcac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6f415e7a0 0x7fa6f4150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.020+0000 7fa6fbcac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f415eb80 con 0x7fa6f415e7a0 2024-09-12T01:43:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.020+0000 7fa6fbcac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f40b7a00 con 0x7fa6f40b6720 2024-09-12T01:43:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.020+0000 7fa6fbcac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa6f415ed00 con 0x7fa6f40cf1f0 2024-09-12T01:43:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.020+0000 7fa6fa249640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6f415e7a0 0x7fa6f4150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.020+0000 7fa6fa249640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6f415e7a0 0x7fa6f4150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56602/0 (socket says 172.21.15.60:56602) 2024-09-12T01:43:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.020+0000 7fa6fa249640 1 -- 172.21.15.60:0/3059433096 learned_addr learned my addr 172.21.15.60:0/3059433096 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.020+0000 7fa6f9a48640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6f40b6720 0x7fa6f41520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.020+0000 7fa6f9247640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6f40cf1f0 0x7fa6f40cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.021+0000 7fa6fa249640 1 -- 172.21.15.60:0/3059433096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6f40cf1f0 msgr2=0x7fa6f40cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.021+0000 7fa6fa249640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6f40cf1f0 0x7fa6f40cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.021+0000 7fa6fa249640 1 -- 172.21.15.60:0/3059433096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6f40b6720 msgr2=0x7fa6f41520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.021+0000 7fa6fa249640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6f40b6720 0x7fa6f41520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.021+0000 7fa6fa249640 1 -- 172.21.15.60:0/3059433096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f40d55a0 con 0x7fa6f415e7a0 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.021+0000 7fa6f9247640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6f40cf1f0 0x7fa6f40cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.021+0000 7fa6fa249640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6f415e7a0 0x7fa6f4150b30 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400cf20 tx=0x7fa6e400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.021+0000 7fa6f27fc640 1 -- 172.21.15.60:0/3059433096 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e401a070 con 0x7fa6f415e7a0 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.021+0000 7fa6f27fc640 1 -- 172.21.15.60:0/3059433096 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6e400d840 con 0x7fa6f415e7a0 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.021+0000 7fa6fbcac640 1 -- 172.21.15.60:0/3059433096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f41527b0 con 0x7fa6f415e7a0 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.021+0000 7fa6f27fc640 1 -- 172.21.15.60:0/3059433096 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6e400dc30 con 0x7fa6f415e7a0 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.021+0000 7fa6fbcac640 1 -- 172.21.15.60:0/3059433096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f40b84c0 con 0x7fa6f415e7a0 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.022+0000 7fa6fbcac640 1 -- 172.21.15.60:0/3059433096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f40b61e0 con 0x7fa6f415e7a0 2024-09-12T01:43:02.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.023+0000 7fa6f27fc640 1 -- 172.21.15.60:0/3059433096 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa6e401d070 con 0x7fa6f415e7a0 2024-09-12T01:43:02.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.023+0000 7fa6f27fc640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa6e006be30 0x7fa6e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.023+0000 7fa6f27fc640 1 -- 172.21.15.60:0/3059433096 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7fa6e408b2a0 con 0x7fa6f415e7a0 2024-09-12T01:43:02.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.023+0000 7fa6f9a48640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa6e006be30 0x7fa6e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.025 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.023+0000 7fa6f9a48640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa6e006be30 0x7fa6e006e2f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec007fd0 tx=0x7fa6ec007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:02.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.027+0000 7fa6f27fc640 1 -- 172.21.15.60:0/3059433096 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa6e4059990 con 0x7fa6f415e7a0 2024-09-12T01:43:02.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.202+0000 7fa6fbcac640 1 -- 172.21.15.60:0/3059433096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"} v 0) -- 0x7fa6f40d2a80 con 0x7fa6f415e7a0 2024-09-12T01:43:02.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.206+0000 7fa6f27fc640 1 -- 172.21.15.60:0/3059433096 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"}]=0 v44) ==== 102+0+0 (secure 0 0 0) 0x7fa6e405ee20 con 0x7fa6f415e7a0 2024-09-12T01:43:02.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.208+0000 7fa6fbcac640 1 -- 172.21.15.60:0/3059433096 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa6e006be30 msgr2=0x7fa6e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.208+0000 7fa6fbcac640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa6e006be30 0x7fa6e006e2f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec007fd0 tx=0x7fa6ec007de0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.208+0000 7fa6fbcac640 1 -- 172.21.15.60:0/3059433096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6f415e7a0 msgr2=0x7fa6f4150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.208+0000 7fa6fbcac640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6f415e7a0 0x7fa6f4150b30 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fa6e400cf20 tx=0x7fa6e400a7d0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.208+0000 7fa6fbcac640 1 -- 172.21.15.60:0/3059433096 shutdown_connections 2024-09-12T01:43:02.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.208+0000 7fa6fbcac640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6f415e7a0 0x7fa6f4150b30 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.208+0000 7fa6fbcac640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa6e006be30 0x7fa6e006e2f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.208+0000 7fa6fbcac640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa6f40cf1f0 0x7fa6f40cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.208+0000 7fa6fbcac640 1 --2- 172.21.15.60:0/3059433096 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa6f40b6720 0x7fa6f41520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.208+0000 7fa6fbcac640 1 -- 172.21.15.60:0/3059433096 >> 172.21.15.60:0/3059433096 conn(0x7fa6f40d11e0 msgr2=0x7fa6f40b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:02.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.208+0000 7fa6fbcac640 1 -- 172.21.15.60:0/3059433096 shutdown_connections 2024-09-12T01:43:02.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.208+0000 7fa6fbcac640 1 -- 172.21.15.60:0/3059433096 wait complete. 2024-09-12T01:43:02.219 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_warning_threshold 2024-09-12T01:43:02.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.324+0000 7f23aba1e640 1 Processor -- start 2024-09-12T01:43:02.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.324+0000 7f23aba1e640 1 -- start start 2024-09-12T01:43:02.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23aba1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a415e750 0x7f23a40cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23aba1e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f23a40cfb70 0x7f23a40b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23aba1e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a40b7790 con 0x7f23a40b69e0 2024-09-12T01:43:02.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23aba1e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f23a40d43c0 con 0x7f23a40cfb70 2024-09-12T01:43:02.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23aba1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f23a40d33b0 con 0x7f23a415e750 2024-09-12T01:43:02.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23a97ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a415e750 0x7f23a40cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23a8fb9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f23a40cfb70 0x7f23a40b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23a9fbb640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f23a40b69e0 0x7f23a406bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:34406/0 (socket says 172.21.15.60:34406) 2024-09-12T01:43:02.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23a9fbb640 1 -- 172.21.15.60:0/2321657766 learned_addr learned my addr 172.21.15.60:0/2321657766 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:02.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f239bfff640 1 -- 172.21.15.60:0/2321657766 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 635854235 0 0) 0x7f23a40b7790 con 0x7f23a40b69e0 2024-09-12T01:43:02.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f239bfff640 1 -- 172.21.15.60:0/2321657766 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2390003520 con 0x7f23a40b69e0 2024-09-12T01:43:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23a97ba640 1 -- 172.21.15.60:0/2321657766 >> v2:172.21.15.105:3300/0 conn(0x7f23a40cfb70 msgr2=0x7f23a40b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23a97ba640 1 --2- 172.21.15.60:0/2321657766 >> v2:172.21.15.105:3300/0 conn(0x7f23a40cfb70 0x7f23a40b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23a97ba640 1 -- 172.21.15.60:0/2321657766 >> v1:172.21.15.105:6789/0 conn(0x7f23a40b69e0 legacy=0x7f23a406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23a97ba640 1 -- 172.21.15.60:0/2321657766 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a40d3600 con 0x7f23a415e750 2024-09-12T01:43:02.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.325+0000 7f23a8fb9640 1 --2- 172.21.15.60:0/2321657766 >> v2:172.21.15.105:3300/0 conn(0x7f23a40cfb70 0x7f23a40b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.326+0000 7f23a97ba640 1 --2- 172.21.15.60:0/2321657766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a415e750 0x7f23a40cf630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f23a00097a0 tx=0x7f23a002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd485497ba350b49 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.326+0000 7f239bfff640 1 -- 172.21.15.60:0/2321657766 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0037070 con 0x7f23a415e750 2024-09-12T01:43:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.326+0000 7f239bfff640 1 -- 172.21.15.60:0/2321657766 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a002ae50 con 0x7f23a415e750 2024-09-12T01:43:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.326+0000 7f239bfff640 1 -- 172.21.15.60:0/2321657766 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0032640 con 0x7f23a415e750 2024-09-12T01:43:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.327+0000 7f23aba1e640 1 -- 172.21.15.60:0/2321657766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a415e750 msgr2=0x7f23a40cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.327+0000 7f23aba1e640 1 --2- 172.21.15.60:0/2321657766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a415e750 0x7f23a40cf630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f23a00097a0 tx=0x7f23a002a100 comp rx=0 tx=0).stop 2024-09-12T01:43:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.327+0000 7f23aba1e640 1 -- 172.21.15.60:0/2321657766 shutdown_connections 2024-09-12T01:43:02.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.327+0000 7f23aba1e640 1 --2- 172.21.15.60:0/2321657766 >> v2:172.21.15.105:3300/0 conn(0x7f23a40cfb70 0x7f23a40b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.327+0000 7f23aba1e640 1 --2- 172.21.15.60:0/2321657766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a415e750 0x7f23a40cf630 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.327+0000 7f23aba1e640 1 -- 172.21.15.60:0/2321657766 >> 172.21.15.60:0/2321657766 conn(0x7f23a40d1500 msgr2=0x7f23a40d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:02.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.327+0000 7f23aba1e640 1 -- 172.21.15.60:0/2321657766 shutdown_connections 2024-09-12T01:43:02.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.327+0000 7f23aba1e640 1 -- 172.21.15.60:0/2321657766 wait complete. 2024-09-12T01:43:02.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.328+0000 7f23aba1e640 1 Processor -- start 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.328+0000 7f23aba1e640 1 -- start start 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.329+0000 7f23aba1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a40b69e0 0x7f23a40cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.329+0000 7f23aba1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23a40cfb70 0x7f23a4155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.329+0000 7f23aba1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a415e750 0x7f23a40cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.329+0000 7f23aba1e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f23a40d3bc0 con 0x7f23a40b69e0 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.329+0000 7f23aba1e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f23a40b7ac0 con 0x7f23a40cfb70 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.329+0000 7f23aba1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f23a415eb30 con 0x7f23a415e750 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.329+0000 7f23a97ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a40b69e0 0x7f23a40cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.329+0000 7f23a97ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a40b69e0 0x7f23a40cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:56618/0 (socket says 172.21.15.60:56618) 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.329+0000 7f23a97ba640 1 -- 172.21.15.60:0/3707751955 learned_addr learned my addr 172.21.15.60:0/3707751955 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.329+0000 7f23a9fbb640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a415e750 0x7f23a40cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.329+0000 7f23a8fb9640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23a40cfb70 0x7f23a4155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.330+0000 7f23a97ba640 1 -- 172.21.15.60:0/3707751955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a415e750 msgr2=0x7f23a40cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.330+0000 7f23a97ba640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a415e750 0x7f23a40cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.330+0000 7f23a97ba640 1 -- 172.21.15.60:0/3707751955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23a40cfb70 msgr2=0x7f23a4155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.330+0000 7f23a97ba640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23a40cfb70 0x7f23a4155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.330+0000 7f23a97ba640 1 -- 172.21.15.60:0/3707751955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a40cb8d0 con 0x7f23a40b69e0 2024-09-12T01:43:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.330+0000 7f23a97ba640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a40b69e0 0x7f23a40cc970 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f23a002a140 tx=0x7f23a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.330+0000 7f2399ffb640 1 -- 172.21.15.60:0/3707751955 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a0037050 con 0x7f23a40b69e0 2024-09-12T01:43:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.330+0000 7f2399ffb640 1 -- 172.21.15.60:0/3707751955 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a0043070 con 0x7f23a40b69e0 2024-09-12T01:43:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.330+0000 7f23aba1e640 1 -- 172.21.15.60:0/3707751955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a40cbbb0 con 0x7f23a40b69e0 2024-09-12T01:43:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.330+0000 7f2399ffb640 1 -- 172.21.15.60:0/3707751955 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a003e670 con 0x7f23a40b69e0 2024-09-12T01:43:02.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.330+0000 7f23aba1e640 1 -- 172.21.15.60:0/3707751955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a40cc170 con 0x7f23a40b69e0 2024-09-12T01:43:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.331+0000 7f23aba1e640 1 -- 172.21.15.60:0/3707751955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a40b64a0 con 0x7f23a40b69e0 2024-09-12T01:43:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.332+0000 7f2399ffb640 1 -- 172.21.15.60:0/3707751955 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f23a003e810 con 0x7f23a40b69e0 2024-09-12T01:43:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.332+0000 7f2399ffb640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f238806be30 0x7f238806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.332+0000 7f2399ffb640 1 -- 172.21.15.60:0/3707751955 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7f23a00ab3d0 con 0x7f23a40b69e0 2024-09-12T01:43:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.332+0000 7f23a8fb9640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f238806be30 0x7f238806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.333 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.333+0000 7f23a8fb9640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f238806be30 0x7f238806e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2394009560 tx=0x7f2394009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:02.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.336+0000 7f2399ffb640 1 -- 172.21.15.60:0/3707751955 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f23a0003e20 con 0x7f23a40b69e0 2024-09-12T01:43:02.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.516+0000 7f23aba1e640 1 -- 172.21.15.60:0/3707751955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"} v 0) -- 0x7f23a415bc70 con 0x7f23a40b69e0 2024-09-12T01:43:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.519+0000 7f2399ffb640 1 -- 172.21.15.60:0/3707751955 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"}]=0 v45) ==== 111+0+0 (secure 0 0 0) 0x7f23a0079ad0 con 0x7f23a40b69e0 2024-09-12T01:43:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.522+0000 7f23aba1e640 1 -- 172.21.15.60:0/3707751955 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f238806be30 msgr2=0x7f238806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.522+0000 7f23aba1e640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f238806be30 0x7f238806e2f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2394009560 tx=0x7f2394009190 comp rx=0 tx=0).stop 2024-09-12T01:43:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.522+0000 7f23aba1e640 1 -- 172.21.15.60:0/3707751955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a40b69e0 msgr2=0x7f23a40cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.522+0000 7f23aba1e640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a40b69e0 0x7f23a40cc970 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f23a002a140 tx=0x7f23a00046c0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.522+0000 7f23aba1e640 1 -- 172.21.15.60:0/3707751955 shutdown_connections 2024-09-12T01:43:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.522+0000 7f23aba1e640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f238806be30 0x7f238806e2f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.522+0000 7f23aba1e640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23a415e750 0x7f23a40cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.522+0000 7f23aba1e640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23a40cfb70 0x7f23a4155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.522+0000 7f23aba1e640 1 --2- 172.21.15.60:0/3707751955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23a40b69e0 0x7f23a40cc970 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.522+0000 7f23aba1e640 1 -- 172.21.15.60:0/3707751955 >> 172.21.15.60:0/3707751955 conn(0x7f23a40d1500 msgr2=0x7f23a40b9640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:02.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.522+0000 7f23aba1e640 1 -- 172.21.15.60:0/3707751955 shutdown_connections 2024-09-12T01:43:02.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.522+0000 7f23aba1e640 1 -- 172.21.15.60:0/3707751955 wait complete. 2024-09-12T01:43:02.533 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin' 2024-09-12T01:43:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.635+0000 7f46aa31a640 1 Processor -- start 2024-09-12T01:43:02.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.635+0000 7f46aa31a640 1 -- start start 2024-09-12T01:43:02.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.636+0000 7f46aa31a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40d1b40 0x7f46a41618a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.636+0000 7f46aa31a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a40708d0 con 0x7f46a40b6eb0 2024-09-12T01:43:02.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.636+0000 7f46aa31a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a4070bb0 con 0x7f46a40b7290 2024-09-12T01:43:02.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.636+0000 7f46aa31a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46a4070e90 con 0x7f46a40d1b40 2024-09-12T01:43:02.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.636+0000 7f46a3fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f46a40b6eb0 0x7f46a406fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51542/0 (socket says 172.21.15.60:51542) 2024-09-12T01:43:02.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a3fff640 1 -- 172.21.15.60:0/866577430 learned_addr learned my addr 172.21.15.60:0/866577430 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:02.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a37fe640 1 --2- 172.21.15.60:0/866577430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40d1b40 0x7f46a41618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2892438919 0 0) 0x7f46a40708d0 con 0x7f46a40b6eb0 2024-09-12T01:43:02.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f468c003520 con 0x7f46a40b6eb0 2024-09-12T01:43:02.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3251817679 0 0) 0x7f468c003520 con 0x7f46a40b6eb0 2024-09-12T01:43:02.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40d1b40 msgr2=0x7f46a41618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:02.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 --2- 172.21.15.60:0/866577430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40d1b40 0x7f46a41618a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 >> v1:172.21.15.105:6789/0 conn(0x7f46a40b7290 legacy=0x7f46a4161de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a4071170 con 0x7f46a40b6eb0 2024-09-12T01:43:02.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f4694001670 con 0x7f46a40b6eb0 2024-09-12T01:43:02.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 >> v1:172.21.15.60:6789/0 conn(0x7f46a40b6eb0 legacy=0x7f46a406fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 --2- 172.21.15.60:0/866577430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40d1b40 0x7f468c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 --2- 172.21.15.60:0/866577430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f468c003f20 0x7f468c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 --2- 172.21.15.60:0/866577430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f468c004d40 0x7f468c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4070e90 con 0x7f468c003f20 2024-09-12T01:43:02.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f468c00bad0 con 0x7f468c004d40 2024-09-12T01:43:02.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f468c00bcd0 con 0x7f46a40d1b40 2024-09-12T01:43:02.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a37fe640 1 --2- 172.21.15.60:0/866577430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f468c003f20 0x7f468c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a3fff640 1 --2- 172.21.15.60:0/866577430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40d1b40 0x7f468c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.637+0000 7f46a88b7640 1 --2- 172.21.15.60:0/866577430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f468c004d40 0x7f468c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.638+0000 7f46a37fe640 1 -- 172.21.15.60:0/866577430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40d1b40 msgr2=0x7f468c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:02.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.638+0000 7f46a37fe640 1 --2- 172.21.15.60:0/866577430 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40d1b40 0x7f468c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.638+0000 7f46a37fe640 1 -- 172.21.15.60:0/866577430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f468c004d40 msgr2=0x7f468c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:02.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.638+0000 7f46a37fe640 1 --2- 172.21.15.60:0/866577430 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f468c004d40 0x7f468c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.638+0000 7f46a37fe640 1 -- 172.21.15.60:0/866577430 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c003520 con 0x7f468c003f20 2024-09-12T01:43:02.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.638+0000 7f46a37fe640 1 --2- 172.21.15.60:0/866577430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f468c003f20 0x7f468c004800 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f4698009ac0 tx=0x7f468c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ebc3e8196a2a87 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:02.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.638+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698036070 con 0x7f468c003f20 2024-09-12T01:43:02.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.638+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4698031400 con 0x7f468c003f20 2024-09-12T01:43:02.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.638+0000 7f46a2ffd640 1 -- 172.21.15.60:0/866577430 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698009690 con 0x7f468c003f20 2024-09-12T01:43:02.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.639+0000 7f46aa31a640 1 -- 172.21.15.60:0/866577430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f468c003f20 msgr2=0x7f468c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.639+0000 7f46aa31a640 1 --2- 172.21.15.60:0/866577430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f468c003f20 0x7f468c004800 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f4698009ac0 tx=0x7f468c005830 comp rx=0 tx=0).stop 2024-09-12T01:43:02.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.639+0000 7f46a88b7640 1 -- 172.21.15.60:0/866577430 reap_dead start 2024-09-12T01:43:02.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.639+0000 7f46aa31a640 1 -- 172.21.15.60:0/866577430 shutdown_connections 2024-09-12T01:43:02.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.639+0000 7f46aa31a640 1 -- 172.21.15.60:0/866577430 >> 172.21.15.60:0/866577430 conn(0x7f46a40d2450 msgr2=0x7f46a40d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:02.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.639+0000 7f46aa31a640 1 -- 172.21.15.60:0/866577430 shutdown_connections 2024-09-12T01:43:02.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.639+0000 7f46aa31a640 1 -- 172.21.15.60:0/866577430 wait complete. 2024-09-12T01:43:02.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.640+0000 7f46aa31a640 1 Processor -- start 2024-09-12T01:43:02.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.640+0000 7f46aa31a640 1 -- start start 2024-09-12T01:43:02.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46aa31a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f468c003f20 0x7f46a4152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46aa31a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a415f290 0x7f46a415f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46aa31a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a415c9d0 0x7f46a415ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46aa31a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4071af0 con 0x7f468c003f20 2024-09-12T01:43:02.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46aa31a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4071970 con 0x7f46a415f290 2024-09-12T01:43:02.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46aa31a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46a41618a0 con 0x7f46a415c9d0 2024-09-12T01:43:02.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46a3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f468c003f20 0x7f46a4152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46a3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f468c003f20 0x7f46a4152b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33372/0 (socket says 172.21.15.60:33372) 2024-09-12T01:43:02.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46a3fff640 1 -- 172.21.15.60:0/844667375 learned_addr learned my addr 172.21.15.60:0/844667375 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:02.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46a37fe640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a415f290 0x7f46a415f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46a88b7640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a415c9d0 0x7f46a415ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46a3fff640 1 -- 172.21.15.60:0/844667375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a415c9d0 msgr2=0x7f46a415ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46a3fff640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a415c9d0 0x7f46a415ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.641+0000 7f46a3fff640 1 -- 172.21.15.60:0/844667375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a415f290 msgr2=0x7f46a415f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.642+0000 7f46a3fff640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a415f290 0x7f46a415f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.642+0000 7f46a3fff640 1 -- 172.21.15.60:0/844667375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a415db30 con 0x7f468c003f20 2024-09-12T01:43:02.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.642+0000 7f46a37fe640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a415f290 0x7f46a415f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:02.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.642+0000 7f46a3fff640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f468c003f20 0x7f46a4152b40 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f4694007340 tx=0x7f4694007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:02.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.642+0000 7f46a0ff9640 1 -- 172.21.15.60:0/844667375 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469401a070 con 0x7f468c003f20 2024-09-12T01:43:02.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.642+0000 7f46a0ff9640 1 -- 172.21.15.60:0/844667375 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469400f860 con 0x7f468c003f20 2024-09-12T01:43:02.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.642+0000 7f46aa31a640 1 -- 172.21.15.60:0/844667375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a415de10 con 0x7f468c003f20 2024-09-12T01:43:02.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.642+0000 7f46a0ff9640 1 -- 172.21.15.60:0/844667375 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4694001090 con 0x7f468c003f20 2024-09-12T01:43:02.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.642+0000 7f46aa31a640 1 -- 172.21.15.60:0/844667375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a415e3d0 con 0x7f468c003f20 2024-09-12T01:43:02.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.643+0000 7f46aa31a640 1 -- 172.21.15.60:0/844667375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a415e5d0 con 0x7f468c003f20 2024-09-12T01:43:02.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.643+0000 7f46a0ff9640 1 -- 172.21.15.60:0/844667375 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f469401d070 con 0x7f468c003f20 2024-09-12T01:43:02.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.644+0000 7f46a0ff9640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f469006be30 0x7f469006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:02.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.644+0000 7f46a0ff9640 1 -- 172.21.15.60:0/844667375 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7f469408a5c0 con 0x7f468c003f20 2024-09-12T01:43:02.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.644+0000 7f46a37fe640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f469006be30 0x7f469006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:02.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.644+0000 7f46a37fe640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f469006be30 0x7f469006e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4698033000 tx=0x7f4698008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:02.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.648+0000 7f46a0ff9640 1 -- 172.21.15.60:0/844667375 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46a415e5d0 con 0x7f468c003f20 2024-09-12T01:43:02.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.890+0000 7f46aa31a640 1 -- 172.21.15.60:0/844667375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]} v 0) -- 0x7f46a415a2d0 con 0x7f468c003f20 2024-09-12T01:43:02.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.958+0000 7f46a0ff9640 1 -- 172.21.15.60:0/844667375 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin"]}]=0 v356) ==== 143+0+0 (secure 0 0 0) 0x7f4694059260 con 0x7f468c003f20 2024-09-12T01:43:02.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.960+0000 7f46aa31a640 1 -- 172.21.15.60:0/844667375 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f469006be30 msgr2=0x7f469006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.960+0000 7f46aa31a640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f469006be30 0x7f469006e2f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f4698033000 tx=0x7f4698008030 comp rx=0 tx=0).stop 2024-09-12T01:43:02.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.960+0000 7f46aa31a640 1 -- 172.21.15.60:0/844667375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f468c003f20 msgr2=0x7f46a4152b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:02.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.960+0000 7f46aa31a640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f468c003f20 0x7f46a4152b40 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f4694007340 tx=0x7f4694007800 comp rx=0 tx=0).stop 2024-09-12T01:43:02.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.960+0000 7f46aa31a640 1 -- 172.21.15.60:0/844667375 shutdown_connections 2024-09-12T01:43:02.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.960+0000 7f46aa31a640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f469006be30 0x7f469006e2f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.960+0000 7f46aa31a640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a415c9d0 0x7f46a415ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.960+0000 7f46aa31a640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a415f290 0x7f46a415f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.960+0000 7f46aa31a640 1 --2- 172.21.15.60:0/844667375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f468c003f20 0x7f46a4152b40 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:02.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.960+0000 7f46aa31a640 1 -- 172.21.15.60:0/844667375 >> 172.21.15.60:0/844667375 conn(0x7f46a40d2450 msgr2=0x7f46a41598b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:02.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.961+0000 7f46aa31a640 1 -- 172.21.15.60:0/844667375 shutdown_connections 2024-09-12T01:43:02.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:02.961+0000 7f46aa31a640 1 -- 172.21.15.60:0/844667375 wait complete. 2024-09-12T01:43:02.972 INFO:tasks.cephfs_test_runner:test_client_pin (tasks.cephfs.test_client_limits.TestClientLimits) ... ok 2024-09-12T01:43:02.973 INFO:tasks.cephfs_test_runner:Starting test: test_client_pin_mincaps (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-12T01:43:02.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:43:03.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.075+0000 7f6bc613b640 1 Processor -- start 2024-09-12T01:43:03.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.075+0000 7f6bc613b640 1 -- start start 2024-09-12T01:43:03.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bc613b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc00ba240 0x7f6bc00d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bc613b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6bc00cf2f0 0x7f6bc00cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bc613b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc00ba660 con 0x7f6bc015e7a0 2024-09-12T01:43:03.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bc613b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc00d2f40 con 0x7f6bc00cf2f0 2024-09-12T01:43:03.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bc613b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc00d3220 con 0x7f6bc00ba240 2024-09-12T01:43:03.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bbf7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6bc015e7a0 0x7f6bc00d2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51558/0 (socket says 172.21.15.60:51558) 2024-09-12T01:43:03.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bbf7fe640 1 -- 172.21.15.60:0/2789601759 learned_addr learned my addr 172.21.15.60:0/2789601759 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:03.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bbffff640 1 --2- 172.21.15.60:0/2789601759 >> v2:172.21.15.60:3300/0 conn(0x7f6bc00cf2f0 0x7f6bc00cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bbffff640 1 -- 172.21.15.60:0/2789601759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc00ba240 msgr2=0x7f6bc00d3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:03.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bbffff640 1 --2- 172.21.15.60:0/2789601759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc00ba240 0x7f6bc00d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bbffff640 1 -- 172.21.15.60:0/2789601759 >> v1:172.21.15.60:6789/0 conn(0x7f6bc015e7a0 legacy=0x7f6bc00d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bbe7fc640 1 -- 172.21.15.60:0/2789601759 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426068844 0 0) 0x7f6bc00ba660 con 0x7f6bc015e7a0 2024-09-12T01:43:03.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.076+0000 7f6bbffff640 1 -- 172.21.15.60:0/2789601759 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc00d3500 con 0x7f6bc00cf2f0 2024-09-12T01:43:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.077+0000 7f6bbffff640 1 --2- 172.21.15.60:0/2789601759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc00cf2f0 0x7f6bc00cf780 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009d90 tx=0x7f6bb802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec46fb8b9f40dd52 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.077+0000 7f6bbe7fc640 1 -- 172.21.15.60:0/2789601759 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8007740 con 0x7f6bc00cf2f0 2024-09-12T01:43:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.077+0000 7f6bbe7fc640 1 -- 172.21.15.60:0/2789601759 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb80078e0 con 0x7f6bc00cf2f0 2024-09-12T01:43:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.077+0000 7f6bbe7fc640 1 -- 172.21.15.60:0/2789601759 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8007cb0 con 0x7f6bc00cf2f0 2024-09-12T01:43:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.078+0000 7f6bc613b640 1 -- 172.21.15.60:0/2789601759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc00cf2f0 msgr2=0x7f6bc00cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.078+0000 7f6bc613b640 1 --2- 172.21.15.60:0/2789601759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc00cf2f0 0x7f6bc00cf780 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009d90 tx=0x7f6bb802a6f0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.078+0000 7f6bc613b640 1 -- 172.21.15.60:0/2789601759 shutdown_connections 2024-09-12T01:43:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.078+0000 7f6bc613b640 1 --2- 172.21.15.60:0/2789601759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc00cf2f0 0x7f6bc00cf780 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.078+0000 7f6bc613b640 1 --2- 172.21.15.60:0/2789601759 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc00ba240 0x7f6bc00d3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.078+0000 7f6bc613b640 1 -- 172.21.15.60:0/2789601759 >> 172.21.15.60:0/2789601759 conn(0x7f6bc00d1550 msgr2=0x7f6bc00d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.078+0000 7f6bc613b640 1 -- 172.21.15.60:0/2789601759 shutdown_connections 2024-09-12T01:43:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.078+0000 7f6bc613b640 1 -- 172.21.15.60:0/2789601759 wait complete. 2024-09-12T01:43:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.079+0000 7f6bc613b640 1 Processor -- start 2024-09-12T01:43:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.079+0000 7f6bc613b640 1 -- start start 2024-09-12T01:43:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bc613b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc00ba240 0x7f6bc01f8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bc613b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bc00cf2f0 0x7f6bc015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bc613b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc015e7a0 0x7f6bc01f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bc613b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc015eb80 con 0x7f6bc015e7a0 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bc613b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc00d3ac0 con 0x7f6bc00cf2f0 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bc613b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc015ed00 con 0x7f6bc00ba240 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc015e7a0 0x7f6bc01f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc015e7a0 0x7f6bc01f75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33402/0 (socket says 172.21.15.60:33402) 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bbffff640 1 -- 172.21.15.60:0/2780745429 learned_addr learned my addr 172.21.15.60:0/2780745429 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bbf7fe640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc00ba240 0x7f6bc01f8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bbffff640 1 -- 172.21.15.60:0/2780745429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc00ba240 msgr2=0x7f6bc01f8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bbeffd640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bc00cf2f0 0x7f6bc015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bbffff640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc00ba240 0x7f6bc01f8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bbffff640 1 -- 172.21.15.60:0/2780745429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bc00cf2f0 msgr2=0x7f6bc015ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bbffff640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bc00cf2f0 0x7f6bc015ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bbffff640 1 -- 172.21.15.60:0/2780745429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc015f3c0 con 0x7f6bc015e7a0 2024-09-12T01:43:03.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.080+0000 7f6bbffff640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc015e7a0 0x7f6bc01f75d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009d90 tx=0x7f6bb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:03.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.081+0000 7f6ba7fff640 1 -- 172.21.15.60:0/2780745429 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8041030 con 0x7f6bc015e7a0 2024-09-12T01:43:03.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.081+0000 7f6ba7fff640 1 -- 172.21.15.60:0/2780745429 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb8031a90 con 0x7f6bc015e7a0 2024-09-12T01:43:03.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.081+0000 7f6bc613b640 1 -- 172.21.15.60:0/2780745429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc00ce750 con 0x7f6bc015e7a0 2024-09-12T01:43:03.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.081+0000 7f6ba7fff640 1 -- 172.21.15.60:0/2780745429 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8031e60 con 0x7f6bc015e7a0 2024-09-12T01:43:03.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.081+0000 7f6bc613b640 1 -- 172.21.15.60:0/2780745429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc00cb9d0 con 0x7f6bc015e7a0 2024-09-12T01:43:03.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.082+0000 7f6bc613b640 1 -- 172.21.15.60:0/2780745429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc00d3fe0 con 0x7f6bc015e7a0 2024-09-12T01:43:03.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.082+0000 7f6ba7fff640 1 -- 172.21.15.60:0/2780745429 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6bb8039040 con 0x7f6bc015e7a0 2024-09-12T01:43:03.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.082+0000 7f6ba7fff640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bac06be30 0x7f6bac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.083+0000 7f6ba7fff640 1 -- 172.21.15.60:0/2780745429 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7f6bb80abd90 con 0x7f6bc015e7a0 2024-09-12T01:43:03.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.083+0000 7f6bbf7fe640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bac06be30 0x7f6bac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.083+0000 7f6bbf7fe640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bac06be30 0x7f6bac06e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0000f60 tx=0x7f6bb0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:03.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.087+0000 7f6ba7fff640 1 -- 172.21.15.60:0/2780745429 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6bb807a9d0 con 0x7f6bc015e7a0 2024-09-12T01:43:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.270+0000 7f6bc613b640 1 -- 172.21.15.60:0/2780745429 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6bc00693c0 con 0x7f6bc015e7a0 2024-09-12T01:43:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.271+0000 7f6ba7fff640 1 -- 172.21.15.60:0/2780745429 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) ==== 74+0+13008 (secure 0 0 0) 0x7f6bb807a2d0 con 0x7f6bc015e7a0 2024-09-12T01:43:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:03.272 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":108,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:43:00.951788+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":104,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6835/3881960029":"2024-09-13T01:42:57.750206+0000","172.21.15.105:6833/3881960029":"2024-09-13T01:42:57.750206+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:43:03.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.273+0000 7f6bc613b640 1 -- 172.21.15.60:0/2780745429 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bac06be30 msgr2=0x7f6bac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.273+0000 7f6bc613b640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bac06be30 0x7f6bac06e2f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0000f60 tx=0x7f6bb0009040 comp rx=0 tx=0).stop 2024-09-12T01:43:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.273+0000 7f6bc613b640 1 -- 172.21.15.60:0/2780745429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc015e7a0 msgr2=0x7f6bc01f75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.273+0000 7f6bc613b640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc015e7a0 0x7f6bc01f75d0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8009d90 tx=0x7f6bb8004a40 comp rx=0 tx=0).stop 2024-09-12T01:43:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.273+0000 7f6bc613b640 1 -- 172.21.15.60:0/2780745429 shutdown_connections 2024-09-12T01:43:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.273+0000 7f6bc613b640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bc015e7a0 0x7f6bc01f75d0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.273+0000 7f6bc613b640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6bc00cf2f0 0x7f6bc015ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.273+0000 7f6bc613b640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6bac06be30 0x7f6bac06e2f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.273+0000 7f6bc613b640 1 --2- 172.21.15.60:0/2780745429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6bc00ba240 0x7f6bc01f8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.273+0000 7f6bc613b640 1 -- 172.21.15.60:0/2780745429 >> 172.21.15.60:0/2780745429 conn(0x7f6bc00d1550 msgr2=0x7f6bc00b8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.273+0000 7f6bc613b640 1 -- 172.21.15.60:0/2780745429 shutdown_connections 2024-09-12T01:43:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.273+0000 7f6bc613b640 1 -- 172.21.15.60:0/2780745429 wait complete. 2024-09-12T01:43:03.285 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:35:46.304939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:43:03.285 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:43:03.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.390+0000 7fac79653640 1 Processor -- start 2024-09-12T01:43:03.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.390+0000 7fac79653640 1 -- start start 2024-09-12T01:43:03.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac79653640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7415a050 0x7fac7415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac79653640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac7415ee90 0x7fac74073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac79653640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac7415a430 con 0x7fac740731c0 2024-09-12T01:43:03.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac79653640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fac74073b40 con 0x7fac7415ee90 2024-09-12T01:43:03.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac79653640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac7415d9a0 con 0x7fac7415a050 2024-09-12T01:43:03.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac737fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac7415ee90 0x7fac74073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac727fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fac740731c0 0x7fac7415ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51562/0 (socket says 172.21.15.60:51562) 2024-09-12T01:43:03.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac737fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac7415ee90 0x7fac74073600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33418/0 (socket says 172.21.15.60:33418) 2024-09-12T01:43:03.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac727fc640 1 -- 172.21.15.60:0/394358697 learned_addr learned my addr 172.21.15.60:0/394358697 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:03.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac737fe640 1 -- 172.21.15.60:0/394358697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7415a050 msgr2=0x7fac7415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:03.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac72ffd640 1 --2- 172.21.15.60:0/394358697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7415a050 0x7fac7415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac71ffb640 1 -- 172.21.15.60:0/394358697 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168865578 0 0) 0x7fac7415a430 con 0x7fac740731c0 2024-09-12T01:43:03.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac737fe640 1 --2- 172.21.15.60:0/394358697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7415a050 0x7fac7415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac737fe640 1 -- 172.21.15.60:0/394358697 >> v1:172.21.15.60:6789/0 conn(0x7fac740731c0 legacy=0x7fac7415ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac737fe640 1 -- 172.21.15.60:0/394358697 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac740cd0a0 con 0x7fac7415ee90 2024-09-12T01:43:03.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.391+0000 7fac72ffd640 1 --2- 172.21.15.60:0/394358697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7415a050 0x7fac7415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:03.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.392+0000 7fac737fe640 1 --2- 172.21.15.60:0/394358697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac7415ee90 0x7fac74073600 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0097a0 tx=0x7fac6c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83a0689d220f9fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:03.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.392+0000 7fac71ffb640 1 -- 172.21.15.60:0/394358697 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c037070 con 0x7fac7415ee90 2024-09-12T01:43:03.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.392+0000 7fac71ffb640 1 -- 172.21.15.60:0/394358697 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6c02ae50 con 0x7fac7415ee90 2024-09-12T01:43:03.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.392+0000 7fac71ffb640 1 -- 172.21.15.60:0/394358697 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c032660 con 0x7fac7415ee90 2024-09-12T01:43:03.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.393+0000 7fac79653640 1 -- 172.21.15.60:0/394358697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac7415ee90 msgr2=0x7fac74073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.393+0000 7fac79653640 1 --2- 172.21.15.60:0/394358697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac7415ee90 0x7fac74073600 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0097a0 tx=0x7fac6c02a100 comp rx=0 tx=0).stop 2024-09-12T01:43:03.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.393+0000 7fac79653640 1 -- 172.21.15.60:0/394358697 shutdown_connections 2024-09-12T01:43:03.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.393+0000 7fac79653640 1 --2- 172.21.15.60:0/394358697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac7415ee90 0x7fac74073600 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.393+0000 7fac79653640 1 --2- 172.21.15.60:0/394358697 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac7415a050 0x7fac7415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.393+0000 7fac79653640 1 -- 172.21.15.60:0/394358697 >> 172.21.15.60:0/394358697 conn(0x7fac7406d0f0 msgr2=0x7fac7406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:03.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.393+0000 7fac79653640 1 -- 172.21.15.60:0/394358697 shutdown_connections 2024-09-12T01:43:03.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.393+0000 7fac79653640 1 -- 172.21.15.60:0/394358697 wait complete. 2024-09-12T01:43:03.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.394+0000 7fac79653640 1 Processor -- start 2024-09-12T01:43:03.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.394+0000 7fac79653640 1 -- start start 2024-09-12T01:43:03.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.395+0000 7fac79653640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac740731c0 0x7fac740725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.395+0000 7fac79653640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac7415a050 0x7fac74155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.395+0000 7fac79653640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac7415ee90 0x7fac741536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.395+0000 7fac79653640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fac740cd940 con 0x7fac7415ee90 2024-09-12T01:43:03.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.395+0000 7fac79653640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fac740cd660 con 0x7fac7415a050 2024-09-12T01:43:03.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.395+0000 7fac79653640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fac740cdc20 con 0x7fac740731c0 2024-09-12T01:43:03.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.395+0000 7fac737fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac7415ee90 0x7fac741536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.395+0000 7fac737fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac7415ee90 0x7fac741536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33432/0 (socket says 172.21.15.60:33432) 2024-09-12T01:43:03.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.395+0000 7fac737fe640 1 -- 172.21.15.60:0/2233989704 learned_addr learned my addr 172.21.15.60:0/2233989704 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:03.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.395+0000 7fac72ffd640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac740731c0 0x7fac740725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.395+0000 7fac727fc640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac7415a050 0x7fac74155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.396+0000 7fac737fe640 1 -- 172.21.15.60:0/2233989704 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac740731c0 msgr2=0x7fac740725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.396+0000 7fac737fe640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac740731c0 0x7fac740725a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.396+0000 7fac737fe640 1 -- 172.21.15.60:0/2233989704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac7415a050 msgr2=0x7fac74155b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.396+0000 7fac737fe640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac7415a050 0x7fac74155b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.396+0000 7fac737fe640 1 -- 172.21.15.60:0/2233989704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac741f4640 con 0x7fac7415ee90 2024-09-12T01:43:03.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.396+0000 7fac737fe640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac7415ee90 0x7fac741536c0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0098c0 tx=0x7fac6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:03.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.396+0000 7fac6b7fe640 1 -- 172.21.15.60:0/2233989704 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c041020 con 0x7fac7415ee90 2024-09-12T01:43:03.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.396+0000 7fac6b7fe640 1 -- 172.21.15.60:0/2233989704 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6c03c670 con 0x7fac7415ee90 2024-09-12T01:43:03.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.396+0000 7fac79653640 1 -- 172.21.15.60:0/2233989704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac741f4920 con 0x7fac7415ee90 2024-09-12T01:43:03.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.396+0000 7fac6b7fe640 1 -- 172.21.15.60:0/2233989704 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c037040 con 0x7fac7415ee90 2024-09-12T01:43:03.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.396+0000 7fac79653640 1 -- 172.21.15.60:0/2233989704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac741f4ee0 con 0x7fac7415ee90 2024-09-12T01:43:03.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.397+0000 7fac79653640 1 -- 172.21.15.60:0/2233989704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac741f5120 con 0x7fac7415ee90 2024-09-12T01:43:03.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.398+0000 7fac6b7fe640 1 -- 172.21.15.60:0/2233989704 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fac6c044020 con 0x7fac7415ee90 2024-09-12T01:43:03.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.398+0000 7fac6b7fe640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fac5406be30 0x7fac5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.398+0000 7fac6b7fe640 1 -- 172.21.15.60:0/2233989704 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7fac6c0ab240 con 0x7fac7415ee90 2024-09-12T01:43:03.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.398+0000 7fac72ffd640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fac5406be30 0x7fac5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.399+0000 7fac72ffd640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fac5406be30 0x7fac5406e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fac6400d620 tx=0x7fac64007810 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:03.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.403+0000 7fac6b7fe640 1 -- 172.21.15.60:0/2233989704 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fac6c04b030 con 0x7fac7415ee90 2024-09-12T01:43:03.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.577+0000 7fac79653640 1 -- 172.21.15.60:0/2233989704 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fac740b36e0 con 0x7fac7415ee90 2024-09-12T01:43:03.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.577+0000 7fac6b7fe640 1 -- 172.21.15.60:0/2233989704 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) ==== 93+0+10 (secure 0 0 0) 0x7fac6c079f80 con 0x7fac7415ee90 2024-09-12T01:43:03.581 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-12T01:43:03.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.579+0000 7fac79653640 1 -- 172.21.15.60:0/2233989704 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fac5406be30 msgr2=0x7fac5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.579+0000 7fac79653640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fac5406be30 0x7fac5406e2f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fac6400d620 tx=0x7fac64007810 comp rx=0 tx=0).stop 2024-09-12T01:43:03.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.579+0000 7fac79653640 1 -- 172.21.15.60:0/2233989704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac7415ee90 msgr2=0x7fac741536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.579+0000 7fac79653640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac7415ee90 0x7fac741536c0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fac6c0098c0 tx=0x7fac6c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.579+0000 7fac79653640 1 -- 172.21.15.60:0/2233989704 shutdown_connections 2024-09-12T01:43:03.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.579+0000 7fac79653640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac7415ee90 0x7fac741536c0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.579+0000 7fac79653640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fac7415a050 0x7fac74155b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.579+0000 7fac79653640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fac5406be30 0x7fac5406e2f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.579+0000 7fac79653640 1 --2- 172.21.15.60:0/2233989704 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fac740731c0 0x7fac740725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.579+0000 7fac79653640 1 -- 172.21.15.60:0/2233989704 >> 172.21.15.60:0/2233989704 conn(0x7fac7406d0f0 msgr2=0x7fac7415bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:03.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.579+0000 7fac79653640 1 -- 172.21.15.60:0/2233989704 shutdown_connections 2024-09-12T01:43:03.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.580+0000 7fac79653640 1 -- 172.21.15.60:0/2233989704 wait complete. 2024-09-12T01:43:03.591 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps' 2024-09-12T01:43:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.693+0000 7ffbc98fa640 1 Processor -- start 2024-09-12T01:43:03.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.693+0000 7ffbc98fa640 1 -- start start 2024-09-12T01:43:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.694+0000 7ffbc98fa640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffbc415f660 0x7ffbc40b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.694+0000 7ffbc98fa640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffbc4072900 0x7ffbc40b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.694+0000 7ffbc98fa640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc4072f90 con 0x7ffbc415b550 2024-09-12T01:43:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.694+0000 7ffbc98fa640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc415fe60 con 0x7ffbc415f660 2024-09-12T01:43:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.694+0000 7ffbc98fa640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffbc4072d50 con 0x7ffbc4072900 2024-09-12T01:43:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.694+0000 7ffbc27fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffbc415f660 0x7ffbc40b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.694+0000 7ffbc2ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ffbc415b550 0x7ffbc415ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51568/0 (socket says 172.21.15.60:51568) 2024-09-12T01:43:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.694+0000 7ffbc2ffd640 1 -- 172.21.15.60:0/2600311537 learned_addr learned my addr 172.21.15.60:0/2600311537 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.695+0000 7ffbc27fc640 1 -- 172.21.15.60:0/2600311537 >> v2:172.21.15.105:3300/0 conn(0x7ffbc4072900 msgr2=0x7ffbc40b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.695+0000 7ffbc27fc640 1 --2- 172.21.15.60:0/2600311537 >> v2:172.21.15.105:3300/0 conn(0x7ffbc4072900 0x7ffbc40b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.695+0000 7ffbc27fc640 1 -- 172.21.15.60:0/2600311537 >> v1:172.21.15.60:6789/0 conn(0x7ffbc415b550 legacy=0x7ffbc415ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.695+0000 7ffbc27fc640 1 -- 172.21.15.60:0/2600311537 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc40b4510 con 0x7ffbc415f660 2024-09-12T01:43:03.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.695+0000 7ffbc27fc640 1 --2- 172.21.15.60:0/2600311537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc415f660 0x7ffbc40b0ad0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4075c20 tx=0x7ffbac02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28001fe0a059c4b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:03.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.696+0000 7ffbc1ffb640 1 -- 172.21.15.60:0/2600311537 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac037070 con 0x7ffbc415f660 2024-09-12T01:43:03.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.696+0000 7ffbc1ffb640 1 -- 172.21.15.60:0/2600311537 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbac032440 con 0x7ffbc415f660 2024-09-12T01:43:03.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.696+0000 7ffbc1ffb640 1 -- 172.21.15.60:0/2600311537 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac02ae60 con 0x7ffbc415f660 2024-09-12T01:43:03.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.696+0000 7ffbc98fa640 1 -- 172.21.15.60:0/2600311537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc415f660 msgr2=0x7ffbc40b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.696+0000 7ffbc98fa640 1 --2- 172.21.15.60:0/2600311537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc415f660 0x7ffbc40b0ad0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4075c20 tx=0x7ffbac02a110 comp rx=0 tx=0).stop 2024-09-12T01:43:03.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.696+0000 7ffbc98fa640 1 -- 172.21.15.60:0/2600311537 shutdown_connections 2024-09-12T01:43:03.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.696+0000 7ffbc98fa640 1 --2- 172.21.15.60:0/2600311537 >> v2:172.21.15.105:3300/0 conn(0x7ffbc4072900 0x7ffbc40b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.696+0000 7ffbc98fa640 1 --2- 172.21.15.60:0/2600311537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc415f660 0x7ffbc40b0ad0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.696+0000 7ffbc98fa640 1 -- 172.21.15.60:0/2600311537 >> 172.21.15.60:0/2600311537 conn(0x7ffbc40d13d0 msgr2=0x7ffbc40d17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:03.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.696+0000 7ffbc98fa640 1 -- 172.21.15.60:0/2600311537 shutdown_connections 2024-09-12T01:43:03.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.696+0000 7ffbc98fa640 1 -- 172.21.15.60:0/2600311537 wait complete. 2024-09-12T01:43:03.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.697+0000 7ffbc98fa640 1 Processor -- start 2024-09-12T01:43:03.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.698+0000 7ffbc98fa640 1 -- start start 2024-09-12T01:43:03.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.698+0000 7ffbc98fa640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc4072900 0x7ffbc415b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.698+0000 7ffbc98fa640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbc415b550 0x7ffbc40cef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.698+0000 7ffbc98fa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc415f660 0x7ffbc40cf480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.698+0000 7ffbc98fa640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc4073270 con 0x7ffbc415f660 2024-09-12T01:43:03.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.698+0000 7ffbc98fa640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc40b4ad0 con 0x7ffbc4072900 2024-09-12T01:43:03.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.698+0000 7ffbc98fa640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc40b5530 con 0x7ffbc415b550 2024-09-12T01:43:03.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.698+0000 7ffbc37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc415f660 0x7ffbc40cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.698+0000 7ffbc37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc415f660 0x7ffbc40cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33446/0 (socket says 172.21.15.60:33446) 2024-09-12T01:43:03.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.698+0000 7ffbc37fe640 1 -- 172.21.15.60:0/357113321 learned_addr learned my addr 172.21.15.60:0/357113321 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:03.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbc2ffd640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc4072900 0x7ffbc415b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbc37fe640 1 -- 172.21.15.60:0/357113321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbc415b550 msgr2=0x7ffbc40cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbc27fc640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbc415b550 0x7ffbc40cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbc37fe640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbc415b550 0x7ffbc40cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbc37fe640 1 -- 172.21.15.60:0/357113321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc4072900 msgr2=0x7ffbc415b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbc37fe640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc4072900 0x7ffbc415b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbc37fe640 1 -- 172.21.15.60:0/357113321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc40ce1a0 con 0x7ffbc415f660 2024-09-12T01:43:03.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbc2ffd640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc4072900 0x7ffbc415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:03.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbc37fe640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc415f660 0x7ffbc40cf480 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009fd0 tx=0x7ffbbc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:03.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbbbfff640 1 -- 172.21.15.60:0/357113321 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc011830 con 0x7ffbc415f660 2024-09-12T01:43:03.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbbbfff640 1 -- 172.21.15.60:0/357113321 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbbc016070 con 0x7ffbc415f660 2024-09-12T01:43:03.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbc98fa640 1 -- 172.21.15.60:0/357113321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc41516c0 con 0x7ffbc415f660 2024-09-12T01:43:03.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbbbfff640 1 -- 172.21.15.60:0/357113321 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc011bf0 con 0x7ffbc415f660 2024-09-12T01:43:03.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.699+0000 7ffbc98fa640 1 -- 172.21.15.60:0/357113321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc40ce740 con 0x7ffbc415f660 2024-09-12T01:43:03.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.700+0000 7ffbc98fa640 1 -- 172.21.15.60:0/357113321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc40b4ff0 con 0x7ffbc415f660 2024-09-12T01:43:03.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.701+0000 7ffbbbfff640 1 -- 172.21.15.60:0/357113321 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffbbc01b460 con 0x7ffbc415f660 2024-09-12T01:43:03.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.701+0000 7ffbbbfff640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffba406be60 0x7ffba406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:03.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.701+0000 7ffbbbfff640 1 -- 172.21.15.60:0/357113321 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7ffbbc08a7b0 con 0x7ffbc415f660 2024-09-12T01:43:03.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.701+0000 7ffbc2ffd640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffba406be60 0x7ffba406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:03.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.701+0000 7ffbc2ffd640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffba406be60 0x7ffba406e320 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40012e0 tx=0x7ffbb4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:03.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.705+0000 7ffbbbfff640 1 -- 172.21.15.60:0/357113321 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffbbc0594f0 con 0x7ffbc415f660 2024-09-12T01:43:03.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.948+0000 7ffbc98fa640 1 -- 172.21.15.60:0/357113321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]} v 0) -- 0x7ffbc4156df0 con 0x7ffbc415f660 2024-09-12T01:43:03.960 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.959+0000 7ffbbbfff640 1 -- 172.21.15.60:0/357113321 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]}]=0 v357) ==== 154+0+0 (secure 0 0 0) 0x7ffbbc058df0 con 0x7ffbc415f660 2024-09-12T01:43:03.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.961+0000 7ffbc98fa640 1 -- 172.21.15.60:0/357113321 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffba406be60 msgr2=0x7ffba406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.961+0000 7ffbc98fa640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffba406be60 0x7ffba406e320 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40012e0 tx=0x7ffbb4009040 comp rx=0 tx=0).stop 2024-09-12T01:43:03.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.961+0000 7ffbc98fa640 1 -- 172.21.15.60:0/357113321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc415f660 msgr2=0x7ffbc40cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:03.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.961+0000 7ffbc98fa640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc415f660 0x7ffbc40cf480 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009fd0 tx=0x7ffbbc00b8e0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.962+0000 7ffbc98fa640 1 -- 172.21.15.60:0/357113321 shutdown_connections 2024-09-12T01:43:03.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.962+0000 7ffbc98fa640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffbc415f660 0x7ffbc40cf480 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.962+0000 7ffbc98fa640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffba406be60 0x7ffba406e320 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.962+0000 7ffbc98fa640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbc415b550 0x7ffbc40cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.962+0000 7ffbc98fa640 1 --2- 172.21.15.60:0/357113321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffbc4072900 0x7ffbc415b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:03.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.962+0000 7ffbc98fa640 1 -- 172.21.15.60:0/357113321 >> 172.21.15.60:0/357113321 conn(0x7ffbc40d13d0 msgr2=0x7ffbc415eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:03.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.962+0000 7ffbc98fa640 1 -- 172.21.15.60:0/357113321 shutdown_connections 2024-09-12T01:43:03.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:03.962+0000 7ffbc98fa640 1 -- 172.21.15.60:0/357113321 wait complete. 2024-09-12T01:43:03.973 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:43:04.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.079+0000 7f9225ed7640 1 Processor -- start 2024-09-12T01:43:04.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.079+0000 7f9225ed7640 1 -- start start 2024-09-12T01:43:04.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.080+0000 7f9225ed7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922006f710 0x7f922006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.080+0000 7f9225ed7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f922006bc10 0x7f922006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.080+0000 7f9225ed7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9220074120 con 0x7f922015c2a0 2024-09-12T01:43:04.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.080+0000 7f9225ed7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f922015c680 con 0x7f922006bc10 2024-09-12T01:43:04.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.080+0000 7f9225ed7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f92200700b0 con 0x7f922006f710 2024-09-12T01:43:04.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.080+0000 7f921f7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f922015c2a0 0x7f92200735d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51578/0 (socket says 172.21.15.60:51578) 2024-09-12T01:43:04.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.080+0000 7f921f7fe640 1 -- 172.21.15.60:0/4227778629 learned_addr learned my addr 172.21.15.60:0/4227778629 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:04.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.080+0000 7f921ffff640 1 --2- 172.21.15.60:0/4227778629 >> v2:172.21.15.105:3300/0 conn(0x7f922006bc10 0x7f922006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.080+0000 7f921effd640 1 --2- 172.21.15.60:0/4227778629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922006f710 0x7f922006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3630479332 0 0) 0x7f9220074120 con 0x7f922015c2a0 2024-09-12T01:43:04.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9208003520 con 0x7f922015c2a0 2024-09-12T01:43:04.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1780018940 0 0) 0x7f9208003520 con 0x7f922015c2a0 2024-09-12T01:43:04.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922006f710 msgr2=0x7f922006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:04.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 --2- 172.21.15.60:0/4227778629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922006f710 0x7f922006fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 >> v2:172.21.15.105:3300/0 conn(0x7f922006bc10 msgr2=0x7f922006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:04.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 --2- 172.21.15.60:0/4227778629 >> v2:172.21.15.105:3300/0 conn(0x7f922006bc10 0x7f922006c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922015ef00 con 0x7f922015c2a0 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f9210001670 con 0x7f922015c2a0 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921ffff640 1 --2- 172.21.15.60:0/4227778629 >> v2:172.21.15.105:3300/0 conn(0x7f922006bc10 0x7f922006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 >> v1:172.21.15.60:6789/0 conn(0x7f922015c2a0 legacy=0x7f92200735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 --2- 172.21.15.60:0/4227778629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92080039b0 0x7f9208003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 --2- 172.21.15.60:0/4227778629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9208004800 0x7f9208004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 --2- 172.21.15.60:0/4227778629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922006f710 0x7f92080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f920800b9c0 con 0x7f92080039b0 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f920800bb40 con 0x7f9208004800 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f920800bcc0 con 0x7f922006f710 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921f7fe640 1 --2- 172.21.15.60:0/4227778629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92080039b0 0x7f9208003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921ffff640 1 --2- 172.21.15.60:0/4227778629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922006f710 0x7f92080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921effd640 1 --2- 172.21.15.60:0/4227778629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9208004800 0x7f9208004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921f7fe640 1 -- 172.21.15.60:0/4227778629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922006f710 msgr2=0x7f92080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921f7fe640 1 --2- 172.21.15.60:0/4227778629 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922006f710 0x7f92080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921f7fe640 1 -- 172.21.15.60:0/4227778629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9208004800 msgr2=0x7f9208004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921f7fe640 1 --2- 172.21.15.60:0/4227778629 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9208004800 0x7f9208004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.081+0000 7f921f7fe640 1 -- 172.21.15.60:0/4227778629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9208003520 con 0x7f92080039b0 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.082+0000 7f921f7fe640 1 --2- 172.21.15.60:0/4227778629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92080039b0 0x7f9208003dd0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f9210007fd0 tx=0x7f9208005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97aaad2e2e22570 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.082+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210007d50 con 0x7f92080039b0 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.082+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9210005ad0 con 0x7f92080039b0 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.082+0000 7f921e7fc640 1 -- 172.21.15.60:0/4227778629 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210007070 con 0x7f92080039b0 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.083+0000 7f9225ed7640 1 -- 172.21.15.60:0/4227778629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92080039b0 msgr2=0x7f9208003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.083+0000 7f9225ed7640 1 --2- 172.21.15.60:0/4227778629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92080039b0 0x7f9208003dd0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f9210007fd0 tx=0x7f9208005830 comp rx=0 tx=0).stop 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.083+0000 7f921ffff640 1 -- 172.21.15.60:0/4227778629 reap_dead start 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.083+0000 7f9225ed7640 1 -- 172.21.15.60:0/4227778629 shutdown_connections 2024-09-12T01:43:04.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.083+0000 7f9225ed7640 1 -- 172.21.15.60:0/4227778629 >> 172.21.15.60:0/4227778629 conn(0x7f92200b3070 msgr2=0x7f92200b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:04.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.083+0000 7f9225ed7640 1 -- 172.21.15.60:0/4227778629 shutdown_connections 2024-09-12T01:43:04.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.083+0000 7f9225ed7640 1 -- 172.21.15.60:0/4227778629 wait complete. 2024-09-12T01:43:04.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.084+0000 7f9225ed7640 1 Processor -- start 2024-09-12T01:43:04.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.084+0000 7f9225ed7640 1 -- start start 2024-09-12T01:43:04.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f9225ed7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92080039b0 0x7f9220155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f9225ed7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200cf070 0x7f922015e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f9225ed7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015e650 0x7f9220160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f9225ed7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f922015ebf0 con 0x7f92200cf070 2024-09-12T01:43:04.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f9225ed7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f922015f4c0 con 0x7f92080039b0 2024-09-12T01:43:04.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f9225ed7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f92200b5f20 con 0x7f922015e650 2024-09-12T01:43:04.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f921effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200cf070 0x7f922015e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f921effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200cf070 0x7f922015e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33456/0 (socket says 172.21.15.60:33456) 2024-09-12T01:43:04.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f921effd640 1 -- 172.21.15.60:0/96928171 learned_addr learned my addr 172.21.15.60:0/96928171 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:04.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f921f7fe640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92080039b0 0x7f9220155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f921ffff640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015e650 0x7f9220160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f921effd640 1 -- 172.21.15.60:0/96928171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015e650 msgr2=0x7f9220160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f921effd640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015e650 0x7f9220160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f921effd640 1 -- 172.21.15.60:0/96928171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92080039b0 msgr2=0x7f9220155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f921effd640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92080039b0 0x7f9220155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.085+0000 7f921effd640 1 -- 172.21.15.60:0/96928171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922015c9f0 con 0x7f92200cf070 2024-09-12T01:43:04.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.086+0000 7f921effd640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200cf070 0x7f922015e110 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f92140118e0 tx=0x7f9214011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:04.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.086+0000 7f9207fff640 1 -- 172.21.15.60:0/96928171 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921400faf0 con 0x7f92200cf070 2024-09-12T01:43:04.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.086+0000 7f9207fff640 1 -- 172.21.15.60:0/96928171 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f921400fc90 con 0x7f92200cf070 2024-09-12T01:43:04.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.086+0000 7f9225ed7640 1 -- 172.21.15.60:0/96928171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922015ccd0 con 0x7f92200cf070 2024-09-12T01:43:04.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.086+0000 7f9207fff640 1 -- 172.21.15.60:0/96928171 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214014440 con 0x7f92200cf070 2024-09-12T01:43:04.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.086+0000 7f9225ed7640 1 -- 172.21.15.60:0/96928171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922015d290 con 0x7f92200cf070 2024-09-12T01:43:04.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.087+0000 7f9225ed7640 1 -- 172.21.15.60:0/96928171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922015f9e0 con 0x7f92200cf070 2024-09-12T01:43:04.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.087+0000 7f9207fff640 1 -- 172.21.15.60:0/96928171 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9214012040 con 0x7f92200cf070 2024-09-12T01:43:04.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.088+0000 7f9207fff640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f920c06be60 0x7f920c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.088+0000 7f9207fff640 1 -- 172.21.15.60:0/96928171 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7f921408b150 con 0x7f92200cf070 2024-09-12T01:43:04.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.088+0000 7f921f7fe640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f920c06be60 0x7f920c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.088+0000 7f921f7fe640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f920c06be60 0x7f920c06e320 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9210033000 tx=0x7f9210009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:04.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.092+0000 7f9207fff640 1 -- 172.21.15.60:0/96928171 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9214019030 con 0x7f92200cf070 2024-09-12T01:43:04.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.269+0000 7f9225ed7640 1 -- 172.21.15.60:0/96928171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f9220076170 con 0x7f92200cf070 2024-09-12T01:43:04.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.272+0000 7f9207fff640 1 -- 172.21.15.60:0/96928171 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f92140597a0 con 0x7f92200cf070 2024-09-12T01:43:04.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.274+0000 7f9225ed7640 1 -- 172.21.15.60:0/96928171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f920c06be60 msgr2=0x7f920c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.274+0000 7f9225ed7640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f920c06be60 0x7f920c06e320 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9210033000 tx=0x7f9210009030 comp rx=0 tx=0).stop 2024-09-12T01:43:04.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.274+0000 7f9225ed7640 1 -- 172.21.15.60:0/96928171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200cf070 msgr2=0x7f922015e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.274+0000 7f9225ed7640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200cf070 0x7f922015e110 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f92140118e0 tx=0x7f9214011da0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.275+0000 7f9225ed7640 1 -- 172.21.15.60:0/96928171 shutdown_connections 2024-09-12T01:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.275+0000 7f9225ed7640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f920c06be60 0x7f920c06e320 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.275+0000 7f9225ed7640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f922015e650 0x7f9220160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.275+0000 7f9225ed7640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92200cf070 0x7f922015e110 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.275+0000 7f9225ed7640 1 --2- 172.21.15.60:0/96928171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f92080039b0 0x7f9220155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.275+0000 7f9225ed7640 1 -- 172.21.15.60:0/96928171 >> 172.21.15.60:0/96928171 conn(0x7f92200b3070 msgr2=0x7f92200b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.275+0000 7f9225ed7640 1 -- 172.21.15.60:0/96928171 shutdown_connections 2024-09-12T01:43:04.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.275+0000 7f9225ed7640 1 -- 172.21.15.60:0/96928171 wait complete. 2024-09-12T01:43:04.286 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:43:04.286 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:43:04.339 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:43:04.386 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:43:04.387 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:43:04.387 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:04.403 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:43:04.404 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:43:04.404 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:04.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:43:04.422 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:43:04.422 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:04.459 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:43:04.460 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:43:04.460 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:04.479 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:43:04.480 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:43:04.480 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:43:04.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.602+0000 7fc82a227640 1 Processor -- start 2024-09-12T01:43:04.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.602+0000 7fc82a227640 1 -- start start 2024-09-12T01:43:04.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.603+0000 7fc82a227640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc8240b74c0 0x7fc82415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.603+0000 7fc82a227640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc82415fb10 con 0x7fc82415c2b0 2024-09-12T01:43:04.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.603+0000 7fc82a227640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8240b5900 con 0x7fc82415f030 2024-09-12T01:43:04.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.603+0000 7fc82a227640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc82415f830 con 0x7fc8240b74c0 2024-09-12T01:43:04.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.603+0000 7fc8237fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc82415c2b0 0x7fc8240b6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51580/0 (socket says 172.21.15.60:51580) 2024-09-12T01:43:04.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.603+0000 7fc8237fe640 1 -- 172.21.15.60:0/4231878898 learned_addr learned my addr 172.21.15.60:0/4231878898 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:04.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.603+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014347099 0 0) 0x7fc82415fb10 con 0x7fc82415c2b0 2024-09-12T01:43:04.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.603+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc80c003520 con 0x7fc82415c2b0 2024-09-12T01:43:04.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.603+0000 7fc822ffd640 1 --2- 172.21.15.60:0/4231878898 >> v2:172.21.15.105:3300/0 conn(0x7fc8240b74c0 0x7fc82415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.603+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4260863246 0 0) 0x7fc80c003520 con 0x7fc82415c2b0 2024-09-12T01:43:04.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.603+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 >> v2:172.21.15.105:3300/0 conn(0x7fc8240b74c0 msgr2=0x7fc82415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:04.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.603+0000 7fc8227fc640 1 --2- 172.21.15.60:0/4231878898 >> v2:172.21.15.105:3300/0 conn(0x7fc8240b74c0 0x7fc82415eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 >> v1:172.21.15.105:6789/0 conn(0x7fc82415f030 legacy=0x7fc82406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82406ce30 con 0x7fc82415c2b0 2024-09-12T01:43:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fc814001670 con 0x7fc82415c2b0 2024-09-12T01:43:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc822ffd640 1 --2- 172.21.15.60:0/4231878898 >> v2:172.21.15.105:3300/0 conn(0x7fc8240b74c0 0x7fc82415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 >> v1:172.21.15.60:6789/0 conn(0x7fc82415c2b0 legacy=0x7fc8240b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc8227fc640 1 --2- 172.21.15.60:0/4231878898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc80c003a00 0x7fc80c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc8227fc640 1 --2- 172.21.15.60:0/4231878898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc80c004800 0x7fc80c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc8227fc640 1 --2- 172.21.15.60:0/4231878898 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc80c005210 0x7fc80c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc82415f830 con 0x7fc80c004800 2024-09-12T01:43:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c00c160 con 0x7fc80c003a00 2024-09-12T01:43:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc80c00c360 con 0x7fc80c005210 2024-09-12T01:43:04.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc822ffd640 1 --2- 172.21.15.60:0/4231878898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc80c004800 0x7fc80c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc8237fe640 1 --2- 172.21.15.60:0/4231878898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc80c003a00 0x7fc80c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc823fff640 1 --2- 172.21.15.60:0/4231878898 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc80c005210 0x7fc80c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc822ffd640 1 -- 172.21.15.60:0/4231878898 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc80c005210 msgr2=0x7fc80c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:04.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc822ffd640 1 --2- 172.21.15.60:0/4231878898 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc80c005210 0x7fc80c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc822ffd640 1 -- 172.21.15.60:0/4231878898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc80c003a00 msgr2=0x7fc80c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:04.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc822ffd640 1 --2- 172.21.15.60:0/4231878898 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc80c003a00 0x7fc80c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc823fff640 1 -- 172.21.15.60:0/4231878898 reap_dead start 2024-09-12T01:43:04.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.604+0000 7fc822ffd640 1 -- 172.21.15.60:0/4231878898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80c003520 con 0x7fc80c004800 2024-09-12T01:43:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.605+0000 7fc822ffd640 1 --2- 172.21.15.60:0/4231878898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc80c004800 0x7fc80c004c80 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fc8180098a0 tx=0x7fc80c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01868536473a475 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.605+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81800f040 con 0x7fc80c004800 2024-09-12T01:43:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.605+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81802ace0 con 0x7fc80c004800 2024-09-12T01:43:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.605+0000 7fc8227fc640 1 -- 172.21.15.60:0/4231878898 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818004250 con 0x7fc80c004800 2024-09-12T01:43:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.606+0000 7fc82a227640 1 -- 172.21.15.60:0/4231878898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc80c004800 msgr2=0x7fc80c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.606+0000 7fc82a227640 1 --2- 172.21.15.60:0/4231878898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc80c004800 0x7fc80c004c80 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fc8180098a0 tx=0x7fc80c005830 comp rx=0 tx=0).stop 2024-09-12T01:43:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.606+0000 7fc82a227640 1 -- 172.21.15.60:0/4231878898 shutdown_connections 2024-09-12T01:43:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.606+0000 7fc82a227640 1 --2- 172.21.15.60:0/4231878898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc80c004800 0x7fc80c004c80 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.606+0000 7fc82a227640 1 -- 172.21.15.60:0/4231878898 >> 172.21.15.60:0/4231878898 conn(0x7fc8240b4240 msgr2=0x7fc8240b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.606+0000 7fc82a227640 1 -- 172.21.15.60:0/4231878898 shutdown_connections 2024-09-12T01:43:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.606+0000 7fc82a227640 1 -- 172.21.15.60:0/4231878898 wait complete. 2024-09-12T01:43:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.607+0000 7fc82a227640 1 Processor -- start 2024-09-12T01:43:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.607+0000 7fc82a227640 1 -- start start 2024-09-12T01:43:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc82a227640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc80c004800 0x7fc8240aa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc82a227640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc82414dfb0 0x7fc8240ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc82a227640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc82415ce80 0x7fc82415d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc82a227640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc82415f480 con 0x7fc82414dfb0 2024-09-12T01:43:04.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc82a227640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc82406d3f0 con 0x7fc82415ce80 2024-09-12T01:43:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc82a227640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc8240aa9c0 con 0x7fc80c004800 2024-09-12T01:43:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc822ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc82414dfb0 0x7fc8240ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc822ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc82414dfb0 0x7fc8240ac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33472/0 (socket says 172.21.15.60:33472) 2024-09-12T01:43:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc822ffd640 1 -- 172.21.15.60:0/410665171 learned_addr learned my addr 172.21.15.60:0/410665171 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc823fff640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc82415ce80 0x7fc82415d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc8237fe640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc80c004800 0x7fc8240aa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc822ffd640 1 -- 172.21.15.60:0/410665171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc80c004800 msgr2=0x7fc8240aa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc822ffd640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc80c004800 0x7fc8240aa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc822ffd640 1 -- 172.21.15.60:0/410665171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc82415ce80 msgr2=0x7fc82415d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc822ffd640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc82415ce80 0x7fc82415d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc822ffd640 1 -- 172.21.15.60:0/410665171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8241f8150 con 0x7fc82414dfb0 2024-09-12T01:43:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc823fff640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc82415ce80 0x7fc82415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc822ffd640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc82414dfb0 0x7fc8240ac270 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fc818034040 tx=0x7fc818004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.608+0000 7fc80bfff640 1 -- 172.21.15.60:0/410665171 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc818041070 con 0x7fc82414dfb0 2024-09-12T01:43:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.609+0000 7fc80bfff640 1 -- 172.21.15.60:0/410665171 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81802aae0 con 0x7fc82414dfb0 2024-09-12T01:43:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.609+0000 7fc80bfff640 1 -- 172.21.15.60:0/410665171 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81803d430 con 0x7fc82414dfb0 2024-09-12T01:43:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.609+0000 7fc82a227640 1 -- 172.21.15.60:0/410665171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8241f75d0 con 0x7fc82414dfb0 2024-09-12T01:43:04.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.609+0000 7fc82a227640 1 -- 172.21.15.60:0/410665171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8241f7b90 con 0x7fc82414dfb0 2024-09-12T01:43:04.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.610+0000 7fc82a227640 1 -- 172.21.15.60:0/410665171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc82415eaf0 con 0x7fc82414dfb0 2024-09-12T01:43:04.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.610+0000 7fc80bfff640 1 -- 172.21.15.60:0/410665171 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc818044070 con 0x7fc82414dfb0 2024-09-12T01:43:04.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.611+0000 7fc80bfff640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc81006be60 0x7fc81006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:04.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.611+0000 7fc80bfff640 1 -- 172.21.15.60:0/410665171 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7fc8180ab370 con 0x7fc82414dfb0 2024-09-12T01:43:04.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.611+0000 7fc8237fe640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc81006be60 0x7fc81006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:04.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.611+0000 7fc8237fe640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc81006be60 0x7fc81006e320 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc814000c00 tx=0x7fc814009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:04.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.615+0000 7fc80bfff640 1 -- 172.21.15.60:0/410665171 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc818079f90 con 0x7fc82414dfb0 2024-09-12T01:43:04.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.825+0000 7fc82a227640 1 -- 172.21.15.60:0/410665171 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8240ac7b0 con 0x7fc82414dfb0 2024-09-12T01:43:04.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.825+0000 7fc80bfff640 1 -- 172.21.15.60:0/410665171 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+3918 (secure 0 0 0) 0x7fc818079890 con 0x7fc82414dfb0 2024-09-12T01:43:04.826 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:04.826 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":65,"btime":"2024-09-12T01:42:58:751661+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7089,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3412598725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3412598725},{"type":"v1","addr":"172.21.15.60:6837","nonce":3412598725}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":7092,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/2966702196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2966702196},{"type":"v1","addr":"172.21.15.60:6836","nonce":2966702196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":7107,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3682228949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3682228949},{"type":"v1","addr":"172.21.15.105:6834","nonce":3682228949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57},{"gid":36119,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/1419942020","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":1419942020},{"type":"v1","addr":"172.21.15.105:6835","nonce":1419942020}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65}],"filesystems":[]} 2024-09-12T01:43:04.826 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 65 2024-09-12T01:43:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.827+0000 7fc82a227640 1 -- 172.21.15.60:0/410665171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc81006be60 msgr2=0x7fc81006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.827+0000 7fc82a227640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc81006be60 0x7fc81006e320 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc814000c00 tx=0x7fc814009040 comp rx=0 tx=0).stop 2024-09-12T01:43:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.827+0000 7fc82a227640 1 -- 172.21.15.60:0/410665171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc82414dfb0 msgr2=0x7fc8240ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.827+0000 7fc82a227640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc82414dfb0 0x7fc8240ac270 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fc818034040 tx=0x7fc818004730 comp rx=0 tx=0).stop 2024-09-12T01:43:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.827+0000 7fc82a227640 1 -- 172.21.15.60:0/410665171 shutdown_connections 2024-09-12T01:43:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.827+0000 7fc82a227640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc82415ce80 0x7fc82415d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.827+0000 7fc82a227640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc82414dfb0 0x7fc8240ac270 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.827+0000 7fc82a227640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc81006be60 0x7fc81006e320 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.827+0000 7fc82a227640 1 --2- 172.21.15.60:0/410665171 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc80c004800 0x7fc8240aa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.827+0000 7fc82a227640 1 -- 172.21.15.60:0/410665171 >> 172.21.15.60:0/410665171 conn(0x7fc8240b4240 msgr2=0x7fc8240b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.827+0000 7fc82a227640 1 -- 172.21.15.60:0/410665171 shutdown_connections 2024-09-12T01:43:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:04.827+0000 7fc82a227640 1 -- 172.21.15.60:0/410665171 wait complete. 2024-09-12T01:43:04.839 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:43:04.839 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:43:04.839 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:43:04.840 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:43:04.840 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:43:04.840 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:43:04.840 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:43:04.840 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:43:04.840 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:43:04.841 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:43:04.841 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:43:04.841 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:43:04.841 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:43:04.841 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:43:04.841 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:43:04.841 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:43:04.851 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:43:04.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:43:04.852 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:43:04.852 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:43:04.853 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:43:04.854 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:43:04.854 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:43:04.854 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:43:04.894 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:43:04.894 DEBUG:teuthology.parallel:result is None 2024-09-12T01:43:04.895 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:43:04.895 DEBUG:teuthology.parallel:result is None 2024-09-12T01:43:04.896 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:43:04.897 DEBUG:teuthology.parallel:result is None 2024-09-12T01:43:04.897 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:43:04.897 DEBUG:teuthology.parallel:result is None 2024-09-12T01:43:04.898 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:43:04.972 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2024-09-12T01:43:04.973 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2024-09-12T01:43:04.978 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:43:04.978 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.004+0000 7fbe35111640 1 Processor -- start 2024-09-12T01:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.004+0000 7fbe35111640 1 -- start start 2024-09-12T01:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.005+0000 7fbe35111640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe3015e7a0 0x7fbe3006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.005+0000 7fbe35111640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe300cf1f0 0x7fbe300b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.005+0000 7fbe35111640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe300cf860 con 0x7fbe300b6720 2024-09-12T01:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.005+0000 7fbe35111640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbe300d2ca0 con 0x7fbe3015e7a0 2024-09-12T01:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.005+0000 7fbe35111640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbe300cfb40 con 0x7fbe300cf1f0 2024-09-12T01:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.005+0000 7fbe2ed9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbe3015e7a0 0x7fbe3006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.005+0000 7fbe2f59e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbe300b6720 0x7fbe301623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51596/0 (socket says 172.21.15.60:51596) 2024-09-12T01:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.005+0000 7fbe2f59e640 1 -- 172.21.15.60:0/3608636654 learned_addr learned my addr 172.21.15.60:0/3608636654 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.005+0000 7fbe2e59c640 1 --2- 172.21.15.60:0/3608636654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe300cf1f0 0x7fbe300b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.006+0000 7fbe2ed9d640 1 -- 172.21.15.60:0/3608636654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe300cf1f0 msgr2=0x7fbe300b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.006+0000 7fbe2ed9d640 1 --2- 172.21.15.60:0/3608636654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe300cf1f0 0x7fbe300b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.006+0000 7fbe2ed9d640 1 -- 172.21.15.60:0/3608636654 >> v1:172.21.15.60:6789/0 conn(0x7fbe300b6720 legacy=0x7fbe301623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.006+0000 7fbe2dd9b640 1 -- 172.21.15.60:0/3608636654 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 55781426 0 0) 0x7fbe300cf860 con 0x7fbe300b6720 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.006+0000 7fbe2ed9d640 1 -- 172.21.15.60:0/3608636654 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe300cfe20 con 0x7fbe3015e7a0 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.006+0000 7fbe2ed9d640 1 --2- 172.21.15.60:0/3608636654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe3015e7a0 0x7fbe3006caa0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009d90 tx=0x7fbe2002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe0a90a2d74b2ab server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.007+0000 7fbe2dd9b640 1 -- 172.21.15.60:0/3608636654 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20031600 con 0x7fbe3015e7a0 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.007+0000 7fbe2dd9b640 1 -- 172.21.15.60:0/3608636654 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe200317a0 con 0x7fbe3015e7a0 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.007+0000 7fbe2dd9b640 1 -- 172.21.15.60:0/3608636654 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20031b70 con 0x7fbe3015e7a0 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.007+0000 7fbe35111640 1 -- 172.21.15.60:0/3608636654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe3015e7a0 msgr2=0x7fbe3006caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.007+0000 7fbe35111640 1 --2- 172.21.15.60:0/3608636654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe3015e7a0 0x7fbe3006caa0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009d90 tx=0x7fbe2002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.007+0000 7fbe35111640 1 -- 172.21.15.60:0/3608636654 shutdown_connections 2024-09-12T01:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.007+0000 7fbe35111640 1 --2- 172.21.15.60:0/3608636654 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe300cf1f0 0x7fbe300b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.007+0000 7fbe35111640 1 --2- 172.21.15.60:0/3608636654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe3015e7a0 0x7fbe3006caa0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.007+0000 7fbe35111640 1 -- 172.21.15.60:0/3608636654 >> 172.21.15.60:0/3608636654 conn(0x7fbe300d11e0 msgr2=0x7fbe300d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.007+0000 7fbe35111640 1 -- 172.21.15.60:0/3608636654 shutdown_connections 2024-09-12T01:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.007+0000 7fbe35111640 1 -- 172.21.15.60:0/3608636654 wait complete. 2024-09-12T01:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.009+0000 7fbe35111640 1 Processor -- start 2024-09-12T01:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.009+0000 7fbe35111640 1 -- start start 2024-09-12T01:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.009+0000 7fbe35111640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe300b6720 0x7fbe3014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.009+0000 7fbe35111640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe300cf1f0 0x7fbe300cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.009+0000 7fbe35111640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe3015e7a0 0x7fbe301607f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe35111640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3006cfe0 con 0x7fbe3015e7a0 2024-09-12T01:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe35111640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe300b7a00 con 0x7fbe300cf1f0 2024-09-12T01:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe35111640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbe300d4420 con 0x7fbe300b6720 2024-09-12T01:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe2f59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe3015e7a0 0x7fbe301607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe2f59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe3015e7a0 0x7fbe301607f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33500/0 (socket says 172.21.15.60:33500) 2024-09-12T01:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe2f59e640 1 -- 172.21.15.60:0/3308824534 learned_addr learned my addr 172.21.15.60:0/3308824534 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe2ed9d640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe300b6720 0x7fbe3014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe2e59c640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe300cf1f0 0x7fbe300cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe2f59e640 1 -- 172.21.15.60:0/3308824534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe300b6720 msgr2=0x7fbe3014f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe2f59e640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe300b6720 0x7fbe3014f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe2f59e640 1 -- 172.21.15.60:0/3308824534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe300cf1f0 msgr2=0x7fbe300cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe2f59e640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe300cf1f0 0x7fbe300cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe2f59e640 1 -- 172.21.15.60:0/3308824534 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3015f300 con 0x7fbe3015e7a0 2024-09-12T01:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe2e59c640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe300cf1f0 0x7fbe300cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe2f59e640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe3015e7a0 0x7fbe301607f0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800c450 tx=0x7fbe2800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe177fe640 1 -- 172.21.15.60:0/3308824534 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28018070 con 0x7fbe3015e7a0 2024-09-12T01:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe177fe640 1 -- 172.21.15.60:0/3308824534 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe28007500 con 0x7fbe3015e7a0 2024-09-12T01:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.010+0000 7fbe35111640 1 -- 172.21.15.60:0/3308824534 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe300ccfb0 con 0x7fbe3015e7a0 2024-09-12T01:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.011+0000 7fbe177fe640 1 -- 172.21.15.60:0/3308824534 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28004a20 con 0x7fbe3015e7a0 2024-09-12T01:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.011+0000 7fbe35111640 1 -- 172.21.15.60:0/3308824534 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe300cd570 con 0x7fbe3015e7a0 2024-09-12T01:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.012+0000 7fbe177fe640 1 -- 172.21.15.60:0/3308824534 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe28004bc0 con 0x7fbe3015e7a0 2024-09-12T01:43:05.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.012+0000 7fbe35111640 1 -- 172.21.15.60:0/3308824534 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe300d2a80 con 0x7fbe3015e7a0 2024-09-12T01:43:05.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.012+0000 7fbe177fe640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe1c06be30 0x7fbe1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:05.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.012+0000 7fbe2ed9d640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe1c06be30 0x7fbe1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:05.020 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.012+0000 7fbe177fe640 1 -- 172.21.15.60:0/3308824534 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 4943+0+0 (secure 0 0 0) 0x7fbe28089f40 con 0x7fbe3015e7a0 2024-09-12T01:43:05.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.013+0000 7fbe2ed9d640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe1c06be30 0x7fbe1c06e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbe20034000 tx=0x7fbe2002f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:05.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.016+0000 7fbe177fe640 1 -- 172.21.15.60:0/3308824534 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe28058b90 con 0x7fbe3015e7a0 2024-09-12T01:43:05.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:05.203+0000 7fbe35111640 1 -- 172.21.15.60:0/3308824534 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fbe3015a930 con 0x7fbe3015e7a0 2024-09-12T01:43:06.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.286+0000 7fbe177fe640 1 -- 172.21.15.60:0/3308824534 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v113) ==== 97+0+0 (secure 0 0 0) 0x7fbe28058490 con 0x7fbe3015e7a0 2024-09-12T01:43:06.287 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2024-09-12T01:43:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.289+0000 7fbe35111640 1 -- 172.21.15.60:0/3308824534 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe1c06be30 msgr2=0x7fbe1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.289+0000 7fbe35111640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe1c06be30 0x7fbe1c06e2f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbe20034000 tx=0x7fbe2002f000 comp rx=0 tx=0).stop 2024-09-12T01:43:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.289+0000 7fbe35111640 1 -- 172.21.15.60:0/3308824534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe3015e7a0 msgr2=0x7fbe301607f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.289+0000 7fbe35111640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe3015e7a0 0x7fbe301607f0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800c450 tx=0x7fbe2800c910 comp rx=0 tx=0).stop 2024-09-12T01:43:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.289+0000 7fbe35111640 1 -- 172.21.15.60:0/3308824534 shutdown_connections 2024-09-12T01:43:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.289+0000 7fbe35111640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe3015e7a0 0x7fbe301607f0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.289+0000 7fbe35111640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe300cf1f0 0x7fbe300cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.289+0000 7fbe35111640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe1c06be30 0x7fbe1c06e2f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.289+0000 7fbe35111640 1 --2- 172.21.15.60:0/3308824534 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe300b6720 0x7fbe3014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.289+0000 7fbe35111640 1 -- 172.21.15.60:0/3308824534 >> 172.21.15.60:0/3308824534 conn(0x7fbe300d11e0 msgr2=0x7fbe300d4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:06.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.289+0000 7fbe35111640 1 -- 172.21.15.60:0/3308824534 shutdown_connections 2024-09-12T01:43:06.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.289+0000 7fbe35111640 1 -- 172.21.15.60:0/3308824534 wait complete. 2024-09-12T01:43:06.303 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:43:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.413+0000 7fdb8644c640 1 Processor -- start 2024-09-12T01:43:06.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.413+0000 7fdb8644c640 1 -- start start 2024-09-12T01:43:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.413+0000 7fdb8644c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdb800d3310 0x7fdb800d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.413+0000 7fdb8644c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8015ea40 con 0x7fdb8015e660 2024-09-12T01:43:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.413+0000 7fdb8644c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb800d3870 con 0x7fdb800d1650 2024-09-12T01:43:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.413+0000 7fdb8644c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdb800d1ac0 con 0x7fdb800d3310 2024-09-12T01:43:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.414+0000 7fdb7f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdb800d3310 0x7fdb800d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.414+0000 7fdb7ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdb8015e660 0x7fdb800cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51602/0 (socket says 172.21.15.60:51602) 2024-09-12T01:43:06.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.414+0000 7fdb7ffff640 1 -- 172.21.15.60:0/1785095736 learned_addr learned my addr 172.21.15.60:0/1785095736 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.414+0000 7fdb7f7fe640 1 -- 172.21.15.60:0/1785095736 >> v1:172.21.15.105:6789/0 conn(0x7fdb800d1650 legacy=0x7fdb800b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.414+0000 7fdb7f7fe640 1 -- 172.21.15.60:0/1785095736 >> v1:172.21.15.60:6789/0 conn(0x7fdb8015e660 legacy=0x7fdb800cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.414+0000 7fdb7f7fe640 1 -- 172.21.15.60:0/1785095736 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb800d3b50 con 0x7fdb800d3310 2024-09-12T01:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.414+0000 7fdb7effd640 1 -- 172.21.15.60:0/1785095736 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1529706348 0 0) 0x7fdb8015ea40 con 0x7fdb8015e660 2024-09-12T01:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.415+0000 7fdb7f7fe640 1 --2- 172.21.15.60:0/1785095736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb800d3310 0x7fdb800d1110 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fdb740097a0 tx=0x7fdb7402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d257a8d1abeb9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.415+0000 7fdb7effd640 1 -- 172.21.15.60:0/1785095736 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74037070 con 0x7fdb800d3310 2024-09-12T01:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.415+0000 7fdb7effd640 1 -- 172.21.15.60:0/1785095736 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb74032440 con 0x7fdb800d3310 2024-09-12T01:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.415+0000 7fdb7effd640 1 -- 172.21.15.60:0/1785095736 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74032810 con 0x7fdb800d3310 2024-09-12T01:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.415+0000 7fdb8644c640 1 -- 172.21.15.60:0/1785095736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb800d3310 msgr2=0x7fdb800d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.415+0000 7fdb8644c640 1 --2- 172.21.15.60:0/1785095736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb800d3310 0x7fdb800d1110 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fdb740097a0 tx=0x7fdb7402a230 comp rx=0 tx=0).stop 2024-09-12T01:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.415+0000 7fdb8644c640 1 -- 172.21.15.60:0/1785095736 shutdown_connections 2024-09-12T01:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.415+0000 7fdb8644c640 1 --2- 172.21.15.60:0/1785095736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb800d3310 0x7fdb800d1110 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.415+0000 7fdb8644c640 1 -- 172.21.15.60:0/1785095736 >> 172.21.15.60:0/1785095736 conn(0x7fdb800b6410 msgr2=0x7fdb800b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.416+0000 7fdb8644c640 1 -- 172.21.15.60:0/1785095736 shutdown_connections 2024-09-12T01:43:06.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.416+0000 7fdb8644c640 1 -- 172.21.15.60:0/1785095736 wait complete. 2024-09-12T01:43:06.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.417+0000 7fdb8644c640 1 Processor -- start 2024-09-12T01:43:06.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.417+0000 7fdb8644c640 1 -- start start 2024-09-12T01:43:06.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb8644c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb800d1650 0x7fdb800ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb8644c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb800d3310 0x7fdb801574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb8644c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb8015e660 0x7fdb801f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb8644c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdb800d43f0 con 0x7fdb8015e660 2024-09-12T01:43:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb8644c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdb800d4110 con 0x7fdb800d3310 2024-09-12T01:43:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb8644c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdb800b8280 con 0x7fdb800d1650 2024-09-12T01:43:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb849e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb8015e660 0x7fdb801f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb849e9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb8015e660 0x7fdb801f7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33508/0 (socket says 172.21.15.60:33508) 2024-09-12T01:43:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb849e9640 1 -- 172.21.15.60:0/3039076213 learned_addr learned my addr 172.21.15.60:0/3039076213 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb7ffff640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb800d1650 0x7fdb800ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb7f7fe640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb800d3310 0x7fdb801574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb849e9640 1 -- 172.21.15.60:0/3039076213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb800d1650 msgr2=0x7fdb800ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb849e9640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb800d1650 0x7fdb800ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb849e9640 1 -- 172.21.15.60:0/3039076213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb800d3310 msgr2=0x7fdb801574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb849e9640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb800d3310 0x7fdb801574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb849e9640 1 -- 172.21.15.60:0/3039076213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb800ca380 con 0x7fdb8015e660 2024-09-12T01:43:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb849e9640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb8015e660 0x7fdb801f7570 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800c7a0 tx=0x7fdb7800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb7cff9640 1 -- 172.21.15.60:0/3039076213 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb78003b70 con 0x7fdb8015e660 2024-09-12T01:43:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb7cff9640 1 -- 172.21.15.60:0/3039076213 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb78003d30 con 0x7fdb8015e660 2024-09-12T01:43:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb7cff9640 1 -- 172.21.15.60:0/3039076213 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7800aa90 con 0x7fdb8015e660 2024-09-12T01:43:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.418+0000 7fdb8644c640 1 -- 172.21.15.60:0/3039076213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb80156a00 con 0x7fdb8015e660 2024-09-12T01:43:06.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.419+0000 7fdb8644c640 1 -- 172.21.15.60:0/3039076213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb80156fc0 con 0x7fdb8015e660 2024-09-12T01:43:06.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.419+0000 7fdb8644c640 1 -- 172.21.15.60:0/3039076213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb800d1110 con 0x7fdb8015e660 2024-09-12T01:43:06.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.420+0000 7fdb7cff9640 1 -- 172.21.15.60:0/3039076213 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdb7800ac30 con 0x7fdb8015e660 2024-09-12T01:43:06.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.420+0000 7fdb7cff9640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdb6c06be30 0x7fdb6c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:06.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.420+0000 7fdb7cff9640 1 -- 172.21.15.60:0/3039076213 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4857+0+0 (secure 0 0 0) 0x7fdb7808aab0 con 0x7fdb8015e660 2024-09-12T01:43:06.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.421+0000 7fdb7ffff640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdb6c06be30 0x7fdb6c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:06.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.421+0000 7fdb7ffff640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdb6c06be30 0x7fdb6c06e2f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdb70000f60 tx=0x7fdb70007d00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:06.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.425+0000 7fdb7cff9640 1 -- 172.21.15.60:0/3039076213 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdb780597a0 con 0x7fdb8015e660 2024-09-12T01:43:06.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.664+0000 7fdb8644c640 1 -- 172.21.15.60:0/3039076213 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fdb800c7cf0 con 0x7fdb8015e660 2024-09-12T01:43:06.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.664+0000 7fdb7cff9640 1 -- 172.21.15.60:0/3039076213 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5304 (secure 0 0 0) 0x7fdb780590a0 con 0x7fdb8015e660 2024-09-12T01:43:06.665 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:06.665 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:43:06.666 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2024-09-12T01:43:06.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.666 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2024-09-12T01:43:06.666 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmIK3fKxAAM9RkghDZwJZWuKouIbObDw==", 2024-09-12T01:43:06.666 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.666 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:06.666 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:43:06.666 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:43:06.666 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.666 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmzqHZNxAAnhCo4gGwLgYDVzzYnoiDFA==", 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmksMWMxAAp3xMDD09rfphgPZwQcEABA==", 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.667 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:06.668 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:43:06.668 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:43:06.668 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.668 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.668 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2024-09-12T01:43:06.668 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmvLw/AxAApd4hl5LRD1QddnPPjRw2Kg==", 2024-09-12T01:43:06.668 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.668 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA7ReJmc3D/JxAAXiw6n1Q3n9sCXln6YSiCBA==", 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.669 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.670 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2024-09-12T01:43:06.670 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA/ReJmEOu3CxAA4uu1neLh0mpeG9nia+/VqQ==", 2024-09-12T01:43:06.670 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.670 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:06.670 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:06.670 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBCReJm3HHtDhAAoAdKVsjuXmpcf5R5zTtFKg==", 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBFReJmtRLuIBAA/BBibpGfpXsFXqVjVrmXWA==", 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.671 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:06.672 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:06.672 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.672 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2024-09-12T01:43:06.672 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBMReJmdDNXKhAAeh5aCvMw+70z3tnwjb9Hjg==", 2024-09-12T01:43:06.672 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.672 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:06.672 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:06.672 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.673 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2024-09-12T01:43:06.673 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBQReJm/tsIHRAAmgx+5WifY/VITGHAbUV2CQ==", 2024-09-12T01:43:06.673 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.673 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:06.673 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:06.673 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.673 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.673 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.673 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2024-09-12T01:43:06.674 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBUReJmQFaBHhAA1vH01tePCoJQFXlHB5gcVg==", 2024-09-12T01:43:06.674 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.674 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:06.674 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:06.674 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.674 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.674 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2024-09-12T01:43:06.674 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBYReJmTHqLAhAAtUB94Pa3eihlVdaupZ8Ggg==", 2024-09-12T01:43:06.674 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.674 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ==", 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmTopGEBAAY0K3iZm2PotQc8a489uO/Q==", 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmqUgQDRAAAp5SAwNM9aSxZ1VVRwroNA==", 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.676 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmGfzeFRAAE2xCnzeyX/KBo3NBrkixYQ==", 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:43:06.677 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmOfXYDxAA0hydSyRvFmmNvFcRwPaXqg==", 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmjpyMKBAAMSGgYJddHs7TtCV0NszZAQ==", 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJm3Ei+JBAAhwgXWq0baTlDtaLedcaHmg==", 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:06.679 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:43:06.680 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:43:06.680 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:06.680 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.680 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.680 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T01:43:06.680 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:43:06.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.666+0000 7fdb8644c640 1 -- 172.21.15.60:0/3039076213 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdb6c06be30 msgr2=0x7fdb6c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.666+0000 7fdb8644c640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdb6c06be30 0x7fdb6c06e2f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdb70000f60 tx=0x7fdb70007d00 comp rx=0 tx=0).stop 2024-09-12T01:43:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.666+0000 7fdb8644c640 1 -- 172.21.15.60:0/3039076213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb8015e660 msgr2=0x7fdb801f7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.666+0000 7fdb8644c640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb8015e660 0x7fdb801f7570 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800c7a0 tx=0x7fdb7800cc60 comp rx=0 tx=0).stop 2024-09-12T01:43:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.666+0000 7fdb8644c640 1 -- 172.21.15.60:0/3039076213 shutdown_connections 2024-09-12T01:43:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.666+0000 7fdb8644c640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb8015e660 0x7fdb801f7570 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.666+0000 7fdb8644c640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdb800d3310 0x7fdb801574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.666+0000 7fdb8644c640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdb6c06be30 0x7fdb6c06e2f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.666+0000 7fdb8644c640 1 --2- 172.21.15.60:0/3039076213 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdb800d1650 0x7fdb800ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.666+0000 7fdb8644c640 1 -- 172.21.15.60:0/3039076213 >> 172.21.15.60:0/3039076213 conn(0x7fdb800b6410 msgr2=0x7fdb800b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.667+0000 7fdb8644c640 1 -- 172.21.15.60:0/3039076213 shutdown_connections 2024-09-12T01:43:06.682 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.667+0000 7fdb8644c640 1 -- 172.21.15.60:0/3039076213 wait complete. 2024-09-12T01:43:06.683 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:43:06.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.784+0000 7f2162817640 1 Processor -- start 2024-09-12T01:43:06.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.784+0000 7f2162817640 1 -- start start 2024-09-12T01:43:06.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.785+0000 7f2162817640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f215c0b74c0 0x7f215c15eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:06.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.785+0000 7f2162817640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 0x7f215c06d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:06.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.785+0000 7f2162817640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c15fb10 con 0x7f215c15c2b0 2024-09-12T01:43:06.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.785+0000 7f2162817640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f215c0b5900 con 0x7f215c0b74c0 2024-09-12T01:43:06.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.785+0000 7f2162817640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f215c15f830 con 0x7f215c15f030 2024-09-12T01:43:06.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.786+0000 7f215b7fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f215c0b74c0 0x7f215c15eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:06.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.786+0000 7f2160db4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 0x7f215c06d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:06.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.786+0000 7f215b7fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f215c0b74c0 0x7f215c15eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:38466/0 (socket says 172.21.15.60:38466) 2024-09-12T01:43:06.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.786+0000 7f2160db4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 0x7f215c06d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:40138/0 (socket says 172.21.15.60:40138) 2024-09-12T01:43:06.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.786+0000 7f215b7fe640 1 -- 172.21.15.60:0/3483804119 learned_addr learned my addr 172.21.15.60:0/3483804119 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:06.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.786+0000 7f215bfff640 1 --1- 172.21.15.60:0/3483804119 >> v1:172.21.15.105:6789/0 conn(0x7f215c15c2b0 0x7f215c0b6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:50526/0 (socket says 172.21.15.60:50526) 2024-09-12T01:43:06.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.786+0000 7f2160db4640 1 -- 172.21.15.60:0/3483804119 >> v2:172.21.15.105:3300/0 conn(0x7f215c0b74c0 msgr2=0x7f215c15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:06.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.786+0000 7f2160db4640 1 --2- 172.21.15.60:0/3483804119 >> v2:172.21.15.105:3300/0 conn(0x7f215c0b74c0 0x7f215c15eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.786+0000 7f2160db4640 1 -- 172.21.15.60:0/3483804119 >> v1:172.21.15.105:6789/0 conn(0x7f215c15c2b0 legacy=0x7f215c0b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.786+0000 7f2160db4640 1 -- 172.21.15.60:0/3483804119 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c06ce30 con 0x7f215c15f030 2024-09-12T01:43:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.787+0000 7f2160db4640 1 --2- 172.21.15.60:0/3483804119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 0x7f215c06d910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2154009d90 tx=0x7f215402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2efa2e159a13e6b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.787+0000 7f215affd640 1 -- 172.21.15.60:0/3483804119 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154007740 con 0x7f215c15f030 2024-09-12T01:43:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.787+0000 7f215affd640 1 -- 172.21.15.60:0/3483804119 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21540078e0 con 0x7f215c15f030 2024-09-12T01:43:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.787+0000 7f215affd640 1 -- 172.21.15.60:0/3483804119 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2154007cb0 con 0x7f215c15f030 2024-09-12T01:43:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.788+0000 7f2162817640 1 -- 172.21.15.60:0/3483804119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 msgr2=0x7f215c06d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.788+0000 7f2162817640 1 --2- 172.21.15.60:0/3483804119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 0x7f215c06d910 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2154009d90 tx=0x7f215402a660 comp rx=0 tx=0).stop 2024-09-12T01:43:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.788+0000 7f2162817640 1 -- 172.21.15.60:0/3483804119 shutdown_connections 2024-09-12T01:43:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.788+0000 7f2162817640 1 --2- 172.21.15.60:0/3483804119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 0x7f215c06d910 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.788+0000 7f2162817640 1 --2- 172.21.15.60:0/3483804119 >> v2:172.21.15.105:3300/0 conn(0x7f215c0b74c0 0x7f215c15eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.788+0000 7f2162817640 1 -- 172.21.15.60:0/3483804119 >> 172.21.15.60:0/3483804119 conn(0x7f215c0b4240 msgr2=0x7f215c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:06.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.788+0000 7f2162817640 1 -- 172.21.15.60:0/3483804119 shutdown_connections 2024-09-12T01:43:06.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.788+0000 7f2162817640 1 -- 172.21.15.60:0/3483804119 wait complete. 2024-09-12T01:43:06.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.789+0000 7f2162817640 1 Processor -- start 2024-09-12T01:43:06.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.789+0000 7f2162817640 1 -- start start 2024-09-12T01:43:06.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f2162817640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f215c0b74c0 0x7f215c0ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:06.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f2162817640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c15c2b0 0x7f215c0cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:06.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f2162817640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 0x7f215c1f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:06.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f2162817640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f215c15f4c0 con 0x7f215c15c2b0 2024-09-12T01:43:06.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f2162817640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f215c06d3f0 con 0x7f215c0b74c0 2024-09-12T01:43:06.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f2162817640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f215c06de50 con 0x7f215c15f030 2024-09-12T01:43:06.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c15c2b0 0x7f215c0cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:06.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f215b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c15c2b0 0x7f215c0cf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33514/0 (socket says 172.21.15.60:33514) 2024-09-12T01:43:06.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f215b7fe640 1 -- 172.21.15.60:0/3675834289 learned_addr learned my addr 172.21.15.60:0/3675834289 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:06.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f215bfff640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f215c0b74c0 0x7f215c0ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:06.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f2160db4640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 0x7f215c1f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:06.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f215b7fe640 1 -- 172.21.15.60:0/3675834289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 msgr2=0x7f215c1f3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f215b7fe640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 0x7f215c1f3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f215b7fe640 1 -- 172.21.15.60:0/3675834289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f215c0b74c0 msgr2=0x7f215c0ab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f215b7fe640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f215c0b74c0 0x7f215c0ab400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f215b7fe640 1 -- 172.21.15.60:0/3675834289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c0cff10 con 0x7f215c15c2b0 2024-09-12T01:43:06.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f2160db4640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 0x7f215c1f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:06.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f215bfff640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f215c0b74c0 0x7f215c0ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:06.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.790+0000 7f215b7fe640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c15c2b0 0x7f215c0cf6c0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f2150009fd0 tx=0x7f215000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:06.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.791+0000 7f2158ff9640 1 -- 172.21.15.60:0/3675834289 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150017070 con 0x7f215c15c2b0 2024-09-12T01:43:06.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.791+0000 7f2158ff9640 1 -- 172.21.15.60:0/3675834289 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f215000c940 con 0x7f215c15c2b0 2024-09-12T01:43:06.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.791+0000 7f2162817640 1 -- 172.21.15.60:0/3675834289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c0d01f0 con 0x7f215c15c2b0 2024-09-12T01:43:06.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.791+0000 7f2158ff9640 1 -- 172.21.15.60:0/3675834289 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215000cd10 con 0x7f215c15c2b0 2024-09-12T01:43:06.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.791+0000 7f2162817640 1 -- 172.21.15.60:0/3675834289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c0cfc00 con 0x7f215c15c2b0 2024-09-12T01:43:06.794 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.792+0000 7f2162817640 1 -- 172.21.15.60:0/3675834289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215c0d0710 con 0x7f215c15c2b0 2024-09-12T01:43:06.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.792+0000 7f2158ff9640 1 -- 172.21.15.60:0/3675834289 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f215001a070 con 0x7f215c15c2b0 2024-09-12T01:43:06.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.792+0000 7f2158ff9640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f214806be30 0x7f214806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:06.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.793+0000 7f2158ff9640 1 -- 172.21.15.60:0/3675834289 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4857+0+0 (secure 0 0 0) 0x7f215008ade0 con 0x7f215c15c2b0 2024-09-12T01:43:06.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.793+0000 7f215bfff640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f214806be30 0x7f214806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:06.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.793+0000 7f215bfff640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f214806be30 0x7f214806e2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f214c007fd0 tx=0x7f214c007d80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:06.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.797+0000 7f2158ff9640 1 -- 172.21.15.60:0/3675834289 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f215c0d0710 con 0x7f215c15c2b0 2024-09-12T01:43:06.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.973+0000 7f2162817640 1 -- 172.21.15.60:0/3675834289 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f215c15eaf0 con 0x7f215c15c2b0 2024-09-12T01:43:06.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.974+0000 7f2158ff9640 1 -- 172.21.15.60:0/3675834289 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v113) ==== 84+0+65 (secure 0 0 0) 0x7f2150059ae0 con 0x7f215c15c2b0 2024-09-12T01:43:06.974 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:06.975 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T01:43:06.975 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:06.975 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T01:43:06.975 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T01:43:06.975 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:06.975 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T01:43:06.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.976+0000 7f2162817640 1 -- 172.21.15.60:0/3675834289 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f214806be30 msgr2=0x7f214806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.976+0000 7f2162817640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f214806be30 0x7f214806e2f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f214c007fd0 tx=0x7f214c007d80 comp rx=0 tx=0).stop 2024-09-12T01:43:06.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.976+0000 7f2162817640 1 -- 172.21.15.60:0/3675834289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c15c2b0 msgr2=0x7f215c0cf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:06.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.976+0000 7f2162817640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c15c2b0 0x7f215c0cf6c0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f2150009fd0 tx=0x7f215000ed40 comp rx=0 tx=0).stop 2024-09-12T01:43:06.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.976+0000 7f2162817640 1 -- 172.21.15.60:0/3675834289 shutdown_connections 2024-09-12T01:43:06.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.976+0000 7f2162817640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f214806be30 0x7f214806e2f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.976+0000 7f2162817640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f215c15f030 0x7f215c1f3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.976+0000 7f2162817640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f215c15c2b0 0x7f215c0cf6c0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.976+0000 7f2162817640 1 --2- 172.21.15.60:0/3675834289 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f215c0b74c0 0x7f215c0ab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:06.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.976+0000 7f2162817640 1 -- 172.21.15.60:0/3675834289 >> 172.21.15.60:0/3675834289 conn(0x7f215c0b4240 msgr2=0x7f215c15fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:06.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.976+0000 7f2162817640 1 -- 172.21.15.60:0/3675834289 shutdown_connections 2024-09-12T01:43:06.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:06.976+0000 7f2162817640 1 -- 172.21.15.60:0/3675834289 wait complete. 2024-09-12T01:43:06.987 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:43:06.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:43:07.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.094+0000 7f85fcbb9640 1 Processor -- start 2024-09-12T01:43:07.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.094+0000 7f85fcbb9640 1 -- start start 2024-09-12T01:43:07.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.095+0000 7f85fcbb9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f85f815a050 0x7f85f815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:07.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.095+0000 7f85fcbb9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f85f80731c0 0x7f85f8073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:07.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.095+0000 7f85fcbb9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f815a430 con 0x7f85f815ffd0 2024-09-12T01:43:07.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.095+0000 7f85fcbb9640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f85f8073b40 con 0x7f85f815a050 2024-09-12T01:43:07.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.095+0000 7f85fcbb9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f85f815d9a0 con 0x7f85f80731c0 2024-09-12T01:43:07.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.095+0000 7f85f659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f85f815a050 0x7f85f815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:07.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.096+0000 7f85f659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f85f815a050 0x7f85f815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33528/0 (socket says 172.21.15.60:33528) 2024-09-12T01:43:07.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.096+0000 7f85f659c640 1 -- 172.21.15.60:0/3842534488 learned_addr learned my addr 172.21.15.60:0/3842534488 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:07.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.096+0000 7f85f659c640 1 -- 172.21.15.60:0/3842534488 >> v2:172.21.15.105:3300/0 conn(0x7f85f80731c0 msgr2=0x7f85f8073600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:07.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.096+0000 7f85f659c640 1 --2- 172.21.15.60:0/3842534488 >> v2:172.21.15.105:3300/0 conn(0x7f85f80731c0 0x7f85f8073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:07.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.096+0000 7f85f659c640 1 -- 172.21.15.60:0/3842534488 >> v1:172.21.15.105:6789/0 conn(0x7f85f815ffd0 legacy=0x7f85f8160440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:07.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.096+0000 7f85f659c640 1 -- 172.21.15.60:0/3842534488 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f80cd0a0 con 0x7f85f815a050 2024-09-12T01:43:07.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.096+0000 7f85f659c640 1 --2- 172.21.15.60:0/3842534488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f815a050 0x7f85f815d460 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f85f80c5c80 tx=0x7f85f002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27baa56a7e99fc56 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:07.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.097+0000 7f85f559a640 1 -- 172.21.15.60:0/3842534488 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0036070 con 0x7f85f815a050 2024-09-12T01:43:07.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.097+0000 7f85f559a640 1 -- 172.21.15.60:0/3842534488 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f0031600 con 0x7f85f815a050 2024-09-12T01:43:07.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.097+0000 7f85f559a640 1 -- 172.21.15.60:0/3842534488 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f00319d0 con 0x7f85f815a050 2024-09-12T01:43:07.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.097+0000 7f85fcbb9640 1 -- 172.21.15.60:0/3842534488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f815a050 msgr2=0x7f85f815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:07.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.097+0000 7f85fcbb9640 1 --2- 172.21.15.60:0/3842534488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f815a050 0x7f85f815d460 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f85f80c5c80 tx=0x7f85f002a660 comp rx=0 tx=0).stop 2024-09-12T01:43:07.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.097+0000 7f85fcbb9640 1 -- 172.21.15.60:0/3842534488 shutdown_connections 2024-09-12T01:43:07.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.097+0000 7f85fcbb9640 1 --2- 172.21.15.60:0/3842534488 >> v2:172.21.15.105:3300/0 conn(0x7f85f80731c0 0x7f85f8073600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:07.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.097+0000 7f85fcbb9640 1 --2- 172.21.15.60:0/3842534488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f815a050 0x7f85f815d460 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:07.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.097+0000 7f85fcbb9640 1 -- 172.21.15.60:0/3842534488 >> 172.21.15.60:0/3842534488 conn(0x7f85f806d0f0 msgr2=0x7f85f806d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:07.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.097+0000 7f85fcbb9640 1 -- 172.21.15.60:0/3842534488 shutdown_connections 2024-09-12T01:43:07.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.097+0000 7f85fcbb9640 1 -- 172.21.15.60:0/3842534488 wait complete. 2024-09-12T01:43:07.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.099+0000 7f85fcbb9640 1 Processor -- start 2024-09-12T01:43:07.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.099+0000 7f85fcbb9640 1 -- start start 2024-09-12T01:43:07.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.099+0000 7f85fcbb9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f80731c0 0x7f85f81551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:07.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.099+0000 7f85fcbb9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f815a050 0x7f85f80c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:07.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.099+0000 7f85fcbb9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f815ffd0 0x7f85f80ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:07.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.099+0000 7f85fcbb9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f85f80cd940 con 0x7f85f815a050 2024-09-12T01:43:07.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.099+0000 7f85fcbb9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f85f80cd660 con 0x7f85f80731c0 2024-09-12T01:43:07.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.099+0000 7f85fcbb9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f85f80cdc20 con 0x7f85f815ffd0 2024-09-12T01:43:07.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.099+0000 7f85f5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f815a050 0x7f85f80c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:07.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85f5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f815a050 0x7f85f80c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33532/0 (socket says 172.21.15.60:33532) 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85f5d9b640 1 -- 172.21.15.60:0/1634410907 learned_addr learned my addr 172.21.15.60:0/1634410907 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85f659c640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f80731c0 0x7f85f81551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85f6d9d640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f815ffd0 0x7f85f80ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85f5d9b640 1 -- 172.21.15.60:0/1634410907 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f815ffd0 msgr2=0x7f85f80ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85f5d9b640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f815ffd0 0x7f85f80ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85f5d9b640 1 -- 172.21.15.60:0/1634410907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f80731c0 msgr2=0x7f85f81551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85f5d9b640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f80731c0 0x7f85f81551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85f5d9b640 1 -- 172.21.15.60:0/1634410907 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f80c7880 con 0x7f85f815a050 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85f659c640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f80731c0 0x7f85f81551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85f5d9b640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f815a050 0x7f85f80c6ea0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f85e000b4a0 tx=0x7f85e000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85eeffd640 1 -- 172.21.15.60:0/1634410907 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0014070 con 0x7f85f815a050 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85eeffd640 1 -- 172.21.15.60:0/1634410907 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e0010610 con 0x7f85f815a050 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85fcbb9640 1 -- 172.21.15.60:0/1634410907 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f80c7b60 con 0x7f85f815a050 2024-09-12T01:43:07.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85eeffd640 1 -- 172.21.15.60:0/1634410907 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0010a00 con 0x7f85f815a050 2024-09-12T01:43:07.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.100+0000 7f85fcbb9640 1 -- 172.21.15.60:0/1634410907 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f8155700 con 0x7f85f815a050 2024-09-12T01:43:07.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.101+0000 7f85fcbb9640 1 -- 172.21.15.60:0/1634410907 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f80b36e0 con 0x7f85f815a050 2024-09-12T01:43:07.103 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.102+0000 7f85eeffd640 1 -- 172.21.15.60:0/1634410907 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f85e0017070 con 0x7f85f815a050 2024-09-12T01:43:07.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.102+0000 7f85eeffd640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f85d806be30 0x7f85d806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:07.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.102+0000 7f85eeffd640 1 -- 172.21.15.60:0/1634410907 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4857+0+0 (secure 0 0 0) 0x7f85e008a520 con 0x7f85f815a050 2024-09-12T01:43:07.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.102+0000 7f85f659c640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f85d806be30 0x7f85d806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:07.104 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.103+0000 7f85f659c640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f85d806be30 0x7f85d806e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f85f0033000 tx=0x7f85f0009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:07.107 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.107+0000 7f85eeffd640 1 -- 172.21.15.60:0/1634410907 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f85e00592b0 con 0x7f85f815a050 2024-09-12T01:43:07.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.283+0000 7f85fcbb9640 1 -- 172.21.15.60:0/1634410907 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f85f80b2730 con 0x7f85f815a050 2024-09-12T01:43:07.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.975+0000 7f85eeffd640 1 -- 172.21.15.60:0/1634410907 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v114) ==== 138+0+0 (secure 0 0 0) 0x7f85e0058bb0 con 0x7f85f815a050 2024-09-12T01:43:07.975 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-12T01:43:07.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.978+0000 7f85fcbb9640 1 -- 172.21.15.60:0/1634410907 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f85d806be30 msgr2=0x7f85d806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:07.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.978+0000 7f85fcbb9640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f85d806be30 0x7f85d806e2f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f85f0033000 tx=0x7f85f0009000 comp rx=0 tx=0).stop 2024-09-12T01:43:07.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.978+0000 7f85fcbb9640 1 -- 172.21.15.60:0/1634410907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f815a050 msgr2=0x7f85f80c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:07.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.978+0000 7f85fcbb9640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f815a050 0x7f85f80c6ea0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f85e000b4a0 tx=0x7f85e000b960 comp rx=0 tx=0).stop 2024-09-12T01:43:07.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.978+0000 7f85fcbb9640 1 -- 172.21.15.60:0/1634410907 shutdown_connections 2024-09-12T01:43:07.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.978+0000 7f85fcbb9640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f85d806be30 0x7f85d806e2f0 secure :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f85f0033000 tx=0x7f85f0009000 comp rx=0 tx=0).stop 2024-09-12T01:43:07.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.978+0000 7f85fcbb9640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f85f815ffd0 0x7f85f80ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:07.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.978+0000 7f85fcbb9640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85f815a050 0x7f85f80c6ea0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:07.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.978+0000 7f85fcbb9640 1 --2- 172.21.15.60:0/1634410907 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f85f80731c0 0x7f85f81551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:07.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.978+0000 7f85fcbb9640 1 -- 172.21.15.60:0/1634410907 >> 172.21.15.60:0/1634410907 conn(0x7f85f806d0f0 msgr2=0x7f85f80d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:07.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.979+0000 7f85fcbb9640 1 -- 172.21.15.60:0/1634410907 shutdown_connections 2024-09-12T01:43:07.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:07.980+0000 7f85fcbb9640 1 -- 172.21.15.60:0/1634410907 wait complete. 2024-09-12T01:43:07.996 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:43:08.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.111+0000 7f027b326640 1 Processor -- start 2024-09-12T01:43:08.112 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.111+0000 7f027b326640 1 -- start start 2024-09-12T01:43:08.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.112+0000 7f027b326640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f027406fe20 0x7f0274073820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.112+0000 7f027b326640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02740741f0 con 0x7f027415e610 2024-09-12T01:43:08.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.112+0000 7f027b326640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f027406bd40 con 0x7f0274073d60 2024-09-12T01:43:08.113 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.112+0000 7f027b326640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f027406c020 con 0x7f027406fe20 2024-09-12T01:43:08.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.112+0000 7f02790c2640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f027415e610 0x7f027406f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51618/0 (socket says 172.21.15.60:51618) 2024-09-12T01:43:08.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.112+0000 7f02790c2640 1 -- 172.21.15.60:0/2371413478 learned_addr learned my addr 172.21.15.60:0/2371413478 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:08.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f02788c1640 1 --2- 172.21.15.60:0/2371413478 >> v2:172.21.15.105:3300/0 conn(0x7f027406fe20 0x7f0274073820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185102266 0 0) 0x7f02740741f0 con 0x7f027415e610 2024-09-12T01:43:08.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f025c003520 con 0x7f027415e610 2024-09-12T01:43:08.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1222298560 0 0) 0x7f025c003520 con 0x7f027415e610 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 >> v2:172.21.15.105:3300/0 conn(0x7f027406fe20 msgr2=0x7f0274073820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 --2- 172.21.15.60:0/2371413478 >> v2:172.21.15.105:3300/0 conn(0x7f027406fe20 0x7f0274073820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 >> v1:172.21.15.105:6789/0 conn(0x7f0274073d60 legacy=0x7f02740ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027406c300 con 0x7f027415e610 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f026c001670 con 0x7f027415e610 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f02788c1640 1 --2- 172.21.15.60:0/2371413478 >> v2:172.21.15.105:3300/0 conn(0x7f027406fe20 0x7f0274073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 >> v1:172.21.15.60:6789/0 conn(0x7f027415e610 legacy=0x7f027406f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 --2- 172.21.15.60:0/2371413478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 0x7f025c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 --2- 172.21.15.60:0/2371413478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f025c004800 0x7f025c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 --2- 172.21.15.60:0/2371413478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f025c0051c0 0x7f025c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f027406c020 con 0x7f025c0039b0 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f025c00c160 con 0x7f025c004800 2024-09-12T01:43:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f025c00c360 con 0x7f025c0051c0 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f02790c2640 1 --2- 172.21.15.60:0/2371413478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 0x7f025c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f02788c1640 1 --2- 172.21.15.60:0/2371413478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f025c004800 0x7f025c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.113+0000 7f02798c3640 1 --2- 172.21.15.60:0/2371413478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f025c0051c0 0x7f025c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.114+0000 7f02790c2640 1 -- 172.21.15.60:0/2371413478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f025c0051c0 msgr2=0x7f025c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.114+0000 7f02790c2640 1 --2- 172.21.15.60:0/2371413478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f025c0051c0 0x7f025c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.114+0000 7f02790c2640 1 -- 172.21.15.60:0/2371413478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f025c004800 msgr2=0x7f025c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.114+0000 7f02790c2640 1 --2- 172.21.15.60:0/2371413478 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f025c004800 0x7f025c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.114+0000 7f02790c2640 1 -- 172.21.15.60:0/2371413478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025c003520 con 0x7f025c0039b0 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.114+0000 7f02798c3640 1 -- 172.21.15.60:0/2371413478 reap_dead start 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.114+0000 7f02790c2640 1 --2- 172.21.15.60:0/2371413478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 0x7f025c003dd0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c240 tx=0x7f025c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48638bb95d475f53 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.114+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c007cf0 con 0x7f025c0039b0 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.115+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026c005af0 con 0x7f025c0039b0 2024-09-12T01:43:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.115+0000 7f0273fff640 1 -- 172.21.15.60:0/2371413478 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c007070 con 0x7f025c0039b0 2024-09-12T01:43:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.115+0000 7f027b326640 1 -- 172.21.15.60:0/2371413478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 msgr2=0x7f025c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.115+0000 7f027b326640 1 --2- 172.21.15.60:0/2371413478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 0x7f025c003dd0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c240 tx=0x7f025c005830 comp rx=0 tx=0).stop 2024-09-12T01:43:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.115+0000 7f027b326640 1 -- 172.21.15.60:0/2371413478 shutdown_connections 2024-09-12T01:43:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.115+0000 7f027b326640 1 --2- 172.21.15.60:0/2371413478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 0x7f025c003dd0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.115+0000 7f027b326640 1 -- 172.21.15.60:0/2371413478 >> 172.21.15.60:0/2371413478 conn(0x7f02740b3070 msgr2=0x7f02740b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.115+0000 7f027b326640 1 -- 172.21.15.60:0/2371413478 shutdown_connections 2024-09-12T01:43:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.115+0000 7f027b326640 1 -- 172.21.15.60:0/2371413478 wait complete. 2024-09-12T01:43:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.116+0000 7f027b326640 1 Processor -- start 2024-09-12T01:43:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.116+0000 7f027b326640 1 -- start start 2024-09-12T01:43:08.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.117+0000 7f027b326640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 0x7f02741499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.117+0000 7f027b326640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f027414c2a0 0x7f027414c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.117+0000 7f027b326640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027414a280 0x7f027414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.117+0000 7f027b326640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0274073820 con 0x7f025c0039b0 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.117+0000 7f027b326640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f027406c8c0 con 0x7f027414c2a0 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.117+0000 7f027b326640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f02740739a0 con 0x7f027414a280 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.117+0000 7f02790c2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 0x7f02741499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.117+0000 7f02790c2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 0x7f02741499a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33542/0 (socket says 172.21.15.60:33542) 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.117+0000 7f02790c2640 1 -- 172.21.15.60:0/2269872539 learned_addr learned my addr 172.21.15.60:0/2269872539 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.117+0000 7f02788c1640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f027414c2a0 0x7f027414c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.117+0000 7f02798c3640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027414a280 0x7f027414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.118+0000 7f02790c2640 1 -- 172.21.15.60:0/2269872539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027414a280 msgr2=0x7f027414a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.118+0000 7f02790c2640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027414a280 0x7f027414a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.118+0000 7f02790c2640 1 -- 172.21.15.60:0/2269872539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f027414c2a0 msgr2=0x7f027414c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.118+0000 7f02790c2640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f027414c2a0 0x7f027414c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.118+0000 7f02790c2640 1 -- 172.21.15.60:0/2269872539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0274149ee0 con 0x7f025c0039b0 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.118+0000 7f02790c2640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 0x7f02741499a0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c240 tx=0x7f027406c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.118+0000 7f0271ffb640 1 -- 172.21.15.60:0/2269872539 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c037040 con 0x7f025c0039b0 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.118+0000 7f0271ffb640 1 -- 172.21.15.60:0/2269872539 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026c041070 con 0x7f025c0039b0 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.118+0000 7f0271ffb640 1 -- 172.21.15.60:0/2269872539 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c001670 con 0x7f025c0039b0 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.118+0000 7f027b326640 1 -- 172.21.15.60:0/2269872539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027414aff0 con 0x7f025c0039b0 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.118+0000 7f027b326640 1 -- 172.21.15.60:0/2269872539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f027414b5b0 con 0x7f025c0039b0 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.119+0000 7f027b326640 1 -- 172.21.15.60:0/2269872539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f027406f710 con 0x7f025c0039b0 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.120+0000 7f0271ffb640 1 -- 172.21.15.60:0/2269872539 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f026c0049e0 con 0x7f025c0039b0 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.121+0000 7f0271ffb640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f026006be60 0x7f026006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.121+0000 7f02788c1640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f026006be60 0x7f026006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.121+0000 7f0271ffb640 1 -- 172.21.15.60:0/2269872539 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5227+0+0 (secure 0 0 0) 0x7f026c0aa8d0 con 0x7f025c0039b0 2024-09-12T01:43:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.121+0000 7f02788c1640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f026006be60 0x7f026006e320 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f027415de80 tx=0x7f0268009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:08.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.125+0000 7f0271ffb640 1 -- 172.21.15.60:0/2269872539 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f026c078df0 con 0x7f025c0039b0 2024-09-12T01:43:08.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.301+0000 7f027b326640 1 -- 172.21.15.60:0/2269872539 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f02740afa70 con 0x7f025c0039b0 2024-09-12T01:43:08.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.980+0000 7f0271ffb640 1 -- 172.21.15.60:0/2269872539 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v115) ==== 170+0+0 (secure 0 0 0) 0x7f026c07d0f0 con 0x7f025c0039b0 2024-09-12T01:43:08.981 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-12T01:43:08.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.984+0000 7f027b326640 1 -- 172.21.15.60:0/2269872539 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f026006be60 msgr2=0x7f026006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:08.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.984+0000 7f027b326640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f026006be60 0x7f026006e320 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f027415de80 tx=0x7f0268009190 comp rx=0 tx=0).stop 2024-09-12T01:43:08.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.984+0000 7f027b326640 1 -- 172.21.15.60:0/2269872539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 msgr2=0x7f02741499a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:08.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.984+0000 7f027b326640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 0x7f02741499a0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c240 tx=0x7f027406c4d0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.984+0000 7f027b326640 1 -- 172.21.15.60:0/2269872539 shutdown_connections 2024-09-12T01:43:08.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.984+0000 7f027b326640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f026006be60 0x7f026006e320 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.984+0000 7f027b326640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f027414a280 0x7f027414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.985+0000 7f027b326640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f027414c2a0 0x7f027414c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.985+0000 7f027b326640 1 --2- 172.21.15.60:0/2269872539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f025c0039b0 0x7f02741499a0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:08.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.985+0000 7f027b326640 1 -- 172.21.15.60:0/2269872539 >> 172.21.15.60:0/2269872539 conn(0x7f02740b3070 msgr2=0x7f02740aebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:08.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.985+0000 7f027b326640 1 -- 172.21.15.60:0/2269872539 shutdown_connections 2024-09-12T01:43:08.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:08.985+0000 7f027b326640 1 -- 172.21.15.60:0/2269872539 wait complete. 2024-09-12T01:43:09.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:43:09.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.122+0000 7f5d7ae27640 1 Processor -- start 2024-09-12T01:43:09.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.122+0000 7f5d7ae27640 1 -- start start 2024-09-12T01:43:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.122+0000 7f5d7ae27640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5d7415b480 0x7f5d740b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.122+0000 7f5d7ae27640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d740b60c0 0x7f5d74071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d7ae27640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d740ccff0 con 0x7f5d74072530 2024-09-12T01:43:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d7ae27640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5d740b6500 con 0x7f5d7415b480 2024-09-12T01:43:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d7ae27640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5d74072970 con 0x7f5d740b60c0 2024-09-12T01:43:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d793c4640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5d74072530 0x7f5d74070fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51624/0 (socket says 172.21.15.60:51624) 2024-09-12T01:43:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d793c4640 1 -- 172.21.15.60:0/293302943 learned_addr learned my addr 172.21.15.60:0/293302943 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d73fff640 1 --2- 172.21.15.60:0/293302943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d740b60c0 0x7f5d74071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d78bc3640 1 --2- 172.21.15.60:0/293302943 >> v2:172.21.15.105:3300/0 conn(0x7f5d7415b480 0x7f5d740b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944431754 0 0) 0x7f5d740ccff0 con 0x7f5d74072530 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d64003520 con 0x7f5d74072530 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3510381466 0 0) 0x7f5d64003520 con 0x7f5d74072530 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d740b60c0 msgr2=0x7f5d74071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 --2- 172.21.15.60:0/293302943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d740b60c0 0x7f5d74071ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 >> v2:172.21.15.105:3300/0 conn(0x7f5d7415b480 msgr2=0x7f5d740b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 --2- 172.21.15.60:0/293302943 >> v2:172.21.15.105:3300/0 conn(0x7f5d7415b480 0x7f5d740b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d740cd2d0 con 0x7f5d74072530 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f5d6c0019f0 con 0x7f5d74072530 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 >> v1:172.21.15.60:6789/0 conn(0x7f5d74072530 legacy=0x7f5d74070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 --2- 172.21.15.60:0/293302943 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d640039b0 0x7f5d64003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 --2- 172.21.15.60:0/293302943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d64004800 0x7f5d64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 --2- 172.21.15.60:0/293302943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d740b60c0 0x7f5d640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5d740b6500 con 0x7f5d64004800 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5d74072970 con 0x7f5d640039b0 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5d6400b9f0 con 0x7f5d740b60c0 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.123+0000 7f5d73fff640 1 --2- 172.21.15.60:0/293302943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d64004800 0x7f5d64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.124+0000 7f5d78bc3640 1 --2- 172.21.15.60:0/293302943 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d640039b0 0x7f5d64003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.124+0000 7f5d793c4640 1 --2- 172.21.15.60:0/293302943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d740b60c0 0x7f5d640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.124+0000 7f5d73fff640 1 -- 172.21.15.60:0/293302943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d740b60c0 msgr2=0x7f5d640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.124+0000 7f5d73fff640 1 --2- 172.21.15.60:0/293302943 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d740b60c0 0x7f5d640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.124+0000 7f5d73fff640 1 -- 172.21.15.60:0/293302943 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d640039b0 msgr2=0x7f5d64003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.124+0000 7f5d73fff640 1 --2- 172.21.15.60:0/293302943 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d640039b0 0x7f5d64003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.124+0000 7f5d73fff640 1 -- 172.21.15.60:0/293302943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d64003520 con 0x7f5d64004800 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.124+0000 7f5d73fff640 1 --2- 172.21.15.60:0/293302943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d64004800 0x7f5d64004c80 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f5d60009ac0 tx=0x7f5d64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bce5a1621bfec2e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.125+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d60036070 con 0x7f5d64004800 2024-09-12T01:43:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.125+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d60031400 con 0x7f5d64004800 2024-09-12T01:43:09.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.125+0000 7f5d737fe640 1 -- 172.21.15.60:0/293302943 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d60009690 con 0x7f5d64004800 2024-09-12T01:43:09.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.125+0000 7f5d7ae27640 1 -- 172.21.15.60:0/293302943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d64004800 msgr2=0x7f5d64004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.125+0000 7f5d7ae27640 1 --2- 172.21.15.60:0/293302943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d64004800 0x7f5d64004c80 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f5d60009ac0 tx=0x7f5d64005830 comp rx=0 tx=0).stop 2024-09-12T01:43:09.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.125+0000 7f5d793c4640 1 -- 172.21.15.60:0/293302943 reap_dead start 2024-09-12T01:43:09.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.125+0000 7f5d7ae27640 1 -- 172.21.15.60:0/293302943 shutdown_connections 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.125+0000 7f5d7ae27640 1 -- 172.21.15.60:0/293302943 >> 172.21.15.60:0/293302943 conn(0x7f5d7406d0f0 msgr2=0x7f5d7406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.125+0000 7f5d7ae27640 1 -- 172.21.15.60:0/293302943 shutdown_connections 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.125+0000 7f5d7ae27640 1 -- 172.21.15.60:0/293302943 wait complete. 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.126+0000 7f5d7ae27640 1 Processor -- start 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.127+0000 7f5d7ae27640 1 -- start start 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.127+0000 7f5d7ae27640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d64004800 0x7f5d74140f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.127+0000 7f5d7ae27640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7415e5e0 0x7f5d74144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.127+0000 7f5d7ae27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d7415ea60 0x7f5d741450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.127+0000 7f5d7ae27640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5d740cdb70 con 0x7f5d7415e5e0 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.127+0000 7f5d7ae27640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5d740cd890 con 0x7f5d7415ea60 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.127+0000 7f5d7ae27640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5d7415b860 con 0x7f5d64004800 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.127+0000 7f5d73fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7415e5e0 0x7f5d74144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d73fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7415e5e0 0x7f5d74144b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33556/0 (socket says 172.21.15.60:33556) 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d73fff640 1 -- 172.21.15.60:0/4274912263 learned_addr learned my addr 172.21.15.60:0/4274912263 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d78bc3640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d64004800 0x7f5d74140f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d793c4640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d7415ea60 0x7f5d741450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d73fff640 1 -- 172.21.15.60:0/4274912263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d64004800 msgr2=0x7f5d74140f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d73fff640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d64004800 0x7f5d74140f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d73fff640 1 -- 172.21.15.60:0/4274912263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d7415ea60 msgr2=0x7f5d741450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d73fff640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d7415ea60 0x7f5d741450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d73fff640 1 -- 172.21.15.60:0/4274912263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d74146b40 con 0x7f5d7415e5e0 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d73fff640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7415e5e0 0x7f5d74144b60 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f5d60034040 tx=0x7f5d60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d717fa640 1 -- 172.21.15.60:0/4274912263 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d60040020 con 0x7f5d7415e5e0 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d717fa640 1 -- 172.21.15.60:0/4274912263 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d60003b40 con 0x7f5d7415e5e0 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d717fa640 1 -- 172.21.15.60:0/4274912263 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d60036040 con 0x7f5d7415e5e0 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d7ae27640 1 -- 172.21.15.60:0/4274912263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d74146e20 con 0x7f5d7415e5e0 2024-09-12T01:43:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.128+0000 7f5d7ae27640 1 -- 172.21.15.60:0/4274912263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d741458c0 con 0x7f5d7415e5e0 2024-09-12T01:43:09.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.129+0000 7f5d7ae27640 1 -- 172.21.15.60:0/4274912263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7415bb60 con 0x7f5d7415e5e0 2024-09-12T01:43:09.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.130+0000 7f5d717fa640 1 -- 172.21.15.60:0/4274912263 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5d60043020 con 0x7f5d7415e5e0 2024-09-12T01:43:09.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.130+0000 7f5d717fa640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5d5806be60 0x7f5d5806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:09.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.131+0000 7f5d78bc3640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5d5806be60 0x7f5d5806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:09.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.131+0000 7f5d717fa640 1 -- 172.21.15.60:0/4274912263 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5609+0+0 (secure 0 0 0) 0x7f5d600aad10 con 0x7f5d7415e5e0 2024-09-12T01:43:09.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.131+0000 7f5d78bc3640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5d5806be60 0x7f5d5806e320 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5d740ccb90 tx=0x7f5d68009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:09.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.135+0000 7f5d717fa640 1 -- 172.21.15.60:0/4274912263 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5d6004a070 con 0x7f5d7415e5e0 2024-09-12T01:43:09.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.346+0000 7f5d7ae27640 1 -- 172.21.15.60:0/4274912263 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5d740b5b80 con 0x7f5d7415e5e0 2024-09-12T01:43:09.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.982+0000 7f5d717fa640 1 -- 172.21.15.60:0/4274912263 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v67) ==== 174+0+0 (secure 0 0 0) 0x7f5d600044e0 con 0x7f5d7415e5e0 2024-09-12T01:43:09.983 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 18 and data pool 19 2024-09-12T01:43:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.986+0000 7f5d7ae27640 1 -- 172.21.15.60:0/4274912263 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5d5806be60 msgr2=0x7f5d5806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.986+0000 7f5d7ae27640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5d5806be60 0x7f5d5806e320 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5d740ccb90 tx=0x7f5d68009190 comp rx=0 tx=0).stop 2024-09-12T01:43:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.986+0000 7f5d7ae27640 1 -- 172.21.15.60:0/4274912263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7415e5e0 msgr2=0x7f5d74144b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.986+0000 7f5d7ae27640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7415e5e0 0x7f5d74144b60 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f5d60034040 tx=0x7f5d60004730 comp rx=0 tx=0).stop 2024-09-12T01:43:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.987+0000 7f5d7ae27640 1 -- 172.21.15.60:0/4274912263 shutdown_connections 2024-09-12T01:43:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.987+0000 7f5d7ae27640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5d7415ea60 0x7f5d741450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.987+0000 7f5d7ae27640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d7415e5e0 0x7f5d74144b60 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.987+0000 7f5d7ae27640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5d5806be60 0x7f5d5806e320 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.987+0000 7f5d7ae27640 1 --2- 172.21.15.60:0/4274912263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5d64004800 0x7f5d74140f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.987+0000 7f5d7ae27640 1 -- 172.21.15.60:0/4274912263 >> 172.21.15.60:0/4274912263 conn(0x7f5d7406d0f0 msgr2=0x7f5d740ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.987+0000 7f5d7ae27640 1 -- 172.21.15.60:0/4274912263 shutdown_connections 2024-09-12T01:43:09.989 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:09.987+0000 7f5d7ae27640 1 -- 172.21.15.60:0/4274912263 wait complete. 2024-09-12T01:43:10.022 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:43:10.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.128+0000 7f9d81fd8640 1 Processor -- start 2024-09-12T01:43:10.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.128+0000 7f9d81fd8640 1 -- start start 2024-09-12T01:43:10.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d81fd8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9d7c0b6260 0x7f9d7c0b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d81fd8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7c0d27e0 0x7f9d7c0d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d81fd8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d7c06c0e0 0x7f9d7c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d81fd8640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9d7c0b8020 con 0x7f9d7c06c0e0 2024-09-12T01:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d81fd8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9d7c0b7d20 con 0x7f9d7c0b6260 2024-09-12T01:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d81fd8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7c0b6b80 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d7bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d7c06c0e0 0x7f9d7c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d7bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9d7c06c0e0 0x7f9d7c06c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33570/0 (socket says 172.21.15.60:33570) 2024-09-12T01:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d7bfff640 1 -- 172.21.15.60:0/364109844 learned_addr learned my addr 172.21.15.60:0/364109844 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d7b7fe640 1 --2- 172.21.15.60:0/364109844 >> v2:172.21.15.105:3300/0 conn(0x7f9d7c0b6260 0x7f9d7c0b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d72ffd640 1 --2- 172.21.15.60:0/364109844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7c0d27e0 0x7f9d7c0d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d7bfff640 1 -- 172.21.15.60:0/364109844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7c0d27e0 msgr2=0x7f9d7c0d2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d7bfff640 1 --2- 172.21.15.60:0/364109844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7c0d27e0 0x7f9d7c0d2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d7bfff640 1 -- 172.21.15.60:0/364109844 >> v2:172.21.15.105:3300/0 conn(0x7f9d7c0b6260 msgr2=0x7f9d7c0b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d7bfff640 1 --2- 172.21.15.60:0/364109844 >> v2:172.21.15.105:3300/0 conn(0x7f9d7c0b6260 0x7f9d7c0b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.129+0000 7f9d7bfff640 1 -- 172.21.15.60:0/364109844 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c0d3560 con 0x7f9d7c06c0e0 2024-09-12T01:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.130+0000 7f9d7bfff640 1 --2- 172.21.15.60:0/364109844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7c06c0e0 0x7f9d7c06c570 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c06d1b0 tx=0x7f9d7402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70496e17889194b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.130+0000 7f9d7affd640 1 -- 172.21.15.60:0/364109844 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74036070 con 0x7f9d7c06c0e0 2024-09-12T01:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.130+0000 7f9d7affd640 1 -- 172.21.15.60:0/364109844 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d74031600 con 0x7f9d7c06c0e0 2024-09-12T01:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.130+0000 7f9d7affd640 1 -- 172.21.15.60:0/364109844 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d740319d0 con 0x7f9d7c06c0e0 2024-09-12T01:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.131+0000 7f9d81fd8640 1 -- 172.21.15.60:0/364109844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7c06c0e0 msgr2=0x7f9d7c06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.131+0000 7f9d81fd8640 1 --2- 172.21.15.60:0/364109844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7c06c0e0 0x7f9d7c06c570 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c06d1b0 tx=0x7f9d7402a6a0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.131+0000 7f9d81fd8640 1 -- 172.21.15.60:0/364109844 shutdown_connections 2024-09-12T01:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.131+0000 7f9d81fd8640 1 --2- 172.21.15.60:0/364109844 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7c06c0e0 0x7f9d7c06c570 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.131+0000 7f9d81fd8640 1 --2- 172.21.15.60:0/364109844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7c0d27e0 0x7f9d7c0d2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.131+0000 7f9d81fd8640 1 --2- 172.21.15.60:0/364109844 >> v2:172.21.15.105:3300/0 conn(0x7f9d7c0b6260 0x7f9d7c0b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.131+0000 7f9d81fd8640 1 -- 172.21.15.60:0/364109844 >> 172.21.15.60:0/364109844 conn(0x7f9d7c062c60 msgr2=0x7f9d7c0d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:10.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.131+0000 7f9d81fd8640 1 -- 172.21.15.60:0/364109844 shutdown_connections 2024-09-12T01:43:10.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.131+0000 7f9d81fd8640 1 -- 172.21.15.60:0/364109844 wait complete. 2024-09-12T01:43:10.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.132+0000 7f9d81fd8640 1 Processor -- start 2024-09-12T01:43:10.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.132+0000 7f9d81fd8640 1 -- start start 2024-09-12T01:43:10.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d81fd8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7c06c0e0 0x7f9d7c154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d81fd8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d7c0b6260 0x7f9d7c160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d81fd8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7c0d27e0 0x7f9d7c1e8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d81fd8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0d3180 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d81fd8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9d7c0d3b20 con 0x7f9d7c0b6260 2024-09-12T01:43:10.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d81fd8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9d7c0d3300 con 0x7f9d7c06c0e0 2024-09-12T01:43:10.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d7bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7c0d27e0 0x7f9d7c1e8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d7bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7c0d27e0 0x7f9d7c1e8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33576/0 (socket says 172.21.15.60:33576) 2024-09-12T01:43:10.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d7bfff640 1 -- 172.21.15.60:0/804841504 learned_addr learned my addr 172.21.15.60:0/804841504 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:10.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d72ffd640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d7c0b6260 0x7f9d7c160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d7b7fe640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7c06c0e0 0x7f9d7c154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d7bfff640 1 -- 172.21.15.60:0/804841504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7c06c0e0 msgr2=0x7f9d7c154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d7bfff640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7c06c0e0 0x7f9d7c154600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d7bfff640 1 -- 172.21.15.60:0/804841504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d7c0b6260 msgr2=0x7f9d7c160b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d7bfff640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d7c0b6260 0x7f9d7c160b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d7bfff640 1 -- 172.21.15.60:0/804841504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7c1f7fa0 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.133+0000 7f9d7bfff640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7c0d27e0 0x7f9d7c1e8fd0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f9d74034040 tx=0x7f9d74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.134+0000 7f9d78ff9640 1 -- 172.21.15.60:0/804841504 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74036050 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.134+0000 7f9d78ff9640 1 -- 172.21.15.60:0/804841504 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d74042070 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.134+0000 7f9d81fd8640 1 -- 172.21.15.60:0/804841504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7c1f8280 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.134+0000 7f9d78ff9640 1 -- 172.21.15.60:0/804841504 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d74009510 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.134+0000 7f9d81fd8640 1 -- 172.21.15.60:0/804841504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d7c1f8840 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.135+0000 7f9d81fd8640 1 -- 172.21.15.60:0/804841504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d7c0cf620 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.135+0000 7f9d78ff9640 1 -- 172.21.15.60:0/804841504 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9d74007bd0 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.136+0000 7f9d78ff9640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9d5c06be60 0x7f9d5c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.136+0000 7f9d78ff9640 1 -- 172.21.15.60:0/804841504 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f9d740abcc0 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.136+0000 7f9d7b7fe640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9d5c06be60 0x7f9d5c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.136+0000 7f9d7b7fe640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9d5c06be60 0x7f9d5c06e320 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c006fd0 tx=0x7f9d6c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.140+0000 7f9d78ff9640 1 -- 172.21.15.60:0/804841504 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9d740b2080 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.317+0000 7f9d81fd8640 1 -- 172.21.15.60:0/804841504 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9d7c15e070 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.318+0000 7f9d78ff9640 1 -- 172.21.15.60:0/804841504 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16664 (secure 0 0 0) 0x7f9d7407a660 con 0x7f9d7c0d27e0 2024-09-12T01:43:10.319 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:10.319 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":116,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:43:09.348041+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:43:07.315366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-12T01:43:08.333340+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:43:10.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.320+0000 7f9d81fd8640 1 -- 172.21.15.60:0/804841504 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9d5c06be60 msgr2=0x7f9d5c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.320+0000 7f9d81fd8640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9d5c06be60 0x7f9d5c06e320 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c006fd0 tx=0x7f9d6c008040 comp rx=0 tx=0).stop 2024-09-12T01:43:10.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.320+0000 7f9d81fd8640 1 -- 172.21.15.60:0/804841504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7c0d27e0 msgr2=0x7f9d7c1e8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.320+0000 7f9d81fd8640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7c0d27e0 0x7f9d7c1e8fd0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f9d74034040 tx=0x7f9d74004a40 comp rx=0 tx=0).stop 2024-09-12T01:43:10.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.320+0000 7f9d81fd8640 1 -- 172.21.15.60:0/804841504 shutdown_connections 2024-09-12T01:43:10.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.320+0000 7f9d81fd8640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7c0d27e0 0x7f9d7c1e8fd0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.320+0000 7f9d81fd8640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9d7c0b6260 0x7f9d7c160b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.320+0000 7f9d81fd8640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9d5c06be60 0x7f9d5c06e320 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.320+0000 7f9d81fd8640 1 --2- 172.21.15.60:0/804841504 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9d7c06c0e0 0x7f9d7c154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.320+0000 7f9d81fd8640 1 -- 172.21.15.60:0/804841504 >> 172.21.15.60:0/804841504 conn(0x7f9d7c062c60 msgr2=0x7f9d7c0ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:10.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.320+0000 7f9d81fd8640 1 -- 172.21.15.60:0/804841504 shutdown_connections 2024-09-12T01:43:10.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.320+0000 7f9d81fd8640 1 -- 172.21.15.60:0/804841504 wait complete. 2024-09-12T01:43:10.332 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:43:10.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.433+0000 7fd5ef0ed640 1 Processor -- start 2024-09-12T01:43:10.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.433+0000 7fd5ef0ed640 1 -- start start 2024-09-12T01:43:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.434+0000 7fd5ef0ed640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd5e815c2b0 0x7fd5e80b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.434+0000 7fd5ef0ed640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5e80b72f0 0x7fd5e815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.434+0000 7fd5ef0ed640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e815fb10 con 0x7fd5e815f030 2024-09-12T01:43:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.434+0000 7fd5ef0ed640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e80b5900 con 0x7fd5e815c2b0 2024-09-12T01:43:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.434+0000 7fd5ef0ed640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e815f830 con 0x7fd5e80b72f0 2024-09-12T01:43:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.434+0000 7fd5ece89640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd5e815c2b0 0x7fd5e80b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.434+0000 7fd5ece89640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd5e815c2b0 0x7fd5e80b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33588/0 (socket says 172.21.15.60:33588) 2024-09-12T01:43:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.434+0000 7fd5ed68a640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd5e815f030 0x7fd5e806f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51632/0 (socket says 172.21.15.60:51632) 2024-09-12T01:43:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.434+0000 7fd5ece89640 1 -- 172.21.15.60:0/935058020 learned_addr learned my addr 172.21.15.60:0/935058020 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.434+0000 7fd5e7fff640 1 --2- 172.21.15.60:0/935058020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5e80b72f0 0x7fd5e815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.435+0000 7fd5ece89640 1 -- 172.21.15.60:0/935058020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5e80b72f0 msgr2=0x7fd5e815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.435+0000 7fd5ece89640 1 --2- 172.21.15.60:0/935058020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5e80b72f0 0x7fd5e815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.435+0000 7fd5ece89640 1 -- 172.21.15.60:0/935058020 >> v1:172.21.15.60:6789/0 conn(0x7fd5e815f030 legacy=0x7fd5e806f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.435+0000 7fd5ece89640 1 -- 172.21.15.60:0/935058020 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e806ce30 con 0x7fd5e815c2b0 2024-09-12T01:43:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.435+0000 7fd5e77fe640 1 -- 172.21.15.60:0/935058020 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756727886 0 0) 0x7fd5e815fb10 con 0x7fd5e815f030 2024-09-12T01:43:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.435+0000 7fd5ece89640 1 --2- 172.21.15.60:0/935058020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5e815c2b0 0x7fd5e80b6db0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009e50 tx=0x7fd5e002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c66483a6cc1550 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.436+0000 7fd5e77fe640 1 -- 172.21.15.60:0/935058020 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0036070 con 0x7fd5e815c2b0 2024-09-12T01:43:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.436+0000 7fd5e77fe640 1 -- 172.21.15.60:0/935058020 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e0031600 con 0x7fd5e815c2b0 2024-09-12T01:43:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.436+0000 7fd5e77fe640 1 -- 172.21.15.60:0/935058020 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00319d0 con 0x7fd5e815c2b0 2024-09-12T01:43:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.436+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/935058020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5e815c2b0 msgr2=0x7fd5e80b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.436+0000 7fd5ef0ed640 1 --2- 172.21.15.60:0/935058020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5e815c2b0 0x7fd5e80b6db0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009e50 tx=0x7fd5e002a710 comp rx=0 tx=0).stop 2024-09-12T01:43:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.436+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/935058020 shutdown_connections 2024-09-12T01:43:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.436+0000 7fd5ef0ed640 1 --2- 172.21.15.60:0/935058020 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5e80b72f0 0x7fd5e815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.436+0000 7fd5ef0ed640 1 --2- 172.21.15.60:0/935058020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5e815c2b0 0x7fd5e80b6db0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.436+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/935058020 >> 172.21.15.60:0/935058020 conn(0x7fd5e80b4240 msgr2=0x7fd5e80b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.436+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/935058020 shutdown_connections 2024-09-12T01:43:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.436+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/935058020 wait complete. 2024-09-12T01:43:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.437+0000 7fd5ef0ed640 1 Processor -- start 2024-09-12T01:43:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.437+0000 7fd5ef0ed640 1 -- start start 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.438+0000 7fd5ef0ed640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5e80b72f0 0x7fd5e81f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.438+0000 7fd5ef0ed640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5e815c2b0 0x7fd5e81539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.438+0000 7fd5ef0ed640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e815f030 0x7fd5e81f4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.438+0000 7fd5ef0ed640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e80b7730 con 0x7fd5e815c2b0 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.438+0000 7fd5ef0ed640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e806d3f0 con 0x7fd5e815f030 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.438+0000 7fd5ef0ed640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e815f4c0 con 0x7fd5e80b72f0 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.438+0000 7fd5e7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5e815c2b0 0x7fd5e81539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.438+0000 7fd5e7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5e815c2b0 0x7fd5e81539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33596/0 (socket says 172.21.15.60:33596) 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.438+0000 7fd5e7fff640 1 -- 172.21.15.60:0/2017599315 learned_addr learned my addr 172.21.15.60:0/2017599315 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5ed68a640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e815f030 0x7fd5e81f4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5ece89640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5e80b72f0 0x7fd5e81f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5e7fff640 1 -- 172.21.15.60:0/2017599315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5e80b72f0 msgr2=0x7fd5e81f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5e7fff640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5e80b72f0 0x7fd5e81f4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5e7fff640 1 -- 172.21.15.60:0/2017599315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e815f030 msgr2=0x7fd5e81f4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5e7fff640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e815f030 0x7fd5e81f4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5e7fff640 1 -- 172.21.15.60:0/2017599315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e8154c80 con 0x7fd5e815c2b0 2024-09-12T01:43:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5e7fff640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5e815c2b0 0x7fd5e81539b0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00e9b0 tx=0x7fd5dc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5e57fa640 1 -- 172.21.15.60:0/2017599315 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc017070 con 0x7fd5e815c2b0 2024-09-12T01:43:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5e57fa640 1 -- 172.21.15.60:0/2017599315 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5dc00c9a0 con 0x7fd5e815c2b0 2024-09-12T01:43:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5e57fa640 1 -- 172.21.15.60:0/2017599315 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc00cd90 con 0x7fd5e815c2b0 2024-09-12T01:43:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/2017599315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e8154100 con 0x7fd5e815c2b0 2024-09-12T01:43:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.439+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/2017599315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e81546c0 con 0x7fd5e815c2b0 2024-09-12T01:43:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.440+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/2017599315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e815eaf0 con 0x7fd5e815c2b0 2024-09-12T01:43:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.441+0000 7fd5e57fa640 1 -- 172.21.15.60:0/2017599315 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd5dc01a070 con 0x7fd5e815c2b0 2024-09-12T01:43:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.441+0000 7fd5e57fa640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd5d406be30 0x7fd5d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.441+0000 7fd5e57fa640 1 -- 172.21.15.60:0/2017599315 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7fd5dc08ae00 con 0x7fd5e815c2b0 2024-09-12T01:43:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.441+0000 7fd5ece89640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd5d406be30 0x7fd5d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.442+0000 7fd5ece89640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd5d406be30 0x7fd5d406e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0033000 tx=0x7fd5e0009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.446+0000 7fd5e57fa640 1 -- 172.21.15.60:0/2017599315 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd5dc059840 con 0x7fd5e815c2b0 2024-09-12T01:43:10.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.620+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/2017599315 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5e80b3fb0 con 0x7fd5e815c2b0 2024-09-12T01:43:10.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.621+0000 7fd5e57fa640 1 -- 172.21.15.60:0/2017599315 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16664 (secure 0 0 0) 0x7fd5dc059140 con 0x7fd5e815c2b0 2024-09-12T01:43:10.622 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:10.622 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":116,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:43:09.348041+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:43:07.315366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-12T01:43:08.333340+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:43:10.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.623+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/2017599315 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd5d406be30 msgr2=0x7fd5d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.623+0000 7fd5ef0ed640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd5d406be30 0x7fd5d406e2f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0033000 tx=0x7fd5e0009000 comp rx=0 tx=0).stop 2024-09-12T01:43:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.623+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/2017599315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5e815c2b0 msgr2=0x7fd5e81539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.623+0000 7fd5ef0ed640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5e815c2b0 0x7fd5e81539b0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00e9b0 tx=0x7fd5dc00ee70 comp rx=0 tx=0).stop 2024-09-12T01:43:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.624+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/2017599315 shutdown_connections 2024-09-12T01:43:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.624+0000 7fd5ef0ed640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd5e815f030 0x7fd5e81f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.624+0000 7fd5ef0ed640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5e815c2b0 0x7fd5e81539b0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.624+0000 7fd5ef0ed640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd5d406be30 0x7fd5d406e2f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.624+0000 7fd5ef0ed640 1 --2- 172.21.15.60:0/2017599315 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd5e80b72f0 0x7fd5e81f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.624+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/2017599315 >> 172.21.15.60:0/2017599315 conn(0x7fd5e80b4240 msgr2=0x7fd5e8160520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.624+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/2017599315 shutdown_connections 2024-09-12T01:43:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.624+0000 7fd5ef0ed640 1 -- 172.21.15.60:0/2017599315 wait complete. 2024-09-12T01:43:10.635 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:43:10.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.741+0000 7f581652c640 1 Processor -- start 2024-09-12T01:43:10.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.741+0000 7f581652c640 1 -- start start 2024-09-12T01:43:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.742+0000 7f581652c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f581015e750 0x7f58100cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.742+0000 7f581652c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f58100cfb70 0x7f58100b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.742+0000 7f581652c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58100b6e00 con 0x7f58100b69e0 2024-09-12T01:43:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.742+0000 7f581652c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f58100d43c0 con 0x7f581015e750 2024-09-12T01:43:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.742+0000 7f581652c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f58100d33b0 con 0x7f58100cfb70 2024-09-12T01:43:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.742+0000 7f580ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f581015e750 0x7f58100cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.742+0000 7f580ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f581015e750 0x7f58100cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33610/0 (socket says 172.21.15.60:33610) 2024-09-12T01:43:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.742+0000 7f580ffff640 1 -- 172.21.15.60:0/2933611927 learned_addr learned my addr 172.21.15.60:0/2933611927 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.742+0000 7f580ffff640 1 -- 172.21.15.60:0/2933611927 >> v2:172.21.15.105:3300/0 conn(0x7f58100cfb70 msgr2=0x7f58100b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:10.748 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.742+0000 7f580f7fe640 1 --2- 172.21.15.60:0/2933611927 >> v2:172.21.15.105:3300/0 conn(0x7f58100cfb70 0x7f58100b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.742+0000 7f580ffff640 1 --2- 172.21.15.60:0/2933611927 >> v2:172.21.15.105:3300/0 conn(0x7f58100cfb70 0x7f58100b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.742+0000 7f580ffff640 1 -- 172.21.15.60:0/2933611927 >> v1:172.21.15.105:6789/0 conn(0x7f58100b69e0 legacy=0x7f581006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.743+0000 7f580ffff640 1 -- 172.21.15.60:0/2933611927 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58100b7790 con 0x7f581015e750 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.743+0000 7f580f7fe640 1 --2- 172.21.15.60:0/2933611927 >> v2:172.21.15.105:3300/0 conn(0x7f58100cfb70 0x7f58100b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.743+0000 7f580ffff640 1 --2- 172.21.15.60:0/2933611927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f581015e750 0x7f58100cf630 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f5810162220 tx=0x7f580002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8407437e61a54f64 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.743+0000 7f580effd640 1 -- 172.21.15.60:0/2933611927 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800037070 con 0x7f581015e750 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.743+0000 7f580effd640 1 -- 172.21.15.60:0/2933611927 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5800032440 con 0x7f581015e750 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.743+0000 7f580effd640 1 -- 172.21.15.60:0/2933611927 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800032810 con 0x7f581015e750 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.744+0000 7f581652c640 1 -- 172.21.15.60:0/2933611927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f581015e750 msgr2=0x7f58100cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.744+0000 7f581652c640 1 --2- 172.21.15.60:0/2933611927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f581015e750 0x7f58100cf630 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f5810162220 tx=0x7f580002a230 comp rx=0 tx=0).stop 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.744+0000 7f581652c640 1 -- 172.21.15.60:0/2933611927 shutdown_connections 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.744+0000 7f581652c640 1 --2- 172.21.15.60:0/2933611927 >> v2:172.21.15.105:3300/0 conn(0x7f58100cfb70 0x7f58100b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.744+0000 7f581652c640 1 --2- 172.21.15.60:0/2933611927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f581015e750 0x7f58100cf630 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.744+0000 7f581652c640 1 -- 172.21.15.60:0/2933611927 >> 172.21.15.60:0/2933611927 conn(0x7f58100d1500 msgr2=0x7f58100d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.744+0000 7f581652c640 1 -- 172.21.15.60:0/2933611927 shutdown_connections 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.744+0000 7f581652c640 1 -- 172.21.15.60:0/2933611927 wait complete. 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.745+0000 7f581652c640 1 Processor -- start 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.745+0000 7f581652c640 1 -- start start 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.746+0000 7f581652c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58100b69e0 0x7f58101f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.746+0000 7f581652c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58100cfb70 0x7f5810157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.746+0000 7f581652c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f581015e750 0x7f58100cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.746+0000 7f581652c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f58100d38e0 con 0x7f581015e750 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.746+0000 7f581652c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f58100b7ac0 con 0x7f58100cfb70 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.746+0000 7f581652c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f58100d3bc0 con 0x7f58100b69e0 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.746+0000 7f5814ac9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f581015e750 0x7f58100cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.746+0000 7f5814ac9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f581015e750 0x7f58100cdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33624/0 (socket says 172.21.15.60:33624) 2024-09-12T01:43:10.750 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.746+0000 7f5814ac9640 1 -- 172.21.15.60:0/3845234435 learned_addr learned my addr 172.21.15.60:0/3845234435 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f580ffff640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58100b69e0 0x7f58101f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f580f7fe640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58100cfb70 0x7f5810157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f5814ac9640 1 -- 172.21.15.60:0/3845234435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58100b69e0 msgr2=0x7f58101f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f5814ac9640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58100b69e0 0x7f58101f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f5814ac9640 1 -- 172.21.15.60:0/3845234435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58100cfb70 msgr2=0x7f5810157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f5814ac9640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58100cfb70 0x7f5810157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f5814ac9640 1 -- 172.21.15.60:0/3845234435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f581015b870 con 0x7f581015e750 2024-09-12T01:43:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f5814ac9640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f581015e750 0x7f58100cdd70 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f580800c780 tx=0x7f580800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f580cff9640 1 -- 172.21.15.60:0/3845234435 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5808004b60 con 0x7f581015e750 2024-09-12T01:43:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f580cff9640 1 -- 172.21.15.60:0/3845234435 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5808004d00 con 0x7f581015e750 2024-09-12T01:43:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f580cff9640 1 -- 172.21.15.60:0/3845234435 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f580800aa90 con 0x7f581015e750 2024-09-12T01:43:10.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f581652c640 1 -- 172.21.15.60:0/3845234435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58101e3a50 con 0x7f581015e750 2024-09-12T01:43:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.747+0000 7f581652c640 1 -- 172.21.15.60:0/3845234435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58101e3fd0 con 0x7f581015e750 2024-09-12T01:43:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.748+0000 7f581652c640 1 -- 172.21.15.60:0/3845234435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f581015eb30 con 0x7f581015e750 2024-09-12T01:43:10.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.749+0000 7f580cff9640 1 -- 172.21.15.60:0/3845234435 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f580800ac30 con 0x7f581015e750 2024-09-12T01:43:10.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.749+0000 7f580cff9640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f57fc06be30 0x7f57fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:10.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.749+0000 7f580cff9640 1 -- 172.21.15.60:0/3845234435 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5709+0+0 (secure 0 0 0) 0x7f580808af70 con 0x7f581015e750 2024-09-12T01:43:10.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.749+0000 7f580ffff640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f57fc06be30 0x7f57fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:10.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.750+0000 7f580ffff640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f57fc06be30 0x7f57fc06e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5800034000 tx=0x7f580002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:10.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.754+0000 7f580cff9640 1 -- 172.21.15.60:0/3845234435 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5808020070 con 0x7f581015e750 2024-09-12T01:43:10.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.967+0000 7f581652c640 1 -- 172.21.15.60:0/3845234435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f58100b5650 con 0x7f581015e750 2024-09-12T01:43:10.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:10.996+0000 7f580cff9640 1 -- 172.21.15.60:0/3845234435 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v68) ==== 118+0+0 (secure 0 0 0) 0x7f58080592d0 con 0x7f581015e750 2024-09-12T01:43:11.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.000+0000 7f581652c640 1 -- 172.21.15.60:0/3845234435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f57fc06be30 msgr2=0x7f57fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:11.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.000+0000 7f581652c640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f57fc06be30 0x7f57fc06e2f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5800034000 tx=0x7f580002e000 comp rx=0 tx=0).stop 2024-09-12T01:43:11.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.000+0000 7f581652c640 1 -- 172.21.15.60:0/3845234435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f581015e750 msgr2=0x7f58100cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:11.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.000+0000 7f581652c640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f581015e750 0x7f58100cdd70 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f580800c780 tx=0x7f580800cc40 comp rx=0 tx=0).stop 2024-09-12T01:43:11.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.000+0000 7f581652c640 1 -- 172.21.15.60:0/3845234435 shutdown_connections 2024-09-12T01:43:11.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.000+0000 7f581652c640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f581015e750 0x7f58100cdd70 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.000+0000 7f581652c640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58100cfb70 0x7f5810157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.000+0000 7f581652c640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f57fc06be30 0x7f57fc06e2f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.000+0000 7f581652c640 1 --2- 172.21.15.60:0/3845234435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58100b69e0 0x7f58101f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.000+0000 7f581652c640 1 -- 172.21.15.60:0/3845234435 >> 172.21.15.60:0/3845234435 conn(0x7f58100d1500 msgr2=0x7f581006bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:11.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.000+0000 7f581652c640 1 -- 172.21.15.60:0/3845234435 shutdown_connections 2024-09-12T01:43:11.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.000+0000 7f581652c640 1 -- 172.21.15.60:0/3845234435 wait complete. 2024-09-12T01:43:11.011 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:43:11.011 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:43:11.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.115+0000 7f42c26a5640 1 Processor -- start 2024-09-12T01:43:11.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.116+0000 7f42c26a5640 1 -- start start 2024-09-12T01:43:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.116+0000 7f42c26a5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42bc15ad10 0x7f42bc0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.116+0000 7f42c26a5640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc071720 con 0x7f42bc0cca40 2024-09-12T01:43:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.116+0000 7f42c26a5640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc15f530 con 0x7f42bc0cc360 2024-09-12T01:43:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.116+0000 7f42c26a5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f42bc070fb0 con 0x7f42bc15ad10 2024-09-12T01:43:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42bb7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f42bc0cca40 0x7f42bc15e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51648/0 (socket says 172.21.15.60:51648) 2024-09-12T01:43:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42bb7fe640 1 -- 172.21.15.60:0/563854866 learned_addr learned my addr 172.21.15.60:0/563854866 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42bbfff640 1 --2- 172.21.15.60:0/563854866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42bc15ad10 0x7f42bc0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:11.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2085455033 0 0) 0x7f42bc071720 con 0x7f42bc0cca40 2024-09-12T01:43:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a4003520 con 0x7f42bc0cca40 2024-09-12T01:43:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3014333111 0 0) 0x7f42a4003520 con 0x7f42bc0cca40 2024-09-12T01:43:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42bc15ad10 msgr2=0x7f42bc0719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 --2- 172.21.15.60:0/563854866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42bc15ad10 0x7f42bc0719c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 >> v1:172.21.15.105:6789/0 conn(0x7f42bc0cc360 legacy=0x7f42bc15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc073920 con 0x7f42bc0cca40 2024-09-12T01:43:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f42b0001670 con 0x7f42bc0cca40 2024-09-12T01:43:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 >> v1:172.21.15.60:6789/0 conn(0x7f42bc0cca40 legacy=0x7f42bc15e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 --2- 172.21.15.60:0/563854866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42a40039e0 0x7f42a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:11.121 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 --2- 172.21.15.60:0/563854866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a4004800 0x7f42a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 --2- 172.21.15.60:0/563854866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42bc15ad10 0x7f42a4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc070fb0 con 0x7f42a4004800 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42a400dd00 con 0x7f42a40039e0 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f42a400df00 con 0x7f42bc15ad10 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42bb7fe640 1 --2- 172.21.15.60:0/563854866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a4004800 0x7f42a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42bbfff640 1 --2- 172.21.15.60:0/563854866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42a40039e0 0x7f42a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.117+0000 7f42c0c42640 1 --2- 172.21.15.60:0/563854866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42bc15ad10 0x7f42a4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.118+0000 7f42bb7fe640 1 -- 172.21.15.60:0/563854866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42bc15ad10 msgr2=0x7f42a4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.118+0000 7f42bb7fe640 1 --2- 172.21.15.60:0/563854866 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42bc15ad10 0x7f42a4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.118+0000 7f42bb7fe640 1 -- 172.21.15.60:0/563854866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42a40039e0 msgr2=0x7f42a4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.118+0000 7f42bb7fe640 1 --2- 172.21.15.60:0/563854866 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42a40039e0 0x7f42a4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.118+0000 7f42bb7fe640 1 -- 172.21.15.60:0/563854866 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a4003520 con 0x7f42a4004800 2024-09-12T01:43:11.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.118+0000 7f42bb7fe640 1 --2- 172.21.15.60:0/563854866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a4004800 0x7f42a4004c80 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f42bc070b50 tx=0x7f42a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05144604d7e8b91 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.119+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0007d30 con 0x7f42a4004800 2024-09-12T01:43:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.119+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b00058d0 con 0x7f42a4004800 2024-09-12T01:43:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.119+0000 7f42baffd640 1 -- 172.21.15.60:0/563854866 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b0005ce0 con 0x7f42a4004800 2024-09-12T01:43:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.119+0000 7f42c26a5640 1 -- 172.21.15.60:0/563854866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a4004800 msgr2=0x7f42a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:11.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.119+0000 7f42c26a5640 1 --2- 172.21.15.60:0/563854866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a4004800 0x7f42a4004c80 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f42bc070b50 tx=0x7f42a4005830 comp rx=0 tx=0).stop 2024-09-12T01:43:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.119+0000 7f42c0c42640 1 -- 172.21.15.60:0/563854866 reap_dead start 2024-09-12T01:43:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.119+0000 7f42c26a5640 1 -- 172.21.15.60:0/563854866 shutdown_connections 2024-09-12T01:43:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.119+0000 7f42c26a5640 1 -- 172.21.15.60:0/563854866 >> 172.21.15.60:0/563854866 conn(0x7f42bc06d0f0 msgr2=0x7f42bc06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.119+0000 7f42c26a5640 1 -- 172.21.15.60:0/563854866 shutdown_connections 2024-09-12T01:43:11.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.119+0000 7f42c26a5640 1 -- 172.21.15.60:0/563854866 wait complete. 2024-09-12T01:43:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.120+0000 7f42c26a5640 1 Processor -- start 2024-09-12T01:43:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.121+0000 7f42c26a5640 1 -- start start 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.121+0000 7f42c26a5640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a4004800 0x7f42bc14e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.121+0000 7f42c26a5640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42bc152d80 0x7f42bc15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.121+0000 7f42c26a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42bc15d0f0 0x7f42bc0d0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.121+0000 7f42c26a5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc071200 con 0x7f42bc15d0f0 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.121+0000 7f42c26a5640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42bc073ee0 con 0x7f42bc152d80 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.121+0000 7f42c26a5640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f42bc0b4eb0 con 0x7f42a4004800 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.121+0000 7f42c0c42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42bc15d0f0 0x7f42bc0d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.121+0000 7f42c0c42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42bc15d0f0 0x7f42bc0d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33652/0 (socket says 172.21.15.60:33652) 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42c0c42640 1 -- 172.21.15.60:0/250595836 learned_addr learned my addr 172.21.15.60:0/250595836 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42bb7fe640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42bc152d80 0x7f42bc15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42bbfff640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a4004800 0x7f42bc14e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42c0c42640 1 -- 172.21.15.60:0/250595836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a4004800 msgr2=0x7f42bc14e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42c0c42640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a4004800 0x7f42bc14e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42c0c42640 1 -- 172.21.15.60:0/250595836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42bc152d80 msgr2=0x7f42bc15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42c0c42640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42bc152d80 0x7f42bc15cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42c0c42640 1 -- 172.21.15.60:0/250595836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc0d1100 con 0x7f42bc15d0f0 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42bb7fe640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42bc152d80 0x7f42bc15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42bbfff640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a4004800 0x7f42bc14e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42c0c42640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42bc15d0f0 0x7f42bc0d0480 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0cc7d0 tx=0x7f42b400fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42b8ff9640 1 -- 172.21.15.60:0/250595836 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b401a070 con 0x7f42bc15d0f0 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42b8ff9640 1 -- 172.21.15.60:0/250595836 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42b4006d60 con 0x7f42bc15d0f0 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42b8ff9640 1 -- 172.21.15.60:0/250595836 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4003b90 con 0x7f42bc15d0f0 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42c26a5640 1 -- 172.21.15.60:0/250595836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42bc1522a0 con 0x7f42bc15d0f0 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.122+0000 7f42c26a5640 1 -- 172.21.15.60:0/250595836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42bc152860 con 0x7f42bc15d0f0 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.123+0000 7f42c26a5640 1 -- 172.21.15.60:0/250595836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42bc1587a0 con 0x7f42bc15d0f0 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.124+0000 7f42b8ff9640 1 -- 172.21.15.60:0/250595836 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f42b401d070 con 0x7f42bc15d0f0 2024-09-12T01:43:11.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.124+0000 7f42b8ff9640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f42a806be30 0x7f42a806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:11.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.124+0000 7f42b8ff9640 1 -- 172.21.15.60:0/250595836 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f42b408a4a0 con 0x7f42bc15d0f0 2024-09-12T01:43:11.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.124+0000 7f42bbfff640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f42a806be30 0x7f42a806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:11.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.125+0000 7f42bbfff640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f42a806be30 0x7f42a806e2f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009bc0 tx=0x7f42ac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:11.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.128+0000 7f42b8ff9640 1 -- 172.21.15.60:0/250595836 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42b4058e50 con 0x7f42bc15d0f0 2024-09-12T01:43:11.343 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:11.343+0000 7f42c26a5640 1 -- 172.21.15.60:0/250595836 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f42bc0720e0 con 0x7f42bc15d0f0 2024-09-12T01:43:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.002+0000 7f42b8ff9640 1 -- 172.21.15.60:0/250595836 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v69) ==== 122+0+0 (secure 0 0 0) 0x7f42b4058750 con 0x7f42bc15d0f0 2024-09-12T01:43:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.005+0000 7f42c26a5640 1 -- 172.21.15.60:0/250595836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f42a806be30 msgr2=0x7f42a806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.005+0000 7f42c26a5640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f42a806be30 0x7f42a806e2f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009bc0 tx=0x7f42ac008040 comp rx=0 tx=0).stop 2024-09-12T01:43:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.005+0000 7f42c26a5640 1 -- 172.21.15.60:0/250595836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42bc15d0f0 msgr2=0x7f42bc0d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.005+0000 7f42c26a5640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42bc15d0f0 0x7f42bc0d0480 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0cc7d0 tx=0x7f42b400fd40 comp rx=0 tx=0).stop 2024-09-12T01:43:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.005+0000 7f42c26a5640 1 -- 172.21.15.60:0/250595836 shutdown_connections 2024-09-12T01:43:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.005+0000 7f42c26a5640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42bc15d0f0 0x7f42bc0d0480 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.005+0000 7f42c26a5640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42bc152d80 0x7f42bc15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.005+0000 7f42c26a5640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f42a806be30 0x7f42a806e2f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.005+0000 7f42c26a5640 1 --2- 172.21.15.60:0/250595836 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42a4004800 0x7f42bc14e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.005+0000 7f42c26a5640 1 -- 172.21.15.60:0/250595836 >> 172.21.15.60:0/250595836 conn(0x7f42bc06d0f0 msgr2=0x7f42bc158090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:12.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.005+0000 7f42c26a5640 1 -- 172.21.15.60:0/250595836 shutdown_connections 2024-09-12T01:43:12.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.005+0000 7f42c26a5640 1 -- 172.21.15.60:0/250595836 wait complete. 2024-09-12T01:43:12.019 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:43:12.020 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:43:12.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.128+0000 7f4fdcc5c640 1 Processor -- start 2024-09-12T01:43:12.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.128+0000 7f4fdcc5c640 1 -- start start 2024-09-12T01:43:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fdcc5c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4fd80b6260 0x7f4fd80b6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fdcc5c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4fd80b84b0 0x7f4fd80b8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fdcc5c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd80b7d20 con 0x7f4fd80d27e0 2024-09-12T01:43:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fdcc5c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd80b8020 con 0x7f4fd80b84b0 2024-09-12T01:43:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fdcc5c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd80b6b80 con 0x7f4fd80b6260 2024-09-12T01:43:12.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fd6d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4fd80b84b0 0x7f4fd80b8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fd5d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4fd80d27e0 0x7f4fd80d2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51652/0 (socket says 172.21.15.60:51652) 2024-09-12T01:43:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fd6d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4fd80b84b0 0x7f4fd80b8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33660/0 (socket says 172.21.15.60:33660) 2024-09-12T01:43:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fd5d9b640 1 -- 172.21.15.60:0/4120201148 learned_addr learned my addr 172.21.15.60:0/4120201148 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fd659c640 1 --2- 172.21.15.60:0/4120201148 >> v2:172.21.15.105:3300/0 conn(0x7f4fd80b6260 0x7f4fd80b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fd6d9d640 1 -- 172.21.15.60:0/4120201148 >> v2:172.21.15.105:3300/0 conn(0x7f4fd80b6260 msgr2=0x7f4fd80b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fd6d9d640 1 --2- 172.21.15.60:0/4120201148 >> v2:172.21.15.105:3300/0 conn(0x7f4fd80b6260 0x7f4fd80b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fd6d9d640 1 -- 172.21.15.60:0/4120201148 >> v1:172.21.15.60:6789/0 conn(0x7f4fd80d27e0 legacy=0x7f4fd80d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fd559a640 1 -- 172.21.15.60:0/4120201148 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96560889 0 0) 0x7f4fd80b7d20 con 0x7f4fd80d27e0 2024-09-12T01:43:12.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.129+0000 7f4fd6d9d640 1 -- 172.21.15.60:0/4120201148 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd80d3560 con 0x7f4fd80b84b0 2024-09-12T01:43:12.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.130+0000 7f4fd6d9d640 1 --2- 172.21.15.60:0/4120201148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80b84b0 0x7f4fd80b8940 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009d90 tx=0x7f4fd002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a8843bc8624cd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.130+0000 7f4fd559a640 1 -- 172.21.15.60:0/4120201148 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0007740 con 0x7f4fd80b84b0 2024-09-12T01:43:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.130+0000 7f4fd559a640 1 -- 172.21.15.60:0/4120201148 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fd00078e0 con 0x7f4fd80b84b0 2024-09-12T01:43:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.130+0000 7f4fd559a640 1 -- 172.21.15.60:0/4120201148 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0007cb0 con 0x7f4fd80b84b0 2024-09-12T01:43:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.131+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/4120201148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80b84b0 msgr2=0x7f4fd80b8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.131+0000 7f4fdcc5c640 1 --2- 172.21.15.60:0/4120201148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80b84b0 0x7f4fd80b8940 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009d90 tx=0x7f4fd002a6a0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.131+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/4120201148 shutdown_connections 2024-09-12T01:43:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.131+0000 7f4fdcc5c640 1 --2- 172.21.15.60:0/4120201148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80b84b0 0x7f4fd80b8940 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.131+0000 7f4fdcc5c640 1 --2- 172.21.15.60:0/4120201148 >> v2:172.21.15.105:3300/0 conn(0x7f4fd80b6260 0x7f4fd80b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.131+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/4120201148 >> 172.21.15.60:0/4120201148 conn(0x7f4fd8062c60 msgr2=0x7f4fd80d1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.131+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/4120201148 shutdown_connections 2024-09-12T01:43:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.131+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/4120201148 wait complete. 2024-09-12T01:43:12.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.132+0000 7f4fdcc5c640 1 Processor -- start 2024-09-12T01:43:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.132+0000 7f4fdcc5c640 1 -- start start 2024-09-12T01:43:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.133+0000 7f4fdcc5c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd80b6260 0x7f4fd81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.133+0000 7f4fdcc5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80b84b0 0x7f4fd80cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.133+0000 7f4fdcc5c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fd80d27e0 0x7f4fd815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.133+0000 7f4fdcc5c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd815eb60 con 0x7f4fd80b84b0 2024-09-12T01:43:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.133+0000 7f4fdcc5c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd80d3b20 con 0x7f4fd80d27e0 2024-09-12T01:43:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.133+0000 7f4fdcc5c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd815ece0 con 0x7f4fd80b6260 2024-09-12T01:43:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.133+0000 7f4fd5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80b84b0 0x7f4fd80cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.133+0000 7f4fd5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80b84b0 0x7f4fd80cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33662/0 (socket says 172.21.15.60:33662) 2024-09-12T01:43:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.133+0000 7f4fd5d9b640 1 -- 172.21.15.60:0/452903479 learned_addr learned my addr 172.21.15.60:0/452903479 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.133+0000 7f4fd6d9d640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fd80d27e0 0x7f4fd815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.133+0000 7f4fd659c640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd80b6260 0x7f4fd81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fd5d9b640 1 -- 172.21.15.60:0/452903479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd80b6260 msgr2=0x7f4fd81525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fd5d9b640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd80b6260 0x7f4fd81525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fd5d9b640 1 -- 172.21.15.60:0/452903479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fd80d27e0 msgr2=0x7f4fd815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fd5d9b640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fd80d27e0 0x7f4fd815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fd5d9b640 1 -- 172.21.15.60:0/452903479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd81e7150 con 0x7f4fd80b84b0 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fd659c640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd80b6260 0x7f4fd81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fd6d9d640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fd80d27e0 0x7f4fd815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fd5d9b640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80b84b0 0x7f4fd80cdc20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00c430 tx=0x7f4fcc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fc6ffd640 1 -- 172.21.15.60:0/452903479 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc0074e0 con 0x7f4fd80b84b0 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fc6ffd640 1 -- 172.21.15.60:0/452903479 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fcc0047e0 con 0x7f4fd80b84b0 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fc6ffd640 1 -- 172.21.15.60:0/452903479 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc004bd0 con 0x7f4fd80b84b0 2024-09-12T01:43:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/452903479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd81e7430 con 0x7f4fd80b84b0 2024-09-12T01:43:12.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.134+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/452903479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd80cbdb0 con 0x7f4fd80b84b0 2024-09-12T01:43:12.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.135+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/452903479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd8156390 con 0x7f4fd80b84b0 2024-09-12T01:43:12.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.135+0000 7f4fc6ffd640 1 -- 172.21.15.60:0/452903479 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4fcc011070 con 0x7f4fd80b84b0 2024-09-12T01:43:12.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.136+0000 7f4fc6ffd640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fb806be30 0x7f4fb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.136+0000 7f4fc6ffd640 1 -- 172.21.15.60:0/452903479 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f4fcc08ab00 con 0x7f4fd80b84b0 2024-09-12T01:43:12.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.136+0000 7f4fd659c640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fb806be30 0x7f4fb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.136+0000 7f4fd659c640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fb806be30 0x7f4fb806e2f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8006fd0 tx=0x7f4fc8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:12.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.140+0000 7f4fc6ffd640 1 -- 172.21.15.60:0/452903479 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4fcc0594b0 con 0x7f4fd80b84b0 2024-09-12T01:43:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.350+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/452903479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fd80b6640 con 0x7f4fd80b84b0 2024-09-12T01:43:12.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.351+0000 7f4fc6ffd640 1 -- 172.21.15.60:0/452903479 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7f4fcc058db0 con 0x7f4fd80b84b0 2024-09-12T01:43:12.352 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:12.352 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":69,"btime":"2024-09-12T01:43:11:998781+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2206957364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2206957364},{"type":"v1","addr":"172.21.15.105:6835","nonce":2206957364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7536,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3802062072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3802062072},{"type":"v1","addr":"172.21.15.60:6836","nonce":3802062072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3557949323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3557949323},{"type":"v1","addr":"172.21.15.60:6837","nonce":3557949323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:09.348346+0000","modified":"2024-09-12T01:43:11.345257+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/3613656777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3613656777},{"type":"v1","addr":"172.21.15.105:6834","nonce":3613656777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":9}]} 2024-09-12T01:43:12.352 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 69 2024-09-12T01:43:12.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.353+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/452903479 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fb806be30 msgr2=0x7f4fb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.353+0000 7f4fdcc5c640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fb806be30 0x7f4fb806e2f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8006fd0 tx=0x7f4fc8008040 comp rx=0 tx=0).stop 2024-09-12T01:43:12.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.353+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/452903479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80b84b0 msgr2=0x7f4fd80cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.353+0000 7f4fdcc5c640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80b84b0 0x7f4fd80cdc20 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00c430 tx=0x7f4fcc00c8f0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.353+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/452903479 shutdown_connections 2024-09-12T01:43:12.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.353+0000 7f4fdcc5c640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4fd80d27e0 0x7f4fd815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.353+0000 7f4fdcc5c640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd80b84b0 0x7f4fd80cdc20 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.353+0000 7f4fdcc5c640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4fb806be30 0x7f4fb806e2f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.353+0000 7f4fdcc5c640 1 --2- 172.21.15.60:0/452903479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4fd80b6260 0x7f4fd81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.353+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/452903479 >> 172.21.15.60:0/452903479 conn(0x7f4fd8062c60 msgr2=0x7f4fd80ce550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:12.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.353+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/452903479 shutdown_connections 2024-09-12T01:43:12.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.353+0000 7f4fdcc5c640 1 -- 172.21.15.60:0/452903479 wait complete. 2024-09-12T01:43:12.365 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:43:12.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.466+0000 7f4831fb7640 1 Processor -- start 2024-09-12T01:43:12.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.466+0000 7f4831fb7640 1 -- start start 2024-09-12T01:43:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.467+0000 7f4831fb7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f482c0b7290 0x7f482c169240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.467+0000 7f4831fb7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f482c0708d0 con 0x7f482c0b6eb0 2024-09-12T01:43:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.467+0000 7f4831fb7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f482c070bb0 con 0x7f482c0d1b40 2024-09-12T01:43:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.467+0000 7f4831fb7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f482c070e90 con 0x7f482c0b7290 2024-09-12T01:43:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.467+0000 7f482bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f482c0b7290 0x7f482c169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.467+0000 7f482b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f482c0b6eb0 0x7f482c06fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51664/0 (socket says 172.21.15.60:51664) 2024-09-12T01:43:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.467+0000 7f482b7fe640 1 -- 172.21.15.60:0/3236531941 learned_addr learned my addr 172.21.15.60:0/3236531941 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.467+0000 7f482bfff640 1 -- 172.21.15.60:0/3236531941 >> v1:172.21.15.105:6789/0 conn(0x7f482c0d1b40 legacy=0x7f482c1618a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:12.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.467+0000 7f482bfff640 1 -- 172.21.15.60:0/3236531941 >> v1:172.21.15.60:6789/0 conn(0x7f482c0b6eb0 legacy=0x7f482c06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.468+0000 7f482bfff640 1 -- 172.21.15.60:0/3236531941 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482c071170 con 0x7f482c0b7290 2024-09-12T01:43:12.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.467+0000 7f482a7fc640 1 -- 172.21.15.60:0/3236531941 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1429227008 0 0) 0x7f482c0708d0 con 0x7f482c0b6eb0 2024-09-12T01:43:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.468+0000 7f482bfff640 1 --2- 172.21.15.60:0/3236531941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f482c0b7290 0x7f482c169240 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f4824009d90 tx=0x7f482402a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2cfa5167186147 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.468+0000 7f482a7fc640 1 -- 172.21.15.60:0/3236531941 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4824007740 con 0x7f482c0b7290 2024-09-12T01:43:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.468+0000 7f482a7fc640 1 -- 172.21.15.60:0/3236531941 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48240078e0 con 0x7f482c0b7290 2024-09-12T01:43:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.468+0000 7f482a7fc640 1 -- 172.21.15.60:0/3236531941 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4824007cb0 con 0x7f482c0b7290 2024-09-12T01:43:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.469+0000 7f4831fb7640 1 -- 172.21.15.60:0/3236531941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f482c0b7290 msgr2=0x7f482c169240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.469+0000 7f4831fb7640 1 --2- 172.21.15.60:0/3236531941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f482c0b7290 0x7f482c169240 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f4824009d90 tx=0x7f482402a580 comp rx=0 tx=0).stop 2024-09-12T01:43:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.469+0000 7f4831fb7640 1 -- 172.21.15.60:0/3236531941 shutdown_connections 2024-09-12T01:43:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.469+0000 7f4831fb7640 1 --2- 172.21.15.60:0/3236531941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f482c0b7290 0x7f482c169240 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.469+0000 7f4831fb7640 1 -- 172.21.15.60:0/3236531941 >> 172.21.15.60:0/3236531941 conn(0x7f482c0d2450 msgr2=0x7f482c0d2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.469+0000 7f4831fb7640 1 -- 172.21.15.60:0/3236531941 shutdown_connections 2024-09-12T01:43:12.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.469+0000 7f4831fb7640 1 -- 172.21.15.60:0/3236531941 wait complete. 2024-09-12T01:43:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.470+0000 7f4831fb7640 1 Processor -- start 2024-09-12T01:43:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.470+0000 7f4831fb7640 1 -- start start 2024-09-12T01:43:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.471+0000 7f4831fb7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f482c0b6eb0 0x7f482c158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.471+0000 7f4831fb7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f482c0b7290 0x7f482c147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.471+0000 7f4831fb7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f482c0d1b40 0x7f482c148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.471+0000 7f4831fb7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f482c071af0 con 0x7f482c0d1b40 2024-09-12T01:43:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.471+0000 7f4831fb7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f482c071970 con 0x7f482c0b7290 2024-09-12T01:43:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.471+0000 7f4831fb7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f482c169780 con 0x7f482c0b6eb0 2024-09-12T01:43:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.471+0000 7f482bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f482c0d1b40 0x7f482c148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.471+0000 7f482bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f482c0d1b40 0x7f482c148450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33680/0 (socket says 172.21.15.60:33680) 2024-09-12T01:43:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.471+0000 7f482bfff640 1 -- 172.21.15.60:0/1636732000 learned_addr learned my addr 172.21.15.60:0/1636732000 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.471+0000 7f482b7fe640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f482c0b6eb0 0x7f482c158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.471+0000 7f482affd640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f482c0b7290 0x7f482c147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.472+0000 7f482bfff640 1 -- 172.21.15.60:0/1636732000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f482c0b6eb0 msgr2=0x7f482c158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.474 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.472+0000 7f482bfff640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f482c0b6eb0 0x7f482c158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.472+0000 7f482bfff640 1 -- 172.21.15.60:0/1636732000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f482c0b7290 msgr2=0x7f482c147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.472+0000 7f482bfff640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f482c0b7290 0x7f482c147f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.472+0000 7f482bfff640 1 -- 172.21.15.60:0/1636732000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482c159110 con 0x7f482c0d1b40 2024-09-12T01:43:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.472+0000 7f482bfff640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f482c0d1b40 0x7f482c148450 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f4824009eb0 tx=0x7f4824004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.472+0000 7f4813fff640 1 -- 172.21.15.60:0/1636732000 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4824040070 con 0x7f482c0d1b40 2024-09-12T01:43:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.472+0000 7f4813fff640 1 -- 172.21.15.60:0/1636732000 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4824031c90 con 0x7f482c0d1b40 2024-09-12T01:43:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.472+0000 7f4831fb7640 1 -- 172.21.15.60:0/1636732000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f482c1593f0 con 0x7f482c0d1b40 2024-09-12T01:43:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.472+0000 7f4813fff640 1 -- 172.21.15.60:0/1636732000 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4824045680 con 0x7f482c0d1b40 2024-09-12T01:43:12.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.472+0000 7f4831fb7640 1 -- 172.21.15.60:0/1636732000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f482c144b30 con 0x7f482c0d1b40 2024-09-12T01:43:12.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.473+0000 7f4831fb7640 1 -- 172.21.15.60:0/1636732000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f482c159910 con 0x7f482c0d1b40 2024-09-12T01:43:12.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.473+0000 7f4813fff640 1 -- 172.21.15.60:0/1636732000 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4824039040 con 0x7f482c0d1b40 2024-09-12T01:43:12.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.474+0000 7f4813fff640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f481806be30 0x7f481806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.474+0000 7f4813fff640 1 -- 172.21.15.60:0/1636732000 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f48240ac7a0 con 0x7f482c0d1b40 2024-09-12T01:43:12.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.474+0000 7f482b7fe640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f481806be30 0x7f481806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.474+0000 7f482b7fe640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f481806be30 0x7f481806e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f481c007fd0 tx=0x7f481c007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:12.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.478+0000 7f4813fff640 1 -- 172.21.15.60:0/1636732000 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f482c159910 con 0x7f482c0d1b40 2024-09-12T01:43:12.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.654+0000 7f4831fb7640 1 -- 172.21.15.60:0/1636732000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f482c06fd00 con 0x7f482c0d1b40 2024-09-12T01:43:12.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.655+0000 7f4813fff640 1 -- 172.21.15.60:0/1636732000 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16651 (secure 0 0 0) 0x7f482407ab40 con 0x7f482c0d1b40 2024-09-12T01:43:12.656 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:12.656 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":117,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:43:10.992951+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:43:07.315366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-12T01:43:08.333340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:43:12.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.657+0000 7f4831fb7640 1 -- 172.21.15.60:0/1636732000 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f481806be30 msgr2=0x7f481806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.657+0000 7f4831fb7640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f481806be30 0x7f481806e2f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f481c007fd0 tx=0x7f481c007de0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.657+0000 7f4831fb7640 1 -- 172.21.15.60:0/1636732000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f482c0d1b40 msgr2=0x7f482c148450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.657+0000 7f4831fb7640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f482c0d1b40 0x7f482c148450 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f4824009eb0 tx=0x7f4824004a40 comp rx=0 tx=0).stop 2024-09-12T01:43:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.657+0000 7f4831fb7640 1 -- 172.21.15.60:0/1636732000 shutdown_connections 2024-09-12T01:43:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.657+0000 7f4831fb7640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f482c0d1b40 0x7f482c148450 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.657+0000 7f4831fb7640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f482c0b7290 0x7f482c147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.657+0000 7f4831fb7640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f481806be30 0x7f481806e2f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.657+0000 7f4831fb7640 1 --2- 172.21.15.60:0/1636732000 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f482c0b6eb0 0x7f482c158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.657+0000 7f4831fb7640 1 -- 172.21.15.60:0/1636732000 >> 172.21.15.60:0/1636732000 conn(0x7f482c0d2450 msgr2=0x7f482c162910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.657+0000 7f4831fb7640 1 -- 172.21.15.60:0/1636732000 shutdown_connections 2024-09-12T01:43:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.657+0000 7f4831fb7640 1 -- 172.21.15.60:0/1636732000 wait complete. 2024-09-12T01:43:12.669 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:43:12.669 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:43:12.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.770+0000 7f7eedea6640 1 Processor -- start 2024-09-12T01:43:12.771 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.770+0000 7f7eedea6640 1 -- start start 2024-09-12T01:43:12.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.771+0000 7f7eedea6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7ee815e950 0x7f7ee806ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.771+0000 7f7eedea6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ee8072050 0x7f7ee806d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.771+0000 7f7eedea6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ee806faf0 con 0x7f7ee80735b0 2024-09-12T01:43:12.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.771+0000 7f7eedea6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7ee806fdd0 con 0x7f7ee815e950 2024-09-12T01:43:12.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.771+0000 7f7eedea6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee80700b0 con 0x7f7ee8072050 2024-09-12T01:43:12.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.771+0000 7f7ee77fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7ee815e950 0x7f7ee806ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.771+0000 7f7edeffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7ee80735b0 0x7f7ee806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50272/0 (socket says 172.21.15.60:50272) 2024-09-12T01:43:12.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.771+0000 7f7edeffd640 1 -- 172.21.15.60:0/681641180 learned_addr learned my addr 172.21.15.60:0/681641180 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:12.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.772+0000 7f7ee77fe640 1 -- 172.21.15.60:0/681641180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ee8072050 msgr2=0x7f7ee806d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:12.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.772+0000 7f7ee77fe640 1 --2- 172.21.15.60:0/681641180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ee8072050 0x7f7ee806d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.772+0000 7f7ee77fe640 1 -- 172.21.15.60:0/681641180 >> v1:172.21.15.60:6789/0 conn(0x7f7ee80735b0 legacy=0x7f7ee806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.772+0000 7f7ee77fe640 1 -- 172.21.15.60:0/681641180 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee8070390 con 0x7f7ee815e950 2024-09-12T01:43:12.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.772+0000 7f7ee6ffd640 1 -- 172.21.15.60:0/681641180 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959298242 0 0) 0x7f7ee806faf0 con 0x7f7ee80735b0 2024-09-12T01:43:12.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.772+0000 7f7ee77fe640 1 --2- 172.21.15.60:0/681641180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ee815e950 0x7f7ee806ce30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80097a0 tx=0x7f7ed802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d95b5148933d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:12.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.773+0000 7f7ee6ffd640 1 -- 172.21.15.60:0/681641180 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8037070 con 0x7f7ee815e950 2024-09-12T01:43:12.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.773+0000 7f7ee6ffd640 1 -- 172.21.15.60:0/681641180 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed8032440 con 0x7f7ee815e950 2024-09-12T01:43:12.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.773+0000 7f7ee6ffd640 1 -- 172.21.15.60:0/681641180 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed8032810 con 0x7f7ee815e950 2024-09-12T01:43:12.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.773+0000 7f7eedea6640 1 -- 172.21.15.60:0/681641180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ee815e950 msgr2=0x7f7ee806ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.773+0000 7f7eedea6640 1 --2- 172.21.15.60:0/681641180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ee815e950 0x7f7ee806ce30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80097a0 tx=0x7f7ed802a180 comp rx=0 tx=0).stop 2024-09-12T01:43:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.773+0000 7f7eedea6640 1 -- 172.21.15.60:0/681641180 shutdown_connections 2024-09-12T01:43:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.773+0000 7f7eedea6640 1 --2- 172.21.15.60:0/681641180 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ee8072050 0x7f7ee806d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.773+0000 7f7eedea6640 1 --2- 172.21.15.60:0/681641180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ee815e950 0x7f7ee806ce30 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.773+0000 7f7eedea6640 1 -- 172.21.15.60:0/681641180 >> 172.21.15.60:0/681641180 conn(0x7f7ee80d14d0 msgr2=0x7f7ee80d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:12.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.773+0000 7f7eedea6640 1 -- 172.21.15.60:0/681641180 shutdown_connections 2024-09-12T01:43:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.773+0000 7f7eedea6640 1 -- 172.21.15.60:0/681641180 wait complete. 2024-09-12T01:43:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.774+0000 7f7eedea6640 1 Processor -- start 2024-09-12T01:43:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.775+0000 7f7eedea6640 1 -- start start 2024-09-12T01:43:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.775+0000 7f7eedea6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ee8072050 0x7f7ee8157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.775+0000 7f7eedea6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ee80735b0 0x7f7ee815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.775+0000 7f7eedea6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ee815e950 0x7f7ee814ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.775+0000 7f7eedea6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee80d0230 con 0x7f7ee815e950 2024-09-12T01:43:12.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.775+0000 7f7eedea6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee80d00b0 con 0x7f7ee8072050 2024-09-12T01:43:12.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.775+0000 7f7eedea6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee80d03b0 con 0x7f7ee80735b0 2024-09-12T01:43:12.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.775+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ee815e950 0x7f7ee814ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.775+0000 7f7ee7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ee815e950 0x7f7ee814ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53342/0 (socket says 172.21.15.60:53342) 2024-09-12T01:43:12.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.775+0000 7f7ee7fff640 1 -- 172.21.15.60:0/3510823828 learned_addr learned my addr 172.21.15.60:0/3510823828 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:12.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7edeffd640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ee80735b0 0x7f7ee815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7ee77fe640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ee8072050 0x7f7ee8157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7ee7fff640 1 -- 172.21.15.60:0/3510823828 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ee80735b0 msgr2=0x7f7ee815a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7ee7fff640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ee80735b0 0x7f7ee815a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7ee7fff640 1 -- 172.21.15.60:0/3510823828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ee8072050 msgr2=0x7f7ee8157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7ee7fff640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ee8072050 0x7f7ee8157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7ee7fff640 1 -- 172.21.15.60:0/3510823828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee81557f0 con 0x7f7ee815e950 2024-09-12T01:43:12.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7edeffd640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ee80735b0 0x7f7ee815a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:12.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7ee7fff640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ee815e950 0x7f7ee814ad10 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000b9a0 tx=0x7f7ee000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:12.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7ee4ff9640 1 -- 172.21.15.60:0/3510823828 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0019070 con 0x7f7ee815e950 2024-09-12T01:43:12.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7ee4ff9640 1 -- 172.21.15.60:0/3510823828 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee000cbc0 con 0x7f7ee815e950 2024-09-12T01:43:12.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7ee4ff9640 1 -- 172.21.15.60:0/3510823828 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0014440 con 0x7f7ee815e950 2024-09-12T01:43:12.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7eedea6640 1 -- 172.21.15.60:0/3510823828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee8155ad0 con 0x7f7ee815e950 2024-09-12T01:43:12.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.776+0000 7f7eedea6640 1 -- 172.21.15.60:0/3510823828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee8156370 con 0x7f7ee815e950 2024-09-12T01:43:12.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.777+0000 7f7eedea6640 1 -- 172.21.15.60:0/3510823828 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ee806ce30 con 0x7f7ee815e950 2024-09-12T01:43:12.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.778+0000 7f7ee4ff9640 1 -- 172.21.15.60:0/3510823828 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7ee001c070 con 0x7f7ee815e950 2024-09-12T01:43:12.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.778+0000 7f7ee4ff9640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ec806be30 0x7f7ec806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:12.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.778+0000 7f7ee4ff9640 1 -- 172.21.15.60:0/3510823828 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f7ee008aaf0 con 0x7f7ee815e950 2024-09-12T01:43:12.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.778+0000 7f7ee77fe640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ec806be30 0x7f7ec806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:12.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.779+0000 7f7ee77fe640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ec806be30 0x7f7ec806e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8034000 tx=0x7f7ed802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:12.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.782+0000 7f7ee4ff9640 1 -- 172.21.15.60:0/3510823828 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7ee0059530 con 0x7f7ee815e950 2024-09-12T01:43:12.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.956+0000 7f7eedea6640 1 -- 172.21.15.60:0/3510823828 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7ee8156540 con 0x7f7ec806be30 2024-09-12T01:43:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.962+0000 7f7ee4ff9640 1 -- 172.21.15.60:0/3510823828 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250202 (secure 0 0 0) 0x7f7ee8156540 con 0x7f7ec806be30 2024-09-12T01:43:12.965 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:12.966 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:43:12.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.964+0000 7f7eedea6640 1 -- 172.21.15.60:0/3510823828 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ec806be30 msgr2=0x7f7ec806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.964+0000 7f7eedea6640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ec806be30 0x7f7ec806e2f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8034000 tx=0x7f7ed802e000 comp rx=0 tx=0).stop 2024-09-12T01:43:12.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.964+0000 7f7eedea6640 1 -- 172.21.15.60:0/3510823828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ee815e950 msgr2=0x7f7ee814ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:12.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.964+0000 7f7eedea6640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ee815e950 0x7f7ee814ad10 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000b9a0 tx=0x7f7ee000be60 comp rx=0 tx=0).stop 2024-09-12T01:43:12.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.965+0000 7f7eedea6640 1 -- 172.21.15.60:0/3510823828 shutdown_connections 2024-09-12T01:43:12.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.965+0000 7f7eedea6640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ee815e950 0x7f7ee814ad10 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.965+0000 7f7eedea6640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7ec806be30 0x7f7ec806e2f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.965+0000 7f7eedea6640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7ee80735b0 0x7f7ee815a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.965+0000 7f7eedea6640 1 --2- 172.21.15.60:0/3510823828 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7ee8072050 0x7f7ee8157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:12.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.965+0000 7f7eedea6640 1 -- 172.21.15.60:0/3510823828 >> 172.21.15.60:0/3510823828 conn(0x7f7ee80d14d0 msgr2=0x7f7ee80b5bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:12.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.965+0000 7f7eedea6640 1 -- 172.21.15.60:0/3510823828 shutdown_connections 2024-09-12T01:43:12.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:12.965+0000 7f7eedea6640 1 -- 172.21.15.60:0/3510823828 wait complete. 2024-09-12T01:43:12.977 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-12T01:43:12.358619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":282744,"kb_used_data":12420,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754691976,"statfs":{"total":773094113280,"available":772804583424,"internally_reserved":0,"allocated":12718080,"data_stored":6070166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.381734"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012397+0000","last_change":"2024-09-12T01:43:10.010617+0000","last_active":"2024-09-12T01:43:10.012397+0000","last_peered":"2024-09-12T01:43:10.012397+0000","last_clean":"2024-09-12T01:43:10.012397+0000","last_became_active":"2024-09-12T01:43:10.010318+0000","last_became_peered":"2024-09-12T01:43:10.010318+0000","last_unstale":"2024-09-12T01:43:10.012397+0000","last_undegraded":"2024-09-12T01:43:10.012397+0000","last_fullsized":"2024-09-12T01:43:10.012397+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:00.998086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.003006+0000","last_change":"2024-09-12T01:43:09.999067+0000","last_active":"2024-09-12T01:43:10.003006+0000","last_peered":"2024-09-12T01:43:10.003006+0000","last_clean":"2024-09-12T01:43:10.003006+0000","last_became_active":"2024-09-12T01:43:09.998779+0000","last_became_peered":"2024-09-12T01:43:09.998779+0000","last_unstale":"2024-09-12T01:43:10.003006+0000","last_undegraded":"2024-09-12T01:43:10.003006+0000","last_fullsized":"2024-09-12T01:43:10.003006+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.436244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.009603+0000","last_change":"2024-09-12T01:43:10.007268+0000","last_active":"2024-09-12T01:43:10.009603+0000","last_peered":"2024-09-12T01:43:10.009603+0000","last_clean":"2024-09-12T01:43:10.009603+0000","last_became_active":"2024-09-12T01:43:10.006974+0000","last_became_peered":"2024-09-12T01:43:10.006974+0000","last_unstale":"2024-09-12T01:43:10.009603+0000","last_undegraded":"2024-09-12T01:43:10.009603+0000","last_fullsized":"2024-09-12T01:43:10.009603+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:45.313222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016364+0000","last_change":"2024-09-12T01:43:10.013407+0000","last_active":"2024-09-12T01:43:10.016364+0000","last_peered":"2024-09-12T01:43:10.016364+0000","last_clean":"2024-09-12T01:43:10.016364+0000","last_became_active":"2024-09-12T01:43:10.013078+0000","last_became_peered":"2024-09-12T01:43:10.013078+0000","last_unstale":"2024-09-12T01:43:10.016364+0000","last_undegraded":"2024-09-12T01:43:10.016364+0000","last_fullsized":"2024-09-12T01:43:10.016364+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:59.595180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.000806+0000","last_change":"2024-09-12T01:43:09.993325+0000","last_active":"2024-09-12T01:43:10.000806+0000","last_peered":"2024-09-12T01:43:10.000806+0000","last_clean":"2024-09-12T01:43:10.000806+0000","last_became_active":"2024-09-12T01:43:09.993003+0000","last_became_peered":"2024-09-12T01:43:09.993003+0000","last_unstale":"2024-09-12T01:43:10.000806+0000","last_undegraded":"2024-09-12T01:43:10.000806+0000","last_fullsized":"2024-09-12T01:43:10.000806+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:13.868284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.009578+0000","last_change":"2024-09-12T01:43:10.006897+0000","last_active":"2024-09-12T01:43:10.009578+0000","last_peered":"2024-09-12T01:43:10.009578+0000","last_clean":"2024-09-12T01:43:10.009578+0000","last_became_active":"2024-09-12T01:43:10.006607+0000","last_became_peered":"2024-09-12T01:43:10.006607+0000","last_unstale":"2024-09-12T01:43:10.009578+0000","last_undegraded":"2024-09-12T01:43:10.009578+0000","last_fullsized":"2024-09-12T01:43:10.009578+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:22.478063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.002936+0000","last_change":"2024-09-12T01:43:09.999698+0000","last_active":"2024-09-12T01:43:10.002936+0000","last_peered":"2024-09-12T01:43:10.002936+0000","last_clean":"2024-09-12T01:43:10.002936+0000","last_became_active":"2024-09-12T01:43:09.999370+0000","last_became_peered":"2024-09-12T01:43:09.999370+0000","last_unstale":"2024-09-12T01:43:10.002936+0000","last_undegraded":"2024-09-12T01:43:10.002936+0000","last_fullsized":"2024-09-12T01:43:10.002936+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:02.840344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010670+0000","last_change":"2024-09-12T01:43:10.007674+0000","last_active":"2024-09-12T01:43:10.010670+0000","last_peered":"2024-09-12T01:43:10.010670+0000","last_clean":"2024-09-12T01:43:10.010670+0000","last_became_active":"2024-09-12T01:43:10.006630+0000","last_became_peered":"2024-09-12T01:43:10.006630+0000","last_unstale":"2024-09-12T01:43:10.010670+0000","last_undegraded":"2024-09-12T01:43:10.010670+0000","last_fullsized":"2024-09-12T01:43:10.010670+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:43.082717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.019627+0000","last_change":"2024-09-12T01:43:10.017470+0000","last_active":"2024-09-12T01:43:10.019627+0000","last_peered":"2024-09-12T01:43:10.019627+0000","last_clean":"2024-09-12T01:43:10.019627+0000","last_became_active":"2024-09-12T01:43:10.017170+0000","last_became_peered":"2024-09-12T01:43:10.017170+0000","last_unstale":"2024-09-12T01:43:10.019627+0000","last_undegraded":"2024-09-12T01:43:10.019627+0000","last_fullsized":"2024-09-12T01:43:10.019627+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:10.230932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013106+0000","last_change":"2024-09-12T01:43:10.009228+0000","last_active":"2024-09-12T01:43:10.013106+0000","last_peered":"2024-09-12T01:43:10.013106+0000","last_clean":"2024-09-12T01:43:10.013106+0000","last_became_active":"2024-09-12T01:43:10.008772+0000","last_became_peered":"2024-09-12T01:43:10.008772+0000","last_unstale":"2024-09-12T01:43:10.013106+0000","last_undegraded":"2024-09-12T01:43:10.013106+0000","last_fullsized":"2024-09-12T01:43:10.013106+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:04.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015852+0000","last_change":"2024-09-12T01:43:10.010426+0000","last_active":"2024-09-12T01:43:10.015852+0000","last_peered":"2024-09-12T01:43:10.015852+0000","last_clean":"2024-09-12T01:43:10.015852+0000","last_became_active":"2024-09-12T01:43:10.010145+0000","last_became_peered":"2024-09-12T01:43:10.010145+0000","last_unstale":"2024-09-12T01:43:10.015852+0000","last_undegraded":"2024-09-12T01:43:10.015852+0000","last_fullsized":"2024-09-12T01:43:10.015852+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:14.568049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016141+0000","last_change":"2024-09-12T01:43:10.012384+0000","last_active":"2024-09-12T01:43:10.016141+0000","last_peered":"2024-09-12T01:43:10.016141+0000","last_clean":"2024-09-12T01:43:10.016141+0000","last_became_active":"2024-09-12T01:43:10.012073+0000","last_became_peered":"2024-09-12T01:43:10.012073+0000","last_unstale":"2024-09-12T01:43:10.016141+0000","last_undegraded":"2024-09-12T01:43:10.016141+0000","last_fullsized":"2024-09-12T01:43:10.016141+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:35.398682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010228+0000","last_change":"2024-09-12T01:43:10.005425+0000","last_active":"2024-09-12T01:43:10.010228+0000","last_peered":"2024-09-12T01:43:10.010228+0000","last_clean":"2024-09-12T01:43:10.010228+0000","last_became_active":"2024-09-12T01:43:10.005101+0000","last_became_peered":"2024-09-12T01:43:10.005101+0000","last_unstale":"2024-09-12T01:43:10.010228+0000","last_undegraded":"2024-09-12T01:43:10.010228+0000","last_fullsized":"2024-09-12T01:43:10.010228+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:45.075912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.996407+0000","last_change":"2024-09-12T01:43:09.994951+0000","last_active":"2024-09-12T01:43:09.996407+0000","last_peered":"2024-09-12T01:43:09.996407+0000","last_clean":"2024-09-12T01:43:09.996407+0000","last_became_active":"2024-09-12T01:43:09.994653+0000","last_became_peered":"2024-09-12T01:43:09.994653+0000","last_unstale":"2024-09-12T01:43:09.996407+0000","last_undegraded":"2024-09-12T01:43:09.996407+0000","last_fullsized":"2024-09-12T01:43:09.996407+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:28.947715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.018468+0000","last_change":"2024-09-12T01:43:10.013071+0000","last_active":"2024-09-12T01:43:10.018468+0000","last_peered":"2024-09-12T01:43:10.018468+0000","last_clean":"2024-09-12T01:43:10.018468+0000","last_became_active":"2024-09-12T01:43:10.012269+0000","last_became_peered":"2024-09-12T01:43:10.012269+0000","last_unstale":"2024-09-12T01:43:10.018468+0000","last_undegraded":"2024-09-12T01:43:10.018468+0000","last_fullsized":"2024-09-12T01:43:10.018468+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:30.956540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012952+0000","last_change":"2024-09-12T01:43:10.008649+0000","last_active":"2024-09-12T01:43:10.012952+0000","last_peered":"2024-09-12T01:43:10.012952+0000","last_clean":"2024-09-12T01:43:10.012952+0000","last_became_active":"2024-09-12T01:43:10.008285+0000","last_became_peered":"2024-09-12T01:43:10.008285+0000","last_unstale":"2024-09-12T01:43:10.012952+0000","last_undegraded":"2024-09-12T01:43:10.012952+0000","last_fullsized":"2024-09-12T01:43:10.012952+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:52.990907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.018040+0000","last_change":"2024-09-12T01:43:10.015834+0000","last_active":"2024-09-12T01:43:10.018040+0000","last_peered":"2024-09-12T01:43:10.018040+0000","last_clean":"2024-09-12T01:43:10.018040+0000","last_became_active":"2024-09-12T01:43:10.012836+0000","last_became_peered":"2024-09-12T01:43:10.012836+0000","last_unstale":"2024-09-12T01:43:10.018040+0000","last_undegraded":"2024-09-12T01:43:10.018040+0000","last_fullsized":"2024-09-12T01:43:10.018040+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:00.239866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016842+0000","last_change":"2024-09-12T01:43:10.015393+0000","last_active":"2024-09-12T01:43:10.016842+0000","last_peered":"2024-09-12T01:43:10.016842+0000","last_clean":"2024-09-12T01:43:10.016842+0000","last_became_active":"2024-09-12T01:43:10.015131+0000","last_became_peered":"2024-09-12T01:43:10.015131+0000","last_unstale":"2024-09-12T01:43:10.016842+0000","last_undegraded":"2024-09-12T01:43:10.016842+0000","last_fullsized":"2024-09-12T01:43:10.016842+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:51.240289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.021079+0000","last_change":"2024-09-12T01:43:10.017901+0000","last_active":"2024-09-12T01:43:10.021079+0000","last_peered":"2024-09-12T01:43:10.021079+0000","last_clean":"2024-09-12T01:43:10.021079+0000","last_became_active":"2024-09-12T01:43:10.017599+0000","last_became_peered":"2024-09-12T01:43:10.017599+0000","last_unstale":"2024-09-12T01:43:10.021079+0000","last_undegraded":"2024-09-12T01:43:10.021079+0000","last_fullsized":"2024-09-12T01:43:10.021079+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:23.039212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012926+0000","last_change":"2024-09-12T01:43:10.008416+0000","last_active":"2024-09-12T01:43:10.012926+0000","last_peered":"2024-09-12T01:43:10.012926+0000","last_clean":"2024-09-12T01:43:10.012926+0000","last_became_active":"2024-09-12T01:43:10.008149+0000","last_became_peered":"2024-09-12T01:43:10.008149+0000","last_unstale":"2024-09-12T01:43:10.012926+0000","last_undegraded":"2024-09-12T01:43:10.012926+0000","last_fullsized":"2024-09-12T01:43:10.012926+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:57.864742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.021030+0000","last_change":"2024-09-12T01:43:10.018610+0000","last_active":"2024-09-12T01:43:10.021030+0000","last_peered":"2024-09-12T01:43:10.021030+0000","last_clean":"2024-09-12T01:43:10.021030+0000","last_became_active":"2024-09-12T01:43:10.018313+0000","last_became_peered":"2024-09-12T01:43:10.018313+0000","last_unstale":"2024-09-12T01:43:10.021030+0000","last_undegraded":"2024-09-12T01:43:10.021030+0000","last_fullsized":"2024-09-12T01:43:10.021030+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.436244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.011049+0000","last_change":"2024-09-12T01:43:10.005034+0000","last_active":"2024-09-12T01:43:10.011049+0000","last_peered":"2024-09-12T01:43:10.011049+0000","last_clean":"2024-09-12T01:43:10.011049+0000","last_became_active":"2024-09-12T01:43:10.004647+0000","last_became_peered":"2024-09-12T01:43:10.004647+0000","last_unstale":"2024-09-12T01:43:10.011049+0000","last_undegraded":"2024-09-12T01:43:10.011049+0000","last_fullsized":"2024-09-12T01:43:10.011049+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:24.531059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013872+0000","last_change":"2024-09-12T01:43:10.010938+0000","last_active":"2024-09-12T01:43:10.013872+0000","last_peered":"2024-09-12T01:43:10.013872+0000","last_clean":"2024-09-12T01:43:10.013872+0000","last_became_active":"2024-09-12T01:43:10.010575+0000","last_became_peered":"2024-09-12T01:43:10.010575+0000","last_unstale":"2024-09-12T01:43:10.013872+0000","last_undegraded":"2024-09-12T01:43:10.013872+0000","last_fullsized":"2024-09-12T01:43:10.013872+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:13.973177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.002914+0000","last_change":"2024-09-12T01:43:09.999258+0000","last_active":"2024-09-12T01:43:10.002914+0000","last_peered":"2024-09-12T01:43:10.002914+0000","last_clean":"2024-09-12T01:43:10.002914+0000","last_became_active":"2024-09-12T01:43:09.998972+0000","last_became_peered":"2024-09-12T01:43:09.998972+0000","last_unstale":"2024-09-12T01:43:10.002914+0000","last_undegraded":"2024-09-12T01:43:10.002914+0000","last_fullsized":"2024-09-12T01:43:10.002914+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:08.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.004836+0000","last_change":"2024-09-12T01:43:10.002479+0000","last_active":"2024-09-12T01:43:10.004836+0000","last_peered":"2024-09-12T01:43:10.004836+0000","last_clean":"2024-09-12T01:43:10.004836+0000","last_became_active":"2024-09-12T01:43:10.001641+0000","last_became_peered":"2024-09-12T01:43:10.001641+0000","last_unstale":"2024-09-12T01:43:10.004836+0000","last_undegraded":"2024-09-12T01:43:10.004836+0000","last_fullsized":"2024-09-12T01:43:10.004836+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:10.230932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"116'4","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.014790+0000","last_change":"2024-09-12T01:43:08.999139+0000","last_active":"2024-09-12T01:43:10.014790+0000","last_peered":"2024-09-12T01:43:10.014790+0000","last_clean":"2024-09-12T01:43:10.014790+0000","last_became_active":"2024-09-12T01:43:08.998874+0000","last_became_peered":"2024-09-12T01:43:08.998874+0000","last_unstale":"2024-09-12T01:43:10.014790+0000","last_undegraded":"2024-09-12T01:43:10.014790+0000","last_fullsized":"2024-09-12T01:43:10.014790+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:12.086671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.999594+0000","last_change":"2024-09-12T01:43:09.998236+0000","last_active":"2024-09-12T01:43:09.999594+0000","last_peered":"2024-09-12T01:43:09.999594+0000","last_clean":"2024-09-12T01:43:09.999594+0000","last_became_active":"2024-09-12T01:43:09.996642+0000","last_became_peered":"2024-09-12T01:43:09.996642+0000","last_unstale":"2024-09-12T01:43:09.999594+0000","last_undegraded":"2024-09-12T01:43:09.999594+0000","last_fullsized":"2024-09-12T01:43:09.999594+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:33.470907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017670+0000","last_change":"2024-09-12T01:43:09.007149+0000","last_active":"2024-09-12T01:43:10.017670+0000","last_peered":"2024-09-12T01:43:10.017670+0000","last_clean":"2024-09-12T01:43:10.017670+0000","last_became_active":"2024-09-12T01:43:09.006801+0000","last_became_peered":"2024-09-12T01:43:09.006801+0000","last_unstale":"2024-09-12T01:43:10.017670+0000","last_undegraded":"2024-09-12T01:43:10.017670+0000","last_fullsized":"2024-09-12T01:43:10.017670+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:48.504193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013118+0000","last_change":"2024-09-12T01:43:10.012246+0000","last_active":"2024-09-12T01:43:10.013118+0000","last_peered":"2024-09-12T01:43:10.013118+0000","last_clean":"2024-09-12T01:43:10.013118+0000","last_became_active":"2024-09-12T01:43:10.011930+0000","last_became_peered":"2024-09-12T01:43:10.011930+0000","last_unstale":"2024-09-12T01:43:10.013118+0000","last_undegraded":"2024-09-12T01:43:10.013118+0000","last_fullsized":"2024-09-12T01:43:10.013118+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:32.799859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.007885+0000","last_change":"2024-09-12T01:43:08.998653+0000","last_active":"2024-09-12T01:43:10.007885+0000","last_peered":"2024-09-12T01:43:10.007885+0000","last_clean":"2024-09-12T01:43:10.007885+0000","last_became_active":"2024-09-12T01:43:08.998390+0000","last_became_peered":"2024-09-12T01:43:08.998390+0000","last_unstale":"2024-09-12T01:43:10.007885+0000","last_undegraded":"2024-09-12T01:43:10.007885+0000","last_fullsized":"2024-09-12T01:43:10.007885+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:18.419447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017106+0000","last_change":"2024-09-12T01:43:10.012472+0000","last_active":"2024-09-12T01:43:10.017106+0000","last_peered":"2024-09-12T01:43:10.017106+0000","last_clean":"2024-09-12T01:43:10.017106+0000","last_became_active":"2024-09-12T01:43:10.011808+0000","last_became_peered":"2024-09-12T01:43:10.011808+0000","last_unstale":"2024-09-12T01:43:10.017106+0000","last_undegraded":"2024-09-12T01:43:10.017106+0000","last_fullsized":"2024-09-12T01:43:10.017106+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:36.244472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-12T01:43:07.980762+0000","last_change":"2024-09-12T01:43:07.980762+0000","last_active":"2024-09-12T01:43:07.971297+0000","last_peered":"2024-09-12T01:43:07.971297+0000","last_clean":"2024-09-12T01:43:07.971297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:07.980762+0000","last_undegraded":"2024-09-12T01:43:07.980762+0000","last_fullsized":"2024-09-12T01:43:07.980762+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016192+0000","last_change":"2024-09-12T01:43:10.012454+0000","last_active":"2024-09-12T01:43:10.016192+0000","last_peered":"2024-09-12T01:43:10.016192+0000","last_clean":"2024-09-12T01:43:10.016192+0000","last_became_active":"2024-09-12T01:43:10.012121+0000","last_became_peered":"2024-09-12T01:43:10.012121+0000","last_unstale":"2024-09-12T01:43:10.016192+0000","last_undegraded":"2024-09-12T01:43:10.016192+0000","last_fullsized":"2024-09-12T01:43:10.016192+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:18.967832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-12T01:43:07.981284+0000","last_change":"2024-09-12T01:43:07.981284+0000","last_active":"2024-09-12T01:43:07.971297+0000","last_peered":"2024-09-12T01:43:07.971297+0000","last_clean":"2024-09-12T01:43:07.971297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:07.981284+0000","last_undegraded":"2024-09-12T01:43:07.981284+0000","last_fullsized":"2024-09-12T01:43:07.981284+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016452+0000","last_change":"2024-09-12T01:43:10.015386+0000","last_active":"2024-09-12T01:43:10.016452+0000","last_peered":"2024-09-12T01:43:10.016452+0000","last_clean":"2024-09-12T01:43:10.016452+0000","last_became_active":"2024-09-12T01:43:10.012428+0000","last_became_peered":"2024-09-12T01:43:10.012428+0000","last_unstale":"2024-09-12T01:43:10.016452+0000","last_undegraded":"2024-09-12T01:43:10.016452+0000","last_fullsized":"2024-09-12T01:43:10.016452+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:04.591571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.008395+0000","last_change":"2024-09-12T01:43:08.997463+0000","last_active":"2024-09-12T01:43:10.008395+0000","last_peered":"2024-09-12T01:43:10.008395+0000","last_clean":"2024-09-12T01:43:10.008395+0000","last_became_active":"2024-09-12T01:43:08.994321+0000","last_became_peered":"2024-09-12T01:43:08.994321+0000","last_unstale":"2024-09-12T01:43:10.008395+0000","last_undegraded":"2024-09-12T01:43:10.008395+0000","last_fullsized":"2024-09-12T01:43:10.008395+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:57.845182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.020328+0000","last_change":"2024-09-12T01:43:10.016198+0000","last_active":"2024-09-12T01:43:10.020328+0000","last_peered":"2024-09-12T01:43:10.020328+0000","last_clean":"2024-09-12T01:43:10.020328+0000","last_became_active":"2024-09-12T01:43:10.015942+0000","last_became_peered":"2024-09-12T01:43:10.015942+0000","last_unstale":"2024-09-12T01:43:10.020328+0000","last_undegraded":"2024-09-12T01:43:10.020328+0000","last_fullsized":"2024-09-12T01:43:10.020328+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:50.905796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.986853+0000","last_change":"2024-09-12T01:43:08.998565+0000","last_active":"2024-09-12T01:43:09.986853+0000","last_peered":"2024-09-12T01:43:09.986853+0000","last_clean":"2024-09-12T01:43:09.986853+0000","last_became_active":"2024-09-12T01:43:08.998292+0000","last_became_peered":"2024-09-12T01:43:08.998292+0000","last_unstale":"2024-09-12T01:43:09.986853+0000","last_undegraded":"2024-09-12T01:43:09.986853+0000","last_fullsized":"2024-09-12T01:43:09.986853+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.559247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-12T01:43:07.980944+0000","last_change":"2024-09-12T01:43:07.980944+0000","last_active":"2024-09-12T01:43:07.971297+0000","last_peered":"2024-09-12T01:43:07.971297+0000","last_clean":"2024-09-12T01:43:07.971297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:07.980944+0000","last_undegraded":"2024-09-12T01:43:07.980944+0000","last_fullsized":"2024-09-12T01:43:07.980944+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.996699+0000","last_change":"2024-09-12T01:43:09.005035+0000","last_active":"2024-09-12T01:43:09.996699+0000","last_peered":"2024-09-12T01:43:09.996699+0000","last_clean":"2024-09-12T01:43:09.996699+0000","last_became_active":"2024-09-12T01:43:09.003567+0000","last_became_peered":"2024-09-12T01:43:09.003567+0000","last_unstale":"2024-09-12T01:43:09.996699+0000","last_undegraded":"2024-09-12T01:43:09.996699+0000","last_fullsized":"2024-09-12T01:43:09.996699+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:29.476489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.008408+0000","last_change":"2024-09-12T01:43:10.006087+0000","last_active":"2024-09-12T01:43:10.008408+0000","last_peered":"2024-09-12T01:43:10.008408+0000","last_clean":"2024-09-12T01:43:10.008408+0000","last_became_active":"2024-09-12T01:43:10.003431+0000","last_became_peered":"2024-09-12T01:43:10.003431+0000","last_unstale":"2024-09-12T01:43:10.008408+0000","last_undegraded":"2024-09-12T01:43:10.008408+0000","last_fullsized":"2024-09-12T01:43:10.008408+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:18.861635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.999813+0000","last_change":"2024-09-12T01:43:09.000223+0000","last_active":"2024-09-12T01:43:09.999813+0000","last_peered":"2024-09-12T01:43:09.999813+0000","last_clean":"2024-09-12T01:43:09.999813+0000","last_became_active":"2024-09-12T01:43:08.999881+0000","last_became_peered":"2024-09-12T01:43:08.999881+0000","last_unstale":"2024-09-12T01:43:09.999813+0000","last_undegraded":"2024-09-12T01:43:09.999813+0000","last_fullsized":"2024-09-12T01:43:09.999813+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:50.234821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.020142+0000","last_change":"2024-09-12T01:43:10.017833+0000","last_active":"2024-09-12T01:43:10.020142+0000","last_peered":"2024-09-12T01:43:10.020142+0000","last_clean":"2024-09-12T01:43:10.020142+0000","last_became_active":"2024-09-12T01:43:10.017506+0000","last_became_peered":"2024-09-12T01:43:10.017506+0000","last_unstale":"2024-09-12T01:43:10.020142+0000","last_undegraded":"2024-09-12T01:43:10.020142+0000","last_fullsized":"2024-09-12T01:43:10.020142+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:12.885550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"116'3","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.014580+0000","last_change":"2024-09-12T01:43:08.999971+0000","last_active":"2024-09-12T01:43:10.014580+0000","last_peered":"2024-09-12T01:43:10.014580+0000","last_clean":"2024-09-12T01:43:10.014580+0000","last_became_active":"2024-09-12T01:43:08.999656+0000","last_became_peered":"2024-09-12T01:43:08.999656+0000","last_unstale":"2024-09-12T01:43:10.014580+0000","last_undegraded":"2024-09-12T01:43:10.014580+0000","last_fullsized":"2024-09-12T01:43:10.014580+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:08.248385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.019658+0000","last_change":"2024-09-12T01:43:10.018504+0000","last_active":"2024-09-12T01:43:10.019658+0000","last_peered":"2024-09-12T01:43:10.019658+0000","last_clean":"2024-09-12T01:43:10.019658+0000","last_became_active":"2024-09-12T01:43:10.018223+0000","last_became_peered":"2024-09-12T01:43:10.018223+0000","last_unstale":"2024-09-12T01:43:10.019658+0000","last_undegraded":"2024-09-12T01:43:10.019658+0000","last_fullsized":"2024-09-12T01:43:10.019658+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:52.990907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"116'6","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.022053+0000","last_change":"2024-09-12T01:43:09.004240+0000","last_active":"2024-09-12T01:43:10.022053+0000","last_peered":"2024-09-12T01:43:10.022053+0000","last_clean":"2024-09-12T01:43:10.022053+0000","last_became_active":"2024-09-12T01:43:09.003936+0000","last_became_peered":"2024-09-12T01:43:09.003936+0000","last_unstale":"2024-09-12T01:43:10.022053+0000","last_undegraded":"2024-09-12T01:43:10.022053+0000","last_fullsized":"2024-09-12T01:43:10.022053+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.733832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.007333+0000","last_change":"2024-09-12T01:43:10.005212+0000","last_active":"2024-09-12T01:43:10.007333+0000","last_peered":"2024-09-12T01:43:10.007333+0000","last_clean":"2024-09-12T01:43:10.007333+0000","last_became_active":"2024-09-12T01:43:10.004914+0000","last_became_peered":"2024-09-12T01:43:10.004914+0000","last_unstale":"2024-09-12T01:43:10.007333+0000","last_undegraded":"2024-09-12T01:43:10.007333+0000","last_fullsized":"2024-09-12T01:43:10.007333+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:12.885550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.998201+0000","last_change":"2024-09-12T01:43:08.996819+0000","last_active":"2024-09-12T01:43:09.998201+0000","last_peered":"2024-09-12T01:43:09.998201+0000","last_clean":"2024-09-12T01:43:09.998201+0000","last_became_active":"2024-09-12T01:43:08.996524+0000","last_became_peered":"2024-09-12T01:43:08.996524+0000","last_unstale":"2024-09-12T01:43:09.998201+0000","last_undegraded":"2024-09-12T01:43:09.998201+0000","last_fullsized":"2024-09-12T01:43:09.998201+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:59.234398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010251+0000","last_change":"2024-09-12T01:43:10.005816+0000","last_active":"2024-09-12T01:43:10.010251+0000","last_peered":"2024-09-12T01:43:10.010251+0000","last_clean":"2024-09-12T01:43:10.010251+0000","last_became_active":"2024-09-12T01:43:10.005542+0000","last_became_peered":"2024-09-12T01:43:10.005542+0000","last_unstale":"2024-09-12T01:43:10.010251+0000","last_undegraded":"2024-09-12T01:43:10.010251+0000","last_fullsized":"2024-09-12T01:43:10.010251+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.088992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990122+0000","last_change":"2024-09-12T01:43:09.005250+0000","last_active":"2024-09-12T01:43:09.990122+0000","last_peered":"2024-09-12T01:43:09.990122+0000","last_clean":"2024-09-12T01:43:09.990122+0000","last_became_active":"2024-09-12T01:43:09.004791+0000","last_became_peered":"2024-09-12T01:43:09.004791+0000","last_unstale":"2024-09-12T01:43:09.990122+0000","last_undegraded":"2024-09-12T01:43:09.990122+0000","last_fullsized":"2024-09-12T01:43:09.990122+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:26.568406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016389+0000","last_change":"2024-09-12T01:43:10.014855+0000","last_active":"2024-09-12T01:43:10.016389+0000","last_peered":"2024-09-12T01:43:10.016389+0000","last_clean":"2024-09-12T01:43:10.016389+0000","last_became_active":"2024-09-12T01:43:10.014592+0000","last_became_peered":"2024-09-12T01:43:10.014592+0000","last_unstale":"2024-09-12T01:43:10.016389+0000","last_undegraded":"2024-09-12T01:43:10.016389+0000","last_fullsized":"2024-09-12T01:43:10.016389+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:17.976343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"116'8","reported_seq":20,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.020601+0000","last_change":"2024-09-12T01:43:09.002635+0000","last_active":"2024-09-12T01:43:10.020601+0000","last_peered":"2024-09-12T01:43:10.020601+0000","last_clean":"2024-09-12T01:43:10.020601+0000","last_became_active":"2024-09-12T01:43:09.002101+0000","last_became_peered":"2024-09-12T01:43:09.002101+0000","last_unstale":"2024-09-12T01:43:10.020601+0000","last_undegraded":"2024-09-12T01:43:10.020601+0000","last_fullsized":"2024-09-12T01:43:10.020601+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:44.307753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013813+0000","last_change":"2024-09-12T01:43:10.008983+0000","last_active":"2024-09-12T01:43:10.013813+0000","last_peered":"2024-09-12T01:43:10.013813+0000","last_clean":"2024-09-12T01:43:10.013813+0000","last_became_active":"2024-09-12T01:43:10.008679+0000","last_became_peered":"2024-09-12T01:43:10.008679+0000","last_unstale":"2024-09-12T01:43:10.013813+0000","last_undegraded":"2024-09-12T01:43:10.013813+0000","last_fullsized":"2024-09-12T01:43:10.013813+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:30.481957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017621+0000","last_change":"2024-09-12T01:43:09.001656+0000","last_active":"2024-09-12T01:43:10.017621+0000","last_peered":"2024-09-12T01:43:10.017621+0000","last_clean":"2024-09-12T01:43:10.017621+0000","last_became_active":"2024-09-12T01:43:09.000503+0000","last_became_peered":"2024-09-12T01:43:09.000503+0000","last_unstale":"2024-09-12T01:43:10.017621+0000","last_undegraded":"2024-09-12T01:43:10.017621+0000","last_fullsized":"2024-09-12T01:43:10.017621+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:21.472595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.008383+0000","last_change":"2024-09-12T01:43:10.005510+0000","last_active":"2024-09-12T01:43:10.008383+0000","last_peered":"2024-09-12T01:43:10.008383+0000","last_clean":"2024-09-12T01:43:10.008383+0000","last_became_active":"2024-09-12T01:43:10.002150+0000","last_became_peered":"2024-09-12T01:43:10.002150+0000","last_unstale":"2024-09-12T01:43:10.008383+0000","last_undegraded":"2024-09-12T01:43:10.008383+0000","last_fullsized":"2024-09-12T01:43:10.008383+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.892242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.014360+0000","last_change":"2024-09-12T01:43:08.997611+0000","last_active":"2024-09-12T01:43:10.014360+0000","last_peered":"2024-09-12T01:43:10.014360+0000","last_clean":"2024-09-12T01:43:10.014360+0000","last_became_active":"2024-09-12T01:43:08.997299+0000","last_became_peered":"2024-09-12T01:43:08.997299+0000","last_unstale":"2024-09-12T01:43:10.014360+0000","last_undegraded":"2024-09-12T01:43:10.014360+0000","last_fullsized":"2024-09-12T01:43:10.014360+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:59.274047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.011710+0000","last_change":"2024-09-12T01:43:09.002198+0000","last_active":"2024-09-12T01:43:10.011710+0000","last_peered":"2024-09-12T01:43:10.011710+0000","last_clean":"2024-09-12T01:43:10.011710+0000","last_became_active":"2024-09-12T01:43:09.001925+0000","last_became_peered":"2024-09-12T01:43:09.001925+0000","last_unstale":"2024-09-12T01:43:10.011710+0000","last_undegraded":"2024-09-12T01:43:10.011710+0000","last_fullsized":"2024-09-12T01:43:10.011710+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:33.130766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990176+0000","last_change":"2024-09-12T01:43:08.991805+0000","last_active":"2024-09-12T01:43:09.990176+0000","last_peered":"2024-09-12T01:43:09.990176+0000","last_clean":"2024-09-12T01:43:09.990176+0000","last_became_active":"2024-09-12T01:43:08.991517+0000","last_became_peered":"2024-09-12T01:43:08.991517+0000","last_unstale":"2024-09-12T01:43:09.990176+0000","last_undegraded":"2024-09-12T01:43:09.990176+0000","last_fullsized":"2024-09-12T01:43:09.990176+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:16.731138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013877+0000","last_change":"2024-09-12T01:43:09.002910+0000","last_active":"2024-09-12T01:43:10.013877+0000","last_peered":"2024-09-12T01:43:10.013877+0000","last_clean":"2024-09-12T01:43:10.013877+0000","last_became_active":"2024-09-12T01:43:09.002618+0000","last_became_peered":"2024-09-12T01:43:09.002618+0000","last_unstale":"2024-09-12T01:43:10.013877+0000","last_undegraded":"2024-09-12T01:43:10.013877+0000","last_fullsized":"2024-09-12T01:43:10.013877+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:37.911468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010952+0000","last_change":"2024-09-12T01:43:10.003250+0000","last_active":"2024-09-12T01:43:10.010952+0000","last_peered":"2024-09-12T01:43:10.010952+0000","last_clean":"2024-09-12T01:43:10.010952+0000","last_became_active":"2024-09-12T01:43:10.002434+0000","last_became_peered":"2024-09-12T01:43:10.002434+0000","last_unstale":"2024-09-12T01:43:10.010952+0000","last_undegraded":"2024-09-12T01:43:10.010952+0000","last_fullsized":"2024-09-12T01:43:10.010952+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:58.850651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.994201+0000","last_change":"2024-09-12T01:43:08.998911+0000","last_active":"2024-09-12T01:43:09.994201+0000","last_peered":"2024-09-12T01:43:09.994201+0000","last_clean":"2024-09-12T01:43:09.994201+0000","last_became_active":"2024-09-12T01:43:08.998521+0000","last_became_peered":"2024-09-12T01:43:08.998521+0000","last_unstale":"2024-09-12T01:43:09.994201+0000","last_undegraded":"2024-09-12T01:43:09.994201+0000","last_fullsized":"2024-09-12T01:43:09.994201+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:23.525590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015958+0000","last_change":"2024-09-12T01:43:10.011401+0000","last_active":"2024-09-12T01:43:10.015958+0000","last_peered":"2024-09-12T01:43:10.015958+0000","last_clean":"2024-09-12T01:43:10.015958+0000","last_became_active":"2024-09-12T01:43:10.011126+0000","last_became_peered":"2024-09-12T01:43:10.011126+0000","last_unstale":"2024-09-12T01:43:10.015958+0000","last_undegraded":"2024-09-12T01:43:10.015958+0000","last_fullsized":"2024-09-12T01:43:10.015958+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:19.424916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.998630+0000","last_change":"2024-09-12T01:43:09.004606+0000","last_active":"2024-09-12T01:43:09.998630+0000","last_peered":"2024-09-12T01:43:09.998630+0000","last_clean":"2024-09-12T01:43:09.998630+0000","last_became_active":"2024-09-12T01:43:09.004182+0000","last_became_peered":"2024-09-12T01:43:09.004182+0000","last_unstale":"2024-09-12T01:43:09.998630+0000","last_undegraded":"2024-09-12T01:43:09.998630+0000","last_fullsized":"2024-09-12T01:43:09.998630+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:49.900328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012891+0000","last_change":"2024-09-12T01:43:10.008207+0000","last_active":"2024-09-12T01:43:10.012891+0000","last_peered":"2024-09-12T01:43:10.012891+0000","last_clean":"2024-09-12T01:43:10.012891+0000","last_became_active":"2024-09-12T01:43:10.007942+0000","last_became_peered":"2024-09-12T01:43:10.007942+0000","last_unstale":"2024-09-12T01:43:10.012891+0000","last_undegraded":"2024-09-12T01:43:10.012891+0000","last_fullsized":"2024-09-12T01:43:10.012891+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:02.422050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.989883+0000","last_change":"2024-09-12T01:43:08.998574+0000","last_active":"2024-09-12T01:43:09.989883+0000","last_peered":"2024-09-12T01:43:09.989883+0000","last_clean":"2024-09-12T01:43:09.989883+0000","last_became_active":"2024-09-12T01:43:08.998295+0000","last_became_peered":"2024-09-12T01:43:08.998295+0000","last_unstale":"2024-09-12T01:43:09.989883+0000","last_undegraded":"2024-09-12T01:43:09.989883+0000","last_fullsized":"2024-09-12T01:43:09.989883+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:44.083523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010961+0000","last_change":"2024-09-12T01:43:10.006771+0000","last_active":"2024-09-12T01:43:10.010961+0000","last_peered":"2024-09-12T01:43:10.010961+0000","last_clean":"2024-09-12T01:43:10.010961+0000","last_became_active":"2024-09-12T01:43:10.006483+0000","last_became_peered":"2024-09-12T01:43:10.006483+0000","last_unstale":"2024-09-12T01:43:10.010961+0000","last_undegraded":"2024-09-12T01:43:10.010961+0000","last_fullsized":"2024-09-12T01:43:10.010961+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:39.623929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.004225+0000","last_change":"2024-09-12T01:43:08.999378+0000","last_active":"2024-09-12T01:43:10.004225+0000","last_peered":"2024-09-12T01:43:10.004225+0000","last_clean":"2024-09-12T01:43:10.004225+0000","last_became_active":"2024-09-12T01:43:08.999097+0000","last_became_peered":"2024-09-12T01:43:08.999097+0000","last_unstale":"2024-09-12T01:43:10.004225+0000","last_undegraded":"2024-09-12T01:43:10.004225+0000","last_fullsized":"2024-09-12T01:43:10.004225+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:38.618460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990685+0000","last_change":"2024-09-12T01:43:09.005092+0000","last_active":"2024-09-12T01:43:09.990685+0000","last_peered":"2024-09-12T01:43:09.990685+0000","last_clean":"2024-09-12T01:43:09.990685+0000","last_became_active":"2024-09-12T01:43:09.004744+0000","last_became_peered":"2024-09-12T01:43:09.004744+0000","last_unstale":"2024-09-12T01:43:09.990685+0000","last_undegraded":"2024-09-12T01:43:09.990685+0000","last_fullsized":"2024-09-12T01:43:09.990685+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.790944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013190+0000","last_change":"2024-09-12T01:43:10.009557+0000","last_active":"2024-09-12T01:43:10.013190+0000","last_peered":"2024-09-12T01:43:10.013190+0000","last_clean":"2024-09-12T01:43:10.013190+0000","last_became_active":"2024-09-12T01:43:10.009200+0000","last_became_peered":"2024-09-12T01:43:10.009200+0000","last_unstale":"2024-09-12T01:43:10.013190+0000","last_undegraded":"2024-09-12T01:43:10.013190+0000","last_fullsized":"2024-09-12T01:43:10.013190+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:27.573875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.998825+0000","last_change":"2024-09-12T01:43:09.005025+0000","last_active":"2024-09-12T01:43:09.998825+0000","last_peered":"2024-09-12T01:43:09.998825+0000","last_clean":"2024-09-12T01:43:09.998825+0000","last_became_active":"2024-09-12T01:43:09.004716+0000","last_became_peered":"2024-09-12T01:43:09.004716+0000","last_unstale":"2024-09-12T01:43:09.998825+0000","last_undegraded":"2024-09-12T01:43:09.998825+0000","last_fullsized":"2024-09-12T01:43:09.998825+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:12.967708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.011002+0000","last_change":"2024-09-12T01:43:10.008340+0000","last_active":"2024-09-12T01:43:10.011002+0000","last_peered":"2024-09-12T01:43:10.011002+0000","last_clean":"2024-09-12T01:43:10.011002+0000","last_became_active":"2024-09-12T01:43:10.008060+0000","last_became_peered":"2024-09-12T01:43:10.008060+0000","last_unstale":"2024-09-12T01:43:10.011002+0000","last_undegraded":"2024-09-12T01:43:10.011002+0000","last_fullsized":"2024-09-12T01:43:10.011002+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.690408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.997967+0000","last_change":"2024-09-12T01:43:09.001072+0000","last_active":"2024-09-12T01:43:09.997967+0000","last_peered":"2024-09-12T01:43:09.997967+0000","last_clean":"2024-09-12T01:43:09.997967+0000","last_became_active":"2024-09-12T01:43:09.000603+0000","last_became_peered":"2024-09-12T01:43:09.000603+0000","last_unstale":"2024-09-12T01:43:09.997967+0000","last_undegraded":"2024-09-12T01:43:09.997967+0000","last_fullsized":"2024-09-12T01:43:09.997967+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:03.586102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016401+0000","last_change":"2024-09-12T01:43:10.015102+0000","last_active":"2024-09-12T01:43:10.016401+0000","last_peered":"2024-09-12T01:43:10.016401+0000","last_clean":"2024-09-12T01:43:10.016401+0000","last_became_active":"2024-09-12T01:43:10.012654+0000","last_became_peered":"2024-09-12T01:43:10.012654+0000","last_unstale":"2024-09-12T01:43:10.016401+0000","last_undegraded":"2024-09-12T01:43:10.016401+0000","last_fullsized":"2024-09-12T01:43:10.016401+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:06.891635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-12T01:43:07.980755+0000","last_change":"2024-09-12T01:43:07.980755+0000","last_active":"2024-09-12T01:43:07.971297+0000","last_peered":"2024-09-12T01:43:07.971297+0000","last_clean":"2024-09-12T01:43:07.971297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:07.980755+0000","last_undegraded":"2024-09-12T01:43:07.980755+0000","last_fullsized":"2024-09-12T01:43:07.980755+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015571+0000","last_change":"2024-09-12T01:43:10.007677+0000","last_active":"2024-09-12T01:43:10.015571+0000","last_peered":"2024-09-12T01:43:10.015571+0000","last_clean":"2024-09-12T01:43:10.015571+0000","last_became_active":"2024-09-12T01:43:10.003872+0000","last_became_peered":"2024-09-12T01:43:10.003872+0000","last_unstale":"2024-09-12T01:43:10.015571+0000","last_undegraded":"2024-09-12T01:43:10.015571+0000","last_fullsized":"2024-09-12T01:43:10.015571+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:09.721296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.995418+0000","last_change":"2024-09-12T01:43:09.002404+0000","last_active":"2024-09-12T01:43:09.995418+0000","last_peered":"2024-09-12T01:43:09.995418+0000","last_clean":"2024-09-12T01:43:09.995418+0000","last_became_active":"2024-09-12T01:43:09.001771+0000","last_became_peered":"2024-09-12T01:43:09.001771+0000","last_unstale":"2024-09-12T01:43:09.995418+0000","last_undegraded":"2024-09-12T01:43:09.995418+0000","last_fullsized":"2024-09-12T01:43:09.995418+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:17.856167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.021093+0000","last_change":"2024-09-12T01:43:10.018067+0000","last_active":"2024-09-12T01:43:10.021093+0000","last_peered":"2024-09-12T01:43:10.021093+0000","last_clean":"2024-09-12T01:43:10.021093+0000","last_became_active":"2024-09-12T01:43:10.017807+0000","last_became_peered":"2024-09-12T01:43:10.017807+0000","last_unstale":"2024-09-12T01:43:10.021093+0000","last_undegraded":"2024-09-12T01:43:10.021093+0000","last_fullsized":"2024-09-12T01:43:10.021093+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:43.834846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990273+0000","last_change":"2024-09-12T01:43:09.005613+0000","last_active":"2024-09-12T01:43:09.990273+0000","last_peered":"2024-09-12T01:43:09.990273+0000","last_clean":"2024-09-12T01:43:09.990273+0000","last_became_active":"2024-09-12T01:43:09.005273+0000","last_became_peered":"2024-09-12T01:43:09.005273+0000","last_unstale":"2024-09-12T01:43:09.990273+0000","last_undegraded":"2024-09-12T01:43:09.990273+0000","last_fullsized":"2024-09-12T01:43:09.990273+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:13.562581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015940+0000","last_change":"2024-09-12T01:43:10.012096+0000","last_active":"2024-09-12T01:43:10.015940+0000","last_peered":"2024-09-12T01:43:10.015940+0000","last_clean":"2024-09-12T01:43:10.015940+0000","last_became_active":"2024-09-12T01:43:10.011810+0000","last_became_peered":"2024-09-12T01:43:10.011810+0000","last_unstale":"2024-09-12T01:43:10.015940+0000","last_undegraded":"2024-09-12T01:43:10.015940+0000","last_fullsized":"2024-09-12T01:43:10.015940+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:00.279516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.000655+0000","last_change":"2024-09-12T01:43:09.001024+0000","last_active":"2024-09-12T01:43:10.000655+0000","last_peered":"2024-09-12T01:43:10.000655+0000","last_clean":"2024-09-12T01:43:10.000655+0000","last_became_active":"2024-09-12T01:43:09.000634+0000","last_became_peered":"2024-09-12T01:43:09.000634+0000","last_unstale":"2024-09-12T01:43:10.000655+0000","last_undegraded":"2024-09-12T01:43:10.000655+0000","last_fullsized":"2024-09-12T01:43:10.000655+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:30.008018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.996725+0000","last_change":"2024-09-12T01:43:09.995813+0000","last_active":"2024-09-12T01:43:09.996725+0000","last_peered":"2024-09-12T01:43:09.996725+0000","last_clean":"2024-09-12T01:43:09.996725+0000","last_became_active":"2024-09-12T01:43:09.995491+0000","last_became_peered":"2024-09-12T01:43:09.995491+0000","last_unstale":"2024-09-12T01:43:09.996725+0000","last_undegraded":"2024-09-12T01:43:09.996725+0000","last_fullsized":"2024-09-12T01:43:09.996725+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:09.217265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017611+0000","last_change":"2024-09-12T01:43:09.000595+0000","last_active":"2024-09-12T01:43:10.017611+0000","last_peered":"2024-09-12T01:43:10.017611+0000","last_clean":"2024-09-12T01:43:10.017611+0000","last_became_active":"2024-09-12T01:43:09.000302+0000","last_became_peered":"2024-09-12T01:43:09.000302+0000","last_unstale":"2024-09-12T01:43:10.017611+0000","last_undegraded":"2024-09-12T01:43:10.017611+0000","last_fullsized":"2024-09-12T01:43:10.017611+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:41.886774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":345,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.994810+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:43:09.994810+0000","last_peered":"2024-09-12T01:43:09.994810+0000","last_clean":"2024-09-12T01:43:09.994810+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:43:09.994810+0000","last_undegraded":"2024-09-12T01:43:09.994810+0000","last_fullsized":"2024-09-12T01:43:09.994810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509534,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1445888,"data_stored":614112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1441792,"data_stored":614078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509532,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1197671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509532,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1445888,"data_stored":614148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36744,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335096,"statfs":{"total":96636764160,"available":96599138304,"internally_reserved":0,"allocated":1429504,"data_stored":607303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509532,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37352,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334488,"statfs":{"total":96636764160,"available":96598515712,"internally_reserved":0,"allocated":2052096,"data_stored":1206080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509533,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36780,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335060,"statfs":{"total":96636764160,"available":96599101440,"internally_reserved":0,"allocated":1462272,"data_stored":615746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1417216,"data_stored":601028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:43:12.981 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:43:13.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.120+0000 7f6b5f0ac640 1 Processor -- start 2024-09-12T01:43:13.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.120+0000 7f6b5f0ac640 1 -- start start 2024-09-12T01:43:13.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.120+0000 7f6b5f0ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b58073080 0x7f6b580b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.120+0000 7f6b5f0ac640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6b5815c670 0x7f6b58073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.121+0000 7f6b5f0ac640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b58071750 con 0x7f6b580b1990 2024-09-12T01:43:13.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.121+0000 7f6b5f0ac640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6b580d0c60 con 0x7f6b5815c670 2024-09-12T01:43:13.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.121+0000 7f6b5f0ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6b580d0370 con 0x7f6b58073080 2024-09-12T01:43:13.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.121+0000 7f6b57fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6b5815c670 0x7f6b58073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.121+0000 7f6b57fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6b5815c670 0x7f6b58073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53352/0 (socket says 172.21.15.60:53352) 2024-09-12T01:43:13.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.121+0000 7f6b57fff640 1 -- 172.21.15.60:0/3540833240 learned_addr learned my addr 172.21.15.60:0/3540833240 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:13.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.121+0000 7f6b5ce48640 1 --2- 172.21.15.60:0/3540833240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b58073080 0x7f6b580b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.121+0000 7f6b57fff640 1 -- 172.21.15.60:0/3540833240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b58073080 msgr2=0x7f6b580b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:13.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.121+0000 7f6b57fff640 1 --2- 172.21.15.60:0/3540833240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b58073080 0x7f6b580b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.121+0000 7f6b57fff640 1 -- 172.21.15.60:0/3540833240 >> v1:172.21.15.105:6789/0 conn(0x7f6b580b1990 legacy=0x7f6b580d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:13.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.121+0000 7f6b57fff640 1 -- 172.21.15.60:0/3540833240 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b580b59a0 con 0x7f6b5815c670 2024-09-12T01:43:13.123 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.122+0000 7f6b57fff640 1 --2- 172.21.15.60:0/3540833240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b5815c670 0x7f6b58073460 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009870 tx=0x7f6b4402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fdb4acbccd2147 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:13.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.122+0000 7f6b577fe640 1 -- 172.21.15.60:0/3540833240 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44037070 con 0x7f6b5815c670 2024-09-12T01:43:13.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.122+0000 7f6b577fe640 1 -- 172.21.15.60:0/3540833240 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b44032440 con 0x7f6b5815c670 2024-09-12T01:43:13.124 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.122+0000 7f6b577fe640 1 -- 172.21.15.60:0/3540833240 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44032810 con 0x7f6b5815c670 2024-09-12T01:43:13.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.122+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/3540833240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b5815c670 msgr2=0x7f6b58073460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.122+0000 7f6b5f0ac640 1 --2- 172.21.15.60:0/3540833240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b5815c670 0x7f6b58073460 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009870 tx=0x7f6b4402a210 comp rx=0 tx=0).stop 2024-09-12T01:43:13.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.122+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/3540833240 shutdown_connections 2024-09-12T01:43:13.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.122+0000 7f6b5f0ac640 1 --2- 172.21.15.60:0/3540833240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b5815c670 0x7f6b58073460 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.122+0000 7f6b5f0ac640 1 --2- 172.21.15.60:0/3540833240 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b58073080 0x7f6b580b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.122+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/3540833240 >> 172.21.15.60:0/3540833240 conn(0x7f6b580d24d0 msgr2=0x7f6b580d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:13.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.123+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/3540833240 shutdown_connections 2024-09-12T01:43:13.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.123+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/3540833240 wait complete. 2024-09-12T01:43:13.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.124+0000 7f6b5f0ac640 1 Processor -- start 2024-09-12T01:43:13.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.124+0000 7f6b5f0ac640 1 -- start start 2024-09-12T01:43:13.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b5f0ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b58073080 0x7f6b5815eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b5f0ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b580b1990 0x7f6b58143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b5f0ac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b5815c670 0x7f6b58151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b5f0ac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58071470 con 0x7f6b580b1990 2024-09-12T01:43:13.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b5f0ac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b58071190 con 0x7f6b5815c670 2024-09-12T01:43:13.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b5f0ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6b580d0610 con 0x7f6b58073080 2024-09-12T01:43:13.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b57fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b580b1990 0x7f6b58143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b57fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b580b1990 0x7f6b58143de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53366/0 (socket says 172.21.15.60:53366) 2024-09-12T01:43:13.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b57fff640 1 -- 172.21.15.60:0/1846505565 learned_addr learned my addr 172.21.15.60:0/1846505565 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:13.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b5ce48640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b58073080 0x7f6b5815eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b5d649640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b5815c670 0x7f6b58151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b57fff640 1 -- 172.21.15.60:0/1846505565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b58073080 msgr2=0x7f6b5815eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b57fff640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b58073080 0x7f6b5815eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b57fff640 1 -- 172.21.15.60:0/1846505565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b5815c670 msgr2=0x7f6b58151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b57fff640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b5815c670 0x7f6b58151e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b57fff640 1 -- 172.21.15.60:0/1846505565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b58144320 con 0x7f6b580b1990 2024-09-12T01:43:13.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b5ce48640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b58073080 0x7f6b5815eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:13.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b5d649640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b5815c670 0x7f6b58151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:13.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b57fff640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b580b1990 0x7f6b58143de0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009870 tx=0x7f6b440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:13.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b557fa640 1 -- 172.21.15.60:0/1846505565 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44041070 con 0x7f6b580b1990 2024-09-12T01:43:13.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b557fa640 1 -- 172.21.15.60:0/1846505565 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b4403c870 con 0x7f6b580b1990 2024-09-12T01:43:13.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/1846505565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5815f1a0 con 0x7f6b580b1990 2024-09-12T01:43:13.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b557fa640 1 -- 172.21.15.60:0/1846505565 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44037040 con 0x7f6b580b1990 2024-09-12T01:43:13.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.125+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/1846505565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b5815f760 con 0x7f6b580b1990 2024-09-12T01:43:13.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.126+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/1846505565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b5815f9a0 con 0x7f6b580b1990 2024-09-12T01:43:13.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.127+0000 7f6b557fa640 1 -- 172.21.15.60:0/1846505565 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b44044070 con 0x7f6b580b1990 2024-09-12T01:43:13.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.127+0000 7f6b557fa640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b3c06be30 0x7f6b3c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.128+0000 7f6b557fa640 1 -- 172.21.15.60:0/1846505565 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f6b440ab850 con 0x7f6b580b1990 2024-09-12T01:43:13.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.128+0000 7f6b5ce48640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b3c06be30 0x7f6b3c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.128+0000 7f6b5ce48640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b3c06be30 0x7f6b3c06e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c006fd0 tx=0x7f6b4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:13.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.132+0000 7f6b557fa640 1 -- 172.21.15.60:0/1846505565 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b5815f9a0 con 0x7f6b580b1990 2024-09-12T01:43:13.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.305+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/1846505565 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b580d08f0 con 0x7f6b3c06be30 2024-09-12T01:43:13.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.311+0000 7f6b557fa640 1 -- 172.21.15.60:0/1846505565 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250202 (secure 0 0 0) 0x7f6b580d08f0 con 0x7f6b3c06be30 2024-09-12T01:43:13.314 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:13.316 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:43:13.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.314+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/1846505565 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b3c06be30 msgr2=0x7f6b3c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.314+0000 7f6b5f0ac640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b3c06be30 0x7f6b3c06e2f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c006fd0 tx=0x7f6b4c008040 comp rx=0 tx=0).stop 2024-09-12T01:43:13.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.314+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/1846505565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b580b1990 msgr2=0x7f6b58143de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.314+0000 7f6b5f0ac640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b580b1990 0x7f6b58143de0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009870 tx=0x7f6b440046c0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.314+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/1846505565 shutdown_connections 2024-09-12T01:43:13.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.314+0000 7f6b5f0ac640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b5815c670 0x7f6b58151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.314+0000 7f6b5f0ac640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b580b1990 0x7f6b58143de0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.314+0000 7f6b5f0ac640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b3c06be30 0x7f6b3c06e2f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.314+0000 7f6b5f0ac640 1 --2- 172.21.15.60:0/1846505565 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b58073080 0x7f6b5815eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.314+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/1846505565 >> 172.21.15.60:0/1846505565 conn(0x7f6b580d24d0 msgr2=0x7f6b58157840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:13.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.314+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/1846505565 shutdown_connections 2024-09-12T01:43:13.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.314+0000 7f6b5f0ac640 1 -- 172.21.15.60:0/1846505565 wait complete. 2024-09-12T01:43:13.325 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-12T01:43:12.358619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":282744,"kb_used_data":12420,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754691976,"statfs":{"total":773094113280,"available":772804583424,"internally_reserved":0,"allocated":12718080,"data_stored":6070166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.381734"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012397+0000","last_change":"2024-09-12T01:43:10.010617+0000","last_active":"2024-09-12T01:43:10.012397+0000","last_peered":"2024-09-12T01:43:10.012397+0000","last_clean":"2024-09-12T01:43:10.012397+0000","last_became_active":"2024-09-12T01:43:10.010318+0000","last_became_peered":"2024-09-12T01:43:10.010318+0000","last_unstale":"2024-09-12T01:43:10.012397+0000","last_undegraded":"2024-09-12T01:43:10.012397+0000","last_fullsized":"2024-09-12T01:43:10.012397+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:00.998086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.003006+0000","last_change":"2024-09-12T01:43:09.999067+0000","last_active":"2024-09-12T01:43:10.003006+0000","last_peered":"2024-09-12T01:43:10.003006+0000","last_clean":"2024-09-12T01:43:10.003006+0000","last_became_active":"2024-09-12T01:43:09.998779+0000","last_became_peered":"2024-09-12T01:43:09.998779+0000","last_unstale":"2024-09-12T01:43:10.003006+0000","last_undegraded":"2024-09-12T01:43:10.003006+0000","last_fullsized":"2024-09-12T01:43:10.003006+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.436244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.009603+0000","last_change":"2024-09-12T01:43:10.007268+0000","last_active":"2024-09-12T01:43:10.009603+0000","last_peered":"2024-09-12T01:43:10.009603+0000","last_clean":"2024-09-12T01:43:10.009603+0000","last_became_active":"2024-09-12T01:43:10.006974+0000","last_became_peered":"2024-09-12T01:43:10.006974+0000","last_unstale":"2024-09-12T01:43:10.009603+0000","last_undegraded":"2024-09-12T01:43:10.009603+0000","last_fullsized":"2024-09-12T01:43:10.009603+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:45.313222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016364+0000","last_change":"2024-09-12T01:43:10.013407+0000","last_active":"2024-09-12T01:43:10.016364+0000","last_peered":"2024-09-12T01:43:10.016364+0000","last_clean":"2024-09-12T01:43:10.016364+0000","last_became_active":"2024-09-12T01:43:10.013078+0000","last_became_peered":"2024-09-12T01:43:10.013078+0000","last_unstale":"2024-09-12T01:43:10.016364+0000","last_undegraded":"2024-09-12T01:43:10.016364+0000","last_fullsized":"2024-09-12T01:43:10.016364+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:59.595180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.000806+0000","last_change":"2024-09-12T01:43:09.993325+0000","last_active":"2024-09-12T01:43:10.000806+0000","last_peered":"2024-09-12T01:43:10.000806+0000","last_clean":"2024-09-12T01:43:10.000806+0000","last_became_active":"2024-09-12T01:43:09.993003+0000","last_became_peered":"2024-09-12T01:43:09.993003+0000","last_unstale":"2024-09-12T01:43:10.000806+0000","last_undegraded":"2024-09-12T01:43:10.000806+0000","last_fullsized":"2024-09-12T01:43:10.000806+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:13.868284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.009578+0000","last_change":"2024-09-12T01:43:10.006897+0000","last_active":"2024-09-12T01:43:10.009578+0000","last_peered":"2024-09-12T01:43:10.009578+0000","last_clean":"2024-09-12T01:43:10.009578+0000","last_became_active":"2024-09-12T01:43:10.006607+0000","last_became_peered":"2024-09-12T01:43:10.006607+0000","last_unstale":"2024-09-12T01:43:10.009578+0000","last_undegraded":"2024-09-12T01:43:10.009578+0000","last_fullsized":"2024-09-12T01:43:10.009578+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:22.478063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.002936+0000","last_change":"2024-09-12T01:43:09.999698+0000","last_active":"2024-09-12T01:43:10.002936+0000","last_peered":"2024-09-12T01:43:10.002936+0000","last_clean":"2024-09-12T01:43:10.002936+0000","last_became_active":"2024-09-12T01:43:09.999370+0000","last_became_peered":"2024-09-12T01:43:09.999370+0000","last_unstale":"2024-09-12T01:43:10.002936+0000","last_undegraded":"2024-09-12T01:43:10.002936+0000","last_fullsized":"2024-09-12T01:43:10.002936+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:02.840344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010670+0000","last_change":"2024-09-12T01:43:10.007674+0000","last_active":"2024-09-12T01:43:10.010670+0000","last_peered":"2024-09-12T01:43:10.010670+0000","last_clean":"2024-09-12T01:43:10.010670+0000","last_became_active":"2024-09-12T01:43:10.006630+0000","last_became_peered":"2024-09-12T01:43:10.006630+0000","last_unstale":"2024-09-12T01:43:10.010670+0000","last_undegraded":"2024-09-12T01:43:10.010670+0000","last_fullsized":"2024-09-12T01:43:10.010670+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:43.082717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.019627+0000","last_change":"2024-09-12T01:43:10.017470+0000","last_active":"2024-09-12T01:43:10.019627+0000","last_peered":"2024-09-12T01:43:10.019627+0000","last_clean":"2024-09-12T01:43:10.019627+0000","last_became_active":"2024-09-12T01:43:10.017170+0000","last_became_peered":"2024-09-12T01:43:10.017170+0000","last_unstale":"2024-09-12T01:43:10.019627+0000","last_undegraded":"2024-09-12T01:43:10.019627+0000","last_fullsized":"2024-09-12T01:43:10.019627+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:10.230932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013106+0000","last_change":"2024-09-12T01:43:10.009228+0000","last_active":"2024-09-12T01:43:10.013106+0000","last_peered":"2024-09-12T01:43:10.013106+0000","last_clean":"2024-09-12T01:43:10.013106+0000","last_became_active":"2024-09-12T01:43:10.008772+0000","last_became_peered":"2024-09-12T01:43:10.008772+0000","last_unstale":"2024-09-12T01:43:10.013106+0000","last_undegraded":"2024-09-12T01:43:10.013106+0000","last_fullsized":"2024-09-12T01:43:10.013106+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:04.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015852+0000","last_change":"2024-09-12T01:43:10.010426+0000","last_active":"2024-09-12T01:43:10.015852+0000","last_peered":"2024-09-12T01:43:10.015852+0000","last_clean":"2024-09-12T01:43:10.015852+0000","last_became_active":"2024-09-12T01:43:10.010145+0000","last_became_peered":"2024-09-12T01:43:10.010145+0000","last_unstale":"2024-09-12T01:43:10.015852+0000","last_undegraded":"2024-09-12T01:43:10.015852+0000","last_fullsized":"2024-09-12T01:43:10.015852+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:14.568049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016141+0000","last_change":"2024-09-12T01:43:10.012384+0000","last_active":"2024-09-12T01:43:10.016141+0000","last_peered":"2024-09-12T01:43:10.016141+0000","last_clean":"2024-09-12T01:43:10.016141+0000","last_became_active":"2024-09-12T01:43:10.012073+0000","last_became_peered":"2024-09-12T01:43:10.012073+0000","last_unstale":"2024-09-12T01:43:10.016141+0000","last_undegraded":"2024-09-12T01:43:10.016141+0000","last_fullsized":"2024-09-12T01:43:10.016141+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:35.398682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010228+0000","last_change":"2024-09-12T01:43:10.005425+0000","last_active":"2024-09-12T01:43:10.010228+0000","last_peered":"2024-09-12T01:43:10.010228+0000","last_clean":"2024-09-12T01:43:10.010228+0000","last_became_active":"2024-09-12T01:43:10.005101+0000","last_became_peered":"2024-09-12T01:43:10.005101+0000","last_unstale":"2024-09-12T01:43:10.010228+0000","last_undegraded":"2024-09-12T01:43:10.010228+0000","last_fullsized":"2024-09-12T01:43:10.010228+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:45.075912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.996407+0000","last_change":"2024-09-12T01:43:09.994951+0000","last_active":"2024-09-12T01:43:09.996407+0000","last_peered":"2024-09-12T01:43:09.996407+0000","last_clean":"2024-09-12T01:43:09.996407+0000","last_became_active":"2024-09-12T01:43:09.994653+0000","last_became_peered":"2024-09-12T01:43:09.994653+0000","last_unstale":"2024-09-12T01:43:09.996407+0000","last_undegraded":"2024-09-12T01:43:09.996407+0000","last_fullsized":"2024-09-12T01:43:09.996407+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:28.947715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.018468+0000","last_change":"2024-09-12T01:43:10.013071+0000","last_active":"2024-09-12T01:43:10.018468+0000","last_peered":"2024-09-12T01:43:10.018468+0000","last_clean":"2024-09-12T01:43:10.018468+0000","last_became_active":"2024-09-12T01:43:10.012269+0000","last_became_peered":"2024-09-12T01:43:10.012269+0000","last_unstale":"2024-09-12T01:43:10.018468+0000","last_undegraded":"2024-09-12T01:43:10.018468+0000","last_fullsized":"2024-09-12T01:43:10.018468+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:30.956540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012952+0000","last_change":"2024-09-12T01:43:10.008649+0000","last_active":"2024-09-12T01:43:10.012952+0000","last_peered":"2024-09-12T01:43:10.012952+0000","last_clean":"2024-09-12T01:43:10.012952+0000","last_became_active":"2024-09-12T01:43:10.008285+0000","last_became_peered":"2024-09-12T01:43:10.008285+0000","last_unstale":"2024-09-12T01:43:10.012952+0000","last_undegraded":"2024-09-12T01:43:10.012952+0000","last_fullsized":"2024-09-12T01:43:10.012952+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:52.990907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.018040+0000","last_change":"2024-09-12T01:43:10.015834+0000","last_active":"2024-09-12T01:43:10.018040+0000","last_peered":"2024-09-12T01:43:10.018040+0000","last_clean":"2024-09-12T01:43:10.018040+0000","last_became_active":"2024-09-12T01:43:10.012836+0000","last_became_peered":"2024-09-12T01:43:10.012836+0000","last_unstale":"2024-09-12T01:43:10.018040+0000","last_undegraded":"2024-09-12T01:43:10.018040+0000","last_fullsized":"2024-09-12T01:43:10.018040+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:00.239866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016842+0000","last_change":"2024-09-12T01:43:10.015393+0000","last_active":"2024-09-12T01:43:10.016842+0000","last_peered":"2024-09-12T01:43:10.016842+0000","last_clean":"2024-09-12T01:43:10.016842+0000","last_became_active":"2024-09-12T01:43:10.015131+0000","last_became_peered":"2024-09-12T01:43:10.015131+0000","last_unstale":"2024-09-12T01:43:10.016842+0000","last_undegraded":"2024-09-12T01:43:10.016842+0000","last_fullsized":"2024-09-12T01:43:10.016842+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:51.240289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.021079+0000","last_change":"2024-09-12T01:43:10.017901+0000","last_active":"2024-09-12T01:43:10.021079+0000","last_peered":"2024-09-12T01:43:10.021079+0000","last_clean":"2024-09-12T01:43:10.021079+0000","last_became_active":"2024-09-12T01:43:10.017599+0000","last_became_peered":"2024-09-12T01:43:10.017599+0000","last_unstale":"2024-09-12T01:43:10.021079+0000","last_undegraded":"2024-09-12T01:43:10.021079+0000","last_fullsized":"2024-09-12T01:43:10.021079+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:23.039212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012926+0000","last_change":"2024-09-12T01:43:10.008416+0000","last_active":"2024-09-12T01:43:10.012926+0000","last_peered":"2024-09-12T01:43:10.012926+0000","last_clean":"2024-09-12T01:43:10.012926+0000","last_became_active":"2024-09-12T01:43:10.008149+0000","last_became_peered":"2024-09-12T01:43:10.008149+0000","last_unstale":"2024-09-12T01:43:10.012926+0000","last_undegraded":"2024-09-12T01:43:10.012926+0000","last_fullsized":"2024-09-12T01:43:10.012926+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:57.864742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.021030+0000","last_change":"2024-09-12T01:43:10.018610+0000","last_active":"2024-09-12T01:43:10.021030+0000","last_peered":"2024-09-12T01:43:10.021030+0000","last_clean":"2024-09-12T01:43:10.021030+0000","last_became_active":"2024-09-12T01:43:10.018313+0000","last_became_peered":"2024-09-12T01:43:10.018313+0000","last_unstale":"2024-09-12T01:43:10.021030+0000","last_undegraded":"2024-09-12T01:43:10.021030+0000","last_fullsized":"2024-09-12T01:43:10.021030+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.436244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.011049+0000","last_change":"2024-09-12T01:43:10.005034+0000","last_active":"2024-09-12T01:43:10.011049+0000","last_peered":"2024-09-12T01:43:10.011049+0000","last_clean":"2024-09-12T01:43:10.011049+0000","last_became_active":"2024-09-12T01:43:10.004647+0000","last_became_peered":"2024-09-12T01:43:10.004647+0000","last_unstale":"2024-09-12T01:43:10.011049+0000","last_undegraded":"2024-09-12T01:43:10.011049+0000","last_fullsized":"2024-09-12T01:43:10.011049+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:24.531059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013872+0000","last_change":"2024-09-12T01:43:10.010938+0000","last_active":"2024-09-12T01:43:10.013872+0000","last_peered":"2024-09-12T01:43:10.013872+0000","last_clean":"2024-09-12T01:43:10.013872+0000","last_became_active":"2024-09-12T01:43:10.010575+0000","last_became_peered":"2024-09-12T01:43:10.010575+0000","last_unstale":"2024-09-12T01:43:10.013872+0000","last_undegraded":"2024-09-12T01:43:10.013872+0000","last_fullsized":"2024-09-12T01:43:10.013872+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:13.973177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.002914+0000","last_change":"2024-09-12T01:43:09.999258+0000","last_active":"2024-09-12T01:43:10.002914+0000","last_peered":"2024-09-12T01:43:10.002914+0000","last_clean":"2024-09-12T01:43:10.002914+0000","last_became_active":"2024-09-12T01:43:09.998972+0000","last_became_peered":"2024-09-12T01:43:09.998972+0000","last_unstale":"2024-09-12T01:43:10.002914+0000","last_undegraded":"2024-09-12T01:43:10.002914+0000","last_fullsized":"2024-09-12T01:43:10.002914+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:08.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.004836+0000","last_change":"2024-09-12T01:43:10.002479+0000","last_active":"2024-09-12T01:43:10.004836+0000","last_peered":"2024-09-12T01:43:10.004836+0000","last_clean":"2024-09-12T01:43:10.004836+0000","last_became_active":"2024-09-12T01:43:10.001641+0000","last_became_peered":"2024-09-12T01:43:10.001641+0000","last_unstale":"2024-09-12T01:43:10.004836+0000","last_undegraded":"2024-09-12T01:43:10.004836+0000","last_fullsized":"2024-09-12T01:43:10.004836+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:10.230932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"116'4","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.014790+0000","last_change":"2024-09-12T01:43:08.999139+0000","last_active":"2024-09-12T01:43:10.014790+0000","last_peered":"2024-09-12T01:43:10.014790+0000","last_clean":"2024-09-12T01:43:10.014790+0000","last_became_active":"2024-09-12T01:43:08.998874+0000","last_became_peered":"2024-09-12T01:43:08.998874+0000","last_unstale":"2024-09-12T01:43:10.014790+0000","last_undegraded":"2024-09-12T01:43:10.014790+0000","last_fullsized":"2024-09-12T01:43:10.014790+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:12.086671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.999594+0000","last_change":"2024-09-12T01:43:09.998236+0000","last_active":"2024-09-12T01:43:09.999594+0000","last_peered":"2024-09-12T01:43:09.999594+0000","last_clean":"2024-09-12T01:43:09.999594+0000","last_became_active":"2024-09-12T01:43:09.996642+0000","last_became_peered":"2024-09-12T01:43:09.996642+0000","last_unstale":"2024-09-12T01:43:09.999594+0000","last_undegraded":"2024-09-12T01:43:09.999594+0000","last_fullsized":"2024-09-12T01:43:09.999594+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:33.470907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017670+0000","last_change":"2024-09-12T01:43:09.007149+0000","last_active":"2024-09-12T01:43:10.017670+0000","last_peered":"2024-09-12T01:43:10.017670+0000","last_clean":"2024-09-12T01:43:10.017670+0000","last_became_active":"2024-09-12T01:43:09.006801+0000","last_became_peered":"2024-09-12T01:43:09.006801+0000","last_unstale":"2024-09-12T01:43:10.017670+0000","last_undegraded":"2024-09-12T01:43:10.017670+0000","last_fullsized":"2024-09-12T01:43:10.017670+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:48.504193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013118+0000","last_change":"2024-09-12T01:43:10.012246+0000","last_active":"2024-09-12T01:43:10.013118+0000","last_peered":"2024-09-12T01:43:10.013118+0000","last_clean":"2024-09-12T01:43:10.013118+0000","last_became_active":"2024-09-12T01:43:10.011930+0000","last_became_peered":"2024-09-12T01:43:10.011930+0000","last_unstale":"2024-09-12T01:43:10.013118+0000","last_undegraded":"2024-09-12T01:43:10.013118+0000","last_fullsized":"2024-09-12T01:43:10.013118+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:32.799859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.007885+0000","last_change":"2024-09-12T01:43:08.998653+0000","last_active":"2024-09-12T01:43:10.007885+0000","last_peered":"2024-09-12T01:43:10.007885+0000","last_clean":"2024-09-12T01:43:10.007885+0000","last_became_active":"2024-09-12T01:43:08.998390+0000","last_became_peered":"2024-09-12T01:43:08.998390+0000","last_unstale":"2024-09-12T01:43:10.007885+0000","last_undegraded":"2024-09-12T01:43:10.007885+0000","last_fullsized":"2024-09-12T01:43:10.007885+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:18.419447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017106+0000","last_change":"2024-09-12T01:43:10.012472+0000","last_active":"2024-09-12T01:43:10.017106+0000","last_peered":"2024-09-12T01:43:10.017106+0000","last_clean":"2024-09-12T01:43:10.017106+0000","last_became_active":"2024-09-12T01:43:10.011808+0000","last_became_peered":"2024-09-12T01:43:10.011808+0000","last_unstale":"2024-09-12T01:43:10.017106+0000","last_undegraded":"2024-09-12T01:43:10.017106+0000","last_fullsized":"2024-09-12T01:43:10.017106+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:36.244472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-12T01:43:07.980762+0000","last_change":"2024-09-12T01:43:07.980762+0000","last_active":"2024-09-12T01:43:07.971297+0000","last_peered":"2024-09-12T01:43:07.971297+0000","last_clean":"2024-09-12T01:43:07.971297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:07.980762+0000","last_undegraded":"2024-09-12T01:43:07.980762+0000","last_fullsized":"2024-09-12T01:43:07.980762+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016192+0000","last_change":"2024-09-12T01:43:10.012454+0000","last_active":"2024-09-12T01:43:10.016192+0000","last_peered":"2024-09-12T01:43:10.016192+0000","last_clean":"2024-09-12T01:43:10.016192+0000","last_became_active":"2024-09-12T01:43:10.012121+0000","last_became_peered":"2024-09-12T01:43:10.012121+0000","last_unstale":"2024-09-12T01:43:10.016192+0000","last_undegraded":"2024-09-12T01:43:10.016192+0000","last_fullsized":"2024-09-12T01:43:10.016192+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:18.967832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-12T01:43:07.981284+0000","last_change":"2024-09-12T01:43:07.981284+0000","last_active":"2024-09-12T01:43:07.971297+0000","last_peered":"2024-09-12T01:43:07.971297+0000","last_clean":"2024-09-12T01:43:07.971297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:07.981284+0000","last_undegraded":"2024-09-12T01:43:07.981284+0000","last_fullsized":"2024-09-12T01:43:07.981284+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016452+0000","last_change":"2024-09-12T01:43:10.015386+0000","last_active":"2024-09-12T01:43:10.016452+0000","last_peered":"2024-09-12T01:43:10.016452+0000","last_clean":"2024-09-12T01:43:10.016452+0000","last_became_active":"2024-09-12T01:43:10.012428+0000","last_became_peered":"2024-09-12T01:43:10.012428+0000","last_unstale":"2024-09-12T01:43:10.016452+0000","last_undegraded":"2024-09-12T01:43:10.016452+0000","last_fullsized":"2024-09-12T01:43:10.016452+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:04.591571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.008395+0000","last_change":"2024-09-12T01:43:08.997463+0000","last_active":"2024-09-12T01:43:10.008395+0000","last_peered":"2024-09-12T01:43:10.008395+0000","last_clean":"2024-09-12T01:43:10.008395+0000","last_became_active":"2024-09-12T01:43:08.994321+0000","last_became_peered":"2024-09-12T01:43:08.994321+0000","last_unstale":"2024-09-12T01:43:10.008395+0000","last_undegraded":"2024-09-12T01:43:10.008395+0000","last_fullsized":"2024-09-12T01:43:10.008395+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:57.845182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.020328+0000","last_change":"2024-09-12T01:43:10.016198+0000","last_active":"2024-09-12T01:43:10.020328+0000","last_peered":"2024-09-12T01:43:10.020328+0000","last_clean":"2024-09-12T01:43:10.020328+0000","last_became_active":"2024-09-12T01:43:10.015942+0000","last_became_peered":"2024-09-12T01:43:10.015942+0000","last_unstale":"2024-09-12T01:43:10.020328+0000","last_undegraded":"2024-09-12T01:43:10.020328+0000","last_fullsized":"2024-09-12T01:43:10.020328+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:50.905796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.986853+0000","last_change":"2024-09-12T01:43:08.998565+0000","last_active":"2024-09-12T01:43:09.986853+0000","last_peered":"2024-09-12T01:43:09.986853+0000","last_clean":"2024-09-12T01:43:09.986853+0000","last_became_active":"2024-09-12T01:43:08.998292+0000","last_became_peered":"2024-09-12T01:43:08.998292+0000","last_unstale":"2024-09-12T01:43:09.986853+0000","last_undegraded":"2024-09-12T01:43:09.986853+0000","last_fullsized":"2024-09-12T01:43:09.986853+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.559247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-12T01:43:07.980944+0000","last_change":"2024-09-12T01:43:07.980944+0000","last_active":"2024-09-12T01:43:07.971297+0000","last_peered":"2024-09-12T01:43:07.971297+0000","last_clean":"2024-09-12T01:43:07.971297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:07.980944+0000","last_undegraded":"2024-09-12T01:43:07.980944+0000","last_fullsized":"2024-09-12T01:43:07.980944+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.996699+0000","last_change":"2024-09-12T01:43:09.005035+0000","last_active":"2024-09-12T01:43:09.996699+0000","last_peered":"2024-09-12T01:43:09.996699+0000","last_clean":"2024-09-12T01:43:09.996699+0000","last_became_active":"2024-09-12T01:43:09.003567+0000","last_became_peered":"2024-09-12T01:43:09.003567+0000","last_unstale":"2024-09-12T01:43:09.996699+0000","last_undegraded":"2024-09-12T01:43:09.996699+0000","last_fullsized":"2024-09-12T01:43:09.996699+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:29.476489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.008408+0000","last_change":"2024-09-12T01:43:10.006087+0000","last_active":"2024-09-12T01:43:10.008408+0000","last_peered":"2024-09-12T01:43:10.008408+0000","last_clean":"2024-09-12T01:43:10.008408+0000","last_became_active":"2024-09-12T01:43:10.003431+0000","last_became_peered":"2024-09-12T01:43:10.003431+0000","last_unstale":"2024-09-12T01:43:10.008408+0000","last_undegraded":"2024-09-12T01:43:10.008408+0000","last_fullsized":"2024-09-12T01:43:10.008408+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:18.861635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.999813+0000","last_change":"2024-09-12T01:43:09.000223+0000","last_active":"2024-09-12T01:43:09.999813+0000","last_peered":"2024-09-12T01:43:09.999813+0000","last_clean":"2024-09-12T01:43:09.999813+0000","last_became_active":"2024-09-12T01:43:08.999881+0000","last_became_peered":"2024-09-12T01:43:08.999881+0000","last_unstale":"2024-09-12T01:43:09.999813+0000","last_undegraded":"2024-09-12T01:43:09.999813+0000","last_fullsized":"2024-09-12T01:43:09.999813+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:50.234821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.020142+0000","last_change":"2024-09-12T01:43:10.017833+0000","last_active":"2024-09-12T01:43:10.020142+0000","last_peered":"2024-09-12T01:43:10.020142+0000","last_clean":"2024-09-12T01:43:10.020142+0000","last_became_active":"2024-09-12T01:43:10.017506+0000","last_became_peered":"2024-09-12T01:43:10.017506+0000","last_unstale":"2024-09-12T01:43:10.020142+0000","last_undegraded":"2024-09-12T01:43:10.020142+0000","last_fullsized":"2024-09-12T01:43:10.020142+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:12.885550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"116'3","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.014580+0000","last_change":"2024-09-12T01:43:08.999971+0000","last_active":"2024-09-12T01:43:10.014580+0000","last_peered":"2024-09-12T01:43:10.014580+0000","last_clean":"2024-09-12T01:43:10.014580+0000","last_became_active":"2024-09-12T01:43:08.999656+0000","last_became_peered":"2024-09-12T01:43:08.999656+0000","last_unstale":"2024-09-12T01:43:10.014580+0000","last_undegraded":"2024-09-12T01:43:10.014580+0000","last_fullsized":"2024-09-12T01:43:10.014580+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:08.248385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.019658+0000","last_change":"2024-09-12T01:43:10.018504+0000","last_active":"2024-09-12T01:43:10.019658+0000","last_peered":"2024-09-12T01:43:10.019658+0000","last_clean":"2024-09-12T01:43:10.019658+0000","last_became_active":"2024-09-12T01:43:10.018223+0000","last_became_peered":"2024-09-12T01:43:10.018223+0000","last_unstale":"2024-09-12T01:43:10.019658+0000","last_undegraded":"2024-09-12T01:43:10.019658+0000","last_fullsized":"2024-09-12T01:43:10.019658+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:52.990907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"116'6","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.022053+0000","last_change":"2024-09-12T01:43:09.004240+0000","last_active":"2024-09-12T01:43:10.022053+0000","last_peered":"2024-09-12T01:43:10.022053+0000","last_clean":"2024-09-12T01:43:10.022053+0000","last_became_active":"2024-09-12T01:43:09.003936+0000","last_became_peered":"2024-09-12T01:43:09.003936+0000","last_unstale":"2024-09-12T01:43:10.022053+0000","last_undegraded":"2024-09-12T01:43:10.022053+0000","last_fullsized":"2024-09-12T01:43:10.022053+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.733832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.007333+0000","last_change":"2024-09-12T01:43:10.005212+0000","last_active":"2024-09-12T01:43:10.007333+0000","last_peered":"2024-09-12T01:43:10.007333+0000","last_clean":"2024-09-12T01:43:10.007333+0000","last_became_active":"2024-09-12T01:43:10.004914+0000","last_became_peered":"2024-09-12T01:43:10.004914+0000","last_unstale":"2024-09-12T01:43:10.007333+0000","last_undegraded":"2024-09-12T01:43:10.007333+0000","last_fullsized":"2024-09-12T01:43:10.007333+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:12.885550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.998201+0000","last_change":"2024-09-12T01:43:08.996819+0000","last_active":"2024-09-12T01:43:09.998201+0000","last_peered":"2024-09-12T01:43:09.998201+0000","last_clean":"2024-09-12T01:43:09.998201+0000","last_became_active":"2024-09-12T01:43:08.996524+0000","last_became_peered":"2024-09-12T01:43:08.996524+0000","last_unstale":"2024-09-12T01:43:09.998201+0000","last_undegraded":"2024-09-12T01:43:09.998201+0000","last_fullsized":"2024-09-12T01:43:09.998201+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:59.234398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010251+0000","last_change":"2024-09-12T01:43:10.005816+0000","last_active":"2024-09-12T01:43:10.010251+0000","last_peered":"2024-09-12T01:43:10.010251+0000","last_clean":"2024-09-12T01:43:10.010251+0000","last_became_active":"2024-09-12T01:43:10.005542+0000","last_became_peered":"2024-09-12T01:43:10.005542+0000","last_unstale":"2024-09-12T01:43:10.010251+0000","last_undegraded":"2024-09-12T01:43:10.010251+0000","last_fullsized":"2024-09-12T01:43:10.010251+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.088992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990122+0000","last_change":"2024-09-12T01:43:09.005250+0000","last_active":"2024-09-12T01:43:09.990122+0000","last_peered":"2024-09-12T01:43:09.990122+0000","last_clean":"2024-09-12T01:43:09.990122+0000","last_became_active":"2024-09-12T01:43:09.004791+0000","last_became_peered":"2024-09-12T01:43:09.004791+0000","last_unstale":"2024-09-12T01:43:09.990122+0000","last_undegraded":"2024-09-12T01:43:09.990122+0000","last_fullsized":"2024-09-12T01:43:09.990122+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:26.568406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016389+0000","last_change":"2024-09-12T01:43:10.014855+0000","last_active":"2024-09-12T01:43:10.016389+0000","last_peered":"2024-09-12T01:43:10.016389+0000","last_clean":"2024-09-12T01:43:10.016389+0000","last_became_active":"2024-09-12T01:43:10.014592+0000","last_became_peered":"2024-09-12T01:43:10.014592+0000","last_unstale":"2024-09-12T01:43:10.016389+0000","last_undegraded":"2024-09-12T01:43:10.016389+0000","last_fullsized":"2024-09-12T01:43:10.016389+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:17.976343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"116'8","reported_seq":20,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.020601+0000","last_change":"2024-09-12T01:43:09.002635+0000","last_active":"2024-09-12T01:43:10.020601+0000","last_peered":"2024-09-12T01:43:10.020601+0000","last_clean":"2024-09-12T01:43:10.020601+0000","last_became_active":"2024-09-12T01:43:09.002101+0000","last_became_peered":"2024-09-12T01:43:09.002101+0000","last_unstale":"2024-09-12T01:43:10.020601+0000","last_undegraded":"2024-09-12T01:43:10.020601+0000","last_fullsized":"2024-09-12T01:43:10.020601+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:44.307753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013813+0000","last_change":"2024-09-12T01:43:10.008983+0000","last_active":"2024-09-12T01:43:10.013813+0000","last_peered":"2024-09-12T01:43:10.013813+0000","last_clean":"2024-09-12T01:43:10.013813+0000","last_became_active":"2024-09-12T01:43:10.008679+0000","last_became_peered":"2024-09-12T01:43:10.008679+0000","last_unstale":"2024-09-12T01:43:10.013813+0000","last_undegraded":"2024-09-12T01:43:10.013813+0000","last_fullsized":"2024-09-12T01:43:10.013813+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:30.481957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017621+0000","last_change":"2024-09-12T01:43:09.001656+0000","last_active":"2024-09-12T01:43:10.017621+0000","last_peered":"2024-09-12T01:43:10.017621+0000","last_clean":"2024-09-12T01:43:10.017621+0000","last_became_active":"2024-09-12T01:43:09.000503+0000","last_became_peered":"2024-09-12T01:43:09.000503+0000","last_unstale":"2024-09-12T01:43:10.017621+0000","last_undegraded":"2024-09-12T01:43:10.017621+0000","last_fullsized":"2024-09-12T01:43:10.017621+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:21.472595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.008383+0000","last_change":"2024-09-12T01:43:10.005510+0000","last_active":"2024-09-12T01:43:10.008383+0000","last_peered":"2024-09-12T01:43:10.008383+0000","last_clean":"2024-09-12T01:43:10.008383+0000","last_became_active":"2024-09-12T01:43:10.002150+0000","last_became_peered":"2024-09-12T01:43:10.002150+0000","last_unstale":"2024-09-12T01:43:10.008383+0000","last_undegraded":"2024-09-12T01:43:10.008383+0000","last_fullsized":"2024-09-12T01:43:10.008383+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.892242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.014360+0000","last_change":"2024-09-12T01:43:08.997611+0000","last_active":"2024-09-12T01:43:10.014360+0000","last_peered":"2024-09-12T01:43:10.014360+0000","last_clean":"2024-09-12T01:43:10.014360+0000","last_became_active":"2024-09-12T01:43:08.997299+0000","last_became_peered":"2024-09-12T01:43:08.997299+0000","last_unstale":"2024-09-12T01:43:10.014360+0000","last_undegraded":"2024-09-12T01:43:10.014360+0000","last_fullsized":"2024-09-12T01:43:10.014360+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:59.274047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.011710+0000","last_change":"2024-09-12T01:43:09.002198+0000","last_active":"2024-09-12T01:43:10.011710+0000","last_peered":"2024-09-12T01:43:10.011710+0000","last_clean":"2024-09-12T01:43:10.011710+0000","last_became_active":"2024-09-12T01:43:09.001925+0000","last_became_peered":"2024-09-12T01:43:09.001925+0000","last_unstale":"2024-09-12T01:43:10.011710+0000","last_undegraded":"2024-09-12T01:43:10.011710+0000","last_fullsized":"2024-09-12T01:43:10.011710+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:33.130766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990176+0000","last_change":"2024-09-12T01:43:08.991805+0000","last_active":"2024-09-12T01:43:09.990176+0000","last_peered":"2024-09-12T01:43:09.990176+0000","last_clean":"2024-09-12T01:43:09.990176+0000","last_became_active":"2024-09-12T01:43:08.991517+0000","last_became_peered":"2024-09-12T01:43:08.991517+0000","last_unstale":"2024-09-12T01:43:09.990176+0000","last_undegraded":"2024-09-12T01:43:09.990176+0000","last_fullsized":"2024-09-12T01:43:09.990176+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:16.731138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013877+0000","last_change":"2024-09-12T01:43:09.002910+0000","last_active":"2024-09-12T01:43:10.013877+0000","last_peered":"2024-09-12T01:43:10.013877+0000","last_clean":"2024-09-12T01:43:10.013877+0000","last_became_active":"2024-09-12T01:43:09.002618+0000","last_became_peered":"2024-09-12T01:43:09.002618+0000","last_unstale":"2024-09-12T01:43:10.013877+0000","last_undegraded":"2024-09-12T01:43:10.013877+0000","last_fullsized":"2024-09-12T01:43:10.013877+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:37.911468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010952+0000","last_change":"2024-09-12T01:43:10.003250+0000","last_active":"2024-09-12T01:43:10.010952+0000","last_peered":"2024-09-12T01:43:10.010952+0000","last_clean":"2024-09-12T01:43:10.010952+0000","last_became_active":"2024-09-12T01:43:10.002434+0000","last_became_peered":"2024-09-12T01:43:10.002434+0000","last_unstale":"2024-09-12T01:43:10.010952+0000","last_undegraded":"2024-09-12T01:43:10.010952+0000","last_fullsized":"2024-09-12T01:43:10.010952+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:58.850651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.994201+0000","last_change":"2024-09-12T01:43:08.998911+0000","last_active":"2024-09-12T01:43:09.994201+0000","last_peered":"2024-09-12T01:43:09.994201+0000","last_clean":"2024-09-12T01:43:09.994201+0000","last_became_active":"2024-09-12T01:43:08.998521+0000","last_became_peered":"2024-09-12T01:43:08.998521+0000","last_unstale":"2024-09-12T01:43:09.994201+0000","last_undegraded":"2024-09-12T01:43:09.994201+0000","last_fullsized":"2024-09-12T01:43:09.994201+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:23.525590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015958+0000","last_change":"2024-09-12T01:43:10.011401+0000","last_active":"2024-09-12T01:43:10.015958+0000","last_peered":"2024-09-12T01:43:10.015958+0000","last_clean":"2024-09-12T01:43:10.015958+0000","last_became_active":"2024-09-12T01:43:10.011126+0000","last_became_peered":"2024-09-12T01:43:10.011126+0000","last_unstale":"2024-09-12T01:43:10.015958+0000","last_undegraded":"2024-09-12T01:43:10.015958+0000","last_fullsized":"2024-09-12T01:43:10.015958+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:19.424916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.998630+0000","last_change":"2024-09-12T01:43:09.004606+0000","last_active":"2024-09-12T01:43:09.998630+0000","last_peered":"2024-09-12T01:43:09.998630+0000","last_clean":"2024-09-12T01:43:09.998630+0000","last_became_active":"2024-09-12T01:43:09.004182+0000","last_became_peered":"2024-09-12T01:43:09.004182+0000","last_unstale":"2024-09-12T01:43:09.998630+0000","last_undegraded":"2024-09-12T01:43:09.998630+0000","last_fullsized":"2024-09-12T01:43:09.998630+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:49.900328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012891+0000","last_change":"2024-09-12T01:43:10.008207+0000","last_active":"2024-09-12T01:43:10.012891+0000","last_peered":"2024-09-12T01:43:10.012891+0000","last_clean":"2024-09-12T01:43:10.012891+0000","last_became_active":"2024-09-12T01:43:10.007942+0000","last_became_peered":"2024-09-12T01:43:10.007942+0000","last_unstale":"2024-09-12T01:43:10.012891+0000","last_undegraded":"2024-09-12T01:43:10.012891+0000","last_fullsized":"2024-09-12T01:43:10.012891+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:02.422050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.989883+0000","last_change":"2024-09-12T01:43:08.998574+0000","last_active":"2024-09-12T01:43:09.989883+0000","last_peered":"2024-09-12T01:43:09.989883+0000","last_clean":"2024-09-12T01:43:09.989883+0000","last_became_active":"2024-09-12T01:43:08.998295+0000","last_became_peered":"2024-09-12T01:43:08.998295+0000","last_unstale":"2024-09-12T01:43:09.989883+0000","last_undegraded":"2024-09-12T01:43:09.989883+0000","last_fullsized":"2024-09-12T01:43:09.989883+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:44.083523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010961+0000","last_change":"2024-09-12T01:43:10.006771+0000","last_active":"2024-09-12T01:43:10.010961+0000","last_peered":"2024-09-12T01:43:10.010961+0000","last_clean":"2024-09-12T01:43:10.010961+0000","last_became_active":"2024-09-12T01:43:10.006483+0000","last_became_peered":"2024-09-12T01:43:10.006483+0000","last_unstale":"2024-09-12T01:43:10.010961+0000","last_undegraded":"2024-09-12T01:43:10.010961+0000","last_fullsized":"2024-09-12T01:43:10.010961+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:39.623929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.004225+0000","last_change":"2024-09-12T01:43:08.999378+0000","last_active":"2024-09-12T01:43:10.004225+0000","last_peered":"2024-09-12T01:43:10.004225+0000","last_clean":"2024-09-12T01:43:10.004225+0000","last_became_active":"2024-09-12T01:43:08.999097+0000","last_became_peered":"2024-09-12T01:43:08.999097+0000","last_unstale":"2024-09-12T01:43:10.004225+0000","last_undegraded":"2024-09-12T01:43:10.004225+0000","last_fullsized":"2024-09-12T01:43:10.004225+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:38.618460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990685+0000","last_change":"2024-09-12T01:43:09.005092+0000","last_active":"2024-09-12T01:43:09.990685+0000","last_peered":"2024-09-12T01:43:09.990685+0000","last_clean":"2024-09-12T01:43:09.990685+0000","last_became_active":"2024-09-12T01:43:09.004744+0000","last_became_peered":"2024-09-12T01:43:09.004744+0000","last_unstale":"2024-09-12T01:43:09.990685+0000","last_undegraded":"2024-09-12T01:43:09.990685+0000","last_fullsized":"2024-09-12T01:43:09.990685+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.790944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013190+0000","last_change":"2024-09-12T01:43:10.009557+0000","last_active":"2024-09-12T01:43:10.013190+0000","last_peered":"2024-09-12T01:43:10.013190+0000","last_clean":"2024-09-12T01:43:10.013190+0000","last_became_active":"2024-09-12T01:43:10.009200+0000","last_became_peered":"2024-09-12T01:43:10.009200+0000","last_unstale":"2024-09-12T01:43:10.013190+0000","last_undegraded":"2024-09-12T01:43:10.013190+0000","last_fullsized":"2024-09-12T01:43:10.013190+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:27.573875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.998825+0000","last_change":"2024-09-12T01:43:09.005025+0000","last_active":"2024-09-12T01:43:09.998825+0000","last_peered":"2024-09-12T01:43:09.998825+0000","last_clean":"2024-09-12T01:43:09.998825+0000","last_became_active":"2024-09-12T01:43:09.004716+0000","last_became_peered":"2024-09-12T01:43:09.004716+0000","last_unstale":"2024-09-12T01:43:09.998825+0000","last_undegraded":"2024-09-12T01:43:09.998825+0000","last_fullsized":"2024-09-12T01:43:09.998825+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:12.967708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.011002+0000","last_change":"2024-09-12T01:43:10.008340+0000","last_active":"2024-09-12T01:43:10.011002+0000","last_peered":"2024-09-12T01:43:10.011002+0000","last_clean":"2024-09-12T01:43:10.011002+0000","last_became_active":"2024-09-12T01:43:10.008060+0000","last_became_peered":"2024-09-12T01:43:10.008060+0000","last_unstale":"2024-09-12T01:43:10.011002+0000","last_undegraded":"2024-09-12T01:43:10.011002+0000","last_fullsized":"2024-09-12T01:43:10.011002+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.690408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.997967+0000","last_change":"2024-09-12T01:43:09.001072+0000","last_active":"2024-09-12T01:43:09.997967+0000","last_peered":"2024-09-12T01:43:09.997967+0000","last_clean":"2024-09-12T01:43:09.997967+0000","last_became_active":"2024-09-12T01:43:09.000603+0000","last_became_peered":"2024-09-12T01:43:09.000603+0000","last_unstale":"2024-09-12T01:43:09.997967+0000","last_undegraded":"2024-09-12T01:43:09.997967+0000","last_fullsized":"2024-09-12T01:43:09.997967+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:03.586102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016401+0000","last_change":"2024-09-12T01:43:10.015102+0000","last_active":"2024-09-12T01:43:10.016401+0000","last_peered":"2024-09-12T01:43:10.016401+0000","last_clean":"2024-09-12T01:43:10.016401+0000","last_became_active":"2024-09-12T01:43:10.012654+0000","last_became_peered":"2024-09-12T01:43:10.012654+0000","last_unstale":"2024-09-12T01:43:10.016401+0000","last_undegraded":"2024-09-12T01:43:10.016401+0000","last_fullsized":"2024-09-12T01:43:10.016401+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:06.891635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-12T01:43:07.980755+0000","last_change":"2024-09-12T01:43:07.980755+0000","last_active":"2024-09-12T01:43:07.971297+0000","last_peered":"2024-09-12T01:43:07.971297+0000","last_clean":"2024-09-12T01:43:07.971297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:07.980755+0000","last_undegraded":"2024-09-12T01:43:07.980755+0000","last_fullsized":"2024-09-12T01:43:07.980755+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015571+0000","last_change":"2024-09-12T01:43:10.007677+0000","last_active":"2024-09-12T01:43:10.015571+0000","last_peered":"2024-09-12T01:43:10.015571+0000","last_clean":"2024-09-12T01:43:10.015571+0000","last_became_active":"2024-09-12T01:43:10.003872+0000","last_became_peered":"2024-09-12T01:43:10.003872+0000","last_unstale":"2024-09-12T01:43:10.015571+0000","last_undegraded":"2024-09-12T01:43:10.015571+0000","last_fullsized":"2024-09-12T01:43:10.015571+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:09.721296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.995418+0000","last_change":"2024-09-12T01:43:09.002404+0000","last_active":"2024-09-12T01:43:09.995418+0000","last_peered":"2024-09-12T01:43:09.995418+0000","last_clean":"2024-09-12T01:43:09.995418+0000","last_became_active":"2024-09-12T01:43:09.001771+0000","last_became_peered":"2024-09-12T01:43:09.001771+0000","last_unstale":"2024-09-12T01:43:09.995418+0000","last_undegraded":"2024-09-12T01:43:09.995418+0000","last_fullsized":"2024-09-12T01:43:09.995418+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:17.856167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.021093+0000","last_change":"2024-09-12T01:43:10.018067+0000","last_active":"2024-09-12T01:43:10.021093+0000","last_peered":"2024-09-12T01:43:10.021093+0000","last_clean":"2024-09-12T01:43:10.021093+0000","last_became_active":"2024-09-12T01:43:10.017807+0000","last_became_peered":"2024-09-12T01:43:10.017807+0000","last_unstale":"2024-09-12T01:43:10.021093+0000","last_undegraded":"2024-09-12T01:43:10.021093+0000","last_fullsized":"2024-09-12T01:43:10.021093+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:43.834846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990273+0000","last_change":"2024-09-12T01:43:09.005613+0000","last_active":"2024-09-12T01:43:09.990273+0000","last_peered":"2024-09-12T01:43:09.990273+0000","last_clean":"2024-09-12T01:43:09.990273+0000","last_became_active":"2024-09-12T01:43:09.005273+0000","last_became_peered":"2024-09-12T01:43:09.005273+0000","last_unstale":"2024-09-12T01:43:09.990273+0000","last_undegraded":"2024-09-12T01:43:09.990273+0000","last_fullsized":"2024-09-12T01:43:09.990273+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:13.562581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015940+0000","last_change":"2024-09-12T01:43:10.012096+0000","last_active":"2024-09-12T01:43:10.015940+0000","last_peered":"2024-09-12T01:43:10.015940+0000","last_clean":"2024-09-12T01:43:10.015940+0000","last_became_active":"2024-09-12T01:43:10.011810+0000","last_became_peered":"2024-09-12T01:43:10.011810+0000","last_unstale":"2024-09-12T01:43:10.015940+0000","last_undegraded":"2024-09-12T01:43:10.015940+0000","last_fullsized":"2024-09-12T01:43:10.015940+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:00.279516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.000655+0000","last_change":"2024-09-12T01:43:09.001024+0000","last_active":"2024-09-12T01:43:10.000655+0000","last_peered":"2024-09-12T01:43:10.000655+0000","last_clean":"2024-09-12T01:43:10.000655+0000","last_became_active":"2024-09-12T01:43:09.000634+0000","last_became_peered":"2024-09-12T01:43:09.000634+0000","last_unstale":"2024-09-12T01:43:10.000655+0000","last_undegraded":"2024-09-12T01:43:10.000655+0000","last_fullsized":"2024-09-12T01:43:10.000655+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:30.008018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.996725+0000","last_change":"2024-09-12T01:43:09.995813+0000","last_active":"2024-09-12T01:43:09.996725+0000","last_peered":"2024-09-12T01:43:09.996725+0000","last_clean":"2024-09-12T01:43:09.996725+0000","last_became_active":"2024-09-12T01:43:09.995491+0000","last_became_peered":"2024-09-12T01:43:09.995491+0000","last_unstale":"2024-09-12T01:43:09.996725+0000","last_undegraded":"2024-09-12T01:43:09.996725+0000","last_fullsized":"2024-09-12T01:43:09.996725+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:09.217265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017611+0000","last_change":"2024-09-12T01:43:09.000595+0000","last_active":"2024-09-12T01:43:10.017611+0000","last_peered":"2024-09-12T01:43:10.017611+0000","last_clean":"2024-09-12T01:43:10.017611+0000","last_became_active":"2024-09-12T01:43:09.000302+0000","last_became_peered":"2024-09-12T01:43:09.000302+0000","last_unstale":"2024-09-12T01:43:10.017611+0000","last_undegraded":"2024-09-12T01:43:10.017611+0000","last_fullsized":"2024-09-12T01:43:10.017611+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:41.886774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":345,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.994810+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:43:09.994810+0000","last_peered":"2024-09-12T01:43:09.994810+0000","last_clean":"2024-09-12T01:43:09.994810+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:43:09.994810+0000","last_undegraded":"2024-09-12T01:43:09.994810+0000","last_fullsized":"2024-09-12T01:43:09.994810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509534,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1445888,"data_stored":614112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1441792,"data_stored":614078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509532,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1197671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509532,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1445888,"data_stored":614148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36744,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335096,"statfs":{"total":96636764160,"available":96599138304,"internally_reserved":0,"allocated":1429504,"data_stored":607303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509532,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37352,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334488,"statfs":{"total":96636764160,"available":96598515712,"internally_reserved":0,"allocated":2052096,"data_stored":1206080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509533,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36780,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335060,"statfs":{"total":96636764160,"available":96599101440,"internally_reserved":0,"allocated":1462272,"data_stored":615746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1417216,"data_stored":601028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:43:13.329 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:43:13.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.468+0000 7f194bf86640 1 Processor -- start 2024-09-12T01:43:13.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.468+0000 7f194bf86640 1 -- start start 2024-09-12T01:43:13.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.469+0000 7f194bf86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19440b63d0 0x7f19440d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.469+0000 7f194bf86640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19440cfc20 con 0x7f19440cf6b0 2024-09-12T01:43:13.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.469+0000 7f194bf86640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19440d2ed0 con 0x7f19440d1c80 2024-09-12T01:43:13.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.469+0000 7f194bf86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f19440d31b0 con 0x7f19440b63d0 2024-09-12T01:43:13.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.469+0000 7f1949521640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f19440cf6b0 0x7f19440b7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50274/0 (socket says 172.21.15.60:50274) 2024-09-12T01:43:13.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.469+0000 7f1949521640 1 -- 172.21.15.60:0/9408073 learned_addr learned my addr 172.21.15.60:0/9408073 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:13.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.469+0000 7f1949d22640 1 --2- 172.21.15.60:0/9408073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19440b63d0 0x7f19440d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.469+0000 7f1948d20640 1 -- 172.21.15.60:0/9408073 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755854994 0 0) 0x7f19440cfc20 con 0x7f19440cf6b0 2024-09-12T01:43:13.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.469+0000 7f1948d20640 1 -- 172.21.15.60:0/9408073 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1930003520 con 0x7f19440cf6b0 2024-09-12T01:43:13.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.470+0000 7f1948d20640 1 -- 172.21.15.60:0/9408073 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1601366907 0 0) 0x7f19440d2ed0 con 0x7f19440d1c80 2024-09-12T01:43:13.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.470+0000 7f1949d22640 1 -- 172.21.15.60:0/9408073 >> v1:172.21.15.105:6789/0 conn(0x7f19440d1c80 legacy=0x7f19441629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.470+0000 7f1949d22640 1 -- 172.21.15.60:0/9408073 >> v1:172.21.15.60:6789/0 conn(0x7f19440cf6b0 legacy=0x7f19440b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.470+0000 7f1949d22640 1 -- 172.21.15.60:0/9408073 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19440d3490 con 0x7f19440b63d0 2024-09-12T01:43:13.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.470+0000 7f1949d22640 1 --2- 172.21.15.60:0/9408073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19440b63d0 0x7f19440d39b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f19400097d0 tx=0x7f194002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb00af25e7df5d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:13.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.471+0000 7f1948d20640 1 -- 172.21.15.60:0/9408073 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940037070 con 0x7f19440b63d0 2024-09-12T01:43:13.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.471+0000 7f1948d20640 1 -- 172.21.15.60:0/9408073 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194002ae50 con 0x7f19440b63d0 2024-09-12T01:43:13.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.471+0000 7f1948d20640 1 -- 172.21.15.60:0/9408073 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940032660 con 0x7f19440b63d0 2024-09-12T01:43:13.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.471+0000 7f194bf86640 1 -- 172.21.15.60:0/9408073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19440b63d0 msgr2=0x7f19440d39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.471+0000 7f194bf86640 1 --2- 172.21.15.60:0/9408073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19440b63d0 0x7f19440d39b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f19400097d0 tx=0x7f194002a100 comp rx=0 tx=0).stop 2024-09-12T01:43:13.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.471+0000 7f194bf86640 1 -- 172.21.15.60:0/9408073 shutdown_connections 2024-09-12T01:43:13.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.471+0000 7f194bf86640 1 --2- 172.21.15.60:0/9408073 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19440b63d0 0x7f19440d39b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.471+0000 7f194bf86640 1 -- 172.21.15.60:0/9408073 >> 172.21.15.60:0/9408073 conn(0x7f19440d1160 msgr2=0x7f19440d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:13.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.471+0000 7f194bf86640 1 -- 172.21.15.60:0/9408073 shutdown_connections 2024-09-12T01:43:13.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.471+0000 7f194bf86640 1 -- 172.21.15.60:0/9408073 wait complete. 2024-09-12T01:43:13.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.472+0000 7f194bf86640 1 Processor -- start 2024-09-12T01:43:13.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.472+0000 7f194bf86640 1 -- start start 2024-09-12T01:43:13.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.473+0000 7f194bf86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19440b63d0 0x7f19440ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.475 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.473+0000 7f194bf86640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19440cf6b0 0x7f19440ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.473+0000 7f194bf86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19440d1c80 0x7f194414c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.473+0000 7f194bf86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f19440cb5c0 con 0x7f19440d1c80 2024-09-12T01:43:13.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.473+0000 7f194bf86640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f19440cb440 con 0x7f19440cf6b0 2024-09-12T01:43:13.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.473+0000 7f194bf86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f19440d3ef0 con 0x7f19440b63d0 2024-09-12T01:43:13.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.473+0000 7f194a523640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19440d1c80 0x7f194414c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.473+0000 7f194a523640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19440d1c80 0x7f194414c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53370/0 (socket says 172.21.15.60:53370) 2024-09-12T01:43:13.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.473+0000 7f194a523640 1 -- 172.21.15.60:0/3214283646 learned_addr learned my addr 172.21.15.60:0/3214283646 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:13.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f1949d22640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19440b63d0 0x7f19440ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f1949521640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19440cf6b0 0x7f19440ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f194a523640 1 -- 172.21.15.60:0/3214283646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19440b63d0 msgr2=0x7f19440ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f194a523640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19440b63d0 0x7f19440ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f194a523640 1 -- 172.21.15.60:0/3214283646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19440cf6b0 msgr2=0x7f19440ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f194a523640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19440cf6b0 0x7f19440ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f194a523640 1 -- 172.21.15.60:0/3214283646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1944150b50 con 0x7f19440d1c80 2024-09-12T01:43:13.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f1949521640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19440cf6b0 0x7f19440ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:13.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f194a523640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19440d1c80 0x7f194414c7b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f193c00c780 tx=0x7f193c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:13.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f193a7fc640 1 -- 172.21.15.60:0/3214283646 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c003b70 con 0x7f19440d1c80 2024-09-12T01:43:13.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f193a7fc640 1 -- 172.21.15.60:0/3214283646 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193c003d10 con 0x7f19440d1c80 2024-09-12T01:43:13.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f194bf86640 1 -- 172.21.15.60:0/3214283646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194415b7e0 con 0x7f19440d1c80 2024-09-12T01:43:13.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f193a7fc640 1 -- 172.21.15.60:0/3214283646 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c005270 con 0x7f19440d1c80 2024-09-12T01:43:13.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.474+0000 7f194bf86640 1 -- 172.21.15.60:0/3214283646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19440c9ff0 con 0x7f19440d1c80 2024-09-12T01:43:13.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.475+0000 7f194bf86640 1 -- 172.21.15.60:0/3214283646 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19440b67b0 con 0x7f19440d1c80 2024-09-12T01:43:13.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.476+0000 7f193a7fc640 1 -- 172.21.15.60:0/3214283646 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f193c005410 con 0x7f19440d1c80 2024-09-12T01:43:13.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.476+0000 7f193a7fc640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f192806be30 0x7f192806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.476+0000 7f193a7fc640 1 -- 172.21.15.60:0/3214283646 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f193c08ad30 con 0x7f19440d1c80 2024-09-12T01:43:13.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.476+0000 7f1949d22640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f192806be30 0x7f192806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.477+0000 7f1949d22640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f192806be30 0x7f192806e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1940034000 tx=0x7f194002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:13.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.480+0000 7f193a7fc640 1 -- 172.21.15.60:0/3214283646 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1944150b50 con 0x7f19440d1c80 2024-09-12T01:43:13.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.653+0000 7f194bf86640 1 -- 172.21.15.60:0/3214283646 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19440cf280 con 0x7f192806be30 2024-09-12T01:43:13.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.658+0000 7f193a7fc640 1 -- 172.21.15.60:0/3214283646 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250202 (secure 0 0 0) 0x7f194007f170 con 0x7f192806be30 2024-09-12T01:43:13.662 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:13.663 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:43:13.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.662+0000 7f194bf86640 1 -- 172.21.15.60:0/3214283646 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f192806be30 msgr2=0x7f192806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.662+0000 7f194bf86640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f192806be30 0x7f192806e2f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1940034000 tx=0x7f194002e000 comp rx=0 tx=0).stop 2024-09-12T01:43:13.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.662+0000 7f194bf86640 1 -- 172.21.15.60:0/3214283646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19440d1c80 msgr2=0x7f194414c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.662+0000 7f194bf86640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19440d1c80 0x7f194414c7b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f193c00c780 tx=0x7f193c00cb80 comp rx=0 tx=0).stop 2024-09-12T01:43:13.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.662+0000 7f194bf86640 1 -- 172.21.15.60:0/3214283646 shutdown_connections 2024-09-12T01:43:13.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.662+0000 7f194bf86640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19440d1c80 0x7f194414c7b0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.662+0000 7f194bf86640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f19440cf6b0 0x7f19440ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.662+0000 7f194bf86640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f192806be30 0x7f192806e2f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.662+0000 7f194bf86640 1 --2- 172.21.15.60:0/3214283646 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f19440b63d0 0x7f19440ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.662+0000 7f194bf86640 1 -- 172.21.15.60:0/3214283646 >> 172.21.15.60:0/3214283646 conn(0x7f19440d1160 msgr2=0x7f1944162930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:13.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.662+0000 7f194bf86640 1 -- 172.21.15.60:0/3214283646 shutdown_connections 2024-09-12T01:43:13.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.662+0000 7f194bf86640 1 -- 172.21.15.60:0/3214283646 wait complete. 2024-09-12T01:43:13.673 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-12T01:43:12.358619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":200,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":166,"acting":166,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":76,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":282744,"kb_used_data":12420,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754691976,"statfs":{"total":773094113280,"available":772804583424,"internally_reserved":0,"allocated":12718080,"data_stored":6070166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.381734"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012397+0000","last_change":"2024-09-12T01:43:10.010617+0000","last_active":"2024-09-12T01:43:10.012397+0000","last_peered":"2024-09-12T01:43:10.012397+0000","last_clean":"2024-09-12T01:43:10.012397+0000","last_became_active":"2024-09-12T01:43:10.010318+0000","last_became_peered":"2024-09-12T01:43:10.010318+0000","last_unstale":"2024-09-12T01:43:10.012397+0000","last_undegraded":"2024-09-12T01:43:10.012397+0000","last_fullsized":"2024-09-12T01:43:10.012397+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:00.998086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.003006+0000","last_change":"2024-09-12T01:43:09.999067+0000","last_active":"2024-09-12T01:43:10.003006+0000","last_peered":"2024-09-12T01:43:10.003006+0000","last_clean":"2024-09-12T01:43:10.003006+0000","last_became_active":"2024-09-12T01:43:09.998779+0000","last_became_peered":"2024-09-12T01:43:09.998779+0000","last_unstale":"2024-09-12T01:43:10.003006+0000","last_undegraded":"2024-09-12T01:43:10.003006+0000","last_fullsized":"2024-09-12T01:43:10.003006+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.436244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.009603+0000","last_change":"2024-09-12T01:43:10.007268+0000","last_active":"2024-09-12T01:43:10.009603+0000","last_peered":"2024-09-12T01:43:10.009603+0000","last_clean":"2024-09-12T01:43:10.009603+0000","last_became_active":"2024-09-12T01:43:10.006974+0000","last_became_peered":"2024-09-12T01:43:10.006974+0000","last_unstale":"2024-09-12T01:43:10.009603+0000","last_undegraded":"2024-09-12T01:43:10.009603+0000","last_fullsized":"2024-09-12T01:43:10.009603+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:45.313222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016364+0000","last_change":"2024-09-12T01:43:10.013407+0000","last_active":"2024-09-12T01:43:10.016364+0000","last_peered":"2024-09-12T01:43:10.016364+0000","last_clean":"2024-09-12T01:43:10.016364+0000","last_became_active":"2024-09-12T01:43:10.013078+0000","last_became_peered":"2024-09-12T01:43:10.013078+0000","last_unstale":"2024-09-12T01:43:10.016364+0000","last_undegraded":"2024-09-12T01:43:10.016364+0000","last_fullsized":"2024-09-12T01:43:10.016364+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:59.595180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.000806+0000","last_change":"2024-09-12T01:43:09.993325+0000","last_active":"2024-09-12T01:43:10.000806+0000","last_peered":"2024-09-12T01:43:10.000806+0000","last_clean":"2024-09-12T01:43:10.000806+0000","last_became_active":"2024-09-12T01:43:09.993003+0000","last_became_peered":"2024-09-12T01:43:09.993003+0000","last_unstale":"2024-09-12T01:43:10.000806+0000","last_undegraded":"2024-09-12T01:43:10.000806+0000","last_fullsized":"2024-09-12T01:43:10.000806+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:13.868284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.009578+0000","last_change":"2024-09-12T01:43:10.006897+0000","last_active":"2024-09-12T01:43:10.009578+0000","last_peered":"2024-09-12T01:43:10.009578+0000","last_clean":"2024-09-12T01:43:10.009578+0000","last_became_active":"2024-09-12T01:43:10.006607+0000","last_became_peered":"2024-09-12T01:43:10.006607+0000","last_unstale":"2024-09-12T01:43:10.009578+0000","last_undegraded":"2024-09-12T01:43:10.009578+0000","last_fullsized":"2024-09-12T01:43:10.009578+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:22.478063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.002936+0000","last_change":"2024-09-12T01:43:09.999698+0000","last_active":"2024-09-12T01:43:10.002936+0000","last_peered":"2024-09-12T01:43:10.002936+0000","last_clean":"2024-09-12T01:43:10.002936+0000","last_became_active":"2024-09-12T01:43:09.999370+0000","last_became_peered":"2024-09-12T01:43:09.999370+0000","last_unstale":"2024-09-12T01:43:10.002936+0000","last_undegraded":"2024-09-12T01:43:10.002936+0000","last_fullsized":"2024-09-12T01:43:10.002936+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:02.840344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010670+0000","last_change":"2024-09-12T01:43:10.007674+0000","last_active":"2024-09-12T01:43:10.010670+0000","last_peered":"2024-09-12T01:43:10.010670+0000","last_clean":"2024-09-12T01:43:10.010670+0000","last_became_active":"2024-09-12T01:43:10.006630+0000","last_became_peered":"2024-09-12T01:43:10.006630+0000","last_unstale":"2024-09-12T01:43:10.010670+0000","last_undegraded":"2024-09-12T01:43:10.010670+0000","last_fullsized":"2024-09-12T01:43:10.010670+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:43.082717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.019627+0000","last_change":"2024-09-12T01:43:10.017470+0000","last_active":"2024-09-12T01:43:10.019627+0000","last_peered":"2024-09-12T01:43:10.019627+0000","last_clean":"2024-09-12T01:43:10.019627+0000","last_became_active":"2024-09-12T01:43:10.017170+0000","last_became_peered":"2024-09-12T01:43:10.017170+0000","last_unstale":"2024-09-12T01:43:10.019627+0000","last_undegraded":"2024-09-12T01:43:10.019627+0000","last_fullsized":"2024-09-12T01:43:10.019627+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:10.230932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013106+0000","last_change":"2024-09-12T01:43:10.009228+0000","last_active":"2024-09-12T01:43:10.013106+0000","last_peered":"2024-09-12T01:43:10.013106+0000","last_clean":"2024-09-12T01:43:10.013106+0000","last_became_active":"2024-09-12T01:43:10.008772+0000","last_became_peered":"2024-09-12T01:43:10.008772+0000","last_unstale":"2024-09-12T01:43:10.013106+0000","last_undegraded":"2024-09-12T01:43:10.013106+0000","last_fullsized":"2024-09-12T01:43:10.013106+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:04.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015852+0000","last_change":"2024-09-12T01:43:10.010426+0000","last_active":"2024-09-12T01:43:10.015852+0000","last_peered":"2024-09-12T01:43:10.015852+0000","last_clean":"2024-09-12T01:43:10.015852+0000","last_became_active":"2024-09-12T01:43:10.010145+0000","last_became_peered":"2024-09-12T01:43:10.010145+0000","last_unstale":"2024-09-12T01:43:10.015852+0000","last_undegraded":"2024-09-12T01:43:10.015852+0000","last_fullsized":"2024-09-12T01:43:10.015852+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:14.568049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016141+0000","last_change":"2024-09-12T01:43:10.012384+0000","last_active":"2024-09-12T01:43:10.016141+0000","last_peered":"2024-09-12T01:43:10.016141+0000","last_clean":"2024-09-12T01:43:10.016141+0000","last_became_active":"2024-09-12T01:43:10.012073+0000","last_became_peered":"2024-09-12T01:43:10.012073+0000","last_unstale":"2024-09-12T01:43:10.016141+0000","last_undegraded":"2024-09-12T01:43:10.016141+0000","last_fullsized":"2024-09-12T01:43:10.016141+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:35.398682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010228+0000","last_change":"2024-09-12T01:43:10.005425+0000","last_active":"2024-09-12T01:43:10.010228+0000","last_peered":"2024-09-12T01:43:10.010228+0000","last_clean":"2024-09-12T01:43:10.010228+0000","last_became_active":"2024-09-12T01:43:10.005101+0000","last_became_peered":"2024-09-12T01:43:10.005101+0000","last_unstale":"2024-09-12T01:43:10.010228+0000","last_undegraded":"2024-09-12T01:43:10.010228+0000","last_fullsized":"2024-09-12T01:43:10.010228+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:45.075912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.996407+0000","last_change":"2024-09-12T01:43:09.994951+0000","last_active":"2024-09-12T01:43:09.996407+0000","last_peered":"2024-09-12T01:43:09.996407+0000","last_clean":"2024-09-12T01:43:09.996407+0000","last_became_active":"2024-09-12T01:43:09.994653+0000","last_became_peered":"2024-09-12T01:43:09.994653+0000","last_unstale":"2024-09-12T01:43:09.996407+0000","last_undegraded":"2024-09-12T01:43:09.996407+0000","last_fullsized":"2024-09-12T01:43:09.996407+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:28.947715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.018468+0000","last_change":"2024-09-12T01:43:10.013071+0000","last_active":"2024-09-12T01:43:10.018468+0000","last_peered":"2024-09-12T01:43:10.018468+0000","last_clean":"2024-09-12T01:43:10.018468+0000","last_became_active":"2024-09-12T01:43:10.012269+0000","last_became_peered":"2024-09-12T01:43:10.012269+0000","last_unstale":"2024-09-12T01:43:10.018468+0000","last_undegraded":"2024-09-12T01:43:10.018468+0000","last_fullsized":"2024-09-12T01:43:10.018468+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:30.956540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012952+0000","last_change":"2024-09-12T01:43:10.008649+0000","last_active":"2024-09-12T01:43:10.012952+0000","last_peered":"2024-09-12T01:43:10.012952+0000","last_clean":"2024-09-12T01:43:10.012952+0000","last_became_active":"2024-09-12T01:43:10.008285+0000","last_became_peered":"2024-09-12T01:43:10.008285+0000","last_unstale":"2024-09-12T01:43:10.012952+0000","last_undegraded":"2024-09-12T01:43:10.012952+0000","last_fullsized":"2024-09-12T01:43:10.012952+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:52.990907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.018040+0000","last_change":"2024-09-12T01:43:10.015834+0000","last_active":"2024-09-12T01:43:10.018040+0000","last_peered":"2024-09-12T01:43:10.018040+0000","last_clean":"2024-09-12T01:43:10.018040+0000","last_became_active":"2024-09-12T01:43:10.012836+0000","last_became_peered":"2024-09-12T01:43:10.012836+0000","last_unstale":"2024-09-12T01:43:10.018040+0000","last_undegraded":"2024-09-12T01:43:10.018040+0000","last_fullsized":"2024-09-12T01:43:10.018040+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:00.239866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016842+0000","last_change":"2024-09-12T01:43:10.015393+0000","last_active":"2024-09-12T01:43:10.016842+0000","last_peered":"2024-09-12T01:43:10.016842+0000","last_clean":"2024-09-12T01:43:10.016842+0000","last_became_active":"2024-09-12T01:43:10.015131+0000","last_became_peered":"2024-09-12T01:43:10.015131+0000","last_unstale":"2024-09-12T01:43:10.016842+0000","last_undegraded":"2024-09-12T01:43:10.016842+0000","last_fullsized":"2024-09-12T01:43:10.016842+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:51.240289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.021079+0000","last_change":"2024-09-12T01:43:10.017901+0000","last_active":"2024-09-12T01:43:10.021079+0000","last_peered":"2024-09-12T01:43:10.021079+0000","last_clean":"2024-09-12T01:43:10.021079+0000","last_became_active":"2024-09-12T01:43:10.017599+0000","last_became_peered":"2024-09-12T01:43:10.017599+0000","last_unstale":"2024-09-12T01:43:10.021079+0000","last_undegraded":"2024-09-12T01:43:10.021079+0000","last_fullsized":"2024-09-12T01:43:10.021079+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:23.039212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012926+0000","last_change":"2024-09-12T01:43:10.008416+0000","last_active":"2024-09-12T01:43:10.012926+0000","last_peered":"2024-09-12T01:43:10.012926+0000","last_clean":"2024-09-12T01:43:10.012926+0000","last_became_active":"2024-09-12T01:43:10.008149+0000","last_became_peered":"2024-09-12T01:43:10.008149+0000","last_unstale":"2024-09-12T01:43:10.012926+0000","last_undegraded":"2024-09-12T01:43:10.012926+0000","last_fullsized":"2024-09-12T01:43:10.012926+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:57.864742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.021030+0000","last_change":"2024-09-12T01:43:10.018610+0000","last_active":"2024-09-12T01:43:10.021030+0000","last_peered":"2024-09-12T01:43:10.021030+0000","last_clean":"2024-09-12T01:43:10.021030+0000","last_became_active":"2024-09-12T01:43:10.018313+0000","last_became_peered":"2024-09-12T01:43:10.018313+0000","last_unstale":"2024-09-12T01:43:10.021030+0000","last_undegraded":"2024-09-12T01:43:10.021030+0000","last_fullsized":"2024-09-12T01:43:10.021030+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.436244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.011049+0000","last_change":"2024-09-12T01:43:10.005034+0000","last_active":"2024-09-12T01:43:10.011049+0000","last_peered":"2024-09-12T01:43:10.011049+0000","last_clean":"2024-09-12T01:43:10.011049+0000","last_became_active":"2024-09-12T01:43:10.004647+0000","last_became_peered":"2024-09-12T01:43:10.004647+0000","last_unstale":"2024-09-12T01:43:10.011049+0000","last_undegraded":"2024-09-12T01:43:10.011049+0000","last_fullsized":"2024-09-12T01:43:10.011049+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:24.531059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013872+0000","last_change":"2024-09-12T01:43:10.010938+0000","last_active":"2024-09-12T01:43:10.013872+0000","last_peered":"2024-09-12T01:43:10.013872+0000","last_clean":"2024-09-12T01:43:10.013872+0000","last_became_active":"2024-09-12T01:43:10.010575+0000","last_became_peered":"2024-09-12T01:43:10.010575+0000","last_unstale":"2024-09-12T01:43:10.013872+0000","last_undegraded":"2024-09-12T01:43:10.013872+0000","last_fullsized":"2024-09-12T01:43:10.013872+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:13.973177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.002914+0000","last_change":"2024-09-12T01:43:09.999258+0000","last_active":"2024-09-12T01:43:10.002914+0000","last_peered":"2024-09-12T01:43:10.002914+0000","last_clean":"2024-09-12T01:43:10.002914+0000","last_became_active":"2024-09-12T01:43:09.998972+0000","last_became_peered":"2024-09-12T01:43:09.998972+0000","last_unstale":"2024-09-12T01:43:10.002914+0000","last_undegraded":"2024-09-12T01:43:10.002914+0000","last_fullsized":"2024-09-12T01:43:10.002914+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:08.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.004836+0000","last_change":"2024-09-12T01:43:10.002479+0000","last_active":"2024-09-12T01:43:10.004836+0000","last_peered":"2024-09-12T01:43:10.004836+0000","last_clean":"2024-09-12T01:43:10.004836+0000","last_became_active":"2024-09-12T01:43:10.001641+0000","last_became_peered":"2024-09-12T01:43:10.001641+0000","last_unstale":"2024-09-12T01:43:10.004836+0000","last_undegraded":"2024-09-12T01:43:10.004836+0000","last_fullsized":"2024-09-12T01:43:10.004836+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:10.230932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"116'4","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.014790+0000","last_change":"2024-09-12T01:43:08.999139+0000","last_active":"2024-09-12T01:43:10.014790+0000","last_peered":"2024-09-12T01:43:10.014790+0000","last_clean":"2024-09-12T01:43:10.014790+0000","last_became_active":"2024-09-12T01:43:08.998874+0000","last_became_peered":"2024-09-12T01:43:08.998874+0000","last_unstale":"2024-09-12T01:43:10.014790+0000","last_undegraded":"2024-09-12T01:43:10.014790+0000","last_fullsized":"2024-09-12T01:43:10.014790+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:12.086671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.999594+0000","last_change":"2024-09-12T01:43:09.998236+0000","last_active":"2024-09-12T01:43:09.999594+0000","last_peered":"2024-09-12T01:43:09.999594+0000","last_clean":"2024-09-12T01:43:09.999594+0000","last_became_active":"2024-09-12T01:43:09.996642+0000","last_became_peered":"2024-09-12T01:43:09.996642+0000","last_unstale":"2024-09-12T01:43:09.999594+0000","last_undegraded":"2024-09-12T01:43:09.999594+0000","last_fullsized":"2024-09-12T01:43:09.999594+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:33.470907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017670+0000","last_change":"2024-09-12T01:43:09.007149+0000","last_active":"2024-09-12T01:43:10.017670+0000","last_peered":"2024-09-12T01:43:10.017670+0000","last_clean":"2024-09-12T01:43:10.017670+0000","last_became_active":"2024-09-12T01:43:09.006801+0000","last_became_peered":"2024-09-12T01:43:09.006801+0000","last_unstale":"2024-09-12T01:43:10.017670+0000","last_undegraded":"2024-09-12T01:43:10.017670+0000","last_fullsized":"2024-09-12T01:43:10.017670+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:48.504193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013118+0000","last_change":"2024-09-12T01:43:10.012246+0000","last_active":"2024-09-12T01:43:10.013118+0000","last_peered":"2024-09-12T01:43:10.013118+0000","last_clean":"2024-09-12T01:43:10.013118+0000","last_became_active":"2024-09-12T01:43:10.011930+0000","last_became_peered":"2024-09-12T01:43:10.011930+0000","last_unstale":"2024-09-12T01:43:10.013118+0000","last_undegraded":"2024-09-12T01:43:10.013118+0000","last_fullsized":"2024-09-12T01:43:10.013118+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:32.799859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.007885+0000","last_change":"2024-09-12T01:43:08.998653+0000","last_active":"2024-09-12T01:43:10.007885+0000","last_peered":"2024-09-12T01:43:10.007885+0000","last_clean":"2024-09-12T01:43:10.007885+0000","last_became_active":"2024-09-12T01:43:08.998390+0000","last_became_peered":"2024-09-12T01:43:08.998390+0000","last_unstale":"2024-09-12T01:43:10.007885+0000","last_undegraded":"2024-09-12T01:43:10.007885+0000","last_fullsized":"2024-09-12T01:43:10.007885+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:18.419447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017106+0000","last_change":"2024-09-12T01:43:10.012472+0000","last_active":"2024-09-12T01:43:10.017106+0000","last_peered":"2024-09-12T01:43:10.017106+0000","last_clean":"2024-09-12T01:43:10.017106+0000","last_became_active":"2024-09-12T01:43:10.011808+0000","last_became_peered":"2024-09-12T01:43:10.011808+0000","last_unstale":"2024-09-12T01:43:10.017106+0000","last_undegraded":"2024-09-12T01:43:10.017106+0000","last_fullsized":"2024-09-12T01:43:10.017106+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:36.244472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-12T01:43:07.980762+0000","last_change":"2024-09-12T01:43:07.980762+0000","last_active":"2024-09-12T01:43:07.971297+0000","last_peered":"2024-09-12T01:43:07.971297+0000","last_clean":"2024-09-12T01:43:07.971297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:07.980762+0000","last_undegraded":"2024-09-12T01:43:07.980762+0000","last_fullsized":"2024-09-12T01:43:07.980762+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016192+0000","last_change":"2024-09-12T01:43:10.012454+0000","last_active":"2024-09-12T01:43:10.016192+0000","last_peered":"2024-09-12T01:43:10.016192+0000","last_clean":"2024-09-12T01:43:10.016192+0000","last_became_active":"2024-09-12T01:43:10.012121+0000","last_became_peered":"2024-09-12T01:43:10.012121+0000","last_unstale":"2024-09-12T01:43:10.016192+0000","last_undegraded":"2024-09-12T01:43:10.016192+0000","last_fullsized":"2024-09-12T01:43:10.016192+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:18.967832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-12T01:43:07.981284+0000","last_change":"2024-09-12T01:43:07.981284+0000","last_active":"2024-09-12T01:43:07.971297+0000","last_peered":"2024-09-12T01:43:07.971297+0000","last_clean":"2024-09-12T01:43:07.971297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:07.981284+0000","last_undegraded":"2024-09-12T01:43:07.981284+0000","last_fullsized":"2024-09-12T01:43:07.981284+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016452+0000","last_change":"2024-09-12T01:43:10.015386+0000","last_active":"2024-09-12T01:43:10.016452+0000","last_peered":"2024-09-12T01:43:10.016452+0000","last_clean":"2024-09-12T01:43:10.016452+0000","last_became_active":"2024-09-12T01:43:10.012428+0000","last_became_peered":"2024-09-12T01:43:10.012428+0000","last_unstale":"2024-09-12T01:43:10.016452+0000","last_undegraded":"2024-09-12T01:43:10.016452+0000","last_fullsized":"2024-09-12T01:43:10.016452+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:04.591571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.008395+0000","last_change":"2024-09-12T01:43:08.997463+0000","last_active":"2024-09-12T01:43:10.008395+0000","last_peered":"2024-09-12T01:43:10.008395+0000","last_clean":"2024-09-12T01:43:10.008395+0000","last_became_active":"2024-09-12T01:43:08.994321+0000","last_became_peered":"2024-09-12T01:43:08.994321+0000","last_unstale":"2024-09-12T01:43:10.008395+0000","last_undegraded":"2024-09-12T01:43:10.008395+0000","last_fullsized":"2024-09-12T01:43:10.008395+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:57.845182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.020328+0000","last_change":"2024-09-12T01:43:10.016198+0000","last_active":"2024-09-12T01:43:10.020328+0000","last_peered":"2024-09-12T01:43:10.020328+0000","last_clean":"2024-09-12T01:43:10.020328+0000","last_became_active":"2024-09-12T01:43:10.015942+0000","last_became_peered":"2024-09-12T01:43:10.015942+0000","last_unstale":"2024-09-12T01:43:10.020328+0000","last_undegraded":"2024-09-12T01:43:10.020328+0000","last_fullsized":"2024-09-12T01:43:10.020328+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:50.905796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.986853+0000","last_change":"2024-09-12T01:43:08.998565+0000","last_active":"2024-09-12T01:43:09.986853+0000","last_peered":"2024-09-12T01:43:09.986853+0000","last_clean":"2024-09-12T01:43:09.986853+0000","last_became_active":"2024-09-12T01:43:08.998292+0000","last_became_peered":"2024-09-12T01:43:08.998292+0000","last_unstale":"2024-09-12T01:43:09.986853+0000","last_undegraded":"2024-09-12T01:43:09.986853+0000","last_fullsized":"2024-09-12T01:43:09.986853+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.559247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-12T01:43:07.980944+0000","last_change":"2024-09-12T01:43:07.980944+0000","last_active":"2024-09-12T01:43:07.971297+0000","last_peered":"2024-09-12T01:43:07.971297+0000","last_clean":"2024-09-12T01:43:07.971297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:07.980944+0000","last_undegraded":"2024-09-12T01:43:07.980944+0000","last_fullsized":"2024-09-12T01:43:07.980944+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.996699+0000","last_change":"2024-09-12T01:43:09.005035+0000","last_active":"2024-09-12T01:43:09.996699+0000","last_peered":"2024-09-12T01:43:09.996699+0000","last_clean":"2024-09-12T01:43:09.996699+0000","last_became_active":"2024-09-12T01:43:09.003567+0000","last_became_peered":"2024-09-12T01:43:09.003567+0000","last_unstale":"2024-09-12T01:43:09.996699+0000","last_undegraded":"2024-09-12T01:43:09.996699+0000","last_fullsized":"2024-09-12T01:43:09.996699+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:29.476489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.008408+0000","last_change":"2024-09-12T01:43:10.006087+0000","last_active":"2024-09-12T01:43:10.008408+0000","last_peered":"2024-09-12T01:43:10.008408+0000","last_clean":"2024-09-12T01:43:10.008408+0000","last_became_active":"2024-09-12T01:43:10.003431+0000","last_became_peered":"2024-09-12T01:43:10.003431+0000","last_unstale":"2024-09-12T01:43:10.008408+0000","last_undegraded":"2024-09-12T01:43:10.008408+0000","last_fullsized":"2024-09-12T01:43:10.008408+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:18.861635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.999813+0000","last_change":"2024-09-12T01:43:09.000223+0000","last_active":"2024-09-12T01:43:09.999813+0000","last_peered":"2024-09-12T01:43:09.999813+0000","last_clean":"2024-09-12T01:43:09.999813+0000","last_became_active":"2024-09-12T01:43:08.999881+0000","last_became_peered":"2024-09-12T01:43:08.999881+0000","last_unstale":"2024-09-12T01:43:09.999813+0000","last_undegraded":"2024-09-12T01:43:09.999813+0000","last_fullsized":"2024-09-12T01:43:09.999813+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:50.234821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.020142+0000","last_change":"2024-09-12T01:43:10.017833+0000","last_active":"2024-09-12T01:43:10.020142+0000","last_peered":"2024-09-12T01:43:10.020142+0000","last_clean":"2024-09-12T01:43:10.020142+0000","last_became_active":"2024-09-12T01:43:10.017506+0000","last_became_peered":"2024-09-12T01:43:10.017506+0000","last_unstale":"2024-09-12T01:43:10.020142+0000","last_undegraded":"2024-09-12T01:43:10.020142+0000","last_fullsized":"2024-09-12T01:43:10.020142+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:12.885550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"116'3","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.014580+0000","last_change":"2024-09-12T01:43:08.999971+0000","last_active":"2024-09-12T01:43:10.014580+0000","last_peered":"2024-09-12T01:43:10.014580+0000","last_clean":"2024-09-12T01:43:10.014580+0000","last_became_active":"2024-09-12T01:43:08.999656+0000","last_became_peered":"2024-09-12T01:43:08.999656+0000","last_unstale":"2024-09-12T01:43:10.014580+0000","last_undegraded":"2024-09-12T01:43:10.014580+0000","last_fullsized":"2024-09-12T01:43:10.014580+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:08.248385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.019658+0000","last_change":"2024-09-12T01:43:10.018504+0000","last_active":"2024-09-12T01:43:10.019658+0000","last_peered":"2024-09-12T01:43:10.019658+0000","last_clean":"2024-09-12T01:43:10.019658+0000","last_became_active":"2024-09-12T01:43:10.018223+0000","last_became_peered":"2024-09-12T01:43:10.018223+0000","last_unstale":"2024-09-12T01:43:10.019658+0000","last_undegraded":"2024-09-12T01:43:10.019658+0000","last_fullsized":"2024-09-12T01:43:10.019658+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:52.990907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"116'6","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.022053+0000","last_change":"2024-09-12T01:43:09.004240+0000","last_active":"2024-09-12T01:43:10.022053+0000","last_peered":"2024-09-12T01:43:10.022053+0000","last_clean":"2024-09-12T01:43:10.022053+0000","last_became_active":"2024-09-12T01:43:09.003936+0000","last_became_peered":"2024-09-12T01:43:09.003936+0000","last_unstale":"2024-09-12T01:43:10.022053+0000","last_undegraded":"2024-09-12T01:43:10.022053+0000","last_fullsized":"2024-09-12T01:43:10.022053+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.733832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.007333+0000","last_change":"2024-09-12T01:43:10.005212+0000","last_active":"2024-09-12T01:43:10.007333+0000","last_peered":"2024-09-12T01:43:10.007333+0000","last_clean":"2024-09-12T01:43:10.007333+0000","last_became_active":"2024-09-12T01:43:10.004914+0000","last_became_peered":"2024-09-12T01:43:10.004914+0000","last_unstale":"2024-09-12T01:43:10.007333+0000","last_undegraded":"2024-09-12T01:43:10.007333+0000","last_fullsized":"2024-09-12T01:43:10.007333+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:12.885550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.998201+0000","last_change":"2024-09-12T01:43:08.996819+0000","last_active":"2024-09-12T01:43:09.998201+0000","last_peered":"2024-09-12T01:43:09.998201+0000","last_clean":"2024-09-12T01:43:09.998201+0000","last_became_active":"2024-09-12T01:43:08.996524+0000","last_became_peered":"2024-09-12T01:43:08.996524+0000","last_unstale":"2024-09-12T01:43:09.998201+0000","last_undegraded":"2024-09-12T01:43:09.998201+0000","last_fullsized":"2024-09-12T01:43:09.998201+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:59.234398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010251+0000","last_change":"2024-09-12T01:43:10.005816+0000","last_active":"2024-09-12T01:43:10.010251+0000","last_peered":"2024-09-12T01:43:10.010251+0000","last_clean":"2024-09-12T01:43:10.010251+0000","last_became_active":"2024-09-12T01:43:10.005542+0000","last_became_peered":"2024-09-12T01:43:10.005542+0000","last_unstale":"2024-09-12T01:43:10.010251+0000","last_undegraded":"2024-09-12T01:43:10.010251+0000","last_fullsized":"2024-09-12T01:43:10.010251+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.088992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990122+0000","last_change":"2024-09-12T01:43:09.005250+0000","last_active":"2024-09-12T01:43:09.990122+0000","last_peered":"2024-09-12T01:43:09.990122+0000","last_clean":"2024-09-12T01:43:09.990122+0000","last_became_active":"2024-09-12T01:43:09.004791+0000","last_became_peered":"2024-09-12T01:43:09.004791+0000","last_unstale":"2024-09-12T01:43:09.990122+0000","last_undegraded":"2024-09-12T01:43:09.990122+0000","last_fullsized":"2024-09-12T01:43:09.990122+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:26.568406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016389+0000","last_change":"2024-09-12T01:43:10.014855+0000","last_active":"2024-09-12T01:43:10.016389+0000","last_peered":"2024-09-12T01:43:10.016389+0000","last_clean":"2024-09-12T01:43:10.016389+0000","last_became_active":"2024-09-12T01:43:10.014592+0000","last_became_peered":"2024-09-12T01:43:10.014592+0000","last_unstale":"2024-09-12T01:43:10.016389+0000","last_undegraded":"2024-09-12T01:43:10.016389+0000","last_fullsized":"2024-09-12T01:43:10.016389+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:17.976343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"116'8","reported_seq":20,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.020601+0000","last_change":"2024-09-12T01:43:09.002635+0000","last_active":"2024-09-12T01:43:10.020601+0000","last_peered":"2024-09-12T01:43:10.020601+0000","last_clean":"2024-09-12T01:43:10.020601+0000","last_became_active":"2024-09-12T01:43:09.002101+0000","last_became_peered":"2024-09-12T01:43:09.002101+0000","last_unstale":"2024-09-12T01:43:10.020601+0000","last_undegraded":"2024-09-12T01:43:10.020601+0000","last_fullsized":"2024-09-12T01:43:10.020601+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:44.307753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013813+0000","last_change":"2024-09-12T01:43:10.008983+0000","last_active":"2024-09-12T01:43:10.013813+0000","last_peered":"2024-09-12T01:43:10.013813+0000","last_clean":"2024-09-12T01:43:10.013813+0000","last_became_active":"2024-09-12T01:43:10.008679+0000","last_became_peered":"2024-09-12T01:43:10.008679+0000","last_unstale":"2024-09-12T01:43:10.013813+0000","last_undegraded":"2024-09-12T01:43:10.013813+0000","last_fullsized":"2024-09-12T01:43:10.013813+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:30.481957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017621+0000","last_change":"2024-09-12T01:43:09.001656+0000","last_active":"2024-09-12T01:43:10.017621+0000","last_peered":"2024-09-12T01:43:10.017621+0000","last_clean":"2024-09-12T01:43:10.017621+0000","last_became_active":"2024-09-12T01:43:09.000503+0000","last_became_peered":"2024-09-12T01:43:09.000503+0000","last_unstale":"2024-09-12T01:43:10.017621+0000","last_undegraded":"2024-09-12T01:43:10.017621+0000","last_fullsized":"2024-09-12T01:43:10.017621+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:21.472595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.008383+0000","last_change":"2024-09-12T01:43:10.005510+0000","last_active":"2024-09-12T01:43:10.008383+0000","last_peered":"2024-09-12T01:43:10.008383+0000","last_clean":"2024-09-12T01:43:10.008383+0000","last_became_active":"2024-09-12T01:43:10.002150+0000","last_became_peered":"2024-09-12T01:43:10.002150+0000","last_unstale":"2024-09-12T01:43:10.008383+0000","last_undegraded":"2024-09-12T01:43:10.008383+0000","last_fullsized":"2024-09-12T01:43:10.008383+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.892242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.014360+0000","last_change":"2024-09-12T01:43:08.997611+0000","last_active":"2024-09-12T01:43:10.014360+0000","last_peered":"2024-09-12T01:43:10.014360+0000","last_clean":"2024-09-12T01:43:10.014360+0000","last_became_active":"2024-09-12T01:43:08.997299+0000","last_became_peered":"2024-09-12T01:43:08.997299+0000","last_unstale":"2024-09-12T01:43:10.014360+0000","last_undegraded":"2024-09-12T01:43:10.014360+0000","last_fullsized":"2024-09-12T01:43:10.014360+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:59.274047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.011710+0000","last_change":"2024-09-12T01:43:09.002198+0000","last_active":"2024-09-12T01:43:10.011710+0000","last_peered":"2024-09-12T01:43:10.011710+0000","last_clean":"2024-09-12T01:43:10.011710+0000","last_became_active":"2024-09-12T01:43:09.001925+0000","last_became_peered":"2024-09-12T01:43:09.001925+0000","last_unstale":"2024-09-12T01:43:10.011710+0000","last_undegraded":"2024-09-12T01:43:10.011710+0000","last_fullsized":"2024-09-12T01:43:10.011710+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:33.130766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990176+0000","last_change":"2024-09-12T01:43:08.991805+0000","last_active":"2024-09-12T01:43:09.990176+0000","last_peered":"2024-09-12T01:43:09.990176+0000","last_clean":"2024-09-12T01:43:09.990176+0000","last_became_active":"2024-09-12T01:43:08.991517+0000","last_became_peered":"2024-09-12T01:43:08.991517+0000","last_unstale":"2024-09-12T01:43:09.990176+0000","last_undegraded":"2024-09-12T01:43:09.990176+0000","last_fullsized":"2024-09-12T01:43:09.990176+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:16.731138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013877+0000","last_change":"2024-09-12T01:43:09.002910+0000","last_active":"2024-09-12T01:43:10.013877+0000","last_peered":"2024-09-12T01:43:10.013877+0000","last_clean":"2024-09-12T01:43:10.013877+0000","last_became_active":"2024-09-12T01:43:09.002618+0000","last_became_peered":"2024-09-12T01:43:09.002618+0000","last_unstale":"2024-09-12T01:43:10.013877+0000","last_undegraded":"2024-09-12T01:43:10.013877+0000","last_fullsized":"2024-09-12T01:43:10.013877+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:37.911468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010952+0000","last_change":"2024-09-12T01:43:10.003250+0000","last_active":"2024-09-12T01:43:10.010952+0000","last_peered":"2024-09-12T01:43:10.010952+0000","last_clean":"2024-09-12T01:43:10.010952+0000","last_became_active":"2024-09-12T01:43:10.002434+0000","last_became_peered":"2024-09-12T01:43:10.002434+0000","last_unstale":"2024-09-12T01:43:10.010952+0000","last_undegraded":"2024-09-12T01:43:10.010952+0000","last_fullsized":"2024-09-12T01:43:10.010952+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:58.850651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.994201+0000","last_change":"2024-09-12T01:43:08.998911+0000","last_active":"2024-09-12T01:43:09.994201+0000","last_peered":"2024-09-12T01:43:09.994201+0000","last_clean":"2024-09-12T01:43:09.994201+0000","last_became_active":"2024-09-12T01:43:08.998521+0000","last_became_peered":"2024-09-12T01:43:08.998521+0000","last_unstale":"2024-09-12T01:43:09.994201+0000","last_undegraded":"2024-09-12T01:43:09.994201+0000","last_fullsized":"2024-09-12T01:43:09.994201+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:23.525590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015958+0000","last_change":"2024-09-12T01:43:10.011401+0000","last_active":"2024-09-12T01:43:10.015958+0000","last_peered":"2024-09-12T01:43:10.015958+0000","last_clean":"2024-09-12T01:43:10.015958+0000","last_became_active":"2024-09-12T01:43:10.011126+0000","last_became_peered":"2024-09-12T01:43:10.011126+0000","last_unstale":"2024-09-12T01:43:10.015958+0000","last_undegraded":"2024-09-12T01:43:10.015958+0000","last_fullsized":"2024-09-12T01:43:10.015958+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:19.424916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.998630+0000","last_change":"2024-09-12T01:43:09.004606+0000","last_active":"2024-09-12T01:43:09.998630+0000","last_peered":"2024-09-12T01:43:09.998630+0000","last_clean":"2024-09-12T01:43:09.998630+0000","last_became_active":"2024-09-12T01:43:09.004182+0000","last_became_peered":"2024-09-12T01:43:09.004182+0000","last_unstale":"2024-09-12T01:43:09.998630+0000","last_undegraded":"2024-09-12T01:43:09.998630+0000","last_fullsized":"2024-09-12T01:43:09.998630+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:49.900328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012891+0000","last_change":"2024-09-12T01:43:10.008207+0000","last_active":"2024-09-12T01:43:10.012891+0000","last_peered":"2024-09-12T01:43:10.012891+0000","last_clean":"2024-09-12T01:43:10.012891+0000","last_became_active":"2024-09-12T01:43:10.007942+0000","last_became_peered":"2024-09-12T01:43:10.007942+0000","last_unstale":"2024-09-12T01:43:10.012891+0000","last_undegraded":"2024-09-12T01:43:10.012891+0000","last_fullsized":"2024-09-12T01:43:10.012891+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:02.422050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.989883+0000","last_change":"2024-09-12T01:43:08.998574+0000","last_active":"2024-09-12T01:43:09.989883+0000","last_peered":"2024-09-12T01:43:09.989883+0000","last_clean":"2024-09-12T01:43:09.989883+0000","last_became_active":"2024-09-12T01:43:08.998295+0000","last_became_peered":"2024-09-12T01:43:08.998295+0000","last_unstale":"2024-09-12T01:43:09.989883+0000","last_undegraded":"2024-09-12T01:43:09.989883+0000","last_fullsized":"2024-09-12T01:43:09.989883+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:44.083523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010961+0000","last_change":"2024-09-12T01:43:10.006771+0000","last_active":"2024-09-12T01:43:10.010961+0000","last_peered":"2024-09-12T01:43:10.010961+0000","last_clean":"2024-09-12T01:43:10.010961+0000","last_became_active":"2024-09-12T01:43:10.006483+0000","last_became_peered":"2024-09-12T01:43:10.006483+0000","last_unstale":"2024-09-12T01:43:10.010961+0000","last_undegraded":"2024-09-12T01:43:10.010961+0000","last_fullsized":"2024-09-12T01:43:10.010961+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:39.623929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.004225+0000","last_change":"2024-09-12T01:43:08.999378+0000","last_active":"2024-09-12T01:43:10.004225+0000","last_peered":"2024-09-12T01:43:10.004225+0000","last_clean":"2024-09-12T01:43:10.004225+0000","last_became_active":"2024-09-12T01:43:08.999097+0000","last_became_peered":"2024-09-12T01:43:08.999097+0000","last_unstale":"2024-09-12T01:43:10.004225+0000","last_undegraded":"2024-09-12T01:43:10.004225+0000","last_fullsized":"2024-09-12T01:43:10.004225+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:38.618460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:08.976766+0000","last_change":"2024-09-12T01:43:08.976766+0000","last_active":"2024-09-12T01:43:08.976766+0000","last_peered":"2024-09-12T01:43:08.976766+0000","last_clean":"2024-09-12T01:43:08.976766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:08.976766+0000","last_undegraded":"2024-09-12T01:43:08.976766+0000","last_fullsized":"2024-09-12T01:43:08.976766+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990685+0000","last_change":"2024-09-12T01:43:09.005092+0000","last_active":"2024-09-12T01:43:09.990685+0000","last_peered":"2024-09-12T01:43:09.990685+0000","last_clean":"2024-09-12T01:43:09.990685+0000","last_became_active":"2024-09-12T01:43:09.004744+0000","last_became_peered":"2024-09-12T01:43:09.004744+0000","last_unstale":"2024-09-12T01:43:09.990685+0000","last_undegraded":"2024-09-12T01:43:09.990685+0000","last_fullsized":"2024-09-12T01:43:09.990685+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.790944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013190+0000","last_change":"2024-09-12T01:43:10.009557+0000","last_active":"2024-09-12T01:43:10.013190+0000","last_peered":"2024-09-12T01:43:10.013190+0000","last_clean":"2024-09-12T01:43:10.013190+0000","last_became_active":"2024-09-12T01:43:10.009200+0000","last_became_peered":"2024-09-12T01:43:10.009200+0000","last_unstale":"2024-09-12T01:43:10.013190+0000","last_undegraded":"2024-09-12T01:43:10.013190+0000","last_fullsized":"2024-09-12T01:43:10.013190+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:27.573875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.998825+0000","last_change":"2024-09-12T01:43:09.005025+0000","last_active":"2024-09-12T01:43:09.998825+0000","last_peered":"2024-09-12T01:43:09.998825+0000","last_clean":"2024-09-12T01:43:09.998825+0000","last_became_active":"2024-09-12T01:43:09.004716+0000","last_became_peered":"2024-09-12T01:43:09.004716+0000","last_unstale":"2024-09-12T01:43:09.998825+0000","last_undegraded":"2024-09-12T01:43:09.998825+0000","last_fullsized":"2024-09-12T01:43:09.998825+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:12.967708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.011002+0000","last_change":"2024-09-12T01:43:10.008340+0000","last_active":"2024-09-12T01:43:10.011002+0000","last_peered":"2024-09-12T01:43:10.011002+0000","last_clean":"2024-09-12T01:43:10.011002+0000","last_became_active":"2024-09-12T01:43:10.008060+0000","last_became_peered":"2024-09-12T01:43:10.008060+0000","last_unstale":"2024-09-12T01:43:10.011002+0000","last_undegraded":"2024-09-12T01:43:10.011002+0000","last_fullsized":"2024-09-12T01:43:10.011002+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.690408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.997967+0000","last_change":"2024-09-12T01:43:09.001072+0000","last_active":"2024-09-12T01:43:09.997967+0000","last_peered":"2024-09-12T01:43:09.997967+0000","last_clean":"2024-09-12T01:43:09.997967+0000","last_became_active":"2024-09-12T01:43:09.000603+0000","last_became_peered":"2024-09-12T01:43:09.000603+0000","last_unstale":"2024-09-12T01:43:09.997967+0000","last_undegraded":"2024-09-12T01:43:09.997967+0000","last_fullsized":"2024-09-12T01:43:09.997967+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:03.586102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016401+0000","last_change":"2024-09-12T01:43:10.015102+0000","last_active":"2024-09-12T01:43:10.016401+0000","last_peered":"2024-09-12T01:43:10.016401+0000","last_clean":"2024-09-12T01:43:10.016401+0000","last_became_active":"2024-09-12T01:43:10.012654+0000","last_became_peered":"2024-09-12T01:43:10.012654+0000","last_unstale":"2024-09-12T01:43:10.016401+0000","last_undegraded":"2024-09-12T01:43:10.016401+0000","last_fullsized":"2024-09-12T01:43:10.016401+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:06.891635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":114,"state":"creating+peering","last_fresh":"2024-09-12T01:43:07.980755+0000","last_change":"2024-09-12T01:43:07.980755+0000","last_active":"2024-09-12T01:43:07.971297+0000","last_peered":"2024-09-12T01:43:07.971297+0000","last_clean":"2024-09-12T01:43:07.971297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:07.980755+0000","last_undegraded":"2024-09-12T01:43:07.980755+0000","last_fullsized":"2024-09-12T01:43:07.980755+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015571+0000","last_change":"2024-09-12T01:43:10.007677+0000","last_active":"2024-09-12T01:43:10.015571+0000","last_peered":"2024-09-12T01:43:10.015571+0000","last_clean":"2024-09-12T01:43:10.015571+0000","last_became_active":"2024-09-12T01:43:10.003872+0000","last_became_peered":"2024-09-12T01:43:10.003872+0000","last_unstale":"2024-09-12T01:43:10.015571+0000","last_undegraded":"2024-09-12T01:43:10.015571+0000","last_fullsized":"2024-09-12T01:43:10.015571+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:09.721296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.995418+0000","last_change":"2024-09-12T01:43:09.002404+0000","last_active":"2024-09-12T01:43:09.995418+0000","last_peered":"2024-09-12T01:43:09.995418+0000","last_clean":"2024-09-12T01:43:09.995418+0000","last_became_active":"2024-09-12T01:43:09.001771+0000","last_became_peered":"2024-09-12T01:43:09.001771+0000","last_unstale":"2024-09-12T01:43:09.995418+0000","last_undegraded":"2024-09-12T01:43:09.995418+0000","last_fullsized":"2024-09-12T01:43:09.995418+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:17.856167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.021093+0000","last_change":"2024-09-12T01:43:10.018067+0000","last_active":"2024-09-12T01:43:10.021093+0000","last_peered":"2024-09-12T01:43:10.021093+0000","last_clean":"2024-09-12T01:43:10.021093+0000","last_became_active":"2024-09-12T01:43:10.017807+0000","last_became_peered":"2024-09-12T01:43:10.017807+0000","last_unstale":"2024-09-12T01:43:10.021093+0000","last_undegraded":"2024-09-12T01:43:10.021093+0000","last_fullsized":"2024-09-12T01:43:10.021093+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:43.834846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990273+0000","last_change":"2024-09-12T01:43:09.005613+0000","last_active":"2024-09-12T01:43:09.990273+0000","last_peered":"2024-09-12T01:43:09.990273+0000","last_clean":"2024-09-12T01:43:09.990273+0000","last_became_active":"2024-09-12T01:43:09.005273+0000","last_became_peered":"2024-09-12T01:43:09.005273+0000","last_unstale":"2024-09-12T01:43:09.990273+0000","last_undegraded":"2024-09-12T01:43:09.990273+0000","last_fullsized":"2024-09-12T01:43:09.990273+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:13.562581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015940+0000","last_change":"2024-09-12T01:43:10.012096+0000","last_active":"2024-09-12T01:43:10.015940+0000","last_peered":"2024-09-12T01:43:10.015940+0000","last_clean":"2024-09-12T01:43:10.015940+0000","last_became_active":"2024-09-12T01:43:10.011810+0000","last_became_peered":"2024-09-12T01:43:10.011810+0000","last_unstale":"2024-09-12T01:43:10.015940+0000","last_undegraded":"2024-09-12T01:43:10.015940+0000","last_fullsized":"2024-09-12T01:43:10.015940+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:00.279516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.000655+0000","last_change":"2024-09-12T01:43:09.001024+0000","last_active":"2024-09-12T01:43:10.000655+0000","last_peered":"2024-09-12T01:43:10.000655+0000","last_clean":"2024-09-12T01:43:10.000655+0000","last_became_active":"2024-09-12T01:43:09.000634+0000","last_became_peered":"2024-09-12T01:43:09.000634+0000","last_unstale":"2024-09-12T01:43:10.000655+0000","last_undegraded":"2024-09-12T01:43:10.000655+0000","last_fullsized":"2024-09-12T01:43:10.000655+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:30.008018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.996725+0000","last_change":"2024-09-12T01:43:09.995813+0000","last_active":"2024-09-12T01:43:09.996725+0000","last_peered":"2024-09-12T01:43:09.996725+0000","last_clean":"2024-09-12T01:43:09.996725+0000","last_became_active":"2024-09-12T01:43:09.995491+0000","last_became_peered":"2024-09-12T01:43:09.995491+0000","last_unstale":"2024-09-12T01:43:09.996725+0000","last_undegraded":"2024-09-12T01:43:09.996725+0000","last_fullsized":"2024-09-12T01:43:09.996725+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:09.217265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017611+0000","last_change":"2024-09-12T01:43:09.000595+0000","last_active":"2024-09-12T01:43:10.017611+0000","last_peered":"2024-09-12T01:43:10.017611+0000","last_clean":"2024-09-12T01:43:10.017611+0000","last_became_active":"2024-09-12T01:43:09.000302+0000","last_became_peered":"2024-09-12T01:43:09.000302+0000","last_unstale":"2024-09-12T01:43:10.017611+0000","last_undegraded":"2024-09-12T01:43:10.017611+0000","last_fullsized":"2024-09-12T01:43:10.017611+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:41.886774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":345,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.994810+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:43:09.994810+0000","last_peered":"2024-09-12T01:43:09.994810+0000","last_clean":"2024-09-12T01:43:09.994810+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:43:09.994810+0000","last_undegraded":"2024-09-12T01:43:09.994810+0000","last_fullsized":"2024-09-12T01:43:09.994810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509534,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1445888,"data_stored":614112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1441792,"data_stored":614078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509532,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1197671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509532,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1445888,"data_stored":614148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36744,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335096,"statfs":{"total":96636764160,"available":96599138304,"internally_reserved":0,"allocated":1429504,"data_stored":607303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509532,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37352,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334488,"statfs":{"total":96636764160,"available":96598515712,"internally_reserved":0,"allocated":2052096,"data_stored":1206080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509533,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36780,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335060,"statfs":{"total":96636764160,"available":96599101440,"internally_reserved":0,"allocated":1462272,"data_stored":615746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32572,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339268,"statfs":{"total":96636764160,"available":96603410432,"internally_reserved":0,"allocated":1417216,"data_stored":601028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:43:13.677 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3f is not active+clean 2024-09-12T01:43:13.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.677 INFO:tasks.ceph.ceph_manager.ceph:PG 19.3e is not active+clean 2024-09-12T01:43:13.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.677 INFO:tasks.ceph.ceph_manager.ceph:PG 19.36 is not active+clean 2024-09-12T01:43:13.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.677 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2d is not active+clean 2024-09-12T01:43:13.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.678 INFO:tasks.ceph.ceph_manager.ceph:PG 19.2a is not active+clean 2024-09-12T01:43:13.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.678 INFO:tasks.ceph.ceph_manager.ceph:PG 19.26 is not active+clean 2024-09-12T01:43:13.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.678 INFO:tasks.ceph.ceph_manager.ceph:PG 19.23 is not active+clean 2024-09-12T01:43:13.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.678 INFO:tasks.ceph.ceph_manager.ceph:PG 19.22 is not active+clean 2024-09-12T01:43:13.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.678 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1c is not active+clean 2024-09-12T01:43:13.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:07.980762+0000', 'last_change': '2024-09-12T01:43:07.980762+0000', 'last_active': '2024-09-12T01:43:07.971297+0000', 'last_peered': '2024-09-12T01:43:07.971297+0000', 'last_clean': '2024-09-12T01:43:07.971297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:07.980762+0000', 'last_undegraded': '2024-09-12T01:43:07.980762+0000', 'last_fullsized': '2024-09-12T01:43:07.980762+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:07.971297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:07.971297+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:07.971297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:43:13.679 INFO:tasks.ceph.ceph_manager.ceph:PG 18.1b is not active+clean 2024-09-12T01:43:13.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:07.981284+0000', 'last_change': '2024-09-12T01:43:07.981284+0000', 'last_active': '2024-09-12T01:43:07.971297+0000', 'last_peered': '2024-09-12T01:43:07.971297+0000', 'last_clean': '2024-09-12T01:43:07.971297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:07.981284+0000', 'last_undegraded': '2024-09-12T01:43:07.981284+0000', 'last_fullsized': '2024-09-12T01:43:07.981284+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:07.971297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:07.971297+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:07.971297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:43:13.679 INFO:tasks.ceph.ceph_manager.ceph:PG 19.19 is not active+clean 2024-09-12T01:43:13.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.679 INFO:tasks.ceph.ceph_manager.ceph:PG 18.18 is not active+clean 2024-09-12T01:43:13.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:07.980944+0000', 'last_change': '2024-09-12T01:43:07.980944+0000', 'last_active': '2024-09-12T01:43:07.971297+0000', 'last_peered': '2024-09-12T01:43:07.971297+0000', 'last_clean': '2024-09-12T01:43:07.971297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:07.980944+0000', 'last_undegraded': '2024-09-12T01:43:07.980944+0000', 'last_fullsized': '2024-09-12T01:43:07.980944+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:07.971297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:07.971297+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:07.971297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:43:13.679 INFO:tasks.ceph.ceph_manager.ceph:PG 19.16 is not active+clean 2024-09-12T01:43:13.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.679 INFO:tasks.ceph.ceph_manager.ceph:PG 19.c is not active+clean 2024-09-12T01:43:13.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.680 INFO:tasks.ceph.ceph_manager.ceph:PG 19.d is not active+clean 2024-09-12T01:43:13.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.680 INFO:tasks.ceph.ceph_manager.ceph:PG 19.a is not active+clean 2024-09-12T01:43:13.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.680 INFO:tasks.ceph.ceph_manager.ceph:PG 19.7 is not active+clean 2024-09-12T01:43:13.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '19.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:08.976766+0000', 'last_change': '2024-09-12T01:43:08.976766+0000', 'last_active': '2024-09-12T01:43:08.976766+0000', 'last_peered': '2024-09-12T01:43:08.976766+0000', 'last_clean': '2024-09-12T01:43:08.976766+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:08.976766+0000', 'last_undegraded': '2024-09-12T01:43:08.976766+0000', 'last_fullsized': '2024-09-12T01:43:08.976766+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:08.976766+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:13.680 INFO:tasks.ceph.ceph_manager.ceph:PG 18.3 is not active+clean 2024-09-12T01:43:13.680 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 114, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:07.980755+0000', 'last_change': '2024-09-12T01:43:07.980755+0000', 'last_active': '2024-09-12T01:43:07.971297+0000', 'last_peered': '2024-09-12T01:43:07.971297+0000', 'last_clean': '2024-09-12T01:43:07.971297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:07.980755+0000', 'last_undegraded': '2024-09-12T01:43:07.980755+0000', 'last_fullsized': '2024-09-12T01:43:07.980755+0000', 'mapping_epoch': 114, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 114, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:07.971297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:07.971297+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:07.971297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:43:13.681 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:43:13.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.814+0000 7f0f7e72a640 1 Processor -- start 2024-09-12T01:43:13.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.814+0000 7f0f7e72a640 1 -- start start 2024-09-12T01:43:13.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.815+0000 7f0f7e72a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0f7815c2b0 0x7f0f780b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.815+0000 7f0f7e72a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f0f780b72f0 0x7f0f7815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.815+0000 7f0f7e72a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f7815f030 0x7f0f7806f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.815+0000 7f0f7e72a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f0f7815fb10 con 0x7f0f7815c2b0 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.815+0000 7f0f7e72a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f0f780b5900 con 0x7f0f780b72f0 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.815+0000 7f0f7e72a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7815f830 con 0x7f0f7815f030 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.815+0000 7f0f77fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0f7815c2b0 0x7f0f780b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.815+0000 7f0f77fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0f7815c2b0 0x7f0f780b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53382/0 (socket says 172.21.15.60:53382) 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.815+0000 7f0f77fff640 1 -- 172.21.15.60:0/790320132 learned_addr learned my addr 172.21.15.60:0/790320132 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.816+0000 7f0f7ccc7640 1 --2- 172.21.15.60:0/790320132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f7815f030 0x7f0f7806f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.816+0000 7f0f777fe640 1 --2- 172.21.15.60:0/790320132 >> v2:172.21.15.105:3300/0 conn(0x7f0f780b72f0 0x7f0f7815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.816+0000 7f0f77fff640 1 -- 172.21.15.60:0/790320132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f7815f030 msgr2=0x7f0f7806f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.816+0000 7f0f77fff640 1 --2- 172.21.15.60:0/790320132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f7815f030 0x7f0f7806f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.816+0000 7f0f77fff640 1 -- 172.21.15.60:0/790320132 >> v2:172.21.15.105:3300/0 conn(0x7f0f780b72f0 msgr2=0x7f0f7815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.816+0000 7f0f77fff640 1 --2- 172.21.15.60:0/790320132 >> v2:172.21.15.105:3300/0 conn(0x7f0f780b72f0 0x7f0f7815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.816+0000 7f0f77fff640 1 -- 172.21.15.60:0/790320132 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7806ce30 con 0x7f0f7815c2b0 2024-09-12T01:43:13.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.816+0000 7f0f777fe640 1 --2- 172.21.15.60:0/790320132 >> v2:172.21.15.105:3300/0 conn(0x7f0f780b72f0 0x7f0f7815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:13.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.816+0000 7f0f77fff640 1 --2- 172.21.15.60:0/790320132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f7815c2b0 0x7f0f780b6db0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f0f78071d10 tx=0x7f0f6802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dac1e97a76cd8d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:13.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.817+0000 7f0f76ffd640 1 -- 172.21.15.60:0/790320132 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68037070 con 0x7f0f7815c2b0 2024-09-12T01:43:13.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.817+0000 7f0f76ffd640 1 -- 172.21.15.60:0/790320132 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f68032440 con 0x7f0f7815c2b0 2024-09-12T01:43:13.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.817+0000 7f0f76ffd640 1 -- 172.21.15.60:0/790320132 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f68032810 con 0x7f0f7815c2b0 2024-09-12T01:43:13.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.817+0000 7f0f7e72a640 1 -- 172.21.15.60:0/790320132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f7815c2b0 msgr2=0x7f0f780b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.817+0000 7f0f7e72a640 1 --2- 172.21.15.60:0/790320132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f7815c2b0 0x7f0f780b6db0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f0f78071d10 tx=0x7f0f6802a1e0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.817+0000 7f0f7e72a640 1 -- 172.21.15.60:0/790320132 shutdown_connections 2024-09-12T01:43:13.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.817+0000 7f0f7e72a640 1 --2- 172.21.15.60:0/790320132 >> v2:172.21.15.105:3300/0 conn(0x7f0f780b72f0 0x7f0f7815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.817+0000 7f0f7e72a640 1 --2- 172.21.15.60:0/790320132 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f7815f030 0x7f0f7806f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.817+0000 7f0f7e72a640 1 --2- 172.21.15.60:0/790320132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f7815c2b0 0x7f0f780b6db0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.817+0000 7f0f7e72a640 1 -- 172.21.15.60:0/790320132 >> 172.21.15.60:0/790320132 conn(0x7f0f780b4240 msgr2=0x7f0f780b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:13.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.817+0000 7f0f7e72a640 1 -- 172.21.15.60:0/790320132 shutdown_connections 2024-09-12T01:43:13.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.817+0000 7f0f7e72a640 1 -- 172.21.15.60:0/790320132 wait complete. 2024-09-12T01:43:13.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.818+0000 7f0f7e72a640 1 Processor -- start 2024-09-12T01:43:13.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.819+0000 7f0f7e72a640 1 -- start start 2024-09-12T01:43:13.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.819+0000 7f0f7e72a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f780b72f0 0x7f0f781e6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.819+0000 7f0f7e72a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f7815c2b0 0x7f0f78148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.819+0000 7f0f7e72a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f7815f030 0x7f0f781f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.819+0000 7f0f7e72a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0f780b7760 con 0x7f0f7815c2b0 2024-09-12T01:43:13.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.819+0000 7f0f7e72a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7806d3f0 con 0x7f0f780b72f0 2024-09-12T01:43:13.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.819+0000 7f0f7e72a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7815f4c0 con 0x7f0f7815f030 2024-09-12T01:43:13.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f7815c2b0 0x7f0f78148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f7815c2b0 0x7f0f78148f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53384/0 (socket says 172.21.15.60:53384) 2024-09-12T01:43:13.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f777fe640 1 -- 172.21.15.60:0/475615805 learned_addr learned my addr 172.21.15.60:0/475615805 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:13.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f77fff640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f780b72f0 0x7f0f781e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f7ccc7640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f7815f030 0x7f0f781f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f777fe640 1 -- 172.21.15.60:0/475615805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f7815f030 msgr2=0x7f0f781f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f777fe640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f7815f030 0x7f0f781f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f777fe640 1 -- 172.21.15.60:0/475615805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f780b72f0 msgr2=0x7f0f781e6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:13.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f777fe640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f780b72f0 0x7f0f781e6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:13.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f777fe640 1 -- 172.21.15.60:0/475615805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f781494a0 con 0x7f0f7815c2b0 2024-09-12T01:43:13.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f777fe640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f7815c2b0 0x7f0f78148f60 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c7f0 tx=0x7f0f6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:13.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f74ff9640 1 -- 172.21.15.60:0/475615805 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c015070 con 0x7f0f7815c2b0 2024-09-12T01:43:13.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f74ff9640 1 -- 172.21.15.60:0/475615805 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c007a30 con 0x7f0f7815c2b0 2024-09-12T01:43:13.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f7e72a640 1 -- 172.21.15.60:0/475615805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f781e7460 con 0x7f0f7815c2b0 2024-09-12T01:43:13.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f74ff9640 1 -- 172.21.15.60:0/475615805 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c007e00 con 0x7f0f7815c2b0 2024-09-12T01:43:13.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.820+0000 7f0f7e72a640 1 -- 172.21.15.60:0/475615805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f781e7a20 con 0x7f0f7815c2b0 2024-09-12T01:43:13.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.821+0000 7f0f7e72a640 1 -- 172.21.15.60:0/475615805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f7815eaf0 con 0x7f0f7815c2b0 2024-09-12T01:43:13.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.822+0000 7f0f74ff9640 1 -- 172.21.15.60:0/475615805 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f0f6c018070 con 0x7f0f7815c2b0 2024-09-12T01:43:13.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.822+0000 7f0f74ff9640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0f6406be60 0x7f0f6406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:13.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.822+0000 7f0f74ff9640 1 -- 172.21.15.60:0/475615805 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f0f6c08ac40 con 0x7f0f7815c2b0 2024-09-12T01:43:13.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.823+0000 7f0f77fff640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0f6406be60 0x7f0f6406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:13.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.823+0000 7f0f77fff640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0f6406be60 0x7f0f6406e320 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0f68034000 tx=0x7f0f6802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:13.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:13.827+0000 7f0f74ff9640 1 -- 172.21.15.60:0/475615805 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f0f781494a0 con 0x7f0f7815c2b0 2024-09-12T01:43:14.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.073+0000 7f0f7e72a640 1 -- 172.21.15.60:0/475615805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0f781567d0 con 0x7f0f7815c2b0 2024-09-12T01:43:14.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.073+0000 7f0f74ff9640 1 -- 172.21.15.60:0/475615805 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1638 (secure 0 0 0) 0x7f0f6c059030 con 0x7f0f7815c2b0 2024-09-12T01:43:14.074 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:14.074 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":461,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":117,"num_osds":8,"num_up_osds":8,"osd_up_since":1726104944,"num_in_osds":8,"osd_in_since":1726104934,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":79},{"state_name":"unknown","count":14},{"state_name":"creating+peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592778,"bytes_used":289529856,"bytes_avail":772804583424,"bytes_total":773094113280,"unknown_pgs_ratio":0.14432989060878754,"inactive_pgs_ratio":0.041237112134695053,"write_bytes_sec":3271,"read_op_per_sec":0,"write_op_per_sec":9},"fsmap":{"epoch":69,"btime":"2024-09-12T01:43:11:998781+0000","id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"d","status":"up:active","gid":7545}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-12T01:42:58.356047+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T01:43:14.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.075+0000 7f0f7e72a640 1 -- 172.21.15.60:0/475615805 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0f6406be60 msgr2=0x7f0f6406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:14.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.075+0000 7f0f7e72a640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0f6406be60 0x7f0f6406e320 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f0f68034000 tx=0x7f0f6802e000 comp rx=0 tx=0).stop 2024-09-12T01:43:14.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.075+0000 7f0f7e72a640 1 -- 172.21.15.60:0/475615805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f7815c2b0 msgr2=0x7f0f78148f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:14.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.075+0000 7f0f7e72a640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f7815c2b0 0x7f0f78148f60 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00c7f0 tx=0x7f0f6c00cbf0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.075+0000 7f0f7e72a640 1 -- 172.21.15.60:0/475615805 shutdown_connections 2024-09-12T01:43:14.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.075+0000 7f0f7e72a640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f0f6406be60 0x7f0f6406e320 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.075+0000 7f0f7e72a640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f0f7815f030 0x7f0f781f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.075+0000 7f0f7e72a640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f7815c2b0 0x7f0f78148f60 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.075+0000 7f0f7e72a640 1 --2- 172.21.15.60:0/475615805 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f0f780b72f0 0x7f0f781e6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.075+0000 7f0f7e72a640 1 -- 172.21.15.60:0/475615805 >> 172.21.15.60:0/475615805 conn(0x7f0f780b4240 msgr2=0x7f0f7815e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.075+0000 7f0f7e72a640 1 -- 172.21.15.60:0/475615805 shutdown_connections 2024-09-12T01:43:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.075+0000 7f0f7e72a640 1 -- 172.21.15.60:0/475615805 wait complete. 2024-09-12T01:43:14.087 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:43:14.087 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:43:14.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.189+0000 7f3887d03640 1 Processor -- start 2024-09-12T01:43:14.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.189+0000 7f3887d03640 1 -- start start 2024-09-12T01:43:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3887d03640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800b63d0 0x7f38800d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3887d03640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f38800d1c80 0x7f38800b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3887d03640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38800cfc20 con 0x7f38800cf6b0 2024-09-12T01:43:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3887d03640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f38800d2ed0 con 0x7f38800d1c80 2024-09-12T01:43:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3887d03640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f38800d31b0 con 0x7f38800b63d0 2024-09-12T01:43:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f388529e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f38800cf6b0 0x7f38800b7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50282/0 (socket says 172.21.15.60:50282) 2024-09-12T01:43:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f388529e640 1 -- 172.21.15.60:0/2028322349 learned_addr learned my addr 172.21.15.60:0/2028322349 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3885a9f640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800b63d0 0x7f38800d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f38862a0640 1 --2- 172.21.15.60:0/2028322349 >> v2:172.21.15.105:3300/0 conn(0x7f38800d1c80 0x7f38800b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742253986 0 0) 0x7f38800cfc20 con 0x7f38800cf6b0 2024-09-12T01:43:14.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f386c003520 con 0x7f38800cf6b0 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 344505068 0 0) 0x7f386c003520 con 0x7f38800cf6b0 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800b63d0 msgr2=0x7f38800d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3884a9d640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800b63d0 0x7f38800d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 >> v2:172.21.15.105:3300/0 conn(0x7f38800d1c80 msgr2=0x7f38800b7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3884a9d640 1 --2- 172.21.15.60:0/2028322349 >> v2:172.21.15.105:3300/0 conn(0x7f38800d1c80 0x7f38800b7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38800d3490 con 0x7f38800cf6b0 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f3870001670 con 0x7f38800cf6b0 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.190+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 >> v1:172.21.15.60:6789/0 conn(0x7f38800cf6b0 legacy=0x7f38800b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f3884a9d640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f386c0039b0 0x7f386c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f3884a9d640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800b63d0 0x7f386c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f3884a9d640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f386c004d40 0x7f386c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38800d2ed0 con 0x7f386c0039b0 2024-09-12T01:43:14.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38800d31b0 con 0x7f386c004d40 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f386c00ba40 con 0x7f38800b63d0 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f3885a9f640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f386c0039b0 0x7f386c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f388529e640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800b63d0 0x7f386c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f38862a0640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f386c004d40 0x7f386c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f3885a9f640 1 -- 172.21.15.60:0/2028322349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800b63d0 msgr2=0x7f386c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f3885a9f640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800b63d0 0x7f386c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f3885a9f640 1 -- 172.21.15.60:0/2028322349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f386c004d40 msgr2=0x7f386c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f3885a9f640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f386c004d40 0x7f386c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f3885a9f640 1 -- 172.21.15.60:0/2028322349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c003520 con 0x7f386c0039b0 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.191+0000 7f388529e640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800b63d0 0x7f386c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.192+0000 7f3885a9f640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f386c0039b0 0x7f386c003dd0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f387c009ac0 tx=0x7f386c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d444cb368fe660f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.192+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c036070 con 0x7f386c0039b0 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.192+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387c031400 con 0x7f386c0039b0 2024-09-12T01:43:14.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.192+0000 7f3884a9d640 1 -- 172.21.15.60:0/2028322349 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387c009690 con 0x7f386c0039b0 2024-09-12T01:43:14.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.192+0000 7f3887d03640 1 -- 172.21.15.60:0/2028322349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f386c0039b0 msgr2=0x7f386c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:14.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.192+0000 7f3887d03640 1 --2- 172.21.15.60:0/2028322349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f386c0039b0 0x7f386c003dd0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f387c009ac0 tx=0x7f386c005830 comp rx=0 tx=0).stop 2024-09-12T01:43:14.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.192+0000 7f38862a0640 1 -- 172.21.15.60:0/2028322349 reap_dead start 2024-09-12T01:43:14.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.192+0000 7f3887d03640 1 -- 172.21.15.60:0/2028322349 shutdown_connections 2024-09-12T01:43:14.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.192+0000 7f3887d03640 1 -- 172.21.15.60:0/2028322349 >> 172.21.15.60:0/2028322349 conn(0x7f38800d1160 msgr2=0x7f38800d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:14.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.192+0000 7f3887d03640 1 -- 172.21.15.60:0/2028322349 shutdown_connections 2024-09-12T01:43:14.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.192+0000 7f3887d03640 1 -- 172.21.15.60:0/2028322349 wait complete. 2024-09-12T01:43:14.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.194+0000 7f3887d03640 1 Processor -- start 2024-09-12T01:43:14.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.194+0000 7f3887d03640 1 -- start start 2024-09-12T01:43:14.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.194+0000 7f3887d03640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f386c0039b0 0x7f38800ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.194+0000 7f3887d03640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800ce2b0 0x7f3880153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.194+0000 7f3887d03640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38800cc360 0x7f38800cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.194+0000 7f3887d03640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38800b6930 con 0x7f38800cc360 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.194+0000 7f3887d03640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f38800b67b0 con 0x7f386c0039b0 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.194+0000 7f3887d03640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f38800b6ab0 con 0x7f38800ce2b0 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.194+0000 7f38862a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38800cc360 0x7f38800cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.194+0000 7f38862a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38800cc360 0x7f38800cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53406/0 (socket says 172.21.15.60:53406) 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.194+0000 7f38862a0640 1 -- 172.21.15.60:0/3693399345 learned_addr learned my addr 172.21.15.60:0/3693399345 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.195+0000 7f38862a0640 1 -- 172.21.15.60:0/3693399345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800ce2b0 msgr2=0x7f3880153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.195+0000 7f38862a0640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800ce2b0 0x7f3880153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.195+0000 7f38862a0640 1 -- 172.21.15.60:0/3693399345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f386c0039b0 msgr2=0x7f38800ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.195+0000 7f3885a9f640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f386c0039b0 0x7f38800ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:14.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.195+0000 7f38862a0640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f386c0039b0 0x7f38800ab290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.195+0000 7f38862a0640 1 -- 172.21.15.60:0/3693399345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38800cd030 con 0x7f38800cc360 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.195+0000 7f38862a0640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38800cc360 0x7f38800cc810 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f3878007d10 tx=0x7f38780115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.195+0000 7f38767fc640 1 -- 172.21.15.60:0/3693399345 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878011de0 con 0x7f38800cc360 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.195+0000 7f38767fc640 1 -- 172.21.15.60:0/3693399345 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f387801b070 con 0x7f38800cc360 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.195+0000 7f3887d03640 1 -- 172.21.15.60:0/3693399345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38800cd310 con 0x7f38800cc360 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.195+0000 7f38767fc640 1 -- 172.21.15.60:0/3693399345 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878003990 con 0x7f38800cc360 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.195+0000 7f3887d03640 1 -- 172.21.15.60:0/3693399345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38800cd8d0 con 0x7f38800cc360 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.196+0000 7f3887d03640 1 -- 172.21.15.60:0/3693399345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38800cdad0 con 0x7f38800cc360 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.197+0000 7f38767fc640 1 -- 172.21.15.60:0/3693399345 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3878005d10 con 0x7f38800cc360 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.197+0000 7f38767fc640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f386406be60 0x7f386406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.197+0000 7f3885a9f640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f386406be60 0x7f386406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.197+0000 7f38767fc640 1 -- 172.21.15.60:0/3693399345 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f387808b370 con 0x7f38800cc360 2024-09-12T01:43:14.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.198+0000 7f3885a9f640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f386406be60 0x7f386406e320 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f387c033000 tx=0x7f387c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:14.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.202+0000 7f38767fc640 1 -- 172.21.15.60:0/3693399345 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f38800cdad0 con 0x7f38800cc360 2024-09-12T01:43:14.376 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.375+0000 7f3887d03640 1 -- 172.21.15.60:0/3693399345 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f38800d39b0 con 0x7f386406be60 2024-09-12T01:43:14.382 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.381+0000 7f38767fc640 1 -- 172.21.15.60:0/3693399345 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252448 (secure 0 0 0) 0x7f38800d39b0 con 0x7f386406be60 2024-09-12T01:43:14.385 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:14.386 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:43:14.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.385+0000 7f3887d03640 1 -- 172.21.15.60:0/3693399345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f386406be60 msgr2=0x7f386406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:14.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.385+0000 7f3887d03640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f386406be60 0x7f386406e320 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f387c033000 tx=0x7f387c008030 comp rx=0 tx=0).stop 2024-09-12T01:43:14.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.385+0000 7f3887d03640 1 -- 172.21.15.60:0/3693399345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38800cc360 msgr2=0x7f38800cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:14.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.385+0000 7f3887d03640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38800cc360 0x7f38800cc810 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f3878007d10 tx=0x7f38780115a0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.385+0000 7f3887d03640 1 -- 172.21.15.60:0/3693399345 shutdown_connections 2024-09-12T01:43:14.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.385+0000 7f3887d03640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38800cc360 0x7f38800cc810 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.385+0000 7f3887d03640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f386406be60 0x7f386406e320 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.385+0000 7f3887d03640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f38800ce2b0 0x7f3880153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.385+0000 7f3887d03640 1 --2- 172.21.15.60:0/3693399345 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f386c0039b0 0x7f38800ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:14.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.385+0000 7f3887d03640 1 -- 172.21.15.60:0/3693399345 >> 172.21.15.60:0/3693399345 conn(0x7f38800d1160 msgr2=0x7f38800b8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:14.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.385+0000 7f3887d03640 1 -- 172.21.15.60:0/3693399345 shutdown_connections 2024-09-12T01:43:14.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:14.385+0000 7f3887d03640 1 -- 172.21.15.60:0/3693399345 wait complete. 2024-09-12T01:43:14.396 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-09-12T01:43:14.358920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":282784,"kb_used_data":12456,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754691936,"statfs":{"total":773094113280,"available":772804542464,"internally_reserved":0,"allocated":12754944,"data_stored":6089516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000909"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963571+0000","last_change":"2024-09-12T01:43:09.999182+0000","last_active":"2024-09-12T01:43:11.963571+0000","last_peered":"2024-09-12T01:43:11.963571+0000","last_clean":"2024-09-12T01:43:11.963571+0000","last_became_active":"2024-09-12T01:43:09.998818+0000","last_became_peered":"2024-09-12T01:43:09.998818+0000","last_unstale":"2024-09-12T01:43:11.963571+0000","last_undegraded":"2024-09-12T01:43:11.963571+0000","last_fullsized":"2024-09-12T01:43:11.963571+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:01.439976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964102+0000","last_change":"2024-09-12T01:43:10.001842+0000","last_active":"2024-09-12T01:43:11.964102+0000","last_peered":"2024-09-12T01:43:11.964102+0000","last_clean":"2024-09-12T01:43:11.964102+0000","last_became_active":"2024-09-12T01:43:10.001559+0000","last_became_peered":"2024-09-12T01:43:10.001559+0000","last_unstale":"2024-09-12T01:43:11.964102+0000","last_undegraded":"2024-09-12T01:43:11.964102+0000","last_fullsized":"2024-09-12T01:43:11.964102+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:30.818180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012397+0000","last_change":"2024-09-12T01:43:10.010617+0000","last_active":"2024-09-12T01:43:10.012397+0000","last_peered":"2024-09-12T01:43:10.012397+0000","last_clean":"2024-09-12T01:43:10.012397+0000","last_became_active":"2024-09-12T01:43:10.010318+0000","last_became_peered":"2024-09-12T01:43:10.010318+0000","last_unstale":"2024-09-12T01:43:10.012397+0000","last_undegraded":"2024-09-12T01:43:10.012397+0000","last_fullsized":"2024-09-12T01:43:10.012397+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:00.998086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.003006+0000","last_change":"2024-09-12T01:43:09.999067+0000","last_active":"2024-09-12T01:43:10.003006+0000","last_peered":"2024-09-12T01:43:10.003006+0000","last_clean":"2024-09-12T01:43:10.003006+0000","last_became_active":"2024-09-12T01:43:09.998779+0000","last_became_peered":"2024-09-12T01:43:09.998779+0000","last_unstale":"2024-09-12T01:43:10.003006+0000","last_undegraded":"2024-09-12T01:43:10.003006+0000","last_fullsized":"2024-09-12T01:43:10.003006+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.436244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.009603+0000","last_change":"2024-09-12T01:43:10.007268+0000","last_active":"2024-09-12T01:43:10.009603+0000","last_peered":"2024-09-12T01:43:10.009603+0000","last_clean":"2024-09-12T01:43:10.009603+0000","last_became_active":"2024-09-12T01:43:10.006974+0000","last_became_peered":"2024-09-12T01:43:10.006974+0000","last_unstale":"2024-09-12T01:43:10.009603+0000","last_undegraded":"2024-09-12T01:43:10.009603+0000","last_fullsized":"2024-09-12T01:43:10.009603+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:45.313222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016364+0000","last_change":"2024-09-12T01:43:10.013407+0000","last_active":"2024-09-12T01:43:10.016364+0000","last_peered":"2024-09-12T01:43:10.016364+0000","last_clean":"2024-09-12T01:43:10.016364+0000","last_became_active":"2024-09-12T01:43:10.013078+0000","last_became_peered":"2024-09-12T01:43:10.013078+0000","last_unstale":"2024-09-12T01:43:10.016364+0000","last_undegraded":"2024-09-12T01:43:10.016364+0000","last_fullsized":"2024-09-12T01:43:10.016364+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:59.595180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.000806+0000","last_change":"2024-09-12T01:43:09.993325+0000","last_active":"2024-09-12T01:43:10.000806+0000","last_peered":"2024-09-12T01:43:10.000806+0000","last_clean":"2024-09-12T01:43:10.000806+0000","last_became_active":"2024-09-12T01:43:09.993003+0000","last_became_peered":"2024-09-12T01:43:09.993003+0000","last_unstale":"2024-09-12T01:43:10.000806+0000","last_undegraded":"2024-09-12T01:43:10.000806+0000","last_fullsized":"2024-09-12T01:43:10.000806+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:13.868284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.009578+0000","last_change":"2024-09-12T01:43:10.006897+0000","last_active":"2024-09-12T01:43:10.009578+0000","last_peered":"2024-09-12T01:43:10.009578+0000","last_clean":"2024-09-12T01:43:10.009578+0000","last_became_active":"2024-09-12T01:43:10.006607+0000","last_became_peered":"2024-09-12T01:43:10.006607+0000","last_unstale":"2024-09-12T01:43:10.009578+0000","last_undegraded":"2024-09-12T01:43:10.009578+0000","last_fullsized":"2024-09-12T01:43:10.009578+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:22.478063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.002936+0000","last_change":"2024-09-12T01:43:09.999698+0000","last_active":"2024-09-12T01:43:10.002936+0000","last_peered":"2024-09-12T01:43:10.002936+0000","last_clean":"2024-09-12T01:43:10.002936+0000","last_became_active":"2024-09-12T01:43:09.999370+0000","last_became_peered":"2024-09-12T01:43:09.999370+0000","last_unstale":"2024-09-12T01:43:10.002936+0000","last_undegraded":"2024-09-12T01:43:10.002936+0000","last_fullsized":"2024-09-12T01:43:10.002936+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:02.840344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963990+0000","last_change":"2024-09-12T01:43:09.999801+0000","last_active":"2024-09-12T01:43:11.963990+0000","last_peered":"2024-09-12T01:43:11.963990+0000","last_clean":"2024-09-12T01:43:11.963990+0000","last_became_active":"2024-09-12T01:43:09.999516+0000","last_became_peered":"2024-09-12T01:43:09.999516+0000","last_unstale":"2024-09-12T01:43:11.963990+0000","last_undegraded":"2024-09-12T01:43:11.963990+0000","last_fullsized":"2024-09-12T01:43:11.963990+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:32.133173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010670+0000","last_change":"2024-09-12T01:43:10.007674+0000","last_active":"2024-09-12T01:43:10.010670+0000","last_peered":"2024-09-12T01:43:10.010670+0000","last_clean":"2024-09-12T01:43:10.010670+0000","last_became_active":"2024-09-12T01:43:10.006630+0000","last_became_peered":"2024-09-12T01:43:10.006630+0000","last_unstale":"2024-09-12T01:43:10.010670+0000","last_undegraded":"2024-09-12T01:43:10.010670+0000","last_fullsized":"2024-09-12T01:43:10.010670+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:43.082717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.019627+0000","last_change":"2024-09-12T01:43:10.017470+0000","last_active":"2024-09-12T01:43:10.019627+0000","last_peered":"2024-09-12T01:43:10.019627+0000","last_clean":"2024-09-12T01:43:10.019627+0000","last_became_active":"2024-09-12T01:43:10.017170+0000","last_became_peered":"2024-09-12T01:43:10.017170+0000","last_unstale":"2024-09-12T01:43:10.019627+0000","last_undegraded":"2024-09-12T01:43:10.019627+0000","last_fullsized":"2024-09-12T01:43:10.019627+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:10.230932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013106+0000","last_change":"2024-09-12T01:43:10.009228+0000","last_active":"2024-09-12T01:43:10.013106+0000","last_peered":"2024-09-12T01:43:10.013106+0000","last_clean":"2024-09-12T01:43:10.013106+0000","last_became_active":"2024-09-12T01:43:10.008772+0000","last_became_peered":"2024-09-12T01:43:10.008772+0000","last_unstale":"2024-09-12T01:43:10.013106+0000","last_undegraded":"2024-09-12T01:43:10.013106+0000","last_fullsized":"2024-09-12T01:43:10.013106+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:04.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015852+0000","last_change":"2024-09-12T01:43:10.010426+0000","last_active":"2024-09-12T01:43:10.015852+0000","last_peered":"2024-09-12T01:43:10.015852+0000","last_clean":"2024-09-12T01:43:10.015852+0000","last_became_active":"2024-09-12T01:43:10.010145+0000","last_became_peered":"2024-09-12T01:43:10.010145+0000","last_unstale":"2024-09-12T01:43:10.015852+0000","last_undegraded":"2024-09-12T01:43:10.015852+0000","last_fullsized":"2024-09-12T01:43:10.015852+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:14.568049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016141+0000","last_change":"2024-09-12T01:43:10.012384+0000","last_active":"2024-09-12T01:43:10.016141+0000","last_peered":"2024-09-12T01:43:10.016141+0000","last_clean":"2024-09-12T01:43:10.016141+0000","last_became_active":"2024-09-12T01:43:10.012073+0000","last_became_peered":"2024-09-12T01:43:10.012073+0000","last_unstale":"2024-09-12T01:43:10.016141+0000","last_undegraded":"2024-09-12T01:43:10.016141+0000","last_fullsized":"2024-09-12T01:43:10.016141+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:35.398682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010228+0000","last_change":"2024-09-12T01:43:10.005425+0000","last_active":"2024-09-12T01:43:10.010228+0000","last_peered":"2024-09-12T01:43:10.010228+0000","last_clean":"2024-09-12T01:43:10.010228+0000","last_became_active":"2024-09-12T01:43:10.005101+0000","last_became_peered":"2024-09-12T01:43:10.005101+0000","last_unstale":"2024-09-12T01:43:10.010228+0000","last_undegraded":"2024-09-12T01:43:10.010228+0000","last_fullsized":"2024-09-12T01:43:10.010228+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:45.075912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.996407+0000","last_change":"2024-09-12T01:43:09.994951+0000","last_active":"2024-09-12T01:43:09.996407+0000","last_peered":"2024-09-12T01:43:09.996407+0000","last_clean":"2024-09-12T01:43:09.996407+0000","last_became_active":"2024-09-12T01:43:09.994653+0000","last_became_peered":"2024-09-12T01:43:09.994653+0000","last_unstale":"2024-09-12T01:43:09.996407+0000","last_undegraded":"2024-09-12T01:43:09.996407+0000","last_fullsized":"2024-09-12T01:43:09.996407+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:28.947715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.018468+0000","last_change":"2024-09-12T01:43:10.013071+0000","last_active":"2024-09-12T01:43:10.018468+0000","last_peered":"2024-09-12T01:43:10.018468+0000","last_clean":"2024-09-12T01:43:10.018468+0000","last_became_active":"2024-09-12T01:43:10.012269+0000","last_became_peered":"2024-09-12T01:43:10.012269+0000","last_unstale":"2024-09-12T01:43:10.018468+0000","last_undegraded":"2024-09-12T01:43:10.018468+0000","last_fullsized":"2024-09-12T01:43:10.018468+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:30.956540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963751+0000","last_change":"2024-09-12T01:43:10.007750+0000","last_active":"2024-09-12T01:43:11.963751+0000","last_peered":"2024-09-12T01:43:11.963751+0000","last_clean":"2024-09-12T01:43:11.963751+0000","last_became_active":"2024-09-12T01:43:10.007449+0000","last_became_peered":"2024-09-12T01:43:10.007449+0000","last_unstale":"2024-09-12T01:43:11.963751+0000","last_undegraded":"2024-09-12T01:43:11.963751+0000","last_fullsized":"2024-09-12T01:43:11.963751+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.495034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012952+0000","last_change":"2024-09-12T01:43:10.008649+0000","last_active":"2024-09-12T01:43:10.012952+0000","last_peered":"2024-09-12T01:43:10.012952+0000","last_clean":"2024-09-12T01:43:10.012952+0000","last_became_active":"2024-09-12T01:43:10.008285+0000","last_became_peered":"2024-09-12T01:43:10.008285+0000","last_unstale":"2024-09-12T01:43:10.012952+0000","last_undegraded":"2024-09-12T01:43:10.012952+0000","last_fullsized":"2024-09-12T01:43:10.012952+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:52.990907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.018040+0000","last_change":"2024-09-12T01:43:10.015834+0000","last_active":"2024-09-12T01:43:10.018040+0000","last_peered":"2024-09-12T01:43:10.018040+0000","last_clean":"2024-09-12T01:43:10.018040+0000","last_became_active":"2024-09-12T01:43:10.012836+0000","last_became_peered":"2024-09-12T01:43:10.012836+0000","last_unstale":"2024-09-12T01:43:10.018040+0000","last_undegraded":"2024-09-12T01:43:10.018040+0000","last_fullsized":"2024-09-12T01:43:10.018040+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:00.239866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963438+0000","last_change":"2024-09-12T01:43:10.001151+0000","last_active":"2024-09-12T01:43:11.963438+0000","last_peered":"2024-09-12T01:43:11.963438+0000","last_clean":"2024-09-12T01:43:11.963438+0000","last_became_active":"2024-09-12T01:43:10.000168+0000","last_became_peered":"2024-09-12T01:43:10.000168+0000","last_unstale":"2024-09-12T01:43:11.963438+0000","last_undegraded":"2024-09-12T01:43:11.963438+0000","last_fullsized":"2024-09-12T01:43:11.963438+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:18.112884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016842+0000","last_change":"2024-09-12T01:43:10.015393+0000","last_active":"2024-09-12T01:43:10.016842+0000","last_peered":"2024-09-12T01:43:10.016842+0000","last_clean":"2024-09-12T01:43:10.016842+0000","last_became_active":"2024-09-12T01:43:10.015131+0000","last_became_peered":"2024-09-12T01:43:10.015131+0000","last_unstale":"2024-09-12T01:43:10.016842+0000","last_undegraded":"2024-09-12T01:43:10.016842+0000","last_fullsized":"2024-09-12T01:43:10.016842+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:51.240289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.021079+0000","last_change":"2024-09-12T01:43:10.017901+0000","last_active":"2024-09-12T01:43:10.021079+0000","last_peered":"2024-09-12T01:43:10.021079+0000","last_clean":"2024-09-12T01:43:10.021079+0000","last_became_active":"2024-09-12T01:43:10.017599+0000","last_became_peered":"2024-09-12T01:43:10.017599+0000","last_unstale":"2024-09-12T01:43:10.021079+0000","last_undegraded":"2024-09-12T01:43:10.021079+0000","last_fullsized":"2024-09-12T01:43:10.021079+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:23.039212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012926+0000","last_change":"2024-09-12T01:43:10.008416+0000","last_active":"2024-09-12T01:43:10.012926+0000","last_peered":"2024-09-12T01:43:10.012926+0000","last_clean":"2024-09-12T01:43:10.012926+0000","last_became_active":"2024-09-12T01:43:10.008149+0000","last_became_peered":"2024-09-12T01:43:10.008149+0000","last_unstale":"2024-09-12T01:43:10.012926+0000","last_undegraded":"2024-09-12T01:43:10.012926+0000","last_fullsized":"2024-09-12T01:43:10.012926+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:57.864742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964145+0000","last_change":"2024-09-12T01:43:10.008139+0000","last_active":"2024-09-12T01:43:11.964145+0000","last_peered":"2024-09-12T01:43:11.964145+0000","last_clean":"2024-09-12T01:43:11.964145+0000","last_became_active":"2024-09-12T01:43:10.007864+0000","last_became_peered":"2024-09-12T01:43:10.007864+0000","last_unstale":"2024-09-12T01:43:11.964145+0000","last_undegraded":"2024-09-12T01:43:11.964145+0000","last_fullsized":"2024-09-12T01:43:11.964145+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:48.553216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.021030+0000","last_change":"2024-09-12T01:43:10.018610+0000","last_active":"2024-09-12T01:43:10.021030+0000","last_peered":"2024-09-12T01:43:10.021030+0000","last_clean":"2024-09-12T01:43:10.021030+0000","last_became_active":"2024-09-12T01:43:10.018313+0000","last_became_peered":"2024-09-12T01:43:10.018313+0000","last_unstale":"2024-09-12T01:43:10.021030+0000","last_undegraded":"2024-09-12T01:43:10.021030+0000","last_fullsized":"2024-09-12T01:43:10.021030+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.436244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.011049+0000","last_change":"2024-09-12T01:43:10.005034+0000","last_active":"2024-09-12T01:43:10.011049+0000","last_peered":"2024-09-12T01:43:10.011049+0000","last_clean":"2024-09-12T01:43:10.011049+0000","last_became_active":"2024-09-12T01:43:10.004647+0000","last_became_peered":"2024-09-12T01:43:10.004647+0000","last_unstale":"2024-09-12T01:43:10.011049+0000","last_undegraded":"2024-09-12T01:43:10.011049+0000","last_fullsized":"2024-09-12T01:43:10.011049+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:24.531059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963435+0000","last_change":"2024-09-12T01:43:10.006573+0000","last_active":"2024-09-12T01:43:11.963435+0000","last_peered":"2024-09-12T01:43:11.963435+0000","last_clean":"2024-09-12T01:43:11.963435+0000","last_became_active":"2024-09-12T01:43:10.006315+0000","last_became_peered":"2024-09-12T01:43:10.006315+0000","last_unstale":"2024-09-12T01:43:11.963435+0000","last_undegraded":"2024-09-12T01:43:11.963435+0000","last_fullsized":"2024-09-12T01:43:11.963435+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:32.878745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963527+0000","last_change":"2024-09-12T01:43:09.993348+0000","last_active":"2024-09-12T01:43:11.963527+0000","last_peered":"2024-09-12T01:43:11.963527+0000","last_clean":"2024-09-12T01:43:11.963527+0000","last_became_active":"2024-09-12T01:43:09.993048+0000","last_became_peered":"2024-09-12T01:43:09.993048+0000","last_unstale":"2024-09-12T01:43:11.963527+0000","last_undegraded":"2024-09-12T01:43:11.963527+0000","last_fullsized":"2024-09-12T01:43:11.963527+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:29.279332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013872+0000","last_change":"2024-09-12T01:43:10.010938+0000","last_active":"2024-09-12T01:43:10.013872+0000","last_peered":"2024-09-12T01:43:10.013872+0000","last_clean":"2024-09-12T01:43:10.013872+0000","last_became_active":"2024-09-12T01:43:10.010575+0000","last_became_peered":"2024-09-12T01:43:10.010575+0000","last_unstale":"2024-09-12T01:43:10.013872+0000","last_undegraded":"2024-09-12T01:43:10.013872+0000","last_fullsized":"2024-09-12T01:43:10.013872+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:13.973177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.002914+0000","last_change":"2024-09-12T01:43:09.999258+0000","last_active":"2024-09-12T01:43:10.002914+0000","last_peered":"2024-09-12T01:43:10.002914+0000","last_clean":"2024-09-12T01:43:10.002914+0000","last_became_active":"2024-09-12T01:43:09.998972+0000","last_became_peered":"2024-09-12T01:43:09.998972+0000","last_unstale":"2024-09-12T01:43:10.002914+0000","last_undegraded":"2024-09-12T01:43:10.002914+0000","last_fullsized":"2024-09-12T01:43:10.002914+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:08.222252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.004836+0000","last_change":"2024-09-12T01:43:10.002479+0000","last_active":"2024-09-12T01:43:10.004836+0000","last_peered":"2024-09-12T01:43:10.004836+0000","last_clean":"2024-09-12T01:43:10.004836+0000","last_became_active":"2024-09-12T01:43:10.001641+0000","last_became_peered":"2024-09-12T01:43:10.001641+0000","last_unstale":"2024-09-12T01:43:10.004836+0000","last_undegraded":"2024-09-12T01:43:10.004836+0000","last_fullsized":"2024-09-12T01:43:10.004836+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:10.230932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"116'4","reported_seq":16,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.014790+0000","last_change":"2024-09-12T01:43:08.999139+0000","last_active":"2024-09-12T01:43:10.014790+0000","last_peered":"2024-09-12T01:43:10.014790+0000","last_clean":"2024-09-12T01:43:10.014790+0000","last_became_active":"2024-09-12T01:43:08.998874+0000","last_became_peered":"2024-09-12T01:43:08.998874+0000","last_unstale":"2024-09-12T01:43:10.014790+0000","last_undegraded":"2024-09-12T01:43:10.014790+0000","last_fullsized":"2024-09-12T01:43:10.014790+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:12.086671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.999594+0000","last_change":"2024-09-12T01:43:09.998236+0000","last_active":"2024-09-12T01:43:09.999594+0000","last_peered":"2024-09-12T01:43:09.999594+0000","last_clean":"2024-09-12T01:43:09.999594+0000","last_became_active":"2024-09-12T01:43:09.996642+0000","last_became_peered":"2024-09-12T01:43:09.996642+0000","last_unstale":"2024-09-12T01:43:09.999594+0000","last_undegraded":"2024-09-12T01:43:09.999594+0000","last_fullsized":"2024-09-12T01:43:09.999594+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:24:33.470907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017670+0000","last_change":"2024-09-12T01:43:09.007149+0000","last_active":"2024-09-12T01:43:10.017670+0000","last_peered":"2024-09-12T01:43:10.017670+0000","last_clean":"2024-09-12T01:43:10.017670+0000","last_became_active":"2024-09-12T01:43:09.006801+0000","last_became_peered":"2024-09-12T01:43:09.006801+0000","last_unstale":"2024-09-12T01:43:10.017670+0000","last_undegraded":"2024-09-12T01:43:10.017670+0000","last_fullsized":"2024-09-12T01:43:10.017670+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:48.504193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013118+0000","last_change":"2024-09-12T01:43:10.012246+0000","last_active":"2024-09-12T01:43:10.013118+0000","last_peered":"2024-09-12T01:43:10.013118+0000","last_clean":"2024-09-12T01:43:10.013118+0000","last_became_active":"2024-09-12T01:43:10.011930+0000","last_became_peered":"2024-09-12T01:43:10.011930+0000","last_unstale":"2024-09-12T01:43:10.013118+0000","last_undegraded":"2024-09-12T01:43:10.013118+0000","last_fullsized":"2024-09-12T01:43:10.013118+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:32.799859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.007885+0000","last_change":"2024-09-12T01:43:08.998653+0000","last_active":"2024-09-12T01:43:10.007885+0000","last_peered":"2024-09-12T01:43:10.007885+0000","last_clean":"2024-09-12T01:43:10.007885+0000","last_became_active":"2024-09-12T01:43:08.998390+0000","last_became_peered":"2024-09-12T01:43:08.998390+0000","last_unstale":"2024-09-12T01:43:10.007885+0000","last_undegraded":"2024-09-12T01:43:10.007885+0000","last_fullsized":"2024-09-12T01:43:10.007885+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:18.419447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017106+0000","last_change":"2024-09-12T01:43:10.012472+0000","last_active":"2024-09-12T01:43:10.017106+0000","last_peered":"2024-09-12T01:43:10.017106+0000","last_clean":"2024-09-12T01:43:10.017106+0000","last_became_active":"2024-09-12T01:43:10.011808+0000","last_became_peered":"2024-09-12T01:43:10.011808+0000","last_unstale":"2024-09-12T01:43:10.017106+0000","last_undegraded":"2024-09-12T01:43:10.017106+0000","last_fullsized":"2024-09-12T01:43:10.017106+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:36.244472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963760+0000","last_change":"2024-09-12T01:43:08.995623+0000","last_active":"2024-09-12T01:43:11.963760+0000","last_peered":"2024-09-12T01:43:11.963760+0000","last_clean":"2024-09-12T01:43:11.963760+0000","last_became_active":"2024-09-12T01:43:08.995275+0000","last_became_peered":"2024-09-12T01:43:08.995275+0000","last_unstale":"2024-09-12T01:43:11.963760+0000","last_undegraded":"2024-09-12T01:43:11.963760+0000","last_fullsized":"2024-09-12T01:43:11.963760+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:05.332464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016192+0000","last_change":"2024-09-12T01:43:10.012454+0000","last_active":"2024-09-12T01:43:10.016192+0000","last_peered":"2024-09-12T01:43:10.016192+0000","last_clean":"2024-09-12T01:43:10.016192+0000","last_became_active":"2024-09-12T01:43:10.012121+0000","last_became_peered":"2024-09-12T01:43:10.012121+0000","last_unstale":"2024-09-12T01:43:10.016192+0000","last_undegraded":"2024-09-12T01:43:10.016192+0000","last_fullsized":"2024-09-12T01:43:10.016192+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:18.967832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963404+0000","last_change":"2024-09-12T01:43:08.997043+0000","last_active":"2024-09-12T01:43:11.963404+0000","last_peered":"2024-09-12T01:43:11.963404+0000","last_clean":"2024-09-12T01:43:11.963404+0000","last_became_active":"2024-09-12T01:43:08.996754+0000","last_became_peered":"2024-09-12T01:43:08.996754+0000","last_unstale":"2024-09-12T01:43:11.963404+0000","last_undegraded":"2024-09-12T01:43:11.963404+0000","last_fullsized":"2024-09-12T01:43:11.963404+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:32.640473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016452+0000","last_change":"2024-09-12T01:43:10.015386+0000","last_active":"2024-09-12T01:43:10.016452+0000","last_peered":"2024-09-12T01:43:10.016452+0000","last_clean":"2024-09-12T01:43:10.016452+0000","last_became_active":"2024-09-12T01:43:10.012428+0000","last_became_peered":"2024-09-12T01:43:10.012428+0000","last_unstale":"2024-09-12T01:43:10.016452+0000","last_undegraded":"2024-09-12T01:43:10.016452+0000","last_fullsized":"2024-09-12T01:43:10.016452+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:04.591571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.008395+0000","last_change":"2024-09-12T01:43:08.997463+0000","last_active":"2024-09-12T01:43:10.008395+0000","last_peered":"2024-09-12T01:43:10.008395+0000","last_clean":"2024-09-12T01:43:10.008395+0000","last_became_active":"2024-09-12T01:43:08.994321+0000","last_became_peered":"2024-09-12T01:43:08.994321+0000","last_unstale":"2024-09-12T01:43:10.008395+0000","last_undegraded":"2024-09-12T01:43:10.008395+0000","last_fullsized":"2024-09-12T01:43:10.008395+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:57.845182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.020328+0000","last_change":"2024-09-12T01:43:10.016198+0000","last_active":"2024-09-12T01:43:10.020328+0000","last_peered":"2024-09-12T01:43:10.020328+0000","last_clean":"2024-09-12T01:43:10.020328+0000","last_became_active":"2024-09-12T01:43:10.015942+0000","last_became_peered":"2024-09-12T01:43:10.015942+0000","last_unstale":"2024-09-12T01:43:10.020328+0000","last_undegraded":"2024-09-12T01:43:10.020328+0000","last_fullsized":"2024-09-12T01:43:10.020328+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:50.905796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.986853+0000","last_change":"2024-09-12T01:43:08.998565+0000","last_active":"2024-09-12T01:43:09.986853+0000","last_peered":"2024-09-12T01:43:09.986853+0000","last_clean":"2024-09-12T01:43:09.986853+0000","last_became_active":"2024-09-12T01:43:08.998292+0000","last_became_peered":"2024-09-12T01:43:08.998292+0000","last_unstale":"2024-09-12T01:43:09.986853+0000","last_undegraded":"2024-09-12T01:43:09.986853+0000","last_fullsized":"2024-09-12T01:43:09.986853+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.559247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963651+0000","last_change":"2024-09-12T01:43:10.003831+0000","last_active":"2024-09-12T01:43:11.963651+0000","last_peered":"2024-09-12T01:43:11.963651+0000","last_clean":"2024-09-12T01:43:11.963651+0000","last_became_active":"2024-09-12T01:43:10.003524+0000","last_became_peered":"2024-09-12T01:43:10.003524+0000","last_unstale":"2024-09-12T01:43:11.963651+0000","last_undegraded":"2024-09-12T01:43:11.963651+0000","last_fullsized":"2024-09-12T01:43:11.963651+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:15.848191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963241+0000","last_change":"2024-09-12T01:43:08.998287+0000","last_active":"2024-09-12T01:43:11.963241+0000","last_peered":"2024-09-12T01:43:11.963241+0000","last_clean":"2024-09-12T01:43:11.963241+0000","last_became_active":"2024-09-12T01:43:08.997989+0000","last_became_peered":"2024-09-12T01:43:08.997989+0000","last_unstale":"2024-09-12T01:43:11.963241+0000","last_undegraded":"2024-09-12T01:43:11.963241+0000","last_fullsized":"2024-09-12T01:43:11.963241+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:26.491976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964254+0000","last_change":"2024-09-12T01:43:10.002510+0000","last_active":"2024-09-12T01:43:11.964254+0000","last_peered":"2024-09-12T01:43:11.964254+0000","last_clean":"2024-09-12T01:43:11.964254+0000","last_became_active":"2024-09-12T01:43:10.002108+0000","last_became_peered":"2024-09-12T01:43:10.002108+0000","last_unstale":"2024-09-12T01:43:11.964254+0000","last_undegraded":"2024-09-12T01:43:11.964254+0000","last_fullsized":"2024-09-12T01:43:11.964254+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:32.374576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.996699+0000","last_change":"2024-09-12T01:43:09.005035+0000","last_active":"2024-09-12T01:43:09.996699+0000","last_peered":"2024-09-12T01:43:09.996699+0000","last_clean":"2024-09-12T01:43:09.996699+0000","last_became_active":"2024-09-12T01:43:09.003567+0000","last_became_peered":"2024-09-12T01:43:09.003567+0000","last_unstale":"2024-09-12T01:43:09.996699+0000","last_undegraded":"2024-09-12T01:43:09.996699+0000","last_fullsized":"2024-09-12T01:43:09.996699+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:29.476489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.008408+0000","last_change":"2024-09-12T01:43:10.006087+0000","last_active":"2024-09-12T01:43:10.008408+0000","last_peered":"2024-09-12T01:43:10.008408+0000","last_clean":"2024-09-12T01:43:10.008408+0000","last_became_active":"2024-09-12T01:43:10.003431+0000","last_became_peered":"2024-09-12T01:43:10.003431+0000","last_unstale":"2024-09-12T01:43:10.008408+0000","last_undegraded":"2024-09-12T01:43:10.008408+0000","last_fullsized":"2024-09-12T01:43:10.008408+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:18.861635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.999813+0000","last_change":"2024-09-12T01:43:09.000223+0000","last_active":"2024-09-12T01:43:09.999813+0000","last_peered":"2024-09-12T01:43:09.999813+0000","last_clean":"2024-09-12T01:43:09.999813+0000","last_became_active":"2024-09-12T01:43:08.999881+0000","last_became_peered":"2024-09-12T01:43:08.999881+0000","last_unstale":"2024-09-12T01:43:09.999813+0000","last_undegraded":"2024-09-12T01:43:09.999813+0000","last_fullsized":"2024-09-12T01:43:09.999813+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:50.234821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.020142+0000","last_change":"2024-09-12T01:43:10.017833+0000","last_active":"2024-09-12T01:43:10.020142+0000","last_peered":"2024-09-12T01:43:10.020142+0000","last_clean":"2024-09-12T01:43:10.020142+0000","last_became_active":"2024-09-12T01:43:10.017506+0000","last_became_peered":"2024-09-12T01:43:10.017506+0000","last_unstale":"2024-09-12T01:43:10.020142+0000","last_undegraded":"2024-09-12T01:43:10.020142+0000","last_fullsized":"2024-09-12T01:43:10.020142+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:12.885550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"116'3","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.014580+0000","last_change":"2024-09-12T01:43:08.999971+0000","last_active":"2024-09-12T01:43:10.014580+0000","last_peered":"2024-09-12T01:43:10.014580+0000","last_clean":"2024-09-12T01:43:10.014580+0000","last_became_active":"2024-09-12T01:43:08.999656+0000","last_became_peered":"2024-09-12T01:43:08.999656+0000","last_unstale":"2024-09-12T01:43:10.014580+0000","last_undegraded":"2024-09-12T01:43:10.014580+0000","last_fullsized":"2024-09-12T01:43:10.014580+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:08.248385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.019658+0000","last_change":"2024-09-12T01:43:10.018504+0000","last_active":"2024-09-12T01:43:10.019658+0000","last_peered":"2024-09-12T01:43:10.019658+0000","last_clean":"2024-09-12T01:43:10.019658+0000","last_became_active":"2024-09-12T01:43:10.018223+0000","last_became_peered":"2024-09-12T01:43:10.018223+0000","last_unstale":"2024-09-12T01:43:10.019658+0000","last_undegraded":"2024-09-12T01:43:10.019658+0000","last_fullsized":"2024-09-12T01:43:10.019658+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:52.990907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"116'6","reported_seq":18,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.022053+0000","last_change":"2024-09-12T01:43:09.004240+0000","last_active":"2024-09-12T01:43:10.022053+0000","last_peered":"2024-09-12T01:43:10.022053+0000","last_clean":"2024-09-12T01:43:10.022053+0000","last_became_active":"2024-09-12T01:43:09.003936+0000","last_became_peered":"2024-09-12T01:43:09.003936+0000","last_unstale":"2024-09-12T01:43:10.022053+0000","last_undegraded":"2024-09-12T01:43:10.022053+0000","last_fullsized":"2024-09-12T01:43:10.022053+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.733832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.007333+0000","last_change":"2024-09-12T01:43:10.005212+0000","last_active":"2024-09-12T01:43:10.007333+0000","last_peered":"2024-09-12T01:43:10.007333+0000","last_clean":"2024-09-12T01:43:10.007333+0000","last_became_active":"2024-09-12T01:43:10.004914+0000","last_became_peered":"2024-09-12T01:43:10.004914+0000","last_unstale":"2024-09-12T01:43:10.007333+0000","last_undegraded":"2024-09-12T01:43:10.007333+0000","last_fullsized":"2024-09-12T01:43:10.007333+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:12.885550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.998201+0000","last_change":"2024-09-12T01:43:08.996819+0000","last_active":"2024-09-12T01:43:09.998201+0000","last_peered":"2024-09-12T01:43:09.998201+0000","last_clean":"2024-09-12T01:43:09.998201+0000","last_became_active":"2024-09-12T01:43:08.996524+0000","last_became_peered":"2024-09-12T01:43:08.996524+0000","last_unstale":"2024-09-12T01:43:09.998201+0000","last_undegraded":"2024-09-12T01:43:09.998201+0000","last_fullsized":"2024-09-12T01:43:09.998201+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:59.234398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010251+0000","last_change":"2024-09-12T01:43:10.005816+0000","last_active":"2024-09-12T01:43:10.010251+0000","last_peered":"2024-09-12T01:43:10.010251+0000","last_clean":"2024-09-12T01:43:10.010251+0000","last_became_active":"2024-09-12T01:43:10.005542+0000","last_became_peered":"2024-09-12T01:43:10.005542+0000","last_unstale":"2024-09-12T01:43:10.010251+0000","last_undegraded":"2024-09-12T01:43:10.010251+0000","last_fullsized":"2024-09-12T01:43:10.010251+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.088992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990122+0000","last_change":"2024-09-12T01:43:09.005250+0000","last_active":"2024-09-12T01:43:09.990122+0000","last_peered":"2024-09-12T01:43:09.990122+0000","last_clean":"2024-09-12T01:43:09.990122+0000","last_became_active":"2024-09-12T01:43:09.004791+0000","last_became_peered":"2024-09-12T01:43:09.004791+0000","last_unstale":"2024-09-12T01:43:09.990122+0000","last_undegraded":"2024-09-12T01:43:09.990122+0000","last_fullsized":"2024-09-12T01:43:09.990122+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:26.568406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016389+0000","last_change":"2024-09-12T01:43:10.014855+0000","last_active":"2024-09-12T01:43:10.016389+0000","last_peered":"2024-09-12T01:43:10.016389+0000","last_clean":"2024-09-12T01:43:10.016389+0000","last_became_active":"2024-09-12T01:43:10.014592+0000","last_became_peered":"2024-09-12T01:43:10.014592+0000","last_unstale":"2024-09-12T01:43:10.016389+0000","last_undegraded":"2024-09-12T01:43:10.016389+0000","last_fullsized":"2024-09-12T01:43:10.016389+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:17.976343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"116'8","reported_seq":20,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.020601+0000","last_change":"2024-09-12T01:43:09.002635+0000","last_active":"2024-09-12T01:43:10.020601+0000","last_peered":"2024-09-12T01:43:10.020601+0000","last_clean":"2024-09-12T01:43:10.020601+0000","last_became_active":"2024-09-12T01:43:09.002101+0000","last_became_peered":"2024-09-12T01:43:09.002101+0000","last_unstale":"2024-09-12T01:43:10.020601+0000","last_undegraded":"2024-09-12T01:43:10.020601+0000","last_fullsized":"2024-09-12T01:43:10.020601+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:44.307753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013813+0000","last_change":"2024-09-12T01:43:10.008983+0000","last_active":"2024-09-12T01:43:10.013813+0000","last_peered":"2024-09-12T01:43:10.013813+0000","last_clean":"2024-09-12T01:43:10.013813+0000","last_became_active":"2024-09-12T01:43:10.008679+0000","last_became_peered":"2024-09-12T01:43:10.008679+0000","last_unstale":"2024-09-12T01:43:10.013813+0000","last_undegraded":"2024-09-12T01:43:10.013813+0000","last_fullsized":"2024-09-12T01:43:10.013813+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:30.481957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017621+0000","last_change":"2024-09-12T01:43:09.001656+0000","last_active":"2024-09-12T01:43:10.017621+0000","last_peered":"2024-09-12T01:43:10.017621+0000","last_clean":"2024-09-12T01:43:10.017621+0000","last_became_active":"2024-09-12T01:43:09.000503+0000","last_became_peered":"2024-09-12T01:43:09.000503+0000","last_unstale":"2024-09-12T01:43:10.017621+0000","last_undegraded":"2024-09-12T01:43:10.017621+0000","last_fullsized":"2024-09-12T01:43:10.017621+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:21.472595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.008383+0000","last_change":"2024-09-12T01:43:10.005510+0000","last_active":"2024-09-12T01:43:10.008383+0000","last_peered":"2024-09-12T01:43:10.008383+0000","last_clean":"2024-09-12T01:43:10.008383+0000","last_became_active":"2024-09-12T01:43:10.002150+0000","last_became_peered":"2024-09-12T01:43:10.002150+0000","last_unstale":"2024-09-12T01:43:10.008383+0000","last_undegraded":"2024-09-12T01:43:10.008383+0000","last_fullsized":"2024-09-12T01:43:10.008383+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.892242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.014360+0000","last_change":"2024-09-12T01:43:08.997611+0000","last_active":"2024-09-12T01:43:10.014360+0000","last_peered":"2024-09-12T01:43:10.014360+0000","last_clean":"2024-09-12T01:43:10.014360+0000","last_became_active":"2024-09-12T01:43:08.997299+0000","last_became_peered":"2024-09-12T01:43:08.997299+0000","last_unstale":"2024-09-12T01:43:10.014360+0000","last_undegraded":"2024-09-12T01:43:10.014360+0000","last_fullsized":"2024-09-12T01:43:10.014360+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:59.274047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963702+0000","last_change":"2024-09-12T01:43:10.004330+0000","last_active":"2024-09-12T01:43:11.963702+0000","last_peered":"2024-09-12T01:43:11.963702+0000","last_clean":"2024-09-12T01:43:11.963702+0000","last_became_active":"2024-09-12T01:43:10.004040+0000","last_became_peered":"2024-09-12T01:43:10.004040+0000","last_unstale":"2024-09-12T01:43:11.963702+0000","last_undegraded":"2024-09-12T01:43:11.963702+0000","last_fullsized":"2024-09-12T01:43:11.963702+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:39.928166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"116'1","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.011710+0000","last_change":"2024-09-12T01:43:09.002198+0000","last_active":"2024-09-12T01:43:10.011710+0000","last_peered":"2024-09-12T01:43:10.011710+0000","last_clean":"2024-09-12T01:43:10.011710+0000","last_became_active":"2024-09-12T01:43:09.001925+0000","last_became_peered":"2024-09-12T01:43:09.001925+0000","last_unstale":"2024-09-12T01:43:10.011710+0000","last_undegraded":"2024-09-12T01:43:10.011710+0000","last_fullsized":"2024-09-12T01:43:10.011710+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:33.130766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963843+0000","last_change":"2024-09-12T01:43:10.001049+0000","last_active":"2024-09-12T01:43:11.963843+0000","last_peered":"2024-09-12T01:43:11.963843+0000","last_clean":"2024-09-12T01:43:11.963843+0000","last_became_active":"2024-09-12T01:43:10.000765+0000","last_became_peered":"2024-09-12T01:43:10.000765+0000","last_unstale":"2024-09-12T01:43:11.963843+0000","last_undegraded":"2024-09-12T01:43:11.963843+0000","last_fullsized":"2024-09-12T01:43:11.963843+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:23.884040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990176+0000","last_change":"2024-09-12T01:43:08.991805+0000","last_active":"2024-09-12T01:43:09.990176+0000","last_peered":"2024-09-12T01:43:09.990176+0000","last_clean":"2024-09-12T01:43:09.990176+0000","last_became_active":"2024-09-12T01:43:08.991517+0000","last_became_peered":"2024-09-12T01:43:08.991517+0000","last_unstale":"2024-09-12T01:43:09.990176+0000","last_undegraded":"2024-09-12T01:43:09.990176+0000","last_fullsized":"2024-09-12T01:43:09.990176+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:16.731138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963811+0000","last_change":"2024-09-12T01:43:10.001313+0000","last_active":"2024-09-12T01:43:11.963811+0000","last_peered":"2024-09-12T01:43:11.963811+0000","last_clean":"2024-09-12T01:43:11.963811+0000","last_became_active":"2024-09-12T01:43:10.001010+0000","last_became_peered":"2024-09-12T01:43:10.001010+0000","last_unstale":"2024-09-12T01:43:11.963811+0000","last_undegraded":"2024-09-12T01:43:11.963811+0000","last_fullsized":"2024-09-12T01:43:11.963811+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:51.577469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013877+0000","last_change":"2024-09-12T01:43:09.002910+0000","last_active":"2024-09-12T01:43:10.013877+0000","last_peered":"2024-09-12T01:43:10.013877+0000","last_clean":"2024-09-12T01:43:10.013877+0000","last_became_active":"2024-09-12T01:43:09.002618+0000","last_became_peered":"2024-09-12T01:43:09.002618+0000","last_unstale":"2024-09-12T01:43:10.013877+0000","last_undegraded":"2024-09-12T01:43:10.013877+0000","last_fullsized":"2024-09-12T01:43:10.013877+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:37.911468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010952+0000","last_change":"2024-09-12T01:43:10.003250+0000","last_active":"2024-09-12T01:43:10.010952+0000","last_peered":"2024-09-12T01:43:10.010952+0000","last_clean":"2024-09-12T01:43:10.010952+0000","last_became_active":"2024-09-12T01:43:10.002434+0000","last_became_peered":"2024-09-12T01:43:10.002434+0000","last_unstale":"2024-09-12T01:43:10.010952+0000","last_undegraded":"2024-09-12T01:43:10.010952+0000","last_fullsized":"2024-09-12T01:43:10.010952+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:58.850651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.994201+0000","last_change":"2024-09-12T01:43:08.998911+0000","last_active":"2024-09-12T01:43:09.994201+0000","last_peered":"2024-09-12T01:43:09.994201+0000","last_clean":"2024-09-12T01:43:09.994201+0000","last_became_active":"2024-09-12T01:43:08.998521+0000","last_became_peered":"2024-09-12T01:43:08.998521+0000","last_unstale":"2024-09-12T01:43:09.994201+0000","last_undegraded":"2024-09-12T01:43:09.994201+0000","last_fullsized":"2024-09-12T01:43:09.994201+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:23.525590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015958+0000","last_change":"2024-09-12T01:43:10.011401+0000","last_active":"2024-09-12T01:43:10.015958+0000","last_peered":"2024-09-12T01:43:10.015958+0000","last_clean":"2024-09-12T01:43:10.015958+0000","last_became_active":"2024-09-12T01:43:10.011126+0000","last_became_peered":"2024-09-12T01:43:10.011126+0000","last_unstale":"2024-09-12T01:43:10.015958+0000","last_undegraded":"2024-09-12T01:43:10.015958+0000","last_fullsized":"2024-09-12T01:43:10.015958+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:19.424916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.998630+0000","last_change":"2024-09-12T01:43:09.004606+0000","last_active":"2024-09-12T01:43:09.998630+0000","last_peered":"2024-09-12T01:43:09.998630+0000","last_clean":"2024-09-12T01:43:09.998630+0000","last_became_active":"2024-09-12T01:43:09.004182+0000","last_became_peered":"2024-09-12T01:43:09.004182+0000","last_unstale":"2024-09-12T01:43:09.998630+0000","last_undegraded":"2024-09-12T01:43:09.998630+0000","last_fullsized":"2024-09-12T01:43:09.998630+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:49.900328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.012891+0000","last_change":"2024-09-12T01:43:10.008207+0000","last_active":"2024-09-12T01:43:10.012891+0000","last_peered":"2024-09-12T01:43:10.012891+0000","last_clean":"2024-09-12T01:43:10.012891+0000","last_became_active":"2024-09-12T01:43:10.007942+0000","last_became_peered":"2024-09-12T01:43:10.007942+0000","last_unstale":"2024-09-12T01:43:10.012891+0000","last_undegraded":"2024-09-12T01:43:10.012891+0000","last_fullsized":"2024-09-12T01:43:10.012891+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:02.422050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.989883+0000","last_change":"2024-09-12T01:43:08.998574+0000","last_active":"2024-09-12T01:43:09.989883+0000","last_peered":"2024-09-12T01:43:09.989883+0000","last_clean":"2024-09-12T01:43:09.989883+0000","last_became_active":"2024-09-12T01:43:08.998295+0000","last_became_peered":"2024-09-12T01:43:08.998295+0000","last_unstale":"2024-09-12T01:43:09.989883+0000","last_undegraded":"2024-09-12T01:43:09.989883+0000","last_fullsized":"2024-09-12T01:43:09.989883+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:44.083523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.010961+0000","last_change":"2024-09-12T01:43:10.006771+0000","last_active":"2024-09-12T01:43:10.010961+0000","last_peered":"2024-09-12T01:43:10.010961+0000","last_clean":"2024-09-12T01:43:10.010961+0000","last_became_active":"2024-09-12T01:43:10.006483+0000","last_became_peered":"2024-09-12T01:43:10.006483+0000","last_unstale":"2024-09-12T01:43:10.010961+0000","last_undegraded":"2024-09-12T01:43:10.010961+0000","last_fullsized":"2024-09-12T01:43:10.010961+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:39.623929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.004225+0000","last_change":"2024-09-12T01:43:08.999378+0000","last_active":"2024-09-12T01:43:10.004225+0000","last_peered":"2024-09-12T01:43:10.004225+0000","last_clean":"2024-09-12T01:43:10.004225+0000","last_became_active":"2024-09-12T01:43:08.999097+0000","last_became_peered":"2024-09-12T01:43:08.999097+0000","last_unstale":"2024-09-12T01:43:10.004225+0000","last_undegraded":"2024-09-12T01:43:10.004225+0000","last_fullsized":"2024-09-12T01:43:10.004225+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:38.618460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963660+0000","last_change":"2024-09-12T01:43:10.000417+0000","last_active":"2024-09-12T01:43:11.963660+0000","last_peered":"2024-09-12T01:43:11.963660+0000","last_clean":"2024-09-12T01:43:11.963660+0000","last_became_active":"2024-09-12T01:43:10.000090+0000","last_became_peered":"2024-09-12T01:43:10.000090+0000","last_unstale":"2024-09-12T01:43:11.963660+0000","last_undegraded":"2024-09-12T01:43:11.963660+0000","last_fullsized":"2024-09-12T01:43:11.963660+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:02.791275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990685+0000","last_change":"2024-09-12T01:43:09.005092+0000","last_active":"2024-09-12T01:43:09.990685+0000","last_peered":"2024-09-12T01:43:09.990685+0000","last_clean":"2024-09-12T01:43:09.990685+0000","last_became_active":"2024-09-12T01:43:09.004744+0000","last_became_peered":"2024-09-12T01:43:09.004744+0000","last_unstale":"2024-09-12T01:43:09.990685+0000","last_undegraded":"2024-09-12T01:43:09.990685+0000","last_fullsized":"2024-09-12T01:43:09.990685+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.790944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.013190+0000","last_change":"2024-09-12T01:43:10.009557+0000","last_active":"2024-09-12T01:43:10.013190+0000","last_peered":"2024-09-12T01:43:10.013190+0000","last_clean":"2024-09-12T01:43:10.013190+0000","last_became_active":"2024-09-12T01:43:10.009200+0000","last_became_peered":"2024-09-12T01:43:10.009200+0000","last_unstale":"2024-09-12T01:43:10.013190+0000","last_undegraded":"2024-09-12T01:43:10.013190+0000","last_fullsized":"2024-09-12T01:43:10.013190+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:27.573875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.998825+0000","last_change":"2024-09-12T01:43:09.005025+0000","last_active":"2024-09-12T01:43:09.998825+0000","last_peered":"2024-09-12T01:43:09.998825+0000","last_clean":"2024-09-12T01:43:09.998825+0000","last_became_active":"2024-09-12T01:43:09.004716+0000","last_became_peered":"2024-09-12T01:43:09.004716+0000","last_unstale":"2024-09-12T01:43:09.998825+0000","last_undegraded":"2024-09-12T01:43:09.998825+0000","last_fullsized":"2024-09-12T01:43:09.998825+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:12.967708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.011002+0000","last_change":"2024-09-12T01:43:10.008340+0000","last_active":"2024-09-12T01:43:10.011002+0000","last_peered":"2024-09-12T01:43:10.011002+0000","last_clean":"2024-09-12T01:43:10.011002+0000","last_became_active":"2024-09-12T01:43:10.008060+0000","last_became_peered":"2024-09-12T01:43:10.008060+0000","last_unstale":"2024-09-12T01:43:10.011002+0000","last_undegraded":"2024-09-12T01:43:10.011002+0000","last_fullsized":"2024-09-12T01:43:10.011002+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:42.690408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.997967+0000","last_change":"2024-09-12T01:43:09.001072+0000","last_active":"2024-09-12T01:43:09.997967+0000","last_peered":"2024-09-12T01:43:09.997967+0000","last_clean":"2024-09-12T01:43:09.997967+0000","last_became_active":"2024-09-12T01:43:09.000603+0000","last_became_peered":"2024-09-12T01:43:09.000603+0000","last_unstale":"2024-09-12T01:43:09.997967+0000","last_undegraded":"2024-09-12T01:43:09.997967+0000","last_fullsized":"2024-09-12T01:43:09.997967+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:03.586102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.016401+0000","last_change":"2024-09-12T01:43:10.015102+0000","last_active":"2024-09-12T01:43:10.016401+0000","last_peered":"2024-09-12T01:43:10.016401+0000","last_clean":"2024-09-12T01:43:10.016401+0000","last_became_active":"2024-09-12T01:43:10.012654+0000","last_became_peered":"2024-09-12T01:43:10.012654+0000","last_unstale":"2024-09-12T01:43:10.016401+0000","last_undegraded":"2024-09-12T01:43:10.016401+0000","last_fullsized":"2024-09-12T01:43:10.016401+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:06.891635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963736+0000","last_change":"2024-09-12T01:43:08.996332+0000","last_active":"2024-09-12T01:43:11.963736+0000","last_peered":"2024-09-12T01:43:11.963736+0000","last_clean":"2024-09-12T01:43:11.963736+0000","last_became_active":"2024-09-12T01:43:08.996027+0000","last_became_peered":"2024-09-12T01:43:08.996027+0000","last_unstale":"2024-09-12T01:43:11.963736+0000","last_undegraded":"2024-09-12T01:43:11.963736+0000","last_fullsized":"2024-09-12T01:43:11.963736+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:08.212680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015571+0000","last_change":"2024-09-12T01:43:10.007677+0000","last_active":"2024-09-12T01:43:10.015571+0000","last_peered":"2024-09-12T01:43:10.015571+0000","last_clean":"2024-09-12T01:43:10.015571+0000","last_became_active":"2024-09-12T01:43:10.003872+0000","last_became_peered":"2024-09-12T01:43:10.003872+0000","last_unstale":"2024-09-12T01:43:10.015571+0000","last_undegraded":"2024-09-12T01:43:10.015571+0000","last_fullsized":"2024-09-12T01:43:10.015571+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:09.721296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.995418+0000","last_change":"2024-09-12T01:43:09.002404+0000","last_active":"2024-09-12T01:43:09.995418+0000","last_peered":"2024-09-12T01:43:09.995418+0000","last_clean":"2024-09-12T01:43:09.995418+0000","last_became_active":"2024-09-12T01:43:09.001771+0000","last_became_peered":"2024-09-12T01:43:09.001771+0000","last_unstale":"2024-09-12T01:43:09.995418+0000","last_undegraded":"2024-09-12T01:43:09.995418+0000","last_fullsized":"2024-09-12T01:43:09.995418+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:17.856167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.021093+0000","last_change":"2024-09-12T01:43:10.018067+0000","last_active":"2024-09-12T01:43:10.021093+0000","last_peered":"2024-09-12T01:43:10.021093+0000","last_clean":"2024-09-12T01:43:10.021093+0000","last_became_active":"2024-09-12T01:43:10.017807+0000","last_became_peered":"2024-09-12T01:43:10.017807+0000","last_unstale":"2024-09-12T01:43:10.021093+0000","last_undegraded":"2024-09-12T01:43:10.021093+0000","last_fullsized":"2024-09-12T01:43:10.021093+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:43.834846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.990273+0000","last_change":"2024-09-12T01:43:09.005613+0000","last_active":"2024-09-12T01:43:09.990273+0000","last_peered":"2024-09-12T01:43:09.990273+0000","last_clean":"2024-09-12T01:43:09.990273+0000","last_became_active":"2024-09-12T01:43:09.005273+0000","last_became_peered":"2024-09-12T01:43:09.005273+0000","last_unstale":"2024-09-12T01:43:09.990273+0000","last_undegraded":"2024-09-12T01:43:09.990273+0000","last_fullsized":"2024-09-12T01:43:09.990273+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:13.562581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.015940+0000","last_change":"2024-09-12T01:43:10.012096+0000","last_active":"2024-09-12T01:43:10.015940+0000","last_peered":"2024-09-12T01:43:10.015940+0000","last_clean":"2024-09-12T01:43:10.015940+0000","last_became_active":"2024-09-12T01:43:10.011810+0000","last_became_peered":"2024-09-12T01:43:10.011810+0000","last_unstale":"2024-09-12T01:43:10.015940+0000","last_undegraded":"2024-09-12T01:43:10.015940+0000","last_fullsized":"2024-09-12T01:43:10.015940+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:00.279516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.000655+0000","last_change":"2024-09-12T01:43:09.001024+0000","last_active":"2024-09-12T01:43:10.000655+0000","last_peered":"2024-09-12T01:43:10.000655+0000","last_clean":"2024-09-12T01:43:10.000655+0000","last_became_active":"2024-09-12T01:43:09.000634+0000","last_became_peered":"2024-09-12T01:43:09.000634+0000","last_unstale":"2024-09-12T01:43:10.000655+0000","last_undegraded":"2024-09-12T01:43:10.000655+0000","last_fullsized":"2024-09-12T01:43:10.000655+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:30.008018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.996725+0000","last_change":"2024-09-12T01:43:09.995813+0000","last_active":"2024-09-12T01:43:09.996725+0000","last_peered":"2024-09-12T01:43:09.996725+0000","last_clean":"2024-09-12T01:43:09.996725+0000","last_became_active":"2024-09-12T01:43:09.995491+0000","last_became_peered":"2024-09-12T01:43:09.995491+0000","last_unstale":"2024-09-12T01:43:09.996725+0000","last_undegraded":"2024-09-12T01:43:09.996725+0000","last_fullsized":"2024-09-12T01:43:09.996725+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:09.217265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"116'2","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:10.017611+0000","last_change":"2024-09-12T01:43:09.000595+0000","last_active":"2024-09-12T01:43:10.017611+0000","last_peered":"2024-09-12T01:43:10.017611+0000","last_clean":"2024-09-12T01:43:10.017611+0000","last_became_active":"2024-09-12T01:43:09.000302+0000","last_became_peered":"2024-09-12T01:43:09.000302+0000","last_unstale":"2024-09-12T01:43:10.017611+0000","last_undegraded":"2024-09-12T01:43:10.017611+0000","last_fullsized":"2024-09-12T01:43:10.017611+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:41.886774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":345,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-09-12T01:43:09.994810+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:43:09.994810+0000","last_peered":"2024-09-12T01:43:09.994810+0000","last_clean":"2024-09-12T01:43:09.994810+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:43:09.994810+0000","last_undegraded":"2024-09-12T01:43:09.994810+0000","last_fullsized":"2024-09-12T01:43:09.994810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509534,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1445888,"data_stored":614112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1441792,"data_stored":614078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509532,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33164,"kb_used_data":1976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338676,"statfs":{"total":96636764160,"available":96602804224,"internally_reserved":0,"allocated":2023424,"data_stored":1197671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509532,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36764,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335076,"statfs":{"total":96636764160,"available":96599117824,"internally_reserved":0,"allocated":1445888,"data_stored":614148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36744,"kb_used_data":1396,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335096,"statfs":{"total":96636764160,"available":96599138304,"internally_reserved":0,"allocated":1429504,"data_stored":607303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509532,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37352,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334488,"statfs":{"total":96636764160,"available":96598515712,"internally_reserved":0,"allocated":2052096,"data_stored":1206080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509533,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36780,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335060,"statfs":{"total":96636764160,"available":96599101440,"internally_reserved":0,"allocated":1462272,"data_stored":615746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,7],"upper_bound":32},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1454080,"data_stored":620378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:43:15.977 INFO:tasks.ceph.mds.d.smithi105.stderr:2024-09-12T01:43:15.977+0000 7fa1cb0e7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:43:17.401 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:43:17.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.516+0000 7eff4b637640 1 Processor -- start 2024-09-12T01:43:17.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.516+0000 7eff4b637640 1 -- start start 2024-09-12T01:43:17.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.517+0000 7eff4b637640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7eff440cd780 0x7eff440cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.517+0000 7eff4b637640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff440ce4f0 con 0x7eff440b4d00 2024-09-12T01:43:17.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.517+0000 7eff4b637640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff440ce7d0 con 0x7eff440b4920 2024-09-12T01:43:17.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.517+0000 7eff4b637640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7eff440cf100 con 0x7eff440cd780 2024-09-12T01:43:17.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.517+0000 7eff49bd4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7eff440cd780 0x7eff440cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.517+0000 7eff48bd2640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7eff440b4d00 0x7eff440b5170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50290/0 (socket says 172.21.15.60:50290) 2024-09-12T01:43:17.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.517+0000 7eff48bd2640 1 -- 172.21.15.60:0/1730872277 learned_addr learned my addr 172.21.15.60:0/1730872277 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:17.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.518+0000 7eff49bd4640 1 -- 172.21.15.60:0/1730872277 >> v1:172.21.15.105:6789/0 conn(0x7eff440b4920 legacy=0x7eff4415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:17.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.518+0000 7eff49bd4640 1 -- 172.21.15.60:0/1730872277 >> v1:172.21.15.60:6789/0 conn(0x7eff440b4d00 legacy=0x7eff440b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.518+0000 7eff49bd4640 1 -- 172.21.15.60:0/1730872277 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff440ceab0 con 0x7eff440cd780 2024-09-12T01:43:17.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.518+0000 7eff49bd4640 1 --2- 172.21.15.60:0/1730872277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440cd780 0x7eff440cdb90 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7eff440cf280 tx=0x7eff3c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00c13d131a502e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:17.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.519+0000 7eff43fff640 1 -- 172.21.15.60:0/1730872277 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c037070 con 0x7eff440cd780 2024-09-12T01:43:17.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.519+0000 7eff43fff640 1 -- 172.21.15.60:0/1730872277 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3c032440 con 0x7eff440cd780 2024-09-12T01:43:17.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.519+0000 7eff43fff640 1 -- 172.21.15.60:0/1730872277 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3c032810 con 0x7eff440cd780 2024-09-12T01:43:17.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.519+0000 7eff4b637640 1 -- 172.21.15.60:0/1730872277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440cd780 msgr2=0x7eff440cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.519+0000 7eff4b637640 1 --2- 172.21.15.60:0/1730872277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440cd780 0x7eff440cdb90 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7eff440cf280 tx=0x7eff3c02a1c0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.519+0000 7eff4b637640 1 -- 172.21.15.60:0/1730872277 shutdown_connections 2024-09-12T01:43:17.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.519+0000 7eff4b637640 1 --2- 172.21.15.60:0/1730872277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440cd780 0x7eff440cdb90 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.519+0000 7eff4b637640 1 -- 172.21.15.60:0/1730872277 >> 172.21.15.60:0/1730872277 conn(0x7eff4406bc10 msgr2=0x7eff4406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:17.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.519+0000 7eff4b637640 1 -- 172.21.15.60:0/1730872277 shutdown_connections 2024-09-12T01:43:17.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.519+0000 7eff4b637640 1 -- 172.21.15.60:0/1730872277 wait complete. 2024-09-12T01:43:17.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.520+0000 7eff4b637640 1 Processor -- start 2024-09-12T01:43:17.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.521+0000 7eff4b637640 1 -- start start 2024-09-12T01:43:17.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.521+0000 7eff4b637640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff440b4920 0x7eff441f5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.521+0000 7eff4b637640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440b4d00 0x7eff441f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.521+0000 7eff4b637640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff440cd780 0x7eff44152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.521+0000 7eff4b637640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7eff440ce250 con 0x7eff440b4d00 2024-09-12T01:43:17.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.521+0000 7eff4b637640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7eff440ce0d0 con 0x7eff440cd780 2024-09-12T01:43:17.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.521+0000 7eff4b637640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7eff440cf590 con 0x7eff440b4920 2024-09-12T01:43:17.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.521+0000 7eff48bd2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440b4d00 0x7eff441f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.521+0000 7eff48bd2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440b4d00 0x7eff441f6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53438/0 (socket says 172.21.15.60:53438) 2024-09-12T01:43:17.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.521+0000 7eff48bd2640 1 -- 172.21.15.60:0/2163383337 learned_addr learned my addr 172.21.15.60:0/2163383337 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:17.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.521+0000 7eff493d3640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff440b4920 0x7eff441f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.522+0000 7eff49bd4640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff440cd780 0x7eff44152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.522+0000 7eff48bd2640 1 -- 172.21.15.60:0/2163383337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff440b4920 msgr2=0x7eff441f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.522+0000 7eff48bd2640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff440b4920 0x7eff441f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.522+0000 7eff48bd2640 1 -- 172.21.15.60:0/2163383337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff440cd780 msgr2=0x7eff44152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.522+0000 7eff48bd2640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff440cd780 0x7eff44152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.522+0000 7eff48bd2640 1 -- 172.21.15.60:0/2163383337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff44153580 con 0x7eff440b4d00 2024-09-12T01:43:17.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.522+0000 7eff48bd2640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440b4d00 0x7eff441f6e30 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c430 tx=0x7eff3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:17.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.522+0000 7eff41ffb640 1 -- 172.21.15.60:0/2163383337 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38017070 con 0x7eff440b4d00 2024-09-12T01:43:17.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.522+0000 7eff41ffb640 1 -- 172.21.15.60:0/2163383337 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff38005ce0 con 0x7eff440b4d00 2024-09-12T01:43:17.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.522+0000 7eff4b637640 1 -- 172.21.15.60:0/2163383337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff44153860 con 0x7eff440b4d00 2024-09-12T01:43:17.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.522+0000 7eff41ffb640 1 -- 172.21.15.60:0/2163383337 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff380072f0 con 0x7eff440b4d00 2024-09-12T01:43:17.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.522+0000 7eff4b637640 1 -- 172.21.15.60:0/2163383337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff4415b7d0 con 0x7eff440b4d00 2024-09-12T01:43:17.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.523+0000 7eff4b637640 1 -- 172.21.15.60:0/2163383337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff440cdb90 con 0x7eff440b4d00 2024-09-12T01:43:17.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.524+0000 7eff41ffb640 1 -- 172.21.15.60:0/2163383337 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7eff3801a070 con 0x7eff440b4d00 2024-09-12T01:43:17.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.524+0000 7eff41ffb640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff3006be30 0x7eff3006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.525+0000 7eff41ffb640 1 -- 172.21.15.60:0/2163383337 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7eff3808a190 con 0x7eff440b4d00 2024-09-12T01:43:17.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.525+0000 7eff493d3640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff3006be30 0x7eff3006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.525+0000 7eff493d3640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff3006be30 0x7eff3006e2f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7eff4415d1d0 tx=0x7eff34003d90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:17.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.529+0000 7eff41ffb640 1 -- 172.21.15.60:0/2163383337 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7eff380584f0 con 0x7eff440b4d00 2024-09-12T01:43:17.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.701+0000 7eff4b637640 1 -- 172.21.15.60:0/2163383337 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7eff440633d0 con 0x7eff3006be30 2024-09-12T01:43:17.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.707+0000 7eff41ffb640 1 -- 172.21.15.60:0/2163383337 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252395 (secure 0 0 0) 0x7eff440633d0 con 0x7eff3006be30 2024-09-12T01:43:17.710 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:17.712 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:43:17.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.710+0000 7eff4b637640 1 -- 172.21.15.60:0/2163383337 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff3006be30 msgr2=0x7eff3006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.710+0000 7eff4b637640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff3006be30 0x7eff3006e2f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7eff4415d1d0 tx=0x7eff34003d90 comp rx=0 tx=0).stop 2024-09-12T01:43:17.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.710+0000 7eff4b637640 1 -- 172.21.15.60:0/2163383337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440b4d00 msgr2=0x7eff441f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.710+0000 7eff4b637640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440b4d00 0x7eff441f6e30 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7eff3800c430 tx=0x7eff3800c8f0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.710+0000 7eff4b637640 1 -- 172.21.15.60:0/2163383337 shutdown_connections 2024-09-12T01:43:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.710+0000 7eff4b637640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7eff440cd780 0x7eff44152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.710+0000 7eff4b637640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff440b4d00 0x7eff441f6e30 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.710+0000 7eff4b637640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7eff3006be30 0x7eff3006e2f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.710+0000 7eff4b637640 1 --2- 172.21.15.60:0/2163383337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff440b4920 0x7eff441f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.710+0000 7eff4b637640 1 -- 172.21.15.60:0/2163383337 >> 172.21.15.60:0/2163383337 conn(0x7eff4406bc10 msgr2=0x7eff440b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.710+0000 7eff4b637640 1 -- 172.21.15.60:0/2163383337 shutdown_connections 2024-09-12T01:43:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.710+0000 7eff4b637640 1 -- 172.21.15.60:0/2163383337 wait complete. 2024-09-12T01:43:17.722 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-12T01:43:16.359326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":282912,"kb_used_data":12584,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754691808,"statfs":{"total":773094113280,"available":772804411392,"internally_reserved":0,"allocated":12886016,"data_stored":6148580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.376402"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963571+0000","last_change":"2024-09-12T01:43:09.999182+0000","last_active":"2024-09-12T01:43:11.963571+0000","last_peered":"2024-09-12T01:43:11.963571+0000","last_clean":"2024-09-12T01:43:11.963571+0000","last_became_active":"2024-09-12T01:43:09.998818+0000","last_became_peered":"2024-09-12T01:43:09.998818+0000","last_unstale":"2024-09-12T01:43:11.963571+0000","last_undegraded":"2024-09-12T01:43:11.963571+0000","last_fullsized":"2024-09-12T01:43:11.963571+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:01.439976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964102+0000","last_change":"2024-09-12T01:43:10.001842+0000","last_active":"2024-09-12T01:43:11.964102+0000","last_peered":"2024-09-12T01:43:11.964102+0000","last_clean":"2024-09-12T01:43:11.964102+0000","last_became_active":"2024-09-12T01:43:10.001559+0000","last_became_peered":"2024-09-12T01:43:10.001559+0000","last_unstale":"2024-09-12T01:43:11.964102+0000","last_undegraded":"2024-09-12T01:43:11.964102+0000","last_fullsized":"2024-09-12T01:43:11.964102+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:30.818180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963980+0000","last_change":"2024-09-12T01:43:10.010617+0000","last_active":"2024-09-12T01:43:11.963980+0000","last_peered":"2024-09-12T01:43:11.963980+0000","last_clean":"2024-09-12T01:43:11.963980+0000","last_became_active":"2024-09-12T01:43:10.010318+0000","last_became_peered":"2024-09-12T01:43:10.010318+0000","last_unstale":"2024-09-12T01:43:11.963980+0000","last_undegraded":"2024-09-12T01:43:11.963980+0000","last_fullsized":"2024-09-12T01:43:11.963980+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:56.204678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001094+0000","last_change":"2024-09-12T01:43:09.999067+0000","last_active":"2024-09-12T01:43:11.001094+0000","last_peered":"2024-09-12T01:43:11.001094+0000","last_clean":"2024-09-12T01:43:11.001094+0000","last_became_active":"2024-09-12T01:43:09.998779+0000","last_became_peered":"2024-09-12T01:43:09.998779+0000","last_unstale":"2024-09-12T01:43:11.001094+0000","last_undegraded":"2024-09-12T01:43:11.001094+0000","last_fullsized":"2024-09-12T01:43:11.001094+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:43.359785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000666+0000","last_change":"2024-09-12T01:43:10.007268+0000","last_active":"2024-09-12T01:43:11.000666+0000","last_peered":"2024-09-12T01:43:11.000666+0000","last_clean":"2024-09-12T01:43:11.000666+0000","last_became_active":"2024-09-12T01:43:10.006974+0000","last_became_peered":"2024-09-12T01:43:10.006974+0000","last_unstale":"2024-09-12T01:43:11.000666+0000","last_undegraded":"2024-09-12T01:43:11.000666+0000","last_fullsized":"2024-09-12T01:43:11.000666+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:02.422050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964600+0000","last_change":"2024-09-12T01:43:10.013407+0000","last_active":"2024-09-12T01:43:11.964600+0000","last_peered":"2024-09-12T01:43:11.964600+0000","last_clean":"2024-09-12T01:43:11.964600+0000","last_became_active":"2024-09-12T01:43:10.013078+0000","last_became_peered":"2024-09-12T01:43:10.013078+0000","last_unstale":"2024-09-12T01:43:11.964600+0000","last_undegraded":"2024-09-12T01:43:11.964600+0000","last_fullsized":"2024-09-12T01:43:11.964600+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:19.424916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000688+0000","last_change":"2024-09-12T01:43:09.993325+0000","last_active":"2024-09-12T01:43:11.000688+0000","last_peered":"2024-09-12T01:43:11.000688+0000","last_clean":"2024-09-12T01:43:11.000688+0000","last_became_active":"2024-09-12T01:43:09.993003+0000","last_became_peered":"2024-09-12T01:43:09.993003+0000","last_unstale":"2024-09-12T01:43:11.000688+0000","last_undegraded":"2024-09-12T01:43:11.000688+0000","last_fullsized":"2024-09-12T01:43:11.000688+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:36.244472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000390+0000","last_change":"2024-09-12T01:43:10.006897+0000","last_active":"2024-09-12T01:43:11.000390+0000","last_peered":"2024-09-12T01:43:11.000390+0000","last_clean":"2024-09-12T01:43:11.000390+0000","last_became_active":"2024-09-12T01:43:10.006607+0000","last_became_peered":"2024-09-12T01:43:10.006607+0000","last_unstale":"2024-09-12T01:43:11.000390+0000","last_undegraded":"2024-09-12T01:43:11.000390+0000","last_fullsized":"2024-09-12T01:43:11.000390+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:09.721296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964179+0000","last_change":"2024-09-12T01:43:09.999698+0000","last_active":"2024-09-12T01:43:11.964179+0000","last_peered":"2024-09-12T01:43:11.964179+0000","last_clean":"2024-09-12T01:43:11.964179+0000","last_became_active":"2024-09-12T01:43:09.999370+0000","last_became_peered":"2024-09-12T01:43:09.999370+0000","last_unstale":"2024-09-12T01:43:11.964179+0000","last_undegraded":"2024-09-12T01:43:11.964179+0000","last_fullsized":"2024-09-12T01:43:11.964179+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:28.609055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963990+0000","last_change":"2024-09-12T01:43:09.999801+0000","last_active":"2024-09-12T01:43:11.963990+0000","last_peered":"2024-09-12T01:43:11.963990+0000","last_clean":"2024-09-12T01:43:11.963990+0000","last_became_active":"2024-09-12T01:43:09.999516+0000","last_became_peered":"2024-09-12T01:43:09.999516+0000","last_unstale":"2024-09-12T01:43:11.963990+0000","last_undegraded":"2024-09-12T01:43:11.963990+0000","last_fullsized":"2024-09-12T01:43:11.963990+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:32.133173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001333+0000","last_change":"2024-09-12T01:43:10.007674+0000","last_active":"2024-09-12T01:43:11.001333+0000","last_peered":"2024-09-12T01:43:11.001333+0000","last_clean":"2024-09-12T01:43:11.001333+0000","last_became_active":"2024-09-12T01:43:10.006630+0000","last_became_peered":"2024-09-12T01:43:10.006630+0000","last_unstale":"2024-09-12T01:43:11.001333+0000","last_undegraded":"2024-09-12T01:43:11.001333+0000","last_fullsized":"2024-09-12T01:43:11.001333+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:08.311418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964547+0000","last_change":"2024-09-12T01:43:10.017470+0000","last_active":"2024-09-12T01:43:11.964547+0000","last_peered":"2024-09-12T01:43:11.964547+0000","last_clean":"2024-09-12T01:43:11.964547+0000","last_became_active":"2024-09-12T01:43:10.017170+0000","last_became_peered":"2024-09-12T01:43:10.017170+0000","last_unstale":"2024-09-12T01:43:11.964547+0000","last_undegraded":"2024-09-12T01:43:11.964547+0000","last_fullsized":"2024-09-12T01:43:11.964547+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:00.279516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001187+0000","last_change":"2024-09-12T01:43:10.009228+0000","last_active":"2024-09-12T01:43:11.001187+0000","last_peered":"2024-09-12T01:43:11.001187+0000","last_clean":"2024-09-12T01:43:11.001187+0000","last_became_active":"2024-09-12T01:43:10.008772+0000","last_became_peered":"2024-09-12T01:43:10.008772+0000","last_unstale":"2024-09-12T01:43:11.001187+0000","last_undegraded":"2024-09-12T01:43:11.001187+0000","last_fullsized":"2024-09-12T01:43:11.001187+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:28.684369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385350+0000","last_change":"2024-09-12T01:43:10.010426+0000","last_active":"2024-09-12T01:43:11.385350+0000","last_peered":"2024-09-12T01:43:11.385350+0000","last_clean":"2024-09-12T01:43:11.385350+0000","last_became_active":"2024-09-12T01:43:10.010145+0000","last_became_peered":"2024-09-12T01:43:10.010145+0000","last_unstale":"2024-09-12T01:43:11.385350+0000","last_undegraded":"2024-09-12T01:43:11.385350+0000","last_fullsized":"2024-09-12T01:43:11.385350+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:28.684369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963999+0000","last_change":"2024-09-12T01:43:10.012384+0000","last_active":"2024-09-12T01:43:11.963999+0000","last_peered":"2024-09-12T01:43:11.963999+0000","last_clean":"2024-09-12T01:43:11.963999+0000","last_became_active":"2024-09-12T01:43:10.012073+0000","last_became_peered":"2024-09-12T01:43:10.012073+0000","last_unstale":"2024-09-12T01:43:11.963999+0000","last_undegraded":"2024-09-12T01:43:11.963999+0000","last_fullsized":"2024-09-12T01:43:11.963999+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:43.312690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385260+0000","last_change":"2024-09-12T01:43:10.005425+0000","last_active":"2024-09-12T01:43:11.385260+0000","last_peered":"2024-09-12T01:43:11.385260+0000","last_clean":"2024-09-12T01:43:11.385260+0000","last_became_active":"2024-09-12T01:43:10.005101+0000","last_became_peered":"2024-09-12T01:43:10.005101+0000","last_unstale":"2024-09-12T01:43:11.385260+0000","last_undegraded":"2024-09-12T01:43:11.385260+0000","last_fullsized":"2024-09-12T01:43:11.385260+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:04.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964431+0000","last_change":"2024-09-12T01:43:09.994951+0000","last_active":"2024-09-12T01:43:11.964431+0000","last_peered":"2024-09-12T01:43:11.964431+0000","last_clean":"2024-09-12T01:43:11.964431+0000","last_became_active":"2024-09-12T01:43:09.994653+0000","last_became_peered":"2024-09-12T01:43:09.994653+0000","last_unstale":"2024-09-12T01:43:11.964431+0000","last_undegraded":"2024-09-12T01:43:11.964431+0000","last_fullsized":"2024-09-12T01:43:11.964431+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:18.410771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964109+0000","last_change":"2024-09-12T01:43:10.013071+0000","last_active":"2024-09-12T01:43:11.964109+0000","last_peered":"2024-09-12T01:43:11.964109+0000","last_clean":"2024-09-12T01:43:11.964109+0000","last_became_active":"2024-09-12T01:43:10.012269+0000","last_became_peered":"2024-09-12T01:43:10.012269+0000","last_unstale":"2024-09-12T01:43:11.964109+0000","last_undegraded":"2024-09-12T01:43:11.964109+0000","last_fullsized":"2024-09-12T01:43:11.964109+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:49.844940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963751+0000","last_change":"2024-09-12T01:43:10.007750+0000","last_active":"2024-09-12T01:43:11.963751+0000","last_peered":"2024-09-12T01:43:11.963751+0000","last_clean":"2024-09-12T01:43:11.963751+0000","last_became_active":"2024-09-12T01:43:10.007449+0000","last_became_peered":"2024-09-12T01:43:10.007449+0000","last_unstale":"2024-09-12T01:43:11.963751+0000","last_undegraded":"2024-09-12T01:43:11.963751+0000","last_fullsized":"2024-09-12T01:43:11.963751+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:41.495034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964358+0000","last_change":"2024-09-12T01:43:10.008649+0000","last_active":"2024-09-12T01:43:11.964358+0000","last_peered":"2024-09-12T01:43:11.964358+0000","last_clean":"2024-09-12T01:43:11.964358+0000","last_became_active":"2024-09-12T01:43:10.008285+0000","last_became_peered":"2024-09-12T01:43:10.008285+0000","last_unstale":"2024-09-12T01:43:11.964358+0000","last_undegraded":"2024-09-12T01:43:11.964358+0000","last_fullsized":"2024-09-12T01:43:11.964358+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:32.634568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964348+0000","last_change":"2024-09-12T01:43:10.015834+0000","last_active":"2024-09-12T01:43:11.964348+0000","last_peered":"2024-09-12T01:43:11.964348+0000","last_clean":"2024-09-12T01:43:11.964348+0000","last_became_active":"2024-09-12T01:43:10.012836+0000","last_became_peered":"2024-09-12T01:43:10.012836+0000","last_unstale":"2024-09-12T01:43:11.964348+0000","last_undegraded":"2024-09-12T01:43:11.964348+0000","last_fullsized":"2024-09-12T01:43:11.964348+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:14.568049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963438+0000","last_change":"2024-09-12T01:43:10.001151+0000","last_active":"2024-09-12T01:43:11.963438+0000","last_peered":"2024-09-12T01:43:11.963438+0000","last_clean":"2024-09-12T01:43:11.963438+0000","last_became_active":"2024-09-12T01:43:10.000168+0000","last_became_peered":"2024-09-12T01:43:10.000168+0000","last_unstale":"2024-09-12T01:43:11.963438+0000","last_undegraded":"2024-09-12T01:43:11.963438+0000","last_fullsized":"2024-09-12T01:43:11.963438+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:18.112884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000652+0000","last_change":"2024-09-12T01:43:10.015393+0000","last_active":"2024-09-12T01:43:11.000652+0000","last_peered":"2024-09-12T01:43:11.000652+0000","last_clean":"2024-09-12T01:43:11.000652+0000","last_became_active":"2024-09-12T01:43:10.015131+0000","last_became_peered":"2024-09-12T01:43:10.015131+0000","last_unstale":"2024-09-12T01:43:11.000652+0000","last_undegraded":"2024-09-12T01:43:11.000652+0000","last_fullsized":"2024-09-12T01:43:11.000652+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:35.398682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963509+0000","last_change":"2024-09-12T01:43:10.017901+0000","last_active":"2024-09-12T01:43:11.963509+0000","last_peered":"2024-09-12T01:43:11.963509+0000","last_clean":"2024-09-12T01:43:11.963509+0000","last_became_active":"2024-09-12T01:43:10.017599+0000","last_became_peered":"2024-09-12T01:43:10.017599+0000","last_unstale":"2024-09-12T01:43:11.963509+0000","last_undegraded":"2024-09-12T01:43:11.963509+0000","last_fullsized":"2024-09-12T01:43:11.963509+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:23.665111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001446+0000","last_change":"2024-09-12T01:43:10.008416+0000","last_active":"2024-09-12T01:43:11.001446+0000","last_peered":"2024-09-12T01:43:11.001446+0000","last_clean":"2024-09-12T01:43:11.001446+0000","last_became_active":"2024-09-12T01:43:10.008149+0000","last_became_peered":"2024-09-12T01:43:10.008149+0000","last_unstale":"2024-09-12T01:43:11.001446+0000","last_undegraded":"2024-09-12T01:43:11.001446+0000","last_fullsized":"2024-09-12T01:43:11.001446+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:48.251303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964145+0000","last_change":"2024-09-12T01:43:10.008139+0000","last_active":"2024-09-12T01:43:11.964145+0000","last_peered":"2024-09-12T01:43:11.964145+0000","last_clean":"2024-09-12T01:43:11.964145+0000","last_became_active":"2024-09-12T01:43:10.007864+0000","last_became_peered":"2024-09-12T01:43:10.007864+0000","last_unstale":"2024-09-12T01:43:11.964145+0000","last_undegraded":"2024-09-12T01:43:11.964145+0000","last_fullsized":"2024-09-12T01:43:11.964145+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:48.553216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385711+0000","last_change":"2024-09-12T01:43:10.018610+0000","last_active":"2024-09-12T01:43:11.385711+0000","last_peered":"2024-09-12T01:43:11.385711+0000","last_clean":"2024-09-12T01:43:11.385711+0000","last_became_active":"2024-09-12T01:43:10.018313+0000","last_became_peered":"2024-09-12T01:43:10.018313+0000","last_unstale":"2024-09-12T01:43:11.385711+0000","last_undegraded":"2024-09-12T01:43:11.385711+0000","last_fullsized":"2024-09-12T01:43:11.385711+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:30:18.196287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000971+0000","last_change":"2024-09-12T01:43:10.005034+0000","last_active":"2024-09-12T01:43:11.000971+0000","last_peered":"2024-09-12T01:43:11.000971+0000","last_clean":"2024-09-12T01:43:11.000971+0000","last_became_active":"2024-09-12T01:43:10.004647+0000","last_became_peered":"2024-09-12T01:43:10.004647+0000","last_unstale":"2024-09-12T01:43:11.000971+0000","last_undegraded":"2024-09-12T01:43:11.000971+0000","last_fullsized":"2024-09-12T01:43:11.000971+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:23.039212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963435+0000","last_change":"2024-09-12T01:43:10.006573+0000","last_active":"2024-09-12T01:43:11.963435+0000","last_peered":"2024-09-12T01:43:11.963435+0000","last_clean":"2024-09-12T01:43:11.963435+0000","last_became_active":"2024-09-12T01:43:10.006315+0000","last_became_peered":"2024-09-12T01:43:10.006315+0000","last_unstale":"2024-09-12T01:43:11.963435+0000","last_undegraded":"2024-09-12T01:43:11.963435+0000","last_fullsized":"2024-09-12T01:43:11.963435+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:32.878745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963527+0000","last_change":"2024-09-12T01:43:09.993348+0000","last_active":"2024-09-12T01:43:11.963527+0000","last_peered":"2024-09-12T01:43:11.963527+0000","last_clean":"2024-09-12T01:43:11.963527+0000","last_became_active":"2024-09-12T01:43:09.993048+0000","last_became_peered":"2024-09-12T01:43:09.993048+0000","last_unstale":"2024-09-12T01:43:11.963527+0000","last_undegraded":"2024-09-12T01:43:11.963527+0000","last_fullsized":"2024-09-12T01:43:11.963527+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:29.279332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000746+0000","last_change":"2024-09-12T01:43:10.010938+0000","last_active":"2024-09-12T01:43:11.000746+0000","last_peered":"2024-09-12T01:43:11.000746+0000","last_clean":"2024-09-12T01:43:11.000746+0000","last_became_active":"2024-09-12T01:43:10.010575+0000","last_became_peered":"2024-09-12T01:43:10.010575+0000","last_unstale":"2024-09-12T01:43:11.000746+0000","last_undegraded":"2024-09-12T01:43:11.000746+0000","last_fullsized":"2024-09-12T01:43:11.000746+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:18.967832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963867+0000","last_change":"2024-09-12T01:43:09.999258+0000","last_active":"2024-09-12T01:43:11.963867+0000","last_peered":"2024-09-12T01:43:11.963867+0000","last_clean":"2024-09-12T01:43:11.963867+0000","last_became_active":"2024-09-12T01:43:09.998972+0000","last_became_peered":"2024-09-12T01:43:09.998972+0000","last_unstale":"2024-09-12T01:43:11.963867+0000","last_undegraded":"2024-09-12T01:43:11.963867+0000","last_fullsized":"2024-09-12T01:43:11.963867+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:13.415100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385715+0000","last_change":"2024-09-12T01:43:10.002479+0000","last_active":"2024-09-12T01:43:11.385715+0000","last_peered":"2024-09-12T01:43:11.385715+0000","last_clean":"2024-09-12T01:43:11.385715+0000","last_became_active":"2024-09-12T01:43:10.001641+0000","last_became_peered":"2024-09-12T01:43:10.001641+0000","last_unstale":"2024-09-12T01:43:11.385715+0000","last_undegraded":"2024-09-12T01:43:11.385715+0000","last_fullsized":"2024-09-12T01:43:11.385715+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:01.752600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"116'4","reported_seq":18,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001264+0000","last_change":"2024-09-12T01:43:08.999139+0000","last_active":"2024-09-12T01:43:11.001264+0000","last_peered":"2024-09-12T01:43:11.001264+0000","last_clean":"2024-09-12T01:43:11.001264+0000","last_became_active":"2024-09-12T01:43:08.998874+0000","last_became_peered":"2024-09-12T01:43:08.998874+0000","last_unstale":"2024-09-12T01:43:11.001264+0000","last_undegraded":"2024-09-12T01:43:11.001264+0000","last_fullsized":"2024-09-12T01:43:11.001264+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:12.086671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964330+0000","last_change":"2024-09-12T01:43:09.998236+0000","last_active":"2024-09-12T01:43:11.964330+0000","last_peered":"2024-09-12T01:43:11.964330+0000","last_clean":"2024-09-12T01:43:11.964330+0000","last_became_active":"2024-09-12T01:43:09.996642+0000","last_became_peered":"2024-09-12T01:43:09.996642+0000","last_unstale":"2024-09-12T01:43:11.964330+0000","last_undegraded":"2024-09-12T01:43:11.964330+0000","last_fullsized":"2024-09-12T01:43:11.964330+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:07.314765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964110+0000","last_change":"2024-09-12T01:43:09.007149+0000","last_active":"2024-09-12T01:43:11.964110+0000","last_peered":"2024-09-12T01:43:11.964110+0000","last_clean":"2024-09-12T01:43:11.964110+0000","last_became_active":"2024-09-12T01:43:09.006801+0000","last_became_peered":"2024-09-12T01:43:09.006801+0000","last_unstale":"2024-09-12T01:43:11.964110+0000","last_undegraded":"2024-09-12T01:43:11.964110+0000","last_fullsized":"2024-09-12T01:43:11.964110+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:48.504193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963946+0000","last_change":"2024-09-12T01:43:10.012246+0000","last_active":"2024-09-12T01:43:11.963946+0000","last_peered":"2024-09-12T01:43:11.963946+0000","last_clean":"2024-09-12T01:43:11.963946+0000","last_became_active":"2024-09-12T01:43:10.011930+0000","last_became_peered":"2024-09-12T01:43:10.011930+0000","last_unstale":"2024-09-12T01:43:11.963946+0000","last_undegraded":"2024-09-12T01:43:11.963946+0000","last_fullsized":"2024-09-12T01:43:11.963946+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:54.518450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001401+0000","last_change":"2024-09-12T01:43:08.998653+0000","last_active":"2024-09-12T01:43:11.001401+0000","last_peered":"2024-09-12T01:43:11.001401+0000","last_clean":"2024-09-12T01:43:11.001401+0000","last_became_active":"2024-09-12T01:43:08.998390+0000","last_became_peered":"2024-09-12T01:43:08.998390+0000","last_unstale":"2024-09-12T01:43:11.001401+0000","last_undegraded":"2024-09-12T01:43:11.001401+0000","last_fullsized":"2024-09-12T01:43:11.001401+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:18.419447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964809+0000","last_change":"2024-09-12T01:43:10.012472+0000","last_active":"2024-09-12T01:43:11.964809+0000","last_peered":"2024-09-12T01:43:11.964809+0000","last_clean":"2024-09-12T01:43:11.964809+0000","last_became_active":"2024-09-12T01:43:10.011808+0000","last_became_peered":"2024-09-12T01:43:10.011808+0000","last_unstale":"2024-09-12T01:43:11.964809+0000","last_undegraded":"2024-09-12T01:43:11.964809+0000","last_fullsized":"2024-09-12T01:43:11.964809+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:43.359785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963760+0000","last_change":"2024-09-12T01:43:08.995623+0000","last_active":"2024-09-12T01:43:11.963760+0000","last_peered":"2024-09-12T01:43:11.963760+0000","last_clean":"2024-09-12T01:43:11.963760+0000","last_became_active":"2024-09-12T01:43:08.995275+0000","last_became_peered":"2024-09-12T01:43:08.995275+0000","last_unstale":"2024-09-12T01:43:11.963760+0000","last_undegraded":"2024-09-12T01:43:11.963760+0000","last_fullsized":"2024-09-12T01:43:11.963760+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:05.332464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964016+0000","last_change":"2024-09-12T01:43:10.012454+0000","last_active":"2024-09-12T01:43:11.964016+0000","last_peered":"2024-09-12T01:43:11.964016+0000","last_clean":"2024-09-12T01:43:11.964016+0000","last_became_active":"2024-09-12T01:43:10.012121+0000","last_became_peered":"2024-09-12T01:43:10.012121+0000","last_unstale":"2024-09-12T01:43:11.964016+0000","last_undegraded":"2024-09-12T01:43:11.964016+0000","last_fullsized":"2024-09-12T01:43:11.964016+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:41.682407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963404+0000","last_change":"2024-09-12T01:43:08.997043+0000","last_active":"2024-09-12T01:43:11.963404+0000","last_peered":"2024-09-12T01:43:11.963404+0000","last_clean":"2024-09-12T01:43:11.963404+0000","last_became_active":"2024-09-12T01:43:08.996754+0000","last_became_peered":"2024-09-12T01:43:08.996754+0000","last_unstale":"2024-09-12T01:43:11.963404+0000","last_undegraded":"2024-09-12T01:43:11.963404+0000","last_fullsized":"2024-09-12T01:43:11.963404+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:32.640473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964727+0000","last_change":"2024-09-12T01:43:10.015386+0000","last_active":"2024-09-12T01:43:11.964727+0000","last_peered":"2024-09-12T01:43:11.964727+0000","last_clean":"2024-09-12T01:43:11.964727+0000","last_became_active":"2024-09-12T01:43:10.012428+0000","last_became_peered":"2024-09-12T01:43:10.012428+0000","last_unstale":"2024-09-12T01:43:11.964727+0000","last_undegraded":"2024-09-12T01:43:11.964727+0000","last_fullsized":"2024-09-12T01:43:11.964727+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:43.082717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964118+0000","last_change":"2024-09-12T01:43:08.997463+0000","last_active":"2024-09-12T01:43:11.964118+0000","last_peered":"2024-09-12T01:43:11.964118+0000","last_clean":"2024-09-12T01:43:11.964118+0000","last_became_active":"2024-09-12T01:43:08.994321+0000","last_became_peered":"2024-09-12T01:43:08.994321+0000","last_unstale":"2024-09-12T01:43:11.964118+0000","last_undegraded":"2024-09-12T01:43:11.964118+0000","last_fullsized":"2024-09-12T01:43:11.964118+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:57.845182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963721+0000","last_change":"2024-09-12T01:43:10.016198+0000","last_active":"2024-09-12T01:43:11.963721+0000","last_peered":"2024-09-12T01:43:11.963721+0000","last_clean":"2024-09-12T01:43:11.963721+0000","last_became_active":"2024-09-12T01:43:10.015942+0000","last_became_peered":"2024-09-12T01:43:10.015942+0000","last_unstale":"2024-09-12T01:43:11.963721+0000","last_undegraded":"2024-09-12T01:43:11.963721+0000","last_fullsized":"2024-09-12T01:43:11.963721+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:45.075912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963676+0000","last_change":"2024-09-12T01:43:08.998565+0000","last_active":"2024-09-12T01:43:11.963676+0000","last_peered":"2024-09-12T01:43:11.963676+0000","last_clean":"2024-09-12T01:43:11.963676+0000","last_became_active":"2024-09-12T01:43:08.998292+0000","last_became_peered":"2024-09-12T01:43:08.998292+0000","last_unstale":"2024-09-12T01:43:11.963676+0000","last_undegraded":"2024-09-12T01:43:11.963676+0000","last_fullsized":"2024-09-12T01:43:11.963676+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:53.559247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963651+0000","last_change":"2024-09-12T01:43:10.003831+0000","last_active":"2024-09-12T01:43:11.963651+0000","last_peered":"2024-09-12T01:43:11.963651+0000","last_clean":"2024-09-12T01:43:11.963651+0000","last_became_active":"2024-09-12T01:43:10.003524+0000","last_became_peered":"2024-09-12T01:43:10.003524+0000","last_unstale":"2024-09-12T01:43:11.963651+0000","last_undegraded":"2024-09-12T01:43:11.963651+0000","last_fullsized":"2024-09-12T01:43:11.963651+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:15.848191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963241+0000","last_change":"2024-09-12T01:43:08.998287+0000","last_active":"2024-09-12T01:43:11.963241+0000","last_peered":"2024-09-12T01:43:11.963241+0000","last_clean":"2024-09-12T01:43:11.963241+0000","last_became_active":"2024-09-12T01:43:08.997989+0000","last_became_peered":"2024-09-12T01:43:08.997989+0000","last_unstale":"2024-09-12T01:43:11.963241+0000","last_undegraded":"2024-09-12T01:43:11.963241+0000","last_fullsized":"2024-09-12T01:43:11.963241+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:26.491976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964254+0000","last_change":"2024-09-12T01:43:10.002510+0000","last_active":"2024-09-12T01:43:11.964254+0000","last_peered":"2024-09-12T01:43:11.964254+0000","last_clean":"2024-09-12T01:43:11.964254+0000","last_became_active":"2024-09-12T01:43:10.002108+0000","last_became_peered":"2024-09-12T01:43:10.002108+0000","last_unstale":"2024-09-12T01:43:11.964254+0000","last_undegraded":"2024-09-12T01:43:11.964254+0000","last_fullsized":"2024-09-12T01:43:11.964254+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:32.374576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964499+0000","last_change":"2024-09-12T01:43:09.005035+0000","last_active":"2024-09-12T01:43:11.964499+0000","last_peered":"2024-09-12T01:43:11.964499+0000","last_clean":"2024-09-12T01:43:11.964499+0000","last_became_active":"2024-09-12T01:43:09.003567+0000","last_became_peered":"2024-09-12T01:43:09.003567+0000","last_unstale":"2024-09-12T01:43:11.964499+0000","last_undegraded":"2024-09-12T01:43:11.964499+0000","last_fullsized":"2024-09-12T01:43:11.964499+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:29.476489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001160+0000","last_change":"2024-09-12T01:43:10.006087+0000","last_active":"2024-09-12T01:43:11.001160+0000","last_peered":"2024-09-12T01:43:11.001160+0000","last_clean":"2024-09-12T01:43:11.001160+0000","last_became_active":"2024-09-12T01:43:10.003431+0000","last_became_peered":"2024-09-12T01:43:10.003431+0000","last_unstale":"2024-09-12T01:43:11.001160+0000","last_undegraded":"2024-09-12T01:43:11.001160+0000","last_fullsized":"2024-09-12T01:43:11.001160+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:59.595180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964210+0000","last_change":"2024-09-12T01:43:09.000223+0000","last_active":"2024-09-12T01:43:11.964210+0000","last_peered":"2024-09-12T01:43:11.964210+0000","last_clean":"2024-09-12T01:43:11.964210+0000","last_became_active":"2024-09-12T01:43:08.999881+0000","last_became_peered":"2024-09-12T01:43:08.999881+0000","last_unstale":"2024-09-12T01:43:11.964210+0000","last_undegraded":"2024-09-12T01:43:11.964210+0000","last_fullsized":"2024-09-12T01:43:11.964210+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:50.234821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964648+0000","last_change":"2024-09-12T01:43:10.017833+0000","last_active":"2024-09-12T01:43:11.964648+0000","last_peered":"2024-09-12T01:43:11.964648+0000","last_clean":"2024-09-12T01:43:11.964648+0000","last_became_active":"2024-09-12T01:43:10.017506+0000","last_became_peered":"2024-09-12T01:43:10.017506+0000","last_unstale":"2024-09-12T01:43:11.964648+0000","last_undegraded":"2024-09-12T01:43:11.964648+0000","last_fullsized":"2024-09-12T01:43:11.964648+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:55.436244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"116'3","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001101+0000","last_change":"2024-09-12T01:43:08.999971+0000","last_active":"2024-09-12T01:43:11.001101+0000","last_peered":"2024-09-12T01:43:11.001101+0000","last_clean":"2024-09-12T01:43:11.001101+0000","last_became_active":"2024-09-12T01:43:08.999656+0000","last_became_peered":"2024-09-12T01:43:08.999656+0000","last_unstale":"2024-09-12T01:43:11.001101+0000","last_undegraded":"2024-09-12T01:43:11.001101+0000","last_fullsized":"2024-09-12T01:43:11.001101+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:08.248385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000958+0000","last_change":"2024-09-12T01:43:10.018504+0000","last_active":"2024-09-12T01:43:11.000958+0000","last_peered":"2024-09-12T01:43:11.000958+0000","last_clean":"2024-09-12T01:43:11.000958+0000","last_became_active":"2024-09-12T01:43:10.018223+0000","last_became_peered":"2024-09-12T01:43:10.018223+0000","last_unstale":"2024-09-12T01:43:11.000958+0000","last_undegraded":"2024-09-12T01:43:11.000958+0000","last_fullsized":"2024-09-12T01:43:11.000958+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:43.834846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"116'6","reported_seq":20,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000961+0000","last_change":"2024-09-12T01:43:09.004240+0000","last_active":"2024-09-12T01:43:11.000961+0000","last_peered":"2024-09-12T01:43:11.000961+0000","last_clean":"2024-09-12T01:43:11.000961+0000","last_became_active":"2024-09-12T01:43:09.003936+0000","last_became_peered":"2024-09-12T01:43:09.003936+0000","last_unstale":"2024-09-12T01:43:11.000961+0000","last_undegraded":"2024-09-12T01:43:11.000961+0000","last_fullsized":"2024-09-12T01:43:11.000961+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:13.733832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385631+0000","last_change":"2024-09-12T01:43:10.005212+0000","last_active":"2024-09-12T01:43:11.385631+0000","last_peered":"2024-09-12T01:43:11.385631+0000","last_clean":"2024-09-12T01:43:11.385631+0000","last_became_active":"2024-09-12T01:43:10.004914+0000","last_became_peered":"2024-09-12T01:43:10.004914+0000","last_unstale":"2024-09-12T01:43:11.385631+0000","last_undegraded":"2024-09-12T01:43:11.385631+0000","last_fullsized":"2024-09-12T01:43:11.385631+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:02.599845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385300+0000","last_change":"2024-09-12T01:43:08.996819+0000","last_active":"2024-09-12T01:43:11.385300+0000","last_peered":"2024-09-12T01:43:11.385300+0000","last_clean":"2024-09-12T01:43:11.385300+0000","last_became_active":"2024-09-12T01:43:08.996524+0000","last_became_peered":"2024-09-12T01:43:08.996524+0000","last_unstale":"2024-09-12T01:43:11.385300+0000","last_undegraded":"2024-09-12T01:43:11.385300+0000","last_fullsized":"2024-09-12T01:43:11.385300+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:59.234398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385249+0000","last_change":"2024-09-12T01:43:10.005816+0000","last_active":"2024-09-12T01:43:11.385249+0000","last_peered":"2024-09-12T01:43:11.385249+0000","last_clean":"2024-09-12T01:43:11.385249+0000","last_became_active":"2024-09-12T01:43:10.005542+0000","last_became_peered":"2024-09-12T01:43:10.005542+0000","last_unstale":"2024-09-12T01:43:11.385249+0000","last_undegraded":"2024-09-12T01:43:11.385249+0000","last_fullsized":"2024-09-12T01:43:11.385249+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:57.864742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000815+0000","last_change":"2024-09-12T01:43:09.005250+0000","last_active":"2024-09-12T01:43:11.000815+0000","last_peered":"2024-09-12T01:43:11.000815+0000","last_clean":"2024-09-12T01:43:11.000815+0000","last_became_active":"2024-09-12T01:43:09.004791+0000","last_became_peered":"2024-09-12T01:43:09.004791+0000","last_unstale":"2024-09-12T01:43:11.000815+0000","last_undegraded":"2024-09-12T01:43:11.000815+0000","last_fullsized":"2024-09-12T01:43:11.000815+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:26.568406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964196+0000","last_change":"2024-09-12T01:43:10.014855+0000","last_active":"2024-09-12T01:43:11.964196+0000","last_peered":"2024-09-12T01:43:11.964196+0000","last_clean":"2024-09-12T01:43:11.964196+0000","last_became_active":"2024-09-12T01:43:10.014592+0000","last_became_peered":"2024-09-12T01:43:10.014592+0000","last_unstale":"2024-09-12T01:43:11.964196+0000","last_undegraded":"2024-09-12T01:43:11.964196+0000","last_fullsized":"2024-09-12T01:43:11.964196+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:27.573875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"116'8","reported_seq":22,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963834+0000","last_change":"2024-09-12T01:43:09.002635+0000","last_active":"2024-09-12T01:43:11.963834+0000","last_peered":"2024-09-12T01:43:11.963834+0000","last_clean":"2024-09-12T01:43:11.963834+0000","last_became_active":"2024-09-12T01:43:09.002101+0000","last_became_peered":"2024-09-12T01:43:09.002101+0000","last_unstale":"2024-09-12T01:43:11.963834+0000","last_undegraded":"2024-09-12T01:43:11.963834+0000","last_fullsized":"2024-09-12T01:43:11.963834+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:44.307753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001224+0000","last_change":"2024-09-12T01:43:10.008983+0000","last_active":"2024-09-12T01:43:11.001224+0000","last_peered":"2024-09-12T01:43:11.001224+0000","last_clean":"2024-09-12T01:43:11.001224+0000","last_became_active":"2024-09-12T01:43:10.008679+0000","last_became_peered":"2024-09-12T01:43:10.008679+0000","last_unstale":"2024-09-12T01:43:11.001224+0000","last_undegraded":"2024-09-12T01:43:11.001224+0000","last_fullsized":"2024-09-12T01:43:11.001224+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:06.891635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964646+0000","last_change":"2024-09-12T01:43:09.001656+0000","last_active":"2024-09-12T01:43:11.964646+0000","last_peered":"2024-09-12T01:43:11.964646+0000","last_clean":"2024-09-12T01:43:11.964646+0000","last_became_active":"2024-09-12T01:43:09.000503+0000","last_became_peered":"2024-09-12T01:43:09.000503+0000","last_unstale":"2024-09-12T01:43:11.964646+0000","last_undegraded":"2024-09-12T01:43:11.964646+0000","last_fullsized":"2024-09-12T01:43:11.964646+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:21.472595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001203+0000","last_change":"2024-09-12T01:43:10.005510+0000","last_active":"2024-09-12T01:43:11.001203+0000","last_peered":"2024-09-12T01:43:11.001203+0000","last_clean":"2024-09-12T01:43:11.001203+0000","last_became_active":"2024-09-12T01:43:10.002150+0000","last_became_peered":"2024-09-12T01:43:10.002150+0000","last_unstale":"2024-09-12T01:43:11.001203+0000","last_undegraded":"2024-09-12T01:43:11.001203+0000","last_fullsized":"2024-09-12T01:43:11.001203+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:17.976343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001169+0000","last_change":"2024-09-12T01:43:08.997611+0000","last_active":"2024-09-12T01:43:11.001169+0000","last_peered":"2024-09-12T01:43:11.001169+0000","last_clean":"2024-09-12T01:43:11.001169+0000","last_became_active":"2024-09-12T01:43:08.997299+0000","last_became_peered":"2024-09-12T01:43:08.997299+0000","last_unstale":"2024-09-12T01:43:11.001169+0000","last_undegraded":"2024-09-12T01:43:11.001169+0000","last_fullsized":"2024-09-12T01:43:11.001169+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:59.274047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963702+0000","last_change":"2024-09-12T01:43:10.004330+0000","last_active":"2024-09-12T01:43:11.963702+0000","last_peered":"2024-09-12T01:43:11.963702+0000","last_clean":"2024-09-12T01:43:11.963702+0000","last_became_active":"2024-09-12T01:43:10.004040+0000","last_became_peered":"2024-09-12T01:43:10.004040+0000","last_unstale":"2024-09-12T01:43:11.963702+0000","last_undegraded":"2024-09-12T01:43:11.963702+0000","last_fullsized":"2024-09-12T01:43:11.963702+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:39.928166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"116'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964124+0000","last_change":"2024-09-12T01:43:09.002198+0000","last_active":"2024-09-12T01:43:11.964124+0000","last_peered":"2024-09-12T01:43:11.964124+0000","last_clean":"2024-09-12T01:43:11.964124+0000","last_became_active":"2024-09-12T01:43:09.001925+0000","last_became_peered":"2024-09-12T01:43:09.001925+0000","last_unstale":"2024-09-12T01:43:11.964124+0000","last_undegraded":"2024-09-12T01:43:11.964124+0000","last_fullsized":"2024-09-12T01:43:11.964124+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:33.130766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963843+0000","last_change":"2024-09-12T01:43:10.001049+0000","last_active":"2024-09-12T01:43:11.963843+0000","last_peered":"2024-09-12T01:43:11.963843+0000","last_clean":"2024-09-12T01:43:11.963843+0000","last_became_active":"2024-09-12T01:43:10.000765+0000","last_became_peered":"2024-09-12T01:43:10.000765+0000","last_unstale":"2024-09-12T01:43:11.963843+0000","last_undegraded":"2024-09-12T01:43:11.963843+0000","last_fullsized":"2024-09-12T01:43:11.963843+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:23.884040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000912+0000","last_change":"2024-09-12T01:43:08.991805+0000","last_active":"2024-09-12T01:43:11.000912+0000","last_peered":"2024-09-12T01:43:11.000912+0000","last_clean":"2024-09-12T01:43:11.000912+0000","last_became_active":"2024-09-12T01:43:08.991517+0000","last_became_peered":"2024-09-12T01:43:08.991517+0000","last_unstale":"2024-09-12T01:43:11.000912+0000","last_undegraded":"2024-09-12T01:43:11.000912+0000","last_fullsized":"2024-09-12T01:43:11.000912+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:16.731138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963811+0000","last_change":"2024-09-12T01:43:10.001313+0000","last_active":"2024-09-12T01:43:11.963811+0000","last_peered":"2024-09-12T01:43:11.963811+0000","last_clean":"2024-09-12T01:43:11.963811+0000","last_became_active":"2024-09-12T01:43:10.001010+0000","last_became_peered":"2024-09-12T01:43:10.001010+0000","last_unstale":"2024-09-12T01:43:11.963811+0000","last_undegraded":"2024-09-12T01:43:11.963811+0000","last_fullsized":"2024-09-12T01:43:11.963811+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:51.577469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963942+0000","last_change":"2024-09-12T01:43:09.002910+0000","last_active":"2024-09-12T01:43:11.963942+0000","last_peered":"2024-09-12T01:43:11.963942+0000","last_clean":"2024-09-12T01:43:11.963942+0000","last_became_active":"2024-09-12T01:43:09.002618+0000","last_became_peered":"2024-09-12T01:43:09.002618+0000","last_unstale":"2024-09-12T01:43:11.963942+0000","last_undegraded":"2024-09-12T01:43:11.963942+0000","last_fullsized":"2024-09-12T01:43:11.963942+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:37.911468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000900+0000","last_change":"2024-09-12T01:43:10.003250+0000","last_active":"2024-09-12T01:43:11.000900+0000","last_peered":"2024-09-12T01:43:11.000900+0000","last_clean":"2024-09-12T01:43:11.000900+0000","last_became_active":"2024-09-12T01:43:10.002434+0000","last_became_peered":"2024-09-12T01:43:10.002434+0000","last_unstale":"2024-09-12T01:43:11.000900+0000","last_undegraded":"2024-09-12T01:43:11.000900+0000","last_fullsized":"2024-09-12T01:43:11.000900+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:30.956540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964288+0000","last_change":"2024-09-12T01:43:08.998911+0000","last_active":"2024-09-12T01:43:11.964288+0000","last_peered":"2024-09-12T01:43:11.964288+0000","last_clean":"2024-09-12T01:43:11.964288+0000","last_became_active":"2024-09-12T01:43:08.998521+0000","last_became_peered":"2024-09-12T01:43:08.998521+0000","last_unstale":"2024-09-12T01:43:11.964288+0000","last_undegraded":"2024-09-12T01:43:11.964288+0000","last_fullsized":"2024-09-12T01:43:11.964288+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:23.525590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385476+0000","last_change":"2024-09-12T01:43:10.011401+0000","last_active":"2024-09-12T01:43:11.385476+0000","last_peered":"2024-09-12T01:43:11.385476+0000","last_clean":"2024-09-12T01:43:11.385476+0000","last_became_active":"2024-09-12T01:43:10.011126+0000","last_became_peered":"2024-09-12T01:43:10.011126+0000","last_unstale":"2024-09-12T01:43:11.385476+0000","last_undegraded":"2024-09-12T01:43:11.385476+0000","last_fullsized":"2024-09-12T01:43:11.385476+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:08.311418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385248+0000","last_change":"2024-09-12T01:43:09.004606+0000","last_active":"2024-09-12T01:43:11.385248+0000","last_peered":"2024-09-12T01:43:11.385248+0000","last_clean":"2024-09-12T01:43:11.385248+0000","last_became_active":"2024-09-12T01:43:09.004182+0000","last_became_peered":"2024-09-12T01:43:09.004182+0000","last_unstale":"2024-09-12T01:43:11.385248+0000","last_undegraded":"2024-09-12T01:43:11.385248+0000","last_fullsized":"2024-09-12T01:43:11.385248+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:49.900328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964747+0000","last_change":"2024-09-12T01:43:10.008207+0000","last_active":"2024-09-12T01:43:11.964747+0000","last_peered":"2024-09-12T01:43:11.964747+0000","last_clean":"2024-09-12T01:43:11.964747+0000","last_became_active":"2024-09-12T01:43:10.007942+0000","last_became_peered":"2024-09-12T01:43:10.007942+0000","last_unstale":"2024-09-12T01:43:11.964747+0000","last_undegraded":"2024-09-12T01:43:11.964747+0000","last_fullsized":"2024-09-12T01:43:11.964747+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:57.864742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000760+0000","last_change":"2024-09-12T01:43:08.998574+0000","last_active":"2024-09-12T01:43:11.000760+0000","last_peered":"2024-09-12T01:43:11.000760+0000","last_clean":"2024-09-12T01:43:11.000760+0000","last_became_active":"2024-09-12T01:43:08.998295+0000","last_became_peered":"2024-09-12T01:43:08.998295+0000","last_unstale":"2024-09-12T01:43:11.000760+0000","last_undegraded":"2024-09-12T01:43:11.000760+0000","last_fullsized":"2024-09-12T01:43:11.000760+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:44.083523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001207+0000","last_change":"2024-09-12T01:43:10.006771+0000","last_active":"2024-09-12T01:43:11.001207+0000","last_peered":"2024-09-12T01:43:11.001207+0000","last_clean":"2024-09-12T01:43:11.001207+0000","last_became_active":"2024-09-12T01:43:10.006483+0000","last_became_peered":"2024-09-12T01:43:10.006483+0000","last_unstale":"2024-09-12T01:43:11.001207+0000","last_undegraded":"2024-09-12T01:43:11.001207+0000","last_fullsized":"2024-09-12T01:43:11.001207+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:34:23.665111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964400+0000","last_change":"2024-09-12T01:43:08.999378+0000","last_active":"2024-09-12T01:43:11.964400+0000","last_peered":"2024-09-12T01:43:11.964400+0000","last_clean":"2024-09-12T01:43:11.964400+0000","last_became_active":"2024-09-12T01:43:08.999097+0000","last_became_peered":"2024-09-12T01:43:08.999097+0000","last_unstale":"2024-09-12T01:43:11.964400+0000","last_undegraded":"2024-09-12T01:43:11.964400+0000","last_fullsized":"2024-09-12T01:43:11.964400+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:38.618460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963660+0000","last_change":"2024-09-12T01:43:10.000417+0000","last_active":"2024-09-12T01:43:11.963660+0000","last_peered":"2024-09-12T01:43:11.963660+0000","last_clean":"2024-09-12T01:43:11.963660+0000","last_became_active":"2024-09-12T01:43:10.000090+0000","last_became_peered":"2024-09-12T01:43:10.000090+0000","last_unstale":"2024-09-12T01:43:11.963660+0000","last_undegraded":"2024-09-12T01:43:11.963660+0000","last_fullsized":"2024-09-12T01:43:11.963660+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:02.791275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"117'1","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.001287+0000","last_change":"2024-09-12T01:43:09.005092+0000","last_active":"2024-09-12T01:43:11.001287+0000","last_peered":"2024-09-12T01:43:11.001287+0000","last_clean":"2024-09-12T01:43:11.001287+0000","last_became_active":"2024-09-12T01:43:09.004744+0000","last_became_peered":"2024-09-12T01:43:09.004744+0000","last_unstale":"2024-09-12T01:43:11.001287+0000","last_undegraded":"2024-09-12T01:43:11.001287+0000","last_fullsized":"2024-09-12T01:43:11.001287+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:38.790944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385535+0000","last_change":"2024-09-12T01:43:10.009557+0000","last_active":"2024-09-12T01:43:11.385535+0000","last_peered":"2024-09-12T01:43:11.385535+0000","last_clean":"2024-09-12T01:43:11.385535+0000","last_became_active":"2024-09-12T01:43:10.009200+0000","last_became_peered":"2024-09-12T01:43:10.009200+0000","last_unstale":"2024-09-12T01:43:11.385535+0000","last_undegraded":"2024-09-12T01:43:11.385535+0000","last_fullsized":"2024-09-12T01:43:11.385535+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:48.251303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964153+0000","last_change":"2024-09-12T01:43:09.005025+0000","last_active":"2024-09-12T01:43:11.964153+0000","last_peered":"2024-09-12T01:43:11.964153+0000","last_clean":"2024-09-12T01:43:11.964153+0000","last_became_active":"2024-09-12T01:43:09.004716+0000","last_became_peered":"2024-09-12T01:43:09.004716+0000","last_unstale":"2024-09-12T01:43:11.964153+0000","last_undegraded":"2024-09-12T01:43:11.964153+0000","last_fullsized":"2024-09-12T01:43:11.964153+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:12.967708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964089+0000","last_change":"2024-09-12T01:43:10.008340+0000","last_active":"2024-09-12T01:43:11.964089+0000","last_peered":"2024-09-12T01:43:11.964089+0000","last_clean":"2024-09-12T01:43:11.964089+0000","last_became_active":"2024-09-12T01:43:10.008060+0000","last_became_peered":"2024-09-12T01:43:10.008060+0000","last_unstale":"2024-09-12T01:43:11.964089+0000","last_undegraded":"2024-09-12T01:43:11.964089+0000","last_fullsized":"2024-09-12T01:43:11.964089+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.407498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385537+0000","last_change":"2024-09-12T01:43:09.001072+0000","last_active":"2024-09-12T01:43:11.385537+0000","last_peered":"2024-09-12T01:43:11.385537+0000","last_clean":"2024-09-12T01:43:11.385537+0000","last_became_active":"2024-09-12T01:43:09.000603+0000","last_became_peered":"2024-09-12T01:43:09.000603+0000","last_unstale":"2024-09-12T01:43:11.385537+0000","last_undegraded":"2024-09-12T01:43:11.385537+0000","last_fullsized":"2024-09-12T01:43:11.385537+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:03.586102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964101+0000","last_change":"2024-09-12T01:43:10.015102+0000","last_active":"2024-09-12T01:43:11.964101+0000","last_peered":"2024-09-12T01:43:11.964101+0000","last_clean":"2024-09-12T01:43:11.964101+0000","last_became_active":"2024-09-12T01:43:10.012654+0000","last_became_peered":"2024-09-12T01:43:10.012654+0000","last_unstale":"2024-09-12T01:43:11.964101+0000","last_undegraded":"2024-09-12T01:43:11.964101+0000","last_fullsized":"2024-09-12T01:43:11.964101+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.088992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963736+0000","last_change":"2024-09-12T01:43:08.996332+0000","last_active":"2024-09-12T01:43:11.963736+0000","last_peered":"2024-09-12T01:43:11.963736+0000","last_clean":"2024-09-12T01:43:11.963736+0000","last_became_active":"2024-09-12T01:43:08.996027+0000","last_became_peered":"2024-09-12T01:43:08.996027+0000","last_unstale":"2024-09-12T01:43:11.963736+0000","last_undegraded":"2024-09-12T01:43:11.963736+0000","last_fullsized":"2024-09-12T01:43:11.963736+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:08.212680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964782+0000","last_change":"2024-09-12T01:43:10.007677+0000","last_active":"2024-09-12T01:43:11.964782+0000","last_peered":"2024-09-12T01:43:11.964782+0000","last_clean":"2024-09-12T01:43:11.964782+0000","last_became_active":"2024-09-12T01:43:10.003872+0000","last_became_peered":"2024-09-12T01:43:10.003872+0000","last_unstale":"2024-09-12T01:43:11.964782+0000","last_undegraded":"2024-09-12T01:43:11.964782+0000","last_fullsized":"2024-09-12T01:43:11.964782+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:04.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964210+0000","last_change":"2024-09-12T01:43:09.002404+0000","last_active":"2024-09-12T01:43:11.964210+0000","last_peered":"2024-09-12T01:43:11.964210+0000","last_clean":"2024-09-12T01:43:11.964210+0000","last_became_active":"2024-09-12T01:43:09.001771+0000","last_became_peered":"2024-09-12T01:43:09.001771+0000","last_unstale":"2024-09-12T01:43:11.964210+0000","last_undegraded":"2024-09-12T01:43:11.964210+0000","last_fullsized":"2024-09-12T01:43:11.964210+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:17.856167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.963704+0000","last_change":"2024-09-12T01:43:10.018067+0000","last_active":"2024-09-12T01:43:11.963704+0000","last_peered":"2024-09-12T01:43:11.963704+0000","last_clean":"2024-09-12T01:43:11.963704+0000","last_became_active":"2024-09-12T01:43:10.017807+0000","last_became_peered":"2024-09-12T01:43:10.017807+0000","last_unstale":"2024-09-12T01:43:11.963704+0000","last_undegraded":"2024-09-12T01:43:11.963704+0000","last_fullsized":"2024-09-12T01:43:11.963704+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:38.468903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000895+0000","last_change":"2024-09-12T01:43:09.005613+0000","last_active":"2024-09-12T01:43:11.000895+0000","last_peered":"2024-09-12T01:43:11.000895+0000","last_clean":"2024-09-12T01:43:11.000895+0000","last_became_active":"2024-09-12T01:43:09.005273+0000","last_became_peered":"2024-09-12T01:43:09.005273+0000","last_unstale":"2024-09-12T01:43:11.000895+0000","last_undegraded":"2024-09-12T01:43:11.000895+0000","last_fullsized":"2024-09-12T01:43:11.000895+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:13.562581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385311+0000","last_change":"2024-09-12T01:43:10.012096+0000","last_active":"2024-09-12T01:43:11.385311+0000","last_peered":"2024-09-12T01:43:11.385311+0000","last_clean":"2024-09-12T01:43:11.385311+0000","last_became_active":"2024-09-12T01:43:10.011810+0000","last_became_peered":"2024-09-12T01:43:10.011810+0000","last_unstale":"2024-09-12T01:43:11.385311+0000","last_undegraded":"2024-09-12T01:43:11.385311+0000","last_fullsized":"2024-09-12T01:43:11.385311+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:43.359785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":14,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.385563+0000","last_change":"2024-09-12T01:43:09.001024+0000","last_active":"2024-09-12T01:43:11.385563+0000","last_peered":"2024-09-12T01:43:11.385563+0000","last_clean":"2024-09-12T01:43:11.385563+0000","last_became_active":"2024-09-12T01:43:09.000634+0000","last_became_peered":"2024-09-12T01:43:09.000634+0000","last_unstale":"2024-09-12T01:43:11.385563+0000","last_undegraded":"2024-09-12T01:43:11.385563+0000","last_fullsized":"2024-09-12T01:43:11.385563+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:30.008018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":12,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964137+0000","last_change":"2024-09-12T01:43:09.995813+0000","last_active":"2024-09-12T01:43:11.964137+0000","last_peered":"2024-09-12T01:43:11.964137+0000","last_clean":"2024-09-12T01:43:11.964137+0000","last_became_active":"2024-09-12T01:43:09.995491+0000","last_became_peered":"2024-09-12T01:43:09.995491+0000","last_unstale":"2024-09-12T01:43:11.964137+0000","last_undegraded":"2024-09-12T01:43:11.964137+0000","last_fullsized":"2024-09-12T01:43:11.964137+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:08.976766+0000","last_clean_scrub_stamp":"2024-09-12T01:43:08.976766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:33:38.657208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"116'2","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.964913+0000","last_change":"2024-09-12T01:43:09.000595+0000","last_active":"2024-09-12T01:43:11.964913+0000","last_peered":"2024-09-12T01:43:11.964913+0000","last_clean":"2024-09-12T01:43:11.964913+0000","last_became_active":"2024-09-12T01:43:09.000302+0000","last_became_peered":"2024-09-12T01:43:09.000302+0000","last_unstale":"2024-09-12T01:43:11.964913+0000","last_undegraded":"2024-09-12T01:43:11.964913+0000","last_fullsized":"2024-09-12T01:43:11.964913+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:07.971297+0000","last_clean_scrub_stamp":"2024-09-12T01:43:07.971297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:41.886774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":347,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-12T01:43:11.000466+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:43:11.000466+0000","last_peered":"2024-09-12T01:43:11.000466+0000","last_clean":"2024-09-12T01:43:11.000466+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:43:11.000466+0000","last_undegraded":"2024-09-12T01:43:11.000466+0000","last_fullsized":"2024-09-12T01:43:11.000466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509535,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1458176,"data_stored":620412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509533,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36768,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335072,"statfs":{"total":96636764160,"available":96599113728,"internally_reserved":0,"allocated":1454080,"data_stored":620378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509533,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33208,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338632,"statfs":{"total":96636764160,"available":96602759168,"internally_reserved":0,"allocated":2060288,"data_stored":1211488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509533,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36772,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335068,"statfs":{"total":96636764160,"available":96599109632,"internally_reserved":0,"allocated":1458176,"data_stored":620448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509533,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36784,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335056,"statfs":{"total":96636764160,"available":96599097344,"internally_reserved":0,"allocated":1462272,"data_stored":621050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509533,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37368,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334472,"statfs":{"total":96636764160,"available":96598499328,"internally_reserved":0,"allocated":2064384,"data_stored":1212380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509534,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36788,"kb_used_data":1440,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335052,"statfs":{"total":96636764160,"available":96599093248,"internally_reserved":0,"allocated":1474560,"data_stored":622046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1454080,"data_stored":620378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:43:17.726 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:43:17.726 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:43:17.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.871+0000 7f181a21e640 1 Processor -- start 2024-09-12T01:43:17.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.871+0000 7f181a21e640 1 -- start start 2024-09-12T01:43:17.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.872+0000 7f181a21e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f181415e7a0 0x7f181406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.872+0000 7f181a21e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18140cf1f0 0x7f18140b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.872+0000 7f181a21e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18140cf860 con 0x7f18140b6720 2024-09-12T01:43:17.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.872+0000 7f181a21e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f18140b6b90 con 0x7f18140cf1f0 2024-09-12T01:43:17.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.872+0000 7f181a21e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f18140d2ca0 con 0x7f181415e7a0 2024-09-12T01:43:17.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.872+0000 7f1812ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18140cf1f0 0x7f18140b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.872+0000 7f1812ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18140cf1f0 0x7f18140b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53446/0 (socket says 172.21.15.60:53446) 2024-09-12T01:43:17.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.872+0000 7f1812ffd640 1 -- 172.21.15.60:0/559116786 learned_addr learned my addr 172.21.15.60:0/559116786 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:17.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.873+0000 7f18137fe640 1 --2- 172.21.15.60:0/559116786 >> v2:172.21.15.105:3300/0 conn(0x7f181415e7a0 0x7f181406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.873+0000 7f1812ffd640 1 -- 172.21.15.60:0/559116786 >> v2:172.21.15.105:3300/0 conn(0x7f181415e7a0 msgr2=0x7f181406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:17.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.873+0000 7f1812ffd640 1 --2- 172.21.15.60:0/559116786 >> v2:172.21.15.105:3300/0 conn(0x7f181415e7a0 0x7f181406caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.873+0000 7f1812ffd640 1 -- 172.21.15.60:0/559116786 >> v1:172.21.15.105:6789/0 conn(0x7f18140b6720 legacy=0x7f18141623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.873+0000 7f1812ffd640 1 -- 172.21.15.60:0/559116786 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18140cfb40 con 0x7f18140cf1f0 2024-09-12T01:43:17.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.873+0000 7f18137fe640 1 --2- 172.21.15.60:0/559116786 >> v2:172.21.15.105:3300/0 conn(0x7f181415e7a0 0x7f181406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:17.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.873+0000 7f1812ffd640 1 --2- 172.21.15.60:0/559116786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18140cf1f0 0x7f18140b61e0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f18140d5820 tx=0x7f180802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b23b5619e4e003 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:17.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.874+0000 7f18127fc640 1 -- 172.21.15.60:0/559116786 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808037070 con 0x7f18140cf1f0 2024-09-12T01:43:17.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.874+0000 7f18127fc640 1 -- 172.21.15.60:0/559116786 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1808032440 con 0x7f18140cf1f0 2024-09-12T01:43:17.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.874+0000 7f18127fc640 1 -- 172.21.15.60:0/559116786 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808032810 con 0x7f18140cf1f0 2024-09-12T01:43:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.874+0000 7f181a21e640 1 -- 172.21.15.60:0/559116786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18140cf1f0 msgr2=0x7f18140b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.874+0000 7f181a21e640 1 --2- 172.21.15.60:0/559116786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18140cf1f0 0x7f18140b61e0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f18140d5820 tx=0x7f180802a1e0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.874+0000 7f181a21e640 1 -- 172.21.15.60:0/559116786 shutdown_connections 2024-09-12T01:43:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.874+0000 7f181a21e640 1 --2- 172.21.15.60:0/559116786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18140cf1f0 0x7f18140b61e0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.874+0000 7f181a21e640 1 --2- 172.21.15.60:0/559116786 >> v2:172.21.15.105:3300/0 conn(0x7f181415e7a0 0x7f181406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.874+0000 7f181a21e640 1 -- 172.21.15.60:0/559116786 >> 172.21.15.60:0/559116786 conn(0x7f18140d11e0 msgr2=0x7f18140d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:17.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.874+0000 7f181a21e640 1 -- 172.21.15.60:0/559116786 shutdown_connections 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.874+0000 7f181a21e640 1 -- 172.21.15.60:0/559116786 wait complete. 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.875+0000 7f181a21e640 1 Processor -- start 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.876+0000 7f181a21e640 1 -- start start 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.876+0000 7f181a21e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18140b6720 0x7f18140c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.876+0000 7f181a21e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18140cf1f0 0x7f18141e8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.876+0000 7f181a21e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f181415e7a0 0x7f18140c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.876+0000 7f181a21e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f18140b7a00 con 0x7f18140b6720 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.876+0000 7f181a21e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f18140d2ef0 con 0x7f18140cf1f0 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.876+0000 7f181a21e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f181406cfe0 con 0x7f181415e7a0 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.876+0000 7f18137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18140b6720 0x7f18140c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.876+0000 7f18137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18140b6720 0x7f18140c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53452/0 (socket says 172.21.15.60:53452) 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.876+0000 7f18137fe640 1 -- 172.21.15.60:0/3070329414 learned_addr learned my addr 172.21.15.60:0/3070329414 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:17.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f1812ffd640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18140cf1f0 0x7f18141e8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f1813fff640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f181415e7a0 0x7f18140c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f18137fe640 1 -- 172.21.15.60:0/3070329414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f181415e7a0 msgr2=0x7f18140c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f18137fe640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f181415e7a0 0x7f18140c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f18137fe640 1 -- 172.21.15.60:0/3070329414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18140cf1f0 msgr2=0x7f18141e8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f18137fe640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18140cf1f0 0x7f18141e8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f18137fe640 1 -- 172.21.15.60:0/3070329414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18141e9590 con 0x7f18140b6720 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f1812ffd640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18140cf1f0 0x7f18141e8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f18137fe640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18140b6720 0x7f18140c77e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f180400e7e0 tx=0x7f180400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f17fbfff640 1 -- 172.21.15.60:0/3070329414 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180400f040 con 0x7f18140b6720 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f17fbfff640 1 -- 172.21.15.60:0/3070329414 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1804004030 con 0x7f18140b6720 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f181a21e640 1 -- 172.21.15.60:0/3070329414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18141e9870 con 0x7f18140b6720 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f17fbfff640 1 -- 172.21.15.60:0/3070329414 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1804004400 con 0x7f18140b6720 2024-09-12T01:43:17.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.877+0000 7f181a21e640 1 -- 172.21.15.60:0/3070329414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18140cc700 con 0x7f18140b6720 2024-09-12T01:43:17.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.878+0000 7f181a21e640 1 -- 172.21.15.60:0/3070329414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181415eb80 con 0x7f18140b6720 2024-09-12T01:43:17.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.879+0000 7f17fbfff640 1 -- 172.21.15.60:0/3070329414 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f180400c6d0 con 0x7f18140b6720 2024-09-12T01:43:17.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.879+0000 7f17fbfff640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f180006be30 0x7f180006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:17.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.879+0000 7f17fbfff640 1 -- 172.21.15.60:0/3070329414 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f180408ac90 con 0x7f18140b6720 2024-09-12T01:43:17.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.879+0000 7f1812ffd640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f180006be30 0x7f180006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:17.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.880+0000 7f1812ffd640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f180006be30 0x7f180006e2f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1808034000 tx=0x7f180802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:17.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:17.883+0000 7f17fbfff640 1 -- 172.21.15.60:0/3070329414 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1804017020 con 0x7f18140b6720 2024-09-12T01:43:18.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.127+0000 7f181a21e640 1 -- 172.21.15.60:0/3070329414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f18140d2a80 con 0x7f18140b6720 2024-09-12T01:43:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.129+0000 7f17fbfff640 1 -- 172.21.15.60:0/3070329414 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) ==== 190+0+147 (secure 0 0 0) 0x7f1804059640 con 0x7f18140b6720 2024-09-12T01:43:18.130 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-12T01:43:18.130 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ== 2024-09-12T01:43:18.130 INFO:teuthology.orchestra.run.smithi060.stdout: caps mds = "allow" 2024-09-12T01:43:18.130 INFO:teuthology.orchestra.run.smithi060.stdout: caps mon = "allow r" 2024-09-12T01:43:18.130 INFO:teuthology.orchestra.run.smithi060.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:43:18.130 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2024-09-12T01:43:18.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.131+0000 7f181a21e640 1 -- 172.21.15.60:0/3070329414 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f180006be30 msgr2=0x7f180006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:18.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.131+0000 7f181a21e640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f180006be30 0x7f180006e2f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1808034000 tx=0x7f180802e000 comp rx=0 tx=0).stop 2024-09-12T01:43:18.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.131+0000 7f181a21e640 1 -- 172.21.15.60:0/3070329414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18140b6720 msgr2=0x7f18140c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:18.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.131+0000 7f181a21e640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18140b6720 0x7f18140c77e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f180400e7e0 tx=0x7f180400eca0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.131+0000 7f181a21e640 1 -- 172.21.15.60:0/3070329414 shutdown_connections 2024-09-12T01:43:18.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.131+0000 7f181a21e640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f180006be30 0x7f180006e2f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.131+0000 7f181a21e640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f181415e7a0 0x7f18140c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.131+0000 7f181a21e640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f18140cf1f0 0x7f18141e8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.131+0000 7f181a21e640 1 --2- 172.21.15.60:0/3070329414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18140b6720 0x7f18140c77e0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.131+0000 7f181a21e640 1 -- 172.21.15.60:0/3070329414 >> 172.21.15.60:0/3070329414 conn(0x7f18140d11e0 msgr2=0x7f181406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.131+0000 7f181a21e640 1 -- 172.21.15.60:0/3070329414 shutdown_connections 2024-09-12T01:43:18.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.131+0000 7f181a21e640 1 -- 172.21.15.60:0/3070329414 wait complete. 2024-09-12T01:43:18.143 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:43:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.244+0000 7fd39fdfd640 1 Processor -- start 2024-09-12T01:43:18.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.244+0000 7fd39fdfd640 1 -- start start 2024-09-12T01:43:18.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.245+0000 7fd39fdfd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd39815c170 0x7fd39815c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.245+0000 7fd39fdfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3980b64e0 0x7fd3980cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.245+0000 7fd39fdfd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3980b4cf0 con 0x7fd3980cf6c0 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.245+0000 7fd39fdfd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd39815ca90 con 0x7fd39815c170 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.245+0000 7fd39fdfd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd3980b49c0 con 0x7fd3980b64e0 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.245+0000 7fd39db99640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd39815c170 0x7fd39815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.245+0000 7fd39e39a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3980b64e0 0x7fd3980cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.245+0000 7fd39db99640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd39815c170 0x7fd39815c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:32888/0 (socket says 172.21.15.60:32888) 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.245+0000 7fd39db99640 1 -- 172.21.15.60:0/2971980675 learned_addr learned my addr 172.21.15.60:0/2971980675 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.246+0000 7fd39e39a640 1 -- 172.21.15.60:0/2971980675 >> v2:172.21.15.105:3300/0 conn(0x7fd39815c170 msgr2=0x7fd39815c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.246+0000 7fd39e39a640 1 --2- 172.21.15.60:0/2971980675 >> v2:172.21.15.105:3300/0 conn(0x7fd39815c170 0x7fd39815c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.246+0000 7fd39e39a640 1 -- 172.21.15.60:0/2971980675 >> v1:172.21.15.105:6789/0 conn(0x7fd3980cf6c0 legacy=0x7fd3980b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.246+0000 7fd39cb97640 1 -- 172.21.15.60:0/2971980675 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3634665414 0 0) 0x7fd3980b4cf0 con 0x7fd3980cf6c0 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.246+0000 7fd39e39a640 1 -- 172.21.15.60:0/2971980675 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3980b4fd0 con 0x7fd3980b64e0 2024-09-12T01:43:18.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.246+0000 7fd39db99640 1 --2- 172.21.15.60:0/2971980675 >> v2:172.21.15.105:3300/0 conn(0x7fd39815c170 0x7fd39815c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:18.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.247+0000 7fd39e39a640 1 --2- 172.21.15.60:0/2971980675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3980b64e0 0x7fd3980cfb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd390009dc0 tx=0x7fd39002a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e8c0fd86099b540 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:18.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.247+0000 7fd39cb97640 1 -- 172.21.15.60:0/2971980675 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd39002ae60 con 0x7fd3980b64e0 2024-09-12T01:43:18.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.247+0000 7fd39cb97640 1 -- 172.21.15.60:0/2971980675 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd390007740 con 0x7fd3980b64e0 2024-09-12T01:43:18.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.247+0000 7fd39cb97640 1 -- 172.21.15.60:0/2971980675 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd390007b10 con 0x7fd3980b64e0 2024-09-12T01:43:18.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.247+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2971980675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3980b64e0 msgr2=0x7fd3980cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:18.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.247+0000 7fd39fdfd640 1 --2- 172.21.15.60:0/2971980675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3980b64e0 0x7fd3980cfb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd390009dc0 tx=0x7fd39002a680 comp rx=0 tx=0).stop 2024-09-12T01:43:18.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.247+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2971980675 shutdown_connections 2024-09-12T01:43:18.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.247+0000 7fd39fdfd640 1 --2- 172.21.15.60:0/2971980675 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3980b64e0 0x7fd3980cfb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.247+0000 7fd39fdfd640 1 --2- 172.21.15.60:0/2971980675 >> v2:172.21.15.105:3300/0 conn(0x7fd39815c170 0x7fd39815c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.247+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2971980675 >> 172.21.15.60:0/2971980675 conn(0x7fd39806bc10 msgr2=0x7fd39806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:18.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.247+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2971980675 shutdown_connections 2024-09-12T01:43:18.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.247+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2971980675 wait complete. 2024-09-12T01:43:18.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.248+0000 7fd39fdfd640 1 Processor -- start 2024-09-12T01:43:18.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.249+0000 7fd39fdfd640 1 -- start start 2024-09-12T01:43:18.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.249+0000 7fd39fdfd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3980b64e0 0x7fd3981f4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.249+0000 7fd39fdfd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3980cf6c0 0x7fd3980cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.249+0000 7fd39fdfd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd39815c170 0x7fd39815ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.249+0000 7fd39fdfd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd3980b5870 con 0x7fd39815c170 2024-09-12T01:43:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.249+0000 7fd39fdfd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd3980b5590 con 0x7fd3980cf6c0 2024-09-12T01:43:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.249+0000 7fd39fdfd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd3980b5b50 con 0x7fd3980b64e0 2024-09-12T01:43:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.249+0000 7fd39e39a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd39815c170 0x7fd39815ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.249+0000 7fd39e39a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd39815c170 0x7fd39815ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53468/0 (socket says 172.21.15.60:53468) 2024-09-12T01:43:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.249+0000 7fd39e39a640 1 -- 172.21.15.60:0/2532159797 learned_addr learned my addr 172.21.15.60:0/2532159797 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd39db99640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3980b64e0 0x7fd3981f4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd39d398640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3980cf6c0 0x7fd3980cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd39e39a640 1 -- 172.21.15.60:0/2532159797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3980b64e0 msgr2=0x7fd3981f4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:18.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd39e39a640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3980b64e0 0x7fd3981f4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd39e39a640 1 -- 172.21.15.60:0/2532159797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3980cf6c0 msgr2=0x7fd3980cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd39e39a640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3980cf6c0 0x7fd3980cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd39e39a640 1 -- 172.21.15.60:0/2532159797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd39814c320 con 0x7fd39815c170 2024-09-12T01:43:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd39db99640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3980b64e0 0x7fd3981f4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd39d398640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3980cf6c0 0x7fd3980cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd39e39a640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd39815c170 0x7fd39815ebc0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fd390009dc0 tx=0x7fd390004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd38e7fc640 1 -- 172.21.15.60:0/2532159797 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd390040070 con 0x7fd39815c170 2024-09-12T01:43:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd38e7fc640 1 -- 172.21.15.60:0/2532159797 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd390031a40 con 0x7fd39815c170 2024-09-12T01:43:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2532159797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd39815f830 con 0x7fd39815c170 2024-09-12T01:43:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd38e7fc640 1 -- 172.21.15.60:0/2532159797 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd390009450 con 0x7fd39815c170 2024-09-12T01:43:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.250+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2532159797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3980cd440 con 0x7fd39815c170 2024-09-12T01:43:18.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.251+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2532159797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3980cfb30 con 0x7fd39815c170 2024-09-12T01:43:18.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.252+0000 7fd38e7fc640 1 -- 172.21.15.60:0/2532159797 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd390039040 con 0x7fd39815c170 2024-09-12T01:43:18.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.252+0000 7fd38e7fc640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd37c06be30 0x7fd37c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.252+0000 7fd38e7fc640 1 -- 172.21.15.60:0/2532159797 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7fd3900abb40 con 0x7fd39815c170 2024-09-12T01:43:18.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.252+0000 7fd39db99640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd37c06be30 0x7fd37c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.253+0000 7fd39db99640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd37c06be30 0x7fd37c06e2f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd394009a20 tx=0x7fd394008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:18.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.257+0000 7fd38e7fc640 1 -- 172.21.15.60:0/2532159797 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd39007a460 con 0x7fd39815c170 2024-09-12T01:43:18.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.466+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2532159797 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd39815fbc0 con 0x7fd39815c170 2024-09-12T01:43:18.467 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.466+0000 7fd38e7fc640 1 -- 172.21.15.60:0/2532159797 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7fd390079d60 con 0x7fd39815c170 2024-09-12T01:43:18.467 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:18.467 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":69,"btime":"2024-09-12T01:43:11:998781+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2206957364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2206957364},{"type":"v1","addr":"172.21.15.105:6835","nonce":2206957364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7536,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3802062072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3802062072},{"type":"v1","addr":"172.21.15.60:6836","nonce":3802062072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3557949323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3557949323},{"type":"v1","addr":"172.21.15.60:6837","nonce":3557949323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:09.348346+0000","modified":"2024-09-12T01:43:11.345257+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/3613656777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3613656777},{"type":"v1","addr":"172.21.15.105:6834","nonce":3613656777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":9}]} 2024-09-12T01:43:18.467 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 69 2024-09-12T01:43:18.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.469+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2532159797 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd37c06be30 msgr2=0x7fd37c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.469+0000 7fd39fdfd640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd37c06be30 0x7fd37c06e2f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd394009a20 tx=0x7fd394008040 comp rx=0 tx=0).stop 2024-09-12T01:43:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.469+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2532159797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd39815c170 msgr2=0x7fd39815ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.469+0000 7fd39fdfd640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd39815c170 0x7fd39815ebc0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fd390009dc0 tx=0x7fd390004a40 comp rx=0 tx=0).stop 2024-09-12T01:43:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.469+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2532159797 shutdown_connections 2024-09-12T01:43:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.469+0000 7fd39fdfd640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd39815c170 0x7fd39815ebc0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.469+0000 7fd39fdfd640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd3980cf6c0 0x7fd3980cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.469+0000 7fd39fdfd640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd37c06be30 0x7fd37c06e2f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.469+0000 7fd39fdfd640 1 --2- 172.21.15.60:0/2532159797 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd3980b64e0 0x7fd3981f4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.469+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2532159797 >> 172.21.15.60:0/2532159797 conn(0x7fd39806bc10 msgr2=0x7fd3980722a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.469+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2532159797 shutdown_connections 2024-09-12T01:43:18.470 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.469+0000 7fd39fdfd640 1 -- 172.21.15.60:0/2532159797 wait complete. 2024-09-12T01:43:18.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:43:09.348346+0000', 'modified': '2024-09-12T01:43:11.345257+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7545}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7545': {'gid': 7545, 'name': 'd', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6834/3613656777', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 3613656777}, {'type': 'v1', 'addr': '172.21.15.105:6834', 'nonce': 3613656777}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7545, 'qdb_cluster': [7545]} 2024-09-12T01:43:18.883 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:43:18.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T01:43:18.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.990+0000 7efea305e640 1 Processor -- start 2024-09-12T01:43:18.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.990+0000 7efea305e640 1 -- start start 2024-09-12T01:43:18.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efea305e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efe9c06fda0 0x7efe9c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efea305e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c0d0fe0 0x7efe9c0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efea305e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe9c0d1540 con 0x7efe9c0d06c0 2024-09-12T01:43:18.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efea305e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efe9c06d810 con 0x7efe9c06fda0 2024-09-12T01:43:18.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efea305e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c06daf0 con 0x7efe9c0d0fe0 2024-09-12T01:43:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efea0dfa640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efe9c0d06c0 0x7efe9c073cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50306/0 (socket says 172.21.15.60:50306) 2024-09-12T01:43:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efea0dfa640 1 -- 172.21.15.60:0/1686394414 learned_addr learned my addr 172.21.15.60:0/1686394414 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efe9bfff640 1 --2- 172.21.15.60:0/1686394414 >> v2:172.21.15.105:3300/0 conn(0x7efe9c06fda0 0x7efe9c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efea15fb640 1 --2- 172.21.15.60:0/1686394414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c0d0fe0 0x7efe9c0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911843803 0 0) 0x7efe9c0d1540 con 0x7efe9c0d06c0 2024-09-12T01:43:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe8c003520 con 0x7efe9c0d06c0 2024-09-12T01:43:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 859499131 0 0) 0x7efe8c003520 con 0x7efe9c0d06c0 2024-09-12T01:43:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c0d0fe0 msgr2=0x7efe9c0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.991+0000 7efe9b7fe640 1 --2- 172.21.15.60:0/1686394414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c0d0fe0 0x7efe9c0b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 >> v2:172.21.15.105:3300/0 conn(0x7efe9c06fda0 msgr2=0x7efe9c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efe9b7fe640 1 --2- 172.21.15.60:0/1686394414 >> v2:172.21.15.105:3300/0 conn(0x7efe9c06fda0 0x7efe9c0d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c06ddd0 con 0x7efe9c0d06c0 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7efe90001670 con 0x7efe9c0d06c0 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 >> v1:172.21.15.60:6789/0 conn(0x7efe9c0d06c0 legacy=0x7efe9c073cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efe9b7fe640 1 --2- 172.21.15.60:0/1686394414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c0039b0 0x7efe8c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efe9b7fe640 1 --2- 172.21.15.60:0/1686394414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c0d0fe0 0x7efe8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efe9b7fe640 1 --2- 172.21.15.60:0/1686394414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe8c004d40 0x7efe8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c06d810 con 0x7efe8c0039b0 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c06daf0 con 0x7efe8c004d40 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efe8c00b9c0 con 0x7efe9c0d0fe0 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efea0dfa640 1 --2- 172.21.15.60:0/1686394414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c0039b0 0x7efe8c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efe9bfff640 1 --2- 172.21.15.60:0/1686394414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c0d0fe0 0x7efe8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efea15fb640 1 --2- 172.21.15.60:0/1686394414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe8c004d40 0x7efe8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efea0dfa640 1 -- 172.21.15.60:0/1686394414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c0d0fe0 msgr2=0x7efe8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efea0dfa640 1 --2- 172.21.15.60:0/1686394414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c0d0fe0 0x7efe8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efea0dfa640 1 -- 172.21.15.60:0/1686394414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe8c004d40 msgr2=0x7efe8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efea0dfa640 1 --2- 172.21.15.60:0/1686394414 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe8c004d40 0x7efe8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.992+0000 7efea0dfa640 1 -- 172.21.15.60:0/1686394414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8c003520 con 0x7efe8c0039b0 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.993+0000 7efea0dfa640 1 --2- 172.21.15.60:0/1686394414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c0039b0 0x7efe8c003dd0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7efe90001050 tx=0x7efe8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1806d44e709de47d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.993+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9002e070 con 0x7efe8c0039b0 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.993+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe90005af0 con 0x7efe8c0039b0 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.993+0000 7efe9b7fe640 1 -- 172.21.15.60:0/1686394414 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe90007d70 con 0x7efe8c0039b0 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.993+0000 7efea305e640 1 -- 172.21.15.60:0/1686394414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c0039b0 msgr2=0x7efe8c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.993+0000 7efea305e640 1 --2- 172.21.15.60:0/1686394414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe8c0039b0 0x7efe8c003dd0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7efe90001050 tx=0x7efe8c005830 comp rx=0 tx=0).stop 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.993+0000 7efea15fb640 1 -- 172.21.15.60:0/1686394414 reap_dead start 2024-09-12T01:43:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.994+0000 7efea305e640 1 -- 172.21.15.60:0/1686394414 shutdown_connections 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.994+0000 7efea305e640 1 -- 172.21.15.60:0/1686394414 >> 172.21.15.60:0/1686394414 conn(0x7efe9c0b7d70 msgr2=0x7efe9c062630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.994+0000 7efea305e640 1 -- 172.21.15.60:0/1686394414 shutdown_connections 2024-09-12T01:43:18.997 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.994+0000 7efea305e640 1 -- 172.21.15.60:0/1686394414 wait complete. 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.995+0000 7efea305e640 1 Processor -- start 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.995+0000 7efea305e640 1 -- start start 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea305e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe8c0039b0 0x7efe9c1e6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea305e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c153930 0x7efe9c154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea305e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe9c143f70 0x7efe9c157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea305e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c0b55e0 con 0x7efe9c143f70 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea305e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c0b5460 con 0x7efe8c0039b0 2024-09-12T01:43:18.999 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea305e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c0b5760 con 0x7efe9c153930 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea15fb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe9c143f70 0x7efe9c157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea15fb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe9c143f70 0x7efe9c157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53488/0 (socket says 172.21.15.60:53488) 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea15fb640 1 -- 172.21.15.60:0/2634351935 learned_addr learned my addr 172.21.15.60:0/2634351935 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea15fb640 1 -- 172.21.15.60:0/2634351935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c153930 msgr2=0x7efe9c154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efe9bfff640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c153930 0x7efe9c154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea0dfa640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe8c0039b0 0x7efe9c1e6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea15fb640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c153930 0x7efe9c154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea15fb640 1 -- 172.21.15.60:0/2634351935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe8c0039b0 msgr2=0x7efe9c1e6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea15fb640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe8c0039b0 0x7efe9c1e6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea15fb640 1 -- 172.21.15.60:0/2634351935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe9c151480 con 0x7efe9c143f70 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efea15fb640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe9c143f70 0x7efe9c157830 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0d1470 tx=0x7efe9400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efe997fa640 1 -- 172.21.15.60:0/2634351935 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94011e90 con 0x7efe9c143f70 2024-09-12T01:43:19.000 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.996+0000 7efe997fa640 1 -- 172.21.15.60:0/2634351935 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe9401c070 con 0x7efe9c143f70 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.997+0000 7efea305e640 1 -- 172.21.15.60:0/2634351935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe9c155460 con 0x7efe9c143f70 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.997+0000 7efe997fa640 1 -- 172.21.15.60:0/2634351935 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94003bd0 con 0x7efe9c143f70 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.997+0000 7efea305e640 1 -- 172.21.15.60:0/2634351935 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe9c154440 con 0x7efe9c143f70 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.998+0000 7efe997fa640 1 -- 172.21.15.60:0/2634351935 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efe94004030 con 0x7efe9c143f70 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.999+0000 7efe997fa640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efe8006bfd0 0x7efe8006e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.999+0000 7efe997fa640 1 -- 172.21.15.60:0/2634351935 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7efe9408b7e0 con 0x7efe9c143f70 2024-09-12T01:43:19.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.999+0000 7efea0dfa640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efe8006bfd0 0x7efe8006e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.999+0000 7efea0dfa640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efe8006bfd0 0x7efe8006e490 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efe90033000 tx=0x7efe90009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:19.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:18.999+0000 7efea5dfe740 1 Processor -- start 2024-09-12T01:43:19.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.000+0000 7efea5dfe740 1 -- start start 2024-09-12T01:43:19.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.000+0000 7efea5dfe740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118a92c0 0x5612118eea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.000+0000 7efea5dfe740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a6a80 0x5612118a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.000+0000 7efea5dfe740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118aaa50 0x5612118a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.000+0000 7efea5dfe740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56121180b520 con 0x5612118a6a80 2024-09-12T01:43:19.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.000+0000 7efea5dfe740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5612117b33e0 con 0x5612118aaa50 2024-09-12T01:43:19.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.000+0000 7efea5dfe740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5612118074e0 con 0x5612118a92c0 2024-09-12T01:43:19.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.000+0000 7efe9bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a6a80 0x5612118a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.000+0000 7efe9bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a6a80 0x5612118a96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53496/0 (socket says 172.21.15.60:53496) 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.000+0000 7efe9bfff640 1 -- 172.21.15.60:0/4060858112 learned_addr learned my addr 172.21.15.60:0/4060858112 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efea0dfa640 1 --2- 172.21.15.60:0/4060858112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118a92c0 0x5612118eea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efea15fb640 1 --2- 172.21.15.60:0/4060858112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118aaa50 0x5612118a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efe9bfff640 1 -- 172.21.15.60:0/4060858112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118a92c0 msgr2=0x5612118eea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efe9bfff640 1 --2- 172.21.15.60:0/4060858112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118a92c0 0x5612118eea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efe9bfff640 1 -- 172.21.15.60:0/4060858112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118aaa50 msgr2=0x5612118a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efe9bfff640 1 --2- 172.21.15.60:0/4060858112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118aaa50 0x5612118a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efe9bfff640 1 -- 172.21.15.60:0/4060858112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612117ce2f0 con 0x5612118a6a80 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efea0dfa640 1 --2- 172.21.15.60:0/4060858112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118a92c0 0x5612118eea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efea15fb640 1 --2- 172.21.15.60:0/4060858112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118aaa50 0x5612118a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efe9bfff640 1 --2- 172.21.15.60:0/4060858112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a6a80 0x5612118a96a0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7efe88009a30 tx=0x7efe88009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369732952697db03 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efe867fc640 1 -- 172.21.15.60:0/4060858112 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8801b070 con 0x5612118a6a80 2024-09-12T01:43:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efe867fc640 1 -- 172.21.15.60:0/4060858112 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe88013bf0 con 0x5612118a6a80 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.001+0000 7efe867fc640 1 -- 172.21.15.60:0/4060858112 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe88016460 con 0x5612118a6a80 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.002+0000 7efea5dfe740 1 -- 172.21.15.60:0/4060858112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a6a80 msgr2=0x5612118a96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.002+0000 7efea5dfe740 1 --2- 172.21.15.60:0/4060858112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a6a80 0x5612118a96a0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7efe88009a30 tx=0x7efe88009190 comp rx=0 tx=0).stop 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.002+0000 7efea5dfe740 1 -- 172.21.15.60:0/4060858112 shutdown_connections 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.002+0000 7efea5dfe740 1 --2- 172.21.15.60:0/4060858112 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118aaa50 0x5612118a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.002+0000 7efea5dfe740 1 --2- 172.21.15.60:0/4060858112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a6a80 0x5612118a96a0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.002+0000 7efea5dfe740 1 --2- 172.21.15.60:0/4060858112 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118a92c0 0x5612118eea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.002+0000 7efea5dfe740 1 -- 172.21.15.60:0/4060858112 >> 172.21.15.60:0/4060858112 conn(0x5612118a5a80 msgr2=0x5612118edf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.002+0000 7efea5dfe740 1 -- 172.21.15.60:0/4060858112 shutdown_connections 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.002+0000 7efea5dfe740 1 -- 172.21.15.60:0/4060858112 wait complete. 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.002+0000 7efea5dfe740 1 -- start start 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.003+0000 7efea5dfe740 1 Processor -- start 2024-09-12T01:43:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.003+0000 7efea5dfe740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a92c0 0x561211902580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.003+0000 7efea5dfe740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118aaa50 0x5612118c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.003+0000 7efea5dfe740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a31b0 0x5612118a3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.003+0000 7efea5dfe740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5612118a4f20 con 0x5612118a31b0 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.003+0000 7efea5dfe740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x561211794450 con 0x5612118a92c0 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.003+0000 7efea5dfe740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5612118ef290 con 0x5612118aaa50 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.003+0000 7efea5dfe740 10 client.0 _ll_register_callbacks cb 0x56121151dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.003+0000 7efea15fb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a31b0 0x5612118a3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.003+0000 7efea15fb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a31b0 0x5612118a3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53512/0 (socket says 172.21.15.60:53512) 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.003+0000 7efea15fb640 1 -- 172.21.15.60:0/3949777258 learned_addr learned my addr 172.21.15.60:0/3949777258 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efe9bfff640 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118aaa50 0x5612118c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efea0dfa640 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a92c0 0x561211902580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efea15fb640 1 -- 172.21.15.60:0/3949777258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118aaa50 msgr2=0x5612118c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efea15fb640 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118aaa50 0x5612118c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efea15fb640 1 -- 172.21.15.60:0/3949777258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a92c0 msgr2=0x561211902580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efea15fb640 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a92c0 0x561211902580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efea15fb640 1 -- 172.21.15.60:0/3949777258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56121151e2d0 con 0x5612118a31b0 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efea15fb640 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a31b0 0x5612118a3630 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7efe94010010 tx=0x7efe9405df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0443c2a5e86ec60 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efe7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efe7b7fe640 1 -- 172.21.15.60:0/3949777258 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94007de0 con 0x5612118a31b0 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efe7b7fe640 1 -- 172.21.15.60:0/3949777258 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7efe94060070 con 0x5612118a31b0 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efea5dfe740 1 -- 172.21.15.60:0/3949777258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe88013bf0 con 0x5612118a31b0 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efe7b7fe640 1 -- 172.21.15.60:0/3949777258 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7efe94057e50 con 0x5612118a31b0 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efea5dfe740 10 client.7695 fetch_fsmap learned FSMap version 69 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efea5dfe740 1 -- 172.21.15.60:0/3949777258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x5612115e86b0 con 0x5612118a31b0 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efe7b7fe640 1 -- 172.21.15.60:0/3949777258 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe88013bf0 con 0x5612118a31b0 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.004+0000 7efe7b7fe640 1 -- 172.21.15.60:0/3949777258 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7efe94058ee0 con 0x5612118a31b0 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.005+0000 7efea5dfe740 10 client.7695 fetch_fsmap finished waiting for FSMap version 69 2024-09-12T01:43:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.005+0000 7efea5dfe740 10 client.7695 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:43:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.005+0000 7efea5dfe740 20 client.7695 populate_metadata read hostname 'smithi060' 2024-09-12T01:43:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.005+0000 7efea5dfe740 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.105:6832/3613656777,v1:172.21.15.105:6834/3613656777] conn(0x5612118f3ea0 0x5612118f4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.005+0000 7efea5dfe740 4 client.7695 mds_command: new command op to 7545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:43:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.005+0000 7efea5dfe740 1 -- 172.21.15.60:0/3949777258 --> [v2:172.21.15.105:6832/3613656777,v1:172.21.15.105:6834/3613656777] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561211818c50 con 0x5612118f3ea0 2024-09-12T01:43:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.005+0000 7efea0dfa640 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.105:6832/3613656777,v1:172.21.15.105:6834/3613656777] conn(0x5612118f3ea0 0x5612118f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.005+0000 7efe7b7fe640 10 client.7695 ms_handle_connect on v2:172.21.15.105:6832/3613656777 2024-09-12T01:43:19.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.005+0000 7efea0dfa640 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.105:6832/3613656777,v1:172.21.15.105:6834/3613656777] conn(0x5612118f3ea0 0x5612118f4280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=393deb8abb6ef532 server_cookie=d28af9b6f9f83c5a in_seq=0 out_seq=0 2024-09-12T01:43:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efe7b7fe640 1 -- 172.21.15.60:0/3949777258 <== mds.0 v2:172.21.15.105:6832/3613656777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561211818c50 con 0x5612118f3ea0 2024-09-12T01:43:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efe7b7fe640 10 client.7695 handle_command_reply: tid=0 2024-09-12T01:43:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efea5dfe740 1 client.7695 shutdown 2024-09-12T01:43:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efea5dfe740 1 -- 172.21.15.60:0/3949777258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a31b0 msgr2=0x5612118a3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efea5dfe740 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a31b0 0x5612118a3630 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7efe94010010 tx=0x7efe9405df00 comp rx=0 tx=0).stop 2024-09-12T01:43:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efea5dfe740 1 -- 172.21.15.60:0/3949777258 shutdown_connections 2024-09-12T01:43:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efea5dfe740 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.105:6832/3613656777,v1:172.21.15.105:6834/3613656777] conn(0x5612118f3ea0 0x5612118f4280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efea5dfe740 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a31b0 0x5612118a3630 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efea5dfe740 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118aaa50 0x5612118c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efea5dfe740 1 --2- 172.21.15.60:0/3949777258 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a92c0 0x561211902580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efe7b7fe640 0 client.7695 ms_handle_reset on v2:172.21.15.105:6832/3613656777 2024-09-12T01:43:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efea5dfe740 1 -- 172.21.15.60:0/3949777258 >> 172.21.15.60:0/3949777258 conn(0x5612118a6a80 msgr2=0x5612118f1440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efea5dfe740 1 -- 172.21.15.60:0/3949777258 shutdown_connections 2024-09-12T01:43:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efea5dfe740 1 -- 172.21.15.60:0/3949777258 wait complete. 2024-09-12T01:43:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.006+0000 7efea5dfe740 20 client.7695 trim_cache size 0 max 16384 2024-09-12T01:43:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.025+0000 7efea5dfe740 1 Processor -- start 2024-09-12T01:43:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.025+0000 7efea5dfe740 1 -- start start 2024-09-12T01:43:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.025+0000 7efea5dfe740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a31b0 0x5612118ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.025+0000 7efea5dfe740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118a92c0 0x5612118ebee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.025+0000 7efea5dfe740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118aaa50 0x5612118ec420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.025+0000 7efea5dfe740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c200230 con 0x5612118aaa50 2024-09-12T01:43:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea5dfe740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efe9c152ac0 con 0x5612118a31b0 2024-09-12T01:43:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea5dfe740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efe9c1ffc40 con 0x5612118a92c0 2024-09-12T01:43:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea15fb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118aaa50 0x5612118ec420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea15fb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118aaa50 0x5612118ec420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53534/0 (socket says 172.21.15.60:53534) 2024-09-12T01:43:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea15fb640 1 -- 172.21.15.60:0/2878632321 learned_addr learned my addr 172.21.15.60:0/2878632321 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efe9bfff640 1 --2- 172.21.15.60:0/2878632321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118a92c0 0x5612118ebee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea0dfa640 1 --2- 172.21.15.60:0/2878632321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a31b0 0x5612118ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea15fb640 1 -- 172.21.15.60:0/2878632321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118a92c0 msgr2=0x5612118ebee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea15fb640 1 --2- 172.21.15.60:0/2878632321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118a92c0 0x5612118ebee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea15fb640 1 -- 172.21.15.60:0/2878632321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a31b0 msgr2=0x5612118ee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea15fb640 1 --2- 172.21.15.60:0/2878632321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a31b0 0x5612118ee0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea15fb640 1 -- 172.21.15.60:0/2878632321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612118d31c0 con 0x5612118aaa50 2024-09-12T01:43:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efe9bfff640 1 --2- 172.21.15.60:0/2878632321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118a92c0 0x5612118ebee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:19.028 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea0dfa640 1 --2- 172.21.15.60:0/2878632321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a31b0 0x5612118ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:19.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efea15fb640 1 --2- 172.21.15.60:0/2878632321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118aaa50 0x5612118ec420 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7efe94059790 tx=0x7efe9405d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4bb0861d37521d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:19.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efe85ffb640 1 -- 172.21.15.60:0/2878632321 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94060380 con 0x5612118aaa50 2024-09-12T01:43:19.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efe85ffb640 1 -- 172.21.15.60:0/2878632321 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe9405a190 con 0x5612118aaa50 2024-09-12T01:43:19.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.026+0000 7efe85ffb640 1 -- 172.21.15.60:0/2878632321 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe94062670 con 0x5612118aaa50 2024-09-12T01:43:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.027+0000 7efea5dfe740 1 -- 172.21.15.60:0/2878632321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118aaa50 msgr2=0x5612118ec420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.027+0000 7efea5dfe740 1 --2- 172.21.15.60:0/2878632321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118aaa50 0x5612118ec420 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7efe94059790 tx=0x7efe9405d000 comp rx=0 tx=0).stop 2024-09-12T01:43:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.027+0000 7efea5dfe740 1 -- 172.21.15.60:0/2878632321 shutdown_connections 2024-09-12T01:43:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.027+0000 7efea5dfe740 1 --2- 172.21.15.60:0/2878632321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118aaa50 0x5612118ec420 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.027+0000 7efea5dfe740 1 --2- 172.21.15.60:0/2878632321 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118a92c0 0x5612118ebee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.027+0000 7efea5dfe740 1 --2- 172.21.15.60:0/2878632321 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a31b0 0x5612118ee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.027+0000 7efea5dfe740 1 -- 172.21.15.60:0/2878632321 >> 172.21.15.60:0/2878632321 conn(0x5612118a6a80 msgr2=0x5612118a28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.027+0000 7efea5dfe740 1 -- 172.21.15.60:0/2878632321 shutdown_connections 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.027+0000 7efea5dfe740 1 -- 172.21.15.60:0/2878632321 wait complete. 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.027+0000 7efea5dfe740 1 -- start start 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.028+0000 7efea5dfe740 1 Processor -- start 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.028+0000 7efea5dfe740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a31b0 0x561211907b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.028+0000 7efea5dfe740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a92c0 0x5612119124c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.028+0000 7efea5dfe740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118aaa50 0x5612119555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.028+0000 7efea5dfe740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5612118d22e0 con 0x5612118a92c0 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.028+0000 7efea5dfe740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5612118d1d40 con 0x5612118a31b0 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.028+0000 7efea5dfe740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5612118f2ad0 con 0x5612118aaa50 2024-09-12T01:43:19.034 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efea5dfe740 10 client.0 _ll_register_callbacks cb 0x7efe940598e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe9bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a92c0 0x5612119124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe9bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a92c0 0x5612119124c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53536/0 (socket says 172.21.15.60:53536) 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe9bfff640 1 -- 172.21.15.60:0/414554874 learned_addr learned my addr 172.21.15.60:0/414554874 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efea0dfa640 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a31b0 0x561211907b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efea15fb640 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118aaa50 0x5612119555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe9bfff640 1 -- 172.21.15.60:0/414554874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118aaa50 msgr2=0x5612119555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe9bfff640 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118aaa50 0x5612119555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe9bfff640 1 -- 172.21.15.60:0/414554874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a31b0 msgr2=0x561211907b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe9bfff640 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a31b0 0x561211907b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe9bfff640 1 -- 172.21.15.60:0/414554874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561211970d90 con 0x5612118a92c0 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe9bfff640 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a92c0 0x5612119124c0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7efe8801a000 tx=0x7efe880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ccac0c9f377b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:43:19.035 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe7b7fe640 1 -- 172.21.15.60:0/414554874 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe8801b040 con 0x5612118a92c0 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe7b7fe640 1 -- 172.21.15.60:0/414554874 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7efe88004250 con 0x5612118a92c0 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efea5dfe740 1 -- 172.21.15.60:0/414554874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe9405a190 con 0x5612118a92c0 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efe7b7fe640 1 -- 172.21.15.60:0/414554874 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7efe88004450 con 0x5612118a92c0 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.029+0000 7efea5dfe740 10 client.7701 fetch_fsmap learned FSMap version 69 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.030+0000 7efea5dfe740 1 -- 172.21.15.60:0/414554874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) -- 0x5612118ea390 con 0x5612118a92c0 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.030+0000 7efe7b7fe640 1 -- 172.21.15.60:0/414554874 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe9405a190 con 0x5612118a92c0 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.030+0000 7efe7b7fe640 1 -- 172.21.15.60:0/414554874 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 69) ==== 3502+0+0 (secure 0 0 0) 0x7efe88003610 con 0x5612118a92c0 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.030+0000 7efea5dfe740 10 client.7701 fetch_fsmap finished waiting for FSMap version 69 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.030+0000 7efea5dfe740 10 client.7701 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.030+0000 7efea5dfe740 20 client.7701 populate_metadata read hostname 'smithi060' 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.030+0000 7efea5dfe740 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.105:6832/3613656777,v1:172.21.15.105:6834/3613656777] conn(0x56121196d5c0 0x561211911050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.030+0000 7efea5dfe740 4 client.7701 mds_command: new command op to 7545 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:43:19.036 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.030+0000 7efea5dfe740 1 -- 172.21.15.60:0/414554874 --> [v2:172.21.15.105:6832/3613656777,v1:172.21.15.105:6834/3613656777] -- command(tid 0: {"prefix": "status"}) -- 0x561211812fa0 con 0x56121196d5c0 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.030+0000 7efea0dfa640 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.105:6832/3613656777,v1:172.21.15.105:6834/3613656777] conn(0x56121196d5c0 0x561211911050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.030+0000 7efe7b7fe640 10 client.7701 ms_handle_connect on v2:172.21.15.105:6832/3613656777 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.030+0000 7efea0dfa640 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.105:6832/3613656777,v1:172.21.15.105:6834/3613656777] conn(0x56121196d5c0 0x561211911050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bcfa868cd34c788 server_cookie=7c125aa741b3b26e in_seq=0 out_seq=0 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efe7b7fe640 1 -- 172.21.15.60:0/414554874 <== mds.0 v2:172.21.15.105:6832/3613656777 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x561211812fa0 con 0x56121196d5c0 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efe7b7fe640 10 client.7701 handle_command_reply: tid=0 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efea5dfe740 1 client.7701 shutdown 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efea5dfe740 1 -- 172.21.15.60:0/414554874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a92c0 msgr2=0x5612119124c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efea5dfe740 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a92c0 0x5612119124c0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7efe8801a000 tx=0x7efe880046c0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efea5dfe740 1 -- 172.21.15.60:0/414554874 shutdown_connections 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efea5dfe740 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.105:6832/3613656777,v1:172.21.15.105:6834/3613656777] conn(0x56121196d5c0 0x561211911050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efea5dfe740 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5612118aaa50 0x5612119555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efea5dfe740 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5612118a92c0 0x5612119124c0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.037 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efea5dfe740 1 --2- 172.21.15.60:0/414554874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5612118a31b0 0x561211907b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efe7b7fe640 0 client.7701 ms_handle_reset on v2:172.21.15.105:6832/3613656777 2024-09-12T01:43:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efea5dfe740 1 -- 172.21.15.60:0/414554874 >> 172.21.15.60:0/414554874 conn(0x5612118a6a80 msgr2=0x5612118a41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efea5dfe740 1 -- 172.21.15.60:0/414554874 shutdown_connections 2024-09-12T01:43:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efea5dfe740 1 -- 172.21.15.60:0/414554874 wait complete. 2024-09-12T01:43:19.038 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.031+0000 7efea5dfe740 20 client.7701 trim_cache size 0 max 16384 2024-09-12T01:43:19.038 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:43:19.038 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "5401bd8a-3492-4b21-b6c0-d6616ff39793", 2024-09-12T01:43:19.038 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T01:43:19.038 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 7545, 2024-09-12T01:43:19.039 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T01:43:19.039 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T01:43:19.039 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-12T01:43:19.039 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 9.0479400190000003, 2024-09-12T01:43:19.039 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 69, 2024-09-12T01:43:19.039 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 117, 2024-09-12T01:43:19.039 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 117, 2024-09-12T01:43:19.039 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 14.05167164 2024-09-12T01:43:19.039 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:43:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.032+0000 7efea305e640 1 -- 172.21.15.60:0/2634351935 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efe8006bfd0 msgr2=0x7efe8006e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.032+0000 7efea305e640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efe8006bfd0 0x7efe8006e490 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efe90033000 tx=0x7efe90009030 comp rx=0 tx=0).stop 2024-09-12T01:43:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.032+0000 7efea305e640 1 -- 172.21.15.60:0/2634351935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe9c143f70 msgr2=0x7efe9c157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.032+0000 7efea305e640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe9c143f70 0x7efe9c157830 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7efe9c0d1470 tx=0x7efe9400f580 comp rx=0 tx=0).stop 2024-09-12T01:43:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.032+0000 7efea305e640 1 -- 172.21.15.60:0/2634351935 shutdown_connections 2024-09-12T01:43:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.032+0000 7efea305e640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe9c143f70 0x7efe9c157830 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.040 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.032+0000 7efea305e640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efe8006bfd0 0x7efe8006e490 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.032+0000 7efea305e640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efe9c153930 0x7efe9c154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.032+0000 7efea305e640 1 --2- 172.21.15.60:0/2634351935 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efe8c0039b0 0x7efe9c1e6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.032+0000 7efea305e640 1 -- 172.21.15.60:0/2634351935 >> 172.21.15.60:0/2634351935 conn(0x7efe9c0b7d70 msgr2=0x7efe9c0d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.032+0000 7efea305e640 1 -- 172.21.15.60:0/2634351935 shutdown_connections 2024-09-12T01:43:19.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.032+0000 7efea305e640 1 -- 172.21.15.60:0/2634351935 wait complete. 2024-09-12T01:43:19.043 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:43:19.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.145+0000 7f8803ce6640 1 Processor -- start 2024-09-12T01:43:19.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.145+0000 7f8803ce6640 1 -- start start 2024-09-12T01:43:19.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.146+0000 7f8803ce6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f87fc15c470 0x7f87fc0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.146+0000 7f8803ce6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87fc0b3c50 0x7f87fc0cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.146+0000 7f8803ce6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87fc15c850 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.146+0000 7f8803ce6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f87fc0b4160 con 0x7f87fc15c470 2024-09-12T01:43:19.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.146+0000 7f8803ce6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f87fc0b4440 con 0x7f87fc0b3c50 2024-09-12T01:43:19.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.146+0000 7f8802283640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f87fc0cf8b0 0x7f87fc15ffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50318/0 (socket says 172.21.15.60:50318) 2024-09-12T01:43:19.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.146+0000 7f8802283640 1 -- 172.21.15.60:0/612545337 learned_addr learned my addr 172.21.15.60:0/612545337 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.146+0000 7f8801a82640 1 --2- 172.21.15.60:0/612545337 >> v2:172.21.15.105:3300/0 conn(0x7f87fc15c470 0x7f87fc0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.146+0000 7f8801281640 1 --2- 172.21.15.60:0/612545337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87fc0b3c50 0x7f87fc0cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.146+0000 7f8800a80640 1 -- 172.21.15.60:0/612545337 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1691532420 0 0) 0x7f87fc15c850 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.146+0000 7f8800a80640 1 -- 172.21.15.60:0/612545337 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87e4003520 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.147+0000 7f8801281640 1 -- 172.21.15.60:0/612545337 >> v2:172.21.15.105:3300/0 conn(0x7f87fc15c470 msgr2=0x7f87fc0b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.147+0000 7f8801281640 1 --2- 172.21.15.60:0/612545337 >> v2:172.21.15.105:3300/0 conn(0x7f87fc15c470 0x7f87fc0b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.147+0000 7f8801281640 1 -- 172.21.15.60:0/612545337 >> v1:172.21.15.60:6789/0 conn(0x7f87fc0cf8b0 legacy=0x7f87fc15ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.147+0000 7f8800a80640 1 -- 172.21.15.60:0/612545337 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 752727616 0 0) 0x7f87e4003520 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.147+0000 7f8801281640 1 -- 172.21.15.60:0/612545337 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc0b4720 con 0x7f87fc0b3c50 2024-09-12T01:43:19.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.148+0000 7f8801281640 1 --2- 172.21.15.60:0/612545337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87fc0b3c50 0x7f87fc0cf370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f87f00097a0 tx=0x7f87f002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c4cc3e5966fc194 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:19.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.148+0000 7f8800a80640 1 -- 172.21.15.60:0/612545337 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0037070 con 0x7f87fc0b3c50 2024-09-12T01:43:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.148+0000 7f8800a80640 1 -- 172.21.15.60:0/612545337 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f002aba0 con 0x7f87fc0b3c50 2024-09-12T01:43:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.148+0000 7f8800a80640 1 -- 172.21.15.60:0/612545337 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4001670 con 0x7f87fc0b3c50 2024-09-12T01:43:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.148+0000 7f8803ce6640 1 -- 172.21.15.60:0/612545337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87fc0b3c50 msgr2=0x7f87fc0cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.148+0000 7f8803ce6640 1 --2- 172.21.15.60:0/612545337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87fc0b3c50 0x7f87fc0cf370 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f87f00097a0 tx=0x7f87f002a110 comp rx=0 tx=0).stop 2024-09-12T01:43:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.148+0000 7f8803ce6640 1 -- 172.21.15.60:0/612545337 shutdown_connections 2024-09-12T01:43:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.148+0000 7f8803ce6640 1 --2- 172.21.15.60:0/612545337 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87fc0b3c50 0x7f87fc0cf370 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.148+0000 7f8803ce6640 1 --2- 172.21.15.60:0/612545337 >> v2:172.21.15.105:3300/0 conn(0x7f87fc15c470 0x7f87fc0b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.148+0000 7f8803ce6640 1 -- 172.21.15.60:0/612545337 >> 172.21.15.60:0/612545337 conn(0x7f87fc06bc10 msgr2=0x7f87fc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.148+0000 7f8803ce6640 1 -- 172.21.15.60:0/612545337 shutdown_connections 2024-09-12T01:43:19.150 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.148+0000 7f8803ce6640 1 -- 172.21.15.60:0/612545337 wait complete. 2024-09-12T01:43:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.150+0000 7f8803ce6640 1 Processor -- start 2024-09-12T01:43:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.150+0000 7f8803ce6640 1 -- start start 2024-09-12T01:43:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.150+0000 7f8803ce6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87fc0b3c50 0x7f87fc1410a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.150+0000 7f8803ce6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87fc0cf8b0 0x7f87fc1419a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.150+0000 7f8803ce6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87fc15c470 0x7f87fc15f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.150+0000 7f8803ce6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc06e1b0 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.150+0000 7f8803ce6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f87fc0b4d90 con 0x7f87fc0b3c50 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.150+0000 7f8803ce6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f87fc0b62c0 con 0x7f87fc15c470 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.150+0000 7f8801281640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87fc0cf8b0 0x7f87fc1419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.150+0000 7f8801281640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87fc0cf8b0 0x7f87fc1419a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53548/0 (socket says 172.21.15.60:53548) 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.150+0000 7f8801281640 1 -- 172.21.15.60:0/1970663569 learned_addr learned my addr 172.21.15.60:0/1970663569 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f8801a82640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87fc0b3c50 0x7f87fc1410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f8802283640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87fc15c470 0x7f87fc15f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f8801281640 1 -- 172.21.15.60:0/1970663569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87fc15c470 msgr2=0x7f87fc15f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f8801281640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87fc15c470 0x7f87fc15f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f8801281640 1 -- 172.21.15.60:0/1970663569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87fc0b3c50 msgr2=0x7f87fc1410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f8801281640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87fc0b3c50 0x7f87fc1410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f8801281640 1 -- 172.21.15.60:0/1970663569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87fc15e170 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f8801281640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87fc0cf8b0 0x7f87fc1419a0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f87f002a700 tx=0x7f87f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:19.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f87fa7fc640 1 -- 172.21.15.60:0/1970663569 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0042020 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f87fa7fc640 1 -- 172.21.15.60:0/1970663569 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f0003a40 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f8803ce6640 1 -- 172.21.15.60:0/1970663569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87fc15e450 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f87fa7fc640 1 -- 172.21.15.60:0/1970663569 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0037040 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.151+0000 7f8803ce6640 1 -- 172.21.15.60:0/1970663569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87fc15ecf0 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.152+0000 7f8803ce6640 1 -- 172.21.15.60:0/1970663569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87fc15e840 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.153+0000 7f87fa7fc640 1 -- 172.21.15.60:0/1970663569 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87f0045020 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.153+0000 7f87fa7fc640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f87e806be30 0x7f87e806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.153+0000 7f87fa7fc640 1 -- 172.21.15.60:0/1970663569 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f87f00ab3b0 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.153+0000 7f8801a82640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f87e806be30 0x7f87e806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:19.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.154+0000 7f8801a82640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f87e806be30 0x7f87e806e2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f87ec011340 tx=0x7f87ec00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:19.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.158+0000 7f87fa7fc640 1 -- 172.21.15.60:0/1970663569 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f87f004c030 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.185 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:43:19.188 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:43:19.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.369+0000 7f8803ce6640 1 -- 172.21.15.60:0/1970663569 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f87fc0cf370 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.370 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.370+0000 7f87fa7fc640 1 -- 172.21.15.60:0/1970663569 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) ==== 53+0+73 (secure 0 0 0) 0x7f87f0079830 con 0x7f87fc0cf8b0 2024-09-12T01:43:19.370 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:43:19.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.371+0000 7f8803ce6640 1 -- 172.21.15.60:0/1970663569 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f87e806be30 msgr2=0x7f87e806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.371+0000 7f8803ce6640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f87e806be30 0x7f87e806e2f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f87ec011340 tx=0x7f87ec00b040 comp rx=0 tx=0).stop 2024-09-12T01:43:19.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.371+0000 7f8803ce6640 1 -- 172.21.15.60:0/1970663569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87fc0cf8b0 msgr2=0x7f87fc1419a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:19.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.371+0000 7f8803ce6640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87fc0cf8b0 0x7f87fc1419a0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f87f002a700 tx=0x7f87f00046c0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.371+0000 7f8803ce6640 1 -- 172.21.15.60:0/1970663569 shutdown_connections 2024-09-12T01:43:19.372 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.371+0000 7f8803ce6640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f87e806be30 0x7f87e806e2f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.371+0000 7f8803ce6640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87fc15c470 0x7f87fc15f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.372+0000 7f8803ce6640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87fc0cf8b0 0x7f87fc1419a0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.372+0000 7f8803ce6640 1 --2- 172.21.15.60:0/1970663569 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f87fc0b3c50 0x7f87fc1410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.372+0000 7f8803ce6640 1 -- 172.21.15.60:0/1970663569 >> 172.21.15.60:0/1970663569 conn(0x7f87fc06bc10 msgr2=0x7f87fc1590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.372+0000 7f8803ce6640 1 -- 172.21.15.60:0/1970663569 shutdown_connections 2024-09-12T01:43:19.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19.372+0000 7f8803ce6640 1 -- 172.21.15.60:0/1970663569 wait complete. 2024-09-12T01:43:19.383 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:43:19.383 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:43:19.383 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T01:43:19.383 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:43:19.383 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:43:19.383 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:43:19.383 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:43:19.383 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:43:19.383 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:43:19.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:19.384 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T01:43:19.400 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:43:19.400 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:43:19.400 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:43:19.400 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:19.400 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:43:19.400 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:19.400 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:43:19.400 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:43:19.400 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42321sec preferred_lft 42321sec 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:43:19.401 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e8cb:28ff:fea3:34fb/64 scope link 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 72:47:53:4d:4f:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7047:53ff:fe4d:4fc7/64 scope link 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:43:19.402 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::183c:47ff:fec1:173/64 scope link 2024-09-12T01:43:19.403 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:19.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:19.403 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:43:19.464 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T01:43:19.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:19.466 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T01:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T01:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:43:19.523 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:43:19.523 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:43:19.523 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:43:19.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:43:19.523 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:43:19.524 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:43:19.524 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:43:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:43:19.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:43:19.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:19.652 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:43:19.667 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:43:19.667 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:43:19.668 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:43:19.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:19.668 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-12T01:43:19.733 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:43:19.734 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:43:19.789 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:43:19.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:43:19.789 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:43:19.845 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T01:43:19.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:19.845 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:43:19.932 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:43:19.932 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:43:19.941 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:43:19.942 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:43:19.942 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:43:19.942 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:43:19.942 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:43:19.943 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:43:19.943 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:43:19.943 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:43:19.943 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:43:19.943 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:43:19.945 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:43:19.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:19.945 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:43:19.973 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:43:20.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:43:20.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:43:20.072 INFO:teuthology.orchestra.run.smithi060.stdout:client36284 2024-09-12T01:43:20.073 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:43:20.073 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:20.090 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:43:20.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.233+0000 7f7643b2c640 1 Processor -- start 2024-09-12T01:43:20.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.233+0000 7f7643b2c640 1 -- start start 2024-09-12T01:43:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f7643b2c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f763c15e660 0x7f763c0cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f7643b2c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f763c0d3310 0x7f763c0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f7643b2c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f763c15ea40 con 0x7f763c0d1650 2024-09-12T01:43:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f7643b2c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f763c0d1ac0 con 0x7f763c15e660 2024-09-12T01:43:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f7643b2c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f763c0d3870 con 0x7f763c0d3310 2024-09-12T01:43:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f76418c8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f763c15e660 0x7f763c0cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f76420c9640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f763c0d1650 0x7f763c06bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50332/0 (socket says 172.21.15.60:50332) 2024-09-12T01:43:20.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f76418c8640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f763c15e660 0x7f763c0cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53560/0 (socket says 172.21.15.60:53560) 2024-09-12T01:43:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f76420c9640 1 -- 172.21.15.60:0/786543377 learned_addr learned my addr 172.21.15.60:0/786543377 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f76410c7640 1 --2- 172.21.15.60:0/786543377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f763c0d3310 0x7f763c0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f76418c8640 1 -- 172.21.15.60:0/786543377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f763c0d3310 msgr2=0x7f763c0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f76418c8640 1 --2- 172.21.15.60:0/786543377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f763c0d3310 0x7f763c0d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f76418c8640 1 -- 172.21.15.60:0/786543377 >> v1:172.21.15.60:6789/0 conn(0x7f763c0d1650 legacy=0x7f763c06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f76408c6640 1 -- 172.21.15.60:0/786543377 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132342152 0 0) 0x7f763c15ea40 con 0x7f763c0d1650 2024-09-12T01:43:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f76418c8640 1 -- 172.21.15.60:0/786543377 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763c0d3b50 con 0x7f763c15e660 2024-09-12T01:43:20.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.234+0000 7f76410c7640 1 --2- 172.21.15.60:0/786543377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f763c0d3310 0x7f763c0d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:20.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.235+0000 7f76418c8640 1 --2- 172.21.15.60:0/786543377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f763c15e660 0x7f763c0cf730 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f76380097a0 tx=0x7f763802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411529afa4742496 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:20.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.235+0000 7f76408c6640 1 -- 172.21.15.60:0/786543377 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7638037070 con 0x7f763c15e660 2024-09-12T01:43:20.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.235+0000 7f76408c6640 1 -- 172.21.15.60:0/786543377 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7638032440 con 0x7f763c15e660 2024-09-12T01:43:20.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.235+0000 7f76408c6640 1 -- 172.21.15.60:0/786543377 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7638032810 con 0x7f763c15e660 2024-09-12T01:43:20.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.236+0000 7f7643b2c640 1 -- 172.21.15.60:0/786543377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f763c15e660 msgr2=0x7f763c0cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:20.238 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.236+0000 7f7643b2c640 1 --2- 172.21.15.60:0/786543377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f763c15e660 0x7f763c0cf730 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f76380097a0 tx=0x7f763802a180 comp rx=0 tx=0).stop 2024-09-12T01:43:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.236+0000 7f7643b2c640 1 -- 172.21.15.60:0/786543377 shutdown_connections 2024-09-12T01:43:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.236+0000 7f7643b2c640 1 --2- 172.21.15.60:0/786543377 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f763c0d3310 0x7f763c0d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.236+0000 7f7643b2c640 1 --2- 172.21.15.60:0/786543377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f763c15e660 0x7f763c0cf730 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.236+0000 7f7643b2c640 1 -- 172.21.15.60:0/786543377 >> 172.21.15.60:0/786543377 conn(0x7f763c0b6410 msgr2=0x7f763c0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.236+0000 7f7643b2c640 1 -- 172.21.15.60:0/786543377 shutdown_connections 2024-09-12T01:43:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.236+0000 7f7643b2c640 1 -- 172.21.15.60:0/786543377 wait complete. 2024-09-12T01:43:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.237+0000 7f7643b2c640 1 Processor -- start 2024-09-12T01:43:20.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.237+0000 7f7643b2c640 1 -- start start 2024-09-12T01:43:20.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.238+0000 7f7643b2c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f763c0d1650 0x7f763c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:20.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.238+0000 7f7643b2c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f763c0d3310 0x7f763c15ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.238+0000 7f7643b2c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f763c15e660 0x7f763c157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.238+0000 7f7643b2c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f763c0d43f0 con 0x7f763c15e660 2024-09-12T01:43:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.238+0000 7f7643b2c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f763c0d4110 con 0x7f763c0d1650 2024-09-12T01:43:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.238+0000 7f7643b2c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f763c0cfc70 con 0x7f763c0d3310 2024-09-12T01:43:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.238+0000 7f76420c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f763c15e660 0x7f763c157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.238+0000 7f76420c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f763c15e660 0x7f763c157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53570/0 (socket says 172.21.15.60:53570) 2024-09-12T01:43:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.238+0000 7f76420c9640 1 -- 172.21.15.60:0/520552756 learned_addr learned my addr 172.21.15.60:0/520552756 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.238+0000 7f76410c7640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f763c0d3310 0x7f763c15ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.238+0000 7f76418c8640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f763c0d1650 0x7f763c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:20.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.239+0000 7f76420c9640 1 -- 172.21.15.60:0/520552756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f763c0d3310 msgr2=0x7f763c15ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.239+0000 7f76420c9640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f763c0d3310 0x7f763c15ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.239+0000 7f76420c9640 1 -- 172.21.15.60:0/520552756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f763c0d1650 msgr2=0x7f763c1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.239+0000 7f76420c9640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f763c0d1650 0x7f763c1588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.239+0000 7f76420c9640 1 -- 172.21.15.60:0/520552756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763c160ed0 con 0x7f763c15e660 2024-09-12T01:43:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.239+0000 7f76420c9640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f763c15e660 0x7f763c157500 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f763400c7d0 tx=0x7f763400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.239+0000 7f76327fc640 1 -- 172.21.15.60:0/520552756 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634018070 con 0x7f763c15e660 2024-09-12T01:43:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.239+0000 7f76327fc640 1 -- 172.21.15.60:0/520552756 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f763400a640 con 0x7f763c15e660 2024-09-12T01:43:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.239+0000 7f7643b2c640 1 -- 172.21.15.60:0/520552756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f763c160630 con 0x7f763c15e660 2024-09-12T01:43:20.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.239+0000 7f76327fc640 1 -- 172.21.15.60:0/520552756 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763400aa70 con 0x7f763c15e660 2024-09-12T01:43:20.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.239+0000 7f7643b2c640 1 -- 172.21.15.60:0/520552756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f763c160bf0 con 0x7f763c15e660 2024-09-12T01:43:20.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.240+0000 7f7643b2c640 1 -- 172.21.15.60:0/520552756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f763c0d1110 con 0x7f763c15e660 2024-09-12T01:43:20.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.241+0000 7f76327fc640 1 -- 172.21.15.60:0/520552756 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f763401b070 con 0x7f763c15e660 2024-09-12T01:43:20.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.242+0000 7f76327fc640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f762006be30 0x7f762006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:20.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.242+0000 7f76327fc640 1 -- 172.21.15.60:0/520552756 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f763408a3f0 con 0x7f763c15e660 2024-09-12T01:43:20.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.242+0000 7f76418c8640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f762006be30 0x7f762006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:20.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.242+0000 7f76418c8640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f762006be30 0x7f762006e2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7638034000 tx=0x7f763802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:20.246 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.246+0000 7f76327fc640 1 -- 172.21.15.60:0/520552756 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7634058740 con 0x7f763c15e660 2024-09-12T01:43:20.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.458+0000 7f7643b2c640 1 -- 172.21.15.60:0/520552756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f763c0b6b00 con 0x7f763c15e660 2024-09-12T01:43:20.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.459+0000 7f76327fc640 1 -- 172.21.15.60:0/520552756 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) ==== 53+0+73 (secure 0 0 0) 0x7f763405ca40 con 0x7f763c15e660 2024-09-12T01:43:20.459 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:43:20.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.460+0000 7f7643b2c640 1 -- 172.21.15.60:0/520552756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f762006be30 msgr2=0x7f762006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:20.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.460+0000 7f7643b2c640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f762006be30 0x7f762006e2f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7638034000 tx=0x7f763802e000 comp rx=0 tx=0).stop 2024-09-12T01:43:20.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.460+0000 7f7643b2c640 1 -- 172.21.15.60:0/520552756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f763c15e660 msgr2=0x7f763c157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:20.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.460+0000 7f7643b2c640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f763c15e660 0x7f763c157500 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f763400c7d0 tx=0x7f763400cc90 comp rx=0 tx=0).stop 2024-09-12T01:43:20.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.461+0000 7f7643b2c640 1 -- 172.21.15.60:0/520552756 shutdown_connections 2024-09-12T01:43:20.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.461+0000 7f7643b2c640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f763c15e660 0x7f763c157500 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:20.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.461+0000 7f7643b2c640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f762006be30 0x7f762006e2f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:20.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.461+0000 7f7643b2c640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f763c0d3310 0x7f763c15ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:20.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.461+0000 7f7643b2c640 1 --2- 172.21.15.60:0/520552756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f763c0d1650 0x7f763c1588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:20.462 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.461+0000 7f7643b2c640 1 -- 172.21.15.60:0/520552756 >> 172.21.15.60:0/520552756 conn(0x7f763c0b6410 msgr2=0x7f763c0b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:20.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.461+0000 7f7643b2c640 1 -- 172.21.15.60:0/520552756 shutdown_connections 2024-09-12T01:43:20.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:20.461+0000 7f7643b2c640 1 -- 172.21.15.60:0/520552756 wait complete. 2024-09-12T01:43:20.472 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:43:20.472 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:43:20.472 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T01:43:20.472 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:43:20.472 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:43:20.473 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:43:20.473 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:43:20.473 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:43:20.473 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:43:20.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:20.473 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T01:43:20.493 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:43:20.493 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:43:20.493 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:43:20.493 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:20.493 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:43:20.493 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:20.494 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:43:20.494 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:43:20.494 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T01:43:20.494 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:43:20.494 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:43:20.494 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T01:43:20.494 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:43:20.494 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:43:20.494 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:43:20.495 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:43:20.495 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:43:20.495 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42322sec preferred_lft 42322sec 2024-09-12T01:43:20.495 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T01:43:20.495 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:20.495 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:43:20.495 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff 2024-09-12T01:43:20.495 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:43:20.495 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:20.495 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::c46c:baff:feeb:1f5e/64 scope link 2024-09-12T01:43:20.495 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:20.495 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:43:20.496 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 56:66:28:3d:b2:45 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:43:20.496 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::5466:28ff:fe3d:b245/64 scope link 2024-09-12T01:43:20.496 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:20.496 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:43:20.496 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:43:20.496 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::2036:4aff:fe87:b9cb/64 scope link 2024-09-12T01:43:20.496 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:43:20.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:20.496 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:43:20.562 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:43:20.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:20.564 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T01:43:20.623 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T01:43:20.623 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:43:20.624 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:43:20.624 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:43:20.624 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:43:20.624 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:43:20.624 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:43:20.624 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:43:20.624 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:43:20.624 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:43:20.624 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:43:20.717 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:43:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:43:20.750 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:43:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:43:20.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:20.757 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:43:20.773 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T01:43:20.773 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:43:20.773 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:43:20.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:20.773 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-12T01:43:20.838 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:43:20.838 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:43:20.894 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:43:20.894 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:43:20.894 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:43:20.950 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T01:43:20.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:20.950 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:43:21.034 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:43:21.034 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:43:21.040 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:43:21.041 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:43:21.041 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:43:21.041 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 1@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:43:21.041 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:43:21.041 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:43:21.041 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:43:21.041 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:43:21.042 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:43:21.042 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:43:21.043 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:43:21.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:21.043 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:43:21.067 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:43:21.156 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:43:21 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:43:21.157 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:43:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:43:21.163 INFO:teuthology.orchestra.run.smithi105.stdout:client7000 2024-09-12T01:43:21.163 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:43:21.163 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:21.180 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-09-12T01:43:21.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.286+0000 7f7e23911640 1 Processor -- start 2024-09-12T01:43:21.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.287+0000 7f7e23911640 1 -- start start 2024-09-12T01:43:21.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.288+0000 7f7e23911640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7e1c0cf1f0 0x7f7e1c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.288+0000 7f7e23911640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e1c0cf860 con 0x7f7e1c0b6720 2024-09-12T01:43:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.288+0000 7f7e23911640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e1c0cfb40 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.288+0000 7f7e23911640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7e1c0b6b90 con 0x7f7e1c0cf1f0 2024-09-12T01:43:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.288+0000 7f7e20eac640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7e1c0cf1f0 0x7f7e1c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.288+0000 7f7e21eae640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7e1c0b6720 0x7f7e1c0d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50344/0 (socket says 172.21.15.60:50344) 2024-09-12T01:43:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.288+0000 7f7e21eae640 1 -- 172.21.15.60:0/2234112725 learned_addr learned my addr 172.21.15.60:0/2234112725 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.288+0000 7f7e20eac640 1 -- 172.21.15.60:0/2234112725 >> v1:172.21.15.105:6789/0 conn(0x7f7e1c15e7a0 legacy=0x7f7e1c06caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:21.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.288+0000 7f7e20eac640 1 -- 172.21.15.60:0/2234112725 >> v1:172.21.15.60:6789/0 conn(0x7f7e1c0b6720 legacy=0x7f7e1c0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.288+0000 7f7e20eac640 1 -- 172.21.15.60:0/2234112725 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1c0cfe20 con 0x7f7e1c0cf1f0 2024-09-12T01:43:21.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.288+0000 7f7e1bfff640 1 -- 172.21.15.60:0/2234112725 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 282221827 0 0) 0x7f7e1c0cf860 con 0x7f7e1c0b6720 2024-09-12T01:43:21.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.289+0000 7f7e20eac640 1 --2- 172.21.15.60:0/2234112725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e1c0cf1f0 0x7f7e1c0b61e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009d90 tx=0x7f7e1002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dddd18414555fb80 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:21.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.289+0000 7f7e1bfff640 1 -- 172.21.15.60:0/2234112725 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e10031600 con 0x7f7e1c0cf1f0 2024-09-12T01:43:21.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.289+0000 7f7e1bfff640 1 -- 172.21.15.60:0/2234112725 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e100317a0 con 0x7f7e1c0cf1f0 2024-09-12T01:43:21.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.289+0000 7f7e1bfff640 1 -- 172.21.15.60:0/2234112725 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e10031b70 con 0x7f7e1c0cf1f0 2024-09-12T01:43:21.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.290+0000 7f7e23911640 1 -- 172.21.15.60:0/2234112725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e1c0cf1f0 msgr2=0x7f7e1c0b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.290+0000 7f7e23911640 1 --2- 172.21.15.60:0/2234112725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e1c0cf1f0 0x7f7e1c0b61e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f7e10009d90 tx=0x7f7e1002a610 comp rx=0 tx=0).stop 2024-09-12T01:43:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.290+0000 7f7e23911640 1 -- 172.21.15.60:0/2234112725 shutdown_connections 2024-09-12T01:43:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.290+0000 7f7e23911640 1 --2- 172.21.15.60:0/2234112725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e1c0cf1f0 0x7f7e1c0b61e0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.290+0000 7f7e23911640 1 -- 172.21.15.60:0/2234112725 >> 172.21.15.60:0/2234112725 conn(0x7f7e1c0d11e0 msgr2=0x7f7e1c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.290+0000 7f7e23911640 1 -- 172.21.15.60:0/2234112725 shutdown_connections 2024-09-12T01:43:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.290+0000 7f7e23911640 1 -- 172.21.15.60:0/2234112725 wait complete. 2024-09-12T01:43:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.291+0000 7f7e23911640 1 Processor -- start 2024-09-12T01:43:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.291+0000 7f7e23911640 1 -- start start 2024-09-12T01:43:21.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e23911640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e1c0b6720 0x7f7e1c0b9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e23911640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e1c0cf1f0 0x7f7e1c0c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e23911640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e1c15e7a0 0x7f7e1c14dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e23911640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c0b7a00 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e23911640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c0d2ca0 con 0x7f7e1c0b6720 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e23911640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1c15eb80 con 0x7f7e1c0cf1f0 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e21eae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e1c15e7a0 0x7f7e1c14dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e21eae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e1c15e7a0 0x7f7e1c14dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53580/0 (socket says 172.21.15.60:53580) 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e21eae640 1 -- 172.21.15.60:0/127923101 learned_addr learned my addr 172.21.15.60:0/127923101 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e216ad640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e1c0b6720 0x7f7e1c0b9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e20eac640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e1c0cf1f0 0x7f7e1c0c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e21eae640 1 -- 172.21.15.60:0/127923101 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e1c0cf1f0 msgr2=0x7f7e1c0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e21eae640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e1c0cf1f0 0x7f7e1c0c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e21eae640 1 -- 172.21.15.60:0/127923101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e1c0b6720 msgr2=0x7f7e1c0b9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e21eae640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e1c0b6720 0x7f7e1c0b9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e21eae640 1 -- 172.21.15.60:0/127923101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1c0b8590 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.292+0000 7f7e21eae640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e1c15e7a0 0x7f7e1c14dc20 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c410 tx=0x7f7e1400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.293+0000 7f7e19ffb640 1 -- 172.21.15.60:0/127923101 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e140074e0 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.293+0000 7f7e19ffb640 1 -- 172.21.15.60:0/127923101 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e140047e0 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.293+0000 7f7e19ffb640 1 -- 172.21.15.60:0/127923101 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e14004bd0 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.293+0000 7f7e23911640 1 -- 172.21.15.60:0/127923101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1c0b8830 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.293+0000 7f7e23911640 1 -- 172.21.15.60:0/127923101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1c0c9b60 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.294+0000 7f7e23911640 1 -- 172.21.15.60:0/127923101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e1c0b61e0 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.294+0000 7f7e19ffb640 1 -- 172.21.15.60:0/127923101 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7e14011070 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.295+0000 7f7e19ffb640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7e0806be30 0x7f7e0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.295+0000 7f7e19ffb640 1 -- 172.21.15.60:0/127923101 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f7e1408a850 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.295+0000 7f7e216ad640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7e0806be30 0x7f7e0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.295+0000 7f7e216ad640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7e0806be30 0x7f7e0806e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0d1a80 tx=0x7f7e0c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:21.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.299+0000 7f7e19ffb640 1 -- 172.21.15.60:0/127923101 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7e14058c40 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.477+0000 7f7e23911640 1 -- 172.21.15.60:0/127923101 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7f7e1c0cefd0 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.480 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.480+0000 7f7e19ffb640 1 -- 172.21.15.60:0/127923101 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v47)=0 v47) ==== 121+0+0 (secure 0 0 0) 0x7f7e1405cf40 con 0x7f7e1c15e7a0 2024-09-12T01:43:21.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.482+0000 7f7e23911640 1 -- 172.21.15.60:0/127923101 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7e0806be30 msgr2=0x7f7e0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.482+0000 7f7e23911640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7e0806be30 0x7f7e0806e2f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0d1a80 tx=0x7f7e0c009040 comp rx=0 tx=0).stop 2024-09-12T01:43:21.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.482+0000 7f7e23911640 1 -- 172.21.15.60:0/127923101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e1c15e7a0 msgr2=0x7f7e1c14dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.482+0000 7f7e23911640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e1c15e7a0 0x7f7e1c14dc20 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c410 tx=0x7f7e1400c8d0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.483+0000 7f7e23911640 1 -- 172.21.15.60:0/127923101 shutdown_connections 2024-09-12T01:43:21.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.483+0000 7f7e23911640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e1c15e7a0 0x7f7e1c14dc20 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.483+0000 7f7e23911640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7e0806be30 0x7f7e0806e2f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.483+0000 7f7e23911640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7e1c0cf1f0 0x7f7e1c0c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.484 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.483+0000 7f7e23911640 1 --2- 172.21.15.60:0/127923101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7e1c0b6720 0x7f7e1c0b9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.483+0000 7f7e23911640 1 -- 172.21.15.60:0/127923101 >> 172.21.15.60:0/127923101 conn(0x7f7e1c0d11e0 msgr2=0x7f7e1c157320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:21.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.483+0000 7f7e23911640 1 -- 172.21.15.60:0/127923101 shutdown_connections 2024-09-12T01:43:21.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.483+0000 7f7e23911640 1 -- 172.21.15.60:0/127923101 wait complete. 2024-09-12T01:43:21.494 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 100 2024-09-12T01:43:21.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.600+0000 7f6a66ad7640 1 Processor -- start 2024-09-12T01:43:21.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.600+0000 7f6a66ad7640 1 -- start start 2024-09-12T01:43:21.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.601+0000 7f6a66ad7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a6015b480 0x7f6a600b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.601+0000 7f6a66ad7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a600ccff0 con 0x7f6a60072700 2024-09-12T01:43:21.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.601+0000 7f6a66ad7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a600cd2d0 con 0x7f6a600b60c0 2024-09-12T01:43:21.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.601+0000 7f6a66ad7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6a600cd5b0 con 0x7f6a6015b480 2024-09-12T01:43:21.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.601+0000 7f6a64873640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a6015b480 0x7f6a600b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.601+0000 7f6a65074640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6a60072700 0x7f6a6015bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50350/0 (socket says 172.21.15.60:50350) 2024-09-12T01:43:21.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.601+0000 7f6a65074640 1 -- 172.21.15.60:0/3360190411 learned_addr learned my addr 172.21.15.60:0/3360190411 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:21.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.602+0000 7f6a64873640 1 -- 172.21.15.60:0/3360190411 >> v1:172.21.15.105:6789/0 conn(0x7f6a600b60c0 legacy=0x7f6a60071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:21.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.602+0000 7f6a64873640 1 -- 172.21.15.60:0/3360190411 >> v1:172.21.15.60:6789/0 conn(0x7f6a60072700 legacy=0x7f6a6015bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.602+0000 7f6a5f7fe640 1 -- 172.21.15.60:0/3360190411 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068834547 0 0) 0x7f6a600ccff0 con 0x7f6a60072700 2024-09-12T01:43:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.602+0000 7f6a64873640 1 -- 172.21.15.60:0/3360190411 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a600cd890 con 0x7f6a6015b480 2024-09-12T01:43:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.602+0000 7f6a64873640 1 --2- 172.21.15.60:0/3360190411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a6015b480 0x7f6a600b5b80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009d90 tx=0x7f6a5802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55719bc6d58f3ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.602+0000 7f6a5f7fe640 1 -- 172.21.15.60:0/3360190411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58031600 con 0x7f6a6015b480 2024-09-12T01:43:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.602+0000 7f6a5f7fe640 1 -- 172.21.15.60:0/3360190411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a580317a0 con 0x7f6a6015b480 2024-09-12T01:43:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.602+0000 7f6a5f7fe640 1 -- 172.21.15.60:0/3360190411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a58031b70 con 0x7f6a6015b480 2024-09-12T01:43:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.603+0000 7f6a66ad7640 1 -- 172.21.15.60:0/3360190411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a6015b480 msgr2=0x7f6a600b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.603+0000 7f6a66ad7640 1 --2- 172.21.15.60:0/3360190411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a6015b480 0x7f6a600b5b80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f6a58009d90 tx=0x7f6a5802a610 comp rx=0 tx=0).stop 2024-09-12T01:43:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.603+0000 7f6a66ad7640 1 -- 172.21.15.60:0/3360190411 shutdown_connections 2024-09-12T01:43:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.603+0000 7f6a66ad7640 1 --2- 172.21.15.60:0/3360190411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a6015b480 0x7f6a600b5b80 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.603+0000 7f6a66ad7640 1 -- 172.21.15.60:0/3360190411 >> 172.21.15.60:0/3360190411 conn(0x7f6a6006d0f0 msgr2=0x7f6a6006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:21.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.603+0000 7f6a66ad7640 1 -- 172.21.15.60:0/3360190411 shutdown_connections 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.603+0000 7f6a66ad7640 1 -- 172.21.15.60:0/3360190411 wait complete. 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.604+0000 7f6a66ad7640 1 Processor -- start 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.604+0000 7f6a66ad7640 1 -- start start 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.605+0000 7f6a66ad7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a60072700 0x7f6a60143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.605+0000 7f6a66ad7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a600b60c0 0x7f6a60152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.605+0000 7f6a66ad7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a6015b480 0x7f6a60152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.605+0000 7f6a66ad7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6015b9e0 con 0x7f6a6015b480 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.605+0000 7f6a66ad7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a6015b860 con 0x7f6a60072700 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.605+0000 7f6a66ad7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6a6015c370 con 0x7f6a600b60c0 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.605+0000 7f6a65074640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a6015b480 0x7f6a60152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.605+0000 7f6a65074640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a6015b480 0x7f6a60152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53594/0 (socket says 172.21.15.60:53594) 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.605+0000 7f6a65074640 1 -- 172.21.15.60:0/1779528608 learned_addr learned my addr 172.21.15.60:0/1779528608 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.605+0000 7f6a64873640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a60072700 0x7f6a60143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.605+0000 7f6a5ffff640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a600b60c0 0x7f6a60152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a65074640 1 -- 172.21.15.60:0/1779528608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a600b60c0 msgr2=0x7f6a60152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a65074640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a600b60c0 0x7f6a60152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a65074640 1 -- 172.21.15.60:0/1779528608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a60072700 msgr2=0x7f6a60143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a65074640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a60072700 0x7f6a60143ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a65074640 1 -- 172.21.15.60:0/1779528608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6014ed50 con 0x7f6a6015b480 2024-09-12T01:43:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a64873640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a60072700 0x7f6a60143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a5ffff640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a600b60c0 0x7f6a60152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a65074640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a6015b480 0x7f6a60152860 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c450 tx=0x7f6a4800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a5d7fa640 1 -- 172.21.15.60:0/1779528608 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48018070 con 0x7f6a6015b480 2024-09-12T01:43:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a5d7fa640 1 -- 172.21.15.60:0/1779528608 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a48007500 con 0x7f6a6015b480 2024-09-12T01:43:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a66ad7640 1 -- 172.21.15.60:0/1779528608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a60144530 con 0x7f6a6015b480 2024-09-12T01:43:21.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a5d7fa640 1 -- 172.21.15.60:0/1779528608 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a48004a20 con 0x7f6a6015b480 2024-09-12T01:43:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.606+0000 7f6a66ad7640 1 -- 172.21.15.60:0/1779528608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a600cf2f0 con 0x7f6a6015b480 2024-09-12T01:43:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.607+0000 7f6a66ad7640 1 -- 172.21.15.60:0/1779528608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a600b5b80 con 0x7f6a6015b480 2024-09-12T01:43:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.608+0000 7f6a5d7fa640 1 -- 172.21.15.60:0/1779528608 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a4801b070 con 0x7f6a6015b480 2024-09-12T01:43:21.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.608+0000 7f6a5d7fa640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a4006be60 0x7f6a4006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.608+0000 7f6a5d7fa640 1 -- 172.21.15.60:0/1779528608 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f6a4808a0e0 con 0x7f6a6015b480 2024-09-12T01:43:21.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.608+0000 7f6a64873640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a4006be60 0x7f6a4006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.609+0000 7f6a64873640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a4006be60 0x7f6a4006e320 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6a58034000 tx=0x7f6a5802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:21.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.613+0000 7f6a5d7fa640 1 -- 172.21.15.60:0/1779528608 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a48058a00 con 0x7f6a6015b480 2024-09-12T01:43:21.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.788+0000 7f6a66ad7640 1 -- 172.21.15.60:0/1779528608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7f6a60159870 con 0x7f6a6015b480 2024-09-12T01:43:21.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.791+0000 7f6a5d7fa640 1 -- 172.21.15.60:0/1779528608 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v48)=0 v48) ==== 119+0+0 (secure 0 0 0) 0x7f6a48058300 con 0x7f6a6015b480 2024-09-12T01:43:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.794+0000 7f6a66ad7640 1 -- 172.21.15.60:0/1779528608 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a4006be60 msgr2=0x7f6a4006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.794+0000 7f6a66ad7640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a4006be60 0x7f6a4006e320 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6a58034000 tx=0x7f6a5802f000 comp rx=0 tx=0).stop 2024-09-12T01:43:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.794+0000 7f6a66ad7640 1 -- 172.21.15.60:0/1779528608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a6015b480 msgr2=0x7f6a60152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.794+0000 7f6a66ad7640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a6015b480 0x7f6a60152860 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c450 tx=0x7f6a4800c910 comp rx=0 tx=0).stop 2024-09-12T01:43:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.794+0000 7f6a66ad7640 1 -- 172.21.15.60:0/1779528608 shutdown_connections 2024-09-12T01:43:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.794+0000 7f6a66ad7640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a6015b480 0x7f6a60152860 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.794+0000 7f6a66ad7640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a4006be60 0x7f6a4006e320 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.794+0000 7f6a66ad7640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a600b60c0 0x7f6a60152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.794+0000 7f6a66ad7640 1 --2- 172.21.15.60:0/1779528608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a60072700 0x7f6a60143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.794+0000 7f6a66ad7640 1 -- 172.21.15.60:0/1779528608 >> 172.21.15.60:0/1779528608 conn(0x7f6a6006d0f0 msgr2=0x7f6a6015a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.794+0000 7f6a66ad7640 1 -- 172.21.15.60:0/1779528608 shutdown_connections 2024-09-12T01:43:21.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.794+0000 7f6a66ad7640 1 -- 172.21.15.60:0/1779528608 wait complete. 2024-09-12T01:43:21.808 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 200 2024-09-12T01:43:21.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.914+0000 7f47db38d640 1 Processor -- start 2024-09-12T01:43:21.915 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.914+0000 7f47db38d640 1 -- start start 2024-09-12T01:43:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.915+0000 7f47db38d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47d415c2a0 0x7f47d40735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.915+0000 7f47db38d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d406fe20 0x7f47d406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.915+0000 7f47db38d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d4074120 con 0x7f47d4073b10 2024-09-12T01:43:21.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.915+0000 7f47db38d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f47d415c680 con 0x7f47d415c2a0 2024-09-12T01:43:21.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.915+0000 7f47db38d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47d415ef00 con 0x7f47d406fe20 2024-09-12T01:43:21.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.915+0000 7f47d9129640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47d415c2a0 0x7f47d40735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.915+0000 7f47d992a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d406fe20 0x7f47d406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.915+0000 7f47d9129640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f47d415c2a0 0x7f47d40735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:32998/0 (socket says 172.21.15.60:32998) 2024-09-12T01:43:21.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.915+0000 7f47d9129640 1 -- 172.21.15.60:0/3524159076 learned_addr learned my addr 172.21.15.60:0/3524159076 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:21.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.915+0000 7f47d992a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d406fe20 0x7f47d406bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:38106/0 (socket says 172.21.15.60:38106) 2024-09-12T01:43:21.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.915+0000 7f47d8928640 1 --1- 172.21.15.60:0/3524159076 >> v1:172.21.15.105:6789/0 conn(0x7f47d4073b10 0x7f47d406f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:38446/0 (socket says 172.21.15.60:38446) 2024-09-12T01:43:21.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.916+0000 7f47d9129640 1 -- 172.21.15.60:0/3524159076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d406fe20 msgr2=0x7f47d406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:21.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.916+0000 7f47d9129640 1 --2- 172.21.15.60:0/3524159076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d406fe20 0x7f47d406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.916+0000 7f47d9129640 1 -- 172.21.15.60:0/3524159076 >> v1:172.21.15.105:6789/0 conn(0x7f47d4073b10 legacy=0x7f47d406f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.916+0000 7f47d9129640 1 -- 172.21.15.60:0/3524159076 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d415f1e0 con 0x7f47d415c2a0 2024-09-12T01:43:21.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.916+0000 7f47d3fff640 1 -- 172.21.15.60:0/3524159076 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637428154 0 0) 0x7f47d4074120 con 0x7f47d4073b10 2024-09-12T01:43:21.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.916+0000 7f47d992a640 1 --2- 172.21.15.60:0/3524159076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d406fe20 0x7f47d406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:21.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.916+0000 7f47d9129640 1 --2- 172.21.15.60:0/3524159076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d415c2a0 0x7f47d40735d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009e50 tx=0x7f47c402a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a84b6b763dcd2bed server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:21.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.916+0000 7f47d3fff640 1 -- 172.21.15.60:0/3524159076 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c4036070 con 0x7f47d415c2a0 2024-09-12T01:43:21.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.916+0000 7f47d3fff640 1 -- 172.21.15.60:0/3524159076 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47c4031600 con 0x7f47d415c2a0 2024-09-12T01:43:21.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.917+0000 7f47d3fff640 1 -- 172.21.15.60:0/3524159076 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47c40319d0 con 0x7f47d415c2a0 2024-09-12T01:43:21.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.917+0000 7f47db38d640 1 -- 172.21.15.60:0/3524159076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d415c2a0 msgr2=0x7f47d40735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.917+0000 7f47db38d640 1 --2- 172.21.15.60:0/3524159076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d415c2a0 0x7f47d40735d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009e50 tx=0x7f47c402a710 comp rx=0 tx=0).stop 2024-09-12T01:43:21.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.917+0000 7f47db38d640 1 -- 172.21.15.60:0/3524159076 shutdown_connections 2024-09-12T01:43:21.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.917+0000 7f47db38d640 1 --2- 172.21.15.60:0/3524159076 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d406fe20 0x7f47d406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.917+0000 7f47db38d640 1 --2- 172.21.15.60:0/3524159076 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d415c2a0 0x7f47d40735d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.917+0000 7f47db38d640 1 -- 172.21.15.60:0/3524159076 >> 172.21.15.60:0/3524159076 conn(0x7f47d40b3070 msgr2=0x7f47d40b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:21.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.917+0000 7f47db38d640 1 -- 172.21.15.60:0/3524159076 shutdown_connections 2024-09-12T01:43:21.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.917+0000 7f47db38d640 1 -- 172.21.15.60:0/3524159076 wait complete. 2024-09-12T01:43:21.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.918+0000 7f47db38d640 1 Processor -- start 2024-09-12T01:43:21.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.918+0000 7f47db38d640 1 -- start start 2024-09-12T01:43:21.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.919+0000 7f47db38d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d406fe20 0x7f47d40b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.919+0000 7f47db38d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d4073b10 0x7f47d4151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.919+0000 7f47db38d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d415c2a0 0x7f47d4157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.919+0000 7f47db38d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47d40b5f20 con 0x7f47d415c2a0 2024-09-12T01:43:21.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.919+0000 7f47db38d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f47d415ebf0 con 0x7f47d406fe20 2024-09-12T01:43:21.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.919+0000 7f47db38d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f47d40b60a0 con 0x7f47d4073b10 2024-09-12T01:43:21.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.919+0000 7f47d992a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d415c2a0 0x7f47d4157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.919+0000 7f47d992a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d415c2a0 0x7f47d4157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53598/0 (socket says 172.21.15.60:53598) 2024-09-12T01:43:21.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.919+0000 7f47d992a640 1 -- 172.21.15.60:0/2426730290 learned_addr learned my addr 172.21.15.60:0/2426730290 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:21.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.919+0000 7f47d9129640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d406fe20 0x7f47d40b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.919+0000 7f47d8928640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d4073b10 0x7f47d4151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47d992a640 1 -- 172.21.15.60:0/2426730290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d4073b10 msgr2=0x7f47d4151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47d992a640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d4073b10 0x7f47d4151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47d992a640 1 -- 172.21.15.60:0/2426730290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d406fe20 msgr2=0x7f47d40b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:21.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47d992a640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d406fe20 0x7f47d40b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:21.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47d992a640 1 -- 172.21.15.60:0/2426730290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d40ce1e0 con 0x7f47d415c2a0 2024-09-12T01:43:21.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47d9129640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d406fe20 0x7f47d40b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:21.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47d8928640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d4073b10 0x7f47d4151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:21.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47d992a640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d415c2a0 0x7f47d4157e90 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f47cc00e930 tx=0x7f47cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:21.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47d1ffb640 1 -- 172.21.15.60:0/2426730290 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc017070 con 0x7f47d415c2a0 2024-09-12T01:43:21.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47d1ffb640 1 -- 172.21.15.60:0/2426730290 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47cc00ca00 con 0x7f47d415c2a0 2024-09-12T01:43:21.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47d1ffb640 1 -- 172.21.15.60:0/2426730290 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47cc00cdd0 con 0x7f47d415c2a0 2024-09-12T01:43:21.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47db38d640 1 -- 172.21.15.60:0/2426730290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47d4073590 con 0x7f47d415c2a0 2024-09-12T01:43:21.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.920+0000 7f47db38d640 1 -- 172.21.15.60:0/2426730290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47d4159730 con 0x7f47d415c2a0 2024-09-12T01:43:21.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.921+0000 7f47db38d640 1 -- 172.21.15.60:0/2426730290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d415fa70 con 0x7f47d415c2a0 2024-09-12T01:43:21.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.922+0000 7f47d1ffb640 1 -- 172.21.15.60:0/2426730290 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f47cc01a070 con 0x7f47d415c2a0 2024-09-12T01:43:21.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.922+0000 7f47d1ffb640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f47c006be30 0x7f47c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:21.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.922+0000 7f47d1ffb640 1 -- 172.21.15.60:0/2426730290 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f47cc08aca0 con 0x7f47d415c2a0 2024-09-12T01:43:21.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.922+0000 7f47d9129640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f47c006be30 0x7f47c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:21.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.923+0000 7f47d9129640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f47c006be30 0x7f47c006e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f47c4033000 tx=0x7f47c4009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:21.927+0000 7f47d1ffb640 1 -- 172.21.15.60:0/2426730290 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f47d40ce1e0 con 0x7f47d415c2a0 2024-09-12T01:43:22.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.104+0000 7f47db38d640 1 -- 172.21.15.60:0/2426730290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7f47d4073870 con 0x7f47d415c2a0 2024-09-12T01:43:22.108 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.107+0000 7f47d1ffb640 1 -- 172.21.15.60:0/2426730290 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v49)=0 v49) ==== 128+0+0 (secure 0 0 0) 0x7f47cc059000 con 0x7f47d415c2a0 2024-09-12T01:43:22.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.110+0000 7f47db38d640 1 -- 172.21.15.60:0/2426730290 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f47c006be30 msgr2=0x7f47c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.114 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.110+0000 7f47db38d640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f47c006be30 0x7f47c006e2f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f47c4033000 tx=0x7f47c4009000 comp rx=0 tx=0).stop 2024-09-12T01:43:22.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.110+0000 7f47db38d640 1 -- 172.21.15.60:0/2426730290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d415c2a0 msgr2=0x7f47d4157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.110+0000 7f47db38d640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d415c2a0 0x7f47d4157e90 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f47cc00e930 tx=0x7f47cc00edf0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.110+0000 7f47db38d640 1 -- 172.21.15.60:0/2426730290 shutdown_connections 2024-09-12T01:43:22.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.110+0000 7f47db38d640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d415c2a0 0x7f47d4157e90 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.110+0000 7f47db38d640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f47c006be30 0x7f47c006e2f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.115 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.110+0000 7f47db38d640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f47d4073b10 0x7f47d4151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.110+0000 7f47db38d640 1 --2- 172.21.15.60:0/2426730290 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f47d406fe20 0x7f47d40b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.110+0000 7f47db38d640 1 -- 172.21.15.60:0/2426730290 >> 172.21.15.60:0/2426730290 conn(0x7f47d40b3070 msgr2=0x7f47d40b1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:22.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.110+0000 7f47db38d640 1 -- 172.21.15.60:0/2426730290 shutdown_connections 2024-09-12T01:43:22.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.110+0000 7f47db38d640 1 -- 172.21.15.60:0/2426730290 wait complete. 2024-09-12T01:43:22.122 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-12T01:43:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.226+0000 7f865fa2e640 1 Processor -- start 2024-09-12T01:43:22.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.227+0000 7f865fa2e640 1 -- start start 2024-09-12T01:43:22.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.227+0000 7f865fa2e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f86580b68f0 0x7f86581696f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.227+0000 7f865fa2e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86580cf860 con 0x7f865815e7a0 2024-09-12T01:43:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.227+0000 7f865fa2e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86580cfb40 con 0x7f86580cf1f0 2024-09-12T01:43:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.227+0000 7f865fa2e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f86580d2ca0 con 0x7f86580b68f0 2024-09-12T01:43:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.228+0000 7f865d7ca640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f865815e7a0 0x7f865806caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50356/0 (socket says 172.21.15.60:50356) 2024-09-12T01:43:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.228+0000 7f865d7ca640 1 -- 172.21.15.60:0/1387412531 learned_addr learned my addr 172.21.15.60:0/1387412531 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.228+0000 7f865dfcb640 1 --2- 172.21.15.60:0/1387412531 >> v2:172.21.15.105:3300/0 conn(0x7f86580b68f0 0x7f86581696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.228+0000 7f864ffff640 1 -- 172.21.15.60:0/1387412531 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4236539582 0 0) 0x7f86580cf860 con 0x7f865815e7a0 2024-09-12T01:43:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.228+0000 7f864ffff640 1 -- 172.21.15.60:0/1387412531 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8644003520 con 0x7f865815e7a0 2024-09-12T01:43:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.228+0000 7f865dfcb640 1 -- 172.21.15.60:0/1387412531 >> v1:172.21.15.105:6789/0 conn(0x7f86580cf1f0 legacy=0x7f86580b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.228+0000 7f865dfcb640 1 -- 172.21.15.60:0/1387412531 >> v1:172.21.15.60:6789/0 conn(0x7f865815e7a0 legacy=0x7f865806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.228+0000 7f864ffff640 1 -- 172.21.15.60:0/1387412531 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182155739 0 0) 0x7f86580cfb40 con 0x7f86580cf1f0 2024-09-12T01:43:22.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.228+0000 7f865dfcb640 1 -- 172.21.15.60:0/1387412531 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86580cfe20 con 0x7f86580b68f0 2024-09-12T01:43:22.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.229+0000 7f865dfcb640 1 --2- 172.21.15.60:0/1387412531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86580b68f0 0x7f86581696f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8650009d90 tx=0x7f865002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8f8e169334da475 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:22.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.229+0000 7f864ffff640 1 -- 172.21.15.60:0/1387412531 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650035020 con 0x7f86580b68f0 2024-09-12T01:43:22.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.229+0000 7f864ffff640 1 -- 172.21.15.60:0/1387412531 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8650007540 con 0x7f86580b68f0 2024-09-12T01:43:22.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.229+0000 7f864ffff640 1 -- 172.21.15.60:0/1387412531 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86540015f0 con 0x7f86580b68f0 2024-09-12T01:43:22.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.230+0000 7f865fa2e640 1 -- 172.21.15.60:0/1387412531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86580b68f0 msgr2=0x7f86581696f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.230+0000 7f865fa2e640 1 --2- 172.21.15.60:0/1387412531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86580b68f0 0x7f86581696f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8650009d90 tx=0x7f865002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.230+0000 7f865fa2e640 1 -- 172.21.15.60:0/1387412531 shutdown_connections 2024-09-12T01:43:22.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.230+0000 7f865fa2e640 1 --2- 172.21.15.60:0/1387412531 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86580b68f0 0x7f86581696f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.230+0000 7f865fa2e640 1 -- 172.21.15.60:0/1387412531 >> 172.21.15.60:0/1387412531 conn(0x7f86580d11e0 msgr2=0x7f86580d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:22.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.230+0000 7f865fa2e640 1 -- 172.21.15.60:0/1387412531 shutdown_connections 2024-09-12T01:43:22.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.230+0000 7f865fa2e640 1 -- 172.21.15.60:0/1387412531 wait complete. 2024-09-12T01:43:22.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.231+0000 7f865fa2e640 1 Processor -- start 2024-09-12T01:43:22.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.231+0000 7f865fa2e640 1 -- start start 2024-09-12T01:43:22.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865fa2e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86580b68f0 0x7f86580b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865fa2e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86580cf1f0 0x7f8658151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865fa2e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f865815e7a0 0x7f86581f77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865fa2e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f86580d4420 con 0x7f86580b68f0 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865fa2e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86580b7a00 con 0x7f86580cf1f0 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865fa2e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86581523c0 con 0x7f865815e7a0 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865d7ca640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86580b68f0 0x7f86580b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865d7ca640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86580b68f0 0x7f86580b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53614/0 (socket says 172.21.15.60:53614) 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865d7ca640 1 -- 172.21.15.60:0/2131315002 learned_addr learned my addr 172.21.15.60:0/2131315002 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865dfcb640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f865815e7a0 0x7f86581f77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865cfc9640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86580cf1f0 0x7f8658151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865d7ca640 1 -- 172.21.15.60:0/2131315002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f865815e7a0 msgr2=0x7f86581f77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865d7ca640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f865815e7a0 0x7f86581f77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865d7ca640 1 -- 172.21.15.60:0/2131315002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86580cf1f0 msgr2=0x7f8658151e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865d7ca640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86580cf1f0 0x7f8658151e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865d7ca640 1 -- 172.21.15.60:0/2131315002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86580b4d70 con 0x7f86580b68f0 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.232+0000 7f865d7ca640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86580b68f0 0x7f86580b6010 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f865400c7b0 tx=0x7f865400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.233+0000 7f864dffb640 1 -- 172.21.15.60:0/2131315002 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654018070 con 0x7f86580b68f0 2024-09-12T01:43:22.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.233+0000 7f865fa2e640 1 -- 172.21.15.60:0/2131315002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86580b5050 con 0x7f86580b68f0 2024-09-12T01:43:22.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.233+0000 7f864dffb640 1 -- 172.21.15.60:0/2131315002 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86540072f0 con 0x7f86580b68f0 2024-09-12T01:43:22.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.233+0000 7f864dffb640 1 -- 172.21.15.60:0/2131315002 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86540047e0 con 0x7f86580b68f0 2024-09-12T01:43:22.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.233+0000 7f865fa2e640 1 -- 172.21.15.60:0/2131315002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86580b5610 con 0x7f86580b68f0 2024-09-12T01:43:22.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.234+0000 7f865fa2e640 1 -- 172.21.15.60:0/2131315002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86580d2a80 con 0x7f86580b68f0 2024-09-12T01:43:22.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.234+0000 7f864dffb640 1 -- 172.21.15.60:0/2131315002 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8654004980 con 0x7f86580b68f0 2024-09-12T01:43:22.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.234+0000 7f864dffb640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f863c06be30 0x7f863c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.235+0000 7f864dffb640 1 -- 172.21.15.60:0/2131315002 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f865408a3f0 con 0x7f86580b68f0 2024-09-12T01:43:22.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.235+0000 7f865cfc9640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f863c06be30 0x7f863c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.235+0000 7f865cfc9640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f863c06be30 0x7f863c06e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8648007fd0 tx=0x7f8648009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:22.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.239+0000 7f864dffb640 1 -- 172.21.15.60:0/2131315002 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8654004c70 con 0x7f86580b68f0 2024-09-12T01:43:22.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.414+0000 7f865fa2e640 1 -- 172.21.15.60:0/2131315002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7f8658156740 con 0x7f86580b68f0 2024-09-12T01:43:22.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.414+0000 7f864dffb640 1 -- 172.21.15.60:0/2131315002 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v49) ==== 106+0+4 (secure 0 0 0) 0x7f8654058d20 con 0x7f86580b68f0 2024-09-12T01:43:22.415 INFO:teuthology.orchestra.run.smithi060.stdout:100 2024-09-12T01:43:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.416+0000 7f865fa2e640 1 -- 172.21.15.60:0/2131315002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f863c06be30 msgr2=0x7f863c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.416+0000 7f865fa2e640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f863c06be30 0x7f863c06e2f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8648007fd0 tx=0x7f8648009040 comp rx=0 tx=0).stop 2024-09-12T01:43:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.416+0000 7f865fa2e640 1 -- 172.21.15.60:0/2131315002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86580b68f0 msgr2=0x7f86580b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.416+0000 7f865fa2e640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86580b68f0 0x7f86580b6010 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f865400c7b0 tx=0x7f865400cc70 comp rx=0 tx=0).stop 2024-09-12T01:43:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.416+0000 7f865fa2e640 1 -- 172.21.15.60:0/2131315002 shutdown_connections 2024-09-12T01:43:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.416+0000 7f865fa2e640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f863c06be30 0x7f863c06e2f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.416+0000 7f865fa2e640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f865815e7a0 0x7f86581f77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.416+0000 7f865fa2e640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f86580cf1f0 0x7f8658151e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.416+0000 7f865fa2e640 1 --2- 172.21.15.60:0/2131315002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86580b68f0 0x7f86580b6010 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.416+0000 7f865fa2e640 1 -- 172.21.15.60:0/2131315002 >> 172.21.15.60:0/2131315002 conn(0x7f86580d11e0 msgr2=0x7f8658155b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:22.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.417+0000 7f865fa2e640 1 -- 172.21.15.60:0/2131315002 shutdown_connections 2024-09-12T01:43:22.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.417+0000 7f865fa2e640 1 -- 172.21.15.60:0/2131315002 wait complete. 2024-09-12T01:43:22.428 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 100 2024-09-12T01:43:22.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.532+0000 7f1e6f2ba640 1 Processor -- start 2024-09-12T01:43:22.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.532+0000 7f1e6f2ba640 1 -- start start 2024-09-12T01:43:22.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.533+0000 7f1e6f2ba640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1e6815e6f0 0x7f1e6806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.533+0000 7f1e6f2ba640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e6806e990 con 0x7f1e680b7450 2024-09-12T01:43:22.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.533+0000 7f1e6f2ba640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e6806ec70 con 0x7f1e680b54d0 2024-09-12T01:43:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.533+0000 7f1e6f2ba640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1e6815ec70 con 0x7f1e6815e6f0 2024-09-12T01:43:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.533+0000 7f1e6d857640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1e680b7450 0x7f1e68070830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50362/0 (socket says 172.21.15.60:50362) 2024-09-12T01:43:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.533+0000 7f1e6d857640 1 -- 172.21.15.60:0/956229101 learned_addr learned my addr 172.21.15.60:0/956229101 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.534+0000 7f1e6d056640 1 --2- 172.21.15.60:0/956229101 >> v2:172.21.15.105:3300/0 conn(0x7f1e6815e6f0 0x7f1e6806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.534+0000 7f1e67fff640 1 -- 172.21.15.60:0/956229101 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402453990 0 0) 0x7f1e6806e990 con 0x7f1e680b7450 2024-09-12T01:43:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.534+0000 7f1e67fff640 1 -- 172.21.15.60:0/956229101 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e50003520 con 0x7f1e680b7450 2024-09-12T01:43:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.534+0000 7f1e6d056640 1 -- 172.21.15.60:0/956229101 >> v1:172.21.15.105:6789/0 conn(0x7f1e680b54d0 legacy=0x7f1e680b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.534+0000 7f1e67fff640 1 -- 172.21.15.60:0/956229101 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3293259323 0 0) 0x7f1e6806ec70 con 0x7f1e680b54d0 2024-09-12T01:43:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.534+0000 7f1e6d056640 1 -- 172.21.15.60:0/956229101 >> v1:172.21.15.60:6789/0 conn(0x7f1e680b7450 legacy=0x7f1e68070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.535 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.534+0000 7f1e6d056640 1 -- 172.21.15.60:0/956229101 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e6815ef50 con 0x7f1e6815e6f0 2024-09-12T01:43:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.535+0000 7f1e6d056640 1 --2- 172.21.15.60:0/956229101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e6815e6f0 0x7f1e6806fd00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1e600097a0 tx=0x7f1e6002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57145add1662bacd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.535+0000 7f1e67fff640 1 -- 172.21.15.60:0/956229101 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e60037070 con 0x7f1e6815e6f0 2024-09-12T01:43:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.535+0000 7f1e67fff640 1 -- 172.21.15.60:0/956229101 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e6002ac30 con 0x7f1e6815e6f0 2024-09-12T01:43:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.535+0000 7f1e67fff640 1 -- 172.21.15.60:0/956229101 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e580019f0 con 0x7f1e6815e6f0 2024-09-12T01:43:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.535+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/956229101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e6815e6f0 msgr2=0x7f1e6806fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.535+0000 7f1e6f2ba640 1 --2- 172.21.15.60:0/956229101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e6815e6f0 0x7f1e6806fd00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1e600097a0 tx=0x7f1e6002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.535+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/956229101 shutdown_connections 2024-09-12T01:43:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.535+0000 7f1e6f2ba640 1 --2- 172.21.15.60:0/956229101 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e6815e6f0 0x7f1e6806fd00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.535+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/956229101 >> 172.21.15.60:0/956229101 conn(0x7f1e680d2430 msgr2=0x7f1e680d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.536+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/956229101 shutdown_connections 2024-09-12T01:43:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.536+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/956229101 wait complete. 2024-09-12T01:43:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.537+0000 7f1e6f2ba640 1 Processor -- start 2024-09-12T01:43:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.537+0000 7f1e6f2ba640 1 -- start start 2024-09-12T01:43:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.537+0000 7f1e6f2ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e680b54d0 0x7f1e68156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.537+0000 7f1e6f2ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e680b7450 0x7f1e6815c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.537+0000 7f1e6f2ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e6815e6f0 0x7f1e68152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.537+0000 7f1e6f2ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6806e730 con 0x7f1e680b7450 2024-09-12T01:43:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.537+0000 7f1e6f2ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1e6806e5b0 con 0x7f1e6815e6f0 2024-09-12T01:43:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.537+0000 7f1e6f2ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1e6815f750 con 0x7f1e680b54d0 2024-09-12T01:43:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6c855640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e680b7450 0x7f1e6815c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6c855640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e680b7450 0x7f1e6815c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:53622/0 (socket says 172.21.15.60:53622) 2024-09-12T01:43:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6c855640 1 -- 172.21.15.60:0/328401949 learned_addr learned my addr 172.21.15.60:0/328401949 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6d857640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e6815e6f0 0x7f1e68152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6d056640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e680b54d0 0x7f1e68156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6c855640 1 -- 172.21.15.60:0/328401949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e680b54d0 msgr2=0x7f1e68156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6c855640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e680b54d0 0x7f1e68156770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6c855640 1 -- 172.21.15.60:0/328401949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e6815e6f0 msgr2=0x7f1e68152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6c855640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e6815e6f0 0x7f1e68152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6c855640 1 -- 172.21.15.60:0/328401949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e681f7dc0 con 0x7f1e680b7450 2024-09-12T01:43:22.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6c855640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e680b7450 0x7f1e6815c4c0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00c520 tx=0x7f1e5c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:22.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e65ffb640 1 -- 172.21.15.60:0/328401949 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c017070 con 0x7f1e680b7450 2024-09-12T01:43:22.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e65ffb640 1 -- 172.21.15.60:0/328401949 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e5c0035f0 con 0x7f1e680b7450 2024-09-12T01:43:22.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/328401949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e681f80a0 con 0x7f1e680b7450 2024-09-12T01:43:22.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e65ffb640 1 -- 172.21.15.60:0/328401949 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c0039e0 con 0x7f1e680b7450 2024-09-12T01:43:22.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.538+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/328401949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e681f8660 con 0x7f1e680b7450 2024-09-12T01:43:22.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.540+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/328401949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e68068e10 con 0x7f1e680b7450 2024-09-12T01:43:22.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.540+0000 7f1e65ffb640 1 -- 172.21.15.60:0/328401949 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1e5c01a070 con 0x7f1e680b7450 2024-09-12T01:43:22.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.540+0000 7f1e65ffb640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1e5406be30 0x7f1e5406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.541+0000 7f1e65ffb640 1 -- 172.21.15.60:0/328401949 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f1e5c08a250 con 0x7f1e680b7450 2024-09-12T01:43:22.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.541+0000 7f1e6d056640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1e5406be30 0x7f1e5406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.541+0000 7f1e6d056640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1e5406be30 0x7f1e5406e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1e60034000 tx=0x7f1e6002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:22.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.545+0000 7f1e65ffb640 1 -- 172.21.15.60:0/328401949 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1e5c058c90 con 0x7f1e680b7450 2024-09-12T01:43:22.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.720+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/328401949 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7f1e680b2d30 con 0x7f1e680b7450 2024-09-12T01:43:22.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.723+0000 7f1e65ffb640 1 -- 172.21.15.60:0/328401949 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v50)=0 v50) ==== 124+0+0 (secure 0 0 0) 0x7f1e5c058590 con 0x7f1e680b7450 2024-09-12T01:43:22.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.726+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/328401949 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1e5406be30 msgr2=0x7f1e5406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.726+0000 7f1e6f2ba640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1e5406be30 0x7f1e5406e2f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1e60034000 tx=0x7f1e6002e000 comp rx=0 tx=0).stop 2024-09-12T01:43:22.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.726+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/328401949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e680b7450 msgr2=0x7f1e6815c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.726+0000 7f1e6f2ba640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e680b7450 0x7f1e6815c4c0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c00c520 tx=0x7f1e5c00c9e0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.726+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/328401949 shutdown_connections 2024-09-12T01:43:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.726+0000 7f1e6f2ba640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1e6815e6f0 0x7f1e68152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.726+0000 7f1e6f2ba640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e680b7450 0x7f1e6815c4c0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.726+0000 7f1e6f2ba640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1e5406be30 0x7f1e5406e2f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.726+0000 7f1e6f2ba640 1 --2- 172.21.15.60:0/328401949 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1e680b54d0 0x7f1e68156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.726+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/328401949 >> 172.21.15.60:0/328401949 conn(0x7f1e680d2430 msgr2=0x7f1e680b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.726+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/328401949 shutdown_connections 2024-09-12T01:43:22.727 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.726+0000 7f1e6f2ba640 1 -- 172.21.15.60:0/328401949 wait complete. 2024-09-12T01:43:22.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_max_caps_per_client 2024-09-12T01:43:22.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.840+0000 7f01a8847640 1 Processor -- start 2024-09-12T01:43:22.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.840+0000 7f01a8847640 1 -- start start 2024-09-12T01:43:22.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.841+0000 7f01a8847640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01a415e7a0 0x7f01a406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.841+0000 7f01a8847640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f01a40cf1f0 0x7f01a40b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.841+0000 7f01a8847640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01a40cf860 con 0x7f01a40b6720 2024-09-12T01:43:22.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.841+0000 7f01a8847640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f01a40d2ca0 con 0x7f01a40cf1f0 2024-09-12T01:43:22.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.841+0000 7f01a8847640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f01a40cfb40 con 0x7f01a415e7a0 2024-09-12T01:43:22.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.841+0000 7f01a1d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f01a40cf1f0 0x7f01a40b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.841+0000 7f01a1d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f01a40cf1f0 0x7f01a40b61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34614/0 (socket says 172.21.15.60:34614) 2024-09-12T01:43:22.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.841+0000 7f01a1d9b640 1 -- 172.21.15.60:0/4114715915 learned_addr learned my addr 172.21.15.60:0/4114715915 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:22.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.842+0000 7f01a259c640 1 --2- 172.21.15.60:0/4114715915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01a415e7a0 0x7f01a406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.842+0000 7f01a1d9b640 1 -- 172.21.15.60:0/4114715915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01a415e7a0 msgr2=0x7f01a406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:22.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.842+0000 7f01a1d9b640 1 --2- 172.21.15.60:0/4114715915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01a415e7a0 0x7f01a406caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.842+0000 7f01a1d9b640 1 -- 172.21.15.60:0/4114715915 >> v1:172.21.15.105:6789/0 conn(0x7f01a40b6720 legacy=0x7f01a41623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:22.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.842+0000 7f01a1d9b640 1 -- 172.21.15.60:0/4114715915 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a40cfe20 con 0x7f01a40cf1f0 2024-09-12T01:43:22.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.842+0000 7f01a259c640 1 --2- 172.21.15.60:0/4114715915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01a415e7a0 0x7f01a406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:22.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.843+0000 7f01a1d9b640 1 --2- 172.21.15.60:0/4114715915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a40cf1f0 0x7f01a40b61e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f018c009870 tx=0x7f018c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac95f8eca1bdb815 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:22.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.843+0000 7f01a159a640 1 -- 172.21.15.60:0/4114715915 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c037070 con 0x7f01a40cf1f0 2024-09-12T01:43:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.843+0000 7f01a159a640 1 -- 172.21.15.60:0/4114715915 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018c032440 con 0x7f01a40cf1f0 2024-09-12T01:43:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.843+0000 7f01a159a640 1 -- 172.21.15.60:0/4114715915 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c032810 con 0x7f01a40cf1f0 2024-09-12T01:43:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.843+0000 7f01a8847640 1 -- 172.21.15.60:0/4114715915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a40cf1f0 msgr2=0x7f01a40b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.843+0000 7f01a8847640 1 --2- 172.21.15.60:0/4114715915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a40cf1f0 0x7f01a40b61e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f018c009870 tx=0x7f018c02a1c0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.843+0000 7f01a8847640 1 -- 172.21.15.60:0/4114715915 shutdown_connections 2024-09-12T01:43:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.843+0000 7f01a8847640 1 --2- 172.21.15.60:0/4114715915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a40cf1f0 0x7f01a40b61e0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.843+0000 7f01a8847640 1 --2- 172.21.15.60:0/4114715915 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01a415e7a0 0x7f01a406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.843+0000 7f01a8847640 1 -- 172.21.15.60:0/4114715915 >> 172.21.15.60:0/4114715915 conn(0x7f01a40d11e0 msgr2=0x7f01a40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.843+0000 7f01a8847640 1 -- 172.21.15.60:0/4114715915 shutdown_connections 2024-09-12T01:43:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.843+0000 7f01a8847640 1 -- 172.21.15.60:0/4114715915 wait complete. 2024-09-12T01:43:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.845+0000 7f01a8847640 1 Processor -- start 2024-09-12T01:43:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.845+0000 7f01a8847640 1 -- start start 2024-09-12T01:43:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.845+0000 7f01a8847640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01a40b6720 0x7f01a40cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.845+0000 7f01a8847640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a40cf1f0 0x7f01a4149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.845+0000 7f01a8847640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01a415e7a0 0x7f01a40b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.845+0000 7f01a8847640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f01a406cfe0 con 0x7f01a40cf1f0 2024-09-12T01:43:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.845+0000 7f01a8847640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f01a40b7a00 con 0x7f01a40b6720 2024-09-12T01:43:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.845+0000 7f01a8847640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f01a40d4420 con 0x7f01a415e7a0 2024-09-12T01:43:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a40cf1f0 0x7f01a4149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a1d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a40cf1f0 0x7f01a4149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34620/0 (socket says 172.21.15.60:34620) 2024-09-12T01:43:22.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a1d9b640 1 -- 172.21.15.60:0/3494690536 learned_addr learned my addr 172.21.15.60:0/3494690536 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:22.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a259c640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01a40b6720 0x7f01a40cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a2d9d640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01a415e7a0 0x7f01a40b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a1d9b640 1 -- 172.21.15.60:0/3494690536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01a415e7a0 msgr2=0x7f01a40b7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a1d9b640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01a415e7a0 0x7f01a40b7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a1d9b640 1 -- 172.21.15.60:0/3494690536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01a40b6720 msgr2=0x7f01a40cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:22.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a1d9b640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01a40b6720 0x7f01a40cab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:22.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a1d9b640 1 -- 172.21.15.60:0/3494690536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a414c980 con 0x7f01a40cf1f0 2024-09-12T01:43:22.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a1d9b640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a40cf1f0 0x7f01a4149a00 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f018c009870 tx=0x7f018c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:22.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f019affd640 1 -- 172.21.15.60:0/3494690536 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c041070 con 0x7f01a40cf1f0 2024-09-12T01:43:22.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f019affd640 1 -- 172.21.15.60:0/3494690536 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f018c03c870 con 0x7f01a40cf1f0 2024-09-12T01:43:22.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a8847640 1 -- 172.21.15.60:0/3494690536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a40cd760 con 0x7f01a40cf1f0 2024-09-12T01:43:22.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f019affd640 1 -- 172.21.15.60:0/3494690536 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c037040 con 0x7f01a40cf1f0 2024-09-12T01:43:22.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.846+0000 7f01a8847640 1 -- 172.21.15.60:0/3494690536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a40cdd20 con 0x7f01a40cf1f0 2024-09-12T01:43:22.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.848+0000 7f01a8847640 1 -- 172.21.15.60:0/3494690536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a415fd00 con 0x7f01a40cf1f0 2024-09-12T01:43:22.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.848+0000 7f019affd640 1 -- 172.21.15.60:0/3494690536 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f018c044070 con 0x7f01a40cf1f0 2024-09-12T01:43:22.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.848+0000 7f019affd640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f018406be30 0x7f018406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:22.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.849+0000 7f019affd640 1 -- 172.21.15.60:0/3494690536 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f018c0ab8f0 con 0x7f01a40cf1f0 2024-09-12T01:43:22.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.849+0000 7f01a259c640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f018406be30 0x7f018406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:22.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.849+0000 7f01a259c640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f018406be30 0x7f018406e2f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f019c00aac0 tx=0x7f019c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:22.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:22.853+0000 7f019affd640 1 -- 172.21.15.60:0/3494690536 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f018c079c50 con 0x7f01a40cf1f0 2024-09-12T01:43:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.029+0000 7f01a8847640 1 -- 172.21.15.60:0/3494690536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"} v 0) -- 0x7f01a415c4d0 con 0x7f01a40cf1f0 2024-09-12T01:43:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.029+0000 7f019affd640 1 -- 172.21.15.60:0/3494690536 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"}]=0 v50) ==== 106+0+8 (secure 0 0 0) 0x7f018c07df50 con 0x7f01a40cf1f0 2024-09-12T01:43:23.030 INFO:teuthology.orchestra.run.smithi060.stdout:1048576 2024-09-12T01:43:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.031+0000 7f01a8847640 1 -- 172.21.15.60:0/3494690536 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f018406be30 msgr2=0x7f018406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.031+0000 7f01a8847640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f018406be30 0x7f018406e2f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f019c00aac0 tx=0x7f019c008040 comp rx=0 tx=0).stop 2024-09-12T01:43:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.031+0000 7f01a8847640 1 -- 172.21.15.60:0/3494690536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a40cf1f0 msgr2=0x7f01a4149a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.031+0000 7f01a8847640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a40cf1f0 0x7f01a4149a00 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f018c009870 tx=0x7f018c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.032+0000 7f01a8847640 1 -- 172.21.15.60:0/3494690536 shutdown_connections 2024-09-12T01:43:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.032+0000 7f01a8847640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f018406be30 0x7f018406e2f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.032+0000 7f01a8847640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01a415e7a0 0x7f01a40b7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.032+0000 7f01a8847640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a40cf1f0 0x7f01a4149a00 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.032+0000 7f01a8847640 1 --2- 172.21.15.60:0/3494690536 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f01a40b6720 0x7f01a40cab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.032+0000 7f01a8847640 1 -- 172.21.15.60:0/3494690536 >> 172.21.15.60:0/3494690536 conn(0x7f01a40d11e0 msgr2=0x7f01a4162c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.032+0000 7f01a8847640 1 -- 172.21.15.60:0/3494690536 shutdown_connections 2024-09-12T01:43:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.032+0000 7f01a8847640 1 -- 172.21.15.60:0/3494690536 wait complete. 2024-09-12T01:43:23.043 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-09-12T01:43:23.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.148+0000 7f757e01e640 1 Processor -- start 2024-09-12T01:43:23.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.148+0000 7f757e01e640 1 -- start start 2024-09-12T01:43:23.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.148+0000 7f757e01e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75780cf1f0 0x7f75780b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.148+0000 7f757e01e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75780cf860 con 0x7f757815e7a0 2024-09-12T01:43:23.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.148+0000 7f757e01e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75780cfb40 con 0x7f75780b6720 2024-09-12T01:43:23.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.148+0000 7f757e01e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f75780d2ca0 con 0x7f75780cf1f0 2024-09-12T01:43:23.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75777fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f757815e7a0 0x7f757806caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48746/0 (socket says 172.21.15.60:48746) 2024-09-12T01:43:23.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75777fe640 1 -- 172.21.15.60:0/143046075 learned_addr learned my addr 172.21.15.60:0/143046075 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:23.152 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f7576ffd640 1 --2- 172.21.15.60:0/143046075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75780cf1f0 0x7f75780b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627185041 0 0) 0x7f75780cf860 con 0x7f757815e7a0 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7560003520 con 0x7f757815e7a0 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1827102935 0 0) 0x7f7560003520 con 0x7f757815e7a0 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75780cf1f0 msgr2=0x7f75780b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 --2- 172.21.15.60:0/143046075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75780cf1f0 0x7f75780b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 >> v1:172.21.15.105:6789/0 conn(0x7f75780b6720 legacy=0x7f75780d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75780cfe20 con 0x7f757815e7a0 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f7568001670 con 0x7f757815e7a0 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 >> v1:172.21.15.60:6789/0 conn(0x7f757815e7a0 legacy=0x7f757806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 --2- 172.21.15.60:0/143046075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75780cf1f0 0x7f75600039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 --2- 172.21.15.60:0/143046075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7560003f20 0x7f7560004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 --2- 172.21.15.60:0/143046075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7560004d40 0x7f75600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f75780d2ca0 con 0x7f7560004d40 2024-09-12T01:43:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f756000bad0 con 0x7f7560003f20 2024-09-12T01:43:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f756000bcd0 con 0x7f75780cf1f0 2024-09-12T01:43:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f7577fff640 1 --2- 172.21.15.60:0/143046075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7560004d40 0x7f75600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f75777fe640 1 --2- 172.21.15.60:0/143046075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75780cf1f0 0x7f75600039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.149+0000 7f7576ffd640 1 --2- 172.21.15.60:0/143046075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7560003f20 0x7f7560004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.150+0000 7f7577fff640 1 -- 172.21.15.60:0/143046075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75780cf1f0 msgr2=0x7f75600039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.150+0000 7f7577fff640 1 --2- 172.21.15.60:0/143046075 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75780cf1f0 0x7f75600039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.150+0000 7f7577fff640 1 -- 172.21.15.60:0/143046075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7560003f20 msgr2=0x7f7560004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.150+0000 7f7577fff640 1 --2- 172.21.15.60:0/143046075 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7560003f20 0x7f7560004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.150+0000 7f7577fff640 1 -- 172.21.15.60:0/143046075 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7560003520 con 0x7f7560004d40 2024-09-12T01:43:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.150+0000 7f7577fff640 1 --2- 172.21.15.60:0/143046075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7560004d40 0x7f75600051c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f7570001f60 tx=0x7f7560005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80057423cc3bf30 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:23.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.151+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570001b30 con 0x7f7560004d40 2024-09-12T01:43:23.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.151+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7570031620 con 0x7f7560004d40 2024-09-12T01:43:23.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.151+0000 7f75767fc640 1 -- 172.21.15.60:0/143046075 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570031a10 con 0x7f7560004d40 2024-09-12T01:43:23.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.151+0000 7f757e01e640 1 -- 172.21.15.60:0/143046075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7560004d40 msgr2=0x7f75600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.151+0000 7f757e01e640 1 --2- 172.21.15.60:0/143046075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7560004d40 0x7f75600051c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f7570001f60 tx=0x7f7560005830 comp rx=0 tx=0).stop 2024-09-12T01:43:23.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.151+0000 7f7577fff640 1 -- 172.21.15.60:0/143046075 reap_dead start 2024-09-12T01:43:23.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.151+0000 7f757e01e640 1 -- 172.21.15.60:0/143046075 shutdown_connections 2024-09-12T01:43:23.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.151+0000 7f757e01e640 1 -- 172.21.15.60:0/143046075 >> 172.21.15.60:0/143046075 conn(0x7f75780d11e0 msgr2=0x7f75780d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:23.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.151+0000 7f757e01e640 1 -- 172.21.15.60:0/143046075 shutdown_connections 2024-09-12T01:43:23.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.151+0000 7f757e01e640 1 -- 172.21.15.60:0/143046075 wait complete. 2024-09-12T01:43:23.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.152+0000 7f757e01e640 1 Processor -- start 2024-09-12T01:43:23.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.153+0000 7f757e01e640 1 -- start start 2024-09-12T01:43:23.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.153+0000 7f757e01e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7560004d40 0x7f75781f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.153+0000 7f757e01e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75781f7830 0x7f75780d4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.153+0000 7f757e01e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75780ca7d0 0x7f75781f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.153+0000 7f757e01e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f757815eb80 con 0x7f7560004d40 2024-09-12T01:43:23.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.153+0000 7f757e01e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f75780b7a00 con 0x7f75780ca7d0 2024-09-12T01:43:23.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.153+0000 7f757e01e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f757815ed00 con 0x7f75781f7830 2024-09-12T01:43:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.153+0000 7f75777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7560004d40 0x7f75781f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.153+0000 7f75777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7560004d40 0x7f75781f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34648/0 (socket says 172.21.15.60:34648) 2024-09-12T01:43:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.153+0000 7f75777fe640 1 -- 172.21.15.60:0/119138002 learned_addr learned my addr 172.21.15.60:0/119138002 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f7577fff640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75780ca7d0 0x7f75781f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f7576ffd640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75781f7830 0x7f75780d4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f75777fe640 1 -- 172.21.15.60:0/119138002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75781f7830 msgr2=0x7f75780d4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f75777fe640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75781f7830 0x7f75780d4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f75777fe640 1 -- 172.21.15.60:0/119138002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75780ca7d0 msgr2=0x7f75781f1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f75777fe640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75780ca7d0 0x7f75781f1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f75777fe640 1 -- 172.21.15.60:0/119138002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75780ca040 con 0x7f7560004d40 2024-09-12T01:43:23.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f7577fff640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75780ca7d0 0x7f75781f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f7576ffd640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75781f7830 0x7f75780d4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f75777fe640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7560004d40 0x7f75781f4da0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7568007340 tx=0x7f7568007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f755ffff640 1 -- 172.21.15.60:0/119138002 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756800f8c0 con 0x7f7560004d40 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f755ffff640 1 -- 172.21.15.60:0/119138002 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7568018070 con 0x7f7560004d40 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f757e01e640 1 -- 172.21.15.60:0/119138002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75781f8080 con 0x7f7560004d40 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f755ffff640 1 -- 172.21.15.60:0/119138002 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756800fcc0 con 0x7f7560004d40 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.154+0000 7f757e01e640 1 -- 172.21.15.60:0/119138002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75780ca2b0 con 0x7f7560004d40 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.155+0000 7f757e01e640 1 -- 172.21.15.60:0/119138002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75780ca4b0 con 0x7f7560004d40 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.156+0000 7f755ffff640 1 -- 172.21.15.60:0/119138002 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f756801d460 con 0x7f7560004d40 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.156+0000 7f755ffff640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f756406be30 0x7f756406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.156+0000 7f755ffff640 1 -- 172.21.15.60:0/119138002 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f756808ae90 con 0x7f7560004d40 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.156+0000 7f7576ffd640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f756406be30 0x7f756406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.157+0000 7f7576ffd640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f756406be30 0x7f756406e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f75780d1a30 tx=0x7f756c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:23.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.160+0000 7f755ffff640 1 -- 172.21.15.60:0/119138002 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f75780ca4b0 con 0x7f7560004d40 2024-09-12T01:43:23.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.336+0000 7f757e01e640 1 -- 172.21.15.60:0/119138002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7f75780b61e0 con 0x7f7560004d40 2024-09-12T01:43:23.337 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.337+0000 7f755ffff640 1 -- 172.21.15.60:0/119138002 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v50) ==== 112+0+10 (secure 0 0 0) 0x7f756800fe60 con 0x7f7560004d40 2024-09-12T01:43:23.338 INFO:teuthology.orchestra.run.smithi060.stdout:60.000000 2024-09-12T01:43:23.339 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.339+0000 7f757e01e640 1 -- 172.21.15.60:0/119138002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f756406be30 msgr2=0x7f756406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.339+0000 7f757e01e640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f756406be30 0x7f756406e2f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f75780d1a30 tx=0x7f756c008040 comp rx=0 tx=0).stop 2024-09-12T01:43:23.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.339+0000 7f757e01e640 1 -- 172.21.15.60:0/119138002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7560004d40 msgr2=0x7f75781f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.339+0000 7f757e01e640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7560004d40 0x7f75781f4da0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f7568007340 tx=0x7f7568007800 comp rx=0 tx=0).stop 2024-09-12T01:43:23.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.339+0000 7f757e01e640 1 -- 172.21.15.60:0/119138002 shutdown_connections 2024-09-12T01:43:23.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.339+0000 7f757e01e640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f75780ca7d0 0x7f75781f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.339+0000 7f757e01e640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f756406be30 0x7f756406e2f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.339+0000 7f757e01e640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f75781f7830 0x7f75780d4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.339+0000 7f757e01e640 1 --2- 172.21.15.60:0/119138002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7560004d40 0x7f75781f4da0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.339+0000 7f757e01e640 1 -- 172.21.15.60:0/119138002 >> 172.21.15.60:0/119138002 conn(0x7f75780d11e0 msgr2=0x7f75781590e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:23.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.339+0000 7f757e01e640 1 -- 172.21.15.60:0/119138002 shutdown_connections 2024-09-12T01:43:23.340 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.339+0000 7f757e01e640 1 -- 172.21.15.60:0/119138002 wait complete. 2024-09-12T01:43:23.350 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:43:23.350 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:23.366 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:43:23.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:43:23.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:43:23.463 INFO:teuthology.orchestra.run.smithi060.stdout:client36284 2024-09-12T01:43:23.463 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:43:23.463 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:23.479 DEBUG:teuthology.orchestra.run.smithi060:> stdin-killer -- python3 -c ' 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> import fcntl 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> import sys 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> import time 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> import os 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> n = 200 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> abs_path = "/home/ubuntu/cephtest/mnt.0/subdir" 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> if not os.path.exists(abs_path): 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> os.makedirs(abs_path) 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:43:23.480 DEBUG:teuthology.orchestra.run.smithi060:> handles = [] 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> for i in range(0, n): 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> fname = "file_"+str(i) 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> path = os.path.join(abs_path, fname) 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> handles.append(open(path, '"'"'w'"'"')) 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> print("waiting with handles open", file=sys.stderr) 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> while True: 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> print("open_n_background: keeping files open", file=sys.stderr) 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> try: 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> if os.read(0, 4096) == b"": 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> break 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> except BlockingIOError: 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> pass 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> time.sleep(2) 2024-09-12T01:43:23.481 DEBUG:teuthology.orchestra.run.smithi060:> print("stdin closed, goodbye!", file=sys.stderr) 2024-09-12T01:43:23.482 DEBUG:teuthology.orchestra.run.smithi060:> ' 2024-09-12T01:43:23.522 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:43:23.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.624+0000 7fda4094b640 1 Processor -- start 2024-09-12T01:43:23.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.624+0000 7fda4094b640 1 -- start start 2024-09-12T01:43:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda4094b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda3c15b460 0x7fda3c0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda4094b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fda3c06d430 0x7fda3c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda4094b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda3c0b49f0 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda4094b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fda3c15eee0 con 0x7fda3c06d430 2024-09-12T01:43:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda4094b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fda3c15f130 con 0x7fda3c15b460 2024-09-12T01:43:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda3ad9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fda3c06d430 0x7fda3c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda3ad9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fda3c06d430 0x7fda3c0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34658/0 (socket says 172.21.15.60:34658) 2024-09-12T01:43:23.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda3ad9d640 1 -- 172.21.15.60:0/3599174296 learned_addr learned my addr 172.21.15.60:0/3599174296 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda31d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fda3c0d0fe0 0x7fda3c06cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48762/0 (socket says 172.21.15.60:48762) 2024-09-12T01:43:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda3a59c640 1 --2- 172.21.15.60:0/3599174296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda3c15b460 0x7fda3c0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda3ad9d640 1 -- 172.21.15.60:0/3599174296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda3c15b460 msgr2=0x7fda3c0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda3ad9d640 1 --2- 172.21.15.60:0/3599174296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda3c15b460 0x7fda3c0b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda3ad9d640 1 -- 172.21.15.60:0/3599174296 >> v1:172.21.15.60:6789/0 conn(0x7fda3c0d0fe0 legacy=0x7fda3c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda3ad9d640 1 -- 172.21.15.60:0/3599174296 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3c15f410 con 0x7fda3c06d430 2024-09-12T01:43:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda39d9b640 1 -- 172.21.15.60:0/3599174296 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3609081635 0 0) 0x7fda3c0b49f0 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.625+0000 7fda3a59c640 1 --2- 172.21.15.60:0/3599174296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda3c15b460 0x7fda3c0b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:23.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.626+0000 7fda3ad9d640 1 --2- 172.21.15.60:0/3599174296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c06d430 0x7fda3c0b5080 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fda3400d150 tx=0x7fda3402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b3722a054ce130 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:23.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.626+0000 7fda39d9b640 1 -- 172.21.15.60:0/3599174296 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3400b2e0 con 0x7fda3c06d430 2024-09-12T01:43:23.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.626+0000 7fda39d9b640 1 -- 172.21.15.60:0/3599174296 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda34037070 con 0x7fda3c06d430 2024-09-12T01:43:23.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.626+0000 7fda39d9b640 1 -- 172.21.15.60:0/3599174296 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3400b480 con 0x7fda3c06d430 2024-09-12T01:43:23.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.627+0000 7fda4094b640 1 -- 172.21.15.60:0/3599174296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c06d430 msgr2=0x7fda3c0b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.627+0000 7fda4094b640 1 --2- 172.21.15.60:0/3599174296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c06d430 0x7fda3c0b5080 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fda3400d150 tx=0x7fda3402c940 comp rx=0 tx=0).stop 2024-09-12T01:43:23.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.627+0000 7fda4094b640 1 -- 172.21.15.60:0/3599174296 shutdown_connections 2024-09-12T01:43:23.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.627+0000 7fda4094b640 1 --2- 172.21.15.60:0/3599174296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c06d430 0x7fda3c0b5080 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.627+0000 7fda4094b640 1 --2- 172.21.15.60:0/3599174296 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda3c15b460 0x7fda3c0b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.627+0000 7fda4094b640 1 -- 172.21.15.60:0/3599174296 >> 172.21.15.60:0/3599174296 conn(0x7fda3c0b6ec0 msgr2=0x7fda3c0b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:23.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.627+0000 7fda4094b640 1 -- 172.21.15.60:0/3599174296 shutdown_connections 2024-09-12T01:43:23.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.627+0000 7fda4094b640 1 -- 172.21.15.60:0/3599174296 wait complete. 2024-09-12T01:43:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.628+0000 7fda4094b640 1 Processor -- start 2024-09-12T01:43:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.629+0000 7fda4094b640 1 -- start start 2024-09-12T01:43:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.629+0000 7fda4094b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda3c06d430 0x7fda3c15e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.629+0000 7fda4094b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c0d0fe0 0x7fda3c14df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.629+0000 7fda4094b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda3c15b460 0x7fda3c1523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.629+0000 7fda4094b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c0b55c0 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.629+0000 7fda4094b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fda3c15f9d0 con 0x7fda3c15b460 2024-09-12T01:43:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.629+0000 7fda4094b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fda3c0b5740 con 0x7fda3c06d430 2024-09-12T01:43:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.629+0000 7fda31d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c0d0fe0 0x7fda3c14df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.629+0000 7fda31d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c0d0fe0 0x7fda3c14df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34674/0 (socket says 172.21.15.60:34674) 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.629+0000 7fda31d9b640 1 -- 172.21.15.60:0/2691877940 learned_addr learned my addr 172.21.15.60:0/2691877940 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda3a59c640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda3c06d430 0x7fda3c15e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda3ad9d640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda3c15b460 0x7fda3c1523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda31d9b640 1 -- 172.21.15.60:0/2691877940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda3c06d430 msgr2=0x7fda3c15e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda31d9b640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda3c06d430 0x7fda3c15e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda31d9b640 1 -- 172.21.15.60:0/2691877940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda3c15b460 msgr2=0x7fda3c1523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda31d9b640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda3c15b460 0x7fda3c1523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda31d9b640 1 -- 172.21.15.60:0/2691877940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3c155f50 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda31d9b640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c0d0fe0 0x7fda3c14df90 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c450 tx=0x7fda2400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda337fe640 1 -- 172.21.15.60:0/2691877940 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24018070 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda337fe640 1 -- 172.21.15.60:0/2691877940 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda24007500 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda4094b640 1 -- 172.21.15.60:0/2691877940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3c1528f0 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda337fe640 1 -- 172.21.15.60:0/2691877940 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24004a20 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.630+0000 7fda4094b640 1 -- 172.21.15.60:0/2691877940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3c155990 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.631+0000 7fda4094b640 1 -- 172.21.15.60:0/2691877940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda3c0b5080 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.632+0000 7fda337fe640 1 -- 172.21.15.60:0/2691877940 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fda2401b070 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.632+0000 7fda337fe640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fda1c06be30 0x7fda1c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:23.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.633+0000 7fda3a59c640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fda1c06be30 0x7fda1c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:23.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.633+0000 7fda337fe640 1 -- 172.21.15.60:0/2691877940 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7fda2408a090 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.633+0000 7fda3a59c640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fda1c06be30 0x7fda1c06e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fda2c006fd0 tx=0x7fda2c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:23.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.637+0000 7fda337fe640 1 -- 172.21.15.60:0/2691877940 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fda3c1528f0 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.748 INFO:teuthology.orchestra.run.smithi060.stderr:waiting with handles open 2024-09-12T01:43:23.749 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:43:23.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.851+0000 7fda4094b640 1 -- 172.21.15.60:0/2691877940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda3c0b4c20 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.852+0000 7fda337fe640 1 -- 172.21.15.60:0/2691877940 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7fda3c155f50 con 0x7fda3c0d0fe0 2024-09-12T01:43:23.852 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:23.853 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":69,"btime":"2024-09-12T01:43:11:998781+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2206957364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2206957364},{"type":"v1","addr":"172.21.15.105:6835","nonce":2206957364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7536,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3802062072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3802062072},{"type":"v1","addr":"172.21.15.60:6836","nonce":3802062072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3557949323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3557949323},{"type":"v1","addr":"172.21.15.60:6837","nonce":3557949323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:09.348346+0000","modified":"2024-09-12T01:43:11.345257+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/3613656777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3613656777},{"type":"v1","addr":"172.21.15.105:6834","nonce":3613656777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":9}]} 2024-09-12T01:43:23.853 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 69 2024-09-12T01:43:23.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.854+0000 7fda4094b640 1 -- 172.21.15.60:0/2691877940 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fda1c06be30 msgr2=0x7fda1c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.854+0000 7fda4094b640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fda1c06be30 0x7fda1c06e2f0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fda2c006fd0 tx=0x7fda2c008040 comp rx=0 tx=0).stop 2024-09-12T01:43:23.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.854+0000 7fda4094b640 1 -- 172.21.15.60:0/2691877940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c0d0fe0 msgr2=0x7fda3c14df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:23.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.854+0000 7fda4094b640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c0d0fe0 0x7fda3c14df90 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c450 tx=0x7fda2400c910 comp rx=0 tx=0).stop 2024-09-12T01:43:23.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.854+0000 7fda4094b640 1 -- 172.21.15.60:0/2691877940 shutdown_connections 2024-09-12T01:43:23.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.854+0000 7fda4094b640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fda3c15b460 0x7fda3c1523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.854+0000 7fda4094b640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c0d0fe0 0x7fda3c14df90 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.854+0000 7fda4094b640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fda1c06be30 0x7fda1c06e2f0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.854+0000 7fda4094b640 1 --2- 172.21.15.60:0/2691877940 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fda3c06d430 0x7fda3c15e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:23.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.854+0000 7fda4094b640 1 -- 172.21.15.60:0/2691877940 >> 172.21.15.60:0/2691877940 conn(0x7fda3c0b6ec0 msgr2=0x7fda3c0d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:23.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.854+0000 7fda4094b640 1 -- 172.21.15.60:0/2691877940 shutdown_connections 2024-09-12T01:43:23.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:23.854+0000 7fda4094b640 1 -- 172.21.15.60:0/2691877940 wait complete. 2024-09-12T01:43:23.866 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-12T01:43:23.982 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":7000,"entity":{"name":{"type":"client","num":7000},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2858918596}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":2.9349399040000002,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9914658335656741,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7000 192.168.0.1:0/2858918596","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi105","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":36284,"entity":{"name":{"type":"client","num":36284},"addr":{"type":"any","addr":"172.21.15.60:0","nonce":3352581087}},"state":"open","num_leases":1,"num_caps":202,"request_load_avg":208,"uptime":4.03591736,"requests_in_flight":200,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":404.70967222122266,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":10,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.36284 172.21.15.60:0/3352581087","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi060","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-12T01:43:23.983 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi105", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2858918596, "type": "any" }, "name": { "num": 7000, "type": "client" } }, "id": 7000, "inst": "client.7000 192.168.0.1:0/2858918596", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.991465833565674 }, "state": "open", "uptime": 2.934939904 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi060", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.60:0", "nonce": 3352581087, "type": "any" }, "name": { "num": 36284, "type": "client" } }, "id": 36284, "inst": "client.36284 172.21.15.60:0/3352581087", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 10, "num_caps": 202, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 208, "requests_in_flight": 200, "session_cache_liveness": { "halflife": 300, "value": 404.70967222122266 }, "state": "open", "uptime": 4.03591736 } ] 2024-09-12T01:43:23.983 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-09-12T01:43:23.983 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:43:24.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.085+0000 7f226e1c0640 1 Processor -- start 2024-09-12T01:43:24.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.085+0000 7f226e1c0640 1 -- start start 2024-09-12T01:43:24.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.086+0000 7f226e1c0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22680cfc80 0x7f22680b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:24.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.086+0000 7f226e1c0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f226815c740 con 0x7f2268155800 2024-09-12T01:43:24.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.086+0000 7f226e1c0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22680b50a0 con 0x7f226815c330 2024-09-12T01:43:24.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.086+0000 7f226e1c0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f22680b5380 con 0x7f22680cfc80 2024-09-12T01:43:24.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.086+0000 7f2266ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22680cfc80 0x7f22680b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:24.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.086+0000 7f22677fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2268155800 0x7f22680cf570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48778/0 (socket says 172.21.15.60:48778) 2024-09-12T01:43:24.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.086+0000 7f22677fe640 1 -- 172.21.15.60:0/1628232545 learned_addr learned my addr 172.21.15.60:0/1628232545 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:24.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.086+0000 7f22667fc640 1 -- 172.21.15.60:0/1628232545 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 556493380 0 0) 0x7f226815c740 con 0x7f2268155800 2024-09-12T01:43:24.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.086+0000 7f22667fc640 1 -- 172.21.15.60:0/1628232545 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2250003520 con 0x7f2268155800 2024-09-12T01:43:24.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.086+0000 7f2266ffd640 1 -- 172.21.15.60:0/1628232545 >> v1:172.21.15.105:6789/0 conn(0x7f226815c330 legacy=0x7f226815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:24.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.086+0000 7f2266ffd640 1 -- 172.21.15.60:0/1628232545 >> v1:172.21.15.60:6789/0 conn(0x7f2268155800 legacy=0x7f22680cf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:24.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.086+0000 7f2266ffd640 1 -- 172.21.15.60:0/1628232545 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22680b5660 con 0x7f22680cfc80 2024-09-12T01:43:24.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.087+0000 7f2266ffd640 1 --2- 172.21.15.60:0/1628232545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22680cfc80 0x7f22680b6140 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f225c0097d0 tx=0x7f225c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6dbb8ed2b5c892 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:24.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.087+0000 7f22667fc640 1 -- 172.21.15.60:0/1628232545 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c037070 con 0x7f22680cfc80 2024-09-12T01:43:24.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.087+0000 7f22667fc640 1 -- 172.21.15.60:0/1628232545 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f225c032440 con 0x7f22680cfc80 2024-09-12T01:43:24.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.087+0000 7f22667fc640 1 -- 172.21.15.60:0/1628232545 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225c032810 con 0x7f22680cfc80 2024-09-12T01:43:24.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.088+0000 7f226e1c0640 1 -- 172.21.15.60:0/1628232545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22680cfc80 msgr2=0x7f22680b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:24.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.088+0000 7f226e1c0640 1 --2- 172.21.15.60:0/1628232545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22680cfc80 0x7f22680b6140 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f225c0097d0 tx=0x7f225c02a270 comp rx=0 tx=0).stop 2024-09-12T01:43:24.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.088+0000 7f226e1c0640 1 -- 172.21.15.60:0/1628232545 shutdown_connections 2024-09-12T01:43:24.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.088+0000 7f226e1c0640 1 --2- 172.21.15.60:0/1628232545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22680cfc80 0x7f22680b6140 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:24.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.088+0000 7f226e1c0640 1 -- 172.21.15.60:0/1628232545 >> 172.21.15.60:0/1628232545 conn(0x7f226806bc10 msgr2=0x7f226806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:24.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.088+0000 7f226e1c0640 1 -- 172.21.15.60:0/1628232545 shutdown_connections 2024-09-12T01:43:24.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.088+0000 7f226e1c0640 1 -- 172.21.15.60:0/1628232545 wait complete. 2024-09-12T01:43:24.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.089+0000 7f226e1c0640 1 Processor -- start 2024-09-12T01:43:24.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.089+0000 7f226e1c0640 1 -- start start 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f226e1c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22680cfc80 0x7f22680cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f226e1c0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2268155800 0x7f2268155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f226e1c0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f226815c330 0x7f2268144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f226e1c0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2268155be0 con 0x7f22680cfc80 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f226e1c0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f22680b5c20 con 0x7f2268155800 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f226e1c0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f22680b4920 con 0x7f226815c330 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f22677fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22680cfc80 0x7f22680cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f22677fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22680cfc80 0x7f22680cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34690/0 (socket says 172.21.15.60:34690) 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f22677fe640 1 -- 172.21.15.60:0/1087374002 learned_addr learned my addr 172.21.15.60:0/1087374002 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f2266ffd640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2268155800 0x7f2268155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f2267fff640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f226815c330 0x7f2268144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f22677fe640 1 -- 172.21.15.60:0/1087374002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f226815c330 msgr2=0x7f2268144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:24.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f22677fe640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f226815c330 0x7f2268144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:24.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f22677fe640 1 -- 172.21.15.60:0/1087374002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2268155800 msgr2=0x7f2268155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:24.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f22677fe640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2268155800 0x7f2268155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:24.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f22677fe640 1 -- 172.21.15.60:0/1087374002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22681f54d0 con 0x7f22680cfc80 2024-09-12T01:43:24.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.090+0000 7f22677fe640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22680cfc80 0x7f22680cd460 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f225800c500 tx=0x7f225800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:24.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.091+0000 7f224ffff640 1 -- 172.21.15.60:0/1087374002 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2258017070 con 0x7f22680cfc80 2024-09-12T01:43:24.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.091+0000 7f224ffff640 1 -- 172.21.15.60:0/1087374002 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2258005ce0 con 0x7f22680cfc80 2024-09-12T01:43:24.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.091+0000 7f224ffff640 1 -- 172.21.15.60:0/1087374002 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2258007330 con 0x7f22680cfc80 2024-09-12T01:43:24.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.091+0000 7f226e1c0640 1 -- 172.21.15.60:0/1087374002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22681f57b0 con 0x7f22680cfc80 2024-09-12T01:43:24.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.091+0000 7f226e1c0640 1 -- 172.21.15.60:0/1087374002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22681f5d70 con 0x7f22680cfc80 2024-09-12T01:43:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.092+0000 7f226e1c0640 1 -- 172.21.15.60:0/1087374002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22680b4cb0 con 0x7f22680cfc80 2024-09-12T01:43:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.092+0000 7f224ffff640 1 -- 172.21.15.60:0/1087374002 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f225801a070 con 0x7f22680cfc80 2024-09-12T01:43:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.093+0000 7f224ffff640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f225406be30 0x7f225406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.093+0000 7f2266ffd640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f225406be30 0x7f225406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.093+0000 7f224ffff640 1 -- 172.21.15.60:0/1087374002 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f225808a190 con 0x7f22680cfc80 2024-09-12T01:43:24.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.093+0000 7f2266ffd640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f225406be30 0x7f225406e2f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f225c034000 tx=0x7f225c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:24.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.097+0000 7f224ffff640 1 -- 172.21.15.60:0/1087374002 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2258058640 con 0x7f22680cfc80 2024-09-12T01:43:24.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.309+0000 7f226e1c0640 1 -- 172.21.15.60:0/1087374002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f226806e400 con 0x7f22680cfc80 2024-09-12T01:43:24.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.310+0000 7f224ffff640 1 -- 172.21.15.60:0/1087374002 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f225805c940 con 0x7f22680cfc80 2024-09-12T01:43:24.310 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:24.310 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T01:43:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.312+0000 7f226e1c0640 1 -- 172.21.15.60:0/1087374002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f225406be30 msgr2=0x7f225406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.312+0000 7f226e1c0640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f225406be30 0x7f225406e2f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f225c034000 tx=0x7f225c02e000 comp rx=0 tx=0).stop 2024-09-12T01:43:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.312+0000 7f226e1c0640 1 -- 172.21.15.60:0/1087374002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22680cfc80 msgr2=0x7f22680cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.312+0000 7f226e1c0640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22680cfc80 0x7f22680cd460 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f225800c500 tx=0x7f225800c9c0 comp rx=0 tx=0).stop 2024-09-12T01:43:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.312+0000 7f226e1c0640 1 -- 172.21.15.60:0/1087374002 shutdown_connections 2024-09-12T01:43:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.312+0000 7f226e1c0640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f225406be30 0x7f225406e2f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.312+0000 7f226e1c0640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f226815c330 0x7f2268144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.312+0000 7f226e1c0640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2268155800 0x7f2268155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.312+0000 7f226e1c0640 1 --2- 172.21.15.60:0/1087374002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22680cfc80 0x7f22680cd460 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.312+0000 7f226e1c0640 1 -- 172.21.15.60:0/1087374002 >> 172.21.15.60:0/1087374002 conn(0x7f226806bc10 msgr2=0x7f22680b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:24.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.312+0000 7f226e1c0640 1 -- 172.21.15.60:0/1087374002 shutdown_connections 2024-09-12T01:43:24.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:24.312+0000 7f226e1c0640 1 -- 172.21.15.60:0/1087374002 wait complete. 2024-09-12T01:43:24.324 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2024-09-12T01:43:24.324 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:43:25.751 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:43:27.753 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:43:29.325 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:43:29.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.443+0000 7f3199386640 1 Processor -- start 2024-09-12T01:43:29.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.443+0000 7f3199386640 1 -- start start 2024-09-12T01:43:29.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.444+0000 7f3199386640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f319415c2b0 0x7f31940b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:29.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.444+0000 7f3199386640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f319415f200 0x7f319406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:29.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.444+0000 7f3199386640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f319415fb10 con 0x7f31940b72f0 2024-09-12T01:43:29.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.444+0000 7f3199386640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f31940b5900 con 0x7f319415f200 2024-09-12T01:43:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.444+0000 7f3199386640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f319415f830 con 0x7f319415c2b0 2024-09-12T01:43:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.444+0000 7f31927fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f31940b72f0 0x7f319415eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48780/0 (socket says 172.21.15.60:48780) 2024-09-12T01:43:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.444+0000 7f31927fc640 1 -- 172.21.15.60:0/2343854060 learned_addr learned my addr 172.21.15.60:0/2343854060 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.444+0000 7f3192ffd640 1 --2- 172.21.15.60:0/2343854060 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f319415c2b0 0x7f31940b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.444+0000 7f31937fe640 1 --2- 172.21.15.60:0/2343854060 >> v2:172.21.15.105:3300/0 conn(0x7f319415f200 0x7f319406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.444+0000 7f3191ffb640 1 -- 172.21.15.60:0/2343854060 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 391943361 0 0) 0x7f319415fb10 con 0x7f31940b72f0 2024-09-12T01:43:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.444+0000 7f3191ffb640 1 -- 172.21.15.60:0/2343854060 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f317c003520 con 0x7f31940b72f0 2024-09-12T01:43:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.445+0000 7f31937fe640 1 -- 172.21.15.60:0/2343854060 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f319415c2b0 msgr2=0x7f31940b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.445+0000 7f31937fe640 1 --2- 172.21.15.60:0/2343854060 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f319415c2b0 0x7f31940b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.445+0000 7f31937fe640 1 -- 172.21.15.60:0/2343854060 >> v1:172.21.15.60:6789/0 conn(0x7f31940b72f0 legacy=0x7f319415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.445+0000 7f3191ffb640 1 -- 172.21.15.60:0/2343854060 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 402613354 0 0) 0x7f317c003520 con 0x7f31940b72f0 2024-09-12T01:43:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.445+0000 7f31937fe640 1 -- 172.21.15.60:0/2343854060 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319406ce30 con 0x7f319415f200 2024-09-12T01:43:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.445+0000 7f31937fe640 1 --2- 172.21.15.60:0/2343854060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f319415f200 0x7f319406d910 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3184009d90 tx=0x7f318402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93670c3a570ddb27 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.446+0000 7f3191ffb640 1 -- 172.21.15.60:0/2343854060 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188001670 con 0x7f319415f200 2024-09-12T01:43:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.446+0000 7f3191ffb640 1 -- 172.21.15.60:0/2343854060 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3184007540 con 0x7f319415f200 2024-09-12T01:43:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.446+0000 7f3191ffb640 1 -- 172.21.15.60:0/2343854060 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3184007910 con 0x7f319415f200 2024-09-12T01:43:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.446+0000 7f3199386640 1 -- 172.21.15.60:0/2343854060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f319415f200 msgr2=0x7f319406d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.446+0000 7f3199386640 1 --2- 172.21.15.60:0/2343854060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f319415f200 0x7f319406d910 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3184009d90 tx=0x7f318402a5f0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.446+0000 7f3199386640 1 -- 172.21.15.60:0/2343854060 shutdown_connections 2024-09-12T01:43:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.446+0000 7f3199386640 1 --2- 172.21.15.60:0/2343854060 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f319415f200 0x7f319406d910 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.446+0000 7f3199386640 1 --2- 172.21.15.60:0/2343854060 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f319415c2b0 0x7f31940b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.446+0000 7f3199386640 1 -- 172.21.15.60:0/2343854060 >> 172.21.15.60:0/2343854060 conn(0x7f31940b4240 msgr2=0x7f31940b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.446+0000 7f3199386640 1 -- 172.21.15.60:0/2343854060 shutdown_connections 2024-09-12T01:43:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.446+0000 7f3199386640 1 -- 172.21.15.60:0/2343854060 wait complete. 2024-09-12T01:43:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.448+0000 7f3199386640 1 Processor -- start 2024-09-12T01:43:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.448+0000 7f3199386640 1 -- start start 2024-09-12T01:43:29.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3199386640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31940b72f0 0x7f319414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:29.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3199386640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f319415c2b0 0x7f31940d2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:29.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3199386640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f319415f200 0x7f31940d2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:29.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3199386640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31940b7730 con 0x7f31940b72f0 2024-09-12T01:43:29.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3199386640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f319406d3f0 con 0x7f319415f200 2024-09-12T01:43:29.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3199386640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f319406de50 con 0x7f319415c2b0 2024-09-12T01:43:29.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3192ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31940b72f0 0x7f319414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:29.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3192ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31940b72f0 0x7f319414ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:34698/0 (socket says 172.21.15.60:34698) 2024-09-12T01:43:29.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3192ffd640 1 -- 172.21.15.60:0/3448777631 learned_addr learned my addr 172.21.15.60:0/3448777631 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:29.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f31937fe640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f319415f200 0x7f31940d2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:29.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f31927fc640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f319415c2b0 0x7f31940d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:29.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3192ffd640 1 -- 172.21.15.60:0/3448777631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f319415c2b0 msgr2=0x7f31940d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:29.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3192ffd640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f319415c2b0 0x7f31940d2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3192ffd640 1 -- 172.21.15.60:0/3448777631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f319415f200 msgr2=0x7f31940d2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:29.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3192ffd640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f319415f200 0x7f31940d2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3192ffd640 1 -- 172.21.15.60:0/3448777631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31941f4160 con 0x7f31940b72f0 2024-09-12T01:43:29.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f31937fe640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f319415f200 0x7f31940d2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:29.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f3192ffd640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31940b72f0 0x7f319414ef50 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f318c00e9e0 tx=0x7f318c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:29.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f317b7fe640 1 -- 172.21.15.60:0/3448777631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c017070 con 0x7f31940b72f0 2024-09-12T01:43:29.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f317b7fe640 1 -- 172.21.15.60:0/3448777631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318c00c9d0 con 0x7f31940b72f0 2024-09-12T01:43:29.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.449+0000 7f317b7fe640 1 -- 172.21.15.60:0/3448777631 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c00cdc0 con 0x7f31940b72f0 2024-09-12T01:43:29.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.450+0000 7f3199386640 1 -- 172.21.15.60:0/3448777631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31941f4420 con 0x7f31940b72f0 2024-09-12T01:43:29.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.450+0000 7f3199386640 1 -- 172.21.15.60:0/3448777631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31941f49e0 con 0x7f31940b72f0 2024-09-12T01:43:29.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.451+0000 7f3199386640 1 -- 172.21.15.60:0/3448777631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31940b6db0 con 0x7f31940b72f0 2024-09-12T01:43:29.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.451+0000 7f317b7fe640 1 -- 172.21.15.60:0/3448777631 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f318c01a070 con 0x7f31940b72f0 2024-09-12T01:43:29.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.452+0000 7f317b7fe640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f318006be30 0x7f318006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:29.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.452+0000 7f317b7fe640 1 -- 172.21.15.60:0/3448777631 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f318c08ae00 con 0x7f31940b72f0 2024-09-12T01:43:29.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.452+0000 7f31927fc640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f318006be30 0x7f318006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:29.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.452+0000 7f31927fc640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f318006be30 0x7f318006e2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3188005880 tx=0x7f3188009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:29.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.456+0000 7f317b7fe640 1 -- 172.21.15.60:0/3448777631 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f318c059840 con 0x7f31940b72f0 2024-09-12T01:43:29.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.666+0000 7f3199386640 1 -- 172.21.15.60:0/3448777631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f31940b2bf0 con 0x7f31940b72f0 2024-09-12T01:43:29.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.667+0000 7f317b7fe640 1 -- 172.21.15.60:0/3448777631 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f318c059140 con 0x7f31940b72f0 2024-09-12T01:43:29.666 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:29.666 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:43:29.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.668+0000 7f3199386640 1 -- 172.21.15.60:0/3448777631 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f318006be30 msgr2=0x7f318006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:29.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.668+0000 7f3199386640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f318006be30 0x7f318006e2f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f3188005880 tx=0x7f3188009040 comp rx=0 tx=0).stop 2024-09-12T01:43:29.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.668+0000 7f3199386640 1 -- 172.21.15.60:0/3448777631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31940b72f0 msgr2=0x7f319414ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:29.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.668+0000 7f3199386640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31940b72f0 0x7f319414ef50 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f318c00e9e0 tx=0x7f318c00eea0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.669+0000 7f3199386640 1 -- 172.21.15.60:0/3448777631 shutdown_connections 2024-09-12T01:43:29.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.669+0000 7f3199386640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f319415f200 0x7f31940d2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.669+0000 7f3199386640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f318006be30 0x7f318006e2f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.669+0000 7f3199386640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f319415c2b0 0x7f31940d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.669+0000 7f3199386640 1 --2- 172.21.15.60:0/3448777631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31940b72f0 0x7f319414ef50 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:29.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.669+0000 7f3199386640 1 -- 172.21.15.60:0/3448777631 >> 172.21.15.60:0/3448777631 conn(0x7f31940b4240 msgr2=0x7f3194073160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:29.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.669+0000 7f3199386640 1 -- 172.21.15.60:0/3448777631 shutdown_connections 2024-09-12T01:43:29.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:29.669+0000 7f3199386640 1 -- 172.21.15.60:0/3448777631 wait complete. 2024-09-12T01:43:29.679 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:43:29.680 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:43:29.755 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:43:31.757 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:43:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:43:34.680 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:43:34.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.795+0000 7f997dfb9640 1 Processor -- start 2024-09-12T01:43:34.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.795+0000 7f997dfb9640 1 -- start start 2024-09-12T01:43:34.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.796+0000 7f997dfb9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f997806d540 0x7f99780cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:34.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.796+0000 7f997dfb9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997806faf0 con 0x7f99780735b0 2024-09-12T01:43:34.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.796+0000 7f997dfb9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997806fdd0 con 0x7f997815e950 2024-09-12T01:43:34.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.796+0000 7f997dfb9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f99780700b0 con 0x7f997806d540 2024-09-12T01:43:34.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.796+0000 7f9977fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f99780735b0 0x7f99780cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56008/0 (socket says 172.21.15.60:56008) 2024-09-12T01:43:34.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.796+0000 7f9977fff640 1 -- 172.21.15.60:0/1804267617 learned_addr learned my addr 172.21.15.60:0/1804267617 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:34.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.796+0000 7f996effd640 1 --2- 172.21.15.60:0/1804267617 >> v2:172.21.15.105:3300/0 conn(0x7f997806d540 0x7f99780cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:34.796 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.797+0000 7f9976ffd640 1 -- 172.21.15.60:0/1804267617 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1750068642 0 0) 0x7f997806faf0 con 0x7f99780735b0 2024-09-12T01:43:34.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.797+0000 7f9976ffd640 1 -- 172.21.15.60:0/1804267617 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9964003520 con 0x7f99780735b0 2024-09-12T01:43:34.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.797+0000 7f996effd640 1 -- 172.21.15.60:0/1804267617 >> v1:172.21.15.105:6789/0 conn(0x7f997815e950 legacy=0x7f997806ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:34.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.797+0000 7f996effd640 1 -- 172.21.15.60:0/1804267617 >> v1:172.21.15.60:6789/0 conn(0x7f99780735b0 legacy=0x7f99780cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:34.797 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.797+0000 7f996effd640 1 -- 172.21.15.60:0/1804267617 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9978070390 con 0x7f997806d540 2024-09-12T01:43:34.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.798+0000 7f996effd640 1 --2- 172.21.15.60:0/1804267617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f997806d540 0x7f99780cf0a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f99600097a0 tx=0x7f996002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2bd0c62c7ffb6af server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:34.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.798+0000 7f9976ffd640 1 -- 172.21.15.60:0/1804267617 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9960037070 con 0x7f997806d540 2024-09-12T01:43:34.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.798+0000 7f9976ffd640 1 -- 172.21.15.60:0/1804267617 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9960032440 con 0x7f997806d540 2024-09-12T01:43:34.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.798+0000 7f9976ffd640 1 -- 172.21.15.60:0/1804267617 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99600327f0 con 0x7f997806d540 2024-09-12T01:43:34.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.798+0000 7f997dfb9640 1 -- 172.21.15.60:0/1804267617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f997806d540 msgr2=0x7f99780cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:34.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.798+0000 7f997dfb9640 1 --2- 172.21.15.60:0/1804267617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f997806d540 0x7f99780cf0a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f99600097a0 tx=0x7f996002a230 comp rx=0 tx=0).stop 2024-09-12T01:43:34.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.798+0000 7f997dfb9640 1 -- 172.21.15.60:0/1804267617 shutdown_connections 2024-09-12T01:43:34.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.798+0000 7f997dfb9640 1 --2- 172.21.15.60:0/1804267617 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f997806d540 0x7f99780cf0a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:34.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.798+0000 7f997dfb9640 1 -- 172.21.15.60:0/1804267617 >> 172.21.15.60:0/1804267617 conn(0x7f99780d14d0 msgr2=0x7f99780d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:34.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.798+0000 7f997dfb9640 1 -- 172.21.15.60:0/1804267617 shutdown_connections 2024-09-12T01:43:34.799 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.798+0000 7f997dfb9640 1 -- 172.21.15.60:0/1804267617 wait complete. 2024-09-12T01:43:34.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.800+0000 7f997dfb9640 1 Processor -- start 2024-09-12T01:43:34.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.800+0000 7f997dfb9640 1 -- start start 2024-09-12T01:43:34.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f997dfb9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f997806d540 0x7f997814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f997dfb9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99780735b0 0x7f99780cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f997dfb9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f997815e950 0x7f9978159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f997dfb9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f99780721d0 con 0x7f997815e950 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f997dfb9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9978072050 con 0x7f99780735b0 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f997dfb9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9978072350 con 0x7f997806d540 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f9977fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f997815e950 0x7f9978159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f9977fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f997815e950 0x7f9978159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55676/0 (socket says 172.21.15.60:55676) 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f9977fff640 1 -- 172.21.15.60:0/3346078389 learned_addr learned my addr 172.21.15.60:0/3346078389 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f996effd640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99780735b0 0x7f99780cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f99777fe640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f997806d540 0x7f997814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f9977fff640 1 -- 172.21.15.60:0/3346078389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f997806d540 msgr2=0x7f997814aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f9977fff640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f997806d540 0x7f997814aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f9977fff640 1 -- 172.21.15.60:0/3346078389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99780735b0 msgr2=0x7f99780cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:34.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f9977fff640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99780735b0 0x7f99780cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:34.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f9977fff640 1 -- 172.21.15.60:0/3346078389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997815aca0 con 0x7f997815e950 2024-09-12T01:43:34.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f9977fff640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f997815e950 0x7f9978159db0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f997000cae0 tx=0x7f997000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:34.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f9974ff9640 1 -- 172.21.15.60:0/3346078389 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970017070 con 0x7f997815e950 2024-09-12T01:43:34.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.801+0000 7f9974ff9640 1 -- 172.21.15.60:0/3346078389 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997000ac40 con 0x7f997815e950 2024-09-12T01:43:34.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.802+0000 7f997dfb9640 1 -- 172.21.15.60:0/3346078389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9978159460 con 0x7f997815e950 2024-09-12T01:43:34.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.802+0000 7f9974ff9640 1 -- 172.21.15.60:0/3346078389 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970012640 con 0x7f997815e950 2024-09-12T01:43:34.803 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.802+0000 7f997dfb9640 1 -- 172.21.15.60:0/3346078389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9978157e50 con 0x7f997815e950 2024-09-12T01:43:34.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.802+0000 7f997dfb9640 1 -- 172.21.15.60:0/3346078389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f997806ce30 con 0x7f997815e950 2024-09-12T01:43:34.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.803+0000 7f9974ff9640 1 -- 172.21.15.60:0/3346078389 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f997001a070 con 0x7f997815e950 2024-09-12T01:43:34.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.803+0000 7f9974ff9640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f995806be30 0x7f995806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:34.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.804+0000 7f9974ff9640 1 -- 172.21.15.60:0/3346078389 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f997008ab60 con 0x7f997815e950 2024-09-12T01:43:34.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.804+0000 7f99777fe640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f995806be30 0x7f995806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:34.804 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.804+0000 7f99777fe640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f995806be30 0x7f995806e2f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9968000f60 tx=0x7f9968009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:34.807 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:34.808+0000 7f9974ff9640 1 -- 172.21.15.60:0/3346078389 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9970058f50 con 0x7f997815e950 2024-09-12T01:43:35.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.019+0000 7f997dfb9640 1 -- 172.21.15.60:0/3346078389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9978157930 con 0x7f997815e950 2024-09-12T01:43:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.019+0000 7f9974ff9640 1 -- 172.21.15.60:0/3346078389 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f997005d250 con 0x7f997815e950 2024-09-12T01:43:35.019 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:35.019 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:43:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.021+0000 7f997dfb9640 1 -- 172.21.15.60:0/3346078389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f995806be30 msgr2=0x7f995806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.021+0000 7f997dfb9640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f995806be30 0x7f995806e2f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9968000f60 tx=0x7f9968009040 comp rx=0 tx=0).stop 2024-09-12T01:43:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.021+0000 7f997dfb9640 1 -- 172.21.15.60:0/3346078389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f997815e950 msgr2=0x7f9978159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.021+0000 7f997dfb9640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f997815e950 0x7f9978159db0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f997000cae0 tx=0x7f997000a060 comp rx=0 tx=0).stop 2024-09-12T01:43:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.021+0000 7f997dfb9640 1 -- 172.21.15.60:0/3346078389 shutdown_connections 2024-09-12T01:43:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.021+0000 7f997dfb9640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f997815e950 0x7f9978159db0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.021+0000 7f997dfb9640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f99780735b0 0x7f99780cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.021+0000 7f997dfb9640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f995806be30 0x7f995806e2f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.021+0000 7f997dfb9640 1 --2- 172.21.15.60:0/3346078389 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f997806d540 0x7f997814aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.021+0000 7f997dfb9640 1 -- 172.21.15.60:0/3346078389 >> 172.21.15.60:0/3346078389 conn(0x7f99780d14d0 msgr2=0x7f99780b4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.021+0000 7f997dfb9640 1 -- 172.21.15.60:0/3346078389 shutdown_connections 2024-09-12T01:43:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.021+0000 7f997dfb9640 1 -- 172.21.15.60:0/3346078389 wait complete. 2024-09-12T01:43:35.031 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-12T01:43:35.031 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-09-12T01:43:35.032 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:43:35.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.133+0000 7f20b1ea6640 1 Processor -- start 2024-09-12T01:43:35.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.133+0000 7f20b1ea6640 1 -- start start 2024-09-12T01:43:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.134+0000 7f20b1ea6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f20ac15e800 0x7f20ac0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.134+0000 7f20b1ea6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac06ea60 con 0x7f20ac15ebe0 2024-09-12T01:43:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.134+0000 7f20b1ea6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20ac06cde0 con 0x7f20ac0b7560 2024-09-12T01:43:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.134+0000 7f20b1ea6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f20ac06ed40 con 0x7f20ac15e800 2024-09-12T01:43:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.134+0000 7f20aaffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f20ac15ebe0 0x7f20ac0b6e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56022/0 (socket says 172.21.15.60:56022) 2024-09-12T01:43:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.134+0000 7f20aaffd640 1 -- 172.21.15.60:0/3244544811 learned_addr learned my addr 172.21.15.60:0/3244544811 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.135+0000 7f20ab7fe640 1 --2- 172.21.15.60:0/3244544811 >> v2:172.21.15.105:3300/0 conn(0x7f20ac15e800 0x7f20ac0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.135+0000 7f20aa7fc640 1 -- 172.21.15.60:0/3244544811 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3423426626 0 0) 0x7f20ac06ea60 con 0x7f20ac15ebe0 2024-09-12T01:43:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.135+0000 7f20aa7fc640 1 -- 172.21.15.60:0/3244544811 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2094003520 con 0x7f20ac15ebe0 2024-09-12T01:43:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.135+0000 7f20aa7fc640 1 -- 172.21.15.60:0/3244544811 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3622625594 0 0) 0x7f20ac06cde0 con 0x7f20ac0b7560 2024-09-12T01:43:35.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.135+0000 7f20aa7fc640 1 -- 172.21.15.60:0/3244544811 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20ac06ea60 con 0x7f20ac0b7560 2024-09-12T01:43:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.135+0000 7f20ab7fe640 1 -- 172.21.15.60:0/3244544811 >> v1:172.21.15.105:6789/0 conn(0x7f20ac0b7560 legacy=0x7f20ac06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.135+0000 7f20ab7fe640 1 -- 172.21.15.60:0/3244544811 >> v1:172.21.15.60:6789/0 conn(0x7f20ac15ebe0 legacy=0x7f20ac0b6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.135+0000 7f20aa7fc640 1 -- 172.21.15.60:0/3244544811 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 687331196 0 0) 0x7f2094003520 con 0x7f20ac15ebe0 2024-09-12T01:43:35.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.135+0000 7f20ab7fe640 1 -- 172.21.15.60:0/3244544811 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac06d0c0 con 0x7f20ac15e800 2024-09-12T01:43:35.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.136+0000 7f20ab7fe640 1 --2- 172.21.15.60:0/3244544811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac15e800 0x7f20ac0b5460 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f209c0097a0 tx=0x7f209c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccf5b3bcfa030e5c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:35.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.136+0000 7f20aa7fc640 1 -- 172.21.15.60:0/3244544811 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c037070 con 0x7f20ac15e800 2024-09-12T01:43:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.136+0000 7f20aa7fc640 1 -- 172.21.15.60:0/3244544811 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c02ac50 con 0x7f20ac15e800 2024-09-12T01:43:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.136+0000 7f20aa7fc640 1 -- 172.21.15.60:0/3244544811 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a0001670 con 0x7f20ac15e800 2024-09-12T01:43:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.136+0000 7f20b1ea6640 1 -- 172.21.15.60:0/3244544811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac15e800 msgr2=0x7f20ac0b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.136+0000 7f20b1ea6640 1 --2- 172.21.15.60:0/3244544811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac15e800 0x7f20ac0b5460 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f209c0097a0 tx=0x7f209c02a1c0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.137+0000 7f20b1ea6640 1 -- 172.21.15.60:0/3244544811 shutdown_connections 2024-09-12T01:43:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.137+0000 7f20b1ea6640 1 --2- 172.21.15.60:0/3244544811 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac15e800 0x7f20ac0b5460 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.137+0000 7f20b1ea6640 1 -- 172.21.15.60:0/3244544811 >> 172.21.15.60:0/3244544811 conn(0x7f20ac0d24d0 msgr2=0x7f20ac0d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.137+0000 7f20b1ea6640 1 -- 172.21.15.60:0/3244544811 shutdown_connections 2024-09-12T01:43:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.137+0000 7f20b1ea6640 1 -- 172.21.15.60:0/3244544811 wait complete. 2024-09-12T01:43:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.138+0000 7f20b1ea6640 1 Processor -- start 2024-09-12T01:43:35.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.138+0000 7f20b1ea6640 1 -- start start 2024-09-12T01:43:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20b1ea6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac0b7560 0x7f20ac1501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20b1ea6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20ac15e800 0x7f20ac151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20b1ea6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac15ebe0 0x7f20ac158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20b1ea6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac06e680 con 0x7f20ac15ebe0 2024-09-12T01:43:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20b1ea6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20ac0d31e0 con 0x7f20ac0b7560 2024-09-12T01:43:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20b1ea6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f20ac06e800 con 0x7f20ac15e800 2024-09-12T01:43:35.140 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20abfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac15ebe0 0x7f20ac158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20abfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac15ebe0 0x7f20ac158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55682/0 (socket says 172.21.15.60:55682) 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20abfff640 1 -- 172.21.15.60:0/2629839231 learned_addr learned my addr 172.21.15.60:0/2629839231 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20aaffd640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20ac15e800 0x7f20ac151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20ab7fe640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac0b7560 0x7f20ac1501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20abfff640 1 -- 172.21.15.60:0/2629839231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20ac15e800 msgr2=0x7f20ac151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20abfff640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20ac15e800 0x7f20ac151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20abfff640 1 -- 172.21.15.60:0/2629839231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac0b7560 msgr2=0x7f20ac1501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20abfff640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac0b7560 0x7f20ac1501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20abfff640 1 -- 172.21.15.60:0/2629839231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ac152380 con 0x7f20ac15ebe0 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20aaffd640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20ac15e800 0x7f20ac151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.139+0000 7f20abfff640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac15ebe0 0x7f20ac158e20 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c790 tx=0x7f20a400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.140+0000 7f2093fff640 1 -- 172.21.15.60:0/2629839231 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a4003b70 con 0x7f20ac15ebe0 2024-09-12T01:43:35.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.140+0000 7f2093fff640 1 -- 172.21.15.60:0/2629839231 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a4003d10 con 0x7f20ac15ebe0 2024-09-12T01:43:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.140+0000 7f2093fff640 1 -- 172.21.15.60:0/2629839231 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20a400aa50 con 0x7f20ac15ebe0 2024-09-12T01:43:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.140+0000 7f20b1ea6640 1 -- 172.21.15.60:0/2629839231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ac152660 con 0x7f20ac15ebe0 2024-09-12T01:43:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.140+0000 7f20b1ea6640 1 -- 172.21.15.60:0/2629839231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ac151fb0 con 0x7f20ac15ebe0 2024-09-12T01:43:35.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.141+0000 7f20b1ea6640 1 -- 172.21.15.60:0/2629839231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20ac0b5460 con 0x7f20ac15ebe0 2024-09-12T01:43:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.141+0000 7f2093fff640 1 -- 172.21.15.60:0/2629839231 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20a400abf0 con 0x7f20ac15ebe0 2024-09-12T01:43:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.142+0000 7f2093fff640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f209806be60 0x7f209806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.142+0000 7f2093fff640 1 -- 172.21.15.60:0/2629839231 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f20a408ae00 con 0x7f20ac15ebe0 2024-09-12T01:43:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.142+0000 7f20ab7fe640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f209806be60 0x7f209806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:35.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.142+0000 7f20ab7fe640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f209806be60 0x7f209806e320 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f209c034000 tx=0x7f209c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:35.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.146+0000 7f2093fff640 1 -- 172.21.15.60:0/2629839231 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20a4059710 con 0x7f20ac15ebe0 2024-09-12T01:43:35.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.359+0000 7f20b1ea6640 1 -- 172.21.15.60:0/2629839231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f20ac0d2080 con 0x7f20ac15ebe0 2024-09-12T01:43:35.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.359+0000 7f2093fff640 1 -- 172.21.15.60:0/2629839231 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f20a4059010 con 0x7f20ac15ebe0 2024-09-12T01:43:35.359 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:35.359 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:43:35.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.361+0000 7f20b1ea6640 1 -- 172.21.15.60:0/2629839231 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f209806be60 msgr2=0x7f209806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:35.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.361+0000 7f20b1ea6640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f209806be60 0x7f209806e320 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f209c034000 tx=0x7f209c02e000 comp rx=0 tx=0).stop 2024-09-12T01:43:35.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.361+0000 7f20b1ea6640 1 -- 172.21.15.60:0/2629839231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac15ebe0 msgr2=0x7f20ac158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:35.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.361+0000 7f20b1ea6640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac15ebe0 0x7f20ac158e20 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f20a400c790 tx=0x7f20a400cc50 comp rx=0 tx=0).stop 2024-09-12T01:43:35.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.361+0000 7f20b1ea6640 1 -- 172.21.15.60:0/2629839231 shutdown_connections 2024-09-12T01:43:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.361+0000 7f20b1ea6640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20ac15ebe0 0x7f20ac158e20 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.361+0000 7f20b1ea6640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f209806be60 0x7f209806e320 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.361+0000 7f20b1ea6640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20ac15e800 0x7f20ac151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.361+0000 7f20b1ea6640 1 --2- 172.21.15.60:0/2629839231 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20ac0b7560 0x7f20ac1501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.361+0000 7f20b1ea6640 1 -- 172.21.15.60:0/2629839231 >> 172.21.15.60:0/2629839231 conn(0x7f20ac0d24d0 msgr2=0x7f20ac15b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.361+0000 7f20b1ea6640 1 -- 172.21.15.60:0/2629839231 shutdown_connections 2024-09-12T01:43:35.362 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.361+0000 7f20b1ea6640 1 -- 172.21.15.60:0/2629839231 wait complete. 2024-09-12T01:43:35.372 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T01:43:35.372 INFO:tasks.cephfs.test_client_limits:Terminating process holding files open 2024-09-12T01:43:35.373 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-12T01:43:35.761 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:43:35.762 INFO:teuthology.orchestra.run.smithi060.stderr:stdin closed, goodbye! 2024-09-12T01:43:35.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:43:35.774 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:43:35.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.919+0000 7f27adcd2640 1 Processor -- start 2024-09-12T01:43:35.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.919+0000 7f27adcd2640 1 -- start start 2024-09-12T01:43:35.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.920+0000 7f27adcd2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27a815c470 0x7f27a80b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:35.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.920+0000 7f27adcd2640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f27a80b3c50 0x7f27a80cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:35.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.920+0000 7f27adcd2640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f27a80cf8b0 0x7f27a815ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:35.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.920+0000 7f27adcd2640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f27a815c850 con 0x7f27a80cf8b0 2024-09-12T01:43:35.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.920+0000 7f27adcd2640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f27a80b4160 con 0x7f27a80b3c50 2024-09-12T01:43:35.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.920+0000 7f27adcd2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f27a80b4440 con 0x7f27a815c470 2024-09-12T01:43:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.920+0000 7f27a7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f27a80cf8b0 0x7f27a815ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.920+0000 7f27a7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f27a80cf8b0 0x7f27a815ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55688/0 (socket says 172.21.15.60:55688) 2024-09-12T01:43:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.920+0000 7f27a7fff640 1 -- 172.21.15.60:0/1704369909 learned_addr learned my addr 172.21.15.60:0/1704369909 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.921+0000 7f27a7fff640 1 -- 172.21.15.60:0/1704369909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27a815c470 msgr2=0x7f27a80b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.921+0000 7f27a7fff640 1 --2- 172.21.15.60:0/1704369909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27a815c470 0x7f27a80b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.921+0000 7f27a6ffd640 1 --2- 172.21.15.60:0/1704369909 >> v2:172.21.15.105:3300/0 conn(0x7f27a80b3c50 0x7f27a80cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.921+0000 7f27a7fff640 1 -- 172.21.15.60:0/1704369909 >> v2:172.21.15.105:3300/0 conn(0x7f27a80b3c50 msgr2=0x7f27a80cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.921+0000 7f27a7fff640 1 --2- 172.21.15.60:0/1704369909 >> v2:172.21.15.105:3300/0 conn(0x7f27a80b3c50 0x7f27a80cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.921+0000 7f27a7fff640 1 -- 172.21.15.60:0/1704369909 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a80b4720 con 0x7f27a80cf8b0 2024-09-12T01:43:35.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.921+0000 7f27a7fff640 1 --2- 172.21.15.60:0/1704369909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a80cf8b0 0x7f27a815ffa0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f27a806c7d0 tx=0x7f27a002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38c84e68ea3c79d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.921+0000 7f27a67fc640 1 -- 172.21.15.60:0/1704369909 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0036070 con 0x7f27a80cf8b0 2024-09-12T01:43:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.921+0000 7f27a67fc640 1 -- 172.21.15.60:0/1704369909 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a0031600 con 0x7f27a80cf8b0 2024-09-12T01:43:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.921+0000 7f27a67fc640 1 -- 172.21.15.60:0/1704369909 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a00319d0 con 0x7f27a80cf8b0 2024-09-12T01:43:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.922+0000 7f27adcd2640 1 -- 172.21.15.60:0/1704369909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a80cf8b0 msgr2=0x7f27a815ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.922+0000 7f27adcd2640 1 --2- 172.21.15.60:0/1704369909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a80cf8b0 0x7f27a815ffa0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f27a806c7d0 tx=0x7f27a002a6a0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.922+0000 7f27adcd2640 1 -- 172.21.15.60:0/1704369909 shutdown_connections 2024-09-12T01:43:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.922+0000 7f27adcd2640 1 --2- 172.21.15.60:0/1704369909 >> v2:172.21.15.105:3300/0 conn(0x7f27a80b3c50 0x7f27a80cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.922+0000 7f27adcd2640 1 --2- 172.21.15.60:0/1704369909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a80cf8b0 0x7f27a815ffa0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.922+0000 7f27adcd2640 1 --2- 172.21.15.60:0/1704369909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27a815c470 0x7f27a80b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.922+0000 7f27adcd2640 1 -- 172.21.15.60:0/1704369909 >> 172.21.15.60:0/1704369909 conn(0x7f27a806bc10 msgr2=0x7f27a806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.922+0000 7f27adcd2640 1 -- 172.21.15.60:0/1704369909 shutdown_connections 2024-09-12T01:43:35.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.922+0000 7f27adcd2640 1 -- 172.21.15.60:0/1704369909 wait complete. 2024-09-12T01:43:35.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.923+0000 7f27adcd2640 1 Processor -- start 2024-09-12T01:43:35.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.923+0000 7f27adcd2640 1 -- start start 2024-09-12T01:43:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.924+0000 7f27adcd2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a80b3c50 0x7f27a81e7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.924+0000 7f27adcd2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27a80cf8b0 0x7f27a8150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.924+0000 7f27adcd2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a815c470 0x7f27a8150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.924+0000 7f27adcd2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f27a806e1b0 con 0x7f27a815c470 2024-09-12T01:43:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.924+0000 7f27adcd2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f27a80b4d90 con 0x7f27a80b3c50 2024-09-12T01:43:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.924+0000 7f27adcd2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f27a81604e0 con 0x7f27a80cf8b0 2024-09-12T01:43:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.924+0000 7f27a7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a815c470 0x7f27a8150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.924+0000 7f27a7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a815c470 0x7f27a8150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55690/0 (socket says 172.21.15.60:55690) 2024-09-12T01:43:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.924+0000 7f27a7fff640 1 -- 172.21.15.60:0/3165088415 learned_addr learned my addr 172.21.15.60:0/3165088415 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:35.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.924+0000 7f27a77fe640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a80b3c50 0x7f27a81e7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.924+0000 7f27a6ffd640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27a80cf8b0 0x7f27a8150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.925+0000 7f27a7fff640 1 -- 172.21.15.60:0/3165088415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27a80cf8b0 msgr2=0x7f27a8150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.925+0000 7f27a7fff640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27a80cf8b0 0x7f27a8150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.925+0000 7f27a7fff640 1 -- 172.21.15.60:0/3165088415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a80b3c50 msgr2=0x7f27a81e7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.925+0000 7f27a7fff640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a80b3c50 0x7f27a81e7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.925+0000 7f27a7fff640 1 -- 172.21.15.60:0/3165088415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a815d5d0 con 0x7f27a815c470 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.925+0000 7f27a77fe640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a80b3c50 0x7f27a81e7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.925+0000 7f27a7fff640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a815c470 0x7f27a8150460 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009f40 tx=0x7f27a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.925+0000 7f278ffff640 1 -- 172.21.15.60:0/3165088415 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0041020 con 0x7f27a815c470 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.925+0000 7f278ffff640 1 -- 172.21.15.60:0/3165088415 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a00077a0 con 0x7f27a815c470 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.925+0000 7f278ffff640 1 -- 172.21.15.60:0/3165088415 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a0036040 con 0x7f27a815c470 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.925+0000 7f27adcd2640 1 -- 172.21.15.60:0/3165088415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a815d870 con 0x7f27a815c470 2024-09-12T01:43:35.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.925+0000 7f27adcd2640 1 -- 172.21.15.60:0/3165088415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a8151320 con 0x7f27a815c470 2024-09-12T01:43:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.926+0000 7f27adcd2640 1 -- 172.21.15.60:0/3165088415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a815ffa0 con 0x7f27a815c470 2024-09-12T01:43:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.926+0000 7f278ffff640 1 -- 172.21.15.60:0/3165088415 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f27a0044020 con 0x7f27a815c470 2024-09-12T01:43:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.927+0000 7f278ffff640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f279406be60 0x7f279406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.927+0000 7f278ffff640 1 -- 172.21.15.60:0/3165088415 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f27a00abac0 con 0x7f27a815c470 2024-09-12T01:43:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.927+0000 7f27a77fe640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f279406be60 0x7f279406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:35.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.927+0000 7f27a77fe640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f279406be60 0x7f279406e320 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2798009890 tx=0x7f2798008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:35.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:35.931+0000 7f278ffff640 1 -- 172.21.15.60:0/3165088415 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f27a004b030 con 0x7f27a815c470 2024-09-12T01:43:36.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.146+0000 7f27adcd2640 1 -- 172.21.15.60:0/3165088415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27a806d590 con 0x7f27a815c470 2024-09-12T01:43:36.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.147+0000 7f278ffff640 1 -- 172.21.15.60:0/3165088415 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5231 (secure 0 0 0) 0x7f27a007a500 con 0x7f27a815c470 2024-09-12T01:43:36.147 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:36.147 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":71,"btime":"2024-09-12T01:43:30:416085+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2206957364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2206957364},{"type":"v1","addr":"172.21.15.105:6835","nonce":2206957364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7536,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3802062072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3802062072},{"type":"v1","addr":"172.21.15.60:6836","nonce":3802062072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3557949323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3557949323},{"type":"v1","addr":"172.21.15.60:6837","nonce":3557949323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:09.348346+0000","modified":"2024-09-12T01:43:30.025684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6834/3613656777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3613656777},{"type":"v1","addr":"172.21.15.105:6834","nonce":3613656777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":9}]} 2024-09-12T01:43:36.147 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 71 2024-09-12T01:43:36.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.149+0000 7f27adcd2640 1 -- 172.21.15.60:0/3165088415 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f279406be60 msgr2=0x7f279406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:36.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.149+0000 7f27adcd2640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f279406be60 0x7f279406e320 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2798009890 tx=0x7f2798008040 comp rx=0 tx=0).stop 2024-09-12T01:43:36.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.149+0000 7f27adcd2640 1 -- 172.21.15.60:0/3165088415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a815c470 msgr2=0x7f27a8150460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:36.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.149+0000 7f27adcd2640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a815c470 0x7f27a8150460 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f27a0009f40 tx=0x7f27a0004a40 comp rx=0 tx=0).stop 2024-09-12T01:43:36.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.149+0000 7f27adcd2640 1 -- 172.21.15.60:0/3165088415 shutdown_connections 2024-09-12T01:43:36.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.149+0000 7f27adcd2640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27a815c470 0x7f27a8150460 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.149+0000 7f27adcd2640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f279406be60 0x7f279406e320 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.149+0000 7f27adcd2640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27a80cf8b0 0x7f27a8150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.149+0000 7f27adcd2640 1 --2- 172.21.15.60:0/3165088415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27a80b3c50 0x7f27a81e7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.149+0000 7f27adcd2640 1 -- 172.21.15.60:0/3165088415 >> 172.21.15.60:0/3165088415 conn(0x7f27a806bc10 msgr2=0x7f27a80723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:36.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.149+0000 7f27adcd2640 1 -- 172.21.15.60:0/3165088415 shutdown_connections 2024-09-12T01:43:36.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.149+0000 7f27adcd2640 1 -- 172.21.15.60:0/3165088415 wait complete. 2024-09-12T01:43:36.160 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json session ls 2024-09-12T01:43:36.302 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":7000,"entity":{"name":{"type":"client","num":7000},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":2858918596}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":15.254687649999999,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9075152522503709,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.7000 192.168.0.1:0/2858918596","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi105","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":36284,"entity":{"name":{"type":"client","num":36284},"addr":{"type":"any","addr":"172.21.15.60:0","nonce":3352581087}},"state":"open","num_leases":1,"num_caps":102,"request_load_avg":180,"uptime":16.355665106,"requests_in_flight":0,"num_completed_requests":200,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":1110.2255696201298,"halflife":60},"release_caps":{"value":99.696637781595868,"halflife":60},"recall_caps_throttle":{"value":235.32098004632508,"halflife":1.5},"recall_caps_throttle2o":{"value":88.793370246995309,"halflife":0.5},"session_cache_liveness":{"value":393.35215917003717,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":10,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.36284 172.21.15.60:0/3352581087","completed_requests":[{"tid":10,"created_ino":"0x10000000001"},{"tid":11,"created_ino":"0x100000001f6"},{"tid":12,"created_ino":"0x100000001f7"},{"tid":13,"created_ino":"0x100000001f8"},{"tid":14,"created_ino":"0x100000001f9"},{"tid":15,"created_ino":"0x100000001fa"},{"tid":16,"created_ino":"0x100000001fb"},{"tid":17,"created_ino":"0x100000001fc"},{"tid":18,"created_ino":"0x100000001fd"},{"tid":19,"created_ino":"0x100000001fe"},{"tid":20,"created_ino":"0x100000001ff"},{"tid":21,"created_ino":"0x10000000200"},{"tid":22,"created_ino":"0x10000000201"},{"tid":23,"created_ino":"0x10000000202"},{"tid":24,"created_ino":"0x10000000203"},{"tid":25,"created_ino":"0x10000000204"},{"tid":26,"created_ino":"0x10000000205"},{"tid":27,"created_ino":"0x10000000206"},{"tid":28,"created_ino":"0x10000000207"},{"tid":29,"created_ino":"0x10000000208"},{"tid":30,"created_ino":"0x10000000209"},{"tid":31,"created_ino":"0x1000000020a"},{"tid":32,"created_ino":"0x1000000020b"},{"tid":33,"created_ino":"0x1000000020c"},{"tid":34,"created_ino":"0x1000000020d"},{"tid":35,"created_ino":"0x1000000020e"},{"tid":36,"created_ino":"0x1000000020f"},{"tid":37,"created_ino":"0x10000000210"},{"tid":38,"created_ino":"0x10000000211"},{"tid":39,"created_ino":"0x10000000212"},{"tid":40,"created_ino":"0x10000000213"},{"tid":41,"created_ino":"0x10000000214"},{"tid":42,"created_ino":"0x10000000215"},{"tid":43,"created_ino":"0x10000000216"},{"tid":44,"created_ino":"0x10000000217"},{"tid":45,"created_ino":"0x10000000218"},{"tid":46,"created_ino":"0x10000000219"},{"tid":47,"created_ino":"0x1000000021a"},{"tid":48,"created_ino":"0x1000000021b"},{"tid":49,"created_ino":"0x1000000021c"},{"tid":50,"created_ino":"0x1000000021d"},{"tid":51,"created_ino":"0x1000000021e"},{"tid":52,"created_ino":"0x1000000021f"},{"tid":53,"created_ino":"0x10000000220"},{"tid":54,"created_ino":"0x10000000221"},{"tid":55,"created_ino":"0x10000000222"},{"tid":56,"created_ino":"0x10000000223"},{"tid":57,"created_ino":"0x10000000224"},{"tid":58,"created_ino":"0x10000000225"},{"tid":59,"created_ino":"0x10000000226"},{"tid":60,"created_ino":"0x10000000227"},{"tid":61,"created_ino":"0x10000000228"},{"tid":62,"created_ino":"0x10000000229"},{"tid":63,"created_ino":"0x1000000022a"},{"tid":64,"created_ino":"0x1000000022b"},{"tid":65,"created_ino":"0x1000000022c"},{"tid":66,"created_ino":"0x1000000022d"},{"tid":67,"created_ino":"0x1000000022e"},{"tid":68,"created_ino":"0x1000000022f"},{"tid":69,"created_ino":"0x10000000230"},{"tid":70,"created_ino":"0x10000000231"},{"tid":71,"created_ino":"0x10000000232"},{"tid":72,"created_ino":"0x10000000233"},{"tid":73,"created_ino":"0x10000000234"},{"tid":74,"created_ino":"0x10000000235"},{"tid":75,"created_ino":"0x10000000236"},{"tid":76,"created_ino":"0x10000000237"},{"tid":77,"created_ino":"0x10000000238"},{"tid":78,"created_ino":"0x10000000239"},{"tid":79,"created_ino":"0x1000000023a"},{"tid":80,"created_ino":"0x1000000023b"},{"tid":81,"created_ino":"0x1000000023c"},{"tid":82,"created_ino":"0x1000000023d"},{"tid":83,"created_ino":"0x1000000023e"},{"tid":84,"created_ino":"0x1000000023f"},{"tid":85,"created_ino":"0x10000000240"},{"tid":86,"created_ino":"0x10000000241"},{"tid":87,"created_ino":"0x10000000242"},{"tid":88,"created_ino":"0x10000000243"},{"tid":89,"created_ino":"0x10000000244"},{"tid":90,"created_ino":"0x10000000245"},{"tid":91,"created_ino":"0x10000000246"},{"tid":92,"created_ino":"0x10000000247"},{"tid":93,"created_ino":"0x10000000248"},{"tid":94,"created_ino":"0x10000000249"},{"tid":95,"created_ino":"0x1000000024a"},{"tid":96,"created_ino":"0x1000000024b"},{"tid":97,"created_ino":"0x1000000024c"},{"tid":98,"created_ino":"0x1000000024d"},{"tid":99,"created_ino":"0x1000000024e"},{"tid":100,"created_ino":"0x1000000024f"},{"tid":101,"created_ino":"0x10000000250"},{"tid":102,"created_ino":"0x10000000251"},{"tid":103,"created_ino":"0x10000000252"},{"tid":104,"created_ino":"0x10000000253"},{"tid":105,"created_ino":"0x10000000254"},{"tid":106,"created_ino":"0x10000000255"},{"tid":107,"created_ino":"0x10000000256"},{"tid":108,"created_ino":"0x10000000257"},{"tid":109,"created_ino":"0x10000000258"},{"tid":110,"created_ino":"0x10000000259"},{"tid":111,"created_ino":"0x1000000025a"},{"tid":112,"created_ino":"0x1000000025b"},{"tid":113,"created_ino":"0x1000000025c"},{"tid":114,"created_ino":"0x1000000025d"},{"tid":115,"created_ino":"0x1000000025e"},{"tid":116,"created_ino":"0x1000000025f"},{"tid":117,"created_ino":"0x10000000260"},{"tid":118,"created_ino":"0x10000000261"},{"tid":119,"created_ino":"0x10000000262"},{"tid":120,"created_ino":"0x10000000263"},{"tid":121,"created_ino":"0x10000000264"},{"tid":122,"created_ino":"0x10000000265"},{"tid":123,"created_ino":"0x10000000266"},{"tid":124,"created_ino":"0x10000000267"},{"tid":125,"created_ino":"0x10000000268"},{"tid":126,"created_ino":"0x10000000269"},{"tid":127,"created_ino":"0x1000000026a"},{"tid":128,"created_ino":"0x1000000026b"},{"tid":129,"created_ino":"0x1000000026c"},{"tid":130,"created_ino":"0x1000000026d"},{"tid":131,"created_ino":"0x1000000026e"},{"tid":132,"created_ino":"0x1000000026f"},{"tid":133,"created_ino":"0x10000000270"},{"tid":134,"created_ino":"0x10000000271"},{"tid":135,"created_ino":"0x10000000272"},{"tid":136,"created_ino":"0x10000000273"},{"tid":137,"created_ino":"0x10000000274"},{"tid":138,"created_ino":"0x10000000275"},{"tid":139,"created_ino":"0x10000000276"},{"tid":140,"created_ino":"0x10000000277"},{"tid":141,"created_ino":"0x10000000278"},{"tid":142,"created_ino":"0x10000000279"},{"tid":143,"created_ino":"0x1000000027a"},{"tid":144,"created_ino":"0x1000000027b"},{"tid":145,"created_ino":"0x1000000027c"},{"tid":146,"created_ino":"0x1000000027d"},{"tid":147,"created_ino":"0x1000000027e"},{"tid":148,"created_ino":"0x1000000027f"},{"tid":149,"created_ino":"0x10000000280"},{"tid":150,"created_ino":"0x10000000281"},{"tid":151,"created_ino":"0x10000000282"},{"tid":152,"created_ino":"0x10000000283"},{"tid":153,"created_ino":"0x10000000284"},{"tid":154,"created_ino":"0x10000000285"},{"tid":155,"created_ino":"0x10000000286"},{"tid":156,"created_ino":"0x10000000287"},{"tid":157,"created_ino":"0x10000000288"},{"tid":158,"created_ino":"0x10000000289"},{"tid":159,"created_ino":"0x1000000028a"},{"tid":160,"created_ino":"0x1000000028b"},{"tid":161,"created_ino":"0x1000000028c"},{"tid":162,"created_ino":"0x1000000028d"},{"tid":163,"created_ino":"0x1000000028e"},{"tid":164,"created_ino":"0x1000000028f"},{"tid":165,"created_ino":"0x10000000290"},{"tid":166,"created_ino":"0x10000000291"},{"tid":167,"created_ino":"0x10000000292"},{"tid":168,"created_ino":"0x10000000293"},{"tid":169,"created_ino":"0x10000000294"},{"tid":170,"created_ino":"0x10000000295"},{"tid":171,"created_ino":"0x10000000296"},{"tid":172,"created_ino":"0x10000000297"},{"tid":173,"created_ino":"0x10000000298"},{"tid":174,"created_ino":"0x10000000299"},{"tid":175,"created_ino":"0x1000000029a"},{"tid":176,"created_ino":"0x1000000029b"},{"tid":177,"created_ino":"0x1000000029c"},{"tid":178,"created_ino":"0x1000000029d"},{"tid":179,"created_ino":"0x1000000029e"},{"tid":180,"created_ino":"0x1000000029f"},{"tid":181,"created_ino":"0x100000002a0"},{"tid":182,"created_ino":"0x100000002a1"},{"tid":183,"created_ino":"0x100000002a2"},{"tid":184,"created_ino":"0x100000002a3"},{"tid":185,"created_ino":"0x100000002a4"},{"tid":186,"created_ino":"0x100000002a5"},{"tid":187,"created_ino":"0x100000002a6"},{"tid":188,"created_ino":"0x100000002a7"},{"tid":189,"created_ino":"0x100000002a8"},{"tid":190,"created_ino":"0x100000002a9"},{"tid":191,"created_ino":"0x100000002aa"},{"tid":192,"created_ino":"0x100000002ab"},{"tid":193,"created_ino":"0x100000002ac"},{"tid":194,"created_ino":"0x100000002ad"},{"tid":195,"created_ino":"0x100000002ae"},{"tid":196,"created_ino":"0x100000002af"},{"tid":197,"created_ino":"0x100000002b0"},{"tid":198,"created_ino":"0x100000002b1"},{"tid":199,"created_ino":"0x100000002b2"},{"tid":200,"created_ino":"0x100000002b3"},{"tid":201,"created_ino":"0x100000002b4"},{"tid":202,"created_ino":"0x100000002b5"},{"tid":203,"created_ino":"0x100000002b6"},{"tid":204,"created_ino":"0x100000002b7"},{"tid":205,"created_ino":"0x100000002b8"},{"tid":206,"created_ino":"0x100000002b9"},{"tid":207,"created_ino":"0x100000002ba"},{"tid":208,"created_ino":"0x100000002bb"},{"tid":209,"created_ino":"0x100000002bc"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x100000002bd","length":802}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi060","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-12T01:43:36.305 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi105", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 2858918596, "type": "any" }, "name": { "num": 7000, "type": "client" } }, "id": 7000, "inst": "client.7000 192.168.0.1:0/2858918596", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.907515252250371 }, "state": "open", "uptime": 15.25468765 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi060", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x10000000001", "tid": 10 }, { "created_ino": "0x100000001f6", "tid": 11 }, { "created_ino": "0x100000001f7", "tid": 12 }, { "created_ino": "0x100000001f8", "tid": 13 }, { "created_ino": "0x100000001f9", "tid": 14 }, { "created_ino": "0x100000001fa", "tid": 15 }, { "created_ino": "0x100000001fb", "tid": 16 }, { "created_ino": "0x100000001fc", "tid": 17 }, { "created_ino": "0x100000001fd", "tid": 18 }, { "created_ino": "0x100000001fe", "tid": 19 }, { "created_ino": "0x100000001ff", "tid": 20 }, { "created_ino": "0x10000000200", "tid": 21 }, { "created_ino": "0x10000000201", "tid": 22 }, { "created_ino": "0x10000000202", "tid": 23 }, { "created_ino": "0x10000000203", "tid": 24 }, { "created_ino": "0x10000000204", "tid": 25 }, { "created_ino": "0x10000000205", "tid": 26 }, { "created_ino": "0x10000000206", "tid": 27 }, { "created_ino": "0x10000000207", "tid": 28 }, { "created_ino": "0x10000000208", "tid": 29 }, { "created_ino": "0x10000000209", "tid": 30 }, { "created_ino": "0x1000000020a", "tid": 31 }, { "created_ino": "0x1000000020b", "tid": 32 }, { "created_ino": "0x1000000020c", "tid": 33 }, { "created_ino": "0x1000000020d", "tid": 34 }, { "created_ino": "0x1000000020e", "tid": 35 }, { "created_ino": "0x1000000020f", "tid": 36 }, { "created_ino": "0x10000000210", "tid": 37 }, { "created_ino": "0x10000000211", "tid": 38 }, { "created_ino": "0x10000000212", "tid": 39 }, { "created_ino": "0x10000000213", "tid": 40 }, { "created_ino": "0x10000000214", "tid": 41 }, { "created_ino": "0x10000000215", "tid": 42 }, { "created_ino": "0x10000000216", "tid": 43 }, { "created_ino": "0x10000000217", "tid": 44 }, { "created_ino": "0x10000000218", "tid": 45 }, { "created_ino": "0x10000000219", "tid": 46 }, { "created_ino": "0x1000000021a", "tid": 47 }, { "created_ino": "0x1000000021b", "tid": 48 }, { "created_ino": "0x1000000021c", "tid": 49 }, { "created_ino": "0x1000000021d", "tid": 50 }, { "created_ino": "0x1000000021e", "tid": 51 }, { "created_ino": "0x1000000021f", "tid": 52 }, { "created_ino": "0x10000000220", "tid": 53 }, { "created_ino": "0x10000000221", "tid": 54 }, { "created_ino": "0x10000000222", "tid": 55 }, { "created_ino": "0x10000000223", "tid": 56 }, { "created_ino": "0x10000000224", "tid": 57 }, { "created_ino": "0x10000000225", "tid": 58 }, { "created_ino": "0x10000000226", "tid": 59 }, { "created_ino": "0x10000000227", "tid": 60 }, { "created_ino": "0x10000000228", "tid": 61 }, { "created_ino": "0x10000000229", "tid": 62 }, { "created_ino": "0x1000000022a", "tid": 63 }, { "created_ino": "0x1000000022b", "tid": 64 }, { "created_ino": "0x1000000022c", "tid": 65 }, { "created_ino": "0x1000000022d", "tid": 66 }, { "created_ino": "0x1000000022e", "tid": 67 }, { "created_ino": "0x1000000022f", "tid": 68 }, { "created_ino": "0x10000000230", "tid": 69 }, { "created_ino": "0x10000000231", "tid": 70 }, { "created_ino": "0x10000000232", "tid": 71 }, { "created_ino": "0x10000000233", "tid": 72 }, { "created_ino": "0x10000000234", "tid": 73 }, { "created_ino": "0x10000000235", "tid": 74 }, { "created_ino": "0x10000000236", "tid": 75 }, { "created_ino": "0x10000000237", "tid": 76 }, { "created_ino": "0x10000000238", "tid": 77 }, { "created_ino": "0x10000000239", "tid": 78 }, { "created_ino": "0x1000000023a", "tid": 79 }, { "created_ino": "0x1000000023b", "tid": 80 }, { "created_ino": "0x1000000023c", "tid": 81 }, { "created_ino": "0x1000000023d", "tid": 82 }, { "created_ino": "0x1000000023e", "tid": 83 }, { "created_ino": "0x1000000023f", "tid": 84 }, { "created_ino": "0x10000000240", "tid": 85 }, { "created_ino": "0x10000000241", "tid": 86 }, { "created_ino": "0x10000000242", "tid": 87 }, { "created_ino": "0x10000000243", "tid": 88 }, { "created_ino": "0x10000000244", "tid": 89 }, { "created_ino": "0x10000000245", "tid": 90 }, { "created_ino": "0x10000000246", "tid": 91 }, { "created_ino": "0x10000000247", "tid": 92 }, { "created_ino": "0x10000000248", "tid": 93 }, { "created_ino": "0x10000000249", "tid": 94 }, { "created_ino": "0x1000000024a", "tid": 95 }, { "created_ino": "0x1000000024b", "tid": 96 }, { "created_ino": "0x1000000024c", "tid": 97 }, { "created_ino": "0x1000000024d", "tid": 98 }, { "created_ino": "0x1000000024e", "tid": 99 }, { "created_ino": "0x1000000024f", "tid": 100 }, { "created_ino": "0x10000000250", "tid": 101 }, { "created_ino": "0x10000000251", "tid": 102 }, { "created_ino": "0x10000000252", "tid": 103 }, { "created_ino": "0x10000000253", "tid": 104 }, { "created_ino": "0x10000000254", "tid": 105 }, { "created_ino": "0x10000000255", "tid": 106 }, { "created_ino": "0x10000000256", "tid": 107 }, { "created_ino": "0x10000000257", "tid": 108 }, { "created_ino": "0x10000000258", "tid": 109 }, { "created_ino": "0x10000000259", "tid": 110 }, { "created_ino": "0x1000000025a", "tid": 111 }, { "created_ino": "0x1000000025b", "tid": 112 }, { "created_ino": "0x1000000025c", "tid": 113 }, { "created_ino": "0x1000000025d", "tid": 114 }, { "created_ino": "0x1000000025e", "tid": 115 }, { "created_ino": "0x1000000025f", "tid": 116 }, { "created_ino": "0x10000000260", "tid": 117 }, { "created_ino": "0x10000000261", "tid": 118 }, { "created_ino": "0x10000000262", "tid": 119 }, { "created_ino": "0x10000000263", "tid": 120 }, { "created_ino": "0x10000000264", "tid": 121 }, { "created_ino": "0x10000000265", "tid": 122 }, { "created_ino": "0x10000000266", "tid": 123 }, { "created_ino": "0x10000000267", "tid": 124 }, { "created_ino": "0x10000000268", "tid": 125 }, { "created_ino": "0x10000000269", "tid": 126 }, { "created_ino": "0x1000000026a", "tid": 127 }, { "created_ino": "0x1000000026b", "tid": 128 }, { "created_ino": "0x1000000026c", "tid": 129 }, { "created_ino": "0x1000000026d", "tid": 130 }, { "created_ino": "0x1000000026e", "tid": 131 }, { "created_ino": "0x1000000026f", "tid": 132 }, { "created_ino": "0x10000000270", "tid": 133 }, { "created_ino": "0x10000000271", "tid": 134 }, { "created_ino": "0x10000000272", "tid": 135 }, { "created_ino": "0x10000000273", "tid": 136 }, { "created_ino": "0x10000000274", "tid": 137 }, { "created_ino": "0x10000000275", "tid": 138 }, { "created_ino": "0x10000000276", "tid": 139 }, { "created_ino": "0x10000000277", "tid": 140 }, { "created_ino": "0x10000000278", "tid": 141 }, { "created_ino": "0x10000000279", "tid": 142 }, { "created_ino": "0x1000000027a", "tid": 143 }, { "created_ino": "0x1000000027b", "tid": 144 }, { "created_ino": "0x1000000027c", "tid": 145 }, { "created_ino": "0x1000000027d", "tid": 146 }, { "created_ino": "0x1000000027e", "tid": 147 }, { "created_ino": "0x1000000027f", "tid": 148 }, { "created_ino": "0x10000000280", "tid": 149 }, { "created_ino": "0x10000000281", "tid": 150 }, { "created_ino": "0x10000000282", "tid": 151 }, { "created_ino": "0x10000000283", "tid": 152 }, { "created_ino": "0x10000000284", "tid": 153 }, { "created_ino": "0x10000000285", "tid": 154 }, { "created_ino": "0x10000000286", "tid": 155 }, { "created_ino": "0x10000000287", "tid": 156 }, { "created_ino": "0x10000000288", "tid": 157 }, { "created_ino": "0x10000000289", "tid": 158 }, { "created_ino": "0x1000000028a", "tid": 159 }, { "created_ino": "0x1000000028b", "tid": 160 }, { "created_ino": "0x1000000028c", "tid": 161 }, { "created_ino": "0x1000000028d", "tid": 162 }, { "created_ino": "0x1000000028e", "tid": 163 }, { "created_ino": "0x1000000028f", "tid": 164 }, { "created_ino": "0x10000000290", "tid": 165 }, { "created_ino": "0x10000000291", "tid": 166 }, { "created_ino": "0x10000000292", "tid": 167 }, { "created_ino": "0x10000000293", "tid": 168 }, { "created_ino": "0x10000000294", "tid": 169 }, { "created_ino": "0x10000000295", "tid": 170 }, { "created_ino": "0x10000000296", "tid": 171 }, { "created_ino": "0x10000000297", "tid": 172 }, { "created_ino": "0x10000000298", "tid": 173 }, { "created_ino": "0x10000000299", "tid": 174 }, { "created_ino": "0x1000000029a", "tid": 175 }, { "created_ino": "0x1000000029b", "tid": 176 }, { "created_ino": "0x1000000029c", "tid": 177 }, { "created_ino": "0x1000000029d", "tid": 178 }, { "created_ino": "0x1000000029e", "tid": 179 }, { "created_ino": "0x1000000029f", "tid": 180 }, { "created_ino": "0x100000002a0", "tid": 181 }, { "created_ino": "0x100000002a1", "tid": 182 }, { "created_ino": "0x100000002a2", "tid": 183 }, { "created_ino": "0x100000002a3", "tid": 184 }, { "created_ino": "0x100000002a4", "tid": 185 }, { "created_ino": "0x100000002a5", "tid": 186 }, { "created_ino": "0x100000002a6", "tid": 187 }, { "created_ino": "0x100000002a7", "tid": 188 }, { "created_ino": "0x100000002a8", "tid": 189 }, { "created_ino": "0x100000002a9", "tid": 190 }, { "created_ino": "0x100000002aa", "tid": 191 }, { "created_ino": "0x100000002ab", "tid": 192 }, { "created_ino": "0x100000002ac", "tid": 193 }, { "created_ino": "0x100000002ad", "tid": 194 }, { "created_ino": "0x100000002ae", "tid": 195 }, { "created_ino": "0x100000002af", "tid": 196 }, { "created_ino": "0x100000002b0", "tid": 197 }, { "created_ino": "0x100000002b1", "tid": 198 }, { "created_ino": "0x100000002b2", "tid": 199 }, { "created_ino": "0x100000002b3", "tid": 200 }, { "created_ino": "0x100000002b4", "tid": 201 }, { "created_ino": "0x100000002b5", "tid": 202 }, { "created_ino": "0x100000002b6", "tid": 203 }, { "created_ino": "0x100000002b7", "tid": 204 }, { "created_ino": "0x100000002b8", "tid": 205 }, { "created_ino": "0x100000002b9", "tid": 206 }, { "created_ino": "0x100000002ba", "tid": 207 }, { "created_ino": "0x100000002bb", "tid": 208 }, { "created_ino": "0x100000002bc", "tid": 209 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "172.21.15.60:0", "nonce": 3352581087, "type": "any" }, "name": { "num": 36284, "type": "client" } }, "id": 36284, "inst": "client.36284 172.21.15.60:0/3352581087", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 10, "num_caps": 102, "num_completed_flushes": 0, "num_completed_requests": 200, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 802, "start": "0x100000002bd" } ], "recall_caps": { "halflife": 60, "value": 1110.2255696201298 }, "recall_caps_throttle": { "halflife": 1.5, "value": 235.32098004632508 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 88.79337024699531 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 99.69663778159587 }, "request_load_avg": 180, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 393.35215917003717 }, "state": "open", "uptime": 16.355665106 } ] 2024-09-12T01:43:36.305 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T01:43:36.305 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:43:36.305 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:43:36.353 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:43:36.401 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:43:36.401 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:43:36.401 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 200\nabs_path = "/home/ubuntu/cephtest/mnt.0/subdir"\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi060') 2024-09-12T01:43:36.401 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:43:36.402 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:36.418 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:43:36.418 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:36.476 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:43:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.619+0000 7f03c1b42640 1 Processor -- start 2024-09-12T01:43:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.619+0000 7f03c1b42640 1 -- start start 2024-09-12T01:43:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.619+0000 7f03c1b42640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f03bc15e7a0 0x7f03bc06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.619+0000 7f03c1b42640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03bc0b68f0 0x7f03bc0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.619+0000 7f03c1b42640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03bc0cf860 con 0x7f03bc0cf1f0 2024-09-12T01:43:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.619+0000 7f03c1b42640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f03bc0d2ca0 con 0x7f03bc15e7a0 2024-09-12T01:43:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.619+0000 7f03c1b42640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f03bc0cfb40 con 0x7f03bc0b68f0 2024-09-12T01:43:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.620+0000 7f03bb7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f03bc15e7a0 0x7f03bc06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.620+0000 7f03bb7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f03bc15e7a0 0x7f03bc06caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55694/0 (socket says 172.21.15.60:55694) 2024-09-12T01:43:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.620+0000 7f03bb7fe640 1 -- 172.21.15.60:0/3775435436 learned_addr learned my addr 172.21.15.60:0/3775435436 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.620+0000 7f03bbfff640 1 --2- 172.21.15.60:0/3775435436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03bc0b68f0 0x7f03bc0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.620+0000 7f03bb7fe640 1 -- 172.21.15.60:0/3775435436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03bc0b68f0 msgr2=0x7f03bc0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.620+0000 7f03bb7fe640 1 --2- 172.21.15.60:0/3775435436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03bc0b68f0 0x7f03bc0d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.620+0000 7f03bb7fe640 1 -- 172.21.15.60:0/3775435436 >> v1:172.21.15.105:6789/0 conn(0x7f03bc0cf1f0 legacy=0x7f03bc0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.620+0000 7f03bb7fe640 1 -- 172.21.15.60:0/3775435436 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03bc0cfe20 con 0x7f03bc15e7a0 2024-09-12T01:43:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.621+0000 7f03bb7fe640 1 --2- 172.21.15.60:0/3775435436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03bc15e7a0 0x7f03bc06caa0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009870 tx=0x7f03ac02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a068e61a0c14833f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.621+0000 7f03baffd640 1 -- 172.21.15.60:0/3775435436 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac037070 con 0x7f03bc15e7a0 2024-09-12T01:43:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.621+0000 7f03baffd640 1 -- 172.21.15.60:0/3775435436 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03ac032440 con 0x7f03bc15e7a0 2024-09-12T01:43:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.621+0000 7f03baffd640 1 -- 172.21.15.60:0/3775435436 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ac032810 con 0x7f03bc15e7a0 2024-09-12T01:43:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.621+0000 7f03c1b42640 1 -- 172.21.15.60:0/3775435436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03bc15e7a0 msgr2=0x7f03bc06caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.621+0000 7f03c1b42640 1 --2- 172.21.15.60:0/3775435436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03bc15e7a0 0x7f03bc06caa0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009870 tx=0x7f03ac02a1c0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.621+0000 7f03c1b42640 1 -- 172.21.15.60:0/3775435436 shutdown_connections 2024-09-12T01:43:36.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.621+0000 7f03c1b42640 1 --2- 172.21.15.60:0/3775435436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03bc0b68f0 0x7f03bc0d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.621+0000 7f03c1b42640 1 --2- 172.21.15.60:0/3775435436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03bc15e7a0 0x7f03bc06caa0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.621+0000 7f03c1b42640 1 -- 172.21.15.60:0/3775435436 >> 172.21.15.60:0/3775435436 conn(0x7f03bc0d11e0 msgr2=0x7f03bc0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.621+0000 7f03c1b42640 1 -- 172.21.15.60:0/3775435436 shutdown_connections 2024-09-12T01:43:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.621+0000 7f03c1b42640 1 -- 172.21.15.60:0/3775435436 wait complete. 2024-09-12T01:43:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.622+0000 7f03c1b42640 1 Processor -- start 2024-09-12T01:43:36.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.623+0000 7f03c1b42640 1 -- start start 2024-09-12T01:43:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.623+0000 7f03c1b42640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03bc0b68f0 0x7f03bc1f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.623+0000 7f03c1b42640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03bc0cf1f0 0x7f03bc0b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.623+0000 7f03c1b42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03bc15e7a0 0x7f03bc15a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.623+0000 7f03c1b42640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc06cfe0 con 0x7f03bc15e7a0 2024-09-12T01:43:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.623+0000 7f03c1b42640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f03bc0b7a00 con 0x7f03bc0cf1f0 2024-09-12T01:43:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.623+0000 7f03c1b42640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f03bc15eb80 con 0x7f03bc0b68f0 2024-09-12T01:43:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03bbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03bc15e7a0 0x7f03bc15a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03bbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03bc15e7a0 0x7f03bc15a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55702/0 (socket says 172.21.15.60:55702) 2024-09-12T01:43:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03bbfff640 1 -- 172.21.15.60:0/4247855553 learned_addr learned my addr 172.21.15.60:0/4247855553 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03bb7fe640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03bc0b68f0 0x7f03bc1f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03b2ffd640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03bc0cf1f0 0x7f03bc0b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:36.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03bbfff640 1 -- 172.21.15.60:0/4247855553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03bc0b68f0 msgr2=0x7f03bc1f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03bbfff640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03bc0b68f0 0x7f03bc1f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03bbfff640 1 -- 172.21.15.60:0/4247855553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03bc0cf1f0 msgr2=0x7f03bc0b3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03bbfff640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03bc0cf1f0 0x7f03bc0b3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03bbfff640 1 -- 172.21.15.60:0/4247855553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03bc15f2f0 con 0x7f03bc15e7a0 2024-09-12T01:43:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03bbfff640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03bc15e7a0 0x7f03bc15a830 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f03b400efc0 tx=0x7f03b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03b8ff9640 1 -- 172.21.15.60:0/4247855553 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b4018020 con 0x7f03bc15e7a0 2024-09-12T01:43:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03b8ff9640 1 -- 172.21.15.60:0/4247855553 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03b4014480 con 0x7f03bc15e7a0 2024-09-12T01:43:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03c1b42640 1 -- 172.21.15.60:0/4247855553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03bc15f5d0 con 0x7f03bc15e7a0 2024-09-12T01:43:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03b8ff9640 1 -- 172.21.15.60:0/4247855553 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b4014870 con 0x7f03bc15e7a0 2024-09-12T01:43:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.624+0000 7f03c1b42640 1 -- 172.21.15.60:0/4247855553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03bc15fb90 con 0x7f03bc15e7a0 2024-09-12T01:43:36.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.625+0000 7f03c1b42640 1 -- 172.21.15.60:0/4247855553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03bc06caa0 con 0x7f03bc15e7a0 2024-09-12T01:43:36.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.626+0000 7f03b8ff9640 1 -- 172.21.15.60:0/4247855553 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f03b4005d10 con 0x7f03bc15e7a0 2024-09-12T01:43:36.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.626+0000 7f03b8ff9640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f039c06be30 0x7f039c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:36.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.626+0000 7f03b8ff9640 1 -- 172.21.15.60:0/4247855553 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f03b408bc10 con 0x7f03bc15e7a0 2024-09-12T01:43:36.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.626+0000 7f03bb7fe640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f039c06be30 0x7f039c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:36.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.627+0000 7f03bb7fe640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f039c06be30 0x7f039c06e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f03ac034000 tx=0x7f03ac02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:36.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.631+0000 7f03b8ff9640 1 -- 172.21.15.60:0/4247855553 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f03b4022030 con 0x7f03bc15e7a0 2024-09-12T01:43:36.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.817+0000 7f03c1b42640 1 -- 172.21.15.60:0/4247855553 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f03bc1610f0 con 0x7f03bc15e7a0 2024-09-12T01:43:36.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.818+0000 7f03b8ff9640 1 -- 172.21.15.60:0/4247855553 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) ==== 80+0+0 (secure 0 0 0) 0x7f03bc1610f0 con 0x7f03bc15e7a0 2024-09-12T01:43:36.817 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:43:36.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.820+0000 7f03c1b42640 1 -- 172.21.15.60:0/4247855553 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f039c06be30 msgr2=0x7f039c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:36.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.820+0000 7f03c1b42640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f039c06be30 0x7f039c06e2f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f03ac034000 tx=0x7f03ac02e000 comp rx=0 tx=0).stop 2024-09-12T01:43:36.819 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.820+0000 7f03c1b42640 1 -- 172.21.15.60:0/4247855553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03bc15e7a0 msgr2=0x7f03bc15a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:36.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.820+0000 7f03c1b42640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03bc15e7a0 0x7f03bc15a830 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f03b400efc0 tx=0x7f03b400c490 comp rx=0 tx=0).stop 2024-09-12T01:43:36.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.820+0000 7f03c1b42640 1 -- 172.21.15.60:0/4247855553 shutdown_connections 2024-09-12T01:43:36.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.820+0000 7f03c1b42640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03bc15e7a0 0x7f03bc15a830 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.820+0000 7f03c1b42640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f03bc0cf1f0 0x7f03bc0b3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.820+0000 7f03c1b42640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f039c06be30 0x7f039c06e2f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.820+0000 7f03c1b42640 1 --2- 172.21.15.60:0/4247855553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f03bc0b68f0 0x7f03bc1f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:36.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.820+0000 7f03c1b42640 1 -- 172.21.15.60:0/4247855553 >> 172.21.15.60:0/4247855553 conn(0x7f03bc0d11e0 msgr2=0x7f03bc0b8380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:36.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.820+0000 7f03c1b42640 1 -- 172.21.15.60:0/4247855553 shutdown_connections 2024-09-12T01:43:36.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:36.820+0000 7f03c1b42640 1 -- 172.21.15.60:0/4247855553 wait complete. 2024-09-12T01:43:36.830 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:43:36.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:36.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:43:36.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:43:36.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:36.936 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:43:36.952 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:43:36.953 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:43:36.953 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:36.969 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:43:36.969 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:37.025 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:43:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.129+0000 7fca700e4640 1 Processor -- start 2024-09-12T01:43:37.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.130+0000 7fca700e4640 1 -- start start 2024-09-12T01:43:37.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.130+0000 7fca700e4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca6815e7a0 0x7fca6806caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca700e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca680b68f0 0x7fca680d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca700e4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca680cf860 con 0x7fca680cf1f0 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca700e4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fca680d2ca0 con 0x7fca6815e7a0 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca700e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fca680cfb40 con 0x7fca680b68f0 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca6d67f640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fca680cf1f0 0x7fca680b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56028/0 (socket says 172.21.15.60:56028) 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca6d67f640 1 -- 172.21.15.60:0/1210451746 learned_addr learned my addr 172.21.15.60:0/1210451746 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca6de80640 1 --2- 172.21.15.60:0/1210451746 >> v2:172.21.15.105:3300/0 conn(0x7fca6815e7a0 0x7fca6806caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca6e681640 1 --2- 172.21.15.60:0/1210451746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca680b68f0 0x7fca680d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca6ce7e640 1 -- 172.21.15.60:0/1210451746 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118837343 0 0) 0x7fca680cf860 con 0x7fca680cf1f0 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca6ce7e640 1 -- 172.21.15.60:0/1210451746 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca54003520 con 0x7fca680cf1f0 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca6de80640 1 -- 172.21.15.60:0/1210451746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca680b68f0 msgr2=0x7fca680d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca6de80640 1 --2- 172.21.15.60:0/1210451746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca680b68f0 0x7fca680d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca6de80640 1 -- 172.21.15.60:0/1210451746 >> v1:172.21.15.60:6789/0 conn(0x7fca680cf1f0 legacy=0x7fca680b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca6de80640 1 -- 172.21.15.60:0/1210451746 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca680cfe20 con 0x7fca6815e7a0 2024-09-12T01:43:37.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.131+0000 7fca6e681640 1 --2- 172.21.15.60:0/1210451746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca680b68f0 0x7fca680d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.132+0000 7fca6de80640 1 --2- 172.21.15.60:0/1210451746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca6815e7a0 0x7fca6806caa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fca640097a0 tx=0x7fca6402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fce2b6971cfc23d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.132+0000 7fca6ce7e640 1 -- 172.21.15.60:0/1210451746 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64037070 con 0x7fca6815e7a0 2024-09-12T01:43:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.132+0000 7fca6ce7e640 1 -- 172.21.15.60:0/1210451746 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6402ae50 con 0x7fca6815e7a0 2024-09-12T01:43:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.132+0000 7fca6ce7e640 1 -- 172.21.15.60:0/1210451746 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64032640 con 0x7fca6815e7a0 2024-09-12T01:43:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.133+0000 7fca700e4640 1 -- 172.21.15.60:0/1210451746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca6815e7a0 msgr2=0x7fca6806caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.133+0000 7fca700e4640 1 --2- 172.21.15.60:0/1210451746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca6815e7a0 0x7fca6806caa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fca640097a0 tx=0x7fca6402a100 comp rx=0 tx=0).stop 2024-09-12T01:43:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.133+0000 7fca700e4640 1 -- 172.21.15.60:0/1210451746 shutdown_connections 2024-09-12T01:43:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.133+0000 7fca700e4640 1 --2- 172.21.15.60:0/1210451746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca680b68f0 0x7fca680d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.133+0000 7fca700e4640 1 --2- 172.21.15.60:0/1210451746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca6815e7a0 0x7fca6806caa0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.133+0000 7fca700e4640 1 -- 172.21.15.60:0/1210451746 >> 172.21.15.60:0/1210451746 conn(0x7fca680d11e0 msgr2=0x7fca680d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.133+0000 7fca700e4640 1 -- 172.21.15.60:0/1210451746 shutdown_connections 2024-09-12T01:43:37.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.133+0000 7fca700e4640 1 -- 172.21.15.60:0/1210451746 wait complete. 2024-09-12T01:43:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.134+0000 7fca700e4640 1 Processor -- start 2024-09-12T01:43:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.134+0000 7fca700e4640 1 -- start start 2024-09-12T01:43:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca700e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca680b68f0 0x7fca681e9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca700e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca680cf1f0 0x7fca680cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca700e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca6815e7a0 0x7fca6815f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca700e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fca6806cfe0 con 0x7fca680b68f0 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca700e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca680b7a00 con 0x7fca680cf1f0 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca700e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fca6815eb80 con 0x7fca6815e7a0 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca6de80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca680b68f0 0x7fca681e9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca6de80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca680b68f0 0x7fca681e9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55708/0 (socket says 172.21.15.60:55708) 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca6de80640 1 -- 172.21.15.60:0/2681419525 learned_addr learned my addr 172.21.15.60:0/2681419525 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca6d67f640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca680cf1f0 0x7fca680cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca6e681640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca6815e7a0 0x7fca6815f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca6de80640 1 -- 172.21.15.60:0/2681419525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca6815e7a0 msgr2=0x7fca6815f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca6de80640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca6815e7a0 0x7fca6815f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca6de80640 1 -- 172.21.15.60:0/2681419525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca680cf1f0 msgr2=0x7fca680cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca6de80640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca680cf1f0 0x7fca680cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca6de80640 1 -- 172.21.15.60:0/2681419525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca680c8e00 con 0x7fca680b68f0 2024-09-12T01:43:37.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.135+0000 7fca6de80640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca680b68f0 0x7fca681e9d20 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fca6402a140 tx=0x7fca640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:37.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.136+0000 7fca5e7fc640 1 -- 172.21.15.60:0/2681419525 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64041070 con 0x7fca680b68f0 2024-09-12T01:43:37.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.136+0000 7fca5e7fc640 1 -- 172.21.15.60:0/2681419525 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6403c460 con 0x7fca680b68f0 2024-09-12T01:43:37.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.136+0000 7fca700e4640 1 -- 172.21.15.60:0/2681419525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca680cb160 con 0x7fca680b68f0 2024-09-12T01:43:37.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.136+0000 7fca5e7fc640 1 -- 172.21.15.60:0/2681419525 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64037040 con 0x7fca680b68f0 2024-09-12T01:43:37.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.136+0000 7fca700e4640 1 -- 172.21.15.60:0/2681419525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca681ea610 con 0x7fca680b68f0 2024-09-12T01:43:37.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.137+0000 7fca700e4640 1 -- 172.21.15.60:0/2681419525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca6806caa0 con 0x7fca680b68f0 2024-09-12T01:43:37.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.137+0000 7fca5e7fc640 1 -- 172.21.15.60:0/2681419525 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca64044070 con 0x7fca680b68f0 2024-09-12T01:43:37.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.138+0000 7fca5e7fc640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fca4c06be30 0x7fca4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.138+0000 7fca5e7fc640 1 -- 172.21.15.60:0/2681419525 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7fca640ab360 con 0x7fca680b68f0 2024-09-12T01:43:37.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.138+0000 7fca6d67f640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fca4c06be30 0x7fca4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.138+0000 7fca6d67f640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fca4c06be30 0x7fca4c06e2f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fca681ea260 tx=0x7fca58009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:37.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.142+0000 7fca5e7fc640 1 -- 172.21.15.60:0/2681419525 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca640796d0 con 0x7fca680b68f0 2024-09-12T01:43:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.329+0000 7fca700e4640 1 -- 172.21.15.60:0/2681419525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fca6815bd80 con 0x7fca680b68f0 2024-09-12T01:43:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.329+0000 7fca5e7fc640 1 -- 172.21.15.60:0/2681419525 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) ==== 80+0+0 (secure 0 0 0) 0x7fca6407d9d0 con 0x7fca680b68f0 2024-09-12T01:43:37.329 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:43:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.331+0000 7fca700e4640 1 -- 172.21.15.60:0/2681419525 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fca4c06be30 msgr2=0x7fca4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.331+0000 7fca700e4640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fca4c06be30 0x7fca4c06e2f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fca681ea260 tx=0x7fca58009040 comp rx=0 tx=0).stop 2024-09-12T01:43:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.331+0000 7fca700e4640 1 -- 172.21.15.60:0/2681419525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca680b68f0 msgr2=0x7fca681e9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.331+0000 7fca700e4640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca680b68f0 0x7fca681e9d20 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fca6402a140 tx=0x7fca640046c0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.331+0000 7fca700e4640 1 -- 172.21.15.60:0/2681419525 shutdown_connections 2024-09-12T01:43:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.331+0000 7fca700e4640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fca4c06be30 0x7fca4c06e2f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.331+0000 7fca700e4640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca6815e7a0 0x7fca6815f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.331+0000 7fca700e4640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca680cf1f0 0x7fca680cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.331+0000 7fca700e4640 1 --2- 172.21.15.60:0/2681419525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca680b68f0 0x7fca681e9d20 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.332+0000 7fca700e4640 1 -- 172.21.15.60:0/2681419525 >> 172.21.15.60:0/2681419525 conn(0x7fca680d11e0 msgr2=0x7fca6815d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.332+0000 7fca700e4640 1 -- 172.21.15.60:0/2681419525 shutdown_connections 2024-09-12T01:43:37.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.332+0000 7fca700e4640 1 -- 172.21.15.60:0/2681419525 wait complete. 2024-09-12T01:43:37.342 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:43:37.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:37.342 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T01:43:37.374 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:43:37.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:43:37.374 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:43:37.430 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:43:37.431 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:43:37.431 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:37.447 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:43:37.447 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:43:37.447 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:43:37.447 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:37.487 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:43:37.487 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:43:37.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.589+0000 7feccc5af640 1 Processor -- start 2024-09-12T01:43:37.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.589+0000 7feccc5af640 1 -- start start 2024-09-12T01:43:37.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.590+0000 7feccc5af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecc40d3310 0x7fecc40d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.590+0000 7feccc5af640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fecc40d1650 0x7fecc40b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.590+0000 7feccc5af640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc415ea40 con 0x7fecc415e660 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.590+0000 7feccc5af640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fecc40d1ac0 con 0x7fecc40d1650 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.590+0000 7feccc5af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fecc40d3870 con 0x7fecc40d3310 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.591+0000 7feccab4c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fecc40d1650 0x7fecc40b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.591+0000 7feccab4c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fecc40d1650 0x7fecc40b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55720/0 (socket says 172.21.15.60:55720) 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.591+0000 7feccab4c640 1 -- 172.21.15.60:0/2556888355 learned_addr learned my addr 172.21.15.60:0/2556888355 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.591+0000 7fecc9b4a640 1 --2- 172.21.15.60:0/2556888355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecc40d3310 0x7fecc40d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.591+0000 7feccab4c640 1 -- 172.21.15.60:0/2556888355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecc40d3310 msgr2=0x7fecc40d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.591+0000 7feccab4c640 1 --2- 172.21.15.60:0/2556888355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecc40d3310 0x7fecc40d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.591+0000 7feccab4c640 1 -- 172.21.15.60:0/2556888355 >> v1:172.21.15.105:6789/0 conn(0x7fecc415e660 legacy=0x7fecc40cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.591+0000 7feccab4c640 1 -- 172.21.15.60:0/2556888355 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc40d3b50 con 0x7fecc40d1650 2024-09-12T01:43:37.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.591+0000 7fecc9b4a640 1 --2- 172.21.15.60:0/2556888355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecc40d3310 0x7fecc40d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:37.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.592+0000 7feccab4c640 1 --2- 172.21.15.60:0/2556888355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecc40d1650 0x7fecc40b7b70 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009870 tx=0x7fecb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf2cde0d38b0af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:37.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.592+0000 7fecc9349640 1 -- 172.21.15.60:0/2556888355 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb4037070 con 0x7fecc40d1650 2024-09-12T01:43:37.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.592+0000 7fecc9349640 1 -- 172.21.15.60:0/2556888355 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb4032440 con 0x7fecc40d1650 2024-09-12T01:43:37.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.592+0000 7fecc9349640 1 -- 172.21.15.60:0/2556888355 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb4032810 con 0x7fecc40d1650 2024-09-12T01:43:37.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.592+0000 7feccc5af640 1 -- 172.21.15.60:0/2556888355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecc40d1650 msgr2=0x7fecc40b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.592+0000 7feccc5af640 1 --2- 172.21.15.60:0/2556888355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecc40d1650 0x7fecc40b7b70 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009870 tx=0x7fecb402a270 comp rx=0 tx=0).stop 2024-09-12T01:43:37.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.592+0000 7feccc5af640 1 -- 172.21.15.60:0/2556888355 shutdown_connections 2024-09-12T01:43:37.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.592+0000 7feccc5af640 1 --2- 172.21.15.60:0/2556888355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecc40d1650 0x7fecc40b7b70 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.592+0000 7feccc5af640 1 --2- 172.21.15.60:0/2556888355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecc40d3310 0x7fecc40d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.592+0000 7feccc5af640 1 -- 172.21.15.60:0/2556888355 >> 172.21.15.60:0/2556888355 conn(0x7fecc40b6410 msgr2=0x7fecc40b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:37.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.592+0000 7feccc5af640 1 -- 172.21.15.60:0/2556888355 shutdown_connections 2024-09-12T01:43:37.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.592+0000 7feccc5af640 1 -- 172.21.15.60:0/2556888355 wait complete. 2024-09-12T01:43:37.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.594+0000 7feccc5af640 1 Processor -- start 2024-09-12T01:43:37.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.594+0000 7feccc5af640 1 -- start start 2024-09-12T01:43:37.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.594+0000 7feccc5af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecc40d1650 0x7fecc4160c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.594+0000 7feccc5af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecc40d3310 0x7fecc41571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.594+0000 7feccc5af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecc415e660 0x7fecc4157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7feccc5af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fecc40d43f0 con 0x7fecc40d1650 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7feccc5af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fecc40d4110 con 0x7fecc40d3310 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7feccc5af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fecc40b80b0 con 0x7fecc415e660 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecca34b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecc40d1650 0x7fecc4160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecca34b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecc40d1650 0x7fecc4160c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55722/0 (socket says 172.21.15.60:55722) 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecca34b640 1 -- 172.21.15.60:0/3689439169 learned_addr learned my addr 172.21.15.60:0/3689439169 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7feccab4c640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecc415e660 0x7fecc4157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecc9b4a640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecc40d3310 0x7fecc41571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecca34b640 1 -- 172.21.15.60:0/3689439169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecc415e660 msgr2=0x7fecc4157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecca34b640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecc415e660 0x7fecc4157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecca34b640 1 -- 172.21.15.60:0/3689439169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecc40d3310 msgr2=0x7fecc41571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecca34b640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecc40d3310 0x7fecc41571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecca34b640 1 -- 172.21.15.60:0/3689439169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc415c760 con 0x7fecc40d1650 2024-09-12T01:43:37.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecc9b4a640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecc40d3310 0x7fecc41571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:37.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecca34b640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecc40d1650 0x7fecc4160c60 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00c730 tx=0x7fecbc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:37.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecc2ffd640 1 -- 172.21.15.60:0/3689439169 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc016020 con 0x7fecc40d1650 2024-09-12T01:43:37.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecc2ffd640 1 -- 172.21.15.60:0/3689439169 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecbc006d50 con 0x7fecc40d1650 2024-09-12T01:43:37.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7feccc5af640 1 -- 172.21.15.60:0/3689439169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc415ca40 con 0x7fecc40d1650 2024-09-12T01:43:37.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7fecc2ffd640 1 -- 172.21.15.60:0/3689439169 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc003bb0 con 0x7fecc40d1650 2024-09-12T01:43:37.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.595+0000 7feccc5af640 1 -- 172.21.15.60:0/3689439169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc415d000 con 0x7fecc40d1650 2024-09-12T01:43:37.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.596+0000 7feccc5af640 1 -- 172.21.15.60:0/3689439169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc40b7b70 con 0x7fecc40d1650 2024-09-12T01:43:37.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.597+0000 7fecc2ffd640 1 -- 172.21.15.60:0/3689439169 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fecbc00a850 con 0x7fecc40d1650 2024-09-12T01:43:37.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.597+0000 7fecc2ffd640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fecb006be30 0x7fecb006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.598+0000 7fecc9b4a640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fecb006be30 0x7fecb006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.598+0000 7fecc2ffd640 1 -- 172.21.15.60:0/3689439169 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7fecbc08a9b0 con 0x7fecc40d1650 2024-09-12T01:43:37.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.598+0000 7fecc9b4a640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fecb006be30 0x7fecb006e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fecc4160930 tx=0x7fecb8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:37.601 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.602+0000 7fecc2ffd640 1 -- 172.21.15.60:0/3689439169 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fecbc020020 con 0x7fecc40d1650 2024-09-12T01:43:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.812+0000 7feccc5af640 1 -- 172.21.15.60:0/3689439169 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecc415de80 con 0x7fecc40d1650 2024-09-12T01:43:37.811 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.812+0000 7fecc2ffd640 1 -- 172.21.15.60:0/3689439169 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5231 (secure 0 0 0) 0x7fecbc0593f0 con 0x7fecc40d1650 2024-09-12T01:43:37.812 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:37.812 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":71,"btime":"2024-09-12T01:43:30:416085+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2206957364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2206957364},{"type":"v1","addr":"172.21.15.105:6835","nonce":2206957364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7536,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3802062072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3802062072},{"type":"v1","addr":"172.21.15.60:6836","nonce":3802062072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3557949323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3557949323},{"type":"v1","addr":"172.21.15.60:6837","nonce":3557949323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:09.348346+0000","modified":"2024-09-12T01:43:30.025684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6834/3613656777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3613656777},{"type":"v1","addr":"172.21.15.105:6834","nonce":3613656777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":9}]} 2024-09-12T01:43:37.812 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 71 2024-09-12T01:43:37.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.814+0000 7feccc5af640 1 -- 172.21.15.60:0/3689439169 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fecb006be30 msgr2=0x7fecb006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.814+0000 7feccc5af640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fecb006be30 0x7fecb006e2f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fecc4160930 tx=0x7fecb8008040 comp rx=0 tx=0).stop 2024-09-12T01:43:37.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.814+0000 7feccc5af640 1 -- 172.21.15.60:0/3689439169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecc40d1650 msgr2=0x7fecc4160c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.814+0000 7feccc5af640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecc40d1650 0x7fecc4160c60 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00c730 tx=0x7fecbc00cbf0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.814+0000 7feccc5af640 1 -- 172.21.15.60:0/3689439169 shutdown_connections 2024-09-12T01:43:37.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.814+0000 7feccc5af640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fecb006be30 0x7fecb006e2f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.814+0000 7feccc5af640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fecc415e660 0x7fecc4157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.814+0000 7feccc5af640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fecc40d3310 0x7fecc41571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.814+0000 7feccc5af640 1 --2- 172.21.15.60:0/3689439169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fecc40d1650 0x7fecc4160c60 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.814+0000 7feccc5af640 1 -- 172.21.15.60:0/3689439169 >> 172.21.15.60:0/3689439169 conn(0x7fecc40b6410 msgr2=0x7fecc415a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.814+0000 7feccc5af640 1 -- 172.21.15.60:0/3689439169 shutdown_connections 2024-09-12T01:43:37.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.814+0000 7feccc5af640 1 -- 172.21.15.60:0/3689439169 wait complete. 2024-09-12T01:43:37.825 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:43:37.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.928+0000 7fca7cfd6640 1 Processor -- start 2024-09-12T01:43:37.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.928+0000 7fca7cfd6640 1 -- start start 2024-09-12T01:43:37.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.929+0000 7fca7cfd6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca780cf6b0 0x7fca781629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.929+0000 7fca7cfd6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fca78162f30 0x7fca780b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.929+0000 7fca7cfd6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca780cfc20 con 0x7fca780b63d0 2024-09-12T01:43:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.929+0000 7fca7cfd6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fca780d40c0 con 0x7fca780cf6b0 2024-09-12T01:43:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.929+0000 7fca7cfd6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fca780d2ed0 con 0x7fca78162f30 2024-09-12T01:43:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.929+0000 7fca75d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca780cf6b0 0x7fca781629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.929+0000 7fca75d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fca780cf6b0 0x7fca781629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55730/0 (socket says 172.21.15.60:55730) 2024-09-12T01:43:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.929+0000 7fca75d9b640 1 -- 172.21.15.60:0/2677355175 learned_addr learned my addr 172.21.15.60:0/2677355175 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.930+0000 7fca76d9d640 1 --2- 172.21.15.60:0/2677355175 >> v2:172.21.15.105:3300/0 conn(0x7fca78162f30 0x7fca780b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.930+0000 7fca75d9b640 1 -- 172.21.15.60:0/2677355175 >> v2:172.21.15.105:3300/0 conn(0x7fca78162f30 msgr2=0x7fca780b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.930+0000 7fca75d9b640 1 --2- 172.21.15.60:0/2677355175 >> v2:172.21.15.105:3300/0 conn(0x7fca78162f30 0x7fca780b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.930 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.930+0000 7fca75d9b640 1 -- 172.21.15.60:0/2677355175 >> v1:172.21.15.105:6789/0 conn(0x7fca780b63d0 legacy=0x7fca780d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.930+0000 7fca75d9b640 1 -- 172.21.15.60:0/2677355175 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca780d31b0 con 0x7fca780cf6b0 2024-09-12T01:43:37.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.930+0000 7fca75d9b640 1 --2- 172.21.15.60:0/2677355175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca780cf6b0 0x7fca781629f0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fca780cfb50 tx=0x7fca6002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d2482647b5f056 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.931+0000 7fca7559a640 1 -- 172.21.15.60:0/2677355175 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60037070 con 0x7fca780cf6b0 2024-09-12T01:43:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.931+0000 7fca7559a640 1 -- 172.21.15.60:0/2677355175 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca60032440 con 0x7fca780cf6b0 2024-09-12T01:43:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.931+0000 7fca7559a640 1 -- 172.21.15.60:0/2677355175 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60032810 con 0x7fca780cf6b0 2024-09-12T01:43:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.931+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2677355175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca780cf6b0 msgr2=0x7fca781629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.931+0000 7fca7cfd6640 1 --2- 172.21.15.60:0/2677355175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca780cf6b0 0x7fca781629f0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fca780cfb50 tx=0x7fca6002a1a0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.931+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2677355175 shutdown_connections 2024-09-12T01:43:37.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.931+0000 7fca7cfd6640 1 --2- 172.21.15.60:0/2677355175 >> v2:172.21.15.105:3300/0 conn(0x7fca78162f30 0x7fca780b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.931+0000 7fca7cfd6640 1 --2- 172.21.15.60:0/2677355175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca780cf6b0 0x7fca781629f0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.931+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2677355175 >> 172.21.15.60:0/2677355175 conn(0x7fca780d1160 msgr2=0x7fca780d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.931+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2677355175 shutdown_connections 2024-09-12T01:43:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.931+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2677355175 wait complete. 2024-09-12T01:43:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.933+0000 7fca7cfd6640 1 Processor -- start 2024-09-12T01:43:37.933 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.933+0000 7fca7cfd6640 1 -- start start 2024-09-12T01:43:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.933+0000 7fca7cfd6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca780b63d0 0x7fca7815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.933+0000 7fca7cfd6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca780cf6b0 0x7fca780cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.933+0000 7fca7cfd6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca78162f30 0x7fca7815f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7cfd6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fca780cb5c0 con 0x7fca780b63d0 2024-09-12T01:43:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7cfd6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fca780cb440 con 0x7fca78162f30 2024-09-12T01:43:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7cfd6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fca780d1c80 con 0x7fca780cf6b0 2024-09-12T01:43:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca780b63d0 0x7fca7815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca780b63d0 0x7fca7815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55738/0 (socket says 172.21.15.60:55738) 2024-09-12T01:43:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7659c640 1 -- 172.21.15.60:0/2416357044 learned_addr learned my addr 172.21.15.60:0/2416357044 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca76d9d640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca78162f30 0x7fca7815f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca75d9b640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca780cf6b0 0x7fca780cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7659c640 1 -- 172.21.15.60:0/2416357044 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca780cf6b0 msgr2=0x7fca780cc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7659c640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca780cf6b0 0x7fca780cc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7659c640 1 -- 172.21.15.60:0/2416357044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca78162f30 msgr2=0x7fca7815f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7659c640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca78162f30 0x7fca7815f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7659c640 1 -- 172.21.15.60:0/2416357044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca780cd4c0 con 0x7fca780b63d0 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca76d9d640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca78162f30 0x7fca7815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7659c640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca780b63d0 0x7fca7815ec90 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fca7000c430 tx=0x7fca7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca6effd640 1 -- 172.21.15.60:0/2416357044 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70011790 con 0x7fca780b63d0 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca6effd640 1 -- 172.21.15.60:0/2416357044 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca70017070 con 0x7fca780b63d0 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca6effd640 1 -- 172.21.15.60:0/2416357044 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70011bb0 con 0x7fca780b63d0 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2416357044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca780cd7a0 con 0x7fca780b63d0 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.934+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2416357044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca780cdd60 con 0x7fca780b63d0 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.935+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2416357044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca780b67b0 con 0x7fca780b63d0 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.936+0000 7fca6effd640 1 -- 172.21.15.60:0/2416357044 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fca7001c460 con 0x7fca780b63d0 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.936+0000 7fca6effd640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fca5806be30 0x7fca5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:37.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.936+0000 7fca6effd640 1 -- 172.21.15.60:0/2416357044 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7fca7008ade0 con 0x7fca780b63d0 2024-09-12T01:43:37.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.936+0000 7fca75d9b640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fca5806be30 0x7fca5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:37.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.937+0000 7fca75d9b640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fca5806be30 0x7fca5806e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fca60034000 tx=0x7fca6002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:37.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:37.941+0000 7fca6effd640 1 -- 172.21.15.60:0/2416357044 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fca70059710 con 0x7fca780b63d0 2024-09-12T01:43:38.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.154+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2416357044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca780b6d00 con 0x7fca780b63d0 2024-09-12T01:43:38.154 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.155+0000 7fca6effd640 1 -- 172.21.15.60:0/2416357044 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5231 (secure 0 0 0) 0x7fca70059010 con 0x7fca780b63d0 2024-09-12T01:43:38.154 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:38.154 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":71,"btime":"2024-09-12T01:43:30:416085+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2206957364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2206957364},{"type":"v1","addr":"172.21.15.105:6835","nonce":2206957364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7536,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3802062072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3802062072},{"type":"v1","addr":"172.21.15.60:6836","nonce":3802062072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3557949323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3557949323},{"type":"v1","addr":"172.21.15.60:6837","nonce":3557949323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:09.348346+0000","modified":"2024-09-12T01:43:30.025684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6834/3613656777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3613656777},{"type":"v1","addr":"172.21.15.105:6834","nonce":3613656777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":9}]} 2024-09-12T01:43:38.155 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 71 2024-09-12T01:43:38.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.157+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2416357044 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fca5806be30 msgr2=0x7fca5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.157+0000 7fca7cfd6640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fca5806be30 0x7fca5806e2f0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fca60034000 tx=0x7fca6002e000 comp rx=0 tx=0).stop 2024-09-12T01:43:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.157+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2416357044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca780b63d0 msgr2=0x7fca7815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.157+0000 7fca7cfd6640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca780b63d0 0x7fca7815ec90 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fca7000c430 tx=0x7fca7000c8f0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.157+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2416357044 shutdown_connections 2024-09-12T01:43:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.157+0000 7fca7cfd6640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fca78162f30 0x7fca7815f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.157+0000 7fca7cfd6640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fca5806be30 0x7fca5806e2f0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.157+0000 7fca7cfd6640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fca780cf6b0 0x7fca780cc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.157+0000 7fca7cfd6640 1 --2- 172.21.15.60:0/2416357044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fca780b63d0 0x7fca7815ec90 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.157+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2416357044 >> 172.21.15.60:0/2416357044 conn(0x7fca780d1160 msgr2=0x7fca781617b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.157+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2416357044 shutdown_connections 2024-09-12T01:43:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.157+0000 7fca7cfd6640 1 -- 172.21.15.60:0/2416357044 wait complete. 2024-09-12T01:43:38.168 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:43:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.270+0000 7f128b378640 1 Processor -- start 2024-09-12T01:43:38.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.271+0000 7f128b378640 1 -- start start 2024-09-12T01:43:38.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.271+0000 7f128b378640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f128415e660 0x7f12840cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.271+0000 7f128b378640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12840d3310 0x7f12840d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.271+0000 7f128b378640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128415ea40 con 0x7f12840d1650 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.271+0000 7f128b378640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f12840d1ac0 con 0x7f128415e660 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.271+0000 7f128b378640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f12840d3870 con 0x7f12840d3310 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.272+0000 7f1289114640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f128415e660 0x7f12840cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.272+0000 7f1289114640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f128415e660 0x7f12840cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55754/0 (socket says 172.21.15.60:55754) 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.272+0000 7f1289114640 1 -- 172.21.15.60:0/3243553977 learned_addr learned my addr 172.21.15.60:0/3243553977 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.272+0000 7f1289915640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f12840d1650 0x7f128406bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56032/0 (socket says 172.21.15.60:56032) 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.272+0000 7f1288913640 1 --2- 172.21.15.60:0/3243553977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12840d3310 0x7f12840d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.272+0000 7f1289114640 1 -- 172.21.15.60:0/3243553977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12840d3310 msgr2=0x7f12840d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.272+0000 7f1289114640 1 --2- 172.21.15.60:0/3243553977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12840d3310 0x7f12840d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.272+0000 7f1289114640 1 -- 172.21.15.60:0/3243553977 >> v1:172.21.15.60:6789/0 conn(0x7f12840d1650 legacy=0x7f128406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.272+0000 7f1289114640 1 -- 172.21.15.60:0/3243553977 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12840d3b50 con 0x7f128415e660 2024-09-12T01:43:38.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.273+0000 7f1289114640 1 --2- 172.21.15.60:0/3243553977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f128415e660 0x7f12840cf730 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f1280009870 tx=0x7f128002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d3ef03b6943861 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:38.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.273+0000 7f127bfff640 1 -- 172.21.15.60:0/3243553977 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280037070 con 0x7f128415e660 2024-09-12T01:43:38.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.273+0000 7f127bfff640 1 -- 172.21.15.60:0/3243553977 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1280032440 con 0x7f128415e660 2024-09-12T01:43:38.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.273+0000 7f127bfff640 1 -- 172.21.15.60:0/3243553977 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280032810 con 0x7f128415e660 2024-09-12T01:43:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.273+0000 7f128b378640 1 -- 172.21.15.60:0/3243553977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f128415e660 msgr2=0x7f12840cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.273+0000 7f128b378640 1 --2- 172.21.15.60:0/3243553977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f128415e660 0x7f12840cf730 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f1280009870 tx=0x7f128002a270 comp rx=0 tx=0).stop 2024-09-12T01:43:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.273+0000 7f128b378640 1 -- 172.21.15.60:0/3243553977 shutdown_connections 2024-09-12T01:43:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.273+0000 7f128b378640 1 --2- 172.21.15.60:0/3243553977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12840d3310 0x7f12840d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.273+0000 7f128b378640 1 --2- 172.21.15.60:0/3243553977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f128415e660 0x7f12840cf730 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.273+0000 7f128b378640 1 -- 172.21.15.60:0/3243553977 >> 172.21.15.60:0/3243553977 conn(0x7f12840b6410 msgr2=0x7f12840b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.274+0000 7f128b378640 1 -- 172.21.15.60:0/3243553977 shutdown_connections 2024-09-12T01:43:38.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.274+0000 7f128b378640 1 -- 172.21.15.60:0/3243553977 wait complete. 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.275+0000 7f128b378640 1 Processor -- start 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.275+0000 7f128b378640 1 -- start start 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.275+0000 7f128b378640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12840d1650 0x7f12840ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.275+0000 7f128b378640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12840d3310 0x7f1284155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.275+0000 7f128b378640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f128415e660 0x7f1284152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f128b378640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f12840d43f0 con 0x7f12840d1650 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f128b378640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f12840d4110 con 0x7f128415e660 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f128b378640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f12840cfc70 con 0x7f12840d3310 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1289114640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12840d1650 0x7f12840ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1289114640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12840d1650 0x7f12840ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55756/0 (socket says 172.21.15.60:55756) 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1289114640 1 -- 172.21.15.60:0/3395709450 learned_addr learned my addr 172.21.15.60:0/3395709450 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1289915640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f128415e660 0x7f1284152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1288913640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12840d3310 0x7f1284155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1289114640 1 -- 172.21.15.60:0/3395709450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12840d3310 msgr2=0x7f1284155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1289114640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12840d3310 0x7f1284155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1289114640 1 -- 172.21.15.60:0/3395709450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f128415e660 msgr2=0x7f1284152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1289114640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f128415e660 0x7f1284152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1289114640 1 -- 172.21.15.60:0/3395709450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12840ca9d0 con 0x7f12840d1650 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1289114640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12840d1650 0x7f12840ca490 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f1280000c00 tx=0x7f12800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1279ffb640 1 -- 172.21.15.60:0/3395709450 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280037040 con 0x7f12840d1650 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1279ffb640 1 -- 172.21.15.60:0/3395709450 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1280042070 con 0x7f12840d1650 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f128b378640 1 -- 172.21.15.60:0/3395709450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1284157f10 con 0x7f12840d1650 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.276+0000 7f1279ffb640 1 -- 172.21.15.60:0/3395709450 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280030bb0 con 0x7f12840d1650 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.277+0000 7f128b378640 1 -- 172.21.15.60:0/3395709450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12841584d0 con 0x7f12840d1650 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.277+0000 7f128b378640 1 -- 172.21.15.60:0/3395709450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12840d1110 con 0x7f12840d1650 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.278+0000 7f1279ffb640 1 -- 172.21.15.60:0/3395709450 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1280047460 con 0x7f12840d1650 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.278+0000 7f1279ffb640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f126806be30 0x7f126806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.279+0000 7f1279ffb640 1 -- 172.21.15.60:0/3395709450 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f12800abaf0 con 0x7f12840d1650 2024-09-12T01:43:38.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.279+0000 7f1288913640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f126806be30 0x7f126806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.279+0000 7f1288913640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f126806be30 0x7f126806e2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1284151b50 tx=0x7f1274008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:38.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.283+0000 7f1279ffb640 1 -- 172.21.15.60:0/3395709450 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f12840ca9d0 con 0x7f12840d1650 2024-09-12T01:43:38.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.460+0000 7f128b378640 1 -- 172.21.15.60:0/3395709450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f128415b0c0 con 0x7f12840d1650 2024-09-12T01:43:38.461 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.461+0000 7f1279ffb640 1 -- 172.21.15.60:0/3395709450 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16651 (secure 0 0 0) 0x7f128007a4a0 con 0x7f12840d1650 2024-09-12T01:43:38.461 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:38.462 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":117,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:43:10.992951+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:43:07.315366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-12T01:43:08.333340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:43:38.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.463+0000 7f128b378640 1 -- 172.21.15.60:0/3395709450 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f126806be30 msgr2=0x7f126806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.463+0000 7f128b378640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f126806be30 0x7f126806e2f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f1284151b50 tx=0x7f1274008040 comp rx=0 tx=0).stop 2024-09-12T01:43:38.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.463+0000 7f128b378640 1 -- 172.21.15.60:0/3395709450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12840d1650 msgr2=0x7f12840ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.464 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.463+0000 7f128b378640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12840d1650 0x7f12840ca490 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f1280000c00 tx=0x7f12800046c0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.463+0000 7f128b378640 1 -- 172.21.15.60:0/3395709450 shutdown_connections 2024-09-12T01:43:38.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.463+0000 7f128b378640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f128415e660 0x7f1284152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.463+0000 7f128b378640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f126806be30 0x7f126806e2f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.463+0000 7f128b378640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12840d3310 0x7f1284155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.463+0000 7f128b378640 1 --2- 172.21.15.60:0/3395709450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12840d1650 0x7f12840ca490 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.463+0000 7f128b378640 1 -- 172.21.15.60:0/3395709450 >> 172.21.15.60:0/3395709450 conn(0x7f12840b6410 msgr2=0x7f12840b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:38.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.463+0000 7f128b378640 1 -- 172.21.15.60:0/3395709450 shutdown_connections 2024-09-12T01:43:38.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.464+0000 7f128b378640 1 -- 172.21.15.60:0/3395709450 wait complete. 2024-09-12T01:43:38.474 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:43:38.474 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:43:38.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.578+0000 7f7b6c5c0640 1 Processor -- start 2024-09-12T01:43:38.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.578+0000 7f7b6c5c0640 1 -- start start 2024-09-12T01:43:38.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6c5c0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7b640ba240 0x7f7b640d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6c5c0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b640d2f40 con 0x7f7b640cf2f0 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6c5c0640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b640d3220 con 0x7f7b6415e7a0 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6c5c0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7b640ba690 con 0x7f7b640ba240 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6ab5d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7b640cf2f0 0x7f7b640b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56046/0 (socket says 172.21.15.60:56046) 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6ab5d640 1 -- 172.21.15.60:0/820717795 learned_addr learned my addr 172.21.15.60:0/820717795 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b69b5b640 1 --2- 172.21.15.60:0/820717795 >> v2:172.21.15.105:3300/0 conn(0x7f7b640ba240 0x7f7b640d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226023031 0 0) 0x7f7b640d2f40 con 0x7f7b640cf2f0 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b50003520 con 0x7f7b640cf2f0 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2865619368 0 0) 0x7f7b50003520 con 0x7f7b640cf2f0 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 >> v2:172.21.15.105:3300/0 conn(0x7f7b640ba240 msgr2=0x7f7b640d3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6935a640 1 --2- 172.21.15.60:0/820717795 >> v2:172.21.15.105:3300/0 conn(0x7f7b640ba240 0x7f7b640d3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 >> v1:172.21.15.105:6789/0 conn(0x7f7b6415e7a0 legacy=0x7f7b640d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b640d3500 con 0x7f7b640cf2f0 2024-09-12T01:43:38.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.579+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f7b5c0019f0 con 0x7f7b640cf2f0 2024-09-12T01:43:38.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 >> v1:172.21.15.60:6789/0 conn(0x7f7b640cf2f0 legacy=0x7f7b640b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6935a640 1 --2- 172.21.15.60:0/820717795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b500039b0 0x7f7b50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6935a640 1 --2- 172.21.15.60:0/820717795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b50004800 0x7f7b50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6935a640 1 --2- 172.21.15.60:0/820717795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b500051c0 0x7f7b5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7b640ba690 con 0x7f7b500051c0 2024-09-12T01:43:38.582 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5000c070 con 0x7f7b500039b0 2024-09-12T01:43:38.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7b5000c270 con 0x7f7b50004800 2024-09-12T01:43:38.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6ab5d640 1 --2- 172.21.15.60:0/820717795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b500051c0 0x7f7b5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6a35c640 1 --2- 172.21.15.60:0/820717795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b500039b0 0x7f7b50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b69b5b640 1 --2- 172.21.15.60:0/820717795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b50004800 0x7f7b50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6ab5d640 1 -- 172.21.15.60:0/820717795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b50004800 msgr2=0x7f7b50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:38.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6ab5d640 1 --2- 172.21.15.60:0/820717795 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b50004800 0x7f7b50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6ab5d640 1 -- 172.21.15.60:0/820717795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b500039b0 msgr2=0x7f7b50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:38.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6ab5d640 1 --2- 172.21.15.60:0/820717795 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b500039b0 0x7f7b50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.580+0000 7f7b6ab5d640 1 -- 172.21.15.60:0/820717795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b50003520 con 0x7f7b500051c0 2024-09-12T01:43:38.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.581+0000 7f7b6ab5d640 1 -- 172.21.15.60:0/820717795 reap_dead start 2024-09-12T01:43:38.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.581+0000 7f7b6ab5d640 1 --2- 172.21.15.60:0/820717795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b500051c0 0x7f7b5000b9c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00a850 tx=0x7f7b50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95da6dd397595ee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:38.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.581+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c00a4a0 con 0x7f7b500051c0 2024-09-12T01:43:38.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.581+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b5c02f070 con 0x7f7b500051c0 2024-09-12T01:43:38.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.581+0000 7f7b6935a640 1 -- 172.21.15.60:0/820717795 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c02bce0 con 0x7f7b500051c0 2024-09-12T01:43:38.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.581+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/820717795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b500051c0 msgr2=0x7f7b5000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.581+0000 7f7b6c5c0640 1 --2- 172.21.15.60:0/820717795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b500051c0 0x7f7b5000b9c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00a850 tx=0x7f7b50005830 comp rx=0 tx=0).stop 2024-09-12T01:43:38.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.582+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/820717795 shutdown_connections 2024-09-12T01:43:38.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.582+0000 7f7b6c5c0640 1 --2- 172.21.15.60:0/820717795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b500051c0 0x7f7b5000b9c0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.582+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/820717795 >> 172.21.15.60:0/820717795 conn(0x7f7b640d1550 msgr2=0x7f7b640d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:38.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.582+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/820717795 shutdown_connections 2024-09-12T01:43:38.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.582+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/820717795 wait complete. 2024-09-12T01:43:38.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.583+0000 7f7b6c5c0640 1 Processor -- start 2024-09-12T01:43:38.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.583+0000 7f7b6c5c0640 1 -- start start 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b6c5c0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b500051c0 0x7f7b64157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b6c5c0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b64160eb0 0x7f7b6406c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b6c5c0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b64161330 0x7f7b6406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b6c5c0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6415eb80 con 0x7f7b64160eb0 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b6c5c0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7b640d3ac0 con 0x7f7b64161330 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b6c5c0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7b6415ed00 con 0x7f7b500051c0 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b69b5b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b64160eb0 0x7f7b6406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b69b5b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b64160eb0 0x7f7b6406c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55774/0 (socket says 172.21.15.60:55774) 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b69b5b640 1 -- 172.21.15.60:0/2933718237 learned_addr learned my addr 172.21.15.60:0/2933718237 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b6ab5d640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b64161330 0x7f7b6406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b6a35c640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b500051c0 0x7f7b64157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b69b5b640 1 -- 172.21.15.60:0/2933718237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b500051c0 msgr2=0x7f7b64157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b69b5b640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b500051c0 0x7f7b64157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b69b5b640 1 -- 172.21.15.60:0/2933718237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b64161330 msgr2=0x7f7b6406c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b69b5b640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b64161330 0x7f7b6406c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b69b5b640 1 -- 172.21.15.60:0/2933718237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b64157f90 con 0x7f7b64160eb0 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b6ab5d640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b64161330 0x7f7b6406c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b6a35c640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b500051c0 0x7f7b64157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b69b5b640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b64160eb0 0x7f7b6406c400 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f7b54011910 tx=0x7f7b54011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b5affd640 1 -- 172.21.15.60:0/2933718237 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400faf0 con 0x7f7b64160eb0 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b5affd640 1 -- 172.21.15.60:0/2933718237 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b5400fc90 con 0x7f7b64160eb0 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/2933718237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b641618a0 con 0x7f7b64160eb0 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b5affd640 1 -- 172.21.15.60:0/2933718237 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54014440 con 0x7f7b64160eb0 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.584+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/2933718237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b641f5c70 con 0x7f7b64160eb0 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.585+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/2933718237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b640ced50 con 0x7f7b64160eb0 2024-09-12T01:43:38.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.586+0000 7f7b5affd640 1 -- 172.21.15.60:0/2933718237 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7b54012040 con 0x7f7b64160eb0 2024-09-12T01:43:38.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.586+0000 7f7b5affd640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7b4806be30 0x7f7b4806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.586+0000 7f7b5affd640 1 -- 172.21.15.60:0/2933718237 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f7b5408b540 con 0x7f7b64160eb0 2024-09-12T01:43:38.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.586+0000 7f7b6a35c640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7b4806be30 0x7f7b4806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.587+0000 7f7b6a35c640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7b4806be30 0x7f7b4806e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7b60000c00 tx=0x7f7b60009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:38.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.590+0000 7f7b5affd640 1 -- 172.21.15.60:0/2933718237 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7b640ced50 con 0x7f7b64160eb0 2024-09-12T01:43:38.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.799+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/2933718237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b6415c920 con 0x7f7b64160eb0 2024-09-12T01:43:38.798 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.799+0000 7f7b5affd640 1 -- 172.21.15.60:0/2933718237 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5231 (secure 0 0 0) 0x7f7b54019030 con 0x7f7b64160eb0 2024-09-12T01:43:38.799 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:38.799 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":71,"btime":"2024-09-12T01:43:30:416085+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2206957364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2206957364},{"type":"v1","addr":"172.21.15.105:6835","nonce":2206957364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7536,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3802062072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3802062072},{"type":"v1","addr":"172.21.15.60:6836","nonce":3802062072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3557949323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3557949323},{"type":"v1","addr":"172.21.15.60:6837","nonce":3557949323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:09.348346+0000","modified":"2024-09-12T01:43:30.025684+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6834/3613656777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3613656777},{"type":"v1","addr":"172.21.15.105:6834","nonce":3613656777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":9}]} 2024-09-12T01:43:38.799 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 71 2024-09-12T01:43:38.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.801+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/2933718237 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7b4806be30 msgr2=0x7f7b4806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.801+0000 7f7b6c5c0640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7b4806be30 0x7f7b4806e2f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7b60000c00 tx=0x7f7b60009040 comp rx=0 tx=0).stop 2024-09-12T01:43:38.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.801+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/2933718237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b64160eb0 msgr2=0x7f7b6406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.801+0000 7f7b6c5c0640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b64160eb0 0x7f7b6406c400 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f7b54011910 tx=0x7f7b54011dd0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.801+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/2933718237 shutdown_connections 2024-09-12T01:43:38.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.801+0000 7f7b6c5c0640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b64161330 0x7f7b6406c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.801+0000 7f7b6c5c0640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b64160eb0 0x7f7b6406c400 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.801+0000 7f7b6c5c0640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7b4806be30 0x7f7b4806e2f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.801+0000 7f7b6c5c0640 1 --2- 172.21.15.60:0/2933718237 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b500051c0 0x7f7b64157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.801+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/2933718237 >> 172.21.15.60:0/2933718237 conn(0x7f7b640d1550 msgr2=0x7f7b64074d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:38.801 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.801+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/2933718237 shutdown_connections 2024-09-12T01:43:38.802 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.801+0000 7f7b6c5c0640 1 -- 172.21.15.60:0/2933718237 wait complete. 2024-09-12T01:43:38.812 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:43:38.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.915+0000 7f8733518640 1 Processor -- start 2024-09-12T01:43:38.914 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.915+0000 7f8733518640 1 -- start start 2024-09-12T01:43:38.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8733518640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f872c0cf6b0 0x7f872c1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8733518640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f872c162f30 0x7f872c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8733518640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f872c0cfc20 con 0x7f872c0b63d0 2024-09-12T01:43:38.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8733518640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f872c0d40c0 con 0x7f872c0cf6b0 2024-09-12T01:43:38.918 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8733518640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f872c0d2ed0 con 0x7f872c162f30 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f87312b4640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f872c0b63d0 0x7f872c0d39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56050/0 (socket says 172.21.15.60:56050) 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f87312b4640 1 -- 172.21.15.60:0/2011519182 learned_addr learned my addr 172.21.15.60:0/2011519182 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8730ab3640 1 --2- 172.21.15.60:0/2011519182 >> v2:172.21.15.105:3300/0 conn(0x7f872c0cf6b0 0x7f872c1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8731ab5640 1 --2- 172.21.15.60:0/2011519182 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f872c162f30 0x7f872c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1016814018 0 0) 0x7f872c0cfc20 con 0x7f872c0b63d0 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8718003520 con 0x7f872c0b63d0 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2221233619 0 0) 0x7f8718003520 con 0x7f872c0b63d0 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f872c162f30 msgr2=0x7f872c0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 --2- 172.21.15.60:0/2011519182 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f872c162f30 0x7f872c0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 >> v2:172.21.15.105:3300/0 conn(0x7f872c0cf6b0 msgr2=0x7f872c1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 --2- 172.21.15.60:0/2011519182 >> v2:172.21.15.105:3300/0 conn(0x7f872c0cf6b0 0x7f872c1629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872c0d31b0 con 0x7f872c0b63d0 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f8728001670 con 0x7f872c0b63d0 2024-09-12T01:43:38.919 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 >> v1:172.21.15.60:6789/0 conn(0x7f872c0b63d0 legacy=0x7f872c0d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 --2- 172.21.15.60:0/2011519182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87180039b0 0x7f8718003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 --2- 172.21.15.60:0/2011519182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8718004800 0x7f8718004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 --2- 172.21.15.60:0/2011519182 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f872c162f30 0x7f87180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f872c0d40c0 con 0x7f87180039b0 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f872c0d2ed0 con 0x7f8718004800 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.916+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f871800b9c0 con 0x7f872c162f30 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.917+0000 7f87312b4640 1 --2- 172.21.15.60:0/2011519182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87180039b0 0x7f8718003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.917+0000 7f8730ab3640 1 --2- 172.21.15.60:0/2011519182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8718004800 0x7f8718004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.917+0000 7f8731ab5640 1 --2- 172.21.15.60:0/2011519182 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f872c162f30 0x7f87180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.917+0000 7f87312b4640 1 -- 172.21.15.60:0/2011519182 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f872c162f30 msgr2=0x7f87180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.917+0000 7f87312b4640 1 --2- 172.21.15.60:0/2011519182 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f872c162f30 0x7f87180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.917+0000 7f87312b4640 1 -- 172.21.15.60:0/2011519182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8718004800 msgr2=0x7f8718004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:38.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.917+0000 7f87312b4640 1 --2- 172.21.15.60:0/2011519182 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8718004800 0x7f8718004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.917+0000 7f87312b4640 1 -- 172.21.15.60:0/2011519182 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8718003520 con 0x7f87180039b0 2024-09-12T01:43:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.918+0000 7f87312b4640 1 --2- 172.21.15.60:0/2011519182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87180039b0 0x7f8718003dd0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f872800c210 tx=0x7f8718005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3ddee05cf3660 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.918+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728007d50 con 0x7f87180039b0 2024-09-12T01:43:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.918+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8728005af0 con 0x7f87180039b0 2024-09-12T01:43:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.918+0000 7f8723fff640 1 -- 172.21.15.60:0/2011519182 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728007070 con 0x7f87180039b0 2024-09-12T01:43:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.918+0000 7f8733518640 1 -- 172.21.15.60:0/2011519182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87180039b0 msgr2=0x7f8718003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.918+0000 7f8733518640 1 --2- 172.21.15.60:0/2011519182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87180039b0 0x7f8718003dd0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f872800c210 tx=0x7f8718005830 comp rx=0 tx=0).stop 2024-09-12T01:43:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.918+0000 7f8731ab5640 1 -- 172.21.15.60:0/2011519182 reap_dead start 2024-09-12T01:43:38.921 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.918+0000 7f8733518640 1 -- 172.21.15.60:0/2011519182 shutdown_connections 2024-09-12T01:43:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.918+0000 7f8733518640 1 -- 172.21.15.60:0/2011519182 >> 172.21.15.60:0/2011519182 conn(0x7f872c0d1160 msgr2=0x7f872c0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.918+0000 7f8733518640 1 -- 172.21.15.60:0/2011519182 shutdown_connections 2024-09-12T01:43:38.922 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.918+0000 7f8733518640 1 -- 172.21.15.60:0/2011519182 wait complete. 2024-09-12T01:43:38.924 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.920+0000 7f8733518640 1 Processor -- start 2024-09-12T01:43:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.920+0000 7f8733518640 1 -- start start 2024-09-12T01:43:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.920+0000 7f8733518640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87180039b0 0x7f872c159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.920+0000 7f8733518640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f872c1e9990 0x7f872c1e8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.920+0000 7f8733518640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f872c162050 0x7f872c162500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.920+0000 7f8733518640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f872c0cb5c0 con 0x7f872c162050 2024-09-12T01:43:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8733518640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f872c0cb440 con 0x7f872c1e9990 2024-09-12T01:43:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8733518640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f872c0d1c80 con 0x7f87180039b0 2024-09-12T01:43:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8731ab5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f872c162050 0x7f872c162500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8731ab5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f872c162050 0x7f872c162500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55802/0 (socket says 172.21.15.60:55802) 2024-09-12T01:43:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8731ab5640 1 -- 172.21.15.60:0/654856109 learned_addr learned my addr 172.21.15.60:0/654856109 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f87312b4640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87180039b0 0x7f872c159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8730ab3640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f872c1e9990 0x7f872c1e8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8731ab5640 1 -- 172.21.15.60:0/654856109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87180039b0 msgr2=0x7f872c159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8731ab5640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87180039b0 0x7f872c159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8731ab5640 1 -- 172.21.15.60:0/654856109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f872c1e9990 msgr2=0x7f872c1e8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8731ab5640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f872c1e9990 0x7f872c1e8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8731ab5640 1 -- 172.21.15.60:0/654856109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872c1eaf30 con 0x7f872c162050 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8731ab5640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f872c162050 0x7f872c162500 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f8724011c80 tx=0x7f872400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8721ffb640 1 -- 172.21.15.60:0/654856109 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724015430 con 0x7f872c162050 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8721ffb640 1 -- 172.21.15.60:0/654856109 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f872401d070 con 0x7f872c162050 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8733518640 1 -- 172.21.15.60:0/654856109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f872c1e9e90 con 0x7f872c162050 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8721ffb640 1 -- 172.21.15.60:0/654856109 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724015830 con 0x7f872c162050 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.921+0000 7f8733518640 1 -- 172.21.15.60:0/654856109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f872c1ea450 con 0x7f872c162050 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.923+0000 7f8733518640 1 -- 172.21.15.60:0/654856109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f872c0b67b0 con 0x7f872c162050 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.923+0000 7f8721ffb640 1 -- 172.21.15.60:0/654856109 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f87240159d0 con 0x7f872c162050 2024-09-12T01:43:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.923+0000 7f8721ffb640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f871006be60 0x7f871006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:38.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.924+0000 7f8721ffb640 1 -- 172.21.15.60:0/654856109 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f872408b7b0 con 0x7f872c162050 2024-09-12T01:43:38.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.924+0000 7f87312b4640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f871006be60 0x7f871006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:38.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.924+0000 7f87312b4640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f871006be60 0x7f871006e320 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8728033000 tx=0x7f8728009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:38.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:38.928+0000 7f8721ffb640 1 -- 172.21.15.60:0/654856109 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8724010040 con 0x7f872c162050 2024-09-12T01:43:39.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.138+0000 7f8733518640 1 -- 172.21.15.60:0/654856109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f872c0cf280 con 0x7f872c162050 2024-09-12T01:43:39.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.139+0000 7f8721ffb640 1 -- 172.21.15.60:0/654856109 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5232 (secure 0 0 0) 0x7f872405a0d0 con 0x7f872c162050 2024-09-12T01:43:39.138 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:39.139 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":72,"btime":"2024-09-12T01:43:38:814702+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2206957364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2206957364},{"type":"v1","addr":"172.21.15.105:6835","nonce":2206957364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7536,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3802062072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3802062072},{"type":"v1","addr":"172.21.15.60:6836","nonce":3802062072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3557949323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3557949323},{"type":"v1","addr":"172.21.15.60:6837","nonce":3557949323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:09.348346+0000","modified":"2024-09-12T01:43:38.027923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"d","rank":0,"incarnation":67,"state":"up:active","state_seq":10,"addr":"172.21.15.105:6834/3613656777","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3613656777},{"type":"v1","addr":"172.21.15.105:6834","nonce":3613656777}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":9}]} 2024-09-12T01:43:39.139 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 72 2024-09-12T01:43:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.141+0000 7f8733518640 1 -- 172.21.15.60:0/654856109 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f871006be60 msgr2=0x7f871006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.141+0000 7f8733518640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f871006be60 0x7f871006e320 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8728033000 tx=0x7f8728009030 comp rx=0 tx=0).stop 2024-09-12T01:43:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.141+0000 7f8733518640 1 -- 172.21.15.60:0/654856109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f872c162050 msgr2=0x7f872c162500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.141+0000 7f8733518640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f872c162050 0x7f872c162500 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f8724011c80 tx=0x7f872400f580 comp rx=0 tx=0).stop 2024-09-12T01:43:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.141+0000 7f8733518640 1 -- 172.21.15.60:0/654856109 shutdown_connections 2024-09-12T01:43:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.141+0000 7f8733518640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f872c162050 0x7f872c162500 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.141+0000 7f8733518640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f872c1e9990 0x7f872c1e8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.141+0000 7f8733518640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f871006be60 0x7f871006e320 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.141+0000 7f8733518640 1 --2- 172.21.15.60:0/654856109 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f87180039b0 0x7f872c159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.141+0000 7f8733518640 1 -- 172.21.15.60:0/654856109 >> 172.21.15.60:0/654856109 conn(0x7f872c0d1160 msgr2=0x7f872c0b78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:39.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.141+0000 7f8733518640 1 -- 172.21.15.60:0/654856109 shutdown_connections 2024-09-12T01:43:39.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.141+0000 7f8733518640 1 -- 172.21.15.60:0/654856109 wait complete. 2024-09-12T01:43:39.151 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:43:39.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.254+0000 7f9ac533b640 1 Processor -- start 2024-09-12T01:43:39.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.254+0000 7f9ac533b640 1 -- start start 2024-09-12T01:43:39.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9ac533b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ac00b63d0 0x7f9ac00d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9ac533b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9ac00cf6b0 0x7f9ac00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9ac533b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ac00cfc20 con 0x7f9ac00d1c80 2024-09-12T01:43:39.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9ac533b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac00d2ed0 con 0x7f9ac00b63d0 2024-09-12T01:43:39.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9ac533b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9ac00d31b0 con 0x7f9ac00cf6b0 2024-09-12T01:43:39.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9abeffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ac00b63d0 0x7f9ac00d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9abf7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9ac00d1c80 0x7f9ac00b7dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56056/0 (socket says 172.21.15.60:56056) 2024-09-12T01:43:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9abeffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ac00b63d0 0x7f9ac00d39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55818/0 (socket says 172.21.15.60:55818) 2024-09-12T01:43:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9abf7fe640 1 -- 172.21.15.60:0/4140678069 learned_addr learned my addr 172.21.15.60:0/4140678069 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9abe7fc640 1 --2- 172.21.15.60:0/4140678069 >> v2:172.21.15.105:3300/0 conn(0x7f9ac00cf6b0 0x7f9ac00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9abeffd640 1 -- 172.21.15.60:0/4140678069 >> v2:172.21.15.105:3300/0 conn(0x7f9ac00cf6b0 msgr2=0x7f9ac00b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9abeffd640 1 --2- 172.21.15.60:0/4140678069 >> v2:172.21.15.105:3300/0 conn(0x7f9ac00cf6b0 0x7f9ac00b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9abeffd640 1 -- 172.21.15.60:0/4140678069 >> v1:172.21.15.60:6789/0 conn(0x7f9ac00d1c80 legacy=0x7f9ac00b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9abdffb640 1 -- 172.21.15.60:0/4140678069 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1071986097 0 0) 0x7f9ac00cfc20 con 0x7f9ac00d1c80 2024-09-12T01:43:39.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.255+0000 7f9abeffd640 1 -- 172.21.15.60:0/4140678069 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac00d3490 con 0x7f9ac00b63d0 2024-09-12T01:43:39.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.256+0000 7f9abeffd640 1 --2- 172.21.15.60:0/4140678069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac00b63d0 0x7f9ac00d39b0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00b40e0 tx=0x7f9ab002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ce69037768e79f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:39.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.256+0000 7f9abdffb640 1 -- 172.21.15.60:0/4140678069 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0037070 con 0x7f9ac00b63d0 2024-09-12T01:43:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.256+0000 7f9abdffb640 1 -- 172.21.15.60:0/4140678069 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab0032440 con 0x7f9ac00b63d0 2024-09-12T01:43:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.256+0000 7f9abdffb640 1 -- 172.21.15.60:0/4140678069 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab002ae60 con 0x7f9ac00b63d0 2024-09-12T01:43:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.257+0000 7f9ac533b640 1 -- 172.21.15.60:0/4140678069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac00b63d0 msgr2=0x7f9ac00d39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.257+0000 7f9ac533b640 1 --2- 172.21.15.60:0/4140678069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac00b63d0 0x7f9ac00d39b0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00b40e0 tx=0x7f9ab002a110 comp rx=0 tx=0).stop 2024-09-12T01:43:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.257+0000 7f9ac533b640 1 -- 172.21.15.60:0/4140678069 shutdown_connections 2024-09-12T01:43:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.257+0000 7f9ac533b640 1 --2- 172.21.15.60:0/4140678069 >> v2:172.21.15.105:3300/0 conn(0x7f9ac00cf6b0 0x7f9ac00b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.257+0000 7f9ac533b640 1 --2- 172.21.15.60:0/4140678069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac00b63d0 0x7f9ac00d39b0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.257+0000 7f9ac533b640 1 -- 172.21.15.60:0/4140678069 >> 172.21.15.60:0/4140678069 conn(0x7f9ac00d1160 msgr2=0x7f9ac00d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.257+0000 7f9ac533b640 1 -- 172.21.15.60:0/4140678069 shutdown_connections 2024-09-12T01:43:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.257+0000 7f9ac533b640 1 -- 172.21.15.60:0/4140678069 wait complete. 2024-09-12T01:43:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.258+0000 7f9ac533b640 1 Processor -- start 2024-09-12T01:43:39.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.258+0000 7f9ac533b640 1 -- start start 2024-09-12T01:43:39.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9ac533b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ac00b63d0 0x7f9ac0160860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9ac533b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ac00cf6b0 0x7f9ac00cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9ac533b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac00d1c80 0x7f9ac00cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9ac533b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac00d4070 con 0x7f9ac00d1c80 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9ac533b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ac00d3ef0 con 0x7f9ac00cf6b0 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9ac533b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9ac00b67b0 con 0x7f9ac00b63d0 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9abf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac00d1c80 0x7f9ac00cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9abf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac00d1c80 0x7f9ac00cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55834/0 (socket says 172.21.15.60:55834) 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9abf7fe640 1 -- 172.21.15.60:0/2678959168 learned_addr learned my addr 172.21.15.60:0/2678959168 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9abeffd640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ac00b63d0 0x7f9ac0160860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9abe7fc640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ac00cf6b0 0x7f9ac00cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9abf7fe640 1 -- 172.21.15.60:0/2678959168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ac00b63d0 msgr2=0x7f9ac0160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9abf7fe640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ac00b63d0 0x7f9ac0160860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9abf7fe640 1 -- 172.21.15.60:0/2678959168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ac00cf6b0 msgr2=0x7f9ac00cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.259+0000 7f9abf7fe640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ac00cf6b0 0x7f9ac00cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.260+0000 7f9abf7fe640 1 -- 172.21.15.60:0/2678959168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ac00cc8e0 con 0x7f9ac00d1c80 2024-09-12T01:43:39.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.260+0000 7f9abf7fe640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac00d1c80 0x7f9ac00cc3a0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800c700 tx=0x7f9ab800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:39.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.260+0000 7f9aa77fe640 1 -- 172.21.15.60:0/2678959168 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8018070 con 0x7f9ac00d1c80 2024-09-12T01:43:39.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.260+0000 7f9aa77fe640 1 -- 172.21.15.60:0/2678959168 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab800ce10 con 0x7f9ac00d1c80 2024-09-12T01:43:39.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.260+0000 7f9ac533b640 1 -- 172.21.15.60:0/2678959168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ac00ccb70 con 0x7f9ac00d1c80 2024-09-12T01:43:39.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.260+0000 7f9aa77fe640 1 -- 172.21.15.60:0/2678959168 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800a860 con 0x7f9ac00d1c80 2024-09-12T01:43:39.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.260+0000 7f9ac533b640 1 -- 172.21.15.60:0/2678959168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ac00cd130 con 0x7f9ac00d1c80 2024-09-12T01:43:39.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.261+0000 7f9ac533b640 1 -- 172.21.15.60:0/2678959168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ac00d39b0 con 0x7f9ac00d1c80 2024-09-12T01:43:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.261+0000 7f9aa77fe640 1 -- 172.21.15.60:0/2678959168 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ab801b070 con 0x7f9ac00d1c80 2024-09-12T01:43:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.262+0000 7f9aa77fe640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9aac06be30 0x7f9aac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.262+0000 7f9aa77fe640 1 -- 172.21.15.60:0/2678959168 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f9ab808a3e0 con 0x7f9ac00d1c80 2024-09-12T01:43:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.262+0000 7f9abeffd640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9aac06be30 0x7f9aac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.262+0000 7f9abeffd640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9aac06be30 0x7f9aac06e2f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0034000 tx=0x7f9ab002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:39.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.266+0000 7f9aa77fe640 1 -- 172.21.15.60:0/2678959168 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ab8058d90 con 0x7f9ac00d1c80 2024-09-12T01:43:39.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.442+0000 7f9ac533b640 1 -- 172.21.15.60:0/2678959168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ac00cf280 con 0x7f9ac00d1c80 2024-09-12T01:43:39.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.443+0000 7f9aa77fe640 1 -- 172.21.15.60:0/2678959168 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16651 (secure 0 0 0) 0x7f9ab8058690 con 0x7f9ac00d1c80 2024-09-12T01:43:39.443 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:39.443 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":117,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:43:10.992951+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:43:07.315366+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-12T01:43:08.333340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:43:39.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.445+0000 7f9ac533b640 1 -- 172.21.15.60:0/2678959168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9aac06be30 msgr2=0x7f9aac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.445+0000 7f9ac533b640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9aac06be30 0x7f9aac06e2f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0034000 tx=0x7f9ab002e000 comp rx=0 tx=0).stop 2024-09-12T01:43:39.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.445+0000 7f9ac533b640 1 -- 172.21.15.60:0/2678959168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac00d1c80 msgr2=0x7f9ac00cc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.445+0000 7f9ac533b640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac00d1c80 0x7f9ac00cc3a0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800c700 tx=0x7f9ab800cbc0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.445+0000 7f9ac533b640 1 -- 172.21.15.60:0/2678959168 shutdown_connections 2024-09-12T01:43:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.445+0000 7f9ac533b640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ac00d1c80 0x7f9ac00cc3a0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.445+0000 7f9ac533b640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ac00cf6b0 0x7f9ac00cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.445+0000 7f9ac533b640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9aac06be30 0x7f9aac06e2f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.445+0000 7f9ac533b640 1 --2- 172.21.15.60:0/2678959168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ac00b63d0 0x7f9ac0160860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.446+0000 7f9ac533b640 1 -- 172.21.15.60:0/2678959168 >> 172.21.15.60:0/2678959168 conn(0x7f9ac00d1160 msgr2=0x7f9ac00b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.446+0000 7f9ac533b640 1 -- 172.21.15.60:0/2678959168 shutdown_connections 2024-09-12T01:43:39.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.446+0000 7f9ac533b640 1 -- 172.21.15.60:0/2678959168 wait complete. 2024-09-12T01:43:39.456 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:43:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.560+0000 7f962aeaf640 1 Processor -- start 2024-09-12T01:43:39.560 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.561+0000 7f962aeaf640 1 -- start start 2024-09-12T01:43:39.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.561+0000 7f962aeaf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415e940 0x7f96240b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.561+0000 7f962aeaf640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96240cfd40 con 0x7f96240ba440 2024-09-12T01:43:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.561+0000 7f962aeaf640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f962415ed20 con 0x7f96240d2290 2024-09-12T01:43:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.561+0000 7f962aeaf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f96240d3ef0 con 0x7f962415e940 2024-09-12T01:43:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f9623fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f96240ba440 0x7f96240cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56072/0 (socket says 172.21.15.60:56072) 2024-09-12T01:43:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f9623fff640 1 -- 172.21.15.60:0/2059276406 learned_addr learned my addr 172.21.15.60:0/2059276406 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f9628c4b640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415e940 0x7f96240b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351160997 0 0) 0x7f96240cfd40 con 0x7f96240ba440 2024-09-12T01:43:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9610003520 con 0x7f96240ba440 2024-09-12T01:43:39.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2869136916 0 0) 0x7f9610003520 con 0x7f96240ba440 2024-09-12T01:43:39.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415e940 msgr2=0x7f96240b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:39.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415e940 0x7f96240b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 >> v1:172.21.15.105:6789/0 conn(0x7f96240d2290 legacy=0x7f96240cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96240d32e0 con 0x7f96240ba440 2024-09-12T01:43:39.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f960c0019f0 con 0x7f96240ba440 2024-09-12T01:43:39.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 >> v1:172.21.15.60:6789/0 conn(0x7f96240ba440 legacy=0x7f96240cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96100039e0 0x7f9610003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9610004800 0x7f9610004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415e940 0x7f9610005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96240d3ef0 con 0x7f9610004800 2024-09-12T01:43:39.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f961000baf0 con 0x7f96100039e0 2024-09-12T01:43:39.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f961000bcf0 con 0x7f962415e940 2024-09-12T01:43:39.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f9623fff640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9610004800 0x7f9610004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f9628c4b640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96100039e0 0x7f9610003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.562+0000 7f962944c640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415e940 0x7f9610005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.563+0000 7f9623fff640 1 -- 172.21.15.60:0/2059276406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415e940 msgr2=0x7f9610005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:39.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.563+0000 7f9623fff640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415e940 0x7f9610005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.563+0000 7f9623fff640 1 -- 172.21.15.60:0/2059276406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96100039e0 msgr2=0x7f9610003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:39.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.563+0000 7f9623fff640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96100039e0 0x7f9610003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.563+0000 7f9623fff640 1 -- 172.21.15.60:0/2059276406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9610003520 con 0x7f9610004800 2024-09-12T01:43:39.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.563+0000 7f962944c640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415e940 0x7f9610005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:39.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.563+0000 7f9623fff640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9610004800 0x7f9610004c80 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f962406dbc0 tx=0x7f9610005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55b29f312d5470d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:39.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.563+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c00a480 con 0x7f9610004800 2024-09-12T01:43:39.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.563+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960c02f070 con 0x7f9610004800 2024-09-12T01:43:39.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.563+0000 7f96237fe640 1 -- 172.21.15.60:0/2059276406 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960c02bc30 con 0x7f9610004800 2024-09-12T01:43:39.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.564+0000 7f962aeaf640 1 -- 172.21.15.60:0/2059276406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9610004800 msgr2=0x7f9610004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.564+0000 7f962aeaf640 1 --2- 172.21.15.60:0/2059276406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9610004800 0x7f9610004c80 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f962406dbc0 tx=0x7f9610005830 comp rx=0 tx=0).stop 2024-09-12T01:43:39.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.564+0000 7f962944c640 1 -- 172.21.15.60:0/2059276406 reap_dead start 2024-09-12T01:43:39.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.564+0000 7f962aeaf640 1 -- 172.21.15.60:0/2059276406 shutdown_connections 2024-09-12T01:43:39.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.564+0000 7f962aeaf640 1 -- 172.21.15.60:0/2059276406 >> 172.21.15.60:0/2059276406 conn(0x7f96240d1140 msgr2=0x7f96240d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:39.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.564+0000 7f962aeaf640 1 -- 172.21.15.60:0/2059276406 shutdown_connections 2024-09-12T01:43:39.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.564+0000 7f962aeaf640 1 -- 172.21.15.60:0/2059276406 wait complete. 2024-09-12T01:43:39.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.565+0000 7f962aeaf640 1 Processor -- start 2024-09-12T01:43:39.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.565+0000 7f962aeaf640 1 -- start start 2024-09-12T01:43:39.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.566+0000 7f962aeaf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9610004800 0x7f962414d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.566+0000 7f962aeaf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96240ab0e0 0x7f96240ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.566+0000 7f962aeaf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415b730 0x7f962415bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.566+0000 7f962aeaf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f96240d3b80 con 0x7f9610004800 2024-09-12T01:43:39.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.566+0000 7f962aeaf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f96240d38a0 con 0x7f96240ab0e0 2024-09-12T01:43:39.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.566+0000 7f962aeaf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f96240b7510 con 0x7f962415b730 2024-09-12T01:43:39.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.566+0000 7f9628c4b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9610004800 0x7f962414d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.566+0000 7f9628c4b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9610004800 0x7f962414d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55852/0 (socket says 172.21.15.60:55852) 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.566+0000 7f9628c4b640 1 -- 172.21.15.60:0/1574211632 learned_addr learned my addr 172.21.15.60:0/1574211632 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.566+0000 7f9623fff640 1 --2- 172.21.15.60:0/1574211632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96240ab0e0 0x7f96240ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.566+0000 7f962944c640 1 --2- 172.21.15.60:0/1574211632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415b730 0x7f962415bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.567+0000 7f9628c4b640 1 -- 172.21.15.60:0/1574211632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415b730 msgr2=0x7f962415bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.567+0000 7f9628c4b640 1 --2- 172.21.15.60:0/1574211632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f962415b730 0x7f962415bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.567+0000 7f9628c4b640 1 -- 172.21.15.60:0/1574211632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96240ab0e0 msgr2=0x7f96240ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.567+0000 7f9628c4b640 1 --2- 172.21.15.60:0/1574211632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f96240ab0e0 0x7f96240ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.567+0000 7f9628c4b640 1 -- 172.21.15.60:0/1574211632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962415c460 con 0x7f9610004800 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.567+0000 7f9628c4b640 1 --2- 172.21.15.60:0/1574211632 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9610004800 0x7f962414d1a0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f96140119a0 tx=0x7f9614011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.567+0000 7f96217fa640 1 -- 172.21.15.60:0/1574211632 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f961400fa30 con 0x7f9610004800 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.567+0000 7f96217fa640 1 -- 172.21.15.60:0/1574211632 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f961400fbd0 con 0x7f9610004800 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.567+0000 7f96217fa640 1 -- 172.21.15.60:0/1574211632 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9614014440 con 0x7f9610004800 2024-09-12T01:43:39.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.567+0000 7f962aeaf640 1 -- 172.21.15.60:0/1574211632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f962415c740 con 0x7f9610004800 2024-09-12T01:43:39.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.567+0000 7f962aeaf640 1 -- 172.21.15.60:0/1574211632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f962415cd00 con 0x7f9610004800 2024-09-12T01:43:39.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.568+0000 7f962aeaf640 1 -- 172.21.15.60:0/1574211632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96240b6140 con 0x7f9610004800 2024-09-12T01:43:39.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.569+0000 7f96217fa640 1 -- 172.21.15.60:0/1574211632 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9614012040 con 0x7f9610004800 2024-09-12T01:43:39.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.569+0000 7f96217fa640 1 --2- 172.21.15.60:0/1574211632 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f960406be30 0x7f960406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.569+0000 7f96217fa640 1 -- 172.21.15.60:0/1574211632 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f961408b480 con 0x7f9610004800 2024-09-12T01:43:39.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.569+0000 7f9623fff640 1 --2- 172.21.15.60:0/1574211632 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f960406be30 0x7f960406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.569+0000 7f9623fff640 1 --2- 172.21.15.60:0/1574211632 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f960406be30 0x7f960406e2f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f960c033000 tx=0x7f960c007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:39.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.573+0000 7f96217fa640 1 -- 172.21.15.60:0/1574211632 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9614019030 con 0x7f9610004800 2024-09-12T01:43:39.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.786+0000 7f962aeaf640 1 -- 172.21.15.60:0/1574211632 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f96240d16f0 con 0x7f9610004800 2024-09-12T01:43:39.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.787+0000 7f96217fa640 1 -- 172.21.15.60:0/1574211632 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=-1 MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it v72) ==== 316+0+0 (secure 0 0 0) 0x7f9614059ec0 con 0x7f9610004800 2024-09-12T01:43:39.786 INFO:teuthology.orchestra.run.smithi060.stderr:Error EPERM: MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it 2024-09-12T01:43:39.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:43:39.792 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs --yes-i-really-mean-it 2024-09-12T01:43:39.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.897+0000 7f2f8c79f640 1 Processor -- start 2024-09-12T01:43:39.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.897+0000 7f2f8c79f640 1 -- start start 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.898+0000 7f2f8c79f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f8415e7a0 0x7f2f8406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.898+0000 7f2f8c79f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2f840cf1f0 0x7f2f840b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.898+0000 7f2f8c79f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f840b6720 0x7f2f841623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.898+0000 7f2f8c79f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2f840d2ca0 con 0x7f2f840b6720 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.898+0000 7f2f8c79f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2f840cf860 con 0x7f2f840cf1f0 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.898+0000 7f2f8c79f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2f840cfb40 con 0x7f2f8415e7a0 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.898+0000 7f2f8ad3c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f840b6720 0x7f2f841623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.898+0000 7f2f8ad3c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f840b6720 0x7f2f841623c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55864/0 (socket says 172.21.15.60:55864) 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.898+0000 7f2f8ad3c640 1 -- 172.21.15.60:0/116585300 learned_addr learned my addr 172.21.15.60:0/116585300 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.899+0000 7f2f8a53b640 1 --2- 172.21.15.60:0/116585300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f8415e7a0 0x7f2f8406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.899+0000 7f2f89d3a640 1 --2- 172.21.15.60:0/116585300 >> v2:172.21.15.105:3300/0 conn(0x7f2f840cf1f0 0x7f2f840b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.899+0000 7f2f8ad3c640 1 -- 172.21.15.60:0/116585300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f8415e7a0 msgr2=0x7f2f8406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.899+0000 7f2f8ad3c640 1 --2- 172.21.15.60:0/116585300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f8415e7a0 0x7f2f8406caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.899+0000 7f2f8ad3c640 1 -- 172.21.15.60:0/116585300 >> v2:172.21.15.105:3300/0 conn(0x7f2f840cf1f0 msgr2=0x7f2f840b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.899+0000 7f2f8ad3c640 1 --2- 172.21.15.60:0/116585300 >> v2:172.21.15.105:3300/0 conn(0x7f2f840cf1f0 0x7f2f840b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.899+0000 7f2f8ad3c640 1 -- 172.21.15.60:0/116585300 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f840cfe20 con 0x7f2f840b6720 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.899+0000 7f2f8a53b640 1 --2- 172.21.15.60:0/116585300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f8415e7a0 0x7f2f8406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.899+0000 7f2f89d3a640 1 --2- 172.21.15.60:0/116585300 >> v2:172.21.15.105:3300/0 conn(0x7f2f840cf1f0 0x7f2f840b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:39.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f8ad3c640 1 --2- 172.21.15.60:0/116585300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f840b6720 0x7f2f841623c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f2f840cb420 tx=0x7f2f7c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570076c962ecd296 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f89539640 1 -- 172.21.15.60:0/116585300 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c036070 con 0x7f2f840b6720 2024-09-12T01:43:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f89539640 1 -- 172.21.15.60:0/116585300 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7c031600 con 0x7f2f840b6720 2024-09-12T01:43:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f89539640 1 -- 172.21.15.60:0/116585300 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0319d0 con 0x7f2f840b6720 2024-09-12T01:43:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f8c79f640 1 -- 172.21.15.60:0/116585300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f840b6720 msgr2=0x7f2f841623c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f8c79f640 1 --2- 172.21.15.60:0/116585300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f840b6720 0x7f2f841623c0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f2f840cb420 tx=0x7f2f7c02a610 comp rx=0 tx=0).stop 2024-09-12T01:43:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f8c79f640 1 -- 172.21.15.60:0/116585300 shutdown_connections 2024-09-12T01:43:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f8c79f640 1 --2- 172.21.15.60:0/116585300 >> v2:172.21.15.105:3300/0 conn(0x7f2f840cf1f0 0x7f2f840b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f8c79f640 1 --2- 172.21.15.60:0/116585300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f840b6720 0x7f2f841623c0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f8c79f640 1 --2- 172.21.15.60:0/116585300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f8415e7a0 0x7f2f8406caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f8c79f640 1 -- 172.21.15.60:0/116585300 >> 172.21.15.60:0/116585300 conn(0x7f2f840d11e0 msgr2=0x7f2f840d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:39.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f8c79f640 1 -- 172.21.15.60:0/116585300 shutdown_connections 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.900+0000 7f2f8c79f640 1 -- 172.21.15.60:0/116585300 wait complete. 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.901+0000 7f2f8c79f640 1 Processor -- start 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.902+0000 7f2f8c79f640 1 -- start start 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.902+0000 7f2f8c79f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f840b6720 0x7f2f840ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.902+0000 7f2f8c79f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f840cf1f0 0x7f2f840cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.902+0000 7f2f8c79f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f8415e7a0 0x7f2f840cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.902+0000 7f2f8c79f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2f8406cfe0 con 0x7f2f840b6720 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.902+0000 7f2f8c79f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2f840b7a00 con 0x7f2f840cf1f0 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.902+0000 7f2f8c79f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2f8415eb80 con 0x7f2f8415e7a0 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.902+0000 7f2f8a53b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f840b6720 0x7f2f840ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.902+0000 7f2f8a53b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f840b6720 0x7f2f840ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55870/0 (socket says 172.21.15.60:55870) 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.902+0000 7f2f8a53b640 1 -- 172.21.15.60:0/2988605753 learned_addr learned my addr 172.21.15.60:0/2988605753 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f8ad3c640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f8415e7a0 0x7f2f840cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f89d3a640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f840cf1f0 0x7f2f840cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f8a53b640 1 -- 172.21.15.60:0/2988605753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f8415e7a0 msgr2=0x7f2f840cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f8a53b640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f8415e7a0 0x7f2f840cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f8a53b640 1 -- 172.21.15.60:0/2988605753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f840cf1f0 msgr2=0x7f2f840cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f8a53b640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f840cf1f0 0x7f2f840cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f8a53b640 1 -- 172.21.15.60:0/2988605753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f84142c20 con 0x7f2f840b6720 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f8ad3c640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f8415e7a0 0x7f2f840cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f8a53b640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f840b6720 0x7f2f840ca780 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000e7e0 tx=0x7f2f8000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f7affd640 1 -- 172.21.15.60:0/2988605753 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8000f040 con 0x7f2f840b6720 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f7affd640 1 -- 172.21.15.60:0/2988605753 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f80004030 con 0x7f2f840b6720 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f8c79f640 1 -- 172.21.15.60:0/2988605753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f84142f00 con 0x7f2f840b6720 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f7affd640 1 -- 172.21.15.60:0/2988605753 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80004400 con 0x7f2f840b6720 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.903+0000 7f2f8c79f640 1 -- 172.21.15.60:0/2988605753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f841434c0 con 0x7f2f840b6720 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.904+0000 7f2f8c79f640 1 -- 172.21.15.60:0/2988605753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f840b61e0 con 0x7f2f840b6720 2024-09-12T01:43:39.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.905+0000 7f2f7affd640 1 -- 172.21.15.60:0/2988605753 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f8000c6d0 con 0x7f2f840b6720 2024-09-12T01:43:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.905+0000 7f2f7affd640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f6806be30 0x7f2f6806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.905+0000 7f2f89d3a640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f6806be30 0x7f2f6806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.905+0000 7f2f7affd640 1 -- 172.21.15.60:0/2988605753 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5709+0+0 (secure 0 0 0) 0x7f2f8008ac00 con 0x7f2f840b6720 2024-09-12T01:43:39.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.906+0000 7f2f89d3a640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f6806be30 0x7f2f6806e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2f74006fd0 tx=0x7f2f74008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:39.909 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:39.910+0000 7f2f7affd640 1 -- 172.21.15.60:0/2988605753 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f80091080 con 0x7f2f840b6720 2024-09-12T01:43:40.120 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.121+0000 7f2f8c79f640 1 -- 172.21.15.60:0/2988605753 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2f840d1990 con 0x7f2f840b6720 2024-09-12T01:43:40.121 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-12T01:43:40.121+0000 7f58b98dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:43:40.122 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.123+0000 7f2f7affd640 1 -- 172.21.15.60:0/2988605753 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) ==== 191+0+0 (secure 0 0 0) 0x7f2f80017020 con 0x7f2f840b6720 2024-09-12T01:43:40.122 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:43:40.125 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.125+0000 7f2f8c79f640 1 -- 172.21.15.60:0/2988605753 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f6806be30 msgr2=0x7f2f6806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.125+0000 7f2f8c79f640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f6806be30 0x7f2f6806e2f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2f74006fd0 tx=0x7f2f74008040 comp rx=0 tx=0).stop 2024-09-12T01:43:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.125+0000 7f2f8c79f640 1 -- 172.21.15.60:0/2988605753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f840b6720 msgr2=0x7f2f840ca780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.125+0000 7f2f8c79f640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f840b6720 0x7f2f840ca780 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000e7e0 tx=0x7f2f8000eca0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.125+0000 7f2f8c79f640 1 -- 172.21.15.60:0/2988605753 shutdown_connections 2024-09-12T01:43:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.125+0000 7f2f8c79f640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f6806be30 0x7f2f6806e2f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.125+0000 7f2f8c79f640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f8415e7a0 0x7f2f840cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.125+0000 7f2f8c79f640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f840cf1f0 0x7f2f840cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.125+0000 7f2f8c79f640 1 --2- 172.21.15.60:0/2988605753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f840b6720 0x7f2f840ca780 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.125+0000 7f2f8c79f640 1 -- 172.21.15.60:0/2988605753 >> 172.21.15.60:0/2988605753 conn(0x7f2f840d11e0 msgr2=0x7f2f840d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.125+0000 7f2f8c79f640 1 -- 172.21.15.60:0/2988605753 shutdown_connections 2024-09-12T01:43:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.125+0000 7f2f8c79f640 1 -- 172.21.15.60:0/2988605753 wait complete. 2024-09-12T01:43:40.136 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:43:40.163 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:43:40.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.241+0000 7f93bc19f640 1 Processor -- start 2024-09-12T01:43:40.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.241+0000 7f93bc19f640 1 -- start start 2024-09-12T01:43:40.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93bc19f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b415e6f0 0x7f93b406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:40.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93bc19f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f93b40b54d0 0x7f93b415f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:40.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93bc19f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f93b40b6d40 0x7f93b40b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:40.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93bc19f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f93b406e990 con 0x7f93b40b54d0 2024-09-12T01:43:40.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93bc19f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f93b406ec70 con 0x7f93b40b6d40 2024-09-12T01:43:40.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93bc19f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f93b415ec70 con 0x7f93b415e6f0 2024-09-12T01:43:40.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93b973a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f93b40b54d0 0x7f93b415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:40.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93b973a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f93b40b54d0 0x7f93b415f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55880/0 (socket says 172.21.15.60:55880) 2024-09-12T01:43:40.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93b973a640 1 -- 172.21.15.60:0/3482896217 learned_addr learned my addr 172.21.15.60:0/3482896217 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:40.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93b9f3b640 1 --2- 172.21.15.60:0/3482896217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b415e6f0 0x7f93b406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:40.242 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93ba73c640 1 --2- 172.21.15.60:0/3482896217 >> v2:172.21.15.105:3300/0 conn(0x7f93b40b6d40 0x7f93b40b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:40.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93b973a640 1 -- 172.21.15.60:0/3482896217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b415e6f0 msgr2=0x7f93b406fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:40.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93b973a640 1 --2- 172.21.15.60:0/3482896217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b415e6f0 0x7f93b406fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93b973a640 1 -- 172.21.15.60:0/3482896217 >> v2:172.21.15.105:3300/0 conn(0x7f93b40b6d40 msgr2=0x7f93b40b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:40.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93b973a640 1 --2- 172.21.15.60:0/3482896217 >> v2:172.21.15.105:3300/0 conn(0x7f93b40b6d40 0x7f93b40b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93b973a640 1 -- 172.21.15.60:0/3482896217 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b415ef50 con 0x7f93b40b54d0 2024-09-12T01:43:40.243 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.242+0000 7f93ba73c640 1 --2- 172.21.15.60:0/3482896217 >> v2:172.21.15.105:3300/0 conn(0x7f93b40b6d40 0x7f93b40b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:40.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.243+0000 7f93b973a640 1 --2- 172.21.15.60:0/3482896217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b40b54d0 0x7f93b415f750 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f93b40d2400 tx=0x7f93a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3011b496f4882d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:40.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.243+0000 7f93b8f39640 1 -- 172.21.15.60:0/3482896217 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4037070 con 0x7f93b40b54d0 2024-09-12T01:43:40.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.243+0000 7f93b8f39640 1 -- 172.21.15.60:0/3482896217 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a4032440 con 0x7f93b40b54d0 2024-09-12T01:43:40.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.243+0000 7f93b8f39640 1 -- 172.21.15.60:0/3482896217 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4032810 con 0x7f93b40b54d0 2024-09-12T01:43:40.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.244+0000 7f93bc19f640 1 -- 172.21.15.60:0/3482896217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b40b54d0 msgr2=0x7f93b415f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:40.244 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.244+0000 7f93bc19f640 1 --2- 172.21.15.60:0/3482896217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b40b54d0 0x7f93b415f750 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f93b40d2400 tx=0x7f93a402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.244+0000 7f93bc19f640 1 -- 172.21.15.60:0/3482896217 shutdown_connections 2024-09-12T01:43:40.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.244+0000 7f93bc19f640 1 --2- 172.21.15.60:0/3482896217 >> v2:172.21.15.105:3300/0 conn(0x7f93b40b6d40 0x7f93b40b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.244+0000 7f93bc19f640 1 --2- 172.21.15.60:0/3482896217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b40b54d0 0x7f93b415f750 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.244+0000 7f93bc19f640 1 --2- 172.21.15.60:0/3482896217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b415e6f0 0x7f93b406fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.244+0000 7f93bc19f640 1 -- 172.21.15.60:0/3482896217 >> 172.21.15.60:0/3482896217 conn(0x7f93b40d2430 msgr2=0x7f93b40d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:40.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.244+0000 7f93bc19f640 1 -- 172.21.15.60:0/3482896217 shutdown_connections 2024-09-12T01:43:40.245 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.244+0000 7f93bc19f640 1 -- 172.21.15.60:0/3482896217 wait complete. 2024-09-12T01:43:40.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.245+0000 7f93bc19f640 1 Processor -- start 2024-09-12T01:43:40.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.245+0000 7f93bc19f640 1 -- start start 2024-09-12T01:43:40.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93bc19f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b40b54d0 0x7f93b40d1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:40.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93bc19f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b40b6d40 0x7f93b41f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:40.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93bc19f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b415e6f0 0x7f93b41f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:40.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93bc19f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f93b406e5b0 con 0x7f93b40b6d40 2024-09-12T01:43:40.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93bc19f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f93b40b7730 con 0x7f93b415e6f0 2024-09-12T01:43:40.247 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93bc19f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f93b406e730 con 0x7f93b40b54d0 2024-09-12T01:43:40.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93b973a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b40b6d40 0x7f93b41f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:40.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93b973a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b40b6d40 0x7f93b41f3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55894/0 (socket says 172.21.15.60:55894) 2024-09-12T01:43:40.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93b973a640 1 -- 172.21.15.60:0/372169195 learned_addr learned my addr 172.21.15.60:0/372169195 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:40.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93ba73c640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b415e6f0 0x7f93b41f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:40.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93b9f3b640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b40b54d0 0x7f93b40d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:40.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93b973a640 1 -- 172.21.15.60:0/372169195 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b40b54d0 msgr2=0x7f93b40d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:40.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93b973a640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b40b54d0 0x7f93b40d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93b973a640 1 -- 172.21.15.60:0/372169195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b415e6f0 msgr2=0x7f93b41f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:40.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93b973a640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b415e6f0 0x7f93b41f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:40.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93b973a640 1 -- 172.21.15.60:0/372169195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b415c000 con 0x7f93b40b6d40 2024-09-12T01:43:40.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.246+0000 7f93b973a640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b40b6d40 0x7f93b41f3040 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f93a402a220 tx=0x7f93a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:40.248 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.247+0000 7f93aa7fc640 1 -- 172.21.15.60:0/372169195 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4041020 con 0x7f93b40b6d40 2024-09-12T01:43:40.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.247+0000 7f93aa7fc640 1 -- 172.21.15.60:0/372169195 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a40306c0 con 0x7f93b40b6d40 2024-09-12T01:43:40.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.247+0000 7f93aa7fc640 1 -- 172.21.15.60:0/372169195 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4037040 con 0x7f93b40b6d40 2024-09-12T01:43:40.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.247+0000 7f93bc19f640 1 -- 172.21.15.60:0/372169195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b415c2e0 con 0x7f93b40b6d40 2024-09-12T01:43:40.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.247+0000 7f93bc19f640 1 -- 172.21.15.60:0/372169195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b415c8a0 con 0x7f93b40b6d40 2024-09-12T01:43:40.249 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.248+0000 7f93bc19f640 1 -- 172.21.15.60:0/372169195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b406c6c0 con 0x7f93b40b6d40 2024-09-12T01:43:40.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.248+0000 7f93aa7fc640 1 -- 172.21.15.60:0/372169195 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f93a4044020 con 0x7f93b40b6d40 2024-09-12T01:43:40.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.249+0000 7f93aa7fc640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f939806be30 0x7f939806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:40.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.249+0000 7f93aa7fc640 1 -- 172.21.15.60:0/372169195 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7f93a40ab5c0 con 0x7f93b40b6d40 2024-09-12T01:43:40.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.249+0000 7f93b9f3b640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f939806be30 0x7f939806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:40.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.249+0000 7f93b9f3b640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f939806be30 0x7f939806e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f93b00079a0 tx=0x7f93b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:40.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.253+0000 7f93aa7fc640 1 -- 172.21.15.60:0/372169195 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f93a404b030 con 0x7f93b40b6d40 2024-09-12T01:43:40.463 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:40.464+0000 7f93bc19f640 1 -- 172.21.15.60:0/372169195 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f93b40b71f0 con 0x7f93b40b6d40 2024-09-12T01:43:41.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.127+0000 7f93aa7fc640 1 -- 172.21.15.60:0/372169195 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v74) ==== 104+0+0 (secure 0 0 0) 0x7f93a40798c0 con 0x7f93b40b6d40 2024-09-12T01:43:41.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.130+0000 7f93bc19f640 1 -- 172.21.15.60:0/372169195 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f939806be30 msgr2=0x7f939806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.130+0000 7f93bc19f640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f939806be30 0x7f939806e2f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f93b00079a0 tx=0x7f93b0008040 comp rx=0 tx=0).stop 2024-09-12T01:43:41.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.130+0000 7f93bc19f640 1 -- 172.21.15.60:0/372169195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b40b6d40 msgr2=0x7f93b41f3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.130+0000 7f93bc19f640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b40b6d40 0x7f93b41f3040 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f93a402a220 tx=0x7f93a40046c0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.131+0000 7f93bc19f640 1 -- 172.21.15.60:0/372169195 shutdown_connections 2024-09-12T01:43:41.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.131+0000 7f93bc19f640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f93b415e6f0 0x7f93b41f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.131+0000 7f93bc19f640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93b40b6d40 0x7f93b41f3040 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.131+0000 7f93bc19f640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f939806be30 0x7f939806e2f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.131+0000 7f93bc19f640 1 --2- 172.21.15.60:0/372169195 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f93b40b54d0 0x7f93b40d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.131+0000 7f93bc19f640 1 -- 172.21.15.60:0/372169195 >> 172.21.15.60:0/372169195 conn(0x7f93b40d2430 msgr2=0x7f93b40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:41.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.131+0000 7f93bc19f640 1 -- 172.21.15.60:0/372169195 shutdown_connections 2024-09-12T01:43:41.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.131+0000 7f93bc19f640 1 -- 172.21.15.60:0/372169195 wait complete. 2024-09-12T01:43:41.144 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:43:41.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.258+0000 7f79b279f640 1 Processor -- start 2024-09-12T01:43:41.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.258+0000 7f79b279f640 1 -- start start 2024-09-12T01:43:41.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79b279f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f79ac0d0f80 0x7f79ac0b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79b279f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f79ac0b46d0 0x7f79ac0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79b279f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79ac0b5680 con 0x7f79ac15c470 2024-09-12T01:43:41.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79b279f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f79ac0b4b10 con 0x7f79ac0d0f80 2024-09-12T01:43:41.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79b279f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f79ac0d1560 con 0x7f79ac0b46d0 2024-09-12T01:43:41.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79a3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f79ac0d0f80 0x7f79ac0b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79abfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f79ac15c470 0x7f79ac073c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56088/0 (socket says 172.21.15.60:56088) 2024-09-12T01:43:41.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79a3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f79ac0d0f80 0x7f79ac0b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55900/0 (socket says 172.21.15.60:55900) 2024-09-12T01:43:41.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79abfff640 1 -- 172.21.15.60:0/3432642689 learned_addr learned my addr 172.21.15.60:0/3432642689 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:41.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79b0d3c640 1 --2- 172.21.15.60:0/3432642689 >> v2:172.21.15.105:3300/0 conn(0x7f79ac0b46d0 0x7f79ac0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79a3fff640 1 -- 172.21.15.60:0/3432642689 >> v2:172.21.15.105:3300/0 conn(0x7f79ac0b46d0 msgr2=0x7f79ac0b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:41.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79a3fff640 1 --2- 172.21.15.60:0/3432642689 >> v2:172.21.15.105:3300/0 conn(0x7f79ac0b46d0 0x7f79ac0b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.259+0000 7f79a3fff640 1 -- 172.21.15.60:0/3432642689 >> v1:172.21.15.60:6789/0 conn(0x7f79ac15c470 legacy=0x7f79ac073c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.260+0000 7f79a3fff640 1 -- 172.21.15.60:0/3432642689 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac0d1840 con 0x7f79ac0d0f80 2024-09-12T01:43:41.260 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.260+0000 7f79ab7fe640 1 -- 172.21.15.60:0/3432642689 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1464932835 0 0) 0x7f79ac0b5680 con 0x7f79ac15c470 2024-09-12T01:43:41.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.260+0000 7f79a3fff640 1 --2- 172.21.15.60:0/3432642689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0d0f80 0x7f79ac0b4190 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0b4c90 tx=0x7f799402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae053448f747c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:41.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.260+0000 7f79ab7fe640 1 -- 172.21.15.60:0/3432642689 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994037070 con 0x7f79ac0d0f80 2024-09-12T01:43:41.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.261+0000 7f79ab7fe640 1 -- 172.21.15.60:0/3432642689 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7994032440 con 0x7f79ac0d0f80 2024-09-12T01:43:41.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.261+0000 7f79ab7fe640 1 -- 172.21.15.60:0/3432642689 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994032810 con 0x7f79ac0d0f80 2024-09-12T01:43:41.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.261+0000 7f79b279f640 1 -- 172.21.15.60:0/3432642689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0d0f80 msgr2=0x7f79ac0b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.261+0000 7f79b279f640 1 --2- 172.21.15.60:0/3432642689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0d0f80 0x7f79ac0b4190 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0b4c90 tx=0x7f799402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.261+0000 7f79b279f640 1 -- 172.21.15.60:0/3432642689 shutdown_connections 2024-09-12T01:43:41.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.261+0000 7f79b279f640 1 --2- 172.21.15.60:0/3432642689 >> v2:172.21.15.105:3300/0 conn(0x7f79ac0b46d0 0x7f79ac0b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.261+0000 7f79b279f640 1 --2- 172.21.15.60:0/3432642689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0d0f80 0x7f79ac0b4190 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.261+0000 7f79b279f640 1 -- 172.21.15.60:0/3432642689 >> 172.21.15.60:0/3432642689 conn(0x7f79ac062630 msgr2=0x7f79ac062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:41.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.261+0000 7f79b279f640 1 -- 172.21.15.60:0/3432642689 shutdown_connections 2024-09-12T01:43:41.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.261+0000 7f79b279f640 1 -- 172.21.15.60:0/3432642689 wait complete. 2024-09-12T01:43:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.262+0000 7f79b279f640 1 Processor -- start 2024-09-12T01:43:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.262+0000 7f79b279f640 1 -- start start 2024-09-12T01:43:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.263+0000 7f79b279f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79ac0b46d0 0x7f79ac1529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.263+0000 7f79b279f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0d0f80 0x7f79ac15f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.263+0000 7f79b279f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79ac15c470 0x7f79ac15c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.263+0000 7f79b279f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac0b60c0 con 0x7f79ac0d0f80 2024-09-12T01:43:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.263+0000 7f79b279f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f79ac15c850 con 0x7f79ac15c470 2024-09-12T01:43:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.263+0000 7f79b279f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f79ac0b6240 con 0x7f79ac0b46d0 2024-09-12T01:43:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.263+0000 7f79a3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0d0f80 0x7f79ac15f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.263+0000 7f79a3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0d0f80 0x7f79ac15f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55916/0 (socket says 172.21.15.60:55916) 2024-09-12T01:43:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.263+0000 7f79a3fff640 1 -- 172.21.15.60:0/3202026100 learned_addr learned my addr 172.21.15.60:0/3202026100 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:41.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.263+0000 7f79abfff640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79ac0b46d0 0x7f79ac1529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.263+0000 7f79b0d3c640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79ac15c470 0x7f79ac15c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.264+0000 7f79a3fff640 1 -- 172.21.15.60:0/3202026100 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79ac0b46d0 msgr2=0x7f79ac1529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.264+0000 7f79a3fff640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79ac0b46d0 0x7f79ac1529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.264+0000 7f79a3fff640 1 -- 172.21.15.60:0/3202026100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79ac15c470 msgr2=0x7f79ac15c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.264+0000 7f79a3fff640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79ac15c470 0x7f79ac15c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.264+0000 7f79a3fff640 1 -- 172.21.15.60:0/3202026100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79ac151920 con 0x7f79ac0d0f80 2024-09-12T01:43:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.264+0000 7f79a3fff640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0d0f80 0x7f79ac15f660 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f7994000c00 tx=0x7f79940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.264+0000 7f79a97fa640 1 -- 172.21.15.60:0/3202026100 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994037050 con 0x7f79ac0d0f80 2024-09-12T01:43:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.264+0000 7f79a97fa640 1 -- 172.21.15.60:0/3202026100 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7994038040 con 0x7f79ac0d0f80 2024-09-12T01:43:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.264+0000 7f79b279f640 1 -- 172.21.15.60:0/3202026100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79ac151c00 con 0x7f79ac0d0f80 2024-09-12T01:43:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.264+0000 7f79a97fa640 1 -- 172.21.15.60:0/3202026100 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7994004470 con 0x7f79ac0d0f80 2024-09-12T01:43:41.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.264+0000 7f79b279f640 1 -- 172.21.15.60:0/3202026100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79ac1521c0 con 0x7f79ac0d0f80 2024-09-12T01:43:41.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.265+0000 7f79b279f640 1 -- 172.21.15.60:0/3202026100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79ac0b5b80 con 0x7f79ac0d0f80 2024-09-12T01:43:41.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.266+0000 7f79a97fa640 1 -- 172.21.15.60:0/3202026100 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7994030900 con 0x7f79ac0d0f80 2024-09-12T01:43:41.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.266+0000 7f79a97fa640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f798c06be30 0x7f798c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:41.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.266+0000 7f79a97fa640 1 -- 172.21.15.60:0/3202026100 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5795+0+0 (secure 0 0 0) 0x7f79940ab8b0 con 0x7f79ac0d0f80 2024-09-12T01:43:41.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.266+0000 7f79abfff640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f798c06be30 0x7f798c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:41.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.267+0000 7f79abfff640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f798c06be30 0x7f798c06e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f799c007fd0 tx=0x7f799c007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:41.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.270+0000 7f79a97fa640 1 -- 172.21.15.60:0/3202026100 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7994079d60 con 0x7f79ac0d0f80 2024-09-12T01:43:41.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:41.446+0000 7f79b279f640 1 -- 172.21.15.60:0/3202026100 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f79ac0b7170 con 0x7f79ac0d0f80 2024-09-12T01:43:42.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.129+0000 7f79a97fa640 1 -- 172.21.15.60:0/3202026100 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v119) ==== 181+0+0 (secure 0 0 0) 0x7f799407e060 con 0x7f79ac0d0f80 2024-09-12T01:43:42.129 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:43:42.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.132+0000 7f79b279f640 1 -- 172.21.15.60:0/3202026100 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f798c06be30 msgr2=0x7f798c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.132+0000 7f79b279f640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f798c06be30 0x7f798c06e2f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f799c007fd0 tx=0x7f799c007de0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.132+0000 7f79b279f640 1 -- 172.21.15.60:0/3202026100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0d0f80 msgr2=0x7f79ac15f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.132+0000 7f79b279f640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0d0f80 0x7f79ac15f660 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f7994000c00 tx=0x7f79940046c0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.132+0000 7f79b279f640 1 -- 172.21.15.60:0/3202026100 shutdown_connections 2024-09-12T01:43:42.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.132+0000 7f79b279f640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f79ac15c470 0x7f79ac15c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.132+0000 7f79b279f640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79ac0d0f80 0x7f79ac15f660 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.132+0000 7f79b279f640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f798c06be30 0x7f798c06e2f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.132+0000 7f79b279f640 1 --2- 172.21.15.60:0/3202026100 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f79ac0b46d0 0x7f79ac1529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.132+0000 7f79b279f640 1 -- 172.21.15.60:0/3202026100 >> 172.21.15.60:0/3202026100 conn(0x7f79ac062630 msgr2=0x7f79ac0d2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:42.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.133+0000 7f79b279f640 1 -- 172.21.15.60:0/3202026100 shutdown_connections 2024-09-12T01:43:42.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.133+0000 7f79b279f640 1 -- 172.21.15.60:0/3202026100 wait complete. 2024-09-12T01:43:42.146 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:43:42.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.256+0000 7f7dc21af640 1 Processor -- start 2024-09-12T01:43:42.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.256+0000 7f7dc21af640 1 -- start start 2024-09-12T01:43:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dc21af640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7dbc15e570 0x7f7dbc0b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dc21af640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7dbc0714a0 0x7f7dbc15e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dc21af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dbc15f020 con 0x7f7dbc06f400 2024-09-12T01:43:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dc21af640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f7dbc15fc30 con 0x7f7dbc0714a0 2024-09-12T01:43:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dc21af640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f7dbc15f300 con 0x7f7dbc15e570 2024-09-12T01:43:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dbaffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7dbc0714a0 0x7f7dbc15e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dbbfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7dbc06f400 0x7f7dbc073160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:56094/0 (socket says 172.21.15.60:56094) 2024-09-12T01:43:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dbbfff640 1 -- 172.21.15.60:0/2583327592 learned_addr learned my addr 172.21.15.60:0/2583327592 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dbb7fe640 1 --2- 172.21.15.60:0/2583327592 >> v2:172.21.15.105:3300/0 conn(0x7f7dbc15e570 0x7f7dbc0b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dbaffd640 1 -- 172.21.15.60:0/2583327592 >> v2:172.21.15.105:3300/0 conn(0x7f7dbc15e570 msgr2=0x7f7dbc0b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dbaffd640 1 --2- 172.21.15.60:0/2583327592 >> v2:172.21.15.105:3300/0 conn(0x7f7dbc15e570 0x7f7dbc0b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dbaffd640 1 -- 172.21.15.60:0/2583327592 >> v1:172.21.15.60:6789/0 conn(0x7f7dbc06f400 legacy=0x7f7dbc073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dba7fc640 1 -- 172.21.15.60:0/2583327592 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461042315 0 0) 0x7f7dbc15f020 con 0x7f7dbc06f400 2024-09-12T01:43:42.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.257+0000 7f7dbaffd640 1 -- 172.21.15.60:0/2583327592 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc15f5e0 con 0x7f7dbc0714a0 2024-09-12T01:43:42.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.258+0000 7f7dbaffd640 1 --2- 172.21.15.60:0/2583327592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dbc0714a0 0x7f7dbc15e950 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0759d0 tx=0x7f7da402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd2dad2f8ee9278 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:42.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.258+0000 7f7dba7fc640 1 -- 172.21.15.60:0/2583327592 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4037070 con 0x7f7dbc0714a0 2024-09-12T01:43:42.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.258+0000 7f7dba7fc640 1 -- 172.21.15.60:0/2583327592 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da4032440 con 0x7f7dbc0714a0 2024-09-12T01:43:42.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.258+0000 7f7dba7fc640 1 -- 172.21.15.60:0/2583327592 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da402ae60 con 0x7f7dbc0714a0 2024-09-12T01:43:42.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.259+0000 7f7dc21af640 1 -- 172.21.15.60:0/2583327592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dbc0714a0 msgr2=0x7f7dbc15e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.259+0000 7f7dc21af640 1 --2- 172.21.15.60:0/2583327592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dbc0714a0 0x7f7dbc15e950 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0759d0 tx=0x7f7da402a110 comp rx=0 tx=0).stop 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.259+0000 7f7dc21af640 1 -- 172.21.15.60:0/2583327592 shutdown_connections 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.259+0000 7f7dc21af640 1 --2- 172.21.15.60:0/2583327592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dbc0714a0 0x7f7dbc15e950 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.259+0000 7f7dc21af640 1 --2- 172.21.15.60:0/2583327592 >> v2:172.21.15.105:3300/0 conn(0x7f7dbc15e570 0x7f7dbc0b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.259+0000 7f7dc21af640 1 -- 172.21.15.60:0/2583327592 >> 172.21.15.60:0/2583327592 conn(0x7f7dbc0b4240 msgr2=0x7f7dbc0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.259+0000 7f7dc21af640 1 -- 172.21.15.60:0/2583327592 shutdown_connections 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.259+0000 7f7dc21af640 1 -- 172.21.15.60:0/2583327592 wait complete. 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.260+0000 7f7dc21af640 1 Processor -- start 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.260+0000 7f7dc21af640 1 -- start start 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dc21af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7dbc06f400 0x7f7dbc0ce200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dc21af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7dbc0714a0 0x7f7dbc0d1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dc21af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dbc15e570 0x7f7dbc0cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dc21af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc06e0f0 con 0x7f7dbc15e570 2024-09-12T01:43:42.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dc21af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7dbc06df70 con 0x7f7dbc06f400 2024-09-12T01:43:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dc21af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7dbc06e270 con 0x7f7dbc0714a0 2024-09-12T01:43:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dbbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dbc15e570 0x7f7dbc0cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dbbfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dbc15e570 0x7f7dbc0cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55942/0 (socket says 172.21.15.60:55942) 2024-09-12T01:43:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dbbfff640 1 -- 172.21.15.60:0/3283422757 learned_addr learned my addr 172.21.15.60:0/3283422757 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dbb7fe640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7dbc06f400 0x7f7dbc0ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dbaffd640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7dbc0714a0 0x7f7dbc0d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dbbfff640 1 -- 172.21.15.60:0/3283422757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7dbc0714a0 msgr2=0x7f7dbc0d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dbbfff640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7dbc0714a0 0x7f7dbc0d1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dbbfff640 1 -- 172.21.15.60:0/3283422757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7dbc06f400 msgr2=0x7f7dbc0ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dbbfff640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7dbc06f400 0x7f7dbc0ce200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dbbfff640 1 -- 172.21.15.60:0/3283422757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dbc0cd160 con 0x7f7dbc15e570 2024-09-12T01:43:42.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.261+0000 7f7dbbfff640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dbc15e570 0x7f7dbc0cca60 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f7db400c7a0 tx=0x7f7db400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:42.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.262+0000 7f7db3fff640 1 -- 172.21.15.60:0/3283422757 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4018070 con 0x7f7dbc15e570 2024-09-12T01:43:42.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.262+0000 7f7db3fff640 1 -- 172.21.15.60:0/3283422757 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db400a640 con 0x7f7dbc15e570 2024-09-12T01:43:42.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.262+0000 7f7dc21af640 1 -- 172.21.15.60:0/3283422757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dbc0cd440 con 0x7f7dbc15e570 2024-09-12T01:43:42.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.262+0000 7f7db3fff640 1 -- 172.21.15.60:0/3283422757 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db400aab0 con 0x7f7dbc15e570 2024-09-12T01:43:42.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.262+0000 7f7dc21af640 1 -- 172.21.15.60:0/3283422757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dbc0cda00 con 0x7f7dbc15e570 2024-09-12T01:43:42.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.263+0000 7f7dc21af640 1 -- 172.21.15.60:0/3283422757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dbc15e950 con 0x7f7dbc15e570 2024-09-12T01:43:42.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.263+0000 7f7db3fff640 1 -- 172.21.15.60:0/3283422757 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7db400ac50 con 0x7f7dbc15e570 2024-09-12T01:43:42.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.264+0000 7f7db3fff640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d9c06be60 0x7f7d9c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:42.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.264+0000 7f7dbb7fe640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d9c06be60 0x7f7d9c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:42.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.264+0000 7f7db3fff640 1 -- 172.21.15.60:0/3283422757 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5357+0+0 (secure 0 0 0) 0x7f7db408a250 con 0x7f7dbc15e570 2024-09-12T01:43:42.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.264+0000 7f7dbb7fe640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d9c06be60 0x7f7d9c06e320 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0cc9f0 tx=0x7f7dac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:42.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.268+0000 7f7db3fff640 1 -- 172.21.15.60:0/3283422757 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7db4058690 con 0x7f7dbc15e570 2024-09-12T01:43:42.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:42.446+0000 7f7dc21af640 1 -- 172.21.15.60:0/3283422757 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7dbc0b4020 con 0x7f7dbc15e570 2024-09-12T01:43:43.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.138+0000 7f7db3fff640 1 -- 172.21.15.60:0/3283422757 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v120) ==== 169+0+0 (secure 0 0 0) 0x7f7db405c990 con 0x7f7dbc15e570 2024-09-12T01:43:43.138 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-12T01:43:43.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.143+0000 7f7dc21af640 1 -- 172.21.15.60:0/3283422757 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d9c06be60 msgr2=0x7f7d9c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.142 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.143+0000 7f7dc21af640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d9c06be60 0x7f7d9c06e320 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0cc9f0 tx=0x7f7dac008040 comp rx=0 tx=0).stop 2024-09-12T01:43:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.143+0000 7f7dc21af640 1 -- 172.21.15.60:0/3283422757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dbc15e570 msgr2=0x7f7dbc0cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.143+0000 7f7dc21af640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dbc15e570 0x7f7dbc0cca60 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f7db400c7a0 tx=0x7f7db400cc60 comp rx=0 tx=0).stop 2024-09-12T01:43:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.143+0000 7f7dc21af640 1 -- 172.21.15.60:0/3283422757 shutdown_connections 2024-09-12T01:43:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.143+0000 7f7dc21af640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7dbc15e570 0x7f7dbc0cca60 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.143+0000 7f7dc21af640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7d9c06be60 0x7f7d9c06e320 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.143+0000 7f7dc21af640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7dbc0714a0 0x7f7dbc0d1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.143+0000 7f7dc21af640 1 --2- 172.21.15.60:0/3283422757 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7dbc06f400 0x7f7dbc0ce200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.143+0000 7f7dc21af640 1 -- 172.21.15.60:0/3283422757 >> 172.21.15.60:0/3283422757 conn(0x7f7dbc0b4240 msgr2=0x7f7dbc160480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.143+0000 7f7dc21af640 1 -- 172.21.15.60:0/3283422757 shutdown_connections 2024-09-12T01:43:43.143 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.143+0000 7f7dc21af640 1 -- 172.21.15.60:0/3283422757 wait complete. 2024-09-12T01:43:43.158 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_min_caps_working_set 2024-09-12T01:43:43.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.270+0000 7f2f60d03640 1 Processor -- start 2024-09-12T01:43:43.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.270+0000 7f2f60d03640 1 -- start start 2024-09-12T01:43:43.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.271+0000 7f2f60d03640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2f5c15e7a0 0x7f2f5c06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.271+0000 7f2f60d03640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f5c0b68f0 0x7f2f5c0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.271+0000 7f2f60d03640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5c0cf860 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.271+0000 7f2f60d03640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5c0d2ca0 con 0x7f2f5c0b68f0 2024-09-12T01:43:43.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.271+0000 7f2f60d03640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2f5c0cfb40 con 0x7f2f5c15e7a0 2024-09-12T01:43:43.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.272+0000 7f2f5ad9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f5c0b68f0 0x7f2f5c0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.272+0000 7f2f5ad9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f5c0b68f0 0x7f2f5c0d3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37042/0 (socket says 172.21.15.60:37042) 2024-09-12T01:43:43.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.272+0000 7f2f5ad9d640 1 -- 172.21.15.60:0/1101443503 learned_addr learned my addr 172.21.15.60:0/1101443503 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:43.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.272+0000 7f2f5a59c640 1 --2- 172.21.15.60:0/1101443503 >> v2:172.21.15.105:3300/0 conn(0x7f2f5c15e7a0 0x7f2f5c06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.272+0000 7f2f5ad9d640 1 -- 172.21.15.60:0/1101443503 >> v2:172.21.15.105:3300/0 conn(0x7f2f5c15e7a0 msgr2=0x7f2f5c06caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:43.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.272+0000 7f2f5ad9d640 1 --2- 172.21.15.60:0/1101443503 >> v2:172.21.15.105:3300/0 conn(0x7f2f5c15e7a0 0x7f2f5c06caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.272+0000 7f2f5ad9d640 1 -- 172.21.15.60:0/1101443503 >> v1:172.21.15.105:6789/0 conn(0x7f2f5c0cf1f0 legacy=0x7f2f5c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.272+0000 7f2f5ad9d640 1 -- 172.21.15.60:0/1101443503 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c0cfe20 con 0x7f2f5c0b68f0 2024-09-12T01:43:43.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.273+0000 7f2f5ad9d640 1 --2- 172.21.15.60:0/1101443503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0b68f0 0x7f2f5c0d3410 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0d5820 tx=0x7f2f5402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52aa35a37ea78727 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:43.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.273+0000 7f2f5959a640 1 -- 172.21.15.60:0/1101443503 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f54036070 con 0x7f2f5c0b68f0 2024-09-12T01:43:43.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.273+0000 7f2f5959a640 1 -- 172.21.15.60:0/1101443503 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f54031600 con 0x7f2f5c0b68f0 2024-09-12T01:43:43.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.273+0000 7f2f5959a640 1 -- 172.21.15.60:0/1101443503 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f540319d0 con 0x7f2f5c0b68f0 2024-09-12T01:43:43.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.273+0000 7f2f60d03640 1 -- 172.21.15.60:0/1101443503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0b68f0 msgr2=0x7f2f5c0d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.273+0000 7f2f60d03640 1 --2- 172.21.15.60:0/1101443503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0b68f0 0x7f2f5c0d3410 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0d5820 tx=0x7f2f5402a6a0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.273+0000 7f2f60d03640 1 -- 172.21.15.60:0/1101443503 shutdown_connections 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.273+0000 7f2f60d03640 1 --2- 172.21.15.60:0/1101443503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0b68f0 0x7f2f5c0d3410 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.273+0000 7f2f60d03640 1 --2- 172.21.15.60:0/1101443503 >> v2:172.21.15.105:3300/0 conn(0x7f2f5c15e7a0 0x7f2f5c06caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.273+0000 7f2f60d03640 1 -- 172.21.15.60:0/1101443503 >> 172.21.15.60:0/1101443503 conn(0x7f2f5c0d11e0 msgr2=0x7f2f5c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.274+0000 7f2f60d03640 1 -- 172.21.15.60:0/1101443503 shutdown_connections 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.274+0000 7f2f60d03640 1 -- 172.21.15.60:0/1101443503 wait complete. 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.275+0000 7f2f60d03640 1 Processor -- start 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.275+0000 7f2f60d03640 1 -- start start 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f60d03640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f5c0b68f0 0x7f2f5c1493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f60d03640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0cf1f0 0x7f2f5c0c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f60d03640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f5c15e7a0 0x7f2f5c15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f60d03640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c06cfe0 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f60d03640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c0b7a00 con 0x7f2f5c0b68f0 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f60d03640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2f5c15eb80 con 0x7f2f5c15e7a0 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f59d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0cf1f0 0x7f2f5c0c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f59d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0cf1f0 0x7f2f5c0c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37050/0 (socket says 172.21.15.60:37050) 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f59d9b640 1 -- 172.21.15.60:0/2546731874 learned_addr learned my addr 172.21.15.60:0/2546731874 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f5a59c640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f5c0b68f0 0x7f2f5c1493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f5ad9d640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f5c15e7a0 0x7f2f5c15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f59d9b640 1 -- 172.21.15.60:0/2546731874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f5c15e7a0 msgr2=0x7f2f5c15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f59d9b640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f5c15e7a0 0x7f2f5c15ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f59d9b640 1 -- 172.21.15.60:0/2546731874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f5c0b68f0 msgr2=0x7f2f5c1493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f59d9b640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f5c0b68f0 0x7f2f5c1493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f59d9b640 1 -- 172.21.15.60:0/2546731874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c15f8c0 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f59d9b640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0cf1f0 0x7f2f5c0c78e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000c450 tx=0x7f2f5000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:43.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f4affd640 1 -- 172.21.15.60:0/2546731874 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f500052d0 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f4affd640 1 -- 172.21.15.60:0/2546731874 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f50005470 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f60d03640 1 -- 172.21.15.60:0/2546731874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c15fba0 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.276+0000 7f2f4affd640 1 -- 172.21.15.60:0/2546731874 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f50012870 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.277+0000 7f2f60d03640 1 -- 172.21.15.60:0/2546731874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c148ba0 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.277+0000 7f2f60d03640 1 -- 172.21.15.60:0/2546731874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c06caa0 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.278+0000 7f2f4affd640 1 -- 172.21.15.60:0/2546731874 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2f50012a10 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.278+0000 7f2f4affd640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f3c06be60 0x7f2f3c06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.279+0000 7f2f4affd640 1 -- 172.21.15.60:0/2546731874 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4943+0+0 (secure 0 0 0) 0x7f2f5008a600 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.279+0000 7f2f5a59c640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f3c06be60 0x7f2f3c06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.279+0000 7f2f5a59c640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f3c06be60 0x7f2f3c06e320 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009b40 tx=0x7f2f4c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:43.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.283+0000 7f2f4affd640 1 -- 172.21.15.60:0/2546731874 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2f50058c60 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.465 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.465+0000 7f2f60d03640 1 -- 172.21.15.60:0/2546731874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"} v 0) -- 0x7f2f5c15cc00 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.468 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.469+0000 7f2f4affd640 1 -- 172.21.15.60:0/2546731874 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"}]=0 v51) ==== 107+0+0 (secure 0 0 0) 0x7f2f5005cf60 con 0x7f2f5c0cf1f0 2024-09-12T01:43:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.471+0000 7f2f60d03640 1 -- 172.21.15.60:0/2546731874 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f3c06be60 msgr2=0x7f2f3c06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.471+0000 7f2f60d03640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f3c06be60 0x7f2f3c06e320 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c009b40 tx=0x7f2f4c009190 comp rx=0 tx=0).stop 2024-09-12T01:43:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.471+0000 7f2f60d03640 1 -- 172.21.15.60:0/2546731874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0cf1f0 msgr2=0x7f2f5c0c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.471+0000 7f2f60d03640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0cf1f0 0x7f2f5c0c78e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2f5000c450 tx=0x7f2f5000c910 comp rx=0 tx=0).stop 2024-09-12T01:43:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.471+0000 7f2f60d03640 1 -- 172.21.15.60:0/2546731874 shutdown_connections 2024-09-12T01:43:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.471+0000 7f2f60d03640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2f3c06be60 0x7f2f3c06e320 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.471+0000 7f2f60d03640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2f5c15e7a0 0x7f2f5c15ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.471+0000 7f2f60d03640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f5c0cf1f0 0x7f2f5c0c78e0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.471+0000 7f2f60d03640 1 --2- 172.21.15.60:0/2546731874 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2f5c0b68f0 0x7f2f5c1493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.471+0000 7f2f60d03640 1 -- 172.21.15.60:0/2546731874 >> 172.21.15.60:0/2546731874 conn(0x7f2f5c0d11e0 msgr2=0x7f2f5c15d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:43.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.471+0000 7f2f60d03640 1 -- 172.21.15.60:0/2546731874 shutdown_connections 2024-09-12T01:43:43.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.471+0000 7f2f60d03640 1 -- 172.21.15.60:0/2546731874 wait complete. 2024-09-12T01:43:43.482 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_memory_limit 2024-09-12T01:43:43.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.587+0000 7ff744c23640 1 Processor -- start 2024-09-12T01:43:43.586 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.587+0000 7ff744c23640 1 -- start start 2024-09-12T01:43:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff744c23640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400b64a0 0x7ff7400b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff744c23640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff7400b7f50 0x7ff7400b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff744c23640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7400b7790 con 0x7ff74015e750 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff744c23640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff7400d43c0 con 0x7ff7400b7f50 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff744c23640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff7400d33b0 con 0x7ff7400b64a0 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff73e59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff74015e750 0x7ff7400cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59488/0 (socket says 172.21.15.60:59488) 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff73e59c640 1 -- 172.21.15.60:0/1436337476 learned_addr learned my addr 172.21.15.60:0/1436337476 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff73ed9d640 1 --2- 172.21.15.60:0/1436337476 >> v2:172.21.15.105:3300/0 conn(0x7ff7400b7f50 0x7ff7400b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff735d9b640 1 --2- 172.21.15.60:0/1436337476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400b64a0 0x7ff7400b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235123858 0 0) 0x7ff7400b7790 con 0x7ff74015e750 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff72c003520 con 0x7ff74015e750 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3405199952 0 0) 0x7ff72c003520 con 0x7ff74015e750 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400b64a0 msgr2=0x7ff7400b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff73dd9b640 1 --2- 172.21.15.60:0/1436337476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400b64a0 0x7ff7400b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 >> v2:172.21.15.105:3300/0 conn(0x7ff7400b7f50 msgr2=0x7ff7400b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff73dd9b640 1 --2- 172.21.15.60:0/1436337476 >> v2:172.21.15.105:3300/0 conn(0x7ff7400b7f50 0x7ff7400b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7400d3600 con 0x7ff74015e750 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.588+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7ff730001690 con 0x7ff74015e750 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 >> v1:172.21.15.60:6789/0 conn(0x7ff74015e750 legacy=0x7ff7400cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73dd9b640 1 --2- 172.21.15.60:0/1436337476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400b64a0 0x7ff72c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73dd9b640 1 --2- 172.21.15.60:0/1436337476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff72c003f30 0x7ff72c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73dd9b640 1 --2- 172.21.15.60:0/1436337476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff72c004d40 0x7ff72c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff7400d43c0 con 0x7ff72c004d40 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7400d33b0 con 0x7ff72c003f30 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff72c00b9c0 con 0x7ff7400b64a0 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73ed9d640 1 --2- 172.21.15.60:0/1436337476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff72c004d40 0x7ff72c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73e59c640 1 --2- 172.21.15.60:0/1436337476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400b64a0 0x7ff72c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff735d9b640 1 --2- 172.21.15.60:0/1436337476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff72c003f30 0x7ff72c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73ed9d640 1 -- 172.21.15.60:0/1436337476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400b64a0 msgr2=0x7ff72c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:43.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73ed9d640 1 --2- 172.21.15.60:0/1436337476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400b64a0 0x7ff72c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73ed9d640 1 -- 172.21.15.60:0/1436337476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff72c003f30 msgr2=0x7ff72c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:43.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73ed9d640 1 --2- 172.21.15.60:0/1436337476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff72c003f30 0x7ff72c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.589+0000 7ff73ed9d640 1 -- 172.21.15.60:0/1436337476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72c003520 con 0x7ff72c004d40 2024-09-12T01:43:43.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.590+0000 7ff73ed9d640 1 --2- 172.21.15.60:0/1436337476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff72c004d40 0x7ff72c0051c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7ff738009fc0 tx=0x7ff72c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcc9d7ab1bb84b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:43.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.590+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738009c10 con 0x7ff72c004d40 2024-09-12T01:43:43.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.590+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff738036070 con 0x7ff72c004d40 2024-09-12T01:43:43.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.590+0000 7ff73dd9b640 1 -- 172.21.15.60:0/1436337476 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73802d070 con 0x7ff72c004d40 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.590+0000 7ff744c23640 1 -- 172.21.15.60:0/1436337476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff72c004d40 msgr2=0x7ff72c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.590+0000 7ff744c23640 1 --2- 172.21.15.60:0/1436337476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff72c004d40 0x7ff72c0051c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7ff738009fc0 tx=0x7ff72c005830 comp rx=0 tx=0).stop 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.590+0000 7ff73ed9d640 1 -- 172.21.15.60:0/1436337476 reap_dead start 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.590+0000 7ff744c23640 1 -- 172.21.15.60:0/1436337476 shutdown_connections 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.590+0000 7ff744c23640 1 -- 172.21.15.60:0/1436337476 >> 172.21.15.60:0/1436337476 conn(0x7ff7400d1500 msgr2=0x7ff7400d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.591+0000 7ff744c23640 1 -- 172.21.15.60:0/1436337476 shutdown_connections 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.591+0000 7ff744c23640 1 -- 172.21.15.60:0/1436337476 wait complete. 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.592+0000 7ff744c23640 1 Processor -- start 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.592+0000 7ff744c23640 1 -- start start 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff744c23640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff740151660 0x7ff7400ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff744c23640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400ce2d0 0x7ff740160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff744c23640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7401614b0 0x7ff7401f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff744c23640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff7400d3bc0 con 0x7ff7401614b0 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff744c23640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff7400b7ac0 con 0x7ff740151660 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff744c23640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff74015eb30 con 0x7ff7400ce2d0 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff73ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7401614b0 0x7ff7401f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff73ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7401614b0 0x7ff7401f48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37066/0 (socket says 172.21.15.60:37066) 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff73ed9d640 1 -- 172.21.15.60:0/4294325152 learned_addr learned my addr 172.21.15.60:0/4294325152 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff735d9b640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400ce2d0 0x7ff740160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff73e59c640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff740151660 0x7ff7400ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff73ed9d640 1 -- 172.21.15.60:0/4294325152 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400ce2d0 msgr2=0x7ff740160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff73ed9d640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400ce2d0 0x7ff740160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff73ed9d640 1 -- 172.21.15.60:0/4294325152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff740151660 msgr2=0x7ff7400ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff73ed9d640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff740151660 0x7ff7400ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff73ed9d640 1 -- 172.21.15.60:0/4294325152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7400cd230 con 0x7ff7401614b0 2024-09-12T01:43:43.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff73e59c640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff740151660 0x7ff7400ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.593+0000 7ff73ed9d640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7401614b0 0x7ff7401f48b0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7ff738033040 tx=0x7ff738009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.594+0000 7ff7377fe640 1 -- 172.21.15.60:0/4294325152 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738009c10 con 0x7ff7401614b0 2024-09-12T01:43:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.594+0000 7ff7377fe640 1 -- 172.21.15.60:0/4294325152 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff738003bb0 con 0x7ff7401614b0 2024-09-12T01:43:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.594+0000 7ff744c23640 1 -- 172.21.15.60:0/4294325152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7400cd510 con 0x7ff7401614b0 2024-09-12T01:43:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.594+0000 7ff7377fe640 1 -- 172.21.15.60:0/4294325152 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff738004020 con 0x7ff7401614b0 2024-09-12T01:43:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.594+0000 7ff744c23640 1 -- 172.21.15.60:0/4294325152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7400cdad0 con 0x7ff7401614b0 2024-09-12T01:43:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.595+0000 7ff744c23640 1 -- 172.21.15.60:0/4294325152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7400b68e0 con 0x7ff7401614b0 2024-09-12T01:43:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.595+0000 7ff7377fe640 1 -- 172.21.15.60:0/4294325152 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff738005d10 con 0x7ff7401614b0 2024-09-12T01:43:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.595+0000 7ff7377fe640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff72006be60 0x7ff72006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.596+0000 7ff7377fe640 1 -- 172.21.15.60:0/4294325152 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4943+0+0 (secure 0 0 0) 0x7ff7380abf50 con 0x7ff7401614b0 2024-09-12T01:43:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.596+0000 7ff73e59c640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff72006be60 0x7ff72006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.598 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.596+0000 7ff73e59c640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff72006be60 0x7ff72006e320 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff730001050 tx=0x7ff730009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:43.599 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.600+0000 7ff7377fe640 1 -- 172.21.15.60:0/4294325152 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff73804a060 con 0x7ff7401614b0 2024-09-12T01:43:43.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.773+0000 7ff744c23640 1 -- 172.21.15.60:0/4294325152 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"} v 0) -- 0x7ff7400b6da0 con 0x7ff7401614b0 2024-09-12T01:43:43.775 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.776+0000 7ff7377fe640 1 -- 172.21.15.60:0/4294325152 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"}]=0 v52) ==== 105+0+0 (secure 0 0 0) 0x7ff73807ac90 con 0x7ff7401614b0 2024-09-12T01:43:43.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.778+0000 7ff744c23640 1 -- 172.21.15.60:0/4294325152 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff72006be60 msgr2=0x7ff72006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.778 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.778+0000 7ff744c23640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff72006be60 0x7ff72006e320 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff730001050 tx=0x7ff730009040 comp rx=0 tx=0).stop 2024-09-12T01:43:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.778+0000 7ff744c23640 1 -- 172.21.15.60:0/4294325152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7401614b0 msgr2=0x7ff7401f48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.778+0000 7ff744c23640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7401614b0 0x7ff7401f48b0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7ff738033040 tx=0x7ff738009750 comp rx=0 tx=0).stop 2024-09-12T01:43:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.779+0000 7ff744c23640 1 -- 172.21.15.60:0/4294325152 shutdown_connections 2024-09-12T01:43:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.779+0000 7ff744c23640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7401614b0 0x7ff7401f48b0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.779+0000 7ff744c23640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff72006be60 0x7ff72006e320 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.779+0000 7ff744c23640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7400ce2d0 0x7ff740160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.779+0000 7ff744c23640 1 --2- 172.21.15.60:0/4294325152 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff740151660 0x7ff7400ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.779+0000 7ff744c23640 1 -- 172.21.15.60:0/4294325152 >> 172.21.15.60:0/4294325152 conn(0x7ff7400d1500 msgr2=0x7ff7400b8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.779+0000 7ff744c23640 1 -- 172.21.15.60:0/4294325152 shutdown_connections 2024-09-12T01:43:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.779+0000 7ff744c23640 1 -- 172.21.15.60:0/4294325152 wait complete. 2024-09-12T01:43:43.789 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T01:43:43.893 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.894+0000 7ffb736f1640 1 Processor -- start 2024-09-12T01:43:43.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.894+0000 7ffb736f1640 1 -- start start 2024-09-12T01:43:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.895+0000 7ffb736f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c15e750 0x7ffb6c0cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.895+0000 7ffb736f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6c0b7790 con 0x7ffb6c0cfb70 2024-09-12T01:43:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.895+0000 7ffb736f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6c0d3600 con 0x7ffb6c0b6bb0 2024-09-12T01:43:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.895+0000 7ffb736f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6c0d43c0 con 0x7ffb6c15e750 2024-09-12T01:43:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.895+0000 7ffb70c8c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ffb6c0cfb70 0x7ffb6c0b64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59492/0 (socket says 172.21.15.60:59492) 2024-09-12T01:43:43.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.895+0000 7ffb70c8c640 1 -- 172.21.15.60:0/3969329009 learned_addr learned my addr 172.21.15.60:0/3969329009 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:43.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.895+0000 7ffb7148d640 1 --2- 172.21.15.60:0/3969329009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c15e750 0x7ffb6c0cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.895+0000 7ffb6bfff640 1 -- 172.21.15.60:0/3969329009 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248546639 0 0) 0x7ffb6c0b7790 con 0x7ffb6c0cfb70 2024-09-12T01:43:43.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.895+0000 7ffb6bfff640 1 -- 172.21.15.60:0/3969329009 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb54003520 con 0x7ffb6c0cfb70 2024-09-12T01:43:43.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.896+0000 7ffb6bfff640 1 -- 172.21.15.60:0/3969329009 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158019904 0 0) 0x7ffb6c0d3600 con 0x7ffb6c0b6bb0 2024-09-12T01:43:43.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.896+0000 7ffb6bfff640 1 -- 172.21.15.60:0/3969329009 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb6c0b7790 con 0x7ffb6c0b6bb0 2024-09-12T01:43:43.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.896+0000 7ffb7148d640 1 -- 172.21.15.60:0/3969329009 >> v1:172.21.15.105:6789/0 conn(0x7ffb6c0b6bb0 legacy=0x7ffb6c0b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.896+0000 7ffb6bfff640 1 -- 172.21.15.60:0/3969329009 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3683616497 0 0) 0x7ffb54003520 con 0x7ffb6c0cfb70 2024-09-12T01:43:43.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.896+0000 7ffb7148d640 1 -- 172.21.15.60:0/3969329009 >> v1:172.21.15.60:6789/0 conn(0x7ffb6c0cfb70 legacy=0x7ffb6c0b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.896 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.896+0000 7ffb7148d640 1 -- 172.21.15.60:0/3969329009 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c0d38e0 con 0x7ffb6c15e750 2024-09-12T01:43:43.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.896+0000 7ffb7148d640 1 --2- 172.21.15.60:0/3969329009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c15e750 0x7ffb6c0cf630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009dc0 tx=0x7ffb5c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ff5283610729a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:43.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.897+0000 7ffb6bfff640 1 -- 172.21.15.60:0/3969329009 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb60001690 con 0x7ffb6c15e750 2024-09-12T01:43:43.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.897+0000 7ffb6bfff640 1 -- 172.21.15.60:0/3969329009 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5c007540 con 0x7ffb6c15e750 2024-09-12T01:43:43.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.897+0000 7ffb6bfff640 1 -- 172.21.15.60:0/3969329009 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c007910 con 0x7ffb6c15e750 2024-09-12T01:43:43.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.897+0000 7ffb736f1640 1 -- 172.21.15.60:0/3969329009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c15e750 msgr2=0x7ffb6c0cf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.897+0000 7ffb736f1640 1 --2- 172.21.15.60:0/3969329009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c15e750 0x7ffb6c0cf630 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c009dc0 tx=0x7ffb5c02a5d0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.897+0000 7ffb736f1640 1 -- 172.21.15.60:0/3969329009 shutdown_connections 2024-09-12T01:43:43.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.897+0000 7ffb736f1640 1 --2- 172.21.15.60:0/3969329009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c15e750 0x7ffb6c0cf630 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.897+0000 7ffb736f1640 1 -- 172.21.15.60:0/3969329009 >> 172.21.15.60:0/3969329009 conn(0x7ffb6c0d1500 msgr2=0x7ffb6c0d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:43.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.897+0000 7ffb736f1640 1 -- 172.21.15.60:0/3969329009 shutdown_connections 2024-09-12T01:43:43.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.897+0000 7ffb736f1640 1 -- 172.21.15.60:0/3969329009 wait complete. 2024-09-12T01:43:43.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.899+0000 7ffb736f1640 1 Processor -- start 2024-09-12T01:43:43.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.899+0000 7ffb736f1640 1 -- start start 2024-09-12T01:43:43.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.899+0000 7ffb736f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb6c0b6bb0 0x7ffb6c14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.899+0000 7ffb736f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c0cfb70 0x7ffb6c1f8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.899+0000 7ffb736f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c15e750 0x7ffb6c0ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.899+0000 7ffb736f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c0b7ac0 con 0x7ffb6c15e750 2024-09-12T01:43:43.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.899+0000 7ffb736f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c0d33b0 con 0x7ffb6c0b6bb0 2024-09-12T01:43:43.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.899+0000 7ffb736f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6c15eb30 con 0x7ffb6c0cfb70 2024-09-12T01:43:43.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.899+0000 7ffb71c8e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c15e750 0x7ffb6c0ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb71c8e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c15e750 0x7ffb6c0ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37070/0 (socket says 172.21.15.60:37070) 2024-09-12T01:43:43.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb71c8e640 1 -- 172.21.15.60:0/3123084806 learned_addr learned my addr 172.21.15.60:0/3123084806 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:43.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb7148d640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb6c0b6bb0 0x7ffb6c14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb70c8c640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c0cfb70 0x7ffb6c1f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb71c8e640 1 -- 172.21.15.60:0/3123084806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c0cfb70 msgr2=0x7ffb6c1f8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb71c8e640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c0cfb70 0x7ffb6c1f8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb71c8e640 1 -- 172.21.15.60:0/3123084806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb6c0b6bb0 msgr2=0x7ffb6c14d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb71c8e640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb6c0b6bb0 0x7ffb6c14d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb71c8e640 1 -- 172.21.15.60:0/3123084806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c0ab620 con 0x7ffb6c15e750 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb7148d640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb6c0b6bb0 0x7ffb6c14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb71c8e640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c15e750 0x7ffb6c0ab0e0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400c430 tx=0x7ffb6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb69ffb640 1 -- 172.21.15.60:0/3123084806 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64017070 con 0x7ffb6c15e750 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb69ffb640 1 -- 172.21.15.60:0/3123084806 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb640052d0 con 0x7ffb6c15e750 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb736f1640 1 -- 172.21.15.60:0/3123084806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6c1eaa60 con 0x7ffb6c15e750 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb69ffb640 1 -- 172.21.15.60:0/3123084806 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb64003830 con 0x7ffb6c15e750 2024-09-12T01:43:43.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.900+0000 7ffb736f1640 1 -- 172.21.15.60:0/3123084806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb6c14c940 con 0x7ffb6c15e750 2024-09-12T01:43:43.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.901+0000 7ffb736f1640 1 -- 172.21.15.60:0/3123084806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb6c0cf630 con 0x7ffb6c15e750 2024-09-12T01:43:43.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.902+0000 7ffb69ffb640 1 -- 172.21.15.60:0/3123084806 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffb6401a070 con 0x7ffb6c15e750 2024-09-12T01:43:43.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.902+0000 7ffb69ffb640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb5806be30 0x7ffb5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:43.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.903+0000 7ffb69ffb640 1 -- 172.21.15.60:0/3123084806 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4943+0+0 (secure 0 0 0) 0x7ffb6408a050 con 0x7ffb6c15e750 2024-09-12T01:43:43.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.903+0000 7ffb7148d640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb5806be30 0x7ffb5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:43.904 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.903+0000 7ffb7148d640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb5806be30 0x7ffb5806e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c034000 tx=0x7ffb5c02f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:43.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:43.907+0000 7ffb69ffb640 1 -- 172.21.15.60:0/3123084806 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffb64058c70 con 0x7ffb6c15e750 2024-09-12T01:43:44.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.081+0000 7ffb736f1640 1 -- 172.21.15.60:0/3123084806 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7ffb6c06d050 con 0x7ffb6c15e750 2024-09-12T01:43:44.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.085+0000 7ffb69ffb640 1 -- 172.21.15.60:0/3123084806 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v53) ==== 104+0+0 (secure 0 0 0) 0x7ffb64058570 con 0x7ffb6c15e750 2024-09-12T01:43:44.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.091+0000 7ffb736f1640 1 -- 172.21.15.60:0/3123084806 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb5806be30 msgr2=0x7ffb5806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.091+0000 7ffb736f1640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb5806be30 0x7ffb5806e2f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c034000 tx=0x7ffb5c02f000 comp rx=0 tx=0).stop 2024-09-12T01:43:44.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.091+0000 7ffb736f1640 1 -- 172.21.15.60:0/3123084806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c15e750 msgr2=0x7ffb6c0ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.091+0000 7ffb736f1640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c15e750 0x7ffb6c0ab0e0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ffb6400c430 tx=0x7ffb6400c8f0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.091+0000 7ffb736f1640 1 -- 172.21.15.60:0/3123084806 shutdown_connections 2024-09-12T01:43:44.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.091+0000 7ffb736f1640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb6c15e750 0x7ffb6c0ab0e0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.091+0000 7ffb736f1640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffb5806be30 0x7ffb5806e2f0 secure :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c034000 tx=0x7ffb5c02f000 comp rx=0 tx=0).stop 2024-09-12T01:43:44.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.091+0000 7ffb736f1640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb6c0cfb70 0x7ffb6c1f8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.091+0000 7ffb736f1640 1 --2- 172.21.15.60:0/3123084806 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb6c0b6bb0 0x7ffb6c14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.091+0000 7ffb736f1640 1 -- 172.21.15.60:0/3123084806 >> 172.21.15.60:0/3123084806 conn(0x7ffb6c0d1500 msgr2=0x7ffb6c0b92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:44.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.092+0000 7ffb736f1640 1 -- 172.21.15.60:0/3123084806 shutdown_connections 2024-09-12T01:43:44.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.092+0000 7ffb736f1640 1 -- 172.21.15.60:0/3123084806 wait complete. 2024-09-12T01:43:44.104 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_max_caps 2024-09-12T01:43:44.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.209+0000 7f9eedd9a640 1 Processor -- start 2024-09-12T01:43:44.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.209+0000 7f9eedd9a640 1 -- start start 2024-09-12T01:43:44.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9eedd9a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ee80b64a0 0x7f9ee80b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9eedd9a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ee80b7f50 0x7f9ee80b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9eedd9a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee80b7790 con 0x7f9ee815e750 2024-09-12T01:43:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9eedd9a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f9ee80d43c0 con 0x7f9ee80b7f50 2024-09-12T01:43:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9eedd9a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee80d33b0 con 0x7f9ee80b64a0 2024-09-12T01:43:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9ee7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ee80b7f50 0x7f9ee80b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9ee7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ee80b7f50 0x7f9ee80b83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37084/0 (socket says 172.21.15.60:37084) 2024-09-12T01:43:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9ee77fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9ee815e750 0x7f9ee80cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59502/0 (socket says 172.21.15.60:59502) 2024-09-12T01:43:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9ee7fff640 1 -- 172.21.15.60:0/4276872435 learned_addr learned my addr 172.21.15.60:0/4276872435 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9ee6ffd640 1 --2- 172.21.15.60:0/4276872435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ee80b64a0 0x7f9ee80b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9ee7fff640 1 -- 172.21.15.60:0/4276872435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ee80b64a0 msgr2=0x7f9ee80b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9ee7fff640 1 --2- 172.21.15.60:0/4276872435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ee80b64a0 0x7f9ee80b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9ee7fff640 1 -- 172.21.15.60:0/4276872435 >> v1:172.21.15.60:6789/0 conn(0x7f9ee815e750 legacy=0x7f9ee80cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9ee67fc640 1 -- 172.21.15.60:0/4276872435 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3000291143 0 0) 0x7f9ee80b7790 con 0x7f9ee815e750 2024-09-12T01:43:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.210+0000 7f9ee7fff640 1 -- 172.21.15.60:0/4276872435 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee80d3600 con 0x7f9ee80b7f50 2024-09-12T01:43:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.211+0000 7f9ee7fff640 1 --2- 172.21.15.60:0/4276872435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b7f50 0x7f9ee80b83e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009e50 tx=0x7f9ee002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ba04358fee54dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.211+0000 7f9ee67fc640 1 -- 172.21.15.60:0/4276872435 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0036070 con 0x7f9ee80b7f50 2024-09-12T01:43:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.211+0000 7f9ee67fc640 1 -- 172.21.15.60:0/4276872435 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee0031600 con 0x7f9ee80b7f50 2024-09-12T01:43:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.211+0000 7f9ee67fc640 1 -- 172.21.15.60:0/4276872435 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00319d0 con 0x7f9ee80b7f50 2024-09-12T01:43:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.212+0000 7f9eedd9a640 1 -- 172.21.15.60:0/4276872435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b7f50 msgr2=0x7f9ee80b83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.212+0000 7f9eedd9a640 1 --2- 172.21.15.60:0/4276872435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b7f50 0x7f9ee80b83e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009e50 tx=0x7f9ee002a710 comp rx=0 tx=0).stop 2024-09-12T01:43:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.212+0000 7f9eedd9a640 1 -- 172.21.15.60:0/4276872435 shutdown_connections 2024-09-12T01:43:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.212+0000 7f9eedd9a640 1 --2- 172.21.15.60:0/4276872435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b7f50 0x7f9ee80b83e0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.212+0000 7f9eedd9a640 1 --2- 172.21.15.60:0/4276872435 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ee80b64a0 0x7f9ee80b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.212+0000 7f9eedd9a640 1 -- 172.21.15.60:0/4276872435 >> 172.21.15.60:0/4276872435 conn(0x7f9ee80d1500 msgr2=0x7f9ee80d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.212+0000 7f9eedd9a640 1 -- 172.21.15.60:0/4276872435 shutdown_connections 2024-09-12T01:43:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.212+0000 7f9eedd9a640 1 -- 172.21.15.60:0/4276872435 wait complete. 2024-09-12T01:43:44.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.213+0000 7f9eedd9a640 1 Processor -- start 2024-09-12T01:43:44.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.213+0000 7f9eedd9a640 1 -- start start 2024-09-12T01:43:44.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9eedd9a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b64a0 0x7f9ee8160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9eedd9a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ee80b7f50 0x7f9ee80ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9eedd9a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ee815e750 0x7f9ee815af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9eedd9a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee80b6e20 con 0x7f9ee80b64a0 2024-09-12T01:43:44.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9eedd9a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee80b7ac0 con 0x7f9ee80b7f50 2024-09-12T01:43:44.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9eedd9a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee80d3bc0 con 0x7f9ee815e750 2024-09-12T01:43:44.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9ee77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b64a0 0x7f9ee8160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9ee77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b64a0 0x7f9ee8160ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37090/0 (socket says 172.21.15.60:37090) 2024-09-12T01:43:44.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9ee77fe640 1 -- 172.21.15.60:0/3834115131 learned_addr learned my addr 172.21.15.60:0/3834115131 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:44.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9ee7fff640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ee815e750 0x7f9ee815af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9ee6ffd640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ee80b7f50 0x7f9ee80ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9ee77fe640 1 -- 172.21.15.60:0/3834115131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ee815e750 msgr2=0x7f9ee815af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9ee77fe640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ee815e750 0x7f9ee815af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9ee77fe640 1 -- 172.21.15.60:0/3834115131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ee80b7f50 msgr2=0x7f9ee80ce5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9ee77fe640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ee80b7f50 0x7f9ee80ce5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9ee77fe640 1 -- 172.21.15.60:0/3834115131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee8159f00 con 0x7f9ee80b64a0 2024-09-12T01:43:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.214+0000 7f9ee77fe640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b64a0 0x7f9ee8160ce0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800c410 tx=0x7f9ed800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.215+0000 7f9edffff640 1 -- 172.21.15.60:0/3834115131 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80074e0 con 0x7f9ee80b64a0 2024-09-12T01:43:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.215+0000 7f9edffff640 1 -- 172.21.15.60:0/3834115131 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed8007680 con 0x7f9ee80b64a0 2024-09-12T01:43:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.215+0000 7f9eedd9a640 1 -- 172.21.15.60:0/3834115131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee815a470 con 0x7f9ee80b64a0 2024-09-12T01:43:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.215+0000 7f9edffff640 1 -- 172.21.15.60:0/3834115131 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8004a00 con 0x7f9ee80b64a0 2024-09-12T01:43:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.215+0000 7f9eedd9a640 1 -- 172.21.15.60:0/3834115131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee815aa30 con 0x7f9ee80b64a0 2024-09-12T01:43:44.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.216+0000 7f9eedd9a640 1 -- 172.21.15.60:0/3834115131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee815ac30 con 0x7f9ee80b64a0 2024-09-12T01:43:44.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.216+0000 7f9edffff640 1 -- 172.21.15.60:0/3834115131 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ed801a020 con 0x7f9ee80b64a0 2024-09-12T01:43:44.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.217+0000 7f9edffff640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9ec806be30 0x7f9ec806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.217+0000 7f9edffff640 1 -- 172.21.15.60:0/3834115131 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4943+0+0 (secure 0 0 0) 0x7f9ed808a440 con 0x7f9ee80b64a0 2024-09-12T01:43:44.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.217+0000 7f9ee6ffd640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9ec806be30 0x7f9ec806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.218 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.217+0000 7f9ee6ffd640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9ec806be30 0x7f9ec806e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80cba50 tx=0x7f9ed0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:44.220 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.221+0000 7f9edffff640 1 -- 172.21.15.60:0/3834115131 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9ed8010300 con 0x7f9ee80b64a0 2024-09-12T01:43:44.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.396+0000 7f9eedd9a640 1 -- 172.21.15.60:0/3834115131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"} v 0) -- 0x7f9ee815eb30 con 0x7f9ee80b64a0 2024-09-12T01:43:44.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.399+0000 7f9edffff640 1 -- 172.21.15.60:0/3834115131 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"}]=0 v54) ==== 102+0+0 (secure 0 0 0) 0x7f9ed8059050 con 0x7f9ee80b64a0 2024-09-12T01:43:44.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.402+0000 7f9eedd9a640 1 -- 172.21.15.60:0/3834115131 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9ec806be30 msgr2=0x7f9ec806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.402+0000 7f9eedd9a640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9ec806be30 0x7f9ec806e2f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9ee80cba50 tx=0x7f9ed0008040 comp rx=0 tx=0).stop 2024-09-12T01:43:44.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.402+0000 7f9eedd9a640 1 -- 172.21.15.60:0/3834115131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b64a0 msgr2=0x7f9ee8160ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.402+0000 7f9eedd9a640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b64a0 0x7f9ee8160ce0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800c410 tx=0x7f9ed800c8d0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.402+0000 7f9eedd9a640 1 -- 172.21.15.60:0/3834115131 shutdown_connections 2024-09-12T01:43:44.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.402+0000 7f9eedd9a640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9ec806be30 0x7f9ec806e2f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.402+0000 7f9eedd9a640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ee815e750 0x7f9ee815af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.402+0000 7f9eedd9a640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ee80b7f50 0x7f9ee80ce5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.402+0000 7f9eedd9a640 1 --2- 172.21.15.60:0/3834115131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ee80b64a0 0x7f9ee8160ce0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.402+0000 7f9eedd9a640 1 -- 172.21.15.60:0/3834115131 >> 172.21.15.60:0/3834115131 conn(0x7f9ee80d1500 msgr2=0x7f9ee80b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:44.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.402+0000 7f9eedd9a640 1 -- 172.21.15.60:0/3834115131 shutdown_connections 2024-09-12T01:43:44.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.402+0000 7f9eedd9a640 1 -- 172.21.15.60:0/3834115131 wait complete. 2024-09-12T01:43:44.412 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_warning_threshold 2024-09-12T01:43:44.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.517+0000 7ffac8dc6640 1 Processor -- start 2024-09-12T01:43:44.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.517+0000 7ffac8dc6640 1 -- start start 2024-09-12T01:43:44.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.518+0000 7ffac8dc6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffac415e6f0 0x7ffac406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.518+0000 7ffac8dc6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffac40b7450 0x7ffac415f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.518+0000 7ffac8dc6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac406e990 con 0x7ffac40b54d0 2024-09-12T01:43:44.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.518+0000 7ffac8dc6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ffac406ec70 con 0x7ffac415e6f0 2024-09-12T01:43:44.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.518+0000 7ffac8dc6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffac415ec70 con 0x7ffac40b7450 2024-09-12T01:43:44.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.518+0000 7ffac259c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffac415e6f0 0x7ffac406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.518+0000 7ffac1d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ffac40b54d0 0x7ffac40b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59516/0 (socket says 172.21.15.60:59516) 2024-09-12T01:43:44.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.518+0000 7ffac1d9b640 1 -- 172.21.15.60:0/277025664 learned_addr learned my addr 172.21.15.60:0/277025664 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.519+0000 7ffac2d9d640 1 --2- 172.21.15.60:0/277025664 >> v2:172.21.15.105:3300/0 conn(0x7ffac40b7450 0x7ffac415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.519+0000 7ffac259c640 1 -- 172.21.15.60:0/277025664 >> v2:172.21.15.105:3300/0 conn(0x7ffac40b7450 msgr2=0x7ffac415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.519+0000 7ffac259c640 1 --2- 172.21.15.60:0/277025664 >> v2:172.21.15.105:3300/0 conn(0x7ffac40b7450 0x7ffac415f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.519+0000 7ffac259c640 1 -- 172.21.15.60:0/277025664 >> v1:172.21.15.60:6789/0 conn(0x7ffac40b54d0 legacy=0x7ffac40b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.519+0000 7ffac259c640 1 -- 172.21.15.60:0/277025664 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac415ef50 con 0x7ffac415e6f0 2024-09-12T01:43:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.519+0000 7ffac159a640 1 -- 172.21.15.60:0/277025664 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175034945 0 0) 0x7ffac406e990 con 0x7ffac40b54d0 2024-09-12T01:43:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.519+0000 7ffac2d9d640 1 --2- 172.21.15.60:0/277025664 >> v2:172.21.15.105:3300/0 conn(0x7ffac40b7450 0x7ffac415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.519+0000 7ffac259c640 1 --2- 172.21.15.60:0/277025664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac415e6f0 0x7ffac406fd00 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ffac4072df0 tx=0x7ffab402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb04741f56b87ca1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.519+0000 7ffac159a640 1 -- 172.21.15.60:0/277025664 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4007740 con 0x7ffac415e6f0 2024-09-12T01:43:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.520+0000 7ffac159a640 1 -- 172.21.15.60:0/277025664 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab40078e0 con 0x7ffac415e6f0 2024-09-12T01:43:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.520+0000 7ffac159a640 1 -- 172.21.15.60:0/277025664 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4007cb0 con 0x7ffac415e6f0 2024-09-12T01:43:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.520+0000 7ffac8dc6640 1 -- 172.21.15.60:0/277025664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac415e6f0 msgr2=0x7ffac406fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.520+0000 7ffac8dc6640 1 --2- 172.21.15.60:0/277025664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac415e6f0 0x7ffac406fd00 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7ffac4072df0 tx=0x7ffab402a680 comp rx=0 tx=0).stop 2024-09-12T01:43:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.520+0000 7ffac8dc6640 1 -- 172.21.15.60:0/277025664 shutdown_connections 2024-09-12T01:43:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.520+0000 7ffac8dc6640 1 --2- 172.21.15.60:0/277025664 >> v2:172.21.15.105:3300/0 conn(0x7ffac40b7450 0x7ffac415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.520+0000 7ffac8dc6640 1 --2- 172.21.15.60:0/277025664 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac415e6f0 0x7ffac406fd00 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.520+0000 7ffac8dc6640 1 -- 172.21.15.60:0/277025664 >> 172.21.15.60:0/277025664 conn(0x7ffac40d2430 msgr2=0x7ffac40d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.520+0000 7ffac8dc6640 1 -- 172.21.15.60:0/277025664 shutdown_connections 2024-09-12T01:43:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.520+0000 7ffac8dc6640 1 -- 172.21.15.60:0/277025664 wait complete. 2024-09-12T01:43:44.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.521+0000 7ffac8dc6640 1 Processor -- start 2024-09-12T01:43:44.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.522+0000 7ffac8dc6640 1 -- start start 2024-09-12T01:43:44.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.522+0000 7ffac8dc6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac40b54d0 0x7ffac40cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.522+0000 7ffac8dc6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffac40b7450 0x7ffac4156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.522+0000 7ffac8dc6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac415e6f0 0x7ffac415d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.522+0000 7ffac8dc6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffac406e730 con 0x7ffac40b54d0 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.522+0000 7ffac8dc6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffac406e5b0 con 0x7ffac40b7450 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.522+0000 7ffac8dc6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffac4070830 con 0x7ffac415e6f0 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.522+0000 7ffac259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac40b54d0 0x7ffac40cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.522+0000 7ffac259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac40b54d0 0x7ffac40cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37114/0 (socket says 172.21.15.60:37114) 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.522+0000 7ffac259c640 1 -- 172.21.15.60:0/1726410497 learned_addr learned my addr 172.21.15.60:0/1726410497 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.523+0000 7ffac259c640 1 -- 172.21.15.60:0/1726410497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac415e6f0 msgr2=0x7ffac415d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.523+0000 7ffac259c640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac415e6f0 0x7ffac415d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.523+0000 7ffac259c640 1 -- 172.21.15.60:0/1726410497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffac40b7450 msgr2=0x7ffac4156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.523+0000 7ffac1d9b640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffac40b7450 0x7ffac4156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.523+0000 7ffac259c640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffac40b7450 0x7ffac4156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.523+0000 7ffac259c640 1 -- 172.21.15.60:0/1726410497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac415ceb0 con 0x7ffac40b54d0 2024-09-12T01:43:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.523+0000 7ffac259c640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac40b54d0 0x7ffac40cb7e0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ffab402ac70 tx=0x7ffab4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.523+0000 7ffabaffd640 1 -- 172.21.15.60:0/1726410497 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab403f070 con 0x7ffac40b54d0 2024-09-12T01:43:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.523+0000 7ffabaffd640 1 -- 172.21.15.60:0/1726410497 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab4031c40 con 0x7ffac40b54d0 2024-09-12T01:43:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.523+0000 7ffac8dc6640 1 -- 172.21.15.60:0/1726410497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac40cc290 con 0x7ffac40b54d0 2024-09-12T01:43:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.523+0000 7ffabaffd640 1 -- 172.21.15.60:0/1726410497 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab4043410 con 0x7ffac40b54d0 2024-09-12T01:43:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.523+0000 7ffac8dc6640 1 -- 172.21.15.60:0/1726410497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac40cc850 con 0x7ffac40b54d0 2024-09-12T01:43:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.524+0000 7ffac8dc6640 1 -- 172.21.15.60:0/1726410497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac406c6c0 con 0x7ffac40b54d0 2024-09-12T01:43:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.525+0000 7ffabaffd640 1 -- 172.21.15.60:0/1726410497 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffab40435b0 con 0x7ffac40b54d0 2024-09-12T01:43:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.525+0000 7ffabaffd640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffaa406be30 0x7ffaa406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.525+0000 7ffabaffd640 1 -- 172.21.15.60:0/1726410497 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4943+0+0 (secure 0 0 0) 0x7ffab40ac060 con 0x7ffac40b54d0 2024-09-12T01:43:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.525+0000 7ffac1d9b640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffaa406be30 0x7ffaa406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.526+0000 7ffac1d9b640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffaa406be30 0x7ffaa406e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ffaac007fd0 tx=0x7ffaac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.529+0000 7ffabaffd640 1 -- 172.21.15.60:0/1726410497 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffab407ada0 con 0x7ffac40b54d0 2024-09-12T01:43:44.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.709+0000 7ffac8dc6640 1 -- 172.21.15.60:0/1726410497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"} v 0) -- 0x7ffac40cca50 con 0x7ffac40b54d0 2024-09-12T01:43:44.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.712+0000 7ffabaffd640 1 -- 172.21.15.60:0/1726410497 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"}]=0 v55) ==== 111+0+0 (secure 0 0 0) 0x7ffab407a6a0 con 0x7ffac40b54d0 2024-09-12T01:43:44.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.714+0000 7ffac8dc6640 1 -- 172.21.15.60:0/1726410497 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffaa406be30 msgr2=0x7ffaa406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.714+0000 7ffac8dc6640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffaa406be30 0x7ffaa406e2f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ffaac007fd0 tx=0x7ffaac009040 comp rx=0 tx=0).stop 2024-09-12T01:43:44.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.714+0000 7ffac8dc6640 1 -- 172.21.15.60:0/1726410497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac40b54d0 msgr2=0x7ffac40cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.714+0000 7ffac8dc6640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac40b54d0 0x7ffac40cb7e0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7ffab402ac70 tx=0x7ffab4004a40 comp rx=0 tx=0).stop 2024-09-12T01:43:44.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.714+0000 7ffac8dc6640 1 -- 172.21.15.60:0/1726410497 shutdown_connections 2024-09-12T01:43:44.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.714+0000 7ffac8dc6640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffaa406be30 0x7ffaa406e2f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.714+0000 7ffac8dc6640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac415e6f0 0x7ffac415d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.714+0000 7ffac8dc6640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffac40b7450 0x7ffac4156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.714+0000 7ffac8dc6640 1 --2- 172.21.15.60:0/1726410497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac40b54d0 0x7ffac40cb7e0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.714+0000 7ffac8dc6640 1 -- 172.21.15.60:0/1726410497 >> 172.21.15.60:0/1726410497 conn(0x7ffac40d2430 msgr2=0x7ffac4070bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:44.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.715+0000 7ffac8dc6640 1 -- 172.21.15.60:0/1726410497 shutdown_connections 2024-09-12T01:43:44.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.715+0000 7ffac8dc6640 1 -- 172.21.15.60:0/1726410497 wait complete. 2024-09-12T01:43:44.725 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps' 2024-09-12T01:43:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.829+0000 7ff16a54b640 1 Processor -- start 2024-09-12T01:43:44.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.829+0000 7ff16a54b640 1 -- start start 2024-09-12T01:43:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.830+0000 7ff16a54b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff1640b2da0 0x7ff1640ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.830+0000 7ff16a54b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff164141d40 con 0x7ff1641434f0 2024-09-12T01:43:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.830+0000 7ff16a54b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff164142020 con 0x7ff16415ec10 2024-09-12T01:43:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.830+0000 7ff16a54b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff164143920 con 0x7ff1640b2da0 2024-09-12T01:43:44.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.830+0000 7ff163fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff1640b2da0 0x7ff1640ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.830+0000 7ff168ae8640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff1641434f0 0x7ff16415f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59528/0 (socket says 172.21.15.60:59528) 2024-09-12T01:43:44.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.830+0000 7ff163fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff1640b2da0 0x7ff1640ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37124/0 (socket says 172.21.15.60:37124) 2024-09-12T01:43:44.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.830+0000 7ff168ae8640 1 -- 172.21.15.60:0/397512454 learned_addr learned my addr 172.21.15.60:0/397512454 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:44.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.830+0000 7ff163fff640 1 -- 172.21.15.60:0/397512454 >> v1:172.21.15.105:6789/0 conn(0x7ff16415ec10 legacy=0x7ff164142de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:44.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.830+0000 7ff163fff640 1 -- 172.21.15.60:0/397512454 >> v1:172.21.15.60:6789/0 conn(0x7ff1641434f0 legacy=0x7ff16415f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.830+0000 7ff163fff640 1 -- 172.21.15.60:0/397512454 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff164142300 con 0x7ff1640b2da0 2024-09-12T01:43:44.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.830+0000 7ff162ffd640 1 -- 172.21.15.60:0/397512454 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3414293026 0 0) 0x7ff164141d40 con 0x7ff1641434f0 2024-09-12T01:43:44.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.831+0000 7ff163fff640 1 --2- 172.21.15.60:0/397512454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1640b2da0 0x7ff1640ce380 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7ff1540097a0 tx=0x7ff15402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7782024f12c4daaa server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:44.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.831+0000 7ff162ffd640 1 -- 172.21.15.60:0/397512454 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff154037070 con 0x7ff1640b2da0 2024-09-12T01:43:44.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.831+0000 7ff162ffd640 1 -- 172.21.15.60:0/397512454 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff154032440 con 0x7ff1640b2da0 2024-09-12T01:43:44.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.831+0000 7ff162ffd640 1 -- 172.21.15.60:0/397512454 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff154032810 con 0x7ff1640b2da0 2024-09-12T01:43:44.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.832+0000 7ff16a54b640 1 -- 172.21.15.60:0/397512454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1640b2da0 msgr2=0x7ff1640ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.832+0000 7ff16a54b640 1 --2- 172.21.15.60:0/397512454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1640b2da0 0x7ff1640ce380 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7ff1540097a0 tx=0x7ff15402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.832+0000 7ff16a54b640 1 -- 172.21.15.60:0/397512454 shutdown_connections 2024-09-12T01:43:44.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.832+0000 7ff16a54b640 1 --2- 172.21.15.60:0/397512454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1640b2da0 0x7ff1640ce380 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.832+0000 7ff16a54b640 1 -- 172.21.15.60:0/397512454 >> 172.21.15.60:0/397512454 conn(0x7ff16406bc10 msgr2=0x7ff16406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.832+0000 7ff16a54b640 1 -- 172.21.15.60:0/397512454 shutdown_connections 2024-09-12T01:43:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.832+0000 7ff16a54b640 1 -- 172.21.15.60:0/397512454 wait complete. 2024-09-12T01:43:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.833+0000 7ff16a54b640 1 Processor -- start 2024-09-12T01:43:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.833+0000 7ff16a54b640 1 -- start start 2024-09-12T01:43:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff16a54b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1640b2da0 0x7ff1640b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff16a54b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1641434f0 0x7ff164154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff16a54b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff16415ec10 0x7ff16413b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff16a54b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff1641428c0 con 0x7ff1641434f0 2024-09-12T01:43:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff16a54b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff164141af0 con 0x7ff1640b2da0 2024-09-12T01:43:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff16a54b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff1640b3180 con 0x7ff16415ec10 2024-09-12T01:43:44.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff1637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1641434f0 0x7ff164154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff1637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1641434f0 0x7ff164154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37138/0 (socket says 172.21.15.60:37138) 2024-09-12T01:43:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff1637fe640 1 -- 172.21.15.60:0/794563970 learned_addr learned my addr 172.21.15.60:0/794563970 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff163fff640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1640b2da0 0x7ff1640b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff168ae8640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff16415ec10 0x7ff16413b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff1637fe640 1 -- 172.21.15.60:0/794563970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff16415ec10 msgr2=0x7ff16413b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.845 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff1637fe640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff16415ec10 0x7ff16413b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff1637fe640 1 -- 172.21.15.60:0/794563970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1640b2da0 msgr2=0x7ff1640b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:44.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff1637fe640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1640b2da0 0x7ff1640b6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:44.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff1637fe640 1 -- 172.21.15.60:0/794563970 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff164154df0 con 0x7ff1641434f0 2024-09-12T01:43:44.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff168ae8640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff16415ec10 0x7ff16413b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:44.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.834+0000 7ff1637fe640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1641434f0 0x7ff164154610 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7ff15800c460 tx=0x7ff15800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:44.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.835+0000 7ff160ff9640 1 -- 172.21.15.60:0/794563970 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff158016020 con 0x7ff1641434f0 2024-09-12T01:43:44.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.835+0000 7ff160ff9640 1 -- 172.21.15.60:0/794563970 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff158012870 con 0x7ff1641434f0 2024-09-12T01:43:44.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.835+0000 7ff160ff9640 1 -- 172.21.15.60:0/794563970 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff158012c60 con 0x7ff1641434f0 2024-09-12T01:43:44.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.835+0000 7ff16a54b640 1 -- 172.21.15.60:0/794563970 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff164154b50 con 0x7ff1641434f0 2024-09-12T01:43:44.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.835+0000 7ff16a54b640 1 -- 172.21.15.60:0/794563970 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1640b3b00 con 0x7ff1641434f0 2024-09-12T01:43:44.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.836+0000 7ff16a54b640 1 -- 172.21.15.60:0/794563970 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff164068fa0 con 0x7ff1641434f0 2024-09-12T01:43:44.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.836+0000 7ff160ff9640 1 -- 172.21.15.60:0/794563970 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff158019020 con 0x7ff1641434f0 2024-09-12T01:43:44.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.837+0000 7ff160ff9640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff15006be30 0x7ff15006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:44.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.837+0000 7ff160ff9640 1 -- 172.21.15.60:0/794563970 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4943+0+0 (secure 0 0 0) 0x7ff15808a570 con 0x7ff1641434f0 2024-09-12T01:43:44.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.837+0000 7ff163fff640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff15006be30 0x7ff15006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:44.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.837+0000 7ff163fff640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff15006be30 0x7ff15006e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff154034000 tx=0x7ff15402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:44.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:44.841+0000 7ff160ff9640 1 -- 172.21.15.60:0/794563970 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff164068fa0 con 0x7ff1641434f0 2024-09-12T01:43:45.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.086+0000 7ff16a54b640 1 -- 172.21.15.60:0/794563970 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]} v 0) -- 0x7ff164142de0 con 0x7ff1641434f0 2024-09-12T01:43:45.145 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.145+0000 7ff160ff9640 1 -- 172.21.15.60:0/794563970 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_mincaps"]}]=0 v393) ==== 151+0+0 (secure 0 0 0) 0x7ff158020070 con 0x7ff1641434f0 2024-09-12T01:43:45.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.147+0000 7ff16a54b640 1 -- 172.21.15.60:0/794563970 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff15006be30 msgr2=0x7ff15006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.147+0000 7ff16a54b640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff15006be30 0x7ff15006e2f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff154034000 tx=0x7ff15402e000 comp rx=0 tx=0).stop 2024-09-12T01:43:45.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.147+0000 7ff16a54b640 1 -- 172.21.15.60:0/794563970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1641434f0 msgr2=0x7ff164154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.147+0000 7ff16a54b640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1641434f0 0x7ff164154610 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7ff15800c460 tx=0x7ff15800c920 comp rx=0 tx=0).stop 2024-09-12T01:43:45.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.147+0000 7ff16a54b640 1 -- 172.21.15.60:0/794563970 shutdown_connections 2024-09-12T01:43:45.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.147+0000 7ff16a54b640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff15006be30 0x7ff15006e2f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.147+0000 7ff16a54b640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff16415ec10 0x7ff16413b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.147+0000 7ff16a54b640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1641434f0 0x7ff164154610 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.147 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.147+0000 7ff16a54b640 1 --2- 172.21.15.60:0/794563970 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff1640b2da0 0x7ff1640b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.147+0000 7ff16a54b640 1 -- 172.21.15.60:0/794563970 >> 172.21.15.60:0/794563970 conn(0x7ff16406bc10 msgr2=0x7ff164143aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:45.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.147+0000 7ff16a54b640 1 -- 172.21.15.60:0/794563970 shutdown_connections 2024-09-12T01:43:45.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.148+0000 7ff16a54b640 1 -- 172.21.15.60:0/794563970 wait complete. 2024-09-12T01:43:45.158 INFO:tasks.cephfs_test_runner:test_client_pin_mincaps (tasks.cephfs.test_client_limits.TestClientLimits) ... ok 2024-09-12T01:43:45.158 INFO:tasks.cephfs_test_runner:Starting test: test_client_pin_root (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-12T01:43:45.159 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:43:45.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.261+0000 7f338be9b640 1 Processor -- start 2024-09-12T01:43:45.261 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.262+0000 7f338be9b640 1 -- start start 2024-09-12T01:43:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.262+0000 7f338be9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33840d3310 0x7f33840d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.262+0000 7f338be9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33840d1650 0x7f33840b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.262+0000 7f338be9b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f338415ea40 con 0x7f338415e660 2024-09-12T01:43:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.262+0000 7f338be9b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f33840d1ac0 con 0x7f33840d1650 2024-09-12T01:43:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.262+0000 7f338be9b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f33840d3870 con 0x7f33840d3310 2024-09-12T01:43:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.263+0000 7f338a438640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33840d1650 0x7f33840b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.263+0000 7f338a438640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33840d1650 0x7f33840b7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37150/0 (socket says 172.21.15.60:37150) 2024-09-12T01:43:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.263+0000 7f338a438640 1 -- 172.21.15.60:0/2002526438 learned_addr learned my addr 172.21.15.60:0/2002526438 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.263+0000 7f3389436640 1 --2- 172.21.15.60:0/2002526438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33840d3310 0x7f33840d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.263+0000 7f338a438640 1 -- 172.21.15.60:0/2002526438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33840d3310 msgr2=0x7f33840d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.263+0000 7f338a438640 1 --2- 172.21.15.60:0/2002526438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33840d3310 0x7f33840d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.263+0000 7f338a438640 1 -- 172.21.15.60:0/2002526438 >> v1:172.21.15.105:6789/0 conn(0x7f338415e660 legacy=0x7f33840cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:45.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.263+0000 7f338a438640 1 -- 172.21.15.60:0/2002526438 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33840d3b50 con 0x7f33840d1650 2024-09-12T01:43:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.264+0000 7f338a438640 1 --2- 172.21.15.60:0/2002526438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840d1650 0x7f33840b7b70 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f337c009e50 tx=0x7f337c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b092f1163bddc88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.264+0000 7f3388c35640 1 -- 172.21.15.60:0/2002526438 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c036070 con 0x7f33840d1650 2024-09-12T01:43:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.264+0000 7f3388c35640 1 -- 172.21.15.60:0/2002526438 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c031600 con 0x7f33840d1650 2024-09-12T01:43:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.264+0000 7f3388c35640 1 -- 172.21.15.60:0/2002526438 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c0319d0 con 0x7f33840d1650 2024-09-12T01:43:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.264+0000 7f338be9b640 1 -- 172.21.15.60:0/2002526438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840d1650 msgr2=0x7f33840b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.264+0000 7f338be9b640 1 --2- 172.21.15.60:0/2002526438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840d1650 0x7f33840b7b70 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f337c009e50 tx=0x7f337c02a6c0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.264+0000 7f338be9b640 1 -- 172.21.15.60:0/2002526438 shutdown_connections 2024-09-12T01:43:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.264+0000 7f338be9b640 1 --2- 172.21.15.60:0/2002526438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840d1650 0x7f33840b7b70 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.264+0000 7f338be9b640 1 --2- 172.21.15.60:0/2002526438 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f33840d3310 0x7f33840d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.264+0000 7f338be9b640 1 -- 172.21.15.60:0/2002526438 >> 172.21.15.60:0/2002526438 conn(0x7f33840b6410 msgr2=0x7f33840b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.264+0000 7f338be9b640 1 -- 172.21.15.60:0/2002526438 shutdown_connections 2024-09-12T01:43:45.265 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.264+0000 7f338be9b640 1 -- 172.21.15.60:0/2002526438 wait complete. 2024-09-12T01:43:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.265+0000 7f338be9b640 1 Processor -- start 2024-09-12T01:43:45.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.266+0000 7f338be9b640 1 -- start start 2024-09-12T01:43:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.266+0000 7f338be9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840d1650 0x7f3384161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.266+0000 7f338be9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33840d3310 0x7f3384159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.266+0000 7f338be9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f338415e660 0x7f338415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.266+0000 7f338be9b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f33840d43f0 con 0x7f33840d1650 2024-09-12T01:43:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.266+0000 7f338be9b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f33840d4110 con 0x7f33840d3310 2024-09-12T01:43:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.266+0000 7f338be9b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f33840b80b0 con 0x7f338415e660 2024-09-12T01:43:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.266+0000 7f3389c37640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840d1650 0x7f3384161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.266+0000 7f3389c37640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840d1650 0x7f3384161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37164/0 (socket says 172.21.15.60:37164) 2024-09-12T01:43:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.266+0000 7f3389c37640 1 -- 172.21.15.60:0/2265557452 learned_addr learned my addr 172.21.15.60:0/2265557452 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.267+0000 7f3389c37640 1 -- 172.21.15.60:0/2265557452 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f338415e660 msgr2=0x7f338415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.267+0000 7f3389c37640 1 --2- 172.21.15.60:0/2265557452 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f338415e660 0x7f338415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.267+0000 7f3389c37640 1 -- 172.21.15.60:0/2265557452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33840d3310 msgr2=0x7f3384159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.267+0000 7f3389c37640 1 --2- 172.21.15.60:0/2265557452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33840d3310 0x7f3384159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.267+0000 7f3389c37640 1 -- 172.21.15.60:0/2265557452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338415f7c0 con 0x7f33840d1650 2024-09-12T01:43:45.268 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.267+0000 7f3389c37640 1 --2- 172.21.15.60:0/2265557452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840d1650 0x7f3384161360 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f338000b3f0 tx=0x7f338000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.267+0000 7f337a7fc640 1 -- 172.21.15.60:0/2265557452 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380015020 con 0x7f33840d1650 2024-09-12T01:43:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.267+0000 7f337a7fc640 1 -- 172.21.15.60:0/2265557452 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3380011830 con 0x7f33840d1650 2024-09-12T01:43:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.267+0000 7f337a7fc640 1 -- 172.21.15.60:0/2265557452 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380011c20 con 0x7f33840d1650 2024-09-12T01:43:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.267+0000 7f338be9b640 1 -- 172.21.15.60:0/2265557452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338415faa0 con 0x7f33840d1650 2024-09-12T01:43:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.267+0000 7f338be9b640 1 -- 172.21.15.60:0/2265557452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3384160060 con 0x7f33840d1650 2024-09-12T01:43:45.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.268+0000 7f338be9b640 1 -- 172.21.15.60:0/2265557452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f338415ca20 con 0x7f33840d1650 2024-09-12T01:43:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.268+0000 7f337a7fc640 1 -- 172.21.15.60:0/2265557452 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3380018020 con 0x7f33840d1650 2024-09-12T01:43:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.269+0000 7f337a7fc640 1 --2- 172.21.15.60:0/2265557452 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f336806be30 0x7f336806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.269+0000 7f337a7fc640 1 -- 172.21.15.60:0/2265557452 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4943+0+0 (secure 0 0 0) 0x7f338008a740 con 0x7f33840d1650 2024-09-12T01:43:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.269+0000 7f3389436640 1 --2- 172.21.15.60:0/2265557452 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f336806be30 0x7f336806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.269+0000 7f3389436640 1 --2- 172.21.15.60:0/2265557452 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f336806be30 0x7f336806e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3374006fd0 tx=0x7f3374008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:45.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.273+0000 7f337a7fc640 1 -- 172.21.15.60:0/2265557452 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f338415ca20 con 0x7f33840d1650 2024-09-12T01:43:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.448+0000 7f338be9b640 1 -- 172.21.15.60:0/2265557452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33840b7b70 con 0x7f33840d1650 2024-09-12T01:43:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.449+0000 7f337a7fc640 1 -- 172.21.15.60:0/2265557452 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) ==== 74+0+13008 (secure 0 0 0) 0x7f338001f030 con 0x7f33840d1650 2024-09-12T01:43:45.449 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:45.449 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":120,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:43:43.129847+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6834/3613656777":"2024-09-13T01:43:40.121943+0000","172.21.15.105:6832/3613656777":"2024-09-13T01:43:40.121943+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:43:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.451+0000 7f338be9b640 1 -- 172.21.15.60:0/2265557452 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f336806be30 msgr2=0x7f336806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.451+0000 7f338be9b640 1 --2- 172.21.15.60:0/2265557452 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f336806be30 0x7f336806e2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3374006fd0 tx=0x7f3374008040 comp rx=0 tx=0).stop 2024-09-12T01:43:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.451+0000 7f338be9b640 1 -- 172.21.15.60:0/2265557452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840d1650 msgr2=0x7f3384161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.451+0000 7f338be9b640 1 --2- 172.21.15.60:0/2265557452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840d1650 0x7f3384161360 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f338000b3f0 tx=0x7f338000b8b0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.451+0000 7f338be9b640 1 -- 172.21.15.60:0/2265557452 shutdown_connections 2024-09-12T01:43:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.451+0000 7f338be9b640 1 --2- 172.21.15.60:0/2265557452 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f336806be30 0x7f336806e2f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.451+0000 7f338be9b640 1 --2- 172.21.15.60:0/2265557452 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f338415e660 0x7f338415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.451+0000 7f338be9b640 1 --2- 172.21.15.60:0/2265557452 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f33840d3310 0x7f3384159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.451+0000 7f338be9b640 1 --2- 172.21.15.60:0/2265557452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33840d1650 0x7f3384161360 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.451+0000 7f338be9b640 1 -- 172.21.15.60:0/2265557452 >> 172.21.15.60:0/2265557452 conn(0x7f33840b6410 msgr2=0x7f33840b56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:45.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.451+0000 7f338be9b640 1 -- 172.21.15.60:0/2265557452 shutdown_connections 2024-09-12T01:43:45.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.451+0000 7f338be9b640 1 -- 172.21.15.60:0/2265557452 wait complete. 2024-09-12T01:43:45.462 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:35:46.304939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:43:45.462 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:43:45.567 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.568+0000 7f52c6a9b640 1 Processor -- start 2024-09-12T01:43:45.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.568+0000 7f52c6a9b640 1 -- start start 2024-09-12T01:43:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.569+0000 7f52c6a9b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f52c015e6f0 0x7f52c006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.569+0000 7f52c6a9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52c00b54d0 0x7f52c015f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.569+0000 7f52c6a9b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52c006e990 con 0x7f52c00b6d40 2024-09-12T01:43:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.569+0000 7f52c6a9b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f52c006ec70 con 0x7f52c015e6f0 2024-09-12T01:43:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.569+0000 7f52c6a9b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f52c015ec70 con 0x7f52c00b54d0 2024-09-12T01:43:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.569+0000 7f52c4837640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f52c015e6f0 0x7f52c006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.569+0000 7f52b7fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52c00b54d0 0x7f52c015f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.569+0000 7f52b7fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52c00b54d0 0x7f52c015f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:46046/0 (socket says 172.21.15.60:46046) 2024-09-12T01:43:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.569+0000 7f52c4837640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f52c015e6f0 0x7f52c006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:53714/0 (socket says 172.21.15.60:53714) 2024-09-12T01:43:45.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.569+0000 7f52b7fff640 1 -- 172.21.15.60:0/3907812128 learned_addr learned my addr 172.21.15.60:0/3907812128 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.570+0000 7f52c4837640 1 -- 172.21.15.60:0/3907812128 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52c00b54d0 msgr2=0x7f52c015f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.570+0000 7f52c4837640 1 --2- 172.21.15.60:0/3907812128 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52c00b54d0 0x7f52c015f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.570+0000 7f52c4837640 1 -- 172.21.15.60:0/3907812128 >> v1:172.21.15.105:6789/0 conn(0x7f52c00b6d40 legacy=0x7f52c00b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.570+0000 7f52c4837640 1 -- 172.21.15.60:0/3907812128 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c015ef50 con 0x7f52c015e6f0 2024-09-12T01:43:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.570+0000 7f52b77fe640 1 -- 172.21.15.60:0/3907812128 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 668669905 0 0) 0x7f52c006e990 con 0x7f52c00b6d40 2024-09-12T01:43:45.571 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.570+0000 7f52c4837640 1 --2- 172.21.15.60:0/3907812128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52c015e6f0 0x7f52c006fd00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0097a0 tx=0x7f52bc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8036fd2e3376085b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.571+0000 7f52b77fe640 1 -- 172.21.15.60:0/3907812128 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc037070 con 0x7f52c015e6f0 2024-09-12T01:43:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.571+0000 7f52b77fe640 1 -- 172.21.15.60:0/3907812128 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52bc032440 con 0x7f52c015e6f0 2024-09-12T01:43:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.571+0000 7f52b77fe640 1 -- 172.21.15.60:0/3907812128 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc032810 con 0x7f52c015e6f0 2024-09-12T01:43:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.571+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3907812128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52c015e6f0 msgr2=0x7f52c006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.571+0000 7f52c6a9b640 1 --2- 172.21.15.60:0/3907812128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52c015e6f0 0x7f52c006fd00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f52bc0097a0 tx=0x7f52bc02a180 comp rx=0 tx=0).stop 2024-09-12T01:43:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.571+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3907812128 shutdown_connections 2024-09-12T01:43:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.571+0000 7f52c6a9b640 1 --2- 172.21.15.60:0/3907812128 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52c00b54d0 0x7f52c015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.571+0000 7f52c6a9b640 1 --2- 172.21.15.60:0/3907812128 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52c015e6f0 0x7f52c006fd00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.571+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3907812128 >> 172.21.15.60:0/3907812128 conn(0x7f52c00d2430 msgr2=0x7f52c00d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:45.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.571+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3907812128 shutdown_connections 2024-09-12T01:43:45.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.571+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3907812128 wait complete. 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.572+0000 7f52c6a9b640 1 Processor -- start 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.572+0000 7f52c6a9b640 1 -- start start 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.573+0000 7f52c6a9b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52c00b54d0 0x7f52c0157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.573+0000 7f52c6a9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52c00b6d40 0x7f52c01f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.573+0000 7f52c6a9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c015e6f0 0x7f52c0161b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.573+0000 7f52c6a9b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f52c006e730 con 0x7f52c015e6f0 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.573+0000 7f52c6a9b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f52c006e5b0 con 0x7f52c00b54d0 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.573+0000 7f52c6a9b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f52c0070830 con 0x7f52c00b6d40 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.573+0000 7f52c5038640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c015e6f0 0x7f52c0161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.573+0000 7f52c5038640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c015e6f0 0x7f52c0161b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37170/0 (socket says 172.21.15.60:37170) 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.573+0000 7f52c5038640 1 -- 172.21.15.60:0/3695859300 learned_addr learned my addr 172.21.15.60:0/3695859300 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52b7fff640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52c00b6d40 0x7f52c01f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52c4837640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52c00b54d0 0x7f52c0157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52c5038640 1 -- 172.21.15.60:0/3695859300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52c00b6d40 msgr2=0x7f52c01f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52c5038640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52c00b6d40 0x7f52c01f7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52c5038640 1 -- 172.21.15.60:0/3695859300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52c00b54d0 msgr2=0x7f52c0157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52c5038640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52c00b54d0 0x7f52c0157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52c5038640 1 -- 172.21.15.60:0/3695859300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c01f8190 con 0x7f52c015e6f0 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52b7fff640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52c00b6d40 0x7f52c01f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52c5038640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c015e6f0 0x7f52c0161b30 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c760 tx=0x7f52b800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52b57fa640 1 -- 172.21.15.60:0/3695859300 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8003da0 con 0x7f52c015e6f0 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52b57fa640 1 -- 172.21.15.60:0/3695859300 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52b8005070 con 0x7f52c015e6f0 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3695859300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c01f8470 con 0x7f52c015e6f0 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52b57fa640 1 -- 172.21.15.60:0/3695859300 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b8005460 con 0x7f52c015e6f0 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.574+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3695859300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c00cd6a0 con 0x7f52c015e6f0 2024-09-12T01:43:45.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.575+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3695859300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c006c6c0 con 0x7f52c015e6f0 2024-09-12T01:43:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.576+0000 7f52b57fa640 1 -- 172.21.15.60:0/3695859300 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f52b8005600 con 0x7f52c015e6f0 2024-09-12T01:43:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.576+0000 7f52b57fa640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f52ac06be30 0x7f52ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.576+0000 7f52b57fa640 1 -- 172.21.15.60:0/3695859300 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4943+0+0 (secure 0 0 0) 0x7f52b808a9a0 con 0x7f52c015e6f0 2024-09-12T01:43:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.576+0000 7f52c4837640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f52ac06be30 0x7f52ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.577+0000 7f52c4837640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f52ac06be30 0x7f52ac06e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f52bc034000 tx=0x7f52bc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:45.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.581+0000 7f52b57fa640 1 -- 172.21.15.60:0/3695859300 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52b80596e0 con 0x7f52c015e6f0 2024-09-12T01:43:45.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.756+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3695859300 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f52c015a080 con 0x7f52c015e6f0 2024-09-12T01:43:45.756 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.756+0000 7f52b57fa640 1 -- 172.21.15.60:0/3695859300 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) ==== 93+0+10 (secure 0 0 0) 0x7f52b8058fe0 con 0x7f52c015e6f0 2024-09-12T01:43:45.756 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-12T01:43:45.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.758+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3695859300 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f52ac06be30 msgr2=0x7f52ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.758+0000 7f52c6a9b640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f52ac06be30 0x7f52ac06e2f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f52bc034000 tx=0x7f52bc02e000 comp rx=0 tx=0).stop 2024-09-12T01:43:45.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.758+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3695859300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c015e6f0 msgr2=0x7f52c0161b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.758+0000 7f52c6a9b640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c015e6f0 0x7f52c0161b30 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c760 tx=0x7f52b800cc20 comp rx=0 tx=0).stop 2024-09-12T01:43:45.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.758+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3695859300 shutdown_connections 2024-09-12T01:43:45.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.758+0000 7f52c6a9b640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52c015e6f0 0x7f52c0161b30 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.758+0000 7f52c6a9b640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f52ac06be30 0x7f52ac06e2f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.758+0000 7f52c6a9b640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f52c00b6d40 0x7f52c01f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.759+0000 7f52c6a9b640 1 --2- 172.21.15.60:0/3695859300 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f52c00b54d0 0x7f52c0157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.759+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3695859300 >> 172.21.15.60:0/3695859300 conn(0x7f52c00d2430 msgr2=0x7f52c015d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:45.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.759+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3695859300 shutdown_connections 2024-09-12T01:43:45.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.759+0000 7f52c6a9b640 1 -- 172.21.15.60:0/3695859300 wait complete. 2024-09-12T01:43:45.769 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root' 2024-09-12T01:43:45.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.871+0000 7fd45c0d0640 1 Processor -- start 2024-09-12T01:43:45.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.871+0000 7fd45c0d0640 1 -- start start 2024-09-12T01:43:45.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.872+0000 7fd45c0d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454073080 0x7fd4540b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.872+0000 7fd45c0d0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd45415c670 0x7fd454073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.873 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.872+0000 7fd45c0d0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd454071750 con 0x7fd4540b1990 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.872+0000 7fd45c0d0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd4540d0c60 con 0x7fd45415c670 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.872+0000 7fd45c0d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd4540d0370 con 0x7fd454073080 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.872+0000 7fd45a66d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd4540b1990 0x7fd4540d10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59536/0 (socket says 172.21.15.60:59536) 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.872+0000 7fd45a66d640 1 -- 172.21.15.60:0/3445689961 learned_addr learned my addr 172.21.15.60:0/3445689961 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd45966b640 1 --2- 172.21.15.60:0/3445689961 >> v2:172.21.15.105:3300/0 conn(0x7fd45415c670 0x7fd454073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd459e6c640 1 --2- 172.21.15.60:0/3445689961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454073080 0x7fd4540b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671924411 0 0) 0x7fd454071750 con 0x7fd4540b1990 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd43c003520 con 0x7fd4540b1990 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 978689830 0 0) 0x7fd43c003520 con 0x7fd4540b1990 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454073080 msgr2=0x7fd4540b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 --2- 172.21.15.60:0/3445689961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454073080 0x7fd4540b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 >> v2:172.21.15.105:3300/0 conn(0x7fd45415c670 msgr2=0x7fd454073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 --2- 172.21.15.60:0/3445689961 >> v2:172.21.15.105:3300/0 conn(0x7fd45415c670 0x7fd454073460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4540b59a0 con 0x7fd4540b1990 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fd4440019f0 con 0x7fd4540b1990 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 >> v1:172.21.15.60:6789/0 conn(0x7fd4540b1990 legacy=0x7fd4540d10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 --2- 172.21.15.60:0/3445689961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454073080 0x7fd43c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 --2- 172.21.15.60:0/3445689961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd43c003f30 0x7fd43c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 --2- 172.21.15.60:0/3445689961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd43c004d40 0x7fd43c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd4540d0c60 con 0x7fd43c003f30 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd4540d0370 con 0x7fd43c004d40 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd43c00b9c0 con 0x7fd454073080 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd45966b640 1 --2- 172.21.15.60:0/3445689961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd43c003f30 0x7fd43c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd459e6c640 1 --2- 172.21.15.60:0/3445689961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454073080 0x7fd43c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.873+0000 7fd45a66d640 1 --2- 172.21.15.60:0/3445689961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd43c004d40 0x7fd43c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.874+0000 7fd45966b640 1 -- 172.21.15.60:0/3445689961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454073080 msgr2=0x7fd43c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:45.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.874+0000 7fd45966b640 1 --2- 172.21.15.60:0/3445689961 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454073080 0x7fd43c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.874+0000 7fd45966b640 1 -- 172.21.15.60:0/3445689961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd43c004d40 msgr2=0x7fd43c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:45.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.874+0000 7fd45966b640 1 --2- 172.21.15.60:0/3445689961 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd43c004d40 0x7fd43c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.874+0000 7fd45966b640 1 -- 172.21.15.60:0/3445689961 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c003520 con 0x7fd43c003f30 2024-09-12T01:43:45.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.874+0000 7fd45966b640 1 --2- 172.21.15.60:0/3445689961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd43c003f30 0x7fd43c004800 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fd4540cf840 tx=0x7fd43c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97ca2b7654ec197 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.874+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448036070 con 0x7fd43c003f30 2024-09-12T01:43:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.874+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd448031400 con 0x7fd43c003f30 2024-09-12T01:43:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.874+0000 7fd458e6a640 1 -- 172.21.15.60:0/3445689961 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448009690 con 0x7fd43c003f30 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.875+0000 7fd45c0d0640 1 -- 172.21.15.60:0/3445689961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd43c003f30 msgr2=0x7fd43c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.875+0000 7fd45c0d0640 1 --2- 172.21.15.60:0/3445689961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd43c003f30 0x7fd43c004800 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fd4540cf840 tx=0x7fd43c005830 comp rx=0 tx=0).stop 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.875+0000 7fd45a66d640 1 -- 172.21.15.60:0/3445689961 reap_dead start 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.875+0000 7fd45c0d0640 1 -- 172.21.15.60:0/3445689961 shutdown_connections 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.875+0000 7fd45c0d0640 1 -- 172.21.15.60:0/3445689961 >> 172.21.15.60:0/3445689961 conn(0x7fd4540d24d0 msgr2=0x7fd4540d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.875+0000 7fd45c0d0640 1 -- 172.21.15.60:0/3445689961 shutdown_connections 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.875+0000 7fd45c0d0640 1 -- 172.21.15.60:0/3445689961 wait complete. 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.876+0000 7fd45c0d0640 1 Processor -- start 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.876+0000 7fd45c0d0640 1 -- start start 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45c0d0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd43c003f30 0x7fd45406d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45c0d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454158e30 0x7fd4541592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45c0d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd45406e450 0x7fd45406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45c0d0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd454071470 con 0x7fd45406e450 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45c0d0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd454071190 con 0x7fd43c003f30 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45c0d0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd4540d0610 con 0x7fd454158e30 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45a66d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd45406e450 0x7fd45406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45a66d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd45406e450 0x7fd45406e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37186/0 (socket says 172.21.15.60:37186) 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45a66d640 1 -- 172.21.15.60:0/1881967103 learned_addr learned my addr 172.21.15.60:0/1881967103 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd459e6c640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd43c003f30 0x7fd45406d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45966b640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454158e30 0x7fd4541592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45a66d640 1 -- 172.21.15.60:0/1881967103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454158e30 msgr2=0x7fd4541592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45a66d640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454158e30 0x7fd4541592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45a66d640 1 -- 172.21.15.60:0/1881967103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd43c003f30 msgr2=0x7fd45406d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.877+0000 7fd45a66d640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd43c003f30 0x7fd45406d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.878+0000 7fd45a66d640 1 -- 172.21.15.60:0/1881967103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4540aeae0 con 0x7fd45406e450 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.878+0000 7fd45a66d640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd45406e450 0x7fd45406e8d0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fd45415ff80 tx=0x7fd444007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.878+0000 7fd4527fc640 1 -- 172.21.15.60:0/1881967103 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd44400ab80 con 0x7fd45406e450 2024-09-12T01:43:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.878+0000 7fd4527fc640 1 -- 172.21.15.60:0/1881967103 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd444018070 con 0x7fd45406e450 2024-09-12T01:43:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.878+0000 7fd45c0d0640 1 -- 172.21.15.60:0/1881967103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4540aedc0 con 0x7fd45406e450 2024-09-12T01:43:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.878+0000 7fd4527fc640 1 -- 172.21.15.60:0/1881967103 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4440133f0 con 0x7fd45406e450 2024-09-12T01:43:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.878+0000 7fd45c0d0640 1 -- 172.21.15.60:0/1881967103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4540af380 con 0x7fd45406e450 2024-09-12T01:43:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.879+0000 7fd45c0d0640 1 -- 172.21.15.60:0/1881967103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4540d08f0 con 0x7fd45406e450 2024-09-12T01:43:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.880+0000 7fd4527fc640 1 -- 172.21.15.60:0/1881967103 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd444013590 con 0x7fd45406e450 2024-09-12T01:43:45.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.880+0000 7fd4527fc640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd44006be60 0x7fd44006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:45.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.880+0000 7fd4527fc640 1 -- 172.21.15.60:0/1881967103 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4943+0+0 (secure 0 0 0) 0x7fd44408b130 con 0x7fd45406e450 2024-09-12T01:43:45.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.881+0000 7fd459e6c640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd44006be60 0x7fd44006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:45.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.881+0000 7fd459e6c640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd44006be60 0x7fd44006e320 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009ae0 tx=0x7fd44c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:45.884+0000 7fd4527fc640 1 -- 172.21.15.60:0/1881967103 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd444059cb0 con 0x7fd45406e450 2024-09-12T01:43:46.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.132+0000 7fd45c0d0640 1 -- 172.21.15.60:0/1881967103 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]} v 0) -- 0x7fd4540d3050 con 0x7fd45406e450 2024-09-12T01:43:46.146 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.146+0000 7fd4527fc640 1 -- 172.21.15.60:0/1881967103 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]}]=0 v394) ==== 151+0+0 (secure 0 0 0) 0x7fd4440595b0 con 0x7fd45406e450 2024-09-12T01:43:46.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.148+0000 7fd45c0d0640 1 -- 172.21.15.60:0/1881967103 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd44006be60 msgr2=0x7fd44006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.148+0000 7fd45c0d0640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd44006be60 0x7fd44006e320 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd44c009ae0 tx=0x7fd44c009190 comp rx=0 tx=0).stop 2024-09-12T01:43:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.149+0000 7fd45c0d0640 1 -- 172.21.15.60:0/1881967103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd45406e450 msgr2=0x7fd45406e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.149+0000 7fd45c0d0640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd45406e450 0x7fd45406e8d0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fd45415ff80 tx=0x7fd444007b10 comp rx=0 tx=0).stop 2024-09-12T01:43:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.149+0000 7fd45c0d0640 1 -- 172.21.15.60:0/1881967103 shutdown_connections 2024-09-12T01:43:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.149+0000 7fd45c0d0640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd45406e450 0x7fd45406e8d0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.149+0000 7fd45c0d0640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd44006be60 0x7fd44006e320 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.149+0000 7fd45c0d0640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd454158e30 0x7fd4541592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.149+0000 7fd45c0d0640 1 --2- 172.21.15.60:0/1881967103 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd43c003f30 0x7fd45406d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.149+0000 7fd45c0d0640 1 -- 172.21.15.60:0/1881967103 >> 172.21.15.60:0/1881967103 conn(0x7fd4540d24d0 msgr2=0x7fd4540b64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.149+0000 7fd45c0d0640 1 -- 172.21.15.60:0/1881967103 shutdown_connections 2024-09-12T01:43:46.149 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.149+0000 7fd45c0d0640 1 -- 172.21.15.60:0/1881967103 wait complete. 2024-09-12T01:43:46.159 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:43:46.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.264+0000 7f61b7b68640 1 Processor -- start 2024-09-12T01:43:46.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.265+0000 7f61b7b68640 1 -- start start 2024-09-12T01:43:46.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.265+0000 7f61b7b68640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b015c2a0 0x7f61b00735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:46.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b7b68640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f61b006fe20 0x7f61b006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:46.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b7b68640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61b0074120 con 0x7f61b0073b10 2024-09-12T01:43:46.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b7b68640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f61b015c680 con 0x7f61b006fe20 2024-09-12T01:43:46.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b7b68640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f61b015ef00 con 0x7f61b015c2a0 2024-09-12T01:43:46.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b5904640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b015c2a0 0x7f61b00735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:46.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b6105640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f61b006fe20 0x7f61b006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:46.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b6105640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f61b006fe20 0x7f61b006bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:53746/0 (socket says 172.21.15.60:53746) 2024-09-12T01:43:46.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b5103640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f61b0073b10 0x7f61b006f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:41726/0 (socket says 172.21.15.60:41726) 2024-09-12T01:43:46.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b5904640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b015c2a0 0x7f61b00735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:46096/0 (socket says 172.21.15.60:46096) 2024-09-12T01:43:46.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b6105640 1 -- 172.21.15.60:0/4204232868 learned_addr learned my addr 172.21.15.60:0/4204232868 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:46.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b5904640 1 -- 172.21.15.60:0/4204232868 >> v2:172.21.15.105:3300/0 conn(0x7f61b006fe20 msgr2=0x7f61b006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:46.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b5904640 1 --2- 172.21.15.60:0/4204232868 >> v2:172.21.15.105:3300/0 conn(0x7f61b006fe20 0x7f61b006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b5904640 1 -- 172.21.15.60:0/4204232868 >> v1:172.21.15.105:6789/0 conn(0x7f61b0073b10 legacy=0x7f61b006f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b5904640 1 -- 172.21.15.60:0/4204232868 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b015f1e0 con 0x7f61b015c2a0 2024-09-12T01:43:46.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.266+0000 7f61b6105640 1 --2- 172.21.15.60:0/4204232868 >> v2:172.21.15.105:3300/0 conn(0x7f61b006fe20 0x7f61b006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.267+0000 7f61b5904640 1 --2- 172.21.15.60:0/4204232868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b015c2a0 0x7f61b00735d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0097a0 tx=0x7f61ac02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af1a64979f1d5b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.267+0000 7f61b4902640 1 -- 172.21.15.60:0/4204232868 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac037070 con 0x7f61b015c2a0 2024-09-12T01:43:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.267+0000 7f61b4902640 1 -- 172.21.15.60:0/4204232868 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ac032440 con 0x7f61b015c2a0 2024-09-12T01:43:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.267+0000 7f61b4902640 1 -- 172.21.15.60:0/4204232868 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac032810 con 0x7f61b015c2a0 2024-09-12T01:43:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.268+0000 7f61b7b68640 1 -- 172.21.15.60:0/4204232868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b015c2a0 msgr2=0x7f61b00735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.268+0000 7f61b7b68640 1 --2- 172.21.15.60:0/4204232868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b015c2a0 0x7f61b00735d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0097a0 tx=0x7f61ac02a180 comp rx=0 tx=0).stop 2024-09-12T01:43:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.268+0000 7f61b7b68640 1 -- 172.21.15.60:0/4204232868 shutdown_connections 2024-09-12T01:43:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.268+0000 7f61b7b68640 1 --2- 172.21.15.60:0/4204232868 >> v2:172.21.15.105:3300/0 conn(0x7f61b006fe20 0x7f61b006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.268+0000 7f61b7b68640 1 --2- 172.21.15.60:0/4204232868 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b015c2a0 0x7f61b00735d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.269 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.268+0000 7f61b7b68640 1 -- 172.21.15.60:0/4204232868 >> 172.21.15.60:0/4204232868 conn(0x7f61b00b3070 msgr2=0x7f61b00b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.268+0000 7f61b7b68640 1 -- 172.21.15.60:0/4204232868 shutdown_connections 2024-09-12T01:43:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.268+0000 7f61b7b68640 1 -- 172.21.15.60:0/4204232868 wait complete. 2024-09-12T01:43:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.269+0000 7f61b7b68640 1 Processor -- start 2024-09-12T01:43:46.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.269+0000 7f61b7b68640 1 -- start start 2024-09-12T01:43:46.271 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b7b68640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b006fe20 0x7f61b01531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b7b68640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61b0073b10 0x7f61b0149c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b7b68640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b015c2a0 0x7f61b01581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b7b68640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f61b00b5f20 con 0x7f61b006fe20 2024-09-12T01:43:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b7b68640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f61b015ebf0 con 0x7f61b0073b10 2024-09-12T01:43:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b7b68640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f61b00b60a0 con 0x7f61b015c2a0 2024-09-12T01:43:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b5904640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b006fe20 0x7f61b01531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b5904640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b006fe20 0x7f61b01531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37194/0 (socket says 172.21.15.60:37194) 2024-09-12T01:43:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b5904640 1 -- 172.21.15.60:0/1542759652 learned_addr learned my addr 172.21.15.60:0/1542759652 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b5103640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61b0073b10 0x7f61b0149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b6105640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b015c2a0 0x7f61b01581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:46.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b5904640 1 -- 172.21.15.60:0/1542759652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b015c2a0 msgr2=0x7f61b01581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b5904640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b015c2a0 0x7f61b01581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b5904640 1 -- 172.21.15.60:0/1542759652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61b0073b10 msgr2=0x7f61b0149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b5904640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61b0073b10 0x7f61b0149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b5904640 1 -- 172.21.15.60:0/1542759652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61b0160830 con 0x7f61b006fe20 2024-09-12T01:43:46.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b5103640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61b0073b10 0x7f61b0149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:46.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.270+0000 7f61b5904640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b006fe20 0x7f61b01531b0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0098c0 tx=0x7f61ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:46.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.271+0000 7f61a67fc640 1 -- 172.21.15.60:0/1542759652 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac037040 con 0x7f61b006fe20 2024-09-12T01:43:46.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.271+0000 7f61a67fc640 1 -- 172.21.15.60:0/1542759652 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ac030500 con 0x7f61b006fe20 2024-09-12T01:43:46.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.271+0000 7f61b7b68640 1 -- 172.21.15.60:0/1542759652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61b0161800 con 0x7f61b006fe20 2024-09-12T01:43:46.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.271+0000 7f61a67fc640 1 -- 172.21.15.60:0/1542759652 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ac0308d0 con 0x7f61b006fe20 2024-09-12T01:43:46.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.271+0000 7f61b7b68640 1 -- 172.21.15.60:0/1542759652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61b014a190 con 0x7f61b006fe20 2024-09-12T01:43:46.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.272+0000 7f61b7b68640 1 -- 172.21.15.60:0/1542759652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61b015fa70 con 0x7f61b006fe20 2024-09-12T01:43:46.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.272+0000 7f61a67fc640 1 -- 172.21.15.60:0/1542759652 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f61ac044020 con 0x7f61b006fe20 2024-09-12T01:43:46.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.273+0000 7f61a67fc640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f619406be30 0x7f619406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:46.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.273+0000 7f61a67fc640 1 -- 172.21.15.60:0/1542759652 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4943+0+0 (secure 0 0 0) 0x7f61ac0aaf60 con 0x7f61b006fe20 2024-09-12T01:43:46.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.273+0000 7f61b5103640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f619406be30 0x7f619406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:46.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.273+0000 7f61b5103640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f619406be30 0x7f619406e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f61a0007fd0 tx=0x7f61a0007d60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:46.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.277+0000 7f61a67fc640 1 -- 172.21.15.60:0/1542759652 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f61ac079af0 con 0x7f61b006fe20 2024-09-12T01:43:46.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.453+0000 7f61b7b68640 1 -- 172.21.15.60:0/1542759652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f61b00b1010 con 0x7f61b006fe20 2024-09-12T01:43:46.456 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.457+0000 7f61a67fc640 1 -- 172.21.15.60:0/1542759652 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v56)=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7f61ac0793f0 con 0x7f61b006fe20 2024-09-12T01:43:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.459+0000 7f61b7b68640 1 -- 172.21.15.60:0/1542759652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f619406be30 msgr2=0x7f619406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.459+0000 7f61b7b68640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f619406be30 0x7f619406e2f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f61a0007fd0 tx=0x7f61a0007d60 comp rx=0 tx=0).stop 2024-09-12T01:43:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.459+0000 7f61b7b68640 1 -- 172.21.15.60:0/1542759652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b006fe20 msgr2=0x7f61b01531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.459+0000 7f61b7b68640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b006fe20 0x7f61b01531b0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0098c0 tx=0x7f61ac0046c0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.459+0000 7f61b7b68640 1 -- 172.21.15.60:0/1542759652 shutdown_connections 2024-09-12T01:43:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.459+0000 7f61b7b68640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f619406be30 0x7f619406e2f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.459+0000 7f61b7b68640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f61b015c2a0 0x7f61b01581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.459+0000 7f61b7b68640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f61b0073b10 0x7f61b0149c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.459+0000 7f61b7b68640 1 --2- 172.21.15.60:0/1542759652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b006fe20 0x7f61b01531b0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.459+0000 7f61b7b68640 1 -- 172.21.15.60:0/1542759652 >> 172.21.15.60:0/1542759652 conn(0x7f61b00b3070 msgr2=0x7f61b00b1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.459+0000 7f61b7b68640 1 -- 172.21.15.60:0/1542759652 shutdown_connections 2024-09-12T01:43:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.459+0000 7f61b7b68640 1 -- 172.21.15.60:0/1542759652 wait complete. 2024-09-12T01:43:46.470 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:43:46.470 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:43:46.514 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:43:46.556 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:43:46.556 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:43:46.556 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:46.572 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:43:46.572 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:43:46.573 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:46.615 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:43:46.615 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:43:46.615 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:46.632 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:43:46.632 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:43:46.632 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:43:46.675 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:43:46.675 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:43:46.676 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:43:46.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.780+0000 7f20d71b7640 1 Processor -- start 2024-09-12T01:43:46.779 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.780+0000 7f20d71b7640 1 -- start start 2024-09-12T01:43:46.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20d71b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f20d006d540 0x7f20d00cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:46.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20d71b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d006faf0 con 0x7f20d00735b0 2024-09-12T01:43:46.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20d71b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d006fdd0 con 0x7f20d015e950 2024-09-12T01:43:46.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20d71b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f20d00700b0 con 0x7f20d006d540 2024-09-12T01:43:46.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20d5754640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f20d00735b0 0x7f20d00cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59552/0 (socket says 172.21.15.60:59552) 2024-09-12T01:43:46.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20d5754640 1 -- 172.21.15.60:0/1429844078 learned_addr learned my addr 172.21.15.60:0/1429844078 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:46.781 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20cffff640 1 --2- 172.21.15.60:0/1429844078 >> v2:172.21.15.105:3300/0 conn(0x7f20d006d540 0x7f20d00cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20cf7fe640 1 -- 172.21.15.60:0/1429844078 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2013559432 0 0) 0x7f20d006faf0 con 0x7f20d00735b0 2024-09-12T01:43:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20cf7fe640 1 -- 172.21.15.60:0/1429844078 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20bc003520 con 0x7f20d00735b0 2024-09-12T01:43:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20cf7fe640 1 -- 172.21.15.60:0/1429844078 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668240657 0 0) 0x7f20d006fdd0 con 0x7f20d015e950 2024-09-12T01:43:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20cf7fe640 1 -- 172.21.15.60:0/1429844078 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20d006faf0 con 0x7f20d015e950 2024-09-12T01:43:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20cf7fe640 1 -- 172.21.15.60:0/1429844078 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2070702245 0 0) 0x7f20bc003520 con 0x7f20d00735b0 2024-09-12T01:43:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20cffff640 1 -- 172.21.15.60:0/1429844078 >> v1:172.21.15.105:6789/0 conn(0x7f20d015e950 legacy=0x7f20d006ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20cffff640 1 -- 172.21.15.60:0/1429844078 >> v1:172.21.15.60:6789/0 conn(0x7f20d00735b0 legacy=0x7f20d00cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.781+0000 7f20cffff640 1 -- 172.21.15.60:0/1429844078 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d0070390 con 0x7f20d006d540 2024-09-12T01:43:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.782+0000 7f20cffff640 1 --2- 172.21.15.60:0/1429844078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d006d540 0x7f20d00cf0a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009d90 tx=0x7f20c002a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e41e316d6408cca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.782+0000 7f20cf7fe640 1 -- 172.21.15.60:0/1429844078 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8001670 con 0x7f20d006d540 2024-09-12T01:43:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.782+0000 7f20cf7fe640 1 -- 172.21.15.60:0/1429844078 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c0007540 con 0x7f20d006d540 2024-09-12T01:43:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.782+0000 7f20cf7fe640 1 -- 172.21.15.60:0/1429844078 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c0007910 con 0x7f20d006d540 2024-09-12T01:43:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.783+0000 7f20d71b7640 1 -- 172.21.15.60:0/1429844078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d006d540 msgr2=0x7f20d00cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.783+0000 7f20d71b7640 1 --2- 172.21.15.60:0/1429844078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d006d540 0x7f20d00cf0a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009d90 tx=0x7f20c002a680 comp rx=0 tx=0).stop 2024-09-12T01:43:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.783+0000 7f20d71b7640 1 -- 172.21.15.60:0/1429844078 shutdown_connections 2024-09-12T01:43:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.783+0000 7f20d71b7640 1 --2- 172.21.15.60:0/1429844078 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d006d540 0x7f20d00cf0a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.783+0000 7f20d71b7640 1 -- 172.21.15.60:0/1429844078 >> 172.21.15.60:0/1429844078 conn(0x7f20d00d14d0 msgr2=0x7f20d00d18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.783+0000 7f20d71b7640 1 -- 172.21.15.60:0/1429844078 shutdown_connections 2024-09-12T01:43:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.783+0000 7f20d71b7640 1 -- 172.21.15.60:0/1429844078 wait complete. 2024-09-12T01:43:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.784+0000 7f20d71b7640 1 Processor -- start 2024-09-12T01:43:46.784 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.784+0000 7f20d71b7640 1 -- start start 2024-09-12T01:43:46.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20d71b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d006d540 0x7f20d00cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:46.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20d71b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d00735b0 0x7f20d014ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:46.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20d71b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d015e950 0x7f20d014b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:46.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20d71b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f20d00721d0 con 0x7f20d00735b0 2024-09-12T01:43:46.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20d71b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f20d0072050 con 0x7f20d006d540 2024-09-12T01:43:46.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20d71b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f20d0072350 con 0x7f20d015e950 2024-09-12T01:43:46.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20cffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d00735b0 0x7f20d014ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:46.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20cffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d00735b0 0x7f20d014ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37204/0 (socket says 172.21.15.60:37204) 2024-09-12T01:43:46.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20cffff640 1 -- 172.21.15.60:0/3200276558 learned_addr learned my addr 172.21.15.60:0/3200276558 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:46.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20d4f53640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d006d540 0x7f20d00cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:46.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20d5754640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d015e950 0x7f20d014b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20cffff640 1 -- 172.21.15.60:0/3200276558 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d015e950 msgr2=0x7f20d014b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20cffff640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d015e950 0x7f20d014b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20cffff640 1 -- 172.21.15.60:0/3200276558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d006d540 msgr2=0x7f20d00cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20cffff640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d006d540 0x7f20d00cc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.785+0000 7f20cffff640 1 -- 172.21.15.60:0/3200276558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d015f990 con 0x7f20d00735b0 2024-09-12T01:43:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.786+0000 7f20cffff640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d00735b0 0x7f20d014ada0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009d90 tx=0x7f20c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.786+0000 7f20cd7fa640 1 -- 172.21.15.60:0/3200276558 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c003f070 con 0x7f20d00735b0 2024-09-12T01:43:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.786+0000 7f20cd7fa640 1 -- 172.21.15.60:0/3200276558 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c0031bc0 con 0x7f20d00735b0 2024-09-12T01:43:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.786+0000 7f20d71b7640 1 -- 172.21.15.60:0/3200276558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d015fc70 con 0x7f20d00735b0 2024-09-12T01:43:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.786+0000 7f20cd7fa640 1 -- 172.21.15.60:0/3200276558 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c0009450 con 0x7f20d00735b0 2024-09-12T01:43:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.786+0000 7f20d71b7640 1 -- 172.21.15.60:0/3200276558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d0160230 con 0x7f20d00735b0 2024-09-12T01:43:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.787+0000 7f20d71b7640 1 -- 172.21.15.60:0/3200276558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d006ce30 con 0x7f20d00735b0 2024-09-12T01:43:46.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.787+0000 7f20cd7fa640 1 -- 172.21.15.60:0/3200276558 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f20c0044460 con 0x7f20d00735b0 2024-09-12T01:43:46.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.788+0000 7f20cd7fa640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f20b006be60 0x7f20b006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:46.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.788+0000 7f20d4f53640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f20b006be60 0x7f20b006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:46.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.788+0000 7f20cd7fa640 1 -- 172.21.15.60:0/3200276558 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 4943+0+0 (secure 0 0 0) 0x7f20c00ac010 con 0x7f20d00735b0 2024-09-12T01:43:46.789 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.788+0000 7f20d4f53640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f20b006be60 0x7f20b006e320 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f20c80011e0 tx=0x7f20c8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:46.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:46.792+0000 7f20cd7fa640 1 -- 172.21.15.60:0/3200276558 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f20c007a700 con 0x7f20d00735b0 2024-09-12T01:43:47.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.003+0000 7f20d71b7640 1 -- 172.21.15.60:0/3200276558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20d00d0f30 con 0x7f20d00735b0 2024-09-12T01:43:47.003 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.003+0000 7f20cd7fa640 1 -- 172.21.15.60:0/3200276558 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+3917 (secure 0 0 0) 0x7f20c007ea00 con 0x7f20d00735b0 2024-09-12T01:43:47.003 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:47.003 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":74,"btime":"2024-09-12T01:43:41:123714+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6892,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2206957364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2206957364},{"type":"v1","addr":"172.21.15.105:6835","nonce":2206957364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7144,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3485042113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3485042113},{"type":"v1","addr":"172.21.15.105:6834","nonce":3485042113}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":74},{"gid":7536,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/3802062072","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3802062072},{"type":"v1","addr":"172.21.15.60:6836","nonce":3802062072}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66},{"gid":7542,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3557949323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":3557949323},{"type":"v1","addr":"172.21.15.60:6837","nonce":3557949323}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":66}],"filesystems":[]} 2024-09-12T01:43:47.003 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 74 2024-09-12T01:43:47.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.006+0000 7f20d71b7640 1 -- 172.21.15.60:0/3200276558 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f20b006be60 msgr2=0x7f20b006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:47.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.006+0000 7f20d71b7640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f20b006be60 0x7f20b006e320 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f20c80011e0 tx=0x7f20c8009040 comp rx=0 tx=0).stop 2024-09-12T01:43:47.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.006+0000 7f20d71b7640 1 -- 172.21.15.60:0/3200276558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d00735b0 msgr2=0x7f20d014ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:47.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.006+0000 7f20d71b7640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d00735b0 0x7f20d014ada0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f20c0009d90 tx=0x7f20c0004a40 comp rx=0 tx=0).stop 2024-09-12T01:43:47.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.006+0000 7f20d71b7640 1 -- 172.21.15.60:0/3200276558 shutdown_connections 2024-09-12T01:43:47.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.006+0000 7f20d71b7640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f20b006be60 0x7f20b006e320 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:47.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.006+0000 7f20d71b7640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f20d015e950 0x7f20d014b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:47.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.006+0000 7f20d71b7640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20d00735b0 0x7f20d014ada0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:47.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.006+0000 7f20d71b7640 1 --2- 172.21.15.60:0/3200276558 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f20d006d540 0x7f20d00cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:47.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.006+0000 7f20d71b7640 1 -- 172.21.15.60:0/3200276558 >> 172.21.15.60:0/3200276558 conn(0x7f20d00d14d0 msgr2=0x7f20d00728f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:47.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.006+0000 7f20d71b7640 1 -- 172.21.15.60:0/3200276558 shutdown_connections 2024-09-12T01:43:47.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.006+0000 7f20d71b7640 1 -- 172.21.15.60:0/3200276558 wait complete. 2024-09-12T01:43:47.016 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:43:47.017 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:43:47.017 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:43:47.017 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:43:47.017 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:43:47.017 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:43:47.017 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:43:47.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:43:47.018 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:43:47.018 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:43:47.018 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:43:47.018 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:43:47.018 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:43:47.019 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:43:47.019 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:43:47.019 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:43:47.027 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:43:47.027 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:43:47.027 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:43:47.028 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:43:47.030 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:43:47.030 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:43:47.031 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:43:47.031 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:43:47.070 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:43:47.070 DEBUG:teuthology.parallel:result is None 2024-09-12T01:43:47.071 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:43:47.071 DEBUG:teuthology.parallel:result is None 2024-09-12T01:43:47.072 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:43:47.072 DEBUG:teuthology.parallel:result is None 2024-09-12T01:43:47.073 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:43:47.073 DEBUG:teuthology.parallel:result is None 2024-09-12T01:43:47.073 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:43:47.148 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2024-09-12T01:43:47.148 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2024-09-12T01:43:47.157 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:43:47.157 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:43:47.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.182+0000 7f6e3cdb7640 1 Processor -- start 2024-09-12T01:43:47.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.182+0000 7f6e3cdb7640 1 -- start start 2024-09-12T01:43:47.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.183+0000 7f6e3cdb7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e3815e7a0 0x7f6e3806caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:47.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e3cdb7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6e380b68f0 0x7f6e380d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:47.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e3cdb7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e380cf860 con 0x7f6e380cf1f0 2024-09-12T01:43:47.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e3cdb7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6e380d2ca0 con 0x7f6e3815e7a0 2024-09-12T01:43:47.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e3cdb7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6e380cfb40 con 0x7f6e380b68f0 2024-09-12T01:43:47.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e3659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e3815e7a0 0x7f6e3806caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:47.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e35d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6e380cf1f0 0x7f6e380b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59568/0 (socket says 172.21.15.60:59568) 2024-09-12T01:43:47.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e3659c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e3815e7a0 0x7f6e3806caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37246/0 (socket says 172.21.15.60:37246) 2024-09-12T01:43:47.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e35d9b640 1 -- 172.21.15.60:0/705009742 learned_addr learned my addr 172.21.15.60:0/705009742 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:47.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e36d9d640 1 --2- 172.21.15.60:0/705009742 >> v2:172.21.15.105:3300/0 conn(0x7f6e380b68f0 0x7f6e380d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:47.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e3659c640 1 -- 172.21.15.60:0/705009742 >> v2:172.21.15.105:3300/0 conn(0x7f6e380b68f0 msgr2=0x7f6e380d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:47.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e3659c640 1 --2- 172.21.15.60:0/705009742 >> v2:172.21.15.105:3300/0 conn(0x7f6e380b68f0 0x7f6e380d3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:47.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e3559a640 1 -- 172.21.15.60:0/705009742 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531663754 0 0) 0x7f6e380cf860 con 0x7f6e380cf1f0 2024-09-12T01:43:47.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e3659c640 1 -- 172.21.15.60:0/705009742 >> v1:172.21.15.60:6789/0 conn(0x7f6e380cf1f0 legacy=0x7f6e380b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:47.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e3659c640 1 -- 172.21.15.60:0/705009742 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e380cfe20 con 0x7f6e3815e7a0 2024-09-12T01:43:47.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.184+0000 7f6e36d9d640 1 --2- 172.21.15.60:0/705009742 >> v2:172.21.15.105:3300/0 conn(0x7f6e380b68f0 0x7f6e380d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:47.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.185+0000 7f6e3659c640 1 --2- 172.21.15.60:0/705009742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e3815e7a0 0x7f6e3806caa0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f6e3808d930 tx=0x7f6e2802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae0f17d609b7130 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:47.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.185+0000 7f6e3559a640 1 -- 172.21.15.60:0/705009742 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28037070 con 0x7f6e3815e7a0 2024-09-12T01:43:47.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.185+0000 7f6e3559a640 1 -- 172.21.15.60:0/705009742 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e28032440 con 0x7f6e3815e7a0 2024-09-12T01:43:47.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.185+0000 7f6e3559a640 1 -- 172.21.15.60:0/705009742 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2802ae60 con 0x7f6e3815e7a0 2024-09-12T01:43:47.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.185+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/705009742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e3815e7a0 msgr2=0x7f6e3806caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.186+0000 7f6e3cdb7640 1 --2- 172.21.15.60:0/705009742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e3815e7a0 0x7f6e3806caa0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f6e3808d930 tx=0x7f6e2802a110 comp rx=0 tx=0).stop 2024-09-12T01:43:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.186+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/705009742 shutdown_connections 2024-09-12T01:43:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.186+0000 7f6e3cdb7640 1 --2- 172.21.15.60:0/705009742 >> v2:172.21.15.105:3300/0 conn(0x7f6e380b68f0 0x7f6e380d3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.186+0000 7f6e3cdb7640 1 --2- 172.21.15.60:0/705009742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e3815e7a0 0x7f6e3806caa0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.186+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/705009742 >> 172.21.15.60:0/705009742 conn(0x7f6e380d11e0 msgr2=0x7f6e380d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.186+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/705009742 shutdown_connections 2024-09-12T01:43:47.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.186+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/705009742 wait complete. 2024-09-12T01:43:47.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.187+0000 7f6e3cdb7640 1 Processor -- start 2024-09-12T01:43:47.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.187+0000 7f6e3cdb7640 1 -- start start 2024-09-12T01:43:47.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.188+0000 7f6e3cdb7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e380b68f0 0x7f6e381e9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:47.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.188+0000 7f6e3cdb7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e380cf1f0 0x7f6e3815ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.188+0000 7f6e3cdb7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e3815e7a0 0x7f6e3815f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.188+0000 7f6e3cdb7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3806cfe0 con 0x7f6e380cf1f0 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.188+0000 7f6e3cdb7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6e380b7a00 con 0x7f6e380b68f0 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.188+0000 7f6e3cdb7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3815eb80 con 0x7f6e3815e7a0 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.188+0000 7f6e35d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e380cf1f0 0x7f6e3815ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.188+0000 7f6e35d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e380cf1f0 0x7f6e3815ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37258/0 (socket says 172.21.15.60:37258) 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.188+0000 7f6e35d9b640 1 -- 172.21.15.60:0/477542614 learned_addr learned my addr 172.21.15.60:0/477542614 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.188+0000 7f6e3659c640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e380b68f0 0x7f6e381e9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.188+0000 7f6e36d9d640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e3815e7a0 0x7f6e3815f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.189+0000 7f6e35d9b640 1 -- 172.21.15.60:0/477542614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e3815e7a0 msgr2=0x7f6e3815f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.189+0000 7f6e35d9b640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e3815e7a0 0x7f6e3815f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.189+0000 7f6e35d9b640 1 -- 172.21.15.60:0/477542614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e380b68f0 msgr2=0x7f6e381e9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:47.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.189+0000 7f6e35d9b640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e380b68f0 0x7f6e381e9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:47.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.189+0000 7f6e35d9b640 1 -- 172.21.15.60:0/477542614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e381e97f0 con 0x7f6e380cf1f0 2024-09-12T01:43:47.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.189+0000 7f6e3659c640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e380b68f0 0x7f6e381e9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:47.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.189+0000 7f6e35d9b640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e380cf1f0 0x7f6e3815ee20 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c4d0 tx=0x7f6e2c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:47.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.189+0000 7f6e26ffd640 1 -- 172.21.15.60:0/477542614 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c018070 con 0x7f6e380cf1f0 2024-09-12T01:43:47.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.189+0000 7f6e26ffd640 1 -- 172.21.15.60:0/477542614 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e2c007500 con 0x7f6e380cf1f0 2024-09-12T01:43:47.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.189+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/477542614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e381e9ad0 con 0x7f6e380cf1f0 2024-09-12T01:43:47.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.189+0000 7f6e26ffd640 1 -- 172.21.15.60:0/477542614 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2c004a20 con 0x7f6e380cf1f0 2024-09-12T01:43:47.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.189+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/477542614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e381ea090 con 0x7f6e380cf1f0 2024-09-12T01:43:47.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.190+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/477542614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3806caa0 con 0x7f6e380cf1f0 2024-09-12T01:43:47.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.190+0000 7f6e26ffd640 1 -- 172.21.15.60:0/477542614 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e2c01b070 con 0x7f6e380cf1f0 2024-09-12T01:43:47.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.191+0000 7f6e26ffd640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e1806be30 0x7f6e1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:47.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.191+0000 7f6e26ffd640 1 -- 172.21.15.60:0/477542614 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 4943+0+0 (secure 0 0 0) 0x7f6e2c089e40 con 0x7f6e380cf1f0 2024-09-12T01:43:47.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.191+0000 7f6e3659c640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e1806be30 0x7f6e1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:47.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.191+0000 7f6e3659c640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e1806be30 0x7f6e1806e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6e28034000 tx=0x7f6e2802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:47.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.195+0000 7f6e26ffd640 1 -- 172.21.15.60:0/477542614 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6e2c0584a0 con 0x7f6e380cf1f0 2024-09-12T01:43:47.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:47.382+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/477542614 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f6e380d2a80 con 0x7f6e380cf1f0 2024-09-12T01:43:48.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.163+0000 7f6e26ffd640 1 -- 172.21.15.60:0/477542614 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v123) ==== 97+0+0 (secure 0 0 0) 0x7f6e2c05c7a0 con 0x7f6e380cf1f0 2024-09-12T01:43:48.163 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2024-09-12T01:43:48.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.167+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/477542614 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e1806be30 msgr2=0x7f6e1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.167+0000 7f6e3cdb7640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e1806be30 0x7f6e1806e2f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6e28034000 tx=0x7f6e2802e000 comp rx=0 tx=0).stop 2024-09-12T01:43:48.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.167+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/477542614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e380cf1f0 msgr2=0x7f6e3815ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.167+0000 7f6e3cdb7640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e380cf1f0 0x7f6e3815ee20 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c00c4d0 tx=0x7f6e2c00c990 comp rx=0 tx=0).stop 2024-09-12T01:43:48.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.167+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/477542614 shutdown_connections 2024-09-12T01:43:48.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.167+0000 7f6e3cdb7640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e1806be30 0x7f6e1806e2f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.167+0000 7f6e3cdb7640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e3815e7a0 0x7f6e3815f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.167+0000 7f6e3cdb7640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e380cf1f0 0x7f6e3815ee20 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.167+0000 7f6e3cdb7640 1 --2- 172.21.15.60:0/477542614 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e380b68f0 0x7f6e381e9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.167+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/477542614 >> 172.21.15.60:0/477542614 conn(0x7f6e380d11e0 msgr2=0x7f6e380b8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:48.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.167+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/477542614 shutdown_connections 2024-09-12T01:43:48.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.167+0000 7f6e3cdb7640 1 -- 172.21.15.60:0/477542614 wait complete. 2024-09-12T01:43:48.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:43:48.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.291+0000 7f3946113640 1 Processor -- start 2024-09-12T01:43:48.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.291+0000 7f3946113640 1 -- start start 2024-09-12T01:43:48.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.291+0000 7f3946113640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f39400d3310 0x7f39400d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f3946113640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394015ea40 con 0x7f394015e660 2024-09-12T01:43:48.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f3946113640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39400d3870 con 0x7f39400d1650 2024-09-12T01:43:48.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f3946113640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f39400d1ac0 con 0x7f39400d3310 2024-09-12T01:43:48.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393f7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f394015e660 0x7f39400cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59570/0 (socket says 172.21.15.60:59570) 2024-09-12T01:43:48.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393f7fe640 1 -- 172.21.15.60:0/2195302270 learned_addr learned my addr 172.21.15.60:0/2195302270 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:48.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2703380697 0 0) 0x7f394015ea40 con 0x7f394015e660 2024-09-12T01:43:48.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393effd640 1 --2- 172.21.15.60:0/2195302270 >> v2:172.21.15.105:3300/0 conn(0x7f39400d3310 0x7f39400d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3928003520 con 0x7f394015e660 2024-09-12T01:43:48.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3928204127 0 0) 0x7f3928003520 con 0x7f394015e660 2024-09-12T01:43:48.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 >> v2:172.21.15.105:3300/0 conn(0x7f39400d3310 msgr2=0x7f39400d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:48.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 --2- 172.21.15.60:0/2195302270 >> v2:172.21.15.105:3300/0 conn(0x7f39400d3310 0x7f39400d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 >> v1:172.21.15.105:6789/0 conn(0x7f39400d1650 legacy=0x7f39400b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39400d3b50 con 0x7f394015e660 2024-09-12T01:43:48.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f3930001670 con 0x7f394015e660 2024-09-12T01:43:48.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 >> v1:172.21.15.60:6789/0 conn(0x7f394015e660 legacy=0x7f39400cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 --2- 172.21.15.60:0/2195302270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39280039b0 0x7f3928003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 --2- 172.21.15.60:0/2195302270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3928004800 0x7f3928004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 --2- 172.21.15.60:0/2195302270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39280051c0 0x7f392800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39400d1ac0 con 0x7f39280051c0 2024-09-12T01:43:48.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f392800c060 con 0x7f39280039b0 2024-09-12T01:43:48.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.292+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f392800c260 con 0x7f3928004800 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.293+0000 7f393ffff640 1 --2- 172.21.15.60:0/2195302270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39280051c0 0x7f392800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.293+0000 7f393f7fe640 1 --2- 172.21.15.60:0/2195302270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39280039b0 0x7f3928003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.293+0000 7f393effd640 1 --2- 172.21.15.60:0/2195302270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3928004800 0x7f3928004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.293+0000 7f393ffff640 1 -- 172.21.15.60:0/2195302270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3928004800 msgr2=0x7f3928004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.293+0000 7f393ffff640 1 --2- 172.21.15.60:0/2195302270 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3928004800 0x7f3928004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.293+0000 7f393ffff640 1 -- 172.21.15.60:0/2195302270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39280039b0 msgr2=0x7f3928003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.293+0000 7f393ffff640 1 --2- 172.21.15.60:0/2195302270 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39280039b0 0x7f3928003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.293+0000 7f393ffff640 1 -- 172.21.15.60:0/2195302270 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3928003520 con 0x7f39280051c0 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.293+0000 7f393ffff640 1 -- 172.21.15.60:0/2195302270 reap_dead start 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.294+0000 7f393ffff640 1 --2- 172.21.15.60:0/2195302270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39280051c0 0x7f392800b9c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f3938001e50 tx=0x7f3928005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77557a783c62d2fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.294+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938001a70 con 0x7f39280051c0 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.294+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3938003970 con 0x7f39280051c0 2024-09-12T01:43:48.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.294+0000 7f393e7fc640 1 -- 172.21.15.60:0/2195302270 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3938003d60 con 0x7f39280051c0 2024-09-12T01:43:48.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.294+0000 7f3946113640 1 -- 172.21.15.60:0/2195302270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39280051c0 msgr2=0x7f392800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.294+0000 7f3946113640 1 --2- 172.21.15.60:0/2195302270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39280051c0 0x7f392800b9c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f3938001e50 tx=0x7f3928005830 comp rx=0 tx=0).stop 2024-09-12T01:43:48.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.294+0000 7f3946113640 1 -- 172.21.15.60:0/2195302270 shutdown_connections 2024-09-12T01:43:48.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.294+0000 7f3946113640 1 --2- 172.21.15.60:0/2195302270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39280051c0 0x7f392800b9c0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.294+0000 7f3946113640 1 -- 172.21.15.60:0/2195302270 >> 172.21.15.60:0/2195302270 conn(0x7f39400b6410 msgr2=0x7f39400b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:48.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.294+0000 7f3946113640 1 -- 172.21.15.60:0/2195302270 shutdown_connections 2024-09-12T01:43:48.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.294+0000 7f3946113640 1 -- 172.21.15.60:0/2195302270 wait complete. 2024-09-12T01:43:48.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.295+0000 7f3946113640 1 Processor -- start 2024-09-12T01:43:48.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.296+0000 7f3946113640 1 -- start start 2024-09-12T01:43:48.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.296+0000 7f3946113640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39280051c0 0x7f3940160980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.296+0000 7f3946113640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400cb7d0 0x7f39401519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.296+0000 7f3946113640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f394015bef0 0x7f394015c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.296+0000 7f3946113640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39400d43f0 con 0x7f39400cb7d0 2024-09-12T01:43:48.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.296+0000 7f3946113640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39400d4110 con 0x7f394015bef0 2024-09-12T01:43:48.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.296+0000 7f3946113640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39400d1110 con 0x7f39280051c0 2024-09-12T01:43:48.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f393effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400cb7d0 0x7f39401519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f393effd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400cb7d0 0x7f39401519d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37280/0 (socket says 172.21.15.60:37280) 2024-09-12T01:43:48.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f393effd640 1 -- 172.21.15.60:0/3709089275 learned_addr learned my addr 172.21.15.60:0/3709089275 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:48.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f393ffff640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f394015bef0 0x7f394015c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f393f7fe640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39280051c0 0x7f3940160980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f393effd640 1 -- 172.21.15.60:0/3709089275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39280051c0 msgr2=0x7f3940160980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f393effd640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39280051c0 0x7f3940160980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f393effd640 1 -- 172.21.15.60:0/3709089275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f394015bef0 msgr2=0x7f394015c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f393effd640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f394015bef0 0x7f394015c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f393effd640 1 -- 172.21.15.60:0/3709089275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39400ccac0 con 0x7f39400cb7d0 2024-09-12T01:43:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f393effd640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400cb7d0 0x7f39401519d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f3934011940 tx=0x7f3934011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f3927fff640 1 -- 172.21.15.60:0/3709089275 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393400faf0 con 0x7f39400cb7d0 2024-09-12T01:43:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f3927fff640 1 -- 172.21.15.60:0/3709089275 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f393400fc90 con 0x7f39400cb7d0 2024-09-12T01:43:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f3946113640 1 -- 172.21.15.60:0/3709089275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39400cbf40 con 0x7f39400cb7d0 2024-09-12T01:43:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f3927fff640 1 -- 172.21.15.60:0/3709089275 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934014440 con 0x7f39400cb7d0 2024-09-12T01:43:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.297+0000 7f3946113640 1 -- 172.21.15.60:0/3709089275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39400cc500 con 0x7f39400cb7d0 2024-09-12T01:43:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.298+0000 7f3946113640 1 -- 172.21.15.60:0/3709089275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39400cf730 con 0x7f39400cb7d0 2024-09-12T01:43:48.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.299+0000 7f3927fff640 1 -- 172.21.15.60:0/3709089275 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3934012040 con 0x7f39400cb7d0 2024-09-12T01:43:48.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.299+0000 7f3927fff640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f392c06be30 0x7f392c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.299+0000 7f393f7fe640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f392c06be30 0x7f392c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.299+0000 7f3927fff640 1 -- 172.21.15.60:0/3709089275 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4857+0+0 (secure 0 0 0) 0x7f393408b140 con 0x7f39400cb7d0 2024-09-12T01:43:48.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.300+0000 7f393f7fe640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f392c06be30 0x7f392c06e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f39401f7970 tx=0x7f3930009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:48.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.304+0000 7f3927fff640 1 -- 172.21.15.60:0/3709089275 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3934019030 con 0x7f39400cb7d0 2024-09-12T01:43:48.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.548+0000 7f3946113640 1 -- 172.21.15.60:0/3709089275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f39401539d0 con 0x7f39400cb7d0 2024-09-12T01:43:48.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.548+0000 7f3927fff640 1 -- 172.21.15.60:0/3709089275 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f3934059e40 con 0x7f39400cb7d0 2024-09-12T01:43:48.548 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:48.548 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:43:48.548 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2024-09-12T01:43:48.548 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.548 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2024-09-12T01:43:48.548 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmIK3fKxAAM9RkghDZwJZWuKouIbObDw==", 2024-09-12T01:43:48.548 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.548 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:48.548 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmzqHZNxAAnhCo4gGwLgYDVzzYnoiDFA==", 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmksMWMxAAp3xMDD09rfphgPZwQcEABA==", 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmvLw/AxAApd4hl5LRD1QddnPPjRw2Kg==", 2024-09-12T01:43:48.550 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA7ReJmc3D/JxAAXiw6n1Q3n9sCXln6YSiCBA==", 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:48.551 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.552 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2024-09-12T01:43:48.552 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA/ReJmEOu3CxAA4uu1neLh0mpeG9nia+/VqQ==", 2024-09-12T01:43:48.552 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.552 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:48.552 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:48.552 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBCReJm3HHtDhAAoAdKVsjuXmpcf5R5zTtFKg==", 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBFReJmtRLuIBAA/BBibpGfpXsFXqVjVrmXWA==", 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.553 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:48.554 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:48.554 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.554 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.554 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2024-09-12T01:43:48.554 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBMReJmdDNXKhAAeh5aCvMw+70z3tnwjb9Hjg==", 2024-09-12T01:43:48.554 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.554 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:48.554 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:48.554 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.554 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBQReJm/tsIHRAAmgx+5WifY/VITGHAbUV2CQ==", 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2024-09-12T01:43:48.555 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBUReJmQFaBHhAA1vH01tePCoJQFXlHB5gcVg==", 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBYReJmTHqLAhAAtUB94Pa3eihlVdaupZ8Ggg==", 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:43:48.556 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.557 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.557 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2024-09-12T01:43:48.557 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ==", 2024-09-12T01:43:48.557 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.557 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:48.557 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2024-09-12T01:43:48.557 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T01:43:48.557 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmTopGEBAAY0K3iZm2PotQc8a489uO/Q==", 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.558 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2024-09-12T01:43:48.559 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmqUgQDRAAAp5SAwNM9aSxZ1VVRwroNA==", 2024-09-12T01:43:48.559 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.559 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:48.559 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:43:48.559 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:43:48.559 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:43:48.559 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.559 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.559 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2024-09-12T01:43:48.559 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmGfzeFRAAE2xCnzeyX/KBo3NBrkixYQ==", 2024-09-12T01:43:48.559 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmOfXYDxAA0hydSyRvFmmNvFcRwPaXqg==", 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:43:48.560 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmjpyMKBAAMSGgYJddHs7TtCV0NszZAQ==", 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:43:48.561 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.562 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2024-09-12T01:43:48.562 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJm3Ei+JBAAhwgXWq0baTlDtaLedcaHmg==", 2024-09-12T01:43:48.562 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:43:48.562 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:43:48.562 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:43:48.562 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:43:48.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.562 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T01:43:48.562 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:43:48.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.550+0000 7f3946113640 1 -- 172.21.15.60:0/3709089275 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f392c06be30 msgr2=0x7f392c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.550+0000 7f3946113640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f392c06be30 0x7f392c06e2f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f39401f7970 tx=0x7f3930009040 comp rx=0 tx=0).stop 2024-09-12T01:43:48.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.550+0000 7f3946113640 1 -- 172.21.15.60:0/3709089275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400cb7d0 msgr2=0x7f39401519d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.550+0000 7f3946113640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400cb7d0 0x7f39401519d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f3934011940 tx=0x7f3934011e00 comp rx=0 tx=0).stop 2024-09-12T01:43:48.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.550+0000 7f3946113640 1 -- 172.21.15.60:0/3709089275 shutdown_connections 2024-09-12T01:43:48.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.550+0000 7f3946113640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f394015bef0 0x7f394015c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.550+0000 7f3946113640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39400cb7d0 0x7f39401519d0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.550+0000 7f3946113640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f392c06be30 0x7f392c06e2f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.550+0000 7f3946113640 1 --2- 172.21.15.60:0/3709089275 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39280051c0 0x7f3940160980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.550+0000 7f3946113640 1 -- 172.21.15.60:0/3709089275 >> 172.21.15.60:0/3709089275 conn(0x7f39400b6410 msgr2=0x7f39400b5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:48.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.550+0000 7f3946113640 1 -- 172.21.15.60:0/3709089275 shutdown_connections 2024-09-12T01:43:48.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.550+0000 7f3946113640 1 -- 172.21.15.60:0/3709089275 wait complete. 2024-09-12T01:43:48.565 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:43:48.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.667+0000 7f30d474b640 1 Processor -- start 2024-09-12T01:43:48.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.667+0000 7f30d474b640 1 -- start start 2024-09-12T01:43:48.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.668+0000 7f30d474b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30cc15e660 0x7f30cc0cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.668+0000 7f30d474b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f30cc0d3310 0x7f30cc0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.668+0000 7f30d474b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30cc15ea40 con 0x7f30cc0d1650 2024-09-12T01:43:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.668+0000 7f30d474b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f30cc0d1ac0 con 0x7f30cc15e660 2024-09-12T01:43:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.668+0000 7f30d474b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f30cc0d3870 con 0x7f30cc0d3310 2024-09-12T01:43:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.668+0000 7f30d24e7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30cc15e660 0x7f30cc0cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.668+0000 7f30d24e7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30cc15e660 0x7f30cc0cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37294/0 (socket says 172.21.15.60:37294) 2024-09-12T01:43:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.668+0000 7f30d24e7640 1 -- 172.21.15.60:0/1764803021 learned_addr learned my addr 172.21.15.60:0/1764803021 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.669+0000 7f30d1ce6640 1 --2- 172.21.15.60:0/1764803021 >> v2:172.21.15.105:3300/0 conn(0x7f30cc0d3310 0x7f30cc0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.669+0000 7f30d24e7640 1 -- 172.21.15.60:0/1764803021 >> v2:172.21.15.105:3300/0 conn(0x7f30cc0d3310 msgr2=0x7f30cc0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.669+0000 7f30d24e7640 1 --2- 172.21.15.60:0/1764803021 >> v2:172.21.15.105:3300/0 conn(0x7f30cc0d3310 0x7f30cc0d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.669+0000 7f30d24e7640 1 -- 172.21.15.60:0/1764803021 >> v1:172.21.15.105:6789/0 conn(0x7f30cc0d1650 legacy=0x7f30cc06bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.669+0000 7f30d24e7640 1 -- 172.21.15.60:0/1764803021 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30cc0d3b50 con 0x7f30cc15e660 2024-09-12T01:43:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.669+0000 7f30d1ce6640 1 --2- 172.21.15.60:0/1764803021 >> v2:172.21.15.105:3300/0 conn(0x7f30cc0d3310 0x7f30cc0d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.669+0000 7f30d24e7640 1 --2- 172.21.15.60:0/1764803021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc15e660 0x7f30cc0cf730 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0c8020 tx=0x7f30bc02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9032aeff9e35b3cf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.670+0000 7f30d14e5640 1 -- 172.21.15.60:0/1764803021 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc036070 con 0x7f30cc15e660 2024-09-12T01:43:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.670+0000 7f30d14e5640 1 -- 172.21.15.60:0/1764803021 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30bc031600 con 0x7f30cc15e660 2024-09-12T01:43:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.670+0000 7f30d14e5640 1 -- 172.21.15.60:0/1764803021 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0319d0 con 0x7f30cc15e660 2024-09-12T01:43:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.670+0000 7f30d474b640 1 -- 172.21.15.60:0/1764803021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc15e660 msgr2=0x7f30cc0cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.670+0000 7f30d474b640 1 --2- 172.21.15.60:0/1764803021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc15e660 0x7f30cc0cf730 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0c8020 tx=0x7f30bc02a6f0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.670+0000 7f30d474b640 1 -- 172.21.15.60:0/1764803021 shutdown_connections 2024-09-12T01:43:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.670+0000 7f30d474b640 1 --2- 172.21.15.60:0/1764803021 >> v2:172.21.15.105:3300/0 conn(0x7f30cc0d3310 0x7f30cc0d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.670+0000 7f30d474b640 1 --2- 172.21.15.60:0/1764803021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc15e660 0x7f30cc0cf730 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.670+0000 7f30d474b640 1 -- 172.21.15.60:0/1764803021 >> 172.21.15.60:0/1764803021 conn(0x7f30cc0b6410 msgr2=0x7f30cc0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:48.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.670+0000 7f30d474b640 1 -- 172.21.15.60:0/1764803021 shutdown_connections 2024-09-12T01:43:48.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.670+0000 7f30d474b640 1 -- 172.21.15.60:0/1764803021 wait complete. 2024-09-12T01:43:48.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.671+0000 7f30d474b640 1 Processor -- start 2024-09-12T01:43:48.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.671+0000 7f30d474b640 1 -- start start 2024-09-12T01:43:48.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.672+0000 7f30d474b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0d1650 0x7f30cc15ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.672+0000 7f30d474b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30cc0d3310 0x7f30cc15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.672+0000 7f30d474b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30cc15e660 0x7f30cc1600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.672+0000 7f30d474b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc0d43f0 con 0x7f30cc0d1650 2024-09-12T01:43:48.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.672+0000 7f30d474b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc0d4110 con 0x7f30cc15e660 2024-09-12T01:43:48.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.672+0000 7f30d474b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f30cc0cfc70 con 0x7f30cc0d3310 2024-09-12T01:43:48.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.672+0000 7f30d24e7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0d1650 0x7f30cc15ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.672+0000 7f30d24e7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0d1650 0x7f30cc15ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37298/0 (socket says 172.21.15.60:37298) 2024-09-12T01:43:48.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.672+0000 7f30d24e7640 1 -- 172.21.15.60:0/4255914119 learned_addr learned my addr 172.21.15.60:0/4255914119 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.672+0000 7f30d2ce8640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30cc15e660 0x7f30cc1600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.672+0000 7f30d1ce6640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30cc0d3310 0x7f30cc15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30d24e7640 1 -- 172.21.15.60:0/4255914119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30cc0d3310 msgr2=0x7f30cc15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30d24e7640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30cc0d3310 0x7f30cc15cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30d24e7640 1 -- 172.21.15.60:0/4255914119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30cc15e660 msgr2=0x7f30cc1600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30d24e7640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30cc15e660 0x7f30cc1600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30d24e7640 1 -- 172.21.15.60:0/4255914119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30cc0c8230 con 0x7f30cc0d1650 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30d2ce8640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30cc15e660 0x7f30cc1600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30d1ce6640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30cc0d3310 0x7f30cc15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30d24e7640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0d1650 0x7f30cc15ca40 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009f40 tx=0x7f30bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30caffd640 1 -- 172.21.15.60:0/4255914119 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc036050 con 0x7f30cc0d1650 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30caffd640 1 -- 172.21.15.60:0/4255914119 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30bc042070 con 0x7f30cc0d1650 2024-09-12T01:43:48.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30d474b640 1 -- 172.21.15.60:0/4255914119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30cc0c8510 con 0x7f30cc0d1650 2024-09-12T01:43:48.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30caffd640 1 -- 172.21.15.60:0/4255914119 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc009510 con 0x7f30cc0d1650 2024-09-12T01:43:48.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.673+0000 7f30d474b640 1 -- 172.21.15.60:0/4255914119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30cc0c8ad0 con 0x7f30cc0d1650 2024-09-12T01:43:48.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.674+0000 7f30d474b640 1 -- 172.21.15.60:0/4255914119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30cc0d1110 con 0x7f30cc0d1650 2024-09-12T01:43:48.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.674+0000 7f30caffd640 1 -- 172.21.15.60:0/4255914119 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30bc007c50 con 0x7f30cc0d1650 2024-09-12T01:43:48.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.675+0000 7f30caffd640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f30b806be60 0x7f30b806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.675+0000 7f30caffd640 1 -- 172.21.15.60:0/4255914119 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4857+0+0 (secure 0 0 0) 0x7f30bc0abae0 con 0x7f30cc0d1650 2024-09-12T01:43:48.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.675+0000 7f30d1ce6640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f30b806be60 0x7f30b806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.675+0000 7f30d1ce6640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f30b806be60 0x7f30b806e320 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f30c0006fd0 tx=0x7f30c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:48.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.679+0000 7f30caffd640 1 -- 172.21.15.60:0/4255914119 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f30bc07a7e0 con 0x7f30cc0d1650 2024-09-12T01:43:48.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.856+0000 7f30d474b640 1 -- 172.21.15.60:0/4255914119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f30cc0b6d10 con 0x7f30cc0d1650 2024-09-12T01:43:48.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.856+0000 7f30caffd640 1 -- 172.21.15.60:0/4255914119 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v124) ==== 84+0+65 (secure 0 0 0) 0x7f30bc07a0e0 con 0x7f30cc0d1650 2024-09-12T01:43:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:48.856 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T01:43:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:43:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T01:43:48.856 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T01:43:48.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:43:48.857 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T01:43:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.858+0000 7f30d474b640 1 -- 172.21.15.60:0/4255914119 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f30b806be60 msgr2=0x7f30b806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.858+0000 7f30d474b640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f30b806be60 0x7f30b806e320 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f30c0006fd0 tx=0x7f30c0008040 comp rx=0 tx=0).stop 2024-09-12T01:43:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.858+0000 7f30d474b640 1 -- 172.21.15.60:0/4255914119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0d1650 msgr2=0x7f30cc15ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.858+0000 7f30d474b640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0d1650 0x7f30cc15ca40 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009f40 tx=0x7f30bc004a40 comp rx=0 tx=0).stop 2024-09-12T01:43:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.858+0000 7f30d474b640 1 -- 172.21.15.60:0/4255914119 shutdown_connections 2024-09-12T01:43:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.858+0000 7f30d474b640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30cc15e660 0x7f30cc1600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.858+0000 7f30d474b640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f30b806be60 0x7f30b806e320 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.858+0000 7f30d474b640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30cc0d3310 0x7f30cc15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.858+0000 7f30d474b640 1 --2- 172.21.15.60:0/4255914119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0d1650 0x7f30cc15ca40 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.858+0000 7f30d474b640 1 -- 172.21.15.60:0/4255914119 >> 172.21.15.60:0/4255914119 conn(0x7f30cc0b6410 msgr2=0x7f30cc0b9ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:48.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.858+0000 7f30d474b640 1 -- 172.21.15.60:0/4255914119 shutdown_connections 2024-09-12T01:43:48.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.858+0000 7f30d474b640 1 -- 172.21.15.60:0/4255914119 wait complete. 2024-09-12T01:43:48.868 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:43:48.869 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:43:48.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.975+0000 7f231e8ac640 1 Processor -- start 2024-09-12T01:43:48.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.975+0000 7f231e8ac640 1 -- start start 2024-09-12T01:43:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.976+0000 7f231e8ac640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f231815b480 0x7f23180b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.976+0000 7f231e8ac640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23180ccff0 con 0x7f23180b60c0 2024-09-12T01:43:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.976+0000 7f231e8ac640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23180cd2d0 con 0x7f2318072700 2024-09-12T01:43:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.976+0000 7f231e8ac640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f23180cd5b0 con 0x7f231815b480 2024-09-12T01:43:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.976+0000 7f23177fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f23180b60c0 0x7f2318071ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59576/0 (socket says 172.21.15.60:59576) 2024-09-12T01:43:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.976+0000 7f23177fe640 1 -- 172.21.15.60:0/681054173 learned_addr learned my addr 172.21.15.60:0/681054173 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.976+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1883324525 0 0) 0x7f23180ccff0 con 0x7f23180b60c0 2024-09-12T01:43:48.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.976+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2300003520 con 0x7f23180b60c0 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.976+0000 7f2317fff640 1 --2- 172.21.15.60:0/681054173 >> v2:172.21.15.105:3300/0 conn(0x7f231815b480 0x7f23180b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.976+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 459634149 0 0) 0x7f2300003520 con 0x7f23180b60c0 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.976+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 >> v2:172.21.15.105:3300/0 conn(0x7f231815b480 msgr2=0x7f23180b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.976+0000 7f2316ffd640 1 --2- 172.21.15.60:0/681054173 >> v2:172.21.15.105:3300/0 conn(0x7f231815b480 0x7f23180b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 >> v1:172.21.15.105:6789/0 conn(0x7f2318072700 legacy=0x7f231815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23180cd890 con 0x7f23180b60c0 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f230c001670 con 0x7f23180b60c0 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 >> v1:172.21.15.60:6789/0 conn(0x7f23180b60c0 legacy=0x7f2318071ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f2316ffd640 1 --2- 172.21.15.60:0/681054173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23000039b0 0x7f2300003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f2316ffd640 1 --2- 172.21.15.60:0/681054173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2300004800 0x7f2300004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f2316ffd640 1 --2- 172.21.15.60:0/681054173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23000051c0 0x7f230000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f23180cd5b0 con 0x7f23000051c0 2024-09-12T01:43:48.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f230000c160 con 0x7f23000039b0 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f230000c360 con 0x7f2300004800 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f231ce49640 1 --2- 172.21.15.60:0/681054173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23000051c0 0x7f230000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f2317fff640 1 --2- 172.21.15.60:0/681054173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23000039b0 0x7f2300003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f23177fe640 1 --2- 172.21.15.60:0/681054173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2300004800 0x7f2300004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f231ce49640 1 -- 172.21.15.60:0/681054173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2300004800 msgr2=0x7f2300004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f231ce49640 1 --2- 172.21.15.60:0/681054173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2300004800 0x7f2300004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f231ce49640 1 -- 172.21.15.60:0/681054173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23000039b0 msgr2=0x7f2300003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f231ce49640 1 --2- 172.21.15.60:0/681054173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23000039b0 0x7f2300003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.977+0000 7f231ce49640 1 -- 172.21.15.60:0/681054173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2300003520 con 0x7f23000051c0 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.978+0000 7f231ce49640 1 -- 172.21.15.60:0/681054173 reap_dead start 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.978+0000 7f231ce49640 1 --2- 172.21.15.60:0/681054173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23000051c0 0x7f230000b9c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f2310001e50 tx=0x7f2300005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ab0e1303a71473 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.978+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310001a70 con 0x7f23000051c0 2024-09-12T01:43:48.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.978+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2310003970 con 0x7f23000051c0 2024-09-12T01:43:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.978+0000 7f2316ffd640 1 -- 172.21.15.60:0/681054173 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310003d60 con 0x7f23000051c0 2024-09-12T01:43:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.978+0000 7f231e8ac640 1 -- 172.21.15.60:0/681054173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23000051c0 msgr2=0x7f230000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.978+0000 7f231e8ac640 1 --2- 172.21.15.60:0/681054173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23000051c0 0x7f230000b9c0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f2310001e50 tx=0x7f2300005830 comp rx=0 tx=0).stop 2024-09-12T01:43:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.979+0000 7f231e8ac640 1 -- 172.21.15.60:0/681054173 shutdown_connections 2024-09-12T01:43:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.979+0000 7f231e8ac640 1 --2- 172.21.15.60:0/681054173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23000051c0 0x7f230000b9c0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.979+0000 7f231e8ac640 1 -- 172.21.15.60:0/681054173 >> 172.21.15.60:0/681054173 conn(0x7f231806d0f0 msgr2=0x7f231806d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.979+0000 7f231e8ac640 1 -- 172.21.15.60:0/681054173 shutdown_connections 2024-09-12T01:43:48.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.979+0000 7f231e8ac640 1 -- 172.21.15.60:0/681054173 wait complete. 2024-09-12T01:43:48.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.980+0000 7f231e8ac640 1 Processor -- start 2024-09-12T01:43:48.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.980+0000 7f231e8ac640 1 -- start start 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231e8ac640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23000051c0 0x7f23180cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231e8ac640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23180c9810 0x7f231814d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231e8ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180ab250 0x7f23180abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231e8ac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f231815b9e0 con 0x7f23180ab250 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231e8ac640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f231815b860 con 0x7f23180c9810 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231e8ac640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f23180b5b80 con 0x7f23000051c0 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231ce49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180ab250 0x7f23180abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231ce49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180ab250 0x7f23180abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37310/0 (socket says 172.21.15.60:37310) 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231ce49640 1 -- 172.21.15.60:0/2718464506 learned_addr learned my addr 172.21.15.60:0/2718464506 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f2317fff640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23000051c0 0x7f23180cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f23177fe640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23180c9810 0x7f231814d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231ce49640 1 -- 172.21.15.60:0/2718464506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23000051c0 msgr2=0x7f23180cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.984 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231ce49640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23000051c0 0x7f23180cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231ce49640 1 -- 172.21.15.60:0/2718464506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23180c9810 msgr2=0x7f231814d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231ce49640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23180c9810 0x7f231814d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231ce49640 1 -- 172.21.15.60:0/2718464506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231814d5c0 con 0x7f23180ab250 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.981+0000 7f231ce49640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180ab250 0x7f23180abbe0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f2310001f40 tx=0x7f23100014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.982+0000 7f2314ff9640 1 -- 172.21.15.60:0/2718464506 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310001a70 con 0x7f23180ab250 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.982+0000 7f2314ff9640 1 -- 172.21.15.60:0/2718464506 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f231002ac70 con 0x7f23180ab250 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.982+0000 7f231e8ac640 1 -- 172.21.15.60:0/2718464506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23180c9d40 con 0x7f23180ab250 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.982+0000 7f2314ff9640 1 -- 172.21.15.60:0/2718464506 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2310006d70 con 0x7f23180ab250 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.982+0000 7f231e8ac640 1 -- 172.21.15.60:0/2718464506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23180ca300 con 0x7f23180ab250 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.983+0000 7f231e8ac640 1 -- 172.21.15.60:0/2718464506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2318071ff0 con 0x7f23180ab250 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.983+0000 7f2314ff9640 1 -- 172.21.15.60:0/2718464506 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2310007030 con 0x7f23180ab250 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.984+0000 7f2314ff9640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f230406be30 0x7f230406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:48.985 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.984+0000 7f2314ff9640 1 -- 172.21.15.60:0/2718464506 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 4857+0+0 (secure 0 0 0) 0x7f23100aa790 con 0x7f23180ab250 2024-09-12T01:43:48.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.984+0000 7f2317fff640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f230406be30 0x7f230406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:48.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.984+0000 7f2317fff640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f230406be30 0x7f230406e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2308009960 tx=0x7f2308008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:48.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:48.988+0000 7f2314ff9640 1 -- 172.21.15.60:0/2718464506 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2310043060 con 0x7f23180ab250 2024-09-12T01:43:49.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:49.167+0000 7f231e8ac640 1 -- 172.21.15.60:0/2718464506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f23180b46b0 con 0x7f23180ab250 2024-09-12T01:43:49.251 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:43:49.254 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:43:50.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.165+0000 7f2314ff9640 1 -- 172.21.15.60:0/2718464506 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v125) ==== 138+0+0 (secure 0 0 0) 0x7f231814d5c0 con 0x7f23180ab250 2024-09-12T01:43:50.199 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-12T01:43:50.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.169+0000 7f231e8ac640 1 -- 172.21.15.60:0/2718464506 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f230406be30 msgr2=0x7f230406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:50.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.169+0000 7f231e8ac640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f230406be30 0x7f230406e2f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2308009960 tx=0x7f2308008040 comp rx=0 tx=0).stop 2024-09-12T01:43:50.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.169+0000 7f231e8ac640 1 -- 172.21.15.60:0/2718464506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180ab250 msgr2=0x7f23180abbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:50.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.169+0000 7f231e8ac640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180ab250 0x7f23180abbe0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f2310001f40 tx=0x7f23100014a0 comp rx=0 tx=0).stop 2024-09-12T01:43:50.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.171+0000 7f231e8ac640 1 -- 172.21.15.60:0/2718464506 shutdown_connections 2024-09-12T01:43:50.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.171+0000 7f231e8ac640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23180ab250 0x7f23180abbe0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:50.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.171+0000 7f231e8ac640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f23180c9810 0x7f231814d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:50.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.171+0000 7f231e8ac640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f230406be30 0x7f230406e2f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:50.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.171+0000 7f231e8ac640 1 --2- 172.21.15.60:0/2718464506 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f23000051c0 0x7f23180cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:50.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.171+0000 7f231e8ac640 1 -- 172.21.15.60:0/2718464506 >> 172.21.15.60:0/2718464506 conn(0x7f231806d0f0 msgr2=0x7f2318074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:50.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.172+0000 7f231e8ac640 1 -- 172.21.15.60:0/2718464506 shutdown_connections 2024-09-12T01:43:50.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.172+0000 7f231e8ac640 1 -- 172.21.15.60:0/2718464506 wait complete. 2024-09-12T01:43:50.202 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:43:50.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.319+0000 7f32dd7af640 1 Processor -- start 2024-09-12T01:43:50.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.319+0000 7f32dd7af640 1 -- start start 2024-09-12T01:43:50.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32dd7af640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f32d80b64a0 0x7f32d80b6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:50.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32dd7af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32d80b7f50 0x7f32d80b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:50.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32dd7af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d80b7790 con 0x7f32d815e750 2024-09-12T01:43:50.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32dd7af640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f32d80b6e50 con 0x7f32d80b64a0 2024-09-12T01:43:50.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32dd7af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f32d80d43c0 con 0x7f32d80b7f50 2024-09-12T01:43:50.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32d67fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f32d80b64a0 0x7f32d80b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:50.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32d67fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f32d80b64a0 0x7f32d80b6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37312/0 (socket says 172.21.15.60:37312) 2024-09-12T01:43:50.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32d67fc640 1 -- 172.21.15.60:0/3187685338 learned_addr learned my addr 172.21.15.60:0/3187685338 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:50.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32d6ffd640 1 --1- 172.21.15.60:0/3187685338 >> v1:172.21.15.60:6789/0 conn(0x7f32d815e750 0x7f32d80cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59582/0 (socket says 172.21.15.60:59582) 2024-09-12T01:43:50.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32d77fe640 1 --2- 172.21.15.60:0/3187685338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32d80b7f50 0x7f32d80b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:50.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32d67fc640 1 -- 172.21.15.60:0/3187685338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32d80b7f50 msgr2=0x7f32d80b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:50.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32d67fc640 1 --2- 172.21.15.60:0/3187685338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32d80b7f50 0x7f32d80b83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:50.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32d67fc640 1 -- 172.21.15.60:0/3187685338 >> v1:172.21.15.60:6789/0 conn(0x7f32d815e750 legacy=0x7f32d80cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:50.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32d5ffb640 1 -- 172.21.15.60:0/3187685338 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3079990895 0 0) 0x7f32d80b7790 con 0x7f32d815e750 2024-09-12T01:43:50.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.320+0000 7f32d67fc640 1 -- 172.21.15.60:0/3187685338 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d80d3600 con 0x7f32d80b64a0 2024-09-12T01:43:50.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.321+0000 7f32d67fc640 1 --2- 172.21.15.60:0/3187685338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32d80b64a0 0x7f32d80b6910 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f32d80d4540 tx=0x7f32c002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b718eb44aec0fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:50.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.321+0000 7f32d5ffb640 1 -- 172.21.15.60:0/3187685338 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0037070 con 0x7f32d80b64a0 2024-09-12T01:43:50.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.321+0000 7f32d5ffb640 1 -- 172.21.15.60:0/3187685338 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c0032440 con 0x7f32d80b64a0 2024-09-12T01:43:50.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.321+0000 7f32d5ffb640 1 -- 172.21.15.60:0/3187685338 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c0032810 con 0x7f32d80b64a0 2024-09-12T01:43:50.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.322+0000 7f32dd7af640 1 -- 172.21.15.60:0/3187685338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32d80b64a0 msgr2=0x7f32d80b6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:50.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.322+0000 7f32dd7af640 1 --2- 172.21.15.60:0/3187685338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32d80b64a0 0x7f32d80b6910 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f32d80d4540 tx=0x7f32c002a250 comp rx=0 tx=0).stop 2024-09-12T01:43:50.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.322+0000 7f32dd7af640 1 -- 172.21.15.60:0/3187685338 shutdown_connections 2024-09-12T01:43:50.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.322+0000 7f32dd7af640 1 --2- 172.21.15.60:0/3187685338 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32d80b7f50 0x7f32d80b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:50.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.322+0000 7f32dd7af640 1 --2- 172.21.15.60:0/3187685338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32d80b64a0 0x7f32d80b6910 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:50.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.322+0000 7f32dd7af640 1 -- 172.21.15.60:0/3187685338 >> 172.21.15.60:0/3187685338 conn(0x7f32d80d1500 msgr2=0x7f32d80d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:50.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.322+0000 7f32dd7af640 1 -- 172.21.15.60:0/3187685338 shutdown_connections 2024-09-12T01:43:50.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.322+0000 7f32dd7af640 1 -- 172.21.15.60:0/3187685338 wait complete. 2024-09-12T01:43:50.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.323+0000 7f32dd7af640 1 Processor -- start 2024-09-12T01:43:50.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.323+0000 7f32dd7af640 1 -- start start 2024-09-12T01:43:50.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32dd7af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32d80b64a0 0x7f32d814ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:50.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32dd7af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32d80b7f50 0x7f32d815c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:50.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32dd7af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32d815e750 0x7f32d815ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:50.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32dd7af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f32d80b7ac0 con 0x7f32d815e750 2024-09-12T01:43:50.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32dd7af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f32d80d33b0 con 0x7f32d80b7f50 2024-09-12T01:43:50.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32dd7af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f32d80d3bc0 con 0x7f32d80b64a0 2024-09-12T01:43:50.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32d815e750 0x7f32d815ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:50.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32d6ffd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32d80b64a0 0x7f32d814ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32d815e750 0x7f32d815ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37328/0 (socket says 172.21.15.60:37328) 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32d77fe640 1 -- 172.21.15.60:0/588471358 learned_addr learned my addr 172.21.15.60:0/588471358 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32d67fc640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32d80b7f50 0x7f32d815c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32d6ffd640 1 -- 172.21.15.60:0/588471358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32d80b7f50 msgr2=0x7f32d815c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32d6ffd640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32d80b7f50 0x7f32d815c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32d6ffd640 1 -- 172.21.15.60:0/588471358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32d815e750 msgr2=0x7f32d815ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32d6ffd640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32d815e750 0x7f32d815ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32d6ffd640 1 -- 172.21.15.60:0/588471358 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d81588b0 con 0x7f32d80b64a0 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.324+0000 7f32d77fe640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32d815e750 0x7f32d815ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.325+0000 7f32d6ffd640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32d80b64a0 0x7f32d814ff70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f32c800c3e0 tx=0x7f32c800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.325+0000 7f32cf7fe640 1 -- 172.21.15.60:0/588471358 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c80074e0 con 0x7f32d80b64a0 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.325+0000 7f32cf7fe640 1 -- 172.21.15.60:0/588471358 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c80047e0 con 0x7f32d80b64a0 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.325+0000 7f32dd7af640 1 -- 172.21.15.60:0/588471358 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d8158b90 con 0x7f32d80b64a0 2024-09-12T01:43:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.325+0000 7f32cf7fe640 1 -- 172.21.15.60:0/588471358 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c8004bd0 con 0x7f32d80b64a0 2024-09-12T01:43:50.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.325+0000 7f32dd7af640 1 -- 172.21.15.60:0/588471358 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d8159150 con 0x7f32d80b64a0 2024-09-12T01:43:50.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.326+0000 7f32dd7af640 1 -- 172.21.15.60:0/588471358 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d80b6910 con 0x7f32d80b64a0 2024-09-12T01:43:50.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.326+0000 7f32cf7fe640 1 -- 172.21.15.60:0/588471358 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f32c801a020 con 0x7f32d80b64a0 2024-09-12T01:43:50.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.327+0000 7f32cf7fe640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f32b806be30 0x7f32b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:50.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.327+0000 7f32cf7fe640 1 -- 172.21.15.60:0/588471358 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(125..125 src has 1..125) ==== 5227+0+0 (secure 0 0 0) 0x7f32c808a330 con 0x7f32d80b64a0 2024-09-12T01:43:50.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.327+0000 7f32d67fc640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f32b806be30 0x7f32b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:50.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.327+0000 7f32d67fc640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f32b806be30 0x7f32b806e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f32c0034000 tx=0x7f32c002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:50.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.336+0000 7f32cf7fe640 1 -- 172.21.15.60:0/588471358 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f32c80588a0 con 0x7f32d80b64a0 2024-09-12T01:43:50.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:50.512+0000 7f32dd7af640 1 -- 172.21.15.60:0/588471358 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f32d80b9e50 con 0x7f32d80b64a0 2024-09-12T01:43:51.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.176+0000 7f32cf7fe640 1 -- 172.21.15.60:0/588471358 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v126) ==== 170+0+0 (secure 0 0 0) 0x7f32c805cba0 con 0x7f32d80b64a0 2024-09-12T01:43:51.185 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-12T01:43:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.191+0000 7f32dd7af640 1 -- 172.21.15.60:0/588471358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f32b806be30 msgr2=0x7f32b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.191+0000 7f32dd7af640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f32b806be30 0x7f32b806e2f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f32c0034000 tx=0x7f32c002e000 comp rx=0 tx=0).stop 2024-09-12T01:43:51.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.191+0000 7f32dd7af640 1 -- 172.21.15.60:0/588471358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32d80b64a0 msgr2=0x7f32d814ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:51.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.191+0000 7f32dd7af640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32d80b64a0 0x7f32d814ff70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f32c800c3e0 tx=0x7f32c800c8a0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.191+0000 7f32dd7af640 1 -- 172.21.15.60:0/588471358 shutdown_connections 2024-09-12T01:43:51.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.191+0000 7f32dd7af640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32d815e750 0x7f32d815ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.191+0000 7f32dd7af640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f32d80b7f50 0x7f32d815c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.191+0000 7f32dd7af640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f32b806be30 0x7f32b806e2f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.191+0000 7f32dd7af640 1 --2- 172.21.15.60:0/588471358 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f32d80b64a0 0x7f32d814ff70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.191+0000 7f32dd7af640 1 -- 172.21.15.60:0/588471358 >> 172.21.15.60:0/588471358 conn(0x7f32d80d1500 msgr2=0x7f32d80d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:51.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.192+0000 7f32dd7af640 1 -- 172.21.15.60:0/588471358 shutdown_connections 2024-09-12T01:43:51.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.192+0000 7f32dd7af640 1 -- 172.21.15.60:0/588471358 wait complete. 2024-09-12T01:43:51.206 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:43:51.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.318+0000 7f7982fc4640 1 Processor -- start 2024-09-12T01:43:51.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.319+0000 7f7982fc4640 1 -- start start 2024-09-12T01:43:51.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.319+0000 7f7982fc4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f797c15e7a0 0x7f797c06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:51.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.319+0000 7f7982fc4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f797c0cf1f0 0x7f797c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:51.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.319+0000 7f7982fc4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f797c0cf860 con 0x7f797c0b6720 2024-09-12T01:43:51.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.319+0000 7f7982fc4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f797c0d2ca0 con 0x7f797c15e7a0 2024-09-12T01:43:51.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.319+0000 7f7982fc4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f797c0cfb40 con 0x7f797c0cf1f0 2024-09-12T01:43:51.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.319+0000 7f7980d60640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f797c15e7a0 0x7f797c06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:51.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.320+0000 7f7980d60640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f797c15e7a0 0x7f797c06caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37338/0 (socket says 172.21.15.60:37338) 2024-09-12T01:43:51.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.320+0000 7f7980d60640 1 -- 172.21.15.60:0/3991268663 learned_addr learned my addr 172.21.15.60:0/3991268663 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:51.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.320+0000 7f7981561640 1 --1- 172.21.15.60:0/3991268663 >> v1:172.21.15.60:6789/0 conn(0x7f797c0b6720 0x7f797c1623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59588/0 (socket says 172.21.15.60:59588) 2024-09-12T01:43:51.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.320+0000 7f797bfff640 1 --2- 172.21.15.60:0/3991268663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f797c0cf1f0 0x7f797c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:51.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.320+0000 7f7980d60640 1 -- 172.21.15.60:0/3991268663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f797c0cf1f0 msgr2=0x7f797c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:51.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.320+0000 7f7980d60640 1 --2- 172.21.15.60:0/3991268663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f797c0cf1f0 0x7f797c0b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.320+0000 7f7980d60640 1 -- 172.21.15.60:0/3991268663 >> v1:172.21.15.60:6789/0 conn(0x7f797c0b6720 legacy=0x7f797c1623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:51.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.320+0000 7f797b7fe640 1 -- 172.21.15.60:0/3991268663 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 226035423 0 0) 0x7f797c0cf860 con 0x7f797c0b6720 2024-09-12T01:43:51.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.320+0000 7f7980d60640 1 -- 172.21.15.60:0/3991268663 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c0cfe20 con 0x7f797c15e7a0 2024-09-12T01:43:51.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.321+0000 7f7980d60640 1 --2- 172.21.15.60:0/3991268663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c15e7a0 0x7f797c06caa0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f796c009870 tx=0x7f796c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628edb3c977d0254 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:51.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.321+0000 7f797b7fe640 1 -- 172.21.15.60:0/3991268663 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c037070 con 0x7f797c15e7a0 2024-09-12T01:43:51.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.321+0000 7f797b7fe640 1 -- 172.21.15.60:0/3991268663 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f796c032440 con 0x7f797c15e7a0 2024-09-12T01:43:51.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.321+0000 7f797b7fe640 1 -- 172.21.15.60:0/3991268663 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c032810 con 0x7f797c15e7a0 2024-09-12T01:43:51.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.321+0000 7f7982fc4640 1 -- 172.21.15.60:0/3991268663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c15e7a0 msgr2=0x7f797c06caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:51.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.321+0000 7f7982fc4640 1 --2- 172.21.15.60:0/3991268663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c15e7a0 0x7f797c06caa0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f796c009870 tx=0x7f796c02a1c0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.321+0000 7f7982fc4640 1 -- 172.21.15.60:0/3991268663 shutdown_connections 2024-09-12T01:43:51.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.321+0000 7f7982fc4640 1 --2- 172.21.15.60:0/3991268663 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f797c0cf1f0 0x7f797c0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.321+0000 7f7982fc4640 1 --2- 172.21.15.60:0/3991268663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c15e7a0 0x7f797c06caa0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.321+0000 7f7982fc4640 1 -- 172.21.15.60:0/3991268663 >> 172.21.15.60:0/3991268663 conn(0x7f797c0d11e0 msgr2=0x7f797c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:51.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.321+0000 7f7982fc4640 1 -- 172.21.15.60:0/3991268663 shutdown_connections 2024-09-12T01:43:51.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.321+0000 7f7982fc4640 1 -- 172.21.15.60:0/3991268663 wait complete. 2024-09-12T01:43:51.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.323+0000 7f7982fc4640 1 Processor -- start 2024-09-12T01:43:51.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.323+0000 7f7982fc4640 1 -- start start 2024-09-12T01:43:51.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.323+0000 7f7982fc4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f797c0b6720 0x7f797c0cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:51.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.323+0000 7f7982fc4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c0cf1f0 0x7f797c160920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:51.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.323+0000 7f7982fc4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f797c15e7a0 0x7f797c0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:51.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.323+0000 7f7982fc4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f797c06cfe0 con 0x7f797c0cf1f0 2024-09-12T01:43:51.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f7982fc4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f797c0b7a00 con 0x7f797c0b6720 2024-09-12T01:43:51.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f7982fc4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f797c0d4420 con 0x7f797c15e7a0 2024-09-12T01:43:51.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f797bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c0cf1f0 0x7f797c160920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:51.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f797bfff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c0cf1f0 0x7f797c160920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37344/0 (socket says 172.21.15.60:37344) 2024-09-12T01:43:51.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f797bfff640 1 -- 172.21.15.60:0/3782569006 learned_addr learned my addr 172.21.15.60:0/3782569006 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:51.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f7981561640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f797c15e7a0 0x7f797c0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:51.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f7980d60640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f797c0b6720 0x7f797c0cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:51.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f797bfff640 1 -- 172.21.15.60:0/3782569006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f797c15e7a0 msgr2=0x7f797c0cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:51.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f797bfff640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f797c15e7a0 0x7f797c0cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f797bfff640 1 -- 172.21.15.60:0/3782569006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f797c0b6720 msgr2=0x7f797c0cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:51.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f797bfff640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f797c0b6720 0x7f797c0cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:51.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f797bfff640 1 -- 172.21.15.60:0/3782569006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c0ccae0 con 0x7f797c0cf1f0 2024-09-12T01:43:51.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f797bfff640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c0cf1f0 0x7f797c160920 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f797000e9b0 tx=0x7f797000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:51.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f79797fa640 1 -- 172.21.15.60:0/3782569006 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7970017070 con 0x7f797c0cf1f0 2024-09-12T01:43:51.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f79797fa640 1 -- 172.21.15.60:0/3782569006 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797000c9a0 con 0x7f797c0cf1f0 2024-09-12T01:43:51.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f7982fc4640 1 -- 172.21.15.60:0/3782569006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797c0ccdc0 con 0x7f797c0cf1f0 2024-09-12T01:43:51.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f79797fa640 1 -- 172.21.15.60:0/3782569006 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f797000cd70 con 0x7f797c0cf1f0 2024-09-12T01:43:51.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.324+0000 7f7982fc4640 1 -- 172.21.15.60:0/3782569006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797c0cd380 con 0x7f797c0cf1f0 2024-09-12T01:43:51.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.325+0000 7f7982fc4640 1 -- 172.21.15.60:0/3782569006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f797c0d2a80 con 0x7f797c0cf1f0 2024-09-12T01:43:51.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.326+0000 7f79797fa640 1 -- 172.21.15.60:0/3782569006 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f797001a070 con 0x7f797c0cf1f0 2024-09-12T01:43:51.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.326+0000 7f79797fa640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f796806be30 0x7f796806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:51.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.327+0000 7f79797fa640 1 -- 172.21.15.60:0/3782569006 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5609+0+0 (secure 0 0 0) 0x7f797008b040 con 0x7f797c0cf1f0 2024-09-12T01:43:51.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.327+0000 7f7980d60640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f796806be30 0x7f796806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:51.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.327+0000 7f7980d60640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f796806be30 0x7f796806e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f796c034000 tx=0x7f796c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:51.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.331+0000 7f79797fa640 1 -- 172.21.15.60:0/3782569006 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7970059490 con 0x7f797c0cf1f0 2024-09-12T01:43:51.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:51.546+0000 7f7982fc4640 1 -- 172.21.15.60:0/3782569006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f797c15a6d0 con 0x7f797c0cf1f0 2024-09-12T01:43:52.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.172+0000 7f79797fa640 1 -- 172.21.15.60:0/3782569006 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v77) ==== 174+0+0 (secure 0 0 0) 0x7f797005d790 con 0x7f797c0cf1f0 2024-09-12T01:43:52.172 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 20 and data pool 21 2024-09-12T01:43:52.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.177+0000 7f7982fc4640 1 -- 172.21.15.60:0/3782569006 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f796806be30 msgr2=0x7f796806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.177+0000 7f7982fc4640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f796806be30 0x7f796806e2f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f796c034000 tx=0x7f796c02e000 comp rx=0 tx=0).stop 2024-09-12T01:43:52.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.177+0000 7f7982fc4640 1 -- 172.21.15.60:0/3782569006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c0cf1f0 msgr2=0x7f797c160920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.177+0000 7f7982fc4640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c0cf1f0 0x7f797c160920 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f797000e9b0 tx=0x7f797000ee70 comp rx=0 tx=0).stop 2024-09-12T01:43:52.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.178+0000 7f7982fc4640 1 -- 172.21.15.60:0/3782569006 shutdown_connections 2024-09-12T01:43:52.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.178+0000 7f7982fc4640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f796806be30 0x7f796806e2f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.178+0000 7f7982fc4640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f797c15e7a0 0x7f797c0cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.178+0000 7f7982fc4640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797c0cf1f0 0x7f797c160920 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.178+0000 7f7982fc4640 1 --2- 172.21.15.60:0/3782569006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f797c0b6720 0x7f797c0cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.178+0000 7f7982fc4640 1 -- 172.21.15.60:0/3782569006 >> 172.21.15.60:0/3782569006 conn(0x7f797c0d11e0 msgr2=0x7f797c15d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:52.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.178+0000 7f7982fc4640 1 -- 172.21.15.60:0/3782569006 shutdown_connections 2024-09-12T01:43:52.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.179+0000 7f7982fc4640 1 -- 172.21.15.60:0/3782569006 wait complete. 2024-09-12T01:43:52.206 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:43:52.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.314+0000 7f327f09b640 1 Processor -- start 2024-09-12T01:43:52.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.314+0000 7f327f09b640 1 -- start start 2024-09-12T01:43:52.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.315+0000 7f327f09b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f32780b74c0 0x7f327815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.315+0000 7f327f09b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f327815fb10 con 0x7f327815f030 2024-09-12T01:43:52.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.315+0000 7f327f09b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32780b5900 con 0x7f327815c2b0 2024-09-12T01:43:52.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.315+0000 7f327f09b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f327815f830 con 0x7f32780b74c0 2024-09-12T01:43:52.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.315+0000 7f3277fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f32780b74c0 0x7f327815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.315+0000 7f327d638640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f327815f030 0x7f327806d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:59594/0 (socket says 172.21.15.60:59594) 2024-09-12T01:43:52.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.315+0000 7f327d638640 1 -- 172.21.15.60:0/460999788 learned_addr learned my addr 172.21.15.60:0/460999788 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:52.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.316+0000 7f3277fff640 1 -- 172.21.15.60:0/460999788 >> v1:172.21.15.105:6789/0 conn(0x7f327815c2b0 legacy=0x7f32780b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.316+0000 7f3277fff640 1 -- 172.21.15.60:0/460999788 >> v1:172.21.15.60:6789/0 conn(0x7f327815f030 legacy=0x7f327806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.316+0000 7f3277fff640 1 -- 172.21.15.60:0/460999788 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327806ce30 con 0x7f32780b74c0 2024-09-12T01:43:52.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.316+0000 7f3277fff640 1 --2- 172.21.15.60:0/460999788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32780b74c0 0x7f327815eaf0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f3268009d90 tx=0x7f326802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f2e10aab617da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:52.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.317+0000 7f32777fe640 1 -- 172.21.15.60:0/460999788 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268007740 con 0x7f32780b74c0 2024-09-12T01:43:52.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.317+0000 7f32777fe640 1 -- 172.21.15.60:0/460999788 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32680078e0 con 0x7f32780b74c0 2024-09-12T01:43:52.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.317+0000 7f32777fe640 1 -- 172.21.15.60:0/460999788 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3268007cb0 con 0x7f32780b74c0 2024-09-12T01:43:52.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.317+0000 7f327f09b640 1 -- 172.21.15.60:0/460999788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32780b74c0 msgr2=0x7f327815eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.317+0000 7f327f09b640 1 --2- 172.21.15.60:0/460999788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32780b74c0 0x7f327815eaf0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f3268009d90 tx=0x7f326802a6f0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.317+0000 7f327f09b640 1 -- 172.21.15.60:0/460999788 shutdown_connections 2024-09-12T01:43:52.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.317+0000 7f327f09b640 1 --2- 172.21.15.60:0/460999788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32780b74c0 0x7f327815eaf0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.317+0000 7f327f09b640 1 -- 172.21.15.60:0/460999788 >> 172.21.15.60:0/460999788 conn(0x7f32780b4240 msgr2=0x7f32780b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:52.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.317+0000 7f327f09b640 1 -- 172.21.15.60:0/460999788 shutdown_connections 2024-09-12T01:43:52.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.317+0000 7f327f09b640 1 -- 172.21.15.60:0/460999788 wait complete. 2024-09-12T01:43:52.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.318+0000 7f327f09b640 1 Processor -- start 2024-09-12T01:43:52.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.318+0000 7f327f09b640 1 -- start start 2024-09-12T01:43:52.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.319+0000 7f327f09b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32780b74c0 0x7f3278151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.319+0000 7f327f09b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f327815c2b0 0x7f32780cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.319+0000 7f327f09b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f327815f030 0x7f32781539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.319+0000 7f327f09b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f327815f480 con 0x7f32780b74c0 2024-09-12T01:43:52.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.319+0000 7f327f09b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f327806d3f0 con 0x7f327815c2b0 2024-09-12T01:43:52.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.319+0000 7f327f09b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f32780cc130 con 0x7f327815f030 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.319+0000 7f327ce37640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32780b74c0 0x7f3278151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.319+0000 7f327ce37640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32780b74c0 0x7f3278151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:37358/0 (socket says 172.21.15.60:37358) 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.319+0000 7f327ce37640 1 -- 172.21.15.60:0/1118222280 learned_addr learned my addr 172.21.15.60:0/1118222280 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f3277fff640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f327815c2b0 0x7f32780cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f327d638640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f327815f030 0x7f32781539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f327ce37640 1 -- 172.21.15.60:0/1118222280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f327815f030 msgr2=0x7f32781539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f327ce37640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f327815f030 0x7f32781539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f327ce37640 1 -- 172.21.15.60:0/1118222280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f327815c2b0 msgr2=0x7f32780cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f327ce37640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f327815c2b0 0x7f32780cd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f327ce37640 1 -- 172.21.15.60:0/1118222280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32780cbe30 con 0x7f32780b74c0 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f327d638640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f327815f030 0x7f32781539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f327ce37640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32780b74c0 0x7f3278151ff0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f326000c450 tx=0x7f326000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:52.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f32757fa640 1 -- 172.21.15.60:0/1118222280 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32600052d0 con 0x7f32780b74c0 2024-09-12T01:43:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f32757fa640 1 -- 172.21.15.60:0/1118222280 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3260005470 con 0x7f32780b74c0 2024-09-12T01:43:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f327f09b640 1 -- 172.21.15.60:0/1118222280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32780cdcc0 con 0x7f32780b74c0 2024-09-12T01:43:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f32757fa640 1 -- 172.21.15.60:0/1118222280 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3260012870 con 0x7f32780b74c0 2024-09-12T01:43:52.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.320+0000 7f327f09b640 1 -- 172.21.15.60:0/1118222280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32780ce520 con 0x7f32780b74c0 2024-09-12T01:43:52.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.321+0000 7f327f09b640 1 -- 172.21.15.60:0/1118222280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f327815a5b0 con 0x7f32780b74c0 2024-09-12T01:43:52.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.322+0000 7f32757fa640 1 -- 172.21.15.60:0/1118222280 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3260012a10 con 0x7f32780b74c0 2024-09-12T01:43:52.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.322+0000 7f32757fa640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f325806be30 0x7f325806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.322+0000 7f32757fa640 1 -- 172.21.15.60:0/1118222280 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5709+0+0 (secure 0 0 0) 0x7f326008a9e0 con 0x7f32780b74c0 2024-09-12T01:43:52.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.322+0000 7f3277fff640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f325806be30 0x7f325806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.323+0000 7f3277fff640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f325806be30 0x7f325806e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3268034000 tx=0x7f326802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:52.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.327+0000 7f32757fa640 1 -- 172.21.15.60:0/1118222280 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f327815a5b0 con 0x7f32780b74c0 2024-09-12T01:43:52.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.503+0000 7f327f09b640 1 -- 172.21.15.60:0/1118222280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f327815eaf0 con 0x7f32780b74c0 2024-09-12T01:43:52.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.505+0000 7f32757fa640 1 -- 172.21.15.60:0/1118222280 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) ==== 74+0+16716 (secure 0 0 0) 0x7f3260059390 con 0x7f32780b74c0 2024-09-12T01:43:52.504 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:52.505 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":127,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:43:51.547473+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:43:49.197828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-12T01:43:50.544112+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:43:52.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.507+0000 7f327f09b640 1 -- 172.21.15.60:0/1118222280 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f325806be30 msgr2=0x7f325806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.507+0000 7f327f09b640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f325806be30 0x7f325806e2f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3268034000 tx=0x7f326802f000 comp rx=0 tx=0).stop 2024-09-12T01:43:52.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.507+0000 7f327f09b640 1 -- 172.21.15.60:0/1118222280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32780b74c0 msgr2=0x7f3278151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.507+0000 7f327f09b640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32780b74c0 0x7f3278151ff0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f326000c450 tx=0x7f326000c910 comp rx=0 tx=0).stop 2024-09-12T01:43:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.507+0000 7f327f09b640 1 -- 172.21.15.60:0/1118222280 shutdown_connections 2024-09-12T01:43:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.507+0000 7f327f09b640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f325806be30 0x7f325806e2f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.507+0000 7f327f09b640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f327815f030 0x7f32781539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.507+0000 7f327f09b640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f327815c2b0 0x7f32780cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.507+0000 7f327f09b640 1 --2- 172.21.15.60:0/1118222280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32780b74c0 0x7f3278151ff0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.507+0000 7f327f09b640 1 -- 172.21.15.60:0/1118222280 >> 172.21.15.60:0/1118222280 conn(0x7f32780b4240 msgr2=0x7f327806fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.507+0000 7f327f09b640 1 -- 172.21.15.60:0/1118222280 shutdown_connections 2024-09-12T01:43:52.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.507+0000 7f327f09b640 1 -- 172.21.15.60:0/1118222280 wait complete. 2024-09-12T01:43:52.517 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:43:52.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.621+0000 7f39dd874640 1 Processor -- start 2024-09-12T01:43:52.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.621+0000 7f39dd874640 1 -- start start 2024-09-12T01:43:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.622+0000 7f39dd874640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39d815c170 0x7f39d815c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.622+0000 7f39dd874640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39d80cf6c0 0x7f39d80cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.622+0000 7f39dd874640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f39d80b5dd0 0x7f39d80b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.622+0000 7f39dd874640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f39d815ca90 con 0x7f39d815c170 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.622+0000 7f39dd874640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f39d80b4cf0 con 0x7f39d80b5dd0 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.622+0000 7f39dd874640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39d80b4fd0 con 0x7f39d80cf6c0 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.622+0000 7f39d6ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39d815c170 0x7f39d815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.622+0000 7f39d6ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39d815c170 0x7f39d815c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40758/0 (socket says 172.21.15.60:40758) 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.622+0000 7f39d6ffd640 1 -- 172.21.15.60:0/3664567701 learned_addr learned my addr 172.21.15.60:0/3664567701 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.622+0000 7f39d77fe640 1 --2- 172.21.15.60:0/3664567701 >> v2:172.21.15.105:3300/0 conn(0x7f39d80b5dd0 0x7f39d80b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.622+0000 7f39d67fc640 1 --2- 172.21.15.60:0/3664567701 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39d80cf6c0 0x7f39d80cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.623+0000 7f39d6ffd640 1 -- 172.21.15.60:0/3664567701 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39d80cf6c0 msgr2=0x7f39d80cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.623+0000 7f39d6ffd640 1 --2- 172.21.15.60:0/3664567701 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39d80cf6c0 0x7f39d80cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.623+0000 7f39d6ffd640 1 -- 172.21.15.60:0/3664567701 >> v2:172.21.15.105:3300/0 conn(0x7f39d80b5dd0 msgr2=0x7f39d80b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.623+0000 7f39d6ffd640 1 --2- 172.21.15.60:0/3664567701 >> v2:172.21.15.105:3300/0 conn(0x7f39d80b5dd0 0x7f39d80b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.623+0000 7f39d6ffd640 1 -- 172.21.15.60:0/3664567701 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d80b52b0 con 0x7f39d815c170 2024-09-12T01:43:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.623+0000 7f39d77fe640 1 --2- 172.21.15.60:0/3664567701 >> v2:172.21.15.105:3300/0 conn(0x7f39d80b5dd0 0x7f39d80b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:52.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.623+0000 7f39d6ffd640 1 --2- 172.21.15.60:0/3664567701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d815c170 0x7f39d815c550 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f39d80c7120 tx=0x7f39c802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3f528cc78e6e8c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.624+0000 7f39d5ffb640 1 -- 172.21.15.60:0/3664567701 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c8036070 con 0x7f39d815c170 2024-09-12T01:43:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.624+0000 7f39d5ffb640 1 -- 172.21.15.60:0/3664567701 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c8031600 con 0x7f39d815c170 2024-09-12T01:43:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.624+0000 7f39d5ffb640 1 -- 172.21.15.60:0/3664567701 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c80319d0 con 0x7f39d815c170 2024-09-12T01:43:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.624+0000 7f39dd874640 1 -- 172.21.15.60:0/3664567701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d815c170 msgr2=0x7f39d815c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.624+0000 7f39dd874640 1 --2- 172.21.15.60:0/3664567701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d815c170 0x7f39d815c550 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f39d80c7120 tx=0x7f39c802a6a0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.624+0000 7f39dd874640 1 -- 172.21.15.60:0/3664567701 shutdown_connections 2024-09-12T01:43:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.624+0000 7f39dd874640 1 --2- 172.21.15.60:0/3664567701 >> v2:172.21.15.105:3300/0 conn(0x7f39d80b5dd0 0x7f39d80b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.624+0000 7f39dd874640 1 --2- 172.21.15.60:0/3664567701 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39d80cf6c0 0x7f39d80cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.624+0000 7f39dd874640 1 --2- 172.21.15.60:0/3664567701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d815c170 0x7f39d815c550 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.624+0000 7f39dd874640 1 -- 172.21.15.60:0/3664567701 >> 172.21.15.60:0/3664567701 conn(0x7f39d806bc10 msgr2=0x7f39d806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.624+0000 7f39dd874640 1 -- 172.21.15.60:0/3664567701 shutdown_connections 2024-09-12T01:43:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.624+0000 7f39dd874640 1 -- 172.21.15.60:0/3664567701 wait complete. 2024-09-12T01:43:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.625+0000 7f39dd874640 1 Processor -- start 2024-09-12T01:43:52.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.626+0000 7f39dd874640 1 -- start start 2024-09-12T01:43:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.626+0000 7f39dd874640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39d80b5dd0 0x7f39d81f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.626+0000 7f39dd874640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d80cf6c0 0x7f39d8140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.626+0000 7f39dd874640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39d815c170 0x7f39d80c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.626+0000 7f39dd874640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39d80b5b50 con 0x7f39d80cf6c0 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.626+0000 7f39dd874640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f39d80b5870 con 0x7f39d80b5dd0 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.626+0000 7f39dd874640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f39d815ffb0 con 0x7f39d815c170 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.626+0000 7f39d67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d80cf6c0 0x7f39d8140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.626+0000 7f39d67fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d80cf6c0 0x7f39d8140ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40772/0 (socket says 172.21.15.60:40772) 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.626+0000 7f39d67fc640 1 -- 172.21.15.60:0/756673004 learned_addr learned my addr 172.21.15.60:0/756673004 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39d77fe640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39d815c170 0x7f39d80c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39d6ffd640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39d80b5dd0 0x7f39d81f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39d67fc640 1 -- 172.21.15.60:0/756673004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39d815c170 msgr2=0x7f39d80c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39d67fc640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39d815c170 0x7f39d80c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39d67fc640 1 -- 172.21.15.60:0/756673004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39d80b5dd0 msgr2=0x7f39d81f2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39d67fc640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39d80b5dd0 0x7f39d81f2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39d67fc640 1 -- 172.21.15.60:0/756673004 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39d81f35e0 con 0x7f39d80cf6c0 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39d77fe640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39d815c170 0x7f39d80c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39d6ffd640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39d80b5dd0 0x7f39d81f2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39d67fc640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d80cf6c0 0x7f39d8140ec0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f39c000d830 tx=0x7f39c000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39cffff640 1 -- 172.21.15.60:0/756673004 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c000b660 con 0x7f39d80cf6c0 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39cffff640 1 -- 172.21.15.60:0/756673004 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39c0019070 con 0x7f39d80cf6c0 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39dd874640 1 -- 172.21.15.60:0/756673004 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39d81f38c0 con 0x7f39d80cf6c0 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39cffff640 1 -- 172.21.15.60:0/756673004 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39c000ba20 con 0x7f39d80cf6c0 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.627+0000 7f39dd874640 1 -- 172.21.15.60:0/756673004 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39d81f3e80 con 0x7f39d80cf6c0 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.628+0000 7f39dd874640 1 -- 172.21.15.60:0/756673004 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39d815c550 con 0x7f39d80cf6c0 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.629+0000 7f39cffff640 1 -- 172.21.15.60:0/756673004 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f39c001e460 con 0x7f39d80cf6c0 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.630+0000 7f39cffff640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39b806be30 0x7f39b806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.630+0000 7f39d6ffd640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39b806be30 0x7f39b806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.630+0000 7f39cffff640 1 -- 172.21.15.60:0/756673004 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5709+0+0 (secure 0 0 0) 0x7f39c008b4d0 con 0x7f39d80cf6c0 2024-09-12T01:43:52.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.630+0000 7f39d6ffd640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39b806be30 0x7f39b806e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f39c8033000 tx=0x7f39c8009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:52.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.634+0000 7f39cffff640 1 -- 172.21.15.60:0/756673004 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f39c0059e80 con 0x7f39d80cf6c0 2024-09-12T01:43:52.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.813+0000 7f39dd874640 1 -- 172.21.15.60:0/756673004 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39d8152290 con 0x7f39d80cf6c0 2024-09-12T01:43:52.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.814+0000 7f39cffff640 1 -- 172.21.15.60:0/756673004 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v127) ==== 74+0+16716 (secure 0 0 0) 0x7f39c0089e20 con 0x7f39d80cf6c0 2024-09-12T01:43:52.815 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:52.815 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":127,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:43:51.547473+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:43:49.197828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-12T01:43:50.544112+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:43:52.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.816+0000 7f39dd874640 1 -- 172.21.15.60:0/756673004 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39b806be30 msgr2=0x7f39b806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.816+0000 7f39dd874640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39b806be30 0x7f39b806e2f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f39c8033000 tx=0x7f39c8009000 comp rx=0 tx=0).stop 2024-09-12T01:43:52.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.816+0000 7f39dd874640 1 -- 172.21.15.60:0/756673004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d80cf6c0 msgr2=0x7f39d8140ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.816+0000 7f39dd874640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d80cf6c0 0x7f39d8140ec0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f39c000d830 tx=0x7f39c000dcf0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.816+0000 7f39dd874640 1 -- 172.21.15.60:0/756673004 shutdown_connections 2024-09-12T01:43:52.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.816+0000 7f39dd874640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f39b806be30 0x7f39b806e2f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.816+0000 7f39dd874640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f39d815c170 0x7f39d80c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.816+0000 7f39dd874640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d80cf6c0 0x7f39d8140ec0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.816+0000 7f39dd874640 1 --2- 172.21.15.60:0/756673004 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f39d80b5dd0 0x7f39d81f2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.816+0000 7f39dd874640 1 -- 172.21.15.60:0/756673004 >> 172.21.15.60:0/756673004 conn(0x7f39d806bc10 msgr2=0x7f39d8071930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:52.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.817+0000 7f39dd874640 1 -- 172.21.15.60:0/756673004 shutdown_connections 2024-09-12T01:43:52.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.817+0000 7f39dd874640 1 -- 172.21.15.60:0/756673004 wait complete. 2024-09-12T01:43:52.827 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:43:52.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.934+0000 7ff7013d8640 1 Processor -- start 2024-09-12T01:43:52.934 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.934+0000 7ff7013d8640 1 -- start start 2024-09-12T01:43:52.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.935+0000 7ff7013d8640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff6fc0cf1f0 0x7ff6fc0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.935+0000 7ff7013d8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6fc0b6720 0x7ff6fc0d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.935+0000 7ff7013d8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6fc0cf860 con 0x7ff6fc15e7a0 2024-09-12T01:43:52.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.935+0000 7ff7013d8640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff6fc0d2ca0 con 0x7ff6fc0cf1f0 2024-09-12T01:43:52.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.935+0000 7ff7013d8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff6fc0cfb40 con 0x7ff6fc0b6720 2024-09-12T01:43:52.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.936+0000 7ff6fb7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6fc0b6720 0x7ff6fc0d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.936+0000 7ff6fa7fc640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff6fc0cf1f0 0x7ff6fc0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.936+0000 7ff6faffd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ff6fc15e7a0 0x7ff6fc06caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:53228/0 (socket says 172.21.15.60:53228) 2024-09-12T01:43:52.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.936+0000 7ff6faffd640 1 -- 172.21.15.60:0/1570121730 learned_addr learned my addr 172.21.15.60:0/1570121730 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:52.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.936+0000 7ff6f9ffb640 1 -- 172.21.15.60:0/1570121730 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000481487 0 0) 0x7ff6fc0cf860 con 0x7ff6fc15e7a0 2024-09-12T01:43:52.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.936+0000 7ff6fb7fe640 1 -- 172.21.15.60:0/1570121730 >> v2:172.21.15.105:3300/0 conn(0x7ff6fc0cf1f0 msgr2=0x7ff6fc0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:52.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.936+0000 7ff6fb7fe640 1 --2- 172.21.15.60:0/1570121730 >> v2:172.21.15.105:3300/0 conn(0x7ff6fc0cf1f0 0x7ff6fc0b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.936+0000 7ff6fb7fe640 1 -- 172.21.15.60:0/1570121730 >> v1:172.21.15.105:6789/0 conn(0x7ff6fc15e7a0 legacy=0x7ff6fc06caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.936+0000 7ff6fb7fe640 1 -- 172.21.15.60:0/1570121730 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc0cfe20 con 0x7ff6fc0b6720 2024-09-12T01:43:52.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.937+0000 7ff6fb7fe640 1 --2- 172.21.15.60:0/1570121730 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6fc0b6720 0x7ff6fc0d3410 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009d90 tx=0x7ff6f402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2c5f33f38b5378c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:52.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.937+0000 7ff6f9ffb640 1 -- 172.21.15.60:0/1570121730 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4031600 con 0x7ff6fc0b6720 2024-09-12T01:43:52.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.937+0000 7ff6f9ffb640 1 -- 172.21.15.60:0/1570121730 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f40317a0 con 0x7ff6fc0b6720 2024-09-12T01:43:52.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.937+0000 7ff6f9ffb640 1 -- 172.21.15.60:0/1570121730 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4031b70 con 0x7ff6fc0b6720 2024-09-12T01:43:52.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.937+0000 7ff7013d8640 1 -- 172.21.15.60:0/1570121730 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6fc0b6720 msgr2=0x7ff6fc0d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.938+0000 7ff7013d8640 1 --2- 172.21.15.60:0/1570121730 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6fc0b6720 0x7ff6fc0d3410 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009d90 tx=0x7ff6f402a5d0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.938+0000 7ff7013d8640 1 -- 172.21.15.60:0/1570121730 shutdown_connections 2024-09-12T01:43:52.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.938+0000 7ff7013d8640 1 --2- 172.21.15.60:0/1570121730 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6fc0b6720 0x7ff6fc0d3410 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.938+0000 7ff7013d8640 1 --2- 172.21.15.60:0/1570121730 >> v2:172.21.15.105:3300/0 conn(0x7ff6fc0cf1f0 0x7ff6fc0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.938+0000 7ff7013d8640 1 -- 172.21.15.60:0/1570121730 >> 172.21.15.60:0/1570121730 conn(0x7ff6fc0d11e0 msgr2=0x7ff6fc0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:52.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.938+0000 7ff7013d8640 1 -- 172.21.15.60:0/1570121730 shutdown_connections 2024-09-12T01:43:52.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.938+0000 7ff7013d8640 1 -- 172.21.15.60:0/1570121730 wait complete. 2024-09-12T01:43:52.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.939+0000 7ff7013d8640 1 Processor -- start 2024-09-12T01:43:52.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.939+0000 7ff7013d8640 1 -- start start 2024-09-12T01:43:52.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff7013d8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6fc0b6720 0x7ff6fc0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff7013d8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc0cf1f0 0x7ff6fc156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff7013d8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc15e7a0 0x7ff6fc1f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff7013d8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc15eb80 con 0x7ff6fc15e7a0 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff7013d8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc0b7a00 con 0x7ff6fc0cf1f0 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff7013d8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff6fc15ed00 con 0x7ff6fc0b6720 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff6fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc15e7a0 0x7ff6fc1f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff6fb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc15e7a0 0x7ff6fc1f7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40778/0 (socket says 172.21.15.60:40778) 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff6fb7fe640 1 -- 172.21.15.60:0/747309572 learned_addr learned my addr 172.21.15.60:0/747309572 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff6fa7fc640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc0cf1f0 0x7ff6fc156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff6faffd640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6fc0b6720 0x7ff6fc0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff6fb7fe640 1 -- 172.21.15.60:0/747309572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6fc0b6720 msgr2=0x7ff6fc0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff6fb7fe640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6fc0b6720 0x7ff6fc0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff6fb7fe640 1 -- 172.21.15.60:0/747309572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc0cf1f0 msgr2=0x7ff6fc156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff6fb7fe640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc0cf1f0 0x7ff6fc156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff6fb7fe640 1 -- 172.21.15.60:0/747309572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc0cce50 con 0x7ff6fc15e7a0 2024-09-12T01:43:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.940+0000 7ff6fb7fe640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc15e7a0 0x7ff6fc1f7cb0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009d90 tx=0x7ff6f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.941+0000 7ff6f37fe640 1 -- 172.21.15.60:0/747309572 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4040070 con 0x7ff6fc15e7a0 2024-09-12T01:43:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.941+0000 7ff6f37fe640 1 -- 172.21.15.60:0/747309572 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6f4030be0 con 0x7ff6fc15e7a0 2024-09-12T01:43:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.941+0000 7ff6f37fe640 1 -- 172.21.15.60:0/747309572 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4009450 con 0x7ff6fc15e7a0 2024-09-12T01:43:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.941+0000 7ff7013d8640 1 -- 172.21.15.60:0/747309572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6fc1556f0 con 0x7ff6fc15e7a0 2024-09-12T01:43:52.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.941+0000 7ff7013d8640 1 -- 172.21.15.60:0/747309572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6fc155cb0 con 0x7ff6fc15e7a0 2024-09-12T01:43:52.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.942+0000 7ff7013d8640 1 -- 172.21.15.60:0/747309572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6fc0b61e0 con 0x7ff6fc15e7a0 2024-09-12T01:43:52.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.942+0000 7ff6f37fe640 1 -- 172.21.15.60:0/747309572 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff6f4039040 con 0x7ff6fc15e7a0 2024-09-12T01:43:52.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.943+0000 7ff6f37fe640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6dc06be30 0x7ff6dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:52.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.943+0000 7ff6f37fe640 1 -- 172.21.15.60:0/747309572 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5709+0+0 (secure 0 0 0) 0x7ff6f40aba80 con 0x7ff6fc15e7a0 2024-09-12T01:43:52.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.943+0000 7ff6faffd640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6dc06be30 0x7ff6dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:52.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.943+0000 7ff6faffd640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6dc06be30 0x7ff6dc06e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec007fd0 tx=0x7ff6ec007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:52.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:52.947+0000 7ff6f37fe640 1 -- 172.21.15.60:0/747309572 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff6f4079df0 con 0x7ff6fc15e7a0 2024-09-12T01:43:53.155 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.156+0000 7ff7013d8640 1 -- 172.21.15.60:0/747309572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff6fc0d2a80 con 0x7ff6fc15e7a0 2024-09-12T01:43:53.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.187+0000 7ff6f37fe640 1 -- 172.21.15.60:0/747309572 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v78) ==== 118+0+0 (secure 0 0 0) 0x7ff6f407e0f0 con 0x7ff6fc15e7a0 2024-09-12T01:43:53.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.190+0000 7ff7013d8640 1 -- 172.21.15.60:0/747309572 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6dc06be30 msgr2=0x7ff6dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:53.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.190+0000 7ff7013d8640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6dc06be30 0x7ff6dc06e2f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec007fd0 tx=0x7ff6ec007de0 comp rx=0 tx=0).stop 2024-09-12T01:43:53.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.190+0000 7ff7013d8640 1 -- 172.21.15.60:0/747309572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc15e7a0 msgr2=0x7ff6fc1f7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:53.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.190+0000 7ff7013d8640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc15e7a0 0x7ff6fc1f7cb0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009d90 tx=0x7ff6f4004a40 comp rx=0 tx=0).stop 2024-09-12T01:43:53.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.190+0000 7ff7013d8640 1 -- 172.21.15.60:0/747309572 shutdown_connections 2024-09-12T01:43:53.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.190+0000 7ff7013d8640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc15e7a0 0x7ff6fc1f7cb0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:53.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.190+0000 7ff7013d8640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6fc0cf1f0 0x7ff6fc156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:53.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.190+0000 7ff7013d8640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff6dc06be30 0x7ff6dc06e2f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:53.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.190+0000 7ff7013d8640 1 --2- 172.21.15.60:0/747309572 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6fc0b6720 0x7ff6fc0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:53.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.190+0000 7ff7013d8640 1 -- 172.21.15.60:0/747309572 >> 172.21.15.60:0/747309572 conn(0x7ff6fc0d11e0 msgr2=0x7ff6fc074d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:53.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.190+0000 7ff7013d8640 1 -- 172.21.15.60:0/747309572 shutdown_connections 2024-09-12T01:43:53.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.191+0000 7ff7013d8640 1 -- 172.21.15.60:0/747309572 wait complete. 2024-09-12T01:43:53.201 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:43:53.201 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:43:53.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.308+0000 7f7379896640 1 Processor -- start 2024-09-12T01:43:53.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.308+0000 7f7379896640 1 -- start start 2024-09-12T01:43:53.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f7379896640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f737415e4f0 0x7f73740ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:53.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f7379896640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73740b4a50 0x7f73740b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:53.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f7379896640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73740af340 con 0x7f737415e8d0 2024-09-12T01:43:53.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f7379896640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f73740717d0 con 0x7f737415e4f0 2024-09-12T01:43:53.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f7379896640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f73740af8c0 con 0x7f73740b4a50 2024-09-12T01:43:53.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f73727fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f737415e8d0 0x7f73740b4340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36286/0 (socket says 172.21.15.60:36286) 2024-09-12T01:43:53.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f73727fc640 1 -- 172.21.15.60:0/3061422695 learned_addr learned my addr 172.21.15.60:0/3061422695 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:53.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f7372ffd640 1 --2- 172.21.15.60:0/3061422695 >> v2:172.21.15.105:3300/0 conn(0x7f737415e4f0 0x7f73740ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:53.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f73737fe640 1 --2- 172.21.15.60:0/3061422695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73740b4a50 0x7f73740b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:53.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f7371ffb640 1 -- 172.21.15.60:0/3061422695 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908154976 0 0) 0x7f73740af340 con 0x7f737415e8d0 2024-09-12T01:43:53.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f7371ffb640 1 -- 172.21.15.60:0/3061422695 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f735c003520 con 0x7f737415e8d0 2024-09-12T01:43:53.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f7371ffb640 1 -- 172.21.15.60:0/3061422695 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3004996473 0 0) 0x7f735c003520 con 0x7f737415e8d0 2024-09-12T01:43:53.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.309+0000 7f73737fe640 1 -- 172.21.15.60:0/3061422695 >> v2:172.21.15.105:3300/0 conn(0x7f737415e4f0 msgr2=0x7f73740ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:53.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.310+0000 7f73737fe640 1 --2- 172.21.15.60:0/3061422695 >> v2:172.21.15.105:3300/0 conn(0x7f737415e4f0 0x7f73740ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:53.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.310+0000 7f73737fe640 1 -- 172.21.15.60:0/3061422695 >> v1:172.21.15.60:6789/0 conn(0x7f737415e8d0 legacy=0x7f73740b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:53.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.310+0000 7f73737fe640 1 -- 172.21.15.60:0/3061422695 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73740af5e0 con 0x7f73740b4a50 2024-09-12T01:43:53.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.310+0000 7f7372ffd640 1 --2- 172.21.15.60:0/3061422695 >> v2:172.21.15.105:3300/0 conn(0x7f737415e4f0 0x7f73740ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:53.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.310+0000 7f73737fe640 1 --2- 172.21.15.60:0/3061422695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73740b4a50 0x7f73740b3830 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f736c009d90 tx=0x7f736c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da61c29826d9ba14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:53.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.311+0000 7f7371ffb640 1 -- 172.21.15.60:0/3061422695 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368001670 con 0x7f73740b4a50 2024-09-12T01:43:53.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.311+0000 7f7371ffb640 1 -- 172.21.15.60:0/3061422695 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f736c007540 con 0x7f73740b4a50 2024-09-12T01:43:53.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.311+0000 7f7371ffb640 1 -- 172.21.15.60:0/3061422695 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736c0078f0 con 0x7f73740b4a50 2024-09-12T01:43:53.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.311+0000 7f7379896640 1 -- 172.21.15.60:0/3061422695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73740b4a50 msgr2=0x7f73740b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:53.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.311+0000 7f7379896640 1 --2- 172.21.15.60:0/3061422695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73740b4a50 0x7f73740b3830 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f736c009d90 tx=0x7f736c02a5f0 comp rx=0 tx=0).stop 2024-09-12T01:43:53.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.311+0000 7f7379896640 1 -- 172.21.15.60:0/3061422695 shutdown_connections 2024-09-12T01:43:53.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.311+0000 7f7379896640 1 --2- 172.21.15.60:0/3061422695 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f73740b4a50 0x7f73740b3830 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:53.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.311+0000 7f7379896640 1 --2- 172.21.15.60:0/3061422695 >> v2:172.21.15.105:3300/0 conn(0x7f737415e4f0 0x7f73740ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:53.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.311+0000 7f7379896640 1 -- 172.21.15.60:0/3061422695 >> 172.21.15.60:0/3061422695 conn(0x7f737406bc10 msgr2=0x7f737406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:53.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.311+0000 7f7379896640 1 -- 172.21.15.60:0/3061422695 shutdown_connections 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.311+0000 7f7379896640 1 -- 172.21.15.60:0/3061422695 wait complete. 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.312+0000 7f7379896640 1 Processor -- start 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.313+0000 7f7379896640 1 -- start start 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.313+0000 7f7379896640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73740b4a50 0x7f73741f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.313+0000 7f7379896640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737415e4f0 0x7f737415bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.313+0000 7f7379896640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f737415e8d0 0x7f7374161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.313+0000 7f7379896640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f73740afcd0 con 0x7f737415e4f0 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.313+0000 7f7379896640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7374071a90 con 0x7f73740b4a50 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.313+0000 7f7379896640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f73740afe50 con 0x7f737415e8d0 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.313+0000 7f73727fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737415e4f0 0x7f737415bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.313+0000 7f73727fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737415e4f0 0x7f737415bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40788/0 (socket says 172.21.15.60:40788) 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.313+0000 7f73727fc640 1 -- 172.21.15.60:0/1220660526 learned_addr learned my addr 172.21.15.60:0/1220660526 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:53.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f73737fe640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f737415e8d0 0x7f7374161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:53.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f7372ffd640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73740b4a50 0x7f73741f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:53.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f73727fc640 1 -- 172.21.15.60:0/1220660526 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f737415e8d0 msgr2=0x7f7374161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:53.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f73727fc640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f737415e8d0 0x7f7374161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:53.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f73727fc640 1 -- 172.21.15.60:0/1220660526 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73740b4a50 msgr2=0x7f73741f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:53.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f73727fc640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73740b4a50 0x7f73741f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:53.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f73727fc640 1 -- 172.21.15.60:0/1220660526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737415c3c0 con 0x7f737415e4f0 2024-09-12T01:43:53.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f73727fc640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737415e4f0 0x7f737415bb70 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f736800c700 tx=0x7f736800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:53.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f735bfff640 1 -- 172.21.15.60:0/1220660526 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368017070 con 0x7f737415e4f0 2024-09-12T01:43:53.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f735bfff640 1 -- 172.21.15.60:0/1220660526 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7368005ad0 con 0x7f737415e4f0 2024-09-12T01:43:53.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f7379896640 1 -- 172.21.15.60:0/1220660526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7374156d80 con 0x7f737415e4f0 2024-09-12T01:43:53.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f735bfff640 1 -- 172.21.15.60:0/1220660526 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368007070 con 0x7f737415e4f0 2024-09-12T01:43:53.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.314+0000 7f7379896640 1 -- 172.21.15.60:0/1220660526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737415c0b0 con 0x7f737415e4f0 2024-09-12T01:43:53.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.315+0000 7f7379896640 1 -- 172.21.15.60:0/1220660526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73740ce680 con 0x7f737415e4f0 2024-09-12T01:43:53.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.316+0000 7f735bfff640 1 -- 172.21.15.60:0/1220660526 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f736801a070 con 0x7f737415e4f0 2024-09-12T01:43:53.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.316+0000 7f735bfff640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f736006be30 0x7f736006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:53.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.316+0000 7f735bfff640 1 -- 172.21.15.60:0/1220660526 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f736808a210 con 0x7f737415e4f0 2024-09-12T01:43:53.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.316+0000 7f7372ffd640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f736006be30 0x7f736006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:53.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.317+0000 7f7372ffd640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f736006be30 0x7f736006e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7364009560 tx=0x7f7364008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:53.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.320+0000 7f735bfff640 1 -- 172.21.15.60:0/1220660526 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7368058580 con 0x7f737415e4f0 2024-09-12T01:43:53.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:53.533+0000 7f7379896640 1 -- 172.21.15.60:0/1220660526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f73740b3f90 con 0x7f737415e4f0 2024-09-12T01:43:54.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.192+0000 7f735bfff640 1 -- 172.21.15.60:0/1220660526 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v79) ==== 122+0+0 (secure 0 0 0) 0x7f736805c880 con 0x7f737415e4f0 2024-09-12T01:43:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.195+0000 7f7379896640 1 -- 172.21.15.60:0/1220660526 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f736006be30 msgr2=0x7f736006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.195+0000 7f7379896640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f736006be30 0x7f736006e2f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7364009560 tx=0x7f7364008040 comp rx=0 tx=0).stop 2024-09-12T01:43:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.195+0000 7f7379896640 1 -- 172.21.15.60:0/1220660526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737415e4f0 msgr2=0x7f737415bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.195+0000 7f7379896640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737415e4f0 0x7f737415bb70 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f736800c700 tx=0x7f736800cbc0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.195+0000 7f7379896640 1 -- 172.21.15.60:0/1220660526 shutdown_connections 2024-09-12T01:43:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.195+0000 7f7379896640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f736006be30 0x7f736006e2f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.195+0000 7f7379896640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f737415e8d0 0x7f7374161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.195+0000 7f7379896640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f737415e4f0 0x7f737415bb70 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.195+0000 7f7379896640 1 --2- 172.21.15.60:0/1220660526 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f73740b4a50 0x7f73741f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.195+0000 7f7379896640 1 -- 172.21.15.60:0/1220660526 >> 172.21.15.60:0/1220660526 conn(0x7f737406bc10 msgr2=0x7f73740cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:54.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.195+0000 7f7379896640 1 -- 172.21.15.60:0/1220660526 shutdown_connections 2024-09-12T01:43:54.196 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.195+0000 7f7379896640 1 -- 172.21.15.60:0/1220660526 wait complete. 2024-09-12T01:43:54.209 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:43:54.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:43:54.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.317+0000 7fc8bba4c640 1 Processor -- start 2024-09-12T01:43:54.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.318+0000 7fc8bba4c640 1 -- start start 2024-09-12T01:43:54.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8bba4c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc8b40d1820 0x7fc8b41691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8bba4c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b415ea40 con 0x7fc8b40d3310 2024-09-12T01:43:54.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8bba4c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8b40d3870 con 0x7fc8b415e660 2024-09-12T01:43:54.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8bba4c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b40d3b50 con 0x7fc8b40d1820 2024-09-12T01:43:54.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8b8fe7640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc8b40d3310 0x7fc8b40d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36292/0 (socket says 172.21.15.60:36292) 2024-09-12T01:43:54.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8b8fe7640 1 -- 172.21.15.60:0/3790453055 learned_addr learned my addr 172.21.15.60:0/3790453055 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:54.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8b9fe9640 1 --2- 172.21.15.60:0/3790453055 >> v2:172.21.15.105:3300/0 conn(0x7fc8b40d1820 0x7fc8b41691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1724046 0 0) 0x7fc8b415ea40 con 0x7fc8b40d3310 2024-09-12T01:43:54.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8a0003520 con 0x7fc8b40d3310 2024-09-12T01:43:54.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3022258196 0 0) 0x7fc8b40d3870 con 0x7fc8b415e660 2024-09-12T01:43:54.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8b415ea40 con 0x7fc8b415e660 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2164722388 0 0) 0x7fc8a0003520 con 0x7fc8b40d3310 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 >> v2:172.21.15.105:3300/0 conn(0x7fc8b40d1820 msgr2=0x7fc8b41691c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 --2- 172.21.15.60:0/3790453055 >> v2:172.21.15.105:3300/0 conn(0x7fc8b40d1820 0x7fc8b41691c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 >> v1:172.21.15.105:6789/0 conn(0x7fc8b415e660 legacy=0x7fc8b40cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b40d3e30 con 0x7fc8b40d3310 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fc8a4001670 con 0x7fc8b40d3310 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 >> v1:172.21.15.60:6789/0 conn(0x7fc8b40d3310 legacy=0x7fc8b40d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 --2- 172.21.15.60:0/3790453055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8a0003b90 0x7fc8a0003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 --2- 172.21.15.60:0/3790453055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8a0004800 0x7fc8a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 --2- 172.21.15.60:0/3790453055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8a00051c0 0x7fc8a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b40d3b50 con 0x7fc8a00051c0 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a000c090 con 0x7fc8a0004800 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.319+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a000c290 con 0x7fc8a0003b90 2024-09-12T01:43:54.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.320+0000 7fc8b9fe9640 1 --2- 172.21.15.60:0/3790453055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8a00051c0 0x7fc8a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.320+0000 7fc8b8fe7640 1 --2- 172.21.15.60:0/3790453055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8a0004800 0x7fc8a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.320+0000 7fc8b97e8640 1 --2- 172.21.15.60:0/3790453055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8a0003b90 0x7fc8a0003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.320+0000 7fc8b9fe9640 1 -- 172.21.15.60:0/3790453055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8a0003b90 msgr2=0x7fc8a0003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:54.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.320+0000 7fc8b9fe9640 1 --2- 172.21.15.60:0/3790453055 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8a0003b90 0x7fc8a0003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.320+0000 7fc8b9fe9640 1 -- 172.21.15.60:0/3790453055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8a0004800 msgr2=0x7fc8a0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:54.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.320+0000 7fc8b9fe9640 1 --2- 172.21.15.60:0/3790453055 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8a0004800 0x7fc8a0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.320+0000 7fc8b9fe9640 1 -- 172.21.15.60:0/3790453055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a0003520 con 0x7fc8a00051c0 2024-09-12T01:43:54.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.320+0000 7fc8b9fe9640 1 -- 172.21.15.60:0/3790453055 reap_dead start 2024-09-12T01:43:54.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.321+0000 7fc8b9fe9640 1 --2- 172.21.15.60:0/3790453055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8a00051c0 0x7fc8a000b9c0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009fc0 tx=0x7fc8a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6976d460cb0879d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:54.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.321+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac035020 con 0x7fc8a00051c0 2024-09-12T01:43:54.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.321+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac003bd0 con 0x7fc8a00051c0 2024-09-12T01:43:54.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.321+0000 7fc8abfff640 1 -- 172.21.15.60:0/3790453055 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac009c10 con 0x7fc8a00051c0 2024-09-12T01:43:54.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.321+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3790453055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8a00051c0 msgr2=0x7fc8a000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.321+0000 7fc8bba4c640 1 --2- 172.21.15.60:0/3790453055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8a00051c0 0x7fc8a000b9c0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009fc0 tx=0x7fc8a0005830 comp rx=0 tx=0).stop 2024-09-12T01:43:54.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.321+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3790453055 shutdown_connections 2024-09-12T01:43:54.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.321+0000 7fc8bba4c640 1 --2- 172.21.15.60:0/3790453055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8a00051c0 0x7fc8a000b9c0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.321+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3790453055 >> 172.21.15.60:0/3790453055 conn(0x7fc8b40b6410 msgr2=0x7fc8b40b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.321+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3790453055 shutdown_connections 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.321+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3790453055 wait complete. 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.323+0000 7fc8bba4c640 1 Processor -- start 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.323+0000 7fc8bba4c640 1 -- start start 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.323+0000 7fc8bba4c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8a00051c0 0x7fc8b414b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.323+0000 7fc8bba4c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8b406bfd0 0x7fc8b406c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8bba4c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8b40cd3f0 0x7fc8b40cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8bba4c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b40d1110 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8bba4c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b40d43f0 con 0x7fc8a00051c0 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8bba4c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b40d1290 con 0x7fc8b406bfd0 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8b9fe9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8b40cd3f0 0x7fc8b40cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8b9fe9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8b40cd3f0 0x7fc8b40cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40804/0 (socket says 172.21.15.60:40804) 2024-09-12T01:43:54.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8b9fe9640 1 -- 172.21.15.60:0/3482374601 learned_addr learned my addr 172.21.15.60:0/3482374601 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8b8fe7640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8b406bfd0 0x7fc8b406c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8b97e8640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8a00051c0 0x7fc8b414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8b9fe9640 1 -- 172.21.15.60:0/3482374601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8b406bfd0 msgr2=0x7fc8b406c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8b9fe9640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8b406bfd0 0x7fc8b406c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8b9fe9640 1 -- 172.21.15.60:0/3482374601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8a00051c0 msgr2=0x7fc8b414b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8b9fe9640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8a00051c0 0x7fc8b414b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8b9fe9640 1 -- 172.21.15.60:0/3482374601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b415fdb0 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8b9fe9640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8b40cd3f0 0x7fc8b40cd870 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00e200 tx=0x7fc8ac009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8a9ffb640 1 -- 172.21.15.60:0/3482374601 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac035030 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8a9ffb640 1 -- 172.21.15.60:0/3482374601 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac043070 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8a9ffb640 1 -- 172.21.15.60:0/3482374601 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac02d070 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.324+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3482374601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b4160090 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.325+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3482374601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b4160650 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.325+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3482374601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b4160850 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.326+0000 7fc8a9ffb640 1 -- 172.21.15.60:0/3482374601 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc8ac005d10 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.327+0000 7fc8a9ffb640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc89806be60 0x7fc89806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.327+0000 7fc8a9ffb640 1 -- 172.21.15.60:0/3482374601 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fc8ac0ab9f0 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.327+0000 7fc8b97e8640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc89806be60 0x7fc89806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.327+0000 7fc8b97e8640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc89806be60 0x7fc89806e320 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000c00 tx=0x7fc8b0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:54.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.331+0000 7fc8a9ffb640 1 -- 172.21.15.60:0/3482374601 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc8b4160850 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.543+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3482374601 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8b4159560 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.544+0000 7fc8a9ffb640 1 -- 172.21.15.60:0/3482374601 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5230 (secure 0 0 0) 0x7fc8ac079de0 con 0x7fc8b40cd3f0 2024-09-12T01:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:54.545 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":79,"btime":"2024-09-12T01:43:54:188220+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/152127841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":152127841},{"type":"v1","addr":"172.21.15.60:6836","nonce":152127841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7234,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2154123948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2154123948},{"type":"v1","addr":"172.21.15.105:6835","nonce":2154123948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1634496909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1634496909},{"type":"v1","addr":"172.21.15.60:6837","nonce":1634496909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:51.547779+0000","modified":"2024-09-12T01:43:53.534706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/2888550162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2888550162},{"type":"v1","addr":"172.21.15.105:6834","nonce":2888550162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7989,"qdb_cluster":[7989]},"id":10}]} 2024-09-12T01:43:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 79 2024-09-12T01:43:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.546+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3482374601 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc89806be60 msgr2=0x7fc89806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.546+0000 7fc8bba4c640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc89806be60 0x7fc89806e320 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0000c00 tx=0x7fc8b0009040 comp rx=0 tx=0).stop 2024-09-12T01:43:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.546+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3482374601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8b40cd3f0 msgr2=0x7fc8b40cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.546+0000 7fc8bba4c640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8b40cd3f0 0x7fc8b40cd870 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00e200 tx=0x7fc8ac009750 comp rx=0 tx=0).stop 2024-09-12T01:43:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.546+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3482374601 shutdown_connections 2024-09-12T01:43:54.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.546+0000 7fc8bba4c640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8b40cd3f0 0x7fc8b40cd870 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.546+0000 7fc8bba4c640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc89806be60 0x7fc89806e320 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.546+0000 7fc8bba4c640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8b406bfd0 0x7fc8b406c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.546+0000 7fc8bba4c640 1 --2- 172.21.15.60:0/3482374601 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc8a00051c0 0x7fc8b414b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.546+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3482374601 >> 172.21.15.60:0/3482374601 conn(0x7fc8b40b6410 msgr2=0x7fc8b40ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:54.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.546+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3482374601 shutdown_connections 2024-09-12T01:43:54.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.546+0000 7fc8bba4c640 1 -- 172.21.15.60:0/3482374601 wait complete. 2024-09-12T01:43:54.557 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:43:54.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.659+0000 7f2c2d75f640 1 Processor -- start 2024-09-12T01:43:54.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.659+0000 7f2c2d75f640 1 -- start start 2024-09-12T01:43:54.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.660+0000 7f2c2d75f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c280cfb90 0x7f2c280d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.660+0000 7f2c2d75f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c280d1870 con 0x7f2c2806fa50 2024-09-12T01:43:54.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.660+0000 7f2c2d75f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c2815cc00 con 0x7f2c280d2090 2024-09-12T01:43:54.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.660+0000 7f2c2d75f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c2815d810 con 0x7f2c280cfb90 2024-09-12T01:43:54.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.660+0000 7f2c277fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2c2806fa50 0x7f2c28073350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36298/0 (socket says 172.21.15.60:36298) 2024-09-12T01:43:54.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.660+0000 7f2c277fe640 1 -- 172.21.15.60:0/15502065 learned_addr learned my addr 172.21.15.60:0/15502065 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:54.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.661+0000 7f2c26ffd640 1 --2- 172.21.15.60:0/15502065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c280cfb90 0x7f2c280d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.661+0000 7f2c25ffb640 1 -- 172.21.15.60:0/15502065 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1436935833 0 0) 0x7f2c280d1870 con 0x7f2c2806fa50 2024-09-12T01:43:54.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.661+0000 7f2c25ffb640 1 -- 172.21.15.60:0/15502065 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c14003520 con 0x7f2c2806fa50 2024-09-12T01:43:54.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.661+0000 7f2c25ffb640 1 -- 172.21.15.60:0/15502065 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322874202 0 0) 0x7f2c2815cc00 con 0x7f2c280d2090 2024-09-12T01:43:54.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.661+0000 7f2c25ffb640 1 -- 172.21.15.60:0/15502065 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c280d1870 con 0x7f2c280d2090 2024-09-12T01:43:54.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.661+0000 7f2c26ffd640 1 -- 172.21.15.60:0/15502065 >> v1:172.21.15.105:6789/0 conn(0x7f2c280d2090 legacy=0x7f2c2806f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.661+0000 7f2c26ffd640 1 -- 172.21.15.60:0/15502065 >> v1:172.21.15.60:6789/0 conn(0x7f2c2806fa50 legacy=0x7f2c28073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.661+0000 7f2c26ffd640 1 -- 172.21.15.60:0/15502065 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2815cee0 con 0x7f2c280cfb90 2024-09-12T01:43:54.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.662+0000 7f2c26ffd640 1 --2- 172.21.15.60:0/15502065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c280cfb90 0x7f2c280d1b50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2c200097d0 tx=0x7f2c2002a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dee22d442a8e986a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:54.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.662+0000 7f2c25ffb640 1 -- 172.21.15.60:0/15502065 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c20037070 con 0x7f2c280cfb90 2024-09-12T01:43:54.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.662+0000 7f2c25ffb640 1 -- 172.21.15.60:0/15502065 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c20032440 con 0x7f2c280cfb90 2024-09-12T01:43:54.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.662+0000 7f2c25ffb640 1 -- 172.21.15.60:0/15502065 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c20032810 con 0x7f2c280cfb90 2024-09-12T01:43:54.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.662+0000 7f2c2d75f640 1 -- 172.21.15.60:0/15502065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c280cfb90 msgr2=0x7f2c280d1b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.662+0000 7f2c2d75f640 1 --2- 172.21.15.60:0/15502065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c280cfb90 0x7f2c280d1b50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2c200097d0 tx=0x7f2c2002a210 comp rx=0 tx=0).stop 2024-09-12T01:43:54.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.663+0000 7f2c2d75f640 1 -- 172.21.15.60:0/15502065 shutdown_connections 2024-09-12T01:43:54.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.663+0000 7f2c2d75f640 1 --2- 172.21.15.60:0/15502065 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c280cfb90 0x7f2c280d1b50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.663+0000 7f2c2d75f640 1 -- 172.21.15.60:0/15502065 >> 172.21.15.60:0/15502065 conn(0x7f2c28062630 msgr2=0x7f2c28062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:54.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.663+0000 7f2c2d75f640 1 -- 172.21.15.60:0/15502065 shutdown_connections 2024-09-12T01:43:54.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.663+0000 7f2c2d75f640 1 -- 172.21.15.60:0/15502065 wait complete. 2024-09-12T01:43:54.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.664+0000 7f2c2d75f640 1 Processor -- start 2024-09-12T01:43:54.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.664+0000 7f2c2d75f640 1 -- start start 2024-09-12T01:43:54.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c2d75f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c2806fa50 0x7f2c280b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c2d75f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c280cfb90 0x7f2c28149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c2d75f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c280d2090 0x7f2c28149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c2d75f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2c280cff70 con 0x7f2c280cfb90 2024-09-12T01:43:54.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c2d75f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2c2815d4a0 con 0x7f2c2806fa50 2024-09-12T01:43:54.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c2d75f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2c280b55b0 con 0x7f2c280d2090 2024-09-12T01:43:54.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c267fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c280cfb90 0x7f2c28149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c267fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c280cfb90 0x7f2c28149a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40816/0 (socket says 172.21.15.60:40816) 2024-09-12T01:43:54.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c267fc640 1 -- 172.21.15.60:0/4286686955 learned_addr learned my addr 172.21.15.60:0/4286686955 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:54.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c277fe640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c280d2090 0x7f2c28149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c26ffd640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c2806fa50 0x7f2c280b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c267fc640 1 -- 172.21.15.60:0/4286686955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c280d2090 msgr2=0x7f2c28149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c267fc640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c280d2090 0x7f2c28149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c267fc640 1 -- 172.21.15.60:0/4286686955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c2806fa50 msgr2=0x7f2c280b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c267fc640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c2806fa50 0x7f2c280b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c267fc640 1 -- 172.21.15.60:0/4286686955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c2806ec70 con 0x7f2c280cfb90 2024-09-12T01:43:54.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c267fc640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c280cfb90 0x7f2c28149a50 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f2c10001eb0 tx=0x7f2c1000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:54.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c1f7fe640 1 -- 172.21.15.60:0/4286686955 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10017070 con 0x7f2c280cfb90 2024-09-12T01:43:54.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c1f7fe640 1 -- 172.21.15.60:0/4286686955 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c100052d0 con 0x7f2c280cfb90 2024-09-12T01:43:54.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c2d75f640 1 -- 172.21.15.60:0/4286686955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c281580e0 con 0x7f2c280cfb90 2024-09-12T01:43:54.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.665+0000 7f2c1f7fe640 1 -- 172.21.15.60:0/4286686955 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10003810 con 0x7f2c280cfb90 2024-09-12T01:43:54.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.666+0000 7f2c2d75f640 1 -- 172.21.15.60:0/4286686955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c281586a0 con 0x7f2c280cfb90 2024-09-12T01:43:54.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.667+0000 7f2c2d75f640 1 -- 172.21.15.60:0/4286686955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c280d1b50 con 0x7f2c280cfb90 2024-09-12T01:43:54.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.667+0000 7f2c1f7fe640 1 -- 172.21.15.60:0/4286686955 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2c1001a070 con 0x7f2c280cfb90 2024-09-12T01:43:54.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.668+0000 7f2c1f7fe640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2c0806be30 0x7f2c0806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.668+0000 7f2c1f7fe640 1 -- 172.21.15.60:0/4286686955 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f2c1008a2a0 con 0x7f2c280cfb90 2024-09-12T01:43:54.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.668+0000 7f2c26ffd640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2c0806be30 0x7f2c0806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.668+0000 7f2c26ffd640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2c0806be30 0x7f2c0806e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2c20034000 tx=0x7f2c2002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:54.671 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.672+0000 7f2c1f7fe640 1 -- 172.21.15.60:0/4286686955 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2c10058bd0 con 0x7f2c280cfb90 2024-09-12T01:43:54.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.847+0000 7f2c2d75f640 1 -- 172.21.15.60:0/4286686955 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c280693c0 con 0x7f2c280cfb90 2024-09-12T01:43:54.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.848+0000 7f2c1f7fe640 1 -- 172.21.15.60:0/4286686955 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16703 (secure 0 0 0) 0x7f2c1008a0c0 con 0x7f2c280cfb90 2024-09-12T01:43:54.848 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:54.848 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":128,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:43:53.182832+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:43:49.197828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-12T01:43:50.544112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:43:54.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.850+0000 7f2c2d75f640 1 -- 172.21.15.60:0/4286686955 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2c0806be30 msgr2=0x7f2c0806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.850+0000 7f2c2d75f640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2c0806be30 0x7f2c0806e2f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2c20034000 tx=0x7f2c2002e000 comp rx=0 tx=0).stop 2024-09-12T01:43:54.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.850+0000 7f2c2d75f640 1 -- 172.21.15.60:0/4286686955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c280cfb90 msgr2=0x7f2c28149a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.850+0000 7f2c2d75f640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c280cfb90 0x7f2c28149a50 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f2c10001eb0 tx=0x7f2c1000c820 comp rx=0 tx=0).stop 2024-09-12T01:43:54.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.850+0000 7f2c2d75f640 1 -- 172.21.15.60:0/4286686955 shutdown_connections 2024-09-12T01:43:54.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.850+0000 7f2c2d75f640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2c0806be30 0x7f2c0806e2f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.850+0000 7f2c2d75f640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2c280d2090 0x7f2c28149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.850+0000 7f2c2d75f640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2c280cfb90 0x7f2c28149a50 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.850+0000 7f2c2d75f640 1 --2- 172.21.15.60:0/4286686955 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2c2806fa50 0x7f2c280b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.850+0000 7f2c2d75f640 1 -- 172.21.15.60:0/4286686955 >> 172.21.15.60:0/4286686955 conn(0x7f2c28062630 msgr2=0x7f2c28155a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.850+0000 7f2c2d75f640 1 -- 172.21.15.60:0/4286686955 shutdown_connections 2024-09-12T01:43:54.851 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.850+0000 7f2c2d75f640 1 -- 172.21.15.60:0/4286686955 wait complete. 2024-09-12T01:43:54.861 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:43:54.861 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:43:54.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.963+0000 7fb01e8f1640 1 Processor -- start 2024-09-12T01:43:54.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.963+0000 7fb01e8f1640 1 -- start start 2024-09-12T01:43:54.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.964+0000 7fb01e8f1640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb0180b74c0 0x7fb01815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.964+0000 7fb01e8f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb01815f030 0x7fb01806d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.964+0000 7fb01e8f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb01815fb10 con 0x7fb01815c2b0 2024-09-12T01:43:54.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.964+0000 7fb01e8f1640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb0180b5900 con 0x7fb0180b74c0 2024-09-12T01:43:54.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.964+0000 7fb01e8f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb01815f830 con 0x7fb01815f030 2024-09-12T01:43:54.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.964+0000 7fb01ce8e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb01815f030 0x7fb01806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.964+0000 7fb0177fe640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb0180b74c0 0x7fb01815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.964+0000 7fb017fff640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fb01815c2b0 0x7fb0180b6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:53258/0 (socket says 172.21.15.60:53258) 2024-09-12T01:43:54.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.964+0000 7fb01ce8e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb01815f030 0x7fb01806d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:51768/0 (socket says 172.21.15.60:51768) 2024-09-12T01:43:54.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.964+0000 7fb017fff640 1 -- 172.21.15.60:0/1811985104 learned_addr learned my addr 172.21.15.60:0/1811985104 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:54.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.965+0000 7fb016ffd640 1 -- 172.21.15.60:0/1811985104 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671329166 0 0) 0x7fb01815fb10 con 0x7fb01815c2b0 2024-09-12T01:43:54.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.965+0000 7fb01ce8e640 1 -- 172.21.15.60:0/1811985104 >> v2:172.21.15.105:3300/0 conn(0x7fb0180b74c0 msgr2=0x7fb01815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:54.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.965+0000 7fb01ce8e640 1 --2- 172.21.15.60:0/1811985104 >> v2:172.21.15.105:3300/0 conn(0x7fb0180b74c0 0x7fb01815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.965+0000 7fb01ce8e640 1 -- 172.21.15.60:0/1811985104 >> v1:172.21.15.105:6789/0 conn(0x7fb01815c2b0 legacy=0x7fb0180b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.965 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.965+0000 7fb01ce8e640 1 -- 172.21.15.60:0/1811985104 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01806ce30 con 0x7fb01815f030 2024-09-12T01:43:54.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.965+0000 7fb01ce8e640 1 --2- 172.21.15.60:0/1811985104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb01815f030 0x7fb01806d910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb010009d90 tx=0x7fb01002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fa0373ba0940d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:54.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.966+0000 7fb016ffd640 1 -- 172.21.15.60:0/1811985104 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010007740 con 0x7fb01815f030 2024-09-12T01:43:54.966 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.966+0000 7fb016ffd640 1 -- 172.21.15.60:0/1811985104 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0100078e0 con 0x7fb01815f030 2024-09-12T01:43:54.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.966+0000 7fb016ffd640 1 -- 172.21.15.60:0/1811985104 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010007cb0 con 0x7fb01815f030 2024-09-12T01:43:54.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.966+0000 7fb01e8f1640 1 -- 172.21.15.60:0/1811985104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb01815f030 msgr2=0x7fb01806d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.966+0000 7fb01e8f1640 1 --2- 172.21.15.60:0/1811985104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb01815f030 0x7fb01806d910 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb010009d90 tx=0x7fb01002a660 comp rx=0 tx=0).stop 2024-09-12T01:43:54.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.966+0000 7fb01e8f1640 1 -- 172.21.15.60:0/1811985104 shutdown_connections 2024-09-12T01:43:54.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.966+0000 7fb01e8f1640 1 --2- 172.21.15.60:0/1811985104 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb01815f030 0x7fb01806d910 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.966+0000 7fb01e8f1640 1 --2- 172.21.15.60:0/1811985104 >> v2:172.21.15.105:3300/0 conn(0x7fb0180b74c0 0x7fb01815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.966+0000 7fb01e8f1640 1 -- 172.21.15.60:0/1811985104 >> 172.21.15.60:0/1811985104 conn(0x7fb0180b4240 msgr2=0x7fb0180b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:54.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.966+0000 7fb01e8f1640 1 -- 172.21.15.60:0/1811985104 shutdown_connections 2024-09-12T01:43:54.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.966+0000 7fb01e8f1640 1 -- 172.21.15.60:0/1811985104 wait complete. 2024-09-12T01:43:54.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.967+0000 7fb01e8f1640 1 Processor -- start 2024-09-12T01:43:54.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.968+0000 7fb01e8f1640 1 -- start start 2024-09-12T01:43:54.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.968+0000 7fb01e8f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0180b74c0 0x7fb0181580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.968+0000 7fb01e8f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb01815c2b0 0x7fb0180ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.968+0000 7fb01e8f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb01815f030 0x7fb0180cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.968+0000 7fb01e8f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb01815f4c0 con 0x7fb01815f030 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.968+0000 7fb01e8f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb01806d3f0 con 0x7fb0180b74c0 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.968+0000 7fb01e8f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb01806de50 con 0x7fb01815c2b0 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb01ce8e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb01815f030 0x7fb0180cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb01ce8e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb01815f030 0x7fb0180cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40820/0 (socket says 172.21.15.60:40820) 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb01ce8e640 1 -- 172.21.15.60:0/3837314608 learned_addr learned my addr 172.21.15.60:0/3837314608 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb017fff640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0180b74c0 0x7fb0181580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb0177fe640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb01815c2b0 0x7fb0180ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb01ce8e640 1 -- 172.21.15.60:0/3837314608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb01815c2b0 msgr2=0x7fb0180ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb01ce8e640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb01815c2b0 0x7fb0180ccc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb01ce8e640 1 -- 172.21.15.60:0/3837314608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0180b74c0 msgr2=0x7fb0181580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb01ce8e640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0180b74c0 0x7fb0181580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb01ce8e640 1 -- 172.21.15.60:0/3837314608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0180cb8c0 con 0x7fb01815f030 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb01ce8e640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb01815f030 0x7fb0180cecb0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb010009d90 tx=0x7fb010004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:54.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb014ff9640 1 -- 172.21.15.60:0/3837314608 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01003f070 con 0x7fb01815f030 2024-09-12T01:43:54.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb014ff9640 1 -- 172.21.15.60:0/3837314608 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb010031c40 con 0x7fb01815f030 2024-09-12T01:43:54.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb014ff9640 1 -- 172.21.15.60:0/3837314608 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb010009450 con 0x7fb01815f030 2024-09-12T01:43:54.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb01e8f1640 1 -- 172.21.15.60:0/3837314608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0180cbba0 con 0x7fb01815f030 2024-09-12T01:43:54.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.969+0000 7fb01e8f1640 1 -- 172.21.15.60:0/3837314608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0180cc160 con 0x7fb01815f030 2024-09-12T01:43:54.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.970+0000 7fb01e8f1640 1 -- 172.21.15.60:0/3837314608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb01815eaf0 con 0x7fb01815f030 2024-09-12T01:43:54.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.971+0000 7fb014ff9640 1 -- 172.21.15.60:0/3837314608 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb010003990 con 0x7fb01815f030 2024-09-12T01:43:54.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.971+0000 7fb014ff9640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb00406be30 0x7fb00406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:54.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.972+0000 7fb017fff640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb00406be30 0x7fb00406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:54.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.972+0000 7fb014ff9640 1 -- 172.21.15.60:0/3837314608 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fb0100abaf0 con 0x7fb01815f030 2024-09-12T01:43:54.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.972+0000 7fb017fff640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb00406be30 0x7fb00406e2f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb008000f60 tx=0x7fb008007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:54.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:54.976+0000 7fb014ff9640 1 -- 172.21.15.60:0/3837314608 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb010079ee0 con 0x7fb01815f030 2024-09-12T01:43:55.148 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.148+0000 7fb01e8f1640 1 -- 172.21.15.60:0/3837314608 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb0180693c0 con 0x7fb00406be30 2024-09-12T01:43:55.153 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.154+0000 7fb014ff9640 1 -- 172.21.15.60:0/3837314608 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241863 (secure 0 0 0) 0x7fb0180693c0 con 0x7fb00406be30 2024-09-12T01:43:55.156 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:55.161 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:43:55.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.157+0000 7fb01e8f1640 1 -- 172.21.15.60:0/3837314608 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb00406be30 msgr2=0x7fb00406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.157+0000 7fb01e8f1640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb00406be30 0x7fb00406e2f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb008000f60 tx=0x7fb008007d50 comp rx=0 tx=0).stop 2024-09-12T01:43:55.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.157+0000 7fb01e8f1640 1 -- 172.21.15.60:0/3837314608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb01815f030 msgr2=0x7fb0180cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.157+0000 7fb01e8f1640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb01815f030 0x7fb0180cecb0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fb010009d90 tx=0x7fb010004a40 comp rx=0 tx=0).stop 2024-09-12T01:43:55.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.157+0000 7fb01e8f1640 1 -- 172.21.15.60:0/3837314608 shutdown_connections 2024-09-12T01:43:55.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.157+0000 7fb01e8f1640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb01815f030 0x7fb0180cecb0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.157+0000 7fb01e8f1640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb00406be30 0x7fb00406e2f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.157+0000 7fb01e8f1640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb01815c2b0 0x7fb0180ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.157+0000 7fb01e8f1640 1 --2- 172.21.15.60:0/3837314608 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb0180b74c0 0x7fb0181580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.157+0000 7fb01e8f1640 1 -- 172.21.15.60:0/3837314608 >> 172.21.15.60:0/3837314608 conn(0x7fb0180b4240 msgr2=0x7fb01815cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:55.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.157+0000 7fb01e8f1640 1 -- 172.21.15.60:0/3837314608 shutdown_connections 2024-09-12T01:43:55.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.157+0000 7fb01e8f1640 1 -- 172.21.15.60:0/3837314608 wait complete. 2024-09-12T01:43:55.168 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2024-09-12T01:43:54.367473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283700,"kb_used_data":13360,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754691020,"statfs":{"total":773094113280,"available":772803604480,"internally_reserved":0,"allocated":13680640,"data_stored":6493063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.200904"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469273+0000","last_change":"2024-09-12T01:43:52.205904+0000","last_active":"2024-09-12T01:43:53.469273+0000","last_peered":"2024-09-12T01:43:53.469273+0000","last_clean":"2024-09-12T01:43:53.469273+0000","last_became_active":"2024-09-12T01:43:52.205590+0000","last_became_peered":"2024-09-12T01:43:52.205590+0000","last_unstale":"2024-09-12T01:43:53.469273+0000","last_undegraded":"2024-09-12T01:43:53.469273+0000","last_fullsized":"2024-09-12T01:43:53.469273+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:36.879938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468212+0000","last_change":"2024-09-12T01:43:52.198813+0000","last_active":"2024-09-12T01:43:53.468212+0000","last_peered":"2024-09-12T01:43:53.468212+0000","last_clean":"2024-09-12T01:43:53.468212+0000","last_became_active":"2024-09-12T01:43:52.198506+0000","last_became_peered":"2024-09-12T01:43:52.198506+0000","last_unstale":"2024-09-12T01:43:53.468212+0000","last_undegraded":"2024-09-12T01:43:53.468212+0000","last_fullsized":"2024-09-12T01:43:53.468212+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:45.961688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468875+0000","last_change":"2024-09-12T01:43:52.195966+0000","last_active":"2024-09-12T01:43:53.468875+0000","last_peered":"2024-09-12T01:43:53.468875+0000","last_clean":"2024-09-12T01:43:53.468875+0000","last_became_active":"2024-09-12T01:43:52.195660+0000","last_became_peered":"2024-09-12T01:43:52.195660+0000","last_unstale":"2024-09-12T01:43:53.468875+0000","last_undegraded":"2024-09-12T01:43:53.468875+0000","last_fullsized":"2024-09-12T01:43:53.468875+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:43.683128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469190+0000","last_change":"2024-09-12T01:43:52.196199+0000","last_active":"2024-09-12T01:43:53.469190+0000","last_peered":"2024-09-12T01:43:53.469190+0000","last_clean":"2024-09-12T01:43:53.469190+0000","last_became_active":"2024-09-12T01:43:52.195361+0000","last_became_peered":"2024-09-12T01:43:52.195361+0000","last_unstale":"2024-09-12T01:43:53.469190+0000","last_undegraded":"2024-09-12T01:43:53.469190+0000","last_fullsized":"2024-09-12T01:43:53.469190+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:34.000665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469385+0000","last_change":"2024-09-12T01:43:52.201745+0000","last_active":"2024-09-12T01:43:53.469385+0000","last_peered":"2024-09-12T01:43:53.469385+0000","last_clean":"2024-09-12T01:43:53.469385+0000","last_became_active":"2024-09-12T01:43:52.201464+0000","last_became_peered":"2024-09-12T01:43:52.201464+0000","last_unstale":"2024-09-12T01:43:53.469385+0000","last_undegraded":"2024-09-12T01:43:53.469385+0000","last_fullsized":"2024-09-12T01:43:53.469385+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:33.755285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468196+0000","last_change":"2024-09-12T01:43:52.202554+0000","last_active":"2024-09-12T01:43:53.468196+0000","last_peered":"2024-09-12T01:43:53.468196+0000","last_clean":"2024-09-12T01:43:53.468196+0000","last_became_active":"2024-09-12T01:43:52.202293+0000","last_became_peered":"2024-09-12T01:43:52.202293+0000","last_unstale":"2024-09-12T01:43:53.468196+0000","last_undegraded":"2024-09-12T01:43:53.468196+0000","last_fullsized":"2024-09-12T01:43:53.468196+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:20.285338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.172118+0000","last_change":"2024-09-12T01:43:50.172118+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.172118+0000","last_undegraded":"2024-09-12T01:43:50.172118+0000","last_fullsized":"2024-09-12T01:43:50.172118+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175305+0000","last_change":"2024-09-12T01:43:50.175305+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175305+0000","last_undegraded":"2024-09-12T01:43:50.175305+0000","last_fullsized":"2024-09-12T01:43:50.175305+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.172081+0000","last_change":"2024-09-12T01:43:50.172081+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.172081+0000","last_undegraded":"2024-09-12T01:43:50.172081+0000","last_fullsized":"2024-09-12T01:43:50.172081+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170806+0000","last_change":"2024-09-12T01:43:50.170806+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170806+0000","last_undegraded":"2024-09-12T01:43:50.170806+0000","last_fullsized":"2024-09-12T01:43:50.170806+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468306+0000","last_change":"2024-09-12T01:43:51.190466+0000","last_active":"2024-09-12T01:43:53.468306+0000","last_peered":"2024-09-12T01:43:53.468306+0000","last_clean":"2024-09-12T01:43:53.468306+0000","last_became_active":"2024-09-12T01:43:51.190282+0000","last_became_peered":"2024-09-12T01:43:51.190282+0000","last_unstale":"2024-09-12T01:43:53.468306+0000","last_undegraded":"2024-09-12T01:43:53.468306+0000","last_fullsized":"2024-09-12T01:43:53.468306+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:14.257545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168501+0000","last_change":"2024-09-12T01:43:50.168501+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168501+0000","last_undegraded":"2024-09-12T01:43:50.168501+0000","last_fullsized":"2024-09-12T01:43:50.168501+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175243+0000","last_change":"2024-09-12T01:43:50.175243+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175243+0000","last_undegraded":"2024-09-12T01:43:50.175243+0000","last_fullsized":"2024-09-12T01:43:50.175243+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171688+0000","last_change":"2024-09-12T01:43:50.171688+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171688+0000","last_undegraded":"2024-09-12T01:43:50.171688+0000","last_fullsized":"2024-09-12T01:43:50.171688+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175675+0000","last_change":"2024-09-12T01:43:50.175675+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175675+0000","last_undegraded":"2024-09-12T01:43:50.175675+0000","last_fullsized":"2024-09-12T01:43:50.175675+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168497+0000","last_change":"2024-09-12T01:43:50.168497+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168497+0000","last_undegraded":"2024-09-12T01:43:50.168497+0000","last_fullsized":"2024-09-12T01:43:50.168497+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170715+0000","last_change":"2024-09-12T01:43:50.170715+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170715+0000","last_undegraded":"2024-09-12T01:43:50.170715+0000","last_fullsized":"2024-09-12T01:43:50.170715+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171273+0000","last_change":"2024-09-12T01:43:50.171273+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171273+0000","last_undegraded":"2024-09-12T01:43:50.171273+0000","last_fullsized":"2024-09-12T01:43:50.171273+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469172+0000","last_change":"2024-09-12T01:43:52.202539+0000","last_active":"2024-09-12T01:43:53.469172+0000","last_peered":"2024-09-12T01:43:53.469172+0000","last_clean":"2024-09-12T01:43:53.469172+0000","last_became_active":"2024-09-12T01:43:52.201815+0000","last_became_peered":"2024-09-12T01:43:52.201815+0000","last_unstale":"2024-09-12T01:43:53.469172+0000","last_undegraded":"2024-09-12T01:43:53.469172+0000","last_fullsized":"2024-09-12T01:43:53.469172+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.323760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168831+0000","last_change":"2024-09-12T01:43:50.168831+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168831+0000","last_undegraded":"2024-09-12T01:43:50.168831+0000","last_fullsized":"2024-09-12T01:43:50.168831+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171844+0000","last_change":"2024-09-12T01:43:50.171844+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171844+0000","last_undegraded":"2024-09-12T01:43:50.171844+0000","last_fullsized":"2024-09-12T01:43:50.171844+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"127'8","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468380+0000","last_change":"2024-09-12T01:43:51.180654+0000","last_active":"2024-09-12T01:43:53.468380+0000","last_peered":"2024-09-12T01:43:53.468380+0000","last_clean":"2024-09-12T01:43:53.468380+0000","last_became_active":"2024-09-12T01:43:51.180405+0000","last_became_peered":"2024-09-12T01:43:51.180405+0000","last_unstale":"2024-09-12T01:43:53.468380+0000","last_undegraded":"2024-09-12T01:43:53.468380+0000","last_fullsized":"2024-09-12T01:43:53.468380+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.597910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171530+0000","last_change":"2024-09-12T01:43:50.171530+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171530+0000","last_undegraded":"2024-09-12T01:43:50.171530+0000","last_fullsized":"2024-09-12T01:43:50.171530+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469411+0000","last_change":"2024-09-12T01:43:51.184567+0000","last_active":"2024-09-12T01:43:53.469411+0000","last_peered":"2024-09-12T01:43:53.469411+0000","last_clean":"2024-09-12T01:43:53.469411+0000","last_became_active":"2024-09-12T01:43:51.184313+0000","last_became_peered":"2024-09-12T01:43:51.184313+0000","last_unstale":"2024-09-12T01:43:53.469411+0000","last_undegraded":"2024-09-12T01:43:53.469411+0000","last_fullsized":"2024-09-12T01:43:53.469411+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:26.397286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170285+0000","last_change":"2024-09-12T01:43:50.170285+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170285+0000","last_undegraded":"2024-09-12T01:43:50.170285+0000","last_fullsized":"2024-09-12T01:43:50.170285+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171888+0000","last_change":"2024-09-12T01:43:50.171888+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171888+0000","last_undegraded":"2024-09-12T01:43:50.171888+0000","last_fullsized":"2024-09-12T01:43:50.171888+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175214+0000","last_change":"2024-09-12T01:43:50.175214+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175214+0000","last_undegraded":"2024-09-12T01:43:50.175214+0000","last_fullsized":"2024-09-12T01:43:50.175214+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171249+0000","last_change":"2024-09-12T01:43:50.171249+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171249+0000","last_undegraded":"2024-09-12T01:43:50.171249+0000","last_fullsized":"2024-09-12T01:43:50.171249+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171226+0000","last_change":"2024-09-12T01:43:50.171226+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171226+0000","last_undegraded":"2024-09-12T01:43:50.171226+0000","last_fullsized":"2024-09-12T01:43:50.171226+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170430+0000","last_change":"2024-09-12T01:43:50.170430+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170430+0000","last_undegraded":"2024-09-12T01:43:50.170430+0000","last_fullsized":"2024-09-12T01:43:50.170430+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170422+0000","last_change":"2024-09-12T01:43:50.170422+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170422+0000","last_undegraded":"2024-09-12T01:43:50.170422+0000","last_fullsized":"2024-09-12T01:43:50.170422+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171882+0000","last_change":"2024-09-12T01:43:50.171882+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171882+0000","last_undegraded":"2024-09-12T01:43:50.171882+0000","last_fullsized":"2024-09-12T01:43:50.171882+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469348+0000","last_change":"2024-09-12T01:43:52.198800+0000","last_active":"2024-09-12T01:43:53.469348+0000","last_peered":"2024-09-12T01:43:53.469348+0000","last_clean":"2024-09-12T01:43:53.469348+0000","last_became_active":"2024-09-12T01:43:52.198490+0000","last_became_peered":"2024-09-12T01:43:52.198490+0000","last_unstale":"2024-09-12T01:43:53.469348+0000","last_undegraded":"2024-09-12T01:43:53.469348+0000","last_fullsized":"2024-09-12T01:43:53.469348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170699+0000","last_change":"2024-09-12T01:43:50.170699+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170699+0000","last_undegraded":"2024-09-12T01:43:50.170699+0000","last_fullsized":"2024-09-12T01:43:50.170699+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469170+0000","last_change":"2024-09-12T01:43:52.205916+0000","last_active":"2024-09-12T01:43:53.469170+0000","last_peered":"2024-09-12T01:43:53.469170+0000","last_clean":"2024-09-12T01:43:53.469170+0000","last_became_active":"2024-09-12T01:43:52.205619+0000","last_became_peered":"2024-09-12T01:43:52.205619+0000","last_unstale":"2024-09-12T01:43:53.469170+0000","last_undegraded":"2024-09-12T01:43:53.469170+0000","last_fullsized":"2024-09-12T01:43:53.469170+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.063068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170250+0000","last_change":"2024-09-12T01:43:50.170250+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170250+0000","last_undegraded":"2024-09-12T01:43:50.170250+0000","last_fullsized":"2024-09-12T01:43:50.170250+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171857+0000","last_change":"2024-09-12T01:43:50.171857+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171857+0000","last_undegraded":"2024-09-12T01:43:50.171857+0000","last_fullsized":"2024-09-12T01:43:50.171857+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171197+0000","last_change":"2024-09-12T01:43:50.171197+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171197+0000","last_undegraded":"2024-09-12T01:43:50.171197+0000","last_fullsized":"2024-09-12T01:43:50.171197+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168700+0000","last_change":"2024-09-12T01:43:50.168700+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168700+0000","last_undegraded":"2024-09-12T01:43:50.168700+0000","last_fullsized":"2024-09-12T01:43:50.168700+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175128+0000","last_change":"2024-09-12T01:43:50.175128+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175128+0000","last_undegraded":"2024-09-12T01:43:50.175128+0000","last_fullsized":"2024-09-12T01:43:50.175128+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168750+0000","last_change":"2024-09-12T01:43:50.168750+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168750+0000","last_undegraded":"2024-09-12T01:43:50.168750+0000","last_fullsized":"2024-09-12T01:43:50.168750+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":362,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-12T01:43:50.168285+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:43:50.168285+0000","last_peered":"2024-09-12T01:43:50.168285+0000","last_clean":"2024-09-12T01:43:50.168285+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:43:50.168285+0000","last_undegraded":"2024-09-12T01:43:50.168285+0000","last_fullsized":"2024-09-12T01:43:50.168285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1560576,"data_stored":664314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1560576,"data_stored":664314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33288,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338552,"statfs":{"total":96636764160,"available":96602677248,"internally_reserved":0,"allocated":2142208,"data_stored":1248865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36864,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334976,"statfs":{"total":96636764160,"available":96599015424,"internally_reserved":0,"allocated":1548288,"data_stored":658497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1548288,"data_stored":658497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37452,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334388,"statfs":{"total":96636764160,"available":96598413312,"internally_reserved":0,"allocated":2154496,"data_stored":1254682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1560576,"data_stored":664314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1605632,"data_stored":679580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:43:55.172 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:43:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.310+0000 7fdea48e6640 1 Processor -- start 2024-09-12T01:43:55.310 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.311+0000 7fdea48e6640 1 -- start start 2024-09-12T01:43:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.311+0000 7fdea48e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdea00d3310 0x7fdea00d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.311+0000 7fdea48e6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdea00d1650 0x7fdea00b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.311+0000 7fdea48e6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea015ea40 con 0x7fdea015e660 2024-09-12T01:43:55.311 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.311+0000 7fdea48e6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fdea00d1ac0 con 0x7fdea00d3310 2024-09-12T01:43:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.311+0000 7fdea48e6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fdea00d3870 con 0x7fdea00d1650 2024-09-12T01:43:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.312+0000 7fde9dd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdea00d3310 0x7fdea00d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.312+0000 7fde9dd9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdea00d3310 0x7fdea00d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40824/0 (socket says 172.21.15.60:40824) 2024-09-12T01:43:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.312+0000 7fde9dd9b640 1 -- 172.21.15.60:0/2192270239 learned_addr learned my addr 172.21.15.60:0/2192270239 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.312+0000 7fde9dd9b640 1 -- 172.21.15.60:0/2192270239 >> v2:172.21.15.105:3300/0 conn(0x7fdea00d1650 msgr2=0x7fdea00b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.312+0000 7fde9dd9b640 1 --2- 172.21.15.60:0/2192270239 >> v2:172.21.15.105:3300/0 conn(0x7fdea00d1650 0x7fdea00b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.312+0000 7fde9dd9b640 1 -- 172.21.15.60:0/2192270239 >> v1:172.21.15.105:6789/0 conn(0x7fdea015e660 legacy=0x7fdea00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:55.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.312+0000 7fde9dd9b640 1 -- 172.21.15.60:0/2192270239 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea00d3b50 con 0x7fdea00d3310 2024-09-12T01:43:55.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.313+0000 7fde9dd9b640 1 --2- 172.21.15.60:0/2192270239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea00d3310 0x7fdea00d1110 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fdea00d26b0 tx=0x7fde9402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a993b5cc1abcac1a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:55.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.313+0000 7fde9d59a640 1 -- 172.21.15.60:0/2192270239 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94037070 con 0x7fdea00d3310 2024-09-12T01:43:55.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.313+0000 7fde9d59a640 1 -- 172.21.15.60:0/2192270239 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde94032440 con 0x7fdea00d3310 2024-09-12T01:43:55.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.313+0000 7fde9d59a640 1 -- 172.21.15.60:0/2192270239 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94032810 con 0x7fdea00d3310 2024-09-12T01:43:55.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.313+0000 7fdea48e6640 1 -- 172.21.15.60:0/2192270239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea00d3310 msgr2=0x7fdea00d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.313+0000 7fdea48e6640 1 --2- 172.21.15.60:0/2192270239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea00d3310 0x7fdea00d1110 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fdea00d26b0 tx=0x7fde9402a230 comp rx=0 tx=0).stop 2024-09-12T01:43:55.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.313+0000 7fdea48e6640 1 -- 172.21.15.60:0/2192270239 shutdown_connections 2024-09-12T01:43:55.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.313+0000 7fdea48e6640 1 --2- 172.21.15.60:0/2192270239 >> v2:172.21.15.105:3300/0 conn(0x7fdea00d1650 0x7fdea00b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.313+0000 7fdea48e6640 1 --2- 172.21.15.60:0/2192270239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea00d3310 0x7fdea00d1110 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.313+0000 7fdea48e6640 1 -- 172.21.15.60:0/2192270239 >> 172.21.15.60:0/2192270239 conn(0x7fdea00b6410 msgr2=0x7fdea00b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:55.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.313+0000 7fdea48e6640 1 -- 172.21.15.60:0/2192270239 shutdown_connections 2024-09-12T01:43:55.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.314+0000 7fdea48e6640 1 -- 172.21.15.60:0/2192270239 wait complete. 2024-09-12T01:43:55.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.315+0000 7fdea48e6640 1 Processor -- start 2024-09-12T01:43:55.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.315+0000 7fdea48e6640 1 -- start start 2024-09-12T01:43:55.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.315+0000 7fdea48e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdea00d1650 0x7fdea00b8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:55.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.315+0000 7fdea48e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea00d3310 0x7fdea01509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:55.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fdea48e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea015e660 0x7fdea0150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:55.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fdea48e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdea00d43f0 con 0x7fdea015e660 2024-09-12T01:43:55.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fdea48e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdea00d4110 con 0x7fdea00d1650 2024-09-12T01:43:55.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fdea48e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdea00b80b0 con 0x7fdea00d3310 2024-09-12T01:43:55.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea015e660 0x7fdea0150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:55.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9ed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea015e660 0x7fdea0150f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40826/0 (socket says 172.21.15.60:40826) 2024-09-12T01:43:55.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9ed9d640 1 -- 172.21.15.60:0/1598899426 learned_addr learned my addr 172.21.15.60:0/1598899426 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:55.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9e59c640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdea00d1650 0x7fdea00b8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:55.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9dd9b640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea00d3310 0x7fdea01509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:55.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9ed9d640 1 -- 172.21.15.60:0/1598899426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea00d3310 msgr2=0x7fdea01509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9ed9d640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea00d3310 0x7fdea01509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9ed9d640 1 -- 172.21.15.60:0/1598899426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdea00d1650 msgr2=0x7fdea00b8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9ed9d640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdea00d1650 0x7fdea00b8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9ed9d640 1 -- 172.21.15.60:0/1598899426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea00cb160 con 0x7fdea015e660 2024-09-12T01:43:55.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9e59c640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdea00d1650 0x7fdea00b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:55.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9dd9b640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea00d3310 0x7fdea01509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:55.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde9ed9d640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea015e660 0x7fdea0150f10 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fde9800b970 tx=0x7fde9800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:55.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde8effd640 1 -- 172.21.15.60:0/1598899426 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98019070 con 0x7fdea015e660 2024-09-12T01:43:55.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde8effd640 1 -- 172.21.15.60:0/1598899426 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9800cb60 con 0x7fdea015e660 2024-09-12T01:43:55.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fdea48e6640 1 -- 172.21.15.60:0/1598899426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea015b2d0 con 0x7fdea015e660 2024-09-12T01:43:55.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fde8effd640 1 -- 172.21.15.60:0/1598899426 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde98014440 con 0x7fdea015e660 2024-09-12T01:43:55.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.316+0000 7fdea48e6640 1 -- 172.21.15.60:0/1598899426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea015b890 con 0x7fdea015e660 2024-09-12T01:43:55.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.318+0000 7fdea48e6640 1 -- 172.21.15.60:0/1598899426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea00b7b70 con 0x7fdea015e660 2024-09-12T01:43:55.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.318+0000 7fde8effd640 1 -- 172.21.15.60:0/1598899426 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fde9801c070 con 0x7fdea015e660 2024-09-12T01:43:55.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.318+0000 7fde8effd640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde8006be60 0x7fde8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:55.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.319+0000 7fde8effd640 1 -- 172.21.15.60:0/1598899426 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fde9808abc0 con 0x7fdea015e660 2024-09-12T01:43:55.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.319+0000 7fde9e59c640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde8006be60 0x7fde8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:55.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.319+0000 7fde9e59c640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde8006be60 0x7fde8006e320 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fde90006fd0 tx=0x7fde90008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:55.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.323+0000 7fde8effd640 1 -- 172.21.15.60:0/1598899426 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fde98059560 con 0x7fdea015e660 2024-09-12T01:43:55.494 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.495+0000 7fdea48e6640 1 -- 172.21.15.60:0/1598899426 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdea00b4480 con 0x7fde8006be60 2024-09-12T01:43:55.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.500+0000 7fde8effd640 1 -- 172.21.15.60:0/1598899426 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241863 (secure 0 0 0) 0x7fdea00b4480 con 0x7fde8006be60 2024-09-12T01:43:55.502 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:55.503 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:43:55.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.504+0000 7fdea48e6640 1 -- 172.21.15.60:0/1598899426 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde8006be60 msgr2=0x7fde8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.504+0000 7fdea48e6640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde8006be60 0x7fde8006e320 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fde90006fd0 tx=0x7fde90008040 comp rx=0 tx=0).stop 2024-09-12T01:43:55.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.504+0000 7fdea48e6640 1 -- 172.21.15.60:0/1598899426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea015e660 msgr2=0x7fdea0150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.504+0000 7fdea48e6640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea015e660 0x7fdea0150f10 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fde9800b970 tx=0x7fde9800be30 comp rx=0 tx=0).stop 2024-09-12T01:43:55.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.504+0000 7fdea48e6640 1 -- 172.21.15.60:0/1598899426 shutdown_connections 2024-09-12T01:43:55.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.504+0000 7fdea48e6640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdea015e660 0x7fdea0150f10 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.504+0000 7fdea48e6640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fde8006be60 0x7fde8006e320 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.504+0000 7fdea48e6640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdea00d3310 0x7fdea01509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.504+0000 7fdea48e6640 1 --2- 172.21.15.60:0/1598899426 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdea00d1650 0x7fdea00b8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.504+0000 7fdea48e6640 1 -- 172.21.15.60:0/1598899426 >> 172.21.15.60:0/1598899426 conn(0x7fdea00b6410 msgr2=0x7fdea00b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.504+0000 7fdea48e6640 1 -- 172.21.15.60:0/1598899426 shutdown_connections 2024-09-12T01:43:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.504+0000 7fdea48e6640 1 -- 172.21.15.60:0/1598899426 wait complete. 2024-09-12T01:43:55.514 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2024-09-12T01:43:54.367473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283700,"kb_used_data":13360,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754691020,"statfs":{"total":773094113280,"available":772803604480,"internally_reserved":0,"allocated":13680640,"data_stored":6493063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.200904"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469273+0000","last_change":"2024-09-12T01:43:52.205904+0000","last_active":"2024-09-12T01:43:53.469273+0000","last_peered":"2024-09-12T01:43:53.469273+0000","last_clean":"2024-09-12T01:43:53.469273+0000","last_became_active":"2024-09-12T01:43:52.205590+0000","last_became_peered":"2024-09-12T01:43:52.205590+0000","last_unstale":"2024-09-12T01:43:53.469273+0000","last_undegraded":"2024-09-12T01:43:53.469273+0000","last_fullsized":"2024-09-12T01:43:53.469273+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:36.879938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468212+0000","last_change":"2024-09-12T01:43:52.198813+0000","last_active":"2024-09-12T01:43:53.468212+0000","last_peered":"2024-09-12T01:43:53.468212+0000","last_clean":"2024-09-12T01:43:53.468212+0000","last_became_active":"2024-09-12T01:43:52.198506+0000","last_became_peered":"2024-09-12T01:43:52.198506+0000","last_unstale":"2024-09-12T01:43:53.468212+0000","last_undegraded":"2024-09-12T01:43:53.468212+0000","last_fullsized":"2024-09-12T01:43:53.468212+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:45.961688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468875+0000","last_change":"2024-09-12T01:43:52.195966+0000","last_active":"2024-09-12T01:43:53.468875+0000","last_peered":"2024-09-12T01:43:53.468875+0000","last_clean":"2024-09-12T01:43:53.468875+0000","last_became_active":"2024-09-12T01:43:52.195660+0000","last_became_peered":"2024-09-12T01:43:52.195660+0000","last_unstale":"2024-09-12T01:43:53.468875+0000","last_undegraded":"2024-09-12T01:43:53.468875+0000","last_fullsized":"2024-09-12T01:43:53.468875+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:43.683128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469190+0000","last_change":"2024-09-12T01:43:52.196199+0000","last_active":"2024-09-12T01:43:53.469190+0000","last_peered":"2024-09-12T01:43:53.469190+0000","last_clean":"2024-09-12T01:43:53.469190+0000","last_became_active":"2024-09-12T01:43:52.195361+0000","last_became_peered":"2024-09-12T01:43:52.195361+0000","last_unstale":"2024-09-12T01:43:53.469190+0000","last_undegraded":"2024-09-12T01:43:53.469190+0000","last_fullsized":"2024-09-12T01:43:53.469190+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:34.000665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469385+0000","last_change":"2024-09-12T01:43:52.201745+0000","last_active":"2024-09-12T01:43:53.469385+0000","last_peered":"2024-09-12T01:43:53.469385+0000","last_clean":"2024-09-12T01:43:53.469385+0000","last_became_active":"2024-09-12T01:43:52.201464+0000","last_became_peered":"2024-09-12T01:43:52.201464+0000","last_unstale":"2024-09-12T01:43:53.469385+0000","last_undegraded":"2024-09-12T01:43:53.469385+0000","last_fullsized":"2024-09-12T01:43:53.469385+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:33.755285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468196+0000","last_change":"2024-09-12T01:43:52.202554+0000","last_active":"2024-09-12T01:43:53.468196+0000","last_peered":"2024-09-12T01:43:53.468196+0000","last_clean":"2024-09-12T01:43:53.468196+0000","last_became_active":"2024-09-12T01:43:52.202293+0000","last_became_peered":"2024-09-12T01:43:52.202293+0000","last_unstale":"2024-09-12T01:43:53.468196+0000","last_undegraded":"2024-09-12T01:43:53.468196+0000","last_fullsized":"2024-09-12T01:43:53.468196+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:20.285338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.172118+0000","last_change":"2024-09-12T01:43:50.172118+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.172118+0000","last_undegraded":"2024-09-12T01:43:50.172118+0000","last_fullsized":"2024-09-12T01:43:50.172118+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175305+0000","last_change":"2024-09-12T01:43:50.175305+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175305+0000","last_undegraded":"2024-09-12T01:43:50.175305+0000","last_fullsized":"2024-09-12T01:43:50.175305+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.172081+0000","last_change":"2024-09-12T01:43:50.172081+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.172081+0000","last_undegraded":"2024-09-12T01:43:50.172081+0000","last_fullsized":"2024-09-12T01:43:50.172081+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170806+0000","last_change":"2024-09-12T01:43:50.170806+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170806+0000","last_undegraded":"2024-09-12T01:43:50.170806+0000","last_fullsized":"2024-09-12T01:43:50.170806+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468306+0000","last_change":"2024-09-12T01:43:51.190466+0000","last_active":"2024-09-12T01:43:53.468306+0000","last_peered":"2024-09-12T01:43:53.468306+0000","last_clean":"2024-09-12T01:43:53.468306+0000","last_became_active":"2024-09-12T01:43:51.190282+0000","last_became_peered":"2024-09-12T01:43:51.190282+0000","last_unstale":"2024-09-12T01:43:53.468306+0000","last_undegraded":"2024-09-12T01:43:53.468306+0000","last_fullsized":"2024-09-12T01:43:53.468306+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:14.257545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168501+0000","last_change":"2024-09-12T01:43:50.168501+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168501+0000","last_undegraded":"2024-09-12T01:43:50.168501+0000","last_fullsized":"2024-09-12T01:43:50.168501+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175243+0000","last_change":"2024-09-12T01:43:50.175243+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175243+0000","last_undegraded":"2024-09-12T01:43:50.175243+0000","last_fullsized":"2024-09-12T01:43:50.175243+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171688+0000","last_change":"2024-09-12T01:43:50.171688+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171688+0000","last_undegraded":"2024-09-12T01:43:50.171688+0000","last_fullsized":"2024-09-12T01:43:50.171688+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175675+0000","last_change":"2024-09-12T01:43:50.175675+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175675+0000","last_undegraded":"2024-09-12T01:43:50.175675+0000","last_fullsized":"2024-09-12T01:43:50.175675+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168497+0000","last_change":"2024-09-12T01:43:50.168497+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168497+0000","last_undegraded":"2024-09-12T01:43:50.168497+0000","last_fullsized":"2024-09-12T01:43:50.168497+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170715+0000","last_change":"2024-09-12T01:43:50.170715+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170715+0000","last_undegraded":"2024-09-12T01:43:50.170715+0000","last_fullsized":"2024-09-12T01:43:50.170715+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171273+0000","last_change":"2024-09-12T01:43:50.171273+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171273+0000","last_undegraded":"2024-09-12T01:43:50.171273+0000","last_fullsized":"2024-09-12T01:43:50.171273+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469172+0000","last_change":"2024-09-12T01:43:52.202539+0000","last_active":"2024-09-12T01:43:53.469172+0000","last_peered":"2024-09-12T01:43:53.469172+0000","last_clean":"2024-09-12T01:43:53.469172+0000","last_became_active":"2024-09-12T01:43:52.201815+0000","last_became_peered":"2024-09-12T01:43:52.201815+0000","last_unstale":"2024-09-12T01:43:53.469172+0000","last_undegraded":"2024-09-12T01:43:53.469172+0000","last_fullsized":"2024-09-12T01:43:53.469172+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.323760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168831+0000","last_change":"2024-09-12T01:43:50.168831+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168831+0000","last_undegraded":"2024-09-12T01:43:50.168831+0000","last_fullsized":"2024-09-12T01:43:50.168831+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171844+0000","last_change":"2024-09-12T01:43:50.171844+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171844+0000","last_undegraded":"2024-09-12T01:43:50.171844+0000","last_fullsized":"2024-09-12T01:43:50.171844+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"127'8","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468380+0000","last_change":"2024-09-12T01:43:51.180654+0000","last_active":"2024-09-12T01:43:53.468380+0000","last_peered":"2024-09-12T01:43:53.468380+0000","last_clean":"2024-09-12T01:43:53.468380+0000","last_became_active":"2024-09-12T01:43:51.180405+0000","last_became_peered":"2024-09-12T01:43:51.180405+0000","last_unstale":"2024-09-12T01:43:53.468380+0000","last_undegraded":"2024-09-12T01:43:53.468380+0000","last_fullsized":"2024-09-12T01:43:53.468380+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.597910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171530+0000","last_change":"2024-09-12T01:43:50.171530+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171530+0000","last_undegraded":"2024-09-12T01:43:50.171530+0000","last_fullsized":"2024-09-12T01:43:50.171530+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469411+0000","last_change":"2024-09-12T01:43:51.184567+0000","last_active":"2024-09-12T01:43:53.469411+0000","last_peered":"2024-09-12T01:43:53.469411+0000","last_clean":"2024-09-12T01:43:53.469411+0000","last_became_active":"2024-09-12T01:43:51.184313+0000","last_became_peered":"2024-09-12T01:43:51.184313+0000","last_unstale":"2024-09-12T01:43:53.469411+0000","last_undegraded":"2024-09-12T01:43:53.469411+0000","last_fullsized":"2024-09-12T01:43:53.469411+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:26.397286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170285+0000","last_change":"2024-09-12T01:43:50.170285+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170285+0000","last_undegraded":"2024-09-12T01:43:50.170285+0000","last_fullsized":"2024-09-12T01:43:50.170285+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171888+0000","last_change":"2024-09-12T01:43:50.171888+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171888+0000","last_undegraded":"2024-09-12T01:43:50.171888+0000","last_fullsized":"2024-09-12T01:43:50.171888+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175214+0000","last_change":"2024-09-12T01:43:50.175214+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175214+0000","last_undegraded":"2024-09-12T01:43:50.175214+0000","last_fullsized":"2024-09-12T01:43:50.175214+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171249+0000","last_change":"2024-09-12T01:43:50.171249+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171249+0000","last_undegraded":"2024-09-12T01:43:50.171249+0000","last_fullsized":"2024-09-12T01:43:50.171249+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171226+0000","last_change":"2024-09-12T01:43:50.171226+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171226+0000","last_undegraded":"2024-09-12T01:43:50.171226+0000","last_fullsized":"2024-09-12T01:43:50.171226+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170430+0000","last_change":"2024-09-12T01:43:50.170430+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170430+0000","last_undegraded":"2024-09-12T01:43:50.170430+0000","last_fullsized":"2024-09-12T01:43:50.170430+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170422+0000","last_change":"2024-09-12T01:43:50.170422+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170422+0000","last_undegraded":"2024-09-12T01:43:50.170422+0000","last_fullsized":"2024-09-12T01:43:50.170422+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171882+0000","last_change":"2024-09-12T01:43:50.171882+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171882+0000","last_undegraded":"2024-09-12T01:43:50.171882+0000","last_fullsized":"2024-09-12T01:43:50.171882+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469348+0000","last_change":"2024-09-12T01:43:52.198800+0000","last_active":"2024-09-12T01:43:53.469348+0000","last_peered":"2024-09-12T01:43:53.469348+0000","last_clean":"2024-09-12T01:43:53.469348+0000","last_became_active":"2024-09-12T01:43:52.198490+0000","last_became_peered":"2024-09-12T01:43:52.198490+0000","last_unstale":"2024-09-12T01:43:53.469348+0000","last_undegraded":"2024-09-12T01:43:53.469348+0000","last_fullsized":"2024-09-12T01:43:53.469348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170699+0000","last_change":"2024-09-12T01:43:50.170699+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170699+0000","last_undegraded":"2024-09-12T01:43:50.170699+0000","last_fullsized":"2024-09-12T01:43:50.170699+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469170+0000","last_change":"2024-09-12T01:43:52.205916+0000","last_active":"2024-09-12T01:43:53.469170+0000","last_peered":"2024-09-12T01:43:53.469170+0000","last_clean":"2024-09-12T01:43:53.469170+0000","last_became_active":"2024-09-12T01:43:52.205619+0000","last_became_peered":"2024-09-12T01:43:52.205619+0000","last_unstale":"2024-09-12T01:43:53.469170+0000","last_undegraded":"2024-09-12T01:43:53.469170+0000","last_fullsized":"2024-09-12T01:43:53.469170+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.063068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170250+0000","last_change":"2024-09-12T01:43:50.170250+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170250+0000","last_undegraded":"2024-09-12T01:43:50.170250+0000","last_fullsized":"2024-09-12T01:43:50.170250+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171857+0000","last_change":"2024-09-12T01:43:50.171857+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171857+0000","last_undegraded":"2024-09-12T01:43:50.171857+0000","last_fullsized":"2024-09-12T01:43:50.171857+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171197+0000","last_change":"2024-09-12T01:43:50.171197+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171197+0000","last_undegraded":"2024-09-12T01:43:50.171197+0000","last_fullsized":"2024-09-12T01:43:50.171197+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168700+0000","last_change":"2024-09-12T01:43:50.168700+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168700+0000","last_undegraded":"2024-09-12T01:43:50.168700+0000","last_fullsized":"2024-09-12T01:43:50.168700+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175128+0000","last_change":"2024-09-12T01:43:50.175128+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175128+0000","last_undegraded":"2024-09-12T01:43:50.175128+0000","last_fullsized":"2024-09-12T01:43:50.175128+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168750+0000","last_change":"2024-09-12T01:43:50.168750+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168750+0000","last_undegraded":"2024-09-12T01:43:50.168750+0000","last_fullsized":"2024-09-12T01:43:50.168750+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":362,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-12T01:43:50.168285+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:43:50.168285+0000","last_peered":"2024-09-12T01:43:50.168285+0000","last_clean":"2024-09-12T01:43:50.168285+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:43:50.168285+0000","last_undegraded":"2024-09-12T01:43:50.168285+0000","last_fullsized":"2024-09-12T01:43:50.168285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1560576,"data_stored":664314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1560576,"data_stored":664314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33288,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338552,"statfs":{"total":96636764160,"available":96602677248,"internally_reserved":0,"allocated":2142208,"data_stored":1248865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36864,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334976,"statfs":{"total":96636764160,"available":96599015424,"internally_reserved":0,"allocated":1548288,"data_stored":658497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1548288,"data_stored":658497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37452,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334388,"statfs":{"total":96636764160,"available":96598413312,"internally_reserved":0,"allocated":2154496,"data_stored":1254682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1560576,"data_stored":664314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1605632,"data_stored":679580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:43:55.518 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:43:55.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.657+0000 7f3026d6d640 1 Processor -- start 2024-09-12T01:43:55.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.657+0000 7f3026d6d640 1 -- start start 2024-09-12T01:43:55.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f3026d6d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30200b4d00 0x7f30200b5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:55.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f3026d6d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f30200cd780 0x7f30200cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:55.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f3026d6d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30200ce4f0 con 0x7f30200b4920 2024-09-12T01:43:55.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f3026d6d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f30200cf100 con 0x7f30200b4d00 2024-09-12T01:43:55.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f3026d6d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f30200ce7d0 con 0x7f30200cd780 2024-09-12T01:43:55.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f3024b09640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f30200b4920 0x7f302015b7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36314/0 (socket says 172.21.15.60:36314) 2024-09-12T01:43:55.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f3024b09640 1 -- 172.21.15.60:0/1388268408 learned_addr learned my addr 172.21.15.60:0/1388268408 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:55.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f301ffff640 1 --2- 172.21.15.60:0/1388268408 >> v2:172.21.15.60:3300/0 conn(0x7f30200b4d00 0x7f30200b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:55.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f301ffff640 1 -- 172.21.15.60:0/1388268408 >> v2:172.21.15.105:3300/0 conn(0x7f30200cd780 msgr2=0x7f30200cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:55.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f302530a640 1 --2- 172.21.15.60:0/1388268408 >> v2:172.21.15.105:3300/0 conn(0x7f30200cd780 0x7f30200cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:55.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f301ffff640 1 --2- 172.21.15.60:0/1388268408 >> v2:172.21.15.105:3300/0 conn(0x7f30200cd780 0x7f30200cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f301ffff640 1 -- 172.21.15.60:0/1388268408 >> v1:172.21.15.60:6789/0 conn(0x7f30200b4920 legacy=0x7f302015b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f301f7fe640 1 -- 172.21.15.60:0/1388268408 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2140926713 0 0) 0x7f30200ce4f0 con 0x7f30200b4920 2024-09-12T01:43:55.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f301ffff640 1 -- 172.21.15.60:0/1388268408 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30200ceab0 con 0x7f30200b4d00 2024-09-12T01:43:55.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.658+0000 7f302530a640 1 --2- 172.21.15.60:0/1388268408 >> v2:172.21.15.105:3300/0 conn(0x7f30200cd780 0x7f30200cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:43:55.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.659+0000 7f301ffff640 1 --2- 172.21.15.60:0/1388268408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30200b4d00 0x7f30200b5170 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f30200b34b0 tx=0x7f300c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43e563e60295d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:55.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.659+0000 7f301f7fe640 1 -- 172.21.15.60:0/1388268408 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c037070 con 0x7f30200b4d00 2024-09-12T01:43:55.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.659+0000 7f301f7fe640 1 -- 172.21.15.60:0/1388268408 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f300c032440 con 0x7f30200b4d00 2024-09-12T01:43:55.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.659+0000 7f301f7fe640 1 -- 172.21.15.60:0/1388268408 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300c032810 con 0x7f30200b4d00 2024-09-12T01:43:55.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.660+0000 7f3026d6d640 1 -- 172.21.15.60:0/1388268408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30200b4d00 msgr2=0x7f30200b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.660+0000 7f3026d6d640 1 --2- 172.21.15.60:0/1388268408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30200b4d00 0x7f30200b5170 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f30200b34b0 tx=0x7f300c02a1a0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.660+0000 7f3026d6d640 1 -- 172.21.15.60:0/1388268408 shutdown_connections 2024-09-12T01:43:55.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.660+0000 7f3026d6d640 1 --2- 172.21.15.60:0/1388268408 >> v2:172.21.15.105:3300/0 conn(0x7f30200cd780 0x7f30200cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.660+0000 7f3026d6d640 1 --2- 172.21.15.60:0/1388268408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30200b4d00 0x7f30200b5170 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.660+0000 7f3026d6d640 1 -- 172.21.15.60:0/1388268408 >> 172.21.15.60:0/1388268408 conn(0x7f302006bc10 msgr2=0x7f302006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:55.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.660+0000 7f3026d6d640 1 -- 172.21.15.60:0/1388268408 shutdown_connections 2024-09-12T01:43:55.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.660+0000 7f3026d6d640 1 -- 172.21.15.60:0/1388268408 wait complete. 2024-09-12T01:43:55.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.661+0000 7f3026d6d640 1 Processor -- start 2024-09-12T01:43:55.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.661+0000 7f3026d6d640 1 -- start start 2024-09-12T01:43:55.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f3026d6d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30200b4920 0x7f30201f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:55.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f3026d6d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30200b4d00 0x7f30200c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:55.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f3026d6d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30200cd780 0x7f3020149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:55.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f3026d6d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f30200ce0d0 con 0x7f30200cd780 2024-09-12T01:43:55.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f3026d6d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f30200b56b0 con 0x7f30200b4920 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f3026d6d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f30200ce250 con 0x7f30200b4d00 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f302530a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30200cd780 0x7f3020149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f302530a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30200cd780 0x7f3020149b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40854/0 (socket says 172.21.15.60:40854) 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f302530a640 1 -- 172.21.15.60:0/400277880 learned_addr learned my addr 172.21.15.60:0/400277880 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f3024b09640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30200b4920 0x7f30201f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f301ffff640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30200b4d00 0x7f30200c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f302530a640 1 -- 172.21.15.60:0/400277880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30200b4d00 msgr2=0x7f30200c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f302530a640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30200b4d00 0x7f30200c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f302530a640 1 -- 172.21.15.60:0/400277880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30200b4920 msgr2=0x7f30201f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f302530a640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30200b4920 0x7f30201f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.662+0000 7f302530a640 1 -- 172.21.15.60:0/400277880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30200cc1c0 con 0x7f30200cd780 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.663+0000 7f302530a640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30200cd780 0x7f3020149b20 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f301800cca0 tx=0x7f301800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:55.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.663+0000 7f301d7fa640 1 -- 172.21.15.60:0/400277880 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301800f680 con 0x7f30200cd780 2024-09-12T01:43:55.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.663+0000 7f301d7fa640 1 -- 172.21.15.60:0/400277880 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301800f840 con 0x7f30200cd780 2024-09-12T01:43:55.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.663+0000 7f3026d6d640 1 -- 172.21.15.60:0/400277880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30200cc4a0 con 0x7f30200cd780 2024-09-12T01:43:55.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.663+0000 7f301d7fa640 1 -- 172.21.15.60:0/400277880 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301800fc30 con 0x7f30200cd780 2024-09-12T01:43:55.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.663+0000 7f3026d6d640 1 -- 172.21.15.60:0/400277880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30200cca60 con 0x7f30200cd780 2024-09-12T01:43:55.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.664+0000 7f3026d6d640 1 -- 172.21.15.60:0/400277880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30200b5170 con 0x7f30200cd780 2024-09-12T01:43:55.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.664+0000 7f301d7fa640 1 -- 172.21.15.60:0/400277880 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f30180213f0 con 0x7f30200cd780 2024-09-12T01:43:55.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.665+0000 7f301d7fa640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f300406be30 0x7f300406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:55.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.665+0000 7f3024b09640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f300406be30 0x7f300406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:55.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.665+0000 7f301d7fa640 1 -- 172.21.15.60:0/400277880 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f301808b9d0 con 0x7f30200cd780 2024-09-12T01:43:55.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.665+0000 7f3024b09640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f300406be30 0x7f300406e2f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3014000f60 tx=0x7f3014007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:55.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.669+0000 7f301d7fa640 1 -- 172.21.15.60:0/400277880 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3018014030 con 0x7f30200cd780 2024-09-12T01:43:55.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.843+0000 7f3026d6d640 1 -- 172.21.15.60:0/400277880 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f302015af80 con 0x7f300406be30 2024-09-12T01:43:55.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.849+0000 7f301d7fa640 1 -- 172.21.15.60:0/400277880 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+241863 (secure 0 0 0) 0x7f302015af80 con 0x7f300406be30 2024-09-12T01:43:55.851 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:55.852 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:43:55.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.852+0000 7f3026d6d640 1 -- 172.21.15.60:0/400277880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f300406be30 msgr2=0x7f300406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.852+0000 7f3026d6d640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f300406be30 0x7f300406e2f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3014000f60 tx=0x7f3014007d50 comp rx=0 tx=0).stop 2024-09-12T01:43:55.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.852+0000 7f3026d6d640 1 -- 172.21.15.60:0/400277880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30200cd780 msgr2=0x7f3020149b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:55.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.852+0000 7f3026d6d640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30200cd780 0x7f3020149b20 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f301800cca0 tx=0x7f301800a650 comp rx=0 tx=0).stop 2024-09-12T01:43:55.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.852+0000 7f3026d6d640 1 -- 172.21.15.60:0/400277880 shutdown_connections 2024-09-12T01:43:55.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.852+0000 7f3026d6d640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30200cd780 0x7f3020149b20 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.852+0000 7f3026d6d640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f300406be30 0x7f300406e2f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.852+0000 7f3026d6d640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30200b4d00 0x7f30200c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.852+0000 7f3026d6d640 1 --2- 172.21.15.60:0/400277880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f30200b4920 0x7f30201f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:55.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.852+0000 7f3026d6d640 1 -- 172.21.15.60:0/400277880 >> 172.21.15.60:0/400277880 conn(0x7f302006bc10 msgr2=0x7f30200b5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:55.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.852+0000 7f3026d6d640 1 -- 172.21.15.60:0/400277880 shutdown_connections 2024-09-12T01:43:55.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:55.853+0000 7f3026d6d640 1 -- 172.21.15.60:0/400277880 wait complete. 2024-09-12T01:43:55.863 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2024-09-12T01:43:54.367473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":174,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":84,"acting":84,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":283700,"kb_used_data":13360,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754691020,"statfs":{"total":773094113280,"available":772803604480,"internally_reserved":0,"allocated":13680640,"data_stored":6493063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.200904"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469273+0000","last_change":"2024-09-12T01:43:52.205904+0000","last_active":"2024-09-12T01:43:53.469273+0000","last_peered":"2024-09-12T01:43:53.469273+0000","last_clean":"2024-09-12T01:43:53.469273+0000","last_became_active":"2024-09-12T01:43:52.205590+0000","last_became_peered":"2024-09-12T01:43:52.205590+0000","last_unstale":"2024-09-12T01:43:53.469273+0000","last_undegraded":"2024-09-12T01:43:53.469273+0000","last_fullsized":"2024-09-12T01:43:53.469273+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:36.879938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468212+0000","last_change":"2024-09-12T01:43:52.198813+0000","last_active":"2024-09-12T01:43:53.468212+0000","last_peered":"2024-09-12T01:43:53.468212+0000","last_clean":"2024-09-12T01:43:53.468212+0000","last_became_active":"2024-09-12T01:43:52.198506+0000","last_became_peered":"2024-09-12T01:43:52.198506+0000","last_unstale":"2024-09-12T01:43:53.468212+0000","last_undegraded":"2024-09-12T01:43:53.468212+0000","last_fullsized":"2024-09-12T01:43:53.468212+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:45.961688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468875+0000","last_change":"2024-09-12T01:43:52.195966+0000","last_active":"2024-09-12T01:43:53.468875+0000","last_peered":"2024-09-12T01:43:53.468875+0000","last_clean":"2024-09-12T01:43:53.468875+0000","last_became_active":"2024-09-12T01:43:52.195660+0000","last_became_peered":"2024-09-12T01:43:52.195660+0000","last_unstale":"2024-09-12T01:43:53.468875+0000","last_undegraded":"2024-09-12T01:43:53.468875+0000","last_fullsized":"2024-09-12T01:43:53.468875+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:43.683128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469190+0000","last_change":"2024-09-12T01:43:52.196199+0000","last_active":"2024-09-12T01:43:53.469190+0000","last_peered":"2024-09-12T01:43:53.469190+0000","last_clean":"2024-09-12T01:43:53.469190+0000","last_became_active":"2024-09-12T01:43:52.195361+0000","last_became_peered":"2024-09-12T01:43:52.195361+0000","last_unstale":"2024-09-12T01:43:53.469190+0000","last_undegraded":"2024-09-12T01:43:53.469190+0000","last_fullsized":"2024-09-12T01:43:53.469190+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:34.000665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469385+0000","last_change":"2024-09-12T01:43:52.201745+0000","last_active":"2024-09-12T01:43:53.469385+0000","last_peered":"2024-09-12T01:43:53.469385+0000","last_clean":"2024-09-12T01:43:53.469385+0000","last_became_active":"2024-09-12T01:43:52.201464+0000","last_became_peered":"2024-09-12T01:43:52.201464+0000","last_unstale":"2024-09-12T01:43:53.469385+0000","last_undegraded":"2024-09-12T01:43:53.469385+0000","last_fullsized":"2024-09-12T01:43:53.469385+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:33.755285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468196+0000","last_change":"2024-09-12T01:43:52.202554+0000","last_active":"2024-09-12T01:43:53.468196+0000","last_peered":"2024-09-12T01:43:53.468196+0000","last_clean":"2024-09-12T01:43:53.468196+0000","last_became_active":"2024-09-12T01:43:52.202293+0000","last_became_peered":"2024-09-12T01:43:52.202293+0000","last_unstale":"2024-09-12T01:43:53.468196+0000","last_undegraded":"2024-09-12T01:43:53.468196+0000","last_fullsized":"2024-09-12T01:43:53.468196+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:20.285338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.172118+0000","last_change":"2024-09-12T01:43:50.172118+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.172118+0000","last_undegraded":"2024-09-12T01:43:50.172118+0000","last_fullsized":"2024-09-12T01:43:50.172118+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175305+0000","last_change":"2024-09-12T01:43:50.175305+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175305+0000","last_undegraded":"2024-09-12T01:43:50.175305+0000","last_fullsized":"2024-09-12T01:43:50.175305+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.172081+0000","last_change":"2024-09-12T01:43:50.172081+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.172081+0000","last_undegraded":"2024-09-12T01:43:50.172081+0000","last_fullsized":"2024-09-12T01:43:50.172081+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170806+0000","last_change":"2024-09-12T01:43:50.170806+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170806+0000","last_undegraded":"2024-09-12T01:43:50.170806+0000","last_fullsized":"2024-09-12T01:43:50.170806+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468306+0000","last_change":"2024-09-12T01:43:51.190466+0000","last_active":"2024-09-12T01:43:53.468306+0000","last_peered":"2024-09-12T01:43:53.468306+0000","last_clean":"2024-09-12T01:43:53.468306+0000","last_became_active":"2024-09-12T01:43:51.190282+0000","last_became_peered":"2024-09-12T01:43:51.190282+0000","last_unstale":"2024-09-12T01:43:53.468306+0000","last_undegraded":"2024-09-12T01:43:53.468306+0000","last_fullsized":"2024-09-12T01:43:53.468306+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:14.257545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168501+0000","last_change":"2024-09-12T01:43:50.168501+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168501+0000","last_undegraded":"2024-09-12T01:43:50.168501+0000","last_fullsized":"2024-09-12T01:43:50.168501+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175243+0000","last_change":"2024-09-12T01:43:50.175243+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175243+0000","last_undegraded":"2024-09-12T01:43:50.175243+0000","last_fullsized":"2024-09-12T01:43:50.175243+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171688+0000","last_change":"2024-09-12T01:43:50.171688+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171688+0000","last_undegraded":"2024-09-12T01:43:50.171688+0000","last_fullsized":"2024-09-12T01:43:50.171688+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175675+0000","last_change":"2024-09-12T01:43:50.175675+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175675+0000","last_undegraded":"2024-09-12T01:43:50.175675+0000","last_fullsized":"2024-09-12T01:43:50.175675+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168497+0000","last_change":"2024-09-12T01:43:50.168497+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168497+0000","last_undegraded":"2024-09-12T01:43:50.168497+0000","last_fullsized":"2024-09-12T01:43:50.168497+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170715+0000","last_change":"2024-09-12T01:43:50.170715+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170715+0000","last_undegraded":"2024-09-12T01:43:50.170715+0000","last_fullsized":"2024-09-12T01:43:50.170715+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171273+0000","last_change":"2024-09-12T01:43:50.171273+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171273+0000","last_undegraded":"2024-09-12T01:43:50.171273+0000","last_fullsized":"2024-09-12T01:43:50.171273+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469172+0000","last_change":"2024-09-12T01:43:52.202539+0000","last_active":"2024-09-12T01:43:53.469172+0000","last_peered":"2024-09-12T01:43:53.469172+0000","last_clean":"2024-09-12T01:43:53.469172+0000","last_became_active":"2024-09-12T01:43:52.201815+0000","last_became_peered":"2024-09-12T01:43:52.201815+0000","last_unstale":"2024-09-12T01:43:53.469172+0000","last_undegraded":"2024-09-12T01:43:53.469172+0000","last_fullsized":"2024-09-12T01:43:53.469172+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.323760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168831+0000","last_change":"2024-09-12T01:43:50.168831+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168831+0000","last_undegraded":"2024-09-12T01:43:50.168831+0000","last_fullsized":"2024-09-12T01:43:50.168831+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171844+0000","last_change":"2024-09-12T01:43:50.171844+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171844+0000","last_undegraded":"2024-09-12T01:43:50.171844+0000","last_fullsized":"2024-09-12T01:43:50.171844+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"127'8","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468380+0000","last_change":"2024-09-12T01:43:51.180654+0000","last_active":"2024-09-12T01:43:53.468380+0000","last_peered":"2024-09-12T01:43:53.468380+0000","last_clean":"2024-09-12T01:43:53.468380+0000","last_became_active":"2024-09-12T01:43:51.180405+0000","last_became_peered":"2024-09-12T01:43:51.180405+0000","last_unstale":"2024-09-12T01:43:53.468380+0000","last_undegraded":"2024-09-12T01:43:53.468380+0000","last_fullsized":"2024-09-12T01:43:53.468380+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.597910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171530+0000","last_change":"2024-09-12T01:43:50.171530+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171530+0000","last_undegraded":"2024-09-12T01:43:50.171530+0000","last_fullsized":"2024-09-12T01:43:50.171530+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469411+0000","last_change":"2024-09-12T01:43:51.184567+0000","last_active":"2024-09-12T01:43:53.469411+0000","last_peered":"2024-09-12T01:43:53.469411+0000","last_clean":"2024-09-12T01:43:53.469411+0000","last_became_active":"2024-09-12T01:43:51.184313+0000","last_became_peered":"2024-09-12T01:43:51.184313+0000","last_unstale":"2024-09-12T01:43:53.469411+0000","last_undegraded":"2024-09-12T01:43:53.469411+0000","last_fullsized":"2024-09-12T01:43:53.469411+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:26.397286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170285+0000","last_change":"2024-09-12T01:43:50.170285+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170285+0000","last_undegraded":"2024-09-12T01:43:50.170285+0000","last_fullsized":"2024-09-12T01:43:50.170285+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171888+0000","last_change":"2024-09-12T01:43:50.171888+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171888+0000","last_undegraded":"2024-09-12T01:43:50.171888+0000","last_fullsized":"2024-09-12T01:43:50.171888+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175214+0000","last_change":"2024-09-12T01:43:50.175214+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175214+0000","last_undegraded":"2024-09-12T01:43:50.175214+0000","last_fullsized":"2024-09-12T01:43:50.175214+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171249+0000","last_change":"2024-09-12T01:43:50.171249+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171249+0000","last_undegraded":"2024-09-12T01:43:50.171249+0000","last_fullsized":"2024-09-12T01:43:50.171249+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171226+0000","last_change":"2024-09-12T01:43:50.171226+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171226+0000","last_undegraded":"2024-09-12T01:43:50.171226+0000","last_fullsized":"2024-09-12T01:43:50.171226+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170430+0000","last_change":"2024-09-12T01:43:50.170430+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170430+0000","last_undegraded":"2024-09-12T01:43:50.170430+0000","last_fullsized":"2024-09-12T01:43:50.170430+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170422+0000","last_change":"2024-09-12T01:43:50.170422+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170422+0000","last_undegraded":"2024-09-12T01:43:50.170422+0000","last_fullsized":"2024-09-12T01:43:50.170422+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171882+0000","last_change":"2024-09-12T01:43:50.171882+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171882+0000","last_undegraded":"2024-09-12T01:43:50.171882+0000","last_fullsized":"2024-09-12T01:43:50.171882+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469348+0000","last_change":"2024-09-12T01:43:52.198800+0000","last_active":"2024-09-12T01:43:53.469348+0000","last_peered":"2024-09-12T01:43:53.469348+0000","last_clean":"2024-09-12T01:43:53.469348+0000","last_became_active":"2024-09-12T01:43:52.198490+0000","last_became_peered":"2024-09-12T01:43:52.198490+0000","last_unstale":"2024-09-12T01:43:53.469348+0000","last_undegraded":"2024-09-12T01:43:53.469348+0000","last_fullsized":"2024-09-12T01:43:53.469348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170699+0000","last_change":"2024-09-12T01:43:50.170699+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170699+0000","last_undegraded":"2024-09-12T01:43:50.170699+0000","last_fullsized":"2024-09-12T01:43:50.170699+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469170+0000","last_change":"2024-09-12T01:43:52.205916+0000","last_active":"2024-09-12T01:43:53.469170+0000","last_peered":"2024-09-12T01:43:53.469170+0000","last_clean":"2024-09-12T01:43:53.469170+0000","last_became_active":"2024-09-12T01:43:52.205619+0000","last_became_peered":"2024-09-12T01:43:52.205619+0000","last_unstale":"2024-09-12T01:43:53.469170+0000","last_undegraded":"2024-09-12T01:43:53.469170+0000","last_fullsized":"2024-09-12T01:43:53.469170+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.063068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.170250+0000","last_change":"2024-09-12T01:43:50.170250+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.170250+0000","last_undegraded":"2024-09-12T01:43:50.170250+0000","last_fullsized":"2024-09-12T01:43:50.170250+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171857+0000","last_change":"2024-09-12T01:43:50.171857+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171857+0000","last_undegraded":"2024-09-12T01:43:50.171857+0000","last_fullsized":"2024-09-12T01:43:50.171857+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.171197+0000","last_change":"2024-09-12T01:43:50.171197+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.171197+0000","last_undegraded":"2024-09-12T01:43:50.171197+0000","last_fullsized":"2024-09-12T01:43:50.171197+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168700+0000","last_change":"2024-09-12T01:43:50.168700+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168700+0000","last_undegraded":"2024-09-12T01:43:50.168700+0000","last_fullsized":"2024-09-12T01:43:50.168700+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.175128+0000","last_change":"2024-09-12T01:43:50.175128+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.175128+0000","last_undegraded":"2024-09-12T01:43:50.175128+0000","last_fullsized":"2024-09-12T01:43:50.175128+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-12T01:43:51.166510+0000","last_change":"2024-09-12T01:43:51.166510+0000","last_active":"2024-09-12T01:43:51.166510+0000","last_peered":"2024-09-12T01:43:51.166510+0000","last_clean":"2024-09-12T01:43:51.166510+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:51.166510+0000","last_undegraded":"2024-09-12T01:43:51.166510+0000","last_fullsized":"2024-09-12T01:43:51.166510+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":125,"state":"creating+peering","last_fresh":"2024-09-12T01:43:50.168750+0000","last_change":"2024-09-12T01:43:50.168750+0000","last_active":"2024-09-12T01:43:50.161299+0000","last_peered":"2024-09-12T01:43:50.161299+0000","last_clean":"2024-09-12T01:43:50.161299+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:43:50.168750+0000","last_undegraded":"2024-09-12T01:43:50.168750+0000","last_fullsized":"2024-09-12T01:43:50.168750+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":362,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-09-12T01:43:50.168285+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:43:50.168285+0000","last_peered":"2024-09-12T01:43:50.168285+0000","last_clean":"2024-09-12T01:43:50.168285+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:43:50.168285+0000","last_undegraded":"2024-09-12T01:43:50.168285+0000","last_fullsized":"2024-09-12T01:43:50.168285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":1},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509542,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1560576,"data_stored":664314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36880,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334960,"statfs":{"total":96636764160,"available":96598999040,"internally_reserved":0,"allocated":1560576,"data_stored":664314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33288,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338552,"statfs":{"total":96636764160,"available":96602677248,"internally_reserved":0,"allocated":2142208,"data_stored":1248865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36864,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334976,"statfs":{"total":96636764160,"available":96599015424,"internally_reserved":0,"allocated":1548288,"data_stored":658497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1548288,"data_stored":658497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37452,"kb_used_data":2104,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334388,"statfs":{"total":96636764160,"available":96598413312,"internally_reserved":0,"allocated":2154496,"data_stored":1254682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36876,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334964,"statfs":{"total":96636764160,"available":96599003136,"internally_reserved":0,"allocated":1560576,"data_stored":664314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1605632,"data_stored":679580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:43:55.866 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3e is not active+clean 2024-09-12T01:43:55.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.867 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3d is not active+clean 2024-09-12T01:43:55.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.867 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3c is not active+clean 2024-09-12T01:43:55.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.867 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3b is not active+clean 2024-09-12T01:43:55.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.867 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3a is not active+clean 2024-09-12T01:43:55.867 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.867 INFO:tasks.ceph.ceph_manager.ceph:PG 21.39 is not active+clean 2024-09-12T01:43:55.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.868 INFO:tasks.ceph.ceph_manager.ceph:PG 21.37 is not active+clean 2024-09-12T01:43:55.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.868 INFO:tasks.ceph.ceph_manager.ceph:PG 21.36 is not active+clean 2024-09-12T01:43:55.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.868 INFO:tasks.ceph.ceph_manager.ceph:PG 21.35 is not active+clean 2024-09-12T01:43:55.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.868 INFO:tasks.ceph.ceph_manager.ceph:PG 21.34 is not active+clean 2024-09-12T01:43:55.868 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.868 INFO:tasks.ceph.ceph_manager.ceph:PG 21.33 is not active+clean 2024-09-12T01:43:55.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.869 INFO:tasks.ceph.ceph_manager.ceph:PG 21.32 is not active+clean 2024-09-12T01:43:55.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.869 INFO:tasks.ceph.ceph_manager.ceph:PG 21.31 is not active+clean 2024-09-12T01:43:55.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.869 INFO:tasks.ceph.ceph_manager.ceph:PG 21.30 is not active+clean 2024-09-12T01:43:55.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.869 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2f is not active+clean 2024-09-12T01:43:55.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.869 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2e is not active+clean 2024-09-12T01:43:55.869 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.870 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2b is not active+clean 2024-09-12T01:43:55.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.870 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2a is not active+clean 2024-09-12T01:43:55.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.870 INFO:tasks.ceph.ceph_manager.ceph:PG 21.29 is not active+clean 2024-09-12T01:43:55.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.870 INFO:tasks.ceph.ceph_manager.ceph:PG 21.28 is not active+clean 2024-09-12T01:43:55.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.870 INFO:tasks.ceph.ceph_manager.ceph:PG 21.27 is not active+clean 2024-09-12T01:43:55.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.870 INFO:tasks.ceph.ceph_manager.ceph:PG 21.25 is not active+clean 2024-09-12T01:43:55.870 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.871 INFO:tasks.ceph.ceph_manager.ceph:PG 21.24 is not active+clean 2024-09-12T01:43:55.871 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.871 INFO:tasks.ceph.ceph_manager.ceph:PG 21.22 is not active+clean 2024-09-12T01:43:55.871 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.871 INFO:tasks.ceph.ceph_manager.ceph:PG 21.21 is not active+clean 2024-09-12T01:43:55.871 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.871 INFO:tasks.ceph.ceph_manager.ceph:PG 21.20 is not active+clean 2024-09-12T01:43:55.871 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.871 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1e is not active+clean 2024-09-12T01:43:55.871 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.871 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1f is not active+clean 2024-09-12T01:43:55.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.172118+0000', 'last_change': '2024-09-12T01:43:50.172118+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.172118+0000', 'last_undegraded': '2024-09-12T01:43:50.172118+0000', 'last_fullsized': '2024-09-12T01:43:50.172118+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:43:55.872 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1f is not active+clean 2024-09-12T01:43:55.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.872 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1e is not active+clean 2024-09-12T01:43:55.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.175305+0000', 'last_change': '2024-09-12T01:43:50.175305+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.175305+0000', 'last_undegraded': '2024-09-12T01:43:50.175305+0000', 'last_fullsized': '2024-09-12T01:43:50.175305+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:43:55.872 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1c is not active+clean 2024-09-12T01:43:55.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.872 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1d is not active+clean 2024-09-12T01:43:55.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.172081+0000', 'last_change': '2024-09-12T01:43:50.172081+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.172081+0000', 'last_undegraded': '2024-09-12T01:43:50.172081+0000', 'last_fullsized': '2024-09-12T01:43:50.172081+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:43:55.872 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1d is not active+clean 2024-09-12T01:43:55.872 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.873 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1c is not active+clean 2024-09-12T01:43:55.873 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.170806+0000', 'last_change': '2024-09-12T01:43:50.170806+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.170806+0000', 'last_undegraded': '2024-09-12T01:43:50.170806+0000', 'last_fullsized': '2024-09-12T01:43:50.170806+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:43:55.873 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1a is not active+clean 2024-09-12T01:43:55.873 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.873 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1b is not active+clean 2024-09-12T01:43:55.873 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.873 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1a is not active+clean 2024-09-12T01:43:55.873 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.168501+0000', 'last_change': '2024-09-12T01:43:50.168501+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.168501+0000', 'last_undegraded': '2024-09-12T01:43:50.168501+0000', 'last_fullsized': '2024-09-12T01:43:50.168501+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:43:55.873 INFO:tasks.ceph.ceph_manager.ceph:PG 21.18 is not active+clean 2024-09-12T01:43:55.873 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.873 INFO:tasks.ceph.ceph_manager.ceph:PG 20.19 is not active+clean 2024-09-12T01:43:55.874 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.175243+0000', 'last_change': '2024-09-12T01:43:50.175243+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.175243+0000', 'last_undegraded': '2024-09-12T01:43:50.175243+0000', 'last_fullsized': '2024-09-12T01:43:50.175243+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:43:55.874 INFO:tasks.ceph.ceph_manager.ceph:PG 21.19 is not active+clean 2024-09-12T01:43:55.874 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.874 INFO:tasks.ceph.ceph_manager.ceph:PG 20.18 is not active+clean 2024-09-12T01:43:55.874 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.171688+0000', 'last_change': '2024-09-12T01:43:50.171688+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.171688+0000', 'last_undegraded': '2024-09-12T01:43:50.171688+0000', 'last_fullsized': '2024-09-12T01:43:50.171688+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:43:55.874 INFO:tasks.ceph.ceph_manager.ceph:PG 21.16 is not active+clean 2024-09-12T01:43:55.874 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.874 INFO:tasks.ceph.ceph_manager.ceph:PG 20.17 is not active+clean 2024-09-12T01:43:55.874 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.175675+0000', 'last_change': '2024-09-12T01:43:50.175675+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.175675+0000', 'last_undegraded': '2024-09-12T01:43:50.175675+0000', 'last_fullsized': '2024-09-12T01:43:50.175675+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:43:55.874 INFO:tasks.ceph.ceph_manager.ceph:PG 21.17 is not active+clean 2024-09-12T01:43:55.874 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.875 INFO:tasks.ceph.ceph_manager.ceph:PG 20.16 is not active+clean 2024-09-12T01:43:55.875 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.168497+0000', 'last_change': '2024-09-12T01:43:50.168497+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.168497+0000', 'last_undegraded': '2024-09-12T01:43:50.168497+0000', 'last_fullsized': '2024-09-12T01:43:50.168497+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-12T01:43:55.875 INFO:tasks.ceph.ceph_manager.ceph:PG 21.15 is not active+clean 2024-09-12T01:43:55.875 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.875 INFO:tasks.ceph.ceph_manager.ceph:PG 20.14 is not active+clean 2024-09-12T01:43:55.875 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.170715+0000', 'last_change': '2024-09-12T01:43:50.170715+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.170715+0000', 'last_undegraded': '2024-09-12T01:43:50.170715+0000', 'last_fullsized': '2024-09-12T01:43:50.170715+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:43:55.875 INFO:tasks.ceph.ceph_manager.ceph:PG 21.12 is not active+clean 2024-09-12T01:43:55.875 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.875 INFO:tasks.ceph.ceph_manager.ceph:PG 20.13 is not active+clean 2024-09-12T01:43:55.876 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.171273+0000', 'last_change': '2024-09-12T01:43:50.171273+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.171273+0000', 'last_undegraded': '2024-09-12T01:43:50.171273+0000', 'last_fullsized': '2024-09-12T01:43:50.171273+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:43:55.876 INFO:tasks.ceph.ceph_manager.ceph:PG 20.12 is not active+clean 2024-09-12T01:43:55.876 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.168831+0000', 'last_change': '2024-09-12T01:43:50.168831+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.168831+0000', 'last_undegraded': '2024-09-12T01:43:50.168831+0000', 'last_fullsized': '2024-09-12T01:43:50.168831+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:43:55.876 INFO:tasks.ceph.ceph_manager.ceph:PG 21.10 is not active+clean 2024-09-12T01:43:55.876 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.876 INFO:tasks.ceph.ceph_manager.ceph:PG 20.11 is not active+clean 2024-09-12T01:43:55.876 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.171844+0000', 'last_change': '2024-09-12T01:43:50.171844+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.171844+0000', 'last_undegraded': '2024-09-12T01:43:50.171844+0000', 'last_fullsized': '2024-09-12T01:43:50.171844+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:43:55.876 INFO:tasks.ceph.ceph_manager.ceph:PG 21.11 is not active+clean 2024-09-12T01:43:55.876 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.876 INFO:tasks.ceph.ceph_manager.ceph:PG 21.e is not active+clean 2024-09-12T01:43:55.877 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.877 INFO:tasks.ceph.ceph_manager.ceph:PG 20.f is not active+clean 2024-09-12T01:43:55.877 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.171530+0000', 'last_change': '2024-09-12T01:43:50.171530+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.171530+0000', 'last_undegraded': '2024-09-12T01:43:50.171530+0000', 'last_fullsized': '2024-09-12T01:43:50.171530+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:43:55.877 INFO:tasks.ceph.ceph_manager.ceph:PG 21.f is not active+clean 2024-09-12T01:43:55.877 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.877 INFO:tasks.ceph.ceph_manager.ceph:PG 21.c is not active+clean 2024-09-12T01:43:55.877 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.877 INFO:tasks.ceph.ceph_manager.ceph:PG 20.d is not active+clean 2024-09-12T01:43:55.877 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.170285+0000', 'last_change': '2024-09-12T01:43:50.170285+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.170285+0000', 'last_undegraded': '2024-09-12T01:43:50.170285+0000', 'last_fullsized': '2024-09-12T01:43:50.170285+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:43:55.877 INFO:tasks.ceph.ceph_manager.ceph:PG 21.d is not active+clean 2024-09-12T01:43:55.878 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.878 INFO:tasks.ceph.ceph_manager.ceph:PG 20.c is not active+clean 2024-09-12T01:43:55.878 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.171888+0000', 'last_change': '2024-09-12T01:43:50.171888+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.171888+0000', 'last_undegraded': '2024-09-12T01:43:50.171888+0000', 'last_fullsized': '2024-09-12T01:43:50.171888+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:43:55.878 INFO:tasks.ceph.ceph_manager.ceph:PG 21.a is not active+clean 2024-09-12T01:43:55.878 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.878 INFO:tasks.ceph.ceph_manager.ceph:PG 20.b is not active+clean 2024-09-12T01:43:55.878 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.175214+0000', 'last_change': '2024-09-12T01:43:50.175214+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.175214+0000', 'last_undegraded': '2024-09-12T01:43:50.175214+0000', 'last_fullsized': '2024-09-12T01:43:50.175214+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:43:55.878 INFO:tasks.ceph.ceph_manager.ceph:PG 21.b is not active+clean 2024-09-12T01:43:55.878 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.878 INFO:tasks.ceph.ceph_manager.ceph:PG 20.a is not active+clean 2024-09-12T01:43:55.878 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.171249+0000', 'last_change': '2024-09-12T01:43:50.171249+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.171249+0000', 'last_undegraded': '2024-09-12T01:43:50.171249+0000', 'last_fullsized': '2024-09-12T01:43:50.171249+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:43:55.879 INFO:tasks.ceph.ceph_manager.ceph:PG 21.8 is not active+clean 2024-09-12T01:43:55.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.879 INFO:tasks.ceph.ceph_manager.ceph:PG 20.9 is not active+clean 2024-09-12T01:43:55.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.171226+0000', 'last_change': '2024-09-12T01:43:50.171226+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.171226+0000', 'last_undegraded': '2024-09-12T01:43:50.171226+0000', 'last_fullsized': '2024-09-12T01:43:50.171226+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:43:55.879 INFO:tasks.ceph.ceph_manager.ceph:PG 21.9 is not active+clean 2024-09-12T01:43:55.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.879 INFO:tasks.ceph.ceph_manager.ceph:PG 20.8 is not active+clean 2024-09-12T01:43:55.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.170430+0000', 'last_change': '2024-09-12T01:43:50.170430+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.170430+0000', 'last_undegraded': '2024-09-12T01:43:50.170430+0000', 'last_fullsized': '2024-09-12T01:43:50.170430+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:43:55.879 INFO:tasks.ceph.ceph_manager.ceph:PG 21.6 is not active+clean 2024-09-12T01:43:55.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.880 INFO:tasks.ceph.ceph_manager.ceph:PG 20.7 is not active+clean 2024-09-12T01:43:55.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.170422+0000', 'last_change': '2024-09-12T01:43:50.170422+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.170422+0000', 'last_undegraded': '2024-09-12T01:43:50.170422+0000', 'last_fullsized': '2024-09-12T01:43:50.170422+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-12T01:43:55.880 INFO:tasks.ceph.ceph_manager.ceph:PG 21.7 is not active+clean 2024-09-12T01:43:55.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.880 INFO:tasks.ceph.ceph_manager.ceph:PG 20.6 is not active+clean 2024-09-12T01:43:55.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.171882+0000', 'last_change': '2024-09-12T01:43:50.171882+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.171882+0000', 'last_undegraded': '2024-09-12T01:43:50.171882+0000', 'last_fullsized': '2024-09-12T01:43:50.171882+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:43:55.880 INFO:tasks.ceph.ceph_manager.ceph:PG 20.5 is not active+clean 2024-09-12T01:43:55.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.170699+0000', 'last_change': '2024-09-12T01:43:50.170699+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.170699+0000', 'last_undegraded': '2024-09-12T01:43:50.170699+0000', 'last_fullsized': '2024-09-12T01:43:50.170699+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:43:55.880 INFO:tasks.ceph.ceph_manager.ceph:PG 20.4 is not active+clean 2024-09-12T01:43:55.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.170250+0000', 'last_change': '2024-09-12T01:43:50.170250+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.170250+0000', 'last_undegraded': '2024-09-12T01:43:50.170250+0000', 'last_fullsized': '2024-09-12T01:43:50.170250+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-12T01:43:55.881 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2 is not active+clean 2024-09-12T01:43:55.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.881 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3 is not active+clean 2024-09-12T01:43:55.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.171857+0000', 'last_change': '2024-09-12T01:43:50.171857+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.171857+0000', 'last_undegraded': '2024-09-12T01:43:50.171857+0000', 'last_fullsized': '2024-09-12T01:43:50.171857+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-12T01:43:55.881 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3 is not active+clean 2024-09-12T01:43:55.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.881 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2 is not active+clean 2024-09-12T01:43:55.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.171197+0000', 'last_change': '2024-09-12T01:43:50.171197+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.171197+0000', 'last_undegraded': '2024-09-12T01:43:50.171197+0000', 'last_fullsized': '2024-09-12T01:43:50.171197+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-12T01:43:55.881 INFO:tasks.ceph.ceph_manager.ceph:PG 21.0 is not active+clean 2024-09-12T01:43:55.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.881 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1 is not active+clean 2024-09-12T01:43:55.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.168700+0000', 'last_change': '2024-09-12T01:43:50.168700+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.168700+0000', 'last_undegraded': '2024-09-12T01:43:50.168700+0000', 'last_fullsized': '2024-09-12T01:43:50.168700+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:43:55.882 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1 is not active+clean 2024-09-12T01:43:55.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.882 INFO:tasks.ceph.ceph_manager.ceph:PG 20.0 is not active+clean 2024-09-12T01:43:55.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.175128+0000', 'last_change': '2024-09-12T01:43:50.175128+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.175128+0000', 'last_undegraded': '2024-09-12T01:43:50.175128+0000', 'last_fullsized': '2024-09-12T01:43:50.175128+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-12T01:43:55.882 INFO:tasks.ceph.ceph_manager.ceph:PG 21.14 is not active+clean 2024-09-12T01:43:55.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-12T01:43:51.166510+0000', 'last_change': '2024-09-12T01:43:51.166510+0000', 'last_active': '2024-09-12T01:43:51.166510+0000', 'last_peered': '2024-09-12T01:43:51.166510+0000', 'last_clean': '2024-09-12T01:43:51.166510+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:51.166510+0000', 'last_undegraded': '2024-09-12T01:43:51.166510+0000', 'last_fullsized': '2024-09-12T01:43:51.166510+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:51.166510+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-12T01:43:55.882 INFO:tasks.ceph.ceph_manager.ceph:PG 20.15 is not active+clean 2024-09-12T01:43:55.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 125, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:43:50.168750+0000', 'last_change': '2024-09-12T01:43:50.168750+0000', 'last_active': '2024-09-12T01:43:50.161299+0000', 'last_peered': '2024-09-12T01:43:50.161299+0000', 'last_clean': '2024-09-12T01:43:50.161299+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:43:50.168750+0000', 'last_undegraded': '2024-09-12T01:43:50.168750+0000', 'last_fullsized': '2024-09-12T01:43:50.168750+0000', 'mapping_epoch': 125, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 125, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'last_clean_scrub_stamp': '2024-09-12T01:43:50.161299+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-12T01:43:55.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:43:56.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.005+0000 7f8667877640 1 Processor -- start 2024-09-12T01:43:56.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.006+0000 7f8667877640 1 -- start start 2024-09-12T01:43:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.006+0000 7f8667877640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f866015e660 0x7f86600cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.006+0000 7f8667877640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f86600d1820 0x7f86600b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.006+0000 7f8667877640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f866015ea40 con 0x7f86600d3310 2024-09-12T01:43:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.006+0000 7f8667877640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f86600d3870 con 0x7f86600d1820 2024-09-12T01:43:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.006+0000 7f8667877640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86600d3b50 con 0x7f866015e660 2024-09-12T01:43:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8664e12640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f86600d3310 0x7f86600d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36322/0 (socket says 172.21.15.60:36322) 2024-09-12T01:43:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8664e12640 1 -- 172.21.15.60:0/3783103400 learned_addr learned my addr 172.21.15.60:0/3783103400 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:56.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8665e14640 1 --2- 172.21.15.60:0/3783103400 >> v2:172.21.15.105:3300/0 conn(0x7f86600d1820 0x7f86600b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8665613640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f866015e660 0x7f86600cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 310897928 0 0) 0x7f866015ea40 con 0x7f86600d3310 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f864c003520 con 0x7f86600d3310 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2684081709 0 0) 0x7f864c003520 con 0x7f86600d3310 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f866015e660 msgr2=0x7f86600cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f866015e660 0x7f86600cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 >> v2:172.21.15.105:3300/0 conn(0x7f86600d1820 msgr2=0x7f86600b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 --2- 172.21.15.60:0/3783103400 >> v2:172.21.15.105:3300/0 conn(0x7f86600d1820 0x7f86600b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86600d3e30 con 0x7f86600d3310 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f8650001670 con 0x7f86600d3310 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 >> v1:172.21.15.60:6789/0 conn(0x7f86600d3310 legacy=0x7f86600d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f866015e660 0x7f864c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f864c003f30 0x7f864c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f864c004d40 0x7f864c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f86600d3870 con 0x7f864c003f30 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86600d3b50 con 0x7f864c004d40 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f864c00b9c0 con 0x7f866015e660 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8664e12640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f864c003f30 0x7f864c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.007+0000 7f8665613640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f866015e660 0x7f864c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.008+0000 7f8665e14640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f864c004d40 0x7f864c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.008+0000 7f8664e12640 1 -- 172.21.15.60:0/3783103400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f866015e660 msgr2=0x7f864c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.008+0000 7f8664e12640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f866015e660 0x7f864c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.008+0000 7f8664e12640 1 -- 172.21.15.60:0/3783103400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f864c004d40 msgr2=0x7f864c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.008+0000 7f8664e12640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f864c004d40 0x7f864c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.008+0000 7f8664e12640 1 -- 172.21.15.60:0/3783103400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c003520 con 0x7f864c003f30 2024-09-12T01:43:56.011 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.008+0000 7f8665613640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f866015e660 0x7f864c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:56.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.008+0000 7f8664e12640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f864c003f30 0x7f864c004800 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f8650007fd0 tx=0x7f864c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67591178f3b1aa3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:56.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.008+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650007d50 con 0x7f864c003f30 2024-09-12T01:43:56.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.008+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8650005ad0 con 0x7f864c003f30 2024-09-12T01:43:56.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.008+0000 7f8657fff640 1 -- 172.21.15.60:0/3783103400 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650007070 con 0x7f864c003f30 2024-09-12T01:43:56.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.009+0000 7f8667877640 1 -- 172.21.15.60:0/3783103400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f864c003f30 msgr2=0x7f864c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:56.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.009+0000 7f8667877640 1 --2- 172.21.15.60:0/3783103400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f864c003f30 0x7f864c004800 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f8650007fd0 tx=0x7f864c005830 comp rx=0 tx=0).stop 2024-09-12T01:43:56.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.009+0000 7f8665e14640 1 -- 172.21.15.60:0/3783103400 reap_dead start 2024-09-12T01:43:56.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.009+0000 7f8667877640 1 -- 172.21.15.60:0/3783103400 shutdown_connections 2024-09-12T01:43:56.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.009+0000 7f8667877640 1 -- 172.21.15.60:0/3783103400 >> 172.21.15.60:0/3783103400 conn(0x7f86600b6410 msgr2=0x7f86600b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:56.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.009+0000 7f8667877640 1 -- 172.21.15.60:0/3783103400 shutdown_connections 2024-09-12T01:43:56.012 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.009+0000 7f8667877640 1 -- 172.21.15.60:0/3783103400 wait complete. 2024-09-12T01:43:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.010+0000 7f8667877640 1 Processor -- start 2024-09-12T01:43:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.010+0000 7f8667877640 1 -- start start 2024-09-12T01:43:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.011+0000 7f8667877640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f864c003f30 0x7f8660151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.011+0000 7f8667877640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8660152870 0x7f8660152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.011+0000 7f8667877640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86601606e0 0x7f8660160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.011+0000 7f8667877640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f86600cf730 con 0x7f86601606e0 2024-09-12T01:43:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.011+0000 7f8667877640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f86600d43f0 con 0x7f8660152870 2024-09-12T01:43:56.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.011+0000 7f8667877640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f86600cf8b0 con 0x7f864c003f30 2024-09-12T01:43:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.011+0000 7f8665e14640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86601606e0 0x7f8660160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.011+0000 7f8665e14640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86601606e0 0x7f8660160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40872/0 (socket says 172.21.15.60:40872) 2024-09-12T01:43:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.011+0000 7f8665e14640 1 -- 172.21.15.60:0/354095173 learned_addr learned my addr 172.21.15.60:0/354095173 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.011+0000 7f8665613640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f864c003f30 0x7f8660151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.011+0000 7f8664e12640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8660152870 0x7f8660152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.011+0000 7f8665e14640 1 -- 172.21.15.60:0/354095173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f864c003f30 msgr2=0x7f8660151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.012+0000 7f8665e14640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f864c003f30 0x7f8660151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.012+0000 7f8665e14640 1 -- 172.21.15.60:0/354095173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8660152870 msgr2=0x7f8660152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.012+0000 7f8665e14640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8660152870 0x7f8660152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.012+0000 7f8665e14640 1 -- 172.21.15.60:0/354095173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86601613f0 con 0x7f86601606e0 2024-09-12T01:43:56.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.012+0000 7f8665e14640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86601606e0 0x7f8660160b90 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f86600cffd0 tx=0x7f86580115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.012+0000 7f8655ffb640 1 -- 172.21.15.60:0/354095173 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658011de0 con 0x7f86601606e0 2024-09-12T01:43:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.012+0000 7f8655ffb640 1 -- 172.21.15.60:0/354095173 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f865801b070 con 0x7f86601606e0 2024-09-12T01:43:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.012+0000 7f8655ffb640 1 -- 172.21.15.60:0/354095173 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8658003990 con 0x7f86601606e0 2024-09-12T01:43:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.012+0000 7f8667877640 1 -- 172.21.15.60:0/354095173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86601e7670 con 0x7f86601606e0 2024-09-12T01:43:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.012+0000 7f8667877640 1 -- 172.21.15.60:0/354095173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86601e7c30 con 0x7f86601606e0 2024-09-12T01:43:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.013+0000 7f8667877640 1 -- 172.21.15.60:0/354095173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86600cfc90 con 0x7f86601606e0 2024-09-12T01:43:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.014+0000 7f8655ffb640 1 -- 172.21.15.60:0/354095173 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8658005d10 con 0x7f86601606e0 2024-09-12T01:43:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.014+0000 7f8655ffb640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f864406be60 0x7f864406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.014+0000 7f8655ffb640 1 -- 172.21.15.60:0/354095173 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f865808b270 con 0x7f86601606e0 2024-09-12T01:43:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.014+0000 7f8665613640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f864406be60 0x7f864406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.015+0000 7f8665613640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f864406be60 0x7f864406e320 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f866015a060 tx=0x7f865c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:56.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.018+0000 7f8655ffb640 1 -- 172.21.15.60:0/354095173 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f8658025020 con 0x7f86601606e0 2024-09-12T01:43:56.263 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.264+0000 7f8667877640 1 -- 172.21.15.60:0/354095173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8660159db0 con 0x7f86601606e0 2024-09-12T01:43:56.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.264+0000 7f8655ffb640 1 -- 172.21.15.60:0/354095173 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1636 (secure 0 0 0) 0x7f86580595d0 con 0x7f86601606e0 2024-09-12T01:43:56.264 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:56.264 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":503,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":128,"num_osds":8,"num_up_osds":8,"osd_up_since":1726104944,"num_in_osds":8,"osd_in_since":1726104934,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":55},{"state_name":"creating+peering","count":29},{"state_name":"active+clean","count":13}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590368,"bytes_used":290508800,"bytes_avail":772803604480,"bytes_total":773094113280,"unknown_pgs_ratio":0.56701028347015381,"inactive_pgs_ratio":0.29896906018257141,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":79,"btime":"2024-09-12T01:43:54:188220+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"b","status":"up:active","gid":7989}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-12T01:43:40.365328+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T01:43:56.266 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.267+0000 7f8667877640 1 -- 172.21.15.60:0/354095173 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f864406be60 msgr2=0x7f864406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:56.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.267+0000 7f8667877640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f864406be60 0x7f864406e320 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f866015a060 tx=0x7f865c008040 comp rx=0 tx=0).stop 2024-09-12T01:43:56.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.267+0000 7f8667877640 1 -- 172.21.15.60:0/354095173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86601606e0 msgr2=0x7f8660160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:56.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.267+0000 7f8667877640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86601606e0 0x7f8660160b90 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f86600cffd0 tx=0x7f86580115a0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.267+0000 7f8667877640 1 -- 172.21.15.60:0/354095173 shutdown_connections 2024-09-12T01:43:56.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.267+0000 7f8667877640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86601606e0 0x7f8660160b90 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.267+0000 7f8667877640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8660152870 0x7f8660152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.267+0000 7f8667877640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f864406be60 0x7f864406e320 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.267+0000 7f8667877640 1 --2- 172.21.15.60:0/354095173 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f864c003f30 0x7f8660151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.267+0000 7f8667877640 1 -- 172.21.15.60:0/354095173 >> 172.21.15.60:0/354095173 conn(0x7f86600b6410 msgr2=0x7f86600ba140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:56.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.267+0000 7f8667877640 1 -- 172.21.15.60:0/354095173 shutdown_connections 2024-09-12T01:43:56.267 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.267+0000 7f8667877640 1 -- 172.21.15.60:0/354095173 wait complete. 2024-09-12T01:43:56.277 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:43:56.278 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:43:56.379 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.380+0000 7fed3b533640 1 Processor -- start 2024-09-12T01:43:56.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.380+0000 7fed3b533640 1 -- start start 2024-09-12T01:43:56.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed3b533640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fed3415e660 0x7fed340cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed3b533640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340d1820 0x7fed340b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed3b533640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed3415ea40 con 0x7fed340d3310 2024-09-12T01:43:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed3b533640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fed340d3870 con 0x7fed3415e660 2024-09-12T01:43:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed3b533640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fed340d3b50 con 0x7fed340d1820 2024-09-12T01:43:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed38ace640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fed340d3310 0x7fed340d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36332/0 (socket says 172.21.15.60:36332) 2024-09-12T01:43:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed38ace640 1 -- 172.21.15.60:0/2720133068 learned_addr learned my addr 172.21.15.60:0/2720133068 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3112892286 0 0) 0x7fed3415ea40 con 0x7fed340d3310 2024-09-12T01:43:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed39ad0640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340d1820 0x7fed340b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed20003520 con 0x7fed340d3310 2024-09-12T01:43:56.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed392cf640 1 --2- 172.21.15.60:0/2720133068 >> v2:172.21.15.105:3300/0 conn(0x7fed3415e660 0x7fed340cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2498184197 0 0) 0x7fed20003520 con 0x7fed340d3310 2024-09-12T01:43:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340d1820 msgr2=0x7fed340b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed2bfff640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340d1820 0x7fed340b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 >> v2:172.21.15.105:3300/0 conn(0x7fed3415e660 msgr2=0x7fed340cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.381+0000 7fed2bfff640 1 --2- 172.21.15.60:0/2720133068 >> v2:172.21.15.105:3300/0 conn(0x7fed3415e660 0x7fed340cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed340d3e30 con 0x7fed340d3310 2024-09-12T01:43:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fed24001670 con 0x7fed340d3310 2024-09-12T01:43:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 >> v1:172.21.15.60:6789/0 conn(0x7fed340d3310 legacy=0x7fed340d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:56.388 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed2bfff640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340d1820 0x7fed200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed2bfff640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed20003f30 0x7fed20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed2bfff640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed20004d40 0x7fed200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fed340d3870 con 0x7fed20003f30 2024-09-12T01:43:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed340d3b50 con 0x7fed20004d40 2024-09-12T01:43:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fed2000b9c0 con 0x7fed340d1820 2024-09-12T01:43:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed38ace640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed20003f30 0x7fed20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed392cf640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340d1820 0x7fed200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.389 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed39ad0640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed20004d40 0x7fed200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed38ace640 1 -- 172.21.15.60:0/2720133068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340d1820 msgr2=0x7fed200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed38ace640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340d1820 0x7fed200039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed38ace640 1 -- 172.21.15.60:0/2720133068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed20004d40 msgr2=0x7fed200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed38ace640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed20004d40 0x7fed200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed38ace640 1 -- 172.21.15.60:0/2720133068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed20003520 con 0x7fed20003f30 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.382+0000 7fed39ad0640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed20004d40 0x7fed200051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.383+0000 7fed38ace640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed20003f30 0x7fed20004800 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fed2400c240 tx=0x7fed20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bce8cc5bbdf77 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.383+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed24007d30 con 0x7fed20003f30 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.383+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed24005ad0 con 0x7fed20003f30 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.383+0000 7fed2bfff640 1 -- 172.21.15.60:0/2720133068 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed24007070 con 0x7fed20003f30 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.383+0000 7fed3b533640 1 -- 172.21.15.60:0/2720133068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed20003f30 msgr2=0x7fed20004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.383+0000 7fed3b533640 1 --2- 172.21.15.60:0/2720133068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed20003f30 0x7fed20004800 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fed2400c240 tx=0x7fed20005830 comp rx=0 tx=0).stop 2024-09-12T01:43:56.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.383+0000 7fed39ad0640 1 -- 172.21.15.60:0/2720133068 reap_dead start 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.383+0000 7fed3b533640 1 -- 172.21.15.60:0/2720133068 shutdown_connections 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.383+0000 7fed3b533640 1 -- 172.21.15.60:0/2720133068 >> 172.21.15.60:0/2720133068 conn(0x7fed340b6410 msgr2=0x7fed340b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.384+0000 7fed3b533640 1 -- 172.21.15.60:0/2720133068 shutdown_connections 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.384+0000 7fed3b533640 1 -- 172.21.15.60:0/2720133068 wait complete. 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.385+0000 7fed3b533640 1 Processor -- start 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.385+0000 7fed3b533640 1 -- start start 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.385+0000 7fed3b533640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed20003f30 0x7fed34151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.385+0000 7fed3b533640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340b9970 0x7fed340b9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.385+0000 7fed3b533640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed340cd010 0x7fed340cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed3b533640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fed340cfc70 con 0x7fed20003f30 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed3b533640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fed340d43f0 con 0x7fed340cd010 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed3b533640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fed340b7b70 con 0x7fed340b9970 2024-09-12T01:43:56.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed392cf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed20003f30 0x7fed34151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed392cf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed20003f30 0x7fed34151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40900/0 (socket says 172.21.15.60:40900) 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed392cf640 1 -- 172.21.15.60:0/2251022922 learned_addr learned my addr 172.21.15.60:0/2251022922 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed39ad0640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed340cd010 0x7fed340cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed38ace640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340b9970 0x7fed340b9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed392cf640 1 -- 172.21.15.60:0/2251022922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340b9970 msgr2=0x7fed340b9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed392cf640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340b9970 0x7fed340b9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed392cf640 1 -- 172.21.15.60:0/2251022922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed340cd010 msgr2=0x7fed340cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed392cf640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed340cd010 0x7fed340cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed392cf640 1 -- 172.21.15.60:0/2251022922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed340cb8e0 con 0x7fed20003f30 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.386+0000 7fed392cf640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed20003f30 0x7fed34151bc0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fed30011aa0 tx=0x7fed30011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.387+0000 7fed29ffb640 1 -- 172.21.15.60:0/2251022922 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed3000fb20 con 0x7fed20003f30 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.387+0000 7fed29ffb640 1 -- 172.21.15.60:0/2251022922 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed3000fcc0 con 0x7fed20003f30 2024-09-12T01:43:56.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.387+0000 7fed29ffb640 1 -- 172.21.15.60:0/2251022922 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30014660 con 0x7fed20003f30 2024-09-12T01:43:56.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.387+0000 7fed3b533640 1 -- 172.21.15.60:0/2251022922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed340cbbc0 con 0x7fed20003f30 2024-09-12T01:43:56.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.387+0000 7fed3b533640 1 -- 172.21.15.60:0/2251022922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed340cc180 con 0x7fed20003f30 2024-09-12T01:43:56.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.388+0000 7fed3b533640 1 -- 172.21.15.60:0/2251022922 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed340cf730 con 0x7fed20003f30 2024-09-12T01:43:56.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.389+0000 7fed29ffb640 1 -- 172.21.15.60:0/2251022922 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fed30012040 con 0x7fed20003f30 2024-09-12T01:43:56.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.389+0000 7fed29ffb640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fed1806be30 0x7fed1806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:56.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.389+0000 7fed29ffb640 1 -- 172.21.15.60:0/2251022922 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fed3008b350 con 0x7fed20003f30 2024-09-12T01:43:56.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.389+0000 7fed38ace640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fed1806be30 0x7fed1806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:56.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.390+0000 7fed38ace640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fed1806be30 0x7fed1806e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fed24033000 tx=0x7fed24009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:56.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.393+0000 7fed29ffb640 1 -- 172.21.15.60:0/2251022922 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fed30019030 con 0x7fed20003f30 2024-09-12T01:43:56.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.564+0000 7fed3b533640 1 -- 172.21.15.60:0/2251022922 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed340b8140 con 0x7fed1806be30 2024-09-12T01:43:56.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.570+0000 7fed29ffb640 1 -- 172.21.15.60:0/2251022922 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7fed340b8140 con 0x7fed1806be30 2024-09-12T01:43:56.572 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:56.573 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:43:56.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.573+0000 7fed3b533640 1 -- 172.21.15.60:0/2251022922 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fed1806be30 msgr2=0x7fed1806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:56.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.573+0000 7fed3b533640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fed1806be30 0x7fed1806e2f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fed24033000 tx=0x7fed24009030 comp rx=0 tx=0).stop 2024-09-12T01:43:56.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.573+0000 7fed3b533640 1 -- 172.21.15.60:0/2251022922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed20003f30 msgr2=0x7fed34151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:56.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.573+0000 7fed3b533640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed20003f30 0x7fed34151bc0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fed30011aa0 tx=0x7fed30011f60 comp rx=0 tx=0).stop 2024-09-12T01:43:56.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.573+0000 7fed3b533640 1 -- 172.21.15.60:0/2251022922 shutdown_connections 2024-09-12T01:43:56.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.573+0000 7fed3b533640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fed340cd010 0x7fed340cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.574+0000 7fed3b533640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fed1806be30 0x7fed1806e2f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.574+0000 7fed3b533640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fed340b9970 0x7fed340b9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.574+0000 7fed3b533640 1 --2- 172.21.15.60:0/2251022922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed20003f30 0x7fed34151bc0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:56.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.574+0000 7fed3b533640 1 -- 172.21.15.60:0/2251022922 >> 172.21.15.60:0/2251022922 conn(0x7fed340b6410 msgr2=0x7fed3406bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:56.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.574+0000 7fed3b533640 1 -- 172.21.15.60:0/2251022922 shutdown_connections 2024-09-12T01:43:56.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:56.574+0000 7fed3b533640 1 -- 172.21.15.60:0/2251022922 wait complete. 2024-09-12T01:43:56.584 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-09-12T01:43:56.367777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284040,"kb_used_data":13692,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754690680,"statfs":{"total":773094113280,"available":772803256320,"internally_reserved":0,"allocated":14020608,"data_stored":6648568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000992"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469273+0000","last_change":"2024-09-12T01:43:52.205904+0000","last_active":"2024-09-12T01:43:53.469273+0000","last_peered":"2024-09-12T01:43:53.469273+0000","last_clean":"2024-09-12T01:43:53.469273+0000","last_became_active":"2024-09-12T01:43:52.205590+0000","last_became_peered":"2024-09-12T01:43:52.205590+0000","last_unstale":"2024-09-12T01:43:53.469273+0000","last_undegraded":"2024-09-12T01:43:53.469273+0000","last_fullsized":"2024-09-12T01:43:53.469273+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:36.879938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468929+0000","last_change":"2024-09-12T01:43:52.201692+0000","last_active":"2024-09-12T01:43:53.468929+0000","last_peered":"2024-09-12T01:43:53.468929+0000","last_clean":"2024-09-12T01:43:53.468929+0000","last_became_active":"2024-09-12T01:43:52.201388+0000","last_became_peered":"2024-09-12T01:43:52.201388+0000","last_unstale":"2024-09-12T01:43:53.468929+0000","last_undegraded":"2024-09-12T01:43:53.468929+0000","last_fullsized":"2024-09-12T01:43:53.468929+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468523+0000","last_change":"2024-09-12T01:43:52.193027+0000","last_active":"2024-09-12T01:43:53.468523+0000","last_peered":"2024-09-12T01:43:53.468523+0000","last_clean":"2024-09-12T01:43:53.468523+0000","last_became_active":"2024-09-12T01:43:52.192753+0000","last_became_peered":"2024-09-12T01:43:52.192753+0000","last_unstale":"2024-09-12T01:43:53.468523+0000","last_undegraded":"2024-09-12T01:43:53.468523+0000","last_fullsized":"2024-09-12T01:43:53.468523+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:49.693010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190740+0000","last_change":"2024-09-12T01:43:52.193179+0000","last_active":"2024-09-12T01:43:53.190740+0000","last_peered":"2024-09-12T01:43:53.190740+0000","last_clean":"2024-09-12T01:43:53.190740+0000","last_became_active":"2024-09-12T01:43:52.192841+0000","last_became_peered":"2024-09-12T01:43:52.192841+0000","last_unstale":"2024-09-12T01:43:53.190740+0000","last_undegraded":"2024-09-12T01:43:53.190740+0000","last_fullsized":"2024-09-12T01:43:53.190740+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:21.106681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191416+0000","last_change":"2024-09-12T01:43:52.193313+0000","last_active":"2024-09-12T01:43:53.191416+0000","last_peered":"2024-09-12T01:43:53.191416+0000","last_clean":"2024-09-12T01:43:53.191416+0000","last_became_active":"2024-09-12T01:43:52.192502+0000","last_became_peered":"2024-09-12T01:43:52.192502+0000","last_unstale":"2024-09-12T01:43:53.191416+0000","last_undegraded":"2024-09-12T01:43:53.191416+0000","last_fullsized":"2024-09-12T01:43:53.191416+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:27.278736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468274+0000","last_change":"2024-09-12T01:43:52.200446+0000","last_active":"2024-09-12T01:43:53.468274+0000","last_peered":"2024-09-12T01:43:53.468274+0000","last_clean":"2024-09-12T01:43:53.468274+0000","last_became_active":"2024-09-12T01:43:52.200161+0000","last_became_peered":"2024-09-12T01:43:52.200161+0000","last_unstale":"2024-09-12T01:43:53.468274+0000","last_undegraded":"2024-09-12T01:43:53.468274+0000","last_fullsized":"2024-09-12T01:43:53.468274+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:51.407008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190918+0000","last_change":"2024-09-12T01:43:52.188175+0000","last_active":"2024-09-12T01:43:53.190918+0000","last_peered":"2024-09-12T01:43:53.190918+0000","last_clean":"2024-09-12T01:43:53.190918+0000","last_became_active":"2024-09-12T01:43:52.187895+0000","last_became_peered":"2024-09-12T01:43:52.187895+0000","last_unstale":"2024-09-12T01:43:53.190918+0000","last_undegraded":"2024-09-12T01:43:53.190918+0000","last_fullsized":"2024-09-12T01:43:53.190918+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:16.325979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468212+0000","last_change":"2024-09-12T01:43:52.198813+0000","last_active":"2024-09-12T01:43:53.468212+0000","last_peered":"2024-09-12T01:43:53.468212+0000","last_clean":"2024-09-12T01:43:53.468212+0000","last_became_active":"2024-09-12T01:43:52.198506+0000","last_became_peered":"2024-09-12T01:43:52.198506+0000","last_unstale":"2024-09-12T01:43:53.468212+0000","last_undegraded":"2024-09-12T01:43:53.468212+0000","last_fullsized":"2024-09-12T01:43:53.468212+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:45.961688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469113+0000","last_change":"2024-09-12T01:43:52.193001+0000","last_active":"2024-09-12T01:43:53.469113+0000","last_peered":"2024-09-12T01:43:53.469113+0000","last_clean":"2024-09-12T01:43:53.469113+0000","last_became_active":"2024-09-12T01:43:52.192621+0000","last_became_peered":"2024-09-12T01:43:52.192621+0000","last_unstale":"2024-09-12T01:43:53.469113+0000","last_undegraded":"2024-09-12T01:43:53.469113+0000","last_fullsized":"2024-09-12T01:43:53.469113+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:24.880152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468637+0000","last_change":"2024-09-12T01:43:52.200452+0000","last_active":"2024-09-12T01:43:53.468637+0000","last_peered":"2024-09-12T01:43:53.468637+0000","last_clean":"2024-09-12T01:43:53.468637+0000","last_became_active":"2024-09-12T01:43:52.200112+0000","last_became_peered":"2024-09-12T01:43:52.200112+0000","last_unstale":"2024-09-12T01:43:53.468637+0000","last_undegraded":"2024-09-12T01:43:53.468637+0000","last_fullsized":"2024-09-12T01:43:53.468637+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:44.609828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468711+0000","last_change":"2024-09-12T01:43:52.200296+0000","last_active":"2024-09-12T01:43:53.468711+0000","last_peered":"2024-09-12T01:43:53.468711+0000","last_clean":"2024-09-12T01:43:53.468711+0000","last_became_active":"2024-09-12T01:43:52.199959+0000","last_became_peered":"2024-09-12T01:43:52.199959+0000","last_unstale":"2024-09-12T01:43:53.468711+0000","last_undegraded":"2024-09-12T01:43:53.468711+0000","last_fullsized":"2024-09-12T01:43:53.468711+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:50.411996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224219+0000","last_change":"2024-09-12T01:43:52.195533+0000","last_active":"2024-09-12T01:43:53.224219+0000","last_peered":"2024-09-12T01:43:53.224219+0000","last_clean":"2024-09-12T01:43:53.224219+0000","last_became_active":"2024-09-12T01:43:52.195217+0000","last_became_peered":"2024-09-12T01:43:52.195217+0000","last_unstale":"2024-09-12T01:43:53.224219+0000","last_undegraded":"2024-09-12T01:43:53.224219+0000","last_fullsized":"2024-09-12T01:43:53.224219+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:51.407008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191557+0000","last_change":"2024-09-12T01:43:52.187289+0000","last_active":"2024-09-12T01:43:53.191557+0000","last_peered":"2024-09-12T01:43:53.191557+0000","last_clean":"2024-09-12T01:43:53.191557+0000","last_became_active":"2024-09-12T01:43:52.187014+0000","last_became_peered":"2024-09-12T01:43:52.187014+0000","last_unstale":"2024-09-12T01:43:53.191557+0000","last_undegraded":"2024-09-12T01:43:53.191557+0000","last_fullsized":"2024-09-12T01:43:53.191557+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:56.757793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.223989+0000","last_change":"2024-09-12T01:43:52.202020+0000","last_active":"2024-09-12T01:43:53.223989+0000","last_peered":"2024-09-12T01:43:53.223989+0000","last_clean":"2024-09-12T01:43:53.223989+0000","last_became_active":"2024-09-12T01:43:52.201750+0000","last_became_peered":"2024-09-12T01:43:52.201750+0000","last_unstale":"2024-09-12T01:43:53.223989+0000","last_undegraded":"2024-09-12T01:43:53.223989+0000","last_fullsized":"2024-09-12T01:43:53.223989+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:21.106681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191227+0000","last_change":"2024-09-12T01:43:52.195468+0000","last_active":"2024-09-12T01:43:53.191227+0000","last_peered":"2024-09-12T01:43:53.191227+0000","last_clean":"2024-09-12T01:43:53.191227+0000","last_became_active":"2024-09-12T01:43:52.193578+0000","last_became_peered":"2024-09-12T01:43:52.193578+0000","last_unstale":"2024-09-12T01:43:53.191227+0000","last_undegraded":"2024-09-12T01:43:53.191227+0000","last_fullsized":"2024-09-12T01:43:53.191227+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:55.075294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190769+0000","last_change":"2024-09-12T01:43:52.192049+0000","last_active":"2024-09-12T01:43:53.190769+0000","last_peered":"2024-09-12T01:43:53.190769+0000","last_clean":"2024-09-12T01:43:53.190769+0000","last_became_active":"2024-09-12T01:43:52.191778+0000","last_became_peered":"2024-09-12T01:43:52.191778+0000","last_unstale":"2024-09-12T01:43:53.190769+0000","last_undegraded":"2024-09-12T01:43:53.190769+0000","last_fullsized":"2024-09-12T01:43:53.190769+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:31.699406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468613+0000","last_change":"2024-09-12T01:43:52.206344+0000","last_active":"2024-09-12T01:43:53.468613+0000","last_peered":"2024-09-12T01:43:53.468613+0000","last_clean":"2024-09-12T01:43:53.468613+0000","last_became_active":"2024-09-12T01:43:52.206048+0000","last_became_peered":"2024-09-12T01:43:52.206048+0000","last_unstale":"2024-09-12T01:43:53.468613+0000","last_undegraded":"2024-09-12T01:43:53.468613+0000","last_fullsized":"2024-09-12T01:43:53.468613+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:58.449646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191490+0000","last_change":"2024-09-12T01:43:52.193017+0000","last_active":"2024-09-12T01:43:53.191490+0000","last_peered":"2024-09-12T01:43:53.191490+0000","last_clean":"2024-09-12T01:43:53.191490+0000","last_became_active":"2024-09-12T01:43:52.192561+0000","last_became_peered":"2024-09-12T01:43:52.192561+0000","last_unstale":"2024-09-12T01:43:53.191490+0000","last_undegraded":"2024-09-12T01:43:53.191490+0000","last_fullsized":"2024-09-12T01:43:53.191490+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:09.763619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468875+0000","last_change":"2024-09-12T01:43:52.195966+0000","last_active":"2024-09-12T01:43:53.468875+0000","last_peered":"2024-09-12T01:43:53.468875+0000","last_clean":"2024-09-12T01:43:53.468875+0000","last_became_active":"2024-09-12T01:43:52.195660+0000","last_became_peered":"2024-09-12T01:43:52.195660+0000","last_unstale":"2024-09-12T01:43:53.468875+0000","last_undegraded":"2024-09-12T01:43:53.468875+0000","last_fullsized":"2024-09-12T01:43:53.468875+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:43.683128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469190+0000","last_change":"2024-09-12T01:43:52.196199+0000","last_active":"2024-09-12T01:43:53.469190+0000","last_peered":"2024-09-12T01:43:53.469190+0000","last_clean":"2024-09-12T01:43:53.469190+0000","last_became_active":"2024-09-12T01:43:52.195361+0000","last_became_peered":"2024-09-12T01:43:52.195361+0000","last_unstale":"2024-09-12T01:43:53.469190+0000","last_undegraded":"2024-09-12T01:43:53.469190+0000","last_fullsized":"2024-09-12T01:43:53.469190+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:34.000665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468369+0000","last_change":"2024-09-12T01:43:52.194162+0000","last_active":"2024-09-12T01:43:53.468369+0000","last_peered":"2024-09-12T01:43:53.468369+0000","last_clean":"2024-09-12T01:43:53.468369+0000","last_became_active":"2024-09-12T01:43:52.193840+0000","last_became_peered":"2024-09-12T01:43:52.193840+0000","last_unstale":"2024-09-12T01:43:53.468369+0000","last_undegraded":"2024-09-12T01:43:53.468369+0000","last_fullsized":"2024-09-12T01:43:53.468369+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:33.385560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224010+0000","last_change":"2024-09-12T01:43:52.195295+0000","last_active":"2024-09-12T01:43:53.224010+0000","last_peered":"2024-09-12T01:43:53.224010+0000","last_clean":"2024-09-12T01:43:53.224010+0000","last_became_active":"2024-09-12T01:43:52.194777+0000","last_became_peered":"2024-09-12T01:43:52.194777+0000","last_unstale":"2024-09-12T01:43:53.224010+0000","last_undegraded":"2024-09-12T01:43:53.224010+0000","last_fullsized":"2024-09-12T01:43:53.224010+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:36.754460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190157+0000","last_change":"2024-09-12T01:43:52.194639+0000","last_active":"2024-09-12T01:43:53.190157+0000","last_peered":"2024-09-12T01:43:53.190157+0000","last_clean":"2024-09-12T01:43:53.190157+0000","last_became_active":"2024-09-12T01:43:52.194286+0000","last_became_peered":"2024-09-12T01:43:52.194286+0000","last_unstale":"2024-09-12T01:43:53.190157+0000","last_undegraded":"2024-09-12T01:43:53.190157+0000","last_fullsized":"2024-09-12T01:43:53.190157+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:32.911591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190979+0000","last_change":"2024-09-12T01:43:52.193333+0000","last_active":"2024-09-12T01:43:53.190979+0000","last_peered":"2024-09-12T01:43:53.190979+0000","last_clean":"2024-09-12T01:43:53.190979+0000","last_became_active":"2024-09-12T01:43:52.193052+0000","last_became_peered":"2024-09-12T01:43:52.193052+0000","last_unstale":"2024-09-12T01:43:53.190979+0000","last_undegraded":"2024-09-12T01:43:53.190979+0000","last_fullsized":"2024-09-12T01:43:53.190979+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:52.420676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468987+0000","last_change":"2024-09-12T01:43:52.195808+0000","last_active":"2024-09-12T01:43:53.468987+0000","last_peered":"2024-09-12T01:43:53.468987+0000","last_clean":"2024-09-12T01:43:53.468987+0000","last_became_active":"2024-09-12T01:43:52.195508+0000","last_became_peered":"2024-09-12T01:43:52.195508+0000","last_unstale":"2024-09-12T01:43:53.468987+0000","last_undegraded":"2024-09-12T01:43:53.468987+0000","last_fullsized":"2024-09-12T01:43:53.468987+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:21.126045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469385+0000","last_change":"2024-09-12T01:43:52.201745+0000","last_active":"2024-09-12T01:43:53.469385+0000","last_peered":"2024-09-12T01:43:53.469385+0000","last_clean":"2024-09-12T01:43:53.469385+0000","last_became_active":"2024-09-12T01:43:52.201464+0000","last_became_peered":"2024-09-12T01:43:52.201464+0000","last_unstale":"2024-09-12T01:43:53.469385+0000","last_undegraded":"2024-09-12T01:43:53.469385+0000","last_fullsized":"2024-09-12T01:43:53.469385+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:33.755285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469017+0000","last_change":"2024-09-12T01:43:52.195819+0000","last_active":"2024-09-12T01:43:53.469017+0000","last_peered":"2024-09-12T01:43:53.469017+0000","last_clean":"2024-09-12T01:43:53.469017+0000","last_became_active":"2024-09-12T01:43:52.195522+0000","last_became_peered":"2024-09-12T01:43:52.195522+0000","last_unstale":"2024-09-12T01:43:53.469017+0000","last_undegraded":"2024-09-12T01:43:53.469017+0000","last_fullsized":"2024-09-12T01:43:53.469017+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:21.891202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469018+0000","last_change":"2024-09-12T01:43:52.201114+0000","last_active":"2024-09-12T01:43:53.469018+0000","last_peered":"2024-09-12T01:43:53.469018+0000","last_clean":"2024-09-12T01:43:53.469018+0000","last_became_active":"2024-09-12T01:43:52.200804+0000","last_became_peered":"2024-09-12T01:43:52.200804+0000","last_unstale":"2024-09-12T01:43:53.469018+0000","last_undegraded":"2024-09-12T01:43:53.469018+0000","last_fullsized":"2024-09-12T01:43:53.469018+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:30.441047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468196+0000","last_change":"2024-09-12T01:43:52.202554+0000","last_active":"2024-09-12T01:43:53.468196+0000","last_peered":"2024-09-12T01:43:53.468196+0000","last_clean":"2024-09-12T01:43:53.468196+0000","last_became_active":"2024-09-12T01:43:52.202293+0000","last_became_peered":"2024-09-12T01:43:52.202293+0000","last_unstale":"2024-09-12T01:43:53.468196+0000","last_undegraded":"2024-09-12T01:43:53.468196+0000","last_fullsized":"2024-09-12T01:43:53.468196+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:20.285338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224150+0000","last_change":"2024-09-12T01:43:52.195057+0000","last_active":"2024-09-12T01:43:53.224150+0000","last_peered":"2024-09-12T01:43:53.224150+0000","last_clean":"2024-09-12T01:43:53.224150+0000","last_became_active":"2024-09-12T01:43:52.194404+0000","last_became_peered":"2024-09-12T01:43:52.194404+0000","last_unstale":"2024-09-12T01:43:53.224150+0000","last_undegraded":"2024-09-12T01:43:53.224150+0000","last_fullsized":"2024-09-12T01:43:53.224150+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:16.325979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468897+0000","last_change":"2024-09-12T01:43:52.201335+0000","last_active":"2024-09-12T01:43:53.468897+0000","last_peered":"2024-09-12T01:43:53.468897+0000","last_clean":"2024-09-12T01:43:53.468897+0000","last_became_active":"2024-09-12T01:43:52.201057+0000","last_became_peered":"2024-09-12T01:43:52.201057+0000","last_unstale":"2024-09-12T01:43:53.468897+0000","last_undegraded":"2024-09-12T01:43:53.468897+0000","last_fullsized":"2024-09-12T01:43:53.468897+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:00.386031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468700+0000","last_change":"2024-09-12T01:43:52.198245+0000","last_active":"2024-09-12T01:43:53.468700+0000","last_peered":"2024-09-12T01:43:53.468700+0000","last_clean":"2024-09-12T01:43:53.468700+0000","last_became_active":"2024-09-12T01:43:52.197965+0000","last_became_peered":"2024-09-12T01:43:52.197965+0000","last_unstale":"2024-09-12T01:43:53.468700+0000","last_undegraded":"2024-09-12T01:43:53.468700+0000","last_fullsized":"2024-09-12T01:43:53.468700+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:10.874112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191660+0000","last_change":"2024-09-12T01:43:52.193225+0000","last_active":"2024-09-12T01:43:53.191660+0000","last_peered":"2024-09-12T01:43:53.191660+0000","last_clean":"2024-09-12T01:43:53.191660+0000","last_became_active":"2024-09-12T01:43:52.192922+0000","last_became_peered":"2024-09-12T01:43:52.192922+0000","last_unstale":"2024-09-12T01:43:53.191660+0000","last_undegraded":"2024-09-12T01:43:53.191660+0000","last_fullsized":"2024-09-12T01:43:53.191660+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:01.614660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"127'4","reported_seq":18,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468622+0000","last_change":"2024-09-12T01:43:51.187236+0000","last_active":"2024-09-12T01:43:53.468622+0000","last_peered":"2024-09-12T01:43:53.468622+0000","last_clean":"2024-09-12T01:43:53.468622+0000","last_became_active":"2024-09-12T01:43:51.186924+0000","last_became_peered":"2024-09-12T01:43:51.186924+0000","last_unstale":"2024-09-12T01:43:53.468622+0000","last_undegraded":"2024-09-12T01:43:53.468622+0000","last_fullsized":"2024-09-12T01:43:53.468622+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:20.501407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191186+0000","last_change":"2024-09-12T01:43:52.195939+0000","last_active":"2024-09-12T01:43:53.191186+0000","last_peered":"2024-09-12T01:43:53.191186+0000","last_clean":"2024-09-12T01:43:53.191186+0000","last_became_active":"2024-09-12T01:43:52.195660+0000","last_became_peered":"2024-09-12T01:43:52.195660+0000","last_unstale":"2024-09-12T01:43:53.191186+0000","last_undegraded":"2024-09-12T01:43:53.191186+0000","last_fullsized":"2024-09-12T01:43:53.191186+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:50.411996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469235+0000","last_change":"2024-09-12T01:43:51.181726+0000","last_active":"2024-09-12T01:43:53.469235+0000","last_peered":"2024-09-12T01:43:53.469235+0000","last_clean":"2024-09-12T01:43:53.469235+0000","last_became_active":"2024-09-12T01:43:51.181468+0000","last_became_peered":"2024-09-12T01:43:51.181468+0000","last_unstale":"2024-09-12T01:43:53.469235+0000","last_undegraded":"2024-09-12T01:43:53.469235+0000","last_fullsized":"2024-09-12T01:43:53.469235+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:50.503490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468387+0000","last_change":"2024-09-12T01:43:52.197401+0000","last_active":"2024-09-12T01:43:53.468387+0000","last_peered":"2024-09-12T01:43:53.468387+0000","last_clean":"2024-09-12T01:43:53.468387+0000","last_became_active":"2024-09-12T01:43:52.197049+0000","last_became_peered":"2024-09-12T01:43:52.197049+0000","last_unstale":"2024-09-12T01:43:53.468387+0000","last_undegraded":"2024-09-12T01:43:53.468387+0000","last_fullsized":"2024-09-12T01:43:53.468387+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:15.660651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468429+0000","last_change":"2024-09-12T01:43:51.186816+0000","last_active":"2024-09-12T01:43:53.468429+0000","last_peered":"2024-09-12T01:43:53.468429+0000","last_clean":"2024-09-12T01:43:53.468429+0000","last_became_active":"2024-09-12T01:43:51.186543+0000","last_became_peered":"2024-09-12T01:43:51.186543+0000","last_unstale":"2024-09-12T01:43:53.468429+0000","last_undegraded":"2024-09-12T01:43:53.468429+0000","last_fullsized":"2024-09-12T01:43:53.468429+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:58.527833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190622+0000","last_change":"2024-09-12T01:43:52.203501+0000","last_active":"2024-09-12T01:43:53.190622+0000","last_peered":"2024-09-12T01:43:53.190622+0000","last_clean":"2024-09-12T01:43:53.190622+0000","last_became_active":"2024-09-12T01:43:52.203193+0000","last_became_peered":"2024-09-12T01:43:52.203193+0000","last_unstale":"2024-09-12T01:43:53.190622+0000","last_undegraded":"2024-09-12T01:43:53.190622+0000","last_fullsized":"2024-09-12T01:43:53.190622+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:42.811450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468343+0000","last_change":"2024-09-12T01:43:51.185369+0000","last_active":"2024-09-12T01:43:53.468343+0000","last_peered":"2024-09-12T01:43:53.468343+0000","last_clean":"2024-09-12T01:43:53.468343+0000","last_became_active":"2024-09-12T01:43:51.184977+0000","last_became_peered":"2024-09-12T01:43:51.184977+0000","last_unstale":"2024-09-12T01:43:53.468343+0000","last_undegraded":"2024-09-12T01:43:53.468343+0000","last_fullsized":"2024-09-12T01:43:53.468343+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:15.702918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468713+0000","last_change":"2024-09-12T01:43:52.206045+0000","last_active":"2024-09-12T01:43:53.468713+0000","last_peered":"2024-09-12T01:43:53.468713+0000","last_clean":"2024-09-12T01:43:53.468713+0000","last_became_active":"2024-09-12T01:43:52.205626+0000","last_became_peered":"2024-09-12T01:43:52.205626+0000","last_unstale":"2024-09-12T01:43:53.468713+0000","last_undegraded":"2024-09-12T01:43:53.468713+0000","last_fullsized":"2024-09-12T01:43:53.468713+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:50.501162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468306+0000","last_change":"2024-09-12T01:43:51.190466+0000","last_active":"2024-09-12T01:43:53.468306+0000","last_peered":"2024-09-12T01:43:53.468306+0000","last_clean":"2024-09-12T01:43:53.468306+0000","last_became_active":"2024-09-12T01:43:51.190282+0000","last_became_peered":"2024-09-12T01:43:51.190282+0000","last_unstale":"2024-09-12T01:43:53.468306+0000","last_undegraded":"2024-09-12T01:43:53.468306+0000","last_fullsized":"2024-09-12T01:43:53.468306+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:14.257545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190579+0000","last_change":"2024-09-12T01:43:52.202902+0000","last_active":"2024-09-12T01:43:53.190579+0000","last_peered":"2024-09-12T01:43:53.190579+0000","last_clean":"2024-09-12T01:43:53.190579+0000","last_became_active":"2024-09-12T01:43:52.202575+0000","last_became_peered":"2024-09-12T01:43:52.202575+0000","last_unstale":"2024-09-12T01:43:53.190579+0000","last_undegraded":"2024-09-12T01:43:53.190579+0000","last_fullsized":"2024-09-12T01:43:53.190579+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:02.648528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191020+0000","last_change":"2024-09-12T01:43:51.189540+0000","last_active":"2024-09-12T01:43:53.191020+0000","last_peered":"2024-09-12T01:43:53.191020+0000","last_clean":"2024-09-12T01:43:53.191020+0000","last_became_active":"2024-09-12T01:43:51.189008+0000","last_became_peered":"2024-09-12T01:43:51.189008+0000","last_unstale":"2024-09-12T01:43:53.191020+0000","last_undegraded":"2024-09-12T01:43:53.191020+0000","last_fullsized":"2024-09-12T01:43:53.191020+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:11.666490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468883+0000","last_change":"2024-09-12T01:43:52.199216+0000","last_active":"2024-09-12T01:43:53.468883+0000","last_peered":"2024-09-12T01:43:53.468883+0000","last_clean":"2024-09-12T01:43:53.468883+0000","last_became_active":"2024-09-12T01:43:52.198828+0000","last_became_peered":"2024-09-12T01:43:52.198828+0000","last_unstale":"2024-09-12T01:43:53.468883+0000","last_undegraded":"2024-09-12T01:43:53.468883+0000","last_fullsized":"2024-09-12T01:43:53.468883+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:44.789589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468501+0000","last_change":"2024-09-12T01:43:51.181780+0000","last_active":"2024-09-12T01:43:53.468501+0000","last_peered":"2024-09-12T01:43:53.468501+0000","last_clean":"2024-09-12T01:43:53.468501+0000","last_became_active":"2024-09-12T01:43:51.180919+0000","last_became_peered":"2024-09-12T01:43:51.180919+0000","last_unstale":"2024-09-12T01:43:53.468501+0000","last_undegraded":"2024-09-12T01:43:53.468501+0000","last_fullsized":"2024-09-12T01:43:53.468501+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:01.643317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190287+0000","last_change":"2024-09-12T01:43:52.196135+0000","last_active":"2024-09-12T01:43:53.190287+0000","last_peered":"2024-09-12T01:43:53.190287+0000","last_clean":"2024-09-12T01:43:53.190287+0000","last_became_active":"2024-09-12T01:43:52.195858+0000","last_became_peered":"2024-09-12T01:43:52.195858+0000","last_unstale":"2024-09-12T01:43:53.190287+0000","last_undegraded":"2024-09-12T01:43:53.190287+0000","last_fullsized":"2024-09-12T01:43:53.190287+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:29.055940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468146+0000","last_change":"2024-09-12T01:43:51.193832+0000","last_active":"2024-09-12T01:43:53.468146+0000","last_peered":"2024-09-12T01:43:53.468146+0000","last_clean":"2024-09-12T01:43:53.468146+0000","last_became_active":"2024-09-12T01:43:51.193464+0000","last_became_peered":"2024-09-12T01:43:51.193464+0000","last_unstale":"2024-09-12T01:43:53.468146+0000","last_undegraded":"2024-09-12T01:43:53.468146+0000","last_fullsized":"2024-09-12T01:43:53.468146+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:34.704740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190965+0000","last_change":"2024-09-12T01:43:52.197193+0000","last_active":"2024-09-12T01:43:53.190965+0000","last_peered":"2024-09-12T01:43:53.190965+0000","last_clean":"2024-09-12T01:43:53.190965+0000","last_became_active":"2024-09-12T01:43:52.196904+0000","last_became_peered":"2024-09-12T01:43:52.196904+0000","last_unstale":"2024-09-12T01:43:53.190965+0000","last_undegraded":"2024-09-12T01:43:53.190965+0000","last_fullsized":"2024-09-12T01:43:53.190965+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:31.699406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469211+0000","last_change":"2024-09-12T01:43:51.186656+0000","last_active":"2024-09-12T01:43:53.469211+0000","last_peered":"2024-09-12T01:43:53.469211+0000","last_clean":"2024-09-12T01:43:53.469211+0000","last_became_active":"2024-09-12T01:43:51.186355+0000","last_became_peered":"2024-09-12T01:43:51.186355+0000","last_unstale":"2024-09-12T01:43:53.469211+0000","last_undegraded":"2024-09-12T01:43:53.469211+0000","last_fullsized":"2024-09-12T01:43:53.469211+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:33.642012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224143+0000","last_change":"2024-09-12T01:43:52.197313+0000","last_active":"2024-09-12T01:43:53.224143+0000","last_peered":"2024-09-12T01:43:53.224143+0000","last_clean":"2024-09-12T01:43:53.224143+0000","last_became_active":"2024-09-12T01:43:52.197035+0000","last_became_peered":"2024-09-12T01:43:52.197035+0000","last_unstale":"2024-09-12T01:43:53.224143+0000","last_undegraded":"2024-09-12T01:43:53.224143+0000","last_fullsized":"2024-09-12T01:43:53.224143+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:31.699406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191702+0000","last_change":"2024-09-12T01:43:51.187892+0000","last_active":"2024-09-12T01:43:53.191702+0000","last_peered":"2024-09-12T01:43:53.191702+0000","last_clean":"2024-09-12T01:43:53.191702+0000","last_became_active":"2024-09-12T01:43:51.187452+0000","last_became_peered":"2024-09-12T01:43:51.187452+0000","last_unstale":"2024-09-12T01:43:53.191702+0000","last_undegraded":"2024-09-12T01:43:53.191702+0000","last_fullsized":"2024-09-12T01:43:53.191702+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:50.905828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191171+0000","last_change":"2024-09-12T01:43:52.193823+0000","last_active":"2024-09-12T01:43:53.191171+0000","last_peered":"2024-09-12T01:43:53.191171+0000","last_clean":"2024-09-12T01:43:53.191171+0000","last_became_active":"2024-09-12T01:43:52.193454+0000","last_became_peered":"2024-09-12T01:43:52.193454+0000","last_unstale":"2024-09-12T01:43:53.191171+0000","last_undegraded":"2024-09-12T01:43:53.191171+0000","last_fullsized":"2024-09-12T01:43:53.191171+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:15.660651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"127'6","reported_seq":20,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190903+0000","last_change":"2024-09-12T01:43:51.187614+0000","last_active":"2024-09-12T01:43:53.190903+0000","last_peered":"2024-09-12T01:43:53.190903+0000","last_clean":"2024-09-12T01:43:53.190903+0000","last_became_active":"2024-09-12T01:43:51.187345+0000","last_became_peered":"2024-09-12T01:43:51.187345+0000","last_unstale":"2024-09-12T01:43:53.190903+0000","last_undegraded":"2024-09-12T01:43:53.190903+0000","last_fullsized":"2024-09-12T01:43:53.190903+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:28.050729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190462+0000","last_change":"2024-09-12T01:43:52.198116+0000","last_active":"2024-09-12T01:43:53.190462+0000","last_peered":"2024-09-12T01:43:53.190462+0000","last_clean":"2024-09-12T01:43:53.190462+0000","last_became_active":"2024-09-12T01:43:52.197852+0000","last_became_peered":"2024-09-12T01:43:52.197852+0000","last_unstale":"2024-09-12T01:43:53.190462+0000","last_undegraded":"2024-09-12T01:43:53.190462+0000","last_fullsized":"2024-09-12T01:43:53.190462+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:51.508700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468423+0000","last_change":"2024-09-12T01:43:51.185009+0000","last_active":"2024-09-12T01:43:53.468423+0000","last_peered":"2024-09-12T01:43:53.468423+0000","last_clean":"2024-09-12T01:43:53.468423+0000","last_became_active":"2024-09-12T01:43:51.184624+0000","last_became_peered":"2024-09-12T01:43:51.184624+0000","last_unstale":"2024-09-12T01:43:53.468423+0000","last_undegraded":"2024-09-12T01:43:53.468423+0000","last_fullsized":"2024-09-12T01:43:53.468423+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:07.724259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469172+0000","last_change":"2024-09-12T01:43:52.202539+0000","last_active":"2024-09-12T01:43:53.469172+0000","last_peered":"2024-09-12T01:43:53.469172+0000","last_clean":"2024-09-12T01:43:53.469172+0000","last_became_active":"2024-09-12T01:43:52.201815+0000","last_became_peered":"2024-09-12T01:43:52.201815+0000","last_unstale":"2024-09-12T01:43:53.469172+0000","last_undegraded":"2024-09-12T01:43:53.469172+0000","last_fullsized":"2024-09-12T01:43:53.469172+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.323760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224209+0000","last_change":"2024-09-12T01:43:51.184292+0000","last_active":"2024-09-12T01:43:53.224209+0000","last_peered":"2024-09-12T01:43:53.224209+0000","last_clean":"2024-09-12T01:43:53.224209+0000","last_became_active":"2024-09-12T01:43:51.183758+0000","last_became_peered":"2024-09-12T01:43:51.183758+0000","last_unstale":"2024-09-12T01:43:53.224209+0000","last_undegraded":"2024-09-12T01:43:53.224209+0000","last_fullsized":"2024-09-12T01:43:53.224209+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:13.828776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190070+0000","last_change":"2024-09-12T01:43:52.197655+0000","last_active":"2024-09-12T01:43:53.190070+0000","last_peered":"2024-09-12T01:43:53.190070+0000","last_clean":"2024-09-12T01:43:53.190070+0000","last_became_active":"2024-09-12T01:43:52.193411+0000","last_became_peered":"2024-09-12T01:43:52.193411+0000","last_unstale":"2024-09-12T01:43:53.190070+0000","last_undegraded":"2024-09-12T01:43:53.190070+0000","last_fullsized":"2024-09-12T01:43:53.190070+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:52.956773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468562+0000","last_change":"2024-09-12T01:43:51.184775+0000","last_active":"2024-09-12T01:43:53.468562+0000","last_peered":"2024-09-12T01:43:53.468562+0000","last_clean":"2024-09-12T01:43:53.468562+0000","last_became_active":"2024-09-12T01:43:51.184498+0000","last_became_peered":"2024-09-12T01:43:51.184498+0000","last_unstale":"2024-09-12T01:43:53.468562+0000","last_undegraded":"2024-09-12T01:43:53.468562+0000","last_fullsized":"2024-09-12T01:43:53.468562+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:41.424399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190418+0000","last_change":"2024-09-12T01:43:52.201499+0000","last_active":"2024-09-12T01:43:53.190418+0000","last_peered":"2024-09-12T01:43:53.190418+0000","last_clean":"2024-09-12T01:43:53.190418+0000","last_became_active":"2024-09-12T01:43:52.193900+0000","last_became_peered":"2024-09-12T01:43:52.193900+0000","last_unstale":"2024-09-12T01:43:53.190418+0000","last_undegraded":"2024-09-12T01:43:53.190418+0000","last_fullsized":"2024-09-12T01:43:53.190418+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:52.200358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"127'8","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468380+0000","last_change":"2024-09-12T01:43:51.180654+0000","last_active":"2024-09-12T01:43:53.468380+0000","last_peered":"2024-09-12T01:43:53.468380+0000","last_clean":"2024-09-12T01:43:53.468380+0000","last_became_active":"2024-09-12T01:43:51.180405+0000","last_became_peered":"2024-09-12T01:43:51.180405+0000","last_unstale":"2024-09-12T01:43:53.468380+0000","last_undegraded":"2024-09-12T01:43:53.468380+0000","last_fullsized":"2024-09-12T01:43:53.468380+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.597910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191658+0000","last_change":"2024-09-12T01:43:52.199512+0000","last_active":"2024-09-12T01:43:53.191658+0000","last_peered":"2024-09-12T01:43:53.191658+0000","last_clean":"2024-09-12T01:43:53.191658+0000","last_became_active":"2024-09-12T01:43:52.199143+0000","last_became_peered":"2024-09-12T01:43:52.199143+0000","last_unstale":"2024-09-12T01:43:53.191658+0000","last_undegraded":"2024-09-12T01:43:53.191658+0000","last_fullsized":"2024-09-12T01:43:53.191658+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:42.469260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190801+0000","last_change":"2024-09-12T01:43:51.190092+0000","last_active":"2024-09-12T01:43:53.190801+0000","last_peered":"2024-09-12T01:43:53.190801+0000","last_clean":"2024-09-12T01:43:53.190801+0000","last_became_active":"2024-09-12T01:43:51.189777+0000","last_became_peered":"2024-09-12T01:43:51.189777+0000","last_unstale":"2024-09-12T01:43:53.190801+0000","last_undegraded":"2024-09-12T01:43:53.190801+0000","last_fullsized":"2024-09-12T01:43:53.190801+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:43.784378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469110+0000","last_change":"2024-09-12T01:43:52.200910+0000","last_active":"2024-09-12T01:43:53.469110+0000","last_peered":"2024-09-12T01:43:53.469110+0000","last_clean":"2024-09-12T01:43:53.469110+0000","last_became_active":"2024-09-12T01:43:52.200600+0000","last_became_peered":"2024-09-12T01:43:52.200600+0000","last_unstale":"2024-09-12T01:43:53.469110+0000","last_undegraded":"2024-09-12T01:43:53.469110+0000","last_fullsized":"2024-09-12T01:43:53.469110+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:44.686853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469411+0000","last_change":"2024-09-12T01:43:51.184567+0000","last_active":"2024-09-12T01:43:53.469411+0000","last_peered":"2024-09-12T01:43:53.469411+0000","last_clean":"2024-09-12T01:43:53.469411+0000","last_became_active":"2024-09-12T01:43:51.184313+0000","last_became_peered":"2024-09-12T01:43:51.184313+0000","last_unstale":"2024-09-12T01:43:53.469411+0000","last_undegraded":"2024-09-12T01:43:53.469411+0000","last_fullsized":"2024-09-12T01:43:53.469411+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:26.397286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191242+0000","last_change":"2024-09-12T01:43:52.200343+0000","last_active":"2024-09-12T01:43:53.191242+0000","last_peered":"2024-09-12T01:43:53.191242+0000","last_clean":"2024-09-12T01:43:53.191242+0000","last_became_active":"2024-09-12T01:43:52.200037+0000","last_became_peered":"2024-09-12T01:43:52.200037+0000","last_unstale":"2024-09-12T01:43:53.191242+0000","last_undegraded":"2024-09-12T01:43:53.191242+0000","last_fullsized":"2024-09-12T01:43:53.191242+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:27.265656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191327+0000","last_change":"2024-09-12T01:43:51.191423+0000","last_active":"2024-09-12T01:43:53.191327+0000","last_peered":"2024-09-12T01:43:53.191327+0000","last_clean":"2024-09-12T01:43:53.191327+0000","last_became_active":"2024-09-12T01:43:51.191236+0000","last_became_peered":"2024-09-12T01:43:51.191236+0000","last_unstale":"2024-09-12T01:43:53.191327+0000","last_undegraded":"2024-09-12T01:43:53.191327+0000","last_fullsized":"2024-09-12T01:43:53.191327+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:31.906381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468875+0000","last_change":"2024-09-12T01:43:52.197256+0000","last_active":"2024-09-12T01:43:53.468875+0000","last_peered":"2024-09-12T01:43:53.468875+0000","last_clean":"2024-09-12T01:43:53.468875+0000","last_became_active":"2024-09-12T01:43:52.196969+0000","last_became_peered":"2024-09-12T01:43:52.196969+0000","last_unstale":"2024-09-12T01:43:53.468875+0000","last_undegraded":"2024-09-12T01:43:53.468875+0000","last_fullsized":"2024-09-12T01:43:53.468875+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.030087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468803+0000","last_change":"2024-09-12T01:43:51.187189+0000","last_active":"2024-09-12T01:43:53.468803+0000","last_peered":"2024-09-12T01:43:53.468803+0000","last_clean":"2024-09-12T01:43:53.468803+0000","last_became_active":"2024-09-12T01:43:51.186919+0000","last_became_peered":"2024-09-12T01:43:51.186919+0000","last_unstale":"2024-09-12T01:43:53.468803+0000","last_undegraded":"2024-09-12T01:43:53.468803+0000","last_fullsized":"2024-09-12T01:43:53.468803+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:12.198020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224156+0000","last_change":"2024-09-12T01:43:52.203777+0000","last_active":"2024-09-12T01:43:53.224156+0000","last_peered":"2024-09-12T01:43:53.224156+0000","last_clean":"2024-09-12T01:43:53.224156+0000","last_became_active":"2024-09-12T01:43:52.203382+0000","last_became_peered":"2024-09-12T01:43:52.203382+0000","last_unstale":"2024-09-12T01:43:53.224156+0000","last_undegraded":"2024-09-12T01:43:53.224156+0000","last_fullsized":"2024-09-12T01:43:53.224156+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.137459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468354+0000","last_change":"2024-09-12T01:43:51.181919+0000","last_active":"2024-09-12T01:43:53.468354+0000","last_peered":"2024-09-12T01:43:53.468354+0000","last_clean":"2024-09-12T01:43:53.468354+0000","last_became_active":"2024-09-12T01:43:51.181640+0000","last_became_peered":"2024-09-12T01:43:51.181640+0000","last_unstale":"2024-09-12T01:43:53.468354+0000","last_undegraded":"2024-09-12T01:43:53.468354+0000","last_fullsized":"2024-09-12T01:43:53.468354+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:51.195148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468410+0000","last_change":"2024-09-12T01:43:52.200061+0000","last_active":"2024-09-12T01:43:53.468410+0000","last_peered":"2024-09-12T01:43:53.468410+0000","last_clean":"2024-09-12T01:43:53.468410+0000","last_became_active":"2024-09-12T01:43:52.199682+0000","last_became_peered":"2024-09-12T01:43:52.199682+0000","last_unstale":"2024-09-12T01:43:53.468410+0000","last_undegraded":"2024-09-12T01:43:53.468410+0000","last_fullsized":"2024-09-12T01:43:53.468410+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:46.385808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190394+0000","last_change":"2024-09-12T01:43:51.190566+0000","last_active":"2024-09-12T01:43:53.190394+0000","last_peered":"2024-09-12T01:43:53.190394+0000","last_clean":"2024-09-12T01:43:53.190394+0000","last_became_active":"2024-09-12T01:43:51.189585+0000","last_became_peered":"2024-09-12T01:43:51.189585+0000","last_unstale":"2024-09-12T01:43:53.190394+0000","last_undegraded":"2024-09-12T01:43:53.190394+0000","last_fullsized":"2024-09-12T01:43:53.190394+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:24.544318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.223940+0000","last_change":"2024-09-12T01:43:52.196763+0000","last_active":"2024-09-12T01:43:53.223940+0000","last_peered":"2024-09-12T01:43:53.223940+0000","last_clean":"2024-09-12T01:43:53.223940+0000","last_became_active":"2024-09-12T01:43:52.196278+0000","last_became_peered":"2024-09-12T01:43:52.196278+0000","last_unstale":"2024-09-12T01:43:53.223940+0000","last_undegraded":"2024-09-12T01:43:53.223940+0000","last_fullsized":"2024-09-12T01:43:53.223940+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:42.811450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190472+0000","last_change":"2024-09-12T01:43:51.189225+0000","last_active":"2024-09-12T01:43:53.190472+0000","last_peered":"2024-09-12T01:43:53.190472+0000","last_clean":"2024-09-12T01:43:53.190472+0000","last_became_active":"2024-09-12T01:43:51.187427+0000","last_became_peered":"2024-09-12T01:43:51.187427+0000","last_unstale":"2024-09-12T01:43:53.190472+0000","last_undegraded":"2024-09-12T01:43:53.190472+0000","last_fullsized":"2024-09-12T01:43:53.190472+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:29.435836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468498+0000","last_change":"2024-09-12T01:43:52.201050+0000","last_active":"2024-09-12T01:43:53.468498+0000","last_peered":"2024-09-12T01:43:53.468498+0000","last_clean":"2024-09-12T01:43:53.468498+0000","last_became_active":"2024-09-12T01:43:52.200559+0000","last_became_peered":"2024-09-12T01:43:52.200559+0000","last_unstale":"2024-09-12T01:43:53.468498+0000","last_undegraded":"2024-09-12T01:43:53.468498+0000","last_fullsized":"2024-09-12T01:43:53.468498+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:25.549529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190264+0000","last_change":"2024-09-12T01:43:51.190048+0000","last_active":"2024-09-12T01:43:53.190264+0000","last_peered":"2024-09-12T01:43:53.190264+0000","last_clean":"2024-09-12T01:43:53.190264+0000","last_became_active":"2024-09-12T01:43:51.189438+0000","last_became_peered":"2024-09-12T01:43:51.189438+0000","last_unstale":"2024-09-12T01:43:53.190264+0000","last_undegraded":"2024-09-12T01:43:53.190264+0000","last_fullsized":"2024-09-12T01:43:53.190264+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.495951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191097+0000","last_change":"2024-09-12T01:43:52.202847+0000","last_active":"2024-09-12T01:43:53.191097+0000","last_peered":"2024-09-12T01:43:53.191097+0000","last_clean":"2024-09-12T01:43:53.191097+0000","last_became_active":"2024-09-12T01:43:52.202595+0000","last_became_peered":"2024-09-12T01:43:52.202595+0000","last_unstale":"2024-09-12T01:43:53.191097+0000","last_undegraded":"2024-09-12T01:43:53.191097+0000","last_fullsized":"2024-09-12T01:43:53.191097+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:16.325979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190945+0000","last_change":"2024-09-12T01:43:51.182059+0000","last_active":"2024-09-12T01:43:53.190945+0000","last_peered":"2024-09-12T01:43:53.190945+0000","last_clean":"2024-09-12T01:43:53.190945+0000","last_became_active":"2024-09-12T01:43:51.181729+0000","last_became_peered":"2024-09-12T01:43:51.181729+0000","last_unstale":"2024-09-12T01:43:53.190945+0000","last_undegraded":"2024-09-12T01:43:53.190945+0000","last_fullsized":"2024-09-12T01:43:53.190945+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:09.868902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190896+0000","last_change":"2024-09-12T01:43:52.203811+0000","last_active":"2024-09-12T01:43:53.190896+0000","last_peered":"2024-09-12T01:43:53.190896+0000","last_clean":"2024-09-12T01:43:53.190896+0000","last_became_active":"2024-09-12T01:43:52.203515+0000","last_became_peered":"2024-09-12T01:43:52.203515+0000","last_unstale":"2024-09-12T01:43:53.190896+0000","last_undegraded":"2024-09-12T01:43:53.190896+0000","last_fullsized":"2024-09-12T01:43:53.190896+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:36.754460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"128'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468900+0000","last_change":"2024-09-12T01:43:51.193650+0000","last_active":"2024-09-12T01:43:53.468900+0000","last_peered":"2024-09-12T01:43:53.468900+0000","last_clean":"2024-09-12T01:43:53.468900+0000","last_became_active":"2024-09-12T01:43:51.193406+0000","last_became_peered":"2024-09-12T01:43:51.193406+0000","last_unstale":"2024-09-12T01:43:53.468900+0000","last_undegraded":"2024-09-12T01:43:53.468900+0000","last_fullsized":"2024-09-12T01:43:53.468900+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:32.090329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469348+0000","last_change":"2024-09-12T01:43:52.198800+0000","last_active":"2024-09-12T01:43:53.469348+0000","last_peered":"2024-09-12T01:43:53.469348+0000","last_clean":"2024-09-12T01:43:53.469348+0000","last_became_active":"2024-09-12T01:43:52.198490+0000","last_became_peered":"2024-09-12T01:43:52.198490+0000","last_unstale":"2024-09-12T01:43:53.469348+0000","last_undegraded":"2024-09-12T01:43:53.469348+0000","last_fullsized":"2024-09-12T01:43:53.469348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191252+0000","last_change":"2024-09-12T01:43:51.188178+0000","last_active":"2024-09-12T01:43:53.191252+0000","last_peered":"2024-09-12T01:43:53.191252+0000","last_clean":"2024-09-12T01:43:53.191252+0000","last_became_active":"2024-09-12T01:43:51.187415+0000","last_became_peered":"2024-09-12T01:43:51.187415+0000","last_unstale":"2024-09-12T01:43:53.191252+0000","last_undegraded":"2024-09-12T01:43:53.191252+0000","last_fullsized":"2024-09-12T01:43:53.191252+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:15.082942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469170+0000","last_change":"2024-09-12T01:43:52.205916+0000","last_active":"2024-09-12T01:43:53.469170+0000","last_peered":"2024-09-12T01:43:53.469170+0000","last_clean":"2024-09-12T01:43:53.469170+0000","last_became_active":"2024-09-12T01:43:52.205619+0000","last_became_peered":"2024-09-12T01:43:52.205619+0000","last_unstale":"2024-09-12T01:43:53.469170+0000","last_undegraded":"2024-09-12T01:43:53.469170+0000","last_fullsized":"2024-09-12T01:43:53.469170+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.063068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191161+0000","last_change":"2024-09-12T01:43:51.184430+0000","last_active":"2024-09-12T01:43:53.191161+0000","last_peered":"2024-09-12T01:43:53.191161+0000","last_clean":"2024-09-12T01:43:53.191161+0000","last_became_active":"2024-09-12T01:43:51.183973+0000","last_became_peered":"2024-09-12T01:43:51.183973+0000","last_unstale":"2024-09-12T01:43:53.191161+0000","last_undegraded":"2024-09-12T01:43:53.191161+0000","last_fullsized":"2024-09-12T01:43:53.191161+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:51.195148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191080+0000","last_change":"2024-09-12T01:43:52.198362+0000","last_active":"2024-09-12T01:43:53.191080+0000","last_peered":"2024-09-12T01:43:53.191080+0000","last_clean":"2024-09-12T01:43:53.191080+0000","last_became_active":"2024-09-12T01:43:52.198053+0000","last_became_peered":"2024-09-12T01:43:52.198053+0000","last_unstale":"2024-09-12T01:43:53.191080+0000","last_undegraded":"2024-09-12T01:43:53.191080+0000","last_fullsized":"2024-09-12T01:43:53.191080+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.137459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468481+0000","last_change":"2024-09-12T01:43:51.186791+0000","last_active":"2024-09-12T01:43:53.468481+0000","last_peered":"2024-09-12T01:43:53.468481+0000","last_clean":"2024-09-12T01:43:53.468481+0000","last_became_active":"2024-09-12T01:43:51.186480+0000","last_became_peered":"2024-09-12T01:43:51.186480+0000","last_unstale":"2024-09-12T01:43:53.468481+0000","last_undegraded":"2024-09-12T01:43:53.468481+0000","last_fullsized":"2024-09-12T01:43:53.468481+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:45.776104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190508+0000","last_change":"2024-09-12T01:43:52.184337+0000","last_active":"2024-09-12T01:43:53.190508+0000","last_peered":"2024-09-12T01:43:53.190508+0000","last_clean":"2024-09-12T01:43:53.190508+0000","last_became_active":"2024-09-12T01:43:52.183717+0000","last_became_peered":"2024-09-12T01:43:52.183717+0000","last_unstale":"2024-09-12T01:43:53.190508+0000","last_undegraded":"2024-09-12T01:43:53.190508+0000","last_fullsized":"2024-09-12T01:43:53.190508+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:34.647223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468200+0000","last_change":"2024-09-12T01:43:51.192004+0000","last_active":"2024-09-12T01:43:53.468200+0000","last_peered":"2024-09-12T01:43:53.468200+0000","last_clean":"2024-09-12T01:43:53.468200+0000","last_became_active":"2024-09-12T01:43:51.191733+0000","last_became_peered":"2024-09-12T01:43:51.191733+0000","last_unstale":"2024-09-12T01:43:53.468200+0000","last_undegraded":"2024-09-12T01:43:53.468200+0000","last_fullsized":"2024-09-12T01:43:53.468200+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:16.063093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190070+0000","last_change":"2024-09-12T01:43:52.201870+0000","last_active":"2024-09-12T01:43:53.190070+0000","last_peered":"2024-09-12T01:43:53.190070+0000","last_clean":"2024-09-12T01:43:53.190070+0000","last_became_active":"2024-09-12T01:43:52.201259+0000","last_became_peered":"2024-09-12T01:43:52.201259+0000","last_unstale":"2024-09-12T01:43:53.190070+0000","last_undegraded":"2024-09-12T01:43:53.190070+0000","last_fullsized":"2024-09-12T01:43:53.190070+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:16.088153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.223777+0000","last_change":"2024-09-12T01:43:51.184853+0000","last_active":"2024-09-12T01:43:53.223777+0000","last_peered":"2024-09-12T01:43:53.223777+0000","last_clean":"2024-09-12T01:43:53.223777+0000","last_became_active":"2024-09-12T01:43:51.184574+0000","last_became_peered":"2024-09-12T01:43:51.184574+0000","last_unstale":"2024-09-12T01:43:53.223777+0000","last_undegraded":"2024-09-12T01:43:53.223777+0000","last_fullsized":"2024-09-12T01:43:53.223777+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:46.068566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468201+0000","last_change":"2024-09-12T01:43:52.197999+0000","last_active":"2024-09-12T01:43:53.468201+0000","last_peered":"2024-09-12T01:43:53.468201+0000","last_clean":"2024-09-12T01:43:53.468201+0000","last_became_active":"2024-09-12T01:43:52.197701+0000","last_became_peered":"2024-09-12T01:43:52.197701+0000","last_unstale":"2024-09-12T01:43:53.468201+0000","last_undegraded":"2024-09-12T01:43:53.468201+0000","last_fullsized":"2024-09-12T01:43:53.468201+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:22.275370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468229+0000","last_change":"2024-09-12T01:43:51.182187+0000","last_active":"2024-09-12T01:43:53.468229+0000","last_peered":"2024-09-12T01:43:53.468229+0000","last_clean":"2024-09-12T01:43:53.468229+0000","last_became_active":"2024-09-12T01:43:51.181927+0000","last_became_peered":"2024-09-12T01:43:51.181927+0000","last_unstale":"2024-09-12T01:43:53.468229+0000","last_undegraded":"2024-09-12T01:43:53.468229+0000","last_fullsized":"2024-09-12T01:43:53.468229+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:41.806239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191161+0000","last_change":"2024-09-12T01:43:52.195208+0000","last_active":"2024-09-12T01:43:53.191161+0000","last_peered":"2024-09-12T01:43:53.191161+0000","last_clean":"2024-09-12T01:43:53.191161+0000","last_became_active":"2024-09-12T01:43:52.194928+0000","last_became_peered":"2024-09-12T01:43:52.194928+0000","last_unstale":"2024-09-12T01:43:53.191161+0000","last_undegraded":"2024-09-12T01:43:53.191161+0000","last_fullsized":"2024-09-12T01:43:53.191161+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:51.407008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"127'3","reported_seq":17,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224158+0000","last_change":"2024-09-12T01:43:51.184190+0000","last_active":"2024-09-12T01:43:53.224158+0000","last_peered":"2024-09-12T01:43:53.224158+0000","last_clean":"2024-09-12T01:43:53.224158+0000","last_became_active":"2024-09-12T01:43:51.183915+0000","last_became_peered":"2024-09-12T01:43:51.183915+0000","last_unstale":"2024-09-12T01:43:53.224158+0000","last_undegraded":"2024-09-12T01:43:53.224158+0000","last_fullsized":"2024-09-12T01:43:53.224158+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:29.914862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":368,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191031+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:43:53.191031+0000","last_peered":"2024-09-12T01:43:53.191031+0000","last_clean":"2024-09-12T01:43:53.191031+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:43:53.191031+0000","last_undegraded":"2024-09-12T01:43:53.191031+0000","last_fullsized":"2024-09-12T01:43:53.191031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509543,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1597440,"data_stored":683664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509541,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36908,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334932,"statfs":{"total":96636764160,"available":96598970368,"internally_reserved":0,"allocated":1597440,"data_stored":683664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509541,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33360,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338480,"statfs":{"total":96636764160,"available":96602603520,"internally_reserved":0,"allocated":2215936,"data_stored":1275838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509541,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36924,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334916,"statfs":{"total":96636764160,"available":96598953984,"internally_reserved":0,"allocated":1605632,"data_stored":684280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1601536,"data_stored":683686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2195456,"data_stored":1274102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509542,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1601536,"data_stored":683754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1605632,"data_stored":679580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:43:58.157 INFO:tasks.ceph.mds.b.smithi105.stderr:2024-09-12T01:43:58.158+0000 7f66dae9e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:43:59.589 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:43:59.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.706+0000 7f6b11f49640 1 Processor -- start 2024-09-12T01:43:59.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.706+0000 7f6b11f49640 1 -- start start 2024-09-12T01:43:59.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.707+0000 7f6b11f49640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6b0c0cf6b0 0x7f6b0c1629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:59.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.707+0000 7f6b11f49640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b0c162f30 0x7f6b0c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:59.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.707+0000 7f6b11f49640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b0c0cfc20 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.707+0000 7f6b11f49640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6b0c0d40c0 con 0x7f6b0c0cf6b0 2024-09-12T01:43:59.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.707+0000 7f6b11f49640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c0d2ed0 con 0x7f6b0c162f30 2024-09-12T01:43:59.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.707+0000 7f6b0bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b0c162f30 0x7f6b0c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:59.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.707+0000 7f6b0affd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6b0c0cf6b0 0x7f6b0c1629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:59.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.707+0000 7f6b0b7fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f6b0c0b63d0 0x7f6b0c0d39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:53284/0 (socket says 172.21.15.60:53284) 2024-09-12T01:43:59.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.707+0000 7f6b0bfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b0c162f30 0x7f6b0c0b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:51870/0 (socket says 172.21.15.60:51870) 2024-09-12T01:43:59.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.707+0000 7f6b0b7fe640 1 -- 172.21.15.60:0/3461106410 learned_addr learned my addr 172.21.15.60:0/3461106410 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:43:59.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.708+0000 7f6b0a7fc640 1 -- 172.21.15.60:0/3461106410 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4083736391 0 0) 0x7f6b0c0cfc20 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.708+0000 7f6b0a7fc640 1 -- 172.21.15.60:0/3461106410 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6af4003520 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.708+0000 7f6b0bfff640 1 -- 172.21.15.60:0/3461106410 >> v2:172.21.15.105:3300/0 conn(0x7f6b0c0cf6b0 msgr2=0x7f6b0c1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:43:59.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.708+0000 7f6b0bfff640 1 --2- 172.21.15.60:0/3461106410 >> v2:172.21.15.105:3300/0 conn(0x7f6b0c0cf6b0 0x7f6b0c1629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:59.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.708+0000 7f6b0bfff640 1 -- 172.21.15.60:0/3461106410 >> v1:172.21.15.105:6789/0 conn(0x7f6b0c0b63d0 legacy=0x7f6b0c0d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:59.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.708+0000 7f6b0bfff640 1 -- 172.21.15.60:0/3461106410 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c0d31b0 con 0x7f6b0c162f30 2024-09-12T01:43:59.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.708+0000 7f6b0affd640 1 --2- 172.21.15.60:0/3461106410 >> v2:172.21.15.105:3300/0 conn(0x7f6b0c0cf6b0 0x7f6b0c1629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:43:59.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.709+0000 7f6b0bfff640 1 --2- 172.21.15.60:0/3461106410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b0c162f30 0x7f6b0c0b7880 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009d90 tx=0x7f6b0402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f471a286cf1b189 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:59.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.709+0000 7f6b0a7fc640 1 -- 172.21.15.60:0/3461106410 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04007740 con 0x7f6b0c162f30 2024-09-12T01:43:59.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.709+0000 7f6b0a7fc640 1 -- 172.21.15.60:0/3461106410 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b040078e0 con 0x7f6b0c162f30 2024-09-12T01:43:59.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.709+0000 7f6b0a7fc640 1 -- 172.21.15.60:0/3461106410 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04007c90 con 0x7f6b0c162f30 2024-09-12T01:43:59.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.709+0000 7f6b11f49640 1 -- 172.21.15.60:0/3461106410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b0c162f30 msgr2=0x7f6b0c0b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:59.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.709+0000 7f6b11f49640 1 --2- 172.21.15.60:0/3461106410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b0c162f30 0x7f6b0c0b7880 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009d90 tx=0x7f6b0402a660 comp rx=0 tx=0).stop 2024-09-12T01:43:59.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.709+0000 7f6b11f49640 1 -- 172.21.15.60:0/3461106410 shutdown_connections 2024-09-12T01:43:59.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.709+0000 7f6b11f49640 1 --2- 172.21.15.60:0/3461106410 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b0c162f30 0x7f6b0c0b7880 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:59.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.709+0000 7f6b11f49640 1 --2- 172.21.15.60:0/3461106410 >> v2:172.21.15.105:3300/0 conn(0x7f6b0c0cf6b0 0x7f6b0c1629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:59.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.709+0000 7f6b11f49640 1 -- 172.21.15.60:0/3461106410 >> 172.21.15.60:0/3461106410 conn(0x7f6b0c0d1160 msgr2=0x7f6b0c0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:59.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.709+0000 7f6b11f49640 1 -- 172.21.15.60:0/3461106410 shutdown_connections 2024-09-12T01:43:59.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.709+0000 7f6b11f49640 1 -- 172.21.15.60:0/3461106410 wait complete. 2024-09-12T01:43:59.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.711+0000 7f6b11f49640 1 Processor -- start 2024-09-12T01:43:59.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.711+0000 7f6b11f49640 1 -- start start 2024-09-12T01:43:59.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.711+0000 7f6b11f49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b0c0b63d0 0x7f6b0c160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:59.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b11f49640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b0c0cf6b0 0x7f6b0c1e9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:59.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b11f49640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b0c162f30 0x7f6b0c0cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:59.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b11f49640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c0cb5c0 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b11f49640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c0cb440 con 0x7f6b0c0cf6b0 2024-09-12T01:43:59.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b11f49640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c0d1c80 con 0x7f6b0c162f30 2024-09-12T01:43:59.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b0b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b0c0b63d0 0x7f6b0c160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:59.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b0b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b0c0b63d0 0x7f6b0c160ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40904/0 (socket says 172.21.15.60:40904) 2024-09-12T01:43:59.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b0b7fe640 1 -- 172.21.15.60:0/1600444285 learned_addr learned my addr 172.21.15.60:0/1600444285 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:43:59.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b0bfff640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b0c162f30 0x7f6b0c0cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:59.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b0affd640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b0c0cf6b0 0x7f6b0c1e9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:59.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b0b7fe640 1 -- 172.21.15.60:0/1600444285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b0c162f30 msgr2=0x7f6b0c0cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:59.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b0b7fe640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b0c162f30 0x7f6b0c0cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:59.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b0b7fe640 1 -- 172.21.15.60:0/1600444285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b0c0cf6b0 msgr2=0x7f6b0c1e9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:59.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b0b7fe640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b0c0cf6b0 0x7f6b0c1e9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:59.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b0b7fe640 1 -- 172.21.15.60:0/1600444285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c1e8a30 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b0b7fe640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b0c0b63d0 0x7f6b0c160ba0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00c430 tx=0x7f6afc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:59.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6af3fff640 1 -- 172.21.15.60:0/1600444285 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6afc017070 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6af3fff640 1 -- 172.21.15.60:0/1600444285 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6afc005ce0 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.712+0000 7f6b11f49640 1 -- 172.21.15.60:0/1600444285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0c1e8d10 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.713+0000 7f6af3fff640 1 -- 172.21.15.60:0/1600444285 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0072f0 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.713+0000 7f6b11f49640 1 -- 172.21.15.60:0/1600444285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0c1e92d0 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.713+0000 7f6b11f49640 1 -- 172.21.15.60:0/1600444285 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b0c0b67b0 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.714+0000 7f6af3fff640 1 -- 172.21.15.60:0/1600444285 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6afc01a070 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.715+0000 7f6af3fff640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6af806be30 0x7f6af806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:43:59.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.715+0000 7f6af3fff640 1 -- 172.21.15.60:0/1600444285 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f6afc08a2c0 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.715+0000 7f6b0affd640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6af806be30 0x7f6af806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:43:59.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.715+0000 7f6b0affd640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6af806be30 0x7f6af806e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009560 tx=0x7f6b00009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:43:59.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.719+0000 7f6af3fff640 1 -- 172.21.15.60:0/1600444285 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6afc058590 con 0x7f6b0c0b63d0 2024-09-12T01:43:59.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.892+0000 7f6b11f49640 1 -- 172.21.15.60:0/1600444285 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b0c0ba660 con 0x7f6af806be30 2024-09-12T01:43:59.897 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.898+0000 7f6af3fff640 1 -- 172.21.15.60:0/1600444285 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252481 (secure 0 0 0) 0x7f6b0c0ba660 con 0x7f6af806be30 2024-09-12T01:43:59.900 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:43:59.901 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:43:59.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.901+0000 7f6b11f49640 1 -- 172.21.15.60:0/1600444285 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6af806be30 msgr2=0x7f6af806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:59.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.901+0000 7f6b11f49640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6af806be30 0x7f6af806e2f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6b00009560 tx=0x7f6b00009190 comp rx=0 tx=0).stop 2024-09-12T01:43:59.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.901+0000 7f6b11f49640 1 -- 172.21.15.60:0/1600444285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b0c0b63d0 msgr2=0x7f6b0c160ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:43:59.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.901+0000 7f6b11f49640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b0c0b63d0 0x7f6b0c160ba0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00c430 tx=0x7f6afc00c8f0 comp rx=0 tx=0).stop 2024-09-12T01:43:59.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.901+0000 7f6b11f49640 1 -- 172.21.15.60:0/1600444285 shutdown_connections 2024-09-12T01:43:59.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.901+0000 7f6b11f49640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6af806be30 0x7f6af806e2f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:59.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.901+0000 7f6b11f49640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b0c162f30 0x7f6b0c0cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:59.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.901+0000 7f6b11f49640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b0c0cf6b0 0x7f6b0c1e9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:59.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.901+0000 7f6b11f49640 1 --2- 172.21.15.60:0/1600444285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b0c0b63d0 0x7f6b0c160ba0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:43:59.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.901+0000 7f6b11f49640 1 -- 172.21.15.60:0/1600444285 >> 172.21.15.60:0/1600444285 conn(0x7f6b0c0d1160 msgr2=0x7f6b0c0b7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:43:59.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.901+0000 7f6b11f49640 1 -- 172.21.15.60:0/1600444285 shutdown_connections 2024-09-12T01:43:59.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:43:59.901+0000 7f6b11f49640 1 -- 172.21.15.60:0/1600444285 wait complete. 2024-09-12T01:43:59.911 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2024-09-12T01:43:58.368270+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284040,"kb_used_data":13692,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754690680,"statfs":{"total":773094113280,"available":772803256320,"internally_reserved":0,"allocated":14020608,"data_stored":6648568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.196006"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469273+0000","last_change":"2024-09-12T01:43:52.205904+0000","last_active":"2024-09-12T01:43:53.469273+0000","last_peered":"2024-09-12T01:43:53.469273+0000","last_clean":"2024-09-12T01:43:53.469273+0000","last_became_active":"2024-09-12T01:43:52.205590+0000","last_became_peered":"2024-09-12T01:43:52.205590+0000","last_unstale":"2024-09-12T01:43:53.469273+0000","last_undegraded":"2024-09-12T01:43:53.469273+0000","last_fullsized":"2024-09-12T01:43:53.469273+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:36.879938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468929+0000","last_change":"2024-09-12T01:43:52.201692+0000","last_active":"2024-09-12T01:43:53.468929+0000","last_peered":"2024-09-12T01:43:53.468929+0000","last_clean":"2024-09-12T01:43:53.468929+0000","last_became_active":"2024-09-12T01:43:52.201388+0000","last_became_peered":"2024-09-12T01:43:52.201388+0000","last_unstale":"2024-09-12T01:43:53.468929+0000","last_undegraded":"2024-09-12T01:43:53.468929+0000","last_fullsized":"2024-09-12T01:43:53.468929+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:43.942344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468523+0000","last_change":"2024-09-12T01:43:52.193027+0000","last_active":"2024-09-12T01:43:53.468523+0000","last_peered":"2024-09-12T01:43:53.468523+0000","last_clean":"2024-09-12T01:43:53.468523+0000","last_became_active":"2024-09-12T01:43:52.192753+0000","last_became_peered":"2024-09-12T01:43:52.192753+0000","last_unstale":"2024-09-12T01:43:53.468523+0000","last_undegraded":"2024-09-12T01:43:53.468523+0000","last_fullsized":"2024-09-12T01:43:53.468523+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:49.693010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190740+0000","last_change":"2024-09-12T01:43:52.193179+0000","last_active":"2024-09-12T01:43:53.190740+0000","last_peered":"2024-09-12T01:43:53.190740+0000","last_clean":"2024-09-12T01:43:53.190740+0000","last_became_active":"2024-09-12T01:43:52.192841+0000","last_became_peered":"2024-09-12T01:43:52.192841+0000","last_unstale":"2024-09-12T01:43:53.190740+0000","last_undegraded":"2024-09-12T01:43:53.190740+0000","last_fullsized":"2024-09-12T01:43:53.190740+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:21.106681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191416+0000","last_change":"2024-09-12T01:43:52.193313+0000","last_active":"2024-09-12T01:43:53.191416+0000","last_peered":"2024-09-12T01:43:53.191416+0000","last_clean":"2024-09-12T01:43:53.191416+0000","last_became_active":"2024-09-12T01:43:52.192502+0000","last_became_peered":"2024-09-12T01:43:52.192502+0000","last_unstale":"2024-09-12T01:43:53.191416+0000","last_undegraded":"2024-09-12T01:43:53.191416+0000","last_fullsized":"2024-09-12T01:43:53.191416+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:27.278736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468274+0000","last_change":"2024-09-12T01:43:52.200446+0000","last_active":"2024-09-12T01:43:53.468274+0000","last_peered":"2024-09-12T01:43:53.468274+0000","last_clean":"2024-09-12T01:43:53.468274+0000","last_became_active":"2024-09-12T01:43:52.200161+0000","last_became_peered":"2024-09-12T01:43:52.200161+0000","last_unstale":"2024-09-12T01:43:53.468274+0000","last_undegraded":"2024-09-12T01:43:53.468274+0000","last_fullsized":"2024-09-12T01:43:53.468274+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:51.407008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190918+0000","last_change":"2024-09-12T01:43:52.188175+0000","last_active":"2024-09-12T01:43:53.190918+0000","last_peered":"2024-09-12T01:43:53.190918+0000","last_clean":"2024-09-12T01:43:53.190918+0000","last_became_active":"2024-09-12T01:43:52.187895+0000","last_became_peered":"2024-09-12T01:43:52.187895+0000","last_unstale":"2024-09-12T01:43:53.190918+0000","last_undegraded":"2024-09-12T01:43:53.190918+0000","last_fullsized":"2024-09-12T01:43:53.190918+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:16.325979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468212+0000","last_change":"2024-09-12T01:43:52.198813+0000","last_active":"2024-09-12T01:43:53.468212+0000","last_peered":"2024-09-12T01:43:53.468212+0000","last_clean":"2024-09-12T01:43:53.468212+0000","last_became_active":"2024-09-12T01:43:52.198506+0000","last_became_peered":"2024-09-12T01:43:52.198506+0000","last_unstale":"2024-09-12T01:43:53.468212+0000","last_undegraded":"2024-09-12T01:43:53.468212+0000","last_fullsized":"2024-09-12T01:43:53.468212+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:21:45.961688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469113+0000","last_change":"2024-09-12T01:43:52.193001+0000","last_active":"2024-09-12T01:43:53.469113+0000","last_peered":"2024-09-12T01:43:53.469113+0000","last_clean":"2024-09-12T01:43:53.469113+0000","last_became_active":"2024-09-12T01:43:52.192621+0000","last_became_peered":"2024-09-12T01:43:52.192621+0000","last_unstale":"2024-09-12T01:43:53.469113+0000","last_undegraded":"2024-09-12T01:43:53.469113+0000","last_fullsized":"2024-09-12T01:43:53.469113+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:12:24.880152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468637+0000","last_change":"2024-09-12T01:43:52.200452+0000","last_active":"2024-09-12T01:43:53.468637+0000","last_peered":"2024-09-12T01:43:53.468637+0000","last_clean":"2024-09-12T01:43:53.468637+0000","last_became_active":"2024-09-12T01:43:52.200112+0000","last_became_peered":"2024-09-12T01:43:52.200112+0000","last_unstale":"2024-09-12T01:43:53.468637+0000","last_undegraded":"2024-09-12T01:43:53.468637+0000","last_fullsized":"2024-09-12T01:43:53.468637+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:44.609828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468711+0000","last_change":"2024-09-12T01:43:52.200296+0000","last_active":"2024-09-12T01:43:53.468711+0000","last_peered":"2024-09-12T01:43:53.468711+0000","last_clean":"2024-09-12T01:43:53.468711+0000","last_became_active":"2024-09-12T01:43:52.199959+0000","last_became_peered":"2024-09-12T01:43:52.199959+0000","last_unstale":"2024-09-12T01:43:53.468711+0000","last_undegraded":"2024-09-12T01:43:53.468711+0000","last_fullsized":"2024-09-12T01:43:53.468711+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:50.411996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224219+0000","last_change":"2024-09-12T01:43:52.195533+0000","last_active":"2024-09-12T01:43:53.224219+0000","last_peered":"2024-09-12T01:43:53.224219+0000","last_clean":"2024-09-12T01:43:53.224219+0000","last_became_active":"2024-09-12T01:43:52.195217+0000","last_became_peered":"2024-09-12T01:43:52.195217+0000","last_unstale":"2024-09-12T01:43:53.224219+0000","last_undegraded":"2024-09-12T01:43:53.224219+0000","last_fullsized":"2024-09-12T01:43:53.224219+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:51.407008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191557+0000","last_change":"2024-09-12T01:43:52.187289+0000","last_active":"2024-09-12T01:43:53.191557+0000","last_peered":"2024-09-12T01:43:53.191557+0000","last_clean":"2024-09-12T01:43:53.191557+0000","last_became_active":"2024-09-12T01:43:52.187014+0000","last_became_peered":"2024-09-12T01:43:52.187014+0000","last_unstale":"2024-09-12T01:43:53.191557+0000","last_undegraded":"2024-09-12T01:43:53.191557+0000","last_fullsized":"2024-09-12T01:43:53.191557+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:56.757793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.223989+0000","last_change":"2024-09-12T01:43:52.202020+0000","last_active":"2024-09-12T01:43:53.223989+0000","last_peered":"2024-09-12T01:43:53.223989+0000","last_clean":"2024-09-12T01:43:53.223989+0000","last_became_active":"2024-09-12T01:43:52.201750+0000","last_became_peered":"2024-09-12T01:43:52.201750+0000","last_unstale":"2024-09-12T01:43:53.223989+0000","last_undegraded":"2024-09-12T01:43:53.223989+0000","last_fullsized":"2024-09-12T01:43:53.223989+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:21.106681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191227+0000","last_change":"2024-09-12T01:43:52.195468+0000","last_active":"2024-09-12T01:43:53.191227+0000","last_peered":"2024-09-12T01:43:53.191227+0000","last_clean":"2024-09-12T01:43:53.191227+0000","last_became_active":"2024-09-12T01:43:52.193578+0000","last_became_peered":"2024-09-12T01:43:52.193578+0000","last_unstale":"2024-09-12T01:43:53.191227+0000","last_undegraded":"2024-09-12T01:43:53.191227+0000","last_fullsized":"2024-09-12T01:43:53.191227+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:55.075294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190769+0000","last_change":"2024-09-12T01:43:52.192049+0000","last_active":"2024-09-12T01:43:53.190769+0000","last_peered":"2024-09-12T01:43:53.190769+0000","last_clean":"2024-09-12T01:43:53.190769+0000","last_became_active":"2024-09-12T01:43:52.191778+0000","last_became_peered":"2024-09-12T01:43:52.191778+0000","last_unstale":"2024-09-12T01:43:53.190769+0000","last_undegraded":"2024-09-12T01:43:53.190769+0000","last_fullsized":"2024-09-12T01:43:53.190769+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:31.699406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468613+0000","last_change":"2024-09-12T01:43:52.206344+0000","last_active":"2024-09-12T01:43:53.468613+0000","last_peered":"2024-09-12T01:43:53.468613+0000","last_clean":"2024-09-12T01:43:53.468613+0000","last_became_active":"2024-09-12T01:43:52.206048+0000","last_became_peered":"2024-09-12T01:43:52.206048+0000","last_unstale":"2024-09-12T01:43:53.468613+0000","last_undegraded":"2024-09-12T01:43:53.468613+0000","last_fullsized":"2024-09-12T01:43:53.468613+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:58.449646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191490+0000","last_change":"2024-09-12T01:43:52.193017+0000","last_active":"2024-09-12T01:43:53.191490+0000","last_peered":"2024-09-12T01:43:53.191490+0000","last_clean":"2024-09-12T01:43:53.191490+0000","last_became_active":"2024-09-12T01:43:52.192561+0000","last_became_peered":"2024-09-12T01:43:52.192561+0000","last_unstale":"2024-09-12T01:43:53.191490+0000","last_undegraded":"2024-09-12T01:43:53.191490+0000","last_fullsized":"2024-09-12T01:43:53.191490+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:09.763619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468875+0000","last_change":"2024-09-12T01:43:52.195966+0000","last_active":"2024-09-12T01:43:53.468875+0000","last_peered":"2024-09-12T01:43:53.468875+0000","last_clean":"2024-09-12T01:43:53.468875+0000","last_became_active":"2024-09-12T01:43:52.195660+0000","last_became_peered":"2024-09-12T01:43:52.195660+0000","last_unstale":"2024-09-12T01:43:53.468875+0000","last_undegraded":"2024-09-12T01:43:53.468875+0000","last_fullsized":"2024-09-12T01:43:53.468875+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:43.683128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469190+0000","last_change":"2024-09-12T01:43:52.196199+0000","last_active":"2024-09-12T01:43:53.469190+0000","last_peered":"2024-09-12T01:43:53.469190+0000","last_clean":"2024-09-12T01:43:53.469190+0000","last_became_active":"2024-09-12T01:43:52.195361+0000","last_became_peered":"2024-09-12T01:43:52.195361+0000","last_unstale":"2024-09-12T01:43:53.469190+0000","last_undegraded":"2024-09-12T01:43:53.469190+0000","last_fullsized":"2024-09-12T01:43:53.469190+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:34.000665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468369+0000","last_change":"2024-09-12T01:43:52.194162+0000","last_active":"2024-09-12T01:43:53.468369+0000","last_peered":"2024-09-12T01:43:53.468369+0000","last_clean":"2024-09-12T01:43:53.468369+0000","last_became_active":"2024-09-12T01:43:52.193840+0000","last_became_peered":"2024-09-12T01:43:52.193840+0000","last_unstale":"2024-09-12T01:43:53.468369+0000","last_undegraded":"2024-09-12T01:43:53.468369+0000","last_fullsized":"2024-09-12T01:43:53.468369+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:33.385560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224010+0000","last_change":"2024-09-12T01:43:52.195295+0000","last_active":"2024-09-12T01:43:53.224010+0000","last_peered":"2024-09-12T01:43:53.224010+0000","last_clean":"2024-09-12T01:43:53.224010+0000","last_became_active":"2024-09-12T01:43:52.194777+0000","last_became_peered":"2024-09-12T01:43:52.194777+0000","last_unstale":"2024-09-12T01:43:53.224010+0000","last_undegraded":"2024-09-12T01:43:53.224010+0000","last_fullsized":"2024-09-12T01:43:53.224010+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:36.754460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190157+0000","last_change":"2024-09-12T01:43:52.194639+0000","last_active":"2024-09-12T01:43:53.190157+0000","last_peered":"2024-09-12T01:43:53.190157+0000","last_clean":"2024-09-12T01:43:53.190157+0000","last_became_active":"2024-09-12T01:43:52.194286+0000","last_became_peered":"2024-09-12T01:43:52.194286+0000","last_unstale":"2024-09-12T01:43:53.190157+0000","last_undegraded":"2024-09-12T01:43:53.190157+0000","last_fullsized":"2024-09-12T01:43:53.190157+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:32.911591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190979+0000","last_change":"2024-09-12T01:43:52.193333+0000","last_active":"2024-09-12T01:43:53.190979+0000","last_peered":"2024-09-12T01:43:53.190979+0000","last_clean":"2024-09-12T01:43:53.190979+0000","last_became_active":"2024-09-12T01:43:52.193052+0000","last_became_peered":"2024-09-12T01:43:52.193052+0000","last_unstale":"2024-09-12T01:43:53.190979+0000","last_undegraded":"2024-09-12T01:43:53.190979+0000","last_fullsized":"2024-09-12T01:43:53.190979+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:52.420676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468987+0000","last_change":"2024-09-12T01:43:52.195808+0000","last_active":"2024-09-12T01:43:53.468987+0000","last_peered":"2024-09-12T01:43:53.468987+0000","last_clean":"2024-09-12T01:43:53.468987+0000","last_became_active":"2024-09-12T01:43:52.195508+0000","last_became_peered":"2024-09-12T01:43:52.195508+0000","last_unstale":"2024-09-12T01:43:53.468987+0000","last_undegraded":"2024-09-12T01:43:53.468987+0000","last_fullsized":"2024-09-12T01:43:53.468987+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:21.126045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469385+0000","last_change":"2024-09-12T01:43:52.201745+0000","last_active":"2024-09-12T01:43:53.469385+0000","last_peered":"2024-09-12T01:43:53.469385+0000","last_clean":"2024-09-12T01:43:53.469385+0000","last_became_active":"2024-09-12T01:43:52.201464+0000","last_became_peered":"2024-09-12T01:43:52.201464+0000","last_unstale":"2024-09-12T01:43:53.469385+0000","last_undegraded":"2024-09-12T01:43:53.469385+0000","last_fullsized":"2024-09-12T01:43:53.469385+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:33.755285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469017+0000","last_change":"2024-09-12T01:43:52.195819+0000","last_active":"2024-09-12T01:43:53.469017+0000","last_peered":"2024-09-12T01:43:53.469017+0000","last_clean":"2024-09-12T01:43:53.469017+0000","last_became_active":"2024-09-12T01:43:52.195522+0000","last_became_peered":"2024-09-12T01:43:52.195522+0000","last_unstale":"2024-09-12T01:43:53.469017+0000","last_undegraded":"2024-09-12T01:43:53.469017+0000","last_fullsized":"2024-09-12T01:43:53.469017+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:21.891202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469018+0000","last_change":"2024-09-12T01:43:52.201114+0000","last_active":"2024-09-12T01:43:53.469018+0000","last_peered":"2024-09-12T01:43:53.469018+0000","last_clean":"2024-09-12T01:43:53.469018+0000","last_became_active":"2024-09-12T01:43:52.200804+0000","last_became_peered":"2024-09-12T01:43:52.200804+0000","last_unstale":"2024-09-12T01:43:53.469018+0000","last_undegraded":"2024-09-12T01:43:53.469018+0000","last_fullsized":"2024-09-12T01:43:53.469018+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:30.441047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468196+0000","last_change":"2024-09-12T01:43:52.202554+0000","last_active":"2024-09-12T01:43:53.468196+0000","last_peered":"2024-09-12T01:43:53.468196+0000","last_clean":"2024-09-12T01:43:53.468196+0000","last_became_active":"2024-09-12T01:43:52.202293+0000","last_became_peered":"2024-09-12T01:43:52.202293+0000","last_unstale":"2024-09-12T01:43:53.468196+0000","last_undegraded":"2024-09-12T01:43:53.468196+0000","last_fullsized":"2024-09-12T01:43:53.468196+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:20.285338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224150+0000","last_change":"2024-09-12T01:43:52.195057+0000","last_active":"2024-09-12T01:43:53.224150+0000","last_peered":"2024-09-12T01:43:53.224150+0000","last_clean":"2024-09-12T01:43:53.224150+0000","last_became_active":"2024-09-12T01:43:52.194404+0000","last_became_peered":"2024-09-12T01:43:52.194404+0000","last_unstale":"2024-09-12T01:43:53.224150+0000","last_undegraded":"2024-09-12T01:43:53.224150+0000","last_fullsized":"2024-09-12T01:43:53.224150+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:16.325979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468897+0000","last_change":"2024-09-12T01:43:52.201335+0000","last_active":"2024-09-12T01:43:53.468897+0000","last_peered":"2024-09-12T01:43:53.468897+0000","last_clean":"2024-09-12T01:43:53.468897+0000","last_became_active":"2024-09-12T01:43:52.201057+0000","last_became_peered":"2024-09-12T01:43:52.201057+0000","last_unstale":"2024-09-12T01:43:53.468897+0000","last_undegraded":"2024-09-12T01:43:53.468897+0000","last_fullsized":"2024-09-12T01:43:53.468897+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:00.386031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468700+0000","last_change":"2024-09-12T01:43:52.198245+0000","last_active":"2024-09-12T01:43:53.468700+0000","last_peered":"2024-09-12T01:43:53.468700+0000","last_clean":"2024-09-12T01:43:53.468700+0000","last_became_active":"2024-09-12T01:43:52.197965+0000","last_became_peered":"2024-09-12T01:43:52.197965+0000","last_unstale":"2024-09-12T01:43:53.468700+0000","last_undegraded":"2024-09-12T01:43:53.468700+0000","last_fullsized":"2024-09-12T01:43:53.468700+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:10.874112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191660+0000","last_change":"2024-09-12T01:43:52.193225+0000","last_active":"2024-09-12T01:43:53.191660+0000","last_peered":"2024-09-12T01:43:53.191660+0000","last_clean":"2024-09-12T01:43:53.191660+0000","last_became_active":"2024-09-12T01:43:52.192922+0000","last_became_peered":"2024-09-12T01:43:52.192922+0000","last_unstale":"2024-09-12T01:43:53.191660+0000","last_undegraded":"2024-09-12T01:43:53.191660+0000","last_fullsized":"2024-09-12T01:43:53.191660+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:01.614660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"127'4","reported_seq":18,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468622+0000","last_change":"2024-09-12T01:43:51.187236+0000","last_active":"2024-09-12T01:43:53.468622+0000","last_peered":"2024-09-12T01:43:53.468622+0000","last_clean":"2024-09-12T01:43:53.468622+0000","last_became_active":"2024-09-12T01:43:51.186924+0000","last_became_peered":"2024-09-12T01:43:51.186924+0000","last_unstale":"2024-09-12T01:43:53.468622+0000","last_undegraded":"2024-09-12T01:43:53.468622+0000","last_fullsized":"2024-09-12T01:43:53.468622+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:20.501407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191186+0000","last_change":"2024-09-12T01:43:52.195939+0000","last_active":"2024-09-12T01:43:53.191186+0000","last_peered":"2024-09-12T01:43:53.191186+0000","last_clean":"2024-09-12T01:43:53.191186+0000","last_became_active":"2024-09-12T01:43:52.195660+0000","last_became_peered":"2024-09-12T01:43:52.195660+0000","last_unstale":"2024-09-12T01:43:53.191186+0000","last_undegraded":"2024-09-12T01:43:53.191186+0000","last_fullsized":"2024-09-12T01:43:53.191186+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:50.411996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469235+0000","last_change":"2024-09-12T01:43:51.181726+0000","last_active":"2024-09-12T01:43:53.469235+0000","last_peered":"2024-09-12T01:43:53.469235+0000","last_clean":"2024-09-12T01:43:53.469235+0000","last_became_active":"2024-09-12T01:43:51.181468+0000","last_became_peered":"2024-09-12T01:43:51.181468+0000","last_unstale":"2024-09-12T01:43:53.469235+0000","last_undegraded":"2024-09-12T01:43:53.469235+0000","last_fullsized":"2024-09-12T01:43:53.469235+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:50.503490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468387+0000","last_change":"2024-09-12T01:43:52.197401+0000","last_active":"2024-09-12T01:43:53.468387+0000","last_peered":"2024-09-12T01:43:53.468387+0000","last_clean":"2024-09-12T01:43:53.468387+0000","last_became_active":"2024-09-12T01:43:52.197049+0000","last_became_peered":"2024-09-12T01:43:52.197049+0000","last_unstale":"2024-09-12T01:43:53.468387+0000","last_undegraded":"2024-09-12T01:43:53.468387+0000","last_fullsized":"2024-09-12T01:43:53.468387+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:15.660651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468429+0000","last_change":"2024-09-12T01:43:51.186816+0000","last_active":"2024-09-12T01:43:53.468429+0000","last_peered":"2024-09-12T01:43:53.468429+0000","last_clean":"2024-09-12T01:43:53.468429+0000","last_became_active":"2024-09-12T01:43:51.186543+0000","last_became_peered":"2024-09-12T01:43:51.186543+0000","last_unstale":"2024-09-12T01:43:53.468429+0000","last_undegraded":"2024-09-12T01:43:53.468429+0000","last_fullsized":"2024-09-12T01:43:53.468429+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:58.527833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190622+0000","last_change":"2024-09-12T01:43:52.203501+0000","last_active":"2024-09-12T01:43:53.190622+0000","last_peered":"2024-09-12T01:43:53.190622+0000","last_clean":"2024-09-12T01:43:53.190622+0000","last_became_active":"2024-09-12T01:43:52.203193+0000","last_became_peered":"2024-09-12T01:43:52.203193+0000","last_unstale":"2024-09-12T01:43:53.190622+0000","last_undegraded":"2024-09-12T01:43:53.190622+0000","last_fullsized":"2024-09-12T01:43:53.190622+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:42.811450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468343+0000","last_change":"2024-09-12T01:43:51.185369+0000","last_active":"2024-09-12T01:43:53.468343+0000","last_peered":"2024-09-12T01:43:53.468343+0000","last_clean":"2024-09-12T01:43:53.468343+0000","last_became_active":"2024-09-12T01:43:51.184977+0000","last_became_peered":"2024-09-12T01:43:51.184977+0000","last_unstale":"2024-09-12T01:43:53.468343+0000","last_undegraded":"2024-09-12T01:43:53.468343+0000","last_fullsized":"2024-09-12T01:43:53.468343+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:15.702918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468713+0000","last_change":"2024-09-12T01:43:52.206045+0000","last_active":"2024-09-12T01:43:53.468713+0000","last_peered":"2024-09-12T01:43:53.468713+0000","last_clean":"2024-09-12T01:43:53.468713+0000","last_became_active":"2024-09-12T01:43:52.205626+0000","last_became_peered":"2024-09-12T01:43:52.205626+0000","last_unstale":"2024-09-12T01:43:53.468713+0000","last_undegraded":"2024-09-12T01:43:53.468713+0000","last_fullsized":"2024-09-12T01:43:53.468713+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:50.501162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468306+0000","last_change":"2024-09-12T01:43:51.190466+0000","last_active":"2024-09-12T01:43:53.468306+0000","last_peered":"2024-09-12T01:43:53.468306+0000","last_clean":"2024-09-12T01:43:53.468306+0000","last_became_active":"2024-09-12T01:43:51.190282+0000","last_became_peered":"2024-09-12T01:43:51.190282+0000","last_unstale":"2024-09-12T01:43:53.468306+0000","last_undegraded":"2024-09-12T01:43:53.468306+0000","last_fullsized":"2024-09-12T01:43:53.468306+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:14.257545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190579+0000","last_change":"2024-09-12T01:43:52.202902+0000","last_active":"2024-09-12T01:43:53.190579+0000","last_peered":"2024-09-12T01:43:53.190579+0000","last_clean":"2024-09-12T01:43:53.190579+0000","last_became_active":"2024-09-12T01:43:52.202575+0000","last_became_peered":"2024-09-12T01:43:52.202575+0000","last_unstale":"2024-09-12T01:43:53.190579+0000","last_undegraded":"2024-09-12T01:43:53.190579+0000","last_fullsized":"2024-09-12T01:43:53.190579+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:02.648528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191020+0000","last_change":"2024-09-12T01:43:51.189540+0000","last_active":"2024-09-12T01:43:53.191020+0000","last_peered":"2024-09-12T01:43:53.191020+0000","last_clean":"2024-09-12T01:43:53.191020+0000","last_became_active":"2024-09-12T01:43:51.189008+0000","last_became_peered":"2024-09-12T01:43:51.189008+0000","last_unstale":"2024-09-12T01:43:53.191020+0000","last_undegraded":"2024-09-12T01:43:53.191020+0000","last_fullsized":"2024-09-12T01:43:53.191020+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:11.666490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468883+0000","last_change":"2024-09-12T01:43:52.199216+0000","last_active":"2024-09-12T01:43:53.468883+0000","last_peered":"2024-09-12T01:43:53.468883+0000","last_clean":"2024-09-12T01:43:53.468883+0000","last_became_active":"2024-09-12T01:43:52.198828+0000","last_became_peered":"2024-09-12T01:43:52.198828+0000","last_unstale":"2024-09-12T01:43:53.468883+0000","last_undegraded":"2024-09-12T01:43:53.468883+0000","last_fullsized":"2024-09-12T01:43:53.468883+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:44.789589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468501+0000","last_change":"2024-09-12T01:43:51.181780+0000","last_active":"2024-09-12T01:43:53.468501+0000","last_peered":"2024-09-12T01:43:53.468501+0000","last_clean":"2024-09-12T01:43:53.468501+0000","last_became_active":"2024-09-12T01:43:51.180919+0000","last_became_peered":"2024-09-12T01:43:51.180919+0000","last_unstale":"2024-09-12T01:43:53.468501+0000","last_undegraded":"2024-09-12T01:43:53.468501+0000","last_fullsized":"2024-09-12T01:43:53.468501+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:01.643317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190287+0000","last_change":"2024-09-12T01:43:52.196135+0000","last_active":"2024-09-12T01:43:53.190287+0000","last_peered":"2024-09-12T01:43:53.190287+0000","last_clean":"2024-09-12T01:43:53.190287+0000","last_became_active":"2024-09-12T01:43:52.195858+0000","last_became_peered":"2024-09-12T01:43:52.195858+0000","last_unstale":"2024-09-12T01:43:53.190287+0000","last_undegraded":"2024-09-12T01:43:53.190287+0000","last_fullsized":"2024-09-12T01:43:53.190287+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:29.055940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468146+0000","last_change":"2024-09-12T01:43:51.193832+0000","last_active":"2024-09-12T01:43:53.468146+0000","last_peered":"2024-09-12T01:43:53.468146+0000","last_clean":"2024-09-12T01:43:53.468146+0000","last_became_active":"2024-09-12T01:43:51.193464+0000","last_became_peered":"2024-09-12T01:43:51.193464+0000","last_unstale":"2024-09-12T01:43:53.468146+0000","last_undegraded":"2024-09-12T01:43:53.468146+0000","last_fullsized":"2024-09-12T01:43:53.468146+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:34.704740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190965+0000","last_change":"2024-09-12T01:43:52.197193+0000","last_active":"2024-09-12T01:43:53.190965+0000","last_peered":"2024-09-12T01:43:53.190965+0000","last_clean":"2024-09-12T01:43:53.190965+0000","last_became_active":"2024-09-12T01:43:52.196904+0000","last_became_peered":"2024-09-12T01:43:52.196904+0000","last_unstale":"2024-09-12T01:43:53.190965+0000","last_undegraded":"2024-09-12T01:43:53.190965+0000","last_fullsized":"2024-09-12T01:43:53.190965+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:31.699406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469211+0000","last_change":"2024-09-12T01:43:51.186656+0000","last_active":"2024-09-12T01:43:53.469211+0000","last_peered":"2024-09-12T01:43:53.469211+0000","last_clean":"2024-09-12T01:43:53.469211+0000","last_became_active":"2024-09-12T01:43:51.186355+0000","last_became_peered":"2024-09-12T01:43:51.186355+0000","last_unstale":"2024-09-12T01:43:53.469211+0000","last_undegraded":"2024-09-12T01:43:53.469211+0000","last_fullsized":"2024-09-12T01:43:53.469211+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:33.642012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224143+0000","last_change":"2024-09-12T01:43:52.197313+0000","last_active":"2024-09-12T01:43:53.224143+0000","last_peered":"2024-09-12T01:43:53.224143+0000","last_clean":"2024-09-12T01:43:53.224143+0000","last_became_active":"2024-09-12T01:43:52.197035+0000","last_became_peered":"2024-09-12T01:43:52.197035+0000","last_unstale":"2024-09-12T01:43:53.224143+0000","last_undegraded":"2024-09-12T01:43:53.224143+0000","last_fullsized":"2024-09-12T01:43:53.224143+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:31.699406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191702+0000","last_change":"2024-09-12T01:43:51.187892+0000","last_active":"2024-09-12T01:43:53.191702+0000","last_peered":"2024-09-12T01:43:53.191702+0000","last_clean":"2024-09-12T01:43:53.191702+0000","last_became_active":"2024-09-12T01:43:51.187452+0000","last_became_peered":"2024-09-12T01:43:51.187452+0000","last_unstale":"2024-09-12T01:43:53.191702+0000","last_undegraded":"2024-09-12T01:43:53.191702+0000","last_fullsized":"2024-09-12T01:43:53.191702+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:50.905828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191171+0000","last_change":"2024-09-12T01:43:52.193823+0000","last_active":"2024-09-12T01:43:53.191171+0000","last_peered":"2024-09-12T01:43:53.191171+0000","last_clean":"2024-09-12T01:43:53.191171+0000","last_became_active":"2024-09-12T01:43:52.193454+0000","last_became_peered":"2024-09-12T01:43:52.193454+0000","last_unstale":"2024-09-12T01:43:53.191171+0000","last_undegraded":"2024-09-12T01:43:53.191171+0000","last_fullsized":"2024-09-12T01:43:53.191171+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:15.660651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"127'6","reported_seq":20,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190903+0000","last_change":"2024-09-12T01:43:51.187614+0000","last_active":"2024-09-12T01:43:53.190903+0000","last_peered":"2024-09-12T01:43:53.190903+0000","last_clean":"2024-09-12T01:43:53.190903+0000","last_became_active":"2024-09-12T01:43:51.187345+0000","last_became_peered":"2024-09-12T01:43:51.187345+0000","last_unstale":"2024-09-12T01:43:53.190903+0000","last_undegraded":"2024-09-12T01:43:53.190903+0000","last_fullsized":"2024-09-12T01:43:53.190903+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:28.050729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190462+0000","last_change":"2024-09-12T01:43:52.198116+0000","last_active":"2024-09-12T01:43:53.190462+0000","last_peered":"2024-09-12T01:43:53.190462+0000","last_clean":"2024-09-12T01:43:53.190462+0000","last_became_active":"2024-09-12T01:43:52.197852+0000","last_became_peered":"2024-09-12T01:43:52.197852+0000","last_unstale":"2024-09-12T01:43:53.190462+0000","last_undegraded":"2024-09-12T01:43:53.190462+0000","last_fullsized":"2024-09-12T01:43:53.190462+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:51.508700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468423+0000","last_change":"2024-09-12T01:43:51.185009+0000","last_active":"2024-09-12T01:43:53.468423+0000","last_peered":"2024-09-12T01:43:53.468423+0000","last_clean":"2024-09-12T01:43:53.468423+0000","last_became_active":"2024-09-12T01:43:51.184624+0000","last_became_peered":"2024-09-12T01:43:51.184624+0000","last_unstale":"2024-09-12T01:43:53.468423+0000","last_undegraded":"2024-09-12T01:43:53.468423+0000","last_fullsized":"2024-09-12T01:43:53.468423+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:07.724259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469172+0000","last_change":"2024-09-12T01:43:52.202539+0000","last_active":"2024-09-12T01:43:53.469172+0000","last_peered":"2024-09-12T01:43:53.469172+0000","last_clean":"2024-09-12T01:43:53.469172+0000","last_became_active":"2024-09-12T01:43:52.201815+0000","last_became_peered":"2024-09-12T01:43:52.201815+0000","last_unstale":"2024-09-12T01:43:53.469172+0000","last_undegraded":"2024-09-12T01:43:53.469172+0000","last_fullsized":"2024-09-12T01:43:53.469172+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:26.323760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224209+0000","last_change":"2024-09-12T01:43:51.184292+0000","last_active":"2024-09-12T01:43:53.224209+0000","last_peered":"2024-09-12T01:43:53.224209+0000","last_clean":"2024-09-12T01:43:53.224209+0000","last_became_active":"2024-09-12T01:43:51.183758+0000","last_became_peered":"2024-09-12T01:43:51.183758+0000","last_unstale":"2024-09-12T01:43:53.224209+0000","last_undegraded":"2024-09-12T01:43:53.224209+0000","last_fullsized":"2024-09-12T01:43:53.224209+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:13.828776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190070+0000","last_change":"2024-09-12T01:43:52.197655+0000","last_active":"2024-09-12T01:43:53.190070+0000","last_peered":"2024-09-12T01:43:53.190070+0000","last_clean":"2024-09-12T01:43:53.190070+0000","last_became_active":"2024-09-12T01:43:52.193411+0000","last_became_peered":"2024-09-12T01:43:52.193411+0000","last_unstale":"2024-09-12T01:43:53.190070+0000","last_undegraded":"2024-09-12T01:43:53.190070+0000","last_fullsized":"2024-09-12T01:43:53.190070+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:52.956773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468562+0000","last_change":"2024-09-12T01:43:51.184775+0000","last_active":"2024-09-12T01:43:53.468562+0000","last_peered":"2024-09-12T01:43:53.468562+0000","last_clean":"2024-09-12T01:43:53.468562+0000","last_became_active":"2024-09-12T01:43:51.184498+0000","last_became_peered":"2024-09-12T01:43:51.184498+0000","last_unstale":"2024-09-12T01:43:53.468562+0000","last_undegraded":"2024-09-12T01:43:53.468562+0000","last_fullsized":"2024-09-12T01:43:53.468562+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:41.424399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190418+0000","last_change":"2024-09-12T01:43:52.201499+0000","last_active":"2024-09-12T01:43:53.190418+0000","last_peered":"2024-09-12T01:43:53.190418+0000","last_clean":"2024-09-12T01:43:53.190418+0000","last_became_active":"2024-09-12T01:43:52.193900+0000","last_became_peered":"2024-09-12T01:43:52.193900+0000","last_unstale":"2024-09-12T01:43:53.190418+0000","last_undegraded":"2024-09-12T01:43:53.190418+0000","last_fullsized":"2024-09-12T01:43:53.190418+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:52.200358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"127'8","reported_seq":22,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468380+0000","last_change":"2024-09-12T01:43:51.180654+0000","last_active":"2024-09-12T01:43:53.468380+0000","last_peered":"2024-09-12T01:43:53.468380+0000","last_clean":"2024-09-12T01:43:53.468380+0000","last_became_active":"2024-09-12T01:43:51.180405+0000","last_became_peered":"2024-09-12T01:43:51.180405+0000","last_unstale":"2024-09-12T01:43:53.468380+0000","last_undegraded":"2024-09-12T01:43:53.468380+0000","last_fullsized":"2024-09-12T01:43:53.468380+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:07.597910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191658+0000","last_change":"2024-09-12T01:43:52.199512+0000","last_active":"2024-09-12T01:43:53.191658+0000","last_peered":"2024-09-12T01:43:53.191658+0000","last_clean":"2024-09-12T01:43:53.191658+0000","last_became_active":"2024-09-12T01:43:52.199143+0000","last_became_peered":"2024-09-12T01:43:52.199143+0000","last_unstale":"2024-09-12T01:43:53.191658+0000","last_undegraded":"2024-09-12T01:43:53.191658+0000","last_fullsized":"2024-09-12T01:43:53.191658+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:42.469260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190801+0000","last_change":"2024-09-12T01:43:51.190092+0000","last_active":"2024-09-12T01:43:53.190801+0000","last_peered":"2024-09-12T01:43:53.190801+0000","last_clean":"2024-09-12T01:43:53.190801+0000","last_became_active":"2024-09-12T01:43:51.189777+0000","last_became_peered":"2024-09-12T01:43:51.189777+0000","last_unstale":"2024-09-12T01:43:53.190801+0000","last_undegraded":"2024-09-12T01:43:53.190801+0000","last_fullsized":"2024-09-12T01:43:53.190801+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:43.784378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469110+0000","last_change":"2024-09-12T01:43:52.200910+0000","last_active":"2024-09-12T01:43:53.469110+0000","last_peered":"2024-09-12T01:43:53.469110+0000","last_clean":"2024-09-12T01:43:53.469110+0000","last_became_active":"2024-09-12T01:43:52.200600+0000","last_became_peered":"2024-09-12T01:43:52.200600+0000","last_unstale":"2024-09-12T01:43:53.469110+0000","last_undegraded":"2024-09-12T01:43:53.469110+0000","last_fullsized":"2024-09-12T01:43:53.469110+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:44.686853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469411+0000","last_change":"2024-09-12T01:43:51.184567+0000","last_active":"2024-09-12T01:43:53.469411+0000","last_peered":"2024-09-12T01:43:53.469411+0000","last_clean":"2024-09-12T01:43:53.469411+0000","last_became_active":"2024-09-12T01:43:51.184313+0000","last_became_peered":"2024-09-12T01:43:51.184313+0000","last_unstale":"2024-09-12T01:43:53.469411+0000","last_undegraded":"2024-09-12T01:43:53.469411+0000","last_fullsized":"2024-09-12T01:43:53.469411+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:26.397286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191242+0000","last_change":"2024-09-12T01:43:52.200343+0000","last_active":"2024-09-12T01:43:53.191242+0000","last_peered":"2024-09-12T01:43:53.191242+0000","last_clean":"2024-09-12T01:43:53.191242+0000","last_became_active":"2024-09-12T01:43:52.200037+0000","last_became_peered":"2024-09-12T01:43:52.200037+0000","last_unstale":"2024-09-12T01:43:53.191242+0000","last_undegraded":"2024-09-12T01:43:53.191242+0000","last_fullsized":"2024-09-12T01:43:53.191242+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:27.265656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"127'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191327+0000","last_change":"2024-09-12T01:43:51.191423+0000","last_active":"2024-09-12T01:43:53.191327+0000","last_peered":"2024-09-12T01:43:53.191327+0000","last_clean":"2024-09-12T01:43:53.191327+0000","last_became_active":"2024-09-12T01:43:51.191236+0000","last_became_peered":"2024-09-12T01:43:51.191236+0000","last_unstale":"2024-09-12T01:43:53.191327+0000","last_undegraded":"2024-09-12T01:43:53.191327+0000","last_fullsized":"2024-09-12T01:43:53.191327+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:31.906381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468875+0000","last_change":"2024-09-12T01:43:52.197256+0000","last_active":"2024-09-12T01:43:53.468875+0000","last_peered":"2024-09-12T01:43:53.468875+0000","last_clean":"2024-09-12T01:43:53.468875+0000","last_became_active":"2024-09-12T01:43:52.196969+0000","last_became_peered":"2024-09-12T01:43:52.196969+0000","last_unstale":"2024-09-12T01:43:53.468875+0000","last_undegraded":"2024-09-12T01:43:53.468875+0000","last_fullsized":"2024-09-12T01:43:53.468875+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.030087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468803+0000","last_change":"2024-09-12T01:43:51.187189+0000","last_active":"2024-09-12T01:43:53.468803+0000","last_peered":"2024-09-12T01:43:53.468803+0000","last_clean":"2024-09-12T01:43:53.468803+0000","last_became_active":"2024-09-12T01:43:51.186919+0000","last_became_peered":"2024-09-12T01:43:51.186919+0000","last_unstale":"2024-09-12T01:43:53.468803+0000","last_undegraded":"2024-09-12T01:43:53.468803+0000","last_fullsized":"2024-09-12T01:43:53.468803+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:12.198020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224156+0000","last_change":"2024-09-12T01:43:52.203777+0000","last_active":"2024-09-12T01:43:53.224156+0000","last_peered":"2024-09-12T01:43:53.224156+0000","last_clean":"2024-09-12T01:43:53.224156+0000","last_became_active":"2024-09-12T01:43:52.203382+0000","last_became_peered":"2024-09-12T01:43:52.203382+0000","last_unstale":"2024-09-12T01:43:53.224156+0000","last_undegraded":"2024-09-12T01:43:53.224156+0000","last_fullsized":"2024-09-12T01:43:53.224156+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.137459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468354+0000","last_change":"2024-09-12T01:43:51.181919+0000","last_active":"2024-09-12T01:43:53.468354+0000","last_peered":"2024-09-12T01:43:53.468354+0000","last_clean":"2024-09-12T01:43:53.468354+0000","last_became_active":"2024-09-12T01:43:51.181640+0000","last_became_peered":"2024-09-12T01:43:51.181640+0000","last_unstale":"2024-09-12T01:43:53.468354+0000","last_undegraded":"2024-09-12T01:43:53.468354+0000","last_fullsized":"2024-09-12T01:43:53.468354+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:51.195148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468410+0000","last_change":"2024-09-12T01:43:52.200061+0000","last_active":"2024-09-12T01:43:53.468410+0000","last_peered":"2024-09-12T01:43:53.468410+0000","last_clean":"2024-09-12T01:43:53.468410+0000","last_became_active":"2024-09-12T01:43:52.199682+0000","last_became_peered":"2024-09-12T01:43:52.199682+0000","last_unstale":"2024-09-12T01:43:53.468410+0000","last_undegraded":"2024-09-12T01:43:53.468410+0000","last_fullsized":"2024-09-12T01:43:53.468410+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:46.385808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190394+0000","last_change":"2024-09-12T01:43:51.190566+0000","last_active":"2024-09-12T01:43:53.190394+0000","last_peered":"2024-09-12T01:43:53.190394+0000","last_clean":"2024-09-12T01:43:53.190394+0000","last_became_active":"2024-09-12T01:43:51.189585+0000","last_became_peered":"2024-09-12T01:43:51.189585+0000","last_unstale":"2024-09-12T01:43:53.190394+0000","last_undegraded":"2024-09-12T01:43:53.190394+0000","last_fullsized":"2024-09-12T01:43:53.190394+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:24.544318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.223940+0000","last_change":"2024-09-12T01:43:52.196763+0000","last_active":"2024-09-12T01:43:53.223940+0000","last_peered":"2024-09-12T01:43:53.223940+0000","last_clean":"2024-09-12T01:43:53.223940+0000","last_became_active":"2024-09-12T01:43:52.196278+0000","last_became_peered":"2024-09-12T01:43:52.196278+0000","last_unstale":"2024-09-12T01:43:53.223940+0000","last_undegraded":"2024-09-12T01:43:53.223940+0000","last_fullsized":"2024-09-12T01:43:53.223940+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:42.811450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190472+0000","last_change":"2024-09-12T01:43:51.189225+0000","last_active":"2024-09-12T01:43:53.190472+0000","last_peered":"2024-09-12T01:43:53.190472+0000","last_clean":"2024-09-12T01:43:53.190472+0000","last_became_active":"2024-09-12T01:43:51.187427+0000","last_became_peered":"2024-09-12T01:43:51.187427+0000","last_unstale":"2024-09-12T01:43:53.190472+0000","last_undegraded":"2024-09-12T01:43:53.190472+0000","last_fullsized":"2024-09-12T01:43:53.190472+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:29.435836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468498+0000","last_change":"2024-09-12T01:43:52.201050+0000","last_active":"2024-09-12T01:43:53.468498+0000","last_peered":"2024-09-12T01:43:53.468498+0000","last_clean":"2024-09-12T01:43:53.468498+0000","last_became_active":"2024-09-12T01:43:52.200559+0000","last_became_peered":"2024-09-12T01:43:52.200559+0000","last_unstale":"2024-09-12T01:43:53.468498+0000","last_undegraded":"2024-09-12T01:43:53.468498+0000","last_fullsized":"2024-09-12T01:43:53.468498+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:25.549529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190264+0000","last_change":"2024-09-12T01:43:51.190048+0000","last_active":"2024-09-12T01:43:53.190264+0000","last_peered":"2024-09-12T01:43:53.190264+0000","last_clean":"2024-09-12T01:43:53.190264+0000","last_became_active":"2024-09-12T01:43:51.189438+0000","last_became_peered":"2024-09-12T01:43:51.189438+0000","last_unstale":"2024-09-12T01:43:53.190264+0000","last_undegraded":"2024-09-12T01:43:53.190264+0000","last_fullsized":"2024-09-12T01:43:53.190264+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:49.495951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191097+0000","last_change":"2024-09-12T01:43:52.202847+0000","last_active":"2024-09-12T01:43:53.191097+0000","last_peered":"2024-09-12T01:43:53.191097+0000","last_clean":"2024-09-12T01:43:53.191097+0000","last_became_active":"2024-09-12T01:43:52.202595+0000","last_became_peered":"2024-09-12T01:43:52.202595+0000","last_unstale":"2024-09-12T01:43:53.191097+0000","last_undegraded":"2024-09-12T01:43:53.191097+0000","last_fullsized":"2024-09-12T01:43:53.191097+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:16.325979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"127'2","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190945+0000","last_change":"2024-09-12T01:43:51.182059+0000","last_active":"2024-09-12T01:43:53.190945+0000","last_peered":"2024-09-12T01:43:53.190945+0000","last_clean":"2024-09-12T01:43:53.190945+0000","last_became_active":"2024-09-12T01:43:51.181729+0000","last_became_peered":"2024-09-12T01:43:51.181729+0000","last_unstale":"2024-09-12T01:43:53.190945+0000","last_undegraded":"2024-09-12T01:43:53.190945+0000","last_fullsized":"2024-09-12T01:43:53.190945+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:09.868902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190896+0000","last_change":"2024-09-12T01:43:52.203811+0000","last_active":"2024-09-12T01:43:53.190896+0000","last_peered":"2024-09-12T01:43:53.190896+0000","last_clean":"2024-09-12T01:43:53.190896+0000","last_became_active":"2024-09-12T01:43:52.203515+0000","last_became_peered":"2024-09-12T01:43:52.203515+0000","last_unstale":"2024-09-12T01:43:53.190896+0000","last_undegraded":"2024-09-12T01:43:53.190896+0000","last_fullsized":"2024-09-12T01:43:53.190896+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:36.754460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"128'1","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468900+0000","last_change":"2024-09-12T01:43:51.193650+0000","last_active":"2024-09-12T01:43:53.468900+0000","last_peered":"2024-09-12T01:43:53.468900+0000","last_clean":"2024-09-12T01:43:53.468900+0000","last_became_active":"2024-09-12T01:43:51.193406+0000","last_became_peered":"2024-09-12T01:43:51.193406+0000","last_unstale":"2024-09-12T01:43:53.468900+0000","last_undegraded":"2024-09-12T01:43:53.468900+0000","last_fullsized":"2024-09-12T01:43:53.468900+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:32.090329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469348+0000","last_change":"2024-09-12T01:43:52.198800+0000","last_active":"2024-09-12T01:43:53.469348+0000","last_peered":"2024-09-12T01:43:53.469348+0000","last_clean":"2024-09-12T01:43:53.469348+0000","last_became_active":"2024-09-12T01:43:52.198490+0000","last_became_peered":"2024-09-12T01:43:52.198490+0000","last_unstale":"2024-09-12T01:43:53.469348+0000","last_undegraded":"2024-09-12T01:43:53.469348+0000","last_fullsized":"2024-09-12T01:43:53.469348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:04.895280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191252+0000","last_change":"2024-09-12T01:43:51.188178+0000","last_active":"2024-09-12T01:43:53.191252+0000","last_peered":"2024-09-12T01:43:53.191252+0000","last_clean":"2024-09-12T01:43:53.191252+0000","last_became_active":"2024-09-12T01:43:51.187415+0000","last_became_peered":"2024-09-12T01:43:51.187415+0000","last_unstale":"2024-09-12T01:43:53.191252+0000","last_undegraded":"2024-09-12T01:43:53.191252+0000","last_fullsized":"2024-09-12T01:43:53.191252+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:15.082942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.469170+0000","last_change":"2024-09-12T01:43:52.205916+0000","last_active":"2024-09-12T01:43:53.469170+0000","last_peered":"2024-09-12T01:43:53.469170+0000","last_clean":"2024-09-12T01:43:53.469170+0000","last_became_active":"2024-09-12T01:43:52.205619+0000","last_became_peered":"2024-09-12T01:43:52.205619+0000","last_unstale":"2024-09-12T01:43:53.469170+0000","last_undegraded":"2024-09-12T01:43:53.469170+0000","last_fullsized":"2024-09-12T01:43:53.469170+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:57.063068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191161+0000","last_change":"2024-09-12T01:43:51.184430+0000","last_active":"2024-09-12T01:43:53.191161+0000","last_peered":"2024-09-12T01:43:53.191161+0000","last_clean":"2024-09-12T01:43:53.191161+0000","last_became_active":"2024-09-12T01:43:51.183973+0000","last_became_peered":"2024-09-12T01:43:51.183973+0000","last_unstale":"2024-09-12T01:43:53.191161+0000","last_undegraded":"2024-09-12T01:43:53.191161+0000","last_fullsized":"2024-09-12T01:43:53.191161+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:51.195148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191080+0000","last_change":"2024-09-12T01:43:52.198362+0000","last_active":"2024-09-12T01:43:53.191080+0000","last_peered":"2024-09-12T01:43:53.191080+0000","last_clean":"2024-09-12T01:43:53.191080+0000","last_became_active":"2024-09-12T01:43:52.198053+0000","last_became_peered":"2024-09-12T01:43:52.198053+0000","last_unstale":"2024-09-12T01:43:53.191080+0000","last_undegraded":"2024-09-12T01:43:53.191080+0000","last_fullsized":"2024-09-12T01:43:53.191080+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.137459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468481+0000","last_change":"2024-09-12T01:43:51.186791+0000","last_active":"2024-09-12T01:43:53.468481+0000","last_peered":"2024-09-12T01:43:53.468481+0000","last_clean":"2024-09-12T01:43:53.468481+0000","last_became_active":"2024-09-12T01:43:51.186480+0000","last_became_peered":"2024-09-12T01:43:51.186480+0000","last_unstale":"2024-09-12T01:43:53.468481+0000","last_undegraded":"2024-09-12T01:43:53.468481+0000","last_fullsized":"2024-09-12T01:43:53.468481+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:45.776104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190508+0000","last_change":"2024-09-12T01:43:52.184337+0000","last_active":"2024-09-12T01:43:53.190508+0000","last_peered":"2024-09-12T01:43:53.190508+0000","last_clean":"2024-09-12T01:43:53.190508+0000","last_became_active":"2024-09-12T01:43:52.183717+0000","last_became_peered":"2024-09-12T01:43:52.183717+0000","last_unstale":"2024-09-12T01:43:53.190508+0000","last_undegraded":"2024-09-12T01:43:53.190508+0000","last_fullsized":"2024-09-12T01:43:53.190508+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:34.647223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468200+0000","last_change":"2024-09-12T01:43:51.192004+0000","last_active":"2024-09-12T01:43:53.468200+0000","last_peered":"2024-09-12T01:43:53.468200+0000","last_clean":"2024-09-12T01:43:53.468200+0000","last_became_active":"2024-09-12T01:43:51.191733+0000","last_became_peered":"2024-09-12T01:43:51.191733+0000","last_unstale":"2024-09-12T01:43:53.468200+0000","last_undegraded":"2024-09-12T01:43:53.468200+0000","last_fullsized":"2024-09-12T01:43:53.468200+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:16.063093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.190070+0000","last_change":"2024-09-12T01:43:52.201870+0000","last_active":"2024-09-12T01:43:53.190070+0000","last_peered":"2024-09-12T01:43:53.190070+0000","last_clean":"2024-09-12T01:43:53.190070+0000","last_became_active":"2024-09-12T01:43:52.201259+0000","last_became_peered":"2024-09-12T01:43:52.201259+0000","last_unstale":"2024-09-12T01:43:53.190070+0000","last_undegraded":"2024-09-12T01:43:53.190070+0000","last_fullsized":"2024-09-12T01:43:53.190070+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:16.088153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.223777+0000","last_change":"2024-09-12T01:43:51.184853+0000","last_active":"2024-09-12T01:43:53.223777+0000","last_peered":"2024-09-12T01:43:53.223777+0000","last_clean":"2024-09-12T01:43:53.223777+0000","last_became_active":"2024-09-12T01:43:51.184574+0000","last_became_peered":"2024-09-12T01:43:51.184574+0000","last_unstale":"2024-09-12T01:43:53.223777+0000","last_undegraded":"2024-09-12T01:43:53.223777+0000","last_fullsized":"2024-09-12T01:43:53.223777+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:46.068566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468201+0000","last_change":"2024-09-12T01:43:52.197999+0000","last_active":"2024-09-12T01:43:53.468201+0000","last_peered":"2024-09-12T01:43:53.468201+0000","last_clean":"2024-09-12T01:43:53.468201+0000","last_became_active":"2024-09-12T01:43:52.197701+0000","last_became_peered":"2024-09-12T01:43:52.197701+0000","last_unstale":"2024-09-12T01:43:53.468201+0000","last_undegraded":"2024-09-12T01:43:53.468201+0000","last_fullsized":"2024-09-12T01:43:53.468201+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:22.275370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.468229+0000","last_change":"2024-09-12T01:43:51.182187+0000","last_active":"2024-09-12T01:43:53.468229+0000","last_peered":"2024-09-12T01:43:53.468229+0000","last_clean":"2024-09-12T01:43:53.468229+0000","last_became_active":"2024-09-12T01:43:51.181927+0000","last_became_peered":"2024-09-12T01:43:51.181927+0000","last_unstale":"2024-09-12T01:43:53.468229+0000","last_undegraded":"2024-09-12T01:43:53.468229+0000","last_fullsized":"2024-09-12T01:43:53.468229+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:41.806239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191161+0000","last_change":"2024-09-12T01:43:52.195208+0000","last_active":"2024-09-12T01:43:53.191161+0000","last_peered":"2024-09-12T01:43:53.191161+0000","last_clean":"2024-09-12T01:43:53.191161+0000","last_became_active":"2024-09-12T01:43:52.194928+0000","last_became_peered":"2024-09-12T01:43:52.194928+0000","last_unstale":"2024-09-12T01:43:53.191161+0000","last_undegraded":"2024-09-12T01:43:53.191161+0000","last_fullsized":"2024-09-12T01:43:53.191161+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:51.166510+0000","last_clean_scrub_stamp":"2024-09-12T01:43:51.166510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:51.407008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"127'3","reported_seq":17,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.224158+0000","last_change":"2024-09-12T01:43:51.184190+0000","last_active":"2024-09-12T01:43:53.224158+0000","last_peered":"2024-09-12T01:43:53.224158+0000","last_clean":"2024-09-12T01:43:53.224158+0000","last_became_active":"2024-09-12T01:43:51.183915+0000","last_became_peered":"2024-09-12T01:43:51.183915+0000","last_unstale":"2024-09-12T01:43:53.224158+0000","last_undegraded":"2024-09-12T01:43:53.224158+0000","last_fullsized":"2024-09-12T01:43:53.224158+0000","mapping_epoch":125,"log_start":"0'0","ondisk_log_start":"0'0","created":125,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:43:50.161299+0000","last_clean_scrub_stamp":"2024-09-12T01:43:50.161299+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:29.914862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":368,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-09-12T01:43:53.191031+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:43:53.191031+0000","last_peered":"2024-09-12T01:43:53.191031+0000","last_clean":"2024-09-12T01:43:53.191031+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:43:53.191031+0000","last_undegraded":"2024-09-12T01:43:53.191031+0000","last_fullsized":"2024-09-12T01:43:53.191031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509543,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1597440,"data_stored":683664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509541,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36908,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334932,"statfs":{"total":96636764160,"available":96598970368,"internally_reserved":0,"allocated":1597440,"data_stored":683664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509541,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33360,"kb_used_data":2164,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338480,"statfs":{"total":96636764160,"available":96602603520,"internally_reserved":0,"allocated":2215936,"data_stored":1275838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509541,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36924,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334916,"statfs":{"total":96636764160,"available":96598953984,"internally_reserved":0,"allocated":1605632,"data_stored":684280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1601536,"data_stored":683686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509541,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37496,"kb_used_data":2144,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334344,"statfs":{"total":96636764160,"available":96598368256,"internally_reserved":0,"allocated":2195456,"data_stored":1274102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509542,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36920,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334920,"statfs":{"total":96636764160,"available":96598958080,"internally_reserved":0,"allocated":1601536,"data_stored":683754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574949,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1605632,"data_stored":679580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:43:59.916 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:43:59.916 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:44:00.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.063+0000 7f6b97677640 1 Processor -- start 2024-09-12T01:44:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.063+0000 7f6b97677640 1 -- start start 2024-09-12T01:44:00.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.064+0000 7f6b97677640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6b9015e7a0 0x7f6b9006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.064+0000 7f6b97677640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b900cf1f0 0x7f6b900b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.064+0000 7f6b97677640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b900cf860 con 0x7f6b900b6720 2024-09-12T01:44:00.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.064+0000 7f6b97677640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6b900d2ca0 con 0x7f6b9015e7a0 2024-09-12T01:44:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.064+0000 7f6b97677640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6b900cfb40 con 0x7f6b900cf1f0 2024-09-12T01:44:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.064+0000 7f6b95c14640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6b900b6720 0x7f6b901623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36338/0 (socket says 172.21.15.60:36338) 2024-09-12T01:44:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.064+0000 7f6b95c14640 1 -- 172.21.15.60:0/802872233 learned_addr learned my addr 172.21.15.60:0/802872233 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.064+0000 7f6b95413640 1 --2- 172.21.15.60:0/802872233 >> v2:172.21.15.105:3300/0 conn(0x7f6b9015e7a0 0x7f6b9006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.064+0000 7f6b94c12640 1 --2- 172.21.15.60:0/802872233 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b900cf1f0 0x7f6b900b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.064+0000 7f6b87fff640 1 -- 172.21.15.60:0/802872233 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345731908 0 0) 0x7f6b900cf860 con 0x7f6b900b6720 2024-09-12T01:44:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.064+0000 7f6b87fff640 1 -- 172.21.15.60:0/802872233 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b7c003520 con 0x7f6b900b6720 2024-09-12T01:44:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.065+0000 7f6b94c12640 1 -- 172.21.15.60:0/802872233 >> v2:172.21.15.105:3300/0 conn(0x7f6b9015e7a0 msgr2=0x7f6b9006caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.065+0000 7f6b94c12640 1 --2- 172.21.15.60:0/802872233 >> v2:172.21.15.105:3300/0 conn(0x7f6b9015e7a0 0x7f6b9006caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.065+0000 7f6b94c12640 1 -- 172.21.15.60:0/802872233 >> v1:172.21.15.60:6789/0 conn(0x7f6b900b6720 legacy=0x7f6b901623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.065+0000 7f6b87fff640 1 -- 172.21.15.60:0/802872233 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2440111567 0 0) 0x7f6b7c003520 con 0x7f6b900b6720 2024-09-12T01:44:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.065+0000 7f6b94c12640 1 -- 172.21.15.60:0/802872233 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b900cfe20 con 0x7f6b900cf1f0 2024-09-12T01:44:00.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.065+0000 7f6b94c12640 1 --2- 172.21.15.60:0/802872233 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b900cf1f0 0x7f6b900b61e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b800097a0 tx=0x7f6b8002a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6872298c9c449b7e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:00.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.066+0000 7f6b87fff640 1 -- 172.21.15.60:0/802872233 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b80037070 con 0x7f6b900cf1f0 2024-09-12T01:44:00.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.066+0000 7f6b87fff640 1 -- 172.21.15.60:0/802872233 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8002ab10 con 0x7f6b900cf1f0 2024-09-12T01:44:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.066+0000 7f6b87fff640 1 -- 172.21.15.60:0/802872233 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b880019f0 con 0x7f6b900cf1f0 2024-09-12T01:44:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.066+0000 7f6b97677640 1 -- 172.21.15.60:0/802872233 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b900cf1f0 msgr2=0x7f6b900b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.066+0000 7f6b97677640 1 --2- 172.21.15.60:0/802872233 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b900cf1f0 0x7f6b900b61e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6b800097a0 tx=0x7f6b8002a080 comp rx=0 tx=0).stop 2024-09-12T01:44:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.066+0000 7f6b97677640 1 -- 172.21.15.60:0/802872233 shutdown_connections 2024-09-12T01:44:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.066+0000 7f6b97677640 1 --2- 172.21.15.60:0/802872233 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b900cf1f0 0x7f6b900b61e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.066+0000 7f6b97677640 1 --2- 172.21.15.60:0/802872233 >> v2:172.21.15.105:3300/0 conn(0x7f6b9015e7a0 0x7f6b9006caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.066+0000 7f6b97677640 1 -- 172.21.15.60:0/802872233 >> 172.21.15.60:0/802872233 conn(0x7f6b900d11e0 msgr2=0x7f6b900d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.066+0000 7f6b97677640 1 -- 172.21.15.60:0/802872233 shutdown_connections 2024-09-12T01:44:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.066+0000 7f6b97677640 1 -- 172.21.15.60:0/802872233 wait complete. 2024-09-12T01:44:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.068+0000 7f6b97677640 1 Processor -- start 2024-09-12T01:44:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.068+0000 7f6b97677640 1 -- start start 2024-09-12T01:44:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.068+0000 7f6b97677640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b900b6720 0x7f6b90160a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.068+0000 7f6b97677640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b900cf1f0 0x7f6b9015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.068+0000 7f6b97677640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9015e7a0 0x7f6b9015ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.068+0000 7f6b97677640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9006cfe0 con 0x7f6b9015e7a0 2024-09-12T01:44:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.068+0000 7f6b97677640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b900b7a00 con 0x7f6b900b6720 2024-09-12T01:44:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.068+0000 7f6b97677640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6b900d4420 con 0x7f6b900cf1f0 2024-09-12T01:44:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.068+0000 7f6b95c14640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9015e7a0 0x7f6b9015ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.068+0000 7f6b95c14640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9015e7a0 0x7f6b9015ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40910/0 (socket says 172.21.15.60:40910) 2024-09-12T01:44:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.068+0000 7f6b95c14640 1 -- 172.21.15.60:0/1019070335 learned_addr learned my addr 172.21.15.60:0/1019070335 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b95413640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b900b6720 0x7f6b90160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b94c12640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b900cf1f0 0x7f6b9015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b95c14640 1 -- 172.21.15.60:0/1019070335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b900cf1f0 msgr2=0x7f6b9015a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b95c14640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b900cf1f0 0x7f6b9015a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b95c14640 1 -- 172.21.15.60:0/1019070335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b900b6720 msgr2=0x7f6b90160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b95c14640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b900b6720 0x7f6b90160a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b95c14640 1 -- 172.21.15.60:0/1019070335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b901610a0 con 0x7f6b9015e7a0 2024-09-12T01:44:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b94c12640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b900cf1f0 0x7f6b9015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b95c14640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9015e7a0 0x7f6b9015ed90 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f6b88001b60 tx=0x7f6b8800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b85ffb640 1 -- 172.21.15.60:0/1019070335 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88017070 con 0x7f6b9015e7a0 2024-09-12T01:44:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b85ffb640 1 -- 172.21.15.60:0/1019070335 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88012400 con 0x7f6b9015e7a0 2024-09-12T01:44:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b85ffb640 1 -- 172.21.15.60:0/1019070335 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b880127b0 con 0x7f6b9015e7a0 2024-09-12T01:44:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b97677640 1 -- 172.21.15.60:0/1019070335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b90161380 con 0x7f6b9015e7a0 2024-09-12T01:44:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.069+0000 7f6b97677640 1 -- 172.21.15.60:0/1019070335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b90156bb0 con 0x7f6b9015e7a0 2024-09-12T01:44:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.070+0000 7f6b97677640 1 -- 172.21.15.60:0/1019070335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9015eb80 con 0x7f6b9015e7a0 2024-09-12T01:44:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.071+0000 7f6b85ffb640 1 -- 172.21.15.60:0/1019070335 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b8801a070 con 0x7f6b9015e7a0 2024-09-12T01:44:00.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.071+0000 7f6b85ffb640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b7406be30 0x7f6b7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.071+0000 7f6b85ffb640 1 -- 172.21.15.60:0/1019070335 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f6b8808ad70 con 0x7f6b9015e7a0 2024-09-12T01:44:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.071+0000 7f6b95413640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b7406be30 0x7f6b7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.072+0000 7f6b95413640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b7406be30 0x7f6b7406e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009aa0 tx=0x7f6b8c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:00.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.076+0000 7f6b85ffb640 1 -- 172.21.15.60:0/1019070335 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6b88059030 con 0x7f6b9015e7a0 2024-09-12T01:44:00.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.321+0000 7f6b97677640 1 -- 172.21.15.60:0/1019070335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f6b900d2a80 con 0x7f6b9015e7a0 2024-09-12T01:44:00.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.323+0000 7f6b85ffb640 1 -- 172.21.15.60:0/1019070335 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f6b8805d330 con 0x7f6b9015e7a0 2024-09-12T01:44:00.323 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-12T01:44:00.323 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ== 2024-09-12T01:44:00.323 INFO:teuthology.orchestra.run.smithi060.stdout: caps mds = "allow" 2024-09-12T01:44:00.323 INFO:teuthology.orchestra.run.smithi060.stdout: caps mon = "allow r" 2024-09-12T01:44:00.324 INFO:teuthology.orchestra.run.smithi060.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:44:00.324 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2024-09-12T01:44:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.325+0000 7f6b97677640 1 -- 172.21.15.60:0/1019070335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b7406be30 msgr2=0x7f6b7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.325+0000 7f6b97677640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b7406be30 0x7f6b7406e2f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009aa0 tx=0x7f6b8c009190 comp rx=0 tx=0).stop 2024-09-12T01:44:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.325+0000 7f6b97677640 1 -- 172.21.15.60:0/1019070335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9015e7a0 msgr2=0x7f6b9015ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.325+0000 7f6b97677640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9015e7a0 0x7f6b9015ed90 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f6b88001b60 tx=0x7f6b8800a430 comp rx=0 tx=0).stop 2024-09-12T01:44:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.325+0000 7f6b97677640 1 -- 172.21.15.60:0/1019070335 shutdown_connections 2024-09-12T01:44:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.325+0000 7f6b97677640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b9015e7a0 0x7f6b9015ed90 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.325+0000 7f6b97677640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b7406be30 0x7f6b7406e2f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.325+0000 7f6b97677640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b900cf1f0 0x7f6b9015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.325+0000 7f6b97677640 1 --2- 172.21.15.60:0/1019070335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b900b6720 0x7f6b90160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.325+0000 7f6b97677640 1 -- 172.21.15.60:0/1019070335 >> 172.21.15.60:0/1019070335 conn(0x7f6b900d11e0 msgr2=0x7f6b901625b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.325+0000 7f6b97677640 1 -- 172.21.15.60:0/1019070335 shutdown_connections 2024-09-12T01:44:00.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.325+0000 7f6b97677640 1 -- 172.21.15.60:0/1019070335 wait complete. 2024-09-12T01:44:00.336 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.440+0000 7fe354568640 1 Processor -- start 2024-09-12T01:44:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.441+0000 7fe354568640 1 -- start start 2024-09-12T01:44:00.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe354568640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe34c15e540 0x7fe34c0b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe354568640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe34c0b01f0 0x7fe34c1620e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe354568640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34c0b5800 con 0x7fe34c073180 2024-09-12T01:44:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe354568640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe34c163010 con 0x7fe34c15e540 2024-09-12T01:44:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe354568640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe34c15e920 con 0x7fe34c0b01f0 2024-09-12T01:44:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe352304640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe34c15e540 0x7fe34c0b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe352304640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe34c15e540 0x7fe34c0b52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40920/0 (socket says 172.21.15.60:40920) 2024-09-12T01:44:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe352304640 1 -- 172.21.15.60:0/2146070628 learned_addr learned my addr 172.21.15.60:0/2146070628 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe351b03640 1 --2- 172.21.15.60:0/2146070628 >> v2:172.21.15.105:3300/0 conn(0x7fe34c0b01f0 0x7fe34c1620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe352304640 1 -- 172.21.15.60:0/2146070628 >> v2:172.21.15.105:3300/0 conn(0x7fe34c0b01f0 msgr2=0x7fe34c1620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe352304640 1 --2- 172.21.15.60:0/2146070628 >> v2:172.21.15.105:3300/0 conn(0x7fe34c0b01f0 0x7fe34c1620e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe352304640 1 -- 172.21.15.60:0/2146070628 >> v1:172.21.15.105:6789/0 conn(0x7fe34c073180 legacy=0x7fe34c0af1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.442+0000 7fe352304640 1 -- 172.21.15.60:0/2146070628 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34c162a50 con 0x7fe34c15e540 2024-09-12T01:44:00.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.443+0000 7fe352304640 1 --2- 172.21.15.60:0/2146070628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c15e540 0x7fe34c0b52c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fe34c062a50 tx=0x7fe34802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d7c7b7a995f7d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:00.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.443+0000 7fe351302640 1 -- 172.21.15.60:0/2146070628 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348037070 con 0x7fe34c15e540 2024-09-12T01:44:00.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.443+0000 7fe351302640 1 -- 172.21.15.60:0/2146070628 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe34802ae20 con 0x7fe34c15e540 2024-09-12T01:44:00.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.443+0000 7fe351302640 1 -- 172.21.15.60:0/2146070628 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348032660 con 0x7fe34c15e540 2024-09-12T01:44:00.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.443+0000 7fe354568640 1 -- 172.21.15.60:0/2146070628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c15e540 msgr2=0x7fe34c0b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.443+0000 7fe354568640 1 --2- 172.21.15.60:0/2146070628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c15e540 0x7fe34c0b52c0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fe34c062a50 tx=0x7fe34802a110 comp rx=0 tx=0).stop 2024-09-12T01:44:00.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.444+0000 7fe354568640 1 -- 172.21.15.60:0/2146070628 shutdown_connections 2024-09-12T01:44:00.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.444+0000 7fe354568640 1 --2- 172.21.15.60:0/2146070628 >> v2:172.21.15.105:3300/0 conn(0x7fe34c0b01f0 0x7fe34c1620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.444+0000 7fe354568640 1 --2- 172.21.15.60:0/2146070628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c15e540 0x7fe34c0b52c0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.444+0000 7fe354568640 1 -- 172.21.15.60:0/2146070628 >> 172.21.15.60:0/2146070628 conn(0x7fe34c06bc10 msgr2=0x7fe34c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:00.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.444+0000 7fe354568640 1 -- 172.21.15.60:0/2146070628 shutdown_connections 2024-09-12T01:44:00.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.444+0000 7fe354568640 1 -- 172.21.15.60:0/2146070628 wait complete. 2024-09-12T01:44:00.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.445+0000 7fe354568640 1 Processor -- start 2024-09-12T01:44:00.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.445+0000 7fe354568640 1 -- start start 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe354568640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c073180 0x7fe34c14d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe354568640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe34c0b01f0 0x7fe34c06c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe354568640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c15e540 0x7fe34c06cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe354568640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c0aeca0 con 0x7fe34c15e540 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe354568640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c0ae9c0 con 0x7fe34c0b01f0 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe354568640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe34c162620 con 0x7fe34c073180 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe352b05640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c15e540 0x7fe34c06cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe352b05640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c15e540 0x7fe34c06cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40928/0 (socket says 172.21.15.60:40928) 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe352b05640 1 -- 172.21.15.60:0/1743813963 learned_addr learned my addr 172.21.15.60:0/1743813963 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe351b03640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe34c0b01f0 0x7fe34c06c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe352304640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c073180 0x7fe34c14d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe352b05640 1 -- 172.21.15.60:0/1743813963 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c073180 msgr2=0x7fe34c14d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe352b05640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c073180 0x7fe34c14d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe352b05640 1 -- 172.21.15.60:0/1743813963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe34c0b01f0 msgr2=0x7fe34c06c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe352b05640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe34c0b01f0 0x7fe34c06c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe352b05640 1 -- 172.21.15.60:0/1743813963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34c15ec00 con 0x7fe34c15e540 2024-09-12T01:44:00.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe352b05640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c15e540 0x7fe34c06cca0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c780 tx=0x7fe34400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:00.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe342ffd640 1 -- 172.21.15.60:0/1743813963 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344004b60 con 0x7fe34c15e540 2024-09-12T01:44:00.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe342ffd640 1 -- 172.21.15.60:0/1743813963 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe344004d00 con 0x7fe34c15e540 2024-09-12T01:44:00.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe354568640 1 -- 172.21.15.60:0/1743813963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34c15eee0 con 0x7fe34c15e540 2024-09-12T01:44:00.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe342ffd640 1 -- 172.21.15.60:0/1743813963 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe34400aa90 con 0x7fe34c15e540 2024-09-12T01:44:00.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.446+0000 7fe354568640 1 -- 172.21.15.60:0/1743813963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34c15f4a0 con 0x7fe34c15e540 2024-09-12T01:44:00.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.447+0000 7fe354568640 1 -- 172.21.15.60:0/1743813963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe34c1620e0 con 0x7fe34c15e540 2024-09-12T01:44:00.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.448+0000 7fe342ffd640 1 -- 172.21.15.60:0/1743813963 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe34400ac30 con 0x7fe34c15e540 2024-09-12T01:44:00.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.448+0000 7fe342ffd640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe33006be30 0x7fe33006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:00.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.448+0000 7fe342ffd640 1 -- 172.21.15.60:0/1743813963 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fe34408aff0 con 0x7fe34c15e540 2024-09-12T01:44:00.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.448+0000 7fe352304640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe33006be30 0x7fe33006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:00.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.449+0000 7fe352304640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe33006be30 0x7fe33006e2f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe348034000 tx=0x7fe34802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:00.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.453+0000 7fe342ffd640 1 -- 172.21.15.60:0/1743813963 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe344020070 con 0x7fe34c15e540 2024-09-12T01:44:00.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.666+0000 7fe354568640 1 -- 172.21.15.60:0/1743813963 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe34c075690 con 0x7fe34c15e540 2024-09-12T01:44:00.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.666+0000 7fe342ffd640 1 -- 172.21.15.60:0/1743813963 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5230 (secure 0 0 0) 0x7fe344059360 con 0x7fe34c15e540 2024-09-12T01:44:00.666 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:00.666 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":79,"btime":"2024-09-12T01:43:54:188220+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/152127841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":152127841},{"type":"v1","addr":"172.21.15.60:6836","nonce":152127841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7234,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2154123948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2154123948},{"type":"v1","addr":"172.21.15.105:6835","nonce":2154123948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1634496909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1634496909},{"type":"v1","addr":"172.21.15.60:6837","nonce":1634496909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:51.547779+0000","modified":"2024-09-12T01:43:53.534706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/2888550162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2888550162},{"type":"v1","addr":"172.21.15.105:6834","nonce":2888550162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7989,"qdb_cluster":[7989]},"id":10}]} 2024-09-12T01:44:00.666 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 79 2024-09-12T01:44:00.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.668+0000 7fe354568640 1 -- 172.21.15.60:0/1743813963 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe33006be30 msgr2=0x7fe33006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.668+0000 7fe354568640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe33006be30 0x7fe33006e2f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe348034000 tx=0x7fe34802e000 comp rx=0 tx=0).stop 2024-09-12T01:44:00.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.668+0000 7fe354568640 1 -- 172.21.15.60:0/1743813963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c15e540 msgr2=0x7fe34c06cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:00.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.668+0000 7fe354568640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c15e540 0x7fe34c06cca0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c780 tx=0x7fe34400cc40 comp rx=0 tx=0).stop 2024-09-12T01:44:00.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.668+0000 7fe354568640 1 -- 172.21.15.60:0/1743813963 shutdown_connections 2024-09-12T01:44:00.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.668+0000 7fe354568640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe34c15e540 0x7fe34c06cca0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.668+0000 7fe354568640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe34c0b01f0 0x7fe34c06c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.668+0000 7fe354568640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe33006be30 0x7fe33006e2f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.668+0000 7fe354568640 1 --2- 172.21.15.60:0/1743813963 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe34c073180 0x7fe34c14d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:00.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.668+0000 7fe354568640 1 -- 172.21.15.60:0/1743813963 >> 172.21.15.60:0/1743813963 conn(0x7fe34c06bc10 msgr2=0x7fe34c072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:00.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.668+0000 7fe354568640 1 -- 172.21.15.60:0/1743813963 shutdown_connections 2024-09-12T01:44:00.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:00.668+0000 7fe354568640 1 -- 172.21.15.60:0/1743813963 wait complete. 2024-09-12T01:44:01.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 79, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:43:51.547779+0000', 'modified': '2024-09-12T01:43:53.534706+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7989}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7989': {'gid': 7989, 'name': 'b', 'rank': 0, 'incarnation': 77, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6834/2888550162', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 2888550162}, {'type': 'v1', 'addr': '172.21.15.105:6834', 'nonce': 2888550162}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7989, 'qdb_cluster': [7989]} 2024-09-12T01:44:01.082 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:44:01.082 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-12T01:44:01.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.191+0000 7f120789b640 1 Processor -- start 2024-09-12T01:44:01.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.192+0000 7f120789b640 1 -- start start 2024-09-12T01:44:01.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.192+0000 7f120789b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f120015e6f0 0x7f120006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.192+0000 7f120789b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f120006e990 con 0x7f12000b54d0 2024-09-12T01:44:01.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.193+0000 7f120789b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f120006ec70 con 0x7f12000b7450 2024-09-12T01:44:01.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.193+0000 7f120789b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f120015ec70 con 0x7f120015e6f0 2024-09-12T01:44:01.192 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.193+0000 7f1205637640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f120015e6f0 0x7f120006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.193+0000 7f1205637640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f120015e6f0 0x7f120006fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40942/0 (socket says 172.21.15.60:40942) 2024-09-12T01:44:01.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.193+0000 7f1205637640 1 -- 172.21.15.60:0/2121330560 learned_addr learned my addr 172.21.15.60:0/2121330560 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:01.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.193+0000 7f1204e36640 1 --1- 172.21.15.60:0/2121330560 >> v1:172.21.15.60:6789/0 conn(0x7f12000b54d0 0x7f12000b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36342/0 (socket says 172.21.15.60:36342) 2024-09-12T01:44:01.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.193+0000 7f1205637640 1 -- 172.21.15.60:0/2121330560 >> v1:172.21.15.105:6789/0 conn(0x7f12000b7450 legacy=0x7f1200070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:01.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.193+0000 7f1205637640 1 -- 172.21.15.60:0/2121330560 >> v1:172.21.15.60:6789/0 conn(0x7f12000b54d0 legacy=0x7f12000b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.193 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.193+0000 7f1205637640 1 -- 172.21.15.60:0/2121330560 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120015ef50 con 0x7f120015e6f0 2024-09-12T01:44:01.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.194+0000 7f1205637640 1 --2- 172.21.15.60:0/2121330560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120015e6f0 0x7f120006fd00 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009870 tx=0x7f11fc02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ff6db9defea883 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:01.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.194+0000 7f11f7fff640 1 -- 172.21.15.60:0/2121330560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc037070 con 0x7f120015e6f0 2024-09-12T01:44:01.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.194+0000 7f11f7fff640 1 -- 172.21.15.60:0/2121330560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11fc032440 con 0x7f120015e6f0 2024-09-12T01:44:01.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.194+0000 7f11f7fff640 1 -- 172.21.15.60:0/2121330560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11fc032810 con 0x7f120015e6f0 2024-09-12T01:44:01.194 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.194+0000 7f120789b640 1 -- 172.21.15.60:0/2121330560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120015e6f0 msgr2=0x7f120006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.194+0000 7f120789b640 1 --2- 172.21.15.60:0/2121330560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120015e6f0 0x7f120006fd00 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009870 tx=0x7f11fc02a2a0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.194+0000 7f120789b640 1 -- 172.21.15.60:0/2121330560 shutdown_connections 2024-09-12T01:44:01.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.194+0000 7f120789b640 1 --2- 172.21.15.60:0/2121330560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120015e6f0 0x7f120006fd00 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.194+0000 7f120789b640 1 -- 172.21.15.60:0/2121330560 >> 172.21.15.60:0/2121330560 conn(0x7f12000d2430 msgr2=0x7f12000d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:01.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.195+0000 7f120789b640 1 -- 172.21.15.60:0/2121330560 shutdown_connections 2024-09-12T01:44:01.195 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.195+0000 7f120789b640 1 -- 172.21.15.60:0/2121330560 wait complete. 2024-09-12T01:44:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.196+0000 7f120789b640 1 Processor -- start 2024-09-12T01:44:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.196+0000 7f120789b640 1 -- start start 2024-09-12T01:44:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.196+0000 7f120789b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12000b54d0 0x7f12001509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.196+0000 7f120789b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000b7450 0x7f120014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.196+0000 7f120789b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120015e6f0 0x7f1200153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.196+0000 7f120789b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f120006e730 con 0x7f120015e6f0 2024-09-12T01:44:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.196+0000 7f120789b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f120006e5b0 con 0x7f12000b7450 2024-09-12T01:44:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.196+0000 7f120789b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f120015f750 con 0x7f12000b54d0 2024-09-12T01:44:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f1205e38640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120015e6f0 0x7f1200153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f1205e38640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120015e6f0 0x7f1200153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40956/0 (socket says 172.21.15.60:40956) 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f1205e38640 1 -- 172.21.15.60:0/3682756320 learned_addr learned my addr 172.21.15.60:0/3682756320 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f1204e36640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000b7450 0x7f120014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f1205e38640 1 -- 172.21.15.60:0/3682756320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12000b54d0 msgr2=0x7f12001509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f1205e38640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12000b54d0 0x7f12001509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f1205e38640 1 -- 172.21.15.60:0/3682756320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000b7450 msgr2=0x7f120014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f1205e38640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000b7450 0x7f120014fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f1205e38640 1 -- 172.21.15.60:0/3682756320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1200150fb0 con 0x7f120015e6f0 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f1205e38640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120015e6f0 0x7f1200153530 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f11f800c780 tx=0x7f11f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f11f5ffb640 1 -- 172.21.15.60:0/3682756320 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8004b60 con 0x7f120015e6f0 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f11f5ffb640 1 -- 172.21.15.60:0/3682756320 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f8004d00 con 0x7f120015e6f0 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f120789b640 1 -- 172.21.15.60:0/3682756320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12001618f0 con 0x7f120015e6f0 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f11f5ffb640 1 -- 172.21.15.60:0/3682756320 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f800aa90 con 0x7f120015e6f0 2024-09-12T01:44:01.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.197+0000 7f120789b640 1 -- 172.21.15.60:0/3682756320 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1200161eb0 con 0x7f120015e6f0 2024-09-12T01:44:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.199+0000 7f11f5ffb640 1 -- 172.21.15.60:0/3682756320 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f11f800ac30 con 0x7f120015e6f0 2024-09-12T01:44:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.199+0000 7f11f5ffb640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f11e406be30 0x7f11e406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.200+0000 7f11f5ffb640 1 -- 172.21.15.60:0/3682756320 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f11f808b0d0 con 0x7f120015e6f0 2024-09-12T01:44:01.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.200+0000 7f1205637640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f11e406be30 0x7f11e406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.200+0000 7f1205637640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f11e406be30 0x7f11e406e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f11fc034000 tx=0x7f11fc02c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.200+0000 7f120a633740 1 Processor -- start 2024-09-12T01:44:01.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.201+0000 7f120a633740 1 -- start start 2024-09-12T01:44:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.201+0000 7f120a633740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 0x55b8a9ddca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.201+0000 7f120a633740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d94a80 0x55b8a9d976a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.201+0000 7f120a633740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d98a50 0x55b8a9d918b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.201+0000 7f120a633740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b8a9cf9520 con 0x55b8a9d94a80 2024-09-12T01:44:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.201+0000 7f120a633740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b8a9ca13e0 con 0x55b8a9d972c0 2024-09-12T01:44:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.201+0000 7f120a633740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55b8a9cf54e0 con 0x55b8a9d98a50 2024-09-12T01:44:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.201+0000 7f1204e36640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d94a80 0x55b8a9d976a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.201+0000 7f1204e36640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d94a80 0x55b8a9d976a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40962/0 (socket says 172.21.15.60:40962) 2024-09-12T01:44:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.201+0000 7f1204e36640 1 -- 172.21.15.60:0/2730265217 learned_addr learned my addr 172.21.15.60:0/2730265217 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.202+0000 7f1205e38640 1 --2- 172.21.15.60:0/2730265217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d98a50 0x55b8a9d918b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.202+0000 7f1205637640 1 --2- 172.21.15.60:0/2730265217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 0x55b8a9ddca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.202+0000 7f1204e36640 1 -- 172.21.15.60:0/2730265217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d98a50 msgr2=0x55b8a9d918b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.202+0000 7f1204e36640 1 --2- 172.21.15.60:0/2730265217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d98a50 0x55b8a9d918b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.202+0000 7f1204e36640 1 -- 172.21.15.60:0/2730265217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 msgr2=0x55b8a9ddca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.202+0000 7f1204e36640 1 --2- 172.21.15.60:0/2730265217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 0x55b8a9ddca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.202+0000 7f1204e36640 1 -- 172.21.15.60:0/2730265217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8a9cbc2f0 con 0x55b8a9d94a80 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.202+0000 7f1204e36640 1 --2- 172.21.15.60:0/2730265217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d94a80 0x55b8a9d976a0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f11f0001660 tx=0x7f11f0001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0002e5937c85692 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.202+0000 7f11eaffd640 1 -- 172.21.15.60:0/2730265217 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f0018070 con 0x55b8a9d94a80 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.202+0000 7f11eaffd640 1 -- 172.21.15.60:0/2730265217 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f00074e0 con 0x55b8a9d94a80 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.202+0000 7f11eaffd640 1 -- 172.21.15.60:0/2730265217 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f0007690 con 0x55b8a9d94a80 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.203+0000 7f120a633740 1 -- 172.21.15.60:0/2730265217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d94a80 msgr2=0x55b8a9d976a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.203+0000 7f120a633740 1 --2- 172.21.15.60:0/2730265217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d94a80 0x55b8a9d976a0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f11f0001660 tx=0x7f11f0001b20 comp rx=0 tx=0).stop 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.203+0000 7f120a633740 1 -- 172.21.15.60:0/2730265217 shutdown_connections 2024-09-12T01:44:01.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.203+0000 7f120a633740 1 --2- 172.21.15.60:0/2730265217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d98a50 0x55b8a9d918b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.203+0000 7f120a633740 1 --2- 172.21.15.60:0/2730265217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d94a80 0x55b8a9d976a0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.203+0000 7f120a633740 1 --2- 172.21.15.60:0/2730265217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 0x55b8a9ddca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.203+0000 7f120a633740 1 -- 172.21.15.60:0/2730265217 >> 172.21.15.60:0/2730265217 conn(0x55b8a9d93a80 msgr2=0x55b8a9ddbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:01.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.203+0000 7f120a633740 1 -- 172.21.15.60:0/2730265217 shutdown_connections 2024-09-12T01:44:01.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.203+0000 7f120a633740 1 -- 172.21.15.60:0/2730265217 wait complete. 2024-09-12T01:44:01.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.203+0000 7f120a633740 1 -- start start 2024-09-12T01:44:01.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.203+0000 7f120a633740 1 Processor -- start 2024-09-12T01:44:01.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.204+0000 7f120a633740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 0x55b8a9dd8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.204+0000 7f120a633740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d98a50 0x55b8a9dc0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.204+0000 7f120a633740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9dd93f0 0x55b8a9db15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.204+0000 7f120a633740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b8a9d92f20 con 0x55b8a9dd93f0 2024-09-12T01:44:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.204+0000 7f120a633740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b8a9c82450 con 0x55b8a9d972c0 2024-09-12T01:44:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.204+0000 7f120a633740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55b8a9ddd290 con 0x55b8a9d98a50 2024-09-12T01:44:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.204+0000 7f120a633740 10 client.0 _ll_register_callbacks cb 0x55b8a9a0bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:44:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.204+0000 7f1205e38640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9dd93f0 0x55b8a9db15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.204+0000 7f1205e38640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9dd93f0 0x55b8a9db15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40972/0 (socket says 172.21.15.60:40972) 2024-09-12T01:44:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.204+0000 7f1205e38640 1 -- 172.21.15.60:0/3559494460 learned_addr learned my addr 172.21.15.60:0/3559494460 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.204+0000 7f1205637640 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 0x55b8a9dd8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f1204e36640 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d98a50 0x55b8a9dc0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f1205e38640 1 -- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d98a50 msgr2=0x55b8a9dc0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f1205e38640 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d98a50 0x55b8a9dc0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f1205e38640 1 -- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 msgr2=0x55b8a9dd8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:01.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f1205e38640 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 0x55b8a9dd8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f1205e38640 1 -- 172.21.15.60:0/3559494460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8a9a0c2d0 con 0x55b8a9dd93f0 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f1204e36640 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d98a50 0x55b8a9dc0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f1205e38640 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9dd93f0 0x55b8a9db15f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f11f8055870 tx=0x7f11f805d7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6bb77e9e0908255 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f11dffff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f11dffff640 1 -- 172.21.15.60:0/3559494460 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8071070 con 0x55b8a9dd93f0 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f11dffff640 1 -- 172.21.15.60:0/3559494460 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f11f8071210 con 0x55b8a9dd93f0 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f120a633740 1 -- 172.21.15.60:0/3559494460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11f00074e0 con 0x55b8a9dd93f0 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f11dffff640 1 -- 172.21.15.60:0/3559494460 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f11f80577d0 con 0x55b8a9dd93f0 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f120a633740 10 client.8133 fetch_fsmap learned FSMap version 79 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f120a633740 1 -- 172.21.15.60:0/3559494460 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x55b8a9ad66b0 con 0x55b8a9dd93f0 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f11dffff640 1 -- 172.21.15.60:0/3559494460 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f00074e0 con 0x55b8a9dd93f0 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f11dffff640 1 -- 172.21.15.60:0/3559494460 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 79) ==== 3502+0+0 (secure 0 0 0) 0x7f11f8089200 con 0x55b8a9dd93f0 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f120a633740 10 client.8133 fetch_fsmap finished waiting for FSMap version 79 2024-09-12T01:44:01.211 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f120a633740 10 client.8133 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f120a633740 20 client.8133 populate_metadata read hostname 'smithi060' 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f120a633740 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:6832/2888550162,v1:172.21.15.105:6834/2888550162] conn(0x55b8a9dd75b0 0x55b8a9dd7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f120a633740 4 client.8133 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.205+0000 7f120a633740 1 -- 172.21.15.60:0/3559494460 --> [v2:172.21.15.105:6832/2888550162,v1:172.21.15.105:6834/2888550162] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8a9d06c50 con 0x55b8a9dd75b0 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.206+0000 7f1205637640 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:6832/2888550162,v1:172.21.15.105:6834/2888550162] conn(0x55b8a9dd75b0 0x55b8a9dd7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.206+0000 7f1205637640 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:6832/2888550162,v1:172.21.15.105:6834/2888550162] conn(0x55b8a9dd75b0 0x55b8a9dd7990 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffb33f5d234101f3 server_cookie=f3e6075eb6478ac7 in_seq=0 out_seq=0 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.206+0000 7f11dffff640 10 client.8133 ms_handle_connect on v2:172.21.15.105:6832/2888550162 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f11dffff640 1 -- 172.21.15.60:0/3559494460 <== mds.0 v2:172.21.15.105:6832/2888550162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b8a9d06c50 con 0x55b8a9dd75b0 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f11dffff640 10 client.8133 handle_command_reply: tid=0 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f120a633740 1 client.8133 shutdown 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f120a633740 1 -- 172.21.15.60:0/3559494460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9dd93f0 msgr2=0x55b8a9db15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f120a633740 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9dd93f0 0x55b8a9db15f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f11f8055870 tx=0x7f11f805d7c0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.212 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f120a633740 1 -- 172.21.15.60:0/3559494460 shutdown_connections 2024-09-12T01:44:01.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f120a633740 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:6832/2888550162,v1:172.21.15.105:6834/2888550162] conn(0x55b8a9dd75b0 0x55b8a9dd7990 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f120a633740 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9dd93f0 0x55b8a9db15f0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f120a633740 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d98a50 0x55b8a9dc0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f11dffff640 0 client.8133 ms_handle_reset on v2:172.21.15.105:6832/2888550162 2024-09-12T01:44:01.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f120a633740 1 --2- 172.21.15.60:0/3559494460 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 0x55b8a9dd8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f120a633740 1 -- 172.21.15.60:0/3559494460 >> 172.21.15.60:0/3559494460 conn(0x55b8a9d94a80 msgr2=0x55b8a9ddda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:01.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f120a633740 1 -- 172.21.15.60:0/3559494460 shutdown_connections 2024-09-12T01:44:01.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f120a633740 1 -- 172.21.15.60:0/3559494460 wait complete. 2024-09-12T01:44:01.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.207+0000 7f120a633740 20 client.8133 trim_cache size 0 max 16384 2024-09-12T01:44:01.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.225+0000 7f120a633740 1 Processor -- start 2024-09-12T01:44:01.225 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.225+0000 7f120a633740 1 -- start start 2024-09-12T01:44:01.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f120a633740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d94a80 0x55b8a9dd7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f120a633740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 0x55b8a9dbfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f120a633740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d98a50 0x55b8a9dda1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f120a633740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f12001ffd50 con 0x55b8a9d98a50 2024-09-12T01:44:01.227 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f120a633740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f12001ff0e0 con 0x55b8a9d972c0 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f120a633740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f12001ff700 con 0x55b8a9d94a80 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f1205e38640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d98a50 0x55b8a9dda1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f1205e38640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d98a50 0x55b8a9dda1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40982/0 (socket says 172.21.15.60:40982) 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f1205e38640 1 -- 172.21.15.60:0/4221214086 learned_addr learned my addr 172.21.15.60:0/4221214086 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f1204e36640 1 --2- 172.21.15.60:0/4221214086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 0x55b8a9dbfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f1205637640 1 --2- 172.21.15.60:0/4221214086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d94a80 0x55b8a9dd7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f1205e38640 1 -- 172.21.15.60:0/4221214086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d94a80 msgr2=0x55b8a9dd7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f1205e38640 1 --2- 172.21.15.60:0/4221214086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d94a80 0x55b8a9dd7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f1205e38640 1 -- 172.21.15.60:0/4221214086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 msgr2=0x55b8a9dbfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f1205e38640 1 --2- 172.21.15.60:0/4221214086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 0x55b8a9dbfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f1205e38640 1 -- 172.21.15.60:0/4221214086 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8a9c7ff70 con 0x55b8a9d98a50 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.226+0000 7f1205637640 1 --2- 172.21.15.60:0/4221214086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d94a80 0x55b8a9dd7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f1205e38640 1 --2- 172.21.15.60:0/4221214086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d98a50 0x55b8a9dda1a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f11f800a430 tx=0x7f11f805d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b1720066a505da server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f11ea7fc640 1 -- 172.21.15.60:0/4221214086 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8071070 con 0x55b8a9d98a50 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f11ea7fc640 1 -- 172.21.15.60:0/4221214086 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f8078360 con 0x55b8a9d98a50 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f11ea7fc640 1 -- 172.21.15.60:0/4221214086 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f80556b0 con 0x55b8a9d98a50 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f120a633740 1 -- 172.21.15.60:0/4221214086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d98a50 msgr2=0x55b8a9dda1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f120a633740 1 --2- 172.21.15.60:0/4221214086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d98a50 0x55b8a9dda1a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f11f800a430 tx=0x7f11f805d000 comp rx=0 tx=0).stop 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f120a633740 1 -- 172.21.15.60:0/4221214086 shutdown_connections 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f120a633740 1 --2- 172.21.15.60:0/4221214086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d98a50 0x55b8a9dda1a0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f120a633740 1 --2- 172.21.15.60:0/4221214086 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d972c0 0x55b8a9dbfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f120a633740 1 --2- 172.21.15.60:0/4221214086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d94a80 0x55b8a9dd7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f120a633740 1 -- 172.21.15.60:0/4221214086 >> 172.21.15.60:0/4221214086 conn(0x55b8a9dbcb90 msgr2=0x55b8a9dd8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f120a633740 1 -- 172.21.15.60:0/4221214086 shutdown_connections 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.227+0000 7f120a633740 1 -- 172.21.15.60:0/4221214086 wait complete. 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.228+0000 7f120a633740 1 -- start start 2024-09-12T01:44:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.228+0000 7f120a633740 1 Processor -- start 2024-09-12T01:44:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f120a633740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d94a80 0x55b8a9dbeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f120a633740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d972c0 0x55b8a9e5a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f120a633740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d98a50 0x55b8a9db1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f120a633740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b8a9db1e00 con 0x55b8a9d972c0 2024-09-12T01:44:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f120a633740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x55b8a9dec2b0 con 0x55b8a9d98a50 2024-09-12T01:44:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f120a633740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x55b8a9def9a0 con 0x55b8a9d94a80 2024-09-12T01:44:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f120a633740 10 client.0 _ll_register_callbacks cb 0x7f11f80591e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f1204e36640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d972c0 0x55b8a9e5a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f1204e36640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d972c0 0x55b8a9e5a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40990/0 (socket says 172.21.15.60:40990) 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f1204e36640 1 -- 172.21.15.60:0/4042292177 learned_addr learned my addr 172.21.15.60:0/4042292177 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f1205e38640 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d98a50 0x55b8a9db1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f1205637640 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d94a80 0x55b8a9dbeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f1204e36640 1 -- 172.21.15.60:0/4042292177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d94a80 msgr2=0x55b8a9dbeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f1204e36640 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d94a80 0x55b8a9dbeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f1204e36640 1 -- 172.21.15.60:0/4042292177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d98a50 msgr2=0x55b8a9db1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f1204e36640 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d98a50 0x55b8a9db1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f1204e36640 1 -- 172.21.15.60:0/4042292177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8a9e5b330 con 0x55b8a9d972c0 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f1204e36640 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d972c0 0x55b8a9e5a1b0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f11f000d520 tx=0x7f11f0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335f731b317ececc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.229+0000 7f11dffff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f11dffff640 1 -- 172.21.15.60:0/4042292177 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f0018040 con 0x55b8a9d972c0 2024-09-12T01:44:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f11dffff640 1 -- 172.21.15.60:0/4042292177 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f11f00049e0 con 0x55b8a9d972c0 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f120a633740 1 -- 172.21.15.60:0/4042292177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11f8078360 con 0x55b8a9d972c0 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f11dffff640 1 -- 172.21.15.60:0/4042292177 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f11f002d050 con 0x55b8a9d972c0 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f120a633740 10 client.8139 fetch_fsmap learned FSMap version 79 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f120a633740 1 -- 172.21.15.60:0/4042292177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=2+}) -- 0x55b8a9ddbf00 con 0x55b8a9d972c0 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f11dffff640 1 -- 172.21.15.60:0/4042292177 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f8078360 con 0x55b8a9d972c0 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f11dffff640 1 -- 172.21.15.60:0/4042292177 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 79) ==== 3502+0+0 (secure 0 0 0) 0x7f11f0030020 con 0x55b8a9d972c0 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f120a633740 10 client.8139 fetch_fsmap finished waiting for FSMap version 79 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f120a633740 10 client.8139 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f120a633740 20 client.8139 populate_metadata read hostname 'smithi060' 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f120a633740 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.105:6832/2888550162,v1:172.21.15.105:6834/2888550162] conn(0x55b8a9dd93f0 0x55b8a9dd7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f120a633740 4 client.8139 mds_command: new command op to 7989 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f120a633740 1 -- 172.21.15.60:0/4042292177 --> [v2:172.21.15.105:6832/2888550162,v1:172.21.15.105:6834/2888550162] -- command(tid 0: {"prefix": "status"}) -- 0x55b8a9d00fa0 con 0x55b8a9dd93f0 2024-09-12T01:44:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.230+0000 7f1205637640 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.105:6832/2888550162,v1:172.21.15.105:6834/2888550162] conn(0x55b8a9dd93f0 0x55b8a9dd7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f11dffff640 10 client.8139 ms_handle_connect on v2:172.21.15.105:6832/2888550162 2024-09-12T01:44:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f1205637640 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.105:6832/2888550162,v1:172.21.15.105:6834/2888550162] conn(0x55b8a9dd93f0 0x55b8a9dd7d00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f052baa24d6ee31f server_cookie=7c15cbf305ac14c4 in_seq=0 out_seq=0 2024-09-12T01:44:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f11dffff640 1 -- 172.21.15.60:0/4042292177 <== mds.0 v2:172.21.15.105:6832/2888550162 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x55b8a9d00fa0 con 0x55b8a9dd93f0 2024-09-12T01:44:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f11dffff640 10 client.8139 handle_command_reply: tid=0 2024-09-12T01:44:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f120a633740 1 client.8139 shutdown 2024-09-12T01:44:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f120a633740 1 -- 172.21.15.60:0/4042292177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d972c0 msgr2=0x55b8a9e5a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f120a633740 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d972c0 0x55b8a9e5a1b0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f11f000d520 tx=0x7f11f0000bc0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f120a633740 1 -- 172.21.15.60:0/4042292177 shutdown_connections 2024-09-12T01:44:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f120a633740 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.105:6832/2888550162,v1:172.21.15.105:6834/2888550162] conn(0x55b8a9dd93f0 0x55b8a9dd7d00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f120a633740 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x55b8a9d98a50 0x55b8a9db1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f120a633740 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b8a9d972c0 0x55b8a9e5a1b0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f11dffff640 0 client.8139 ms_handle_reset on v2:172.21.15.105:6832/2888550162 2024-09-12T01:44:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f120a633740 1 --2- 172.21.15.60:0/4042292177 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x55b8a9d94a80 0x55b8a9dbeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f120a633740 1 -- 172.21.15.60:0/4042292177 >> 172.21.15.60:0/4042292177 conn(0x55b8a9dbcb90 msgr2=0x55b8a9dda1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f120a633740 1 -- 172.21.15.60:0/4042292177 shutdown_connections 2024-09-12T01:44:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f120a633740 1 -- 172.21.15.60:0/4042292177 wait complete. 2024-09-12T01:44:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.231+0000 7f120a633740 20 client.8139 trim_cache size 0 max 16384 2024-09-12T01:44:01.237 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:44:01.237 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "5401bd8a-3492-4b21-b6c0-d6616ff39793", 2024-09-12T01:44:01.237 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T01:44:01.237 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 7989, 2024-09-12T01:44:01.238 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T01:44:01.238 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T01:44:01.238 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-12T01:44:01.238 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 9.057052595, 2024-09-12T01:44:01.238 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 79, 2024-09-12T01:44:01.238 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 128, 2024-09-12T01:44:01.238 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 128, 2024-09-12T01:44:01.238 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 14.071710821 2024-09-12T01:44:01.238 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:44:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.232+0000 7f120789b640 1 -- 172.21.15.60:0/3682756320 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f11e406be30 msgr2=0x7f11e406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.232+0000 7f120789b640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f11e406be30 0x7f11e406e2f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f11fc034000 tx=0x7f11fc02c000 comp rx=0 tx=0).stop 2024-09-12T01:44:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.232+0000 7f120789b640 1 -- 172.21.15.60:0/3682756320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120015e6f0 msgr2=0x7f1200153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.232+0000 7f120789b640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120015e6f0 0x7f1200153530 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f11f800c780 tx=0x7f11f800cc40 comp rx=0 tx=0).stop 2024-09-12T01:44:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.232+0000 7f120789b640 1 -- 172.21.15.60:0/3682756320 shutdown_connections 2024-09-12T01:44:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.232+0000 7f120789b640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f120015e6f0 0x7f1200153530 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.232+0000 7f120789b640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f12000b7450 0x7f120014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.232+0000 7f120789b640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f11e406be30 0x7f11e406e2f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.232+0000 7f120789b640 1 --2- 172.21.15.60:0/3682756320 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f12000b54d0 0x7f12001509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.232+0000 7f120789b640 1 -- 172.21.15.60:0/3682756320 >> 172.21.15.60:0/3682756320 conn(0x7f12000d2430 msgr2=0x7f1200074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.232+0000 7f120789b640 1 -- 172.21.15.60:0/3682756320 shutdown_connections 2024-09-12T01:44:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.232+0000 7f120789b640 1 -- 172.21.15.60:0/3682756320 wait complete. 2024-09-12T01:44:01.243 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:44:01.345 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.346+0000 7f4af461e640 1 Processor -- start 2024-09-12T01:44:01.346 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.346+0000 7f4af461e640 1 -- start start 2024-09-12T01:44:01.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.347+0000 7f4af461e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4aec0b5be0 0x7f4aec15a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.347+0000 7f4af461e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aec0b6830 con 0x7f4aec15e600 2024-09-12T01:44:01.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.347+0000 7f4af461e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aec0cd0b0 con 0x7f4aec0b29a0 2024-09-12T01:44:01.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.347+0000 7f4af461e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4aec06e550 con 0x7f4aec0b5be0 2024-09-12T01:44:01.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.347+0000 7f4af23ba640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4aec0b5be0 0x7f4aec15a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.347+0000 7f4af2bbb640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4aec15e600 0x7f4aec15eab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36348/0 (socket says 172.21.15.60:36348) 2024-09-12T01:44:01.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.347+0000 7f4af2bbb640 1 -- 172.21.15.60:0/4000973977 learned_addr learned my addr 172.21.15.60:0/4000973977 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:01.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.347+0000 7f4af23ba640 1 -- 172.21.15.60:0/4000973977 >> v1:172.21.15.105:6789/0 conn(0x7f4aec0b29a0 legacy=0x7f4aec06de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:01.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.347+0000 7f4af23ba640 1 -- 172.21.15.60:0/4000973977 >> v1:172.21.15.60:6789/0 conn(0x7f4aec15e600 legacy=0x7f4aec15eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.347+0000 7f4af23ba640 1 -- 172.21.15.60:0/4000973977 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec0cd390 con 0x7f4aec0b5be0 2024-09-12T01:44:01.348 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.347+0000 7f4af13b8640 1 -- 172.21.15.60:0/4000973977 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4065140292 0 0) 0x7f4aec0b6830 con 0x7f4aec15e600 2024-09-12T01:44:01.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.348+0000 7f4af23ba640 1 --2- 172.21.15.60:0/4000973977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0b5be0 0x7f4aec15a9c0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80097a0 tx=0x7f4ae802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d10356722036b9d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:01.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.348+0000 7f4af13b8640 1 -- 172.21.15.60:0/4000973977 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8037070 con 0x7f4aec0b5be0 2024-09-12T01:44:01.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.348+0000 7f4af13b8640 1 -- 172.21.15.60:0/4000973977 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae802ae50 con 0x7f4aec0b5be0 2024-09-12T01:44:01.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.348+0000 7f4af13b8640 1 -- 172.21.15.60:0/4000973977 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8032660 con 0x7f4aec0b5be0 2024-09-12T01:44:01.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.349+0000 7f4af461e640 1 -- 172.21.15.60:0/4000973977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0b5be0 msgr2=0x7f4aec15a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.349+0000 7f4af461e640 1 --2- 172.21.15.60:0/4000973977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0b5be0 0x7f4aec15a9c0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80097a0 tx=0x7f4ae802a140 comp rx=0 tx=0).stop 2024-09-12T01:44:01.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.349+0000 7f4af461e640 1 -- 172.21.15.60:0/4000973977 shutdown_connections 2024-09-12T01:44:01.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.349+0000 7f4af461e640 1 --2- 172.21.15.60:0/4000973977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0b5be0 0x7f4aec15a9c0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.349+0000 7f4af461e640 1 -- 172.21.15.60:0/4000973977 >> 172.21.15.60:0/4000973977 conn(0x7f4aec06bc10 msgr2=0x7f4aec06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:01.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.349+0000 7f4af461e640 1 -- 172.21.15.60:0/4000973977 shutdown_connections 2024-09-12T01:44:01.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.349+0000 7f4af461e640 1 -- 172.21.15.60:0/4000973977 wait complete. 2024-09-12T01:44:01.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.350+0000 7f4af461e640 1 Processor -- start 2024-09-12T01:44:01.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.350+0000 7f4af461e640 1 -- start start 2024-09-12T01:44:01.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af461e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0b29a0 0x7f4aec14e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af461e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aec0b5be0 0x7f4aec151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af461e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4aec15e600 0x7f4aec153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af461e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec15f1c0 con 0x7f4aec0b29a0 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af461e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec15f410 con 0x7f4aec15e600 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af461e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec0cd950 con 0x7f4aec0b5be0 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af23ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0b29a0 0x7f4aec14e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af23ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0b29a0 0x7f4aec14e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41006/0 (socket says 172.21.15.60:41006) 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af23ba640 1 -- 172.21.15.60:0/3054005168 learned_addr learned my addr 172.21.15.60:0/3054005168 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af1bb9640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aec0b5be0 0x7f4aec151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af2bbb640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4aec15e600 0x7f4aec153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af23ba640 1 -- 172.21.15.60:0/3054005168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aec0b5be0 msgr2=0x7f4aec151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af23ba640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aec0b5be0 0x7f4aec151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af23ba640 1 -- 172.21.15.60:0/3054005168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4aec15e600 msgr2=0x7f4aec153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af23ba640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4aec15e600 0x7f4aec153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af23ba640 1 -- 172.21.15.60:0/3054005168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec1529f0 con 0x7f4aec0b29a0 2024-09-12T01:44:01.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.351+0000 7f4af1bb9640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aec0b5be0 0x7f4aec151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:01.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.352+0000 7f4af23ba640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0b29a0 0x7f4aec14e120 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80097a0 tx=0x7f4ae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:01.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.352+0000 7f4ae2ffd640 1 -- 172.21.15.60:0/3054005168 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8037040 con 0x7f4aec0b29a0 2024-09-12T01:44:01.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.352+0000 7f4ae2ffd640 1 -- 172.21.15.60:0/3054005168 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae8004030 con 0x7f4aec0b29a0 2024-09-12T01:44:01.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.352+0000 7f4af461e640 1 -- 172.21.15.60:0/3054005168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec152cd0 con 0x7f4aec0b29a0 2024-09-12T01:44:01.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.352+0000 7f4ae2ffd640 1 -- 172.21.15.60:0/3054005168 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8006e10 con 0x7f4aec0b29a0 2024-09-12T01:44:01.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.352+0000 7f4af461e640 1 -- 172.21.15.60:0/3054005168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec153290 con 0x7f4aec0b29a0 2024-09-12T01:44:01.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.353+0000 7f4af461e640 1 -- 172.21.15.60:0/3054005168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aec0cef80 con 0x7f4aec0b29a0 2024-09-12T01:44:01.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.353+0000 7f4ae2ffd640 1 -- 172.21.15.60:0/3054005168 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ae803d650 con 0x7f4aec0b29a0 2024-09-12T01:44:01.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.354+0000 7f4ae2ffd640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ad006be30 0x7f4ad006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:01.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.354+0000 7f4af1bb9640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ad006be30 0x7f4ad006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:01.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.354+0000 7f4ae2ffd640 1 -- 172.21.15.60:0/3054005168 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f4ae80ab680 con 0x7f4aec0b29a0 2024-09-12T01:44:01.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.354+0000 7f4af1bb9640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ad006be30 0x7f4ad006e2f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4aec071ae0 tx=0x7f4adc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:01.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.358+0000 7f4ae2ffd640 1 -- 172.21.15.60:0/3054005168 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ae8042020 con 0x7f4aec0b29a0 2024-09-12T01:44:01.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.574+0000 7f4af461e640 1 -- 172.21.15.60:0/3054005168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4aec0cea20 con 0x7f4aec0b29a0 2024-09-12T01:44:01.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.575+0000 7f4ae2ffd640 1 -- 172.21.15.60:0/3054005168 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v79) ==== 53+0+73 (secure 0 0 0) 0x7f4ae807a030 con 0x7f4aec0b29a0 2024-09-12T01:44:01.574 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:44:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.577+0000 7f4af461e640 1 -- 172.21.15.60:0/3054005168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ad006be30 msgr2=0x7f4ad006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.577+0000 7f4af461e640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ad006be30 0x7f4ad006e2f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f4aec071ae0 tx=0x7f4adc009040 comp rx=0 tx=0).stop 2024-09-12T01:44:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.577+0000 7f4af461e640 1 -- 172.21.15.60:0/3054005168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0b29a0 msgr2=0x7f4aec14e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.577+0000 7f4af461e640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0b29a0 0x7f4aec14e120 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f4ae80097a0 tx=0x7f4ae80046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.577+0000 7f4af461e640 1 -- 172.21.15.60:0/3054005168 shutdown_connections 2024-09-12T01:44:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.577+0000 7f4af461e640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4aec15e600 0x7f4aec153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.577+0000 7f4af461e640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ad006be30 0x7f4ad006e2f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.577+0000 7f4af461e640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aec0b5be0 0x7f4aec151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.577+0000 7f4af461e640 1 --2- 172.21.15.60:0/3054005168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aec0b29a0 0x7f4aec14e120 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:01.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.577+0000 7f4af461e640 1 -- 172.21.15.60:0/3054005168 >> 172.21.15.60:0/3054005168 conn(0x7f4aec06bc10 msgr2=0x7f4aec0cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:01.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.577+0000 7f4af461e640 1 -- 172.21.15.60:0/3054005168 shutdown_connections 2024-09-12T01:44:01.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01.577+0000 7f4af461e640 1 -- 172.21.15.60:0/3054005168 wait complete. 2024-09-12T01:44:01.587 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:44:01.587 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:44:01.588 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T01:44:01.588 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:44:01.588 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:44:01.588 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:44:01.588 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:44:01.588 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:44:01.588 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:44:01.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:01.588 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T01:44:01.605 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:44:01.605 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:44:01.605 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:44:01.605 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:01.605 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:44:01.605 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:01.605 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:44:01.605 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:01.605 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T01:44:01.605 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:44:01.605 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42279sec preferred_lft 42279sec 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:44:01.606 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:01.607 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:44:01.607 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:01.607 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e8cb:28ff:fea3:34fb/64 scope link 2024-09-12T01:44:01.607 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:01.607 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:44:01.607 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 72:47:53:4d:4f:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:44:01.607 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7047:53ff:fe4d:4fc7/64 scope link 2024-09-12T01:44:01.607 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:01.607 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:44:01.607 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:44:01.607 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::183c:47ff:fec1:173/64 scope link 2024-09-12T01:44:01.607 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:01.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:01.608 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:44:01.670 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T01:44:01.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:01.671 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T01:44:01.728 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T01:44:01.728 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:44:01.728 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:44:01.728 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:44:01.728 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:44:01.729 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:44:01.729 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:44:01.729 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:44:01.729 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:44:01.729 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:44:01.729 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:44:01.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:44:01.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:44:01.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:01.857 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:44:01.873 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:44:01.873 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:44:01.873 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:44:01.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:01.873 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-12T01:44:01.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:44:01.939 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:44:01.995 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:44:01.995 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:44:01.995 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:44:02.051 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T01:44:02.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:02.051 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:44:02.136 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:44:02.136 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:44:02.144 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:44:02.144 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:44:02.144 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:44:02.144 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:44:02.144 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:44:02.145 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:44:02.145 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:44:02.145 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:44:02.145 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:44:02.145 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:44:02.146 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:44:02.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:02.147 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:44:02.172 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:44:02.264 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:44:02.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:44:02.275 INFO:teuthology.orchestra.run.smithi060.stdout:client8151 2024-09-12T01:44:02.276 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:02.276 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:02.293 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:44:02.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.437+0000 7fa502af1640 1 Processor -- start 2024-09-12T01:44:02.436 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.437+0000 7fa502af1640 1 -- start start 2024-09-12T01:44:02.437 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.437+0000 7fa502af1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4fc15c470 0x7fa4fc0b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:02.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.437+0000 7fa502af1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa4fc0cfa80 0x7fa4fc0b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:02.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.437+0000 7fa502af1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4fc15c850 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.437+0000 7fa502af1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa4fc0b4160 con 0x7fa4fc0cfa80 2024-09-12T01:44:02.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.437+0000 7fa502af1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4fc0b4440 con 0x7fa4fc15c470 2024-09-12T01:44:02.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.438+0000 7fa50108e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa4fc0cfa80 0x7fa4fc0b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:02.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.438+0000 7fa4fbfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa4fc0b3c50 0x7fa4fc0cf370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:36356/0 (socket says 172.21.15.60:36356) 2024-09-12T01:44:02.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.438+0000 7fa4fbfff640 1 -- 172.21.15.60:0/2245229659 learned_addr learned my addr 172.21.15.60:0/2245229659 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:02.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.438+0000 7fa50088d640 1 --2- 172.21.15.60:0/2245229659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4fc15c470 0x7fa4fc0b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:02.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.438+0000 7fa50108e640 1 -- 172.21.15.60:0/2245229659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4fc15c470 msgr2=0x7fa4fc0b3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:02.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.438+0000 7fa50108e640 1 --2- 172.21.15.60:0/2245229659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4fc15c470 0x7fa4fc0b3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:02.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.438+0000 7fa50108e640 1 -- 172.21.15.60:0/2245229659 >> v1:172.21.15.60:6789/0 conn(0x7fa4fc0b3c50 legacy=0x7fa4fc0cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:02.438 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.438+0000 7fa50108e640 1 -- 172.21.15.60:0/2245229659 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc0b4720 con 0x7fa4fc0cfa80 2024-09-12T01:44:02.439 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.438+0000 7fa4fb7fe640 1 -- 172.21.15.60:0/2245229659 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374176033 0 0) 0x7fa4fc15c850 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.439+0000 7fa50108e640 1 --2- 172.21.15.60:0/2245229659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4fc0cfa80 0x7fa4fc0b52b0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0097a0 tx=0x7fa4ec02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2794fec4af72268 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:02.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.439+0000 7fa4fb7fe640 1 -- 172.21.15.60:0/2245229659 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec037070 con 0x7fa4fc0cfa80 2024-09-12T01:44:02.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.439+0000 7fa4fb7fe640 1 -- 172.21.15.60:0/2245229659 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ec032440 con 0x7fa4fc0cfa80 2024-09-12T01:44:02.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.439+0000 7fa4fb7fe640 1 -- 172.21.15.60:0/2245229659 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec032810 con 0x7fa4fc0cfa80 2024-09-12T01:44:02.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.439+0000 7fa502af1640 1 -- 172.21.15.60:0/2245229659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4fc0cfa80 msgr2=0x7fa4fc0b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:02.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.439+0000 7fa502af1640 1 --2- 172.21.15.60:0/2245229659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4fc0cfa80 0x7fa4fc0b52b0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0097a0 tx=0x7fa4ec02a180 comp rx=0 tx=0).stop 2024-09-12T01:44:02.440 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.439+0000 7fa502af1640 1 -- 172.21.15.60:0/2245229659 shutdown_connections 2024-09-12T01:44:02.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.439+0000 7fa502af1640 1 --2- 172.21.15.60:0/2245229659 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4fc0cfa80 0x7fa4fc0b52b0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:02.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.439+0000 7fa502af1640 1 --2- 172.21.15.60:0/2245229659 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4fc15c470 0x7fa4fc0b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:02.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.439+0000 7fa502af1640 1 -- 172.21.15.60:0/2245229659 >> 172.21.15.60:0/2245229659 conn(0x7fa4fc06bc10 msgr2=0x7fa4fc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:02.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.439+0000 7fa502af1640 1 -- 172.21.15.60:0/2245229659 shutdown_connections 2024-09-12T01:44:02.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.440+0000 7fa502af1640 1 -- 172.21.15.60:0/2245229659 wait complete. 2024-09-12T01:44:02.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.441+0000 7fa502af1640 1 Processor -- start 2024-09-12T01:44:02.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.441+0000 7fa502af1640 1 -- start start 2024-09-12T01:44:02.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa502af1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4fc0b3c50 0x7fa4fc143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:02.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa502af1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4fc0cfa80 0x7fa4fc153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:02.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa502af1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4fc15c470 0x7fa4fc1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:02.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa502af1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc06e1b0 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa502af1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4fc0b4d90 con 0x7fa4fc15c470 2024-09-12T01:44:02.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa502af1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4fc0b57f0 con 0x7fa4fc0cfa80 2024-09-12T01:44:02.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa50088d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4fc0b3c50 0x7fa4fc143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:02.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa50088d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4fc0b3c50 0x7fa4fc143cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41026/0 (socket says 172.21.15.60:41026) 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa50088d640 1 -- 172.21.15.60:0/1243137577 learned_addr learned my addr 172.21.15.60:0/1243137577 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa4fbfff640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4fc0cfa80 0x7fa4fc153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa50108e640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4fc15c470 0x7fa4fc1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa50088d640 1 -- 172.21.15.60:0/1243137577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4fc0cfa80 msgr2=0x7fa4fc153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa50088d640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4fc0cfa80 0x7fa4fc153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa50088d640 1 -- 172.21.15.60:0/1243137577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4fc15c470 msgr2=0x7fa4fc1516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa50088d640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4fc15c470 0x7fa4fc1516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa50088d640 1 -- 172.21.15.60:0/1243137577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4fc151ee0 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa50088d640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4fc0b3c50 0x7fa4fc143cb0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4007e40 tx=0x7fa4f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa4f97fa640 1 -- 172.21.15.60:0/1243137577 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4014620 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa4f97fa640 1 -- 172.21.15.60:0/1243137577 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4f4019070 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.442+0000 7fa502af1640 1 -- 172.21.15.60:0/1243137577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4fc1521c0 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.443+0000 7fa4f97fa640 1 -- 172.21.15.60:0/1243137577 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4014a00 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.443+0000 7fa502af1640 1 -- 172.21.15.60:0/1243137577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4fc152780 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.443+0000 7fa502af1640 1 -- 172.21.15.60:0/1243137577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4fc0b52b0 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.444+0000 7fa4f97fa640 1 -- 172.21.15.60:0/1243137577 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4f4014ba0 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.445+0000 7fa4f97fa640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa4dc06be30 0x7fa4dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:02.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.445+0000 7fa4f97fa640 1 -- 172.21.15.60:0/1243137577 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fa4f408b5b0 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.445+0000 7fa4fbfff640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa4dc06be30 0x7fa4dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:02.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.445+0000 7fa4fbfff640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa4dc06be30 0x7fa4dc06e2f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0cf550 tx=0x7fa4e4007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:02.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.449+0000 7fa4f97fa640 1 -- 172.21.15.60:0/1243137577 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4f4059910 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.660+0000 7fa502af1640 1 -- 172.21.15.60:0/1243137577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa4fc156b70 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.661+0000 7fa4f97fa640 1 -- 172.21.15.60:0/1243137577 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v79) ==== 53+0+73 (secure 0 0 0) 0x7fa4f405dc10 con 0x7fa4fc0b3c50 2024-09-12T01:44:02.660 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:44:02.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.662+0000 7fa502af1640 1 -- 172.21.15.60:0/1243137577 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa4dc06be30 msgr2=0x7fa4dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:02.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.662+0000 7fa502af1640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa4dc06be30 0x7fa4dc06e2f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0cf550 tx=0x7fa4e4007d50 comp rx=0 tx=0).stop 2024-09-12T01:44:02.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.662+0000 7fa502af1640 1 -- 172.21.15.60:0/1243137577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4fc0b3c50 msgr2=0x7fa4fc143cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:02.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.662+0000 7fa502af1640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4fc0b3c50 0x7fa4fc143cb0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4007e40 tx=0x7fa4f400e4b0 comp rx=0 tx=0).stop 2024-09-12T01:44:02.662 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.663+0000 7fa502af1640 1 -- 172.21.15.60:0/1243137577 shutdown_connections 2024-09-12T01:44:02.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.663+0000 7fa502af1640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4fc15c470 0x7fa4fc1516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:02.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.663+0000 7fa502af1640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa4dc06be30 0x7fa4dc06e2f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:02.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.663+0000 7fa502af1640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4fc0cfa80 0x7fa4fc153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:02.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.663+0000 7fa502af1640 1 --2- 172.21.15.60:0/1243137577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4fc0b3c50 0x7fa4fc143cb0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:02.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.663+0000 7fa502af1640 1 -- 172.21.15.60:0/1243137577 >> 172.21.15.60:0/1243137577 conn(0x7fa4fc06bc10 msgr2=0x7fa4fc15b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:02.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.663+0000 7fa502af1640 1 -- 172.21.15.60:0/1243137577 shutdown_connections 2024-09-12T01:44:02.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:02.663+0000 7fa502af1640 1 -- 172.21.15.60:0/1243137577 wait complete. 2024-09-12T01:44:02.674 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:44:02.674 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:44:02.674 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T01:44:02.674 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:44:02.674 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:44:02.674 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:44:02.674 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:44:02.674 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:44:02.674 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:44:02.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:02.674 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T01:44:02.695 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:44:02.695 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:44:02.695 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:44:02.695 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:02.695 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:44:02.695 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:02.695 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:44:02.695 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42280sec preferred_lft 42280sec 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:44:02.696 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:02.697 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:44:02.697 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:02.697 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::c46c:baff:feeb:1f5e/64 scope link 2024-09-12T01:44:02.697 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:02.697 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:44:02.697 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 56:66:28:3d:b2:45 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:44:02.697 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::5466:28ff:fe3d:b245/64 scope link 2024-09-12T01:44:02.697 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:02.697 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:44:02.697 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:44:02.697 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::2036:4aff:fe87:b9cb/64 scope link 2024-09-12T01:44:02.697 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:02.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:02.698 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:44:02.765 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:44:02.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:02.767 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T01:44:02.825 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T01:44:02.825 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:44:02.825 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:44:02.825 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:44:02.825 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:44:02.826 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:44:02.826 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:44:02.826 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:44:02.826 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:44:02.826 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:44:02.826 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:44:02.918 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:44:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:44:02.952 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:44:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:44:02.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:02.958 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:44:02.974 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T01:44:02.974 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:44:02.974 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:44:02.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:02.975 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-12T01:44:03.039 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:44:03.039 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:44:03.095 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:44:03.096 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:44:03.096 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:44:03.150 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T01:44:03.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:03.150 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:44:03.234 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:44:03.234 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:44:03.241 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:44:03.242 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:44:03.242 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:44:03.242 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 1@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:44:03.242 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:44:03.242 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:44:03.242 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:44:03.242 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:44:03.242 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:44:03.242 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:44:03.244 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:44:03.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:03.244 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:44:03.309 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:44:03.398 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:44:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:44:03.399 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:44:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:44:03.405 INFO:teuthology.orchestra.run.smithi105.stdout:client8163 2024-09-12T01:44:03.405 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:44:03.406 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:03.422 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_cache_memory_limit 1K 2024-09-12T01:44:03.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.541+0000 7fe2b2786640 1 Processor -- start 2024-09-12T01:44:03.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.541+0000 7fe2b2786640 1 -- start start 2024-09-12T01:44:03.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.541+0000 7fe2b2786640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe2ac15e7a0 0x7fe2ac06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.541+0000 7fe2b2786640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0cf1f0 0x7fe2ac0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2b2786640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2ac0cf860 con 0x7fe2ac0b6720 2024-09-12T01:44:03.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2b2786640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe2ac0d2ca0 con 0x7fe2ac15e7a0 2024-09-12T01:44:03.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2b2786640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ac0cfb40 con 0x7fe2ac0cf1f0 2024-09-12T01:44:03.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2ab7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0cf1f0 0x7fe2ac0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2abfff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe2ac15e7a0 0x7fe2ac06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2b0d23640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fe2ac0b6720 0x7fe2ac1623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:60940/0 (socket says 172.21.15.60:60940) 2024-09-12T01:44:03.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2b0d23640 1 -- 172.21.15.60:0/4294597533 learned_addr learned my addr 172.21.15.60:0/4294597533 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:03.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2abfff640 1 -- 172.21.15.60:0/4294597533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0cf1f0 msgr2=0x7fe2ac0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:03.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2abfff640 1 --2- 172.21.15.60:0/4294597533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0cf1f0 0x7fe2ac0b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2abfff640 1 -- 172.21.15.60:0/4294597533 >> v1:172.21.15.105:6789/0 conn(0x7fe2ac0b6720 legacy=0x7fe2ac1623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:03.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2abfff640 1 -- 172.21.15.60:0/4294597533 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ac0cfe20 con 0x7fe2ac15e7a0 2024-09-12T01:44:03.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2aaffd640 1 -- 172.21.15.60:0/4294597533 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529943192 0 0) 0x7fe2ac0cf860 con 0x7fe2ac0b6720 2024-09-12T01:44:03.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.542+0000 7fe2ab7fe640 1 --2- 172.21.15.60:0/4294597533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0cf1f0 0x7fe2ac0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:03.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.543+0000 7fe2abfff640 1 --2- 172.21.15.60:0/4294597533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ac15e7a0 0x7fe2ac06caa0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0097a0 tx=0x7fe29c02a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=212a7f745581d8d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:03.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.543+0000 7fe2aaffd640 1 -- 172.21.15.60:0/4294597533 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c037070 con 0x7fe2ac15e7a0 2024-09-12T01:44:03.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.543+0000 7fe2aaffd640 1 -- 172.21.15.60:0/4294597533 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29c02ae40 con 0x7fe2ac15e7a0 2024-09-12T01:44:03.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.543+0000 7fe2aaffd640 1 -- 172.21.15.60:0/4294597533 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c032660 con 0x7fe2ac15e7a0 2024-09-12T01:44:03.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.544+0000 7fe2b2786640 1 -- 172.21.15.60:0/4294597533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ac15e7a0 msgr2=0x7fe2ac06caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:03.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.544+0000 7fe2b2786640 1 --2- 172.21.15.60:0/4294597533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ac15e7a0 0x7fe2ac06caa0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0097a0 tx=0x7fe29c02a0f0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.544+0000 7fe2b2786640 1 -- 172.21.15.60:0/4294597533 shutdown_connections 2024-09-12T01:44:03.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.544+0000 7fe2b2786640 1 --2- 172.21.15.60:0/4294597533 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0cf1f0 0x7fe2ac0b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.544+0000 7fe2b2786640 1 --2- 172.21.15.60:0/4294597533 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ac15e7a0 0x7fe2ac06caa0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.544+0000 7fe2b2786640 1 -- 172.21.15.60:0/4294597533 >> 172.21.15.60:0/4294597533 conn(0x7fe2ac0d11e0 msgr2=0x7fe2ac0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:03.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.544+0000 7fe2b2786640 1 -- 172.21.15.60:0/4294597533 shutdown_connections 2024-09-12T01:44:03.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.544+0000 7fe2b2786640 1 -- 172.21.15.60:0/4294597533 wait complete. 2024-09-12T01:44:03.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.545+0000 7fe2b2786640 1 Processor -- start 2024-09-12T01:44:03.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.545+0000 7fe2b2786640 1 -- start start 2024-09-12T01:44:03.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.546+0000 7fe2b2786640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0b6720 0x7fe2ac14fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.546+0000 7fe2b2786640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2ac0cf1f0 0x7fe2ac155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.546+0000 7fe2b2786640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ac15e7a0 0x7fe2ac0b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.546+0000 7fe2b2786640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac06cfe0 con 0x7fe2ac0cf1f0 2024-09-12T01:44:03.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.546+0000 7fe2b2786640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac0b7a00 con 0x7fe2ac15e7a0 2024-09-12T01:44:03.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.546+0000 7fe2b2786640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ac0d4420 con 0x7fe2ac0b6720 2024-09-12T01:44:03.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.546+0000 7fe2abfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0b6720 0x7fe2ac14fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.546+0000 7fe2ab7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2ac0cf1f0 0x7fe2ac155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.546+0000 7fe2abfff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0b6720 0x7fe2ac14fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:51752/0 (socket says 172.21.15.60:51752) 2024-09-12T01:44:03.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.546+0000 7fe2abfff640 1 -- 172.21.15.60:0/1273645987 learned_addr learned my addr 172.21.15.60:0/1273645987 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:03.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.546+0000 7fe2b0d23640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ac15e7a0 0x7fe2ac0b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.547+0000 7fe2abfff640 1 -- 172.21.15.60:0/1273645987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ac15e7a0 msgr2=0x7fe2ac0b8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:03.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.547+0000 7fe2abfff640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ac15e7a0 0x7fe2ac0b8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.547+0000 7fe2abfff640 1 -- 172.21.15.60:0/1273645987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2ac0cf1f0 msgr2=0x7fe2ac155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:03.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.547+0000 7fe2abfff640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2ac0cf1f0 0x7fe2ac155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.547+0000 7fe2abfff640 1 -- 172.21.15.60:0/1273645987 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ac153fd0 con 0x7fe2ac0b6720 2024-09-12T01:44:03.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.547+0000 7fe2abfff640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0b6720 0x7fe2ac14fb20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0097a0 tx=0x7fe29c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:03.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.547+0000 7fe2a8ff9640 1 -- 172.21.15.60:0/1273645987 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c037040 con 0x7fe2ac0b6720 2024-09-12T01:44:03.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.547+0000 7fe2a8ff9640 1 -- 172.21.15.60:0/1273645987 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29c004030 con 0x7fe2ac0b6720 2024-09-12T01:44:03.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.547+0000 7fe2b2786640 1 -- 172.21.15.60:0/1273645987 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ac1542b0 con 0x7fe2ac0b6720 2024-09-12T01:44:03.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.547+0000 7fe2a8ff9640 1 -- 172.21.15.60:0/1273645987 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c006e10 con 0x7fe2ac0b6720 2024-09-12T01:44:03.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.547+0000 7fe2b2786640 1 -- 172.21.15.60:0/1273645987 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ac154870 con 0x7fe2ac0b6720 2024-09-12T01:44:03.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.548+0000 7fe2b2786640 1 -- 172.21.15.60:0/1273645987 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2ac15eb80 con 0x7fe2ac0b6720 2024-09-12T01:44:03.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.549+0000 7fe2a8ff9640 1 -- 172.21.15.60:0/1273645987 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe29c003610 con 0x7fe2ac0b6720 2024-09-12T01:44:03.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.549+0000 7fe2a8ff9640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe29806be30 0x7fe29806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.549+0000 7fe2ab7fe640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe29806be30 0x7fe29806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.549+0000 7fe2a8ff9640 1 -- 172.21.15.60:0/1273645987 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fe29c0ab4c0 con 0x7fe2ac0b6720 2024-09-12T01:44:03.553 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.549+0000 7fe2ab7fe640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe29806be30 0x7fe29806e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009560 tx=0x7fe2a0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:03.554 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.554+0000 7fe2a8ff9640 1 -- 172.21.15.60:0/1273645987 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe29c042020 con 0x7fe2ac0b6720 2024-09-12T01:44:03.729 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.730+0000 7fe2b2786640 1 -- 172.21.15.60:0/1273645987 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command([{prefix=config set, name=mds_cache_memory_limit}] v 0) -- 0x7fe2ac15b9a0 con 0x7fe2ac0b6720 2024-09-12T01:44:03.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.735+0000 7fe2a8ff9640 1 -- 172.21.15.60:0/1273645987 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_cache_memory_limit}]=0 v57)=0 v57) ==== 121+0+0 (secure 0 0 0) 0x7fe29c079820 con 0x7fe2ac0b6720 2024-09-12T01:44:03.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.737+0000 7fe2b2786640 1 -- 172.21.15.60:0/1273645987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe29806be30 msgr2=0x7fe29806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:03.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.737+0000 7fe2b2786640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe29806be30 0x7fe29806e2f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009560 tx=0x7fe2a0009190 comp rx=0 tx=0).stop 2024-09-12T01:44:03.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.737+0000 7fe2b2786640 1 -- 172.21.15.60:0/1273645987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0b6720 msgr2=0x7fe2ac14fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:03.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.737+0000 7fe2b2786640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0b6720 0x7fe2ac14fb20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0097a0 tx=0x7fe29c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.737+0000 7fe2b2786640 1 -- 172.21.15.60:0/1273645987 shutdown_connections 2024-09-12T01:44:03.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.737+0000 7fe2b2786640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe2ac15e7a0 0x7fe2ac0b8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.737+0000 7fe2b2786640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2ac0cf1f0 0x7fe2ac155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.737+0000 7fe2b2786640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe29806be30 0x7fe29806e2f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.737+0000 7fe2b2786640 1 --2- 172.21.15.60:0/1273645987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe2ac0b6720 0x7fe2ac14fb20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.737+0000 7fe2b2786640 1 -- 172.21.15.60:0/1273645987 >> 172.21.15.60:0/1273645987 conn(0x7fe2ac0d11e0 msgr2=0x7fe2ac0d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:03.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.737+0000 7fe2b2786640 1 -- 172.21.15.60:0/1273645987 shutdown_connections 2024-09-12T01:44:03.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.737+0000 7fe2b2786640 1 -- 172.21.15.60:0/1273645987 wait complete. 2024-09-12T01:44:03.748 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_max_caps 200 2024-09-12T01:44:03.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.854+0000 7f2aadbc0640 1 Processor -- start 2024-09-12T01:44:03.854 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.854+0000 7f2aadbc0640 1 -- start start 2024-09-12T01:44:03.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aadbc0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2aa815a060 0x7f2aa806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aadbc0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2aa815d3d0 0x7f2aa806f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aadbc0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2aa80b1990 0x7f2aa815ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aadbc0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f2aa80712e0 con 0x7f2aa815d3d0 2024-09-12T01:44:03.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aadbc0640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f2aa8071770 con 0x7f2aa815a060 2024-09-12T01:44:03.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aadbc0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2aa80709b0 con 0x7f2aa80b1990 2024-09-12T01:44:03.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aa6ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2aa815d3d0 0x7f2aa806f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.855 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aa6ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2aa815d3d0 0x7f2aa806f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38920/0 (socket says 172.21.15.60:38920) 2024-09-12T01:44:03.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aa6ffd640 1 -- 172.21.15.60:0/357464679 learned_addr learned my addr 172.21.15.60:0/357464679 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:03.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aa7fff640 1 --2- 172.21.15.60:0/357464679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2aa80b1990 0x7f2aa815ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aa77fe640 1 --2- 172.21.15.60:0/357464679 >> v2:172.21.15.105:3300/0 conn(0x7f2aa815a060 0x7f2aa806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aa6ffd640 1 -- 172.21.15.60:0/357464679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2aa80b1990 msgr2=0x7f2aa815ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:03.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aa6ffd640 1 --2- 172.21.15.60:0/357464679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2aa80b1990 0x7f2aa815ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aa6ffd640 1 -- 172.21.15.60:0/357464679 >> v2:172.21.15.105:3300/0 conn(0x7f2aa815a060 msgr2=0x7f2aa806f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:03.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aa6ffd640 1 --2- 172.21.15.60:0/357464679 >> v2:172.21.15.105:3300/0 conn(0x7f2aa815a060 0x7f2aa806f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aa6ffd640 1 -- 172.21.15.60:0/357464679 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa8070c90 con 0x7f2aa815d3d0 2024-09-12T01:44:03.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aa77fe640 1 --2- 172.21.15.60:0/357464679 >> v2:172.21.15.105:3300/0 conn(0x7f2aa815a060 0x7f2aa806f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:03.856 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.855+0000 7f2aa7fff640 1 --2- 172.21.15.60:0/357464679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2aa80b1990 0x7f2aa815ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:03.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.856+0000 7f2aa6ffd640 1 --2- 172.21.15.60:0/357464679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aa815d3d0 0x7f2aa806f830 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80759d0 tx=0x7f2a9c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a15680fbe720a19 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:03.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.856+0000 7f2aa67fc640 1 -- 172.21.15.60:0/357464679 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c037070 con 0x7f2aa815d3d0 2024-09-12T01:44:03.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.856+0000 7f2aa67fc640 1 -- 172.21.15.60:0/357464679 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9c032440 con 0x7f2aa815d3d0 2024-09-12T01:44:03.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.856+0000 7f2aa67fc640 1 -- 172.21.15.60:0/357464679 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c032810 con 0x7f2aa815d3d0 2024-09-12T01:44:03.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.857+0000 7f2aadbc0640 1 -- 172.21.15.60:0/357464679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aa815d3d0 msgr2=0x7f2aa806f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:03.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.857+0000 7f2aadbc0640 1 --2- 172.21.15.60:0/357464679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aa815d3d0 0x7f2aa806f830 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f2aa80759d0 tx=0x7f2a9c02a1e0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.857+0000 7f2aadbc0640 1 -- 172.21.15.60:0/357464679 shutdown_connections 2024-09-12T01:44:03.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.857+0000 7f2aadbc0640 1 --2- 172.21.15.60:0/357464679 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2aa80b1990 0x7f2aa815ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.857+0000 7f2aadbc0640 1 --2- 172.21.15.60:0/357464679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aa815d3d0 0x7f2aa806f830 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.857+0000 7f2aadbc0640 1 --2- 172.21.15.60:0/357464679 >> v2:172.21.15.105:3300/0 conn(0x7f2aa815a060 0x7f2aa806f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.857+0000 7f2aadbc0640 1 -- 172.21.15.60:0/357464679 >> 172.21.15.60:0/357464679 conn(0x7f2aa80d2430 msgr2=0x7f2aa80d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:03.858 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.857+0000 7f2aadbc0640 1 -- 172.21.15.60:0/357464679 shutdown_connections 2024-09-12T01:44:03.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.857+0000 7f2aadbc0640 1 -- 172.21.15.60:0/357464679 wait complete. 2024-09-12T01:44:03.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.858+0000 7f2aadbc0640 1 Processor -- start 2024-09-12T01:44:03.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.858+0000 7f2aadbc0640 1 -- start start 2024-09-12T01:44:03.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aadbc0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2aa80b1990 0x7f2aa80ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aadbc0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2aa815a060 0x7f2aa815cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aadbc0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aa815d3d0 0x7f2aa815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aadbc0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa8070030 con 0x7f2aa815d3d0 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aadbc0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa806feb0 con 0x7f2aa80b1990 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aadbc0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f2aa8160480 con 0x7f2aa815a060 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aa7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aa815d3d0 0x7f2aa815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aa7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aa815d3d0 0x7f2aa815f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38928/0 (socket says 172.21.15.60:38928) 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aa7fff640 1 -- 172.21.15.60:0/4231596403 learned_addr learned my addr 172.21.15.60:0/4231596403 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aa6ffd640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2aa815a060 0x7f2aa815cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aa77fe640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2aa80b1990 0x7f2aa80ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aa7fff640 1 -- 172.21.15.60:0/4231596403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2aa815a060 msgr2=0x7f2aa815cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aa7fff640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2aa815a060 0x7f2aa815cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aa7fff640 1 -- 172.21.15.60:0/4231596403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2aa80b1990 msgr2=0x7f2aa80ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aa7fff640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2aa80b1990 0x7f2aa80ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aa7fff640 1 -- 172.21.15.60:0/4231596403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa80b0fc0 con 0x7f2aa815d3d0 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.859+0000 7f2aa7fff640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aa815d3d0 0x7f2aa815f1a0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000cf20 tx=0x7f2aa000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:03.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.860+0000 7f2a8ffff640 1 -- 172.21.15.60:0/4231596403 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa001a070 con 0x7f2aa815d3d0 2024-09-12T01:44:03.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.860+0000 7f2a8ffff640 1 -- 172.21.15.60:0/4231596403 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2aa000d840 con 0x7f2aa815d3d0 2024-09-12T01:44:03.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.860+0000 7f2aadbc0640 1 -- 172.21.15.60:0/4231596403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa80aee70 con 0x7f2aa815d3d0 2024-09-12T01:44:03.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.860+0000 7f2a8ffff640 1 -- 172.21.15.60:0/4231596403 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2aa000dc30 con 0x7f2aa815d3d0 2024-09-12T01:44:03.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.860+0000 7f2aadbc0640 1 -- 172.21.15.60:0/4231596403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa80b1540 con 0x7f2aa815d3d0 2024-09-12T01:44:03.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.861+0000 7f2aadbc0640 1 -- 172.21.15.60:0/4231596403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2aa806c6c0 con 0x7f2aa815d3d0 2024-09-12T01:44:03.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.861+0000 7f2a8ffff640 1 -- 172.21.15.60:0/4231596403 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2aa001d070 con 0x7f2aa815d3d0 2024-09-12T01:44:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.862+0000 7f2a8ffff640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a9406be30 0x7f2a9406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.862+0000 7f2a8ffff640 1 -- 172.21.15.60:0/4231596403 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f2aa008b670 con 0x7f2aa815d3d0 2024-09-12T01:44:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.862+0000 7f2aa77fe640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a9406be30 0x7f2a9406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:03.863 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.862+0000 7f2aa77fe640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a9406be30 0x7f2a9406e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800ab60 tx=0x7f2a98008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:03.865 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:03.866+0000 7f2a8ffff640 1 -- 172.21.15.60:0/4231596403 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2aa0059940 con 0x7f2aa815d3d0 2024-09-12T01:44:04.039 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.040+0000 7f2aadbc0640 1 -- 172.21.15.60:0/4231596403 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_recall_max_caps}] v 0) -- 0x7f2aa80d2c20 con 0x7f2aa815d3d0 2024-09-12T01:44:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.043+0000 7f2a8ffff640 1 -- 172.21.15.60:0/4231596403 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_max_caps}]=0 v58)=0 v58) ==== 119+0+0 (secure 0 0 0) 0x7f2aa005dc40 con 0x7f2aa815d3d0 2024-09-12T01:44:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.046+0000 7f2aadbc0640 1 -- 172.21.15.60:0/4231596403 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a9406be30 msgr2=0x7f2a9406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.046+0000 7f2aadbc0640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a9406be30 0x7f2a9406e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800ab60 tx=0x7f2a98008040 comp rx=0 tx=0).stop 2024-09-12T01:44:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.046+0000 7f2aadbc0640 1 -- 172.21.15.60:0/4231596403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aa815d3d0 msgr2=0x7f2aa815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.046+0000 7f2aadbc0640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aa815d3d0 0x7f2aa815f1a0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000cf20 tx=0x7f2aa000a710 comp rx=0 tx=0).stop 2024-09-12T01:44:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.046+0000 7f2aadbc0640 1 -- 172.21.15.60:0/4231596403 shutdown_connections 2024-09-12T01:44:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.046+0000 7f2aadbc0640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aa815d3d0 0x7f2aa815f1a0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.046+0000 7f2aadbc0640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f2a9406be30 0x7f2a9406e2f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.046+0000 7f2aadbc0640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2aa815a060 0x7f2aa815cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.046+0000 7f2aadbc0640 1 --2- 172.21.15.60:0/4231596403 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2aa80b1990 0x7f2aa80ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.046+0000 7f2aadbc0640 1 -- 172.21.15.60:0/4231596403 >> 172.21.15.60:0/4231596403 conn(0x7f2aa80d2430 msgr2=0x7f2aa806f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:04.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.046+0000 7f2aadbc0640 1 -- 172.21.15.60:0/4231596403 shutdown_connections 2024-09-12T01:44:04.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.046+0000 7f2aadbc0640 1 -- 172.21.15.60:0/4231596403 wait complete. 2024-09-12T01:44:04.057 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_recall_warning_threshold 400 2024-09-12T01:44:04.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.163+0000 7f31d0fbe640 1 Processor -- start 2024-09-12T01:44:04.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.163+0000 7f31d0fbe640 1 -- start start 2024-09-12T01:44:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31d0fbe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31cc0b7450 0x7f31cc06fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31d0fbe640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31cc06e990 con 0x7f31cc15e6f0 2024-09-12T01:44:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31d0fbe640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31cc06ec70 con 0x7f31cc0b54d0 2024-09-12T01:44:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31d0fbe640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31cc15ec70 con 0x7f31cc0b7450 2024-09-12T01:44:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31ca59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f31cc15e6f0 0x7f31cc0b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55024/0 (socket says 172.21.15.60:55024) 2024-09-12T01:44:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31ca59c640 1 -- 172.21.15.60:0/1560829804 learned_addr learned my addr 172.21.15.60:0/1560829804 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31cad9d640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31cc0b7450 0x7f31cc06fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556615039 0 0) 0x7f31cc06e990 con 0x7f31cc15e6f0 2024-09-12T01:44:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31b8003520 con 0x7f31cc15e6f0 2024-09-12T01:44:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547876486 0 0) 0x7f31cc06ec70 con 0x7f31cc0b54d0 2024-09-12T01:44:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31cc06e990 con 0x7f31cc0b54d0 2024-09-12T01:44:04.167 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2510968782 0 0) 0x7f31b8003520 con 0x7f31cc15e6f0 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31cc0b7450 msgr2=0x7f31cc06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31c9d9b640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31cc0b7450 0x7f31cc06fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.164+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 >> v1:172.21.15.105:6789/0 conn(0x7f31cc0b54d0 legacy=0x7f31cc070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31cc15ef50 con 0x7f31cc15e6f0 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f31bc001670 con 0x7f31cc15e6f0 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31cad9d640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31cc0b7450 0x7f31cc06fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 >> v1:172.21.15.60:6789/0 conn(0x7f31cc15e6f0 legacy=0x7f31cc0b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c9d9b640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31b8003b70 0x7f31b8003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c9d9b640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b8004800 0x7f31b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c9d9b640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31b80051c0 0x7f31b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc15ec70 con 0x7f31b8004800 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31b800bfe0 con 0x7f31b80051c0 2024-09-12T01:44:04.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31b800c1e0 con 0x7f31b8003b70 2024-09-12T01:44:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c3fff640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b8004800 0x7f31b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31ca59c640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31b8003b70 0x7f31b8003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31cad9d640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31b80051c0 0x7f31b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c3fff640 1 -- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31b8003b70 msgr2=0x7f31b8003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c3fff640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31b8003b70 0x7f31b8003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c3fff640 1 -- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31b80051c0 msgr2=0x7f31b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c3fff640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31b80051c0 0x7f31b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31c3fff640 1 -- 172.21.15.60:0/1560829804 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b8003520 con 0x7f31b8004800 2024-09-12T01:44:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.165+0000 7f31ca59c640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31b8003b70 0x7f31b8003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:04.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.166+0000 7f31c3fff640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b8004800 0x7f31b8004c80 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f31b40018a0 tx=0x7f31b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4ab269bce64be3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.166+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b40014f0 con 0x7f31b8004800 2024-09-12T01:44:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.166+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b40052d0 con 0x7f31b8004800 2024-09-12T01:44:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.166+0000 7f31c9d9b640 1 -- 172.21.15.60:0/1560829804 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b402ac60 con 0x7f31b8004800 2024-09-12T01:44:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.166+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1560829804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b8004800 msgr2=0x7f31b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.166+0000 7f31d0fbe640 1 --2- 172.21.15.60:0/1560829804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b8004800 0x7f31b8004c80 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f31b40018a0 tx=0x7f31b8005830 comp rx=0 tx=0).stop 2024-09-12T01:44:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.166+0000 7f31cad9d640 1 -- 172.21.15.60:0/1560829804 reap_dead start 2024-09-12T01:44:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.166+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1560829804 shutdown_connections 2024-09-12T01:44:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.166+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1560829804 >> 172.21.15.60:0/1560829804 conn(0x7f31cc0d2430 msgr2=0x7f31cc0d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.166+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1560829804 shutdown_connections 2024-09-12T01:44:04.170 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.166+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1560829804 wait complete. 2024-09-12T01:44:04.173 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.168+0000 7f31d0fbe640 1 Processor -- start 2024-09-12T01:44:04.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.168+0000 7f31d0fbe640 1 -- start start 2024-09-12T01:44:04.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31d0fbe640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31b8004800 0x7f31cc151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31d0fbe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31cc1f7a90 0x7f31cc155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31d0fbe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31cc1f7f10 0x7f31cc155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31d0fbe640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc06e730 con 0x7f31cc1f7f10 2024-09-12T01:44:04.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31d0fbe640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31cc06e5b0 con 0x7f31b8004800 2024-09-12T01:44:04.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31d0fbe640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31cc06fd00 con 0x7f31cc1f7a90 2024-09-12T01:44:04.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31cad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31cc1f7f10 0x7f31cc155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31cad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31cc1f7f10 0x7f31cc155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38950/0 (socket says 172.21.15.60:38950) 2024-09-12T01:44:04.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31cad9d640 1 -- 172.21.15.60:0/1307711746 learned_addr learned my addr 172.21.15.60:0/1307711746 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31cad9d640 1 -- 172.21.15.60:0/1307711746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31cc1f7a90 msgr2=0x7f31cc155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31c3fff640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31cc1f7a90 0x7f31cc155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31ca59c640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31b8004800 0x7f31cc151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31cad9d640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31cc1f7a90 0x7f31cc155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31cad9d640 1 -- 172.21.15.60:0/1307711746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31b8004800 msgr2=0x7f31cc151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31cad9d640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31b8004800 0x7f31cc151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31cad9d640 1 -- 172.21.15.60:0/1307711746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31cc150e40 con 0x7f31cc1f7f10 2024-09-12T01:44:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31c3fff640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31cc1f7a90 0x7f31cc155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31ca59c640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31b8004800 0x7f31cc151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31cad9d640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31cc1f7f10 0x7f31cc155d80 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0b67d0 tx=0x7f31c40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31c2ffd640 1 -- 172.21.15.60:0/1307711746 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4003990 con 0x7f31cc1f7f10 2024-09-12T01:44:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31c2ffd640 1 -- 172.21.15.60:0/1307711746 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c401b070 con 0x7f31cc1f7f10 2024-09-12T01:44:04.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1307711746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31cc151120 con 0x7f31cc1f7f10 2024-09-12T01:44:04.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31c2ffd640 1 -- 172.21.15.60:0/1307711746 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4003b50 con 0x7f31cc1f7f10 2024-09-12T01:44:04.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.169+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1307711746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31cc1516e0 con 0x7f31cc1f7f10 2024-09-12T01:44:04.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.171+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1307711746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31cc15f750 con 0x7f31cc1f7f10 2024-09-12T01:44:04.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.171+0000 7f31c2ffd640 1 -- 172.21.15.60:0/1307711746 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f31c4005d10 con 0x7f31cc1f7f10 2024-09-12T01:44:04.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.171+0000 7f31c2ffd640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31ac06be30 0x7f31ac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.171+0000 7f31c2ffd640 1 -- 172.21.15.60:0/1307711746 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f31c408b630 con 0x7f31cc1f7f10 2024-09-12T01:44:04.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.171+0000 7f31ca59c640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31ac06be30 0x7f31ac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.172+0000 7f31ca59c640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31ac06be30 0x7f31ac06e2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0017e0 tx=0x7f31bc000ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:04.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.176+0000 7f31c2ffd640 1 -- 172.21.15.60:0/1307711746 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31c4025020 con 0x7f31cc1f7f10 2024-09-12T01:44:04.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.351+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1307711746 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_recall_warning_threshold}] v 0) -- 0x7f31cc0b3d10 con 0x7f31cc1f7f10 2024-09-12T01:44:04.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.355+0000 7f31c2ffd640 1 -- 172.21.15.60:0/1307711746 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_recall_warning_threshold}]=0 v59)=0 v59) ==== 128+0+0 (secure 0 0 0) 0x7f31c405ee20 con 0x7f31cc1f7f10 2024-09-12T01:44:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.357+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1307711746 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31ac06be30 msgr2=0x7f31ac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.357+0000 7f31d0fbe640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31ac06be30 0x7f31ac06e2f0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0017e0 tx=0x7f31bc000ed0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.357+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1307711746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31cc1f7f10 msgr2=0x7f31cc155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.357+0000 7f31d0fbe640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31cc1f7f10 0x7f31cc155d80 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0b67d0 tx=0x7f31c40115a0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.357+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1307711746 shutdown_connections 2024-09-12T01:44:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.357+0000 7f31d0fbe640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31cc1f7f10 0x7f31cc155d80 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.357+0000 7f31d0fbe640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f31ac06be30 0x7f31ac06e2f0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.357+0000 7f31d0fbe640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31cc1f7a90 0x7f31cc155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.357+0000 7f31d0fbe640 1 --2- 172.21.15.60:0/1307711746 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31b8004800 0x7f31cc151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.357+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1307711746 >> 172.21.15.60:0/1307711746 conn(0x7f31cc0d2430 msgr2=0x7f31cc0702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.357+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1307711746 shutdown_connections 2024-09-12T01:44:04.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.357+0000 7f31d0fbe640 1 -- 172.21.15.60:0/1307711746 wait complete. 2024-09-12T01:44:04.368 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_min_caps_per_client 2024-09-12T01:44:04.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.473+0000 7f047979f640 1 Processor -- start 2024-09-12T01:44:04.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.473+0000 7f047979f640 1 -- start start 2024-09-12T01:44:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.474+0000 7f047979f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f047415e5f0 0x7f04740d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.474+0000 7f047979f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f04740d13c0 0x7f04740b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.474+0000 7f047979f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04740b8730 0x7f04740ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.474+0000 7f047979f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f04740b9b30 con 0x7f047415e5f0 2024-09-12T01:44:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.474+0000 7f047979f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f047415e9d0 con 0x7f04740d13c0 2024-09-12T01:44:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.474+0000 7f047979f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f04740b8f20 con 0x7f04740b8730 2024-09-12T01:44:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.474+0000 7f0473fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f047415e5f0 0x7f04740d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.474+0000 7f0473fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f047415e5f0 0x7f04740d0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38964/0 (socket says 172.21.15.60:38964) 2024-09-12T01:44:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.475+0000 7f0473fff640 1 -- 172.21.15.60:0/1079981063 learned_addr learned my addr 172.21.15.60:0/1079981063 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:04.476 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.475+0000 7f04737fe640 1 --2- 172.21.15.60:0/1079981063 >> v2:172.21.15.105:3300/0 conn(0x7f04740d13c0 0x7f04740b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.475+0000 7f0478f9e640 1 --2- 172.21.15.60:0/1079981063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04740b8730 0x7f04740ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.475+0000 7f0473fff640 1 -- 172.21.15.60:0/1079981063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04740b8730 msgr2=0x7f04740ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.475+0000 7f0473fff640 1 --2- 172.21.15.60:0/1079981063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04740b8730 0x7f04740ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.475+0000 7f0473fff640 1 -- 172.21.15.60:0/1079981063 >> v2:172.21.15.105:3300/0 conn(0x7f04740d13c0 msgr2=0x7f04740b81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.475+0000 7f0473fff640 1 --2- 172.21.15.60:0/1079981063 >> v2:172.21.15.105:3300/0 conn(0x7f04740d13c0 0x7f04740b81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.475+0000 7f0473fff640 1 -- 172.21.15.60:0/1079981063 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04740b9200 con 0x7f047415e5f0 2024-09-12T01:44:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.475+0000 7f0478f9e640 1 --2- 172.21.15.60:0/1079981063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04740b8730 0x7f04740ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.475+0000 7f0473fff640 1 --2- 172.21.15.60:0/1079981063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f047415e5f0 0x7f04740d0e80 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f04740d1fc0 tx=0x7f046402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=861b4743395c3778 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.476+0000 7f0472ffd640 1 -- 172.21.15.60:0/1079981063 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0464037070 con 0x7f047415e5f0 2024-09-12T01:44:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.476+0000 7f0472ffd640 1 -- 172.21.15.60:0/1079981063 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0464032440 con 0x7f047415e5f0 2024-09-12T01:44:04.477 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.476+0000 7f0472ffd640 1 -- 172.21.15.60:0/1079981063 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0464032810 con 0x7f047415e5f0 2024-09-12T01:44:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.476+0000 7f047979f640 1 -- 172.21.15.60:0/1079981063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f047415e5f0 msgr2=0x7f04740d0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.476+0000 7f047979f640 1 --2- 172.21.15.60:0/1079981063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f047415e5f0 0x7f04740d0e80 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f04740d1fc0 tx=0x7f046402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.476+0000 7f047979f640 1 -- 172.21.15.60:0/1079981063 shutdown_connections 2024-09-12T01:44:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.476+0000 7f047979f640 1 --2- 172.21.15.60:0/1079981063 >> v2:172.21.15.105:3300/0 conn(0x7f04740d13c0 0x7f04740b81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.476+0000 7f047979f640 1 --2- 172.21.15.60:0/1079981063 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04740b8730 0x7f04740ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.476+0000 7f047979f640 1 --2- 172.21.15.60:0/1079981063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f047415e5f0 0x7f04740d0e80 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.476+0000 7f047979f640 1 -- 172.21.15.60:0/1079981063 >> 172.21.15.60:0/1079981063 conn(0x7f0474062630 msgr2=0x7f0474062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.476+0000 7f047979f640 1 -- 172.21.15.60:0/1079981063 shutdown_connections 2024-09-12T01:44:04.478 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.476+0000 7f047979f640 1 -- 172.21.15.60:0/1079981063 wait complete. 2024-09-12T01:44:04.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.477+0000 7f047979f640 1 Processor -- start 2024-09-12T01:44:04.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.478+0000 7f047979f640 1 -- start start 2024-09-12T01:44:04.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.478+0000 7f047979f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04740b8730 0x7f047414e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.478+0000 7f047979f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04740d13c0 0x7f04741617b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.478+0000 7f047979f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f047415e5f0 0x7f04740ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.478+0000 7f047979f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f04740b8ba0 con 0x7f047415e5f0 2024-09-12T01:44:04.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.478+0000 7f047979f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f04740b97c0 con 0x7f04740b8730 2024-09-12T01:44:04.481 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.478+0000 7f047979f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f04740cf000 con 0x7f04740d13c0 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0478f9e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f047415e5f0 0x7f04740ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0478f9e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f047415e5f0 0x7f04740ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38974/0 (socket says 172.21.15.60:38974) 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0478f9e640 1 -- 172.21.15.60:0/2848494070 learned_addr learned my addr 172.21.15.60:0/2848494070 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0473fff640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04740b8730 0x7f047414e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f04737fe640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04740d13c0 0x7f04741617b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0478f9e640 1 -- 172.21.15.60:0/2848494070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04740d13c0 msgr2=0x7f04741617b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0478f9e640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04740d13c0 0x7f04741617b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0478f9e640 1 -- 172.21.15.60:0/2848494070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04740b8730 msgr2=0x7f047414e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0478f9e640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04740b8730 0x7f047414e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0478f9e640 1 -- 172.21.15.60:0/2848494070 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04740cc680 con 0x7f047415e5f0 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0478f9e640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f047415e5f0 0x7f04740ca180 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f046c00cf20 tx=0x7f046c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0470ff9640 1 -- 172.21.15.60:0/2848494070 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c01a070 con 0x7f047415e5f0 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0470ff9640 1 -- 172.21.15.60:0/2848494070 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046c00d840 con 0x7f047415e5f0 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f0470ff9640 1 -- 172.21.15.60:0/2848494070 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c00dc30 con 0x7f047415e5f0 2024-09-12T01:44:04.482 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f047979f640 1 -- 172.21.15.60:0/2848494070 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04740cbb00 con 0x7f047415e5f0 2024-09-12T01:44:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.479+0000 7f047979f640 1 -- 172.21.15.60:0/2848494070 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04740cc0c0 con 0x7f047415e5f0 2024-09-12T01:44:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.480+0000 7f047979f640 1 -- 172.21.15.60:0/2848494070 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04740b81f0 con 0x7f047415e5f0 2024-09-12T01:44:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.481+0000 7f0470ff9640 1 -- 172.21.15.60:0/2848494070 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f046c01d070 con 0x7f047415e5f0 2024-09-12T01:44:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.481+0000 7f0470ff9640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f046006be30 0x7f046006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.481+0000 7f0470ff9640 1 -- 172.21.15.60:0/2848494070 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f046c08b550 con 0x7f047415e5f0 2024-09-12T01:44:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.481+0000 7f0473fff640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f046006be30 0x7f046006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.483 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.482+0000 7f0473fff640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f046006be30 0x7f046006e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0464034000 tx=0x7f046402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:04.485 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.486+0000 7f0470ff9640 1 -- 172.21.15.60:0/2848494070 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f046c059940 con 0x7f047415e5f0 2024-09-12T01:44:04.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.663+0000 7f047979f640 1 -- 172.21.15.60:0/2848494070 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"} v 0) -- 0x7f04740cffd0 con 0x7f047415e5f0 2024-09-12T01:44:04.663 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.663+0000 7f0470ff9640 1 -- 172.21.15.60:0/2848494070 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_min_caps_per_client"}]=0 v59) ==== 106+0+4 (secure 0 0 0) 0x7f046c05dc40 con 0x7f047415e5f0 2024-09-12T01:44:04.663 INFO:teuthology.orchestra.run.smithi060.stdout:100 2024-09-12T01:44:04.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.665+0000 7f047979f640 1 -- 172.21.15.60:0/2848494070 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f046006be30 msgr2=0x7f046006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.665+0000 7f047979f640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f046006be30 0x7f046006e2f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f0464034000 tx=0x7f046402e000 comp rx=0 tx=0).stop 2024-09-12T01:44:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.665+0000 7f047979f640 1 -- 172.21.15.60:0/2848494070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f047415e5f0 msgr2=0x7f04740ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.665+0000 7f047979f640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f047415e5f0 0x7f04740ca180 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f046c00cf20 tx=0x7f046c00a710 comp rx=0 tx=0).stop 2024-09-12T01:44:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.666+0000 7f047979f640 1 -- 172.21.15.60:0/2848494070 shutdown_connections 2024-09-12T01:44:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.666+0000 7f047979f640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f047415e5f0 0x7f04740ca180 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.666+0000 7f047979f640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f046006be30 0x7f046006e2f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.666+0000 7f047979f640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f04740d13c0 0x7f04741617b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.666+0000 7f047979f640 1 --2- 172.21.15.60:0/2848494070 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f04740b8730 0x7f047414e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.666+0000 7f047979f640 1 -- 172.21.15.60:0/2848494070 >> 172.21.15.60:0/2848494070 conn(0x7f0474062630 msgr2=0x7f04740cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.666+0000 7f047979f640 1 -- 172.21.15.60:0/2848494070 shutdown_connections 2024-09-12T01:44:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.666+0000 7f047979f640 1 -- 172.21.15.60:0/2848494070 wait complete. 2024-09-12T01:44:04.676 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_min_caps_working_set 100 2024-09-12T01:44:04.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.782+0000 7f9e74caf640 1 Processor -- start 2024-09-12T01:44:04.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.782+0000 7f9e74caf640 1 -- start start 2024-09-12T01:44:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.783+0000 7f9e74caf640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9e7015e7a0 0x7f9e7006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.783+0000 7f9e74caf640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e700cf860 con 0x7f9e700b68f0 2024-09-12T01:44:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.783+0000 7f9e74caf640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e700cfb40 con 0x7f9e700cf1f0 2024-09-12T01:44:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.783+0000 7f9e74caf640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f9e700d2ca0 con 0x7f9e7015e7a0 2024-09-12T01:44:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6ed9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9e700b68f0 0x7f9e700d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55038/0 (socket says 172.21.15.60:55038) 2024-09-12T01:44:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6ed9d640 1 -- 172.21.15.60:0/3250066136 learned_addr learned my addr 172.21.15.60:0/3250066136 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379811959 0 0) 0x7f9e700cf860 con 0x7f9e700b68f0 2024-09-12T01:44:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6e59c640 1 --2- 172.21.15.60:0/3250066136 >> v2:172.21.15.105:3300/0 conn(0x7f9e7015e7a0 0x7f9e7006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.785 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e58003520 con 0x7f9e700b68f0 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3504779451 0 0) 0x7f9e58003520 con 0x7f9e700b68f0 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 >> v2:172.21.15.105:3300/0 conn(0x7f9e7015e7a0 msgr2=0x7f9e7006caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 --2- 172.21.15.60:0/3250066136 >> v2:172.21.15.105:3300/0 conn(0x7f9e7015e7a0 0x7f9e7006caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 >> v1:172.21.15.105:6789/0 conn(0x7f9e700cf1f0 legacy=0x7f9e700b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e700cfe20 con 0x7f9e700b68f0 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f9e680019f0 con 0x7f9e700b68f0 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 >> v1:172.21.15.60:6789/0 conn(0x7f9e700b68f0 legacy=0x7f9e700d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 --2- 172.21.15.60:0/3250066136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 0x7f9e58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 --2- 172.21.15.60:0/3250066136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e58004800 0x7f9e58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 --2- 172.21.15.60:0/3250066136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e580051c0 0x7f9e5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9e700d2ca0 con 0x7f9e580039b0 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5800c160 con 0x7f9e58004800 2024-09-12T01:44:04.786 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5800c360 con 0x7f9e580051c0 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6e59c640 1 --2- 172.21.15.60:0/3250066136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 0x7f9e58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6dd9b640 1 --2- 172.21.15.60:0/3250066136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e58004800 0x7f9e58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.784+0000 7f9e6ed9d640 1 --2- 172.21.15.60:0/3250066136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e580051c0 0x7f9e5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.785+0000 7f9e6e59c640 1 -- 172.21.15.60:0/3250066136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e580051c0 msgr2=0x7f9e5800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.785+0000 7f9e6e59c640 1 --2- 172.21.15.60:0/3250066136 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e580051c0 0x7f9e5800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.785+0000 7f9e6e59c640 1 -- 172.21.15.60:0/3250066136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e58004800 msgr2=0x7f9e58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.785+0000 7f9e6e59c640 1 --2- 172.21.15.60:0/3250066136 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e58004800 0x7f9e58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.785+0000 7f9e6e59c640 1 -- 172.21.15.60:0/3250066136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e58003520 con 0x7f9e580039b0 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.785+0000 7f9e6ed9d640 1 -- 172.21.15.60:0/3250066136 reap_dead start 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.785+0000 7f9e6e59c640 1 --2- 172.21.15.60:0/3250066136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 0x7f9e58003dd0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f9e60009ac0 tx=0x7f9e58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3c96f560c4a7a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.785+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60036070 con 0x7f9e580039b0 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.786+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e60031400 con 0x7f9e580039b0 2024-09-12T01:44:04.787 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.786+0000 7f9e6d59a640 1 -- 172.21.15.60:0/3250066136 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60009690 con 0x7f9e580039b0 2024-09-12T01:44:04.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.786+0000 7f9e74caf640 1 -- 172.21.15.60:0/3250066136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 msgr2=0x7f9e58003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.786+0000 7f9e74caf640 1 --2- 172.21.15.60:0/3250066136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 0x7f9e58003dd0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f9e60009ac0 tx=0x7f9e58005830 comp rx=0 tx=0).stop 2024-09-12T01:44:04.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.786+0000 7f9e74caf640 1 -- 172.21.15.60:0/3250066136 shutdown_connections 2024-09-12T01:44:04.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.786+0000 7f9e74caf640 1 --2- 172.21.15.60:0/3250066136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 0x7f9e58003dd0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.786+0000 7f9e74caf640 1 -- 172.21.15.60:0/3250066136 >> 172.21.15.60:0/3250066136 conn(0x7f9e700d11e0 msgr2=0x7f9e700d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:04.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.786+0000 7f9e74caf640 1 -- 172.21.15.60:0/3250066136 shutdown_connections 2024-09-12T01:44:04.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.786+0000 7f9e74caf640 1 -- 172.21.15.60:0/3250066136 wait complete. 2024-09-12T01:44:04.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.788+0000 7f9e74caf640 1 Processor -- start 2024-09-12T01:44:04.790 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.788+0000 7f9e74caf640 1 -- start start 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.788+0000 7f9e74caf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 0x7f9e7014f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.788+0000 7f9e74caf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e700d49a0 0x7f9e701506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.788+0000 7f9e74caf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e70150c10 0x7f9e70151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.788+0000 7f9e74caf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7015eb80 con 0x7f9e580039b0 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.788+0000 7f9e74caf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f9e700b7a00 con 0x7f9e70150c10 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.788+0000 7f9e74caf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f9e7015ed00 con 0x7f9e700d49a0 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.788+0000 7f9e6e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 0x7f9e7014f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.788+0000 7f9e6e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 0x7f9e7014f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:38996/0 (socket says 172.21.15.60:38996) 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.788+0000 7f9e6e59c640 1 -- 172.21.15.60:0/577613334 learned_addr learned my addr 172.21.15.60:0/577613334 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e6dd9b640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e700d49a0 0x7f9e701506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e6ed9d640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e70150c10 0x7f9e70151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e6e59c640 1 -- 172.21.15.60:0/577613334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e700d49a0 msgr2=0x7f9e701506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e6e59c640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e700d49a0 0x7f9e701506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e6e59c640 1 -- 172.21.15.60:0/577613334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e70150c10 msgr2=0x7f9e70151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e6e59c640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e70150c10 0x7f9e70151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.791 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e6e59c640 1 -- 172.21.15.60:0/577613334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e700caa60 con 0x7f9e580039b0 2024-09-12T01:44:04.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e6e59c640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 0x7f9e7014f980 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f9e60009be0 tx=0x7f9e60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:04.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e5effd640 1 -- 172.21.15.60:0/577613334 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e6003f020 con 0x7f9e580039b0 2024-09-12T01:44:04.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e5effd640 1 -- 172.21.15.60:0/577613334 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e60037040 con 0x7f9e580039b0 2024-09-12T01:44:04.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e74caf640 1 -- 172.21.15.60:0/577613334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e700d3ec0 con 0x7f9e580039b0 2024-09-12T01:44:04.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e5effd640 1 -- 172.21.15.60:0/577613334 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60036070 con 0x7f9e580039b0 2024-09-12T01:44:04.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.789+0000 7f9e74caf640 1 -- 172.21.15.60:0/577613334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7014fec0 con 0x7f9e580039b0 2024-09-12T01:44:04.792 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.790+0000 7f9e74caf640 1 -- 172.21.15.60:0/577613334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e70159de0 con 0x7f9e580039b0 2024-09-12T01:44:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.791+0000 7f9e5effd640 1 -- 172.21.15.60:0/577613334 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9e60042020 con 0x7f9e580039b0 2024-09-12T01:44:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.791+0000 7f9e5effd640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9e5006be30 0x7f9e5006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.791+0000 7f9e5effd640 1 -- 172.21.15.60:0/577613334 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f9e600aac90 con 0x7f9e580039b0 2024-09-12T01:44:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.791+0000 7f9e6dd9b640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9e5006be30 0x7f9e5006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:04.793 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.792+0000 7f9e6dd9b640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9e5006be30 0x7f9e5006e2f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9e64000c00 tx=0x7f9e64009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:04.795 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.796+0000 7f9e5effd640 1 -- 172.21.15.60:0/577613334 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9e70159de0 con 0x7f9e580039b0 2024-09-12T01:44:04.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.971+0000 7f9e74caf640 1 -- 172.21.15.60:0/577613334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mds_min_caps_working_set}] v 0) -- 0x7f9e700b61e0 con 0x7f9e580039b0 2024-09-12T01:44:04.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.974+0000 7f9e5effd640 1 -- 172.21.15.60:0/577613334 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_min_caps_working_set}]=0 v60)=0 v60) ==== 124+0+0 (secure 0 0 0) 0x7f9e60049030 con 0x7f9e580039b0 2024-09-12T01:44:04.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.977+0000 7f9e74caf640 1 -- 172.21.15.60:0/577613334 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9e5006be30 msgr2=0x7f9e5006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.977+0000 7f9e74caf640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9e5006be30 0x7f9e5006e2f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9e64000c00 tx=0x7f9e64009040 comp rx=0 tx=0).stop 2024-09-12T01:44:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.977+0000 7f9e74caf640 1 -- 172.21.15.60:0/577613334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 msgr2=0x7f9e7014f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.977+0000 7f9e74caf640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 0x7f9e7014f980 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f9e60009be0 tx=0x7f9e60004730 comp rx=0 tx=0).stop 2024-09-12T01:44:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.977+0000 7f9e74caf640 1 -- 172.21.15.60:0/577613334 shutdown_connections 2024-09-12T01:44:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.977+0000 7f9e74caf640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9e70150c10 0x7f9e70151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.977+0000 7f9e74caf640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9e5006be30 0x7f9e5006e2f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.977+0000 7f9e74caf640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9e700d49a0 0x7f9e701506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.977+0000 7f9e74caf640 1 --2- 172.21.15.60:0/577613334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e580039b0 0x7f9e7014f980 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.977+0000 7f9e74caf640 1 -- 172.21.15.60:0/577613334 >> 172.21.15.60:0/577613334 conn(0x7f9e700d11e0 msgr2=0x7f9e7015cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.977+0000 7f9e74caf640 1 -- 172.21.15.60:0/577613334 shutdown_connections 2024-09-12T01:44:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:04.977+0000 7f9e74caf640 1 -- 172.21.15.60:0/577613334 wait complete. 2024-09-12T01:44:04.988 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_max_caps_per_client 2024-09-12T01:44:05.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.093+0000 7f525601e640 1 Processor -- start 2024-09-12T01:44:05.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.093+0000 7f525601e640 1 -- start start 2024-09-12T01:44:05.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.094+0000 7f525601e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f525015e460 0x7f52500b3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.094+0000 7f525601e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f52500b4a50 0x7f5250071d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.094+0000 7f525601e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52500b0090 con 0x7f525015e840 2024-09-12T01:44:05.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.094+0000 7f525601e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f52500af480 con 0x7f52500b4a50 2024-09-12T01:44:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.094+0000 7f525601e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f52500af760 con 0x7f525015e460 2024-09-12T01:44:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.094+0000 7f524f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f525015e460 0x7f52500b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.094+0000 7f524ffff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f52500b4a50 0x7f5250071d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.094+0000 7f524f7fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f525015e460 0x7f52500b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:51844/0 (socket says 172.21.15.60:51844) 2024-09-12T01:44:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.094+0000 7f524f7fe640 1 -- 172.21.15.60:0/2251706110 learned_addr learned my addr 172.21.15.60:0/2251706110 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.094+0000 7f5246ffd640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f525015e840 0x7f52500b4340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:60960/0 (socket says 172.21.15.60:60960) 2024-09-12T01:44:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.094+0000 7f524ffff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f52500b4a50 0x7f5250071d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:43608/0 (socket says 172.21.15.60:43608) 2024-09-12T01:44:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.095+0000 7f524f7fe640 1 -- 172.21.15.60:0/2251706110 >> v2:172.21.15.105:3300/0 conn(0x7f52500b4a50 msgr2=0x7f5250071d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.095+0000 7f524f7fe640 1 --2- 172.21.15.60:0/2251706110 >> v2:172.21.15.105:3300/0 conn(0x7f52500b4a50 0x7f5250071d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.095+0000 7f524f7fe640 1 -- 172.21.15.60:0/2251706110 >> v1:172.21.15.105:6789/0 conn(0x7f525015e840 legacy=0x7f52500b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.095+0000 7f524f7fe640 1 -- 172.21.15.60:0/2251706110 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52500717d0 con 0x7f525015e460 2024-09-12T01:44:05.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.096+0000 7f524f7fe640 1 --2- 172.21.15.60:0/2251706110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f525015e460 0x7f52500b3830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52400098a0 tx=0x7f524002a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=737e08da60f81d5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:05.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.096+0000 7f524effd640 1 -- 172.21.15.60:0/2251706110 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240037070 con 0x7f525015e460 2024-09-12T01:44:05.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.096+0000 7f524effd640 1 -- 172.21.15.60:0/2251706110 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5240032440 con 0x7f525015e460 2024-09-12T01:44:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.096+0000 7f524effd640 1 -- 172.21.15.60:0/2251706110 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240032810 con 0x7f525015e460 2024-09-12T01:44:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.096+0000 7f525601e640 1 -- 172.21.15.60:0/2251706110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f525015e460 msgr2=0x7f52500b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.096+0000 7f525601e640 1 --2- 172.21.15.60:0/2251706110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f525015e460 0x7f52500b3830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f52400098a0 tx=0x7f524002a290 comp rx=0 tx=0).stop 2024-09-12T01:44:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.096+0000 7f525601e640 1 -- 172.21.15.60:0/2251706110 shutdown_connections 2024-09-12T01:44:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.096+0000 7f525601e640 1 --2- 172.21.15.60:0/2251706110 >> v2:172.21.15.105:3300/0 conn(0x7f52500b4a50 0x7f5250071d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.096+0000 7f525601e640 1 --2- 172.21.15.60:0/2251706110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f525015e460 0x7f52500b3830 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.096+0000 7f525601e640 1 -- 172.21.15.60:0/2251706110 >> 172.21.15.60:0/2251706110 conn(0x7f525006bc10 msgr2=0x7f525006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.096+0000 7f525601e640 1 -- 172.21.15.60:0/2251706110 shutdown_connections 2024-09-12T01:44:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.096+0000 7f525601e640 1 -- 172.21.15.60:0/2251706110 wait complete. 2024-09-12T01:44:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.098+0000 7f525601e640 1 Processor -- start 2024-09-12T01:44:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.098+0000 7f525601e640 1 -- start start 2024-09-12T01:44:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.098+0000 7f525601e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52500b4a50 0x7f525014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.098+0000 7f525601e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f525015e460 0x7f5250151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.098+0000 7f525601e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f525015e840 0x7f5250162370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.098+0000 7f525601e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f52500afe50 con 0x7f52500b4a50 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.098+0000 7f525601e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f52500afcd0 con 0x7f525015e840 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.098+0000 7f525601e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f52500ce680 con 0x7f525015e460 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52500b4a50 0x7f525014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52500b4a50 0x7f525014fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39008/0 (socket says 172.21.15.60:39008) 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524f7fe640 1 -- 172.21.15.60:0/957429124 learned_addr learned my addr 172.21.15.60:0/957429124 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524ffff640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f525015e840 0x7f5250162370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f5246ffd640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f525015e460 0x7f5250151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524f7fe640 1 -- 172.21.15.60:0/957429124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f525015e460 msgr2=0x7f5250151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524f7fe640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f525015e460 0x7f5250151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524f7fe640 1 -- 172.21.15.60:0/957429124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f525015e840 msgr2=0x7f5250162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524f7fe640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f525015e840 0x7f5250162370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524f7fe640 1 -- 172.21.15.60:0/957429124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5250151620 con 0x7f52500b4a50 2024-09-12T01:44:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524f7fe640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52500b4a50 0x7f525014fe30 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f5240000c00 tx=0x7f52400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:05.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524cff9640 1 -- 172.21.15.60:0/957429124 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240037040 con 0x7f52500b4a50 2024-09-12T01:44:05.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524cff9640 1 -- 172.21.15.60:0/957429124 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5240042070 con 0x7f52500b4a50 2024-09-12T01:44:05.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f525601e640 1 -- 172.21.15.60:0/957429124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52501608c0 con 0x7f52500b4a50 2024-09-12T01:44:05.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f524cff9640 1 -- 172.21.15.60:0/957429124 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240030880 con 0x7f52500b4a50 2024-09-12T01:44:05.101 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.099+0000 7f525601e640 1 -- 172.21.15.60:0/957429124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525006e0a0 con 0x7f52500b4a50 2024-09-12T01:44:05.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.100+0000 7f525601e640 1 -- 172.21.15.60:0/957429124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52500b3830 con 0x7f52500b4a50 2024-09-12T01:44:05.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.101+0000 7f524cff9640 1 -- 172.21.15.60:0/957429124 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5240030a20 con 0x7f52500b4a50 2024-09-12T01:44:05.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.101+0000 7f524cff9640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f523006be30 0x7f523006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.101+0000 7f524cff9640 1 -- 172.21.15.60:0/957429124 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f52400ab610 con 0x7f52500b4a50 2024-09-12T01:44:05.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.101+0000 7f5246ffd640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f523006be30 0x7f523006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.102 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.102+0000 7f5246ffd640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f523006be30 0x7f523006e2f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5250154510 tx=0x7f5238007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:05.105 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.106+0000 7f524cff9640 1 -- 172.21.15.60:0/957429124 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f52400798f0 con 0x7f52500b4a50 2024-09-12T01:44:05.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.281+0000 7f525601e640 1 -- 172.21.15.60:0/957429124 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"} v 0) -- 0x7f525015d900 con 0x7f52500b4a50 2024-09-12T01:44:05.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.281+0000 7f524cff9640 1 -- 172.21.15.60:0/957429124 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_max_caps_per_client"}]=0 v60) ==== 106+0+8 (secure 0 0 0) 0x7f524007dbf0 con 0x7f52500b4a50 2024-09-12T01:44:05.281 INFO:teuthology.orchestra.run.smithi060.stdout:1048576 2024-09-12T01:44:05.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.283+0000 7f525601e640 1 -- 172.21.15.60:0/957429124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f523006be30 msgr2=0x7f523006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.283+0000 7f525601e640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f523006be30 0x7f523006e2f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5250154510 tx=0x7f5238007e80 comp rx=0 tx=0).stop 2024-09-12T01:44:05.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.283+0000 7f525601e640 1 -- 172.21.15.60:0/957429124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52500b4a50 msgr2=0x7f525014fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.283+0000 7f525601e640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52500b4a50 0x7f525014fe30 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f5240000c00 tx=0x7f52400046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.283+0000 7f525601e640 1 -- 172.21.15.60:0/957429124 shutdown_connections 2024-09-12T01:44:05.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.283+0000 7f525601e640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f525015e840 0x7f5250162370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.283+0000 7f525601e640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f523006be30 0x7f523006e2f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.283+0000 7f525601e640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f525015e460 0x7f5250151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.283+0000 7f525601e640 1 --2- 172.21.15.60:0/957429124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52500b4a50 0x7f525014fe30 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.283+0000 7f525601e640 1 -- 172.21.15.60:0/957429124 >> 172.21.15.60:0/957429124 conn(0x7f525006bc10 msgr2=0x7f52500ceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:05.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.283+0000 7f525601e640 1 -- 172.21.15.60:0/957429124 shutdown_connections 2024-09-12T01:44:05.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.283+0000 7f525601e640 1 -- 172.21.15.60:0/957429124 wait complete. 2024-09-12T01:44:05.294 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config get mds mds_recall_warning_decay_rate 2024-09-12T01:44:05.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.399+0000 7f4f372e4640 1 Processor -- start 2024-09-12T01:44:05.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.399+0000 7f4f372e4640 1 -- start start 2024-09-12T01:44:05.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.400+0000 7f4f372e4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f3015e940 0x7f4f300b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.400+0000 7f4f372e4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4f300ba440 0x7f4f300b6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.400+0000 7f4f372e4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3015ed20 con 0x7f4f300d2290 2024-09-12T01:44:05.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.400+0000 7f4f372e4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4f300d3ef0 con 0x7f4f3015e940 2024-09-12T01:44:05.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.400+0000 7f4f372e4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f4f300d32e0 con 0x7f4f300ba440 2024-09-12T01:44:05.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.400+0000 7f4f35080640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f3015e940 0x7f4f300b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.400+0000 7f4f35881640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4f300d2290 0x7f4f300cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55040/0 (socket says 172.21.15.60:55040) 2024-09-12T01:44:05.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.400+0000 7f4f35881640 1 -- 172.21.15.60:0/3619678864 learned_addr learned my addr 172.21.15.60:0/3619678864 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:05.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.400+0000 7f4f3487f640 1 --2- 172.21.15.60:0/3619678864 >> v2:172.21.15.105:3300/0 conn(0x7f4f300ba440 0x7f4f300b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.401+0000 7f4f35080640 1 -- 172.21.15.60:0/3619678864 >> v2:172.21.15.105:3300/0 conn(0x7f4f300ba440 msgr2=0x7f4f300b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:05.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.401+0000 7f4f35080640 1 --2- 172.21.15.60:0/3619678864 >> v2:172.21.15.105:3300/0 conn(0x7f4f300ba440 0x7f4f300b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.401+0000 7f4f35080640 1 -- 172.21.15.60:0/3619678864 >> v1:172.21.15.60:6789/0 conn(0x7f4f300d2290 legacy=0x7f4f300cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.401+0000 7f4f35080640 1 -- 172.21.15.60:0/3619678864 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f300d35c0 con 0x7f4f3015e940 2024-09-12T01:44:05.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.401+0000 7f4f35080640 1 --2- 172.21.15.60:0/3619678864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f3015e940 0x7f4f300b6140 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f4f3008d440 tx=0x7f4f2c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d1d8e3faa8cabf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.401+0000 7f4f27fff640 1 -- 172.21.15.60:0/3619678864 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c037070 con 0x7f4f3015e940 2024-09-12T01:44:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.401+0000 7f4f27fff640 1 -- 172.21.15.60:0/3619678864 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c032440 con 0x7f4f3015e940 2024-09-12T01:44:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.401+0000 7f4f27fff640 1 -- 172.21.15.60:0/3619678864 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c02ae60 con 0x7f4f3015e940 2024-09-12T01:44:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.402+0000 7f4f372e4640 1 -- 172.21.15.60:0/3619678864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f3015e940 msgr2=0x7f4f300b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.402+0000 7f4f372e4640 1 --2- 172.21.15.60:0/3619678864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f3015e940 0x7f4f300b6140 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f4f3008d440 tx=0x7f4f2c02a110 comp rx=0 tx=0).stop 2024-09-12T01:44:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.402+0000 7f4f372e4640 1 -- 172.21.15.60:0/3619678864 shutdown_connections 2024-09-12T01:44:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.402+0000 7f4f372e4640 1 --2- 172.21.15.60:0/3619678864 >> v2:172.21.15.105:3300/0 conn(0x7f4f300ba440 0x7f4f300b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.402+0000 7f4f372e4640 1 --2- 172.21.15.60:0/3619678864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f3015e940 0x7f4f300b6140 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.402+0000 7f4f372e4640 1 -- 172.21.15.60:0/3619678864 >> 172.21.15.60:0/3619678864 conn(0x7f4f300d1140 msgr2=0x7f4f300d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.402+0000 7f4f372e4640 1 -- 172.21.15.60:0/3619678864 shutdown_connections 2024-09-12T01:44:05.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.402+0000 7f4f372e4640 1 -- 172.21.15.60:0/3619678864 wait complete. 2024-09-12T01:44:05.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.403+0000 7f4f372e4640 1 Processor -- start 2024-09-12T01:44:05.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.403+0000 7f4f372e4640 1 -- start start 2024-09-12T01:44:05.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f372e4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f300ba440 0x7f4f301f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f372e4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f300d2290 0x7f4f301f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f372e4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f3015e940 0x7f4f301f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f372e4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4f300b7510 con 0x7f4f3015e940 2024-09-12T01:44:05.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f372e4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4f300d3b80 con 0x7f4f300d2290 2024-09-12T01:44:05.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f372e4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4f300b8bb0 con 0x7f4f300ba440 2024-09-12T01:44:05.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f35881640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f3015e940 0x7f4f301f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f35881640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f3015e940 0x7f4f301f15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39012/0 (socket says 172.21.15.60:39012) 2024-09-12T01:44:05.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f35881640 1 -- 172.21.15.60:0/3643844571 learned_addr learned my addr 172.21.15.60:0/3643844571 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:05.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f3487f640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f300d2290 0x7f4f301f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f35080640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f300ba440 0x7f4f301f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f35881640 1 -- 172.21.15.60:0/3643844571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f300ba440 msgr2=0x7f4f301f52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f35881640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f300ba440 0x7f4f301f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f35881640 1 -- 172.21.15.60:0/3643844571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f300d2290 msgr2=0x7f4f301f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.404+0000 7f4f35881640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f300d2290 0x7f4f301f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.405+0000 7f4f35881640 1 -- 172.21.15.60:0/3643844571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f301f50c0 con 0x7f4f3015e940 2024-09-12T01:44:05.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.405+0000 7f4f3487f640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f300d2290 0x7f4f301f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:05.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.405+0000 7f4f35881640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f3015e940 0x7f4f301f15e0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800cad0 tx=0x7f4f2800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:05.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.405+0000 7f4f25ffb640 1 -- 172.21.15.60:0/3643844571 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f28017070 con 0x7f4f3015e940 2024-09-12T01:44:05.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.405+0000 7f4f25ffb640 1 -- 172.21.15.60:0/3643844571 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2800abd0 con 0x7f4f3015e940 2024-09-12T01:44:05.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.405+0000 7f4f372e4640 1 -- 172.21.15.60:0/3643844571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f301f1b20 con 0x7f4f3015e940 2024-09-12T01:44:05.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.405+0000 7f4f25ffb640 1 -- 172.21.15.60:0/3643844571 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f28012400 con 0x7f4f3015e940 2024-09-12T01:44:05.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.405+0000 7f4f372e4640 1 -- 172.21.15.60:0/3643844571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f301f5bd0 con 0x7f4f3015e940 2024-09-12T01:44:05.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.406+0000 7f4f372e4640 1 -- 172.21.15.60:0/3643844571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f300b6140 con 0x7f4f3015e940 2024-09-12T01:44:05.408 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.407+0000 7f4f25ffb640 1 -- 172.21.15.60:0/3643844571 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4f2801a070 con 0x7f4f3015e940 2024-09-12T01:44:05.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.407+0000 7f4f25ffb640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4f1406be30 0x7f4f1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.407+0000 7f4f25ffb640 1 -- 172.21.15.60:0/3643844571 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f4f2808ab80 con 0x7f4f3015e940 2024-09-12T01:44:05.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.407+0000 7f4f35080640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4f1406be30 0x7f4f1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.408+0000 7f4f35080640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4f1406be30 0x7f4f1406e2f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c034000 tx=0x7f4f2c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:05.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.412+0000 7f4f25ffb640 1 -- 172.21.15.60:0/3643844571 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4f301f50c0 con 0x7f4f3015e940 2024-09-12T01:44:05.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.591+0000 7f4f372e4640 1 -- 172.21.15.60:0/3643844571 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"} v 0) -- 0x7f4f30161610 con 0x7f4f3015e940 2024-09-12T01:44:05.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.591+0000 7f4f25ffb640 1 -- 172.21.15.60:0/3643844571 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mds", "key": "mds_recall_warning_decay_rate"}]=0 v60) ==== 112+0+10 (secure 0 0 0) 0x7f4f28059530 con 0x7f4f3015e940 2024-09-12T01:44:05.591 INFO:teuthology.orchestra.run.smithi060.stdout:60.000000 2024-09-12T01:44:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.593+0000 7f4f372e4640 1 -- 172.21.15.60:0/3643844571 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4f1406be30 msgr2=0x7f4f1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.593+0000 7f4f372e4640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4f1406be30 0x7f4f1406e2f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c034000 tx=0x7f4f2c02e000 comp rx=0 tx=0).stop 2024-09-12T01:44:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.593+0000 7f4f372e4640 1 -- 172.21.15.60:0/3643844571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f3015e940 msgr2=0x7f4f301f15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.593+0000 7f4f372e4640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f3015e940 0x7f4f301f15e0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800cad0 tx=0x7f4f2800cf90 comp rx=0 tx=0).stop 2024-09-12T01:44:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.593+0000 7f4f372e4640 1 -- 172.21.15.60:0/3643844571 shutdown_connections 2024-09-12T01:44:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.593+0000 7f4f372e4640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f3015e940 0x7f4f301f15e0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.593+0000 7f4f372e4640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4f300d2290 0x7f4f301f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.593+0000 7f4f372e4640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4f1406be30 0x7f4f1406e2f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.593+0000 7f4f372e4640 1 --2- 172.21.15.60:0/3643844571 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4f300ba440 0x7f4f301f52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.593+0000 7f4f372e4640 1 -- 172.21.15.60:0/3643844571 >> 172.21.15.60:0/3643844571 conn(0x7f4f300d1140 msgr2=0x7f4f30160f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.593+0000 7f4f372e4640 1 -- 172.21.15.60:0/3643844571 shutdown_connections 2024-09-12T01:44:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.593+0000 7f4f372e4640 1 -- 172.21.15.60:0/3643844571 wait complete. 2024-09-12T01:44:05.604 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:05.604 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:05.621 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:44:05.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:44:05.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:44:05.719 INFO:teuthology.orchestra.run.smithi060.stdout:client8151 2024-09-12T01:44:05.719 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:05.719 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:05.735 DEBUG:teuthology.orchestra.run.smithi060:> stdin-killer -- python3 -c ' 2024-09-12T01:44:05.735 DEBUG:teuthology.orchestra.run.smithi060:> import fcntl 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> import sys 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> import time 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> import os 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> n = 400 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> abs_path = "/home/ubuntu/cephtest/mnt.0/." 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> if not os.path.exists(abs_path): 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> os.makedirs(abs_path) 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:44:05.736 DEBUG:teuthology.orchestra.run.smithi060:> handles = [] 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> for i in range(0, n): 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> fname = "file_"+str(i) 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> path = os.path.join(abs_path, fname) 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> handles.append(open(path, '"'"'w'"'"')) 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> print("waiting with handles open", file=sys.stderr) 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> while True: 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> print("open_n_background: keeping files open", file=sys.stderr) 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> try: 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> if os.read(0, 4096) == b"": 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> break 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> except BlockingIOError: 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> pass 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> time.sleep(2) 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> print("stdin closed, goodbye!", file=sys.stderr) 2024-09-12T01:44:05.737 DEBUG:teuthology.orchestra.run.smithi060:> ' 2024-09-12T01:44:05.778 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.883+0000 7ff61f9b7640 1 Processor -- start 2024-09-12T01:44:05.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.883+0000 7ff61f9b7640 1 -- start start 2024-09-12T01:44:05.883 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61f9b7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff61815c2b0 0x7ff6180b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61f9b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff6180b72f0 0x7ff61815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61f9b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61815fb10 con 0x7ff61815f030 2024-09-12T01:44:05.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61f9b7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ff6180b5900 con 0x7ff61815c2b0 2024-09-12T01:44:05.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61f9b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff61815f830 con 0x7ff6180b72f0 2024-09-12T01:44:05.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61d753640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff61815c2b0 0x7ff6180b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61df54640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff61815f030 0x7ff61806f3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55050/0 (socket says 172.21.15.60:55050) 2024-09-12T01:44:05.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61df54640 1 -- 172.21.15.60:0/3530088544 learned_addr learned my addr 172.21.15.60:0/3530088544 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:05.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61cf52640 1 --2- 172.21.15.60:0/3530088544 >> v2:172.21.15.105:3300/0 conn(0x7ff6180b72f0 0x7ff61815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61d753640 1 -- 172.21.15.60:0/3530088544 >> v2:172.21.15.105:3300/0 conn(0x7ff6180b72f0 msgr2=0x7ff61815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:05.884 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61d753640 1 --2- 172.21.15.60:0/3530088544 >> v2:172.21.15.105:3300/0 conn(0x7ff6180b72f0 0x7ff61815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61d753640 1 -- 172.21.15.60:0/3530088544 >> v1:172.21.15.60:6789/0 conn(0x7ff61815f030 legacy=0x7ff61806f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.885 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.884+0000 7ff61d753640 1 -- 172.21.15.60:0/3530088544 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61806ce30 con 0x7ff61815c2b0 2024-09-12T01:44:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.885+0000 7ff61d753640 1 --2- 172.21.15.60:0/3530088544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff61815c2b0 0x7ff6180b6db0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7ff618071d10 tx=0x7ff60c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a1b465ae0eba9c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.885+0000 7ff60bfff640 1 -- 172.21.15.60:0/3530088544 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c037070 con 0x7ff61815c2b0 2024-09-12T01:44:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.885+0000 7ff60bfff640 1 -- 172.21.15.60:0/3530088544 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c032440 con 0x7ff61815c2b0 2024-09-12T01:44:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.885+0000 7ff60bfff640 1 -- 172.21.15.60:0/3530088544 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c032810 con 0x7ff61815c2b0 2024-09-12T01:44:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.885+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3530088544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff61815c2b0 msgr2=0x7ff6180b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.885+0000 7ff61f9b7640 1 --2- 172.21.15.60:0/3530088544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff61815c2b0 0x7ff6180b6db0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7ff618071d10 tx=0x7ff60c02a1a0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.886+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3530088544 shutdown_connections 2024-09-12T01:44:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.886+0000 7ff61f9b7640 1 --2- 172.21.15.60:0/3530088544 >> v2:172.21.15.105:3300/0 conn(0x7ff6180b72f0 0x7ff61815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.886+0000 7ff61f9b7640 1 --2- 172.21.15.60:0/3530088544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff61815c2b0 0x7ff6180b6db0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.886 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.886+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3530088544 >> 172.21.15.60:0/3530088544 conn(0x7ff6180b4240 msgr2=0x7ff6180b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.886+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3530088544 shutdown_connections 2024-09-12T01:44:05.887 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.886+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3530088544 wait complete. 2024-09-12T01:44:05.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.887+0000 7ff61f9b7640 1 Processor -- start 2024-09-12T01:44:05.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.887+0000 7ff61f9b7640 1 -- start start 2024-09-12T01:44:05.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61f9b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6180b72f0 0x7ff6181597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61f9b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61815c2b0 0x7ff6180d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61f9b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff61815f030 0x7ff61814cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61f9b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6180b7760 con 0x7ff61815f030 2024-09-12T01:44:05.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61f9b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff61806d3f0 con 0x7ff6180b72f0 2024-09-12T01:44:05.889 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61f9b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff61815f480 con 0x7ff61815c2b0 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61df54640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff61815f030 0x7ff61814cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61df54640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff61815f030 0x7ff61814cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39026/0 (socket says 172.21.15.60:39026) 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61df54640 1 -- 172.21.15.60:0/3385358885 learned_addr learned my addr 172.21.15.60:0/3385358885 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61d753640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6180b72f0 0x7ff6181597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61cf52640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61815c2b0 0x7ff6180d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61df54640 1 -- 172.21.15.60:0/3385358885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61815c2b0 msgr2=0x7ff6180d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61df54640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61815c2b0 0x7ff6180d29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61df54640 1 -- 172.21.15.60:0/3385358885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6180b72f0 msgr2=0x7ff6181597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61df54640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6180b72f0 0x7ff6181597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61df54640 1 -- 172.21.15.60:0/3385358885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6181f76f0 con 0x7ff61815f030 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61cf52640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61815c2b0 0x7ff6180d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61df54640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff61815f030 0x7ff61814cb90 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7ff61000cbf0 tx=0x7ff61000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff609ffb640 1 -- 172.21.15.60:0/3385358885 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610017070 con 0x7ff61815f030 2024-09-12T01:44:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff609ffb640 1 -- 172.21.15.60:0/3385358885 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff61000ad40 con 0x7ff61815f030 2024-09-12T01:44:05.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.888+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3385358885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6181f79d0 con 0x7ff61815f030 2024-09-12T01:44:05.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.889+0000 7ff609ffb640 1 -- 172.21.15.60:0/3385358885 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff610012600 con 0x7ff61815f030 2024-09-12T01:44:05.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.889+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3385358885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6181f7f90 con 0x7ff61815f030 2024-09-12T01:44:05.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.890+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3385358885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61815eaf0 con 0x7ff61815f030 2024-09-12T01:44:05.891 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.890+0000 7ff609ffb640 1 -- 172.21.15.60:0/3385358885 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff61001a070 con 0x7ff61815f030 2024-09-12T01:44:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.891+0000 7ff609ffb640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff5fc06be30 0x7ff5fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.891+0000 7ff609ffb640 1 -- 172.21.15.60:0/3385358885 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7ff61008ab20 con 0x7ff61815f030 2024-09-12T01:44:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.891+0000 7ff61d753640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff5fc06be30 0x7ff5fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.891+0000 7ff61d753640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff5fc06be30 0x7ff5fc06e2f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff60c034000 tx=0x7ff60c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:05.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:05.895+0000 7ff609ffb640 1 -- 172.21.15.60:0/3385358885 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff610058e80 con 0x7ff61815f030 2024-09-12T01:44:06.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.116+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3385358885 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6181f8360 con 0x7ff61815f030 2024-09-12T01:44:06.116 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.117+0000 7ff609ffb640 1 -- 172.21.15.60:0/3385358885 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+5230 (secure 0 0 0) 0x7ff61005d180 con 0x7ff61815f030 2024-09-12T01:44:06.116 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:06.117 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":79,"btime":"2024-09-12T01:43:54:188220+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/152127841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":152127841},{"type":"v1","addr":"172.21.15.60:6836","nonce":152127841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7234,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2154123948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2154123948},{"type":"v1","addr":"172.21.15.105:6835","nonce":2154123948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1634496909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1634496909},{"type":"v1","addr":"172.21.15.60:6837","nonce":1634496909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:51.547779+0000","modified":"2024-09-12T01:43:53.534706+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/2888550162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2888550162},{"type":"v1","addr":"172.21.15.105:6834","nonce":2888550162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7989,"qdb_cluster":[7989]},"id":10}]} 2024-09-12T01:44:06.117 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 79 2024-09-12T01:44:06.118 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.119+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3385358885 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff5fc06be30 msgr2=0x7ff5fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.119+0000 7ff61f9b7640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff5fc06be30 0x7ff5fc06e2f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff60c034000 tx=0x7ff60c02e000 comp rx=0 tx=0).stop 2024-09-12T01:44:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.119+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3385358885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff61815f030 msgr2=0x7ff61814cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.119+0000 7ff61f9b7640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff61815f030 0x7ff61814cb90 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7ff61000cbf0 tx=0x7ff61000a430 comp rx=0 tx=0).stop 2024-09-12T01:44:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.119+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3385358885 shutdown_connections 2024-09-12T01:44:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.119+0000 7ff61f9b7640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff61815f030 0x7ff61814cb90 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.119+0000 7ff61f9b7640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff5fc06be30 0x7ff5fc06e2f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.119+0000 7ff61f9b7640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff61815c2b0 0x7ff6180d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.119+0000 7ff61f9b7640 1 --2- 172.21.15.60:0/3385358885 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff6180b72f0 0x7ff6181597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.119+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3385358885 >> 172.21.15.60:0/3385358885 conn(0x7ff6180b4240 msgr2=0x7ff61815dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.119+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3385358885 shutdown_connections 2024-09-12T01:44:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.119+0000 7ff61f9b7640 1 -- 172.21.15.60:0/3385358885 wait complete. 2024-09-12T01:44:06.130 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-12T01:44:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:waiting with handles open 2024-09-12T01:44:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:44:06.248 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":8163,"entity":{"name":{"type":"client","num":8163},"addr":{"type":"any","addr":"172.21.15.105:0","nonce":3010876499}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":2.9999381010000001,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9912728091570568,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.8163 172.21.15.105:0/3010876499","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi105","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":8151,"entity":{"name":{"type":"client","num":8151},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":661998823}},"state":"open","num_leases":400,"num_caps":401,"request_load_avg":424,"uptime":4.0969154669999996,"requests_in_flight":399,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":199.87527499069253,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":195.07119281386764,"halflife":1.5},"recall_caps_throttle2o":{"value":185.57498214066456,"halflife":0.5},"session_cache_liveness":{"value":1201.316143309695,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.8151 192.168.0.1:0/661998823","completed_requests":[],"prealloc_inos":[{"start":"0x10000000001","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi060","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-12T01:44:06.248 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi105", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 3010876499, "type": "any" }, "name": { "num": 8163, "type": "client" } }, "id": 8163, "inst": "client.8163 172.21.15.105:0/3010876499", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.991272809157057 }, "state": "open", "uptime": 2.999938101 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi060", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 661998823, "type": "any" }, "name": { "num": 8151, "type": "client" } }, "id": 8151, "inst": "client.8151 192.168.0.1:0/661998823", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 401, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 400, "prealloc_inos": [ { "length": 1000, "start": "0x10000000001" } ], "recall_caps": { "halflife": 60, "value": 199.87527499069253 }, "recall_caps_throttle": { "halflife": 1.5, "value": 195.07119281386764 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 185.57498214066456 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 424, "requests_in_flight": 399, "session_cache_liveness": { "halflife": 300, "value": 1201.316143309695 }, "state": "open", "uptime": 4.096915467 } ] 2024-09-12T01:44:06.249 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CLIENT_RECALL 2024-09-12T01:44:06.249 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:44:06.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.351+0000 7fe53bfc6640 1 Processor -- start 2024-09-12T01:44:06.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.351+0000 7fe53bfc6640 1 -- start start 2024-09-12T01:44:06.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.352+0000 7fe53bfc6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe53415e7a0 0x7fe5340ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:06.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.352+0000 7fe53bfc6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe5340d3fe0 0x7fe5340d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:06.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.352+0000 7fe53bfc6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5340cf2f0 0x7fe5340cf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.352+0000 7fe53bfc6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fe5340d2cc0 con 0x7fe5340cf2f0 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.352+0000 7fe53bfc6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe5340d4400 con 0x7fe5340d3fe0 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.352+0000 7fe53bfc6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe5340d2f40 con 0x7fe53415e7a0 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.352+0000 7fe53a563640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5340cf2f0 0x7fe5340cf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.352+0000 7fe53a563640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5340cf2f0 0x7fe5340cf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39042/0 (socket says 172.21.15.60:39042) 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.352+0000 7fe53a563640 1 -- 172.21.15.60:0/2679525803 learned_addr learned my addr 172.21.15.60:0/2679525803 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.352+0000 7fe539561640 1 --2- 172.21.15.60:0/2679525803 >> v2:172.21.15.105:3300/0 conn(0x7fe5340d3fe0 0x7fe5340d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.352+0000 7fe539d62640 1 --2- 172.21.15.60:0/2679525803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe53415e7a0 0x7fe5340ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.353+0000 7fe53a563640 1 -- 172.21.15.60:0/2679525803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe53415e7a0 msgr2=0x7fe5340ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.353+0000 7fe53a563640 1 --2- 172.21.15.60:0/2679525803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe53415e7a0 0x7fe5340ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.353+0000 7fe53a563640 1 -- 172.21.15.60:0/2679525803 >> v2:172.21.15.105:3300/0 conn(0x7fe5340d3fe0 msgr2=0x7fe5340d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.353+0000 7fe53a563640 1 --2- 172.21.15.60:0/2679525803 >> v2:172.21.15.105:3300/0 conn(0x7fe5340d3fe0 0x7fe5340d2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.353+0000 7fe53a563640 1 -- 172.21.15.60:0/2679525803 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5340d3220 con 0x7fe5340cf2f0 2024-09-12T01:44:06.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.353+0000 7fe53a563640 1 --2- 172.21.15.60:0/2679525803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5340cf2f0 0x7fe5340cf7a0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe5340696f0 tx=0x7fe52c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaac75a596106e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:06.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.354+0000 7fe538d60640 1 -- 172.21.15.60:0/2679525803 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c037070 con 0x7fe5340cf2f0 2024-09-12T01:44:06.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.354+0000 7fe538d60640 1 -- 172.21.15.60:0/2679525803 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c032440 con 0x7fe5340cf2f0 2024-09-12T01:44:06.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.354+0000 7fe538d60640 1 -- 172.21.15.60:0/2679525803 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c032810 con 0x7fe5340cf2f0 2024-09-12T01:44:06.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.354+0000 7fe53bfc6640 1 -- 172.21.15.60:0/2679525803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5340cf2f0 msgr2=0x7fe5340cf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:06.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.354+0000 7fe53bfc6640 1 --2- 172.21.15.60:0/2679525803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5340cf2f0 0x7fe5340cf7a0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe5340696f0 tx=0x7fe52c02a270 comp rx=0 tx=0).stop 2024-09-12T01:44:06.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.354+0000 7fe53bfc6640 1 -- 172.21.15.60:0/2679525803 shutdown_connections 2024-09-12T01:44:06.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.354+0000 7fe53bfc6640 1 --2- 172.21.15.60:0/2679525803 >> v2:172.21.15.105:3300/0 conn(0x7fe5340d3fe0 0x7fe5340d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.354+0000 7fe53bfc6640 1 --2- 172.21.15.60:0/2679525803 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5340cf2f0 0x7fe5340cf7a0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.354+0000 7fe53bfc6640 1 --2- 172.21.15.60:0/2679525803 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe53415e7a0 0x7fe5340ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.354+0000 7fe53bfc6640 1 -- 172.21.15.60:0/2679525803 >> 172.21.15.60:0/2679525803 conn(0x7fe5340d1550 msgr2=0x7fe5340d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:06.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.354+0000 7fe53bfc6640 1 -- 172.21.15.60:0/2679525803 shutdown_connections 2024-09-12T01:44:06.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.354+0000 7fe53bfc6640 1 -- 172.21.15.60:0/2679525803 wait complete. 2024-09-12T01:44:06.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.355+0000 7fe53bfc6640 1 Processor -- start 2024-09-12T01:44:06.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.356+0000 7fe53bfc6640 1 -- start start 2024-09-12T01:44:06.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.356+0000 7fe53bfc6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5340cf2f0 0x7fe5340b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:06.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.356+0000 7fe53bfc6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5340d3fe0 0x7fe5341e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:06.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.356+0000 7fe53bfc6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe53415e7a0 0x7fe53414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:06.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.356+0000 7fe53bfc6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe5340d3ac0 con 0x7fe53415e7a0 2024-09-12T01:44:06.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.356+0000 7fe53bfc6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe5340d37e0 con 0x7fe5340d3fe0 2024-09-12T01:44:06.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.356+0000 7fe53bfc6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe53415eb80 con 0x7fe5340cf2f0 2024-09-12T01:44:06.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.356+0000 7fe53a563640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe53415e7a0 0x7fe53414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.356+0000 7fe53a563640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe53415e7a0 0x7fe53414d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39044/0 (socket says 172.21.15.60:39044) 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.356+0000 7fe53a563640 1 -- 172.21.15.60:0/3041873819 learned_addr learned my addr 172.21.15.60:0/3041873819 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe539561640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5340d3fe0 0x7fe5341e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe53a563640 1 -- 172.21.15.60:0/3041873819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5340cf2f0 msgr2=0x7fe5340b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe53a563640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5340cf2f0 0x7fe5340b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe53a563640 1 -- 172.21.15.60:0/3041873819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5340d3fe0 msgr2=0x7fe5341e8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe53a563640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5340d3fe0 0x7fe5341e8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe53a563640 1 -- 172.21.15.60:0/3041873819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5340b3970 con 0x7fe53415e7a0 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe539561640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5340d3fe0 0x7fe5341e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe53a563640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe53415e7a0 0x7fe53414d5b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0090b0 tx=0x7fe52c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe5327fc640 1 -- 172.21.15.60:0/3041873819 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c041020 con 0x7fe53415e7a0 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe5327fc640 1 -- 172.21.15.60:0/3041873819 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe52c03d620 con 0x7fe53415e7a0 2024-09-12T01:44:06.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe5327fc640 1 -- 172.21.15.60:0/3041873819 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52c037040 con 0x7fe53415e7a0 2024-09-12T01:44:06.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe53bfc6640 1 -- 172.21.15.60:0/3041873819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5341e94b0 con 0x7fe53415e7a0 2024-09-12T01:44:06.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.357+0000 7fe53bfc6640 1 -- 172.21.15.60:0/3041873819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5341e9a70 con 0x7fe53415e7a0 2024-09-12T01:44:06.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.358+0000 7fe53bfc6640 1 -- 172.21.15.60:0/3041873819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5340d2780 con 0x7fe53415e7a0 2024-09-12T01:44:06.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.359+0000 7fe5327fc640 1 -- 172.21.15.60:0/3041873819 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe52c044020 con 0x7fe53415e7a0 2024-09-12T01:44:06.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.359+0000 7fe5327fc640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe52006be30 0x7fe52006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:06.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.359+0000 7fe5327fc640 1 -- 172.21.15.60:0/3041873819 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fe52c0ab5d0 con 0x7fe53415e7a0 2024-09-12T01:44:06.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.359+0000 7fe539d62640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe52006be30 0x7fe52006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:06.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.360+0000 7fe539d62640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe52006be30 0x7fe52006e2f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe524009fa0 tx=0x7fe52400d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:06.363 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.363+0000 7fe5327fc640 1 -- 172.21.15.60:0/3041873819 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe52c04b030 con 0x7fe53415e7a0 2024-09-12T01:44:06.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.573+0000 7fe53bfc6640 1 -- 172.21.15.60:0/3041873819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe5340b9a70 con 0x7fe53415e7a0 2024-09-12T01:44:06.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.574+0000 7fe5327fc640 1 -- 172.21.15.60:0/3041873819 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe52c079ef0 con 0x7fe53415e7a0 2024-09-12T01:44:06.574 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:06.574 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T01:44:06.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.576+0000 7fe53bfc6640 1 -- 172.21.15.60:0/3041873819 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe52006be30 msgr2=0x7fe52006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:06.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.576+0000 7fe53bfc6640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe52006be30 0x7fe52006e2f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe524009fa0 tx=0x7fe52400d040 comp rx=0 tx=0).stop 2024-09-12T01:44:06.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.576+0000 7fe53bfc6640 1 -- 172.21.15.60:0/3041873819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe53415e7a0 msgr2=0x7fe53414d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:06.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.576+0000 7fe53bfc6640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe53415e7a0 0x7fe53414d5b0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0090b0 tx=0x7fe52c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.576+0000 7fe53bfc6640 1 -- 172.21.15.60:0/3041873819 shutdown_connections 2024-09-12T01:44:06.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.576+0000 7fe53bfc6640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe53415e7a0 0x7fe53414d5b0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.576+0000 7fe53bfc6640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe5340d3fe0 0x7fe5341e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.576+0000 7fe53bfc6640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe52006be30 0x7fe52006e2f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.576+0000 7fe53bfc6640 1 --2- 172.21.15.60:0/3041873819 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe5340cf2f0 0x7fe5340b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.576+0000 7fe53bfc6640 1 -- 172.21.15.60:0/3041873819 >> 172.21.15.60:0/3041873819 conn(0x7fe5340d1550 msgr2=0x7fe5340b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.576+0000 7fe53bfc6640 1 -- 172.21.15.60:0/3041873819 shutdown_connections 2024-09-12T01:44:06.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:06.576+0000 7fe53bfc6640 1 -- 172.21.15.60:0/3041873819 wait complete. 2024-09-12T01:44:06.586 DEBUG:tasks.ceph_test_case:Not expected number of summary strings ([]) 2024-09-12T01:44:06.586 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:44:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:44:10.140 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:44:11.588 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:44:11.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.702+0000 7f579367b640 1 Processor -- start 2024-09-12T01:44:11.703 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.702+0000 7f579367b640 1 -- start start 2024-09-12T01:44:11.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.703+0000 7f579367b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f578c0715e0 0x7f578c0b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:11.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.703+0000 7f579367b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c073160 0x7f578c073590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:11.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.703+0000 7f579367b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f578c0d0270 con 0x7f578c15c550 2024-09-12T01:44:11.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.703+0000 7f579367b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f578c0b7350 con 0x7f578c0715e0 2024-09-12T01:44:11.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.703+0000 7f579367b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f578c15c930 con 0x7f578c073160 2024-09-12T01:44:11.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.703+0000 7f5791417640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f578c15c550 0x7f578c0b5540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:55056/0 (socket says 172.21.15.60:55056) 2024-09-12T01:44:11.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.703+0000 7f5791417640 1 -- 172.21.15.60:0/318722386 learned_addr learned my addr 172.21.15.60:0/318722386 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:11.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.703+0000 7f5790c16640 1 --2- 172.21.15.60:0/318722386 >> v2:172.21.15.105:3300/0 conn(0x7f578c0715e0 0x7f578c0b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:11.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.703+0000 7f5791c18640 1 --2- 172.21.15.60:0/318722386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c073160 0x7f578c073590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:11.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.704+0000 7f577ffff640 1 -- 172.21.15.60:0/318722386 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292164465 0 0) 0x7f5788001110 con 0x7f578c15c550 2024-09-12T01:44:11.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.704+0000 7f577ffff640 1 -- 172.21.15.60:0/318722386 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5778003520 con 0x7f578c15c550 2024-09-12T01:44:11.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.704+0000 7f577ffff640 1 -- 172.21.15.60:0/318722386 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2394904050 0 0) 0x7f5778003520 con 0x7f578c15c550 2024-09-12T01:44:11.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.704+0000 7f5790c16640 1 -- 172.21.15.60:0/318722386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c073160 msgr2=0x7f578c073590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:11.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.704+0000 7f5790c16640 1 --2- 172.21.15.60:0/318722386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c073160 0x7f578c073590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.704+0000 7f5790c16640 1 -- 172.21.15.60:0/318722386 >> v1:172.21.15.60:6789/0 conn(0x7f578c15c550 legacy=0x7f578c0b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.704+0000 7f5790c16640 1 -- 172.21.15.60:0/318722386 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578c071a50 con 0x7f578c0715e0 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.704+0000 7f5791c18640 1 --2- 172.21.15.60:0/318722386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c073160 0x7f578c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.705+0000 7f5790c16640 1 --2- 172.21.15.60:0/318722386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0715e0 0x7f578c0b6e10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f57800097a0 tx=0x7f578002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1a6f63e4a48f394 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.705+0000 7f577ffff640 1 -- 172.21.15.60:0/318722386 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5780037070 con 0x7f578c0715e0 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.705+0000 7f577ffff640 1 -- 172.21.15.60:0/318722386 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578002aba0 con 0x7f578c0715e0 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.705+0000 7f577ffff640 1 -- 172.21.15.60:0/318722386 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788001840 con 0x7f578c0715e0 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.705+0000 7f579367b640 1 -- 172.21.15.60:0/318722386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0715e0 msgr2=0x7f578c0b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.705+0000 7f579367b640 1 --2- 172.21.15.60:0/318722386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0715e0 0x7f578c0b6e10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f57800097a0 tx=0x7f578002a110 comp rx=0 tx=0).stop 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.706+0000 7f579367b640 1 -- 172.21.15.60:0/318722386 shutdown_connections 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.706+0000 7f579367b640 1 --2- 172.21.15.60:0/318722386 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c073160 0x7f578c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.706+0000 7f579367b640 1 --2- 172.21.15.60:0/318722386 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0715e0 0x7f578c0b6e10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.706+0000 7f579367b640 1 -- 172.21.15.60:0/318722386 >> 172.21.15.60:0/318722386 conn(0x7f578c0b4240 msgr2=0x7f578c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:11.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.706+0000 7f579367b640 1 -- 172.21.15.60:0/318722386 shutdown_connections 2024-09-12T01:44:11.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.706+0000 7f579367b640 1 -- 172.21.15.60:0/318722386 wait complete. 2024-09-12T01:44:11.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.707+0000 7f579367b640 1 Processor -- start 2024-09-12T01:44:11.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.707+0000 7f579367b640 1 -- start start 2024-09-12T01:44:11.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f579367b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0715e0 0x7f578c06e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:11.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f579367b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c073160 0x7f578c1f4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:11.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f579367b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15c550 0x7f578c1f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:11.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f579367b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f578c0b7580 con 0x7f578c15c550 2024-09-12T01:44:11.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f579367b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f578c073ad0 con 0x7f578c0715e0 2024-09-12T01:44:11.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f579367b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f578c0b7860 con 0x7f578c073160 2024-09-12T01:44:11.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f5791c18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15c550 0x7f578c1f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:11.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f5791c18640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15c550 0x7f578c1f1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:39054/0 (socket says 172.21.15.60:39054) 2024-09-12T01:44:11.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f5791c18640 1 -- 172.21.15.60:0/3785933496 learned_addr learned my addr 172.21.15.60:0/3785933496 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:11.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f5791417640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0715e0 0x7f578c06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:11.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f5790c16640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c073160 0x7f578c1f4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f5791c18640 1 -- 172.21.15.60:0/3785933496 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c073160 msgr2=0x7f578c1f4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f5791c18640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c073160 0x7f578c1f4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f5791c18640 1 -- 172.21.15.60:0/3785933496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0715e0 msgr2=0x7f578c06e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f5791c18640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0715e0 0x7f578c06e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f5791c18640 1 -- 172.21.15.60:0/3785933496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578c15de00 con 0x7f578c15c550 2024-09-12T01:44:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.708+0000 7f5791c18640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15c550 0x7f578c1f1520 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f5784009f00 tx=0x7f578400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.709+0000 7f577dffb640 1 -- 172.21.15.60:0/3785933496 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784018030 con 0x7f578c15c550 2024-09-12T01:44:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.709+0000 7f577dffb640 1 -- 172.21.15.60:0/3785933496 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578400cdf0 con 0x7f578c15c550 2024-09-12T01:44:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.709+0000 7f579367b640 1 -- 172.21.15.60:0/3785933496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578c15e0e0 con 0x7f578c15c550 2024-09-12T01:44:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.709+0000 7f577dffb640 1 -- 172.21.15.60:0/3785933496 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784003bb0 con 0x7f578c15c550 2024-09-12T01:44:11.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.709+0000 7f579367b640 1 -- 172.21.15.60:0/3785933496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f578c15e6a0 con 0x7f578c15c550 2024-09-12T01:44:11.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.710+0000 7f579367b640 1 -- 172.21.15.60:0/3785933496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f578c0d07b0 con 0x7f578c15c550 2024-09-12T01:44:11.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.710+0000 7f577dffb640 1 -- 172.21.15.60:0/3785933496 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f578401b070 con 0x7f578c15c550 2024-09-12T01:44:11.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.711+0000 7f577dffb640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f577006be30 0x7f577006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:11.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.711+0000 7f577dffb640 1 -- 172.21.15.60:0/3785933496 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f578408b810 con 0x7f578c15c550 2024-09-12T01:44:11.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.711+0000 7f5791417640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f577006be30 0x7f577006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:11.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.711+0000 7f5791417640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f577006be30 0x7f577006e2f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5788005880 tx=0x7f57880012d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:11.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.715+0000 7f577dffb640 1 -- 172.21.15.60:0/3785933496 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5784010040 con 0x7f578c15c550 2024-09-12T01:44:11.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.928+0000 7f579367b640 1 -- 172.21.15.60:0/3785933496 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f578c0b3c40 con 0x7f578c15c550 2024-09-12T01:44:11.929 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.928+0000 7f577dffb640 1 -- 172.21.15.60:0/3785933496 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+174 (secure 0 0 0) 0x7f5784059a60 con 0x7f578c15c550 2024-09-12T01:44:11.929 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:11.929 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:44:11.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.930+0000 7f579367b640 1 -- 172.21.15.60:0/3785933496 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f577006be30 msgr2=0x7f577006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:11.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.930+0000 7f579367b640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f577006be30 0x7f577006e2f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5788005880 tx=0x7f57880012d0 comp rx=0 tx=0).stop 2024-09-12T01:44:11.931 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.930+0000 7f579367b640 1 -- 172.21.15.60:0/3785933496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15c550 msgr2=0x7f578c1f1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.930+0000 7f579367b640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15c550 0x7f578c1f1520 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f5784009f00 tx=0x7f578400c490 comp rx=0 tx=0).stop 2024-09-12T01:44:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.930+0000 7f579367b640 1 -- 172.21.15.60:0/3785933496 shutdown_connections 2024-09-12T01:44:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.930+0000 7f579367b640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c15c550 0x7f578c1f1520 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.930+0000 7f579367b640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f577006be30 0x7f577006e2f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.930+0000 7f579367b640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f578c073160 0x7f578c1f4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.930+0000 7f579367b640 1 --2- 172.21.15.60:0/3785933496 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f578c0715e0 0x7f578c06e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.930+0000 7f579367b640 1 -- 172.21.15.60:0/3785933496 >> 172.21.15.60:0/3785933496 conn(0x7f578c0b4240 msgr2=0x7f578c0b5540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.931+0000 7f579367b640 1 -- 172.21.15.60:0/3785933496 shutdown_connections 2024-09-12T01:44:11.932 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:11.931+0000 7f579367b640 1 -- 172.21.15.60:0/3785933496 wait complete. 2024-09-12T01:44:11.942 DEBUG:tasks.ceph_test_case:Not found expected summary strings yet (['1 MDSs report oversized cache']) 2024-09-12T01:44:11.942 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120.0 retry_count=0)... 2024-09-12T01:44:12.142 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:44:14.144 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:44:16.147 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:44:16.943 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:44:17.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.057+0000 7f83e5447640 1 Processor -- start 2024-09-12T01:44:17.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.058+0000 7f83e5447640 1 -- start start 2024-09-12T01:44:17.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.058+0000 7f83e5447640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f83e006e5c0 0x7f83e006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:17.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.058+0000 7f83e5447640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f83e015c840 0x7f83e00b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:17.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.059+0000 7f83e5447640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83e006eee0 con 0x7f83e00b3e20 2024-09-12T01:44:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.059+0000 7f83e5447640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f83e0072160 con 0x7f83e015c840 2024-09-12T01:44:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.059+0000 7f83e5447640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f83e0072440 con 0x7f83e006e5c0 2024-09-12T01:44:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.059+0000 7f83de7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f83e015c840 0x7f83e00b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.059+0000 7f83df7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f83e00b3e20 0x7f83e006bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60314/0 (socket says 172.21.15.60:60314) 2024-09-12T01:44:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.059+0000 7f83df7fe640 1 -- 172.21.15.60:0/2373702303 learned_addr learned my addr 172.21.15.60:0/2373702303 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.059+0000 7f83deffd640 1 --2- 172.21.15.60:0/2373702303 >> v2:172.21.15.105:3300/0 conn(0x7f83e006e5c0 0x7f83e006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.059+0000 7f83de7fc640 1 -- 172.21.15.60:0/2373702303 >> v2:172.21.15.105:3300/0 conn(0x7f83e006e5c0 msgr2=0x7f83e006e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.059+0000 7f83de7fc640 1 --2- 172.21.15.60:0/2373702303 >> v2:172.21.15.105:3300/0 conn(0x7f83e006e5c0 0x7f83e006e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.059+0000 7f83de7fc640 1 -- 172.21.15.60:0/2373702303 >> v1:172.21.15.60:6789/0 conn(0x7f83e00b3e20 legacy=0x7f83e006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.059+0000 7f83de7fc640 1 -- 172.21.15.60:0/2373702303 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e0072720 con 0x7f83e015c840 2024-09-12T01:44:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.059+0000 7f83ddffb640 1 -- 172.21.15.60:0/2373702303 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 576867587 0 0) 0x7f83e006eee0 con 0x7f83e00b3e20 2024-09-12T01:44:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.060+0000 7f83de7fc640 1 --2- 172.21.15.60:0/2373702303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e015c840 0x7f83e00b38e0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f83e00b71d0 tx=0x7f83d402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124508031b0e2e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.060+0000 7f83ddffb640 1 -- 172.21.15.60:0/2373702303 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4037070 con 0x7f83e015c840 2024-09-12T01:44:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.060+0000 7f83ddffb640 1 -- 172.21.15.60:0/2373702303 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d4032440 con 0x7f83e015c840 2024-09-12T01:44:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.060+0000 7f83ddffb640 1 -- 172.21.15.60:0/2373702303 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4032810 con 0x7f83e015c840 2024-09-12T01:44:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.061+0000 7f83e5447640 1 -- 172.21.15.60:0/2373702303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e015c840 msgr2=0x7f83e00b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.061+0000 7f83e5447640 1 --2- 172.21.15.60:0/2373702303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e015c840 0x7f83e00b38e0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f83e00b71d0 tx=0x7f83d402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.061+0000 7f83e5447640 1 -- 172.21.15.60:0/2373702303 shutdown_connections 2024-09-12T01:44:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.061+0000 7f83e5447640 1 --2- 172.21.15.60:0/2373702303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e015c840 0x7f83e00b38e0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.061+0000 7f83e5447640 1 --2- 172.21.15.60:0/2373702303 >> v2:172.21.15.105:3300/0 conn(0x7f83e006e5c0 0x7f83e006e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.061+0000 7f83e5447640 1 -- 172.21.15.60:0/2373702303 >> 172.21.15.60:0/2373702303 conn(0x7f83e006e1e0 msgr2=0x7f83e00b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.061+0000 7f83e5447640 1 -- 172.21.15.60:0/2373702303 shutdown_connections 2024-09-12T01:44:17.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.061+0000 7f83e5447640 1 -- 172.21.15.60:0/2373702303 wait complete. 2024-09-12T01:44:17.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.062+0000 7f83e5447640 1 Processor -- start 2024-09-12T01:44:17.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.062+0000 7f83e5447640 1 -- start start 2024-09-12T01:44:17.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83e5447640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e006e5c0 0x7f83e0155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:17.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83e5447640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83e00b3e20 0x7f83e013fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83e5447640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e015c840 0x7f83e014ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83e5447640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f83e015ccb0 con 0x7f83e015c840 2024-09-12T01:44:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83e5447640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f83e00b4230 con 0x7f83e00b3e20 2024-09-12T01:44:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83e5447640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f83e015ce30 con 0x7f83e006e5c0 2024-09-12T01:44:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e015c840 0x7f83e014ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83df7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e015c840 0x7f83e014ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40798/0 (socket says 172.21.15.60:40798) 2024-09-12T01:44:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83df7fe640 1 -- 172.21.15.60:0/2403737628 learned_addr learned my addr 172.21.15.60:0/2403737628 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83de7fc640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83e00b3e20 0x7f83e013fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83deffd640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e006e5c0 0x7f83e0155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83df7fe640 1 -- 172.21.15.60:0/2403737628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e006e5c0 msgr2=0x7f83e0155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83df7fe640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e006e5c0 0x7f83e0155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83df7fe640 1 -- 172.21.15.60:0/2403737628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83e00b3e20 msgr2=0x7f83e013fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:17.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83df7fe640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83e00b3e20 0x7f83e013fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.063+0000 7f83df7fe640 1 -- 172.21.15.60:0/2403737628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e014b2d0 con 0x7f83e015c840 2024-09-12T01:44:17.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.064+0000 7f83df7fe640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e015c840 0x7f83e014ad90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c730 tx=0x7f83d800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:17.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.064+0000 7f83c77fe640 1 -- 172.21.15.60:0/2403737628 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d8018070 con 0x7f83e015c840 2024-09-12T01:44:17.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.064+0000 7f83c77fe640 1 -- 172.21.15.60:0/2403737628 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d800ce40 con 0x7f83e015c840 2024-09-12T01:44:17.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.064+0000 7f83c77fe640 1 -- 172.21.15.60:0/2403737628 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d800a800 con 0x7f83e015c840 2024-09-12T01:44:17.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.064+0000 7f83e5447640 1 -- 172.21.15.60:0/2403737628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e0156280 con 0x7f83e015c840 2024-09-12T01:44:17.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.064+0000 7f83e5447640 1 -- 172.21.15.60:0/2403737628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e014cd70 con 0x7f83e015c840 2024-09-12T01:44:17.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.065+0000 7f83e5447640 1 -- 172.21.15.60:0/2403737628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e0070720 con 0x7f83e015c840 2024-09-12T01:44:17.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.065+0000 7f83c77fe640 1 -- 172.21.15.60:0/2403737628 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f83d801b070 con 0x7f83e015c840 2024-09-12T01:44:17.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.066+0000 7f83c77fe640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f83cc06be60 0x7f83cc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:17.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.066+0000 7f83deffd640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f83cc06be60 0x7f83cc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:17.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.066+0000 7f83c77fe640 1 -- 172.21.15.60:0/2403737628 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f83d808a210 con 0x7f83e015c840 2024-09-12T01:44:17.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.066+0000 7f83deffd640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f83cc06be60 0x7f83cc06e320 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f83d00079a0 tx=0x7f83d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:17.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.070+0000 7f83c77fe640 1 -- 172.21.15.60:0/2403737628 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f83e0070720 con 0x7f83e015c840 2024-09-12T01:44:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.286+0000 7f83e5447640 1 -- 172.21.15.60:0/2403737628 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f83e00b38e0 con 0x7f83e015c840 2024-09-12T01:44:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.287+0000 7f83c77fe640 1 -- 172.21.15.60:0/2403737628 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f83d8058600 con 0x7f83e015c840 2024-09-12T01:44:17.289 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:17.290 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:44:17.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.289+0000 7f83e5447640 1 -- 172.21.15.60:0/2403737628 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f83cc06be60 msgr2=0x7f83cc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.289+0000 7f83e5447640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f83cc06be60 0x7f83cc06e320 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f83d00079a0 tx=0x7f83d0008040 comp rx=0 tx=0).stop 2024-09-12T01:44:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.289+0000 7f83e5447640 1 -- 172.21.15.60:0/2403737628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e015c840 msgr2=0x7f83e014ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.289+0000 7f83e5447640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e015c840 0x7f83e014ad90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f83d800c730 tx=0x7f83d800cbf0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.289+0000 7f83e5447640 1 -- 172.21.15.60:0/2403737628 shutdown_connections 2024-09-12T01:44:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.289+0000 7f83e5447640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e015c840 0x7f83e014ad90 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.289+0000 7f83e5447640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83e00b3e20 0x7f83e013fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.289+0000 7f83e5447640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f83cc06be60 0x7f83cc06e320 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.289+0000 7f83e5447640 1 --2- 172.21.15.60:0/2403737628 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e006e5c0 0x7f83e0155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.289+0000 7f83e5447640 1 -- 172.21.15.60:0/2403737628 >> 172.21.15.60:0/2403737628 conn(0x7f83e006e1e0 msgr2=0x7f83e00b66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.289+0000 7f83e5447640 1 -- 172.21.15.60:0/2403737628 shutdown_connections 2024-09-12T01:44:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.289+0000 7f83e5447640 1 -- 172.21.15.60:0/2403737628 wait complete. 2024-09-12T01:44:17.301 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-12T01:44:17.301 INFO:tasks.ceph_test_case:waiting 120.0s for health warning matching MDS_CACHE_OVERSIZED 2024-09-12T01:44:17.301 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T01:44:17.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.402+0000 7f8238cdd640 1 Processor -- start 2024-09-12T01:44:17.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.402+0000 7f8238cdd640 1 -- start start 2024-09-12T01:44:17.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.403+0000 7f8238cdd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f823415c670 0x7f8234073460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:17.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.403+0000 7f8238cdd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f82340b1990 0x7f82340d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:17.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.403+0000 7f8238cdd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8234071750 con 0x7f8234073080 2024-09-12T01:44:17.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.403+0000 7f8238cdd640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f82340d0c60 con 0x7f82340b1990 2024-09-12T01:44:17.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.403+0000 7f8238cdd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f82340d0370 con 0x7f823415c670 2024-09-12T01:44:17.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.404+0000 7f8232d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f82340b1990 0x7f82340d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:17.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.404+0000 7f8232d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f82340b1990 0x7f82340d10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40806/0 (socket says 172.21.15.60:40806) 2024-09-12T01:44:17.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.404+0000 7f8232d9d640 1 -- 172.21.15.60:0/4265330631 learned_addr learned my addr 172.21.15.60:0/4265330631 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:17.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.404+0000 7f8231d9b640 1 --2- 172.21.15.60:0/4265330631 >> v2:172.21.15.105:3300/0 conn(0x7f823415c670 0x7f8234073460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:17.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.404+0000 7f8232d9d640 1 -- 172.21.15.60:0/4265330631 >> v2:172.21.15.105:3300/0 conn(0x7f823415c670 msgr2=0x7f8234073460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:17.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.404+0000 7f8232d9d640 1 --2- 172.21.15.60:0/4265330631 >> v2:172.21.15.105:3300/0 conn(0x7f823415c670 0x7f8234073460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.404+0000 7f8232d9d640 1 -- 172.21.15.60:0/4265330631 >> v1:172.21.15.105:6789/0 conn(0x7f8234073080 legacy=0x7f82340b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:17.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.404+0000 7f8232d9d640 1 -- 172.21.15.60:0/4265330631 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82340739a0 con 0x7f82340b1990 2024-09-12T01:44:17.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.405+0000 7f8232d9d640 1 --2- 172.21.15.60:0/4265330631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340b1990 0x7f82340d10f0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f82340cf840 tx=0x7f822402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08cee6086bc01dd server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:17.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.405+0000 7f823159a640 1 -- 172.21.15.60:0/4265330631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224036070 con 0x7f82340b1990 2024-09-12T01:44:17.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.405+0000 7f823159a640 1 -- 172.21.15.60:0/4265330631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8224031600 con 0x7f82340b1990 2024-09-12T01:44:17.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.405+0000 7f823159a640 1 -- 172.21.15.60:0/4265330631 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82240319d0 con 0x7f82340b1990 2024-09-12T01:44:17.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.405+0000 7f8238cdd640 1 -- 172.21.15.60:0/4265330631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340b1990 msgr2=0x7f82340d10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:17.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.405+0000 7f8238cdd640 1 --2- 172.21.15.60:0/4265330631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340b1990 0x7f82340d10f0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f82340cf840 tx=0x7f822402a6f0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.405+0000 7f8238cdd640 1 -- 172.21.15.60:0/4265330631 shutdown_connections 2024-09-12T01:44:17.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.405+0000 7f8238cdd640 1 --2- 172.21.15.60:0/4265330631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340b1990 0x7f82340d10f0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.405+0000 7f8238cdd640 1 --2- 172.21.15.60:0/4265330631 >> v2:172.21.15.105:3300/0 conn(0x7f823415c670 0x7f8234073460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.405+0000 7f8238cdd640 1 -- 172.21.15.60:0/4265330631 >> 172.21.15.60:0/4265330631 conn(0x7f82340d24d0 msgr2=0x7f82340d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:17.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.405+0000 7f8238cdd640 1 -- 172.21.15.60:0/4265330631 shutdown_connections 2024-09-12T01:44:17.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.405+0000 7f8238cdd640 1 -- 172.21.15.60:0/4265330631 wait complete. 2024-09-12T01:44:17.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.407+0000 7f8238cdd640 1 Processor -- start 2024-09-12T01:44:17.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.407+0000 7f8238cdd640 1 -- start start 2024-09-12T01:44:17.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.407+0000 7f8238cdd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8234073080 0x7f8234155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:17.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.407+0000 7f8238cdd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340b1990 0x7f8234159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:17.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.407+0000 7f8238cdd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f823415c670 0x7f82341565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:17.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.407+0000 7f8238cdd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f82340d0610 con 0x7f82340b1990 2024-09-12T01:44:17.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.407+0000 7f8238cdd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8234071470 con 0x7f823415c670 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.407+0000 7f8238cdd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f82340d08f0 con 0x7f8234073080 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f8231d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340b1990 0x7f8234159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f8231d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340b1990 0x7f8234159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40822/0 (socket says 172.21.15.60:40822) 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f8231d9b640 1 -- 172.21.15.60:0/893057118 learned_addr learned my addr 172.21.15.60:0/893057118 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f8232d9d640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f823415c670 0x7f82341565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f823259c640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8234073080 0x7f8234155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f8231d9b640 1 -- 172.21.15.60:0/893057118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8234073080 msgr2=0x7f8234155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f8231d9b640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8234073080 0x7f8234155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f8231d9b640 1 -- 172.21.15.60:0/893057118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f823415c670 msgr2=0x7f82341565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f8231d9b640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f823415c670 0x7f82341565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f8231d9b640 1 -- 172.21.15.60:0/893057118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8234155790 con 0x7f82340b1990 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f823259c640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8234073080 0x7f8234155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:17.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f8231d9b640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340b1990 0x7f8234159730 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f821c00c7f0 tx=0x7f821c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:17.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f822affd640 1 -- 172.21.15.60:0/893057118 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c015070 con 0x7f82340b1990 2024-09-12T01:44:17.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f822affd640 1 -- 172.21.15.60:0/893057118 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f821c004220 con 0x7f82340b1990 2024-09-12T01:44:17.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f8238cdd640 1 -- 172.21.15.60:0/893057118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8234155a60 con 0x7f82340b1990 2024-09-12T01:44:17.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f822affd640 1 -- 172.21.15.60:0/893057118 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c007620 con 0x7f82340b1990 2024-09-12T01:44:17.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.408+0000 7f8238cdd640 1 -- 172.21.15.60:0/893057118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8234156020 con 0x7f82340b1990 2024-09-12T01:44:17.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.409+0000 7f8238cdd640 1 -- 172.21.15.60:0/893057118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82340d1f00 con 0x7f82340b1990 2024-09-12T01:44:17.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.410+0000 7f822affd640 1 -- 172.21.15.60:0/893057118 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f821c0079d0 con 0x7f82340b1990 2024-09-12T01:44:17.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.410+0000 7f822affd640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f821406be30 0x7f821406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:17.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.410+0000 7f822affd640 1 -- 172.21.15.60:0/893057118 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f821c08b240 con 0x7f82340b1990 2024-09-12T01:44:17.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.410+0000 7f823259c640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f821406be30 0x7f821406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:17.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.411+0000 7f823259c640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f821406be30 0x7f821406e2f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f822c00a830 tx=0x7f822c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:17.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.415+0000 7f822affd640 1 -- 172.21.15.60:0/893057118 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f821c059be0 con 0x7f82340b1990 2024-09-12T01:44:17.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.628+0000 7f8238cdd640 1 -- 172.21.15.60:0/893057118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f82340b5c10 con 0x7f82340b1990 2024-09-12T01:44:17.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.628+0000 7f822affd640 1 -- 172.21.15.60:0/893057118 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+316 (secure 0 0 0) 0x7f821c0594e0 con 0x7f82340b1990 2024-09-12T01:44:17.629 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:17.629 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_WARN","checks":{"MDS_CACHE_OVERSIZED":{"severity":"HEALTH_WARN","summary":{"message":"1 MDSs report oversized cache","count":1},"muted":false},"MDS_CLIENT_RECALL":{"severity":"HEALTH_WARN","summary":{"message":"1 clients failing to respond to cache pressure","count":1},"muted":false}},"mutes":[]} 2024-09-12T01:44:17.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.630+0000 7f8238cdd640 1 -- 172.21.15.60:0/893057118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f821406be30 msgr2=0x7f821406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:17.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.630+0000 7f8238cdd640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f821406be30 0x7f821406e2f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f822c00a830 tx=0x7f822c008040 comp rx=0 tx=0).stop 2024-09-12T01:44:17.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.630+0000 7f8238cdd640 1 -- 172.21.15.60:0/893057118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340b1990 msgr2=0x7f8234159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:17.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.630+0000 7f8238cdd640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340b1990 0x7f8234159730 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f821c00c7f0 tx=0x7f821c00ccb0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.630+0000 7f8238cdd640 1 -- 172.21.15.60:0/893057118 shutdown_connections 2024-09-12T01:44:17.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.630+0000 7f8238cdd640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f823415c670 0x7f82341565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.630+0000 7f8238cdd640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82340b1990 0x7f8234159730 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.630+0000 7f8238cdd640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f821406be30 0x7f821406e2f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.630+0000 7f8238cdd640 1 --2- 172.21.15.60:0/893057118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8234073080 0x7f8234155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:17.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.630+0000 7f8238cdd640 1 -- 172.21.15.60:0/893057118 >> 172.21.15.60:0/893057118 conn(0x7f82340d24d0 msgr2=0x7f82340b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:17.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.630+0000 7f8238cdd640 1 -- 172.21.15.60:0/893057118 shutdown_connections 2024-09-12T01:44:17.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17.630+0000 7f8238cdd640 1 -- 172.21.15.60:0/893057118 wait complete. 2024-09-12T01:44:17.642 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T01:44:17.642 INFO:tasks.cephfs.test_client_limits:Terminating process holding files open 2024-09-12T01:44:17.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:17 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-12T01:44:18.148 INFO:teuthology.orchestra.run.smithi060.stderr:open_n_background: keeping files open 2024-09-12T01:44:18.148 INFO:teuthology.orchestra.run.smithi060.stderr:stdin closed, goodbye! 2024-09-12T01:44:18.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:44:18.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:18.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.312+0000 7f4e54f2a640 1 Processor -- start 2024-09-12T01:44:18.312 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.312+0000 7f4e54f2a640 1 -- start start 2024-09-12T01:44:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.313+0000 7f4e54f2a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4e5015c2b0 0x7f4e500b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.313+0000 7f4e54f2a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e5015fb10 con 0x7f4e500b72f0 2024-09-12T01:44:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.313+0000 7f4e54f2a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e500b5900 con 0x7f4e5015f200 2024-09-12T01:44:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.313+0000 7f4e54f2a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4e5015f830 con 0x7f4e5015c2b0 2024-09-12T01:44:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.313+0000 7f4e4e59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4e5015c2b0 0x7f4e500b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.313+0000 7f4e47fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4e500b72f0 0x7f4e5015eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60324/0 (socket says 172.21.15.60:60324) 2024-09-12T01:44:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.313+0000 7f4e47fff640 1 -- 172.21.15.60:0/644158546 learned_addr learned my addr 172.21.15.60:0/644158546 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.313+0000 7f4e4e59c640 1 -- 172.21.15.60:0/644158546 >> v1:172.21.15.105:6789/0 conn(0x7f4e5015f200 legacy=0x7f4e5006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.313+0000 7f4e4e59c640 1 -- 172.21.15.60:0/644158546 >> v1:172.21.15.60:6789/0 conn(0x7f4e500b72f0 legacy=0x7f4e5015eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:18.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.313+0000 7f4e4e59c640 1 -- 172.21.15.60:0/644158546 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5006ce30 con 0x7f4e5015c2b0 2024-09-12T01:44:18.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.314+0000 7f4e4e59c640 1 --2- 172.21.15.60:0/644158546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5015c2b0 0x7f4e500b6db0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f4e400097a0 tx=0x7f4e4002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47658468161acde5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.314+0000 7f4e4dd9b640 1 -- 172.21.15.60:0/644158546 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40037070 con 0x7f4e5015c2b0 2024-09-12T01:44:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.314+0000 7f4e4dd9b640 1 -- 172.21.15.60:0/644158546 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e40032440 con 0x7f4e5015c2b0 2024-09-12T01:44:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.314+0000 7f4e4dd9b640 1 -- 172.21.15.60:0/644158546 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40032810 con 0x7f4e5015c2b0 2024-09-12T01:44:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.314+0000 7f4e54f2a640 1 -- 172.21.15.60:0/644158546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5015c2b0 msgr2=0x7f4e500b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.314+0000 7f4e54f2a640 1 --2- 172.21.15.60:0/644158546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5015c2b0 0x7f4e500b6db0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f4e400097a0 tx=0x7f4e4002a1e0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.315+0000 7f4e54f2a640 1 -- 172.21.15.60:0/644158546 shutdown_connections 2024-09-12T01:44:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.315+0000 7f4e54f2a640 1 --2- 172.21.15.60:0/644158546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5015c2b0 0x7f4e500b6db0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.315+0000 7f4e54f2a640 1 -- 172.21.15.60:0/644158546 >> 172.21.15.60:0/644158546 conn(0x7f4e500b4240 msgr2=0x7f4e500b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.315+0000 7f4e54f2a640 1 -- 172.21.15.60:0/644158546 shutdown_connections 2024-09-12T01:44:18.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.315+0000 7f4e54f2a640 1 -- 172.21.15.60:0/644158546 wait complete. 2024-09-12T01:44:18.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.316+0000 7f4e54f2a640 1 Processor -- start 2024-09-12T01:44:18.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.316+0000 7f4e54f2a640 1 -- start start 2024-09-12T01:44:18.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e54f2a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e500b72f0 0x7f4e501f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e54f2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5015c2b0 0x7f4e50153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e54f2a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5015f200 0x7f4e50154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e54f2a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4e500b7760 con 0x7f4e5015c2b0 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e54f2a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5006d3f0 con 0x7f4e5015f200 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e54f2a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4e5006e020 con 0x7f4e500b72f0 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e47fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5015c2b0 0x7f4e50153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e47fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5015c2b0 0x7f4e50153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40852/0 (socket says 172.21.15.60:40852) 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e47fff640 1 -- 172.21.15.60:0/4164848707 learned_addr learned my addr 172.21.15.60:0/4164848707 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e4ed9d640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5015f200 0x7f4e50154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e4e59c640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e500b72f0 0x7f4e501f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e47fff640 1 -- 172.21.15.60:0/4164848707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e500b72f0 msgr2=0x7f4e501f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e47fff640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e500b72f0 0x7f4e501f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e47fff640 1 -- 172.21.15.60:0/4164848707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5015f200 msgr2=0x7f4e50154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e47fff640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5015f200 0x7f4e50154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e47fff640 1 -- 172.21.15.60:0/4164848707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e50154e80 con 0x7f4e5015c2b0 2024-09-12T01:44:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.317+0000 7f4e47fff640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5015c2b0 0x7f4e50153070 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800c430 tx=0x7f4e3800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.318+0000 7f4e46ffd640 1 -- 172.21.15.60:0/4164848707 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38017070 con 0x7f4e5015c2b0 2024-09-12T01:44:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.318+0000 7f4e46ffd640 1 -- 172.21.15.60:0/4164848707 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e38005ce0 con 0x7f4e5015c2b0 2024-09-12T01:44:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.318+0000 7f4e46ffd640 1 -- 172.21.15.60:0/4164848707 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e380072f0 con 0x7f4e5015c2b0 2024-09-12T01:44:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.318+0000 7f4e54f2a640 1 -- 172.21.15.60:0/4164848707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e50158260 con 0x7f4e5015c2b0 2024-09-12T01:44:18.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.318+0000 7f4e54f2a640 1 -- 172.21.15.60:0/4164848707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e501f8450 con 0x7f4e5015c2b0 2024-09-12T01:44:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.319+0000 7f4e54f2a640 1 -- 172.21.15.60:0/4164848707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e500b6db0 con 0x7f4e5015c2b0 2024-09-12T01:44:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.319+0000 7f4e46ffd640 1 -- 172.21.15.60:0/4164848707 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4e3801a070 con 0x7f4e5015c2b0 2024-09-12T01:44:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.320+0000 7f4e46ffd640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e3006be60 0x7f4e3006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.320+0000 7f4e4e59c640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e3006be60 0x7f4e3006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.320+0000 7f4e46ffd640 1 -- 172.21.15.60:0/4164848707 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f4e3808a1b0 con 0x7f4e5015c2b0 2024-09-12T01:44:18.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.320+0000 7f4e4e59c640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e3006be60 0x7f4e3006e320 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4e40034000 tx=0x7f4e4002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:18.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.324+0000 7f4e46ffd640 1 -- 172.21.15.60:0/4164848707 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4e38058510 con 0x7f4e5015c2b0 2024-09-12T01:44:18.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.539+0000 7f4e54f2a640 1 -- 172.21.15.60:0/4164848707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e50158010 con 0x7f4e5015c2b0 2024-09-12T01:44:18.540 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.539+0000 7f4e46ffd640 1 -- 172.21.15.60:0/4164848707 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5230 (secure 0 0 0) 0x7f4e3805c810 con 0x7f4e5015c2b0 2024-09-12T01:44:18.540 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:18.540 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":81,"btime":"2024-09-12T01:44:13:036586+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/152127841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":152127841},{"type":"v1","addr":"172.21.15.60:6836","nonce":152127841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7234,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2154123948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2154123948},{"type":"v1","addr":"172.21.15.105:6835","nonce":2154123948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1634496909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1634496909},{"type":"v1","addr":"172.21.15.60:6837","nonce":1634496909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:51.547779+0000","modified":"2024-09-12T01:44:12.213628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6834/2888550162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2888550162},{"type":"v1","addr":"172.21.15.105:6834","nonce":2888550162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7989,"qdb_cluster":[7989]},"id":10}]} 2024-09-12T01:44:18.540 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 81 2024-09-12T01:44:18.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.541+0000 7f4e54f2a640 1 -- 172.21.15.60:0/4164848707 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e3006be60 msgr2=0x7f4e3006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:18.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.541+0000 7f4e54f2a640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e3006be60 0x7f4e3006e320 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f4e40034000 tx=0x7f4e4002e000 comp rx=0 tx=0).stop 2024-09-12T01:44:18.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.541+0000 7f4e54f2a640 1 -- 172.21.15.60:0/4164848707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5015c2b0 msgr2=0x7f4e50153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:18.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.541+0000 7f4e54f2a640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5015c2b0 0x7f4e50153070 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800c430 tx=0x7f4e3800c8f0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.541+0000 7f4e54f2a640 1 -- 172.21.15.60:0/4164848707 shutdown_connections 2024-09-12T01:44:18.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.542+0000 7f4e54f2a640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e5015f200 0x7f4e50154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.542+0000 7f4e54f2a640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e5015c2b0 0x7f4e50153070 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.542+0000 7f4e54f2a640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4e3006be60 0x7f4e3006e320 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.542+0000 7f4e54f2a640 1 --2- 172.21.15.60:0/4164848707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e500b72f0 0x7f4e501f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.542+0000 7f4e54f2a640 1 -- 172.21.15.60:0/4164848707 >> 172.21.15.60:0/4164848707 conn(0x7f4e500b4240 msgr2=0x7f4e5015dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:18.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.542+0000 7f4e54f2a640 1 -- 172.21.15.60:0/4164848707 shutdown_connections 2024-09-12T01:44:18.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.542+0000 7f4e54f2a640 1 -- 172.21.15.60:0/4164848707 wait complete. 2024-09-12T01:44:18.554 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-09-12T01:44:18.684 INFO:teuthology.orchestra.run.smithi105.stdout:[{"id":8163,"entity":{"name":{"type":"client","num":8163},"addr":{"type":"any","addr":"172.21.15.105:0","nonce":3010876499}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":3,"uptime":15.434681528,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":2.9065552807611392,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":4,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.8163 172.21.15.105:0/3010876499","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"1","hostname":"smithi105","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}},{"id":8151,"entity":{"name":{"type":"client","num":8151},"addr":{"type":"any","addr":"192.168.0.1:0","nonce":661998823}},"state":"open","num_leases":400,"num_caps":201,"request_load_avg":367,"uptime":16.531658894,"requests_in_flight":0,"num_completed_requests":399,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":2215.6029604919477,"halflife":60},"release_caps":{"value":198.97426129051661,"halflife":60},"recall_caps_throttle":{"value":431.27342937720539,"halflife":1.5},"recall_caps_throttle2o":{"value":136.54846055473877,"halflife":0.5},"session_cache_liveness":{"value":1167.2929896301771,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":29,"last_trim_completed_flushes_tid":0,"delegated_inos":[{"start":"0x10000000002","length":500}],"inst":"client.8151 192.168.0.1:0/661998823","completed_requests":[{"tid":29,"created_ino":"0x10000000001"},{"tid":30,"created_ino":"0x100000001f6"},{"tid":31,"created_ino":"0x100000001f7"},{"tid":32,"created_ino":"0x100000001f8"},{"tid":33,"created_ino":"0x100000001f9"},{"tid":34,"created_ino":"0x100000001fa"},{"tid":35,"created_ino":"0x100000001fb"},{"tid":36,"created_ino":"0x100000001fc"},{"tid":37,"created_ino":"0x100000001fd"},{"tid":38,"created_ino":"0x100000001fe"},{"tid":39,"created_ino":"0x100000001ff"},{"tid":40,"created_ino":"0x10000000200"},{"tid":41,"created_ino":"0x10000000201"},{"tid":42,"created_ino":"0x10000000202"},{"tid":43,"created_ino":"0x10000000203"},{"tid":44,"created_ino":"0x10000000204"},{"tid":45,"created_ino":"0x10000000205"},{"tid":46,"created_ino":"0x10000000206"},{"tid":47,"created_ino":"0x10000000207"},{"tid":48,"created_ino":"0x10000000208"},{"tid":49,"created_ino":"0x10000000209"},{"tid":50,"created_ino":"0x1000000020a"},{"tid":51,"created_ino":"0x1000000020b"},{"tid":52,"created_ino":"0x1000000020c"},{"tid":53,"created_ino":"0x1000000020d"},{"tid":54,"created_ino":"0x1000000020e"},{"tid":55,"created_ino":"0x1000000020f"},{"tid":56,"created_ino":"0x10000000210"},{"tid":57,"created_ino":"0x10000000211"},{"tid":58,"created_ino":"0x10000000212"},{"tid":59,"created_ino":"0x10000000213"},{"tid":60,"created_ino":"0x10000000214"},{"tid":61,"created_ino":"0x10000000215"},{"tid":62,"created_ino":"0x10000000216"},{"tid":63,"created_ino":"0x10000000217"},{"tid":64,"created_ino":"0x10000000218"},{"tid":65,"created_ino":"0x10000000219"},{"tid":66,"created_ino":"0x1000000021a"},{"tid":67,"created_ino":"0x1000000021b"},{"tid":68,"created_ino":"0x1000000021c"},{"tid":69,"created_ino":"0x1000000021d"},{"tid":70,"created_ino":"0x1000000021e"},{"tid":71,"created_ino":"0x1000000021f"},{"tid":72,"created_ino":"0x10000000220"},{"tid":73,"created_ino":"0x10000000221"},{"tid":74,"created_ino":"0x10000000222"},{"tid":75,"created_ino":"0x10000000223"},{"tid":76,"created_ino":"0x10000000224"},{"tid":77,"created_ino":"0x10000000225"},{"tid":78,"created_ino":"0x10000000226"},{"tid":79,"created_ino":"0x10000000227"},{"tid":80,"created_ino":"0x10000000228"},{"tid":81,"created_ino":"0x10000000229"},{"tid":82,"created_ino":"0x1000000022a"},{"tid":83,"created_ino":"0x1000000022b"},{"tid":84,"created_ino":"0x1000000022c"},{"tid":85,"created_ino":"0x1000000022d"},{"tid":86,"created_ino":"0x1000000022e"},{"tid":87,"created_ino":"0x1000000022f"},{"tid":88,"created_ino":"0x10000000230"},{"tid":89,"created_ino":"0x10000000231"},{"tid":90,"created_ino":"0x10000000232"},{"tid":91,"created_ino":"0x10000000233"},{"tid":92,"created_ino":"0x10000000234"},{"tid":93,"created_ino":"0x10000000235"},{"tid":94,"created_ino":"0x10000000236"},{"tid":95,"created_ino":"0x10000000237"},{"tid":96,"created_ino":"0x10000000238"},{"tid":97,"created_ino":"0x10000000239"},{"tid":98,"created_ino":"0x1000000023a"},{"tid":99,"created_ino":"0x1000000023b"},{"tid":100,"created_ino":"0x1000000023c"},{"tid":101,"created_ino":"0x1000000023d"},{"tid":102,"created_ino":"0x1000000023e"},{"tid":103,"created_ino":"0x1000000023f"},{"tid":104,"created_ino":"0x10000000240"},{"tid":105,"created_ino":"0x10000000241"},{"tid":106,"created_ino":"0x10000000242"},{"tid":107,"created_ino":"0x10000000243"},{"tid":108,"created_ino":"0x10000000244"},{"tid":109,"created_ino":"0x10000000245"},{"tid":110,"created_ino":"0x10000000246"},{"tid":111,"created_ino":"0x10000000247"},{"tid":112,"created_ino":"0x10000000248"},{"tid":113,"created_ino":"0x10000000249"},{"tid":114,"created_ino":"0x1000000024a"},{"tid":115,"created_ino":"0x1000000024b"},{"tid":116,"created_ino":"0x1000000024c"},{"tid":117,"created_ino":"0x1000000024d"},{"tid":118,"created_ino":"0x1000000024e"},{"tid":119,"created_ino":"0x1000000024f"},{"tid":120,"created_ino":"0x10000000250"},{"tid":121,"created_ino":"0x10000000251"},{"tid":122,"created_ino":"0x10000000252"},{"tid":123,"created_ino":"0x10000000253"},{"tid":124,"created_ino":"0x10000000254"},{"tid":125,"created_ino":"0x10000000255"},{"tid":126,"created_ino":"0x10000000256"},{"tid":127,"created_ino":"0x10000000257"},{"tid":128,"created_ino":"0x10000000258"},{"tid":129,"created_ino":"0x10000000259"},{"tid":130,"created_ino":"0x1000000025a"},{"tid":131,"created_ino":"0x1000000025b"},{"tid":132,"created_ino":"0x1000000025c"},{"tid":133,"created_ino":"0x1000000025d"},{"tid":134,"created_ino":"0x1000000025e"},{"tid":135,"created_ino":"0x1000000025f"},{"tid":136,"created_ino":"0x10000000260"},{"tid":137,"created_ino":"0x10000000261"},{"tid":138,"created_ino":"0x10000000262"},{"tid":139,"created_ino":"0x10000000263"},{"tid":140,"created_ino":"0x10000000264"},{"tid":141,"created_ino":"0x10000000265"},{"tid":142,"created_ino":"0x10000000266"},{"tid":143,"created_ino":"0x10000000267"},{"tid":144,"created_ino":"0x10000000268"},{"tid":145,"created_ino":"0x10000000269"},{"tid":146,"created_ino":"0x1000000026a"},{"tid":147,"created_ino":"0x1000000026b"},{"tid":148,"created_ino":"0x1000000026c"},{"tid":149,"created_ino":"0x1000000026d"},{"tid":150,"created_ino":"0x1000000026e"},{"tid":151,"created_ino":"0x1000000026f"},{"tid":152,"created_ino":"0x10000000270"},{"tid":153,"created_ino":"0x10000000271"},{"tid":154,"created_ino":"0x10000000272"},{"tid":155,"created_ino":"0x10000000273"},{"tid":156,"created_ino":"0x10000000274"},{"tid":157,"created_ino":"0x10000000275"},{"tid":158,"created_ino":"0x10000000276"},{"tid":159,"created_ino":"0x10000000277"},{"tid":160,"created_ino":"0x10000000278"},{"tid":161,"created_ino":"0x10000000279"},{"tid":162,"created_ino":"0x1000000027a"},{"tid":163,"created_ino":"0x1000000027b"},{"tid":164,"created_ino":"0x1000000027c"},{"tid":165,"created_ino":"0x1000000027d"},{"tid":166,"created_ino":"0x1000000027e"},{"tid":167,"created_ino":"0x1000000027f"},{"tid":168,"created_ino":"0x10000000280"},{"tid":169,"created_ino":"0x10000000281"},{"tid":170,"created_ino":"0x10000000282"},{"tid":171,"created_ino":"0x10000000283"},{"tid":172,"created_ino":"0x10000000284"},{"tid":173,"created_ino":"0x10000000285"},{"tid":174,"created_ino":"0x10000000286"},{"tid":175,"created_ino":"0x10000000287"},{"tid":176,"created_ino":"0x10000000288"},{"tid":177,"created_ino":"0x10000000289"},{"tid":178,"created_ino":"0x1000000028a"},{"tid":179,"created_ino":"0x1000000028b"},{"tid":180,"created_ino":"0x1000000028c"},{"tid":181,"created_ino":"0x1000000028d"},{"tid":182,"created_ino":"0x1000000028e"},{"tid":183,"created_ino":"0x1000000028f"},{"tid":184,"created_ino":"0x10000000290"},{"tid":185,"created_ino":"0x10000000291"},{"tid":186,"created_ino":"0x10000000292"},{"tid":187,"created_ino":"0x10000000293"},{"tid":188,"created_ino":"0x10000000294"},{"tid":189,"created_ino":"0x10000000295"},{"tid":190,"created_ino":"0x10000000296"},{"tid":191,"created_ino":"0x10000000297"},{"tid":192,"created_ino":"0x10000000298"},{"tid":193,"created_ino":"0x10000000299"},{"tid":194,"created_ino":"0x1000000029a"},{"tid":195,"created_ino":"0x1000000029b"},{"tid":196,"created_ino":"0x1000000029c"},{"tid":197,"created_ino":"0x1000000029d"},{"tid":198,"created_ino":"0x1000000029e"},{"tid":199,"created_ino":"0x1000000029f"},{"tid":200,"created_ino":"0x100000002a0"},{"tid":201,"created_ino":"0x100000002a1"},{"tid":202,"created_ino":"0x100000002a2"},{"tid":203,"created_ino":"0x100000002a3"},{"tid":204,"created_ino":"0x100000002a4"},{"tid":205,"created_ino":"0x100000002a5"},{"tid":206,"created_ino":"0x100000002a6"},{"tid":207,"created_ino":"0x100000002a7"},{"tid":208,"created_ino":"0x100000002a8"},{"tid":209,"created_ino":"0x100000002a9"},{"tid":210,"created_ino":"0x100000002aa"},{"tid":211,"created_ino":"0x100000002ab"},{"tid":212,"created_ino":"0x100000002ac"},{"tid":213,"created_ino":"0x100000002ad"},{"tid":214,"created_ino":"0x100000002ae"},{"tid":215,"created_ino":"0x100000002af"},{"tid":216,"created_ino":"0x100000002b0"},{"tid":217,"created_ino":"0x100000002b1"},{"tid":218,"created_ino":"0x100000002b2"},{"tid":219,"created_ino":"0x100000002b3"},{"tid":220,"created_ino":"0x100000002b4"},{"tid":221,"created_ino":"0x100000002b5"},{"tid":222,"created_ino":"0x100000002b6"},{"tid":223,"created_ino":"0x100000002b7"},{"tid":224,"created_ino":"0x100000002b8"},{"tid":225,"created_ino":"0x100000002b9"},{"tid":226,"created_ino":"0x100000002ba"},{"tid":227,"created_ino":"0x100000002bb"},{"tid":228,"created_ino":"0x100000002bc"},{"tid":229,"created_ino":"0x100000002bd"},{"tid":230,"created_ino":"0x100000002be"},{"tid":231,"created_ino":"0x100000002bf"},{"tid":232,"created_ino":"0x100000002c0"},{"tid":233,"created_ino":"0x100000002c1"},{"tid":234,"created_ino":"0x100000002c2"},{"tid":235,"created_ino":"0x100000002c3"},{"tid":236,"created_ino":"0x100000002c4"},{"tid":237,"created_ino":"0x100000002c5"},{"tid":238,"created_ino":"0x100000002c6"},{"tid":239,"created_ino":"0x100000002c7"},{"tid":240,"created_ino":"0x100000002c8"},{"tid":241,"created_ino":"0x100000002c9"},{"tid":242,"created_ino":"0x100000002ca"},{"tid":243,"created_ino":"0x100000002cb"},{"tid":244,"created_ino":"0x100000002cc"},{"tid":245,"created_ino":"0x100000002cd"},{"tid":246,"created_ino":"0x100000002ce"},{"tid":247,"created_ino":"0x100000002cf"},{"tid":248,"created_ino":"0x100000002d0"},{"tid":249,"created_ino":"0x100000002d1"},{"tid":250,"created_ino":"0x100000002d2"},{"tid":251,"created_ino":"0x100000002d3"},{"tid":252,"created_ino":"0x100000002d4"},{"tid":253,"created_ino":"0x100000002d5"},{"tid":254,"created_ino":"0x100000002d6"},{"tid":255,"created_ino":"0x100000002d7"},{"tid":256,"created_ino":"0x100000002d8"},{"tid":257,"created_ino":"0x100000002d9"},{"tid":258,"created_ino":"0x100000002da"},{"tid":259,"created_ino":"0x100000002db"},{"tid":260,"created_ino":"0x100000002dc"},{"tid":261,"created_ino":"0x100000002dd"},{"tid":262,"created_ino":"0x100000002de"},{"tid":263,"created_ino":"0x100000002df"},{"tid":264,"created_ino":"0x100000002e0"},{"tid":265,"created_ino":"0x100000002e1"},{"tid":266,"created_ino":"0x100000002e2"},{"tid":267,"created_ino":"0x100000002e3"},{"tid":268,"created_ino":"0x100000002e4"},{"tid":269,"created_ino":"0x100000002e5"},{"tid":270,"created_ino":"0x100000002e6"},{"tid":271,"created_ino":"0x100000002e7"},{"tid":272,"created_ino":"0x100000002e8"},{"tid":273,"created_ino":"0x100000002e9"},{"tid":274,"created_ino":"0x100000002ea"},{"tid":275,"created_ino":"0x100000002eb"},{"tid":276,"created_ino":"0x100000002ec"},{"tid":277,"created_ino":"0x100000002ed"},{"tid":278,"created_ino":"0x100000002ee"},{"tid":279,"created_ino":"0x100000002ef"},{"tid":280,"created_ino":"0x100000002f0"},{"tid":281,"created_ino":"0x100000002f1"},{"tid":282,"created_ino":"0x100000002f2"},{"tid":283,"created_ino":"0x100000002f3"},{"tid":284,"created_ino":"0x100000002f4"},{"tid":285,"created_ino":"0x100000002f5"},{"tid":286,"created_ino":"0x100000002f6"},{"tid":287,"created_ino":"0x100000002f7"},{"tid":288,"created_ino":"0x100000002f8"},{"tid":289,"created_ino":"0x100000002f9"},{"tid":290,"created_ino":"0x100000002fa"},{"tid":291,"created_ino":"0x100000002fb"},{"tid":292,"created_ino":"0x100000002fc"},{"tid":293,"created_ino":"0x100000002fd"},{"tid":294,"created_ino":"0x100000002fe"},{"tid":295,"created_ino":"0x100000002ff"},{"tid":296,"created_ino":"0x10000000300"},{"tid":297,"created_ino":"0x10000000301"},{"tid":298,"created_ino":"0x10000000302"},{"tid":299,"created_ino":"0x10000000303"},{"tid":300,"created_ino":"0x10000000304"},{"tid":301,"created_ino":"0x10000000305"},{"tid":302,"created_ino":"0x10000000306"},{"tid":303,"created_ino":"0x10000000307"},{"tid":304,"created_ino":"0x10000000308"},{"tid":305,"created_ino":"0x10000000309"},{"tid":306,"created_ino":"0x1000000030a"},{"tid":307,"created_ino":"0x1000000030b"},{"tid":308,"created_ino":"0x1000000030c"},{"tid":309,"created_ino":"0x1000000030d"},{"tid":310,"created_ino":"0x1000000030e"},{"tid":311,"created_ino":"0x1000000030f"},{"tid":312,"created_ino":"0x10000000310"},{"tid":313,"created_ino":"0x10000000311"},{"tid":314,"created_ino":"0x10000000312"},{"tid":315,"created_ino":"0x10000000313"},{"tid":316,"created_ino":"0x10000000314"},{"tid":317,"created_ino":"0x10000000315"},{"tid":318,"created_ino":"0x10000000316"},{"tid":319,"created_ino":"0x10000000317"},{"tid":320,"created_ino":"0x10000000318"},{"tid":321,"created_ino":"0x10000000319"},{"tid":322,"created_ino":"0x1000000031a"},{"tid":323,"created_ino":"0x1000000031b"},{"tid":324,"created_ino":"0x1000000031c"},{"tid":325,"created_ino":"0x1000000031d"},{"tid":326,"created_ino":"0x1000000031e"},{"tid":327,"created_ino":"0x1000000031f"},{"tid":328,"created_ino":"0x10000000320"},{"tid":329,"created_ino":"0x10000000321"},{"tid":330,"created_ino":"0x10000000322"},{"tid":331,"created_ino":"0x10000000323"},{"tid":332,"created_ino":"0x10000000324"},{"tid":333,"created_ino":"0x10000000325"},{"tid":334,"created_ino":"0x10000000326"},{"tid":335,"created_ino":"0x10000000327"},{"tid":336,"created_ino":"0x10000000328"},{"tid":337,"created_ino":"0x10000000329"},{"tid":338,"created_ino":"0x1000000032a"},{"tid":339,"created_ino":"0x1000000032b"},{"tid":340,"created_ino":"0x1000000032c"},{"tid":341,"created_ino":"0x1000000032d"},{"tid":342,"created_ino":"0x1000000032e"},{"tid":343,"created_ino":"0x1000000032f"},{"tid":344,"created_ino":"0x10000000330"},{"tid":345,"created_ino":"0x10000000331"},{"tid":346,"created_ino":"0x10000000332"},{"tid":347,"created_ino":"0x10000000333"},{"tid":348,"created_ino":"0x10000000334"},{"tid":349,"created_ino":"0x10000000335"},{"tid":350,"created_ino":"0x10000000336"},{"tid":351,"created_ino":"0x10000000337"},{"tid":352,"created_ino":"0x10000000338"},{"tid":353,"created_ino":"0x10000000339"},{"tid":354,"created_ino":"0x1000000033a"},{"tid":355,"created_ino":"0x1000000033b"},{"tid":356,"created_ino":"0x1000000033c"},{"tid":357,"created_ino":"0x1000000033d"},{"tid":358,"created_ino":"0x1000000033e"},{"tid":359,"created_ino":"0x1000000033f"},{"tid":360,"created_ino":"0x10000000340"},{"tid":361,"created_ino":"0x10000000341"},{"tid":362,"created_ino":"0x10000000342"},{"tid":363,"created_ino":"0x10000000343"},{"tid":364,"created_ino":"0x10000000344"},{"tid":365,"created_ino":"0x10000000345"},{"tid":366,"created_ino":"0x10000000346"},{"tid":367,"created_ino":"0x10000000347"},{"tid":368,"created_ino":"0x10000000348"},{"tid":369,"created_ino":"0x10000000349"},{"tid":370,"created_ino":"0x1000000034a"},{"tid":371,"created_ino":"0x1000000034b"},{"tid":372,"created_ino":"0x1000000034c"},{"tid":373,"created_ino":"0x1000000034d"},{"tid":374,"created_ino":"0x1000000034e"},{"tid":375,"created_ino":"0x1000000034f"},{"tid":376,"created_ino":"0x10000000350"},{"tid":377,"created_ino":"0x10000000351"},{"tid":378,"created_ino":"0x10000000352"},{"tid":379,"created_ino":"0x10000000353"},{"tid":380,"created_ino":"0x10000000354"},{"tid":381,"created_ino":"0x10000000355"},{"tid":382,"created_ino":"0x10000000356"},{"tid":383,"created_ino":"0x10000000357"},{"tid":384,"created_ino":"0x10000000358"},{"tid":385,"created_ino":"0x10000000359"},{"tid":386,"created_ino":"0x1000000035a"},{"tid":387,"created_ino":"0x1000000035b"},{"tid":388,"created_ino":"0x1000000035c"},{"tid":389,"created_ino":"0x1000000035d"},{"tid":390,"created_ino":"0x1000000035e"},{"tid":391,"created_ino":"0x1000000035f"},{"tid":392,"created_ino":"0x10000000360"},{"tid":393,"created_ino":"0x10000000361"},{"tid":394,"created_ino":"0x10000000362"},{"tid":395,"created_ino":"0x10000000363"},{"tid":396,"created_ino":"0x10000000364"},{"tid":397,"created_ino":"0x10000000365"},{"tid":398,"created_ino":"0x10000000366"},{"tid":399,"created_ino":"0x10000000367"},{"tid":400,"created_ino":"0x10000000368"},{"tid":401,"created_ino":"0x10000000369"},{"tid":402,"created_ino":"0x1000000036a"},{"tid":403,"created_ino":"0x1000000036b"},{"tid":404,"created_ino":"0x1000000036c"},{"tid":405,"created_ino":"0x1000000036d"},{"tid":406,"created_ino":"0x1000000036e"},{"tid":407,"created_ino":"0x1000000036f"},{"tid":408,"created_ino":"0x10000000370"},{"tid":409,"created_ino":"0x10000000371"},{"tid":410,"created_ino":"0x10000000372"},{"tid":411,"created_ino":"0x10000000373"},{"tid":412,"created_ino":"0x10000000374"},{"tid":413,"created_ino":"0x10000000375"},{"tid":414,"created_ino":"0x10000000376"},{"tid":415,"created_ino":"0x10000000377"},{"tid":416,"created_ino":"0x10000000378"},{"tid":417,"created_ino":"0x10000000379"},{"tid":418,"created_ino":"0x1000000037a"},{"tid":419,"created_ino":"0x1000000037b"},{"tid":420,"created_ino":"0x1000000037c"},{"tid":421,"created_ino":"0x1000000037d"},{"tid":422,"created_ino":"0x1000000037e"},{"tid":423,"created_ino":"0x1000000037f"},{"tid":424,"created_ino":"0x10000000380"},{"tid":425,"created_ino":"0x10000000381"},{"tid":426,"created_ino":"0x10000000382"},{"tid":427,"created_ino":"0x10000000383"}],"prealloc_inos":[{"start":"0x10000000002","length":500},{"start":"0x10000000384","length":603}],"client_metadata":{"client_features":{"feature_bits":"0x000000000003fbff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000080ffff"}},"entity_id":"0","hostname":"smithi060","kernel_version":"5.14.0-505.el9.x86_64","root":"/"}}] 2024-09-12T01:44:18.687 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "1", "hostname": "smithi105", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.105:0", "nonce": 3010876499, "type": "any" }, "name": { "num": 8163, "type": "client" } }, "id": 8163, "inst": "client.8163 172.21.15.105:0/3010876499", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 4, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 3, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 2.9065552807611392 }, "state": "open", "uptime": 15.434681528 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "client_features": { "feature_bits": "0x000000000003fbff" }, "entity_id": "0", "hostname": "smithi060", "kernel_version": "5.14.0-505.el9.x86_64", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000080ffff" } }, "root": "/" }, "completed_requests": [ { "created_ino": "0x10000000001", "tid": 29 }, { "created_ino": "0x100000001f6", "tid": 30 }, { "created_ino": "0x100000001f7", "tid": 31 }, { "created_ino": "0x100000001f8", "tid": 32 }, { "created_ino": "0x100000001f9", "tid": 33 }, { "created_ino": "0x100000001fa", "tid": 34 }, { "created_ino": "0x100000001fb", "tid": 35 }, { "created_ino": "0x100000001fc", "tid": 36 }, { "created_ino": "0x100000001fd", "tid": 37 }, { "created_ino": "0x100000001fe", "tid": 38 }, { "created_ino": "0x100000001ff", "tid": 39 }, { "created_ino": "0x10000000200", "tid": 40 }, { "created_ino": "0x10000000201", "tid": 41 }, { "created_ino": "0x10000000202", "tid": 42 }, { "created_ino": "0x10000000203", "tid": 43 }, { "created_ino": "0x10000000204", "tid": 44 }, { "created_ino": "0x10000000205", "tid": 45 }, { "created_ino": "0x10000000206", "tid": 46 }, { "created_ino": "0x10000000207", "tid": 47 }, { "created_ino": "0x10000000208", "tid": 48 }, { "created_ino": "0x10000000209", "tid": 49 }, { "created_ino": "0x1000000020a", "tid": 50 }, { "created_ino": "0x1000000020b", "tid": 51 }, { "created_ino": "0x1000000020c", "tid": 52 }, { "created_ino": "0x1000000020d", "tid": 53 }, { "created_ino": "0x1000000020e", "tid": 54 }, { "created_ino": "0x1000000020f", "tid": 55 }, { "created_ino": "0x10000000210", "tid": 56 }, { "created_ino": "0x10000000211", "tid": 57 }, { "created_ino": "0x10000000212", "tid": 58 }, { "created_ino": "0x10000000213", "tid": 59 }, { "created_ino": "0x10000000214", "tid": 60 }, { "created_ino": "0x10000000215", "tid": 61 }, { "created_ino": "0x10000000216", "tid": 62 }, { "created_ino": "0x10000000217", "tid": 63 }, { "created_ino": "0x10000000218", "tid": 64 }, { "created_ino": "0x10000000219", "tid": 65 }, { "created_ino": "0x1000000021a", "tid": 66 }, { "created_ino": "0x1000000021b", "tid": 67 }, { "created_ino": "0x1000000021c", "tid": 68 }, { "created_ino": "0x1000000021d", "tid": 69 }, { "created_ino": "0x1000000021e", "tid": 70 }, { "created_ino": "0x1000000021f", "tid": 71 }, { "created_ino": "0x10000000220", "tid": 72 }, { "created_ino": "0x10000000221", "tid": 73 }, { "created_ino": "0x10000000222", "tid": 74 }, { "created_ino": "0x10000000223", "tid": 75 }, { "created_ino": "0x10000000224", "tid": 76 }, { "created_ino": "0x10000000225", "tid": 77 }, { "created_ino": "0x10000000226", "tid": 78 }, { "created_ino": "0x10000000227", "tid": 79 }, { "created_ino": "0x10000000228", "tid": 80 }, { "created_ino": "0x10000000229", "tid": 81 }, { "created_ino": "0x1000000022a", "tid": 82 }, { "created_ino": "0x1000000022b", "tid": 83 }, { "created_ino": "0x1000000022c", "tid": 84 }, { "created_ino": "0x1000000022d", "tid": 85 }, { "created_ino": "0x1000000022e", "tid": 86 }, { "created_ino": "0x1000000022f", "tid": 87 }, { "created_ino": "0x10000000230", "tid": 88 }, { "created_ino": "0x10000000231", "tid": 89 }, { "created_ino": "0x10000000232", "tid": 90 }, { "created_ino": "0x10000000233", "tid": 91 }, { "created_ino": "0x10000000234", "tid": 92 }, { "created_ino": "0x10000000235", "tid": 93 }, { "created_ino": "0x10000000236", "tid": 94 }, { "created_ino": "0x10000000237", "tid": 95 }, { "created_ino": "0x10000000238", "tid": 96 }, { "created_ino": "0x10000000239", "tid": 97 }, { "created_ino": "0x1000000023a", "tid": 98 }, { "created_ino": "0x1000000023b", "tid": 99 }, { "created_ino": "0x1000000023c", "tid": 100 }, { "created_ino": "0x1000000023d", "tid": 101 }, { "created_ino": "0x1000000023e", "tid": 102 }, { "created_ino": "0x1000000023f", "tid": 103 }, { "created_ino": "0x10000000240", "tid": 104 }, { "created_ino": "0x10000000241", "tid": 105 }, { "created_ino": "0x10000000242", "tid": 106 }, { "created_ino": "0x10000000243", "tid": 107 }, { "created_ino": "0x10000000244", "tid": 108 }, { "created_ino": "0x10000000245", "tid": 109 }, { "created_ino": "0x10000000246", "tid": 110 }, { "created_ino": "0x10000000247", "tid": 111 }, { "created_ino": "0x10000000248", "tid": 112 }, { "created_ino": "0x10000000249", "tid": 113 }, { "created_ino": "0x1000000024a", "tid": 114 }, { "created_ino": "0x1000000024b", "tid": 115 }, { "created_ino": "0x1000000024c", "tid": 116 }, { "created_ino": "0x1000000024d", "tid": 117 }, { "created_ino": "0x1000000024e", "tid": 118 }, { "created_ino": "0x1000000024f", "tid": 119 }, { "created_ino": "0x10000000250", "tid": 120 }, { "created_ino": "0x10000000251", "tid": 121 }, { "created_ino": "0x10000000252", "tid": 122 }, { "created_ino": "0x10000000253", "tid": 123 }, { "created_ino": "0x10000000254", "tid": 124 }, { "created_ino": "0x10000000255", "tid": 125 }, { "created_ino": "0x10000000256", "tid": 126 }, { "created_ino": "0x10000000257", "tid": 127 }, { "created_ino": "0x10000000258", "tid": 128 }, { "created_ino": "0x10000000259", "tid": 129 }, { "created_ino": "0x1000000025a", "tid": 130 }, { "created_ino": "0x1000000025b", "tid": 131 }, { "created_ino": "0x1000000025c", "tid": 132 }, { "created_ino": "0x1000000025d", "tid": 133 }, { "created_ino": "0x1000000025e", "tid": 134 }, { "created_ino": "0x1000000025f", "tid": 135 }, { "created_ino": "0x10000000260", "tid": 136 }, { "created_ino": "0x10000000261", "tid": 137 }, { "created_ino": "0x10000000262", "tid": 138 }, { "created_ino": "0x10000000263", "tid": 139 }, { "created_ino": "0x10000000264", "tid": 140 }, { "created_ino": "0x10000000265", "tid": 141 }, { "created_ino": "0x10000000266", "tid": 142 }, { "created_ino": "0x10000000267", "tid": 143 }, { "created_ino": "0x10000000268", "tid": 144 }, { "created_ino": "0x10000000269", "tid": 145 }, { "created_ino": "0x1000000026a", "tid": 146 }, { "created_ino": "0x1000000026b", "tid": 147 }, { "created_ino": "0x1000000026c", "tid": 148 }, { "created_ino": "0x1000000026d", "tid": 149 }, { "created_ino": "0x1000000026e", "tid": 150 }, { "created_ino": "0x1000000026f", "tid": 151 }, { "created_ino": "0x10000000270", "tid": 152 }, { "created_ino": "0x10000000271", "tid": 153 }, { "created_ino": "0x10000000272", "tid": 154 }, { "created_ino": "0x10000000273", "tid": 155 }, { "created_ino": "0x10000000274", "tid": 156 }, { "created_ino": "0x10000000275", "tid": 157 }, { "created_ino": "0x10000000276", "tid": 158 }, { "created_ino": "0x10000000277", "tid": 159 }, { "created_ino": "0x10000000278", "tid": 160 }, { "created_ino": "0x10000000279", "tid": 161 }, { "created_ino": "0x1000000027a", "tid": 162 }, { "created_ino": "0x1000000027b", "tid": 163 }, { "created_ino": "0x1000000027c", "tid": 164 }, { "created_ino": "0x1000000027d", "tid": 165 }, { "created_ino": "0x1000000027e", "tid": 166 }, { "created_ino": "0x1000000027f", "tid": 167 }, { "created_ino": "0x10000000280", "tid": 168 }, { "created_ino": "0x10000000281", "tid": 169 }, { "created_ino": "0x10000000282", "tid": 170 }, { "created_ino": "0x10000000283", "tid": 171 }, { "created_ino": "0x10000000284", "tid": 172 }, { "created_ino": "0x10000000285", "tid": 173 }, { "created_ino": "0x10000000286", "tid": 174 }, { "created_ino": "0x10000000287", "tid": 175 }, { "created_ino": "0x10000000288", "tid": 176 }, { "created_ino": "0x10000000289", "tid": 177 }, { "created_ino": "0x1000000028a", "tid": 178 }, { "created_ino": "0x1000000028b", "tid": 179 }, { "created_ino": "0x1000000028c", "tid": 180 }, { "created_ino": "0x1000000028d", "tid": 181 }, { "created_ino": "0x1000000028e", "tid": 182 }, { "created_ino": "0x1000000028f", "tid": 183 }, { "created_ino": "0x10000000290", "tid": 184 }, { "created_ino": "0x10000000291", "tid": 185 }, { "created_ino": "0x10000000292", "tid": 186 }, { "created_ino": "0x10000000293", "tid": 187 }, { "created_ino": "0x10000000294", "tid": 188 }, { "created_ino": "0x10000000295", "tid": 189 }, { "created_ino": "0x10000000296", "tid": 190 }, { "created_ino": "0x10000000297", "tid": 191 }, { "created_ino": "0x10000000298", "tid": 192 }, { "created_ino": "0x10000000299", "tid": 193 }, { "created_ino": "0x1000000029a", "tid": 194 }, { "created_ino": "0x1000000029b", "tid": 195 }, { "created_ino": "0x1000000029c", "tid": 196 }, { "created_ino": "0x1000000029d", "tid": 197 }, { "created_ino": "0x1000000029e", "tid": 198 }, { "created_ino": "0x1000000029f", "tid": 199 }, { "created_ino": "0x100000002a0", "tid": 200 }, { "created_ino": "0x100000002a1", "tid": 201 }, { "created_ino": "0x100000002a2", "tid": 202 }, { "created_ino": "0x100000002a3", "tid": 203 }, { "created_ino": "0x100000002a4", "tid": 204 }, { "created_ino": "0x100000002a5", "tid": 205 }, { "created_ino": "0x100000002a6", "tid": 206 }, { "created_ino": "0x100000002a7", "tid": 207 }, { "created_ino": "0x100000002a8", "tid": 208 }, { "created_ino": "0x100000002a9", "tid": 209 }, { "created_ino": "0x100000002aa", "tid": 210 }, { "created_ino": "0x100000002ab", "tid": 211 }, { "created_ino": "0x100000002ac", "tid": 212 }, { "created_ino": "0x100000002ad", "tid": 213 }, { "created_ino": "0x100000002ae", "tid": 214 }, { "created_ino": "0x100000002af", "tid": 215 }, { "created_ino": "0x100000002b0", "tid": 216 }, { "created_ino": "0x100000002b1", "tid": 217 }, { "created_ino": "0x100000002b2", "tid": 218 }, { "created_ino": "0x100000002b3", "tid": 219 }, { "created_ino": "0x100000002b4", "tid": 220 }, { "created_ino": "0x100000002b5", "tid": 221 }, { "created_ino": "0x100000002b6", "tid": 222 }, { "created_ino": "0x100000002b7", "tid": 223 }, { "created_ino": "0x100000002b8", "tid": 224 }, { "created_ino": "0x100000002b9", "tid": 225 }, { "created_ino": "0x100000002ba", "tid": 226 }, { "created_ino": "0x100000002bb", "tid": 227 }, { "created_ino": "0x100000002bc", "tid": 228 }, { "created_ino": "0x100000002bd", "tid": 229 }, { "created_ino": "0x100000002be", "tid": 230 }, { "created_ino": "0x100000002bf", "tid": 231 }, { "created_ino": "0x100000002c0", "tid": 232 }, { "created_ino": "0x100000002c1", "tid": 233 }, { "created_ino": "0x100000002c2", "tid": 234 }, { "created_ino": "0x100000002c3", "tid": 235 }, { "created_ino": "0x100000002c4", "tid": 236 }, { "created_ino": "0x100000002c5", "tid": 237 }, { "created_ino": "0x100000002c6", "tid": 238 }, { "created_ino": "0x100000002c7", "tid": 239 }, { "created_ino": "0x100000002c8", "tid": 240 }, { "created_ino": "0x100000002c9", "tid": 241 }, { "created_ino": "0x100000002ca", "tid": 242 }, { "created_ino": "0x100000002cb", "tid": 243 }, { "created_ino": "0x100000002cc", "tid": 244 }, { "created_ino": "0x100000002cd", "tid": 245 }, { "created_ino": "0x100000002ce", "tid": 246 }, { "created_ino": "0x100000002cf", "tid": 247 }, { "created_ino": "0x100000002d0", "tid": 248 }, { "created_ino": "0x100000002d1", "tid": 249 }, { "created_ino": "0x100000002d2", "tid": 250 }, { "created_ino": "0x100000002d3", "tid": 251 }, { "created_ino": "0x100000002d4", "tid": 252 }, { "created_ino": "0x100000002d5", "tid": 253 }, { "created_ino": "0x100000002d6", "tid": 254 }, { "created_ino": "0x100000002d7", "tid": 255 }, { "created_ino": "0x100000002d8", "tid": 256 }, { "created_ino": "0x100000002d9", "tid": 257 }, { "created_ino": "0x100000002da", "tid": 258 }, { "created_ino": "0x100000002db", "tid": 259 }, { "created_ino": "0x100000002dc", "tid": 260 }, { "created_ino": "0x100000002dd", "tid": 261 }, { "created_ino": "0x100000002de", "tid": 262 }, { "created_ino": "0x100000002df", "tid": 263 }, { "created_ino": "0x100000002e0", "tid": 264 }, { "created_ino": "0x100000002e1", "tid": 265 }, { "created_ino": "0x100000002e2", "tid": 266 }, { "created_ino": "0x100000002e3", "tid": 267 }, { "created_ino": "0x100000002e4", "tid": 268 }, { "created_ino": "0x100000002e5", "tid": 269 }, { "created_ino": "0x100000002e6", "tid": 270 }, { "created_ino": "0x100000002e7", "tid": 271 }, { "created_ino": "0x100000002e8", "tid": 272 }, { "created_ino": "0x100000002e9", "tid": 273 }, { "created_ino": "0x100000002ea", "tid": 274 }, { "created_ino": "0x100000002eb", "tid": 275 }, { "created_ino": "0x100000002ec", "tid": 276 }, { "created_ino": "0x100000002ed", "tid": 277 }, { "created_ino": "0x100000002ee", "tid": 278 }, { "created_ino": "0x100000002ef", "tid": 279 }, { "created_ino": "0x100000002f0", "tid": 280 }, { "created_ino": "0x100000002f1", "tid": 281 }, { "created_ino": "0x100000002f2", "tid": 282 }, { "created_ino": "0x100000002f3", "tid": 283 }, { "created_ino": "0x100000002f4", "tid": 284 }, { "created_ino": "0x100000002f5", "tid": 285 }, { "created_ino": "0x100000002f6", "tid": 286 }, { "created_ino": "0x100000002f7", "tid": 287 }, { "created_ino": "0x100000002f8", "tid": 288 }, { "created_ino": "0x100000002f9", "tid": 289 }, { "created_ino": "0x100000002fa", "tid": 290 }, { "created_ino": "0x100000002fb", "tid": 291 }, { "created_ino": "0x100000002fc", "tid": 292 }, { "created_ino": "0x100000002fd", "tid": 293 }, { "created_ino": "0x100000002fe", "tid": 294 }, { "created_ino": "0x100000002ff", "tid": 295 }, { "created_ino": "0x10000000300", "tid": 296 }, { "created_ino": "0x10000000301", "tid": 297 }, { "created_ino": "0x10000000302", "tid": 298 }, { "created_ino": "0x10000000303", "tid": 299 }, { "created_ino": "0x10000000304", "tid": 300 }, { "created_ino": "0x10000000305", "tid": 301 }, { "created_ino": "0x10000000306", "tid": 302 }, { "created_ino": "0x10000000307", "tid": 303 }, { "created_ino": "0x10000000308", "tid": 304 }, { "created_ino": "0x10000000309", "tid": 305 }, { "created_ino": "0x1000000030a", "tid": 306 }, { "created_ino": "0x1000000030b", "tid": 307 }, { "created_ino": "0x1000000030c", "tid": 308 }, { "created_ino": "0x1000000030d", "tid": 309 }, { "created_ino": "0x1000000030e", "tid": 310 }, { "created_ino": "0x1000000030f", "tid": 311 }, { "created_ino": "0x10000000310", "tid": 312 }, { "created_ino": "0x10000000311", "tid": 313 }, { "created_ino": "0x10000000312", "tid": 314 }, { "created_ino": "0x10000000313", "tid": 315 }, { "created_ino": "0x10000000314", "tid": 316 }, { "created_ino": "0x10000000315", "tid": 317 }, { "created_ino": "0x10000000316", "tid": 318 }, { "created_ino": "0x10000000317", "tid": 319 }, { "created_ino": "0x10000000318", "tid": 320 }, { "created_ino": "0x10000000319", "tid": 321 }, { "created_ino": "0x1000000031a", "tid": 322 }, { "created_ino": "0x1000000031b", "tid": 323 }, { "created_ino": "0x1000000031c", "tid": 324 }, { "created_ino": "0x1000000031d", "tid": 325 }, { "created_ino": "0x1000000031e", "tid": 326 }, { "created_ino": "0x1000000031f", "tid": 327 }, { "created_ino": "0x10000000320", "tid": 328 }, { "created_ino": "0x10000000321", "tid": 329 }, { "created_ino": "0x10000000322", "tid": 330 }, { "created_ino": "0x10000000323", "tid": 331 }, { "created_ino": "0x10000000324", "tid": 332 }, { "created_ino": "0x10000000325", "tid": 333 }, { "created_ino": "0x10000000326", "tid": 334 }, { "created_ino": "0x10000000327", "tid": 335 }, { "created_ino": "0x10000000328", "tid": 336 }, { "created_ino": "0x10000000329", "tid": 337 }, { "created_ino": "0x1000000032a", "tid": 338 }, { "created_ino": "0x1000000032b", "tid": 339 }, { "created_ino": "0x1000000032c", "tid": 340 }, { "created_ino": "0x1000000032d", "tid": 341 }, { "created_ino": "0x1000000032e", "tid": 342 }, { "created_ino": "0x1000000032f", "tid": 343 }, { "created_ino": "0x10000000330", "tid": 344 }, { "created_ino": "0x10000000331", "tid": 345 }, { "created_ino": "0x10000000332", "tid": 346 }, { "created_ino": "0x10000000333", "tid": 347 }, { "created_ino": "0x10000000334", "tid": 348 }, { "created_ino": "0x10000000335", "tid": 349 }, { "created_ino": "0x10000000336", "tid": 350 }, { "created_ino": "0x10000000337", "tid": 351 }, { "created_ino": "0x10000000338", "tid": 352 }, { "created_ino": "0x10000000339", "tid": 353 }, { "created_ino": "0x1000000033a", "tid": 354 }, { "created_ino": "0x1000000033b", "tid": 355 }, { "created_ino": "0x1000000033c", "tid": 356 }, { "created_ino": "0x1000000033d", "tid": 357 }, { "created_ino": "0x1000000033e", "tid": 358 }, { "created_ino": "0x1000000033f", "tid": 359 }, { "created_ino": "0x10000000340", "tid": 360 }, { "created_ino": "0x10000000341", "tid": 361 }, { "created_ino": "0x10000000342", "tid": 362 }, { "created_ino": "0x10000000343", "tid": 363 }, { "created_ino": "0x10000000344", "tid": 364 }, { "created_ino": "0x10000000345", "tid": 365 }, { "created_ino": "0x10000000346", "tid": 366 }, { "created_ino": "0x10000000347", "tid": 367 }, { "created_ino": "0x10000000348", "tid": 368 }, { "created_ino": "0x10000000349", "tid": 369 }, { "created_ino": "0x1000000034a", "tid": 370 }, { "created_ino": "0x1000000034b", "tid": 371 }, { "created_ino": "0x1000000034c", "tid": 372 }, { "created_ino": "0x1000000034d", "tid": 373 }, { "created_ino": "0x1000000034e", "tid": 374 }, { "created_ino": "0x1000000034f", "tid": 375 }, { "created_ino": "0x10000000350", "tid": 376 }, { "created_ino": "0x10000000351", "tid": 377 }, { "created_ino": "0x10000000352", "tid": 378 }, { "created_ino": "0x10000000353", "tid": 379 }, { "created_ino": "0x10000000354", "tid": 380 }, { "created_ino": "0x10000000355", "tid": 381 }, { "created_ino": "0x10000000356", "tid": 382 }, { "created_ino": "0x10000000357", "tid": 383 }, { "created_ino": "0x10000000358", "tid": 384 }, { "created_ino": "0x10000000359", "tid": 385 }, { "created_ino": "0x1000000035a", "tid": 386 }, { "created_ino": "0x1000000035b", "tid": 387 }, { "created_ino": "0x1000000035c", "tid": 388 }, { "created_ino": "0x1000000035d", "tid": 389 }, { "created_ino": "0x1000000035e", "tid": 390 }, { "created_ino": "0x1000000035f", "tid": 391 }, { "created_ino": "0x10000000360", "tid": 392 }, { "created_ino": "0x10000000361", "tid": 393 }, { "created_ino": "0x10000000362", "tid": 394 }, { "created_ino": "0x10000000363", "tid": 395 }, { "created_ino": "0x10000000364", "tid": 396 }, { "created_ino": "0x10000000365", "tid": 397 }, { "created_ino": "0x10000000366", "tid": 398 }, { "created_ino": "0x10000000367", "tid": 399 }, { "created_ino": "0x10000000368", "tid": 400 }, { "created_ino": "0x10000000369", "tid": 401 }, { "created_ino": "0x1000000036a", "tid": 402 }, { "created_ino": "0x1000000036b", "tid": 403 }, { "created_ino": "0x1000000036c", "tid": 404 }, { "created_ino": "0x1000000036d", "tid": 405 }, { "created_ino": "0x1000000036e", "tid": 406 }, { "created_ino": "0x1000000036f", "tid": 407 }, { "created_ino": "0x10000000370", "tid": 408 }, { "created_ino": "0x10000000371", "tid": 409 }, { "created_ino": "0x10000000372", "tid": 410 }, { "created_ino": "0x10000000373", "tid": 411 }, { "created_ino": "0x10000000374", "tid": 412 }, { "created_ino": "0x10000000375", "tid": 413 }, { "created_ino": "0x10000000376", "tid": 414 }, { "created_ino": "0x10000000377", "tid": 415 }, { "created_ino": "0x10000000378", "tid": 416 }, { "created_ino": "0x10000000379", "tid": 417 }, { "created_ino": "0x1000000037a", "tid": 418 }, { "created_ino": "0x1000000037b", "tid": 419 }, { "created_ino": "0x1000000037c", "tid": 420 }, { "created_ino": "0x1000000037d", "tid": 421 }, { "created_ino": "0x1000000037e", "tid": 422 }, { "created_ino": "0x1000000037f", "tid": 423 }, { "created_ino": "0x10000000380", "tid": 424 }, { "created_ino": "0x10000000381", "tid": 425 }, { "created_ino": "0x10000000382", "tid": 426 }, { "created_ino": "0x10000000383", "tid": 427 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000002" } ], "entity": { "addr": { "addr": "192.168.0.1:0", "nonce": 661998823, "type": "any" }, "name": { "num": 8151, "type": "client" } }, "id": 8151, "inst": "client.8151 192.168.0.1:0/661998823", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 29, "num_caps": 201, "num_completed_flushes": 0, "num_completed_requests": 399, "num_leases": 400, "prealloc_inos": [ { "length": 500, "start": "0x10000000002" }, { "length": 603, "start": "0x10000000384" } ], "recall_caps": { "halflife": 60, "value": 2215.6029604919477 }, "recall_caps_throttle": { "halflife": 1.5, "value": 431.2734293772054 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 136.54846055473877 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 198.9742612905166 }, "request_load_avg": 367, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1167.292989630177 }, "state": "open", "uptime": 16.531658894 } ] 2024-09-12T01:44:18.687 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-12T01:44:18.687 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:44:18.687 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:44:18.727 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:44:18.765 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:44:18.765 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:44:18.766 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport sys\nimport time\nimport os\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nn = 400\nabs_path = "/home/ubuntu/cephtest/mnt.0/."\n\nif not os.path.exists(abs_path):\n os.makedirs(abs_path)\n\nhandles = []\nfor i in range(0, n):\n fname = "file_"+str(i)\n path = os.path.join(abs_path, fname)\n handles.append(open(path, \'w\'))\n\nprint("waiting with handles open", file=sys.stderr)\nwhile True:\n print("open_n_background: keeping files open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\nprint("stdin closed, goodbye!", file=sys.stderr)\n'], check_status=True, hostname='smithi060') 2024-09-12T01:44:18.766 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:18.766 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:18.784 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:18.784 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:18.841 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:44:18.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.985+0000 7fc30045e640 1 Processor -- start 2024-09-12T01:44:18.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.985+0000 7fc30045e640 1 -- start start 2024-09-12T01:44:18.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.986+0000 7fc30045e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc2f80d1130 0x7fc2f80d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:18.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.986+0000 7fc30045e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc2f80d1a50 0x7fc2f80b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:18.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.986+0000 7fc30045e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f80d4530 con 0x7fc2f80b8160 2024-09-12T01:44:18.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.986+0000 7fc30045e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f80d40a0 con 0x7fc2f80d1a50 2024-09-12T01:44:18.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.986+0000 7fc30045e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f80d3490 con 0x7fc2f80d1130 2024-09-12T01:44:18.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.986+0000 7fc2fd9f9640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc2f80d1a50 0x7fc2f80b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:18.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.986+0000 7fc2fe9fb640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc2f80b8160 0x7fc2f80b85f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60328/0 (socket says 172.21.15.60:60328) 2024-09-12T01:44:18.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.986+0000 7fc2fe9fb640 1 -- 172.21.15.60:0/3383421373 learned_addr learned my addr 172.21.15.60:0/3383421373 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:18.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.987+0000 7fc2fe1fa640 1 --2- 172.21.15.60:0/3383421373 >> v2:172.21.15.105:3300/0 conn(0x7fc2f80d1130 0x7fc2f80d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:18.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.987+0000 7fc2fd9f9640 1 -- 172.21.15.60:0/3383421373 >> v2:172.21.15.105:3300/0 conn(0x7fc2f80d1130 msgr2=0x7fc2f80d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:18.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.987+0000 7fc2fd9f9640 1 --2- 172.21.15.60:0/3383421373 >> v2:172.21.15.105:3300/0 conn(0x7fc2f80d1130 0x7fc2f80d1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.987+0000 7fc2fd9f9640 1 -- 172.21.15.60:0/3383421373 >> v1:172.21.15.60:6789/0 conn(0x7fc2f80b8160 legacy=0x7fc2f80b85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:18.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.987+0000 7fc2fd9f9640 1 -- 172.21.15.60:0/3383421373 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f80d3770 con 0x7fc2f80d1a50 2024-09-12T01:44:18.988 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.987+0000 7fc2fd1f8640 1 -- 172.21.15.60:0/3383421373 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 891214182 0 0) 0x7fc2f80d4530 con 0x7fc2f80b8160 2024-09-12T01:44:18.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.988+0000 7fc2fd9f9640 1 --2- 172.21.15.60:0/3383421373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f80d1a50 0x7fc2f80b7c20 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8050600 tx=0x7fc2e802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d9ab1deb7ddfc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:18.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.988+0000 7fc2fd1f8640 1 -- 172.21.15.60:0/3383421373 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8037070 con 0x7fc2f80d1a50 2024-09-12T01:44:18.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.988+0000 7fc2fd1f8640 1 -- 172.21.15.60:0/3383421373 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e8032440 con 0x7fc2f80d1a50 2024-09-12T01:44:18.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.988+0000 7fc2fd1f8640 1 -- 172.21.15.60:0/3383421373 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8032810 con 0x7fc2f80d1a50 2024-09-12T01:44:18.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.988+0000 7fc30045e640 1 -- 172.21.15.60:0/3383421373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f80d1a50 msgr2=0x7fc2f80b7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:18.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.988+0000 7fc30045e640 1 --2- 172.21.15.60:0/3383421373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f80d1a50 0x7fc2f80b7c20 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8050600 tx=0x7fc2e802a1a0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.990 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.988+0000 7fc30045e640 1 -- 172.21.15.60:0/3383421373 shutdown_connections 2024-09-12T01:44:18.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.988+0000 7fc30045e640 1 --2- 172.21.15.60:0/3383421373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f80d1a50 0x7fc2f80b7c20 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.988+0000 7fc30045e640 1 --2- 172.21.15.60:0/3383421373 >> v2:172.21.15.105:3300/0 conn(0x7fc2f80d1130 0x7fc2f80d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.988+0000 7fc30045e640 1 -- 172.21.15.60:0/3383421373 >> 172.21.15.60:0/3383421373 conn(0x7fc2f806c020 msgr2=0x7fc2f806c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:18.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.988+0000 7fc30045e640 1 -- 172.21.15.60:0/3383421373 shutdown_connections 2024-09-12T01:44:18.991 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.988+0000 7fc30045e640 1 -- 172.21.15.60:0/3383421373 wait complete. 2024-09-12T01:44:18.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.990+0000 7fc30045e640 1 Processor -- start 2024-09-12T01:44:18.992 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.990+0000 7fc30045e640 1 -- start start 2024-09-12T01:44:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.990+0000 7fc30045e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f80b8160 0x7fc2f80ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.990+0000 7fc30045e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2f80d1130 0x7fc2f81f8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.990+0000 7fc30045e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2f80d1a50 0x7fc2f815aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.990+0000 7fc30045e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f80b8d00 con 0x7fc2f80b8160 2024-09-12T01:44:18.994 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.990+0000 7fc30045e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f80d3d30 con 0x7fc2f80d1a50 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.990+0000 7fc30045e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f80d1e90 con 0x7fc2f80d1130 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.990+0000 7fc2fe1fa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f80b8160 0x7fc2f80ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2fe1fa640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f80b8160 0x7fc2f80ac570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40876/0 (socket says 172.21.15.60:40876) 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2fe1fa640 1 -- 172.21.15.60:0/3532192721 learned_addr learned my addr 172.21.15.60:0/3532192721 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2fe9fb640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2f80d1a50 0x7fc2f815aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2fd9f9640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2f80d1130 0x7fc2f81f8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2fe1fa640 1 -- 172.21.15.60:0/3532192721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2f80d1130 msgr2=0x7fc2f81f8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2fe1fa640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2f80d1130 0x7fc2f81f8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2fe1fa640 1 -- 172.21.15.60:0/3532192721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2f80d1a50 msgr2=0x7fc2f815aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2fe1fa640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2f80d1a50 0x7fc2f815aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2fe1fa640 1 -- 172.21.15.60:0/3532192721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f8156dd0 con 0x7fc2f80b8160 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2fe9fb640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2f80d1a50 0x7fc2f815aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:18.995 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2fd9f9640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2f80d1130 0x7fc2f81f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2fe1fa640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f80b8160 0x7fc2f80ac570 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400e9b0 tx=0x7fc2f400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2eeffd640 1 -- 172.21.15.60:0/3532192721 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4017070 con 0x7fc2f80b8160 2024-09-12T01:44:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2eeffd640 1 -- 172.21.15.60:0/3532192721 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f400c9a0 con 0x7fc2f80b8160 2024-09-12T01:44:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc30045e640 1 -- 172.21.15.60:0/3532192721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f80ab4f0 con 0x7fc2f80b8160 2024-09-12T01:44:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc2eeffd640 1 -- 172.21.15.60:0/3532192721 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400cd90 con 0x7fc2f80b8160 2024-09-12T01:44:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.991+0000 7fc30045e640 1 -- 172.21.15.60:0/3532192721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f80aba90 con 0x7fc2f80b8160 2024-09-12T01:44:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.992+0000 7fc30045e640 1 -- 172.21.15.60:0/3532192721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f80d3070 con 0x7fc2f80b8160 2024-09-12T01:44:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.993+0000 7fc2eeffd640 1 -- 172.21.15.60:0/3532192721 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc2f401a070 con 0x7fc2f80b8160 2024-09-12T01:44:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.993+0000 7fc2eeffd640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc2dc06be30 0x7fc2dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.993+0000 7fc2eeffd640 1 -- 172.21.15.60:0/3532192721 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fc2f408adc0 con 0x7fc2f80b8160 2024-09-12T01:44:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.993+0000 7fc2fd9f9640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc2dc06be30 0x7fc2dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:18.996 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.994+0000 7fc2fd9f9640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc2dc06be30 0x7fc2dc06e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8034000 tx=0x7fc2e802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:18.998 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:18.997+0000 7fc2eeffd640 1 -- 172.21.15.60:0/3532192721 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc2f8156dd0 con 0x7fc2f80b8160 2024-09-12T01:44:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.186+0000 7fc30045e640 1 -- 172.21.15.60:0/3532192721 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc2f815bca0 con 0x7fc2f80b8160 2024-09-12T01:44:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.186+0000 7fc2eeffd640 1 -- 172.21.15.60:0/3532192721 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v128) ==== 80+0+0 (secure 0 0 0) 0x7fc2f4059800 con 0x7fc2f80b8160 2024-09-12T01:44:19.187 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:44:19.189 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.188+0000 7fc30045e640 1 -- 172.21.15.60:0/3532192721 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc2dc06be30 msgr2=0x7fc2dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.188+0000 7fc30045e640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc2dc06be30 0x7fc2dc06e2f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8034000 tx=0x7fc2e802e000 comp rx=0 tx=0).stop 2024-09-12T01:44:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.188+0000 7fc30045e640 1 -- 172.21.15.60:0/3532192721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f80b8160 msgr2=0x7fc2f80ac570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.188+0000 7fc30045e640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f80b8160 0x7fc2f80ac570 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400e9b0 tx=0x7fc2f400ee70 comp rx=0 tx=0).stop 2024-09-12T01:44:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.188+0000 7fc30045e640 1 -- 172.21.15.60:0/3532192721 shutdown_connections 2024-09-12T01:44:19.190 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.188+0000 7fc30045e640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc2f80d1a50 0x7fc2f815aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.188+0000 7fc30045e640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc2dc06be30 0x7fc2dc06e2f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.188+0000 7fc30045e640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc2f80d1130 0x7fc2f81f8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.188+0000 7fc30045e640 1 --2- 172.21.15.60:0/3532192721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2f80b8160 0x7fc2f80ac570 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.188+0000 7fc30045e640 1 -- 172.21.15.60:0/3532192721 >> 172.21.15.60:0/3532192721 conn(0x7fc2f806c020 msgr2=0x7fc2f80b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.188+0000 7fc30045e640 1 -- 172.21.15.60:0/3532192721 shutdown_connections 2024-09-12T01:44:19.191 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.188+0000 7fc30045e640 1 -- 172.21.15.60:0/3532192721 wait complete. 2024-09-12T01:44:19.200 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:44:19.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:19.200 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:44:19.304 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:44:19.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:19.304 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:44:19.320 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:44:19.321 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:44:19.321 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:19.337 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:44:19.337 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:19.394 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:44:19.394 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:44:19.398 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:44:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.500+0000 7f46ac3b7640 1 Processor -- start 2024-09-12T01:44:19.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.500+0000 7f46ac3b7640 1 -- start start 2024-09-12T01:44:19.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.501+0000 7f46ac3b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a415e6f0 0x7f46a406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:19.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.501+0000 7f46ac3b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f46a40b7450 0x7f46a415f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:19.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.501+0000 7f46ac3b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a406e990 con 0x7f46a40b54d0 2024-09-12T01:44:19.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.501+0000 7f46ac3b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f46a406ec70 con 0x7f46a40b7450 2024-09-12T01:44:19.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.501+0000 7f46ac3b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46a415ec70 con 0x7f46a415e6f0 2024-09-12T01:44:19.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.501+0000 7f46a9952640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f46a40b54d0 0x7f46a40b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60338/0 (socket says 172.21.15.60:60338) 2024-09-12T01:44:19.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.501+0000 7f46a9952640 1 -- 172.21.15.60:0/2250452860 learned_addr learned my addr 172.21.15.60:0/2250452860 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:19.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.501+0000 7f46aa954640 1 --2- 172.21.15.60:0/2250452860 >> v2:172.21.15.105:3300/0 conn(0x7f46a40b7450 0x7f46a415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:19.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.501+0000 7f46aa153640 1 --2- 172.21.15.60:0/2250452860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a415e6f0 0x7f46a406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:19.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.501+0000 7f46a9151640 1 -- 172.21.15.60:0/2250452860 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654246166 0 0) 0x7f46a406e990 con 0x7f46a40b54d0 2024-09-12T01:44:19.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.501+0000 7f46a9151640 1 -- 172.21.15.60:0/2250452860 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4690003520 con 0x7f46a40b54d0 2024-09-12T01:44:19.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.502+0000 7f46aa153640 1 -- 172.21.15.60:0/2250452860 >> v2:172.21.15.105:3300/0 conn(0x7f46a40b7450 msgr2=0x7f46a415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:19.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.502+0000 7f46aa153640 1 --2- 172.21.15.60:0/2250452860 >> v2:172.21.15.105:3300/0 conn(0x7f46a40b7450 0x7f46a415f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.502+0000 7f46aa153640 1 -- 172.21.15.60:0/2250452860 >> v1:172.21.15.60:6789/0 conn(0x7f46a40b54d0 legacy=0x7f46a40b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.502+0000 7f46aa153640 1 -- 172.21.15.60:0/2250452860 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a415ef50 con 0x7f46a415e6f0 2024-09-12T01:44:19.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.502+0000 7f46aa954640 1 --2- 172.21.15.60:0/2250452860 >> v2:172.21.15.105:3300/0 conn(0x7f46a40b7450 0x7f46a415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:19.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.502+0000 7f46aa153640 1 --2- 172.21.15.60:0/2250452860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a415e6f0 0x7f46a406fd00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f46a00097a0 tx=0x7f46a002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fe4d20aefa21333 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:19.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.503+0000 7f46a9151640 1 -- 172.21.15.60:0/2250452860 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0037070 con 0x7f46a415e6f0 2024-09-12T01:44:19.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.503+0000 7f46a9151640 1 -- 172.21.15.60:0/2250452860 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a0032440 con 0x7f46a415e6f0 2024-09-12T01:44:19.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.503+0000 7f46a9151640 1 -- 172.21.15.60:0/2250452860 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a00327f0 con 0x7f46a415e6f0 2024-09-12T01:44:19.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.503+0000 7f46ac3b7640 1 -- 172.21.15.60:0/2250452860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a415e6f0 msgr2=0x7f46a406fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.503+0000 7f46ac3b7640 1 --2- 172.21.15.60:0/2250452860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a415e6f0 0x7f46a406fd00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f46a00097a0 tx=0x7f46a002a180 comp rx=0 tx=0).stop 2024-09-12T01:44:19.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.503+0000 7f46ac3b7640 1 -- 172.21.15.60:0/2250452860 shutdown_connections 2024-09-12T01:44:19.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.503+0000 7f46ac3b7640 1 --2- 172.21.15.60:0/2250452860 >> v2:172.21.15.105:3300/0 conn(0x7f46a40b7450 0x7f46a415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.503+0000 7f46ac3b7640 1 --2- 172.21.15.60:0/2250452860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a415e6f0 0x7f46a406fd00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.503+0000 7f46ac3b7640 1 -- 172.21.15.60:0/2250452860 >> 172.21.15.60:0/2250452860 conn(0x7f46a40d2430 msgr2=0x7f46a40d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:19.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.503+0000 7f46ac3b7640 1 -- 172.21.15.60:0/2250452860 shutdown_connections 2024-09-12T01:44:19.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.503+0000 7f46ac3b7640 1 -- 172.21.15.60:0/2250452860 wait complete. 2024-09-12T01:44:19.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.504+0000 7f46ac3b7640 1 Processor -- start 2024-09-12T01:44:19.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.504+0000 7f46ac3b7640 1 -- start start 2024-09-12T01:44:19.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.505+0000 7f46ac3b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a40b54d0 0x7f46a41f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:19.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.505+0000 7f46ac3b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40b7450 0x7f46a41580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:19.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.505+0000 7f46ac3b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a415e6f0 0x7f46a4148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:19.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.505+0000 7f46ac3b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46a406e730 con 0x7f46a40b54d0 2024-09-12T01:44:19.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.505+0000 7f46ac3b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f46a406e5b0 con 0x7f46a415e6f0 2024-09-12T01:44:19.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.505+0000 7f46ac3b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f46a4070830 con 0x7f46a40b7450 2024-09-12T01:44:19.510 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.505+0000 7f46aa153640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a40b54d0 0x7f46a41f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.505+0000 7f46aa153640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a40b54d0 0x7f46a41f4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40886/0 (socket says 172.21.15.60:40886) 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.505+0000 7f46aa153640 1 -- 172.21.15.60:0/162772281 learned_addr learned my addr 172.21.15.60:0/162772281 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.505+0000 7f46aa954640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a415e6f0 0x7f46a4148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.505+0000 7f46a9952640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40b7450 0x7f46a41580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.506+0000 7f46aa153640 1 -- 172.21.15.60:0/162772281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40b7450 msgr2=0x7f46a41580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.506+0000 7f46aa153640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40b7450 0x7f46a41580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.506+0000 7f46aa153640 1 -- 172.21.15.60:0/162772281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a415e6f0 msgr2=0x7f46a4148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.506+0000 7f46aa153640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a415e6f0 0x7f46a4148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.506+0000 7f46aa153640 1 -- 172.21.15.60:0/162772281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a41585f0 con 0x7f46a40b54d0 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.506+0000 7f46aa153640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a40b54d0 0x7f46a41f4520 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000c00 tx=0x7f46a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.506+0000 7f469affd640 1 -- 172.21.15.60:0/162772281 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0041020 con 0x7f46a40b54d0 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.506+0000 7f469affd640 1 -- 172.21.15.60:0/162772281 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46a003d620 con 0x7f46a40b54d0 2024-09-12T01:44:19.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.506+0000 7f46ac3b7640 1 -- 172.21.15.60:0/162772281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a4159a50 con 0x7f46a40b54d0 2024-09-12T01:44:19.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.506+0000 7f469affd640 1 -- 172.21.15.60:0/162772281 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a0037040 con 0x7f46a40b54d0 2024-09-12T01:44:19.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.506+0000 7f46ac3b7640 1 -- 172.21.15.60:0/162772281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a4161130 con 0x7f46a40b54d0 2024-09-12T01:44:19.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.507+0000 7f46ac3b7640 1 -- 172.21.15.60:0/162772281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a406c6c0 con 0x7f46a40b54d0 2024-09-12T01:44:19.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.507+0000 7f469affd640 1 -- 172.21.15.60:0/162772281 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f46a0044020 con 0x7f46a40b54d0 2024-09-12T01:44:19.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.508+0000 7f469affd640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f468806be30 0x7f468806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:19.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.508+0000 7f469affd640 1 -- 172.21.15.60:0/162772281 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f46a00ab4d0 con 0x7f46a40b54d0 2024-09-12T01:44:19.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.508+0000 7f46a9952640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f468806be30 0x7f468806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:19.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.509+0000 7f46a9952640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f468806be30 0x7f468806e2f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4694005880 tx=0x7f4694009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:19.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.512+0000 7f469affd640 1 -- 172.21.15.60:0/162772281 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f46a004b030 con 0x7f46a40b54d0 2024-09-12T01:44:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.698+0000 7f46ac3b7640 1 -- 172.21.15.60:0/162772281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f46a415d7d0 con 0x7f46a40b54d0 2024-09-12T01:44:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.698+0000 7f469affd640 1 -- 172.21.15.60:0/162772281 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v128) ==== 80+0+0 (secure 0 0 0) 0x7f46a41585f0 con 0x7f46a40b54d0 2024-09-12T01:44:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:44:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.700+0000 7f46ac3b7640 1 -- 172.21.15.60:0/162772281 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f468806be30 msgr2=0x7f468806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.700+0000 7f46ac3b7640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f468806be30 0x7f468806e2f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4694005880 tx=0x7f4694009040 comp rx=0 tx=0).stop 2024-09-12T01:44:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.700+0000 7f46ac3b7640 1 -- 172.21.15.60:0/162772281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a40b54d0 msgr2=0x7f46a41f4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.700+0000 7f46ac3b7640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a40b54d0 0x7f46a41f4520 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f46a0000c00 tx=0x7f46a00046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.700+0000 7f46ac3b7640 1 -- 172.21.15.60:0/162772281 shutdown_connections 2024-09-12T01:44:19.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.700+0000 7f46ac3b7640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f46a415e6f0 0x7f46a4148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.700+0000 7f46ac3b7640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f468806be30 0x7f468806e2f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.700+0000 7f46ac3b7640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f46a40b7450 0x7f46a41580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.700+0000 7f46ac3b7640 1 --2- 172.21.15.60:0/162772281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a40b54d0 0x7f46a41f4520 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.700+0000 7f46ac3b7640 1 -- 172.21.15.60:0/162772281 >> 172.21.15.60:0/162772281 conn(0x7f46a40d2430 msgr2=0x7f46a4074c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:19.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.700+0000 7f46ac3b7640 1 -- 172.21.15.60:0/162772281 shutdown_connections 2024-09-12T01:44:19.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.700+0000 7f46ac3b7640 1 -- 172.21.15.60:0/162772281 wait complete. 2024-09-12T01:44:19.711 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:44:19.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:19.711 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T01:44:19.739 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:44:19.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:19.739 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:44:19.795 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:44:19.795 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:19.796 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:19.812 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:44:19.812 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:44:19.812 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:44:19.812 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:19.851 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:44:19.851 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:19.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.954+0000 7f68ab45c640 1 Processor -- start 2024-09-12T01:44:19.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.954+0000 7f68ab45c640 1 -- start start 2024-09-12T01:44:19.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f68ab45c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f68a40cf6b0 0x7f68a41629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:19.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f68ab45c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a40cfc20 con 0x7f68a40b63d0 2024-09-12T01:44:19.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f68ab45c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a40d2ed0 con 0x7f68a4162f30 2024-09-12T01:44:19.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f68ab45c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f68a40d40c0 con 0x7f68a40cf6b0 2024-09-12T01:44:19.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f68a91f8640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f68a40b63d0 0x7f68a40d39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60350/0 (socket says 172.21.15.60:60350) 2024-09-12T01:44:19.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f68a91f8640 1 -- 172.21.15.60:0/2256076053 learned_addr learned my addr 172.21.15.60:0/2256076053 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:19.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f68a89f7640 1 --2- 172.21.15.60:0/2256076053 >> v2:172.21.15.105:3300/0 conn(0x7f68a40cf6b0 0x7f68a41629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:19.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f689bfff640 1 -- 172.21.15.60:0/2256076053 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2521517822 0 0) 0x7f68a40cfc20 con 0x7f68a40b63d0 2024-09-12T01:44:19.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f689bfff640 1 -- 172.21.15.60:0/2256076053 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6890003520 con 0x7f68a40b63d0 2024-09-12T01:44:19.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f689bfff640 1 -- 172.21.15.60:0/2256076053 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520142737 0 0) 0x7f68a40d2ed0 con 0x7f68a4162f30 2024-09-12T01:44:19.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f689bfff640 1 -- 172.21.15.60:0/2256076053 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68a40cfc20 con 0x7f68a4162f30 2024-09-12T01:44:19.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f68a89f7640 1 -- 172.21.15.60:0/2256076053 >> v1:172.21.15.105:6789/0 conn(0x7f68a4162f30 legacy=0x7f68a40b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f68a89f7640 1 -- 172.21.15.60:0/2256076053 >> v1:172.21.15.60:6789/0 conn(0x7f68a40b63d0 legacy=0x7f68a40d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.955+0000 7f68a89f7640 1 -- 172.21.15.60:0/2256076053 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a40d31b0 con 0x7f68a40cf6b0 2024-09-12T01:44:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.956+0000 7f68a89f7640 1 --2- 172.21.15.60:0/2256076053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a40cf6b0 0x7f68a41629f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f68940097a0 tx=0x7f689402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea5d763b9288623c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.956+0000 7f689bfff640 1 -- 172.21.15.60:0/2256076053 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6894037070 con 0x7f68a40cf6b0 2024-09-12T01:44:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.956+0000 7f689bfff640 1 -- 172.21.15.60:0/2256076053 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6894032440 con 0x7f68a40cf6b0 2024-09-12T01:44:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.956+0000 7f689bfff640 1 -- 172.21.15.60:0/2256076053 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68940327f0 con 0x7f68a40cf6b0 2024-09-12T01:44:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.957+0000 7f68ab45c640 1 -- 172.21.15.60:0/2256076053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a40cf6b0 msgr2=0x7f68a41629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.957+0000 7f68ab45c640 1 --2- 172.21.15.60:0/2256076053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a40cf6b0 0x7f68a41629f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f68940097a0 tx=0x7f689402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.957+0000 7f68ab45c640 1 -- 172.21.15.60:0/2256076053 shutdown_connections 2024-09-12T01:44:19.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.957+0000 7f68ab45c640 1 --2- 172.21.15.60:0/2256076053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a40cf6b0 0x7f68a41629f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.957+0000 7f68ab45c640 1 -- 172.21.15.60:0/2256076053 >> 172.21.15.60:0/2256076053 conn(0x7f68a40d1160 msgr2=0x7f68a40d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:19.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.957+0000 7f68ab45c640 1 -- 172.21.15.60:0/2256076053 shutdown_connections 2024-09-12T01:44:19.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.957+0000 7f68ab45c640 1 -- 172.21.15.60:0/2256076053 wait complete. 2024-09-12T01:44:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.958+0000 7f68ab45c640 1 Processor -- start 2024-09-12T01:44:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.958+0000 7f68ab45c640 1 -- start start 2024-09-12T01:44:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.959+0000 7f68ab45c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a40b63d0 0x7f68a40cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.959+0000 7f68ab45c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a40cf6b0 0x7f68a40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.959+0000 7f68ab45c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a4162f30 0x7f68a40cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.959+0000 7f68ab45c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f68a40cb5c0 con 0x7f68a4162f30 2024-09-12T01:44:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.959+0000 7f68ab45c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f68a40cb440 con 0x7f68a40cf6b0 2024-09-12T01:44:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.959+0000 7f68ab45c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f68a40d1c80 con 0x7f68a40b63d0 2024-09-12T01:44:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.959+0000 7f68a99f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a4162f30 0x7f68a40cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.959+0000 7f68a89f7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a40cf6b0 0x7f68a40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.959+0000 7f68a99f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a4162f30 0x7f68a40cdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40894/0 (socket says 172.21.15.60:40894) 2024-09-12T01:44:19.961 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.959+0000 7f68a89f7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a40cf6b0 0x7f68a40cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:46992/0 (socket says 172.21.15.60:46992) 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.959+0000 7f68a99f9640 1 -- 172.21.15.60:0/1265907316 learned_addr learned my addr 172.21.15.60:0/1265907316 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.959+0000 7f68a91f8640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a40b63d0 0x7f68a40cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.960+0000 7f68a99f9640 1 -- 172.21.15.60:0/1265907316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a40b63d0 msgr2=0x7f68a40cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.960+0000 7f68a99f9640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a40b63d0 0x7f68a40cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.960+0000 7f68a99f9640 1 -- 172.21.15.60:0/1265907316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a40cf6b0 msgr2=0x7f68a40cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.960+0000 7f68a99f9640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a40cf6b0 0x7f68a40cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.960+0000 7f68a99f9640 1 -- 172.21.15.60:0/1265907316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a41e9190 con 0x7f68a4162f30 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.960+0000 7f68a89f7640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a40cf6b0 0x7f68a40cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.960+0000 7f68a99f9640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a4162f30 0x7f68a40cdeb0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f689c00c6b0 tx=0x7f689c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.960+0000 7f6899ffb640 1 -- 172.21.15.60:0/1265907316 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c003b70 con 0x7f68a4162f30 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.960+0000 7f6899ffb640 1 -- 172.21.15.60:0/1265907316 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f689c003d10 con 0x7f68a4162f30 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.960+0000 7f68ab45c640 1 -- 172.21.15.60:0/1265907316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a40cbb70 con 0x7f68a4162f30 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.960+0000 7f6899ffb640 1 -- 172.21.15.60:0/1265907316 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c005310 con 0x7f68a4162f30 2024-09-12T01:44:19.962 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.960+0000 7f68ab45c640 1 -- 172.21.15.60:0/1265907316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a41e9730 con 0x7f68a4162f30 2024-09-12T01:44:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.961+0000 7f68ab45c640 1 -- 172.21.15.60:0/1265907316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a40b67b0 con 0x7f68a4162f30 2024-09-12T01:44:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.962+0000 7f6899ffb640 1 -- 172.21.15.60:0/1265907316 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f689c0054b0 con 0x7f68a4162f30 2024-09-12T01:44:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.962+0000 7f6899ffb640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f688806be30 0x7f688806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:19.963 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.962+0000 7f68a91f8640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f688806be30 0x7f688806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:19.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.962+0000 7f6899ffb640 1 -- 172.21.15.60:0/1265907316 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f689c08ab70 con 0x7f68a4162f30 2024-09-12T01:44:19.964 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.963+0000 7f68a91f8640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f688806be30 0x7f688806e2f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f68a0000f60 tx=0x7f68a0007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:19.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:19.967+0000 7f6899ffb640 1 -- 172.21.15.60:0/1265907316 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f689c058ed0 con 0x7f68a4162f30 2024-09-12T01:44:20.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.176+0000 7f68ab45c640 1 -- 172.21.15.60:0/1265907316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68a40cf280 con 0x7f68a4162f30 2024-09-12T01:44:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.176+0000 7f6899ffb640 1 -- 172.21.15.60:0/1265907316 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5230 (secure 0 0 0) 0x7f689c05d1d0 con 0x7f68a4162f30 2024-09-12T01:44:20.177 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:20.177 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":81,"btime":"2024-09-12T01:44:13:036586+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/152127841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":152127841},{"type":"v1","addr":"172.21.15.60:6836","nonce":152127841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7234,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2154123948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2154123948},{"type":"v1","addr":"172.21.15.105:6835","nonce":2154123948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1634496909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1634496909},{"type":"v1","addr":"172.21.15.60:6837","nonce":1634496909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:51.547779+0000","modified":"2024-09-12T01:44:12.213628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6834/2888550162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2888550162},{"type":"v1","addr":"172.21.15.105:6834","nonce":2888550162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7989,"qdb_cluster":[7989]},"id":10}]} 2024-09-12T01:44:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 81 2024-09-12T01:44:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.179+0000 7f68ab45c640 1 -- 172.21.15.60:0/1265907316 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f688806be30 msgr2=0x7f688806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.179+0000 7f68ab45c640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f688806be30 0x7f688806e2f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f68a0000f60 tx=0x7f68a0007d30 comp rx=0 tx=0).stop 2024-09-12T01:44:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.179+0000 7f68ab45c640 1 -- 172.21.15.60:0/1265907316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a4162f30 msgr2=0x7f68a40cdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.179+0000 7f68ab45c640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a4162f30 0x7f68a40cdeb0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f689c00c6b0 tx=0x7f689c00cb70 comp rx=0 tx=0).stop 2024-09-12T01:44:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.179+0000 7f68ab45c640 1 -- 172.21.15.60:0/1265907316 shutdown_connections 2024-09-12T01:44:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.179+0000 7f68ab45c640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68a4162f30 0x7f68a40cdeb0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.179+0000 7f68ab45c640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f68a40cf6b0 0x7f68a40cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.179+0000 7f68ab45c640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f688806be30 0x7f688806e2f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.179+0000 7f68ab45c640 1 --2- 172.21.15.60:0/1265907316 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f68a40b63d0 0x7f68a40cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.179+0000 7f68ab45c640 1 -- 172.21.15.60:0/1265907316 >> 172.21.15.60:0/1265907316 conn(0x7f68a40d1160 msgr2=0x7f68a40b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.179+0000 7f68ab45c640 1 -- 172.21.15.60:0/1265907316 shutdown_connections 2024-09-12T01:44:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.179+0000 7f68ab45c640 1 -- 172.21.15.60:0/1265907316 wait complete. 2024-09-12T01:44:20.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:20.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.293+0000 7f91bf933640 1 Processor -- start 2024-09-12T01:44:20.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.293+0000 7f91bf933640 1 -- start start 2024-09-12T01:44:20.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bf933640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91b80b63d0 0x7f91b80d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bf933640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f91b80d1c80 0x7f91b80b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bf933640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b80cfc20 con 0x7f91b80cf6b0 2024-09-12T01:44:20.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bf933640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f91b80d2ed0 con 0x7f91b80d1c80 2024-09-12T01:44:20.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bf933640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f91b80d31b0 con 0x7f91b80b63d0 2024-09-12T01:44:20.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bcece640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f91b80cf6b0 0x7f91b80b7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60354/0 (socket says 172.21.15.60:60354) 2024-09-12T01:44:20.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bcece640 1 -- 172.21.15.60:0/2734079779 learned_addr learned my addr 172.21.15.60:0/2734079779 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:20.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bded0640 1 --2- 172.21.15.60:0/2734079779 >> v2:172.21.15.105:3300/0 conn(0x7f91b80d1c80 0x7f91b80b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bd6cf640 1 --2- 172.21.15.60:0/2734079779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91b80b63d0 0x7f91b80d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91b7fff640 1 -- 172.21.15.60:0/2734079779 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4125948518 0 0) 0x7f91b80cfc20 con 0x7f91b80cf6b0 2024-09-12T01:44:20.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91b7fff640 1 -- 172.21.15.60:0/2734079779 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91a0003520 con 0x7f91b80cf6b0 2024-09-12T01:44:20.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bded0640 1 -- 172.21.15.60:0/2734079779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91b80b63d0 msgr2=0x7f91b80d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:20.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bded0640 1 --2- 172.21.15.60:0/2734079779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91b80b63d0 0x7f91b80d39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bded0640 1 -- 172.21.15.60:0/2734079779 >> v1:172.21.15.60:6789/0 conn(0x7f91b80cf6b0 legacy=0x7f91b80b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.296 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.294+0000 7f91bded0640 1 -- 172.21.15.60:0/2734079779 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b80d3490 con 0x7f91b80d1c80 2024-09-12T01:44:20.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.295+0000 7f91bded0640 1 --2- 172.21.15.60:0/2734079779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91b80d1c80 0x7f91b80b7f90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f91b00097a0 tx=0x7f91b002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9000c83206af1c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:20.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.295+0000 7f91b7fff640 1 -- 172.21.15.60:0/2734079779 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0037070 con 0x7f91b80d1c80 2024-09-12T01:44:20.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.295+0000 7f91b7fff640 1 -- 172.21.15.60:0/2734079779 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b002adb0 con 0x7f91b80d1c80 2024-09-12T01:44:20.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.295+0000 7f91b7fff640 1 -- 172.21.15.60:0/2734079779 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b0032660 con 0x7f91b80d1c80 2024-09-12T01:44:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.296+0000 7f91bf933640 1 -- 172.21.15.60:0/2734079779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91b80d1c80 msgr2=0x7f91b80b7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.296+0000 7f91bf933640 1 --2- 172.21.15.60:0/2734079779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91b80d1c80 0x7f91b80b7f90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f91b00097a0 tx=0x7f91b002a060 comp rx=0 tx=0).stop 2024-09-12T01:44:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.296+0000 7f91bf933640 1 -- 172.21.15.60:0/2734079779 shutdown_connections 2024-09-12T01:44:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.296+0000 7f91bf933640 1 --2- 172.21.15.60:0/2734079779 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91b80d1c80 0x7f91b80b7f90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.296+0000 7f91bf933640 1 --2- 172.21.15.60:0/2734079779 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91b80b63d0 0x7f91b80d39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.296+0000 7f91bf933640 1 -- 172.21.15.60:0/2734079779 >> 172.21.15.60:0/2734079779 conn(0x7f91b80d1160 msgr2=0x7f91b80d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.296+0000 7f91bf933640 1 -- 172.21.15.60:0/2734079779 shutdown_connections 2024-09-12T01:44:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.296+0000 7f91bf933640 1 -- 172.21.15.60:0/2734079779 wait complete. 2024-09-12T01:44:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.297+0000 7f91bf933640 1 Processor -- start 2024-09-12T01:44:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.297+0000 7f91bf933640 1 -- start start 2024-09-12T01:44:20.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bf933640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80b63d0 0x7f91b8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bf933640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91b80cf6b0 0x7f91b80b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bf933640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91b80d1c80 0x7f91b80b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.300 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bf933640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f91b80d4070 con 0x7f91b80b63d0 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bf933640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f91b80d3ef0 con 0x7f91b80cf6b0 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bf933640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f91b80b67b0 con 0x7f91b80d1c80 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bd6cf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80b63d0 0x7f91b8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bd6cf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80b63d0 0x7f91b8156b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40906/0 (socket says 172.21.15.60:40906) 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bd6cf640 1 -- 172.21.15.60:0/3784224867 learned_addr learned my addr 172.21.15.60:0/3784224867 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bd6cf640 1 -- 172.21.15.60:0/3784224867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91b80d1c80 msgr2=0x7f91b80b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bd6cf640 1 --2- 172.21.15.60:0/3784224867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91b80d1c80 0x7f91b80b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bd6cf640 1 -- 172.21.15.60:0/3784224867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91b80cf6b0 msgr2=0x7f91b80b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bd6cf640 1 --2- 172.21.15.60:0/3784224867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91b80cf6b0 0x7f91b80b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bd6cf640 1 -- 172.21.15.60:0/3784224867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b80ac220 con 0x7f91b80b63d0 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bd6cf640 1 --2- 172.21.15.60:0/3784224867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80b63d0 0x7f91b8156b30 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f91a800efc0 tx=0x7f91a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91b5ffb640 1 -- 172.21.15.60:0/3784224867 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8018020 con 0x7f91b80b63d0 2024-09-12T01:44:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91b5ffb640 1 -- 172.21.15.60:0/3784224867 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91a8014480 con 0x7f91b80b63d0 2024-09-12T01:44:20.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91bf933640 1 -- 172.21.15.60:0/3784224867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b80ac500 con 0x7f91b80b63d0 2024-09-12T01:44:20.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.298+0000 7f91b5ffb640 1 -- 172.21.15.60:0/3784224867 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91a8014850 con 0x7f91b80b63d0 2024-09-12T01:44:20.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.299+0000 7f91bf933640 1 -- 172.21.15.60:0/3784224867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b80acac0 con 0x7f91b80b63d0 2024-09-12T01:44:20.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.300+0000 7f91bf933640 1 -- 172.21.15.60:0/3784224867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b80d39b0 con 0x7f91b80b63d0 2024-09-12T01:44:20.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.300+0000 7f91b5ffb640 1 -- 172.21.15.60:0/3784224867 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f91a801b020 con 0x7f91b80b63d0 2024-09-12T01:44:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.301+0000 7f91b5ffb640 1 --2- 172.21.15.60:0/3784224867 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91a406be30 0x7f91a406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.301+0000 7f91b5ffb640 1 -- 172.21.15.60:0/3784224867 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f91a808ba40 con 0x7f91b80b63d0 2024-09-12T01:44:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.301+0000 7f91bcece640 1 --2- 172.21.15.60:0/3784224867 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91a406be30 0x7f91a406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.301+0000 7f91bcece640 1 --2- 172.21.15.60:0/3784224867 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91a406be30 0x7f91a406e2f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f91ac000f60 tx=0x7f91ac0078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.305+0000 7f91b5ffb640 1 -- 172.21.15.60:0/3784224867 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f91a8022030 con 0x7f91b80b63d0 2024-09-12T01:44:20.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.521+0000 7f91bf933640 1 -- 172.21.15.60:0/3784224867 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91b80cf280 con 0x7f91b80b63d0 2024-09-12T01:44:20.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.521+0000 7f91b5ffb640 1 -- 172.21.15.60:0/3784224867 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5230 (secure 0 0 0) 0x7f91a808be20 con 0x7f91b80b63d0 2024-09-12T01:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:20.522 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":81,"btime":"2024-09-12T01:44:13:036586+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/152127841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":152127841},{"type":"v1","addr":"172.21.15.60:6836","nonce":152127841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7234,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2154123948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2154123948},{"type":"v1","addr":"172.21.15.105:6835","nonce":2154123948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1634496909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1634496909},{"type":"v1","addr":"172.21.15.60:6837","nonce":1634496909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:51.547779+0000","modified":"2024-09-12T01:44:12.213628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6834/2888550162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2888550162},{"type":"v1","addr":"172.21.15.105:6834","nonce":2888550162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7989,"qdb_cluster":[7989]},"id":10}]} 2024-09-12T01:44:20.522 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 81 2024-09-12T01:44:20.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.524+0000 7f91bf933640 1 -- 172.21.15.60:0/3784224867 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91a406be30 msgr2=0x7f91a406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.524+0000 7f91bf933640 1 --2- 172.21.15.60:0/3784224867 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91a406be30 0x7f91a406e2f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f91ac000f60 tx=0x7f91ac0078f0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.524+0000 7f91bf933640 1 -- 172.21.15.60:0/3784224867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80b63d0 msgr2=0x7f91b8156b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.524+0000 7f91bf933640 1 --2- 172.21.15.60:0/3784224867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80b63d0 0x7f91b8156b30 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f91a800efc0 tx=0x7f91a800c490 comp rx=0 tx=0).stop 2024-09-12T01:44:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.524+0000 7f91bf933640 1 -- 172.21.15.60:0/3784224867 shutdown_connections 2024-09-12T01:44:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.524+0000 7f91bf933640 1 --2- 172.21.15.60:0/3784224867 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91a406be30 0x7f91a406e2f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.524+0000 7f91bf933640 1 --2- 172.21.15.60:0/3784224867 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91b80d1c80 0x7f91b80b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.524+0000 7f91bf933640 1 --2- 172.21.15.60:0/3784224867 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f91b80cf6b0 0x7f91b80b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.524+0000 7f91bf933640 1 --2- 172.21.15.60:0/3784224867 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80b63d0 0x7f91b8156b30 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.524+0000 7f91bf933640 1 -- 172.21.15.60:0/3784224867 >> 172.21.15.60:0/3784224867 conn(0x7f91b80d1160 msgr2=0x7f91b80ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.524+0000 7f91bf933640 1 -- 172.21.15.60:0/3784224867 shutdown_connections 2024-09-12T01:44:20.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.524+0000 7f91bf933640 1 -- 172.21.15.60:0/3784224867 wait complete. 2024-09-12T01:44:20.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:44:20.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.637+0000 7fa006d23640 1 Processor -- start 2024-09-12T01:44:20.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.637+0000 7fa006d23640 1 -- start start 2024-09-12T01:44:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.637+0000 7fa006d23640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa00015e660 0x7fa0000cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.637+0000 7fa006d23640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0000d3310 0x7fa0000d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.637+0000 7fa006d23640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa00015ea40 con 0x7fa0000d1650 2024-09-12T01:44:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.637+0000 7fa006d23640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa0000d1ac0 con 0x7fa00015e660 2024-09-12T01:44:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.637+0000 7fa006d23640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0000d3870 con 0x7fa0000d3310 2024-09-12T01:44:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.638+0000 7fa004abf640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa00015e660 0x7fa0000cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.638+0000 7fa004abf640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa00015e660 0x7fa0000cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40918/0 (socket says 172.21.15.60:40918) 2024-09-12T01:44:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.638+0000 7fa004abf640 1 -- 172.21.15.60:0/1871607483 learned_addr learned my addr 172.21.15.60:0/1871607483 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:20.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.638+0000 7f9ffffff640 1 --2- 172.21.15.60:0/1871607483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0000d3310 0x7fa0000d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.638+0000 7fa004abf640 1 -- 172.21.15.60:0/1871607483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0000d3310 msgr2=0x7fa0000d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:20.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.638+0000 7fa004abf640 1 --2- 172.21.15.60:0/1871607483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0000d3310 0x7fa0000d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.638+0000 7fa004abf640 1 -- 172.21.15.60:0/1871607483 >> v1:172.21.15.105:6789/0 conn(0x7fa0000d1650 legacy=0x7fa00006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.638+0000 7fa004abf640 1 -- 172.21.15.60:0/1871607483 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0000d3b50 con 0x7fa00015e660 2024-09-12T01:44:20.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.639+0000 7fa004abf640 1 --2- 172.21.15.60:0/1871607483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa00015e660 0x7fa0000cf730 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009870 tx=0x7f9ff402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fceb9e15b1bf00 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:20.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.639+0000 7f9fff7fe640 1 -- 172.21.15.60:0/1871607483 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4037070 con 0x7fa00015e660 2024-09-12T01:44:20.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.639+0000 7f9fff7fe640 1 -- 172.21.15.60:0/1871607483 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff4032440 con 0x7fa00015e660 2024-09-12T01:44:20.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.639+0000 7f9fff7fe640 1 -- 172.21.15.60:0/1871607483 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4032810 con 0x7fa00015e660 2024-09-12T01:44:20.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.639+0000 7fa006d23640 1 -- 172.21.15.60:0/1871607483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa00015e660 msgr2=0x7fa0000cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.639+0000 7fa006d23640 1 --2- 172.21.15.60:0/1871607483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa00015e660 0x7fa0000cf730 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009870 tx=0x7f9ff402a270 comp rx=0 tx=0).stop 2024-09-12T01:44:20.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.639+0000 7fa006d23640 1 -- 172.21.15.60:0/1871607483 shutdown_connections 2024-09-12T01:44:20.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.639+0000 7fa006d23640 1 --2- 172.21.15.60:0/1871607483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0000d3310 0x7fa0000d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.639+0000 7fa006d23640 1 --2- 172.21.15.60:0/1871607483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa00015e660 0x7fa0000cf730 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.639+0000 7fa006d23640 1 -- 172.21.15.60:0/1871607483 >> 172.21.15.60:0/1871607483 conn(0x7fa0000b6410 msgr2=0x7fa0000b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:20.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.639+0000 7fa006d23640 1 -- 172.21.15.60:0/1871607483 shutdown_connections 2024-09-12T01:44:20.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.639+0000 7fa006d23640 1 -- 172.21.15.60:0/1871607483 wait complete. 2024-09-12T01:44:20.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.641+0000 7fa006d23640 1 Processor -- start 2024-09-12T01:44:20.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.641+0000 7fa006d23640 1 -- start start 2024-09-12T01:44:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.641+0000 7fa006d23640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0000d1650 0x7fa0001f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.641+0000 7fa006d23640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0000d3310 0x7fa0001f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.641+0000 7fa006d23640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa00015e660 0x7fa0001611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa006d23640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa0000d43f0 con 0x7fa0000d1650 2024-09-12T01:44:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa006d23640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa0000d4110 con 0x7fa0000d3310 2024-09-12T01:44:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa006d23640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0000cfc70 con 0x7fa00015e660 2024-09-12T01:44:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa004abf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0000d1650 0x7fa0001f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa004abf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0000d1650 0x7fa0001f8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40926/0 (socket says 172.21.15.60:40926) 2024-09-12T01:44:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa004abf640 1 -- 172.21.15.60:0/3235554102 learned_addr learned my addr 172.21.15.60:0/3235554102 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7f9ffffff640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0000d3310 0x7fa0001f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa0052c0640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa00015e660 0x7fa0001611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa004abf640 1 -- 172.21.15.60:0/3235554102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa00015e660 msgr2=0x7fa0001611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa004abf640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa00015e660 0x7fa0001611e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa004abf640 1 -- 172.21.15.60:0/3235554102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0000d3310 msgr2=0x7fa0001f7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa004abf640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0000d3310 0x7fa0001f7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa004abf640 1 -- 172.21.15.60:0/3235554102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0001f8bd0 con 0x7fa0000d1650 2024-09-12T01:44:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa004abf640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0000d1650 0x7fa0001f8690 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4000c00 tx=0x7f9ff40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7f9ffd7fa640 1 -- 172.21.15.60:0/3235554102 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4037040 con 0x7fa0000d1650 2024-09-12T01:44:20.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7f9ffd7fa640 1 -- 172.21.15.60:0/3235554102 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ff4042070 con 0x7fa0000d1650 2024-09-12T01:44:20.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa006d23640 1 -- 172.21.15.60:0/3235554102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00015fea0 con 0x7fa0000d1650 2024-09-12T01:44:20.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7f9ffd7fa640 1 -- 172.21.15.60:0/3235554102 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4030880 con 0x7fa0000d1650 2024-09-12T01:44:20.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.642+0000 7fa006d23640 1 -- 172.21.15.60:0/3235554102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa000160700 con 0x7fa0000d1650 2024-09-12T01:44:20.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.643+0000 7fa006d23640 1 -- 172.21.15.60:0/3235554102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0000d1110 con 0x7fa0000d1650 2024-09-12T01:44:20.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.644+0000 7f9ffd7fa640 1 -- 172.21.15.60:0/3235554102 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f9ff4030a20 con 0x7fa0000d1650 2024-09-12T01:44:20.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.644+0000 7f9ffd7fa640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9fe406be30 0x7f9fe406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.645+0000 7f9ffd7fa640 1 -- 172.21.15.60:0/3235554102 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f9ff40ab660 con 0x7fa0000d1650 2024-09-12T01:44:20.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.645+0000 7f9ffffff640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9fe406be30 0x7f9fe406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.645+0000 7f9ffffff640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9fe406be30 0x7f9fe406e2f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa000152fe0 tx=0x7f9fec009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:20.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.649+0000 7f9ffd7fa640 1 -- 172.21.15.60:0/3235554102 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa0001f8bd0 con 0x7fa0000d1650 2024-09-12T01:44:20.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.826+0000 7fa006d23640 1 -- 172.21.15.60:0/3235554102 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa00015b180 con 0x7fa0000d1650 2024-09-12T01:44:20.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.827+0000 7f9ffd7fa640 1 -- 172.21.15.60:0/3235554102 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16703 (secure 0 0 0) 0x7f9ff40800c0 con 0x7fa0000d1650 2024-09-12T01:44:20.829 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:20.830 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":128,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:43:53.182832+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:43:49.197828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-12T01:43:50.544112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:44:20.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.829+0000 7fa006d23640 1 -- 172.21.15.60:0/3235554102 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9fe406be30 msgr2=0x7f9fe406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.829+0000 7fa006d23640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9fe406be30 0x7f9fe406e2f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa000152fe0 tx=0x7f9fec009190 comp rx=0 tx=0).stop 2024-09-12T01:44:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.829+0000 7fa006d23640 1 -- 172.21.15.60:0/3235554102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0000d1650 msgr2=0x7fa0001f8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.829+0000 7fa006d23640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0000d1650 0x7fa0001f8690 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4000c00 tx=0x7f9ff40046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.829+0000 7fa006d23640 1 -- 172.21.15.60:0/3235554102 shutdown_connections 2024-09-12T01:44:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.829+0000 7fa006d23640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f9fe406be30 0x7f9fe406e2f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.829+0000 7fa006d23640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa00015e660 0x7fa0001611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.829+0000 7fa006d23640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0000d3310 0x7fa0001f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.829+0000 7fa006d23640 1 --2- 172.21.15.60:0/3235554102 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0000d1650 0x7fa0001f8690 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.829+0000 7fa006d23640 1 -- 172.21.15.60:0/3235554102 >> 172.21.15.60:0/3235554102 conn(0x7fa0000b6410 msgr2=0x7fa0000b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.829+0000 7fa006d23640 1 -- 172.21.15.60:0/3235554102 shutdown_connections 2024-09-12T01:44:20.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.829+0000 7fa006d23640 1 -- 172.21.15.60:0/3235554102 wait complete. 2024-09-12T01:44:20.841 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:44:20.841 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:20.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.943+0000 7f4cf123c640 1 Processor -- start 2024-09-12T01:44:20.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.943+0000 7f4cf123c640 1 -- start start 2024-09-12T01:44:20.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4cf123c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cec15c2b0 0x7f4cec0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4cf123c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cec15fb10 con 0x7f4cec0b72f0 2024-09-12T01:44:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4cf123c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cec0b5900 con 0x7f4cec15f200 2024-09-12T01:44:20.946 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4cf123c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4cec15f830 con 0x7f4cec15c2b0 2024-09-12T01:44:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4ce3fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4cec0b72f0 0x7f4cec15eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60360/0 (socket says 172.21.15.60:60360) 2024-09-12T01:44:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4ce3fff640 1 -- 172.21.15.60:0/172231403 learned_addr learned my addr 172.21.15.60:0/172231403 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4cead9d640 1 --2- 172.21.15.60:0/172231403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cec15c2b0 0x7f4cec0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4cea59c640 1 -- 172.21.15.60:0/172231403 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1818181457 0 0) 0x7f4cec15fb10 con 0x7f4cec0b72f0 2024-09-12T01:44:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4cea59c640 1 -- 172.21.15.60:0/172231403 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cd8003520 con 0x7f4cec0b72f0 2024-09-12T01:44:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4cea59c640 1 -- 172.21.15.60:0/172231403 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3662561946 0 0) 0x7f4cec0b5900 con 0x7f4cec15f200 2024-09-12T01:44:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4cea59c640 1 -- 172.21.15.60:0/172231403 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cec15fb10 con 0x7f4cec15f200 2024-09-12T01:44:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4cead9d640 1 -- 172.21.15.60:0/172231403 >> v1:172.21.15.105:6789/0 conn(0x7f4cec15f200 legacy=0x7f4cec06d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4cead9d640 1 -- 172.21.15.60:0/172231403 >> v1:172.21.15.60:6789/0 conn(0x7f4cec0b72f0 legacy=0x7f4cec15eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.944+0000 7f4cead9d640 1 -- 172.21.15.60:0/172231403 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cec06ce30 con 0x7f4cec15c2b0 2024-09-12T01:44:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.945+0000 7f4cead9d640 1 --2- 172.21.15.60:0/172231403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cec15c2b0 0x7f4cec0b6db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0097d0 tx=0x7f4cdc02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65072a675ec6a6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.945+0000 7f4cea59c640 1 -- 172.21.15.60:0/172231403 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc037070 con 0x7f4cec15c2b0 2024-09-12T01:44:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.945+0000 7f4cea59c640 1 -- 172.21.15.60:0/172231403 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cdc032440 con 0x7f4cec15c2b0 2024-09-12T01:44:20.948 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.945+0000 7f4cea59c640 1 -- 172.21.15.60:0/172231403 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc0327f0 con 0x7f4cec15c2b0 2024-09-12T01:44:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.946+0000 7f4cf123c640 1 -- 172.21.15.60:0/172231403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cec15c2b0 msgr2=0x7f4cec0b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.946+0000 7f4cf123c640 1 --2- 172.21.15.60:0/172231403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cec15c2b0 0x7f4cec0b6db0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0097d0 tx=0x7f4cdc02a210 comp rx=0 tx=0).stop 2024-09-12T01:44:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.946+0000 7f4cf123c640 1 -- 172.21.15.60:0/172231403 shutdown_connections 2024-09-12T01:44:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.946+0000 7f4cf123c640 1 --2- 172.21.15.60:0/172231403 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cec15c2b0 0x7f4cec0b6db0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.946+0000 7f4cf123c640 1 -- 172.21.15.60:0/172231403 >> 172.21.15.60:0/172231403 conn(0x7f4cec0b4240 msgr2=0x7f4cec0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.946+0000 7f4cf123c640 1 -- 172.21.15.60:0/172231403 shutdown_connections 2024-09-12T01:44:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.946+0000 7f4cf123c640 1 -- 172.21.15.60:0/172231403 wait complete. 2024-09-12T01:44:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.947+0000 7f4cf123c640 1 Processor -- start 2024-09-12T01:44:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.947+0000 7f4cf123c640 1 -- start start 2024-09-12T01:44:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4cf123c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec0b72f0 0x7f4cec1524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4cf123c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cec15c2b0 0x7f4cec156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4cf123c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cec15f200 0x7f4cec154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4cf123c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4cec0b7730 con 0x7f4cec15f200 2024-09-12T01:44:20.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4cf123c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4cec06d3f0 con 0x7f4cec0b72f0 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4cf123c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4cec06e020 con 0x7f4cec15c2b0 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4ceb59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cec15f200 0x7f4cec154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4ce3fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cec15c2b0 0x7f4cec156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4cead9d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec0b72f0 0x7f4cec1524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4ceb59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cec15f200 0x7f4cec154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40940/0 (socket says 172.21.15.60:40940) 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4ceb59e640 1 -- 172.21.15.60:0/2003706234 learned_addr learned my addr 172.21.15.60:0/2003706234 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4ceb59e640 1 -- 172.21.15.60:0/2003706234 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cec15c2b0 msgr2=0x7f4cec156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4ceb59e640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cec15c2b0 0x7f4cec156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4ceb59e640 1 -- 172.21.15.60:0/2003706234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec0b72f0 msgr2=0x7f4cec1524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4ceb59e640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec0b72f0 0x7f4cec1524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4ceb59e640 1 -- 172.21.15.60:0/2003706234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cec1574a0 con 0x7f4cec15f200 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.948+0000 7f4cead9d640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec0b72f0 0x7f4cec1524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.949+0000 7f4ceb59e640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cec15f200 0x7f4cec154fc0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c6e0 tx=0x7f4ce400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:20.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.949+0000 7f4ce37fe640 1 -- 172.21.15.60:0/2003706234 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4003b70 con 0x7f4cec15f200 2024-09-12T01:44:20.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.949+0000 7f4ce37fe640 1 -- 172.21.15.60:0/2003706234 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce4003d10 con 0x7f4cec15f200 2024-09-12T01:44:20.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.949+0000 7f4cf123c640 1 -- 172.21.15.60:0/2003706234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cec157780 con 0x7f4cec15f200 2024-09-12T01:44:20.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.949+0000 7f4ce37fe640 1 -- 172.21.15.60:0/2003706234 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce40052d0 con 0x7f4cec15f200 2024-09-12T01:44:20.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.949+0000 7f4cf123c640 1 -- 172.21.15.60:0/2003706234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cec157d40 con 0x7f4cec15f200 2024-09-12T01:44:20.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.950+0000 7f4cf123c640 1 -- 172.21.15.60:0/2003706234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cec0b6db0 con 0x7f4cec15f200 2024-09-12T01:44:20.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.950+0000 7f4ce37fe640 1 -- 172.21.15.60:0/2003706234 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4ce4005470 con 0x7f4cec15f200 2024-09-12T01:44:20.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.951+0000 7f4ce37fe640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ccc06be30 0x7f4ccc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:20.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.951+0000 7f4ce37fe640 1 -- 172.21.15.60:0/2003706234 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7f4ce408ab70 con 0x7f4cec15f200 2024-09-12T01:44:20.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.951+0000 7f4cead9d640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ccc06be30 0x7f4ccc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:20.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.951+0000 7f4cead9d640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ccc06be30 0x7f4ccc06e2f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc034000 tx=0x7f4cdc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:20.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:20.955+0000 7f4ce37fe640 1 -- 172.21.15.60:0/2003706234 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4ce4058f60 con 0x7f4cec15f200 2024-09-12T01:44:21.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.168+0000 7f4cf123c640 1 -- 172.21.15.60:0/2003706234 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cec0b3c80 con 0x7f4cec15f200 2024-09-12T01:44:21.172 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.169+0000 7f4ce37fe640 1 -- 172.21.15.60:0/2003706234 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5230 (secure 0 0 0) 0x7f4ce405d260 con 0x7f4cec15f200 2024-09-12T01:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:21.173 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":81,"btime":"2024-09-12T01:44:13:036586+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/152127841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":152127841},{"type":"v1","addr":"172.21.15.60:6836","nonce":152127841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7234,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2154123948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2154123948},{"type":"v1","addr":"172.21.15.105:6835","nonce":2154123948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1634496909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1634496909},{"type":"v1","addr":"172.21.15.60:6837","nonce":1634496909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:51.547779+0000","modified":"2024-09-12T01:44:12.213628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6834/2888550162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2888550162},{"type":"v1","addr":"172.21.15.105:6834","nonce":2888550162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7989,"qdb_cluster":[7989]},"id":10}]} 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 81 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.171+0000 7f4cf123c640 1 -- 172.21.15.60:0/2003706234 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ccc06be30 msgr2=0x7f4ccc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.171+0000 7f4cf123c640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ccc06be30 0x7f4ccc06e2f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc034000 tx=0x7f4cdc02e000 comp rx=0 tx=0).stop 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.171+0000 7f4cf123c640 1 -- 172.21.15.60:0/2003706234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cec15f200 msgr2=0x7f4cec154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.171+0000 7f4cf123c640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cec15f200 0x7f4cec154fc0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c6e0 tx=0x7f4ce400cba0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.171+0000 7f4cf123c640 1 -- 172.21.15.60:0/2003706234 shutdown_connections 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.171+0000 7f4cf123c640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4cec15f200 0x7f4cec154fc0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.171+0000 7f4cf123c640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ccc06be30 0x7f4ccc06e2f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.171+0000 7f4cf123c640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cec15c2b0 0x7f4cec156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.171+0000 7f4cf123c640 1 --2- 172.21.15.60:0/2003706234 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4cec0b72f0 0x7f4cec1524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.171+0000 7f4cf123c640 1 -- 172.21.15.60:0/2003706234 >> 172.21.15.60:0/2003706234 conn(0x7f4cec0b4240 msgr2=0x7f4cec0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.171+0000 7f4cf123c640 1 -- 172.21.15.60:0/2003706234 shutdown_connections 2024-09-12T01:44:21.174 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.171+0000 7f4cf123c640 1 -- 172.21.15.60:0/2003706234 wait complete. 2024-09-12T01:44:21.183 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:21.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.284+0000 7fe0773bd640 1 Processor -- start 2024-09-12T01:44:21.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.284+0000 7fe0773bd640 1 -- start start 2024-09-12T01:44:21.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.285+0000 7fe0773bd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe070155800 0x7fe0700b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.285+0000 7fe0773bd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe07015c330 0x7fe0700b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.285+0000 7fe0773bd640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0700b50a0 con 0x7fe0700cf570 2024-09-12T01:44:21.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.285+0000 7fe0773bd640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe0700b4e60 con 0x7fe070155800 2024-09-12T01:44:21.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.285+0000 7fe0773bd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe07015c7a0 con 0x7fe07015c330 2024-09-12T01:44:21.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.285+0000 7fe074958640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe07015c330 0x7fe0700b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.285+0000 7fe075159640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe070155800 0x7fe0700b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.285+0000 7fe07595a640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fe0700cf570 0x7fe07015c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:52334/0 (socket says 172.21.15.60:52334) 2024-09-12T01:44:21.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.285+0000 7fe07595a640 1 -- 172.21.15.60:0/1267490640 learned_addr learned my addr 172.21.15.60:0/1267490640 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:21.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.285+0000 7fe074958640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe07015c330 0x7fe0700b4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:36792/0 (socket says 172.21.15.60:36792) 2024-09-12T01:44:21.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.286+0000 7fe074958640 1 -- 172.21.15.60:0/1267490640 >> v2:172.21.15.105:3300/0 conn(0x7fe070155800 msgr2=0x7fe0700b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:21.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.286+0000 7fe074958640 1 --2- 172.21.15.60:0/1267490640 >> v2:172.21.15.105:3300/0 conn(0x7fe070155800 0x7fe0700b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.286+0000 7fe074958640 1 -- 172.21.15.60:0/1267490640 >> v1:172.21.15.105:6789/0 conn(0x7fe0700cf570 legacy=0x7fe07015c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.286+0000 7fe074958640 1 -- 172.21.15.60:0/1267490640 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0700b5380 con 0x7fe07015c330 2024-09-12T01:44:21.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.287+0000 7fe074958640 1 --2- 172.21.15.60:0/1267490640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe07015c330 0x7fe0700b4920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe0640097a0 tx=0x7fe06402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20598e0a2d92d15f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:21.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.287+0000 7fe06ffff640 1 -- 172.21.15.60:0/1267490640 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064037070 con 0x7fe07015c330 2024-09-12T01:44:21.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.287+0000 7fe06ffff640 1 -- 172.21.15.60:0/1267490640 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe064032440 con 0x7fe07015c330 2024-09-12T01:44:21.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.287+0000 7fe06ffff640 1 -- 172.21.15.60:0/1267490640 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064032810 con 0x7fe07015c330 2024-09-12T01:44:21.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.287+0000 7fe0773bd640 1 -- 172.21.15.60:0/1267490640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe07015c330 msgr2=0x7fe0700b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.287+0000 7fe0773bd640 1 --2- 172.21.15.60:0/1267490640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe07015c330 0x7fe0700b4920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe0640097a0 tx=0x7fe06402a180 comp rx=0 tx=0).stop 2024-09-12T01:44:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.287+0000 7fe0773bd640 1 -- 172.21.15.60:0/1267490640 shutdown_connections 2024-09-12T01:44:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.287+0000 7fe0773bd640 1 --2- 172.21.15.60:0/1267490640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe07015c330 0x7fe0700b4920 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.287+0000 7fe0773bd640 1 --2- 172.21.15.60:0/1267490640 >> v2:172.21.15.105:3300/0 conn(0x7fe070155800 0x7fe0700b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.287+0000 7fe0773bd640 1 -- 172.21.15.60:0/1267490640 >> 172.21.15.60:0/1267490640 conn(0x7fe07006bc10 msgr2=0x7fe07006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.287+0000 7fe0773bd640 1 -- 172.21.15.60:0/1267490640 shutdown_connections 2024-09-12T01:44:21.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.287+0000 7fe0773bd640 1 -- 172.21.15.60:0/1267490640 wait complete. 2024-09-12T01:44:21.291 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.288+0000 7fe0773bd640 1 Processor -- start 2024-09-12T01:44:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.289+0000 7fe0773bd640 1 -- start start 2024-09-12T01:44:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.289+0000 7fe0773bd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0700cf570 0x7fe0701f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.289+0000 7fe0773bd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe070155800 0x7fe07014cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.289+0000 7fe0773bd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07015c330 0x7fe0700723d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.289+0000 7fe0773bd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe0700b5c20 con 0x7fe07015c330 2024-09-12T01:44:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.289+0000 7fe0773bd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe0700b5940 con 0x7fe0700cf570 2024-09-12T01:44:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.289+0000 7fe0773bd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe070155be0 con 0x7fe070155800 2024-09-12T01:44:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.289+0000 7fe07595a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07015c330 0x7fe0700723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe07595a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07015c330 0x7fe0700723d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40946/0 (socket says 172.21.15.60:40946) 2024-09-12T01:44:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe07595a640 1 -- 172.21.15.60:0/1847556737 learned_addr learned my addr 172.21.15.60:0/1847556737 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe075159640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0700cf570 0x7fe0701f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe074958640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe070155800 0x7fe07014cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe07595a640 1 -- 172.21.15.60:0/1847556737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe070155800 msgr2=0x7fe07014cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe07595a640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe070155800 0x7fe07014cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe07595a640 1 -- 172.21.15.60:0/1847556737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0700cf570 msgr2=0x7fe0701f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe07595a640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0700cf570 0x7fe0701f40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe07595a640 1 -- 172.21.15.60:0/1847556737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe070153800 con 0x7fe07015c330 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe074958640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe070155800 0x7fe07014cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe075159640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0700cf570 0x7fe0701f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe07595a640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07015c330 0x7fe0700723d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fe06000ca70 tx=0x7fe06000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe06dffb640 1 -- 172.21.15.60:0/1847556737 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060017070 con 0x7fe07015c330 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe06dffb640 1 -- 172.21.15.60:0/1847556737 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe06000ab70 con 0x7fe07015c330 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe06dffb640 1 -- 172.21.15.60:0/1847556737 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060012400 con 0x7fe07015c330 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.290+0000 7fe0773bd640 1 -- 172.21.15.60:0/1847556737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe070158da0 con 0x7fe07015c330 2024-09-12T01:44:21.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.291+0000 7fe0773bd640 1 -- 172.21.15.60:0/1847556737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe070153ac0 con 0x7fe07015c330 2024-09-12T01:44:21.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.292+0000 7fe0773bd640 1 -- 172.21.15.60:0/1847556737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0700cd9e0 con 0x7fe07015c330 2024-09-12T01:44:21.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.292+0000 7fe06dffb640 1 -- 172.21.15.60:0/1847556737 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe06001a070 con 0x7fe07015c330 2024-09-12T01:44:21.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.292+0000 7fe06dffb640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe05c06be30 0x7fe05c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.293+0000 7fe06dffb640 1 -- 172.21.15.60:0/1847556737 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fe06008aab0 con 0x7fe07015c330 2024-09-12T01:44:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.293+0000 7fe075159640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe05c06be30 0x7fe05c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.293+0000 7fe075159640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe05c06be30 0x7fe05c06e2f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe068009b90 tx=0x7fe068008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:21.297 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.297+0000 7fe06dffb640 1 -- 172.21.15.60:0/1847556737 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0700cd9e0 con 0x7fe07015c330 2024-09-12T01:44:21.512 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.512+0000 7fe0773bd640 1 -- 172.21.15.60:0/1847556737 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0700b6140 con 0x7fe07015c330 2024-09-12T01:44:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.512+0000 7fe06dffb640 1 -- 172.21.15.60:0/1847556737 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5230 (secure 0 0 0) 0x7fe060058d00 con 0x7fe07015c330 2024-09-12T01:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:21.513 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":81,"btime":"2024-09-12T01:44:13:036586+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/152127841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":152127841},{"type":"v1","addr":"172.21.15.60:6836","nonce":152127841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7234,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2154123948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2154123948},{"type":"v1","addr":"172.21.15.105:6835","nonce":2154123948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1634496909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1634496909},{"type":"v1","addr":"172.21.15.60:6837","nonce":1634496909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:43:51.547779+0000","modified":"2024-09-12T01:44:12.213628+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7989},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7989":{"gid":7989,"name":"b","rank":0,"incarnation":77,"state":"up:active","state_seq":8,"addr":"172.21.15.105:6834/2888550162","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":2888550162},{"type":"v1","addr":"172.21.15.105:6834","nonce":2888550162}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7989,"qdb_cluster":[7989]},"id":10}]} 2024-09-12T01:44:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 81 2024-09-12T01:44:21.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.515+0000 7fe0773bd640 1 -- 172.21.15.60:0/1847556737 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe05c06be30 msgr2=0x7fe05c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.515+0000 7fe0773bd640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe05c06be30 0x7fe05c06e2f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe068009b90 tx=0x7fe068008040 comp rx=0 tx=0).stop 2024-09-12T01:44:21.515 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.515+0000 7fe0773bd640 1 -- 172.21.15.60:0/1847556737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07015c330 msgr2=0x7fe0700723d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.515+0000 7fe0773bd640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07015c330 0x7fe0700723d0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fe06000ca70 tx=0x7fe06000cf30 comp rx=0 tx=0).stop 2024-09-12T01:44:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.515+0000 7fe0773bd640 1 -- 172.21.15.60:0/1847556737 shutdown_connections 2024-09-12T01:44:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.515+0000 7fe0773bd640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07015c330 0x7fe0700723d0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.515+0000 7fe0773bd640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe05c06be30 0x7fe05c06e2f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.515+0000 7fe0773bd640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe070155800 0x7fe07014cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.515+0000 7fe0773bd640 1 --2- 172.21.15.60:0/1847556737 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0700cf570 0x7fe0701f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.515+0000 7fe0773bd640 1 -- 172.21.15.60:0/1847556737 >> 172.21.15.60:0/1847556737 conn(0x7fe07006bc10 msgr2=0x7fe0700b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.515+0000 7fe0773bd640 1 -- 172.21.15.60:0/1847556737 shutdown_connections 2024-09-12T01:44:21.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.515+0000 7fe0773bd640 1 -- 172.21.15.60:0/1847556737 wait complete. 2024-09-12T01:44:21.526 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:44:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.627+0000 7fc81a78d640 1 Processor -- start 2024-09-12T01:44:21.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.627+0000 7fc81a78d640 1 -- start start 2024-09-12T01:44:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.628+0000 7fc81a78d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc8140b74c0 0x7fc81415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.628+0000 7fc81a78d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc81415f030 0x7fc81406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.628+0000 7fc81a78d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc81415fb10 con 0x7fc81415c2b0 2024-09-12T01:44:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.628+0000 7fc81a78d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc8140b5900 con 0x7fc81415f030 2024-09-12T01:44:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.628+0000 7fc81a78d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc81415f830 con 0x7fc8140b74c0 2024-09-12T01:44:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.628+0000 7fc818d2a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc81415f030 0x7fc81406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.628+0000 7fc818d2a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc81415f030 0x7fc81406d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40948/0 (socket says 172.21.15.60:40948) 2024-09-12T01:44:21.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.628+0000 7fc818d2a640 1 -- 172.21.15.60:0/1157258428 learned_addr learned my addr 172.21.15.60:0/1157258428 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:21.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.629+0000 7fc8137fe640 1 --2- 172.21.15.60:0/1157258428 >> v2:172.21.15.105:3300/0 conn(0x7fc8140b74c0 0x7fc81415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.629+0000 7fc818d2a640 1 -- 172.21.15.60:0/1157258428 >> v2:172.21.15.105:3300/0 conn(0x7fc8140b74c0 msgr2=0x7fc81415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:21.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.629+0000 7fc818d2a640 1 --2- 172.21.15.60:0/1157258428 >> v2:172.21.15.105:3300/0 conn(0x7fc8140b74c0 0x7fc81415eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.629+0000 7fc818d2a640 1 -- 172.21.15.60:0/1157258428 >> v1:172.21.15.105:6789/0 conn(0x7fc81415c2b0 legacy=0x7fc8140b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.629+0000 7fc818d2a640 1 -- 172.21.15.60:0/1157258428 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81406ce30 con 0x7fc81415f030 2024-09-12T01:44:21.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.629+0000 7fc818d2a640 1 --2- 172.21.15.60:0/1157258428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc81415f030 0x7fc81406d910 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fc814071d10 tx=0x7fc80c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486b6a3d666b7f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:21.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.630+0000 7fc812ffd640 1 -- 172.21.15.60:0/1157258428 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c036070 con 0x7fc81415f030 2024-09-12T01:44:21.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.630+0000 7fc812ffd640 1 -- 172.21.15.60:0/1157258428 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80c031600 con 0x7fc81415f030 2024-09-12T01:44:21.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.630+0000 7fc812ffd640 1 -- 172.21.15.60:0/1157258428 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c0319d0 con 0x7fc81415f030 2024-09-12T01:44:21.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.630+0000 7fc81a78d640 1 -- 172.21.15.60:0/1157258428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc81415f030 msgr2=0x7fc81406d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.630+0000 7fc81a78d640 1 --2- 172.21.15.60:0/1157258428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc81415f030 0x7fc81406d910 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fc814071d10 tx=0x7fc80c02a730 comp rx=0 tx=0).stop 2024-09-12T01:44:21.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.630+0000 7fc81a78d640 1 -- 172.21.15.60:0/1157258428 shutdown_connections 2024-09-12T01:44:21.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.630+0000 7fc81a78d640 1 --2- 172.21.15.60:0/1157258428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc81415f030 0x7fc81406d910 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.630+0000 7fc81a78d640 1 --2- 172.21.15.60:0/1157258428 >> v2:172.21.15.105:3300/0 conn(0x7fc8140b74c0 0x7fc81415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.630+0000 7fc81a78d640 1 -- 172.21.15.60:0/1157258428 >> 172.21.15.60:0/1157258428 conn(0x7fc8140b4240 msgr2=0x7fc8140b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:21.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.630+0000 7fc81a78d640 1 -- 172.21.15.60:0/1157258428 shutdown_connections 2024-09-12T01:44:21.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.630+0000 7fc81a78d640 1 -- 172.21.15.60:0/1157258428 wait complete. 2024-09-12T01:44:21.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.631+0000 7fc81a78d640 1 Processor -- start 2024-09-12T01:44:21.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.632+0000 7fc81a78d640 1 -- start start 2024-09-12T01:44:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.632+0000 7fc81a78d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8140b74c0 0x7fc8141f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.632+0000 7fc81a78d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc81415c2b0 0x7fc8140cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.632+0000 7fc81a78d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc81415f030 0x7fc814158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.632+0000 7fc81a78d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc81415f480 con 0x7fc81415f030 2024-09-12T01:44:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.632+0000 7fc81a78d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc81406d3f0 con 0x7fc81415c2b0 2024-09-12T01:44:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.632+0000 7fc81a78d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc8140d0290 con 0x7fc8140b74c0 2024-09-12T01:44:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.632+0000 7fc818d2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc81415f030 0x7fc814158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.632+0000 7fc818d2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc81415f030 0x7fc814158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40952/0 (socket says 172.21.15.60:40952) 2024-09-12T01:44:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.632+0000 7fc818d2a640 1 -- 172.21.15.60:0/182625652 learned_addr learned my addr 172.21.15.60:0/182625652 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.632+0000 7fc8137fe640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc81415c2b0 0x7fc8140cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.632+0000 7fc813fff640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8140b74c0 0x7fc8141f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.633+0000 7fc818d2a640 1 -- 172.21.15.60:0/182625652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8140b74c0 msgr2=0x7fc8141f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.633+0000 7fc818d2a640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8140b74c0 0x7fc8141f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.633+0000 7fc818d2a640 1 -- 172.21.15.60:0/182625652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc81415c2b0 msgr2=0x7fc8140cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.633+0000 7fc818d2a640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc81415c2b0 0x7fc8140cf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.633+0000 7fc818d2a640 1 -- 172.21.15.60:0/182625652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8140cb8c0 con 0x7fc81415f030 2024-09-12T01:44:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.633+0000 7fc818d2a640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc81415f030 0x7fc814158660 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009f40 tx=0x7fc80c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.633+0000 7fc810ff9640 1 -- 172.21.15.60:0/182625652 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c036050 con 0x7fc81415f030 2024-09-12T01:44:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.633+0000 7fc810ff9640 1 -- 172.21.15.60:0/182625652 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80c042070 con 0x7fc81415f030 2024-09-12T01:44:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.633+0000 7fc81a78d640 1 -- 172.21.15.60:0/182625652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8140cbba0 con 0x7fc81415f030 2024-09-12T01:44:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.633+0000 7fc810ff9640 1 -- 172.21.15.60:0/182625652 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c009510 con 0x7fc81415f030 2024-09-12T01:44:21.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.633+0000 7fc81a78d640 1 -- 172.21.15.60:0/182625652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8140cc160 con 0x7fc81415f030 2024-09-12T01:44:21.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.634+0000 7fc81a78d640 1 -- 172.21.15.60:0/182625652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc81415eaf0 con 0x7fc81415f030 2024-09-12T01:44:21.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.635+0000 7fc810ff9640 1 -- 172.21.15.60:0/182625652 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc80c007bf0 con 0x7fc81415f030 2024-09-12T01:44:21.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.635+0000 7fc810ff9640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc80006be30 0x7fc80006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.635+0000 7fc810ff9640 1 -- 172.21.15.60:0/182625652 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fc80c0aba60 con 0x7fc81415f030 2024-09-12T01:44:21.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.635+0000 7fc813fff640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc80006be30 0x7fc80006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.636+0000 7fc813fff640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc80006be30 0x7fc80006e2f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc804001780 tx=0x7fc804009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:21.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.640+0000 7fc810ff9640 1 -- 172.21.15.60:0/182625652 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc80c079dd0 con 0x7fc81415f030 2024-09-12T01:44:21.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.816+0000 7fc81a78d640 1 -- 172.21.15.60:0/182625652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8140693c0 con 0x7fc81415f030 2024-09-12T01:44:21.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.818+0000 7fc810ff9640 1 -- 172.21.15.60:0/182625652 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16703 (secure 0 0 0) 0x7fc80c07e0d0 con 0x7fc81415f030 2024-09-12T01:44:21.818 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:21.818 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":128,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:43:53.182832+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:43:49.197828+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"127","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-12T01:43:50.544112+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:44:21.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.820+0000 7fc81a78d640 1 -- 172.21.15.60:0/182625652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc80006be30 msgr2=0x7fc80006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.820+0000 7fc81a78d640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc80006be30 0x7fc80006e2f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fc804001780 tx=0x7fc804009040 comp rx=0 tx=0).stop 2024-09-12T01:44:21.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.820+0000 7fc81a78d640 1 -- 172.21.15.60:0/182625652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc81415f030 msgr2=0x7fc814158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.820+0000 7fc81a78d640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc81415f030 0x7fc814158660 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009f40 tx=0x7fc80c004a40 comp rx=0 tx=0).stop 2024-09-12T01:44:21.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.820+0000 7fc81a78d640 1 -- 172.21.15.60:0/182625652 shutdown_connections 2024-09-12T01:44:21.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.820+0000 7fc81a78d640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc81415f030 0x7fc814158660 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.820+0000 7fc81a78d640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc81415c2b0 0x7fc8140cf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.820+0000 7fc81a78d640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc80006be30 0x7fc80006e2f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.820+0000 7fc81a78d640 1 --2- 172.21.15.60:0/182625652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8140b74c0 0x7fc8141f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.820+0000 7fc81a78d640 1 -- 172.21.15.60:0/182625652 >> 172.21.15.60:0/182625652 conn(0x7fc8140b4240 msgr2=0x7fc81415db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:21.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.820+0000 7fc81a78d640 1 -- 172.21.15.60:0/182625652 shutdown_connections 2024-09-12T01:44:21.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.820+0000 7fc81a78d640 1 -- 172.21.15.60:0/182625652 wait complete. 2024-09-12T01:44:21.832 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:44:21.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.935+0000 7fbe718c9640 1 Processor -- start 2024-09-12T01:44:21.935 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.935+0000 7fbe718c9640 1 -- start start 2024-09-12T01:44:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.935+0000 7fbe718c9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbe6c06fba0 0x7fbe6c06c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.935+0000 7fbe718c9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe6c070010 con 0x7fbe6c06f710 2024-09-12T01:44:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.936+0000 7fbe718c9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe6c074120 con 0x7fbe6c15c2a0 2024-09-12T01:44:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.936+0000 7fbe718c9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbe6c15c680 con 0x7fbe6c06fba0 2024-09-12T01:44:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.936+0000 7fbe6a7fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbe6c06f710 0x7fbe6c06bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60370/0 (socket says 172.21.15.60:60370) 2024-09-12T01:44:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.936+0000 7fbe6a7fc640 1 -- 172.21.15.60:0/2280890882 learned_addr learned my addr 172.21.15.60:0/2280890882 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.936+0000 7fbe6b7fe640 1 --2- 172.21.15.60:0/2280890882 >> v2:172.21.15.105:3300/0 conn(0x7fbe6c06fba0 0x7fbe6c06c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.936+0000 7fbe69ffb640 1 -- 172.21.15.60:0/2280890882 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 882091210 0 0) 0x7fbe6c070010 con 0x7fbe6c06f710 2024-09-12T01:44:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.936+0000 7fbe69ffb640 1 -- 172.21.15.60:0/2280890882 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe54003520 con 0x7fbe6c06f710 2024-09-12T01:44:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.936+0000 7fbe6b7fe640 1 -- 172.21.15.60:0/2280890882 >> v1:172.21.15.105:6789/0 conn(0x7fbe6c15c2a0 legacy=0x7fbe6c0735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.936+0000 7fbe69ffb640 1 -- 172.21.15.60:0/2280890882 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1534415060 0 0) 0x7fbe6c074120 con 0x7fbe6c15c2a0 2024-09-12T01:44:21.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.936+0000 7fbe6b7fe640 1 -- 172.21.15.60:0/2280890882 >> v1:172.21.15.60:6789/0 conn(0x7fbe6c06f710 legacy=0x7fbe6c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.936+0000 7fbe6b7fe640 1 -- 172.21.15.60:0/2280890882 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6c15ef00 con 0x7fbe6c06fba0 2024-09-12T01:44:21.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.937+0000 7fbe6b7fe640 1 --2- 172.21.15.60:0/2280890882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6c06fba0 0x7fbe6c06c320 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbe64009d90 tx=0x7fbe6402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50ffb20a42416e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:21.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.937+0000 7fbe69ffb640 1 -- 172.21.15.60:0/2280890882 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64007740 con 0x7fbe6c06fba0 2024-09-12T01:44:21.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.937+0000 7fbe69ffb640 1 -- 172.21.15.60:0/2280890882 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe640078e0 con 0x7fbe6c06fba0 2024-09-12T01:44:21.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.937+0000 7fbe69ffb640 1 -- 172.21.15.60:0/2280890882 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64007c90 con 0x7fbe6c06fba0 2024-09-12T01:44:21.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.938+0000 7fbe718c9640 1 -- 172.21.15.60:0/2280890882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6c06fba0 msgr2=0x7fbe6c06c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.938+0000 7fbe718c9640 1 --2- 172.21.15.60:0/2280890882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6c06fba0 0x7fbe6c06c320 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fbe64009d90 tx=0x7fbe6402a6f0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.938+0000 7fbe718c9640 1 -- 172.21.15.60:0/2280890882 shutdown_connections 2024-09-12T01:44:21.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.938+0000 7fbe718c9640 1 --2- 172.21.15.60:0/2280890882 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6c06fba0 0x7fbe6c06c320 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.938+0000 7fbe718c9640 1 -- 172.21.15.60:0/2280890882 >> 172.21.15.60:0/2280890882 conn(0x7fbe6c0b3070 msgr2=0x7fbe6c0b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:21.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.938+0000 7fbe718c9640 1 -- 172.21.15.60:0/2280890882 shutdown_connections 2024-09-12T01:44:21.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.938+0000 7fbe718c9640 1 -- 172.21.15.60:0/2280890882 wait complete. 2024-09-12T01:44:21.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.939+0000 7fbe718c9640 1 Processor -- start 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.939+0000 7fbe718c9640 1 -- start start 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe718c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe6c06f710 0x7fbe6c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe718c9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6c06fba0 0x7fbe6c14ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe718c9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6c15c2a0 0x7fbe6c0cf640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe718c9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c15ebf0 con 0x7fbe6c06f710 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe718c9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c15f4c0 con 0x7fbe6c06fba0 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe718c9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbe6c0b5f20 con 0x7fbe6c15c2a0 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe6affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe6c06f710 0x7fbe6c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe6affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe6c06f710 0x7fbe6c0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40964/0 (socket says 172.21.15.60:40964) 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe6affd640 1 -- 172.21.15.60:0/1251993125 learned_addr learned my addr 172.21.15.60:0/1251993125 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe6a7fc640 1 --2- 172.21.15.60:0/1251993125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6c06fba0 0x7fbe6c14ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe6b7fe640 1 --2- 172.21.15.60:0/1251993125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6c15c2a0 0x7fbe6c0cf640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe6affd640 1 -- 172.21.15.60:0/1251993125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6c15c2a0 msgr2=0x7fbe6c0cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.942 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe6affd640 1 --2- 172.21.15.60:0/1251993125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6c15c2a0 0x7fbe6c0cf640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe6affd640 1 -- 172.21.15.60:0/1251993125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6c06fba0 msgr2=0x7fbe6c14ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe6affd640 1 --2- 172.21.15.60:0/1251993125 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbe6c06fba0 0x7fbe6c14ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe6affd640 1 -- 172.21.15.60:0/1251993125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6c0ce5a0 con 0x7fbe6c06f710 2024-09-12T01:44:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.940+0000 7fbe6b7fe640 1 --2- 172.21.15.60:0/1251993125 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbe6c15c2a0 0x7fbe6c0cf640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.941+0000 7fbe6affd640 1 --2- 172.21.15.60:0/1251993125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe6c06f710 0x7fbe6c0cdd50 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c00c440 tx=0x7fbe5c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.941+0000 7fbe53fff640 1 -- 172.21.15.60:0/1251993125 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c017070 con 0x7fbe6c06f710 2024-09-12T01:44:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.941+0000 7fbe53fff640 1 -- 172.21.15.60:0/1251993125 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe5c005480 con 0x7fbe6c06f710 2024-09-12T01:44:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.941+0000 7fbe53fff640 1 -- 172.21.15.60:0/1251993125 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c003830 con 0x7fbe6c06f710 2024-09-12T01:44:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.941+0000 7fbe718c9640 1 -- 172.21.15.60:0/1251993125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6c0ce880 con 0x7fbe6c06f710 2024-09-12T01:44:21.943 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.941+0000 7fbe718c9640 1 -- 172.21.15.60:0/1251993125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe6c0cee40 con 0x7fbe6c06f710 2024-09-12T01:44:21.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.942+0000 7fbe718c9640 1 -- 172.21.15.60:0/1251993125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe6c0d2250 con 0x7fbe6c06f710 2024-09-12T01:44:21.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.942+0000 7fbe53fff640 1 -- 172.21.15.60:0/1251993125 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbe5c01a070 con 0x7fbe6c06f710 2024-09-12T01:44:21.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.943+0000 7fbe53fff640 1 --2- 172.21.15.60:0/1251993125 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe5806be30 0x7fbe5806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:21.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.943+0000 7fbe53fff640 1 -- 172.21.15.60:0/1251993125 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fbe5c08a2f0 con 0x7fbe6c06f710 2024-09-12T01:44:21.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.943+0000 7fbe6a7fc640 1 --2- 172.21.15.60:0/1251993125 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe5806be30 0x7fbe5806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:21.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.943+0000 7fbe6a7fc640 1 --2- 172.21.15.60:0/1251993125 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbe5806be30 0x7fbe5806e2f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0b0440 tx=0x7fbe60009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:21.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:21.947+0000 7fbe53fff640 1 -- 172.21.15.60:0/1251993125 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbe5c058af0 con 0x7fbe6c06f710 2024-09-12T01:44:22.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.160+0000 7fbe718c9640 1 -- 172.21.15.60:0/1251993125 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fbe6c0b61c0 con 0x7fbe6c06f710 2024-09-12T01:44:22.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.160+0000 7fbe53fff640 1 -- 172.21.15.60:0/1251993125 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=-1 MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it v81) ==== 316+0+0 (secure 0 0 0) 0x7fbe5c08a0d0 con 0x7fbe6c06f710 2024-09-12T01:44:22.161 INFO:teuthology.orchestra.run.smithi060.stderr:Error EPERM: MDS has one of two health warnings which could extend recovery: MDS_TRIM or MDS_CACHE_OVERSIZED. MDS failover is not recommended since it might cause unexpected file system unavailability. If you wish to proceed, pass --yes-i-really-mean-it 2024-09-12T01:44:22.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:44:22.166 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs --yes-i-really-mean-it 2024-09-12T01:44:22.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.269+0000 7fa4b50af640 1 Processor -- start 2024-09-12T01:44:22.270 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.269+0000 7fa4b50af640 1 -- start start 2024-09-12T01:44:22.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.270+0000 7fa4b50af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b015e7a0 0x7fa4b006caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:22.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.270+0000 7fa4b50af640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b00cf860 con 0x7fa4b00b68f0 2024-09-12T01:44:22.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.270+0000 7fa4b50af640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b00cfb40 con 0x7fa4b00cf1f0 2024-09-12T01:44:22.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.270+0000 7fa4b50af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b00d2ca0 con 0x7fa4b015e7a0 2024-09-12T01:44:22.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.270+0000 7fa4af59e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa4b00b68f0 0x7fa4b00d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:60378/0 (socket says 172.21.15.60:60378) 2024-09-12T01:44:22.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.270+0000 7fa4af59e640 1 -- 172.21.15.60:0/2030117676 learned_addr learned my addr 172.21.15.60:0/2030117676 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:22.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.271+0000 7fa4aed9d640 1 --2- 172.21.15.60:0/2030117676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b015e7a0 0x7fa4b006caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:22.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.271+0000 7fa4add9b640 1 -- 172.21.15.60:0/2030117676 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1270139052 0 0) 0x7fa4b00cf860 con 0x7fa4b00b68f0 2024-09-12T01:44:22.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.271+0000 7fa4add9b640 1 -- 172.21.15.60:0/2030117676 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa498003520 con 0x7fa4b00b68f0 2024-09-12T01:44:22.272 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.271+0000 7fa4add9b640 1 -- 172.21.15.60:0/2030117676 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2849288015 0 0) 0x7fa4b00cfb40 con 0x7fa4b00cf1f0 2024-09-12T01:44:22.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.271+0000 7fa4add9b640 1 -- 172.21.15.60:0/2030117676 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4b00cf860 con 0x7fa4b00cf1f0 2024-09-12T01:44:22.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.271+0000 7fa4aed9d640 1 -- 172.21.15.60:0/2030117676 >> v1:172.21.15.105:6789/0 conn(0x7fa4b00cf1f0 legacy=0x7fa4b00b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:22.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.271+0000 7fa4aed9d640 1 -- 172.21.15.60:0/2030117676 >> v1:172.21.15.60:6789/0 conn(0x7fa4b00b68f0 legacy=0x7fa4b00d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:22.273 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.271+0000 7fa4aed9d640 1 -- 172.21.15.60:0/2030117676 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b00cfe20 con 0x7fa4b015e7a0 2024-09-12T01:44:22.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.272+0000 7fa4aed9d640 1 --2- 172.21.15.60:0/2030117676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b015e7a0 0x7fa4b006caa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00097d0 tx=0x7fa4a002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ee631d95a0e6f5f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:22.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.272+0000 7fa4add9b640 1 -- 172.21.15.60:0/2030117676 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0037070 con 0x7fa4b015e7a0 2024-09-12T01:44:22.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.272+0000 7fa4add9b640 1 -- 172.21.15.60:0/2030117676 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a0032440 con 0x7fa4b015e7a0 2024-09-12T01:44:22.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.272+0000 7fa4add9b640 1 -- 172.21.15.60:0/2030117676 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a00327f0 con 0x7fa4b015e7a0 2024-09-12T01:44:22.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.272+0000 7fa4b50af640 1 -- 172.21.15.60:0/2030117676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b015e7a0 msgr2=0x7fa4b006caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:22.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.272+0000 7fa4b50af640 1 --2- 172.21.15.60:0/2030117676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b015e7a0 0x7fa4b006caa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00097d0 tx=0x7fa4a002a180 comp rx=0 tx=0).stop 2024-09-12T01:44:22.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.272+0000 7fa4b50af640 1 -- 172.21.15.60:0/2030117676 shutdown_connections 2024-09-12T01:44:22.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.272+0000 7fa4b50af640 1 --2- 172.21.15.60:0/2030117676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b015e7a0 0x7fa4b006caa0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.272+0000 7fa4b50af640 1 -- 172.21.15.60:0/2030117676 >> 172.21.15.60:0/2030117676 conn(0x7fa4b00d11e0 msgr2=0x7fa4b00d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:22.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.273+0000 7fa4b50af640 1 -- 172.21.15.60:0/2030117676 shutdown_connections 2024-09-12T01:44:22.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.273+0000 7fa4b50af640 1 -- 172.21.15.60:0/2030117676 wait complete. 2024-09-12T01:44:22.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.274+0000 7fa4b50af640 1 Processor -- start 2024-09-12T01:44:22.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.274+0000 7fa4b50af640 1 -- start start 2024-09-12T01:44:22.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4b50af640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b00b68f0 0x7fa4b0158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:22.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4b50af640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b00cf1f0 0x7fa4b0159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:22.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4b50af640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b015e7a0 0x7fa4b015ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4b50af640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b006cfe0 con 0x7fa4b00b68f0 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4b50af640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b00b7a00 con 0x7fa4b015e7a0 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4b50af640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b015eb80 con 0x7fa4b00cf1f0 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4aed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b00b68f0 0x7fa4b0158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4aed9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b00b68f0 0x7fa4b0158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40966/0 (socket says 172.21.15.60:40966) 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4aed9d640 1 -- 172.21.15.60:0/3453910008 learned_addr learned my addr 172.21.15.60:0/3453910008 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4ae59c640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b00cf1f0 0x7fa4b0159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4af59e640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b015e7a0 0x7fa4b015ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4aed9d640 1 -- 172.21.15.60:0/3453910008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b00cf1f0 msgr2=0x7fa4b0159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4aed9d640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b00cf1f0 0x7fa4b0159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4aed9d640 1 -- 172.21.15.60:0/3453910008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b015e7a0 msgr2=0x7fa4b015ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4aed9d640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b015e7a0 0x7fa4b015ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.279 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4aed9d640 1 -- 172.21.15.60:0/3453910008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b01e9cc0 con 0x7fa4b00b68f0 2024-09-12T01:44:22.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.275+0000 7fa4aed9d640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b00b68f0 0x7fa4b0158e60 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0035040 tx=0x7fa4a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:22.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.276+0000 7fa4977fe640 1 -- 172.21.15.60:0/3453910008 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0037040 con 0x7fa4b00b68f0 2024-09-12T01:44:22.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.276+0000 7fa4977fe640 1 -- 172.21.15.60:0/3453910008 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a0042070 con 0x7fa4b00b68f0 2024-09-12T01:44:22.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.276+0000 7fa4b50af640 1 -- 172.21.15.60:0/3453910008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b01e9fa0 con 0x7fa4b00b68f0 2024-09-12T01:44:22.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.276+0000 7fa4977fe640 1 -- 172.21.15.60:0/3453910008 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a0032810 con 0x7fa4b00b68f0 2024-09-12T01:44:22.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.276+0000 7fa4b50af640 1 -- 172.21.15.60:0/3453910008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b01ea560 con 0x7fa4b00b68f0 2024-09-12T01:44:22.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.277+0000 7fa4b50af640 1 -- 172.21.15.60:0/3453910008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b006caa0 con 0x7fa4b00b68f0 2024-09-12T01:44:22.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.277+0000 7fa4977fe640 1 -- 172.21.15.60:0/3453910008 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa4a00329b0 con 0x7fa4b00b68f0 2024-09-12T01:44:22.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.278+0000 7fa4977fe640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa49c06be30 0x7fa49c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:22.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.278+0000 7fa4977fe640 1 -- 172.21.15.60:0/3453910008 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5709+0+0 (secure 0 0 0) 0x7fa4a00ab4b0 con 0x7fa4b00b68f0 2024-09-12T01:44:22.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.278+0000 7fa4ae59c640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa49c06be30 0x7fa49c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:22.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.278+0000 7fa4ae59c640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa49c06be30 0x7fa49c06e2f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4007fd0 tx=0x7fa4a4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:22.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.282+0000 7fa4977fe640 1 -- 172.21.15.60:0/3453910008 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa4a00799c0 con 0x7fa4b00b68f0 2024-09-12T01:44:22.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.502+0000 7fa4b50af640 1 -- 172.21.15.60:0/3453910008 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa4b00d2a80 con 0x7fa4b00b68f0 2024-09-12T01:44:22.503 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-12T01:44:22.502+0000 7f58b98dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:44:22.504 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.504+0000 7fa4977fe640 1 -- 172.21.15.60:0/3453910008 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v82) ==== 191+0+0 (secure 0 0 0) 0x7fa4a007dcc0 con 0x7fa4b00b68f0 2024-09-12T01:44:22.504 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:44:22.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.506+0000 7fa4b50af640 1 -- 172.21.15.60:0/3453910008 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa49c06be30 msgr2=0x7fa49c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:22.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.506+0000 7fa4b50af640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa49c06be30 0x7fa49c06e2f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4007fd0 tx=0x7fa4a4009040 comp rx=0 tx=0).stop 2024-09-12T01:44:22.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.506+0000 7fa4b50af640 1 -- 172.21.15.60:0/3453910008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b00b68f0 msgr2=0x7fa4b0158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:22.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.506+0000 7fa4b50af640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b00b68f0 0x7fa4b0158e60 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0035040 tx=0x7fa4a00046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.506+0000 7fa4b50af640 1 -- 172.21.15.60:0/3453910008 shutdown_connections 2024-09-12T01:44:22.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.506+0000 7fa4b50af640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa4b015e7a0 0x7fa4b015ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.506+0000 7fa4b50af640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa49c06be30 0x7fa49c06e2f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.506+0000 7fa4b50af640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4b00cf1f0 0x7fa4b0159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.506+0000 7fa4b50af640 1 --2- 172.21.15.60:0/3453910008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4b00b68f0 0x7fa4b0158e60 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.506+0000 7fa4b50af640 1 -- 172.21.15.60:0/3453910008 >> 172.21.15.60:0/3453910008 conn(0x7fa4b00d11e0 msgr2=0x7fa4b00d4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:22.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.507+0000 7fa4b50af640 1 -- 172.21.15.60:0/3453910008 shutdown_connections 2024-09-12T01:44:22.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.507+0000 7fa4b50af640 1 -- 172.21.15.60:0/3453910008 wait complete. 2024-09-12T01:44:22.518 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:44:22.547 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:44:22.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.621+0000 7fc9388d7640 1 Processor -- start 2024-09-12T01:44:22.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.622+0000 7fc9388d7640 1 -- start start 2024-09-12T01:44:22.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.622+0000 7fc9388d7640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc93415e7a0 0x7fc93406caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.622+0000 7fc9388d7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc9340cf1f0 0x7fc9340b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.622+0000 7fc9388d7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9340cf860 con 0x7fc9340b6720 2024-09-12T01:44:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.622+0000 7fc9388d7640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc9340b6b90 con 0x7fc93415e7a0 2024-09-12T01:44:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.622+0000 7fc9388d7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc9340d2ca0 con 0x7fc9340cf1f0 2024-09-12T01:44:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.623+0000 7fc93259c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc93415e7a0 0x7fc93406caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.623+0000 7fc932d9d640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc9340b6720 0x7fc9341623c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38752/0 (socket says 172.21.15.60:38752) 2024-09-12T01:44:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.623+0000 7fc93259c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc93415e7a0 0x7fc93406caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45842/0 (socket says 172.21.15.60:45842) 2024-09-12T01:44:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.623+0000 7fc932d9d640 1 -- 172.21.15.60:0/500959725 learned_addr learned my addr 172.21.15.60:0/500959725 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:22.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.623+0000 7fc931d9b640 1 --2- 172.21.15.60:0/500959725 >> v2:172.21.15.105:3300/0 conn(0x7fc9340cf1f0 0x7fc9340b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.623+0000 7fc93259c640 1 -- 172.21.15.60:0/500959725 >> v2:172.21.15.105:3300/0 conn(0x7fc9340cf1f0 msgr2=0x7fc9340b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.623+0000 7fc93259c640 1 --2- 172.21.15.60:0/500959725 >> v2:172.21.15.105:3300/0 conn(0x7fc9340cf1f0 0x7fc9340b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.623+0000 7fc93259c640 1 -- 172.21.15.60:0/500959725 >> v1:172.21.15.60:6789/0 conn(0x7fc9340b6720 legacy=0x7fc9341623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.623+0000 7fc93259c640 1 -- 172.21.15.60:0/500959725 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9340cfb40 con 0x7fc93415e7a0 2024-09-12T01:44:22.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.623+0000 7fc93159a640 1 -- 172.21.15.60:0/500959725 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4090152291 0 0) 0x7fc9340cf860 con 0x7fc9340b6720 2024-09-12T01:44:22.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.624+0000 7fc93259c640 1 --2- 172.21.15.60:0/500959725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93415e7a0 0x7fc93406caa0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc9340d2110 tx=0x7fc92402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0d5dbbbed663d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:22.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.624+0000 7fc93159a640 1 -- 172.21.15.60:0/500959725 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924007740 con 0x7fc93415e7a0 2024-09-12T01:44:22.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.624+0000 7fc93159a640 1 -- 172.21.15.60:0/500959725 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9240078e0 con 0x7fc93415e7a0 2024-09-12T01:44:22.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.624+0000 7fc93159a640 1 -- 172.21.15.60:0/500959725 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc924007cb0 con 0x7fc93415e7a0 2024-09-12T01:44:22.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.624+0000 7fc9388d7640 1 -- 172.21.15.60:0/500959725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93415e7a0 msgr2=0x7fc93406caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:22.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.624+0000 7fc9388d7640 1 --2- 172.21.15.60:0/500959725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93415e7a0 0x7fc93406caa0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fc9340d2110 tx=0x7fc92402a5f0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.624+0000 7fc9388d7640 1 -- 172.21.15.60:0/500959725 shutdown_connections 2024-09-12T01:44:22.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.625+0000 7fc9388d7640 1 --2- 172.21.15.60:0/500959725 >> v2:172.21.15.105:3300/0 conn(0x7fc9340cf1f0 0x7fc9340b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.625+0000 7fc9388d7640 1 --2- 172.21.15.60:0/500959725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc93415e7a0 0x7fc93406caa0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.625+0000 7fc9388d7640 1 -- 172.21.15.60:0/500959725 >> 172.21.15.60:0/500959725 conn(0x7fc9340d11e0 msgr2=0x7fc9340d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:22.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.625+0000 7fc9388d7640 1 -- 172.21.15.60:0/500959725 shutdown_connections 2024-09-12T01:44:22.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.625+0000 7fc9388d7640 1 -- 172.21.15.60:0/500959725 wait complete. 2024-09-12T01:44:22.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.626+0000 7fc9388d7640 1 Processor -- start 2024-09-12T01:44:22.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.626+0000 7fc9388d7640 1 -- start start 2024-09-12T01:44:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc9388d7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9340b6720 0x7fc9340cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc9388d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9340cf1f0 0x7fc934161210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc9388d7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc93415e7a0 0x7fc934161750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc9388d7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340b7a00 con 0x7fc9340cf1f0 2024-09-12T01:44:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc9388d7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc9340d2ef0 con 0x7fc93415e7a0 2024-09-12T01:44:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc9388d7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc93406cfe0 con 0x7fc9340b6720 2024-09-12T01:44:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc931d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9340cf1f0 0x7fc934161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc931d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9340cf1f0 0x7fc934161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45850/0 (socket says 172.21.15.60:45850) 2024-09-12T01:44:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc931d9b640 1 -- 172.21.15.60:0/1272364853 learned_addr learned my addr 172.21.15.60:0/1272364853 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc93259c640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9340b6720 0x7fc9340cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc932d9d640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc93415e7a0 0x7fc934161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:22.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc931d9b640 1 -- 172.21.15.60:0/1272364853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9340b6720 msgr2=0x7fc9340cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc931d9b640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9340b6720 0x7fc9340cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc931d9b640 1 -- 172.21.15.60:0/1272364853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc93415e7a0 msgr2=0x7fc934161750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc931d9b640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc93415e7a0 0x7fc934161750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc931d9b640 1 -- 172.21.15.60:0/1272364853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9340cdd20 con 0x7fc9340cf1f0 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc931d9b640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9340cf1f0 0x7fc934161210 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00e9b0 tx=0x7fc91c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.627+0000 7fc92affd640 1 -- 172.21.15.60:0/1272364853 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c017070 con 0x7fc9340cf1f0 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.628+0000 7fc92affd640 1 -- 172.21.15.60:0/1272364853 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c00c9a0 con 0x7fc9340cf1f0 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.628+0000 7fc9388d7640 1 -- 172.21.15.60:0/1272364853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9340ce000 con 0x7fc9340cf1f0 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.628+0000 7fc92affd640 1 -- 172.21.15.60:0/1272364853 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c00cd90 con 0x7fc9340cf1f0 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.628+0000 7fc9388d7640 1 -- 172.21.15.60:0/1272364853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9340c96f0 con 0x7fc9340cf1f0 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.629+0000 7fc9388d7640 1 -- 172.21.15.60:0/1272364853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9340d2a80 con 0x7fc9340cf1f0 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.629+0000 7fc92affd640 1 -- 172.21.15.60:0/1272364853 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc91c01a070 con 0x7fc9340cf1f0 2024-09-12T01:44:22.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.630+0000 7fc92affd640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc91406be30 0x7fc91406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.630+0000 7fc92affd640 1 -- 172.21.15.60:0/1272364853 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5795+0+0 (secure 0 0 0) 0x7fc91c08b100 con 0x7fc9340cf1f0 2024-09-12T01:44:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.630+0000 7fc93259c640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc91406be30 0x7fc91406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:22.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.630+0000 7fc93259c640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc91406be30 0x7fc91406e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc924034000 tx=0x7fc92402f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:22.634 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.634+0000 7fc92affd640 1 -- 172.21.15.60:0/1272364853 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc91c059490 con 0x7fc9340cf1f0 2024-09-12T01:44:22.844 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:22.844+0000 7fc9388d7640 1 -- 172.21.15.60:0/1272364853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fc93415dca0 con 0x7fc9340cf1f0 2024-09-12T01:44:23.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.505+0000 7fc92affd640 1 -- 172.21.15.60:0/1272364853 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v83) ==== 104+0+0 (secure 0 0 0) 0x7fc91c05d790 con 0x7fc9340cf1f0 2024-09-12T01:44:23.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.508+0000 7fc9388d7640 1 -- 172.21.15.60:0/1272364853 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc91406be30 msgr2=0x7fc91406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:23.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.508+0000 7fc9388d7640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc91406be30 0x7fc91406e2f0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fc924034000 tx=0x7fc92402f000 comp rx=0 tx=0).stop 2024-09-12T01:44:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.508+0000 7fc9388d7640 1 -- 172.21.15.60:0/1272364853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9340cf1f0 msgr2=0x7fc934161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.508+0000 7fc9388d7640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9340cf1f0 0x7fc934161210 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00e9b0 tx=0x7fc91c00ee70 comp rx=0 tx=0).stop 2024-09-12T01:44:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.508+0000 7fc9388d7640 1 -- 172.21.15.60:0/1272364853 shutdown_connections 2024-09-12T01:44:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.508+0000 7fc9388d7640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc93415e7a0 0x7fc934161750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.508+0000 7fc9388d7640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9340cf1f0 0x7fc934161210 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.508+0000 7fc9388d7640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc91406be30 0x7fc91406e2f0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.508+0000 7fc9388d7640 1 --2- 172.21.15.60:0/1272364853 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc9340b6720 0x7fc9340cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.508+0000 7fc9388d7640 1 -- 172.21.15.60:0/1272364853 >> 172.21.15.60:0/1272364853 conn(0x7fc9340d11e0 msgr2=0x7fc93415c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.508+0000 7fc9388d7640 1 -- 172.21.15.60:0/1272364853 shutdown_connections 2024-09-12T01:44:23.509 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.508+0000 7fc9388d7640 1 -- 172.21.15.60:0/1272364853 wait complete. 2024-09-12T01:44:23.522 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:44:23.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.634+0000 7fbc3e2b7640 1 Processor -- start 2024-09-12T01:44:23.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.634+0000 7fbc3e2b7640 1 -- start start 2024-09-12T01:44:23.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.635+0000 7fbc3e2b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc3815e990 0x7fbc380b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:23.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.635+0000 7fbc3e2b7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbc38162450 0x7fbc38162890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:23.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.635+0000 7fbc3e2b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc3815ed70 con 0x7fbc38162dd0 2024-09-12T01:44:23.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.635+0000 7fbc3e2b7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbc380cff20 con 0x7fbc38162450 2024-09-12T01:44:23.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.635+0000 7fbc3e2b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbc38163280 con 0x7fbc3815e990 2024-09-12T01:44:23.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.636+0000 7fbc37fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc3815e990 0x7fbc380b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:23.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.636+0000 7fbc37fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc3815e990 0x7fbc380b3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:36742/0 (socket says 172.21.15.60:36742) 2024-09-12T01:44:23.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.636+0000 7fbc37fff640 1 -- 172.21.15.60:0/591806512 learned_addr learned my addr 172.21.15.60:0/591806512 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:23.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.636+0000 7fbc377fe640 1 --2- 172.21.15.60:0/591806512 >> v2:172.21.15.105:3300/0 conn(0x7fbc38162450 0x7fbc38162890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:23.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.636+0000 7fbc37fff640 1 -- 172.21.15.60:0/591806512 >> v2:172.21.15.105:3300/0 conn(0x7fbc38162450 msgr2=0x7fbc38162890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.636+0000 7fbc37fff640 1 --2- 172.21.15.60:0/591806512 >> v2:172.21.15.105:3300/0 conn(0x7fbc38162450 0x7fbc38162890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.636+0000 7fbc37fff640 1 -- 172.21.15.60:0/591806512 >> v1:172.21.15.105:6789/0 conn(0x7fbc38162dd0 legacy=0x7fbc380b6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.636+0000 7fbc37fff640 1 -- 172.21.15.60:0/591806512 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc380d1fa0 con 0x7fbc3815e990 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.637+0000 7fbc37fff640 1 --2- 172.21.15.60:0/591806512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc3815e990 0x7fbc380b3920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009870 tx=0x7fbc2802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a55111004547810 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.637+0000 7fbc36ffd640 1 -- 172.21.15.60:0/591806512 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28037070 con 0x7fbc3815e990 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.637+0000 7fbc36ffd640 1 -- 172.21.15.60:0/591806512 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc28032440 con 0x7fbc3815e990 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.637+0000 7fbc36ffd640 1 -- 172.21.15.60:0/591806512 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28032810 con 0x7fbc3815e990 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.638+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/591806512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc3815e990 msgr2=0x7fbc380b3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.638+0000 7fbc3e2b7640 1 --2- 172.21.15.60:0/591806512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc3815e990 0x7fbc380b3920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009870 tx=0x7fbc2802a1c0 comp rx=0 tx=0).stop 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.638+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/591806512 shutdown_connections 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.638+0000 7fbc3e2b7640 1 --2- 172.21.15.60:0/591806512 >> v2:172.21.15.105:3300/0 conn(0x7fbc38162450 0x7fbc38162890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.638+0000 7fbc3e2b7640 1 --2- 172.21.15.60:0/591806512 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc3815e990 0x7fbc380b3920 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:23.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.638+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/591806512 >> 172.21.15.60:0/591806512 conn(0x7fbc380d1200 msgr2=0x7fbc380d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:23.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.638+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/591806512 shutdown_connections 2024-09-12T01:44:23.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.638+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/591806512 wait complete. 2024-09-12T01:44:23.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.639+0000 7fbc3e2b7640 1 Processor -- start 2024-09-12T01:44:23.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.639+0000 7fbc3e2b7640 1 -- start start 2024-09-12T01:44:23.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc3e2b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc3815e990 0x7fbc381f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:23.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc3e2b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc38162450 0x7fbc380cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:23.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc3e2b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc38162dd0 0x7fbc380cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:23.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc3e2b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbc380d39b0 con 0x7fbc3815e990 2024-09-12T01:44:23.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc3e2b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbc380cfc40 con 0x7fbc38162450 2024-09-12T01:44:23.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc3e2b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbc380d3b30 con 0x7fbc38162dd0 2024-09-12T01:44:23.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc37fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc3815e990 0x7fbc381f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:23.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc37fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc3815e990 0x7fbc381f41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45860/0 (socket says 172.21.15.60:45860) 2024-09-12T01:44:23.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc37fff640 1 -- 172.21.15.60:0/3576995137 learned_addr learned my addr 172.21.15.60:0/3576995137 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc377fe640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc38162450 0x7fbc380cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc3c854640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc38162dd0 0x7fbc380cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc37fff640 1 -- 172.21.15.60:0/3576995137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc38162dd0 msgr2=0x7fbc380cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc37fff640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc38162dd0 0x7fbc380cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc37fff640 1 -- 172.21.15.60:0/3576995137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc38162450 msgr2=0x7fbc380cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc37fff640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc38162450 0x7fbc380cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.640+0000 7fbc37fff640 1 -- 172.21.15.60:0/3576995137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc3814d8b0 con 0x7fbc3815e990 2024-09-12T01:44:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.641+0000 7fbc37fff640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc3815e990 0x7fbc381f41a0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fbc28000c00 tx=0x7fbc280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.641+0000 7fbc34ff9640 1 -- 172.21.15.60:0/3576995137 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28041020 con 0x7fbc3815e990 2024-09-12T01:44:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.641+0000 7fbc34ff9640 1 -- 172.21.15.60:0/3576995137 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc2803d620 con 0x7fbc3815e990 2024-09-12T01:44:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.641+0000 7fbc34ff9640 1 -- 172.21.15.60:0/3576995137 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc28037040 con 0x7fbc3815e990 2024-09-12T01:44:23.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.641+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/3576995137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc380ce1a0 con 0x7fbc3815e990 2024-09-12T01:44:23.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.641+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/3576995137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc380ce760 con 0x7fbc3815e990 2024-09-12T01:44:23.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.642+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/3576995137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc380b3920 con 0x7fbc3815e990 2024-09-12T01:44:23.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.643+0000 7fbc34ff9640 1 -- 172.21.15.60:0/3576995137 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbc28044020 con 0x7fbc3815e990 2024-09-12T01:44:23.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.643+0000 7fbc34ff9640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc2406be30 0x7fbc2406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:23.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.643+0000 7fbc34ff9640 1 -- 172.21.15.60:0/3576995137 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5795+0+0 (secure 0 0 0) 0x7fbc280ab4c0 con 0x7fbc3815e990 2024-09-12T01:44:23.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.643+0000 7fbc377fe640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc2406be30 0x7fbc2406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:23.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.643+0000 7fbc377fe640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc2406be30 0x7fbc2406e2f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbc381f7bd0 tx=0x7fbc2c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:23.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.647+0000 7fbc34ff9640 1 -- 172.21.15.60:0/3576995137 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbc2804b030 con 0x7fbc3815e990 2024-09-12T01:44:23.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:23.820+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/3576995137 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbc3814da80 con 0x7fbc3815e990 2024-09-12T01:44:24.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.513+0000 7fbc34ff9640 1 -- 172.21.15.60:0/3576995137 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v130) ==== 181+0+0 (secure 0 0 0) 0x7fbc280797d0 con 0x7fbc3815e990 2024-09-12T01:44:24.514 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:44:24.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.517+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/3576995137 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc2406be30 msgr2=0x7fbc2406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:24.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.517+0000 7fbc3e2b7640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc2406be30 0x7fbc2406e2f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbc381f7bd0 tx=0x7fbc2c009190 comp rx=0 tx=0).stop 2024-09-12T01:44:24.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.517+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/3576995137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc3815e990 msgr2=0x7fbc381f41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:24.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.517+0000 7fbc3e2b7640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc3815e990 0x7fbc381f41a0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fbc28000c00 tx=0x7fbc280046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:24.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.517+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/3576995137 shutdown_connections 2024-09-12T01:44:24.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.517+0000 7fbc3e2b7640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbc2406be30 0x7fbc2406e2f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:24.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.517+0000 7fbc3e2b7640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc38162dd0 0x7fbc380cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:24.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.517+0000 7fbc3e2b7640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc38162450 0x7fbc380cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:24.518 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.517+0000 7fbc3e2b7640 1 --2- 172.21.15.60:0/3576995137 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc3815e990 0x7fbc381f41a0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:24.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.517+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/3576995137 >> 172.21.15.60:0/3576995137 conn(0x7fbc380d1200 msgr2=0x7fbc380d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:24.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.517+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/3576995137 shutdown_connections 2024-09-12T01:44:24.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.517+0000 7fbc3e2b7640 1 -- 172.21.15.60:0/3576995137 wait complete. 2024-09-12T01:44:24.532 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:44:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.644+0000 7fbfe86a6640 1 Processor -- start 2024-09-12T01:44:24.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.645+0000 7fbfe86a6640 1 -- start start 2024-09-12T01:44:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe86a6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbfe0158a00 0x7fbfe0071f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe86a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfe0072470 0x7fbfe00b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe86a6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfe00728f0 con 0x7fbfe0158de0 2024-09-12T01:44:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe86a6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbfe0072bd0 con 0x7fbfe0158a00 2024-09-12T01:44:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe86a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe0072eb0 con 0x7fbfe0072470 2024-09-12T01:44:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe6c43640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbfe0158de0 0x7fbfe0162110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38768/0 (socket says 172.21.15.60:38768) 2024-09-12T01:44:24.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe6c43640 1 -- 172.21.15.60:0/260828841 learned_addr learned my addr 172.21.15.60:0/260828841 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe6442640 1 --2- 172.21.15.60:0/260828841 >> v2:172.21.15.105:3300/0 conn(0x7fbfe0158a00 0x7fbfe0071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe5c41640 1 --2- 172.21.15.60:0/260828841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfe0072470 0x7fbfe00b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe5440640 1 -- 172.21.15.60:0/260828841 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2791872524 0 0) 0x7fbfe00728f0 con 0x7fbfe0158de0 2024-09-12T01:44:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe5440640 1 -- 172.21.15.60:0/260828841 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfcc003520 con 0x7fbfe0158de0 2024-09-12T01:44:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe5440640 1 -- 172.21.15.60:0/260828841 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 474590951 0 0) 0x7fbfcc003520 con 0x7fbfe0158de0 2024-09-12T01:44:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe6442640 1 -- 172.21.15.60:0/260828841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfe0072470 msgr2=0x7fbfe00b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe6442640 1 --2- 172.21.15.60:0/260828841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfe0072470 0x7fbfe00b4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe6442640 1 -- 172.21.15.60:0/260828841 >> v1:172.21.15.60:6789/0 conn(0x7fbfe0158de0 legacy=0x7fbfe0162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe6442640 1 -- 172.21.15.60:0/260828841 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe0073190 con 0x7fbfe0158a00 2024-09-12T01:44:24.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.646+0000 7fbfe5c41640 1 --2- 172.21.15.60:0/260828841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfe0072470 0x7fbfe00b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.647+0000 7fbfe6442640 1 --2- 172.21.15.60:0/260828841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfe0158a00 0x7fbfe0071f30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0097a0 tx=0x7fbfdc02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abc7f81e7bc811b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.647+0000 7fbfe5440640 1 -- 172.21.15.60:0/260828841 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc037070 con 0x7fbfe0158a00 2024-09-12T01:44:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.647+0000 7fbfe5440640 1 -- 172.21.15.60:0/260828841 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfdc02aba0 con 0x7fbfe0158a00 2024-09-12T01:44:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.647+0000 7fbfe5440640 1 -- 172.21.15.60:0/260828841 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80019f0 con 0x7fbfe0158a00 2024-09-12T01:44:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.648+0000 7fbfe86a6640 1 -- 172.21.15.60:0/260828841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfe0158a00 msgr2=0x7fbfe0071f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:24.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.648+0000 7fbfe86a6640 1 --2- 172.21.15.60:0/260828841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfe0158a00 0x7fbfe0071f30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0097a0 tx=0x7fbfdc02a110 comp rx=0 tx=0).stop 2024-09-12T01:44:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.648+0000 7fbfe86a6640 1 -- 172.21.15.60:0/260828841 shutdown_connections 2024-09-12T01:44:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.648+0000 7fbfe86a6640 1 --2- 172.21.15.60:0/260828841 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfe0072470 0x7fbfe00b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.648+0000 7fbfe86a6640 1 --2- 172.21.15.60:0/260828841 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfe0158a00 0x7fbfe0071f30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.648+0000 7fbfe86a6640 1 -- 172.21.15.60:0/260828841 >> 172.21.15.60:0/260828841 conn(0x7fbfe006cb50 msgr2=0x7fbfe006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.648+0000 7fbfe86a6640 1 -- 172.21.15.60:0/260828841 shutdown_connections 2024-09-12T01:44:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.648+0000 7fbfe86a6640 1 -- 172.21.15.60:0/260828841 wait complete. 2024-09-12T01:44:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.649+0000 7fbfe86a6640 1 Processor -- start 2024-09-12T01:44:24.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.649+0000 7fbfe86a6640 1 -- start start 2024-09-12T01:44:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe86a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfe0072470 0x7fbfe01f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe86a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfe0158a00 0x7fbfe014dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe86a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfe0158de0 0x7fbfe01ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe86a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe00b5ca0 con 0x7fbfe0158a00 2024-09-12T01:44:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe86a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe00b5b20 con 0x7fbfe0072470 2024-09-12T01:44:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe86a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbfe006faf0 con 0x7fbfe0158de0 2024-09-12T01:44:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe5c41640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfe0158a00 0x7fbfe014dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe5c41640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfe0158a00 0x7fbfe014dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45874/0 (socket says 172.21.15.60:45874) 2024-09-12T01:44:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe5c41640 1 -- 172.21.15.60:0/375264457 learned_addr learned my addr 172.21.15.60:0/375264457 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe6442640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfe0072470 0x7fbfe01f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe6c43640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfe0158de0 0x7fbfe01ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe5c41640 1 -- 172.21.15.60:0/375264457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfe0158de0 msgr2=0x7fbfe01ea120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe5c41640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfe0158de0 0x7fbfe01ea120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe5c41640 1 -- 172.21.15.60:0/375264457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfe0072470 msgr2=0x7fbfe01f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe5c41640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfe0072470 0x7fbfe01f8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe5c41640 1 -- 172.21.15.60:0/375264457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe01f8870 con 0x7fbfe0158a00 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.650+0000 7fbfe6c43640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfe0158de0 0x7fbfe01ea120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.651+0000 7fbfe5c41640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfe0158a00 0x7fbfe014dc30 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000ebe0 tx=0x7fbfd000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.651+0000 7fbfd6ffd640 1 -- 172.21.15.60:0/375264457 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0017070 con 0x7fbfe0158a00 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.651+0000 7fbfd6ffd640 1 -- 172.21.15.60:0/375264457 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfd000cc30 con 0x7fbfe0158a00 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.651+0000 7fbfe86a6640 1 -- 172.21.15.60:0/375264457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe0160bc0 con 0x7fbfe0158a00 2024-09-12T01:44:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.651+0000 7fbfd6ffd640 1 -- 172.21.15.60:0/375264457 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0013470 con 0x7fbfe0158a00 2024-09-12T01:44:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.651+0000 7fbfe86a6640 1 -- 172.21.15.60:0/375264457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe0161140 con 0x7fbfe0158a00 2024-09-12T01:44:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.652+0000 7fbfe86a6640 1 -- 172.21.15.60:0/375264457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe0071f30 con 0x7fbfe0158a00 2024-09-12T01:44:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.652+0000 7fbfd6ffd640 1 -- 172.21.15.60:0/375264457 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbfd001a070 con 0x7fbfe0158a00 2024-09-12T01:44:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.653+0000 7fbfd6ffd640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbfc406be30 0x7fbfc406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.653+0000 7fbfd6ffd640 1 -- 172.21.15.60:0/375264457 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5357+0+0 (secure 0 0 0) 0x7fbfd008ad20 con 0x7fbfe0158a00 2024-09-12T01:44:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.653+0000 7fbfe6442640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbfc406be30 0x7fbfc406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:24.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.654+0000 7fbfe6442640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbfc406be30 0x7fbfc406e2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc034000 tx=0x7fbfdc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.657+0000 7fbfd6ffd640 1 -- 172.21.15.60:0/375264457 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbfe01f8870 con 0x7fbfe0158a00 2024-09-12T01:44:24.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:24.831+0000 7fbfe86a6640 1 -- 172.21.15.60:0/375264457 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbfe00b02f0 con 0x7fbfe0158a00 2024-09-12T01:44:25.519 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.518+0000 7fbfd6ffd640 1 -- 172.21.15.60:0/375264457 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v131) ==== 169+0+0 (secure 0 0 0) 0x7fbfd0059150 con 0x7fbfe0158a00 2024-09-12T01:44:25.519 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-12T01:44:25.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.522+0000 7fbfe86a6640 1 -- 172.21.15.60:0/375264457 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbfc406be30 msgr2=0x7fbfc406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.522 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.522+0000 7fbfe86a6640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbfc406be30 0x7fbfc406e2f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc034000 tx=0x7fbfdc02e000 comp rx=0 tx=0).stop 2024-09-12T01:44:25.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.522+0000 7fbfe86a6640 1 -- 172.21.15.60:0/375264457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfe0158a00 msgr2=0x7fbfe014dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.522+0000 7fbfe86a6640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfe0158a00 0x7fbfe014dc30 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000ebe0 tx=0x7fbfd000c520 comp rx=0 tx=0).stop 2024-09-12T01:44:25.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.522+0000 7fbfe86a6640 1 -- 172.21.15.60:0/375264457 shutdown_connections 2024-09-12T01:44:25.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.522+0000 7fbfe86a6640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbfc406be30 0x7fbfc406e2f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.522+0000 7fbfe86a6640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbfe0158de0 0x7fbfe01ea120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.522+0000 7fbfe86a6640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbfe0158a00 0x7fbfe014dc30 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.522+0000 7fbfe86a6640 1 --2- 172.21.15.60:0/375264457 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbfe0072470 0x7fbfe01f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.522+0000 7fbfe86a6640 1 -- 172.21.15.60:0/375264457 >> 172.21.15.60:0/375264457 conn(0x7fbfe006cb50 msgr2=0x7fbfe00b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:25.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.522+0000 7fbfe86a6640 1 -- 172.21.15.60:0/375264457 shutdown_connections 2024-09-12T01:44:25.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.522+0000 7fbfe86a6640 1 -- 172.21.15.60:0/375264457 wait complete. 2024-09-12T01:44:25.538 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_min_caps_working_set 2024-09-12T01:44:25.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.655+0000 7f26a1933640 1 Processor -- start 2024-09-12T01:44:25.656 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.655+0000 7f26a1933640 1 -- start start 2024-09-12T01:44:25.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f26a1933640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f269c15e940 0x7f269c0b6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f26a1933640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f269c0cfd40 con 0x7f269c0ba440 2024-09-12T01:44:25.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f26a1933640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f269c15ed20 con 0x7f269c0d2290 2024-09-12T01:44:25.658 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f26a1933640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f269c0d3ef0 con 0x7f269c15e940 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f269a7fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f269c0ba440 0x7f269c0cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38772/0 (socket says 172.21.15.60:38772) 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f269a7fc640 1 -- 172.21.15.60:0/3813796650 learned_addr learned my addr 172.21.15.60:0/3813796650 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 607857762 0 0) 0x7f269c0cfd40 con 0x7f269c0ba440 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2684003520 con 0x7f269c0ba440 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f269affd640 1 --2- 172.21.15.60:0/3813796650 >> v2:172.21.15.105:3300/0 conn(0x7f269c15e940 0x7f269c0b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2960165199 0 0) 0x7f2684003520 con 0x7f269c0ba440 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 >> v2:172.21.15.105:3300/0 conn(0x7f269c15e940 msgr2=0x7f269c0b6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 --2- 172.21.15.60:0/3813796650 >> v2:172.21.15.105:3300/0 conn(0x7f269c15e940 0x7f269c0b6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 >> v1:172.21.15.105:6789/0 conn(0x7f269c0d2290 legacy=0x7f269c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c0d32e0 con 0x7f269c0ba440 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f2690001670 con 0x7f269c0ba440 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 >> v1:172.21.15.60:6789/0 conn(0x7f269c0ba440 legacy=0x7f269c0cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 --2- 172.21.15.60:0/3813796650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840039b0 0x7f2684003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.659 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 --2- 172.21.15.60:0/3813796650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2684004800 0x7f2684004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 --2- 172.21.15.60:0/3813796650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26840051c0 0x7f268400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f269c0d3ef0 con 0x7f26840051c0 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f268400c160 con 0x7f2684004800 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.656+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f268400c360 con 0x7f26840039b0 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.657+0000 7f269b7fe640 1 --2- 172.21.15.60:0/3813796650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26840051c0 0x7f268400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.657+0000 7f269a7fc640 1 --2- 172.21.15.60:0/3813796650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2684004800 0x7f2684004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.657+0000 7f269affd640 1 --2- 172.21.15.60:0/3813796650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840039b0 0x7f2684003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.657+0000 7f269b7fe640 1 -- 172.21.15.60:0/3813796650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840039b0 msgr2=0x7f2684003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.657+0000 7f269b7fe640 1 --2- 172.21.15.60:0/3813796650 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f26840039b0 0x7f2684003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.657+0000 7f269b7fe640 1 -- 172.21.15.60:0/3813796650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2684004800 msgr2=0x7f2684004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.657+0000 7f269b7fe640 1 --2- 172.21.15.60:0/3813796650 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2684004800 0x7f2684004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.657+0000 7f269b7fe640 1 -- 172.21.15.60:0/3813796650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2684003520 con 0x7f26840051c0 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.658+0000 7f269b7fe640 1 -- 172.21.15.60:0/3813796650 reap_dead start 2024-09-12T01:44:25.660 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.658+0000 7f269b7fe640 1 --2- 172.21.15.60:0/3813796650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26840051c0 0x7f268400b9c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f2694001e50 tx=0x7f2684005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a079d4ad3b0eb2ce server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.658+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694001a70 con 0x7f26840051c0 2024-09-12T01:44:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.658+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2694003970 con 0x7f26840051c0 2024-09-12T01:44:25.661 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.658+0000 7f2699ffb640 1 -- 172.21.15.60:0/3813796650 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694003d60 con 0x7f26840051c0 2024-09-12T01:44:25.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.658+0000 7f26a1933640 1 -- 172.21.15.60:0/3813796650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26840051c0 msgr2=0x7f268400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.658+0000 7f26a1933640 1 --2- 172.21.15.60:0/3813796650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26840051c0 0x7f268400b9c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f2694001e50 tx=0x7f2684005830 comp rx=0 tx=0).stop 2024-09-12T01:44:25.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.658+0000 7f26a1933640 1 -- 172.21.15.60:0/3813796650 shutdown_connections 2024-09-12T01:44:25.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.658+0000 7f26a1933640 1 --2- 172.21.15.60:0/3813796650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26840051c0 0x7f268400b9c0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.658+0000 7f26a1933640 1 -- 172.21.15.60:0/3813796650 >> 172.21.15.60:0/3813796650 conn(0x7f269c0d1140 msgr2=0x7f269c0d1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:25.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.658+0000 7f26a1933640 1 -- 172.21.15.60:0/3813796650 shutdown_connections 2024-09-12T01:44:25.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.658+0000 7f26a1933640 1 -- 172.21.15.60:0/3813796650 wait complete. 2024-09-12T01:44:25.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.660+0000 7f26a1933640 1 Processor -- start 2024-09-12T01:44:25.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.660+0000 7f26a1933640 1 -- start start 2024-09-12T01:44:25.664 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f26a1933640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26840051c0 0x7f269c1f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f26a1933640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f269c1f4a90 0x7f269c1f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f26a1933640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c0cdda0 0x7f269c160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f26a1933640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f269c0d3b80 con 0x7f269c0cdda0 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f26a1933640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f269c0d38a0 con 0x7f26840051c0 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f26a1933640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f269c0b7510 con 0x7f269c1f4a90 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f269b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c0cdda0 0x7f269c160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f269b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c0cdda0 0x7f269c160cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45898/0 (socket says 172.21.15.60:45898) 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f269b7fe640 1 -- 172.21.15.60:0/949884644 learned_addr learned my addr 172.21.15.60:0/949884644 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f269a7fc640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f269c1f4a90 0x7f269c1f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f269affd640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26840051c0 0x7f269c1f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f269b7fe640 1 -- 172.21.15.60:0/949884644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f269c1f4a90 msgr2=0x7f269c1f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f269b7fe640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f269c1f4a90 0x7f269c1f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f269b7fe640 1 -- 172.21.15.60:0/949884644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26840051c0 msgr2=0x7f269c1f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f269b7fe640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26840051c0 0x7f269c1f36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f269b7fe640 1 -- 172.21.15.60:0/949884644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c0cb930 con 0x7f269c0cdda0 2024-09-12T01:44:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f269affd640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26840051c0 0x7f269c1f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f269b7fe640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c0cdda0 0x7f269c160cd0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f2694005040 tx=0x7f26940014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.661+0000 7f2683fff640 1 -- 172.21.15.60:0/949884644 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694007db0 con 0x7f269c0cdda0 2024-09-12T01:44:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.662+0000 7f2683fff640 1 -- 172.21.15.60:0/949884644 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2694001250 con 0x7f269c0cdda0 2024-09-12T01:44:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.662+0000 7f26a1933640 1 -- 172.21.15.60:0/949884644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269c1f5410 con 0x7f269c0cdda0 2024-09-12T01:44:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.662+0000 7f2683fff640 1 -- 172.21.15.60:0/949884644 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2694006b50 con 0x7f269c0cdda0 2024-09-12T01:44:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.662+0000 7f26a1933640 1 -- 172.21.15.60:0/949884644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269c0cbeb0 con 0x7f269c0cdda0 2024-09-12T01:44:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.663+0000 7f26a1933640 1 -- 172.21.15.60:0/949884644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f269c0b6140 con 0x7f269c0cdda0 2024-09-12T01:44:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.663+0000 7f2683fff640 1 -- 172.21.15.60:0/949884644 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2694006cf0 con 0x7f269c0cdda0 2024-09-12T01:44:25.666 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.664+0000 7f2683fff640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f268806be60 0x7f268806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.664+0000 7f269affd640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f268806be60 0x7f268806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.664+0000 7f2683fff640 1 -- 172.21.15.60:0/949884644 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7f26940aa140 con 0x7f269c0cdda0 2024-09-12T01:44:25.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.664+0000 7f269affd640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f268806be60 0x7f268806e320 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f269c160120 tx=0x7f268c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:25.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.668+0000 7f2683fff640 1 -- 172.21.15.60:0/949884644 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f2694078df0 con 0x7f269c0cdda0 2024-09-12T01:44:25.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.846+0000 7f26a1933640 1 -- 172.21.15.60:0/949884644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"} v 0) -- 0x7f269c0b5170 con 0x7f269c0cdda0 2024-09-12T01:44:25.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.849+0000 7f2683fff640 1 -- 172.21.15.60:0/949884644 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_min_caps_working_set"}]=0 v61) ==== 107+0+0 (secure 0 0 0) 0x7f26940786f0 con 0x7f269c0cdda0 2024-09-12T01:44:25.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.851+0000 7f26a1933640 1 -- 172.21.15.60:0/949884644 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f268806be60 msgr2=0x7f268806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.851+0000 7f26a1933640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f268806be60 0x7f268806e320 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f269c160120 tx=0x7f268c008040 comp rx=0 tx=0).stop 2024-09-12T01:44:25.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.851+0000 7f26a1933640 1 -- 172.21.15.60:0/949884644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c0cdda0 msgr2=0x7f269c160cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.851+0000 7f26a1933640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c0cdda0 0x7f269c160cd0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f2694005040 tx=0x7f26940014a0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.851+0000 7f26a1933640 1 -- 172.21.15.60:0/949884644 shutdown_connections 2024-09-12T01:44:25.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.851+0000 7f26a1933640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f269c0cdda0 0x7f269c160cd0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.851+0000 7f26a1933640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f268806be60 0x7f268806e320 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.852 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.851+0000 7f26a1933640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f269c1f4a90 0x7f269c1f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.851+0000 7f26a1933640 1 --2- 172.21.15.60:0/949884644 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f26840051c0 0x7f269c1f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.851+0000 7f26a1933640 1 -- 172.21.15.60:0/949884644 >> 172.21.15.60:0/949884644 conn(0x7f269c0d1140 msgr2=0x7f269c0b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:25.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.851+0000 7f26a1933640 1 -- 172.21.15.60:0/949884644 shutdown_connections 2024-09-12T01:44:25.853 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.851+0000 7f26a1933640 1 -- 172.21.15.60:0/949884644 wait complete. 2024-09-12T01:44:25.863 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_cache_memory_limit 2024-09-12T01:44:25.967 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.967+0000 7ffac5f23640 1 Processor -- start 2024-09-12T01:44:25.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.967+0000 7ffac5f23640 1 -- start start 2024-09-12T01:44:25.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.968+0000 7ffac5f23640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac00b64a0 0x7ffac00b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.968+0000 7ffac5f23640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffac00b7f50 0x7ffac00b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.968+0000 7ffac5f23640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac00b7790 con 0x7ffac015e750 2024-09-12T01:44:25.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.968+0000 7ffac5f23640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffac00d43c0 con 0x7ffac00b7f50 2024-09-12T01:44:25.968 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.968+0000 7ffac5f23640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffac00d33b0 con 0x7ffac00b64a0 2024-09-12T01:44:25.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.968+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac00b64a0 0x7ffac00b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.969 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.968+0000 7ffabffff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffac00b7f50 0x7ffac00b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.968+0000 7ffab7fff640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac00b64a0 0x7ffac00b68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:36790/0 (socket says 172.21.15.60:36790) 2024-09-12T01:44:25.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.968+0000 7ffabf7fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ffac015e750 0x7ffac00cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45404/0 (socket says 172.21.15.60:45404) 2024-09-12T01:44:25.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.968+0000 7ffab7fff640 1 -- 172.21.15.60:0/3834761549 learned_addr learned my addr 172.21.15.60:0/3834761549 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:25.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.969+0000 7ffab7fff640 1 -- 172.21.15.60:0/3834761549 >> v2:172.21.15.105:3300/0 conn(0x7ffac00b7f50 msgr2=0x7ffac00b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:25.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.969+0000 7ffab7fff640 1 --2- 172.21.15.60:0/3834761549 >> v2:172.21.15.105:3300/0 conn(0x7ffac00b7f50 0x7ffac00b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.969+0000 7ffab7fff640 1 -- 172.21.15.60:0/3834761549 >> v1:172.21.15.105:6789/0 conn(0x7ffac015e750 legacy=0x7ffac00cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.970 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.969+0000 7ffab7fff640 1 -- 172.21.15.60:0/3834761549 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac00d3600 con 0x7ffac00b64a0 2024-09-12T01:44:25.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.969+0000 7ffab7fff640 1 --2- 172.21.15.60:0/3834761549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac00b64a0 0x7ffac00b68e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009870 tx=0x7ffaa802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fb08d30414a6cbe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:25.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.970+0000 7ffabeffd640 1 -- 172.21.15.60:0/3834761549 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8037070 con 0x7ffac00b64a0 2024-09-12T01:44:25.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.970+0000 7ffabeffd640 1 -- 172.21.15.60:0/3834761549 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa8032440 con 0x7ffac00b64a0 2024-09-12T01:44:25.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.970+0000 7ffabeffd640 1 -- 172.21.15.60:0/3834761549 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8032810 con 0x7ffac00b64a0 2024-09-12T01:44:25.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.970+0000 7ffac5f23640 1 -- 172.21.15.60:0/3834761549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac00b64a0 msgr2=0x7ffac00b68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.970+0000 7ffac5f23640 1 --2- 172.21.15.60:0/3834761549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac00b64a0 0x7ffac00b68e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8009870 tx=0x7ffaa802a270 comp rx=0 tx=0).stop 2024-09-12T01:44:25.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.970+0000 7ffac5f23640 1 -- 172.21.15.60:0/3834761549 shutdown_connections 2024-09-12T01:44:25.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.970+0000 7ffac5f23640 1 --2- 172.21.15.60:0/3834761549 >> v2:172.21.15.105:3300/0 conn(0x7ffac00b7f50 0x7ffac00b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.970+0000 7ffac5f23640 1 --2- 172.21.15.60:0/3834761549 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac00b64a0 0x7ffac00b68e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.970+0000 7ffac5f23640 1 -- 172.21.15.60:0/3834761549 >> 172.21.15.60:0/3834761549 conn(0x7ffac00d1500 msgr2=0x7ffac00d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:25.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.970+0000 7ffac5f23640 1 -- 172.21.15.60:0/3834761549 shutdown_connections 2024-09-12T01:44:25.972 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.970+0000 7ffac5f23640 1 -- 172.21.15.60:0/3834761549 wait complete. 2024-09-12T01:44:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.971+0000 7ffac5f23640 1 Processor -- start 2024-09-12T01:44:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.971+0000 7ffac5f23640 1 -- start start 2024-09-12T01:44:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.972+0000 7ffac5f23640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac00b64a0 0x7ffac015c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.972+0000 7ffac5f23640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac00b7f50 0x7ffac01f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.972+0000 7ffac5f23640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffac015e750 0x7ffac01e8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.972+0000 7ffac5f23640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffac00b6e20 con 0x7ffac00b64a0 2024-09-12T01:44:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.972+0000 7ffac5f23640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffac00b7ac0 con 0x7ffac015e750 2024-09-12T01:44:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.972+0000 7ffac5f23640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffac00d3bc0 con 0x7ffac00b7f50 2024-09-12T01:44:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.972+0000 7ffabf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac00b64a0 0x7ffac015c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.972+0000 7ffabf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac00b64a0 0x7ffac015c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45908/0 (socket says 172.21.15.60:45908) 2024-09-12T01:44:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.972+0000 7ffabf7fe640 1 -- 172.21.15.60:0/3235084756 learned_addr learned my addr 172.21.15.60:0/3235084756 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:25.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffab7fff640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac00b7f50 0x7ffac01f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffabffff640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffac015e750 0x7ffac01e8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffabf7fe640 1 -- 172.21.15.60:0/3235084756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac00b7f50 msgr2=0x7ffac01f8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffabf7fe640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac00b7f50 0x7ffac01f8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffabf7fe640 1 -- 172.21.15.60:0/3235084756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffac015e750 msgr2=0x7ffac01e8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffabf7fe640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffac015e750 0x7ffac01e8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffabf7fe640 1 -- 172.21.15.60:0/3235084756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac015cbb0 con 0x7ffac00b64a0 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffabffff640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffac015e750 0x7ffac01e8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffabf7fe640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac00b64a0 0x7ffac015c4f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7ffab000c3c0 tx=0x7ffab000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffabcff9640 1 -- 172.21.15.60:0/3235084756 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab00074e0 con 0x7ffac00b64a0 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffabcff9640 1 -- 172.21.15.60:0/3235084756 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab0007680 con 0x7ffac00b64a0 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffac5f23640 1 -- 172.21.15.60:0/3235084756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac015ce90 con 0x7ffac00b64a0 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffabcff9640 1 -- 172.21.15.60:0/3235084756 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffab0004a00 con 0x7ffac00b64a0 2024-09-12T01:44:25.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.973+0000 7ffac5f23640 1 -- 172.21.15.60:0/3235084756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac015d450 con 0x7ffac00b64a0 2024-09-12T01:44:25.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.974+0000 7ffac5f23640 1 -- 172.21.15.60:0/3235084756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac00b68e0 con 0x7ffac00b64a0 2024-09-12T01:44:25.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.975+0000 7ffabcff9640 1 -- 172.21.15.60:0/3235084756 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffab001a020 con 0x7ffac00b64a0 2024-09-12T01:44:25.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.975+0000 7ffabcff9640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffaa006be60 0x7ffaa006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:25.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.975+0000 7ffab7fff640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffaa006be60 0x7ffaa006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:25.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.975+0000 7ffabcff9640 1 -- 172.21.15.60:0/3235084756 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7ffab008a210 con 0x7ffac00b64a0 2024-09-12T01:44:25.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.976+0000 7ffab7fff640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffaa006be60 0x7ffaa006e320 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8034000 tx=0x7ffaa802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:25.979 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:25.979+0000 7ffabcff9640 1 -- 172.21.15.60:0/3235084756 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffab0058f50 con 0x7ffac00b64a0 2024-09-12T01:44:26.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.156+0000 7ffac5f23640 1 -- 172.21.15.60:0/3235084756 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"} v 0) -- 0x7ffac00b9e20 con 0x7ffac00b64a0 2024-09-12T01:44:26.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.159+0000 7ffabcff9640 1 -- 172.21.15.60:0/3235084756 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_cache_memory_limit"}]=0 v62) ==== 105+0+0 (secure 0 0 0) 0x7ffab0058850 con 0x7ffac00b64a0 2024-09-12T01:44:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.161+0000 7ffac5f23640 1 -- 172.21.15.60:0/3235084756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffaa006be60 msgr2=0x7ffaa006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.161+0000 7ffac5f23640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffaa006be60 0x7ffaa006e320 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ffaa8034000 tx=0x7ffaa802e000 comp rx=0 tx=0).stop 2024-09-12T01:44:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.161+0000 7ffac5f23640 1 -- 172.21.15.60:0/3235084756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac00b64a0 msgr2=0x7ffac015c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.161+0000 7ffac5f23640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac00b64a0 0x7ffac015c4f0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7ffab000c3c0 tx=0x7ffab000c880 comp rx=0 tx=0).stop 2024-09-12T01:44:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.161+0000 7ffac5f23640 1 -- 172.21.15.60:0/3235084756 shutdown_connections 2024-09-12T01:44:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.161+0000 7ffac5f23640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffac015e750 0x7ffac01e8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.161+0000 7ffac5f23640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffaa006be60 0x7ffaa006e320 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.161+0000 7ffac5f23640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffac00b7f50 0x7ffac01f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.161+0000 7ffac5f23640 1 --2- 172.21.15.60:0/3235084756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffac00b64a0 0x7ffac015c4f0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.161+0000 7ffac5f23640 1 -- 172.21.15.60:0/3235084756 >> 172.21.15.60:0/3235084756 conn(0x7ffac00d1500 msgr2=0x7ffac006c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.161+0000 7ffac5f23640 1 -- 172.21.15.60:0/3235084756 shutdown_connections 2024-09-12T01:44:26.163 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.161+0000 7ffac5f23640 1 -- 172.21.15.60:0/3235084756 wait complete. 2024-09-12T01:44:26.173 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T01:44:26.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.277+0000 7f423dfd8640 1 Processor -- start 2024-09-12T01:44:26.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.277+0000 7f423dfd8640 1 -- start start 2024-09-12T01:44:26.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.277+0000 7f423dfd8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380cf1f0 0x7f42380b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.277+0000 7f423dfd8640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42380cf860 con 0x7f42380b6720 2024-09-12T01:44:26.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.277+0000 7f423dfd8640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42380cfb40 con 0x7f423815e7a0 2024-09-12T01:44:26.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.277+0000 7f423dfd8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f42380d2ca0 con 0x7f42380cf1f0 2024-09-12T01:44:26.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4237fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f42380b6720 0x7f42380d3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38776/0 (socket says 172.21.15.60:38776) 2024-09-12T01:44:26.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4237fff640 1 -- 172.21.15.60:0/3612189455 learned_addr learned my addr 172.21.15.60:0/3612189455 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:26.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f422effd640 1 --2- 172.21.15.60:0/3612189455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380cf1f0 0x7f42380b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 851194242 0 0) 0x7f42380cf860 con 0x7f42380b6720 2024-09-12T01:44:26.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4224003520 con 0x7f42380b6720 2024-09-12T01:44:26.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3275295138 0 0) 0x7f4224003520 con 0x7f42380b6720 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380cf1f0 msgr2=0x7f42380b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 --2- 172.21.15.60:0/3612189455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380cf1f0 0x7f42380b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 >> v1:172.21.15.105:6789/0 conn(0x7f423815e7a0 legacy=0x7f423806caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42380cfe20 con 0x7f42380b6720 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f42300019f0 con 0x7f42380b6720 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 >> v1:172.21.15.60:6789/0 conn(0x7f42380b6720 legacy=0x7f42380d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 --2- 172.21.15.60:0/3612189455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380cf1f0 0x7f42240039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 --2- 172.21.15.60:0/3612189455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4224003f20 0x7f4224004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 --2- 172.21.15.60:0/3612189455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4224004d40 0x7f42240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f42380d2ca0 con 0x7f4224003f20 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f422400bad0 con 0x7f4224004d40 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f422400bcd0 con 0x7f42380cf1f0 2024-09-12T01:44:26.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f422effd640 1 --2- 172.21.15.60:0/3612189455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4224003f20 0x7f4224004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.278+0000 7f4237fff640 1 --2- 172.21.15.60:0/3612189455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4224004d40 0x7f42240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.279+0000 7f42377fe640 1 --2- 172.21.15.60:0/3612189455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380cf1f0 0x7f42240039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.279+0000 7f422effd640 1 -- 172.21.15.60:0/3612189455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380cf1f0 msgr2=0x7f42240039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.279+0000 7f422effd640 1 --2- 172.21.15.60:0/3612189455 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380cf1f0 0x7f42240039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.279+0000 7f422effd640 1 -- 172.21.15.60:0/3612189455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4224004d40 msgr2=0x7f42240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.279+0000 7f422effd640 1 --2- 172.21.15.60:0/3612189455 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4224004d40 0x7f42240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.279+0000 7f422effd640 1 -- 172.21.15.60:0/3612189455 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4224003520 con 0x7f4224003f20 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.279+0000 7f422effd640 1 --2- 172.21.15.60:0/3612189455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4224003f20 0x7f4224004800 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f4220009a90 tx=0x7f4224005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8288bdc5b4a53d07 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.280+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220036070 con 0x7f4224003f20 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.280+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4220031400 con 0x7f4224003f20 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.280+0000 7f4236ffd640 1 -- 172.21.15.60:0/3612189455 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220009690 con 0x7f4224003f20 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.280+0000 7f423dfd8640 1 -- 172.21.15.60:0/3612189455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4224003f20 msgr2=0x7f4224004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.280+0000 7f423dfd8640 1 --2- 172.21.15.60:0/3612189455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4224003f20 0x7f4224004800 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f4220009a90 tx=0x7f4224005830 comp rx=0 tx=0).stop 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.280+0000 7f4237fff640 1 -- 172.21.15.60:0/3612189455 reap_dead start 2024-09-12T01:44:26.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.280+0000 7f423dfd8640 1 -- 172.21.15.60:0/3612189455 shutdown_connections 2024-09-12T01:44:26.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.280+0000 7f423dfd8640 1 -- 172.21.15.60:0/3612189455 >> 172.21.15.60:0/3612189455 conn(0x7f42380d11e0 msgr2=0x7f42380d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:26.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.280+0000 7f423dfd8640 1 -- 172.21.15.60:0/3612189455 shutdown_connections 2024-09-12T01:44:26.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.280+0000 7f423dfd8640 1 -- 172.21.15.60:0/3612189455 wait complete. 2024-09-12T01:44:26.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.281+0000 7f423dfd8640 1 Processor -- start 2024-09-12T01:44:26.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.282+0000 7f423dfd8640 1 -- start start 2024-09-12T01:44:26.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.282+0000 7f423dfd8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f423814ed30 0x7f423815ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.282+0000 7f423dfd8640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42380d3310 0x7f42380c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.282+0000 7f423dfd8640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380ca220 0x7f4238161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.282+0000 7f423dfd8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f423815eb80 con 0x7f423814ed30 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.282+0000 7f423dfd8640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f42380b7a00 con 0x7f42380d3310 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.282+0000 7f423dfd8640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f423815ed00 con 0x7f42380ca220 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f42377fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f423814ed30 0x7f423815ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f42377fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f423814ed30 0x7f423815ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45928/0 (socket says 172.21.15.60:45928) 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f42377fe640 1 -- 172.21.15.60:0/3619667925 learned_addr learned my addr 172.21.15.60:0/3619667925 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f422effd640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42380d3310 0x7f42380c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f4237fff640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380ca220 0x7f4238161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f42377fe640 1 -- 172.21.15.60:0/3619667925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380ca220 msgr2=0x7f4238161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f42377fe640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380ca220 0x7f4238161100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f42377fe640 1 -- 172.21.15.60:0/3619667925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42380d3310 msgr2=0x7f42380c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f42377fe640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42380d3310 0x7f42380c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f42377fe640 1 -- 172.21.15.60:0/3619667925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4238160660 con 0x7f423814ed30 2024-09-12T01:44:26.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f42377fe640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f423814ed30 0x7f423815ee80 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f422800f7c0 tx=0x7f422800fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:26.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f4234ff9640 1 -- 172.21.15.60:0/3619667925 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42280052e0 con 0x7f423814ed30 2024-09-12T01:44:26.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f4234ff9640 1 -- 172.21.15.60:0/3619667925 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4228018070 con 0x7f423814ed30 2024-09-12T01:44:26.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f423dfd8640 1 -- 172.21.15.60:0/3619667925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42380cab60 con 0x7f423814ed30 2024-09-12T01:44:26.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f4234ff9640 1 -- 172.21.15.60:0/3619667925 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422800d970 con 0x7f423814ed30 2024-09-12T01:44:26.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.283+0000 7f423dfd8640 1 -- 172.21.15.60:0/3619667925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4238160900 con 0x7f423814ed30 2024-09-12T01:44:26.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.284+0000 7f423dfd8640 1 -- 172.21.15.60:0/3619667925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42380cb080 con 0x7f423814ed30 2024-09-12T01:44:26.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.285+0000 7f4234ff9640 1 -- 172.21.15.60:0/3619667925 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f422800db10 con 0x7f423814ed30 2024-09-12T01:44:26.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.285+0000 7f4234ff9640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f421806be60 0x7f421806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.285+0000 7f4234ff9640 1 -- 172.21.15.60:0/3619667925 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7f422808aa50 con 0x7f423814ed30 2024-09-12T01:44:26.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.285+0000 7f422effd640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f421806be60 0x7f421806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.286+0000 7f422effd640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f421806be60 0x7f421806e320 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4220033000 tx=0x7f4220008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:26.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.290+0000 7f4234ff9640 1 -- 172.21.15.60:0/3619667925 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f42380cb080 con 0x7f423814ed30 2024-09-12T01:44:26.466 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.465+0000 7f423dfd8640 1 -- 172.21.15.60:0/3619667925 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f42380b61e0 con 0x7f423814ed30 2024-09-12T01:44:26.469 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.468+0000 7f4234ff9640 1 -- 172.21.15.60:0/3619667925 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v63) ==== 104+0+0 (secure 0 0 0) 0x7f4228059700 con 0x7f423814ed30 2024-09-12T01:44:26.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.470+0000 7f423dfd8640 1 -- 172.21.15.60:0/3619667925 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f421806be60 msgr2=0x7f421806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.470+0000 7f423dfd8640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f421806be60 0x7f421806e320 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4220033000 tx=0x7f4220008030 comp rx=0 tx=0).stop 2024-09-12T01:44:26.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.470+0000 7f423dfd8640 1 -- 172.21.15.60:0/3619667925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f423814ed30 msgr2=0x7f423815ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.471 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.470+0000 7f423dfd8640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f423814ed30 0x7f423815ee80 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f422800f7c0 tx=0x7f422800fc80 comp rx=0 tx=0).stop 2024-09-12T01:44:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.470+0000 7f423dfd8640 1 -- 172.21.15.60:0/3619667925 shutdown_connections 2024-09-12T01:44:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.471+0000 7f423dfd8640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f421806be60 0x7f421806e320 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.471+0000 7f423dfd8640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42380ca220 0x7f4238161100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.471+0000 7f423dfd8640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f42380d3310 0x7f42380c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.471+0000 7f423dfd8640 1 --2- 172.21.15.60:0/3619667925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f423814ed30 0x7f423815ee80 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.472 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.471+0000 7f423dfd8640 1 -- 172.21.15.60:0/3619667925 >> 172.21.15.60:0/3619667925 conn(0x7f42380d11e0 msgr2=0x7f42380b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:26.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.471+0000 7f423dfd8640 1 -- 172.21.15.60:0/3619667925 shutdown_connections 2024-09-12T01:44:26.473 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.471+0000 7f423dfd8640 1 -- 172.21.15.60:0/3619667925 wait complete. 2024-09-12T01:44:26.483 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_max_caps 2024-09-12T01:44:26.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.587+0000 7f3c63f2a640 1 Processor -- start 2024-09-12T01:44:26.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.587+0000 7f3c63f2a640 1 -- start start 2024-09-12T01:44:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.588+0000 7f3c63f2a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3c5c15e6d0 0x7f3c5c073c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.588+0000 7f3c63f2a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3c5c06d6c0 0x7f3c5c0cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.588+0000 7f3c63f2a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c5c06dba0 con 0x7f3c5c0cf350 2024-09-12T01:44:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.588+0000 7f3c63f2a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f3c5c0d1070 con 0x7f3c5c06d6c0 2024-09-12T01:44:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.588+0000 7f3c63f2a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f3c5c0d1350 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.588+0000 7f3c614c5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3c5c06d6c0 0x7f3c5c0cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.588+0000 7f3c624c7640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3c5c0cf350 0x7f3c5c06f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38780/0 (socket says 172.21.15.60:38780) 2024-09-12T01:44:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.588+0000 7f3c614c5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3c5c06d6c0 0x7f3c5c0cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45944/0 (socket says 172.21.15.60:45944) 2024-09-12T01:44:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.588+0000 7f3c624c7640 1 -- 172.21.15.60:0/4021247524 learned_addr learned my addr 172.21.15.60:0/4021247524 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:26.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.589+0000 7f3c61cc6640 1 --2- 172.21.15.60:0/4021247524 >> v2:172.21.15.105:3300/0 conn(0x7f3c5c15e6d0 0x7f3c5c073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.589+0000 7f3c614c5640 1 -- 172.21.15.60:0/4021247524 >> v2:172.21.15.105:3300/0 conn(0x7f3c5c15e6d0 msgr2=0x7f3c5c073c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.589+0000 7f3c614c5640 1 --2- 172.21.15.60:0/4021247524 >> v2:172.21.15.105:3300/0 conn(0x7f3c5c15e6d0 0x7f3c5c073c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.589+0000 7f3c614c5640 1 -- 172.21.15.60:0/4021247524 >> v1:172.21.15.60:6789/0 conn(0x7f3c5c0cf350 legacy=0x7f3c5c06f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.589+0000 7f3c614c5640 1 -- 172.21.15.60:0/4021247524 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5c15eab0 con 0x7f3c5c06d6c0 2024-09-12T01:44:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.589+0000 7f3c60cc4640 1 -- 172.21.15.60:0/4021247524 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459190754 0 0) 0x7f3c5c06dba0 con 0x7f3c5c0cf350 2024-09-12T01:44:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.589+0000 7f3c61cc6640 1 --2- 172.21.15.60:0/4021247524 >> v2:172.21.15.105:3300/0 conn(0x7f3c5c15e6d0 0x7f3c5c073c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.589+0000 7f3c614c5640 1 --2- 172.21.15.60:0/4021247524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c06d6c0 0x7f3c5c0cee10 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0d3480 tx=0x7f3c4c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a5d159f0104e65 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.590+0000 7f3c60cc4640 1 -- 172.21.15.60:0/4021247524 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c037070 con 0x7f3c5c06d6c0 2024-09-12T01:44:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.590+0000 7f3c60cc4640 1 -- 172.21.15.60:0/4021247524 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c4c032440 con 0x7f3c5c06d6c0 2024-09-12T01:44:26.591 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.590+0000 7f3c60cc4640 1 -- 172.21.15.60:0/4021247524 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c02ae60 con 0x7f3c5c06d6c0 2024-09-12T01:44:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.590+0000 7f3c63f2a640 1 -- 172.21.15.60:0/4021247524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c06d6c0 msgr2=0x7f3c5c0cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.590+0000 7f3c63f2a640 1 --2- 172.21.15.60:0/4021247524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c06d6c0 0x7f3c5c0cee10 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0d3480 tx=0x7f3c4c02a110 comp rx=0 tx=0).stop 2024-09-12T01:44:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.590+0000 7f3c63f2a640 1 -- 172.21.15.60:0/4021247524 shutdown_connections 2024-09-12T01:44:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.590+0000 7f3c63f2a640 1 --2- 172.21.15.60:0/4021247524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c06d6c0 0x7f3c5c0cee10 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.590+0000 7f3c63f2a640 1 --2- 172.21.15.60:0/4021247524 >> v2:172.21.15.105:3300/0 conn(0x7f3c5c15e6d0 0x7f3c5c073c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.590+0000 7f3c63f2a640 1 -- 172.21.15.60:0/4021247524 >> 172.21.15.60:0/4021247524 conn(0x7f3c5c0b7d70 msgr2=0x7f3c5c062630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.590+0000 7f3c63f2a640 1 -- 172.21.15.60:0/4021247524 shutdown_connections 2024-09-12T01:44:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.590+0000 7f3c63f2a640 1 -- 172.21.15.60:0/4021247524 wait complete. 2024-09-12T01:44:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.591+0000 7f3c63f2a640 1 Processor -- start 2024-09-12T01:44:26.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.591+0000 7f3c63f2a640 1 -- start start 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.592+0000 7f3c63f2a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c5c06d6c0 0x7f3c5c159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.592+0000 7f3c63f2a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c5c0cf350 0x7f3c5c1609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.592+0000 7f3c63f2a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c15e6d0 0x7f3c5c0ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.592+0000 7f3c63f2a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c0d2ee0 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.592+0000 7f3c63f2a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c0d2d60 con 0x7f3c5c06d6c0 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.592+0000 7f3c63f2a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f3c5c0d3060 con 0x7f3c5c0cf350 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.592+0000 7f3c624c7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c15e6d0 0x7f3c5c0ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.592+0000 7f3c624c7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c15e6d0 0x7f3c5c0ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45950/0 (socket says 172.21.15.60:45950) 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.592+0000 7f3c624c7640 1 -- 172.21.15.60:0/969730676 learned_addr learned my addr 172.21.15.60:0/969730676 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.592+0000 7f3c61cc6640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c5c06d6c0 0x7f3c5c159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c614c5640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c5c0cf350 0x7f3c5c1609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c624c7640 1 -- 172.21.15.60:0/969730676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c5c0cf350 msgr2=0x7f3c5c1609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.595 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c624c7640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c5c0cf350 0x7f3c5c1609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c624c7640 1 -- 172.21.15.60:0/969730676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c5c06d6c0 msgr2=0x7f3c5c159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c624c7640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c5c06d6c0 0x7f3c5c159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c624c7640 1 -- 172.21.15.60:0/969730676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5c0cb7e0 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c61cc6640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c5c06d6c0 0x7f3c5c159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c624c7640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c15e6d0 0x7f3c5c0ccdb0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c730 tx=0x7f3c5400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c527fc640 1 -- 172.21.15.60:0/969730676 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c54018070 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c527fc640 1 -- 172.21.15.60:0/969730676 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c5400ce40 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c63f2a640 1 -- 172.21.15.60:0/969730676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5c0cbac0 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c527fc640 1 -- 172.21.15.60:0/969730676 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400a860 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.593+0000 7f3c63f2a640 1 -- 172.21.15.60:0/969730676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c5c0cc080 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.596 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.594+0000 7f3c63f2a640 1 -- 172.21.15.60:0/969730676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c5c06c740 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.595+0000 7f3c527fc640 1 -- 172.21.15.60:0/969730676 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f3c5401b070 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.595+0000 7f3c527fc640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3c4006be30 0x7f3c4006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.595+0000 7f3c527fc640 1 -- 172.21.15.60:0/969730676 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7f3c5408a180 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.595+0000 7f3c61cc6640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3c4006be30 0x7f3c4006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.597 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.596+0000 7f3c61cc6640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3c4006be30 0x7f3c4006e2f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800a990 tx=0x7f3c58008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:26.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.600+0000 7f3c527fc640 1 -- 172.21.15.60:0/969730676 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f3c54058e30 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.777 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.776+0000 7f3c63f2a640 1 -- 172.21.15.60:0/969730676 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"} v 0) -- 0x7f3c5c0d1d90 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.780 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.779+0000 7f3c527fc640 1 -- 172.21.15.60:0/969730676 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_max_caps"}]=0 v64) ==== 102+0+0 (secure 0 0 0) 0x7f3c54058730 con 0x7f3c5c15e6d0 2024-09-12T01:44:26.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.782+0000 7f3c63f2a640 1 -- 172.21.15.60:0/969730676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3c4006be30 msgr2=0x7f3c4006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.782 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.782+0000 7f3c63f2a640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3c4006be30 0x7f3c4006e2f0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800a990 tx=0x7f3c58008040 comp rx=0 tx=0).stop 2024-09-12T01:44:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.782+0000 7f3c63f2a640 1 -- 172.21.15.60:0/969730676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c15e6d0 msgr2=0x7f3c5c0ccdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.782+0000 7f3c63f2a640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c15e6d0 0x7f3c5c0ccdb0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c730 tx=0x7f3c5400cbf0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.782+0000 7f3c63f2a640 1 -- 172.21.15.60:0/969730676 shutdown_connections 2024-09-12T01:44:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.782+0000 7f3c63f2a640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c5c15e6d0 0x7f3c5c0ccdb0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.782+0000 7f3c63f2a640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f3c4006be30 0x7f3c4006e2f0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.782+0000 7f3c63f2a640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3c5c0cf350 0x7f3c5c1609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.782+0000 7f3c63f2a640 1 --2- 172.21.15.60:0/969730676 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f3c5c06d6c0 0x7f3c5c159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.782+0000 7f3c63f2a640 1 -- 172.21.15.60:0/969730676 >> 172.21.15.60:0/969730676 conn(0x7f3c5c0b7d70 msgr2=0x7f3c5c0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.782+0000 7f3c63f2a640 1 -- 172.21.15.60:0/969730676 shutdown_connections 2024-09-12T01:44:26.783 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.782+0000 7f3c63f2a640 1 -- 172.21.15.60:0/969730676 wait complete. 2024-09-12T01:44:26.793 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_recall_warning_threshold 2024-09-12T01:44:26.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.897+0000 7efc3af11640 1 Processor -- start 2024-09-12T01:44:26.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.897+0000 7efc3af11640 1 -- start start 2024-09-12T01:44:26.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.898+0000 7efc3af11640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc340d1c10 0x7efc340cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.898+0000 7efc3af11640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7efc340cf2f0 0x7efc340d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.898+0000 7efc3af11640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc340b7ad0 con 0x7efc3415e600 2024-09-12T01:44:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.898+0000 7efc3af11640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7efc340d2ee0 con 0x7efc340d1c10 2024-09-12T01:44:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.898+0000 7efc3af11640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7efc340cf760 con 0x7efc340cf2f0 2024-09-12T01:44:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.898+0000 7efc33fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc340d1c10 0x7efc340cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.898+0000 7efc33fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc340d1c10 0x7efc340cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45964/0 (socket says 172.21.15.60:45964) 2024-09-12T01:44:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.898+0000 7efc33fff640 1 -- 172.21.15.60:0/645175634 learned_addr learned my addr 172.21.15.60:0/645175634 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.899+0000 7efc33fff640 1 -- 172.21.15.60:0/645175634 >> v2:172.21.15.105:3300/0 conn(0x7efc340cf2f0 msgr2=0x7efc340d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.899+0000 7efc394ae640 1 --2- 172.21.15.60:0/645175634 >> v2:172.21.15.105:3300/0 conn(0x7efc340cf2f0 0x7efc340d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.899+0000 7efc33fff640 1 --2- 172.21.15.60:0/645175634 >> v2:172.21.15.105:3300/0 conn(0x7efc340cf2f0 0x7efc340d3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.899+0000 7efc337fe640 1 -- 172.21.15.60:0/645175634 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1661444372 0 0) 0x7efc24001110 con 0x7efc3415e600 2024-09-12T01:44:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.899+0000 7efc33fff640 1 -- 172.21.15.60:0/645175634 >> v1:172.21.15.60:6789/0 conn(0x7efc3415e600 legacy=0x7efc340d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.900 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.899+0000 7efc33fff640 1 -- 172.21.15.60:0/645175634 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc340cf9e0 con 0x7efc340d1c10 2024-09-12T01:44:26.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.899+0000 7efc394ae640 1 --2- 172.21.15.60:0/645175634 >> v2:172.21.15.105:3300/0 conn(0x7efc340cf2f0 0x7efc340d3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.899+0000 7efc33fff640 1 --2- 172.21.15.60:0/645175634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc340d1c10 0x7efc340cedb0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7efc340d23c0 tx=0x7efc2802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f910e6ffa523077 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.900+0000 7efc337fe640 1 -- 172.21.15.60:0/645175634 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28037070 con 0x7efc340d1c10 2024-09-12T01:44:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.900+0000 7efc337fe640 1 -- 172.21.15.60:0/645175634 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc28032440 con 0x7efc340d1c10 2024-09-12T01:44:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.900+0000 7efc337fe640 1 -- 172.21.15.60:0/645175634 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28032810 con 0x7efc340d1c10 2024-09-12T01:44:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.900+0000 7efc3af11640 1 -- 172.21.15.60:0/645175634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc340d1c10 msgr2=0x7efc340cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.900+0000 7efc3af11640 1 --2- 172.21.15.60:0/645175634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc340d1c10 0x7efc340cedb0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7efc340d23c0 tx=0x7efc2802a270 comp rx=0 tx=0).stop 2024-09-12T01:44:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.900+0000 7efc3af11640 1 -- 172.21.15.60:0/645175634 shutdown_connections 2024-09-12T01:44:26.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.900+0000 7efc3af11640 1 --2- 172.21.15.60:0/645175634 >> v2:172.21.15.105:3300/0 conn(0x7efc340cf2f0 0x7efc340d3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.900+0000 7efc3af11640 1 --2- 172.21.15.60:0/645175634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc340d1c10 0x7efc340cedb0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.900+0000 7efc3af11640 1 -- 172.21.15.60:0/645175634 >> 172.21.15.60:0/645175634 conn(0x7efc3406c2c0 msgr2=0x7efc3406c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.900+0000 7efc3af11640 1 -- 172.21.15.60:0/645175634 shutdown_connections 2024-09-12T01:44:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.900+0000 7efc3af11640 1 -- 172.21.15.60:0/645175634 wait complete. 2024-09-12T01:44:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.901+0000 7efc3af11640 1 Processor -- start 2024-09-12T01:44:26.903 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.901+0000 7efc3af11640 1 -- start start 2024-09-12T01:44:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.902+0000 7efc3af11640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc340cf2f0 0x7efc341f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.902+0000 7efc3af11640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc340d1c10 0x7efc340cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.902+0000 7efc3af11640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc3415e600 0x7efc3415a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.902+0000 7efc3af11640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7efc340d2b70 con 0x7efc340d1c10 2024-09-12T01:44:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.902+0000 7efc3af11640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7efc340cffa0 con 0x7efc340cf2f0 2024-09-12T01:44:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.902+0000 7efc3af11640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7efc3415e9e0 con 0x7efc3415e600 2024-09-12T01:44:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.902+0000 7efc33fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc340d1c10 0x7efc340cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.902+0000 7efc33fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc340d1c10 0x7efc340cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45980/0 (socket says 172.21.15.60:45980) 2024-09-12T01:44:26.905 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.902+0000 7efc33fff640 1 -- 172.21.15.60:0/4291485238 learned_addr learned my addr 172.21.15.60:0/4291485238 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc38cad640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc340cf2f0 0x7efc341f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc394ae640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc3415e600 0x7efc3415a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc33fff640 1 -- 172.21.15.60:0/4291485238 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc3415e600 msgr2=0x7efc3415a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc33fff640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc3415e600 0x7efc3415a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc33fff640 1 -- 172.21.15.60:0/4291485238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc340cf2f0 msgr2=0x7efc341f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc33fff640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc340cf2f0 0x7efc341f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc33fff640 1 -- 172.21.15.60:0/4291485238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc341f5820 con 0x7efc340d1c10 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc33fff640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc340d1c10 0x7efc340cdb10 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7efc2802a2b0 tx=0x7efc280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc317fa640 1 -- 172.21.15.60:0/4291485238 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28037040 con 0x7efc340d1c10 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc317fa640 1 -- 172.21.15.60:0/4291485238 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc28042070 con 0x7efc340d1c10 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc3af11640 1 -- 172.21.15.60:0/4291485238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc341e6500 con 0x7efc340d1c10 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc317fa640 1 -- 172.21.15.60:0/4291485238 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28030bb0 con 0x7efc340d1c10 2024-09-12T01:44:26.906 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.903+0000 7efc3af11640 1 -- 172.21.15.60:0/4291485238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc341e3c70 con 0x7efc340d1c10 2024-09-12T01:44:26.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.904+0000 7efc3af11640 1 -- 172.21.15.60:0/4291485238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc341e3a80 con 0x7efc340d1c10 2024-09-12T01:44:26.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.905+0000 7efc317fa640 1 -- 172.21.15.60:0/4291485238 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7efc28047460 con 0x7efc340d1c10 2024-09-12T01:44:26.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.905+0000 7efc317fa640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efc2006be30 0x7efc2006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:26.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.905+0000 7efc317fa640 1 -- 172.21.15.60:0/4291485238 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7efc280ab6c0 con 0x7efc340d1c10 2024-09-12T01:44:26.907 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.905+0000 7efc38cad640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efc2006be30 0x7efc2006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:26.908 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.906+0000 7efc38cad640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efc2006be30 0x7efc2006e2f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7efc24000f60 tx=0x7efc24009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:26.910 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:26.910+0000 7efc317fa640 1 -- 172.21.15.60:0/4291485238 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7efc341f5820 con 0x7efc340d1c10 2024-09-12T01:44:27.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.084+0000 7efc3af11640 1 -- 172.21.15.60:0/4291485238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"} v 0) -- 0x7efc340cedb0 con 0x7efc340d1c10 2024-09-12T01:44:27.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.087+0000 7efc317fa640 1 -- 172.21.15.60:0/4291485238 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_recall_warning_threshold"}]=0 v65) ==== 111+0+0 (secure 0 0 0) 0x7efc2807a400 con 0x7efc340d1c10 2024-09-12T01:44:27.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.089+0000 7efc3af11640 1 -- 172.21.15.60:0/4291485238 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efc2006be30 msgr2=0x7efc2006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.089+0000 7efc3af11640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efc2006be30 0x7efc2006e2f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7efc24000f60 tx=0x7efc24009040 comp rx=0 tx=0).stop 2024-09-12T01:44:27.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.089+0000 7efc3af11640 1 -- 172.21.15.60:0/4291485238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc340d1c10 msgr2=0x7efc340cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.089+0000 7efc3af11640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc340d1c10 0x7efc340cdb10 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7efc2802a2b0 tx=0x7efc280046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.090+0000 7efc3af11640 1 -- 172.21.15.60:0/4291485238 shutdown_connections 2024-09-12T01:44:27.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.090+0000 7efc3af11640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7efc2006be30 0x7efc2006e2f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.090+0000 7efc3af11640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7efc3415e600 0x7efc3415a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.090+0000 7efc3af11640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc340d1c10 0x7efc340cdb10 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.090+0000 7efc3af11640 1 --2- 172.21.15.60:0/4291485238 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7efc340cf2f0 0x7efc341f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.090+0000 7efc3af11640 1 -- 172.21.15.60:0/4291485238 >> 172.21.15.60:0/4291485238 conn(0x7efc3406c2c0 msgr2=0x7efc340b5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:27.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.090+0000 7efc3af11640 1 -- 172.21.15.60:0/4291485238 shutdown_connections 2024-09-12T01:44:27.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.090+0000 7efc3af11640 1 -- 172.21.15.60:0/4291485238 wait complete. 2024-09-12T01:44:27.101 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root' 2024-09-12T01:44:27.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.204+0000 7fb210b49640 1 Processor -- start 2024-09-12T01:44:27.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.204+0000 7fb210b49640 1 -- start start 2024-09-12T01:44:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.205+0000 7fb210b49640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb20c0d1c80 0x7fb20c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.205+0000 7fb210b49640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb20c0cfc20 con 0x7fb20c0b63d0 2024-09-12T01:44:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.205+0000 7fb210b49640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb20c0d2ed0 con 0x7fb20c0cf6b0 2024-09-12T01:44:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.205+0000 7fb210b49640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb20c0d40c0 con 0x7fb20c0d1c80 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.205+0000 7fb20a59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb20c0b63d0 0x7fb20c0d39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38806/0 (socket says 172.21.15.60:38806) 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.205+0000 7fb20a59c640 1 -- 172.21.15.60:0/4269305236 learned_addr learned my addr 172.21.15.60:0/4269305236 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.205+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2452328864 0 0) 0x7fb20c0cfc20 con 0x7fb20c0b63d0 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.205+0000 7fb20ad9d640 1 --2- 172.21.15.60:0/4269305236 >> v2:172.21.15.105:3300/0 conn(0x7fb20c0d1c80 0x7fb20c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.205+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f8003520 con 0x7fb20c0b63d0 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3774632841 0 0) 0x7fb1f8003520 con 0x7fb20c0b63d0 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 >> v2:172.21.15.105:3300/0 conn(0x7fb20c0d1c80 msgr2=0x7fb20c0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 --2- 172.21.15.60:0/4269305236 >> v2:172.21.15.105:3300/0 conn(0x7fb20c0d1c80 0x7fb20c0b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 >> v1:172.21.15.105:6789/0 conn(0x7fb20c0cf6b0 legacy=0x7fb20c1629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20c0d31b0 con 0x7fb20c0b63d0 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fb1fc0019f0 con 0x7fb20c0b63d0 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 >> v1:172.21.15.60:6789/0 conn(0x7fb20c0b63d0 legacy=0x7fb20c0d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 --2- 172.21.15.60:0/4269305236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1f80039b0 0x7fb1f8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 --2- 172.21.15.60:0/4269305236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1f8004800 0x7fb1f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 --2- 172.21.15.60:0/4269305236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1f80051c0 0x7fb1f800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c0d40c0 con 0x7fb1f8004800 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f800c160 con 0x7fb1f80039b0 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f800c360 con 0x7fb1f80051c0 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb209d9b640 1 --2- 172.21.15.60:0/4269305236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1f8004800 0x7fb1f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20a59c640 1 --2- 172.21.15.60:0/4269305236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1f80039b0 0x7fb1f8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20ad9d640 1 --2- 172.21.15.60:0/4269305236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1f80051c0 0x7fb1f800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb209d9b640 1 -- 172.21.15.60:0/4269305236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1f80051c0 msgr2=0x7fb1f800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb209d9b640 1 --2- 172.21.15.60:0/4269305236 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1f80051c0 0x7fb1f800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb209d9b640 1 -- 172.21.15.60:0/4269305236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1f80039b0 msgr2=0x7fb1f8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb209d9b640 1 --2- 172.21.15.60:0/4269305236 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb1f80039b0 0x7fb1f8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb209d9b640 1 -- 172.21.15.60:0/4269305236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f8003520 con 0x7fb1f8004800 2024-09-12T01:44:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.206+0000 7fb20ad9d640 1 -- 172.21.15.60:0/4269305236 reap_dead start 2024-09-12T01:44:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.207+0000 7fb209d9b640 1 --2- 172.21.15.60:0/4269305236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1f8004800 0x7fb1f8004c80 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4001750 tx=0x7fb1f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a3933a77a1cff5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.207+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4001370 con 0x7fb1f8004800 2024-09-12T01:44:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.207+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f40052d0 con 0x7fb1f8004800 2024-09-12T01:44:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.207+0000 7fb20959a640 1 -- 172.21.15.60:0/4269305236 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f402abc0 con 0x7fb1f8004800 2024-09-12T01:44:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.207+0000 7fb210b49640 1 -- 172.21.15.60:0/4269305236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1f8004800 msgr2=0x7fb1f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.207+0000 7fb210b49640 1 --2- 172.21.15.60:0/4269305236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1f8004800 0x7fb1f8004c80 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4001750 tx=0x7fb1f8005830 comp rx=0 tx=0).stop 2024-09-12T01:44:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.208+0000 7fb210b49640 1 -- 172.21.15.60:0/4269305236 shutdown_connections 2024-09-12T01:44:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.208+0000 7fb210b49640 1 --2- 172.21.15.60:0/4269305236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1f8004800 0x7fb1f8004c80 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.208+0000 7fb210b49640 1 -- 172.21.15.60:0/4269305236 >> 172.21.15.60:0/4269305236 conn(0x7fb20c0d1160 msgr2=0x7fb20c0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.208+0000 7fb210b49640 1 -- 172.21.15.60:0/4269305236 shutdown_connections 2024-09-12T01:44:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.208+0000 7fb210b49640 1 -- 172.21.15.60:0/4269305236 wait complete. 2024-09-12T01:44:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.209+0000 7fb210b49640 1 Processor -- start 2024-09-12T01:44:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.209+0000 7fb210b49640 1 -- start start 2024-09-12T01:44:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb210b49640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1f8004800 0x7fb20c159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb210b49640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb20c15ba10 0x7fb20c15be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb210b49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20c161b00 0x7fb20c161f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb210b49640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c0cb5c0 con 0x7fb20c161b00 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb210b49640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c0cb440 con 0x7fb20c15ba10 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb210b49640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb20c0b67b0 con 0x7fb1f8004800 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb20ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20c161b00 0x7fb20c161f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb20ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20c161b00 0x7fb20c161f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45990/0 (socket says 172.21.15.60:45990) 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb20ad9d640 1 -- 172.21.15.60:0/707506758 learned_addr learned my addr 172.21.15.60:0/707506758 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb209d9b640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb20c15ba10 0x7fb20c15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb20a59c640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1f8004800 0x7fb20c159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb20ad9d640 1 -- 172.21.15.60:0/707506758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1f8004800 msgr2=0x7fb20c159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb20ad9d640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1f8004800 0x7fb20c159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb20ad9d640 1 -- 172.21.15.60:0/707506758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb20c15ba10 msgr2=0x7fb20c15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb20ad9d640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb20c15ba10 0x7fb20c15be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb20ad9d640 1 -- 172.21.15.60:0/707506758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20c15c4d0 con 0x7fb20c161b00 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb20a59c640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1f8004800 0x7fb20c159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb20ad9d640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20c161b00 0x7fb20c161f80 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0d0280 tx=0x7fb204009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb202ffd640 1 -- 172.21.15.60:0/707506758 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb204003610 con 0x7fb20c161b00 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.210+0000 7fb202ffd640 1 -- 172.21.15.60:0/707506758 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb20401b070 con 0x7fb20c161b00 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.211+0000 7fb210b49640 1 -- 172.21.15.60:0/707506758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20c15c7b0 con 0x7fb20c161b00 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.211+0000 7fb202ffd640 1 -- 172.21.15.60:0/707506758 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2040039f0 con 0x7fb20c161b00 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.211+0000 7fb210b49640 1 -- 172.21.15.60:0/707506758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20c15cd70 con 0x7fb20c161b00 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.211+0000 7fb210b49640 1 -- 172.21.15.60:0/707506758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb20c0d39b0 con 0x7fb20c161b00 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.212+0000 7fb202ffd640 1 -- 172.21.15.60:0/707506758 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb204003b90 con 0x7fb20c161b00 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.212+0000 7fb202ffd640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb1ec06be30 0x7fb1ec06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.213+0000 7fb202ffd640 1 -- 172.21.15.60:0/707506758 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7fb20408ae20 con 0x7fb20c161b00 2024-09-12T01:44:27.215 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.213+0000 7fb20a59c640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb1ec06be30 0x7fb1ec06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.216 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.213+0000 7fb20a59c640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb1ec06be30 0x7fb1ec06e2f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc002230 tx=0x7fb1fc006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:27.217 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.217+0000 7fb202ffd640 1 -- 172.21.15.60:0/707506758 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb204059b60 con 0x7fb20c161b00 2024-09-12T01:44:27.458 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.457+0000 7fb210b49640 1 -- 172.21.15.60:0/707506758 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]} v 0) -- 0x7fb20c0cf280 con 0x7fb20c161b00 2024-09-12T01:44:27.521 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.520+0000 7fb202ffd640 1 -- 172.21.15.60:0/707506758 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_pin_root"]}]=0 v430) ==== 148+0+0 (secure 0 0 0) 0x7fb204059460 con 0x7fb20c161b00 2024-09-12T01:44:27.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.522+0000 7fb210b49640 1 -- 172.21.15.60:0/707506758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb1ec06be30 msgr2=0x7fb1ec06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.522+0000 7fb210b49640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb1ec06be30 0x7fb1ec06e2f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc002230 tx=0x7fb1fc006040 comp rx=0 tx=0).stop 2024-09-12T01:44:27.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.522+0000 7fb210b49640 1 -- 172.21.15.60:0/707506758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20c161b00 msgr2=0x7fb20c161f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.523 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.522+0000 7fb210b49640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20c161b00 0x7fb20c161f80 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0d0280 tx=0x7fb204009f90 comp rx=0 tx=0).stop 2024-09-12T01:44:27.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.522+0000 7fb210b49640 1 -- 172.21.15.60:0/707506758 shutdown_connections 2024-09-12T01:44:27.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.522+0000 7fb210b49640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20c161b00 0x7fb20c161f80 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.522+0000 7fb210b49640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb20c15ba10 0x7fb20c15be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.522+0000 7fb210b49640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb1ec06be30 0x7fb1ec06e2f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.522+0000 7fb210b49640 1 --2- 172.21.15.60:0/707506758 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb1f8004800 0x7fb20c159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.523+0000 7fb210b49640 1 -- 172.21.15.60:0/707506758 >> 172.21.15.60:0/707506758 conn(0x7fb20c0d1160 msgr2=0x7fb20c0b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:27.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.523+0000 7fb210b49640 1 -- 172.21.15.60:0/707506758 shutdown_connections 2024-09-12T01:44:27.524 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.523+0000 7fb210b49640 1 -- 172.21.15.60:0/707506758 wait complete. 2024-09-12T01:44:27.534 INFO:tasks.cephfs_test_runner:test_client_pin_root (tasks.cephfs.test_client_limits.TestClientLimits) ... ok 2024-09-12T01:44:27.535 INFO:tasks.cephfs_test_runner:Starting test: test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits) When a client has a bug (which we will simulate) preventing it from releasing caps, 2024-09-12T01:44:27.535 INFO:tasks.cephfs_test_runner:test_client_release_bug (tasks.cephfs.test_client_limits.TestClientLimits) 2024-09-12T01:44:27.535 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:44:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.637+0000 7faf02aaf640 1 Processor -- start 2024-09-12T01:44:27.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.637+0000 7faf02aaf640 1 -- start start 2024-09-12T01:44:27.638 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.637+0000 7faf02aaf640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faefc0d1820 0x7faefc1691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.637+0000 7faf02aaf640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faefc15ea40 con 0x7faefc0d3310 2024-09-12T01:44:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.637+0000 7faf02aaf640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faefc0d3870 con 0x7faefc15e660 2024-09-12T01:44:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.637+0000 7faf02aaf640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7faefc0d3b50 con 0x7faefc0d1820 2024-09-12T01:44:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.638+0000 7faf0104c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faefc0d1820 0x7faefc1691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.638+0000 7faefbfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7faefc0d3310 0x7faefc0d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38820/0 (socket says 172.21.15.60:38820) 2024-09-12T01:44:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.638+0000 7faefbfff640 1 -- 172.21.15.60:0/4180143767 learned_addr learned my addr 172.21.15.60:0/4180143767 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.638+0000 7faf0104c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faefc0d1820 0x7faefc1691c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46006/0 (socket says 172.21.15.60:46006) 2024-09-12T01:44:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.638+0000 7faf0104c640 1 -- 172.21.15.60:0/4180143767 >> v1:172.21.15.105:6789/0 conn(0x7faefc15e660 legacy=0x7faefc0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.638+0000 7faf0104c640 1 -- 172.21.15.60:0/4180143767 >> v1:172.21.15.60:6789/0 conn(0x7faefc0d3310 legacy=0x7faefc0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.639 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.638+0000 7faf0104c640 1 -- 172.21.15.60:0/4180143767 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faefc0d3e30 con 0x7faefc0d1820 2024-09-12T01:44:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.639+0000 7faf0104c640 1 --2- 172.21.15.60:0/4180143767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faefc0d1820 0x7faefc1691c0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7faef40097a0 tx=0x7faef402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3300db802e9641c server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.639+0000 7faefb7fe640 1 -- 172.21.15.60:0/4180143767 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4037070 con 0x7faefc0d1820 2024-09-12T01:44:27.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.639+0000 7faefb7fe640 1 -- 172.21.15.60:0/4180143767 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef4032440 con 0x7faefc0d1820 2024-09-12T01:44:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.639+0000 7faefb7fe640 1 -- 172.21.15.60:0/4180143767 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4032810 con 0x7faefc0d1820 2024-09-12T01:44:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.639+0000 7faf02aaf640 1 -- 172.21.15.60:0/4180143767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faefc0d1820 msgr2=0x7faefc1691c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.639+0000 7faf02aaf640 1 --2- 172.21.15.60:0/4180143767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faefc0d1820 0x7faefc1691c0 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7faef40097a0 tx=0x7faef402a230 comp rx=0 tx=0).stop 2024-09-12T01:44:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.639+0000 7faf02aaf640 1 -- 172.21.15.60:0/4180143767 shutdown_connections 2024-09-12T01:44:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.639+0000 7faf02aaf640 1 --2- 172.21.15.60:0/4180143767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faefc0d1820 0x7faefc1691c0 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.639+0000 7faf02aaf640 1 -- 172.21.15.60:0/4180143767 >> 172.21.15.60:0/4180143767 conn(0x7faefc0b6410 msgr2=0x7faefc0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.639+0000 7faf02aaf640 1 -- 172.21.15.60:0/4180143767 shutdown_connections 2024-09-12T01:44:27.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.639+0000 7faf02aaf640 1 -- 172.21.15.60:0/4180143767 wait complete. 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.641+0000 7faf02aaf640 1 Processor -- start 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.641+0000 7faf02aaf640 1 -- start start 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.641+0000 7faf02aaf640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faefc0d1820 0x7faefc0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.641+0000 7faf02aaf640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faefc0d3310 0x7faefc157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.641+0000 7faf02aaf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faefc15e660 0x7faefc1577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf02aaf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faefc0b8b80 con 0x7faefc15e660 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf02aaf640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7faefc0d43f0 con 0x7faefc0d3310 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf02aaf640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7faefc0b8d00 con 0x7faefc0d1820 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf0104c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faefc15e660 0x7faefc1577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf0104c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faefc15e660 0x7faefc1577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46016/0 (socket says 172.21.15.60:46016) 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf0104c640 1 -- 172.21.15.60:0/3152829154 learned_addr learned my addr 172.21.15.60:0/3152829154 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faefbfff640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faefc0d3310 0x7faefc157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf0084b640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faefc0d1820 0x7faefc0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf0104c640 1 -- 172.21.15.60:0/3152829154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faefc0d1820 msgr2=0x7faefc0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf0104c640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faefc0d1820 0x7faefc0ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf0104c640 1 -- 172.21.15.60:0/3152829154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faefc0d3310 msgr2=0x7faefc157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf0104c640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faefc0d3310 0x7faefc157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf0104c640 1 -- 172.21.15.60:0/3152829154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faefc15eeb0 con 0x7faefc15e660 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf0084b640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faefc0d1820 0x7faefc0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf0104c640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faefc15e660 0x7faefc1577c0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7faef4035040 tx=0x7faef40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faef97fa640 1 -- 172.21.15.60:0/3152829154 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4037040 con 0x7faefc15e660 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faef97fa640 1 -- 172.21.15.60:0/3152829154 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef4042070 con 0x7faefc15e660 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faef97fa640 1 -- 172.21.15.60:0/3152829154 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef4030b50 con 0x7faefc15e660 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf02aaf640 1 -- 172.21.15.60:0/3152829154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faefc15f190 con 0x7faefc15e660 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.642+0000 7faf02aaf640 1 -- 172.21.15.60:0/3152829154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faefc15f750 con 0x7faefc15e660 2024-09-12T01:44:27.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.643+0000 7faf02aaf640 1 -- 172.21.15.60:0/3152829154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faefc0d1110 con 0x7faefc15e660 2024-09-12T01:44:27.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.644+0000 7faef97fa640 1 -- 172.21.15.60:0/3152829154 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7faef4030cf0 con 0x7faefc15e660 2024-09-12T01:44:27.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.644+0000 7faef97fa640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7faedc06be30 0x7faedc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.644+0000 7faef97fa640 1 -- 172.21.15.60:0/3152829154 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7faef40ab6c0 con 0x7faefc15e660 2024-09-12T01:44:27.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.645+0000 7faf0084b640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7faedc06be30 0x7faedc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.645+0000 7faf0084b640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7faedc06be30 0x7faedc06e2f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7faefc1511b0 tx=0x7faeec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:27.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.649+0000 7faef97fa640 1 -- 172.21.15.60:0/3152829154 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7faef4032e20 con 0x7faefc15e660 2024-09-12T01:44:27.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.825+0000 7faf02aaf640 1 -- 172.21.15.60:0/3152829154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faefc15d2e0 con 0x7faefc15e660 2024-09-12T01:44:27.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.826+0000 7faef97fa640 1 -- 172.21.15.60:0/3152829154 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) ==== 74+0+13008 (secure 0 0 0) 0x7faef4080020 con 0x7faefc15e660 2024-09-12T01:44:27.826 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:27.827 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":131,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:44:25.514990+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6834/2888550162":"2024-09-13T01:44:22.504136+0000","172.21.15.105:6832/2888550162":"2024-09-13T01:44:22.504136+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:44:27.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.828+0000 7faf02aaf640 1 -- 172.21.15.60:0/3152829154 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7faedc06be30 msgr2=0x7faedc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.828+0000 7faf02aaf640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7faedc06be30 0x7faedc06e2f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7faefc1511b0 tx=0x7faeec009040 comp rx=0 tx=0).stop 2024-09-12T01:44:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.828+0000 7faf02aaf640 1 -- 172.21.15.60:0/3152829154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faefc15e660 msgr2=0x7faefc1577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.828+0000 7faf02aaf640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faefc15e660 0x7faefc1577c0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7faef4035040 tx=0x7faef40046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.828+0000 7faf02aaf640 1 -- 172.21.15.60:0/3152829154 shutdown_connections 2024-09-12T01:44:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.828+0000 7faf02aaf640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faefc15e660 0x7faefc1577c0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.828+0000 7faf02aaf640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7faefc0d3310 0x7faefc157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.828+0000 7faf02aaf640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7faedc06be30 0x7faedc06e2f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.828+0000 7faf02aaf640 1 --2- 172.21.15.60:0/3152829154 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7faefc0d1820 0x7faefc0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.828+0000 7faf02aaf640 1 -- 172.21.15.60:0/3152829154 >> 172.21.15.60:0/3152829154 conn(0x7faefc0b6410 msgr2=0x7faefc0b5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.828+0000 7faf02aaf640 1 -- 172.21.15.60:0/3152829154 shutdown_connections 2024-09-12T01:44:27.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.828+0000 7faf02aaf640 1 -- 172.21.15.60:0/3152829154 wait complete. 2024-09-12T01:44:27.840 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-12T01:35:46.304939+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-12T01:44:27.840 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-12T01:44:27.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.945+0000 7f5d01731640 1 Processor -- start 2024-09-12T01:44:27.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.945+0000 7f5d01731640 1 -- start start 2024-09-12T01:44:27.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5d01731640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5cfc15b480 0x7f5cfc0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5d01731640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5cfc0b60c0 0x7f5cfc071ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5d01731640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cfc0ccff0 con 0x7f5cfc072530 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5d01731640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f5cfc072980 con 0x7f5cfc0b60c0 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5d01731640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f5cfc0cd2d0 con 0x7f5cfc15b480 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5cf3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5cfc0b60c0 0x7f5cfc071ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5cfb7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5cfc072530 0x7f5cfc070fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38832/0 (socket says 172.21.15.60:38832) 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5cfb7fe640 1 -- 172.21.15.60:0/1005556280 learned_addr learned my addr 172.21.15.60:0/1005556280 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5cf3fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5cfc0b60c0 0x7f5cfc071ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46018/0 (socket says 172.21.15.60:46018) 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5cfaffd640 1 --2- 172.21.15.60:0/1005556280 >> v2:172.21.15.105:3300/0 conn(0x7f5cfc15b480 0x7f5cfc0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5cf3fff640 1 -- 172.21.15.60:0/1005556280 >> v2:172.21.15.105:3300/0 conn(0x7f5cfc15b480 msgr2=0x7f5cfc0b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5cf3fff640 1 --2- 172.21.15.60:0/1005556280 >> v2:172.21.15.105:3300/0 conn(0x7f5cfc15b480 0x7f5cfc0b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5cf3fff640 1 -- 172.21.15.60:0/1005556280 >> v1:172.21.15.60:6789/0 conn(0x7f5cfc072530 legacy=0x7f5cfc070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5cfa7fc640 1 -- 172.21.15.60:0/1005556280 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3521218044 0 0) 0x7f5cfc0ccff0 con 0x7f5cfc072530 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.946+0000 7f5cf3fff640 1 -- 172.21.15.60:0/1005556280 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc0cd5b0 con 0x7f5cfc0b60c0 2024-09-12T01:44:27.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.947+0000 7f5cf3fff640 1 --2- 172.21.15.60:0/1005556280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cfc0b60c0 0x7f5cfc071ff0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0694d0 tx=0x7f5ce402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d466aa5df25bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.947+0000 7f5cfa7fc640 1 -- 172.21.15.60:0/1005556280 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4037070 con 0x7f5cfc0b60c0 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.947+0000 7f5cfa7fc640 1 -- 172.21.15.60:0/1005556280 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce4032440 con 0x7f5cfc0b60c0 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.947+0000 7f5cfa7fc640 1 -- 172.21.15.60:0/1005556280 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4032810 con 0x7f5cfc0b60c0 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.948+0000 7f5d01731640 1 -- 172.21.15.60:0/1005556280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cfc0b60c0 msgr2=0x7f5cfc071ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.948+0000 7f5d01731640 1 --2- 172.21.15.60:0/1005556280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cfc0b60c0 0x7f5cfc071ff0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0694d0 tx=0x7f5ce402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.948+0000 7f5d01731640 1 -- 172.21.15.60:0/1005556280 shutdown_connections 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.948+0000 7f5d01731640 1 --2- 172.21.15.60:0/1005556280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cfc0b60c0 0x7f5cfc071ff0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.948+0000 7f5d01731640 1 --2- 172.21.15.60:0/1005556280 >> v2:172.21.15.105:3300/0 conn(0x7f5cfc15b480 0x7f5cfc0b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.948+0000 7f5d01731640 1 -- 172.21.15.60:0/1005556280 >> 172.21.15.60:0/1005556280 conn(0x7f5cfc06d0f0 msgr2=0x7f5cfc06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.948+0000 7f5d01731640 1 -- 172.21.15.60:0/1005556280 shutdown_connections 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.948+0000 7f5d01731640 1 -- 172.21.15.60:0/1005556280 wait complete. 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.949+0000 7f5d01731640 1 Processor -- start 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.949+0000 7f5d01731640 1 -- start start 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5d01731640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cfc072530 0x7f5cfc0d0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5d01731640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cfc0b60c0 0x7f5cfc145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5d01731640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cfc15b480 0x7f5cfc15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5d01731640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc15b860 con 0x7f5cfc15b480 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5d01731640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f5cfc0cdb70 con 0x7f5cfc0b60c0 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5d01731640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f5cfc15b9e0 con 0x7f5cfc072530 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5cfb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cfc15b480 0x7f5cfc15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5cfb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cfc15b480 0x7f5cfc15ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46034/0 (socket says 172.21.15.60:46034) 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5cfb7fe640 1 -- 172.21.15.60:0/336322645 learned_addr learned my addr 172.21.15.60:0/336322645 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5cf3fff640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cfc0b60c0 0x7f5cfc145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5cfaffd640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cfc072530 0x7f5cfc0d0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5cfb7fe640 1 -- 172.21.15.60:0/336322645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cfc072530 msgr2=0x7f5cfc0d0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5cfb7fe640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cfc072530 0x7f5cfc0d0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5cfb7fe640 1 -- 172.21.15.60:0/336322645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cfc0b60c0 msgr2=0x7f5cfc145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5cfb7fe640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cfc0b60c0 0x7f5cfc145de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:27.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5cfb7fe640 1 -- 172.21.15.60:0/336322645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cfc146650 con 0x7f5cfc15b480 2024-09-12T01:44:27.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5cf3fff640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cfc0b60c0 0x7f5cfc145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:27.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.950+0000 7f5cfb7fe640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cfc15b480 0x7f5cfc15ce40 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400c7a0 tx=0x7f5cf400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:27.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.951+0000 7f5cf37fe640 1 -- 172.21.15.60:0/336322645 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4018070 con 0x7f5cfc15b480 2024-09-12T01:44:27.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.951+0000 7f5cf37fe640 1 -- 172.21.15.60:0/336322645 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf400a640 con 0x7f5cfc15b480 2024-09-12T01:44:27.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.951+0000 7f5d01731640 1 -- 172.21.15.60:0/336322645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cfc146930 con 0x7f5cfc15b480 2024-09-12T01:44:27.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.951+0000 7f5cf37fe640 1 -- 172.21.15.60:0/336322645 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf400aab0 con 0x7f5cfc15b480 2024-09-12T01:44:27.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.951+0000 7f5d01731640 1 -- 172.21.15.60:0/336322645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cfc146ef0 con 0x7f5cfc15b480 2024-09-12T01:44:27.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.952+0000 7f5d01731640 1 -- 172.21.15.60:0/336322645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cfc147130 con 0x7f5cfc15b480 2024-09-12T01:44:27.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.952+0000 7f5cf37fe640 1 -- 172.21.15.60:0/336322645 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f5cf401b070 con 0x7f5cfc15b480 2024-09-12T01:44:27.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.953+0000 7f5cf37fe640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5cdc06be60 0x7f5cdc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:27.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.953+0000 7f5cf37fe640 1 -- 172.21.15.60:0/336322645 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7f5cf408a180 con 0x7f5cfc15b480 2024-09-12T01:44:27.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.953+0000 7f5cfaffd640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5cdc06be60 0x7f5cdc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:27.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.953+0000 7f5cfaffd640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5cdc06be60 0x7f5cdc06e320 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009a30 tx=0x7f5cec008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:27.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:27.957+0000 7f5cf37fe640 1 -- 172.21.15.60:0/336322645 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f5cfc147130 con 0x7f5cfc15b480 2024-09-12T01:44:28.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.133+0000 7f5d01731640 1 -- 172.21.15.60:0/336322645 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5cfc069180 con 0x7f5cfc15b480 2024-09-12T01:44:28.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.133+0000 7f5cf37fe640 1 -- 172.21.15.60:0/336322645 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v131) ==== 93+0+10 (secure 0 0 0) 0x7f5cfc069180 con 0x7f5cfc15b480 2024-09-12T01:44:28.134 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2024-09-12T01:44:28.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.135+0000 7f5d01731640 1 -- 172.21.15.60:0/336322645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5cdc06be60 msgr2=0x7f5cdc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.135+0000 7f5d01731640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5cdc06be60 0x7f5cdc06e320 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5cec009a30 tx=0x7f5cec008040 comp rx=0 tx=0).stop 2024-09-12T01:44:28.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.135+0000 7f5d01731640 1 -- 172.21.15.60:0/336322645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cfc15b480 msgr2=0x7f5cfc15ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.135+0000 7f5d01731640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cfc15b480 0x7f5cfc15ce40 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400c7a0 tx=0x7f5cf400cc60 comp rx=0 tx=0).stop 2024-09-12T01:44:28.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.135+0000 7f5d01731640 1 -- 172.21.15.60:0/336322645 shutdown_connections 2024-09-12T01:44:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.135+0000 7f5d01731640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cfc15b480 0x7f5cfc15ce40 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.135+0000 7f5d01731640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f5cfc0b60c0 0x7f5cfc145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.135+0000 7f5d01731640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f5cdc06be60 0x7f5cdc06e320 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.135+0000 7f5d01731640 1 --2- 172.21.15.60:0/336322645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5cfc072530 0x7f5cfc0d0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.135+0000 7f5d01731640 1 -- 172.21.15.60:0/336322645 >> 172.21.15.60:0/336322645 conn(0x7f5cfc06d0f0 msgr2=0x7f5cfc0b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.136+0000 7f5d01731640 1 -- 172.21.15.60:0/336322645 shutdown_connections 2024-09-12T01:44:28.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.136+0000 7f5d01731640 1 -- 172.21.15.60:0/336322645 wait complete. 2024-09-12T01:44:28.147 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug' 2024-09-12T01:44:28.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.249+0000 7fc4ba63c640 1 Processor -- start 2024-09-12T01:44:28.250 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.249+0000 7fc4ba63c640 1 -- start start 2024-09-12T01:44:28.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.250+0000 7fc4ba63c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc4b415c210 0x7fc4b415f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:28.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.250+0000 7fc4ba63c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4b406fa00 0x7fc4b40d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:28.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.250+0000 7fc4ba63c640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b406e900 con 0x7fc4b40b5560 2024-09-12T01:44:28.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.250+0000 7fc4ba63c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc4b415ecd0 con 0x7fc4b415c210 2024-09-12T01:44:28.251 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.250+0000 7fc4ba63c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b415efb0 con 0x7fc4b406fa00 2024-09-12T01:44:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.250+0000 7fc4b3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc4b415c210 0x7fc4b415f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.250+0000 7fc4b8bd9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4b406fa00 0x7fc4b40d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.250+0000 7fc4b3fff640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc4b415c210 0x7fc4b415f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:33600/0 (socket says 172.21.15.60:33600) 2024-09-12T01:44:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.250+0000 7fc4b37fe640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fc4b40b5560 0x7fc4b406f2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:45436/0 (socket says 172.21.15.60:45436) 2024-09-12T01:44:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.250+0000 7fc4b3fff640 1 -- 172.21.15.60:0/2551957040 learned_addr learned my addr 172.21.15.60:0/2551957040 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.251+0000 7fc4b3fff640 1 -- 172.21.15.60:0/2551957040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4b406fa00 msgr2=0x7fc4b40d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.251+0000 7fc4b3fff640 1 --2- 172.21.15.60:0/2551957040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4b406fa00 0x7fc4b40d2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.251+0000 7fc4b3fff640 1 -- 172.21.15.60:0/2551957040 >> v1:172.21.15.105:6789/0 conn(0x7fc4b40b5560 legacy=0x7fc4b406f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.251+0000 7fc4b3fff640 1 -- 172.21.15.60:0/2551957040 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b415f290 con 0x7fc4b415c210 2024-09-12T01:44:28.253 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.251+0000 7fc4b3fff640 1 --2- 172.21.15.60:0/2551957040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4b415c210 0x7fc4b415f7b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009870 tx=0x7fc4a402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f15c67428d90aa6f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.252+0000 7fc4b2ffd640 1 -- 172.21.15.60:0/2551957040 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4037070 con 0x7fc4b415c210 2024-09-12T01:44:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.252+0000 7fc4b2ffd640 1 -- 172.21.15.60:0/2551957040 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a4032440 con 0x7fc4b415c210 2024-09-12T01:44:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.252+0000 7fc4b2ffd640 1 -- 172.21.15.60:0/2551957040 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4032810 con 0x7fc4b415c210 2024-09-12T01:44:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.252+0000 7fc4ba63c640 1 -- 172.21.15.60:0/2551957040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4b415c210 msgr2=0x7fc4b415f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.252+0000 7fc4ba63c640 1 --2- 172.21.15.60:0/2551957040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4b415c210 0x7fc4b415f7b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4009870 tx=0x7fc4a402a270 comp rx=0 tx=0).stop 2024-09-12T01:44:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.252+0000 7fc4ba63c640 1 -- 172.21.15.60:0/2551957040 shutdown_connections 2024-09-12T01:44:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.252+0000 7fc4ba63c640 1 --2- 172.21.15.60:0/2551957040 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4b406fa00 0x7fc4b40d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.252+0000 7fc4ba63c640 1 --2- 172.21.15.60:0/2551957040 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4b415c210 0x7fc4b415f7b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.252+0000 7fc4ba63c640 1 -- 172.21.15.60:0/2551957040 >> 172.21.15.60:0/2551957040 conn(0x7fc4b40d2430 msgr2=0x7fc4b40d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.252+0000 7fc4ba63c640 1 -- 172.21.15.60:0/2551957040 shutdown_connections 2024-09-12T01:44:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.252+0000 7fc4ba63c640 1 -- 172.21.15.60:0/2551957040 wait complete. 2024-09-12T01:44:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.253+0000 7fc4ba63c640 1 Processor -- start 2024-09-12T01:44:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.254+0000 7fc4ba63c640 1 -- start start 2024-09-12T01:44:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.254+0000 7fc4ba63c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b406fa00 0x7fc4b41f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.254+0000 7fc4ba63c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4b40b5560 0x7fc4b40d1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.254+0000 7fc4ba63c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4b415c210 0x7fc4b406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:28.256 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.254+0000 7fc4ba63c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b406e6e0 con 0x7fc4b406fa00 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.254+0000 7fc4ba63c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b406e560 con 0x7fc4b415c210 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.254+0000 7fc4ba63c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b4070830 con 0x7fc4b40b5560 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.254+0000 7fc4b3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b406fa00 0x7fc4b41f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.254+0000 7fc4b3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b406fa00 0x7fc4b41f43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46046/0 (socket says 172.21.15.60:46046) 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.254+0000 7fc4b3fff640 1 -- 172.21.15.60:0/1891997686 learned_addr learned my addr 172.21.15.60:0/1891997686 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4b8bd9640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4b415c210 0x7fc4b406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4b37fe640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4b40b5560 0x7fc4b40d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4b3fff640 1 -- 172.21.15.60:0/1891997686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4b40b5560 msgr2=0x7fc4b40d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4b3fff640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4b40b5560 0x7fc4b40d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4b3fff640 1 -- 172.21.15.60:0/1891997686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4b415c210 msgr2=0x7fc4b406cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4b3fff640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4b415c210 0x7fc4b406cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4b3fff640 1 -- 172.21.15.60:0/1891997686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b40ccbf0 con 0x7fc4b406fa00 2024-09-12T01:44:28.257 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4b3fff640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b406fa00 0x7fc4b41f43b0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4000c00 tx=0x7fc4a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:28.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4b0ff9640 1 -- 172.21.15.60:0/1891997686 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4037040 con 0x7fc4b406fa00 2024-09-12T01:44:28.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4b0ff9640 1 -- 172.21.15.60:0/1891997686 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a4042070 con 0x7fc4b406fa00 2024-09-12T01:44:28.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4ba63c640 1 -- 172.21.15.60:0/1891997686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b40cced0 con 0x7fc4b406fa00 2024-09-12T01:44:28.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4b0ff9640 1 -- 172.21.15.60:0/1891997686 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4030880 con 0x7fc4b406fa00 2024-09-12T01:44:28.258 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.255+0000 7fc4ba63c640 1 -- 172.21.15.60:0/1891997686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b40cd490 con 0x7fc4b406fa00 2024-09-12T01:44:28.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.256+0000 7fc4ba63c640 1 -- 172.21.15.60:0/1891997686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b415f7b0 con 0x7fc4b406fa00 2024-09-12T01:44:28.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.257+0000 7fc4b0ff9640 1 -- 172.21.15.60:0/1891997686 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc4a4030a20 con 0x7fc4b406fa00 2024-09-12T01:44:28.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.257+0000 7fc4b0ff9640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4a006be30 0x7fc4a006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:28.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.257+0000 7fc4b0ff9640 1 -- 172.21.15.60:0/1891997686 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7fc4a40ab210 con 0x7fc4b406fa00 2024-09-12T01:44:28.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.257+0000 7fc4b37fe640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4a006be30 0x7fc4a006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:28.259 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.258+0000 7fc4b37fe640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4a006be30 0x7fc4a006e2f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc4b415a730 tx=0x7fc4a8007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:28.262 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.262+0000 7fc4b0ff9640 1 -- 172.21.15.60:0/1891997686 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc4a4079870 con 0x7fc4b406fa00 2024-09-12T01:44:28.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.507+0000 7fc4ba63c640 1 -- 172.21.15.60:0/1891997686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]} v 0) -- 0x7fc4b40cd930 con 0x7fc4b406fa00 2024-09-12T01:44:28.525 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.524+0000 7fc4b0ff9640 1 -- 172.21.15.60:0/1891997686 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]}]=0 v431) ==== 154+0+0 (secure 0 0 0) 0x7fc4a407db70 con 0x7fc4b406fa00 2024-09-12T01:44:28.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.528+0000 7fc4ba63c640 1 -- 172.21.15.60:0/1891997686 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4a006be30 msgr2=0x7fc4a006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.528 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.528+0000 7fc4ba63c640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4a006be30 0x7fc4a006e2f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fc4b415a730 tx=0x7fc4a8007e80 comp rx=0 tx=0).stop 2024-09-12T01:44:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.528+0000 7fc4ba63c640 1 -- 172.21.15.60:0/1891997686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b406fa00 msgr2=0x7fc4b41f43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.528+0000 7fc4ba63c640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b406fa00 0x7fc4b41f43b0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4000c00 tx=0x7fc4a40046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.528+0000 7fc4ba63c640 1 -- 172.21.15.60:0/1891997686 shutdown_connections 2024-09-12T01:44:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.528+0000 7fc4ba63c640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc4b415c210 0x7fc4b406cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.528+0000 7fc4ba63c640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4a006be30 0x7fc4a006e2f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.528+0000 7fc4ba63c640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc4b40b5560 0x7fc4b40d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.528+0000 7fc4ba63c640 1 --2- 172.21.15.60:0/1891997686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b406fa00 0x7fc4b41f43b0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.528+0000 7fc4ba63c640 1 -- 172.21.15.60:0/1891997686 >> 172.21.15.60:0/1891997686 conn(0x7fc4b40d2430 msgr2=0x7fc4b415cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.528+0000 7fc4ba63c640 1 -- 172.21.15.60:0/1891997686 shutdown_connections 2024-09-12T01:44:28.529 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.528+0000 7fc4ba63c640 1 -- 172.21.15.60:0/1891997686 wait complete. 2024-09-12T01:44:28.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-12T01:44:28.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.644+0000 7f399215b640 1 Processor -- start 2024-09-12T01:44:28.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.644+0000 7f399215b640 1 -- start start 2024-09-12T01:44:28.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.645+0000 7f399215b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f398c0b6910 0x7f398c0b8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:28.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.645+0000 7f399215b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c0b7790 con 0x7f398c15e750 2024-09-12T01:44:28.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.645+0000 7f399215b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c0d3600 con 0x7f398c0b64a0 2024-09-12T01:44:28.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.645+0000 7f399215b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f398c0d43c0 con 0x7f398c0b6910 2024-09-12T01:44:28.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.645+0000 7f398bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f398c0b6910 0x7f398c0b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:28.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.645+0000 7f398bfff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f398c0b6910 0x7f398c0b8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46062/0 (socket says 172.21.15.60:46062) 2024-09-12T01:44:28.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.645+0000 7f398b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f398c15e750 0x7f398c0cf630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38838/0 (socket says 172.21.15.60:38838) 2024-09-12T01:44:28.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.645+0000 7f398bfff640 1 -- 172.21.15.60:0/881206546 learned_addr learned my addr 172.21.15.60:0/881206546 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:28.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.645+0000 7f398bfff640 1 -- 172.21.15.60:0/881206546 >> v1:172.21.15.105:6789/0 conn(0x7f398c0b64a0 legacy=0x7f398c0b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:28.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.645+0000 7f398bfff640 1 -- 172.21.15.60:0/881206546 >> v1:172.21.15.60:6789/0 conn(0x7f398c15e750 legacy=0x7f398c0cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.645+0000 7f398bfff640 1 -- 172.21.15.60:0/881206546 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c0d38e0 con 0x7f398c0b6910 2024-09-12T01:44:28.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.646+0000 7f398bfff640 1 --2- 172.21.15.60:0/881206546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f398c0b6910 0x7f398c0b8660 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f3984009e50 tx=0x7f398402a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7ce46efb008b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:28.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.646+0000 7f398affd640 1 -- 172.21.15.60:0/881206546 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3984036070 con 0x7f398c0b6910 2024-09-12T01:44:28.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.646+0000 7f398affd640 1 -- 172.21.15.60:0/881206546 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3984031600 con 0x7f398c0b6910 2024-09-12T01:44:28.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.646+0000 7f398affd640 1 -- 172.21.15.60:0/881206546 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39840319d0 con 0x7f398c0b6910 2024-09-12T01:44:28.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.647+0000 7f399215b640 1 -- 172.21.15.60:0/881206546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f398c0b6910 msgr2=0x7f398c0b8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.647+0000 7f399215b640 1 --2- 172.21.15.60:0/881206546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f398c0b6910 0x7f398c0b8660 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f3984009e50 tx=0x7f398402a760 comp rx=0 tx=0).stop 2024-09-12T01:44:28.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.647+0000 7f399215b640 1 -- 172.21.15.60:0/881206546 shutdown_connections 2024-09-12T01:44:28.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.647+0000 7f399215b640 1 --2- 172.21.15.60:0/881206546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f398c0b6910 0x7f398c0b8660 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.647+0000 7f399215b640 1 -- 172.21.15.60:0/881206546 >> 172.21.15.60:0/881206546 conn(0x7f398c0d1500 msgr2=0x7f398c0d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:28.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.647+0000 7f399215b640 1 -- 172.21.15.60:0/881206546 shutdown_connections 2024-09-12T01:44:28.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.647+0000 7f399215b640 1 -- 172.21.15.60:0/881206546 wait complete. 2024-09-12T01:44:28.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.648+0000 7f399215b640 1 Processor -- start 2024-09-12T01:44:28.649 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.648+0000 7f399215b640 1 -- start start 2024-09-12T01:44:28.650 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f399215b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f398c0b64a0 0x7f398c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:28.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f399215b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f398c0b6910 0x7f398c0ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:28.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f399215b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c15e750 0x7f398c0ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:28.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f399215b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f398c0b7ac0 con 0x7f398c0b64a0 2024-09-12T01:44:28.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f399215b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f398c0d33b0 con 0x7f398c0b6910 2024-09-12T01:44:28.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f399215b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f398c15eb30 con 0x7f398c15e750 2024-09-12T01:44:28.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f398b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f398c0b64a0 0x7f398c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:28.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f398b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f398c0b64a0 0x7f398c0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46068/0 (socket says 172.21.15.60:46068) 2024-09-12T01:44:28.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f398b7fe640 1 -- 172.21.15.60:0/1764082899 learned_addr learned my addr 172.21.15.60:0/1764082899 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:28.651 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f3982ffd640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f398c0b6910 0x7f398c0ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f398bfff640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c15e750 0x7f398c0ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f398b7fe640 1 -- 172.21.15.60:0/1764082899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c15e750 msgr2=0x7f398c0ce6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f398b7fe640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c15e750 0x7f398c0ce6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f398b7fe640 1 -- 172.21.15.60:0/1764082899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f398c0b6910 msgr2=0x7f398c0ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f398b7fe640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f398c0b6910 0x7f398c0ac390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f398b7fe640 1 -- 172.21.15.60:0/1764082899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c0cb730 con 0x7f398c0b64a0 2024-09-12T01:44:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.649+0000 7f398b7fe640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f398c0b64a0 0x7f398c0ccab0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f397c00c400 tx=0x7f397c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.650+0000 7f3988ff9640 1 -- 172.21.15.60:0/1764082899 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c0074e0 con 0x7f398c0b64a0 2024-09-12T01:44:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.650+0000 7f3988ff9640 1 -- 172.21.15.60:0/1764082899 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f397c007680 con 0x7f398c0b64a0 2024-09-12T01:44:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.650+0000 7f399215b640 1 -- 172.21.15.60:0/1764082899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398c0cba10 con 0x7f398c0b64a0 2024-09-12T01:44:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.650+0000 7f3988ff9640 1 -- 172.21.15.60:0/1764082899 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f397c004a00 con 0x7f398c0b64a0 2024-09-12T01:44:28.652 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.650+0000 7f399215b640 1 -- 172.21.15.60:0/1764082899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398c0cbfd0 con 0x7f398c0b64a0 2024-09-12T01:44:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.651+0000 7f399215b640 1 -- 172.21.15.60:0/1764082899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f398c0cf630 con 0x7f398c0b64a0 2024-09-12T01:44:28.653 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.651+0000 7f3988ff9640 1 -- 172.21.15.60:0/1764082899 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f397c01a020 con 0x7f398c0b64a0 2024-09-12T01:44:28.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.652+0000 7f3988ff9640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f396c06be30 0x7f396c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:28.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.652+0000 7f3988ff9640 1 -- 172.21.15.60:0/1764082899 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7f397c08a460 con 0x7f398c0b64a0 2024-09-12T01:44:28.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.652+0000 7f3982ffd640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f396c06be30 0x7f396c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:28.654 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.652+0000 7f3982ffd640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f396c06be30 0x7f396c06e2f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3974006fd0 tx=0x7f3974008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:28.657 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.656+0000 7f3988ff9640 1 -- 172.21.15.60:0/1764082899 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f397c059070 con 0x7f398c0b64a0 2024-09-12T01:44:28.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.834+0000 7f399215b640 1 -- 172.21.15.60:0/1764082899 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f398c1e4180 con 0x7f398c0b64a0 2024-09-12T01:44:28.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.837+0000 7f3988ff9640 1 -- 172.21.15.60:0/1764082899 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v66)=0 v66) ==== 122+0+0 (secure 0 0 0) 0x7f397c058970 con 0x7f398c0b64a0 2024-09-12T01:44:28.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.840+0000 7f399215b640 1 -- 172.21.15.60:0/1764082899 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f396c06be30 msgr2=0x7f396c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.840+0000 7f399215b640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f396c06be30 0x7f396c06e2f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3974006fd0 tx=0x7f3974008040 comp rx=0 tx=0).stop 2024-09-12T01:44:28.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.840+0000 7f399215b640 1 -- 172.21.15.60:0/1764082899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f398c0b64a0 msgr2=0x7f398c0ccab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:28.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.840+0000 7f399215b640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f398c0b64a0 0x7f398c0ccab0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f397c00c400 tx=0x7f397c00c8c0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.840+0000 7f399215b640 1 -- 172.21.15.60:0/1764082899 shutdown_connections 2024-09-12T01:44:28.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.840+0000 7f399215b640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f396c06be30 0x7f396c06e2f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.840+0000 7f399215b640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f398c15e750 0x7f398c0ce6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.840+0000 7f399215b640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f398c0b6910 0x7f398c0ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.840+0000 7f399215b640 1 --2- 172.21.15.60:0/1764082899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f398c0b64a0 0x7f398c0ccab0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:28.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.840+0000 7f399215b640 1 -- 172.21.15.60:0/1764082899 >> 172.21.15.60:0/1764082899 conn(0x7f398c0d1500 msgr2=0x7f398c0b8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:28.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.840+0000 7f399215b640 1 -- 172.21.15.60:0/1764082899 shutdown_connections 2024-09-12T01:44:28.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:28.840+0000 7f399215b640 1 -- 172.21.15.60:0/1764082899 wait complete. 2024-09-12T01:44:28.852 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:44:28.852 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:44:28.895 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:44:28.942 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:44:28.942 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:28.942 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:28.958 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:44:28.958 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:44:28.959 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:28.978 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:44:28.978 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:28.978 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:29.014 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:44:29.014 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:44:29.014 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:29.037 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:44:29.037 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-12T01:44:29.038 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:29.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.155+0000 7fcefb703640 1 Processor -- start 2024-09-12T01:44:29.156 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.156+0000 7fcefb703640 1 -- start start 2024-09-12T01:44:29.157 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.156+0000 7fcefb703640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcef415e560 0x7fcef406e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.156+0000 7fcefb703640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcef4073130 0x7fcef4073580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.156+0000 7fcefb703640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcef40b5220 con 0x7fcef4072220 2024-09-12T01:44:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.156+0000 7fcefb703640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcef40aefa0 con 0x7fcef415e560 2024-09-12T01:44:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.156+0000 7fcefb703640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcef4073ac0 con 0x7fcef4073130 2024-09-12T01:44:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.156+0000 7fcef949f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcef415e560 0x7fcef406e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.157+0000 7fcef8c9e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcef4072220 0x7fcef40ae890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38848/0 (socket says 172.21.15.60:38848) 2024-09-12T01:44:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.157+0000 7fcef8c9e640 1 -- 172.21.15.60:0/664251636 learned_addr learned my addr 172.21.15.60:0/664251636 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.157+0000 7fcef9ca0640 1 --2- 172.21.15.60:0/664251636 >> v2:172.21.15.105:3300/0 conn(0x7fcef4073130 0x7fcef4073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.157+0000 7fcef949f640 1 -- 172.21.15.60:0/664251636 >> v2:172.21.15.105:3300/0 conn(0x7fcef4073130 msgr2=0x7fcef4073580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.157+0000 7fcef949f640 1 --2- 172.21.15.60:0/664251636 >> v2:172.21.15.105:3300/0 conn(0x7fcef4073130 0x7fcef4073580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.157+0000 7fcef949f640 1 -- 172.21.15.60:0/664251636 >> v1:172.21.15.60:6789/0 conn(0x7fcef4072220 legacy=0x7fcef40ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:29.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.157+0000 7fcef3fff640 1 -- 172.21.15.60:0/664251636 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1773699209 0 0) 0x7fcef40b5220 con 0x7fcef4072220 2024-09-12T01:44:29.159 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.157+0000 7fcef949f640 1 -- 172.21.15.60:0/664251636 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef40b54c0 con 0x7fcef415e560 2024-09-12T01:44:29.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.158+0000 7fcef949f640 1 --2- 172.21.15.60:0/664251636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef415e560 0x7fcef406e780 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fcef40b44f0 tx=0x7fcee402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c288d1acbedb3965 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:29.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.158+0000 7fcef3fff640 1 -- 172.21.15.60:0/664251636 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4007740 con 0x7fcef415e560 2024-09-12T01:44:29.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.158+0000 7fcef3fff640 1 -- 172.21.15.60:0/664251636 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee40078e0 con 0x7fcef415e560 2024-09-12T01:44:29.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.158+0000 7fcef3fff640 1 -- 172.21.15.60:0/664251636 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4007cb0 con 0x7fcef415e560 2024-09-12T01:44:29.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.158+0000 7fcefb703640 1 -- 172.21.15.60:0/664251636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef415e560 msgr2=0x7fcef406e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:29.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.158+0000 7fcefb703640 1 --2- 172.21.15.60:0/664251636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef415e560 0x7fcef406e780 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fcef40b44f0 tx=0x7fcee402a5f0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.160 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.158+0000 7fcefb703640 1 -- 172.21.15.60:0/664251636 shutdown_connections 2024-09-12T01:44:29.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.158+0000 7fcefb703640 1 --2- 172.21.15.60:0/664251636 >> v2:172.21.15.105:3300/0 conn(0x7fcef4073130 0x7fcef4073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.158+0000 7fcefb703640 1 --2- 172.21.15.60:0/664251636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef415e560 0x7fcef406e780 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.161 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.158+0000 7fcefb703640 1 -- 172.21.15.60:0/664251636 >> 172.21.15.60:0/664251636 conn(0x7fcef406bc10 msgr2=0x7fcef406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:29.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.158+0000 7fcefb703640 1 -- 172.21.15.60:0/664251636 shutdown_connections 2024-09-12T01:44:29.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.158+0000 7fcefb703640 1 -- 172.21.15.60:0/664251636 wait complete. 2024-09-12T01:44:29.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.160+0000 7fcefb703640 1 Processor -- start 2024-09-12T01:44:29.162 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.160+0000 7fcefb703640 1 -- start start 2024-09-12T01:44:29.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.160+0000 7fcefb703640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4072220 0x7fcef415fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.160+0000 7fcefb703640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef4073130 0x7fcef41f4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.160+0000 7fcefb703640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef415e560 0x7fcef40cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.160+0000 7fcefb703640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcef40b5d60 con 0x7fcef4072220 2024-09-12T01:44:29.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.160+0000 7fcefb703640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcef40b5a80 con 0x7fcef415e560 2024-09-12T01:44:29.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.160+0000 7fcefb703640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcef4072660 con 0x7fcef4073130 2024-09-12T01:44:29.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.160+0000 7fcef949f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4072220 0x7fcef415fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.164 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef949f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4072220 0x7fcef415fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46092/0 (socket says 172.21.15.60:46092) 2024-09-12T01:44:29.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef949f640 1 -- 172.21.15.60:0/2994446110 learned_addr learned my addr 172.21.15.60:0/2994446110 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:29.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef9ca0640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef415e560 0x7fcef40cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef8c9e640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef4073130 0x7fcef41f4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef949f640 1 -- 172.21.15.60:0/2994446110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef4073130 msgr2=0x7fcef41f4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:29.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef949f640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef4073130 0x7fcef41f4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef949f640 1 -- 172.21.15.60:0/2994446110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef415e560 msgr2=0x7fcef40cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:29.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef949f640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef415e560 0x7fcef40cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef949f640 1 -- 172.21.15.60:0/2994446110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef41602d0 con 0x7fcef4072220 2024-09-12T01:44:29.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef949f640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4072220 0x7fcef415fba0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fcee4000f80 tx=0x7fcee4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:29.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef1ffb640 1 -- 172.21.15.60:0/2994446110 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee403f070 con 0x7fcef4072220 2024-09-12T01:44:29.165 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef1ffb640 1 -- 172.21.15.60:0/2994446110 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee4031c40 con 0x7fcef4072220 2024-09-12T01:44:29.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcef1ffb640 1 -- 172.21.15.60:0/2994446110 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4009450 con 0x7fcef4072220 2024-09-12T01:44:29.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcefb703640 1 -- 172.21.15.60:0/2994446110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef41605b0 con 0x7fcef4072220 2024-09-12T01:44:29.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.161+0000 7fcefb703640 1 -- 172.21.15.60:0/2994446110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef4160b70 con 0x7fcef4072220 2024-09-12T01:44:29.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.162+0000 7fcefb703640 1 -- 172.21.15.60:0/2994446110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef415e940 con 0x7fcef4072220 2024-09-12T01:44:29.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.163+0000 7fcef1ffb640 1 -- 172.21.15.60:0/2994446110 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcee4003990 con 0x7fcef4072220 2024-09-12T01:44:29.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.163+0000 7fcef1ffb640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcee006be30 0x7fcee006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.163+0000 7fcef1ffb640 1 -- 172.21.15.60:0/2994446110 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7fcee40abe30 con 0x7fcef4072220 2024-09-12T01:44:29.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.163+0000 7fcef8c9e640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcee006be30 0x7fcee006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.164+0000 7fcef8c9e640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcee006be30 0x7fcee006e2f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcef4154cb0 tx=0x7fcee8007b70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:29.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.168+0000 7fcef1ffb640 1 -- 172.21.15.60:0/2994446110 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcee407aa40 con 0x7fcef4072220 2024-09-12T01:44:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.380+0000 7fcefb703640 1 -- 172.21.15.60:0/2994446110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcef40b6620 con 0x7fcef4072220 2024-09-12T01:44:29.381 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.380+0000 7fcef1ffb640 1 -- 172.21.15.60:0/2994446110 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+3915 (secure 0 0 0) 0x7fcee407a340 con 0x7fcef4072220 2024-09-12T01:44:29.385 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:29.385 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":83,"btime":"2024-09-12T01:44:23:505454+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/152127841","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":152127841},{"type":"v1","addr":"172.21.15.60:6836","nonce":152127841}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7234,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/2154123948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":2154123948},{"type":"v1","addr":"172.21.15.105:6835","nonce":2154123948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76},{"gid":7980,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/1634496909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":1634496909},{"type":"v1","addr":"172.21.15.60:6837","nonce":1634496909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75},{"gid":36662,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/1016711424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":1016711424},{"type":"v1","addr":"172.21.15.105:6834","nonce":1016711424}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":83}],"filesystems":[]} 2024-09-12T01:44:29.386 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 83 2024-09-12T01:44:29.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.383+0000 7fcefb703640 1 -- 172.21.15.60:0/2994446110 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcee006be30 msgr2=0x7fcee006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:29.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.383+0000 7fcefb703640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcee006be30 0x7fcee006e2f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcef4154cb0 tx=0x7fcee8007b70 comp rx=0 tx=0).stop 2024-09-12T01:44:29.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.383+0000 7fcefb703640 1 -- 172.21.15.60:0/2994446110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4072220 msgr2=0x7fcef415fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:29.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.383+0000 7fcefb703640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4072220 0x7fcef415fba0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fcee4000f80 tx=0x7fcee4004a40 comp rx=0 tx=0).stop 2024-09-12T01:44:29.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.383+0000 7fcefb703640 1 -- 172.21.15.60:0/2994446110 shutdown_connections 2024-09-12T01:44:29.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.383+0000 7fcefb703640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcef415e560 0x7fcef40cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.383+0000 7fcefb703640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcee006be30 0x7fcee006e2f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.383+0000 7fcefb703640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcef4073130 0x7fcef41f4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.383+0000 7fcefb703640 1 --2- 172.21.15.60:0/2994446110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef4072220 0x7fcef415fba0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.383+0000 7fcefb703640 1 -- 172.21.15.60:0/2994446110 >> 172.21.15.60:0/2994446110 conn(0x7fcef406bc10 msgr2=0x7fcef406e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:29.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.383+0000 7fcefb703640 1 -- 172.21.15.60:0/2994446110 shutdown_connections 2024-09-12T01:44:29.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.383+0000 7fcefb703640 1 -- 172.21.15.60:0/2994446110 wait complete. 2024-09-12T01:44:29.395 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-12T01:44:29.395 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-12T01:44:29.395 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:44:29.395 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:44:29.395 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-12T01:44:29.396 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-12T01:44:29.396 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:44:29.396 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:44:29.396 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-12T01:44:29.396 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-12T01:44:29.396 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:44:29.397 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:44:29.397 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-12T01:44:29.397 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-12T01:44:29.397 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:44:29.397 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:44:29.405 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:44:29.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-12T01:44:29.406 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:44:29.406 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-12T01:44:29.408 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:44:29.409 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-12T01:44:29.409 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:44:29.409 DEBUG:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-12T01:44:29.448 INFO:tasks.ceph.mds.a:Started 2024-09-12T01:44:29.448 DEBUG:teuthology.parallel:result is None 2024-09-12T01:44:29.449 INFO:tasks.ceph.mds.c:Started 2024-09-12T01:44:29.449 DEBUG:teuthology.parallel:result is None 2024-09-12T01:44:29.451 INFO:tasks.ceph.mds.b:Started 2024-09-12T01:44:29.451 DEBUG:teuthology.parallel:result is None 2024-09-12T01:44:29.452 INFO:tasks.ceph.mds.d:Started 2024-09-12T01:44:29.452 DEBUG:teuthology.parallel:result is None 2024-09-12T01:44:29.452 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-12T01:44:29.526 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2024-09-12T01:44:29.527 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2024-09-12T01:44:29.533 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:44:29.534 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2024-09-12T01:44:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.559+0000 7fd4fa79f640 1 Processor -- start 2024-09-12T01:44:29.559 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.559+0000 7fd4fa79f640 1 -- start start 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4fa79f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f406bc10 0x7fd4f406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4fa79f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f415c4d0 con 0x7fd4f415c0f0 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4fa79f640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4f40740e0 con 0x7fd4f406f630 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4fa79f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f406c5b0 con 0x7fd4f406bc10 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f3fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd4f415c0f0 0x7fd4f40739d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38886/0 (socket says 172.21.15.60:38886) 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f3fff640 1 -- 172.21.15.60:0/2294264784 learned_addr learned my addr 172.21.15.60:0/2294264784 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2707706300 0 0) 0x7fd4f415c4d0 con 0x7fd4f415c0f0 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f37fe640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f406bc10 0x7fd4f406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4dc003520 con 0x7fd4f415c0f0 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3860992596 0 0) 0x7fd4dc003520 con 0x7fd4f415c0f0 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f406bc10 msgr2=0x7fd4f406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f406bc10 0x7fd4f406c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 >> v1:172.21.15.105:6789/0 conn(0x7fd4f406f630 legacy=0x7fd4f406fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f415ee60 con 0x7fd4f415c0f0 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fd4e4001670 con 0x7fd4f415c0f0 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 >> v1:172.21.15.60:6789/0 conn(0x7fd4f415c0f0 legacy=0x7fd4f40739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4dc0039e0 0x7fd4dc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4dc004390 0x7fd4dc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4dc005100 0x7fd4dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc00bfb0 con 0x7fd4dc0039e0 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd4dc00c160 con 0x7fd4dc004390 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd4dc00c360 con 0x7fd4dc005100 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.560+0000 7fd4f37fe640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f406bc10 0x7fd4f406c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.561+0000 7fd4f3fff640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4dc0039e0 0x7fd4dc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.561+0000 7fd4f8d3c640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4dc005100 0x7fd4dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.561+0000 7fd4f37fe640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4dc004390 0x7fd4dc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.561+0000 7fd4f3fff640 1 -- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4dc005100 msgr2=0x7fd4dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.561+0000 7fd4f3fff640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4dc005100 0x7fd4dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.561+0000 7fd4f3fff640 1 -- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4dc004390 msgr2=0x7fd4dc004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.561+0000 7fd4f3fff640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4dc004390 0x7fd4dc004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.561+0000 7fd4f3fff640 1 -- 172.21.15.60:0/2294264784 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4dc003520 con 0x7fd4dc0039e0 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.561+0000 7fd4f37fe640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4dc004390 0x7fd4dc004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.561+0000 7fd4f3fff640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4dc0039e0 0x7fd4dc003dc0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400c290 tx=0x7fd4dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40610a1dc43b4da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.562+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4007d50 con 0x7fd4dc0039e0 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.562+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e4005af0 con 0x7fd4dc0039e0 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.562+0000 7fd4f2ffd640 1 -- 172.21.15.60:0/2294264784 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4007070 con 0x7fd4dc0039e0 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.562+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2294264784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4dc0039e0 msgr2=0x7fd4dc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.562+0000 7fd4fa79f640 1 --2- 172.21.15.60:0/2294264784 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4dc0039e0 0x7fd4dc003dc0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fd4e400c290 tx=0x7fd4dc005830 comp rx=0 tx=0).stop 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.562+0000 7fd4f8d3c640 1 -- 172.21.15.60:0/2294264784 reap_dead start 2024-09-12T01:44:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.562+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2294264784 shutdown_connections 2024-09-12T01:44:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.562+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2294264784 >> 172.21.15.60:0/2294264784 conn(0x7fd4f40d1390 msgr2=0x7fd4f40d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.562+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2294264784 shutdown_connections 2024-09-12T01:44:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.562+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2294264784 wait complete. 2024-09-12T01:44:29.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.563+0000 7fd4fa79f640 1 Processor -- start 2024-09-12T01:44:29.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.564+0000 7fd4fa79f640 1 -- start start 2024-09-12T01:44:29.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.564+0000 7fd4fa79f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4dc0039e0 0x7fd4f40b2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.564+0000 7fd4fa79f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f415fc50 0x7fd4f40cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.564+0000 7fd4fa79f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f40ce2d0 0x7fd4f40ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.564+0000 7fd4fa79f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f415eb50 con 0x7fd4dc0039e0 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.564+0000 7fd4fa79f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f415f420 con 0x7fd4f40ce2d0 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.564+0000 7fd4fa79f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd4f4071ef0 con 0x7fd4f415fc50 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.564+0000 7fd4f3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4dc0039e0 0x7fd4f40b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.564+0000 7fd4f3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4dc0039e0 0x7fd4f40b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46124/0 (socket says 172.21.15.60:46124) 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.564+0000 7fd4f3fff640 1 -- 172.21.15.60:0/2202891006 learned_addr learned my addr 172.21.15.60:0/2202891006 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.564+0000 7fd4f37fe640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f415fc50 0x7fd4f40cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.565+0000 7fd4f8d3c640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f40ce2d0 0x7fd4f40ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.565+0000 7fd4f3fff640 1 -- 172.21.15.60:0/2202891006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f415fc50 msgr2=0x7fd4f40cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.565+0000 7fd4f3fff640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f415fc50 0x7fd4f40cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.565+0000 7fd4f3fff640 1 -- 172.21.15.60:0/2202891006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f40ce2d0 msgr2=0x7fd4f40ce750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.565+0000 7fd4f3fff640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f40ce2d0 0x7fd4f40ce750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.565+0000 7fd4f3fff640 1 -- 172.21.15.60:0/2202891006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4f4162e30 con 0x7fd4dc0039e0 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.565+0000 7fd4f3fff640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4dc0039e0 0x7fd4f40b2340 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4001970 tx=0x7fd4e4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.565+0000 7fd4f0ff9640 1 -- 172.21.15.60:0/2202891006 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4042070 con 0x7fd4dc0039e0 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.565+0000 7fd4f0ff9640 1 -- 172.21.15.60:0/2202891006 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4e4007280 con 0x7fd4dc0039e0 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.565+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2202891006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4f4162b50 con 0x7fd4dc0039e0 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.565+0000 7fd4f0ff9640 1 -- 172.21.15.60:0/2202891006 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4007d50 con 0x7fd4dc0039e0 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.565+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2202891006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4f40b1b40 con 0x7fd4dc0039e0 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.566+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2202891006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f40b0ba0 con 0x7fd4dc0039e0 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.567+0000 7fd4f0ff9640 1 -- 172.21.15.60:0/2202891006 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd4e4045070 con 0x7fd4dc0039e0 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.567+0000 7fd4f0ff9640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd4e006be30 0x7fd4e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.567+0000 7fd4f0ff9640 1 -- 172.21.15.60:0/2202891006 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 4943+0+0 (secure 0 0 0) 0x7fd4e40ab710 con 0x7fd4dc0039e0 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.567+0000 7fd4f37fe640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd4e006be30 0x7fd4e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.568+0000 7fd4f37fe640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd4e006be30 0x7fd4e006e2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40b1790 tx=0x7fd4e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:29.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.571+0000 7fd4f0ff9640 1 -- 172.21.15.60:0/2202891006 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd4e4005ac0 con 0x7fd4dc0039e0 2024-09-12T01:44:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:29.759+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2202891006 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd4f415e0a0 con 0x7fd4dc0039e0 2024-09-12T01:44:30.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.537+0000 7fd4f0ff9640 1 -- 172.21.15.60:0/2202891006 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v133) ==== 97+0+0 (secure 0 0 0) 0x7fd4e4079ce0 con 0x7fd4dc0039e0 2024-09-12T01:44:30.538 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blocklist entries 2024-09-12T01:44:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.540+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2202891006 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd4e006be30 msgr2=0x7fd4e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.540+0000 7fd4fa79f640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd4e006be30 0x7fd4e006e2f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40b1790 tx=0x7fd4e8008040 comp rx=0 tx=0).stop 2024-09-12T01:44:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.540+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2202891006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4dc0039e0 msgr2=0x7fd4f40b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.540+0000 7fd4fa79f640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4dc0039e0 0x7fd4f40b2340 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4001970 tx=0x7fd4e4001a40 comp rx=0 tx=0).stop 2024-09-12T01:44:30.541 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.540+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2202891006 shutdown_connections 2024-09-12T01:44:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.540+0000 7fd4fa79f640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd4f40ce2d0 0x7fd4f40ce750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.540+0000 7fd4fa79f640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd4e006be30 0x7fd4e006e2f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.540+0000 7fd4fa79f640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd4f415fc50 0x7fd4f40cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.540+0000 7fd4fa79f640 1 --2- 172.21.15.60:0/2202891006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4dc0039e0 0x7fd4f40b2340 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.540+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2202891006 >> 172.21.15.60:0/2202891006 conn(0x7fd4f40d1390 msgr2=0x7fd4f40b5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.541+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2202891006 shutdown_connections 2024-09-12T01:44:30.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.541+0000 7fd4fa79f640 1 -- 172.21.15.60:0/2202891006 wait complete. 2024-09-12T01:44:30.557 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-12T01:44:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.664+0000 7f17798d7640 1 Processor -- start 2024-09-12T01:44:30.665 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.664+0000 7f17798d7640 1 -- start start 2024-09-12T01:44:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.665+0000 7f17798d7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f177406e640 0x7f17740d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.665+0000 7f17798d7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17740cf450 con 0x7f177406e200 2024-09-12T01:44:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.665+0000 7f17798d7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17740cf730 con 0x7f177415fad0 2024-09-12T01:44:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.665+0000 7f17798d7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f177406d070 con 0x7f177406e640 2024-09-12T01:44:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.665+0000 7f17727fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f177406e200 0x7f17740d0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38896/0 (socket says 172.21.15.60:38896) 2024-09-12T01:44:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.665+0000 7f17727fc640 1 -- 172.21.15.60:0/1884419418 learned_addr learned my addr 172.21.15.60:0/1884419418 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f17737fe640 1 --2- 172.21.15.60:0/1884419418 >> v2:172.21.15.105:3300/0 conn(0x7f177406e640 0x7f17740d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888668988 0 0) 0x7f17740cf450 con 0x7f177406e200 2024-09-12T01:44:30.668 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1760003520 con 0x7f177406e200 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3770647529 0 0) 0x7f1760003520 con 0x7f177406e200 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 >> v2:172.21.15.105:3300/0 conn(0x7f177406e640 msgr2=0x7f17740d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 --2- 172.21.15.60:0/1884419418 >> v2:172.21.15.105:3300/0 conn(0x7f177406e640 0x7f17740d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 >> v1:172.21.15.105:6789/0 conn(0x7f177415fad0 legacy=0x7f177406c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17740cfa10 con 0x7f177406e200 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f175c001670 con 0x7f177406e200 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 >> v1:172.21.15.60:6789/0 conn(0x7f177406e200 legacy=0x7f17740d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 --2- 172.21.15.60:0/1884419418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17600039b0 0x7f1760003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 --2- 172.21.15.60:0/1884419418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 0x7f1760004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 --2- 172.21.15.60:0/1884419418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17600051c0 0x7f176000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f177406d070 con 0x7f1760004800 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f176000c060 con 0x7f17600051c0 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f176000c260 con 0x7f17600039b0 2024-09-12T01:44:30.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f17727fc640 1 --2- 172.21.15.60:0/1884419418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 0x7f1760004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f17737fe640 1 --2- 172.21.15.60:0/1884419418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17600051c0 0x7f176000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f1772ffd640 1 --2- 172.21.15.60:0/1884419418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17600039b0 0x7f1760003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.666+0000 7f17727fc640 1 -- 172.21.15.60:0/1884419418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17600039b0 msgr2=0x7f1760003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.667+0000 7f17727fc640 1 --2- 172.21.15.60:0/1884419418 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17600039b0 0x7f1760003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.667+0000 7f17727fc640 1 -- 172.21.15.60:0/1884419418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17600051c0 msgr2=0x7f176000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.667+0000 7f17727fc640 1 --2- 172.21.15.60:0/1884419418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17600051c0 0x7f176000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.667+0000 7f17727fc640 1 -- 172.21.15.60:0/1884419418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1760003520 con 0x7f1760004800 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.667+0000 7f17737fe640 1 --2- 172.21.15.60:0/1884419418 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17600051c0 0x7f176000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.667+0000 7f17737fe640 1 -- 172.21.15.60:0/1884419418 reap_dead start 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.667+0000 7f17727fc640 1 --2- 172.21.15.60:0/1884419418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 0x7f1760004c80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f175c00c290 tx=0x7f1760005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2164c67638b065a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.667+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175c007d30 con 0x7f1760004800 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.667+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f175c005af0 con 0x7f1760004800 2024-09-12T01:44:30.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.667+0000 7f1771ffb640 1 -- 172.21.15.60:0/1884419418 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175c007070 con 0x7f1760004800 2024-09-12T01:44:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.668+0000 7f17798d7640 1 -- 172.21.15.60:0/1884419418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 msgr2=0x7f1760004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.668+0000 7f17798d7640 1 --2- 172.21.15.60:0/1884419418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 0x7f1760004c80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f175c00c290 tx=0x7f1760005830 comp rx=0 tx=0).stop 2024-09-12T01:44:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.668+0000 7f17798d7640 1 -- 172.21.15.60:0/1884419418 shutdown_connections 2024-09-12T01:44:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.668+0000 7f17798d7640 1 --2- 172.21.15.60:0/1884419418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 0x7f1760004c80 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.668+0000 7f17798d7640 1 -- 172.21.15.60:0/1884419418 >> 172.21.15.60:0/1884419418 conn(0x7f17740b6ec0 msgr2=0x7f17740b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.668+0000 7f17798d7640 1 -- 172.21.15.60:0/1884419418 shutdown_connections 2024-09-12T01:44:30.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.668+0000 7f17798d7640 1 -- 172.21.15.60:0/1884419418 wait complete. 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.669+0000 7f17798d7640 1 Processor -- start 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.669+0000 7f17798d7640 1 -- start start 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.670+0000 7f17798d7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 0x7f1774157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.670+0000 7f17798d7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1774152940 0x7f17740b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.670+0000 7f17798d7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17740afcf0 0x7f17740b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.670+0000 7f17798d7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f177406d620 con 0x7f1760004800 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.670+0000 7f17798d7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f17740cfd80 con 0x7f1774152940 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.670+0000 7f17798d7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f177406d7a0 con 0x7f17740afcf0 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.670+0000 7f1772ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 0x7f1774157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.670+0000 7f1772ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 0x7f1774157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46150/0 (socket says 172.21.15.60:46150) 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.670+0000 7f1772ffd640 1 -- 172.21.15.60:0/4101677633 learned_addr learned my addr 172.21.15.60:0/4101677633 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f17727fc640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1774152940 0x7f17740b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:30.674 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f17737fe640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17740afcf0 0x7f17740b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f1772ffd640 1 -- 172.21.15.60:0/4101677633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17740afcf0 msgr2=0x7f17740b0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f1772ffd640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17740afcf0 0x7f17740b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f1772ffd640 1 -- 172.21.15.60:0/4101677633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1774152940 msgr2=0x7f17740b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f1772ffd640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1774152940 0x7f17740b5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f1772ffd640 1 -- 172.21.15.60:0/4101677633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1774153220 con 0x7f1760004800 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f17727fc640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1774152940 0x7f17740b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f1772ffd640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 0x7f1774157360 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f176400e840 tx=0x7f176400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f176bfff640 1 -- 172.21.15.60:0/4101677633 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764003b80 con 0x7f1760004800 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f176bfff640 1 -- 172.21.15.60:0/4101677633 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1764018070 con 0x7f1760004800 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f17798d7640 1 -- 172.21.15.60:0/4101677633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1774153500 con 0x7f1760004800 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f176bfff640 1 -- 172.21.15.60:0/4101677633 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17640050d0 con 0x7f1760004800 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.671+0000 7f17798d7640 1 -- 172.21.15.60:0/4101677633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1774153ac0 con 0x7f1760004800 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.672+0000 7f17798d7640 1 -- 172.21.15.60:0/4101677633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17740cf450 con 0x7f1760004800 2024-09-12T01:44:30.675 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.673+0000 7f176bfff640 1 -- 172.21.15.60:0/4101677633 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1764005270 con 0x7f1760004800 2024-09-12T01:44:30.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.673+0000 7f176bfff640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f175406be30 0x7f175406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:30.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.673+0000 7f176bfff640 1 -- 172.21.15.60:0/4101677633 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4857+0+0 (secure 0 0 0) 0x7f176408ab40 con 0x7f1760004800 2024-09-12T01:44:30.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.673+0000 7f17727fc640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f175406be30 0x7f175406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:30.676 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.674+0000 7f17727fc640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f175406be30 0x7f175406e2f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f175c032000 tx=0x7f175c009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:30.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.678+0000 7f176bfff640 1 -- 172.21.15.60:0/4101677633 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f176401a310 con 0x7f1760004800 2024-09-12T01:44:30.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.922+0000 7f17798d7640 1 -- 172.21.15.60:0/4101677633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f1774073380 con 0x7f1760004800 2024-09-12T01:44:30.923 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.923+0000 7f176bfff640 1 -- 172.21.15.60:0/4101677633 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7f1764059840 con 0x7f1760004800 2024-09-12T01:44:30.924 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:30.924 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:44:30.924 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2024-09-12T01:44:30.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.924 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2024-09-12T01:44:30.924 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmIK3fKxAAM9RkghDZwJZWuKouIbObDw==", 2024-09-12T01:44:30.924 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.924 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:44:30.924 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:44:30.924 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmzqHZNxAAnhCo4gGwLgYDVzzYnoiDFA==", 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmksMWMxAAp3xMDD09rfphgPZwQcEABA==", 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.d", 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmvLw/AxAApd4hl5LRD1QddnPPjRw2Kg==", 2024-09-12T01:44:30.926 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA7ReJmc3D/JxAAXiw6n1Q3n9sCXln6YSiCBA==", 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:44:30.927 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA/ReJmEOu3CxAA4uu1neLh0mpeG9nia+/VqQ==", 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.928 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBCReJm3HHtDhAAoAdKVsjuXmpcf5R5zTtFKg==", 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBFReJmtRLuIBAA/BBibpGfpXsFXqVjVrmXWA==", 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:44:30.929 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBMReJmdDNXKhAAeh5aCvMw+70z3tnwjb9Hjg==", 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.930 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBQReJm/tsIHRAAmgx+5WifY/VITGHAbUV2CQ==", 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBUReJmQFaBHhAA1vH01tePCoJQFXlHB5gcVg==", 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:44:30.931 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQBYReJmTHqLAhAAtUB94Pa3eihlVdaupZ8Ggg==", 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow profile osd", 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile osd", 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.932 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ==", 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmTopGEBAAY0K3iZm2PotQc8a489uO/Q==", 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:44:30.933 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.2", 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmqUgQDRAAAp5SAwNM9aSxZ1VVRwroNA==", 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.3", 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA6ReJmGfzeFRAAE2xCnzeyX/KBo3NBrkixYQ==", 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2024-09-12T01:44:30.935 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmOfXYDxAA0hydSyRvFmmNvFcRwPaXqg==", 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJmjpyMKBAAMSGgYJddHs7TtCV0NszZAQ==", 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.936 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-12T01:44:30.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:30.937 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2024-09-12T01:44:30.937 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQA5ReJm3Ei+JBAAhwgXWq0baTlDtaLedcaHmg==", 2024-09-12T01:44:30.937 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2024-09-12T01:44:30.937 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2024-09-12T01:44:30.937 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2024-09-12T01:44:30.937 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2024-09-12T01:44:30.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.937 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:30.937 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-12T01:44:30.937 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:44:30.938 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.925+0000 7f17798d7640 1 -- 172.21.15.60:0/4101677633 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f175406be30 msgr2=0x7f175406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:30.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.925+0000 7f17798d7640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f175406be30 0x7f175406e2f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f175c032000 tx=0x7f175c009030 comp rx=0 tx=0).stop 2024-09-12T01:44:30.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.925+0000 7f17798d7640 1 -- 172.21.15.60:0/4101677633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 msgr2=0x7f1774157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:30.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.925+0000 7f17798d7640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 0x7f1774157360 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f176400e840 tx=0x7f176400ed00 comp rx=0 tx=0).stop 2024-09-12T01:44:30.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.925+0000 7f17798d7640 1 -- 172.21.15.60:0/4101677633 shutdown_connections 2024-09-12T01:44:30.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.925+0000 7f17798d7640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f175406be30 0x7f175406e2f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.925+0000 7f17798d7640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17740afcf0 0x7f17740b0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.925+0000 7f17798d7640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1774152940 0x7f17740b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.925+0000 7f17798d7640 1 --2- 172.21.15.60:0/4101677633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1760004800 0x7f1774157360 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:30.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.925+0000 7f17798d7640 1 -- 172.21.15.60:0/4101677633 >> 172.21.15.60:0/4101677633 conn(0x7f17740b6ec0 msgr2=0x7f1774072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:30.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.925+0000 7f17798d7640 1 -- 172.21.15.60:0/4101677633 shutdown_connections 2024-09-12T01:44:30.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:30.925+0000 7f17798d7640 1 -- 172.21.15.60:0/4101677633 wait complete. 2024-09-12T01:44:30.940 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-12T01:44:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.042+0000 7f6a9756d640 1 Processor -- start 2024-09-12T01:44:31.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.042+0000 7f6a9756d640 1 -- start start 2024-09-12T01:44:31.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a9756d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a900cf6b0 0x7f6a901629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a9756d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a90162f30 0x7f6a900b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a9756d640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a900cfc20 con 0x7f6a900b63d0 2024-09-12T01:44:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a9756d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6a900d40c0 con 0x7f6a90162f30 2024-09-12T01:44:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a9756d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6a900d2ed0 con 0x7f6a900cf6b0 2024-09-12T01:44:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a95b0a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6a90162f30 0x7f6a900b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a95309640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6a900b63d0 0x7f6a900d39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:38906/0 (socket says 172.21.15.60:38906) 2024-09-12T01:44:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a95309640 1 -- 172.21.15.60:0/2098645824 learned_addr learned my addr 172.21.15.60:0/2098645824 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a94b08640 1 --2- 172.21.15.60:0/2098645824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a900cf6b0 0x7f6a901629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a95b0a640 1 -- 172.21.15.60:0/2098645824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a900cf6b0 msgr2=0x7f6a901629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a95b0a640 1 --2- 172.21.15.60:0/2098645824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a900cf6b0 0x7f6a901629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a95b0a640 1 -- 172.21.15.60:0/2098645824 >> v1:172.21.15.60:6789/0 conn(0x7f6a900b63d0 legacy=0x7f6a900d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:31.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.043+0000 7f6a95b0a640 1 -- 172.21.15.60:0/2098645824 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a900d31b0 con 0x7f6a90162f30 2024-09-12T01:44:31.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.044+0000 7f6a95b0a640 1 --2- 172.21.15.60:0/2098645824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a90162f30 0x7f6a900b7880 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009d90 tx=0x7f6a8802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50a6036243e3880 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:31.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.044+0000 7f6a83fff640 1 -- 172.21.15.60:0/2098645824 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88007740 con 0x7f6a90162f30 2024-09-12T01:44:31.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.044+0000 7f6a83fff640 1 -- 172.21.15.60:0/2098645824 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a880078e0 con 0x7f6a90162f30 2024-09-12T01:44:31.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.044+0000 7f6a83fff640 1 -- 172.21.15.60:0/2098645824 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88007cb0 con 0x7f6a90162f30 2024-09-12T01:44:31.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.045+0000 7f6a9756d640 1 -- 172.21.15.60:0/2098645824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a90162f30 msgr2=0x7f6a900b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:31.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.045+0000 7f6a9756d640 1 --2- 172.21.15.60:0/2098645824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a90162f30 0x7f6a900b7880 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009d90 tx=0x7f6a8802a660 comp rx=0 tx=0).stop 2024-09-12T01:44:31.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.045+0000 7f6a9756d640 1 -- 172.21.15.60:0/2098645824 shutdown_connections 2024-09-12T01:44:31.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.045+0000 7f6a9756d640 1 --2- 172.21.15.60:0/2098645824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a90162f30 0x7f6a900b7880 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.045+0000 7f6a9756d640 1 --2- 172.21.15.60:0/2098645824 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a900cf6b0 0x7f6a901629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.045+0000 7f6a9756d640 1 -- 172.21.15.60:0/2098645824 >> 172.21.15.60:0/2098645824 conn(0x7f6a900d1160 msgr2=0x7f6a900d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.045+0000 7f6a9756d640 1 -- 172.21.15.60:0/2098645824 shutdown_connections 2024-09-12T01:44:31.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.045+0000 7f6a9756d640 1 -- 172.21.15.60:0/2098645824 wait complete. 2024-09-12T01:44:31.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.046+0000 7f6a9756d640 1 Processor -- start 2024-09-12T01:44:31.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.046+0000 7f6a9756d640 1 -- start start 2024-09-12T01:44:31.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a9756d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a900b63d0 0x7f6a900b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:31.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a9756d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a900cf6b0 0x7f6a9014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:31.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a9756d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a90162f30 0x7f6a9014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:31.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a9756d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a900cb5c0 con 0x7f6a90162f30 2024-09-12T01:44:31.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a9756d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6a900cb440 con 0x7f6a900cf6b0 2024-09-12T01:44:31.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a9756d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6a900d1c80 con 0x7f6a900b63d0 2024-09-12T01:44:31.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a95b0a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a90162f30 0x7f6a9014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:31.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a95b0a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a90162f30 0x7f6a9014fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46174/0 (socket says 172.21.15.60:46174) 2024-09-12T01:44:31.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a95b0a640 1 -- 172.21.15.60:0/1610537638 learned_addr learned my addr 172.21.15.60:0/1610537638 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:31.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a94b08640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a900cf6b0 0x7f6a9014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:31.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a95309640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a900b63d0 0x7f6a900b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:31.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a95b0a640 1 -- 172.21.15.60:0/1610537638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a900b63d0 msgr2=0x7f6a900b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:31.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a95b0a640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a900b63d0 0x7f6a900b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a95b0a640 1 -- 172.21.15.60:0/1610537638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a900cf6b0 msgr2=0x7f6a9014f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:31.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a95b0a640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a900cf6b0 0x7f6a9014f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.047+0000 7f6a95b0a640 1 -- 172.21.15.60:0/1610537638 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a901f55e0 con 0x7f6a90162f30 2024-09-12T01:44:31.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.048+0000 7f6a95b0a640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a90162f30 0x7f6a9014fcb0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009eb0 tx=0x7f6a88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:31.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.048+0000 7f6a81ffb640 1 -- 172.21.15.60:0/1610537638 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8803f070 con 0x7f6a90162f30 2024-09-12T01:44:31.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.048+0000 7f6a81ffb640 1 -- 172.21.15.60:0/1610537638 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a88031bc0 con 0x7f6a90162f30 2024-09-12T01:44:31.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.048+0000 7f6a9756d640 1 -- 172.21.15.60:0/1610537638 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a900b5000 con 0x7f6a90162f30 2024-09-12T01:44:31.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.048+0000 7f6a81ffb640 1 -- 172.21.15.60:0/1610537638 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a88044460 con 0x7f6a90162f30 2024-09-12T01:44:31.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.048+0000 7f6a9756d640 1 -- 172.21.15.60:0/1610537638 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a901f5b30 con 0x7f6a90162f30 2024-09-12T01:44:31.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.049+0000 7f6a9756d640 1 -- 172.21.15.60:0/1610537638 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a900b67b0 con 0x7f6a90162f30 2024-09-12T01:44:31.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.049+0000 7f6a81ffb640 1 -- 172.21.15.60:0/1610537638 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6a88007790 con 0x7f6a90162f30 2024-09-12T01:44:31.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.050+0000 7f6a81ffb640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7406be30 0x7f6a7406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:31.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.050+0000 7f6a81ffb640 1 -- 172.21.15.60:0/1610537638 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4857+0+0 (secure 0 0 0) 0x7f6a880ac270 con 0x7f6a90162f30 2024-09-12T01:44:31.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.050+0000 7f6a95309640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7406be30 0x7f6a7406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:31.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.050+0000 7f6a95309640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7406be30 0x7f6a7406e2f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c007fd0 tx=0x7f6a8c007e80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:31.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.054+0000 7f6a81ffb640 1 -- 172.21.15.60:0/1610537638 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6a8807a920 con 0x7f6a90162f30 2024-09-12T01:44:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.232+0000 7f6a9756d640 1 -- 172.21.15.60:0/1610537638 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6a900b6d00 con 0x7f6a90162f30 2024-09-12T01:44:31.232 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.232+0000 7f6a81ffb640 1 -- 172.21.15.60:0/1610537638 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v135) ==== 84+0+65 (secure 0 0 0) 0x7f6a8807ec20 con 0x7f6a90162f30 2024-09-12T01:44:31.233 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:31.233 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2024-09-12T01:44:31.233 INFO:teuthology.orchestra.run.smithi060.stdout: { 2024-09-12T01:44:31.233 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2024-09-12T01:44:31.233 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": ".mgr" 2024-09-12T01:44:31.233 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-12T01:44:31.233 INFO:teuthology.orchestra.run.smithi060.stdout:] 2024-09-12T01:44:31.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.234+0000 7f6a9756d640 1 -- 172.21.15.60:0/1610537638 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7406be30 msgr2=0x7f6a7406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:31.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.234+0000 7f6a9756d640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7406be30 0x7f6a7406e2f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c007fd0 tx=0x7f6a8c007e80 comp rx=0 tx=0).stop 2024-09-12T01:44:31.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.234+0000 7f6a9756d640 1 -- 172.21.15.60:0/1610537638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a90162f30 msgr2=0x7f6a9014fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:31.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.234+0000 7f6a9756d640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a90162f30 0x7f6a9014fcb0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009eb0 tx=0x7f6a88004a40 comp rx=0 tx=0).stop 2024-09-12T01:44:31.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.234+0000 7f6a9756d640 1 -- 172.21.15.60:0/1610537638 shutdown_connections 2024-09-12T01:44:31.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.234+0000 7f6a9756d640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a90162f30 0x7f6a9014fcb0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.234+0000 7f6a9756d640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6a900cf6b0 0x7f6a9014f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.234+0000 7f6a9756d640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6a7406be30 0x7f6a7406e2f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.234+0000 7f6a9756d640 1 --2- 172.21.15.60:0/1610537638 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6a900b63d0 0x7f6a900b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.235 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.234+0000 7f6a9756d640 1 -- 172.21.15.60:0/1610537638 >> 172.21.15.60:0/1610537638 conn(0x7f6a900d1160 msgr2=0x7f6a90162620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.234+0000 7f6a9756d640 1 -- 172.21.15.60:0/1610537638 shutdown_connections 2024-09-12T01:44:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.234+0000 7f6a9756d640 1 -- 172.21.15.60:0/1610537638 wait complete. 2024-09-12T01:44:31.245 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-12T01:44:31.246 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-12T01:44:31.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.351+0000 7f1752559640 1 Processor -- start 2024-09-12T01:44:31.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.351+0000 7f1752559640 1 -- start start 2024-09-12T01:44:31.353 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.352+0000 7f1752559640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f174c158bd0 0x7f174c15f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:31.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.352+0000 7f1752559640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f174c0b4620 0x7f174c073a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:31.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.352+0000 7f1752559640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f174c0d24f0 con 0x7f174c0b4190 2024-09-12T01:44:31.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.352+0000 7f1752559640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f174c0d27d0 con 0x7f174c0b4620 2024-09-12T01:44:31.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.352+0000 7f1752559640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f174c0d2ab0 con 0x7f174c158bd0 2024-09-12T01:44:31.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.352+0000 7f1750af6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f174c0b4620 0x7f174c073a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:31.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.353+0000 7f1750af6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f174c0b4620 0x7f174c073a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46182/0 (socket says 172.21.15.60:46182) 2024-09-12T01:44:31.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.353+0000 7f1750af6640 1 -- 172.21.15.60:0/3823536487 learned_addr learned my addr 172.21.15.60:0/3823536487 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:31.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.353+0000 7f174bfff640 1 --2- 172.21.15.60:0/3823536487 >> v2:172.21.15.105:3300/0 conn(0x7f174c158bd0 0x7f174c15f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:31.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.353+0000 7f1750af6640 1 -- 172.21.15.60:0/3823536487 >> v2:172.21.15.105:3300/0 conn(0x7f174c158bd0 msgr2=0x7f174c15f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:31.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.353+0000 7f1750af6640 1 --2- 172.21.15.60:0/3823536487 >> v2:172.21.15.105:3300/0 conn(0x7f174c158bd0 0x7f174c15f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.353+0000 7f1750af6640 1 -- 172.21.15.60:0/3823536487 >> v1:172.21.15.105:6789/0 conn(0x7f174c0b4190 legacy=0x7f174c073300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:31.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.353+0000 7f1750af6640 1 -- 172.21.15.60:0/3823536487 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c0d2d90 con 0x7f174c0b4620 2024-09-12T01:44:31.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.354+0000 7f1750af6640 1 --2- 172.21.15.60:0/3823536487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c0b4620 0x7f174c073a10 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f174c075ab0 tx=0x7f174402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c51e591f851757 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:31.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.354+0000 7f174affd640 1 -- 172.21.15.60:0/3823536487 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744036070 con 0x7f174c0b4620 2024-09-12T01:44:31.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.354+0000 7f174affd640 1 -- 172.21.15.60:0/3823536487 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1744031600 con 0x7f174c0b4620 2024-09-12T01:44:31.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.354+0000 7f174affd640 1 -- 172.21.15.60:0/3823536487 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17440319d0 con 0x7f174c0b4620 2024-09-12T01:44:31.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.354+0000 7f1752559640 1 -- 172.21.15.60:0/3823536487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c0b4620 msgr2=0x7f174c073a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:31.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.354+0000 7f1752559640 1 --2- 172.21.15.60:0/3823536487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c0b4620 0x7f174c073a10 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f174c075ab0 tx=0x7f174402a6f0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.354+0000 7f1752559640 1 -- 172.21.15.60:0/3823536487 shutdown_connections 2024-09-12T01:44:31.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.354+0000 7f1752559640 1 --2- 172.21.15.60:0/3823536487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c0b4620 0x7f174c073a10 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.354+0000 7f1752559640 1 --2- 172.21.15.60:0/3823536487 >> v2:172.21.15.105:3300/0 conn(0x7f174c158bd0 0x7f174c15f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.354+0000 7f1752559640 1 -- 172.21.15.60:0/3823536487 >> 172.21.15.60:0/3823536487 conn(0x7f174c062630 msgr2=0x7f174c062a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:31.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.354+0000 7f1752559640 1 -- 172.21.15.60:0/3823536487 shutdown_connections 2024-09-12T01:44:31.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.354+0000 7f1752559640 1 -- 172.21.15.60:0/3823536487 wait complete. 2024-09-12T01:44:31.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.355+0000 7f1752559640 1 Processor -- start 2024-09-12T01:44:31.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.356+0000 7f1752559640 1 -- start start 2024-09-12T01:44:31.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.356+0000 7f1752559640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c0b4190 0x7f174c151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:31.358 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.356+0000 7f1752559640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c0b4620 0x7f174c0cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.356+0000 7f1752559640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f174c158bd0 0x7f174c15e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.356+0000 7f1752559640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f174c161f70 con 0x7f174c0b4620 2024-09-12T01:44:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.356+0000 7f1752559640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f174c0b4a50 con 0x7f174c158bd0 2024-09-12T01:44:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.356+0000 7f1752559640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f174c0d2180 con 0x7f174c0b4190 2024-09-12T01:44:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f174b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c0b4620 0x7f174c0cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f174b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c0b4620 0x7f174c0cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46186/0 (socket says 172.21.15.60:46186) 2024-09-12T01:44:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f174b7fe640 1 -- 172.21.15.60:0/250904715 learned_addr learned my addr 172.21.15.60:0/250904715 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f174bfff640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c0b4190 0x7f174c151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f1750af6640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f174c158bd0 0x7f174c15e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f174b7fe640 1 -- 172.21.15.60:0/250904715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c0b4190 msgr2=0x7f174c151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f174b7fe640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c0b4190 0x7f174c151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f174b7fe640 1 -- 172.21.15.60:0/250904715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f174c158bd0 msgr2=0x7f174c15e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f174b7fe640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f174c158bd0 0x7f174c15e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f174b7fe640 1 -- 172.21.15.60:0/250904715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c0ce760 con 0x7f174c0b4620 2024-09-12T01:44:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f174b7fe640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c0b4620 0x7f174c0cdaa0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f174000b3e0 tx=0x7f174000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f1748ff9640 1 -- 172.21.15.60:0/250904715 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740015020 con 0x7f174c0b4620 2024-09-12T01:44:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f1748ff9640 1 -- 172.21.15.60:0/250904715 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1740011850 con 0x7f174c0b4620 2024-09-12T01:44:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f1752559640 1 -- 172.21.15.60:0/250904715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c0ce480 con 0x7f174c0b4620 2024-09-12T01:44:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f1748ff9640 1 -- 172.21.15.60:0/250904715 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1740011c40 con 0x7f174c0b4620 2024-09-12T01:44:31.360 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.357+0000 7f1752559640 1 -- 172.21.15.60:0/250904715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c0cbc90 con 0x7f174c0b4620 2024-09-12T01:44:31.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.358+0000 7f1752559640 1 -- 172.21.15.60:0/250904715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f174c0b6fe0 con 0x7f174c0b4620 2024-09-12T01:44:31.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.359+0000 7f1748ff9640 1 -- 172.21.15.60:0/250904715 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1740018020 con 0x7f174c0b4620 2024-09-12T01:44:31.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.359+0000 7f1748ff9640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f173806be30 0x7f173806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:31.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.359+0000 7f1748ff9640 1 -- 172.21.15.60:0/250904715 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 4857+0+0 (secure 0 0 0) 0x7f174008a8e0 con 0x7f174c0b4620 2024-09-12T01:44:31.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.359+0000 7f174bfff640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f173806be30 0x7f173806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:31.361 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.360+0000 7f174bfff640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f173806be30 0x7f173806e2f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f173c00aac0 tx=0x7f173c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:31.364 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.363+0000 7f1748ff9640 1 -- 172.21.15.60:0/250904715 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f174001f020 con 0x7f174c0b4620 2024-09-12T01:44:31.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:31.538+0000 7f1752559640 1 -- 172.21.15.60:0/250904715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f174c0b77d0 con 0x7f174c0b4620 2024-09-12T01:44:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.543+0000 7f1748ff9640 1 -- 172.21.15.60:0/250904715 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v136) ==== 138+0+0 (secure 0 0 0) 0x7f174c0ce760 con 0x7f174c0b4620 2024-09-12T01:44:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2024-09-12T01:44:32.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.546+0000 7f1752559640 1 -- 172.21.15.60:0/250904715 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f173806be30 msgr2=0x7f173806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:32.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.546+0000 7f1752559640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f173806be30 0x7f173806e2f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f173c00aac0 tx=0x7f173c008040 comp rx=0 tx=0).stop 2024-09-12T01:44:32.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.546+0000 7f1752559640 1 -- 172.21.15.60:0/250904715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c0b4620 msgr2=0x7f174c0cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.546+0000 7f1752559640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c0b4620 0x7f174c0cdaa0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f174000b3e0 tx=0x7f174000b8a0 comp rx=0 tx=0).stop 2024-09-12T01:44:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.547+0000 7f1752559640 1 -- 172.21.15.60:0/250904715 shutdown_connections 2024-09-12T01:44:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.547+0000 7f1752559640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f174c158bd0 0x7f174c15e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.547+0000 7f1752559640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f174c0b4620 0x7f174c0cdaa0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.547+0000 7f1752559640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f173806be30 0x7f173806e2f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.547+0000 7f1752559640 1 --2- 172.21.15.60:0/250904715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f174c0b4190 0x7f174c151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.547+0000 7f1752559640 1 -- 172.21.15.60:0/250904715 >> 172.21.15.60:0/250904715 conn(0x7f174c062630 msgr2=0x7f174c15f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.547+0000 7f1752559640 1 -- 172.21.15.60:0/250904715 shutdown_connections 2024-09-12T01:44:32.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.549+0000 7f1752559640 1 -- 172.21.15.60:0/250904715 wait complete. 2024-09-12T01:44:32.567 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-12T01:44:32.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.682+0000 7fd34230a640 1 Processor -- start 2024-09-12T01:44:32.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.682+0000 7fd34230a640 1 -- start start 2024-09-12T01:44:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd34230a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33c15e6f0 0x7fd33c06fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd34230a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd33c0b54d0 0x7fd33c15f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd34230a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd33c06e990 con 0x7fd33c0b6d40 2024-09-12T01:44:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd34230a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd33c06ec70 con 0x7fd33c0b54d0 2024-09-12T01:44:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd34230a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd33c15ec70 con 0x7fd33c15e6f0 2024-09-12T01:44:32.684 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd333fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd33c0b54d0 0x7fd33c15f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd3408a7640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd33c0b6d40 0x7fd33c0b71f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54288/0 (socket says 172.21.15.60:54288) 2024-09-12T01:44:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd3408a7640 1 -- 172.21.15.60:0/1508122011 learned_addr learned my addr 172.21.15.60:0/1508122011 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd33bfff640 1 --2- 172.21.15.60:0/1508122011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33c15e6f0 0x7fd33c06fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd333fff640 1 -- 172.21.15.60:0/1508122011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33c15e6f0 msgr2=0x7fd33c06fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd333fff640 1 --2- 172.21.15.60:0/1508122011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33c15e6f0 0x7fd33c06fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd333fff640 1 -- 172.21.15.60:0/1508122011 >> v1:172.21.15.60:6789/0 conn(0x7fd33c0b6d40 legacy=0x7fd33c0b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd333fff640 1 -- 172.21.15.60:0/1508122011 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33c15ef50 con 0x7fd33c0b54d0 2024-09-12T01:44:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.683+0000 7fd33b7fe640 1 -- 172.21.15.60:0/1508122011 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185486648 0 0) 0x7fd33c06e990 con 0x7fd33c0b6d40 2024-09-12T01:44:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.684+0000 7fd33bfff640 1 --2- 172.21.15.60:0/1508122011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33c15e6f0 0x7fd33c06fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:32.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.684+0000 7fd333fff640 1 --2- 172.21.15.60:0/1508122011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c0b54d0 0x7fd33c15f750 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fd3240097a0 tx=0x7fd32402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42e9a20ce5aeb16 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:32.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.684+0000 7fd33b7fe640 1 -- 172.21.15.60:0/1508122011 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324037070 con 0x7fd33c0b54d0 2024-09-12T01:44:32.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.684+0000 7fd33b7fe640 1 -- 172.21.15.60:0/1508122011 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd324032440 con 0x7fd33c0b54d0 2024-09-12T01:44:32.686 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.684+0000 7fd33b7fe640 1 -- 172.21.15.60:0/1508122011 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324032810 con 0x7fd33c0b54d0 2024-09-12T01:44:32.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.685+0000 7fd34230a640 1 -- 172.21.15.60:0/1508122011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c0b54d0 msgr2=0x7fd33c15f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:32.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.685+0000 7fd34230a640 1 --2- 172.21.15.60:0/1508122011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c0b54d0 0x7fd33c15f750 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fd3240097a0 tx=0x7fd32402a180 comp rx=0 tx=0).stop 2024-09-12T01:44:32.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.685+0000 7fd34230a640 1 -- 172.21.15.60:0/1508122011 shutdown_connections 2024-09-12T01:44:32.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.685+0000 7fd34230a640 1 --2- 172.21.15.60:0/1508122011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c0b54d0 0x7fd33c15f750 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:32.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.685+0000 7fd34230a640 1 --2- 172.21.15.60:0/1508122011 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33c15e6f0 0x7fd33c06fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:32.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.685+0000 7fd34230a640 1 -- 172.21.15.60:0/1508122011 >> 172.21.15.60:0/1508122011 conn(0x7fd33c0d2430 msgr2=0x7fd33c0d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:32.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.685+0000 7fd34230a640 1 -- 172.21.15.60:0/1508122011 shutdown_connections 2024-09-12T01:44:32.687 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.685+0000 7fd34230a640 1 -- 172.21.15.60:0/1508122011 wait complete. 2024-09-12T01:44:32.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.686+0000 7fd34230a640 1 Processor -- start 2024-09-12T01:44:32.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.686+0000 7fd34230a640 1 -- start start 2024-09-12T01:44:32.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.687+0000 7fd34230a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd33c0b54d0 0x7fd33c14dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:32.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.687+0000 7fd34230a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33c0b6d40 0x7fd33c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.687+0000 7fd34230a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c15e6f0 0x7fd33c1622b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.687+0000 7fd34230a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c06e730 con 0x7fd33c15e6f0 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.687+0000 7fd34230a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd33c06e5b0 con 0x7fd33c0b54d0 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.687+0000 7fd34230a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd33c070830 con 0x7fd33c0b6d40 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.687+0000 7fd3408a7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c15e6f0 0x7fd33c1622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.687+0000 7fd3408a7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c15e6f0 0x7fd33c1622b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42650/0 (socket says 172.21.15.60:42650) 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.687+0000 7fd3408a7640 1 -- 172.21.15.60:0/3167588253 learned_addr learned my addr 172.21.15.60:0/3167588253 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.687+0000 7fd333fff640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33c0b6d40 0x7fd33c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.687+0000 7fd33bfff640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd33c0b54d0 0x7fd33c14dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.688+0000 7fd3408a7640 1 -- 172.21.15.60:0/3167588253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33c0b6d40 msgr2=0x7fd33c15b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.688+0000 7fd3408a7640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33c0b6d40 0x7fd33c15b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.688+0000 7fd3408a7640 1 -- 172.21.15.60:0/3167588253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd33c0b54d0 msgr2=0x7fd33c14dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.688+0000 7fd3408a7640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd33c0b54d0 0x7fd33c14dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.688+0000 7fd3408a7640 1 -- 172.21.15.60:0/3167588253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd33c14e320 con 0x7fd33c15e6f0 2024-09-12T01:44:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.688+0000 7fd33bfff640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd33c0b54d0 0x7fd33c14dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.688+0000 7fd3408a7640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c15e6f0 0x7fd33c1622b0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd33400c7d0 tx=0x7fd33400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.688+0000 7fd3397fa640 1 -- 172.21.15.60:0/3167588253 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd334018070 con 0x7fd33c15e6f0 2024-09-12T01:44:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.688+0000 7fd3397fa640 1 -- 172.21.15.60:0/3167588253 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd33400a640 con 0x7fd33c15e6f0 2024-09-12T01:44:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.688+0000 7fd34230a640 1 -- 172.21.15.60:0/3167588253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd33c161210 con 0x7fd33c15e6f0 2024-09-12T01:44:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.688+0000 7fd3397fa640 1 -- 172.21.15.60:0/3167588253 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd33400aa70 con 0x7fd33c15e6f0 2024-09-12T01:44:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.688+0000 7fd34230a640 1 -- 172.21.15.60:0/3167588253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd33c161ab0 con 0x7fd33c15e6f0 2024-09-12T01:44:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.689+0000 7fd34230a640 1 -- 172.21.15.60:0/3167588253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd33c158520 con 0x7fd33c15e6f0 2024-09-12T01:44:32.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.690+0000 7fd3397fa640 1 -- 172.21.15.60:0/3167588253 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd33401b070 con 0x7fd33c15e6f0 2024-09-12T01:44:32.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.690+0000 7fd3397fa640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd31c06be30 0x7fd31c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:32.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.690+0000 7fd3397fa640 1 -- 172.21.15.60:0/3167588253 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5227+0+0 (secure 0 0 0) 0x7fd33408a200 con 0x7fd33c15e6f0 2024-09-12T01:44:32.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.690+0000 7fd33bfff640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd31c06be30 0x7fd31c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:32.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.691+0000 7fd33bfff640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd31c06be30 0x7fd31c06e2f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00a990 tx=0x7fd32c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.695+0000 7fd3397fa640 1 -- 172.21.15.60:0/3167588253 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd334058740 con 0x7fd33c15e6f0 2024-09-12T01:44:32.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:32.871+0000 7fd34230a640 1 -- 172.21.15.60:0/3167588253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd33c157600 con 0x7fd33c15e6f0 2024-09-12T01:44:33.546 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.545+0000 7fd3397fa640 1 -- 172.21.15.60:0/3167588253 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v137) ==== 170+0+0 (secure 0 0 0) 0x7fd33405ca40 con 0x7fd33c15e6f0 2024-09-12T01:44:33.546 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2024-09-12T01:44:33.549 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.549+0000 7fd34230a640 1 -- 172.21.15.60:0/3167588253 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd31c06be30 msgr2=0x7fd31c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:33.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.549+0000 7fd34230a640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd31c06be30 0x7fd31c06e2f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd32c00a990 tx=0x7fd32c008040 comp rx=0 tx=0).stop 2024-09-12T01:44:33.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.549+0000 7fd34230a640 1 -- 172.21.15.60:0/3167588253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c15e6f0 msgr2=0x7fd33c1622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:33.550 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.549+0000 7fd34230a640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c15e6f0 0x7fd33c1622b0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fd33400c7d0 tx=0x7fd33400cc90 comp rx=0 tx=0).stop 2024-09-12T01:44:33.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.551+0000 7fd34230a640 1 -- 172.21.15.60:0/3167588253 shutdown_connections 2024-09-12T01:44:33.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.551+0000 7fd34230a640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c15e6f0 0x7fd33c1622b0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:33.551 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.551+0000 7fd34230a640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd31c06be30 0x7fd31c06e2f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:33.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.551+0000 7fd34230a640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd33c0b6d40 0x7fd33c15b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:33.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.551+0000 7fd34230a640 1 --2- 172.21.15.60:0/3167588253 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd33c0b54d0 0x7fd33c14dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:33.552 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.551+0000 7fd34230a640 1 -- 172.21.15.60:0/3167588253 >> 172.21.15.60:0/3167588253 conn(0x7fd33c0d2430 msgr2=0x7fd33c0b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:33.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.554+0000 7fd34230a640 1 -- 172.21.15.60:0/3167588253 shutdown_connections 2024-09-12T01:44:33.555 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.555+0000 7fd34230a640 1 -- 172.21.15.60:0/3167588253 wait complete. 2024-09-12T01:44:33.580 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-12T01:44:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.691+0000 7fc520a65640 1 Processor -- start 2024-09-12T01:44:33.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.691+0000 7fc520a65640 1 -- start start 2024-09-12T01:44:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.692+0000 7fc520a65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c0d1c10 0x7fc51c0cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.692+0000 7fc520a65640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc51c0cf2f0 0x7fc51c0d3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.692+0000 7fc520a65640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc51c0b7ad0 con 0x7fc51c15e600 2024-09-12T01:44:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.692+0000 7fc520a65640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc51c0cf7a0 con 0x7fc51c0cf2f0 2024-09-12T01:44:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.692+0000 7fc520a65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc51c0d2ee0 con 0x7fc51c0d1c10 2024-09-12T01:44:33.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.692+0000 7fc51a59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc51c15e600 0x7fc51c0d1500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54304/0 (socket says 172.21.15.60:54304) 2024-09-12T01:44:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.692+0000 7fc51a59c640 1 -- 172.21.15.60:0/1674012214 learned_addr learned my addr 172.21.15.60:0/1674012214 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.692+0000 7fc513fff640 1 --2- 172.21.15.60:0/1674012214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c0d1c10 0x7fc51c0cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.692+0000 7fc51ad9d640 1 --2- 172.21.15.60:0/1674012214 >> v2:172.21.15.105:3300/0 conn(0x7fc51c0cf2f0 0x7fc51c0d3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.692+0000 7fc519d9b640 1 -- 172.21.15.60:0/1674012214 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3849922172 0 0) 0x7fc50c001110 con 0x7fc51c15e600 2024-09-12T01:44:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.692+0000 7fc519d9b640 1 -- 172.21.15.60:0/1674012214 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc508003520 con 0x7fc51c15e600 2024-09-12T01:44:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.693+0000 7fc513fff640 1 -- 172.21.15.60:0/1674012214 >> v2:172.21.15.105:3300/0 conn(0x7fc51c0cf2f0 msgr2=0x7fc51c0d3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.693+0000 7fc513fff640 1 --2- 172.21.15.60:0/1674012214 >> v2:172.21.15.105:3300/0 conn(0x7fc51c0cf2f0 0x7fc51c0d3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.693+0000 7fc513fff640 1 -- 172.21.15.60:0/1674012214 >> v1:172.21.15.60:6789/0 conn(0x7fc51c15e600 legacy=0x7fc51c0d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.693+0000 7fc519d9b640 1 -- 172.21.15.60:0/1674012214 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3486044657 0 0) 0x7fc508003520 con 0x7fc51c15e600 2024-09-12T01:44:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.693+0000 7fc513fff640 1 -- 172.21.15.60:0/1674012214 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51c0cf9e0 con 0x7fc51c0d1c10 2024-09-12T01:44:33.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.693+0000 7fc51ad9d640 1 --2- 172.21.15.60:0/1674012214 >> v2:172.21.15.105:3300/0 conn(0x7fc51c0cf2f0 0x7fc51c0d3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.693+0000 7fc513fff640 1 --2- 172.21.15.60:0/1674012214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c0d1c10 0x7fc51c0cedb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc5040097a0 tx=0x7fc50402a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4ea7b3448d74809 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:33.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.694+0000 7fc519d9b640 1 -- 172.21.15.60:0/1674012214 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc504037070 con 0x7fc51c0d1c10 2024-09-12T01:44:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.694+0000 7fc519d9b640 1 -- 172.21.15.60:0/1674012214 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50402aba0 con 0x7fc51c0d1c10 2024-09-12T01:44:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.694+0000 7fc519d9b640 1 -- 172.21.15.60:0/1674012214 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c001840 con 0x7fc51c0d1c10 2024-09-12T01:44:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.694+0000 7fc520a65640 1 -- 172.21.15.60:0/1674012214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c0d1c10 msgr2=0x7fc51c0cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.694+0000 7fc520a65640 1 --2- 172.21.15.60:0/1674012214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c0d1c10 0x7fc51c0cedb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc5040097a0 tx=0x7fc50402a110 comp rx=0 tx=0).stop 2024-09-12T01:44:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.694+0000 7fc520a65640 1 -- 172.21.15.60:0/1674012214 shutdown_connections 2024-09-12T01:44:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.694+0000 7fc520a65640 1 --2- 172.21.15.60:0/1674012214 >> v2:172.21.15.105:3300/0 conn(0x7fc51c0cf2f0 0x7fc51c0d3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.694+0000 7fc520a65640 1 --2- 172.21.15.60:0/1674012214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c0d1c10 0x7fc51c0cedb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.694+0000 7fc520a65640 1 -- 172.21.15.60:0/1674012214 >> 172.21.15.60:0/1674012214 conn(0x7fc51c06c2c0 msgr2=0x7fc51c06c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.694+0000 7fc520a65640 1 -- 172.21.15.60:0/1674012214 shutdown_connections 2024-09-12T01:44:33.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.694+0000 7fc520a65640 1 -- 172.21.15.60:0/1674012214 wait complete. 2024-09-12T01:44:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.696+0000 7fc520a65640 1 Processor -- start 2024-09-12T01:44:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.696+0000 7fc520a65640 1 -- start start 2024-09-12T01:44:33.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.696+0000 7fc520a65640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51c0cf2f0 0x7fc51c14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.696+0000 7fc520a65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c0d1c10 0x7fc51c1515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.696+0000 7fc520a65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc51c15e600 0x7fc51c151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.696+0000 7fc520a65640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c0d2b70 con 0x7fc51c15e600 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.696+0000 7fc520a65640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc51c0cffa0 con 0x7fc51c0cf2f0 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.696+0000 7fc520a65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc51c15e9e0 con 0x7fc51c0d1c10 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc51ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc51c15e600 0x7fc51c151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc51ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc51c15e600 0x7fc51c151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42664/0 (socket says 172.21.15.60:42664) 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc51ad9d640 1 -- 172.21.15.60:0/2257166272 learned_addr learned my addr 172.21.15.60:0/2257166272 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc51a59c640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51c0cf2f0 0x7fc51c14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc513fff640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c0d1c10 0x7fc51c1515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc51ad9d640 1 -- 172.21.15.60:0/2257166272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c0d1c10 msgr2=0x7fc51c1515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc51ad9d640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c0d1c10 0x7fc51c1515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc51ad9d640 1 -- 172.21.15.60:0/2257166272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51c0cf2f0 msgr2=0x7fc51c14fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc51ad9d640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51c0cf2f0 0x7fc51c14fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:33.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc51ad9d640 1 -- 172.21.15.60:0/2257166272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc51c1e5490 con 0x7fc51c15e600 2024-09-12T01:44:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc51ad9d640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc51c15e600 0x7fc51c151b20 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fc51400efc0 tx=0x7fc514009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc512ffd640 1 -- 172.21.15.60:0/2257166272 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc514018030 con 0x7fc51c15e600 2024-09-12T01:44:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc512ffd640 1 -- 172.21.15.60:0/2257166272 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc51400cde0 con 0x7fc51c15e600 2024-09-12T01:44:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc520a65640 1 -- 172.21.15.60:0/2257166272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc51c1e5770 con 0x7fc51c15e600 2024-09-12T01:44:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc512ffd640 1 -- 172.21.15.60:0/2257166272 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc514003bb0 con 0x7fc51c15e600 2024-09-12T01:44:33.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.697+0000 7fc520a65640 1 -- 172.21.15.60:0/2257166272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc51c1e5d30 con 0x7fc51c15e600 2024-09-12T01:44:33.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.698+0000 7fc520a65640 1 -- 172.21.15.60:0/2257166272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc51c0cedb0 con 0x7fc51c15e600 2024-09-12T01:44:33.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.699+0000 7fc512ffd640 1 -- 172.21.15.60:0/2257166272 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc514005d10 con 0x7fc51c15e600 2024-09-12T01:44:33.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.700+0000 7fc512ffd640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4fc06be30 0x7fc4fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:33.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.700+0000 7fc512ffd640 1 -- 172.21.15.60:0/2257166272 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5609+0+0 (secure 0 0 0) 0x7fc51408b740 con 0x7fc51c15e600 2024-09-12T01:44:33.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.700+0000 7fc51a59c640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4fc06be30 0x7fc4fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:33.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.700+0000 7fc51a59c640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4fc06be30 0x7fc4fc06e2f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc50c005880 tx=0x7fc50c001230 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:33.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.704+0000 7fc512ffd640 1 -- 172.21.15.60:0/2257166272 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc514022070 con 0x7fc51c15e600 2024-09-12T01:44:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:33.919+0000 7fc520a65640 1 -- 172.21.15.60:0/2257166272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fc51c0d25f0 con 0x7fc51c15e600 2024-09-12T01:44:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.565+0000 7fc512ffd640 1 -- 172.21.15.60:0/2257166272 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v86) ==== 174+0+0 (secure 0 0 0) 0x7fc514010040 con 0x7fc51c15e600 2024-09-12T01:44:34.569 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 22 and data pool 23 2024-09-12T01:44:34.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.575+0000 7fc520a65640 1 -- 172.21.15.60:0/2257166272 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4fc06be30 msgr2=0x7fc4fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:34.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.575+0000 7fc520a65640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4fc06be30 0x7fc4fc06e2f0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc50c005880 tx=0x7fc50c001230 comp rx=0 tx=0).stop 2024-09-12T01:44:34.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.575+0000 7fc520a65640 1 -- 172.21.15.60:0/2257166272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc51c15e600 msgr2=0x7fc51c151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:34.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.575+0000 7fc520a65640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc51c15e600 0x7fc51c151b20 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fc51400efc0 tx=0x7fc514009f90 comp rx=0 tx=0).stop 2024-09-12T01:44:34.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.576+0000 7fc520a65640 1 -- 172.21.15.60:0/2257166272 shutdown_connections 2024-09-12T01:44:34.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.576+0000 7fc520a65640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc51c15e600 0x7fc51c151b20 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.577 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.577+0000 7fc520a65640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc4fc06be30 0x7fc4fc06e2f0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.577+0000 7fc520a65640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc51c0d1c10 0x7fc51c1515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.577+0000 7fc520a65640 1 --2- 172.21.15.60:0/2257166272 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc51c0cf2f0 0x7fc51c14fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.577+0000 7fc520a65640 1 -- 172.21.15.60:0/2257166272 >> 172.21.15.60:0/2257166272 conn(0x7fc51c06c2c0 msgr2=0x7fc51c06c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:34.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.577+0000 7fc520a65640 1 -- 172.21.15.60:0/2257166272 shutdown_connections 2024-09-12T01:44:34.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.578+0000 7fc520a65640 1 -- 172.21.15.60:0/2257166272 wait complete. 2024-09-12T01:44:34.601 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:44:34.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.708+0000 7fbedc882640 1 Processor -- start 2024-09-12T01:44:34.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.708+0000 7fbedc882640 1 -- start start 2024-09-12T01:44:34.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.709+0000 7fbedc882640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbed80d3310 0x7fbed80d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:34.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.709+0000 7fbedc882640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbed80d1650 0x7fbed80b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:34.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.709+0000 7fbedc882640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed815ea40 con 0x7fbed815e660 2024-09-12T01:44:34.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.709+0000 7fbedc882640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbed80d1ac0 con 0x7fbed80d1650 2024-09-12T01:44:34.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.709+0000 7fbedc882640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbed80d3870 con 0x7fbed80d3310 2024-09-12T01:44:34.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.709+0000 7fbed6d9d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbed80d1650 0x7fbed80b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:34.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.709+0000 7fbed5d9b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbed80d3310 0x7fbed80d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:34.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.709+0000 7fbed659c640 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fbed815e660 0x7fbed80cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.60:48588/0 (socket says 172.21.15.60:48588) 2024-09-12T01:44:34.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.709+0000 7fbed659c640 1 -- 172.21.15.60:0/3325342481 learned_addr learned my addr 172.21.15.60:0/3325342481 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:34.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.710+0000 7fbed6d9d640 1 -- 172.21.15.60:0/3325342481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbed80d3310 msgr2=0x7fbed80d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:34.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.710+0000 7fbed6d9d640 1 --2- 172.21.15.60:0/3325342481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbed80d3310 0x7fbed80d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.710+0000 7fbed6d9d640 1 -- 172.21.15.60:0/3325342481 >> v1:172.21.15.105:6789/0 conn(0x7fbed815e660 legacy=0x7fbed80cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:34.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.710+0000 7fbed6d9d640 1 -- 172.21.15.60:0/3325342481 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed80d3b50 con 0x7fbed80d1650 2024-09-12T01:44:34.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.711+0000 7fbed6d9d640 1 --2- 172.21.15.60:0/3325342481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbed80d1650 0x7fbed80b7b70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009d90 tx=0x7fbed002a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc93ac1753c3380a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:34.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.711+0000 7fbed559a640 1 -- 172.21.15.60:0/3325342481 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0007740 con 0x7fbed80d1650 2024-09-12T01:44:34.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.711+0000 7fbed559a640 1 -- 172.21.15.60:0/3325342481 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed00078e0 con 0x7fbed80d1650 2024-09-12T01:44:34.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.711+0000 7fbed559a640 1 -- 172.21.15.60:0/3325342481 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0007cb0 con 0x7fbed80d1650 2024-09-12T01:44:34.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.711+0000 7fbedc882640 1 -- 172.21.15.60:0/3325342481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbed80d1650 msgr2=0x7fbed80b7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:34.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.711+0000 7fbedc882640 1 --2- 172.21.15.60:0/3325342481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbed80d1650 0x7fbed80b7b70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009d90 tx=0x7fbed002a660 comp rx=0 tx=0).stop 2024-09-12T01:44:34.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.711+0000 7fbedc882640 1 -- 172.21.15.60:0/3325342481 shutdown_connections 2024-09-12T01:44:34.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.711+0000 7fbedc882640 1 --2- 172.21.15.60:0/3325342481 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbed80d1650 0x7fbed80b7b70 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.711+0000 7fbedc882640 1 --2- 172.21.15.60:0/3325342481 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbed80d3310 0x7fbed80d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.711+0000 7fbedc882640 1 -- 172.21.15.60:0/3325342481 >> 172.21.15.60:0/3325342481 conn(0x7fbed80b6410 msgr2=0x7fbed80b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:34.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.712+0000 7fbedc882640 1 -- 172.21.15.60:0/3325342481 shutdown_connections 2024-09-12T01:44:34.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.712+0000 7fbedc882640 1 -- 172.21.15.60:0/3325342481 wait complete. 2024-09-12T01:44:34.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.713+0000 7fbedc882640 1 Processor -- start 2024-09-12T01:44:34.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.713+0000 7fbedc882640 1 -- start start 2024-09-12T01:44:34.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbedc882640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed80d1650 0x7fbed8160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:34.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbedc882640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbed80d3310 0x7fbed815ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbedc882640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbed815e660 0x7fbed815f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbedc882640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbed80d43f0 con 0x7fbed80d1650 2024-09-12T01:44:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbedc882640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbed80d4110 con 0x7fbed80d3310 2024-09-12T01:44:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbedc882640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbed80b80b0 con 0x7fbed815e660 2024-09-12T01:44:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed80d1650 0x7fbed8160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed80d1650 0x7fbed8160310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42676/0 (socket says 172.21.15.60:42676) 2024-09-12T01:44:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed659c640 1 -- 172.21.15.60:0/2643990945 learned_addr learned my addr 172.21.15.60:0/2643990945 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed5d9b640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbed80d3310 0x7fbed815ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed6d9d640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbed815e660 0x7fbed815f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed659c640 1 -- 172.21.15.60:0/2643990945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbed815e660 msgr2=0x7fbed815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed659c640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbed815e660 0x7fbed815f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed659c640 1 -- 172.21.15.60:0/2643990945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbed80d3310 msgr2=0x7fbed815ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed659c640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbed80d3310 0x7fbed815ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed659c640 1 -- 172.21.15.60:0/2643990945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed815d9a0 con 0x7fbed80d1650 2024-09-12T01:44:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed6d9d640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbed815e660 0x7fbed815f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed5d9b640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbed80d3310 0x7fbed815ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.714+0000 7fbed659c640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed80d1650 0x7fbed8160310 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c3c0 tx=0x7fbec800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.715+0000 7fbec6ffd640 1 -- 172.21.15.60:0/2643990945 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec8017070 con 0x7fbed80d1650 2024-09-12T01:44:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.715+0000 7fbec6ffd640 1 -- 172.21.15.60:0/2643990945 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec8005ce0 con 0x7fbed80d1650 2024-09-12T01:44:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.715+0000 7fbedc882640 1 -- 172.21.15.60:0/2643990945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed815dc80 con 0x7fbed80d1650 2024-09-12T01:44:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.715+0000 7fbec6ffd640 1 -- 172.21.15.60:0/2643990945 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec80072f0 con 0x7fbed80d1650 2024-09-12T01:44:34.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.715+0000 7fbedc882640 1 -- 172.21.15.60:0/2643990945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed80ca550 con 0x7fbed80d1650 2024-09-12T01:44:34.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.716+0000 7fbedc882640 1 -- 172.21.15.60:0/2643990945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed80d24c0 con 0x7fbed80d1650 2024-09-12T01:44:34.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.716+0000 7fbec6ffd640 1 -- 172.21.15.60:0/2643990945 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbec801a070 con 0x7fbed80d1650 2024-09-12T01:44:34.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.717+0000 7fbec6ffd640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbeb806be30 0x7fbeb806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:34.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.717+0000 7fbec6ffd640 1 -- 172.21.15.60:0/2643990945 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7fbec808a180 con 0x7fbed80d1650 2024-09-12T01:44:34.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.717+0000 7fbed5d9b640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbeb806be30 0x7fbeb806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:34.719 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.717+0000 7fbed5d9b640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbeb806be30 0x7fbeb806e2f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbed80c7c30 tx=0x7fbecc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:34.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.721+0000 7fbec6ffd640 1 -- 172.21.15.60:0/2643990945 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbed80d24c0 con 0x7fbed80d1650 2024-09-12T01:44:34.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.897+0000 7fbedc882640 1 -- 172.21.15.60:0/2643990945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbed80b7b70 con 0x7fbed80d1650 2024-09-12T01:44:34.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.899+0000 7fbec6ffd640 1 -- 172.21.15.60:0/2643990945 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) ==== 74+0+16716 (secure 0 0 0) 0x7fbec8058bc0 con 0x7fbed80d1650 2024-09-12T01:44:34.899 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:34.899 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":138,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:44:33.921591+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:44:31.572386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-12T01:44:32.903039+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:44:34.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.900+0000 7fbedc882640 1 -- 172.21.15.60:0/2643990945 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbeb806be30 msgr2=0x7fbeb806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:34.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.900+0000 7fbedc882640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbeb806be30 0x7fbeb806e2f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbed80c7c30 tx=0x7fbecc008040 comp rx=0 tx=0).stop 2024-09-12T01:44:34.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.900+0000 7fbedc882640 1 -- 172.21.15.60:0/2643990945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed80d1650 msgr2=0x7fbed8160310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:34.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.900+0000 7fbedc882640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed80d1650 0x7fbed8160310 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fbec800c3c0 tx=0x7fbec800c880 comp rx=0 tx=0).stop 2024-09-12T01:44:34.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.900+0000 7fbedc882640 1 -- 172.21.15.60:0/2643990945 shutdown_connections 2024-09-12T01:44:34.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.900+0000 7fbedc882640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbeb806be30 0x7fbeb806e2f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.900+0000 7fbedc882640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbed815e660 0x7fbed815f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.900+0000 7fbedc882640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbed80d3310 0x7fbed815ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.900+0000 7fbedc882640 1 --2- 172.21.15.60:0/2643990945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbed80d1650 0x7fbed8160310 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:34.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.900+0000 7fbedc882640 1 -- 172.21.15.60:0/2643990945 >> 172.21.15.60:0/2643990945 conn(0x7fbed80b6410 msgr2=0x7fbed80b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:34.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.901+0000 7fbedc882640 1 -- 172.21.15.60:0/2643990945 shutdown_connections 2024-09-12T01:44:34.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:34.901+0000 7fbedc882640 1 -- 172.21.15.60:0/2643990945 wait complete. 2024-09-12T01:44:34.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:44:35.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.014+0000 7ffab431a640 1 Processor -- start 2024-09-12T01:44:35.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.014+0000 7ffab431a640 1 -- start start 2024-09-12T01:44:35.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.015+0000 7ffab431a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffaac0d3310 0x7ffaac0d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.015+0000 7ffab431a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffaac0d1650 0x7ffaac0b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.015+0000 7ffab431a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaac15ea40 con 0x7ffaac15e660 2024-09-12T01:44:35.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.015+0000 7ffab431a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ffaac0d1ac0 con 0x7ffaac0d3310 2024-09-12T01:44:35.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.015+0000 7ffab431a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ffaac0d3870 con 0x7ffaac0d1650 2024-09-12T01:44:35.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.015+0000 7ffab18b5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffaac0d3310 0x7ffaac0d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.015+0000 7ffab18b5640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffaac0d3310 0x7ffaac0d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42684/0 (socket says 172.21.15.60:42684) 2024-09-12T01:44:35.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.015+0000 7ffab18b5640 1 -- 172.21.15.60:0/1144794357 learned_addr learned my addr 172.21.15.60:0/1144794357 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:35.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.016+0000 7ffab28b7640 1 --2- 172.21.15.60:0/1144794357 >> v2:172.21.15.105:3300/0 conn(0x7ffaac0d1650 0x7ffaac0b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.016+0000 7ffab18b5640 1 -- 172.21.15.60:0/1144794357 >> v2:172.21.15.105:3300/0 conn(0x7ffaac0d1650 msgr2=0x7ffaac0b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:35.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.016+0000 7ffab18b5640 1 --2- 172.21.15.60:0/1144794357 >> v2:172.21.15.105:3300/0 conn(0x7ffaac0d1650 0x7ffaac0b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.016+0000 7ffab18b5640 1 -- 172.21.15.60:0/1144794357 >> v1:172.21.15.105:6789/0 conn(0x7ffaac15e660 legacy=0x7ffaac0cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.016+0000 7ffab18b5640 1 -- 172.21.15.60:0/1144794357 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaac0d3b50 con 0x7ffaac0d3310 2024-09-12T01:44:35.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.016+0000 7ffab28b7640 1 --2- 172.21.15.60:0/1144794357 >> v2:172.21.15.105:3300/0 conn(0x7ffaac0d1650 0x7ffaac0b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:35.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.017+0000 7ffab18b5640 1 --2- 172.21.15.60:0/1144794357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffaac0d3310 0x7ffaac0d1110 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0d26b0 tx=0x7ffa9c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa58f9ebe5bfe34 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:35.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.017+0000 7ffab10b4640 1 -- 172.21.15.60:0/1144794357 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c037070 con 0x7ffaac0d3310 2024-09-12T01:44:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.017+0000 7ffab10b4640 1 -- 172.21.15.60:0/1144794357 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa9c032440 con 0x7ffaac0d3310 2024-09-12T01:44:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.017+0000 7ffab10b4640 1 -- 172.21.15.60:0/1144794357 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c032810 con 0x7ffaac0d3310 2024-09-12T01:44:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.017+0000 7ffab431a640 1 -- 172.21.15.60:0/1144794357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffaac0d3310 msgr2=0x7ffaac0d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.017+0000 7ffab431a640 1 --2- 172.21.15.60:0/1144794357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffaac0d3310 0x7ffaac0d1110 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0d26b0 tx=0x7ffa9c02a270 comp rx=0 tx=0).stop 2024-09-12T01:44:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.017+0000 7ffab431a640 1 -- 172.21.15.60:0/1144794357 shutdown_connections 2024-09-12T01:44:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.017+0000 7ffab431a640 1 --2- 172.21.15.60:0/1144794357 >> v2:172.21.15.105:3300/0 conn(0x7ffaac0d1650 0x7ffaac0b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.017+0000 7ffab431a640 1 --2- 172.21.15.60:0/1144794357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffaac0d3310 0x7ffaac0d1110 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.017+0000 7ffab431a640 1 -- 172.21.15.60:0/1144794357 >> 172.21.15.60:0/1144794357 conn(0x7ffaac0b6410 msgr2=0x7ffaac0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.017+0000 7ffab431a640 1 -- 172.21.15.60:0/1144794357 shutdown_connections 2024-09-12T01:44:35.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.017+0000 7ffab431a640 1 -- 172.21.15.60:0/1144794357 wait complete. 2024-09-12T01:44:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.019+0000 7ffab431a640 1 Processor -- start 2024-09-12T01:44:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.019+0000 7ffab431a640 1 -- start start 2024-09-12T01:44:35.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.019+0000 7ffab431a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaac0d1650 0x7ffaac15f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.019+0000 7ffab431a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffaac0d3310 0x7ffaac14dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.019+0000 7ffab431a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffaac15e660 0x7ffaac0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.019+0000 7ffab431a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac0d43f0 con 0x7ffaac15e660 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.019+0000 7ffab431a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffaac0d4110 con 0x7ffaac0d3310 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.019+0000 7ffab431a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffaac0b80b0 con 0x7ffaac0d1650 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.019+0000 7ffab28b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffaac15e660 0x7ffaac0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.019+0000 7ffab28b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffaac15e660 0x7ffaac0caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42690/0 (socket says 172.21.15.60:42690) 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffab28b7640 1 -- 172.21.15.60:0/3508904660 learned_addr learned my addr 172.21.15.60:0/3508904660 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffab18b5640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffaac0d3310 0x7ffaac14dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffab20b6640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaac0d1650 0x7ffaac15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffab28b7640 1 -- 172.21.15.60:0/3508904660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaac0d1650 msgr2=0x7ffaac15f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffab28b7640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaac0d1650 0x7ffaac15f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffab28b7640 1 -- 172.21.15.60:0/3508904660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffaac0d3310 msgr2=0x7ffaac14dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffab28b7640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffaac0d3310 0x7ffaac14dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffab28b7640 1 -- 172.21.15.60:0/3508904660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaac14e150 con 0x7ffaac15e660 2024-09-12T01:44:35.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffab28b7640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffaac15e660 0x7ffaac0caa20 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4007f20 tx=0x7ffaa400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:35.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffaa2ffd640 1 -- 172.21.15.60:0/3508904660 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa401a070 con 0x7ffaac15e660 2024-09-12T01:44:35.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffaa2ffd640 1 -- 172.21.15.60:0/3508904660 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa4003b90 con 0x7ffaac15e660 2024-09-12T01:44:35.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffab431a640 1 -- 172.21.15.60:0/3508904660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaac15ff60 con 0x7ffaac15e660 2024-09-12T01:44:35.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffaa2ffd640 1 -- 172.21.15.60:0/3508904660 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4004030 con 0x7ffaac15e660 2024-09-12T01:44:35.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.020+0000 7ffab431a640 1 -- 172.21.15.60:0/3508904660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaac160520 con 0x7ffaac15e660 2024-09-12T01:44:35.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.021+0000 7ffab431a640 1 -- 172.21.15.60:0/3508904660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaac160860 con 0x7ffaac15e660 2024-09-12T01:44:35.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.022+0000 7ffaa2ffd640 1 -- 172.21.15.60:0/3508904660 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffaa401d070 con 0x7ffaac15e660 2024-09-12T01:44:35.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.022+0000 7ffaa2ffd640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa9006be30 0x7ffa9006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.022+0000 7ffaa2ffd640 1 -- 172.21.15.60:0/3508904660 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7ffaa408b090 con 0x7ffaac15e660 2024-09-12T01:44:35.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.022+0000 7ffab20b6640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa9006be30 0x7ffa9006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.023+0000 7ffab20b6640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa9006be30 0x7ffa9006e2f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80016e0 tx=0x7ffaa8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:35.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.027+0000 7ffaa2ffd640 1 -- 172.21.15.60:0/3508904660 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ffaac160860 con 0x7ffaac15e660 2024-09-12T01:44:35.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.202+0000 7ffab431a640 1 -- 172.21.15.60:0/3508904660 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffaac0b7b70 con 0x7ffaac15e660 2024-09-12T01:44:35.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.203+0000 7ffaa2ffd640 1 -- 172.21.15.60:0/3508904660 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) ==== 74+0+16716 (secure 0 0 0) 0x7ffaa4010070 con 0x7ffaac15e660 2024-09-12T01:44:35.203 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:35.204 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":138,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:44:33.921591+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:44:31.572386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-12T01:44:32.903039+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:44:35.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.205+0000 7ffab431a640 1 -- 172.21.15.60:0/3508904660 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa9006be30 msgr2=0x7ffa9006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.205+0000 7ffab431a640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa9006be30 0x7ffa9006e2f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7ffaa80016e0 tx=0x7ffaa8009040 comp rx=0 tx=0).stop 2024-09-12T01:44:35.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.205+0000 7ffab431a640 1 -- 172.21.15.60:0/3508904660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffaac15e660 msgr2=0x7ffaac0caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.205+0000 7ffab431a640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffaac15e660 0x7ffaac0caa20 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4007f20 tx=0x7ffaa400d560 comp rx=0 tx=0).stop 2024-09-12T01:44:35.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.205+0000 7ffab431a640 1 -- 172.21.15.60:0/3508904660 shutdown_connections 2024-09-12T01:44:35.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.205+0000 7ffab431a640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffaac15e660 0x7ffaac0caa20 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.205+0000 7ffab431a640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffaac0d3310 0x7ffaac14dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.205+0000 7ffab431a640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffa9006be30 0x7ffa9006e2f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.205+0000 7ffab431a640 1 --2- 172.21.15.60:0/3508904660 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffaac0d1650 0x7ffaac15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.205+0000 7ffab431a640 1 -- 172.21.15.60:0/3508904660 >> 172.21.15.60:0/3508904660 conn(0x7ffaac0b6410 msgr2=0x7ffaac0b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:35.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.205+0000 7ffab431a640 1 -- 172.21.15.60:0/3508904660 shutdown_connections 2024-09-12T01:44:35.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.205+0000 7ffab431a640 1 -- 172.21.15.60:0/3508904660 wait complete. 2024-09-12T01:44:35.217 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-12T01:44:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.322+0000 7f110d3c4640 1 Processor -- start 2024-09-12T01:44:35.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.322+0000 7f110d3c4640 1 -- start start 2024-09-12T01:44:35.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.323+0000 7f110d3c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f110815c0f0 0x7f11080739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.323+0000 7f110d3c4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f110806c320 0x7f110806f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.323+0000 7f110d3c4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f110815c4d0 con 0x7f1108073f10 2024-09-12T01:44:35.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.323+0000 7f110d3c4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f110815ee60 con 0x7f110806c320 2024-09-12T01:44:35.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.323+0000 7f110d3c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f110815f140 con 0x7f110815c0f0 2024-09-12T01:44:35.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.323+0000 7f11077fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f110806c320 0x7f110806f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.323+0000 7f11077fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f110806c320 0x7f110806f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42700/0 (socket says 172.21.15.60:42700) 2024-09-12T01:44:35.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.323+0000 7f11077fe640 1 -- 172.21.15.60:0/3832132429 learned_addr learned my addr 172.21.15.60:0/3832132429 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:35.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.323+0000 7f1106ffd640 1 --2- 172.21.15.60:0/3832132429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f110815c0f0 0x7f11080739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.324+0000 7f11077fe640 1 -- 172.21.15.60:0/3832132429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f110815c0f0 msgr2=0x7f11080739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:35.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.324+0000 7f11077fe640 1 --2- 172.21.15.60:0/3832132429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f110815c0f0 0x7f11080739d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.324+0000 7f11077fe640 1 -- 172.21.15.60:0/3832132429 >> v1:172.21.15.105:6789/0 conn(0x7f1108073f10 legacy=0x7f110806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.325 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.324+0000 7f11077fe640 1 -- 172.21.15.60:0/3832132429 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f110815f420 con 0x7f110806c320 2024-09-12T01:44:35.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.324+0000 7f11077fe640 1 --2- 172.21.15.60:0/3832132429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110806c320 0x7f110806f630 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009e50 tx=0x7f10f802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64819e8061950056 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:35.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.324+0000 7f1105ffb640 1 -- 172.21.15.60:0/3832132429 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f8036070 con 0x7f110806c320 2024-09-12T01:44:35.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.325+0000 7f1105ffb640 1 -- 172.21.15.60:0/3832132429 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10f8031600 con 0x7f110806c320 2024-09-12T01:44:35.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.325+0000 7f1105ffb640 1 -- 172.21.15.60:0/3832132429 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10f80319d0 con 0x7f110806c320 2024-09-12T01:44:35.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.325+0000 7f110d3c4640 1 -- 172.21.15.60:0/3832132429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110806c320 msgr2=0x7f110806f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.325+0000 7f110d3c4640 1 --2- 172.21.15.60:0/3832132429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110806c320 0x7f110806f630 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009e50 tx=0x7f10f802a680 comp rx=0 tx=0).stop 2024-09-12T01:44:35.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.325+0000 7f110d3c4640 1 -- 172.21.15.60:0/3832132429 shutdown_connections 2024-09-12T01:44:35.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.325+0000 7f110d3c4640 1 --2- 172.21.15.60:0/3832132429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110806c320 0x7f110806f630 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.325+0000 7f110d3c4640 1 --2- 172.21.15.60:0/3832132429 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f110815c0f0 0x7f11080739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.325+0000 7f110d3c4640 1 -- 172.21.15.60:0/3832132429 >> 172.21.15.60:0/3832132429 conn(0x7f11080d1390 msgr2=0x7f11080d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:35.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.325+0000 7f110d3c4640 1 -- 172.21.15.60:0/3832132429 shutdown_connections 2024-09-12T01:44:35.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.325+0000 7f110d3c4640 1 -- 172.21.15.60:0/3832132429 wait complete. 2024-09-12T01:44:35.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.327+0000 7f110d3c4640 1 Processor -- start 2024-09-12T01:44:35.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.327+0000 7f110d3c4640 1 -- start start 2024-09-12T01:44:35.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.327+0000 7f110d3c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110806c320 0x7f11081589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.327+0000 7f110d3c4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1108073f10 0x7f11080b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.327+0000 7f110d3c4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f110815c0f0 0x7f11081613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.327+0000 7f110d3c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1108072070 con 0x7f110806c320 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.327+0000 7f110d3c4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1108071ef0 con 0x7f1108073f10 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.327+0000 7f110d3c4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f11080b0ba0 con 0x7f110815c0f0 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.327+0000 7f1106ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110806c320 0x7f11081589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.327+0000 7f1106ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110806c320 0x7f11081589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42706/0 (socket says 172.21.15.60:42706) 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.327+0000 7f1106ffd640 1 -- 172.21.15.60:0/1377216552 learned_addr learned my addr 172.21.15.60:0/1377216552 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f11077fe640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f110815c0f0 0x7f11081613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f11067fc640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1108073f10 0x7f11080b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f1106ffd640 1 -- 172.21.15.60:0/1377216552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f110815c0f0 msgr2=0x7f11081613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f1106ffd640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f110815c0f0 0x7f11081613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f1106ffd640 1 -- 172.21.15.60:0/1377216552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1108073f10 msgr2=0x7f11080b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f1106ffd640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1108073f10 0x7f11080b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f1106ffd640 1 -- 172.21.15.60:0/1377216552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1108158f00 con 0x7f110806c320 2024-09-12T01:44:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f1106ffd640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110806c320 0x7f11081589c0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f110000e870 tx=0x7f110000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:35.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f10ff7fe640 1 -- 172.21.15.60:0/1377216552 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1100017070 con 0x7f110806c320 2024-09-12T01:44:35.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f10ff7fe640 1 -- 172.21.15.60:0/1377216552 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f110000c940 con 0x7f110806c320 2024-09-12T01:44:35.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f110d3c4640 1 -- 172.21.15.60:0/1377216552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11080b5330 con 0x7f110806c320 2024-09-12T01:44:35.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f10ff7fe640 1 -- 172.21.15.60:0/1377216552 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110000cd30 con 0x7f110806c320 2024-09-12T01:44:35.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.328+0000 7f110d3c4640 1 -- 172.21.15.60:0/1377216552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11080b58f0 con 0x7f110806c320 2024-09-12T01:44:35.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.329+0000 7f110d3c4640 1 -- 172.21.15.60:0/1377216552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1108068d10 con 0x7f110806c320 2024-09-12T01:44:35.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.330+0000 7f10ff7fe640 1 -- 172.21.15.60:0/1377216552 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f110001a070 con 0x7f110806c320 2024-09-12T01:44:35.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.330+0000 7f10ff7fe640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f10e806be60 0x7f10e806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.330+0000 7f10ff7fe640 1 -- 172.21.15.60:0/1377216552 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f110008ac60 con 0x7f110806c320 2024-09-12T01:44:35.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.330+0000 7f11067fc640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f10e806be60 0x7f10e806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.332 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.331+0000 7f11067fc640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f10e806be60 0x7f10e806e320 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1108072e10 tx=0x7f10f0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:35.335 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.334+0000 7f10ff7fe640 1 -- 172.21.15.60:0/1377216552 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1108068d10 con 0x7f110806c320 2024-09-12T01:44:35.547 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.547+0000 7f110d3c4640 1 -- 172.21.15.60:0/1377216552 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f11080739d0 con 0x7f110806c320 2024-09-12T01:44:35.565 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.565+0000 7f10ff7fe640 1 -- 172.21.15.60:0/1377216552 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v87) ==== 118+0+0 (secure 0 0 0) 0x7f1108158f00 con 0x7f110806c320 2024-09-12T01:44:35.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.567+0000 7f110d3c4640 1 -- 172.21.15.60:0/1377216552 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f10e806be60 msgr2=0x7f10e806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.567+0000 7f110d3c4640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f10e806be60 0x7f10e806e320 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1108072e10 tx=0x7f10f0009040 comp rx=0 tx=0).stop 2024-09-12T01:44:35.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.567+0000 7f110d3c4640 1 -- 172.21.15.60:0/1377216552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110806c320 msgr2=0x7f11081589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.567+0000 7f110d3c4640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110806c320 0x7f11081589c0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f110000e870 tx=0x7f110000ed30 comp rx=0 tx=0).stop 2024-09-12T01:44:35.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.567+0000 7f110d3c4640 1 -- 172.21.15.60:0/1377216552 shutdown_connections 2024-09-12T01:44:35.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.567+0000 7f110d3c4640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f10e806be60 0x7f10e806e320 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.568 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.567+0000 7f110d3c4640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f110815c0f0 0x7f11081613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.567+0000 7f110d3c4640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1108073f10 0x7f11080b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.567+0000 7f110d3c4640 1 --2- 172.21.15.60:0/1377216552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f110806c320 0x7f11081589c0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.567+0000 7f110d3c4640 1 -- 172.21.15.60:0/1377216552 >> 172.21.15.60:0/1377216552 conn(0x7f11080d1390 msgr2=0x7f110815caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:35.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.567+0000 7f110d3c4640 1 -- 172.21.15.60:0/1377216552 shutdown_connections 2024-09-12T01:44:35.569 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.567+0000 7f110d3c4640 1 -- 172.21.15.60:0/1377216552 wait complete. 2024-09-12T01:44:35.581 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-12T01:44:35.582 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-12T01:44:35.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.687+0000 7fea91267640 1 Processor -- start 2024-09-12T01:44:35.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.687+0000 7fea91267640 1 -- start start 2024-09-12T01:44:35.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.688+0000 7fea91267640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fea8c0cf1f0 0x7fea8c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.688+0000 7fea91267640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea8c0cf860 con 0x7fea8c15e7a0 2024-09-12T01:44:35.690 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.688+0000 7fea91267640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea8c0cfb40 con 0x7fea8c0b6720 2024-09-12T01:44:35.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.688+0000 7fea91267640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fea8c0b6b90 con 0x7fea8c0cf1f0 2024-09-12T01:44:35.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.688+0000 7fea8affd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fea8c15e7a0 0x7fea8c06caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54310/0 (socket says 172.21.15.60:54310) 2024-09-12T01:44:35.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.688+0000 7fea8affd640 1 -- 172.21.15.60:0/2445127339 learned_addr learned my addr 172.21.15.60:0/2445127339 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:35.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.688+0000 7fea8a7fc640 1 --2- 172.21.15.60:0/2445127339 >> v2:172.21.15.105:3300/0 conn(0x7fea8c0cf1f0 0x7fea8c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.688+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935978857 0 0) 0x7fea8c0cf860 con 0x7fea8c15e7a0 2024-09-12T01:44:35.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.688+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea74003520 con 0x7fea8c15e7a0 2024-09-12T01:44:35.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1450412573 0 0) 0x7fea74003520 con 0x7fea8c15e7a0 2024-09-12T01:44:35.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 >> v2:172.21.15.105:3300/0 conn(0x7fea8c0cf1f0 msgr2=0x7fea8c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:35.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 --2- 172.21.15.60:0/2445127339 >> v2:172.21.15.105:3300/0 conn(0x7fea8c0cf1f0 0x7fea8c0b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.691 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 >> v1:172.21.15.105:6789/0 conn(0x7fea8c0b6720 legacy=0x7fea8c0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8c0cfe20 con 0x7fea8c15e7a0 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fea7c001670 con 0x7fea8c15e7a0 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 >> v1:172.21.15.60:6789/0 conn(0x7fea8c15e7a0 legacy=0x7fea8c06caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 --2- 172.21.15.60:0/2445127339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea740039b0 0x7fea74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 --2- 172.21.15.60:0/2445127339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea74004800 0x7fea74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 --2- 172.21.15.60:0/2445127339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 0x7fea7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c0b6b90 con 0x7fea740051c0 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fea7400c160 con 0x7fea74004800 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fea7400c360 con 0x7fea740039b0 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea8b7fe640 1 --2- 172.21.15.60:0/2445127339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 0x7fea7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea8affd640 1 --2- 172.21.15.60:0/2445127339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea740039b0 0x7fea74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea8a7fc640 1 --2- 172.21.15.60:0/2445127339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea74004800 0x7fea74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.692 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea8b7fe640 1 -- 172.21.15.60:0/2445127339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea740039b0 msgr2=0x7fea74003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:35.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea8b7fe640 1 --2- 172.21.15.60:0/2445127339 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea740039b0 0x7fea74003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea8b7fe640 1 -- 172.21.15.60:0/2445127339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea74004800 msgr2=0x7fea74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:35.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea8b7fe640 1 --2- 172.21.15.60:0/2445127339 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea74004800 0x7fea74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.689+0000 7fea8b7fe640 1 -- 172.21.15.60:0/2445127339 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea74003520 con 0x7fea740051c0 2024-09-12T01:44:35.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.690+0000 7fea8b7fe640 1 -- 172.21.15.60:0/2445127339 reap_dead start 2024-09-12T01:44:35.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.690+0000 7fea8b7fe640 1 --2- 172.21.15.60:0/2445127339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 0x7fea7400b9c0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fea84001e50 tx=0x7fea74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadd247f0d9c462a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:35.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.690+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84001a70 con 0x7fea740051c0 2024-09-12T01:44:35.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.690+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea84003970 con 0x7fea740051c0 2024-09-12T01:44:35.693 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.690+0000 7fea89ffb640 1 -- 172.21.15.60:0/2445127339 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84003d60 con 0x7fea740051c0 2024-09-12T01:44:35.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.691+0000 7fea91267640 1 -- 172.21.15.60:0/2445127339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 msgr2=0x7fea7400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.691+0000 7fea91267640 1 --2- 172.21.15.60:0/2445127339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 0x7fea7400b9c0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7fea84001e50 tx=0x7fea74005830 comp rx=0 tx=0).stop 2024-09-12T01:44:35.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.691+0000 7fea91267640 1 -- 172.21.15.60:0/2445127339 shutdown_connections 2024-09-12T01:44:35.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.691+0000 7fea91267640 1 --2- 172.21.15.60:0/2445127339 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 0x7fea7400b9c0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.691+0000 7fea91267640 1 -- 172.21.15.60:0/2445127339 >> 172.21.15.60:0/2445127339 conn(0x7fea8c0d11e0 msgr2=0x7fea8c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:35.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.691+0000 7fea91267640 1 -- 172.21.15.60:0/2445127339 shutdown_connections 2024-09-12T01:44:35.696 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.691+0000 7fea91267640 1 -- 172.21.15.60:0/2445127339 wait complete. 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.692+0000 7fea91267640 1 Processor -- start 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.692+0000 7fea91267640 1 -- start start 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea91267640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 0x7fea8c0c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea91267640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea8c1f54b0 0x7fea8c1f7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea91267640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea8c1f4fa0 0x7fea8c157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea91267640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c0b7a00 con 0x7fea740051c0 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea91267640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fea8c0d2ca0 con 0x7fea8c1f4fa0 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea91267640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fea8c15eb80 con 0x7fea8c1f54b0 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea8affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 0x7fea8c0c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea8affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 0x7fea8c0c9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42722/0 (socket says 172.21.15.60:42722) 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea8affd640 1 -- 172.21.15.60:0/2704427736 learned_addr learned my addr 172.21.15.60:0/2704427736 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea8a7fc640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea8c1f54b0 0x7fea8c1f7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.697 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea8b7fe640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea8c1f4fa0 0x7fea8c157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea8affd640 1 -- 172.21.15.60:0/2704427736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea8c1f54b0 msgr2=0x7fea8c1f7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea8affd640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea8c1f54b0 0x7fea8c1f7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea8affd640 1 -- 172.21.15.60:0/2704427736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea8c1f4fa0 msgr2=0x7fea8c157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea8affd640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea8c1f4fa0 0x7fea8c157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.693+0000 7fea8affd640 1 -- 172.21.15.60:0/2704427736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea8c15f020 con 0x7fea740051c0 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.694+0000 7fea8affd640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 0x7fea8c0c9be0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fea7c001050 tx=0x7fea7c007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.694+0000 7fea737fe640 1 -- 172.21.15.60:0/2704427736 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c004e10 con 0x7fea740051c0 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.694+0000 7fea737fe640 1 -- 172.21.15.60:0/2704427736 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea7c018070 con 0x7fea740051c0 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.694+0000 7fea737fe640 1 -- 172.21.15.60:0/2704427736 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea7c00fbc0 con 0x7fea740051c0 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.694+0000 7fea91267640 1 -- 172.21.15.60:0/2704427736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea8c15f300 con 0x7fea740051c0 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.694+0000 7fea91267640 1 -- 172.21.15.60:0/2704427736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea8c0ca120 con 0x7fea740051c0 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.695+0000 7fea91267640 1 -- 172.21.15.60:0/2704427736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea8c0b61e0 con 0x7fea740051c0 2024-09-12T01:44:35.698 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.695+0000 7fea737fe640 1 -- 172.21.15.60:0/2704427736 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fea7c01d460 con 0x7fea740051c0 2024-09-12T01:44:35.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.696+0000 7fea737fe640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea7806be30 0x7fea7806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:35.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.696+0000 7fea737fe640 1 -- 172.21.15.60:0/2704427736 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fea7c08af00 con 0x7fea740051c0 2024-09-12T01:44:35.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.696+0000 7fea8a7fc640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea7806be30 0x7fea7806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:35.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.696+0000 7fea8a7fc640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea7806be30 0x7fea7806e2f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fea8c1f58d0 tx=0x7fea80009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:35.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.700+0000 7fea737fe640 1 -- 172.21.15.60:0/2704427736 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fea7c059820 con 0x7fea740051c0 2024-09-12T01:44:35.912 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:35.911+0000 7fea91267640 1 -- 172.21.15.60:0/2704427736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fea8c0d2a80 con 0x7fea740051c0 2024-09-12T01:44:36.544 INFO:tasks.ceph.mds.d.smithi105.stderr:2024-09-12T01:44:36.544+0000 7f97b4c03640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:44:36.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.574+0000 7fea737fe640 1 -- 172.21.15.60:0/2704427736 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v88) ==== 122+0+0 (secure 0 0 0) 0x7fea7c059120 con 0x7fea740051c0 2024-09-12T01:44:36.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.577+0000 7fea91267640 1 -- 172.21.15.60:0/2704427736 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea7806be30 msgr2=0x7fea7806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:36.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.577+0000 7fea91267640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea7806be30 0x7fea7806e2f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fea8c1f58d0 tx=0x7fea80009190 comp rx=0 tx=0).stop 2024-09-12T01:44:36.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.577+0000 7fea91267640 1 -- 172.21.15.60:0/2704427736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 msgr2=0x7fea8c0c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:36.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.577+0000 7fea91267640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 0x7fea8c0c9be0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fea7c001050 tx=0x7fea7c007660 comp rx=0 tx=0).stop 2024-09-12T01:44:36.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.577+0000 7fea91267640 1 -- 172.21.15.60:0/2704427736 shutdown_connections 2024-09-12T01:44:36.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.577+0000 7fea91267640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fea8c1f4fa0 0x7fea8c157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.577+0000 7fea91267640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fea7806be30 0x7fea7806e2f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.577+0000 7fea91267640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fea8c1f54b0 0x7fea8c1f7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.577+0000 7fea91267640 1 --2- 172.21.15.60:0/2704427736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea740051c0 0x7fea8c0c9be0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.577+0000 7fea91267640 1 -- 172.21.15.60:0/2704427736 >> 172.21.15.60:0/2704427736 conn(0x7fea8c0d11e0 msgr2=0x7fea8c0b8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:36.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.578+0000 7fea91267640 1 -- 172.21.15.60:0/2704427736 shutdown_connections 2024-09-12T01:44:36.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.578+0000 7fea91267640 1 -- 172.21.15.60:0/2704427736 wait complete. 2024-09-12T01:44:36.592 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-12T01:44:36.592 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:36.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.700+0000 7f4d2ac47640 1 Processor -- start 2024-09-12T01:44:36.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.700+0000 7f4d2ac47640 1 -- start start 2024-09-12T01:44:36.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.701+0000 7f4d2ac47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d24073130 0x7f4d24073580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:36.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.701+0000 7f4d2ac47640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d240b5220 con 0x7f4d2415e560 2024-09-12T01:44:36.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.701+0000 7f4d2ac47640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d240b54c0 con 0x7f4d2406e780 2024-09-12T01:44:36.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.701+0000 7f4d2ac47640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4d240aefa0 con 0x7f4d24073130 2024-09-12T01:44:36.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.701+0000 7f4d289e3640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4d2415e560 0x7f4d24072220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54324/0 (socket says 172.21.15.60:54324) 2024-09-12T01:44:36.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.701+0000 7f4d289e3640 1 -- 172.21.15.60:0/1959089988 learned_addr learned my addr 172.21.15.60:0/1959089988 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:36.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.701+0000 7f4d291e4640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d24073130 0x7f4d24073580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:36.704 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.701+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2075320925 0 0) 0x7f4d240b5220 con 0x7f4d2415e560 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d0c003520 con 0x7f4d2415e560 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 117493320 0 0) 0x7f4d240b54c0 con 0x7f4d2406e780 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d240b5220 con 0x7f4d2406e780 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2141315654 0 0) 0x7f4d0c003520 con 0x7f4d2415e560 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d24073130 msgr2=0x7f4d24073580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d24073130 0x7f4d24073580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 >> v1:172.21.15.105:6789/0 conn(0x7f4d2406e780 legacy=0x7f4d240ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d240b57a0 con 0x7f4d2415e560 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f4d1c0019f0 con 0x7f4d2415e560 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d291e4640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d24073130 0x7f4d24073580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 >> v1:172.21.15.60:6789/0 conn(0x7f4d2415e560 legacy=0x7f4d24072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d24073130 0x7f4d0c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d0c0040b0 0x7f4d0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d0c004d40 0x7f4d0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4d240aefa0 con 0x7f4d0c004d40 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c00bb00 con 0x7f4d0c0040b0 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0c00bd00 con 0x7f4d24073130 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d291e4640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d0c004d40 0x7f4d0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d289e3640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d24073130 0x7f4d0c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d23fff640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d0c0040b0 0x7f4d0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d291e4640 1 -- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d24073130 msgr2=0x7f4d0c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d291e4640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d24073130 0x7f4d0c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d291e4640 1 -- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d0c0040b0 msgr2=0x7f4d0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d291e4640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d0c0040b0 0x7f4d0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d291e4640 1 -- 172.21.15.60:0/1959089988 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c003520 con 0x7f4d0c004d40 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.702+0000 7f4d23fff640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d0c0040b0 0x7f4d0c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.703+0000 7f4d291e4640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d0c004d40 0x7f4d0c0051c0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009c70 tx=0x7f4d0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824e8e4f5d89e10a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.703+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14036070 con 0x7f4d0c004d40 2024-09-12T01:44:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.703+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d14031400 con 0x7f4d0c004d40 2024-09-12T01:44:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.703+0000 7f4d237fe640 1 -- 172.21.15.60:0/1959089988 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14009840 con 0x7f4d0c004d40 2024-09-12T01:44:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.704+0000 7f4d2ac47640 1 -- 172.21.15.60:0/1959089988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d0c004d40 msgr2=0x7f4d0c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.704+0000 7f4d2ac47640 1 --2- 172.21.15.60:0/1959089988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d0c004d40 0x7f4d0c0051c0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009c70 tx=0x7f4d0c005830 comp rx=0 tx=0).stop 2024-09-12T01:44:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.704+0000 7f4d291e4640 1 -- 172.21.15.60:0/1959089988 reap_dead start 2024-09-12T01:44:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.704+0000 7f4d2ac47640 1 -- 172.21.15.60:0/1959089988 shutdown_connections 2024-09-12T01:44:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.704+0000 7f4d2ac47640 1 -- 172.21.15.60:0/1959089988 >> 172.21.15.60:0/1959089988 conn(0x7f4d2406bc10 msgr2=0x7f4d2406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.704+0000 7f4d2ac47640 1 -- 172.21.15.60:0/1959089988 shutdown_connections 2024-09-12T01:44:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.704+0000 7f4d2ac47640 1 -- 172.21.15.60:0/1959089988 wait complete. 2024-09-12T01:44:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.705+0000 7f4d2ac47640 1 Processor -- start 2024-09-12T01:44:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.705+0000 7f4d2ac47640 1 -- start start 2024-09-12T01:44:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d2ac47640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d0c004d40 0x7f4d24153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d2ac47640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24162360 0x7f4d2415f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d2ac47640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d241ea280 0x7f4d2415fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d2ac47640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4d240b5d60 con 0x7f4d0c004d40 2024-09-12T01:44:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d2ac47640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2406ebc0 con 0x7f4d24162360 2024-09-12T01:44:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d2ac47640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4d2415e940 con 0x7f4d241ea280 2024-09-12T01:44:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d289e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d0c004d40 0x7f4d24153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d289e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d0c004d40 0x7f4d24153860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42740/0 (socket says 172.21.15.60:42740) 2024-09-12T01:44:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d289e3640 1 -- 172.21.15.60:0/2224257398 learned_addr learned my addr 172.21.15.60:0/2224257398 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d23fff640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24162360 0x7f4d2415f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d291e4640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d241ea280 0x7f4d2415fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d289e3640 1 -- 172.21.15.60:0/2224257398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d241ea280 msgr2=0x7f4d2415fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d289e3640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d241ea280 0x7f4d2415fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d289e3640 1 -- 172.21.15.60:0/2224257398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24162360 msgr2=0x7f4d2415f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d289e3640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24162360 0x7f4d2415f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.706+0000 7f4d289e3640 1 -- 172.21.15.60:0/2224257398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d241e80a0 con 0x7f4d0c004d40 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.707+0000 7f4d289e3640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d0c004d40 0x7f4d24153860 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0079f0 tx=0x7f4d1c00a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.707+0000 7f4d217fa640 1 -- 172.21.15.60:0/2224257398 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c017020 con 0x7f4d0c004d40 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.707+0000 7f4d217fa640 1 -- 172.21.15.60:0/2224257398 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0133f0 con 0x7f4d0c004d40 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.707+0000 7f4d2ac47640 1 -- 172.21.15.60:0/2224257398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d241627f0 con 0x7f4d0c004d40 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.707+0000 7f4d217fa640 1 -- 172.21.15.60:0/2224257398 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0019f0 con 0x7f4d0c004d40 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.707+0000 7f4d2ac47640 1 -- 172.21.15.60:0/2224257398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d24162ad0 con 0x7f4d0c004d40 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.708+0000 7f4d2ac47640 1 -- 172.21.15.60:0/2224257398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d24073580 con 0x7f4d0c004d40 2024-09-12T01:44:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.708+0000 7f4d217fa640 1 -- 172.21.15.60:0/2224257398 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d1c01a020 con 0x7f4d0c004d40 2024-09-12T01:44:36.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.709+0000 7f4d217fa640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4d1006be60 0x7f4d1006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:36.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.709+0000 7f4d217fa640 1 -- 172.21.15.60:0/2224257398 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f4d1c08b720 con 0x7f4d0c004d40 2024-09-12T01:44:36.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.709+0000 7f4d23fff640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4d1006be60 0x7f4d1006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:36.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.709+0000 7f4d23fff640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4d1006be60 0x7f4d1006e320 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4d18007fd0 tx=0x7f4d18009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:36.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.713+0000 7f4d217fa640 1 -- 172.21.15.60:0/2224257398 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d1c021020 con 0x7f4d0c004d40 2024-09-12T01:44:36.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.924+0000 7f4d2ac47640 1 -- 172.21.15.60:0/2224257398 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d24072200 con 0x7f4d0c004d40 2024-09-12T01:44:36.925 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.925+0000 7f4d217fa640 1 -- 172.21.15.60:0/2224257398 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5229 (secure 0 0 0) 0x7f4d1c059a80 con 0x7f4d0c004d40 2024-09-12T01:44:36.925 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:36.926 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"btime":"2024-09-12T01:44:36:571579+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/877895322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":877895322},{"type":"v1","addr":"172.21.15.60:6837","nonce":877895322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7621,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3882170083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3882170083},{"type":"v1","addr":"172.21.15.105:6835","nonce":3882170083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/906162612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":906162612},{"type":"v1","addr":"172.21.15.60:6836","nonce":906162612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:44:33.921909+0000","modified":"2024-09-12T01:44:35.913515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":36740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36740":{"gid":36740,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/705814866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":705814866},{"type":"v1","addr":"172.21.15.105:6834","nonce":705814866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":36740,"qdb_cluster":[36740]},"id":11}]} 2024-09-12T01:44:36.926 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 88 2024-09-12T01:44:36.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.927+0000 7f4d2ac47640 1 -- 172.21.15.60:0/2224257398 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4d1006be60 msgr2=0x7f4d1006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:36.927 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.927+0000 7f4d2ac47640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4d1006be60 0x7f4d1006e320 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4d18007fd0 tx=0x7f4d18009040 comp rx=0 tx=0).stop 2024-09-12T01:44:36.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.927+0000 7f4d2ac47640 1 -- 172.21.15.60:0/2224257398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d0c004d40 msgr2=0x7f4d24153860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:36.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.927+0000 7f4d2ac47640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d0c004d40 0x7f4d24153860 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0079f0 tx=0x7f4d1c00a6a0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.927+0000 7f4d2ac47640 1 -- 172.21.15.60:0/2224257398 shutdown_connections 2024-09-12T01:44:36.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.927+0000 7f4d2ac47640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4d1006be60 0x7f4d1006e320 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.927+0000 7f4d2ac47640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d241ea280 0x7f4d2415fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.927+0000 7f4d2ac47640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d24162360 0x7f4d2415f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.927+0000 7f4d2ac47640 1 --2- 172.21.15.60:0/2224257398 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d0c004d40 0x7f4d24153860 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:36.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.927+0000 7f4d2ac47640 1 -- 172.21.15.60:0/2224257398 >> 172.21.15.60:0/2224257398 conn(0x7f4d2406bc10 msgr2=0x7f4d2415d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:36.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.927+0000 7f4d2ac47640 1 -- 172.21.15.60:0/2224257398 shutdown_connections 2024-09-12T01:44:36.928 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:36.927+0000 7f4d2ac47640 1 -- 172.21.15.60:0/2224257398 wait complete. 2024-09-12T01:44:36.939 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:44:37.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.040+0000 7f4eef93a640 1 Processor -- start 2024-09-12T01:44:37.041 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.041+0000 7f4eef93a640 1 -- start start 2024-09-12T01:44:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.041+0000 7f4eef93a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4ee80d3310 0x7f4ee80d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.041+0000 7f4eef93a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee80d1650 0x7f4ee80b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.041+0000 7f4eef93a640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ee815ea40 con 0x7f4ee815e660 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.041+0000 7f4eef93a640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee80d1a90 con 0x7f4ee80d3310 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.041+0000 7f4eef93a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee80d3870 con 0x7f4ee80d1650 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.041+0000 7f4eed6d6640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4ee815e660 0x7f4ee80cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54328/0 (socket says 172.21.15.60:54328) 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.041+0000 7f4eed6d6640 1 -- 172.21.15.60:0/3462798686 learned_addr learned my addr 172.21.15.60:0/3462798686 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.042+0000 7f4eeced5640 1 --2- 172.21.15.60:0/3462798686 >> v2:172.21.15.60:3300/0 conn(0x7f4ee80d3310 0x7f4ee80d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.042+0000 7f4eeded7640 1 --2- 172.21.15.60:0/3462798686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee80d1650 0x7f4ee80b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.042+0000 7f4ee7fff640 1 -- 172.21.15.60:0/3462798686 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 243617108 0 0) 0x7f4ee815ea40 con 0x7f4ee815e660 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.042+0000 7f4ee7fff640 1 -- 172.21.15.60:0/3462798686 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ed0003520 con 0x7f4ee815e660 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.042+0000 7f4eeced5640 1 -- 172.21.15.60:0/3462798686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee80d1650 msgr2=0x7f4ee80b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.042+0000 7f4eeced5640 1 --2- 172.21.15.60:0/3462798686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee80d1650 0x7f4ee80b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.042+0000 7f4eeced5640 1 -- 172.21.15.60:0/3462798686 >> v1:172.21.15.60:6789/0 conn(0x7f4ee815e660 legacy=0x7f4ee80cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.042+0000 7f4eeced5640 1 -- 172.21.15.60:0/3462798686 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee80d3b50 con 0x7f4ee80d3310 2024-09-12T01:44:37.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.043+0000 7f4eeced5640 1 --2- 172.21.15.60:0/3462798686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ee80d3310 0x7f4ee80d1110 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0097a0 tx=0x7f4edc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce58cea9976fdda5 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.043+0000 7f4ee7fff640 1 -- 172.21.15.60:0/3462798686 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc037070 con 0x7f4ee80d3310 2024-09-12T01:44:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.043+0000 7f4ee7fff640 1 -- 172.21.15.60:0/3462798686 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc032440 con 0x7f4ee80d3310 2024-09-12T01:44:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.043+0000 7f4ee7fff640 1 -- 172.21.15.60:0/3462798686 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc0327f0 con 0x7f4ee80d3310 2024-09-12T01:44:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.043+0000 7f4eef93a640 1 -- 172.21.15.60:0/3462798686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ee80d3310 msgr2=0x7f4ee80d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.043+0000 7f4eef93a640 1 --2- 172.21.15.60:0/3462798686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ee80d3310 0x7f4ee80d1110 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0097a0 tx=0x7f4edc02a180 comp rx=0 tx=0).stop 2024-09-12T01:44:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.043+0000 7f4eef93a640 1 -- 172.21.15.60:0/3462798686 shutdown_connections 2024-09-12T01:44:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.043+0000 7f4eef93a640 1 --2- 172.21.15.60:0/3462798686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee80d1650 0x7f4ee80b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.043+0000 7f4eef93a640 1 --2- 172.21.15.60:0/3462798686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ee80d3310 0x7f4ee80d1110 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.043+0000 7f4eef93a640 1 -- 172.21.15.60:0/3462798686 >> 172.21.15.60:0/3462798686 conn(0x7f4ee80b6410 msgr2=0x7f4ee80b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.044+0000 7f4eef93a640 1 -- 172.21.15.60:0/3462798686 shutdown_connections 2024-09-12T01:44:37.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.044+0000 7f4eef93a640 1 -- 172.21.15.60:0/3462798686 wait complete. 2024-09-12T01:44:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.045+0000 7f4eef93a640 1 Processor -- start 2024-09-12T01:44:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.045+0000 7f4eef93a640 1 -- start start 2024-09-12T01:44:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.045+0000 7f4eef93a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee80d1650 0x7f4ee8152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.045+0000 7f4eef93a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ee80d3310 0x7f4ee80b9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.045+0000 7f4eef93a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee815e660 0x7f4ee80ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.045+0000 7f4eef93a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee80d43f0 con 0x7f4ee80d3310 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.045+0000 7f4eef93a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee80d4110 con 0x7f4ee815e660 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.045+0000 7f4eef93a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee80b80b0 con 0x7f4ee80d1650 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eeced5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ee80d3310 0x7f4ee80b9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eeced5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ee80d3310 0x7f4ee80b9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42746/0 (socket says 172.21.15.60:42746) 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eeced5640 1 -- 172.21.15.60:0/54532541 learned_addr learned my addr 172.21.15.60:0/54532541 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eed6d6640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee80d1650 0x7f4ee8152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eeded7640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee815e660 0x7f4ee80ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eeced5640 1 -- 172.21.15.60:0/54532541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee80d1650 msgr2=0x7f4ee8152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eeced5640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee80d1650 0x7f4ee8152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eeced5640 1 -- 172.21.15.60:0/54532541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee815e660 msgr2=0x7f4ee80ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eeced5640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee815e660 0x7f4ee80ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eeced5640 1 -- 172.21.15.60:0/54532541 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee80b9ac0 con 0x7f4ee80d3310 2024-09-12T01:44:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eeded7640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee815e660 0x7f4ee80ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eeced5640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ee80d3310 0x7f4ee80b9430 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f4edc02a1c0 tx=0x7f4edc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4ee5ffb640 1 -- 172.21.15.60:0/54532541 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc037040 con 0x7f4ee80d3310 2024-09-12T01:44:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4ee5ffb640 1 -- 172.21.15.60:0/54532541 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc042070 con 0x7f4ee80d3310 2024-09-12T01:44:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eef93a640 1 -- 172.21.15.60:0/54532541 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee80b9da0 con 0x7f4ee80d3310 2024-09-12T01:44:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4ee5ffb640 1 -- 172.21.15.60:0/54532541 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc03b930 con 0x7f4ee80d3310 2024-09-12T01:44:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.046+0000 7f4eef93a640 1 -- 172.21.15.60:0/54532541 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee8146800 con 0x7f4ee80d3310 2024-09-12T01:44:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.047+0000 7f4eef93a640 1 -- 172.21.15.60:0/54532541 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee80b7b70 con 0x7f4ee80d3310 2024-09-12T01:44:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.048+0000 7f4ee5ffb640 1 -- 172.21.15.60:0/54532541 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4edc03bad0 con 0x7f4ee80d3310 2024-09-12T01:44:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.048+0000 7f4ee5ffb640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ed406be30 0x7f4ed406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.048+0000 7f4ee5ffb640 1 -- 172.21.15.60:0/54532541 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f4edc0ab670 con 0x7f4ee80d3310 2024-09-12T01:44:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.048+0000 7f4eed6d6640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ed406be30 0x7f4ed406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.049+0000 7f4eed6d6640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ed406be30 0x7f4ed406e2f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0005880 tx=0x7f4ee0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.053+0000 7f4ee5ffb640 1 -- 172.21.15.60:0/54532541 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4edc07a020 con 0x7f4ee80d3310 2024-09-12T01:44:37.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.229+0000 7f4eef93a640 1 -- 172.21.15.60:0/54532541 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ee81462d0 con 0x7f4ee80d3310 2024-09-12T01:44:37.231 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.230+0000 7f4ee5ffb640 1 -- 172.21.15.60:0/54532541 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) ==== 74+0+16703 (secure 0 0 0) 0x7f4edc079920 con 0x7f4ee80d3310 2024-09-12T01:44:37.231 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:37.231 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":139,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:44:35.566002+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:44:31.572386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-12T01:44:32.903039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:44:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.232+0000 7f4eef93a640 1 -- 172.21.15.60:0/54532541 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ed406be30 msgr2=0x7f4ed406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.233 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.232+0000 7f4eef93a640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ed406be30 0x7f4ed406e2f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0005880 tx=0x7f4ee0009040 comp rx=0 tx=0).stop 2024-09-12T01:44:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.233+0000 7f4eef93a640 1 -- 172.21.15.60:0/54532541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ee80d3310 msgr2=0x7f4ee80b9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.233+0000 7f4eef93a640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ee80d3310 0x7f4ee80b9430 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f4edc02a1c0 tx=0x7f4edc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.233+0000 7f4eef93a640 1 -- 172.21.15.60:0/54532541 shutdown_connections 2024-09-12T01:44:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.233+0000 7f4eef93a640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4ee815e660 0x7f4ee80ca690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.233+0000 7f4eef93a640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ee80d3310 0x7f4ee80b9430 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.233+0000 7f4eef93a640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4ed406be30 0x7f4ed406e2f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.233+0000 7f4eef93a640 1 --2- 172.21.15.60:0/54532541 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4ee80d1650 0x7f4ee8152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.233+0000 7f4eef93a640 1 -- 172.21.15.60:0/54532541 >> 172.21.15.60:0/54532541 conn(0x7f4ee80b6410 msgr2=0x7f4ee815cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.233+0000 7f4eef93a640 1 -- 172.21.15.60:0/54532541 shutdown_connections 2024-09-12T01:44:37.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.233+0000 7f4eef93a640 1 -- 172.21.15.60:0/54532541 wait complete. 2024-09-12T01:44:37.245 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:44:37.245 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:44:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.346+0000 7f29b7f98640 1 Processor -- start 2024-09-12T01:44:37.347 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.347+0000 7f29b7f98640 1 -- start start 2024-09-12T01:44:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b7f98640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29b00d1c80 0x7f29b00b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b7f98640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b00cfc20 con 0x7f29b00cf6b0 2024-09-12T01:44:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b7f98640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b00d2ed0 con 0x7f29b00b63d0 2024-09-12T01:44:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b7f98640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f29b00d40c0 con 0x7f29b00d1c80 2024-09-12T01:44:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b5533640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f29b00cf6b0 0x7f29b01629f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54338/0 (socket says 172.21.15.60:54338) 2024-09-12T01:44:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b5533640 1 -- 172.21.15.60:0/3412145844 learned_addr learned my addr 172.21.15.60:0/3412145844 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:37.349 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b6535640 1 --2- 172.21.15.60:0/3412145844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29b00d1c80 0x7f29b00b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b4d32640 1 -- 172.21.15.60:0/3412145844 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 342225991 0 0) 0x7f29b00cfc20 con 0x7f29b00cf6b0 2024-09-12T01:44:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b4d32640 1 -- 172.21.15.60:0/3412145844 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f299c003520 con 0x7f29b00cf6b0 2024-09-12T01:44:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b4d32640 1 -- 172.21.15.60:0/3412145844 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3075906248 0 0) 0x7f29b00d2ed0 con 0x7f29b00b63d0 2024-09-12T01:44:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b4d32640 1 -- 172.21.15.60:0/3412145844 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29b00cfc20 con 0x7f29b00b63d0 2024-09-12T01:44:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b6535640 1 -- 172.21.15.60:0/3412145844 >> v1:172.21.15.105:6789/0 conn(0x7f29b00b63d0 legacy=0x7f29b00d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b6535640 1 -- 172.21.15.60:0/3412145844 >> v1:172.21.15.60:6789/0 conn(0x7f29b00cf6b0 legacy=0x7f29b01629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b4d32640 1 -- 172.21.15.60:0/3412145844 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3346478207 0 0) 0x7f299c003520 con 0x7f29b00cf6b0 2024-09-12T01:44:37.350 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.348+0000 7f29b6535640 1 -- 172.21.15.60:0/3412145844 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b00d31b0 con 0x7f29b00d1c80 2024-09-12T01:44:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.349+0000 7f29b6535640 1 --2- 172.21.15.60:0/3412145844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29b00d1c80 0x7f29b00b7880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009dc0 tx=0x7f29a802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6074221ecf09237f server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.349+0000 7f29b4d32640 1 -- 172.21.15.60:0/3412145844 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a0001670 con 0x7f29b00d1c80 2024-09-12T01:44:37.351 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.349+0000 7f29b4d32640 1 -- 172.21.15.60:0/3412145844 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a8007540 con 0x7f29b00d1c80 2024-09-12T01:44:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.349+0000 7f29b4d32640 1 -- 172.21.15.60:0/3412145844 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a80078f0 con 0x7f29b00d1c80 2024-09-12T01:44:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.350+0000 7f29b7f98640 1 -- 172.21.15.60:0/3412145844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29b00d1c80 msgr2=0x7f29b00b7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.350+0000 7f29b7f98640 1 --2- 172.21.15.60:0/3412145844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29b00d1c80 0x7f29b00b7880 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f29a8009dc0 tx=0x7f29a802a5d0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.350+0000 7f29b7f98640 1 -- 172.21.15.60:0/3412145844 shutdown_connections 2024-09-12T01:44:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.350+0000 7f29b7f98640 1 --2- 172.21.15.60:0/3412145844 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29b00d1c80 0x7f29b00b7880 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.350+0000 7f29b7f98640 1 -- 172.21.15.60:0/3412145844 >> 172.21.15.60:0/3412145844 conn(0x7f29b00d1160 msgr2=0x7f29b00d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.350+0000 7f29b7f98640 1 -- 172.21.15.60:0/3412145844 shutdown_connections 2024-09-12T01:44:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.350+0000 7f29b7f98640 1 -- 172.21.15.60:0/3412145844 wait complete. 2024-09-12T01:44:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.351+0000 7f29b7f98640 1 Processor -- start 2024-09-12T01:44:37.352 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.351+0000 7f29b7f98640 1 -- start start 2024-09-12T01:44:37.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b7f98640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29b00b63d0 0x7f29b0158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b7f98640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b00cf6b0 0x7f29b00c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b7f98640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b00d1c80 0x7f29b00b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.354 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b7f98640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f29b00cb440 con 0x7f29b00d1c80 2024-09-12T01:44:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b7f98640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0163100 con 0x7f29b00cf6b0 2024-09-12T01:44:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b7f98640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f29b00cb5c0 con 0x7f29b00b63d0 2024-09-12T01:44:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b6535640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b00d1c80 0x7f29b00b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b6535640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b00d1c80 0x7f29b00b77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42762/0 (socket says 172.21.15.60:42762) 2024-09-12T01:44:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b6535640 1 -- 172.21.15.60:0/1738693603 learned_addr learned my addr 172.21.15.60:0/1738693603 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b5d34640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29b00b63d0 0x7f29b0158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b5533640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b00cf6b0 0x7f29b00c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b6535640 1 -- 172.21.15.60:0/1738693603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29b00b63d0 msgr2=0x7f29b0158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b6535640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29b00b63d0 0x7f29b0158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b6535640 1 -- 172.21.15.60:0/1738693603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b00cf6b0 msgr2=0x7f29b00c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b6535640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b00cf6b0 0x7f29b00c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b6535640 1 -- 172.21.15.60:0/1738693603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b00ca5f0 con 0x7f29b00d1c80 2024-09-12T01:44:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.352+0000 7f29b5533640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b00cf6b0 0x7f29b00c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.353+0000 7f29b6535640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b00d1c80 0x7f29b00b77f0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f29a802abc0 tx=0x7f29a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.353+0000 7f29a67fc640 1 -- 172.21.15.60:0/1738693603 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8009450 con 0x7f29b00d1c80 2024-09-12T01:44:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.353+0000 7f29a67fc640 1 -- 172.21.15.60:0/1738693603 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29a8004450 con 0x7f29b00d1c80 2024-09-12T01:44:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.353+0000 7f29a67fc640 1 -- 172.21.15.60:0/1738693603 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8004800 con 0x7f29b00d1c80 2024-09-12T01:44:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.353+0000 7f29b7f98640 1 -- 172.21.15.60:0/1738693603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b015a740 con 0x7f29b00d1c80 2024-09-12T01:44:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.353+0000 7f29b7f98640 1 -- 172.21.15.60:0/1738693603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b015ad00 con 0x7f29b00d1c80 2024-09-12T01:44:37.356 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.354+0000 7f29b7f98640 1 -- 172.21.15.60:0/1738693603 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29b00b67b0 con 0x7f29b00d1c80 2024-09-12T01:44:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.354+0000 7f29a67fc640 1 -- 172.21.15.60:0/1738693603 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f29a803b410 con 0x7f29b00d1c80 2024-09-12T01:44:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.355+0000 7f29a67fc640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f299406be30 0x7f299406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.355+0000 7f29a67fc640 1 -- 172.21.15.60:0/1738693603 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f29a80ac250 con 0x7f29b00d1c80 2024-09-12T01:44:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.355+0000 7f29b5d34640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f299406be30 0x7f299406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.357 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.355+0000 7f29b5d34640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f299406be30 0x7f299406e2f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0011e0 tx=0x7f29ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:37.359 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.359+0000 7f29a67fc640 1 -- 172.21.15.60:0/1738693603 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f29a803f030 con 0x7f29b00d1c80 2024-09-12T01:44:37.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.531+0000 7f29b7f98640 1 -- 172.21.15.60:0/1738693603 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29b00cf280 con 0x7f299406be30 2024-09-12T01:44:37.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.537+0000 7f29a67fc640 1 -- 172.21.15.60:0/1738693603 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251623 (secure 0 0 0) 0x7f29b00cf280 con 0x7f299406be30 2024-09-12T01:44:37.541 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:37.542 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:44:37.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.540+0000 7f29b7f98640 1 -- 172.21.15.60:0/1738693603 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f299406be30 msgr2=0x7f299406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.540+0000 7f29b7f98640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f299406be30 0x7f299406e2f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f29ac0011e0 tx=0x7f29ac009040 comp rx=0 tx=0).stop 2024-09-12T01:44:37.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.540+0000 7f29b7f98640 1 -- 172.21.15.60:0/1738693603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b00d1c80 msgr2=0x7f29b00b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.540+0000 7f29b7f98640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b00d1c80 0x7f29b00b77f0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f29a802abc0 tx=0x7f29a8004a40 comp rx=0 tx=0).stop 2024-09-12T01:44:37.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.540+0000 7f29b7f98640 1 -- 172.21.15.60:0/1738693603 shutdown_connections 2024-09-12T01:44:37.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.540+0000 7f29b7f98640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b00d1c80 0x7f29b00b77f0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.540+0000 7f29b7f98640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f29b00cf6b0 0x7f29b00c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.540+0000 7f29b7f98640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f299406be30 0x7f299406e2f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.540+0000 7f29b7f98640 1 --2- 172.21.15.60:0/1738693603 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f29b00b63d0 0x7f29b0158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.540+0000 7f29b7f98640 1 -- 172.21.15.60:0/1738693603 >> 172.21.15.60:0/1738693603 conn(0x7f29b00d1160 msgr2=0x7f29b00b9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:37.544 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.541+0000 7f29b7f98640 1 -- 172.21.15.60:0/1738693603 shutdown_connections 2024-09-12T01:44:37.545 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.541+0000 7f29b7f98640 1 -- 172.21.15.60:0/1738693603 wait complete. 2024-09-12T01:44:37.552 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":399,"stamp":"2024-09-12T01:44:36.376736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592744,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":293372,"kb_used_data":14712,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754681348,"statfs":{"total":773094113280,"available":772793700352,"internally_reserved":0,"allocated":15065088,"data_stored":7103284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000884"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577206+0000","last_change":"2024-09-12T01:44:34.578808+0000","last_active":"2024-09-12T01:44:35.577206+0000","last_peered":"2024-09-12T01:44:35.577206+0000","last_clean":"2024-09-12T01:44:35.577206+0000","last_became_active":"2024-09-12T01:44:34.578528+0000","last_became_peered":"2024-09-12T01:44:34.578528+0000","last_unstale":"2024-09-12T01:44:35.577206+0000","last_undegraded":"2024-09-12T01:44:35.577206+0000","last_fullsized":"2024-09-12T01:44:35.577206+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:04.653539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577100+0000","last_change":"2024-09-12T01:44:34.579190+0000","last_active":"2024-09-12T01:44:35.577100+0000","last_peered":"2024-09-12T01:44:35.577100+0000","last_clean":"2024-09-12T01:44:35.577100+0000","last_became_active":"2024-09-12T01:44:34.578880+0000","last_became_peered":"2024-09-12T01:44:34.578880+0000","last_unstale":"2024-09-12T01:44:35.577100+0000","last_undegraded":"2024-09-12T01:44:35.577100+0000","last_fullsized":"2024-09-12T01:44:35.577100+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:48.771413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577035+0000","last_change":"2024-09-12T01:44:34.568255+0000","last_active":"2024-09-12T01:44:35.577035+0000","last_peered":"2024-09-12T01:44:35.577035+0000","last_clean":"2024-09-12T01:44:35.577035+0000","last_became_active":"2024-09-12T01:44:34.567951+0000","last_became_peered":"2024-09-12T01:44:34.567951+0000","last_unstale":"2024-09-12T01:44:35.577035+0000","last_undegraded":"2024-09-12T01:44:35.577035+0000","last_fullsized":"2024-09-12T01:44:35.577035+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:06.315519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560664+0000","last_change":"2024-09-12T01:44:33.560664+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560664+0000","last_undegraded":"2024-09-12T01:44:33.560664+0000","last_fullsized":"2024-09-12T01:44:33.560664+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573865+0000","last_change":"2024-09-12T01:44:34.581929+0000","last_active":"2024-09-12T01:44:35.573865+0000","last_peered":"2024-09-12T01:44:35.573865+0000","last_clean":"2024-09-12T01:44:35.573865+0000","last_became_active":"2024-09-12T01:44:34.581430+0000","last_became_peered":"2024-09-12T01:44:34.581430+0000","last_unstale":"2024-09-12T01:44:35.573865+0000","last_undegraded":"2024-09-12T01:44:35.573865+0000","last_fullsized":"2024-09-12T01:44:35.573865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:58.704148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593245+0000","last_change":"2024-09-12T01:44:34.587092+0000","last_active":"2024-09-12T01:44:34.593245+0000","last_peered":"2024-09-12T01:44:34.593245+0000","last_clean":"2024-09-12T01:44:34.593245+0000","last_became_active":"2024-09-12T01:44:34.586801+0000","last_became_peered":"2024-09-12T01:44:34.586801+0000","last_unstale":"2024-09-12T01:44:34.593245+0000","last_undegraded":"2024-09-12T01:44:34.593245+0000","last_fullsized":"2024-09-12T01:44:34.593245+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:07.258321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583107+0000","last_change":"2024-09-12T01:44:34.579218+0000","last_active":"2024-09-12T01:44:34.583107+0000","last_peered":"2024-09-12T01:44:34.583107+0000","last_clean":"2024-09-12T01:44:34.583107+0000","last_became_active":"2024-09-12T01:44:34.578880+0000","last_became_peered":"2024-09-12T01:44:34.578880+0000","last_unstale":"2024-09-12T01:44:34.583107+0000","last_undegraded":"2024-09-12T01:44:34.583107+0000","last_fullsized":"2024-09-12T01:44:34.583107+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.281914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593466+0000","last_change":"2024-09-12T01:44:34.589398+0000","last_active":"2024-09-12T01:44:34.593466+0000","last_peered":"2024-09-12T01:44:34.593466+0000","last_clean":"2024-09-12T01:44:34.593466+0000","last_became_active":"2024-09-12T01:44:34.589132+0000","last_became_peered":"2024-09-12T01:44:34.589132+0000","last_unstale":"2024-09-12T01:44:34.593466+0000","last_undegraded":"2024-09-12T01:44:34.593466+0000","last_fullsized":"2024-09-12T01:44:34.593466+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.806227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583277+0000","last_change":"2024-09-12T01:44:34.582405+0000","last_active":"2024-09-12T01:44:34.583277+0000","last_peered":"2024-09-12T01:44:34.583277+0000","last_clean":"2024-09-12T01:44:34.583277+0000","last_became_active":"2024-09-12T01:44:34.582107+0000","last_became_peered":"2024-09-12T01:44:34.582107+0000","last_unstale":"2024-09-12T01:44:34.583277+0000","last_undegraded":"2024-09-12T01:44:34.583277+0000","last_fullsized":"2024-09-12T01:44:34.583277+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:51.464037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592952+0000","last_change":"2024-09-12T01:44:34.587622+0000","last_active":"2024-09-12T01:44:34.592952+0000","last_peered":"2024-09-12T01:44:34.592952+0000","last_clean":"2024-09-12T01:44:34.592952+0000","last_became_active":"2024-09-12T01:44:34.587309+0000","last_became_peered":"2024-09-12T01:44:34.587309+0000","last_unstale":"2024-09-12T01:44:34.592952+0000","last_undegraded":"2024-09-12T01:44:34.592952+0000","last_fullsized":"2024-09-12T01:44:34.592952+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:22.658357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573760+0000","last_change":"2024-09-12T01:44:34.581035+0000","last_active":"2024-09-12T01:44:35.573760+0000","last_peered":"2024-09-12T01:44:35.573760+0000","last_clean":"2024-09-12T01:44:35.573760+0000","last_became_active":"2024-09-12T01:44:34.580768+0000","last_became_peered":"2024-09-12T01:44:34.580768+0000","last_unstale":"2024-09-12T01:44:35.573760+0000","last_undegraded":"2024-09-12T01:44:35.573760+0000","last_fullsized":"2024-09-12T01:44:35.573760+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:14.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573365+0000","last_change":"2024-09-12T01:44:34.582605+0000","last_active":"2024-09-12T01:44:35.573365+0000","last_peered":"2024-09-12T01:44:35.573365+0000","last_clean":"2024-09-12T01:44:35.573365+0000","last_became_active":"2024-09-12T01:44:34.582322+0000","last_became_peered":"2024-09-12T01:44:34.582322+0000","last_unstale":"2024-09-12T01:44:35.573365+0000","last_undegraded":"2024-09-12T01:44:35.573365+0000","last_fullsized":"2024-09-12T01:44:35.573365+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:01.900564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573363+0000","last_change":"2024-09-12T01:44:34.587381+0000","last_active":"2024-09-12T01:44:35.573363+0000","last_peered":"2024-09-12T01:44:35.573363+0000","last_clean":"2024-09-12T01:44:35.573363+0000","last_became_active":"2024-09-12T01:44:34.586812+0000","last_became_peered":"2024-09-12T01:44:34.586812+0000","last_unstale":"2024-09-12T01:44:35.573363+0000","last_undegraded":"2024-09-12T01:44:35.573363+0000","last_fullsized":"2024-09-12T01:44:35.573363+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:11.765535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592991+0000","last_change":"2024-09-12T01:44:34.587979+0000","last_active":"2024-09-12T01:44:34.592991+0000","last_peered":"2024-09-12T01:44:34.592991+0000","last_clean":"2024-09-12T01:44:34.592991+0000","last_became_active":"2024-09-12T01:44:34.587628+0000","last_became_peered":"2024-09-12T01:44:34.587628+0000","last_unstale":"2024-09-12T01:44:34.592991+0000","last_undegraded":"2024-09-12T01:44:34.592991+0000","last_fullsized":"2024-09-12T01:44:34.592991+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:42.799915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593669+0000","last_change":"2024-09-12T01:44:34.591685+0000","last_active":"2024-09-12T01:44:34.593669+0000","last_peered":"2024-09-12T01:44:34.593669+0000","last_clean":"2024-09-12T01:44:34.593669+0000","last_became_active":"2024-09-12T01:44:34.591395+0000","last_became_peered":"2024-09-12T01:44:34.591395+0000","last_unstale":"2024-09-12T01:44:34.593669+0000","last_undegraded":"2024-09-12T01:44:34.593669+0000","last_fullsized":"2024-09-12T01:44:34.593669+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.281914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590619+0000","last_change":"2024-09-12T01:44:34.585126+0000","last_active":"2024-09-12T01:44:34.590619+0000","last_peered":"2024-09-12T01:44:34.590619+0000","last_clean":"2024-09-12T01:44:34.590619+0000","last_became_active":"2024-09-12T01:44:34.584665+0000","last_became_peered":"2024-09-12T01:44:34.584665+0000","last_unstale":"2024-09-12T01:44:34.590619+0000","last_undegraded":"2024-09-12T01:44:34.590619+0000","last_fullsized":"2024-09-12T01:44:34.590619+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:59.840812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586620+0000","last_change":"2024-09-12T01:44:34.581891+0000","last_active":"2024-09-12T01:44:34.586620+0000","last_peered":"2024-09-12T01:44:34.586620+0000","last_clean":"2024-09-12T01:44:34.586620+0000","last_became_active":"2024-09-12T01:44:34.581603+0000","last_became_peered":"2024-09-12T01:44:34.581603+0000","last_unstale":"2024-09-12T01:44:34.586620+0000","last_undegraded":"2024-09-12T01:44:34.586620+0000","last_fullsized":"2024-09-12T01:44:34.586620+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:32.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.557842+0000","last_change":"2024-09-12T01:44:33.557842+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.557842+0000","last_undegraded":"2024-09-12T01:44:33.557842+0000","last_fullsized":"2024-09-12T01:44:33.557842+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583062+0000","last_change":"2024-09-12T01:44:34.578536+0000","last_active":"2024-09-12T01:44:34.583062+0000","last_peered":"2024-09-12T01:44:34.583062+0000","last_clean":"2024-09-12T01:44:34.583062+0000","last_became_active":"2024-09-12T01:44:34.578194+0000","last_became_peered":"2024-09-12T01:44:34.578194+0000","last_unstale":"2024-09-12T01:44:34.583062+0000","last_undegraded":"2024-09-12T01:44:34.583062+0000","last_fullsized":"2024-09-12T01:44:34.583062+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:06.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573384+0000","last_change":"2024-09-12T01:44:34.574426+0000","last_active":"2024-09-12T01:44:35.573384+0000","last_peered":"2024-09-12T01:44:35.573384+0000","last_clean":"2024-09-12T01:44:35.573384+0000","last_became_active":"2024-09-12T01:44:34.574151+0000","last_became_peered":"2024-09-12T01:44:34.574151+0000","last_unstale":"2024-09-12T01:44:35.573384+0000","last_undegraded":"2024-09-12T01:44:35.573384+0000","last_fullsized":"2024-09-12T01:44:35.573384+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:11.234396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.581027+0000","last_change":"2024-09-12T01:44:34.578057+0000","last_active":"2024-09-12T01:44:34.581027+0000","last_peered":"2024-09-12T01:44:34.581027+0000","last_clean":"2024-09-12T01:44:34.581027+0000","last_became_active":"2024-09-12T01:44:34.577776+0000","last_became_peered":"2024-09-12T01:44:34.577776+0000","last_unstale":"2024-09-12T01:44:34.581027+0000","last_undegraded":"2024-09-12T01:44:34.581027+0000","last_fullsized":"2024-09-12T01:44:34.581027+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:14.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574004+0000","last_change":"2024-09-12T01:44:34.569162+0000","last_active":"2024-09-12T01:44:35.574004+0000","last_peered":"2024-09-12T01:44:35.574004+0000","last_clean":"2024-09-12T01:44:35.574004+0000","last_became_active":"2024-09-12T01:44:34.568844+0000","last_became_peered":"2024-09-12T01:44:34.568844+0000","last_unstale":"2024-09-12T01:44:35.574004+0000","last_undegraded":"2024-09-12T01:44:35.574004+0000","last_fullsized":"2024-09-12T01:44:35.574004+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:33.785177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573911+0000","last_change":"2024-09-12T01:44:34.568333+0000","last_active":"2024-09-12T01:44:35.573911+0000","last_peered":"2024-09-12T01:44:35.573911+0000","last_clean":"2024-09-12T01:44:35.573911+0000","last_became_active":"2024-09-12T01:44:34.566942+0000","last_became_peered":"2024-09-12T01:44:34.566942+0000","last_unstale":"2024-09-12T01:44:35.573911+0000","last_undegraded":"2024-09-12T01:44:35.573911+0000","last_fullsized":"2024-09-12T01:44:35.573911+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:59.446473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573434+0000","last_change":"2024-09-12T01:44:34.574892+0000","last_active":"2024-09-12T01:44:35.573434+0000","last_peered":"2024-09-12T01:44:35.573434+0000","last_clean":"2024-09-12T01:44:35.573434+0000","last_became_active":"2024-09-12T01:44:34.574240+0000","last_became_peered":"2024-09-12T01:44:34.574240+0000","last_unstale":"2024-09-12T01:44:35.573434+0000","last_undegraded":"2024-09-12T01:44:35.573434+0000","last_fullsized":"2024-09-12T01:44:35.573434+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:03.484850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573730+0000","last_change":"2024-09-12T01:44:34.578283+0000","last_active":"2024-09-12T01:44:35.573730+0000","last_peered":"2024-09-12T01:44:35.573730+0000","last_clean":"2024-09-12T01:44:35.573730+0000","last_became_active":"2024-09-12T01:44:34.578019+0000","last_became_peered":"2024-09-12T01:44:34.578019+0000","last_unstale":"2024-09-12T01:44:35.573730+0000","last_undegraded":"2024-09-12T01:44:35.573730+0000","last_fullsized":"2024-09-12T01:44:35.573730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:19.132628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574318+0000","last_change":"2024-09-12T01:44:34.577407+0000","last_active":"2024-09-12T01:44:35.574318+0000","last_peered":"2024-09-12T01:44:35.574318+0000","last_clean":"2024-09-12T01:44:35.574318+0000","last_became_active":"2024-09-12T01:44:34.571477+0000","last_became_peered":"2024-09-12T01:44:34.571477+0000","last_unstale":"2024-09-12T01:44:35.574318+0000","last_undegraded":"2024-09-12T01:44:35.574318+0000","last_fullsized":"2024-09-12T01:44:35.574318+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:03.884787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573865+0000","last_change":"2024-09-12T01:44:34.579449+0000","last_active":"2024-09-12T01:44:35.573865+0000","last_peered":"2024-09-12T01:44:35.573865+0000","last_clean":"2024-09-12T01:44:35.573865+0000","last_became_active":"2024-09-12T01:44:34.579170+0000","last_became_peered":"2024-09-12T01:44:34.579170+0000","last_unstale":"2024-09-12T01:44:35.573865+0000","last_undegraded":"2024-09-12T01:44:35.573865+0000","last_fullsized":"2024-09-12T01:44:35.573865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:53.515628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583215+0000","last_change":"2024-09-12T01:44:34.580740+0000","last_active":"2024-09-12T01:44:34.583215+0000","last_peered":"2024-09-12T01:44:34.583215+0000","last_clean":"2024-09-12T01:44:34.583215+0000","last_became_active":"2024-09-12T01:44:34.580371+0000","last_became_peered":"2024-09-12T01:44:34.580371+0000","last_unstale":"2024-09-12T01:44:34.583215+0000","last_undegraded":"2024-09-12T01:44:34.583215+0000","last_fullsized":"2024-09-12T01:44:34.583215+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.079241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576943+0000","last_change":"2024-09-12T01:44:34.567435+0000","last_active":"2024-09-12T01:44:35.576943+0000","last_peered":"2024-09-12T01:44:35.576943+0000","last_clean":"2024-09-12T01:44:35.576943+0000","last_became_active":"2024-09-12T01:44:34.567107+0000","last_became_peered":"2024-09-12T01:44:34.567107+0000","last_unstale":"2024-09-12T01:44:35.576943+0000","last_undegraded":"2024-09-12T01:44:35.576943+0000","last_fullsized":"2024-09-12T01:44:35.576943+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:36.649302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.581883+0000","last_change":"2024-09-12T01:44:34.580274+0000","last_active":"2024-09-12T01:44:34.581883+0000","last_peered":"2024-09-12T01:44:34.581883+0000","last_clean":"2024-09-12T01:44:34.581883+0000","last_became_active":"2024-09-12T01:44:34.579917+0000","last_became_peered":"2024-09-12T01:44:34.579917+0000","last_unstale":"2024-09-12T01:44:34.581883+0000","last_undegraded":"2024-09-12T01:44:34.581883+0000","last_fullsized":"2024-09-12T01:44:34.581883+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.768947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576831+0000","last_change":"2024-09-12T01:44:34.577332+0000","last_active":"2024-09-12T01:44:35.576831+0000","last_peered":"2024-09-12T01:44:35.576831+0000","last_clean":"2024-09-12T01:44:35.576831+0000","last_became_active":"2024-09-12T01:44:34.576807+0000","last_became_peered":"2024-09-12T01:44:34.576807+0000","last_unstale":"2024-09-12T01:44:35.576831+0000","last_undegraded":"2024-09-12T01:44:35.576831+0000","last_fullsized":"2024-09-12T01:44:35.576831+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.911212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582646+0000","last_change":"2024-09-12T01:44:34.579014+0000","last_active":"2024-09-12T01:44:34.582646+0000","last_peered":"2024-09-12T01:44:34.582646+0000","last_clean":"2024-09-12T01:44:34.582646+0000","last_became_active":"2024-09-12T01:44:34.577666+0000","last_became_peered":"2024-09-12T01:44:34.577666+0000","last_unstale":"2024-09-12T01:44:34.582646+0000","last_undegraded":"2024-09-12T01:44:34.582646+0000","last_fullsized":"2024-09-12T01:44:34.582646+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:33.785177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.557343+0000","last_change":"2024-09-12T01:44:33.557343+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.557343+0000","last_undegraded":"2024-09-12T01:44:33.557343+0000","last_fullsized":"2024-09-12T01:44:33.557343+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"138'4","reported_seq":18,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577263+0000","last_change":"2024-09-12T01:44:33.562262+0000","last_active":"2024-09-12T01:44:35.577263+0000","last_peered":"2024-09-12T01:44:35.577263+0000","last_clean":"2024-09-12T01:44:35.577263+0000","last_became_active":"2024-09-12T01:44:33.561973+0000","last_became_peered":"2024-09-12T01:44:33.561973+0000","last_unstale":"2024-09-12T01:44:35.577263+0000","last_undegraded":"2024-09-12T01:44:35.577263+0000","last_fullsized":"2024-09-12T01:44:35.577263+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:50.459258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577264+0000","last_change":"2024-09-12T01:44:34.572331+0000","last_active":"2024-09-12T01:44:35.577264+0000","last_peered":"2024-09-12T01:44:35.577264+0000","last_clean":"2024-09-12T01:44:35.577264+0000","last_became_active":"2024-09-12T01:44:34.572042+0000","last_became_peered":"2024-09-12T01:44:34.572042+0000","last_unstale":"2024-09-12T01:44:35.577264+0000","last_undegraded":"2024-09-12T01:44:35.577264+0000","last_fullsized":"2024-09-12T01:44:35.577264+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:15.763728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"138'1","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592860+0000","last_change":"2024-09-12T01:44:33.571315+0000","last_active":"2024-09-12T01:44:34.592860+0000","last_peered":"2024-09-12T01:44:34.592860+0000","last_clean":"2024-09-12T01:44:34.592860+0000","last_became_active":"2024-09-12T01:44:33.570791+0000","last_became_peered":"2024-09-12T01:44:33.570791+0000","last_unstale":"2024-09-12T01:44:34.592860+0000","last_undegraded":"2024-09-12T01:44:34.592860+0000","last_fullsized":"2024-09-12T01:44:34.592860+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:15.839665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.579947+0000","last_change":"2024-09-12T01:44:34.578171+0000","last_active":"2024-09-12T01:44:34.579947+0000","last_peered":"2024-09-12T01:44:34.579947+0000","last_clean":"2024-09-12T01:44:34.579947+0000","last_became_active":"2024-09-12T01:44:34.577874+0000","last_became_peered":"2024-09-12T01:44:34.577874+0000","last_unstale":"2024-09-12T01:44:34.579947+0000","last_undegraded":"2024-09-12T01:44:34.579947+0000","last_fullsized":"2024-09-12T01:44:34.579947+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:58.704148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590018+0000","last_change":"2024-09-12T01:44:33.564326+0000","last_active":"2024-09-12T01:44:34.590018+0000","last_peered":"2024-09-12T01:44:34.590018+0000","last_clean":"2024-09-12T01:44:34.590018+0000","last_became_active":"2024-09-12T01:44:33.564082+0000","last_became_peered":"2024-09-12T01:44:33.564082+0000","last_unstale":"2024-09-12T01:44:34.590018+0000","last_undegraded":"2024-09-12T01:44:34.590018+0000","last_fullsized":"2024-09-12T01:44:34.590018+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:24.184840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593488+0000","last_change":"2024-09-12T01:44:34.590779+0000","last_active":"2024-09-12T01:44:34.593488+0000","last_peered":"2024-09-12T01:44:34.593488+0000","last_clean":"2024-09-12T01:44:34.593488+0000","last_became_active":"2024-09-12T01:44:34.590440+0000","last_became_peered":"2024-09-12T01:44:34.590440+0000","last_unstale":"2024-09-12T01:44:34.593488+0000","last_undegraded":"2024-09-12T01:44:34.593488+0000","last_fullsized":"2024-09-12T01:44:34.593488+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:06.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573976+0000","last_change":"2024-09-12T01:44:33.562995+0000","last_active":"2024-09-12T01:44:35.573976+0000","last_peered":"2024-09-12T01:44:35.573976+0000","last_clean":"2024-09-12T01:44:35.573976+0000","last_became_active":"2024-09-12T01:44:33.562650+0000","last_became_peered":"2024-09-12T01:44:33.562650+0000","last_unstale":"2024-09-12T01:44:35.573976+0000","last_undegraded":"2024-09-12T01:44:35.573976+0000","last_fullsized":"2024-09-12T01:44:35.573976+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560028+0000","last_change":"2024-09-12T01:44:33.560028+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560028+0000","last_undegraded":"2024-09-12T01:44:33.560028+0000","last_fullsized":"2024-09-12T01:44:33.560028+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577066+0000","last_change":"2024-09-12T01:44:33.571205+0000","last_active":"2024-09-12T01:44:35.577066+0000","last_peered":"2024-09-12T01:44:35.577066+0000","last_clean":"2024-09-12T01:44:35.577066+0000","last_became_active":"2024-09-12T01:44:33.570909+0000","last_became_peered":"2024-09-12T01:44:33.570909+0000","last_unstale":"2024-09-12T01:44:35.577066+0000","last_undegraded":"2024-09-12T01:44:35.577066+0000","last_fullsized":"2024-09-12T01:44:35.577066+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:05.134312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582675+0000","last_change":"2024-09-12T01:44:34.578688+0000","last_active":"2024-09-12T01:44:34.582675+0000","last_peered":"2024-09-12T01:44:34.582675+0000","last_clean":"2024-09-12T01:44:34.582675+0000","last_became_active":"2024-09-12T01:44:34.578415+0000","last_became_peered":"2024-09-12T01:44:34.578415+0000","last_unstale":"2024-09-12T01:44:34.582675+0000","last_undegraded":"2024-09-12T01:44:34.582675+0000","last_fullsized":"2024-09-12T01:44:34.582675+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:53.515628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-12T01:44:33.570379+0000","last_change":"2024-09-12T01:44:33.569461+0000","last_active":"2024-09-12T01:44:33.570379+0000","last_peered":"2024-09-12T01:44:33.570379+0000","last_clean":"2024-09-12T01:44:33.570379+0000","last_became_active":"2024-09-12T01:44:33.569155+0000","last_became_peered":"2024-09-12T01:44:33.569155+0000","last_unstale":"2024-09-12T01:44:33.570379+0000","last_undegraded":"2024-09-12T01:44:33.570379+0000","last_fullsized":"2024-09-12T01:44:33.570379+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:21.354429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573629+0000","last_change":"2024-09-12T01:44:34.569126+0000","last_active":"2024-09-12T01:44:35.573629+0000","last_peered":"2024-09-12T01:44:35.573629+0000","last_clean":"2024-09-12T01:44:35.573629+0000","last_became_active":"2024-09-12T01:44:34.568830+0000","last_became_peered":"2024-09-12T01:44:34.568830+0000","last_unstale":"2024-09-12T01:44:35.573629+0000","last_undegraded":"2024-09-12T01:44:35.573629+0000","last_fullsized":"2024-09-12T01:44:35.573629+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:18.088120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576891+0000","last_change":"2024-09-12T01:44:33.569947+0000","last_active":"2024-09-12T01:44:35.576891+0000","last_peered":"2024-09-12T01:44:35.576891+0000","last_clean":"2024-09-12T01:44:35.576891+0000","last_became_active":"2024-09-12T01:44:33.569378+0000","last_became_peered":"2024-09-12T01:44:33.569378+0000","last_unstale":"2024-09-12T01:44:35.576891+0000","last_undegraded":"2024-09-12T01:44:35.576891+0000","last_fullsized":"2024-09-12T01:44:35.576891+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:21.653578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560355+0000","last_change":"2024-09-12T01:44:33.560355+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560355+0000","last_undegraded":"2024-09-12T01:44:33.560355+0000","last_fullsized":"2024-09-12T01:44:33.560355+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573874+0000","last_change":"2024-09-12T01:44:33.566465+0000","last_active":"2024-09-12T01:44:35.573874+0000","last_peered":"2024-09-12T01:44:35.573874+0000","last_clean":"2024-09-12T01:44:35.573874+0000","last_became_active":"2024-09-12T01:44:33.566147+0000","last_became_peered":"2024-09-12T01:44:33.566147+0000","last_unstale":"2024-09-12T01:44:35.573874+0000","last_undegraded":"2024-09-12T01:44:35.573874+0000","last_fullsized":"2024-09-12T01:44:35.573874+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:42.446369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.588131+0000","last_change":"2024-09-12T01:44:34.583987+0000","last_active":"2024-09-12T01:44:34.588131+0000","last_peered":"2024-09-12T01:44:34.588131+0000","last_clean":"2024-09-12T01:44:34.588131+0000","last_became_active":"2024-09-12T01:44:34.583670+0000","last_became_peered":"2024-09-12T01:44:34.583670+0000","last_unstale":"2024-09-12T01:44:34.588131+0000","last_undegraded":"2024-09-12T01:44:34.588131+0000","last_fullsized":"2024-09-12T01:44:34.588131+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:23.984044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.572301+0000","last_change":"2024-09-12T01:44:33.568793+0000","last_active":"2024-09-12T01:44:34.572301+0000","last_peered":"2024-09-12T01:44:34.572301+0000","last_clean":"2024-09-12T01:44:34.572301+0000","last_became_active":"2024-09-12T01:44:33.568545+0000","last_became_peered":"2024-09-12T01:44:33.568545+0000","last_unstale":"2024-09-12T01:44:34.572301+0000","last_undegraded":"2024-09-12T01:44:34.572301+0000","last_fullsized":"2024-09-12T01:44:34.572301+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:02.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590661+0000","last_change":"2024-09-12T01:44:34.584292+0000","last_active":"2024-09-12T01:44:34.590661+0000","last_peered":"2024-09-12T01:44:34.590661+0000","last_clean":"2024-09-12T01:44:34.590661+0000","last_became_active":"2024-09-12T01:44:34.583648+0000","last_became_peered":"2024-09-12T01:44:34.583648+0000","last_unstale":"2024-09-12T01:44:34.590661+0000","last_undegraded":"2024-09-12T01:44:34.590661+0000","last_fullsized":"2024-09-12T01:44:34.590661+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:01.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"138'3","reported_seq":17,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574365+0000","last_change":"2024-09-12T01:44:33.561874+0000","last_active":"2024-09-12T01:44:35.574365+0000","last_peered":"2024-09-12T01:44:35.574365+0000","last_clean":"2024-09-12T01:44:35.574365+0000","last_became_active":"2024-09-12T01:44:33.561180+0000","last_became_peered":"2024-09-12T01:44:33.561180+0000","last_unstale":"2024-09-12T01:44:35.574365+0000","last_undegraded":"2024-09-12T01:44:35.574365+0000","last_fullsized":"2024-09-12T01:44:35.574365+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.801449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577045+0000","last_change":"2024-09-12T01:44:34.570692+0000","last_active":"2024-09-12T01:44:35.577045+0000","last_peered":"2024-09-12T01:44:35.577045+0000","last_clean":"2024-09-12T01:44:35.577045+0000","last_became_active":"2024-09-12T01:44:34.570372+0000","last_became_peered":"2024-09-12T01:44:34.570372+0000","last_unstale":"2024-09-12T01:44:35.577045+0000","last_undegraded":"2024-09-12T01:44:35.577045+0000","last_fullsized":"2024-09-12T01:44:35.577045+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:06.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"138'6","reported_seq":20,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574109+0000","last_change":"2024-09-12T01:44:33.561870+0000","last_active":"2024-09-12T01:44:35.574109+0000","last_peered":"2024-09-12T01:44:35.574109+0000","last_clean":"2024-09-12T01:44:35.574109+0000","last_became_active":"2024-09-12T01:44:33.561575+0000","last_became_peered":"2024-09-12T01:44:33.561575+0000","last_unstale":"2024-09-12T01:44:35.574109+0000","last_undegraded":"2024-09-12T01:44:35.574109+0000","last_fullsized":"2024-09-12T01:44:35.574109+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:28.447167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583184+0000","last_change":"2024-09-12T01:44:34.580219+0000","last_active":"2024-09-12T01:44:34.583184+0000","last_peered":"2024-09-12T01:44:34.583184+0000","last_clean":"2024-09-12T01:44:34.583184+0000","last_became_active":"2024-09-12T01:44:34.579863+0000","last_became_peered":"2024-09-12T01:44:34.579863+0000","last_unstale":"2024-09-12T01:44:34.583184+0000","last_undegraded":"2024-09-12T01:44:34.583184+0000","last_fullsized":"2024-09-12T01:44:34.583184+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:39.869863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-12T01:44:33.567606+0000","last_change":"2024-09-12T01:44:33.566891+0000","last_active":"2024-09-12T01:44:33.567606+0000","last_peered":"2024-09-12T01:44:33.567606+0000","last_clean":"2024-09-12T01:44:33.567606+0000","last_became_active":"2024-09-12T01:44:33.566599+0000","last_became_peered":"2024-09-12T01:44:33.566599+0000","last_unstale":"2024-09-12T01:44:33.567606+0000","last_undegraded":"2024-09-12T01:44:33.567606+0000","last_fullsized":"2024-09-12T01:44:33.567606+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:43.374724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574087+0000","last_change":"2024-09-12T01:44:34.582387+0000","last_active":"2024-09-12T01:44:35.574087+0000","last_peered":"2024-09-12T01:44:35.574087+0000","last_clean":"2024-09-12T01:44:35.574087+0000","last_became_active":"2024-09-12T01:44:34.582096+0000","last_became_peered":"2024-09-12T01:44:34.582096+0000","last_unstale":"2024-09-12T01:44:35.574087+0000","last_undegraded":"2024-09-12T01:44:35.574087+0000","last_fullsized":"2024-09-12T01:44:35.574087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:51.107638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.573223+0000","last_change":"2024-09-12T01:44:33.558602+0000","last_active":"2024-09-12T01:44:34.573223+0000","last_peered":"2024-09-12T01:44:34.573223+0000","last_clean":"2024-09-12T01:44:34.573223+0000","last_became_active":"2024-09-12T01:44:33.558246+0000","last_became_peered":"2024-09-12T01:44:33.558246+0000","last_unstale":"2024-09-12T01:44:34.573223+0000","last_undegraded":"2024-09-12T01:44:34.573223+0000","last_fullsized":"2024-09-12T01:44:34.573223+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:18.127850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586616+0000","last_change":"2024-09-12T01:44:34.579825+0000","last_active":"2024-09-12T01:44:34.586616+0000","last_peered":"2024-09-12T01:44:34.586616+0000","last_clean":"2024-09-12T01:44:34.586616+0000","last_became_active":"2024-09-12T01:44:34.579565+0000","last_became_peered":"2024-09-12T01:44:34.579565+0000","last_unstale":"2024-09-12T01:44:34.586616+0000","last_undegraded":"2024-09-12T01:44:34.586616+0000","last_fullsized":"2024-09-12T01:44:34.586616+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:58.038820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.569789+0000","last_change":"2024-09-12T01:44:33.565496+0000","last_active":"2024-09-12T01:44:34.569789+0000","last_peered":"2024-09-12T01:44:34.569789+0000","last_clean":"2024-09-12T01:44:34.569789+0000","last_became_active":"2024-09-12T01:44:33.565197+0000","last_became_peered":"2024-09-12T01:44:33.565197+0000","last_unstale":"2024-09-12T01:44:34.569789+0000","last_undegraded":"2024-09-12T01:44:34.569789+0000","last_fullsized":"2024-09-12T01:44:34.569789+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582599+0000","last_change":"2024-09-12T01:44:34.580307+0000","last_active":"2024-09-12T01:44:34.582599+0000","last_peered":"2024-09-12T01:44:34.582599+0000","last_clean":"2024-09-12T01:44:34.582599+0000","last_became_active":"2024-09-12T01:44:34.579921+0000","last_became_peered":"2024-09-12T01:44:34.579921+0000","last_unstale":"2024-09-12T01:44:34.582599+0000","last_undegraded":"2024-09-12T01:44:34.582599+0000","last_fullsized":"2024-09-12T01:44:34.582599+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:41.766067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"138'8","reported_seq":22,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574137+0000","last_change":"2024-09-12T01:44:33.558236+0000","last_active":"2024-09-12T01:44:35.574137+0000","last_peered":"2024-09-12T01:44:35.574137+0000","last_clean":"2024-09-12T01:44:35.574137+0000","last_became_active":"2024-09-12T01:44:33.557953+0000","last_became_peered":"2024-09-12T01:44:33.557953+0000","last_unstale":"2024-09-12T01:44:35.574137+0000","last_undegraded":"2024-09-12T01:44:35.574137+0000","last_fullsized":"2024-09-12T01:44:35.574137+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:12.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590830+0000","last_change":"2024-09-12T01:44:34.589581+0000","last_active":"2024-09-12T01:44:34.590830+0000","last_peered":"2024-09-12T01:44:34.590830+0000","last_clean":"2024-09-12T01:44:34.590830+0000","last_became_active":"2024-09-12T01:44:34.589048+0000","last_became_peered":"2024-09-12T01:44:34.589048+0000","last_unstale":"2024-09-12T01:44:34.590830+0000","last_undegraded":"2024-09-12T01:44:34.590830+0000","last_fullsized":"2024-09-12T01:44:34.590830+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:25.732831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573933+0000","last_change":"2024-09-12T01:44:33.557600+0000","last_active":"2024-09-12T01:44:35.573933+0000","last_peered":"2024-09-12T01:44:35.573933+0000","last_clean":"2024-09-12T01:44:35.573933+0000","last_became_active":"2024-09-12T01:44:33.557317+0000","last_became_peered":"2024-09-12T01:44:33.557317+0000","last_unstale":"2024-09-12T01:44:35.573933+0000","last_undegraded":"2024-09-12T01:44:35.573933+0000","last_fullsized":"2024-09-12T01:44:35.573933+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:34.330164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560947+0000","last_change":"2024-09-12T01:44:33.560947+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560947+0000","last_undegraded":"2024-09-12T01:44:33.560947+0000","last_fullsized":"2024-09-12T01:44:33.560947+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.596296+0000","last_change":"2024-09-12T01:44:33.570978+0000","last_active":"2024-09-12T01:44:34.596296+0000","last_peered":"2024-09-12T01:44:34.596296+0000","last_clean":"2024-09-12T01:44:34.596296+0000","last_became_active":"2024-09-12T01:44:33.570604+0000","last_became_peered":"2024-09-12T01:44:33.570604+0000","last_unstale":"2024-09-12T01:44:34.596296+0000","last_undegraded":"2024-09-12T01:44:34.596296+0000","last_fullsized":"2024-09-12T01:44:34.596296+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:08.714197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560122+0000","last_change":"2024-09-12T01:44:33.560122+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560122+0000","last_undegraded":"2024-09-12T01:44:33.560122+0000","last_fullsized":"2024-09-12T01:44:33.560122+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574107+0000","last_change":"2024-09-12T01:44:33.564371+0000","last_active":"2024-09-12T01:44:35.574107+0000","last_peered":"2024-09-12T01:44:35.574107+0000","last_clean":"2024-09-12T01:44:35.574107+0000","last_became_active":"2024-09-12T01:44:33.564044+0000","last_became_peered":"2024-09-12T01:44:33.564044+0000","last_unstale":"2024-09-12T01:44:35.574107+0000","last_undegraded":"2024-09-12T01:44:35.574107+0000","last_fullsized":"2024-09-12T01:44:35.574107+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:57.461543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574320+0000","last_change":"2024-09-12T01:44:34.577881+0000","last_active":"2024-09-12T01:44:35.574320+0000","last_peered":"2024-09-12T01:44:35.574320+0000","last_clean":"2024-09-12T01:44:35.574320+0000","last_became_active":"2024-09-12T01:44:34.571399+0000","last_became_peered":"2024-09-12T01:44:34.571399+0000","last_unstale":"2024-09-12T01:44:35.574320+0000","last_undegraded":"2024-09-12T01:44:35.574320+0000","last_fullsized":"2024-09-12T01:44:35.574320+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:36.649302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573487+0000","last_change":"2024-09-12T01:44:33.563195+0000","last_active":"2024-09-12T01:44:35.573487+0000","last_peered":"2024-09-12T01:44:35.573487+0000","last_clean":"2024-09-12T01:44:35.573487+0000","last_became_active":"2024-09-12T01:44:33.562898+0000","last_became_peered":"2024-09-12T01:44:33.562898+0000","last_unstale":"2024-09-12T01:44:35.573487+0000","last_undegraded":"2024-09-12T01:44:35.573487+0000","last_fullsized":"2024-09-12T01:44:35.573487+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:59.939596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576984+0000","last_change":"2024-09-12T01:44:34.576473+0000","last_active":"2024-09-12T01:44:35.576984+0000","last_peered":"2024-09-12T01:44:35.576984+0000","last_clean":"2024-09-12T01:44:35.576984+0000","last_became_active":"2024-09-12T01:44:34.576143+0000","last_became_peered":"2024-09-12T01:44:34.576143+0000","last_unstale":"2024-09-12T01:44:35.576984+0000","last_undegraded":"2024-09-12T01:44:35.576984+0000","last_fullsized":"2024-09-12T01:44:35.576984+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:29.139125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574252+0000","last_change":"2024-09-12T01:44:33.555265+0000","last_active":"2024-09-12T01:44:35.574252+0000","last_peered":"2024-09-12T01:44:35.574252+0000","last_clean":"2024-09-12T01:44:35.574252+0000","last_became_active":"2024-09-12T01:44:33.554630+0000","last_became_peered":"2024-09-12T01:44:33.554630+0000","last_unstale":"2024-09-12T01:44:35.574252+0000","last_undegraded":"2024-09-12T01:44:35.574252+0000","last_fullsized":"2024-09-12T01:44:35.574252+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:53.277135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574227+0000","last_change":"2024-09-12T01:44:34.580476+0000","last_active":"2024-09-12T01:44:35.574227+0000","last_peered":"2024-09-12T01:44:35.574227+0000","last_clean":"2024-09-12T01:44:35.574227+0000","last_became_active":"2024-09-12T01:44:34.579803+0000","last_became_peered":"2024-09-12T01:44:34.579803+0000","last_unstale":"2024-09-12T01:44:35.574227+0000","last_undegraded":"2024-09-12T01:44:35.574227+0000","last_fullsized":"2024-09-12T01:44:35.574227+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.911212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573217+0000","last_change":"2024-09-12T01:44:33.556147+0000","last_active":"2024-09-12T01:44:35.573217+0000","last_peered":"2024-09-12T01:44:35.573217+0000","last_clean":"2024-09-12T01:44:35.573217+0000","last_became_active":"2024-09-12T01:44:33.555852+0000","last_became_peered":"2024-09-12T01:44:33.555852+0000","last_unstale":"2024-09-12T01:44:35.573217+0000","last_undegraded":"2024-09-12T01:44:35.573217+0000","last_fullsized":"2024-09-12T01:44:35.573217+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:25.006137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576742+0000","last_change":"2024-09-12T01:44:34.579386+0000","last_active":"2024-09-12T01:44:35.576742+0000","last_peered":"2024-09-12T01:44:35.576742+0000","last_clean":"2024-09-12T01:44:35.576742+0000","last_became_active":"2024-09-12T01:44:34.579004+0000","last_became_peered":"2024-09-12T01:44:34.579004+0000","last_unstale":"2024-09-12T01:44:35.576742+0000","last_undegraded":"2024-09-12T01:44:35.576742+0000","last_fullsized":"2024-09-12T01:44:35.576742+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:59.446473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-12T01:44:33.570870+0000","last_change":"2024-09-12T01:44:33.570319+0000","last_active":"2024-09-12T01:44:33.570870+0000","last_peered":"2024-09-12T01:44:33.570870+0000","last_clean":"2024-09-12T01:44:33.570870+0000","last_became_active":"2024-09-12T01:44:33.570021+0000","last_became_peered":"2024-09-12T01:44:33.570021+0000","last_unstale":"2024-09-12T01:44:33.570870+0000","last_undegraded":"2024-09-12T01:44:33.570870+0000","last_fullsized":"2024-09-12T01:44:33.570870+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:51.216059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583126+0000","last_change":"2024-09-12T01:44:34.579335+0000","last_active":"2024-09-12T01:44:34.583126+0000","last_peered":"2024-09-12T01:44:34.583126+0000","last_clean":"2024-09-12T01:44:34.583126+0000","last_became_active":"2024-09-12T01:44:34.578948+0000","last_became_peered":"2024-09-12T01:44:34.578948+0000","last_unstale":"2024-09-12T01:44:34.583126+0000","last_undegraded":"2024-09-12T01:44:34.583126+0000","last_fullsized":"2024-09-12T01:44:34.583126+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:43.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573182+0000","last_change":"2024-09-12T01:44:33.562892+0000","last_active":"2024-09-12T01:44:35.573182+0000","last_peered":"2024-09-12T01:44:35.573182+0000","last_clean":"2024-09-12T01:44:35.573182+0000","last_became_active":"2024-09-12T01:44:33.562581+0000","last_became_peered":"2024-09-12T01:44:33.562581+0000","last_unstale":"2024-09-12T01:44:35.573182+0000","last_undegraded":"2024-09-12T01:44:35.573182+0000","last_fullsized":"2024-09-12T01:44:35.573182+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:36.009808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574480+0000","last_change":"2024-09-12T01:44:34.577117+0000","last_active":"2024-09-12T01:44:35.574480+0000","last_peered":"2024-09-12T01:44:35.574480+0000","last_clean":"2024-09-12T01:44:35.574480+0000","last_became_active":"2024-09-12T01:44:34.575726+0000","last_became_peered":"2024-09-12T01:44:34.575726+0000","last_unstale":"2024-09-12T01:44:35.574480+0000","last_undegraded":"2024-09-12T01:44:35.574480+0000","last_fullsized":"2024-09-12T01:44:35.574480+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:29.139125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.591091+0000","last_change":"2024-09-12T01:44:33.566034+0000","last_active":"2024-09-12T01:44:34.591091+0000","last_peered":"2024-09-12T01:44:34.591091+0000","last_clean":"2024-09-12T01:44:34.591091+0000","last_became_active":"2024-09-12T01:44:33.565748+0000","last_became_peered":"2024-09-12T01:44:33.565748+0000","last_unstale":"2024-09-12T01:44:34.591091+0000","last_undegraded":"2024-09-12T01:44:34.591091+0000","last_fullsized":"2024-09-12T01:44:34.591091+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:44.021918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560386+0000","last_change":"2024-09-12T01:44:33.560386+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560386+0000","last_undegraded":"2024-09-12T01:44:33.560386+0000","last_fullsized":"2024-09-12T01:44:33.560386+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"139'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576279+0000","last_change":"2024-09-12T01:44:33.568481+0000","last_active":"2024-09-12T01:44:35.576279+0000","last_peered":"2024-09-12T01:44:35.576279+0000","last_clean":"2024-09-12T01:44:35.576279+0000","last_became_active":"2024-09-12T01:44:33.568131+0000","last_became_peered":"2024-09-12T01:44:33.568131+0000","last_unstale":"2024-09-12T01:44:35.576279+0000","last_undegraded":"2024-09-12T01:44:35.576279+0000","last_fullsized":"2024-09-12T01:44:35.576279+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:06.349936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.558120+0000","last_change":"2024-09-12T01:44:33.558120+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.558120+0000","last_undegraded":"2024-09-12T01:44:33.558120+0000","last_fullsized":"2024-09-12T01:44:33.558120+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577169+0000","last_change":"2024-09-12T01:44:33.568264+0000","last_active":"2024-09-12T01:44:35.577169+0000","last_peered":"2024-09-12T01:44:35.577169+0000","last_clean":"2024-09-12T01:44:35.577169+0000","last_became_active":"2024-09-12T01:44:33.567714+0000","last_became_peered":"2024-09-12T01:44:33.567714+0000","last_unstale":"2024-09-12T01:44:35.577169+0000","last_undegraded":"2024-09-12T01:44:35.577169+0000","last_fullsized":"2024-09-12T01:44:35.577169+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.801449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560175+0000","last_change":"2024-09-12T01:44:33.560175+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560175+0000","last_undegraded":"2024-09-12T01:44:33.560175+0000","last_fullsized":"2024-09-12T01:44:33.560175+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574180+0000","last_change":"2024-09-12T01:44:33.553971+0000","last_active":"2024-09-12T01:44:35.574180+0000","last_peered":"2024-09-12T01:44:35.574180+0000","last_clean":"2024-09-12T01:44:35.574180+0000","last_became_active":"2024-09-12T01:44:33.553693+0000","last_became_peered":"2024-09-12T01:44:33.553693+0000","last_unstale":"2024-09-12T01:44:35.574180+0000","last_undegraded":"2024-09-12T01:44:35.574180+0000","last_fullsized":"2024-09-12T01:44:35.574180+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:05.134312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586642+0000","last_change":"2024-09-12T01:44:34.582051+0000","last_active":"2024-09-12T01:44:34.586642+0000","last_peered":"2024-09-12T01:44:34.586642+0000","last_clean":"2024-09-12T01:44:34.586642+0000","last_became_active":"2024-09-12T01:44:34.581751+0000","last_became_peered":"2024-09-12T01:44:34.581751+0000","last_unstale":"2024-09-12T01:44:34.586642+0000","last_undegraded":"2024-09-12T01:44:34.586642+0000","last_fullsized":"2024-09-12T01:44:34.586642+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:27.408256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574019+0000","last_change":"2024-09-12T01:44:33.566494+0000","last_active":"2024-09-12T01:44:35.574019+0000","last_peered":"2024-09-12T01:44:35.574019+0000","last_clean":"2024-09-12T01:44:35.574019+0000","last_became_active":"2024-09-12T01:44:33.566175+0000","last_became_peered":"2024-09-12T01:44:33.566175+0000","last_unstale":"2024-09-12T01:44:35.574019+0000","last_undegraded":"2024-09-12T01:44:35.574019+0000","last_fullsized":"2024-09-12T01:44:35.574019+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:10.376177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576904+0000","last_change":"2024-09-12T01:44:34.571445+0000","last_active":"2024-09-12T01:44:35.576904+0000","last_peered":"2024-09-12T01:44:35.576904+0000","last_clean":"2024-09-12T01:44:35.576904+0000","last_became_active":"2024-09-12T01:44:34.571128+0000","last_became_peered":"2024-09-12T01:44:34.571128+0000","last_unstale":"2024-09-12T01:44:35.576904+0000","last_undegraded":"2024-09-12T01:44:35.576904+0000","last_fullsized":"2024-09-12T01:44:35.576904+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:03.884787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.569409+0000","last_change":"2024-09-12T01:44:33.565610+0000","last_active":"2024-09-12T01:44:34.569409+0000","last_peered":"2024-09-12T01:44:34.569409+0000","last_clean":"2024-09-12T01:44:34.569409+0000","last_became_active":"2024-09-12T01:44:33.565331+0000","last_became_peered":"2024-09-12T01:44:33.565331+0000","last_unstale":"2024-09-12T01:44:34.569409+0000","last_undegraded":"2024-09-12T01:44:34.569409+0000","last_fullsized":"2024-09-12T01:44:34.569409+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:21.653578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.578023+0000","last_change":"2024-09-12T01:44:34.574761+0000","last_active":"2024-09-12T01:44:34.578023+0000","last_peered":"2024-09-12T01:44:34.578023+0000","last_clean":"2024-09-12T01:44:34.578023+0000","last_became_active":"2024-09-12T01:44:34.574471+0000","last_became_peered":"2024-09-12T01:44:34.574471+0000","last_unstale":"2024-09-12T01:44:34.578023+0000","last_undegraded":"2024-09-12T01:44:34.578023+0000","last_fullsized":"2024-09-12T01:44:34.578023+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.806227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577074+0000","last_change":"2024-09-12T01:44:33.569721+0000","last_active":"2024-09-12T01:44:35.577074+0000","last_peered":"2024-09-12T01:44:35.577074+0000","last_clean":"2024-09-12T01:44:35.577074+0000","last_became_active":"2024-09-12T01:44:33.569016+0000","last_became_peered":"2024-09-12T01:44:33.569016+0000","last_unstale":"2024-09-12T01:44:35.577074+0000","last_undegraded":"2024-09-12T01:44:35.577074+0000","last_fullsized":"2024-09-12T01:44:35.577074+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576770+0000","last_change":"2024-09-12T01:44:34.569764+0000","last_active":"2024-09-12T01:44:35.576770+0000","last_peered":"2024-09-12T01:44:35.576770+0000","last_clean":"2024-09-12T01:44:35.576770+0000","last_became_active":"2024-09-12T01:44:34.569409+0000","last_became_peered":"2024-09-12T01:44:34.569409+0000","last_unstale":"2024-09-12T01:44:35.576770+0000","last_undegraded":"2024-09-12T01:44:35.576770+0000","last_fullsized":"2024-09-12T01:44:35.576770+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:51.107638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576701+0000","last_change":"2024-09-12T01:44:33.567980+0000","last_active":"2024-09-12T01:44:35.576701+0000","last_peered":"2024-09-12T01:44:35.576701+0000","last_clean":"2024-09-12T01:44:35.576701+0000","last_became_active":"2024-09-12T01:44:33.567648+0000","last_became_peered":"2024-09-12T01:44:33.567648+0000","last_unstale":"2024-09-12T01:44:35.576701+0000","last_undegraded":"2024-09-12T01:44:35.576701+0000","last_fullsized":"2024-09-12T01:44:35.576701+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:40.761288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590655+0000","last_change":"2024-09-12T01:44:34.585187+0000","last_active":"2024-09-12T01:44:34.590655+0000","last_peered":"2024-09-12T01:44:34.590655+0000","last_clean":"2024-09-12T01:44:34.590655+0000","last_became_active":"2024-09-12T01:44:34.584915+0000","last_became_peered":"2024-09-12T01:44:34.584915+0000","last_unstale":"2024-09-12T01:44:34.590655+0000","last_undegraded":"2024-09-12T01:44:34.590655+0000","last_fullsized":"2024-09-12T01:44:34.590655+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:24.224542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573836+0000","last_change":"2024-09-12T01:44:33.567593+0000","last_active":"2024-09-12T01:44:35.573836+0000","last_peered":"2024-09-12T01:44:35.573836+0000","last_clean":"2024-09-12T01:44:35.573836+0000","last_became_active":"2024-09-12T01:44:33.566833+0000","last_became_peered":"2024-09-12T01:44:33.566833+0000","last_unstale":"2024-09-12T01:44:35.573836+0000","last_undegraded":"2024-09-12T01:44:35.573836+0000","last_fullsized":"2024-09-12T01:44:35.573836+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:56.207377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":389,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574004+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:44:35.574004+0000","last_peered":"2024-09-12T01:44:35.574004+0000","last_clean":"2024-09-12T01:44:35.574004+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:44:35.574004+0000","last_undegraded":"2024-09-12T01:44:35.574004+0000","last_fullsized":"2024-09-12T01:44:35.574004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509551,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1728512,"data_stored":740564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":1732608,"data_stored":740598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509549,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2330624,"data_stored":1331604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509549,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41216,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330624,"statfs":{"total":96636764160,"available":96594558976,"internally_reserved":0,"allocated":1744896,"data_stored":742198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509549,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37060,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334780,"statfs":{"total":96636764160,"available":96598814720,"internally_reserved":0,"allocated":1744896,"data_stored":747446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509549,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37644,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334196,"statfs":{"total":96636764160,"available":96598216704,"internally_reserved":0,"allocated":2347008,"data_stored":1332726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1732608,"data_stored":740634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32852,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338988,"statfs":{"total":96636764160,"available":96603123712,"internally_reserved":0,"allocated":1703936,"data_stored":727514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:44:37.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:44:37.694 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.694+0000 7fdc9a5b7640 1 Processor -- start 2024-09-12T01:44:37.695 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.694+0000 7fdc9a5b7640 1 -- start start 2024-09-12T01:44:37.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.695+0000 7fdc9a5b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc9415c2b0 0x7fdc940b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.695+0000 7fdc9a5b7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9415fb10 con 0x7fdc940b72f0 2024-09-12T01:44:37.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.695+0000 7fdc9a5b7640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc940b5900 con 0x7fdc9415f200 2024-09-12T01:44:37.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.695+0000 7fdc9a5b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9415f830 con 0x7fdc9415c2b0 2024-09-12T01:44:37.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.695+0000 7fdc937fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdc940b72f0 0x7fdc9415eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54350/0 (socket says 172.21.15.60:54350) 2024-09-12T01:44:37.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.695+0000 7fdc937fe640 1 -- 172.21.15.60:0/3949542745 learned_addr learned my addr 172.21.15.60:0/3949542745 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:37.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.695+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1208297227 0 0) 0x7fdc9415fb10 con 0x7fdc940b72f0 2024-09-12T01:44:37.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.695+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc7c003520 con 0x7fdc940b72f0 2024-09-12T01:44:37.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.695+0000 7fdc93fff640 1 --2- 172.21.15.60:0/3949542745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc9415c2b0 0x7fdc940b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2871276942 0 0) 0x7fdc7c003520 con 0x7fdc940b72f0 2024-09-12T01:44:37.699 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc9415c2b0 msgr2=0x7fdc940b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 --2- 172.21.15.60:0/3949542745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc9415c2b0 0x7fdc940b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 >> v1:172.21.15.105:6789/0 conn(0x7fdc9415f200 legacy=0x7fdc9406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9406ce30 con 0x7fdc940b72f0 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fdc88001670 con 0x7fdc940b72f0 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 >> v1:172.21.15.60:6789/0 conn(0x7fdc940b72f0 legacy=0x7fdc9415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 --2- 172.21.15.60:0/3949542745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc7c0039e0 0x7fdc7c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 --2- 172.21.15.60:0/3949542745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc7c004800 0x7fdc7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 --2- 172.21.15.60:0/3949542745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc9415c2b0 0x7fdc7c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9415f830 con 0x7fdc7c0039e0 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c00baf0 con 0x7fdc7c004800 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7c00bcf0 con 0x7fdc9415c2b0 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc93fff640 1 --2- 172.21.15.60:0/3949542745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc7c0039e0 0x7fdc7c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc937fe640 1 --2- 172.21.15.60:0/3949542745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc7c004800 0x7fdc7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc98b54640 1 --2- 172.21.15.60:0/3949542745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc9415c2b0 0x7fdc7c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc93fff640 1 -- 172.21.15.60:0/3949542745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc9415c2b0 msgr2=0x7fdc7c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc93fff640 1 --2- 172.21.15.60:0/3949542745 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc9415c2b0 0x7fdc7c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc93fff640 1 -- 172.21.15.60:0/3949542745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc7c004800 msgr2=0x7fdc7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc93fff640 1 --2- 172.21.15.60:0/3949542745 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc7c004800 0x7fdc7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.696+0000 7fdc93fff640 1 -- 172.21.15.60:0/3949542745 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c003520 con 0x7fdc7c0039e0 2024-09-12T01:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.697+0000 7fdc93fff640 1 --2- 172.21.15.60:0/3949542745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc7c0039e0 0x7fdc7c003e00 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400ba30 tx=0x7fdc7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=518927e8c115af2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.697+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc84030070 con 0x7fdc7c0039e0 2024-09-12T01:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.697+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8402ade0 con 0x7fdc7c0039e0 2024-09-12T01:44:37.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.697+0000 7fdc92ffd640 1 -- 172.21.15.60:0/3949542745 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400b600 con 0x7fdc7c0039e0 2024-09-12T01:44:37.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.697+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/3949542745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc7c0039e0 msgr2=0x7fdc7c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.697+0000 7fdc9a5b7640 1 --2- 172.21.15.60:0/3949542745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc7c0039e0 0x7fdc7c003e00 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400ba30 tx=0x7fdc7c005830 comp rx=0 tx=0).stop 2024-09-12T01:44:37.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.697+0000 7fdc98b54640 1 -- 172.21.15.60:0/3949542745 reap_dead start 2024-09-12T01:44:37.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.697+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/3949542745 shutdown_connections 2024-09-12T01:44:37.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.697+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/3949542745 >> 172.21.15.60:0/3949542745 conn(0x7fdc940b4240 msgr2=0x7fdc940b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:37.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.698+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/3949542745 shutdown_connections 2024-09-12T01:44:37.702 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.698+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/3949542745 wait complete. 2024-09-12T01:44:37.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.699+0000 7fdc9a5b7640 1 Processor -- start 2024-09-12T01:44:37.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.699+0000 7fdc9a5b7640 1 -- start start 2024-09-12T01:44:37.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc9a5b7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc7c0039e0 0x7fdc9415d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc9a5b7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc94154bb0 0x7fdc94155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc9a5b7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc940d1b00 0x7fdc940d1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc9a5b7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdc940b7730 con 0x7fdc940d1b00 2024-09-12T01:44:37.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc9a5b7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9406d3f0 con 0x7fdc94154bb0 2024-09-12T01:44:37.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc9a5b7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fdc940b6db0 con 0x7fdc7c0039e0 2024-09-12T01:44:37.705 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc98b54640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc940d1b00 0x7fdc940d1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc98b54640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc940d1b00 0x7fdc940d1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42776/0 (socket says 172.21.15.60:42776) 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc98b54640 1 -- 172.21.15.60:0/2725362484 learned_addr learned my addr 172.21.15.60:0/2725362484 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc93fff640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc7c0039e0 0x7fdc9415d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc937fe640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc94154bb0 0x7fdc94155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc98b54640 1 -- 172.21.15.60:0/2725362484 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc7c0039e0 msgr2=0x7fdc9415d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc98b54640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc7c0039e0 0x7fdc9415d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc98b54640 1 -- 172.21.15.60:0/2725362484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc94154bb0 msgr2=0x7fdc94155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc98b54640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc94154bb0 0x7fdc94155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc98b54640 1 -- 172.21.15.60:0/2725362484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc940d2830 con 0x7fdc940d1b00 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc937fe640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc94154bb0 0x7fdc94155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc98b54640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc940d1b00 0x7fdc940d1f80 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fdc94072d40 tx=0x7fdc8c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc90ff9640 1 -- 172.21.15.60:0/2725362484 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c003970 con 0x7fdc940d1b00 2024-09-12T01:44:37.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.700+0000 7fdc90ff9640 1 -- 172.21.15.60:0/2725362484 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c018070 con 0x7fdc940d1b00 2024-09-12T01:44:37.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.701+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/2725362484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc940d2b10 con 0x7fdc940d1b00 2024-09-12T01:44:37.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.701+0000 7fdc90ff9640 1 -- 172.21.15.60:0/2725362484 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c003d50 con 0x7fdc940d1b00 2024-09-12T01:44:37.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.701+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/2725362484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc94156be0 con 0x7fdc940d1b00 2024-09-12T01:44:37.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.701+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/2725362484 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc9415eaf0 con 0x7fdc940d1b00 2024-09-12T01:44:37.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.702+0000 7fdc90ff9640 1 -- 172.21.15.60:0/2725362484 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fdc8c0050d0 con 0x7fdc940d1b00 2024-09-12T01:44:37.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.702+0000 7fdc90ff9640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdc8006be60 0x7fdc8006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:37.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.703+0000 7fdc90ff9640 1 -- 172.21.15.60:0/2725362484 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fdc8c08aae0 con 0x7fdc940d1b00 2024-09-12T01:44:37.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.703+0000 7fdc93fff640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdc8006be60 0x7fdc8006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:37.707 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.703+0000 7fdc93fff640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdc8006be60 0x7fdc8006e320 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400ba00 tx=0x7fdc84030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:37.708 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.707+0000 7fdc90ff9640 1 -- 172.21.15.60:0/2725362484 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fdc8c059490 con 0x7fdc940d1b00 2024-09-12T01:44:37.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.882+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/2725362484 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc94155570 con 0x7fdc8006be60 2024-09-12T01:44:37.888 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.888+0000 7fdc90ff9640 1 -- 172.21.15.60:0/2725362484 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251623 (secure 0 0 0) 0x7fdc94155570 con 0x7fdc8006be60 2024-09-12T01:44:37.891 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:37.892 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:44:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.891+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/2725362484 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdc8006be60 msgr2=0x7fdc8006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.891+0000 7fdc9a5b7640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdc8006be60 0x7fdc8006e320 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400ba00 tx=0x7fdc84030000 comp rx=0 tx=0).stop 2024-09-12T01:44:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.891+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/2725362484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc940d1b00 msgr2=0x7fdc940d1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.891+0000 7fdc9a5b7640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc940d1b00 0x7fdc940d1f80 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fdc94072d40 tx=0x7fdc8c00ec10 comp rx=0 tx=0).stop 2024-09-12T01:44:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.891+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/2725362484 shutdown_connections 2024-09-12T01:44:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.891+0000 7fdc9a5b7640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc940d1b00 0x7fdc940d1f80 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.891+0000 7fdc9a5b7640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fdc94154bb0 0x7fdc94155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.891+0000 7fdc9a5b7640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fdc8006be60 0x7fdc8006e320 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.894 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.891+0000 7fdc9a5b7640 1 --2- 172.21.15.60:0/2725362484 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc7c0039e0 0x7fdc9415d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.891+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/2725362484 >> 172.21.15.60:0/2725362484 conn(0x7fdc940b4240 msgr2=0x7fdc94161380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.891+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/2725362484 shutdown_connections 2024-09-12T01:44:37.895 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:37.891+0000 7fdc9a5b7640 1 -- 172.21.15.60:0/2725362484 wait complete. 2024-09-12T01:44:37.902 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":399,"stamp":"2024-09-12T01:44:36.376736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592744,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":293372,"kb_used_data":14712,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754681348,"statfs":{"total":773094113280,"available":772793700352,"internally_reserved":0,"allocated":15065088,"data_stored":7103284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000884"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577206+0000","last_change":"2024-09-12T01:44:34.578808+0000","last_active":"2024-09-12T01:44:35.577206+0000","last_peered":"2024-09-12T01:44:35.577206+0000","last_clean":"2024-09-12T01:44:35.577206+0000","last_became_active":"2024-09-12T01:44:34.578528+0000","last_became_peered":"2024-09-12T01:44:34.578528+0000","last_unstale":"2024-09-12T01:44:35.577206+0000","last_undegraded":"2024-09-12T01:44:35.577206+0000","last_fullsized":"2024-09-12T01:44:35.577206+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:04.653539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577100+0000","last_change":"2024-09-12T01:44:34.579190+0000","last_active":"2024-09-12T01:44:35.577100+0000","last_peered":"2024-09-12T01:44:35.577100+0000","last_clean":"2024-09-12T01:44:35.577100+0000","last_became_active":"2024-09-12T01:44:34.578880+0000","last_became_peered":"2024-09-12T01:44:34.578880+0000","last_unstale":"2024-09-12T01:44:35.577100+0000","last_undegraded":"2024-09-12T01:44:35.577100+0000","last_fullsized":"2024-09-12T01:44:35.577100+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:48.771413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577035+0000","last_change":"2024-09-12T01:44:34.568255+0000","last_active":"2024-09-12T01:44:35.577035+0000","last_peered":"2024-09-12T01:44:35.577035+0000","last_clean":"2024-09-12T01:44:35.577035+0000","last_became_active":"2024-09-12T01:44:34.567951+0000","last_became_peered":"2024-09-12T01:44:34.567951+0000","last_unstale":"2024-09-12T01:44:35.577035+0000","last_undegraded":"2024-09-12T01:44:35.577035+0000","last_fullsized":"2024-09-12T01:44:35.577035+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:06.315519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560664+0000","last_change":"2024-09-12T01:44:33.560664+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560664+0000","last_undegraded":"2024-09-12T01:44:33.560664+0000","last_fullsized":"2024-09-12T01:44:33.560664+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573865+0000","last_change":"2024-09-12T01:44:34.581929+0000","last_active":"2024-09-12T01:44:35.573865+0000","last_peered":"2024-09-12T01:44:35.573865+0000","last_clean":"2024-09-12T01:44:35.573865+0000","last_became_active":"2024-09-12T01:44:34.581430+0000","last_became_peered":"2024-09-12T01:44:34.581430+0000","last_unstale":"2024-09-12T01:44:35.573865+0000","last_undegraded":"2024-09-12T01:44:35.573865+0000","last_fullsized":"2024-09-12T01:44:35.573865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:58.704148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593245+0000","last_change":"2024-09-12T01:44:34.587092+0000","last_active":"2024-09-12T01:44:34.593245+0000","last_peered":"2024-09-12T01:44:34.593245+0000","last_clean":"2024-09-12T01:44:34.593245+0000","last_became_active":"2024-09-12T01:44:34.586801+0000","last_became_peered":"2024-09-12T01:44:34.586801+0000","last_unstale":"2024-09-12T01:44:34.593245+0000","last_undegraded":"2024-09-12T01:44:34.593245+0000","last_fullsized":"2024-09-12T01:44:34.593245+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:07.258321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583107+0000","last_change":"2024-09-12T01:44:34.579218+0000","last_active":"2024-09-12T01:44:34.583107+0000","last_peered":"2024-09-12T01:44:34.583107+0000","last_clean":"2024-09-12T01:44:34.583107+0000","last_became_active":"2024-09-12T01:44:34.578880+0000","last_became_peered":"2024-09-12T01:44:34.578880+0000","last_unstale":"2024-09-12T01:44:34.583107+0000","last_undegraded":"2024-09-12T01:44:34.583107+0000","last_fullsized":"2024-09-12T01:44:34.583107+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.281914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593466+0000","last_change":"2024-09-12T01:44:34.589398+0000","last_active":"2024-09-12T01:44:34.593466+0000","last_peered":"2024-09-12T01:44:34.593466+0000","last_clean":"2024-09-12T01:44:34.593466+0000","last_became_active":"2024-09-12T01:44:34.589132+0000","last_became_peered":"2024-09-12T01:44:34.589132+0000","last_unstale":"2024-09-12T01:44:34.593466+0000","last_undegraded":"2024-09-12T01:44:34.593466+0000","last_fullsized":"2024-09-12T01:44:34.593466+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.806227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583277+0000","last_change":"2024-09-12T01:44:34.582405+0000","last_active":"2024-09-12T01:44:34.583277+0000","last_peered":"2024-09-12T01:44:34.583277+0000","last_clean":"2024-09-12T01:44:34.583277+0000","last_became_active":"2024-09-12T01:44:34.582107+0000","last_became_peered":"2024-09-12T01:44:34.582107+0000","last_unstale":"2024-09-12T01:44:34.583277+0000","last_undegraded":"2024-09-12T01:44:34.583277+0000","last_fullsized":"2024-09-12T01:44:34.583277+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:51.464037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592952+0000","last_change":"2024-09-12T01:44:34.587622+0000","last_active":"2024-09-12T01:44:34.592952+0000","last_peered":"2024-09-12T01:44:34.592952+0000","last_clean":"2024-09-12T01:44:34.592952+0000","last_became_active":"2024-09-12T01:44:34.587309+0000","last_became_peered":"2024-09-12T01:44:34.587309+0000","last_unstale":"2024-09-12T01:44:34.592952+0000","last_undegraded":"2024-09-12T01:44:34.592952+0000","last_fullsized":"2024-09-12T01:44:34.592952+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:22.658357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573760+0000","last_change":"2024-09-12T01:44:34.581035+0000","last_active":"2024-09-12T01:44:35.573760+0000","last_peered":"2024-09-12T01:44:35.573760+0000","last_clean":"2024-09-12T01:44:35.573760+0000","last_became_active":"2024-09-12T01:44:34.580768+0000","last_became_peered":"2024-09-12T01:44:34.580768+0000","last_unstale":"2024-09-12T01:44:35.573760+0000","last_undegraded":"2024-09-12T01:44:35.573760+0000","last_fullsized":"2024-09-12T01:44:35.573760+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:14.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573365+0000","last_change":"2024-09-12T01:44:34.582605+0000","last_active":"2024-09-12T01:44:35.573365+0000","last_peered":"2024-09-12T01:44:35.573365+0000","last_clean":"2024-09-12T01:44:35.573365+0000","last_became_active":"2024-09-12T01:44:34.582322+0000","last_became_peered":"2024-09-12T01:44:34.582322+0000","last_unstale":"2024-09-12T01:44:35.573365+0000","last_undegraded":"2024-09-12T01:44:35.573365+0000","last_fullsized":"2024-09-12T01:44:35.573365+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:01.900564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573363+0000","last_change":"2024-09-12T01:44:34.587381+0000","last_active":"2024-09-12T01:44:35.573363+0000","last_peered":"2024-09-12T01:44:35.573363+0000","last_clean":"2024-09-12T01:44:35.573363+0000","last_became_active":"2024-09-12T01:44:34.586812+0000","last_became_peered":"2024-09-12T01:44:34.586812+0000","last_unstale":"2024-09-12T01:44:35.573363+0000","last_undegraded":"2024-09-12T01:44:35.573363+0000","last_fullsized":"2024-09-12T01:44:35.573363+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:11.765535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592991+0000","last_change":"2024-09-12T01:44:34.587979+0000","last_active":"2024-09-12T01:44:34.592991+0000","last_peered":"2024-09-12T01:44:34.592991+0000","last_clean":"2024-09-12T01:44:34.592991+0000","last_became_active":"2024-09-12T01:44:34.587628+0000","last_became_peered":"2024-09-12T01:44:34.587628+0000","last_unstale":"2024-09-12T01:44:34.592991+0000","last_undegraded":"2024-09-12T01:44:34.592991+0000","last_fullsized":"2024-09-12T01:44:34.592991+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:42.799915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593669+0000","last_change":"2024-09-12T01:44:34.591685+0000","last_active":"2024-09-12T01:44:34.593669+0000","last_peered":"2024-09-12T01:44:34.593669+0000","last_clean":"2024-09-12T01:44:34.593669+0000","last_became_active":"2024-09-12T01:44:34.591395+0000","last_became_peered":"2024-09-12T01:44:34.591395+0000","last_unstale":"2024-09-12T01:44:34.593669+0000","last_undegraded":"2024-09-12T01:44:34.593669+0000","last_fullsized":"2024-09-12T01:44:34.593669+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.281914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590619+0000","last_change":"2024-09-12T01:44:34.585126+0000","last_active":"2024-09-12T01:44:34.590619+0000","last_peered":"2024-09-12T01:44:34.590619+0000","last_clean":"2024-09-12T01:44:34.590619+0000","last_became_active":"2024-09-12T01:44:34.584665+0000","last_became_peered":"2024-09-12T01:44:34.584665+0000","last_unstale":"2024-09-12T01:44:34.590619+0000","last_undegraded":"2024-09-12T01:44:34.590619+0000","last_fullsized":"2024-09-12T01:44:34.590619+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:59.840812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586620+0000","last_change":"2024-09-12T01:44:34.581891+0000","last_active":"2024-09-12T01:44:34.586620+0000","last_peered":"2024-09-12T01:44:34.586620+0000","last_clean":"2024-09-12T01:44:34.586620+0000","last_became_active":"2024-09-12T01:44:34.581603+0000","last_became_peered":"2024-09-12T01:44:34.581603+0000","last_unstale":"2024-09-12T01:44:34.586620+0000","last_undegraded":"2024-09-12T01:44:34.586620+0000","last_fullsized":"2024-09-12T01:44:34.586620+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:32.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.557842+0000","last_change":"2024-09-12T01:44:33.557842+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.557842+0000","last_undegraded":"2024-09-12T01:44:33.557842+0000","last_fullsized":"2024-09-12T01:44:33.557842+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583062+0000","last_change":"2024-09-12T01:44:34.578536+0000","last_active":"2024-09-12T01:44:34.583062+0000","last_peered":"2024-09-12T01:44:34.583062+0000","last_clean":"2024-09-12T01:44:34.583062+0000","last_became_active":"2024-09-12T01:44:34.578194+0000","last_became_peered":"2024-09-12T01:44:34.578194+0000","last_unstale":"2024-09-12T01:44:34.583062+0000","last_undegraded":"2024-09-12T01:44:34.583062+0000","last_fullsized":"2024-09-12T01:44:34.583062+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:06.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573384+0000","last_change":"2024-09-12T01:44:34.574426+0000","last_active":"2024-09-12T01:44:35.573384+0000","last_peered":"2024-09-12T01:44:35.573384+0000","last_clean":"2024-09-12T01:44:35.573384+0000","last_became_active":"2024-09-12T01:44:34.574151+0000","last_became_peered":"2024-09-12T01:44:34.574151+0000","last_unstale":"2024-09-12T01:44:35.573384+0000","last_undegraded":"2024-09-12T01:44:35.573384+0000","last_fullsized":"2024-09-12T01:44:35.573384+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:11.234396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.581027+0000","last_change":"2024-09-12T01:44:34.578057+0000","last_active":"2024-09-12T01:44:34.581027+0000","last_peered":"2024-09-12T01:44:34.581027+0000","last_clean":"2024-09-12T01:44:34.581027+0000","last_became_active":"2024-09-12T01:44:34.577776+0000","last_became_peered":"2024-09-12T01:44:34.577776+0000","last_unstale":"2024-09-12T01:44:34.581027+0000","last_undegraded":"2024-09-12T01:44:34.581027+0000","last_fullsized":"2024-09-12T01:44:34.581027+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:14.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574004+0000","last_change":"2024-09-12T01:44:34.569162+0000","last_active":"2024-09-12T01:44:35.574004+0000","last_peered":"2024-09-12T01:44:35.574004+0000","last_clean":"2024-09-12T01:44:35.574004+0000","last_became_active":"2024-09-12T01:44:34.568844+0000","last_became_peered":"2024-09-12T01:44:34.568844+0000","last_unstale":"2024-09-12T01:44:35.574004+0000","last_undegraded":"2024-09-12T01:44:35.574004+0000","last_fullsized":"2024-09-12T01:44:35.574004+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:33.785177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573911+0000","last_change":"2024-09-12T01:44:34.568333+0000","last_active":"2024-09-12T01:44:35.573911+0000","last_peered":"2024-09-12T01:44:35.573911+0000","last_clean":"2024-09-12T01:44:35.573911+0000","last_became_active":"2024-09-12T01:44:34.566942+0000","last_became_peered":"2024-09-12T01:44:34.566942+0000","last_unstale":"2024-09-12T01:44:35.573911+0000","last_undegraded":"2024-09-12T01:44:35.573911+0000","last_fullsized":"2024-09-12T01:44:35.573911+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:59.446473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573434+0000","last_change":"2024-09-12T01:44:34.574892+0000","last_active":"2024-09-12T01:44:35.573434+0000","last_peered":"2024-09-12T01:44:35.573434+0000","last_clean":"2024-09-12T01:44:35.573434+0000","last_became_active":"2024-09-12T01:44:34.574240+0000","last_became_peered":"2024-09-12T01:44:34.574240+0000","last_unstale":"2024-09-12T01:44:35.573434+0000","last_undegraded":"2024-09-12T01:44:35.573434+0000","last_fullsized":"2024-09-12T01:44:35.573434+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:03.484850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573730+0000","last_change":"2024-09-12T01:44:34.578283+0000","last_active":"2024-09-12T01:44:35.573730+0000","last_peered":"2024-09-12T01:44:35.573730+0000","last_clean":"2024-09-12T01:44:35.573730+0000","last_became_active":"2024-09-12T01:44:34.578019+0000","last_became_peered":"2024-09-12T01:44:34.578019+0000","last_unstale":"2024-09-12T01:44:35.573730+0000","last_undegraded":"2024-09-12T01:44:35.573730+0000","last_fullsized":"2024-09-12T01:44:35.573730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:19.132628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574318+0000","last_change":"2024-09-12T01:44:34.577407+0000","last_active":"2024-09-12T01:44:35.574318+0000","last_peered":"2024-09-12T01:44:35.574318+0000","last_clean":"2024-09-12T01:44:35.574318+0000","last_became_active":"2024-09-12T01:44:34.571477+0000","last_became_peered":"2024-09-12T01:44:34.571477+0000","last_unstale":"2024-09-12T01:44:35.574318+0000","last_undegraded":"2024-09-12T01:44:35.574318+0000","last_fullsized":"2024-09-12T01:44:35.574318+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:03.884787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573865+0000","last_change":"2024-09-12T01:44:34.579449+0000","last_active":"2024-09-12T01:44:35.573865+0000","last_peered":"2024-09-12T01:44:35.573865+0000","last_clean":"2024-09-12T01:44:35.573865+0000","last_became_active":"2024-09-12T01:44:34.579170+0000","last_became_peered":"2024-09-12T01:44:34.579170+0000","last_unstale":"2024-09-12T01:44:35.573865+0000","last_undegraded":"2024-09-12T01:44:35.573865+0000","last_fullsized":"2024-09-12T01:44:35.573865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:53.515628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583215+0000","last_change":"2024-09-12T01:44:34.580740+0000","last_active":"2024-09-12T01:44:34.583215+0000","last_peered":"2024-09-12T01:44:34.583215+0000","last_clean":"2024-09-12T01:44:34.583215+0000","last_became_active":"2024-09-12T01:44:34.580371+0000","last_became_peered":"2024-09-12T01:44:34.580371+0000","last_unstale":"2024-09-12T01:44:34.583215+0000","last_undegraded":"2024-09-12T01:44:34.583215+0000","last_fullsized":"2024-09-12T01:44:34.583215+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.079241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576943+0000","last_change":"2024-09-12T01:44:34.567435+0000","last_active":"2024-09-12T01:44:35.576943+0000","last_peered":"2024-09-12T01:44:35.576943+0000","last_clean":"2024-09-12T01:44:35.576943+0000","last_became_active":"2024-09-12T01:44:34.567107+0000","last_became_peered":"2024-09-12T01:44:34.567107+0000","last_unstale":"2024-09-12T01:44:35.576943+0000","last_undegraded":"2024-09-12T01:44:35.576943+0000","last_fullsized":"2024-09-12T01:44:35.576943+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:36.649302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.581883+0000","last_change":"2024-09-12T01:44:34.580274+0000","last_active":"2024-09-12T01:44:34.581883+0000","last_peered":"2024-09-12T01:44:34.581883+0000","last_clean":"2024-09-12T01:44:34.581883+0000","last_became_active":"2024-09-12T01:44:34.579917+0000","last_became_peered":"2024-09-12T01:44:34.579917+0000","last_unstale":"2024-09-12T01:44:34.581883+0000","last_undegraded":"2024-09-12T01:44:34.581883+0000","last_fullsized":"2024-09-12T01:44:34.581883+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.768947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576831+0000","last_change":"2024-09-12T01:44:34.577332+0000","last_active":"2024-09-12T01:44:35.576831+0000","last_peered":"2024-09-12T01:44:35.576831+0000","last_clean":"2024-09-12T01:44:35.576831+0000","last_became_active":"2024-09-12T01:44:34.576807+0000","last_became_peered":"2024-09-12T01:44:34.576807+0000","last_unstale":"2024-09-12T01:44:35.576831+0000","last_undegraded":"2024-09-12T01:44:35.576831+0000","last_fullsized":"2024-09-12T01:44:35.576831+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.911212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582646+0000","last_change":"2024-09-12T01:44:34.579014+0000","last_active":"2024-09-12T01:44:34.582646+0000","last_peered":"2024-09-12T01:44:34.582646+0000","last_clean":"2024-09-12T01:44:34.582646+0000","last_became_active":"2024-09-12T01:44:34.577666+0000","last_became_peered":"2024-09-12T01:44:34.577666+0000","last_unstale":"2024-09-12T01:44:34.582646+0000","last_undegraded":"2024-09-12T01:44:34.582646+0000","last_fullsized":"2024-09-12T01:44:34.582646+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:33.785177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.557343+0000","last_change":"2024-09-12T01:44:33.557343+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.557343+0000","last_undegraded":"2024-09-12T01:44:33.557343+0000","last_fullsized":"2024-09-12T01:44:33.557343+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"138'4","reported_seq":18,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577263+0000","last_change":"2024-09-12T01:44:33.562262+0000","last_active":"2024-09-12T01:44:35.577263+0000","last_peered":"2024-09-12T01:44:35.577263+0000","last_clean":"2024-09-12T01:44:35.577263+0000","last_became_active":"2024-09-12T01:44:33.561973+0000","last_became_peered":"2024-09-12T01:44:33.561973+0000","last_unstale":"2024-09-12T01:44:35.577263+0000","last_undegraded":"2024-09-12T01:44:35.577263+0000","last_fullsized":"2024-09-12T01:44:35.577263+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:50.459258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577264+0000","last_change":"2024-09-12T01:44:34.572331+0000","last_active":"2024-09-12T01:44:35.577264+0000","last_peered":"2024-09-12T01:44:35.577264+0000","last_clean":"2024-09-12T01:44:35.577264+0000","last_became_active":"2024-09-12T01:44:34.572042+0000","last_became_peered":"2024-09-12T01:44:34.572042+0000","last_unstale":"2024-09-12T01:44:35.577264+0000","last_undegraded":"2024-09-12T01:44:35.577264+0000","last_fullsized":"2024-09-12T01:44:35.577264+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:15.763728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"138'1","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592860+0000","last_change":"2024-09-12T01:44:33.571315+0000","last_active":"2024-09-12T01:44:34.592860+0000","last_peered":"2024-09-12T01:44:34.592860+0000","last_clean":"2024-09-12T01:44:34.592860+0000","last_became_active":"2024-09-12T01:44:33.570791+0000","last_became_peered":"2024-09-12T01:44:33.570791+0000","last_unstale":"2024-09-12T01:44:34.592860+0000","last_undegraded":"2024-09-12T01:44:34.592860+0000","last_fullsized":"2024-09-12T01:44:34.592860+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:15.839665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.579947+0000","last_change":"2024-09-12T01:44:34.578171+0000","last_active":"2024-09-12T01:44:34.579947+0000","last_peered":"2024-09-12T01:44:34.579947+0000","last_clean":"2024-09-12T01:44:34.579947+0000","last_became_active":"2024-09-12T01:44:34.577874+0000","last_became_peered":"2024-09-12T01:44:34.577874+0000","last_unstale":"2024-09-12T01:44:34.579947+0000","last_undegraded":"2024-09-12T01:44:34.579947+0000","last_fullsized":"2024-09-12T01:44:34.579947+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:58.704148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590018+0000","last_change":"2024-09-12T01:44:33.564326+0000","last_active":"2024-09-12T01:44:34.590018+0000","last_peered":"2024-09-12T01:44:34.590018+0000","last_clean":"2024-09-12T01:44:34.590018+0000","last_became_active":"2024-09-12T01:44:33.564082+0000","last_became_peered":"2024-09-12T01:44:33.564082+0000","last_unstale":"2024-09-12T01:44:34.590018+0000","last_undegraded":"2024-09-12T01:44:34.590018+0000","last_fullsized":"2024-09-12T01:44:34.590018+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:24.184840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593488+0000","last_change":"2024-09-12T01:44:34.590779+0000","last_active":"2024-09-12T01:44:34.593488+0000","last_peered":"2024-09-12T01:44:34.593488+0000","last_clean":"2024-09-12T01:44:34.593488+0000","last_became_active":"2024-09-12T01:44:34.590440+0000","last_became_peered":"2024-09-12T01:44:34.590440+0000","last_unstale":"2024-09-12T01:44:34.593488+0000","last_undegraded":"2024-09-12T01:44:34.593488+0000","last_fullsized":"2024-09-12T01:44:34.593488+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:06.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573976+0000","last_change":"2024-09-12T01:44:33.562995+0000","last_active":"2024-09-12T01:44:35.573976+0000","last_peered":"2024-09-12T01:44:35.573976+0000","last_clean":"2024-09-12T01:44:35.573976+0000","last_became_active":"2024-09-12T01:44:33.562650+0000","last_became_peered":"2024-09-12T01:44:33.562650+0000","last_unstale":"2024-09-12T01:44:35.573976+0000","last_undegraded":"2024-09-12T01:44:35.573976+0000","last_fullsized":"2024-09-12T01:44:35.573976+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560028+0000","last_change":"2024-09-12T01:44:33.560028+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560028+0000","last_undegraded":"2024-09-12T01:44:33.560028+0000","last_fullsized":"2024-09-12T01:44:33.560028+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577066+0000","last_change":"2024-09-12T01:44:33.571205+0000","last_active":"2024-09-12T01:44:35.577066+0000","last_peered":"2024-09-12T01:44:35.577066+0000","last_clean":"2024-09-12T01:44:35.577066+0000","last_became_active":"2024-09-12T01:44:33.570909+0000","last_became_peered":"2024-09-12T01:44:33.570909+0000","last_unstale":"2024-09-12T01:44:35.577066+0000","last_undegraded":"2024-09-12T01:44:35.577066+0000","last_fullsized":"2024-09-12T01:44:35.577066+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:05.134312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582675+0000","last_change":"2024-09-12T01:44:34.578688+0000","last_active":"2024-09-12T01:44:34.582675+0000","last_peered":"2024-09-12T01:44:34.582675+0000","last_clean":"2024-09-12T01:44:34.582675+0000","last_became_active":"2024-09-12T01:44:34.578415+0000","last_became_peered":"2024-09-12T01:44:34.578415+0000","last_unstale":"2024-09-12T01:44:34.582675+0000","last_undegraded":"2024-09-12T01:44:34.582675+0000","last_fullsized":"2024-09-12T01:44:34.582675+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:53.515628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-12T01:44:33.570379+0000","last_change":"2024-09-12T01:44:33.569461+0000","last_active":"2024-09-12T01:44:33.570379+0000","last_peered":"2024-09-12T01:44:33.570379+0000","last_clean":"2024-09-12T01:44:33.570379+0000","last_became_active":"2024-09-12T01:44:33.569155+0000","last_became_peered":"2024-09-12T01:44:33.569155+0000","last_unstale":"2024-09-12T01:44:33.570379+0000","last_undegraded":"2024-09-12T01:44:33.570379+0000","last_fullsized":"2024-09-12T01:44:33.570379+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:21.354429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573629+0000","last_change":"2024-09-12T01:44:34.569126+0000","last_active":"2024-09-12T01:44:35.573629+0000","last_peered":"2024-09-12T01:44:35.573629+0000","last_clean":"2024-09-12T01:44:35.573629+0000","last_became_active":"2024-09-12T01:44:34.568830+0000","last_became_peered":"2024-09-12T01:44:34.568830+0000","last_unstale":"2024-09-12T01:44:35.573629+0000","last_undegraded":"2024-09-12T01:44:35.573629+0000","last_fullsized":"2024-09-12T01:44:35.573629+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:18.088120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576891+0000","last_change":"2024-09-12T01:44:33.569947+0000","last_active":"2024-09-12T01:44:35.576891+0000","last_peered":"2024-09-12T01:44:35.576891+0000","last_clean":"2024-09-12T01:44:35.576891+0000","last_became_active":"2024-09-12T01:44:33.569378+0000","last_became_peered":"2024-09-12T01:44:33.569378+0000","last_unstale":"2024-09-12T01:44:35.576891+0000","last_undegraded":"2024-09-12T01:44:35.576891+0000","last_fullsized":"2024-09-12T01:44:35.576891+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:21.653578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560355+0000","last_change":"2024-09-12T01:44:33.560355+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560355+0000","last_undegraded":"2024-09-12T01:44:33.560355+0000","last_fullsized":"2024-09-12T01:44:33.560355+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573874+0000","last_change":"2024-09-12T01:44:33.566465+0000","last_active":"2024-09-12T01:44:35.573874+0000","last_peered":"2024-09-12T01:44:35.573874+0000","last_clean":"2024-09-12T01:44:35.573874+0000","last_became_active":"2024-09-12T01:44:33.566147+0000","last_became_peered":"2024-09-12T01:44:33.566147+0000","last_unstale":"2024-09-12T01:44:35.573874+0000","last_undegraded":"2024-09-12T01:44:35.573874+0000","last_fullsized":"2024-09-12T01:44:35.573874+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:42.446369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.588131+0000","last_change":"2024-09-12T01:44:34.583987+0000","last_active":"2024-09-12T01:44:34.588131+0000","last_peered":"2024-09-12T01:44:34.588131+0000","last_clean":"2024-09-12T01:44:34.588131+0000","last_became_active":"2024-09-12T01:44:34.583670+0000","last_became_peered":"2024-09-12T01:44:34.583670+0000","last_unstale":"2024-09-12T01:44:34.588131+0000","last_undegraded":"2024-09-12T01:44:34.588131+0000","last_fullsized":"2024-09-12T01:44:34.588131+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:23.984044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.572301+0000","last_change":"2024-09-12T01:44:33.568793+0000","last_active":"2024-09-12T01:44:34.572301+0000","last_peered":"2024-09-12T01:44:34.572301+0000","last_clean":"2024-09-12T01:44:34.572301+0000","last_became_active":"2024-09-12T01:44:33.568545+0000","last_became_peered":"2024-09-12T01:44:33.568545+0000","last_unstale":"2024-09-12T01:44:34.572301+0000","last_undegraded":"2024-09-12T01:44:34.572301+0000","last_fullsized":"2024-09-12T01:44:34.572301+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:02.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590661+0000","last_change":"2024-09-12T01:44:34.584292+0000","last_active":"2024-09-12T01:44:34.590661+0000","last_peered":"2024-09-12T01:44:34.590661+0000","last_clean":"2024-09-12T01:44:34.590661+0000","last_became_active":"2024-09-12T01:44:34.583648+0000","last_became_peered":"2024-09-12T01:44:34.583648+0000","last_unstale":"2024-09-12T01:44:34.590661+0000","last_undegraded":"2024-09-12T01:44:34.590661+0000","last_fullsized":"2024-09-12T01:44:34.590661+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:01.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"138'3","reported_seq":17,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574365+0000","last_change":"2024-09-12T01:44:33.561874+0000","last_active":"2024-09-12T01:44:35.574365+0000","last_peered":"2024-09-12T01:44:35.574365+0000","last_clean":"2024-09-12T01:44:35.574365+0000","last_became_active":"2024-09-12T01:44:33.561180+0000","last_became_peered":"2024-09-12T01:44:33.561180+0000","last_unstale":"2024-09-12T01:44:35.574365+0000","last_undegraded":"2024-09-12T01:44:35.574365+0000","last_fullsized":"2024-09-12T01:44:35.574365+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.801449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577045+0000","last_change":"2024-09-12T01:44:34.570692+0000","last_active":"2024-09-12T01:44:35.577045+0000","last_peered":"2024-09-12T01:44:35.577045+0000","last_clean":"2024-09-12T01:44:35.577045+0000","last_became_active":"2024-09-12T01:44:34.570372+0000","last_became_peered":"2024-09-12T01:44:34.570372+0000","last_unstale":"2024-09-12T01:44:35.577045+0000","last_undegraded":"2024-09-12T01:44:35.577045+0000","last_fullsized":"2024-09-12T01:44:35.577045+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:06.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"138'6","reported_seq":20,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574109+0000","last_change":"2024-09-12T01:44:33.561870+0000","last_active":"2024-09-12T01:44:35.574109+0000","last_peered":"2024-09-12T01:44:35.574109+0000","last_clean":"2024-09-12T01:44:35.574109+0000","last_became_active":"2024-09-12T01:44:33.561575+0000","last_became_peered":"2024-09-12T01:44:33.561575+0000","last_unstale":"2024-09-12T01:44:35.574109+0000","last_undegraded":"2024-09-12T01:44:35.574109+0000","last_fullsized":"2024-09-12T01:44:35.574109+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:28.447167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583184+0000","last_change":"2024-09-12T01:44:34.580219+0000","last_active":"2024-09-12T01:44:34.583184+0000","last_peered":"2024-09-12T01:44:34.583184+0000","last_clean":"2024-09-12T01:44:34.583184+0000","last_became_active":"2024-09-12T01:44:34.579863+0000","last_became_peered":"2024-09-12T01:44:34.579863+0000","last_unstale":"2024-09-12T01:44:34.583184+0000","last_undegraded":"2024-09-12T01:44:34.583184+0000","last_fullsized":"2024-09-12T01:44:34.583184+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:39.869863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-12T01:44:33.567606+0000","last_change":"2024-09-12T01:44:33.566891+0000","last_active":"2024-09-12T01:44:33.567606+0000","last_peered":"2024-09-12T01:44:33.567606+0000","last_clean":"2024-09-12T01:44:33.567606+0000","last_became_active":"2024-09-12T01:44:33.566599+0000","last_became_peered":"2024-09-12T01:44:33.566599+0000","last_unstale":"2024-09-12T01:44:33.567606+0000","last_undegraded":"2024-09-12T01:44:33.567606+0000","last_fullsized":"2024-09-12T01:44:33.567606+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:43.374724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574087+0000","last_change":"2024-09-12T01:44:34.582387+0000","last_active":"2024-09-12T01:44:35.574087+0000","last_peered":"2024-09-12T01:44:35.574087+0000","last_clean":"2024-09-12T01:44:35.574087+0000","last_became_active":"2024-09-12T01:44:34.582096+0000","last_became_peered":"2024-09-12T01:44:34.582096+0000","last_unstale":"2024-09-12T01:44:35.574087+0000","last_undegraded":"2024-09-12T01:44:35.574087+0000","last_fullsized":"2024-09-12T01:44:35.574087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:51.107638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.573223+0000","last_change":"2024-09-12T01:44:33.558602+0000","last_active":"2024-09-12T01:44:34.573223+0000","last_peered":"2024-09-12T01:44:34.573223+0000","last_clean":"2024-09-12T01:44:34.573223+0000","last_became_active":"2024-09-12T01:44:33.558246+0000","last_became_peered":"2024-09-12T01:44:33.558246+0000","last_unstale":"2024-09-12T01:44:34.573223+0000","last_undegraded":"2024-09-12T01:44:34.573223+0000","last_fullsized":"2024-09-12T01:44:34.573223+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:18.127850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586616+0000","last_change":"2024-09-12T01:44:34.579825+0000","last_active":"2024-09-12T01:44:34.586616+0000","last_peered":"2024-09-12T01:44:34.586616+0000","last_clean":"2024-09-12T01:44:34.586616+0000","last_became_active":"2024-09-12T01:44:34.579565+0000","last_became_peered":"2024-09-12T01:44:34.579565+0000","last_unstale":"2024-09-12T01:44:34.586616+0000","last_undegraded":"2024-09-12T01:44:34.586616+0000","last_fullsized":"2024-09-12T01:44:34.586616+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:58.038820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.569789+0000","last_change":"2024-09-12T01:44:33.565496+0000","last_active":"2024-09-12T01:44:34.569789+0000","last_peered":"2024-09-12T01:44:34.569789+0000","last_clean":"2024-09-12T01:44:34.569789+0000","last_became_active":"2024-09-12T01:44:33.565197+0000","last_became_peered":"2024-09-12T01:44:33.565197+0000","last_unstale":"2024-09-12T01:44:34.569789+0000","last_undegraded":"2024-09-12T01:44:34.569789+0000","last_fullsized":"2024-09-12T01:44:34.569789+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582599+0000","last_change":"2024-09-12T01:44:34.580307+0000","last_active":"2024-09-12T01:44:34.582599+0000","last_peered":"2024-09-12T01:44:34.582599+0000","last_clean":"2024-09-12T01:44:34.582599+0000","last_became_active":"2024-09-12T01:44:34.579921+0000","last_became_peered":"2024-09-12T01:44:34.579921+0000","last_unstale":"2024-09-12T01:44:34.582599+0000","last_undegraded":"2024-09-12T01:44:34.582599+0000","last_fullsized":"2024-09-12T01:44:34.582599+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:41.766067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"138'8","reported_seq":22,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574137+0000","last_change":"2024-09-12T01:44:33.558236+0000","last_active":"2024-09-12T01:44:35.574137+0000","last_peered":"2024-09-12T01:44:35.574137+0000","last_clean":"2024-09-12T01:44:35.574137+0000","last_became_active":"2024-09-12T01:44:33.557953+0000","last_became_peered":"2024-09-12T01:44:33.557953+0000","last_unstale":"2024-09-12T01:44:35.574137+0000","last_undegraded":"2024-09-12T01:44:35.574137+0000","last_fullsized":"2024-09-12T01:44:35.574137+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:12.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590830+0000","last_change":"2024-09-12T01:44:34.589581+0000","last_active":"2024-09-12T01:44:34.590830+0000","last_peered":"2024-09-12T01:44:34.590830+0000","last_clean":"2024-09-12T01:44:34.590830+0000","last_became_active":"2024-09-12T01:44:34.589048+0000","last_became_peered":"2024-09-12T01:44:34.589048+0000","last_unstale":"2024-09-12T01:44:34.590830+0000","last_undegraded":"2024-09-12T01:44:34.590830+0000","last_fullsized":"2024-09-12T01:44:34.590830+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:25.732831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573933+0000","last_change":"2024-09-12T01:44:33.557600+0000","last_active":"2024-09-12T01:44:35.573933+0000","last_peered":"2024-09-12T01:44:35.573933+0000","last_clean":"2024-09-12T01:44:35.573933+0000","last_became_active":"2024-09-12T01:44:33.557317+0000","last_became_peered":"2024-09-12T01:44:33.557317+0000","last_unstale":"2024-09-12T01:44:35.573933+0000","last_undegraded":"2024-09-12T01:44:35.573933+0000","last_fullsized":"2024-09-12T01:44:35.573933+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:34.330164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560947+0000","last_change":"2024-09-12T01:44:33.560947+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560947+0000","last_undegraded":"2024-09-12T01:44:33.560947+0000","last_fullsized":"2024-09-12T01:44:33.560947+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.596296+0000","last_change":"2024-09-12T01:44:33.570978+0000","last_active":"2024-09-12T01:44:34.596296+0000","last_peered":"2024-09-12T01:44:34.596296+0000","last_clean":"2024-09-12T01:44:34.596296+0000","last_became_active":"2024-09-12T01:44:33.570604+0000","last_became_peered":"2024-09-12T01:44:33.570604+0000","last_unstale":"2024-09-12T01:44:34.596296+0000","last_undegraded":"2024-09-12T01:44:34.596296+0000","last_fullsized":"2024-09-12T01:44:34.596296+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:08.714197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560122+0000","last_change":"2024-09-12T01:44:33.560122+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560122+0000","last_undegraded":"2024-09-12T01:44:33.560122+0000","last_fullsized":"2024-09-12T01:44:33.560122+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574107+0000","last_change":"2024-09-12T01:44:33.564371+0000","last_active":"2024-09-12T01:44:35.574107+0000","last_peered":"2024-09-12T01:44:35.574107+0000","last_clean":"2024-09-12T01:44:35.574107+0000","last_became_active":"2024-09-12T01:44:33.564044+0000","last_became_peered":"2024-09-12T01:44:33.564044+0000","last_unstale":"2024-09-12T01:44:35.574107+0000","last_undegraded":"2024-09-12T01:44:35.574107+0000","last_fullsized":"2024-09-12T01:44:35.574107+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:57.461543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574320+0000","last_change":"2024-09-12T01:44:34.577881+0000","last_active":"2024-09-12T01:44:35.574320+0000","last_peered":"2024-09-12T01:44:35.574320+0000","last_clean":"2024-09-12T01:44:35.574320+0000","last_became_active":"2024-09-12T01:44:34.571399+0000","last_became_peered":"2024-09-12T01:44:34.571399+0000","last_unstale":"2024-09-12T01:44:35.574320+0000","last_undegraded":"2024-09-12T01:44:35.574320+0000","last_fullsized":"2024-09-12T01:44:35.574320+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:36.649302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573487+0000","last_change":"2024-09-12T01:44:33.563195+0000","last_active":"2024-09-12T01:44:35.573487+0000","last_peered":"2024-09-12T01:44:35.573487+0000","last_clean":"2024-09-12T01:44:35.573487+0000","last_became_active":"2024-09-12T01:44:33.562898+0000","last_became_peered":"2024-09-12T01:44:33.562898+0000","last_unstale":"2024-09-12T01:44:35.573487+0000","last_undegraded":"2024-09-12T01:44:35.573487+0000","last_fullsized":"2024-09-12T01:44:35.573487+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:59.939596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576984+0000","last_change":"2024-09-12T01:44:34.576473+0000","last_active":"2024-09-12T01:44:35.576984+0000","last_peered":"2024-09-12T01:44:35.576984+0000","last_clean":"2024-09-12T01:44:35.576984+0000","last_became_active":"2024-09-12T01:44:34.576143+0000","last_became_peered":"2024-09-12T01:44:34.576143+0000","last_unstale":"2024-09-12T01:44:35.576984+0000","last_undegraded":"2024-09-12T01:44:35.576984+0000","last_fullsized":"2024-09-12T01:44:35.576984+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:29.139125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574252+0000","last_change":"2024-09-12T01:44:33.555265+0000","last_active":"2024-09-12T01:44:35.574252+0000","last_peered":"2024-09-12T01:44:35.574252+0000","last_clean":"2024-09-12T01:44:35.574252+0000","last_became_active":"2024-09-12T01:44:33.554630+0000","last_became_peered":"2024-09-12T01:44:33.554630+0000","last_unstale":"2024-09-12T01:44:35.574252+0000","last_undegraded":"2024-09-12T01:44:35.574252+0000","last_fullsized":"2024-09-12T01:44:35.574252+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:53.277135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574227+0000","last_change":"2024-09-12T01:44:34.580476+0000","last_active":"2024-09-12T01:44:35.574227+0000","last_peered":"2024-09-12T01:44:35.574227+0000","last_clean":"2024-09-12T01:44:35.574227+0000","last_became_active":"2024-09-12T01:44:34.579803+0000","last_became_peered":"2024-09-12T01:44:34.579803+0000","last_unstale":"2024-09-12T01:44:35.574227+0000","last_undegraded":"2024-09-12T01:44:35.574227+0000","last_fullsized":"2024-09-12T01:44:35.574227+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.911212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573217+0000","last_change":"2024-09-12T01:44:33.556147+0000","last_active":"2024-09-12T01:44:35.573217+0000","last_peered":"2024-09-12T01:44:35.573217+0000","last_clean":"2024-09-12T01:44:35.573217+0000","last_became_active":"2024-09-12T01:44:33.555852+0000","last_became_peered":"2024-09-12T01:44:33.555852+0000","last_unstale":"2024-09-12T01:44:35.573217+0000","last_undegraded":"2024-09-12T01:44:35.573217+0000","last_fullsized":"2024-09-12T01:44:35.573217+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:25.006137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576742+0000","last_change":"2024-09-12T01:44:34.579386+0000","last_active":"2024-09-12T01:44:35.576742+0000","last_peered":"2024-09-12T01:44:35.576742+0000","last_clean":"2024-09-12T01:44:35.576742+0000","last_became_active":"2024-09-12T01:44:34.579004+0000","last_became_peered":"2024-09-12T01:44:34.579004+0000","last_unstale":"2024-09-12T01:44:35.576742+0000","last_undegraded":"2024-09-12T01:44:35.576742+0000","last_fullsized":"2024-09-12T01:44:35.576742+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:59.446473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-12T01:44:33.570870+0000","last_change":"2024-09-12T01:44:33.570319+0000","last_active":"2024-09-12T01:44:33.570870+0000","last_peered":"2024-09-12T01:44:33.570870+0000","last_clean":"2024-09-12T01:44:33.570870+0000","last_became_active":"2024-09-12T01:44:33.570021+0000","last_became_peered":"2024-09-12T01:44:33.570021+0000","last_unstale":"2024-09-12T01:44:33.570870+0000","last_undegraded":"2024-09-12T01:44:33.570870+0000","last_fullsized":"2024-09-12T01:44:33.570870+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:51.216059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583126+0000","last_change":"2024-09-12T01:44:34.579335+0000","last_active":"2024-09-12T01:44:34.583126+0000","last_peered":"2024-09-12T01:44:34.583126+0000","last_clean":"2024-09-12T01:44:34.583126+0000","last_became_active":"2024-09-12T01:44:34.578948+0000","last_became_peered":"2024-09-12T01:44:34.578948+0000","last_unstale":"2024-09-12T01:44:34.583126+0000","last_undegraded":"2024-09-12T01:44:34.583126+0000","last_fullsized":"2024-09-12T01:44:34.583126+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:43.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573182+0000","last_change":"2024-09-12T01:44:33.562892+0000","last_active":"2024-09-12T01:44:35.573182+0000","last_peered":"2024-09-12T01:44:35.573182+0000","last_clean":"2024-09-12T01:44:35.573182+0000","last_became_active":"2024-09-12T01:44:33.562581+0000","last_became_peered":"2024-09-12T01:44:33.562581+0000","last_unstale":"2024-09-12T01:44:35.573182+0000","last_undegraded":"2024-09-12T01:44:35.573182+0000","last_fullsized":"2024-09-12T01:44:35.573182+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:36.009808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574480+0000","last_change":"2024-09-12T01:44:34.577117+0000","last_active":"2024-09-12T01:44:35.574480+0000","last_peered":"2024-09-12T01:44:35.574480+0000","last_clean":"2024-09-12T01:44:35.574480+0000","last_became_active":"2024-09-12T01:44:34.575726+0000","last_became_peered":"2024-09-12T01:44:34.575726+0000","last_unstale":"2024-09-12T01:44:35.574480+0000","last_undegraded":"2024-09-12T01:44:35.574480+0000","last_fullsized":"2024-09-12T01:44:35.574480+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:29.139125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.591091+0000","last_change":"2024-09-12T01:44:33.566034+0000","last_active":"2024-09-12T01:44:34.591091+0000","last_peered":"2024-09-12T01:44:34.591091+0000","last_clean":"2024-09-12T01:44:34.591091+0000","last_became_active":"2024-09-12T01:44:33.565748+0000","last_became_peered":"2024-09-12T01:44:33.565748+0000","last_unstale":"2024-09-12T01:44:34.591091+0000","last_undegraded":"2024-09-12T01:44:34.591091+0000","last_fullsized":"2024-09-12T01:44:34.591091+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:44.021918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560386+0000","last_change":"2024-09-12T01:44:33.560386+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560386+0000","last_undegraded":"2024-09-12T01:44:33.560386+0000","last_fullsized":"2024-09-12T01:44:33.560386+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"139'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576279+0000","last_change":"2024-09-12T01:44:33.568481+0000","last_active":"2024-09-12T01:44:35.576279+0000","last_peered":"2024-09-12T01:44:35.576279+0000","last_clean":"2024-09-12T01:44:35.576279+0000","last_became_active":"2024-09-12T01:44:33.568131+0000","last_became_peered":"2024-09-12T01:44:33.568131+0000","last_unstale":"2024-09-12T01:44:35.576279+0000","last_undegraded":"2024-09-12T01:44:35.576279+0000","last_fullsized":"2024-09-12T01:44:35.576279+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:06.349936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.558120+0000","last_change":"2024-09-12T01:44:33.558120+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.558120+0000","last_undegraded":"2024-09-12T01:44:33.558120+0000","last_fullsized":"2024-09-12T01:44:33.558120+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577169+0000","last_change":"2024-09-12T01:44:33.568264+0000","last_active":"2024-09-12T01:44:35.577169+0000","last_peered":"2024-09-12T01:44:35.577169+0000","last_clean":"2024-09-12T01:44:35.577169+0000","last_became_active":"2024-09-12T01:44:33.567714+0000","last_became_peered":"2024-09-12T01:44:33.567714+0000","last_unstale":"2024-09-12T01:44:35.577169+0000","last_undegraded":"2024-09-12T01:44:35.577169+0000","last_fullsized":"2024-09-12T01:44:35.577169+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.801449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560175+0000","last_change":"2024-09-12T01:44:33.560175+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560175+0000","last_undegraded":"2024-09-12T01:44:33.560175+0000","last_fullsized":"2024-09-12T01:44:33.560175+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574180+0000","last_change":"2024-09-12T01:44:33.553971+0000","last_active":"2024-09-12T01:44:35.574180+0000","last_peered":"2024-09-12T01:44:35.574180+0000","last_clean":"2024-09-12T01:44:35.574180+0000","last_became_active":"2024-09-12T01:44:33.553693+0000","last_became_peered":"2024-09-12T01:44:33.553693+0000","last_unstale":"2024-09-12T01:44:35.574180+0000","last_undegraded":"2024-09-12T01:44:35.574180+0000","last_fullsized":"2024-09-12T01:44:35.574180+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:05.134312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586642+0000","last_change":"2024-09-12T01:44:34.582051+0000","last_active":"2024-09-12T01:44:34.586642+0000","last_peered":"2024-09-12T01:44:34.586642+0000","last_clean":"2024-09-12T01:44:34.586642+0000","last_became_active":"2024-09-12T01:44:34.581751+0000","last_became_peered":"2024-09-12T01:44:34.581751+0000","last_unstale":"2024-09-12T01:44:34.586642+0000","last_undegraded":"2024-09-12T01:44:34.586642+0000","last_fullsized":"2024-09-12T01:44:34.586642+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:27.408256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574019+0000","last_change":"2024-09-12T01:44:33.566494+0000","last_active":"2024-09-12T01:44:35.574019+0000","last_peered":"2024-09-12T01:44:35.574019+0000","last_clean":"2024-09-12T01:44:35.574019+0000","last_became_active":"2024-09-12T01:44:33.566175+0000","last_became_peered":"2024-09-12T01:44:33.566175+0000","last_unstale":"2024-09-12T01:44:35.574019+0000","last_undegraded":"2024-09-12T01:44:35.574019+0000","last_fullsized":"2024-09-12T01:44:35.574019+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:10.376177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576904+0000","last_change":"2024-09-12T01:44:34.571445+0000","last_active":"2024-09-12T01:44:35.576904+0000","last_peered":"2024-09-12T01:44:35.576904+0000","last_clean":"2024-09-12T01:44:35.576904+0000","last_became_active":"2024-09-12T01:44:34.571128+0000","last_became_peered":"2024-09-12T01:44:34.571128+0000","last_unstale":"2024-09-12T01:44:35.576904+0000","last_undegraded":"2024-09-12T01:44:35.576904+0000","last_fullsized":"2024-09-12T01:44:35.576904+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:03.884787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.569409+0000","last_change":"2024-09-12T01:44:33.565610+0000","last_active":"2024-09-12T01:44:34.569409+0000","last_peered":"2024-09-12T01:44:34.569409+0000","last_clean":"2024-09-12T01:44:34.569409+0000","last_became_active":"2024-09-12T01:44:33.565331+0000","last_became_peered":"2024-09-12T01:44:33.565331+0000","last_unstale":"2024-09-12T01:44:34.569409+0000","last_undegraded":"2024-09-12T01:44:34.569409+0000","last_fullsized":"2024-09-12T01:44:34.569409+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:21.653578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.578023+0000","last_change":"2024-09-12T01:44:34.574761+0000","last_active":"2024-09-12T01:44:34.578023+0000","last_peered":"2024-09-12T01:44:34.578023+0000","last_clean":"2024-09-12T01:44:34.578023+0000","last_became_active":"2024-09-12T01:44:34.574471+0000","last_became_peered":"2024-09-12T01:44:34.574471+0000","last_unstale":"2024-09-12T01:44:34.578023+0000","last_undegraded":"2024-09-12T01:44:34.578023+0000","last_fullsized":"2024-09-12T01:44:34.578023+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.806227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577074+0000","last_change":"2024-09-12T01:44:33.569721+0000","last_active":"2024-09-12T01:44:35.577074+0000","last_peered":"2024-09-12T01:44:35.577074+0000","last_clean":"2024-09-12T01:44:35.577074+0000","last_became_active":"2024-09-12T01:44:33.569016+0000","last_became_peered":"2024-09-12T01:44:33.569016+0000","last_unstale":"2024-09-12T01:44:35.577074+0000","last_undegraded":"2024-09-12T01:44:35.577074+0000","last_fullsized":"2024-09-12T01:44:35.577074+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576770+0000","last_change":"2024-09-12T01:44:34.569764+0000","last_active":"2024-09-12T01:44:35.576770+0000","last_peered":"2024-09-12T01:44:35.576770+0000","last_clean":"2024-09-12T01:44:35.576770+0000","last_became_active":"2024-09-12T01:44:34.569409+0000","last_became_peered":"2024-09-12T01:44:34.569409+0000","last_unstale":"2024-09-12T01:44:35.576770+0000","last_undegraded":"2024-09-12T01:44:35.576770+0000","last_fullsized":"2024-09-12T01:44:35.576770+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:51.107638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576701+0000","last_change":"2024-09-12T01:44:33.567980+0000","last_active":"2024-09-12T01:44:35.576701+0000","last_peered":"2024-09-12T01:44:35.576701+0000","last_clean":"2024-09-12T01:44:35.576701+0000","last_became_active":"2024-09-12T01:44:33.567648+0000","last_became_peered":"2024-09-12T01:44:33.567648+0000","last_unstale":"2024-09-12T01:44:35.576701+0000","last_undegraded":"2024-09-12T01:44:35.576701+0000","last_fullsized":"2024-09-12T01:44:35.576701+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:40.761288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590655+0000","last_change":"2024-09-12T01:44:34.585187+0000","last_active":"2024-09-12T01:44:34.590655+0000","last_peered":"2024-09-12T01:44:34.590655+0000","last_clean":"2024-09-12T01:44:34.590655+0000","last_became_active":"2024-09-12T01:44:34.584915+0000","last_became_peered":"2024-09-12T01:44:34.584915+0000","last_unstale":"2024-09-12T01:44:34.590655+0000","last_undegraded":"2024-09-12T01:44:34.590655+0000","last_fullsized":"2024-09-12T01:44:34.590655+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:24.224542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573836+0000","last_change":"2024-09-12T01:44:33.567593+0000","last_active":"2024-09-12T01:44:35.573836+0000","last_peered":"2024-09-12T01:44:35.573836+0000","last_clean":"2024-09-12T01:44:35.573836+0000","last_became_active":"2024-09-12T01:44:33.566833+0000","last_became_peered":"2024-09-12T01:44:33.566833+0000","last_unstale":"2024-09-12T01:44:35.573836+0000","last_undegraded":"2024-09-12T01:44:35.573836+0000","last_fullsized":"2024-09-12T01:44:35.573836+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:56.207377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":389,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574004+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:44:35.574004+0000","last_peered":"2024-09-12T01:44:35.574004+0000","last_clean":"2024-09-12T01:44:35.574004+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:44:35.574004+0000","last_undegraded":"2024-09-12T01:44:35.574004+0000","last_fullsized":"2024-09-12T01:44:35.574004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509551,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1728512,"data_stored":740564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":1732608,"data_stored":740598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509549,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2330624,"data_stored":1331604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509549,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41216,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330624,"statfs":{"total":96636764160,"available":96594558976,"internally_reserved":0,"allocated":1744896,"data_stored":742198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509549,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37060,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334780,"statfs":{"total":96636764160,"available":96598814720,"internally_reserved":0,"allocated":1744896,"data_stored":747446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509549,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37644,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334196,"statfs":{"total":96636764160,"available":96598216704,"internally_reserved":0,"allocated":2347008,"data_stored":1332726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1732608,"data_stored":740634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32852,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338988,"statfs":{"total":96636764160,"available":96603123712,"internally_reserved":0,"allocated":1703936,"data_stored":727514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:44:37.906 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:44:38.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.043+0000 7fa45d2e6640 1 Processor -- start 2024-09-12T01:44:38.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.044+0000 7fa45d2e6640 1 -- start start 2024-09-12T01:44:38.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.044+0000 7fa45d2e6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa45815e7a0 0x7fa4580ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.044+0000 7fa45d2e6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa4580d3fe0 0x7fa4580d2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.045 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.044+0000 7fa45d2e6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4580d4430 con 0x7fa4580cf2f0 2024-09-12T01:44:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.044+0000 7fa45d2e6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa4580d2cc0 con 0x7fa45815e7a0 2024-09-12T01:44:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.044+0000 7fa45d2e6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa4580d2f40 con 0x7fa4580d3fe0 2024-09-12T01:44:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.044+0000 7fa456ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa45815e7a0 0x7fa4580ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.044+0000 7fa4577fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa4580cf2f0 0x7fa4580b7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54360/0 (socket says 172.21.15.60:54360) 2024-09-12T01:44:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.044+0000 7fa4577fe640 1 -- 172.21.15.60:0/2608926628 learned_addr learned my addr 172.21.15.60:0/2608926628 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.045+0000 7fa456ffd640 1 -- 172.21.15.60:0/2608926628 >> v2:172.21.15.105:3300/0 conn(0x7fa4580d3fe0 msgr2=0x7fa4580d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.045+0000 7fa456ffd640 1 --2- 172.21.15.60:0/2608926628 >> v2:172.21.15.105:3300/0 conn(0x7fa4580d3fe0 0x7fa4580d2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.045+0000 7fa456ffd640 1 -- 172.21.15.60:0/2608926628 >> v1:172.21.15.60:6789/0 conn(0x7fa4580cf2f0 legacy=0x7fa4580b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.045+0000 7fa456ffd640 1 -- 172.21.15.60:0/2608926628 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4580d3220 con 0x7fa45815e7a0 2024-09-12T01:44:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.045+0000 7fa455ffb640 1 -- 172.21.15.60:0/2608926628 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426768456 0 0) 0x7fa4580d4430 con 0x7fa4580cf2f0 2024-09-12T01:44:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.045+0000 7fa456ffd640 1 --2- 172.21.15.60:0/2608926628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa45815e7a0 0x7fa4580ba240 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fa45808dbd0 tx=0x7fa45002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a059db06553500d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.046+0000 7fa455ffb640 1 -- 172.21.15.60:0/2608926628 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450007740 con 0x7fa45815e7a0 2024-09-12T01:44:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.046+0000 7fa455ffb640 1 -- 172.21.15.60:0/2608926628 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4500078e0 con 0x7fa45815e7a0 2024-09-12T01:44:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.046+0000 7fa455ffb640 1 -- 172.21.15.60:0/2608926628 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450007cb0 con 0x7fa45815e7a0 2024-09-12T01:44:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.046+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2608926628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa45815e7a0 msgr2=0x7fa4580ba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.046+0000 7fa45d2e6640 1 --2- 172.21.15.60:0/2608926628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa45815e7a0 0x7fa4580ba240 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fa45808dbd0 tx=0x7fa45002a710 comp rx=0 tx=0).stop 2024-09-12T01:44:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.046+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2608926628 shutdown_connections 2024-09-12T01:44:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.046+0000 7fa45d2e6640 1 --2- 172.21.15.60:0/2608926628 >> v2:172.21.15.105:3300/0 conn(0x7fa4580d3fe0 0x7fa4580d2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.046+0000 7fa45d2e6640 1 --2- 172.21.15.60:0/2608926628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa45815e7a0 0x7fa4580ba240 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.046+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2608926628 >> 172.21.15.60:0/2608926628 conn(0x7fa4580d1550 msgr2=0x7fa4580d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.046+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2608926628 shutdown_connections 2024-09-12T01:44:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.046+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2608926628 wait complete. 2024-09-12T01:44:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.048+0000 7fa45d2e6640 1 Processor -- start 2024-09-12T01:44:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.048+0000 7fa45d2e6640 1 -- start start 2024-09-12T01:44:38.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.048+0000 7fa45d2e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4580cf2f0 0x7fa4580c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.048+0000 7fa45d2e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4580d3fe0 0x7fa4580c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.048+0000 7fa45d2e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45815e7a0 0x7fa458160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.048+0000 7fa45d2e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa4580d3ac0 con 0x7fa4580cf2f0 2024-09-12T01:44:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.048+0000 7fa45d2e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa4580d37e0 con 0x7fa45815e7a0 2024-09-12T01:44:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.048+0000 7fa45d2e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa45815eb80 con 0x7fa4580d3fe0 2024-09-12T01:44:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.048+0000 7fa456ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4580cf2f0 0x7fa4580c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.048+0000 7fa456ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4580cf2f0 0x7fa4580c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42794/0 (socket says 172.21.15.60:42794) 2024-09-12T01:44:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.048+0000 7fa456ffd640 1 -- 172.21.15.60:0/2145468808 learned_addr learned my addr 172.21.15.60:0/2145468808 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa4567fc640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4580d3fe0 0x7fa4580c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa4577fe640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45815e7a0 0x7fa458160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa456ffd640 1 -- 172.21.15.60:0/2145468808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4580d3fe0 msgr2=0x7fa4580c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa456ffd640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4580d3fe0 0x7fa4580c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa456ffd640 1 -- 172.21.15.60:0/2145468808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45815e7a0 msgr2=0x7fa458160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa456ffd640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45815e7a0 0x7fa458160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa456ffd640 1 -- 172.21.15.60:0/2145468808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa458160f10 con 0x7fa4580cf2f0 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa456ffd640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4580cf2f0 0x7fa4580c9870 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fa45002ad00 tx=0x7fa450004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa44f7fe640 1 -- 172.21.15.60:0/2145468808 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450040070 con 0x7fa4580cf2f0 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa44f7fe640 1 -- 172.21.15.60:0/2145468808 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa450031c40 con 0x7fa4580cf2f0 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2145468808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4581611f0 con 0x7fa4580cf2f0 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa44f7fe640 1 -- 172.21.15.60:0/2145468808 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45003c420 con 0x7fa4580cf2f0 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.049+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2145468808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4581617b0 con 0x7fa4580cf2f0 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.050+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2145468808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4580d2780 con 0x7fa4580cf2f0 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.051+0000 7fa44f7fe640 1 -- 172.21.15.60:0/2145468808 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa450039040 con 0x7fa4580cf2f0 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.051+0000 7fa44f7fe640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa43806be30 0x7fa43806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.051+0000 7fa44f7fe640 1 -- 172.21.15.60:0/2145468808 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fa4500ac460 con 0x7fa4580cf2f0 2024-09-12T01:44:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.051+0000 7fa4567fc640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa43806be30 0x7fa43806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.052+0000 7fa4567fc640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa43806be30 0x7fa43806e2f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa4580b9cb0 tx=0x7fa440008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.055+0000 7fa44f7fe640 1 -- 172.21.15.60:0/2145468808 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa45007af30 con 0x7fa4580cf2f0 2024-09-12T01:44:38.229 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.228+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2145468808 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa45806d450 con 0x7fa43806be30 2024-09-12T01:44:38.234 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.234+0000 7fa44f7fe640 1 -- 172.21.15.60:0/2145468808 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251623 (secure 0 0 0) 0x7fa45806d450 con 0x7fa43806be30 2024-09-12T01:44:38.237 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:38.239 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:44:38.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.237+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2145468808 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa43806be30 msgr2=0x7fa43806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.240 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.237+0000 7fa45d2e6640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa43806be30 0x7fa43806e2f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa4580b9cb0 tx=0x7fa440008040 comp rx=0 tx=0).stop 2024-09-12T01:44:38.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.237+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2145468808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4580cf2f0 msgr2=0x7fa4580c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.237+0000 7fa45d2e6640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4580cf2f0 0x7fa4580c9870 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fa45002ad00 tx=0x7fa450004a40 comp rx=0 tx=0).stop 2024-09-12T01:44:38.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.237+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2145468808 shutdown_connections 2024-09-12T01:44:38.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.237+0000 7fa45d2e6640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa45815e7a0 0x7fa458160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.237+0000 7fa45d2e6640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa43806be30 0x7fa43806e2f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.237+0000 7fa45d2e6640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa4580d3fe0 0x7fa4580c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.237+0000 7fa45d2e6640 1 --2- 172.21.15.60:0/2145468808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4580cf2f0 0x7fa4580c9870 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.237+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2145468808 >> 172.21.15.60:0/2145468808 conn(0x7fa4580d1550 msgr2=0x7fa4580b91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:38.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.237+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2145468808 shutdown_connections 2024-09-12T01:44:38.241 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.237+0000 7fa45d2e6640 1 -- 172.21.15.60:0/2145468808 wait complete. 2024-09-12T01:44:38.248 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":399,"stamp":"2024-09-12T01:44:36.376736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592744,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":293372,"kb_used_data":14712,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754681348,"statfs":{"total":773094113280,"available":772793700352,"internally_reserved":0,"allocated":15065088,"data_stored":7103284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000884"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577206+0000","last_change":"2024-09-12T01:44:34.578808+0000","last_active":"2024-09-12T01:44:35.577206+0000","last_peered":"2024-09-12T01:44:35.577206+0000","last_clean":"2024-09-12T01:44:35.577206+0000","last_became_active":"2024-09-12T01:44:34.578528+0000","last_became_peered":"2024-09-12T01:44:34.578528+0000","last_unstale":"2024-09-12T01:44:35.577206+0000","last_undegraded":"2024-09-12T01:44:35.577206+0000","last_fullsized":"2024-09-12T01:44:35.577206+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:04.653539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577100+0000","last_change":"2024-09-12T01:44:34.579190+0000","last_active":"2024-09-12T01:44:35.577100+0000","last_peered":"2024-09-12T01:44:35.577100+0000","last_clean":"2024-09-12T01:44:35.577100+0000","last_became_active":"2024-09-12T01:44:34.578880+0000","last_became_peered":"2024-09-12T01:44:34.578880+0000","last_unstale":"2024-09-12T01:44:35.577100+0000","last_undegraded":"2024-09-12T01:44:35.577100+0000","last_fullsized":"2024-09-12T01:44:35.577100+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:48.771413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577035+0000","last_change":"2024-09-12T01:44:34.568255+0000","last_active":"2024-09-12T01:44:35.577035+0000","last_peered":"2024-09-12T01:44:35.577035+0000","last_clean":"2024-09-12T01:44:35.577035+0000","last_became_active":"2024-09-12T01:44:34.567951+0000","last_became_peered":"2024-09-12T01:44:34.567951+0000","last_unstale":"2024-09-12T01:44:35.577035+0000","last_undegraded":"2024-09-12T01:44:35.577035+0000","last_fullsized":"2024-09-12T01:44:35.577035+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:06.315519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560664+0000","last_change":"2024-09-12T01:44:33.560664+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560664+0000","last_undegraded":"2024-09-12T01:44:33.560664+0000","last_fullsized":"2024-09-12T01:44:33.560664+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573865+0000","last_change":"2024-09-12T01:44:34.581929+0000","last_active":"2024-09-12T01:44:35.573865+0000","last_peered":"2024-09-12T01:44:35.573865+0000","last_clean":"2024-09-12T01:44:35.573865+0000","last_became_active":"2024-09-12T01:44:34.581430+0000","last_became_peered":"2024-09-12T01:44:34.581430+0000","last_unstale":"2024-09-12T01:44:35.573865+0000","last_undegraded":"2024-09-12T01:44:35.573865+0000","last_fullsized":"2024-09-12T01:44:35.573865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:58.704148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593245+0000","last_change":"2024-09-12T01:44:34.587092+0000","last_active":"2024-09-12T01:44:34.593245+0000","last_peered":"2024-09-12T01:44:34.593245+0000","last_clean":"2024-09-12T01:44:34.593245+0000","last_became_active":"2024-09-12T01:44:34.586801+0000","last_became_peered":"2024-09-12T01:44:34.586801+0000","last_unstale":"2024-09-12T01:44:34.593245+0000","last_undegraded":"2024-09-12T01:44:34.593245+0000","last_fullsized":"2024-09-12T01:44:34.593245+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:07.258321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583107+0000","last_change":"2024-09-12T01:44:34.579218+0000","last_active":"2024-09-12T01:44:34.583107+0000","last_peered":"2024-09-12T01:44:34.583107+0000","last_clean":"2024-09-12T01:44:34.583107+0000","last_became_active":"2024-09-12T01:44:34.578880+0000","last_became_peered":"2024-09-12T01:44:34.578880+0000","last_unstale":"2024-09-12T01:44:34.583107+0000","last_undegraded":"2024-09-12T01:44:34.583107+0000","last_fullsized":"2024-09-12T01:44:34.583107+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.281914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593466+0000","last_change":"2024-09-12T01:44:34.589398+0000","last_active":"2024-09-12T01:44:34.593466+0000","last_peered":"2024-09-12T01:44:34.593466+0000","last_clean":"2024-09-12T01:44:34.593466+0000","last_became_active":"2024-09-12T01:44:34.589132+0000","last_became_peered":"2024-09-12T01:44:34.589132+0000","last_unstale":"2024-09-12T01:44:34.593466+0000","last_undegraded":"2024-09-12T01:44:34.593466+0000","last_fullsized":"2024-09-12T01:44:34.593466+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.806227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583277+0000","last_change":"2024-09-12T01:44:34.582405+0000","last_active":"2024-09-12T01:44:34.583277+0000","last_peered":"2024-09-12T01:44:34.583277+0000","last_clean":"2024-09-12T01:44:34.583277+0000","last_became_active":"2024-09-12T01:44:34.582107+0000","last_became_peered":"2024-09-12T01:44:34.582107+0000","last_unstale":"2024-09-12T01:44:34.583277+0000","last_undegraded":"2024-09-12T01:44:34.583277+0000","last_fullsized":"2024-09-12T01:44:34.583277+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:51.464037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592952+0000","last_change":"2024-09-12T01:44:34.587622+0000","last_active":"2024-09-12T01:44:34.592952+0000","last_peered":"2024-09-12T01:44:34.592952+0000","last_clean":"2024-09-12T01:44:34.592952+0000","last_became_active":"2024-09-12T01:44:34.587309+0000","last_became_peered":"2024-09-12T01:44:34.587309+0000","last_unstale":"2024-09-12T01:44:34.592952+0000","last_undegraded":"2024-09-12T01:44:34.592952+0000","last_fullsized":"2024-09-12T01:44:34.592952+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:22.658357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573760+0000","last_change":"2024-09-12T01:44:34.581035+0000","last_active":"2024-09-12T01:44:35.573760+0000","last_peered":"2024-09-12T01:44:35.573760+0000","last_clean":"2024-09-12T01:44:35.573760+0000","last_became_active":"2024-09-12T01:44:34.580768+0000","last_became_peered":"2024-09-12T01:44:34.580768+0000","last_unstale":"2024-09-12T01:44:35.573760+0000","last_undegraded":"2024-09-12T01:44:35.573760+0000","last_fullsized":"2024-09-12T01:44:35.573760+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:14.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573365+0000","last_change":"2024-09-12T01:44:34.582605+0000","last_active":"2024-09-12T01:44:35.573365+0000","last_peered":"2024-09-12T01:44:35.573365+0000","last_clean":"2024-09-12T01:44:35.573365+0000","last_became_active":"2024-09-12T01:44:34.582322+0000","last_became_peered":"2024-09-12T01:44:34.582322+0000","last_unstale":"2024-09-12T01:44:35.573365+0000","last_undegraded":"2024-09-12T01:44:35.573365+0000","last_fullsized":"2024-09-12T01:44:35.573365+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:01.900564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573363+0000","last_change":"2024-09-12T01:44:34.587381+0000","last_active":"2024-09-12T01:44:35.573363+0000","last_peered":"2024-09-12T01:44:35.573363+0000","last_clean":"2024-09-12T01:44:35.573363+0000","last_became_active":"2024-09-12T01:44:34.586812+0000","last_became_peered":"2024-09-12T01:44:34.586812+0000","last_unstale":"2024-09-12T01:44:35.573363+0000","last_undegraded":"2024-09-12T01:44:35.573363+0000","last_fullsized":"2024-09-12T01:44:35.573363+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:11.765535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592991+0000","last_change":"2024-09-12T01:44:34.587979+0000","last_active":"2024-09-12T01:44:34.592991+0000","last_peered":"2024-09-12T01:44:34.592991+0000","last_clean":"2024-09-12T01:44:34.592991+0000","last_became_active":"2024-09-12T01:44:34.587628+0000","last_became_peered":"2024-09-12T01:44:34.587628+0000","last_unstale":"2024-09-12T01:44:34.592991+0000","last_undegraded":"2024-09-12T01:44:34.592991+0000","last_fullsized":"2024-09-12T01:44:34.592991+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:42.799915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593669+0000","last_change":"2024-09-12T01:44:34.591685+0000","last_active":"2024-09-12T01:44:34.593669+0000","last_peered":"2024-09-12T01:44:34.593669+0000","last_clean":"2024-09-12T01:44:34.593669+0000","last_became_active":"2024-09-12T01:44:34.591395+0000","last_became_peered":"2024-09-12T01:44:34.591395+0000","last_unstale":"2024-09-12T01:44:34.593669+0000","last_undegraded":"2024-09-12T01:44:34.593669+0000","last_fullsized":"2024-09-12T01:44:34.593669+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.281914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590619+0000","last_change":"2024-09-12T01:44:34.585126+0000","last_active":"2024-09-12T01:44:34.590619+0000","last_peered":"2024-09-12T01:44:34.590619+0000","last_clean":"2024-09-12T01:44:34.590619+0000","last_became_active":"2024-09-12T01:44:34.584665+0000","last_became_peered":"2024-09-12T01:44:34.584665+0000","last_unstale":"2024-09-12T01:44:34.590619+0000","last_undegraded":"2024-09-12T01:44:34.590619+0000","last_fullsized":"2024-09-12T01:44:34.590619+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:59.840812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586620+0000","last_change":"2024-09-12T01:44:34.581891+0000","last_active":"2024-09-12T01:44:34.586620+0000","last_peered":"2024-09-12T01:44:34.586620+0000","last_clean":"2024-09-12T01:44:34.586620+0000","last_became_active":"2024-09-12T01:44:34.581603+0000","last_became_peered":"2024-09-12T01:44:34.581603+0000","last_unstale":"2024-09-12T01:44:34.586620+0000","last_undegraded":"2024-09-12T01:44:34.586620+0000","last_fullsized":"2024-09-12T01:44:34.586620+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:32.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.557842+0000","last_change":"2024-09-12T01:44:33.557842+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.557842+0000","last_undegraded":"2024-09-12T01:44:33.557842+0000","last_fullsized":"2024-09-12T01:44:33.557842+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583062+0000","last_change":"2024-09-12T01:44:34.578536+0000","last_active":"2024-09-12T01:44:34.583062+0000","last_peered":"2024-09-12T01:44:34.583062+0000","last_clean":"2024-09-12T01:44:34.583062+0000","last_became_active":"2024-09-12T01:44:34.578194+0000","last_became_peered":"2024-09-12T01:44:34.578194+0000","last_unstale":"2024-09-12T01:44:34.583062+0000","last_undegraded":"2024-09-12T01:44:34.583062+0000","last_fullsized":"2024-09-12T01:44:34.583062+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:06.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573384+0000","last_change":"2024-09-12T01:44:34.574426+0000","last_active":"2024-09-12T01:44:35.573384+0000","last_peered":"2024-09-12T01:44:35.573384+0000","last_clean":"2024-09-12T01:44:35.573384+0000","last_became_active":"2024-09-12T01:44:34.574151+0000","last_became_peered":"2024-09-12T01:44:34.574151+0000","last_unstale":"2024-09-12T01:44:35.573384+0000","last_undegraded":"2024-09-12T01:44:35.573384+0000","last_fullsized":"2024-09-12T01:44:35.573384+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:11.234396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.581027+0000","last_change":"2024-09-12T01:44:34.578057+0000","last_active":"2024-09-12T01:44:34.581027+0000","last_peered":"2024-09-12T01:44:34.581027+0000","last_clean":"2024-09-12T01:44:34.581027+0000","last_became_active":"2024-09-12T01:44:34.577776+0000","last_became_peered":"2024-09-12T01:44:34.577776+0000","last_unstale":"2024-09-12T01:44:34.581027+0000","last_undegraded":"2024-09-12T01:44:34.581027+0000","last_fullsized":"2024-09-12T01:44:34.581027+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:14.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574004+0000","last_change":"2024-09-12T01:44:34.569162+0000","last_active":"2024-09-12T01:44:35.574004+0000","last_peered":"2024-09-12T01:44:35.574004+0000","last_clean":"2024-09-12T01:44:35.574004+0000","last_became_active":"2024-09-12T01:44:34.568844+0000","last_became_peered":"2024-09-12T01:44:34.568844+0000","last_unstale":"2024-09-12T01:44:35.574004+0000","last_undegraded":"2024-09-12T01:44:35.574004+0000","last_fullsized":"2024-09-12T01:44:35.574004+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:33.785177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573911+0000","last_change":"2024-09-12T01:44:34.568333+0000","last_active":"2024-09-12T01:44:35.573911+0000","last_peered":"2024-09-12T01:44:35.573911+0000","last_clean":"2024-09-12T01:44:35.573911+0000","last_became_active":"2024-09-12T01:44:34.566942+0000","last_became_peered":"2024-09-12T01:44:34.566942+0000","last_unstale":"2024-09-12T01:44:35.573911+0000","last_undegraded":"2024-09-12T01:44:35.573911+0000","last_fullsized":"2024-09-12T01:44:35.573911+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:59.446473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573434+0000","last_change":"2024-09-12T01:44:34.574892+0000","last_active":"2024-09-12T01:44:35.573434+0000","last_peered":"2024-09-12T01:44:35.573434+0000","last_clean":"2024-09-12T01:44:35.573434+0000","last_became_active":"2024-09-12T01:44:34.574240+0000","last_became_peered":"2024-09-12T01:44:34.574240+0000","last_unstale":"2024-09-12T01:44:35.573434+0000","last_undegraded":"2024-09-12T01:44:35.573434+0000","last_fullsized":"2024-09-12T01:44:35.573434+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:03.484850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573730+0000","last_change":"2024-09-12T01:44:34.578283+0000","last_active":"2024-09-12T01:44:35.573730+0000","last_peered":"2024-09-12T01:44:35.573730+0000","last_clean":"2024-09-12T01:44:35.573730+0000","last_became_active":"2024-09-12T01:44:34.578019+0000","last_became_peered":"2024-09-12T01:44:34.578019+0000","last_unstale":"2024-09-12T01:44:35.573730+0000","last_undegraded":"2024-09-12T01:44:35.573730+0000","last_fullsized":"2024-09-12T01:44:35.573730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:19.132628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574318+0000","last_change":"2024-09-12T01:44:34.577407+0000","last_active":"2024-09-12T01:44:35.574318+0000","last_peered":"2024-09-12T01:44:35.574318+0000","last_clean":"2024-09-12T01:44:35.574318+0000","last_became_active":"2024-09-12T01:44:34.571477+0000","last_became_peered":"2024-09-12T01:44:34.571477+0000","last_unstale":"2024-09-12T01:44:35.574318+0000","last_undegraded":"2024-09-12T01:44:35.574318+0000","last_fullsized":"2024-09-12T01:44:35.574318+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:03.884787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573865+0000","last_change":"2024-09-12T01:44:34.579449+0000","last_active":"2024-09-12T01:44:35.573865+0000","last_peered":"2024-09-12T01:44:35.573865+0000","last_clean":"2024-09-12T01:44:35.573865+0000","last_became_active":"2024-09-12T01:44:34.579170+0000","last_became_peered":"2024-09-12T01:44:34.579170+0000","last_unstale":"2024-09-12T01:44:35.573865+0000","last_undegraded":"2024-09-12T01:44:35.573865+0000","last_fullsized":"2024-09-12T01:44:35.573865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:53.515628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583215+0000","last_change":"2024-09-12T01:44:34.580740+0000","last_active":"2024-09-12T01:44:34.583215+0000","last_peered":"2024-09-12T01:44:34.583215+0000","last_clean":"2024-09-12T01:44:34.583215+0000","last_became_active":"2024-09-12T01:44:34.580371+0000","last_became_peered":"2024-09-12T01:44:34.580371+0000","last_unstale":"2024-09-12T01:44:34.583215+0000","last_undegraded":"2024-09-12T01:44:34.583215+0000","last_fullsized":"2024-09-12T01:44:34.583215+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.079241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576943+0000","last_change":"2024-09-12T01:44:34.567435+0000","last_active":"2024-09-12T01:44:35.576943+0000","last_peered":"2024-09-12T01:44:35.576943+0000","last_clean":"2024-09-12T01:44:35.576943+0000","last_became_active":"2024-09-12T01:44:34.567107+0000","last_became_peered":"2024-09-12T01:44:34.567107+0000","last_unstale":"2024-09-12T01:44:35.576943+0000","last_undegraded":"2024-09-12T01:44:35.576943+0000","last_fullsized":"2024-09-12T01:44:35.576943+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:36.649302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.581883+0000","last_change":"2024-09-12T01:44:34.580274+0000","last_active":"2024-09-12T01:44:34.581883+0000","last_peered":"2024-09-12T01:44:34.581883+0000","last_clean":"2024-09-12T01:44:34.581883+0000","last_became_active":"2024-09-12T01:44:34.579917+0000","last_became_peered":"2024-09-12T01:44:34.579917+0000","last_unstale":"2024-09-12T01:44:34.581883+0000","last_undegraded":"2024-09-12T01:44:34.581883+0000","last_fullsized":"2024-09-12T01:44:34.581883+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.768947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576831+0000","last_change":"2024-09-12T01:44:34.577332+0000","last_active":"2024-09-12T01:44:35.576831+0000","last_peered":"2024-09-12T01:44:35.576831+0000","last_clean":"2024-09-12T01:44:35.576831+0000","last_became_active":"2024-09-12T01:44:34.576807+0000","last_became_peered":"2024-09-12T01:44:34.576807+0000","last_unstale":"2024-09-12T01:44:35.576831+0000","last_undegraded":"2024-09-12T01:44:35.576831+0000","last_fullsized":"2024-09-12T01:44:35.576831+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.911212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582646+0000","last_change":"2024-09-12T01:44:34.579014+0000","last_active":"2024-09-12T01:44:34.582646+0000","last_peered":"2024-09-12T01:44:34.582646+0000","last_clean":"2024-09-12T01:44:34.582646+0000","last_became_active":"2024-09-12T01:44:34.577666+0000","last_became_peered":"2024-09-12T01:44:34.577666+0000","last_unstale":"2024-09-12T01:44:34.582646+0000","last_undegraded":"2024-09-12T01:44:34.582646+0000","last_fullsized":"2024-09-12T01:44:34.582646+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:33.785177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.557343+0000","last_change":"2024-09-12T01:44:33.557343+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.557343+0000","last_undegraded":"2024-09-12T01:44:33.557343+0000","last_fullsized":"2024-09-12T01:44:33.557343+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"138'4","reported_seq":18,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577263+0000","last_change":"2024-09-12T01:44:33.562262+0000","last_active":"2024-09-12T01:44:35.577263+0000","last_peered":"2024-09-12T01:44:35.577263+0000","last_clean":"2024-09-12T01:44:35.577263+0000","last_became_active":"2024-09-12T01:44:33.561973+0000","last_became_peered":"2024-09-12T01:44:33.561973+0000","last_unstale":"2024-09-12T01:44:35.577263+0000","last_undegraded":"2024-09-12T01:44:35.577263+0000","last_fullsized":"2024-09-12T01:44:35.577263+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:50.459258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577264+0000","last_change":"2024-09-12T01:44:34.572331+0000","last_active":"2024-09-12T01:44:35.577264+0000","last_peered":"2024-09-12T01:44:35.577264+0000","last_clean":"2024-09-12T01:44:35.577264+0000","last_became_active":"2024-09-12T01:44:34.572042+0000","last_became_peered":"2024-09-12T01:44:34.572042+0000","last_unstale":"2024-09-12T01:44:35.577264+0000","last_undegraded":"2024-09-12T01:44:35.577264+0000","last_fullsized":"2024-09-12T01:44:35.577264+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:15.763728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"138'1","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592860+0000","last_change":"2024-09-12T01:44:33.571315+0000","last_active":"2024-09-12T01:44:34.592860+0000","last_peered":"2024-09-12T01:44:34.592860+0000","last_clean":"2024-09-12T01:44:34.592860+0000","last_became_active":"2024-09-12T01:44:33.570791+0000","last_became_peered":"2024-09-12T01:44:33.570791+0000","last_unstale":"2024-09-12T01:44:34.592860+0000","last_undegraded":"2024-09-12T01:44:34.592860+0000","last_fullsized":"2024-09-12T01:44:34.592860+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:15.839665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.579947+0000","last_change":"2024-09-12T01:44:34.578171+0000","last_active":"2024-09-12T01:44:34.579947+0000","last_peered":"2024-09-12T01:44:34.579947+0000","last_clean":"2024-09-12T01:44:34.579947+0000","last_became_active":"2024-09-12T01:44:34.577874+0000","last_became_peered":"2024-09-12T01:44:34.577874+0000","last_unstale":"2024-09-12T01:44:34.579947+0000","last_undegraded":"2024-09-12T01:44:34.579947+0000","last_fullsized":"2024-09-12T01:44:34.579947+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:58.704148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590018+0000","last_change":"2024-09-12T01:44:33.564326+0000","last_active":"2024-09-12T01:44:34.590018+0000","last_peered":"2024-09-12T01:44:34.590018+0000","last_clean":"2024-09-12T01:44:34.590018+0000","last_became_active":"2024-09-12T01:44:33.564082+0000","last_became_peered":"2024-09-12T01:44:33.564082+0000","last_unstale":"2024-09-12T01:44:34.590018+0000","last_undegraded":"2024-09-12T01:44:34.590018+0000","last_fullsized":"2024-09-12T01:44:34.590018+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:24.184840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593488+0000","last_change":"2024-09-12T01:44:34.590779+0000","last_active":"2024-09-12T01:44:34.593488+0000","last_peered":"2024-09-12T01:44:34.593488+0000","last_clean":"2024-09-12T01:44:34.593488+0000","last_became_active":"2024-09-12T01:44:34.590440+0000","last_became_peered":"2024-09-12T01:44:34.590440+0000","last_unstale":"2024-09-12T01:44:34.593488+0000","last_undegraded":"2024-09-12T01:44:34.593488+0000","last_fullsized":"2024-09-12T01:44:34.593488+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:06.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573976+0000","last_change":"2024-09-12T01:44:33.562995+0000","last_active":"2024-09-12T01:44:35.573976+0000","last_peered":"2024-09-12T01:44:35.573976+0000","last_clean":"2024-09-12T01:44:35.573976+0000","last_became_active":"2024-09-12T01:44:33.562650+0000","last_became_peered":"2024-09-12T01:44:33.562650+0000","last_unstale":"2024-09-12T01:44:35.573976+0000","last_undegraded":"2024-09-12T01:44:35.573976+0000","last_fullsized":"2024-09-12T01:44:35.573976+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560028+0000","last_change":"2024-09-12T01:44:33.560028+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560028+0000","last_undegraded":"2024-09-12T01:44:33.560028+0000","last_fullsized":"2024-09-12T01:44:33.560028+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577066+0000","last_change":"2024-09-12T01:44:33.571205+0000","last_active":"2024-09-12T01:44:35.577066+0000","last_peered":"2024-09-12T01:44:35.577066+0000","last_clean":"2024-09-12T01:44:35.577066+0000","last_became_active":"2024-09-12T01:44:33.570909+0000","last_became_peered":"2024-09-12T01:44:33.570909+0000","last_unstale":"2024-09-12T01:44:35.577066+0000","last_undegraded":"2024-09-12T01:44:35.577066+0000","last_fullsized":"2024-09-12T01:44:35.577066+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:05.134312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582675+0000","last_change":"2024-09-12T01:44:34.578688+0000","last_active":"2024-09-12T01:44:34.582675+0000","last_peered":"2024-09-12T01:44:34.582675+0000","last_clean":"2024-09-12T01:44:34.582675+0000","last_became_active":"2024-09-12T01:44:34.578415+0000","last_became_peered":"2024-09-12T01:44:34.578415+0000","last_unstale":"2024-09-12T01:44:34.582675+0000","last_undegraded":"2024-09-12T01:44:34.582675+0000","last_fullsized":"2024-09-12T01:44:34.582675+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:53.515628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-12T01:44:33.570379+0000","last_change":"2024-09-12T01:44:33.569461+0000","last_active":"2024-09-12T01:44:33.570379+0000","last_peered":"2024-09-12T01:44:33.570379+0000","last_clean":"2024-09-12T01:44:33.570379+0000","last_became_active":"2024-09-12T01:44:33.569155+0000","last_became_peered":"2024-09-12T01:44:33.569155+0000","last_unstale":"2024-09-12T01:44:33.570379+0000","last_undegraded":"2024-09-12T01:44:33.570379+0000","last_fullsized":"2024-09-12T01:44:33.570379+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:21.354429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573629+0000","last_change":"2024-09-12T01:44:34.569126+0000","last_active":"2024-09-12T01:44:35.573629+0000","last_peered":"2024-09-12T01:44:35.573629+0000","last_clean":"2024-09-12T01:44:35.573629+0000","last_became_active":"2024-09-12T01:44:34.568830+0000","last_became_peered":"2024-09-12T01:44:34.568830+0000","last_unstale":"2024-09-12T01:44:35.573629+0000","last_undegraded":"2024-09-12T01:44:35.573629+0000","last_fullsized":"2024-09-12T01:44:35.573629+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:18.088120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576891+0000","last_change":"2024-09-12T01:44:33.569947+0000","last_active":"2024-09-12T01:44:35.576891+0000","last_peered":"2024-09-12T01:44:35.576891+0000","last_clean":"2024-09-12T01:44:35.576891+0000","last_became_active":"2024-09-12T01:44:33.569378+0000","last_became_peered":"2024-09-12T01:44:33.569378+0000","last_unstale":"2024-09-12T01:44:35.576891+0000","last_undegraded":"2024-09-12T01:44:35.576891+0000","last_fullsized":"2024-09-12T01:44:35.576891+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:21.653578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560355+0000","last_change":"2024-09-12T01:44:33.560355+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560355+0000","last_undegraded":"2024-09-12T01:44:33.560355+0000","last_fullsized":"2024-09-12T01:44:33.560355+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573874+0000","last_change":"2024-09-12T01:44:33.566465+0000","last_active":"2024-09-12T01:44:35.573874+0000","last_peered":"2024-09-12T01:44:35.573874+0000","last_clean":"2024-09-12T01:44:35.573874+0000","last_became_active":"2024-09-12T01:44:33.566147+0000","last_became_peered":"2024-09-12T01:44:33.566147+0000","last_unstale":"2024-09-12T01:44:35.573874+0000","last_undegraded":"2024-09-12T01:44:35.573874+0000","last_fullsized":"2024-09-12T01:44:35.573874+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:42.446369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.588131+0000","last_change":"2024-09-12T01:44:34.583987+0000","last_active":"2024-09-12T01:44:34.588131+0000","last_peered":"2024-09-12T01:44:34.588131+0000","last_clean":"2024-09-12T01:44:34.588131+0000","last_became_active":"2024-09-12T01:44:34.583670+0000","last_became_peered":"2024-09-12T01:44:34.583670+0000","last_unstale":"2024-09-12T01:44:34.588131+0000","last_undegraded":"2024-09-12T01:44:34.588131+0000","last_fullsized":"2024-09-12T01:44:34.588131+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:23.984044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.572301+0000","last_change":"2024-09-12T01:44:33.568793+0000","last_active":"2024-09-12T01:44:34.572301+0000","last_peered":"2024-09-12T01:44:34.572301+0000","last_clean":"2024-09-12T01:44:34.572301+0000","last_became_active":"2024-09-12T01:44:33.568545+0000","last_became_peered":"2024-09-12T01:44:33.568545+0000","last_unstale":"2024-09-12T01:44:34.572301+0000","last_undegraded":"2024-09-12T01:44:34.572301+0000","last_fullsized":"2024-09-12T01:44:34.572301+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:02.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590661+0000","last_change":"2024-09-12T01:44:34.584292+0000","last_active":"2024-09-12T01:44:34.590661+0000","last_peered":"2024-09-12T01:44:34.590661+0000","last_clean":"2024-09-12T01:44:34.590661+0000","last_became_active":"2024-09-12T01:44:34.583648+0000","last_became_peered":"2024-09-12T01:44:34.583648+0000","last_unstale":"2024-09-12T01:44:34.590661+0000","last_undegraded":"2024-09-12T01:44:34.590661+0000","last_fullsized":"2024-09-12T01:44:34.590661+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:01.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"138'3","reported_seq":17,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574365+0000","last_change":"2024-09-12T01:44:33.561874+0000","last_active":"2024-09-12T01:44:35.574365+0000","last_peered":"2024-09-12T01:44:35.574365+0000","last_clean":"2024-09-12T01:44:35.574365+0000","last_became_active":"2024-09-12T01:44:33.561180+0000","last_became_peered":"2024-09-12T01:44:33.561180+0000","last_unstale":"2024-09-12T01:44:35.574365+0000","last_undegraded":"2024-09-12T01:44:35.574365+0000","last_fullsized":"2024-09-12T01:44:35.574365+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.801449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577045+0000","last_change":"2024-09-12T01:44:34.570692+0000","last_active":"2024-09-12T01:44:35.577045+0000","last_peered":"2024-09-12T01:44:35.577045+0000","last_clean":"2024-09-12T01:44:35.577045+0000","last_became_active":"2024-09-12T01:44:34.570372+0000","last_became_peered":"2024-09-12T01:44:34.570372+0000","last_unstale":"2024-09-12T01:44:35.577045+0000","last_undegraded":"2024-09-12T01:44:35.577045+0000","last_fullsized":"2024-09-12T01:44:35.577045+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:06.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"138'6","reported_seq":20,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574109+0000","last_change":"2024-09-12T01:44:33.561870+0000","last_active":"2024-09-12T01:44:35.574109+0000","last_peered":"2024-09-12T01:44:35.574109+0000","last_clean":"2024-09-12T01:44:35.574109+0000","last_became_active":"2024-09-12T01:44:33.561575+0000","last_became_peered":"2024-09-12T01:44:33.561575+0000","last_unstale":"2024-09-12T01:44:35.574109+0000","last_undegraded":"2024-09-12T01:44:35.574109+0000","last_fullsized":"2024-09-12T01:44:35.574109+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:28.447167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583184+0000","last_change":"2024-09-12T01:44:34.580219+0000","last_active":"2024-09-12T01:44:34.583184+0000","last_peered":"2024-09-12T01:44:34.583184+0000","last_clean":"2024-09-12T01:44:34.583184+0000","last_became_active":"2024-09-12T01:44:34.579863+0000","last_became_peered":"2024-09-12T01:44:34.579863+0000","last_unstale":"2024-09-12T01:44:34.583184+0000","last_undegraded":"2024-09-12T01:44:34.583184+0000","last_fullsized":"2024-09-12T01:44:34.583184+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:39.869863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-12T01:44:33.567606+0000","last_change":"2024-09-12T01:44:33.566891+0000","last_active":"2024-09-12T01:44:33.567606+0000","last_peered":"2024-09-12T01:44:33.567606+0000","last_clean":"2024-09-12T01:44:33.567606+0000","last_became_active":"2024-09-12T01:44:33.566599+0000","last_became_peered":"2024-09-12T01:44:33.566599+0000","last_unstale":"2024-09-12T01:44:33.567606+0000","last_undegraded":"2024-09-12T01:44:33.567606+0000","last_fullsized":"2024-09-12T01:44:33.567606+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:43.374724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574087+0000","last_change":"2024-09-12T01:44:34.582387+0000","last_active":"2024-09-12T01:44:35.574087+0000","last_peered":"2024-09-12T01:44:35.574087+0000","last_clean":"2024-09-12T01:44:35.574087+0000","last_became_active":"2024-09-12T01:44:34.582096+0000","last_became_peered":"2024-09-12T01:44:34.582096+0000","last_unstale":"2024-09-12T01:44:35.574087+0000","last_undegraded":"2024-09-12T01:44:35.574087+0000","last_fullsized":"2024-09-12T01:44:35.574087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:51.107638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.573223+0000","last_change":"2024-09-12T01:44:33.558602+0000","last_active":"2024-09-12T01:44:34.573223+0000","last_peered":"2024-09-12T01:44:34.573223+0000","last_clean":"2024-09-12T01:44:34.573223+0000","last_became_active":"2024-09-12T01:44:33.558246+0000","last_became_peered":"2024-09-12T01:44:33.558246+0000","last_unstale":"2024-09-12T01:44:34.573223+0000","last_undegraded":"2024-09-12T01:44:34.573223+0000","last_fullsized":"2024-09-12T01:44:34.573223+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:18.127850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586616+0000","last_change":"2024-09-12T01:44:34.579825+0000","last_active":"2024-09-12T01:44:34.586616+0000","last_peered":"2024-09-12T01:44:34.586616+0000","last_clean":"2024-09-12T01:44:34.586616+0000","last_became_active":"2024-09-12T01:44:34.579565+0000","last_became_peered":"2024-09-12T01:44:34.579565+0000","last_unstale":"2024-09-12T01:44:34.586616+0000","last_undegraded":"2024-09-12T01:44:34.586616+0000","last_fullsized":"2024-09-12T01:44:34.586616+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:58.038820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.569789+0000","last_change":"2024-09-12T01:44:33.565496+0000","last_active":"2024-09-12T01:44:34.569789+0000","last_peered":"2024-09-12T01:44:34.569789+0000","last_clean":"2024-09-12T01:44:34.569789+0000","last_became_active":"2024-09-12T01:44:33.565197+0000","last_became_peered":"2024-09-12T01:44:33.565197+0000","last_unstale":"2024-09-12T01:44:34.569789+0000","last_undegraded":"2024-09-12T01:44:34.569789+0000","last_fullsized":"2024-09-12T01:44:34.569789+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582599+0000","last_change":"2024-09-12T01:44:34.580307+0000","last_active":"2024-09-12T01:44:34.582599+0000","last_peered":"2024-09-12T01:44:34.582599+0000","last_clean":"2024-09-12T01:44:34.582599+0000","last_became_active":"2024-09-12T01:44:34.579921+0000","last_became_peered":"2024-09-12T01:44:34.579921+0000","last_unstale":"2024-09-12T01:44:34.582599+0000","last_undegraded":"2024-09-12T01:44:34.582599+0000","last_fullsized":"2024-09-12T01:44:34.582599+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:41.766067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"138'8","reported_seq":22,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574137+0000","last_change":"2024-09-12T01:44:33.558236+0000","last_active":"2024-09-12T01:44:35.574137+0000","last_peered":"2024-09-12T01:44:35.574137+0000","last_clean":"2024-09-12T01:44:35.574137+0000","last_became_active":"2024-09-12T01:44:33.557953+0000","last_became_peered":"2024-09-12T01:44:33.557953+0000","last_unstale":"2024-09-12T01:44:35.574137+0000","last_undegraded":"2024-09-12T01:44:35.574137+0000","last_fullsized":"2024-09-12T01:44:35.574137+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:12.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590830+0000","last_change":"2024-09-12T01:44:34.589581+0000","last_active":"2024-09-12T01:44:34.590830+0000","last_peered":"2024-09-12T01:44:34.590830+0000","last_clean":"2024-09-12T01:44:34.590830+0000","last_became_active":"2024-09-12T01:44:34.589048+0000","last_became_peered":"2024-09-12T01:44:34.589048+0000","last_unstale":"2024-09-12T01:44:34.590830+0000","last_undegraded":"2024-09-12T01:44:34.590830+0000","last_fullsized":"2024-09-12T01:44:34.590830+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:25.732831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573933+0000","last_change":"2024-09-12T01:44:33.557600+0000","last_active":"2024-09-12T01:44:35.573933+0000","last_peered":"2024-09-12T01:44:35.573933+0000","last_clean":"2024-09-12T01:44:35.573933+0000","last_became_active":"2024-09-12T01:44:33.557317+0000","last_became_peered":"2024-09-12T01:44:33.557317+0000","last_unstale":"2024-09-12T01:44:35.573933+0000","last_undegraded":"2024-09-12T01:44:35.573933+0000","last_fullsized":"2024-09-12T01:44:35.573933+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:34.330164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560947+0000","last_change":"2024-09-12T01:44:33.560947+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560947+0000","last_undegraded":"2024-09-12T01:44:33.560947+0000","last_fullsized":"2024-09-12T01:44:33.560947+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.596296+0000","last_change":"2024-09-12T01:44:33.570978+0000","last_active":"2024-09-12T01:44:34.596296+0000","last_peered":"2024-09-12T01:44:34.596296+0000","last_clean":"2024-09-12T01:44:34.596296+0000","last_became_active":"2024-09-12T01:44:33.570604+0000","last_became_peered":"2024-09-12T01:44:33.570604+0000","last_unstale":"2024-09-12T01:44:34.596296+0000","last_undegraded":"2024-09-12T01:44:34.596296+0000","last_fullsized":"2024-09-12T01:44:34.596296+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:08.714197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560122+0000","last_change":"2024-09-12T01:44:33.560122+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560122+0000","last_undegraded":"2024-09-12T01:44:33.560122+0000","last_fullsized":"2024-09-12T01:44:33.560122+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574107+0000","last_change":"2024-09-12T01:44:33.564371+0000","last_active":"2024-09-12T01:44:35.574107+0000","last_peered":"2024-09-12T01:44:35.574107+0000","last_clean":"2024-09-12T01:44:35.574107+0000","last_became_active":"2024-09-12T01:44:33.564044+0000","last_became_peered":"2024-09-12T01:44:33.564044+0000","last_unstale":"2024-09-12T01:44:35.574107+0000","last_undegraded":"2024-09-12T01:44:35.574107+0000","last_fullsized":"2024-09-12T01:44:35.574107+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:57.461543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574320+0000","last_change":"2024-09-12T01:44:34.577881+0000","last_active":"2024-09-12T01:44:35.574320+0000","last_peered":"2024-09-12T01:44:35.574320+0000","last_clean":"2024-09-12T01:44:35.574320+0000","last_became_active":"2024-09-12T01:44:34.571399+0000","last_became_peered":"2024-09-12T01:44:34.571399+0000","last_unstale":"2024-09-12T01:44:35.574320+0000","last_undegraded":"2024-09-12T01:44:35.574320+0000","last_fullsized":"2024-09-12T01:44:35.574320+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:36.649302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573487+0000","last_change":"2024-09-12T01:44:33.563195+0000","last_active":"2024-09-12T01:44:35.573487+0000","last_peered":"2024-09-12T01:44:35.573487+0000","last_clean":"2024-09-12T01:44:35.573487+0000","last_became_active":"2024-09-12T01:44:33.562898+0000","last_became_peered":"2024-09-12T01:44:33.562898+0000","last_unstale":"2024-09-12T01:44:35.573487+0000","last_undegraded":"2024-09-12T01:44:35.573487+0000","last_fullsized":"2024-09-12T01:44:35.573487+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:59.939596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576984+0000","last_change":"2024-09-12T01:44:34.576473+0000","last_active":"2024-09-12T01:44:35.576984+0000","last_peered":"2024-09-12T01:44:35.576984+0000","last_clean":"2024-09-12T01:44:35.576984+0000","last_became_active":"2024-09-12T01:44:34.576143+0000","last_became_peered":"2024-09-12T01:44:34.576143+0000","last_unstale":"2024-09-12T01:44:35.576984+0000","last_undegraded":"2024-09-12T01:44:35.576984+0000","last_fullsized":"2024-09-12T01:44:35.576984+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:29.139125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574252+0000","last_change":"2024-09-12T01:44:33.555265+0000","last_active":"2024-09-12T01:44:35.574252+0000","last_peered":"2024-09-12T01:44:35.574252+0000","last_clean":"2024-09-12T01:44:35.574252+0000","last_became_active":"2024-09-12T01:44:33.554630+0000","last_became_peered":"2024-09-12T01:44:33.554630+0000","last_unstale":"2024-09-12T01:44:35.574252+0000","last_undegraded":"2024-09-12T01:44:35.574252+0000","last_fullsized":"2024-09-12T01:44:35.574252+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:53.277135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574227+0000","last_change":"2024-09-12T01:44:34.580476+0000","last_active":"2024-09-12T01:44:35.574227+0000","last_peered":"2024-09-12T01:44:35.574227+0000","last_clean":"2024-09-12T01:44:35.574227+0000","last_became_active":"2024-09-12T01:44:34.579803+0000","last_became_peered":"2024-09-12T01:44:34.579803+0000","last_unstale":"2024-09-12T01:44:35.574227+0000","last_undegraded":"2024-09-12T01:44:35.574227+0000","last_fullsized":"2024-09-12T01:44:35.574227+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.911212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573217+0000","last_change":"2024-09-12T01:44:33.556147+0000","last_active":"2024-09-12T01:44:35.573217+0000","last_peered":"2024-09-12T01:44:35.573217+0000","last_clean":"2024-09-12T01:44:35.573217+0000","last_became_active":"2024-09-12T01:44:33.555852+0000","last_became_peered":"2024-09-12T01:44:33.555852+0000","last_unstale":"2024-09-12T01:44:35.573217+0000","last_undegraded":"2024-09-12T01:44:35.573217+0000","last_fullsized":"2024-09-12T01:44:35.573217+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:25.006137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576742+0000","last_change":"2024-09-12T01:44:34.579386+0000","last_active":"2024-09-12T01:44:35.576742+0000","last_peered":"2024-09-12T01:44:35.576742+0000","last_clean":"2024-09-12T01:44:35.576742+0000","last_became_active":"2024-09-12T01:44:34.579004+0000","last_became_peered":"2024-09-12T01:44:34.579004+0000","last_unstale":"2024-09-12T01:44:35.576742+0000","last_undegraded":"2024-09-12T01:44:35.576742+0000","last_fullsized":"2024-09-12T01:44:35.576742+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:59.446473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-12T01:44:33.570870+0000","last_change":"2024-09-12T01:44:33.570319+0000","last_active":"2024-09-12T01:44:33.570870+0000","last_peered":"2024-09-12T01:44:33.570870+0000","last_clean":"2024-09-12T01:44:33.570870+0000","last_became_active":"2024-09-12T01:44:33.570021+0000","last_became_peered":"2024-09-12T01:44:33.570021+0000","last_unstale":"2024-09-12T01:44:33.570870+0000","last_undegraded":"2024-09-12T01:44:33.570870+0000","last_fullsized":"2024-09-12T01:44:33.570870+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:51.216059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583126+0000","last_change":"2024-09-12T01:44:34.579335+0000","last_active":"2024-09-12T01:44:34.583126+0000","last_peered":"2024-09-12T01:44:34.583126+0000","last_clean":"2024-09-12T01:44:34.583126+0000","last_became_active":"2024-09-12T01:44:34.578948+0000","last_became_peered":"2024-09-12T01:44:34.578948+0000","last_unstale":"2024-09-12T01:44:34.583126+0000","last_undegraded":"2024-09-12T01:44:34.583126+0000","last_fullsized":"2024-09-12T01:44:34.583126+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:43.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573182+0000","last_change":"2024-09-12T01:44:33.562892+0000","last_active":"2024-09-12T01:44:35.573182+0000","last_peered":"2024-09-12T01:44:35.573182+0000","last_clean":"2024-09-12T01:44:35.573182+0000","last_became_active":"2024-09-12T01:44:33.562581+0000","last_became_peered":"2024-09-12T01:44:33.562581+0000","last_unstale":"2024-09-12T01:44:35.573182+0000","last_undegraded":"2024-09-12T01:44:35.573182+0000","last_fullsized":"2024-09-12T01:44:35.573182+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:36.009808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574480+0000","last_change":"2024-09-12T01:44:34.577117+0000","last_active":"2024-09-12T01:44:35.574480+0000","last_peered":"2024-09-12T01:44:35.574480+0000","last_clean":"2024-09-12T01:44:35.574480+0000","last_became_active":"2024-09-12T01:44:34.575726+0000","last_became_peered":"2024-09-12T01:44:34.575726+0000","last_unstale":"2024-09-12T01:44:35.574480+0000","last_undegraded":"2024-09-12T01:44:35.574480+0000","last_fullsized":"2024-09-12T01:44:35.574480+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:29.139125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.591091+0000","last_change":"2024-09-12T01:44:33.566034+0000","last_active":"2024-09-12T01:44:34.591091+0000","last_peered":"2024-09-12T01:44:34.591091+0000","last_clean":"2024-09-12T01:44:34.591091+0000","last_became_active":"2024-09-12T01:44:33.565748+0000","last_became_peered":"2024-09-12T01:44:33.565748+0000","last_unstale":"2024-09-12T01:44:34.591091+0000","last_undegraded":"2024-09-12T01:44:34.591091+0000","last_fullsized":"2024-09-12T01:44:34.591091+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:44.021918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560386+0000","last_change":"2024-09-12T01:44:33.560386+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560386+0000","last_undegraded":"2024-09-12T01:44:33.560386+0000","last_fullsized":"2024-09-12T01:44:33.560386+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"139'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576279+0000","last_change":"2024-09-12T01:44:33.568481+0000","last_active":"2024-09-12T01:44:35.576279+0000","last_peered":"2024-09-12T01:44:35.576279+0000","last_clean":"2024-09-12T01:44:35.576279+0000","last_became_active":"2024-09-12T01:44:33.568131+0000","last_became_peered":"2024-09-12T01:44:33.568131+0000","last_unstale":"2024-09-12T01:44:35.576279+0000","last_undegraded":"2024-09-12T01:44:35.576279+0000","last_fullsized":"2024-09-12T01:44:35.576279+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:06.349936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.558120+0000","last_change":"2024-09-12T01:44:33.558120+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.558120+0000","last_undegraded":"2024-09-12T01:44:33.558120+0000","last_fullsized":"2024-09-12T01:44:33.558120+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577169+0000","last_change":"2024-09-12T01:44:33.568264+0000","last_active":"2024-09-12T01:44:35.577169+0000","last_peered":"2024-09-12T01:44:35.577169+0000","last_clean":"2024-09-12T01:44:35.577169+0000","last_became_active":"2024-09-12T01:44:33.567714+0000","last_became_peered":"2024-09-12T01:44:33.567714+0000","last_unstale":"2024-09-12T01:44:35.577169+0000","last_undegraded":"2024-09-12T01:44:35.577169+0000","last_fullsized":"2024-09-12T01:44:35.577169+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.801449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560175+0000","last_change":"2024-09-12T01:44:33.560175+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560175+0000","last_undegraded":"2024-09-12T01:44:33.560175+0000","last_fullsized":"2024-09-12T01:44:33.560175+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574180+0000","last_change":"2024-09-12T01:44:33.553971+0000","last_active":"2024-09-12T01:44:35.574180+0000","last_peered":"2024-09-12T01:44:35.574180+0000","last_clean":"2024-09-12T01:44:35.574180+0000","last_became_active":"2024-09-12T01:44:33.553693+0000","last_became_peered":"2024-09-12T01:44:33.553693+0000","last_unstale":"2024-09-12T01:44:35.574180+0000","last_undegraded":"2024-09-12T01:44:35.574180+0000","last_fullsized":"2024-09-12T01:44:35.574180+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:05.134312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586642+0000","last_change":"2024-09-12T01:44:34.582051+0000","last_active":"2024-09-12T01:44:34.586642+0000","last_peered":"2024-09-12T01:44:34.586642+0000","last_clean":"2024-09-12T01:44:34.586642+0000","last_became_active":"2024-09-12T01:44:34.581751+0000","last_became_peered":"2024-09-12T01:44:34.581751+0000","last_unstale":"2024-09-12T01:44:34.586642+0000","last_undegraded":"2024-09-12T01:44:34.586642+0000","last_fullsized":"2024-09-12T01:44:34.586642+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:27.408256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574019+0000","last_change":"2024-09-12T01:44:33.566494+0000","last_active":"2024-09-12T01:44:35.574019+0000","last_peered":"2024-09-12T01:44:35.574019+0000","last_clean":"2024-09-12T01:44:35.574019+0000","last_became_active":"2024-09-12T01:44:33.566175+0000","last_became_peered":"2024-09-12T01:44:33.566175+0000","last_unstale":"2024-09-12T01:44:35.574019+0000","last_undegraded":"2024-09-12T01:44:35.574019+0000","last_fullsized":"2024-09-12T01:44:35.574019+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:10.376177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576904+0000","last_change":"2024-09-12T01:44:34.571445+0000","last_active":"2024-09-12T01:44:35.576904+0000","last_peered":"2024-09-12T01:44:35.576904+0000","last_clean":"2024-09-12T01:44:35.576904+0000","last_became_active":"2024-09-12T01:44:34.571128+0000","last_became_peered":"2024-09-12T01:44:34.571128+0000","last_unstale":"2024-09-12T01:44:35.576904+0000","last_undegraded":"2024-09-12T01:44:35.576904+0000","last_fullsized":"2024-09-12T01:44:35.576904+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:03.884787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.569409+0000","last_change":"2024-09-12T01:44:33.565610+0000","last_active":"2024-09-12T01:44:34.569409+0000","last_peered":"2024-09-12T01:44:34.569409+0000","last_clean":"2024-09-12T01:44:34.569409+0000","last_became_active":"2024-09-12T01:44:33.565331+0000","last_became_peered":"2024-09-12T01:44:33.565331+0000","last_unstale":"2024-09-12T01:44:34.569409+0000","last_undegraded":"2024-09-12T01:44:34.569409+0000","last_fullsized":"2024-09-12T01:44:34.569409+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:21.653578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.578023+0000","last_change":"2024-09-12T01:44:34.574761+0000","last_active":"2024-09-12T01:44:34.578023+0000","last_peered":"2024-09-12T01:44:34.578023+0000","last_clean":"2024-09-12T01:44:34.578023+0000","last_became_active":"2024-09-12T01:44:34.574471+0000","last_became_peered":"2024-09-12T01:44:34.574471+0000","last_unstale":"2024-09-12T01:44:34.578023+0000","last_undegraded":"2024-09-12T01:44:34.578023+0000","last_fullsized":"2024-09-12T01:44:34.578023+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.806227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577074+0000","last_change":"2024-09-12T01:44:33.569721+0000","last_active":"2024-09-12T01:44:35.577074+0000","last_peered":"2024-09-12T01:44:35.577074+0000","last_clean":"2024-09-12T01:44:35.577074+0000","last_became_active":"2024-09-12T01:44:33.569016+0000","last_became_peered":"2024-09-12T01:44:33.569016+0000","last_unstale":"2024-09-12T01:44:35.577074+0000","last_undegraded":"2024-09-12T01:44:35.577074+0000","last_fullsized":"2024-09-12T01:44:35.577074+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576770+0000","last_change":"2024-09-12T01:44:34.569764+0000","last_active":"2024-09-12T01:44:35.576770+0000","last_peered":"2024-09-12T01:44:35.576770+0000","last_clean":"2024-09-12T01:44:35.576770+0000","last_became_active":"2024-09-12T01:44:34.569409+0000","last_became_peered":"2024-09-12T01:44:34.569409+0000","last_unstale":"2024-09-12T01:44:35.576770+0000","last_undegraded":"2024-09-12T01:44:35.576770+0000","last_fullsized":"2024-09-12T01:44:35.576770+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:51.107638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576701+0000","last_change":"2024-09-12T01:44:33.567980+0000","last_active":"2024-09-12T01:44:35.576701+0000","last_peered":"2024-09-12T01:44:35.576701+0000","last_clean":"2024-09-12T01:44:35.576701+0000","last_became_active":"2024-09-12T01:44:33.567648+0000","last_became_peered":"2024-09-12T01:44:33.567648+0000","last_unstale":"2024-09-12T01:44:35.576701+0000","last_undegraded":"2024-09-12T01:44:35.576701+0000","last_fullsized":"2024-09-12T01:44:35.576701+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:40.761288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590655+0000","last_change":"2024-09-12T01:44:34.585187+0000","last_active":"2024-09-12T01:44:34.590655+0000","last_peered":"2024-09-12T01:44:34.590655+0000","last_clean":"2024-09-12T01:44:34.590655+0000","last_became_active":"2024-09-12T01:44:34.584915+0000","last_became_peered":"2024-09-12T01:44:34.584915+0000","last_unstale":"2024-09-12T01:44:34.590655+0000","last_undegraded":"2024-09-12T01:44:34.590655+0000","last_fullsized":"2024-09-12T01:44:34.590655+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:24.224542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573836+0000","last_change":"2024-09-12T01:44:33.567593+0000","last_active":"2024-09-12T01:44:35.573836+0000","last_peered":"2024-09-12T01:44:35.573836+0000","last_clean":"2024-09-12T01:44:35.573836+0000","last_became_active":"2024-09-12T01:44:33.566833+0000","last_became_peered":"2024-09-12T01:44:33.566833+0000","last_unstale":"2024-09-12T01:44:35.573836+0000","last_undegraded":"2024-09-12T01:44:35.573836+0000","last_fullsized":"2024-09-12T01:44:35.573836+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:56.207377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":389,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574004+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:44:35.574004+0000","last_peered":"2024-09-12T01:44:35.574004+0000","last_clean":"2024-09-12T01:44:35.574004+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:44:35.574004+0000","last_undegraded":"2024-09-12T01:44:35.574004+0000","last_fullsized":"2024-09-12T01:44:35.574004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509551,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1728512,"data_stored":740564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":1732608,"data_stored":740598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509549,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2330624,"data_stored":1331604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509549,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41216,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330624,"statfs":{"total":96636764160,"available":96594558976,"internally_reserved":0,"allocated":1744896,"data_stored":742198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509549,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37060,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334780,"statfs":{"total":96636764160,"available":96598814720,"internally_reserved":0,"allocated":1744896,"data_stored":747446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509549,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37644,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334196,"statfs":{"total":96636764160,"available":96598216704,"internally_reserved":0,"allocated":2347008,"data_stored":1332726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1732608,"data_stored":740634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32852,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338988,"statfs":{"total":96636764160,"available":96603123712,"internally_reserved":0,"allocated":1703936,"data_stored":727514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:44:38.252 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3c is not active+clean 2024-09-12T01:44:38.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 137, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:44:33.560664+0000', 'last_change': '2024-09-12T01:44:33.560664+0000', 'last_active': '2024-09-12T01:44:33.544679+0000', 'last_peered': '2024-09-12T01:44:33.544679+0000', 'last_clean': '2024-09-12T01:44:33.544679+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:44:33.560664+0000', 'last_undegraded': '2024-09-12T01:44:33.560664+0000', 'last_fullsized': '2024-09-12T01:44:33.560664+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_clean_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:44:38.252 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2e is not active+clean 2024-09-12T01:44:38.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 137, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:44:33.557842+0000', 'last_change': '2024-09-12T01:44:33.557842+0000', 'last_active': '2024-09-12T01:44:33.544679+0000', 'last_peered': '2024-09-12T01:44:33.544679+0000', 'last_clean': '2024-09-12T01:44:33.544679+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:44:33.557842+0000', 'last_undegraded': '2024-09-12T01:44:33.557842+0000', 'last_fullsized': '2024-09-12T01:44:33.557842+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_clean_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:44:38.252 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1e is not active+clean 2024-09-12T01:44:38.252 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 137, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:44:33.557343+0000', 'last_change': '2024-09-12T01:44:33.557343+0000', 'last_active': '2024-09-12T01:44:33.544679+0000', 'last_peered': '2024-09-12T01:44:33.544679+0000', 'last_clean': '2024-09-12T01:44:33.544679+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:44:33.557343+0000', 'last_undegraded': '2024-09-12T01:44:33.557343+0000', 'last_fullsized': '2024-09-12T01:44:33.557343+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_clean_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:44:38.253 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1a is not active+clean 2024-09-12T01:44:38.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 137, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:44:33.560028+0000', 'last_change': '2024-09-12T01:44:33.560028+0000', 'last_active': '2024-09-12T01:44:33.544679+0000', 'last_peered': '2024-09-12T01:44:33.544679+0000', 'last_clean': '2024-09-12T01:44:33.544679+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:44:33.560028+0000', 'last_undegraded': '2024-09-12T01:44:33.560028+0000', 'last_fullsized': '2024-09-12T01:44:33.560028+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_clean_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:44:38.253 INFO:tasks.ceph.ceph_manager.ceph:PG 23.19 is not active+clean 2024-09-12T01:44:38.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 137, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:44:33.560355+0000', 'last_change': '2024-09-12T01:44:33.560355+0000', 'last_active': '2024-09-12T01:44:33.544679+0000', 'last_peered': '2024-09-12T01:44:33.544679+0000', 'last_clean': '2024-09-12T01:44:33.544679+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:44:33.560355+0000', 'last_undegraded': '2024-09-12T01:44:33.560355+0000', 'last_fullsized': '2024-09-12T01:44:33.560355+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_clean_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:44:38.253 INFO:tasks.ceph.ceph_manager.ceph:PG 23.f is not active+clean 2024-09-12T01:44:38.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 137, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:44:33.560947+0000', 'last_change': '2024-09-12T01:44:33.560947+0000', 'last_active': '2024-09-12T01:44:33.544679+0000', 'last_peered': '2024-09-12T01:44:33.544679+0000', 'last_clean': '2024-09-12T01:44:33.544679+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:44:33.560947+0000', 'last_undegraded': '2024-09-12T01:44:33.560947+0000', 'last_fullsized': '2024-09-12T01:44:33.560947+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_clean_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:44:38.253 INFO:tasks.ceph.ceph_manager.ceph:PG 23.c is not active+clean 2024-09-12T01:44:38.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 137, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:44:33.560122+0000', 'last_change': '2024-09-12T01:44:33.560122+0000', 'last_active': '2024-09-12T01:44:33.544679+0000', 'last_peered': '2024-09-12T01:44:33.544679+0000', 'last_clean': '2024-09-12T01:44:33.544679+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:44:33.560122+0000', 'last_undegraded': '2024-09-12T01:44:33.560122+0000', 'last_fullsized': '2024-09-12T01:44:33.560122+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_clean_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:44:38.253 INFO:tasks.ceph.ceph_manager.ceph:PG 23.7 is not active+clean 2024-09-12T01:44:38.253 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 137, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:44:33.560386+0000', 'last_change': '2024-09-12T01:44:33.560386+0000', 'last_active': '2024-09-12T01:44:33.544679+0000', 'last_peered': '2024-09-12T01:44:33.544679+0000', 'last_clean': '2024-09-12T01:44:33.544679+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:44:33.560386+0000', 'last_undegraded': '2024-09-12T01:44:33.560386+0000', 'last_fullsized': '2024-09-12T01:44:33.560386+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_clean_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:44:38.254 INFO:tasks.ceph.ceph_manager.ceph:PG 23.4 is not active+clean 2024-09-12T01:44:38.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 137, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:44:33.558120+0000', 'last_change': '2024-09-12T01:44:33.558120+0000', 'last_active': '2024-09-12T01:44:33.544679+0000', 'last_peered': '2024-09-12T01:44:33.544679+0000', 'last_clean': '2024-09-12T01:44:33.544679+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:44:33.558120+0000', 'last_undegraded': '2024-09-12T01:44:33.558120+0000', 'last_fullsized': '2024-09-12T01:44:33.558120+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_clean_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:44:38.254 INFO:tasks.ceph.ceph_manager.ceph:PG 23.5 is not active+clean 2024-09-12T01:44:38.254 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 137, 'state': 'creating+peering', 'last_fresh': '2024-09-12T01:44:33.560175+0000', 'last_change': '2024-09-12T01:44:33.560175+0000', 'last_active': '2024-09-12T01:44:33.544679+0000', 'last_peered': '2024-09-12T01:44:33.544679+0000', 'last_clean': '2024-09-12T01:44:33.544679+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-12T01:44:33.560175+0000', 'last_undegraded': '2024-09-12T01:44:33.560175+0000', 'last_fullsized': '2024-09-12T01:44:33.560175+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'last_clean_scrub_stamp': '2024-09-12T01:44:33.544679+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-12T01:44:38.254 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-12T01:44:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.389+0000 7ff022d86640 1 Processor -- start 2024-09-12T01:44:38.390 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.389+0000 7ff022d86640 1 -- start start 2024-09-12T01:44:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.390+0000 7ff022d86640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff01c15e7a0 0x7ff01c0ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.390+0000 7ff022d86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff01c0cf2f0 0x7ff01c0cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.390+0000 7ff022d86640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff01c0d4430 con 0x7ff01c0d3fe0 2024-09-12T01:44:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.390+0000 7ff022d86640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff01c0d2f40 con 0x7ff01c15e7a0 2024-09-12T01:44:38.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.390+0000 7ff022d86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff01c0d3220 con 0x7ff01c0cf2f0 2024-09-12T01:44:38.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.391+0000 7ff020b22640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff01c15e7a0 0x7ff01c0ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.391+0000 7ff021323640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff01c0cf2f0 0x7ff01c0cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.391+0000 7ff021323640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff01c0cf2f0 0x7ff01c0cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:45722/0 (socket says 172.21.15.60:45722) 2024-09-12T01:44:38.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.391+0000 7ff021323640 1 -- 172.21.15.60:0/2381056361 learned_addr learned my addr 172.21.15.60:0/2381056361 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:38.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.391+0000 7ff021323640 1 -- 172.21.15.60:0/2381056361 >> v2:172.21.15.105:3300/0 conn(0x7ff01c15e7a0 msgr2=0x7ff01c0ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:38.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.391+0000 7ff021323640 1 --2- 172.21.15.60:0/2381056361 >> v2:172.21.15.105:3300/0 conn(0x7ff01c15e7a0 0x7ff01c0ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.391+0000 7ff021323640 1 -- 172.21.15.60:0/2381056361 >> v1:172.21.15.105:6789/0 conn(0x7ff01c0d3fe0 legacy=0x7ff01c0d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.392 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.391+0000 7ff021323640 1 -- 172.21.15.60:0/2381056361 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01c0d3500 con 0x7ff01c0cf2f0 2024-09-12T01:44:38.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.392+0000 7ff021323640 1 --2- 172.21.15.60:0/2381056361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff01c0cf2f0 0x7ff01c0cf780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009870 tx=0x7ff00c02a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd166fc1c3afb54a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:38.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.392+0000 7ff01b7fe640 1 -- 172.21.15.60:0/2381056361 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c037070 con 0x7ff01c0cf2f0 2024-09-12T01:44:38.393 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.392+0000 7ff01b7fe640 1 -- 172.21.15.60:0/2381056361 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff00c02ae50 con 0x7ff01c0cf2f0 2024-09-12T01:44:38.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.392+0000 7ff01b7fe640 1 -- 172.21.15.60:0/2381056361 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c032860 con 0x7ff01c0cf2f0 2024-09-12T01:44:38.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.392+0000 7ff022d86640 1 -- 172.21.15.60:0/2381056361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff01c0cf2f0 msgr2=0x7ff01c0cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.392+0000 7ff022d86640 1 --2- 172.21.15.60:0/2381056361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff01c0cf2f0 0x7ff01c0cf780 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009870 tx=0x7ff00c02a300 comp rx=0 tx=0).stop 2024-09-12T01:44:38.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.392+0000 7ff022d86640 1 -- 172.21.15.60:0/2381056361 shutdown_connections 2024-09-12T01:44:38.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.392+0000 7ff022d86640 1 --2- 172.21.15.60:0/2381056361 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff01c0cf2f0 0x7ff01c0cf780 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.392+0000 7ff022d86640 1 --2- 172.21.15.60:0/2381056361 >> v2:172.21.15.105:3300/0 conn(0x7ff01c15e7a0 0x7ff01c0ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.392+0000 7ff022d86640 1 -- 172.21.15.60:0/2381056361 >> 172.21.15.60:0/2381056361 conn(0x7ff01c0d1550 msgr2=0x7ff01c0d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:38.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.392+0000 7ff022d86640 1 -- 172.21.15.60:0/2381056361 shutdown_connections 2024-09-12T01:44:38.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.393+0000 7ff022d86640 1 -- 172.21.15.60:0/2381056361 wait complete. 2024-09-12T01:44:38.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.394+0000 7ff022d86640 1 Processor -- start 2024-09-12T01:44:38.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.394+0000 7ff022d86640 1 -- start start 2024-09-12T01:44:38.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff022d86640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff01c0cf2f0 0x7ff01c14ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff022d86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff01c0d3fe0 0x7ff01c0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff022d86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c15e7a0 0x7ff01c0b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff022d86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c15eb80 con 0x7ff01c15e7a0 2024-09-12T01:44:38.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff022d86640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c0d3ac0 con 0x7ff01c0cf2f0 2024-09-12T01:44:38.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff022d86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff01c15ed00 con 0x7ff01c0d3fe0 2024-09-12T01:44:38.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff021323640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c15e7a0 0x7ff01c0b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff021323640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c15e7a0 0x7ff01c0b67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42802/0 (socket says 172.21.15.60:42802) 2024-09-12T01:44:38.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff021323640 1 -- 172.21.15.60:0/3234711249 learned_addr learned my addr 172.21.15.60:0/3234711249 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:38.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff020b22640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff01c0cf2f0 0x7ff01c14ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff01bfff640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff01c0d3fe0 0x7ff01c0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff021323640 1 -- 172.21.15.60:0/3234711249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff01c0d3fe0 msgr2=0x7ff01c0b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff021323640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff01c0d3fe0 0x7ff01c0b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff021323640 1 -- 172.21.15.60:0/3234711249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff01c0cf2f0 msgr2=0x7ff01c14ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff021323640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff01c0cf2f0 0x7ff01c14ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff021323640 1 -- 172.21.15.60:0/3234711249 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01c15f180 con 0x7ff01c15e7a0 2024-09-12T01:44:38.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff021323640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c15e7a0 0x7ff01c0b67d0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7ff00c02a340 tx=0x7ff00c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:38.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff0197fa640 1 -- 172.21.15.60:0/3234711249 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c041020 con 0x7ff01c15e7a0 2024-09-12T01:44:38.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff0197fa640 1 -- 172.21.15.60:0/3234711249 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff00c03c890 con 0x7ff01c15e7a0 2024-09-12T01:44:38.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.395+0000 7ff022d86640 1 -- 172.21.15.60:0/3234711249 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff01c0cc2d0 con 0x7ff01c15e7a0 2024-09-12T01:44:38.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.396+0000 7ff0197fa640 1 -- 172.21.15.60:0/3234711249 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00c037040 con 0x7ff01c15e7a0 2024-09-12T01:44:38.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.396+0000 7ff022d86640 1 -- 172.21.15.60:0/3234711249 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff01c0cc890 con 0x7ff01c15e7a0 2024-09-12T01:44:38.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.397+0000 7ff022d86640 1 -- 172.21.15.60:0/3234711249 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff01c0ba240 con 0x7ff01c15e7a0 2024-09-12T01:44:38.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.397+0000 7ff0197fa640 1 -- 172.21.15.60:0/3234711249 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff00c044020 con 0x7ff01c15e7a0 2024-09-12T01:44:38.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.398+0000 7ff0197fa640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff00806be30 0x7ff00806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.398+0000 7ff0197fa640 1 -- 172.21.15.60:0/3234711249 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7ff00c0ab7f0 con 0x7ff01c15e7a0 2024-09-12T01:44:38.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.398+0000 7ff020b22640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff00806be30 0x7ff00806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.398+0000 7ff020b22640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff00806be30 0x7ff00806e2f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff0140073f0 tx=0x7ff01400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:38.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.402+0000 7ff0197fa640 1 -- 172.21.15.60:0/3234711249 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7ff00c04b030 con 0x7ff01c15e7a0 2024-09-12T01:44:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.644+0000 7ff022d86640 1 -- 172.21.15.60:0/3234711249 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff01c0caf80 con 0x7ff01c15e7a0 2024-09-12T01:44:38.645 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.645+0000 7ff0197fa640 1 -- 172.21.15.60:0/3234711249 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1565 (secure 0 0 0) 0x7ff01c15f180 con 0x7ff01c15e7a0 2024-09-12T01:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:38.645 INFO:teuthology.orchestra.run.smithi060.stdout:{"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":545,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":139,"num_osds":8,"num_up_osds":8,"osd_up_since":1726104944,"num_in_osds":8,"osd_in_since":1726104934,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":87},{"state_name":"creating+peering","count":10}],"num_pgs":97,"num_pools":3,"num_objects":22,"data_bytes":592744,"bytes_used":300412928,"bytes_avail":772793700352,"bytes_total":773094113280,"inactive_pgs_ratio":0.10309278219938278,"write_bytes_sec":1229,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":88,"btime":"2024-09-12T01:44:36:571579+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"d","status":"up:active","gid":36740}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2024-09-12T01:43:40.365328+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-12T01:44:38.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.647+0000 7ff022d86640 1 -- 172.21.15.60:0/3234711249 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff00806be30 msgr2=0x7ff00806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.647+0000 7ff022d86640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff00806be30 0x7ff00806e2f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff0140073f0 tx=0x7ff01400b040 comp rx=0 tx=0).stop 2024-09-12T01:44:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.647+0000 7ff022d86640 1 -- 172.21.15.60:0/3234711249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c15e7a0 msgr2=0x7ff01c0b67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.647+0000 7ff022d86640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c15e7a0 0x7ff01c0b67d0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7ff00c02a340 tx=0x7ff00c0046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.647+0000 7ff022d86640 1 -- 172.21.15.60:0/3234711249 shutdown_connections 2024-09-12T01:44:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.647+0000 7ff022d86640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff01c15e7a0 0x7ff01c0b67d0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.647+0000 7ff022d86640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff00806be30 0x7ff00806e2f0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.647+0000 7ff022d86640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff01c0d3fe0 0x7ff01c0b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.647+0000 7ff022d86640 1 --2- 172.21.15.60:0/3234711249 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff01c0cf2f0 0x7ff01c14ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.647+0000 7ff022d86640 1 -- 172.21.15.60:0/3234711249 >> 172.21.15.60:0/3234711249 conn(0x7ff01c0d1550 msgr2=0x7ff01c0ca190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.647+0000 7ff022d86640 1 -- 172.21.15.60:0/3234711249 shutdown_connections 2024-09-12T01:44:38.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.647+0000 7ff022d86640 1 -- 172.21.15.60:0/3234711249 wait complete. 2024-09-12T01:44:38.659 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-12T01:44:38.659 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:44:38.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.760+0000 7f58f8677640 1 Processor -- start 2024-09-12T01:44:38.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.760+0000 7f58f8677640 1 -- start start 2024-09-12T01:44:38.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.761+0000 7f58f8677640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f58f00b63d0 0x7f58f00d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.761+0000 7f58f8677640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58f00d1c80 0x7f58f00b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.761+0000 7f58f8677640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58f00cfc20 con 0x7f58f00cf6b0 2024-09-12T01:44:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.761+0000 7f58f8677640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f58f00d2ed0 con 0x7f58f00b63d0 2024-09-12T01:44:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.761+0000 7f58f8677640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f58f00d31b0 con 0x7f58f00d1c80 2024-09-12T01:44:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.761+0000 7f58f6413640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f58f00b63d0 0x7f58f00d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.761+0000 7f58f5c12640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f58f00cf6b0 0x7f58f00b7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54374/0 (socket says 172.21.15.60:54374) 2024-09-12T01:44:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.761+0000 7f58f5c12640 1 -- 172.21.15.60:0/1810405082 learned_addr learned my addr 172.21.15.60:0/1810405082 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.762+0000 7f58f6c14640 1 --2- 172.21.15.60:0/1810405082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58f00d1c80 0x7f58f00b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.762+0000 7f58f6413640 1 -- 172.21.15.60:0/1810405082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58f00d1c80 msgr2=0x7f58f00b7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.762+0000 7f58f6413640 1 --2- 172.21.15.60:0/1810405082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58f00d1c80 0x7f58f00b7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.762+0000 7f58f6413640 1 -- 172.21.15.60:0/1810405082 >> v1:172.21.15.60:6789/0 conn(0x7f58f00cf6b0 legacy=0x7f58f00b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.762+0000 7f58f5411640 1 -- 172.21.15.60:0/1810405082 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4051275418 0 0) 0x7f58f00cfc20 con 0x7f58f00cf6b0 2024-09-12T01:44:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.762+0000 7f58f6413640 1 -- 172.21.15.60:0/1810405082 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f00d3490 con 0x7f58f00b63d0 2024-09-12T01:44:38.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.762+0000 7f58f6c14640 1 --2- 172.21.15.60:0/1810405082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58f00d1c80 0x7f58f00b7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.762+0000 7f58f6413640 1 --2- 172.21.15.60:0/1810405082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f00b63d0 0x7f58f00d39b0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0097a0 tx=0x7f58ec02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4a7ffda108bc9e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.763+0000 7f58f5411640 1 -- 172.21.15.60:0/1810405082 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec037070 con 0x7f58f00b63d0 2024-09-12T01:44:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.763+0000 7f58f5411640 1 -- 172.21.15.60:0/1810405082 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ec02ae50 con 0x7f58f00b63d0 2024-09-12T01:44:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.763+0000 7f58f5411640 1 -- 172.21.15.60:0/1810405082 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ec032660 con 0x7f58f00b63d0 2024-09-12T01:44:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.763+0000 7f58f8677640 1 -- 172.21.15.60:0/1810405082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f00b63d0 msgr2=0x7f58f00d39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.763+0000 7f58f8677640 1 --2- 172.21.15.60:0/1810405082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f00b63d0 0x7f58f00d39b0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0097a0 tx=0x7f58ec02a100 comp rx=0 tx=0).stop 2024-09-12T01:44:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.763+0000 7f58f8677640 1 -- 172.21.15.60:0/1810405082 shutdown_connections 2024-09-12T01:44:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.763+0000 7f58f8677640 1 --2- 172.21.15.60:0/1810405082 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58f00d1c80 0x7f58f00b7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.763+0000 7f58f8677640 1 --2- 172.21.15.60:0/1810405082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f00b63d0 0x7f58f00d39b0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.763+0000 7f58f8677640 1 -- 172.21.15.60:0/1810405082 >> 172.21.15.60:0/1810405082 conn(0x7f58f00d1160 msgr2=0x7f58f00d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:38.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.763+0000 7f58f8677640 1 -- 172.21.15.60:0/1810405082 shutdown_connections 2024-09-12T01:44:38.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.763+0000 7f58f8677640 1 -- 172.21.15.60:0/1810405082 wait complete. 2024-09-12T01:44:38.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.764+0000 7f58f8677640 1 Processor -- start 2024-09-12T01:44:38.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.764+0000 7f58f8677640 1 -- start start 2024-09-12T01:44:38.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.765+0000 7f58f8677640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58f00b63d0 0x7f58f01f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.765+0000 7f58f8677640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58f00cf6b0 0x7f58f00b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.765+0000 7f58f8677640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f00d1c80 0x7f58f01f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.765+0000 7f58f8677640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f58f00d4070 con 0x7f58f00d1c80 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.765+0000 7f58f8677640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f58f00d3ef0 con 0x7f58f00b63d0 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.765+0000 7f58f8677640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f58f00b67b0 con 0x7f58f00cf6b0 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.765+0000 7f58f6c14640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f00d1c80 0x7f58f01f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.765+0000 7f58f6c14640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f00d1c80 0x7f58f01f4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42824/0 (socket says 172.21.15.60:42824) 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.765+0000 7f58f6c14640 1 -- 172.21.15.60:0/3671469131 learned_addr learned my addr 172.21.15.60:0/3671469131 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.765+0000 7f58f5c12640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58f00cf6b0 0x7f58f00b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.765+0000 7f58f6413640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58f00b63d0 0x7f58f01f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.766+0000 7f58f6c14640 1 -- 172.21.15.60:0/3671469131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58f00cf6b0 msgr2=0x7f58f00b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.766+0000 7f58f6c14640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58f00cf6b0 0x7f58f00b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.766+0000 7f58f6c14640 1 -- 172.21.15.60:0/3671469131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58f00b63d0 msgr2=0x7f58f01f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.766+0000 7f58f6c14640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58f00b63d0 0x7f58f01f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.766+0000 7f58f6c14640 1 -- 172.21.15.60:0/3671469131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58f01f6430 con 0x7f58f00d1c80 2024-09-12T01:44:38.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.766+0000 7f58f6c14640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f00d1c80 0x7f58f01f4a40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f58e800cd50 tx=0x7f58e800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:38.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.766+0000 7f58e6ffd640 1 -- 172.21.15.60:0/3671469131 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e800f680 con 0x7f58f00d1c80 2024-09-12T01:44:38.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.766+0000 7f58e6ffd640 1 -- 172.21.15.60:0/3671469131 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58e800f840 con 0x7f58f00d1c80 2024-09-12T01:44:38.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.766+0000 7f58f8677640 1 -- 172.21.15.60:0/3671469131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58f01f53f0 con 0x7f58f00d1c80 2024-09-12T01:44:38.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.766+0000 7f58e6ffd640 1 -- 172.21.15.60:0/3671469131 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58e800fc30 con 0x7f58f00d1c80 2024-09-12T01:44:38.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.766+0000 7f58f8677640 1 -- 172.21.15.60:0/3671469131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58f01f59b0 con 0x7f58f00d1c80 2024-09-12T01:44:38.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.767+0000 7f58f8677640 1 -- 172.21.15.60:0/3671469131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58f01f5bb0 con 0x7f58f00d1c80 2024-09-12T01:44:38.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.768+0000 7f58e6ffd640 1 -- 172.21.15.60:0/3671469131 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f58e80213f0 con 0x7f58f00d1c80 2024-09-12T01:44:38.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.768+0000 7f58e6ffd640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f58d406be30 0x7f58d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:38.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.768+0000 7f58e6ffd640 1 -- 172.21.15.60:0/3671469131 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f58e808bb00 con 0x7f58f00d1c80 2024-09-12T01:44:38.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.768+0000 7f58f6413640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f58d406be30 0x7f58d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:38.770 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.768+0000 7f58f6413640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f58d406be30 0x7f58d406e2f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f58ec034000 tx=0x7f58ec02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:38.773 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.772+0000 7f58e6ffd640 1 -- 172.21.15.60:0/3671469131 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f58f01f5bb0 con 0x7f58f00d1c80 2024-09-12T01:44:38.947 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.946+0000 7f58f8677640 1 -- 172.21.15.60:0/3671469131 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f58f00d39b0 con 0x7f58d406be30 2024-09-12T01:44:38.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.952+0000 7f58e6ffd640 1 -- 172.21.15.60:0/3671469131 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251623 (secure 0 0 0) 0x7f58f00d39b0 con 0x7f58d406be30 2024-09-12T01:44:38.955 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:38.956 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:44:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.956+0000 7f58f8677640 1 -- 172.21.15.60:0/3671469131 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f58d406be30 msgr2=0x7f58d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.956+0000 7f58f8677640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f58d406be30 0x7f58d406e2f0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f58ec034000 tx=0x7f58ec02e000 comp rx=0 tx=0).stop 2024-09-12T01:44:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.956+0000 7f58f8677640 1 -- 172.21.15.60:0/3671469131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f00d1c80 msgr2=0x7f58f01f4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.956+0000 7f58f8677640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f00d1c80 0x7f58f01f4a40 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f58e800cd50 tx=0x7f58e800a650 comp rx=0 tx=0).stop 2024-09-12T01:44:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.956+0000 7f58f8677640 1 -- 172.21.15.60:0/3671469131 shutdown_connections 2024-09-12T01:44:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.956+0000 7f58f8677640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58f00d1c80 0x7f58f01f4a40 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.956+0000 7f58f8677640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f58d406be30 0x7f58d406e2f0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.956+0000 7f58f8677640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f58f00cf6b0 0x7f58f00b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.956+0000 7f58f8677640 1 --2- 172.21.15.60:0/3671469131 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f58f00b63d0 0x7f58f01f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:38.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.956+0000 7f58f8677640 1 -- 172.21.15.60:0/3671469131 >> 172.21.15.60:0/3671469131 conn(0x7f58f00d1160 msgr2=0x7f58f00d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:38.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.956+0000 7f58f8677640 1 -- 172.21.15.60:0/3671469131 shutdown_connections 2024-09-12T01:44:38.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:38.956+0000 7f58f8677640 1 -- 172.21.15.60:0/3671469131 wait complete. 2024-09-12T01:44:38.967 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-09-12T01:44:38.377182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592744,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":293372,"kb_used_data":14712,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754681348,"statfs":{"total":773094113280,"available":772793700352,"internally_reserved":0,"allocated":15065088,"data_stored":7103284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.831911"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577206+0000","last_change":"2024-09-12T01:44:34.578808+0000","last_active":"2024-09-12T01:44:35.577206+0000","last_peered":"2024-09-12T01:44:35.577206+0000","last_clean":"2024-09-12T01:44:35.577206+0000","last_became_active":"2024-09-12T01:44:34.578528+0000","last_became_peered":"2024-09-12T01:44:34.578528+0000","last_unstale":"2024-09-12T01:44:35.577206+0000","last_undegraded":"2024-09-12T01:44:35.577206+0000","last_fullsized":"2024-09-12T01:44:35.577206+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:04.653539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577100+0000","last_change":"2024-09-12T01:44:34.579190+0000","last_active":"2024-09-12T01:44:35.577100+0000","last_peered":"2024-09-12T01:44:35.577100+0000","last_clean":"2024-09-12T01:44:35.577100+0000","last_became_active":"2024-09-12T01:44:34.578880+0000","last_became_peered":"2024-09-12T01:44:34.578880+0000","last_unstale":"2024-09-12T01:44:35.577100+0000","last_undegraded":"2024-09-12T01:44:35.577100+0000","last_fullsized":"2024-09-12T01:44:35.577100+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:48.771413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577035+0000","last_change":"2024-09-12T01:44:34.568255+0000","last_active":"2024-09-12T01:44:35.577035+0000","last_peered":"2024-09-12T01:44:35.577035+0000","last_clean":"2024-09-12T01:44:35.577035+0000","last_became_active":"2024-09-12T01:44:34.567951+0000","last_became_peered":"2024-09-12T01:44:34.567951+0000","last_unstale":"2024-09-12T01:44:35.577035+0000","last_undegraded":"2024-09-12T01:44:35.577035+0000","last_fullsized":"2024-09-12T01:44:35.577035+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:06.315519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560664+0000","last_change":"2024-09-12T01:44:33.560664+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560664+0000","last_undegraded":"2024-09-12T01:44:33.560664+0000","last_fullsized":"2024-09-12T01:44:33.560664+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573865+0000","last_change":"2024-09-12T01:44:34.581929+0000","last_active":"2024-09-12T01:44:35.573865+0000","last_peered":"2024-09-12T01:44:35.573865+0000","last_clean":"2024-09-12T01:44:35.573865+0000","last_became_active":"2024-09-12T01:44:34.581430+0000","last_became_peered":"2024-09-12T01:44:34.581430+0000","last_unstale":"2024-09-12T01:44:35.573865+0000","last_undegraded":"2024-09-12T01:44:35.573865+0000","last_fullsized":"2024-09-12T01:44:35.573865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:58.704148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593245+0000","last_change":"2024-09-12T01:44:34.587092+0000","last_active":"2024-09-12T01:44:34.593245+0000","last_peered":"2024-09-12T01:44:34.593245+0000","last_clean":"2024-09-12T01:44:34.593245+0000","last_became_active":"2024-09-12T01:44:34.586801+0000","last_became_peered":"2024-09-12T01:44:34.586801+0000","last_unstale":"2024-09-12T01:44:34.593245+0000","last_undegraded":"2024-09-12T01:44:34.593245+0000","last_fullsized":"2024-09-12T01:44:34.593245+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:07.258321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583107+0000","last_change":"2024-09-12T01:44:34.579218+0000","last_active":"2024-09-12T01:44:34.583107+0000","last_peered":"2024-09-12T01:44:34.583107+0000","last_clean":"2024-09-12T01:44:34.583107+0000","last_became_active":"2024-09-12T01:44:34.578880+0000","last_became_peered":"2024-09-12T01:44:34.578880+0000","last_unstale":"2024-09-12T01:44:34.583107+0000","last_undegraded":"2024-09-12T01:44:34.583107+0000","last_fullsized":"2024-09-12T01:44:34.583107+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.281914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593466+0000","last_change":"2024-09-12T01:44:34.589398+0000","last_active":"2024-09-12T01:44:34.593466+0000","last_peered":"2024-09-12T01:44:34.593466+0000","last_clean":"2024-09-12T01:44:34.593466+0000","last_became_active":"2024-09-12T01:44:34.589132+0000","last_became_peered":"2024-09-12T01:44:34.589132+0000","last_unstale":"2024-09-12T01:44:34.593466+0000","last_undegraded":"2024-09-12T01:44:34.593466+0000","last_fullsized":"2024-09-12T01:44:34.593466+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.806227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583277+0000","last_change":"2024-09-12T01:44:34.582405+0000","last_active":"2024-09-12T01:44:34.583277+0000","last_peered":"2024-09-12T01:44:34.583277+0000","last_clean":"2024-09-12T01:44:34.583277+0000","last_became_active":"2024-09-12T01:44:34.582107+0000","last_became_peered":"2024-09-12T01:44:34.582107+0000","last_unstale":"2024-09-12T01:44:34.583277+0000","last_undegraded":"2024-09-12T01:44:34.583277+0000","last_fullsized":"2024-09-12T01:44:34.583277+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:51.464037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592952+0000","last_change":"2024-09-12T01:44:34.587622+0000","last_active":"2024-09-12T01:44:34.592952+0000","last_peered":"2024-09-12T01:44:34.592952+0000","last_clean":"2024-09-12T01:44:34.592952+0000","last_became_active":"2024-09-12T01:44:34.587309+0000","last_became_peered":"2024-09-12T01:44:34.587309+0000","last_unstale":"2024-09-12T01:44:34.592952+0000","last_undegraded":"2024-09-12T01:44:34.592952+0000","last_fullsized":"2024-09-12T01:44:34.592952+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:22.658357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573760+0000","last_change":"2024-09-12T01:44:34.581035+0000","last_active":"2024-09-12T01:44:35.573760+0000","last_peered":"2024-09-12T01:44:35.573760+0000","last_clean":"2024-09-12T01:44:35.573760+0000","last_became_active":"2024-09-12T01:44:34.580768+0000","last_became_peered":"2024-09-12T01:44:34.580768+0000","last_unstale":"2024-09-12T01:44:35.573760+0000","last_undegraded":"2024-09-12T01:44:35.573760+0000","last_fullsized":"2024-09-12T01:44:35.573760+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:14.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573365+0000","last_change":"2024-09-12T01:44:34.582605+0000","last_active":"2024-09-12T01:44:35.573365+0000","last_peered":"2024-09-12T01:44:35.573365+0000","last_clean":"2024-09-12T01:44:35.573365+0000","last_became_active":"2024-09-12T01:44:34.582322+0000","last_became_peered":"2024-09-12T01:44:34.582322+0000","last_unstale":"2024-09-12T01:44:35.573365+0000","last_undegraded":"2024-09-12T01:44:35.573365+0000","last_fullsized":"2024-09-12T01:44:35.573365+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:01.900564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573363+0000","last_change":"2024-09-12T01:44:34.587381+0000","last_active":"2024-09-12T01:44:35.573363+0000","last_peered":"2024-09-12T01:44:35.573363+0000","last_clean":"2024-09-12T01:44:35.573363+0000","last_became_active":"2024-09-12T01:44:34.586812+0000","last_became_peered":"2024-09-12T01:44:34.586812+0000","last_unstale":"2024-09-12T01:44:35.573363+0000","last_undegraded":"2024-09-12T01:44:35.573363+0000","last_fullsized":"2024-09-12T01:44:35.573363+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:11.765535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592991+0000","last_change":"2024-09-12T01:44:34.587979+0000","last_active":"2024-09-12T01:44:34.592991+0000","last_peered":"2024-09-12T01:44:34.592991+0000","last_clean":"2024-09-12T01:44:34.592991+0000","last_became_active":"2024-09-12T01:44:34.587628+0000","last_became_peered":"2024-09-12T01:44:34.587628+0000","last_unstale":"2024-09-12T01:44:34.592991+0000","last_undegraded":"2024-09-12T01:44:34.592991+0000","last_fullsized":"2024-09-12T01:44:34.592991+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:42.799915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593669+0000","last_change":"2024-09-12T01:44:34.591685+0000","last_active":"2024-09-12T01:44:34.593669+0000","last_peered":"2024-09-12T01:44:34.593669+0000","last_clean":"2024-09-12T01:44:34.593669+0000","last_became_active":"2024-09-12T01:44:34.591395+0000","last_became_peered":"2024-09-12T01:44:34.591395+0000","last_unstale":"2024-09-12T01:44:34.593669+0000","last_undegraded":"2024-09-12T01:44:34.593669+0000","last_fullsized":"2024-09-12T01:44:34.593669+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.281914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590619+0000","last_change":"2024-09-12T01:44:34.585126+0000","last_active":"2024-09-12T01:44:34.590619+0000","last_peered":"2024-09-12T01:44:34.590619+0000","last_clean":"2024-09-12T01:44:34.590619+0000","last_became_active":"2024-09-12T01:44:34.584665+0000","last_became_peered":"2024-09-12T01:44:34.584665+0000","last_unstale":"2024-09-12T01:44:34.590619+0000","last_undegraded":"2024-09-12T01:44:34.590619+0000","last_fullsized":"2024-09-12T01:44:34.590619+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:59.840812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586620+0000","last_change":"2024-09-12T01:44:34.581891+0000","last_active":"2024-09-12T01:44:34.586620+0000","last_peered":"2024-09-12T01:44:34.586620+0000","last_clean":"2024-09-12T01:44:34.586620+0000","last_became_active":"2024-09-12T01:44:34.581603+0000","last_became_peered":"2024-09-12T01:44:34.581603+0000","last_unstale":"2024-09-12T01:44:34.586620+0000","last_undegraded":"2024-09-12T01:44:34.586620+0000","last_fullsized":"2024-09-12T01:44:34.586620+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:32.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.557842+0000","last_change":"2024-09-12T01:44:33.557842+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.557842+0000","last_undegraded":"2024-09-12T01:44:33.557842+0000","last_fullsized":"2024-09-12T01:44:33.557842+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583062+0000","last_change":"2024-09-12T01:44:34.578536+0000","last_active":"2024-09-12T01:44:34.583062+0000","last_peered":"2024-09-12T01:44:34.583062+0000","last_clean":"2024-09-12T01:44:34.583062+0000","last_became_active":"2024-09-12T01:44:34.578194+0000","last_became_peered":"2024-09-12T01:44:34.578194+0000","last_unstale":"2024-09-12T01:44:34.583062+0000","last_undegraded":"2024-09-12T01:44:34.583062+0000","last_fullsized":"2024-09-12T01:44:34.583062+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:06.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573384+0000","last_change":"2024-09-12T01:44:34.574426+0000","last_active":"2024-09-12T01:44:35.573384+0000","last_peered":"2024-09-12T01:44:35.573384+0000","last_clean":"2024-09-12T01:44:35.573384+0000","last_became_active":"2024-09-12T01:44:34.574151+0000","last_became_peered":"2024-09-12T01:44:34.574151+0000","last_unstale":"2024-09-12T01:44:35.573384+0000","last_undegraded":"2024-09-12T01:44:35.573384+0000","last_fullsized":"2024-09-12T01:44:35.573384+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:11.234396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.581027+0000","last_change":"2024-09-12T01:44:34.578057+0000","last_active":"2024-09-12T01:44:34.581027+0000","last_peered":"2024-09-12T01:44:34.581027+0000","last_clean":"2024-09-12T01:44:34.581027+0000","last_became_active":"2024-09-12T01:44:34.577776+0000","last_became_peered":"2024-09-12T01:44:34.577776+0000","last_unstale":"2024-09-12T01:44:34.581027+0000","last_undegraded":"2024-09-12T01:44:34.581027+0000","last_fullsized":"2024-09-12T01:44:34.581027+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:14.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574004+0000","last_change":"2024-09-12T01:44:34.569162+0000","last_active":"2024-09-12T01:44:35.574004+0000","last_peered":"2024-09-12T01:44:35.574004+0000","last_clean":"2024-09-12T01:44:35.574004+0000","last_became_active":"2024-09-12T01:44:34.568844+0000","last_became_peered":"2024-09-12T01:44:34.568844+0000","last_unstale":"2024-09-12T01:44:35.574004+0000","last_undegraded":"2024-09-12T01:44:35.574004+0000","last_fullsized":"2024-09-12T01:44:35.574004+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:33.785177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573911+0000","last_change":"2024-09-12T01:44:34.568333+0000","last_active":"2024-09-12T01:44:35.573911+0000","last_peered":"2024-09-12T01:44:35.573911+0000","last_clean":"2024-09-12T01:44:35.573911+0000","last_became_active":"2024-09-12T01:44:34.566942+0000","last_became_peered":"2024-09-12T01:44:34.566942+0000","last_unstale":"2024-09-12T01:44:35.573911+0000","last_undegraded":"2024-09-12T01:44:35.573911+0000","last_fullsized":"2024-09-12T01:44:35.573911+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:59.446473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573434+0000","last_change":"2024-09-12T01:44:34.574892+0000","last_active":"2024-09-12T01:44:35.573434+0000","last_peered":"2024-09-12T01:44:35.573434+0000","last_clean":"2024-09-12T01:44:35.573434+0000","last_became_active":"2024-09-12T01:44:34.574240+0000","last_became_peered":"2024-09-12T01:44:34.574240+0000","last_unstale":"2024-09-12T01:44:35.573434+0000","last_undegraded":"2024-09-12T01:44:35.573434+0000","last_fullsized":"2024-09-12T01:44:35.573434+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:03.484850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573730+0000","last_change":"2024-09-12T01:44:34.578283+0000","last_active":"2024-09-12T01:44:35.573730+0000","last_peered":"2024-09-12T01:44:35.573730+0000","last_clean":"2024-09-12T01:44:35.573730+0000","last_became_active":"2024-09-12T01:44:34.578019+0000","last_became_peered":"2024-09-12T01:44:34.578019+0000","last_unstale":"2024-09-12T01:44:35.573730+0000","last_undegraded":"2024-09-12T01:44:35.573730+0000","last_fullsized":"2024-09-12T01:44:35.573730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:19.132628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574318+0000","last_change":"2024-09-12T01:44:34.577407+0000","last_active":"2024-09-12T01:44:35.574318+0000","last_peered":"2024-09-12T01:44:35.574318+0000","last_clean":"2024-09-12T01:44:35.574318+0000","last_became_active":"2024-09-12T01:44:34.571477+0000","last_became_peered":"2024-09-12T01:44:34.571477+0000","last_unstale":"2024-09-12T01:44:35.574318+0000","last_undegraded":"2024-09-12T01:44:35.574318+0000","last_fullsized":"2024-09-12T01:44:35.574318+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:03.884787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573865+0000","last_change":"2024-09-12T01:44:34.579449+0000","last_active":"2024-09-12T01:44:35.573865+0000","last_peered":"2024-09-12T01:44:35.573865+0000","last_clean":"2024-09-12T01:44:35.573865+0000","last_became_active":"2024-09-12T01:44:34.579170+0000","last_became_peered":"2024-09-12T01:44:34.579170+0000","last_unstale":"2024-09-12T01:44:35.573865+0000","last_undegraded":"2024-09-12T01:44:35.573865+0000","last_fullsized":"2024-09-12T01:44:35.573865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:53.515628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583215+0000","last_change":"2024-09-12T01:44:34.580740+0000","last_active":"2024-09-12T01:44:34.583215+0000","last_peered":"2024-09-12T01:44:34.583215+0000","last_clean":"2024-09-12T01:44:34.583215+0000","last_became_active":"2024-09-12T01:44:34.580371+0000","last_became_peered":"2024-09-12T01:44:34.580371+0000","last_unstale":"2024-09-12T01:44:34.583215+0000","last_undegraded":"2024-09-12T01:44:34.583215+0000","last_fullsized":"2024-09-12T01:44:34.583215+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.079241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576943+0000","last_change":"2024-09-12T01:44:34.567435+0000","last_active":"2024-09-12T01:44:35.576943+0000","last_peered":"2024-09-12T01:44:35.576943+0000","last_clean":"2024-09-12T01:44:35.576943+0000","last_became_active":"2024-09-12T01:44:34.567107+0000","last_became_peered":"2024-09-12T01:44:34.567107+0000","last_unstale":"2024-09-12T01:44:35.576943+0000","last_undegraded":"2024-09-12T01:44:35.576943+0000","last_fullsized":"2024-09-12T01:44:35.576943+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:36.649302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.581883+0000","last_change":"2024-09-12T01:44:34.580274+0000","last_active":"2024-09-12T01:44:34.581883+0000","last_peered":"2024-09-12T01:44:34.581883+0000","last_clean":"2024-09-12T01:44:34.581883+0000","last_became_active":"2024-09-12T01:44:34.579917+0000","last_became_peered":"2024-09-12T01:44:34.579917+0000","last_unstale":"2024-09-12T01:44:34.581883+0000","last_undegraded":"2024-09-12T01:44:34.581883+0000","last_fullsized":"2024-09-12T01:44:34.581883+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.768947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576831+0000","last_change":"2024-09-12T01:44:34.577332+0000","last_active":"2024-09-12T01:44:35.576831+0000","last_peered":"2024-09-12T01:44:35.576831+0000","last_clean":"2024-09-12T01:44:35.576831+0000","last_became_active":"2024-09-12T01:44:34.576807+0000","last_became_peered":"2024-09-12T01:44:34.576807+0000","last_unstale":"2024-09-12T01:44:35.576831+0000","last_undegraded":"2024-09-12T01:44:35.576831+0000","last_fullsized":"2024-09-12T01:44:35.576831+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.911212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582646+0000","last_change":"2024-09-12T01:44:34.579014+0000","last_active":"2024-09-12T01:44:34.582646+0000","last_peered":"2024-09-12T01:44:34.582646+0000","last_clean":"2024-09-12T01:44:34.582646+0000","last_became_active":"2024-09-12T01:44:34.577666+0000","last_became_peered":"2024-09-12T01:44:34.577666+0000","last_unstale":"2024-09-12T01:44:34.582646+0000","last_undegraded":"2024-09-12T01:44:34.582646+0000","last_fullsized":"2024-09-12T01:44:34.582646+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:33.785177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.557343+0000","last_change":"2024-09-12T01:44:33.557343+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.557343+0000","last_undegraded":"2024-09-12T01:44:33.557343+0000","last_fullsized":"2024-09-12T01:44:33.557343+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"138'4","reported_seq":18,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577263+0000","last_change":"2024-09-12T01:44:33.562262+0000","last_active":"2024-09-12T01:44:35.577263+0000","last_peered":"2024-09-12T01:44:35.577263+0000","last_clean":"2024-09-12T01:44:35.577263+0000","last_became_active":"2024-09-12T01:44:33.561973+0000","last_became_peered":"2024-09-12T01:44:33.561973+0000","last_unstale":"2024-09-12T01:44:35.577263+0000","last_undegraded":"2024-09-12T01:44:35.577263+0000","last_fullsized":"2024-09-12T01:44:35.577263+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:50.459258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577264+0000","last_change":"2024-09-12T01:44:34.572331+0000","last_active":"2024-09-12T01:44:35.577264+0000","last_peered":"2024-09-12T01:44:35.577264+0000","last_clean":"2024-09-12T01:44:35.577264+0000","last_became_active":"2024-09-12T01:44:34.572042+0000","last_became_peered":"2024-09-12T01:44:34.572042+0000","last_unstale":"2024-09-12T01:44:35.577264+0000","last_undegraded":"2024-09-12T01:44:35.577264+0000","last_fullsized":"2024-09-12T01:44:35.577264+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:15.763728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"138'1","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592860+0000","last_change":"2024-09-12T01:44:33.571315+0000","last_active":"2024-09-12T01:44:34.592860+0000","last_peered":"2024-09-12T01:44:34.592860+0000","last_clean":"2024-09-12T01:44:34.592860+0000","last_became_active":"2024-09-12T01:44:33.570791+0000","last_became_peered":"2024-09-12T01:44:33.570791+0000","last_unstale":"2024-09-12T01:44:34.592860+0000","last_undegraded":"2024-09-12T01:44:34.592860+0000","last_fullsized":"2024-09-12T01:44:34.592860+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:15.839665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.579947+0000","last_change":"2024-09-12T01:44:34.578171+0000","last_active":"2024-09-12T01:44:34.579947+0000","last_peered":"2024-09-12T01:44:34.579947+0000","last_clean":"2024-09-12T01:44:34.579947+0000","last_became_active":"2024-09-12T01:44:34.577874+0000","last_became_peered":"2024-09-12T01:44:34.577874+0000","last_unstale":"2024-09-12T01:44:34.579947+0000","last_undegraded":"2024-09-12T01:44:34.579947+0000","last_fullsized":"2024-09-12T01:44:34.579947+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:58.704148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590018+0000","last_change":"2024-09-12T01:44:33.564326+0000","last_active":"2024-09-12T01:44:34.590018+0000","last_peered":"2024-09-12T01:44:34.590018+0000","last_clean":"2024-09-12T01:44:34.590018+0000","last_became_active":"2024-09-12T01:44:33.564082+0000","last_became_peered":"2024-09-12T01:44:33.564082+0000","last_unstale":"2024-09-12T01:44:34.590018+0000","last_undegraded":"2024-09-12T01:44:34.590018+0000","last_fullsized":"2024-09-12T01:44:34.590018+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:24.184840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593488+0000","last_change":"2024-09-12T01:44:34.590779+0000","last_active":"2024-09-12T01:44:34.593488+0000","last_peered":"2024-09-12T01:44:34.593488+0000","last_clean":"2024-09-12T01:44:34.593488+0000","last_became_active":"2024-09-12T01:44:34.590440+0000","last_became_peered":"2024-09-12T01:44:34.590440+0000","last_unstale":"2024-09-12T01:44:34.593488+0000","last_undegraded":"2024-09-12T01:44:34.593488+0000","last_fullsized":"2024-09-12T01:44:34.593488+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:06.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573976+0000","last_change":"2024-09-12T01:44:33.562995+0000","last_active":"2024-09-12T01:44:35.573976+0000","last_peered":"2024-09-12T01:44:35.573976+0000","last_clean":"2024-09-12T01:44:35.573976+0000","last_became_active":"2024-09-12T01:44:33.562650+0000","last_became_peered":"2024-09-12T01:44:33.562650+0000","last_unstale":"2024-09-12T01:44:35.573976+0000","last_undegraded":"2024-09-12T01:44:35.573976+0000","last_fullsized":"2024-09-12T01:44:35.573976+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560028+0000","last_change":"2024-09-12T01:44:33.560028+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560028+0000","last_undegraded":"2024-09-12T01:44:33.560028+0000","last_fullsized":"2024-09-12T01:44:33.560028+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577066+0000","last_change":"2024-09-12T01:44:33.571205+0000","last_active":"2024-09-12T01:44:35.577066+0000","last_peered":"2024-09-12T01:44:35.577066+0000","last_clean":"2024-09-12T01:44:35.577066+0000","last_became_active":"2024-09-12T01:44:33.570909+0000","last_became_peered":"2024-09-12T01:44:33.570909+0000","last_unstale":"2024-09-12T01:44:35.577066+0000","last_undegraded":"2024-09-12T01:44:35.577066+0000","last_fullsized":"2024-09-12T01:44:35.577066+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:05.134312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582675+0000","last_change":"2024-09-12T01:44:34.578688+0000","last_active":"2024-09-12T01:44:34.582675+0000","last_peered":"2024-09-12T01:44:34.582675+0000","last_clean":"2024-09-12T01:44:34.582675+0000","last_became_active":"2024-09-12T01:44:34.578415+0000","last_became_peered":"2024-09-12T01:44:34.578415+0000","last_unstale":"2024-09-12T01:44:34.582675+0000","last_undegraded":"2024-09-12T01:44:34.582675+0000","last_fullsized":"2024-09-12T01:44:34.582675+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:53.515628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-12T01:44:33.570379+0000","last_change":"2024-09-12T01:44:33.569461+0000","last_active":"2024-09-12T01:44:33.570379+0000","last_peered":"2024-09-12T01:44:33.570379+0000","last_clean":"2024-09-12T01:44:33.570379+0000","last_became_active":"2024-09-12T01:44:33.569155+0000","last_became_peered":"2024-09-12T01:44:33.569155+0000","last_unstale":"2024-09-12T01:44:33.570379+0000","last_undegraded":"2024-09-12T01:44:33.570379+0000","last_fullsized":"2024-09-12T01:44:33.570379+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:21.354429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573629+0000","last_change":"2024-09-12T01:44:34.569126+0000","last_active":"2024-09-12T01:44:35.573629+0000","last_peered":"2024-09-12T01:44:35.573629+0000","last_clean":"2024-09-12T01:44:35.573629+0000","last_became_active":"2024-09-12T01:44:34.568830+0000","last_became_peered":"2024-09-12T01:44:34.568830+0000","last_unstale":"2024-09-12T01:44:35.573629+0000","last_undegraded":"2024-09-12T01:44:35.573629+0000","last_fullsized":"2024-09-12T01:44:35.573629+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:18.088120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576891+0000","last_change":"2024-09-12T01:44:33.569947+0000","last_active":"2024-09-12T01:44:35.576891+0000","last_peered":"2024-09-12T01:44:35.576891+0000","last_clean":"2024-09-12T01:44:35.576891+0000","last_became_active":"2024-09-12T01:44:33.569378+0000","last_became_peered":"2024-09-12T01:44:33.569378+0000","last_unstale":"2024-09-12T01:44:35.576891+0000","last_undegraded":"2024-09-12T01:44:35.576891+0000","last_fullsized":"2024-09-12T01:44:35.576891+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:21.653578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560355+0000","last_change":"2024-09-12T01:44:33.560355+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560355+0000","last_undegraded":"2024-09-12T01:44:33.560355+0000","last_fullsized":"2024-09-12T01:44:33.560355+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573874+0000","last_change":"2024-09-12T01:44:33.566465+0000","last_active":"2024-09-12T01:44:35.573874+0000","last_peered":"2024-09-12T01:44:35.573874+0000","last_clean":"2024-09-12T01:44:35.573874+0000","last_became_active":"2024-09-12T01:44:33.566147+0000","last_became_peered":"2024-09-12T01:44:33.566147+0000","last_unstale":"2024-09-12T01:44:35.573874+0000","last_undegraded":"2024-09-12T01:44:35.573874+0000","last_fullsized":"2024-09-12T01:44:35.573874+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:42.446369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.588131+0000","last_change":"2024-09-12T01:44:34.583987+0000","last_active":"2024-09-12T01:44:34.588131+0000","last_peered":"2024-09-12T01:44:34.588131+0000","last_clean":"2024-09-12T01:44:34.588131+0000","last_became_active":"2024-09-12T01:44:34.583670+0000","last_became_peered":"2024-09-12T01:44:34.583670+0000","last_unstale":"2024-09-12T01:44:34.588131+0000","last_undegraded":"2024-09-12T01:44:34.588131+0000","last_fullsized":"2024-09-12T01:44:34.588131+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:23.984044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.572301+0000","last_change":"2024-09-12T01:44:33.568793+0000","last_active":"2024-09-12T01:44:34.572301+0000","last_peered":"2024-09-12T01:44:34.572301+0000","last_clean":"2024-09-12T01:44:34.572301+0000","last_became_active":"2024-09-12T01:44:33.568545+0000","last_became_peered":"2024-09-12T01:44:33.568545+0000","last_unstale":"2024-09-12T01:44:34.572301+0000","last_undegraded":"2024-09-12T01:44:34.572301+0000","last_fullsized":"2024-09-12T01:44:34.572301+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:02.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590661+0000","last_change":"2024-09-12T01:44:34.584292+0000","last_active":"2024-09-12T01:44:34.590661+0000","last_peered":"2024-09-12T01:44:34.590661+0000","last_clean":"2024-09-12T01:44:34.590661+0000","last_became_active":"2024-09-12T01:44:34.583648+0000","last_became_peered":"2024-09-12T01:44:34.583648+0000","last_unstale":"2024-09-12T01:44:34.590661+0000","last_undegraded":"2024-09-12T01:44:34.590661+0000","last_fullsized":"2024-09-12T01:44:34.590661+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:01.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"138'3","reported_seq":17,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574365+0000","last_change":"2024-09-12T01:44:33.561874+0000","last_active":"2024-09-12T01:44:35.574365+0000","last_peered":"2024-09-12T01:44:35.574365+0000","last_clean":"2024-09-12T01:44:35.574365+0000","last_became_active":"2024-09-12T01:44:33.561180+0000","last_became_peered":"2024-09-12T01:44:33.561180+0000","last_unstale":"2024-09-12T01:44:35.574365+0000","last_undegraded":"2024-09-12T01:44:35.574365+0000","last_fullsized":"2024-09-12T01:44:35.574365+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.801449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577045+0000","last_change":"2024-09-12T01:44:34.570692+0000","last_active":"2024-09-12T01:44:35.577045+0000","last_peered":"2024-09-12T01:44:35.577045+0000","last_clean":"2024-09-12T01:44:35.577045+0000","last_became_active":"2024-09-12T01:44:34.570372+0000","last_became_peered":"2024-09-12T01:44:34.570372+0000","last_unstale":"2024-09-12T01:44:35.577045+0000","last_undegraded":"2024-09-12T01:44:35.577045+0000","last_fullsized":"2024-09-12T01:44:35.577045+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:06.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"138'6","reported_seq":20,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574109+0000","last_change":"2024-09-12T01:44:33.561870+0000","last_active":"2024-09-12T01:44:35.574109+0000","last_peered":"2024-09-12T01:44:35.574109+0000","last_clean":"2024-09-12T01:44:35.574109+0000","last_became_active":"2024-09-12T01:44:33.561575+0000","last_became_peered":"2024-09-12T01:44:33.561575+0000","last_unstale":"2024-09-12T01:44:35.574109+0000","last_undegraded":"2024-09-12T01:44:35.574109+0000","last_fullsized":"2024-09-12T01:44:35.574109+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:28.447167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583184+0000","last_change":"2024-09-12T01:44:34.580219+0000","last_active":"2024-09-12T01:44:34.583184+0000","last_peered":"2024-09-12T01:44:34.583184+0000","last_clean":"2024-09-12T01:44:34.583184+0000","last_became_active":"2024-09-12T01:44:34.579863+0000","last_became_peered":"2024-09-12T01:44:34.579863+0000","last_unstale":"2024-09-12T01:44:34.583184+0000","last_undegraded":"2024-09-12T01:44:34.583184+0000","last_fullsized":"2024-09-12T01:44:34.583184+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:39.869863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-12T01:44:33.567606+0000","last_change":"2024-09-12T01:44:33.566891+0000","last_active":"2024-09-12T01:44:33.567606+0000","last_peered":"2024-09-12T01:44:33.567606+0000","last_clean":"2024-09-12T01:44:33.567606+0000","last_became_active":"2024-09-12T01:44:33.566599+0000","last_became_peered":"2024-09-12T01:44:33.566599+0000","last_unstale":"2024-09-12T01:44:33.567606+0000","last_undegraded":"2024-09-12T01:44:33.567606+0000","last_fullsized":"2024-09-12T01:44:33.567606+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:43.374724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574087+0000","last_change":"2024-09-12T01:44:34.582387+0000","last_active":"2024-09-12T01:44:35.574087+0000","last_peered":"2024-09-12T01:44:35.574087+0000","last_clean":"2024-09-12T01:44:35.574087+0000","last_became_active":"2024-09-12T01:44:34.582096+0000","last_became_peered":"2024-09-12T01:44:34.582096+0000","last_unstale":"2024-09-12T01:44:35.574087+0000","last_undegraded":"2024-09-12T01:44:35.574087+0000","last_fullsized":"2024-09-12T01:44:35.574087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:51.107638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.573223+0000","last_change":"2024-09-12T01:44:33.558602+0000","last_active":"2024-09-12T01:44:34.573223+0000","last_peered":"2024-09-12T01:44:34.573223+0000","last_clean":"2024-09-12T01:44:34.573223+0000","last_became_active":"2024-09-12T01:44:33.558246+0000","last_became_peered":"2024-09-12T01:44:33.558246+0000","last_unstale":"2024-09-12T01:44:34.573223+0000","last_undegraded":"2024-09-12T01:44:34.573223+0000","last_fullsized":"2024-09-12T01:44:34.573223+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:18.127850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586616+0000","last_change":"2024-09-12T01:44:34.579825+0000","last_active":"2024-09-12T01:44:34.586616+0000","last_peered":"2024-09-12T01:44:34.586616+0000","last_clean":"2024-09-12T01:44:34.586616+0000","last_became_active":"2024-09-12T01:44:34.579565+0000","last_became_peered":"2024-09-12T01:44:34.579565+0000","last_unstale":"2024-09-12T01:44:34.586616+0000","last_undegraded":"2024-09-12T01:44:34.586616+0000","last_fullsized":"2024-09-12T01:44:34.586616+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:58.038820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.569789+0000","last_change":"2024-09-12T01:44:33.565496+0000","last_active":"2024-09-12T01:44:34.569789+0000","last_peered":"2024-09-12T01:44:34.569789+0000","last_clean":"2024-09-12T01:44:34.569789+0000","last_became_active":"2024-09-12T01:44:33.565197+0000","last_became_peered":"2024-09-12T01:44:33.565197+0000","last_unstale":"2024-09-12T01:44:34.569789+0000","last_undegraded":"2024-09-12T01:44:34.569789+0000","last_fullsized":"2024-09-12T01:44:34.569789+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582599+0000","last_change":"2024-09-12T01:44:34.580307+0000","last_active":"2024-09-12T01:44:34.582599+0000","last_peered":"2024-09-12T01:44:34.582599+0000","last_clean":"2024-09-12T01:44:34.582599+0000","last_became_active":"2024-09-12T01:44:34.579921+0000","last_became_peered":"2024-09-12T01:44:34.579921+0000","last_unstale":"2024-09-12T01:44:34.582599+0000","last_undegraded":"2024-09-12T01:44:34.582599+0000","last_fullsized":"2024-09-12T01:44:34.582599+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:41.766067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"138'8","reported_seq":22,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574137+0000","last_change":"2024-09-12T01:44:33.558236+0000","last_active":"2024-09-12T01:44:35.574137+0000","last_peered":"2024-09-12T01:44:35.574137+0000","last_clean":"2024-09-12T01:44:35.574137+0000","last_became_active":"2024-09-12T01:44:33.557953+0000","last_became_peered":"2024-09-12T01:44:33.557953+0000","last_unstale":"2024-09-12T01:44:35.574137+0000","last_undegraded":"2024-09-12T01:44:35.574137+0000","last_fullsized":"2024-09-12T01:44:35.574137+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:12.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590830+0000","last_change":"2024-09-12T01:44:34.589581+0000","last_active":"2024-09-12T01:44:34.590830+0000","last_peered":"2024-09-12T01:44:34.590830+0000","last_clean":"2024-09-12T01:44:34.590830+0000","last_became_active":"2024-09-12T01:44:34.589048+0000","last_became_peered":"2024-09-12T01:44:34.589048+0000","last_unstale":"2024-09-12T01:44:34.590830+0000","last_undegraded":"2024-09-12T01:44:34.590830+0000","last_fullsized":"2024-09-12T01:44:34.590830+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:25.732831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573933+0000","last_change":"2024-09-12T01:44:33.557600+0000","last_active":"2024-09-12T01:44:35.573933+0000","last_peered":"2024-09-12T01:44:35.573933+0000","last_clean":"2024-09-12T01:44:35.573933+0000","last_became_active":"2024-09-12T01:44:33.557317+0000","last_became_peered":"2024-09-12T01:44:33.557317+0000","last_unstale":"2024-09-12T01:44:35.573933+0000","last_undegraded":"2024-09-12T01:44:35.573933+0000","last_fullsized":"2024-09-12T01:44:35.573933+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:34.330164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560947+0000","last_change":"2024-09-12T01:44:33.560947+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560947+0000","last_undegraded":"2024-09-12T01:44:33.560947+0000","last_fullsized":"2024-09-12T01:44:33.560947+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.596296+0000","last_change":"2024-09-12T01:44:33.570978+0000","last_active":"2024-09-12T01:44:34.596296+0000","last_peered":"2024-09-12T01:44:34.596296+0000","last_clean":"2024-09-12T01:44:34.596296+0000","last_became_active":"2024-09-12T01:44:33.570604+0000","last_became_peered":"2024-09-12T01:44:33.570604+0000","last_unstale":"2024-09-12T01:44:34.596296+0000","last_undegraded":"2024-09-12T01:44:34.596296+0000","last_fullsized":"2024-09-12T01:44:34.596296+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:08.714197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560122+0000","last_change":"2024-09-12T01:44:33.560122+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560122+0000","last_undegraded":"2024-09-12T01:44:33.560122+0000","last_fullsized":"2024-09-12T01:44:33.560122+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574107+0000","last_change":"2024-09-12T01:44:33.564371+0000","last_active":"2024-09-12T01:44:35.574107+0000","last_peered":"2024-09-12T01:44:35.574107+0000","last_clean":"2024-09-12T01:44:35.574107+0000","last_became_active":"2024-09-12T01:44:33.564044+0000","last_became_peered":"2024-09-12T01:44:33.564044+0000","last_unstale":"2024-09-12T01:44:35.574107+0000","last_undegraded":"2024-09-12T01:44:35.574107+0000","last_fullsized":"2024-09-12T01:44:35.574107+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:57.461543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574320+0000","last_change":"2024-09-12T01:44:34.577881+0000","last_active":"2024-09-12T01:44:35.574320+0000","last_peered":"2024-09-12T01:44:35.574320+0000","last_clean":"2024-09-12T01:44:35.574320+0000","last_became_active":"2024-09-12T01:44:34.571399+0000","last_became_peered":"2024-09-12T01:44:34.571399+0000","last_unstale":"2024-09-12T01:44:35.574320+0000","last_undegraded":"2024-09-12T01:44:35.574320+0000","last_fullsized":"2024-09-12T01:44:35.574320+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:36.649302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573487+0000","last_change":"2024-09-12T01:44:33.563195+0000","last_active":"2024-09-12T01:44:35.573487+0000","last_peered":"2024-09-12T01:44:35.573487+0000","last_clean":"2024-09-12T01:44:35.573487+0000","last_became_active":"2024-09-12T01:44:33.562898+0000","last_became_peered":"2024-09-12T01:44:33.562898+0000","last_unstale":"2024-09-12T01:44:35.573487+0000","last_undegraded":"2024-09-12T01:44:35.573487+0000","last_fullsized":"2024-09-12T01:44:35.573487+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:59.939596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576984+0000","last_change":"2024-09-12T01:44:34.576473+0000","last_active":"2024-09-12T01:44:35.576984+0000","last_peered":"2024-09-12T01:44:35.576984+0000","last_clean":"2024-09-12T01:44:35.576984+0000","last_became_active":"2024-09-12T01:44:34.576143+0000","last_became_peered":"2024-09-12T01:44:34.576143+0000","last_unstale":"2024-09-12T01:44:35.576984+0000","last_undegraded":"2024-09-12T01:44:35.576984+0000","last_fullsized":"2024-09-12T01:44:35.576984+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:29.139125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574252+0000","last_change":"2024-09-12T01:44:33.555265+0000","last_active":"2024-09-12T01:44:35.574252+0000","last_peered":"2024-09-12T01:44:35.574252+0000","last_clean":"2024-09-12T01:44:35.574252+0000","last_became_active":"2024-09-12T01:44:33.554630+0000","last_became_peered":"2024-09-12T01:44:33.554630+0000","last_unstale":"2024-09-12T01:44:35.574252+0000","last_undegraded":"2024-09-12T01:44:35.574252+0000","last_fullsized":"2024-09-12T01:44:35.574252+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:53.277135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574227+0000","last_change":"2024-09-12T01:44:34.580476+0000","last_active":"2024-09-12T01:44:35.574227+0000","last_peered":"2024-09-12T01:44:35.574227+0000","last_clean":"2024-09-12T01:44:35.574227+0000","last_became_active":"2024-09-12T01:44:34.579803+0000","last_became_peered":"2024-09-12T01:44:34.579803+0000","last_unstale":"2024-09-12T01:44:35.574227+0000","last_undegraded":"2024-09-12T01:44:35.574227+0000","last_fullsized":"2024-09-12T01:44:35.574227+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.911212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573217+0000","last_change":"2024-09-12T01:44:33.556147+0000","last_active":"2024-09-12T01:44:35.573217+0000","last_peered":"2024-09-12T01:44:35.573217+0000","last_clean":"2024-09-12T01:44:35.573217+0000","last_became_active":"2024-09-12T01:44:33.555852+0000","last_became_peered":"2024-09-12T01:44:33.555852+0000","last_unstale":"2024-09-12T01:44:35.573217+0000","last_undegraded":"2024-09-12T01:44:35.573217+0000","last_fullsized":"2024-09-12T01:44:35.573217+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:25.006137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576742+0000","last_change":"2024-09-12T01:44:34.579386+0000","last_active":"2024-09-12T01:44:35.576742+0000","last_peered":"2024-09-12T01:44:35.576742+0000","last_clean":"2024-09-12T01:44:35.576742+0000","last_became_active":"2024-09-12T01:44:34.579004+0000","last_became_peered":"2024-09-12T01:44:34.579004+0000","last_unstale":"2024-09-12T01:44:35.576742+0000","last_undegraded":"2024-09-12T01:44:35.576742+0000","last_fullsized":"2024-09-12T01:44:35.576742+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:59.446473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-12T01:44:33.570870+0000","last_change":"2024-09-12T01:44:33.570319+0000","last_active":"2024-09-12T01:44:33.570870+0000","last_peered":"2024-09-12T01:44:33.570870+0000","last_clean":"2024-09-12T01:44:33.570870+0000","last_became_active":"2024-09-12T01:44:33.570021+0000","last_became_peered":"2024-09-12T01:44:33.570021+0000","last_unstale":"2024-09-12T01:44:33.570870+0000","last_undegraded":"2024-09-12T01:44:33.570870+0000","last_fullsized":"2024-09-12T01:44:33.570870+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:51.216059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583126+0000","last_change":"2024-09-12T01:44:34.579335+0000","last_active":"2024-09-12T01:44:34.583126+0000","last_peered":"2024-09-12T01:44:34.583126+0000","last_clean":"2024-09-12T01:44:34.583126+0000","last_became_active":"2024-09-12T01:44:34.578948+0000","last_became_peered":"2024-09-12T01:44:34.578948+0000","last_unstale":"2024-09-12T01:44:34.583126+0000","last_undegraded":"2024-09-12T01:44:34.583126+0000","last_fullsized":"2024-09-12T01:44:34.583126+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:43.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573182+0000","last_change":"2024-09-12T01:44:33.562892+0000","last_active":"2024-09-12T01:44:35.573182+0000","last_peered":"2024-09-12T01:44:35.573182+0000","last_clean":"2024-09-12T01:44:35.573182+0000","last_became_active":"2024-09-12T01:44:33.562581+0000","last_became_peered":"2024-09-12T01:44:33.562581+0000","last_unstale":"2024-09-12T01:44:35.573182+0000","last_undegraded":"2024-09-12T01:44:35.573182+0000","last_fullsized":"2024-09-12T01:44:35.573182+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:36.009808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574480+0000","last_change":"2024-09-12T01:44:34.577117+0000","last_active":"2024-09-12T01:44:35.574480+0000","last_peered":"2024-09-12T01:44:35.574480+0000","last_clean":"2024-09-12T01:44:35.574480+0000","last_became_active":"2024-09-12T01:44:34.575726+0000","last_became_peered":"2024-09-12T01:44:34.575726+0000","last_unstale":"2024-09-12T01:44:35.574480+0000","last_undegraded":"2024-09-12T01:44:35.574480+0000","last_fullsized":"2024-09-12T01:44:35.574480+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:29.139125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.591091+0000","last_change":"2024-09-12T01:44:33.566034+0000","last_active":"2024-09-12T01:44:34.591091+0000","last_peered":"2024-09-12T01:44:34.591091+0000","last_clean":"2024-09-12T01:44:34.591091+0000","last_became_active":"2024-09-12T01:44:33.565748+0000","last_became_peered":"2024-09-12T01:44:33.565748+0000","last_unstale":"2024-09-12T01:44:34.591091+0000","last_undegraded":"2024-09-12T01:44:34.591091+0000","last_fullsized":"2024-09-12T01:44:34.591091+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:44.021918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560386+0000","last_change":"2024-09-12T01:44:33.560386+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560386+0000","last_undegraded":"2024-09-12T01:44:33.560386+0000","last_fullsized":"2024-09-12T01:44:33.560386+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"139'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576279+0000","last_change":"2024-09-12T01:44:33.568481+0000","last_active":"2024-09-12T01:44:35.576279+0000","last_peered":"2024-09-12T01:44:35.576279+0000","last_clean":"2024-09-12T01:44:35.576279+0000","last_became_active":"2024-09-12T01:44:33.568131+0000","last_became_peered":"2024-09-12T01:44:33.568131+0000","last_unstale":"2024-09-12T01:44:35.576279+0000","last_undegraded":"2024-09-12T01:44:35.576279+0000","last_fullsized":"2024-09-12T01:44:35.576279+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:06.349936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.558120+0000","last_change":"2024-09-12T01:44:33.558120+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.558120+0000","last_undegraded":"2024-09-12T01:44:33.558120+0000","last_fullsized":"2024-09-12T01:44:33.558120+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577169+0000","last_change":"2024-09-12T01:44:33.568264+0000","last_active":"2024-09-12T01:44:35.577169+0000","last_peered":"2024-09-12T01:44:35.577169+0000","last_clean":"2024-09-12T01:44:35.577169+0000","last_became_active":"2024-09-12T01:44:33.567714+0000","last_became_peered":"2024-09-12T01:44:33.567714+0000","last_unstale":"2024-09-12T01:44:35.577169+0000","last_undegraded":"2024-09-12T01:44:35.577169+0000","last_fullsized":"2024-09-12T01:44:35.577169+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.801449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":137,"state":"creating+peering","last_fresh":"2024-09-12T01:44:33.560175+0000","last_change":"2024-09-12T01:44:33.560175+0000","last_active":"2024-09-12T01:44:33.544679+0000","last_peered":"2024-09-12T01:44:33.544679+0000","last_clean":"2024-09-12T01:44:33.544679+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-12T01:44:33.560175+0000","last_undegraded":"2024-09-12T01:44:33.560175+0000","last_fullsized":"2024-09-12T01:44:33.560175+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574180+0000","last_change":"2024-09-12T01:44:33.553971+0000","last_active":"2024-09-12T01:44:35.574180+0000","last_peered":"2024-09-12T01:44:35.574180+0000","last_clean":"2024-09-12T01:44:35.574180+0000","last_became_active":"2024-09-12T01:44:33.553693+0000","last_became_peered":"2024-09-12T01:44:33.553693+0000","last_unstale":"2024-09-12T01:44:35.574180+0000","last_undegraded":"2024-09-12T01:44:35.574180+0000","last_fullsized":"2024-09-12T01:44:35.574180+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:05.134312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586642+0000","last_change":"2024-09-12T01:44:34.582051+0000","last_active":"2024-09-12T01:44:34.586642+0000","last_peered":"2024-09-12T01:44:34.586642+0000","last_clean":"2024-09-12T01:44:34.586642+0000","last_became_active":"2024-09-12T01:44:34.581751+0000","last_became_peered":"2024-09-12T01:44:34.581751+0000","last_unstale":"2024-09-12T01:44:34.586642+0000","last_undegraded":"2024-09-12T01:44:34.586642+0000","last_fullsized":"2024-09-12T01:44:34.586642+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:27.408256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574019+0000","last_change":"2024-09-12T01:44:33.566494+0000","last_active":"2024-09-12T01:44:35.574019+0000","last_peered":"2024-09-12T01:44:35.574019+0000","last_clean":"2024-09-12T01:44:35.574019+0000","last_became_active":"2024-09-12T01:44:33.566175+0000","last_became_peered":"2024-09-12T01:44:33.566175+0000","last_unstale":"2024-09-12T01:44:35.574019+0000","last_undegraded":"2024-09-12T01:44:35.574019+0000","last_fullsized":"2024-09-12T01:44:35.574019+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:10.376177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576904+0000","last_change":"2024-09-12T01:44:34.571445+0000","last_active":"2024-09-12T01:44:35.576904+0000","last_peered":"2024-09-12T01:44:35.576904+0000","last_clean":"2024-09-12T01:44:35.576904+0000","last_became_active":"2024-09-12T01:44:34.571128+0000","last_became_peered":"2024-09-12T01:44:34.571128+0000","last_unstale":"2024-09-12T01:44:35.576904+0000","last_undegraded":"2024-09-12T01:44:35.576904+0000","last_fullsized":"2024-09-12T01:44:35.576904+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:03.884787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.569409+0000","last_change":"2024-09-12T01:44:33.565610+0000","last_active":"2024-09-12T01:44:34.569409+0000","last_peered":"2024-09-12T01:44:34.569409+0000","last_clean":"2024-09-12T01:44:34.569409+0000","last_became_active":"2024-09-12T01:44:33.565331+0000","last_became_peered":"2024-09-12T01:44:33.565331+0000","last_unstale":"2024-09-12T01:44:34.569409+0000","last_undegraded":"2024-09-12T01:44:34.569409+0000","last_fullsized":"2024-09-12T01:44:34.569409+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:21.653578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.578023+0000","last_change":"2024-09-12T01:44:34.574761+0000","last_active":"2024-09-12T01:44:34.578023+0000","last_peered":"2024-09-12T01:44:34.578023+0000","last_clean":"2024-09-12T01:44:34.578023+0000","last_became_active":"2024-09-12T01:44:34.574471+0000","last_became_peered":"2024-09-12T01:44:34.574471+0000","last_unstale":"2024-09-12T01:44:34.578023+0000","last_undegraded":"2024-09-12T01:44:34.578023+0000","last_fullsized":"2024-09-12T01:44:34.578023+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.806227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577074+0000","last_change":"2024-09-12T01:44:33.569721+0000","last_active":"2024-09-12T01:44:35.577074+0000","last_peered":"2024-09-12T01:44:35.577074+0000","last_clean":"2024-09-12T01:44:35.577074+0000","last_became_active":"2024-09-12T01:44:33.569016+0000","last_became_peered":"2024-09-12T01:44:33.569016+0000","last_unstale":"2024-09-12T01:44:35.577074+0000","last_undegraded":"2024-09-12T01:44:35.577074+0000","last_fullsized":"2024-09-12T01:44:35.577074+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576770+0000","last_change":"2024-09-12T01:44:34.569764+0000","last_active":"2024-09-12T01:44:35.576770+0000","last_peered":"2024-09-12T01:44:35.576770+0000","last_clean":"2024-09-12T01:44:35.576770+0000","last_became_active":"2024-09-12T01:44:34.569409+0000","last_became_peered":"2024-09-12T01:44:34.569409+0000","last_unstale":"2024-09-12T01:44:35.576770+0000","last_undegraded":"2024-09-12T01:44:35.576770+0000","last_fullsized":"2024-09-12T01:44:35.576770+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:51.107638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576701+0000","last_change":"2024-09-12T01:44:33.567980+0000","last_active":"2024-09-12T01:44:35.576701+0000","last_peered":"2024-09-12T01:44:35.576701+0000","last_clean":"2024-09-12T01:44:35.576701+0000","last_became_active":"2024-09-12T01:44:33.567648+0000","last_became_peered":"2024-09-12T01:44:33.567648+0000","last_unstale":"2024-09-12T01:44:35.576701+0000","last_undegraded":"2024-09-12T01:44:35.576701+0000","last_fullsized":"2024-09-12T01:44:35.576701+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:40.761288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590655+0000","last_change":"2024-09-12T01:44:34.585187+0000","last_active":"2024-09-12T01:44:34.590655+0000","last_peered":"2024-09-12T01:44:34.590655+0000","last_clean":"2024-09-12T01:44:34.590655+0000","last_became_active":"2024-09-12T01:44:34.584915+0000","last_became_peered":"2024-09-12T01:44:34.584915+0000","last_unstale":"2024-09-12T01:44:34.590655+0000","last_undegraded":"2024-09-12T01:44:34.590655+0000","last_fullsized":"2024-09-12T01:44:34.590655+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:24.224542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573836+0000","last_change":"2024-09-12T01:44:33.567593+0000","last_active":"2024-09-12T01:44:35.573836+0000","last_peered":"2024-09-12T01:44:35.573836+0000","last_clean":"2024-09-12T01:44:35.573836+0000","last_became_active":"2024-09-12T01:44:33.566833+0000","last_became_peered":"2024-09-12T01:44:33.566833+0000","last_unstale":"2024-09-12T01:44:35.573836+0000","last_undegraded":"2024-09-12T01:44:35.573836+0000","last_fullsized":"2024-09-12T01:44:35.573836+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:56.207377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":389,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574004+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:44:35.574004+0000","last_peered":"2024-09-12T01:44:35.574004+0000","last_clean":"2024-09-12T01:44:35.574004+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:44:35.574004+0000","last_undegraded":"2024-09-12T01:44:35.574004+0000","last_fullsized":"2024-09-12T01:44:35.574004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2376,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509551,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1728512,"data_stored":740564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":1732608,"data_stored":740598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509549,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2330624,"data_stored":1331604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509549,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41216,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330624,"statfs":{"total":96636764160,"available":96594558976,"internally_reserved":0,"allocated":1744896,"data_stored":742198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509549,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37060,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334780,"statfs":{"total":96636764160,"available":96598814720,"internally_reserved":0,"allocated":1744896,"data_stored":747446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509549,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37644,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334196,"statfs":{"total":96636764160,"available":96598216704,"internally_reserved":0,"allocated":2347008,"data_stored":1332726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1732608,"data_stored":740634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574957,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32852,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338988,"statfs":{"total":96636764160,"available":96603123712,"internally_reserved":0,"allocated":1703936,"data_stored":727514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:44:41.971 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:44:42.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.087+0000 7fbb05a27640 1 Processor -- start 2024-09-12T01:44:42.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.087+0000 7fbb05a27640 1 -- start start 2024-09-12T01:44:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbb05a27640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbb0015c170 0x7fbb0015c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbb05a27640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb000cf6c0 0x7fbb000cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbb05a27640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb000b5dd0 0x7fbb000b6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbb05a27640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fbb0015ca90 con 0x7fbb000cf6c0 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbb05a27640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fbb000b4cf0 con 0x7fbb0015c170 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbb05a27640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbb000b4fd0 con 0x7fbb000b5dd0 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbaf7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb000cf6c0 0x7fbb000cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbaf7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb000cf6c0 0x7fbb000cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42834/0 (socket says 172.21.15.60:42834) 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbaf7fff640 1 -- 172.21.15.60:0/966159046 learned_addr learned my addr 172.21.15.60:0/966159046 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbaff7fe640 1 --2- 172.21.15.60:0/966159046 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb000b5dd0 0x7fbb000b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbafeffd640 1 --2- 172.21.15.60:0/966159046 >> v2:172.21.15.105:3300/0 conn(0x7fbb0015c170 0x7fbb0015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbaf7fff640 1 -- 172.21.15.60:0/966159046 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb000b5dd0 msgr2=0x7fbb000b6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbaf7fff640 1 --2- 172.21.15.60:0/966159046 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb000b5dd0 0x7fbb000b6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbaf7fff640 1 -- 172.21.15.60:0/966159046 >> v2:172.21.15.105:3300/0 conn(0x7fbb0015c170 msgr2=0x7fbb0015c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbaf7fff640 1 --2- 172.21.15.60:0/966159046 >> v2:172.21.15.105:3300/0 conn(0x7fbb0015c170 0x7fbb0015c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbaf7fff640 1 -- 172.21.15.60:0/966159046 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb000b52b0 con 0x7fbb000cf6c0 2024-09-12T01:44:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.088+0000 7fbafeffd640 1 --2- 172.21.15.60:0/966159046 >> v2:172.21.15.105:3300/0 conn(0x7fbb0015c170 0x7fbb0015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:42.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.089+0000 7fbaf7fff640 1 --2- 172.21.15.60:0/966159046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb000cf6c0 0x7fbb000cfb30 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009870 tx=0x7fbae802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6ae974b85f6c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.089+0000 7fbafe7fc640 1 -- 172.21.15.60:0/966159046 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8037070 con 0x7fbb000cf6c0 2024-09-12T01:44:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.089+0000 7fbafe7fc640 1 -- 172.21.15.60:0/966159046 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbae8032440 con 0x7fbb000cf6c0 2024-09-12T01:44:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.089+0000 7fbafe7fc640 1 -- 172.21.15.60:0/966159046 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbae8032810 con 0x7fbb000cf6c0 2024-09-12T01:44:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.090+0000 7fbb05a27640 1 -- 172.21.15.60:0/966159046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb000cf6c0 msgr2=0x7fbb000cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.090+0000 7fbb05a27640 1 --2- 172.21.15.60:0/966159046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb000cf6c0 0x7fbb000cfb30 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fbae8009870 tx=0x7fbae802a210 comp rx=0 tx=0).stop 2024-09-12T01:44:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.090+0000 7fbb05a27640 1 -- 172.21.15.60:0/966159046 shutdown_connections 2024-09-12T01:44:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.090+0000 7fbb05a27640 1 --2- 172.21.15.60:0/966159046 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb000b5dd0 0x7fbb000b6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.090+0000 7fbb05a27640 1 --2- 172.21.15.60:0/966159046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb000cf6c0 0x7fbb000cfb30 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.090+0000 7fbb05a27640 1 --2- 172.21.15.60:0/966159046 >> v2:172.21.15.105:3300/0 conn(0x7fbb0015c170 0x7fbb0015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.090+0000 7fbb05a27640 1 -- 172.21.15.60:0/966159046 >> 172.21.15.60:0/966159046 conn(0x7fbb0006bc10 msgr2=0x7fbb0006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:42.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.090+0000 7fbb05a27640 1 -- 172.21.15.60:0/966159046 shutdown_connections 2024-09-12T01:44:42.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.090+0000 7fbb05a27640 1 -- 172.21.15.60:0/966159046 wait complete. 2024-09-12T01:44:42.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.091+0000 7fbb05a27640 1 Processor -- start 2024-09-12T01:44:42.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.091+0000 7fbb05a27640 1 -- start start 2024-09-12T01:44:42.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbb05a27640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb000b5dd0 0x7fbb0013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbb05a27640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb000cf6c0 0x7fbb000b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbb05a27640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb0015c170 0x7fbb000b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbb05a27640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbb000b5b50 con 0x7fbb000b5dd0 2024-09-12T01:44:42.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbb05a27640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fbb000b5870 con 0x7fbb0015c170 2024-09-12T01:44:42.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbb05a27640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fbb0015ffb0 con 0x7fbb000cf6c0 2024-09-12T01:44:42.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbafeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb000b5dd0 0x7fbb0013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbafeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb000b5dd0 0x7fbb0013ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42846/0 (socket says 172.21.15.60:42846) 2024-09-12T01:44:42.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbafeffd640 1 -- 172.21.15.60:0/374436843 learned_addr learned my addr 172.21.15.60:0/374436843 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbaf7fff640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb000cf6c0 0x7fbb000b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbaff7fe640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb0015c170 0x7fbb000b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbafeffd640 1 -- 172.21.15.60:0/374436843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb000cf6c0 msgr2=0x7fbb000b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbafeffd640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb000cf6c0 0x7fbb000b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbafeffd640 1 -- 172.21.15.60:0/374436843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb0015c170 msgr2=0x7fbb000b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbafeffd640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb0015c170 0x7fbb000b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbafeffd640 1 -- 172.21.15.60:0/374436843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb00152e00 con 0x7fbb000b5dd0 2024-09-12T01:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.092+0000 7fbafeffd640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb000b5dd0 0x7fbb0013ece0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000d7d0 tx=0x7fbaf000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.093+0000 7fbafcff9640 1 -- 172.21.15.60:0/374436843 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0004030 con 0x7fbb000b5dd0 2024-09-12T01:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.093+0000 7fbafcff9640 1 -- 172.21.15.60:0/374436843 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf00041d0 con 0x7fbb000b5dd0 2024-09-12T01:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.093+0000 7fbafcff9640 1 -- 172.21.15.60:0/374436843 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaf00096a0 con 0x7fbb000b5dd0 2024-09-12T01:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.093+0000 7fbb05a27640 1 -- 172.21.15.60:0/374436843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb001530e0 con 0x7fbb000b5dd0 2024-09-12T01:44:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.093+0000 7fbb05a27640 1 -- 172.21.15.60:0/374436843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb001536a0 con 0x7fbb000b5dd0 2024-09-12T01:44:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.094+0000 7fbb05a27640 1 -- 172.21.15.60:0/374436843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb0015c550 con 0x7fbb000b5dd0 2024-09-12T01:44:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.094+0000 7fbafcff9640 1 -- 172.21.15.60:0/374436843 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fbaf0009840 con 0x7fbb000b5dd0 2024-09-12T01:44:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.095+0000 7fbafcff9640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbae006be30 0x7fbae006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.095+0000 7fbafcff9640 1 -- 172.21.15.60:0/374436843 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fbaf008b170 con 0x7fbb000b5dd0 2024-09-12T01:44:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.095+0000 7fbaf7fff640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbae006be30 0x7fbae006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.096+0000 7fbaf7fff640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbae006be30 0x7fbae006e2f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbae8034000 tx=0x7fbae802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:42.100 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.100+0000 7fbafcff9640 1 -- 172.21.15.60:0/374436843 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fbaf0059b20 con 0x7fbb000b5dd0 2024-09-12T01:44:42.274 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.274+0000 7fbb05a27640 1 -- 172.21.15.60:0/374436843 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb00072e60 con 0x7fbae006be30 2024-09-12T01:44:42.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.280+0000 7fbafcff9640 1 -- 172.21.15.60:0/374436843 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252458 (secure 0 0 0) 0x7fbb00072e60 con 0x7fbae006be30 2024-09-12T01:44:42.283 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:42.285 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:44:42.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.283+0000 7fbb05a27640 1 -- 172.21.15.60:0/374436843 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbae006be30 msgr2=0x7fbae006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.283+0000 7fbb05a27640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbae006be30 0x7fbae006e2f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fbae8034000 tx=0x7fbae802e000 comp rx=0 tx=0).stop 2024-09-12T01:44:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.283+0000 7fbb05a27640 1 -- 172.21.15.60:0/374436843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb000b5dd0 msgr2=0x7fbb0013ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.283+0000 7fbb05a27640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb000b5dd0 0x7fbb0013ece0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fbaf000d7d0 tx=0x7fbaf000dc90 comp rx=0 tx=0).stop 2024-09-12T01:44:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.283+0000 7fbb05a27640 1 -- 172.21.15.60:0/374436843 shutdown_connections 2024-09-12T01:44:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.283+0000 7fbb05a27640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbb0015c170 0x7fbb000b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.283+0000 7fbb05a27640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fbae006be30 0x7fbae006e2f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.283+0000 7fbb05a27640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbb000cf6c0 0x7fbb000b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.283+0000 7fbb05a27640 1 --2- 172.21.15.60:0/374436843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb000b5dd0 0x7fbb0013ece0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.283+0000 7fbb05a27640 1 -- 172.21.15.60:0/374436843 >> 172.21.15.60:0/374436843 conn(0x7fbb0006bc10 msgr2=0x7fbb0006d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.283+0000 7fbb05a27640 1 -- 172.21.15.60:0/374436843 shutdown_connections 2024-09-12T01:44:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.283+0000 7fbb05a27640 1 -- 172.21.15.60:0/374436843 wait complete. 2024-09-12T01:44:42.295 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":401,"stamp":"2024-09-12T01:44:40.377562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":293412,"kb_used_data":14752,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754681308,"statfs":{"total":773094113280,"available":772793659392,"internally_reserved":0,"allocated":15106048,"data_stored":7122668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.829607"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577206+0000","last_change":"2024-09-12T01:44:34.578808+0000","last_active":"2024-09-12T01:44:35.577206+0000","last_peered":"2024-09-12T01:44:35.577206+0000","last_clean":"2024-09-12T01:44:35.577206+0000","last_became_active":"2024-09-12T01:44:34.578528+0000","last_became_peered":"2024-09-12T01:44:34.578528+0000","last_unstale":"2024-09-12T01:44:35.577206+0000","last_undegraded":"2024-09-12T01:44:35.577206+0000","last_fullsized":"2024-09-12T01:44:35.577206+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:04.653539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577100+0000","last_change":"2024-09-12T01:44:34.579190+0000","last_active":"2024-09-12T01:44:35.577100+0000","last_peered":"2024-09-12T01:44:35.577100+0000","last_clean":"2024-09-12T01:44:35.577100+0000","last_became_active":"2024-09-12T01:44:34.578880+0000","last_became_peered":"2024-09-12T01:44:34.578880+0000","last_unstale":"2024-09-12T01:44:35.577100+0000","last_undegraded":"2024-09-12T01:44:35.577100+0000","last_fullsized":"2024-09-12T01:44:35.577100+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:48.771413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577035+0000","last_change":"2024-09-12T01:44:34.568255+0000","last_active":"2024-09-12T01:44:35.577035+0000","last_peered":"2024-09-12T01:44:35.577035+0000","last_clean":"2024-09-12T01:44:35.577035+0000","last_became_active":"2024-09-12T01:44:34.567951+0000","last_became_peered":"2024-09-12T01:44:34.567951+0000","last_unstale":"2024-09-12T01:44:35.577035+0000","last_undegraded":"2024-09-12T01:44:35.577035+0000","last_fullsized":"2024-09-12T01:44:35.577035+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:06.315519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.230252+0000","last_change":"2024-09-12T01:44:34.587196+0000","last_active":"2024-09-12T01:44:38.230252+0000","last_peered":"2024-09-12T01:44:38.230252+0000","last_clean":"2024-09-12T01:44:38.230252+0000","last_became_active":"2024-09-12T01:44:34.586972+0000","last_became_peered":"2024-09-12T01:44:34.586972+0000","last_unstale":"2024-09-12T01:44:38.230252+0000","last_undegraded":"2024-09-12T01:44:38.230252+0000","last_fullsized":"2024-09-12T01:44:38.230252+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:45.420701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573865+0000","last_change":"2024-09-12T01:44:34.581929+0000","last_active":"2024-09-12T01:44:35.573865+0000","last_peered":"2024-09-12T01:44:35.573865+0000","last_clean":"2024-09-12T01:44:35.573865+0000","last_became_active":"2024-09-12T01:44:34.581430+0000","last_became_peered":"2024-09-12T01:44:34.581430+0000","last_unstale":"2024-09-12T01:44:35.573865+0000","last_undegraded":"2024-09-12T01:44:35.573865+0000","last_fullsized":"2024-09-12T01:44:35.573865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:58.704148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593245+0000","last_change":"2024-09-12T01:44:34.587092+0000","last_active":"2024-09-12T01:44:34.593245+0000","last_peered":"2024-09-12T01:44:34.593245+0000","last_clean":"2024-09-12T01:44:34.593245+0000","last_became_active":"2024-09-12T01:44:34.586801+0000","last_became_peered":"2024-09-12T01:44:34.586801+0000","last_unstale":"2024-09-12T01:44:34.593245+0000","last_undegraded":"2024-09-12T01:44:34.593245+0000","last_fullsized":"2024-09-12T01:44:34.593245+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:07.258321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583107+0000","last_change":"2024-09-12T01:44:34.579218+0000","last_active":"2024-09-12T01:44:34.583107+0000","last_peered":"2024-09-12T01:44:34.583107+0000","last_clean":"2024-09-12T01:44:34.583107+0000","last_became_active":"2024-09-12T01:44:34.578880+0000","last_became_peered":"2024-09-12T01:44:34.578880+0000","last_unstale":"2024-09-12T01:44:34.583107+0000","last_undegraded":"2024-09-12T01:44:34.583107+0000","last_fullsized":"2024-09-12T01:44:34.583107+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.281914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593466+0000","last_change":"2024-09-12T01:44:34.589398+0000","last_active":"2024-09-12T01:44:34.593466+0000","last_peered":"2024-09-12T01:44:34.593466+0000","last_clean":"2024-09-12T01:44:34.593466+0000","last_became_active":"2024-09-12T01:44:34.589132+0000","last_became_peered":"2024-09-12T01:44:34.589132+0000","last_unstale":"2024-09-12T01:44:34.593466+0000","last_undegraded":"2024-09-12T01:44:34.593466+0000","last_fullsized":"2024-09-12T01:44:34.593466+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.806227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583277+0000","last_change":"2024-09-12T01:44:34.582405+0000","last_active":"2024-09-12T01:44:34.583277+0000","last_peered":"2024-09-12T01:44:34.583277+0000","last_clean":"2024-09-12T01:44:34.583277+0000","last_became_active":"2024-09-12T01:44:34.582107+0000","last_became_peered":"2024-09-12T01:44:34.582107+0000","last_unstale":"2024-09-12T01:44:34.583277+0000","last_undegraded":"2024-09-12T01:44:34.583277+0000","last_fullsized":"2024-09-12T01:44:34.583277+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:51.464037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592952+0000","last_change":"2024-09-12T01:44:34.587622+0000","last_active":"2024-09-12T01:44:34.592952+0000","last_peered":"2024-09-12T01:44:34.592952+0000","last_clean":"2024-09-12T01:44:34.592952+0000","last_became_active":"2024-09-12T01:44:34.587309+0000","last_became_peered":"2024-09-12T01:44:34.587309+0000","last_unstale":"2024-09-12T01:44:34.592952+0000","last_undegraded":"2024-09-12T01:44:34.592952+0000","last_fullsized":"2024-09-12T01:44:34.592952+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:22.658357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573760+0000","last_change":"2024-09-12T01:44:34.581035+0000","last_active":"2024-09-12T01:44:35.573760+0000","last_peered":"2024-09-12T01:44:35.573760+0000","last_clean":"2024-09-12T01:44:35.573760+0000","last_became_active":"2024-09-12T01:44:34.580768+0000","last_became_peered":"2024-09-12T01:44:34.580768+0000","last_unstale":"2024-09-12T01:44:35.573760+0000","last_undegraded":"2024-09-12T01:44:35.573760+0000","last_fullsized":"2024-09-12T01:44:35.573760+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:14.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573365+0000","last_change":"2024-09-12T01:44:34.582605+0000","last_active":"2024-09-12T01:44:35.573365+0000","last_peered":"2024-09-12T01:44:35.573365+0000","last_clean":"2024-09-12T01:44:35.573365+0000","last_became_active":"2024-09-12T01:44:34.582322+0000","last_became_peered":"2024-09-12T01:44:34.582322+0000","last_unstale":"2024-09-12T01:44:35.573365+0000","last_undegraded":"2024-09-12T01:44:35.573365+0000","last_fullsized":"2024-09-12T01:44:35.573365+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:01.900564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573363+0000","last_change":"2024-09-12T01:44:34.587381+0000","last_active":"2024-09-12T01:44:35.573363+0000","last_peered":"2024-09-12T01:44:35.573363+0000","last_clean":"2024-09-12T01:44:35.573363+0000","last_became_active":"2024-09-12T01:44:34.586812+0000","last_became_peered":"2024-09-12T01:44:34.586812+0000","last_unstale":"2024-09-12T01:44:35.573363+0000","last_undegraded":"2024-09-12T01:44:35.573363+0000","last_fullsized":"2024-09-12T01:44:35.573363+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:11.765535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592991+0000","last_change":"2024-09-12T01:44:34.587979+0000","last_active":"2024-09-12T01:44:34.592991+0000","last_peered":"2024-09-12T01:44:34.592991+0000","last_clean":"2024-09-12T01:44:34.592991+0000","last_became_active":"2024-09-12T01:44:34.587628+0000","last_became_peered":"2024-09-12T01:44:34.587628+0000","last_unstale":"2024-09-12T01:44:34.592991+0000","last_undegraded":"2024-09-12T01:44:34.592991+0000","last_fullsized":"2024-09-12T01:44:34.592991+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:42.799915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593669+0000","last_change":"2024-09-12T01:44:34.591685+0000","last_active":"2024-09-12T01:44:34.593669+0000","last_peered":"2024-09-12T01:44:34.593669+0000","last_clean":"2024-09-12T01:44:34.593669+0000","last_became_active":"2024-09-12T01:44:34.591395+0000","last_became_peered":"2024-09-12T01:44:34.591395+0000","last_unstale":"2024-09-12T01:44:34.593669+0000","last_undegraded":"2024-09-12T01:44:34.593669+0000","last_fullsized":"2024-09-12T01:44:34.593669+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:54.281914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590619+0000","last_change":"2024-09-12T01:44:34.585126+0000","last_active":"2024-09-12T01:44:34.590619+0000","last_peered":"2024-09-12T01:44:34.590619+0000","last_clean":"2024-09-12T01:44:34.590619+0000","last_became_active":"2024-09-12T01:44:34.584665+0000","last_became_peered":"2024-09-12T01:44:34.584665+0000","last_unstale":"2024-09-12T01:44:34.590619+0000","last_undegraded":"2024-09-12T01:44:34.590619+0000","last_fullsized":"2024-09-12T01:44:34.590619+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:59.840812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586620+0000","last_change":"2024-09-12T01:44:34.581891+0000","last_active":"2024-09-12T01:44:34.586620+0000","last_peered":"2024-09-12T01:44:34.586620+0000","last_clean":"2024-09-12T01:44:34.586620+0000","last_became_active":"2024-09-12T01:44:34.581603+0000","last_became_peered":"2024-09-12T01:44:34.581603+0000","last_unstale":"2024-09-12T01:44:34.586620+0000","last_undegraded":"2024-09-12T01:44:34.586620+0000","last_fullsized":"2024-09-12T01:44:34.586620+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:32.790165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.230284+0000","last_change":"2024-09-12T01:44:34.585241+0000","last_active":"2024-09-12T01:44:38.230284+0000","last_peered":"2024-09-12T01:44:38.230284+0000","last_clean":"2024-09-12T01:44:38.230284+0000","last_became_active":"2024-09-12T01:44:34.584976+0000","last_became_peered":"2024-09-12T01:44:34.584976+0000","last_unstale":"2024-09-12T01:44:38.230284+0000","last_undegraded":"2024-09-12T01:44:38.230284+0000","last_fullsized":"2024-09-12T01:44:38.230284+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:31.934738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583062+0000","last_change":"2024-09-12T01:44:34.578536+0000","last_active":"2024-09-12T01:44:34.583062+0000","last_peered":"2024-09-12T01:44:34.583062+0000","last_clean":"2024-09-12T01:44:34.583062+0000","last_became_active":"2024-09-12T01:44:34.578194+0000","last_became_peered":"2024-09-12T01:44:34.578194+0000","last_unstale":"2024-09-12T01:44:34.583062+0000","last_undegraded":"2024-09-12T01:44:34.583062+0000","last_fullsized":"2024-09-12T01:44:34.583062+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:06.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573384+0000","last_change":"2024-09-12T01:44:34.574426+0000","last_active":"2024-09-12T01:44:35.573384+0000","last_peered":"2024-09-12T01:44:35.573384+0000","last_clean":"2024-09-12T01:44:35.573384+0000","last_became_active":"2024-09-12T01:44:34.574151+0000","last_became_peered":"2024-09-12T01:44:34.574151+0000","last_unstale":"2024-09-12T01:44:35.573384+0000","last_undegraded":"2024-09-12T01:44:35.573384+0000","last_fullsized":"2024-09-12T01:44:35.573384+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:11.234396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.581027+0000","last_change":"2024-09-12T01:44:34.578057+0000","last_active":"2024-09-12T01:44:34.581027+0000","last_peered":"2024-09-12T01:44:34.581027+0000","last_clean":"2024-09-12T01:44:34.581027+0000","last_became_active":"2024-09-12T01:44:34.577776+0000","last_became_peered":"2024-09-12T01:44:34.577776+0000","last_unstale":"2024-09-12T01:44:34.581027+0000","last_undegraded":"2024-09-12T01:44:34.581027+0000","last_fullsized":"2024-09-12T01:44:34.581027+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:14.077575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574004+0000","last_change":"2024-09-12T01:44:34.569162+0000","last_active":"2024-09-12T01:44:35.574004+0000","last_peered":"2024-09-12T01:44:35.574004+0000","last_clean":"2024-09-12T01:44:35.574004+0000","last_became_active":"2024-09-12T01:44:34.568844+0000","last_became_peered":"2024-09-12T01:44:34.568844+0000","last_unstale":"2024-09-12T01:44:35.574004+0000","last_undegraded":"2024-09-12T01:44:35.574004+0000","last_fullsized":"2024-09-12T01:44:35.574004+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:33.785177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573911+0000","last_change":"2024-09-12T01:44:34.568333+0000","last_active":"2024-09-12T01:44:35.573911+0000","last_peered":"2024-09-12T01:44:35.573911+0000","last_clean":"2024-09-12T01:44:35.573911+0000","last_became_active":"2024-09-12T01:44:34.566942+0000","last_became_peered":"2024-09-12T01:44:34.566942+0000","last_unstale":"2024-09-12T01:44:35.573911+0000","last_undegraded":"2024-09-12T01:44:35.573911+0000","last_fullsized":"2024-09-12T01:44:35.573911+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:59.446473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573434+0000","last_change":"2024-09-12T01:44:34.574892+0000","last_active":"2024-09-12T01:44:35.573434+0000","last_peered":"2024-09-12T01:44:35.573434+0000","last_clean":"2024-09-12T01:44:35.573434+0000","last_became_active":"2024-09-12T01:44:34.574240+0000","last_became_peered":"2024-09-12T01:44:34.574240+0000","last_unstale":"2024-09-12T01:44:35.573434+0000","last_undegraded":"2024-09-12T01:44:35.573434+0000","last_fullsized":"2024-09-12T01:44:35.573434+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:03.484850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573730+0000","last_change":"2024-09-12T01:44:34.578283+0000","last_active":"2024-09-12T01:44:35.573730+0000","last_peered":"2024-09-12T01:44:35.573730+0000","last_clean":"2024-09-12T01:44:35.573730+0000","last_became_active":"2024-09-12T01:44:34.578019+0000","last_became_peered":"2024-09-12T01:44:34.578019+0000","last_unstale":"2024-09-12T01:44:35.573730+0000","last_undegraded":"2024-09-12T01:44:35.573730+0000","last_fullsized":"2024-09-12T01:44:35.573730+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:19.132628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574318+0000","last_change":"2024-09-12T01:44:34.577407+0000","last_active":"2024-09-12T01:44:35.574318+0000","last_peered":"2024-09-12T01:44:35.574318+0000","last_clean":"2024-09-12T01:44:35.574318+0000","last_became_active":"2024-09-12T01:44:34.571477+0000","last_became_peered":"2024-09-12T01:44:34.571477+0000","last_unstale":"2024-09-12T01:44:35.574318+0000","last_undegraded":"2024-09-12T01:44:35.574318+0000","last_fullsized":"2024-09-12T01:44:35.574318+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:03.884787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573865+0000","last_change":"2024-09-12T01:44:34.579449+0000","last_active":"2024-09-12T01:44:35.573865+0000","last_peered":"2024-09-12T01:44:35.573865+0000","last_clean":"2024-09-12T01:44:35.573865+0000","last_became_active":"2024-09-12T01:44:34.579170+0000","last_became_peered":"2024-09-12T01:44:34.579170+0000","last_unstale":"2024-09-12T01:44:35.573865+0000","last_undegraded":"2024-09-12T01:44:35.573865+0000","last_fullsized":"2024-09-12T01:44:35.573865+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:53.515628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583215+0000","last_change":"2024-09-12T01:44:34.580740+0000","last_active":"2024-09-12T01:44:34.583215+0000","last_peered":"2024-09-12T01:44:34.583215+0000","last_clean":"2024-09-12T01:44:34.583215+0000","last_became_active":"2024-09-12T01:44:34.580371+0000","last_became_peered":"2024-09-12T01:44:34.580371+0000","last_unstale":"2024-09-12T01:44:34.583215+0000","last_undegraded":"2024-09-12T01:44:34.583215+0000","last_fullsized":"2024-09-12T01:44:34.583215+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.079241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576943+0000","last_change":"2024-09-12T01:44:34.567435+0000","last_active":"2024-09-12T01:44:35.576943+0000","last_peered":"2024-09-12T01:44:35.576943+0000","last_clean":"2024-09-12T01:44:35.576943+0000","last_became_active":"2024-09-12T01:44:34.567107+0000","last_became_peered":"2024-09-12T01:44:34.567107+0000","last_unstale":"2024-09-12T01:44:35.576943+0000","last_undegraded":"2024-09-12T01:44:35.576943+0000","last_fullsized":"2024-09-12T01:44:35.576943+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:36.649302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.581883+0000","last_change":"2024-09-12T01:44:34.580274+0000","last_active":"2024-09-12T01:44:34.581883+0000","last_peered":"2024-09-12T01:44:34.581883+0000","last_clean":"2024-09-12T01:44:34.581883+0000","last_became_active":"2024-09-12T01:44:34.579917+0000","last_became_peered":"2024-09-12T01:44:34.579917+0000","last_unstale":"2024-09-12T01:44:34.581883+0000","last_undegraded":"2024-09-12T01:44:34.581883+0000","last_fullsized":"2024-09-12T01:44:34.581883+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.768947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576831+0000","last_change":"2024-09-12T01:44:34.577332+0000","last_active":"2024-09-12T01:44:35.576831+0000","last_peered":"2024-09-12T01:44:35.576831+0000","last_clean":"2024-09-12T01:44:35.576831+0000","last_became_active":"2024-09-12T01:44:34.576807+0000","last_became_peered":"2024-09-12T01:44:34.576807+0000","last_unstale":"2024-09-12T01:44:35.576831+0000","last_undegraded":"2024-09-12T01:44:35.576831+0000","last_fullsized":"2024-09-12T01:44:35.576831+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.911212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582646+0000","last_change":"2024-09-12T01:44:34.579014+0000","last_active":"2024-09-12T01:44:34.582646+0000","last_peered":"2024-09-12T01:44:34.582646+0000","last_clean":"2024-09-12T01:44:34.582646+0000","last_became_active":"2024-09-12T01:44:34.577666+0000","last_became_peered":"2024-09-12T01:44:34.577666+0000","last_unstale":"2024-09-12T01:44:34.582646+0000","last_undegraded":"2024-09-12T01:44:34.582646+0000","last_fullsized":"2024-09-12T01:44:34.582646+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:33.785177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.230401+0000","last_change":"2024-09-12T01:44:34.588108+0000","last_active":"2024-09-12T01:44:38.230401+0000","last_peered":"2024-09-12T01:44:38.230401+0000","last_clean":"2024-09-12T01:44:38.230401+0000","last_became_active":"2024-09-12T01:44:34.587833+0000","last_became_peered":"2024-09-12T01:44:34.587833+0000","last_unstale":"2024-09-12T01:44:38.230401+0000","last_undegraded":"2024-09-12T01:44:38.230401+0000","last_fullsized":"2024-09-12T01:44:38.230401+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:10.247746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"138'4","reported_seq":18,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577263+0000","last_change":"2024-09-12T01:44:33.562262+0000","last_active":"2024-09-12T01:44:35.577263+0000","last_peered":"2024-09-12T01:44:35.577263+0000","last_clean":"2024-09-12T01:44:35.577263+0000","last_became_active":"2024-09-12T01:44:33.561973+0000","last_became_peered":"2024-09-12T01:44:33.561973+0000","last_unstale":"2024-09-12T01:44:35.577263+0000","last_undegraded":"2024-09-12T01:44:35.577263+0000","last_fullsized":"2024-09-12T01:44:35.577263+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:50.459258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577264+0000","last_change":"2024-09-12T01:44:34.572331+0000","last_active":"2024-09-12T01:44:35.577264+0000","last_peered":"2024-09-12T01:44:35.577264+0000","last_clean":"2024-09-12T01:44:35.577264+0000","last_became_active":"2024-09-12T01:44:34.572042+0000","last_became_peered":"2024-09-12T01:44:34.572042+0000","last_unstale":"2024-09-12T01:44:35.577264+0000","last_undegraded":"2024-09-12T01:44:35.577264+0000","last_fullsized":"2024-09-12T01:44:35.577264+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:15.763728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"138'1","reported_seq":13,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.592860+0000","last_change":"2024-09-12T01:44:33.571315+0000","last_active":"2024-09-12T01:44:34.592860+0000","last_peered":"2024-09-12T01:44:34.592860+0000","last_clean":"2024-09-12T01:44:34.592860+0000","last_became_active":"2024-09-12T01:44:33.570791+0000","last_became_peered":"2024-09-12T01:44:33.570791+0000","last_unstale":"2024-09-12T01:44:34.592860+0000","last_undegraded":"2024-09-12T01:44:34.592860+0000","last_fullsized":"2024-09-12T01:44:34.592860+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:15.839665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.579947+0000","last_change":"2024-09-12T01:44:34.578171+0000","last_active":"2024-09-12T01:44:34.579947+0000","last_peered":"2024-09-12T01:44:34.579947+0000","last_clean":"2024-09-12T01:44:34.579947+0000","last_became_active":"2024-09-12T01:44:34.577874+0000","last_became_peered":"2024-09-12T01:44:34.577874+0000","last_unstale":"2024-09-12T01:44:34.579947+0000","last_undegraded":"2024-09-12T01:44:34.579947+0000","last_fullsized":"2024-09-12T01:44:34.579947+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:58.704148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590018+0000","last_change":"2024-09-12T01:44:33.564326+0000","last_active":"2024-09-12T01:44:34.590018+0000","last_peered":"2024-09-12T01:44:34.590018+0000","last_clean":"2024-09-12T01:44:34.590018+0000","last_became_active":"2024-09-12T01:44:33.564082+0000","last_became_peered":"2024-09-12T01:44:33.564082+0000","last_unstale":"2024-09-12T01:44:34.590018+0000","last_undegraded":"2024-09-12T01:44:34.590018+0000","last_fullsized":"2024-09-12T01:44:34.590018+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:24.184840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.593488+0000","last_change":"2024-09-12T01:44:34.590779+0000","last_active":"2024-09-12T01:44:34.593488+0000","last_peered":"2024-09-12T01:44:34.593488+0000","last_clean":"2024-09-12T01:44:34.593488+0000","last_became_active":"2024-09-12T01:44:34.590440+0000","last_became_peered":"2024-09-12T01:44:34.590440+0000","last_unstale":"2024-09-12T01:44:34.593488+0000","last_undegraded":"2024-09-12T01:44:34.593488+0000","last_fullsized":"2024-09-12T01:44:34.593488+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:06.139090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573976+0000","last_change":"2024-09-12T01:44:33.562995+0000","last_active":"2024-09-12T01:44:35.573976+0000","last_peered":"2024-09-12T01:44:35.573976+0000","last_clean":"2024-09-12T01:44:35.573976+0000","last_became_active":"2024-09-12T01:44:33.562650+0000","last_became_peered":"2024-09-12T01:44:33.562650+0000","last_unstale":"2024-09-12T01:44:35.573976+0000","last_undegraded":"2024-09-12T01:44:35.573976+0000","last_fullsized":"2024-09-12T01:44:35.573976+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.230078+0000","last_change":"2024-09-12T01:44:34.591006+0000","last_active":"2024-09-12T01:44:38.230078+0000","last_peered":"2024-09-12T01:44:38.230078+0000","last_clean":"2024-09-12T01:44:38.230078+0000","last_became_active":"2024-09-12T01:44:34.590159+0000","last_became_peered":"2024-09-12T01:44:34.590159+0000","last_unstale":"2024-09-12T01:44:38.230078+0000","last_undegraded":"2024-09-12T01:44:38.230078+0000","last_fullsized":"2024-09-12T01:44:38.230078+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:25.885724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577066+0000","last_change":"2024-09-12T01:44:33.571205+0000","last_active":"2024-09-12T01:44:35.577066+0000","last_peered":"2024-09-12T01:44:35.577066+0000","last_clean":"2024-09-12T01:44:35.577066+0000","last_became_active":"2024-09-12T01:44:33.570909+0000","last_became_peered":"2024-09-12T01:44:33.570909+0000","last_unstale":"2024-09-12T01:44:35.577066+0000","last_undegraded":"2024-09-12T01:44:35.577066+0000","last_fullsized":"2024-09-12T01:44:35.577066+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:05.134312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582675+0000","last_change":"2024-09-12T01:44:34.578688+0000","last_active":"2024-09-12T01:44:34.582675+0000","last_peered":"2024-09-12T01:44:34.582675+0000","last_clean":"2024-09-12T01:44:34.582675+0000","last_became_active":"2024-09-12T01:44:34.578415+0000","last_became_peered":"2024-09-12T01:44:34.578415+0000","last_unstale":"2024-09-12T01:44:34.582675+0000","last_undegraded":"2024-09-12T01:44:34.582675+0000","last_fullsized":"2024-09-12T01:44:34.582675+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:53.515628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.230055+0000","last_change":"2024-09-12T01:44:33.569461+0000","last_active":"2024-09-12T01:44:38.230055+0000","last_peered":"2024-09-12T01:44:38.230055+0000","last_clean":"2024-09-12T01:44:38.230055+0000","last_became_active":"2024-09-12T01:44:33.569155+0000","last_became_peered":"2024-09-12T01:44:33.569155+0000","last_unstale":"2024-09-12T01:44:38.230055+0000","last_undegraded":"2024-09-12T01:44:38.230055+0000","last_fullsized":"2024-09-12T01:44:38.230055+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:31.677494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573629+0000","last_change":"2024-09-12T01:44:34.569126+0000","last_active":"2024-09-12T01:44:35.573629+0000","last_peered":"2024-09-12T01:44:35.573629+0000","last_clean":"2024-09-12T01:44:35.573629+0000","last_became_active":"2024-09-12T01:44:34.568830+0000","last_became_peered":"2024-09-12T01:44:34.568830+0000","last_unstale":"2024-09-12T01:44:35.573629+0000","last_undegraded":"2024-09-12T01:44:35.573629+0000","last_fullsized":"2024-09-12T01:44:35.573629+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:31:18.088120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576891+0000","last_change":"2024-09-12T01:44:33.569947+0000","last_active":"2024-09-12T01:44:35.576891+0000","last_peered":"2024-09-12T01:44:35.576891+0000","last_clean":"2024-09-12T01:44:35.576891+0000","last_became_active":"2024-09-12T01:44:33.569378+0000","last_became_peered":"2024-09-12T01:44:33.569378+0000","last_unstale":"2024-09-12T01:44:35.576891+0000","last_undegraded":"2024-09-12T01:44:35.576891+0000","last_fullsized":"2024-09-12T01:44:35.576891+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:21.653578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.229932+0000","last_change":"2024-09-12T01:44:34.588807+0000","last_active":"2024-09-12T01:44:38.229932+0000","last_peered":"2024-09-12T01:44:38.229932+0000","last_clean":"2024-09-12T01:44:38.229932+0000","last_became_active":"2024-09-12T01:44:34.588540+0000","last_became_peered":"2024-09-12T01:44:34.588540+0000","last_unstale":"2024-09-12T01:44:38.229932+0000","last_undegraded":"2024-09-12T01:44:38.229932+0000","last_fullsized":"2024-09-12T01:44:38.229932+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:57.707580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573874+0000","last_change":"2024-09-12T01:44:33.566465+0000","last_active":"2024-09-12T01:44:35.573874+0000","last_peered":"2024-09-12T01:44:35.573874+0000","last_clean":"2024-09-12T01:44:35.573874+0000","last_became_active":"2024-09-12T01:44:33.566147+0000","last_became_peered":"2024-09-12T01:44:33.566147+0000","last_unstale":"2024-09-12T01:44:35.573874+0000","last_undegraded":"2024-09-12T01:44:35.573874+0000","last_fullsized":"2024-09-12T01:44:35.573874+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:42.446369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.588131+0000","last_change":"2024-09-12T01:44:34.583987+0000","last_active":"2024-09-12T01:44:34.588131+0000","last_peered":"2024-09-12T01:44:34.588131+0000","last_clean":"2024-09-12T01:44:34.588131+0000","last_became_active":"2024-09-12T01:44:34.583670+0000","last_became_peered":"2024-09-12T01:44:34.583670+0000","last_unstale":"2024-09-12T01:44:34.588131+0000","last_undegraded":"2024-09-12T01:44:34.588131+0000","last_fullsized":"2024-09-12T01:44:34.588131+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:23.984044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.572301+0000","last_change":"2024-09-12T01:44:33.568793+0000","last_active":"2024-09-12T01:44:34.572301+0000","last_peered":"2024-09-12T01:44:34.572301+0000","last_clean":"2024-09-12T01:44:34.572301+0000","last_became_active":"2024-09-12T01:44:33.568545+0000","last_became_peered":"2024-09-12T01:44:33.568545+0000","last_unstale":"2024-09-12T01:44:34.572301+0000","last_undegraded":"2024-09-12T01:44:34.572301+0000","last_fullsized":"2024-09-12T01:44:34.572301+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:02.480071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590661+0000","last_change":"2024-09-12T01:44:34.584292+0000","last_active":"2024-09-12T01:44:34.590661+0000","last_peered":"2024-09-12T01:44:34.590661+0000","last_clean":"2024-09-12T01:44:34.590661+0000","last_became_active":"2024-09-12T01:44:34.583648+0000","last_became_peered":"2024-09-12T01:44:34.583648+0000","last_unstale":"2024-09-12T01:44:34.590661+0000","last_undegraded":"2024-09-12T01:44:34.590661+0000","last_fullsized":"2024-09-12T01:44:34.590661+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:01.238710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"138'3","reported_seq":17,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574365+0000","last_change":"2024-09-12T01:44:33.561874+0000","last_active":"2024-09-12T01:44:35.574365+0000","last_peered":"2024-09-12T01:44:35.574365+0000","last_clean":"2024-09-12T01:44:35.574365+0000","last_became_active":"2024-09-12T01:44:33.561180+0000","last_became_peered":"2024-09-12T01:44:33.561180+0000","last_unstale":"2024-09-12T01:44:35.574365+0000","last_undegraded":"2024-09-12T01:44:35.574365+0000","last_fullsized":"2024-09-12T01:44:35.574365+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.801449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577045+0000","last_change":"2024-09-12T01:44:34.570692+0000","last_active":"2024-09-12T01:44:35.577045+0000","last_peered":"2024-09-12T01:44:35.577045+0000","last_clean":"2024-09-12T01:44:35.577045+0000","last_became_active":"2024-09-12T01:44:34.570372+0000","last_became_peered":"2024-09-12T01:44:34.570372+0000","last_unstale":"2024-09-12T01:44:35.577045+0000","last_undegraded":"2024-09-12T01:44:35.577045+0000","last_fullsized":"2024-09-12T01:44:35.577045+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:06.329724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"138'6","reported_seq":20,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574109+0000","last_change":"2024-09-12T01:44:33.561870+0000","last_active":"2024-09-12T01:44:35.574109+0000","last_peered":"2024-09-12T01:44:35.574109+0000","last_clean":"2024-09-12T01:44:35.574109+0000","last_became_active":"2024-09-12T01:44:33.561575+0000","last_became_peered":"2024-09-12T01:44:33.561575+0000","last_unstale":"2024-09-12T01:44:35.574109+0000","last_undegraded":"2024-09-12T01:44:35.574109+0000","last_fullsized":"2024-09-12T01:44:35.574109+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:28.447167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583184+0000","last_change":"2024-09-12T01:44:34.580219+0000","last_active":"2024-09-12T01:44:34.583184+0000","last_peered":"2024-09-12T01:44:34.583184+0000","last_clean":"2024-09-12T01:44:34.583184+0000","last_became_active":"2024-09-12T01:44:34.579863+0000","last_became_peered":"2024-09-12T01:44:34.579863+0000","last_unstale":"2024-09-12T01:44:34.583184+0000","last_undegraded":"2024-09-12T01:44:34.583184+0000","last_fullsized":"2024-09-12T01:44:34.583184+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:39.869863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.230260+0000","last_change":"2024-09-12T01:44:33.566891+0000","last_active":"2024-09-12T01:44:38.230260+0000","last_peered":"2024-09-12T01:44:38.230260+0000","last_clean":"2024-09-12T01:44:38.230260+0000","last_became_active":"2024-09-12T01:44:33.566599+0000","last_became_peered":"2024-09-12T01:44:33.566599+0000","last_unstale":"2024-09-12T01:44:38.230260+0000","last_undegraded":"2024-09-12T01:44:38.230260+0000","last_fullsized":"2024-09-12T01:44:38.230260+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:08.246043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574087+0000","last_change":"2024-09-12T01:44:34.582387+0000","last_active":"2024-09-12T01:44:35.574087+0000","last_peered":"2024-09-12T01:44:35.574087+0000","last_clean":"2024-09-12T01:44:35.574087+0000","last_became_active":"2024-09-12T01:44:34.582096+0000","last_became_peered":"2024-09-12T01:44:34.582096+0000","last_unstale":"2024-09-12T01:44:35.574087+0000","last_undegraded":"2024-09-12T01:44:35.574087+0000","last_fullsized":"2024-09-12T01:44:35.574087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:51.107638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.573223+0000","last_change":"2024-09-12T01:44:33.558602+0000","last_active":"2024-09-12T01:44:34.573223+0000","last_peered":"2024-09-12T01:44:34.573223+0000","last_clean":"2024-09-12T01:44:34.573223+0000","last_became_active":"2024-09-12T01:44:33.558246+0000","last_became_peered":"2024-09-12T01:44:33.558246+0000","last_unstale":"2024-09-12T01:44:34.573223+0000","last_undegraded":"2024-09-12T01:44:34.573223+0000","last_fullsized":"2024-09-12T01:44:34.573223+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:18.127850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586616+0000","last_change":"2024-09-12T01:44:34.579825+0000","last_active":"2024-09-12T01:44:34.586616+0000","last_peered":"2024-09-12T01:44:34.586616+0000","last_clean":"2024-09-12T01:44:34.586616+0000","last_became_active":"2024-09-12T01:44:34.579565+0000","last_became_peered":"2024-09-12T01:44:34.579565+0000","last_unstale":"2024-09-12T01:44:34.586616+0000","last_undegraded":"2024-09-12T01:44:34.586616+0000","last_fullsized":"2024-09-12T01:44:34.586616+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:58.038820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.569789+0000","last_change":"2024-09-12T01:44:33.565496+0000","last_active":"2024-09-12T01:44:34.569789+0000","last_peered":"2024-09-12T01:44:34.569789+0000","last_clean":"2024-09-12T01:44:34.569789+0000","last_became_active":"2024-09-12T01:44:33.565197+0000","last_became_peered":"2024-09-12T01:44:33.565197+0000","last_unstale":"2024-09-12T01:44:34.569789+0000","last_undegraded":"2024-09-12T01:44:34.569789+0000","last_fullsized":"2024-09-12T01:44:34.569789+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.582599+0000","last_change":"2024-09-12T01:44:34.580307+0000","last_active":"2024-09-12T01:44:34.582599+0000","last_peered":"2024-09-12T01:44:34.582599+0000","last_clean":"2024-09-12T01:44:34.582599+0000","last_became_active":"2024-09-12T01:44:34.579921+0000","last_became_peered":"2024-09-12T01:44:34.579921+0000","last_unstale":"2024-09-12T01:44:34.582599+0000","last_undegraded":"2024-09-12T01:44:34.582599+0000","last_fullsized":"2024-09-12T01:44:34.582599+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:41.766067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"138'8","reported_seq":22,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574137+0000","last_change":"2024-09-12T01:44:33.558236+0000","last_active":"2024-09-12T01:44:35.574137+0000","last_peered":"2024-09-12T01:44:35.574137+0000","last_clean":"2024-09-12T01:44:35.574137+0000","last_became_active":"2024-09-12T01:44:33.557953+0000","last_became_peered":"2024-09-12T01:44:33.557953+0000","last_unstale":"2024-09-12T01:44:35.574137+0000","last_undegraded":"2024-09-12T01:44:35.574137+0000","last_fullsized":"2024-09-12T01:44:35.574137+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:12.293463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590830+0000","last_change":"2024-09-12T01:44:34.589581+0000","last_active":"2024-09-12T01:44:34.590830+0000","last_peered":"2024-09-12T01:44:34.590830+0000","last_clean":"2024-09-12T01:44:34.590830+0000","last_became_active":"2024-09-12T01:44:34.589048+0000","last_became_peered":"2024-09-12T01:44:34.589048+0000","last_unstale":"2024-09-12T01:44:34.590830+0000","last_undegraded":"2024-09-12T01:44:34.590830+0000","last_fullsized":"2024-09-12T01:44:34.590830+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:25.732831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573933+0000","last_change":"2024-09-12T01:44:33.557600+0000","last_active":"2024-09-12T01:44:35.573933+0000","last_peered":"2024-09-12T01:44:35.573933+0000","last_clean":"2024-09-12T01:44:35.573933+0000","last_became_active":"2024-09-12T01:44:33.557317+0000","last_became_peered":"2024-09-12T01:44:33.557317+0000","last_unstale":"2024-09-12T01:44:35.573933+0000","last_undegraded":"2024-09-12T01:44:35.573933+0000","last_fullsized":"2024-09-12T01:44:35.573933+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:34.330164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.230345+0000","last_change":"2024-09-12T01:44:34.574546+0000","last_active":"2024-09-12T01:44:38.230345+0000","last_peered":"2024-09-12T01:44:38.230345+0000","last_clean":"2024-09-12T01:44:38.230345+0000","last_became_active":"2024-09-12T01:44:34.574237+0000","last_became_peered":"2024-09-12T01:44:34.574237+0000","last_unstale":"2024-09-12T01:44:38.230345+0000","last_undegraded":"2024-09-12T01:44:38.230345+0000","last_fullsized":"2024-09-12T01:44:38.230345+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:22.819525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.596296+0000","last_change":"2024-09-12T01:44:33.570978+0000","last_active":"2024-09-12T01:44:34.596296+0000","last_peered":"2024-09-12T01:44:34.596296+0000","last_clean":"2024-09-12T01:44:34.596296+0000","last_became_active":"2024-09-12T01:44:33.570604+0000","last_became_peered":"2024-09-12T01:44:33.570604+0000","last_unstale":"2024-09-12T01:44:34.596296+0000","last_undegraded":"2024-09-12T01:44:34.596296+0000","last_fullsized":"2024-09-12T01:44:34.596296+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:08.714197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.230395+0000","last_change":"2024-09-12T01:44:34.586602+0000","last_active":"2024-09-12T01:44:38.230395+0000","last_peered":"2024-09-12T01:44:38.230395+0000","last_clean":"2024-09-12T01:44:38.230395+0000","last_became_active":"2024-09-12T01:44:34.586340+0000","last_became_peered":"2024-09-12T01:44:34.586340+0000","last_unstale":"2024-09-12T01:44:38.230395+0000","last_undegraded":"2024-09-12T01:44:38.230395+0000","last_fullsized":"2024-09-12T01:44:38.230395+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:51.710457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"138'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574107+0000","last_change":"2024-09-12T01:44:33.564371+0000","last_active":"2024-09-12T01:44:35.574107+0000","last_peered":"2024-09-12T01:44:35.574107+0000","last_clean":"2024-09-12T01:44:35.574107+0000","last_became_active":"2024-09-12T01:44:33.564044+0000","last_became_peered":"2024-09-12T01:44:33.564044+0000","last_unstale":"2024-09-12T01:44:35.574107+0000","last_undegraded":"2024-09-12T01:44:35.574107+0000","last_fullsized":"2024-09-12T01:44:35.574107+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:57.461543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574320+0000","last_change":"2024-09-12T01:44:34.577881+0000","last_active":"2024-09-12T01:44:35.574320+0000","last_peered":"2024-09-12T01:44:35.574320+0000","last_clean":"2024-09-12T01:44:35.574320+0000","last_became_active":"2024-09-12T01:44:34.571399+0000","last_became_peered":"2024-09-12T01:44:34.571399+0000","last_unstale":"2024-09-12T01:44:35.574320+0000","last_undegraded":"2024-09-12T01:44:35.574320+0000","last_fullsized":"2024-09-12T01:44:35.574320+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:36.649302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573487+0000","last_change":"2024-09-12T01:44:33.563195+0000","last_active":"2024-09-12T01:44:35.573487+0000","last_peered":"2024-09-12T01:44:35.573487+0000","last_clean":"2024-09-12T01:44:35.573487+0000","last_became_active":"2024-09-12T01:44:33.562898+0000","last_became_peered":"2024-09-12T01:44:33.562898+0000","last_unstale":"2024-09-12T01:44:35.573487+0000","last_undegraded":"2024-09-12T01:44:35.573487+0000","last_fullsized":"2024-09-12T01:44:35.573487+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:59.939596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576984+0000","last_change":"2024-09-12T01:44:34.576473+0000","last_active":"2024-09-12T01:44:35.576984+0000","last_peered":"2024-09-12T01:44:35.576984+0000","last_clean":"2024-09-12T01:44:35.576984+0000","last_became_active":"2024-09-12T01:44:34.576143+0000","last_became_peered":"2024-09-12T01:44:34.576143+0000","last_unstale":"2024-09-12T01:44:35.576984+0000","last_undegraded":"2024-09-12T01:44:35.576984+0000","last_fullsized":"2024-09-12T01:44:35.576984+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:29.139125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"138'2","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574252+0000","last_change":"2024-09-12T01:44:33.555265+0000","last_active":"2024-09-12T01:44:35.574252+0000","last_peered":"2024-09-12T01:44:35.574252+0000","last_clean":"2024-09-12T01:44:35.574252+0000","last_became_active":"2024-09-12T01:44:33.554630+0000","last_became_peered":"2024-09-12T01:44:33.554630+0000","last_unstale":"2024-09-12T01:44:35.574252+0000","last_undegraded":"2024-09-12T01:44:35.574252+0000","last_fullsized":"2024-09-12T01:44:35.574252+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:53.277135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574227+0000","last_change":"2024-09-12T01:44:34.580476+0000","last_active":"2024-09-12T01:44:35.574227+0000","last_peered":"2024-09-12T01:44:35.574227+0000","last_clean":"2024-09-12T01:44:35.574227+0000","last_became_active":"2024-09-12T01:44:34.579803+0000","last_became_peered":"2024-09-12T01:44:34.579803+0000","last_unstale":"2024-09-12T01:44:35.574227+0000","last_undegraded":"2024-09-12T01:44:35.574227+0000","last_fullsized":"2024-09-12T01:44:35.574227+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:41.911212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573217+0000","last_change":"2024-09-12T01:44:33.556147+0000","last_active":"2024-09-12T01:44:35.573217+0000","last_peered":"2024-09-12T01:44:35.573217+0000","last_clean":"2024-09-12T01:44:35.573217+0000","last_became_active":"2024-09-12T01:44:33.555852+0000","last_became_peered":"2024-09-12T01:44:33.555852+0000","last_unstale":"2024-09-12T01:44:35.573217+0000","last_undegraded":"2024-09-12T01:44:35.573217+0000","last_fullsized":"2024-09-12T01:44:35.573217+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:25.006137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576742+0000","last_change":"2024-09-12T01:44:34.579386+0000","last_active":"2024-09-12T01:44:35.576742+0000","last_peered":"2024-09-12T01:44:35.576742+0000","last_clean":"2024-09-12T01:44:35.576742+0000","last_became_active":"2024-09-12T01:44:34.579004+0000","last_became_peered":"2024-09-12T01:44:34.579004+0000","last_unstale":"2024-09-12T01:44:35.576742+0000","last_undegraded":"2024-09-12T01:44:35.576742+0000","last_fullsized":"2024-09-12T01:44:35.576742+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:59.446473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.229957+0000","last_change":"2024-09-12T01:44:33.570319+0000","last_active":"2024-09-12T01:44:38.229957+0000","last_peered":"2024-09-12T01:44:38.229957+0000","last_clean":"2024-09-12T01:44:38.229957+0000","last_became_active":"2024-09-12T01:44:33.570021+0000","last_became_peered":"2024-09-12T01:44:33.570021+0000","last_unstale":"2024-09-12T01:44:38.229957+0000","last_undegraded":"2024-09-12T01:44:38.229957+0000","last_fullsized":"2024-09-12T01:44:38.229957+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:09.947433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.583126+0000","last_change":"2024-09-12T01:44:34.579335+0000","last_active":"2024-09-12T01:44:34.583126+0000","last_peered":"2024-09-12T01:44:34.583126+0000","last_clean":"2024-09-12T01:44:34.583126+0000","last_became_active":"2024-09-12T01:44:34.578948+0000","last_became_peered":"2024-09-12T01:44:34.578948+0000","last_unstale":"2024-09-12T01:44:34.583126+0000","last_undegraded":"2024-09-12T01:44:34.583126+0000","last_fullsized":"2024-09-12T01:44:34.583126+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:43.451148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573182+0000","last_change":"2024-09-12T01:44:33.562892+0000","last_active":"2024-09-12T01:44:35.573182+0000","last_peered":"2024-09-12T01:44:35.573182+0000","last_clean":"2024-09-12T01:44:35.573182+0000","last_became_active":"2024-09-12T01:44:33.562581+0000","last_became_peered":"2024-09-12T01:44:33.562581+0000","last_unstale":"2024-09-12T01:44:35.573182+0000","last_undegraded":"2024-09-12T01:44:35.573182+0000","last_fullsized":"2024-09-12T01:44:35.573182+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:36.009808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574480+0000","last_change":"2024-09-12T01:44:34.577117+0000","last_active":"2024-09-12T01:44:35.574480+0000","last_peered":"2024-09-12T01:44:35.574480+0000","last_clean":"2024-09-12T01:44:35.574480+0000","last_became_active":"2024-09-12T01:44:34.575726+0000","last_became_peered":"2024-09-12T01:44:34.575726+0000","last_unstale":"2024-09-12T01:44:35.574480+0000","last_undegraded":"2024-09-12T01:44:35.574480+0000","last_fullsized":"2024-09-12T01:44:35.574480+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:29.139125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"138'2","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.591091+0000","last_change":"2024-09-12T01:44:33.566034+0000","last_active":"2024-09-12T01:44:34.591091+0000","last_peered":"2024-09-12T01:44:34.591091+0000","last_clean":"2024-09-12T01:44:34.591091+0000","last_became_active":"2024-09-12T01:44:33.565748+0000","last_became_peered":"2024-09-12T01:44:33.565748+0000","last_unstale":"2024-09-12T01:44:34.591091+0000","last_undegraded":"2024-09-12T01:44:34.591091+0000","last_fullsized":"2024-09-12T01:44:34.591091+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:37:44.021918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.230422+0000","last_change":"2024-09-12T01:44:34.581931+0000","last_active":"2024-09-12T01:44:38.230422+0000","last_peered":"2024-09-12T01:44:38.230422+0000","last_clean":"2024-09-12T01:44:38.230422+0000","last_became_active":"2024-09-12T01:44:34.581639+0000","last_became_peered":"2024-09-12T01:44:34.581639+0000","last_unstale":"2024-09-12T01:44:38.230422+0000","last_undegraded":"2024-09-12T01:44:38.230422+0000","last_fullsized":"2024-09-12T01:44:38.230422+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:52.921501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"139'1","reported_seq":15,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576279+0000","last_change":"2024-09-12T01:44:33.568481+0000","last_active":"2024-09-12T01:44:35.576279+0000","last_peered":"2024-09-12T01:44:35.576279+0000","last_clean":"2024-09-12T01:44:35.576279+0000","last_became_active":"2024-09-12T01:44:33.568131+0000","last_became_peered":"2024-09-12T01:44:33.568131+0000","last_unstale":"2024-09-12T01:44:35.576279+0000","last_undegraded":"2024-09-12T01:44:35.576279+0000","last_fullsized":"2024-09-12T01:44:35.576279+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:06.349936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.230445+0000","last_change":"2024-09-12T01:44:34.575654+0000","last_active":"2024-09-12T01:44:38.230445+0000","last_peered":"2024-09-12T01:44:38.230445+0000","last_clean":"2024-09-12T01:44:38.230445+0000","last_became_active":"2024-09-12T01:44:34.575382+0000","last_became_peered":"2024-09-12T01:44:34.575382+0000","last_unstale":"2024-09-12T01:44:38.230445+0000","last_undegraded":"2024-09-12T01:44:38.230445+0000","last_fullsized":"2024-09-12T01:44:38.230445+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:16.829434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577169+0000","last_change":"2024-09-12T01:44:33.568264+0000","last_active":"2024-09-12T01:44:35.577169+0000","last_peered":"2024-09-12T01:44:35.577169+0000","last_clean":"2024-09-12T01:44:35.577169+0000","last_became_active":"2024-09-12T01:44:33.567714+0000","last_became_peered":"2024-09-12T01:44:33.567714+0000","last_unstale":"2024-09-12T01:44:35.577169+0000","last_undegraded":"2024-09-12T01:44:35.577169+0000","last_fullsized":"2024-09-12T01:44:35.577169+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:50.801449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:38.230207+0000","last_change":"2024-09-12T01:44:34.580218+0000","last_active":"2024-09-12T01:44:38.230207+0000","last_peered":"2024-09-12T01:44:38.230207+0000","last_clean":"2024-09-12T01:44:38.230207+0000","last_became_active":"2024-09-12T01:44:34.579544+0000","last_became_peered":"2024-09-12T01:44:34.579544+0000","last_unstale":"2024-09-12T01:44:38.230207+0000","last_undegraded":"2024-09-12T01:44:38.230207+0000","last_fullsized":"2024-09-12T01:44:38.230207+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:41.734684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574180+0000","last_change":"2024-09-12T01:44:33.553971+0000","last_active":"2024-09-12T01:44:35.574180+0000","last_peered":"2024-09-12T01:44:35.574180+0000","last_clean":"2024-09-12T01:44:35.574180+0000","last_became_active":"2024-09-12T01:44:33.553693+0000","last_became_peered":"2024-09-12T01:44:33.553693+0000","last_unstale":"2024-09-12T01:44:35.574180+0000","last_undegraded":"2024-09-12T01:44:35.574180+0000","last_fullsized":"2024-09-12T01:44:35.574180+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:05.134312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.586642+0000","last_change":"2024-09-12T01:44:34.582051+0000","last_active":"2024-09-12T01:44:34.586642+0000","last_peered":"2024-09-12T01:44:34.586642+0000","last_clean":"2024-09-12T01:44:34.586642+0000","last_became_active":"2024-09-12T01:44:34.581751+0000","last_became_peered":"2024-09-12T01:44:34.581751+0000","last_unstale":"2024-09-12T01:44:34.586642+0000","last_undegraded":"2024-09-12T01:44:34.586642+0000","last_fullsized":"2024-09-12T01:44:34.586642+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:27.408256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574019+0000","last_change":"2024-09-12T01:44:33.566494+0000","last_active":"2024-09-12T01:44:35.574019+0000","last_peered":"2024-09-12T01:44:35.574019+0000","last_clean":"2024-09-12T01:44:35.574019+0000","last_became_active":"2024-09-12T01:44:33.566175+0000","last_became_peered":"2024-09-12T01:44:33.566175+0000","last_unstale":"2024-09-12T01:44:35.574019+0000","last_undegraded":"2024-09-12T01:44:35.574019+0000","last_fullsized":"2024-09-12T01:44:35.574019+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:10.376177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576904+0000","last_change":"2024-09-12T01:44:34.571445+0000","last_active":"2024-09-12T01:44:35.576904+0000","last_peered":"2024-09-12T01:44:35.576904+0000","last_clean":"2024-09-12T01:44:35.576904+0000","last_became_active":"2024-09-12T01:44:34.571128+0000","last_became_peered":"2024-09-12T01:44:34.571128+0000","last_unstale":"2024-09-12T01:44:35.576904+0000","last_undegraded":"2024-09-12T01:44:35.576904+0000","last_fullsized":"2024-09-12T01:44:35.576904+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:03.884787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.569409+0000","last_change":"2024-09-12T01:44:33.565610+0000","last_active":"2024-09-12T01:44:34.569409+0000","last_peered":"2024-09-12T01:44:34.569409+0000","last_clean":"2024-09-12T01:44:34.569409+0000","last_became_active":"2024-09-12T01:44:33.565331+0000","last_became_peered":"2024-09-12T01:44:33.565331+0000","last_unstale":"2024-09-12T01:44:34.569409+0000","last_undegraded":"2024-09-12T01:44:34.569409+0000","last_fullsized":"2024-09-12T01:44:34.569409+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:21.653578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.578023+0000","last_change":"2024-09-12T01:44:34.574761+0000","last_active":"2024-09-12T01:44:34.578023+0000","last_peered":"2024-09-12T01:44:34.578023+0000","last_clean":"2024-09-12T01:44:34.578023+0000","last_became_active":"2024-09-12T01:44:34.574471+0000","last_became_peered":"2024-09-12T01:44:34.574471+0000","last_unstale":"2024-09-12T01:44:34.578023+0000","last_undegraded":"2024-09-12T01:44:34.578023+0000","last_fullsized":"2024-09-12T01:44:34.578023+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:51.806227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.577074+0000","last_change":"2024-09-12T01:44:33.569721+0000","last_active":"2024-09-12T01:44:35.577074+0000","last_peered":"2024-09-12T01:44:35.577074+0000","last_clean":"2024-09-12T01:44:35.577074+0000","last_became_active":"2024-09-12T01:44:33.569016+0000","last_became_peered":"2024-09-12T01:44:33.569016+0000","last_unstale":"2024-09-12T01:44:35.577074+0000","last_undegraded":"2024-09-12T01:44:35.577074+0000","last_fullsized":"2024-09-12T01:44:35.577074+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:41.795137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576770+0000","last_change":"2024-09-12T01:44:34.569764+0000","last_active":"2024-09-12T01:44:35.576770+0000","last_peered":"2024-09-12T01:44:35.576770+0000","last_clean":"2024-09-12T01:44:35.576770+0000","last_became_active":"2024-09-12T01:44:34.569409+0000","last_became_peered":"2024-09-12T01:44:34.569409+0000","last_unstale":"2024-09-12T01:44:35.576770+0000","last_undegraded":"2024-09-12T01:44:35.576770+0000","last_fullsized":"2024-09-12T01:44:35.576770+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:51.107638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.576701+0000","last_change":"2024-09-12T01:44:33.567980+0000","last_active":"2024-09-12T01:44:35.576701+0000","last_peered":"2024-09-12T01:44:35.576701+0000","last_clean":"2024-09-12T01:44:35.576701+0000","last_became_active":"2024-09-12T01:44:33.567648+0000","last_became_peered":"2024-09-12T01:44:33.567648+0000","last_unstale":"2024-09-12T01:44:35.576701+0000","last_undegraded":"2024-09-12T01:44:35.576701+0000","last_fullsized":"2024-09-12T01:44:35.576701+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:40.761288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-12T01:44:34.590655+0000","last_change":"2024-09-12T01:44:34.585187+0000","last_active":"2024-09-12T01:44:34.590655+0000","last_peered":"2024-09-12T01:44:34.590655+0000","last_clean":"2024-09-12T01:44:34.590655+0000","last_became_active":"2024-09-12T01:44:34.584915+0000","last_became_peered":"2024-09-12T01:44:34.584915+0000","last_unstale":"2024-09-12T01:44:34.590655+0000","last_undegraded":"2024-09-12T01:44:34.590655+0000","last_fullsized":"2024-09-12T01:44:34.590655+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:33.544679+0000","last_clean_scrub_stamp":"2024-09-12T01:44:33.544679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:24.224542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.573836+0000","last_change":"2024-09-12T01:44:33.567593+0000","last_active":"2024-09-12T01:44:35.573836+0000","last_peered":"2024-09-12T01:44:35.573836+0000","last_clean":"2024-09-12T01:44:35.573836+0000","last_became_active":"2024-09-12T01:44:33.566833+0000","last_became_peered":"2024-09-12T01:44:33.566833+0000","last_unstale":"2024-09-12T01:44:35.573836+0000","last_undegraded":"2024-09-12T01:44:35.573836+0000","last_fullsized":"2024-09-12T01:44:35.573836+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:44:32.539900+0000","last_clean_scrub_stamp":"2024-09-12T01:44:32.539900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:56.207377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":389,"reported_epoch":139,"state":"active+clean","last_fresh":"2024-09-12T01:44:35.574004+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:44:35.574004+0000","last_peered":"2024-09-12T01:44:35.574004+0000","last_clean":"2024-09-12T01:44:35.574004+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:44:35.574004+0000","last_undegraded":"2024-09-12T01:44:35.574004+0000","last_fullsized":"2024-09-12T01:44:35.574004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509551,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1728512,"data_stored":740564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509549,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":1732608,"data_stored":740598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509549,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2330624,"data_stored":1331604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509549,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41216,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330624,"statfs":{"total":96636764160,"available":96594558976,"internally_reserved":0,"allocated":1744896,"data_stored":742198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509549,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37060,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334780,"statfs":{"total":96636764160,"available":96598814720,"internally_reserved":0,"allocated":1744896,"data_stored":747446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509549,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37644,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334196,"statfs":{"total":96636764160,"available":96598216704,"internally_reserved":0,"allocated":2347008,"data_stored":1332726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509550,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37044,"kb_used_data":1692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334796,"statfs":{"total":96636764160,"available":96598831104,"internally_reserved":0,"allocated":1732608,"data_stored":740634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1744896,"data_stored":746898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:44:42.299 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:44:42.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-12T01:44:42.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.445+0000 7fb5da29b640 1 Processor -- start 2024-09-12T01:44:42.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.445+0000 7fb5da29b640 1 -- start start 2024-09-12T01:44:42.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.445+0000 7fb5da29b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb5d40cf1f0 0x7fb5d40b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.445+0000 7fb5da29b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5d40b6720 0x7fb5d40d3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.445+0000 7fb5da29b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5d40cf860 con 0x7fb5d415e7a0 2024-09-12T01:44:42.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.445+0000 7fb5da29b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d40b6b90 con 0x7fb5d40b6720 2024-09-12T01:44:42.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.445+0000 7fb5da29b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb5d40d2ca0 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.447 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.446+0000 7fb5d8838640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5d40b6720 0x7fb5d40d3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.446+0000 7fb5d3fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb5d415e7a0 0x7fb5d406caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54386/0 (socket says 172.21.15.60:54386) 2024-09-12T01:44:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.446+0000 7fb5d3fff640 1 -- 172.21.15.60:0/3315925270 learned_addr learned my addr 172.21.15.60:0/3315925270 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.446+0000 7fb5d8838640 1 -- 172.21.15.60:0/3315925270 >> v2:172.21.15.105:3300/0 conn(0x7fb5d40cf1f0 msgr2=0x7fb5d40b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.446+0000 7fb5d8838640 1 --2- 172.21.15.60:0/3315925270 >> v2:172.21.15.105:3300/0 conn(0x7fb5d40cf1f0 0x7fb5d40b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.446+0000 7fb5d8838640 1 -- 172.21.15.60:0/3315925270 >> v1:172.21.15.60:6789/0 conn(0x7fb5d415e7a0 legacy=0x7fb5d406caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.446+0000 7fb5d8838640 1 -- 172.21.15.60:0/3315925270 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d40cfb40 con 0x7fb5d40b6720 2024-09-12T01:44:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.446+0000 7fb5d2ffd640 1 -- 172.21.15.60:0/3315925270 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043735223 0 0) 0x7fb5d40cf860 con 0x7fb5d415e7a0 2024-09-12T01:44:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.447+0000 7fb5d8838640 1 --2- 172.21.15.60:0/3315925270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d40b6720 0x7fb5d40d3410 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40d2110 tx=0x7fb5cc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d014399f7f58ac88 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.447+0000 7fb5d2ffd640 1 -- 172.21.15.60:0/3315925270 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc007740 con 0x7fb5d40b6720 2024-09-12T01:44:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.447+0000 7fb5d2ffd640 1 -- 172.21.15.60:0/3315925270 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5cc0078e0 con 0x7fb5d40b6720 2024-09-12T01:44:42.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.447+0000 7fb5d2ffd640 1 -- 172.21.15.60:0/3315925270 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc007cb0 con 0x7fb5d40b6720 2024-09-12T01:44:42.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.447+0000 7fb5da29b640 1 -- 172.21.15.60:0/3315925270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d40b6720 msgr2=0x7fb5d40d3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.447+0000 7fb5da29b640 1 --2- 172.21.15.60:0/3315925270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d40b6720 0x7fb5d40d3410 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40d2110 tx=0x7fb5cc02a5f0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.447+0000 7fb5da29b640 1 -- 172.21.15.60:0/3315925270 shutdown_connections 2024-09-12T01:44:42.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.447+0000 7fb5da29b640 1 --2- 172.21.15.60:0/3315925270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d40b6720 0x7fb5d40d3410 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.447+0000 7fb5da29b640 1 --2- 172.21.15.60:0/3315925270 >> v2:172.21.15.105:3300/0 conn(0x7fb5d40cf1f0 0x7fb5d40b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.447+0000 7fb5da29b640 1 -- 172.21.15.60:0/3315925270 >> 172.21.15.60:0/3315925270 conn(0x7fb5d40d11e0 msgr2=0x7fb5d40d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:42.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.447+0000 7fb5da29b640 1 -- 172.21.15.60:0/3315925270 shutdown_connections 2024-09-12T01:44:42.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.447+0000 7fb5da29b640 1 -- 172.21.15.60:0/3315925270 wait complete. 2024-09-12T01:44:42.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.449+0000 7fb5da29b640 1 Processor -- start 2024-09-12T01:44:42.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.449+0000 7fb5da29b640 1 -- start start 2024-09-12T01:44:42.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.449+0000 7fb5da29b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5d40b6720 0x7fb5d40c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.449+0000 7fb5da29b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d40cf1f0 0x7fb5d41f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.449+0000 7fb5da29b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5d415e7a0 0x7fb5d41f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.449+0000 7fb5da29b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d40b7a00 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5da29b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb5d40d2ef0 con 0x7fb5d40b6720 2024-09-12T01:44:42.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5da29b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb5d415eb80 con 0x7fb5d415e7a0 2024-09-12T01:44:42.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d40cf1f0 0x7fb5d41f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d37fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d40cf1f0 0x7fb5d41f4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42864/0 (socket says 172.21.15.60:42864) 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d37fe640 1 -- 172.21.15.60:0/2127257066 learned_addr learned my addr 172.21.15.60:0/2127257066 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d8838640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5d415e7a0 0x7fb5d41f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d3fff640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5d40b6720 0x7fb5d40c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d37fe640 1 -- 172.21.15.60:0/2127257066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5d415e7a0 msgr2=0x7fb5d41f17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d37fe640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5d415e7a0 0x7fb5d41f17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d37fe640 1 -- 172.21.15.60:0/2127257066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5d40b6720 msgr2=0x7fb5d40c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d37fe640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5d40b6720 0x7fb5d40c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d37fe640 1 -- 172.21.15.60:0/2127257066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5d41f49d0 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d37fe640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d40cf1f0 0x7fb5d41f4490 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800b410 tx=0x7fb5c800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d0ff9640 1 -- 172.21.15.60:0/2127257066 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8015020 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d0ff9640 1 -- 172.21.15.60:0/2127257066 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5c8011850 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5da29b640 1 -- 172.21.15.60:0/2127257066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5d41f4ca0 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.454 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5d0ff9640 1 -- 172.21.15.60:0/2127257066 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5c8011c40 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.450+0000 7fb5da29b640 1 -- 172.21.15.60:0/2127257066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5d41f5260 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.451+0000 7fb5da29b640 1 -- 172.21.15.60:0/2127257066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5d40b61e0 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.452+0000 7fb5d0ff9640 1 -- 172.21.15.60:0/2127257066 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb5c8018020 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.452+0000 7fb5d0ff9640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb5c006be30 0x7fb5c006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.452+0000 7fb5d0ff9640 1 -- 172.21.15.60:0/2127257066 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fb5c808ae10 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.452+0000 7fb5d3fff640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb5c006be30 0x7fb5c006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.455 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.453+0000 7fb5d3fff640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb5c006be30 0x7fb5c006e2f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4000f60 tx=0x7fb5c4007b70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:42.457 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.457+0000 7fb5d0ff9640 1 -- 172.21.15.60:0/2127257066 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb5c801f020 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.706 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.706+0000 7fb5da29b640 1 -- 172.21.15.60:0/2127257066 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb5d40ba3a0 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.709 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.708+0000 7fb5d0ff9640 1 -- 172.21.15.60:0/2127257066 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7fb5c80172c0 con 0x7fb5d40cf1f0 2024-09-12T01:44:42.709 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2024-09-12T01:44:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQA6ReJmXYhfBxAAM95AZhEFs22oj/VXa4NdsQ== 2024-09-12T01:44:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: caps mds = "allow" 2024-09-12T01:44:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: caps mon = "allow r" 2024-09-12T01:44:42.709 INFO:teuthology.orchestra.run.smithi060.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-12T01:44:42.710 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2024-09-12T01:44:42.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.710+0000 7fb5da29b640 1 -- 172.21.15.60:0/2127257066 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb5c006be30 msgr2=0x7fb5c006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.711 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.710+0000 7fb5da29b640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb5c006be30 0x7fb5c006e2f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4000f60 tx=0x7fb5c4007b70 comp rx=0 tx=0).stop 2024-09-12T01:44:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.710+0000 7fb5da29b640 1 -- 172.21.15.60:0/2127257066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d40cf1f0 msgr2=0x7fb5d41f4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.710+0000 7fb5da29b640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d40cf1f0 0x7fb5d41f4490 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800b410 tx=0x7fb5c800b8d0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.710+0000 7fb5da29b640 1 -- 172.21.15.60:0/2127257066 shutdown_connections 2024-09-12T01:44:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.710+0000 7fb5da29b640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb5c006be30 0x7fb5c006e2f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.710+0000 7fb5da29b640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb5d415e7a0 0x7fb5d41f17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.711+0000 7fb5da29b640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5d40cf1f0 0x7fb5d41f4490 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.711+0000 7fb5da29b640 1 --2- 172.21.15.60:0/2127257066 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb5d40b6720 0x7fb5d40c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.711+0000 7fb5da29b640 1 -- 172.21.15.60:0/2127257066 >> 172.21.15.60:0/2127257066 conn(0x7fb5d40d11e0 msgr2=0x7fb5d406cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:42.712 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.711+0000 7fb5da29b640 1 -- 172.21.15.60:0/2127257066 shutdown_connections 2024-09-12T01:44:42.713 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.711+0000 7fb5da29b640 1 -- 172.21.15.60:0/2127257066 wait complete. 2024-09-12T01:44:42.722 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:42.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.824+0000 7f4592465640 1 Processor -- start 2024-09-12T01:44:42.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.824+0000 7f4592465640 1 -- start start 2024-09-12T01:44:42.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.825+0000 7f4592465640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c15fad0 0x7f458c06c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.825+0000 7f4592465640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f458c0cf450 con 0x7f458c06cb60 2024-09-12T01:44:42.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.825+0000 7f4592465640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f458c0cf730 con 0x7f458c06e910 2024-09-12T01:44:42.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.825+0000 7f4592465640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f458c06d070 con 0x7f458c15fad0 2024-09-12T01:44:42.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.825+0000 7f458b7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f458c06cb60 0x7f458c06e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45806/0 (socket says 172.21.15.60:45806) 2024-09-12T01:44:42.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.825+0000 7f458b7fe640 1 -- 172.21.15.60:0/630561181 learned_addr learned my addr 172.21.15.60:0/630561181 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:42.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.826+0000 7f458bfff640 1 --2- 172.21.15.60:0/630561181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c15fad0 0x7f458c06c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.826+0000 7f458affd640 1 -- 172.21.15.60:0/630561181 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544763348 0 0) 0x7f458c0cf450 con 0x7f458c06cb60 2024-09-12T01:44:42.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.826+0000 7f458affd640 1 -- 172.21.15.60:0/630561181 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4574003520 con 0x7f458c06cb60 2024-09-12T01:44:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.826+0000 7f458affd640 1 -- 172.21.15.60:0/630561181 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1885848017 0 0) 0x7f458c0cf730 con 0x7f458c06e910 2024-09-12T01:44:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.826+0000 7f458affd640 1 -- 172.21.15.60:0/630561181 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f458c0cf450 con 0x7f458c06e910 2024-09-12T01:44:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.826+0000 7f458bfff640 1 -- 172.21.15.60:0/630561181 >> v1:172.21.15.105:6789/0 conn(0x7f458c06e910 legacy=0x7f458c0d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.826+0000 7f458bfff640 1 -- 172.21.15.60:0/630561181 >> v1:172.21.15.60:6789/0 conn(0x7f458c06cb60 legacy=0x7f458c06e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.826+0000 7f458bfff640 1 -- 172.21.15.60:0/630561181 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c0cfa10 con 0x7f458c15fad0 2024-09-12T01:44:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.827+0000 7f458bfff640 1 --2- 172.21.15.60:0/630561181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c15fad0 0x7f458c06c620 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f457c0097d0 tx=0x7f457c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c445ebe083ff1c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.827+0000 7f458affd640 1 -- 172.21.15.60:0/630561181 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c037070 con 0x7f458c15fad0 2024-09-12T01:44:42.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.827+0000 7f458affd640 1 -- 172.21.15.60:0/630561181 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f457c032440 con 0x7f458c15fad0 2024-09-12T01:44:42.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.827+0000 7f458affd640 1 -- 172.21.15.60:0/630561181 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c0327f0 con 0x7f458c15fad0 2024-09-12T01:44:42.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.828+0000 7f4592465640 1 -- 172.21.15.60:0/630561181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c15fad0 msgr2=0x7f458c06c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.828+0000 7f4592465640 1 --2- 172.21.15.60:0/630561181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c15fad0 0x7f458c06c620 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f457c0097d0 tx=0x7f457c02a210 comp rx=0 tx=0).stop 2024-09-12T01:44:42.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.828+0000 7f4592465640 1 -- 172.21.15.60:0/630561181 shutdown_connections 2024-09-12T01:44:42.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.828+0000 7f4592465640 1 --2- 172.21.15.60:0/630561181 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c15fad0 0x7f458c06c620 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.828+0000 7f4592465640 1 -- 172.21.15.60:0/630561181 >> 172.21.15.60:0/630561181 conn(0x7f458c0b6ec0 msgr2=0x7f458c0b3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:42.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.828+0000 7f4592465640 1 -- 172.21.15.60:0/630561181 shutdown_connections 2024-09-12T01:44:42.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.828+0000 7f4592465640 1 -- 172.21.15.60:0/630561181 wait complete. 2024-09-12T01:44:42.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.829+0000 7f4592465640 1 Processor -- start 2024-09-12T01:44:42.835 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.829+0000 7f4592465640 1 -- start start 2024-09-12T01:44:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f4592465640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c06cb60 0x7f458c155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f4592465640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f458c06e910 0x7f458c155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f4592465640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458c15fad0 0x7f458c155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f4592465640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f458c071f80 con 0x7f458c06e910 2024-09-12T01:44:42.836 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f4592465640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f458c0cfd80 con 0x7f458c15fad0 2024-09-12T01:44:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f4592465640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f458c072100 con 0x7f458c06cb60 2024-09-12T01:44:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f458b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f458c06e910 0x7f458c155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f458b7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f458c06e910 0x7f458c155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55406/0 (socket says 172.21.15.60:55406) 2024-09-12T01:44:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f458b7fe640 1 -- 172.21.15.60:0/142527845 learned_addr learned my addr 172.21.15.60:0/142527845 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f458bfff640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c06cb60 0x7f458c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f4590a02640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458c15fad0 0x7f458c155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f458b7fe640 1 -- 172.21.15.60:0/142527845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c06cb60 msgr2=0x7f458c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f458b7fe640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c06cb60 0x7f458c155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f458b7fe640 1 -- 172.21.15.60:0/142527845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458c15fad0 msgr2=0x7f458c155ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:42.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f458b7fe640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458c15fad0 0x7f458c155ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:42.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f458b7fe640 1 -- 172.21.15.60:0/142527845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c153100 con 0x7f458c06e910 2024-09-12T01:44:42.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.830+0000 7f458b7fe640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f458c06e910 0x7f458c155ab0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f458000c4d0 tx=0x7f458000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:42.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.831+0000 7f4588ff9640 1 -- 172.21.15.60:0/142527845 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580017070 con 0x7f458c06e910 2024-09-12T01:44:42.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.831+0000 7f4588ff9640 1 -- 172.21.15.60:0/142527845 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4580005ce0 con 0x7f458c06e910 2024-09-12T01:44:42.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.831+0000 7f4592465640 1 -- 172.21.15.60:0/142527845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458c1533a0 con 0x7f458c06e910 2024-09-12T01:44:42.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.831+0000 7f4588ff9640 1 -- 172.21.15.60:0/142527845 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4580007270 con 0x7f458c06e910 2024-09-12T01:44:42.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.831+0000 7f4592465640 1 -- 172.21.15.60:0/142527845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458c153960 con 0x7f458c06e910 2024-09-12T01:44:42.838 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.832+0000 7f4592465640 1 -- 172.21.15.60:0/142527845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f458c0cf730 con 0x7f458c06e910 2024-09-12T01:44:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.832+0000 7f4588ff9640 1 -- 172.21.15.60:0/142527845 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f458001a070 con 0x7f458c06e910 2024-09-12T01:44:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.833+0000 7f4588ff9640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f457806be30 0x7f457806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.833+0000 7f4588ff9640 1 -- 172.21.15.60:0/142527845 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f458008a0d0 con 0x7f458c06e910 2024-09-12T01:44:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.833+0000 7f458bfff640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f457806be30 0x7f457806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:42.839 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.833+0000 7f458bfff640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f457806be30 0x7f457806e2f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f457c034000 tx=0x7f457c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:42.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:42.837+0000 7f4588ff9640 1 -- 172.21.15.60:0/142527845 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4580058420 con 0x7f458c06e910 2024-09-12T01:44:43.048 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.047+0000 7f4592465640 1 -- 172.21.15.60:0/142527845 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f458c0d04f0 con 0x7f458c06e910 2024-09-12T01:44:43.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.048+0000 7f4588ff9640 1 -- 172.21.15.60:0/142527845 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5229 (secure 0 0 0) 0x7f458005c720 con 0x7f458c06e910 2024-09-12T01:44:43.049 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:43.049 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"btime":"2024-09-12T01:44:36:571579+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/877895322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":877895322},{"type":"v1","addr":"172.21.15.60:6837","nonce":877895322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7621,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3882170083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3882170083},{"type":"v1","addr":"172.21.15.105:6835","nonce":3882170083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/906162612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":906162612},{"type":"v1","addr":"172.21.15.60:6836","nonce":906162612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:44:33.921909+0000","modified":"2024-09-12T01:44:35.913515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":36740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36740":{"gid":36740,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/705814866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":705814866},{"type":"v1","addr":"172.21.15.105:6834","nonce":705814866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":36740,"qdb_cluster":[36740]},"id":11}]} 2024-09-12T01:44:43.049 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 88 2024-09-12T01:44:43.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.050+0000 7f4592465640 1 -- 172.21.15.60:0/142527845 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f457806be30 msgr2=0x7f457806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.050+0000 7f4592465640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f457806be30 0x7f457806e2f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f457c034000 tx=0x7f457c02e000 comp rx=0 tx=0).stop 2024-09-12T01:44:43.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.050+0000 7f4592465640 1 -- 172.21.15.60:0/142527845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f458c06e910 msgr2=0x7f458c155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.050+0000 7f4592465640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f458c06e910 0x7f458c155ab0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f458000c4d0 tx=0x7f458000c990 comp rx=0 tx=0).stop 2024-09-12T01:44:43.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.050+0000 7f4592465640 1 -- 172.21.15.60:0/142527845 shutdown_connections 2024-09-12T01:44:43.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.050+0000 7f4592465640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f458c15fad0 0x7f458c155ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.050+0000 7f4592465640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f458c06e910 0x7f458c155ab0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.050+0000 7f4592465640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f457806be30 0x7f457806e2f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.050+0000 7f4592465640 1 --2- 172.21.15.60:0/142527845 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f458c06cb60 0x7f458c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.050+0000 7f4592465640 1 -- 172.21.15.60:0/142527845 >> 172.21.15.60:0/142527845 conn(0x7f458c0b6ec0 msgr2=0x7f458c06e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:43.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.050+0000 7f4592465640 1 -- 172.21.15.60:0/142527845 shutdown_connections 2024-09-12T01:44:43.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.050+0000 7f4592465640 1 -- 172.21.15.60:0/142527845 wait complete. 2024-09-12T01:44:43.465 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-12T01:44:33.921909+0000', 'modified': '2024-09-12T01:44:35.913515+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 36740}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_36740': {'gid': 36740, 'name': 'd', 'rank': 0, 'incarnation': 86, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.105:6834/705814866', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.105:6832', 'nonce': 705814866}, {'type': 'v1', 'addr': '172.21.15.105:6834', 'nonce': 705814866}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 36740, 'qdb_cluster': [36740]} 2024-09-12T01:44:43.466 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-12T01:44:43.466 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-12T01:44:43.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.571+0000 7f6e304e6640 1 Processor -- start 2024-09-12T01:44:43.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.571+0000 7f6e304e6640 1 -- start start 2024-09-12T01:44:43.572 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.572+0000 7f6e304e6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6e280d1c20 0x7f6e280cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.572+0000 7f6e304e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280cf590 0x7f6e280cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.572+0000 7f6e304e6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e280d4530 con 0x7f6e280d1130 2024-09-12T01:44:43.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.572+0000 7f6e304e6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6e280d40a0 con 0x7f6e280d1c20 2024-09-12T01:44:43.573 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.572+0000 7f6e304e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6e280d3490 con 0x7f6e280cf590 2024-09-12T01:44:43.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.573+0000 7f6e2ea83640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280cf590 0x7f6e280cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.573+0000 7f6e2da81640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6e280d1c20 0x7f6e280cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.573+0000 7f6e2ea83640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280cf590 0x7f6e280cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:41666/0 (socket says 172.21.15.60:41666) 2024-09-12T01:44:43.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.573+0000 7f6e2ea83640 1 -- 172.21.15.60:0/2011619269 learned_addr learned my addr 172.21.15.60:0/2011619269 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:43.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.573+0000 7f6e2ea83640 1 -- 172.21.15.60:0/2011619269 >> v2:172.21.15.105:3300/0 conn(0x7f6e280d1c20 msgr2=0x7f6e280cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:43.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.573+0000 7f6e2ea83640 1 --2- 172.21.15.60:0/2011619269 >> v2:172.21.15.105:3300/0 conn(0x7f6e280d1c20 0x7f6e280cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.573+0000 7f6e2ea83640 1 -- 172.21.15.60:0/2011619269 >> v1:172.21.15.105:6789/0 conn(0x7f6e280d1130 legacy=0x7f6e280d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.573+0000 7f6e2ea83640 1 -- 172.21.15.60:0/2011619269 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e280d3770 con 0x7f6e280cf590 2024-09-12T01:44:43.574 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.573+0000 7f6e2da81640 1 --2- 172.21.15.60:0/2011619269 >> v2:172.21.15.105:3300/0 conn(0x7f6e280d1c20 0x7f6e280cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:43.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.574+0000 7f6e2ea83640 1 --2- 172.21.15.60:0/2011619269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280cf590 0x7f6e280cfa20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009870 tx=0x7f6e2002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6efc6d844103ee3e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:43.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.574+0000 7f6e2d280640 1 -- 172.21.15.60:0/2011619269 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20037070 con 0x7f6e280cf590 2024-09-12T01:44:43.575 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.574+0000 7f6e2d280640 1 -- 172.21.15.60:0/2011619269 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e20032440 con 0x7f6e280cf590 2024-09-12T01:44:43.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.574+0000 7f6e2d280640 1 -- 172.21.15.60:0/2011619269 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20032810 con 0x7f6e280cf590 2024-09-12T01:44:43.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.574+0000 7f6e304e6640 1 -- 172.21.15.60:0/2011619269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280cf590 msgr2=0x7f6e280cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.574+0000 7f6e304e6640 1 --2- 172.21.15.60:0/2011619269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280cf590 0x7f6e280cfa20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009870 tx=0x7f6e2002a270 comp rx=0 tx=0).stop 2024-09-12T01:44:43.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.574+0000 7f6e304e6640 1 -- 172.21.15.60:0/2011619269 shutdown_connections 2024-09-12T01:44:43.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.574+0000 7f6e304e6640 1 --2- 172.21.15.60:0/2011619269 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280cf590 0x7f6e280cfa20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.574+0000 7f6e304e6640 1 --2- 172.21.15.60:0/2011619269 >> v2:172.21.15.105:3300/0 conn(0x7f6e280d1c20 0x7f6e280cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.574+0000 7f6e304e6640 1 -- 172.21.15.60:0/2011619269 >> 172.21.15.60:0/2011619269 conn(0x7f6e2806c020 msgr2=0x7f6e2806c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:43.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.575+0000 7f6e304e6640 1 -- 172.21.15.60:0/2011619269 shutdown_connections 2024-09-12T01:44:43.576 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.575+0000 7f6e304e6640 1 -- 172.21.15.60:0/2011619269 wait complete. 2024-09-12T01:44:43.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.576+0000 7f6e304e6640 1 Processor -- start 2024-09-12T01:44:43.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.576+0000 7f6e304e6640 1 -- start start 2024-09-12T01:44:43.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.576+0000 7f6e304e6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e280cf590 0x7f6e281e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.576+0000 7f6e304e6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e280d1130 0x7f6e281e8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.578 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.576+0000 7f6e304e6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280d1c20 0x7f6e2815c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.576+0000 7f6e304e6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6e280b8c30 con 0x7f6e280cf590 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.576+0000 7f6e304e6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6e280d3d30 con 0x7f6e280d1130 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.576+0000 7f6e304e6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6e280b8db0 con 0x7f6e280d1c20 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e2e282640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e280cf590 0x7f6e281e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e2e282640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e280cf590 0x7f6e281e6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55408/0 (socket says 172.21.15.60:55408) 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e2e282640 1 -- 172.21.15.60:0/1298546479 learned_addr learned my addr 172.21.15.60:0/1298546479 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e2da81640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e280d1130 0x7f6e281e8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e2ea83640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280d1c20 0x7f6e2815c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e2e282640 1 -- 172.21.15.60:0/1298546479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280d1c20 msgr2=0x7f6e2815c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e2e282640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280d1c20 0x7f6e2815c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e2e282640 1 -- 172.21.15.60:0/1298546479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e280d1130 msgr2=0x7f6e281e8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e2e282640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e280d1130 0x7f6e281e8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e2e282640 1 -- 172.21.15.60:0/1298546479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e28157f00 con 0x7f6e280cf590 2024-09-12T01:44:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e2ea83640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280d1c20 0x7f6e2815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:43.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e2e282640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e280cf590 0x7f6e281e6c30 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800c430 tx=0x7f6e1800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:43.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e26ffd640 1 -- 172.21.15.60:0/1298546479 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e180052d0 con 0x7f6e280cf590 2024-09-12T01:44:43.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e26ffd640 1 -- 172.21.15.60:0/1298546479 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e18005490 con 0x7f6e280cf590 2024-09-12T01:44:43.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e304e6640 1 -- 172.21.15.60:0/1298546479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e28159a30 con 0x7f6e280cf590 2024-09-12T01:44:43.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e26ffd640 1 -- 172.21.15.60:0/1298546479 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18007260 con 0x7f6e280cf590 2024-09-12T01:44:43.580 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.577+0000 7f6e304e6640 1 -- 172.21.15.60:0/1298546479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e2815a290 con 0x7f6e280cf590 2024-09-12T01:44:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.579+0000 7f6e26ffd640 1 -- 172.21.15.60:0/1298546479 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6e18007400 con 0x7f6e280cf590 2024-09-12T01:44:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.580+0000 7f6e26ffd640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e1406be30 0x7f6e1406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.580+0000 7f6e26ffd640 1 -- 172.21.15.60:0/1298546479 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f6e1808a360 con 0x7f6e280cf590 2024-09-12T01:44:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.580+0000 7f6e2da81640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e1406be30 0x7f6e1406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.580+0000 7f6e2da81640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e1406be30 0x7f6e1406e2f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009bd0 tx=0x7f6e1c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.581+0000 7f6e3327e740 1 Processor -- start 2024-09-12T01:44:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.581+0000 7f6e3327e740 1 -- start start 2024-09-12T01:44:43.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e3327e740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 0x56312921fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e3327e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291d7a80 0x5631291da6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e3327e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291d48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e3327e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56312913c520 con 0x5631291dba50 2024-09-12T01:44:43.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e3327e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5631290e43e0 con 0x5631291d7a80 2024-09-12T01:44:43.583 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e3327e740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x5631291384e0 con 0x5631291da2c0 2024-09-12T01:44:43.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e2ea83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291d48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e2ea83640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291d48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55418/0 (socket says 172.21.15.60:55418) 2024-09-12T01:44:43.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e2ea83640 1 -- 172.21.15.60:0/4100674147 learned_addr learned my addr 172.21.15.60:0/4100674147 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:43.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e2da81640 1 --2- 172.21.15.60:0/4100674147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291d7a80 0x5631291da6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e2e282640 1 --2- 172.21.15.60:0/4100674147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 0x56312921fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e2ea83640 1 -- 172.21.15.60:0/4100674147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 msgr2=0x56312921fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:43.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e2ea83640 1 --2- 172.21.15.60:0/4100674147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 0x56312921fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e2ea83640 1 -- 172.21.15.60:0/4100674147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291d7a80 msgr2=0x5631291da6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:43.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e2ea83640 1 --2- 172.21.15.60:0/4100674147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291d7a80 0x5631291da6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e2ea83640 1 -- 172.21.15.60:0/4100674147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631290ff2f0 con 0x5631291dba50 2024-09-12T01:44:43.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e2ea83640 1 --2- 172.21.15.60:0/4100674147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291d48b0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009960 tx=0x7f6e2002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b09f06c06e87942 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:43.584 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.582+0000 7f6e0ffff640 1 -- 172.21.15.60:0/4100674147 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20037040 con 0x5631291dba50 2024-09-12T01:44:43.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.583+0000 7f6e0ffff640 1 -- 172.21.15.60:0/4100674147 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e20032740 con 0x5631291dba50 2024-09-12T01:44:43.585 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.583+0000 7f6e0ffff640 1 -- 172.21.15.60:0/4100674147 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20032af0 con 0x5631291dba50 2024-09-12T01:44:43.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.583+0000 7f6e3327e740 1 -- 172.21.15.60:0/4100674147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 msgr2=0x5631291d48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.583+0000 7f6e3327e740 1 --2- 172.21.15.60:0/4100674147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291d48b0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009960 tx=0x7f6e2002c000 comp rx=0 tx=0).stop 2024-09-12T01:44:43.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.583+0000 7f6e3327e740 1 -- 172.21.15.60:0/4100674147 shutdown_connections 2024-09-12T01:44:43.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.583+0000 7f6e3327e740 1 --2- 172.21.15.60:0/4100674147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291d48b0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.583+0000 7f6e3327e740 1 --2- 172.21.15.60:0/4100674147 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291d7a80 0x5631291da6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.583+0000 7f6e3327e740 1 --2- 172.21.15.60:0/4100674147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 0x56312921fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.583+0000 7f6e3327e740 1 -- 172.21.15.60:0/4100674147 >> 172.21.15.60:0/4100674147 conn(0x5631291d6a80 msgr2=0x56312921ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:43.587 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.583+0000 7f6e3327e740 1 -- 172.21.15.60:0/4100674147 shutdown_connections 2024-09-12T01:44:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.583+0000 7f6e3327e740 1 -- 172.21.15.60:0/4100674147 wait complete. 2024-09-12T01:44:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.584+0000 7f6e3327e740 1 -- start start 2024-09-12T01:44:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.584+0000 7f6e3327e740 1 Processor -- start 2024-09-12T01:44:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e3327e740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 0x563129203560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e3327e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291f8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e3327e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291f8da0 0x5631291f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e3327e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5631291d5f20 con 0x5631291dba50 2024-09-12T01:44:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e3327e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5631290c5450 con 0x5631291f8da0 2024-09-12T01:44:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e3327e740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x563129220290 con 0x5631291da2c0 2024-09-12T01:44:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e3327e740 10 client.0 _ll_register_callbacks cb 0x563128e4eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:44:43.588 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e2da81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291f8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e2da81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291f8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55428/0 (socket says 172.21.15.60:55428) 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e2da81640 1 -- 172.21.15.60:0/1656871247 learned_addr learned my addr 172.21.15.60:0/1656871247 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e2e282640 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 0x563129203560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e2ea83640 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291f8da0 0x5631291f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e2da81640 1 -- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 msgr2=0x563129203560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e2da81640 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 0x563129203560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e2da81640 1 -- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291f8da0 msgr2=0x5631291f9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e2da81640 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291f8da0 0x5631291f9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e2da81640 1 -- 172.21.15.60:0/1656871247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563128e4f2d0 con 0x5631291dba50 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.585+0000 7f6e2ea83640 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291f8da0 0x5631291f9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.586+0000 7f6e2da81640 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291f8600 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c004620 tx=0x7f6e1c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408299f67a8aabe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.586+0000 7f6e0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.586+0000 7f6e0d7fa640 1 -- 172.21.15.60:0/1656871247 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c027030 con 0x5631291dba50 2024-09-12T01:44:43.589 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.586+0000 7f6e3327e740 1 -- 172.21.15.60:0/1656871247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e20032740 con 0x5631291dba50 2024-09-12T01:44:43.590 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.586+0000 7f6e0d7fa640 1 -- 172.21.15.60:0/1656871247 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f6e1c023450 con 0x5631291dba50 2024-09-12T01:44:43.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.588+0000 7f6e0d7fa640 1 -- 172.21.15.60:0/1656871247 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f6e1c030050 con 0x5631291dba50 2024-09-12T01:44:43.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.588+0000 7f6e3327e740 10 client.8571 fetch_fsmap learned FSMap version 88 2024-09-12T01:44:43.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.588+0000 7f6e3327e740 1 -- 172.21.15.60:0/1656871247 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) -- 0x563128f196b0 con 0x5631291dba50 2024-09-12T01:44:43.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.588+0000 7f6e0d7fa640 1 -- 172.21.15.60:0/1656871247 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e20032740 con 0x5631291dba50 2024-09-12T01:44:43.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.588+0000 7f6e0d7fa640 1 -- 172.21.15.60:0/1656871247 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 88) ==== 3502+0+0 (secure 0 0 0) 0x7f6e1c033020 con 0x5631291dba50 2024-09-12T01:44:43.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.588+0000 7f6e3327e740 10 client.8571 fetch_fsmap finished waiting for FSMap version 88 2024-09-12T01:44:43.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.588+0000 7f6e3327e740 10 client.8571 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:44:43.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.589+0000 7f6e3327e740 20 client.8571 populate_metadata read hostname 'smithi060' 2024-09-12T01:44:43.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.589+0000 7f6e3327e740 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:6832/705814866,v1:172.21.15.105:6834/705814866] conn(0x5631291d3a30 0x5631291d3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.589+0000 7f6e3327e740 4 client.8571 mds_command: new command op to 36740 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-12T01:44:43.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.589+0000 7f6e3327e740 1 -- 172.21.15.60:0/1656871247 --> [v2:172.21.15.105:6832/705814866,v1:172.21.15.105:6834/705814866] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563129149c50 con 0x5631291d3a30 2024-09-12T01:44:43.592 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.589+0000 7f6e2e282640 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:6832/705814866,v1:172.21.15.105:6834/705814866] conn(0x5631291d3a30 0x5631291d3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.589+0000 7f6e2e282640 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:6832/705814866,v1:172.21.15.105:6834/705814866] conn(0x5631291d3a30 0x5631291d3e10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a68c5e3df8d8eb5 server_cookie=b2d8e5a530389556 in_seq=0 out_seq=0 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.589+0000 7f6e0d7fa640 10 client.8571 ms_handle_connect on v2:172.21.15.105:6832/705814866 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e0d7fa640 1 -- 172.21.15.60:0/1656871247 <== mds.0 v2:172.21.15.105:6832/705814866 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563129149c50 con 0x5631291d3a30 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e0d7fa640 10 client.8571 handle_command_reply: tid=0 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e3327e740 1 client.8571 shutdown 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e3327e740 1 -- 172.21.15.60:0/1656871247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 msgr2=0x5631291f8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e3327e740 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291f8600 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c004620 tx=0x7f6e1c004a40 comp rx=0 tx=0).stop 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e3327e740 1 -- 172.21.15.60:0/1656871247 shutdown_connections 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e3327e740 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:6832/705814866,v1:172.21.15.105:6834/705814866] conn(0x5631291d3a30 0x5631291d3e10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e3327e740 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291f8da0 0x5631291f9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e3327e740 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291f8600 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e3327e740 1 --2- 172.21.15.60:0/1656871247 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 0x563129203560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.593 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e0d7fa640 0 client.8571 ms_handle_reset on v2:172.21.15.105:6832/705814866 2024-09-12T01:44:43.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e3327e740 1 -- 172.21.15.60:0/1656871247 >> 172.21.15.60:0/1656871247 conn(0x5631291d7a80 msgr2=0x563129222440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:43.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e3327e740 1 -- 172.21.15.60:0/1656871247 shutdown_connections 2024-09-12T01:44:43.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.590+0000 7f6e3327e740 1 -- 172.21.15.60:0/1656871247 wait complete. 2024-09-12T01:44:43.594 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.591+0000 7f6e3327e740 20 client.8571 trim_cache size 0 max 16384 2024-09-12T01:44:43.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.609+0000 7f6e3327e740 1 Processor -- start 2024-09-12T01:44:43.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.609+0000 7f6e3327e740 1 -- start start 2024-09-12T01:44:43.611 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e3327e740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 0x5631292315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e3327e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291f8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e3327e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291f8da0 0x56312921eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e3327e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28159160 con 0x5631291dba50 2024-09-12T01:44:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e3327e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281584c0 con 0x5631291f8da0 2024-09-12T01:44:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e3327e740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6e28158b10 con 0x5631291da2c0 2024-09-12T01:44:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e2da81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e2da81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55440/0 (socket says 172.21.15.60:55440) 2024-09-12T01:44:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e2da81640 1 -- 172.21.15.60:0/195510450 learned_addr learned my addr 172.21.15.60:0/195510450 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e2e282640 1 --2- 172.21.15.60:0/195510450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 0x5631292315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e2ea83640 1 --2- 172.21.15.60:0/195510450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291f8da0 0x56312921eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e2da81640 1 -- 172.21.15.60:0/195510450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 msgr2=0x5631292315e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:43.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e2da81640 1 --2- 172.21.15.60:0/195510450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 0x5631292315e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e2da81640 1 -- 172.21.15.60:0/195510450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291f8da0 msgr2=0x56312921eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e2da81640 1 --2- 172.21.15.60:0/195510450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291f8da0 0x56312921eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e2da81640 1 -- 172.21.15.60:0/195510450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631292018b0 con 0x5631291dba50 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e2da81640 1 --2- 172.21.15.60:0/195510450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291f8250 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c003e50 tx=0x7f6e1c022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67157fcdcc9ecbe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e0f7fe640 1 -- 172.21.15.60:0/195510450 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c027040 con 0x5631291dba50 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e0f7fe640 1 -- 172.21.15.60:0/195510450 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0236f0 con 0x5631291dba50 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.610+0000 7f6e0f7fe640 1 -- 172.21.15.60:0/195510450 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c023ac0 con 0x5631291dba50 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.611+0000 7f6e3327e740 1 -- 172.21.15.60:0/195510450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 msgr2=0x5631291f8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.611+0000 7f6e3327e740 1 --2- 172.21.15.60:0/195510450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291f8250 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c003e50 tx=0x7f6e1c022000 comp rx=0 tx=0).stop 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.611+0000 7f6e3327e740 1 -- 172.21.15.60:0/195510450 shutdown_connections 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.611+0000 7f6e3327e740 1 --2- 172.21.15.60:0/195510450 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291f8da0 0x56312921eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.611+0000 7f6e3327e740 1 --2- 172.21.15.60:0/195510450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x5631291f8250 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.611+0000 7f6e3327e740 1 --2- 172.21.15.60:0/195510450 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291da2c0 0x5631292315e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.611+0000 7f6e3327e740 1 -- 172.21.15.60:0/195510450 >> 172.21.15.60:0/195510450 conn(0x5631291d7a80 msgr2=0x563129222440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:43.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.611+0000 7f6e3327e740 1 -- 172.21.15.60:0/195510450 shutdown_connections 2024-09-12T01:44:43.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.611+0000 7f6e3327e740 1 -- 172.21.15.60:0/195510450 wait complete. 2024-09-12T01:44:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.612+0000 7f6e3327e740 1 -- start start 2024-09-12T01:44:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.612+0000 7f6e3327e740 1 Processor -- start 2024-09-12T01:44:43.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e3327e740 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291da2c0 0x563129292f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e3327e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x563129232480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e3327e740 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291f8da0 0x5631292329c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e3327e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563129203c40 con 0x5631291dba50 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e3327e740 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x5631291f8b90 con 0x5631291da2c0 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e3327e740 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x56312921d510 con 0x5631291f8da0 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e3327e740 10 client.0 _ll_register_callbacks cb 0x7f6e1c01b040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e2da81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x563129232480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e2da81640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x563129232480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55448/0 (socket says 172.21.15.60:55448) 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e2da81640 1 -- 172.21.15.60:0/1737616243 learned_addr learned my addr 172.21.15.60:0/1737616243 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e2ea83640 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291f8da0 0x5631292329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e2e282640 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291da2c0 0x563129292f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e2da81640 1 -- 172.21.15.60:0/1737616243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291f8da0 msgr2=0x5631292329c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e2da81640 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291f8da0 0x5631292329c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e2da81640 1 -- 172.21.15.60:0/1737616243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291da2c0 msgr2=0x563129292f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e2da81640 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291da2c0 0x563129292f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e2da81640 1 -- 172.21.15.60:0/1737616243 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631292434a0 con 0x5631291dba50 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e2da81640 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x563129232480 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00b010 tx=0x7f6e1c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1533a3e1909823 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e0d7fa640 1 -- 172.21.15.60:0/1737616243 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1c027040 con 0x5631291dba50 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e0d7fa640 1 -- 172.21.15.60:0/1737616243 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f6e1c046cf0 con 0x5631291dba50 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.613+0000 7f6e3327e740 1 -- 172.21.15.60:0/1737616243 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e1c0236f0 con 0x5631291dba50 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.614+0000 7f6e0d7fa640 1 -- 172.21.15.60:0/1737616243 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) ==== 24+0+0 (secure 0 0 0) 0x7f6e1c04d050 con 0x5631291dba50 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.614+0000 7f6e3327e740 10 client.8577 fetch_fsmap learned FSMap version 88 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.614+0000 7f6e3327e740 1 -- 172.21.15.60:0/1737616243 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=2+}) -- 0x563129233150 con 0x5631291dba50 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.614+0000 7f6e0d7fa640 1 -- 172.21.15.60:0/1737616243 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e1c0236f0 con 0x5631291dba50 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.614+0000 7f6e0d7fa640 1 -- 172.21.15.60:0/1737616243 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 88) ==== 3502+0+0 (secure 0 0 0) 0x7f6e1c050020 con 0x5631291dba50 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.614+0000 7f6e3327e740 10 client.8577 fetch_fsmap finished waiting for FSMap version 88 2024-09-12T01:44:43.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.614+0000 7f6e3327e740 10 client.8577 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-12T01:44:43.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.614+0000 7f6e3327e740 20 client.8577 populate_metadata read hostname 'smithi060' 2024-09-12T01:44:43.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.614+0000 7f6e3327e740 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.105:6832/705814866,v1:172.21.15.105:6834/705814866] conn(0x563129236bf0 0x563129236fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.614+0000 7f6e3327e740 4 client.8577 mds_command: new command op to 36740 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-12T01:44:43.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.614+0000 7f6e3327e740 1 -- 172.21.15.60:0/1737616243 --> [v2:172.21.15.105:6832/705814866,v1:172.21.15.105:6834/705814866] -- command(tid 0: {"prefix": "status"}) -- 0x563129143fa0 con 0x563129236bf0 2024-09-12T01:44:43.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.614+0000 7f6e2e282640 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.105:6832/705814866,v1:172.21.15.105:6834/705814866] conn(0x563129236bf0 0x563129236fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e2e282640 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.105:6832/705814866,v1:172.21.15.105:6834/705814866] conn(0x563129236bf0 0x563129236fd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=938cade923aae33e server_cookie=a71a8816e1519299 in_seq=0 out_seq=0 2024-09-12T01:44:43.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e0d7fa640 10 client.8577 ms_handle_connect on v2:172.21.15.105:6832/705814866 2024-09-12T01:44:43.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e0d7fa640 1 -- 172.21.15.60:0/1737616243 <== mds.0 v2:172.21.15.105:6832/705814866 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x563129143fa0 con 0x563129236bf0 2024-09-12T01:44:43.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e0d7fa640 10 client.8577 handle_command_reply: tid=0 2024-09-12T01:44:43.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e3327e740 1 client.8577 shutdown 2024-09-12T01:44:43.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e3327e740 1 -- 172.21.15.60:0/1737616243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 msgr2=0x563129232480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e3327e740 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x563129232480 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c00b010 tx=0x7f6e1c016000 comp rx=0 tx=0).stop 2024-09-12T01:44:43.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e3327e740 1 -- 172.21.15.60:0/1737616243 shutdown_connections 2024-09-12T01:44:43.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e3327e740 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.105:6832/705814866,v1:172.21.15.105:6834/705814866] conn(0x563129236bf0 0x563129236fd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e3327e740 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x5631291f8da0 0x5631292329c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e3327e740 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5631291dba50 0x563129232480 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e3327e740 1 --2- 172.21.15.60:0/1737616243 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x5631291da2c0 0x563129292f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e3327e740 1 -- 172.21.15.60:0/1737616243 >> 172.21.15.60:0/1737616243 conn(0x5631291d7a80 msgr2=0x56312921eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:43.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e0d7fa640 0 client.8577 ms_handle_reset on v2:172.21.15.105:6832/705814866 2024-09-12T01:44:43.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e3327e740 1 -- 172.21.15.60:0/1737616243 shutdown_connections 2024-09-12T01:44:43.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e3327e740 1 -- 172.21.15.60:0/1737616243 wait complete. 2024-09-12T01:44:43.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.615+0000 7f6e3327e740 20 client.8577 trim_cache size 0 max 16384 2024-09-12T01:44:43.621 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:44:43.622 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_fsid": "5401bd8a-3492-4b21-b6c0-d6616ff39793", 2024-09-12T01:44:43.622 INFO:teuthology.orchestra.run.smithi060.stdout: "whoami": 0, 2024-09-12T01:44:43.622 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 36740, 2024-09-12T01:44:43.622 INFO:teuthology.orchestra.run.smithi060.stdout: "want_state": "up:active", 2024-09-12T01:44:43.622 INFO:teuthology.orchestra.run.smithi060.stdout: "state": "up:active", 2024-09-12T01:44:43.622 INFO:teuthology.orchestra.run.smithi060.stdout: "fs_name": "cephfs", 2024-09-12T01:44:43.622 INFO:teuthology.orchestra.run.smithi060.stdout: "rank_uptime": 9.0492454969999994, 2024-09-12T01:44:43.622 INFO:teuthology.orchestra.run.smithi060.stdout: "mdsmap_epoch": 88, 2024-09-12T01:44:43.622 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch": 139, 2024-09-12T01:44:43.622 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_epoch_barrier": 139, 2024-09-12T01:44:43.622 INFO:teuthology.orchestra.run.smithi060.stdout: "uptime": 14.080275390000001 2024-09-12T01:44:43.622 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:44:43.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.616+0000 7f6e304e6640 1 -- 172.21.15.60:0/1298546479 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e1406be30 msgr2=0x7f6e1406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.616+0000 7f6e304e6640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e1406be30 0x7f6e1406e2f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6e1c009bd0 tx=0x7f6e1c00b040 comp rx=0 tx=0).stop 2024-09-12T01:44:43.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.616+0000 7f6e304e6640 1 -- 172.21.15.60:0/1298546479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e280cf590 msgr2=0x7f6e281e6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.616+0000 7f6e304e6640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e280cf590 0x7f6e281e6c30 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800c430 tx=0x7f6e1800c8f0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.616+0000 7f6e304e6640 1 -- 172.21.15.60:0/1298546479 shutdown_connections 2024-09-12T01:44:43.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.616+0000 7f6e304e6640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6e1406be30 0x7f6e1406e2f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.616+0000 7f6e304e6640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e280d1c20 0x7f6e2815c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.616+0000 7f6e304e6640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e280d1130 0x7f6e281e8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.616+0000 7f6e304e6640 1 --2- 172.21.15.60:0/1298546479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e280cf590 0x7f6e281e6c30 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.616+0000 7f6e304e6640 1 -- 172.21.15.60:0/1298546479 >> 172.21.15.60:0/1298546479 conn(0x7f6e2806c020 msgr2=0x7f6e280cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:43.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.616+0000 7f6e304e6640 1 -- 172.21.15.60:0/1298546479 shutdown_connections 2024-09-12T01:44:43.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.616+0000 7f6e304e6640 1 -- 172.21.15.60:0/1298546479 wait complete. 2024-09-12T01:44:43.627 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:44:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.729+0000 7f7d1b978640 1 Processor -- start 2024-09-12T01:44:43.730 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.729+0000 7f7d1b978640 1 -- start start 2024-09-12T01:44:43.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.730+0000 7f7d1b978640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d140ba240 0x7f7d140d3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.730+0000 7f7d1b978640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d140ba660 con 0x7f7d1415e7a0 2024-09-12T01:44:43.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.730+0000 7f7d1b978640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d140d2f40 con 0x7f7d140cf2f0 2024-09-12T01:44:43.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.730+0000 7f7d1b978640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7d140d3220 con 0x7f7d140ba240 2024-09-12T01:44:43.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.730+0000 7f7d19714640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7d1415e7a0 0x7f7d140d2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45820/0 (socket says 172.21.15.60:45820) 2024-09-12T01:44:43.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.730+0000 7f7d19714640 1 -- 172.21.15.60:0/1946814712 learned_addr learned my addr 172.21.15.60:0/1946814712 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:43.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.730+0000 7f7d18f13640 1 --2- 172.21.15.60:0/1946814712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d140ba240 0x7f7d140d3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.730+0000 7f7d0bfff640 1 -- 172.21.15.60:0/1946814712 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1674104113 0 0) 0x7f7d140ba660 con 0x7f7d1415e7a0 2024-09-12T01:44:43.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.730+0000 7f7d0bfff640 1 -- 172.21.15.60:0/1946814712 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d00003520 con 0x7f7d1415e7a0 2024-09-12T01:44:43.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.731+0000 7f7d0bfff640 1 -- 172.21.15.60:0/1946814712 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3175607338 0 0) 0x7f7d140d2f40 con 0x7f7d140cf2f0 2024-09-12T01:44:43.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.731+0000 7f7d0bfff640 1 -- 172.21.15.60:0/1946814712 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d140ba660 con 0x7f7d140cf2f0 2024-09-12T01:44:43.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.731+0000 7f7d18f13640 1 -- 172.21.15.60:0/1946814712 >> v1:172.21.15.105:6789/0 conn(0x7f7d140cf2f0 legacy=0x7f7d140b7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.731+0000 7f7d18f13640 1 -- 172.21.15.60:0/1946814712 >> v1:172.21.15.60:6789/0 conn(0x7f7d1415e7a0 legacy=0x7f7d140d2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.731+0000 7f7d0bfff640 1 -- 172.21.15.60:0/1946814712 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3987299060 0 0) 0x7f7d00003520 con 0x7f7d1415e7a0 2024-09-12T01:44:43.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.731+0000 7f7d18f13640 1 -- 172.21.15.60:0/1946814712 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d140d3500 con 0x7f7d140ba240 2024-09-12T01:44:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.731+0000 7f7d18f13640 1 --2- 172.21.15.60:0/1946814712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d140ba240 0x7f7d140d3fe0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d040097d0 tx=0x7f7d0402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2546b71b7624a9fc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.732+0000 7f7d0bfff640 1 -- 172.21.15.60:0/1946814712 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d04037070 con 0x7f7d140ba240 2024-09-12T01:44:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.732+0000 7f7d0bfff640 1 -- 172.21.15.60:0/1946814712 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0402acc0 con 0x7f7d140ba240 2024-09-12T01:44:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.732+0000 7f7d0bfff640 1 -- 172.21.15.60:0/1946814712 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10001670 con 0x7f7d140ba240 2024-09-12T01:44:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.732+0000 7f7d1b978640 1 -- 172.21.15.60:0/1946814712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d140ba240 msgr2=0x7f7d140d3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.732+0000 7f7d1b978640 1 --2- 172.21.15.60:0/1946814712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d140ba240 0x7f7d140d3fe0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7d040097d0 tx=0x7f7d0402a230 comp rx=0 tx=0).stop 2024-09-12T01:44:43.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.732+0000 7f7d1b978640 1 -- 172.21.15.60:0/1946814712 shutdown_connections 2024-09-12T01:44:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.732+0000 7f7d1b978640 1 --2- 172.21.15.60:0/1946814712 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d140ba240 0x7f7d140d3fe0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.732+0000 7f7d1b978640 1 -- 172.21.15.60:0/1946814712 >> 172.21.15.60:0/1946814712 conn(0x7f7d140d1550 msgr2=0x7f7d140d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.732+0000 7f7d1b978640 1 -- 172.21.15.60:0/1946814712 shutdown_connections 2024-09-12T01:44:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.732+0000 7f7d1b978640 1 -- 172.21.15.60:0/1946814712 wait complete. 2024-09-12T01:44:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.733+0000 7f7d1b978640 1 Processor -- start 2024-09-12T01:44:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.734+0000 7f7d1b978640 1 -- start start 2024-09-12T01:44:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.734+0000 7f7d1b978640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d140ba240 0x7f7d141e8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.734+0000 7f7d1b978640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d140cf2f0 0x7f7d141508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.734+0000 7f7d1b978640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d1415e7a0 0x7f7d14161050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.734+0000 7f7d1b978640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1415eb80 con 0x7f7d1415e7a0 2024-09-12T01:44:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.734+0000 7f7d1b978640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f7d140d3ac0 con 0x7f7d140ba240 2024-09-12T01:44:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.734+0000 7f7d1b978640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1415ed00 con 0x7f7d140cf2f0 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.734+0000 7f7d19f15640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d1415e7a0 0x7f7d14161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.734+0000 7f7d19f15640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d1415e7a0 0x7f7d14161050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55452/0 (socket says 172.21.15.60:55452) 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.734+0000 7f7d19f15640 1 -- 172.21.15.60:0/913869335 learned_addr learned my addr 172.21.15.60:0/913869335 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.734+0000 7f7d18f13640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d140cf2f0 0x7f7d141508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.734+0000 7f7d19714640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d140ba240 0x7f7d141e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d19f15640 1 -- 172.21.15.60:0/913869335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d140cf2f0 msgr2=0x7f7d141508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d19f15640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d140cf2f0 0x7f7d141508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d19f15640 1 -- 172.21.15.60:0/913869335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d140ba240 msgr2=0x7f7d141e8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d19f15640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d140ba240 0x7f7d141e8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d19f15640 1 -- 172.21.15.60:0/913869335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d140cd6b0 con 0x7f7d1415e7a0 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d18f13640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d140cf2f0 0x7f7d141508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d19714640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d140ba240 0x7f7d141e8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d19f15640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d1415e7a0 0x7f7d14161050 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00c790 tx=0x7f7d0c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d09ffb640 1 -- 172.21.15.60:0/913869335 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c003b70 con 0x7f7d1415e7a0 2024-09-12T01:44:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d09ffb640 1 -- 172.21.15.60:0/913869335 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d0c003d10 con 0x7f7d1415e7a0 2024-09-12T01:44:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d1b978640 1 -- 172.21.15.60:0/913869335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d140cd990 con 0x7f7d1415e7a0 2024-09-12T01:44:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d09ffb640 1 -- 172.21.15.60:0/913869335 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c00aa50 con 0x7f7d1415e7a0 2024-09-12T01:44:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.735+0000 7f7d1b978640 1 -- 172.21.15.60:0/913869335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d140cdf50 con 0x7f7d1415e7a0 2024-09-12T01:44:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.736+0000 7f7d1b978640 1 -- 172.21.15.60:0/913869335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d140d3fe0 con 0x7f7d1415e7a0 2024-09-12T01:44:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.737+0000 7f7d09ffb640 1 -- 172.21.15.60:0/913869335 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7d0c00abf0 con 0x7f7d1415e7a0 2024-09-12T01:44:43.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.737+0000 7f7d09ffb640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7cf806be30 0x7f7cf806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:43.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.737+0000 7f7d09ffb640 1 -- 172.21.15.60:0/913869335 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f7d0c08adc0 con 0x7f7d1415e7a0 2024-09-12T01:44:43.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.737+0000 7f7d19714640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7cf806be30 0x7f7cf806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:43.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.738+0000 7f7d19714640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7cf806be30 0x7f7cf806e2f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7d100011e0 tx=0x7f7d10009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:43.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.741+0000 7f7d09ffb640 1 -- 172.21.15.60:0/913869335 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f7d0c059800 con 0x7f7d1415e7a0 2024-09-12T01:44:43.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.953+0000 7f7d1b978640 1 -- 172.21.15.60:0/913869335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7d140b95a0 con 0x7f7d1415e7a0 2024-09-12T01:44:43.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.953+0000 7f7d09ffb640 1 -- 172.21.15.60:0/913869335 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) ==== 53+0+73 (secure 0 0 0) 0x7f7d0c059100 con 0x7f7d1415e7a0 2024-09-12T01:44:43.954 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:44:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.955+0000 7f7d1b978640 1 -- 172.21.15.60:0/913869335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7cf806be30 msgr2=0x7f7cf806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.955+0000 7f7d1b978640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7cf806be30 0x7f7cf806e2f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7d100011e0 tx=0x7f7d10009040 comp rx=0 tx=0).stop 2024-09-12T01:44:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.955+0000 7f7d1b978640 1 -- 172.21.15.60:0/913869335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d1415e7a0 msgr2=0x7f7d14161050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.955+0000 7f7d1b978640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d1415e7a0 0x7f7d14161050 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00c790 tx=0x7f7d0c00cc50 comp rx=0 tx=0).stop 2024-09-12T01:44:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.955+0000 7f7d1b978640 1 -- 172.21.15.60:0/913869335 shutdown_connections 2024-09-12T01:44:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.955+0000 7f7d1b978640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d1415e7a0 0x7f7d14161050 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.955+0000 7f7d1b978640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f7cf806be30 0x7f7cf806e2f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.955+0000 7f7d1b978640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7d140cf2f0 0x7f7d141508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.955+0000 7f7d1b978640 1 --2- 172.21.15.60:0/913869335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7d140ba240 0x7f7d141e8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:43.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.955+0000 7f7d1b978640 1 -- 172.21.15.60:0/913869335 >> 172.21.15.60:0/913869335 conn(0x7f7d140d1550 msgr2=0x7f7d140ca5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:43.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.955+0000 7f7d1b978640 1 -- 172.21.15.60:0/913869335 shutdown_connections 2024-09-12T01:44:43.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:43.955+0000 7f7d1b978640 1 -- 172.21.15.60:0/913869335 wait complete. 2024-09-12T01:44:43.967 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:44:43.967 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:44:43.967 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi060.front.sepia.ceph.com 2024-09-12T01:44:43.967 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-12T01:44:43.967 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-12T01:44:43.967 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:44:43.967 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:44:43.967 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:44:43.967 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:44:43.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:43.968 DEBUG:teuthology.orchestra.run.smithi060:> ip addr 2024-09-12T01:44:43.984 INFO:teuthology.orchestra.run.smithi060.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:44:43.984 INFO:teuthology.orchestra.run.smithi060.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:44:43.984 INFO:teuthology.orchestra.run.smithi060.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:44:43.984 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 ::1/128 scope host 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cc brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f0 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:6b:fe:cd brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp7s0f1 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:60 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f0 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout: inet 172.21.15.60/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft 42236sec preferred_lft 42236sec 2024-09-12T01:44:43.985 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::ec4:7aff:febd:1560/64 scope link 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 0c:c4:7a:bd:15:61 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout: altname enp1s0f1 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::e8cb:28ff:fea3:34fb/64 scope link 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 72:47:53:4d:4f:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:44:43.986 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::7047:53ff:fe4d:4fc7/64 scope link 2024-09-12T01:44:43.987 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:43.987 INFO:teuthology.orchestra.run.smithi060.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:44:43.987 INFO:teuthology.orchestra.run.smithi060.stdout: link/ether 1a:3c:47:c1:01:73 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:44:43.987 INFO:teuthology.orchestra.run.smithi060.stdout: inet6 fe80::183c:47ff:fec1:173/64 scope link 2024-09-12T01:44:43.987 INFO:teuthology.orchestra.run.smithi060.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:43.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:43.987 DEBUG:teuthology.orchestra.run.smithi060:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:44:44.049 INFO:teuthology.orchestra.run.smithi060.stdout:1 2024-09-12T01:44:44.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:44.050 DEBUG:teuthology.orchestra.run.smithi060:> route 2024-09-12T01:44:44.107 INFO:teuthology.orchestra.run.smithi060.stdout:Kernel IP routing table 2024-09-12T01:44:44.107 INFO:teuthology.orchestra.run.smithi060.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:44:44.107 INFO:teuthology.orchestra.run.smithi060.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-12T01:44:44.107 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-12T01:44:44.107 INFO:teuthology.orchestra.run.smithi060.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:44:44.108 DEBUG:teuthology.orchestra.run.smithi060:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:44:44.108 DEBUG:teuthology.orchestra.run.smithi060:> set -e 2024-09-12T01:44:44.108 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-12T01:44:44.108 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-12T01:44:44.108 DEBUG:teuthology.orchestra.run.smithi060:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-12T01:44:44.108 DEBUG:teuthology.orchestra.run.smithi060:> ') 2024-09-12T01:44:44.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:44:44.230 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:44:44.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:44.236 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:44:44.252 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:44:44.252 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:44:44.252 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:44:44.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:44.252 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link set brx.0 up 2024-09-12T01:44:44.318 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:44:44.319 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-12T01:44:44.374 INFO:teuthology.orchestra.run.smithi060.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-12T01:44:44.375 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:44:44.375 DEBUG:teuthology.orchestra.run.smithi060:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:44:44.430 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-12T01:44:44.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:44.430 DEBUG:teuthology.orchestra.run.smithi060:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:44:44.515 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:44:44.515 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:44:44.528 INFO:teuthology.orchestra.run.smithi060.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:44:44.528 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:44:44.528 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:44:44.528 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: trying mount with new device syntax: 0@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:44:44.528 INFO:teuthology.orchestra.run.smithi060.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:44:44.528 INFO:teuthology.orchestra.run.smithi060.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-12T01:44:44.529 INFO:teuthology.orchestra.run.smithi060.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:44:44.529 INFO:teuthology.orchestra.run.smithi060.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:44:44.529 INFO:teuthology.orchestra.run.smithi060.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:44:44.529 INFO:teuthology.orchestra.run.smithi060.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:44:44.530 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:44:44.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:44.531 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-12T01:44:44.556 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:44:44.648 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:44:44.655 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:44:44.660 INFO:teuthology.orchestra.run.smithi060.stdout:client7753 2024-09-12T01:44:44.661 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:44.661 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:44.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-12T01:44:44.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.821+0000 7fb48ea2e640 1 Processor -- start 2024-09-12T01:44:44.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.821+0000 7fb48ea2e640 1 -- start start 2024-09-12T01:44:44.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb48ea2e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb48815c2b0 0x7fb4880b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:44.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb48ea2e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb48815f200 0x7fb48806d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:44.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb48ea2e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb48815fb10 con 0x7fb4880b72f0 2024-09-12T01:44:44.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb48ea2e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb4880b5900 con 0x7fb48815c2b0 2024-09-12T01:44:44.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb48ea2e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb48815f830 con 0x7fb48815f200 2024-09-12T01:44:44.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb487fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb48815c2b0 0x7fb4880b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:44.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb487fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb48815c2b0 0x7fb4880b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55454/0 (socket says 172.21.15.60:55454) 2024-09-12T01:44:44.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb487fff640 1 -- 172.21.15.60:0/3867386552 learned_addr learned my addr 172.21.15.60:0/3867386552 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:44.826 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb487fff640 1 -- 172.21.15.60:0/3867386552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb48815f200 msgr2=0x7fb48806d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:44.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb48cfcb640 1 --2- 172.21.15.60:0/3867386552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb48815f200 0x7fb48806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:44.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb487fff640 1 --2- 172.21.15.60:0/3867386552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb48815f200 0x7fb48806d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:44.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb487fff640 1 -- 172.21.15.60:0/3867386552 >> v1:172.21.15.105:6789/0 conn(0x7fb4880b72f0 legacy=0x7fb48815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:44.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb487fff640 1 -- 172.21.15.60:0/3867386552 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48806ce30 con 0x7fb48815c2b0 2024-09-12T01:44:44.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.822+0000 7fb48cfcb640 1 --2- 172.21.15.60:0/3867386552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb48815f200 0x7fb48806d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:44.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.823+0000 7fb487fff640 1 --2- 172.21.15.60:0/3867386552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb48815c2b0 0x7fb4880b6db0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fb478009870 tx=0x7fb47802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482793b61c082538 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:44.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.823+0000 7fb486ffd640 1 -- 172.21.15.60:0/3867386552 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb478037070 con 0x7fb48815c2b0 2024-09-12T01:44:44.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.823+0000 7fb486ffd640 1 -- 172.21.15.60:0/3867386552 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb478032440 con 0x7fb48815c2b0 2024-09-12T01:44:44.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.823+0000 7fb486ffd640 1 -- 172.21.15.60:0/3867386552 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb478032810 con 0x7fb48815c2b0 2024-09-12T01:44:44.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.824+0000 7fb48ea2e640 1 -- 172.21.15.60:0/3867386552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb48815c2b0 msgr2=0x7fb4880b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:44.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.824+0000 7fb48ea2e640 1 --2- 172.21.15.60:0/3867386552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb48815c2b0 0x7fb4880b6db0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fb478009870 tx=0x7fb47802a210 comp rx=0 tx=0).stop 2024-09-12T01:44:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.824+0000 7fb48ea2e640 1 -- 172.21.15.60:0/3867386552 shutdown_connections 2024-09-12T01:44:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.824+0000 7fb48ea2e640 1 --2- 172.21.15.60:0/3867386552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb48815f200 0x7fb48806d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.824+0000 7fb48ea2e640 1 --2- 172.21.15.60:0/3867386552 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb48815c2b0 0x7fb4880b6db0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.824+0000 7fb48ea2e640 1 -- 172.21.15.60:0/3867386552 >> 172.21.15.60:0/3867386552 conn(0x7fb4880b4240 msgr2=0x7fb4880b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.824+0000 7fb48ea2e640 1 -- 172.21.15.60:0/3867386552 shutdown_connections 2024-09-12T01:44:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.824+0000 7fb48ea2e640 1 -- 172.21.15.60:0/3867386552 wait complete. 2024-09-12T01:44:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.825+0000 7fb48ea2e640 1 Processor -- start 2024-09-12T01:44:44.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.825+0000 7fb48ea2e640 1 -- start start 2024-09-12T01:44:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb48ea2e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4880b72f0 0x7fb4881590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb48ea2e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb48815c2b0 0x7fb4881f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb48ea2e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb48815f200 0x7fb48806e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb48ea2e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb4880b7760 con 0x7fb48815c2b0 2024-09-12T01:44:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb48ea2e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb48806d3f0 con 0x7fb4880b72f0 2024-09-12T01:44:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb48ea2e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb48806de50 con 0x7fb48815f200 2024-09-12T01:44:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb4877fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb48815c2b0 0x7fb4881f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb4877fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb48815c2b0 0x7fb4881f36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55468/0 (socket says 172.21.15.60:55468) 2024-09-12T01:44:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb4877fe640 1 -- 172.21.15.60:0/832066954 learned_addr learned my addr 172.21.15.60:0/832066954 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb487fff640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4880b72f0 0x7fb4881590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb48cfcb640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb48815f200 0x7fb48806e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:44.831 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb4877fe640 1 -- 172.21.15.60:0/832066954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb48815f200 msgr2=0x7fb48806e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb4877fe640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb48815f200 0x7fb48806e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb4877fe640 1 -- 172.21.15.60:0/832066954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4880b72f0 msgr2=0x7fb4881590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb4877fe640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4880b72f0 0x7fb4881590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb4877fe640 1 -- 172.21.15.60:0/832066954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb488159920 con 0x7fb48815c2b0 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.826+0000 7fb48cfcb640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb48815f200 0x7fb48806e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.827+0000 7fb4877fe640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb48815c2b0 0x7fb4881f36c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fb47000c460 tx=0x7fb47000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.827+0000 7fb484ff9640 1 -- 172.21.15.60:0/832066954 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb470016020 con 0x7fb48815c2b0 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.827+0000 7fb484ff9640 1 -- 172.21.15.60:0/832066954 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb470012870 con 0x7fb48815c2b0 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.827+0000 7fb48ea2e640 1 -- 172.21.15.60:0/832066954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb488159c00 con 0x7fb48815c2b0 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.827+0000 7fb484ff9640 1 -- 172.21.15.60:0/832066954 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb470012c60 con 0x7fb48815c2b0 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.827+0000 7fb48ea2e640 1 -- 172.21.15.60:0/832066954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb488153c00 con 0x7fb48815c2b0 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.828+0000 7fb48ea2e640 1 -- 172.21.15.60:0/832066954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4880b6db0 con 0x7fb48815c2b0 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.828+0000 7fb484ff9640 1 -- 172.21.15.60:0/832066954 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb470019020 con 0x7fb48815c2b0 2024-09-12T01:44:44.832 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.829+0000 7fb484ff9640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb46806be30 0x7fb46806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:44.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.829+0000 7fb484ff9640 1 -- 172.21.15.60:0/832066954 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fb47008abb0 con 0x7fb48815c2b0 2024-09-12T01:44:44.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.829+0000 7fb487fff640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb46806be30 0x7fb46806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:44.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.829+0000 7fb487fff640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb46806be30 0x7fb46806e2f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb478034000 tx=0x7fb47802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:44.834 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:44.833+0000 7fb484ff9640 1 -- 172.21.15.60:0/832066954 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb470020030 con 0x7fb48815c2b0 2024-09-12T01:44:45.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.043+0000 7fb48ea2e640 1 -- 172.21.15.60:0/832066954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb4881539b0 con 0x7fb48815c2b0 2024-09-12T01:44:45.044 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.044+0000 7fb484ff9640 1 -- 172.21.15.60:0/832066954 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v88) ==== 53+0+73 (secure 0 0 0) 0x7fb4700594d0 con 0x7fb48815c2b0 2024-09-12T01:44:45.044 INFO:teuthology.orchestra.run.smithi060.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-12T01:44:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.045+0000 7fb48ea2e640 1 -- 172.21.15.60:0/832066954 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb46806be30 msgr2=0x7fb46806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:45.046 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.045+0000 7fb48ea2e640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb46806be30 0x7fb46806e2f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb478034000 tx=0x7fb47802e000 comp rx=0 tx=0).stop 2024-09-12T01:44:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.046+0000 7fb48ea2e640 1 -- 172.21.15.60:0/832066954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb48815c2b0 msgr2=0x7fb4881f36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.046+0000 7fb48ea2e640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb48815c2b0 0x7fb4881f36c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fb47000c460 tx=0x7fb47000c920 comp rx=0 tx=0).stop 2024-09-12T01:44:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.046+0000 7fb48ea2e640 1 -- 172.21.15.60:0/832066954 shutdown_connections 2024-09-12T01:44:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.046+0000 7fb48ea2e640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb46806be30 0x7fb46806e2f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.046+0000 7fb48ea2e640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb48815f200 0x7fb48806e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.046+0000 7fb48ea2e640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb48815c2b0 0x7fb4881f36c0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.046+0000 7fb48ea2e640 1 --2- 172.21.15.60:0/832066954 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4880b72f0 0x7fb4881590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.046+0000 7fb48ea2e640 1 -- 172.21.15.60:0/832066954 >> 172.21.15.60:0/832066954 conn(0x7fb4880b4240 msgr2=0x7fb4880b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.046+0000 7fb48ea2e640 1 -- 172.21.15.60:0/832066954 shutdown_connections 2024-09-12T01:44:45.047 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:45.046+0000 7fb48ea2e640 1 -- 172.21.15.60:0/832066954 wait complete. 2024-09-12T01:44:45.058 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-12T01:44:45.058 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-12T01:44:45.058 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi105.front.sepia.ceph.com 2024-09-12T01:44:45.058 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-12T01:44:45.058 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-12T01:44:45.058 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-12T01:44:45.058 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-12T01:44:45.058 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-12T01:44:45.059 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:44:45.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:45.059 DEBUG:teuthology.orchestra.run.smithi105:> ip addr 2024-09-12T01:44:45.079 INFO:teuthology.orchestra.run.smithi105.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-12T01:44:45.079 INFO:teuthology.orchestra.run.smithi105.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-12T01:44:45.079 INFO:teuthology.orchestra.run.smithi105.stdout: inet 127.0.0.1/8 scope host lo 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 ::1/128 scope host 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b8 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f0 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:d8:a4:b9 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout: altname enp7s0f1 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:28 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-12T01:44:45.080 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 0c:c4:7a:8f:d4:29 brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout: inet 172.21.15.105/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft 42238sec preferred_lft 42238sec 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::ec4:7aff:fe8f:d429/64 scope link noprefixroute 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::c46c:baff:feeb:1f5e/64 scope link 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 56:66:28:3d:b2:45 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:44:45.081 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::5466:28ff:fe3d:b245/64 scope link 2024-09-12T01:44:45.082 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:45.082 INFO:teuthology.orchestra.run.smithi105.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-12T01:44:45.082 INFO:teuthology.orchestra.run.smithi105.stdout: link/ether 22:36:4a:87:b9:cb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:44:45.082 INFO:teuthology.orchestra.run.smithi105.stdout: inet6 fe80::2036:4aff:fe87:b9cb/64 scope link 2024-09-12T01:44:45.082 INFO:teuthology.orchestra.run.smithi105.stdout: valid_lft forever preferred_lft forever 2024-09-12T01:44:45.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:45.082 DEBUG:teuthology.orchestra.run.smithi105:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-12T01:44:45.147 INFO:teuthology.orchestra.run.smithi105.stdout:1 2024-09-12T01:44:45.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:45.149 DEBUG:teuthology.orchestra.run.smithi105:> route 2024-09-12T01:44:45.208 INFO:teuthology.orchestra.run.smithi105.stdout:Kernel IP routing table 2024-09-12T01:44:45.208 INFO:teuthology.orchestra.run.smithi105.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-12T01:44:45.208 INFO:teuthology.orchestra.run.smithi105.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-12T01:44:45.208 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-12T01:44:45.208 INFO:teuthology.orchestra.run.smithi105.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-12T01:44:45.209 DEBUG:teuthology.orchestra.run.smithi105:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-12T01:44:45.209 DEBUG:teuthology.orchestra.run.smithi105:> set -e 2024-09-12T01:44:45.209 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-12T01:44:45.209 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-12T01:44:45.209 DEBUG:teuthology.orchestra.run.smithi105:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-12T01:44:45.209 DEBUG:teuthology.orchestra.run.smithi105:> ') 2024-09-12T01:44:45.301 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:44:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-12T01:44:45.334 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:44:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:44:45.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:45.341 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:44:45.356 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T01:44:45.356 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:44:45.357 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:44:45.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:45.357 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link set brx.0 up 2024-09-12T01:44:45.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:44:45.422 DEBUG:teuthology.orchestra.run.smithi105:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-12T01:44:45.477 INFO:teuthology.orchestra.run.smithi105.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-12T01:44:45.477 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-12T01:44:45.477 DEBUG:teuthology.orchestra.run.smithi105:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:44:45.531 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-12T01:44:45.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:45.532 DEBUG:teuthology.orchestra.run.smithi105:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:44:45.615 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:44:45.615 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:44:45.626 INFO:teuthology.orchestra.run.smithi105.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-12T01:44:45.626 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-12T01:44:45.626 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: resolved to: "172.21.15.60:3300,172.21.15.105:3300,172.21.15.105:3301" 2024-09-12T01:44:45.626 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: trying mount with new device syntax: 1@5401bd8a-3492-4b21-b6c0-d6616ff39793.cephfs=/ 2024-09-12T01:44:45.627 INFO:teuthology.orchestra.run.smithi105.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.60:3300/172.21.15.105:3300/172.21.15.105:3301" will pass to kernel 2024-09-12T01:44:45.627 INFO:teuthology.orchestra.run.smithi105.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-12T01:44:45.627 INFO:teuthology.orchestra.run.smithi105.stdout: You just mounted a file system that supports labels which does not 2024-09-12T01:44:45.627 INFO:teuthology.orchestra.run.smithi105.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-12T01:44:45.627 INFO:teuthology.orchestra.run.smithi105.stdout: applications will generate AVC messages and not be allowed access to 2024-09-12T01:44:45.627 INFO:teuthology.orchestra.run.smithi105.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-12T01:44:45.628 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-12T01:44:45.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:45.629 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-12T01:44:45.693 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-12T01:44:45.782 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:44:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-12T01:44:45.783 INFO:teuthology.orchestra.run.smithi105.stderr:2024-09-12T01:44:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-12T01:44:45.789 INFO:teuthology.orchestra.run.smithi105.stdout:client8592 2024-09-12T01:44:45.789 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:44:45.789 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:45.805 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-12T01:44:45.805 DEBUG:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:44:45.853 DEBUG:teuthology.orchestra.run.smithi105:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-12T01:44:45.893 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-12T01:44:45.893 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:44:45.893 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:45.893 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:45.912 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:45.913 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:45.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:44:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.126+0000 7f4d606f1640 1 Processor -- start 2024-09-12T01:44:46.127 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.126+0000 7f4d606f1640 1 -- start start 2024-09-12T01:44:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.127+0000 7f4d606f1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d5815a060 0x7f4d5806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.127+0000 7f4d606f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d58071770 con 0x7f4d5815d3d0 2024-09-12T01:44:46.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.127+0000 7f4d606f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d58160d60 con 0x7f4d580b1990 2024-09-12T01:44:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.127+0000 7f4d606f1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4d580712e0 con 0x7f4d5815a060 2024-09-12T01:44:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.127+0000 7f4d5e48d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d5815a060 0x7f4d5806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.128+0000 7f4d5e48d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d5815a060 0x7f4d5806f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55474/0 (socket says 172.21.15.60:55474) 2024-09-12T01:44:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.128+0000 7f4d5e48d640 1 -- 172.21.15.60:0/2717373633 learned_addr learned my addr 172.21.15.60:0/2717373633 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.128+0000 7f4d5dc8c640 1 --1- 172.21.15.60:0/2717373633 >> v1:172.21.15.60:6789/0 conn(0x7f4d5815d3d0 0x7f4d5815ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45824/0 (socket says 172.21.15.60:45824) 2024-09-12T01:44:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.128+0000 7f4d5e48d640 1 -- 172.21.15.60:0/2717373633 >> v1:172.21.15.105:6789/0 conn(0x7f4d580b1990 legacy=0x7f4d58160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.128+0000 7f4d5e48d640 1 -- 172.21.15.60:0/2717373633 >> v1:172.21.15.60:6789/0 conn(0x7f4d5815d3d0 legacy=0x7f4d5815ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.129 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.128+0000 7f4d5e48d640 1 -- 172.21.15.60:0/2717373633 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d580709b0 con 0x7f4d5815a060 2024-09-12T01:44:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.129+0000 7f4d5e48d640 1 --2- 172.21.15.60:0/2717373633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5815a060 0x7f4d5806f2f0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009e50 tx=0x7f4d4802a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c924237e229f1b3b server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.129+0000 7f4d5d48b640 1 -- 172.21.15.60:0/2717373633 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48036070 con 0x7f4d5815a060 2024-09-12T01:44:46.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.129+0000 7f4d5d48b640 1 -- 172.21.15.60:0/2717373633 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d48031600 con 0x7f4d5815a060 2024-09-12T01:44:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.129+0000 7f4d5d48b640 1 -- 172.21.15.60:0/2717373633 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d480319f0 con 0x7f4d5815a060 2024-09-12T01:44:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.129+0000 7f4d606f1640 1 -- 172.21.15.60:0/2717373633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5815a060 msgr2=0x7f4d5806f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.129+0000 7f4d606f1640 1 --2- 172.21.15.60:0/2717373633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5815a060 0x7f4d5806f2f0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009e50 tx=0x7f4d4802a7c0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.129+0000 7f4d606f1640 1 -- 172.21.15.60:0/2717373633 shutdown_connections 2024-09-12T01:44:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.129+0000 7f4d606f1640 1 --2- 172.21.15.60:0/2717373633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5815a060 0x7f4d5806f2f0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.129+0000 7f4d606f1640 1 -- 172.21.15.60:0/2717373633 >> 172.21.15.60:0/2717373633 conn(0x7f4d580d2430 msgr2=0x7f4d580d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.129+0000 7f4d606f1640 1 -- 172.21.15.60:0/2717373633 shutdown_connections 2024-09-12T01:44:46.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.129+0000 7f4d606f1640 1 -- 172.21.15.60:0/2717373633 wait complete. 2024-09-12T01:44:46.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.131+0000 7f4d606f1640 1 Processor -- start 2024-09-12T01:44:46.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.131+0000 7f4d606f1640 1 -- start start 2024-09-12T01:44:46.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.131+0000 7f4d606f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d580b1990 0x7f4d5814ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.131+0000 7f4d606f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d5815a060 0x7f4d581573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.131+0000 7f4d606f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d5815d3d0 0x7f4d5815fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.131+0000 7f4d606f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4d580d12e0 con 0x7f4d580b1990 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.131+0000 7f4d606f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4d58070f70 con 0x7f4d5815a060 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.131+0000 7f4d606f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4d580d1460 con 0x7f4d5815d3d0 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.131+0000 7f4d5e48d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d580b1990 0x7f4d5814ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d5e48d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d580b1990 0x7f4d5814ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55484/0 (socket says 172.21.15.60:55484) 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d5e48d640 1 -- 172.21.15.60:0/3097552751 learned_addr learned my addr 172.21.15.60:0/3097552751 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d5dc8c640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d5815a060 0x7f4d581573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d5ec8e640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d5815d3d0 0x7f4d5815fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d5e48d640 1 -- 172.21.15.60:0/3097552751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d5815d3d0 msgr2=0x7f4d5815fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d5e48d640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d5815d3d0 0x7f4d5815fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d5e48d640 1 -- 172.21.15.60:0/3097552751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d5815a060 msgr2=0x7f4d581573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d5e48d640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d5815a060 0x7f4d581573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d5e48d640 1 -- 172.21.15.60:0/3097552751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d58157910 con 0x7f4d580b1990 2024-09-12T01:44:46.134 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d5e48d640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d580b1990 0x7f4d5814ad90 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f4d48000f80 tx=0x7f4d48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d56ffd640 1 -- 172.21.15.60:0/3097552751 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48036050 con 0x7f4d580b1990 2024-09-12T01:44:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d56ffd640 1 -- 172.21.15.60:0/3097552751 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d48042070 con 0x7f4d580b1990 2024-09-12T01:44:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d56ffd640 1 -- 172.21.15.60:0/3097552751 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d48009510 con 0x7f4d580b1990 2024-09-12T01:44:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d606f1640 1 -- 172.21.15.60:0/3097552751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d58157fb0 con 0x7f4d580b1990 2024-09-12T01:44:46.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.132+0000 7f4d606f1640 1 -- 172.21.15.60:0/3097552751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d58158570 con 0x7f4d580b1990 2024-09-12T01:44:46.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.133+0000 7f4d606f1640 1 -- 172.21.15.60:0/3097552751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d5806c6c0 con 0x7f4d580b1990 2024-09-12T01:44:46.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.134+0000 7f4d56ffd640 1 -- 172.21.15.60:0/3097552751 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4d48004470 con 0x7f4d580b1990 2024-09-12T01:44:46.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.134+0000 7f4d56ffd640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4d4406be30 0x7f4d4406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.134+0000 7f4d56ffd640 1 -- 172.21.15.60:0/3097552751 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f4d480abc40 con 0x7f4d580b1990 2024-09-12T01:44:46.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.134+0000 7f4d5dc8c640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4d4406be30 0x7f4d4406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.135+0000 7f4d5dc8c640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4d4406be30 0x7f4d4406e2f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4d58156e90 tx=0x7f4d4c000ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:46.139 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.139+0000 7f4d56ffd640 1 -- 172.21.15.60:0/3097552751 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4d4807a030 con 0x7f4d580b1990 2024-09-12T01:44:46.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.325+0000 7f4d606f1640 1 -- 172.21.15.60:0/3097552751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4d580b2d70 con 0x7f4d580b1990 2024-09-12T01:44:46.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.325+0000 7f4d56ffd640 1 -- 172.21.15.60:0/3097552751 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v139) ==== 80+0+0 (secure 0 0 0) 0x7f4d4807e330 con 0x7f4d580b1990 2024-09-12T01:44:46.326 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:44:46.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.327+0000 7f4d606f1640 1 -- 172.21.15.60:0/3097552751 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4d4406be30 msgr2=0x7f4d4406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.327+0000 7f4d606f1640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4d4406be30 0x7f4d4406e2f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4d58156e90 tx=0x7f4d4c000ed0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.327+0000 7f4d606f1640 1 -- 172.21.15.60:0/3097552751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d580b1990 msgr2=0x7f4d5814ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.327+0000 7f4d606f1640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d580b1990 0x7f4d5814ad90 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f4d48000f80 tx=0x7f4d48004a40 comp rx=0 tx=0).stop 2024-09-12T01:44:46.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.327+0000 7f4d606f1640 1 -- 172.21.15.60:0/3097552751 shutdown_connections 2024-09-12T01:44:46.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.327+0000 7f4d606f1640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4d4406be30 0x7f4d4406e2f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.327+0000 7f4d606f1640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4d5815d3d0 0x7f4d5815fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.327+0000 7f4d606f1640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4d5815a060 0x7f4d581573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.327+0000 7f4d606f1640 1 --2- 172.21.15.60:0/3097552751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d580b1990 0x7f4d5814ad90 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.327+0000 7f4d606f1640 1 -- 172.21.15.60:0/3097552751 >> 172.21.15.60:0/3097552751 conn(0x7f4d580d2430 msgr2=0x7f4d5815cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:46.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.327+0000 7f4d606f1640 1 -- 172.21.15.60:0/3097552751 shutdown_connections 2024-09-12T01:44:46.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.327+0000 7f4d606f1640 1 -- 172.21.15.60:0/3097552751 wait complete. 2024-09-12T01:44:46.339 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-12T01:44:46.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:46.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-12T01:44:46.370 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:44:46.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:46.370 DEBUG:teuthology.orchestra.run.smithi060:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-12T01:44:46.428 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:44:46.428 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:44:46.429 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:46.448 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:44:46.448 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:46.508 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-12T01:44:46.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.614+0000 7f638a111640 1 Processor -- start 2024-09-12T01:44:46.614 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.614+0000 7f638a111640 1 -- start start 2024-09-12T01:44:46.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f638a111640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f638415a050 0x7f638415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f638a111640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f63840731c0 0x7f6384073600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f638a111640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638415a430 con 0x7f638415ffd0 2024-09-12T01:44:46.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f638a111640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6384073b40 con 0x7f63840731c0 2024-09-12T01:44:46.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f638a111640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f638415d9a0 con 0x7f638415a050 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f6382ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f63840731c0 0x7f6384073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f6383fff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f638415ffd0 0x7f6384160480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45840/0 (socket says 172.21.15.60:45840) 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f6382ffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f63840731c0 0x7f6384073600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55496/0 (socket says 172.21.15.60:55496) 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f6383fff640 1 -- 172.21.15.60:0/125388150 learned_addr learned my addr 172.21.15.60:0/125388150 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f63837fe640 1 --2- 172.21.15.60:0/125388150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f638415a050 0x7f638415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f6382ffd640 1 -- 172.21.15.60:0/125388150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f638415a050 msgr2=0x7f638415d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f6382ffd640 1 --2- 172.21.15.60:0/125388150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f638415a050 0x7f638415d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f6382ffd640 1 -- 172.21.15.60:0/125388150 >> v1:172.21.15.60:6789/0 conn(0x7f638415ffd0 legacy=0x7f6384160480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f6382ffd640 1 -- 172.21.15.60:0/125388150 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63840cd0a0 con 0x7f63840731c0 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f63827fc640 1 -- 172.21.15.60:0/125388150 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341217301 0 0) 0x7f638415a430 con 0x7f638415ffd0 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.615+0000 7f63837fe640 1 --2- 172.21.15.60:0/125388150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f638415a050 0x7f638415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.616+0000 7f6382ffd640 1 --2- 172.21.15.60:0/125388150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63840731c0 0x7f6384073600 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f63780097a0 tx=0x7f637802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338782b2bd0e18e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.616+0000 7f63827fc640 1 -- 172.21.15.60:0/125388150 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378037070 con 0x7f63840731c0 2024-09-12T01:44:46.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.616+0000 7f63827fc640 1 -- 172.21.15.60:0/125388150 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f637802ae50 con 0x7f63840731c0 2024-09-12T01:44:46.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.616+0000 7f63827fc640 1 -- 172.21.15.60:0/125388150 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378032660 con 0x7f63840731c0 2024-09-12T01:44:46.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.616+0000 7f638a111640 1 -- 172.21.15.60:0/125388150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63840731c0 msgr2=0x7f6384073600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.616+0000 7f638a111640 1 --2- 172.21.15.60:0/125388150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63840731c0 0x7f6384073600 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f63780097a0 tx=0x7f637802a100 comp rx=0 tx=0).stop 2024-09-12T01:44:46.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.617+0000 7f638a111640 1 -- 172.21.15.60:0/125388150 shutdown_connections 2024-09-12T01:44:46.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.617+0000 7f638a111640 1 --2- 172.21.15.60:0/125388150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63840731c0 0x7f6384073600 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.617+0000 7f638a111640 1 --2- 172.21.15.60:0/125388150 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f638415a050 0x7f638415d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.617+0000 7f638a111640 1 -- 172.21.15.60:0/125388150 >> 172.21.15.60:0/125388150 conn(0x7f638406d0f0 msgr2=0x7f638406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:46.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.617+0000 7f638a111640 1 -- 172.21.15.60:0/125388150 shutdown_connections 2024-09-12T01:44:46.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.617+0000 7f638a111640 1 -- 172.21.15.60:0/125388150 wait complete. 2024-09-12T01:44:46.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.618+0000 7f638a111640 1 Processor -- start 2024-09-12T01:44:46.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.618+0000 7f638a111640 1 -- start start 2024-09-12T01:44:46.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f638a111640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63840731c0 0x7f63840cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f638a111640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f638415a050 0x7f63841f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f638a111640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f638415ffd0 0x7f63841f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f638a111640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f63840cd940 con 0x7f63840731c0 2024-09-12T01:44:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f638a111640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f63840cd660 con 0x7f638415ffd0 2024-09-12T01:44:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f638a111640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f63840cdc20 con 0x7f638415a050 2024-09-12T01:44:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f63837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63840731c0 0x7f63840cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f63837fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63840731c0 0x7f63840cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55502/0 (socket says 172.21.15.60:55502) 2024-09-12T01:44:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f63837fe640 1 -- 172.21.15.60:0/2080865510 learned_addr learned my addr 172.21.15.60:0/2080865510 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f63837fe640 1 -- 172.21.15.60:0/2080865510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f638415a050 msgr2=0x7f63841f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f63837fe640 1 --2- 172.21.15.60:0/2080865510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f638415a050 0x7f63841f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f63837fe640 1 -- 172.21.15.60:0/2080865510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f638415ffd0 msgr2=0x7f63841f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f63837fe640 1 --2- 172.21.15.60:0/2080865510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f638415ffd0 0x7f63841f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f63837fe640 1 -- 172.21.15.60:0/2080865510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63840cba50 con 0x7f63840731c0 2024-09-12T01:44:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f63837fe640 1 --2- 172.21.15.60:0/2080865510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63840731c0 0x7f63840cb150 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f637400c7f0 tx=0x7f637400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f636bfff640 1 -- 172.21.15.60:0/2080865510 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374015070 con 0x7f63840731c0 2024-09-12T01:44:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f636bfff640 1 -- 172.21.15.60:0/2080865510 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6374007a30 con 0x7f63840731c0 2024-09-12T01:44:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f636bfff640 1 -- 172.21.15.60:0/2080865510 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6374007e00 con 0x7f63840731c0 2024-09-12T01:44:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.619+0000 7f638a111640 1 -- 172.21.15.60:0/2080865510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63840cbd30 con 0x7f63840731c0 2024-09-12T01:44:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.620+0000 7f638a111640 1 -- 172.21.15.60:0/2080865510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63840cc2f0 con 0x7f63840731c0 2024-09-12T01:44:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.621+0000 7f638a111640 1 -- 172.21.15.60:0/2080865510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63840d12a0 con 0x7f63840731c0 2024-09-12T01:44:46.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.621+0000 7f636bfff640 1 -- 172.21.15.60:0/2080865510 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6374018070 con 0x7f63840731c0 2024-09-12T01:44:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.621+0000 7f636bfff640 1 --2- 172.21.15.60:0/2080865510 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f637006be30 0x7f637006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.621+0000 7f636bfff640 1 -- 172.21.15.60:0/2080865510 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f637408ad90 con 0x7f63840731c0 2024-09-12T01:44:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.621+0000 7f6382ffd640 1 --2- 172.21.15.60:0/2080865510 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f637006be30 0x7f637006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:46.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.622+0000 7f6382ffd640 1 --2- 172.21.15.60:0/2080865510 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f637006be30 0x7f637006e2f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6378034000 tx=0x7f637802c000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:46.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.626+0000 7f636bfff640 1 -- 172.21.15.60:0/2080865510 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f63840d12a0 con 0x7f63840731c0 2024-09-12T01:44:46.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.811+0000 7f638a111640 1 -- 172.21.15.60:0/2080865510 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f63840b36e0 con 0x7f63840731c0 2024-09-12T01:44:46.812 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.811+0000 7f636bfff640 1 -- 172.21.15.60:0/2080865510 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v139) ==== 80+0+0 (secure 0 0 0) 0x7f63740597d0 con 0x7f63840731c0 2024-09-12T01:44:46.812 INFO:teuthology.orchestra.run.smithi060.stderr:listed 0 entries 2024-09-12T01:44:46.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.813+0000 7f638a111640 1 -- 172.21.15.60:0/2080865510 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f637006be30 msgr2=0x7f637006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.813+0000 7f638a111640 1 --2- 172.21.15.60:0/2080865510 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f637006be30 0x7f637006e2f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6378034000 tx=0x7f637802c000 comp rx=0 tx=0).stop 2024-09-12T01:44:46.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.813+0000 7f638a111640 1 -- 172.21.15.60:0/2080865510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63840731c0 msgr2=0x7f63840cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:46.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.813+0000 7f638a111640 1 --2- 172.21.15.60:0/2080865510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63840731c0 0x7f63840cb150 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f637400c7f0 tx=0x7f637400cbf0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.813+0000 7f638a111640 1 -- 172.21.15.60:0/2080865510 shutdown_connections 2024-09-12T01:44:46.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.813+0000 7f638a111640 1 --2- 172.21.15.60:0/2080865510 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f638415ffd0 0x7f63841f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.813+0000 7f638a111640 1 --2- 172.21.15.60:0/2080865510 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f637006be30 0x7f637006e2f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.813+0000 7f638a111640 1 --2- 172.21.15.60:0/2080865510 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f638415a050 0x7f63841f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.813+0000 7f638a111640 1 --2- 172.21.15.60:0/2080865510 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63840731c0 0x7f63840cb150 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:46.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.813+0000 7f638a111640 1 -- 172.21.15.60:0/2080865510 >> 172.21.15.60:0/2080865510 conn(0x7f638406d0f0 msgr2=0x7f63840b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:46.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.814+0000 7f638a111640 1 -- 172.21.15.60:0/2080865510 shutdown_connections 2024-09-12T01:44:46.815 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:46.814+0000 7f638a111640 1 -- 172.21.15.60:0/2080865510 wait complete. 2024-09-12T01:44:46.825 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-12T01:44:46.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:46.825 DEBUG:teuthology.orchestra.run.smithi105:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-12T01:44:46.858 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:44:46.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:46.858 DEBUG:teuthology.orchestra.run.smithi105:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-12T01:44:46.916 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:44:46.916 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:46.916 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:46.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:44:46.933 INFO:tasks.cephfs.mount:Terminating background process 2024-09-12T01:44:46.933 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:44:46.934 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:46.974 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:44:46.974 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:47.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.076+0000 7fa190e1e640 1 Processor -- start 2024-09-12T01:44:47.076 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.076+0000 7fa190e1e640 1 -- start start 2024-09-12T01:44:47.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa190e1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa18c0b4d00 0x7fa18c0b5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa190e1e640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa18c0cd780 0x7fa18c0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa190e1e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa18c0ce4f0 con 0x7fa18c0b4920 2024-09-12T01:44:47.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa190e1e640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa18c0cf100 con 0x7fa18c0cd780 2024-09-12T01:44:47.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa190e1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa18c0ce7d0 con 0x7fa18c0b4d00 2024-09-12T01:44:47.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa18a59c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa18c0b4920 0x7fa18c15b7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45854/0 (socket says 172.21.15.60:45854) 2024-09-12T01:44:47.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa18a59c640 1 -- 172.21.15.60:0/1565879503 learned_addr learned my addr 172.21.15.60:0/1565879503 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:47.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa189d9b640 1 --2- 172.21.15.60:0/1565879503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa18c0b4d00 0x7fa18c0b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa18ad9d640 1 --2- 172.21.15.60:0/1565879503 >> v2:172.21.15.105:3300/0 conn(0x7fa18c0cd780 0x7fa18c0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa18959a640 1 -- 172.21.15.60:0/1565879503 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3296816471 0 0) 0x7fa18c0ce4f0 con 0x7fa18c0b4920 2024-09-12T01:44:47.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa18959a640 1 -- 172.21.15.60:0/1565879503 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa174003520 con 0x7fa18c0b4920 2024-09-12T01:44:47.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa189d9b640 1 -- 172.21.15.60:0/1565879503 >> v2:172.21.15.105:3300/0 conn(0x7fa18c0cd780 msgr2=0x7fa18c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:47.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa189d9b640 1 --2- 172.21.15.60:0/1565879503 >> v2:172.21.15.105:3300/0 conn(0x7fa18c0cd780 0x7fa18c0cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa189d9b640 1 -- 172.21.15.60:0/1565879503 >> v1:172.21.15.60:6789/0 conn(0x7fa18c0b4920 legacy=0x7fa18c15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa189d9b640 1 -- 172.21.15.60:0/1565879503 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c0ceab0 con 0x7fa18c0b4d00 2024-09-12T01:44:47.079 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.077+0000 7fa18ad9d640 1 --2- 172.21.15.60:0/1565879503 >> v2:172.21.15.105:3300/0 conn(0x7fa18c0cd780 0x7fa18c0cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:47.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.078+0000 7fa189d9b640 1 --2- 172.21.15.60:0/1565879503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa18c0b4d00 0x7fa18c0b5140 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa1800097a0 tx=0x7fa18002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d32c1dd81e099189 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:47.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.078+0000 7fa18959a640 1 -- 172.21.15.60:0/1565879503 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa180037070 con 0x7fa18c0b4d00 2024-09-12T01:44:47.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.078+0000 7fa18959a640 1 -- 172.21.15.60:0/1565879503 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa180032440 con 0x7fa18c0b4d00 2024-09-12T01:44:47.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.078+0000 7fa18959a640 1 -- 172.21.15.60:0/1565879503 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1800327f0 con 0x7fa18c0b4d00 2024-09-12T01:44:47.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.079+0000 7fa190e1e640 1 -- 172.21.15.60:0/1565879503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa18c0b4d00 msgr2=0x7fa18c0b5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.080 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.079+0000 7fa190e1e640 1 --2- 172.21.15.60:0/1565879503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa18c0b4d00 0x7fa18c0b5140 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa1800097a0 tx=0x7fa18002a180 comp rx=0 tx=0).stop 2024-09-12T01:44:47.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.079+0000 7fa190e1e640 1 -- 172.21.15.60:0/1565879503 shutdown_connections 2024-09-12T01:44:47.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.079+0000 7fa190e1e640 1 --2- 172.21.15.60:0/1565879503 >> v2:172.21.15.105:3300/0 conn(0x7fa18c0cd780 0x7fa18c0cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.079+0000 7fa190e1e640 1 --2- 172.21.15.60:0/1565879503 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa18c0b4d00 0x7fa18c0b5140 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.079+0000 7fa190e1e640 1 -- 172.21.15.60:0/1565879503 >> 172.21.15.60:0/1565879503 conn(0x7fa18c06bc10 msgr2=0x7fa18c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:47.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.079+0000 7fa190e1e640 1 -- 172.21.15.60:0/1565879503 shutdown_connections 2024-09-12T01:44:47.081 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.079+0000 7fa190e1e640 1 -- 172.21.15.60:0/1565879503 wait complete. 2024-09-12T01:44:47.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.080+0000 7fa190e1e640 1 Processor -- start 2024-09-12T01:44:47.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.080+0000 7fa190e1e640 1 -- start start 2024-09-12T01:44:47.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa190e1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa18c0b4920 0x7fa18c147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa190e1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa18c0b4d00 0x7fa18c154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa190e1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa18c0cd780 0x7fa18c0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa190e1e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c0ce130 con 0x7fa18c0b4d00 2024-09-12T01:44:47.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa190e1e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa18c0b5680 con 0x7fa18c0b4920 2024-09-12T01:44:47.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa190e1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa18c0ce2b0 con 0x7fa18c0cd780 2024-09-12T01:44:47.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa189d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa18c0b4d00 0x7fa18c154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa189d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa18c0b4d00 0x7fa18c154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55510/0 (socket says 172.21.15.60:55510) 2024-09-12T01:44:47.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa189d9b640 1 -- 172.21.15.60:0/1871967639 learned_addr learned my addr 172.21.15.60:0/1871967639 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:47.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa18ad9d640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa18c0cd780 0x7fa18c0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa18a59c640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa18c0b4920 0x7fa18c147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa189d9b640 1 -- 172.21.15.60:0/1871967639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa18c0cd780 msgr2=0x7fa18c0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa189d9b640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa18c0cd780 0x7fa18c0b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa189d9b640 1 -- 172.21.15.60:0/1871967639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa18c0b4920 msgr2=0x7fa18c147040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa189d9b640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa18c0b4920 0x7fa18c147040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.081+0000 7fa189d9b640 1 -- 172.21.15.60:0/1871967639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa18c151df0 con 0x7fa18c0b4d00 2024-09-12T01:44:47.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.082+0000 7fa189d9b640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa18c0b4d00 0x7fa18c154960 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fa18002a1c0 tx=0x7fa1800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:47.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.082+0000 7fa17affd640 1 -- 172.21.15.60:0/1871967639 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa180037040 con 0x7fa18c0b4d00 2024-09-12T01:44:47.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.082+0000 7fa17affd640 1 -- 172.21.15.60:0/1871967639 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa180042070 con 0x7fa18c0b4d00 2024-09-12T01:44:47.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.082+0000 7fa190e1e640 1 -- 172.21.15.60:0/1871967639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa18c1520d0 con 0x7fa18c0b4d00 2024-09-12T01:44:47.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.082+0000 7fa17affd640 1 -- 172.21.15.60:0/1871967639 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18003b930 con 0x7fa18c0b4d00 2024-09-12T01:44:47.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.082+0000 7fa190e1e640 1 -- 172.21.15.60:0/1871967639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa18c0cac70 con 0x7fa18c0b4d00 2024-09-12T01:44:47.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.083+0000 7fa190e1e640 1 -- 172.21.15.60:0/1871967639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa18c0b5140 con 0x7fa18c0b4d00 2024-09-12T01:44:47.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.083+0000 7fa17affd640 1 -- 172.21.15.60:0/1871967639 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa18003bad0 con 0x7fa18c0b4d00 2024-09-12T01:44:47.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.084+0000 7fa17affd640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa16c06be30 0x7fa16c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.084+0000 7fa17affd640 1 -- 172.21.15.60:0/1871967639 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fa1800ab520 con 0x7fa18c0b4d00 2024-09-12T01:44:47.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.084+0000 7fa18a59c640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa16c06be30 0x7fa16c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.084+0000 7fa18a59c640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa16c06be30 0x7fa16c06e2f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa17c005880 tx=0x7fa17c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:47.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.088+0000 7fa17affd640 1 -- 172.21.15.60:0/1871967639 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa180079a30 con 0x7fa18c0b4d00 2024-09-12T01:44:47.301 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.300+0000 7fa190e1e640 1 -- 172.21.15.60:0/1871967639 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa18c15aff0 con 0x7fa18c0b4d00 2024-09-12T01:44:47.302 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.301+0000 7fa17affd640 1 -- 172.21.15.60:0/1871967639 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5229 (secure 0 0 0) 0x7fa18007dd30 con 0x7fa18c0b4d00 2024-09-12T01:44:47.302 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:47.302 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"btime":"2024-09-12T01:44:36:571579+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/877895322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":877895322},{"type":"v1","addr":"172.21.15.60:6837","nonce":877895322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7621,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3882170083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3882170083},{"type":"v1","addr":"172.21.15.105:6835","nonce":3882170083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/906162612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":906162612},{"type":"v1","addr":"172.21.15.60:6836","nonce":906162612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:44:33.921909+0000","modified":"2024-09-12T01:44:35.913515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":36740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36740":{"gid":36740,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/705814866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":705814866},{"type":"v1","addr":"172.21.15.105:6834","nonce":705814866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":36740,"qdb_cluster":[36740]},"id":11}]} 2024-09-12T01:44:47.304 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 88 2024-09-12T01:44:47.304 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.303+0000 7fa190e1e640 1 -- 172.21.15.60:0/1871967639 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa16c06be30 msgr2=0x7fa16c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.303+0000 7fa190e1e640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa16c06be30 0x7fa16c06e2f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa17c005880 tx=0x7fa17c009040 comp rx=0 tx=0).stop 2024-09-12T01:44:47.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.303+0000 7fa190e1e640 1 -- 172.21.15.60:0/1871967639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa18c0b4d00 msgr2=0x7fa18c154960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.303+0000 7fa190e1e640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa18c0b4d00 0x7fa18c154960 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fa18002a1c0 tx=0x7fa1800046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.303+0000 7fa190e1e640 1 -- 172.21.15.60:0/1871967639 shutdown_connections 2024-09-12T01:44:47.305 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.303+0000 7fa190e1e640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa16c06be30 0x7fa16c06e2f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.303+0000 7fa190e1e640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa18c0cd780 0x7fa18c0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.303+0000 7fa190e1e640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa18c0b4d00 0x7fa18c154960 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.303+0000 7fa190e1e640 1 --2- 172.21.15.60:0/1871967639 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa18c0b4920 0x7fa18c147040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.303+0000 7fa190e1e640 1 -- 172.21.15.60:0/1871967639 >> 172.21.15.60:0/1871967639 conn(0x7fa18c06bc10 msgr2=0x7fa18c15c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.303+0000 7fa190e1e640 1 -- 172.21.15.60:0/1871967639 shutdown_connections 2024-09-12T01:44:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.303+0000 7fa190e1e640 1 -- 172.21.15.60:0/1871967639 wait complete. 2024-09-12T01:44:47.315 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:47.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.417+0000 7f9211bb0640 1 Processor -- start 2024-09-12T01:44:47.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.417+0000 7f9211bb0640 1 -- start start 2024-09-12T01:44:47.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f9211bb0640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f920c0b63d0 0x7f920c0d39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f9211bb0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f920c0cf6b0 0x7f920c0b7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f9211bb0640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c0cfc20 con 0x7f920c0d1c80 2024-09-12T01:44:47.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f9211bb0640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f920c0d2ed0 con 0x7f920c0b63d0 2024-09-12T01:44:47.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f9211bb0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f920c0d31b0 con 0x7f920c0cf6b0 2024-09-12T01:44:47.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f920b7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f920c0b63d0 0x7f920c0d39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f920bfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f920c0d1c80 0x7f920c0b7dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45862/0 (socket says 172.21.15.60:45862) 2024-09-12T01:44:47.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f920bfff640 1 -- 172.21.15.60:0/2332387719 learned_addr learned my addr 172.21.15.60:0/2332387719 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:47.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f920affd640 1 --2- 172.21.15.60:0/2332387719 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f920c0cf6b0 0x7f920c0b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f920b7fe640 1 -- 172.21.15.60:0/2332387719 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f920c0cf6b0 msgr2=0x7f920c0b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:47.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f920b7fe640 1 --2- 172.21.15.60:0/2332387719 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f920c0cf6b0 0x7f920c0b7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f920b7fe640 1 -- 172.21.15.60:0/2332387719 >> v1:172.21.15.60:6789/0 conn(0x7f920c0d1c80 legacy=0x7f920c0b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f920b7fe640 1 -- 172.21.15.60:0/2332387719 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c0d3490 con 0x7f920c0b63d0 2024-09-12T01:44:47.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.418+0000 7f920a7fc640 1 -- 172.21.15.60:0/2332387719 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 632602705 0 0) 0x7f920c0cfc20 con 0x7f920c0d1c80 2024-09-12T01:44:47.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.419+0000 7f920b7fe640 1 --2- 172.21.15.60:0/2332387719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f920c0b63d0 0x7f920c0d39b0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0097a0 tx=0x7f91fc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa78b2798a3a7fac server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:47.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.419+0000 7f920a7fc640 1 -- 172.21.15.60:0/2332387719 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc037070 con 0x7f920c0b63d0 2024-09-12T01:44:47.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.419+0000 7f920a7fc640 1 -- 172.21.15.60:0/2332387719 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91fc032440 con 0x7f920c0b63d0 2024-09-12T01:44:47.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.419+0000 7f920a7fc640 1 -- 172.21.15.60:0/2332387719 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc032810 con 0x7f920c0b63d0 2024-09-12T01:44:47.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.420+0000 7f9211bb0640 1 -- 172.21.15.60:0/2332387719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f920c0b63d0 msgr2=0x7f920c0d39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.420+0000 7f9211bb0640 1 --2- 172.21.15.60:0/2332387719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f920c0b63d0 0x7f920c0d39b0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0097a0 tx=0x7f91fc02a180 comp rx=0 tx=0).stop 2024-09-12T01:44:47.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.420+0000 7f9211bb0640 1 -- 172.21.15.60:0/2332387719 shutdown_connections 2024-09-12T01:44:47.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.420+0000 7f9211bb0640 1 --2- 172.21.15.60:0/2332387719 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f920c0cf6b0 0x7f920c0b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.420+0000 7f9211bb0640 1 --2- 172.21.15.60:0/2332387719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f920c0b63d0 0x7f920c0d39b0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.420+0000 7f9211bb0640 1 -- 172.21.15.60:0/2332387719 >> 172.21.15.60:0/2332387719 conn(0x7f920c0d1160 msgr2=0x7f920c0d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:47.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.420+0000 7f9211bb0640 1 -- 172.21.15.60:0/2332387719 shutdown_connections 2024-09-12T01:44:47.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.420+0000 7f9211bb0640 1 -- 172.21.15.60:0/2332387719 wait complete. 2024-09-12T01:44:47.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.421+0000 7f9211bb0640 1 Processor -- start 2024-09-12T01:44:47.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.421+0000 7f9211bb0640 1 -- start start 2024-09-12T01:44:47.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f9211bb0640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f920c0b63d0 0x7f920c0ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f9211bb0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f920c0cf6b0 0x7f920c147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f9211bb0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f920c0d1c80 0x7f920c0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f9211bb0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f920c0d4070 con 0x7f920c0cf6b0 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f9211bb0640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f920c0d3ef0 con 0x7f920c0b63d0 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f9211bb0640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f920c0b67b0 con 0x7f920c0d1c80 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f920affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f920c0cf6b0 0x7f920c147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f920affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f920c0cf6b0 0x7f920c147960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55528/0 (socket says 172.21.15.60:55528) 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f920affd640 1 -- 172.21.15.60:0/2883384208 learned_addr learned my addr 172.21.15.60:0/2883384208 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f920b7fe640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f920c0b63d0 0x7f920c0ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f920bfff640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f920c0d1c80 0x7f920c0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f920affd640 1 -- 172.21.15.60:0/2883384208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f920c0d1c80 msgr2=0x7f920c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f920affd640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f920c0d1c80 0x7f920c0cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f920affd640 1 -- 172.21.15.60:0/2883384208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f920c0b63d0 msgr2=0x7f920c0ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f920affd640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f920c0b63d0 0x7f920c0ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f920affd640 1 -- 172.21.15.60:0/2883384208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c1e8140 con 0x7f920c0cf6b0 2024-09-12T01:44:47.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.422+0000 7f920bfff640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f920c0d1c80 0x7f920c0cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:47.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.423+0000 7f920affd640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f920c0cf6b0 0x7f920c147960 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f920000c7f0 tx=0x7f920000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:47.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.423+0000 7f91f3fff640 1 -- 172.21.15.60:0/2883384208 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200015070 con 0x7f920c0cf6b0 2024-09-12T01:44:47.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.423+0000 7f91f3fff640 1 -- 172.21.15.60:0/2883384208 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9200004240 con 0x7f920c0cf6b0 2024-09-12T01:44:47.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.423+0000 7f9211bb0640 1 -- 172.21.15.60:0/2883384208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920c1e8420 con 0x7f920c0cf6b0 2024-09-12T01:44:47.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.423+0000 7f91f3fff640 1 -- 172.21.15.60:0/2883384208 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200007620 con 0x7f920c0cf6b0 2024-09-12T01:44:47.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.423+0000 7f9211bb0640 1 -- 172.21.15.60:0/2883384208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f920c0cb090 con 0x7f920c0cf6b0 2024-09-12T01:44:47.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.424+0000 7f9211bb0640 1 -- 172.21.15.60:0/2883384208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f920c0cb260 con 0x7f920c0cf6b0 2024-09-12T01:44:47.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.424+0000 7f91f3fff640 1 -- 172.21.15.60:0/2883384208 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f92000077c0 con 0x7f920c0cf6b0 2024-09-12T01:44:47.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.425+0000 7f91f3fff640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91f806be60 0x7f91f806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.425+0000 7f91f3fff640 1 -- 172.21.15.60:0/2883384208 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f920008acb0 con 0x7f920c0cf6b0 2024-09-12T01:44:47.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.425+0000 7f920b7fe640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91f806be60 0x7f91f806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.426+0000 7f920b7fe640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91f806be60 0x7f91f806e320 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f91fc034000 tx=0x7f91fc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:47.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.429+0000 7f91f3fff640 1 -- 172.21.15.60:0/2883384208 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f920c0cb260 con 0x7f920c0cf6b0 2024-09-12T01:44:47.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.643+0000 7f9211bb0640 1 -- 172.21.15.60:0/2883384208 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f920c1e8830 con 0x7f920c0cf6b0 2024-09-12T01:44:47.644 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.643+0000 7f91f3fff640 1 -- 172.21.15.60:0/2883384208 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5229 (secure 0 0 0) 0x7f9200058f80 con 0x7f920c0cf6b0 2024-09-12T01:44:47.644 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:47.644 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"btime":"2024-09-12T01:44:36:571579+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/877895322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":877895322},{"type":"v1","addr":"172.21.15.60:6837","nonce":877895322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7621,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3882170083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3882170083},{"type":"v1","addr":"172.21.15.105:6835","nonce":3882170083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/906162612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":906162612},{"type":"v1","addr":"172.21.15.60:6836","nonce":906162612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:44:33.921909+0000","modified":"2024-09-12T01:44:35.913515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":36740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36740":{"gid":36740,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/705814866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":705814866},{"type":"v1","addr":"172.21.15.105:6834","nonce":705814866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":36740,"qdb_cluster":[36740]},"id":11}]} 2024-09-12T01:44:47.645 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 88 2024-09-12T01:44:47.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.645+0000 7f9211bb0640 1 -- 172.21.15.60:0/2883384208 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91f806be60 msgr2=0x7f91f806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.645+0000 7f9211bb0640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91f806be60 0x7f91f806e320 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f91fc034000 tx=0x7f91fc02e000 comp rx=0 tx=0).stop 2024-09-12T01:44:47.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.645+0000 7f9211bb0640 1 -- 172.21.15.60:0/2883384208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f920c0cf6b0 msgr2=0x7f920c147960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.645+0000 7f9211bb0640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f920c0cf6b0 0x7f920c147960 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f920000c7f0 tx=0x7f920000ccb0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.646 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.645+0000 7f9211bb0640 1 -- 172.21.15.60:0/2883384208 shutdown_connections 2024-09-12T01:44:47.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.645+0000 7f9211bb0640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f91f806be60 0x7f91f806e320 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.645+0000 7f9211bb0640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f920c0d1c80 0x7f920c0cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.645+0000 7f9211bb0640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f920c0cf6b0 0x7f920c147960 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.645+0000 7f9211bb0640 1 --2- 172.21.15.60:0/2883384208 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f920c0b63d0 0x7f920c0ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.645+0000 7f9211bb0640 1 -- 172.21.15.60:0/2883384208 >> 172.21.15.60:0/2883384208 conn(0x7f920c0d1160 msgr2=0x7f920c0b7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:47.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.646+0000 7f9211bb0640 1 -- 172.21.15.60:0/2883384208 shutdown_connections 2024-09-12T01:44:47.647 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.646+0000 7f9211bb0640 1 -- 172.21.15.60:0/2883384208 wait complete. 2024-09-12T01:44:47.658 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:44:47.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.759+0000 7fd8da786640 1 Processor -- start 2024-09-12T01:44:47.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.759+0000 7fd8da786640 1 -- start start 2024-09-12T01:44:47.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8da786640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8d415c2b0 0x7fd8d40b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8da786640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8d40b72f0 0x7fd8d415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8da786640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8d415fb10 con 0x7fd8d415f030 2024-09-12T01:44:47.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8da786640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd8d40b5900 con 0x7fd8d40b72f0 2024-09-12T01:44:47.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8da786640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d415f830 con 0x7fd8d415c2b0 2024-09-12T01:44:47.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8d37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8d40b72f0 0x7fd8d415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8d37fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8d40b72f0 0x7fd8d415eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55534/0 (socket says 172.21.15.60:55534) 2024-09-12T01:44:47.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8d37fe640 1 -- 172.21.15.60:0/539638891 learned_addr learned my addr 172.21.15.60:0/539638891 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:47.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8d3fff640 1 --2- 172.21.15.60:0/539638891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8d415c2b0 0x7fd8d40b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8d37fe640 1 -- 172.21.15.60:0/539638891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8d415c2b0 msgr2=0x7fd8d40b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:47.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8d37fe640 1 --2- 172.21.15.60:0/539638891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8d415c2b0 0x7fd8d40b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8d37fe640 1 -- 172.21.15.60:0/539638891 >> v1:172.21.15.105:6789/0 conn(0x7fd8d415f030 legacy=0x7fd8d406f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:47.762 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.760+0000 7fd8d37fe640 1 -- 172.21.15.60:0/539638891 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d406ce30 con 0x7fd8d40b72f0 2024-09-12T01:44:47.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.761+0000 7fd8d37fe640 1 --2- 172.21.15.60:0/539638891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d40b72f0 0x7fd8d415eaf0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009870 tx=0x7fd8c802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295a100d8a403a1e server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:47.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.761+0000 7fd8d2ffd640 1 -- 172.21.15.60:0/539638891 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8037070 con 0x7fd8d40b72f0 2024-09-12T01:44:47.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.761+0000 7fd8d2ffd640 1 -- 172.21.15.60:0/539638891 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8c8032440 con 0x7fd8d40b72f0 2024-09-12T01:44:47.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.761+0000 7fd8d2ffd640 1 -- 172.21.15.60:0/539638891 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8032810 con 0x7fd8d40b72f0 2024-09-12T01:44:47.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.762+0000 7fd8da786640 1 -- 172.21.15.60:0/539638891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d40b72f0 msgr2=0x7fd8d415eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.762+0000 7fd8da786640 1 --2- 172.21.15.60:0/539638891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d40b72f0 0x7fd8d415eaf0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8009870 tx=0x7fd8c802a210 comp rx=0 tx=0).stop 2024-09-12T01:44:47.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.762+0000 7fd8da786640 1 -- 172.21.15.60:0/539638891 shutdown_connections 2024-09-12T01:44:47.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.762+0000 7fd8da786640 1 --2- 172.21.15.60:0/539638891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d40b72f0 0x7fd8d415eaf0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.762+0000 7fd8da786640 1 --2- 172.21.15.60:0/539638891 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8d415c2b0 0x7fd8d40b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.762+0000 7fd8da786640 1 -- 172.21.15.60:0/539638891 >> 172.21.15.60:0/539638891 conn(0x7fd8d40b4240 msgr2=0x7fd8d40b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:47.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.762+0000 7fd8da786640 1 -- 172.21.15.60:0/539638891 shutdown_connections 2024-09-12T01:44:47.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.762+0000 7fd8da786640 1 -- 172.21.15.60:0/539638891 wait complete. 2024-09-12T01:44:47.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.763+0000 7fd8da786640 1 Processor -- start 2024-09-12T01:44:47.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.763+0000 7fd8da786640 1 -- start start 2024-09-12T01:44:47.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8da786640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d40b72f0 0x7fd8d40cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8da786640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8d415c2b0 0x7fd8d40ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8da786640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d415f030 0x7fd8d4151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8da786640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d40b7730 con 0x7fd8d415f030 2024-09-12T01:44:47.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8da786640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d406d3f0 con 0x7fd8d40b72f0 2024-09-12T01:44:47.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8da786640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d415f4e0 con 0x7fd8d415c2b0 2024-09-12T01:44:47.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8d8d23640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d415f030 0x7fd8d4151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8d8d23640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d415f030 0x7fd8d4151ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55536/0 (socket says 172.21.15.60:55536) 2024-09-12T01:44:47.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8d8d23640 1 -- 172.21.15.60:0/1174613849 learned_addr learned my addr 172.21.15.60:0/1174613849 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:47.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8d3fff640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d40b72f0 0x7fd8d40cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8d37fe640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8d415c2b0 0x7fd8d40ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8d8d23640 1 -- 172.21.15.60:0/1174613849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8d415c2b0 msgr2=0x7fd8d40ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8d8d23640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8d415c2b0 0x7fd8d40ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8d8d23640 1 -- 172.21.15.60:0/1174613849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d40b72f0 msgr2=0x7fd8d40cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8d8d23640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d40b72f0 0x7fd8d40cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.767 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.764+0000 7fd8d8d23640 1 -- 172.21.15.60:0/1174613849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d4157f80 con 0x7fd8d415f030 2024-09-12T01:44:47.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.765+0000 7fd8d8d23640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d415f030 0x7fd8d4151ec0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00b970 tx=0x7fd8cc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:47.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.765+0000 7fd8d0ff9640 1 -- 172.21.15.60:0/1174613849 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc019070 con 0x7fd8d415f030 2024-09-12T01:44:47.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.765+0000 7fd8d0ff9640 1 -- 172.21.15.60:0/1174613849 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8cc00cb40 con 0x7fd8d415f030 2024-09-12T01:44:47.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.765+0000 7fd8d0ff9640 1 -- 172.21.15.60:0/1174613849 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc014440 con 0x7fd8d415f030 2024-09-12T01:44:47.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.765+0000 7fd8da786640 1 -- 172.21.15.60:0/1174613849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d40cd120 con 0x7fd8d415f030 2024-09-12T01:44:47.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.765+0000 7fd8da786640 1 -- 172.21.15.60:0/1174613849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d40cd6e0 con 0x7fd8d415f030 2024-09-12T01:44:47.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.766+0000 7fd8da786640 1 -- 172.21.15.60:0/1174613849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8d40cdea0 con 0x7fd8d415f030 2024-09-12T01:44:47.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.766+0000 7fd8d0ff9640 1 -- 172.21.15.60:0/1174613849 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8cc01c070 con 0x7fd8d415f030 2024-09-12T01:44:47.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.767+0000 7fd8d0ff9640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8c006be60 0x7fd8c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:47.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.767+0000 7fd8d3fff640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8c006be60 0x7fd8c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:47.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.767+0000 7fd8d0ff9640 1 -- 172.21.15.60:0/1174613849 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fd8cc08a990 con 0x7fd8d415f030 2024-09-12T01:44:47.769 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.768+0000 7fd8d3fff640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8c006be60 0x7fd8c006e320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40b2e00 tx=0x7fd8c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:47.772 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.771+0000 7fd8d0ff9640 1 -- 172.21.15.60:0/1174613849 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8d40cdea0 con 0x7fd8d415f030 2024-09-12T01:44:47.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.948+0000 7fd8da786640 1 -- 172.21.15.60:0/1174613849 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd8d415eaf0 con 0x7fd8d415f030 2024-09-12T01:44:47.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.949+0000 7fd8d0ff9640 1 -- 172.21.15.60:0/1174613849 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) ==== 74+0+16703 (secure 0 0 0) 0x7fd8cc058ce0 con 0x7fd8d415f030 2024-09-12T01:44:47.950 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:47.950 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":139,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:44:35.566002+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:44:31.572386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-12T01:44:32.903039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:44:47.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.952+0000 7fd8da786640 1 -- 172.21.15.60:0/1174613849 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8c006be60 msgr2=0x7fd8c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.952+0000 7fd8da786640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8c006be60 0x7fd8c006e320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40b2e00 tx=0x7fd8c4008040 comp rx=0 tx=0).stop 2024-09-12T01:44:47.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.952+0000 7fd8da786640 1 -- 172.21.15.60:0/1174613849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d415f030 msgr2=0x7fd8d4151ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:47.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.952+0000 7fd8da786640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d415f030 0x7fd8d4151ec0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc00b970 tx=0x7fd8cc00be30 comp rx=0 tx=0).stop 2024-09-12T01:44:47.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.952+0000 7fd8da786640 1 -- 172.21.15.60:0/1174613849 shutdown_connections 2024-09-12T01:44:47.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.952+0000 7fd8da786640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d415f030 0x7fd8d4151ec0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.952+0000 7fd8da786640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8c006be60 0x7fd8c006e320 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.952+0000 7fd8da786640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8d415c2b0 0x7fd8d40ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.952+0000 7fd8da786640 1 --2- 172.21.15.60:0/1174613849 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d40b72f0 0x7fd8d40cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:47.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.952+0000 7fd8da786640 1 -- 172.21.15.60:0/1174613849 >> 172.21.15.60:0/1174613849 conn(0x7fd8d40b4240 msgr2=0x7fd8d415cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:47.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.952+0000 7fd8da786640 1 -- 172.21.15.60:0/1174613849 shutdown_connections 2024-09-12T01:44:47.954 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:47.952+0000 7fd8da786640 1 -- 172.21.15.60:0/1174613849 wait complete. 2024-09-12T01:44:47.964 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:44:47.964 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:48.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.065+0000 7fa0692ba640 1 Processor -- start 2024-09-12T01:44:48.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.065+0000 7fa0692ba640 1 -- start start 2024-09-12T01:44:48.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.066+0000 7fa0692ba640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa06415c170 0x7fa06415c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.066+0000 7fa0692ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0640b64e0 0x7fa0640cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.066+0000 7fa0692ba640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0640b4cf0 con 0x7fa0640cf6c0 2024-09-12T01:44:48.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.066+0000 7fa0692ba640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa06415ca90 con 0x7fa06415c170 2024-09-12T01:44:48.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.066+0000 7fa0692ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0640b49c0 con 0x7fa0640b64e0 2024-09-12T01:44:48.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.066+0000 7fa062ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa06415c170 0x7fa06415c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.066+0000 7fa0637fe640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0640b64e0 0x7fa0640cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.066+0000 7fa062ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa06415c170 0x7fa06415c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:59288/0 (socket says 172.21.15.60:59288) 2024-09-12T01:44:48.067 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.066+0000 7fa062ffd640 1 -- 172.21.15.60:0/2084457552 learned_addr learned my addr 172.21.15.60:0/2084457552 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:48.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.067+0000 7fa062ffd640 1 -- 172.21.15.60:0/2084457552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0640b64e0 msgr2=0x7fa0640cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:48.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.067+0000 7fa062ffd640 1 --2- 172.21.15.60:0/2084457552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0640b64e0 0x7fa0640cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.067+0000 7fa062ffd640 1 -- 172.21.15.60:0/2084457552 >> v1:172.21.15.105:6789/0 conn(0x7fa0640cf6c0 legacy=0x7fa0640b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.067+0000 7fa062ffd640 1 -- 172.21.15.60:0/2084457552 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0640b4fd0 con 0x7fa06415c170 2024-09-12T01:44:48.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.067+0000 7fa0637fe640 1 --2- 172.21.15.60:0/2084457552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0640b64e0 0x7fa0640cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:48.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.067+0000 7fa062ffd640 1 --2- 172.21.15.60:0/2084457552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa06415c170 0x7fa06415c550 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa0540098a0 tx=0x7fa05402a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93092cea32a51c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:48.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.068+0000 7fa061ffb640 1 -- 172.21.15.60:0/2084457552 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054037070 con 0x7fa06415c170 2024-09-12T01:44:48.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.068+0000 7fa061ffb640 1 -- 172.21.15.60:0/2084457552 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa054032440 con 0x7fa06415c170 2024-09-12T01:44:48.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.068+0000 7fa061ffb640 1 -- 172.21.15.60:0/2084457552 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa054032810 con 0x7fa06415c170 2024-09-12T01:44:48.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.068+0000 7fa0692ba640 1 -- 172.21.15.60:0/2084457552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa06415c170 msgr2=0x7fa06415c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.068+0000 7fa0692ba640 1 --2- 172.21.15.60:0/2084457552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa06415c170 0x7fa06415c550 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa0540098a0 tx=0x7fa05402a290 comp rx=0 tx=0).stop 2024-09-12T01:44:48.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.068+0000 7fa0692ba640 1 -- 172.21.15.60:0/2084457552 shutdown_connections 2024-09-12T01:44:48.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.068+0000 7fa0692ba640 1 --2- 172.21.15.60:0/2084457552 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0640b64e0 0x7fa0640cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.068+0000 7fa0692ba640 1 --2- 172.21.15.60:0/2084457552 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa06415c170 0x7fa06415c550 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.068+0000 7fa0692ba640 1 -- 172.21.15.60:0/2084457552 >> 172.21.15.60:0/2084457552 conn(0x7fa06406bc10 msgr2=0x7fa06406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:48.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.068+0000 7fa0692ba640 1 -- 172.21.15.60:0/2084457552 shutdown_connections 2024-09-12T01:44:48.070 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.068+0000 7fa0692ba640 1 -- 172.21.15.60:0/2084457552 wait complete. 2024-09-12T01:44:48.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.069+0000 7fa0692ba640 1 Processor -- start 2024-09-12T01:44:48.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.069+0000 7fa0692ba640 1 -- start start 2024-09-12T01:44:48.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.070+0000 7fa0692ba640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0640b64e0 0x7fa064143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.070+0000 7fa0692ba640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0640cf6c0 0x7fa06415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.070+0000 7fa0692ba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa06415c170 0x7fa06415e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.070+0000 7fa0692ba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa0640b5870 con 0x7fa06415c170 2024-09-12T01:44:48.072 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.070+0000 7fa0692ba640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa0640b5590 con 0x7fa0640b64e0 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.070+0000 7fa0692ba640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa0640b5b50 con 0x7fa0640cf6c0 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.070+0000 7fa0637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa06415c170 0x7fa06415e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.070+0000 7fa0637fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa06415c170 0x7fa06415e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55546/0 (socket says 172.21.15.60:55546) 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.070+0000 7fa0637fe640 1 -- 172.21.15.60:0/3489182053 learned_addr learned my addr 172.21.15.60:0/3489182053 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa0627fc640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0640cf6c0 0x7fa06415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa062ffd640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0640b64e0 0x7fa064143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa0637fe640 1 -- 172.21.15.60:0/3489182053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0640cf6c0 msgr2=0x7fa06415b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa0637fe640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0640cf6c0 0x7fa06415b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa0637fe640 1 -- 172.21.15.60:0/3489182053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0640b64e0 msgr2=0x7fa064143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa0637fe640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0640b64e0 0x7fa064143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa0637fe640 1 -- 172.21.15.60:0/3489182053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06415a170 con 0x7fa06415c170 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa062ffd640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0640b64e0 0x7fa064143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:48.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa0627fc640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0640cf6c0 0x7fa06415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:48.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa0637fe640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa06415c170 0x7fa06415e6b0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009e50 tx=0x7fa05c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:48.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa04b7fe640 1 -- 172.21.15.60:0/3489182053 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c018030 con 0x7fa06415c170 2024-09-12T01:44:48.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa04b7fe640 1 -- 172.21.15.60:0/3489182053 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa05c00cd90 con 0x7fa06415c170 2024-09-12T01:44:48.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa0692ba640 1 -- 172.21.15.60:0/3489182053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06415a450 con 0x7fa06415c170 2024-09-12T01:44:48.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa04b7fe640 1 -- 172.21.15.60:0/3489182053 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa05c003bb0 con 0x7fa06415c170 2024-09-12T01:44:48.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.071+0000 7fa0692ba640 1 -- 172.21.15.60:0/3489182053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06415aa10 con 0x7fa06415c170 2024-09-12T01:44:48.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.072+0000 7fa0692ba640 1 -- 172.21.15.60:0/3489182053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa064075310 con 0x7fa06415c170 2024-09-12T01:44:48.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.073+0000 7fa04b7fe640 1 -- 172.21.15.60:0/3489182053 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa05c01b070 con 0x7fa06415c170 2024-09-12T01:44:48.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.073+0000 7fa04b7fe640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa05006be30 0x7fa05006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.073+0000 7fa04b7fe640 1 -- 172.21.15.60:0/3489182053 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fa05c08b7a0 con 0x7fa06415c170 2024-09-12T01:44:48.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.073+0000 7fa062ffd640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa05006be30 0x7fa05006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.075 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.074+0000 7fa062ffd640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa05006be30 0x7fa05006e2f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa054034000 tx=0x7fa05402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:48.078 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.077+0000 7fa04b7fe640 1 -- 172.21.15.60:0/3489182053 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa064075310 con 0x7fa06415c170 2024-09-12T01:44:48.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.289+0000 7fa0692ba640 1 -- 172.21.15.60:0/3489182053 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0640cfb30 con 0x7fa06415c170 2024-09-12T01:44:48.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.289+0000 7fa04b7fe640 1 -- 172.21.15.60:0/3489182053 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5229 (secure 0 0 0) 0x7fa05c010040 con 0x7fa06415c170 2024-09-12T01:44:48.290 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:48.290 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"btime":"2024-09-12T01:44:36:571579+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/877895322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":877895322},{"type":"v1","addr":"172.21.15.60:6837","nonce":877895322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7621,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3882170083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3882170083},{"type":"v1","addr":"172.21.15.105:6835","nonce":3882170083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/906162612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":906162612},{"type":"v1","addr":"172.21.15.60:6836","nonce":906162612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:44:33.921909+0000","modified":"2024-09-12T01:44:35.913515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":36740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36740":{"gid":36740,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/705814866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":705814866},{"type":"v1","addr":"172.21.15.105:6834","nonce":705814866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":36740,"qdb_cluster":[36740]},"id":11}]} 2024-09-12T01:44:48.291 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 88 2024-09-12T01:44:48.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.291+0000 7fa0692ba640 1 -- 172.21.15.60:0/3489182053 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa05006be30 msgr2=0x7fa05006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.291+0000 7fa0692ba640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa05006be30 0x7fa05006e2f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa054034000 tx=0x7fa05402e000 comp rx=0 tx=0).stop 2024-09-12T01:44:48.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.291+0000 7fa0692ba640 1 -- 172.21.15.60:0/3489182053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa06415c170 msgr2=0x7fa06415e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.291+0000 7fa0692ba640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa06415c170 0x7fa06415e6b0 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009e50 tx=0x7fa05c00c490 comp rx=0 tx=0).stop 2024-09-12T01:44:48.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.291+0000 7fa0692ba640 1 -- 172.21.15.60:0/3489182053 shutdown_connections 2024-09-12T01:44:48.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.291+0000 7fa0692ba640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa06415c170 0x7fa06415e6b0 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.291+0000 7fa0692ba640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa05006be30 0x7fa05006e2f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.291+0000 7fa0692ba640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa0640cf6c0 0x7fa06415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.291+0000 7fa0692ba640 1 --2- 172.21.15.60:0/3489182053 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa0640b64e0 0x7fa064143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.291+0000 7fa0692ba640 1 -- 172.21.15.60:0/3489182053 >> 172.21.15.60:0/3489182053 conn(0x7fa06406bc10 msgr2=0x7fa064072170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:48.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.291+0000 7fa0692ba640 1 -- 172.21.15.60:0/3489182053 shutdown_connections 2024-09-12T01:44:48.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.291+0000 7fa0692ba640 1 -- 172.21.15.60:0/3489182053 wait complete. 2024-09-12T01:44:48.303 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:44:48.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.405+0000 7f21a81d6640 1 Processor -- start 2024-09-12T01:44:48.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.405+0000 7f21a81d6640 1 -- start start 2024-09-12T01:44:48.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.406+0000 7f21a81d6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f21a00d3310 0x7f21a00d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.406+0000 7f21a81d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a00d1650 0x7f21a00b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.406+0000 7f21a81d6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21a015ea40 con 0x7f21a015e660 2024-09-12T01:44:48.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.406+0000 7f21a81d6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f21a00d1a90 con 0x7f21a00d3310 2024-09-12T01:44:48.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.406+0000 7f21a81d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21a00d3870 con 0x7f21a00d1650 2024-09-12T01:44:48.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.406+0000 7f21a5f72640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f21a015e660 0x7f21a00cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45866/0 (socket says 172.21.15.60:45866) 2024-09-12T01:44:48.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.406+0000 7f21a5f72640 1 -- 172.21.15.60:0/2356544624 learned_addr learned my addr 172.21.15.60:0/2356544624 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:48.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a6773640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a00d1650 0x7f21a00b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a5771640 1 --2- 172.21.15.60:0/2356544624 >> v2:172.21.15.105:3300/0 conn(0x7f21a00d3310 0x7f21a00d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.410 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188336152 0 0) 0x7f21a015ea40 con 0x7f21a015e660 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2188003520 con 0x7f21a015e660 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 866840930 0 0) 0x7f2188003520 con 0x7f21a015e660 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a00d1650 msgr2=0x7f21a00b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a00d1650 0x7f21a00b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 >> v2:172.21.15.105:3300/0 conn(0x7f21a00d3310 msgr2=0x7f21a00d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 --2- 172.21.15.60:0/2356544624 >> v2:172.21.15.105:3300/0 conn(0x7f21a00d3310 0x7f21a00d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a00d3b50 con 0x7f21a015e660 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f2198001670 con 0x7f21a015e660 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a6773640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a00d1650 0x7f21a00b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 >> v1:172.21.15.60:6789/0 conn(0x7f21a015e660 legacy=0x7f21a00cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21880039b0 0x7f2188003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2188004800 0x7f2188004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a00d1650 0x7f21880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f21a00d1a90 con 0x7f2188004800 2024-09-12T01:44:48.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21a00d3870 con 0x7f21880039b0 2024-09-12T01:44:48.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f218800b9c0 con 0x7f21a00d1650 2024-09-12T01:44:48.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a5771640 1 --2- 172.21.15.60:0/2356544624 >> v2:172.21.15.105:3300/0 conn(0x7f21a00d3310 0x7f21a00d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:48.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a5771640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2188004800 0x7f2188004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a5f72640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21880039b0 0x7f2188003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a6773640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a00d1650 0x7f21880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a5771640 1 -- 172.21.15.60:0/2356544624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a00d1650 msgr2=0x7f21880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:48.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a5771640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f21a00d1650 0x7f21880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a5771640 1 -- 172.21.15.60:0/2356544624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21880039b0 msgr2=0x7f2188003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:48.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a5771640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21880039b0 0x7f2188003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.407+0000 7f21a5771640 1 -- 172.21.15.60:0/2356544624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2188003520 con 0x7f2188004800 2024-09-12T01:44:48.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.408+0000 7f21a5771640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2188004800 0x7f2188004c80 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f2194009c70 tx=0x7f2188005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585797fd5c1a08fe server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:48.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.408+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194009840 con 0x7f2188004800 2024-09-12T01:44:48.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.408+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2194004020 con 0x7f2188004800 2024-09-12T01:44:48.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.408+0000 7f21a4f70640 1 -- 172.21.15.60:0/2356544624 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21940043d0 con 0x7f2188004800 2024-09-12T01:44:48.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.409+0000 7f21a81d6640 1 -- 172.21.15.60:0/2356544624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2188004800 msgr2=0x7f2188004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.409+0000 7f21a81d6640 1 --2- 172.21.15.60:0/2356544624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2188004800 0x7f2188004c80 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f2194009c70 tx=0x7f2188005830 comp rx=0 tx=0).stop 2024-09-12T01:44:48.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.409+0000 7f21a6773640 1 -- 172.21.15.60:0/2356544624 reap_dead start 2024-09-12T01:44:48.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.409+0000 7f21a81d6640 1 -- 172.21.15.60:0/2356544624 shutdown_connections 2024-09-12T01:44:48.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.409+0000 7f21a81d6640 1 -- 172.21.15.60:0/2356544624 >> 172.21.15.60:0/2356544624 conn(0x7f21a00b6410 msgr2=0x7f21a00b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:48.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.409+0000 7f21a81d6640 1 -- 172.21.15.60:0/2356544624 shutdown_connections 2024-09-12T01:44:48.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.409+0000 7f21a81d6640 1 -- 172.21.15.60:0/2356544624 wait complete. 2024-09-12T01:44:48.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.410+0000 7f21a81d6640 1 Processor -- start 2024-09-12T01:44:48.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.410+0000 7f21a81d6640 1 -- start start 2024-09-12T01:44:48.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a81d6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2188004800 0x7f21a00ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a81d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21a0155e20 0x7f21a0156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a81d6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a01606e0 0x7f21a0160b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a81d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f21a00d43f0 con 0x7f21a0155e20 2024-09-12T01:44:48.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a81d6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f21a00d4110 con 0x7f21a01606e0 2024-09-12T01:44:48.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a81d6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f21a00b7b70 con 0x7f2188004800 2024-09-12T01:44:48.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a5771640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21a0155e20 0x7f21a0156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a5771640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21a0155e20 0x7f21a0156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55576/0 (socket says 172.21.15.60:55576) 2024-09-12T01:44:48.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a5771640 1 -- 172.21.15.60:0/705319987 learned_addr learned my addr 172.21.15.60:0/705319987 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:48.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a6773640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a01606e0 0x7f21a0160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a5f72640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2188004800 0x7f21a00ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a5771640 1 -- 172.21.15.60:0/705319987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2188004800 msgr2=0x7f21a00ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a5771640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2188004800 0x7f21a00ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a5771640 1 -- 172.21.15.60:0/705319987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a01606e0 msgr2=0x7f21a0160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a5771640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a01606e0 0x7f21a0160b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.411+0000 7f21a5771640 1 -- 172.21.15.60:0/705319987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21a00caad0 con 0x7f21a0155e20 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.412+0000 7f21a5771640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21a0155e20 0x7f21a0156280 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f2194009d90 tx=0x7f2194004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.412+0000 7f219e7fc640 1 -- 172.21.15.60:0/705319987 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194040070 con 0x7f21a0155e20 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.412+0000 7f219e7fc640 1 -- 172.21.15.60:0/705319987 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2194003820 con 0x7f21a0155e20 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.412+0000 7f21a81d6640 1 -- 172.21.15.60:0/705319987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21a01613d0 con 0x7f21a0155e20 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.412+0000 7f219e7fc640 1 -- 172.21.15.60:0/705319987 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194006e10 con 0x7f21a0155e20 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.412+0000 7f21a81d6640 1 -- 172.21.15.60:0/705319987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21a01534e0 con 0x7f21a0155e20 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.413+0000 7f21a81d6640 1 -- 172.21.15.60:0/705319987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21a00d1110 con 0x7f21a0155e20 2024-09-12T01:44:48.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.413+0000 7f219e7fc640 1 -- 172.21.15.60:0/705319987 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f2194043070 con 0x7f21a0155e20 2024-09-12T01:44:48.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.414+0000 7f219e7fc640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f218c06be30 0x7f218c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.414+0000 7f219e7fc640 1 -- 172.21.15.60:0/705319987 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f21940ab660 con 0x7f21a0155e20 2024-09-12T01:44:48.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.414+0000 7f21a5f72640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f218c06be30 0x7f218c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.414+0000 7f21a5f72640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f218c06be30 0x7f218c06e2f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f21980015d0 tx=0x7f21980078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:48.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.418+0000 7f219e7fc640 1 -- 172.21.15.60:0/705319987 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f21a00caad0 con 0x7f21a0155e20 2024-09-12T01:44:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.632+0000 7f21a81d6640 1 -- 172.21.15.60:0/705319987 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21a00b4a00 con 0x7f21a0155e20 2024-09-12T01:44:48.633 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.633+0000 7f219e7fc640 1 -- 172.21.15.60:0/705319987 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) ==== 94+0+5229 (secure 0 0 0) 0x7f2194079920 con 0x7f21a0155e20 2024-09-12T01:44:48.634 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:48.634 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"btime":"2024-09-12T01:44:36:571579+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/877895322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":877895322},{"type":"v1","addr":"172.21.15.60:6837","nonce":877895322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7621,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3882170083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3882170083},{"type":"v1","addr":"172.21.15.105:6835","nonce":3882170083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/906162612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":906162612},{"type":"v1","addr":"172.21.15.60:6836","nonce":906162612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-12T01:44:33.921909+0000","modified":"2024-09-12T01:44:35.913515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":36740},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36740":{"gid":36740,"name":"d","rank":0,"incarnation":86,"state":"up:active","state_seq":3,"addr":"172.21.15.105:6834/705814866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":705814866},{"type":"v1","addr":"172.21.15.105:6834","nonce":705814866}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":36740,"qdb_cluster":[36740]},"id":11}]} 2024-09-12T01:44:48.634 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 88 2024-09-12T01:44:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.635+0000 7f21a81d6640 1 -- 172.21.15.60:0/705319987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f218c06be30 msgr2=0x7f218c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.635+0000 7f21a81d6640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f218c06be30 0x7f218c06e2f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f21980015d0 tx=0x7f21980078f0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.635+0000 7f21a81d6640 1 -- 172.21.15.60:0/705319987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21a0155e20 msgr2=0x7f21a0156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.635+0000 7f21a81d6640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21a0155e20 0x7f21a0156280 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f2194009d90 tx=0x7f2194004730 comp rx=0 tx=0).stop 2024-09-12T01:44:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.635+0000 7f21a81d6640 1 -- 172.21.15.60:0/705319987 shutdown_connections 2024-09-12T01:44:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.635+0000 7f21a81d6640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f21a01606e0 0x7f21a0160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.635+0000 7f21a81d6640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21a0155e20 0x7f21a0156280 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.635+0000 7f21a81d6640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f218c06be30 0x7f218c06e2f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.635+0000 7f21a81d6640 1 --2- 172.21.15.60:0/705319987 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2188004800 0x7f21a00ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.635+0000 7f21a81d6640 1 -- 172.21.15.60:0/705319987 >> 172.21.15.60:0/705319987 conn(0x7f21a00b6410 msgr2=0x7f21a00b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:48.636 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.635+0000 7f21a81d6640 1 -- 172.21.15.60:0/705319987 shutdown_connections 2024-09-12T01:44:48.637 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.635+0000 7f21a81d6640 1 -- 172.21.15.60:0/705319987 wait complete. 2024-09-12T01:44:48.646 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:44:48.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.748+0000 7f1a4ba77640 1 Processor -- start 2024-09-12T01:44:48.749 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.748+0000 7f1a4ba77640 1 -- start start 2024-09-12T01:44:48.751 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.749+0000 7f1a4ba77640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1a440cf6b0 0x7f1a441629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.749+0000 7f1a4ba77640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a440cfc20 con 0x7f1a440b63d0 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.749+0000 7f1a4ba77640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a440d2ed0 con 0x7f1a44162f30 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.749+0000 7f1a4ba77640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f1a440d40c0 con 0x7f1a440cf6b0 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.749+0000 7f1a49813640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1a440b63d0 0x7f1a440d39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45878/0 (socket says 172.21.15.60:45878) 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.749+0000 7f1a49813640 1 -- 172.21.15.60:0/3834095752 learned_addr learned my addr 172.21.15.60:0/3834095752 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.749+0000 7f1a49012640 1 --2- 172.21.15.60:0/3834095752 >> v2:172.21.15.105:3300/0 conn(0x7f1a440cf6b0 0x7f1a441629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.749+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428263056 0 0) 0x7f1a440cfc20 con 0x7f1a440b63d0 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.749+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a30003520 con 0x7f1a440b63d0 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1864231832 0 0) 0x7f1a30003520 con 0x7f1a440b63d0 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 >> v2:172.21.15.105:3300/0 conn(0x7f1a440cf6b0 msgr2=0x7f1a441629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 --2- 172.21.15.60:0/3834095752 >> v2:172.21.15.105:3300/0 conn(0x7f1a440cf6b0 0x7f1a441629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 >> v1:172.21.15.105:6789/0 conn(0x7f1a44162f30 legacy=0x7f1a440b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.752 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a440d31b0 con 0x7f1a440b63d0 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f1a40001670 con 0x7f1a440b63d0 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 >> v1:172.21.15.60:6789/0 conn(0x7f1a440b63d0 legacy=0x7f1a440d39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 --2- 172.21.15.60:0/3834095752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a300039b0 0x7f1a30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 --2- 172.21.15.60:0/3834095752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a30004800 0x7f1a30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 --2- 172.21.15.60:0/3834095752 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a300051c0 0x7f1a3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1a440d40c0 con 0x7f1a300039b0 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3000c160 con 0x7f1a30004800 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3000c360 con 0x7f1a300051c0 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a49813640 1 --2- 172.21.15.60:0/3834095752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a300039b0 0x7f1a30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a49012640 1 --2- 172.21.15.60:0/3834095752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a30004800 0x7f1a30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a4a014640 1 --2- 172.21.15.60:0/3834095752 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a300051c0 0x7f1a3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a49813640 1 -- 172.21.15.60:0/3834095752 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a300051c0 msgr2=0x7f1a3000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a49813640 1 --2- 172.21.15.60:0/3834095752 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a300051c0 0x7f1a3000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a49813640 1 -- 172.21.15.60:0/3834095752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a30004800 msgr2=0x7f1a30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:48.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a49813640 1 --2- 172.21.15.60:0/3834095752 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a30004800 0x7f1a30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a49813640 1 -- 172.21.15.60:0/3834095752 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a30003520 con 0x7f1a300039b0 2024-09-12T01:44:48.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.750+0000 7f1a4a014640 1 -- 172.21.15.60:0/3834095752 reap_dead start 2024-09-12T01:44:48.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.751+0000 7f1a49813640 1 --2- 172.21.15.60:0/3834095752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a300039b0 0x7f1a30003dd0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c210 tx=0x7f1a30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c6f859d29b3593 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:48.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.751+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40007d30 con 0x7f1a300039b0 2024-09-12T01:44:48.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.751+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a40005ad0 con 0x7f1a300039b0 2024-09-12T01:44:48.754 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.751+0000 7f1a48811640 1 -- 172.21.15.60:0/3834095752 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a40007070 con 0x7f1a300039b0 2024-09-12T01:44:48.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.752+0000 7f1a4ba77640 1 -- 172.21.15.60:0/3834095752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a300039b0 msgr2=0x7f1a30003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.752+0000 7f1a4ba77640 1 --2- 172.21.15.60:0/3834095752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a300039b0 0x7f1a30003dd0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f1a4000c210 tx=0x7f1a30005830 comp rx=0 tx=0).stop 2024-09-12T01:44:48.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.752+0000 7f1a4ba77640 1 -- 172.21.15.60:0/3834095752 shutdown_connections 2024-09-12T01:44:48.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.752+0000 7f1a4ba77640 1 --2- 172.21.15.60:0/3834095752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a300039b0 0x7f1a30003dd0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.752+0000 7f1a4ba77640 1 -- 172.21.15.60:0/3834095752 >> 172.21.15.60:0/3834095752 conn(0x7f1a440d1160 msgr2=0x7f1a440d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.752+0000 7f1a4ba77640 1 -- 172.21.15.60:0/3834095752 shutdown_connections 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.752+0000 7f1a4ba77640 1 -- 172.21.15.60:0/3834095752 wait complete. 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.753+0000 7f1a4ba77640 1 Processor -- start 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.753+0000 7f1a4ba77640 1 -- start start 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a4ba77640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a300039b0 0x7f1a44156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a4ba77640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a44157a00 0x7f1a4415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a4ba77640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a441574b0 0x7f1a4415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a4ba77640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1a440cb5c0 con 0x7f1a44157a00 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a4ba77640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f1a440cb440 con 0x7f1a441574b0 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a4ba77640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f1a440d1c80 con 0x7f1a300039b0 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a49012640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a44157a00 0x7f1a4415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a49012640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a44157a00 0x7f1a4415aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55586/0 (socket says 172.21.15.60:55586) 2024-09-12T01:44:48.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a49012640 1 -- 172.21.15.60:0/2134914262 learned_addr learned my addr 172.21.15.60:0/2134914262 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a4a014640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a441574b0 0x7f1a4415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a49813640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a300039b0 0x7f1a44156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a49012640 1 -- 172.21.15.60:0/2134914262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a300039b0 msgr2=0x7f1a44156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a49012640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a300039b0 0x7f1a44156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a49012640 1 -- 172.21.15.60:0/2134914262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a441574b0 msgr2=0x7f1a4415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a49012640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a441574b0 0x7f1a4415b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a49012640 1 -- 172.21.15.60:0/2134914262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a44157280 con 0x7f1a44157a00 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a49012640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a44157a00 0x7f1a4415aae0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f1a34011aa0 tx=0x7f1a34011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.754+0000 7f1a3a7fc640 1 -- 172.21.15.60:0/2134914262 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3400fb80 con 0x7f1a44157a00 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.755+0000 7f1a3a7fc640 1 -- 172.21.15.60:0/2134914262 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3400fd20 con 0x7f1a44157a00 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.755+0000 7f1a3a7fc640 1 -- 172.21.15.60:0/2134914262 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34014660 con 0x7f1a44157a00 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.755+0000 7f1a4ba77640 1 -- 172.21.15.60:0/2134914262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4415ea40 con 0x7f1a44157a00 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.755+0000 7f1a4ba77640 1 -- 172.21.15.60:0/2134914262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4415f000 con 0x7f1a44157a00 2024-09-12T01:44:48.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.756+0000 7f1a4ba77640 1 -- 172.21.15.60:0/2134914262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a440b67b0 con 0x7f1a44157a00 2024-09-12T01:44:48.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.756+0000 7f1a3a7fc640 1 -- 172.21.15.60:0/2134914262 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f1a34012040 con 0x7f1a44157a00 2024-09-12T01:44:48.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.756+0000 7f1a3a7fc640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1a2806be30 0x7f1a2806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:48.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.757+0000 7f1a3a7fc640 1 -- 172.21.15.60:0/2134914262 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f1a3408b370 con 0x7f1a44157a00 2024-09-12T01:44:48.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.757+0000 7f1a49813640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1a2806be30 0x7f1a2806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:48.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.757+0000 7f1a49813640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1a2806be30 0x7f1a2806e2f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1a40033000 tx=0x7f1a4002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:48.761 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.761+0000 7f1a3a7fc640 1 -- 172.21.15.60:0/2134914262 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f1a34019030 con 0x7f1a44157a00 2024-09-12T01:44:48.936 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.935+0000 7f1a4ba77640 1 -- 172.21.15.60:0/2134914262 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a440cf280 con 0x7f1a44157a00 2024-09-12T01:44:48.937 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.936+0000 7f1a3a7fc640 1 -- 172.21.15.60:0/2134914262 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) ==== 74+0+16703 (secure 0 0 0) 0x7f1a340596d0 con 0x7f1a44157a00 2024-09-12T01:44:48.937 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:48.937 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":139,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:44:35.566002+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-12T01:44:31.572386+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-12T01:44:32.903039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:44:48.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.938+0000 7f1a4ba77640 1 -- 172.21.15.60:0/2134914262 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1a2806be30 msgr2=0x7f1a2806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.939 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.938+0000 7f1a4ba77640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1a2806be30 0x7f1a2806e2f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f1a40033000 tx=0x7f1a4002e000 comp rx=0 tx=0).stop 2024-09-12T01:44:48.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.938+0000 7f1a4ba77640 1 -- 172.21.15.60:0/2134914262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a44157a00 msgr2=0x7f1a4415aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:48.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.938+0000 7f1a4ba77640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a44157a00 0x7f1a4415aae0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f1a34011aa0 tx=0x7f1a34011f60 comp rx=0 tx=0).stop 2024-09-12T01:44:48.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.938+0000 7f1a4ba77640 1 -- 172.21.15.60:0/2134914262 shutdown_connections 2024-09-12T01:44:48.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.938+0000 7f1a4ba77640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f1a441574b0 0x7f1a4415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.938+0000 7f1a4ba77640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a44157a00 0x7f1a4415aae0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.938+0000 7f1a4ba77640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f1a2806be30 0x7f1a2806e2f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.938+0000 7f1a4ba77640 1 --2- 172.21.15.60:0/2134914262 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1a300039b0 0x7f1a44156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:48.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.938+0000 7f1a4ba77640 1 -- 172.21.15.60:0/2134914262 >> 172.21.15.60:0/2134914262 conn(0x7f1a440d1160 msgr2=0x7f1a440ba080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:48.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.938+0000 7f1a4ba77640 1 -- 172.21.15.60:0/2134914262 shutdown_connections 2024-09-12T01:44:48.940 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:48.938+0000 7f1a4ba77640 1 -- 172.21.15.60:0/2134914262 wait complete. 2024-09-12T01:44:48.950 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-12T01:44:49.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.053+0000 7fd8f5d91640 1 Processor -- start 2024-09-12T01:44:49.054 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.053+0000 7fd8f5d91640 1 -- start start 2024-09-12T01:44:49.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.054+0000 7fd8f5d91640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd8f015e750 0x7fd8f00cf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.054+0000 7fd8f5d91640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f00b6bb0 0x7fd8f00b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.054+0000 7fd8f5d91640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f00b7790 con 0x7fd8f00cfb70 2024-09-12T01:44:49.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.054+0000 7fd8f5d91640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f00d43c0 con 0x7fd8f015e750 2024-09-12T01:44:49.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.054+0000 7fd8f5d91640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f00d33b0 con 0x7fd8f00b6bb0 2024-09-12T01:44:49.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.054+0000 7fd8eeffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd8f00cfb70 0x7fd8f00b64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45892/0 (socket says 172.21.15.60:45892) 2024-09-12T01:44:49.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.054+0000 7fd8eeffd640 1 -- 172.21.15.60:0/4106555081 learned_addr learned my addr 172.21.15.60:0/4106555081 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:49.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.054+0000 7fd8ef7fe640 1 --2- 172.21.15.60:0/4106555081 >> v2:172.21.15.105:3300/0 conn(0x7fd8f015e750 0x7fd8f00cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8effff640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f00b6bb0 0x7fd8f00b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 532868808 0 0) 0x7fd8f00b7790 con 0x7fd8f00cfb70 2024-09-12T01:44:49.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8d8003520 con 0x7fd8f00cfb70 2024-09-12T01:44:49.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4034270211 0 0) 0x7fd8d8003520 con 0x7fd8f00cfb70 2024-09-12T01:44:49.057 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f00b6bb0 msgr2=0x7fd8f00b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f00b6bb0 0x7fd8f00b7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 >> v2:172.21.15.105:3300/0 conn(0x7fd8f015e750 msgr2=0x7fd8f00cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 --2- 172.21.15.60:0/4106555081 >> v2:172.21.15.105:3300/0 conn(0x7fd8f015e750 0x7fd8f00cf630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f00d3600 con 0x7fd8f00cfb70 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fd8e4001670 con 0x7fd8f00cfb70 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8effff640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f00b6bb0 0x7fd8f00b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 >> v1:172.21.15.60:6789/0 conn(0x7fd8f00cfb70 legacy=0x7fd8f00b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d80039b0 0x7fd8d8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f00b6bb0 0x7fd8d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d8004d40 0x7fd8d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f00d43c0 con 0x7fd8d80039b0 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f00d33b0 con 0x7fd8d8004d40 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd8d800b9c0 con 0x7fd8f00b6bb0 2024-09-12T01:44:49.058 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ef7fe640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d80039b0 0x7fd8d8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8eeffd640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f00b6bb0 0x7fd8d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8effff640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d8004d40 0x7fd8d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ef7fe640 1 -- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f00b6bb0 msgr2=0x7fd8d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:49.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ef7fe640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f00b6bb0 0x7fd8d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ef7fe640 1 -- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d8004d40 msgr2=0x7fd8d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:49.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ef7fe640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d8004d40 0x7fd8d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8ef7fe640 1 -- 172.21.15.60:0/4106555081 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d8003520 con 0x7fd8d80039b0 2024-09-12T01:44:49.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.055+0000 7fd8effff640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d8004d40 0x7fd8d80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:49.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.056+0000 7fd8ef7fe640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d80039b0 0x7fd8d8003df0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009ac0 tx=0x7fd8d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4561a95e87e79e95 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:49.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.056+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0036070 con 0x7fd8d80039b0 2024-09-12T01:44:49.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.056+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e0031400 con 0x7fd8d80039b0 2024-09-12T01:44:49.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.056+0000 7fd8ee7fc640 1 -- 172.21.15.60:0/4106555081 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0009690 con 0x7fd8d80039b0 2024-09-12T01:44:49.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.057+0000 7fd8f5d91640 1 -- 172.21.15.60:0/4106555081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d80039b0 msgr2=0x7fd8d8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:49.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.057+0000 7fd8f5d91640 1 --2- 172.21.15.60:0/4106555081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8d80039b0 0x7fd8d8003df0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009ac0 tx=0x7fd8d8005830 comp rx=0 tx=0).stop 2024-09-12T01:44:49.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.057+0000 7fd8effff640 1 -- 172.21.15.60:0/4106555081 reap_dead start 2024-09-12T01:44:49.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.057+0000 7fd8f5d91640 1 -- 172.21.15.60:0/4106555081 shutdown_connections 2024-09-12T01:44:49.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.057+0000 7fd8f5d91640 1 -- 172.21.15.60:0/4106555081 >> 172.21.15.60:0/4106555081 conn(0x7fd8f00d1500 msgr2=0x7fd8f00d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:49.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.057+0000 7fd8f5d91640 1 -- 172.21.15.60:0/4106555081 shutdown_connections 2024-09-12T01:44:49.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.057+0000 7fd8f5d91640 1 -- 172.21.15.60:0/4106555081 wait complete. 2024-09-12T01:44:49.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.058+0000 7fd8f5d91640 1 Processor -- start 2024-09-12T01:44:49.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.058+0000 7fd8f5d91640 1 -- start start 2024-09-12T01:44:49.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8f5d91640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d80039b0 0x7fd8f01f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8f5d91640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f01f8b10 0x7fd8f015b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8f5d91640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f01e44c0 0x7fd8f00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8f5d91640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f00d3bc0 con 0x7fd8f01f8b10 2024-09-12T01:44:49.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8f5d91640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f00b7ac0 con 0x7fd8d80039b0 2024-09-12T01:44:49.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8f5d91640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f015eb30 con 0x7fd8f01e44c0 2024-09-12T01:44:49.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8eeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f01f8b10 0x7fd8f015b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8eeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f01f8b10 0x7fd8f015b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55616/0 (socket says 172.21.15.60:55616) 2024-09-12T01:44:49.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8eeffd640 1 -- 172.21.15.60:0/1704604335 learned_addr learned my addr 172.21.15.60:0/1704604335 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:49.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8ef7fe640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d80039b0 0x7fd8f01f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8effff640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f01e44c0 0x7fd8f00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8eeffd640 1 -- 172.21.15.60:0/1704604335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f01e44c0 msgr2=0x7fd8f00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:49.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8eeffd640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f01e44c0 0x7fd8f00ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.064 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8eeffd640 1 -- 172.21.15.60:0/1704604335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d80039b0 msgr2=0x7fd8f01f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8eeffd640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d80039b0 0x7fd8f01f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.059+0000 7fd8eeffd640 1 -- 172.21.15.60:0/1704604335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f01e4060 con 0x7fd8f01f8b10 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.060+0000 7fd8eeffd640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f01f8b10 0x7fd8f015b0c0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4007340 tx=0x7fd8e4007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.060+0000 7fd8d7fff640 1 -- 172.21.15.60:0/1704604335 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e400f910 con 0x7fd8f01f8b10 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.060+0000 7fd8d7fff640 1 -- 172.21.15.60:0/1704604335 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e4018070 con 0x7fd8f01f8b10 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.060+0000 7fd8d7fff640 1 -- 172.21.15.60:0/1704604335 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e400fcf0 con 0x7fd8f01f8b10 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.060+0000 7fd8f5d91640 1 -- 172.21.15.60:0/1704604335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f015b600 con 0x7fd8f01f8b10 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.060+0000 7fd8f5d91640 1 -- 172.21.15.60:0/1704604335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f01f8030 con 0x7fd8f01f8b10 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.061+0000 7fd8f5d91640 1 -- 172.21.15.60:0/1704604335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f00cf630 con 0x7fd8f01f8b10 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.061+0000 7fd8d7fff640 1 -- 172.21.15.60:0/1704604335 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd8e401d460 con 0x7fd8f01f8b10 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.062+0000 7fd8d7fff640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8dc06be60 0x7fd8dc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.062+0000 7fd8d7fff640 1 -- 172.21.15.60:0/1704604335 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7fd8e408af40 con 0x7fd8f01f8b10 2024-09-12T01:44:49.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.062+0000 7fd8ef7fe640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8dc06be60 0x7fd8dc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.062+0000 7fd8ef7fe640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8dc06be60 0x7fd8dc06e320 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0033000 tx=0x7fd8e0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:49.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.066+0000 7fd8d7fff640 1 -- 172.21.15.60:0/1704604335 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fd8f01e4060 con 0x7fd8f01f8b10 2024-09-12T01:44:49.276 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.276+0000 7fd8f5d91640 1 -- 172.21.15.60:0/1704604335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd8f00d2e30 con 0x7fd8f01f8b10 2024-09-12T01:44:49.277 INFO:tasks.ceph.mon.a.smithi060.stderr:2024-09-12T01:44:49.277+0000 7f58b98dd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-12T01:44:49.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.278+0000 7fd8d7fff640 1 -- 172.21.15.60:0/1704604335 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v89) ==== 161+0+0 (secure 0 0 0) 0x7fd8e4059220 con 0x7fd8f01f8b10 2024-09-12T01:44:49.278 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-12T01:44:49.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.281+0000 7fd8f5d91640 1 -- 172.21.15.60:0/1704604335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8dc06be60 msgr2=0x7fd8dc06e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:49.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.281+0000 7fd8f5d91640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8dc06be60 0x7fd8dc06e320 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0033000 tx=0x7fd8e0008030 comp rx=0 tx=0).stop 2024-09-12T01:44:49.281 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.281+0000 7fd8f5d91640 1 -- 172.21.15.60:0/1704604335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f01f8b10 msgr2=0x7fd8f015b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:49.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.281+0000 7fd8f5d91640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f01f8b10 0x7fd8f015b0c0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4007340 tx=0x7fd8e4007800 comp rx=0 tx=0).stop 2024-09-12T01:44:49.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.281+0000 7fd8f5d91640 1 -- 172.21.15.60:0/1704604335 shutdown_connections 2024-09-12T01:44:49.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.281+0000 7fd8f5d91640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd8dc06be60 0x7fd8dc06e320 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.281+0000 7fd8f5d91640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd8f01e44c0 0x7fd8f00ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.281+0000 7fd8f5d91640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f01f8b10 0x7fd8f015b0c0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.281+0000 7fd8f5d91640 1 --2- 172.21.15.60:0/1704604335 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd8d80039b0 0x7fd8f01f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.281+0000 7fd8f5d91640 1 -- 172.21.15.60:0/1704604335 >> 172.21.15.60:0/1704604335 conn(0x7fd8f00d1500 msgr2=0x7fd8f00d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:49.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.281+0000 7fd8f5d91640 1 -- 172.21.15.60:0/1704604335 shutdown_connections 2024-09-12T01:44:49.282 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.281+0000 7fd8f5d91640 1 -- 172.21.15.60:0/1704604335 wait complete. 2024-09-12T01:44:49.283 INFO:tasks.ceph.mds.d.smithi105.stderr: -2118> 2024-09-12T01:44:36.544+0000 7f97b4c03640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-12T01:44:49.293 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-12T01:44:49.313 INFO:tasks.ceph.mds.d.smithi105.stdout:starting mds.d at 2024-09-12T01:44:49.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.397+0000 7f05e790a640 1 Processor -- start 2024-09-12T01:44:49.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.397+0000 7f05e790a640 1 -- start start 2024-09-12T01:44:49.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e790a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e015e600 0x7f05e00d1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e790a640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f05e00d1a40 0x7f05e00cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e790a640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05e00d1e60 con 0x7f05e00cf2f0 2024-09-12T01:44:49.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e790a640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f05e00cf7a0 con 0x7f05e00d1a40 2024-09-12T01:44:49.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e790a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f05e00d2ee0 con 0x7f05e015e600 2024-09-12T01:44:49.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e4ea5640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f05e00d1a40 0x7f05e00cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e56a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e015e600 0x7f05e00d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e4ea5640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f05e00d1a40 0x7f05e00cedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:59394/0 (socket says 172.21.15.60:59394) 2024-09-12T01:44:49.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e4ea5640 1 -- 172.21.15.60:0/3544726459 learned_addr learned my addr 172.21.15.60:0/3544726459 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:49.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e56a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e015e600 0x7f05e00d1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:41944/0 (socket says 172.21.15.60:41944) 2024-09-12T01:44:49.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e4ea5640 1 -- 172.21.15.60:0/3544726459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e015e600 msgr2=0x7f05e00d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:49.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e4ea5640 1 --2- 172.21.15.60:0/3544726459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e015e600 0x7f05e00d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e4ea5640 1 -- 172.21.15.60:0/3544726459 >> v1:172.21.15.105:6789/0 conn(0x7f05e00cf2f0 legacy=0x7f05e00b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:49.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e4ea5640 1 -- 172.21.15.60:0/3544726459 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e00b7ad0 con 0x7f05e00d1a40 2024-09-12T01:44:49.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.398+0000 7f05e56a6640 1 --2- 172.21.15.60:0/3544726459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e015e600 0x7f05e00d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:49.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.399+0000 7f05e4ea5640 1 --2- 172.21.15.60:0/3544726459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05e00d1a40 0x7f05e00cedb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009870 tx=0x7f05d402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae23fdf0c190478 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:49.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.399+0000 7f05d3fff640 1 -- 172.21.15.60:0/3544726459 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4037070 con 0x7f05e00d1a40 2024-09-12T01:44:49.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.399+0000 7f05d3fff640 1 -- 172.21.15.60:0/3544726459 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d4032440 con 0x7f05e00d1a40 2024-09-12T01:44:49.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.399+0000 7f05d3fff640 1 -- 172.21.15.60:0/3544726459 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4032810 con 0x7f05e00d1a40 2024-09-12T01:44:49.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.400+0000 7f05e790a640 1 -- 172.21.15.60:0/3544726459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05e00d1a40 msgr2=0x7f05e00cedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:49.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.400+0000 7f05e790a640 1 --2- 172.21.15.60:0/3544726459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05e00d1a40 0x7f05e00cedb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f05d4009870 tx=0x7f05d402a270 comp rx=0 tx=0).stop 2024-09-12T01:44:49.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.400+0000 7f05e790a640 1 -- 172.21.15.60:0/3544726459 shutdown_connections 2024-09-12T01:44:49.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.400+0000 7f05e790a640 1 --2- 172.21.15.60:0/3544726459 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05e00d1a40 0x7f05e00cedb0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.400+0000 7f05e790a640 1 --2- 172.21.15.60:0/3544726459 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e015e600 0x7f05e00d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.400+0000 7f05e790a640 1 -- 172.21.15.60:0/3544726459 >> 172.21.15.60:0/3544726459 conn(0x7f05e006c2c0 msgr2=0x7f05e006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:49.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.400+0000 7f05e790a640 1 -- 172.21.15.60:0/3544726459 shutdown_connections 2024-09-12T01:44:49.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.400+0000 7f05e790a640 1 -- 172.21.15.60:0/3544726459 wait complete. 2024-09-12T01:44:49.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.401+0000 7f05e790a640 1 Processor -- start 2024-09-12T01:44:49.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.401+0000 7f05e790a640 1 -- start start 2024-09-12T01:44:49.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.402+0000 7f05e790a640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e00cf2f0 0x7f05e014bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.402+0000 7f05e790a640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05e00d1a40 0x7f05e014c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.402+0000 7f05e790a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05e015e600 0x7f05e00cc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.402+0000 7f05e790a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f05e00cffa0 con 0x7f05e015e600 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.402+0000 7f05e790a640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f05e00cfcc0 con 0x7f05e00d1a40 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.402+0000 7f05e790a640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f05e00d2b70 con 0x7f05e00cf2f0 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.402+0000 7f05e5ea7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05e015e600 0x7f05e00cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.402+0000 7f05e5ea7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05e015e600 0x7f05e00cc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55618/0 (socket says 172.21.15.60:55618) 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.402+0000 7f05e5ea7640 1 -- 172.21.15.60:0/1839785723 learned_addr learned my addr 172.21.15.60:0/1839785723 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.402+0000 7f05e56a6640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e00cf2f0 0x7f05e014bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.402+0000 7f05e4ea5640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05e00d1a40 0x7f05e014c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05e5ea7640 1 -- 172.21.15.60:0/1839785723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e00cf2f0 msgr2=0x7f05e014bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05e5ea7640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e00cf2f0 0x7f05e014bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05e5ea7640 1 -- 172.21.15.60:0/1839785723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05e00d1a40 msgr2=0x7f05e014c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05e5ea7640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05e00d1a40 0x7f05e014c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:49.405 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05e5ea7640 1 -- 172.21.15.60:0/1839785723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e00cd3f0 con 0x7f05e015e600 2024-09-12T01:44:49.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05e56a6640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e00cf2f0 0x7f05e014bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:49.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05e4ea5640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05e00d1a40 0x7f05e014c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:49.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05e5ea7640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05e015e600 0x7f05e00cc880 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c7a0 tx=0x7f05d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:49.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05d1ffb640 1 -- 172.21.15.60:0/1839785723 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8003b70 con 0x7f05e015e600 2024-09-12T01:44:49.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05d1ffb640 1 -- 172.21.15.60:0/1839785723 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d8003d30 con 0x7f05e015e600 2024-09-12T01:44:49.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05e790a640 1 -- 172.21.15.60:0/1839785723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e00cd6d0 con 0x7f05e015e600 2024-09-12T01:44:49.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05d1ffb640 1 -- 172.21.15.60:0/1839785723 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d800aa90 con 0x7f05e015e600 2024-09-12T01:44:49.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.403+0000 7f05e790a640 1 -- 172.21.15.60:0/1839785723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e00cdc90 con 0x7f05e015e600 2024-09-12T01:44:49.406 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.404+0000 7f05e790a640 1 -- 172.21.15.60:0/1839785723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e015e9e0 con 0x7f05e015e600 2024-09-12T01:44:49.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.404+0000 7f05d1ffb640 1 -- 172.21.15.60:0/1839785723 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f05d800ac30 con 0x7f05e015e600 2024-09-12T01:44:49.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.405+0000 7f05d1ffb640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f05c406be60 0x7f05c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:49.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.405+0000 7f05d1ffb640 1 -- 172.21.15.60:0/1839785723 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5795+0+0 (secure 0 0 0) 0x7f05d808ac90 con 0x7f05e015e600 2024-09-12T01:44:49.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.405+0000 7f05e56a6640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f05c406be60 0x7f05c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:49.407 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.405+0000 7f05e56a6640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f05c406be60 0x7f05c406e320 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009560 tx=0x7f05dc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:49.409 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.409+0000 7f05d1ffb640 1 -- 172.21.15.60:0/1839785723 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f05d8058f90 con 0x7f05e015e600 2024-09-12T01:44:49.482 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:44:49.485 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:44:49.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:49.624+0000 7f05e790a640 1 -- 172.21.15.60:0/1839785723 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f05e00d25f0 con 0x7f05e015e600 2024-09-12T01:44:50.280 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.280+0000 7f05d1ffb640 1 -- 172.21.15.60:0/1839785723 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v90) ==== 104+0+0 (secure 0 0 0) 0x7f05d805d290 con 0x7f05e015e600 2024-09-12T01:44:50.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.283+0000 7f05e790a640 1 -- 172.21.15.60:0/1839785723 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f05c406be60 msgr2=0x7f05c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:50.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.283+0000 7f05e790a640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f05c406be60 0x7f05c406e320 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009560 tx=0x7f05dc009190 comp rx=0 tx=0).stop 2024-09-12T01:44:50.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.283+0000 7f05e790a640 1 -- 172.21.15.60:0/1839785723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05e015e600 msgr2=0x7f05e00cc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:50.283 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.283+0000 7f05e790a640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05e015e600 0x7f05e00cc880 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c7a0 tx=0x7f05d800cc60 comp rx=0 tx=0).stop 2024-09-12T01:44:50.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.283+0000 7f05e790a640 1 -- 172.21.15.60:0/1839785723 shutdown_connections 2024-09-12T01:44:50.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.283+0000 7f05e790a640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f05e015e600 0x7f05e00cc880 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:50.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.283+0000 7f05e790a640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f05e00d1a40 0x7f05e014c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:50.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.283+0000 7f05e790a640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f05c406be60 0x7f05c406e320 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:50.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.283+0000 7f05e790a640 1 --2- 172.21.15.60:0/1839785723 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f05e00cf2f0 0x7f05e014bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:50.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.283+0000 7f05e790a640 1 -- 172.21.15.60:0/1839785723 >> 172.21.15.60:0/1839785723 conn(0x7f05e006c2c0 msgr2=0x7f05e015ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:50.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.283+0000 7f05e790a640 1 -- 172.21.15.60:0/1839785723 shutdown_connections 2024-09-12T01:44:50.284 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.283+0000 7f05e790a640 1 -- 172.21.15.60:0/1839785723 wait complete. 2024-09-12T01:44:50.297 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-12T01:44:50.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.410+0000 7fcf1ec65640 1 Processor -- start 2024-09-12T01:44:50.411 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.410+0000 7fcf1ec65640 1 -- start start 2024-09-12T01:44:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.411+0000 7fcf1ec65640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcf1815e970 0x7fcf180b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.411+0000 7fcf1ec65640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf180d1cd0 0x7fcf180b6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.411+0000 7fcf1ec65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf18162430 0x7fcf181628c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.411+0000 7fcf1ec65640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcf180cf7c0 con 0x7fcf180d1cd0 2024-09-12T01:44:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.411+0000 7fcf1ec65640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fcf180d2560 con 0x7fcf1815e970 2024-09-12T01:44:50.412 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.411+0000 7fcf1ec65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcf1815ed50 con 0x7fcf18162430 2024-09-12T01:44:50.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.411+0000 7fcf17fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf180d1cd0 0x7fcf180b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:50.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.411+0000 7fcf17fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf180d1cd0 0x7fcf180b6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55620/0 (socket says 172.21.15.60:55620) 2024-09-12T01:44:50.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.411+0000 7fcf17fff640 1 -- 172.21.15.60:0/3510753998 learned_addr learned my addr 172.21.15.60:0/3510753998 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:50.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.411+0000 7fcf1d202640 1 --2- 172.21.15.60:0/3510753998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf18162430 0x7fcf181628c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:50.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.412+0000 7fcf1ca01640 1 --2- 172.21.15.60:0/3510753998 >> v2:172.21.15.105:3300/0 conn(0x7fcf1815e970 0x7fcf180b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:50.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.412+0000 7fcf17fff640 1 -- 172.21.15.60:0/3510753998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf18162430 msgr2=0x7fcf181628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:50.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.412+0000 7fcf17fff640 1 --2- 172.21.15.60:0/3510753998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf18162430 0x7fcf181628c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:50.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.412+0000 7fcf17fff640 1 -- 172.21.15.60:0/3510753998 >> v2:172.21.15.105:3300/0 conn(0x7fcf1815e970 msgr2=0x7fcf180b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:50.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.412+0000 7fcf17fff640 1 --2- 172.21.15.60:0/3510753998 >> v2:172.21.15.105:3300/0 conn(0x7fcf1815e970 0x7fcf180b61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:50.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.412+0000 7fcf17fff640 1 -- 172.21.15.60:0/3510753998 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf180cffd0 con 0x7fcf180d1cd0 2024-09-12T01:44:50.413 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.412+0000 7fcf1ca01640 1 --2- 172.21.15.60:0/3510753998 >> v2:172.21.15.105:3300/0 conn(0x7fcf1815e970 0x7fcf180b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:50.414 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.412+0000 7fcf17fff640 1 --2- 172.21.15.60:0/3510753998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf180d1cd0 0x7fcf180b6720 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fcf180501f0 tx=0x7fcf0c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29eea9d83fe74ebf server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.413+0000 7fcf177fe640 1 -- 172.21.15.60:0/3510753998 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c037070 con 0x7fcf180d1cd0 2024-09-12T01:44:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.413+0000 7fcf177fe640 1 -- 172.21.15.60:0/3510753998 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf0c032440 con 0x7fcf180d1cd0 2024-09-12T01:44:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.413+0000 7fcf177fe640 1 -- 172.21.15.60:0/3510753998 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c032810 con 0x7fcf180d1cd0 2024-09-12T01:44:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.413+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3510753998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf180d1cd0 msgr2=0x7fcf180b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.413+0000 7fcf1ec65640 1 --2- 172.21.15.60:0/3510753998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf180d1cd0 0x7fcf180b6720 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fcf180501f0 tx=0x7fcf0c02a140 comp rx=0 tx=0).stop 2024-09-12T01:44:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.413+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3510753998 shutdown_connections 2024-09-12T01:44:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.413+0000 7fcf1ec65640 1 --2- 172.21.15.60:0/3510753998 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf18162430 0x7fcf181628c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.413+0000 7fcf1ec65640 1 --2- 172.21.15.60:0/3510753998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf180d1cd0 0x7fcf180b6720 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.413+0000 7fcf1ec65640 1 --2- 172.21.15.60:0/3510753998 >> v2:172.21.15.105:3300/0 conn(0x7fcf1815e970 0x7fcf180b61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.413+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3510753998 >> 172.21.15.60:0/3510753998 conn(0x7fcf180d11e0 msgr2=0x7fcf180d15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.413+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3510753998 shutdown_connections 2024-09-12T01:44:50.415 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.413+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3510753998 wait complete. 2024-09-12T01:44:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.415+0000 7fcf1ec65640 1 Processor -- start 2024-09-12T01:44:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.415+0000 7fcf1ec65640 1 -- start start 2024-09-12T01:44:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.415+0000 7fcf1ec65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf180d1cd0 0x7fcf18157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ec65640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf1815e970 0x7fcf181f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ec65640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf18162430 0x7fcf18160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ec65640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcf1806d9a0 con 0x7fcf180d1cd0 2024-09-12T01:44:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ec65640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcf180cfcf0 con 0x7fcf18162430 2024-09-12T01:44:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ec65640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcf1806db20 con 0x7fcf1815e970 2024-09-12T01:44:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ca01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf180d1cd0 0x7fcf18157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:50.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ca01640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf180d1cd0 0x7fcf18157fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55634/0 (socket says 172.21.15.60:55634) 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ca01640 1 -- 172.21.15.60:0/3734532415 learned_addr learned my addr 172.21.15.60:0/3734532415 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1d202640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf18162430 0x7fcf18160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf17fff640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf1815e970 0x7fcf181f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ca01640 1 -- 172.21.15.60:0/3734532415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf1815e970 msgr2=0x7fcf181f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ca01640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf1815e970 0x7fcf181f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ca01640 1 -- 172.21.15.60:0/3734532415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf18162430 msgr2=0x7fcf18160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ca01640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf18162430 0x7fcf18160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ca01640 1 -- 172.21.15.60:0/3734532415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf181f5390 con 0x7fcf180d1cd0 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf17fff640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf1815e970 0x7fcf181f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1d202640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf18162430 0x7fcf18160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ca01640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf180d1cd0 0x7fcf18157fc0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800c7c0 tx=0x7fcf0800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf157fa640 1 -- 172.21.15.60:0/3734532415 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08015070 con 0x7fcf180d1cd0 2024-09-12T01:44:50.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf157fa640 1 -- 172.21.15.60:0/3734532415 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf08007a30 con 0x7fcf180d1cd0 2024-09-12T01:44:50.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3734532415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf181f5670 con 0x7fcf180d1cd0 2024-09-12T01:44:50.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf157fa640 1 -- 172.21.15.60:0/3734532415 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf08007e00 con 0x7fcf180d1cd0 2024-09-12T01:44:50.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.416+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3734532415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf181f5c30 con 0x7fcf180d1cd0 2024-09-12T01:44:50.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.417+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3734532415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf180b3920 con 0x7fcf180d1cd0 2024-09-12T01:44:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.418+0000 7fcf157fa640 1 -- 172.21.15.60:0/3734532415 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcf08018070 con 0x7fcf180d1cd0 2024-09-12T01:44:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.418+0000 7fcf157fa640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcf0406be30 0x7fcf0406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.418+0000 7fcf157fa640 1 -- 172.21.15.60:0/3734532415 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5795+0+0 (secure 0 0 0) 0x7fcf0808ad90 con 0x7fcf180d1cd0 2024-09-12T01:44:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.419+0000 7fcf17fff640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcf0406be30 0x7fcf0406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.419+0000 7fcf17fff640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcf0406be30 0x7fcf0406e2f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c034000 tx=0x7fcf0c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:50.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.423+0000 7fcf157fa640 1 -- 172.21.15.60:0/3734532415 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcf08059770 con 0x7fcf180d1cd0 2024-09-12T01:44:50.600 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:50.599+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3734532415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcf1815e200 con 0x7fcf180d1cd0 2024-09-12T01:44:51.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.284+0000 7fcf157fa640 1 -- 172.21.15.60:0/3734532415 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v141) ==== 181+0+0 (secure 0 0 0) 0x7fcf08059070 con 0x7fcf180d1cd0 2024-09-12T01:44:51.285 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2024-09-12T01:44:51.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.288+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3734532415 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcf0406be30 msgr2=0x7fcf0406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:51.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.288+0000 7fcf1ec65640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcf0406be30 0x7fcf0406e2f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c034000 tx=0x7fcf0c02e000 comp rx=0 tx=0).stop 2024-09-12T01:44:51.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.288+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3734532415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf180d1cd0 msgr2=0x7fcf18157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:51.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.288+0000 7fcf1ec65640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf180d1cd0 0x7fcf18157fc0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800c7c0 tx=0x7fcf0800cc80 comp rx=0 tx=0).stop 2024-09-12T01:44:51.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.288+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3734532415 shutdown_connections 2024-09-12T01:44:51.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.288+0000 7fcf1ec65640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcf18162430 0x7fcf18160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:51.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.288+0000 7fcf1ec65640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcf0406be30 0x7fcf0406e2f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:51.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.288+0000 7fcf1ec65640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcf1815e970 0x7fcf181f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:51.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.288+0000 7fcf1ec65640 1 --2- 172.21.15.60:0/3734532415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf180d1cd0 0x7fcf18157fc0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:51.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.288+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3734532415 >> 172.21.15.60:0/3734532415 conn(0x7fcf180d11e0 msgr2=0x7fcf180b81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:51.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.288+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3734532415 shutdown_connections 2024-09-12T01:44:51.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.288+0000 7fcf1ec65640 1 -- 172.21.15.60:0/3734532415 wait complete. 2024-09-12T01:44:51.305 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-12T01:44:51.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.417+0000 7f7417de4640 1 Processor -- start 2024-09-12T01:44:51.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.417+0000 7f7417de4640 1 -- start start 2024-09-12T01:44:51.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.418+0000 7f7417de4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f741015c2a0 0x7f74100735d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:51.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.418+0000 7f7417de4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7410074120 con 0x7f7410073b10 2024-09-12T01:44:51.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.418+0000 7f7417de4640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f741015ef00 con 0x7f741006fe20 2024-09-12T01:44:51.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.418+0000 7f7417de4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f741015c680 con 0x7f741015c2a0 2024-09-12T01:44:51.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.418+0000 7f741537f640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7410073b10 0x7f741006f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45904/0 (socket says 172.21.15.60:45904) 2024-09-12T01:44:51.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.418+0000 7f741537f640 1 -- 172.21.15.60:0/377759550 learned_addr learned my addr 172.21.15.60:0/377759550 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:51.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.418+0000 7f7415b80640 1 --2- 172.21.15.60:0/377759550 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f741015c2a0 0x7f74100735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:51.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.419+0000 7f7414b7e640 1 -- 172.21.15.60:0/377759550 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645978409 0 0) 0x7f7410074120 con 0x7f7410073b10 2024-09-12T01:44:51.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.419+0000 7f7414b7e640 1 -- 172.21.15.60:0/377759550 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73f8003520 con 0x7f7410073b10 2024-09-12T01:44:51.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.419+0000 7f7414b7e640 1 -- 172.21.15.60:0/377759550 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3520384120 0 0) 0x7f741015ef00 con 0x7f741006fe20 2024-09-12T01:44:51.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.419+0000 7f7415b80640 1 -- 172.21.15.60:0/377759550 >> v1:172.21.15.105:6789/0 conn(0x7f741006fe20 legacy=0x7f741006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:51.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.419+0000 7f7415b80640 1 -- 172.21.15.60:0/377759550 >> v1:172.21.15.60:6789/0 conn(0x7f7410073b10 legacy=0x7f741006f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:51.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.419+0000 7f7415b80640 1 -- 172.21.15.60:0/377759550 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741015f1e0 con 0x7f741015c2a0 2024-09-12T01:44:51.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.420+0000 7f7415b80640 1 --2- 172.21.15.60:0/377759550 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f741015c2a0 0x7f74100735d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7400009dc0 tx=0x7f740002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbd60e1e751d11e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:51.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.420+0000 7f7414b7e640 1 -- 172.21.15.60:0/377759550 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7400035020 con 0x7f741015c2a0 2024-09-12T01:44:51.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.420+0000 7f7414b7e640 1 -- 172.21.15.60:0/377759550 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7400007540 con 0x7f741015c2a0 2024-09-12T01:44:51.422 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.420+0000 7f7414b7e640 1 -- 172.21.15.60:0/377759550 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7404001670 con 0x7f741015c2a0 2024-09-12T01:44:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.420+0000 7f7417de4640 1 -- 172.21.15.60:0/377759550 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f741015c2a0 msgr2=0x7f74100735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.420+0000 7f7417de4640 1 --2- 172.21.15.60:0/377759550 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f741015c2a0 0x7f74100735d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7400009dc0 tx=0x7f740002a640 comp rx=0 tx=0).stop 2024-09-12T01:44:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.420+0000 7f7417de4640 1 -- 172.21.15.60:0/377759550 shutdown_connections 2024-09-12T01:44:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.420+0000 7f7417de4640 1 --2- 172.21.15.60:0/377759550 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f741015c2a0 0x7f74100735d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.420+0000 7f7417de4640 1 -- 172.21.15.60:0/377759550 >> 172.21.15.60:0/377759550 conn(0x7f74100b3070 msgr2=0x7f74100b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.420+0000 7f7417de4640 1 -- 172.21.15.60:0/377759550 shutdown_connections 2024-09-12T01:44:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.420+0000 7f7417de4640 1 -- 172.21.15.60:0/377759550 wait complete. 2024-09-12T01:44:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.422+0000 7f7417de4640 1 Processor -- start 2024-09-12T01:44:51.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.422+0000 7f7417de4640 1 -- start start 2024-09-12T01:44:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.422+0000 7f7417de4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f741006fe20 0x7f741015b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.422+0000 7f7417de4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7410073b10 0x7f7410157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.422+0000 7f7417de4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f741015c2a0 0x7f741015fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.422+0000 7f7417de4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f74100b5f20 con 0x7f741006fe20 2024-09-12T01:44:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.422+0000 7f7417de4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f741015ebf0 con 0x7f7410073b10 2024-09-12T01:44:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.422+0000 7f7417de4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f74100b60a0 con 0x7f741015c2a0 2024-09-12T01:44:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f7415b80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f741006fe20 0x7f741015b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f7415b80640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f741006fe20 0x7f741015b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55640/0 (socket says 172.21.15.60:55640) 2024-09-12T01:44:51.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f7415b80640 1 -- 172.21.15.60:0/1577102217 learned_addr learned my addr 172.21.15.60:0/1577102217 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f741537f640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7410073b10 0x7f7410157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f7416381640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f741015c2a0 0x7f741015fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f7415b80640 1 -- 172.21.15.60:0/1577102217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f741015c2a0 msgr2=0x7f741015fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f7415b80640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f741015c2a0 0x7f741015fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f7415b80640 1 -- 172.21.15.60:0/1577102217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7410073b10 msgr2=0x7f7410157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f7415b80640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7410073b10 0x7f7410157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f7415b80640 1 -- 172.21.15.60:0/1577102217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7410159970 con 0x7f741006fe20 2024-09-12T01:44:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f741537f640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7410073b10 0x7f7410157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f7415b80640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f741006fe20 0x7f741015b520 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f7400034040 tx=0x7f7400004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f740e7fc640 1 -- 172.21.15.60:0/1577102217 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f740003e030 con 0x7f741006fe20 2024-09-12T01:44:51.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f740e7fc640 1 -- 172.21.15.60:0/1577102217 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7400007e20 con 0x7f741006fe20 2024-09-12T01:44:51.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f7417de4640 1 -- 172.21.15.60:0/1577102217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7410159c50 con 0x7f741006fe20 2024-09-12T01:44:51.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f740e7fc640 1 -- 172.21.15.60:0/1577102217 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7400035040 con 0x7f741006fe20 2024-09-12T01:44:51.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.423+0000 7f7417de4640 1 -- 172.21.15.60:0/1577102217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f741014fb80 con 0x7f741006fe20 2024-09-12T01:44:51.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.424+0000 7f7417de4640 1 -- 172.21.15.60:0/1577102217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74100731b0 con 0x7f741006fe20 2024-09-12T01:44:51.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.425+0000 7f740e7fc640 1 -- 172.21.15.60:0/1577102217 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f7400041030 con 0x7f741006fe20 2024-09-12T01:44:51.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.425+0000 7f740e7fc640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f73fc06be30 0x7f73fc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:51.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.425+0000 7f740e7fc640 1 -- 172.21.15.60:0/1577102217 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5357+0+0 (secure 0 0 0) 0x7f74000ab710 con 0x7f741006fe20 2024-09-12T01:44:51.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.425+0000 7f741537f640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f73fc06be30 0x7f73fc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:51.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.426+0000 7f741537f640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f73fc06be30 0x7f73fc06e2f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7404001560 tx=0x7f7404009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:51.430 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.429+0000 7f740e7fc640 1 -- 172.21.15.60:0/1577102217 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f74100731b0 con 0x7f741006fe20 2024-09-12T01:44:51.605 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:51.605+0000 7f7417de4640 1 -- 172.21.15.60:0/1577102217 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f741015fa70 con 0x7f741006fe20 2024-09-12T01:44:52.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.285+0000 7f740e7fc640 1 -- 172.21.15.60:0/1577102217 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v142) ==== 169+0+0 (secure 0 0 0) 0x7f740007a190 con 0x7f741006fe20 2024-09-12T01:44:52.286 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2024-09-12T01:44:52.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.289+0000 7f7417de4640 1 -- 172.21.15.60:0/1577102217 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f73fc06be30 msgr2=0x7f73fc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.289+0000 7f7417de4640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f73fc06be30 0x7f73fc06e2f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7404001560 tx=0x7f7404009040 comp rx=0 tx=0).stop 2024-09-12T01:44:52.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.289+0000 7f7417de4640 1 -- 172.21.15.60:0/1577102217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f741006fe20 msgr2=0x7f741015b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.289+0000 7f7417de4640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f741006fe20 0x7f741015b520 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f7400034040 tx=0x7f7400004a40 comp rx=0 tx=0).stop 2024-09-12T01:44:52.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.290+0000 7f7417de4640 1 -- 172.21.15.60:0/1577102217 shutdown_connections 2024-09-12T01:44:52.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.290+0000 7f7417de4640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f73fc06be30 0x7f73fc06e2f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.290+0000 7f7417de4640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f741015c2a0 0x7f741015fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.290+0000 7f7417de4640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7410073b10 0x7f7410157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.294 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.290+0000 7f7417de4640 1 --2- 172.21.15.60:0/1577102217 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f741006fe20 0x7f741015b520 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.290+0000 7f7417de4640 1 -- 172.21.15.60:0/1577102217 >> 172.21.15.60:0/1577102217 conn(0x7f74100b3070 msgr2=0x7f74100b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.290+0000 7f7417de4640 1 -- 172.21.15.60:0/1577102217 shutdown_connections 2024-09-12T01:44:52.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.290+0000 7f7417de4640 1 -- 172.21.15.60:0/1577102217 wait complete. 2024-09-12T01:44:52.305 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-12T01:44:52.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.415+0000 7f4aade1e640 1 Processor -- start 2024-09-12T01:44:52.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.415+0000 7f4aade1e640 1 -- start start 2024-09-12T01:44:52.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.416+0000 7f4aade1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa80b54d0 0x7f4aa806fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.416+0000 7f4aade1e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aa806e990 con 0x7f4aa815e6f0 2024-09-12T01:44:52.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.416+0000 7f4aade1e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aa806ec70 con 0x7f4aa80b7450 2024-09-12T01:44:52.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.416+0000 7f4aade1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa815ec70 con 0x7f4aa80b54d0 2024-09-12T01:44:52.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.416+0000 7f4aa77fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4aa815e6f0 0x7f4aa80b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45910/0 (socket says 172.21.15.60:45910) 2024-09-12T01:44:52.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.416+0000 7f4aa77fe640 1 -- 172.21.15.60:0/2010833476 learned_addr learned my addr 172.21.15.60:0/2010833476 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa6ffd640 1 --2- 172.21.15.60:0/2010833476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa80b54d0 0x7f4aa806fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738028938 0 0) 0x7f4aa806e990 con 0x7f4aa815e6f0 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a90003520 con 0x7f4aa815e6f0 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1073100755 0 0) 0x7f4a90003520 con 0x7f4aa815e6f0 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa80b54d0 msgr2=0x7f4aa806fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 --2- 172.21.15.60:0/2010833476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa80b54d0 0x7f4aa806fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 >> v1:172.21.15.105:6789/0 conn(0x7f4aa80b7450 legacy=0x7f4aa8070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa815ef50 con 0x7f4aa815e6f0 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f4a98001670 con 0x7f4aa815e6f0 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 >> v1:172.21.15.60:6789/0 conn(0x7f4aa815e6f0 legacy=0x7f4aa80b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 --2- 172.21.15.60:0/2010833476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a900039e0 0x7f4a90003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 --2- 172.21.15.60:0/2010833476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa80b54d0 0x7f4a90004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 --2- 172.21.15.60:0/2010833476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a90004d40 0x7f4a900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa815ec70 con 0x7f4a90004d40 2024-09-12T01:44:52.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9000ba70 con 0x7f4a900039e0 2024-09-12T01:44:52.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9000bc70 con 0x7f4aa80b54d0 2024-09-12T01:44:52.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa7fff640 1 --2- 172.21.15.60:0/2010833476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a90004d40 0x7f4a900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa77fe640 1 --2- 172.21.15.60:0/2010833476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a900039e0 0x7f4a90003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.417+0000 7f4aa6ffd640 1 --2- 172.21.15.60:0/2010833476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa80b54d0 0x7f4a90004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.418+0000 7f4aa7fff640 1 -- 172.21.15.60:0/2010833476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa80b54d0 msgr2=0x7f4a90004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:52.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.418+0000 7f4aa7fff640 1 --2- 172.21.15.60:0/2010833476 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa80b54d0 0x7f4a90004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.418+0000 7f4aa7fff640 1 -- 172.21.15.60:0/2010833476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a900039e0 msgr2=0x7f4a90003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:52.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.418+0000 7f4aa7fff640 1 --2- 172.21.15.60:0/2010833476 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4a900039e0 0x7f4a90003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.420 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.418+0000 7f4aa7fff640 1 -- 172.21.15.60:0/2010833476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a90003520 con 0x7f4a90004d40 2024-09-12T01:44:52.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.418+0000 7f4aa7fff640 1 --2- 172.21.15.60:0/2010833476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a90004d40 0x7f4a900051c0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0001e20 tx=0x7f4a90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f44f8e8b550449d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:52.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.418+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0001a70 con 0x7f4a90004d40 2024-09-12T01:44:52.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.418+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aa002ae40 con 0x7f4a90004d40 2024-09-12T01:44:52.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.418+0000 7f4aa67fc640 1 -- 172.21.15.60:0/2010833476 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0003bb0 con 0x7f4a90004d40 2024-09-12T01:44:52.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.419+0000 7f4aade1e640 1 -- 172.21.15.60:0/2010833476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a90004d40 msgr2=0x7f4a900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.419+0000 7f4aade1e640 1 --2- 172.21.15.60:0/2010833476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a90004d40 0x7f4a900051c0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0001e20 tx=0x7f4a90005830 comp rx=0 tx=0).stop 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.419+0000 7f4aa7fff640 1 -- 172.21.15.60:0/2010833476 reap_dead start 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.419+0000 7f4aade1e640 1 -- 172.21.15.60:0/2010833476 shutdown_connections 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.419+0000 7f4aade1e640 1 -- 172.21.15.60:0/2010833476 >> 172.21.15.60:0/2010833476 conn(0x7f4aa80d2430 msgr2=0x7f4aa80d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.419+0000 7f4aade1e640 1 -- 172.21.15.60:0/2010833476 shutdown_connections 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.419+0000 7f4aade1e640 1 -- 172.21.15.60:0/2010833476 wait complete. 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.420+0000 7f4aade1e640 1 Processor -- start 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.420+0000 7f4aade1e640 1 -- start start 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.421+0000 7f4aade1e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4aa81538b0 0x7f4aa81f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.421+0000 7f4aade1e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa81f4be0 0x7f4aa815a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.421+0000 7f4aade1e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa815ad30 0x7f4aa81609a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.421+0000 7f4aade1e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa806e730 con 0x7f4aa81f4be0 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.421+0000 7f4aade1e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa806e5b0 con 0x7f4aa81538b0 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.421+0000 7f4aade1e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4aa806fd00 con 0x7f4aa815ad30 2024-09-12T01:44:52.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.421+0000 7f4aa6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa81f4be0 0x7f4aa815a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.421+0000 7f4aa6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa81f4be0 0x7f4aa815a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:55666/0 (socket says 172.21.15.60:55666) 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.421+0000 7f4aa6ffd640 1 -- 172.21.15.60:0/2104333584 learned_addr learned my addr 172.21.15.60:0/2104333584 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.421+0000 7f4aa77fe640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4aa81538b0 0x7f4aa81f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.421+0000 7f4aa7fff640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa815ad30 0x7f4aa81609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.422+0000 7f4aa6ffd640 1 -- 172.21.15.60:0/2104333584 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa815ad30 msgr2=0x7f4aa81609a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.422+0000 7f4aa6ffd640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa815ad30 0x7f4aa81609a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.422+0000 7f4aa6ffd640 1 -- 172.21.15.60:0/2104333584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4aa81538b0 msgr2=0x7f4aa81f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.422+0000 7f4aa6ffd640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4aa81538b0 0x7f4aa81f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.422+0000 7f4aa6ffd640 1 -- 172.21.15.60:0/2104333584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa8159a30 con 0x7f4aa81f4be0 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.422+0000 7f4aa77fe640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4aa81538b0 0x7f4aa81f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.422+0000 7f4aa6ffd640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa81f4be0 0x7f4aa815a7f0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c011910 tx=0x7f4a9c011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.422+0000 7f4a8ffff640 1 -- 172.21.15.60:0/2104333584 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c00faf0 con 0x7f4aa81f4be0 2024-09-12T01:44:52.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.422+0000 7f4a8ffff640 1 -- 172.21.15.60:0/2104333584 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9c00fc90 con 0x7f4aa81f4be0 2024-09-12T01:44:52.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.422+0000 7f4aade1e640 1 -- 172.21.15.60:0/2104333584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa8159d10 con 0x7f4aa81f4be0 2024-09-12T01:44:52.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.422+0000 7f4a8ffff640 1 -- 172.21.15.60:0/2104333584 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c014440 con 0x7f4aa81f4be0 2024-09-12T01:44:52.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.422+0000 7f4aade1e640 1 -- 172.21.15.60:0/2104333584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa815a2d0 con 0x7f4aa81f4be0 2024-09-12T01:44:52.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.423+0000 7f4aade1e640 1 -- 172.21.15.60:0/2104333584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aa806c6c0 con 0x7f4aa81f4be0 2024-09-12T01:44:52.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.423+0000 7f4a8ffff640 1 -- 172.21.15.60:0/2104333584 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4a9c012040 con 0x7f4aa81f4be0 2024-09-12T01:44:52.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.424+0000 7f4a8ffff640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4a9406be60 0x7f4a9406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.424+0000 7f4a8ffff640 1 -- 172.21.15.60:0/2104333584 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f4a9c08b210 con 0x7f4aa81f4be0 2024-09-12T01:44:52.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.424+0000 7f4aa77fe640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4a9406be60 0x7f4a9406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.427 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.424+0000 7f4aa77fe640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4a9406be60 0x7f4a9406e320 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4a98004840 tx=0x7f4a98009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:52.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.428+0000 7f4a8ffff640 1 -- 172.21.15.60:0/2104333584 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4a9c019030 con 0x7f4aa81f4be0 2024-09-12T01:44:52.615 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.614+0000 7f4aade1e640 1 -- 172.21.15.60:0/2104333584 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f4aa806e290 con 0x7f4aa81f4be0 2024-09-12T01:44:52.616 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.616+0000 7f4a8ffff640 1 -- 172.21.15.60:0/2104333584 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v67) ==== 104+0+0 (secure 0 0 0) 0x7f4a9c059870 con 0x7f4aa81f4be0 2024-09-12T01:44:52.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.618+0000 7f4aade1e640 1 -- 172.21.15.60:0/2104333584 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4a9406be60 msgr2=0x7f4a9406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.618+0000 7f4aade1e640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4a9406be60 0x7f4a9406e320 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f4a98004840 tx=0x7f4a98009040 comp rx=0 tx=0).stop 2024-09-12T01:44:52.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.618+0000 7f4aade1e640 1 -- 172.21.15.60:0/2104333584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa81f4be0 msgr2=0x7f4aa815a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.618+0000 7f4aade1e640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa81f4be0 0x7f4aa815a7f0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c011910 tx=0x7f4a9c011dd0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.618+0000 7f4aade1e640 1 -- 172.21.15.60:0/2104333584 shutdown_connections 2024-09-12T01:44:52.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.618+0000 7f4aade1e640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4a9406be60 0x7f4a9406e320 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.618+0000 7f4aade1e640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4aa815ad30 0x7f4aa81609a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.618+0000 7f4aade1e640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa81f4be0 0x7f4aa815a7f0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.618+0000 7f4aade1e640 1 --2- 172.21.15.60:0/2104333584 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4aa81538b0 0x7f4aa81f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.618+0000 7f4aade1e640 1 -- 172.21.15.60:0/2104333584 >> 172.21.15.60:0/2104333584 conn(0x7f4aa80d2430 msgr2=0x7f4aa806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:52.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.618+0000 7f4aade1e640 1 -- 172.21.15.60:0/2104333584 shutdown_connections 2024-09-12T01:44:52.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.618+0000 7f4aade1e640 1 -- 172.21.15.60:0/2104333584 wait complete. 2024-09-12T01:44:52.630 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug' 2024-09-12T01:44:52.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.733+0000 7fa95632c640 1 Processor -- start 2024-09-12T01:44:52.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.733+0000 7fa95632c640 1 -- start start 2024-09-12T01:44:52.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa95632c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa95015c470 0x7fa9500b3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa95632c640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa9500b3c50 0x7fa9500cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa95632c640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa95015c850 con 0x7fa9500cf8b0 2024-09-12T01:44:52.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa95632c640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa9500b4160 con 0x7fa95015c470 2024-09-12T01:44:52.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa95632c640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa9500b4440 con 0x7fa9500b3c50 2024-09-12T01:44:52.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa94ffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa95015c470 0x7fa9500b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa9548c9640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa9500cf8b0 0x7fa95015ffa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35496/0 (socket says 172.21.15.60:35496) 2024-09-12T01:44:52.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa9548c9640 1 -- 172.21.15.60:0/2624810577 learned_addr learned my addr 172.21.15.60:0/2624810577 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:52.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa94f7fe640 1 --2- 172.21.15.60:0/2624810577 >> v2:172.21.15.105:3300/0 conn(0x7fa9500b3c50 0x7fa9500cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa94ffff640 1 -- 172.21.15.60:0/2624810577 >> v2:172.21.15.105:3300/0 conn(0x7fa9500b3c50 msgr2=0x7fa9500cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:52.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa94ffff640 1 --2- 172.21.15.60:0/2624810577 >> v2:172.21.15.105:3300/0 conn(0x7fa9500b3c50 0x7fa9500cf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa94ffff640 1 -- 172.21.15.60:0/2624810577 >> v1:172.21.15.60:6789/0 conn(0x7fa9500cf8b0 legacy=0x7fa95015ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa94ffff640 1 -- 172.21.15.60:0/2624810577 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9500b4720 con 0x7fa95015c470 2024-09-12T01:44:52.736 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.734+0000 7fa94effd640 1 -- 172.21.15.60:0/2624810577 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2558214440 0 0) 0x7fa95015c850 con 0x7fa9500cf8b0 2024-09-12T01:44:52.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.735+0000 7fa94ffff640 1 --2- 172.21.15.60:0/2624810577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa95015c470 0x7fa9500b3710 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa9400097a0 tx=0x7fa94002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24709b30282be83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:52.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.735+0000 7fa94effd640 1 -- 172.21.15.60:0/2624810577 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa940037070 con 0x7fa95015c470 2024-09-12T01:44:52.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.735+0000 7fa94effd640 1 -- 172.21.15.60:0/2624810577 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa940032440 con 0x7fa95015c470 2024-09-12T01:44:52.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.735+0000 7fa94effd640 1 -- 172.21.15.60:0/2624810577 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa940032810 con 0x7fa95015c470 2024-09-12T01:44:52.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.736+0000 7fa95632c640 1 -- 172.21.15.60:0/2624810577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa95015c470 msgr2=0x7fa9500b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.736+0000 7fa95632c640 1 --2- 172.21.15.60:0/2624810577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa95015c470 0x7fa9500b3710 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fa9400097a0 tx=0x7fa94002a1e0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.736+0000 7fa95632c640 1 -- 172.21.15.60:0/2624810577 shutdown_connections 2024-09-12T01:44:52.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.736+0000 7fa95632c640 1 --2- 172.21.15.60:0/2624810577 >> v2:172.21.15.105:3300/0 conn(0x7fa9500b3c50 0x7fa9500cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.736+0000 7fa95632c640 1 --2- 172.21.15.60:0/2624810577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa95015c470 0x7fa9500b3710 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.736+0000 7fa95632c640 1 -- 172.21.15.60:0/2624810577 >> 172.21.15.60:0/2624810577 conn(0x7fa95006bc10 msgr2=0x7fa95006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:52.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.736+0000 7fa95632c640 1 -- 172.21.15.60:0/2624810577 shutdown_connections 2024-09-12T01:44:52.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.736+0000 7fa95632c640 1 -- 172.21.15.60:0/2624810577 wait complete. 2024-09-12T01:44:52.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.737+0000 7fa95632c640 1 Processor -- start 2024-09-12T01:44:52.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.737+0000 7fa95632c640 1 -- start start 2024-09-12T01:44:52.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa95632c640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9500b3c50 0x7fa950145ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa95632c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9500cf8b0 0x7fa95006ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa95632c640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa95015c470 0x7fa95006d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa95632c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa95006e1b0 con 0x7fa9500cf8b0 2024-09-12T01:44:52.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa95632c640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa9500b4d90 con 0x7fa95015c470 2024-09-12T01:44:52.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa95632c640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa9500b62c0 con 0x7fa9500b3c50 2024-09-12T01:44:52.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa94f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9500cf8b0 0x7fa95006ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa94f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9500cf8b0 0x7fa95006ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52178/0 (socket says 172.21.15.60:52178) 2024-09-12T01:44:52.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa94f7fe640 1 -- 172.21.15.60:0/480618501 learned_addr learned my addr 172.21.15.60:0/480618501 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:52.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa9548c9640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa95015c470 0x7fa95006d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa94ffff640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9500b3c50 0x7fa950145ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa94f7fe640 1 -- 172.21.15.60:0/480618501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9500b3c50 msgr2=0x7fa950145ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa94f7fe640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9500b3c50 0x7fa950145ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa94f7fe640 1 -- 172.21.15.60:0/480618501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa95015c470 msgr2=0x7fa95006d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:52.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa94f7fe640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa95015c470 0x7fa95006d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:52.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa94f7fe640 1 -- 172.21.15.60:0/480618501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9501f29a0 con 0x7fa9500cf8b0 2024-09-12T01:44:52.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.738+0000 7fa94ffff640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9500b3c50 0x7fa950145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:52.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.739+0000 7fa94f7fe640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9500cf8b0 0x7fa95006ce30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa94400d830 tx=0x7fa94400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:52.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.739+0000 7fa94cff9640 1 -- 172.21.15.60:0/480618501 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94400b6c0 con 0x7fa9500cf8b0 2024-09-12T01:44:52.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.739+0000 7fa94cff9640 1 -- 172.21.15.60:0/480618501 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa944019070 con 0x7fa9500cf8b0 2024-09-12T01:44:52.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.739+0000 7fa95632c640 1 -- 172.21.15.60:0/480618501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9500c7e20 con 0x7fa9500cf8b0 2024-09-12T01:44:52.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.739+0000 7fa94cff9640 1 -- 172.21.15.60:0/480618501 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94400ba80 con 0x7fa9500cf8b0 2024-09-12T01:44:52.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.739+0000 7fa95632c640 1 -- 172.21.15.60:0/480618501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9500c83e0 con 0x7fa9500cf8b0 2024-09-12T01:44:52.742 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.740+0000 7fa95632c640 1 -- 172.21.15.60:0/480618501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9500cf370 con 0x7fa9500cf8b0 2024-09-12T01:44:52.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.740+0000 7fa94cff9640 1 -- 172.21.15.60:0/480618501 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa94401e460 con 0x7fa9500cf8b0 2024-09-12T01:44:52.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.741+0000 7fa94cff9640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa93c06be30 0x7fa93c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:52.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.741+0000 7fa94cff9640 1 -- 172.21.15.60:0/480618501 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7fa94408b150 con 0x7fa9500cf8b0 2024-09-12T01:44:52.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.741+0000 7fa94ffff640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa93c06be30 0x7fa93c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:52.743 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.741+0000 7fa94ffff640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa93c06be30 0x7fa93c06e2f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa940034000 tx=0x7fa94002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:52.745 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.745+0000 7fa94cff9640 1 -- 172.21.15.60:0/480618501 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa944059e70 con 0x7fa9500cf8b0 2024-09-12T01:44:52.987 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:52.986+0000 7fa95632c640 1 -- 172.21.15.60:0/480618501 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]} v 0) -- 0x7fa9500c7bd0 con 0x7fa9500cf8b0 2024-09-12T01:44:53.609 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.608+0000 7fa94cff9640 1 -- 172.21.15.60:0/480618501 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_client_limits.TestClientLimits.test_client_release_bug"]}]=0 v454) ==== 151+0+0 (secure 0 0 0) 0x7fa944059770 con 0x7fa9500cf8b0 2024-09-12T01:44:53.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.611+0000 7fa95632c640 1 -- 172.21.15.60:0/480618501 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa93c06be30 msgr2=0x7fa93c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:53.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.611+0000 7fa95632c640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa93c06be30 0x7fa93c06e2f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa940034000 tx=0x7fa94002e000 comp rx=0 tx=0).stop 2024-09-12T01:44:53.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.611+0000 7fa95632c640 1 -- 172.21.15.60:0/480618501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9500cf8b0 msgr2=0x7fa95006ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:53.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.611+0000 7fa95632c640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9500cf8b0 0x7fa95006ce30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fa94400d830 tx=0x7fa94400dcf0 comp rx=0 tx=0).stop 2024-09-12T01:44:53.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.611+0000 7fa95632c640 1 -- 172.21.15.60:0/480618501 shutdown_connections 2024-09-12T01:44:53.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.611+0000 7fa95632c640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa95015c470 0x7fa95006d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.611+0000 7fa95632c640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9500cf8b0 0x7fa95006ce30 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.611+0000 7fa95632c640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa93c06be30 0x7fa93c06e2f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.611+0000 7fa95632c640 1 --2- 172.21.15.60:0/480618501 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa9500b3c50 0x7fa950145ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.611+0000 7fa95632c640 1 -- 172.21.15.60:0/480618501 >> 172.21.15.60:0/480618501 conn(0x7fa95006bc10 msgr2=0x7fa950158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.612+0000 7fa95632c640 1 -- 172.21.15.60:0/480618501 shutdown_connections 2024-09-12T01:44:53.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:53.612+0000 7fa95632c640 1 -- 172.21.15.60:0/480618501 wait complete. 2024-09-12T01:44:53.625 INFO:tasks.cephfs_test_runner:When a client has a bug (which we will simulate) preventing it from releasing caps, ... skipped 'Require FUSE client to inject client release failure' 2024-09-12T01:44:53.625 INFO:tasks.cephfs_test_runner: 2024-09-12T01:44:53.625 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-12T01:44:53.625 INFO:tasks.cephfs_test_runner:Ran 10 tests in 514.230s 2024-09-12T01:44:53.625 INFO:tasks.cephfs_test_runner: 2024-09-12T01:44:53.626 INFO:tasks.cephfs_test_runner:OK (skipped=4) 2024-09-12T01:44:53.626 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-12T01:44:53.635 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-12T01:44:53.736 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-12T01:44:53.736 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:53.736 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:53.756 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:44:53.756 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-12T01:44:53.756 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:53.815 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20709 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-12T01:44:53.815 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:44:53.815 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:53.835 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:44:53.835 DEBUG:teuthology.orchestra.run.smithi105:> set -ex 2024-09-12T01:44:53.835 DEBUG:teuthology.orchestra.run.smithi105:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-12T01:44:53.894 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056024,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19663 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-12T01:44:53.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:53.894 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:44:53.912 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-12T01:44:53.913 INFO:teuthology.orchestra.run.smithi060.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-12T01:44:53.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:53.913 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-12T01:44:53.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:53.983 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-12T01:44:54.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:54.053 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-09-12T01:44:54.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:54.148 DEBUG:teuthology.orchestra.run.smithi060:> ip netns list 2024-09-12T01:44:54.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:54.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo ip link delete ceph-brx 2024-09-12T01:44:54.234 INFO:teuthology.orchestra.run.smithi060.stderr:Cannot find device "ceph-brx" 2024-09-12T01:44:54.235 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:44:54.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:54.235 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:44:54.254 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-12T01:44:54.255 INFO:teuthology.orchestra.run.smithi105.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-12T01:44:54.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:54.255 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-12T01:44:54.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:54.325 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-12T01:44:54.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:54.394 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-09-12T01:44:54.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:54.506 DEBUG:teuthology.orchestra.run.smithi105:> ip netns list 2024-09-12T01:44:54.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-12T01:44:54.522 DEBUG:teuthology.orchestra.run.smithi105:> sudo ip link delete ceph-brx 2024-09-12T01:44:54.591 INFO:teuthology.orchestra.run.smithi105.stderr:Cannot find device "ceph-brx" 2024-09-12T01:44:54.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:44:54.593 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T01:44:54.602 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:44:54.602 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:44:54.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.714+0000 7f57b128d640 1 Processor -- start 2024-09-12T01:44:54.714 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.714+0000 7f57b128d640 1 -- start start 2024-09-12T01:44:54.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.715+0000 7f57b128d640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f57ac15c170 0x7f57ac15c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:54.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.715+0000 7f57b128d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f57ac0cf6c0 0x7f57ac0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:54.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.715+0000 7f57b128d640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57ac0b49c0 con 0x7f57ac0b5dd0 2024-09-12T01:44:54.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.715+0000 7f57b128d640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f57ac15ca90 con 0x7f57ac0cf6c0 2024-09-12T01:44:54.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.715+0000 7f57b128d640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f57ac0b4cf0 con 0x7f57ac15c170 2024-09-12T01:44:54.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.715+0000 7f57aa7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f57ac0cf6c0 0x7f57ac0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:54.715 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.715+0000 7f57aa7fc640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f57ac0cf6c0 0x7f57ac0cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52194/0 (socket says 172.21.15.60:52194) 2024-09-12T01:44:54.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.715+0000 7f57aa7fc640 1 -- 172.21.15.60:0/2953642225 learned_addr learned my addr 172.21.15.60:0/2953642225 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:54.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.715+0000 7f57aaffd640 1 --2- 172.21.15.60:0/2953642225 >> v2:172.21.15.105:3300/0 conn(0x7f57ac15c170 0x7f57ac15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:54.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.716+0000 7f57aa7fc640 1 -- 172.21.15.60:0/2953642225 >> v2:172.21.15.105:3300/0 conn(0x7f57ac15c170 msgr2=0x7f57ac15c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:54.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.716+0000 7f57aa7fc640 1 --2- 172.21.15.60:0/2953642225 >> v2:172.21.15.105:3300/0 conn(0x7f57ac15c170 0x7f57ac15c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:54.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.716+0000 7f57aa7fc640 1 -- 172.21.15.60:0/2953642225 >> v1:172.21.15.105:6789/0 conn(0x7f57ac0b5dd0 legacy=0x7f57ac15ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:54.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.716+0000 7f57aa7fc640 1 -- 172.21.15.60:0/2953642225 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ac0b4fd0 con 0x7f57ac0cf6c0 2024-09-12T01:44:54.716 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.716+0000 7f57aaffd640 1 --2- 172.21.15.60:0/2953642225 >> v2:172.21.15.105:3300/0 conn(0x7f57ac15c170 0x7f57ac15c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:54.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.716+0000 7f57aa7fc640 1 --2- 172.21.15.60:0/2953642225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57ac0cf6c0 0x7f57ac0cfb30 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f5794009870 tx=0x7f579402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9d3472b54874bc server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:54.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.716+0000 7f57a9ffb640 1 -- 172.21.15.60:0/2953642225 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794037070 con 0x7f57ac0cf6c0 2024-09-12T01:44:54.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.717+0000 7f57a9ffb640 1 -- 172.21.15.60:0/2953642225 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5794032440 con 0x7f57ac0cf6c0 2024-09-12T01:44:54.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.717+0000 7f57a9ffb640 1 -- 172.21.15.60:0/2953642225 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5794032810 con 0x7f57ac0cf6c0 2024-09-12T01:44:54.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.717+0000 7f57b128d640 1 -- 172.21.15.60:0/2953642225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57ac0cf6c0 msgr2=0x7f57ac0cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:54.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.717+0000 7f57b128d640 1 --2- 172.21.15.60:0/2953642225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57ac0cf6c0 0x7f57ac0cfb30 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f5794009870 tx=0x7f579402a2a0 comp rx=0 tx=0).stop 2024-09-12T01:44:54.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.717+0000 7f57b128d640 1 -- 172.21.15.60:0/2953642225 shutdown_connections 2024-09-12T01:44:54.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.717+0000 7f57b128d640 1 --2- 172.21.15.60:0/2953642225 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57ac0cf6c0 0x7f57ac0cfb30 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:54.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.717+0000 7f57b128d640 1 --2- 172.21.15.60:0/2953642225 >> v2:172.21.15.105:3300/0 conn(0x7f57ac15c170 0x7f57ac15c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:54.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.717+0000 7f57b128d640 1 -- 172.21.15.60:0/2953642225 >> 172.21.15.60:0/2953642225 conn(0x7f57ac06bc10 msgr2=0x7f57ac06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:54.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.717+0000 7f57b128d640 1 -- 172.21.15.60:0/2953642225 shutdown_connections 2024-09-12T01:44:54.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.717+0000 7f57b128d640 1 -- 172.21.15.60:0/2953642225 wait complete. 2024-09-12T01:44:54.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.718+0000 7f57b128d640 1 Processor -- start 2024-09-12T01:44:54.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.719+0000 7f57b128d640 1 -- start start 2024-09-12T01:44:54.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.719+0000 7f57b128d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57ac0b5dd0 0x7f57ac14af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:54.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.719+0000 7f57b128d640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57ac0cf6c0 0x7f57ac1557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:54.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.719+0000 7f57b128d640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57ac15c170 0x7f57ac15a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:54.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.719+0000 7f57b128d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac0b5870 con 0x7f57ac0b5dd0 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.719+0000 7f57b128d640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f57ac0b5590 con 0x7f57ac15c170 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.719+0000 7f57b128d640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f57ac0b5b50 con 0x7f57ac0cf6c0 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.719+0000 7f57aaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57ac0b5dd0 0x7f57ac14af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.719+0000 7f57aaffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57ac0b5dd0 0x7f57ac14af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52202/0 (socket says 172.21.15.60:52202) 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.719+0000 7f57aaffd640 1 -- 172.21.15.60:0/1676631916 learned_addr learned my addr 172.21.15.60:0/1676631916 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.719+0000 7f57aa7fc640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57ac0cf6c0 0x7f57ac1557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.719+0000 7f57ab7fe640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57ac15c170 0x7f57ac15a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.720+0000 7f57aaffd640 1 -- 172.21.15.60:0/1676631916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57ac0cf6c0 msgr2=0x7f57ac1557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.720+0000 7f57aaffd640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57ac0cf6c0 0x7f57ac1557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.720+0000 7f57aaffd640 1 -- 172.21.15.60:0/1676631916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57ac15c170 msgr2=0x7f57ac15a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.720+0000 7f57aaffd640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57ac15c170 0x7f57ac15a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.720+0000 7f57aaffd640 1 -- 172.21.15.60:0/1676631916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57ac154230 con 0x7f57ac0b5dd0 2024-09-12T01:44:54.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.720+0000 7f57aaffd640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57ac0b5dd0 0x7f57ac14af60 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f579c00efc0 tx=0x7f579c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:54.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.720+0000 7f57a37fe640 1 -- 172.21.15.60:0/1676631916 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c018020 con 0x7f57ac0b5dd0 2024-09-12T01:44:54.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.720+0000 7f57a37fe640 1 -- 172.21.15.60:0/1676631916 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f579c014680 con 0x7f57ac0b5dd0 2024-09-12T01:44:54.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.720+0000 7f57b128d640 1 -- 172.21.15.60:0/1676631916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57ac154510 con 0x7f57ac0b5dd0 2024-09-12T01:44:54.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.720+0000 7f57a37fe640 1 -- 172.21.15.60:0/1676631916 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c014a50 con 0x7f57ac0b5dd0 2024-09-12T01:44:54.722 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.720+0000 7f57b128d640 1 -- 172.21.15.60:0/1676631916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57ac154db0 con 0x7f57ac0b5dd0 2024-09-12T01:44:54.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.721+0000 7f57b128d640 1 -- 172.21.15.60:0/1676631916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57ac0cfb30 con 0x7f57ac0b5dd0 2024-09-12T01:44:54.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.722+0000 7f57a37fe640 1 -- 172.21.15.60:0/1676631916 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f579c005d10 con 0x7f57ac0b5dd0 2024-09-12T01:44:54.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.722+0000 7f57a37fe640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f578c06be30 0x7f578c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:54.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.722+0000 7f57a37fe640 1 -- 172.21.15.60:0/1676631916 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f579c08b790 con 0x7f57ac0b5dd0 2024-09-12T01:44:54.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.722+0000 7f57aa7fc640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f578c06be30 0x7f578c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:54.723 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.723+0000 7f57aa7fc640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f578c06be30 0x7f578c06e2f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5794034000 tx=0x7f579402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:54.726 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.726+0000 7f57a37fe640 1 -- 172.21.15.60:0/1676631916 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f579c022030 con 0x7f57ac0b5dd0 2024-09-12T01:44:54.898 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.899+0000 7f57b128d640 1 -- 172.21.15.60:0/1676631916 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57ac1546e0 con 0x7f578c06be30 2024-09-12T01:44:54.899 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.899+0000 7f57a37fe640 1 -- 172.21.15.60:0/1676631916 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13431 (secure 0 0 0) 0x7f57ac1546e0 con 0x7f578c06be30 2024-09-12T01:44:54.899 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:54.899 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:44:54.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.901+0000 7f57b128d640 1 -- 172.21.15.60:0/1676631916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f578c06be30 msgr2=0x7f578c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:54.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.901+0000 7f57b128d640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f578c06be30 0x7f578c06e2f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5794034000 tx=0x7f579402e000 comp rx=0 tx=0).stop 2024-09-12T01:44:54.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.901+0000 7f57b128d640 1 -- 172.21.15.60:0/1676631916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57ac0b5dd0 msgr2=0x7f57ac14af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:54.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.901+0000 7f57b128d640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57ac0b5dd0 0x7f57ac14af60 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f579c00efc0 tx=0x7f579c00c490 comp rx=0 tx=0).stop 2024-09-12T01:44:54.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.901+0000 7f57b128d640 1 -- 172.21.15.60:0/1676631916 shutdown_connections 2024-09-12T01:44:54.901 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.901+0000 7f57b128d640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f57ac15c170 0x7f57ac15a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:54.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.901+0000 7f57b128d640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f578c06be30 0x7f578c06e2f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:54.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.901+0000 7f57b128d640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f57ac0cf6c0 0x7f57ac1557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:54.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.901+0000 7f57b128d640 1 --2- 172.21.15.60:0/1676631916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57ac0b5dd0 0x7f57ac14af60 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:54.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.901+0000 7f57b128d640 1 -- 172.21.15.60:0/1676631916 >> 172.21.15.60:0/1676631916 conn(0x7f57ac06bc10 msgr2=0x7f57ac06d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:54.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.901+0000 7f57b128d640 1 -- 172.21.15.60:0/1676631916 shutdown_connections 2024-09-12T01:44:54.902 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:54.901+0000 7f57b128d640 1 -- 172.21.15.60:0/1676631916 wait complete. 2024-09-12T01:44:54.912 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-09-12T01:44:54.380453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":293548,"kb_used_data":14924,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754681172,"statfs":{"total":773094113280,"available":772793520128,"internally_reserved":0,"allocated":15282176,"data_stored":7212050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3909,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-47,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001094"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":391,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T01:44:49.623007+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:44:49.623007+0000","last_peered":"2024-09-12T01:44:49.623007+0000","last_clean":"2024-09-12T01:44:49.623007+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:44:49.623007+0000","last_undegraded":"2024-09-12T01:44:49.623007+0000","last_fullsized":"2024-09-12T01:44:49.623007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":1740800,"data_stored":746864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509552,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37052,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334788,"statfs":{"total":96636764160,"available":96598822912,"internally_reserved":0,"allocated":1744896,"data_stored":746898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509552,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33488,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2355200,"data_stored":1343985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509552,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41236,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330604,"statfs":{"total":96636764160,"available":96594538496,"internally_reserved":0,"allocated":1769472,"data_stored":756360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509552,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":1757184,"data_stored":753527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37664,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334176,"statfs":{"total":96636764160,"available":96598196224,"internally_reserved":0,"allocated":2371584,"data_stored":1346888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509553,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":1757184,"data_stored":753015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574961,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:44:54.912 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:44:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.015+0000 7f6c6545e640 1 Processor -- start 2024-09-12T01:44:55.015 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.016+0000 7f6c6545e640 1 -- start start 2024-09-12T01:44:55.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.016+0000 7f6c6545e640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c600d4d00 0x7f6c600cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.016+0000 7f6c6545e640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c600d3c60 con 0x7f6c600d18c0 2024-09-12T01:44:55.016 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.016+0000 7f6c6545e640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c600d3f40 con 0x7f6c6015e640 2024-09-12T01:44:55.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.016+0000 7f6c6545e640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6c600d5170 con 0x7f6c600d4d00 2024-09-12T01:44:55.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.017+0000 7f6c5f7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c600d4d00 0x7f6c600cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.017+0000 7f6c5e7fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6c600d18c0 0x7f6c600b7850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35500/0 (socket says 172.21.15.60:35500) 2024-09-12T01:44:55.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.017+0000 7f6c5e7fc640 1 -- 172.21.15.60:0/3581375193 learned_addr learned my addr 172.21.15.60:0/3581375193 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:55.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.017+0000 7f6c5f7fe640 1 -- 172.21.15.60:0/3581375193 >> v1:172.21.15.105:6789/0 conn(0x7f6c6015e640 legacy=0x7f6c600d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.017+0000 7f6c5f7fe640 1 -- 172.21.15.60:0/3581375193 >> v1:172.21.15.60:6789/0 conn(0x7f6c600d18c0 legacy=0x7f6c600b7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.017+0000 7f6c5f7fe640 1 -- 172.21.15.60:0/3581375193 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c600d4220 con 0x7f6c600d4d00 2024-09-12T01:44:55.017 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.017+0000 7f6c5dffb640 1 -- 172.21.15.60:0/3581375193 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 898855424 0 0) 0x7f6c600d3c60 con 0x7f6c600d18c0 2024-09-12T01:44:55.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.018+0000 7f6c5f7fe640 1 --2- 172.21.15.60:0/3581375193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c600d4d00 0x7f6c600cf940 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f6c580097a0 tx=0x7f6c5802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0bff7c6b375b84 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:55.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.018+0000 7f6c5dffb640 1 -- 172.21.15.60:0/3581375193 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58037070 con 0x7f6c600d4d00 2024-09-12T01:44:55.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.018+0000 7f6c5dffb640 1 -- 172.21.15.60:0/3581375193 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c58032440 con 0x7f6c600d4d00 2024-09-12T01:44:55.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.018+0000 7f6c5dffb640 1 -- 172.21.15.60:0/3581375193 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58032810 con 0x7f6c600d4d00 2024-09-12T01:44:55.018 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.018+0000 7f6c6545e640 1 -- 172.21.15.60:0/3581375193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c600d4d00 msgr2=0x7f6c600cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.018+0000 7f6c6545e640 1 --2- 172.21.15.60:0/3581375193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c600d4d00 0x7f6c600cf940 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f6c580097a0 tx=0x7f6c5802a230 comp rx=0 tx=0).stop 2024-09-12T01:44:55.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.018+0000 7f6c6545e640 1 -- 172.21.15.60:0/3581375193 shutdown_connections 2024-09-12T01:44:55.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.018+0000 7f6c6545e640 1 --2- 172.21.15.60:0/3581375193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c600d4d00 0x7f6c600cf940 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.018+0000 7f6c6545e640 1 -- 172.21.15.60:0/3581375193 >> 172.21.15.60:0/3581375193 conn(0x7f6c60062a50 msgr2=0x7f6c60062e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:55.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.018+0000 7f6c6545e640 1 -- 172.21.15.60:0/3581375193 shutdown_connections 2024-09-12T01:44:55.019 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.018+0000 7f6c6545e640 1 -- 172.21.15.60:0/3581375193 wait complete. 2024-09-12T01:44:55.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.020+0000 7f6c6545e640 1 Processor -- start 2024-09-12T01:44:55.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.020+0000 7f6c6545e640 1 -- start start 2024-09-12T01:44:55.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.020+0000 7f6c6545e640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c600d18c0 0x7f6c600b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.020+0000 7f6c6545e640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c600d4d00 0x7f6c601f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.020+0000 7f6c6545e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6015e640 0x7f6c600b99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c6545e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6015eba0 con 0x7f6c6015e640 2024-09-12T01:44:55.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c6545e640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6015ea20 con 0x7f6c600d4d00 2024-09-12T01:44:55.021 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c6545e640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6c600d34f0 con 0x7f6c600d18c0 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c5f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6015e640 0x7f6c600b99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c5f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6015e640 0x7f6c600b99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52216/0 (socket says 172.21.15.60:52216) 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c5f7fe640 1 -- 172.21.15.60:0/2307325957 learned_addr learned my addr 172.21.15.60:0/2307325957 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c5e7fc640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c600d4d00 0x7f6c601f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c5effd640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c600d18c0 0x7f6c600b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c5f7fe640 1 -- 172.21.15.60:0/2307325957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c600d18c0 msgr2=0x7f6c600b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c5f7fe640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c600d18c0 0x7f6c600b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c5f7fe640 1 -- 172.21.15.60:0/2307325957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c600d4d00 msgr2=0x7f6c601f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c5f7fe640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c600d4d00 0x7f6c601f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c5f7fe640 1 -- 172.21.15.60:0/2307325957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c600b8060 con 0x7f6c6015e640 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c5f7fe640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6015e640 0x7f6c600b99b0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f6c580098c0 tx=0x7f6c580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c477fe640 1 -- 172.21.15.60:0/2307325957 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58037040 con 0x7f6c6015e640 2024-09-12T01:44:55.022 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c477fe640 1 -- 172.21.15.60:0/2307325957 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c58042070 con 0x7f6c6015e640 2024-09-12T01:44:55.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c6545e640 1 -- 172.21.15.60:0/2307325957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c600b8340 con 0x7f6c6015e640 2024-09-12T01:44:55.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c477fe640 1 -- 172.21.15.60:0/2307325957 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c58030b30 con 0x7f6c6015e640 2024-09-12T01:44:55.023 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.021+0000 7f6c6545e640 1 -- 172.21.15.60:0/2307325957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c600b8be0 con 0x7f6c6015e640 2024-09-12T01:44:55.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.022+0000 7f6c6545e640 1 -- 172.21.15.60:0/2307325957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c600d3890 con 0x7f6c6015e640 2024-09-12T01:44:55.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.023+0000 7f6c477fe640 1 -- 172.21.15.60:0/2307325957 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6c58030cd0 con 0x7f6c6015e640 2024-09-12T01:44:55.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.023+0000 7f6c477fe640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.023+0000 7f6c477fe640 1 -- 172.21.15.60:0/2307325957 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f6c580ab690 con 0x7f6c6015e640 2024-09-12T01:44:55.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.024+0000 7f6c5effd640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.024 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.024+0000 7f6c5effd640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6c500012e0 tx=0x7f6c50009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:55.027 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.028+0000 7f6c477fe640 1 -- 172.21.15.60:0/2307325957 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6c58079cf0 con 0x7f6c6015e640 2024-09-12T01:44:55.202 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.203+0000 7f6c6545e640 1 -- 172.21.15.60:0/2307325957 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c600d2610 con 0x7f6c4c06be30 2024-09-12T01:44:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.204+0000 7f6c477fe640 1 -- 172.21.15.60:0/2307325957 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13431 (secure 0 0 0) 0x7f6c600d2610 con 0x7f6c4c06be30 2024-09-12T01:44:55.203 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:55.203 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:44:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.206+0000 7f6c6545e640 1 -- 172.21.15.60:0/2307325957 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6c4c06be30 msgr2=0x7f6c4c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.206+0000 7f6c6545e640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6c500012e0 tx=0x7f6c50009040 comp rx=0 tx=0).stop 2024-09-12T01:44:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.206+0000 7f6c6545e640 1 -- 172.21.15.60:0/2307325957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6015e640 msgr2=0x7f6c600b99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.206+0000 7f6c6545e640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6015e640 0x7f6c600b99b0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f6c580098c0 tx=0x7f6c580046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.206+0000 7f6c6545e640 1 -- 172.21.15.60:0/2307325957 shutdown_connections 2024-09-12T01:44:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.206+0000 7f6c6545e640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c6015e640 0x7f6c600b99b0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.206+0000 7f6c6545e640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6c600d4d00 0x7f6c601f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.206+0000 7f6c6545e640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6c4c06be30 0x7f6c4c06e2f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.206+0000 7f6c6545e640 1 --2- 172.21.15.60:0/2307325957 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6c600d18c0 0x7f6c600b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.206+0000 7f6c6545e640 1 -- 172.21.15.60:0/2307325957 >> 172.21.15.60:0/2307325957 conn(0x7f6c60062a50 msgr2=0x7f6c60062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.206+0000 7f6c6545e640 1 -- 172.21.15.60:0/2307325957 shutdown_connections 2024-09-12T01:44:55.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.206+0000 7f6c6545e640 1 -- 172.21.15.60:0/2307325957 wait complete. 2024-09-12T01:44:55.216 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-09-12T01:44:54.380453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":293548,"kb_used_data":14924,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754681172,"statfs":{"total":773094113280,"available":772793520128,"internally_reserved":0,"allocated":15282176,"data_stored":7212050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3909,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-47,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001094"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":391,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T01:44:49.623007+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:44:49.623007+0000","last_peered":"2024-09-12T01:44:49.623007+0000","last_clean":"2024-09-12T01:44:49.623007+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:44:49.623007+0000","last_undegraded":"2024-09-12T01:44:49.623007+0000","last_fullsized":"2024-09-12T01:44:49.623007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":1740800,"data_stored":746864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509552,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37052,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334788,"statfs":{"total":96636764160,"available":96598822912,"internally_reserved":0,"allocated":1744896,"data_stored":746898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509552,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33488,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2355200,"data_stored":1343985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509552,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41236,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330604,"statfs":{"total":96636764160,"available":96594538496,"internally_reserved":0,"allocated":1769472,"data_stored":756360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509552,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":1757184,"data_stored":753527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37664,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334176,"statfs":{"total":96636764160,"available":96598196224,"internally_reserved":0,"allocated":2371584,"data_stored":1346888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509553,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":1757184,"data_stored":753015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574961,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:44:55.216 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:44:55.217 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:44:55.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.319+0000 7fcc0cf42640 1 Processor -- start 2024-09-12T01:44:55.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.319+0000 7fcc0cf42640 1 -- start start 2024-09-12T01:44:55.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.320+0000 7fcc0cf42640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcc080b5460 0x7fcc080b6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.320+0000 7fcc0cf42640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc080b7390 0x7fcc0806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.320+0000 7fcc0cf42640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc080b58f0 con 0x7fcc0815e800 2024-09-12T01:44:55.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.321+0000 7fcc0cf42640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fcc0806ed40 con 0x7fcc080b5460 2024-09-12T01:44:55.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.321+0000 7fcc0cf42640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc0806ea60 con 0x7fcc080b7390 2024-09-12T01:44:55.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.321+0000 7fcc05d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcc080b5460 0x7fcc080b6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.321+0000 7fcc05d9b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcc080b5460 0x7fcc080b6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52226/0 (socket says 172.21.15.60:52226) 2024-09-12T01:44:55.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.321+0000 7fcc05d9b640 1 -- 172.21.15.60:0/2588767640 learned_addr learned my addr 172.21.15.60:0/2588767640 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:55.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.321+0000 7fcc06d9d640 1 --2- 172.21.15.60:0/2588767640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc080b7390 0x7fcc0806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.321+0000 7fcc05d9b640 1 -- 172.21.15.60:0/2588767640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc080b7390 msgr2=0x7fcc0806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:55.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.321+0000 7fcc05d9b640 1 --2- 172.21.15.60:0/2588767640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc080b7390 0x7fcc0806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.321+0000 7fcc05d9b640 1 -- 172.21.15.60:0/2588767640 >> v1:172.21.15.105:6789/0 conn(0x7fcc0815e800 legacy=0x7fcc0815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:55.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.321+0000 7fcc05d9b640 1 -- 172.21.15.60:0/2588767640 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0806cde0 con 0x7fcc080b5460 2024-09-12T01:44:55.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.322+0000 7fcc05d9b640 1 --2- 172.21.15.60:0/2588767640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc080b5460 0x7fcc080b6e50 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009870 tx=0x7fcbfc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77604313c428627a server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:55.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.322+0000 7fcc0559a640 1 -- 172.21.15.60:0/2588767640 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc037070 con 0x7fcc080b5460 2024-09-12T01:44:55.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.322+0000 7fcc0559a640 1 -- 172.21.15.60:0/2588767640 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbfc032440 con 0x7fcc080b5460 2024-09-12T01:44:55.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.322+0000 7fcc0559a640 1 -- 172.21.15.60:0/2588767640 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc032810 con 0x7fcc080b5460 2024-09-12T01:44:55.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.322+0000 7fcc0cf42640 1 -- 172.21.15.60:0/2588767640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc080b5460 msgr2=0x7fcc080b6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.323+0000 7fcc0cf42640 1 --2- 172.21.15.60:0/2588767640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc080b5460 0x7fcc080b6e50 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009870 tx=0x7fcbfc02a270 comp rx=0 tx=0).stop 2024-09-12T01:44:55.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.323+0000 7fcc0cf42640 1 -- 172.21.15.60:0/2588767640 shutdown_connections 2024-09-12T01:44:55.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.323+0000 7fcc0cf42640 1 --2- 172.21.15.60:0/2588767640 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc080b7390 0x7fcc0806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.323+0000 7fcc0cf42640 1 --2- 172.21.15.60:0/2588767640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc080b5460 0x7fcc080b6e50 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.323+0000 7fcc0cf42640 1 -- 172.21.15.60:0/2588767640 >> 172.21.15.60:0/2588767640 conn(0x7fcc080d24d0 msgr2=0x7fcc080d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:55.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.323+0000 7fcc0cf42640 1 -- 172.21.15.60:0/2588767640 shutdown_connections 2024-09-12T01:44:55.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.323+0000 7fcc0cf42640 1 -- 172.21.15.60:0/2588767640 wait complete. 2024-09-12T01:44:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.324+0000 7fcc0cf42640 1 Processor -- start 2024-09-12T01:44:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.324+0000 7fcc0cf42640 1 -- start start 2024-09-12T01:44:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc0cf42640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc080b5460 0x7fcc080b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc0cf42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc080b7390 0x7fcc0814d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc0cf42640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc0815e800 0x7fcc08161700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc0cf42640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcc080b77c0 con 0x7fcc080b7390 2024-09-12T01:44:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc0cf42640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fcc0806d3a0 con 0x7fcc080b5460 2024-09-12T01:44:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc0cf42640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fcc080d31e0 con 0x7fcc0815e800 2024-09-12T01:44:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc05d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc080b7390 0x7fcc0814d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc05d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc080b7390 0x7fcc0814d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52238/0 (socket says 172.21.15.60:52238) 2024-09-12T01:44:55.326 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc05d9b640 1 -- 172.21.15.60:0/952322726 learned_addr learned my addr 172.21.15.60:0/952322726 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc0659c640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc080b5460 0x7fcc080b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc06d9d640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc0815e800 0x7fcc08161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc05d9b640 1 -- 172.21.15.60:0/952322726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc0815e800 msgr2=0x7fcc08161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc05d9b640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc0815e800 0x7fcc08161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc05d9b640 1 -- 172.21.15.60:0/952322726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc080b5460 msgr2=0x7fcc080b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc05d9b640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc080b5460 0x7fcc080b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc05d9b640 1 -- 172.21.15.60:0/952322726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc08160660 con 0x7fcc080b7390 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.325+0000 7fcc05d9b640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc080b7390 0x7fcc0814d170 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc000c00 tx=0x7fcbfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.326+0000 7fcbf6ffd640 1 -- 172.21.15.60:0/952322726 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc041020 con 0x7fcc080b7390 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.326+0000 7fcbf6ffd640 1 -- 172.21.15.60:0/952322726 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbfc030780 con 0x7fcc080b7390 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.326+0000 7fcbf6ffd640 1 -- 172.21.15.60:0/952322726 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc037040 con 0x7fcc080b7390 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.326+0000 7fcc0cf42640 1 -- 172.21.15.60:0/952322726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc08160940 con 0x7fcc080b7390 2024-09-12T01:44:55.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.326+0000 7fcc0cf42640 1 -- 172.21.15.60:0/952322726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc08160f00 con 0x7fcc080b7390 2024-09-12T01:44:55.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.327+0000 7fcc0cf42640 1 -- 172.21.15.60:0/952322726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc0806e680 con 0x7fcc080b7390 2024-09-12T01:44:55.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.327+0000 7fcbf6ffd640 1 -- 172.21.15.60:0/952322726 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fcbfc044020 con 0x7fcc080b7390 2024-09-12T01:44:55.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.327+0000 7fcbf6ffd640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcbe806be30 0x7fcbe806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.328+0000 7fcc0659c640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcbe806be30 0x7fcbe806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.328+0000 7fcbf6ffd640 1 -- 172.21.15.60:0/952322726 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7fcbfc0ab250 con 0x7fcc080b7390 2024-09-12T01:44:55.329 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.328+0000 7fcc0659c640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcbe806be30 0x7fcbe806e2f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8001780 tx=0x7fcbf8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:55.331 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.332+0000 7fcbf6ffd640 1 -- 172.21.15.60:0/952322726 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fcbfc04b030 con 0x7fcc080b7390 2024-09-12T01:44:55.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.503+0000 7fcc0cf42640 1 -- 172.21.15.60:0/952322726 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc080693c0 con 0x7fcbe806be30 2024-09-12T01:44:55.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.503+0000 7fcbf6ffd640 1 -- 172.21.15.60:0/952322726 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13431 (secure 0 0 0) 0x7fcc080693c0 con 0x7fcbe806be30 2024-09-12T01:44:55.503 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:55.503 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:44:55.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.505+0000 7fcc0cf42640 1 -- 172.21.15.60:0/952322726 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcbe806be30 msgr2=0x7fcbe806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.505+0000 7fcc0cf42640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcbe806be30 0x7fcbe806e2f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8001780 tx=0x7fcbf8009040 comp rx=0 tx=0).stop 2024-09-12T01:44:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.505+0000 7fcc0cf42640 1 -- 172.21.15.60:0/952322726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc080b7390 msgr2=0x7fcc0814d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.505+0000 7fcc0cf42640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc080b7390 0x7fcc0814d170 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc000c00 tx=0x7fcbfc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.505+0000 7fcc0cf42640 1 -- 172.21.15.60:0/952322726 shutdown_connections 2024-09-12T01:44:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.505+0000 7fcc0cf42640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fcbe806be30 0x7fcbe806e2f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.505+0000 7fcc0cf42640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcc0815e800 0x7fcc08161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.505+0000 7fcc0cf42640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcc080b7390 0x7fcc0814d170 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.505+0000 7fcc0cf42640 1 --2- 172.21.15.60:0/952322726 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcc080b5460 0x7fcc080b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.505+0000 7fcc0cf42640 1 -- 172.21.15.60:0/952322726 >> 172.21.15.60:0/952322726 conn(0x7fcc080d24d0 msgr2=0x7fcc080b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.505+0000 7fcc0cf42640 1 -- 172.21.15.60:0/952322726 shutdown_connections 2024-09-12T01:44:55.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.505+0000 7fcc0cf42640 1 -- 172.21.15.60:0/952322726 wait complete. 2024-09-12T01:44:55.516 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-09-12T01:44:54.380453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":293548,"kb_used_data":14924,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754681172,"statfs":{"total":773094113280,"available":772793520128,"internally_reserved":0,"allocated":15282176,"data_stored":7212050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3909,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-47,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001094"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":391,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-12T01:44:49.623007+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:44:49.623007+0000","last_peered":"2024-09-12T01:44:49.623007+0000","last_clean":"2024-09-12T01:44:49.623007+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:44:49.623007+0000","last_undegraded":"2024-09-12T01:44:49.623007+0000","last_fullsized":"2024-09-12T01:44:49.623007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509554,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37048,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334792,"statfs":{"total":96636764160,"available":96598827008,"internally_reserved":0,"allocated":1740800,"data_stored":746864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509552,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37052,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334788,"statfs":{"total":96636764160,"available":96598822912,"internally_reserved":0,"allocated":1744896,"data_stored":746898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509552,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33488,"kb_used_data":2300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338352,"statfs":{"total":96636764160,"available":96602472448,"internally_reserved":0,"allocated":2355200,"data_stored":1343985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509552,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41236,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330604,"statfs":{"total":96636764160,"available":96594538496,"internally_reserved":0,"allocated":1769472,"data_stored":756360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509552,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":1757184,"data_stored":753527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509552,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37664,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334176,"statfs":{"total":96636764160,"available":96598196224,"internally_reserved":0,"allocated":2371584,"data_stored":1346888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509553,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":1757184,"data_stored":753015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574961,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:44:55.516 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:44:55.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.620+0000 7fc7e967b640 1 Processor -- start 2024-09-12T01:44:55.620 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.620+0000 7fc7e967b640 1 -- start start 2024-09-12T01:44:55.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.621+0000 7fc7e967b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc7e415e660 0x7fc7e40cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.621+0000 7fc7e967b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e40d3310 0x7fc7e40d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.621+0000 7fc7e967b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7e415ea40 con 0x7fc7e40d1650 2024-09-12T01:44:55.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.621+0000 7fc7e967b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc7e40d1ac0 con 0x7fc7e415e660 2024-09-12T01:44:55.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.621+0000 7fc7e967b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e40d3870 con 0x7fc7e40d3310 2024-09-12T01:44:55.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.621+0000 7fc7e27fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e40d3310 0x7fc7e40d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.621+0000 7fc7e2ffd640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc7e415e660 0x7fc7e40cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.623 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.621+0000 7fc7e27fc640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e40d3310 0x7fc7e40d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:42504/0 (socket says 172.21.15.60:42504) 2024-09-12T01:44:55.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.621+0000 7fc7e27fc640 1 -- 172.21.15.60:0/3168678516 learned_addr learned my addr 172.21.15.60:0/3168678516 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:55.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.622+0000 7fc7e27fc640 1 -- 172.21.15.60:0/3168678516 >> v2:172.21.15.105:3300/0 conn(0x7fc7e415e660 msgr2=0x7fc7e40cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:55.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.622+0000 7fc7e27fc640 1 --2- 172.21.15.60:0/3168678516 >> v2:172.21.15.105:3300/0 conn(0x7fc7e415e660 0x7fc7e40cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.622+0000 7fc7e27fc640 1 -- 172.21.15.60:0/3168678516 >> v1:172.21.15.105:6789/0 conn(0x7fc7e40d1650 legacy=0x7fc7e406bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.622+0000 7fc7e27fc640 1 -- 172.21.15.60:0/3168678516 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e40d3b50 con 0x7fc7e40d3310 2024-09-12T01:44:55.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.622+0000 7fc7e27fc640 1 --2- 172.21.15.60:0/3168678516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e40d3310 0x7fc7e40d1110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009870 tx=0x7fc7cc02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79f6bcda83f82c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:55.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.623+0000 7fc7e1ffb640 1 -- 172.21.15.60:0/3168678516 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc037070 con 0x7fc7e40d3310 2024-09-12T01:44:55.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.623+0000 7fc7e1ffb640 1 -- 172.21.15.60:0/3168678516 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7cc032440 con 0x7fc7e40d3310 2024-09-12T01:44:55.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.623+0000 7fc7e1ffb640 1 -- 172.21.15.60:0/3168678516 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc032810 con 0x7fc7e40d3310 2024-09-12T01:44:55.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.623+0000 7fc7e967b640 1 -- 172.21.15.60:0/3168678516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e40d3310 msgr2=0x7fc7e40d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.623+0000 7fc7e967b640 1 --2- 172.21.15.60:0/3168678516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e40d3310 0x7fc7e40d1110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009870 tx=0x7fc7cc02a270 comp rx=0 tx=0).stop 2024-09-12T01:44:55.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.623+0000 7fc7e967b640 1 -- 172.21.15.60:0/3168678516 shutdown_connections 2024-09-12T01:44:55.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.623+0000 7fc7e967b640 1 --2- 172.21.15.60:0/3168678516 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e40d3310 0x7fc7e40d1110 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.623+0000 7fc7e967b640 1 --2- 172.21.15.60:0/3168678516 >> v2:172.21.15.105:3300/0 conn(0x7fc7e415e660 0x7fc7e40cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.623+0000 7fc7e967b640 1 -- 172.21.15.60:0/3168678516 >> 172.21.15.60:0/3168678516 conn(0x7fc7e40b6410 msgr2=0x7fc7e40b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.623+0000 7fc7e967b640 1 -- 172.21.15.60:0/3168678516 shutdown_connections 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.623+0000 7fc7e967b640 1 -- 172.21.15.60:0/3168678516 wait complete. 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.624+0000 7fc7e967b640 1 Processor -- start 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.625+0000 7fc7e967b640 1 -- start start 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.625+0000 7fc7e967b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7e40d1650 0x7fc7e40ca470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.625+0000 7fc7e967b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e40d3310 0x7fc7e40b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.625+0000 7fc7e967b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e415e660 0x7fc7e40ba070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.625+0000 7fc7e967b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e40d43f0 con 0x7fc7e40d3310 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.625+0000 7fc7e967b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc7e40d4110 con 0x7fc7e40d1650 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.625+0000 7fc7e967b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc7e40cfc70 con 0x7fc7e415e660 2024-09-12T01:44:55.629 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.625+0000 7fc7e27fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e40d3310 0x7fc7e40b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.625+0000 7fc7e27fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e40d3310 0x7fc7e40b9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52250/0 (socket says 172.21.15.60:52250) 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.625+0000 7fc7e27fc640 1 -- 172.21.15.60:0/2082666521 learned_addr learned my addr 172.21.15.60:0/2082666521 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7e2ffd640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7e40d1650 0x7fc7e40ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7e37fe640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e415e660 0x7fc7e40ba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7e27fc640 1 -- 172.21.15.60:0/2082666521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e415e660 msgr2=0x7fc7e40ba070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7e27fc640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e415e660 0x7fc7e40ba070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7e27fc640 1 -- 172.21.15.60:0/2082666521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7e40d1650 msgr2=0x7fc7e40ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7e27fc640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7e40d1650 0x7fc7e40ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7e27fc640 1 -- 172.21.15.60:0/2082666521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7e41f7960 con 0x7fc7e40d3310 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7e37fe640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e415e660 0x7fc7e40ba070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7e2ffd640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7e40d1650 0x7fc7e40ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7e27fc640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e40d3310 0x7fc7e40b9b30 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc000c00 tx=0x7fc7cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7db7fe640 1 -- 172.21.15.60:0/2082666521 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc037040 con 0x7fc7e40d3310 2024-09-12T01:44:55.630 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7db7fe640 1 -- 172.21.15.60:0/2082666521 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7cc042070 con 0x7fc7e40d3310 2024-09-12T01:44:55.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7e967b640 1 -- 172.21.15.60:0/2082666521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7e41f7c40 con 0x7fc7e40d3310 2024-09-12T01:44:55.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7db7fe640 1 -- 172.21.15.60:0/2082666521 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc030880 con 0x7fc7e40d3310 2024-09-12T01:44:55.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.626+0000 7fc7e967b640 1 -- 172.21.15.60:0/2082666521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7e41f8200 con 0x7fc7e40d3310 2024-09-12T01:44:55.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.627+0000 7fc7e967b640 1 -- 172.21.15.60:0/2082666521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e40d1110 con 0x7fc7e40d3310 2024-09-12T01:44:55.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.628+0000 7fc7db7fe640 1 -- 172.21.15.60:0/2082666521 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc7cc030a20 con 0x7fc7e40d3310 2024-09-12T01:44:55.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.628+0000 7fc7db7fe640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc7c406be30 0x7fc7c406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:55.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.628+0000 7fc7db7fe640 1 -- 172.21.15.60:0/2082666521 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7fc7cc0ab3a0 con 0x7fc7e40d3310 2024-09-12T01:44:55.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.628+0000 7fc7e2ffd640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc7c406be30 0x7fc7c406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:55.631 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.629+0000 7fc7e2ffd640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc7c406be30 0x7fc7c406e2f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009a20 tx=0x7fc7dc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:55.632 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.633+0000 7fc7db7fe640 1 -- 172.21.15.60:0/2082666521 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc7cc07a050 con 0x7fc7e40d3310 2024-09-12T01:44:55.813 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.813+0000 7fc7e967b640 1 -- 172.21.15.60:0/2082666521 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc7e415b720 con 0x7fc7e40d3310 2024-09-12T01:44:55.814 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.814+0000 7fc7db7fe640 1 -- 172.21.15.60:0/2082666521 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+13006 (secure 0 0 0) 0x7fc7cc079950 con 0x7fc7e40d3310 2024-09-12T01:44:55.814 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:44:55.814 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":142,"fsid":"5401bd8a-3492-4b21-b6c0-d6616ff39793","created":"2024-09-12T01:35:31.948089+0000","modified":"2024-09-12T01:44:52.285822+0000","last_up_change":"2024-09-12T01:35:44.995602+0000","last_in_change":"2024-09-12T01:35:34.911685+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T01:35:46.304939+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"2f2c26f8-c31e-432b-87ff-54875d7a99c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6819","nonce":1570261314}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6821","nonce":1570261314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6825","nonce":1570261314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1570261314},{"type":"v1","addr":"172.21.15.60:6823","nonce":1570261314}]},"public_addr":"172.21.15.60:6819/1570261314","cluster_addr":"172.21.15.60:6821/1570261314","heartbeat_back_addr":"172.21.15.60:6825/1570261314","heartbeat_front_addr":"172.21.15.60:6823/1570261314","state":["exists","up"]},{"osd":1,"uuid":"c92bf594-1af8-4a25-beed-7ca9cc3d9eff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6811","nonce":1439609768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6813","nonce":1439609768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6817","nonce":1439609768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1439609768},{"type":"v1","addr":"172.21.15.60:6815","nonce":1439609768}]},"public_addr":"172.21.15.60:6811/1439609768","cluster_addr":"172.21.15.60:6813/1439609768","heartbeat_back_addr":"172.21.15.60:6817/1439609768","heartbeat_front_addr":"172.21.15.60:6815/1439609768","state":["exists","up"]},{"osd":2,"uuid":"f1eee73a-bfd9-43d4-9b46-eaba90621d59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6803","nonce":939860136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6805","nonce":939860136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6809","nonce":939860136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":939860136},{"type":"v1","addr":"172.21.15.60:6807","nonce":939860136}]},"public_addr":"172.21.15.60:6803/939860136","cluster_addr":"172.21.15.60:6805/939860136","heartbeat_back_addr":"172.21.15.60:6809/939860136","heartbeat_front_addr":"172.21.15.60:6807/939860136","state":["exists","up"]},{"osd":3,"uuid":"49c31c39-8c0b-49cc-99c3-d4c5b400e7ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6827","nonce":3508972949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6829","nonce":3508972949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6833","nonce":3508972949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":3508972949},{"type":"v1","addr":"172.21.15.60:6831","nonce":3508972949}]},"public_addr":"172.21.15.60:6827/3508972949","cluster_addr":"172.21.15.60:6829/3508972949","heartbeat_back_addr":"172.21.15.60:6833/3508972949","heartbeat_front_addr":"172.21.15.60:6831/3508972949","state":["exists","up"]},{"osd":4,"uuid":"031273d9-1c1f-4374-8b9a-47f6c60aa5a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6809","nonce":3941434125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6811","nonce":3941434125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6815","nonce":3941434125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":3941434125},{"type":"v1","addr":"172.21.15.105:6813","nonce":3941434125}]},"public_addr":"172.21.15.105:6809/3941434125","cluster_addr":"172.21.15.105:6811/3941434125","heartbeat_back_addr":"172.21.15.105:6815/3941434125","heartbeat_front_addr":"172.21.15.105:6813/3941434125","state":["exists","up"]},{"osd":5,"uuid":"304a5a51-6887-4771-bfa0-136120f8a3cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6817","nonce":16466051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6819","nonce":16466051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6823","nonce":16466051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":16466051},{"type":"v1","addr":"172.21.15.105:6821","nonce":16466051}]},"public_addr":"172.21.15.105:6817/16466051","cluster_addr":"172.21.15.105:6819/16466051","heartbeat_back_addr":"172.21.15.105:6823/16466051","heartbeat_front_addr":"172.21.15.105:6821/16466051","state":["exists","up"]},{"osd":6,"uuid":"c48ec2c8-a4b8-4fc8-9c10-a69cd7cb2de7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6801","nonce":48914195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6803","nonce":48914195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6807","nonce":48914195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":48914195},{"type":"v1","addr":"172.21.15.105:6805","nonce":48914195}]},"public_addr":"172.21.15.105:6801/48914195","cluster_addr":"172.21.15.105:6803/48914195","heartbeat_back_addr":"172.21.15.105:6807/48914195","heartbeat_front_addr":"172.21.15.105:6805/48914195","state":["exists","up"]},{"osd":7,"uuid":"52f0c7f6-1764-4e6b-a135-40a6d07df0b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6825","nonce":2648783557}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6827","nonce":2648783557}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6831","nonce":2648783557}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":2648783557},{"type":"v1","addr":"172.21.15.105:6829","nonce":2648783557}]},"public_addr":"172.21.15.105:6825/2648783557","cluster_addr":"172.21.15.105:6827/2648783557","heartbeat_back_addr":"172.21.15.105:6831/2648783557","heartbeat_front_addr":"172.21.15.105:6829/2648783557","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.184953+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.931499+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.684094+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.168712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:41.507494+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.506596+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.067694+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T01:35:42.279364+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.105:6834/705814866":"2024-09-13T01:44:49.278304+0000","172.21.15.105:6832/705814866":"2024-09-13T01:44:49.278304+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:44:55.816 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.816+0000 7fc7e967b640 1 -- 172.21.15.60:0/2082666521 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc7c406be30 msgr2=0x7fc7c406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.816+0000 7fc7e967b640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc7c406be30 0x7fc7c406e2f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009a20 tx=0x7fc7dc008040 comp rx=0 tx=0).stop 2024-09-12T01:44:55.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.816+0000 7fc7e967b640 1 -- 172.21.15.60:0/2082666521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e40d3310 msgr2=0x7fc7e40b9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:55.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.816+0000 7fc7e967b640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e40d3310 0x7fc7e40b9b30 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc000c00 tx=0x7fc7cc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.816+0000 7fc7e967b640 1 -- 172.21.15.60:0/2082666521 shutdown_connections 2024-09-12T01:44:55.817 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.816+0000 7fc7e967b640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc7c406be30 0x7fc7c406e2f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.816+0000 7fc7e967b640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc7e415e660 0x7fc7e40ba070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.816+0000 7fc7e967b640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7e40d3310 0x7fc7e40b9b30 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.816+0000 7fc7e967b640 1 --2- 172.21.15.60:0/2082666521 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc7e40d1650 0x7fc7e40ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:55.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.816+0000 7fc7e967b640 1 -- 172.21.15.60:0/2082666521 >> 172.21.15.60:0/2082666521 conn(0x7fc7e40b6410 msgr2=0x7fc7e41596e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:55.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.816+0000 7fc7e967b640 1 -- 172.21.15.60:0/2082666521 shutdown_connections 2024-09-12T01:44:55.818 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:55.816+0000 7fc7e967b640 1 -- 172.21.15.60:0/2082666521 wait complete. 2024-09-12T01:44:56.829 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T01:44:56.829 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:44:56.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.949+0000 7ffb0d642640 1 Processor -- start 2024-09-12T01:44:56.949 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.950+0000 7ffb0d642640 1 -- start start 2024-09-12T01:44:56.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.950+0000 7ffb0d642640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb0806ff70 0x7ffb080d1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:56.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.950+0000 7ffb0d642640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb080b56e0 con 0x7ffb0806fae0 2024-09-12T01:44:56.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.950+0000 7ffb0d642640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb080d1240 con 0x7ffb0815c550 2024-09-12T01:44:56.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.950+0000 7ffb0d642640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7ffb080d1800 con 0x7ffb0806ff70 2024-09-12T01:44:56.950 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.951+0000 7ffb077fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffb0806ff70 0x7ffb080d1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:56.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.951+0000 7ffb067fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ffb0806fae0 0x7ffb080b5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35506/0 (socket says 172.21.15.60:35506) 2024-09-12T01:44:56.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.951+0000 7ffb067fc640 1 -- 172.21.15.60:0/122069838 learned_addr learned my addr 172.21.15.60:0/122069838 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:56.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.951+0000 7ffb077fe640 1 -- 172.21.15.60:0/122069838 >> v1:172.21.15.105:6789/0 conn(0x7ffb0815c550 legacy=0x7ffb0806f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:56.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.951+0000 7ffb077fe640 1 -- 172.21.15.60:0/122069838 >> v1:172.21.15.60:6789/0 conn(0x7ffb0806fae0 legacy=0x7ffb080b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:56.951 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.951+0000 7ffb077fe640 1 -- 172.21.15.60:0/122069838 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb080d1520 con 0x7ffb0806ff70 2024-09-12T01:44:56.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.952+0000 7ffb077fe640 1 --2- 172.21.15.60:0/122069838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0806ff70 0x7ffb080d1eb0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7ffb000097a0 tx=0x7ffb0002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531faa2dbb3e1729 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:56.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.952+0000 7ffb05ffb640 1 -- 172.21.15.60:0/122069838 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00037070 con 0x7ffb0806ff70 2024-09-12T01:44:56.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.952+0000 7ffb05ffb640 1 -- 172.21.15.60:0/122069838 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb0002ae50 con 0x7ffb0806ff70 2024-09-12T01:44:56.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.952+0000 7ffb05ffb640 1 -- 172.21.15.60:0/122069838 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00032660 con 0x7ffb0806ff70 2024-09-12T01:44:56.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.952+0000 7ffb0d642640 1 -- 172.21.15.60:0/122069838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0806ff70 msgr2=0x7ffb080d1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:56.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.952+0000 7ffb0d642640 1 --2- 172.21.15.60:0/122069838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0806ff70 0x7ffb080d1eb0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7ffb000097a0 tx=0x7ffb0002a140 comp rx=0 tx=0).stop 2024-09-12T01:44:56.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.952+0000 7ffb0d642640 1 -- 172.21.15.60:0/122069838 shutdown_connections 2024-09-12T01:44:56.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.952+0000 7ffb0d642640 1 --2- 172.21.15.60:0/122069838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0806ff70 0x7ffb080d1eb0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:56.952 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.952+0000 7ffb0d642640 1 -- 172.21.15.60:0/122069838 >> 172.21.15.60:0/122069838 conn(0x7ffb080d24d0 msgr2=0x7ffb080d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:56.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.953+0000 7ffb0d642640 1 -- 172.21.15.60:0/122069838 shutdown_connections 2024-09-12T01:44:56.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.953+0000 7ffb0d642640 1 -- 172.21.15.60:0/122069838 wait complete. 2024-09-12T01:44:56.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.954+0000 7ffb0d642640 1 Processor -- start 2024-09-12T01:44:56.953 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.954+0000 7ffb0d642640 1 -- start start 2024-09-12T01:44:56.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb0d642640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0806fae0 0x7ffb081f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:56.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb0d642640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb0806ff70 0x7ffb08152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:56.955 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb0d642640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb0815c550 0x7ffb081531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb0d642640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffb080b6730 con 0x7ffb0806fae0 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb0d642640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ffb080b65b0 con 0x7ffb0815c550 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb0d642640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ffb080b68b0 con 0x7ffb0806ff70 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb06ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0806fae0 0x7ffb081f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb06ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0806fae0 0x7ffb081f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52282/0 (socket says 172.21.15.60:52282) 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb06ffd640 1 -- 172.21.15.60:0/3112597851 learned_addr learned my addr 172.21.15.60:0/3112597851 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb077fe640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb0815c550 0x7ffb081531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb067fc640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb0806ff70 0x7ffb08152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb06ffd640 1 -- 172.21.15.60:0/3112597851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb0806ff70 msgr2=0x7ffb08152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb06ffd640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb0806ff70 0x7ffb08152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb06ffd640 1 -- 172.21.15.60:0/3112597851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb0815c550 msgr2=0x7ffb081531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb06ffd640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb0815c550 0x7ffb081531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:56.956 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb06ffd640 1 -- 172.21.15.60:0/3112597851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb081f57f0 con 0x7ffb0806fae0 2024-09-12T01:44:56.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb077fe640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ffb0815c550 0x7ffb081531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:56.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb067fc640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffb0806ff70 0x7ffb08152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:56.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffb06ffd640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0806fae0 0x7ffb081f52b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800ba80 tx=0x7ffaf800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:56.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.955+0000 7ffaff7fe640 1 -- 172.21.15.60:0/3112597851 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf800cc00 con 0x7ffb0806fae0 2024-09-12T01:44:56.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.956+0000 7ffaff7fe640 1 -- 172.21.15.60:0/3112597851 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf800cda0 con 0x7ffb0806fae0 2024-09-12T01:44:56.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.956+0000 7ffaff7fe640 1 -- 172.21.15.60:0/3112597851 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8003bb0 con 0x7ffb0806fae0 2024-09-12T01:44:56.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.956+0000 7ffb0d642640 1 -- 172.21.15.60:0/3112597851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0815e7a0 con 0x7ffb0806fae0 2024-09-12T01:44:56.957 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.956+0000 7ffb0d642640 1 -- 172.21.15.60:0/3112597851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb0815f040 con 0x7ffb0806fae0 2024-09-12T01:44:56.958 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.956+0000 7ffb0d642640 1 -- 172.21.15.60:0/3112597851 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb080d1eb0 con 0x7ffb0806fae0 2024-09-12T01:44:56.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.957+0000 7ffaff7fe640 1 -- 172.21.15.60:0/3112597851 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ffaf8014440 con 0x7ffb0806fae0 2024-09-12T01:44:56.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.957+0000 7ffaff7fe640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffae806be30 0x7ffae806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:56.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.958+0000 7ffaff7fe640 1 -- 172.21.15.60:0/3112597851 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7ffaf808ab20 con 0x7ffb0806fae0 2024-09-12T01:44:56.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.958+0000 7ffb067fc640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffae806be30 0x7ffae806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:56.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.958+0000 7ffaff7fe640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] conn(0x7ffae8071cf0 0x7ffae8074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:56.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.958+0000 7ffaff7fe640 1 -- 172.21.15.60:0/3112597851 --> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffae80747c0 con 0x7ffae8071cf0 2024-09-12T01:44:56.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.958+0000 7ffaff7fe640 1 -- 172.21.15.60:0/3112597851 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=142) ==== 24+0+0 (secure 0 0 0) 0x7ffaf808f2a0 con 0x7ffb0806fae0 2024-09-12T01:44:56.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.958+0000 7ffb077fe640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] conn(0x7ffae8071cf0 0x7ffae8074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:56.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.958+0000 7ffb067fc640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffae806be30 0x7ffae806e2f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ffb08154440 tx=0x7ffaf0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:56.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.958+0000 7ffb077fe640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] conn(0x7ffae8071cf0 0x7ffae8074110 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:56.959 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.959+0000 7ffaff7fe640 1 -- 172.21.15.60:0/3112597851 <== osd.0 v2:172.21.15.60:6818/1570261314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffae80747c0 con 0x7ffae8071cf0 2024-09-12T01:44:56.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.972+0000 7ffb0d642640 1 -- 172.21.15.60:0/3112597851 --> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffb0815eb40 con 0x7ffae8071cf0 2024-09-12T01:44:56.971 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.972+0000 7ffaff7fe640 1 -- 172.21.15.60:0/3112597851 <== osd.0 v2:172.21.15.60:6818/1570261314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffb0815eb40 con 0x7ffae8071cf0 2024-09-12T01:44:56.972 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:44:56.972 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:44:56.972 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:44:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.972+0000 7ffb0d642640 1 -- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] conn(0x7ffae8071cf0 msgr2=0x7ffae8074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.972+0000 7ffb0d642640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:6818/1570261314,v1:172.21.15.60:6819/1570261314] conn(0x7ffae8071cf0 0x7ffae8074110 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.972+0000 7ffb0d642640 1 -- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffae806be30 msgr2=0x7ffae806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.972+0000 7ffb0d642640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ffae806be30 0x7ffae806e2f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7ffb08154440 tx=0x7ffaf0009040 comp rx=0 tx=0).stop 2024-09-12T01:44:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.972+0000 7ffb0d642640 1 -- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0806fae0 msgr2=0x7ffb081f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.972+0000 7ffb0d642640 1 --2- 172.21.15.60:0/3112597851 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffb0806fae0 0x7ffb081f52b0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800ba80 tx=0x7ffaf800bf40 comp rx=0 tx=0).stop 2024-09-12T01:44:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.972+0000 7ffb077fe640 1 -- 172.21.15.60:0/3112597851 reap_dead start 2024-09-12T01:44:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.972+0000 7ffb0d642640 1 -- 172.21.15.60:0/3112597851 shutdown_connections 2024-09-12T01:44:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.972+0000 7ffb0d642640 1 -- 172.21.15.60:0/3112597851 >> 172.21.15.60:0/3112597851 conn(0x7ffb080d24d0 msgr2=0x7ffb080b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.972+0000 7ffb0d642640 1 -- 172.21.15.60:0/3112597851 shutdown_connections 2024-09-12T01:44:56.973 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:56.973+0000 7ffb0d642640 1 -- 172.21.15.60:0/3112597851 wait complete. 2024-09-12T01:44:56.983 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T01:44:57.086 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.087+0000 7fe0fad33640 1 Processor -- start 2024-09-12T01:44:57.087 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.087+0000 7fe0fad33640 1 -- start start 2024-09-12T01:44:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.088+0000 7fe0fad33640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe0f415e6f0 0x7fe0f406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.088+0000 7fe0fad33640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 0x7fe0f415f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.088+0000 7fe0fad33640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0f406e990 con 0x7fe0f40b54d0 2024-09-12T01:44:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.088+0000 7fe0fad33640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fe0f406ec70 con 0x7fe0f415e6f0 2024-09-12T01:44:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.088+0000 7fe0fad33640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f415ec70 con 0x7fe0f40b7450 2024-09-12T01:44:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.088+0000 7fe0f8acf640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe0f415e6f0 0x7fe0f406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.088+0000 7fe0f92d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 0x7fe0f415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.088+0000 7fe0f92d0640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 0x7fe0f415f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:42536/0 (socket says 172.21.15.60:42536) 2024-09-12T01:44:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.088+0000 7fe0f8acf640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fe0f415e6f0 0x7fe0f406fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.60:48636/0 (socket says 172.21.15.60:48636) 2024-09-12T01:44:57.088 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.088+0000 7fe0f92d0640 1 -- 172.21.15.60:0/2200553417 learned_addr learned my addr 172.21.15.60:0/2200553417 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.089+0000 7fe0f8acf640 1 -- 172.21.15.60:0/2200553417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 msgr2=0x7fe0f415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.089+0000 7fe0f8acf640 1 --2- 172.21.15.60:0/2200553417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 0x7fe0f415f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.089+0000 7fe0f8acf640 1 -- 172.21.15.60:0/2200553417 >> v1:172.21.15.105:6789/0 conn(0x7fe0f40b54d0 legacy=0x7fe0f40b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.089+0000 7fe0f8acf640 1 -- 172.21.15.60:0/2200553417 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f415ef50 con 0x7fe0f415e6f0 2024-09-12T01:44:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.089+0000 7fe0f92d0640 1 --2- 172.21.15.60:0/2200553417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 0x7fe0f415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.089+0000 7fe0f8acf640 1 --2- 172.21.15.60:0/2200553417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0f415e6f0 0x7fe0f406fd00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00097a0 tx=0x7fe0f002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60b647583b3452e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.090+0000 7fe0eb7fe640 1 -- 172.21.15.60:0/2200553417 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0037070 con 0x7fe0f415e6f0 2024-09-12T01:44:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.090+0000 7fe0eb7fe640 1 -- 172.21.15.60:0/2200553417 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f0032440 con 0x7fe0f415e6f0 2024-09-12T01:44:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.090+0000 7fe0eb7fe640 1 -- 172.21.15.60:0/2200553417 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0032810 con 0x7fe0f415e6f0 2024-09-12T01:44:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.090+0000 7fe0fad33640 1 -- 172.21.15.60:0/2200553417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0f415e6f0 msgr2=0x7fe0f406fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.090 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.090+0000 7fe0fad33640 1 --2- 172.21.15.60:0/2200553417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0f415e6f0 0x7fe0f406fd00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00097a0 tx=0x7fe0f002a180 comp rx=0 tx=0).stop 2024-09-12T01:44:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.090+0000 7fe0fad33640 1 -- 172.21.15.60:0/2200553417 shutdown_connections 2024-09-12T01:44:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.090+0000 7fe0fad33640 1 --2- 172.21.15.60:0/2200553417 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 0x7fe0f415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.090+0000 7fe0fad33640 1 --2- 172.21.15.60:0/2200553417 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0f415e6f0 0x7fe0f406fd00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.090+0000 7fe0fad33640 1 -- 172.21.15.60:0/2200553417 >> 172.21.15.60:0/2200553417 conn(0x7fe0f40d2430 msgr2=0x7fe0f40d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.090+0000 7fe0fad33640 1 -- 172.21.15.60:0/2200553417 shutdown_connections 2024-09-12T01:44:57.091 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.090+0000 7fe0fad33640 1 -- 172.21.15.60:0/2200553417 wait complete. 2024-09-12T01:44:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.091+0000 7fe0fad33640 1 Processor -- start 2024-09-12T01:44:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.091+0000 7fe0fad33640 1 -- start start 2024-09-12T01:44:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.092+0000 7fe0fad33640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b54d0 0x7fe0f4154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.092+0000 7fe0fad33640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 0x7fe0f4153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.092+0000 7fe0fad33640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0f415e6f0 0x7fe0f4153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.092+0000 7fe0fad33640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f406e730 con 0x7fe0f40b54d0 2024-09-12T01:44:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.092+0000 7fe0fad33640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f406e5b0 con 0x7fe0f415e6f0 2024-09-12T01:44:57.093 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.092+0000 7fe0fad33640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f4070830 con 0x7fe0f40b7450 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.092+0000 7fe0f8acf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b54d0 0x7fe0f4154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.092+0000 7fe0f8acf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b54d0 0x7fe0f4154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52284/0 (socket says 172.21.15.60:52284) 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.092+0000 7fe0f8acf640 1 -- 172.21.15.60:0/2846675286 learned_addr learned my addr 172.21.15.60:0/2846675286 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.092+0000 7fe0f92d0640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0f415e6f0 0x7fe0f4153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.092+0000 7fe0ebfff640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 0x7fe0f4153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.093+0000 7fe0f8acf640 1 -- 172.21.15.60:0/2846675286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 msgr2=0x7fe0f4153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.093+0000 7fe0f8acf640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 0x7fe0f4153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.093+0000 7fe0f8acf640 1 -- 172.21.15.60:0/2846675286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0f415e6f0 msgr2=0x7fe0f4153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.093+0000 7fe0f8acf640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0f415e6f0 0x7fe0f4153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.093+0000 7fe0f8acf640 1 -- 172.21.15.60:0/2846675286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f4160930 con 0x7fe0f40b54d0 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.093+0000 7fe0ebfff640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 0x7fe0f4153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.093+0000 7fe0f8acf640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b54d0 0x7fe0f4154dc0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00098c0 tx=0x7fe0f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.094 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.093+0000 7fe0e97fa640 1 -- 172.21.15.60:0/2846675286 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0037040 con 0x7fe0f40b54d0 2024-09-12T01:44:57.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.093+0000 7fe0e97fa640 1 -- 172.21.15.60:0/2846675286 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0f0030500 con 0x7fe0f40b54d0 2024-09-12T01:44:57.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.093+0000 7fe0fad33640 1 -- 172.21.15.60:0/2846675286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f4160c10 con 0x7fe0f40b54d0 2024-09-12T01:44:57.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.093+0000 7fe0e97fa640 1 -- 172.21.15.60:0/2846675286 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f00308d0 con 0x7fe0f40b54d0 2024-09-12T01:44:57.095 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.093+0000 7fe0fad33640 1 -- 172.21.15.60:0/2846675286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f41611d0 con 0x7fe0f40b54d0 2024-09-12T01:44:57.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.094+0000 7fe0fad33640 1 -- 172.21.15.60:0/2846675286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f415f750 con 0x7fe0f40b54d0 2024-09-12T01:44:57.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.095+0000 7fe0e97fa640 1 -- 172.21.15.60:0/2846675286 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fe0f0044020 con 0x7fe0f40b54d0 2024-09-12T01:44:57.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.095+0000 7fe0e97fa640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe0e006be30 0x7fe0e006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.095+0000 7fe0e97fa640 1 -- 172.21.15.60:0/2846675286 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7fe0f00aad30 con 0x7fe0f40b54d0 2024-09-12T01:44:57.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.095+0000 7fe0ebfff640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe0e006be30 0x7fe0e006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.096 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.096+0000 7fe0ebfff640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe0e006be30 0x7fe0e006e2f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40d1680 tx=0x7fe0e4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.099 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.100+0000 7fe0e97fa640 1 -- 172.21.15.60:0/2846675286 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fe0f00799e0 con 0x7fe0f40b54d0 2024-09-12T01:44:57.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.275+0000 7fe0fad33640 1 -- 172.21.15.60:0/2846675286 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe0f406d1e0 con 0x7fe0e006be30 2024-09-12T01:44:57.275 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.276+0000 7fe0e97fa640 1 -- 172.21.15.60:0/2846675286 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe0f406d1e0 con 0x7fe0e006be30 2024-09-12T01:44:57.275 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T01:44:57.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.277+0000 7fe0fad33640 1 -- 172.21.15.60:0/2846675286 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe0e006be30 msgr2=0x7fe0e006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.277 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.277+0000 7fe0fad33640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe0e006be30 0x7fe0e006e2f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40d1680 tx=0x7fe0e4009040 comp rx=0 tx=0).stop 2024-09-12T01:44:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.277+0000 7fe0fad33640 1 -- 172.21.15.60:0/2846675286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b54d0 msgr2=0x7fe0f4154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.278+0000 7fe0fad33640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b54d0 0x7fe0f4154dc0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00098c0 tx=0x7fe0f00046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.278+0000 7fe0fad33640 1 -- 172.21.15.60:0/2846675286 shutdown_connections 2024-09-12T01:44:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.278+0000 7fe0fad33640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fe0f415e6f0 0x7fe0f4153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.278+0000 7fe0fad33640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fe0e006be30 0x7fe0e006e2f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.278+0000 7fe0fad33640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe0f40b7450 0x7fe0f4153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.278+0000 7fe0fad33640 1 --2- 172.21.15.60:0/2846675286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b54d0 0x7fe0f4154dc0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.278+0000 7fe0fad33640 1 -- 172.21.15.60:0/2846675286 >> 172.21.15.60:0/2846675286 conn(0x7fe0f40d2430 msgr2=0x7fe0f406d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.278+0000 7fe0fad33640 1 -- 172.21.15.60:0/2846675286 shutdown_connections 2024-09-12T01:44:57.278 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.278+0000 7fe0fad33640 1 -- 172.21.15.60:0/2846675286 wait complete. 2024-09-12T01:44:57.288 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T01:44:57.288 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:44:57.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.395+0000 7ff919ab7640 1 Processor -- start 2024-09-12T01:44:57.394 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.395+0000 7ff919ab7640 1 -- start start 2024-09-12T01:44:57.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.395+0000 7ff919ab7640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff9140b3920 0x7ff914162b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.395+0000 7ff919ab7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9140d29a0 0x7ff9140d2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.395 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.395+0000 7ff919ab7640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91415ed70 con 0x7ff91415e990 2024-09-12T01:44:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.395+0000 7ff919ab7640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7ff9140cff20 con 0x7ff9140b3920 2024-09-12T01:44:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.395+0000 7ff919ab7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff9140b3d60 con 0x7ff9140d29a0 2024-09-12T01:44:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.396+0000 7ff9137fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff91415e990 0x7ff914162450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35510/0 (socket says 172.21.15.60:35510) 2024-09-12T01:44:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.396+0000 7ff9137fe640 1 -- 172.21.15.60:0/3529206768 learned_addr learned my addr 172.21.15.60:0/3529206768 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.396+0000 7ff90affd640 1 --2- 172.21.15.60:0/3529206768 >> v2:172.21.15.105:3300/0 conn(0x7ff9140b3920 0x7ff914162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.396+0000 7ff913fff640 1 --2- 172.21.15.60:0/3529206768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9140d29a0 0x7ff9140d2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.396+0000 7ff912ffd640 1 -- 172.21.15.60:0/3529206768 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264258531 0 0) 0x7ff904001110 con 0x7ff91415e990 2024-09-12T01:44:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.396+0000 7ff912ffd640 1 -- 172.21.15.60:0/3529206768 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff900003520 con 0x7ff91415e990 2024-09-12T01:44:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.396+0000 7ff913fff640 1 -- 172.21.15.60:0/3529206768 >> v2:172.21.15.105:3300/0 conn(0x7ff9140b3920 msgr2=0x7ff914162b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.396+0000 7ff913fff640 1 --2- 172.21.15.60:0/3529206768 >> v2:172.21.15.105:3300/0 conn(0x7ff9140b3920 0x7ff914162b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.396+0000 7ff912ffd640 1 -- 172.21.15.60:0/3529206768 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 427817633 0 0) 0x7ff900003520 con 0x7ff91415e990 2024-09-12T01:44:57.396 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.396+0000 7ff913fff640 1 -- 172.21.15.60:0/3529206768 >> v1:172.21.15.60:6789/0 conn(0x7ff91415e990 legacy=0x7ff914162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.396+0000 7ff913fff640 1 -- 172.21.15.60:0/3529206768 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9140d1fa0 con 0x7ff9140d29a0 2024-09-12T01:44:57.397 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.396+0000 7ff90affd640 1 --2- 172.21.15.60:0/3529206768 >> v2:172.21.15.105:3300/0 conn(0x7ff9140b3920 0x7ff914162b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.397+0000 7ff913fff640 1 --2- 172.21.15.60:0/3529206768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9140d29a0 0x7ff9140d2e30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009d90 tx=0x7ff90c02a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ace17a415ac0e24 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.397+0000 7ff912ffd640 1 -- 172.21.15.60:0/3529206768 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904001840 con 0x7ff9140d29a0 2024-09-12T01:44:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.397+0000 7ff912ffd640 1 -- 172.21.15.60:0/3529206768 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff90c007540 con 0x7ff9140d29a0 2024-09-12T01:44:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.397+0000 7ff912ffd640 1 -- 172.21.15.60:0/3529206768 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c0078f0 con 0x7ff9140d29a0 2024-09-12T01:44:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.398+0000 7ff919ab7640 1 -- 172.21.15.60:0/3529206768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9140d29a0 msgr2=0x7ff9140d2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.398+0000 7ff919ab7640 1 --2- 172.21.15.60:0/3529206768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9140d29a0 0x7ff9140d2e30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff90c009d90 tx=0x7ff90c02a560 comp rx=0 tx=0).stop 2024-09-12T01:44:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.398+0000 7ff919ab7640 1 -- 172.21.15.60:0/3529206768 shutdown_connections 2024-09-12T01:44:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.398+0000 7ff919ab7640 1 --2- 172.21.15.60:0/3529206768 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff9140d29a0 0x7ff9140d2e30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.398+0000 7ff919ab7640 1 --2- 172.21.15.60:0/3529206768 >> v2:172.21.15.105:3300/0 conn(0x7ff9140b3920 0x7ff914162b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.398+0000 7ff919ab7640 1 -- 172.21.15.60:0/3529206768 >> 172.21.15.60:0/3529206768 conn(0x7ff9140d1200 msgr2=0x7ff9140d1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:57.398 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.398+0000 7ff919ab7640 1 -- 172.21.15.60:0/3529206768 shutdown_connections 2024-09-12T01:44:57.399 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.398+0000 7ff919ab7640 1 -- 172.21.15.60:0/3529206768 wait complete. 2024-09-12T01:44:57.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.399+0000 7ff919ab7640 1 Processor -- start 2024-09-12T01:44:57.400 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.399+0000 7ff919ab7640 1 -- start start 2024-09-12T01:44:57.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff919ab7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b3920 0x7ff9140c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff919ab7640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9140d29a0 0x7ff91415f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff919ab7640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415e990 0x7ff91415fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff919ab7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff9141630a0 con 0x7ff9140b3920 2024-09-12T01:44:57.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff919ab7640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7ff9140cfc40 con 0x7ff9140d29a0 2024-09-12T01:44:57.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff919ab7640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7ff914163220 con 0x7ff91415e990 2024-09-12T01:44:57.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b3920 0x7ff9140c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff9137fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b3920 0x7ff9140c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52300/0 (socket says 172.21.15.60:52300) 2024-09-12T01:44:57.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff9137fe640 1 -- 172.21.15.60:0/4257792860 learned_addr learned my addr 172.21.15.60:0/4257792860 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:57.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff90affd640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9140d29a0 0x7ff91415f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff913fff640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415e990 0x7ff91415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.401 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff9137fe640 1 -- 172.21.15.60:0/4257792860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415e990 msgr2=0x7ff91415fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff9137fe640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415e990 0x7ff91415fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff9137fe640 1 -- 172.21.15.60:0/4257792860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9140d29a0 msgr2=0x7ff91415f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff9137fe640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7ff9140d29a0 0x7ff91415f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff9137fe640 1 -- 172.21.15.60:0/4257792860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9140ca0b0 con 0x7ff9140b3920 2024-09-12T01:44:57.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff913fff640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff91415e990 0x7ff91415fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:57.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.400+0000 7ff9137fe640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b3920 0x7ff9140c85d0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7ff90400c500 tx=0x7ff90400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.401+0000 7ff910ff9640 1 -- 172.21.15.60:0/4257792860 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904017070 con 0x7ff9140b3920 2024-09-12T01:44:57.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.401+0000 7ff910ff9640 1 -- 172.21.15.60:0/4257792860 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff904005ce0 con 0x7ff9140b3920 2024-09-12T01:44:57.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.401+0000 7ff919ab7640 1 -- 172.21.15.60:0/4257792860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9140ca350 con 0x7ff9140b3920 2024-09-12T01:44:57.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.401+0000 7ff910ff9640 1 -- 172.21.15.60:0/4257792860 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff904007310 con 0x7ff9140b3920 2024-09-12T01:44:57.402 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.401+0000 7ff919ab7640 1 -- 172.21.15.60:0/4257792860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9140ca910 con 0x7ff9140b3920 2024-09-12T01:44:57.403 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.401+0000 7ff919ab7640 1 -- 172.21.15.60:0/4257792860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff914162450 con 0x7ff9140b3920 2024-09-12T01:44:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.402+0000 7ff910ff9640 1 -- 172.21.15.60:0/4257792860 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7ff90401a070 con 0x7ff9140b3920 2024-09-12T01:44:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.403+0000 7ff910ff9640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff8f406be30 0x7ff8f406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.403+0000 7ff910ff9640 1 -- 172.21.15.60:0/4257792860 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7ff904089f80 con 0x7ff9140b3920 2024-09-12T01:44:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.403+0000 7ff90affd640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff8f406be30 0x7ff8f406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.403+0000 7ff910ff9640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] conn(0x7ff8f4071cf0 0x7ff8f4074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.403+0000 7ff910ff9640 1 -- 172.21.15.60:0/4257792860 --> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff904014ec0 con 0x7ff8f4071cf0 2024-09-12T01:44:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.403+0000 7ff910ff9640 1 -- 172.21.15.60:0/4257792860 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=142) ==== 24+0+0 (secure 0 0 0) 0x7ff90408c620 con 0x7ff9140b3920 2024-09-12T01:44:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.403+0000 7ff913fff640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] conn(0x7ff8f4071cf0 0x7ff8f4074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.403+0000 7ff90affd640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff8f406be30 0x7ff8f406e2f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009560 tx=0x7ff8fc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.403+0000 7ff913fff640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] conn(0x7ff8f4071cf0 0x7ff8f4074110 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.404 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.404+0000 7ff910ff9640 1 -- 172.21.15.60:0/4257792860 <== osd.1 v2:172.21.15.60:6810/1439609768 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff904014ec0 con 0x7ff8f4071cf0 2024-09-12T01:44:57.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.416+0000 7ff919ab7640 1 -- 172.21.15.60:0/4257792860 --> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff9140ba700 con 0x7ff8f4071cf0 2024-09-12T01:44:57.416 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.417+0000 7ff910ff9640 1 -- 172.21.15.60:0/4257792860 <== osd.1 v2:172.21.15.60:6810/1439609768 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff9140ba700 con 0x7ff8f4071cf0 2024-09-12T01:44:57.416 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:44:57.416 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:44:57.417 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:44:57.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.417+0000 7ff919ab7640 1 -- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] conn(0x7ff8f4071cf0 msgr2=0x7ff8f4074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.417 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.417+0000 7ff919ab7640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:6810/1439609768,v1:172.21.15.60:6811/1439609768] conn(0x7ff8f4071cf0 0x7ff8f4074110 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.417+0000 7ff919ab7640 1 -- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff8f406be30 msgr2=0x7ff8f406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.417+0000 7ff919ab7640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7ff8f406be30 0x7ff8f406e2f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc009560 tx=0x7ff8fc009190 comp rx=0 tx=0).stop 2024-09-12T01:44:57.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.417+0000 7ff919ab7640 1 -- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b3920 msgr2=0x7ff9140c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.417+0000 7ff919ab7640 1 --2- 172.21.15.60:0/4257792860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9140b3920 0x7ff9140c85d0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7ff90400c500 tx=0x7ff90400c9c0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.417+0000 7ff913fff640 1 -- 172.21.15.60:0/4257792860 reap_dead start 2024-09-12T01:44:57.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.417+0000 7ff919ab7640 1 -- 172.21.15.60:0/4257792860 shutdown_connections 2024-09-12T01:44:57.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.417+0000 7ff919ab7640 1 -- 172.21.15.60:0/4257792860 >> 172.21.15.60:0/4257792860 conn(0x7ff9140d1200 msgr2=0x7ff914160d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:57.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.417+0000 7ff919ab7640 1 -- 172.21.15.60:0/4257792860 shutdown_connections 2024-09-12T01:44:57.418 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.417+0000 7ff919ab7640 1 -- 172.21.15.60:0/4257792860 wait complete. 2024-09-12T01:44:57.427 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T01:44:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.530+0000 7f97508f1640 1 Processor -- start 2024-09-12T01:44:57.530 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.530+0000 7f97508f1640 1 -- start start 2024-09-12T01:44:57.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.531+0000 7f97508f1640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f974c15e7a0 0x7f974c06caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.531+0000 7f97508f1640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f974c0cf860 con 0x7f974c0cf1f0 2024-09-12T01:44:57.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.531+0000 7f97508f1640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f974c0cfb40 con 0x7f974c0b68f0 2024-09-12T01:44:57.531 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.531+0000 7f97508f1640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f974c0d2ca0 con 0x7f974c15e7a0 2024-09-12T01:44:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.532+0000 7f974a59c640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f974c15e7a0 0x7f974c06caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.532+0000 7f9749d9b640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f974c0cf1f0 0x7f974c0b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35516/0 (socket says 172.21.15.60:35516) 2024-09-12T01:44:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.532+0000 7f9749d9b640 1 -- 172.21.15.60:0/805295379 learned_addr learned my addr 172.21.15.60:0/805295379 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.532+0000 7f974a59c640 1 -- 172.21.15.60:0/805295379 >> v1:172.21.15.105:6789/0 conn(0x7f974c0b68f0 legacy=0x7f974c0d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.532+0000 7f974a59c640 1 -- 172.21.15.60:0/805295379 >> v1:172.21.15.60:6789/0 conn(0x7f974c0cf1f0 legacy=0x7f974c0b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.532+0000 7f974a59c640 1 -- 172.21.15.60:0/805295379 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c0cfe20 con 0x7f974c15e7a0 2024-09-12T01:44:57.532 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.532+0000 7f974959a640 1 -- 172.21.15.60:0/805295379 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 702734311 0 0) 0x7f974c0cf860 con 0x7f974c0cf1f0 2024-09-12T01:44:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.533+0000 7f974a59c640 1 --2- 172.21.15.60:0/805295379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f974c15e7a0 0x7f974c06caa0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f973c0097a0 tx=0x7f973c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cceeea437f08ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.533+0000 7f974959a640 1 -- 172.21.15.60:0/805295379 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c037070 con 0x7f974c15e7a0 2024-09-12T01:44:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.533+0000 7f974959a640 1 -- 172.21.15.60:0/805295379 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973c032440 con 0x7f974c15e7a0 2024-09-12T01:44:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.533+0000 7f974959a640 1 -- 172.21.15.60:0/805295379 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973c032810 con 0x7f974c15e7a0 2024-09-12T01:44:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.533+0000 7f97508f1640 1 -- 172.21.15.60:0/805295379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f974c15e7a0 msgr2=0x7f974c06caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.533 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.533+0000 7f97508f1640 1 --2- 172.21.15.60:0/805295379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f974c15e7a0 0x7f974c06caa0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f973c0097a0 tx=0x7f973c02a1a0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.533+0000 7f97508f1640 1 -- 172.21.15.60:0/805295379 shutdown_connections 2024-09-12T01:44:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.533+0000 7f97508f1640 1 --2- 172.21.15.60:0/805295379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f974c15e7a0 0x7f974c06caa0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.533+0000 7f97508f1640 1 -- 172.21.15.60:0/805295379 >> 172.21.15.60:0/805295379 conn(0x7f974c0d11e0 msgr2=0x7f974c0d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.533+0000 7f97508f1640 1 -- 172.21.15.60:0/805295379 shutdown_connections 2024-09-12T01:44:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.534+0000 7f97508f1640 1 -- 172.21.15.60:0/805295379 wait complete. 2024-09-12T01:44:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.535+0000 7f97508f1640 1 Processor -- start 2024-09-12T01:44:57.534 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.535+0000 7f97508f1640 1 -- start start 2024-09-12T01:44:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f97508f1640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f974c0b68f0 0x7f974c159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f97508f1640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f974c0cf1f0 0x7f974c0ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f97508f1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f974c15e7a0 0x7f974c0ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.536 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f97508f1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f974c06cfe0 con 0x7f974c15e7a0 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f97508f1640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f974c0b7a00 con 0x7f974c0cf1f0 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f97508f1640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f974c15eb80 con 0x7f974c0b68f0 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f974ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f974c15e7a0 0x7f974c0ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f974ad9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f974c15e7a0 0x7f974c0ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52318/0 (socket says 172.21.15.60:52318) 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f974ad9d640 1 -- 172.21.15.60:0/1145553214 learned_addr learned my addr 172.21.15.60:0/1145553214 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f9749d9b640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f974c0cf1f0 0x7f974c0ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f974a59c640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f974c0b68f0 0x7f974c159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f974ad9d640 1 -- 172.21.15.60:0/1145553214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f974c0b68f0 msgr2=0x7f974c159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f974ad9d640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f974c0b68f0 0x7f974c159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f974ad9d640 1 -- 172.21.15.60:0/1145553214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f974c0cf1f0 msgr2=0x7f974c0ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f974ad9d640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f974c0cf1f0 0x7f974c0ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f974ad9d640 1 -- 172.21.15.60:0/1145553214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c0c96a0 con 0x7f974c15e7a0 2024-09-12T01:44:57.537 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f974a59c640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f974c0b68f0 0x7f974c159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:57.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f974ad9d640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f974c15e7a0 0x7f974c0ce9a0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f974400c760 tx=0x7f974400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f9742ffd640 1 -- 172.21.15.60:0/1145553214 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744003b70 con 0x7f974c15e7a0 2024-09-12T01:44:57.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f9742ffd640 1 -- 172.21.15.60:0/1145553214 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9744003d10 con 0x7f974c15e7a0 2024-09-12T01:44:57.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f97508f1640 1 -- 172.21.15.60:0/1145553214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974c0c9980 con 0x7f974c15e7a0 2024-09-12T01:44:57.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f9742ffd640 1 -- 172.21.15.60:0/1145553214 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974400aa90 con 0x7f974c15e7a0 2024-09-12T01:44:57.538 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.536+0000 7f97508f1640 1 -- 172.21.15.60:0/1145553214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f974c0c9f40 con 0x7f974c15e7a0 2024-09-12T01:44:57.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.538+0000 7f97508f1640 1 -- 172.21.15.60:0/1145553214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f974c06caa0 con 0x7f974c15e7a0 2024-09-12T01:44:57.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.538+0000 7f9742ffd640 1 -- 172.21.15.60:0/1145553214 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f974400ac30 con 0x7f974c15e7a0 2024-09-12T01:44:57.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.538+0000 7f9742ffd640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f972c06be30 0x7f972c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.539+0000 7f974a59c640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f972c06be30 0x7f972c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.539+0000 7f9742ffd640 1 -- 172.21.15.60:0/1145553214 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f974408a8f0 con 0x7f974c15e7a0 2024-09-12T01:44:57.539 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.539+0000 7f974a59c640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f972c06be30 0x7f972c06e2f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f973c034000 tx=0x7f973c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.542 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.543+0000 7f9742ffd640 1 -- 172.21.15.60:0/1145553214 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f9744059630 con 0x7f974c15e7a0 2024-09-12T01:44:57.717 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.718+0000 7f97508f1640 1 -- 172.21.15.60:0/1145553214 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f974c0d2a80 con 0x7f972c06be30 2024-09-12T01:44:57.718 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.718+0000 7f9742ffd640 1 -- 172.21.15.60:0/1145553214 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f974c0d2a80 con 0x7f972c06be30 2024-09-12T01:44:57.718 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T01:44:57.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.720+0000 7f97508f1640 1 -- 172.21.15.60:0/1145553214 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f972c06be30 msgr2=0x7f972c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.720+0000 7f97508f1640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f972c06be30 0x7f972c06e2f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f973c034000 tx=0x7f973c02e000 comp rx=0 tx=0).stop 2024-09-12T01:44:57.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.720+0000 7f97508f1640 1 -- 172.21.15.60:0/1145553214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f974c15e7a0 msgr2=0x7f974c0ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.720+0000 7f97508f1640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f974c15e7a0 0x7f974c0ce9a0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f974400c760 tx=0x7f974400cc20 comp rx=0 tx=0).stop 2024-09-12T01:44:57.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.720+0000 7f97508f1640 1 -- 172.21.15.60:0/1145553214 shutdown_connections 2024-09-12T01:44:57.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.720+0000 7f97508f1640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f974c15e7a0 0x7f974c0ce9a0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.720+0000 7f97508f1640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f974c0cf1f0 0x7f974c0ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.720 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.720+0000 7f97508f1640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f972c06be30 0x7f972c06e2f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.720+0000 7f97508f1640 1 --2- 172.21.15.60:0/1145553214 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f974c0b68f0 0x7f974c159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.720+0000 7f97508f1640 1 -- 172.21.15.60:0/1145553214 >> 172.21.15.60:0/1145553214 conn(0x7f974c0d11e0 msgr2=0x7f974c06c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:57.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.720+0000 7f97508f1640 1 -- 172.21.15.60:0/1145553214 shutdown_connections 2024-09-12T01:44:57.721 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.720+0000 7f97508f1640 1 -- 172.21.15.60:0/1145553214 wait complete. 2024-09-12T01:44:57.731 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T01:44:57.731 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:44:57.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.838+0000 7f8e26552640 1 Processor -- start 2024-09-12T01:44:57.837 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.838+0000 7f8e26552640 1 -- start start 2024-09-12T01:44:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e26552640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8e200b3360 0x7f8e200b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e26552640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200b3820 0x7f8e200b8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e26552640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e200d2ce0 con 0x7f8e2015eb10 2024-09-12T01:44:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e26552640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f8e200d2f80 con 0x7f8e200b3360 2024-09-12T01:44:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e26552640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8e200d3260 con 0x7f8e200b3820 2024-09-12T01:44:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1ffff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8e2015eb10 0x7f8e200d3a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35524/0 (socket says 172.21.15.60:35524) 2024-09-12T01:44:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1ffff640 1 -- 172.21.15.60:0/2830180630 learned_addr learned my addr 172.21.15.60:0/2830180630 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:57.840 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168259719 0 0) 0x7f8e200d2ce0 con 0x7f8e2015eb10 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e08003520 con 0x7f8e2015eb10 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1f7fe640 1 --2- 172.21.15.60:0/2830180630 >> v2:172.21.15.105:3300/0 conn(0x7f8e200b3360 0x7f8e200b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e24aef640 1 --2- 172.21.15.60:0/2830180630 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200b3820 0x7f8e200b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1205898027 0 0) 0x7f8e08003520 con 0x7f8e2015eb10 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200b3820 msgr2=0x7f8e200b8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 --2- 172.21.15.60:0/2830180630 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200b3820 0x7f8e200b8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 >> v2:172.21.15.105:3300/0 conn(0x7f8e200b3360 msgr2=0x7f8e200b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 --2- 172.21.15.60:0/2830180630 >> v2:172.21.15.105:3300/0 conn(0x7f8e200b3360 0x7f8e200b7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e200d3540 con 0x7f8e2015eb10 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7f8e10001670 con 0x7f8e2015eb10 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 >> v1:172.21.15.60:6789/0 conn(0x7f8e2015eb10 legacy=0x7f8e200d3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 --2- 172.21.15.60:0/2830180630 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200b3820 0x7f8e080039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.841 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 --2- 172.21.15.60:0/2830180630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e08003fe0 0x7f8e08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 --2- 172.21.15.60:0/2830180630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e08004d40 0x7f8e080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8e200d2f80 con 0x7f8e08003fe0 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8e200d3260 con 0x7f8e08004d40 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.839+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8e0800bb80 con 0x7f8e200b3820 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.840+0000 7f8e1f7fe640 1 --2- 172.21.15.60:0/2830180630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e08003fe0 0x7f8e08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.840+0000 7f8e1ffff640 1 --2- 172.21.15.60:0/2830180630 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200b3820 0x7f8e080039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.840+0000 7f8e24aef640 1 --2- 172.21.15.60:0/2830180630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e08004d40 0x7f8e080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.840+0000 7f8e1f7fe640 1 -- 172.21.15.60:0/2830180630 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200b3820 msgr2=0x7f8e080039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.840+0000 7f8e1f7fe640 1 --2- 172.21.15.60:0/2830180630 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e200b3820 0x7f8e080039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.840+0000 7f8e1f7fe640 1 -- 172.21.15.60:0/2830180630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e08004d40 msgr2=0x7f8e080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.840+0000 7f8e1f7fe640 1 --2- 172.21.15.60:0/2830180630 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e08004d40 0x7f8e080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.840+0000 7f8e1f7fe640 1 -- 172.21.15.60:0/2830180630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e08003520 con 0x7f8e08003fe0 2024-09-12T01:44:57.842 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.840+0000 7f8e1f7fe640 1 --2- 172.21.15.60:0/2830180630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e08003fe0 0x7f8e08004800 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400ba00 tx=0x7f8e08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5630785637986b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.841+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14030070 con 0x7f8e08003fe0 2024-09-12T01:44:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.841+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1402ade0 con 0x7f8e08003fe0 2024-09-12T01:44:57.843 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.841+0000 7f8e1effd640 1 -- 172.21.15.60:0/2830180630 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1400b600 con 0x7f8e08003fe0 2024-09-12T01:44:57.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.841+0000 7f8e26552640 1 -- 172.21.15.60:0/2830180630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e08003fe0 msgr2=0x7f8e08004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.841+0000 7f8e26552640 1 --2- 172.21.15.60:0/2830180630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e08003fe0 0x7f8e08004800 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400ba00 tx=0x7f8e08005830 comp rx=0 tx=0).stop 2024-09-12T01:44:57.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.841+0000 7f8e24aef640 1 -- 172.21.15.60:0/2830180630 reap_dead start 2024-09-12T01:44:57.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.841+0000 7f8e26552640 1 -- 172.21.15.60:0/2830180630 shutdown_connections 2024-09-12T01:44:57.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.841+0000 7f8e26552640 1 -- 172.21.15.60:0/2830180630 >> 172.21.15.60:0/2830180630 conn(0x7f8e200b61f0 msgr2=0x7f8e200b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:57.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.841+0000 7f8e26552640 1 -- 172.21.15.60:0/2830180630 shutdown_connections 2024-09-12T01:44:57.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.841+0000 7f8e26552640 1 -- 172.21.15.60:0/2830180630 wait complete. 2024-09-12T01:44:57.846 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.842+0000 7f8e26552640 1 Processor -- start 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.843+0000 7f8e26552640 1 -- start start 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.843+0000 7f8e26552640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e08003fe0 0x7f8e201f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.843+0000 7f8e26552640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e201f86a0 0x7f8e20160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.843+0000 7f8e26552640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e20160ad0 0x7f8e2015c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.843+0000 7f8e26552640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2015f070 con 0x7f8e20160ad0 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.843+0000 7f8e26552640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2015eef0 con 0x7f8e201f86a0 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.843+0000 7f8e26552640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f8e200b8080 con 0x7f8e08003fe0 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.843+0000 7f8e24aef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e20160ad0 0x7f8e2015c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.843+0000 7f8e24aef640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e20160ad0 0x7f8e2015c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52324/0 (socket says 172.21.15.60:52324) 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e24aef640 1 -- 172.21.15.60:0/1099629458 learned_addr learned my addr 172.21.15.60:0/1099629458 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e1f7fe640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e201f86a0 0x7f8e20160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e1ffff640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e08003fe0 0x7f8e201f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.847 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e24aef640 1 -- 172.21.15.60:0/1099629458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e08003fe0 msgr2=0x7f8e201f8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e24aef640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e08003fe0 0x7f8e201f8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e24aef640 1 -- 172.21.15.60:0/1099629458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e201f86a0 msgr2=0x7f8e20160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e24aef640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e201f86a0 0x7f8e20160590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e24aef640 1 -- 172.21.15.60:0/1099629458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e20161360 con 0x7f8e20160ad0 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e1f7fe640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f8e201f86a0 0x7f8e20160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e1ffff640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8e08003fe0 0x7f8e201f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e24aef640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e20160ad0 0x7f8e2015c290 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f8e200d0ac0 tx=0x7f8e18009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e1cff9640 1 -- 172.21.15.60:0/1099629458 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18007d20 con 0x7f8e20160ad0 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e1cff9640 1 -- 172.21.15.60:0/1099629458 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e18019070 con 0x7f8e20160ad0 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e1cff9640 1 -- 172.21.15.60:0/1099629458 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e18014650 con 0x7f8e20160ad0 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e26552640 1 -- 172.21.15.60:0/1099629458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e20161640 con 0x7f8e20160ad0 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.844+0000 7f8e26552640 1 -- 172.21.15.60:0/1099629458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e20161c00 con 0x7f8e20160ad0 2024-09-12T01:44:57.848 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.845+0000 7f8e26552640 1 -- 172.21.15.60:0/1099629458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8e200b7b40 con 0x7f8e20160ad0 2024-09-12T01:44:57.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.846+0000 7f8e1cff9640 1 -- 172.21.15.60:0/1099629458 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f8e180147f0 con 0x7f8e20160ad0 2024-09-12T01:44:57.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.846+0000 7f8e1cff9640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8e0c06be30 0x7f8e0c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.846+0000 7f8e1cff9640 1 -- 172.21.15.60:0/1099629458 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f8e1808b010 con 0x7f8e20160ad0 2024-09-12T01:44:57.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.846+0000 7f8e1ffff640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8e0c06be30 0x7f8e0c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.846+0000 7f8e1cff9640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] conn(0x7f8e0c071cf0 0x7f8e0c074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.846+0000 7f8e1cff9640 1 -- 172.21.15.60:0/1099629458 --> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8e18018ec0 con 0x7f8e0c071cf0 2024-09-12T01:44:57.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.846+0000 7f8e1cff9640 1 -- 172.21.15.60:0/1099629458 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=142) ==== 24+0+0 (secure 0 0 0) 0x7f8e18092050 con 0x7f8e20160ad0 2024-09-12T01:44:57.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.846+0000 7f8e1f7fe640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] conn(0x7f8e0c071cf0 0x7f8e0c074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.847+0000 7f8e1ffff640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8e0c06be30 0x7f8e0c06e2f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8e100015d0 tx=0x7f8e10009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.849 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.847+0000 7f8e1f7fe640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] conn(0x7f8e0c071cf0 0x7f8e0c074110 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.850 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.847+0000 7f8e1cff9640 1 -- 172.21.15.60:0/1099629458 <== osd.2 v2:172.21.15.60:6802/939860136 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8e18018ec0 con 0x7f8e0c071cf0 2024-09-12T01:44:57.859 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.860+0000 7f8e26552640 1 -- 172.21.15.60:0/1099629458 --> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8e200b7040 con 0x7f8e0c071cf0 2024-09-12T01:44:57.860 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.860+0000 7f8e1cff9640 1 -- 172.21.15.60:0/1099629458 <== osd.2 v2:172.21.15.60:6802/939860136 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8e200b7040 con 0x7f8e0c071cf0 2024-09-12T01:44:57.860 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:44:57.860 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:44:57.860 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:44:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.860+0000 7f8e26552640 1 -- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] conn(0x7f8e0c071cf0 msgr2=0x7f8e0c074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.860+0000 7f8e26552640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:6802/939860136,v1:172.21.15.60:6803/939860136] conn(0x7f8e0c071cf0 0x7f8e0c074110 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.861+0000 7f8e26552640 1 -- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8e0c06be30 msgr2=0x7f8e0c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.861+0000 7f8e26552640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f8e0c06be30 0x7f8e0c06e2f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8e100015d0 tx=0x7f8e10009040 comp rx=0 tx=0).stop 2024-09-12T01:44:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.861+0000 7f8e26552640 1 -- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e20160ad0 msgr2=0x7f8e2015c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.861+0000 7f8e26552640 1 --2- 172.21.15.60:0/1099629458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e20160ad0 0x7f8e2015c290 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f8e200d0ac0 tx=0x7f8e18009d20 comp rx=0 tx=0).stop 2024-09-12T01:44:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.861+0000 7f8e24aef640 1 -- 172.21.15.60:0/1099629458 reap_dead start 2024-09-12T01:44:57.861 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.861+0000 7f8e26552640 1 -- 172.21.15.60:0/1099629458 shutdown_connections 2024-09-12T01:44:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.861+0000 7f8e26552640 1 -- 172.21.15.60:0/1099629458 >> 172.21.15.60:0/1099629458 conn(0x7f8e200b61f0 msgr2=0x7f8e200b99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.861+0000 7f8e26552640 1 -- 172.21.15.60:0/1099629458 shutdown_connections 2024-09-12T01:44:57.862 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.861+0000 7f8e26552640 1 -- 172.21.15.60:0/1099629458 wait complete. 2024-09-12T01:44:57.871 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T01:44:57.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.974+0000 7fa913bf6640 1 Processor -- start 2024-09-12T01:44:57.974 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.975+0000 7fa913bf6640 1 -- start start 2024-09-12T01:44:57.975 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.975+0000 7fa913bf6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa90c15c710 0x7fa90c073970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.975+0000 7fa913bf6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa90c073eb0 0x7fa90c0d2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.975+0000 7fa913bf6640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa90c0cdf50 con 0x7fa90c0b53f0 2024-09-12T01:44:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.975+0000 7fa913bf6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fa90c0ce230 con 0x7fa90c073eb0 2024-09-12T01:44:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.975+0000 7fa913bf6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa90c0ce510 con 0x7fa90c15c710 2024-09-12T01:44:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.976+0000 7fa911191640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa90c073eb0 0x7fa90c0d2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.976+0000 7fa912193640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa90c0b53f0 0x7fa90c0d2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35536/0 (socket says 172.21.15.60:35536) 2024-09-12T01:44:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.976+0000 7fa912193640 1 -- 172.21.15.60:0/3532976205 learned_addr learned my addr 172.21.15.60:0/3532976205 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.976+0000 7fa911992640 1 --2- 172.21.15.60:0/3532976205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa90c15c710 0x7fa90c073970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.976+0000 7fa911191640 1 -- 172.21.15.60:0/3532976205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa90c15c710 msgr2=0x7fa90c073970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.976+0000 7fa911191640 1 --2- 172.21.15.60:0/3532976205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa90c15c710 0x7fa90c073970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.976+0000 7fa911191640 1 -- 172.21.15.60:0/3532976205 >> v1:172.21.15.60:6789/0 conn(0x7fa90c0b53f0 legacy=0x7fa90c0d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.976+0000 7fa911191640 1 -- 172.21.15.60:0/3532976205 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c0ce7f0 con 0x7fa90c073eb0 2024-09-12T01:44:57.977 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.976+0000 7fa910990640 1 -- 172.21.15.60:0/3532976205 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1777757890 0 0) 0x7fa90c0cdf50 con 0x7fa90c0b53f0 2024-09-12T01:44:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.977+0000 7fa911191640 1 --2- 172.21.15.60:0/3532976205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa90c073eb0 0x7fa90c0d2110 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc0097a0 tx=0x7fa8fc02a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d0d32e5a6dcc7f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.977+0000 7fa910990640 1 -- 172.21.15.60:0/3532976205 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc037070 con 0x7fa90c073eb0 2024-09-12T01:44:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.977+0000 7fa910990640 1 -- 172.21.15.60:0/3532976205 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8fc02adb0 con 0x7fa90c073eb0 2024-09-12T01:44:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.977+0000 7fa910990640 1 -- 172.21.15.60:0/3532976205 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc032660 con 0x7fa90c073eb0 2024-09-12T01:44:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.977+0000 7fa913bf6640 1 -- 172.21.15.60:0/3532976205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa90c073eb0 msgr2=0x7fa90c0d2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.977+0000 7fa913bf6640 1 --2- 172.21.15.60:0/3532976205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa90c073eb0 0x7fa90c0d2110 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc0097a0 tx=0x7fa8fc02a060 comp rx=0 tx=0).stop 2024-09-12T01:44:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.977+0000 7fa913bf6640 1 -- 172.21.15.60:0/3532976205 shutdown_connections 2024-09-12T01:44:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.977+0000 7fa913bf6640 1 --2- 172.21.15.60:0/3532976205 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa90c073eb0 0x7fa90c0d2110 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.977+0000 7fa913bf6640 1 --2- 172.21.15.60:0/3532976205 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa90c15c710 0x7fa90c073970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.977+0000 7fa913bf6640 1 -- 172.21.15.60:0/3532976205 >> 172.21.15.60:0/3532976205 conn(0x7fa90c062a20 msgr2=0x7fa90c062e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.978+0000 7fa913bf6640 1 -- 172.21.15.60:0/3532976205 shutdown_connections 2024-09-12T01:44:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.978+0000 7fa913bf6640 1 -- 172.21.15.60:0/3532976205 wait complete. 2024-09-12T01:44:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.979+0000 7fa913bf6640 1 Processor -- start 2024-09-12T01:44:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.979+0000 7fa913bf6640 1 -- start start 2024-09-12T01:44:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.979+0000 7fa913bf6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa90c073eb0 0x7fa90c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.980 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.979+0000 7fa913bf6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa90c0b53f0 0x7fa90c0ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.979+0000 7fa913bf6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa90c15c710 0x7fa90c156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.979+0000 7fa913bf6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c0ceff0 con 0x7fa90c15c710 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.979+0000 7fa913bf6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c0cdc00 con 0x7fa90c073eb0 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.979+0000 7fa913bf6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa90c0cf170 con 0x7fa90c0b53f0 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa912193640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa90c15c710 0x7fa90c156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa912193640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa90c15c710 0x7fa90c156a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52346/0 (socket says 172.21.15.60:52346) 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa912193640 1 -- 172.21.15.60:0/2691027350 learned_addr learned my addr 172.21.15.60:0/2691027350 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa911992640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa90c073eb0 0x7fa90c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa911191640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa90c0b53f0 0x7fa90c0ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa912193640 1 -- 172.21.15.60:0/2691027350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa90c0b53f0 msgr2=0x7fa90c0ae8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa912193640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa90c0b53f0 0x7fa90c0ae8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa912193640 1 -- 172.21.15.60:0/2691027350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa90c073eb0 msgr2=0x7fa90c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:57.981 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa912193640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa90c073eb0 0x7fa90c06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:57.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa912193640 1 -- 172.21.15.60:0/2691027350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c0af8b0 con 0x7fa90c15c710 2024-09-12T01:44:57.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa912193640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa90c15c710 0x7fa90c156a90 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fa90400c7d0 tx=0x7fa90400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa9027fc640 1 -- 172.21.15.60:0/2691027350 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa904018070 con 0x7fa90c15c710 2024-09-12T01:44:57.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa9027fc640 1 -- 172.21.15.60:0/2691027350 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa90400a640 con 0x7fa90c15c710 2024-09-12T01:44:57.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa913bf6640 1 -- 172.21.15.60:0/2691027350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90c0af010 con 0x7fa90c15c710 2024-09-12T01:44:57.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa9027fc640 1 -- 172.21.15.60:0/2691027350 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa90400aa70 con 0x7fa90c15c710 2024-09-12T01:44:57.982 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.980+0000 7fa913bf6640 1 -- 172.21.15.60:0/2691027350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa90c0af5d0 con 0x7fa90c15c710 2024-09-12T01:44:57.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.981+0000 7fa913bf6640 1 -- 172.21.15.60:0/2691027350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa90c0cdf50 con 0x7fa90c15c710 2024-09-12T01:44:57.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.982+0000 7fa9027fc640 1 -- 172.21.15.60:0/2691027350 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa90401b070 con 0x7fa90c15c710 2024-09-12T01:44:57.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.982+0000 7fa9027fc640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa8f006be60 0x7fa8f006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:57.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.982+0000 7fa9027fc640 1 -- 172.21.15.60:0/2691027350 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7fa90408a050 con 0x7fa90c15c710 2024-09-12T01:44:57.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.983+0000 7fa911992640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa8f006be60 0x7fa8f006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:57.983 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.983+0000 7fa911992640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa8f006be60 0x7fa8f006e320 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa908009aa0 tx=0x7fa908009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:57.986 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:57.987+0000 7fa9027fc640 1 -- 172.21.15.60:0/2691027350 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fa9040586b0 con 0x7fa90c15c710 2024-09-12T01:44:58.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.166+0000 7fa913bf6640 1 -- 172.21.15.60:0/2691027350 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fa90c156fd0 con 0x7fa8f006be60 2024-09-12T01:44:58.166 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.166+0000 7fa9027fc640 1 -- 172.21.15.60:0/2691027350 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa908011a00 con 0x7fa8f006be60 2024-09-12T01:44:58.166 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T01:44:58.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.169+0000 7fa913bf6640 1 -- 172.21.15.60:0/2691027350 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa8f006be60 msgr2=0x7fa8f006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.168 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.169+0000 7fa913bf6640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa8f006be60 0x7fa8f006e320 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fa908009aa0 tx=0x7fa908009190 comp rx=0 tx=0).stop 2024-09-12T01:44:58.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.169+0000 7fa913bf6640 1 -- 172.21.15.60:0/2691027350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa90c15c710 msgr2=0x7fa90c156a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.169+0000 7fa913bf6640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa90c15c710 0x7fa90c156a90 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fa90400c7d0 tx=0x7fa90400cc90 comp rx=0 tx=0).stop 2024-09-12T01:44:58.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.169+0000 7fa913bf6640 1 -- 172.21.15.60:0/2691027350 shutdown_connections 2024-09-12T01:44:58.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.169+0000 7fa913bf6640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa90c15c710 0x7fa90c156a90 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.169+0000 7fa913bf6640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa8f006be60 0x7fa8f006e320 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.169+0000 7fa913bf6640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa90c0b53f0 0x7fa90c0ae8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.169+0000 7fa913bf6640 1 --2- 172.21.15.60:0/2691027350 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa90c073eb0 0x7fa90c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.169+0000 7fa913bf6640 1 -- 172.21.15.60:0/2691027350 >> 172.21.15.60:0/2691027350 conn(0x7fa90c062a20 msgr2=0x7fa90c0b38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:58.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.169+0000 7fa913bf6640 1 -- 172.21.15.60:0/2691027350 shutdown_connections 2024-09-12T01:44:58.169 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.169+0000 7fa913bf6640 1 -- 172.21.15.60:0/2691027350 wait complete. 2024-09-12T01:44:58.179 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T01:44:58.179 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:44:58.285 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.286+0000 7f81f1b86640 1 Processor -- start 2024-09-12T01:44:58.286 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.286+0000 7f81f1b86640 1 -- start start 2024-09-12T01:44:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.287+0000 7f81f1b86640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f81ec15e660 0x7f81ec06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.287+0000 7f81f1b86640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ec0b6f90 con 0x7f81ec0d1780 2024-09-12T01:44:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.287+0000 7f81f1b86640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81ec0b7270 con 0x7f81ec0d1cd0 2024-09-12T01:44:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.287+0000 7f81f1b86640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f81ec162310 con 0x7f81ec15e660 2024-09-12T01:44:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.287+0000 7f81eb7fe640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f81ec15e660 0x7f81ec06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.287+0000 7f81eaffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f81ec0d1780 0x7f81ec1627a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35544/0 (socket says 172.21.15.60:35544) 2024-09-12T01:44:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.287+0000 7f81eaffd640 1 -- 172.21.15.60:0/3199470963 learned_addr learned my addr 172.21.15.60:0/3199470963 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.287+0000 7f81eb7fe640 1 -- 172.21.15.60:0/3199470963 >> v1:172.21.15.105:6789/0 conn(0x7f81ec0d1cd0 legacy=0x7f81ec073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.287+0000 7f81eb7fe640 1 -- 172.21.15.60:0/3199470963 >> v1:172.21.15.60:6789/0 conn(0x7f81ec0d1780 legacy=0x7f81ec1627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.287 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.287+0000 7f81eb7fe640 1 -- 172.21.15.60:0/3199470963 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec0b7550 con 0x7f81ec15e660 2024-09-12T01:44:58.288 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.288+0000 7f81eb7fe640 1 --2- 172.21.15.60:0/3199470963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81ec15e660 0x7f81ec06cd20 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f81ec162490 tx=0x7f81dc02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59753a49d8b819c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.288+0000 7f81ea7fc640 1 -- 172.21.15.60:0/3199470963 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc037070 con 0x7f81ec15e660 2024-09-12T01:44:58.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.288+0000 7f81ea7fc640 1 -- 172.21.15.60:0/3199470963 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc02ae40 con 0x7f81ec15e660 2024-09-12T01:44:58.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.288+0000 7f81ea7fc640 1 -- 172.21.15.60:0/3199470963 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc032660 con 0x7f81ec15e660 2024-09-12T01:44:58.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.289+0000 7f81f1b86640 1 -- 172.21.15.60:0/3199470963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81ec15e660 msgr2=0x7f81ec06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.289+0000 7f81f1b86640 1 --2- 172.21.15.60:0/3199470963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81ec15e660 0x7f81ec06cd20 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f81ec162490 tx=0x7f81dc02a130 comp rx=0 tx=0).stop 2024-09-12T01:44:58.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.289+0000 7f81f1b86640 1 -- 172.21.15.60:0/3199470963 shutdown_connections 2024-09-12T01:44:58.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.289+0000 7f81f1b86640 1 --2- 172.21.15.60:0/3199470963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81ec15e660 0x7f81ec06cd20 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.289+0000 7f81f1b86640 1 -- 172.21.15.60:0/3199470963 >> 172.21.15.60:0/3199470963 conn(0x7f81ec0b4160 msgr2=0x7f81ec0b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:58.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.289+0000 7f81f1b86640 1 -- 172.21.15.60:0/3199470963 shutdown_connections 2024-09-12T01:44:58.289 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.289+0000 7f81f1b86640 1 -- 172.21.15.60:0/3199470963 wait complete. 2024-09-12T01:44:58.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.290+0000 7f81f1b86640 1 Processor -- start 2024-09-12T01:44:58.290 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.290+0000 7f81f1b86640 1 -- start start 2024-09-12T01:44:58.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81f1b86640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81ec0d1780 0x7f81ec158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81f1b86640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ec0d1cd0 0x7f81ec15ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81f1b86640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81ec15e660 0x7f81ec0cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81f1b86640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec0b6c40 con 0x7f81ec0d1780 2024-09-12T01:44:58.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81f1b86640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec15ea40 con 0x7f81ec15e660 2024-09-12T01:44:58.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81f1b86640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f81ec0b7830 con 0x7f81ec0d1cd0 2024-09-12T01:44:58.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81eb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81ec0d1780 0x7f81ec158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81eb7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81ec0d1780 0x7f81ec158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52366/0 (socket says 172.21.15.60:52366) 2024-09-12T01:44:58.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81eb7fe640 1 -- 172.21.15.60:0/3354435992 learned_addr learned my addr 172.21.15.60:0/3354435992 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:58.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81ebfff640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81ec15e660 0x7f81ec0cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.292 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81eaffd640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ec0d1cd0 0x7f81ec15ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81eb7fe640 1 -- 172.21.15.60:0/3354435992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ec0d1cd0 msgr2=0x7f81ec15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81eb7fe640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f81ec0d1cd0 0x7f81ec15ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81eb7fe640 1 -- 172.21.15.60:0/3354435992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81ec15e660 msgr2=0x7f81ec0cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81eb7fe640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f81ec15e660 0x7f81ec0cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81eb7fe640 1 -- 172.21.15.60:0/3354435992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec158e40 con 0x7f81ec0d1780 2024-09-12T01:44:58.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.291+0000 7f81eb7fe640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81ec0d1780 0x7f81ec158900 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f81dc000c00 tx=0x7f81dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.292+0000 7f81d3fff640 1 -- 172.21.15.60:0/3354435992 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc041070 con 0x7f81ec0d1780 2024-09-12T01:44:58.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.292+0000 7f81d3fff640 1 -- 172.21.15.60:0/3354435992 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc03c670 con 0x7f81ec0d1780 2024-09-12T01:44:58.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.292+0000 7f81f1b86640 1 -- 172.21.15.60:0/3354435992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ec15f6c0 con 0x7f81ec0d1780 2024-09-12T01:44:58.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.292+0000 7f81d3fff640 1 -- 172.21.15.60:0/3354435992 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc037040 con 0x7f81ec0d1780 2024-09-12T01:44:58.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.292+0000 7f81f1b86640 1 -- 172.21.15.60:0/3354435992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ec1f4bd0 con 0x7f81ec0d1780 2024-09-12T01:44:58.293 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.293+0000 7f81f1b86640 1 -- 172.21.15.60:0/3354435992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f81ec15dec0 con 0x7f81ec0d1780 2024-09-12T01:44:58.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.293+0000 7f81d3fff640 1 -- 172.21.15.60:0/3354435992 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f81dc044070 con 0x7f81ec0d1780 2024-09-12T01:44:58.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.294+0000 7f81d3fff640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81d806be60 0x7f81d806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.294+0000 7f81d3fff640 1 -- 172.21.15.60:0/3354435992 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f81dc0ab3a0 con 0x7f81ec0d1780 2024-09-12T01:44:58.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.294+0000 7f81eaffd640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81d806be60 0x7f81d806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.294+0000 7f81d3fff640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] conn(0x7f81d8071d20 0x7f81d8074140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.294+0000 7f81d3fff640 1 -- 172.21.15.60:0/3354435992 --> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f81d80747f0 con 0x7f81d8071d20 2024-09-12T01:44:58.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.294+0000 7f81d3fff640 1 -- 172.21.15.60:0/3354435992 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=142) ==== 24+0+0 (secure 0 0 0) 0x7f81dc0b2050 con 0x7f81ec0d1780 2024-09-12T01:44:58.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.294+0000 7f81ebfff640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] conn(0x7f81d8071d20 0x7f81d8074140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.294+0000 7f81eaffd640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81d806be60 0x7f81d806e320 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0b5680 tx=0x7f81e0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.294+0000 7f81ebfff640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] conn(0x7f81d8071d20 0x7f81d8074140 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.295 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.295+0000 7f81d3fff640 1 -- 172.21.15.60:0/3354435992 <== osd.3 v2:172.21.15.60:6826/3508972949 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f81d80747f0 con 0x7f81d8071d20 2024-09-12T01:44:58.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81f1b86640 1 -- 172.21.15.60:0/3354435992 --> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f81ec06cd20 con 0x7f81d8071d20 2024-09-12T01:44:58.307 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81d3fff640 1 -- 172.21.15.60:0/3354435992 <== osd.3 v2:172.21.15.60:6826/3508972949 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f81ec06cd20 con 0x7f81d8071d20 2024-09-12T01:44:58.307 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:44:58.307 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:44:58.308 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:44:58.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81f1b86640 1 -- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] conn(0x7f81d8071d20 msgr2=0x7f81d8074140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.308 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81f1b86640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:6826/3508972949,v1:172.21.15.60:6827/3508972949] conn(0x7f81d8071d20 0x7f81d8074140 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81f1b86640 1 -- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81d806be60 msgr2=0x7f81d806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81f1b86640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f81d806be60 0x7f81d806e320 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f81ec0b5680 tx=0x7f81e0009040 comp rx=0 tx=0).stop 2024-09-12T01:44:58.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81f1b86640 1 -- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81ec0d1780 msgr2=0x7f81ec158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81f1b86640 1 --2- 172.21.15.60:0/3354435992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81ec0d1780 0x7f81ec158900 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f81dc000c00 tx=0x7f81dc0046c0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81ebfff640 1 -- 172.21.15.60:0/3354435992 reap_dead start 2024-09-12T01:44:58.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81f1b86640 1 -- 172.21.15.60:0/3354435992 shutdown_connections 2024-09-12T01:44:58.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81f1b86640 1 -- 172.21.15.60:0/3354435992 >> 172.21.15.60:0/3354435992 conn(0x7f81ec0b4160 msgr2=0x7f81ec073160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:58.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81f1b86640 1 -- 172.21.15.60:0/3354435992 shutdown_connections 2024-09-12T01:44:58.309 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.308+0000 7f81f1b86640 1 -- 172.21.15.60:0/3354435992 wait complete. 2024-09-12T01:44:58.318 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T01:44:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.422+0000 7f347c6a6640 1 Processor -- start 2024-09-12T01:44:58.421 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.422+0000 7f347c6a6640 1 -- start start 2024-09-12T01:44:58.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f347c6a6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f347415e6f0 0x7f347406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f347c6a6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34740b54d0 0x7f347415f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f347c6a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34740b6d40 0x7f34740b71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f347c6a6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f347406e990 con 0x7f34740b54d0 2024-09-12T01:44:58.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f347c6a6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f347406ec70 con 0x7f347415e6f0 2024-09-12T01:44:58.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f347c6a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f347415ec70 con 0x7f34740b6d40 2024-09-12T01:44:58.423 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f3479c41640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34740b54d0 0x7f347415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f3479c41640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34740b54d0 0x7f347415f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52378/0 (socket says 172.21.15.60:52378) 2024-09-12T01:44:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f3479c41640 1 -- 172.21.15.60:0/2060900478 learned_addr learned my addr 172.21.15.60:0/2060900478 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f347a442640 1 --2- 172.21.15.60:0/2060900478 >> v2:172.21.15.105:3300/0 conn(0x7f347415e6f0 0x7f347406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f347ac43640 1 --2- 172.21.15.60:0/2060900478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34740b6d40 0x7f34740b71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f3479c41640 1 -- 172.21.15.60:0/2060900478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34740b6d40 msgr2=0x7f34740b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f3479c41640 1 --2- 172.21.15.60:0/2060900478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34740b6d40 0x7f34740b71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f3479c41640 1 -- 172.21.15.60:0/2060900478 >> v2:172.21.15.105:3300/0 conn(0x7f347415e6f0 msgr2=0x7f347406fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f3479c41640 1 --2- 172.21.15.60:0/2060900478 >> v2:172.21.15.105:3300/0 conn(0x7f347415e6f0 0x7f347406fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f3479c41640 1 -- 172.21.15.60:0/2060900478 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347415ef50 con 0x7f34740b54d0 2024-09-12T01:44:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.423+0000 7f347ac43640 1 --2- 172.21.15.60:0/2060900478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34740b6d40 0x7f34740b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:58.424 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.424+0000 7f3479c41640 1 --2- 172.21.15.60:0/2060900478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34740b54d0 0x7f347415f750 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f3474069920 tx=0x7f346402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd488d61575598a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.425 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.424+0000 7f3479440640 1 -- 172.21.15.60:0/2060900478 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464037070 con 0x7f34740b54d0 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.424+0000 7f3479440640 1 -- 172.21.15.60:0/2060900478 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3464032440 con 0x7f34740b54d0 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.424+0000 7f3479440640 1 -- 172.21.15.60:0/2060900478 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3464032810 con 0x7f34740b54d0 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.425+0000 7f347c6a6640 1 -- 172.21.15.60:0/2060900478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34740b54d0 msgr2=0x7f347415f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.425+0000 7f347c6a6640 1 --2- 172.21.15.60:0/2060900478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34740b54d0 0x7f347415f750 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f3474069920 tx=0x7f346402a1e0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.425+0000 7f347c6a6640 1 -- 172.21.15.60:0/2060900478 shutdown_connections 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.425+0000 7f347c6a6640 1 --2- 172.21.15.60:0/2060900478 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34740b6d40 0x7f34740b71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.425+0000 7f347c6a6640 1 --2- 172.21.15.60:0/2060900478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34740b54d0 0x7f347415f750 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.425+0000 7f347c6a6640 1 --2- 172.21.15.60:0/2060900478 >> v2:172.21.15.105:3300/0 conn(0x7f347415e6f0 0x7f347406fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.425+0000 7f347c6a6640 1 -- 172.21.15.60:0/2060900478 >> 172.21.15.60:0/2060900478 conn(0x7f34740d2430 msgr2=0x7f34740d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.425+0000 7f347c6a6640 1 -- 172.21.15.60:0/2060900478 shutdown_connections 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.425+0000 7f347c6a6640 1 -- 172.21.15.60:0/2060900478 wait complete. 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.426+0000 7f347c6a6640 1 Processor -- start 2024-09-12T01:44:58.426 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.426+0000 7f347c6a6640 1 -- start start 2024-09-12T01:44:58.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347c6a6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34740b54d0 0x7f34741f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.428 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347c6a6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34740b6d40 0x7f34741f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347c6a6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f347415e6f0 0x7f347406d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347c6a6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f347406e5b0 con 0x7f347415e6f0 2024-09-12T01:44:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347c6a6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f34740b7730 con 0x7f34740b6d40 2024-09-12T01:44:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347c6a6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f347406e730 con 0x7f34740b54d0 2024-09-12T01:44:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347ac43640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f347415e6f0 0x7f347406d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.429 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347ac43640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f347415e6f0 0x7f347406d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52390/0 (socket says 172.21.15.60:52390) 2024-09-12T01:44:58.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347ac43640 1 -- 172.21.15.60:0/386427996 learned_addr learned my addr 172.21.15.60:0/386427996 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:58.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347a442640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34740b54d0 0x7f34741f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f3479c41640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34740b6d40 0x7f34741f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347ac43640 1 -- 172.21.15.60:0/386427996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34740b54d0 msgr2=0x7f34741f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347ac43640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34740b54d0 0x7f34741f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347ac43640 1 -- 172.21.15.60:0/386427996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34740b6d40 msgr2=0x7f34741f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.432 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347ac43640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34740b6d40 0x7f34741f5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347ac43640 1 -- 172.21.15.60:0/386427996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34741f4f70 con 0x7f347415e6f0 2024-09-12T01:44:58.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f3479c41640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34740b6d40 0x7f34741f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:58.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347ac43640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f347415e6f0 0x7f347406d4e0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f346c007e10 tx=0x7f346c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f346affd640 1 -- 172.21.15.60:0/386427996 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c01a070 con 0x7f347415e6f0 2024-09-12T01:44:58.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f346affd640 1 -- 172.21.15.60:0/386427996 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346c003b90 con 0x7f347415e6f0 2024-09-12T01:44:58.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f346affd640 1 -- 172.21.15.60:0/386427996 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c004030 con 0x7f347415e6f0 2024-09-12T01:44:58.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.427+0000 7f347c6a6640 1 -- 172.21.15.60:0/386427996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347415f790 con 0x7f347415e6f0 2024-09-12T01:44:58.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.428+0000 7f347c6a6640 1 -- 172.21.15.60:0/386427996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347415fd50 con 0x7f347415e6f0 2024-09-12T01:44:58.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.428+0000 7f347c6a6640 1 -- 172.21.15.60:0/386427996 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f347406c6c0 con 0x7f347415e6f0 2024-09-12T01:44:58.433 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.429+0000 7f346affd640 1 -- 172.21.15.60:0/386427996 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f346c01d070 con 0x7f347415e6f0 2024-09-12T01:44:58.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.429+0000 7f346affd640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f345806be30 0x7f345806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.429+0000 7f346affd640 1 -- 172.21.15.60:0/386427996 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f346c08ae10 con 0x7f347415e6f0 2024-09-12T01:44:58.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.430+0000 7f347a442640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f345806be30 0x7f345806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.430+0000 7f347a442640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f345806be30 0x7f345806e2f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f34700079a0 tx=0x7f3470008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.434 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.434+0000 7f346affd640 1 -- 172.21.15.60:0/386427996 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f346c08e030 con 0x7f347415e6f0 2024-09-12T01:44:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.610+0000 7f347c6a6640 1 -- 172.21.15.60:0/386427996 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f34740b71f0 con 0x7f345806be30 2024-09-12T01:44:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.610+0000 7f346affd640 1 -- 172.21.15.60:0/386427996 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f34740b71f0 con 0x7f345806be30 2024-09-12T01:44:58.610 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T01:44:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.612+0000 7f347c6a6640 1 -- 172.21.15.60:0/386427996 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f345806be30 msgr2=0x7f345806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.612+0000 7f347c6a6640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f345806be30 0x7f345806e2f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f34700079a0 tx=0x7f3470008040 comp rx=0 tx=0).stop 2024-09-12T01:44:58.612 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.612+0000 7f347c6a6640 1 -- 172.21.15.60:0/386427996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f347415e6f0 msgr2=0x7f347406d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.612+0000 7f347c6a6640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f347415e6f0 0x7f347406d4e0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f346c007e10 tx=0x7f346c00d4a0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.613+0000 7f347c6a6640 1 -- 172.21.15.60:0/386427996 shutdown_connections 2024-09-12T01:44:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.613+0000 7f347c6a6640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f347415e6f0 0x7f347406d4e0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.613+0000 7f347c6a6640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f34740b6d40 0x7f34741f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.613+0000 7f347c6a6640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f345806be30 0x7f345806e2f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.613+0000 7f347c6a6640 1 --2- 172.21.15.60:0/386427996 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f34740b54d0 0x7f34741f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.613+0000 7f347c6a6640 1 -- 172.21.15.60:0/386427996 >> 172.21.15.60:0/386427996 conn(0x7f34740d2430 msgr2=0x7f3474070620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.613+0000 7f347c6a6640 1 -- 172.21.15.60:0/386427996 shutdown_connections 2024-09-12T01:44:58.613 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.613+0000 7f347c6a6640 1 -- 172.21.15.60:0/386427996 wait complete. 2024-09-12T01:44:58.624 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T01:44:58.624 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:44:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.731+0000 7f6b4756f640 1 Processor -- start 2024-09-12T01:44:58.731 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.731+0000 7f6b4756f640 1 -- start start 2024-09-12T01:44:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.732+0000 7f6b4756f640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6b4015c590 0x7f6b4006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.732+0000 7f6b4756f640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6b4006c410 0x7f6b400b2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.732+0000 7f6b4756f640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b400cf5b0 con 0x7f6b400b2b80 2024-09-12T01:44:58.732 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.732+0000 7f6b4756f640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f6b400b2f90 con 0x7f6b4015c590 2024-09-12T01:44:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.732+0000 7f6b4756f640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6b4006ef10 con 0x7f6b4006c410 2024-09-12T01:44:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.732+0000 7f6b45b0c640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6b400b2b80 0x7f6b4015fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35548/0 (socket says 172.21.15.60:35548) 2024-09-12T01:44:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.732+0000 7f6b45b0c640 1 -- 172.21.15.60:0/3237139473 learned_addr learned my addr 172.21.15.60:0/3237139473 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.732+0000 7f6b4530b640 1 --2- 172.21.15.60:0/3237139473 >> v2:172.21.15.60:3300/0 conn(0x7f6b4015c590 0x7f6b4006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.733+0000 7f6b44b0a640 1 --2- 172.21.15.60:0/3237139473 >> v2:172.21.15.105:3300/0 conn(0x7f6b4006c410 0x7f6b400b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.733+0000 7f6b4530b640 1 -- 172.21.15.60:0/3237139473 >> v2:172.21.15.105:3300/0 conn(0x7f6b4006c410 msgr2=0x7f6b400b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.733+0000 7f6b4530b640 1 --2- 172.21.15.60:0/3237139473 >> v2:172.21.15.105:3300/0 conn(0x7f6b4006c410 0x7f6b400b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.733+0000 7f6b4530b640 1 -- 172.21.15.60:0/3237139473 >> v1:172.21.15.60:6789/0 conn(0x7f6b400b2b80 legacy=0x7f6b4015fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.733+0000 7f6b3ffff640 1 -- 172.21.15.60:0/3237139473 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325258206 0 0) 0x7f6b400cf5b0 con 0x7f6b400b2b80 2024-09-12T01:44:58.733 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.733+0000 7f6b4530b640 1 -- 172.21.15.60:0/3237139473 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4006f920 con 0x7f6b4015c590 2024-09-12T01:44:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.734+0000 7f6b4530b640 1 --2- 172.21.15.60:0/3237139473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4015c590 0x7f6b4006bed0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f6b4006ccd0 tx=0x7f6b3802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8ca24ae3b61739 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.734+0000 7f6b3ffff640 1 -- 172.21.15.60:0/3237139473 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38037070 con 0x7f6b4015c590 2024-09-12T01:44:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.734+0000 7f6b3ffff640 1 -- 172.21.15.60:0/3237139473 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b38032440 con 0x7f6b4015c590 2024-09-12T01:44:58.734 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.734+0000 7f6b3ffff640 1 -- 172.21.15.60:0/3237139473 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b38032810 con 0x7f6b4015c590 2024-09-12T01:44:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.734+0000 7f6b4756f640 1 -- 172.21.15.60:0/3237139473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4015c590 msgr2=0x7f6b4006bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.734+0000 7f6b4756f640 1 --2- 172.21.15.60:0/3237139473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4015c590 0x7f6b4006bed0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f6b4006ccd0 tx=0x7f6b3802a1a0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.734+0000 7f6b4756f640 1 -- 172.21.15.60:0/3237139473 shutdown_connections 2024-09-12T01:44:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.734+0000 7f6b4756f640 1 --2- 172.21.15.60:0/3237139473 >> v2:172.21.15.105:3300/0 conn(0x7f6b4006c410 0x7f6b400b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.734+0000 7f6b4756f640 1 --2- 172.21.15.60:0/3237139473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4015c590 0x7f6b4006bed0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.734+0000 7f6b4756f640 1 -- 172.21.15.60:0/3237139473 >> 172.21.15.60:0/3237139473 conn(0x7f6b4006e140 msgr2=0x7f6b4006e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.734+0000 7f6b4756f640 1 -- 172.21.15.60:0/3237139473 shutdown_connections 2024-09-12T01:44:58.735 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.734+0000 7f6b4756f640 1 -- 172.21.15.60:0/3237139473 wait complete. 2024-09-12T01:44:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.735+0000 7f6b4756f640 1 Processor -- start 2024-09-12T01:44:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.736+0000 7f6b4756f640 1 -- start start 2024-09-12T01:44:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.736+0000 7f6b4756f640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4006c410 0x7f6b40148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.736+0000 7f6b4756f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b400b2b80 0x7f6b400b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.736+0000 7f6b4756f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b4015c590 0x7f6b4014cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.736+0000 7f6b4756f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b400701c0 con 0x7f6b400b2b80 2024-09-12T01:44:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.736+0000 7f6b4756f640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4006fee0 con 0x7f6b4006c410 2024-09-12T01:44:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.736+0000 7f6b4756f640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6b400704a0 con 0x7f6b4015c590 2024-09-12T01:44:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.736+0000 7f6b44b0a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b400b2b80 0x7f6b400b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.737 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.736+0000 7f6b44b0a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b400b2b80 0x7f6b400b5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52410/0 (socket says 172.21.15.60:52410) 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.736+0000 7f6b44b0a640 1 -- 172.21.15.60:0/4193591326 learned_addr learned my addr 172.21.15.60:0/4193591326 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b4530b640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4006c410 0x7f6b40148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b45b0c640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b4015c590 0x7f6b4014cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b44b0a640 1 -- 172.21.15.60:0/4193591326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b4015c590 msgr2=0x7f6b4014cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b44b0a640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6b4015c590 0x7f6b4014cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b44b0a640 1 -- 172.21.15.60:0/4193591326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4006c410 msgr2=0x7f6b40148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b44b0a640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4006c410 0x7f6b40148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b44b0a640 1 -- 172.21.15.60:0/4193591326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b40148ac0 con 0x7f6b400b2b80 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b4530b640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6b4006c410 0x7f6b40148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b44b0a640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b400b2b80 0x7f6b400b5090 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400c7f0 tx=0x7f6b3400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b3dffb640 1 -- 172.21.15.60:0/4193591326 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34015070 con 0x7f6b400b2b80 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b3dffb640 1 -- 172.21.15.60:0/4193591326 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b34004240 con 0x7f6b400b2b80 2024-09-12T01:44:58.738 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b3dffb640 1 -- 172.21.15.60:0/4193591326 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34007620 con 0x7f6b400b2b80 2024-09-12T01:44:58.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b4756f640 1 -- 172.21.15.60:0/4193591326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b400b5a00 con 0x7f6b400b2b80 2024-09-12T01:44:58.739 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.737+0000 7f6b4756f640 1 -- 172.21.15.60:0/4193591326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b40148d30 con 0x7f6b400b2b80 2024-09-12T01:44:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.738+0000 7f6b4756f640 1 -- 172.21.15.60:0/4193591326 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b4015c970 con 0x7f6b400b2b80 2024-09-12T01:44:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.739+0000 7f6b3dffb640 1 -- 172.21.15.60:0/4193591326 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6b340079d0 con 0x7f6b400b2b80 2024-09-12T01:44:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.739+0000 7f6b3dffb640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b2c06be30 0x7f6b2c06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.739+0000 7f6b3dffb640 1 -- 172.21.15.60:0/4193591326 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f6b3408af60 con 0x7f6b400b2b80 2024-09-12T01:44:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.739+0000 7f6b4530b640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b2c06be30 0x7f6b2c06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.739+0000 7f6b3dffb640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] conn(0x7f6b2c071cf0 0x7f6b2c074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.740 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.739+0000 7f6b3dffb640 1 -- 172.21.15.60:0/4193591326 --> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b2c0747c0 con 0x7f6b2c071cf0 2024-09-12T01:44:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.739+0000 7f6b3dffb640 1 -- 172.21.15.60:0/4193591326 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=142) ==== 24+0+0 (secure 0 0 0) 0x7f6b3408d600 con 0x7f6b400b2b80 2024-09-12T01:44:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.740+0000 7f6b4530b640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b2c06be30 0x7f6b2c06e2f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6b38034000 tx=0x7f6b3802e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.740+0000 7f6b45b0c640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] conn(0x7f6b2c071cf0 0x7f6b2c074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.740+0000 7f6b45b0c640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] conn(0x7f6b2c071cf0 0x7f6b2c074110 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.741 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.741+0000 7f6b3dffb640 1 -- 172.21.15.60:0/4193591326 <== osd.4 v2:172.21.15.105:6808/3941434125 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b2c0747c0 con 0x7f6b2c071cf0 2024-09-12T01:44:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.753+0000 7f6b4756f640 1 -- 172.21.15.60:0/4193591326 --> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6b400d0f40 con 0x7f6b2c071cf0 2024-09-12T01:44:58.753 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.754+0000 7f6b3dffb640 1 -- 172.21.15.60:0/4193591326 <== osd.4 v2:172.21.15.105:6808/3941434125 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6b400d0f40 con 0x7f6b2c071cf0 2024-09-12T01:44:58.754 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:44:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:44:58.754 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:44:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.754+0000 7f6b4756f640 1 -- 172.21.15.60:0/4193591326 >> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] conn(0x7f6b2c071cf0 msgr2=0x7f6b2c074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.754+0000 7f6b4756f640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.105:6808/3941434125,v1:172.21.15.105:6809/3941434125] conn(0x7f6b2c071cf0 0x7f6b2c074110 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.755+0000 7f6b4756f640 1 -- 172.21.15.60:0/4193591326 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b2c06be30 msgr2=0x7f6b2c06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.755+0000 7f6b4756f640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6b2c06be30 0x7f6b2c06e2f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6b38034000 tx=0x7f6b3802e000 comp rx=0 tx=0).stop 2024-09-12T01:44:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.755+0000 7f6b4756f640 1 -- 172.21.15.60:0/4193591326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b400b2b80 msgr2=0x7f6b400b5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.755+0000 7f6b4756f640 1 --2- 172.21.15.60:0/4193591326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b400b2b80 0x7f6b400b5090 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400c7f0 tx=0x7f6b3400ccb0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.755+0000 7f6b45b0c640 1 -- 172.21.15.60:0/4193591326 reap_dead start 2024-09-12T01:44:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.755+0000 7f6b4756f640 1 -- 172.21.15.60:0/4193591326 shutdown_connections 2024-09-12T01:44:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.755+0000 7f6b4756f640 1 -- 172.21.15.60:0/4193591326 >> 172.21.15.60:0/4193591326 conn(0x7f6b4006e140 msgr2=0x7f6b400d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.755+0000 7f6b4756f640 1 -- 172.21.15.60:0/4193591326 shutdown_connections 2024-09-12T01:44:58.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.755+0000 7f6b4756f640 1 -- 172.21.15.60:0/4193591326 wait complete. 2024-09-12T01:44:58.765 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T01:44:58.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.868+0000 7f6d09465640 1 Processor -- start 2024-09-12T01:44:58.868 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.868+0000 7f6d09465640 1 -- start start 2024-09-12T01:44:58.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.869+0000 7f6d09465640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6d040b7450 0x7f6d0406fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.869+0000 7f6d09465640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d0406e990 con 0x7f6d040b54d0 2024-09-12T01:44:58.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.869+0000 7f6d09465640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d0406ec70 con 0x7f6d0415e6f0 2024-09-12T01:44:58.869 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.869+0000 7f6d09465640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7f6d0415ec70 con 0x7f6d040b7450 2024-09-12T01:44:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.869+0000 7f6d027fc640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6d040b54d0 0x7f6d04070830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35554/0 (socket says 172.21.15.60:35554) 2024-09-12T01:44:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.869+0000 7f6d027fc640 1 -- 172.21.15.60:0/4208192515 learned_addr learned my addr 172.21.15.60:0/4208192515 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.869+0000 7f6d037fe640 1 --2- 172.21.15.60:0/4208192515 >> v2:172.21.15.105:3300/0 conn(0x7f6d040b7450 0x7f6d0406fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.870+0000 7f6d01ffb640 1 -- 172.21.15.60:0/4208192515 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 983605725 0 0) 0x7f6d0406e990 con 0x7f6d040b54d0 2024-09-12T01:44:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.870+0000 7f6d01ffb640 1 -- 172.21.15.60:0/4208192515 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cf0003520 con 0x7f6d040b54d0 2024-09-12T01:44:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.870+0000 7f6d037fe640 1 -- 172.21.15.60:0/4208192515 >> v1:172.21.15.105:6789/0 conn(0x7f6d0415e6f0 legacy=0x7f6d040b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.870+0000 7f6d037fe640 1 -- 172.21.15.60:0/4208192515 >> v1:172.21.15.60:6789/0 conn(0x7f6d040b54d0 legacy=0x7f6d04070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.870 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.870+0000 7f6d037fe640 1 -- 172.21.15.60:0/4208192515 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0415ef50 con 0x7f6d040b7450 2024-09-12T01:44:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.870+0000 7f6d037fe640 1 --2- 172.21.15.60:0/4208192515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d040b7450 0x7f6d0406fd00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0097a0 tx=0x7f6cfc02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad5df40b310ceb33 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.871+0000 7f6d01ffb640 1 -- 172.21.15.60:0/4208192515 <== mon.1 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc037070 con 0x7f6d040b7450 2024-09-12T01:44:58.871 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.871+0000 7f6d01ffb640 1 -- 172.21.15.60:0/4208192515 <== mon.1 v2:172.21.15.105:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cfc032440 con 0x7f6d040b7450 2024-09-12T01:44:58.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.871+0000 7f6d01ffb640 1 -- 172.21.15.60:0/4208192515 <== mon.1 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc032810 con 0x7f6d040b7450 2024-09-12T01:44:58.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.871+0000 7f6d09465640 1 -- 172.21.15.60:0/4208192515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d040b7450 msgr2=0x7f6d0406fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.871+0000 7f6d09465640 1 --2- 172.21.15.60:0/4208192515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d040b7450 0x7f6d0406fd00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0097a0 tx=0x7f6cfc02a230 comp rx=0 tx=0).stop 2024-09-12T01:44:58.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.871+0000 7f6d09465640 1 -- 172.21.15.60:0/4208192515 shutdown_connections 2024-09-12T01:44:58.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.871+0000 7f6d09465640 1 --2- 172.21.15.60:0/4208192515 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d040b7450 0x7f6d0406fd00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.871+0000 7f6d09465640 1 -- 172.21.15.60:0/4208192515 >> 172.21.15.60:0/4208192515 conn(0x7f6d040d2430 msgr2=0x7f6d040d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:58.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.871+0000 7f6d09465640 1 -- 172.21.15.60:0/4208192515 shutdown_connections 2024-09-12T01:44:58.872 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.871+0000 7f6d09465640 1 -- 172.21.15.60:0/4208192515 wait complete. 2024-09-12T01:44:58.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.873+0000 7f6d09465640 1 Processor -- start 2024-09-12T01:44:58.874 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.873+0000 7f6d09465640 1 -- start start 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.873+0000 7f6d09465640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d040b54d0 0x7f6d04161170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.873+0000 7f6d09465640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d040b7450 0x7f6d0415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.873+0000 7f6d09465640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d0415e6f0 0x7f6d0415a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.873+0000 7f6d09465640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0406e730 con 0x7f6d040b7450 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.873+0000 7f6d09465640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0406e5b0 con 0x7f6d0415e6f0 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.873+0000 7f6d09465640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0415f750 con 0x7f6d040b54d0 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.873+0000 7f6d027fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d040b7450 0x7f6d0415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d027fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d040b7450 0x7f6d0415a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52422/0 (socket says 172.21.15.60:52422) 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d027fc640 1 -- 172.21.15.60:0/1064155118 learned_addr learned my addr 172.21.15.60:0/1064155118 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d037fe640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d0415e6f0 0x7f6d0415a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d02ffd640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d040b54d0 0x7f6d04161170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d027fc640 1 -- 172.21.15.60:0/1064155118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d040b54d0 msgr2=0x7f6d04161170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.875 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d027fc640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d040b54d0 0x7f6d04161170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d027fc640 1 -- 172.21.15.60:0/1064155118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d0415e6f0 msgr2=0x7f6d0415a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d027fc640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d0415e6f0 0x7f6d0415a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d027fc640 1 -- 172.21.15.60:0/1064155118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d04161c50 con 0x7f6d040b7450 2024-09-12T01:44:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d02ffd640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d040b54d0 0x7f6d04161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d027fc640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d040b7450 0x7f6d0415a1a0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00c4d0 tx=0x7f6cec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6cfb7fe640 1 -- 172.21.15.60:0/1064155118 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec017070 con 0x7f6d040b7450 2024-09-12T01:44:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6cfb7fe640 1 -- 172.21.15.60:0/1064155118 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cec005ce0 con 0x7f6d040b7450 2024-09-12T01:44:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d09465640 1 -- 172.21.15.60:0/1064155118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d04161f30 con 0x7f6d040b7450 2024-09-12T01:44:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6cfb7fe640 1 -- 172.21.15.60:0/1064155118 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cec007270 con 0x7f6d040b7450 2024-09-12T01:44:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.874+0000 7f6d09465640 1 -- 172.21.15.60:0/1064155118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d041624f0 con 0x7f6d040b7450 2024-09-12T01:44:58.876 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.875+0000 7f6d09465640 1 -- 172.21.15.60:0/1064155118 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d04076170 con 0x7f6d040b7450 2024-09-12T01:44:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.876+0000 7f6cfb7fe640 1 -- 172.21.15.60:0/1064155118 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f6cec01a070 con 0x7f6d040b7450 2024-09-12T01:44:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.876+0000 7f6cfb7fe640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ce406be30 0x7f6ce406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.876+0000 7f6cfb7fe640 1 -- 172.21.15.60:0/1064155118 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f6cec089ed0 con 0x7f6d040b7450 2024-09-12T01:44:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.876+0000 7f6d02ffd640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ce406be30 0x7f6ce406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:58.877 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.877+0000 7f6d02ffd640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ce406be30 0x7f6ce406e2f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4001d60 tx=0x7f6cf4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:58.880 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:58.881+0000 7f6cfb7fe640 1 -- 172.21.15.60:0/1064155118 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f6d04076170 con 0x7f6d040b7450 2024-09-12T01:44:59.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.057+0000 7f6d09465640 1 -- 172.21.15.60:0/1064155118 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f6d041626c0 con 0x7f6ce406be30 2024-09-12T01:44:59.056 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.057+0000 7f6cfb7fe640 1 -- 172.21.15.60:0/1064155118 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6d041626c0 con 0x7f6ce406be30 2024-09-12T01:44:59.057 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T01:44:59.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.059+0000 7f6d09465640 1 -- 172.21.15.60:0/1064155118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ce406be30 msgr2=0x7f6ce406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.059+0000 7f6d09465640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ce406be30 0x7f6ce406e2f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4001d60 tx=0x7f6cf4009040 comp rx=0 tx=0).stop 2024-09-12T01:44:59.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.059+0000 7f6d09465640 1 -- 172.21.15.60:0/1064155118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d040b7450 msgr2=0x7f6d0415a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.059+0000 7f6d09465640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d040b7450 0x7f6d0415a1a0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f6cec00c4d0 tx=0x7f6cec00c990 comp rx=0 tx=0).stop 2024-09-12T01:44:59.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.059+0000 7f6d09465640 1 -- 172.21.15.60:0/1064155118 shutdown_connections 2024-09-12T01:44:59.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.059+0000 7f6d09465640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6d0415e6f0 0x7f6d0415a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.059 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.059+0000 7f6d09465640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d040b7450 0x7f6d0415a1a0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.059+0000 7f6d09465640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f6ce406be30 0x7f6ce406e2f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.059+0000 7f6d09465640 1 --2- 172.21.15.60:0/1064155118 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6d040b54d0 0x7f6d04161170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.059+0000 7f6d09465640 1 -- 172.21.15.60:0/1064155118 >> 172.21.15.60:0/1064155118 conn(0x7f6d040d2430 msgr2=0x7f6d040b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:59.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.059+0000 7f6d09465640 1 -- 172.21.15.60:0/1064155118 shutdown_connections 2024-09-12T01:44:59.060 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.059+0000 7f6d09465640 1 -- 172.21.15.60:0/1064155118 wait complete. 2024-09-12T01:44:59.070 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T01:44:59.070 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:44:59.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.176+0000 7fa57b3a2640 1 Processor -- start 2024-09-12T01:44:59.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.177+0000 7fa57b3a2640 1 -- start start 2024-09-12T01:44:59.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.177+0000 7fa57b3a2640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa5740b3650 0x7fa57415b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.177+0000 7fa57b3a2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5740b3a30 0x7fa5740ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.178+0000 7fa57b3a2640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5740cf4f0 con 0x7fa5740ce9e0 2024-09-12T01:44:59.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.178+0000 7fa57b3a2640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fa5740cf210 con 0x7fa5740b3650 2024-09-12T01:44:59.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.178+0000 7fa57b3a2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa5740b45b0 con 0x7fa5740b3a30 2024-09-12T01:44:59.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.178+0000 7fa579b9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5740b3a30 0x7fa5740ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.178+0000 7fa57a3a0640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa5740b3650 0x7fa57415b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.178+0000 7fa579b9f640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5740b3a30 0x7fa5740ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.60:42644/0 (socket says 172.21.15.60:42644) 2024-09-12T01:44:59.178 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.178+0000 7fa579b9f640 1 -- 172.21.15.60:0/1958689763 learned_addr learned my addr 172.21.15.60:0/1958689763 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:59.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.178+0000 7fa579b9f640 1 -- 172.21.15.60:0/1958689763 >> v2:172.21.15.105:3300/0 conn(0x7fa5740b3650 msgr2=0x7fa57415b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:59.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.178+0000 7fa579b9f640 1 --2- 172.21.15.60:0/1958689763 >> v2:172.21.15.105:3300/0 conn(0x7fa5740b3650 0x7fa57415b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.178+0000 7fa579b9f640 1 -- 172.21.15.60:0/1958689763 >> v1:172.21.15.105:6789/0 conn(0x7fa5740ce9e0 legacy=0x7fa57415edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.178+0000 7fa579b9f640 1 -- 172.21.15.60:0/1958689763 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5740b4890 con 0x7fa5740b3a30 2024-09-12T01:44:59.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.178+0000 7fa57a3a0640 1 --2- 172.21.15.60:0/1958689763 >> v2:172.21.15.105:3300/0 conn(0x7fa5740b3650 0x7fa57415b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-12T01:44:59.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.179+0000 7fa579b9f640 1 --2- 172.21.15.60:0/1958689763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5740b3a30 0x7fa5740ce4a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa564009870 tx=0x7fa56402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e4215add03394d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.179+0000 7fa57939e640 1 -- 172.21.15.60:0/1958689763 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa564037070 con 0x7fa5740b3a30 2024-09-12T01:44:59.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.179+0000 7fa57939e640 1 -- 172.21.15.60:0/1958689763 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa564032440 con 0x7fa5740b3a30 2024-09-12T01:44:59.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.179+0000 7fa57939e640 1 -- 172.21.15.60:0/1958689763 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa564032810 con 0x7fa5740b3a30 2024-09-12T01:44:59.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.180+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1958689763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5740b3a30 msgr2=0x7fa5740ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.180+0000 7fa57b3a2640 1 --2- 172.21.15.60:0/1958689763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5740b3a30 0x7fa5740ce4a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa564009870 tx=0x7fa56402a1c0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.180+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1958689763 shutdown_connections 2024-09-12T01:44:59.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.180+0000 7fa57b3a2640 1 --2- 172.21.15.60:0/1958689763 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5740b3a30 0x7fa5740ce4a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.180+0000 7fa57b3a2640 1 --2- 172.21.15.60:0/1958689763 >> v2:172.21.15.105:3300/0 conn(0x7fa5740b3650 0x7fa57415b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.180+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1958689763 >> 172.21.15.60:0/1958689763 conn(0x7fa574062a20 msgr2=0x7fa57406e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:59.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.180+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1958689763 shutdown_connections 2024-09-12T01:44:59.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.180+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1958689763 wait complete. 2024-09-12T01:44:59.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.181+0000 7fa57b3a2640 1 Processor -- start 2024-09-12T01:44:59.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.181+0000 7fa57b3a2640 1 -- start start 2024-09-12T01:44:59.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57b3a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5740b3650 0x7fa574143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57b3a2640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740b3a30 0x7fa5741555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57b3a2640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5740ce9e0 0x7fa574155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57b3a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa5740b3ff0 con 0x7fa5740b3650 2024-09-12T01:44:59.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57b3a2640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fa5740b3e70 con 0x7fa5740b3a30 2024-09-12T01:44:59.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57b3a2640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fa57415f500 con 0x7fa5740ce9e0 2024-09-12T01:44:59.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57a3a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5740b3650 0x7fa574143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57a3a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5740b3650 0x7fa574143790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52432/0 (socket says 172.21.15.60:52432) 2024-09-12T01:44:59.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57a3a0640 1 -- 172.21.15.60:0/1971596880 learned_addr learned my addr 172.21.15.60:0/1971596880 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57aba1640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5740ce9e0 0x7fa574155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa579b9f640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740b3a30 0x7fa5741555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57a3a0640 1 -- 172.21.15.60:0/1971596880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5740ce9e0 msgr2=0x7fa574155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57a3a0640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5740ce9e0 0x7fa574155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57a3a0640 1 -- 172.21.15.60:0/1971596880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740b3a30 msgr2=0x7fa5741555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57a3a0640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740b3a30 0x7fa5741555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57a3a0640 1 -- 172.21.15.60:0/1971596880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa574146960 con 0x7fa5740b3650 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa579b9f640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fa5740b3a30 0x7fa5741555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.182+0000 7fa57a3a0640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5740b3650 0x7fa574143790 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fa57000ebe0 tx=0x7fa57000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.183+0000 7fa56affd640 1 -- 172.21.15.60:0/1971596880 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570017070 con 0x7fa5740b3650 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.183+0000 7fa56affd640 1 -- 172.21.15.60:0/1971596880 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa57000cc30 con 0x7fa5740b3650 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.183+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1971596880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa574156370 con 0x7fa5740b3650 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.183+0000 7fa56affd640 1 -- 172.21.15.60:0/1971596880 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570013470 con 0x7fa5740b3650 2024-09-12T01:44:59.184 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.183+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1971596880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa574156070 con 0x7fa5740b3650 2024-09-12T01:44:59.185 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.183+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1971596880 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa574156890 con 0x7fa5740b3650 2024-09-12T01:44:59.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.184+0000 7fa56affd640 1 -- 172.21.15.60:0/1971596880 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fa57001a070 con 0x7fa5740b3650 2024-09-12T01:44:59.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.184+0000 7fa56affd640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa55806be30 0x7fa55806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.185+0000 7fa56affd640 1 -- 172.21.15.60:0/1971596880 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7fa57008ae80 con 0x7fa5740b3650 2024-09-12T01:44:59.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.185+0000 7fa579b9f640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa55806be30 0x7fa55806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.185+0000 7fa56affd640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] conn(0x7fa558071cf0 0x7fa558074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.185+0000 7fa56affd640 1 -- 172.21.15.60:0/1971596880 --> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5580747c0 con 0x7fa558071cf0 2024-09-12T01:44:59.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.185+0000 7fa56affd640 1 -- 172.21.15.60:0/1971596880 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=142) ==== 24+0+0 (secure 0 0 0) 0x7fa57008d580 con 0x7fa5740b3650 2024-09-12T01:44:59.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.185+0000 7fa579b9f640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa55806be30 0x7fa55806e2f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa564034000 tx=0x7fa56402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.185+0000 7fa57aba1640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] conn(0x7fa558071cf0 0x7fa558074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.185+0000 7fa57aba1640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] conn(0x7fa558071cf0 0x7fa558074110 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.187 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.186+0000 7fa56affd640 1 -- 172.21.15.60:0/1971596880 <== osd.5 v2:172.21.15.105:6816/16466051 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5580747c0 con 0x7fa558071cf0 2024-09-12T01:44:59.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.199+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1971596880 --> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa57415f900 con 0x7fa558071cf0 2024-09-12T01:44:59.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.200+0000 7fa56affd640 1 -- 172.21.15.60:0/1971596880 <== osd.5 v2:172.21.15.105:6816/16466051 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa57415f900 con 0x7fa558071cf0 2024-09-12T01:44:59.199 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:44:59.199 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:44:59.199 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:44:59.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.200+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1971596880 >> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] conn(0x7fa558071cf0 msgr2=0x7fa558074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.200+0000 7fa57b3a2640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.105:6816/16466051,v1:172.21.15.105:6817/16466051] conn(0x7fa558071cf0 0x7fa558074110 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.200+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1971596880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa55806be30 msgr2=0x7fa55806e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.200+0000 7fa57b3a2640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fa55806be30 0x7fa55806e2f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa564034000 tx=0x7fa56402e000 comp rx=0 tx=0).stop 2024-09-12T01:44:59.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.200+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1971596880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5740b3650 msgr2=0x7fa574143790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.200+0000 7fa57b3a2640 1 --2- 172.21.15.60:0/1971596880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5740b3650 0x7fa574143790 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fa57000ebe0 tx=0x7fa57000c520 comp rx=0 tx=0).stop 2024-09-12T01:44:59.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.200+0000 7fa57aba1640 1 -- 172.21.15.60:0/1971596880 reap_dead start 2024-09-12T01:44:59.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.200+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1971596880 shutdown_connections 2024-09-12T01:44:59.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.200+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1971596880 >> 172.21.15.60:0/1971596880 conn(0x7fa574062a20 msgr2=0x7fa574073820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:59.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.200+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1971596880 shutdown_connections 2024-09-12T01:44:59.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.200+0000 7fa57b3a2640 1 -- 172.21.15.60:0/1971596880 wait complete. 2024-09-12T01:44:59.210 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T01:44:59.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.313+0000 7fddc5dc4640 1 Processor -- start 2024-09-12T01:44:59.313 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.313+0000 7fddc5dc4640 1 -- start start 2024-09-12T01:44:59.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.314+0000 7fddc5dc4640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fddc00b54d0 0x7fddc006fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.314 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.314+0000 7fddc5dc4640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fddc00b7450 0x7fddc015f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.314+0000 7fddc5dc4640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddc006e990 con 0x7fddc015e6f0 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.314+0000 7fddc5dc4640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fddc006ec70 con 0x7fddc00b54d0 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.314+0000 7fddc5dc4640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fddc015ec70 con 0x7fddc00b7450 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.314+0000 7fddbeffd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fddc00b54d0 0x7fddc006fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.314+0000 7fddbf7fe640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fddc015e6f0 0x7fddc00b6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35558/0 (socket says 172.21.15.60:35558) 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.314+0000 7fddbf7fe640 1 -- 172.21.15.60:0/1109590119 learned_addr learned my addr 172.21.15.60:0/1109590119 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.314+0000 7fddbffff640 1 --2- 172.21.15.60:0/1109590119 >> v2:172.21.15.105:3300/0 conn(0x7fddc00b7450 0x7fddc015f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.314+0000 7fddbe7fc640 1 -- 172.21.15.60:0/1109590119 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341685657 0 0) 0x7fddc006e990 con 0x7fddc015e6f0 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.315+0000 7fddbe7fc640 1 -- 172.21.15.60:0/1109590119 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdda8003520 con 0x7fddc015e6f0 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.315+0000 7fddbeffd640 1 -- 172.21.15.60:0/1109590119 >> v2:172.21.15.105:3300/0 conn(0x7fddc00b7450 msgr2=0x7fddc015f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.315+0000 7fddbeffd640 1 --2- 172.21.15.60:0/1109590119 >> v2:172.21.15.105:3300/0 conn(0x7fddc00b7450 0x7fddc015f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.315+0000 7fddbeffd640 1 -- 172.21.15.60:0/1109590119 >> v1:172.21.15.60:6789/0 conn(0x7fddc015e6f0 legacy=0x7fddc00b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.315 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.315+0000 7fddbeffd640 1 -- 172.21.15.60:0/1109590119 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc015ef50 con 0x7fddc00b54d0 2024-09-12T01:44:59.316 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.315+0000 7fddbeffd640 1 --2- 172.21.15.60:0/1109590119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddc00b54d0 0x7fddc006fd00 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fddc0072df0 tx=0x7fddb402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ded40616e9ad14 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.316+0000 7fddbe7fc640 1 -- 172.21.15.60:0/1109590119 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4037070 con 0x7fddc00b54d0 2024-09-12T01:44:59.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.316+0000 7fddbe7fc640 1 -- 172.21.15.60:0/1109590119 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb4032440 con 0x7fddc00b54d0 2024-09-12T01:44:59.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.316+0000 7fddbe7fc640 1 -- 172.21.15.60:0/1109590119 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4032810 con 0x7fddc00b54d0 2024-09-12T01:44:59.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.316+0000 7fddc5dc4640 1 -- 172.21.15.60:0/1109590119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddc00b54d0 msgr2=0x7fddc006fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.316+0000 7fddc5dc4640 1 --2- 172.21.15.60:0/1109590119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddc00b54d0 0x7fddc006fd00 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fddc0072df0 tx=0x7fddb402a1a0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.316+0000 7fddc5dc4640 1 -- 172.21.15.60:0/1109590119 shutdown_connections 2024-09-12T01:44:59.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.316+0000 7fddc5dc4640 1 --2- 172.21.15.60:0/1109590119 >> v2:172.21.15.105:3300/0 conn(0x7fddc00b7450 0x7fddc015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.316+0000 7fddc5dc4640 1 --2- 172.21.15.60:0/1109590119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddc00b54d0 0x7fddc006fd00 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.316+0000 7fddc5dc4640 1 -- 172.21.15.60:0/1109590119 >> 172.21.15.60:0/1109590119 conn(0x7fddc00d2430 msgr2=0x7fddc00d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:59.317 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.316+0000 7fddc5dc4640 1 -- 172.21.15.60:0/1109590119 shutdown_connections 2024-09-12T01:44:59.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.316+0000 7fddc5dc4640 1 -- 172.21.15.60:0/1109590119 wait complete. 2024-09-12T01:44:59.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.317+0000 7fddc5dc4640 1 Processor -- start 2024-09-12T01:44:59.318 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.318+0000 7fddc5dc4640 1 -- start start 2024-09-12T01:44:59.319 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.318+0000 7fddc5dc4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddc00b54d0 0x7fddc0143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.318+0000 7fddc5dc4640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddc00b7450 0x7fddc0159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.318+0000 7fddc5dc4640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddc015e6f0 0x7fddc0152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.318+0000 7fddc5dc4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fddc006e730 con 0x7fddc00b54d0 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.318+0000 7fddc5dc4640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fddc006e5b0 con 0x7fddc00b7450 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.318+0000 7fddc5dc4640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fddc0070830 con 0x7fddc015e6f0 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.318+0000 7fddbf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddc00b54d0 0x7fddc0143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.318+0000 7fddbf7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddc00b54d0 0x7fddc0143e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52442/0 (socket says 172.21.15.60:52442) 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.318+0000 7fddbf7fe640 1 -- 172.21.15.60:0/3850321686 learned_addr learned my addr 172.21.15.60:0/3850321686 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.318+0000 7fddbffff640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddc015e6f0 0x7fddc0152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.318+0000 7fddbeffd640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddc00b7450 0x7fddc0159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fddbf7fe640 1 -- 172.21.15.60:0/3850321686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddc015e6f0 msgr2=0x7fddc0152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fddbf7fe640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddc015e6f0 0x7fddc0152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fddbf7fe640 1 -- 172.21.15.60:0/3850321686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddc00b7450 msgr2=0x7fddc0159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fddbf7fe640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddc00b7450 0x7fddc0159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fddbf7fe640 1 -- 172.21.15.60:0/3850321686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc0159b90 con 0x7fddc00b54d0 2024-09-12T01:44:59.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fddbffff640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddc015e6f0 0x7fddc0152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:59.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fddbeffd640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddc00b7450 0x7fddc0159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:59.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fddbf7fe640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddc00b54d0 0x7fddc0143e70 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fddb000c390 tx=0x7fddb000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fdda7fff640 1 -- 172.21.15.60:0/3850321686 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb0017070 con 0x7fddc00b54d0 2024-09-12T01:44:59.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fdda7fff640 1 -- 172.21.15.60:0/3850321686 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddb0005ce0 con 0x7fddc00b54d0 2024-09-12T01:44:59.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fdda7fff640 1 -- 172.21.15.60:0/3850321686 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb00072f0 con 0x7fddc00b54d0 2024-09-12T01:44:59.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fddc5dc4640 1 -- 172.21.15.60:0/3850321686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc015f7f0 con 0x7fddc00b54d0 2024-09-12T01:44:59.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.319+0000 7fddc5dc4640 1 -- 172.21.15.60:0/3850321686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc015fdb0 con 0x7fddc00b54d0 2024-09-12T01:44:59.321 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.320+0000 7fddc5dc4640 1 -- 172.21.15.60:0/3850321686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc006c6c0 con 0x7fddc00b54d0 2024-09-12T01:44:59.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.321+0000 7fdda7fff640 1 -- 172.21.15.60:0/3850321686 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fddb001a070 con 0x7fddc00b54d0 2024-09-12T01:44:59.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.321+0000 7fdda7fff640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fddac06be30 0x7fddac06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.321+0000 7fdda7fff640 1 -- 172.21.15.60:0/3850321686 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7fddb0089f10 con 0x7fddc00b54d0 2024-09-12T01:44:59.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.321+0000 7fddbeffd640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fddac06be30 0x7fddac06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.322 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.322+0000 7fddbeffd640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fddac06be30 0x7fddac06e2f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fddb4034000 tx=0x7fddb402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.325+0000 7fdda7fff640 1 -- 172.21.15.60:0/3850321686 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fddb0058c50 con 0x7fddc00b54d0 2024-09-12T01:44:59.498 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.499+0000 7fddc5dc4640 1 -- 172.21.15.60:0/3850321686 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fddc006fd00 con 0x7fddac06be30 2024-09-12T01:44:59.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.499+0000 7fdda7fff640 1 -- 172.21.15.60:0/3850321686 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fddc006fd00 con 0x7fddac06be30 2024-09-12T01:44:59.499 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T01:44:59.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.501+0000 7fddc5dc4640 1 -- 172.21.15.60:0/3850321686 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fddac06be30 msgr2=0x7fddac06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.501+0000 7fddc5dc4640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fddac06be30 0x7fddac06e2f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fddb4034000 tx=0x7fddb402e000 comp rx=0 tx=0).stop 2024-09-12T01:44:59.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.501+0000 7fddc5dc4640 1 -- 172.21.15.60:0/3850321686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddc00b54d0 msgr2=0x7fddc0143e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.501+0000 7fddc5dc4640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddc00b54d0 0x7fddc0143e70 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fddb000c390 tx=0x7fddb000c850 comp rx=0 tx=0).stop 2024-09-12T01:44:59.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.501+0000 7fddc5dc4640 1 -- 172.21.15.60:0/3850321686 shutdown_connections 2024-09-12T01:44:59.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.501+0000 7fddc5dc4640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fddac06be30 0x7fddac06e2f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.501+0000 7fddc5dc4640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fddc015e6f0 0x7fddc0152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.501+0000 7fddc5dc4640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fddc00b7450 0x7fddc0159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.501+0000 7fddc5dc4640 1 --2- 172.21.15.60:0/3850321686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fddc00b54d0 0x7fddc0143e70 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.501+0000 7fddc5dc4640 1 -- 172.21.15.60:0/3850321686 >> 172.21.15.60:0/3850321686 conn(0x7fddc00d2430 msgr2=0x7fddc00b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:59.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.501+0000 7fddc5dc4640 1 -- 172.21.15.60:0/3850321686 shutdown_connections 2024-09-12T01:44:59.502 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.501+0000 7fddc5dc4640 1 -- 172.21.15.60:0/3850321686 wait complete. 2024-09-12T01:44:59.511 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T01:44:59.511 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:44:59.617 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.618+0000 7fb3effbd640 1 Processor -- start 2024-09-12T01:44:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.618+0000 7fb3effbd640 1 -- start start 2024-09-12T01:44:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3effbd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3e80720d0 0x7fb3e80b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.618 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3effbd640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb3e80cca40 0x7fb3e80b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3effbd640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3e8071720 con 0x7fb3e815ad10 2024-09-12T01:44:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3effbd640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fb3e8070fb0 con 0x7fb3e80cca40 2024-09-12T01:44:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3effbd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e8073920 con 0x7fb3e80720d0 2024-09-12T01:44:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3ee55a640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb3e80cca40 0x7fb3e80b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3edd59640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb3e815ad10 0x7fb3e80719c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35564/0 (socket says 172.21.15.60:35564) 2024-09-12T01:44:59.619 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3edd59640 1 -- 172.21.15.60:0/1299871086 learned_addr learned my addr 172.21.15.60:0/1299871086 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3ed558640 1 --2- 172.21.15.60:0/1299871086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3e80720d0 0x7fb3e80b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3ee55a640 1 -- 172.21.15.60:0/1299871086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3e80720d0 msgr2=0x7fb3e80b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3ee55a640 1 --2- 172.21.15.60:0/1299871086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3e80720d0 0x7fb3e80b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3ee55a640 1 -- 172.21.15.60:0/1299871086 >> v1:172.21.15.60:6789/0 conn(0x7fb3e815ad10 legacy=0x7fb3e80719c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3ee55a640 1 -- 172.21.15.60:0/1299871086 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e8073c00 con 0x7fb3e80cca40 2024-09-12T01:44:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3ecd57640 1 -- 172.21.15.60:0/1299871086 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507074064 0 0) 0x7fb3e8071720 con 0x7fb3e815ad10 2024-09-12T01:44:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.619+0000 7fb3ed558640 1 --2- 172.21.15.60:0/1299871086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3e80720d0 0x7fb3e80b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:44:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.620+0000 7fb3ee55a640 1 --2- 172.21.15.60:0/1299871086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3e80cca40 0x7fb3e80b43e0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009d90 tx=0x7fb3e002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4577f6e078065e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.620+0000 7fb3ecd57640 1 -- 172.21.15.60:0/1299871086 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0031600 con 0x7fb3e80cca40 2024-09-12T01:44:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.620+0000 7fb3ecd57640 1 -- 172.21.15.60:0/1299871086 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3e00317a0 con 0x7fb3e80cca40 2024-09-12T01:44:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.620+0000 7fb3ecd57640 1 -- 172.21.15.60:0/1299871086 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e0031b70 con 0x7fb3e80cca40 2024-09-12T01:44:59.621 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.621+0000 7fb3effbd640 1 -- 172.21.15.60:0/1299871086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3e80cca40 msgr2=0x7fb3e80b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.621+0000 7fb3effbd640 1 --2- 172.21.15.60:0/1299871086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3e80cca40 0x7fb3e80b43e0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fb3e0009d90 tx=0x7fb3e002a5d0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.621+0000 7fb3effbd640 1 -- 172.21.15.60:0/1299871086 shutdown_connections 2024-09-12T01:44:59.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.621+0000 7fb3effbd640 1 --2- 172.21.15.60:0/1299871086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3e80cca40 0x7fb3e80b43e0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.621+0000 7fb3effbd640 1 --2- 172.21.15.60:0/1299871086 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3e80720d0 0x7fb3e80b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.621+0000 7fb3effbd640 1 -- 172.21.15.60:0/1299871086 >> 172.21.15.60:0/1299871086 conn(0x7fb3e806d0f0 msgr2=0x7fb3e806d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:59.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.621+0000 7fb3effbd640 1 -- 172.21.15.60:0/1299871086 shutdown_connections 2024-09-12T01:44:59.622 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.621+0000 7fb3effbd640 1 -- 172.21.15.60:0/1299871086 wait complete. 2024-09-12T01:44:59.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.622+0000 7fb3effbd640 1 Processor -- start 2024-09-12T01:44:59.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.622+0000 7fb3effbd640 1 -- start start 2024-09-12T01:44:59.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3effbd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3e80720d0 0x7fb3e813e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3effbd640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3e80cca40 0x7fb3e815d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.624 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3effbd640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3e815ad10 0x7fb3e815d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3effbd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e80cc360 con 0x7fb3e80720d0 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3effbd640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e8071200 con 0x7fb3e815ad10 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3effbd640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb3e80cc4e0 con 0x7fb3e80cca40 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3edd59640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3e80720d0 0x7fb3e813e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3edd59640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3e80720d0 0x7fb3e813e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52468/0 (socket says 172.21.15.60:52468) 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3edd59640 1 -- 172.21.15.60:0/366281766 learned_addr learned my addr 172.21.15.60:0/366281766 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3ee55a640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3e815ad10 0x7fb3e815d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3ed558640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3e80cca40 0x7fb3e815d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3edd59640 1 -- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3e80cca40 msgr2=0x7fb3e815d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3edd59640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3e80cca40 0x7fb3e815d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3edd59640 1 -- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3e815ad10 msgr2=0x7fb3e815d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3edd59640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3e815ad10 0x7fb3e815d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.625 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3edd59640 1 -- 172.21.15.60:0/366281766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3e8151110 con 0x7fb3e80720d0 2024-09-12T01:44:59.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3ee55a640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb3e815ad10 0x7fb3e815d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:59.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.623+0000 7fb3ed558640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb3e80cca40 0x7fb3e815d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:59.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.624+0000 7fb3edd59640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3e80720d0 0x7fb3e813e1b0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400c430 tx=0x7fb3e400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.624+0000 7fb3de7fc640 1 -- 172.21.15.60:0/366281766 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e40074e0 con 0x7fb3e80720d0 2024-09-12T01:44:59.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.624+0000 7fb3de7fc640 1 -- 172.21.15.60:0/366281766 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3e40047e0 con 0x7fb3e80720d0 2024-09-12T01:44:59.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.624+0000 7fb3effbd640 1 -- 172.21.15.60:0/366281766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3e81513f0 con 0x7fb3e80720d0 2024-09-12T01:44:59.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.624+0000 7fb3de7fc640 1 -- 172.21.15.60:0/366281766 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4004bd0 con 0x7fb3e80720d0 2024-09-12T01:44:59.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.624+0000 7fb3effbd640 1 -- 172.21.15.60:0/366281766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3e81519b0 con 0x7fb3e80720d0 2024-09-12T01:44:59.626 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.624+0000 7fb3effbd640 1 -- 172.21.15.60:0/366281766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb3e80d0120 con 0x7fb3e80720d0 2024-09-12T01:44:59.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.625+0000 7fb3de7fc640 1 -- 172.21.15.60:0/366281766 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb3e4011070 con 0x7fb3e80720d0 2024-09-12T01:44:59.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.626+0000 7fb3de7fc640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb3cc06be30 0x7fb3cc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.627 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.626+0000 7fb3de7fc640 1 -- 172.21.15.60:0/366281766 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7fb3e408a870 con 0x7fb3e80720d0 2024-09-12T01:44:59.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.626+0000 7fb3ed558640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb3cc06be30 0x7fb3cc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.626+0000 7fb3de7fc640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] conn(0x7fb3cc071cf0 0x7fb3cc074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.626+0000 7fb3de7fc640 1 -- 172.21.15.60:0/366281766 --> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3e400ee50 con 0x7fb3cc071cf0 2024-09-12T01:44:59.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.626+0000 7fb3de7fc640 1 -- 172.21.15.60:0/366281766 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=142) ==== 24+0+0 (secure 0 0 0) 0x7fb3e408f2a0 con 0x7fb3e80720d0 2024-09-12T01:44:59.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.626+0000 7fb3ee55a640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] conn(0x7fb3cc071cf0 0x7fb3cc074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.626+0000 7fb3ed558640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb3cc06be30 0x7fb3cc06e2f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fb3e815aa70 tx=0x7fb3d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.627+0000 7fb3ee55a640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] conn(0x7fb3cc071cf0 0x7fb3cc074110 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.628 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.628+0000 7fb3de7fc640 1 -- 172.21.15.60:0/366281766 <== osd.6 v2:172.21.15.105:6800/48914195 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3e400ee50 con 0x7fb3cc071cf0 2024-09-12T01:44:59.640 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.641+0000 7fb3effbd640 1 -- 172.21.15.60:0/366281766 --> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb3e80719c0 con 0x7fb3cc071cf0 2024-09-12T01:44:59.641 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.641+0000 7fb3de7fc640 1 -- 172.21.15.60:0/366281766 <== osd.6 v2:172.21.15.105:6800/48914195 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb3e80719c0 con 0x7fb3cc071cf0 2024-09-12T01:44:59.641 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:44:59.641 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:44:59.641 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:44:59.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.642+0000 7fb3effbd640 1 -- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] conn(0x7fb3cc071cf0 msgr2=0x7fb3cc074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.642+0000 7fb3effbd640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.105:6800/48914195,v1:172.21.15.105:6801/48914195] conn(0x7fb3cc071cf0 0x7fb3cc074110 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.642 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.642+0000 7fb3effbd640 1 -- 172.21.15.60:0/366281766 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb3cc06be30 msgr2=0x7fb3cc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.642+0000 7fb3effbd640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb3cc06be30 0x7fb3cc06e2f0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fb3e815aa70 tx=0x7fb3d8008040 comp rx=0 tx=0).stop 2024-09-12T01:44:59.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.642+0000 7fb3effbd640 1 -- 172.21.15.60:0/366281766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3e80720d0 msgr2=0x7fb3e813e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.642+0000 7fb3effbd640 1 --2- 172.21.15.60:0/366281766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb3e80720d0 0x7fb3e813e1b0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400c430 tx=0x7fb3e400c8f0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.642+0000 7fb3ee55a640 1 -- 172.21.15.60:0/366281766 reap_dead start 2024-09-12T01:44:59.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.642+0000 7fb3effbd640 1 -- 172.21.15.60:0/366281766 shutdown_connections 2024-09-12T01:44:59.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.642+0000 7fb3effbd640 1 -- 172.21.15.60:0/366281766 >> 172.21.15.60:0/366281766 conn(0x7fb3e806d0f0 msgr2=0x7fb3e8155ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:59.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.642+0000 7fb3effbd640 1 -- 172.21.15.60:0/366281766 shutdown_connections 2024-09-12T01:44:59.643 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.642+0000 7fb3effbd640 1 -- 172.21.15.60:0/366281766 wait complete. 2024-09-12T01:44:59.652 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T01:44:59.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.755+0000 7fb43a1b9640 1 Processor -- start 2024-09-12T01:44:59.755 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.755+0000 7fb43a1b9640 1 -- start start 2024-09-12T01:44:59.757 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.756+0000 7fb43a1b9640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb4340b6910 0x7fb4340b8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.756+0000 7fb43a1b9640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4340b7790 con 0x7fb4340b64a0 2024-09-12T01:44:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.756+0000 7fb43a1b9640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4340d3600 con 0x7fb43415e750 2024-09-12T01:44:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.756+0000 7fb43a1b9640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fb4340d43c0 con 0x7fb4340b6910 2024-09-12T01:44:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.756+0000 7fb432ffd640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb4340b64a0 0x7fb4340b7f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35572/0 (socket says 172.21.15.60:35572) 2024-09-12T01:44:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.756+0000 7fb432ffd640 1 -- 172.21.15.60:0/532119948 learned_addr learned my addr 172.21.15.60:0/532119948 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:44:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.756+0000 7fb433fff640 1 --2- 172.21.15.60:0/532119948 >> v2:172.21.15.105:3300/0 conn(0x7fb4340b6910 0x7fb4340b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.756+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968995286 0 0) 0x7fb4340b7790 con 0x7fb4340b64a0 2024-09-12T01:44:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.756+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb41c003520 con 0x7fb4340b64a0 2024-09-12T01:44:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1545118082 0 0) 0x7fb41c003520 con 0x7fb4340b64a0 2024-09-12T01:44:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 >> v2:172.21.15.105:3300/0 conn(0x7fb4340b6910 msgr2=0x7fb4340b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 --2- 172.21.15.60:0/532119948 >> v2:172.21.15.105:3300/0 conn(0x7fb4340b6910 0x7fb4340b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 >> v1:172.21.15.105:6789/0 conn(0x7fb43415e750 legacy=0x7fb4340cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4340d38e0 con 0x7fb4340b64a0 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 459950475 0 0) 0x7fb428001670 con 0x7fb4340b64a0 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 >> v1:172.21.15.60:6789/0 conn(0x7fb4340b64a0 legacy=0x7fb4340b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 --2- 172.21.15.60:0/532119948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb41c0039b0 0x7fb41c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 --2- 172.21.15.60:0/532119948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb41c004800 0x7fb41c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 --2- 172.21.15.60:0/532119948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb41c0051c0 0x7fb41c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340d43c0 con 0x7fb41c0039b0 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb41c00c060 con 0x7fb41c0051c0 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb41c00c260 con 0x7fb41c004800 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4337fe640 1 --2- 172.21.15.60:0/532119948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb41c0039b0 0x7fb41c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb433fff640 1 --2- 172.21.15.60:0/532119948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb41c0051c0 0x7fb41c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb432ffd640 1 --2- 172.21.15.60:0/532119948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb41c004800 0x7fb41c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4337fe640 1 -- 172.21.15.60:0/532119948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb41c004800 msgr2=0x7fb41c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4337fe640 1 --2- 172.21.15.60:0/532119948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb41c004800 0x7fb41c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.759 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4337fe640 1 -- 172.21.15.60:0/532119948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb41c0051c0 msgr2=0x7fb41c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:44:59.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4337fe640 1 --2- 172.21.15.60:0/532119948 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb41c0051c0 0x7fb41c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb433fff640 1 -- 172.21.15.60:0/532119948 reap_dead start 2024-09-12T01:44:59.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb4337fe640 1 -- 172.21.15.60:0/532119948 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41c003520 con 0x7fb41c0039b0 2024-09-12T01:44:59.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.757+0000 7fb432ffd640 1 --2- 172.21.15.60:0/532119948 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb41c004800 0x7fb41c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:44:59.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.758+0000 7fb4337fe640 1 --2- 172.21.15.60:0/532119948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb41c0039b0 0x7fb41c003dd0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fb424001750 tx=0x7fb41c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e104697fcd46764d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.758+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb424001370 con 0x7fb41c0039b0 2024-09-12T01:44:59.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.758+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4240052d0 con 0x7fb41c0039b0 2024-09-12T01:44:59.760 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.758+0000 7fb4327fc640 1 -- 172.21.15.60:0/532119948 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42402abc0 con 0x7fb41c0039b0 2024-09-12T01:44:59.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.759+0000 7fb43a1b9640 1 -- 172.21.15.60:0/532119948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb41c0039b0 msgr2=0x7fb41c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.759+0000 7fb43a1b9640 1 --2- 172.21.15.60:0/532119948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb41c0039b0 0x7fb41c003dd0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fb424001750 tx=0x7fb41c005830 comp rx=0 tx=0).stop 2024-09-12T01:44:59.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.759+0000 7fb43a1b9640 1 -- 172.21.15.60:0/532119948 shutdown_connections 2024-09-12T01:44:59.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.759+0000 7fb43a1b9640 1 --2- 172.21.15.60:0/532119948 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb41c0039b0 0x7fb41c003dd0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.759+0000 7fb43a1b9640 1 -- 172.21.15.60:0/532119948 >> 172.21.15.60:0/532119948 conn(0x7fb4340d1500 msgr2=0x7fb4340d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:59.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.759+0000 7fb43a1b9640 1 -- 172.21.15.60:0/532119948 shutdown_connections 2024-09-12T01:44:59.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.759+0000 7fb43a1b9640 1 -- 172.21.15.60:0/532119948 wait complete. 2024-09-12T01:44:59.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.760+0000 7fb43a1b9640 1 Processor -- start 2024-09-12T01:44:59.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.760+0000 7fb43a1b9640 1 -- start start 2024-09-12T01:44:59.763 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb43a1b9640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb41c0039b0 0x7fb434157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb43a1b9640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4341e5040 0x7fb434159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb43a1b9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43415c850 0x7fb43415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb43a1b9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340b7ac0 con 0x7fb43415c850 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb43a1b9640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fb4340d33b0 con 0x7fb4341e5040 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb43a1b9640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fb43415eb30 con 0x7fb41c0039b0 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb433fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43415c850 0x7fb43415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb433fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43415c850 0x7fb43415cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52488/0 (socket says 172.21.15.60:52488) 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb433fff640 1 -- 172.21.15.60:0/475264748 learned_addr learned my addr 172.21.15.60:0/475264748 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb4337fe640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb41c0039b0 0x7fb434157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb432ffd640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4341e5040 0x7fb434159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb433fff640 1 -- 172.21.15.60:0/475264748 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb41c0039b0 msgr2=0x7fb434157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb433fff640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb41c0039b0 0x7fb434157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb433fff640 1 -- 172.21.15.60:0/475264748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4341e5040 msgr2=0x7fb434159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.764 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb433fff640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4341e5040 0x7fb434159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.761+0000 7fb433fff640 1 -- 172.21.15.60:0/475264748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43415a5d0 con 0x7fb43415c850 2024-09-12T01:44:59.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.762+0000 7fb433fff640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43415c850 0x7fb43415cd00 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fb434069950 tx=0x7fb42c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.762+0000 7fb41bfff640 1 -- 172.21.15.60:0/475264748 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c00fce0 con 0x7fb43415c850 2024-09-12T01:44:59.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.762+0000 7fb41bfff640 1 -- 172.21.15.60:0/475264748 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42c00fe80 con 0x7fb43415c850 2024-09-12T01:44:59.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.762+0000 7fb41bfff640 1 -- 172.21.15.60:0/475264748 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb42c015670 con 0x7fb43415c850 2024-09-12T01:44:59.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.762+0000 7fb43a1b9640 1 -- 172.21.15.60:0/475264748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43415a8b0 con 0x7fb43415c850 2024-09-12T01:44:59.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.762+0000 7fb43a1b9640 1 -- 172.21.15.60:0/475264748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43415ae70 con 0x7fb43415c850 2024-09-12T01:44:59.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.763+0000 7fb43a1b9640 1 -- 172.21.15.60:0/475264748 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4340b6d30 con 0x7fb43415c850 2024-09-12T01:44:59.765 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.763+0000 7fb41bfff640 1 -- 172.21.15.60:0/475264748 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fb42c015810 con 0x7fb43415c850 2024-09-12T01:44:59.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.764+0000 7fb41bfff640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb42006be30 0x7fb42006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:44:59.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.764+0000 7fb4337fe640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb42006be30 0x7fb42006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:44:59.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.764+0000 7fb41bfff640 1 -- 172.21.15.60:0/475264748 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7fb42c08b600 con 0x7fb43415c850 2024-09-12T01:44:59.766 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.764+0000 7fb4337fe640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb42006be30 0x7fb42006e2f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb424032000 tx=0x7fb42402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:44:59.768 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.768+0000 7fb41bfff640 1 -- 172.21.15.60:0/475264748 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fb42c024030 con 0x7fb43415c850 2024-09-12T01:44:59.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.941+0000 7fb43a1b9640 1 -- 172.21.15.60:0/475264748 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb4340b5f30 con 0x7fb42006be30 2024-09-12T01:44:59.941 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.942+0000 7fb41bfff640 1 -- 172.21.15.60:0/475264748 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb4340b5f30 con 0x7fb42006be30 2024-09-12T01:44:59.941 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T01:44:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.944+0000 7fb43a1b9640 1 -- 172.21.15.60:0/475264748 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb42006be30 msgr2=0x7fb42006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.944+0000 7fb43a1b9640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb42006be30 0x7fb42006e2f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb424032000 tx=0x7fb42402e000 comp rx=0 tx=0).stop 2024-09-12T01:44:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.944+0000 7fb43a1b9640 1 -- 172.21.15.60:0/475264748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43415c850 msgr2=0x7fb43415cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:44:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.944+0000 7fb43a1b9640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43415c850 0x7fb43415cd00 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fb434069950 tx=0x7fb42c00f1b0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.944+0000 7fb43a1b9640 1 -- 172.21.15.60:0/475264748 shutdown_connections 2024-09-12T01:44:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.944+0000 7fb43a1b9640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb43415c850 0x7fb43415cd00 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.944+0000 7fb43a1b9640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb4341e5040 0x7fb434159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.944+0000 7fb43a1b9640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fb42006be30 0x7fb42006e2f0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.944+0000 7fb43a1b9640 1 --2- 172.21.15.60:0/475264748 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb41c0039b0 0x7fb434157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:44:59.944 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.944+0000 7fb43a1b9640 1 -- 172.21.15.60:0/475264748 >> 172.21.15.60:0/475264748 conn(0x7fb4340d1500 msgr2=0x7fb4340ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:44:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.944+0000 7fb43a1b9640 1 -- 172.21.15.60:0/475264748 shutdown_connections 2024-09-12T01:44:59.945 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:44:59.944+0000 7fb43a1b9640 1 -- 172.21.15.60:0/475264748 wait complete. 2024-09-12T01:44:59.954 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T01:44:59.954 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:45:00.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.061+0000 7fd2d6a7b640 1 Processor -- start 2024-09-12T01:45:00.061 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.061+0000 7fd2d6a7b640 1 -- start start 2024-09-12T01:45:00.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2d6a7b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd2d006fb10 0x7fd2d00b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2d6a7b640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd2d00714a0 0x7fd2d015e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.062 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2d6a7b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d015f020 con 0x7fd2d015e570 2024-09-12T01:45:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2d6a7b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d015fc30 con 0x7fd2d006fb10 2024-09-12T01:45:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2d6a7b640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d015f300 con 0x7fd2d00714a0 2024-09-12T01:45:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2cffff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd2d006fb10 0x7fd2d00b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2d4817640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd2d015e570 0x7fd2d006f400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35576/0 (socket says 172.21.15.60:35576) 2024-09-12T01:45:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2d4817640 1 -- 172.21.15.60:0/1146603538 learned_addr learned my addr 172.21.15.60:0/1146603538 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:45:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2d5018640 1 --2- 172.21.15.60:0/1146603538 >> v2:172.21.15.105:3300/0 conn(0x7fd2d00714a0 0x7fd2d015e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2cf7fe640 1 -- 172.21.15.60:0/1146603538 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862967958 0 0) 0x7fd2d015f020 con 0x7fd2d015e570 2024-09-12T01:45:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2cf7fe640 1 -- 172.21.15.60:0/1146603538 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2bc003520 con 0x7fd2d015e570 2024-09-12T01:45:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2cffff640 1 -- 172.21.15.60:0/1146603538 >> v2:172.21.15.105:3300/0 conn(0x7fd2d00714a0 msgr2=0x7fd2d015e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:45:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2cffff640 1 --2- 172.21.15.60:0/1146603538 >> v2:172.21.15.105:3300/0 conn(0x7fd2d00714a0 0x7fd2d015e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2cffff640 1 -- 172.21.15.60:0/1146603538 >> v1:172.21.15.60:6789/0 conn(0x7fd2d015e570 legacy=0x7fd2d006f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.063 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.062+0000 7fd2cffff640 1 -- 172.21.15.60:0/1146603538 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d015f5e0 con 0x7fd2d006fb10 2024-09-12T01:45:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.063+0000 7fd2cffff640 1 --2- 172.21.15.60:0/1146603538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d006fb10 0x7fd2d00b5540 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00b7c00 tx=0x7fd2b802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be02208503444589 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.063+0000 7fd2cf7fe640 1 -- 172.21.15.60:0/1146603538 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8037070 con 0x7fd2d006fb10 2024-09-12T01:45:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.063+0000 7fd2cf7fe640 1 -- 172.21.15.60:0/1146603538 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b8032440 con 0x7fd2d006fb10 2024-09-12T01:45:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.063+0000 7fd2cf7fe640 1 -- 172.21.15.60:0/1146603538 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8032810 con 0x7fd2d006fb10 2024-09-12T01:45:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.064+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/1146603538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d006fb10 msgr2=0x7fd2d00b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.064+0000 7fd2d6a7b640 1 --2- 172.21.15.60:0/1146603538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d006fb10 0x7fd2d00b5540 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00b7c00 tx=0x7fd2b802a1a0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.064+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/1146603538 shutdown_connections 2024-09-12T01:45:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.064+0000 7fd2d6a7b640 1 --2- 172.21.15.60:0/1146603538 >> v2:172.21.15.105:3300/0 conn(0x7fd2d00714a0 0x7fd2d015e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.064+0000 7fd2d6a7b640 1 --2- 172.21.15.60:0/1146603538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d006fb10 0x7fd2d00b5540 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.065 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.064+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/1146603538 >> 172.21.15.60:0/1146603538 conn(0x7fd2d00b4240 msgr2=0x7fd2d00b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.064+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/1146603538 shutdown_connections 2024-09-12T01:45:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.064+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/1146603538 wait complete. 2024-09-12T01:45:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.065+0000 7fd2d6a7b640 1 Processor -- start 2024-09-12T01:45:00.066 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.065+0000 7fd2d6a7b640 1 -- start start 2024-09-12T01:45:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.066+0000 7fd2d6a7b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2d006fb10 0x7fd2d0148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.066+0000 7fd2d6a7b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d00714a0 0x7fd2d0159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.066+0000 7fd2d6a7b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2d015e570 0x7fd2d015a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.066+0000 7fd2d6a7b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d006d0e0 con 0x7fd2d00714a0 2024-09-12T01:45:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.066+0000 7fd2d6a7b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d006cf60 con 0x7fd2d015e570 2024-09-12T01:45:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.066+0000 7fd2d6a7b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d006d260 con 0x7fd2d006fb10 2024-09-12T01:45:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.066+0000 7fd2cffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d00714a0 0x7fd2d0159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.066+0000 7fd2cffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d00714a0 0x7fd2d0159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52500/0 (socket says 172.21.15.60:52500) 2024-09-12T01:45:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.066+0000 7fd2cffff640 1 -- 172.21.15.60:0/2682731884 learned_addr learned my addr 172.21.15.60:0/2682731884 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:45:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.066+0000 7fd2d4817640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2d006fb10 0x7fd2d0148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.066+0000 7fd2d5018640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2d015e570 0x7fd2d015a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.068 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.067+0000 7fd2cffff640 1 -- 172.21.15.60:0/2682731884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2d006fb10 msgr2=0x7fd2d0148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.067+0000 7fd2cffff640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2d006fb10 0x7fd2d0148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.067+0000 7fd2cffff640 1 -- 172.21.15.60:0/2682731884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2d015e570 msgr2=0x7fd2d015a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.067+0000 7fd2cffff640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fd2d015e570 0x7fd2d015a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.067+0000 7fd2cffff640 1 -- 172.21.15.60:0/2682731884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d00d0400 con 0x7fd2d00714a0 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.067+0000 7fd2d4817640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2d006fb10 0x7fd2d0148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.067+0000 7fd2cffff640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d00714a0 0x7fd2d0159df0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8000c00 tx=0x7fd2b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.067+0000 7fd2cd7fa640 1 -- 172.21.15.60:0/2682731884 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8037040 con 0x7fd2d00714a0 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.067+0000 7fd2cd7fa640 1 -- 172.21.15.60:0/2682731884 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b8042070 con 0x7fd2d00714a0 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.067+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/2682731884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d00d06e0 con 0x7fd2d00714a0 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.067+0000 7fd2cd7fa640 1 -- 172.21.15.60:0/2682731884 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8030960 con 0x7fd2d00714a0 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.067+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/2682731884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d00cef80 con 0x7fd2d00714a0 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.068+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/2682731884 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd2d00b5540 con 0x7fd2d00714a0 2024-09-12T01:45:00.069 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.068+0000 7fd2cd7fa640 1 -- 172.21.15.60:0/2682731884 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fd2b8030b00 con 0x7fd2d00714a0 2024-09-12T01:45:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.069+0000 7fd2cd7fa640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd2b006be30 0x7fd2b006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.069+0000 7fd2cd7fa640 1 -- 172.21.15.60:0/2682731884 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7fd2b80ab440 con 0x7fd2d00714a0 2024-09-12T01:45:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.069+0000 7fd2d4817640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd2b006be30 0x7fd2b006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.069+0000 7fd2cd7fa640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] conn(0x7fd2b0071cf0 0x7fd2b0074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.069+0000 7fd2cd7fa640 1 -- 172.21.15.60:0/2682731884 --> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2b8008eb0 con 0x7fd2b0071cf0 2024-09-12T01:45:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.069+0000 7fd2cd7fa640 1 -- 172.21.15.60:0/2682731884 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=142) ==== 24+0+0 (secure 0 0 0) 0x7fd2b80b2050 con 0x7fd2d00714a0 2024-09-12T01:45:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.069+0000 7fd2d5018640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] conn(0x7fd2b0071cf0 0x7fd2b0074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.069+0000 7fd2d4817640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd2b006be30 0x7fd2b006e2f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0005c00 tx=0x7fd2c0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.070+0000 7fd2d5018640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] conn(0x7fd2b0071cf0 0x7fd2b0074110 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:00.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.071+0000 7fd2cd7fa640 1 -- 172.21.15.60:0/2682731884 <== osd.7 v2:172.21.15.105:6824/2648783557 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2b8008eb0 con 0x7fd2b0071cf0 2024-09-12T01:45:00.082 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.083+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/2682731884 --> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd2d00708c0 con 0x7fd2b0071cf0 2024-09-12T01:45:00.083 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.084+0000 7fd2cd7fa640 1 -- 172.21.15.60:0/2682731884 <== osd.7 v2:172.21.15.105:6824/2648783557 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd2d00708c0 con 0x7fd2b0071cf0 2024-09-12T01:45:00.083 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-12T01:45:00.083 INFO:teuthology.orchestra.run.smithi060.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:45:00.083 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-12T01:45:00.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.084+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/2682731884 >> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] conn(0x7fd2b0071cf0 msgr2=0x7fd2b0074110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.084+0000 7fd2d6a7b640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.105:6824/2648783557,v1:172.21.15.105:6825/2648783557] conn(0x7fd2b0071cf0 0x7fd2b0074110 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.084+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/2682731884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd2b006be30 msgr2=0x7fd2b006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.084+0000 7fd2d6a7b640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fd2b006be30 0x7fd2b006e2f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0005c00 tx=0x7fd2c0009040 comp rx=0 tx=0).stop 2024-09-12T01:45:00.084 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.084+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/2682731884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d00714a0 msgr2=0x7fd2d0159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.084+0000 7fd2d6a7b640 1 --2- 172.21.15.60:0/2682731884 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2d00714a0 0x7fd2d0159df0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8000c00 tx=0x7fd2b80046c0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.084+0000 7fd2d5018640 1 -- 172.21.15.60:0/2682731884 reap_dead start 2024-09-12T01:45:00.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.084+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/2682731884 shutdown_connections 2024-09-12T01:45:00.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.084+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/2682731884 >> 172.21.15.60:0/2682731884 conn(0x7fd2d00b4240 msgr2=0x7fd2d0160770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:00.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.084+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/2682731884 shutdown_connections 2024-09-12T01:45:00.085 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.084+0000 7fd2d6a7b640 1 -- 172.21.15.60:0/2682731884 wait complete. 2024-09-12T01:45:00.094 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T01:45:00.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.197+0000 7fc0edff6640 1 Processor -- start 2024-09-12T01:45:00.197 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.197+0000 7fc0edff6640 1 -- start start 2024-09-12T01:45:00.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.198+0000 7fc0edff6640 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fc0e815c520 0x7fc0e80b4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.198+0000 7fc0edff6640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0e806c320 0x7fc0e80704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.198+0000 7fc0edff6640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0e80cf3d0 con 0x7fc0e8070040 2024-09-12T01:45:00.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.198+0000 7fc0edff6640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e80cffe0 con 0x7fc0e806c320 2024-09-12T01:45:00.198 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.198+0000 7fc0edff6640 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 -- 0x7fc0e80cf6b0 con 0x7fc0e815c520 2024-09-12T01:45:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.198+0000 7fc0e7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0e806c320 0x7fc0e80704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.198+0000 7fc0e7fff640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0e806c320 0x7fc0e80704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52508/0 (socket says 172.21.15.60:52508) 2024-09-12T01:45:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.198+0000 7fc0e7fff640 1 -- 172.21.15.60:0/1332596412 learned_addr learned my addr 172.21.15.60:0/1332596412 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:45:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.198+0000 7fc0e77fe640 1 --2- 172.21.15.60:0/1332596412 >> v2:172.21.15.105:3300/0 conn(0x7fc0e815c520 0x7fc0e80b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.199+0000 7fc0e7fff640 1 -- 172.21.15.60:0/1332596412 >> v2:172.21.15.105:3300/0 conn(0x7fc0e815c520 msgr2=0x7fc0e80b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:45:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.199+0000 7fc0e7fff640 1 --2- 172.21.15.60:0/1332596412 >> v2:172.21.15.105:3300/0 conn(0x7fc0e815c520 0x7fc0e80b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.199+0000 7fc0e7fff640 1 -- 172.21.15.60:0/1332596412 >> v1:172.21.15.105:6789/0 conn(0x7fc0e8070040 legacy=0x7fc0e806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.199+0000 7fc0e7fff640 1 -- 172.21.15.60:0/1332596412 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e80cf990 con 0x7fc0e806c320 2024-09-12T01:45:00.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.199+0000 7fc0e7fff640 1 --2- 172.21.15.60:0/1332596412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0e806c320 0x7fc0e80704a0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80d0160 tx=0x7fc0e002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29c4709998a303d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:00.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.200+0000 7fc0e67fc640 1 -- 172.21.15.60:0/1332596412 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0036070 con 0x7fc0e806c320 2024-09-12T01:45:00.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.200+0000 7fc0e67fc640 1 -- 172.21.15.60:0/1332596412 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e0031600 con 0x7fc0e806c320 2024-09-12T01:45:00.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.200+0000 7fc0e67fc640 1 -- 172.21.15.60:0/1332596412 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e00319d0 con 0x7fc0e806c320 2024-09-12T01:45:00.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.200+0000 7fc0edff6640 1 -- 172.21.15.60:0/1332596412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0e806c320 msgr2=0x7fc0e80704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.200 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.200+0000 7fc0edff6640 1 --2- 172.21.15.60:0/1332596412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0e806c320 0x7fc0e80704a0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fc0e80d0160 tx=0x7fc0e002a6a0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.200+0000 7fc0edff6640 1 -- 172.21.15.60:0/1332596412 shutdown_connections 2024-09-12T01:45:00.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.200+0000 7fc0edff6640 1 --2- 172.21.15.60:0/1332596412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0e806c320 0x7fc0e80704a0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.200+0000 7fc0edff6640 1 --2- 172.21.15.60:0/1332596412 >> v2:172.21.15.105:3300/0 conn(0x7fc0e815c520 0x7fc0e80b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.200+0000 7fc0edff6640 1 -- 172.21.15.60:0/1332596412 >> 172.21.15.60:0/1332596412 conn(0x7fc0e80d1390 msgr2=0x7fc0e80d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:00.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.200+0000 7fc0edff6640 1 -- 172.21.15.60:0/1332596412 shutdown_connections 2024-09-12T01:45:00.201 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.200+0000 7fc0edff6640 1 -- 172.21.15.60:0/1332596412 wait complete. 2024-09-12T01:45:00.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.201+0000 7fc0edff6640 1 Processor -- start 2024-09-12T01:45:00.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.202+0000 7fc0edff6640 1 -- start start 2024-09-12T01:45:00.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.202+0000 7fc0edff6640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e806c320 0x7fc0e814ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.202+0000 7fc0edff6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0e8070040 0x7fc0e8159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.203 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.202+0000 7fc0edff6640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0e815c520 0x7fc0e8151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.202+0000 7fc0edff6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e80d0470 con 0x7fc0e8070040 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.202+0000 7fc0edff6640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7fc0e80cdb00 con 0x7fc0e806c320 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.202+0000 7fc0edff6640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7fc0e80d05f0 con 0x7fc0e815c520 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.202+0000 7fc0e6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0e8070040 0x7fc0e8159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0e6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0e8070040 0x7fc0e8159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52522/0 (socket says 172.21.15.60:52522) 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0e6ffd640 1 -- 172.21.15.60:0/1431793355 learned_addr learned my addr 172.21.15.60:0/1431793355 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0e77fe640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e806c320 0x7fc0e814ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0e7fff640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0e815c520 0x7fc0e8151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0e6ffd640 1 -- 172.21.15.60:0/1431793355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0e815c520 msgr2=0x7fc0e8151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0e6ffd640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0e815c520 0x7fc0e8151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0e6ffd640 1 -- 172.21.15.60:0/1431793355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e806c320 msgr2=0x7fc0e814ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0e6ffd640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e806c320 0x7fc0e814ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.204 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0e6ffd640 1 -- 172.21.15.60:0/1431793355 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0e814f1a0 con 0x7fc0e8070040 2024-09-12T01:45:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0e7fff640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0e815c520 0x7fc0e8151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-12T01:45:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0e6ffd640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0e8070040 0x7fc0e8159870 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00c430 tx=0x7fc0dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0cffff640 1 -- 172.21.15.60:0/1431793355 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc0052d0 con 0x7fc0e8070040 2024-09-12T01:45:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0cffff640 1 -- 172.21.15.60:0/1431793355 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0dc005490 con 0x7fc0e8070040 2024-09-12T01:45:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0edff6640 1 -- 172.21.15.60:0/1431793355 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0e815a0c0 con 0x7fc0e8070040 2024-09-12T01:45:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0cffff640 1 -- 172.21.15.60:0/1431793355 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0dc007260 con 0x7fc0e8070040 2024-09-12T01:45:00.205 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.203+0000 7fc0edff6640 1 -- 172.21.15.60:0/1431793355 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0e815a680 con 0x7fc0e8070040 2024-09-12T01:45:00.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.204+0000 7fc0edff6640 1 -- 172.21.15.60:0/1431793355 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e80704a0 con 0x7fc0e8070040 2024-09-12T01:45:00.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.205+0000 7fc0cffff640 1 -- 172.21.15.60:0/1431793355 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7fc0dc007400 con 0x7fc0e8070040 2024-09-12T01:45:00.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.205+0000 7fc0cffff640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc0d406be30 0x7fc0d406e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.205+0000 7fc0cffff640 1 -- 172.21.15.60:0/1431793355 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7fc0dc089fd0 con 0x7fc0e8070040 2024-09-12T01:45:00.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.205+0000 7fc0e77fe640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc0d406be30 0x7fc0d406e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.206 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.206+0000 7fc0e77fe640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc0d406be30 0x7fc0d406e2f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009aa0 tx=0x7fc0d8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:00.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.209+0000 7fc0cffff640 1 -- 172.21.15.60:0/1431793355 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7fc0dc058630 con 0x7fc0e8070040 2024-09-12T01:45:00.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.384+0000 7fc0edff6640 1 -- 172.21.15.60:0/1431793355 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fc0e80b1090 con 0x7fc0d406be30 2024-09-12T01:45:00.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.384+0000 7fc0cffff640 1 -- 172.21.15.60:0/1431793355 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc0e80b1090 con 0x7fc0d406be30 2024-09-12T01:45:00.384 INFO:teuthology.orchestra.run.smithi060.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T01:45:00.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.386+0000 7fc0edff6640 1 -- 172.21.15.60:0/1431793355 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc0d406be30 msgr2=0x7fc0d406e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.386+0000 7fc0edff6640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc0d406be30 0x7fc0d406e2f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009aa0 tx=0x7fc0d8009190 comp rx=0 tx=0).stop 2024-09-12T01:45:00.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.386+0000 7fc0edff6640 1 -- 172.21.15.60:0/1431793355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0e8070040 msgr2=0x7fc0e8159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.386+0000 7fc0edff6640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0e8070040 0x7fc0e8159870 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fc0dc00c430 tx=0x7fc0dc00c8f0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.386+0000 7fc0edff6640 1 -- 172.21.15.60:0/1431793355 shutdown_connections 2024-09-12T01:45:00.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.386+0000 7fc0edff6640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7fc0d406be30 0x7fc0d406e2f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.386 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.386+0000 7fc0edff6640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc0e815c520 0x7fc0e8151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.386+0000 7fc0edff6640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0e8070040 0x7fc0e8159870 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.386+0000 7fc0edff6640 1 --2- 172.21.15.60:0/1431793355 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fc0e806c320 0x7fc0e814ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.386+0000 7fc0edff6640 1 -- 172.21.15.60:0/1431793355 >> 172.21.15.60:0/1431793355 conn(0x7fc0e80d1390 msgr2=0x7fc0e80b4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:00.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.386+0000 7fc0edff6640 1 -- 172.21.15.60:0/1431793355 shutdown_connections 2024-09-12T01:45:00.387 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.387+0000 7fc0edff6640 1 -- 172.21.15.60:0/1431793355 wait complete. 2024-09-12T01:45:00.397 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:45:00.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.499+0000 7f314d037640 1 Processor -- start 2024-09-12T01:45:00.499 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.499+0000 7f314d037640 1 -- start start 2024-09-12T01:45:00.500 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.500+0000 7f314d037640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314815e660 0x7f31480cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.500+0000 7f314d037640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f314815ea40 con 0x7f31480d1820 2024-09-12T01:45:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.500+0000 7f314d037640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31480d3870 con 0x7f31480d3310 2024-09-12T01:45:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.500+0000 7f314d037640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31480d3b50 con 0x7f314815e660 2024-09-12T01:45:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.500+0000 7f314759e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f31480d1820 0x7f31480b7b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:35584/0 (socket says 172.21.15.60:35584) 2024-09-12T01:45:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.500+0000 7f314759e640 1 -- 172.21.15.60:0/3492055500 learned_addr learned my addr 172.21.15.60:0/3492055500 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:45:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.500+0000 7f3146d9d640 1 --2- 172.21.15.60:0/3492055500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314815e660 0x7f31480cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.501+0000 7f3145d9b640 1 -- 172.21.15.60:0/3492055500 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1690947585 0 0) 0x7f314815ea40 con 0x7f31480d1820 2024-09-12T01:45:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.501+0000 7f3145d9b640 1 -- 172.21.15.60:0/3492055500 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3134003520 con 0x7f31480d1820 2024-09-12T01:45:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.501+0000 7f3145d9b640 1 -- 172.21.15.60:0/3492055500 <== mon.1 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289233915 0 0) 0x7f31480d3870 con 0x7f31480d3310 2024-09-12T01:45:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.501+0000 7f3146d9d640 1 -- 172.21.15.60:0/3492055500 >> v1:172.21.15.105:6789/0 conn(0x7f31480d3310 legacy=0x7f31480d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.501+0000 7f3146d9d640 1 -- 172.21.15.60:0/3492055500 >> v1:172.21.15.60:6789/0 conn(0x7f31480d1820 legacy=0x7f31480b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.501 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.501+0000 7f3146d9d640 1 -- 172.21.15.60:0/3492055500 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31480d3e30 con 0x7f314815e660 2024-09-12T01:45:00.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.502+0000 7f3146d9d640 1 --2- 172.21.15.60:0/3492055500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314815e660 0x7f31480cf730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3138009dc0 tx=0x7f313802a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c19abcf9a571a3b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:00.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.502+0000 7f3145d9b640 1 -- 172.21.15.60:0/3492055500 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3138035020 con 0x7f314815e660 2024-09-12T01:45:00.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.502+0000 7f3145d9b640 1 -- 172.21.15.60:0/3492055500 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3138007540 con 0x7f314815e660 2024-09-12T01:45:00.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.502+0000 7f3145d9b640 1 -- 172.21.15.60:0/3492055500 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31400015f0 con 0x7f314815e660 2024-09-12T01:45:00.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.502+0000 7f314d037640 1 -- 172.21.15.60:0/3492055500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314815e660 msgr2=0x7f31480cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.502+0000 7f314d037640 1 --2- 172.21.15.60:0/3492055500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314815e660 0x7f31480cf730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3138009dc0 tx=0x7f313802a640 comp rx=0 tx=0).stop 2024-09-12T01:45:00.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.502+0000 7f314d037640 1 -- 172.21.15.60:0/3492055500 shutdown_connections 2024-09-12T01:45:00.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.502+0000 7f314d037640 1 --2- 172.21.15.60:0/3492055500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f314815e660 0x7f31480cf730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.502+0000 7f314d037640 1 -- 172.21.15.60:0/3492055500 >> 172.21.15.60:0/3492055500 conn(0x7f31480b6410 msgr2=0x7f31480b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:00.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.502+0000 7f314d037640 1 -- 172.21.15.60:0/3492055500 shutdown_connections 2024-09-12T01:45:00.503 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.502+0000 7f314d037640 1 -- 172.21.15.60:0/3492055500 wait complete. 2024-09-12T01:45:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.504+0000 7f314d037640 1 Processor -- start 2024-09-12T01:45:00.505 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.504+0000 7f314d037640 1 -- start start 2024-09-12T01:45:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314d037640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31480d1820 0x7f31480cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314d037640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31480d3310 0x7f31480cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314d037640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314815e660 0x7f31480cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314d037640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f31480cfc70 con 0x7f314815e660 2024-09-12T01:45:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314d037640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f31480d43f0 con 0x7f31480d1820 2024-09-12T01:45:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314d037640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f31480b8280 con 0x7f31480d3310 2024-09-12T01:45:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314815e660 0x7f31480cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314815e660 0x7f31480cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:52538/0 (socket says 172.21.15.60:52538) 2024-09-12T01:45:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314759e640 1 -- 172.21.15.60:0/779178787 learned_addr learned my addr 172.21.15.60:0/779178787 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:45:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f3146d9d640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31480d1820 0x7f31480cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314659c640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31480d3310 0x7f31480cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.506 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314759e640 1 -- 172.21.15.60:0/779178787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31480d3310 msgr2=0x7f31480cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314759e640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31480d3310 0x7f31480cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314759e640 1 -- 172.21.15.60:0/779178787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31480d1820 msgr2=0x7f31480cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314759e640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31480d1820 0x7f31480cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314759e640 1 -- 172.21.15.60:0/779178787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31480cdd60 con 0x7f314815e660 2024-09-12T01:45:00.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.505+0000 7f314759e640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314815e660 0x7f31480cbbd0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f314000c780 tx=0x7f314000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:00.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.506+0000 7f313f7fe640 1 -- 172.21.15.60:0/779178787 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3140018070 con 0x7f314815e660 2024-09-12T01:45:00.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.506+0000 7f313f7fe640 1 -- 172.21.15.60:0/779178787 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31400072d0 con 0x7f314815e660 2024-09-12T01:45:00.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.506+0000 7f313f7fe640 1 -- 172.21.15.60:0/779178787 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31400047e0 con 0x7f314815e660 2024-09-12T01:45:00.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.506+0000 7f314d037640 1 -- 172.21.15.60:0/779178787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31480ce040 con 0x7f314815e660 2024-09-12T01:45:00.507 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.506+0000 7f314d037640 1 -- 172.21.15.60:0/779178787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31480ce600 con 0x7f314815e660 2024-09-12T01:45:00.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.507+0000 7f314d037640 1 -- 172.21.15.60:0/779178787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31480cf730 con 0x7f314815e660 2024-09-12T01:45:00.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.507+0000 7f313f7fe640 1 -- 172.21.15.60:0/779178787 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f314001b070 con 0x7f314815e660 2024-09-12T01:45:00.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.508+0000 7f313f7fe640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f312806be60 0x7f312806e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:00.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.508+0000 7f313f7fe640 1 -- 172.21.15.60:0/779178787 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f3140089f70 con 0x7f314815e660 2024-09-12T01:45:00.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.508+0000 7f3146d9d640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f312806be60 0x7f312806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:00.508 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.508+0000 7f3146d9d640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f312806be60 0x7f312806e320 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3138033000 tx=0x7f313802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:00.511 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.512+0000 7f313f7fe640 1 -- 172.21.15.60:0/779178787 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f31400585d0 con 0x7f314815e660 2024-09-12T01:45:00.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.685+0000 7f314d037640 1 -- 172.21.15.60:0/779178787 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f31480cc110 con 0x7f312806be60 2024-09-12T01:45:00.685 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.686+0000 7f313f7fe640 1 -- 172.21.15.60:0/779178787 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13457 (secure 0 0 0) 0x7f31480cc110 con 0x7f312806be60 2024-09-12T01:45:00.686 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:45:00.686 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:45:00.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.688+0000 7f314d037640 1 -- 172.21.15.60:0/779178787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f312806be60 msgr2=0x7f312806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.688+0000 7f314d037640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f312806be60 0x7f312806e320 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3138033000 tx=0x7f313802f000 comp rx=0 tx=0).stop 2024-09-12T01:45:00.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.688+0000 7f314d037640 1 -- 172.21.15.60:0/779178787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314815e660 msgr2=0x7f31480cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:00.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.688+0000 7f314d037640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314815e660 0x7f31480cbbd0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f314000c780 tx=0x7f314000cc40 comp rx=0 tx=0).stop 2024-09-12T01:45:00.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.688+0000 7f314d037640 1 -- 172.21.15.60:0/779178787 shutdown_connections 2024-09-12T01:45:00.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.688+0000 7f314d037640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f314815e660 0x7f31480cbbd0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.688+0000 7f314d037640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f312806be60 0x7f312806e320 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.688+0000 7f314d037640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f31480d3310 0x7f31480cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.688 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.688+0000 7f314d037640 1 --2- 172.21.15.60:0/779178787 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f31480d1820 0x7f31480cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:00.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.688+0000 7f314d037640 1 -- 172.21.15.60:0/779178787 >> 172.21.15.60:0/779178787 conn(0x7f31480b6410 msgr2=0x7f314806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:00.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.688+0000 7f314d037640 1 -- 172.21.15.60:0/779178787 shutdown_connections 2024-09-12T01:45:00.689 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:00.688+0000 7f314d037640 1 -- 172.21.15.60:0/779178787 wait complete. 2024-09-12T01:45:00.698 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":414,"stamp":"2024-09-12T01:45:00.381536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":293748,"kb_used_data":15112,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754680972,"statfs":{"total":773094113280,"available":772793315328,"internally_reserved":0,"allocated":15474688,"data_stored":7296840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.095208"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":395,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-12T01:44:52.572874+0000","last_change":"2024-09-12T01:35:48.011512+0000","last_active":"2024-09-12T01:44:52.572874+0000","last_peered":"2024-09-12T01:44:52.572874+0000","last_clean":"2024-09-12T01:44:52.572874+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:44:52.572874+0000","last_undegraded":"2024-09-12T01:44:52.572874+0000","last_fullsized":"2024-09-12T01:44:52.572874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:35:46.998848+0000","last_clean_scrub_stamp":"2024-09-12T01:35:46.998848+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:36.385731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509555,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37096,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37092,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33512,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338328,"statfs":{"total":96636764160,"available":96602447872,"internally_reserved":0,"allocated":2379776,"data_stored":1354881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41256,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330584,"statfs":{"total":96636764160,"available":96594518016,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37092,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509553,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37676,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334164,"statfs":{"total":96636764160,"available":96598183936,"internally_reserved":0,"allocated":2379776,"data_stored":1354881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509554,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37092,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:45:00.702 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T01:35:46.998848+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=35, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=44, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:45:00.702 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:45:19.607 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:45:19.610 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:45:20.703 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:45:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.820+0000 7f495307b640 1 Processor -- start 2024-09-12T01:45:20.820 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.820+0000 7f495307b640 1 -- start start 2024-09-12T01:45:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.821+0000 7f495307b640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f494c15e660 0x7f494c0cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.821+0000 7f495307b640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f494c15ea40 con 0x7f494c0d3310 2024-09-12T01:45:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.821+0000 7f495307b640 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f494c0d3870 con 0x7f494c0d1820 2024-09-12T01:45:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.821+0000 7f495307b640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f494c0d3b50 con 0x7f494c15e660 2024-09-12T01:45:20.821 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.821+0000 7f4950e17640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f494c15e660 0x7f494c0cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.821+0000 7f494bfff640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f494c0d3310 0x7f494c0d1110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46314/0 (socket says 172.21.15.60:46314) 2024-09-12T01:45:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.822+0000 7f4950e17640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f494c15e660 0x7f494c0cf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43446/0 (socket says 172.21.15.60:43446) 2024-09-12T01:45:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.822+0000 7f494bfff640 1 -- 172.21.15.60:0/4095389283 learned_addr learned my addr 172.21.15.60:0/4095389283 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:45:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.822+0000 7f4950e17640 1 -- 172.21.15.60:0/4095389283 >> v1:172.21.15.105:6789/0 conn(0x7f494c0d1820 legacy=0x7f494c0b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.822+0000 7f4950e17640 1 -- 172.21.15.60:0/4095389283 >> v1:172.21.15.60:6789/0 conn(0x7f494c0d3310 legacy=0x7f494c0d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.822+0000 7f494b7fe640 1 -- 172.21.15.60:0/4095389283 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1419579843 0 0) 0x7f494c15ea40 con 0x7f494c0d3310 2024-09-12T01:45:20.822 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.822+0000 7f4950e17640 1 -- 172.21.15.60:0/4095389283 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c0d3e30 con 0x7f494c15e660 2024-09-12T01:45:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.823+0000 7f4950e17640 1 --2- 172.21.15.60:0/4095389283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f494c15e660 0x7f494c0cf730 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f49400097a0 tx=0x7f494002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8349a0d2209644ea server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.823+0000 7f494b7fe640 1 -- 172.21.15.60:0/4095389283 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940037070 con 0x7f494c15e660 2024-09-12T01:45:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.823+0000 7f494b7fe640 1 -- 172.21.15.60:0/4095389283 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4940032440 con 0x7f494c15e660 2024-09-12T01:45:20.823 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.823+0000 7f494b7fe640 1 -- 172.21.15.60:0/4095389283 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940032810 con 0x7f494c15e660 2024-09-12T01:45:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.824+0000 7f495307b640 1 -- 172.21.15.60:0/4095389283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f494c15e660 msgr2=0x7f494c0cf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.824+0000 7f495307b640 1 --2- 172.21.15.60:0/4095389283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f494c15e660 0x7f494c0cf730 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f49400097a0 tx=0x7f494002a230 comp rx=0 tx=0).stop 2024-09-12T01:45:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.824+0000 7f495307b640 1 -- 172.21.15.60:0/4095389283 shutdown_connections 2024-09-12T01:45:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.824+0000 7f495307b640 1 --2- 172.21.15.60:0/4095389283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f494c15e660 0x7f494c0cf730 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.824+0000 7f495307b640 1 -- 172.21.15.60:0/4095389283 >> 172.21.15.60:0/4095389283 conn(0x7f494c0b6410 msgr2=0x7f494c0b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.824+0000 7f495307b640 1 -- 172.21.15.60:0/4095389283 shutdown_connections 2024-09-12T01:45:20.824 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.824+0000 7f495307b640 1 -- 172.21.15.60:0/4095389283 wait complete. 2024-09-12T01:45:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.825+0000 7f495307b640 1 Processor -- start 2024-09-12T01:45:20.825 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.825+0000 7f495307b640 1 -- start start 2024-09-12T01:45:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.826+0000 7f495307b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f494c0d1820 0x7f494c152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.826+0000 7f495307b640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f494c0d3310 0x7f494c154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.826+0000 7f495307b640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f494c15e660 0x7f494c0cade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.826+0000 7f495307b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f494c0cfc70 con 0x7f494c0d1820 2024-09-12T01:45:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.826+0000 7f495307b640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f494c0d43f0 con 0x7f494c15e660 2024-09-12T01:45:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.826+0000 7f495307b640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f494c0b8280 con 0x7f494c0d3310 2024-09-12T01:45:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.826+0000 7f4950e17640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f494c0d1820 0x7f494c152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:20.827 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.826+0000 7f4950e17640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f494c0d1820 0x7f494c152600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43454/0 (socket says 172.21.15.60:43454) 2024-09-12T01:45:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.826+0000 7f4950e17640 1 -- 172.21.15.60:0/1444998427 learned_addr learned my addr 172.21.15.60:0/1444998427 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:45:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.826+0000 7f494bfff640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f494c0d3310 0x7f494c154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.826+0000 7f4951618640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f494c15e660 0x7f494c0cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.827+0000 7f4950e17640 1 -- 172.21.15.60:0/1444998427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f494c0d3310 msgr2=0x7f494c154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.827+0000 7f4950e17640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f494c0d3310 0x7f494c154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.827+0000 7f4950e17640 1 -- 172.21.15.60:0/1444998427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f494c15e660 msgr2=0x7f494c0cade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.827+0000 7f4950e17640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f494c15e660 0x7f494c0cade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.827+0000 7f4950e17640 1 -- 172.21.15.60:0/1444998427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f494c155170 con 0x7f494c0d1820 2024-09-12T01:45:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.827+0000 7f4950e17640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f494c0d1820 0x7f494c152600 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f49400097a0 tx=0x7f49400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.827+0000 7f49497fa640 1 -- 172.21.15.60:0/1444998427 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940037050 con 0x7f494c0d1820 2024-09-12T01:45:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.827+0000 7f49497fa640 1 -- 172.21.15.60:0/1444998427 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4940038040 con 0x7f494c0d1820 2024-09-12T01:45:20.828 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.827+0000 7f495307b640 1 -- 172.21.15.60:0/1444998427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f494c155450 con 0x7f494c0d1820 2024-09-12T01:45:20.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.827+0000 7f49497fa640 1 -- 172.21.15.60:0/1444998427 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4940004490 con 0x7f494c0d1820 2024-09-12T01:45:20.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.827+0000 7f495307b640 1 -- 172.21.15.60:0/1444998427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f494c15fcb0 con 0x7f494c0d1820 2024-09-12T01:45:20.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.828+0000 7f495307b640 1 -- 172.21.15.60:0/1444998427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f494c0cf730 con 0x7f494c0d1820 2024-09-12T01:45:20.829 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.829+0000 7f49497fa640 1 -- 172.21.15.60:0/1444998427 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4940030900 con 0x7f494c0d1820 2024-09-12T01:45:20.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.829+0000 7f49497fa640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f493006be30 0x7f493006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:20.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.829+0000 7f49497fa640 1 -- 172.21.15.60:0/1444998427 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f49400ab810 con 0x7f494c0d1820 2024-09-12T01:45:20.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.829+0000 7f494bfff640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f493006be30 0x7f493006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:20.830 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.830+0000 7f494bfff640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f493006be30 0x7f493006e2f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f494c0ceb20 tx=0x7f4938007b90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:20.833 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:20.834+0000 7f49497fa640 1 -- 172.21.15.60:0/1444998427 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f494007a5e0 con 0x7f494c0d1820 2024-09-12T01:45:21.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.007+0000 7f495307b640 1 -- 172.21.15.60:0/1444998427 --> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f494c1f5140 con 0x7f493006be30 2024-09-12T01:45:21.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.008+0000 7f49497fa640 1 -- 172.21.15.60:0/1444998427 <== mgr.4098 v2:172.21.15.60:6800/2696595369 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13379 (secure 0 0 0) 0x7f494c1f5140 con 0x7f493006be30 2024-09-12T01:45:21.007 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:45:21.008 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2024-09-12T01:45:21.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.010+0000 7f495307b640 1 -- 172.21.15.60:0/1444998427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f493006be30 msgr2=0x7f493006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.010+0000 7f495307b640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f493006be30 0x7f493006e2f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f494c0ceb20 tx=0x7f4938007b90 comp rx=0 tx=0).stop 2024-09-12T01:45:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.010+0000 7f495307b640 1 -- 172.21.15.60:0/1444998427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f494c0d1820 msgr2=0x7f494c152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.010+0000 7f495307b640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f494c0d1820 0x7f494c152600 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f49400097a0 tx=0x7f49400046c0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.010+0000 7f495307b640 1 -- 172.21.15.60:0/1444998427 shutdown_connections 2024-09-12T01:45:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.010+0000 7f495307b640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f494c15e660 0x7f494c0cade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.010+0000 7f495307b640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f493006be30 0x7f493006e2f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.010+0000 7f495307b640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f494c0d3310 0x7f494c154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.010+0000 7f495307b640 1 --2- 172.21.15.60:0/1444998427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f494c0d1820 0x7f494c152600 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.010+0000 7f495307b640 1 -- 172.21.15.60:0/1444998427 >> 172.21.15.60:0/1444998427 conn(0x7f494c0b6410 msgr2=0x7f494c0b9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.010+0000 7f495307b640 1 -- 172.21.15.60:0/1444998427 shutdown_connections 2024-09-12T01:45:21.010 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.010+0000 7f495307b640 1 -- 172.21.15.60:0/1444998427 wait complete. 2024-09-12T01:45:21.024 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":424,"stamp":"2024-09-12T01:45:20.385379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":293736,"kb_used_data":15112,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754680984,"statfs":{"total":773094113280,"available":772793327616,"internally_reserved":0,"allocated":15474688,"data_stored":7296840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":285134384},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002311"},"pg_stats":[{"pgid":"1.0","version":"142'119","reported_seq":406,"reported_epoch":142,"state":"active+clean","last_fresh":"2024-09-12T01:44:58.618534+0000","last_change":"2024-09-12T01:44:58.618563+0000","last_active":"2024-09-12T01:44:58.618534+0000","last_peered":"2024-09-12T01:44:58.618534+0000","last_clean":"2024-09-12T01:44:58.618534+0000","last_became_active":"2024-09-12T01:35:48.011207+0000","last_became_peered":"2024-09-12T01:35:48.011207+0000","last_unstale":"2024-09-12T01:44:58.618534+0000","last_undegraded":"2024-09-12T01:44:58.618534+0000","last_fullsized":"2024-09-12T01:44:58.618534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'119","last_scrub_stamp":"2024-09-12T01:44:58.618455+0000","last_deep_scrub":"142'119","last_deep_scrub_stamp":"2024-09-12T01:44:58.618455+0000","last_clean_scrub_stamp":"2024-09-12T01:44:58.618455+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:45.846367+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509559,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37096,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334744,"statfs":{"total":96636764160,"available":96598777856,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37092,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509557,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33508,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338332,"statfs":{"total":96636764160,"available":96602451968,"internally_reserved":0,"allocated":2379776,"data_stored":1354881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":41256,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330584,"statfs":{"total":96636764160,"available":96594518016,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37092,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509557,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37668,"kb_used_data":2324,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334172,"statfs":{"total":96636764160,"available":96598192128,"internally_reserved":0,"allocated":2379776,"data_stored":1354881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509558,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37092,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334748,"statfs":{"total":96636764160,"available":96598781952,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32932,"kb_used_data":1744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338908,"statfs":{"total":96636764160,"available":96603041792,"internally_reserved":0,"allocated":1785856,"data_stored":764513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:45:21.025 DEBUG:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T01:45:21.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.128+0000 7f66e8186640 1 Processor -- start 2024-09-12T01:45:21.128 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.129+0000 7f66e8186640 1 -- start start 2024-09-12T01:45:21.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e8186640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f66e00730d0 0x7f66e006fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:21.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e8186640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66e00ae890 0x7f66e00aecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:21.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e8186640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e00717c0 con 0x7f66e015f780 2024-09-12T01:45:21.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e8186640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f66e0071aa0 con 0x7f66e00730d0 2024-09-12T01:45:21.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e8186640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f66e0071d80 con 0x7f66e00ae890 2024-09-12T01:45:21.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e5f22640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f66e00730d0 0x7f66e006fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:21.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e5721640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f66e015f780 0x7f66e00734b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46324/0 (socket says 172.21.15.60:46324) 2024-09-12T01:45:21.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e5721640 1 -- 172.21.15.60:0/81719554 learned_addr learned my addr 172.21.15.60:0/81719554 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:45:21.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e6723640 1 --2- 172.21.15.60:0/81719554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66e00ae890 0x7f66e00aecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:21.130 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e5f22640 1 -- 172.21.15.60:0/81719554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66e00ae890 msgr2=0x7f66e00aecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:45:21.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e5f22640 1 --2- 172.21.15.60:0/81719554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66e00ae890 0x7f66e00aecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e5f22640 1 -- 172.21.15.60:0/81719554 >> v1:172.21.15.60:6789/0 conn(0x7f66e015f780 legacy=0x7f66e00734b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e5f22640 1 -- 172.21.15.60:0/81719554 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e0072060 con 0x7f66e00730d0 2024-09-12T01:45:21.131 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.130+0000 7f66e4f20640 1 -- 172.21.15.60:0/81719554 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4049866098 0 0) 0x7f66e00717c0 con 0x7f66e015f780 2024-09-12T01:45:21.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.131+0000 7f66e5f22640 1 --2- 172.21.15.60:0/81719554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66e00730d0 0x7f66e006fc30 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0097a0 tx=0x7f66dc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fea6043690b160 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:21.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.131+0000 7f66e4f20640 1 -- 172.21.15.60:0/81719554 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc037070 con 0x7f66e00730d0 2024-09-12T01:45:21.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.131+0000 7f66e4f20640 1 -- 172.21.15.60:0/81719554 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66dc032440 con 0x7f66e00730d0 2024-09-12T01:45:21.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.131+0000 7f66e4f20640 1 -- 172.21.15.60:0/81719554 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc032810 con 0x7f66e00730d0 2024-09-12T01:45:21.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.132+0000 7f66e8186640 1 -- 172.21.15.60:0/81719554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66e00730d0 msgr2=0x7f66e006fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.132+0000 7f66e8186640 1 --2- 172.21.15.60:0/81719554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66e00730d0 0x7f66e006fc30 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0097a0 tx=0x7f66dc02a180 comp rx=0 tx=0).stop 2024-09-12T01:45:21.132 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.132+0000 7f66e8186640 1 -- 172.21.15.60:0/81719554 shutdown_connections 2024-09-12T01:45:21.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.132+0000 7f66e8186640 1 --2- 172.21.15.60:0/81719554 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66e00ae890 0x7f66e00aecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.132+0000 7f66e8186640 1 --2- 172.21.15.60:0/81719554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66e00730d0 0x7f66e006fc30 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.132+0000 7f66e8186640 1 -- 172.21.15.60:0/81719554 >> 172.21.15.60:0/81719554 conn(0x7f66e00b0aa0 msgr2=0x7f66e00b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:21.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.132+0000 7f66e8186640 1 -- 172.21.15.60:0/81719554 shutdown_connections 2024-09-12T01:45:21.133 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.132+0000 7f66e8186640 1 -- 172.21.15.60:0/81719554 wait complete. 2024-09-12T01:45:21.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.133+0000 7f66e8186640 1 Processor -- start 2024-09-12T01:45:21.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.133+0000 7f66e8186640 1 -- start start 2024-09-12T01:45:21.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e8186640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66e00730d0 0x7f66e014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:21.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e8186640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66e00ae890 0x7f66e014e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:21.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e8186640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66e015f780 0x7f66e01e8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:21.135 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e8186640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f66e015fc10 con 0x7f66e015f780 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e8186640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f66e0159170 con 0x7f66e00730d0 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e8186640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f66e0072860 con 0x7f66e00ae890 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e6723640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66e015f780 0x7f66e01e8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e6723640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66e015f780 0x7f66e01e8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43476/0 (socket says 172.21.15.60:43476) 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e6723640 1 -- 172.21.15.60:0/374089715 learned_addr learned my addr 172.21.15.60:0/374089715 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e5f22640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66e00730d0 0x7f66e014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e5721640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66e00ae890 0x7f66e014e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e6723640 1 -- 172.21.15.60:0/374089715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66e00ae890 msgr2=0x7f66e014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e6723640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66e00ae890 0x7f66e014e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e6723640 1 -- 172.21.15.60:0/374089715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66e00730d0 msgr2=0x7f66e014f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e6723640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66e00730d0 0x7f66e014f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.134+0000 7f66e6723640 1 -- 172.21.15.60:0/374089715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e014f650 con 0x7f66e015f780 2024-09-12T01:45:21.136 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.135+0000 7f66e6723640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66e015f780 0x7f66e01e8130 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f66d8007e70 tx=0x7f66d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:21.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.135+0000 7f66d27fc640 1 -- 172.21.15.60:0/374089715 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8014620 con 0x7f66e015f780 2024-09-12T01:45:21.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.135+0000 7f66d27fc640 1 -- 172.21.15.60:0/374089715 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66d8019070 con 0x7f66e015f780 2024-09-12T01:45:21.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.135+0000 7f66d27fc640 1 -- 172.21.15.60:0/374089715 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d8014a20 con 0x7f66e015f780 2024-09-12T01:45:21.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.135+0000 7f66e8186640 1 -- 172.21.15.60:0/374089715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e014f8f0 con 0x7f66e015f780 2024-09-12T01:45:21.137 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.135+0000 7f66e8186640 1 -- 172.21.15.60:0/374089715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e014feb0 con 0x7f66e015f780 2024-09-12T01:45:21.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.136+0000 7f66e8186640 1 -- 172.21.15.60:0/374089715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e006fc30 con 0x7f66e015f780 2024-09-12T01:45:21.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.137+0000 7f66d27fc640 1 -- 172.21.15.60:0/374089715 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f66d8014bc0 con 0x7f66e015f780 2024-09-12T01:45:21.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.137+0000 7f66d27fc640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66c406be60 0x7f66c406e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:21.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.137+0000 7f66d27fc640 1 -- 172.21.15.60:0/374089715 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f66d808b310 con 0x7f66e015f780 2024-09-12T01:45:21.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.137+0000 7f66e5f22640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66c406be60 0x7f66c406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:21.138 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.138+0000 7f66e5f22640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66c406be60 0x7f66c406e320 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f66dc034000 tx=0x7f66dc02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:21.141 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.141+0000 7f66d27fc640 1 -- 172.21.15.60:0/374089715 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f66d8059970 con 0x7f66e015f780 2024-09-12T01:45:21.320 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.320+0000 7f66e8186640 1 -- 172.21.15.60:0/374089715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f66e00d0af0 con 0x7f66e015f780 2024-09-12T01:45:21.323 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.323+0000 7f66d27fc640 1 -- 172.21.15.60:0/374089715 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v68)=0 v68) ==== 123+0+0 (secure 0 0 0) 0x7f66d805dc70 con 0x7f66e015f780 2024-09-12T01:45:21.324 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.324+0000 7f66d27fc640 1 -- 172.21.15.60:0/374089715 <== mon.0 v2:172.21.15.60:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f66d80624a0 con 0x7f66e015f780 2024-09-12T01:45:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.327+0000 7f66e8186640 1 -- 172.21.15.60:0/374089715 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66c406be60 msgr2=0x7f66c406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.327+0000 7f66e8186640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66c406be60 0x7f66c406e320 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f66dc034000 tx=0x7f66dc02e000 comp rx=0 tx=0).stop 2024-09-12T01:45:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.327+0000 7f66e8186640 1 -- 172.21.15.60:0/374089715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66e015f780 msgr2=0x7f66e01e8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.327+0000 7f66e8186640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66e015f780 0x7f66e01e8130 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f66d8007e70 tx=0x7f66d800e4b0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.327+0000 7f66e8186640 1 -- 172.21.15.60:0/374089715 shutdown_connections 2024-09-12T01:45:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.327+0000 7f66e8186640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f66e015f780 0x7f66e01e8130 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.327+0000 7f66e8186640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f66c406be60 0x7f66c406e320 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.327+0000 7f66e8186640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f66e00ae890 0x7f66e014e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.327+0000 7f66e8186640 1 --2- 172.21.15.60:0/374089715 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f66e00730d0 0x7f66e014f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.327 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.327+0000 7f66e8186640 1 -- 172.21.15.60:0/374089715 >> 172.21.15.60:0/374089715 conn(0x7f66e00b0aa0 msgr2=0x7f66e00afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.327+0000 7f66e8186640 1 -- 172.21.15.60:0/374089715 shutdown_connections 2024-09-12T01:45:21.328 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.327+0000 7f66e8186640 1 -- 172.21.15.60:0/374089715 wait complete. 2024-09-12T01:45:21.338 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-12T01:45:21.339 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-12T01:45:21.441 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.442+0000 7f4e09227640 1 Processor -- start 2024-09-12T01:45:21.442 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.442+0000 7f4e09227640 1 -- start start 2024-09-12T01:45:21.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e09227640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4e0415e800 0x7f4e040b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:21.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e09227640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e0415ebe0 0x7f4e0415f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:21.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e09227640 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e0406ea60 con 0x7f4e040b6e50 2024-09-12T01:45:21.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e09227640 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 -- 0x7f4e0406ed40 con 0x7f4e0415e800 2024-09-12T01:45:21.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e09227640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0406cde0 con 0x7f4e0415ebe0 2024-09-12T01:45:21.443 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e02d9d640 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4e0415e800 0x7f4e040b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:21.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e0359e640 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4e040b6e50 0x7f4e040b7280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46326/0 (socket says 172.21.15.60:46326) 2024-09-12T01:45:21.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e0359e640 1 -- 172.21.15.60:0/2599452169 learned_addr learned my addr 172.21.15.60:0/2599452169 (peer_addr_for_me v1:172.21.15.60:0/0) 2024-09-12T01:45:21.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e0259c640 1 --2- 172.21.15.60:0/2599452169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e0415ebe0 0x7f4e0415f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:21.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e02d9d640 1 -- 172.21.15.60:0/2599452169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e0415ebe0 msgr2=0x7f4e0415f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-12T01:45:21.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e02d9d640 1 --2- 172.21.15.60:0/2599452169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e0415ebe0 0x7f4e0415f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e02d9d640 1 -- 172.21.15.60:0/2599452169 >> v1:172.21.15.60:6789/0 conn(0x7f4e040b6e50 legacy=0x7f4e040b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e01d9b640 1 -- 172.21.15.60:0/2599452169 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786388573 0 0) 0x7f4e0406ea60 con 0x7f4e040b6e50 2024-09-12T01:45:21.444 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.443+0000 7f4e02d9d640 1 -- 172.21.15.60:0/2599452169 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0406d0c0 con 0x7f4e0415e800 2024-09-12T01:45:21.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.444+0000 7f4e02d9d640 1 --2- 172.21.15.60:0/2599452169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e0415e800 0x7f4e040b5460 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f4df40097a0 tx=0x7f4df402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08998a6d0e6057d server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:21.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.444+0000 7f4e01d9b640 1 -- 172.21.15.60:0/2599452169 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4037070 con 0x7f4e0415e800 2024-09-12T01:45:21.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.444+0000 7f4e01d9b640 1 -- 172.21.15.60:0/2599452169 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4df4032440 con 0x7f4e0415e800 2024-09-12T01:45:21.445 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.444+0000 7f4e01d9b640 1 -- 172.21.15.60:0/2599452169 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4032830 con 0x7f4e0415e800 2024-09-12T01:45:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.445+0000 7f4e09227640 1 -- 172.21.15.60:0/2599452169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e0415e800 msgr2=0x7f4e040b5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.445+0000 7f4e09227640 1 --2- 172.21.15.60:0/2599452169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e0415e800 0x7f4e040b5460 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f4df40097a0 tx=0x7f4df402a180 comp rx=0 tx=0).stop 2024-09-12T01:45:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.445+0000 7f4e09227640 1 -- 172.21.15.60:0/2599452169 shutdown_connections 2024-09-12T01:45:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.445+0000 7f4e09227640 1 --2- 172.21.15.60:0/2599452169 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e0415ebe0 0x7f4e0415f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.445+0000 7f4e09227640 1 --2- 172.21.15.60:0/2599452169 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e0415e800 0x7f4e040b5460 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.445+0000 7f4e09227640 1 -- 172.21.15.60:0/2599452169 >> 172.21.15.60:0/2599452169 conn(0x7f4e040d24d0 msgr2=0x7f4e040d28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.445+0000 7f4e09227640 1 -- 172.21.15.60:0/2599452169 shutdown_connections 2024-09-12T01:45:21.446 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.445+0000 7f4e09227640 1 -- 172.21.15.60:0/2599452169 wait complete. 2024-09-12T01:45:21.448 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.446+0000 7f4e09227640 1 Processor -- start 2024-09-12T01:45:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.446+0000 7f4e09227640 1 -- start start 2024-09-12T01:45:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.447+0000 7f4e09227640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040b6e50 0x7f4e040cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.447+0000 7f4e09227640 1 --2- >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0415e800 0x7f4e040cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.447+0000 7f4e09227640 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e0415ebe0 0x7f4e041576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.447+0000 7f4e09227640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0406e680 con 0x7f4e040b6e50 2024-09-12T01:45:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.447+0000 7f4e09227640 1 -- --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 -- 0x7f4e040d31e0 con 0x7f4e0415e800 2024-09-12T01:45:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.447+0000 7f4e09227640 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0406e800 con 0x7f4e0415ebe0 2024-09-12T01:45:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.447+0000 7f4e02d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040b6e50 0x7f4e040cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.447+0000 7f4e02d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040b6e50 0x7f4e040cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43490/0 (socket says 172.21.15.60:43490) 2024-09-12T01:45:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.447+0000 7f4e02d9d640 1 -- 172.21.15.60:0/855956303 learned_addr learned my addr 172.21.15.60:0/855956303 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-12T01:45:21.449 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4e0359e640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e0415ebe0 0x7f4e041576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4e02d9d640 1 -- 172.21.15.60:0/855956303 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e0415ebe0 msgr2=0x7f4e041576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4e0259c640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0415e800 0x7f4e040cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4e02d9d640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e0415ebe0 0x7f4e041576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4e02d9d640 1 -- 172.21.15.60:0/855956303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0415e800 msgr2=0x7f4e040cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4e02d9d640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0415e800 0x7f4e040cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4e02d9d640 1 -- 172.21.15.60:0/855956303 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e04159590 con 0x7f4e040b6e50 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4e0359e640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e0415ebe0 0x7f4e041576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4e0259c640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0415e800 0x7f4e040cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4e02d9d640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040b6e50 0x7f4e040cdfb0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f4df4000c00 tx=0x7f4df40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4deb7fe640 1 -- 172.21.15.60:0/855956303 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4041020 con 0x7f4e040b6e50 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4deb7fe640 1 -- 172.21.15.60:0/855956303 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4df4030740 con 0x7f4e040b6e50 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4e09227640 1 -- 172.21.15.60:0/855956303 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e04159870 con 0x7f4e040b6e50 2024-09-12T01:45:21.450 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4deb7fe640 1 -- 172.21.15.60:0/855956303 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4037040 con 0x7f4e040b6e50 2024-09-12T01:45:21.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.448+0000 7f4e09227640 1 -- 172.21.15.60:0/855956303 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e04159e30 con 0x7f4e040b6e50 2024-09-12T01:45:21.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.449+0000 7f4e09227640 1 -- 172.21.15.60:0/855956303 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e0415f070 con 0x7f4e040b6e50 2024-09-12T01:45:21.451 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.450+0000 7f4deb7fe640 1 -- 172.21.15.60:0/855956303 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 5) ==== 90498+0+0 (secure 0 0 0) 0x7f4df4044020 con 0x7f4e040b6e50 2024-09-12T01:45:21.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.450+0000 7f4deb7fe640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4df006be30 0x7f4df006e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-12T01:45:21.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.450+0000 7f4deb7fe640 1 -- 172.21.15.60:0/855956303 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 4943+0+0 (secure 0 0 0) 0x7f4df40ab850 con 0x7f4e040b6e50 2024-09-12T01:45:21.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.450+0000 7f4e0259c640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4df006be30 0x7f4df006e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-12T01:45:21.452 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.451+0000 7f4e0259c640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4df006be30 0x7f4df006e2f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009a20 tx=0x7f4df8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-12T01:45:21.453 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.454+0000 7f4deb7fe640 1 -- 172.21.15.60:0/855956303 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187697 (secure 0 0 0) 0x7f4df404b030 con 0x7f4e040b6e50 2024-09-12T01:45:21.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.668+0000 7f4e09227640 1 -- 172.21.15.60:0/855956303 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e040b7420 con 0x7f4e040b6e50 2024-09-12T01:45:21.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.670+0000 7f4deb7fe640 1 -- 172.21.15.60:0/855956303 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) ==== 94+0+3912 (secure 0 0 0) 0x7f4df407a700 con 0x7f4e040b6e50 2024-09-12T01:45:21.669 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-12T01:45:21.670 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":90,"btime":"2024-09-12T01:44:50:279792+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7609,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/877895322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6835","nonce":877895322},{"type":"v1","addr":"172.21.15.60:6837","nonce":877895322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":7621,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6835/3882170083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6833","nonce":3882170083},{"type":"v1","addr":"172.21.15.105:6835","nonce":3882170083}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":85},{"gid":8418,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6836/906162612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":906162612},{"type":"v1","addr":"172.21.15.60:6836","nonce":906162612}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84},{"gid":36896,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.105:6834/3562849263","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":3562849263},{"type":"v1","addr":"172.21.15.105:6834","nonce":3562849263}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":90}],"filesystems":[]} 2024-09-12T01:45:21.670 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 90 2024-09-12T01:45:21.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.672+0000 7f4e09227640 1 -- 172.21.15.60:0/855956303 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4df006be30 msgr2=0x7f4df006e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.672+0000 7f4e09227640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4df006be30 0x7f4df006e2f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009a20 tx=0x7f4df8008040 comp rx=0 tx=0).stop 2024-09-12T01:45:21.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.672+0000 7f4e09227640 1 -- 172.21.15.60:0/855956303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040b6e50 msgr2=0x7f4e040cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-12T01:45:21.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.672+0000 7f4e09227640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040b6e50 0x7f4e040cdfb0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f4df4000c00 tx=0x7f4df40046c0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.672+0000 7f4e09227640 1 -- 172.21.15.60:0/855956303 shutdown_connections 2024-09-12T01:45:21.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.672+0000 7f4e09227640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.60:6800/2696595369,v1:172.21.15.60:6801/2696595369] conn(0x7f4df006be30 0x7f4df006e2f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.672+0000 7f4e09227640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4e0415ebe0 0x7f4e041576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.672+0000 7f4e09227640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f4e0415e800 0x7f4e040cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.672 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.672+0000 7f4e09227640 1 --2- 172.21.15.60:0/855956303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e040b6e50 0x7f4e040cdfb0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-12T01:45:21.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.672+0000 7f4e09227640 1 -- 172.21.15.60:0/855956303 >> 172.21.15.60:0/855956303 conn(0x7f4e040d24d0 msgr2=0x7f4e0415b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-12T01:45:21.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.672+0000 7f4e09227640 1 -- 172.21.15.60:0/855956303 shutdown_connections 2024-09-12T01:45:21.673 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-12T01:45:21.672+0000 7f4e09227640 1 -- 172.21.15.60:0/855956303 wait complete. 2024-09-12T01:45:21.683 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-12T01:45:21.683 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T01:45:21.683 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-12T01:45:21.683 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:21.692 INFO:tasks.ceph.mds.a:Stopped 2024-09-12T01:45:21.693 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-12T01:45:21.693 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:21.742 INFO:tasks.ceph.mds.c:Stopped 2024-09-12T01:45:21.742 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-12T01:45:21.742 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:21.753 INFO:tasks.ceph.mds.b:Stopped 2024-09-12T01:45:21.754 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-12T01:45:21.754 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:21.806 INFO:tasks.ceph.mds.d:Stopped 2024-09-12T01:45:21.806 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T01:45:21.806 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T01:45:21.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:21.841 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T01:45:21.841 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T01:45:21.841 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:21.917 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T01:45:21.917 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T01:45:21.917 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:22.002 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T01:45:22.002 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T01:45:22.002 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:22.037 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T01:45:22.038 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T01:45:22.038 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:22.069 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T01:45:22.070 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T01:45:22.070 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:22.139 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T01:45:22.139 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T01:45:22.139 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:22.213 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T01:45:22.213 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T01:45:22.213 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:22.288 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T01:45:22.288 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T01:45:22.289 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T01:45:22.289 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:22.316 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T01:45:22.316 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T01:45:22.316 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:22.356 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T01:45:22.356 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T01:45:22.356 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T01:45:22.356 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:22.368 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T01:45:22.368 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T01:45:22.369 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:22.408 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T01:45:22.409 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T01:45:22.409 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:45:22.461 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T01:45:22.461 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T01:45:22.461 DEBUG:teuthology.orchestra.run.smithi060:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'responding to mclientcaps\(revoke\)' | egrep -v 'not advance its oldest_client_tid' | egrep -v 'failing to advance its oldest client/flush tid' | egrep -v 'Too many inodes in cache' | egrep -v 'failing to respond to cache pressure' | egrep -v 'slow requests are blocked' | egrep -v 'failing to respond to capability release' | egrep -v 'MDS cache is too large' | egrep -v '\(MDS_CLIENT_OLDEST_TID\)' | egrep -v '\(MDS_CACHE_OVERSIZED\)' | head -n 1 2024-09-12T01:45:22.503 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:45:22.503 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T01:45:22.737 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:45:22.737 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T01:45:22.817 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:45:22.818 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T01:45:23.009 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:45:23.009 DEBUG:teuthology.orchestra.run.smithi060:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T01:45:23.077 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:45:23.077 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T01:45:23.246 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:45:23.246 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T01:45:23.319 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:45:23.319 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T01:45:23.374 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:45:23.374 DEBUG:teuthology.orchestra.run.smithi105:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T01:45:23.425 INFO:tasks.ceph:Archiving mon data... 2024-09-12T01:45:23.426 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559/data/mon.a.tgz 2024-09-12T01:45:23.427 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-09-12T01:45:23.444 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.0SSAYQEB0v 2024-09-12T01:45:23.444 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0SSAYQEB0v 2024-09-12T01:45:23.607 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.0SSAYQEB0v 2024-09-12T01:45:23.692 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.0SSAYQEB0v is 395KB 2024-09-12T01:45:23.789 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.0SSAYQEB0v 2024-09-12T01:45:23.805 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559/data/mon.b.tgz 2024-09-12T01:45:23.805 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-09-12T01:45:23.824 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.0SfmfXKRPa 2024-09-12T01:45:23.825 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0SfmfXKRPa 2024-09-12T01:45:23.979 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.0SfmfXKRPa 2024-09-12T01:45:24.063 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.0SfmfXKRPa is 395KB 2024-09-12T01:45:24.160 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.0SfmfXKRPa 2024-09-12T01:45:24.175 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559/data/mon.c.tgz 2024-09-12T01:45:24.175 DEBUG:teuthology.orchestra.run.smithi105:> mktemp 2024-09-12T01:45:24.230 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.Xkki7tG2Ai 2024-09-12T01:45:24.230 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Xkki7tG2Ai 2024-09-12T01:45:24.363 DEBUG:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.Xkki7tG2Ai 2024-09-12T01:45:24.449 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.Xkki7tG2Ai is 396KB 2024-09-12T01:45:24.545 DEBUG:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.Xkki7tG2Ai 2024-09-12T01:45:24.560 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T01:45:24.560 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:45:24.563 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:45:24.646 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:45:24.680 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:45:24.680 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T01:45:24.682 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559/remote/smithi060/crash 2024-09-12T01:45:24.683 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:45:24.714 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559/remote/smithi105/crash 2024-09-12T01:45:24.715 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:45:24.744 INFO:tasks.ceph:Shutting down logrotate 2024-09-12T01:45:24.745 DEBUG:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:45:24.759 DEBUG:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-12T01:45:24.830 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T01:45:24.858 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-12T01:45:24.882 INFO:tasks.ceph:Compressing logs... 2024-09-12T01:45:24.883 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:45:24.901 DEBUG:teuthology.orchestra.run.smithi105:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:45:24.924 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T01:45:24.926 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61909.log 2024-09-12T01:45:24.926 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73580.log 2024-09-12T01:45:24.926 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69059.log 2024-09-12T01:45:24.926 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73580.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61909.log.gz 2024-09-12T01:45:24.926 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57066.log 2024-09-12T01:45:24.926 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.73580.log.gz 2024-09-12T01:45:24.927 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49472.log 2024-09-12T01:45:24.943 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75008.log 2024-09-12T01:45:24.943 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69059.log.gz 2024-09-12T01:45:24.943 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.57066.log: /var/log/ceph/ceph-client.admin.49472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43555.log 2024-09-12T01:45:24.943 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57066.log.gz 2024-09-12T01:45:24.943 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49472.log.gz 2024-09-12T01:45:24.943 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65188.log 2024-09-12T01:45:24.944 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.75008.log: /var/log/ceph/ceph-client.admin.43555.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75008.log.gz 2024-09-12T01:45:24.944 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56730.log 2024-09-12T01:45:24.944 INFO:teuthology.orchestra.run.smithi060.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43555.log.gz 2024-09-12T01:45:24.944 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64979.log 2024-09-12T01:45:24.944 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56730.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.65188.log.gz -5 2024-09-12T01:45:24.944 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.64243.log 2024-09-12T01:45:24.944 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56730.log.gz 2024-09-12T01:45:24.944 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59764.log 2024-09-12T01:45:24.944 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64979.log.gz 2024-09-12T01:45:24.944 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66206.log 2024-09-12T01:45:24.944 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59764.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64243.log.gz 2024-09-12T01:45:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47437.log 2024-09-12T01:45:24.945 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59764.log.gz 2024-09-12T01:45:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43686.log 2024-09-12T01:45:24.945 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66206.log.gz 2024-09-12T01:45:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61220.log 2024-09-12T01:45:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73664.log 2024-09-12T01:45:24.945 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47437.log.gz 2024-09-12T01:45:24.945 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43686.log.gz 2024-09-12T01:45:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71327.log 2024-09-12T01:45:24.945 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61220.log.gz 2024-09-12T01:45:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54266.log 2024-09-12T01:45:24.945 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71789.log 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.73664.log.gz 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71327.log.gz 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52730.log 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54266.log.gz 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70092.log 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.52730.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.71789.log.gz 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74294.log 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52730.log.gz 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.70092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73706.log 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.70092.log.gz 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58427.log 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73706.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.74294.log.gz 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68174.log 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73706.log.gz 2024-09-12T01:45:24.946 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58799.log 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58427.log.gz 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47017.log 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58799.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68174.log.gz 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59371.log 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58799.log.gz 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46719.log 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47017.log.gz 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70297.log 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46719.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59371.log.gz 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71411.log 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46719.log.gz 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59471.log 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.70297.log.gz 2024-09-12T01:45:24.947 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64159.log 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59471.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.71411.log.gz 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68719.log 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59471.log.gz 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43359.log 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64159.log.gz 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43356.log 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44101.log 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68719.log.gz 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43359.log.gz 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58884.log 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62035.log 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43356.log.gz 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44101.log: /var/log/ceph/ceph-client.admin.58884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68299.log 2024-09-12T01:45:24.948 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44101.log.gz 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58884.log.gz 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60672.log 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68299.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62035.log.gz 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75159.log 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68299.log.gz 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50038.log 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60672.log.gz 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.75159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55965.log 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50038.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.75159.log.gz 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55314.log 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55965.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50038.log.gz 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68425.log 2024-09-12T01:45:24.949 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55965.log.gz 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43891.log 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68425.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55314.log.gz 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65399.log 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68425.log.gz 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65063.log 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43891.log.gz 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64117.log 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65063.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.65399.log.gz 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57627.log 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.65063.log.gz 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49810.log 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64117.log.gz 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.57627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63112.log 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49810.log: gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.57627.log.gz 2024-09-12T01:45:24.950 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61010.log 2024-09-12T01:45:24.951 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49810.log.gz 2024-09-12T01:45:24.951 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72999.log 2024-09-12T01:45:24.951 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.63112.log.gz 2024-09-12T01:45:24.951 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58469.log 2024-09-12T01:45:24.951 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72999.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61010.log.gz 2024-09-12T01:45:24.951 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58258.log 2024-09-12T01:45:24.951 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72999.log.gz 2024-09-12T01:45:24.951 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73850.log 2024-09-12T01:45:24.951 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58469.log.gz 2024-09-12T01:45:24.951 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68090.log 2024-09-12T01:45:24.978 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44929.log 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.44929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43242.log 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44929.log.gz 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36984.log 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.3.43242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44419.log 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43242.log.gz 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36984.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.44419.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.1.44419.log.gz 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.1.43839.log 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36984.log.gz 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36853.log 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.43839.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T01:45:24.979 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43839.log.gz 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47700.log 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-osd.4.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36853.log.gz 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36944.log 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.47700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47700.log.gz 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36895.log 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36944.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr: 87.8%/var/log/ceph/ceph-client.admin.36895.log: -- replaced with /var/log/ceph/ceph-client.admin.36944.log.gz 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48817.log 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mon.c.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36895.log.gz 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42826.log 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.48817.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.1.48817.log.gz 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36773.log 2024-09-12T01:45:24.980 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.42826.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46596.log 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.1.42826.log.gz 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47107.log 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.46596.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36733.log 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.46596.log.gz 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36773.log.gz 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5/var/log/ceph/ceph-client.1.47107.log: --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.47107.log.gz 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36733.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr: 89.0%/var/log/ceph/ceph-osd.6.log: -- replaced with /var/log/ceph/ceph-client.admin.36733.log.gz 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37024.log 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.5.log: 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45990.log 2024-09-12T01:45:24.981 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.37024.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37024.log.gz 2024-09-12T01:45:24.982 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-12T01:45:24.982 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.45990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.45990.log.gz 2024-09-12T01:45:24.982 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T01:45:24.982 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mds.d.log: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:45:24.982 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T01:45:24.982 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mgr.x.log: 94.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T01:45:24.982 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36813.log 2024-09-12T01:45:24.985 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45439.log 2024-09-12T01:45:24.985 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.admin.36813.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36813.log.gz 2024-09-12T01:45:24.992 INFO:teuthology.orchestra.run.smithi105.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48266.log 2024-09-12T01:45:25.004 INFO:teuthology.orchestra.run.smithi105.stderr:/var/log/ceph/ceph-client.1.45439.log: 0.0%/var/log/ceph/ceph-client.1.48266.log: -- replaced with /var/log/ceph/ceph-client.1.45439.log.gz 2024-09-12T01:45:25.011 INFO:teuthology.orchestra.run.smithi105.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.48266.log.gz 2024-09-12T01:45:25.200 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73850.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.58258.log.gz 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53501.log 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.73850.log.gz 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54518.log 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.68090.log.gz 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53333.log 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65908.log 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53501.log.gz 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53333.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54518.log.gz 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46263.log 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53333.log.gz 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56091.log 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46263.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65908.log.gz 2024-09-12T01:45:25.201 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53039.log 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46263.log.gz 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56516.log 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56091.log.gz 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41691.log 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53039.log.gz 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42039.log 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56516.log.gz 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67478.log 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41691.log.gz 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51231.log 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67478.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42039.log.gz 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53081.log 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67478.log.gz 2024-09-12T01:45:25.202 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69904.log 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51231.log.gz 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62413.log 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69904.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53081.log.gz 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72933.log 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69904.log.gz 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60758.log 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62413.log.gz 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73361.log 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54392.log 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73361.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.72933.log.gz 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60758.log.gz 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56007.log 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73361.log.gz 2024-09-12T01:45:25.203 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68467.log 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54392.log.gz 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65021.log 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59155.log 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56007.log.gz 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65021.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68467.log.gz 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.65021.log.gz 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63682.log 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.1.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59155.log.gz 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45247.log 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42337.log 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63682.log.gz 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52434.log 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45247.log.gz 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59028.log 2024-09-12T01:45:25.204 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52392.log 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52434.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42337.log.gz 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59028.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52434.log.gzgzip 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46761.log 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59028.log.gzgzip 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67370.log 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52392.log: /var/log/ceph/ceph-client.admin.46761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42505.log 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52392.log.gz 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67370.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46761.log.gz 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48244.log 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67370.log.gz 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46677.log 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42505.log.gz 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71286.log 2024-09-12T01:45:25.205 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48244.log.gz 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62287.log 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46677.log: /var/log/ceph/ceph-client.admin.71286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51105.log 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46677.log.gz 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53207.log 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.71286.log.gz 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62287.log.gz 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72214.log 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53207.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51105.log.gz 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43693.log 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53207.log.gz 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54476.log 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.72214.log.gz 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5/var/log/ceph/ceph-client.admin.43693.log: --verbose -- /var/log/ceph/ceph-client.admin.60034.log 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71747.log 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43693.log.gz 2024-09-12T01:45:25.206 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54476.log.gz 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49213.log 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68761.log 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60034.log.gz 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71747.log: /var/log/ceph/ceph-client.admin.49213.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.71747.log.gz 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42253.log 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49213.log.gz 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49255.log 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68761.log: /var/log/ceph/ceph-client.admin.42253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65992.log 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68761.log.gz 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42253.log.gz 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62329.log 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65992.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49255.log.gz 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72639.log 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65992.log.gz 2024-09-12T01:45:25.207 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48625.log 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62329.log.gz 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56646.log 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72639.log.gzgzip 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57795.log 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48625.log: /var/log/ceph/ceph-client.admin.56646.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48625.log.gz 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58571.log 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43020.log 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.57795.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56646.log.gz 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58571.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57795.log.gz 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48961.log 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70616.log 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43020.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58571.log.gz 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48961.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43020.log.gz 2024-09-12T01:45:25.208 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42799.log 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42123.log 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70616.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48961.log.gz 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42799.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.70616.log.gz 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47143.log 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46889.log 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42123.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42799.log.gz 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72891.log 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42123.log.gz 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47143.log.gz 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52542.log 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72891.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46889.log.gz 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71705.log 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.72891.log.gz --verbose 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr: -- /var/log/ceph/ceph-client.admin.47998.log 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52542.log: /var/log/ceph/ceph-client.admin.71705.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52542.log.gz 2024-09-12T01:45:25.209 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54602.log 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.71705.log.gz 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47956.log 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47998.log: /var/log/ceph/ceph-client.admin.54602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74714.log 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47998.log.gz 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54602.log.gz 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45559.log 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47956.log.gz 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49129.log 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72048.log 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74714.log.gz 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45559.log: /var/log/ceph/ceph-client.admin.49129.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45559.log.gz 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47563.log 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49129.log.gz 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49996.log 2024-09-12T01:45:25.210 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72048.log: /var/log/ceph/ceph-client.admin.47563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60244.log 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72048.log.gz 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52981.log 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49996.log.gz 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47563.log.gz 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58697.log 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49087.log 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60244.log.gz 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58697.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52981.log.gz 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56898.log 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58697.log.gz 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74756.log 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49087.log.gz 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48751.log 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56898.log: /var/log/ceph/ceph-client.admin.74756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59806.log 2024-09-12T01:45:25.211 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56898.log.gz 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48751.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74756.log.gz 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65525.log 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:gzip 89.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.48751.log.gz -- 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.61262.log 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59806.log: /var/log/ceph/ceph-client.admin.65525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56392.log 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59806.log.gz 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65525.log.gz 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55587.log 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61262.log: /var/log/ceph/ceph-client.admin.56392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69628.log 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61262.log.gz 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56392.log.gz 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57987.log 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55587.log.gz 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46134.log 2024-09-12T01:45:25.212 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69628.log: /var/log/ceph/ceph-client.admin.57987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71968.log 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69628.log.gz 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4%/var/log/ceph/ceph-client.admin.46134.log: -- replaced with /var/log/ceph/ceph-client.admin.57987.log.gz 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72303.log 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46134.log.gz 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68383.log 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66122.log 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.71968.log.gz 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72303.log: /var/log/ceph/ceph-client.admin.68383.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.72303.log.gz 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51996.log 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68383.log.gz 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30142.log 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66122.log: /var/log/ceph/ceph-client.admin.51996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66458.log 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.66122.log.gz 2024-09-12T01:45:25.213 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.tmp-client.admin.30142.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51996.log.gz 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30142.log.gz 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56602.log 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51441.log 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66458.log.gz 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56049.log 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51441.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56602.log.gz 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53844.log 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51441.log.gz 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5/var/log/ceph/ceph-client.admin.56049.log: --verbose -- /var/log/ceph/ceph-client.admin.70255.log 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67922.log 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56049.log.gz 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53844.log.gz 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54308.log 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67922.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.70255.log.gz 2024-09-12T01:45:25.214 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56217.log 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67922.log.gz 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44673.log 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54308.log.gz 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65651.log 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56217.log.gz 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74420.log 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.44673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44673.log.gz 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54140.log 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74420.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65651.log.gz 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62986.log 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74420.log.gz 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64033.log 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70573.log 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54140.log.gz 2024-09-12T01:45:25.215 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62986.log: /var/log/ceph/ceph-client.admin.64033.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62986.log.gz 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55061.log 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64033.log.gz 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45349.log 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51865.log 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55061.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70573.log.gz 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60800.log 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55061.log.gz 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45349.log.gz 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60842.log 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51865.log.gz 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55409.log 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60800.log: /var/log/ceph/ceph-client.admin.60842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43022.log 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60800.log.gz 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60842.log.gz 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72130.log 2024-09-12T01:45:25.216 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67607.log 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43022.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55409.log.gz 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70700.log 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43022.log.gz 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72130.log.gz 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52290.log 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67607.log: /var/log/ceph/ceph-client.admin.70700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63870.log 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67607.log.gz 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70700.log.gz 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60716.log 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52290.log.gz 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50206.log 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.63870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63870.log.gz 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66500.log 2024-09-12T01:45:25.217 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61851.log 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60716.log.gz 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50206.log.gz 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56312.log 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66500.log.gz 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71663.log 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61851.log: /var/log/ceph/ceph-client.admin.56312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45517.log 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61851.log.gz 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56312.log.gz 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54224.log 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52809.log 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71663.log.gz 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45517.log: /var/log/ceph/ceph-client.admin.54224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45307.log 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45517.log.gz 2024-09-12T01:45:25.218 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54224.log.gz 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59429.log 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45391.log 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52809.log.gz 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45307.log.gz 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49297.log 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56474.log 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59429.log.gz 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45391.log.gz 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58300.log 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62245.log 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56474.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49297.log.gz 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58300.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.56474.log.gz 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70658.log 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70742.log 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62245.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58300.log.gz 2024-09-12T01:45:25.219 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70658.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62245.log.gz 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47101.log 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55881.log 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.70658.log.gz 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70742.log: /var/log/ceph/ceph-client.admin.47101.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.70742.log.gz 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73892.log 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47101.log.gz 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46933.log 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55881.log: /var/log/ceph/ceph-client.admin.73892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51742.log 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55881.log.gz 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46933.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73892.log.gz 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72765.log 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46933.log.gz 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73976.log 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51742.log.gz 2024-09-12T01:45:25.220 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.72765.log: /var/log/ceph/ceph-client.admin.69838.log 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56175.log 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.72765.log.gz 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69838.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.73976.log.gz 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57669.log 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53764.log 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56175.log: /var/log/ceph/ceph-client.admin.57669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72681.log 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.69838.log.gz 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56175.log.gz 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57669.log.gz 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49554.log 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53764.log: /var/log/ceph/ceph-client.admin.72681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65230.log 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53764.log.gz 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49554.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72681.log.gz 2024-09-12T01:45:25.221 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45915.log 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49554.log.gz 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44059.log 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46591.log 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65230.log.gz 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45915.log: /var/log/ceph/ceph-client.admin.44059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47059.log 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45915.log.gz 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44059.log.gz 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64538.log 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46591.log: /var/log/ceph/ceph-client.admin.47059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52038.log 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46591.log.gz 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64538.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47059.log.gz 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72555.log 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64538.log.gz 2024-09-12T01:45:25.222 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69101.log 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63574.log 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72555.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52038.log.gz 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69101.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.72555.log.gz 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58156.log 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69101.log.gz 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73790.log 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63574.log: /var/log/ceph/ceph-client.admin.58156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69460.log 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63574.log.gz 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73790.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58156.log.gz 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73790.log.gz 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42081.log 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74336.log 2024-09-12T01:45:25.223 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.69460.log.gz 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.42081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70976.log 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42081.log.gz 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64201.log 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71034.log 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70976.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74336.log.gz 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64201.log: gzip -5 88.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.70976.log.gz /var/log/ceph/ceph-client.admin.74588.log 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71034.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64201.log.gz 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66984.log 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74588.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71034.log.gz 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59113.log 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.66984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.66984.log.gz 2024-09-12T01:45:25.224 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64351.log 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74588.log.gz 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63490.log 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59113.log: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65146.log 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59113.log.gz 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64351.log.gz 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73187.log 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63490.log: /var/log/ceph/ceph-client.admin.65146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49894.log 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63490.log.gz 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65146.log.gz 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.73187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56558.log 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.73187.log.gz 2024-09-12T01:45:25.225 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71453.log 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49894.log: /var/log/ceph/ceph-client.admin.56558.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49894.log.gz 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70381.log 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56558.log.gz 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55839.log 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71453.log: /var/log/ceph/ceph-client.admin.70381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69376.log 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71453.log.gz 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.70381.log.gz 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55163.log 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55839.log.gz 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53967.log 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55163.log: gzip -5 --verbose -- 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69376.log.gz 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.62855.log 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55163.log.gz 2024-09-12T01:45:25.226 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47629.log 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53967.log.gz 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67160.log 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62855.log.gz 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42421.log 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72597.log 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47629.log.gz 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67160.log: /var/log/ceph/ceph-client.admin.42421.log: gzip -5 --verbose 87.9% -- -- replaced with /var/log/ceph/ceph-client.admin.67160.log.gz /var/log/ceph/ceph-client.admin.68006.log 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72259.log 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42421.log.gz 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72597.log: /var/log/ceph/ceph-client.admin.68006.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72597.log.gz 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58739.log 2024-09-12T01:45:25.227 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59197.log 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68006.log.gz 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72259.log: /var/log/ceph/ceph-client.admin.58739.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.72259.log.gz 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60884.log 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72513.log 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59197.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58739.log.gz 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60884.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59197.log.gz 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47479.log 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60884.log.gz 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58968.log 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47479.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.72513.log.gz 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54009.log 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74966.log 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58968.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47479.log.gz 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54009.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58968.log.gz 2024-09-12T01:45:25.228 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66332.log 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45838.log 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54009.log.gz 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74966.log: /var/log/ceph/ceph-client.admin.66332.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.74966.log.gz 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42841.log 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59722.log 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66332.log.gz 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45838.log: /var/log/ceph/ceph-client.admin.42841.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.45838.log.gz 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46347.log 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57294.log 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42841.log.gz 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59722.log: /var/log/ceph/ceph-client.admin.46347.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59722.log.gz 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51567.log 2024-09-12T01:45:25.229 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42631.log 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5%/var/log/ceph/ceph-client.admin.57294.log: -- replaced with /var/log/ceph/ceph-client.admin.46347.log.gz 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50628.log 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57294.log.gz 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51567.log.gz 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74462.log 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.50628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50628.log.gz 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42631.log.gz 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67786.log 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65357.log 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74462.log.gz 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44323.log 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66668.log 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67786.log.gz 2024-09-12T01:45:25.230 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65357.log: /var/log/ceph/ceph-client.admin.44323.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.65357.log.gz 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63949.log 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49045.log 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0%/var/log/ceph/ceph-client.admin.66668.log: -- replaced with /var/log/ceph/ceph-client.admin.44323.log.gz 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63949.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66668.log.gz 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65826.log 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60202.log 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63949.log.gz 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49045.log: /var/log/ceph/ceph-client.admin.65826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70171.log 88.4% 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49045.log.gz 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70423.log 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60202.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.65826.log.gz 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70171.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60202.log.gz 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72807.log 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64075.log 2024-09-12T01:45:25.231 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70171.log.gz 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70423.log: /var/log/ceph/ceph-client.admin.72807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66776.log 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.70423.log.gz 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48919.log 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.72807.log.gz 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64075.log: /var/log/ceph/ceph-client.admin.66776.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.64075.log.gz -5 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.55545.log 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65104.log 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66776.log.gz 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48919.log: /var/log/ceph/ceph-client.admin.55545.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48919.log.gz 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50979.log 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46221.log 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55545.log.gz 2024-09-12T01:45:25.232 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65104.log: /var/log/ceph/ceph-client.admin.50979.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.65104.log.gz 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54686.log 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58385.log 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50979.log.gz 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46221.log: /var/log/ceph/ceph-client.admin.54686.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46221.log.gz 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65441.log 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73622.log 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58385.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54686.log.gz 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65441.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58385.log.gz 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61993.log 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54098.log 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65441.log.gz 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73622.log: /var/log/ceph/ceph-client.admin.61993.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.73622.log.gz 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74504.log 2024-09-12T01:45:25.233 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69208.log 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54098.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61993.log.gz 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74504.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54098.log.gz 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64496.log 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65609.log 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69208.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74504.log.gz 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64496.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69208.log.gz 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71202.log 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53925.log 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64496.log.gz 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65609.log: /var/log/ceph/ceph-client.admin.71202.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65609.log.gz 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54182.log 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63154.log 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.71202.log.gz 2024-09-12T01:45:25.234 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53925.log: /var/log/ceph/ceph-client.admin.54182.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53925.log.gz 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53669.log 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70213.log 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.54182.log.gz 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63154.log: /var/log/ceph/ceph-client.admin.53669.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63154.log.gz 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66542.log 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60544.log 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70213.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53669.log.gz 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66542.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.70213.log.gz 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56772.log 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61951.log 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60544.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66542.log.gz 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56772.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60544.log.gzgzip 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51189.log 2024-09-12T01:45:25.235 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41957.log 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56772.log.gz 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61951.log: /var/log/ceph/ceph-client.admin.51189.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61951.log.gz 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71118.log 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41957.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51189.log.gz 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71118.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41957.log.gz 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60462.log 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose 88.8% -- /var/log/ceph/ceph-client.admin.62077.log -- replaced with /var/log/ceph/ceph-client.admin.71118.log.gz 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.60462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72345.log 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60462.log.gz 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72345.log: gzip -5 88.6% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.62077.log.gz /var/log/ceph/ceph-client.admin.44017.log 2024-09-12T01:45:25.236 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43688.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72345.log.gz 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48667.log 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58114.log 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48667.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44017.log.gz 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59639.log 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48667.log.gz 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67649.log 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58114.log.gz 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45999.log 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67864.log 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59639.log.gz 2024-09-12T01:45:25.237 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67649.log: /var/log/ceph/ceph-client.admin.45999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50707.log 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67649.log.gz 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67864.log: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.45999.log.gz 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.70880.log 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50707.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.67864.log.gz 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70784.log 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69502.log 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50707.log.gz 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70784.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.70880.log.gz 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61679.log 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55797.log 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70784.log.gz 2024-09-12T01:45:25.238 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69502.log: /var/log/ceph/ceph-client.admin.61679.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.69502.log.gz 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53291.log 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61679.log.gz 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55671.log 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55797.log: /var/log/ceph/ceph-client.admin.53291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43694.log 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55797.log.gz 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53291.log.gz 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54644.log 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46975.log 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1%/var/log/ceph/ceph-client.admin.43694.log: -- replaced with /var/log/ceph/ceph-client.admin.55671.log.gz 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54644.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43694.log.gz 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46635.log 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54644.log.gz 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66374.log 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46975.log: /var/log/ceph/ceph-client.admin.46635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43357.log 2024-09-12T01:45:25.239 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46975.log.gz 2024-09-12T01:45:25.240 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66374.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46635.log.gz 2024-09-12T01:45:25.240 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53543.log 2024-09-12T01:45:25.240 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66374.log.gz 2024-09-12T01:45:25.240 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71873.log 2024-09-12T01:45:25.240 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69670.log 2024-09-12T01:45:25.240 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53543.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43357.log.gz 2024-09-12T01:45:25.240 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71873.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53543.log.gz 2024-09-12T01:45:25.240 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71244.log 2024-09-12T01:45:25.240 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71873.log.gz 2024-09-12T01:45:25.240 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64753.log 2024-09-12T01:45:25.240 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69670.log: /var/log/ceph/ceph-client.admin.71244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49768.log 2024-09-12T01:45:25.240 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69670.log.gz 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6%/var/log/ceph/ceph-client.admin.64753.log: -- replaced with /var/log/ceph/ceph-client.admin.71244.log.gz 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46803.log 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64753.log.gz 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43691.log 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66626.log 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49768.log.gz 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46803.log: /var/log/ceph/ceph-client.admin.43691.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46803.log.gz 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62942.log 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43691.log.gz 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61178.log 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55923.log 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66626.log.gz 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61178.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62942.log.gz 2024-09-12T01:45:25.241 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49852.log 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61178.log.gz 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71369.log 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64937.log 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1%/var/log/ceph/ceph-client.admin.49852.log: -- replaced with /var/log/ceph/ceph-client.admin.55923.log.gz 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71369.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49852.log.gz 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55121.log 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71369.log.gz 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57168.log 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64937.log: /var/log/ceph/ceph-client.admin.55121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74168.log 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64937.log.gz 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.57168.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55121.log.gz 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49003.log 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57168.log.gz 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57024.log 2024-09-12T01:45:25.242 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.74168.log.gz 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55272.log 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49003.log: /var/log/ceph/ceph-client.admin.57024.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49003.log.gz 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49171.log 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57024.log.gz 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52122.log 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55272.log: /var/log/ceph/ceph-client.admin.49171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63406.log 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55272.log.gz 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52122.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49171.log.gz 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59555.log 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52122.log.gz 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68048.log 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42589.log 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63406.log.gz 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59555.log: /var/log/ceph/ceph-client.admin.68048.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59555.log.gz 2024-09-12T01:45:25.243 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69164.log 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.68048.log.gz 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53585.log 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42589.log: /var/log/ceph/ceph-client.admin.69164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61052.log 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42589.log.gz 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.69164.log.gz 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43018.log 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53585.log.gz 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59681.log 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46845.log 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61052.log.gz 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43018.log: /var/log/ceph/ceph-client.admin.59681.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43018.log.gz 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55629.log 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.59681.log.gz 2024-09-12T01:45:25.244 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46845.log: /var/log/ceph/ceph-client.admin.55629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50802.log 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46845.log.gz 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mon.a.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55629.log.gz 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74924.log 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52164.log 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50802.log.gz 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44185.log 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52164.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74924.log.gz 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62371.log 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44185.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52164.log.gz 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58926.log 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54350.log 2024-09-12T01:45:25.245 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58529.log 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62371.log.gz 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44185.log.gz 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43015.log 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58926.log.gz 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58529.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54350.log.gz 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47395.log 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43015.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58529.log.gz 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73538.log 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43015.log.gz 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52206.log 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73538.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47395.log.gz 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.73538.log.gz -5 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.58842.log 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56982.log 2024-09-12T01:45:25.246 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52206.log: /var/log/ceph/ceph-client.admin.58842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46549.log 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52206.log.gz 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58842.log.gz 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64394.log 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47185.log 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46549.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56982.log.gz 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71495.log 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46549.log.gz 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64394.log.gz 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56856.log 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61136.log 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47185.log.gz 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71495.log: /var/log/ceph/ceph-client.admin.56856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73438.log 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.71495.log.gz 2024-09-12T01:45:25.247 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56856.log.gz 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51063.log 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61136.log: /var/log/ceph/ceph-client.admin.73438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41861.log 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61136.log.gz 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73438.log.gz 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63070.log 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.41861.log: gzip 88.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.51063.log.gz -- 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.71076.log 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41861.log.gz 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69418.log 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51952.log 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63070.log.gz 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71076.log.gz 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73496.log 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57753.log 2024-09-12T01:45:25.248 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69418.log.gz 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73496.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51952.log.gz 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57837.log 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.73496.log.gz 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.57753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66416.log 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51315.log/var/log/ceph/ceph-client.admin.57837.log: 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57753.log.gz 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36510.log 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57837.log.gz 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66416.log.gz 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43933.log 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36510.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51315.log.gz 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66290.log 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36510.log.gz 2024-09-12T01:45:25.249 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73266.log 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66290.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66290.log.gz 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53249.log 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74546.log 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53249.log: 88.9%gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73266.log.gz 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53249.log.gz 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44809.log 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74546.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60160.log 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74546.log.gz 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71160.log 2024-09-12T01:45:25.250 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9%/var/log/ceph/ceph-client.admin.60160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46305.log 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44809.log.gz 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6%/var/log/ceph/ceph-client.admin.71160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64436.log 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60160.log.gz 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr:gzip/var/log/ceph/ceph-client.admin.46305.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51147.log 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71160.log.gz 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46305.log.gz 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64436.log: --verbose -- /var/log/ceph/ceph-client.admin.45670.log 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51147.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.64436.log.gz 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57711.log 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51147.log.gz 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57360.log 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45670.log.gz 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.57711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65273.log 2024-09-12T01:45:25.251 INFO:teuthology.orchestra.run.smithi060.stderr: 87.2%/var/log/ceph/ceph-client.admin.57360.log: gzip -- replaced with /var/log/ceph/ceph-client.admin.57711.log.gz 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43352.log 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65273.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57360.log.gz 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59866.log 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65273.log.gz 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58613.log 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43352.log.gz 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66584.log 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59866.log.gz 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57210.log 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66584.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.58613.log.gz 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.45433.log 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66584.log.gz 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.57210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49954.log 2024-09-12T01:45:25.252 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57210.log.gz 2024-09-12T01:45:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64853.log 2024-09-12T01:45:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49954.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45433.log.gz 2024-09-12T01:45:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62652.log 2024-09-12T01:45:25.253 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49954.log.gz 2024-09-12T01:45:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65746.log 2024-09-12T01:45:25.253 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64853.log.gz 2024-09-12T01:45:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51273.log 2024-09-12T01:45:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65746.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62652.log.gz 2024-09-12T01:45:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36245.log 2024-09-12T01:45:25.253 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.65746.log.gz 2024-09-12T01:45:25.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59908.log 2024-09-12T01:45:25.256 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51273.log.gz 2024-09-12T01:45:25.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74882.log 2024-09-12T01:45:25.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42167.log 2024-09-12T01:45:25.256 INFO:teuthology.orchestra.run.smithi060.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.36245.log.gz 2024-09-12T01:45:25.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74882.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59908.log.gz 2024-09-12T01:45:25.256 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72172.log 2024-09-12T01:45:25.256 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74882.log.gz 2024-09-12T01:45:25.256 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72849.log 2024-09-12T01:45:25.256 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42167.log.gz 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58030.log 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.72172.log.gz 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54728.log 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58030.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43975.log 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72849.log.gz 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54728.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58030.log.gz 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57252.log 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43975.log: -- /var/log/ceph/ceph-client.admin.66248.log 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.57252.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.54728.log.gz 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43975.log.gz 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66080.log 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57252.log.gz 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58072.log 2024-09-12T01:45:25.257 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66248.log: /var/log/ceph/ceph-client.admin.66080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66036.log 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66248.log.gz 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr:gzip 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.66080.log.gz 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.69586.log 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58072.log: /var/log/ceph/ceph-client.admin.66036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69796.log 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58072.log.gz/var/log/ceph/ceph-client.admin.69586.log: 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51399.log 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66036.log.gz 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69586.log.gz 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67521.log 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69796.log: /var/log/ceph/ceph-client.admin.51399.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.69796.log.gz 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63991.log 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51399.log.gz 2024-09-12T01:45:25.258 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67521.log.gz 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mgr.y.log: --verbose -- /var/log/ceph/ceph-client.admin.49392.log 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43021.log 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63991.log.gz 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64580.log 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49392.log.gz 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59513.log 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43021.log.gz 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56688.log 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64580.log.gz 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52904.log 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59513.log.gz 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62813.log 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56688.log: /var/log/ceph/ceph-client.admin.52904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73934.log 2024-09-12T01:45:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62813.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56688.log.gz 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52904.log.gz 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50164.log 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62813.log.gz 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72387.log 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73934.log: /var/log/ceph/ceph-client.admin.50164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60381.log 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72387.log: 89.8% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.73934.log.gz 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50164.log.gz 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72387.log.gz 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75109.log 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61094.log 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60381.log: gzip/var/log/ceph/ceph-client.admin.75109.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48447.log 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60381.log.gz 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75109.log.gz 2024-09-12T01:45:25.260 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61094.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 88.5% 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61094.log.gz 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42757.log 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48447.log.gz/var/log/ceph/ceph.log: 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53165.log 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44143.log 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42757.log.gz 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53165.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53165.log.gz 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64675.log 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.44143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69017.log 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44143.log.gz/var/log/ceph/ceph-client.admin.64675.log: 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47227.log 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64675.log.gz/var/log/ceph/ceph-client.admin.69017.log: 2024-09-12T01:45:25.261 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69754.log 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69017.log.gz 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59950.log 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69754.log: /var/log/ceph/ceph-client.admin.47227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43349.log 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69754.log.gz 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59950.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47227.log.gz 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48525.log 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59950.log.gz 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43349.log: -- /var/log/ceph/ceph-client.admin.50879.log 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48525.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43349.log.gz 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50290.log 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48525.log.gz 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5/var/log/ceph/ceph-client.admin.50879.log: --verbose -- /var/log/ceph/ceph-client.admin.50937.log 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50290.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50879.log.gz 2024-09-12T01:45:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72429.log 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50290.log.gz 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50937.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50937.log.gz 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75069.log 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51907.log 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72429.log: /var/log/ceph/ceph-client.admin.75069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42211.log 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51907.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72429.log.gz 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75069.log.gz 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43695.log 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51907.log.gz 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58198.log 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42211.log: /var/log/ceph/ceph-client.admin.43695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46507.log 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58198.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42211.log.gz 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43695.log.gz 2024-09-12T01:45:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63364.log 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58198.log.gz 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66164.log 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46507.log: /var/log/ceph/ceph-client.admin.63364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65567.log 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.66164.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46507.log.gz 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63364.log.gz 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62732.log 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66164.log.gz 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42379.log 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65567.log: /var/log/ceph/ceph-client.admin.62732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48709.log 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42379.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65567.log.gz 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62732.log.gz 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63280.log 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42379.log.gz 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73748.log 2024-09-12T01:45:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47269.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48709.log.gz 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.73748.log: /var/log/ceph/ceph-client.admin.63280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42463.log 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73748.log.gz/var/log/ceph/ceph-client.admin.47269.log: 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63280.log.gz 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47269.log.gz 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47521.log 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53375.log 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47521.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42463.log.gz 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65950.log 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47521.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55487.log 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53375.log: /var/log/ceph/ceph-client.admin.65950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49726.log 2024-09-12T01:45:25.265 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.55487.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53375.log.gz 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65950.log.gz 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- 89.6% -- replaced with /var/log/ceph/ceph-client.admin.55487.log.gz 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.63616.log 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60926.log 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49726.log.gz 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71831.log 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61600.log 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.63616.log.gz 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.60926.log.gz 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53417.log 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.61600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74672.log 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% 0.0% -- replaced with /var/log/ceph/ceph-client.0.61600.log.gz 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71831.log.gz 2024-09-12T01:45:25.266 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49682.log 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53417.log.gz 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58655.log 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.74672.log.gz 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60968.log 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49682.log.gz 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.58655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74840.log 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58655.log.gz 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68341.log 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60968.log: /var/log/ceph/ceph-client.admin.74840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43012.log 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68341.log: 88.7% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.74840.log.gz 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60968.log.gz 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68341.log.gz 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74210.log 2024-09-12T01:45:25.267 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68132.log 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43012.log.gz 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63238.log 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74210.log.gz 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43016.log 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68132.log: /var/log/ceph/ceph-client.admin.63238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64811.log 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43016.log: 88.3% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68132.log.gz 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63238.log.gz 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43016.log.gz 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60628.log 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55755.log 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64811.log.gz 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47896.log 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60628.log.gz/var/log/ceph/ceph-client.admin.55755.log: 2024-09-12T01:45:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50248.log 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55755.log.gz 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46042.log 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47896.log: /var/log/ceph/ceph-client.admin.50248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45748.log 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7%/var/log/ceph/ceph-client.admin.46042.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47896.log.gz 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50248.log.gz 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46042.log.gz 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68509.log 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43355.log 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45748.log.gz 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55713.log 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68509.log.gz 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48835.log 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43355.log: /var/log/ceph/ceph-client.admin.55713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43341.log 2024-09-12T01:45:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48835.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43355.log.gz 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55713.log.gz 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60286.log 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48835.log.gz 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67202.log 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43341.log: /var/log/ceph/ceph-client.admin.60286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51823.log 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67202.log: 88.3% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60286.log.gz 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43341.log.gz 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67202.log.gz 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67691.log 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61346.log 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51823.log.gz 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50332.log 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67691.log.gz 2024-09-12T01:45:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67328.log 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61346.log: /var/log/ceph/ceph-client.admin.50332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68215.log 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67328.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.50332.log.gz 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% 91.2% -- replaced with /var/log/ceph/ceph-client.admin.61346.log.gz 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67328.log.gz 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51483.log 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62119.log 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51483.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68215.log.gz 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69334.log 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51483.log.gz 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66710.log 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62119.log: /var/log/ceph/ceph-client.admin.69334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42295.log 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62119.log.gz 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1%/var/log/ceph/ceph-client.admin.66710.log: -- replaced with /var/log/ceph/ceph-client.admin.69334.log.gz 2024-09-12T01:45:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43023.log 2024-09-12T01:45:25.272 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67564.log 2024-09-12T01:45:25.272 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43023.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42295.log.gz 2024-09-12T01:45:25.272 INFO:teuthology.orchestra.run.smithi060.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.66710.log.gz 2024-09-12T01:45:25.272 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43023.log.gz 2024-09-12T01:45:25.272 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56940.log 2024-09-12T01:45:25.272 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50374.log 2024-09-12T01:45:25.272 INFO:teuthology.orchestra.run.smithi060.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67564.log.gz 2024-09-12T01:45:25.272 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50122.log 2024-09-12T01:45:25.272 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56940.log.gz 2024-09-12T01:45:25.272 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67065.log 2024-09-12T01:45:25.272 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71537.log 2024-09-12T01:45:25.272 INFO:teuthology.orchestra.run.smithi060.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50374.log.gz 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50122.log: /var/log/ceph/ceph-client.admin.67065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67117.log 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50122.log.gz 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4%/var/log/ceph/ceph-client.admin.71537.log: -- replaced with /var/log/ceph/ceph-client.admin.67065.log.gz 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr:gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71537.log.gz 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67244.log 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67117.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67117.log.gz 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr: /var/log/ceph/ceph-client.admin.45475.log 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48286.log 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67244.log.gz 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.45475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49638.log 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45475.log.gz 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60076.log 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48286.log: /var/log/ceph/ceph-client.admin.49638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53123.log 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60076.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48286.log.gz 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49638.log.gz 2024-09-12T01:45:25.273 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60076.log.gz 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59597.log 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63028.log 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53123.log.gz 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59070.log 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59597.log.gz 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48793.log 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63028.log: /var/log/ceph/ceph-client.admin.59070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46427.log 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48793.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63028.log.gz 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59070.log.gz 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62161.log 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48793.log.gz 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46427.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46427.log.gz 2024-09-12T01:45:25.274 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43689.log 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64895.log 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62161.log: gzip/var/log/ceph/ceph-client.admin.43689.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.68257.log 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.64895.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43689.log.gz 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62161.log.gz 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr:gzip 87.7% -5 --verbose -- /var/log/ceph/ceph-client.admin.68936.log 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64895.log.gz 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58343.log 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68257.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62455.log 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68936.log: /var/log/ceph/ceph-client.admin.58343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53459.log 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62455.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68936.log.gz 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.58343.log.gz 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48328.log 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62455.log.gz 2024-09-12T01:45:25.275 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51662.log 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53459.log: /var/log/ceph/ceph-client.admin.48328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69712.log 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53459.log.gz 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68677.log 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48328.log.gz 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51662.log.gz 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69712.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69712.log.gz 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72723.log 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49596.log 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68677.log.gz/var/log/ceph/ceph-client.admin.72723.log: 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68856.log 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.72723.log.gz 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56814.log 2024-09-12T01:45:25.276 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.49596.log: gzip -5 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49596.log.gz 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr: --verbose -- /var/log/ceph/ceph-client.admin.65483.log 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.56814.log: /var/log/ceph/ceph-client.admin.68856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71579.log 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6%/var/log/ceph/ceph-client.admin.65483.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68856.log.gz 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56814.log.gz 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50080.log 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65483.log.gz 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54794.log 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71579.log: gzip/var/log/ceph/ceph-client.admin.50080.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51525.log 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50080.log.gz 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71579.log.gz 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54794.log: gzip -5 --verbose 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54794.log.gz 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr: -- /var/log/ceph/ceph-client.admin.47311.log 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54434.log 2024-09-12T01:45:25.277 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51525.log.gz 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51021.log 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47311.log.gz 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46084.log 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54434.log.gz 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70339.log 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51021.log.gz 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74252.log 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46084.log.gz/var/log/ceph/ceph-client.admin.70339.log: 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62897.log 89.3% -- replaced with /var/log/ceph/ceph-client.admin.70339.log.gz 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60118.log 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.74252.log.gz 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52476.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62897.log.gz 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.278 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62557.log 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60118.log.gz/var/log/ceph/ceph-client.admin.52476.log: 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45113.log 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.62557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52248.log 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52476.log.gz 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62557.log.gz 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.2.45113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52080.log 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45113.log.gz/var/log/ceph/ceph-client.admin.52248.log: 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51357.log 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52248.log.gz 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60586.log 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52080.log.gz 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.51357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42673.log 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51357.log.gz 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.279 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.60586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50440.log 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60586.log.gz 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63448.log 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42673.log.gz 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.50440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62515.log 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50440.log.gzgzip 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43358.log 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63448.log: /var/log/ceph/ceph-client.admin.62515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74798.log 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.43358.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62515.log.gz 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63448.log.gz 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63532.log 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43358.log.gz 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63196.log 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74798.log: /var/log/ceph/ceph-client.admin.63532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68593.log 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.74798.log.gz 2024-09-12T01:45:25.280 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63196.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63532.log.gz 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67286.log 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.68593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69292.log 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63196.log.gz 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67286.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68593.log.gz 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62203.log 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67286.log.gz 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72471.log 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69292.log: /var/log/ceph/ceph-client.admin.62203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42547.log 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.72471.log: 89.6% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62203.log.gz 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69292.log.gz 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr:gzip 88.8% -5 --verbose -- /var/log/ceph/ceph-client.admin.42715.log 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72471.log.gz 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56133.log 2024-09-12T01:45:25.281 INFO:teuthology.orchestra.run.smithi060.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74378.log 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42547.log.gz 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.42715.log: /var/log/ceph/ceph-client.admin.56133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57548.log 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74378.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56133.log.gz 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42715.log.gz 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.74378.log.gz 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68635.log 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr:gzip/var/log/ceph/ceph-client.0.57548.log: -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57548.log.gz 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.68635.log: -- /var/log/ceph/ceph-client.admin.68551.log 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-osd.3.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68635.log.gz 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70465.log 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52332.log 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.70465.log: /var/log/ceph/ceph-client.admin.68551.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.70465.log.gz 2024-09-12T01:45:25.282 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68551.log.gz 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61304.log 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.52332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48877.log 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52332.log.gz 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.61304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54982.log 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61304.log.gz 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48877.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48877.log.gz 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.54982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54982.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61412.log 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36613.log 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.61412.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61412.log.gz 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74630.log 2024-09-12T01:45:25.283 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.36613.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36613.log.gz 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65315.log 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.74630.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.74630.log.gz 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46178.log 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.65315.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65315.log.gz 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59293.log 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.46178.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46178.log.gz 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71621.log 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59293.log: 92.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57879.log 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59293.log.gz 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.71621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47817.log 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.57879.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.71621.log.gz 2024-09-12T01:45:25.284 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57879.log.gz 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53627.log 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.0.47817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47817.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69250.log 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54054.log 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.53627.log: /var/log/ceph/ceph-client.admin.69250.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53627.log.gz 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.69250.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47353.log 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63322.log 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.47353.log: /var/log/ceph/ceph-client.admin.54054.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54054.log.gz 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47353.log.gz 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59992.log 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.63322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54560.log 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63322.log.gz 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.59992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48583.log 2024-09-12T01:45:25.285 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.54560.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59992.log.gz 2024-09-12T01:45:25.286 INFO:teuthology.orchestra.run.smithi060.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54560.log.gz 2024-09-12T01:45:25.286 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45957.log 2024-09-12T01:45:25.286 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67964.log 2024-09-12T01:45:25.286 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.48583.log: /var/log/ceph/ceph-client.admin.45957.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48583.log.gz 2024-09-12T01:45:25.286 INFO:teuthology.orchestra.run.smithi060.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45957.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57108.log 2024-09-12T01:45:25.286 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.286 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69544.log 2024-09-12T01:45:25.286 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.67964.log: /var/log/ceph/ceph-client.admin.57108.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67964.log.gz 2024-09-12T01:45:25.286 INFO:teuthology.orchestra.run.smithi060.stderr: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61774.log 2024-09-12T01:45:25.286 INFO:teuthology.orchestra.run.smithi060.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57108.log.gz 2024-09-12T01:45:25.286 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ceph-client.admin.69544.log: /var/log/ceph/ceph-client.admin.61774.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69544.log.gz 2024-09-12T01:45:25.286 INFO:teuthology.orchestra.run.smithi060.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61774.log.gz 2024-09-12T01:45:25.287 INFO:teuthology.orchestra.run.smithi060.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T01:45:25.287 INFO:teuthology.orchestra.run.smithi105.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T01:45:25.335 INFO:teuthology.orchestra.run.smithi105.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T01:45:25.535 INFO:teuthology.orchestra.run.smithi060.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T01:45:25.576 INFO:teuthology.orchestra.run.smithi105.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T01:45:25.640 INFO:teuthology.orchestra.run.smithi060.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T01:45:25.692 INFO:teuthology.orchestra.run.smithi060.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T01:45:25.694 INFO:teuthology.orchestra.run.smithi060.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T01:45:25.695 INFO:teuthology.orchestra.run.smithi105.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T01:45:25.788 INFO:teuthology.orchestra.run.smithi105.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T01:45:25.855 INFO:teuthology.orchestra.run.smithi105.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T01:45:25.872 INFO:teuthology.orchestra.run.smithi060.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T01:45:25.873 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-12T01:45:25.874 INFO:teuthology.orchestra.run.smithi060.stderr:real 0m0.960s 2024-09-12T01:45:25.874 INFO:teuthology.orchestra.run.smithi060.stderr:user 0m3.608s 2024-09-12T01:45:25.874 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m0.548s 2024-09-12T01:45:26.322 INFO:teuthology.orchestra.run.smithi105.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-12T01:45:26.455 INFO:teuthology.orchestra.run.smithi105.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-12T01:45:26.457 INFO:teuthology.orchestra.run.smithi105.stderr: 2024-09-12T01:45:26.457 INFO:teuthology.orchestra.run.smithi105.stderr:real 0m1.519s 2024-09-12T01:45:26.457 INFO:teuthology.orchestra.run.smithi105.stderr:user 0m6.466s 2024-09-12T01:45:26.457 INFO:teuthology.orchestra.run.smithi105.stderr:sys 0m0.223s 2024-09-12T01:45:26.457 INFO:tasks.ceph:Archiving logs... 2024-09-12T01:45:26.457 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559/remote/smithi060/log 2024-09-12T01:45:26.459 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:45:27.399 DEBUG:teuthology.misc:Transferring archived files from smithi105:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559/remote/smithi105/log 2024-09-12T01:45:27.399 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:45:28.175 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:45:28.184 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:45:28.184 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:45:28.187 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:45:28.293 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:45:28.302 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:45:28.303 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:45:28.306 DEBUG:teuthology.orchestra.run.smithi105:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:45:28.321 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:45:28.322 INFO:teuthology.orchestra.run.smithi105.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:45:28.326 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:45:28.326 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-12T01:45:28.326 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 22 -2276us[-2276us] +/- 65ms 2024-09-12T01:45:28.327 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv02.front.sepia.ceph.com 3 6 377 24 +4697ns[ -10us] +/- 63ms 2024-09-12T01:45:28.327 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 +2667us[+2667us] +/- 59ms 2024-09-12T01:45:28.327 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:28.328 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:45:28.328 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2024-09-12T01:45:28.328 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 26 -2421us[-2326us] +/- 65ms 2024-09-12T01:45:28.329 INFO:teuthology.orchestra.run.smithi105.stdout:^* hv02.front.sepia.ceph.com 3 6 377 23 -134us[ -39us] +/- 63ms 2024-09-12T01:45:28.329 INFO:teuthology.orchestra.run.smithi105.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +2530us[+2626us] +/- 59ms 2024-09-12T01:45:28.329 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:45:28.329 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:45:28.338 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:45:28.339 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:45:28.348 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:45:28.459 DEBUG:teuthology.orchestra.run.smithi105:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:45:28.532 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:45:28.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:45:28.564 DEBUG:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-12T01:45:28.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:45:28.593 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:45:28.602 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:45:28.629 INFO:teuthology.task.internal:Duration was 970.254031 seconds 2024-09-12T01:45:28.630 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:45:28.639 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:45:28.639 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:45:28.642 DEBUG:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:45:28.682 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:45:28.683 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:45:29.032 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:45:29.033 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-09-12T01:45:29.033 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:45:29.095 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi105.front.sepia.ceph.com 2024-09-12T01:45:29.096 DEBUG:teuthology.orchestra.run.smithi105:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:45:29.123 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:45:29.124 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:45:29.139 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:45:29.191 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:45:29.191 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:45:29.209 DEBUG:teuthology.orchestra.run.smithi105:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:45:29.344 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:45:29.360 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:45:29.361 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:45:29.387 DEBUG:teuthology.orchestra.run.smithi105:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:45:29.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:45:29.447 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:45:29.450 DEBUG:teuthology.orchestra.run.smithi105:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:45:29.472 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-09-12T01:45:29.477 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = core 2024-09-12T01:45:29.503 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:45:29.558 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:45:29.559 DEBUG:teuthology.orchestra.run.smithi105:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:45:29.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:45:29.574 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:45:29.584 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:45:29.585 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559/remote/smithi060 2024-09-12T01:45:29.585 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:45:29.635 DEBUG:teuthology.misc:Transferring archived files from smithi105:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-11_21:24:17-fs-squid-distro-default-smithi/7901559/remote/smithi105 2024-09-12T01:45:29.636 DEBUG:teuthology.orchestra.run.smithi105:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:45:29.671 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:45:29.671 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:45:29.673 DEBUG:teuthology.orchestra.run.smithi105:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:45:29.719 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:45:29.730 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:45:29.731 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:45:29.837 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:45:29.837 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:45:29.840 DEBUG:teuthology.orchestra.run.smithi105:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:45:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:45 /home/ubuntu/cephtest 2024-09-12T01:45:29.854 INFO:teuthology.orchestra.run.smithi105.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:45 /home/ubuntu/cephtest 2024-09-12T01:45:29.856 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:45:29.867 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:45:29.892 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/client-limits} duration: 970.2540311813354 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-12T01:45:29.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:45:29.989 INFO:teuthology.run:pass